2024-09-12T00:04:16.854 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T00:04:16.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T00:04:17.040 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901842 branch: wip-cls-rgw-busy-resharding description: rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} email: null first_in_suite: false job_id: '7901842' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-cls-rgw-busy-resharding ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 lockdep: true osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 lockdep: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 compression type: random ec-data-pool: false frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 tenant: RGW33333333333333333 force-branch: ceph-master storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-67986 sha1: 6a169fc940965ab446a63954fde870aa497efde7 owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 2206 sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f sleep_before_teardown: 0 suite: rgw suite_branch: wip-67986 suite_path: /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa suite_relpath: qa suite_repo: https://github.com/cbodley/ceph.git suite_sha1: 6a169fc940965ab446a63954fde870aa497efde7 targets: smithi043.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGf+v5ISJ+ENS1EDXSs857wfcuBDave/lWV0nldXgIyGgeDGaE0YL7jfsCsXFVKcRcwfx0JqC3qfA9yW1EdN1E0= smithi097.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEQ5/w4oC4TjXo1MLneYKKPa51CBrDnIMGQhg+h9op19OjYX29ks8HzjhIIhrzyNeANQlbs2ksd5F1uvhW6N9IA= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: force-branch: wip-67986 rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_23:33:24 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T00:04:17.040 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa; will attempt to use it 2024-09-12T00:04:17.041 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa/tasks 2024-09-12T00:04:17.041 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T00:04:17.042 INFO:teuthology.task.internal:Checking packages... 2024-09-12T00:04:17.064 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd011c522bb171e70fc5782f1e7a71ce5f37e573f' 2024-09-12T00:04:17.065 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T00:04:17.065 INFO:teuthology.packaging:ref: None 2024-09-12T00:04:17.065 INFO:teuthology.packaging:tag: None 2024-09-12T00:04:17.065 INFO:teuthology.packaging:branch: wip-cls-rgw-busy-resharding 2024-09-12T00:04:17.065 INFO:teuthology.packaging:sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:04:17.065 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-cls-rgw-busy-resharding 2024-09-12T00:04:17.231 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:04:17.233 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T00:04:17.237 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T00:04:17.237 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T00:04:17.241 INFO:teuthology.task.internal:Saving configuration 2024-09-12T00:04:17.262 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T00:04:17.267 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T00:04:17.298 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901842', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:58:37.042047', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPhySdd7P4viD6QB5ZsvtwZbgUFGhxAUG4v1WUG0jw/N'} 2024-09-12T00:04:17.327 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901842', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:58:37.040569', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKuyZQFPdsoUIq9DtkYtn+WJDwOi3L0ZApDFpcFLqZKt'} 2024-09-12T00:04:17.327 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T00:04:17.334 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T00:04:17.335 INFO:teuthology.task.internal:roles: ubuntu@smithi097.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T00:04:17.335 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T00:04:17.487 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3c4de27490>, signals=[15]) 2024-09-12T00:04:17.487 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T00:04:17.512 INFO:teuthology.task.internal:Opening connections... 2024-09-12T00:04:17.513 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi043.front.sepia.ceph.com 2024-09-12T00:04:17.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:04:17.607 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi097.front.sepia.ceph.com 2024-09-12T00:04:17.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:04:17.696 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T00:04:17.701 DEBUG:teuthology.orchestra.run.smithi043:> uname -m 2024-09-12T00:04:17.706 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2024-09-12T00:04:17.706 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2024-09-12T00:04:17.753 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T00:04:17.753 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="Ubuntu" 2024-09-12T00:04:17.753 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="22.04" 2024-09-12T00:04:17.753 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T00:04:17.753 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_CODENAME=jammy 2024-09-12T00:04:17.753 INFO:teuthology.orchestra.run.smithi043.stdout:ID=ubuntu 2024-09-12T00:04:17.753 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE=debian 2024-09-12T00:04:17.754 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T00:04:17.754 INFO:teuthology.orchestra.run.smithi043.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T00:04:17.754 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T00:04:17.754 INFO:teuthology.orchestra.run.smithi043.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T00:04:17.754 INFO:teuthology.orchestra.run.smithi043.stdout:UBUNTU_CODENAME=jammy 2024-09-12T00:04:17.754 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2024-09-12T00:04:17.788 DEBUG:teuthology.orchestra.run.smithi097:> uname -m 2024-09-12T00:04:17.793 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2024-09-12T00:04:17.793 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2024-09-12T00:04:17.839 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T00:04:17.839 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Ubuntu" 2024-09-12T00:04:17.839 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="22.04" 2024-09-12T00:04:17.839 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T00:04:17.839 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_CODENAME=jammy 2024-09-12T00:04:17.840 INFO:teuthology.orchestra.run.smithi097.stdout:ID=ubuntu 2024-09-12T00:04:17.840 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE=debian 2024-09-12T00:04:17.840 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T00:04:17.840 INFO:teuthology.orchestra.run.smithi097.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T00:04:17.840 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T00:04:17.840 INFO:teuthology.orchestra.run.smithi097.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T00:04:17.840 INFO:teuthology.orchestra.run.smithi097.stdout:UBUNTU_CODENAME=jammy 2024-09-12T00:04:17.840 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2024-09-12T00:04:17.871 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T00:04:17.880 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T00:04:17.884 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T00:04:17.885 DEBUG:teuthology.orchestra.run.smithi043:> test '!' -e /home/ubuntu/cephtest 2024-09-12T00:04:17.887 DEBUG:teuthology.orchestra.run.smithi097:> test '!' -e /home/ubuntu/cephtest 2024-09-12T00:04:17.892 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T00:04:17.897 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T00:04:17.897 DEBUG:teuthology.orchestra.run.smithi043:> test -z $(ls -A /var/lib/ceph) 2024-09-12T00:04:17.935 DEBUG:teuthology.orchestra.run.smithi097:> test -z $(ls -A /var/lib/ceph) 2024-09-12T00:04:17.948 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T00:04:18.035 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T00:04:18.050 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T00:04:18.050 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T00:04:18.050 DEBUG:teuthology.orchestra.run.smithi043:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T00:04:18.051 DEBUG:teuthology.orchestra.run.smithi097:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T00:04:18.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:04:18.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:04:18.056 DEBUG:teuthology.orchestra.run.smithi097:> uname -r 2024-09-12T00:04:18.057 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2024-09-12T00:04:18.104 INFO:teuthology.orchestra.run.smithi097.stdout:5.15.0-56-generic 2024-09-12T00:04:18.104 INFO:teuthology.task.kernel:Running kernel on smithi097: 5.15.0-56-generic 2024-09-12T00:04:18.104 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get clean 2024-09-12T00:04:18.106 INFO:teuthology.orchestra.run.smithi043.stdout:5.15.0-56-generic 2024-09-12T00:04:18.106 INFO:teuthology.task.kernel:Running kernel on smithi043: 5.15.0-56-generic 2024-09-12T00:04:18.106 DEBUG:teuthology.orchestra.run.smithi043:> sudo apt-get clean 2024-09-12T00:04:18.241 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get update 2024-09-12T00:04:18.249 DEBUG:teuthology.orchestra.run.smithi043:> sudo apt-get update 2024-09-12T00:04:18.391 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:04:18.403 INFO:teuthology.orchestra.run.smithi043.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T00:04:18.466 INFO:teuthology.orchestra.run.smithi043.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T00:04:18.498 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:04:18.505 INFO:teuthology.orchestra.run.smithi043.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T00:04:18.515 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T00:04:18.566 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T00:04:18.637 INFO:teuthology.orchestra.run.smithi043.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T00:04:18.733 INFO:teuthology.orchestra.run.smithi043.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T00:04:18.739 INFO:teuthology.orchestra.run.smithi043.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T00:04:18.742 INFO:teuthology.orchestra.run.smithi043.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T00:04:18.742 INFO:teuthology.orchestra.run.smithi043.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T00:04:18.761 INFO:teuthology.orchestra.run.smithi043.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T00:04:18.761 INFO:teuthology.orchestra.run.smithi043.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T00:04:18.765 INFO:teuthology.orchestra.run.smithi043.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T00:04:18.765 INFO:teuthology.orchestra.run.smithi043.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T00:04:18.771 INFO:teuthology.orchestra.run.smithi043.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T00:04:18.779 INFO:teuthology.orchestra.run.smithi043.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T00:04:18.781 INFO:teuthology.orchestra.run.smithi043.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T00:04:18.781 INFO:teuthology.orchestra.run.smithi043.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T00:04:18.782 INFO:teuthology.orchestra.run.smithi043.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T00:04:18.792 INFO:teuthology.orchestra.run.smithi043.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T00:04:18.809 INFO:teuthology.orchestra.run.smithi043.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T00:04:18.809 INFO:teuthology.orchestra.run.smithi043.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T00:04:18.809 INFO:teuthology.orchestra.run.smithi043.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T00:04:18.810 INFO:teuthology.orchestra.run.smithi043.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T00:04:18.810 INFO:teuthology.orchestra.run.smithi043.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T00:04:18.811 INFO:teuthology.orchestra.run.smithi043.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T00:04:18.811 INFO:teuthology.orchestra.run.smithi043.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T00:04:18.811 INFO:teuthology.orchestra.run.smithi043.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T00:04:18.812 INFO:teuthology.orchestra.run.smithi043.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T00:04:18.921 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T00:04:18.958 INFO:teuthology.orchestra.run.smithi043.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T00:04:18.963 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T00:04:19.060 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T00:04:19.274 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T00:04:19.377 INFO:teuthology.orchestra.run.smithi043.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T00:04:19.383 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T00:04:19.393 INFO:teuthology.orchestra.run.smithi043.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T00:04:19.399 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T00:04:19.401 INFO:teuthology.orchestra.run.smithi043.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T00:04:19.402 INFO:teuthology.orchestra.run.smithi043.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T00:04:19.407 INFO:teuthology.orchestra.run.smithi097.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T00:04:19.408 INFO:teuthology.orchestra.run.smithi097.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T00:04:19.409 INFO:teuthology.orchestra.run.smithi097.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T00:04:19.410 INFO:teuthology.orchestra.run.smithi097.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T00:04:19.424 INFO:teuthology.orchestra.run.smithi097.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T00:04:19.425 INFO:teuthology.orchestra.run.smithi097.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T00:04:19.492 INFO:teuthology.orchestra.run.smithi097.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T00:04:19.494 INFO:teuthology.orchestra.run.smithi097.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T00:04:19.498 INFO:teuthology.orchestra.run.smithi043.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T00:04:19.499 INFO:teuthology.orchestra.run.smithi043.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T00:04:19.505 INFO:teuthology.orchestra.run.smithi097.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T00:04:19.509 INFO:teuthology.orchestra.run.smithi097.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T00:04:19.511 INFO:teuthology.orchestra.run.smithi043.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T00:04:19.511 INFO:teuthology.orchestra.run.smithi043.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T00:04:19.531 INFO:teuthology.orchestra.run.smithi097.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T00:04:19.531 INFO:teuthology.orchestra.run.smithi097.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T00:04:19.532 INFO:teuthology.orchestra.run.smithi097.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T00:04:19.534 INFO:teuthology.orchestra.run.smithi043.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T00:04:19.544 INFO:teuthology.orchestra.run.smithi097.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T00:04:19.553 INFO:teuthology.orchestra.run.smithi043.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T00:04:19.559 INFO:teuthology.orchestra.run.smithi043.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T00:04:19.560 INFO:teuthology.orchestra.run.smithi043.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T00:04:19.562 INFO:teuthology.orchestra.run.smithi097.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T00:04:19.562 INFO:teuthology.orchestra.run.smithi043.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T00:04:19.564 INFO:teuthology.orchestra.run.smithi097.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T00:04:19.568 INFO:teuthology.orchestra.run.smithi097.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T00:04:19.572 INFO:teuthology.orchestra.run.smithi097.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T00:04:19.574 INFO:teuthology.orchestra.run.smithi097.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T00:04:19.576 INFO:teuthology.orchestra.run.smithi097.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T00:04:19.576 INFO:teuthology.orchestra.run.smithi097.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T00:04:19.576 INFO:teuthology.orchestra.run.smithi097.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T00:04:19.577 INFO:teuthology.orchestra.run.smithi097.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T00:04:19.577 INFO:teuthology.orchestra.run.smithi097.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T00:04:19.577 INFO:teuthology.orchestra.run.smithi097.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T00:04:19.640 INFO:teuthology.orchestra.run.smithi043.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T00:04:19.640 INFO:teuthology.orchestra.run.smithi043.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T00:04:19.645 INFO:teuthology.orchestra.run.smithi097.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T00:04:19.650 INFO:teuthology.orchestra.run.smithi097.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T00:04:19.650 INFO:teuthology.orchestra.run.smithi097.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T00:04:19.651 INFO:teuthology.orchestra.run.smithi097.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T00:04:19.653 INFO:teuthology.orchestra.run.smithi097.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T00:04:19.653 INFO:teuthology.orchestra.run.smithi097.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T00:04:19.656 INFO:teuthology.orchestra.run.smithi097.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T00:04:19.657 INFO:teuthology.orchestra.run.smithi097.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T00:04:19.737 INFO:teuthology.orchestra.run.smithi097.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T00:04:19.737 INFO:teuthology.orchestra.run.smithi097.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T00:04:25.499 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 15.8 MB in 3s (5,790 kB/s) 2024-09-12T00:04:25.612 INFO:teuthology.orchestra.run.smithi043.stdout:Fetched 15.8 MB in 2s (7,091 kB/s) 2024-09-12T00:04:27.014 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-09-12T00:04:27.017 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2024-09-12T00:04:27.032 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T00:04:27.035 DEBUG:teuthology.orchestra.run.smithi043:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T00:04:27.096 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-09-12T00:04:27.102 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2024-09-12T00:04:27.306 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-09-12T00:04:27.306 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-09-12T00:04:27.316 INFO:teuthology.orchestra.run.smithi043.stdout:Building dependency tree... 2024-09-12T00:04:27.316 INFO:teuthology.orchestra.run.smithi043.stdout:Reading state information... 2024-09-12T00:04:27.493 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:04:27.493 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:04:27.494 INFO:teuthology.orchestra.run.smithi097.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:04:27.494 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:04:27.494 INFO:teuthology.orchestra.run.smithi097.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T00:04:27.495 INFO:teuthology.orchestra.run.smithi097.stdout: python2.7-minimal 2024-09-12T00:04:27.495 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:04:27.495 INFO:teuthology.orchestra.run.smithi097.stdout:The following additional packages will be installed: 2024-09-12T00:04:27.495 INFO:teuthology.orchestra.run.smithi097.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T00:04:27.496 INFO:teuthology.orchestra.run.smithi097.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T00:04:27.496 INFO:teuthology.orchestra.run.smithi097.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T00:04:27.497 INFO:teuthology.orchestra.run.smithi097.stdout:Suggested packages: 2024-09-12T00:04:27.497 INFO:teuthology.orchestra.run.smithi097.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T00:04:27.497 INFO:teuthology.orchestra.run.smithi097.stdout:Recommended packages: 2024-09-12T00:04:27.497 INFO:teuthology.orchestra.run.smithi097.stdout: thermald 2024-09-12T00:04:27.511 INFO:teuthology.orchestra.run.smithi043.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:04:27.512 INFO:teuthology.orchestra.run.smithi043.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:04:27.512 INFO:teuthology.orchestra.run.smithi043.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:04:27.512 INFO:teuthology.orchestra.run.smithi043.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:04:27.512 INFO:teuthology.orchestra.run.smithi043.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T00:04:27.513 INFO:teuthology.orchestra.run.smithi043.stdout: python2.7-minimal 2024-09-12T00:04:27.513 INFO:teuthology.orchestra.run.smithi043.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:04:27.514 INFO:teuthology.orchestra.run.smithi043.stdout:The following additional packages will be installed: 2024-09-12T00:04:27.514 INFO:teuthology.orchestra.run.smithi043.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T00:04:27.514 INFO:teuthology.orchestra.run.smithi043.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T00:04:27.514 INFO:teuthology.orchestra.run.smithi043.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T00:04:27.516 INFO:teuthology.orchestra.run.smithi043.stdout:Suggested packages: 2024-09-12T00:04:27.516 INFO:teuthology.orchestra.run.smithi043.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T00:04:27.516 INFO:teuthology.orchestra.run.smithi043.stdout:Recommended packages: 2024-09-12T00:04:27.516 INFO:teuthology.orchestra.run.smithi043.stdout: thermald 2024-09-12T00:04:27.544 INFO:teuthology.orchestra.run.smithi097.stdout:The following NEW packages will be installed: 2024-09-12T00:04:27.544 INFO:teuthology.orchestra.run.smithi097.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T00:04:27.544 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T00:04:27.544 INFO:teuthology.orchestra.run.smithi097.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T00:04:27.545 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages will be upgraded: 2024-09-12T00:04:27.546 INFO:teuthology.orchestra.run.smithi097.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T00:04:27.578 INFO:teuthology.orchestra.run.smithi043.stdout:The following NEW packages will be installed: 2024-09-12T00:04:27.578 INFO:teuthology.orchestra.run.smithi043.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T00:04:27.578 INFO:teuthology.orchestra.run.smithi043.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T00:04:27.581 INFO:teuthology.orchestra.run.smithi043.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T00:04:27.581 INFO:teuthology.orchestra.run.smithi043.stdout:The following packages will be upgraded: 2024-09-12T00:04:27.581 INFO:teuthology.orchestra.run.smithi043.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T00:04:27.596 INFO:teuthology.orchestra.run.smithi097.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T00:04:27.596 INFO:teuthology.orchestra.run.smithi097.stdout:Need to get 113 MB of archives. 2024-09-12T00:04:27.596 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T00:04:27.596 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T00:04:27.761 INFO:teuthology.orchestra.run.smithi043.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T00:04:27.762 INFO:teuthology.orchestra.run.smithi043.stdout:Need to get 113 MB of archives. 2024-09-12T00:04:27.762 INFO:teuthology.orchestra.run.smithi043.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T00:04:27.762 INFO:teuthology.orchestra.run.smithi043.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T00:04:28.063 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T00:04:28.164 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T00:04:28.988 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T00:04:28.988 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T00:04:28.989 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T00:04:29.112 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T00:04:29.149 INFO:teuthology.orchestra.run.smithi043.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T00:04:29.205 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T00:04:29.505 INFO:teuthology.orchestra.run.smithi043.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T00:04:29.544 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 113 MB in 2s (68.6 MB/s) 2024-09-12T00:04:29.748 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T00:04:31.734 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T00:04:31.741 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:04:31.742 INFO:teuthology.orchestra.run.smithi043.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T00:04:31.742 INFO:teuthology.orchestra.run.smithi043.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T00:04:31.743 INFO:teuthology.orchestra.run.smithi043.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T00:04:31.904 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:04:32.485 INFO:teuthology.orchestra.run.smithi043.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T00:04:32.557 INFO:teuthology.orchestra.run.smithi043.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T00:04:32.989 INFO:teuthology.orchestra.run.smithi043.stdout:Fetched 113 MB in 5s (22.8 MB/s) 2024-09-12T00:04:33.187 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T00:04:34.139 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T00:04:34.160 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:04:34.252 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:04:34.734 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T00:04:34.754 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:04:34.792 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:04:35.214 INFO:teuthology.orchestra.run.smithi043.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T00:04:35.221 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:04:35.376 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:04:37.711 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T00:04:37.732 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:04:37.826 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:04:38.656 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T00:04:38.676 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:04:38.714 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:04:41.637 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:04:41.763 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:04:42.079 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:04:42.174 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:04:42.478 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T00:04:42.500 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T00:04:42.544 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T00:04:45.406 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:04:45.532 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:04:45.890 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:04:46.019 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:04:46.338 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T00:04:46.350 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T00:04:46.380 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T00:04:48.452 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T00:04:48.489 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:04:48.526 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:04:51.158 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:04:51.280 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:04:51.563 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T00:04:51.694 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:04:51.820 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T00:04:51.949 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:04:52.014 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T00:04:52.051 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:04:52.089 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:04:53.309 INFO:teuthology.orchestra.run.smithi097.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:04:53.309 INFO:teuthology.orchestra.run.smithi097.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T00:04:53.309 INFO:teuthology.orchestra.run.smithi097.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:04:53.309 INFO:teuthology.orchestra.run.smithi097.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T00:04:53.467 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:04:55.243 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:04:56.512 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:04:56.642 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:04:56.645 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T00:04:56.771 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T00:04:56.897 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:04:56.966 INFO:teuthology.orchestra.run.smithi097.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T00:04:56.966 INFO:teuthology.orchestra.run.smithi097.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:04:57.017 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T00:04:57.155 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:04:57.281 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T00:04:57.418 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:04:58.834 INFO:teuthology.orchestra.run.smithi043.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:04:58.834 INFO:teuthology.orchestra.run.smithi043.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T00:04:58.834 INFO:teuthology.orchestra.run.smithi043.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:04:58.834 INFO:teuthology.orchestra.run.smithi043.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T00:04:59.003 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:05:00.421 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:05:02.356 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T00:05:02.465 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T00:05:02.708 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:05:02.763 INFO:teuthology.orchestra.run.smithi043.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T00:05:02.763 INFO:teuthology.orchestra.run.smithi043.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:05:11.451 INFO:teuthology.orchestra.run.smithi097.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T00:05:11.452 INFO:teuthology.orchestra.run.smithi097.stdout:Sourcing file `/etc/default/grub' 2024-09-12T00:05:11.483 INFO:teuthology.orchestra.run.smithi097.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T00:05:11.506 INFO:teuthology.orchestra.run.smithi097.stdout:Generating grub configuration file ... 2024-09-12T00:05:11.738 INFO:teuthology.orchestra.run.smithi097.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:05:11.754 INFO:teuthology.orchestra.run.smithi097.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:05:12.020 INFO:teuthology.orchestra.run.smithi097.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:05:12.026 INFO:teuthology.orchestra.run.smithi097.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T00:05:12.097 INFO:teuthology.orchestra.run.smithi097.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T00:05:12.103 INFO:teuthology.orchestra.run.smithi097.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T00:05:12.286 INFO:teuthology.orchestra.run.smithi097.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T00:05:12.287 INFO:teuthology.orchestra.run.smithi097.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T00:05:12.287 INFO:teuthology.orchestra.run.smithi097.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T00:05:12.325 INFO:teuthology.orchestra.run.smithi097.stdout:done 2024-09-12T00:05:12.788 DEBUG:teuthology.orchestra.run.smithi097:> dpkg -s linux-image-generic 2024-09-12T00:05:12.810 INFO:teuthology.orchestra.run.smithi097.stdout:Package: linux-image-generic 2024-09-12T00:05:12.810 INFO:teuthology.orchestra.run.smithi097.stdout:Status: install ok installed 2024-09-12T00:05:12.810 INFO:teuthology.orchestra.run.smithi097.stdout:Priority: optional 2024-09-12T00:05:12.810 INFO:teuthology.orchestra.run.smithi097.stdout:Section: kernel 2024-09-12T00:05:12.810 INFO:teuthology.orchestra.run.smithi097.stdout:Installed-Size: 21 2024-09-12T00:05:12.810 INFO:teuthology.orchestra.run.smithi097.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T00:05:12.810 INFO:teuthology.orchestra.run.smithi097.stdout:Architecture: amd64 2024-09-12T00:05:12.810 INFO:teuthology.orchestra.run.smithi097.stdout:Source: linux-meta 2024-09-12T00:05:12.810 INFO:teuthology.orchestra.run.smithi097.stdout:Version: 5.15.0.119.119 2024-09-12T00:05:12.811 INFO:teuthology.orchestra.run.smithi097.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T00:05:12.811 INFO:teuthology.orchestra.run.smithi097.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T00:05:12.811 INFO:teuthology.orchestra.run.smithi097.stdout:Recommends: thermald 2024-09-12T00:05:12.811 INFO:teuthology.orchestra.run.smithi097.stdout:Description: Generic Linux kernel image 2024-09-12T00:05:12.811 INFO:teuthology.orchestra.run.smithi097.stdout: This package will always depend on the latest generic kernel image 2024-09-12T00:05:12.811 INFO:teuthology.orchestra.run.smithi097.stdout: available. 2024-09-12T00:05:12.811 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T00:05:12.811 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T00:05:12.811 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T00:05:12.812 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-12T00:05:12.812 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi097.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T00:05:12.812 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get clean 2024-09-12T00:05:12.978 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get update 2024-09-12T00:05:13.092 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:05:13.092 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T00:05:13.102 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T00:05:13.119 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T00:05:14.573 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-09-12T00:05:14.592 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T00:05:14.653 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-09-12T00:05:14.862 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-09-12T00:05:14.873 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-09-12T00:05:15.055 INFO:teuthology.orchestra.run.smithi097.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T00:05:15.055 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:05:15.055 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:05:15.055 INFO:teuthology.orchestra.run.smithi097.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:05:15.055 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:05:15.056 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:05:15.056 INFO:teuthology.orchestra.run.smithi097.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:05:15.056 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:05:15.096 INFO:teuthology.orchestra.run.smithi097.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T00:05:15.100 DEBUG:teuthology.orchestra.run.smithi097:> dpkg -s linux-image-generic 2024-09-12T00:05:15.117 INFO:teuthology.orchestra.run.smithi097.stdout:Package: linux-image-generic 2024-09-12T00:05:15.117 INFO:teuthology.orchestra.run.smithi097.stdout:Status: install ok installed 2024-09-12T00:05:15.117 INFO:teuthology.orchestra.run.smithi097.stdout:Priority: optional 2024-09-12T00:05:15.117 INFO:teuthology.orchestra.run.smithi097.stdout:Section: kernel 2024-09-12T00:05:15.117 INFO:teuthology.orchestra.run.smithi097.stdout:Installed-Size: 21 2024-09-12T00:05:15.117 INFO:teuthology.orchestra.run.smithi097.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T00:05:15.117 INFO:teuthology.orchestra.run.smithi097.stdout:Architecture: amd64 2024-09-12T00:05:15.117 INFO:teuthology.orchestra.run.smithi097.stdout:Source: linux-meta 2024-09-12T00:05:15.117 INFO:teuthology.orchestra.run.smithi097.stdout:Version: 5.15.0.119.119 2024-09-12T00:05:15.118 INFO:teuthology.orchestra.run.smithi097.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T00:05:15.118 INFO:teuthology.orchestra.run.smithi097.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T00:05:15.118 INFO:teuthology.orchestra.run.smithi097.stdout:Recommends: thermald 2024-09-12T00:05:15.118 INFO:teuthology.orchestra.run.smithi097.stdout:Description: Generic Linux kernel image 2024-09-12T00:05:15.118 INFO:teuthology.orchestra.run.smithi097.stdout: This package will always depend on the latest generic kernel image 2024-09-12T00:05:15.118 INFO:teuthology.orchestra.run.smithi097.stdout: available. 2024-09-12T00:05:15.118 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2024-09-12T00:05:15.162 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.hbr0u6yKsN 2024-09-12T00:05:15.163 DEBUG:teuthology.orchestra.run.smithi097:> sudo cp /boot/grub/grub.cfg /tmp/tmp.hbr0u6yKsN 2024-09-12T00:05:15.218 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.hbr0u6yKsN 2024-09-12T00:05:15.330 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.hbr0u6yKsN is 10KB 2024-09-12T00:05:15.342 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.hbr0u6yKsN 2024-09-12T00:05:15.347 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T00:05:15.402 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T00:05:15.402 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T00:05:15.402 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T00:05:15.465 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T00:05:15.465 DEBUG:teuthology.orchestra.run.smithi097:> sudo update-grub 2024-09-12T00:05:16.727 INFO:teuthology.orchestra.run.smithi097.stderr:Sourcing file `/etc/default/grub' 2024-09-12T00:05:16.728 INFO:teuthology.orchestra.run.smithi097.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T00:05:16.734 INFO:teuthology.orchestra.run.smithi097.stderr:Generating grub configuration file ... 2024-09-12T00:05:16.905 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:05:16.912 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:05:17.129 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:05:17.134 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T00:05:17.174 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T00:05:17.180 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T00:05:17.204 INFO:teuthology.orchestra.run.smithi043.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T00:05:17.204 INFO:teuthology.orchestra.run.smithi043.stdout:Sourcing file `/etc/default/grub' 2024-09-12T00:05:17.233 INFO:teuthology.orchestra.run.smithi043.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T00:05:17.298 INFO:teuthology.orchestra.run.smithi043.stdout:Generating grub configuration file ... 2024-09-12T00:05:17.304 INFO:teuthology.orchestra.run.smithi097.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T00:05:17.304 INFO:teuthology.orchestra.run.smithi097.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T00:05:17.304 INFO:teuthology.orchestra.run.smithi097.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T00:05:17.316 INFO:teuthology.orchestra.run.smithi097.stderr:done 2024-09-12T00:05:17.334 DEBUG:teuthology.orchestra.run.smithi097:> sudo shutdown -r now 2024-09-12T00:05:17.785 INFO:teuthology.orchestra.run.smithi043.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:05:17.813 INFO:teuthology.orchestra.run.smithi043.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:05:18.182 INFO:teuthology.orchestra.run.smithi043.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:05:18.188 INFO:teuthology.orchestra.run.smithi043.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T00:05:18.253 INFO:teuthology.orchestra.run.smithi043.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T00:05:18.258 INFO:teuthology.orchestra.run.smithi043.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T00:05:18.397 INFO:teuthology.orchestra.run.smithi043.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T00:05:18.397 INFO:teuthology.orchestra.run.smithi043.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T00:05:18.398 INFO:teuthology.orchestra.run.smithi043.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T00:05:18.433 INFO:teuthology.orchestra.run.smithi043.stdout:done 2024-09-12T00:05:18.969 DEBUG:teuthology.orchestra.run.smithi043:> dpkg -s linux-image-generic 2024-09-12T00:05:18.995 INFO:teuthology.orchestra.run.smithi043.stdout:Package: linux-image-generic 2024-09-12T00:05:18.995 INFO:teuthology.orchestra.run.smithi043.stdout:Status: install ok installed 2024-09-12T00:05:18.995 INFO:teuthology.orchestra.run.smithi043.stdout:Priority: optional 2024-09-12T00:05:18.995 INFO:teuthology.orchestra.run.smithi043.stdout:Section: kernel 2024-09-12T00:05:18.995 INFO:teuthology.orchestra.run.smithi043.stdout:Installed-Size: 21 2024-09-12T00:05:18.995 INFO:teuthology.orchestra.run.smithi043.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T00:05:18.995 INFO:teuthology.orchestra.run.smithi043.stdout:Architecture: amd64 2024-09-12T00:05:18.996 INFO:teuthology.orchestra.run.smithi043.stdout:Source: linux-meta 2024-09-12T00:05:18.996 INFO:teuthology.orchestra.run.smithi043.stdout:Version: 5.15.0.119.119 2024-09-12T00:05:18.996 INFO:teuthology.orchestra.run.smithi043.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T00:05:18.996 INFO:teuthology.orchestra.run.smithi043.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T00:05:18.996 INFO:teuthology.orchestra.run.smithi043.stdout:Recommends: thermald 2024-09-12T00:05:18.996 INFO:teuthology.orchestra.run.smithi043.stdout:Description: Generic Linux kernel image 2024-09-12T00:05:18.996 INFO:teuthology.orchestra.run.smithi043.stdout: This package will always depend on the latest generic kernel image 2024-09-12T00:05:18.996 INFO:teuthology.orchestra.run.smithi043.stdout: available. 2024-09-12T00:05:18.996 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T00:05:18.996 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T00:05:18.996 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T00:05:18.997 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T00:05:18.997 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi043.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T00:05:18.997 DEBUG:teuthology.orchestra.run.smithi043:> sudo apt-get clean 2024-09-12T00:05:19.165 DEBUG:teuthology.orchestra.run.smithi043:> sudo apt-get update 2024-09-12T00:05:19.290 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:05:19.300 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T00:05:19.320 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T00:05:19.408 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T00:05:20.854 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2024-09-12T00:05:20.873 DEBUG:teuthology.orchestra.run.smithi043:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T00:05:20.927 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2024-09-12T00:05:21.117 INFO:teuthology.orchestra.run.smithi043.stdout:Building dependency tree... 2024-09-12T00:05:21.120 INFO:teuthology.orchestra.run.smithi043.stdout:Reading state information... 2024-09-12T00:05:21.291 INFO:teuthology.orchestra.run.smithi043.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T00:05:21.291 INFO:teuthology.orchestra.run.smithi043.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:05:21.291 INFO:teuthology.orchestra.run.smithi043.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:05:21.291 INFO:teuthology.orchestra.run.smithi043.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:05:21.291 INFO:teuthology.orchestra.run.smithi043.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:05:21.292 INFO:teuthology.orchestra.run.smithi043.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:05:21.292 INFO:teuthology.orchestra.run.smithi043.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:05:21.292 INFO:teuthology.orchestra.run.smithi043.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:05:21.331 INFO:teuthology.orchestra.run.smithi043.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T00:05:21.333 DEBUG:teuthology.orchestra.run.smithi043:> dpkg -s linux-image-generic 2024-09-12T00:05:21.388 INFO:teuthology.orchestra.run.smithi043.stdout:Package: linux-image-generic 2024-09-12T00:05:21.388 INFO:teuthology.orchestra.run.smithi043.stdout:Status: install ok installed 2024-09-12T00:05:21.388 INFO:teuthology.orchestra.run.smithi043.stdout:Priority: optional 2024-09-12T00:05:21.388 INFO:teuthology.orchestra.run.smithi043.stdout:Section: kernel 2024-09-12T00:05:21.389 INFO:teuthology.orchestra.run.smithi043.stdout:Installed-Size: 21 2024-09-12T00:05:21.389 INFO:teuthology.orchestra.run.smithi043.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T00:05:21.389 INFO:teuthology.orchestra.run.smithi043.stdout:Architecture: amd64 2024-09-12T00:05:21.389 INFO:teuthology.orchestra.run.smithi043.stdout:Source: linux-meta 2024-09-12T00:05:21.389 INFO:teuthology.orchestra.run.smithi043.stdout:Version: 5.15.0.119.119 2024-09-12T00:05:21.389 INFO:teuthology.orchestra.run.smithi043.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T00:05:21.389 INFO:teuthology.orchestra.run.smithi043.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T00:05:21.389 INFO:teuthology.orchestra.run.smithi043.stdout:Recommends: thermald 2024-09-12T00:05:21.389 INFO:teuthology.orchestra.run.smithi043.stdout:Description: Generic Linux kernel image 2024-09-12T00:05:21.389 INFO:teuthology.orchestra.run.smithi043.stdout: This package will always depend on the latest generic kernel image 2024-09-12T00:05:21.389 INFO:teuthology.orchestra.run.smithi043.stdout: available. 2024-09-12T00:05:21.390 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2024-09-12T00:05:21.433 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.ZLMhJFbNR3 2024-09-12T00:05:21.433 DEBUG:teuthology.orchestra.run.smithi043:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ZLMhJFbNR3 2024-09-12T00:05:21.499 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.ZLMhJFbNR3 2024-09-12T00:05:21.611 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.ZLMhJFbNR3 is 10KB 2024-09-12T00:05:21.624 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.ZLMhJFbNR3 2024-09-12T00:05:21.629 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T00:05:21.684 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:05:21.685 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T00:05:21.685 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T00:05:21.756 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T00:05:21.757 DEBUG:teuthology.orchestra.run.smithi043:> sudo update-grub 2024-09-12T00:05:23.242 INFO:teuthology.orchestra.run.smithi043.stderr:Sourcing file `/etc/default/grub' 2024-09-12T00:05:23.243 INFO:teuthology.orchestra.run.smithi043.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T00:05:23.246 INFO:teuthology.orchestra.run.smithi043.stderr:Generating grub configuration file ... 2024-09-12T00:05:23.512 INFO:teuthology.orchestra.run.smithi043.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:05:23.518 INFO:teuthology.orchestra.run.smithi043.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:05:23.825 INFO:teuthology.orchestra.run.smithi043.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:05:23.831 INFO:teuthology.orchestra.run.smithi043.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T00:05:23.872 INFO:teuthology.orchestra.run.smithi043.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T00:05:23.877 INFO:teuthology.orchestra.run.smithi043.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T00:05:24.013 INFO:teuthology.orchestra.run.smithi043.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T00:05:24.013 INFO:teuthology.orchestra.run.smithi043.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T00:05:24.013 INFO:teuthology.orchestra.run.smithi043.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T00:05:24.035 INFO:teuthology.orchestra.run.smithi043.stderr:done 2024-09-12T00:05:24.044 DEBUG:teuthology.orchestra.run.smithi043:> sudo shutdown -r now 2024-09-12T00:05:47.357 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-12T00:05:47.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-12T00:05:47.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:05:54.093 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T00:05:54.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-12T00:05:54.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:06:22.014 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-09-12T00:06:31.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-12T00:06:31.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:06:54.125 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T00:07:02.779 DEBUG:teuthology.orchestra.run.smithi097:> true 2024-09-12T00:07:03.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-12T00:07:03.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:07:03.523 DEBUG:teuthology.orchestra.run.smithi043:> true 2024-09-12T00:07:03.941 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-12T00:07:03.941 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-119-generic"... 2024-09-12T00:07:03.941 DEBUG:teuthology.orchestra.run.smithi097:> uname -r 2024-09-12T00:07:03.987 INFO:teuthology.orchestra.run.smithi097.stdout:5.15.0-119-generic 2024-09-12T00:07:03.988 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T00:07:03.988 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T00:07:03.988 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T00:07:04.274 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-12T00:07:04.275 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-12T00:07:04.275 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2024-09-12T00:07:04.322 INFO:teuthology.orchestra.run.smithi043.stdout:5.15.0-119-generic 2024-09-12T00:07:04.323 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T00:07:04.323 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T00:07:04.323 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T00:07:04.989 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-12T00:07:04.989 DEBUG:teuthology.orchestra.run.smithi097:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T00:07:05.191 INFO:teuthology.orchestra.run.smithi097.stdout:ttyS1 2024-09-12T00:07:05.230 DEBUG:teuthology.parallel:result is None 2024-09-12T00:07:05.323 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T00:07:05.323 DEBUG:teuthology.orchestra.run.smithi043:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T00:07:05.875 INFO:teuthology.orchestra.run.smithi043.stdout:ttyS1 2024-09-12T00:07:05.905 DEBUG:teuthology.parallel:result is None 2024-09-12T00:07:05.905 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T00:07:05.926 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T00:07:05.926 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T00:07:05.929 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T00:07:05.936 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T00:07:05.945 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T00:07:05.953 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T00:07:05.953 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T00:07:05.975 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T00:07:06.013 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T00:07:06.019 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T00:07:06.019 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T00:07:06.051 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T00:07:06.071 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:07:06.077 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:07:06.081 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:07:06.085 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:07:06.087 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T00:07:06.092 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T00:07:06.092 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T00:07:06.127 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T00:07:06.170 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T00:07:06.205 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T00:07:06.205 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T00:07:06.208 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T00:07:06.216 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:07:06.259 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:07:06.307 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:07:06.307 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T00:07:06.369 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:07:06.376 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:07:06.424 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T00:07:06.424 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T00:07:06.490 DEBUG:teuthology.orchestra.run.smithi043:> sudo service rsyslog restart 2024-09-12T00:07:06.493 DEBUG:teuthology.orchestra.run.smithi097:> sudo service rsyslog restart 2024-09-12T00:07:06.568 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T00:07:06.600 INFO:teuthology.task.internal:Starting timer... 2024-09-12T00:07:06.600 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T00:07:06.614 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T00:07:06.651 DEBUG:teuthology.task.selinux:Excluding smithi043: OS 'ubuntu' does not support SELinux 2024-09-12T00:07:06.652 DEBUG:teuthology.task.selinux:Excluding smithi097: OS 'ubuntu' does not support SELinux 2024-09-12T00:07:06.652 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T00:07:06.652 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-12T00:07:06.652 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T00:07:06.652 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T00:07:06.660 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T00:07:06.663 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T00:07:06.781 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T00:07:06.792 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T00:07:06.793 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi043.front.sepia.ceph.com,smithi097.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T00:14:47.999 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi043.front.sepia.ceph.com'), Remote(name='ubuntu@smithi097.front.sepia.ceph.com')] 2024-09-12T00:14:48.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-12T00:14:48.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:14:48.984 DEBUG:teuthology.orchestra.run.smithi043:> true 2024-09-12T00:14:49.065 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-12T00:14:49.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-12T00:14:49.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:14:49.156 DEBUG:teuthology.orchestra.run.smithi097:> true 2024-09-12T00:14:49.233 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-12T00:14:49.233 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T00:14:49.297 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T00:14:49.297 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:14:49.298 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:14:49.301 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:14:49.301 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:14:49.330 INFO:teuthology.orchestra.run.smithi043.stdout:12 Sep 00:14:49 ntpd[18385]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T00:14:49.330 INFO:teuthology.orchestra.run.smithi043.stdout:12 Sep 00:14:49 ntpd[18385]: Command line: ntpd -gq 2024-09-12T00:14:49.331 INFO:teuthology.orchestra.run.smithi043.stdout:12 Sep 00:14:49 ntpd[18385]: ---------------------------------------------------- 2024-09-12T00:14:49.331 INFO:teuthology.orchestra.run.smithi043.stdout:12 Sep 00:14:49 ntpd[18385]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T00:14:49.331 INFO:teuthology.orchestra.run.smithi043.stdout:12 Sep 00:14:49 ntpd[18385]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T00:14:49.331 INFO:teuthology.orchestra.run.smithi043.stdout:12 Sep 00:14:49 ntpd[18385]: corporation. Support and training for ntp-4 are 2024-09-12T00:14:49.331 INFO:teuthology.orchestra.run.smithi043.stdout:12 Sep 00:14:49 ntpd[18385]: available at https://www.nwtime.org/support 2024-09-12T00:14:49.331 INFO:teuthology.orchestra.run.smithi043.stdout:12 Sep 00:14:49 ntpd[18385]: ---------------------------------------------------- 2024-09-12T00:14:49.332 INFO:teuthology.orchestra.run.smithi043.stdout:12 Sep 00:14:49 ntpd[18385]: proto: precision = 0.066 usec (-24) 2024-09-12T00:14:49.333 INFO:teuthology.orchestra.run.smithi043.stdout:12 Sep 00:14:49 ntpd[18385]: basedate set to 2022-02-04 2024-09-12T00:14:49.333 INFO:teuthology.orchestra.run.smithi043.stdout:12 Sep 00:14:49 ntpd[18385]: gps base set to 2022-02-06 (week 2196) 2024-09-12T00:14:49.333 INFO:teuthology.orchestra.run.smithi043.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:14:49.334 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 00:14:49 ntpd[18462]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T00:14:49.334 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 00:14:49 ntpd[18462]: Command line: ntpd -gq 2024-09-12T00:14:49.334 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 00:14:49 ntpd[18462]: ---------------------------------------------------- 2024-09-12T00:14:49.334 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 00:14:49 ntpd[18462]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T00:14:49.334 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 00:14:49 ntpd[18462]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T00:14:49.335 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 00:14:49 ntpd[18462]: corporation. Support and training for ntp-4 are 2024-09-12T00:14:49.335 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 00:14:49 ntpd[18462]: available at https://www.nwtime.org/support 2024-09-12T00:14:49.335 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 00:14:49 ntpd[18462]: ---------------------------------------------------- 2024-09-12T00:14:49.335 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 00:14:49 ntpd[18462]: proto: precision = 0.044 usec (-24) 2024-09-12T00:14:49.335 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 00:14:49 ntpd[18462]: basedate set to 2022-02-04 2024-09-12T00:14:49.335 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 00:14:49 ntpd[18462]: gps base set to 2022-02-06 (week 2196) 2024-09-12T00:14:49.336 INFO:teuthology.orchestra.run.smithi097.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:14:49.336 INFO:teuthology.orchestra.run.smithi043.stdout:12 Sep 00:14:49 ntpd[18385]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:14:49.336 INFO:teuthology.orchestra.run.smithi043.stdout:12 Sep 00:14:49 ntpd[18385]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:14:49.337 INFO:teuthology.orchestra.run.smithi043.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:14:49.337 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 00:14:49 ntpd[18462]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:14:49.338 INFO:teuthology.orchestra.run.smithi097.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:14:49.340 INFO:teuthology.orchestra.run.smithi043.stdout:12 Sep 00:14:49 ntpd[18385]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T00:14:49.340 INFO:teuthology.orchestra.run.smithi043.stdout:12 Sep 00:14:49 ntpd[18385]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T00:14:49.340 INFO:teuthology.orchestra.run.smithi043.stdout:12 Sep 00:14:49 ntpd[18385]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T00:14:49.340 INFO:teuthology.orchestra.run.smithi043.stdout:12 Sep 00:14:49 ntpd[18385]: Listen normally on 3 ens1f0 172.21.15.43:123 2024-09-12T00:14:49.340 INFO:teuthology.orchestra.run.smithi043.stdout:12 Sep 00:14:49 ntpd[18385]: Listen normally on 4 lo [::1]:123 2024-09-12T00:14:49.340 INFO:teuthology.orchestra.run.smithi043.stdout:12 Sep 00:14:49 ntpd[18385]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1358%4]:123 2024-09-12T00:14:49.340 INFO:teuthology.orchestra.run.smithi043.stdout:12 Sep 00:14:49 ntpd[18385]: Listening on routing socket on fd #22 for interface updates 2024-09-12T00:14:49.341 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 00:14:49 ntpd[18462]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:14:49.341 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 00:14:49 ntpd[18462]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T00:14:49.341 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 00:14:49 ntpd[18462]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T00:14:49.341 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 00:14:49 ntpd[18462]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T00:14:49.341 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 00:14:49 ntpd[18462]: Listen normally on 3 enp3s0f1 172.21.15.97:123 2024-09-12T00:14:49.341 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 00:14:49 ntpd[18462]: Listen normally on 4 lo [::1]:123 2024-09-12T00:14:49.341 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 00:14:49 ntpd[18462]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d805%5]:123 2024-09-12T00:14:49.341 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 00:14:49 ntpd[18462]: Listening on routing socket on fd #22 for interface updates 2024-09-12T00:14:50.331 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:50 ntpd[18385]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:50.331 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:50 ntpd[18385]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:50.331 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:50 ntpd[18385]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:50.331 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:50 ntpd[18385]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:50.331 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:50 ntpd[18385]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:50.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:50 ntpd[18385]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:50.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:50 ntpd[18385]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:14:50.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:50 ntpd[18385]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:14:50.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:50 ntpd[18385]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:50.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:50 ntpd[18385]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:50.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:50 ntpd[18385]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:14:50.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:50 ntpd[18385]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:14:50.333 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:50 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:50.333 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:50 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:50.333 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:50 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:50.333 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:50 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:50.333 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:50 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:14:50.333 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:50 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:14:52.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:52 ntpd[18385]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:52.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:52 ntpd[18385]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:52.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:52 ntpd[18385]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:52.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:52 ntpd[18385]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:52.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:52 ntpd[18385]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:52.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:52 ntpd[18385]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:52.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:52 ntpd[18385]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:52.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:52 ntpd[18385]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:52.333 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:52 ntpd[18385]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:14:52.333 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:52 ntpd[18385]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:14:52.333 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:52 ntpd[18385]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:52.333 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:52 ntpd[18385]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:52.333 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:52 ntpd[18385]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:14:52.333 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:52 ntpd[18385]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:14:52.333 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:52 ntpd[18385]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:52.333 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:52 ntpd[18385]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:52.333 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:52 ntpd[18385]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:14:52.333 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:52 ntpd[18385]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:14:52.334 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:52 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:52.334 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:52 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:52.334 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:52 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:52.334 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:52 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:52.335 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:52 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:52.335 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:52 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:52.335 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:52 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:14:52.335 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:52 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:14:53.331 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:53 ntpd[18385]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:53.331 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:53 ntpd[18385]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:53.333 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:53 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:53.333 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:53 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:53.333 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:53 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:53.333 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:53 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:53.333 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:53 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:53.333 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:53 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:53.333 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:53 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:14:53.333 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:53 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:14:53.334 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:53 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:53.334 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:53 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:53.334 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:53 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:14:53.334 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:53 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:14:54.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:54 ntpd[18385]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:54.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:54 ntpd[18385]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:54.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:54 ntpd[18385]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:54.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:54 ntpd[18385]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:54.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:54 ntpd[18385]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:54.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:54 ntpd[18385]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:54.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:54 ntpd[18385]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:54.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:54 ntpd[18385]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:54.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:54 ntpd[18385]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:14:54.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:54 ntpd[18385]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:14:54.333 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:54 ntpd[18385]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:54.333 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:54 ntpd[18385]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:54.333 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:54 ntpd[18385]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:14:54.333 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:54 ntpd[18385]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:14:54.333 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:54 ntpd[18385]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:54.333 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:54 ntpd[18385]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:54.333 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:54 ntpd[18385]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:14:54.333 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:54 ntpd[18385]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:14:54.334 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:54 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:54.334 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:54 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:54.334 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:54 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:54.334 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:54 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:54.334 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:54 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:14:54.334 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:54 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:14:55.333 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:55 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:55.333 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:55 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:55.334 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:55 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:55.334 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:55 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:55.334 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:55 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:55.334 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:55 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:55.334 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:55 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:14:55.335 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:55 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:14:55.335 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:55 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:55.335 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:55 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:55.335 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:55 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:14:55.335 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:55 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:14:56.331 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:56 ntpd[18385]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:56.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:56 ntpd[18385]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:56.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:56 ntpd[18385]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:56.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:56 ntpd[18385]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:56.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:56 ntpd[18385]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:56.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:56 ntpd[18385]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:56.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:56 ntpd[18385]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:56.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:56 ntpd[18385]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:56.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:56 ntpd[18385]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:14:56.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:56 ntpd[18385]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:14:56.332 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:56 ntpd[18385]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:56.333 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:56 ntpd[18385]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:56.333 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:56 ntpd[18385]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:14:56.333 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:56 ntpd[18385]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:14:56.333 INFO:teuthology.orchestra.run.smithi043.stdout:12 Sep 00:14:56 ntpd[18385]: ntpd: time slew +0.002177 s 2024-09-12T00:14:56.333 INFO:teuthology.orchestra.run.smithi043.stdout:ntpd: time slew +0.002177s 2024-09-12T00:14:56.333 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:56 ntpd[18385]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T00:14:56.334 INFO:teuthology.orchestra.run.smithi043.stderr:12 Sep 00:14:56 ntpd[18385]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T00:14:56.334 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:56 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:56.334 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:56 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:56.335 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:56 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:14:56.335 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:56 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:14:56.335 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:56 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:14:56.335 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:56 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:14:56.335 INFO:teuthology.orchestra.run.smithi097.stdout:12 Sep 00:14:56 ntpd[18462]: ntpd: time slew +0.001957 s 2024-09-12T00:14:56.335 INFO:teuthology.orchestra.run.smithi097.stdout:ntpd: time slew +0.001957s 2024-09-12T00:14:56.336 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:56 ntpd[18462]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T00:14:56.336 INFO:teuthology.orchestra.run.smithi097.stderr:12 Sep 00:14:56 ntpd[18462]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T00:14:56.389 INFO:teuthology.orchestra.run.smithi043.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T00:14:56.389 INFO:teuthology.orchestra.run.smithi043.stdout:============================================================================== 2024-09-12T00:14:56.389 INFO:teuthology.orchestra.run.smithi043.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:14:56.389 INFO:teuthology.orchestra.run.smithi043.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:14:56.389 INFO:teuthology.orchestra.run.smithi043.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:14:56.389 INFO:teuthology.orchestra.run.smithi043.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:14:56.393 INFO:teuthology.orchestra.run.smithi097.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T00:14:56.393 INFO:teuthology.orchestra.run.smithi097.stdout:============================================================================== 2024-09-12T00:14:56.393 INFO:teuthology.orchestra.run.smithi097.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:14:56.394 INFO:teuthology.orchestra.run.smithi097.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:14:56.394 INFO:teuthology.orchestra.run.smithi097.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:14:56.394 INFO:teuthology.orchestra.run.smithi097.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:14:56.394 INFO:teuthology.run_tasks:Running task install... 2024-09-12T00:14:56.403 DEBUG:teuthology.task.install:project ceph 2024-09-12T00:14:56.403 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}} 2024-09-12T00:14:56.404 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'} 2024-09-12T00:14:56.404 INFO:teuthology.task.install:Using flavor: default 2024-09-12T00:14:56.410 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T00:14:56.410 INFO:teuthology.task.install:extra packages: [] 2024-09-12T00:14:56.411 DEBUG:teuthology.orchestra.run.smithi043:> sudo apt-key list | grep Ceph 2024-09-12T00:14:56.411 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-key list | grep Ceph 2024-09-12T00:14:56.487 INFO:teuthology.orchestra.run.smithi043.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T00:14:56.489 INFO:teuthology.orchestra.run.smithi097.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T00:14:56.515 INFO:teuthology.orchestra.run.smithi043.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T00:14:56.515 INFO:teuthology.orchestra.run.smithi043.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T00:14:56.516 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T00:14:56.516 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-12T00:14:56.516 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:14:56.529 INFO:teuthology.orchestra.run.smithi097.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T00:14:56.529 INFO:teuthology.orchestra.run.smithi097.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T00:14:56.529 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T00:14:56.529 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-12T00:14:56.530 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:14:56.671 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default/ 2024-09-12T00:14:56.671 INFO:teuthology.task.install.deb:Package version is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:14:56.684 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default/ 2024-09-12T00:14:56.684 INFO:teuthology.task.install.deb:Package version is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:14:56.792 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:14:56.792 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T00:14:56.809 DEBUG:teuthology.orchestra.run.smithi043:> sudo apt-get update 2024-09-12T00:14:56.810 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T00:14:56.810 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T00:14:56.824 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get update 2024-09-12T00:14:56.992 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T00:14:57.036 INFO:teuthology.orchestra.run.smithi043.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T00:14:57.046 INFO:teuthology.orchestra.run.smithi097.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T00:14:57.057 INFO:teuthology.orchestra.run.smithi043.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T00:14:57.066 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T00:14:57.081 INFO:teuthology.orchestra.run.smithi043.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T00:14:57.088 INFO:teuthology.orchestra.run.smithi097.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T00:14:57.109 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-09-12T00:14:57.110 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:14:57.110 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T00:14:57.111 INFO:teuthology.orchestra.run.smithi043.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-12T00:14:57.115 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:14:57.136 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-12T00:14:57.140 INFO:teuthology.orchestra.run.smithi043.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-09-12T00:14:57.183 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T00:14:57.196 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T00:14:57.264 INFO:teuthology.orchestra.run.smithi043.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T00:14:57.277 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T00:14:57.409 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 29.2 kB in 0s (72.0 kB/s) 2024-09-12T00:14:57.504 INFO:teuthology.orchestra.run.smithi043.stdout:Fetched 29.2 kB in 1s (57.8 kB/s) 2024-09-12T00:14:58.365 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-09-12T00:14:58.381 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4753-gd011c522-1jammy cephadm=19.3.0-4753-gd011c522-1jammy ceph-mds=19.3.0-4753-gd011c522-1jammy ceph-mgr=19.3.0-4753-gd011c522-1jammy ceph-common=19.3.0-4753-gd011c522-1jammy ceph-fuse=19.3.0-4753-gd011c522-1jammy ceph-test=19.3.0-4753-gd011c522-1jammy ceph-volume=19.3.0-4753-gd011c522-1jammy radosgw=19.3.0-4753-gd011c522-1jammy python3-rados=19.3.0-4753-gd011c522-1jammy python3-rgw=19.3.0-4753-gd011c522-1jammy python3-cephfs=19.3.0-4753-gd011c522-1jammy python3-rbd=19.3.0-4753-gd011c522-1jammy libcephfs2=19.3.0-4753-gd011c522-1jammy libcephfs-dev=19.3.0-4753-gd011c522-1jammy librados2=19.3.0-4753-gd011c522-1jammy librbd1=19.3.0-4753-gd011c522-1jammy rbd-fuse=19.3.0-4753-gd011c522-1jammy 2024-09-12T00:14:58.441 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-09-12T00:14:58.548 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2024-09-12T00:14:58.565 DEBUG:teuthology.orchestra.run.smithi043:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4753-gd011c522-1jammy cephadm=19.3.0-4753-gd011c522-1jammy ceph-mds=19.3.0-4753-gd011c522-1jammy ceph-mgr=19.3.0-4753-gd011c522-1jammy ceph-common=19.3.0-4753-gd011c522-1jammy ceph-fuse=19.3.0-4753-gd011c522-1jammy ceph-test=19.3.0-4753-gd011c522-1jammy ceph-volume=19.3.0-4753-gd011c522-1jammy radosgw=19.3.0-4753-gd011c522-1jammy python3-rados=19.3.0-4753-gd011c522-1jammy python3-rgw=19.3.0-4753-gd011c522-1jammy python3-cephfs=19.3.0-4753-gd011c522-1jammy python3-rbd=19.3.0-4753-gd011c522-1jammy libcephfs2=19.3.0-4753-gd011c522-1jammy libcephfs-dev=19.3.0-4753-gd011c522-1jammy librados2=19.3.0-4753-gd011c522-1jammy librbd1=19.3.0-4753-gd011c522-1jammy rbd-fuse=19.3.0-4753-gd011c522-1jammy 2024-09-12T00:14:58.629 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2024-09-12T00:14:58.658 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-09-12T00:14:58.659 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-09-12T00:14:58.842 INFO:teuthology.orchestra.run.smithi043.stdout:Building dependency tree... 2024-09-12T00:14:58.842 INFO:teuthology.orchestra.run.smithi043.stdout:Reading state information... 2024-09-12T00:14:58.855 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:14:58.855 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:14:58.855 INFO:teuthology.orchestra.run.smithi097.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:14:58.855 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:14:58.856 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:14:58.856 INFO:teuthology.orchestra.run.smithi097.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:14:58.856 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:14:58.856 INFO:teuthology.orchestra.run.smithi097.stdout:The following additional packages will be installed: 2024-09-12T00:14:58.856 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T00:14:58.857 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T00:14:58.858 INFO:teuthology.orchestra.run.smithi097.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T00:14:58.858 INFO:teuthology.orchestra.run.smithi097.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T00:14:58.858 INFO:teuthology.orchestra.run.smithi097.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T00:14:58.858 INFO:teuthology.orchestra.run.smithi097.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T00:14:58.858 INFO:teuthology.orchestra.run.smithi097.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T00:14:58.858 INFO:teuthology.orchestra.run.smithi097.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T00:14:58.859 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T00:14:58.859 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:14:58.859 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:14:58.859 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:14:58.859 INFO:teuthology.orchestra.run.smithi097.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:14:58.859 INFO:teuthology.orchestra.run.smithi097.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:14:58.859 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:14:58.859 INFO:teuthology.orchestra.run.smithi097.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:14:58.859 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T00:14:58.859 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T00:14:58.859 INFO:teuthology.orchestra.run.smithi097.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T00:14:58.859 INFO:teuthology.orchestra.run.smithi097.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T00:14:58.860 INFO:teuthology.orchestra.run.smithi097.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T00:14:58.860 INFO:teuthology.orchestra.run.smithi097.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T00:14:58.860 INFO:teuthology.orchestra.run.smithi097.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T00:14:58.860 INFO:teuthology.orchestra.run.smithi097.stdout: xmlstarlet zip 2024-09-12T00:14:58.860 INFO:teuthology.orchestra.run.smithi097.stdout:Suggested packages: 2024-09-12T00:14:58.860 INFO:teuthology.orchestra.run.smithi097.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T00:14:58.860 INFO:teuthology.orchestra.run.smithi097.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T00:14:58.860 INFO:teuthology.orchestra.run.smithi097.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T00:14:58.861 INFO:teuthology.orchestra.run.smithi097.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T00:14:58.861 INFO:teuthology.orchestra.run.smithi097.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T00:14:58.861 INFO:teuthology.orchestra.run.smithi097.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T00:14:58.861 INFO:teuthology.orchestra.run.smithi097.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T00:14:58.861 INFO:teuthology.orchestra.run.smithi097.stdout:Recommended packages: 2024-09-12T00:14:58.861 INFO:teuthology.orchestra.run.smithi097.stdout: btrfs-tools 2024-09-12T00:14:58.961 INFO:teuthology.orchestra.run.smithi097.stdout:The following NEW packages will be installed: 2024-09-12T00:14:58.962 INFO:teuthology.orchestra.run.smithi097.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T00:14:58.962 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T00:14:58.962 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T00:14:58.962 INFO:teuthology.orchestra.run.smithi097.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T00:14:58.962 INFO:teuthology.orchestra.run.smithi097.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T00:14:58.962 INFO:teuthology.orchestra.run.smithi097.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T00:14:58.963 INFO:teuthology.orchestra.run.smithi097.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T00:14:58.963 INFO:teuthology.orchestra.run.smithi097.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T00:14:58.963 INFO:teuthology.orchestra.run.smithi097.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T00:14:58.963 INFO:teuthology.orchestra.run.smithi097.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T00:14:58.963 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T00:14:58.963 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:14:58.964 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:14:58.964 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:14:58.964 INFO:teuthology.orchestra.run.smithi097.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:14:58.964 INFO:teuthology.orchestra.run.smithi097.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:14:58.964 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:14:58.964 INFO:teuthology.orchestra.run.smithi097.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:14:58.964 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T00:14:58.964 INFO:teuthology.orchestra.run.smithi097.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T00:14:58.964 INFO:teuthology.orchestra.run.smithi097.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T00:14:58.964 INFO:teuthology.orchestra.run.smithi097.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T00:14:58.964 INFO:teuthology.orchestra.run.smithi097.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T00:14:58.964 INFO:teuthology.orchestra.run.smithi097.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T00:14:58.964 INFO:teuthology.orchestra.run.smithi097.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T00:14:58.965 INFO:teuthology.orchestra.run.smithi097.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T00:14:59.059 INFO:teuthology.orchestra.run.smithi043.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:14:59.059 INFO:teuthology.orchestra.run.smithi043.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:14:59.059 INFO:teuthology.orchestra.run.smithi043.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:14:59.059 INFO:teuthology.orchestra.run.smithi043.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:14:59.062 INFO:teuthology.orchestra.run.smithi043.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:14:59.062 INFO:teuthology.orchestra.run.smithi043.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:14:59.062 INFO:teuthology.orchestra.run.smithi043.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:14:59.062 INFO:teuthology.orchestra.run.smithi043.stdout:The following additional packages will be installed: 2024-09-12T00:14:59.063 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T00:14:59.063 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T00:14:59.063 INFO:teuthology.orchestra.run.smithi043.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T00:14:59.063 INFO:teuthology.orchestra.run.smithi043.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T00:14:59.063 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T00:14:59.063 INFO:teuthology.orchestra.run.smithi043.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T00:14:59.063 INFO:teuthology.orchestra.run.smithi043.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T00:14:59.063 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T00:14:59.063 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T00:14:59.063 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:14:59.063 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:14:59.064 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:14:59.064 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:14:59.064 INFO:teuthology.orchestra.run.smithi043.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:14:59.064 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:14:59.065 INFO:teuthology.orchestra.run.smithi043.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:14:59.066 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T00:14:59.066 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T00:14:59.066 INFO:teuthology.orchestra.run.smithi043.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T00:14:59.066 INFO:teuthology.orchestra.run.smithi043.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T00:14:59.066 INFO:teuthology.orchestra.run.smithi043.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T00:14:59.066 INFO:teuthology.orchestra.run.smithi043.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T00:14:59.066 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T00:14:59.067 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet zip 2024-09-12T00:14:59.067 INFO:teuthology.orchestra.run.smithi043.stdout:Suggested packages: 2024-09-12T00:14:59.067 INFO:teuthology.orchestra.run.smithi043.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T00:14:59.067 INFO:teuthology.orchestra.run.smithi043.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T00:14:59.067 INFO:teuthology.orchestra.run.smithi043.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T00:14:59.067 INFO:teuthology.orchestra.run.smithi043.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T00:14:59.068 INFO:teuthology.orchestra.run.smithi043.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T00:14:59.068 INFO:teuthology.orchestra.run.smithi043.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T00:14:59.068 INFO:teuthology.orchestra.run.smithi043.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T00:14:59.068 INFO:teuthology.orchestra.run.smithi043.stdout:Recommended packages: 2024-09-12T00:14:59.068 INFO:teuthology.orchestra.run.smithi043.stdout: btrfs-tools 2024-09-12T00:14:59.106 INFO:teuthology.orchestra.run.smithi097.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:14:59.107 INFO:teuthology.orchestra.run.smithi097.stdout:Need to get 251 MB of archives. 2024-09-12T00:14:59.107 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-12T00:14:59.107 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4753-gd011c522-1jammy [3,628 kB] 2024-09-12T00:14:59.153 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T00:14:59.173 INFO:teuthology.orchestra.run.smithi043.stdout:The following NEW packages will be installed: 2024-09-12T00:14:59.174 INFO:teuthology.orchestra.run.smithi043.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T00:14:59.174 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T00:14:59.174 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T00:14:59.175 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T00:14:59.175 INFO:teuthology.orchestra.run.smithi043.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T00:14:59.175 INFO:teuthology.orchestra.run.smithi043.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T00:14:59.175 INFO:teuthology.orchestra.run.smithi043.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T00:14:59.175 INFO:teuthology.orchestra.run.smithi043.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T00:14:59.176 INFO:teuthology.orchestra.run.smithi043.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T00:14:59.176 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T00:14:59.176 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T00:14:59.176 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:14:59.176 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:14:59.176 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:14:59.176 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:14:59.176 INFO:teuthology.orchestra.run.smithi043.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:14:59.176 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:14:59.176 INFO:teuthology.orchestra.run.smithi043.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:14:59.176 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T00:14:59.176 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T00:14:59.176 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T00:14:59.176 INFO:teuthology.orchestra.run.smithi043.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T00:14:59.177 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T00:14:59.177 INFO:teuthology.orchestra.run.smithi043.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T00:14:59.177 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T00:14:59.177 INFO:teuthology.orchestra.run.smithi043.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T00:14:59.238 INFO:teuthology.orchestra.run.smithi043.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:14:59.238 INFO:teuthology.orchestra.run.smithi043.stdout:Need to get 251 MB of archives. 2024-09-12T00:14:59.238 INFO:teuthology.orchestra.run.smithi043.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-12T00:14:59.238 INFO:teuthology.orchestra.run.smithi043.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T00:14:59.295 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4753-gd011c522-1jammy [3,322 kB] 2024-09-12T00:14:59.326 INFO:teuthology.orchestra.run.smithi043.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T00:14:59.328 INFO:teuthology.orchestra.run.smithi043.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T00:14:59.334 INFO:teuthology.orchestra.run.smithi043.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4753-gd011c522-1jammy [3,628 kB] 2024-09-12T00:14:59.343 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4753-gd011c522-1jammy [722 kB] 2024-09-12T00:14:59.345 INFO:teuthology.orchestra.run.smithi043.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T00:14:59.353 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4753-gd011c522-1jammy [356 kB] 2024-09-12T00:14:59.359 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4753-gd011c522-1jammy [32.8 kB] 2024-09-12T00:14:59.359 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4753-gd011c522-1jammy [180 kB] 2024-09-12T00:14:59.363 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4753-gd011c522-1jammy [71.3 kB] 2024-09-12T00:14:59.364 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4753-gd011c522-1jammy [338 kB] 2024-09-12T00:14:59.370 INFO:teuthology.orchestra.run.smithi097.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4753-gd011c522-1jammy [7,983 kB] 2024-09-12T00:14:59.404 INFO:teuthology.orchestra.run.smithi043.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T00:14:59.409 INFO:teuthology.orchestra.run.smithi043.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T00:14:59.422 INFO:teuthology.orchestra.run.smithi043.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T00:14:59.427 INFO:teuthology.orchestra.run.smithi043.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T00:14:59.427 INFO:teuthology.orchestra.run.smithi043.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T00:14:59.428 INFO:teuthology.orchestra.run.smithi043.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T00:14:59.437 INFO:teuthology.orchestra.run.smithi043.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T00:14:59.439 INFO:teuthology.orchestra.run.smithi043.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T00:14:59.442 INFO:teuthology.orchestra.run.smithi043.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T00:14:59.443 INFO:teuthology.orchestra.run.smithi043.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T00:14:59.443 INFO:teuthology.orchestra.run.smithi043.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T00:14:59.445 INFO:teuthology.orchestra.run.smithi043.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T00:14:59.460 INFO:teuthology.orchestra.run.smithi043.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T00:14:59.462 INFO:teuthology.orchestra.run.smithi043.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T00:14:59.463 INFO:teuthology.orchestra.run.smithi043.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T00:14:59.463 INFO:teuthology.orchestra.run.smithi043.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T00:14:59.464 INFO:teuthology.orchestra.run.smithi043.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T00:14:59.478 INFO:teuthology.orchestra.run.smithi043.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T00:14:59.479 INFO:teuthology.orchestra.run.smithi043.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T00:14:59.479 INFO:teuthology.orchestra.run.smithi043.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T00:14:59.480 INFO:teuthology.orchestra.run.smithi043.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T00:14:59.480 INFO:teuthology.orchestra.run.smithi043.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T00:14:59.495 INFO:teuthology.orchestra.run.smithi043.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T00:14:59.498 INFO:teuthology.orchestra.run.smithi043.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T00:14:59.498 INFO:teuthology.orchestra.run.smithi043.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T00:14:59.499 INFO:teuthology.orchestra.run.smithi043.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T00:14:59.499 INFO:teuthology.orchestra.run.smithi043.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T00:14:59.508 INFO:teuthology.orchestra.run.smithi097.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4753-gd011c522-1jammy [112 kB] 2024-09-12T00:14:59.509 INFO:teuthology.orchestra.run.smithi097.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4753-gd011c522-1jammy [473 kB] 2024-09-12T00:14:59.512 INFO:teuthology.orchestra.run.smithi043.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T00:14:59.512 INFO:teuthology.orchestra.run.smithi043.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T00:14:59.513 INFO:teuthology.orchestra.run.smithi043.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T00:14:59.514 INFO:teuthology.orchestra.run.smithi043.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T00:14:59.515 INFO:teuthology.orchestra.run.smithi043.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T00:14:59.516 INFO:teuthology.orchestra.run.smithi097.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4753-gd011c522-1jammy [28.3 MB] 2024-09-12T00:14:59.529 INFO:teuthology.orchestra.run.smithi043.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T00:14:59.535 INFO:teuthology.orchestra.run.smithi043.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T00:14:59.535 INFO:teuthology.orchestra.run.smithi043.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T00:14:59.535 INFO:teuthology.orchestra.run.smithi043.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T00:14:59.536 INFO:teuthology.orchestra.run.smithi043.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T00:14:59.546 INFO:teuthology.orchestra.run.smithi043.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T00:14:59.549 INFO:teuthology.orchestra.run.smithi043.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T00:14:59.550 INFO:teuthology.orchestra.run.smithi043.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T00:14:59.551 INFO:teuthology.orchestra.run.smithi043.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T00:14:59.552 INFO:teuthology.orchestra.run.smithi043.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T00:14:59.563 INFO:teuthology.orchestra.run.smithi043.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T00:14:59.564 INFO:teuthology.orchestra.run.smithi043.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T00:14:59.565 INFO:teuthology.orchestra.run.smithi043.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T00:14:59.569 INFO:teuthology.orchestra.run.smithi043.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T00:14:59.575 INFO:teuthology.orchestra.run.smithi097.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T00:14:59.588 INFO:teuthology.orchestra.run.smithi097.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T00:14:59.630 INFO:teuthology.orchestra.run.smithi043.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T00:14:59.631 INFO:teuthology.orchestra.run.smithi043.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T00:14:59.633 INFO:teuthology.orchestra.run.smithi043.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T00:14:59.633 INFO:teuthology.orchestra.run.smithi043.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T00:14:59.634 INFO:teuthology.orchestra.run.smithi043.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T00:14:59.652 INFO:teuthology.orchestra.run.smithi043.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T00:14:59.654 INFO:teuthology.orchestra.run.smithi043.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T00:14:59.654 INFO:teuthology.orchestra.run.smithi043.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T00:14:59.669 INFO:teuthology.orchestra.run.smithi043.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T00:14:59.669 INFO:teuthology.orchestra.run.smithi043.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T00:14:59.670 INFO:teuthology.orchestra.run.smithi097.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T00:14:59.670 INFO:teuthology.orchestra.run.smithi043.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T00:14:59.670 INFO:teuthology.orchestra.run.smithi043.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T00:14:59.670 INFO:teuthology.orchestra.run.smithi043.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T00:14:59.671 INFO:teuthology.orchestra.run.smithi043.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T00:14:59.684 INFO:teuthology.orchestra.run.smithi043.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T00:14:59.684 INFO:teuthology.orchestra.run.smithi043.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T00:14:59.687 INFO:teuthology.orchestra.run.smithi043.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T00:14:59.700 INFO:teuthology.orchestra.run.smithi043.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T00:14:59.702 INFO:teuthology.orchestra.run.smithi043.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T00:14:59.703 INFO:teuthology.orchestra.run.smithi043.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T00:14:59.706 INFO:teuthology.orchestra.run.smithi043.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T00:14:59.708 INFO:teuthology.orchestra.run.smithi043.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T00:14:59.709 INFO:teuthology.orchestra.run.smithi043.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T00:14:59.709 INFO:teuthology.orchestra.run.smithi043.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T00:14:59.717 INFO:teuthology.orchestra.run.smithi043.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T00:14:59.718 INFO:teuthology.orchestra.run.smithi043.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T00:14:59.721 INFO:teuthology.orchestra.run.smithi043.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T00:14:59.734 INFO:teuthology.orchestra.run.smithi043.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T00:14:59.735 INFO:teuthology.orchestra.run.smithi043.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T00:14:59.735 INFO:teuthology.orchestra.run.smithi043.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T00:14:59.737 INFO:teuthology.orchestra.run.smithi043.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T00:14:59.737 INFO:teuthology.orchestra.run.smithi043.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T00:14:59.744 INFO:teuthology.orchestra.run.smithi043.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T00:14:59.744 INFO:teuthology.orchestra.run.smithi043.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T00:14:59.751 INFO:teuthology.orchestra.run.smithi043.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T00:14:59.754 INFO:teuthology.orchestra.run.smithi043.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T00:14:59.754 INFO:teuthology.orchestra.run.smithi043.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T00:14:59.898 INFO:teuthology.orchestra.run.smithi097.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T00:14:59.909 INFO:teuthology.orchestra.run.smithi097.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T00:14:59.939 INFO:teuthology.orchestra.run.smithi097.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T00:14:59.947 INFO:teuthology.orchestra.run.smithi097.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T00:14:59.948 INFO:teuthology.orchestra.run.smithi097.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T00:14:59.950 INFO:teuthology.orchestra.run.smithi097.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T00:14:59.970 INFO:teuthology.orchestra.run.smithi097.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T00:14:59.974 INFO:teuthology.orchestra.run.smithi097.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T00:14:59.978 INFO:teuthology.orchestra.run.smithi097.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T00:14:59.980 INFO:teuthology.orchestra.run.smithi097.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T00:15:00.062 INFO:teuthology.orchestra.run.smithi097.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T00:15:00.079 INFO:teuthology.orchestra.run.smithi097.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T00:15:00.143 INFO:teuthology.orchestra.run.smithi097.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T00:15:00.143 INFO:teuthology.orchestra.run.smithi097.stdout:Get:30 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4753-gd011c522-1jammy [5,210 kB] 2024-09-12T00:15:00.147 INFO:teuthology.orchestra.run.smithi097.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T00:15:00.148 INFO:teuthology.orchestra.run.smithi097.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T00:15:00.149 INFO:teuthology.orchestra.run.smithi097.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T00:15:00.151 INFO:teuthology.orchestra.run.smithi097.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T00:15:00.151 INFO:teuthology.orchestra.run.smithi097.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T00:15:00.152 INFO:teuthology.orchestra.run.smithi097.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T00:15:00.153 INFO:teuthology.orchestra.run.smithi097.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T00:15:00.211 INFO:teuthology.orchestra.run.smithi097.stdout:Get:38 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4753-gd011c522-1jammy [251 kB] 2024-09-12T00:15:00.213 INFO:teuthology.orchestra.run.smithi097.stdout:Get:39 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4753-gd011c522-1jammy [124 kB] 2024-09-12T00:15:00.215 INFO:teuthology.orchestra.run.smithi097.stdout:Get:40 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4753-gd011c522-1jammy [1,562 kB] 2024-09-12T00:15:00.226 INFO:teuthology.orchestra.run.smithi097.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T00:15:00.228 INFO:teuthology.orchestra.run.smithi097.stdout:Get:42 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4753-gd011c522-1jammy [6,308 kB] 2024-09-12T00:15:00.234 INFO:teuthology.orchestra.run.smithi043.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4753-gd011c522-1jammy [3,322 kB] 2024-09-12T00:15:00.236 INFO:teuthology.orchestra.run.smithi097.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T00:15:00.237 INFO:teuthology.orchestra.run.smithi097.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T00:15:00.242 INFO:teuthology.orchestra.run.smithi097.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T00:15:00.243 INFO:teuthology.orchestra.run.smithi097.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T00:15:00.244 INFO:teuthology.orchestra.run.smithi097.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T00:15:00.245 INFO:teuthology.orchestra.run.smithi097.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T00:15:00.247 INFO:teuthology.orchestra.run.smithi097.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T00:15:00.247 INFO:teuthology.orchestra.run.smithi097.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T00:15:00.308 INFO:teuthology.orchestra.run.smithi097.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T00:15:00.331 INFO:teuthology.orchestra.run.smithi097.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T00:15:00.332 INFO:teuthology.orchestra.run.smithi097.stdout:Get:53 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4753-gd011c522-1jammy [23.1 MB] 2024-09-12T00:15:00.333 INFO:teuthology.orchestra.run.smithi097.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T00:15:00.334 INFO:teuthology.orchestra.run.smithi097.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T00:15:00.344 INFO:teuthology.orchestra.run.smithi097.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T00:15:00.345 INFO:teuthology.orchestra.run.smithi097.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T00:15:00.390 INFO:teuthology.orchestra.run.smithi097.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T00:15:00.391 INFO:teuthology.orchestra.run.smithi097.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T00:15:00.393 INFO:teuthology.orchestra.run.smithi097.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T00:15:00.397 INFO:teuthology.orchestra.run.smithi097.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T00:15:00.471 INFO:teuthology.orchestra.run.smithi097.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T00:15:00.474 INFO:teuthology.orchestra.run.smithi097.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T00:15:00.475 INFO:teuthology.orchestra.run.smithi097.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T00:15:00.480 INFO:teuthology.orchestra.run.smithi097.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T00:15:00.481 INFO:teuthology.orchestra.run.smithi097.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T00:15:00.553 INFO:teuthology.orchestra.run.smithi097.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T00:15:00.558 INFO:teuthology.orchestra.run.smithi097.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T00:15:00.724 INFO:teuthology.orchestra.run.smithi097.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T00:15:00.726 INFO:teuthology.orchestra.run.smithi097.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T00:15:00.728 INFO:teuthology.orchestra.run.smithi097.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T00:15:00.729 INFO:teuthology.orchestra.run.smithi097.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T00:15:00.732 INFO:teuthology.orchestra.run.smithi097.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T00:15:00.791 INFO:teuthology.orchestra.run.smithi043.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4753-gd011c522-1jammy [722 kB] 2024-09-12T00:15:00.829 INFO:teuthology.orchestra.run.smithi043.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4753-gd011c522-1jammy [356 kB] 2024-09-12T00:15:00.832 INFO:teuthology.orchestra.run.smithi097.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T00:15:00.833 INFO:teuthology.orchestra.run.smithi097.stdout:Get:75 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4753-gd011c522-1jammy [14.0 kB] 2024-09-12T00:15:00.834 INFO:teuthology.orchestra.run.smithi097.stdout:Get:76 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4753-gd011c522-1jammy [880 kB] 2024-09-12T00:15:00.835 INFO:teuthology.orchestra.run.smithi097.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T00:15:00.836 INFO:teuthology.orchestra.run.smithi097.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T00:15:00.845 INFO:teuthology.orchestra.run.smithi097.stdout:Get:79 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4753-gd011c522-1jammy [2,438 kB] 2024-09-12T00:15:00.847 INFO:teuthology.orchestra.run.smithi043.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4753-gd011c522-1jammy [32.8 kB] 2024-09-12T00:15:00.849 INFO:teuthology.orchestra.run.smithi043.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4753-gd011c522-1jammy [180 kB] 2024-09-12T00:15:00.860 INFO:teuthology.orchestra.run.smithi097.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T00:15:00.860 INFO:teuthology.orchestra.run.smithi097.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T00:15:00.863 INFO:teuthology.orchestra.run.smithi043.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4753-gd011c522-1jammy [71.3 kB] 2024-09-12T00:15:00.865 INFO:teuthology.orchestra.run.smithi043.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4753-gd011c522-1jammy [338 kB] 2024-09-12T00:15:00.885 INFO:teuthology.orchestra.run.smithi043.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4753-gd011c522-1jammy [7,983 kB] 2024-09-12T00:15:00.908 INFO:teuthology.orchestra.run.smithi097.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T00:15:00.908 INFO:teuthology.orchestra.run.smithi097.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4753-gd011c522-1jammy [812 kB] 2024-09-12T00:15:00.909 INFO:teuthology.orchestra.run.smithi097.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T00:15:00.909 INFO:teuthology.orchestra.run.smithi097.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T00:15:00.910 INFO:teuthology.orchestra.run.smithi097.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T00:15:00.917 INFO:teuthology.orchestra.run.smithi097.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4753-gd011c522-1jammy [160 kB] 2024-09-12T00:15:00.920 INFO:teuthology.orchestra.run.smithi097.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4753-gd011c522-1jammy [61.4 MB] 2024-09-12T00:15:00.974 INFO:teuthology.orchestra.run.smithi097.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T00:15:00.974 INFO:teuthology.orchestra.run.smithi097.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T00:15:00.980 INFO:teuthology.orchestra.run.smithi097.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T00:15:01.055 INFO:teuthology.orchestra.run.smithi097.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T00:15:01.059 INFO:teuthology.orchestra.run.smithi097.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T00:15:01.060 INFO:teuthology.orchestra.run.smithi097.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T00:15:01.070 INFO:teuthology.orchestra.run.smithi097.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T00:15:01.076 INFO:teuthology.orchestra.run.smithi097.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T00:15:01.078 INFO:teuthology.orchestra.run.smithi097.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T00:15:01.080 INFO:teuthology.orchestra.run.smithi097.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T00:15:01.136 INFO:teuthology.orchestra.run.smithi097.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T00:15:01.138 INFO:teuthology.orchestra.run.smithi097.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T00:15:01.146 INFO:teuthology.orchestra.run.smithi097.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T00:15:01.218 INFO:teuthology.orchestra.run.smithi097.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T00:15:01.219 INFO:teuthology.orchestra.run.smithi097.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T00:15:01.220 INFO:teuthology.orchestra.run.smithi097.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T00:15:01.225 INFO:teuthology.orchestra.run.smithi097.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T00:15:01.227 INFO:teuthology.orchestra.run.smithi097.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T00:15:01.244 INFO:teuthology.orchestra.run.smithi097.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T00:15:01.245 INFO:teuthology.orchestra.run.smithi097.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T00:15:01.299 INFO:teuthology.orchestra.run.smithi097.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T00:15:01.305 INFO:teuthology.orchestra.run.smithi097.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T00:15:01.306 INFO:teuthology.orchestra.run.smithi097.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T00:15:01.543 INFO:teuthology.orchestra.run.smithi043.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4753-gd011c522-1jammy [112 kB] 2024-09-12T00:15:01.563 INFO:teuthology.orchestra.run.smithi043.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4753-gd011c522-1jammy [473 kB] 2024-09-12T00:15:01.572 INFO:teuthology.orchestra.run.smithi043.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4753-gd011c522-1jammy [28.3 MB] 2024-09-12T00:15:02.450 INFO:teuthology.orchestra.run.smithi097.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4753-gd011c522-1jammy [8,625 kB] 2024-09-12T00:15:02.707 INFO:teuthology.orchestra.run.smithi097.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4753-gd011c522-1jammy [14.2 kB] 2024-09-12T00:15:02.708 INFO:teuthology.orchestra.run.smithi097.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4753-gd011c522-1jammy [55.8 MB] 2024-09-12T00:15:02.726 INFO:teuthology.orchestra.run.smithi043.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4753-gd011c522-1jammy [5,210 kB] 2024-09-12T00:15:02.809 INFO:teuthology.orchestra.run.smithi043.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4753-gd011c522-1jammy [251 kB] 2024-09-12T00:15:02.816 INFO:teuthology.orchestra.run.smithi043.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4753-gd011c522-1jammy [124 kB] 2024-09-12T00:15:02.818 INFO:teuthology.orchestra.run.smithi043.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4753-gd011c522-1jammy [1,562 kB] 2024-09-12T00:15:02.876 INFO:teuthology.orchestra.run.smithi043.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4753-gd011c522-1jammy [6,308 kB] 2024-09-12T00:15:03.102 INFO:teuthology.orchestra.run.smithi043.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4753-gd011c522-1jammy [23.1 MB] 2024-09-12T00:15:04.006 INFO:teuthology.orchestra.run.smithi043.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4753-gd011c522-1jammy [14.0 kB] 2024-09-12T00:15:04.006 INFO:teuthology.orchestra.run.smithi043.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4753-gd011c522-1jammy [880 kB] 2024-09-12T00:15:04.024 INFO:teuthology.orchestra.run.smithi043.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4753-gd011c522-1jammy [2,438 kB] 2024-09-12T00:15:04.067 INFO:teuthology.orchestra.run.smithi043.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4753-gd011c522-1jammy [812 kB] 2024-09-12T00:15:04.091 INFO:teuthology.orchestra.run.smithi043.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4753-gd011c522-1jammy [160 kB] 2024-09-12T00:15:04.093 INFO:teuthology.orchestra.run.smithi043.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4753-gd011c522-1jammy [61.4 MB] 2024-09-12T00:15:04.557 INFO:teuthology.orchestra.run.smithi097.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4753-gd011c522-1jammy [130 kB] 2024-09-12T00:15:04.560 INFO:teuthology.orchestra.run.smithi097.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4753-gd011c522-1jammy [38.9 kB] 2024-09-12T00:15:04.561 INFO:teuthology.orchestra.run.smithi097.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4753-gd011c522-1jammy [15.9 MB] 2024-09-12T00:15:05.025 INFO:teuthology.orchestra.run.smithi097.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4753-gd011c522-1jammy [91.2 kB] 2024-09-12T00:15:05.599 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 251 MB in 6s (41.4 MB/s) 2024-09-12T00:15:05.729 INFO:teuthology.orchestra.run.smithi043.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4753-gd011c522-1jammy [8,625 kB] 2024-09-12T00:15:05.841 INFO:teuthology.orchestra.run.smithi043.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4753-gd011c522-1jammy [14.2 kB] 2024-09-12T00:15:05.841 INFO:teuthology.orchestra.run.smithi043.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4753-gd011c522-1jammy [55.8 MB] 2024-09-12T00:15:05.874 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T00:15:05.976 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T00:15:05.982 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T00:15:06.064 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:15:06.384 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T00:15:06.411 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T00:15:06.451 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:15:06.787 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T00:15:06.813 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T00:15:06.854 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:15:07.026 INFO:teuthology.orchestra.run.smithi043.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4753-gd011c522-1jammy [130 kB] 2024-09-12T00:15:07.028 INFO:teuthology.orchestra.run.smithi043.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4753-gd011c522-1jammy [38.9 kB] 2024-09-12T00:15:07.030 INFO:teuthology.orchestra.run.smithi043.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4753-gd011c522-1jammy [15.9 MB] 2024-09-12T00:15:07.299 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T00:15:07.325 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:15:07.335 INFO:teuthology.orchestra.run.smithi043.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4753-gd011c522-1jammy [91.2 kB] 2024-09-12T00:15:07.373 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:15:07.785 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T00:15:07.812 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:15:07.852 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:15:07.932 INFO:teuthology.orchestra.run.smithi043.stdout:Fetched 251 MB in 8s (30.8 MB/s) 2024-09-12T00:15:08.097 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T00:15:08.188 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T00:15:08.199 INFO:teuthology.orchestra.run.smithi043.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T00:15:08.205 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T00:15:08.215 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:15:08.254 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:15:08.295 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:15:08.599 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T00:15:08.600 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T00:15:08.626 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T00:15:08.626 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T00:15:08.657 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:15:08.666 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:15:08.952 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librados2. 2024-09-12T00:15:08.978 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../007-librados2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:08.985 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T00:15:09.010 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:09.012 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T00:15:09.043 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:15:09.479 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librbd1. 2024-09-12T00:15:09.497 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T00:15:09.506 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../008-librbd1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:09.524 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:15:09.546 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:09.572 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:15:09.992 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T00:15:09.998 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T00:15:10.019 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:15:10.025 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:10.059 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:15:10.074 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:10.309 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rados. 2024-09-12T00:15:10.324 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:10.367 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:10.378 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T00:15:10.405 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:15:10.445 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:15:10.798 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T00:15:10.825 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T00:15:10.865 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:15:10.878 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T00:15:10.905 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:15:10.945 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:11.339 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T00:15:11.354 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:11.376 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package librados2. 2024-09-12T00:15:11.397 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:11.403 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../007-librados2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:11.443 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:11.709 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T00:15:11.735 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:15:11.775 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:11.854 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package librbd1. 2024-09-12T00:15:11.880 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../008-librbd1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:11.912 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:12.070 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T00:15:12.085 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T00:15:12.119 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:15:12.357 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T00:15:12.383 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:12.397 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T00:15:12.423 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:12.423 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T00:15:12.464 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T00:15:12.709 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-rados. 2024-09-12T00:15:12.716 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T00:15:12.736 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:12.742 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:12.776 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:12.783 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:13.104 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T00:15:13.128 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T00:15:13.131 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:15:13.154 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T00:15:13.170 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:13.194 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:15:13.389 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T00:15:13.405 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:13.439 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:13.455 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T00:15:13.470 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T00:15:13.505 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:15:13.759 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T00:15:13.766 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T00:15:13.781 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T00:15:13.786 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:15:13.824 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:15:13.825 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:14.137 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T00:15:14.153 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package lua5.1. 2024-09-12T00:15:14.153 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T00:15:14.179 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T00:15:14.186 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:15:14.219 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:15:14.515 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T00:15:14.539 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package lua-any. 2024-09-12T00:15:14.542 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T00:15:14.554 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T00:15:14.581 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T00:15:14.597 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T00:15:14.833 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package zip. 2024-09-12T00:15:14.848 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T00:15:14.850 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T00:15:14.867 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:14.883 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T00:15:14.909 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:15.177 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package unzip. 2024-09-12T00:15:15.203 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T00:15:15.244 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:15:15.262 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T00:15:15.289 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T00:15:15.329 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:15:15.573 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T00:15:15.599 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T00:15:15.631 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:15:15.639 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package luarocks. 2024-09-12T00:15:15.665 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T00:15:15.706 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:15:15.950 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T00:15:15.967 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T00:15:16.009 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:15:16.089 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librgw2. 2024-09-12T00:15:16.115 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../025-librgw2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:16.155 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:16.521 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package lua5.1. 2024-09-12T00:15:16.548 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T00:15:16.588 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:15:16.732 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T00:15:16.747 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:16.791 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:16.890 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package lua-any. 2024-09-12T00:15:16.906 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T00:15:16.941 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T00:15:17.127 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T00:15:17.154 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T00:15:17.193 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package zip. 2024-09-12T00:15:17.194 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:15:17.209 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T00:15:17.251 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T00:15:17.463 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T00:15:17.489 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:17.521 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:17.596 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package unzip. 2024-09-12T00:15:17.623 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T00:15:17.663 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:15:17.916 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-common. 2024-09-12T00:15:17.942 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:17.993 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:18.042 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package luarocks. 2024-09-12T00:15:18.069 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T00:15:18.101 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:15:18.461 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package librgw2. 2024-09-12T00:15:18.485 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../025-librgw2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:18.516 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:19.144 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T00:15:19.159 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:19.201 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:19.496 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-base. 2024-09-12T00:15:19.523 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:19.546 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T00:15:19.572 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:19.573 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T00:15:19.613 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:15:19.891 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T00:15:19.917 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:19.949 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:20.125 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T00:15:20.151 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T00:15:20.192 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:15:20.379 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-common. 2024-09-12T00:15:20.407 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:20.446 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:20.452 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T00:15:20.468 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T00:15:20.511 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:15:20.814 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T00:15:20.840 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T00:15:20.880 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:15:21.400 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T00:15:21.426 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T00:15:21.466 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:15:21.769 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T00:15:21.795 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T00:15:21.844 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:15:22.051 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-base. 2024-09-12T00:15:22.078 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:22.105 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T00:15:22.127 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:22.131 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T00:15:22.163 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T00:15:22.449 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-portend. 2024-09-12T00:15:22.476 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T00:15:22.524 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T00:15:22.722 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T00:15:22.749 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T00:15:22.797 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:15:22.827 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T00:15:22.853 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T00:15:22.894 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T00:15:23.167 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T00:15:23.171 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T00:15:23.193 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T00:15:23.198 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T00:15:23.238 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:15:23.241 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:15:23.583 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T00:15:23.609 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T00:15:23.611 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T00:15:23.638 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T00:15:23.658 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T00:15:23.678 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:15:23.969 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T00:15:23.981 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T00:15:23.996 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T00:15:24.008 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T00:15:24.036 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T00:15:24.047 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:15:24.297 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T00:15:24.323 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T00:15:24.355 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:15:24.383 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T00:15:24.410 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T00:15:24.458 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:15:24.625 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-mako. 2024-09-12T00:15:24.651 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T00:15:24.691 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:15:24.845 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T00:15:24.872 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T00:15:24.920 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T00:15:25.019 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T00:15:25.046 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T00:15:25.086 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:15:25.231 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-portend. 2024-09-12T00:15:25.258 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T00:15:25.297 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T00:15:25.347 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T00:15:25.362 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T00:15:25.422 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:15:25.600 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T00:15:25.627 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T00:15:25.667 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T00:15:25.724 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-webob. 2024-09-12T00:15:25.751 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T00:15:25.791 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:15:26.020 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T00:15:26.047 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T00:15:26.095 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:15:26.144 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T00:15:26.171 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T00:15:26.214 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:15:26.465 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T00:15:26.492 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T00:15:26.522 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T00:15:26.531 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T00:15:26.548 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T00:15:26.589 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:15:26.835 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T00:15:26.862 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T00:15:26.875 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-paste. 2024-09-12T00:15:26.901 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T00:15:26.902 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T00:15:26.941 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:15:27.138 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T00:15:27.165 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T00:15:27.221 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:15:27.261 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T00:15:27.276 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T00:15:27.319 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:15:27.507 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-mako. 2024-09-12T00:15:27.534 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T00:15:27.574 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:15:27.580 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T00:15:27.607 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T00:15:27.647 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:15:27.919 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T00:15:27.946 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T00:15:27.949 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T00:15:27.976 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T00:15:27.985 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:15:28.016 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T00:15:28.288 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T00:15:28.315 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T00:15:28.327 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T00:15:28.354 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T00:15:28.355 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:15:28.394 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:15:28.633 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-webob. 2024-09-12T00:15:28.660 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T00:15:28.699 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:15:28.749 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T00:15:28.775 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T00:15:28.815 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T00:15:29.036 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T00:15:29.063 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T00:15:29.106 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:15:29.168 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-idna. 2024-09-12T00:15:29.194 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T00:15:29.234 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:15:29.414 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T00:15:29.441 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T00:15:29.480 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:15:29.512 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T00:15:29.538 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T00:15:29.570 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:15:29.783 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-paste. 2024-09-12T00:15:29.810 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T00:15:29.849 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:15:29.890 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-requests. 2024-09-12T00:15:29.917 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T00:15:29.956 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:15:30.136 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T00:15:30.152 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T00:15:30.186 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:15:30.270 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T00:15:30.296 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T00:15:30.336 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:15:30.480 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T00:15:30.508 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T00:15:30.547 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:15:30.639 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T00:15:30.654 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:15:30.697 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:30.850 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T00:15:30.879 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T00:15:30.916 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T00:15:31.052 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T00:15:31.079 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:31.110 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:31.236 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T00:15:31.264 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T00:15:31.303 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:15:31.421 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T00:15:31.448 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T00:15:31.488 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:15:31.791 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T00:15:31.817 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T00:15:31.857 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T00:15:31.874 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T00:15:31.902 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T00:15:31.941 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T00:15:32.218 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T00:15:32.236 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-idna. 2024-09-12T00:15:32.245 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:32.263 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T00:15:32.302 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:15:32.360 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:33.463 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T00:15:33.464 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T00:15:33.490 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:33.490 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T00:15:33.530 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:33.530 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:15:33.844 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-requests. 2024-09-12T00:15:33.869 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T00:15:33.909 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:15:34.150 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T00:15:34.176 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:34.216 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:34.245 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T00:15:34.272 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T00:15:34.311 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:15:34.606 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T00:15:34.630 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:15:34.664 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:35.094 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T00:15:35.121 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:35.169 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:35.253 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph. 2024-09-12T00:15:35.268 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../066-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:35.303 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:35.464 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T00:15:35.491 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T00:15:35.522 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:15:35.605 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T00:15:35.632 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:35.672 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:35.808 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T00:15:35.835 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T00:15:35.874 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T00:15:36.041 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T00:15:36.068 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:36.108 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:36.228 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T00:15:36.255 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:36.294 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:36.520 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package cephadm. 2024-09-12T00:15:36.546 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../069-cephadm_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:36.586 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:36.697 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T00:15:36.725 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:36.764 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:37.064 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T00:15:37.090 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T00:15:37.130 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T00:15:37.292 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T00:15:37.320 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:37.350 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:37.416 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T00:15:37.431 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:15:37.474 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:15:38.470 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph. 2024-09-12T00:15:38.489 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../066-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:38.529 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:38.529 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-babel. 2024-09-12T00:15:38.556 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:15:38.596 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:15:38.840 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T00:15:38.867 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:38.907 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T00:15:38.914 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:38.933 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T00:15:38.973 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:15:39.301 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T00:15:39.309 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T00:15:39.329 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:39.336 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:15:39.368 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:39.376 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:39.746 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T00:15:39.773 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T00:15:39.779 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package cephadm. 2024-09-12T00:15:39.807 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../069-cephadm_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:39.812 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T00:15:39.854 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:40.090 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-routes. 2024-09-12T00:15:40.105 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T00:15:40.140 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:15:40.224 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T00:15:40.251 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T00:15:40.298 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T00:15:40.477 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T00:15:40.503 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:15:40.543 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:40.618 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T00:15:40.646 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:15:40.693 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:15:41.723 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-babel. 2024-09-12T00:15:41.752 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:15:41.838 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:15:42.251 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T00:15:42.278 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T00:15:42.309 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:15:42.654 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T00:15:42.681 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:15:42.712 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:43.032 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T00:15:43.059 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T00:15:43.081 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T00:15:43.090 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T00:15:43.111 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T00:15:43.155 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:15:43.351 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-routes. 2024-09-12T00:15:43.379 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T00:15:43.418 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:15:43.634 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T00:15:43.661 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T00:15:43.700 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:15:43.713 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T00:15:43.741 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:15:43.779 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:44.079 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T00:15:44.107 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T00:15:44.145 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:15:44.448 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T00:15:44.475 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T00:15:44.514 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:15:45.189 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T00:15:45.217 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:15:45.341 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:46.270 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T00:15:46.297 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T00:15:46.336 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T00:15:46.576 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T00:15:46.594 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T00:15:46.597 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T00:15:46.625 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T00:15:46.634 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:15:46.655 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:15:46.967 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T00:15:46.995 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T00:15:47.025 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:15:47.138 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T00:15:47.155 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T00:15:47.196 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:15:47.504 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T00:15:47.532 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T00:15:47.566 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T00:15:47.570 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T00:15:47.592 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T00:15:47.633 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:15:47.865 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T00:15:47.893 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T00:15:47.923 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T00:15:47.935 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T00:15:47.963 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T00:15:48.011 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:15:48.193 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T00:15:48.209 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T00:15:48.243 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:15:48.529 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T00:15:48.557 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T00:15:48.596 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T00:15:48.686 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T00:15:48.714 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:15:48.839 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:48.908 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T00:15:48.935 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T00:15:48.974 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:15:49.596 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T00:15:49.613 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:15:49.654 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:49.842 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T00:15:49.870 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T00:15:49.908 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T00:15:49.973 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T00:15:50.001 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T00:15:50.040 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:15:50.220 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T00:15:50.248 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T00:15:50.286 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:15:50.376 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T00:15:50.404 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:15:50.442 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:15:50.590 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T00:15:50.618 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T00:15:50.647 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:15:50.679 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package jq. 2024-09-12T00:15:50.695 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:15:50.737 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T00:15:50.917 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T00:15:50.945 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T00:15:50.984 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T00:15:51.006 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package socat. 2024-09-12T00:15:51.034 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T00:15:51.072 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:15:51.313 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T00:15:51.341 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T00:15:51.375 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T00:15:51.379 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T00:15:51.392 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T00:15:51.434 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:15:51.699 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T00:15:51.727 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T00:15:51.766 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:15:51.788 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-test. 2024-09-12T00:15:51.804 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:51.846 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:52.344 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T00:15:52.372 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T00:15:52.418 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T00:15:52.914 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T00:15:52.942 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T00:15:52.980 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:15:53.669 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T00:15:53.686 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:15:53.727 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:54.047 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T00:15:54.075 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T00:15:54.113 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:15:54.426 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T00:15:54.450 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T00:15:54.453 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:15:54.478 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:15:54.491 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:54.516 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:15:54.744 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package jq. 2024-09-12T00:15:54.761 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:15:54.802 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T00:15:54.812 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T00:15:54.840 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:54.879 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:55.055 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package socat. 2024-09-12T00:15:55.072 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T00:15:55.113 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:15:55.190 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T00:15:55.206 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T00:15:55.240 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:15:55.408 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T00:15:55.425 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T00:15:55.466 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:15:55.561 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T00:15:55.589 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T00:15:55.627 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:15:55.804 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-test. 2024-09-12T00:15:55.821 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:55.867 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:56.015 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T00:15:56.042 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T00:15:56.081 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:15:56.494 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package pkg-config. 2024-09-12T00:15:56.522 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T00:15:56.560 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:15:56.822 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T00:15:56.838 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T00:15:56.880 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:15:57.291 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T00:15:57.320 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T00:15:57.358 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T00:15:57.686 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T00:15:57.713 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T00:15:57.752 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T00:15:58.072 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T00:15:58.101 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T00:15:58.139 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:15:58.450 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T00:15:58.450 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T00:15:58.478 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T00:15:58.479 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:15:58.516 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:58.517 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T00:15:58.804 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T00:15:58.833 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:15:58.836 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-py. 2024-09-12T00:15:58.864 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T00:15:58.870 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:15:58.902 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T00:15:59.190 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T00:15:59.218 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T00:15:59.222 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T00:15:59.251 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T00:15:59.256 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:15:59.289 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:15:59.561 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T00:15:59.590 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T00:15:59.619 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:15:59.745 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T00:15:59.771 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T00:15:59.826 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:15:59.982 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T00:16:00.010 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T00:16:00.048 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:16:00.128 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-toml. 2024-09-12T00:16:00.157 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T00:16:00.195 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T00:16:00.498 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T00:16:00.526 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T00:16:00.545 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package pkg-config. 2024-09-12T00:16:00.564 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:16:00.574 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T00:16:00.613 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:16:00.867 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T00:16:00.874 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T00:16:00.895 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T00:16:00.903 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T00:16:00.934 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:16:00.941 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:16:01.203 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T00:16:01.219 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T00:16:01.261 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:16:01.361 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T00:16:01.389 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T00:16:01.427 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T00:16:01.730 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T00:16:01.758 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T00:16:01.796 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T00:16:01.966 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package radosgw. 2024-09-12T00:16:01.998 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../116-radosgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:02.032 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:02.100 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T00:16:02.128 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T00:16:02.158 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:16:02.444 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T00:16:02.473 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T00:16:02.511 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T00:16:02.814 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-py. 2024-09-12T00:16:02.842 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T00:16:02.872 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T00:16:02.926 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T00:16:02.942 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:02.984 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:03.150 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T00:16:03.179 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T00:16:03.217 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:16:03.522 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T00:16:03.654 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T00:16:03.683 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T00:16:03.720 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:16:03.781 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:16:03.907 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:16:04.048 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-toml. 2024-09-12T00:16:04.077 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T00:16:04.123 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T00:16:04.160 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T00:16:04.426 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T00:16:04.455 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T00:16:04.478 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T00:16:04.492 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:16:04.846 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T00:16:04.875 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T00:16:04.909 INFO:teuthology.orchestra.run.smithi097.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T00:16:04.912 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:16:04.975 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:05.182 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T00:16:05.199 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T00:16:05.231 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:16:05.442 INFO:teuthology.orchestra.run.smithi097.stdout:Adding system user cephadm....done 2024-09-12T00:16:05.598 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:16:05.882 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:16:06.019 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package radosgw. 2024-09-12T00:16:06.048 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../116-radosgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:06.093 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:06.134 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:16:06.243 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:16:06.502 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T00:16:06.753 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:16:06.888 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T00:16:07.055 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T00:16:07.072 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:16:07.147 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:07.198 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:16:07.558 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T00:16:07.782 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T00:16:07.801 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T00:16:08.043 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:16:08.069 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:16:08.144 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:16:08.312 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:16:08.389 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T00:16:08.605 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:16:08.757 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T00:16:08.864 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:16:09.115 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:09.183 INFO:teuthology.orchestra.run.smithi043.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T00:16:09.280 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:09.375 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:16:09.634 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:16:09.735 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:16:09.844 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:16:09.864 INFO:teuthology.orchestra.run.smithi043.stdout:Adding system user cephadm....done 2024-09-12T00:16:10.029 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:16:10.103 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:16:10.462 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T00:16:10.493 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T00:16:10.505 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:16:10.557 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:16:10.683 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T00:16:10.765 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:16:10.891 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:16:11.050 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:16:11.150 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T00:16:11.176 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T00:16:11.435 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:16:11.443 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:16:11.544 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T00:16:11.695 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:16:11.846 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:16:12.038 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T00:16:12.164 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:16:12.207 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T00:16:12.457 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T00:16:12.816 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:16:12.825 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:16:13.060 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:16:13.066 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:16:13.168 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:16:13.269 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:16:13.303 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:16:13.570 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T00:16:13.613 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:16:13.948 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T00:16:13.955 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:14.199 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:16:14.206 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:16:14.307 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:16:14.433 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:16:14.559 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:16:14.567 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:16:14.843 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:16:14.852 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:16:15.186 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:16:15.187 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T00:16:15.215 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T00:16:15.279 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:16:15.389 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T00:16:15.429 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:16:15.565 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:15.740 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:16:15.858 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T00:16:15.865 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:16:16.142 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:16:16.174 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:16:16.410 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:16:16.686 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T00:16:16.812 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:16:17.296 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:16:17.497 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:16:17.548 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:16:17.683 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T00:16:17.740 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:16:17.866 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:16:17.958 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:16:18.084 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:16:18.227 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:16:18.275 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:16:18.512 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:16:18.585 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T00:16:18.754 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T00:16:18.961 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T00:16:19.006 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:16:19.150 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:16:19.212 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:16:19.450 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:16:19.589 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:16:19.692 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T00:16:19.865 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:16:19.960 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T00:16:20.208 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:16:20.211 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:16:20.454 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T00:16:20.467 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:16:20.576 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:20.713 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:16:20.840 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T00:16:20.861 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:16:21.132 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:16:21.179 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:16:21.261 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:16:21.543 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:16:21.827 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:16:22.070 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:16:22.171 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:16:22.280 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:16:22.369 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T00:16:22.434 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:16:22.607 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:16:22.669 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:16:22.758 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:16:22.787 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T00:16:23.063 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:16:23.168 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:16:23.189 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:16:23.415 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:16:23.418 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T00:16:23.545 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T00:16:23.741 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:16:23.796 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:16:23.922 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:16:24.001 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T00:16:24.240 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:16:24.277 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:16:24.378 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:16:24.549 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:16:24.672 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:16:24.817 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T00:16:24.918 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T00:16:24.922 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T00:16:25.181 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T00:16:25.186 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T00:16:25.441 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:16:25.461 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:16:25.700 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T00:16:25.815 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:16:25.976 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:16:26.102 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T00:16:26.217 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T00:16:26.403 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:16:26.485 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:16:26.529 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:16:26.814 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:16:26.820 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:16:26.947 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:27.081 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:27.131 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:16:27.191 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:16:27.391 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:16:27.468 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:27.517 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:16:27.594 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:27.643 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:16:27.720 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T00:16:27.731 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T00:16:27.978 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:16:27.997 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:28.104 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:16:28.132 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:28.258 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:28.455 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:16:28.455 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:16:28.505 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:16:28.781 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T00:16:28.908 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T00:16:29.143 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:29.192 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:16:29.243 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:29.309 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:16:29.369 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:29.495 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:16:29.619 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:16:29.920 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:16:30.196 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T00:16:30.297 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T00:16:30.549 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T00:16:30.641 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:30.758 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:30.824 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:16:30.867 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:30.968 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:31.094 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:31.186 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:16:31.579 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T00:16:31.612 INFO:teuthology.orchestra.run.smithi097.stdout:Adding group ceph....done 2024-09-12T00:16:31.856 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:16:31.897 INFO:teuthology.orchestra.run.smithi097.stdout:Adding system user ceph....done 2024-09-12T00:16:32.066 INFO:teuthology.orchestra.run.smithi097.stdout:Setting system user ceph properties....done 2024-09-12T00:16:32.085 INFO:teuthology.orchestra.run.smithi097.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T00:16:32.200 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:16:32.238 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T00:16:32.326 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:32.452 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:32.578 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:16:32.592 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T00:16:32.914 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:33.015 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:33.104 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:33.141 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T00:16:33.230 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:33.426 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:33.552 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:33.678 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:33.708 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:16:33.709 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:16:33.915 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:16:33.915 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:16:34.207 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:34.438 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:34.524 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T00:16:34.572 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:34.698 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:34.824 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:16:35.000 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:35.231 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:16:35.231 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:16:35.743 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:35.956 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:16:35.956 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:16:36.086 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:36.212 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:36.355 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:36.436 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:36.456 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:36.565 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:36.709 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:16:36.709 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:16:37.075 INFO:teuthology.orchestra.run.smithi043.stdout:Adding group ceph....done 2024-09-12T00:16:37.179 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:37.305 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:37.384 INFO:teuthology.orchestra.run.smithi043.stdout:Adding system user ceph....done 2024-09-12T00:16:37.457 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:37.553 INFO:teuthology.orchestra.run.smithi043.stdout:Setting system user ceph properties....done 2024-09-12T00:16:37.566 INFO:teuthology.orchestra.run.smithi043.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T00:16:37.647 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:16:37.647 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:16:37.719 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T00:16:38.095 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T00:16:38.133 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:38.259 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:38.368 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:38.519 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:38.583 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:38.709 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:38.944 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T00:16:39.160 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:16:39.160 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:16:39.182 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T00:16:39.318 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:16:39.636 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:40.020 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T00:16:40.360 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T00:16:40.462 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:40.688 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:16:40.688 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:16:41.077 INFO:teuthology.orchestra.run.smithi097.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T00:16:41.081 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-12T00:16:41.136 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-09-12T00:16:41.207 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:41.345 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-09-12T00:16:41.345 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-09-12T00:16:41.494 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:16:41.494 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:16:41.547 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:16:41.547 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:16:41.547 INFO:teuthology.orchestra.run.smithi097.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:16:41.547 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:16:41.548 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:16:41.548 INFO:teuthology.orchestra.run.smithi097.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:16:41.548 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:16:41.549 INFO:teuthology.orchestra.run.smithi097.stdout:The following additional packages will be installed: 2024-09-12T00:16:41.549 INFO:teuthology.orchestra.run.smithi097.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T00:16:41.550 INFO:teuthology.orchestra.run.smithi097.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T00:16:41.550 INFO:teuthology.orchestra.run.smithi097.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T00:16:41.550 INFO:teuthology.orchestra.run.smithi097.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T00:16:41.550 INFO:teuthology.orchestra.run.smithi097.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T00:16:41.550 INFO:teuthology.orchestra.run.smithi097.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T00:16:41.550 INFO:teuthology.orchestra.run.smithi097.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T00:16:41.550 INFO:teuthology.orchestra.run.smithi097.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T00:16:41.550 INFO:teuthology.orchestra.run.smithi097.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T00:16:41.550 INFO:teuthology.orchestra.run.smithi097.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T00:16:41.551 INFO:teuthology.orchestra.run.smithi097.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-12T00:16:41.551 INFO:teuthology.orchestra.run.smithi097.stdout:Suggested packages: 2024-09-12T00:16:41.551 INFO:teuthology.orchestra.run.smithi097.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-12T00:16:41.551 INFO:teuthology.orchestra.run.smithi097.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-12T00:16:41.551 INFO:teuthology.orchestra.run.smithi097.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-12T00:16:41.551 INFO:teuthology.orchestra.run.smithi097.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-12T00:16:41.551 INFO:teuthology.orchestra.run.smithi097.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-12T00:16:41.594 INFO:teuthology.orchestra.run.smithi097.stdout:The following NEW packages will be installed: 2024-09-12T00:16:41.594 INFO:teuthology.orchestra.run.smithi097.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T00:16:41.594 INFO:teuthology.orchestra.run.smithi097.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T00:16:41.594 INFO:teuthology.orchestra.run.smithi097.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T00:16:41.595 INFO:teuthology.orchestra.run.smithi097.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T00:16:41.595 INFO:teuthology.orchestra.run.smithi097.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T00:16:41.595 INFO:teuthology.orchestra.run.smithi097.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T00:16:41.595 INFO:teuthology.orchestra.run.smithi097.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T00:16:41.595 INFO:teuthology.orchestra.run.smithi097.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T00:16:41.595 INFO:teuthology.orchestra.run.smithi097.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T00:16:41.595 INFO:teuthology.orchestra.run.smithi097.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T00:16:41.595 INFO:teuthology.orchestra.run.smithi097.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-12T00:16:41.596 INFO:teuthology.orchestra.run.smithi097.stdout: s3cmd 2024-09-12T00:16:41.779 INFO:teuthology.orchestra.run.smithi097.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:16:41.779 INFO:teuthology.orchestra.run.smithi097.stdout:Need to get 10.4 MB of archives. 2024-09-12T00:16:41.779 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-12T00:16:41.779 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-12T00:16:41.861 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-12T00:16:41.861 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-12T00:16:41.878 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-12T00:16:42.041 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:42.042 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-12T00:16:42.112 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-12T00:16:42.120 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-12T00:16:42.254 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-12T00:16:42.347 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-12T00:16:42.348 INFO:teuthology.orchestra.run.smithi097.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-12T00:16:42.350 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:16:42.350 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:16:42.351 INFO:teuthology.orchestra.run.smithi097.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-12T00:16:42.496 INFO:teuthology.orchestra.run.smithi097.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-12T00:16:42.496 INFO:teuthology.orchestra.run.smithi097.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-12T00:16:42.536 INFO:teuthology.orchestra.run.smithi097.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-12T00:16:42.537 INFO:teuthology.orchestra.run.smithi097.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-12T00:16:42.541 INFO:teuthology.orchestra.run.smithi097.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-12T00:16:42.541 INFO:teuthology.orchestra.run.smithi097.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-12T00:16:42.541 INFO:teuthology.orchestra.run.smithi097.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-12T00:16:42.545 INFO:teuthology.orchestra.run.smithi097.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-12T00:16:42.546 INFO:teuthology.orchestra.run.smithi097.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-12T00:16:42.593 INFO:teuthology.orchestra.run.smithi097.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-12T00:16:42.595 INFO:teuthology.orchestra.run.smithi097.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-12T00:16:42.646 INFO:teuthology.orchestra.run.smithi097.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-12T00:16:42.647 INFO:teuthology.orchestra.run.smithi097.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-12T00:16:42.648 INFO:teuthology.orchestra.run.smithi097.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-12T00:16:42.650 INFO:teuthology.orchestra.run.smithi097.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-12T00:16:42.651 INFO:teuthology.orchestra.run.smithi097.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-12T00:16:42.674 INFO:teuthology.orchestra.run.smithi097.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-12T00:16:42.683 INFO:teuthology.orchestra.run.smithi097.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-12T00:16:42.688 INFO:teuthology.orchestra.run.smithi097.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-12T00:16:42.755 INFO:teuthology.orchestra.run.smithi097.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-12T00:16:42.756 INFO:teuthology.orchestra.run.smithi097.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-12T00:16:42.787 INFO:teuthology.orchestra.run.smithi097.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-12T00:16:42.788 INFO:teuthology.orchestra.run.smithi097.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-12T00:16:42.788 INFO:teuthology.orchestra.run.smithi097.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-12T00:16:42.810 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:42.936 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:43.087 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:43.230 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 10.4 MB in 1s (8,744 kB/s) 2024-09-12T00:16:43.290 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:16:43.290 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:16:43.322 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-12T00:16:43.383 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176248 files and directories currently installed.) 2024-09-12T00:16:43.388 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-12T00:16:43.430 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-12T00:16:43.658 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-12T00:16:43.674 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-12T00:16:43.709 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T00:16:43.814 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:43.944 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-12T00:16:43.957 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:43.961 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-12T00:16:44.002 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T00:16:44.083 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:44.234 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:16:44.285 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-12T00:16:44.314 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-12T00:16:44.364 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-12T00:16:44.612 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T00:16:44.641 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-12T00:16:44.670 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-12T00:16:44.708 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-12T00:16:44.738 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T00:16:44.882 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:16:44.961 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-12T00:16:44.989 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-12T00:16:45.027 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-12T00:16:45.271 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-12T00:16:45.287 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-12T00:16:45.329 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-12T00:16:45.540 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-12T00:16:45.557 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-12T00:16:45.598 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-12T00:16:45.682 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T00:16:45.892 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-12T00:16:45.909 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-12T00:16:45.951 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T00:16:46.203 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libjsr305-java. 2024-09-12T00:16:46.220 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-12T00:16:46.262 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-12T00:16:46.342 INFO:teuthology.orchestra.run.smithi043.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T00:16:46.346 DEBUG:teuthology.orchestra.run.smithi043:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-12T00:16:46.403 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2024-09-12T00:16:46.497 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libguava-java. 2024-09-12T00:16:46.514 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-12T00:16:46.556 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-12T00:16:46.616 INFO:teuthology.orchestra.run.smithi043.stdout:Building dependency tree... 2024-09-12T00:16:46.616 INFO:teuthology.orchestra.run.smithi043.stdout:Reading state information... 2024-09-12T00:16:46.825 INFO:teuthology.orchestra.run.smithi043.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:16:46.826 INFO:teuthology.orchestra.run.smithi043.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:16:46.826 INFO:teuthology.orchestra.run.smithi043.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:16:46.826 INFO:teuthology.orchestra.run.smithi043.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:16:46.826 INFO:teuthology.orchestra.run.smithi043.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:16:46.827 INFO:teuthology.orchestra.run.smithi043.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:16:46.827 INFO:teuthology.orchestra.run.smithi043.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:16:46.828 INFO:teuthology.orchestra.run.smithi043.stdout:The following additional packages will be installed: 2024-09-12T00:16:46.828 INFO:teuthology.orchestra.run.smithi043.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T00:16:46.828 INFO:teuthology.orchestra.run.smithi043.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T00:16:46.828 INFO:teuthology.orchestra.run.smithi043.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T00:16:46.828 INFO:teuthology.orchestra.run.smithi043.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T00:16:46.828 INFO:teuthology.orchestra.run.smithi043.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T00:16:46.829 INFO:teuthology.orchestra.run.smithi043.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T00:16:46.829 INFO:teuthology.orchestra.run.smithi043.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T00:16:46.829 INFO:teuthology.orchestra.run.smithi043.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T00:16:46.829 INFO:teuthology.orchestra.run.smithi043.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T00:16:46.829 INFO:teuthology.orchestra.run.smithi043.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T00:16:46.829 INFO:teuthology.orchestra.run.smithi043.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-12T00:16:46.830 INFO:teuthology.orchestra.run.smithi043.stdout:Suggested packages: 2024-09-12T00:16:46.830 INFO:teuthology.orchestra.run.smithi043.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-12T00:16:46.830 INFO:teuthology.orchestra.run.smithi043.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-12T00:16:46.830 INFO:teuthology.orchestra.run.smithi043.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-12T00:16:46.830 INFO:teuthology.orchestra.run.smithi043.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-12T00:16:46.831 INFO:teuthology.orchestra.run.smithi043.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-12T00:16:46.871 INFO:teuthology.orchestra.run.smithi043.stdout:The following NEW packages will be installed: 2024-09-12T00:16:46.871 INFO:teuthology.orchestra.run.smithi043.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T00:16:46.871 INFO:teuthology.orchestra.run.smithi043.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T00:16:46.871 INFO:teuthology.orchestra.run.smithi043.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T00:16:46.871 INFO:teuthology.orchestra.run.smithi043.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T00:16:46.871 INFO:teuthology.orchestra.run.smithi043.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T00:16:46.871 INFO:teuthology.orchestra.run.smithi043.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T00:16:46.871 INFO:teuthology.orchestra.run.smithi043.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T00:16:46.871 INFO:teuthology.orchestra.run.smithi043.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T00:16:46.871 INFO:teuthology.orchestra.run.smithi043.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T00:16:46.872 INFO:teuthology.orchestra.run.smithi043.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T00:16:46.872 INFO:teuthology.orchestra.run.smithi043.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-12T00:16:46.872 INFO:teuthology.orchestra.run.smithi043.stdout: s3cmd 2024-09-12T00:16:46.967 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-12T00:16:46.983 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-12T00:16:47.025 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-12T00:16:47.054 INFO:teuthology.orchestra.run.smithi043.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:16:47.054 INFO:teuthology.orchestra.run.smithi043.stdout:Need to get 10.4 MB of archives. 2024-09-12T00:16:47.054 INFO:teuthology.orchestra.run.smithi043.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-12T00:16:47.054 INFO:teuthology.orchestra.run.smithi043.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-12T00:16:47.136 INFO:teuthology.orchestra.run.smithi043.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-12T00:16:47.137 INFO:teuthology.orchestra.run.smithi043.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-12T00:16:47.153 INFO:teuthology.orchestra.run.smithi043.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-12T00:16:47.278 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libguice-java. 2024-09-12T00:16:47.295 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-12T00:16:47.317 INFO:teuthology.orchestra.run.smithi043.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-12T00:16:47.336 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-12T00:16:47.388 INFO:teuthology.orchestra.run.smithi043.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-12T00:16:47.395 INFO:teuthology.orchestra.run.smithi043.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-12T00:16:47.530 INFO:teuthology.orchestra.run.smithi043.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-12T00:16:47.623 INFO:teuthology.orchestra.run.smithi043.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-12T00:16:47.623 INFO:teuthology.orchestra.run.smithi043.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-12T00:16:47.627 INFO:teuthology.orchestra.run.smithi043.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-12T00:16:47.698 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-12T00:16:47.714 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-12T00:16:47.756 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-12T00:16:47.771 INFO:teuthology.orchestra.run.smithi043.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-12T00:16:47.772 INFO:teuthology.orchestra.run.smithi043.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-12T00:16:47.812 INFO:teuthology.orchestra.run.smithi043.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-12T00:16:47.813 INFO:teuthology.orchestra.run.smithi043.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-12T00:16:47.814 INFO:teuthology.orchestra.run.smithi043.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-12T00:16:47.816 INFO:teuthology.orchestra.run.smithi043.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-12T00:16:47.817 INFO:teuthology.orchestra.run.smithi043.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-12T00:16:47.822 INFO:teuthology.orchestra.run.smithi043.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-12T00:16:47.823 INFO:teuthology.orchestra.run.smithi043.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-12T00:16:47.868 INFO:teuthology.orchestra.run.smithi043.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-12T00:16:47.871 INFO:teuthology.orchestra.run.smithi043.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-12T00:16:47.922 INFO:teuthology.orchestra.run.smithi043.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-12T00:16:47.923 INFO:teuthology.orchestra.run.smithi043.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-12T00:16:47.924 INFO:teuthology.orchestra.run.smithi043.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-12T00:16:47.926 INFO:teuthology.orchestra.run.smithi043.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-12T00:16:47.927 INFO:teuthology.orchestra.run.smithi043.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-12T00:16:47.951 INFO:teuthology.orchestra.run.smithi043.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-12T00:16:47.959 INFO:teuthology.orchestra.run.smithi043.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-12T00:16:47.964 INFO:teuthology.orchestra.run.smithi043.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-12T00:16:47.992 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-12T00:16:48.008 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-12T00:16:48.031 INFO:teuthology.orchestra.run.smithi043.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-12T00:16:48.031 INFO:teuthology.orchestra.run.smithi043.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-12T00:16:48.050 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-12T00:16:48.065 INFO:teuthology.orchestra.run.smithi043.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-12T00:16:48.065 INFO:teuthology.orchestra.run.smithi043.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-12T00:16:48.065 INFO:teuthology.orchestra.run.smithi043.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-12T00:16:48.303 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libjansi-java. 2024-09-12T00:16:48.319 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-12T00:16:48.361 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-12T00:16:48.531 INFO:teuthology.orchestra.run.smithi043.stdout:Fetched 10.4 MB in 1s (8,743 kB/s) 2024-09-12T00:16:48.622 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-12T00:16:48.637 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-12T00:16:48.638 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-12T00:16:48.682 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-12T00:16:48.719 INFO:teuthology.orchestra.run.smithi043.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176248 files and directories currently installed.) 2024-09-12T00:16:48.725 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-12T00:16:48.785 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-12T00:16:48.933 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-12T00:16:48.949 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-12T00:16:48.983 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-12T00:16:49.148 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-12T00:16:49.165 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-12T00:16:49.206 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T00:16:49.227 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-12T00:16:49.243 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-12T00:16:49.285 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T00:16:49.493 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-12T00:16:49.521 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-12T00:16:49.567 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T00:16:49.715 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-12T00:16:49.731 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-12T00:16:49.764 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T00:16:49.870 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-12T00:16:49.899 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-12T00:16:49.945 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-12T00:16:50.044 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-12T00:16:50.071 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-12T00:16:50.110 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T00:16:50.273 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-12T00:16:50.290 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-12T00:16:50.339 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-12T00:16:50.363 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-12T00:16:50.379 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-12T00:16:50.421 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-12T00:16:50.609 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-12T00:16:50.637 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-12T00:16:50.648 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-12T00:16:50.665 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-12T00:16:50.707 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T00:16:50.708 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-12T00:16:50.951 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-12T00:16:50.969 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-12T00:16:50.979 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-12T00:16:50.997 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-12T00:16:51.018 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T00:16:51.114 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-12T00:16:51.270 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-12T00:16:51.298 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-12T00:16:51.337 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-12T00:16:51.355 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-12T00:16:51.372 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-12T00:16:51.430 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-12T00:16:51.723 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-12T00:16:51.740 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-12T00:16:51.774 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-12T00:16:51.781 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T00:16:51.803 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-12T00:16:51.849 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T00:16:52.034 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libslf4j-java. 2024-09-12T00:16:52.050 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-12T00:16:52.092 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-12T00:16:52.110 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libjsr305-java. 2024-09-12T00:16:52.127 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-12T00:16:52.168 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-12T00:16:52.345 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-12T00:16:52.362 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-12T00:16:52.404 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-12T00:16:52.438 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libguava-java. 2024-09-12T00:16:52.456 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-12T00:16:52.496 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-12T00:16:52.690 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-12T00:16:52.706 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-12T00:16:52.748 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-12T00:16:52.892 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-12T00:16:52.909 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-12T00:16:52.950 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-12T00:16:53.018 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-12T00:16:53.034 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-12T00:16:53.076 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-12T00:16:53.203 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libguice-java. 2024-09-12T00:16:53.220 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-12T00:16:53.261 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-12T00:16:53.455 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-12T00:16:53.472 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-12T00:16:53.514 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-12T00:16:53.632 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-12T00:16:53.649 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-12T00:16:53.690 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-12T00:16:53.766 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-12T00:16:53.783 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-12T00:16:53.825 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T00:16:54.226 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-12T00:16:54.252 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package maven. 2024-09-12T00:16:54.255 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-12T00:16:54.281 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-12T00:16:54.293 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-12T00:16:54.319 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking maven (3.6.3-5) ... 2024-09-12T00:16:54.681 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-magic. 2024-09-12T00:16:54.688 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libjansi-java. 2024-09-12T00:16:54.710 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-12T00:16:54.718 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-12T00:16:54.748 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-12T00:16:54.997 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-12T00:16:55.084 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package s3cmd. 2024-09-12T00:16:55.113 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-12T00:16:55.150 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-12T00:16:55.267 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-12T00:16:55.296 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-12T00:16:55.333 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-12T00:16:55.505 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-12T00:16:55.585 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-12T00:16:55.602 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-12T00:16:55.631 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-12T00:16:55.645 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-12T00:16:55.756 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T00:16:55.883 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-12T00:16:55.921 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-12T00:16:55.939 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-12T00:16:55.979 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T00:16:56.000 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-12T00:16:56.110 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-12T00:16:56.199 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-12T00:16:56.210 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T00:16:56.216 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-12T00:16:56.257 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T00:16:56.345 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-12T00:16:56.471 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T00:16:56.572 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T00:16:56.586 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-12T00:16:56.615 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-12T00:16:56.653 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T00:16:56.697 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-12T00:16:56.824 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T00:16:56.922 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-12T00:16:56.939 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-12T00:16:56.958 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-12T00:16:56.980 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-12T00:16:57.084 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T00:16:57.210 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T00:16:57.224 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-12T00:16:57.242 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-12T00:16:57.274 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T00:16:57.336 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-12T00:16:57.493 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-12T00:16:57.511 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-12T00:16:57.551 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T00:16:57.595 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-12T00:16:57.721 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-12T00:16:57.804 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-12T00:16:57.821 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-12T00:16:57.847 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T00:16:57.879 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-12T00:16:57.973 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-12T00:16:58.099 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-12T00:16:58.148 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-12T00:16:58.177 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-12T00:16:58.210 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-12T00:16:58.214 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T00:16:58.328 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-12T00:16:58.459 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libslf4j-java. 2024-09-12T00:16:58.477 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-12T00:16:58.509 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-12T00:16:58.621 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-12T00:16:58.763 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-12T00:16:58.763 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T00:16:58.792 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-12T00:16:58.829 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-12T00:16:58.889 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libguava-java (29.0-6) ... 2024-09-12T00:16:59.016 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-12T00:16:59.115 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-12T00:16:59.133 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-12T00:16:59.150 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-12T00:16:59.173 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-12T00:16:59.268 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-12T00:16:59.377 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-12T00:16:59.451 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-12T00:16:59.469 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-12T00:16:59.486 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-12T00:16:59.509 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-12T00:16:59.612 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-12T00:16:59.738 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T00:16:59.864 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-12T00:16:59.865 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-12T00:16:59.882 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-12T00:16:59.957 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-12T00:16:59.990 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up maven (3.6.3-5) ... 2024-09-12T00:17:00.225 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-12T00:17:00.242 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-12T00:17:00.283 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T00:17:00.753 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package maven. 2024-09-12T00:17:00.782 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-12T00:17:00.819 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking maven (3.6.3-5) ... 2024-09-12T00:17:00.875 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-12T00:17:00.931 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:17:01.089 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package python3-magic. 2024-09-12T00:17:01.103 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-12T00:17:01.139 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-12T00:17:01.535 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package s3cmd. 2024-09-12T00:17:01.551 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-12T00:17:01.600 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-12T00:17:02.022 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-12T00:17:02.156 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-12T00:17:02.282 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T00:17:02.293 INFO:teuthology.orchestra.run.smithi097.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T00:17:02.298 DEBUG:teuthology.parallel:result is None 2024-09-12T00:17:02.416 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-12T00:17:02.542 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-12T00:17:02.668 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-12T00:17:02.777 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T00:17:02.878 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-12T00:17:02.981 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T00:17:03.105 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T00:17:03.233 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-12T00:17:03.374 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T00:17:03.500 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-12T00:17:03.626 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T00:17:03.752 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T00:17:03.861 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-12T00:17:04.104 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-12T00:17:04.222 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-12T00:17:04.348 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T00:17:04.474 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-12T00:17:04.608 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-12T00:17:04.747 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-12T00:17:04.877 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-12T00:17:05.179 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-12T00:17:05.288 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T00:17:05.414 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libguava-java (29.0-6) ... 2024-09-12T00:17:05.540 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-12T00:17:05.666 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-12T00:17:05.792 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-12T00:17:05.918 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-12T00:17:06.044 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-12T00:17:06.145 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-12T00:17:06.246 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T00:17:06.355 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-12T00:17:06.481 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up maven (3.6.3-5) ... 2024-09-12T00:17:06.747 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-12T00:17:06.811 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:17:08.342 INFO:teuthology.orchestra.run.smithi043.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T00:17:08.347 DEBUG:teuthology.parallel:result is None 2024-09-12T00:17:08.348 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:17:08.495 DEBUG:teuthology.orchestra.run.smithi043:> dpkg-query -W -f '${Version}' ceph 2024-09-12T00:17:08.515 INFO:teuthology.orchestra.run.smithi043.stdout:19.3.0-4753-gd011c522-1jammy 2024-09-12T00:17:08.515 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:17:08.516 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753-gd011c522-1jammy is installed. 2024-09-12T00:17:08.517 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:17:08.664 DEBUG:teuthology.orchestra.run.smithi097:> dpkg-query -W -f '${Version}' ceph 2024-09-12T00:17:08.683 INFO:teuthology.orchestra.run.smithi097.stdout:19.3.0-4753-gd011c522-1jammy 2024-09-12T00:17:08.684 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:17:08.684 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753-gd011c522-1jammy is installed. 2024-09-12T00:17:08.686 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T00:17:08.686 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:17:08.686 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:17:08.701 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T00:17:08.701 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:17:08.737 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T00:17:08.737 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:17:08.737 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:17:08.760 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:17:08.817 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T00:17:08.817 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:17:08.830 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:17:08.884 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T00:17:08.884 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:17:08.884 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:17:08.897 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:17:08.956 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T00:17:08.956 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:17:08.973 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:17:09.028 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T00:17:09.028 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:17:09.029 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:17:09.042 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:17:09.097 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T00:17:09.097 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:17:09.109 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:17:09.163 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T00:17:09.250 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T00:17:09.251 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 777 /var/log/ceph 2024-09-12T00:17:09.253 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 777 /var/log/ceph 2024-09-12T00:17:09.266 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T00:17:09.266 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:17:09.314 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:17:09.326 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T00:17:09.327 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:17:09.370 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:17:09.427 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T00:17:09.427 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T00:17:09.427 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901842', 'branch': 'wip-cls-rgw-busy-resharding', 'description': 'rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}', 'email': None, 'first_in_suite': False, 'job_id': '7901842', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-cls-rgw-busy-resharding'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, 'openssl_keys': {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}}, 'rgw': {'client.0': {'ssl certificate': 'rgw.client.0'}, 'compression type': 'random', 'ec-data-pool': False, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-67986', 'sha1': '6a169fc940965ab446a63954fde870aa497efde7'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 2206, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-67986', 'suite_path': '/home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/cbodley/ceph.git', 'suite_sha1': '6a169fc940965ab446a63954fde870aa497efde7', 'targets': {'smithi043.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGf+v5ISJ+ENS1EDXSs857wfcuBDave/lWV0nldXgIyGgeDGaE0YL7jfsCsXFVKcRcwfx0JqC3qfA9yW1EdN1E0=', 'smithi097.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEQ5/w4oC4TjXo1MLneYKKPa51CBrDnIMGQhg+h9op19OjYX29ks8HzjhIIhrzyNeANQlbs2ksd5F1uvhW6N9IA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'force-branch': 'wip-67986', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_23:33:24', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T00:17:09.428 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:17:09.430 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:17:09.436 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:17:09.478 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:17:09.493 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:17:09.493 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:17:09.537 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:17:09.537 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_1 2024-09-12T00:17:09.589 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:17:09.589 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:17:09.589 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 870 Links: 1 2024-09-12T00:17:09.589 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:17:09.589 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-09-12 00:11:12.305266927 +0000 2024-09-12T00:17:09.589 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-09-12 00:11:12.049269215 +0000 2024-09-12T00:17:09.589 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-09-12 00:11:12.049269215 +0000 2024-09-12T00:17:09.589 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: - 2024-09-12T00:17:09.590 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:17:09.644 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-09-12T00:17:09.644 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-09-12T00:17:09.644 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000310954 s, 1.6 MB/s 2024-09-12T00:17:09.645 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:17:09.698 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_2 2024-09-12T00:17:09.745 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:17:09.745 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:17:09.746 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 891 Links: 1 2024-09-12T00:17:09.746 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:17:09.746 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-09-12 00:11:12.789262604 +0000 2024-09-12T00:17:09.746 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-09-12 00:11:12.525264963 +0000 2024-09-12T00:17:09.746 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-09-12 00:11:12.525264963 +0000 2024-09-12T00:17:09.746 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: - 2024-09-12T00:17:09.746 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:17:09.800 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-09-12T00:17:09.800 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-09-12T00:17:09.800 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000308377 s, 1.7 MB/s 2024-09-12T00:17:09.801 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:17:09.851 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_3 2024-09-12T00:17:09.901 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:17:09.901 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:17:09.902 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 908 Links: 1 2024-09-12T00:17:09.902 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:17:09.902 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-09-12 00:11:13.021260533 +0000 2024-09-12T00:17:09.902 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-09-12 00:11:13.017260569 +0000 2024-09-12T00:17:09.902 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-09-12 00:11:13.017260569 +0000 2024-09-12T00:17:09.902 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: - 2024-09-12T00:17:09.902 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:17:09.956 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-09-12T00:17:09.956 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-09-12T00:17:09.956 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000306641 s, 1.7 MB/s 2024-09-12T00:17:09.957 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:17:10.007 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_4 2024-09-12T00:17:10.053 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:17:10.053 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:17:10.054 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 921 Links: 1 2024-09-12T00:17:10.054 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:17:10.054 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-09-12 00:11:13.525256031 +0000 2024-09-12T00:17:10.054 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-09-12 00:11:13.521256066 +0000 2024-09-12T00:17:10.054 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-09-12 00:11:13.521256066 +0000 2024-09-12T00:17:10.054 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: - 2024-09-12T00:17:10.054 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:17:10.109 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-09-12T00:17:10.109 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-09-12T00:17:10.109 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.00034781 s, 1.5 MB/s 2024-09-12T00:17:10.110 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:17:10.160 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:17:10.160 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T00:17:10.161 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:17:10.166 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:17:10.166 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_1 2024-09-12T00:17:10.213 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:17:10.213 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:17:10.213 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 871 Links: 1 2024-09-12T00:17:10.213 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:17:10.214 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-09-12 00:11:07.257238099 +0000 2024-09-12T00:17:10.214 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-09-12 00:11:07.005240350 +0000 2024-09-12T00:17:10.214 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-09-12 00:11:07.005240350 +0000 2024-09-12T00:17:10.214 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2024-09-12T00:17:10.214 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:17:10.267 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-09-12T00:17:10.268 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-09-12T00:17:10.268 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000401333 s, 1.3 MB/s 2024-09-12T00:17:10.269 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:17:10.318 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_2 2024-09-12T00:17:10.364 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:17:10.364 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:17:10.365 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 893 Links: 1 2024-09-12T00:17:10.365 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:17:10.365 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-09-12 00:11:07.757233632 +0000 2024-09-12T00:17:10.365 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-09-12 00:11:07.497235956 +0000 2024-09-12T00:17:10.365 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-09-12 00:11:07.497235956 +0000 2024-09-12T00:17:10.365 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2024-09-12T00:17:10.365 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:17:10.419 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-09-12T00:17:10.419 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-09-12T00:17:10.419 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000410296 s, 1.2 MB/s 2024-09-12T00:17:10.420 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:17:10.470 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_3 2024-09-12T00:17:10.516 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:17:10.517 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:17:10.517 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 908 Links: 1 2024-09-12T00:17:10.517 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:17:10.517 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-09-12 00:11:08.277228988 +0000 2024-09-12T00:17:10.517 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-09-12 00:11:08.005231417 +0000 2024-09-12T00:17:10.517 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-09-12 00:11:08.005231417 +0000 2024-09-12T00:17:10.517 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2024-09-12T00:17:10.517 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:17:10.570 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-09-12T00:17:10.570 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-09-12T00:17:10.571 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000370221 s, 1.4 MB/s 2024-09-12T00:17:10.572 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:17:10.622 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_4 2024-09-12T00:17:10.669 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:17:10.669 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:17:10.669 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-09-12T00:17:10.669 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:17:10.669 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-09-12 00:11:08.781224487 +0000 2024-09-12T00:17:10.669 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-09-12 00:11:08.549226559 +0000 2024-09-12T00:17:10.669 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-09-12 00:11:08.549226559 +0000 2024-09-12T00:17:10.669 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2024-09-12T00:17:10.670 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:17:10.727 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-09-12T00:17:10.727 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-09-12T00:17:10.727 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000332728 s, 1.5 MB/s 2024-09-12T00:17:10.729 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:17:10.778 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:17:10.778 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi043.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi097.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T00:17:10.778 INFO:tasks.ceph:Generating config... 2024-09-12T00:17:10.780 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-12T00:17:10.780 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-12T00:17:10.780 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-12T00:17:10.780 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-12T00:17:10.780 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-12T00:17:10.781 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:17:10.781 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-12T00:17:10.781 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-12T00:17:10.781 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-12T00:17:10.781 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-12T00:17:10.781 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-12T00:17:10.782 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-12T00:17:10.782 INFO:tasks.ceph:[client] setuser = ceph 2024-09-12T00:17:10.782 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-12T00:17:10.782 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-12T00:17:10.782 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-12T00:17:10.782 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-12T00:17:10.782 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T00:17:10.782 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T00:17:10.783 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T00:17:10.783 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T00:17:10.783 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T00:17:10.783 INFO:tasks.ceph:[mon] lockdep = True 2024-09-12T00:17:10.783 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T00:17:10.783 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T00:17:10.783 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T00:17:10.783 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T00:17:10.783 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T00:17:10.783 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T00:17:10.783 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T00:17:10.783 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T00:17:10.783 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-12T00:17:10.783 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T00:17:10.784 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T00:17:10.784 INFO:tasks.ceph:[osd] lockdep = True 2024-09-12T00:17:10.784 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T00:17:10.784 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T00:17:10.784 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T00:17:10.784 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T00:17:10.784 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T00:17:10.784 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-12T00:17:10.784 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T00:17:10.784 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T00:17:10.819 INFO:teuthology.orchestra.run.smithi043.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T00:17:10.835 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T00:17:10.915 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:17:10.969 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.43'), ('mon.c', '[v2:172.21.15.43:3301,v1:172.21.15.43:6790]'), ('mon.b', '172.21.15.97')] 2024-09-12T00:17:10.969 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790],172.21.15.97', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'lockdep': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-12T00:17:10.970 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:17:10.970 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:17:11.017 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.43 --addv c '[v2:172.21.15.43:3301,v1:172.21.15.43:6790]' --add b 172.21.15.97 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:17:11.106 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:11.106 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:11.107 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:17:11.107 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: generated fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:17:11.107 INFO:teuthology.orchestra.run.smithi043.stdout:setting min_mon_release = quincy 2024-09-12T00:17:11.107 INFO:teuthology.orchestra.run.smithi043.stdout:epoch 0 2024-09-12T00:17:11.107 INFO:teuthology.orchestra.run.smithi043.stdout:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:17:11.107 INFO:teuthology.orchestra.run.smithi043.stdout:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:17:11.107 INFO:teuthology.orchestra.run.smithi043.stdout:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:17:11.107 INFO:teuthology.orchestra.run.smithi043.stdout:min_mon_release 17 (quincy) 2024-09-12T00:17:11.108 INFO:teuthology.orchestra.run.smithi043.stdout:election_strategy: 1 2024-09-12T00:17:11.108 INFO:teuthology.orchestra.run.smithi043.stdout:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:17:11.108 INFO:teuthology.orchestra.run.smithi043.stdout:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:17:11.108 INFO:teuthology.orchestra.run.smithi043.stdout:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:17:11.108 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T00:17:11.109 DEBUG:teuthology.orchestra.run.smithi043:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:17:11.114 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e3ab48df-9588-4a92-9a12-d24598e1ef6f... 2024-09-12T00:17:11.115 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:17:11.158 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:17:11.183 INFO:teuthology.orchestra.run.smithi043.stdout:[global] 2024-09-12T00:17:11.183 INFO:teuthology.orchestra.run.smithi043.stdout: chdir = "" 2024-09-12T00:17:11.183 INFO:teuthology.orchestra.run.smithi043.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:17:11.183 INFO:teuthology.orchestra.run.smithi043.stdout: auth supported = cephx 2024-09-12T00:17:11.183 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:17:11.183 INFO:teuthology.orchestra.run.smithi043.stdout: filestore xattr use omap = true 2024-09-12T00:17:11.183 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:17:11.183 INFO:teuthology.orchestra.run.smithi043.stdout: mon clock drift allowed = 1.000 2024-09-12T00:17:11.184 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:17:11.184 INFO:teuthology.orchestra.run.smithi043.stdout: osd crush chooseleaf type = 0 2024-09-12T00:17:11.184 INFO:teuthology.orchestra.run.smithi043.stdout: auth debug = true 2024-09-12T00:17:11.184 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:17:11.184 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on old message = true 2024-09-12T00:17:11.184 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on bug = true 2024-09-12T00:17:11.184 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:17:11.184 INFO:teuthology.orchestra.run.smithi043.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:17:11.184 INFO:teuthology.orchestra.run.smithi043.stdout: mon pg warn max object skew = 0 2024-09-12T00:17:11.184 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:17:11.184 INFO:teuthology.orchestra.run.smithi043.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:17:11.185 INFO:teuthology.orchestra.run.smithi043.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:17:11.185 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:17:11.185 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default size = 2 2024-09-12T00:17:11.185 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:17:11.185 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow primary affinity = true 2024-09-12T00:17:11.185 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow pg remap = true 2024-09-12T00:17:11.185 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:17:11.185 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:17:11.185 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on no sortbitwise = false 2024-09-12T00:17:11.185 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:17:11.185 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on too few osds = false 2024-09-12T00:17:11.185 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:17:11.186 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:17:11.186 INFO:teuthology.orchestra.run.smithi043.stdout: mon_allow_pool_size_one = true 2024-09-12T00:17:11.186 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:17:11.186 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:17:11.186 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:17:11.186 INFO:teuthology.orchestra.run.smithi043.stdout: osd default data pool replay window = 5 2024-09-12T00:17:11.186 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:17:11.186 INFO:teuthology.orchestra.run.smithi043.stdout: mon allow pool delete = true 2024-09-12T00:17:11.186 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:17:11.186 INFO:teuthology.orchestra.run.smithi043.stdout: mon cluster log file level = debug 2024-09-12T00:17:11.186 INFO:teuthology.orchestra.run.smithi043.stdout: debug asserts on shutdown = true 2024-09-12T00:17:11.186 INFO:teuthology.orchestra.run.smithi043.stdout: mon health detail to clog = false 2024-09-12T00:17:11.186 INFO:teuthology.orchestra.run.smithi043.stdout: mon host = "172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790],172.21.15.97" 2024-09-12T00:17:11.187 INFO:teuthology.orchestra.run.smithi043.stdout: mon client directed command retry = 5 2024-09-12T00:17:11.187 INFO:teuthology.orchestra.run.smithi043.stdout: ms inject socket failures = 5000 2024-09-12T00:17:11.187 INFO:teuthology.orchestra.run.smithi043.stdout: osd_max_pg_log_entries = 10 2024-09-12T00:17:11.187 INFO:teuthology.orchestra.run.smithi043.stdout: osd_min_pg_log_entries = 10 2024-09-12T00:17:11.187 INFO:teuthology.orchestra.run.smithi043.stdout: fsid = e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:17:11.187 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:17:11.187 INFO:teuthology.orchestra.run.smithi043.stdout:[osd] 2024-09-12T00:17:11.187 INFO:teuthology.orchestra.run.smithi043.stdout: osd journal size = 100 2024-09-12T00:17:11.187 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:17:11.187 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub load threshold = 5.0 2024-09-12T00:17:11.187 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub max interval = 600 2024-09-12T00:17:11.187 INFO:teuthology.orchestra.run.smithi043.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:17:11.187 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:17:11.187 INFO:teuthology.orchestra.run.smithi043.stdout: osd recover clone overlap = true 2024-09-12T00:17:11.188 INFO:teuthology.orchestra.run.smithi043.stdout: osd recovery max chunk = 1048576 2024-09-12T00:17:11.188 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:17:11.188 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug shutdown = true 2024-09-12T00:17:11.188 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug op order = true 2024-09-12T00:17:11.188 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug verify stray on activate = true 2024-09-12T00:17:11.188 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug trim objects = true 2024-09-12T00:17:11.188 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:17:11.188 INFO:teuthology.orchestra.run.smithi043.stdout: osd open classes on start = true 2024-09-12T00:17:11.188 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug pg log writeout = true 2024-09-12T00:17:11.188 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:17:11.188 INFO:teuthology.orchestra.run.smithi043.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:17:11.188 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:17:11.188 INFO:teuthology.orchestra.run.smithi043.stdout: osd map max advance = 10 2024-09-12T00:17:11.189 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:17:11.189 INFO:teuthology.orchestra.run.smithi043.stdout: journal zero on create = true 2024-09-12T00:17:11.189 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:17:11.189 INFO:teuthology.orchestra.run.smithi043.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:17:11.189 INFO:teuthology.orchestra.run.smithi043.stdout: filestore apply finisher threads = 3 2024-09-12T00:17:11.189 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:17:11.189 INFO:teuthology.orchestra.run.smithi043.stdout: bdev debug aio = true 2024-09-12T00:17:11.189 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug misdirected ops = true 2024-09-12T00:17:11.189 INFO:teuthology.orchestra.run.smithi043.stdout: bdev async discard = True 2024-09-12T00:17:11.189 INFO:teuthology.orchestra.run.smithi043.stdout: bdev enable discard = True 2024-09-12T00:17:11.189 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore allocator = bitmap 2024-09-12T00:17:11.190 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore block size = 96636764160 2024-09-12T00:17:11.190 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore fsck on mount = True 2024-09-12T00:17:11.190 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluefs = 1/20 2024-09-12T00:17:11.190 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluestore = 1/20 2024-09-12T00:17:11.190 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-09-12T00:17:11.190 INFO:teuthology.orchestra.run.smithi043.stdout: debug objclass = 20 2024-09-12T00:17:11.190 INFO:teuthology.orchestra.run.smithi043.stdout: debug osd = 20 2024-09-12T00:17:11.190 INFO:teuthology.orchestra.run.smithi043.stdout: debug rocksdb = 4/10 2024-09-12T00:17:11.190 INFO:teuthology.orchestra.run.smithi043.stdout: lockdep = True 2024-09-12T00:17:11.190 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:17:11.190 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd full ratio = 0.9 2024-09-12T00:17:11.190 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:17:11.191 INFO:teuthology.orchestra.run.smithi043.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:17:11.191 INFO:teuthology.orchestra.run.smithi043.stdout: osd objectstore = bluestore 2024-09-12T00:17:11.191 INFO:teuthology.orchestra.run.smithi043.stdout: osd shutdown pgref assert = True 2024-09-12T00:17:11.191 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:17:11.191 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr] 2024-09-12T00:17:11.191 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-09-12T00:17:11.191 INFO:teuthology.orchestra.run.smithi043.stdout: debug mgr = 20 2024-09-12T00:17:11.191 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2024-09-12T00:17:11.191 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2024-09-12T00:17:11.191 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:17:11.191 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:17:11.191 INFO:teuthology.orchestra.run.smithi043.stdout: mgr/telemetry/nag = false 2024-09-12T00:17:11.192 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:17:11.192 INFO:teuthology.orchestra.run.smithi043.stdout:[mon] 2024-09-12T00:17:11.192 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-09-12T00:17:11.192 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2024-09-12T00:17:11.192 INFO:teuthology.orchestra.run.smithi043.stdout: debug paxos = 20 2024-09-12T00:17:11.192 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2024-09-12T00:17:11.192 INFO:teuthology.orchestra.run.smithi043.stdout: mon data avail warn = 5 2024-09-12T00:17:11.192 INFO:teuthology.orchestra.run.smithi043.stdout: mon mgr mkfs grace = 240 2024-09-12T00:17:11.192 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:17:11.192 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd reporter subtree level = osd 2024-09-12T00:17:11.192 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd prime pg temp = true 2024-09-12T00:17:11.192 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:17:11.193 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:17:11.193 INFO:teuthology.orchestra.run.smithi043.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:17:11.193 INFO:teuthology.orchestra.run.smithi043.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:17:11.193 INFO:teuthology.orchestra.run.smithi043.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:17:11.193 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:17:11.193 INFO:teuthology.orchestra.run.smithi043.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:17:11.193 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:17:11.193 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:17:11.193 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:17:11.193 INFO:teuthology.orchestra.run.smithi043.stdout: # 1m isn't quite enough 2024-09-12T00:17:11.193 INFO:teuthology.orchestra.run.smithi043.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:17:11.193 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:17:11.193 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:17:11.194 INFO:teuthology.orchestra.run.smithi043.stdout: lockdep = True 2024-09-12T00:17:11.194 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:17:11.194 INFO:teuthology.orchestra.run.smithi043.stdout:[client] 2024-09-12T00:17:11.194 INFO:teuthology.orchestra.run.smithi043.stdout: rgw cache enabled = true 2024-09-12T00:17:11.194 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable ops log = true 2024-09-12T00:17:11.194 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable usage log = true 2024-09-12T00:17:11.194 INFO:teuthology.orchestra.run.smithi043.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:17:11.194 INFO:teuthology.orchestra.run.smithi043.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:17:11.194 INFO:teuthology.orchestra.run.smithi043.stdout: debug rgw = 20 2024-09-12T00:17:11.194 INFO:teuthology.orchestra.run.smithi043.stdout: debug rgw notification = 20 2024-09-12T00:17:11.194 INFO:teuthology.orchestra.run.smithi043.stdout: rgw bucket counters cache = True 2024-09-12T00:17:11.194 INFO:teuthology.orchestra.run.smithi043.stdout: rgw crypt require ssl = False 2024-09-12T00:17:11.194 INFO:teuthology.orchestra.run.smithi043.stdout: rgw crypt s3 kms backend = testing 2024-09-12T00:17:11.194 INFO:teuthology.orchestra.run.smithi043.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:17:11.195 INFO:teuthology.orchestra.run.smithi043.stdout: rgw reshard progress judge interval = 10 2024-09-12T00:17:11.195 INFO:teuthology.orchestra.run.smithi043.stdout: rgw s3 auth use sts = True 2024-09-12T00:17:11.195 INFO:teuthology.orchestra.run.smithi043.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T00:17:11.195 INFO:teuthology.orchestra.run.smithi043.stdout: rgw torrent flag = True 2024-09-12T00:17:11.195 INFO:teuthology.orchestra.run.smithi043.stdout: rgw user counters cache = True 2024-09-12T00:17:11.195 INFO:teuthology.orchestra.run.smithi043.stdout: setgroup = ceph 2024-09-12T00:17:11.195 INFO:teuthology.orchestra.run.smithi043.stdout: setuser = ceph 2024-09-12T00:17:11.195 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.a] 2024-09-12T00:17:11.195 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.c] 2024-09-12T00:17:11.195 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.b] 2024-09-12T00:17:11.196 INFO:teuthology.orchestra.run.smithi097.stdout:[global] 2024-09-12T00:17:11.196 INFO:teuthology.orchestra.run.smithi097.stdout: chdir = "" 2024-09-12T00:17:11.196 INFO:teuthology.orchestra.run.smithi097.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:17:11.196 INFO:teuthology.orchestra.run.smithi097.stdout: auth supported = cephx 2024-09-12T00:17:11.196 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T00:17:11.196 INFO:teuthology.orchestra.run.smithi097.stdout: filestore xattr use omap = true 2024-09-12T00:17:11.196 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T00:17:11.196 INFO:teuthology.orchestra.run.smithi097.stdout: mon clock drift allowed = 1.000 2024-09-12T00:17:11.197 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T00:17:11.197 INFO:teuthology.orchestra.run.smithi097.stdout: osd crush chooseleaf type = 0 2024-09-12T00:17:11.197 INFO:teuthology.orchestra.run.smithi097.stdout: auth debug = true 2024-09-12T00:17:11.197 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T00:17:11.197 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on old message = true 2024-09-12T00:17:11.197 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on bug = true 2024-09-12T00:17:11.197 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T00:17:11.197 INFO:teuthology.orchestra.run.smithi097.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:17:11.197 INFO:teuthology.orchestra.run.smithi097.stdout: mon pg warn max object skew = 0 2024-09-12T00:17:11.197 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T00:17:11.197 INFO:teuthology.orchestra.run.smithi097.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:17:11.197 INFO:teuthology.orchestra.run.smithi097.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:17:11.198 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T00:17:11.198 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default size = 2 2024-09-12T00:17:11.198 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T00:17:11.198 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow primary affinity = true 2024-09-12T00:17:11.198 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow pg remap = true 2024-09-12T00:17:11.198 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:17:11.198 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:17:11.198 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on no sortbitwise = false 2024-09-12T00:17:11.198 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:17:11.198 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on too few osds = false 2024-09-12T00:17:11.199 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:17:11.199 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:17:11.199 INFO:teuthology.orchestra.run.smithi097.stdout: mon_allow_pool_size_one = true 2024-09-12T00:17:11.199 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T00:17:11.199 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:17:11.199 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T00:17:11.199 INFO:teuthology.orchestra.run.smithi097.stdout: osd default data pool replay window = 5 2024-09-12T00:17:11.199 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T00:17:11.199 INFO:teuthology.orchestra.run.smithi097.stdout: mon allow pool delete = true 2024-09-12T00:17:11.199 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T00:17:11.199 INFO:teuthology.orchestra.run.smithi097.stdout: mon cluster log file level = debug 2024-09-12T00:17:11.199 INFO:teuthology.orchestra.run.smithi097.stdout: debug asserts on shutdown = true 2024-09-12T00:17:11.200 INFO:teuthology.orchestra.run.smithi097.stdout: mon health detail to clog = false 2024-09-12T00:17:11.200 INFO:teuthology.orchestra.run.smithi097.stdout: mon host = "172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790],172.21.15.97" 2024-09-12T00:17:11.200 INFO:teuthology.orchestra.run.smithi097.stdout: mon client directed command retry = 5 2024-09-12T00:17:11.200 INFO:teuthology.orchestra.run.smithi097.stdout: ms inject socket failures = 5000 2024-09-12T00:17:11.200 INFO:teuthology.orchestra.run.smithi097.stdout: osd_max_pg_log_entries = 10 2024-09-12T00:17:11.200 INFO:teuthology.orchestra.run.smithi097.stdout: osd_min_pg_log_entries = 10 2024-09-12T00:17:11.200 INFO:teuthology.orchestra.run.smithi097.stdout: fsid = e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:17:11.200 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T00:17:11.200 INFO:teuthology.orchestra.run.smithi097.stdout:[osd] 2024-09-12T00:17:11.200 INFO:teuthology.orchestra.run.smithi097.stdout: osd journal size = 100 2024-09-12T00:17:11.200 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T00:17:11.200 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub load threshold = 5.0 2024-09-12T00:17:11.200 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub max interval = 600 2024-09-12T00:17:11.201 INFO:teuthology.orchestra.run.smithi097.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:17:11.201 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T00:17:11.201 INFO:teuthology.orchestra.run.smithi097.stdout: osd recover clone overlap = true 2024-09-12T00:17:11.201 INFO:teuthology.orchestra.run.smithi097.stdout: osd recovery max chunk = 1048576 2024-09-12T00:17:11.201 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T00:17:11.201 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug shutdown = true 2024-09-12T00:17:11.201 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug op order = true 2024-09-12T00:17:11.201 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug verify stray on activate = true 2024-09-12T00:17:11.201 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug trim objects = true 2024-09-12T00:17:11.201 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T00:17:11.201 INFO:teuthology.orchestra.run.smithi097.stdout: osd open classes on start = true 2024-09-12T00:17:11.201 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug pg log writeout = true 2024-09-12T00:17:11.202 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T00:17:11.202 INFO:teuthology.orchestra.run.smithi097.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:17:11.202 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T00:17:11.202 INFO:teuthology.orchestra.run.smithi097.stdout: osd map max advance = 10 2024-09-12T00:17:11.202 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T00:17:11.202 INFO:teuthology.orchestra.run.smithi097.stdout: journal zero on create = true 2024-09-12T00:17:11.202 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T00:17:11.202 INFO:teuthology.orchestra.run.smithi097.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:17:11.202 INFO:teuthology.orchestra.run.smithi097.stdout: filestore apply finisher threads = 3 2024-09-12T00:17:11.202 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T00:17:11.202 INFO:teuthology.orchestra.run.smithi097.stdout: bdev debug aio = true 2024-09-12T00:17:11.202 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug misdirected ops = true 2024-09-12T00:17:11.202 INFO:teuthology.orchestra.run.smithi097.stdout: bdev async discard = True 2024-09-12T00:17:11.203 INFO:teuthology.orchestra.run.smithi097.stdout: bdev enable discard = True 2024-09-12T00:17:11.203 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore allocator = bitmap 2024-09-12T00:17:11.203 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore block size = 96636764160 2024-09-12T00:17:11.203 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore fsck on mount = True 2024-09-12T00:17:11.203 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluefs = 1/20 2024-09-12T00:17:11.203 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluestore = 1/20 2024-09-12T00:17:11.203 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-12T00:17:11.203 INFO:teuthology.orchestra.run.smithi097.stdout: debug objclass = 20 2024-09-12T00:17:11.203 INFO:teuthology.orchestra.run.smithi097.stdout: debug osd = 20 2024-09-12T00:17:11.203 INFO:teuthology.orchestra.run.smithi097.stdout: debug rocksdb = 4/10 2024-09-12T00:17:11.203 INFO:teuthology.orchestra.run.smithi097.stdout: lockdep = True 2024-09-12T00:17:11.203 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:17:11.203 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd full ratio = 0.9 2024-09-12T00:17:11.203 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:17:11.204 INFO:teuthology.orchestra.run.smithi097.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:17:11.204 INFO:teuthology.orchestra.run.smithi097.stdout: osd objectstore = bluestore 2024-09-12T00:17:11.204 INFO:teuthology.orchestra.run.smithi097.stdout: osd shutdown pgref assert = True 2024-09-12T00:17:11.204 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T00:17:11.204 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr] 2024-09-12T00:17:11.204 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-12T00:17:11.204 INFO:teuthology.orchestra.run.smithi097.stdout: debug mgr = 20 2024-09-12T00:17:11.204 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2024-09-12T00:17:11.204 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2024-09-12T00:17:11.204 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:17:11.204 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:17:11.204 INFO:teuthology.orchestra.run.smithi097.stdout: mgr/telemetry/nag = false 2024-09-12T00:17:11.204 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T00:17:11.205 INFO:teuthology.orchestra.run.smithi097.stdout:[mon] 2024-09-12T00:17:11.205 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-12T00:17:11.205 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2024-09-12T00:17:11.205 INFO:teuthology.orchestra.run.smithi097.stdout: debug paxos = 20 2024-09-12T00:17:11.205 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2024-09-12T00:17:11.205 INFO:teuthology.orchestra.run.smithi097.stdout: mon data avail warn = 5 2024-09-12T00:17:11.205 INFO:teuthology.orchestra.run.smithi097.stdout: mon mgr mkfs grace = 240 2024-09-12T00:17:11.205 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:17:11.205 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd reporter subtree level = osd 2024-09-12T00:17:11.205 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd prime pg temp = true 2024-09-12T00:17:11.205 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:17:11.205 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T00:17:11.205 INFO:teuthology.orchestra.run.smithi097.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:17:11.206 INFO:teuthology.orchestra.run.smithi097.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:17:11.206 INFO:teuthology.orchestra.run.smithi097.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:17:11.206 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T00:17:11.206 INFO:teuthology.orchestra.run.smithi097.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:17:11.206 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:17:11.206 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:17:11.206 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T00:17:11.206 INFO:teuthology.orchestra.run.smithi097.stdout: # 1m isn't quite enough 2024-09-12T00:17:11.206 INFO:teuthology.orchestra.run.smithi097.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:17:11.206 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T00:17:11.206 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:17:11.206 INFO:teuthology.orchestra.run.smithi097.stdout: lockdep = True 2024-09-12T00:17:11.206 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-12T00:17:11.206 INFO:teuthology.orchestra.run.smithi097.stdout:[client] 2024-09-12T00:17:11.206 INFO:teuthology.orchestra.run.smithi097.stdout: rgw cache enabled = true 2024-09-12T00:17:11.207 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable ops log = true 2024-09-12T00:17:11.207 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable usage log = true 2024-09-12T00:17:11.207 INFO:teuthology.orchestra.run.smithi097.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:17:11.207 INFO:teuthology.orchestra.run.smithi097.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:17:11.207 INFO:teuthology.orchestra.run.smithi097.stdout: debug rgw = 20 2024-09-12T00:17:11.207 INFO:teuthology.orchestra.run.smithi097.stdout: debug rgw notification = 20 2024-09-12T00:17:11.207 INFO:teuthology.orchestra.run.smithi097.stdout: rgw bucket counters cache = True 2024-09-12T00:17:11.207 INFO:teuthology.orchestra.run.smithi097.stdout: rgw crypt require ssl = False 2024-09-12T00:17:11.207 INFO:teuthology.orchestra.run.smithi097.stdout: rgw crypt s3 kms backend = testing 2024-09-12T00:17:11.207 INFO:teuthology.orchestra.run.smithi097.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:17:11.207 INFO:teuthology.orchestra.run.smithi097.stdout: rgw reshard progress judge interval = 10 2024-09-12T00:17:11.207 INFO:teuthology.orchestra.run.smithi097.stdout: rgw s3 auth use sts = True 2024-09-12T00:17:11.207 INFO:teuthology.orchestra.run.smithi097.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T00:17:11.208 INFO:teuthology.orchestra.run.smithi097.stdout: rgw torrent flag = True 2024-09-12T00:17:11.208 INFO:teuthology.orchestra.run.smithi097.stdout: rgw user counters cache = True 2024-09-12T00:17:11.208 INFO:teuthology.orchestra.run.smithi097.stdout: setgroup = ceph 2024-09-12T00:17:11.208 INFO:teuthology.orchestra.run.smithi097.stdout: setuser = ceph 2024-09-12T00:17:11.208 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.a] 2024-09-12T00:17:11.208 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.c] 2024-09-12T00:17:11.208 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.b] 2024-09-12T00:17:11.209 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T00:17:11.209 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T00:17:11.303 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T00:17:11.303 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:17:11.304 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T00:17:11.308 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:17:11.308 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T00:17:11.357 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi043.front.sepia.ceph.com 2024-09-12T00:17:11.358 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:17:11.358 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:17:11.358 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:17:11.423 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:17:11.423 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:17:11.469 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi097.front.sepia.ceph.com 2024-09-12T00:17:11.469 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T00:17:11.470 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:17:11.470 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:17:11.492 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T00:17:11.493 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:17:11.541 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T00:17:11.542 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T00:17:11.542 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T00:17:11.588 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T00:17:11.591 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:17:11.633 INFO:teuthology.orchestra.run.smithi097.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:17:11.645 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T00:17:11.646 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T00:17:11.646 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T00:17:11.682 INFO:teuthology.orchestra.run.smithi043.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T00:17:11.694 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T00:17:11.729 INFO:teuthology.orchestra.run.smithi097.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T00:17:11.739 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T00:17:11.739 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi043.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi097.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T00:17:11.739 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T00:17:11.751 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:17:11.751 INFO:tasks.ceph:role: osd.0 2024-09-12T00:17:11.752 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi043.front.sepia.ceph.com 2024-09-12T00:17:11.752 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:17:11.803 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:17:11.803 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:17:11.803 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:17:11.804 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:17:11.804 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:17:11.804 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:17:11.804 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:17:11.804 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:17:11.804 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:17:11.804 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:17:11.827 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2024-09-12T00:17:11.828 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2024-09-12T00:17:11.828 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T00:17:11.888 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T00:17:11.937 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:17:11.937 INFO:teuthology.orchestra.run.smithi043.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:17:11.938 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T00:17:11.990 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:17:11.991 INFO:tasks.ceph:role: osd.1 2024-09-12T00:17:11.991 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi043.front.sepia.ceph.com 2024-09-12T00:17:11.991 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:17:12.045 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:17:12.045 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:17:12.045 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:17:12.045 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:17:12.046 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:17:12.046 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:17:12.046 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:17:12.046 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:17:12.046 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:17:12.046 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:17:12.071 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2024-09-12T00:17:12.073 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2024-09-12T00:17:12.074 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T00:17:12.134 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T00:17:12.186 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:17:12.186 INFO:teuthology.orchestra.run.smithi043.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:17:12.186 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T00:17:12.241 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:17:12.241 INFO:tasks.ceph:role: osd.2 2024-09-12T00:17:12.241 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi043.front.sepia.ceph.com 2024-09-12T00:17:12.242 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:17:12.297 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:17:12.297 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:17:12.297 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:17:12.297 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:17:12.298 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:17:12.298 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:17:12.298 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:17:12.298 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:17:12.298 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:17:12.298 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:17:12.321 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2024-09-12T00:17:12.323 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2024-09-12T00:17:12.323 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T00:17:12.380 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T00:17:12.433 INFO:teuthology.orchestra.run.smithi043.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:17:12.434 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:17:12.435 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T00:17:12.487 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:17:12.487 INFO:tasks.ceph:role: osd.3 2024-09-12T00:17:12.487 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi043.front.sepia.ceph.com 2024-09-12T00:17:12.487 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T00:17:12.541 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:17:12.541 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:17:12.541 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:17:12.541 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:17:12.541 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:17:12.542 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:17:12.542 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:17:12.542 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:17:12.542 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:17:12.542 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:17:12.565 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2024-09-12T00:17:12.567 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2024-09-12T00:17:12.567 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T00:17:12.624 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T00:17:12.679 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:17:12.679 INFO:teuthology.orchestra.run.smithi043.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:17:12.680 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:17:12.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:17:12.789+0000 7fa2e25227c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T00:17:12.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:17:12.789+0000 7fa2e25227c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T00:17:12.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:17:12.789+0000 7fa2e25227c0 -1 bdev(0x55ded5c59800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T00:17:12.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:17:12.789+0000 7fa2e25227c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T00:17:15.938 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T00:17:15.952 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:17:16.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:17:16.033+0000 7f6bbc9497c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T00:17:16.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:17:16.033+0000 7f6bbc9497c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T00:17:16.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:17:16.033+0000 7f6bbc9497c0 -1 bdev(0x55b9f5273800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T00:17:16.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:17:16.033+0000 7f6bbc9497c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T00:17:19.177 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T00:17:19.234 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:17:19.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:17:19.317+0000 7f97f4ec67c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T00:17:19.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:17:19.317+0000 7f97f4ec67c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T00:17:19.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:17:19.317+0000 7f97f4ec67c0 -1 bdev(0x564848921800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T00:17:19.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:17:19.317+0000 7f97f4ec67c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T00:17:22.465 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T00:17:22.526 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:17:22.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:17:22.609+0000 7f59e50847c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T00:17:22.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:17:22.609+0000 7f59e50847c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T00:17:22.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:17:22.609+0000 7f59e50847c0 -1 bdev(0x55831d981800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T00:17:22.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:17:22.609+0000 7f59e50847c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T00:17:25.748 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T00:17:25.802 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T00:17:25.816 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:17:25.817 INFO:tasks.ceph:role: osd.4 2024-09-12T00:17:25.817 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-12T00:17:25.817 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:17:25.880 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:17:25.880 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:17:25.881 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:17:25.881 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:17:25.881 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:17:25.881 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:17:25.881 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:17:25.881 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:17:25.881 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:17:25.881 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:17:26.340 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2024-09-12T00:17:26.342 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-09-12T00:17:26.342 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T00:17:26.435 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T00:17:26.446 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:17:26.447 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:17:26.447 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T00:17:26.499 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:17:26.499 INFO:tasks.ceph:role: osd.5 2024-09-12T00:17:26.499 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-12T00:17:26.500 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:17:26.561 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:17:26.561 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:17:26.561 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:17:26.561 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:17:26.561 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:17:26.561 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:17:26.561 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:17:26.561 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:17:26.561 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:17:26.562 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:17:27.028 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2024-09-12T00:17:27.031 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-09-12T00:17:27.031 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T00:17:27.177 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T00:17:27.189 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:17:27.189 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:17:27.190 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T00:17:27.244 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:17:27.245 INFO:tasks.ceph:role: osd.6 2024-09-12T00:17:27.245 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-12T00:17:27.245 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:17:27.308 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:17:27.308 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:17:27.308 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:17:27.308 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:17:27.308 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:17:27.308 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:17:27.308 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:17:27.308 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:17:27.308 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:17:27.308 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:17:27.790 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2024-09-12T00:17:27.793 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-09-12T00:17:27.793 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T00:17:27.939 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T00:17:27.950 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:17:27.951 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:17:27.951 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T00:17:28.004 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:17:28.004 INFO:tasks.ceph:role: osd.7 2024-09-12T00:17:28.004 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-12T00:17:28.005 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T00:17:28.067 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:17:28.067 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:17:28.068 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:17:28.068 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:17:28.068 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:17:28.068 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:17:28.068 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:17:28.068 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:17:28.068 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:17:28.068 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:17:28.492 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2024-09-12T00:17:28.494 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-09-12T00:17:28.494 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T00:17:28.598 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T00:17:28.609 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:17:28.610 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:17:28.610 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:17:28.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T00:17:28.731+0000 7f704bd007c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T00:17:28.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T00:17:28.735+0000 7f704bd007c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T00:17:28.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T00:17:28.735+0000 7f704bd007c0 -1 bdev(0x55d179289800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T00:17:28.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T00:17:28.735+0000 7f704bd007c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T00:17:31.889 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T00:17:31.903 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:17:31.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T00:17:31.983+0000 7fc695d477c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T00:17:31.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T00:17:31.983+0000 7fc695d477c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T00:17:31.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T00:17:31.983+0000 7fc695d477c0 -1 bdev(0x55d52a5d1800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T00:17:31.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T00:17:31.983+0000 7fc695d477c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T00:17:35.123 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T00:17:35.177 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:17:35.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T00:17:35.259+0000 7f5070d867c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T00:17:35.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T00:17:35.259+0000 7f5070d867c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T00:17:35.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T00:17:35.259+0000 7f5070d867c0 -1 bdev(0x55e253129800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T00:17:35.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T00:17:35.259+0000 7f5070d867c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T00:17:38.408 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T00:17:38.465 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:17:38.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T00:17:38.551+0000 7efd8c87c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T00:17:38.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T00:17:38.551+0000 7efd8c87c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T00:17:38.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T00:17:38.551+0000 7efd8c87c7c0 -1 bdev(0x55b484b09800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T00:17:38.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-12T00:17:38.555+0000 7efd8c87c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T00:17:41.711 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T00:17:41.765 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T00:17:41.765 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:17:41.765 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T00:17:41.780 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:17:41.780 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T00:17:41.838 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:17:41.838 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T00:17:41.894 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:17:41.894 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T00:17:41.949 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:17:41.949 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T00:17:42.005 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T00:17:42.005 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T00:17:42.018 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T00:17:42.018 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T00:17:42.076 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T00:17:42.076 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T00:17:42.132 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T00:17:42.132 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T00:17:42.188 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T00:17:42.188 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T00:17:42.247 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:17:42.247 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T00:17:42.253 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T00:17:42.253 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T00:17:42.293 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T00:17:42.293 DEBUG:teuthology.orchestra.run.smithi043:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:17:42.298 DEBUG:teuthology.orchestra.run.smithi097:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:17:42.338 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr.y] 2024-09-12T00:17:42.338 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQAHM+JmQ9RPIxAAyRhnHHox4d/yf3mTWpboIg== 2024-09-12T00:17:42.339 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.0] 2024-09-12T00:17:42.339 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQAIM+JmqS9hLxAAEtEqKciKrBGes3XxvSKoDg== 2024-09-12T00:17:42.339 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.1] 2024-09-12T00:17:42.339 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQAMM+JmzX9AAhAAc24/MI/gmbkF2oCP5XWl7w== 2024-09-12T00:17:42.339 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.2] 2024-09-12T00:17:42.339 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQAPM+JmmWcsExAA+Pf2X0U4EuYM/w5Bi2yGUA== 2024-09-12T00:17:42.339 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.3] 2024-09-12T00:17:42.339 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQASM+JmdDqcJBAAlEAv5aJLRhBG383Rt6FcmA== 2024-09-12T00:17:42.339 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr.x] 2024-09-12T00:17:42.339 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQAHM+JmDUz8JRAApiQsqmV8HjmiixWURMp8bA== 2024-09-12T00:17:42.339 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.4] 2024-09-12T00:17:42.339 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQAYM+JmLg3HKxAAFaw0Pnc0Ws5dS2tzDyNFxg== 2024-09-12T00:17:42.340 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.5] 2024-09-12T00:17:42.340 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQAbM+JmLXXbOhAAklMDr6kUMg5JhfKZY7jCBg== 2024-09-12T00:17:42.340 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.6] 2024-09-12T00:17:42.340 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQAfM+JmzDynDxAA0gjWJF0dPttyT/gwik48Ig== 2024-09-12T00:17:42.340 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.7] 2024-09-12T00:17:42.340 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQAiM+Jm45QkIRAAxI1M6gDhECirO9r03EsnFg== 2024-09-12T00:17:42.340 INFO:teuthology.orchestra.run.smithi043.stdout:[client.0] 2024-09-12T00:17:42.340 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQAHM+JmB3/kKBAAT9bGZvqgLVRlHqDv73eSow== 2024-09-12T00:17:42.340 INFO:teuthology.orchestra.run.smithi043.stdout:[client.1] 2024-09-12T00:17:42.340 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQAHM+JmNji8KxAAMMQL54aGllyaHlgh91FaGQ== 2024-09-12T00:17:42.346 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr.y] 2024-09-12T00:17:42.346 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAHM+JmQ9RPIxAAyRhnHHox4d/yf3mTWpboIg== 2024-09-12T00:17:42.346 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.0] 2024-09-12T00:17:42.346 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAIM+JmqS9hLxAAEtEqKciKrBGes3XxvSKoDg== 2024-09-12T00:17:42.347 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.1] 2024-09-12T00:17:42.347 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAMM+JmzX9AAhAAc24/MI/gmbkF2oCP5XWl7w== 2024-09-12T00:17:42.347 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.2] 2024-09-12T00:17:42.347 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAPM+JmmWcsExAA+Pf2X0U4EuYM/w5Bi2yGUA== 2024-09-12T00:17:42.347 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.3] 2024-09-12T00:17:42.347 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQASM+JmdDqcJBAAlEAv5aJLRhBG383Rt6FcmA== 2024-09-12T00:17:42.347 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr.x] 2024-09-12T00:17:42.347 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAHM+JmDUz8JRAApiQsqmV8HjmiixWURMp8bA== 2024-09-12T00:17:42.347 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.4] 2024-09-12T00:17:42.347 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAYM+JmLg3HKxAAFaw0Pnc0Ws5dS2tzDyNFxg== 2024-09-12T00:17:42.347 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.5] 2024-09-12T00:17:42.347 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAbM+JmLXXbOhAAklMDr6kUMg5JhfKZY7jCBg== 2024-09-12T00:17:42.347 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.6] 2024-09-12T00:17:42.348 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAfM+JmzDynDxAA0gjWJF0dPttyT/gwik48Ig== 2024-09-12T00:17:42.348 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.7] 2024-09-12T00:17:42.348 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAiM+Jm45QkIRAAxI1M6gDhECirO9r03EsnFg== 2024-09-12T00:17:42.348 INFO:teuthology.orchestra.run.smithi097.stdout:[client.0] 2024-09-12T00:17:42.348 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAHM+JmB3/kKBAAT9bGZvqgLVRlHqDv73eSow== 2024-09-12T00:17:42.348 INFO:teuthology.orchestra.run.smithi097.stdout:[client.1] 2024-09-12T00:17:42.348 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAHM+JmNji8KxAAMMQL54aGllyaHlgh91FaGQ== 2024-09-12T00:17:42.349 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:17:42.386 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:17:42.437 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:17:42.440 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:17:42.482 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:17:42.526 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:17:42.567 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:17:42.610 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:17:42.654 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:17:42.694 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:17:42.741 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:17:42.743 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:17:42.783 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:17:42.826 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:17:42.870 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:17:42.914 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:17:42.960 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:17:42.998 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:17:43.044 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:17:43.082 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:17:43.132 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:17:43.135 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:17:43.225 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:17:43.227 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:17:43.270 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T00:17:43.271 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T00:17:43.282 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:17:43.375 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T00:17:43.386 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T00:17:43.439 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:17:43.529 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T00:17:43.539 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T00:17:43.553 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:17:43.647 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T00:17:43.659 DEBUG:teuthology.orchestra.run.smithi043:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:17:43.662 DEBUG:teuthology.orchestra.run.smithi097:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:17:43.708 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T00:17:43.708 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T00:17:43.708 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T00:17:43.711 INFO:tasks.ceph.mon.a:Started 2024-09-12T00:17:43.711 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T00:17:43.711 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T00:17:43.714 INFO:tasks.ceph.mon.c:Started 2024-09-12T00:17:43.714 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T00:17:43.714 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T00:17:43.753 INFO:tasks.ceph.mon.b:Started 2024-09-12T00:17:43.754 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T00:17:43.754 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T00:17:43.754 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T00:17:43.757 INFO:tasks.ceph.mgr.y:Started 2024-09-12T00:17:43.757 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T00:17:43.757 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T00:17:43.759 INFO:tasks.ceph.mgr.x:Started 2024-09-12T00:17:43.760 DEBUG:tasks.ceph:set 0 configs 2024-09-12T00:17:43.760 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T00:17:43.760 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T00:17:49.242 INFO:teuthology.orchestra.run.smithi043.stderr:adjusted tunables profile to default 2024-09-12T00:17:49.261 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T00:17:49.261 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T00:17:49.262 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:17:49.262 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T00:17:49.273 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:17:49.273 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T00:17:49.330 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:17:49.330 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T00:17:49.383 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:17:49.383 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T00:17:49.435 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T00:17:49.435 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T00:17:49.450 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T00:17:49.450 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T00:17:49.504 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T00:17:49.504 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T00:17:49.559 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-12T00:17:49.559 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T00:17:49.611 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new a01120fa-9861-4543-877e-1a479ec703c8 0 2024-09-12T00:17:49.883 INFO:teuthology.orchestra.run.smithi097.stdout:0 2024-09-12T00:17:49.901 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new aee942ab-cc86-4a8c-b80c-1d3a62bed36a 1 2024-09-12T00:17:50.106 INFO:teuthology.orchestra.run.smithi097.stdout:1 2024-09-12T00:17:50.123 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new f0001c93-a21f-4778-9e0d-334f4aea1884 2 2024-09-12T00:17:50.328 INFO:teuthology.orchestra.run.smithi097.stdout:2 2024-09-12T00:17:50.344 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new c1251384-55ec-4132-92bb-87191c36177e 3 2024-09-12T00:17:50.545 INFO:teuthology.orchestra.run.smithi097.stdout:3 2024-09-12T00:17:50.562 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new 46dcd344-ed56-48b7-94f6-47abf3c37949 4 2024-09-12T00:17:50.764 INFO:teuthology.orchestra.run.smithi097.stdout:4 2024-09-12T00:17:50.780 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new 95347c4a-6255-49c6-85b0-8cd94d161cd4 5 2024-09-12T00:17:50.980 INFO:teuthology.orchestra.run.smithi097.stdout:5 2024-09-12T00:17:50.996 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new f7289693-3ded-4d19-923e-87dc0973c90e 6 2024-09-12T00:17:51.201 INFO:teuthology.orchestra.run.smithi097.stdout:6 2024-09-12T00:17:51.217 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd new 0ed72a4e-1fba-41f3-ab0c-9cbd0aa332a2 7 2024-09-12T00:17:51.433 INFO:teuthology.orchestra.run.smithi097.stdout:7 2024-09-12T00:17:51.449 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T00:17:51.449 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T00:17:51.452 INFO:tasks.ceph.osd.0:Started 2024-09-12T00:17:51.453 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T00:17:51.453 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T00:17:51.455 INFO:tasks.ceph.osd.1:Started 2024-09-12T00:17:51.455 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T00:17:51.455 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T00:17:51.458 INFO:tasks.ceph.osd.2:Started 2024-09-12T00:17:51.458 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T00:17:51.458 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T00:17:51.460 INFO:tasks.ceph.osd.3:Started 2024-09-12T00:17:51.460 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T00:17:51.460 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T00:17:51.462 INFO:tasks.ceph.osd.4:Started 2024-09-12T00:17:51.462 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T00:17:51.463 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T00:17:51.465 INFO:tasks.ceph.osd.5:Started 2024-09-12T00:17:51.465 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T00:17:51.465 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T00:17:51.467 INFO:tasks.ceph.osd.6:Started 2024-09-12T00:17:51.468 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T00:17:51.468 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T00:17:51.470 INFO:tasks.ceph.osd.7:Started 2024-09-12T00:17:51.470 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:17:51.675 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:17:51.675 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":10,"fsid":"e3ab48df-9588-4a92-9a12-d24598e1ef6f","created":"2024-09-12T00:17:49.122127+0000","modified":"2024-09-12T00:17:51.433076+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:17:51.433076+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a01120fa-9861-4543-877e-1a479ec703c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"aee942ab-cc86-4a8c-b80c-1d3a62bed36a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f0001c93-a21f-4778-9e0d-334f4aea1884","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c1251384-55ec-4132-92bb-87191c36177e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"46dcd344-ed56-48b7-94f6-47abf3c37949","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"95347c4a-6255-49c6-85b0-8cd94d161cd4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f7289693-3ded-4d19-923e-87dc0973c90e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0ed72a4e-1fba-41f3-ab0c-9cbd0aa332a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:17:51.691 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T00:17:51.692 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T00:17:52.201 INFO:tasks.ceph.mgr.y.smithi043.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T00:17:52.201 INFO:tasks.ceph.mgr.y.smithi043.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T00:17:52.202 INFO:tasks.ceph.mgr.y.smithi043.stderr: from numpy import show_config as show_numpy_config 2024-09-12T00:17:52.498 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:17:52.649 INFO:tasks.ceph.osd.5.smithi097.stderr:2024-09-12T00:17:52.651+0000 7f7088da87c0 -1 Falling back to public interface 2024-09-12T00:17:52.657 INFO:tasks.ceph.osd.1.smithi043.stderr:2024-09-12T00:17:52.656+0000 7f5e15fe67c0 -1 Falling back to public interface 2024-09-12T00:17:52.690 INFO:teuthology.misc.health.smithi043.stdout: 2024-09-12T00:17:52.690 INFO:teuthology.misc.health.smithi043.stdout:{"epoch":10,"fsid":"e3ab48df-9588-4a92-9a12-d24598e1ef6f","created":"2024-09-12T00:17:49.122127+0000","modified":"2024-09-12T00:17:51.433076+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:17:51.433076+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a01120fa-9861-4543-877e-1a479ec703c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"aee942ab-cc86-4a8c-b80c-1d3a62bed36a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f0001c93-a21f-4778-9e0d-334f4aea1884","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c1251384-55ec-4132-92bb-87191c36177e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"46dcd344-ed56-48b7-94f6-47abf3c37949","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"95347c4a-6255-49c6-85b0-8cd94d161cd4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f7289693-3ded-4d19-923e-87dc0973c90e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0ed72a4e-1fba-41f3-ab0c-9cbd0aa332a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:17:52.707 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T00:17:52.756 INFO:tasks.ceph.mgr.x.smithi097.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T00:17:52.756 INFO:tasks.ceph.mgr.x.smithi097.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T00:17:52.756 INFO:tasks.ceph.mgr.x.smithi097.stderr: from numpy import show_config as show_numpy_config 2024-09-12T00:17:52.841 INFO:tasks.ceph.osd.6.smithi097.stderr:2024-09-12T00:17:52.843+0000 7f6c616427c0 -1 Falling back to public interface 2024-09-12T00:17:52.874 INFO:tasks.ceph.osd.3.smithi043.stderr:2024-09-12T00:17:52.872+0000 7fdf472a17c0 -1 Falling back to public interface 2024-09-12T00:17:52.893 INFO:tasks.ceph.osd.7.smithi097.stderr:2024-09-12T00:17:52.895+0000 7f03a0d517c0 -1 Falling back to public interface 2024-09-12T00:17:53.077 INFO:tasks.ceph.osd.4.smithi097.stderr:2024-09-12T00:17:53.079+0000 7f2539cec7c0 -1 Falling back to public interface 2024-09-12T00:17:53.318 INFO:tasks.ceph.osd.2.smithi043.stderr:2024-09-12T00:17:53.316+0000 7f3406e737c0 -1 Falling back to public interface 2024-09-12T00:17:53.334 INFO:tasks.ceph.osd.0.smithi043.stderr:2024-09-12T00:17:53.332+0000 7f655730e7c0 -1 Falling back to public interface 2024-09-12T00:17:55.288 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-09-12T00:17:55.284+0000 7f6a89180640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T00:17:55.289 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-09-12T00:17:55.288+0000 7f6a89180640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T00:17:56.744 INFO:tasks.ceph.osd.1.smithi043.stderr:2024-09-12T00:17:56.740+0000 7f5e15fe67c0 -1 osd.1 0 log_to_monitors true 2024-09-12T00:17:56.933 INFO:tasks.ceph.osd.7.smithi097.stderr:2024-09-12T00:17:56.935+0000 7f03a0d517c0 -1 osd.7 0 log_to_monitors true 2024-09-12T00:17:56.941 INFO:tasks.ceph.osd.5.smithi097.stderr:2024-09-12T00:17:56.943+0000 7f7088da87c0 -1 osd.5 0 log_to_monitors true 2024-09-12T00:17:56.982 INFO:tasks.ceph.osd.3.smithi043.stderr:2024-09-12T00:17:56.980+0000 7fdf472a17c0 -1 osd.3 0 log_to_monitors true 2024-09-12T00:17:57.065 INFO:tasks.ceph.osd.4.smithi097.stderr:2024-09-12T00:17:57.067+0000 7f2539cec7c0 -1 osd.4 0 log_to_monitors true 2024-09-12T00:17:57.106 INFO:tasks.ceph.osd.6.smithi097.stderr:2024-09-12T00:17:57.107+0000 7f6c616427c0 -1 osd.6 0 log_to_monitors true 2024-09-12T00:17:57.432 INFO:tasks.ceph.osd.2.smithi043.stderr:2024-09-12T00:17:57.432+0000 7f3406e737c0 -1 osd.2 0 log_to_monitors true 2024-09-12T00:17:57.511 INFO:tasks.ceph.osd.0.smithi043.stderr:2024-09-12T00:17:57.508+0000 7f655730e7c0 -1 osd.0 0 log_to_monitors true 2024-09-12T00:17:59.466 INFO:tasks.ceph.osd.3.smithi043.stderr:2024-09-12T00:17:59.464+0000 7fdf4324a640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T00:17:59.486 INFO:tasks.ceph.osd.1.smithi043.stderr:2024-09-12T00:17:59.484+0000 7f5e11f8f640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T00:17:59.498 INFO:tasks.ceph.osd.3.smithi043.stderr:2024-09-12T00:17:59.496+0000 7fdf3b07c640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:17:59.530 INFO:tasks.ceph.osd.1.smithi043.stderr:2024-09-12T00:17:59.528+0000 7f5e09dc1640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:17:59.562 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:18:00.018 INFO:teuthology.misc.health.smithi043.stdout: 2024-09-12T00:18:00.019 INFO:teuthology.misc.health.smithi043.stdout:{"epoch":13,"fsid":"e3ab48df-9588-4a92-9a12-d24598e1ef6f","created":"2024-09-12T00:17:49.122127+0000","modified":"2024-09-12T00:17:59.334528+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:17:51.433076+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a01120fa-9861-4543-877e-1a479ec703c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"aee942ab-cc86-4a8c-b80c-1d3a62bed36a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f0001c93-a21f-4778-9e0d-334f4aea1884","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c1251384-55ec-4132-92bb-87191c36177e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"46dcd344-ed56-48b7-94f6-47abf3c37949","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"95347c4a-6255-49c6-85b0-8cd94d161cd4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f7289693-3ded-4d19-923e-87dc0973c90e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0ed72a4e-1fba-41f3-ab0c-9cbd0aa332a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:18:00.042 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T00:18:00.396 INFO:tasks.ceph.osd.2.smithi043.stderr:2024-09-12T00:18:00.392+0000 7f340362e640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T00:18:00.403 INFO:tasks.ceph.osd.0.smithi043.stderr:2024-09-12T00:18:00.400+0000 7f65532b7640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T00:18:00.421 INFO:tasks.ceph.osd.2.smithi043.stderr:2024-09-12T00:18:00.420+0000 7f33fac4e640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:18:00.433 INFO:tasks.ceph.osd.0.smithi043.stderr:2024-09-12T00:18:00.432+0000 7f654b0e9640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:18:00.512 INFO:tasks.ceph.osd.5.smithi097.stderr:2024-09-12T00:18:00.515+0000 7f7085563640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T00:18:00.521 INFO:tasks.ceph.osd.7.smithi097.stderr:2024-09-12T00:18:00.523+0000 7f039d50c640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T00:18:00.540 INFO:tasks.ceph.osd.5.smithi097.stderr:2024-09-12T00:18:00.543+0000 7f707cb83640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:18:00.554 INFO:tasks.ceph.osd.4.smithi097.stderr:2024-09-12T00:18:00.555+0000 7f25364a7640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T00:18:00.556 INFO:tasks.ceph.osd.7.smithi097.stderr:2024-09-12T00:18:00.559+0000 7f0394b2c640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:18:00.559 INFO:tasks.ceph.osd.6.smithi097.stderr:2024-09-12T00:18:00.559+0000 7f6c5d5eb640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T00:18:00.581 INFO:tasks.ceph.osd.4.smithi097.stderr:2024-09-12T00:18:00.583+0000 7f252dac7640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:18:00.592 INFO:tasks.ceph.osd.6.smithi097.stderr:2024-09-12T00:18:00.595+0000 7f6c5541d640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:18:06.850 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:18:07.165 INFO:teuthology.misc.health.smithi043.stdout: 2024-09-12T00:18:07.165 INFO:teuthology.misc.health.smithi043.stdout:{"epoch":18,"fsid":"e3ab48df-9588-4a92-9a12-d24598e1ef6f","created":"2024-09-12T00:17:49.122127+0000","modified":"2024-09-12T00:18:04.569450+0000","last_up_change":"2024-09-12T00:18:01.528226+0000","last_in_change":"2024-09-12T00:17:51.433076+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:18:02.319323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a01120fa-9861-4543-877e-1a479ec703c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1864725413},{"type":"v1","addr":"172.21.15.43:6825","nonce":1864725413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":1864725413},{"type":"v1","addr":"172.21.15.43:6827","nonce":1864725413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1864725413},{"type":"v1","addr":"172.21.15.43:6831","nonce":1864725413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1864725413},{"type":"v1","addr":"172.21.15.43:6829","nonce":1864725413}]},"public_addr":"172.21.15.43:6825/1864725413","cluster_addr":"172.21.15.43:6827/1864725413","heartbeat_back_addr":"172.21.15.43:6831/1864725413","heartbeat_front_addr":"172.21.15.43:6829/1864725413","state":["exists","up"]},{"osd":1,"uuid":"aee942ab-cc86-4a8c-b80c-1d3a62bed36a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1255554747},{"type":"v1","addr":"172.21.15.43:6801","nonce":1255554747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1255554747},{"type":"v1","addr":"172.21.15.43:6803","nonce":1255554747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1255554747},{"type":"v1","addr":"172.21.15.43:6807","nonce":1255554747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1255554747},{"type":"v1","addr":"172.21.15.43:6805","nonce":1255554747}]},"public_addr":"172.21.15.43:6801/1255554747","cluster_addr":"172.21.15.43:6803/1255554747","heartbeat_back_addr":"172.21.15.43:6807/1255554747","heartbeat_front_addr":"172.21.15.43:6805/1255554747","state":["exists","up"]},{"osd":2,"uuid":"f0001c93-a21f-4778-9e0d-334f4aea1884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":653473197},{"type":"v1","addr":"172.21.15.43:6817","nonce":653473197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":653473197},{"type":"v1","addr":"172.21.15.43:6819","nonce":653473197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":653473197},{"type":"v1","addr":"172.21.15.43:6823","nonce":653473197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":653473197},{"type":"v1","addr":"172.21.15.43:6821","nonce":653473197}]},"public_addr":"172.21.15.43:6817/653473197","cluster_addr":"172.21.15.43:6819/653473197","heartbeat_back_addr":"172.21.15.43:6823/653473197","heartbeat_front_addr":"172.21.15.43:6821/653473197","state":["exists","up"]},{"osd":3,"uuid":"c1251384-55ec-4132-92bb-87191c36177e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2258408181},{"type":"v1","addr":"172.21.15.43:6809","nonce":2258408181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2258408181},{"type":"v1","addr":"172.21.15.43:6811","nonce":2258408181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2258408181},{"type":"v1","addr":"172.21.15.43:6815","nonce":2258408181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2258408181},{"type":"v1","addr":"172.21.15.43:6813","nonce":2258408181}]},"public_addr":"172.21.15.43:6809/2258408181","cluster_addr":"172.21.15.43:6811/2258408181","heartbeat_back_addr":"172.21.15.43:6815/2258408181","heartbeat_front_addr":"172.21.15.43:6813/2258408181","state":["exists","up"]},{"osd":4,"uuid":"46dcd344-ed56-48b7-94f6-47abf3c37949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1948010415},{"type":"v1","addr":"172.21.15.97:6825","nonce":1948010415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1948010415},{"type":"v1","addr":"172.21.15.97:6827","nonce":1948010415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1948010415},{"type":"v1","addr":"172.21.15.97:6831","nonce":1948010415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1948010415},{"type":"v1","addr":"172.21.15.97:6829","nonce":1948010415}]},"public_addr":"172.21.15.97:6825/1948010415","cluster_addr":"172.21.15.97:6827/1948010415","heartbeat_back_addr":"172.21.15.97:6831/1948010415","heartbeat_front_addr":"172.21.15.97:6829/1948010415","state":["exists","up"]},{"osd":5,"uuid":"95347c4a-6255-49c6-85b0-8cd94d161cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":838866664},{"type":"v1","addr":"172.21.15.97:6801","nonce":838866664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":838866664},{"type":"v1","addr":"172.21.15.97:6803","nonce":838866664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":838866664},{"type":"v1","addr":"172.21.15.97:6807","nonce":838866664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":838866664},{"type":"v1","addr":"172.21.15.97:6805","nonce":838866664}]},"public_addr":"172.21.15.97:6801/838866664","cluster_addr":"172.21.15.97:6803/838866664","heartbeat_back_addr":"172.21.15.97:6807/838866664","heartbeat_front_addr":"172.21.15.97:6805/838866664","state":["exists","up"]},{"osd":6,"uuid":"f7289693-3ded-4d19-923e-87dc0973c90e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":3829003147},{"type":"v1","addr":"172.21.15.97:6809","nonce":3829003147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3829003147},{"type":"v1","addr":"172.21.15.97:6811","nonce":3829003147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":3829003147},{"type":"v1","addr":"172.21.15.97:6815","nonce":3829003147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":3829003147},{"type":"v1","addr":"172.21.15.97:6813","nonce":3829003147}]},"public_addr":"172.21.15.97:6809/3829003147","cluster_addr":"172.21.15.97:6811/3829003147","heartbeat_back_addr":"172.21.15.97:6815/3829003147","heartbeat_front_addr":"172.21.15.97:6813/3829003147","state":["exists","up"]},{"osd":7,"uuid":"0ed72a4e-1fba-41f3-ab0c-9cbd0aa332a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":489545787},{"type":"v1","addr":"172.21.15.97:6817","nonce":489545787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":489545787},{"type":"v1","addr":"172.21.15.97:6819","nonce":489545787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":489545787},{"type":"v1","addr":"172.21.15.97:6823","nonce":489545787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":489545787},{"type":"v1","addr":"172.21.15.97:6821","nonce":489545787}]},"public_addr":"172.21.15.97:6817/489545787","cluster_addr":"172.21.15.97:6819/489545787","heartbeat_back_addr":"172.21.15.97:6823/489545787","heartbeat_front_addr":"172.21.15.97:6821/489545787","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:58.472344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:57.762123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:58.470680+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:58.032194+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:58.059331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:57.950186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:58.141069+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:57.909463+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:18:07.182 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T00:18:07.183 INFO:tasks.ceph:Creating RBD pool 2024-09-12T00:18:07.183 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T00:18:07.624 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'rbd' created 2024-09-12T00:18:07.647 DEBUG:teuthology.orchestra.run.smithi043:> rbd --cluster ceph pool init rbd 2024-09-12T00:18:07.700 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:07.700 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:10.681 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T00:18:10.682 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T00:18:10.683 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T00:18:11.006 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:18:11.025 INFO:teuthology.orchestra.run.smithi043.stdout:[{"version":9,"timestamp":"2024-09-12T00:18:00.566776+0000","name":"","changes":[{"name":"osd.6/osd_mclock_max_capacity_iops_ssd","new_value":"4678.034859"}]}] 2024-09-12T00:18:11.025 INFO:tasks.ceph_manager:config epoch is 9 2024-09-12T00:18:11.025 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T00:18:11.026 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T00:18:11.026 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T00:18:11.380 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:18:11.397 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":1982306818},{"type":"v1","addr":"172.21.15.43:6833","nonce":1982306818}]},"active_addr":"172.21.15.43:6833/1982306818","active_change":"2024-09-12T00:17:54.265925+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4114,"name":"x","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":2669023194}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":3453477481}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":437665207}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":1637168125}]}]} 2024-09-12T00:18:11.401 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T00:18:11.401 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T00:18:11.401 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:18:11.690 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:18:11.691 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":22,"fsid":"e3ab48df-9588-4a92-9a12-d24598e1ef6f","created":"2024-09-12T00:17:49.122127+0000","modified":"2024-09-12T00:18:10.641531+0000","last_up_change":"2024-09-12T00:18:01.528226+0000","last_in_change":"2024-09-12T00:17:51.433076+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:18:02.319323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:18:07.498192+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a01120fa-9861-4543-877e-1a479ec703c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1864725413},{"type":"v1","addr":"172.21.15.43:6825","nonce":1864725413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":1864725413},{"type":"v1","addr":"172.21.15.43:6827","nonce":1864725413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1864725413},{"type":"v1","addr":"172.21.15.43:6831","nonce":1864725413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1864725413},{"type":"v1","addr":"172.21.15.43:6829","nonce":1864725413}]},"public_addr":"172.21.15.43:6825/1864725413","cluster_addr":"172.21.15.43:6827/1864725413","heartbeat_back_addr":"172.21.15.43:6831/1864725413","heartbeat_front_addr":"172.21.15.43:6829/1864725413","state":["exists","up"]},{"osd":1,"uuid":"aee942ab-cc86-4a8c-b80c-1d3a62bed36a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1255554747},{"type":"v1","addr":"172.21.15.43:6801","nonce":1255554747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1255554747},{"type":"v1","addr":"172.21.15.43:6803","nonce":1255554747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1255554747},{"type":"v1","addr":"172.21.15.43:6807","nonce":1255554747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1255554747},{"type":"v1","addr":"172.21.15.43:6805","nonce":1255554747}]},"public_addr":"172.21.15.43:6801/1255554747","cluster_addr":"172.21.15.43:6803/1255554747","heartbeat_back_addr":"172.21.15.43:6807/1255554747","heartbeat_front_addr":"172.21.15.43:6805/1255554747","state":["exists","up"]},{"osd":2,"uuid":"f0001c93-a21f-4778-9e0d-334f4aea1884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":653473197},{"type":"v1","addr":"172.21.15.43:6817","nonce":653473197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":653473197},{"type":"v1","addr":"172.21.15.43:6819","nonce":653473197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":653473197},{"type":"v1","addr":"172.21.15.43:6823","nonce":653473197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":653473197},{"type":"v1","addr":"172.21.15.43:6821","nonce":653473197}]},"public_addr":"172.21.15.43:6817/653473197","cluster_addr":"172.21.15.43:6819/653473197","heartbeat_back_addr":"172.21.15.43:6823/653473197","heartbeat_front_addr":"172.21.15.43:6821/653473197","state":["exists","up"]},{"osd":3,"uuid":"c1251384-55ec-4132-92bb-87191c36177e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2258408181},{"type":"v1","addr":"172.21.15.43:6809","nonce":2258408181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2258408181},{"type":"v1","addr":"172.21.15.43:6811","nonce":2258408181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2258408181},{"type":"v1","addr":"172.21.15.43:6815","nonce":2258408181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2258408181},{"type":"v1","addr":"172.21.15.43:6813","nonce":2258408181}]},"public_addr":"172.21.15.43:6809/2258408181","cluster_addr":"172.21.15.43:6811/2258408181","heartbeat_back_addr":"172.21.15.43:6815/2258408181","heartbeat_front_addr":"172.21.15.43:6813/2258408181","state":["exists","up"]},{"osd":4,"uuid":"46dcd344-ed56-48b7-94f6-47abf3c37949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1948010415},{"type":"v1","addr":"172.21.15.97:6825","nonce":1948010415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1948010415},{"type":"v1","addr":"172.21.15.97:6827","nonce":1948010415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1948010415},{"type":"v1","addr":"172.21.15.97:6831","nonce":1948010415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1948010415},{"type":"v1","addr":"172.21.15.97:6829","nonce":1948010415}]},"public_addr":"172.21.15.97:6825/1948010415","cluster_addr":"172.21.15.97:6827/1948010415","heartbeat_back_addr":"172.21.15.97:6831/1948010415","heartbeat_front_addr":"172.21.15.97:6829/1948010415","state":["exists","up"]},{"osd":5,"uuid":"95347c4a-6255-49c6-85b0-8cd94d161cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":838866664},{"type":"v1","addr":"172.21.15.97:6801","nonce":838866664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":838866664},{"type":"v1","addr":"172.21.15.97:6803","nonce":838866664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":838866664},{"type":"v1","addr":"172.21.15.97:6807","nonce":838866664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":838866664},{"type":"v1","addr":"172.21.15.97:6805","nonce":838866664}]},"public_addr":"172.21.15.97:6801/838866664","cluster_addr":"172.21.15.97:6803/838866664","heartbeat_back_addr":"172.21.15.97:6807/838866664","heartbeat_front_addr":"172.21.15.97:6805/838866664","state":["exists","up"]},{"osd":6,"uuid":"f7289693-3ded-4d19-923e-87dc0973c90e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":3829003147},{"type":"v1","addr":"172.21.15.97:6809","nonce":3829003147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3829003147},{"type":"v1","addr":"172.21.15.97:6811","nonce":3829003147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":3829003147},{"type":"v1","addr":"172.21.15.97:6815","nonce":3829003147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":3829003147},{"type":"v1","addr":"172.21.15.97:6813","nonce":3829003147}]},"public_addr":"172.21.15.97:6809/3829003147","cluster_addr":"172.21.15.97:6811/3829003147","heartbeat_back_addr":"172.21.15.97:6815/3829003147","heartbeat_front_addr":"172.21.15.97:6813/3829003147","state":["exists","up"]},{"osd":7,"uuid":"0ed72a4e-1fba-41f3-ab0c-9cbd0aa332a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":489545787},{"type":"v1","addr":"172.21.15.97:6817","nonce":489545787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":489545787},{"type":"v1","addr":"172.21.15.97:6819","nonce":489545787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":489545787},{"type":"v1","addr":"172.21.15.97:6823","nonce":489545787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":489545787},{"type":"v1","addr":"172.21.15.97:6821","nonce":489545787}]},"public_addr":"172.21.15.97:6817/489545787","cluster_addr":"172.21.15.97:6819/489545787","heartbeat_back_addr":"172.21.15.97:6823/489545787","heartbeat_front_addr":"172.21.15.97:6821/489545787","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:58.472344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:57.762123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:58.470680+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:58.032194+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:58.059331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:57.950186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:58.141069+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:57.909463+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:18:11.710 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T00:18:11.710 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:18:12.010 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:18:12.010 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":22,"fsid":"e3ab48df-9588-4a92-9a12-d24598e1ef6f","created":"2024-09-12T00:17:49.122127+0000","modified":"2024-09-12T00:18:10.641531+0000","last_up_change":"2024-09-12T00:18:01.528226+0000","last_in_change":"2024-09-12T00:17:51.433076+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:18:02.319323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:18:07.498192+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a01120fa-9861-4543-877e-1a479ec703c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1864725413},{"type":"v1","addr":"172.21.15.43:6825","nonce":1864725413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":1864725413},{"type":"v1","addr":"172.21.15.43:6827","nonce":1864725413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1864725413},{"type":"v1","addr":"172.21.15.43:6831","nonce":1864725413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1864725413},{"type":"v1","addr":"172.21.15.43:6829","nonce":1864725413}]},"public_addr":"172.21.15.43:6825/1864725413","cluster_addr":"172.21.15.43:6827/1864725413","heartbeat_back_addr":"172.21.15.43:6831/1864725413","heartbeat_front_addr":"172.21.15.43:6829/1864725413","state":["exists","up"]},{"osd":1,"uuid":"aee942ab-cc86-4a8c-b80c-1d3a62bed36a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1255554747},{"type":"v1","addr":"172.21.15.43:6801","nonce":1255554747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1255554747},{"type":"v1","addr":"172.21.15.43:6803","nonce":1255554747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1255554747},{"type":"v1","addr":"172.21.15.43:6807","nonce":1255554747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1255554747},{"type":"v1","addr":"172.21.15.43:6805","nonce":1255554747}]},"public_addr":"172.21.15.43:6801/1255554747","cluster_addr":"172.21.15.43:6803/1255554747","heartbeat_back_addr":"172.21.15.43:6807/1255554747","heartbeat_front_addr":"172.21.15.43:6805/1255554747","state":["exists","up"]},{"osd":2,"uuid":"f0001c93-a21f-4778-9e0d-334f4aea1884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":653473197},{"type":"v1","addr":"172.21.15.43:6817","nonce":653473197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":653473197},{"type":"v1","addr":"172.21.15.43:6819","nonce":653473197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":653473197},{"type":"v1","addr":"172.21.15.43:6823","nonce":653473197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":653473197},{"type":"v1","addr":"172.21.15.43:6821","nonce":653473197}]},"public_addr":"172.21.15.43:6817/653473197","cluster_addr":"172.21.15.43:6819/653473197","heartbeat_back_addr":"172.21.15.43:6823/653473197","heartbeat_front_addr":"172.21.15.43:6821/653473197","state":["exists","up"]},{"osd":3,"uuid":"c1251384-55ec-4132-92bb-87191c36177e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2258408181},{"type":"v1","addr":"172.21.15.43:6809","nonce":2258408181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2258408181},{"type":"v1","addr":"172.21.15.43:6811","nonce":2258408181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2258408181},{"type":"v1","addr":"172.21.15.43:6815","nonce":2258408181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2258408181},{"type":"v1","addr":"172.21.15.43:6813","nonce":2258408181}]},"public_addr":"172.21.15.43:6809/2258408181","cluster_addr":"172.21.15.43:6811/2258408181","heartbeat_back_addr":"172.21.15.43:6815/2258408181","heartbeat_front_addr":"172.21.15.43:6813/2258408181","state":["exists","up"]},{"osd":4,"uuid":"46dcd344-ed56-48b7-94f6-47abf3c37949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1948010415},{"type":"v1","addr":"172.21.15.97:6825","nonce":1948010415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1948010415},{"type":"v1","addr":"172.21.15.97:6827","nonce":1948010415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1948010415},{"type":"v1","addr":"172.21.15.97:6831","nonce":1948010415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1948010415},{"type":"v1","addr":"172.21.15.97:6829","nonce":1948010415}]},"public_addr":"172.21.15.97:6825/1948010415","cluster_addr":"172.21.15.97:6827/1948010415","heartbeat_back_addr":"172.21.15.97:6831/1948010415","heartbeat_front_addr":"172.21.15.97:6829/1948010415","state":["exists","up"]},{"osd":5,"uuid":"95347c4a-6255-49c6-85b0-8cd94d161cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":838866664},{"type":"v1","addr":"172.21.15.97:6801","nonce":838866664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":838866664},{"type":"v1","addr":"172.21.15.97:6803","nonce":838866664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":838866664},{"type":"v1","addr":"172.21.15.97:6807","nonce":838866664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":838866664},{"type":"v1","addr":"172.21.15.97:6805","nonce":838866664}]},"public_addr":"172.21.15.97:6801/838866664","cluster_addr":"172.21.15.97:6803/838866664","heartbeat_back_addr":"172.21.15.97:6807/838866664","heartbeat_front_addr":"172.21.15.97:6805/838866664","state":["exists","up"]},{"osd":6,"uuid":"f7289693-3ded-4d19-923e-87dc0973c90e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":3829003147},{"type":"v1","addr":"172.21.15.97:6809","nonce":3829003147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3829003147},{"type":"v1","addr":"172.21.15.97:6811","nonce":3829003147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":3829003147},{"type":"v1","addr":"172.21.15.97:6815","nonce":3829003147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":3829003147},{"type":"v1","addr":"172.21.15.97:6813","nonce":3829003147}]},"public_addr":"172.21.15.97:6809/3829003147","cluster_addr":"172.21.15.97:6811/3829003147","heartbeat_back_addr":"172.21.15.97:6815/3829003147","heartbeat_front_addr":"172.21.15.97:6813/3829003147","state":["exists","up"]},{"osd":7,"uuid":"0ed72a4e-1fba-41f3-ab0c-9cbd0aa332a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":489545787},{"type":"v1","addr":"172.21.15.97:6817","nonce":489545787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":489545787},{"type":"v1","addr":"172.21.15.97:6819","nonce":489545787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":489545787},{"type":"v1","addr":"172.21.15.97:6823","nonce":489545787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":489545787},{"type":"v1","addr":"172.21.15.97:6821","nonce":489545787}]},"public_addr":"172.21.15.97:6817/489545787","cluster_addr":"172.21.15.97:6819/489545787","heartbeat_back_addr":"172.21.15.97:6823/489545787","heartbeat_front_addr":"172.21.15.97:6821/489545787","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:58.472344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:57.762123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:58.470680+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:58.032194+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:58.059331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:57.950186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:58.141069+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:57.909463+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:18:12.030 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T00:18:12.031 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T00:18:12.031 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T00:18:12.031 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T00:18:12.032 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T00:18:12.032 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T00:18:12.033 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T00:18:12.033 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T00:18:12.296 INFO:teuthology.orchestra.run.smithi043.stdout:60129542149 2024-09-12T00:18:12.296 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:18:12.303 INFO:teuthology.orchestra.run.smithi043.stdout:60129542150 2024-09-12T00:18:12.303 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:18:12.306 INFO:teuthology.orchestra.run.smithi043.stdout:60129542148 2024-09-12T00:18:12.306 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:18:12.308 INFO:teuthology.orchestra.run.smithi043.stdout:64424509446 2024-09-12T00:18:12.309 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:18:12.309 INFO:teuthology.orchestra.run.smithi043.stdout:60129542150 2024-09-12T00:18:12.310 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:18:12.312 INFO:teuthology.orchestra.run.smithi043.stdout:64424509446 2024-09-12T00:18:12.312 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:18:12.316 INFO:teuthology.orchestra.run.smithi043.stdout:64424509446 2024-09-12T00:18:12.316 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:18:12.318 INFO:teuthology.orchestra.run.smithi043.stdout:64424509446 2024-09-12T00:18:12.319 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:18:12.832 INFO:teuthology.orchestra.run.smithi043.stdout:60129542150 2024-09-12T00:18:12.844 INFO:teuthology.orchestra.run.smithi043.stdout:60129542150 2024-09-12T00:18:12.850 INFO:teuthology.orchestra.run.smithi043.stdout:60129542149 2024-09-12T00:18:12.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.1 2024-09-12T00:18:12.862 DEBUG:teuthology.parallel:result is None 2024-09-12T00:18:12.865 INFO:teuthology.orchestra.run.smithi043.stdout:64424509446 2024-09-12T00:18:12.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.3 2024-09-12T00:18:12.875 DEBUG:teuthology.parallel:result is None 2024-09-12T00:18:12.880 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.0 2024-09-12T00:18:12.880 INFO:teuthology.orchestra.run.smithi043.stdout:60129542148 2024-09-12T00:18:12.880 DEBUG:teuthology.parallel:result is None 2024-09-12T00:18:12.893 INFO:teuthology.orchestra.run.smithi043.stdout:64424509445 2024-09-12T00:18:12.895 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.4 2024-09-12T00:18:12.896 DEBUG:teuthology.parallel:result is None 2024-09-12T00:18:12.899 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.2 2024-09-12T00:18:12.899 DEBUG:teuthology.parallel:result is None 2024-09-12T00:18:12.900 INFO:teuthology.orchestra.run.smithi043.stdout:64424509445 2024-09-12T00:18:12.907 INFO:teuthology.orchestra.run.smithi043.stdout:64424509446 2024-09-12T00:18:12.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.7 2024-09-12T00:18:12.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.6 2024-09-12T00:18:12.928 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.5 2024-09-12T00:18:12.928 DEBUG:teuthology.parallel:result is None 2024-09-12T00:18:13.918 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:18:13.926 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:18:14.239 INFO:teuthology.orchestra.run.smithi043.stdout:64424509445 2024-09-12T00:18:14.257 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.7 2024-09-12T00:18:14.267 INFO:teuthology.orchestra.run.smithi043.stdout:64424509445 2024-09-12T00:18:14.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.6 2024-09-12T00:18:15.259 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:18:15.286 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:18:15.578 INFO:teuthology.orchestra.run.smithi043.stdout:64424509447 2024-09-12T00:18:15.596 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.7 2024-09-12T00:18:15.596 DEBUG:teuthology.parallel:result is None 2024-09-12T00:18:15.617 INFO:teuthology.orchestra.run.smithi043.stdout:64424509447 2024-09-12T00:18:15.635 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.6 2024-09-12T00:18:15.635 DEBUG:teuthology.parallel:result is None 2024-09-12T00:18:15.635 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T00:18:15.635 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:18:15.974 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:18:15.974 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-12T00:18:15.993 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-12T00:18:14.280792+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":252460,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722260,"statfs":{"total":773094113280,"available":772835594240,"internally_reserved":0,"allocated":2965504,"data_stored":1786182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001486"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.895554+0000","last_change":"2024-09-12T00:18:10.895554+0000","last_active":"2024-09-12T00:18:10.895554+0000","last_peered":"2024-09-12T00:18:10.895554+0000","last_clean":"2024-09-12T00:18:10.895554+0000","last_became_active":"2024-09-12T00:18:08.648187+0000","last_became_peered":"2024-09-12T00:18:08.648187+0000","last_unstale":"2024-09-12T00:18:10.895554+0000","last_undegraded":"2024-09-12T00:18:10.895554+0000","last_fullsized":"2024-09-12T00:18:10.895554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:14.147236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001130048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.665231+0000","last_change":"2024-09-12T00:18:10.665231+0000","last_active":"2024-09-12T00:18:10.665231+0000","last_peered":"2024-09-12T00:18:10.665231+0000","last_clean":"2024-09-12T00:18:10.665231+0000","last_became_active":"2024-09-12T00:18:08.638003+0000","last_became_peered":"2024-09-12T00:18:08.638003+0000","last_unstale":"2024-09-12T00:18:10.665231+0000","last_undegraded":"2024-09-12T00:18:10.665231+0000","last_fullsized":"2024-09-12T00:18:10.665231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:05.656587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010953429999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.895453+0000","last_change":"2024-09-12T00:18:10.895453+0000","last_active":"2024-09-12T00:18:10.895453+0000","last_peered":"2024-09-12T00:18:10.895453+0000","last_clean":"2024-09-12T00:18:10.895453+0000","last_became_active":"2024-09-12T00:18:08.958069+0000","last_became_peered":"2024-09-12T00:18:08.958069+0000","last_unstale":"2024-09-12T00:18:10.895453+0000","last_undegraded":"2024-09-12T00:18:10.895453+0000","last_fullsized":"2024-09-12T00:18:10.895453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:41.978158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001047189,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.665342+0000","last_change":"2024-09-12T00:18:10.665342+0000","last_active":"2024-09-12T00:18:10.665342+0000","last_peered":"2024-09-12T00:18:10.665342+0000","last_clean":"2024-09-12T00:18:10.665342+0000","last_became_active":"2024-09-12T00:18:08.956785+0000","last_became_peered":"2024-09-12T00:18:08.956785+0000","last_unstale":"2024-09-12T00:18:10.665342+0000","last_undegraded":"2024-09-12T00:18:10.665342+0000","last_fullsized":"2024-09-12T00:18:10.665342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:11.556988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012417909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.664495+0000","last_change":"2024-09-12T00:18:10.662993+0000","last_active":"2024-09-12T00:18:10.664495+0000","last_peered":"2024-09-12T00:18:10.664495+0000","last_clean":"2024-09-12T00:18:10.664495+0000","last_became_active":"2024-09-12T00:18:08.645156+0000","last_became_peered":"2024-09-12T00:18:08.645156+0000","last_unstale":"2024-09-12T00:18:10.664495+0000","last_undegraded":"2024-09-12T00:18:10.664495+0000","last_fullsized":"2024-09-12T00:18:10.664495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:52.068369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024595709999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.654679+0000","last_change":"2024-09-12T00:18:10.654679+0000","last_active":"2024-09-12T00:18:10.654679+0000","last_peered":"2024-09-12T00:18:10.654679+0000","last_clean":"2024-09-12T00:18:10.654679+0000","last_became_active":"2024-09-12T00:18:08.874442+0000","last_became_peered":"2024-09-12T00:18:08.874442+0000","last_unstale":"2024-09-12T00:18:10.654679+0000","last_undegraded":"2024-09-12T00:18:10.654679+0000","last_fullsized":"2024-09-12T00:18:10.654679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:30.659138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010707620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.895303+0000","last_change":"2024-09-12T00:18:10.895303+0000","last_active":"2024-09-12T00:18:10.895303+0000","last_peered":"2024-09-12T00:18:10.895303+0000","last_clean":"2024-09-12T00:18:10.895303+0000","last_became_active":"2024-09-12T00:18:08.646097+0000","last_became_peered":"2024-09-12T00:18:08.646097+0000","last_unstale":"2024-09-12T00:18:10.895303+0000","last_undegraded":"2024-09-12T00:18:10.895303+0000","last_fullsized":"2024-09-12T00:18:10.895303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:23.989230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001003409,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.661688+0000","last_change":"2024-09-12T00:18:10.661688+0000","last_active":"2024-09-12T00:18:10.661688+0000","last_peered":"2024-09-12T00:18:10.661688+0000","last_clean":"2024-09-12T00:18:10.661688+0000","last_became_active":"2024-09-12T00:18:08.644385+0000","last_became_peered":"2024-09-12T00:18:08.644385+0000","last_unstale":"2024-09-12T00:18:10.661688+0000","last_undegraded":"2024-09-12T00:18:10.661688+0000","last_fullsized":"2024-09-12T00:18:10.661688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:31.240227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001156741,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.894161+0000","last_change":"2024-09-12T00:18:03.927642+0000","last_active":"2024-09-12T00:18:10.894161+0000","last_peered":"2024-09-12T00:18:10.894161+0000","last_clean":"2024-09-12T00:18:10.894161+0000","last_became_active":"2024-09-12T00:18:03.924829+0000","last_became_peered":"2024-09-12T00:18:03.924829+0000","last_unstale":"2024-09-12T00:18:10.894161+0000","last_undegraded":"2024-09-12T00:18:10.894161+0000","last_fullsized":"2024-09-12T00:18:10.894161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:02.531521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:02.531521+0000","last_clean_scrub_stamp":"2024-09-12T00:18:02.531521+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:47.557338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":666044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":75676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":75676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35572,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336268,"statfs":{"total":96636764160,"available":96600338432,"internally_reserved":0,"allocated":221184,"data_stored":75676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35568,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336272,"statfs":{"total":96636764160,"available":96600342528,"internally_reserved":0,"allocated":221184,"data_stored":75676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35576,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336264,"statfs":{"total":96636764160,"available":96600334336,"internally_reserved":0,"allocated":225280,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36152,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335688,"statfs":{"total":96636764160,"available":96599744512,"internally_reserved":0,"allocated":815104,"data_stored":666044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:18:15.994 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:18:16.299 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:18:16.299 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-12T00:18:16.316 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-12T00:18:16.281219+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":252460,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722260,"statfs":{"total":773094113280,"available":772835594240,"internally_reserved":0,"allocated":2965504,"data_stored":1786182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.649365"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.895554+0000","last_change":"2024-09-12T00:18:10.895554+0000","last_active":"2024-09-12T00:18:10.895554+0000","last_peered":"2024-09-12T00:18:10.895554+0000","last_clean":"2024-09-12T00:18:10.895554+0000","last_became_active":"2024-09-12T00:18:08.648187+0000","last_became_peered":"2024-09-12T00:18:08.648187+0000","last_unstale":"2024-09-12T00:18:10.895554+0000","last_undegraded":"2024-09-12T00:18:10.895554+0000","last_fullsized":"2024-09-12T00:18:10.895554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:14.147236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001130048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.665231+0000","last_change":"2024-09-12T00:18:10.665231+0000","last_active":"2024-09-12T00:18:10.665231+0000","last_peered":"2024-09-12T00:18:10.665231+0000","last_clean":"2024-09-12T00:18:10.665231+0000","last_became_active":"2024-09-12T00:18:08.638003+0000","last_became_peered":"2024-09-12T00:18:08.638003+0000","last_unstale":"2024-09-12T00:18:10.665231+0000","last_undegraded":"2024-09-12T00:18:10.665231+0000","last_fullsized":"2024-09-12T00:18:10.665231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:05.656587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010953429999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.895453+0000","last_change":"2024-09-12T00:18:10.895453+0000","last_active":"2024-09-12T00:18:10.895453+0000","last_peered":"2024-09-12T00:18:10.895453+0000","last_clean":"2024-09-12T00:18:10.895453+0000","last_became_active":"2024-09-12T00:18:08.958069+0000","last_became_peered":"2024-09-12T00:18:08.958069+0000","last_unstale":"2024-09-12T00:18:10.895453+0000","last_undegraded":"2024-09-12T00:18:10.895453+0000","last_fullsized":"2024-09-12T00:18:10.895453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:41.978158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001047189,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.665342+0000","last_change":"2024-09-12T00:18:10.665342+0000","last_active":"2024-09-12T00:18:10.665342+0000","last_peered":"2024-09-12T00:18:10.665342+0000","last_clean":"2024-09-12T00:18:10.665342+0000","last_became_active":"2024-09-12T00:18:08.956785+0000","last_became_peered":"2024-09-12T00:18:08.956785+0000","last_unstale":"2024-09-12T00:18:10.665342+0000","last_undegraded":"2024-09-12T00:18:10.665342+0000","last_fullsized":"2024-09-12T00:18:10.665342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:11.556988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012417909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.664495+0000","last_change":"2024-09-12T00:18:10.662993+0000","last_active":"2024-09-12T00:18:10.664495+0000","last_peered":"2024-09-12T00:18:10.664495+0000","last_clean":"2024-09-12T00:18:10.664495+0000","last_became_active":"2024-09-12T00:18:08.645156+0000","last_became_peered":"2024-09-12T00:18:08.645156+0000","last_unstale":"2024-09-12T00:18:10.664495+0000","last_undegraded":"2024-09-12T00:18:10.664495+0000","last_fullsized":"2024-09-12T00:18:10.664495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:52.068369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024595709999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.654679+0000","last_change":"2024-09-12T00:18:10.654679+0000","last_active":"2024-09-12T00:18:10.654679+0000","last_peered":"2024-09-12T00:18:10.654679+0000","last_clean":"2024-09-12T00:18:10.654679+0000","last_became_active":"2024-09-12T00:18:08.874442+0000","last_became_peered":"2024-09-12T00:18:08.874442+0000","last_unstale":"2024-09-12T00:18:10.654679+0000","last_undegraded":"2024-09-12T00:18:10.654679+0000","last_fullsized":"2024-09-12T00:18:10.654679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:30.659138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010707620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.895303+0000","last_change":"2024-09-12T00:18:10.895303+0000","last_active":"2024-09-12T00:18:10.895303+0000","last_peered":"2024-09-12T00:18:10.895303+0000","last_clean":"2024-09-12T00:18:10.895303+0000","last_became_active":"2024-09-12T00:18:08.646097+0000","last_became_peered":"2024-09-12T00:18:08.646097+0000","last_unstale":"2024-09-12T00:18:10.895303+0000","last_undegraded":"2024-09-12T00:18:10.895303+0000","last_fullsized":"2024-09-12T00:18:10.895303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:23.989230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001003409,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.661688+0000","last_change":"2024-09-12T00:18:10.661688+0000","last_active":"2024-09-12T00:18:10.661688+0000","last_peered":"2024-09-12T00:18:10.661688+0000","last_clean":"2024-09-12T00:18:10.661688+0000","last_became_active":"2024-09-12T00:18:08.644385+0000","last_became_peered":"2024-09-12T00:18:08.644385+0000","last_unstale":"2024-09-12T00:18:10.661688+0000","last_undegraded":"2024-09-12T00:18:10.661688+0000","last_fullsized":"2024-09-12T00:18:10.661688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:31.240227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001156741,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.894161+0000","last_change":"2024-09-12T00:18:03.927642+0000","last_active":"2024-09-12T00:18:10.894161+0000","last_peered":"2024-09-12T00:18:10.894161+0000","last_clean":"2024-09-12T00:18:10.894161+0000","last_became_active":"2024-09-12T00:18:03.924829+0000","last_became_peered":"2024-09-12T00:18:03.924829+0000","last_unstale":"2024-09-12T00:18:10.894161+0000","last_undegraded":"2024-09-12T00:18:10.894161+0000","last_fullsized":"2024-09-12T00:18:10.894161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:02.531521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:02.531521+0000","last_clean_scrub_stamp":"2024-09-12T00:18:02.531521+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:47.557338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":666044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":75676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":75676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35572,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336268,"statfs":{"total":96636764160,"available":96600338432,"internally_reserved":0,"allocated":221184,"data_stored":75676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35568,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336272,"statfs":{"total":96636764160,"available":96600342528,"internally_reserved":0,"allocated":221184,"data_stored":75676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35576,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336264,"statfs":{"total":96636764160,"available":96600334336,"internally_reserved":0,"allocated":225280,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36152,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335688,"statfs":{"total":96636764160,"available":96599744512,"internally_reserved":0,"allocated":815104,"data_stored":666044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:18:16.317 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T00:18:16.317 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T00:18:16.317 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T00:18:16.318 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T00:18:16.643 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:18:16.643 INFO:teuthology.orchestra.run.smithi043.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T00:18:16.661 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T00:18:16.661 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-12T00:18:16.672 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}} 2024-09-12T00:18:16.672 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-12T00:18:16.678 DEBUG:teuthology.orchestra.run.smithi043:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2024-09-12T00:18:17.550 INFO:teuthology.orchestra.run.smithi043.stderr:...............+........+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...............+......+.....+.........+.......+...+.........+..+.+..+...+....+........+.......+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+.....+.........+....+.....+...............+......+..........+.........+..+.............+..+...............+...+.+...+...........+.+...+.....+.......+...............+.....+...+...+.........+.+.....+...+......+........................+....+...+.....+...........................+..........+..+...+...+....+......+....................+.............+.....+.+...+......+.....+.+...............+.........+.........+.....+............+.+........+.......+.....+............+...+.............+............+..+.+.....+.+........+...+...............+.......+.................+.............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T00:18:17.994 INFO:teuthology.orchestra.run.smithi043.stderr:.....+.+..+..........+..................+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+.....+....+.....+.+...+..+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+....+...........+...+.......+.....+......+.......+...+.....+....+........+.+..+..........+..+......+.+...+.....+.......+......+.....+..................+.............................................+..........+.....+......+....+..............+.+......+.....+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T00:18:18.018 INFO:teuthology.orchestra.run.smithi043.stderr:----- 2024-09-12T00:18:18.029 DEBUG:teuthology.orchestra.run.smithi043:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/local/share/ca-certificates/root.crt 2024-09-12T00:18:18.089 DEBUG:teuthology.orchestra.run.smithi043:> sudo update-ca-certificates 2024-09-12T00:18:18.154 INFO:teuthology.orchestra.run.smithi043.stdout:Updating certificates in /etc/ssl/certs... 2024-09-12T00:18:18.879 INFO:teuthology.orchestra.run.smithi043.stderr:rehash: warning: skipping ca-certificates.crt,it does not contain exactly one certificate or CRL 2024-09-12T00:18:18.900 INFO:teuthology.orchestra.run.smithi043.stdout:1 added, 0 removed; done. 2024-09-12T00:18:18.903 INFO:teuthology.orchestra.run.smithi043.stdout:Running hooks in /etc/ca-certificates/update.d... 2024-09-12T00:18:18.909 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:18:20.527 INFO:teuthology.orchestra.run.smithi043.stdout:Adding debian:root.pem 2024-09-12T00:18:20.555 INFO:teuthology.orchestra.run.smithi043.stdout:done. 2024-09-12T00:18:20.556 INFO:teuthology.orchestra.run.smithi043.stdout:done. 2024-09-12T00:18:20.560 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-12T00:18:20.610 DEBUG:teuthology.orchestra.run.smithi043:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi043.front.sepia.ceph.com 2024-09-12T00:18:20.725 INFO:teuthology.orchestra.run.smithi043.stderr:..+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+.......+......+..+.......+...+......+..+...+....+......+..............+...+...+.......+...............+...+.....+.+.....+....+..+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+..+.........+....+.....+.+..+............+.+.........+.....+.+..+...........................+.+.........+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T00:18:20.951 INFO:teuthology.orchestra.run.smithi043.stderr:.+..+....+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+.........+.+.....+.+.....+.+.........+.....+..................+.+......+...+..+...+..........+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.................+............+........+.+......+...+..+.+........+....+..+....+...............+..+....+.....+......+.......+......+..+.......+..+...+......+.......+............+.....+...+.......+...+........+......+.+.....+.........+...+...+.......+...+.........+........+.+...............+..+...+.+.....+...+...+....+...+......+..+...+...........................+............+.....................+......+..................+...+....+.....+.+.....+...+....+..+....+......+.....+...+......+.+...+...+.....+...+..........+......+.....+......+.......+..+.............+......+.........+..+.+..+.+......+.........+..............+...+.......+............+.............................+.+...+........+.......+...+..+..........+.....+.+..+...+..........+......+........+.+.....+...............+............+...+......+.+...+............+....................+....+...+...+...............+..+......+.+........+.+.....+.+...+.....+...+.......+..+...............+...+...+.......+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T00:18:20.956 INFO:teuthology.orchestra.run.smithi043.stderr:----- 2024-09-12T00:18:20.959 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:18:20.959 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T00:18:21.006 DEBUG:teuthology.orchestra.run.smithi043:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 -extfile /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T00:18:21.057 INFO:teuthology.orchestra.run.smithi043.stderr:Certificate request self-signature ok 2024-09-12T00:18:21.057 INFO:teuthology.orchestra.run.smithi043.stderr:subject=CN = smithi043.front.sepia.ceph.com 2024-09-12T00:18:21.073 DEBUG:teuthology.orchestra.run.smithi043:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T00:18:21.122 DEBUG:teuthology.orchestra.run.smithi043:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-12T00:18:21.179 INFO:teuthology.orchestra.run.smithi043.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2024-09-12T00:18:21.179 DEBUG:teuthology.orchestra.run.smithi043:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-12T00:18:21.231 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T00:18:21.246 DEBUG:tasks.rgw:config is {'client.0': {'ssl certificate': 'rgw.client.0'}} 2024-09-12T00:18:21.246 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T00:18:21.247 INFO:tasks.rgw:Creating data pools 2024-09-12T00:18:21.247 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T00:18:21.247 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-12T00:18:21.814 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T00:18:21.847 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T00:18:22.817 INFO:teuthology.orchestra.run.smithi043.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T00:18:22.864 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T00:18:23.821 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T00:18:23.862 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T00:18:24.838 INFO:teuthology.orchestra.run.smithi043.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T00:18:24.892 DEBUG:tasks.rgw:Pools created 2024-09-12T00:18:24.893 INFO:tasks.rgw:Configuring compression type = random 2024-09-12T00:18:24.893 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:18:24.893 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:18:24.893 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:18:24.936 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:24.936 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:26.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.920+0000 7f7986abc640 0 -- 172.21.15.43:0/1823877189 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562cd2a27910 msgr2=0x562cd2a2dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:26.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.928+0000 7f7986abc640 0 -- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562cd2a363b0 msgr2=0x562cd2a3fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:26.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.932+0000 7f79917b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:26.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.932+0000 7f79917b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:26.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.932+0000 7f79917b79c0 20 realm 2024-09-12T00:18:26.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.932+0000 7f79917b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:26.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.932+0000 7f79917b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:26.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.932+0000 7f79917b79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:26.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.932+0000 7f79917b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:26.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.932+0000 7f79917b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:26.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.932+0000 7f79917b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:26.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.936+0000 7f79917b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:26.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.936+0000 7f79917b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:26.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.936+0000 7f79917b79c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:18:26.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.936+0000 7f79917b79c0 20 searching for the correct realm 2024-09-12T00:18:26.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.956+0000 7f79917b79c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:18:26.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.956+0000 7f79917b79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:26.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.956+0000 7f79917b79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:26.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.956+0000 7f79917b79c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:18:26.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.956+0000 7f79917b79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:26.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.956+0000 7f79917b79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:26.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.956+0000 7f79917b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:26.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.960+0000 7f79917b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:26.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.960+0000 7f79917b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:26.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.960+0000 7f79917b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:26.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.960+0000 7f79917b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:26.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.960+0000 7f79917b79c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:18:26.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.960+0000 7f79917b79c0 20 zone default found 2024-09-12T00:18:26.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.960+0000 7f79917b79c0 4 Realm: () 2024-09-12T00:18:26.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.960+0000 7f79917b79c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:18:26.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.960+0000 7f79917b79c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:18:26.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.960+0000 7f79917b79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:26.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.960+0000 7f79917b79c0 20 zonegroup default 2024-09-12T00:18:26.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.960+0000 7f79917b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:26.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.960+0000 7f79917b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:26.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:26.960+0000 7f79917b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:28.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:28.883+0000 7f79917b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:28.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:28.883+0000 7f79917b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:28.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:28.895+0000 7f79917b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:28.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:28.895+0000 7f79917b79c0 20 started sync module instance, tier type = 2024-09-12T00:18:28.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:28.895+0000 7f79917b79c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:18:30.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.927+0000 7f79917b79c0 20 add_watcher() i=0 2024-09-12T00:18:30.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.927+0000 7f79917b79c0 20 add_watcher() i=1 2024-09-12T00:18:30.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.927+0000 7f79917b79c0 20 add_watcher() i=2 2024-09-12T00:18:30.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.927+0000 7f79917b79c0 20 add_watcher() i=3 2024-09-12T00:18:30.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.927+0000 7f79917b79c0 20 add_watcher() i=4 2024-09-12T00:18:30.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.927+0000 7f79917b79c0 20 add_watcher() i=5 2024-09-12T00:18:30.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.927+0000 7f79917b79c0 20 add_watcher() i=6 2024-09-12T00:18:30.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.927+0000 7f79917b79c0 20 add_watcher() i=7 2024-09-12T00:18:30.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.927+0000 7f79917b79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:30.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.931+0000 7f79917b79c0 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-12T00:18:30.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.931+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-12T00:18:30.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.931+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.931+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-12T00:18:30.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.931+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-12T00:18:30.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.931+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.931+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-12T00:18:30.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.931+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-12T00:18:30.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.931+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.931+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-12T00:18:30.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.931+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-12T00:18:30.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.931+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.931+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-12T00:18:30.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.931+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-12T00:18:30.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.931+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.931+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-12T00:18:30.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.931+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-12T00:18:30.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.931+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.935+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-12T00:18:30.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.935+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-12T00:18:30.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.935+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.935+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-12T00:18:30.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.935+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-12T00:18:30.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.935+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.935+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-12T00:18:30.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.935+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-12T00:18:30.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.935+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.935+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-12T00:18:30.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.935+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-12T00:18:30.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.935+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.935+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-12T00:18:30.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.935+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-12T00:18:30.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.935+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.935+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-12T00:18:30.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.935+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-12T00:18:30.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.935+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.935+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-12T00:18:30.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.935+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-12T00:18:30.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.935+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.939+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-12T00:18:30.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.939+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-12T00:18:30.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.939+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.939+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-12T00:18:30.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.939+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-12T00:18:30.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.939+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.939+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-12T00:18:30.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.939+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-12T00:18:30.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.939+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.939+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-12T00:18:30.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.939+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-12T00:18:30.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.939+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.939+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-12T00:18:30.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.939+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-12T00:18:30.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.939+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.939+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-12T00:18:30.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.939+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-12T00:18:30.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.939+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.943+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-12T00:18:30.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.943+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-12T00:18:30.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.943+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.943+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-12T00:18:30.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.943+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-12T00:18:30.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.943+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.943+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-12T00:18:30.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.943+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-12T00:18:30.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.943+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.943+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-12T00:18:30.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.943+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-12T00:18:30.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.943+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.943+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-12T00:18:30.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.943+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-12T00:18:30.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.943+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.947+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-12T00:18:30.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.947+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-12T00:18:30.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.947+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.947+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-12T00:18:30.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.947+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-12T00:18:30.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.947+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.947+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-12T00:18:30.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.947+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-12T00:18:30.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.947+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.947+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-12T00:18:30.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.947+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-12T00:18:30.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.947+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.947+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-12T00:18:30.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.947+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-12T00:18:30.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.947+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.947+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-12T00:18:30.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.947+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-12T00:18:30.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.947+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.951+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-12T00:18:30.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.951+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-12T00:18:30.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.951+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.951+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-12T00:18:30.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.951+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-12T00:18:30.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.951+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.951+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-12T00:18:30.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.951+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-12T00:18:30.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.951+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.951+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-12T00:18:30.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.951+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-12T00:18:30.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.951+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.951+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-12T00:18:30.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.951+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-12T00:18:30.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.951+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.951+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-12T00:18:30.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.951+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-12T00:18:30.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.951+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.955+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-12T00:18:30.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.955+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-12T00:18:30.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.955+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.955+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-12T00:18:30.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.955+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-12T00:18:30.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.955+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.955+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-12T00:18:30.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.955+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-12T00:18:30.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.955+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.955+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-12T00:18:30.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.955+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-12T00:18:30.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.955+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.955+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-12T00:18:30.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.955+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-12T00:18:30.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.955+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.955+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-12T00:18:30.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.955+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-12T00:18:30.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.955+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.959+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-12T00:18:30.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.959+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-12T00:18:30.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.959+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.959+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-12T00:18:30.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.959+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-12T00:18:30.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.959+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.959+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-12T00:18:30.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.959+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-12T00:18:30.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.959+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.959+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-12T00:18:30.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.959+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-12T00:18:30.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.959+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.959+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-12T00:18:30.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.959+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-12T00:18:30.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.959+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.959+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-12T00:18:30.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.959+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-12T00:18:30.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.959+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.959+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-12T00:18:30.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.959+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-12T00:18:30.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.959+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.963+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-12T00:18:30.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.963+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-12T00:18:30.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.963+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.963+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-12T00:18:30.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.963+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-12T00:18:30.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.963+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.963+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-12T00:18:30.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.963+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-12T00:18:30.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.963+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.963+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-12T00:18:30.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.963+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-12T00:18:30.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.963+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.963+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-12T00:18:30.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.963+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-12T00:18:30.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.963+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.963+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-12T00:18:30.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.963+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-12T00:18:30.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.963+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.963+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-12T00:18:30.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.963+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-12T00:18:30.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.963+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.967+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-12T00:18:30.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.967+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-12T00:18:30.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.967+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.967+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-12T00:18:30.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.967+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-12T00:18:30.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.967+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.967+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-12T00:18:30.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.967+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-12T00:18:30.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.967+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.967+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-12T00:18:30.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.967+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-12T00:18:30.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.967+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.967+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-12T00:18:30.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.967+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-12T00:18:30.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.967+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.967+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-12T00:18:30.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.967+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-12T00:18:30.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.967+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.971+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-12T00:18:30.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.971+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-12T00:18:30.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.971+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.971+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-12T00:18:30.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.971+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-12T00:18:30.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.971+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.971+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-12T00:18:30.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.971+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-12T00:18:30.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.971+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.971+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-12T00:18:30.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.971+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-12T00:18:30.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.971+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.971+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-12T00:18:30.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.971+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-12T00:18:30.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.971+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.971+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-12T00:18:30.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.971+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-12T00:18:30.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.971+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.971+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-12T00:18:30.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.971+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-12T00:18:30.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.971+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.971+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-12T00:18:30.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.971+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-12T00:18:30.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.971+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.975+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-12T00:18:30.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.975+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-12T00:18:30.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.975+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.975+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-12T00:18:30.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.975+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-12T00:18:30.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.975+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.975+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-12T00:18:30.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.975+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-12T00:18:30.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.975+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.975+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-12T00:18:30.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.975+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-12T00:18:30.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.975+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.975+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-12T00:18:30.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.975+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-12T00:18:30.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.975+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.975+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-12T00:18:30.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.975+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-12T00:18:30.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.975+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.979+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-12T00:18:30.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.979+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-12T00:18:30.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.979+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.979+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-12T00:18:30.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.979+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-12T00:18:30.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.979+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.979+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-12T00:18:30.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.979+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-12T00:18:30.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.979+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.979+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-12T00:18:30.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.979+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-12T00:18:30.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.979+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.979+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-12T00:18:30.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.979+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-12T00:18:30.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.979+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.983+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-12T00:18:30.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.983+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-12T00:18:30.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.983+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.983+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-12T00:18:30.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.983+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-12T00:18:30.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.983+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.983+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-12T00:18:30.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.983+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-12T00:18:30.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.983+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.983+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-12T00:18:30.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.983+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-12T00:18:30.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.983+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.983+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-12T00:18:30.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.983+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-12T00:18:30.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.983+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.983+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-12T00:18:30.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.983+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-12T00:18:30.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.983+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.987+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-12T00:18:30.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.987+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-12T00:18:30.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.987+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.987+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-12T00:18:30.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.987+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-12T00:18:30.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.987+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.987+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-12T00:18:30.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.987+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-12T00:18:30.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.987+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.987+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-12T00:18:30.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.987+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-12T00:18:30.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.987+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.987+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-12T00:18:30.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.987+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-12T00:18:30.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.987+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.991+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-12T00:18:30.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.991+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-12T00:18:30.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.991+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.991+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-12T00:18:30.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.991+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-12T00:18:30.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.991+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.991+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-12T00:18:30.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.991+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-12T00:18:30.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.991+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.991+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-12T00:18:30.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.991+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-12T00:18:30.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.991+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.991+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-12T00:18:30.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.991+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-12T00:18:30.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.991+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.991+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-12T00:18:30.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.991+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-12T00:18:30.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.991+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.995+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-12T00:18:30.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.995+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-12T00:18:30.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.995+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.995+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-12T00:18:30.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.995+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-12T00:18:30.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.995+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.995+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-12T00:18:30.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.995+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-12T00:18:30.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.995+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.995+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-12T00:18:30.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.995+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-12T00:18:30.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.995+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.995+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-12T00:18:30.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.995+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-12T00:18:30.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.995+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.999+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-12T00:18:30.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.999+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-12T00:18:30.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.999+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.999+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-12T00:18:30.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.999+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-12T00:18:30.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.999+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:30.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.999+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-12T00:18:30.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.999+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-12T00:18:30.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.999+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:31.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.999+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-12T00:18:31.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.999+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-12T00:18:31.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.999+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:31.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.999+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-12T00:18:31.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.999+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-12T00:18:31.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:30.999+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:31.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.003+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-12T00:18:31.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.003+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-12T00:18:31.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.003+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:31.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.003+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-12T00:18:31.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.003+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-12T00:18:31.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.003+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:31.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.003+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-12T00:18:31.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.003+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-12T00:18:31.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.003+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:31.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.003+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-12T00:18:31.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.003+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-12T00:18:31.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.003+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:31.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.003+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-12T00:18:31.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.003+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-12T00:18:31.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.003+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:31.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.003+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-12T00:18:31.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.003+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-12T00:18:31.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.003+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:31.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.007+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-12T00:18:31.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.007+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-12T00:18:31.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.007+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:31.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.007+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-12T00:18:31.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.007+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-12T00:18:31.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.007+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:31.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.007+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-12T00:18:31.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.007+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-12T00:18:31.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.007+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:31.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.007+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-12T00:18:31.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.007+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-12T00:18:31.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.007+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:31.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.007+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-12T00:18:31.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.007+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-12T00:18:31.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.007+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:31.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.007+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-12T00:18:31.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.007+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-12T00:18:31.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.007+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:31.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.011+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-12T00:18:31.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.011+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-12T00:18:31.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.011+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:31.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.011+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-12T00:18:31.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.011+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-12T00:18:31.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.011+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:31.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.011+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-12T00:18:31.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.011+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-12T00:18:31.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.011+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:31.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.011+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-12T00:18:31.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.011+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-12T00:18:31.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.011+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:31.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.011+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-12T00:18:31.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.011+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-12T00:18:31.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.011+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:31.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.011+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-12T00:18:31.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.011+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-12T00:18:31.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.011+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:31.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.015+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-12T00:18:31.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.015+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-12T00:18:31.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.015+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:31.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.015+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-12T00:18:31.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.015+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-12T00:18:31.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.015+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:31.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.015+0000 7f79917b79c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-12T00:18:31.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.015+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-12T00:18:31.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.019+0000 7f79917b79c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:18:31.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.031+0000 7f783dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:31.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.031+0000 7f79917b79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:31.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:31.031+0000 7f79917b79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:33.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:33.875+0000 7f79917b79c0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-12T00:18:33.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:33.875+0000 7f79917b79c0 5 note: GC not initialized 2024-09-12T00:18:33.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:33.887+0000 7f783cfe1640 20 reqs_thread_entry: start 2024-09-12T00:18:33.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:33.887+0000 7f79917b79c0 20 init_complete bucket index max shards: 11 2024-09-12T00:18:33.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:33.887+0000 7f79917b79c0 20 Filter name: none 2024-09-12T00:18:33.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:33.887+0000 7f77a67fc640 20 reqs_thread_entry: start 2024-09-12T00:18:33.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:33.935+0000 7f783dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:33.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:33.947+0000 7f79917b79c0 20 remove_watcher() i=0 2024-09-12T00:18:33.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:33.947+0000 7f79917b79c0 2 removed watcher, disabling cache 2024-09-12T00:18:33.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:33.947+0000 7f79917b79c0 20 remove_watcher() i=1 2024-09-12T00:18:33.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:33.951+0000 7f79917b79c0 20 remove_watcher() i=2 2024-09-12T00:18:33.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:33.955+0000 7f79917b79c0 20 remove_watcher() i=3 2024-09-12T00:18:33.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:33.955+0000 7f79917b79c0 20 remove_watcher() i=4 2024-09-12T00:18:33.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:33.959+0000 7f79917b79c0 20 remove_watcher() i=5 2024-09-12T00:18:33.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:33.959+0000 7f79917b79c0 20 remove_watcher() i=6 2024-09-12T00:18:33.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:33.963+0000 7f79917b79c0 20 remove_watcher() i=7 2024-09-12T00:18:33.986 INFO:teuthology.orchestra.run.smithi043.stdout:[] 2024-09-12T00:18:33.986 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:18:33.987 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T00:18:33.987 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T00:18:33.987 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-12T00:18:34.077 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:34.078 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:34.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.107+0000 7f82b31789c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:34.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.107+0000 7f82b31789c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:34.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.111+0000 7f80eeffd640 20 reqs_thread_entry: start 2024-09-12T00:18:34.133 INFO:teuthology.orchestra.run.smithi043.stdout:{"id":"af15766d-a760-4e2f-9cfc-808f2566cb70","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T00:18:34.133 DEBUG:tasks.util.rgw: json result: {'id': 'af15766d-a760-4e2f-9cfc-808f2566cb70', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T00:18:34.133 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:18:34.133 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:18:34.134 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:18:34.205 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:34.206 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:34.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.243+0000 7f6ea98629c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:34.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.247+0000 7f6ea98629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:34.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.247+0000 7f6ea98629c0 20 realm 2024-09-12T00:18:34.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.247+0000 7f6ea98629c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:34.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.247+0000 7f6ea98629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:34.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.247+0000 7f6ea98629c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:34.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.247+0000 7f6ea98629c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:34.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.247+0000 7f6ea98629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:34.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.247+0000 7f6ea98629c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:34.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.247+0000 7f6ea98629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:34.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.247+0000 7f6ea98629c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:34.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.251+0000 7f6ea98629c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T00:18:34.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.251+0000 7f6ea98629c0 20 searching for the correct realm 2024-09-12T00:18:34.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.255+0000 7f6ea6b67640 0 -- 172.21.15.43:0/432703661 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f6e9c0682b0 msgr2=0x7f6e9c06da50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:34.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.263+0000 7f6ea7b69640 0 -- 172.21.15.43:0/432703661 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f6e9c09a040 msgr2=0x7f6e9c06c0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:18:34.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.271+0000 7f6ea98629c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:18:34.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.271+0000 7f6ea98629c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:34.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.271+0000 7f6ea98629c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:34.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.271+0000 7f6ea98629c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:18:34.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.271+0000 7f6ea98629c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:34.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.271+0000 7f6ea98629c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:34.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.271+0000 7f6ea98629c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:34.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.271+0000 7f6ea98629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:34.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.271+0000 7f6ea98629c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:34.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.271+0000 7f6ea98629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:34.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.271+0000 7f6ea98629c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:34.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.271+0000 7f6ea98629c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:18:34.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.271+0000 7f6ea98629c0 20 zone default found 2024-09-12T00:18:34.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.271+0000 7f6ea98629c0 4 Realm: () 2024-09-12T00:18:34.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.271+0000 7f6ea98629c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:18:34.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.271+0000 7f6ea98629c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:18:34.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.271+0000 7f6ea98629c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:34.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.271+0000 7f6ea98629c0 20 zonegroup default 2024-09-12T00:18:34.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.271+0000 7f6ea98629c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:34.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.271+0000 7f6ea98629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:34.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.271+0000 7f6ea98629c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:34.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.271+0000 7f6ea98629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:34.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.271+0000 7f6ea98629c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:34.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.275+0000 7f6ea98629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:34.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.275+0000 7f6ea98629c0 20 started sync module instance, tier type = 2024-09-12T00:18:34.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.275+0000 7f6ea98629c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:18:34.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.291+0000 7f6ea98629c0 20 add_watcher() i=0 2024-09-12T00:18:34.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.291+0000 7f6ea98629c0 20 add_watcher() i=1 2024-09-12T00:18:34.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.291+0000 7f6ea98629c0 20 add_watcher() i=2 2024-09-12T00:18:34.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.291+0000 7f6ea98629c0 20 add_watcher() i=3 2024-09-12T00:18:34.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.291+0000 7f6ea98629c0 20 add_watcher() i=4 2024-09-12T00:18:34.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.291+0000 7f6ea98629c0 20 add_watcher() i=5 2024-09-12T00:18:34.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.291+0000 7f6ea98629c0 20 add_watcher() i=6 2024-09-12T00:18:34.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.291+0000 7f6ea98629c0 20 add_watcher() i=7 2024-09-12T00:18:34.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.291+0000 7f6ea98629c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:34.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.291+0000 7f6d5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:34.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.295+0000 7f6ea98629c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:34.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.295+0000 7f6ea98629c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:34.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.295+0000 7f6ea98629c0 5 note: GC not initialized 2024-09-12T00:18:34.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.295+0000 7f6d5cfe1640 20 reqs_thread_entry: start 2024-09-12T00:18:34.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.295+0000 7f6ea98629c0 20 init_complete bucket index max shards: 11 2024-09-12T00:18:34.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.295+0000 7f6ea98629c0 20 Filter name: none 2024-09-12T00:18:34.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.295+0000 7f6cd67fc640 20 reqs_thread_entry: start 2024-09-12T00:18:34.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.311+0000 7f6d5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:34.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.319+0000 7f6ea98629c0 20 remove_watcher() i=0 2024-09-12T00:18:34.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.319+0000 7f6ea98629c0 2 removed watcher, disabling cache 2024-09-12T00:18:34.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.319+0000 7f6ea98629c0 20 remove_watcher() i=1 2024-09-12T00:18:34.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.323+0000 7f6ea98629c0 20 remove_watcher() i=2 2024-09-12T00:18:34.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.327+0000 7f6ea98629c0 20 remove_watcher() i=3 2024-09-12T00:18:34.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.327+0000 7f6ea98629c0 20 remove_watcher() i=4 2024-09-12T00:18:34.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.327+0000 7f6ea98629c0 20 remove_watcher() i=5 2024-09-12T00:18:34.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.331+0000 7f6ea98629c0 20 remove_watcher() i=6 2024-09-12T00:18:34.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.331+0000 7f6ea98629c0 20 remove_watcher() i=7 2024-09-12T00:18:34.346 INFO:teuthology.orchestra.run.smithi043.stdout:[] 2024-09-12T00:18:34.346 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:18:34.346 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T00:18:34.346 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T00:18:34.347 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-12T00:18:34.428 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:34.428 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:34.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.459+0000 7f71c63649c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:34.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.459+0000 7f71c63649c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:34.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.463+0000 7f7081ffb640 20 reqs_thread_entry: start 2024-09-12T00:18:34.483 INFO:teuthology.orchestra.run.smithi043.stdout:{"id":"af15766d-a760-4e2f-9cfc-808f2566cb70","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:18:34.483 DEBUG:tasks.util.rgw: json result: {'id': 'af15766d-a760-4e2f-9cfc-808f2566cb70', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:18:34.483 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:18:34.484 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:18:34.484 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:18:34.559 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:34.559 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:34.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.599+0000 7fcde59f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:34.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.599+0000 7fcde59f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:34.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.599+0000 7fcde59f89c0 20 realm 2024-09-12T00:18:34.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.599+0000 7fcde59f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:34.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.599+0000 7fcde59f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:34.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.599+0000 7fcde59f89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:34.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.599+0000 7fcde59f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:34.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.599+0000 7fcde59f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:34.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.599+0000 7fcde59f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:34.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.603+0000 7fcde59f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:34.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.603+0000 7fcde59f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:34.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.603+0000 7fcde59f89c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T00:18:34.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.603+0000 7fcde59f89c0 20 searching for the correct realm 2024-09-12T00:18:34.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.611+0000 7fcde2cfd640 0 -- 172.21.15.43:0/1509155980 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fcdd806e770 msgr2=0x7fcdd8064640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:18:34.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.615+0000 7fcde2cfd640 0 -- 172.21.15.43:0/1509155980 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fccac07dc60 msgr2=0x7fccac080050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:34.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.623+0000 7fcde59f89c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:18:34.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.623+0000 7fcde59f89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:34.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.623+0000 7fcde59f89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:34.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.623+0000 7fcde59f89c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:18:34.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.623+0000 7fcde59f89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:34.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.623+0000 7fcde59f89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:34.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.623+0000 7fcde59f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:34.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.623+0000 7fcde59f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:34.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.623+0000 7fcde59f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:34.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.623+0000 7fcde59f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:34.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.623+0000 7fcde59f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:34.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.627+0000 7fcde59f89c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:18:34.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.627+0000 7fcde59f89c0 20 zone default found 2024-09-12T00:18:34.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.627+0000 7fcde59f89c0 4 Realm: () 2024-09-12T00:18:34.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.627+0000 7fcde59f89c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:18:34.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.627+0000 7fcde59f89c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:18:34.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.627+0000 7fcde59f89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:34.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.627+0000 7fcde59f89c0 20 zonegroup default 2024-09-12T00:18:34.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.627+0000 7fcde59f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:34.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.627+0000 7fcde59f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:34.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.627+0000 7fcde59f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:34.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.627+0000 7fcde59f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:34.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.627+0000 7fcde59f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:18:34.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.627+0000 7fcde59f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:34.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.627+0000 7fcde59f89c0 20 started sync module instance, tier type = 2024-09-12T00:18:34.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.627+0000 7fcde59f89c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:18:34.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.643+0000 7fcde59f89c0 20 add_watcher() i=0 2024-09-12T00:18:34.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.643+0000 7fcde59f89c0 20 add_watcher() i=1 2024-09-12T00:18:34.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.643+0000 7fcde59f89c0 20 add_watcher() i=2 2024-09-12T00:18:34.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.643+0000 7fcde59f89c0 20 add_watcher() i=3 2024-09-12T00:18:34.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.643+0000 7fcde59f89c0 20 add_watcher() i=4 2024-09-12T00:18:34.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.643+0000 7fcde59f89c0 20 add_watcher() i=5 2024-09-12T00:18:34.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.643+0000 7fcde59f89c0 20 add_watcher() i=6 2024-09-12T00:18:34.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.643+0000 7fcde59f89c0 20 add_watcher() i=7 2024-09-12T00:18:34.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.643+0000 7fcde59f89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:34.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.647+0000 7fcc99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:34.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.647+0000 7fcde59f89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:34.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.647+0000 7fcde59f89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:34.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.647+0000 7fcde59f89c0 5 note: GC not initialized 2024-09-12T00:18:34.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.647+0000 7fcc98fe1640 20 reqs_thread_entry: start 2024-09-12T00:18:34.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.647+0000 7fcde59f89c0 20 init_complete bucket index max shards: 11 2024-09-12T00:18:34.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.647+0000 7fcde59f89c0 20 Filter name: none 2024-09-12T00:18:34.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.647+0000 7fcc127fc640 20 reqs_thread_entry: start 2024-09-12T00:18:34.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.663+0000 7fcc99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:34.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.671+0000 7fcde59f89c0 20 remove_watcher() i=0 2024-09-12T00:18:34.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.671+0000 7fcde59f89c0 2 removed watcher, disabling cache 2024-09-12T00:18:34.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.671+0000 7fcde59f89c0 20 remove_watcher() i=1 2024-09-12T00:18:34.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.675+0000 7fcde59f89c0 20 remove_watcher() i=2 2024-09-12T00:18:34.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.675+0000 7fcde59f89c0 20 remove_watcher() i=3 2024-09-12T00:18:34.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.679+0000 7fcde59f89c0 20 remove_watcher() i=4 2024-09-12T00:18:34.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.679+0000 7fcde59f89c0 20 remove_watcher() i=5 2024-09-12T00:18:34.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.683+0000 7fcde59f89c0 20 remove_watcher() i=6 2024-09-12T00:18:34.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.683+0000 7fcde59f89c0 20 remove_watcher() i=7 2024-09-12T00:18:34.696 INFO:teuthology.orchestra.run.smithi043.stdout:[] 2024-09-12T00:18:34.696 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:18:34.697 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-12T00:18:34.697 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T00:18:34.697 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T00:18:34.697 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-12T00:18:34.776 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:34.776 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:34.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.807+0000 7fc9741eb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:34.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.807+0000 7fc9741eb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:34.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.811+0000 7fc7a7fff640 20 reqs_thread_entry: start 2024-09-12T00:18:34.828 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-12T00:18:34.829 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-12T00:18:34.829 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T00:18:34.829 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T00:18:34.829 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-12T00:18:34.917 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:34.918 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:34.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.947+0000 7f94a3d269c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:34.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.947+0000 7f94a3d269c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:34.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:34.951+0000 7f92d7fff640 20 reqs_thread_entry: start 2024-09-12T00:18:34.970 INFO:teuthology.orchestra.run.smithi043.stdout:{"id":"af15766d-a760-4e2f-9cfc-808f2566cb70","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:18:34.971 DEBUG:tasks.util.rgw: json result: {'id': 'af15766d-a760-4e2f-9cfc-808f2566cb70', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:18:34.971 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-12T00:18:34.971 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T00:18:34.971 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T00:18:34.971 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-12T00:18:35.049 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:35.050 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:35.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:35.079+0000 7f9c9a0999c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:35.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:35.079+0000 7f9c9a0999c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:35.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:35.083+0000 7f9b2dffb640 20 reqs_thread_entry: start 2024-09-12T00:18:35.103 INFO:teuthology.orchestra.run.smithi043.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-12T00:18:35.103 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-12T00:18:35.104 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T00:18:35.104 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T00:18:35.104 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-12T00:18:35.193 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:35.193 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:35.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:35.223+0000 7f833a6349c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:35.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:35.223+0000 7f833a6349c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:35.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:18:35.227+0000 7f817e7fc640 20 reqs_thread_entry: start 2024-09-12T00:18:35.246 INFO:teuthology.orchestra.run.smithi043.stdout:{"id":"af15766d-a760-4e2f-9cfc-808f2566cb70","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:18:35.247 DEBUG:tasks.util.rgw: json result: {'id': 'af15766d-a760-4e2f-9cfc-808f2566cb70', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:18:35.247 INFO:tasks.rgw:Starting rgw... 2024-09-12T00:18:35.247 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0'} 2024-09-12T00:18:35.247 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T00:18:35.247 DEBUG:teuthology.orchestra.run.smithi043:> sudo echo -n https://smithi043.front.sepia.ceph.com:443 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T00:18:35.300 INFO:teuthology.orchestra.run.smithi043.stdout:https://smithi043.front.sepia.ceph.com:443 2024-09-12T00:18:35.301 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T00:18:35.351 DEBUG:teuthology.orchestra.run.smithi043:> sudo keytool -import -alias smithi043.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2024-09-12T00:18:35.761 INFO:teuthology.orchestra.run.smithi043.stderr:Warning: use -cacerts option to access cacerts keystore 2024-09-12T00:18:36.142 INFO:teuthology.orchestra.run.smithi043.stderr:Certificate was added to keystore 2024-09-12T00:18:36.178 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T00:18:36.178 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T00:18:36.180 INFO:tasks.rgw.client.0:Started 2024-09-12T00:18:36.181 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi043.front.sepia.ceph.com:443/ 2024-09-12T00:18:36.181 DEBUG:teuthology.orchestra.run.smithi043:> curl https://smithi043.front.sepia.ceph.com:443/ 2024-09-12T00:18:36.208 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:18:36.208 INFO:teuthology.orchestra.run.smithi043.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:18:36.208 INFO:teuthology.orchestra.run.smithi043.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:18:36.209 INFO:teuthology.orchestra.run.smithi043.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:18:36.209 INFO:teuthology.orchestra.run.smithi043.stderr:curl: (7) Failed to connect to smithi043.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-12T00:18:36.963 INFO:tasks.rgw.client.0.smithi043.stdout:2024-09-12T00:18:36.963+0000 7f99178cca40 -1 ssl_private_key was not found: rgw/cert//default.key 2024-09-12T00:18:37.210 DEBUG:teuthology.orchestra.run.smithi043:> curl https://smithi043.front.sepia.ceph.com:443/ 2024-09-12T00:18:37.221 INFO:teuthology.orchestra.run.smithi043.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:18:37.221 INFO:teuthology.orchestra.run.smithi043.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:18:37.338 INFO:teuthology.orchestra.run.smithi043.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 1599 0 --:--:-- --:--:-- --:--:-- 1612 2024-09-12T00:18:37.341 INFO:teuthology.orchestra.run.smithi043.stdout:anonymous 2024-09-12T00:18:37.341 INFO:teuthology.run_tasks:Running task tox... 2024-09-12T00:18:37.353 INFO:tasks.tox:Deploying tox from pip... 2024-09-12T00:18:37.353 DEBUG:teuthology.orchestra.run.smithi043:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-12T00:18:40.479 DEBUG:teuthology.orchestra.run.smithi043:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-12T00:18:41.273 INFO:teuthology.orchestra.run.smithi043.stdout:Collecting tox==3.15.0 2024-09-12T00:18:41.391 INFO:teuthology.orchestra.run.smithi043.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-12T00:18:41.463 INFO:teuthology.orchestra.run.smithi043.stdout: ---------------------------------------- 82.1/82.1 KB 1.1 MB/s eta 0:00:00 2024-09-12T00:18:41.626 INFO:teuthology.orchestra.run.smithi043.stdout:Collecting packaging>=14 2024-09-12T00:18:41.641 INFO:teuthology.orchestra.run.smithi043.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-12T00:18:41.672 INFO:teuthology.orchestra.run.smithi043.stdout: ---------------------------------------- 54.0/54.0 KB 1.7 MB/s eta 0:00:00 2024-09-12T00:18:41.757 INFO:teuthology.orchestra.run.smithi043.stdout:Collecting six<2,>=1.14.0 2024-09-12T00:18:41.774 INFO:teuthology.orchestra.run.smithi043.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:18:42.069 INFO:teuthology.orchestra.run.smithi043.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-12T00:18:42.087 INFO:teuthology.orchestra.run.smithi043.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-12T00:18:42.285 INFO:teuthology.orchestra.run.smithi043.stdout: ---------------------------------------- 6.0/6.0 MB 31.0 MB/s eta 0:00:00 2024-09-12T00:18:42.432 INFO:teuthology.orchestra.run.smithi043.stdout:Collecting py<2,>=1.4.17 2024-09-12T00:18:42.448 INFO:teuthology.orchestra.run.smithi043.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-12T00:18:42.483 INFO:teuthology.orchestra.run.smithi043.stdout: ---------------------------------------- 98.7/98.7 KB 2.9 MB/s eta 0:00:00 2024-09-12T00:18:42.604 INFO:teuthology.orchestra.run.smithi043.stdout:Collecting toml>=0.9.4 2024-09-12T00:18:42.622 INFO:teuthology.orchestra.run.smithi043.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-12T00:18:43.063 INFO:teuthology.orchestra.run.smithi043.stdout:Collecting pluggy<1,>=0.12.0 2024-09-12T00:18:43.081 INFO:teuthology.orchestra.run.smithi043.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-12T00:18:43.235 INFO:teuthology.orchestra.run.smithi043.stdout:Collecting filelock<4,>=3.0.0 2024-09-12T00:18:43.250 INFO:teuthology.orchestra.run.smithi043.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-12T00:18:43.424 INFO:teuthology.orchestra.run.smithi043.stdout:Collecting distlib<1,>=0.3.7 2024-09-12T00:18:43.439 INFO:teuthology.orchestra.run.smithi043.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-12T00:18:43.471 INFO:teuthology.orchestra.run.smithi043.stdout: -------------------------------------- 468.9/468.9 KB 16.9 MB/s eta 0:00:00 2024-09-12T00:18:43.603 INFO:teuthology.orchestra.run.smithi043.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-12T00:18:43.618 INFO:teuthology.orchestra.run.smithi043.stdout: Downloading platformdirs-4.3.2-py3-none-any.whl (18 kB) 2024-09-12T00:18:43.801 INFO:teuthology.orchestra.run.smithi043.stdout:Installing collected packages: distlib, toml, six, py, pluggy, platformdirs, packaging, filelock, virtualenv, tox 2024-09-12T00:18:44.757 INFO:teuthology.orchestra.run.smithi043.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.2 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-12T00:18:44.853 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:18:44.868 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:18:44.868 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:18:44.869 DEBUG:teuthology.orchestra.run.smithi043:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:18:44.875 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:18:44.875 INFO:teuthology.orchestra.run.smithi043.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:18:44.875 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:18:44.922 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:18:44.923 DEBUG:teuthology.orchestra.run.smithi043:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:18:44.972 INFO:tasks.workunit:timeout=3h 2024-09-12T00:18:44.972 INFO:tasks.workunit:cleanup=True 2024-09-12T00:18:44.972 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:18:45.019 INFO:tasks.workunit.client.0.smithi043.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:19:28.629 INFO:tasks.workunit.client.0.smithi043.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:19:28.630 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:19:28.630 INFO:tasks.workunit.client.0.smithi043.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:19:28.630 INFO:tasks.workunit.client.0.smithi043.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:19:28.631 INFO:tasks.workunit.client.0.smithi043.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:19:28.631 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:19:28.631 INFO:tasks.workunit.client.0.smithi043.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:19:28.631 INFO:tasks.workunit.client.0.smithi043.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:19:28.631 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:19:28.631 INFO:tasks.workunit.client.0.smithi043.stderr: git switch -c 2024-09-12T00:19:28.632 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:19:28.632 INFO:tasks.workunit.client.0.smithi043.stderr:Or undo this operation with: 2024-09-12T00:19:28.632 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:19:28.632 INFO:tasks.workunit.client.0.smithi043.stderr: git switch - 2024-09-12T00:19:28.632 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:19:28.632 INFO:tasks.workunit.client.0.smithi043.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:19:28.632 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:19:28.632 INFO:tasks.workunit.client.0.smithi043.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:19:28.636 DEBUG:teuthology.orchestra.run.smithi043:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:19:28.687 INFO:tasks.workunit.client.0.smithi043.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:19:28.690 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:19:28.690 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:19:29.428 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:19:29.515 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:19:29.569 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:19:29.571 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:19:29.571 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:19:29.620 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:19:29.625 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:19:29.625 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:19:29.671 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-12T00:19:29.672 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-12T00:19:29.672 DEBUG:teuthology.orchestra.run.smithi043:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T00:19:29.728 INFO:tasks.workunit.client.0.smithi043.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T00:19:29.729 INFO:tasks.workunit.client.0.smithi043.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:19:29.729 INFO:tasks.workunit.client.0.smithi043.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:19:32.689 INFO:tasks.workunit.client.0.smithi043.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:19:32.689 INFO:tasks.workunit.client.0.smithi043.stderr:++ deactivate nondestructive 2024-09-12T00:19:32.689 INFO:tasks.workunit.client.0.smithi043.stderr:++ '[' -n '' ']' 2024-09-12T00:19:32.689 INFO:tasks.workunit.client.0.smithi043.stderr:++ '[' -n '' ']' 2024-09-12T00:19:32.690 INFO:tasks.workunit.client.0.smithi043.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:19:32.690 INFO:tasks.workunit.client.0.smithi043.stderr:++ hash -r 2024-09-12T00:19:32.690 INFO:tasks.workunit.client.0.smithi043.stderr:++ '[' -n '' ']' 2024-09-12T00:19:32.690 INFO:tasks.workunit.client.0.smithi043.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:19:32.690 INFO:tasks.workunit.client.0.smithi043.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T00:19:32.690 INFO:tasks.workunit.client.0.smithi043.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:19:32.690 INFO:tasks.workunit.client.0.smithi043.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:19:32.690 INFO:tasks.workunit.client.0.smithi043.stderr:++ export VIRTUAL_ENV 2024-09-12T00:19:32.690 INFO:tasks.workunit.client.0.smithi043.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:19:32.690 INFO:tasks.workunit.client.0.smithi043.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:19:32.690 INFO:tasks.workunit.client.0.smithi043.stderr:++ export PATH 2024-09-12T00:19:32.690 INFO:tasks.workunit.client.0.smithi043.stderr:++ '[' -n '' ']' 2024-09-12T00:19:32.690 INFO:tasks.workunit.client.0.smithi043.stderr:++ '[' -z '' ']' 2024-09-12T00:19:32.691 INFO:tasks.workunit.client.0.smithi043.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:19:32.691 INFO:tasks.workunit.client.0.smithi043.stderr:++ PS1='(rgw) ' 2024-09-12T00:19:32.691 INFO:tasks.workunit.client.0.smithi043.stderr:++ export PS1 2024-09-12T00:19:32.691 INFO:tasks.workunit.client.0.smithi043.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T00:19:32.691 INFO:tasks.workunit.client.0.smithi043.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T00:19:32.691 INFO:tasks.workunit.client.0.smithi043.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:19:32.691 INFO:tasks.workunit.client.0.smithi043.stderr:++ hash -r 2024-09-12T00:19:32.691 INFO:tasks.workunit.client.0.smithi043.stderr:+ pip install pip --upgrade 2024-09-12T00:19:33.094 INFO:tasks.workunit.client.0.smithi043.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T00:19:33.337 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting pip 2024-09-12T00:19:33.444 INFO:tasks.workunit.client.0.smithi043.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:19:33.721 INFO:tasks.workunit.client.0.smithi043.stdout: ---------------------------------------- 1.8/1.8 MB 6.6 MB/s eta 0:00:00 2024-09-12T00:19:33.797 INFO:tasks.workunit.client.0.smithi043.stdout:Installing collected packages: pip 2024-09-12T00:19:33.797 INFO:tasks.workunit.client.0.smithi043.stdout: Attempting uninstall: pip 2024-09-12T00:19:33.798 INFO:tasks.workunit.client.0.smithi043.stdout: Found existing installation: pip 22.0.2 2024-09-12T00:19:34.092 INFO:tasks.workunit.client.0.smithi043.stdout: Uninstalling pip-22.0.2: 2024-09-12T00:19:34.100 INFO:tasks.workunit.client.0.smithi043.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T00:19:34.907 INFO:tasks.workunit.client.0.smithi043.stdout:Successfully installed pip-24.2 2024-09-12T00:19:34.969 INFO:tasks.workunit.client.0.smithi043.stderr:+ pip install boto3 2024-09-12T00:19:36.112 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting boto3 2024-09-12T00:19:36.162 INFO:tasks.workunit.client.0.smithi043.stdout: Downloading boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:19:36.859 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:19:36.877 INFO:tasks.workunit.client.0.smithi043.stdout: Downloading botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:19:36.968 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:19:36.984 INFO:tasks.workunit.client.0.smithi043.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:19:37.125 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:19:37.148 INFO:tasks.workunit.client.0.smithi043.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:19:37.305 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:19:37.322 INFO:tasks.workunit.client.0.smithi043.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:19:37.541 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:19:37.556 INFO:tasks.workunit.client.0.smithi043.stdout: Downloading urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-09-12T00:19:37.870 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:19:37.884 INFO:tasks.workunit.client.0.smithi043.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:19:37.950 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:19:38.039 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:19:38.288 INFO:tasks.workunit.client.0.smithi043.stdout: ---------------------------------------- 12.5/12.5 MB 53.4 MB/s eta 0:00:00 2024-09-12T00:19:38.308 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:19:38.372 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:19:38.440 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:19:38.514 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-09-12T00:19:38.590 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:19:38.771 INFO:tasks.workunit.client.0.smithi043.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:19:39.978 INFO:tasks.workunit.client.0.smithi043.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-09-12T00:19:40.433 INFO:tasks.workunit.client.0.smithi043.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-12T00:19:40.592 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-12T00:19:40.633 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:40.633 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:40.676 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.674+0000 7f7d855a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:40.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.674+0000 7f7d855a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:40.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.674+0000 7f7d855a19c0 20 realm 2024-09-12T00:19:40.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.674+0000 7f7d855a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:40.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.674+0000 7f7d855a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:40.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.674+0000 7f7d855a19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:40.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.674+0000 7f7d855a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:40.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.678+0000 7f7d855a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:40.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.678+0000 7f7d855a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:40.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.678+0000 7f7d855a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:40.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.678+0000 7f7d855a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:40.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.678+0000 7f7d855a19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:40.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.678+0000 7f7d855a19c0 20 searching for the correct realm 2024-09-12T00:19:40.687 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.686+0000 7f7d828a6640 0 -- 172.21.15.43:0/197986951 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x55cb514e8390 msgr2=0x7f7d6c0e0950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:40.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.690+0000 7f7d838a8640 0 -- 172.21.15.43:0/197986951 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f7d6c0d1900 msgr2=0x7f7d6c0c93f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:19:40.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.698+0000 7f7d855a19c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:19:40.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.698+0000 7f7d855a19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:40.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.698+0000 7f7d855a19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:40.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.698+0000 7f7d855a19c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:19:40.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.698+0000 7f7d855a19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:40.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.698+0000 7f7d855a19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:40.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.698+0000 7f7d855a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:40.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.698+0000 7f7d855a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:40.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.698+0000 7f7d855a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:40.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.698+0000 7f7d855a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:40.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.698+0000 7f7d855a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:40.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.702+0000 7f7d855a19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:40.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.702+0000 7f7d855a19c0 20 zone default found 2024-09-12T00:19:40.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.702+0000 7f7d855a19c0 4 Realm: () 2024-09-12T00:19:40.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.702+0000 7f7d855a19c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:19:40.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.702+0000 7f7d855a19c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:19:40.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.702+0000 7f7d855a19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:40.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.702+0000 7f7d855a19c0 20 zonegroup default 2024-09-12T00:19:40.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.702+0000 7f7d855a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:40.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.702+0000 7f7d855a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:40.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.702+0000 7f7d855a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:40.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.702+0000 7f7d855a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:40.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.702+0000 7f7d855a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:40.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.702+0000 7f7d855a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:40.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.702+0000 7f7d855a19c0 20 started sync module instance, tier type = 2024-09-12T00:19:40.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.702+0000 7f7d855a19c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:19:40.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.718+0000 7f7d855a19c0 20 add_watcher() i=0 2024-09-12T00:19:40.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.718+0000 7f7d855a19c0 20 add_watcher() i=1 2024-09-12T00:19:40.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.718+0000 7f7d855a19c0 20 add_watcher() i=2 2024-09-12T00:19:40.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.718+0000 7f7d855a19c0 20 add_watcher() i=3 2024-09-12T00:19:40.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.718+0000 7f7d855a19c0 20 add_watcher() i=4 2024-09-12T00:19:40.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.718+0000 7f7d855a19c0 20 add_watcher() i=5 2024-09-12T00:19:40.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.718+0000 7f7d855a19c0 20 add_watcher() i=6 2024-09-12T00:19:40.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.718+0000 7f7d855a19c0 20 add_watcher() i=7 2024-09-12T00:19:40.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.718+0000 7f7d855a19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:40.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.722+0000 7f7c39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:40.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.722+0000 7f7d855a19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:40.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.722+0000 7f7d855a19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:40.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.722+0000 7f7d855a19c0 5 note: GC not initialized 2024-09-12T00:19:40.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.722+0000 7f7c38fe1640 20 reqs_thread_entry: start 2024-09-12T00:19:40.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.722+0000 7f7d855a19c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:40.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.722+0000 7f7d855a19c0 20 Filter name: none 2024-09-12T00:19:40.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.722+0000 7f7bb27fc640 20 reqs_thread_entry: start 2024-09-12T00:19:40.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.722+0000 7f7d855a19c0 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-12T00:19:40.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.722+0000 7f7d855a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:40.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.722+0000 7f7d855a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:40.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.722+0000 7f7d855a19c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-12T00:19:40.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.722+0000 7f7d855a19c0 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:19:40.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.722+0000 7f7d855a19c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-12T00:19:40.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.722+0000 7f7d855a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:40.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.726+0000 7f7d855a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:40.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.726+0000 7f7d855a19c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-12T00:19:40.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.726+0000 7f7d855a19c0 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:19:40.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.726+0000 7f7d855a19c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T00:19:40.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.726+0000 7f7d855a19c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T00:19:40.730 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.730+0000 7f7d855a19c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T00:19:40.730 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.730+0000 7f7d855a19c0 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:19:40.730 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.730+0000 7f7d855a19c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-12T00:19:40.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.730+0000 7f7c667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 163208757248 cookie 94331733232336 notifier 4565 bl.length()=593 2024-09-12T00:19:40.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.730+0000 7f7c667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T00:19:40.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.730+0000 7f7c667fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:19:40.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.734+0000 7f7d855a19c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T00:19:40.735 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.734+0000 7f7d855a19c0 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:19:40.735 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.734+0000 7f7d855a19c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-12T00:19:40.735 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.734+0000 7f7c667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 163208757248 cookie 94331733230032 notifier 4565 bl.length()=186 2024-09-12T00:19:40.735 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.734+0000 7f7c667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T00:19:40.735 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.734+0000 7f7c667fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:19:40.737 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.734+0000 7f7c39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:40.742 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.742+0000 7f7d855a19c0 20 remove_watcher() i=0 2024-09-12T00:19:40.742 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.742+0000 7f7d855a19c0 2 removed watcher, disabling cache 2024-09-12T00:19:40.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.742+0000 7f7d855a19c0 20 remove_watcher() i=1 2024-09-12T00:19:40.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.746+0000 7f7d855a19c0 20 remove_watcher() i=2 2024-09-12T00:19:40.749 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.746+0000 7f7d855a19c0 20 remove_watcher() i=3 2024-09-12T00:19:40.750 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.750+0000 7f7d855a19c0 20 remove_watcher() i=4 2024-09-12T00:19:40.752 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.750+0000 7f7d855a19c0 20 remove_watcher() i=5 2024-09-12T00:19:40.753 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.750+0000 7f7d855a19c0 20 remove_watcher() i=6 2024-09-12T00:19:40.755 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:40.754+0000 7f7d855a19c0 20 remove_watcher() i=7 2024-09-12T00:19:40.922 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:40.922 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:40.971 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:40.971 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:41.021 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:41.021 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:41.050 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:41.051 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:41.072 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:41.072 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:41.080 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:41.080 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:41.095 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:41.096 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:41.102 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:41.102 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:41.111 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:41.111 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:41.142 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:41.142 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:41.150 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:41.150 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:41.185 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:41.185 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:41.194 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:41.194 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:41.227 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:41.227 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:41.236 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:41.236 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:41.271 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:41.271 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:41.277 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: recalculated bucket check stats are correct 2024-09-12T00:19:41.277 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:19:41.277 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T00:19:41.314 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:41.314 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:41.359 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.358+0000 7ff64825c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.361 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.358+0000 7ff64825c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:41.361 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.358+0000 7ff64825c9c0 20 realm 2024-09-12T00:19:41.361 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.358+0000 7ff64825c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.361 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.358+0000 7ff64825c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:41.361 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.358+0000 7ff64825c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:41.361 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.358+0000 7ff64825c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.361 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.358+0000 7ff64825c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:41.362 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.358+0000 7ff64825c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.363 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.362+0000 7ff64825c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:41.363 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.362+0000 7ff64825c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.362+0000 7ff64825c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:41.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.362+0000 7ff64825c9c0 20 searching for the correct realm 2024-09-12T00:19:41.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.370+0000 7ff645561640 0 -- 172.21.15.43:0/2012627196 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7ff63c027040 msgr2=0x7ff63c043440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:41.377 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.374+0000 7ff645561640 0 -- 172.21.15.43:0/2012627196 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7ff51007e070 msgr2=0x7ff5100804a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:41.384 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.382+0000 7ff64825c9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:19:41.384 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.382+0000 7ff64825c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:41.384 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.382+0000 7ff64825c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:41.384 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.382+0000 7ff64825c9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:19:41.384 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.382+0000 7ff64825c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:41.384 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.382+0000 7ff64825c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:41.384 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.382+0000 7ff64825c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.384 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.382+0000 7ff64825c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:41.385 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.382+0000 7ff64825c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.385 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.382+0000 7ff64825c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:41.385 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.382+0000 7ff64825c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.385 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.382+0000 7ff64825c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:41.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.382+0000 7ff64825c9c0 20 zone default found 2024-09-12T00:19:41.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.382+0000 7ff64825c9c0 4 Realm: () 2024-09-12T00:19:41.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.382+0000 7ff64825c9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:19:41.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.382+0000 7ff64825c9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:19:41.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.382+0000 7ff64825c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:41.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.382+0000 7ff64825c9c0 20 zonegroup default 2024-09-12T00:19:41.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.382+0000 7ff64825c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.387 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.382+0000 7ff64825c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:41.387 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.382+0000 7ff64825c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.387 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.386+0000 7ff64825c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:41.387 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.386+0000 7ff64825c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.387 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.386+0000 7ff64825c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:41.387 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.386+0000 7ff64825c9c0 20 started sync module instance, tier type = 2024-09-12T00:19:41.387 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.386+0000 7ff64825c9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:19:41.403 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.402+0000 7ff64825c9c0 20 add_watcher() i=0 2024-09-12T00:19:41.403 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.402+0000 7ff64825c9c0 20 add_watcher() i=1 2024-09-12T00:19:41.404 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.402+0000 7ff64825c9c0 20 add_watcher() i=2 2024-09-12T00:19:41.404 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.402+0000 7ff64825c9c0 20 add_watcher() i=3 2024-09-12T00:19:41.404 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.402+0000 7ff64825c9c0 20 add_watcher() i=4 2024-09-12T00:19:41.404 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.402+0000 7ff64825c9c0 20 add_watcher() i=5 2024-09-12T00:19:41.404 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.402+0000 7ff64825c9c0 20 add_watcher() i=6 2024-09-12T00:19:41.404 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.402+0000 7ff64825c9c0 20 add_watcher() i=7 2024-09-12T00:19:41.404 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.402+0000 7ff64825c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:41.407 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.406+0000 7ff4f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:41.408 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.406+0000 7ff64825c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:41.409 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.406+0000 7ff64825c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:41.409 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.406+0000 7ff64825c9c0 5 note: GC not initialized 2024-09-12T00:19:41.409 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.406+0000 7ff4f67fc640 20 reqs_thread_entry: start 2024-09-12T00:19:41.409 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.406+0000 7ff64825c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:41.409 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.406+0000 7ff64825c9c0 20 Filter name: none 2024-09-12T00:19:41.409 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.406+0000 7ff467fff640 20 reqs_thread_entry: start 2024-09-12T00:19:41.409 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.406+0000 7ff64825c9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:19:41.409 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.406+0000 7ff64825c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.410 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.406+0000 7ff64825c9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:19:41.410 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.406+0000 7ff64825c9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:19:41.410 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.406+0000 7ff64825c9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:19:41.410 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.406+0000 7ff64825c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 : miss 2024-09-12T00:19:41.410 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.406+0000 7ff64825c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.411 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.410+0000 7ff64825c9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:19:41.411 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.410+0000 7ff64825c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 info.flags=0x17 2024-09-12T00:19:41.411 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.410+0000 7ff64825c9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 to cache LRU end 2024-09-12T00:19:41.411 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.410+0000 7ff64825c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:41.411 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.410+0000 7ff64825c9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:19:41.411 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.410+0000 7ff64825c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 2024-09-12T00:19:41.411 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.410+0000 7ff64825c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.0 2024-09-12T00:19:41.412 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.410+0000 7ff64825c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:41.412 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.410+0000 7ff64825c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.2 2024-09-12T00:19:41.413 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.410+0000 7ff64825c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.3 2024-09-12T00:19:41.415 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.414+0000 7ff64825c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.4 2024-09-12T00:19:41.416 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.414+0000 7ff64825c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:41.417 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.414+0000 7ff64825c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.6 2024-09-12T00:19:41.418 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.418+0000 7ff64825c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.7 2024-09-12T00:19:41.419 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.418+0000 7ff64825c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:41.420 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.418+0000 7ff64825c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.9 2024-09-12T00:19:41.421 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.418+0000 7ff64825c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:41.429 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.426+0000 7ff4f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:41.434 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.434+0000 7ff64825c9c0 20 remove_watcher() i=0 2024-09-12T00:19:41.434 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.434+0000 7ff64825c9c0 2 removed watcher, disabling cache 2024-09-12T00:19:41.436 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.434+0000 7ff64825c9c0 20 remove_watcher() i=1 2024-09-12T00:19:41.438 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.438+0000 7ff64825c9c0 20 remove_watcher() i=2 2024-09-12T00:19:41.440 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.438+0000 7ff64825c9c0 20 remove_watcher() i=3 2024-09-12T00:19:41.443 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.442+0000 7ff64825c9c0 20 remove_watcher() i=4 2024-09-12T00:19:41.444 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.442+0000 7ff64825c9c0 20 remove_watcher() i=5 2024-09-12T00:19:41.445 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.442+0000 7ff64825c9c0 20 remove_watcher() i=6 2024-09-12T00:19:41.447 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.446+0000 7ff64825c9c0 20 remove_watcher() i=7 2024-09-12T00:19:41.461 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T00:19:41.488 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:41.488 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:41.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.530+0000 7f89141269c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.532 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.530+0000 7f89141269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:41.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.530+0000 7f89141269c0 20 realm 2024-09-12T00:19:41.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.530+0000 7f89141269c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.530+0000 7f89141269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:41.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.530+0000 7f89141269c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:41.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.530+0000 7f89141269c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.530+0000 7f89141269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:41.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.530+0000 7f89141269c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.534+0000 7f89141269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:41.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.534+0000 7f89141269c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.534+0000 7f89141269c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:41.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.534+0000 7f89141269c0 20 searching for the correct realm 2024-09-12T00:19:41.541 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.538+0000 7f891242d640 0 -- 172.21.15.43:0/2570728441 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f890806f240 msgr2=0x7f89080760d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:41.756 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.754+0000 7f8911c2c640 0 -- 172.21.15.43:0/2570728441 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x55f7355cd770 msgr2=0x55f7355cfb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:41.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.762+0000 7f89141269c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:19:41.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.762+0000 7f89141269c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:41.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.762+0000 7f89141269c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:41.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.762+0000 7f89141269c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:19:41.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.762+0000 7f89141269c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:41.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.762+0000 7f89141269c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:41.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.762+0000 7f89141269c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.762+0000 7f89141269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:41.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.762+0000 7f89141269c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.762+0000 7f89141269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:41.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.762+0000 7f89141269c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.766 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.766+0000 7f89141269c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:41.766 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.766+0000 7f89141269c0 20 zone default found 2024-09-12T00:19:41.766 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.766+0000 7f89141269c0 4 Realm: () 2024-09-12T00:19:41.766 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.766+0000 7f89141269c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:19:41.766 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.766+0000 7f89141269c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:19:41.767 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.766+0000 7f89141269c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:41.767 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.766+0000 7f89141269c0 20 zonegroup default 2024-09-12T00:19:41.767 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.766+0000 7f89141269c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.767 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.766+0000 7f89141269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:41.767 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.766+0000 7f89141269c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.768 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.766+0000 7f89141269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:41.768 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.766+0000 7f89141269c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.768 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.766+0000 7f89141269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:41.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.766+0000 7f89141269c0 20 started sync module instance, tier type = 2024-09-12T00:19:41.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.766+0000 7f89141269c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:19:41.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.790+0000 7f89141269c0 20 add_watcher() i=0 2024-09-12T00:19:41.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.790+0000 7f89141269c0 20 add_watcher() i=1 2024-09-12T00:19:41.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.790+0000 7f89141269c0 20 add_watcher() i=2 2024-09-12T00:19:41.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.790+0000 7f89141269c0 20 add_watcher() i=3 2024-09-12T00:19:41.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.790+0000 7f89141269c0 20 add_watcher() i=4 2024-09-12T00:19:41.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.790+0000 7f89141269c0 20 add_watcher() i=5 2024-09-12T00:19:41.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.790+0000 7f89141269c0 20 add_watcher() i=6 2024-09-12T00:19:41.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.790+0000 7f89141269c0 20 add_watcher() i=7 2024-09-12T00:19:41.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.790+0000 7f89141269c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:41.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.794+0000 7f87c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:41.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.794+0000 7f89141269c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:41.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.794+0000 7f89141269c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:41.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.794+0000 7f89141269c0 5 note: GC not initialized 2024-09-12T00:19:41.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.794+0000 7f87c27fc640 20 reqs_thread_entry: start 2024-09-12T00:19:41.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.794+0000 7f89141269c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:41.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.794+0000 7f89141269c0 20 Filter name: none 2024-09-12T00:19:41.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.794+0000 7f8733fff640 20 reqs_thread_entry: start 2024-09-12T00:19:41.799 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.798+0000 7f89141269c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.799 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.798+0000 7f89141269c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:19:41.799 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.798+0000 7f89141269c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.798+0000 7f89141269c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:19:41.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.798+0000 7f89141269c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:41.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.798+0000 7f89141269c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.798+0000 7f89141269c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:19:41.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.798+0000 7f89141269c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.801 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.798+0000 7f89141269c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:19:41.801 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.798+0000 7f89141269c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:41.803 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.802+0000 7f87c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:41.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.806+0000 7f89141269c0 20 remove_watcher() i=0 2024-09-12T00:19:41.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.806+0000 7f89141269c0 2 removed watcher, disabling cache 2024-09-12T00:19:41.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.810+0000 7f89141269c0 20 remove_watcher() i=1 2024-09-12T00:19:41.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.810+0000 7f89141269c0 20 remove_watcher() i=2 2024-09-12T00:19:41.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.814+0000 7f89141269c0 20 remove_watcher() i=3 2024-09-12T00:19:41.818 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.818+0000 7f89141269c0 20 remove_watcher() i=4 2024-09-12T00:19:41.819 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.818+0000 7f89141269c0 20 remove_watcher() i=5 2024-09-12T00:19:41.821 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.818+0000 7f89141269c0 20 remove_watcher() i=6 2024-09-12T00:19:41.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.822+0000 7f89141269c0 20 remove_watcher() i=7 2024-09-12T00:19:41.837 INFO:tasks.workunit.client.0.smithi043.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 111, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-12T00:19:41.837 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-12T00:19:41.838 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:19:41.838 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:19:41.869 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:41.869 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:41.913 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.910+0000 7f0914b289c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.914 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.914+0000 7f0914b289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:41.914 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.914+0000 7f0914b289c0 20 realm 2024-09-12T00:19:41.915 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.914+0000 7f0914b289c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.915 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.914+0000 7f0914b289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:41.915 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.914+0000 7f0914b289c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:41.915 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.914+0000 7f0914b289c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.915 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.914+0000 7f0914b289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:41.915 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.914+0000 7f0914b289c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.916 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.914+0000 7f0914b289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:41.916 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.914+0000 7f0914b289c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:41.917 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.914+0000 7f0914b289c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:41.918 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.914+0000 7f0914b289c0 20 searching for the correct realm 2024-09-12T00:19:41.925 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:41.922+0000 7f0912e2f640 0 -- 172.21.15.43:0/682534970 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f09080db910 msgr2=0x7f09080e63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:42.140 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.138+0000 7f091262e640 0 -- 172.21.15.43:0/682534970 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x556052c0c390 msgr2=0x556052c0e7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:42.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.146+0000 7f0914b289c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:19:42.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.146+0000 7f0914b289c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:42.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.146+0000 7f0914b289c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:42.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.146+0000 7f0914b289c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:19:42.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.146+0000 7f0914b289c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:42.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.146+0000 7f0914b289c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:42.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.146+0000 7f0914b289c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:42.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.146+0000 7f0914b289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:42.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.146+0000 7f0914b289c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:42.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.146+0000 7f0914b289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:42.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.150+0000 7f0914b289c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:42.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.150+0000 7f0914b289c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:42.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.150+0000 7f0914b289c0 20 zone default found 2024-09-12T00:19:42.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.150+0000 7f0914b289c0 4 Realm: () 2024-09-12T00:19:42.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.150+0000 7f0914b289c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:19:42.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.150+0000 7f0914b289c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:19:42.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.150+0000 7f0914b289c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:42.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.150+0000 7f0914b289c0 20 zonegroup default 2024-09-12T00:19:42.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.150+0000 7f0914b289c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:42.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.150+0000 7f0914b289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:42.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.150+0000 7f0914b289c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:42.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.150+0000 7f0914b289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:42.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.150+0000 7f0914b289c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:42.153 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.150+0000 7f0914b289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:42.153 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.150+0000 7f0914b289c0 20 started sync module instance, tier type = 2024-09-12T00:19:42.153 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.150+0000 7f0914b289c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:19:42.178 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.174+0000 7f0914b289c0 20 add_watcher() i=0 2024-09-12T00:19:42.178 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.174+0000 7f0914b289c0 20 add_watcher() i=1 2024-09-12T00:19:42.178 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.174+0000 7f0914b289c0 20 add_watcher() i=2 2024-09-12T00:19:42.178 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.174+0000 7f0914b289c0 20 add_watcher() i=3 2024-09-12T00:19:42.178 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.174+0000 7f0914b289c0 20 add_watcher() i=4 2024-09-12T00:19:42.178 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.174+0000 7f0914b289c0 20 add_watcher() i=5 2024-09-12T00:19:42.178 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.174+0000 7f0914b289c0 20 add_watcher() i=6 2024-09-12T00:19:42.180 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.178+0000 7f0914b289c0 20 add_watcher() i=7 2024-09-12T00:19:42.180 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.178+0000 7f0914b289c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:42.184 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.182+0000 7f07c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:42.185 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.182+0000 7f0914b289c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:42.185 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.182+0000 7f0914b289c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:42.185 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.182+0000 7f0914b289c0 5 note: GC not initialized 2024-09-12T00:19:42.186 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.182+0000 7f07437fe640 20 reqs_thread_entry: start 2024-09-12T00:19:42.186 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.182+0000 7f0914b289c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:42.186 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.186+0000 7f0914b289c0 20 Filter name: none 2024-09-12T00:19:42.187 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.186+0000 7f07417fa640 20 reqs_thread_entry: start 2024-09-12T00:19:42.187 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.186+0000 7f0914b289c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:19:42.187 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.186+0000 7f0914b289c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:42.187 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.186+0000 7f0914b289c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:19:42.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.186+0000 7f0914b289c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:19:42.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.186+0000 7f0914b289c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:19:42.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.186+0000 7f0914b289c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 : miss 2024-09-12T00:19:42.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.186+0000 7f0914b289c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:42.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.186+0000 7f0914b289c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:19:42.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.186+0000 7f0914b289c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 info.flags=0x17 2024-09-12T00:19:42.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.186+0000 7f0914b289c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 to cache LRU end 2024-09-12T00:19:42.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.186+0000 7f0914b289c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:42.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.186+0000 7f0914b289c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:19:42.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.186+0000 7f0914b289c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 2024-09-12T00:19:42.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.186+0000 7f0914b289c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.0 2024-09-12T00:19:42.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.186+0000 7f0914b289c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:19:42.190 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.186+0000 7f0914b289c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:42.190 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.190+0000 7f0914b289c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T00:19:42.191 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.190+0000 7f0914b289c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.2 2024-09-12T00:19:42.192 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.190+0000 7f0914b289c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:19:42.192 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.190+0000 7f0914b289c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.3 2024-09-12T00:19:42.192 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.190+0000 7f0914b289c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:19:42.193 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.190+0000 7f0914b289c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.4 2024-09-12T00:19:42.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.190+0000 7f0914b289c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:19:42.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.190+0000 7f0914b289c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:42.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.194+0000 7f0914b289c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T00:19:42.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.194+0000 7f0914b289c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.6 2024-09-12T00:19:42.196 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.194+0000 7f0914b289c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:19:42.196 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.194+0000 7f0914b289c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.7 2024-09-12T00:19:42.197 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.194+0000 7f0914b289c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:19:42.197 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.194+0000 7f0914b289c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:42.198 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.198+0000 7f0914b289c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T00:19:42.199 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.198+0000 7f0914b289c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.9 2024-09-12T00:19:42.199 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.198+0000 7f0914b289c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:19:42.199 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.198+0000 7f0914b289c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:42.200 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.198+0000 7f0914b289c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T00:19:42.200 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.198+0000 7f0914b289c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:19:42.201 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.198+0000 7f07c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:42.206 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.206+0000 7f0914b289c0 20 remove_watcher() i=0 2024-09-12T00:19:42.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.206+0000 7f0914b289c0 2 removed watcher, disabling cache 2024-09-12T00:19:42.209 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.206+0000 7f0914b289c0 20 remove_watcher() i=1 2024-09-12T00:19:42.212 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.210+0000 7f0914b289c0 20 remove_watcher() i=2 2024-09-12T00:19:42.214 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.214+0000 7f0914b289c0 20 remove_watcher() i=3 2024-09-12T00:19:42.217 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.214+0000 7f0914b289c0 20 remove_watcher() i=4 2024-09-12T00:19:42.219 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.218+0000 7f0914b289c0 20 remove_watcher() i=5 2024-09-12T00:19:42.220 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.218+0000 7f0914b289c0 20 remove_watcher() i=6 2024-09-12T00:19:42.223 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:42.222+0000 7f0914b289c0 20 remove_watcher() i=7 2024-09-12T00:19:42.240 INFO:tasks.workunit.client.0.smithi043.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:19:42.682 INFO:tasks.workunit.client.0.smithi043.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:19:44.133 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:44.133 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:44.199 INFO:tasks.workunit.client.0.smithi043.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:19:44.199 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:19:44.237 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:44.237 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:44.282 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.277+0000 7f6924ec19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:44.284 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.281+0000 7f6924ec19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:44.284 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.281+0000 7f6924ec19c0 20 realm 2024-09-12T00:19:44.284 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.281+0000 7f6924ec19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:44.284 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.281+0000 7f6924ec19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:44.285 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.281+0000 7f6924ec19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:44.285 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.281+0000 7f6924ec19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:44.285 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.281+0000 7f6924ec19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:44.285 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.281+0000 7f6924ec19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:44.286 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.285+0000 7f6924ec19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:44.286 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.285+0000 7f6924ec19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:44.287 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.285+0000 7f6924ec19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:44.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.285+0000 7f6924ec19c0 20 searching for the correct realm 2024-09-12T00:19:44.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.293+0000 7f69231c8640 0 -- 172.21.15.43:0/54167690 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f691808f2f0 msgr2=0x7f691805b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:44.513 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.509+0000 7f69229c7640 0 -- 172.21.15.43:0/54167690 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x564dac0d2850 msgr2=0x564dac0d4c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:44.520 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.517+0000 7f6924ec19c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:19:44.520 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.517+0000 7f6924ec19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:44.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.517+0000 7f6924ec19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:44.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.517+0000 7f6924ec19c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:19:44.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.517+0000 7f6924ec19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:44.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.517+0000 7f6924ec19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:44.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.517+0000 7f6924ec19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:44.522 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.517+0000 7f6924ec19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:44.522 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.517+0000 7f6924ec19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:44.523 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.521+0000 7f6924ec19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:44.523 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.521+0000 7f6924ec19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:44.524 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.521+0000 7f6924ec19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:44.524 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.521+0000 7f6924ec19c0 20 zone default found 2024-09-12T00:19:44.524 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.521+0000 7f6924ec19c0 4 Realm: () 2024-09-12T00:19:44.524 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.521+0000 7f6924ec19c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:19:44.524 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.521+0000 7f6924ec19c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:19:44.524 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.521+0000 7f6924ec19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:44.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.521+0000 7f6924ec19c0 20 zonegroup default 2024-09-12T00:19:44.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.521+0000 7f6924ec19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:44.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.521+0000 7f6924ec19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:44.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.521+0000 7f6924ec19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:44.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.521+0000 7f6924ec19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:44.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.521+0000 7f6924ec19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:44.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.521+0000 7f6924ec19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:44.527 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.521+0000 7f6924ec19c0 20 started sync module instance, tier type = 2024-09-12T00:19:44.527 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.521+0000 7f6924ec19c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:19:44.551 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.549+0000 7f6924ec19c0 20 add_watcher() i=0 2024-09-12T00:19:44.551 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.549+0000 7f6924ec19c0 20 add_watcher() i=1 2024-09-12T00:19:44.551 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.549+0000 7f6924ec19c0 20 add_watcher() i=2 2024-09-12T00:19:44.551 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.549+0000 7f6924ec19c0 20 add_watcher() i=3 2024-09-12T00:19:44.551 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.549+0000 7f6924ec19c0 20 add_watcher() i=4 2024-09-12T00:19:44.551 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.549+0000 7f6924ec19c0 20 add_watcher() i=5 2024-09-12T00:19:44.551 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.549+0000 7f6924ec19c0 20 add_watcher() i=6 2024-09-12T00:19:44.553 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.549+0000 7f6924ec19c0 20 add_watcher() i=7 2024-09-12T00:19:44.553 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.549+0000 7f6924ec19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:44.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.553+0000 7f67d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:44.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.557+0000 7f6924ec19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:44.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.557+0000 7f6924ec19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:44.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.557+0000 7f6924ec19c0 5 note: GC not initialized 2024-09-12T00:19:44.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.557+0000 7f6753fff640 20 reqs_thread_entry: start 2024-09-12T00:19:44.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.557+0000 7f6924ec19c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:44.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.557+0000 7f6924ec19c0 20 Filter name: none 2024-09-12T00:19:44.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.557+0000 7f6751ffb640 20 reqs_thread_entry: start 2024-09-12T00:19:44.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.557+0000 7f6924ec19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:44.561 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.557+0000 7f6924ec19c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:19:44.561 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.557+0000 7f6924ec19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:44.562 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.557+0000 7f6924ec19c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:19:44.562 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.557+0000 7f6924ec19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:44.562 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.557+0000 7f6924ec19c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:19:44.562 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.557+0000 7f6924ec19c0 20 INFO: main: starting shard=0 2024-09-12T00:19:44.562 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.557+0000 7f6924ec19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.0 2024-09-12T00:19:44.563 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.561+0000 7f6924ec19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:44.563 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.561+0000 7f6924ec19c0 20 INFO: main: starting shard=1 2024-09-12T00:19:44.563 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.561+0000 7f6924ec19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:44.563 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.561+0000 7f6924ec19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:44.563 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.561+0000 7f6924ec19c0 20 INFO: main: starting shard=2 2024-09-12T00:19:44.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.561+0000 7f6924ec19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.2 2024-09-12T00:19:44.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.561+0000 7f6924ec19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:44.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.561+0000 7f6924ec19c0 20 INFO: main: starting shard=3 2024-09-12T00:19:44.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.561+0000 7f6924ec19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.3 2024-09-12T00:19:44.566 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.561+0000 7f6924ec19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:44.566 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.561+0000 7f6924ec19c0 20 INFO: main: starting shard=4 2024-09-12T00:19:44.566 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.561+0000 7f6924ec19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.4 2024-09-12T00:19:44.567 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.565+0000 7f6924ec19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:44.567 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.565+0000 7f6924ec19c0 20 INFO: main: starting shard=5 2024-09-12T00:19:44.567 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.565+0000 7f6924ec19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:44.568 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.565+0000 7f6924ec19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:44.568 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.565+0000 7f6924ec19c0 20 INFO: main: starting shard=6 2024-09-12T00:19:44.568 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.565+0000 7f6924ec19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.6 2024-09-12T00:19:44.569 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.565+0000 7f6924ec19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:44.569 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.565+0000 7f6924ec19c0 20 INFO: main: starting shard=7 2024-09-12T00:19:44.569 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.565+0000 7f6924ec19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.7 2024-09-12T00:19:44.573 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.569+0000 7f6924ec19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:44.573 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.569+0000 7f6924ec19c0 20 INFO: main: starting shard=8 2024-09-12T00:19:44.573 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.569+0000 7f6924ec19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:44.573 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.569+0000 7f6924ec19c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:19:44.573 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.569+0000 7f6924ec19c0 20 INFO: main: starting shard=9 2024-09-12T00:19:44.573 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.569+0000 7f6924ec19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.9 2024-09-12T00:19:44.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.569+0000 7f6924ec19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:44.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.569+0000 7f6924ec19c0 20 INFO: main: starting shard=10 2024-09-12T00:19:44.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.569+0000 7f6924ec19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:44.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.569+0000 7f6924ec19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:44.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.569+0000 7f6924ec19c0 20 INFO: main: done 2024-09-12T00:19:44.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.569+0000 7f67d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:44.579 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.577+0000 7f6924ec19c0 20 remove_watcher() i=0 2024-09-12T00:19:44.579 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.577+0000 7f6924ec19c0 2 removed watcher, disabling cache 2024-09-12T00:19:44.581 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.577+0000 7f6924ec19c0 20 remove_watcher() i=1 2024-09-12T00:19:44.584 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.581+0000 7f6924ec19c0 20 remove_watcher() i=2 2024-09-12T00:19:44.587 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.585+0000 7f6924ec19c0 20 remove_watcher() i=3 2024-09-12T00:19:44.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.585+0000 7f6924ec19c0 20 remove_watcher() i=4 2024-09-12T00:19:44.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.589+0000 7f6924ec19c0 20 remove_watcher() i=5 2024-09-12T00:19:44.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.589+0000 7f6924ec19c0 20 remove_watcher() i=6 2024-09-12T00:19:44.595 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.593+0000 7f6924ec19c0 20 remove_watcher() i=7 2024-09-12T00:19:44.611 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:44.611 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:44.616 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:44.616 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:44.620 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:44.620 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:44.679 INFO:tasks.workunit.client.0.smithi043.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:19:44.679 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:19:44.715 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:44.715 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:44.758 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.757+0000 7fc7099119c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:44.760 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.757+0000 7fc7099119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:44.760 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.757+0000 7fc7099119c0 20 realm 2024-09-12T00:19:44.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.757+0000 7fc7099119c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:44.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.757+0000 7fc7099119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:44.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.757+0000 7fc7099119c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:44.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.757+0000 7fc7099119c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:44.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.757+0000 7fc7099119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:44.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.757+0000 7fc7099119c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:44.762 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.761+0000 7fc7099119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:44.762 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.761+0000 7fc7099119c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:44.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.761+0000 7fc7099119c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:44.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.761+0000 7fc7099119c0 20 searching for the correct realm 2024-09-12T00:19:44.770 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.765+0000 7fc707c18640 0 -- 172.21.15.43:0/1699013324 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55cc4571a520 msgr2=0x55cc4571c970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:44.776 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.773+0000 7fc706c16640 0 -- 172.21.15.43:0/1699013324 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fc6fc036040 msgr2=0x7fc6fc00a450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:44.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.781+0000 7fc7099119c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:19:44.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.781+0000 7fc7099119c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:44.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.781+0000 7fc7099119c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:44.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.781+0000 7fc7099119c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:19:44.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.781+0000 7fc7099119c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:44.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.781+0000 7fc7099119c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:44.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.781+0000 7fc7099119c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:44.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.781+0000 7fc7099119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:44.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.781+0000 7fc7099119c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:44.785 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.781+0000 7fc7099119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:44.785 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.781+0000 7fc7099119c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:44.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.781+0000 7fc7099119c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:44.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.781+0000 7fc7099119c0 20 zone default found 2024-09-12T00:19:44.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.781+0000 7fc7099119c0 4 Realm: () 2024-09-12T00:19:44.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.781+0000 7fc7099119c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:19:44.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.781+0000 7fc7099119c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:19:44.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.781+0000 7fc7099119c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:44.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.781+0000 7fc7099119c0 20 zonegroup default 2024-09-12T00:19:44.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.781+0000 7fc7099119c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:44.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.781+0000 7fc7099119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:44.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.781+0000 7fc7099119c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:44.787 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.785+0000 7fc7099119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:44.787 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.785+0000 7fc7099119c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:44.787 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.785+0000 7fc7099119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:44.787 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.785+0000 7fc7099119c0 20 started sync module instance, tier type = 2024-09-12T00:19:44.787 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.785+0000 7fc7099119c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:19:44.803 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.801+0000 7fc7099119c0 20 add_watcher() i=0 2024-09-12T00:19:44.803 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.801+0000 7fc7099119c0 20 add_watcher() i=1 2024-09-12T00:19:44.803 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.801+0000 7fc7099119c0 20 add_watcher() i=2 2024-09-12T00:19:44.803 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.801+0000 7fc7099119c0 20 add_watcher() i=3 2024-09-12T00:19:44.803 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.801+0000 7fc7099119c0 20 add_watcher() i=4 2024-09-12T00:19:44.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.801+0000 7fc7099119c0 20 add_watcher() i=5 2024-09-12T00:19:44.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.801+0000 7fc7099119c0 20 add_watcher() i=6 2024-09-12T00:19:44.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.801+0000 7fc7099119c0 20 add_watcher() i=7 2024-09-12T00:19:44.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.801+0000 7fc7099119c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:44.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.805+0000 7fc5bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:44.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.805+0000 7fc7099119c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:44.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.805+0000 7fc7099119c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:44.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.805+0000 7fc7099119c0 5 note: GC not initialized 2024-09-12T00:19:44.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.805+0000 7fc5bcfe1640 20 reqs_thread_entry: start 2024-09-12T00:19:44.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.805+0000 7fc7099119c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:44.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.805+0000 7fc7099119c0 20 Filter name: none 2024-09-12T00:19:44.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.805+0000 7fc5367fc640 20 reqs_thread_entry: start 2024-09-12T00:19:44.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.805+0000 7fc7099119c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:44.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.805+0000 7fc7099119c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:19:44.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.805+0000 7fc7099119c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:44.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.805+0000 7fc7099119c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:19:44.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.805+0000 7fc7099119c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:44.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.805+0000 7fc7099119c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:19:44.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.805+0000 7fc7099119c0 20 INFO: main: starting shard=0 2024-09-12T00:19:44.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.805+0000 7fc7099119c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.0 2024-09-12T00:19:44.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.809+0000 7fc7099119c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:44.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.809+0000 7fc7099119c0 20 INFO: main: starting shard=1 2024-09-12T00:19:44.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.809+0000 7fc7099119c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:44.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.809+0000 7fc7099119c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:44.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.809+0000 7fc7099119c0 20 INFO: main: starting shard=2 2024-09-12T00:19:44.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.809+0000 7fc7099119c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.2 2024-09-12T00:19:44.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.809+0000 7fc7099119c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:44.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.809+0000 7fc7099119c0 20 INFO: main: starting shard=3 2024-09-12T00:19:44.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.809+0000 7fc7099119c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.3 2024-09-12T00:19:44.812 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.809+0000 7fc7099119c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:44.812 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.809+0000 7fc7099119c0 20 INFO: main: starting shard=4 2024-09-12T00:19:44.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.809+0000 7fc7099119c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.4 2024-09-12T00:19:44.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.809+0000 7fc7099119c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:44.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.809+0000 7fc7099119c0 20 INFO: main: starting shard=5 2024-09-12T00:19:44.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.809+0000 7fc7099119c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:44.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.813+0000 7fc7099119c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:19:44.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.813+0000 7fc7099119c0 20 INFO: main: starting shard=6 2024-09-12T00:19:44.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.813+0000 7fc7099119c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.6 2024-09-12T00:19:44.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.813+0000 7fc7099119c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:44.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.813+0000 7fc7099119c0 20 INFO: main: starting shard=7 2024-09-12T00:19:44.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.813+0000 7fc7099119c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.7 2024-09-12T00:19:44.817 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.813+0000 7fc7099119c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:44.817 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.813+0000 7fc7099119c0 20 INFO: main: starting shard=8 2024-09-12T00:19:44.817 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.813+0000 7fc7099119c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:44.817 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.813+0000 7fc7099119c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:44.818 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.813+0000 7fc7099119c0 20 INFO: main: starting shard=9 2024-09-12T00:19:44.818 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.813+0000 7fc7099119c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.9 2024-09-12T00:19:44.818 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.817+0000 7fc7099119c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:44.818 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.817+0000 7fc7099119c0 20 INFO: main: starting shard=10 2024-09-12T00:19:44.818 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.817+0000 7fc7099119c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:44.819 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.817+0000 7fc7099119c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:44.819 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.817+0000 7fc7099119c0 20 INFO: main: done 2024-09-12T00:19:44.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.817+0000 7fc5bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:44.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.821+0000 7fc7099119c0 20 remove_watcher() i=0 2024-09-12T00:19:44.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.821+0000 7fc7099119c0 2 removed watcher, disabling cache 2024-09-12T00:19:44.827 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.825+0000 7fc7099119c0 20 remove_watcher() i=1 2024-09-12T00:19:44.829 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.825+0000 7fc7099119c0 20 remove_watcher() i=2 2024-09-12T00:19:44.831 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.829+0000 7fc7099119c0 20 remove_watcher() i=3 2024-09-12T00:19:44.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.829+0000 7fc7099119c0 20 remove_watcher() i=4 2024-09-12T00:19:44.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.833+0000 7fc7099119c0 20 remove_watcher() i=5 2024-09-12T00:19:44.836 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.833+0000 7fc7099119c0 20 remove_watcher() i=6 2024-09-12T00:19:44.837 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:44.833+0000 7fc7099119c0 20 remove_watcher() i=7 2024-09-12T00:19:44.853 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:44.854 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:44.858 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:44.858 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:44.923 INFO:tasks.workunit.client.0.smithi043.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:19:44.923 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T00:19:44.959 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:44.959 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:45.004 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.001+0000 7f767a6a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:45.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.005+0000 7f767a6a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:45.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.005+0000 7f767a6a19c0 20 realm 2024-09-12T00:19:45.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.005+0000 7f767a6a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:45.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.005+0000 7f767a6a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:45.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.005+0000 7f767a6a19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:45.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.005+0000 7f767a6a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:45.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.005+0000 7f767a6a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:45.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.005+0000 7f767a6a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:45.008 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.005+0000 7f767a6a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:45.009 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.005+0000 7f767a6a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:45.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.005+0000 7f767a6a19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:45.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.005+0000 7f767a6a19c0 20 searching for the correct realm 2024-09-12T00:19:45.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.013+0000 7f76779a6640 0 -- 172.21.15.43:0/1355852254 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f766002f070 msgr2=0x7f7660063970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:45.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.017+0000 7f76779a6640 0 -- 172.21.15.43:0/1355852254 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f754007e040 msgr2=0x7f7540080470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:45.028 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.025+0000 7f767a6a19c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:19:45.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.025+0000 7f767a6a19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:45.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.025+0000 7f767a6a19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:45.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.025+0000 7f767a6a19c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:19:45.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.025+0000 7f767a6a19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:45.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.025+0000 7f767a6a19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:45.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.025+0000 7f767a6a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:45.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.025+0000 7f767a6a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:45.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.025+0000 7f767a6a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:45.030 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.025+0000 7f767a6a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:45.030 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.025+0000 7f767a6a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:45.030 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.029+0000 7f767a6a19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:45.030 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.029+0000 7f767a6a19c0 20 zone default found 2024-09-12T00:19:45.030 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.029+0000 7f767a6a19c0 4 Realm: () 2024-09-12T00:19:45.031 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.029+0000 7f767a6a19c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:19:45.031 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.029+0000 7f767a6a19c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:19:45.031 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.029+0000 7f767a6a19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:45.031 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.029+0000 7f767a6a19c0 20 zonegroup default 2024-09-12T00:19:45.031 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.029+0000 7f767a6a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:45.031 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.029+0000 7f767a6a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:45.031 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.029+0000 7f767a6a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:45.032 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.029+0000 7f767a6a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:45.032 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.029+0000 7f767a6a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:45.032 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.029+0000 7f767a6a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:45.032 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.029+0000 7f767a6a19c0 20 started sync module instance, tier type = 2024-09-12T00:19:45.032 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.029+0000 7f767a6a19c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:19:45.051 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.049+0000 7f767a6a19c0 20 add_watcher() i=0 2024-09-12T00:19:45.051 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.049+0000 7f767a6a19c0 20 add_watcher() i=1 2024-09-12T00:19:45.051 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.049+0000 7f767a6a19c0 20 add_watcher() i=2 2024-09-12T00:19:45.052 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.049+0000 7f767a6a19c0 20 add_watcher() i=3 2024-09-12T00:19:45.052 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.049+0000 7f767a6a19c0 20 add_watcher() i=4 2024-09-12T00:19:45.052 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.049+0000 7f767a6a19c0 20 add_watcher() i=5 2024-09-12T00:19:45.052 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.049+0000 7f767a6a19c0 20 add_watcher() i=6 2024-09-12T00:19:45.052 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.049+0000 7f767a6a19c0 20 add_watcher() i=7 2024-09-12T00:19:45.052 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.049+0000 7f767a6a19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:45.054 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.053+0000 7f752efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:45.055 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.053+0000 7f767a6a19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:45.055 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.053+0000 7f767a6a19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:45.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.053+0000 7f767a6a19c0 5 note: GC not initialized 2024-09-12T00:19:45.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.053+0000 7f767a6a19c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:45.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.053+0000 7f752dfdb640 20 reqs_thread_entry: start 2024-09-12T00:19:45.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.053+0000 7f767a6a19c0 20 Filter name: none 2024-09-12T00:19:45.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.053+0000 7f749f7fe640 20 reqs_thread_entry: start 2024-09-12T00:19:45.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.053+0000 7f767a6a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:45.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.053+0000 7f767a6a19c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:19:45.057 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.053+0000 7f767a6a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:45.057 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.053+0000 7f767a6a19c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:19:45.057 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.053+0000 7f767a6a19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:45.057 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.053+0000 7f767a6a19c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:19:45.057 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.053+0000 7f767a6a19c0 20 INFO: main: starting shard=0 2024-09-12T00:19:45.058 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.053+0000 7f767a6a19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.0 2024-09-12T00:19:45.058 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.053+0000 7f767a6a19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:45.058 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.053+0000 7f767a6a19c0 20 INFO: main: starting shard=1 2024-09-12T00:19:45.058 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.053+0000 7f767a6a19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:45.058 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.057+0000 7f767a6a19c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:19:45.058 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.057+0000 7f767a6a19c0 20 INFO: main: starting shard=2 2024-09-12T00:19:45.059 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.057+0000 7f767a6a19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.2 2024-09-12T00:19:45.059 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.057+0000 7f767a6a19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:45.059 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.057+0000 7f767a6a19c0 20 INFO: main: starting shard=3 2024-09-12T00:19:45.059 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.057+0000 7f767a6a19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.3 2024-09-12T00:19:45.060 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.057+0000 7f767a6a19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:45.060 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.057+0000 7f767a6a19c0 20 INFO: main: starting shard=4 2024-09-12T00:19:45.060 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.057+0000 7f767a6a19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.4 2024-09-12T00:19:45.061 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.057+0000 7f767a6a19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:45.061 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.057+0000 7f767a6a19c0 20 INFO: main: starting shard=5 2024-09-12T00:19:45.061 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.057+0000 7f767a6a19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:45.062 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.061+0000 7f767a6a19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:45.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.061+0000 7f767a6a19c0 20 INFO: main: starting shard=6 2024-09-12T00:19:45.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.061+0000 7f767a6a19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.6 2024-09-12T00:19:45.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.061+0000 7f767a6a19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:45.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.061+0000 7f767a6a19c0 20 INFO: main: starting shard=7 2024-09-12T00:19:45.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.061+0000 7f767a6a19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.7 2024-09-12T00:19:45.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.061+0000 7f767a6a19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:45.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.061+0000 7f767a6a19c0 20 INFO: main: starting shard=8 2024-09-12T00:19:45.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.061+0000 7f767a6a19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:45.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.061+0000 7f767a6a19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:45.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.061+0000 7f767a6a19c0 20 INFO: main: starting shard=9 2024-09-12T00:19:45.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.061+0000 7f767a6a19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.9 2024-09-12T00:19:45.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.061+0000 7f767a6a19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:45.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.061+0000 7f767a6a19c0 20 INFO: main: starting shard=10 2024-09-12T00:19:45.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.061+0000 7f767a6a19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:45.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.065+0000 7f767a6a19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:45.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.065+0000 7f767a6a19c0 20 INFO: main: done 2024-09-12T00:19:45.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.065+0000 7f752efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:45.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.069+0000 7f767a6a19c0 20 remove_watcher() i=0 2024-09-12T00:19:45.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.069+0000 7f767a6a19c0 2 removed watcher, disabling cache 2024-09-12T00:19:45.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.069+0000 7f767a6a19c0 20 remove_watcher() i=1 2024-09-12T00:19:45.076 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.073+0000 7f767a6a19c0 20 remove_watcher() i=2 2024-09-12T00:19:45.078 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.077+0000 7f767a6a19c0 20 remove_watcher() i=3 2024-09-12T00:19:45.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.077+0000 7f767a6a19c0 20 remove_watcher() i=4 2024-09-12T00:19:45.081 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.077+0000 7f767a6a19c0 20 remove_watcher() i=5 2024-09-12T00:19:45.083 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.081+0000 7f767a6a19c0 20 remove_watcher() i=6 2024-09-12T00:19:45.084 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.081+0000 7f767a6a19c0 20 remove_watcher() i=7 2024-09-12T00:19:45.100 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:45.100 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:45.104 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:45.104 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:45.159 INFO:tasks.workunit.client.0.smithi043.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:19:45.159 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T00:19:45.195 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:45.196 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:45.241 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.237+0000 7f30e211d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:45.243 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.241+0000 7f30e211d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:45.243 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.241+0000 7f30e211d9c0 20 realm 2024-09-12T00:19:45.243 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.241+0000 7f30e211d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:45.243 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.241+0000 7f30e211d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:45.243 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.241+0000 7f30e211d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:45.244 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.241+0000 7f30e211d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:45.244 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.241+0000 7f30e211d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:45.244 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.241+0000 7f30e211d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:45.245 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.241+0000 7f30e211d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:45.245 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.241+0000 7f30e211d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:45.246 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.241+0000 7f30e211d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:45.246 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.241+0000 7f30e211d9c0 20 searching for the correct realm 2024-09-12T00:19:45.249 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.245+0000 7f30df422640 0 -- 172.21.15.43:0/2695487651 >> [v2:172.21.15.43:6816/653473197,v1:172.21.15.43:6817/653473197] conn(0x55ac76d6dcc0 msgr2=0x55ac76d700b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:45.255 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.253+0000 7f30dfc23640 0 -- 172.21.15.43:0/2695487651 >> [v2:172.21.15.97:6816/489545787,v1:172.21.15.97:6817/489545787] conn(0x7f30d80bb070 msgr2=0x7f30d81226d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:45.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.261+0000 7f30e211d9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:19:45.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.261+0000 7f30e211d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:45.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.261+0000 7f30e211d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:45.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.261+0000 7f30e211d9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:19:45.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.261+0000 7f30e211d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:45.266 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.261+0000 7f30e211d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:45.266 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.261+0000 7f30e211d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:45.266 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.261+0000 7f30e211d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:45.266 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.261+0000 7f30e211d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:45.266 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.265+0000 7f30e211d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:45.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.265+0000 7f30e211d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:45.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.265+0000 7f30e211d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:45.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.265+0000 7f30e211d9c0 20 zone default found 2024-09-12T00:19:45.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.265+0000 7f30e211d9c0 4 Realm: () 2024-09-12T00:19:45.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.265+0000 7f30e211d9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:19:45.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.265+0000 7f30e211d9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:19:45.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.265+0000 7f30e211d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:45.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.265+0000 7f30e211d9c0 20 zonegroup default 2024-09-12T00:19:45.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.265+0000 7f30e211d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:45.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.265+0000 7f30e211d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:45.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.265+0000 7f30e211d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:45.268 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.265+0000 7f30e211d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:45.268 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.265+0000 7f30e211d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:45.268 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.265+0000 7f30e211d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:45.268 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.265+0000 7f30e211d9c0 20 started sync module instance, tier type = 2024-09-12T00:19:45.268 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.265+0000 7f30e211d9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:19:45.285 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.281+0000 7f30e211d9c0 20 add_watcher() i=0 2024-09-12T00:19:45.286 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.281+0000 7f30e211d9c0 20 add_watcher() i=1 2024-09-12T00:19:45.286 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.281+0000 7f30e211d9c0 20 add_watcher() i=2 2024-09-12T00:19:45.286 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.281+0000 7f30e211d9c0 20 add_watcher() i=3 2024-09-12T00:19:45.286 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.281+0000 7f30e211d9c0 20 add_watcher() i=4 2024-09-12T00:19:45.286 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.281+0000 7f30e211d9c0 20 add_watcher() i=5 2024-09-12T00:19:45.286 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.281+0000 7f30e211d9c0 20 add_watcher() i=6 2024-09-12T00:19:45.286 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.285+0000 7f30e211d9c0 20 add_watcher() i=7 2024-09-12T00:19:45.286 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.285+0000 7f30e211d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:45.290 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.285+0000 7f2f95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:45.290 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.285+0000 7f30e211d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:45.290 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.285+0000 7f30e211d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:45.291 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.285+0000 7f30e211d9c0 5 note: GC not initialized 2024-09-12T00:19:45.291 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.289+0000 7f2f94fe1640 20 reqs_thread_entry: start 2024-09-12T00:19:45.291 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.289+0000 7f30e211d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:45.291 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.289+0000 7f30e211d9c0 20 Filter name: none 2024-09-12T00:19:45.291 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.289+0000 7f2f0e7fc640 20 reqs_thread_entry: start 2024-09-12T00:19:45.291 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.289+0000 7f30e211d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:45.292 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.289+0000 7f30e211d9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:19:45.292 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.289+0000 7f30e211d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:45.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.289+0000 7f30e211d9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:19:45.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.289+0000 7f30e211d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:45.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.289+0000 7f30e211d9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:19:45.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.289+0000 7f30e211d9c0 20 INFO: main: starting shard=0 2024-09-12T00:19:45.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.289+0000 7f30e211d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.0 2024-09-12T00:19:45.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.289+0000 7f30e211d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:45.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.289+0000 7f30e211d9c0 20 INFO: main: starting shard=1 2024-09-12T00:19:45.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.289+0000 7f30e211d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:45.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.289+0000 7f30e211d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:45.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.289+0000 7f30e211d9c0 20 INFO: main: starting shard=2 2024-09-12T00:19:45.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.289+0000 7f30e211d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.2 2024-09-12T00:19:45.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.289+0000 7f30e211d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:45.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.289+0000 7f30e211d9c0 20 INFO: main: starting shard=3 2024-09-12T00:19:45.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.289+0000 7f30e211d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.3 2024-09-12T00:19:45.295 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.293+0000 7f30e211d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:45.295 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.293+0000 7f30e211d9c0 20 INFO: main: starting shard=4 2024-09-12T00:19:45.295 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.293+0000 7f30e211d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.4 2024-09-12T00:19:45.296 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.293+0000 7f30e211d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:45.296 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.293+0000 7f30e211d9c0 20 INFO: main: starting shard=5 2024-09-12T00:19:45.296 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.293+0000 7f30e211d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:45.297 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.293+0000 7f30e211d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:45.297 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.293+0000 7f30e211d9c0 20 INFO: main: starting shard=6 2024-09-12T00:19:45.298 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.293+0000 7f30e211d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.6 2024-09-12T00:19:45.298 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.293+0000 7f30e211d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:45.298 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.293+0000 7f30e211d9c0 20 INFO: main: starting shard=7 2024-09-12T00:19:45.298 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.293+0000 7f30e211d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.7 2024-09-12T00:19:45.299 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.297+0000 7f30e211d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:45.299 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.297+0000 7f30e211d9c0 20 INFO: main: starting shard=8 2024-09-12T00:19:45.299 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.297+0000 7f30e211d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:45.299 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.297+0000 7f30e211d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:45.300 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.297+0000 7f30e211d9c0 20 INFO: main: starting shard=9 2024-09-12T00:19:45.300 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.297+0000 7f30e211d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.9 2024-09-12T00:19:45.300 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.297+0000 7f30e211d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:45.300 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.297+0000 7f30e211d9c0 20 INFO: main: starting shard=10 2024-09-12T00:19:45.300 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.297+0000 7f30e211d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:45.301 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.297+0000 7f30e211d9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:19:45.301 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.297+0000 7f30e211d9c0 20 INFO: main: done 2024-09-12T00:19:45.302 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.301+0000 7f2f95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:45.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.305+0000 7f30e211d9c0 20 remove_watcher() i=0 2024-09-12T00:19:45.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.305+0000 7f30e211d9c0 2 removed watcher, disabling cache 2024-09-12T00:19:45.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.305+0000 7f30e211d9c0 20 remove_watcher() i=1 2024-09-12T00:19:45.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.309+0000 7f30e211d9c0 20 remove_watcher() i=2 2024-09-12T00:19:45.314 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.313+0000 7f30e211d9c0 20 remove_watcher() i=3 2024-09-12T00:19:45.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.313+0000 7f30e211d9c0 20 remove_watcher() i=4 2024-09-12T00:19:45.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.317+0000 7f30e211d9c0 20 remove_watcher() i=5 2024-09-12T00:19:45.320 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.317+0000 7f30e211d9c0 20 remove_watcher() i=6 2024-09-12T00:19:45.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:45.317+0000 7f30e211d9c0 20 remove_watcher() i=7 2024-09-12T00:19:45.338 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:45.338 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:45.341 INFO:tasks.workunit.client.0.smithi043.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:19:45.778 INFO:tasks.workunit.client.0.smithi043.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:19:46.212 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-12T00:19:46.212 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:19:46.212 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:19:46.247 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:46.247 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:46.286 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.285+0000 7f08230089c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:46.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.285+0000 7f08230089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:46.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.285+0000 7f08230089c0 20 realm 2024-09-12T00:19:46.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.285+0000 7f08230089c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:46.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.285+0000 7f08230089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:46.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.285+0000 7f08230089c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:46.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.285+0000 7f08230089c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:46.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.285+0000 7f08230089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:46.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.285+0000 7f08230089c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:46.289 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.285+0000 7f08230089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:46.289 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.285+0000 7f08230089c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:46.290 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.289+0000 7f08230089c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:46.290 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.289+0000 7f08230089c0 20 searching for the correct realm 2024-09-12T00:19:46.297 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.293+0000 7f082130f640 0 -- 172.21.15.43:0/1832209446 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f081400a050 msgr2=0x7f081409a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:19:46.512 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.509+0000 7f0820b0e640 0 -- 172.21.15.43:0/1832209446 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x5590f6f94fe0 msgr2=0x5590f6f974a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:46.519 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.517+0000 7f08230089c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:19:46.519 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.517+0000 7f08230089c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:46.519 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.517+0000 7f08230089c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:46.519 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.517+0000 7f08230089c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:19:46.519 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.517+0000 7f08230089c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:46.519 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.517+0000 7f08230089c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:46.520 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.517+0000 7f08230089c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:46.520 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.517+0000 7f08230089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:46.520 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.517+0000 7f08230089c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:46.520 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.517+0000 7f08230089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:46.520 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.517+0000 7f08230089c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:46.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.517+0000 7f08230089c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:46.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.517+0000 7f08230089c0 20 zone default found 2024-09-12T00:19:46.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.517+0000 7f08230089c0 4 Realm: () 2024-09-12T00:19:46.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.517+0000 7f08230089c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:19:46.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.517+0000 7f08230089c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:19:46.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.517+0000 7f08230089c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:46.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.517+0000 7f08230089c0 20 zonegroup default 2024-09-12T00:19:46.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.517+0000 7f08230089c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:46.522 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.517+0000 7f08230089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:46.522 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.517+0000 7f08230089c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:46.522 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.521+0000 7f08230089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:46.522 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.521+0000 7f08230089c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:46.523 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.521+0000 7f08230089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:46.523 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.521+0000 7f08230089c0 20 started sync module instance, tier type = 2024-09-12T00:19:46.523 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.521+0000 7f08230089c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:19:46.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.545+0000 7f08230089c0 20 add_watcher() i=0 2024-09-12T00:19:46.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.545+0000 7f08230089c0 20 add_watcher() i=1 2024-09-12T00:19:46.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.545+0000 7f08230089c0 20 add_watcher() i=2 2024-09-12T00:19:46.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.545+0000 7f08230089c0 20 add_watcher() i=3 2024-09-12T00:19:46.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.545+0000 7f08230089c0 20 add_watcher() i=4 2024-09-12T00:19:46.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.545+0000 7f08230089c0 20 add_watcher() i=5 2024-09-12T00:19:46.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.545+0000 7f08230089c0 20 add_watcher() i=6 2024-09-12T00:19:46.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.545+0000 7f08230089c0 20 add_watcher() i=7 2024-09-12T00:19:46.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.545+0000 7f08230089c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:46.553 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.549+0000 7f06d6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:46.554 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.553+0000 7f08230089c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:46.554 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.553+0000 7f08230089c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:46.554 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.553+0000 7f08230089c0 5 note: GC not initialized 2024-09-12T00:19:46.555 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.553+0000 7f06d5fe3640 20 reqs_thread_entry: start 2024-09-12T00:19:46.556 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.553+0000 7f08230089c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:46.556 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.553+0000 7f08230089c0 20 Filter name: none 2024-09-12T00:19:46.556 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.553+0000 7f06477fe640 20 reqs_thread_entry: start 2024-09-12T00:19:46.556 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.553+0000 7f08230089c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:19:46.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.553+0000 7f08230089c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:46.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.553+0000 7f08230089c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:19:46.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.553+0000 7f08230089c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:19:46.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.553+0000 7f08230089c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:19:46.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.553+0000 7f08230089c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 : miss 2024-09-12T00:19:46.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.553+0000 7f08230089c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:46.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.553+0000 7f08230089c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:19:46.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.553+0000 7f08230089c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 info.flags=0x17 2024-09-12T00:19:46.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.553+0000 7f08230089c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 to cache LRU end 2024-09-12T00:19:46.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.553+0000 7f08230089c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:46.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.553+0000 7f08230089c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:19:46.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.553+0000 7f08230089c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 2024-09-12T00:19:46.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.553+0000 7f08230089c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.0 2024-09-12T00:19:46.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.557+0000 7f08230089c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:19:46.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.557+0000 7f08230089c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:46.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.557+0000 7f08230089c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.2 2024-09-12T00:19:46.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.557+0000 7f08230089c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:19:46.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.557+0000 7f08230089c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.3 2024-09-12T00:19:46.561 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.557+0000 7f08230089c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:19:46.561 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.557+0000 7f08230089c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.4 2024-09-12T00:19:46.562 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.561+0000 7f08230089c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:19:46.563 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.561+0000 7f08230089c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:46.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.561+0000 7f08230089c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.6 2024-09-12T00:19:46.565 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.561+0000 7f08230089c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:19:46.565 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.561+0000 7f08230089c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.7 2024-09-12T00:19:46.566 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.565+0000 7f08230089c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:19:46.566 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.565+0000 7f08230089c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:46.567 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.565+0000 7f08230089c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.9 2024-09-12T00:19:46.568 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.565+0000 7f08230089c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:19:46.568 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.565+0000 7f08230089c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:46.569 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.565+0000 7f08230089c0 1 NOTICE: finished shard 1 (1 entries found) 2024-09-12T00:19:46.569 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.565+0000 7f08230089c0 1 NOTICE: finished shard 5 (1 entries found) 2024-09-12T00:19:46.569 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.565+0000 7f08230089c0 1 NOTICE: finished shard 8 (1 entries found) 2024-09-12T00:19:46.569 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.565+0000 7f08230089c0 1 NOTICE: finished shard 10 (1 entries found) 2024-09-12T00:19:46.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.565+0000 7f08230089c0 1 NOTICE: finished all shards (4 entries found) 2024-09-12T00:19:46.571 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.569+0000 7f06d6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:46.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.573+0000 7f08230089c0 20 remove_watcher() i=0 2024-09-12T00:19:46.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.573+0000 7f08230089c0 2 removed watcher, disabling cache 2024-09-12T00:19:46.578 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.577+0000 7f08230089c0 20 remove_watcher() i=1 2024-09-12T00:19:46.581 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.577+0000 7f08230089c0 20 remove_watcher() i=2 2024-09-12T00:19:46.583 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.581+0000 7f08230089c0 20 remove_watcher() i=3 2024-09-12T00:19:46.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.581+0000 7f08230089c0 20 remove_watcher() i=4 2024-09-12T00:19:46.587 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.585+0000 7f08230089c0 20 remove_watcher() i=5 2024-09-12T00:19:46.589 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.585+0000 7f08230089c0 20 remove_watcher() i=6 2024-09-12T00:19:46.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.589+0000 7f08230089c0 20 remove_watcher() i=7 2024-09-12T00:19:46.606 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: unlinked entries are not listable 2024-09-12T00:19:46.606 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:19:46.609 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:46.609 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:46.615 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-12T00:19:46.615 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:19:46.618 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:46.619 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:46.665 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:46.665 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:46.711 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-12T00:19:46.711 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:19:46.711 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:19:46.753 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:46.753 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:46.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.793+0000 7f42b65279c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:46.799 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.797+0000 7f42b65279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:46.799 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.797+0000 7f42b65279c0 20 realm 2024-09-12T00:19:46.799 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.797+0000 7f42b65279c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:46.799 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.797+0000 7f42b65279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:46.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.797+0000 7f42b65279c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:46.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.797+0000 7f42b65279c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:46.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.797+0000 7f42b65279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:46.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.797+0000 7f42b65279c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:46.801 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.797+0000 7f42b65279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:46.801 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.797+0000 7f42b65279c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:46.802 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.797+0000 7f42b65279c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:46.802 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.797+0000 7f42b65279c0 20 searching for the correct realm 2024-09-12T00:19:46.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:46.805+0000 7f42b482e640 0 -- 172.21.15.43:0/3627509559 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f42a80651a0 msgr2=0x7f42a806caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:47.024 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.021+0000 7f42b402d640 0 -- 172.21.15.43:0/3627509559 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x55ea90c53080 msgr2=0x55ea90c55470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:47.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.029+0000 7f42b65279c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:19:47.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.029+0000 7f42b65279c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:47.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.029+0000 7f42b65279c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:47.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.029+0000 7f42b65279c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:19:47.034 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.029+0000 7f42b65279c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:47.034 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.029+0000 7f42b65279c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:47.034 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.029+0000 7f42b65279c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.034 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.029+0000 7f42b65279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:47.035 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.029+0000 7f42b65279c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.035 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.033+0000 7f42b65279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:47.035 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.033+0000 7f42b65279c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.033+0000 7f42b65279c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:47.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.033+0000 7f42b65279c0 20 zone default found 2024-09-12T00:19:47.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.033+0000 7f42b65279c0 4 Realm: () 2024-09-12T00:19:47.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.033+0000 7f42b65279c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:19:47.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.033+0000 7f42b65279c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:19:47.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.033+0000 7f42b65279c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:47.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.033+0000 7f42b65279c0 20 zonegroup default 2024-09-12T00:19:47.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.033+0000 7f42b65279c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.037 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.033+0000 7f42b65279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:47.037 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.033+0000 7f42b65279c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.038 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.033+0000 7f42b65279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:47.038 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.033+0000 7f42b65279c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.038 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.037+0000 7f42b65279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:47.038 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.037+0000 7f42b65279c0 20 started sync module instance, tier type = 2024-09-12T00:19:47.038 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.037+0000 7f42b65279c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:19:47.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.061+0000 7f42b65279c0 20 add_watcher() i=0 2024-09-12T00:19:47.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.061+0000 7f42b65279c0 20 add_watcher() i=1 2024-09-12T00:19:47.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.061+0000 7f42b65279c0 20 add_watcher() i=2 2024-09-12T00:19:47.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.061+0000 7f42b65279c0 20 add_watcher() i=3 2024-09-12T00:19:47.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.061+0000 7f42b65279c0 20 add_watcher() i=4 2024-09-12T00:19:47.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.061+0000 7f42b65279c0 20 add_watcher() i=5 2024-09-12T00:19:47.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.061+0000 7f42b65279c0 20 add_watcher() i=6 2024-09-12T00:19:47.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.065+0000 7f42b65279c0 20 add_watcher() i=7 2024-09-12T00:19:47.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.065+0000 7f42b65279c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:47.071 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.069+0000 7f416b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:47.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.069+0000 7f42b65279c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:47.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.069+0000 7f42b65279c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:47.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.069+0000 7f42b65279c0 5 note: GC not initialized 2024-09-12T00:19:47.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.069+0000 7f416a7dc640 20 reqs_thread_entry: start 2024-09-12T00:19:47.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.069+0000 7f42b65279c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:47.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.069+0000 7f42b65279c0 20 Filter name: none 2024-09-12T00:19:47.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.069+0000 7f41637fe640 20 reqs_thread_entry: start 2024-09-12T00:19:47.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.069+0000 7f42b65279c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:19:47.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.069+0000 7f42b65279c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.069+0000 7f42b65279c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:19:47.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.069+0000 7f42b65279c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:19:47.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.069+0000 7f42b65279c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:19:47.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.069+0000 7f42b65279c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 : miss 2024-09-12T00:19:47.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.069+0000 7f42b65279c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.075 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.073+0000 7f42b65279c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:19:47.075 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.073+0000 7f42b65279c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 info.flags=0x17 2024-09-12T00:19:47.075 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.073+0000 7f42b65279c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 to cache LRU end 2024-09-12T00:19:47.076 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.073+0000 7f42b65279c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:47.076 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.073+0000 7f42b65279c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:19:47.076 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.073+0000 7f42b65279c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 2024-09-12T00:19:47.076 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.073+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.0 2024-09-12T00:19:47.076 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.073+0000 7f42b65279c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T00:19:47.076 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.073+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:47.077 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.073+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.2 2024-09-12T00:19:47.078 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.073+0000 7f42b65279c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T00:19:47.078 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.073+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.3 2024-09-12T00:19:47.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.077+0000 7f42b65279c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T00:19:47.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.077+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.4 2024-09-12T00:19:47.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.077+0000 7f42b65279c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T00:19:47.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.077+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:47.082 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.077+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.6 2024-09-12T00:19:47.082 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.081+0000 7f42b65279c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T00:19:47.082 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.081+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.7 2024-09-12T00:19:47.083 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.081+0000 7f42b65279c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T00:19:47.084 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.081+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:47.084 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.081+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.9 2024-09-12T00:19:47.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.081+0000 7f42b65279c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T00:19:47.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.081+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:47.086 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.081+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:47.086 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.085+0000 7f42b65279c0 20 get_obj_state: octx=0x55ea9092d7e0 obj=check-bucket:e state=0x55ea90c8e6e8 s->prefetch_data=0 2024-09-12T00:19:47.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.085+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:47.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.085+0000 7f42b65279c0 20 get_obj_state: octx=0x55ea909ef540 obj=check-bucket:d state=0x55ea90c87268 s->prefetch_data=0 2024-09-12T00:19:47.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.085+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:47.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.085+0000 7f42b65279c0 20 get_obj_state: octx=0x55ea90c91bf0 obj=check-bucket:c state=0x55ea90c8a978 s->prefetch_data=0 2024-09-12T00:19:47.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.085+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:47.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.085+0000 7f42b65279c0 20 get_obj_state: octx=0x55ea90c8bcb0 obj=check-bucket:f state=0x55ea90c88018 s->prefetch_data=0 2024-09-12T00:19:47.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.085+0000 7f42b65279c0 20 get_obj_state: setting s->obj_tag to hev94t8mqlkwbos3gsnlrchez25pbmy5 2024-09-12T00:19:47.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.085+0000 7f42b65279c0 20 get_obj_state_impl: setting s->olh_tag to 4r690ge0thh4zful401es2tfnhttmdyc 2024-09-12T00:19:47.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.085+0000 7f42b65279c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4r690ge0thh4zful401es2tfnhttmdyc 2024-09-12T00:19:47.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.085+0000 7f42b65279c0 20 get_obj_state: setting s->obj_tag to q28bipevc8vehqupuszhrubonzqmt4t2 2024-09-12T00:19:47.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.085+0000 7f42b65279c0 20 get_obj_state_impl: setting s->olh_tag to 415306o6nup0v9z5anso98wz5e6zsgpn 2024-09-12T00:19:47.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.085+0000 7f42b65279c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=415306o6nup0v9z5anso98wz5e6zsgpn 2024-09-12T00:19:47.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.085+0000 7f42b65279c0 20 get_obj_state: setting s->obj_tag to istmuc11b63xrk0sq6z1nam36ms7nve7 2024-09-12T00:19:47.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.085+0000 7f42b65279c0 20 get_obj_state_impl: setting s->olh_tag to 4n4yz4hkni3e3yjc8cqtal67sfoxn33d 2024-09-12T00:19:47.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.085+0000 7f42b65279c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4n4yz4hkni3e3yjc8cqtal67sfoxn33d 2024-09-12T00:19:47.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.089+0000 7f42b65279c0 20 get_obj_state: setting s->obj_tag to zncw7ywszuvq94ilqvyx17brgbi28gqu 2024-09-12T00:19:47.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.089+0000 7f42b65279c0 20 get_obj_state_impl: setting s->olh_tag to k0tujzdb6irg4059wmq93iuurymz8ded 2024-09-12T00:19:47.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.089+0000 7f42b65279c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=k0tujzdb6irg4059wmq93iuurymz8ded 2024-09-12T00:19:47.092 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.089+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:47.094 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.089+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:47.095 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.093+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:47.095 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.093+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:47.095 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.093+0000 7f42b65279c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T00:19:47.095 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.093+0000 7f42b65279c0 20 olh_log_entry: epoch=2 op=3 key=e[vWwD02S720kiIyZrV1H4vyRDTHXnges] 2024-09-12T00:19:47.095 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.093+0000 7f42b65279c0 20 get_obj_state: octx=0x55ea9092d7e0 obj=check-bucket:_:vWwD02S720kiIyZrV1H4vyRDTHXnges_e state=0x55ea90d239a8 s->prefetch_data=0 2024-09-12T00:19:47.095 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.093+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:47.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.093+0000 7f42b65279c0 10 manifest: total_size = 12 2024-09-12T00:19:47.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.093+0000 7f42b65279c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13673223649504628959 2024-09-12T00:19:47.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.093+0000 7f42b65279c0 20 get_obj_state: octx=0x55ea9092d7e0 obj=check-bucket:_:vWwD02S720kiIyZrV1H4vyRDTHXnges_e state=0x55ea90d239a8 s->prefetch_data=0 2024-09-12T00:19:47.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.093+0000 7f42b65279c0 20 prepare_atomic_modification: state is not atomic. state=0x55ea90d239a8 2024-09-12T00:19:47.099 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.093+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:47.099 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.093+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:47.099 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.093+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:47.099 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.097+0000 7f42b65279c0 20 olh_log_entry: epoch=3 op=3 key=c[hyhQT5gdjWttoHh4kij0ZHZi4oJIsCO] 2024-09-12T00:19:47.099 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.097+0000 7f42b65279c0 20 get_obj_state: octx=0x55ea90c91bf0 obj=check-bucket:_:hyhQT5gdjWttoHh4kij0ZHZi4oJIsCO_c state=0x55ea90d3b8a8 s->prefetch_data=0 2024-09-12T00:19:47.099 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.097+0000 7f42b65279c0 20 olh_log_entry: epoch=3 op=3 key=d[.EdjjAeP-iZ1ImWIh.nzuvNRkFb6A7L] 2024-09-12T00:19:47.099 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.097+0000 7f42b65279c0 20 get_obj_state: octx=0x55ea909ef540 obj=check-bucket:_:.EdjjAeP-iZ1ImWIh.nzuvNRkFb6A7L_d state=0x55ea90d41b68 s->prefetch_data=0 2024-09-12T00:19:47.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.097+0000 7f42b65279c0 10 manifest: total_size = 11 2024-09-12T00:19:47.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.097+0000 7f42b65279c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17898044567379436604 2024-09-12T00:19:47.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.097+0000 7f42b65279c0 20 get_obj_state: octx=0x55ea90c91bf0 obj=check-bucket:_:hyhQT5gdjWttoHh4kij0ZHZi4oJIsCO_c state=0x55ea90d3b8a8 s->prefetch_data=0 2024-09-12T00:19:47.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.097+0000 7f42b65279c0 20 prepare_atomic_modification: state is not atomic. state=0x55ea90d3b8a8 2024-09-12T00:19:47.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.097+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:47.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.097+0000 7f42b65279c0 10 manifest: total_size = 22 2024-09-12T00:19:47.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.097+0000 7f42b65279c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2505826550424839756 2024-09-12T00:19:47.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.097+0000 7f42b65279c0 20 get_obj_state: octx=0x55ea909ef540 obj=check-bucket:_:.EdjjAeP-iZ1ImWIh.nzuvNRkFb6A7L_d state=0x55ea90d41b68 s->prefetch_data=0 2024-09-12T00:19:47.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.097+0000 7f42b65279c0 20 prepare_atomic_modification: state is not atomic. state=0x55ea90d41b68 2024-09-12T00:19:47.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.097+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:47.102 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.097+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:47.102 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.097+0000 7f42b65279c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T00:19:47.102 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.097+0000 7f42b65279c0 20 olh_log_entry: epoch=2 op=3 key=f[XQ0F-hMxbTI6a8C-iBS2uEXrFtEjVfV] 2024-09-12T00:19:47.102 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.097+0000 7f42b65279c0 20 get_obj_state: octx=0x55ea90c8bcb0 obj=check-bucket:_:XQ0F-hMxbTI6a8C-iBS2uEXrFtEjVfV_f state=0x55ea90d4d6f8 s->prefetch_data=0 2024-09-12T00:19:47.103 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.101+0000 7f42b65279c0 10 manifest: total_size = 22 2024-09-12T00:19:47.103 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.101+0000 7f42b65279c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8386962886054086519 2024-09-12T00:19:47.103 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.101+0000 7f42b65279c0 20 get_obj_state: octx=0x55ea90c8bcb0 obj=check-bucket:_:XQ0F-hMxbTI6a8C-iBS2uEXrFtEjVfV_f state=0x55ea90d4d6f8 s->prefetch_data=0 2024-09-12T00:19:47.103 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.101+0000 7f42b65279c0 20 prepare_atomic_modification: state is not atomic. state=0x55ea90d4d6f8 2024-09-12T00:19:47.103 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.101+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:47.103 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.101+0000 7f42b65279c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:19:47.103 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.101+0000 7f42b65279c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T00:19:47.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.101+0000 7f42b65279c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:19:47.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.101+0000 7f42b65279c0 5 delete_objs_inline: removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1__shadow:vWwD02S720kiIyZrV1H4vyRDTHXnges_.o3iNgOq4mVviutJKRPAoJAVTNB96S23_0 2024-09-12T00:19:47.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.101+0000 7f418affd640 20 handle_completion(): completion ok for obj=e[vWwD02S720kiIyZrV1H4vyRDTHXnges] 2024-09-12T00:19:47.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.101+0000 7f42b65279c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:19:47.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.101+0000 7f42b65279c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T00:19:47.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.101+0000 7f42b65279c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:19:47.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.101+0000 7f42b65279c0 5 delete_objs_inline: removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1__shadow:hyhQT5gdjWttoHh4kij0ZHZi4oJIsCO_.TLMgSKFiiobjRkIXYOtfce0dnVoYJlg_0 2024-09-12T00:19:47.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.105+0000 7f42b65279c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:19:47.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.105+0000 7f42b65279c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:19:47.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.105+0000 7f42b65279c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:19:47.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.105+0000 7f42b65279c0 5 delete_objs_inline: removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1__shadow:XQ0F-hMxbTI6a8C-iBS2uEXrFtEjVfV_.4aCnuiNR5J3KAbHZLLXO2aMMa0xW3V2_0 2024-09-12T00:19:47.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.105+0000 7f42b65279c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:19:47.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.105+0000 7f42b65279c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:19:47.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.105+0000 7f42b65279c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:19:47.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.105+0000 7f42b65279c0 5 delete_objs_inline: removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1__shadow:.EdjjAeP-iZ1ImWIh.nzuvNRkFb6A7L_.wJCNDWV6QR9vHuuxXpuCaeoTOSUdGBY_0 2024-09-12T00:19:47.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.105+0000 7f418affd640 20 handle_completion(): completion ok for obj=c[hyhQT5gdjWttoHh4kij0ZHZi4oJIsCO] 2024-09-12T00:19:47.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.105+0000 7f42b65279c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:19:47.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.105+0000 7f42b65279c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:19:47.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.109+0000 7f418b7fe640 20 handle_completion(): completion ok for obj=f[XQ0F-hMxbTI6a8C-iBS2uEXrFtEjVfV] 2024-09-12T00:19:47.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.109+0000 7f418affd640 20 handle_completion(): completion ok for obj=d[.EdjjAeP-iZ1ImWIh.nzuvNRkFb6A7L] 2024-09-12T00:19:47.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.109+0000 7f42b65279c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:19:47.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.109+0000 7f42b65279c0 20 get_obj_state: octx=0x55ea90c8bcb0 obj=check-bucket:f state=0x55ea90c88018 s->prefetch_data=0 2024-09-12T00:19:47.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.109+0000 7f42b65279c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=k0tujzdb6irg4059wmq93iuurymz8ded 2024-09-12T00:19:47.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.109+0000 7f42b65279c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:19:47.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.109+0000 7f42b65279c0 20 get_obj_state: octx=0x55ea9092d7e0 obj=check-bucket:e state=0x55ea90c8e6e8 s->prefetch_data=0 2024-09-12T00:19:47.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.109+0000 7f42b65279c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4r690ge0thh4zful401es2tfnhttmdyc 2024-09-12T00:19:47.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.113+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:47.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.113+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:47.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.113+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:47.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.113+0000 7f42b65279c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T00:19:47.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.113+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:47.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.113+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:47.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.117+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:47.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.117+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:47.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.117+0000 7f42b65279c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T00:19:47.121 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.117+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:47.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.121+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:47.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.121+0000 7f42b65279c0 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-12T00:19:47.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.121+0000 7f42b65279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:47.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.121+0000 7f42b65279c0 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-12T00:19:47.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.121+0000 7f42b65279c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T00:19:47.124 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.121+0000 7f416b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:47.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.125+0000 7f42b65279c0 20 remove_watcher() i=0 2024-09-12T00:19:47.130 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.125+0000 7f42b65279c0 2 removed watcher, disabling cache 2024-09-12T00:19:47.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.129+0000 7f42b65279c0 20 remove_watcher() i=1 2024-09-12T00:19:47.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.133+0000 7f42b65279c0 20 remove_watcher() i=2 2024-09-12T00:19:47.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.133+0000 7f42b65279c0 20 remove_watcher() i=3 2024-09-12T00:19:47.139 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.137+0000 7f42b65279c0 20 remove_watcher() i=4 2024-09-12T00:19:47.141 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.137+0000 7f42b65279c0 20 remove_watcher() i=5 2024-09-12T00:19:47.142 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.141+0000 7f42b65279c0 20 remove_watcher() i=6 2024-09-12T00:19:47.144 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.141+0000 7f42b65279c0 20 remove_watcher() i=7 2024-09-12T00:19:47.163 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:47.163 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:47.168 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:47.168 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:47.172 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:47.172 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:47.175 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:47.175 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:47.177 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-12T00:19:47.177 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:19:47.178 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:47.178 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:47.227 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:47.227 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:47.235 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:47.235 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:47.243 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:47.243 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:47.250 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:47.250 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:47.255 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-12T00:19:47.255 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:19:47.255 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:19:47.295 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:47.295 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:47.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.337+0000 7f7fd51ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.343 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.341+0000 7f7fd51ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:47.343 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.341+0000 7f7fd51ef9c0 20 realm 2024-09-12T00:19:47.343 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.341+0000 7f7fd51ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.341+0000 7f7fd51ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:47.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.341+0000 7f7fd51ef9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:47.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.341+0000 7f7fd51ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.341+0000 7f7fd51ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:47.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.341+0000 7f7fd51ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.345 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.341+0000 7f7fd51ef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:47.345 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.341+0000 7f7fd51ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.341+0000 7f7fd51ef9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:47.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.341+0000 7f7fd51ef9c0 20 searching for the correct realm 2024-09-12T00:19:47.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.349+0000 7f7fd24f4640 0 -- 172.21.15.43:0/1594171040 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f7fbc0df070 msgr2=0x7f7fbc0e1460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:47.358 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.357+0000 7f7fd24f4640 0 -- 172.21.15.43:0/1594171040 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f7e9c07e040 msgr2=0x7f7e9c080470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:47.365 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.361+0000 7f7fd51ef9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:19:47.365 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.361+0000 7f7fd51ef9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:47.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.361+0000 7f7fd51ef9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:47.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.361+0000 7f7fd51ef9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:19:47.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.361+0000 7f7fd51ef9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:47.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.361+0000 7f7fd51ef9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:47.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.361+0000 7f7fd51ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.361+0000 7f7fd51ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:47.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.361+0000 7f7fd51ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.365+0000 7f7fd51ef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:47.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.365+0000 7f7fd51ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.365+0000 7f7fd51ef9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:47.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.365+0000 7f7fd51ef9c0 20 zone default found 2024-09-12T00:19:47.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.365+0000 7f7fd51ef9c0 4 Realm: () 2024-09-12T00:19:47.368 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.365+0000 7f7fd51ef9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:19:47.368 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.365+0000 7f7fd51ef9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:19:47.368 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.365+0000 7f7fd51ef9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:47.368 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.365+0000 7f7fd51ef9c0 20 zonegroup default 2024-09-12T00:19:47.368 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.365+0000 7f7fd51ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.368 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.365+0000 7f7fd51ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:47.368 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.365+0000 7f7fd51ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.369 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.365+0000 7f7fd51ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:47.369 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.365+0000 7f7fd51ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.369 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.365+0000 7f7fd51ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:47.369 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.365+0000 7f7fd51ef9c0 20 started sync module instance, tier type = 2024-09-12T00:19:47.369 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.365+0000 7f7fd51ef9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:19:47.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.381+0000 7f7fd51ef9c0 20 add_watcher() i=0 2024-09-12T00:19:47.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.381+0000 7f7fd51ef9c0 20 add_watcher() i=1 2024-09-12T00:19:47.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.381+0000 7f7fd51ef9c0 20 add_watcher() i=2 2024-09-12T00:19:47.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.381+0000 7f7fd51ef9c0 20 add_watcher() i=3 2024-09-12T00:19:47.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.381+0000 7f7fd51ef9c0 20 add_watcher() i=4 2024-09-12T00:19:47.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.381+0000 7f7fd51ef9c0 20 add_watcher() i=5 2024-09-12T00:19:47.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.381+0000 7f7fd51ef9c0 20 add_watcher() i=6 2024-09-12T00:19:47.387 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.385+0000 7f7fd51ef9c0 20 add_watcher() i=7 2024-09-12T00:19:47.387 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.385+0000 7f7fd51ef9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:47.389 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.385+0000 7f7e897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:47.390 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.385+0000 7f7fd51ef9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:47.390 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.385+0000 7f7fd51ef9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:47.390 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.385+0000 7f7fd51ef9c0 5 note: GC not initialized 2024-09-12T00:19:47.391 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.389+0000 7f7e03fff640 20 reqs_thread_entry: start 2024-09-12T00:19:47.391 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.389+0000 7f7fd51ef9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:47.391 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.389+0000 7f7fd51ef9c0 20 Filter name: none 2024-09-12T00:19:47.391 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.389+0000 7f7e01ffb640 20 reqs_thread_entry: start 2024-09-12T00:19:47.391 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.389+0000 7f7fd51ef9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:19:47.391 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.389+0000 7f7fd51ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.391 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.389+0000 7f7fd51ef9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:19:47.392 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.389+0000 7f7fd51ef9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:19:47.392 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.389+0000 7f7fd51ef9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:19:47.392 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.389+0000 7f7fd51ef9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 : miss 2024-09-12T00:19:47.392 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.389+0000 7f7fd51ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.393 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.389+0000 7f7fd51ef9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:19:47.393 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.389+0000 7f7fd51ef9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 info.flags=0x17 2024-09-12T00:19:47.393 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.389+0000 7f7fd51ef9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 to cache LRU end 2024-09-12T00:19:47.393 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.389+0000 7f7fd51ef9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:47.393 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.389+0000 7f7fd51ef9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:19:47.393 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.389+0000 7f7fd51ef9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 2024-09-12T00:19:47.393 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.389+0000 7f7fd51ef9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.0 2024-09-12T00:19:47.393 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.389+0000 7f7fd51ef9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:19:47.393 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.389+0000 7f7fd51ef9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:47.394 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.389+0000 7f7fd51ef9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T00:19:47.394 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.389+0000 7f7fd51ef9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.2 2024-09-12T00:19:47.394 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.389+0000 7f7fd51ef9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:19:47.394 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.389+0000 7f7fd51ef9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.3 2024-09-12T00:19:47.395 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.393+0000 7f7fd51ef9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:19:47.395 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.393+0000 7f7fd51ef9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.4 2024-09-12T00:19:47.396 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.393+0000 7f7fd51ef9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:19:47.396 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.393+0000 7f7fd51ef9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:47.397 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.393+0000 7f7fd51ef9c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T00:19:47.397 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.393+0000 7f7fd51ef9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.6 2024-09-12T00:19:47.398 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.397+0000 7f7fd51ef9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:19:47.398 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.397+0000 7f7fd51ef9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.7 2024-09-12T00:19:47.399 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.397+0000 7f7fd51ef9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:19:47.399 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.397+0000 7f7fd51ef9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:47.400 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.397+0000 7f7fd51ef9c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T00:19:47.400 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.397+0000 7f7fd51ef9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.9 2024-09-12T00:19:47.400 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.397+0000 7f7fd51ef9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:19:47.400 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.397+0000 7f7fd51ef9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:47.401 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.397+0000 7f7fd51ef9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T00:19:47.401 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.397+0000 7f7fd51ef9c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:19:47.402 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.401+0000 7f7e897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:47.407 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.405+0000 7f7fd51ef9c0 20 remove_watcher() i=0 2024-09-12T00:19:47.407 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.405+0000 7f7fd51ef9c0 2 removed watcher, disabling cache 2024-09-12T00:19:47.409 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.405+0000 7f7fd51ef9c0 20 remove_watcher() i=1 2024-09-12T00:19:47.411 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.409+0000 7f7fd51ef9c0 20 remove_watcher() i=2 2024-09-12T00:19:47.414 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.409+0000 7f7fd51ef9c0 20 remove_watcher() i=3 2024-09-12T00:19:47.415 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.413+0000 7f7fd51ef9c0 20 remove_watcher() i=4 2024-09-12T00:19:47.417 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.413+0000 7f7fd51ef9c0 20 remove_watcher() i=5 2024-09-12T00:19:47.418 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.417+0000 7f7fd51ef9c0 20 remove_watcher() i=6 2024-09-12T00:19:47.420 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.417+0000 7f7fd51ef9c0 20 remove_watcher() i=7 2024-09-12T00:19:47.436 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:47.436 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:47.463 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:47.463 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:47.486 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:19:47.516 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:47.516 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:47.561 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.557+0000 7f7b09cbe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.561+0000 7f7b09cbe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:47.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.561+0000 7f7b09cbe9c0 20 realm 2024-09-12T00:19:47.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.561+0000 7f7b09cbe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.561+0000 7f7b09cbe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:47.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.561+0000 7f7b09cbe9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:47.565 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.561+0000 7f7b09cbe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.565 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.561+0000 7f7b09cbe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:47.565 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.561+0000 7f7b09cbe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.566 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.561+0000 7f7b09cbe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:47.566 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.561+0000 7f7b09cbe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.567 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.565+0000 7f7b09cbe9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:47.567 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.565+0000 7f7b09cbe9c0 20 searching for the correct realm 2024-09-12T00:19:47.572 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.569+0000 7f7b07fc5640 0 -- 172.21.15.43:0/2698017503 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55aba56a4270 msgr2=0x55aba56a6660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:47.578 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.577+0000 7f7b077c4640 0 -- 172.21.15.43:0/2698017503 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f7afc10ab40 msgr2=0x7f7afc1325d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:47.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.581+0000 7f7b09cbe9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:19:47.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.581+0000 7f7b09cbe9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:47.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.581+0000 7f7b09cbe9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:47.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.581+0000 7f7b09cbe9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:19:47.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.581+0000 7f7b09cbe9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:47.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.581+0000 7f7b09cbe9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:47.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.581+0000 7f7b09cbe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.581+0000 7f7b09cbe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:47.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.581+0000 7f7b09cbe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.587 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.585+0000 7f7b09cbe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:47.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.585+0000 7f7b09cbe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.585+0000 7f7b09cbe9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:47.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.585+0000 7f7b09cbe9c0 20 zone default found 2024-09-12T00:19:47.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.585+0000 7f7b09cbe9c0 4 Realm: () 2024-09-12T00:19:47.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.585+0000 7f7b09cbe9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:19:47.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.585+0000 7f7b09cbe9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:19:47.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.585+0000 7f7b09cbe9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:47.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.585+0000 7f7b09cbe9c0 20 zonegroup default 2024-09-12T00:19:47.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.585+0000 7f7b09cbe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.585+0000 7f7b09cbe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:47.589 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.585+0000 7f7b09cbe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.589 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.585+0000 7f7b09cbe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:47.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.585+0000 7f7b09cbe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.585+0000 7f7b09cbe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:47.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.585+0000 7f7b09cbe9c0 20 started sync module instance, tier type = 2024-09-12T00:19:47.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.585+0000 7f7b09cbe9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:19:47.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.601+0000 7f7b09cbe9c0 20 add_watcher() i=0 2024-09-12T00:19:47.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.601+0000 7f7b09cbe9c0 20 add_watcher() i=1 2024-09-12T00:19:47.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.601+0000 7f7b09cbe9c0 20 add_watcher() i=2 2024-09-12T00:19:47.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.601+0000 7f7b09cbe9c0 20 add_watcher() i=3 2024-09-12T00:19:47.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.601+0000 7f7b09cbe9c0 20 add_watcher() i=4 2024-09-12T00:19:47.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.601+0000 7f7b09cbe9c0 20 add_watcher() i=5 2024-09-12T00:19:47.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.601+0000 7f7b09cbe9c0 20 add_watcher() i=6 2024-09-12T00:19:47.606 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.605+0000 7f7b09cbe9c0 20 add_watcher() i=7 2024-09-12T00:19:47.606 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.605+0000 7f7b09cbe9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:47.609 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.605+0000 7f79bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:47.610 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.605+0000 7f7b09cbe9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:47.610 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.605+0000 7f7b09cbe9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:47.610 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.605+0000 7f7b09cbe9c0 5 note: GC not initialized 2024-09-12T00:19:47.610 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.605+0000 7f79bcfe1640 20 reqs_thread_entry: start 2024-09-12T00:19:47.610 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.605+0000 7f7b09cbe9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:47.610 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.605+0000 7f7b09cbe9c0 20 Filter name: none 2024-09-12T00:19:47.610 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.605+0000 7f79367fc640 20 reqs_thread_entry: start 2024-09-12T00:19:47.610 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.605+0000 7f7b09cbe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.611 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.609+0000 7f7b09cbe9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:19:47.611 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.609+0000 7f7b09cbe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.612 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.609+0000 7f7b09cbe9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:19:47.612 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.609+0000 7f7b09cbe9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:47.612 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.609+0000 7f7b09cbe9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:19:47.612 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.609+0000 7f7b09cbe9c0 20 INFO: main: starting shard=0 2024-09-12T00:19:47.612 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.609+0000 7f7b09cbe9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.0 2024-09-12T00:19:47.612 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.609+0000 7f7b09cbe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:47.612 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.609+0000 7f7b09cbe9c0 20 INFO: main: starting shard=1 2024-09-12T00:19:47.612 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.609+0000 7f7b09cbe9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:47.613 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.609+0000 7f7b09cbe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:47.613 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.609+0000 7f7b09cbe9c0 20 INFO: main: starting shard=2 2024-09-12T00:19:47.613 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.609+0000 7f7b09cbe9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.2 2024-09-12T00:19:47.613 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.609+0000 7f7b09cbe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:47.613 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.609+0000 7f7b09cbe9c0 20 INFO: main: starting shard=3 2024-09-12T00:19:47.613 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.609+0000 7f7b09cbe9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.3 2024-09-12T00:19:47.614 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.613+0000 7f7b09cbe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:47.614 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.613+0000 7f7b09cbe9c0 20 INFO: main: starting shard=4 2024-09-12T00:19:47.614 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.613+0000 7f7b09cbe9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.4 2024-09-12T00:19:47.615 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.613+0000 7f7b09cbe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:47.615 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.613+0000 7f7b09cbe9c0 20 INFO: main: starting shard=5 2024-09-12T00:19:47.615 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.613+0000 7f7b09cbe9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:47.616 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.613+0000 7f7b09cbe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:47.617 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.613+0000 7f7b09cbe9c0 20 INFO: main: starting shard=6 2024-09-12T00:19:47.617 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.613+0000 7f7b09cbe9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.6 2024-09-12T00:19:47.617 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.613+0000 7f7b09cbe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:47.617 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.613+0000 7f7b09cbe9c0 20 INFO: main: starting shard=7 2024-09-12T00:19:47.617 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.613+0000 7f7b09cbe9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.7 2024-09-12T00:19:47.618 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.617+0000 7f7b09cbe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:47.618 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.617+0000 7f7b09cbe9c0 20 INFO: main: starting shard=8 2024-09-12T00:19:47.618 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.617+0000 7f7b09cbe9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:47.619 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.617+0000 7f7b09cbe9c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T00:19:47.619 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.617+0000 7f7b09cbe9c0 20 INFO: main: starting shard=9 2024-09-12T00:19:47.619 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.617+0000 7f7b09cbe9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.9 2024-09-12T00:19:47.620 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.617+0000 7f7b09cbe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:47.620 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.617+0000 7f7b09cbe9c0 20 INFO: main: starting shard=10 2024-09-12T00:19:47.620 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.617+0000 7f7b09cbe9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:47.620 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.617+0000 7f7b09cbe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:47.620 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.617+0000 7f7b09cbe9c0 20 INFO: main: done 2024-09-12T00:19:47.621 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.617+0000 7f79bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:47.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.625+0000 7f7b09cbe9c0 20 remove_watcher() i=0 2024-09-12T00:19:47.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.625+0000 7f7b09cbe9c0 2 removed watcher, disabling cache 2024-09-12T00:19:47.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.625+0000 7f7b09cbe9c0 20 remove_watcher() i=1 2024-09-12T00:19:47.630 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.629+0000 7f7b09cbe9c0 20 remove_watcher() i=2 2024-09-12T00:19:47.632 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.629+0000 7f7b09cbe9c0 20 remove_watcher() i=3 2024-09-12T00:19:47.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.633+0000 7f7b09cbe9c0 20 remove_watcher() i=4 2024-09-12T00:19:47.636 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.633+0000 7f7b09cbe9c0 20 remove_watcher() i=5 2024-09-12T00:19:47.637 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.633+0000 7f7b09cbe9c0 20 remove_watcher() i=6 2024-09-12T00:19:47.638 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.637+0000 7f7b09cbe9c0 20 remove_watcher() i=7 2024-09-12T00:19:47.654 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:19:47.688 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:47.688 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:47.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.729+0000 7f9c2d4a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.733 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.729+0000 7f9c2d4a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:47.733 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.729+0000 7f9c2d4a39c0 20 realm 2024-09-12T00:19:47.733 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.729+0000 7f9c2d4a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.729+0000 7f9c2d4a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:47.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.729+0000 7f9c2d4a39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:47.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.729+0000 7f9c2d4a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.729+0000 7f9c2d4a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:47.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.729+0000 7f9c2d4a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.735 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.733+0000 7f9c2d4a39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:47.735 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.733+0000 7f9c2d4a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.736 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.733+0000 7f9c2d4a39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:47.736 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.733+0000 7f9c2d4a39c0 20 searching for the correct realm 2024-09-12T00:19:47.742 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.741+0000 7f9c2b7aa640 0 -- 172.21.15.43:0/2944453115 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f9c1403ad00 msgr2=0x7f9c14051820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:47.960 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.957+0000 7f9c2afa9640 0 -- 172.21.15.43:0/2944453115 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x55e313f6a220 msgr2=0x55e313f6c610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:47.967 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.965+0000 7f9c2d4a39c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:19:47.968 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.965+0000 7f9c2d4a39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:47.968 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.965+0000 7f9c2d4a39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:47.968 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.965+0000 7f9c2d4a39c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:19:47.968 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.965+0000 7f9c2d4a39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:47.968 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.965+0000 7f9c2d4a39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:47.968 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.965+0000 7f9c2d4a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.968 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.965+0000 7f9c2d4a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:47.969 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.965+0000 7f9c2d4a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.969 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.965+0000 7f9c2d4a39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:47.969 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.965+0000 7f9c2d4a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.969+0000 7f9c2d4a39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:47.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.969+0000 7f9c2d4a39c0 20 zone default found 2024-09-12T00:19:47.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.969+0000 7f9c2d4a39c0 4 Realm: () 2024-09-12T00:19:47.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.969+0000 7f9c2d4a39c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:19:47.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.969+0000 7f9c2d4a39c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:19:47.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.969+0000 7f9c2d4a39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:47.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.969+0000 7f9c2d4a39c0 20 zonegroup default 2024-09-12T00:19:47.971 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.969+0000 7f9c2d4a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.971 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.969+0000 7f9c2d4a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:47.971 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.969+0000 7f9c2d4a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.971 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.969+0000 7f9c2d4a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:47.971 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.969+0000 7f9c2d4a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:47.972 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.969+0000 7f9c2d4a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:47.972 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.969+0000 7f9c2d4a39c0 20 started sync module instance, tier type = 2024-09-12T00:19:47.972 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.969+0000 7f9c2d4a39c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:19:47.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.993+0000 7f9c2d4a39c0 20 add_watcher() i=0 2024-09-12T00:19:47.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.993+0000 7f9c2d4a39c0 20 add_watcher() i=1 2024-09-12T00:19:47.998 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.993+0000 7f9c2d4a39c0 20 add_watcher() i=2 2024-09-12T00:19:47.998 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.993+0000 7f9c2d4a39c0 20 add_watcher() i=3 2024-09-12T00:19:47.998 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.993+0000 7f9c2d4a39c0 20 add_watcher() i=4 2024-09-12T00:19:47.998 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.993+0000 7f9c2d4a39c0 20 add_watcher() i=5 2024-09-12T00:19:47.998 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.993+0000 7f9c2d4a39c0 20 add_watcher() i=6 2024-09-12T00:19:48.000 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.997+0000 7f9c2d4a39c0 20 add_watcher() i=7 2024-09-12T00:19:48.000 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:47.997+0000 7f9c2d4a39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:48.005 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.001+0000 7f9ae17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:48.006 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.001+0000 7f9c2d4a39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:48.006 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.001+0000 7f9c2d4a39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:48.006 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.001+0000 7f9c2d4a39c0 5 note: GC not initialized 2024-09-12T00:19:48.006 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.005+0000 7f9a5bfff640 20 reqs_thread_entry: start 2024-09-12T00:19:48.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.005+0000 7f9c2d4a39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:48.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.005+0000 7f9c2d4a39c0 20 Filter name: none 2024-09-12T00:19:48.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.005+0000 7f9a59ffb640 20 reqs_thread_entry: start 2024-09-12T00:19:48.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.005+0000 7f9c2d4a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.008 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.005+0000 7f9c2d4a39c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:19:48.008 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.005+0000 7f9c2d4a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.005+0000 7f9c2d4a39c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:19:48.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.005+0000 7f9c2d4a39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:48.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.005+0000 7f9c2d4a39c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:19:48.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.005+0000 7f9c2d4a39c0 20 INFO: main: starting shard=0 2024-09-12T00:19:48.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.005+0000 7f9c2d4a39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.0 2024-09-12T00:19:48.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.009+0000 7f9c2d4a39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:48.011 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.009+0000 7f9c2d4a39c0 20 INFO: main: starting shard=1 2024-09-12T00:19:48.011 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.009+0000 7f9c2d4a39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:48.011 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.009+0000 7f9c2d4a39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:48.011 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.009+0000 7f9c2d4a39c0 20 INFO: main: starting shard=2 2024-09-12T00:19:48.011 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.009+0000 7f9c2d4a39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.2 2024-09-12T00:19:48.012 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.009+0000 7f9c2d4a39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:48.012 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.009+0000 7f9c2d4a39c0 20 INFO: main: starting shard=3 2024-09-12T00:19:48.012 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.009+0000 7f9c2d4a39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.3 2024-09-12T00:19:48.013 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.009+0000 7f9c2d4a39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:48.013 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.009+0000 7f9c2d4a39c0 20 INFO: main: starting shard=4 2024-09-12T00:19:48.013 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.009+0000 7f9c2d4a39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.4 2024-09-12T00:19:48.015 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.013+0000 7f9c2d4a39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:48.015 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.013+0000 7f9c2d4a39c0 20 INFO: main: starting shard=5 2024-09-12T00:19:48.015 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.013+0000 7f9c2d4a39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:48.017 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.013+0000 7f9c2d4a39c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T00:19:48.017 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.013+0000 7f9c2d4a39c0 20 INFO: main: starting shard=6 2024-09-12T00:19:48.017 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.013+0000 7f9c2d4a39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.6 2024-09-12T00:19:48.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.013+0000 7f9c2d4a39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:48.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.017+0000 7f9c2d4a39c0 20 INFO: main: starting shard=7 2024-09-12T00:19:48.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.017+0000 7f9c2d4a39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.7 2024-09-12T00:19:48.019 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.017+0000 7f9c2d4a39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:48.019 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.017+0000 7f9c2d4a39c0 20 INFO: main: starting shard=8 2024-09-12T00:19:48.019 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.017+0000 7f9c2d4a39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:48.020 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.017+0000 7f9c2d4a39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:48.020 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.017+0000 7f9c2d4a39c0 20 INFO: main: starting shard=9 2024-09-12T00:19:48.020 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.017+0000 7f9c2d4a39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.9 2024-09-12T00:19:48.021 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.017+0000 7f9c2d4a39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:48.021 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.017+0000 7f9c2d4a39c0 20 INFO: main: starting shard=10 2024-09-12T00:19:48.021 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.017+0000 7f9c2d4a39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:48.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.017+0000 7f9c2d4a39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:48.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.017+0000 7f9c2d4a39c0 20 INFO: main: done 2024-09-12T00:19:48.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.021+0000 7f9ae17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:48.028 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.025+0000 7f9c2d4a39c0 20 remove_watcher() i=0 2024-09-12T00:19:48.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.025+0000 7f9c2d4a39c0 2 removed watcher, disabling cache 2024-09-12T00:19:48.031 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.029+0000 7f9c2d4a39c0 20 remove_watcher() i=1 2024-09-12T00:19:48.034 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.029+0000 7f9c2d4a39c0 20 remove_watcher() i=2 2024-09-12T00:19:48.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.033+0000 7f9c2d4a39c0 20 remove_watcher() i=3 2024-09-12T00:19:48.039 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.037+0000 7f9c2d4a39c0 20 remove_watcher() i=4 2024-09-12T00:19:48.041 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.037+0000 7f9c2d4a39c0 20 remove_watcher() i=5 2024-09-12T00:19:48.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.041+0000 7f9c2d4a39c0 20 remove_watcher() i=6 2024-09-12T00:19:48.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.041+0000 7f9c2d4a39c0 20 remove_watcher() i=7 2024-09-12T00:19:48.059 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-12T00:19:48.059 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:19:48.059 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T00:19:48.094 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:48.094 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:48.140 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.137+0000 7f8fffc8b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.141 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.137+0000 7f8fffc8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:48.141 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.137+0000 7f8fffc8b9c0 20 realm 2024-09-12T00:19:48.142 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.137+0000 7f8fffc8b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.142 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.137+0000 7f8fffc8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:48.142 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.137+0000 7f8fffc8b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:48.142 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.137+0000 7f8fffc8b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.142 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.137+0000 7f8fffc8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:48.142 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.137+0000 7f8fffc8b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.143 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.141+0000 7f8fffc8b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:48.143 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.141+0000 7f8fffc8b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.144 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.141+0000 7f8fffc8b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:48.144 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.141+0000 7f8fffc8b9c0 20 searching for the correct realm 2024-09-12T00:19:48.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.145+0000 7f8ffdf92640 0 -- 172.21.15.43:0/1674542673 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55786bf75240 msgr2=0x55786bf77670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:48.156 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.153+0000 7f8ff4f90640 0 -- 172.21.15.43:0/1674542673 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f8fe803d060 msgr2=0x7f8fe80637f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:48.163 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.161+0000 7f8fffc8b9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:19:48.163 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.161+0000 7f8fffc8b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:48.163 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.161+0000 7f8fffc8b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:48.163 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.161+0000 7f8fffc8b9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:19:48.163 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.161+0000 7f8fffc8b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:48.163 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.161+0000 7f8fffc8b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:48.163 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.161+0000 7f8fffc8b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.164 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.161+0000 7f8fffc8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:48.164 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.161+0000 7f8fffc8b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.165 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.161+0000 7f8fffc8b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:48.165 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.161+0000 7f8fffc8b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.165 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.161+0000 7f8fffc8b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:48.165 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.161+0000 7f8fffc8b9c0 20 zone default found 2024-09-12T00:19:48.165 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.161+0000 7f8fffc8b9c0 4 Realm: () 2024-09-12T00:19:48.165 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.161+0000 7f8fffc8b9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:19:48.165 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.161+0000 7f8fffc8b9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:19:48.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.161+0000 7f8fffc8b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:48.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.161+0000 7f8fffc8b9c0 20 zonegroup default 2024-09-12T00:19:48.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.161+0000 7f8fffc8b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.161+0000 7f8fffc8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:48.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.161+0000 7f8fffc8b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.161+0000 7f8fffc8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:48.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.161+0000 7f8fffc8b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.161+0000 7f8fffc8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:48.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.161+0000 7f8fffc8b9c0 20 started sync module instance, tier type = 2024-09-12T00:19:48.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.161+0000 7f8fffc8b9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:19:48.181 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.177+0000 7f8fffc8b9c0 20 add_watcher() i=0 2024-09-12T00:19:48.181 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.177+0000 7f8fffc8b9c0 20 add_watcher() i=1 2024-09-12T00:19:48.181 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.177+0000 7f8fffc8b9c0 20 add_watcher() i=2 2024-09-12T00:19:48.181 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.177+0000 7f8fffc8b9c0 20 add_watcher() i=3 2024-09-12T00:19:48.181 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.177+0000 7f8fffc8b9c0 20 add_watcher() i=4 2024-09-12T00:19:48.182 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.177+0000 7f8fffc8b9c0 20 add_watcher() i=5 2024-09-12T00:19:48.182 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.177+0000 7f8fffc8b9c0 20 add_watcher() i=6 2024-09-12T00:19:48.182 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.181+0000 7f8fffc8b9c0 20 add_watcher() i=7 2024-09-12T00:19:48.182 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.181+0000 7f8fffc8b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:48.185 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.181+0000 7f8eb37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:48.186 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.181+0000 7f8fffc8b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:48.187 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.181+0000 7f8fffc8b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:48.187 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.181+0000 7f8fffc8b9c0 5 note: GC not initialized 2024-09-12T00:19:48.187 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.181+0000 7f8eb27e4640 20 reqs_thread_entry: start 2024-09-12T00:19:48.187 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.185+0000 7f8fffc8b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:48.187 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.185+0000 7f8fffc8b9c0 20 Filter name: none 2024-09-12T00:19:48.187 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.185+0000 7f8e23fff640 20 reqs_thread_entry: start 2024-09-12T00:19:48.187 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.185+0000 7f8fffc8b9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:19:48.187 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.185+0000 7f8fffc8b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.185+0000 7f8fffc8b9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:19:48.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.185+0000 7f8fffc8b9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:19:48.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.185+0000 7f8fffc8b9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:19:48.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.185+0000 7f8fffc8b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 : miss 2024-09-12T00:19:48.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.185+0000 7f8fffc8b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.185+0000 7f8fffc8b9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:19:48.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.185+0000 7f8fffc8b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 info.flags=0x17 2024-09-12T00:19:48.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.185+0000 7f8fffc8b9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 to cache LRU end 2024-09-12T00:19:48.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.185+0000 7f8fffc8b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:48.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.185+0000 7f8fffc8b9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:19:48.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.185+0000 7f8fffc8b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 2024-09-12T00:19:48.190 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.185+0000 7f8fffc8b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.0 2024-09-12T00:19:48.190 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.185+0000 7f8fffc8b9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:19:48.190 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.185+0000 7f8fffc8b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:48.190 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.185+0000 7f8fffc8b9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T00:19:48.190 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.185+0000 7f8fffc8b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.2 2024-09-12T00:19:48.190 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.185+0000 7f8fffc8b9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:19:48.190 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.185+0000 7f8fffc8b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.3 2024-09-12T00:19:48.191 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.189+0000 7f8fffc8b9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:19:48.191 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.189+0000 7f8fffc8b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.4 2024-09-12T00:19:48.193 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.189+0000 7f8fffc8b9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:19:48.193 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.189+0000 7f8fffc8b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:48.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.193+0000 7f8fffc8b9c0 1 NOTICE: finished shard 5 (1 entries found) 2024-09-12T00:19:48.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.193+0000 7f8fffc8b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.6 2024-09-12T00:19:48.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.193+0000 7f8fffc8b9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:19:48.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.193+0000 7f8fffc8b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.7 2024-09-12T00:19:48.196 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.193+0000 7f8fffc8b9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:19:48.196 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.193+0000 7f8fffc8b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:48.196 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.193+0000 7f8fffc8b9c0 1 NOTICE: finished shard 8 (1 entries found) 2024-09-12T00:19:48.197 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.193+0000 7f8fffc8b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.9 2024-09-12T00:19:48.197 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.193+0000 7f8fffc8b9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:19:48.197 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.193+0000 7f8fffc8b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:48.197 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.193+0000 7f8fffc8b9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T00:19:48.198 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.193+0000 7f8fffc8b9c0 1 NOTICE: finished all shards (2 entries found) 2024-09-12T00:19:48.199 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.197+0000 7f8eb37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:48.204 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.201+0000 7f8fffc8b9c0 20 remove_watcher() i=0 2024-09-12T00:19:48.204 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.201+0000 7f8fffc8b9c0 2 removed watcher, disabling cache 2024-09-12T00:19:48.206 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.205+0000 7f8fffc8b9c0 20 remove_watcher() i=1 2024-09-12T00:19:48.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.205+0000 7f8fffc8b9c0 20 remove_watcher() i=2 2024-09-12T00:19:48.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.209+0000 7f8fffc8b9c0 20 remove_watcher() i=3 2024-09-12T00:19:48.213 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.209+0000 7f8fffc8b9c0 20 remove_watcher() i=4 2024-09-12T00:19:48.214 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.213+0000 7f8fffc8b9c0 20 remove_watcher() i=5 2024-09-12T00:19:48.215 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.213+0000 7f8fffc8b9c0 20 remove_watcher() i=6 2024-09-12T00:19:48.217 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.213+0000 7f8fffc8b9c0 20 remove_watcher() i=7 2024-09-12T00:19:48.230 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-12T00:19:48.230 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:19:48.231 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:19:48.265 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:48.265 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:48.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.305+0000 7fba38bcc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.305+0000 7fba38bcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:48.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.305+0000 7fba38bcc9c0 20 realm 2024-09-12T00:19:48.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.305+0000 7fba38bcc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.305+0000 7fba38bcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:48.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.305+0000 7fba38bcc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:48.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.305+0000 7fba38bcc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.305+0000 7fba38bcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:48.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.305+0000 7fba38bcc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.309+0000 7fba38bcc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:48.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.309+0000 7fba38bcc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.309+0000 7fba38bcc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:48.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.309+0000 7fba38bcc9c0 20 searching for the correct realm 2024-09-12T00:19:48.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.313+0000 7fba36ed3640 0 -- 172.21.15.43:0/462130502 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x5566cf9a9440 msgr2=0x5566cf9ab900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:19:48.324 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.321+0000 7fba366d2640 0 -- 172.21.15.43:0/462130502 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fba20106ba0 msgr2=0x7fba20128a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:48.331 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.329+0000 7fba38bcc9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:19:48.332 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.329+0000 7fba38bcc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:48.332 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.329+0000 7fba38bcc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:48.332 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.329+0000 7fba38bcc9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:19:48.332 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.329+0000 7fba38bcc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:48.332 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.329+0000 7fba38bcc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:48.332 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.329+0000 7fba38bcc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.332 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.329+0000 7fba38bcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:48.332 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.329+0000 7fba38bcc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.333 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.329+0000 7fba38bcc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:48.333 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.329+0000 7fba38bcc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.333 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.329+0000 7fba38bcc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:48.333 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.329+0000 7fba38bcc9c0 20 zone default found 2024-09-12T00:19:48.333 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.329+0000 7fba38bcc9c0 4 Realm: () 2024-09-12T00:19:48.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.329+0000 7fba38bcc9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:19:48.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.329+0000 7fba38bcc9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:19:48.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.329+0000 7fba38bcc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:48.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.329+0000 7fba38bcc9c0 20 zonegroup default 2024-09-12T00:19:48.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.329+0000 7fba38bcc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.329+0000 7fba38bcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:48.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.329+0000 7fba38bcc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.335 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.333+0000 7fba38bcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:48.335 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.333+0000 7fba38bcc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.335 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.333+0000 7fba38bcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:48.335 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.333+0000 7fba38bcc9c0 20 started sync module instance, tier type = 2024-09-12T00:19:48.335 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.333+0000 7fba38bcc9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:19:48.351 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.349+0000 7fba38bcc9c0 20 add_watcher() i=0 2024-09-12T00:19:48.351 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.349+0000 7fba38bcc9c0 20 add_watcher() i=1 2024-09-12T00:19:48.351 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.349+0000 7fba38bcc9c0 20 add_watcher() i=2 2024-09-12T00:19:48.351 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.349+0000 7fba38bcc9c0 20 add_watcher() i=3 2024-09-12T00:19:48.351 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.349+0000 7fba38bcc9c0 20 add_watcher() i=4 2024-09-12T00:19:48.351 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.349+0000 7fba38bcc9c0 20 add_watcher() i=5 2024-09-12T00:19:48.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.349+0000 7fba38bcc9c0 20 add_watcher() i=6 2024-09-12T00:19:48.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.349+0000 7fba38bcc9c0 20 add_watcher() i=7 2024-09-12T00:19:48.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.349+0000 7fba38bcc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:48.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.353+0000 7fb8ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:48.358 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.353+0000 7fba38bcc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:48.359 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.353+0000 7fba38bcc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:48.359 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.353+0000 7fba38bcc9c0 5 note: GC not initialized 2024-09-12T00:19:48.359 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.353+0000 7fb8677fe640 20 reqs_thread_entry: start 2024-09-12T00:19:48.359 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.353+0000 7fba38bcc9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:48.359 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.353+0000 7fba38bcc9c0 20 Filter name: none 2024-09-12T00:19:48.359 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.353+0000 7fb8657fa640 20 reqs_thread_entry: start 2024-09-12T00:19:48.360 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.353+0000 7fba38bcc9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:19:48.360 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.353+0000 7fba38bcc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.360 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.353+0000 7fba38bcc9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:19:48.360 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.353+0000 7fba38bcc9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:19:48.360 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.353+0000 7fba38bcc9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:19:48.360 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.353+0000 7fba38bcc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 : miss 2024-09-12T00:19:48.361 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.353+0000 7fba38bcc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.361 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.353+0000 7fba38bcc9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:19:48.361 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.353+0000 7fba38bcc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 info.flags=0x17 2024-09-12T00:19:48.361 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.353+0000 7fba38bcc9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 to cache LRU end 2024-09-12T00:19:48.361 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.353+0000 7fba38bcc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:48.361 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.353+0000 7fba38bcc9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:19:48.361 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.353+0000 7fba38bcc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 2024-09-12T00:19:48.362 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.353+0000 7fba38bcc9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.0 2024-09-12T00:19:48.362 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.353+0000 7fba38bcc9c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T00:19:48.362 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.353+0000 7fba38bcc9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:48.362 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.353+0000 7fba38bcc9c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T00:19:48.362 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.353+0000 7fba38bcc9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.2 2024-09-12T00:19:48.363 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.357+0000 7fba38bcc9c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T00:19:48.363 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.357+0000 7fba38bcc9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.3 2024-09-12T00:19:48.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.357+0000 7fba38bcc9c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T00:19:48.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.357+0000 7fba38bcc9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.4 2024-09-12T00:19:48.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.357+0000 7fba38bcc9c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T00:19:48.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.357+0000 7fba38bcc9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:48.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.357+0000 7fba38bcc9c0 20 get_obj_state: octx=0x5566cf68a7e0 obj=check-bucket:d state=0x5566cf9eb768 s->prefetch_data=0 2024-09-12T00:19:48.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.357+0000 7fba38bcc9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.6 2024-09-12T00:19:48.368 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.361+0000 7fba38bcc9c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T00:19:48.368 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.361+0000 7fba38bcc9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.7 2024-09-12T00:19:48.368 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.361+0000 7fba38bcc9c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T00:19:48.368 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.361+0000 7fba38bcc9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:48.368 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.361+0000 7fba38bcc9c0 20 get_obj_state: octx=0x5566cf74c530 obj=check-bucket:c state=0x5566cf9e7498 s->prefetch_data=0 2024-09-12T00:19:48.369 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.361+0000 7fba38bcc9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.9 2024-09-12T00:19:48.369 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.361+0000 7fba38bcc9c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T00:19:48.369 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.361+0000 7fba38bcc9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:48.369 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.361+0000 7fba38bcc9c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T00:19:48.369 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.361+0000 7fba38bcc9c0 20 get_obj_state: setting s->obj_tag to q28bipevc8vehqupuszhrubonzqmt4t2 2024-09-12T00:19:48.369 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.361+0000 7fba38bcc9c0 20 get_obj_state_impl: setting s->olh_tag to 415306o6nup0v9z5anso98wz5e6zsgpn 2024-09-12T00:19:48.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.361+0000 7fba38bcc9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:48.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.361+0000 7fba38bcc9c0 20 get_obj_state: setting s->obj_tag to istmuc11b63xrk0sq6z1nam36ms7nve7 2024-09-12T00:19:48.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.361+0000 7fba38bcc9c0 20 get_obj_state_impl: setting s->olh_tag to 4n4yz4hkni3e3yjc8cqtal67sfoxn33d 2024-09-12T00:19:48.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.361+0000 7fba38bcc9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:48.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.361+0000 7fba38bcc9c0 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-12T00:19:48.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.361+0000 7fba38bcc9c0 20 olh_log_entry: epoch=4 op=3 key=c[cU6mMQ.1DDt19VUG5KAMbT2eamyx8C2] 2024-09-12T00:19:48.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.361+0000 7fba38bcc9c0 20 get_obj_state: octx=0x5566cfa33ca0 obj=check-bucket:_:cU6mMQ.1DDt19VUG5KAMbT2eamyx8C2_c state=0x5566cfa37788 s->prefetch_data=0 2024-09-12T00:19:48.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.361+0000 7fba38bcc9c0 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-12T00:19:48.371 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.361+0000 7fba38bcc9c0 20 olh_log_entry: epoch=4 op=3 key=d[O6YVeblqpbb6m0oO0K-LQt0ivkkO3Jl] 2024-09-12T00:19:48.371 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.361+0000 7fba38bcc9c0 20 get_obj_state: octx=0x5566cfa13ca0 obj=check-bucket:_:O6YVeblqpbb6m0oO0K-LQt0ivkkO3Jl_d state=0x5566cfa3dde8 s->prefetch_data=0 2024-09-12T00:19:48.372 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.365+0000 7fba38bcc9c0 20 get_obj_state: octx=0x5566cfa13ca0 obj=check-bucket:d state=0x5566cfa38d98 s->prefetch_data=0 2024-09-12T00:19:48.372 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.365+0000 7fba38bcc9c0 20 get_obj_state: setting s->obj_tag to q28bipevc8vehqupuszhrubonzqmt4t2 2024-09-12T00:19:48.372 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.365+0000 7fba38bcc9c0 20 get_obj_state_impl: setting s->olh_tag to 415306o6nup0v9z5anso98wz5e6zsgpn 2024-09-12T00:19:48.372 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.365+0000 7fba38bcc9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=415306o6nup0v9z5anso98wz5e6zsgpn 2024-09-12T00:19:48.373 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.365+0000 7fba38bcc9c0 20 get_obj_state: octx=0x5566cfa33ca0 obj=check-bucket:c state=0x5566cf9e28d8 s->prefetch_data=0 2024-09-12T00:19:48.373 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.365+0000 7fba38bcc9c0 20 get_obj_state: setting s->obj_tag to istmuc11b63xrk0sq6z1nam36ms7nve7 2024-09-12T00:19:48.373 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.365+0000 7fba38bcc9c0 20 get_obj_state_impl: setting s->olh_tag to 4n4yz4hkni3e3yjc8cqtal67sfoxn33d 2024-09-12T00:19:48.373 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.365+0000 7fba38bcc9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4n4yz4hkni3e3yjc8cqtal67sfoxn33d 2024-09-12T00:19:48.374 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.369+0000 7fba38bcc9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:48.374 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.369+0000 7fba38bcc9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:48.375 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.373+0000 7fba38bcc9c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T00:19:48.376 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.373+0000 7fba38bcc9c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T00:19:48.376 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.373+0000 7fba38bcc9c0 1 NOTICE: finished all shards (2 entries removed) 2024-09-12T00:19:48.376 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.373+0000 7fb8ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:48.381 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.377+0000 7fba38bcc9c0 20 remove_watcher() i=0 2024-09-12T00:19:48.381 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.377+0000 7fba38bcc9c0 2 removed watcher, disabling cache 2024-09-12T00:19:48.384 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.381+0000 7fba38bcc9c0 20 remove_watcher() i=1 2024-09-12T00:19:48.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.385+0000 7fba38bcc9c0 20 remove_watcher() i=2 2024-09-12T00:19:48.388 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.385+0000 7fba38bcc9c0 20 remove_watcher() i=3 2024-09-12T00:19:48.390 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.389+0000 7fba38bcc9c0 20 remove_watcher() i=4 2024-09-12T00:19:48.391 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.389+0000 7fba38bcc9c0 20 remove_watcher() i=5 2024-09-12T00:19:48.393 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.389+0000 7fba38bcc9c0 20 remove_watcher() i=6 2024-09-12T00:19:48.394 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.393+0000 7fba38bcc9c0 20 remove_watcher() i=7 2024-09-12T00:19:48.408 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:19:48.438 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:48.438 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:48.481 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.477+0000 7f74b22e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.483 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.481+0000 7f74b22e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:48.483 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.481+0000 7f74b22e09c0 20 realm 2024-09-12T00:19:48.483 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.481+0000 7f74b22e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.483 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.481+0000 7f74b22e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:48.483 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.481+0000 7f74b22e09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:48.483 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.481+0000 7f74b22e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.483 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.481+0000 7f74b22e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:48.483 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.481+0000 7f74b22e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.481+0000 7f74b22e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:48.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.481+0000 7f74b22e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.486 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.485+0000 7f74b22e09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:48.486 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.485+0000 7f74b22e09c0 20 searching for the correct realm 2024-09-12T00:19:48.493 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.489+0000 7f74af5e5640 0 -- 172.21.15.43:0/3868756288 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f74a40cf040 msgr2=0x7f74a40cf930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:48.499 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.497+0000 7f74b05e7640 0 -- 172.21.15.43:0/3868756288 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f74a40e2950 msgr2=0x7f74a40df410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:19:48.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.505+0000 7f74b22e09c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:19:48.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.505+0000 7f74b22e09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:48.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.505+0000 7f74b22e09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:48.507 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.505+0000 7f74b22e09c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:19:48.507 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.505+0000 7f74b22e09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:48.507 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.505+0000 7f74b22e09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:48.507 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.505+0000 7f74b22e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.507 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.505+0000 7f74b22e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:48.507 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.505+0000 7f74b22e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.508 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.505+0000 7f74b22e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:48.508 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.505+0000 7f74b22e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.508 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.505+0000 7f74b22e09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:48.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.505+0000 7f74b22e09c0 20 zone default found 2024-09-12T00:19:48.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.505+0000 7f74b22e09c0 4 Realm: () 2024-09-12T00:19:48.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.505+0000 7f74b22e09c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:19:48.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.505+0000 7f74b22e09c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:19:48.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.505+0000 7f74b22e09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:48.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.505+0000 7f74b22e09c0 20 zonegroup default 2024-09-12T00:19:48.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.505+0000 7f74b22e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.505+0000 7f74b22e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:48.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.505+0000 7f74b22e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.510 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.505+0000 7f74b22e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:48.510 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.505+0000 7f74b22e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.510 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.505+0000 7f74b22e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:48.510 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.505+0000 7f74b22e09c0 20 started sync module instance, tier type = 2024-09-12T00:19:48.510 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.505+0000 7f74b22e09c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:19:48.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.525+0000 7f74b22e09c0 20 add_watcher() i=0 2024-09-12T00:19:48.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.525+0000 7f74b22e09c0 20 add_watcher() i=1 2024-09-12T00:19:48.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.525+0000 7f74b22e09c0 20 add_watcher() i=2 2024-09-12T00:19:48.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.525+0000 7f74b22e09c0 20 add_watcher() i=3 2024-09-12T00:19:48.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.525+0000 7f74b22e09c0 20 add_watcher() i=4 2024-09-12T00:19:48.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.525+0000 7f74b22e09c0 20 add_watcher() i=5 2024-09-12T00:19:48.527 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.525+0000 7f74b22e09c0 20 add_watcher() i=6 2024-09-12T00:19:48.527 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.525+0000 7f74b22e09c0 20 add_watcher() i=7 2024-09-12T00:19:48.527 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.525+0000 7f74b22e09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:48.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.529+0000 7f7365fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:48.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.529+0000 7f74b22e09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:48.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.529+0000 7f74b22e09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:48.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.529+0000 7f74b22e09c0 5 note: GC not initialized 2024-09-12T00:19:48.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.529+0000 7f7364fe1640 20 reqs_thread_entry: start 2024-09-12T00:19:48.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.529+0000 7f74b22e09c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:48.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.529+0000 7f74b22e09c0 20 Filter name: none 2024-09-12T00:19:48.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.529+0000 7f72de7fc640 20 reqs_thread_entry: start 2024-09-12T00:19:48.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.529+0000 7f74b22e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.532 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.529+0000 7f74b22e09c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:19:48.532 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.529+0000 7f74b22e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.532 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.529+0000 7f74b22e09c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:19:48.532 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.529+0000 7f74b22e09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:48.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.529+0000 7f74b22e09c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:19:48.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.529+0000 7f74b22e09c0 20 INFO: main: starting shard=0 2024-09-12T00:19:48.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.529+0000 7f74b22e09c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.0 2024-09-12T00:19:48.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.529+0000 7f74b22e09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:48.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.529+0000 7f74b22e09c0 20 INFO: main: starting shard=1 2024-09-12T00:19:48.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.529+0000 7f74b22e09c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:48.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.529+0000 7f74b22e09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:48.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.529+0000 7f74b22e09c0 20 INFO: main: starting shard=2 2024-09-12T00:19:48.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.529+0000 7f74b22e09c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.2 2024-09-12T00:19:48.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.529+0000 7f74b22e09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:48.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.529+0000 7f74b22e09c0 20 INFO: main: starting shard=3 2024-09-12T00:19:48.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.529+0000 7f74b22e09c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.3 2024-09-12T00:19:48.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.533+0000 7f74b22e09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:48.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.533+0000 7f74b22e09c0 20 INFO: main: starting shard=4 2024-09-12T00:19:48.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.533+0000 7f74b22e09c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.4 2024-09-12T00:19:48.536 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.533+0000 7f74b22e09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:48.536 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.533+0000 7f74b22e09c0 20 INFO: main: starting shard=5 2024-09-12T00:19:48.536 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.533+0000 7f74b22e09c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:48.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.533+0000 7f74b22e09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:48.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.533+0000 7f74b22e09c0 20 INFO: main: starting shard=6 2024-09-12T00:19:48.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.533+0000 7f74b22e09c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.6 2024-09-12T00:19:48.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.537+0000 7f74b22e09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:48.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.537+0000 7f74b22e09c0 20 INFO: main: starting shard=7 2024-09-12T00:19:48.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.537+0000 7f74b22e09c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.7 2024-09-12T00:19:48.539 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.537+0000 7f74b22e09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:48.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.537+0000 7f74b22e09c0 20 INFO: main: starting shard=8 2024-09-12T00:19:48.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.537+0000 7f74b22e09c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:48.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.537+0000 7f74b22e09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:48.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.537+0000 7f74b22e09c0 20 INFO: main: starting shard=9 2024-09-12T00:19:48.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.537+0000 7f74b22e09c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.9 2024-09-12T00:19:48.541 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.537+0000 7f74b22e09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:48.541 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.537+0000 7f74b22e09c0 20 INFO: main: starting shard=10 2024-09-12T00:19:48.541 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.537+0000 7f74b22e09c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:48.541 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.537+0000 7f74b22e09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:48.541 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.537+0000 7f74b22e09c0 20 INFO: main: done 2024-09-12T00:19:48.542 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.541+0000 7f7365fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:48.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.545+0000 7f74b22e09c0 20 remove_watcher() i=0 2024-09-12T00:19:48.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.545+0000 7f74b22e09c0 2 removed watcher, disabling cache 2024-09-12T00:19:48.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.545+0000 7f74b22e09c0 20 remove_watcher() i=1 2024-09-12T00:19:48.551 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.549+0000 7f74b22e09c0 20 remove_watcher() i=2 2024-09-12T00:19:48.553 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.549+0000 7f74b22e09c0 20 remove_watcher() i=3 2024-09-12T00:19:48.556 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.553+0000 7f74b22e09c0 20 remove_watcher() i=4 2024-09-12T00:19:48.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.553+0000 7f74b22e09c0 20 remove_watcher() i=5 2024-09-12T00:19:48.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.557+0000 7f74b22e09c0 20 remove_watcher() i=6 2024-09-12T00:19:48.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.557+0000 7f74b22e09c0 20 remove_watcher() i=7 2024-09-12T00:19:48.574 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:19:48.603 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:48.603 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:48.645 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.641+0000 7fb73453b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.648 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.645+0000 7fb73453b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:48.648 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.645+0000 7fb73453b9c0 20 realm 2024-09-12T00:19:48.648 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.645+0000 7fb73453b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.648 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.645+0000 7fb73453b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:48.648 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.645+0000 7fb73453b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:48.648 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.645+0000 7fb73453b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.648 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.645+0000 7fb73453b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:48.648 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.645+0000 7fb73453b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.650 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.645+0000 7fb73453b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:48.650 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.645+0000 7fb73453b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:48.651 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.649+0000 7fb73453b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:48.651 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.649+0000 7fb73453b9c0 20 searching for the correct realm 2024-09-12T00:19:48.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.653+0000 7fb731840640 0 -- 172.21.15.43:0/2407439134 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fb7280cc430 msgr2=0x7fb7280cc870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:19:48.872 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:48.869+0000 7fb732041640 0 -- 172.21.15.43:0/2407439134 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fb7280c0400 msgr2=0x7fb7280c0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:49.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.085+0000 7fb73453b9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:19:49.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.085+0000 7fb73453b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:49.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.085+0000 7fb73453b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:49.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.085+0000 7fb73453b9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:19:49.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.085+0000 7fb73453b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:49.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.085+0000 7fb73453b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:49.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.085+0000 7fb73453b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.085+0000 7fb73453b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:49.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.085+0000 7fb73453b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.089+0000 7fb73453b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:49.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.089+0000 7fb73453b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.089+0000 7fb73453b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:49.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.089+0000 7fb73453b9c0 20 zone default found 2024-09-12T00:19:49.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.089+0000 7fb73453b9c0 4 Realm: () 2024-09-12T00:19:49.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.089+0000 7fb73453b9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:19:49.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.089+0000 7fb73453b9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:19:49.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.089+0000 7fb73453b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:49.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.089+0000 7fb73453b9c0 20 zonegroup default 2024-09-12T00:19:49.092 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.089+0000 7fb73453b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.092 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.089+0000 7fb73453b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:49.092 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.089+0000 7fb73453b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.092 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.089+0000 7fb73453b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:49.092 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.089+0000 7fb73453b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.093 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.089+0000 7fb73453b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:49.093 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.089+0000 7fb73453b9c0 20 started sync module instance, tier type = 2024-09-12T00:19:49.093 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.089+0000 7fb73453b9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:19:49.119 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.117+0000 7fb73453b9c0 20 add_watcher() i=0 2024-09-12T00:19:49.119 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.117+0000 7fb73453b9c0 20 add_watcher() i=1 2024-09-12T00:19:49.119 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.117+0000 7fb73453b9c0 20 add_watcher() i=2 2024-09-12T00:19:49.119 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.117+0000 7fb73453b9c0 20 add_watcher() i=3 2024-09-12T00:19:49.119 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.117+0000 7fb73453b9c0 20 add_watcher() i=4 2024-09-12T00:19:49.119 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.117+0000 7fb73453b9c0 20 add_watcher() i=5 2024-09-12T00:19:49.119 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.117+0000 7fb73453b9c0 20 add_watcher() i=6 2024-09-12T00:19:49.121 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.117+0000 7fb73453b9c0 20 add_watcher() i=7 2024-09-12T00:19:49.121 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.117+0000 7fb73453b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:49.125 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.121+0000 7fb5e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:49.126 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.125+0000 7fb73453b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:49.126 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.125+0000 7fb73453b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:49.127 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.125+0000 7fb73453b9c0 5 note: GC not initialized 2024-09-12T00:19:49.127 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.125+0000 7fb5637fe640 20 reqs_thread_entry: start 2024-09-12T00:19:49.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.125+0000 7fb73453b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:49.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.125+0000 7fb73453b9c0 20 Filter name: none 2024-09-12T00:19:49.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.125+0000 7fb5617fa640 20 reqs_thread_entry: start 2024-09-12T00:19:49.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.125+0000 7fb73453b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.125+0000 7fb73453b9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:19:49.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.125+0000 7fb73453b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.125+0000 7fb73453b9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:19:49.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.125+0000 7fb73453b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:49.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.125+0000 7fb73453b9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:19:49.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.125+0000 7fb73453b9c0 20 INFO: main: starting shard=0 2024-09-12T00:19:49.130 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.125+0000 7fb73453b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.0 2024-09-12T00:19:49.130 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.129+0000 7fb73453b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:49.130 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.129+0000 7fb73453b9c0 20 INFO: main: starting shard=1 2024-09-12T00:19:49.130 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.129+0000 7fb73453b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:49.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.129+0000 7fb73453b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:49.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.129+0000 7fb73453b9c0 20 INFO: main: starting shard=2 2024-09-12T00:19:49.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.129+0000 7fb73453b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.2 2024-09-12T00:19:49.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.129+0000 7fb73453b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:49.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.129+0000 7fb73453b9c0 20 INFO: main: starting shard=3 2024-09-12T00:19:49.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.129+0000 7fb73453b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.3 2024-09-12T00:19:49.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.129+0000 7fb73453b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:49.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.129+0000 7fb73453b9c0 20 INFO: main: starting shard=4 2024-09-12T00:19:49.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.129+0000 7fb73453b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.4 2024-09-12T00:19:49.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.129+0000 7fb73453b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:49.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.129+0000 7fb73453b9c0 20 INFO: main: starting shard=5 2024-09-12T00:19:49.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.129+0000 7fb73453b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:49.135 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.133+0000 7fb73453b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:49.135 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.133+0000 7fb73453b9c0 20 INFO: main: starting shard=6 2024-09-12T00:19:49.135 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.133+0000 7fb73453b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.6 2024-09-12T00:19:49.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.133+0000 7fb73453b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:49.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.133+0000 7fb73453b9c0 20 INFO: main: starting shard=7 2024-09-12T00:19:49.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.133+0000 7fb73453b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.7 2024-09-12T00:19:49.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.133+0000 7fb73453b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:49.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.133+0000 7fb73453b9c0 20 INFO: main: starting shard=8 2024-09-12T00:19:49.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.133+0000 7fb73453b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:49.138 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.133+0000 7fb73453b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:49.138 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.133+0000 7fb73453b9c0 20 INFO: main: starting shard=9 2024-09-12T00:19:49.139 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.133+0000 7fb73453b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.9 2024-09-12T00:19:49.139 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.137+0000 7fb73453b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:49.139 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.137+0000 7fb73453b9c0 20 INFO: main: starting shard=10 2024-09-12T00:19:49.139 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.137+0000 7fb73453b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:49.140 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.137+0000 7fb73453b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:49.140 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.137+0000 7fb73453b9c0 20 INFO: main: done 2024-09-12T00:19:49.141 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.137+0000 7fb5e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:49.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.141+0000 7fb73453b9c0 20 remove_watcher() i=0 2024-09-12T00:19:49.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.141+0000 7fb73453b9c0 2 removed watcher, disabling cache 2024-09-12T00:19:49.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.145+0000 7fb73453b9c0 20 remove_watcher() i=1 2024-09-12T00:19:49.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.149+0000 7fb73453b9c0 20 remove_watcher() i=2 2024-09-12T00:19:49.153 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.149+0000 7fb73453b9c0 20 remove_watcher() i=3 2024-09-12T00:19:49.155 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.153+0000 7fb73453b9c0 20 remove_watcher() i=4 2024-09-12T00:19:49.157 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.153+0000 7fb73453b9c0 20 remove_watcher() i=5 2024-09-12T00:19:49.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.157+0000 7fb73453b9c0 20 remove_watcher() i=6 2024-09-12T00:19:49.163 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.157+0000 7fb73453b9c0 20 remove_watcher() i=7 2024-09-12T00:19:49.176 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-12T00:19:49.176 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:19:49.177 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T00:19:49.211 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:49.211 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:49.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.253+0000 7fbde2bf59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.257+0000 7fbde2bf59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:49.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.257+0000 7fbde2bf59c0 20 realm 2024-09-12T00:19:49.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.257+0000 7fbde2bf59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.257+0000 7fbde2bf59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:49.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.257+0000 7fbde2bf59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:49.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.257+0000 7fbde2bf59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.257+0000 7fbde2bf59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:49.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.257+0000 7fbde2bf59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.257+0000 7fbde2bf59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:49.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.257+0000 7fbde2bf59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.257+0000 7fbde2bf59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:49.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.257+0000 7fbde2bf59c0 20 searching for the correct realm 2024-09-12T00:19:49.268 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.265+0000 7fbde0efc640 0 -- 172.21.15.43:0/4166357264 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7fbdd404cb10 msgr2=0x7fbdd404a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:19:49.484 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.481+0000 7fbde06fb640 0 -- 172.21.15.43:0/4166357264 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x55c7e1d0d200 msgr2=0x55c7e1d0f5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:49.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.489+0000 7fbde2bf59c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:19:49.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.489+0000 7fbde2bf59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:49.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.489+0000 7fbde2bf59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:49.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.489+0000 7fbde2bf59c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:19:49.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.489+0000 7fbde2bf59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:49.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.489+0000 7fbde2bf59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:49.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.489+0000 7fbde2bf59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.493 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.489+0000 7fbde2bf59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:49.493 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.489+0000 7fbde2bf59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.493 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.489+0000 7fbde2bf59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:49.493 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.489+0000 7fbde2bf59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.494 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.493+0000 7fbde2bf59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:49.494 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.493+0000 7fbde2bf59c0 20 zone default found 2024-09-12T00:19:49.494 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.493+0000 7fbde2bf59c0 4 Realm: () 2024-09-12T00:19:49.494 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.493+0000 7fbde2bf59c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:19:49.495 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.493+0000 7fbde2bf59c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:19:49.495 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.493+0000 7fbde2bf59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:49.495 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.493+0000 7fbde2bf59c0 20 zonegroup default 2024-09-12T00:19:49.495 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.493+0000 7fbde2bf59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.495 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.493+0000 7fbde2bf59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:49.495 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.493+0000 7fbde2bf59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.496 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.493+0000 7fbde2bf59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:49.496 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.493+0000 7fbde2bf59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.496 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.493+0000 7fbde2bf59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:49.496 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.493+0000 7fbde2bf59c0 20 started sync module instance, tier type = 2024-09-12T00:19:49.496 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.493+0000 7fbde2bf59c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:19:49.520 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.517+0000 7fbde2bf59c0 20 add_watcher() i=0 2024-09-12T00:19:49.520 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.517+0000 7fbde2bf59c0 20 add_watcher() i=1 2024-09-12T00:19:49.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.517+0000 7fbde2bf59c0 20 add_watcher() i=2 2024-09-12T00:19:49.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.517+0000 7fbde2bf59c0 20 add_watcher() i=3 2024-09-12T00:19:49.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.517+0000 7fbde2bf59c0 20 add_watcher() i=4 2024-09-12T00:19:49.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.517+0000 7fbde2bf59c0 20 add_watcher() i=5 2024-09-12T00:19:49.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.517+0000 7fbde2bf59c0 20 add_watcher() i=6 2024-09-12T00:19:49.523 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.521+0000 7fbde2bf59c0 20 add_watcher() i=7 2024-09-12T00:19:49.523 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.521+0000 7fbde2bf59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:49.527 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.525+0000 7fbc96fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:49.527 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.525+0000 7fbde2bf59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:49.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.525+0000 7fbde2bf59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:49.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.525+0000 7fbde2bf59c0 5 note: GC not initialized 2024-09-12T00:19:49.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.525+0000 7fbc95fdb640 20 reqs_thread_entry: start 2024-09-12T00:19:49.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.525+0000 7fbde2bf59c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:49.529 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.525+0000 7fbde2bf59c0 20 Filter name: none 2024-09-12T00:19:49.529 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.525+0000 7fbc077fe640 20 reqs_thread_entry: start 2024-09-12T00:19:49.529 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.525+0000 7fbde2bf59c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:19:49.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.525+0000 7fbde2bf59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.525+0000 7fbde2bf59c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:19:49.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.525+0000 7fbde2bf59c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:19:49.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.525+0000 7fbde2bf59c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:19:49.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.525+0000 7fbde2bf59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 : miss 2024-09-12T00:19:49.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.525+0000 7fbde2bf59c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.529+0000 7fbde2bf59c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:19:49.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.529+0000 7fbde2bf59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 info.flags=0x17 2024-09-12T00:19:49.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.529+0000 7fbde2bf59c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 to cache LRU end 2024-09-12T00:19:49.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.529+0000 7fbde2bf59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:49.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.529+0000 7fbde2bf59c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:19:49.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.529+0000 7fbde2bf59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 2024-09-12T00:19:49.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.529+0000 7fbde2bf59c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.0 2024-09-12T00:19:49.532 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.529+0000 7fbde2bf59c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:19:49.532 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.529+0000 7fbde2bf59c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:49.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.529+0000 7fbde2bf59c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T00:19:49.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.529+0000 7fbde2bf59c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.2 2024-09-12T00:19:49.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.533+0000 7fbde2bf59c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:19:49.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.533+0000 7fbde2bf59c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.3 2024-09-12T00:19:49.536 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.533+0000 7fbde2bf59c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:19:49.536 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.533+0000 7fbde2bf59c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.4 2024-09-12T00:19:49.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.533+0000 7fbde2bf59c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:19:49.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.533+0000 7fbde2bf59c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:49.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.537+0000 7fbde2bf59c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T00:19:49.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.537+0000 7fbde2bf59c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.6 2024-09-12T00:19:49.539 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.537+0000 7fbde2bf59c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:19:49.539 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.537+0000 7fbde2bf59c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.7 2024-09-12T00:19:49.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.537+0000 7fbde2bf59c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:19:49.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.537+0000 7fbde2bf59c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:49.541 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.537+0000 7fbde2bf59c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T00:19:49.541 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.537+0000 7fbde2bf59c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.9 2024-09-12T00:19:49.542 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.537+0000 7fbde2bf59c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:19:49.542 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.537+0000 7fbde2bf59c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:49.542 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.541+0000 7fbde2bf59c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T00:19:49.543 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.541+0000 7fbde2bf59c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:19:49.544 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.541+0000 7fbc96fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:49.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.545+0000 7fbde2bf59c0 20 remove_watcher() i=0 2024-09-12T00:19:49.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.545+0000 7fbde2bf59c0 2 removed watcher, disabling cache 2024-09-12T00:19:49.551 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.549+0000 7fbde2bf59c0 20 remove_watcher() i=1 2024-09-12T00:19:49.553 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.549+0000 7fbde2bf59c0 20 remove_watcher() i=2 2024-09-12T00:19:49.556 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.553+0000 7fbde2bf59c0 20 remove_watcher() i=3 2024-09-12T00:19:49.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.557+0000 7fbde2bf59c0 20 remove_watcher() i=4 2024-09-12T00:19:49.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.557+0000 7fbde2bf59c0 20 remove_watcher() i=5 2024-09-12T00:19:49.561 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.557+0000 7fbde2bf59c0 20 remove_watcher() i=6 2024-09-12T00:19:49.563 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:49.561+0000 7fbde2bf59c0 20 remove_watcher() i=7 2024-09-12T00:19:49.580 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-12T00:19:49.580 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:19:49.582 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:49.583 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:49.587 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:49.588 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:49.592 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:49.592 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:49.646 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-12T00:19:49.646 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:19:49.648 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:49.648 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:49.702 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:49.702 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:49.770 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:49.771 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:49.801 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:49.801 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:49.808 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:49.808 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:49.842 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:49.843 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:49.850 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:49.850 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:49.886 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:49.886 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:49.894 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:49.894 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:49.928 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:49.928 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:49.936 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:49.937 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:49.969 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:49.970 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:49.978 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:49.978 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:50.012 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:50.012 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:50.019 INFO:tasks.workunit.client.0.smithi043.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:19:50.468 INFO:tasks.workunit.client.0.smithi043.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:19:51.915 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:51.915 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:51.979 INFO:tasks.workunit.client.0.smithi043.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:19:51.980 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:19:52.017 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:52.017 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:52.061 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.057+0000 7fa5deca49c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.062 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.061+0000 7fa5deca49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:52.062 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.061+0000 7fa5deca49c0 20 realm 2024-09-12T00:19:52.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.061+0000 7fa5deca49c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.061+0000 7fa5deca49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:52.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.061+0000 7fa5deca49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:52.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.061+0000 7fa5deca49c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.061+0000 7fa5deca49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:52.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.061+0000 7fa5deca49c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.061+0000 7fa5deca49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:52.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.061+0000 7fa5deca49c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.061+0000 7fa5deca49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:52.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.061+0000 7fa5deca49c0 20 searching for the correct realm 2024-09-12T00:19:52.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.069+0000 7fa5dbfa9640 0 -- 172.21.15.43:0/2869396983 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fa5d0069100 msgr2=0x7fa5d0070a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:52.078 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.077+0000 7fa5dbfa9640 0 -- 172.21.15.43:0/2869396983 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fa4a407e210 msgr2=0x7fa4a4080640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:52.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.081+0000 7fa5deca49c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:19:52.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.081+0000 7fa5deca49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:52.086 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.081+0000 7fa5deca49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:52.086 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.081+0000 7fa5deca49c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:19:52.086 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.081+0000 7fa5deca49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:52.086 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.081+0000 7fa5deca49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:52.086 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.081+0000 7fa5deca49c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.086 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.081+0000 7fa5deca49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:52.086 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.081+0000 7fa5deca49c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.081+0000 7fa5deca49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:52.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.085+0000 7fa5deca49c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.085+0000 7fa5deca49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:52.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.085+0000 7fa5deca49c0 20 zone default found 2024-09-12T00:19:52.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.085+0000 7fa5deca49c0 4 Realm: () 2024-09-12T00:19:52.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.085+0000 7fa5deca49c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:19:52.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.085+0000 7fa5deca49c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:19:52.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.085+0000 7fa5deca49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:52.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.085+0000 7fa5deca49c0 20 zonegroup default 2024-09-12T00:19:52.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.085+0000 7fa5deca49c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.085+0000 7fa5deca49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:52.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.085+0000 7fa5deca49c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.085+0000 7fa5deca49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:52.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.085+0000 7fa5deca49c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.085+0000 7fa5deca49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:52.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.085+0000 7fa5deca49c0 20 started sync module instance, tier type = 2024-09-12T00:19:52.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.085+0000 7fa5deca49c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:19:52.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.101+0000 7fa5deca49c0 20 add_watcher() i=0 2024-09-12T00:19:52.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.101+0000 7fa5deca49c0 20 add_watcher() i=1 2024-09-12T00:19:52.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.101+0000 7fa5deca49c0 20 add_watcher() i=2 2024-09-12T00:19:52.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.101+0000 7fa5deca49c0 20 add_watcher() i=3 2024-09-12T00:19:52.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.101+0000 7fa5deca49c0 20 add_watcher() i=4 2024-09-12T00:19:52.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.101+0000 7fa5deca49c0 20 add_watcher() i=5 2024-09-12T00:19:52.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.101+0000 7fa5deca49c0 20 add_watcher() i=6 2024-09-12T00:19:52.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.105+0000 7fa5deca49c0 20 add_watcher() i=7 2024-09-12T00:19:52.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.105+0000 7fa5deca49c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:52.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.105+0000 7fa492fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:52.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.105+0000 7fa5deca49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:52.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.105+0000 7fa5deca49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:52.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.105+0000 7fa5deca49c0 5 note: GC not initialized 2024-09-12T00:19:52.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.109+0000 7fa491fdb640 20 reqs_thread_entry: start 2024-09-12T00:19:52.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.109+0000 7fa5deca49c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:52.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.109+0000 7fa5deca49c0 20 Filter name: none 2024-09-12T00:19:52.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.109+0000 7fa4037fe640 20 reqs_thread_entry: start 2024-09-12T00:19:52.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.109+0000 7fa5deca49c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.109+0000 7fa5deca49c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:19:52.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.109+0000 7fa5deca49c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.109+0000 7fa5deca49c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:19:52.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.109+0000 7fa5deca49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:52.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.109+0000 7fa5deca49c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:19:52.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.109+0000 7fa5deca49c0 20 INFO: main: starting shard=0 2024-09-12T00:19:52.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.109+0000 7fa5deca49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.0 2024-09-12T00:19:52.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.109+0000 7fa5deca49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:52.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.109+0000 7fa5deca49c0 20 INFO: main: starting shard=1 2024-09-12T00:19:52.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.109+0000 7fa5deca49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:52.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.109+0000 7fa5deca49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:52.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.109+0000 7fa5deca49c0 20 INFO: main: starting shard=2 2024-09-12T00:19:52.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.109+0000 7fa5deca49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.2 2024-09-12T00:19:52.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.109+0000 7fa5deca49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:52.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.109+0000 7fa5deca49c0 20 INFO: main: starting shard=3 2024-09-12T00:19:52.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.109+0000 7fa5deca49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.3 2024-09-12T00:19:52.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.113+0000 7fa5deca49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:52.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.113+0000 7fa5deca49c0 20 INFO: main: starting shard=4 2024-09-12T00:19:52.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.113+0000 7fa5deca49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.4 2024-09-12T00:19:52.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.113+0000 7fa5deca49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:52.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.113+0000 7fa5deca49c0 20 INFO: main: starting shard=5 2024-09-12T00:19:52.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.113+0000 7fa5deca49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:52.118 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.113+0000 7fa5deca49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:52.118 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.113+0000 7fa5deca49c0 20 INFO: main: starting shard=6 2024-09-12T00:19:52.118 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.113+0000 7fa5deca49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.6 2024-09-12T00:19:52.118 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.117+0000 7fa5deca49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:52.118 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.117+0000 7fa5deca49c0 20 INFO: main: starting shard=7 2024-09-12T00:19:52.118 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.117+0000 7fa5deca49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.7 2024-09-12T00:19:52.119 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.117+0000 7fa5deca49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:52.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.117+0000 7fa5deca49c0 20 INFO: main: starting shard=8 2024-09-12T00:19:52.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.117+0000 7fa5deca49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:52.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.117+0000 7fa5deca49c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:19:52.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.117+0000 7fa5deca49c0 20 INFO: main: starting shard=9 2024-09-12T00:19:52.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.117+0000 7fa5deca49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.9 2024-09-12T00:19:52.121 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.117+0000 7fa5deca49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:52.121 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.117+0000 7fa5deca49c0 20 INFO: main: starting shard=10 2024-09-12T00:19:52.121 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.117+0000 7fa5deca49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:52.121 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.117+0000 7fa5deca49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:52.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.117+0000 7fa5deca49c0 20 INFO: main: done 2024-09-12T00:19:52.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.121+0000 7fa492fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:52.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.125+0000 7fa5deca49c0 20 remove_watcher() i=0 2024-09-12T00:19:52.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.125+0000 7fa5deca49c0 2 removed watcher, disabling cache 2024-09-12T00:19:52.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.125+0000 7fa5deca49c0 20 remove_watcher() i=1 2024-09-12T00:19:52.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.129+0000 7fa5deca49c0 20 remove_watcher() i=2 2024-09-12T00:19:52.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.129+0000 7fa5deca49c0 20 remove_watcher() i=3 2024-09-12T00:19:52.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.133+0000 7fa5deca49c0 20 remove_watcher() i=4 2024-09-12T00:19:52.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.133+0000 7fa5deca49c0 20 remove_watcher() i=5 2024-09-12T00:19:52.138 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.137+0000 7fa5deca49c0 20 remove_watcher() i=6 2024-09-12T00:19:52.139 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.137+0000 7fa5deca49c0 20 remove_watcher() i=7 2024-09-12T00:19:52.153 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:52.153 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:52.156 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:52.157 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:52.159 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:52.159 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:52.219 INFO:tasks.workunit.client.0.smithi043.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:19:52.219 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:19:52.253 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:52.253 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:52.296 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.293+0000 7f5a773e99c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.298 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.293+0000 7f5a773e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:52.298 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.293+0000 7f5a773e99c0 20 realm 2024-09-12T00:19:52.298 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.293+0000 7f5a773e99c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.298 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.293+0000 7f5a773e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:52.298 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.293+0000 7f5a773e99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:52.298 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.293+0000 7f5a773e99c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.298 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.293+0000 7f5a773e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:52.298 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.293+0000 7f5a773e99c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.300 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.297+0000 7f5a773e99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:52.300 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.297+0000 7f5a773e99c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.300 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.297+0000 7f5a773e99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:52.300 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.297+0000 7f5a773e99c0 20 searching for the correct realm 2024-09-12T00:19:52.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.305+0000 7f5a756f0640 0 -- 172.21.15.43:0/3195486373 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f5a68009040 msgr2=0x7f5a68017410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:19:52.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.521+0000 7f5a74eef640 0 -- 172.21.15.43:0/3195486373 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x55e4cb9d5660 msgr2=0x55e4cb9d7a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:52.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.529+0000 7f5a773e99c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:19:52.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.529+0000 7f5a773e99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:52.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.529+0000 7f5a773e99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:52.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.529+0000 7f5a773e99c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:19:52.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.529+0000 7f5a773e99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:52.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.529+0000 7f5a773e99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:52.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.529+0000 7f5a773e99c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.529+0000 7f5a773e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:52.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.529+0000 7f5a773e99c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.533+0000 7f5a773e99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:52.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.533+0000 7f5a773e99c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.533+0000 7f5a773e99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:52.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.533+0000 7f5a773e99c0 20 zone default found 2024-09-12T00:19:52.536 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.533+0000 7f5a773e99c0 4 Realm: () 2024-09-12T00:19:52.536 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.533+0000 7f5a773e99c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:19:52.536 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.533+0000 7f5a773e99c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:19:52.536 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.533+0000 7f5a773e99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:52.536 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.533+0000 7f5a773e99c0 20 zonegroup default 2024-09-12T00:19:52.536 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.533+0000 7f5a773e99c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.536 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.533+0000 7f5a773e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:52.536 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.533+0000 7f5a773e99c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.533+0000 7f5a773e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:52.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.533+0000 7f5a773e99c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.533+0000 7f5a773e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:52.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.533+0000 7f5a773e99c0 20 started sync module instance, tier type = 2024-09-12T00:19:52.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.533+0000 7f5a773e99c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:19:52.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.561+0000 7f5a773e99c0 20 add_watcher() i=0 2024-09-12T00:19:52.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.561+0000 7f5a773e99c0 20 add_watcher() i=1 2024-09-12T00:19:52.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.561+0000 7f5a773e99c0 20 add_watcher() i=2 2024-09-12T00:19:52.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.561+0000 7f5a773e99c0 20 add_watcher() i=3 2024-09-12T00:19:52.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.561+0000 7f5a773e99c0 20 add_watcher() i=4 2024-09-12T00:19:52.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.561+0000 7f5a773e99c0 20 add_watcher() i=5 2024-09-12T00:19:52.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.561+0000 7f5a773e99c0 20 add_watcher() i=6 2024-09-12T00:19:52.566 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.565+0000 7f5a773e99c0 20 add_watcher() i=7 2024-09-12T00:19:52.566 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.565+0000 7f5a773e99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:52.571 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.569+0000 7f592afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:52.572 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.569+0000 7f5a773e99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:52.572 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.569+0000 7f5a773e99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:52.572 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.569+0000 7f5a773e99c0 5 note: GC not initialized 2024-09-12T00:19:52.572 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.569+0000 7f5929fe3640 20 reqs_thread_entry: start 2024-09-12T00:19:52.573 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.569+0000 7f5a773e99c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:52.573 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.569+0000 7f5a773e99c0 20 Filter name: none 2024-09-12T00:19:52.573 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.569+0000 7f589b7fe640 20 reqs_thread_entry: start 2024-09-12T00:19:52.573 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.569+0000 7f5a773e99c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.569+0000 7f5a773e99c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:19:52.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.569+0000 7f5a773e99c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.575 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.573+0000 7f5a773e99c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:19:52.575 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.573+0000 7f5a773e99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:52.575 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.573+0000 7f5a773e99c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:19:52.575 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.573+0000 7f5a773e99c0 20 INFO: main: starting shard=0 2024-09-12T00:19:52.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.573+0000 7f5a773e99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.0 2024-09-12T00:19:52.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.573+0000 7f5a773e99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:52.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.573+0000 7f5a773e99c0 20 INFO: main: starting shard=1 2024-09-12T00:19:52.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.573+0000 7f5a773e99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:52.577 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.573+0000 7f5a773e99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:52.577 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.573+0000 7f5a773e99c0 20 INFO: main: starting shard=2 2024-09-12T00:19:52.577 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.573+0000 7f5a773e99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.2 2024-09-12T00:19:52.577 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.573+0000 7f5a773e99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:52.577 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.573+0000 7f5a773e99c0 20 INFO: main: starting shard=3 2024-09-12T00:19:52.577 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.573+0000 7f5a773e99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.3 2024-09-12T00:19:52.578 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.577+0000 7f5a773e99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:52.579 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.577+0000 7f5a773e99c0 20 INFO: main: starting shard=4 2024-09-12T00:19:52.579 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.577+0000 7f5a773e99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.4 2024-09-12T00:19:52.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.577+0000 7f5a773e99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:52.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.577+0000 7f5a773e99c0 20 INFO: main: starting shard=5 2024-09-12T00:19:52.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.577+0000 7f5a773e99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:52.581 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.577+0000 7f5a773e99c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:19:52.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.577+0000 7f5a773e99c0 20 INFO: main: starting shard=6 2024-09-12T00:19:52.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.577+0000 7f5a773e99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.6 2024-09-12T00:19:52.583 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.581+0000 7f5a773e99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:52.583 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.581+0000 7f5a773e99c0 20 INFO: main: starting shard=7 2024-09-12T00:19:52.583 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.581+0000 7f5a773e99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.7 2024-09-12T00:19:52.584 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.581+0000 7f5a773e99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:52.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.581+0000 7f5a773e99c0 20 INFO: main: starting shard=8 2024-09-12T00:19:52.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.581+0000 7f5a773e99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:52.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.581+0000 7f5a773e99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:52.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.581+0000 7f5a773e99c0 20 INFO: main: starting shard=9 2024-09-12T00:19:52.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.581+0000 7f5a773e99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.9 2024-09-12T00:19:52.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.585+0000 7f5a773e99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:52.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.585+0000 7f5a773e99c0 20 INFO: main: starting shard=10 2024-09-12T00:19:52.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.585+0000 7f5a773e99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:52.587 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.585+0000 7f5a773e99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:52.587 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.585+0000 7f5a773e99c0 20 INFO: main: done 2024-09-12T00:19:52.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.585+0000 7f592afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:52.594 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.593+0000 7f5a773e99c0 20 remove_watcher() i=0 2024-09-12T00:19:52.594 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.593+0000 7f5a773e99c0 2 removed watcher, disabling cache 2024-09-12T00:19:52.596 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.593+0000 7f5a773e99c0 20 remove_watcher() i=1 2024-09-12T00:19:52.598 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.597+0000 7f5a773e99c0 20 remove_watcher() i=2 2024-09-12T00:19:52.601 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.597+0000 7f5a773e99c0 20 remove_watcher() i=3 2024-09-12T00:19:52.603 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.601+0000 7f5a773e99c0 20 remove_watcher() i=4 2024-09-12T00:19:52.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.601+0000 7f5a773e99c0 20 remove_watcher() i=5 2024-09-12T00:19:52.607 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.605+0000 7f5a773e99c0 20 remove_watcher() i=6 2024-09-12T00:19:52.609 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.605+0000 7f5a773e99c0 20 remove_watcher() i=7 2024-09-12T00:19:52.631 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:52.631 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:52.635 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:52.635 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:52.699 INFO:tasks.workunit.client.0.smithi043.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:19:52.699 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T00:19:52.736 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:52.736 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:52.782 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.777+0000 7fc58ab129c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.783 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.781+0000 7fc58ab129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:52.783 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.781+0000 7fc58ab129c0 20 realm 2024-09-12T00:19:52.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.781+0000 7fc58ab129c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.781+0000 7fc58ab129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:52.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.781+0000 7fc58ab129c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:52.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.781+0000 7fc58ab129c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.781+0000 7fc58ab129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:52.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.781+0000 7fc58ab129c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.785 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.781+0000 7fc58ab129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:52.785 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.781+0000 7fc58ab129c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.785+0000 7fc58ab129c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:52.787 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.785+0000 7fc58ab129c0 20 searching for the correct realm 2024-09-12T00:19:52.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.789+0000 7fc588e19640 0 -- 172.21.15.43:0/2123939940 >> [v2:172.21.15.43:6808/2258408181,v1:172.21.15.43:6809/2258408181] conn(0x55c003886cc0 msgr2=0x55c003889180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:52.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.797+0000 7fc588618640 0 -- 172.21.15.43:0/2123939940 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fc57c054970 msgr2=0x7fc57c031420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:52.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.801+0000 7fc58ab129c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:19:52.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.801+0000 7fc58ab129c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:52.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.805+0000 7fc58ab129c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:52.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.805+0000 7fc58ab129c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:19:52.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.805+0000 7fc58ab129c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:52.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.805+0000 7fc58ab129c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:52.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.805+0000 7fc58ab129c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.805+0000 7fc58ab129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:52.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.805+0000 7fc58ab129c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.805+0000 7fc58ab129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:52.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.805+0000 7fc58ab129c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.805+0000 7fc58ab129c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:52.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.805+0000 7fc58ab129c0 20 zone default found 2024-09-12T00:19:52.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.805+0000 7fc58ab129c0 4 Realm: () 2024-09-12T00:19:52.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.805+0000 7fc58ab129c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:19:52.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.805+0000 7fc58ab129c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:19:52.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.805+0000 7fc58ab129c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:52.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.805+0000 7fc58ab129c0 20 zonegroup default 2024-09-12T00:19:52.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.805+0000 7fc58ab129c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.805+0000 7fc58ab129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:52.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.805+0000 7fc58ab129c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.805+0000 7fc58ab129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:52.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.805+0000 7fc58ab129c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.805+0000 7fc58ab129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:52.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.805+0000 7fc58ab129c0 20 started sync module instance, tier type = 2024-09-12T00:19:52.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.805+0000 7fc58ab129c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:19:52.826 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.825+0000 7fc58ab129c0 20 add_watcher() i=0 2024-09-12T00:19:52.827 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.825+0000 7fc58ab129c0 20 add_watcher() i=1 2024-09-12T00:19:52.827 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.825+0000 7fc58ab129c0 20 add_watcher() i=2 2024-09-12T00:19:52.827 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.825+0000 7fc58ab129c0 20 add_watcher() i=3 2024-09-12T00:19:52.827 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.825+0000 7fc58ab129c0 20 add_watcher() i=4 2024-09-12T00:19:52.827 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.825+0000 7fc58ab129c0 20 add_watcher() i=5 2024-09-12T00:19:52.827 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.825+0000 7fc58ab129c0 20 add_watcher() i=6 2024-09-12T00:19:52.828 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.825+0000 7fc58ab129c0 20 add_watcher() i=7 2024-09-12T00:19:52.828 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.825+0000 7fc58ab129c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:52.830 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.829+0000 7fc43efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:52.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.829+0000 7fc58ab129c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:52.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.829+0000 7fc58ab129c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:52.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.829+0000 7fc58ab129c0 5 note: GC not initialized 2024-09-12T00:19:52.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.829+0000 7fc43dfdb640 20 reqs_thread_entry: start 2024-09-12T00:19:52.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.829+0000 7fc58ab129c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:52.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.829+0000 7fc58ab129c0 20 Filter name: none 2024-09-12T00:19:52.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.829+0000 7fc3af7fe640 20 reqs_thread_entry: start 2024-09-12T00:19:52.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.829+0000 7fc58ab129c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.829+0000 7fc58ab129c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:19:52.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.829+0000 7fc58ab129c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:52.834 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.829+0000 7fc58ab129c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:19:52.834 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.829+0000 7fc58ab129c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:52.834 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.829+0000 7fc58ab129c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:19:52.834 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.829+0000 7fc58ab129c0 20 INFO: main: starting shard=0 2024-09-12T00:19:52.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.829+0000 7fc58ab129c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.0 2024-09-12T00:19:52.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.833+0000 7fc58ab129c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:52.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.833+0000 7fc58ab129c0 20 INFO: main: starting shard=1 2024-09-12T00:19:52.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.833+0000 7fc58ab129c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:52.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.833+0000 7fc58ab129c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:19:52.836 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.833+0000 7fc58ab129c0 20 INFO: main: starting shard=2 2024-09-12T00:19:52.836 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.833+0000 7fc58ab129c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.2 2024-09-12T00:19:52.836 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.833+0000 7fc58ab129c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:52.836 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.833+0000 7fc58ab129c0 20 INFO: main: starting shard=3 2024-09-12T00:19:52.836 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.833+0000 7fc58ab129c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.3 2024-09-12T00:19:52.837 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.833+0000 7fc58ab129c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:52.837 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.833+0000 7fc58ab129c0 20 INFO: main: starting shard=4 2024-09-12T00:19:52.837 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.833+0000 7fc58ab129c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.4 2024-09-12T00:19:52.837 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.833+0000 7fc58ab129c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:52.838 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.833+0000 7fc58ab129c0 20 INFO: main: starting shard=5 2024-09-12T00:19:52.838 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.833+0000 7fc58ab129c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:52.839 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.837+0000 7fc58ab129c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:52.839 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.837+0000 7fc58ab129c0 20 INFO: main: starting shard=6 2024-09-12T00:19:52.839 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.837+0000 7fc58ab129c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.6 2024-09-12T00:19:52.839 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.837+0000 7fc58ab129c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:52.840 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.837+0000 7fc58ab129c0 20 INFO: main: starting shard=7 2024-09-12T00:19:52.840 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.837+0000 7fc58ab129c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.7 2024-09-12T00:19:52.841 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.837+0000 7fc58ab129c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:52.841 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.837+0000 7fc58ab129c0 20 INFO: main: starting shard=8 2024-09-12T00:19:52.841 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.837+0000 7fc58ab129c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:52.841 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.837+0000 7fc58ab129c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:52.841 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.837+0000 7fc58ab129c0 20 INFO: main: starting shard=9 2024-09-12T00:19:52.841 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.837+0000 7fc58ab129c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.9 2024-09-12T00:19:52.842 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.837+0000 7fc58ab129c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:52.842 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.837+0000 7fc58ab129c0 20 INFO: main: starting shard=10 2024-09-12T00:19:52.842 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.837+0000 7fc58ab129c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:52.842 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.841+0000 7fc58ab129c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:52.842 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.841+0000 7fc58ab129c0 20 INFO: main: done 2024-09-12T00:19:52.843 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.841+0000 7fc43efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:52.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.849+0000 7fc58ab129c0 20 remove_watcher() i=0 2024-09-12T00:19:52.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.849+0000 7fc58ab129c0 2 removed watcher, disabling cache 2024-09-12T00:19:52.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.849+0000 7fc58ab129c0 20 remove_watcher() i=1 2024-09-12T00:19:52.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.853+0000 7fc58ab129c0 20 remove_watcher() i=2 2024-09-12T00:19:52.858 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.857+0000 7fc58ab129c0 20 remove_watcher() i=3 2024-09-12T00:19:52.860 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.857+0000 7fc58ab129c0 20 remove_watcher() i=4 2024-09-12T00:19:52.862 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.861+0000 7fc58ab129c0 20 remove_watcher() i=5 2024-09-12T00:19:52.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.861+0000 7fc58ab129c0 20 remove_watcher() i=6 2024-09-12T00:19:52.865 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:52.861+0000 7fc58ab129c0 20 remove_watcher() i=7 2024-09-12T00:19:52.884 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:52.884 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:52.888 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:52.888 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:52.947 INFO:tasks.workunit.client.0.smithi043.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:19:52.948 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T00:19:52.982 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:52.982 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:53.026 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.025+0000 7f064a45e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:53.028 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.025+0000 7f064a45e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:53.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.025+0000 7f064a45e9c0 20 realm 2024-09-12T00:19:53.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.025+0000 7f064a45e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:53.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.025+0000 7f064a45e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:53.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.025+0000 7f064a45e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:53.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.025+0000 7f064a45e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:53.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.025+0000 7f064a45e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:53.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.025+0000 7f064a45e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:53.030 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.029+0000 7f064a45e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:53.031 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.029+0000 7f064a45e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:53.031 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.029+0000 7f064a45e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:53.032 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.029+0000 7f064a45e9c0 20 searching for the correct realm 2024-09-12T00:19:53.039 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.037+0000 7f0648765640 0 -- 172.21.15.43:0/580849474 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f063c040400 msgr2=0x7f063c040880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:53.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.253+0000 7f0647f64640 0 -- 172.21.15.43:0/580849474 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x55797c85c910 msgr2=0x55797c85ed00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:53.264 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.261+0000 7f064a45e9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:19:53.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.261+0000 7f064a45e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:53.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.261+0000 7f064a45e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:53.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.261+0000 7f064a45e9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:19:53.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.261+0000 7f064a45e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:53.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.261+0000 7f064a45e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:53.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.261+0000 7f064a45e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:53.266 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.261+0000 7f064a45e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:53.266 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.261+0000 7f064a45e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:53.266 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.261+0000 7f064a45e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:53.266 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.261+0000 7f064a45e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:53.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.265+0000 7f064a45e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:53.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.265+0000 7f064a45e9c0 20 zone default found 2024-09-12T00:19:53.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.265+0000 7f064a45e9c0 4 Realm: () 2024-09-12T00:19:53.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.265+0000 7f064a45e9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:19:53.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.265+0000 7f064a45e9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:19:53.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.265+0000 7f064a45e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:53.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.265+0000 7f064a45e9c0 20 zonegroup default 2024-09-12T00:19:53.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.265+0000 7f064a45e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:53.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.265+0000 7f064a45e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:53.268 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.265+0000 7f064a45e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:53.268 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.265+0000 7f064a45e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:53.268 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.265+0000 7f064a45e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:53.269 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.265+0000 7f064a45e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:53.269 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.265+0000 7f064a45e9c0 20 started sync module instance, tier type = 2024-09-12T00:19:53.269 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.265+0000 7f064a45e9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:19:53.295 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.293+0000 7f064a45e9c0 20 add_watcher() i=0 2024-09-12T00:19:53.295 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.293+0000 7f064a45e9c0 20 add_watcher() i=1 2024-09-12T00:19:53.296 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.293+0000 7f064a45e9c0 20 add_watcher() i=2 2024-09-12T00:19:53.296 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.293+0000 7f064a45e9c0 20 add_watcher() i=3 2024-09-12T00:19:53.296 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.293+0000 7f064a45e9c0 20 add_watcher() i=4 2024-09-12T00:19:53.296 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.293+0000 7f064a45e9c0 20 add_watcher() i=5 2024-09-12T00:19:53.296 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.293+0000 7f064a45e9c0 20 add_watcher() i=6 2024-09-12T00:19:53.298 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.293+0000 7f064a45e9c0 20 add_watcher() i=7 2024-09-12T00:19:53.298 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.293+0000 7f064a45e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:53.302 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.301+0000 7f04fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:53.303 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.301+0000 7f064a45e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:53.303 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.301+0000 7f064a45e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:53.303 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.301+0000 7f064a45e9c0 5 note: GC not initialized 2024-09-12T00:19:53.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.301+0000 7f04fcfe1640 20 reqs_thread_entry: start 2024-09-12T00:19:53.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.301+0000 7f064a45e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:53.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.301+0000 7f064a45e9c0 20 Filter name: none 2024-09-12T00:19:53.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.301+0000 7f04767fc640 20 reqs_thread_entry: start 2024-09-12T00:19:53.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.301+0000 7f064a45e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:53.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.301+0000 7f064a45e9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:19:53.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.301+0000 7f064a45e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:53.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.305+0000 7f064a45e9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:19:53.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.305+0000 7f064a45e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:53.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.305+0000 7f064a45e9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:19:53.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.305+0000 7f064a45e9c0 20 INFO: main: starting shard=0 2024-09-12T00:19:53.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.305+0000 7f064a45e9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.0 2024-09-12T00:19:53.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.305+0000 7f064a45e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:53.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.305+0000 7f064a45e9c0 20 INFO: main: starting shard=1 2024-09-12T00:19:53.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.305+0000 7f064a45e9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:53.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.305+0000 7f064a45e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:53.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.305+0000 7f064a45e9c0 20 INFO: main: starting shard=2 2024-09-12T00:19:53.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.305+0000 7f064a45e9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.2 2024-09-12T00:19:53.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.305+0000 7f064a45e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:53.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.305+0000 7f064a45e9c0 20 INFO: main: starting shard=3 2024-09-12T00:19:53.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.305+0000 7f064a45e9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.3 2024-09-12T00:19:53.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.309+0000 7f064a45e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:53.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.309+0000 7f064a45e9c0 20 INFO: main: starting shard=4 2024-09-12T00:19:53.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.309+0000 7f064a45e9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.4 2024-09-12T00:19:53.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.309+0000 7f064a45e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:53.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.309+0000 7f064a45e9c0 20 INFO: main: starting shard=5 2024-09-12T00:19:53.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.309+0000 7f064a45e9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:53.314 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.309+0000 7f064a45e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:53.314 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.309+0000 7f064a45e9c0 20 INFO: main: starting shard=6 2024-09-12T00:19:53.314 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.309+0000 7f064a45e9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.6 2024-09-12T00:19:53.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.313+0000 7f064a45e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:53.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.313+0000 7f064a45e9c0 20 INFO: main: starting shard=7 2024-09-12T00:19:53.316 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.313+0000 7f064a45e9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.7 2024-09-12T00:19:53.316 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.313+0000 7f064a45e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:53.316 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.313+0000 7f064a45e9c0 20 INFO: main: starting shard=8 2024-09-12T00:19:53.316 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.313+0000 7f064a45e9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:53.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.313+0000 7f064a45e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:53.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.313+0000 7f064a45e9c0 20 INFO: main: starting shard=9 2024-09-12T00:19:53.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.313+0000 7f064a45e9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.9 2024-09-12T00:19:53.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.317+0000 7f064a45e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:19:53.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.317+0000 7f064a45e9c0 20 INFO: main: starting shard=10 2024-09-12T00:19:53.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.317+0000 7f064a45e9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:53.319 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.317+0000 7f064a45e9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:19:53.319 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.317+0000 7f064a45e9c0 20 INFO: main: done 2024-09-12T00:19:53.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.317+0000 7f04fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:53.327 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.325+0000 7f064a45e9c0 20 remove_watcher() i=0 2024-09-12T00:19:53.327 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.325+0000 7f064a45e9c0 2 removed watcher, disabling cache 2024-09-12T00:19:53.329 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.325+0000 7f064a45e9c0 20 remove_watcher() i=1 2024-09-12T00:19:53.332 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.329+0000 7f064a45e9c0 20 remove_watcher() i=2 2024-09-12T00:19:53.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.333+0000 7f064a45e9c0 20 remove_watcher() i=3 2024-09-12T00:19:53.337 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.333+0000 7f064a45e9c0 20 remove_watcher() i=4 2024-09-12T00:19:53.338 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.337+0000 7f064a45e9c0 20 remove_watcher() i=5 2024-09-12T00:19:53.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.337+0000 7f064a45e9c0 20 remove_watcher() i=6 2024-09-12T00:19:53.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:53.337+0000 7f064a45e9c0 20 remove_watcher() i=7 2024-09-12T00:19:53.359 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:53.360 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:53.363 INFO:tasks.workunit.client.0.smithi043.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:19:53.806 INFO:tasks.workunit.client.0.smithi043.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:19:54.236 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T00:19:54.268 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:54.268 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:54.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.305+0000 7fed646bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:54.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.305+0000 7fed646bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:54.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.305+0000 7fed646bd9c0 20 realm 2024-09-12T00:19:54.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.305+0000 7fed646bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:54.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.305+0000 7fed646bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:54.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.305+0000 7fed646bd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:54.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.305+0000 7fed646bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:54.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.305+0000 7fed646bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:54.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.305+0000 7fed646bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:54.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.309+0000 7fed646bd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:54.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.309+0000 7fed646bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:54.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.309+0000 7fed646bd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:54.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.309+0000 7fed646bd9c0 20 searching for the correct realm 2024-09-12T00:19:54.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.313+0000 7fed629c4640 0 -- 172.21.15.43:0/2916792681 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7fed580a0050 msgr2=0x7fed580780b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:54.532 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.529+0000 7fed621c3640 0 -- 172.21.15.43:0/2916792681 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x555ff6706210 msgr2=0x555ff67086b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:54.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.537+0000 7fed646bd9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:19:54.541 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.537+0000 7fed646bd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:54.541 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.537+0000 7fed646bd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:54.541 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.537+0000 7fed646bd9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:19:54.541 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.537+0000 7fed646bd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:54.541 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.537+0000 7fed646bd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:54.541 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.537+0000 7fed646bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:54.541 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.537+0000 7fed646bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:54.542 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.537+0000 7fed646bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:54.542 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.537+0000 7fed646bd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:54.542 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.541+0000 7fed646bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:54.543 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.541+0000 7fed646bd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:54.543 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.541+0000 7fed646bd9c0 20 zone default found 2024-09-12T00:19:54.543 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.541+0000 7fed646bd9c0 4 Realm: () 2024-09-12T00:19:54.543 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.541+0000 7fed646bd9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:19:54.544 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.541+0000 7fed646bd9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:19:54.544 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.541+0000 7fed646bd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:54.544 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.541+0000 7fed646bd9c0 20 zonegroup default 2024-09-12T00:19:54.544 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.541+0000 7fed646bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:54.544 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.541+0000 7fed646bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:54.544 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.541+0000 7fed646bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:54.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.541+0000 7fed646bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:54.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.541+0000 7fed646bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:54.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.541+0000 7fed646bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:54.546 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.541+0000 7fed646bd9c0 20 started sync module instance, tier type = 2024-09-12T00:19:54.546 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.541+0000 7fed646bd9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:19:54.571 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.569+0000 7fed646bd9c0 20 add_watcher() i=0 2024-09-12T00:19:54.571 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.569+0000 7fed646bd9c0 20 add_watcher() i=1 2024-09-12T00:19:54.571 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.569+0000 7fed646bd9c0 20 add_watcher() i=2 2024-09-12T00:19:54.571 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.569+0000 7fed646bd9c0 20 add_watcher() i=3 2024-09-12T00:19:54.571 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.569+0000 7fed646bd9c0 20 add_watcher() i=4 2024-09-12T00:19:54.571 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.569+0000 7fed646bd9c0 20 add_watcher() i=5 2024-09-12T00:19:54.572 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.569+0000 7fed646bd9c0 20 add_watcher() i=6 2024-09-12T00:19:54.573 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.569+0000 7fed646bd9c0 20 add_watcher() i=7 2024-09-12T00:19:54.573 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.569+0000 7fed646bd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:54.577 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.573+0000 7fec197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:54.578 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.577+0000 7fed646bd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:54.578 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.577+0000 7fed646bd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:54.578 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.577+0000 7fed646bd9c0 5 note: GC not initialized 2024-09-12T00:19:54.579 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.577+0000 7fec137fe640 20 reqs_thread_entry: start 2024-09-12T00:19:54.579 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.577+0000 7fed646bd9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:54.579 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.577+0000 7fed646bd9c0 20 Filter name: none 2024-09-12T00:19:54.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.577+0000 7fec117fa640 20 reqs_thread_entry: start 2024-09-12T00:19:54.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.577+0000 7fed646bd9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:19:54.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.577+0000 7fed646bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:54.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.577+0000 7fed646bd9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:19:54.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.577+0000 7fed646bd9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:19:54.581 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.577+0000 7fed646bd9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:19:54.581 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.577+0000 7fed646bd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 : miss 2024-09-12T00:19:54.581 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.577+0000 7fed646bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:54.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.577+0000 7fed646bd9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:19:54.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.577+0000 7fed646bd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 info.flags=0x17 2024-09-12T00:19:54.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.577+0000 7fed646bd9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 to cache LRU end 2024-09-12T00:19:54.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.577+0000 7fed646bd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:54.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.577+0000 7fed646bd9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:19:54.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.577+0000 7fed646bd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 2024-09-12T00:19:54.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.577+0000 7fed646bd9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.0 2024-09-12T00:19:54.583 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.581+0000 7fed646bd9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:54.584 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.581+0000 7fed646bd9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.2 2024-09-12T00:19:54.584 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.581+0000 7fed646bd9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.3 2024-09-12T00:19:54.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.585+0000 7fed646bd9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.4 2024-09-12T00:19:54.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.585+0000 7fed646bd9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:54.589 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.585+0000 7fed646bd9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.6 2024-09-12T00:19:54.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.585+0000 7fed646bd9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.7 2024-09-12T00:19:54.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.589+0000 7fed646bd9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:54.592 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.589+0000 7fed646bd9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.9 2024-09-12T00:19:54.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.589+0000 7fed646bd9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:54.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.601+0000 7fec197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:54.610 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.609+0000 7fed646bd9c0 20 remove_watcher() i=0 2024-09-12T00:19:54.610 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.609+0000 7fed646bd9c0 2 removed watcher, disabling cache 2024-09-12T00:19:54.613 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.609+0000 7fed646bd9c0 20 remove_watcher() i=1 2024-09-12T00:19:54.615 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.613+0000 7fed646bd9c0 20 remove_watcher() i=2 2024-09-12T00:19:54.618 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.617+0000 7fed646bd9c0 20 remove_watcher() i=3 2024-09-12T00:19:54.620 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.617+0000 7fed646bd9c0 20 remove_watcher() i=4 2024-09-12T00:19:54.622 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.617+0000 7fed646bd9c0 20 remove_watcher() i=5 2024-09-12T00:19:54.624 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.621+0000 7fed646bd9c0 20 remove_watcher() i=6 2024-09-12T00:19:54.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.621+0000 7fed646bd9c0 20 remove_watcher() i=7 2024-09-12T00:19:54.643 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:19:54.681 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:54.681 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:54.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.721+0000 7fd07f14d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:54.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.721+0000 7fd07f14d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:54.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.721+0000 7fd07f14d9c0 20 realm 2024-09-12T00:19:54.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.721+0000 7fd07f14d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:54.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.721+0000 7fd07f14d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:54.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.721+0000 7fd07f14d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:54.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.721+0000 7fd07f14d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:54.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.721+0000 7fd07f14d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:54.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.721+0000 7fd07f14d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:54.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.725+0000 7fd07f14d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:54.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.725+0000 7fd07f14d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:54.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.725+0000 7fd07f14d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:54.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.725+0000 7fd07f14d9c0 20 searching for the correct realm 2024-09-12T00:19:54.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.729+0000 7fd07c452640 0 -- 172.21.15.43:0/2417026163 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fd070042040 msgr2=0x7fd070041410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:54.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:54.945+0000 7fd07cc53640 0 -- 172.21.15.43:0/2417026163 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fd070008040 msgr2=0x7fd070034910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:19:55.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.161+0000 7fd07f14d9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:19:55.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.161+0000 7fd07f14d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:55.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.161+0000 7fd07f14d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:55.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.161+0000 7fd07f14d9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:19:55.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.161+0000 7fd07f14d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:55.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.161+0000 7fd07f14d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:55.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.161+0000 7fd07f14d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:55.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.165+0000 7fd07f14d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:55.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.165+0000 7fd07f14d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:55.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.165+0000 7fd07f14d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:55.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.165+0000 7fd07f14d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:55.168 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.165+0000 7fd07f14d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:55.168 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.165+0000 7fd07f14d9c0 20 zone default found 2024-09-12T00:19:55.168 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.165+0000 7fd07f14d9c0 4 Realm: () 2024-09-12T00:19:55.168 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.165+0000 7fd07f14d9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:19:55.168 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.165+0000 7fd07f14d9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:19:55.168 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.165+0000 7fd07f14d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:55.168 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.165+0000 7fd07f14d9c0 20 zonegroup default 2024-09-12T00:19:55.169 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.165+0000 7fd07f14d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:55.169 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.165+0000 7fd07f14d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:55.169 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.165+0000 7fd07f14d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:55.169 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.165+0000 7fd07f14d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:55.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.165+0000 7fd07f14d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:55.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.169+0000 7fd07f14d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:55.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.169+0000 7fd07f14d9c0 20 started sync module instance, tier type = 2024-09-12T00:19:55.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.169+0000 7fd07f14d9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:19:55.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.189+0000 7fd07f14d9c0 20 add_watcher() i=0 2024-09-12T00:19:55.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.189+0000 7fd07f14d9c0 20 add_watcher() i=1 2024-09-12T00:19:55.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.189+0000 7fd07f14d9c0 20 add_watcher() i=2 2024-09-12T00:19:55.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.189+0000 7fd07f14d9c0 20 add_watcher() i=3 2024-09-12T00:19:55.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.189+0000 7fd07f14d9c0 20 add_watcher() i=4 2024-09-12T00:19:55.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.189+0000 7fd07f14d9c0 20 add_watcher() i=5 2024-09-12T00:19:55.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.189+0000 7fd07f14d9c0 20 add_watcher() i=6 2024-09-12T00:19:55.197 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.193+0000 7fd07f14d9c0 20 add_watcher() i=7 2024-09-12T00:19:55.197 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.193+0000 7fd07f14d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:55.201 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.197+0000 7fcf32fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:55.202 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.197+0000 7fd07f14d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:55.202 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.197+0000 7fd07f14d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:55.202 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.197+0000 7fd07f14d9c0 5 note: GC not initialized 2024-09-12T00:19:55.202 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.201+0000 7fcf31fe3640 20 reqs_thread_entry: start 2024-09-12T00:19:55.202 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.201+0000 7fd07f14d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:55.203 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.201+0000 7fd07f14d9c0 20 Filter name: none 2024-09-12T00:19:55.203 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.201+0000 7fcea37fe640 20 reqs_thread_entry: start 2024-09-12T00:19:55.203 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.201+0000 7fd07f14d9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:19:55.203 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.201+0000 7fd07f14d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:55.204 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.201+0000 7fd07f14d9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:19:55.204 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.201+0000 7fd07f14d9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:19:55.204 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.201+0000 7fd07f14d9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:19:55.204 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.201+0000 7fd07f14d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 : miss 2024-09-12T00:19:55.204 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.201+0000 7fd07f14d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:55.205 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.201+0000 7fd07f14d9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:19:55.205 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.201+0000 7fd07f14d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 info.flags=0x17 2024-09-12T00:19:55.205 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.201+0000 7fd07f14d9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 to cache LRU end 2024-09-12T00:19:55.205 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.201+0000 7fd07f14d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:55.205 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.201+0000 7fd07f14d9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:19:55.205 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.201+0000 7fd07f14d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1 2024-09-12T00:19:55.206 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.201+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.0 2024-09-12T00:19:55.206 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.205+0000 7fd07f14d9c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T00:19:55.206 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.205+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:55.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.205+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.2 2024-09-12T00:19:55.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.205+0000 7fd07f14d9c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T00:19:55.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.205+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.3 2024-09-12T00:19:55.209 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.205+0000 7fd07f14d9c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T00:19:55.209 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.205+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.4 2024-09-12T00:19:55.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.209+0000 7fd07f14d9c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T00:19:55.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.209+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:55.212 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.209+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.6 2024-09-12T00:19:55.212 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.209+0000 7fd07f14d9c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T00:19:55.213 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.209+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.7 2024-09-12T00:19:55.214 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.209+0000 7fd07f14d9c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T00:19:55.214 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.209+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:55.215 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.213+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.9 2024-09-12T00:19:55.215 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.213+0000 7fd07f14d9c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T00:19:55.215 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.213+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:55.216 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.213+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:55.217 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.213+0000 7fd07f14d9c0 20 get_obj_state: octx=0x5566543137e0 obj=check-bucket:e state=0x55665467a488 s->prefetch_data=0 2024-09-12T00:19:55.217 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.213+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:55.218 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.217+0000 7fd07f14d9c0 20 get_obj_state: octx=0x5566543d5540 obj=check-bucket:d state=0x556654675bf8 s->prefetch_data=0 2024-09-12T00:19:55.218 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.217+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:55.219 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.217+0000 7fd07f14d9c0 20 get_obj_state: octx=0x556654678cb0 obj=check-bucket:c state=0x556654670598 s->prefetch_data=0 2024-09-12T00:19:55.219 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.217+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:55.220 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.217+0000 7fd07f14d9c0 20 get_obj_state: octx=0x556654676570 obj=check-bucket:f state=0x556654671ff8 s->prefetch_data=0 2024-09-12T00:19:55.220 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.217+0000 7fd07f14d9c0 20 get_obj_state: setting s->obj_tag to 9q52a4h1ko313l8bsgspnkfkbclcs04s 2024-09-12T00:19:55.220 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.217+0000 7fd07f14d9c0 20 get_obj_state_impl: setting s->olh_tag to p7e9jx0t94xqqmtti2hscah6oji9ytkw 2024-09-12T00:19:55.220 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.217+0000 7fd07f14d9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=p7e9jx0t94xqqmtti2hscah6oji9ytkw 2024-09-12T00:19:55.220 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.217+0000 7fd07f14d9c0 20 get_obj_state: setting s->obj_tag to 2ogabylpa1njjbybaivjogjhnncm0983 2024-09-12T00:19:55.220 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.217+0000 7fd07f14d9c0 20 get_obj_state_impl: setting s->olh_tag to ykah45rkedzt6fyqxlyn92eg36bel1bw 2024-09-12T00:19:55.220 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.217+0000 7fd07f14d9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ykah45rkedzt6fyqxlyn92eg36bel1bw 2024-09-12T00:19:55.220 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.217+0000 7fd07f14d9c0 20 get_obj_state: setting s->obj_tag to 9kqrjx6fo3jw0145l5vi5d34qpif0t0j 2024-09-12T00:19:55.220 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.217+0000 7fd07f14d9c0 20 get_obj_state_impl: setting s->olh_tag to exdk25tlug9k5q1fgmq01954xmiwjlg0 2024-09-12T00:19:55.221 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.217+0000 7fd07f14d9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=exdk25tlug9k5q1fgmq01954xmiwjlg0 2024-09-12T00:19:55.221 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.217+0000 7fd07f14d9c0 20 get_obj_state: setting s->obj_tag to r2dc2t2v1uxk4vgt8cyljou0ablnoih4 2024-09-12T00:19:55.221 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.217+0000 7fd07f14d9c0 20 get_obj_state_impl: setting s->olh_tag to yvwu670x5eqow591ozyplywtuy5w50il 2024-09-12T00:19:55.221 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.217+0000 7fd07f14d9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=yvwu670x5eqow591ozyplywtuy5w50il 2024-09-12T00:19:55.222 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.221+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:55.223 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.221+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:55.223 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.221+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:55.224 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.221+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:55.225 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.221+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:55.225 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.221+0000 7fd07f14d9c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T00:19:55.225 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.221+0000 7fd07f14d9c0 20 olh_log_entry: epoch=2 op=3 key=e[Y3-CVTs9IOcBZ4YzL5GDZvOqFh5n-RC] 2024-09-12T00:19:55.226 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.221+0000 7fd07f14d9c0 20 get_obj_state: octx=0x5566543137e0 obj=check-bucket:_:Y3-CVTs9IOcBZ4YzL5GDZvOqFh5n-RC_e state=0x55665471d7d8 s->prefetch_data=0 2024-09-12T00:19:55.227 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.225+0000 7fd07f14d9c0 10 manifest: total_size = 22 2024-09-12T00:19:55.227 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.225+0000 7fd07f14d9c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2274685658510639379 2024-09-12T00:19:55.227 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.225+0000 7fd07f14d9c0 20 get_obj_state: octx=0x5566543137e0 obj=check-bucket:_:Y3-CVTs9IOcBZ4YzL5GDZvOqFh5n-RC_e state=0x55665471d7d8 s->prefetch_data=0 2024-09-12T00:19:55.227 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.225+0000 7fd07f14d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55665471d7d8 2024-09-12T00:19:55.227 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.225+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:55.227 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.225+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:55.228 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.225+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:55.228 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.225+0000 7fd07f14d9c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T00:19:55.228 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.225+0000 7fd07f14d9c0 20 olh_log_entry: epoch=2 op=3 key=f[17FiqPkpPf2Bv53y0kw3CNx8n9SMKMg] 2024-09-12T00:19:55.228 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.225+0000 7fd07f14d9c0 20 get_obj_state: octx=0x556654676570 obj=check-bucket:_:17FiqPkpPf2Bv53y0kw3CNx8n9SMKMg_f state=0x556654719528 s->prefetch_data=0 2024-09-12T00:19:55.228 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.225+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:55.228 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.225+0000 7fd07f14d9c0 20 olh_log_entry: epoch=3 op=3 key=c[F9z5rPixHq2K-FfCn5-o9eVZXngFtb5] 2024-09-12T00:19:55.228 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.225+0000 7fd07f14d9c0 20 get_obj_state: octx=0x556654678cb0 obj=check-bucket:_:F9z5rPixHq2K-FfCn5-o9eVZXngFtb5_c state=0x556654728fc8 s->prefetch_data=0 2024-09-12T00:19:55.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.225+0000 7fd07f14d9c0 20 olh_log_entry: epoch=3 op=3 key=d[QzodQhvA8zZgSE2GxVxEvlJK3BWNbJ6] 2024-09-12T00:19:55.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.225+0000 7fd07f14d9c0 20 get_obj_state: octx=0x5566543d5540 obj=check-bucket:_:QzodQhvA8zZgSE2GxVxEvlJK3BWNbJ6_d state=0x55665472e208 s->prefetch_data=0 2024-09-12T00:19:55.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.225+0000 7fd07f14d9c0 10 manifest: total_size = 12 2024-09-12T00:19:55.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.225+0000 7fd07f14d9c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13459045436317127407 2024-09-12T00:19:55.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.225+0000 7fd07f14d9c0 20 get_obj_state: octx=0x556654678cb0 obj=check-bucket:_:F9z5rPixHq2K-FfCn5-o9eVZXngFtb5_c state=0x556654728fc8 s->prefetch_data=0 2024-09-12T00:19:55.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.225+0000 7fd07f14d9c0 20 prepare_atomic_modification: state is not atomic. state=0x556654728fc8 2024-09-12T00:19:55.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.225+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:55.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.225+0000 7fd07f14d9c0 10 manifest: total_size = 11 2024-09-12T00:19:55.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.225+0000 7fd07f14d9c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10241856581926890317 2024-09-12T00:19:55.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.225+0000 7fd07f14d9c0 20 get_obj_state: octx=0x556654676570 obj=check-bucket:_:17FiqPkpPf2Bv53y0kw3CNx8n9SMKMg_f state=0x556654719528 s->prefetch_data=0 2024-09-12T00:19:55.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.225+0000 7fd07f14d9c0 20 prepare_atomic_modification: state is not atomic. state=0x556654719528 2024-09-12T00:19:55.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.225+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:55.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.225+0000 7fd07f14d9c0 10 manifest: total_size = 9 2024-09-12T00:19:55.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.225+0000 7fd07f14d9c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5452918592686031558 2024-09-12T00:19:55.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.225+0000 7fd07f14d9c0 20 get_obj_state: octx=0x5566543d5540 obj=check-bucket:_:QzodQhvA8zZgSE2GxVxEvlJK3BWNbJ6_d state=0x55665472e208 s->prefetch_data=0 2024-09-12T00:19:55.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.225+0000 7fd07f14d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55665472e208 2024-09-12T00:19:55.231 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.225+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:55.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.229+0000 7fd07f14d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:19:55.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.229+0000 7fd07f14d9c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T00:19:55.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.229+0000 7fd07f14d9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:19:55.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.229+0000 7fd07f14d9c0 5 delete_objs_inline: removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1__shadow:F9z5rPixHq2K-FfCn5-o9eVZXngFtb5_.TNskvIxjps1ZZM7zZaRjfmuCjcwaX0g_0 2024-09-12T00:19:55.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.229+0000 7fd07f14d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:19:55.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.229+0000 7fd07f14d9c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:19:55.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.229+0000 7fd07f14d9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:19:55.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.229+0000 7fd07f14d9c0 5 delete_objs_inline: removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1__shadow:Y3-CVTs9IOcBZ4YzL5GDZvOqFh5n-RC_.fsAdBO_BovPw4st2uGkHVWKSwHaQ186_0 2024-09-12T00:19:55.235 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.233+0000 7fd07f14d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:19:55.235 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.233+0000 7fd07f14d9c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T00:19:55.235 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.233+0000 7fd07f14d9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:19:55.235 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.233+0000 7fd07f14d9c0 5 delete_objs_inline: removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1__shadow:17FiqPkpPf2Bv53y0kw3CNx8n9SMKMg_.W-uSOiCTnUy_n2kCr79QJTgfLE_9GG2_0 2024-09-12T00:19:55.235 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.233+0000 7fd07f14d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:19:55.235 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.233+0000 7fd07f14d9c0 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-12T00:19:55.235 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.233+0000 7fd07f14d9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:19:55.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.233+0000 7fd07f14d9c0 5 delete_objs_inline: removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1__shadow:QzodQhvA8zZgSE2GxVxEvlJK3BWNbJ6_.Lm0m7MCYvwNZctwCS99CVdY-xi_VvGs_0 2024-09-12T00:19:55.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.233+0000 7fcf53fff640 20 handle_completion(): completion ok for obj=c[F9z5rPixHq2K-FfCn5-o9eVZXngFtb5] 2024-09-12T00:19:55.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.233+0000 7fd07f14d9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:19:55.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.233+0000 7fcf53fff640 20 handle_completion(): completion ok for obj=e[Y3-CVTs9IOcBZ4YzL5GDZvOqFh5n-RC] 2024-09-12T00:19:55.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.233+0000 7fd07f14d9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:19:55.237 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.233+0000 7fd07f14d9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:19:55.237 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.233+0000 7fcf537fe640 20 handle_completion(): completion ok for obj=f[17FiqPkpPf2Bv53y0kw3CNx8n9SMKMg] 2024-09-12T00:19:55.238 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.233+0000 7fd07f14d9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:19:55.238 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.237+0000 7fcf537fe640 20 handle_completion(): completion ok for obj=d[QzodQhvA8zZgSE2GxVxEvlJK3BWNbJ6] 2024-09-12T00:19:55.239 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.237+0000 7fd07f14d9c0 20 get_obj_state: octx=0x5566543137e0 obj=check-bucket:e state=0x55665467a488 s->prefetch_data=0 2024-09-12T00:19:55.239 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.237+0000 7fd07f14d9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=p7e9jx0t94xqqmtti2hscah6oji9ytkw 2024-09-12T00:19:55.240 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.237+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:55.240 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.237+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:55.242 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.237+0000 7fd07f14d9c0 20 get_obj_state: octx=0x556654676570 obj=check-bucket:f state=0x556654671ff8 s->prefetch_data=0 2024-09-12T00:19:55.242 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.237+0000 7fd07f14d9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=yvwu670x5eqow591ozyplywtuy5w50il 2024-09-12T00:19:55.242 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.237+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:55.242 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.237+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:55.242 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.237+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.8 2024-09-12T00:19:55.242 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.237+0000 7fd07f14d9c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T00:19:55.244 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.241+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.5 2024-09-12T00:19:55.244 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.241+0000 7fd07f14d9c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T00:19:55.245 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.241+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:55.247 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.245+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.1 2024-09-12T00:19:55.247 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.245+0000 7fd07f14d9c0 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-12T00:19:55.249 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.245+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:55.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.249+0000 7fd07f14d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1.10 2024-09-12T00:19:55.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.249+0000 7fd07f14d9c0 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-12T00:19:55.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.249+0000 7fd07f14d9c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T00:19:55.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.249+0000 7fcf32fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:55.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.257+0000 7fd07f14d9c0 20 remove_watcher() i=0 2024-09-12T00:19:55.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.257+0000 7fd07f14d9c0 2 removed watcher, disabling cache 2024-09-12T00:19:55.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.257+0000 7fd07f14d9c0 20 remove_watcher() i=1 2024-09-12T00:19:55.263 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.261+0000 7fd07f14d9c0 20 remove_watcher() i=2 2024-09-12T00:19:55.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.261+0000 7fd07f14d9c0 20 remove_watcher() i=3 2024-09-12T00:19:55.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.265+0000 7fd07f14d9c0 20 remove_watcher() i=4 2024-09-12T00:19:55.269 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.265+0000 7fd07f14d9c0 20 remove_watcher() i=5 2024-09-12T00:19:55.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.269+0000 7fd07f14d9c0 20 remove_watcher() i=6 2024-09-12T00:19:55.272 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.269+0000 7fd07f14d9c0 20 remove_watcher() i=7 2024-09-12T00:19:55.291 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:55.291 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:55.299 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:55.299 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:55.347 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T00:19:55.382 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:55.382 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:55.647 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.645+0000 7f6aeaf759c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:55.649 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.645+0000 7f6aeaf759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:55.649 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.645+0000 7f6aeaf759c0 20 realm 2024-09-12T00:19:55.649 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.645+0000 7f6aeaf759c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:55.650 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.645+0000 7f6aeaf759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:55.650 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.645+0000 7f6aeaf759c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:55.650 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.645+0000 7f6aeaf759c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:55.650 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.645+0000 7f6aeaf759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:55.650 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.645+0000 7f6aeaf759c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:55.651 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.649+0000 7f6aeaf759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:55.651 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.649+0000 7f6aeaf759c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:55.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.649+0000 7f6aeaf759c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:55.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.649+0000 7f6aeaf759c0 20 searching for the correct realm 2024-09-12T00:19:55.662 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.657+0000 7f6ae827a640 0 -- 172.21.15.43:0/3103124092 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f6adc008040 msgr2=0x7f6adc048c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:55.880 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:55.877+0000 7f6ae8a7b640 0 -- 172.21.15.43:0/3103124092 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f6adc08f790 msgr2=0x7f6adc048350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:56.097 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.093+0000 7f6aeaf759c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:19:56.097 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.093+0000 7f6aeaf759c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:56.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.093+0000 7f6aeaf759c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:56.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.093+0000 7f6aeaf759c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:19:56.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.093+0000 7f6aeaf759c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:56.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.093+0000 7f6aeaf759c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:56.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.093+0000 7f6aeaf759c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:56.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.093+0000 7f6aeaf759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:56.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.093+0000 7f6aeaf759c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:56.099 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.097+0000 7f6aeaf759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:56.099 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.097+0000 7f6aeaf759c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:56.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.097+0000 7f6aeaf759c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:56.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.097+0000 7f6aeaf759c0 20 zone default found 2024-09-12T00:19:56.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.097+0000 7f6aeaf759c0 4 Realm: () 2024-09-12T00:19:56.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.097+0000 7f6aeaf759c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:19:56.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.097+0000 7f6aeaf759c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:19:56.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.097+0000 7f6aeaf759c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:56.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.097+0000 7f6aeaf759c0 20 zonegroup default 2024-09-12T00:19:56.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.097+0000 7f6aeaf759c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:56.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.097+0000 7f6aeaf759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:56.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.097+0000 7f6aeaf759c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:56.102 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.097+0000 7f6aeaf759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:56.102 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.097+0000 7f6aeaf759c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:56.102 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.101+0000 7f6aeaf759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:56.103 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.101+0000 7f6aeaf759c0 20 started sync module instance, tier type = 2024-09-12T00:19:56.103 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.101+0000 7f6aeaf759c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:19:56.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.129+0000 7f6aeaf759c0 20 add_watcher() i=0 2024-09-12T00:19:56.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.129+0000 7f6aeaf759c0 20 add_watcher() i=1 2024-09-12T00:19:56.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.129+0000 7f6aeaf759c0 20 add_watcher() i=2 2024-09-12T00:19:56.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.129+0000 7f6aeaf759c0 20 add_watcher() i=3 2024-09-12T00:19:56.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.129+0000 7f6aeaf759c0 20 add_watcher() i=4 2024-09-12T00:19:56.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.129+0000 7f6aeaf759c0 20 add_watcher() i=5 2024-09-12T00:19:56.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.129+0000 7f6aeaf759c0 20 add_watcher() i=6 2024-09-12T00:19:56.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.129+0000 7f6aeaf759c0 20 add_watcher() i=7 2024-09-12T00:19:56.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.129+0000 7f6aeaf759c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:56.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.133+0000 7f699f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:56.138 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.137+0000 7f6aeaf759c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:56.138 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.137+0000 7f6aeaf759c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:56.138 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.137+0000 7f6aeaf759c0 5 note: GC not initialized 2024-09-12T00:19:56.139 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.137+0000 7f699e7e4640 20 reqs_thread_entry: start 2024-09-12T00:19:56.139 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.137+0000 7f6aeaf759c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:56.139 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.137+0000 7f6aeaf759c0 20 Filter name: none 2024-09-12T00:19:56.140 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.137+0000 7f69977fe640 20 reqs_thread_entry: start 2024-09-12T00:19:56.140 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.137+0000 7f6aeaf759c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:56.141 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.137+0000 7f6aeaf759c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:19:56.141 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.137+0000 7f6aeaf759c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:56.142 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.141+0000 7f6aeaf759c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:19:56.143 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.141+0000 7f6aeaf759c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:56.143 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.141+0000 7f6aeaf759c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:56.143 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.141+0000 7f6aeaf759c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:19:56.143 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.141+0000 7f6aeaf759c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:56.144 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.141+0000 7f6aeaf759c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:19:56.144 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.141+0000 7f6aeaf759c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:56.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.145+0000 7f699f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:56.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.149+0000 7f6aeaf759c0 20 remove_watcher() i=0 2024-09-12T00:19:56.153 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.149+0000 7f6aeaf759c0 2 removed watcher, disabling cache 2024-09-12T00:19:56.155 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.153+0000 7f6aeaf759c0 20 remove_watcher() i=1 2024-09-12T00:19:56.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.157+0000 7f6aeaf759c0 20 remove_watcher() i=2 2024-09-12T00:19:56.161 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.157+0000 7f6aeaf759c0 20 remove_watcher() i=3 2024-09-12T00:19:56.163 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.161+0000 7f6aeaf759c0 20 remove_watcher() i=4 2024-09-12T00:19:56.165 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.161+0000 7f6aeaf759c0 20 remove_watcher() i=5 2024-09-12T00:19:56.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.165+0000 7f6aeaf759c0 20 remove_watcher() i=6 2024-09-12T00:19:56.168 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:19:56.165+0000 7f6aeaf759c0 20 remove_watcher() i=7 2024-09-12T00:19:56.185 INFO:tasks.workunit.client.0.smithi043.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T00:19:56.185 INFO:tasks.workunit.client.0.smithi043.stderr:Deleting bucket check-bucket 2024-09-12T00:19:56.187 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:56.187 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:56.193 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:19:56.194 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:19:56.250 INFO:tasks.workunit.client.0.smithi043.stderr:Completed bucket check tests 2024-09-12T00:19:56.250 INFO:tasks.workunit.client.0.smithi043.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T00:19:56.250 INFO:tasks.workunit.client.0.smithi043.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T00:19:56.250 INFO:tasks.workunit.client.0.smithi043.stdout:connected to https://localhost:443 2024-09-12T00:19:56.343 INFO:tasks.workunit.client.0.smithi043.stderr:+ deactivate 2024-09-12T00:19:56.343 INFO:tasks.workunit.client.0.smithi043.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T00:19:56.343 INFO:tasks.workunit.client.0.smithi043.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:19:56.343 INFO:tasks.workunit.client.0.smithi043.stderr:+ export PATH 2024-09-12T00:19:56.343 INFO:tasks.workunit.client.0.smithi043.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:19:56.343 INFO:tasks.workunit.client.0.smithi043.stderr:+ '[' -n '' ']' 2024-09-12T00:19:56.344 INFO:tasks.workunit.client.0.smithi043.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:19:56.344 INFO:tasks.workunit.client.0.smithi043.stderr:+ hash -r 2024-09-12T00:19:56.344 INFO:tasks.workunit.client.0.smithi043.stderr:+ '[' -n '' ']' 2024-09-12T00:19:56.344 INFO:tasks.workunit.client.0.smithi043.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:19:56.344 INFO:tasks.workunit.client.0.smithi043.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T00:19:56.344 INFO:tasks.workunit.client.0.smithi043.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:19:56.344 INFO:tasks.workunit.client.0.smithi043.stderr:+ unset -f deactivate 2024-09-12T00:19:56.344 INFO:tasks.workunit.client.0.smithi043.stderr:+ echo OK. 2024-09-12T00:19:56.345 INFO:tasks.workunit.client.0.smithi043.stdout:OK. 2024-09-12T00:19:56.345 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:19:56.346 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:19:56.358 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-12T00:19:56.359 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:19:56.770 DEBUG:teuthology.parallel:result is None 2024-09-12T00:19:56.771 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:19:56.783 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:19:56.783 DEBUG:teuthology.orchestra.run.smithi043:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:19:56.840 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:19:56.840 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:19:56.851 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:19:56.851 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:19:56.851 DEBUG:teuthology.orchestra.run.smithi043:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:19:56.887 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:19:56.887 INFO:teuthology.orchestra.run.smithi043.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:19:56.887 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:19:56.936 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:19:56.936 DEBUG:teuthology.orchestra.run.smithi043:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:19:56.983 INFO:tasks.workunit:timeout=3h 2024-09-12T00:19:56.983 INFO:tasks.workunit:cleanup=True 2024-09-12T00:19:56.984 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:19:57.033 INFO:tasks.workunit.client.0.smithi043.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:20:40.844 INFO:tasks.workunit.client.0.smithi043.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:20:40.845 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:20:40.845 INFO:tasks.workunit.client.0.smithi043.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:20:40.845 INFO:tasks.workunit.client.0.smithi043.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:20:40.845 INFO:tasks.workunit.client.0.smithi043.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:20:40.845 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:20:40.845 INFO:tasks.workunit.client.0.smithi043.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:20:40.845 INFO:tasks.workunit.client.0.smithi043.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:20:40.846 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:20:40.846 INFO:tasks.workunit.client.0.smithi043.stderr: git switch -c 2024-09-12T00:20:40.846 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:20:40.846 INFO:tasks.workunit.client.0.smithi043.stderr:Or undo this operation with: 2024-09-12T00:20:40.846 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:20:40.846 INFO:tasks.workunit.client.0.smithi043.stderr: git switch - 2024-09-12T00:20:40.846 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:20:40.846 INFO:tasks.workunit.client.0.smithi043.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:20:40.846 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:20:40.846 INFO:tasks.workunit.client.0.smithi043.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:20:40.852 DEBUG:teuthology.orchestra.run.smithi043:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:20:40.904 INFO:tasks.workunit.client.0.smithi043.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:20:40.906 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:20:40.906 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:20:40.969 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:20:41.030 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:20:41.078 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:20:41.079 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:20:41.079 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:20:41.124 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:20:41.128 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:20:41.128 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:20:41.175 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-12T00:20:41.176 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-12T00:20:41.176 DEBUG:teuthology.orchestra.run.smithi043:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-12T00:20:41.237 INFO:tasks.workunit.client.0.smithi043.stdout:Running main() from gmock_main.cc 2024-09-12T00:20:41.237 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:20:41.237 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment set-up. 2024-09-12T00:20:41.237 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 11 tests from ClsLock 2024-09-12T00:20:41.238 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-12T00:20:42.652 INFO:tasks.workunit.client.0.smithi043.stdout:lock: mylock 2024-09-12T00:20:42.653 INFO:tasks.workunit.client.0.smithi043.stdout: lock_type: exclusive 2024-09-12T00:20:42.653 INFO:tasks.workunit.client.0.smithi043.stdout: tag: 2024-09-12T00:20:42.653 INFO:tasks.workunit.client.0.smithi043.stdout: lockers: 2024-09-12T00:20:42.653 INFO:tasks.workunit.client.0.smithi043.stdout: client.5118 expiration=2024-09-12T00:22:42.647180+0000 addr=v1:172.21.15.43:0/3501822712 cookie= 2024-09-12T00:20:42.661 INFO:tasks.workunit.client.0.smithi043.stdout:lock: mylock 2024-09-12T00:20:42.661 INFO:tasks.workunit.client.0.smithi043.stdout: lock_type: shared 2024-09-12T00:20:42.661 INFO:tasks.workunit.client.0.smithi043.stdout: tag: 2024-09-12T00:20:42.661 INFO:tasks.workunit.client.0.smithi043.stdout: lockers: 2024-09-12T00:20:42.662 INFO:tasks.workunit.client.0.smithi043.stdout: client.5118 expiration=2024-09-12T00:22:42.661491+0000 addr=v1:172.21.15.43:0/3501822712 cookie= 2024-09-12T00:20:42.662 INFO:tasks.workunit.client.0.smithi043.stdout: client.5124 expiration=0.000000 addr=v1:172.21.15.43:0/2740609224 cookie= 2024-09-12T00:20:42.665 INFO:tasks.workunit.client.0.smithi043.stdout:lock: mylock 2024-09-12T00:20:42.665 INFO:tasks.workunit.client.0.smithi043.stdout: lock_type: shared 2024-09-12T00:20:42.665 INFO:tasks.workunit.client.0.smithi043.stdout: tag: 2024-09-12T00:20:42.665 INFO:tasks.workunit.client.0.smithi043.stdout: lockers: 2024-09-12T00:20:42.665 INFO:tasks.workunit.client.0.smithi043.stdout: client.5124 expiration=0.000000 addr=v1:172.21.15.43:0/2740609224 cookie= 2024-09-12T00:20:43.588 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] ClsLock.TestMultiLocking (2351 ms) 2024-09-12T00:20:43.589 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] ClsLock.TestMeta 2024-09-12T00:20:45.902 INFO:tasks.workunit.client.0.smithi043.stdout:lock: mylock 2024-09-12T00:20:45.902 INFO:tasks.workunit.client.0.smithi043.stdout: lock_type: shared 2024-09-12T00:20:45.902 INFO:tasks.workunit.client.0.smithi043.stdout: tag: 2024-09-12T00:20:45.902 INFO:tasks.workunit.client.0.smithi043.stdout: lockers: 2024-09-12T00:20:45.902 INFO:tasks.workunit.client.0.smithi043.stdout: client.5139 expiration=0.000000 addr=v1:172.21.15.43:0/2642953777 cookie= 2024-09-12T00:20:45.908 INFO:tasks.workunit.client.0.smithi043.stdout:lock: mylock 2024-09-12T00:20:45.908 INFO:tasks.workunit.client.0.smithi043.stdout: lock_type: exclusive 2024-09-12T00:20:45.909 INFO:tasks.workunit.client.0.smithi043.stdout: tag: new_tag 2024-09-12T00:20:45.909 INFO:tasks.workunit.client.0.smithi043.stdout: lockers: 2024-09-12T00:20:45.909 INFO:tasks.workunit.client.0.smithi043.stdout: client.5133 expiration=0.000000 addr=v1:172.21.15.43:0/2101582502 cookie= 2024-09-12T00:20:46.638 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] ClsLock.TestMeta (3050 ms) 2024-09-12T00:20:46.638 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] ClsLock.TestCookie 2024-09-12T00:20:48.722 INFO:tasks.workunit.client.0.smithi043.stdout:lock: mylock 2024-09-12T00:20:48.722 INFO:tasks.workunit.client.0.smithi043.stdout: lock_type: exclusive 2024-09-12T00:20:48.722 INFO:tasks.workunit.client.0.smithi043.stdout: tag: 2024-09-12T00:20:48.722 INFO:tasks.workunit.client.0.smithi043.stdout: lockers: 2024-09-12T00:20:48.727 INFO:tasks.workunit.client.0.smithi043.stdout:lock: mylock 2024-09-12T00:20:48.727 INFO:tasks.workunit.client.0.smithi043.stdout: lock_type: shared 2024-09-12T00:20:48.727 INFO:tasks.workunit.client.0.smithi043.stdout: tag: 2024-09-12T00:20:48.727 INFO:tasks.workunit.client.0.smithi043.stdout: lockers: 2024-09-12T00:20:48.727 INFO:tasks.workunit.client.0.smithi043.stdout: client.5027 expiration=0.000000 addr=v1:172.21.15.43:0/2494151397 cookie= 2024-09-12T00:20:48.727 INFO:tasks.workunit.client.0.smithi043.stdout: client.5027 expiration=0.000000 addr=v1:172.21.15.43:0/2494151397 cookie=new cookie 2024-09-12T00:20:49.697 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] ClsLock.TestCookie (3059 ms) 2024-09-12T00:20:49.697 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-12T00:20:52.742 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] ClsLock.TestMultipleLocks (3045 ms) 2024-09-12T00:20:52.742 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-12T00:20:59.856 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] ClsLock.TestLockDuration (7114 ms) 2024-09-12T00:20:59.856 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-12T00:21:02.923 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] ClsLock.TestAssertLocked (3067 ms) 2024-09-12T00:21:02.923 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-12T00:21:05.927 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] ClsLock.TestSetCookie (3004 ms) 2024-09-12T00:21:05.927 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] ClsLock.TestRenew 2024-09-12T00:21:27.010 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] ClsLock.TestRenew (21083 ms) 2024-09-12T00:21:27.011 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-12T00:21:33.132 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6122 ms) 2024-09-12T00:21:33.133 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-12T00:21:40.246 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7108 ms) 2024-09-12T00:21:40.246 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-12T00:21:48.452 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8212 ms) 2024-09-12T00:21:48.453 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 11 tests from ClsLock (67216 ms total) 2024-09-12T00:21:48.453 INFO:tasks.workunit.client.0.smithi043.stdout: 2024-09-12T00:21:48.453 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment tear-down 2024-09-12T00:21:48.453 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] 11 tests from 1 test suite ran. (67216 ms total) 2024-09-12T00:21:48.453 INFO:tasks.workunit.client.0.smithi043.stdout:[ PASSED ] 11 tests. 2024-09-12T00:21:48.459 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:21:48.459 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:21:48.516 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-12T00:21:48.517 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-12T00:21:48.518 DEBUG:teuthology.orchestra.run.smithi043:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-12T00:21:48.581 INFO:tasks.workunit.client.0.smithi043.stdout:Running main() from gmock_main.cc 2024-09-12T00:21:48.581 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:21:48.582 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment set-up. 2024-09-12T00:21:48.582 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 4 tests from cls_log 2024-09-12T00:21:48.582 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-12T00:21:51.488 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_log.test_log_add_same_time (2906 ms) 2024-09-12T00:21:51.488 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-12T00:21:54.531 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_log.test_log_add_different_time (3044 ms) 2024-09-12T00:21:54.531 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_log.trim_by_time 2024-09-12T00:21:57.558 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_log.trim_by_time (3022 ms) 2024-09-12T00:21:57.558 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-12T00:22:00.622 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_log.trim_by_marker (3068 ms) 2024-09-12T00:22:00.622 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 4 tests from cls_log (12040 ms total) 2024-09-12T00:22:00.622 INFO:tasks.workunit.client.0.smithi043.stdout: 2024-09-12T00:22:00.623 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment tear-down 2024-09-12T00:22:00.623 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] 4 tests from 1 test suite ran. (12040 ms total) 2024-09-12T00:22:00.623 INFO:tasks.workunit.client.0.smithi043.stdout:[ PASSED ] 4 tests. 2024-09-12T00:22:00.629 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:22:00.629 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:22:00.684 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-12T00:22:00.685 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-12T00:22:00.685 DEBUG:teuthology.orchestra.run.smithi043:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-12T00:22:00.749 INFO:tasks.workunit.client.0.smithi043.stdout:Running main() from gmock_main.cc 2024-09-12T00:22:00.750 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T00:22:00.750 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment set-up. 2024-09-12T00:22:00.750 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 10 tests from cls_refcount 2024-09-12T00:22:00.750 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-12T00:22:03.632 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_refcount.test_implicit (2883 ms) 2024-09-12T00:22:03.680 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-12T00:22:06.682 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3048 ms) 2024-09-12T00:22:06.682 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-12T00:22:15.800 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_refcount.test_put_snap (9119 ms) 2024-09-12T00:22:15.800 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-12T00:22:18.817 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_refcount.test_explicit (3017 ms) 2024-09-12T00:22:18.817 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_refcount.set 2024-09-12T00:22:21.859 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_refcount.set (3042 ms) 2024-09-12T00:22:21.859 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-12T00:22:28.963 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_refcount.test_implicit_ec (7103 ms) 2024-09-12T00:22:28.963 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-12T00:22:36.047 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7085 ms) 2024-09-12T00:22:36.047 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-12T00:22:49.126 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_refcount.test_put_snap_ec (13078 ms) 2024-09-12T00:22:49.126 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-12T00:22:56.185 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_refcount.test_explicit_ec (7060 ms) 2024-09-12T00:22:56.185 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_refcount.set_ec 2024-09-12T00:23:03.229 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_refcount.set_ec (7043 ms) 2024-09-12T00:23:03.229 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 10 tests from cls_refcount (62479 ms total) 2024-09-12T00:23:03.229 INFO:tasks.workunit.client.0.smithi043.stdout: 2024-09-12T00:23:03.229 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment tear-down 2024-09-12T00:23:03.229 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] 10 tests from 1 test suite ran. (62479 ms total) 2024-09-12T00:23:03.229 INFO:tasks.workunit.client.0.smithi043.stdout:[ PASSED ] 10 tests. 2024-09-12T00:23:03.232 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:23:03.232 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:23:03.287 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-12T00:23:03.289 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-12T00:23:03.289 DEBUG:teuthology.orchestra.run.smithi043:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-12T00:23:03.354 INFO:tasks.workunit.client.0.smithi043.stdout:Running main() from gmock_main.cc 2024-09-12T00:23:03.354 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:23:03.354 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment set-up. 2024-09-12T00:23:03.354 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 19 tests from cls_rgw 2024-09-12T00:23:05.237 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_rgw.index_basic 2024-09-12T00:23:05.304 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_rgw.index_basic (68 ms) 2024-09-12T00:23:05.305 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-12T00:23:05.391 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (87 ms) 2024-09-12T00:23:05.392 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-12T00:23:05.504 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_rgw.index_remove_object (112 ms) 2024-09-12T00:23:05.504 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-12T00:23:07.998 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_rgw.index_suggest (2495 ms) 2024-09-12T00:23:07.998 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-12T00:23:08.011 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_rgw.index_suggest_complete (13 ms) 2024-09-12T00:23:08.012 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_rgw.index_list 2024-09-12T00:23:08.065 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_rgw.index_list (54 ms) 2024-09-12T00:23:08.065 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-12T00:23:57.998 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_rgw.index_list_delimited (49932 ms) 2024-09-12T00:23:57.999 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_rgw.bi_list 2024-09-12T00:23:58.188 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_rgw.bi_list (191 ms) 2024-09-12T00:23:58.188 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_rgw.gc_set 2024-09-12T00:23:58.211 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_rgw.gc_set (23 ms) 2024-09-12T00:23:58.211 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_rgw.gc_list 2024-09-12T00:23:58.236 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_rgw.gc_list (24 ms) 2024-09-12T00:23:58.236 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-12T00:24:05.616 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_rgw.gc_defer (7379 ms) 2024-09-12T00:24:05.617 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-12T00:24:05.791 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_rgw.usage_basic (176 ms) 2024-09-12T00:24:05.791 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-12T00:24:05.793 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_rgw.usage_clear_no_obj (2 ms) 2024-09-12T00:24:05.793 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-12T00:24:06.033 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_rgw.usage_clear (239 ms) 2024-09-12T00:24:06.033 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-12T00:24:06.154 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_rgw.bi_log_trim (120 ms) 2024-09-12T00:24:06.154 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-12T00:24:06.188 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_rgw.index_racing_removes (34 ms) 2024-09-12T00:24:06.188 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-12T00:24:06.229 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_rgw.reshardlog_list (41 ms) 2024-09-12T00:24:06.229 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-12T00:24:06.261 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_rgw.reshardlog_num (32 ms) 2024-09-12T00:24:06.261 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_rgw.bi_put_entries 2024-09-12T00:24:06.320 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_rgw.bi_put_entries (59 ms) 2024-09-12T00:24:06.644 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 19 tests from cls_rgw (61084 ms total) 2024-09-12T00:24:06.645 INFO:tasks.workunit.client.0.smithi043.stdout: 2024-09-12T00:24:06.645 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment tear-down 2024-09-12T00:24:06.645 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] 19 tests from 1 test suite ran. (63290 ms total) 2024-09-12T00:24:06.645 INFO:tasks.workunit.client.0.smithi043.stdout:[ PASSED ] 19 tests. 2024-09-12T00:24:06.655 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:24:06.655 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:24:06.712 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-12T00:24:06.714 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-12T00:24:06.714 DEBUG:teuthology.orchestra.run.smithi043:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-12T00:24:06.778 INFO:tasks.workunit.client.0.smithi043.stdout:Running main() from gmock_main.cc 2024-09-12T00:24:06.779 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:24:06.779 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment set-up. 2024-09-12T00:24:06.779 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-12T00:24:06.779 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_rgw_gc.init 2024-09-12T00:24:08.652 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_rgw_gc.init (1874 ms) 2024-09-12T00:24:08.652 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-12T00:24:08.687 INFO:tasks.workunit.client.0.smithi043.stderr:[ ] list info tag = chain-0 2024-09-12T00:24:08.687 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (35 ms) 2024-09-12T00:24:08.688 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-12T00:24:08.699 INFO:tasks.workunit.client.0.smithi043.stderr:[ ] next_marker is: = 0/4263 2024-09-12T00:24:08.699 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (13 ms) 2024-09-12T00:24:08.700 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-12T00:24:08.715 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (15 ms) 2024-09-12T00:24:08.715 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-12T00:24:08.886 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (171 ms) 2024-09-12T00:24:08.886 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-12T00:24:08.905 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (19 ms) 2024-09-12T00:24:08.905 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-12T00:24:08.925 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (20 ms) 2024-09-12T00:24:08.925 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-12T00:24:08.942 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (17 ms) 2024-09-12T00:24:08.943 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-12T00:24:09.698 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_rgw_gc.finalize (748 ms) 2024-09-12T00:24:09.698 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 9 tests from cls_rgw_gc (2912 ms total) 2024-09-12T00:24:09.698 INFO:tasks.workunit.client.0.smithi043.stdout: 2024-09-12T00:24:09.698 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment tear-down 2024-09-12T00:24:09.698 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] 9 tests from 1 test suite ran. (2913 ms total) 2024-09-12T00:24:09.698 INFO:tasks.workunit.client.0.smithi043.stdout:[ PASSED ] 9 tests. 2024-09-12T00:24:09.698 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:24:09.699 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:24:09.755 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-12T00:24:09.756 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-12T00:24:09.756 DEBUG:teuthology.orchestra.run.smithi043:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-12T00:24:09.832 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:09.833 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:09.833 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] Running 1 test from 1 test suite. 2024-09-12T00:24:09.833 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment set-up. 2024-09-12T00:24:11.693 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 1 test from cls_rgw_stats 2024-09-12T00:24:11.693 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-12T00:24:11.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.735+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~E0U9HVVSWGPO.0 size=941596 2024-09-12T00:24:11.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.735+0000 7f0d199128c0 1 > prepared multipart upload key=RX3RVT06SGJ4 upload=E0U9HVVSWGPO tag=JN67I3IB1YNF type=write size=1990172 2024-09-12T00:24:11.736 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.735+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=EPFCHL3YLKLU type=del size=3142103 2024-09-12T00:24:11.739 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.739+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=SXJSRG2JJPKL type=write size=996063 2024-09-12T00:24:11.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.743+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~XAOA8QTDSGC0.0 size=280927 2024-09-12T00:24:11.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.743+0000 7f0d199128c0 1 > prepared multipart upload key=H604SA6XTFLY upload=XAOA8QTDSGC0 tag=XXZNN3CRD3OW type=write size=1329503 2024-09-12T00:24:11.747 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.747+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=Y0W5T3MSY6UM type=write size=430831 2024-09-12T00:24:11.752 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.751+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~W0BUE4YR4NQJ.0 size=1048576 2024-09-12T00:24:11.754 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.755+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~W0BUE4YR4NQJ.1 size=679834 2024-09-12T00:24:11.754 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.755+0000 7f0d199128c0 1 > prepared multipart upload key=JA6CSJF78VE2 upload=W0BUE4YR4NQJ tag=ROQS310V5URN type=write size=2776986 2024-09-12T00:24:11.760 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.759+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~5JQU9A24DGGY.0 size=655235 2024-09-12T00:24:11.760 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.759+0000 7f0d199128c0 1 > prepared multipart upload key=10YEWZDTTEV0 upload=5JQU9A24DGGY tag=RHZLNP907APU type=write size=1703811 2024-09-12T00:24:11.763 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.763+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=01PM0BWNGF90 type=del size=1084471 2024-09-12T00:24:11.766 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.767+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=O0O8W7C3VAZZ type=del size=856686 2024-09-12T00:24:11.768 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.767+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=ZC25BAVSFGTE type=del size=2462133 2024-09-12T00:24:11.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.771+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=53DTSF1HXNF8 type=del size=1445329 2024-09-12T00:24:11.776 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.775+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~2PC8D12G2NJS.0 size=553663 2024-09-12T00:24:11.777 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.775+0000 7f0d199128c0 1 > prepared multipart upload key=V6H6S9X0U2A0 upload=2PC8D12G2NJS tag=9HNIDUO7WCBK type=write size=1602239 2024-09-12T00:24:11.779 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.779+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=5P6XJ2M0M2R9 type=del size=878295 2024-09-12T00:24:11.785 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.783+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~HH1SOLKZLAU0.0 size=1048576 2024-09-12T00:24:11.787 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.787+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~HH1SOLKZLAU0.1 size=568292 2024-09-12T00:24:11.787 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.787+0000 7f0d199128c0 1 > prepared multipart upload key=FJ8YV026H0ZU upload=HH1SOLKZLAU0 tag=B7P0XUZY3TMQ type=write size=2665444 2024-09-12T00:24:11.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.791+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=NSOEQWF3BUVK type=del size=1789622 2024-09-12T00:24:11.796 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.795+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~VMLFAIVPXMOG.0 size=1048576 2024-09-12T00:24:11.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.799+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~VMLFAIVPXMOG.1 size=1048576 2024-09-12T00:24:11.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.799+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~VMLFAIVPXMOG.2 size=452007 2024-09-12T00:24:11.801 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.799+0000 7f0d199128c0 1 > prepared multipart upload key=YTXW98O07966 upload=VMLFAIVPXMOG tag=AWI4GUWQ3WGO type=write size=3597735 2024-09-12T00:24:11.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.803+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~E0U9HVVSWGPO.0 size=941596 2024-09-12T00:24:11.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.807+0000 7f0d199128c0 1 < completed multipart upload key=RX3RVT06SGJ4 upload=E0U9HVVSWGPO tag=JN67I3IB1YNF type=write size=1990172 2024-09-12T00:24:11.812 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.811+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=MS0BRVSKG2QO type=write size=952445 2024-09-12T00:24:11.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.815+0000 7f0d199128c0 1 < canceled operation key=J75P0821XGRO tag=EPFCHL3YLKLU type=del size=3142103 2024-09-12T00:24:11.817 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.815+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=LWJVQJB9UIS8 type=del size=2466690 2024-09-12T00:24:11.819 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.819+0000 7f0d199128c0 1 < completed write operation key=2EK9CCKG26W2 tag=SXJSRG2JJPKL type=write size=996063 2024-09-12T00:24:11.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.823+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=941AOPNWFJZ1 type=del size=3013620 2024-09-12T00:24:11.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.823+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~XAOA8QTDSGC0.0 size=280927 2024-09-12T00:24:11.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.831+0000 7f0d199128c0 1 < completed multipart upload key=H604SA6XTFLY upload=XAOA8QTDSGC0 tag=XXZNN3CRD3OW type=write size=1329503 2024-09-12T00:24:11.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.835+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~LXMDA9DFKHXT.0 size=1048576 2024-09-12T00:24:11.837 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.835+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~LXMDA9DFKHXT.1 size=637405 2024-09-12T00:24:11.837 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.835+0000 7f0d199128c0 1 > prepared multipart upload key=YTXW98O07966 upload=LXMDA9DFKHXT tag=0ELQ3JTCP1M0 type=write size=2734557 2024-09-12T00:24:11.842 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.843+0000 7f0d199128c0 1 < suggested remove operation key=OVLAP0OS78QG tag=Y0W5T3MSY6UM type=write 2024-09-12T00:24:11.846 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.847+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~RBG3NAG2OYXI.0 size=1048576 2024-09-12T00:24:11.848 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.847+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~RBG3NAG2OYXI.1 size=1048576 2024-09-12T00:24:11.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.851+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~RBG3NAG2OYXI.2 size=204192 2024-09-12T00:24:11.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.851+0000 7f0d199128c0 1 > prepared multipart upload key=9I6MZAEUS4I0 upload=RBG3NAG2OYXI tag=QY1A6F8OQ0R0 type=write size=3349920 2024-09-12T00:24:11.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.851+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~W0BUE4YR4NQJ.0 size=1048576 2024-09-12T00:24:11.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.855+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~W0BUE4YR4NQJ.1 size=679834 2024-09-12T00:24:11.859 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.859+0000 7f0d199128c0 1 < completed multipart upload key=JA6CSJF78VE2 upload=W0BUE4YR4NQJ tag=ROQS310V5URN type=write size=2776986 2024-09-12T00:24:11.862 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.863+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=6MZS0VO9DABZ type=del size=3511868 2024-09-12T00:24:11.865 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.863+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~5JQU9A24DGGY.0 size=655235 2024-09-12T00:24:11.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.867+0000 7f0d199128c0 1 < completed multipart upload key=10YEWZDTTEV0 upload=5JQU9A24DGGY tag=RHZLNP907APU type=write size=1703811 2024-09-12T00:24:11.872 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.871+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=XPSP28AJUJ7D type=write size=569260 2024-09-12T00:24:11.874 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.875+0000 7f0d199128c0 1 < completed delete operation key=JA6CSJF78VE2 tag=01PM0BWNGF90 type=del 2024-09-12T00:24:11.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.875+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=S1JB1RTINOSG type=del size=2471244 2024-09-12T00:24:11.882 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.883+0000 7f0d199128c0 1 < suggested update operation key=ZWGD87Z1MMNK tag=O0O8W7C3VAZZ type=del size=856686 2024-09-12T00:24:11.885 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.883+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=UDT6CBEH61X8 type=del size=3583050 2024-09-12T00:24:11.888 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.887+0000 7f0d199128c0 -1 < failed to complete operation key=ZWGD87Z1MMNK tag=ZC25BAVSFGTE type=del size=2462133: (22) Invalid argument 2024-09-12T00:24:11.894 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.895+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~TFP63BBAAL10.0 size=1048576 2024-09-12T00:24:11.896 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.895+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~TFP63BBAAL10.1 size=1048576 2024-09-12T00:24:11.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.899+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~TFP63BBAAL10.2 size=824271 2024-09-12T00:24:11.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.899+0000 7f0d199128c0 1 > prepared multipart upload key=10YEWZDTTEV0 upload=TFP63BBAAL10 tag=9GC4WKGI7PXL type=write size=3969999 2024-09-12T00:24:11.903 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.903+0000 7f0d199128c0 1 < suggested update operation key=HXNC728XIWC1 tag=53DTSF1HXNF8 type=del size=1445329 2024-09-12T00:24:11.907 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.907+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~IS59U4ONDJAS.0 size=810611 2024-09-12T00:24:11.908 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.907+0000 7f0d199128c0 1 > prepared multipart upload key=QUO5ND3O41TY upload=IS59U4ONDJAS tag=Y97U3D3YHCSU type=write size=1859187 2024-09-12T00:24:11.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.911+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~2PC8D12G2NJS.0 size=553663 2024-09-12T00:24:11.914 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.915+0000 7f0d199128c0 1 < completed multipart upload key=V6H6S9X0U2A0 upload=2PC8D12G2NJS tag=9HNIDUO7WCBK type=write size=1602239 2024-09-12T00:24:11.917 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.919+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=LXJB0OA0L5PY type=del size=2974504 2024-09-12T00:24:11.920 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.919+0000 7f0d199128c0 1 < completed delete operation key=RFCHRGVA9GOI tag=5P6XJ2M0M2R9 type=del 2024-09-12T00:24:11.924 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.923+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=TMOEHS83DMQ0 type=write size=100412 2024-09-12T00:24:11.927 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.927+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~HH1SOLKZLAU0.0 size=1048576 2024-09-12T00:24:11.929 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.931+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~HH1SOLKZLAU0.1 size=568292 2024-09-12T00:24:11.934 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.935+0000 7f0d199128c0 1 < completed multipart upload key=FJ8YV026H0ZU upload=HH1SOLKZLAU0 tag=B7P0XUZY3TMQ type=write size=2665444 2024-09-12T00:24:11.938 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.935+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=9WDEISP5BKP9 type=write size=408792 2024-09-12T00:24:11.940 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.939+0000 7f0d199128c0 1 < completed delete operation key=QUO5ND3O41TY tag=NSOEQWF3BUVK type=del 2024-09-12T00:24:11.942 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.943+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=WRI6E86F51BV type=del size=3344912 2024-09-12T00:24:11.945 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.943+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~VMLFAIVPXMOG.0 size=1048576 2024-09-12T00:24:11.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.947+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~VMLFAIVPXMOG.1 size=1048576 2024-09-12T00:24:11.949 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.947+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~VMLFAIVPXMOG.2 size=452007 2024-09-12T00:24:11.953 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.951+0000 7f0d199128c0 1 < completed multipart upload key=YTXW98O07966 upload=VMLFAIVPXMOG tag=AWI4GUWQ3WGO type=write size=3597735 2024-09-12T00:24:11.958 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.959+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~Y8A1Y5T5I6HM.0 size=1048576 2024-09-12T00:24:11.960 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.959+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~Y8A1Y5T5I6HM.1 size=535519 2024-09-12T00:24:11.960 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.959+0000 7f0d199128c0 1 > prepared multipart upload key=0ZT4NZYZKI5Z upload=Y8A1Y5T5I6HM tag=GNDKAN5MOSAP type=write size=2632671 2024-09-12T00:24:11.963 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.963+0000 7f0d199128c0 1 < completed write operation key=VXZI0ZTMQSV0 tag=MS0BRVSKG2QO type=write size=952445 2024-09-12T00:24:11.966 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.967+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=YGAZF0Q1I24P type=del size=3564303 2024-09-12T00:24:11.969 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.967+0000 7f0d199128c0 1 < completed delete operation key=T6GOR4SBYU2Y tag=LWJVQJB9UIS8 type=del 2024-09-12T00:24:11.972 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.971+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=N68HF1N75179 type=del size=364533 2024-09-12T00:24:11.975 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.975+0000 7f0d199128c0 1 < completed delete operation key=10YEWZDTTEV0 tag=941AOPNWFJZ1 type=del 2024-09-12T00:24:11.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.983+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~FEMFLFYM2IZ5.0 size=520642 2024-09-12T00:24:11.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.983+0000 7f0d199128c0 1 > prepared multipart upload key=NXQYUQIR2APT upload=FEMFLFYM2IZ5 tag=T7W0MGV8JBPQ type=write size=1569218 2024-09-12T00:24:11.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.983+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~LXMDA9DFKHXT.0 size=1048576 2024-09-12T00:24:11.987 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.987+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~LXMDA9DFKHXT.1 size=637405 2024-09-12T00:24:11.993 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.991+0000 7f0d199128c0 1 < completed multipart upload key=YTXW98O07966 upload=LXMDA9DFKHXT tag=0ELQ3JTCP1M0 type=write size=2734557 2024-09-12T00:24:11.999 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:11.999+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~IW6KFP2CEHUT.0 size=1048576 2024-09-12T00:24:12.001 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.003+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~IW6KFP2CEHUT.1 size=370871 2024-09-12T00:24:12.001 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.003+0000 7f0d199128c0 1 > prepared multipart upload key=WBGXMJB7U422 upload=IW6KFP2CEHUT tag=AAD8UMDZ730I type=write size=2468023 2024-09-12T00:24:12.004 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.003+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~RBG3NAG2OYXI.0 size=1048576 2024-09-12T00:24:12.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.007+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~RBG3NAG2OYXI.1 size=1048576 2024-09-12T00:24:12.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.011+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~RBG3NAG2OYXI.2 size=204192 2024-09-12T00:24:12.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.019+0000 7f0d199128c0 1 < completed multipart upload key=9I6MZAEUS4I0 upload=RBG3NAG2OYXI tag=QY1A6F8OQ0R0 type=write size=3349920 2024-09-12T00:24:12.021 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.023+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=AXP4GCUVPRR7 type=del size=2729843 2024-09-12T00:24:12.025 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.023+0000 7f0d199128c0 1 < completed delete operation key=A529WOKFD1NI tag=6MZS0VO9DABZ type=del 2024-09-12T00:24:12.027 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.027+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=FCI2MVPPFXKQ type=del size=2145274 2024-09-12T00:24:12.031 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.031+0000 7f0d199128c0 1 < completed write operation key=IPJEXRBN96NB tag=XPSP28AJUJ7D type=write size=569260 2024-09-12T00:24:12.034 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.035+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=GBPB1O23M901 type=del size=2655738 2024-09-12T00:24:12.037 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.035+0000 7f0d199128c0 1 < canceled operation key=PK2CA62QBZXS tag=S1JB1RTINOSG type=del size=2471244 2024-09-12T00:24:12.041 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.039+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=D1IVO5QIS1KS type=del size=502001 2024-09-12T00:24:12.043 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.043+0000 7f0d199128c0 1 < completed delete operation key=GH0FNY2AI00G tag=UDT6CBEH61X8 type=del 2024-09-12T00:24:12.049 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.047+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~25IXSWOE2RH4.0 size=493849 2024-09-12T00:24:12.049 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.047+0000 7f0d199128c0 1 > prepared multipart upload key=HXNC728XIWC1 upload=25IXSWOE2RH4 tag=M3MHB57CSJZI type=write size=1542425 2024-09-12T00:24:12.052 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.051+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~TFP63BBAAL10.0 size=1048576 2024-09-12T00:24:12.055 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.055+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~TFP63BBAAL10.1 size=1048576 2024-09-12T00:24:12.058 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.059+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~TFP63BBAAL10.2 size=824271 2024-09-12T00:24:12.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.063+0000 7f0d199128c0 1 < completed multipart upload key=10YEWZDTTEV0 upload=TFP63BBAAL10 tag=9GC4WKGI7PXL type=write size=3969999 2024-09-12T00:24:12.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.067+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=NSDYCALHQ6VL type=del size=1935855 2024-09-12T00:24:12.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.067+0000 7f0d199128c0 1 < canceled part key=_multipart_QUO5ND3O41TY.2~IS59U4ONDJAS.0 size=810611 2024-09-12T00:24:12.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.071+0000 7f0d199128c0 1 < canceled multipart upload key=QUO5ND3O41TY upload=IS59U4ONDJAS tag=Y97U3D3YHCSU type=write size=1859187 2024-09-12T00:24:12.078 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.079+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~2QD5W0ATR5Z4.0 size=1048576 2024-09-12T00:24:12.081 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.079+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~2QD5W0ATR5Z4.1 size=1048576 2024-09-12T00:24:12.083 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.083+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~2QD5W0ATR5Z4.2 size=376783 2024-09-12T00:24:12.083 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.083+0000 7f0d199128c0 1 > prepared multipart upload key=YTXW98O07966 upload=2QD5W0ATR5Z4 tag=R6SEEP6A2PMS type=write size=3522511 2024-09-12T00:24:12.086 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.087+0000 7f0d199128c0 1 < completed delete operation key=0ZT4NZYZKI5Z tag=LXJB0OA0L5PY type=del 2024-09-12T00:24:12.092 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.091+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~L6Q7YISQOTFJ.0 size=1048576 2024-09-12T00:24:12.094 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.095+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~L6Q7YISQOTFJ.1 size=200178 2024-09-12T00:24:12.095 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.095+0000 7f0d199128c0 1 > prepared multipart upload key=2EK9CCKG26W2 upload=L6Q7YISQOTFJ tag=9E41TIYOSU44 type=write size=2297330 2024-09-12T00:24:12.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.099+0000 7f0d199128c0 1 < completed write operation key=IPJEXRBN96NB tag=TMOEHS83DMQ0 type=write size=100412 2024-09-12T00:24:12.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.103+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~0ETE6METXFT8.0 size=1021743 2024-09-12T00:24:12.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.103+0000 7f0d199128c0 1 > prepared multipart upload key=2EK9CCKG26W2 upload=0ETE6METXFT8 tag=7843G7N3EJ5A type=write size=2070319 2024-09-12T00:24:12.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.107+0000 7f0d199128c0 1 < completed write operation key=A529WOKFD1NI tag=9WDEISP5BKP9 type=write size=408792 2024-09-12T00:24:12.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.111+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=7NLWDYCYY5HS type=del size=3635351 2024-09-12T00:24:12.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.115+0000 7f0d199128c0 1 < completed delete operation key=4K654PSDLDVI tag=WRI6E86F51BV type=del 2024-09-12T00:24:12.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.115+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=U07LVZ1ASNZB type=del size=981715 2024-09-12T00:24:12.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.119+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~Y8A1Y5T5I6HM.0 size=1048576 2024-09-12T00:24:12.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.123+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~Y8A1Y5T5I6HM.1 size=535519 2024-09-12T00:24:12.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.127+0000 7f0d199128c0 1 < completed multipart upload key=0ZT4NZYZKI5Z upload=Y8A1Y5T5I6HM tag=GNDKAN5MOSAP type=write size=2632671 2024-09-12T00:24:12.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.131+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=FA9YCSK2NST7 type=del size=2866572 2024-09-12T00:24:12.140 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.139+0000 7f0d199128c0 1 < suggested remove operation key=9I6MZAEUS4I0 tag=YGAZF0Q1I24P type=del 2024-09-12T00:24:12.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.147+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~IZDV6033IN6C.0 size=1048576 2024-09-12T00:24:12.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.147+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~IZDV6033IN6C.1 size=924543 2024-09-12T00:24:12.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.147+0000 7f0d199128c0 1 > prepared multipart upload key=H604SA6XTFLY upload=IZDV6033IN6C tag=04CDX88D10GE type=write size=3021695 2024-09-12T00:24:12.153 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.151+0000 7f0d199128c0 1 < completed delete operation key=0EBWUENN0881 tag=N68HF1N75179 type=del 2024-09-12T00:24:12.156 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.155+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=3X0GVCKRBZ0T type=del size=311291 2024-09-12T00:24:12.160 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.159+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~FEMFLFYM2IZ5.0 size=520642 2024-09-12T00:24:12.165 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.163+0000 7f0d199128c0 1 < completed multipart upload key=NXQYUQIR2APT upload=FEMFLFYM2IZ5 tag=T7W0MGV8JBPQ type=write size=1569218 2024-09-12T00:24:12.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.171+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~AT9NM8WA4571.0 size=1048576 2024-09-12T00:24:12.174 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.175+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~AT9NM8WA4571.1 size=1048576 2024-09-12T00:24:12.177 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.175+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~AT9NM8WA4571.2 size=622630 2024-09-12T00:24:12.177 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.175+0000 7f0d199128c0 1 > prepared multipart upload key=0ZT4NZYZKI5Z upload=AT9NM8WA4571 tag=POJW42UIXZCR type=write size=3768358 2024-09-12T00:24:12.181 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.179+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~IW6KFP2CEHUT.0 size=1048576 2024-09-12T00:24:12.181 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.179+0000 7f0d199128c0 1 < canceled part key=_multipart_WBGXMJB7U422.2~IW6KFP2CEHUT.1 size=370871 2024-09-12T00:24:12.187 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.187+0000 7f0d199128c0 1 < canceled multipart upload key=WBGXMJB7U422 upload=IW6KFP2CEHUT tag=AAD8UMDZ730I type=write size=2468023 2024-09-12T00:24:12.190 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.191+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=TNWPQ8SXN0ZN type=del size=410913 2024-09-12T00:24:12.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.195+0000 7f0d199128c0 1 < completed delete operation key=1Y6B1MJP5G4L tag=AXP4GCUVPRR7 type=del 2024-09-12T00:24:12.198 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.199+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=WYZX5PSROEPC type=del size=936641 2024-09-12T00:24:12.201 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.199+0000 7f0d199128c0 1 < completed delete operation key=V6H6S9X0U2A0 tag=FCI2MVPPFXKQ type=del 2024-09-12T00:24:12.205 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.203+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=H1UV0TTFTTYU type=del size=3203158 2024-09-12T00:24:12.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.207+0000 7f0d199128c0 1 < completed delete operation key=GH0FNY2AI00G tag=GBPB1O23M901 type=del 2024-09-12T00:24:12.215 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.215+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~CFAK9YLN63TA.0 size=1048576 2024-09-12T00:24:12.217 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.219+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~CFAK9YLN63TA.1 size=758897 2024-09-12T00:24:12.218 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.219+0000 7f0d199128c0 1 > prepared multipart upload key=4K654PSDLDVI upload=CFAK9YLN63TA tag=LCZ7QNYJQAWS type=write size=2856049 2024-09-12T00:24:12.224 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.223+0000 7f0d199128c0 1 < suggested update operation key=WBGXMJB7U422 tag=D1IVO5QIS1KS type=del size=502001 2024-09-12T00:24:12.228 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.227+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=0ZI97P81M1AA type=del size=2734760 2024-09-12T00:24:12.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.227+0000 7f0d199128c0 1 < canceled part key=_multipart_HXNC728XIWC1.2~25IXSWOE2RH4.0 size=493849 2024-09-12T00:24:12.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.235+0000 7f0d199128c0 1 < canceled multipart upload key=HXNC728XIWC1 upload=25IXSWOE2RH4 tag=M3MHB57CSJZI type=write size=1542425 2024-09-12T00:24:12.237 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.239+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=NENH1D9T2BT1 type=del size=935623 2024-09-12T00:24:12.241 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.243+0000 7f0d199128c0 1 < completed delete operation key=J75P0821XGRO tag=NSDYCALHQ6VL type=del 2024-09-12T00:24:12.248 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.247+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~Y5U48AQDFI83.0 size=853637 2024-09-12T00:24:12.248 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.247+0000 7f0d199128c0 1 > prepared multipart upload key=ZWGD87Z1MMNK upload=Y5U48AQDFI83 tag=83L59Z1OABLU type=write size=1902213 2024-09-12T00:24:12.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.251+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~2QD5W0ATR5Z4.0 size=1048576 2024-09-12T00:24:12.254 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.255+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~2QD5W0ATR5Z4.1 size=1048576 2024-09-12T00:24:12.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.255+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~2QD5W0ATR5Z4.2 size=376783 2024-09-12T00:24:12.263 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.263+0000 7f0d199128c0 1 < completed multipart upload key=YTXW98O07966 upload=2QD5W0ATR5Z4 tag=R6SEEP6A2PMS type=write size=3522511 2024-09-12T00:24:12.269 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.267+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~QSSDF7R772IO.0 size=1048576 2024-09-12T00:24:12.272 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.271+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~QSSDF7R772IO.1 size=1048576 2024-09-12T00:24:12.275 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.275+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~QSSDF7R772IO.2 size=109697 2024-09-12T00:24:12.275 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.275+0000 7f0d199128c0 1 > prepared multipart upload key=ZWGD87Z1MMNK upload=QSSDF7R772IO tag=VQ31XPTLOKN2 type=write size=3255425 2024-09-12T00:24:12.279 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.279+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~L6Q7YISQOTFJ.0 size=1048576 2024-09-12T00:24:12.281 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.283+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~L6Q7YISQOTFJ.1 size=200178 2024-09-12T00:24:12.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.287+0000 7f0d199128c0 1 < completed multipart upload key=2EK9CCKG26W2 upload=L6Q7YISQOTFJ tag=9E41TIYOSU44 type=write size=2297330 2024-09-12T00:24:12.295 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.295+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~5N6PCB0JO21A.0 size=430834 2024-09-12T00:24:12.295 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.295+0000 7f0d199128c0 1 > prepared multipart upload key=WPZOKZDFXK4S upload=5N6PCB0JO21A tag=OXQI4QO1VHDP type=write size=1479410 2024-09-12T00:24:12.298 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.299+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~0ETE6METXFT8.0 size=1021743 2024-09-12T00:24:12.304 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.303+0000 7f0d199128c0 1 < completed multipart upload key=2EK9CCKG26W2 upload=0ETE6METXFT8 tag=7843G7N3EJ5A type=write size=2070319 2024-09-12T00:24:12.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.311+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~QQ0UNFTKV0WF.0 size=763654 2024-09-12T00:24:12.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.311+0000 7f0d199128c0 1 > prepared multipart upload key=JA6CSJF78VE2 upload=QQ0UNFTKV0WF tag=GYGAULAMPL8Z type=write size=1812230 2024-09-12T00:24:12.316 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.315+0000 7f0d199128c0 1 < completed delete operation key=0ZT4NZYZKI5Z tag=7NLWDYCYY5HS type=del 2024-09-12T00:24:12.320 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.319+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=2JS1W54AHHO3 type=del size=3902781 2024-09-12T00:24:12.327 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.327+0000 7f0d199128c0 1 < suggested remove operation key=JA6CSJF78VE2 tag=U07LVZ1ASNZB type=del 2024-09-12T00:24:12.331 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.331+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=IKQZ1UA2WQ1A type=del size=517700 2024-09-12T00:24:12.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.335+0000 7f0d199128c0 1 < completed delete operation key=V6H6S9X0U2A0 tag=FA9YCSK2NST7 type=del 2024-09-12T00:24:12.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.339+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=ETU3G8V6TTXB type=del size=3181846 2024-09-12T00:24:12.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.339+0000 7f0d199128c0 1 < canceled part key=_multipart_H604SA6XTFLY.2~IZDV6033IN6C.0 size=1048576 2024-09-12T00:24:12.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.343+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~IZDV6033IN6C.1 size=924543 2024-09-12T00:24:12.351 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.351+0000 7f0d199128c0 1 < canceled multipart upload key=H604SA6XTFLY upload=IZDV6033IN6C tag=04CDX88D10GE type=write size=3021695 2024-09-12T00:24:12.358 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.359+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~EAAK3TLL0DOW.0 size=1048576 2024-09-12T00:24:12.362 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.363+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~EAAK3TLL0DOW.1 size=192642 2024-09-12T00:24:12.362 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.363+0000 7f0d199128c0 1 > prepared multipart upload key=QUO5ND3O41TY upload=EAAK3TLL0DOW tag=5XZOYOJPH06U type=write size=2289794 2024-09-12T00:24:12.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.367+0000 7f0d199128c0 1 < completed delete operation key=A529WOKFD1NI tag=3X0GVCKRBZ0T type=del 2024-09-12T00:24:12.371 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.371+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=Q6R3JFQEC4OV type=del size=1773618 2024-09-12T00:24:12.375 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.375+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~AT9NM8WA4571.0 size=1048576 2024-09-12T00:24:12.379 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.379+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~AT9NM8WA4571.1 size=1048576 2024-09-12T00:24:12.385 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.383+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~AT9NM8WA4571.2 size=622630 2024-09-12T00:24:12.389 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.387+0000 7f0d199128c0 1 < completed multipart upload key=0ZT4NZYZKI5Z upload=AT9NM8WA4571 tag=POJW42UIXZCR type=write size=3768358 2024-09-12T00:24:12.393 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.395+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=7Q1WUIQCVHJ8 type=del size=2712053 2024-09-12T00:24:12.401 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.403+0000 7f0d199128c0 1 < suggested remove operation key=A529WOKFD1NI tag=TNWPQ8SXN0ZN type=del 2024-09-12T00:24:12.405 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.407+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=SDGQ6UCWSTCE type=del size=3367680 2024-09-12T00:24:12.407 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.407+0000 7f0d199128c0 -1 < no bi entry to suggest for operation key=A529WOKFD1NI tag=WYZX5PSROEPC type=del size=936641: (2) No such file or directory 2024-09-12T00:24:12.411 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.411+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=FQF9GZM04ZNB type=del size=2596386 2024-09-12T00:24:12.415 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.415+0000 7f0d199128c0 1 < completed delete operation key=IPJEXRBN96NB tag=H1UV0TTFTTYU type=del 2024-09-12T00:24:12.421 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.423+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~6WWSVQ3SABIQ.0 size=714270 2024-09-12T00:24:12.421 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.423+0000 7f0d199128c0 1 > prepared multipart upload key=V6H6S9X0U2A0 upload=6WWSVQ3SABIQ tag=GCL1T5Z3BLC2 type=write size=1762846 2024-09-12T00:24:12.425 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.423+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~CFAK9YLN63TA.0 size=1048576 2024-09-12T00:24:12.428 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.427+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~CFAK9YLN63TA.1 size=758897 2024-09-12T00:24:12.434 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.435+0000 7f0d199128c0 1 < completed multipart upload key=4K654PSDLDVI upload=CFAK9YLN63TA tag=LCZ7QNYJQAWS type=write size=2856049 2024-09-12T00:24:12.438 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.439+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=B1YSSM08LLTL type=del size=1069350 2024-09-12T00:24:12.442 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.443+0000 7f0d199128c0 1 < completed delete operation key=RX3RVT06SGJ4 tag=0ZI97P81M1AA type=del 2024-09-12T00:24:12.449 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.447+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~79J9SWP2FHTB.0 size=1048576 2024-09-12T00:24:12.452 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.451+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~79J9SWP2FHTB.1 size=1048576 2024-09-12T00:24:12.455 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.455+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~79J9SWP2FHTB.2 size=315730 2024-09-12T00:24:12.455 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.455+0000 7f0d199128c0 1 > prepared multipart upload key=GH0FNY2AI00G upload=79J9SWP2FHTB tag=PIPB2X909AQ6 type=write size=3461458 2024-09-12T00:24:12.457 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.459+0000 7f0d199128c0 1 < completed delete operation key=9I6MZAEUS4I0 tag=NENH1D9T2BT1 type=del 2024-09-12T00:24:12.460 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.459+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=K3ZLJR1PH1K9 type=write size=734683 2024-09-12T00:24:12.464 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.463+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~Y5U48AQDFI83.0 size=853637 2024-09-12T00:24:12.469 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.467+0000 7f0d199128c0 1 < completed multipart upload key=ZWGD87Z1MMNK upload=Y5U48AQDFI83 tag=83L59Z1OABLU type=write size=1902213 2024-09-12T00:24:12.475 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.475+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~WMP1DLS5WVVA.0 size=792739 2024-09-12T00:24:12.475 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.475+0000 7f0d199128c0 1 > prepared multipart upload key=V6H6S9X0U2A0 upload=WMP1DLS5WVVA tag=R25P4GLBPCKK type=write size=1841315 2024-09-12T00:24:12.478 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.479+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~QSSDF7R772IO.0 size=1048576 2024-09-12T00:24:12.478 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.479+0000 7f0d199128c0 1 < canceled part key=_multipart_ZWGD87Z1MMNK.2~QSSDF7R772IO.1 size=1048576 2024-09-12T00:24:12.480 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.479+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~QSSDF7R772IO.2 size=109697 2024-09-12T00:24:12.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.483+0000 7f0d199128c0 1 < canceled multipart upload key=ZWGD87Z1MMNK upload=QSSDF7R772IO tag=VQ31XPTLOKN2 type=write size=3255425 2024-09-12T00:24:12.491 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.491+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~S9AE4SJFQ3W5.0 size=133740 2024-09-12T00:24:12.491 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.491+0000 7f0d199128c0 1 > prepared multipart upload key=FJ8YV026H0ZU upload=S9AE4SJFQ3W5 tag=W3P2PM1U6M06 type=write size=1182316 2024-09-12T00:24:12.493 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.491+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~5N6PCB0JO21A.0 size=430834 2024-09-12T00:24:12.498 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.499+0000 7f0d199128c0 1 < completed multipart upload key=WPZOKZDFXK4S upload=5N6PCB0JO21A tag=OXQI4QO1VHDP type=write size=1479410 2024-09-12T00:24:12.501 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.499+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=Y67NP5IAYS0J type=write size=444275 2024-09-12T00:24:12.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.503+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~QQ0UNFTKV0WF.0 size=763654 2024-09-12T00:24:12.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.507+0000 7f0d199128c0 1 < completed multipart upload key=JA6CSJF78VE2 upload=QQ0UNFTKV0WF tag=GYGAULAMPL8Z type=write size=1812230 2024-09-12T00:24:12.512 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.511+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=TN3Q5YA9HZ6D type=write size=800359 2024-09-12T00:24:12.515 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.515+0000 7f0d199128c0 1 < completed delete operation key=4K654PSDLDVI tag=2JS1W54AHHO3 type=del 2024-09-12T00:24:12.519 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.519+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=Z7AU0TX2BJV5 type=del size=3774897 2024-09-12T00:24:12.522 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.523+0000 7f0d199128c0 1 < completed delete operation key=T6GOR4SBYU2Y tag=IKQZ1UA2WQ1A type=del 2024-09-12T00:24:12.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.527+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=NFGMVG29GYKA type=del size=307727 2024-09-12T00:24:12.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.527+0000 7f0d199128c0 1 < completed delete operation key=VXZI0ZTMQSV0 tag=ETU3G8V6TTXB type=del 2024-09-12T00:24:12.532 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.531+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=YMB981MHQ994 type=del size=3692360 2024-09-12T00:24:12.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.535+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~EAAK3TLL0DOW.0 size=1048576 2024-09-12T00:24:12.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.539+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~EAAK3TLL0DOW.1 size=192642 2024-09-12T00:24:12.543 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.543+0000 7f0d199128c0 1 < completed multipart upload key=QUO5ND3O41TY upload=EAAK3TLL0DOW tag=5XZOYOJPH06U type=write size=2289794 2024-09-12T00:24:12.546 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.547+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=XQG6BA6VWJDU type=del size=962720 2024-09-12T00:24:12.552 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.551+0000 7f0d199128c0 1 < suggested update operation key=0EBWUENN0881 tag=Q6R3JFQEC4OV type=del size=1773618 2024-09-12T00:24:12.556 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.555+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=OA7JA8XPL8SL type=del size=3567587 2024-09-12T00:24:12.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.559+0000 7f0d199128c0 1 < completed delete operation key=GH0FNY2AI00G tag=7Q1WUIQCVHJ8 type=del 2024-09-12T00:24:12.562 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.563+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=5BB15O1MSE9V type=del size=2914239 2024-09-12T00:24:12.566 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.567+0000 7f0d199128c0 1 < completed delete operation key=2EK9CCKG26W2 tag=SDGQ6UCWSTCE type=del 2024-09-12T00:24:12.572 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.571+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~66CAXJFET8F2.0 size=1048576 2024-09-12T00:24:12.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.575+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~66CAXJFET8F2.1 size=1048576 2024-09-12T00:24:12.577 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.575+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~66CAXJFET8F2.2 size=900215 2024-09-12T00:24:12.577 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.575+0000 7f0d199128c0 1 > prepared multipart upload key=NXQYUQIR2APT upload=66CAXJFET8F2 tag=LFF24UZYHA2K type=write size=4045943 2024-09-12T00:24:12.581 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.579+0000 7f0d199128c0 1 < completed delete operation key=RX3RVT06SGJ4 tag=FQF9GZM04ZNB type=del 2024-09-12T00:24:12.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.583+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=JX6JFAY219II type=del size=536350 2024-09-12T00:24:12.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.587+0000 7f0d199128c0 1 < canceled part key=_multipart_V6H6S9X0U2A0.2~6WWSVQ3SABIQ.0 size=714270 2024-09-12T00:24:12.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.591+0000 7f0d199128c0 1 < canceled multipart upload key=V6H6S9X0U2A0 upload=6WWSVQ3SABIQ tag=GCL1T5Z3BLC2 type=write size=1762846 2024-09-12T00:24:12.595 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.595+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=34DOJ293DGZ8 type=del size=2730853 2024-09-12T00:24:12.598 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.599+0000 7f0d199128c0 1 < completed delete operation key=10YEWZDTTEV0 tag=B1YSSM08LLTL type=del 2024-09-12T00:24:12.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.603+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=IMO4VN8VXHGR type=del size=794685 2024-09-12T00:24:12.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.607+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~79J9SWP2FHTB.0 size=1048576 2024-09-12T00:24:12.608 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.607+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~79J9SWP2FHTB.1 size=1048576 2024-09-12T00:24:12.611 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.611+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~79J9SWP2FHTB.2 size=315730 2024-09-12T00:24:12.617 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.615+0000 7f0d199128c0 1 < completed multipart upload key=GH0FNY2AI00G upload=79J9SWP2FHTB tag=PIPB2X909AQ6 type=write size=3461458 2024-09-12T00:24:12.621 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.619+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=FS8XTM4Q1WWH type=del size=3262175 2024-09-12T00:24:12.625 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.623+0000 7f0d199128c0 1 < completed write operation key=H604SA6XTFLY tag=K3ZLJR1PH1K9 type=write size=734683 2024-09-12T00:24:12.628 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.627+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=QSDTBWQHWQCZ type=del size=738283 2024-09-12T00:24:12.632 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.631+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~WMP1DLS5WVVA.0 size=792739 2024-09-12T00:24:12.638 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.639+0000 7f0d199128c0 1 < completed multipart upload key=V6H6S9X0U2A0 upload=WMP1DLS5WVVA tag=R25P4GLBPCKK type=write size=1841315 2024-09-12T00:24:12.645 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.643+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~BE6CYL1VG16Z.0 size=1048576 2024-09-12T00:24:12.648 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.647+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~BE6CYL1VG16Z.1 size=1048576 2024-09-12T00:24:12.650 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.651+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~BE6CYL1VG16Z.2 size=31296 2024-09-12T00:24:12.651 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.651+0000 7f0d199128c0 1 > prepared multipart upload key=RX3RVT06SGJ4 upload=BE6CYL1VG16Z tag=1X6LNAQ0TCXV type=write size=3177024 2024-09-12T00:24:12.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.655+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~S9AE4SJFQ3W5.0 size=133740 2024-09-12T00:24:12.660 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.659+0000 7f0d199128c0 1 < completed multipart upload key=FJ8YV026H0ZU upload=S9AE4SJFQ3W5 tag=W3P2PM1U6M06 type=write size=1182316 2024-09-12T00:24:12.664 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.663+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=8WFGC64QVA7J type=del size=4150524 2024-09-12T00:24:12.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.671+0000 7f0d199128c0 1 < canceled operation key=2EK9CCKG26W2 tag=Y67NP5IAYS0J type=write size=444275 2024-09-12T00:24:12.677 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.675+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~961QEKZ37QOP.0 size=1048576 2024-09-12T00:24:12.689 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.687+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~961QEKZ37QOP.1 size=1048576 2024-09-12T00:24:12.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.699+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~961QEKZ37QOP.2 size=115117 2024-09-12T00:24:12.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.699+0000 7f0d199128c0 1 > prepared multipart upload key=10YEWZDTTEV0 upload=961QEKZ37QOP tag=BZQDIL15SVGR type=write size=3260845 2024-09-12T00:24:12.707 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.707+0000 7f0d199128c0 1 < canceled operation key=GH0FNY2AI00G tag=TN3Q5YA9HZ6D type=write size=800359 2024-09-12T00:24:12.711 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.711+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=VVGDBPHI77F3 type=del size=3369254 2024-09-12T00:24:12.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.715+0000 7f0d199128c0 1 < completed delete operation key=FJ8YV026H0ZU tag=Z7AU0TX2BJV5 type=del 2024-09-12T00:24:12.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.715+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=5O4JHRQ9PZFV type=del size=2159937 2024-09-12T00:24:12.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.723+0000 7f0d199128c0 1 < suggested update operation key=JA6CSJF78VE2 tag=NFGMVG29GYKA type=del size=307727 2024-09-12T00:24:12.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.723+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=B1YWGYAV1J7M type=del size=4079238 2024-09-12T00:24:12.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.727+0000 7f0d199128c0 1 < completed delete operation key=YTXW98O07966 tag=YMB981MHQ994 type=del 2024-09-12T00:24:12.730 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.731+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=6DVTTN1E1SFA type=del size=248539 2024-09-12T00:24:12.733 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.731+0000 7f0d199128c0 1 < completed delete operation key=10YEWZDTTEV0 tag=XQG6BA6VWJDU type=del 2024-09-12T00:24:12.736 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.735+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=N4FESEFM7F4T type=write size=85170 2024-09-12T00:24:12.739 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.739+0000 7f0d199128c0 1 < completed delete operation key=37WTPAJGOX5L tag=OA7JA8XPL8SL type=del 2024-09-12T00:24:12.742 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.743+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=IL3RGXTQ1FQZ type=del size=2605570 2024-09-12T00:24:12.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.743+0000 7f0d199128c0 1 < completed delete operation key=GH0FNY2AI00G tag=5BB15O1MSE9V type=del 2024-09-12T00:24:12.748 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.747+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=F0WYNDZJ4B5X type=del size=1741646 2024-09-12T00:24:12.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.751+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~66CAXJFET8F2.0 size=1048576 2024-09-12T00:24:12.754 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.755+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~66CAXJFET8F2.1 size=1048576 2024-09-12T00:24:12.754 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.755+0000 7f0d199128c0 1 < canceled part key=_multipart_NXQYUQIR2APT.2~66CAXJFET8F2.2 size=900215 2024-09-12T00:24:12.759 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.759+0000 7f0d199128c0 1 < canceled multipart upload key=NXQYUQIR2APT upload=66CAXJFET8F2 tag=LFF24UZYHA2K type=write size=4045943 2024-09-12T00:24:12.762 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.763+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=G2GRGBUCT82W type=del size=1312344 2024-09-12T00:24:12.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.767+0000 7f0d199128c0 1 < completed delete operation key=SITJU2EUVSR8 tag=JX6JFAY219II type=del 2024-09-12T00:24:12.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.767+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=T2SVNVB0G6BR type=del size=1381148 2024-09-12T00:24:12.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.771+0000 7f0d199128c0 1 < completed delete operation key=0EBWUENN0881 tag=34DOJ293DGZ8 type=del 2024-09-12T00:24:12.776 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.775+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=UGNGVBUHBOQE type=write size=133492 2024-09-12T00:24:12.778 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.779+0000 7f0d199128c0 1 < completed delete operation key=0ZT4NZYZKI5Z tag=IMO4VN8VXHGR type=del 2024-09-12T00:24:12.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.783+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~WOAH695EQMAX.0 size=1048576 2024-09-12T00:24:12.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.787+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~WOAH695EQMAX.1 size=1048576 2024-09-12T00:24:12.789 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.787+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~WOAH695EQMAX.2 size=214496 2024-09-12T00:24:12.789 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.787+0000 7f0d199128c0 1 > prepared multipart upload key=RX3RVT06SGJ4 upload=WOAH695EQMAX tag=EFRF7AYPJTKK type=write size=3360224 2024-09-12T00:24:12.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.791+0000 7f0d199128c0 1 < completed delete operation key=SITJU2EUVSR8 tag=FS8XTM4Q1WWH type=del 2024-09-12T00:24:12.796 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.795+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=OC7J5172M62A type=del size=4103336 2024-09-12T00:24:12.799 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.799+0000 7f0d199128c0 1 < completed delete operation key=A529WOKFD1NI tag=QSDTBWQHWQCZ type=del 2024-09-12T00:24:12.803 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.803+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=EL41Z310228X type=del size=2472343 2024-09-12T00:24:12.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.807+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~BE6CYL1VG16Z.0 size=1048576 2024-09-12T00:24:12.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.807+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~BE6CYL1VG16Z.1 size=1048576 2024-09-12T00:24:12.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.811+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~BE6CYL1VG16Z.2 size=31296 2024-09-12T00:24:12.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.815+0000 7f0d199128c0 1 < completed multipart upload key=RX3RVT06SGJ4 upload=BE6CYL1VG16Z tag=1X6LNAQ0TCXV type=write size=3177024 2024-09-12T00:24:12.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.823+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~0LFXMI5NHUI8.0 size=1048576 2024-09-12T00:24:12.824 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.823+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~0LFXMI5NHUI8.1 size=1048576 2024-09-12T00:24:12.826 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.827+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~0LFXMI5NHUI8.2 size=731242 2024-09-12T00:24:12.826 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.827+0000 7f0d199128c0 1 > prepared multipart upload key=VXZI0ZTMQSV0 upload=0LFXMI5NHUI8 tag=EWSX37PLGL92 type=write size=3876970 2024-09-12T00:24:12.829 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.831+0000 7f0d199128c0 1 < canceled operation key=IPJEXRBN96NB tag=8WFGC64QVA7J type=del size=4150524 2024-09-12T00:24:12.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.831+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=UD3R0GI798KT type=del size=3811101 2024-09-12T00:24:12.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.835+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~961QEKZ37QOP.0 size=1048576 2024-09-12T00:24:12.837 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.835+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~961QEKZ37QOP.1 size=1048576 2024-09-12T00:24:12.839 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.839+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~961QEKZ37QOP.2 size=115117 2024-09-12T00:24:12.843 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.843+0000 7f0d199128c0 1 < completed multipart upload key=10YEWZDTTEV0 upload=961QEKZ37QOP tag=BZQDIL15SVGR type=write size=3260845 2024-09-12T00:24:12.846 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.847+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=PE00PEQDZ2QG type=write size=186046 2024-09-12T00:24:12.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.851+0000 7f0d199128c0 1 < canceled operation key=B58RWC9W8THG tag=VVGDBPHI77F3 type=del size=3369254 2024-09-12T00:24:12.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.851+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=YSBEIIBPNU4M type=del size=388225 2024-09-12T00:24:12.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.855+0000 7f0d199128c0 1 < completed delete operation key=1Y6B1MJP5G4L tag=5O4JHRQ9PZFV type=del 2024-09-12T00:24:12.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.863+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~M9OV9V8ODTBF.0 size=1048576 2024-09-12T00:24:12.865 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.863+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~M9OV9V8ODTBF.1 size=1048576 2024-09-12T00:24:12.868 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.867+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~M9OV9V8ODTBF.2 size=837831 2024-09-12T00:24:12.868 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.867+0000 7f0d199128c0 1 > prepared multipart upload key=B58RWC9W8THG upload=M9OV9V8ODTBF tag=0K16IRER240P type=write size=3983559 2024-09-12T00:24:12.872 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.871+0000 7f0d199128c0 1 < completed delete operation key=QUO5ND3O41TY tag=B1YWGYAV1J7M type=del 2024-09-12T00:24:12.875 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.875+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=HFIKF5QLW1BU type=del size=1093435 2024-09-12T00:24:12.878 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.879+0000 7f0d199128c0 1 < completed delete operation key=9I6MZAEUS4I0 tag=6DVTTN1E1SFA type=del 2024-09-12T00:24:12.882 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.883+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=29IIQDF2CBSH type=del size=2812541 2024-09-12T00:24:12.888 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.887+0000 7f0d199128c0 1 < suggested update operation key=9I6MZAEUS4I0 tag=N4FESEFM7F4T type=write size=85170 2024-09-12T00:24:12.894 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.895+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~B02H2A217SKM.0 size=675631 2024-09-12T00:24:12.894 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.895+0000 7f0d199128c0 1 > prepared multipart upload key=WBGXMJB7U422 upload=B02H2A217SKM tag=P6GWMWNUTNGN type=write size=1724207 2024-09-12T00:24:12.897 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.895+0000 7f0d199128c0 1 < completed delete operation key=V6H6S9X0U2A0 tag=IL3RGXTQ1FQZ type=del 2024-09-12T00:24:12.902 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.903+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~2UQO9LP6DAXH.0 size=543262 2024-09-12T00:24:12.902 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.903+0000 7f0d199128c0 1 > prepared multipart upload key=ZWGD87Z1MMNK upload=2UQO9LP6DAXH tag=KLYUP9N11EZ8 type=write size=1591838 2024-09-12T00:24:12.907 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.907+0000 7f0d199128c0 1 < suggested update operation key=H604SA6XTFLY tag=F0WYNDZJ4B5X type=del size=1741646 2024-09-12T00:24:12.912 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.911+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~4O3KZKQL8WMQ.0 size=1048576 2024-09-12T00:24:12.914 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.915+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~4O3KZKQL8WMQ.1 size=1048576 2024-09-12T00:24:12.916 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.915+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~4O3KZKQL8WMQ.2 size=118809 2024-09-12T00:24:12.916 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.915+0000 7f0d199128c0 1 > prepared multipart upload key=10YEWZDTTEV0 upload=4O3KZKQL8WMQ tag=CKGETBH1GY3K type=write size=3264537 2024-09-12T00:24:12.919 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.919+0000 7f0d199128c0 1 < completed delete operation key=VXZI0ZTMQSV0 tag=G2GRGBUCT82W type=del 2024-09-12T00:24:12.921 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.923+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=EVX2S4MYY3GY type=del size=1883283 2024-09-12T00:24:12.924 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.923+0000 7f0d199128c0 1 < completed delete operation key=PK2CA62QBZXS tag=T2SVNVB0G6BR type=del 2024-09-12T00:24:12.927 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.927+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=8KVAUC6RAXBM type=write size=380841 2024-09-12T00:24:12.930 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.931+0000 7f0d199128c0 1 < canceled operation key=OVLAP0OS78QG tag=UGNGVBUHBOQE type=write size=133492 2024-09-12T00:24:12.933 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.931+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=86YOW5NA1OI6 type=del size=1103255 2024-09-12T00:24:12.936 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.935+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~WOAH695EQMAX.0 size=1048576 2024-09-12T00:24:12.938 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.939+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~WOAH695EQMAX.1 size=1048576 2024-09-12T00:24:12.939 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.939+0000 7f0d199128c0 1 < canceled part key=_multipart_RX3RVT06SGJ4.2~WOAH695EQMAX.2 size=214496 2024-09-12T00:24:12.943 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.943+0000 7f0d199128c0 1 < canceled multipart upload key=RX3RVT06SGJ4 upload=WOAH695EQMAX tag=EFRF7AYPJTKK type=write size=3360224 2024-09-12T00:24:12.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.947+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=OIWNCZ4W272R type=write size=419507 2024-09-12T00:24:12.950 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.951+0000 7f0d199128c0 1 < completed delete operation key=PK2CA62QBZXS tag=OC7J5172M62A type=del 2024-09-12T00:24:12.953 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.951+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=3Y84NKLUQ1H9 type=del size=1664463 2024-09-12T00:24:12.957 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.955+0000 7f0d199128c0 1 < completed delete operation key=OVLAP0OS78QG tag=EL41Z310228X type=del 2024-09-12T00:24:12.960 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.959+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=F86VBVROF2M9 type=del size=488901 2024-09-12T00:24:12.963 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.963+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~0LFXMI5NHUI8.0 size=1048576 2024-09-12T00:24:12.965 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.963+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~0LFXMI5NHUI8.1 size=1048576 2024-09-12T00:24:12.965 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.967+0000 7f0d199128c0 1 < canceled part key=_multipart_VXZI0ZTMQSV0.2~0LFXMI5NHUI8.2 size=731242 2024-09-12T00:24:12.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.971+0000 7f0d199128c0 1 < canceled multipart upload key=VXZI0ZTMQSV0 upload=0LFXMI5NHUI8 tag=EWSX37PLGL92 type=write size=3876970 2024-09-12T00:24:12.976 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.975+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~PJKAMIM9S6RJ.0 size=903168 2024-09-12T00:24:12.976 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.975+0000 7f0d199128c0 1 > prepared multipart upload key=1Y6B1MJP5G4L upload=PJKAMIM9S6RJ tag=ESA4NE60J6AX type=write size=1951744 2024-09-12T00:24:12.983 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.983+0000 7f0d199128c0 1 < completed delete operation key=ZWGD87Z1MMNK tag=UD3R0GI798KT type=del 2024-09-12T00:24:12.986 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.987+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=JICTLM24RS9B type=del size=3049055 2024-09-12T00:24:12.989 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.987+0000 7f0d199128c0 1 < canceled operation key=A529WOKFD1NI tag=PE00PEQDZ2QG type=write size=186046 2024-09-12T00:24:12.992 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.991+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=25INMSPQ8BCK type=del size=649406 2024-09-12T00:24:12.998 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:12.999+0000 7f0d199128c0 1 < suggested update operation key=1Y6B1MJP5G4L tag=YSBEIIBPNU4M type=del size=388225 2024-09-12T00:24:13.002 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.003+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=Y7B42VR2GHQY type=write size=12051 2024-09-12T00:24:13.005 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.003+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~M9OV9V8ODTBF.0 size=1048576 2024-09-12T00:24:13.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.007+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~M9OV9V8ODTBF.1 size=1048576 2024-09-12T00:24:13.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.011+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~M9OV9V8ODTBF.2 size=837831 2024-09-12T00:24:13.015 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.015+0000 7f0d199128c0 1 < completed multipart upload key=B58RWC9W8THG upload=M9OV9V8ODTBF tag=0K16IRER240P type=write size=3983559 2024-09-12T00:24:13.021 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.023+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~5OT4KCF2HL5D.0 size=1048576 2024-09-12T00:24:13.024 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.023+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~5OT4KCF2HL5D.1 size=1048576 2024-09-12T00:24:13.027 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.027+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~5OT4KCF2HL5D.2 size=126654 2024-09-12T00:24:13.027 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.027+0000 7f0d199128c0 1 > prepared multipart upload key=VXZI0ZTMQSV0 upload=5OT4KCF2HL5D tag=LJ2OF4LD880E type=write size=3272382 2024-09-12T00:24:13.034 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.035+0000 7f0d199128c0 1 < suggested update operation key=4K654PSDLDVI tag=HFIKF5QLW1BU type=del size=1093435 2024-09-12T00:24:13.040 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.039+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~QP81BYZHZDDA.0 size=119977 2024-09-12T00:24:13.040 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.039+0000 7f0d199128c0 1 > prepared multipart upload key=JA6CSJF78VE2 upload=QP81BYZHZDDA tag=DJNT1XUMB5VY type=write size=1168553 2024-09-12T00:24:13.043 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.043+0000 7f0d199128c0 -1 < failed to complete operation key=4K654PSDLDVI tag=29IIQDF2CBSH type=del size=2812541: (22) Invalid argument 2024-09-12T00:24:13.047 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.047+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=HN1PQCZDUBT8 type=del size=532286 2024-09-12T00:24:13.050 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.051+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~B02H2A217SKM.0 size=675631 2024-09-12T00:24:13.055 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.055+0000 7f0d199128c0 1 < completed multipart upload key=WBGXMJB7U422 upload=B02H2A217SKM tag=P6GWMWNUTNGN type=write size=1724207 2024-09-12T00:24:13.059 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.059+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=I6DJ8R5M1U0L type=del size=2317966 2024-09-12T00:24:13.062 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.063+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~2UQO9LP6DAXH.0 size=543262 2024-09-12T00:24:13.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.067+0000 7f0d199128c0 1 < completed multipart upload key=ZWGD87Z1MMNK upload=2UQO9LP6DAXH tag=KLYUP9N11EZ8 type=write size=1591838 2024-09-12T00:24:13.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.071+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~EZDFCJVOPKH9.0 size=1048576 2024-09-12T00:24:13.075 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.075+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~EZDFCJVOPKH9.1 size=44959 2024-09-12T00:24:13.075 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.075+0000 7f0d199128c0 1 > prepared multipart upload key=WPZOKZDFXK4S upload=EZDFCJVOPKH9 tag=5MZP0ET3LGNL type=write size=2142111 2024-09-12T00:24:13.078 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.079+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~4O3KZKQL8WMQ.0 size=1048576 2024-09-12T00:24:13.081 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.079+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~4O3KZKQL8WMQ.1 size=1048576 2024-09-12T00:24:13.084 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.083+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~4O3KZKQL8WMQ.2 size=118809 2024-09-12T00:24:13.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.091+0000 7f0d199128c0 1 < completed multipart upload key=10YEWZDTTEV0 upload=4O3KZKQL8WMQ tag=CKGETBH1GY3K type=write size=3264537 2024-09-12T00:24:13.096 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.095+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~6RZH29HC55PR.0 size=649846 2024-09-12T00:24:13.096 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.095+0000 7f0d199128c0 1 > prepared multipart upload key=9I6MZAEUS4I0 upload=6RZH29HC55PR tag=TX1KIUBPP52V type=write size=1698422 2024-09-12T00:24:13.099 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.099+0000 7f0d199128c0 1 < completed delete operation key=T6GOR4SBYU2Y tag=EVX2S4MYY3GY type=del 2024-09-12T00:24:13.105 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.107+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~UTZ5BB9F7IZT.0 size=911124 2024-09-12T00:24:13.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.107+0000 7f0d199128c0 1 > prepared multipart upload key=0EBWUENN0881 upload=UTZ5BB9F7IZT tag=L2LDYGK46COL type=write size=1959700 2024-09-12T00:24:13.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.107+0000 7f0d199128c0 1 < completed write operation key=0EBWUENN0881 tag=8KVAUC6RAXBM type=write size=380841 2024-09-12T00:24:13.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.111+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=K967DJ0LGFEG type=del size=2542135 2024-09-12T00:24:13.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.115+0000 7f0d199128c0 1 < completed delete operation key=RX3RVT06SGJ4 tag=86YOW5NA1OI6 type=del 2024-09-12T00:24:13.119 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.119+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=N59V9LGBTY31 type=del size=3772451 2024-09-12T00:24:13.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.123+0000 7f0d199128c0 1 < canceled operation key=A529WOKFD1NI tag=OIWNCZ4W272R type=write size=419507 2024-09-12T00:24:13.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.127+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~1T8XXSGNZJGQ.0 size=954967 2024-09-12T00:24:13.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.127+0000 7f0d199128c0 1 > prepared multipart upload key=GH0FNY2AI00G upload=1T8XXSGNZJGQ tag=1KK983S16SBC type=write size=2003543 2024-09-12T00:24:13.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.131+0000 7f0d199128c0 1 < completed delete operation key=RX3RVT06SGJ4 tag=3Y84NKLUQ1H9 type=del 2024-09-12T00:24:13.139 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.139+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~SYP69C24V3BU.0 size=1048576 2024-09-12T00:24:13.142 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.143+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~SYP69C24V3BU.1 size=497064 2024-09-12T00:24:13.142 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.143+0000 7f0d199128c0 1 > prepared multipart upload key=WPZOKZDFXK4S upload=SYP69C24V3BU tag=G3CUVUI3PV28 type=write size=2594216 2024-09-12T00:24:13.145 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.147+0000 7f0d199128c0 1 < completed delete operation key=10YEWZDTTEV0 tag=F86VBVROF2M9 type=del 2024-09-12T00:24:13.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.151+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~PTUEPMRPXRRP.0 size=1048576 2024-09-12T00:24:13.154 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.155+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~PTUEPMRPXRRP.1 size=160517 2024-09-12T00:24:13.154 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.155+0000 7f0d199128c0 1 > prepared multipart upload key=GH0FNY2AI00G upload=PTUEPMRPXRRP tag=U3VJ38S0WOL8 type=write size=2257669 2024-09-12T00:24:13.154 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.155+0000 7f0d199128c0 1 < canceled part key=_multipart_1Y6B1MJP5G4L.2~PJKAMIM9S6RJ.0 size=903168 2024-09-12T00:24:13.159 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.159+0000 7f0d199128c0 1 < canceled multipart upload key=1Y6B1MJP5G4L upload=PJKAMIM9S6RJ tag=ESA4NE60J6AX type=write size=1951744 2024-09-12T00:24:13.163 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.163+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=PZ3TYID2B31L type=write size=279323 2024-09-12T00:24:13.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.167+0000 7f0d199128c0 -1 < failed to complete operation key=4K654PSDLDVI tag=JICTLM24RS9B type=del size=3049055: (22) Invalid argument 2024-09-12T00:24:13.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.171+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~9R4H5BXCA2IW.0 size=960139 2024-09-12T00:24:13.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.171+0000 7f0d199128c0 1 > prepared multipart upload key=WBGXMJB7U422 upload=9R4H5BXCA2IW tag=0MFYO27LYDGZ type=write size=2008715 2024-09-12T00:24:13.175 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.175+0000 7f0d199128c0 1 < completed delete operation key=J75P0821XGRO tag=25INMSPQ8BCK type=del 2024-09-12T00:24:13.178 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.179+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=2JV2GIB8OK9W type=del size=2241437 2024-09-12T00:24:13.183 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.183+0000 7f0d199128c0 1 < suggested update operation key=ZWGD87Z1MMNK tag=Y7B42VR2GHQY type=write size=12051 2024-09-12T00:24:13.186 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.187+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=QX1FKEWUP3KE type=write size=977375 2024-09-12T00:24:13.190 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.191+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~5OT4KCF2HL5D.0 size=1048576 2024-09-12T00:24:13.193 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.191+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~5OT4KCF2HL5D.1 size=1048576 2024-09-12T00:24:13.193 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.191+0000 7f0d199128c0 1 < canceled part key=_multipart_VXZI0ZTMQSV0.2~5OT4KCF2HL5D.2 size=126654 2024-09-12T00:24:13.199 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.199+0000 7f0d199128c0 1 < canceled multipart upload key=VXZI0ZTMQSV0 upload=5OT4KCF2HL5D tag=LJ2OF4LD880E type=write size=3272382 2024-09-12T00:24:13.202 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.203+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=ON3JPNQGO4HR type=write size=168112 2024-09-12T00:24:13.206 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.207+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~QP81BYZHZDDA.0 size=119977 2024-09-12T00:24:13.212 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.211+0000 7f0d199128c0 1 < completed multipart upload key=JA6CSJF78VE2 upload=QP81BYZHZDDA tag=DJNT1XUMB5VY type=write size=1168553 2024-09-12T00:24:13.215 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.215+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=8VWY1R3PY746 type=del size=1850341 2024-09-12T00:24:13.219 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.219+0000 7f0d199128c0 1 < canceled operation key=4K654PSDLDVI tag=HN1PQCZDUBT8 type=del size=532286 2024-09-12T00:24:13.223 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.223+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=E41YHOHXYOWH type=write size=404666 2024-09-12T00:24:13.226 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.227+0000 7f0d199128c0 1 < completed delete operation key=0ZT4NZYZKI5Z tag=I6DJ8R5M1U0L type=del 2024-09-12T00:24:13.232 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.231+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~DBAZG7J0Q006.0 size=1048576 2024-09-12T00:24:13.235 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.235+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~DBAZG7J0Q006.1 size=1048576 2024-09-12T00:24:13.237 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.235+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~DBAZG7J0Q006.2 size=712775 2024-09-12T00:24:13.237 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.235+0000 7f0d199128c0 1 > prepared multipart upload key=V6H6S9X0U2A0 upload=DBAZG7J0Q006 tag=7NXHLSUI2Y82 type=write size=3858503 2024-09-12T00:24:13.241 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.239+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~EZDFCJVOPKH9.0 size=1048576 2024-09-12T00:24:13.243 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.243+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~EZDFCJVOPKH9.1 size=44959 2024-09-12T00:24:13.248 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.247+0000 7f0d199128c0 1 < completed multipart upload key=WPZOKZDFXK4S upload=EZDFCJVOPKH9 tag=5MZP0ET3LGNL type=write size=2142111 2024-09-12T00:24:13.253 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.251+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~HIZD0FXKYMMV.0 size=1048576 2024-09-12T00:24:13.255 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.255+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~HIZD0FXKYMMV.1 size=1048576 2024-09-12T00:24:13.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.259+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~HIZD0FXKYMMV.2 size=411735 2024-09-12T00:24:13.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.259+0000 7f0d199128c0 1 > prepared multipart upload key=QUO5ND3O41TY upload=HIZD0FXKYMMV tag=0A841878OIJY type=write size=3557463 2024-09-12T00:24:13.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.259+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~6RZH29HC55PR.0 size=649846 2024-09-12T00:24:13.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.263+0000 7f0d199128c0 1 < completed multipart upload key=9I6MZAEUS4I0 upload=6RZH29HC55PR tag=TX1KIUBPP52V type=write size=1698422 2024-09-12T00:24:13.270 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.271+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~Z3GSV2SAKUEL.0 size=484215 2024-09-12T00:24:13.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.271+0000 7f0d199128c0 1 > prepared multipart upload key=A529WOKFD1NI upload=Z3GSV2SAKUEL tag=1VLABB9TVQZR type=write size=1532791 2024-09-12T00:24:13.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.271+0000 7f0d199128c0 1 < canceled part key=_multipart_0EBWUENN0881.2~UTZ5BB9F7IZT.0 size=911124 2024-09-12T00:24:13.276 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.275+0000 7f0d199128c0 1 < canceled multipart upload key=0EBWUENN0881 upload=UTZ5BB9F7IZT tag=L2LDYGK46COL type=write size=1959700 2024-09-12T00:24:13.279 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.279+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=8U0HY9RUM3I9 type=del size=158951 2024-09-12T00:24:13.285 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.283+0000 7f0d199128c0 1 < completed delete operation key=HXNC728XIWC1 tag=K967DJ0LGFEG type=del 2024-09-12T00:24:13.291 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.291+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~5KGIR5Q9OHGF.0 size=490530 2024-09-12T00:24:13.291 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.291+0000 7f0d199128c0 1 > prepared multipart upload key=10YEWZDTTEV0 upload=5KGIR5Q9OHGF tag=JB5HFQICC859 type=write size=1539106 2024-09-12T00:24:13.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.295+0000 7f0d199128c0 1 < completed delete operation key=37WTPAJGOX5L tag=N59V9LGBTY31 type=del 2024-09-12T00:24:13.297 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.299+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=T2ISAQ8YYE4O type=del size=1542945 2024-09-12T00:24:13.301 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.299+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~1T8XXSGNZJGQ.0 size=954967 2024-09-12T00:24:13.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.307+0000 7f0d199128c0 1 < completed multipart upload key=GH0FNY2AI00G upload=1T8XXSGNZJGQ tag=1KK983S16SBC type=write size=2003543 2024-09-12T00:24:13.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.311+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~CO5MDIO30N61.0 size=22689 2024-09-12T00:24:13.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.311+0000 7f0d199128c0 1 > prepared multipart upload key=J75P0821XGRO upload=CO5MDIO30N61 tag=MKM247VOQGU2 type=write size=1071265 2024-09-12T00:24:13.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.315+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~SYP69C24V3BU.0 size=1048576 2024-09-12T00:24:13.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.319+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~SYP69C24V3BU.1 size=497064 2024-09-12T00:24:13.323 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.323+0000 7f0d199128c0 1 < completed multipart upload key=WPZOKZDFXK4S upload=SYP69C24V3BU tag=G3CUVUI3PV28 type=write size=2594216 2024-09-12T00:24:13.326 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.327+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=AS605YISKOTY type=write size=46422 2024-09-12T00:24:13.330 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.331+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~PTUEPMRPXRRP.0 size=1048576 2024-09-12T00:24:13.333 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.331+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~PTUEPMRPXRRP.1 size=160517 2024-09-12T00:24:13.338 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.339+0000 7f0d199128c0 1 < completed multipart upload key=GH0FNY2AI00G upload=PTUEPMRPXRRP tag=U3VJ38S0WOL8 type=write size=2257669 2024-09-12T00:24:13.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.343+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~IQ22IZWJHABL.0 size=896057 2024-09-12T00:24:13.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.343+0000 7f0d199128c0 1 > prepared multipart upload key=0ZT4NZYZKI5Z upload=IQ22IZWJHABL tag=D0W4W07IL491 type=write size=1944633 2024-09-12T00:24:13.351 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.351+0000 7f0d199128c0 1 < suggested update operation key=H604SA6XTFLY tag=PZ3TYID2B31L type=write size=279323 2024-09-12T00:24:13.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.355+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=5MN3T7GXHAVX type=del size=618008 2024-09-12T00:24:13.358 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.359+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~9R4H5BXCA2IW.0 size=960139 2024-09-12T00:24:13.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.363+0000 7f0d199128c0 1 < completed multipart upload key=WBGXMJB7U422 upload=9R4H5BXCA2IW tag=0MFYO27LYDGZ type=write size=2008715 2024-09-12T00:24:13.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.371+0000 7f0d199128c0 1 > prepared part key=_multipart_RFCHRGVA9GOI.2~JSBW1QMKA12P.0 size=428369 2024-09-12T00:24:13.371 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.371+0000 7f0d199128c0 1 > prepared multipart upload key=RFCHRGVA9GOI upload=JSBW1QMKA12P tag=4HZ2ZCGS1BCA type=write size=1476945 2024-09-12T00:24:13.374 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.375+0000 7f0d199128c0 1 < completed delete operation key=IPJEXRBN96NB tag=2JV2GIB8OK9W type=del 2024-09-12T00:24:13.377 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.379+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=CNWX4KUMDJBC type=del size=300595 2024-09-12T00:24:13.384 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.383+0000 7f0d199128c0 1 < suggested update operation key=0ZT4NZYZKI5Z tag=QX1FKEWUP3KE type=write size=977375 2024-09-12T00:24:13.388 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.387+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=DKFJ9BAB47Y1 type=del size=1575550 2024-09-12T00:24:13.391 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.391+0000 7f0d199128c0 -1 < failed to complete operation key=0ZT4NZYZKI5Z tag=ON3JPNQGO4HR type=write size=168112: (22) Invalid argument 2024-09-12T00:24:13.394 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.395+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=SO4I7XKZSX3D type=del size=504150 2024-09-12T00:24:13.401 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.403+0000 7f0d199128c0 1 < suggested remove operation key=0ZT4NZYZKI5Z tag=8VWY1R3PY746 type=del 2024-09-12T00:24:13.405 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.403+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=W3D7H461TSBQ type=del size=133380 2024-09-12T00:24:13.408 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.407+0000 7f0d199128c0 1 < completed write operation key=FJ8YV026H0ZU tag=E41YHOHXYOWH type=write size=404666 2024-09-12T00:24:13.412 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.411+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=QUPE99OUHBUP type=del size=488062 2024-09-12T00:24:13.415 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.415+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~DBAZG7J0Q006.0 size=1048576 2024-09-12T00:24:13.418 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.419+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~DBAZG7J0Q006.1 size=1048576 2024-09-12T00:24:13.421 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.423+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~DBAZG7J0Q006.2 size=712775 2024-09-12T00:24:13.427 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.427+0000 7f0d199128c0 1 < completed multipart upload key=V6H6S9X0U2A0 upload=DBAZG7J0Q006 tag=7NXHLSUI2Y82 type=write size=3858503 2024-09-12T00:24:13.430 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.431+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=9H7LBUCPLIRQ type=write size=388601 2024-09-12T00:24:13.433 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.435+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~HIZD0FXKYMMV.0 size=1048576 2024-09-12T00:24:13.433 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.435+0000 7f0d199128c0 1 < canceled part key=_multipart_QUO5ND3O41TY.2~HIZD0FXKYMMV.1 size=1048576 2024-09-12T00:24:13.436 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.435+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~HIZD0FXKYMMV.2 size=411735 2024-09-12T00:24:13.441 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.443+0000 7f0d199128c0 1 < canceled multipart upload key=QUO5ND3O41TY upload=HIZD0FXKYMMV tag=0A841878OIJY type=write size=3557463 2024-09-12T00:24:13.448 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.447+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~WZ7YXSVJC76V.0 size=1048576 2024-09-12T00:24:13.451 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.451+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~WZ7YXSVJC76V.1 size=1048576 2024-09-12T00:24:13.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.451+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~WZ7YXSVJC76V.2 size=446638 2024-09-12T00:24:13.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.451+0000 7f0d199128c0 1 > prepared multipart upload key=QUO5ND3O41TY upload=WZ7YXSVJC76V tag=MJCGS0VL4BMA type=write size=3592366 2024-09-12T00:24:13.457 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.455+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~Z3GSV2SAKUEL.0 size=484215 2024-09-12T00:24:13.463 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.463+0000 7f0d199128c0 1 < completed multipart upload key=A529WOKFD1NI upload=Z3GSV2SAKUEL tag=1VLABB9TVQZR type=write size=1532791 2024-09-12T00:24:13.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.467+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=M4KYQDKMC4FU type=del size=3171371 2024-09-12T00:24:13.473 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.475+0000 7f0d199128c0 1 < suggested update operation key=V6H6S9X0U2A0 tag=8U0HY9RUM3I9 type=del size=158951 2024-09-12T00:24:13.477 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.475+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=Z6NMQK5HNEOT type=write size=973981 2024-09-12T00:24:13.481 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.479+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~5KGIR5Q9OHGF.0 size=490530 2024-09-12T00:24:13.487 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.487+0000 7f0d199128c0 1 < completed multipart upload key=10YEWZDTTEV0 upload=5KGIR5Q9OHGF tag=JB5HFQICC859 type=write size=1539106 2024-09-12T00:24:13.494 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.495+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~ZMUMA37VS1DZ.0 size=1048576 2024-09-12T00:24:13.496 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.495+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~ZMUMA37VS1DZ.1 size=1013918 2024-09-12T00:24:13.497 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.495+0000 7f0d199128c0 1 > prepared multipart upload key=10YEWZDTTEV0 upload=ZMUMA37VS1DZ tag=D610WXXRTVIA type=write size=3111070 2024-09-12T00:24:13.500 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.499+0000 7f0d199128c0 1 < canceled operation key=2EK9CCKG26W2 tag=T2ISAQ8YYE4O type=del size=1542945 2024-09-12T00:24:13.507 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.507+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~EZYJJT1N69A4.0 size=1048576 2024-09-12T00:24:13.510 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.511+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~EZYJJT1N69A4.1 size=430047 2024-09-12T00:24:13.510 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.511+0000 7f0d199128c0 1 > prepared multipart upload key=37WTPAJGOX5L upload=EZYJJT1N69A4 tag=YGIG75DIEHMC type=write size=2527199 2024-09-12T00:24:13.515 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.515+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~CO5MDIO30N61.0 size=22689 2024-09-12T00:24:13.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.519+0000 7f0d199128c0 1 < completed multipart upload key=J75P0821XGRO upload=CO5MDIO30N61 tag=MKM247VOQGU2 type=write size=1071265 2024-09-12T00:24:13.524 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.523+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=1RV3X316FTRV type=del size=4039053 2024-09-12T00:24:13.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.531+0000 7f0d199128c0 1 < suggested remove operation key=V6H6S9X0U2A0 tag=AS605YISKOTY type=write 2024-09-12T00:24:13.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.535+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=CZDDWI83T8KW type=del size=2907289 2024-09-12T00:24:13.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.535+0000 7f0d199128c0 1 < canceled part key=_multipart_0ZT4NZYZKI5Z.2~IQ22IZWJHABL.0 size=896057 2024-09-12T00:24:13.541 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.539+0000 7f0d199128c0 1 < canceled multipart upload key=0ZT4NZYZKI5Z upload=IQ22IZWJHABL tag=D0W4W07IL491 type=write size=1944633 2024-09-12T00:24:13.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.547+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~1F5567CKFGHK.0 size=1048576 2024-09-12T00:24:13.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.551+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~1F5567CKFGHK.1 size=1048576 2024-09-12T00:24:13.553 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.551+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~1F5567CKFGHK.2 size=474406 2024-09-12T00:24:13.553 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.551+0000 7f0d199128c0 1 > prepared multipart upload key=1Y6B1MJP5G4L upload=1F5567CKFGHK tag=8LG2MUXCQYHG type=write size=3620134 2024-09-12T00:24:13.556 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.555+0000 7f0d199128c0 1 < completed delete operation key=0EBWUENN0881 tag=5MN3T7GXHAVX type=del 2024-09-12T00:24:13.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.559+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=Q1H10PBAFV9T type=write size=394533 2024-09-12T00:24:13.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.563+0000 7f0d199128c0 1 < completed part key=_multipart_RFCHRGVA9GOI.2~JSBW1QMKA12P.0 size=428369 2024-09-12T00:24:13.569 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.567+0000 7f0d199128c0 1 < completed multipart upload key=RFCHRGVA9GOI upload=JSBW1QMKA12P tag=4HZ2ZCGS1BCA type=write size=1476945 2024-09-12T00:24:13.572 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.571+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=GGKW8P4KNBET type=del size=3984290 2024-09-12T00:24:13.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.579+0000 7f0d199128c0 1 < suggested remove operation key=4K654PSDLDVI tag=CNWX4KUMDJBC type=del 2024-09-12T00:24:13.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.587+0000 7f0d199128c0 1 > prepared part key=_multipart_RFCHRGVA9GOI.2~ULBKBCU5CNF0.0 size=1048576 2024-09-12T00:24:13.589 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.591+0000 7f0d199128c0 1 > prepared part key=_multipart_RFCHRGVA9GOI.2~ULBKBCU5CNF0.1 size=1048576 2024-09-12T00:24:13.592 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.591+0000 7f0d199128c0 1 > prepared part key=_multipart_RFCHRGVA9GOI.2~ULBKBCU5CNF0.2 size=149349 2024-09-12T00:24:13.592 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.591+0000 7f0d199128c0 1 > prepared multipart upload key=RFCHRGVA9GOI upload=ULBKBCU5CNF0 tag=LEULFH42Y5XV type=write size=3295077 2024-09-12T00:24:13.596 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.595+0000 7f0d199128c0 1 < completed delete operation key=1Y6B1MJP5G4L tag=DKFJ9BAB47Y1 type=del 2024-09-12T00:24:13.600 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.599+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=ZYVSJZWF6DKN type=write size=1020929 2024-09-12T00:24:13.603 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.603+0000 7f0d199128c0 1 < completed delete operation key=A529WOKFD1NI tag=SO4I7XKZSX3D type=del 2024-09-12T00:24:13.613 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.611+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~9FS28X1VVUNS.0 size=819651 2024-09-12T00:24:13.613 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.611+0000 7f0d199128c0 1 > prepared multipart upload key=WBGXMJB7U422 upload=9FS28X1VVUNS tag=4AQ99VJYZ7DA type=write size=1868227 2024-09-12T00:24:13.616 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.615+0000 7f0d199128c0 1 < completed delete operation key=10YEWZDTTEV0 tag=W3D7H461TSBQ type=del 2024-09-12T00:24:13.620 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.619+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=6VOC7LCJQMKN type=del size=2058446 2024-09-12T00:24:13.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.627+0000 7f0d199128c0 1 < suggested remove operation key=ZWGD87Z1MMNK tag=QUPE99OUHBUP type=del 2024-09-12T00:24:13.630 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.631+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=163X8QAOZ0F5 type=del size=1278034 2024-09-12T00:24:13.637 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.639+0000 7f0d199128c0 1 < suggested remove operation key=SITJU2EUVSR8 tag=9H7LBUCPLIRQ type=write 2024-09-12T00:24:13.641 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.639+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=O8SZWML7N9BE type=del size=1026711 2024-09-12T00:24:13.641 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.643+0000 7f0d199128c0 1 < canceled part key=_multipart_QUO5ND3O41TY.2~WZ7YXSVJC76V.0 size=1048576 2024-09-12T00:24:13.644 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.643+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~WZ7YXSVJC76V.1 size=1048576 2024-09-12T00:24:13.647 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.647+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~WZ7YXSVJC76V.2 size=446638 2024-09-12T00:24:13.653 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.651+0000 7f0d199128c0 1 < canceled multipart upload key=QUO5ND3O41TY upload=WZ7YXSVJC76V tag=MJCGS0VL4BMA type=write size=3592366 2024-09-12T00:24:13.660 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.659+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~BS99263SQ81X.0 size=1048576 2024-09-12T00:24:13.662 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.663+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~BS99263SQ81X.1 size=1048576 2024-09-12T00:24:13.665 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.667+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~BS99263SQ81X.2 size=937611 2024-09-12T00:24:13.665 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.667+0000 7f0d199128c0 1 > prepared multipart upload key=QUO5ND3O41TY upload=BS99263SQ81X tag=GTS1JSDYIHMV type=write size=4083339 2024-09-12T00:24:13.669 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.667+0000 7f0d199128c0 1 < completed delete operation key=OVLAP0OS78QG tag=M4KYQDKMC4FU type=del 2024-09-12T00:24:13.673 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.671+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=21YQ34TFFPIP type=del size=2672276 2024-09-12T00:24:13.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.679+0000 7f0d199128c0 1 < suggested update operation key=FJ8YV026H0ZU tag=Z6NMQK5HNEOT type=write size=973981 2024-09-12T00:24:13.684 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.683+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=ES2714V6HFCJ type=del size=348877 2024-09-12T00:24:13.687 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.687+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~ZMUMA37VS1DZ.0 size=1048576 2024-09-12T00:24:13.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.691+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~ZMUMA37VS1DZ.1 size=1013918 2024-09-12T00:24:13.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.695+0000 7f0d199128c0 1 < completed multipart upload key=10YEWZDTTEV0 upload=ZMUMA37VS1DZ tag=D610WXXRTVIA type=write size=3111070 2024-09-12T00:24:13.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.703+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~523GQK310IBF.0 size=873443 2024-09-12T00:24:13.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.703+0000 7f0d199128c0 1 > prepared multipart upload key=57W1IO3KSWBR upload=523GQK310IBF tag=4CAW3ZGUG4EC type=write size=1922019 2024-09-12T00:24:13.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.703+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~EZYJJT1N69A4.0 size=1048576 2024-09-12T00:24:13.707 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.707+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~EZYJJT1N69A4.1 size=430047 2024-09-12T00:24:13.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.711+0000 7f0d199128c0 1 < completed multipart upload key=37WTPAJGOX5L upload=EZYJJT1N69A4 tag=YGIG75DIEHMC type=write size=2527199 2024-09-12T00:24:13.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.715+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=12HGEC424NLV type=del size=3219242 2024-09-12T00:24:13.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.719+0000 7f0d199128c0 1 < completed delete operation key=9I6MZAEUS4I0 tag=1RV3X316FTRV type=del 2024-09-12T00:24:13.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.723+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=GTU4GUPP3T3V type=del size=4045993 2024-09-12T00:24:13.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.727+0000 7f0d199128c0 1 < canceled operation key=J75P0821XGRO tag=CZDDWI83T8KW type=del size=2907289 2024-09-12T00:24:13.730 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.731+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=ZKVJKJYCOOAN type=del size=2024079 2024-09-12T00:24:13.733 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.731+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~1F5567CKFGHK.0 size=1048576 2024-09-12T00:24:13.736 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.735+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~1F5567CKFGHK.1 size=1048576 2024-09-12T00:24:13.738 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.739+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~1F5567CKFGHK.2 size=474406 2024-09-12T00:24:13.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.743+0000 7f0d199128c0 1 < completed multipart upload key=1Y6B1MJP5G4L upload=1F5567CKFGHK tag=8LG2MUXCQYHG type=write size=3620134 2024-09-12T00:24:13.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.751+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~JD79JJ195NHX.0 size=1048576 2024-09-12T00:24:13.754 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.755+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~JD79JJ195NHX.1 size=1048576 2024-09-12T00:24:13.757 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.759+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~JD79JJ195NHX.2 size=594901 2024-09-12T00:24:13.758 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.759+0000 7f0d199128c0 1 > prepared multipart upload key=J75P0821XGRO upload=JD79JJ195NHX tag=I2SS0SDO1KI3 type=write size=3740629 2024-09-12T00:24:13.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.763+0000 7f0d199128c0 1 < completed write operation key=YTXW98O07966 tag=Q1H10PBAFV9T type=write size=394533 2024-09-12T00:24:13.766 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.767+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=C7RZL3MNIRNO type=del size=713037 2024-09-12T00:24:13.770 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.771+0000 7f0d199128c0 1 < completed delete operation key=RFCHRGVA9GOI tag=GGKW8P4KNBET type=del 2024-09-12T00:24:13.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.775+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=8W58ORHYP3KK type=del size=3060137 2024-09-12T00:24:13.778 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.779+0000 7f0d199128c0 1 < completed part key=_multipart_RFCHRGVA9GOI.2~ULBKBCU5CNF0.0 size=1048576 2024-09-12T00:24:13.778 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.779+0000 7f0d199128c0 1 < canceled part key=_multipart_RFCHRGVA9GOI.2~ULBKBCU5CNF0.1 size=1048576 2024-09-12T00:24:13.778 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.779+0000 7f0d199128c0 1 < canceled part key=_multipart_RFCHRGVA9GOI.2~ULBKBCU5CNF0.2 size=149349 2024-09-12T00:24:13.783 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.783+0000 7f0d199128c0 1 < canceled multipart upload key=RFCHRGVA9GOI upload=ULBKBCU5CNF0 tag=LEULFH42Y5XV type=write size=3295077 2024-09-12T00:24:13.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.791+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~UKEDGF6E866M.0 size=1048576 2024-09-12T00:24:13.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.791+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~UKEDGF6E866M.1 size=321211 2024-09-12T00:24:13.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.791+0000 7f0d199128c0 1 > prepared multipart upload key=2EK9CCKG26W2 upload=UKEDGF6E866M tag=DJ2AGB91FDAR type=write size=2418363 2024-09-12T00:24:13.796 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.795+0000 7f0d199128c0 1 < completed write operation key=RFCHRGVA9GOI tag=ZYVSJZWF6DKN type=write size=1020929 2024-09-12T00:24:13.799 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.799+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=LA5257AH9IC8 type=del size=765577 2024-09-12T00:24:13.803 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.803+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~9FS28X1VVUNS.0 size=819651 2024-09-12T00:24:13.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.807+0000 7f0d199128c0 1 < completed multipart upload key=WBGXMJB7U422 upload=9FS28X1VVUNS tag=4AQ99VJYZ7DA type=write size=1868227 2024-09-12T00:24:13.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.811+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=S230FWHGXKE1 type=write size=647141 2024-09-12T00:24:13.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.815+0000 7f0d199128c0 1 < canceled operation key=NXQYUQIR2APT tag=6VOC7LCJQMKN type=del size=2058446 2024-09-12T00:24:13.823 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.823+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~6G8OFM32EOHY.0 size=1048576 2024-09-12T00:24:13.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.827+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~6G8OFM32EOHY.1 size=1048576 2024-09-12T00:24:13.828 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.827+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~6G8OFM32EOHY.2 size=113540 2024-09-12T00:24:13.828 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.827+0000 7f0d199128c0 1 > prepared multipart upload key=57W1IO3KSWBR upload=6G8OFM32EOHY tag=GMPKBLPBT99D type=write size=3259268 2024-09-12T00:24:13.831 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.831+0000 7f0d199128c0 1 < completed delete operation key=VXZI0ZTMQSV0 tag=163X8QAOZ0F5 type=del 2024-09-12T00:24:13.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.835+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=4CNKFD7IPK1Q type=del size=1956394 2024-09-12T00:24:13.841 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.843+0000 7f0d199128c0 1 < suggested update operation key=ZWGD87Z1MMNK tag=O8SZWML7N9BE type=del size=1026711 2024-09-12T00:24:13.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.843+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=UHCF2URIJEFA type=del size=2358029 2024-09-12T00:24:13.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.847+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~BS99263SQ81X.0 size=1048576 2024-09-12T00:24:13.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.851+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~BS99263SQ81X.1 size=1048576 2024-09-12T00:24:13.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.855+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~BS99263SQ81X.2 size=937611 2024-09-12T00:24:13.860 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.859+0000 7f0d199128c0 1 < completed multipart upload key=QUO5ND3O41TY upload=BS99263SQ81X tag=GTS1JSDYIHMV type=write size=4083339 2024-09-12T00:24:13.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.863+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=Z1RM0GCOHM12 type=del size=2838831 2024-09-12T00:24:13.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.871+0000 7f0d199128c0 1 < suggested remove operation key=WPZOKZDFXK4S tag=21YQ34TFFPIP type=del 2024-09-12T00:24:13.878 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.879+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~17TMHD22F6DM.0 size=1048576 2024-09-12T00:24:13.881 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.883+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~17TMHD22F6DM.1 size=897757 2024-09-12T00:24:13.882 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.883+0000 7f0d199128c0 1 > prepared multipart upload key=QUO5ND3O41TY upload=17TMHD22F6DM tag=5KOPGU9I2YVK type=write size=2994909 2024-09-12T00:24:13.885 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.883+0000 7f0d199128c0 1 < completed delete operation key=J75P0821XGRO tag=ES2714V6HFCJ type=del 2024-09-12T00:24:13.892 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.891+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~7MNJNEVL31LN.0 size=1048576 2024-09-12T00:24:13.895 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.895+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~7MNJNEVL31LN.1 size=630584 2024-09-12T00:24:13.895 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.895+0000 7f0d199128c0 1 > prepared multipart upload key=WPZOKZDFXK4S upload=7MNJNEVL31LN tag=IQ24H4TLI5RA type=write size=2727736 2024-09-12T00:24:13.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.899+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~523GQK310IBF.0 size=873443 2024-09-12T00:24:13.903 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.903+0000 7f0d199128c0 1 < completed multipart upload key=57W1IO3KSWBR upload=523GQK310IBF tag=4CAW3ZGUG4EC type=write size=1922019 2024-09-12T00:24:13.907 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.907+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=UELAYRR2AWDV type=del size=1278074 2024-09-12T00:24:13.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.911+0000 7f0d199128c0 1 < completed delete operation key=37WTPAJGOX5L tag=12HGEC424NLV type=del 2024-09-12T00:24:13.914 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.915+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=F3KAFRJ9HCAD type=del size=1363218 2024-09-12T00:24:13.918 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.919+0000 7f0d199128c0 1 < completed delete operation key=0ZT4NZYZKI5Z tag=GTU4GUPP3T3V type=del 2024-09-12T00:24:13.924 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.923+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~J78PV488HD1R.0 size=1048576 2024-09-12T00:24:13.927 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.927+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~J78PV488HD1R.1 size=1048576 2024-09-12T00:24:13.930 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.931+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~J78PV488HD1R.2 size=718500 2024-09-12T00:24:13.930 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.931+0000 7f0d199128c0 1 > prepared multipart upload key=GH0FNY2AI00G upload=J78PV488HD1R tag=NYFQB27986C9 type=write size=3864228 2024-09-12T00:24:13.940 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.939+0000 7f0d199128c0 1 < suggested update operation key=OVLAP0OS78QG tag=ZKVJKJYCOOAN type=del size=2024079 2024-09-12T00:24:13.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.947+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~TFGNZXF68Y0W.0 size=1048576 2024-09-12T00:24:13.950 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.951+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~TFGNZXF68Y0W.1 size=985158 2024-09-12T00:24:13.950 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.951+0000 7f0d199128c0 1 > prepared multipart upload key=ZWGD87Z1MMNK upload=TFGNZXF68Y0W tag=MTCSIDRFR9YE type=write size=3082310 2024-09-12T00:24:13.950 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.951+0000 7f0d199128c0 1 < canceled part key=_multipart_J75P0821XGRO.2~JD79JJ195NHX.0 size=1048576 2024-09-12T00:24:13.954 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.955+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~JD79JJ195NHX.1 size=1048576 2024-09-12T00:24:13.956 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.955+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~JD79JJ195NHX.2 size=594901 2024-09-12T00:24:13.963 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.963+0000 7f0d199128c0 1 < canceled multipart upload key=J75P0821XGRO upload=JD79JJ195NHX tag=I2SS0SDO1KI3 type=write size=3740629 2024-09-12T00:24:13.966 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.967+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=YQGXK8WRJHFB type=del size=4059128 2024-09-12T00:24:13.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.971+0000 7f0d199128c0 1 < completed delete operation key=VXZI0ZTMQSV0 tag=C7RZL3MNIRNO type=del 2024-09-12T00:24:13.973 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.975+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=3PBNKLH8NTCQ type=del size=1744903 2024-09-12T00:24:13.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.975+0000 7f0d199128c0 1 < completed delete operation key=2EK9CCKG26W2 tag=8W58ORHYP3KK type=del 2024-09-12T00:24:13.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.979+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=LBCZ6B6MCYM4 type=del size=571496 2024-09-12T00:24:13.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.983+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~UKEDGF6E866M.0 size=1048576 2024-09-12T00:24:13.987 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.987+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~UKEDGF6E866M.1 size=321211 2024-09-12T00:24:13.993 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.991+0000 7f0d199128c0 1 < completed multipart upload key=2EK9CCKG26W2 upload=UKEDGF6E866M tag=DJ2AGB91FDAR type=write size=2418363 2024-09-12T00:24:13.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.995+0000 7f0d199128c0 1 > prepared operation key=57W1IO3KSWBR tag=D2N3VR7PRK4B type=del size=205030 2024-09-12T00:24:14.000 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:13.999+0000 7f0d199128c0 1 < completed delete operation key=WBGXMJB7U422 tag=LA5257AH9IC8 type=del 2024-09-12T00:24:14.004 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.003+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=ULU9DAAM0PH4 type=del size=2298394 2024-09-12T00:24:14.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.007+0000 7f0d199128c0 1 < completed write operation key=FJ8YV026H0ZU tag=S230FWHGXKE1 type=write size=647141 2024-09-12T00:24:14.011 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.011+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=1ONELV536DDB type=del size=1827445 2024-09-12T00:24:14.015 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.015+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~6G8OFM32EOHY.0 size=1048576 2024-09-12T00:24:14.017 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.019+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~6G8OFM32EOHY.1 size=1048576 2024-09-12T00:24:14.021 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.019+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~6G8OFM32EOHY.2 size=113540 2024-09-12T00:24:14.027 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.027+0000 7f0d199128c0 1 < completed multipart upload key=57W1IO3KSWBR upload=6G8OFM32EOHY tag=GMPKBLPBT99D type=write size=3259268 2024-09-12T00:24:14.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.031+0000 7f0d199128c0 1 > prepared part key=_multipart_RFCHRGVA9GOI.2~3QBAMY1RNI0Z.0 size=310254 2024-09-12T00:24:14.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.031+0000 7f0d199128c0 1 > prepared multipart upload key=RFCHRGVA9GOI upload=3QBAMY1RNI0Z tag=BYTBMTU7VUYR type=write size=1358830 2024-09-12T00:24:14.037 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.035+0000 7f0d199128c0 -1 < failed to complete operation key=WPZOKZDFXK4S tag=4CNKFD7IPK1Q type=del size=1956394: (22) Invalid argument 2024-09-12T00:24:14.041 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.039+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=101YF0VV0G93 type=del size=1550237 2024-09-12T00:24:14.045 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.043+0000 7f0d199128c0 1 < completed delete operation key=FJ8YV026H0ZU tag=UHCF2URIJEFA type=del 2024-09-12T00:24:14.049 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.051+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=YUV8OYY6MZP6 type=del size=2125369 2024-09-12T00:24:14.053 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.051+0000 7f0d199128c0 1 < completed delete operation key=WBGXMJB7U422 tag=Z1RM0GCOHM12 type=del 2024-09-12T00:24:14.061 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.059+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~2DZWRY2UD6I3.0 size=1048576 2024-09-12T00:24:14.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.063+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~2DZWRY2UD6I3.1 size=1048576 2024-09-12T00:24:14.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.067+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~2DZWRY2UD6I3.2 size=751087 2024-09-12T00:24:14.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.067+0000 7f0d199128c0 1 > prepared multipart upload key=VXZI0ZTMQSV0 upload=2DZWRY2UD6I3 tag=RZ3042M6VYR0 type=write size=3896815 2024-09-12T00:24:14.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.071+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~17TMHD22F6DM.0 size=1048576 2024-09-12T00:24:14.075 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.075+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~17TMHD22F6DM.1 size=897757 2024-09-12T00:24:14.081 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.083+0000 7f0d199128c0 1 < completed multipart upload key=QUO5ND3O41TY upload=17TMHD22F6DM tag=5KOPGU9I2YVK type=write size=2994909 2024-09-12T00:24:14.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.087+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=X5HYCL36CO8C type=del size=1703601 2024-09-12T00:24:14.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.087+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~7MNJNEVL31LN.0 size=1048576 2024-09-12T00:24:14.092 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.091+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~7MNJNEVL31LN.1 size=630584 2024-09-12T00:24:14.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.099+0000 7f0d199128c0 1 < completed multipart upload key=WPZOKZDFXK4S upload=7MNJNEVL31LN tag=IQ24H4TLI5RA type=write size=2727736 2024-09-12T00:24:14.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.099+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=FUU1QG55R5QM type=del size=1132059 2024-09-12T00:24:14.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.103+0000 7f0d199128c0 1 < completed delete operation key=HXNC728XIWC1 tag=UELAYRR2AWDV type=del 2024-09-12T00:24:14.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.107+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=T3K748EG6E7X type=del size=149221 2024-09-12T00:24:14.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.111+0000 7f0d199128c0 1 < completed delete operation key=B58RWC9W8THG tag=F3KAFRJ9HCAD type=del 2024-09-12T00:24:14.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.115+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=SL54HWYBSCBW type=del size=292118 2024-09-12T00:24:14.118 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.119+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~J78PV488HD1R.0 size=1048576 2024-09-12T00:24:14.121 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.119+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~J78PV488HD1R.1 size=1048576 2024-09-12T00:24:14.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.123+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~J78PV488HD1R.2 size=718500 2024-09-12T00:24:14.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.131+0000 7f0d199128c0 1 < completed multipart upload key=GH0FNY2AI00G upload=J78PV488HD1R tag=NYFQB27986C9 type=write size=3864228 2024-09-12T00:24:14.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.131+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=QO3S10YEEWH5 type=del size=3908232 2024-09-12T00:24:14.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.135+0000 7f0d199128c0 1 < canceled part key=_multipart_ZWGD87Z1MMNK.2~TFGNZXF68Y0W.0 size=1048576 2024-09-12T00:24:14.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.139+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~TFGNZXF68Y0W.1 size=985158 2024-09-12T00:24:14.143 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.143+0000 7f0d199128c0 1 < canceled multipart upload key=ZWGD87Z1MMNK upload=TFGNZXF68Y0W tag=MTCSIDRFR9YE type=write size=3082310 2024-09-12T00:24:14.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.151+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~XA5WELD7F9N1.0 size=1048576 2024-09-12T00:24:14.153 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.151+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~XA5WELD7F9N1.1 size=1048576 2024-09-12T00:24:14.155 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.155+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~XA5WELD7F9N1.2 size=465277 2024-09-12T00:24:14.156 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.155+0000 7f0d199128c0 1 > prepared multipart upload key=37WTPAJGOX5L upload=XA5WELD7F9N1 tag=XKASK9EIMKRB type=write size=3611005 2024-09-12T00:24:14.159 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.159+0000 7f0d199128c0 1 < completed delete operation key=HXNC728XIWC1 tag=YQGXK8WRJHFB type=del 2024-09-12T00:24:14.165 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.167+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~AD6R5C4NHUVO.0 size=1048576 2024-09-12T00:24:14.169 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.167+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~AD6R5C4NHUVO.1 size=1048576 2024-09-12T00:24:14.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.171+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~AD6R5C4NHUVO.2 size=598670 2024-09-12T00:24:14.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.171+0000 7f0d199128c0 1 > prepared multipart upload key=V6H6S9X0U2A0 upload=AD6R5C4NHUVO tag=HJ4YZPTCYOIU type=write size=3744398 2024-09-12T00:24:14.175 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.175+0000 7f0d199128c0 1 < completed delete operation key=B58RWC9W8THG tag=3PBNKLH8NTCQ type=del 2024-09-12T00:24:14.181 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.179+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~8IVJ30ZKDHHR.0 size=1048576 2024-09-12T00:24:14.184 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.183+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~8IVJ30ZKDHHR.1 size=1048576 2024-09-12T00:24:14.187 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.187+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~8IVJ30ZKDHHR.2 size=48442 2024-09-12T00:24:14.187 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.187+0000 7f0d199128c0 1 > prepared multipart upload key=10YEWZDTTEV0 upload=8IVJ30ZKDHHR tag=GJTN9H90S4BY type=write size=3194170 2024-09-12T00:24:14.191 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.191+0000 7f0d199128c0 1 < completed delete operation key=PK2CA62QBZXS tag=LBCZ6B6MCYM4 type=del 2024-09-12T00:24:14.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.195+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=BKFIYBLRDT77 type=del size=1103030 2024-09-12T00:24:14.198 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.199+0000 7f0d199128c0 1 < completed delete operation key=57W1IO3KSWBR tag=D2N3VR7PRK4B type=del 2024-09-12T00:24:14.202 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.203+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=PVOWFNW8SZH0 type=del size=1118175 2024-09-12T00:24:14.206 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.207+0000 7f0d199128c0 1 < completed delete operation key=RFCHRGVA9GOI tag=ULU9DAAM0PH4 type=del 2024-09-12T00:24:14.209 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.207+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=OF5NUGQJ3FTP type=write size=492053 2024-09-12T00:24:14.213 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.211+0000 7f0d199128c0 1 < completed delete operation key=37WTPAJGOX5L tag=1ONELV536DDB type=del 2024-09-12T00:24:14.219 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.219+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~2V697SHR044J.0 size=1048576 2024-09-12T00:24:14.222 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.223+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~2V697SHR044J.1 size=1048576 2024-09-12T00:24:14.225 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.223+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~2V697SHR044J.2 size=430743 2024-09-12T00:24:14.225 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.223+0000 7f0d199128c0 1 > prepared multipart upload key=RX3RVT06SGJ4 upload=2V697SHR044J tag=4K30CKAWZ98B type=write size=3576471 2024-09-12T00:24:14.228 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.227+0000 7f0d199128c0 1 < completed part key=_multipart_RFCHRGVA9GOI.2~3QBAMY1RNI0Z.0 size=310254 2024-09-12T00:24:14.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.235+0000 7f0d199128c0 1 < completed multipart upload key=RFCHRGVA9GOI upload=3QBAMY1RNI0Z tag=BYTBMTU7VUYR type=write size=1358830 2024-09-12T00:24:14.237 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.239+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=JENC0S8K4GQ7 type=del size=3465931 2024-09-12T00:24:14.245 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.243+0000 7f0d199128c0 1 < suggested remove operation key=PK2CA62QBZXS tag=101YF0VV0G93 type=del 2024-09-12T00:24:14.248 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.247+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=AIEMS8XJOWR3 type=del size=3944840 2024-09-12T00:24:14.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.251+0000 7f0d199128c0 1 < completed delete operation key=JA6CSJF78VE2 tag=YUV8OYY6MZP6 type=del 2024-09-12T00:24:14.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.255+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=33NG65GQP8OX type=del size=942509 2024-09-12T00:24:14.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.259+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~2DZWRY2UD6I3.0 size=1048576 2024-09-12T00:24:14.262 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.263+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~2DZWRY2UD6I3.1 size=1048576 2024-09-12T00:24:14.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.267+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~2DZWRY2UD6I3.2 size=751087 2024-09-12T00:24:14.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.271+0000 7f0d199128c0 1 < completed multipart upload key=VXZI0ZTMQSV0 upload=2DZWRY2UD6I3 tag=RZ3042M6VYR0 type=write size=3896815 2024-09-12T00:24:14.279 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.279+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=PIKEOQXN9P52 type=write size=791158 2024-09-12T00:24:14.283 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.283+0000 7f0d199128c0 1 < canceled operation key=YTXW98O07966 tag=X5HYCL36CO8C type=del size=1703601 2024-09-12T00:24:14.289 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.291+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~2V9HE2THE8GH.0 size=1048576 2024-09-12T00:24:14.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.291+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~2V9HE2THE8GH.1 size=468614 2024-09-12T00:24:14.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.291+0000 7f0d199128c0 1 > prepared multipart upload key=A529WOKFD1NI upload=2V9HE2THE8GH tag=ZYU9TQMXLTMI type=write size=2565766 2024-09-12T00:24:14.299 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.299+0000 7f0d199128c0 1 < suggested remove operation key=NXQYUQIR2APT tag=FUU1QG55R5QM type=del 2024-09-12T00:24:14.303 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.303+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=X7PN8WF1I2WP type=del size=36493 2024-09-12T00:24:14.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.307+0000 7f0d199128c0 1 < completed delete operation key=A529WOKFD1NI tag=T3K748EG6E7X type=del 2024-09-12T00:24:14.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.311+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=IPCFQOFNMVT2 type=write size=712927 2024-09-12T00:24:14.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.315+0000 7f0d199128c0 1 < suggested update operation key=37WTPAJGOX5L tag=SL54HWYBSCBW type=del size=292118 2024-09-12T00:24:14.320 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.319+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=O2FO560BSIG5 type=del size=2199010 2024-09-12T00:24:14.323 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.323+0000 7f0d199128c0 -1 < failed to complete operation key=37WTPAJGOX5L tag=QO3S10YEEWH5 type=del size=3908232: (22) Invalid argument 2024-09-12T00:24:14.327 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.327+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=FUIBK24SOXIQ type=del size=3680572 2024-09-12T00:24:14.330 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.331+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~XA5WELD7F9N1.0 size=1048576 2024-09-12T00:24:14.333 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.335+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~XA5WELD7F9N1.1 size=1048576 2024-09-12T00:24:14.333 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.335+0000 7f0d199128c0 1 < canceled part key=_multipart_37WTPAJGOX5L.2~XA5WELD7F9N1.2 size=465277 2024-09-12T00:24:14.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.339+0000 7f0d199128c0 1 < canceled multipart upload key=37WTPAJGOX5L upload=XA5WELD7F9N1 tag=XKASK9EIMKRB type=write size=3611005 2024-09-12T00:24:14.342 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.343+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=2LSK4U4CFYAE type=del size=4026701 2024-09-12T00:24:14.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.347+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~AD6R5C4NHUVO.0 size=1048576 2024-09-12T00:24:14.349 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.347+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~AD6R5C4NHUVO.1 size=1048576 2024-09-12T00:24:14.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.351+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~AD6R5C4NHUVO.2 size=598670 2024-09-12T00:24:14.357 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.359+0000 7f0d199128c0 1 < completed multipart upload key=V6H6S9X0U2A0 upload=AD6R5C4NHUVO tag=HJ4YZPTCYOIU type=write size=3744398 2024-09-12T00:24:14.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.363+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~RVTNKM032YBP.0 size=32239 2024-09-12T00:24:14.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.363+0000 7f0d199128c0 1 > prepared multipart upload key=B58RWC9W8THG upload=RVTNKM032YBP tag=C6FY4WE19P90 type=write size=1080815 2024-09-12T00:24:14.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.367+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~8IVJ30ZKDHHR.0 size=1048576 2024-09-12T00:24:14.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.371+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~8IVJ30ZKDHHR.1 size=1048576 2024-09-12T00:24:14.373 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.371+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~8IVJ30ZKDHHR.2 size=48442 2024-09-12T00:24:14.378 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.379+0000 7f0d199128c0 1 < completed multipart upload key=10YEWZDTTEV0 upload=8IVJ30ZKDHHR tag=GJTN9H90S4BY type=write size=3194170 2024-09-12T00:24:14.382 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.383+0000 7f0d199128c0 1 > prepared operation key=57W1IO3KSWBR tag=RX17PTVVD9RZ type=del size=1742648 2024-09-12T00:24:14.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.387+0000 7f0d199128c0 1 < completed delete operation key=ZWGD87Z1MMNK tag=BKFIYBLRDT77 type=del 2024-09-12T00:24:14.394 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.395+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~QFJIP6Z6AJ0R.0 size=1048576 2024-09-12T00:24:14.400 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.395+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~QFJIP6Z6AJ0R.1 size=883361 2024-09-12T00:24:14.401 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.395+0000 7f0d199128c0 1 > prepared multipart upload key=VXZI0ZTMQSV0 upload=QFJIP6Z6AJ0R tag=RFS2NM7I7HY9 type=write size=2980513 2024-09-12T00:24:14.401 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.399+0000 7f0d199128c0 1 < completed delete operation key=FJ8YV026H0ZU tag=PVOWFNW8SZH0 type=del 2024-09-12T00:24:14.406 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.407+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~JUU6SUKSS1K0.0 size=1048576 2024-09-12T00:24:14.409 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.411+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~JUU6SUKSS1K0.1 size=266430 2024-09-12T00:24:14.409 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.411+0000 7f0d199128c0 1 > prepared multipart upload key=OVLAP0OS78QG upload=JUU6SUKSS1K0 tag=03V1QNHYO9GX type=write size=2363582 2024-09-12T00:24:14.413 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.411+0000 7f0d199128c0 1 < completed write operation key=A529WOKFD1NI tag=OF5NUGQJ3FTP type=write size=492053 2024-09-12T00:24:14.416 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.415+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=9WYWBM57R74E type=del size=1648978 2024-09-12T00:24:14.420 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.419+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~2V697SHR044J.0 size=1048576 2024-09-12T00:24:14.423 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.423+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~2V697SHR044J.1 size=1048576 2024-09-12T00:24:14.425 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.427+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~2V697SHR044J.2 size=430743 2024-09-12T00:24:14.431 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.431+0000 7f0d199128c0 1 < completed multipart upload key=RX3RVT06SGJ4 upload=2V697SHR044J tag=4K30CKAWZ98B type=write size=3576471 2024-09-12T00:24:14.435 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.435+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=0DU8J8X4GW0X type=del size=3021347 2024-09-12T00:24:14.442 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.443+0000 7f0d199128c0 1 < suggested update operation key=VXZI0ZTMQSV0 tag=JENC0S8K4GQ7 type=del size=3465931 2024-09-12T00:24:14.448 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.447+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~O995H039VOYV.0 size=1048576 2024-09-12T00:24:14.451 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.451+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~O995H039VOYV.1 size=857735 2024-09-12T00:24:14.451 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.451+0000 7f0d199128c0 1 > prepared multipart upload key=0EBWUENN0881 upload=O995H039VOYV tag=MSUE8W333TBI type=write size=2954887 2024-09-12T00:24:14.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.455+0000 7f0d199128c0 1 < completed delete operation key=V6H6S9X0U2A0 tag=AIEMS8XJOWR3 type=del 2024-09-12T00:24:14.458 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.459+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=AVZ7JV1LO8LI type=del size=3554444 2024-09-12T00:24:14.465 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.463+0000 7f0d199128c0 1 < suggested update operation key=JA6CSJF78VE2 tag=33NG65GQP8OX type=del size=942509 2024-09-12T00:24:14.468 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.467+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=3EEM46K6ZDLN type=del size=663795 2024-09-12T00:24:14.472 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.471+0000 7f0d199128c0 1 < completed write operation key=10YEWZDTTEV0 tag=PIKEOQXN9P52 type=write size=791158 2024-09-12T00:24:14.479 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.479+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~Y4EZLXF6NWEX.0 size=1048576 2024-09-12T00:24:14.481 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.483+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~Y4EZLXF6NWEX.1 size=972457 2024-09-12T00:24:14.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.483+0000 7f0d199128c0 1 > prepared multipart upload key=57W1IO3KSWBR upload=Y4EZLXF6NWEX tag=KHI4X90BR8C7 type=write size=3069609 2024-09-12T00:24:14.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.483+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~2V9HE2THE8GH.0 size=1048576 2024-09-12T00:24:14.488 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.487+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~2V9HE2THE8GH.1 size=468614 2024-09-12T00:24:14.494 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.495+0000 7f0d199128c0 1 < completed multipart upload key=A529WOKFD1NI upload=2V9HE2THE8GH tag=ZYU9TQMXLTMI type=write size=2565766 2024-09-12T00:24:14.498 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.499+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=KRYQN1G0JKP4 type=del size=735522 2024-09-12T00:24:14.501 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.503+0000 7f0d199128c0 1 < completed delete operation key=4K654PSDLDVI tag=X7PN8WF1I2WP type=del 2024-09-12T00:24:14.505 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.503+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=JMNZNA7L8N4P type=del size=1700470 2024-09-12T00:24:14.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.507+0000 7f0d199128c0 1 < completed write operation key=0EBWUENN0881 tag=IPCFQOFNMVT2 type=write size=712927 2024-09-12T00:24:14.515 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.515+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~T9Q03CHCEJJ1.0 size=155955 2024-09-12T00:24:14.516 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.515+0000 7f0d199128c0 1 > prepared multipart upload key=NXQYUQIR2APT upload=T9Q03CHCEJJ1 tag=NSTVAAMHM5AK type=write size=1204531 2024-09-12T00:24:14.522 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.523+0000 7f0d199128c0 1 < suggested remove operation key=IPJEXRBN96NB tag=O2FO560BSIG5 type=del 2024-09-12T00:24:14.529 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.527+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~7KO3VW31S8A7.0 size=392692 2024-09-12T00:24:14.529 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.527+0000 7f0d199128c0 1 > prepared multipart upload key=RX3RVT06SGJ4 upload=7KO3VW31S8A7 tag=M1Q7HLOTVF8U type=write size=1441268 2024-09-12T00:24:14.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.531+0000 7f0d199128c0 1 < canceled operation key=H604SA6XTFLY tag=FUIBK24SOXIQ type=del size=3680572 2024-09-12T00:24:14.536 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.535+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=LKRHH3KNSPN3 type=del size=1694952 2024-09-12T00:24:14.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.539+0000 7f0d199128c0 1 < completed delete operation key=WPZOKZDFXK4S tag=2LSK4U4CFYAE type=del 2024-09-12T00:24:14.544 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.543+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=MCXHLGPKV4JS type=del size=3817550 2024-09-12T00:24:14.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.547+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~RVTNKM032YBP.0 size=32239 2024-09-12T00:24:14.553 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.555+0000 7f0d199128c0 1 < completed multipart upload key=B58RWC9W8THG upload=RVTNKM032YBP tag=C6FY4WE19P90 type=write size=1080815 2024-09-12T00:24:14.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.559+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~DUA24E5JGPN9.0 size=698215 2024-09-12T00:24:14.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.559+0000 7f0d199128c0 1 > prepared multipart upload key=SITJU2EUVSR8 upload=DUA24E5JGPN9 tag=YGGSKWG9IR1Y type=write size=1746791 2024-09-12T00:24:14.563 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.563+0000 7f0d199128c0 1 < completed delete operation key=57W1IO3KSWBR tag=RX17PTVVD9RZ type=del 2024-09-12T00:24:14.567 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.567+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=MZEX3CSW0KHI type=del size=63990 2024-09-12T00:24:14.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.571+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~QFJIP6Z6AJ0R.0 size=1048576 2024-09-12T00:24:14.573 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.571+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~QFJIP6Z6AJ0R.1 size=883361 2024-09-12T00:24:14.579 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.579+0000 7f0d199128c0 1 < completed multipart upload key=VXZI0ZTMQSV0 upload=QFJIP6Z6AJ0R tag=RFS2NM7I7HY9 type=write size=2980513 2024-09-12T00:24:14.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.583+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~0MZN1MUL1B3X.0 size=1048576 2024-09-12T00:24:14.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.587+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~0MZN1MUL1B3X.1 size=1048576 2024-09-12T00:24:14.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.591+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~0MZN1MUL1B3X.2 size=410810 2024-09-12T00:24:14.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.591+0000 7f0d199128c0 1 > prepared multipart upload key=OVLAP0OS78QG upload=0MZN1MUL1B3X tag=QCWRTWGBENMI type=write size=3556538 2024-09-12T00:24:14.594 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.595+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~JUU6SUKSS1K0.0 size=1048576 2024-09-12T00:24:14.597 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.595+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~JUU6SUKSS1K0.1 size=266430 2024-09-12T00:24:14.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.603+0000 7f0d199128c0 1 < completed multipart upload key=OVLAP0OS78QG upload=JUU6SUKSS1K0 tag=03V1QNHYO9GX type=write size=2363582 2024-09-12T00:24:14.608 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.607+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=SSDDMU14Q4IG type=write size=71401 2024-09-12T00:24:14.612 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.611+0000 7f0d199128c0 1 < completed delete operation key=9I6MZAEUS4I0 tag=9WYWBM57R74E type=del 2024-09-12T00:24:14.615 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.615+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=FAM4FHXZQGTJ type=del size=844786 2024-09-12T00:24:14.619 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.619+0000 7f0d199128c0 -1 < failed to complete operation key=IPJEXRBN96NB tag=0DU8J8X4GW0X type=del size=3021347: (22) Invalid argument 2024-09-12T00:24:14.622 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.623+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=SNY4MM6BVDFC type=del size=178662 2024-09-12T00:24:14.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.627+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~O995H039VOYV.0 size=1048576 2024-09-12T00:24:14.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.627+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~O995H039VOYV.1 size=857735 2024-09-12T00:24:14.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.635+0000 7f0d199128c0 1 < completed multipart upload key=0EBWUENN0881 upload=O995H039VOYV tag=MSUE8W333TBI type=write size=2954887 2024-09-12T00:24:14.638 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.639+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=AMYGX2CZK4AP type=del size=2801905 2024-09-12T00:24:14.642 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.643+0000 7f0d199128c0 1 < completed delete operation key=2EK9CCKG26W2 tag=AVZ7JV1LO8LI type=del 2024-09-12T00:24:14.648 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.647+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~ZOA69UYZA8FW.0 size=1048576 2024-09-12T00:24:14.651 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.651+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~ZOA69UYZA8FW.1 size=1014087 2024-09-12T00:24:14.651 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.651+0000 7f0d199128c0 1 > prepared multipart upload key=T6GOR4SBYU2Y upload=ZOA69UYZA8FW tag=JE9HQBYM3A81 type=write size=3111239 2024-09-12T00:24:14.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.655+0000 7f0d199128c0 1 < completed delete operation key=WBGXMJB7U422 tag=3EEM46K6ZDLN type=del 2024-09-12T00:24:14.658 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.659+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=8C0EZD897J8E type=del size=770335 2024-09-12T00:24:14.661 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.663+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~Y4EZLXF6NWEX.0 size=1048576 2024-09-12T00:24:14.664 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.663+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~Y4EZLXF6NWEX.1 size=972457 2024-09-12T00:24:14.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.671+0000 7f0d199128c0 1 < completed multipart upload key=57W1IO3KSWBR upload=Y4EZLXF6NWEX tag=KHI4X90BR8C7 type=write size=3069609 2024-09-12T00:24:14.673 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.675+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=N27R9ADXY7KY type=del size=1035996 2024-09-12T00:24:14.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.679+0000 7f0d199128c0 1 < suggested remove operation key=JA6CSJF78VE2 tag=KRYQN1G0JKP4 type=del 2024-09-12T00:24:14.686 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.687+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=66AXZ8RIY5FT type=del size=1131932 2024-09-12T00:24:14.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.691+0000 7f0d199128c0 1 < completed delete operation key=J75P0821XGRO tag=JMNZNA7L8N4P type=del 2024-09-12T00:24:14.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.695+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=Q82TKJRZSR1R type=del size=3836282 2024-09-12T00:24:14.697 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.699+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~T9Q03CHCEJJ1.0 size=155955 2024-09-12T00:24:14.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.703+0000 7f0d199128c0 1 < completed multipart upload key=NXQYUQIR2APT upload=T9Q03CHCEJJ1 tag=NSTVAAMHM5AK type=write size=1204531 2024-09-12T00:24:14.708 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.707+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=FU5T3LBD6UNG type=del size=2330112 2024-09-12T00:24:14.711 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.711+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~7KO3VW31S8A7.0 size=392692 2024-09-12T00:24:14.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.715+0000 7f0d199128c0 1 < completed multipart upload key=RX3RVT06SGJ4 upload=7KO3VW31S8A7 tag=M1Q7HLOTVF8U type=write size=1441268 2024-09-12T00:24:14.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.719+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=01VWSDRB9DRH type=write size=53045 2024-09-12T00:24:14.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.727+0000 7f0d199128c0 1 < suggested update operation key=VXZI0ZTMQSV0 tag=LKRHH3KNSPN3 type=del size=1694952 2024-09-12T00:24:14.730 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.731+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=R6DT0982EYBG type=del size=731776 2024-09-12T00:24:14.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.735+0000 7f0d199128c0 1 < completed delete operation key=2EK9CCKG26W2 tag=MCXHLGPKV4JS type=del 2024-09-12T00:24:14.740 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.739+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~Y349QTUYHUZI.0 size=1048576 2024-09-12T00:24:14.742 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.743+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~Y349QTUYHUZI.1 size=1048576 2024-09-12T00:24:14.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.747+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~Y349QTUYHUZI.2 size=7590 2024-09-12T00:24:14.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.747+0000 7f0d199128c0 1 > prepared multipart upload key=ZWGD87Z1MMNK upload=Y349QTUYHUZI tag=9G35MJJI2866 type=write size=3153318 2024-09-12T00:24:14.749 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.747+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~DUA24E5JGPN9.0 size=698215 2024-09-12T00:24:14.754 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.755+0000 7f0d199128c0 1 < completed multipart upload key=SITJU2EUVSR8 upload=DUA24E5JGPN9 tag=YGGSKWG9IR1Y type=write size=1746791 2024-09-12T00:24:14.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.763+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~1GG6WDYRJOW5.0 size=1048576 2024-09-12T00:24:14.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.763+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~1GG6WDYRJOW5.1 size=1048576 2024-09-12T00:24:14.767 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.767+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~1GG6WDYRJOW5.2 size=861133 2024-09-12T00:24:14.767 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.767+0000 7f0d199128c0 1 > prepared multipart upload key=B58RWC9W8THG upload=1GG6WDYRJOW5 tag=4PRUBMVF48PW type=write size=4006861 2024-09-12T00:24:14.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.771+0000 7f0d199128c0 1 < completed delete operation key=H604SA6XTFLY tag=MZEX3CSW0KHI type=del 2024-09-12T00:24:14.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.775+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=WABKLEMYGESD type=write size=752191 2024-09-12T00:24:14.779 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.779+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~0MZN1MUL1B3X.0 size=1048576 2024-09-12T00:24:14.783 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.783+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~0MZN1MUL1B3X.1 size=1048576 2024-09-12T00:24:14.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.787+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~0MZN1MUL1B3X.2 size=410810 2024-09-12T00:24:14.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.791+0000 7f0d199128c0 1 < completed multipart upload key=OVLAP0OS78QG upload=0MZN1MUL1B3X tag=QCWRTWGBENMI type=write size=3556538 2024-09-12T00:24:14.796 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.795+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=8VXYNTA8TWVD type=del size=2283198 2024-09-12T00:24:14.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.803+0000 7f0d199128c0 1 < suggested update operation key=RX3RVT06SGJ4 tag=SSDDMU14Q4IG type=write size=71401 2024-09-12T00:24:14.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.807+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=42U9YNCQ47C3 type=write size=5301 2024-09-12T00:24:14.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.811+0000 7f0d199128c0 -1 < no bi entry to suggest for operation key=JA6CSJF78VE2 tag=FAM4FHXZQGTJ type=del size=844786: (2) No such file or directory 2024-09-12T00:24:14.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.815+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=83498HFDMVFJ type=del size=1688528 2024-09-12T00:24:14.818 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.819+0000 7f0d199128c0 1 < completed delete operation key=HXNC728XIWC1 tag=SNY4MM6BVDFC type=del 2024-09-12T00:24:14.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.823+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=INRC1YIYOCYI type=write size=447687 2024-09-12T00:24:14.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.827+0000 7f0d199128c0 -1 < failed to complete operation key=VXZI0ZTMQSV0 tag=AMYGX2CZK4AP type=del size=2801905: (22) Invalid argument 2024-09-12T00:24:14.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.831+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~NKJX1VBMNKFJ.0 size=1015303 2024-09-12T00:24:14.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.831+0000 7f0d199128c0 1 > prepared multipart upload key=ZWGD87Z1MMNK upload=NKJX1VBMNKFJ tag=XKEOYK2CI493 type=write size=2063879 2024-09-12T00:24:14.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.831+0000 7f0d199128c0 1 < canceled part key=_multipart_T6GOR4SBYU2Y.2~ZOA69UYZA8FW.0 size=1048576 2024-09-12T00:24:14.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.835+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~ZOA69UYZA8FW.1 size=1014087 2024-09-12T00:24:14.841 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.839+0000 7f0d199128c0 1 < canceled multipart upload key=T6GOR4SBYU2Y upload=ZOA69UYZA8FW tag=JE9HQBYM3A81 type=write size=3111239 2024-09-12T00:24:14.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.847+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~MLV4XNSWT33L.0 size=1048576 2024-09-12T00:24:14.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.851+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~MLV4XNSWT33L.1 size=586591 2024-09-12T00:24:14.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.851+0000 7f0d199128c0 1 > prepared multipart upload key=YTXW98O07966 upload=MLV4XNSWT33L tag=8O7OLYYYBW0B type=write size=2683743 2024-09-12T00:24:14.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.855+0000 7f0d199128c0 1 < canceled operation key=1Y6B1MJP5G4L tag=8C0EZD897J8E type=del size=770335 2024-09-12T00:24:14.860 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.859+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~KTKAVS4YUJ3F.0 size=366041 2024-09-12T00:24:14.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.859+0000 7f0d199128c0 1 > prepared multipart upload key=IPJEXRBN96NB upload=KTKAVS4YUJ3F tag=NISSZOKTG0V8 type=write size=1414617 2024-09-12T00:24:14.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.863+0000 7f0d199128c0 1 < completed delete operation key=PK2CA62QBZXS tag=N27R9ADXY7KY type=del 2024-09-12T00:24:14.867 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.867+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=BYBW050MLIL5 type=del size=1400077 2024-09-12T00:24:14.873 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.875+0000 7f0d199128c0 1 < suggested remove operation key=4K654PSDLDVI tag=66AXZ8RIY5FT type=del 2024-09-12T00:24:14.876 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.875+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=CGMNS1L1TOQF type=del size=2294180 2024-09-12T00:24:14.880 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.879+0000 7f0d199128c0 1 < canceled operation key=WPZOKZDFXK4S tag=Q82TKJRZSR1R type=del size=3836282 2024-09-12T00:24:14.885 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.883+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~BI47T9Z2AAZ5.0 size=1048576 2024-09-12T00:24:14.887 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.887+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~BI47T9Z2AAZ5.1 size=368745 2024-09-12T00:24:14.887 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.887+0000 7f0d199128c0 1 > prepared multipart upload key=0ZT4NZYZKI5Z upload=BI47T9Z2AAZ5 tag=ZROCWUHX1W0B type=write size=2465897 2024-09-12T00:24:14.890 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.891+0000 7f0d199128c0 1 < completed delete operation key=37WTPAJGOX5L tag=FU5T3LBD6UNG type=del 2024-09-12T00:24:14.893 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.891+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=AVU3F49LHW9D type=del size=2775201 2024-09-12T00:24:14.895 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.895+0000 7f0d199128c0 1 < completed write operation key=0EBWUENN0881 tag=01VWSDRB9DRH type=write size=53045 2024-09-12T00:24:14.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.899+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~CWCVVM17TAFB.0 size=1048576 2024-09-12T00:24:14.903 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.903+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~CWCVVM17TAFB.1 size=4750 2024-09-12T00:24:14.903 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.903+0000 7f0d199128c0 1 > prepared multipart upload key=JA6CSJF78VE2 upload=CWCVVM17TAFB tag=GDQ1DBGGTIT9 type=write size=2101902 2024-09-12T00:24:14.906 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.907+0000 7f0d199128c0 1 < canceled operation key=WPZOKZDFXK4S tag=R6DT0982EYBG type=del size=731776 2024-09-12T00:24:14.912 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.907+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=K96MVON4BARK type=del size=3373798 2024-09-12T00:24:14.912 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.911+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~Y349QTUYHUZI.0 size=1048576 2024-09-12T00:24:14.914 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.915+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~Y349QTUYHUZI.1 size=1048576 2024-09-12T00:24:14.914 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.915+0000 7f0d199128c0 1 < canceled part key=_multipart_ZWGD87Z1MMNK.2~Y349QTUYHUZI.2 size=7590 2024-09-12T00:24:14.918 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.919+0000 7f0d199128c0 1 < canceled multipart upload key=ZWGD87Z1MMNK upload=Y349QTUYHUZI tag=9G35MJJI2866 type=write size=3153318 2024-09-12T00:24:14.921 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.919+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=RIBOVC89A11H type=del size=165452 2024-09-12T00:24:14.923 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.923+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~1GG6WDYRJOW5.0 size=1048576 2024-09-12T00:24:14.925 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.927+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~1GG6WDYRJOW5.1 size=1048576 2024-09-12T00:24:14.928 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.927+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~1GG6WDYRJOW5.2 size=861133 2024-09-12T00:24:14.933 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.935+0000 7f0d199128c0 1 < completed multipart upload key=B58RWC9W8THG upload=1GG6WDYRJOW5 tag=4PRUBMVF48PW type=write size=4006861 2024-09-12T00:24:14.936 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.935+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=NK4M3P77P79D type=del size=965501 2024-09-12T00:24:14.941 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.939+0000 7f0d199128c0 1 < suggested remove operation key=0EBWUENN0881 tag=WABKLEMYGESD type=write 2024-09-12T00:24:14.945 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.947+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~AVJ0R1T2Z21N.0 size=1046963 2024-09-12T00:24:14.946 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.947+0000 7f0d199128c0 1 > prepared multipart upload key=A529WOKFD1NI upload=AVJ0R1T2Z21N tag=AU2Y5E95541X type=write size=2095539 2024-09-12T00:24:14.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.947+0000 7f0d199128c0 1 < completed delete operation key=VXZI0ZTMQSV0 tag=8VXYNTA8TWVD type=del 2024-09-12T00:24:14.953 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.951+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~AOXQZWSFFBXP.0 size=1048576 2024-09-12T00:24:14.955 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.955+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~AOXQZWSFFBXP.1 size=350089 2024-09-12T00:24:14.955 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.955+0000 7f0d199128c0 1 > prepared multipart upload key=0EBWUENN0881 upload=AOXQZWSFFBXP tag=38ZVFTH219BN type=write size=2447241 2024-09-12T00:24:14.959 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.959+0000 7f0d199128c0 1 < suggested update operation key=2EK9CCKG26W2 tag=42U9YNCQ47C3 type=write size=5301 2024-09-12T00:24:14.962 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.963+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=ZPIVA9UMRI41 type=del size=1636948 2024-09-12T00:24:14.964 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.963+0000 7f0d199128c0 1 < completed delete operation key=WPZOKZDFXK4S tag=83498HFDMVFJ type=del 2024-09-12T00:24:14.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.971+0000 7f0d199128c0 1 > prepared part key=_multipart_RFCHRGVA9GOI.2~YPGWL5HELZMW.0 size=1048576 2024-09-12T00:24:14.972 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.971+0000 7f0d199128c0 1 > prepared part key=_multipart_RFCHRGVA9GOI.2~YPGWL5HELZMW.1 size=142232 2024-09-12T00:24:14.972 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.971+0000 7f0d199128c0 1 > prepared multipart upload key=RFCHRGVA9GOI upload=YPGWL5HELZMW tag=37991F2GMBR2 type=write size=2239384 2024-09-12T00:24:14.976 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.975+0000 7f0d199128c0 1 < completed write operation key=GH0FNY2AI00G tag=INRC1YIYOCYI type=write size=447687 2024-09-12T00:24:14.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.983+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~CQ1TRAMAR7CU.0 size=1048576 2024-09-12T00:24:14.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.983+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~CQ1TRAMAR7CU.1 size=1048576 2024-09-12T00:24:14.986 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.987+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~CQ1TRAMAR7CU.2 size=275427 2024-09-12T00:24:14.986 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.987+0000 7f0d199128c0 1 > prepared multipart upload key=OVLAP0OS78QG upload=CQ1TRAMAR7CU tag=QQSMRDSDTHEI type=write size=3421155 2024-09-12T00:24:14.989 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.987+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~NKJX1VBMNKFJ.0 size=1015303 2024-09-12T00:24:14.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.995+0000 7f0d199128c0 1 < completed multipart upload key=ZWGD87Z1MMNK upload=NKJX1VBMNKFJ tag=XKEOYK2CI493 type=write size=2063879 2024-09-12T00:24:14.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.999+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=WTXABQZ1JSJW type=del size=3893535 2024-09-12T00:24:15.000 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:14.999+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~MLV4XNSWT33L.0 size=1048576 2024-09-12T00:24:15.003 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.003+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~MLV4XNSWT33L.1 size=586591 2024-09-12T00:24:15.008 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.007+0000 7f0d199128c0 1 < completed multipart upload key=YTXW98O07966 upload=MLV4XNSWT33L tag=8O7OLYYYBW0B type=write size=2683743 2024-09-12T00:24:15.011 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.011+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=DOPZVQE9T813 type=del size=3568945 2024-09-12T00:24:15.015 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.015+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~KTKAVS4YUJ3F.0 size=366041 2024-09-12T00:24:15.020 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.019+0000 7f0d199128c0 1 < completed multipart upload key=IPJEXRBN96NB upload=KTKAVS4YUJ3F tag=NISSZOKTG0V8 type=write size=1414617 2024-09-12T00:24:15.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.023+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=L4TTAFU0L5B1 type=del size=1408340 2024-09-12T00:24:15.026 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.027+0000 7f0d199128c0 1 < completed delete operation key=10YEWZDTTEV0 tag=BYBW050MLIL5 type=del 2024-09-12T00:24:15.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.027+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=Z1TRRSQAWBSK type=del size=3716480 2024-09-12T00:24:15.035 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.035+0000 7f0d199128c0 1 < suggested remove operation key=1Y6B1MJP5G4L tag=CGMNS1L1TOQF type=del 2024-09-12T00:24:15.040 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.039+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~A9E1G4QLMUL1.0 size=1048576 2024-09-12T00:24:15.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.043+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~A9E1G4QLMUL1.1 size=1048576 2024-09-12T00:24:15.045 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.043+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~A9E1G4QLMUL1.2 size=966471 2024-09-12T00:24:15.045 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.043+0000 7f0d199128c0 1 > prepared multipart upload key=9I6MZAEUS4I0 upload=A9E1G4QLMUL1 tag=PIEPXNUSN4S1 type=write size=4112199 2024-09-12T00:24:15.047 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.047+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~BI47T9Z2AAZ5.0 size=1048576 2024-09-12T00:24:15.050 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.051+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~BI47T9Z2AAZ5.1 size=368745 2024-09-12T00:24:15.055 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.055+0000 7f0d199128c0 1 < completed multipart upload key=0ZT4NZYZKI5Z upload=BI47T9Z2AAZ5 tag=ZROCWUHX1W0B type=write size=2465897 2024-09-12T00:24:15.058 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.059+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=AT475BDMROZY type=del size=589108 2024-09-12T00:24:15.061 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.059+0000 7f0d199128c0 1 < canceled operation key=37WTPAJGOX5L tag=AVU3F49LHW9D type=del size=2775201 2024-09-12T00:24:15.068 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.067+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~9VVGRSNG6FCQ.0 size=1048576 2024-09-12T00:24:15.071 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.071+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~9VVGRSNG6FCQ.1 size=1048576 2024-09-12T00:24:15.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.075+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~9VVGRSNG6FCQ.2 size=114982 2024-09-12T00:24:15.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.075+0000 7f0d199128c0 1 > prepared multipart upload key=J75P0821XGRO upload=9VVGRSNG6FCQ tag=P8C6KB4UFMQY type=write size=3260710 2024-09-12T00:24:15.077 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.075+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~CWCVVM17TAFB.0 size=1048576 2024-09-12T00:24:15.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.079+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~CWCVVM17TAFB.1 size=4750 2024-09-12T00:24:15.084 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.083+0000 7f0d199128c0 1 < completed multipart upload key=JA6CSJF78VE2 upload=CWCVVM17TAFB tag=GDQ1DBGGTIT9 type=write size=2101902 2024-09-12T00:24:15.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.087+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=8UI6PKW4WSS4 type=write size=275147 2024-09-12T00:24:15.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.091+0000 7f0d199128c0 1 < completed delete operation key=YTXW98O07966 tag=K96MVON4BARK type=del 2024-09-12T00:24:15.095 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.095+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=VE03GIJAERJT type=del size=3379406 2024-09-12T00:24:15.102 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.103+0000 7f0d199128c0 1 < suggested update operation key=SITJU2EUVSR8 tag=RIBOVC89A11H type=del size=165452 2024-09-12T00:24:15.105 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.107+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=VGF78MLGTMI7 type=del size=1728286 2024-09-12T00:24:15.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.107+0000 7f0d199128c0 1 < completed delete operation key=FJ8YV026H0ZU tag=NK4M3P77P79D type=del 2024-09-12T00:24:15.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.111+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=G98K4JVJS9Z2 type=del size=1102106 2024-09-12T00:24:15.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.115+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~AVJ0R1T2Z21N.0 size=1046963 2024-09-12T00:24:15.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.119+0000 7f0d199128c0 1 < completed multipart upload key=A529WOKFD1NI upload=AVJ0R1T2Z21N tag=AU2Y5E95541X type=write size=2095539 2024-09-12T00:24:15.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.123+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=MTG7JGAQWPV3 type=del size=3015418 2024-09-12T00:24:15.126 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.127+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~AOXQZWSFFBXP.0 size=1048576 2024-09-12T00:24:15.130 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.131+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~AOXQZWSFFBXP.1 size=350089 2024-09-12T00:24:15.135 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.135+0000 7f0d199128c0 1 < completed multipart upload key=0EBWUENN0881 upload=AOXQZWSFFBXP tag=38ZVFTH219BN type=write size=2447241 2024-09-12T00:24:15.139 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.139+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=HBQ2Q6NK408T type=del size=2200079 2024-09-12T00:24:15.141 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.143+0000 7f0d199128c0 1 < completed delete operation key=4K654PSDLDVI tag=ZPIVA9UMRI41 type=del 2024-09-12T00:24:15.144 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.143+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=YNSTQKTGDHBB type=del size=153432 2024-09-12T00:24:15.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.147+0000 7f0d199128c0 1 < completed part key=_multipart_RFCHRGVA9GOI.2~YPGWL5HELZMW.0 size=1048576 2024-09-12T00:24:15.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.151+0000 7f0d199128c0 1 < completed part key=_multipart_RFCHRGVA9GOI.2~YPGWL5HELZMW.1 size=142232 2024-09-12T00:24:15.155 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.155+0000 7f0d199128c0 1 < completed multipart upload key=RFCHRGVA9GOI upload=YPGWL5HELZMW tag=37991F2GMBR2 type=write size=2239384 2024-09-12T00:24:15.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.159+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=XDCS25J0FN7I type=write size=841941 2024-09-12T00:24:15.161 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.159+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~CQ1TRAMAR7CU.0 size=1048576 2024-09-12T00:24:15.161 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.159+0000 7f0d199128c0 1 < canceled part key=_multipart_OVLAP0OS78QG.2~CQ1TRAMAR7CU.1 size=1048576 2024-09-12T00:24:15.163 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.163+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~CQ1TRAMAR7CU.2 size=275427 2024-09-12T00:24:15.168 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.167+0000 7f0d199128c0 1 < canceled multipart upload key=OVLAP0OS78QG upload=CQ1TRAMAR7CU tag=QQSMRDSDTHEI type=write size=3421155 2024-09-12T00:24:15.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.171+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=2CUZF5MYIWMC type=write size=429086 2024-09-12T00:24:15.175 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.175+0000 7f0d199128c0 1 < canceled operation key=RX3RVT06SGJ4 tag=WTXABQZ1JSJW type=del size=3893535 2024-09-12T00:24:15.181 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.179+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~AOORFC24SY55.0 size=1048576 2024-09-12T00:24:15.183 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.183+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~AOORFC24SY55.1 size=761057 2024-09-12T00:24:15.183 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.183+0000 7f0d199128c0 1 > prepared multipart upload key=PK2CA62QBZXS upload=AOORFC24SY55 tag=2XZQBJ30UQEF type=write size=2858209 2024-09-12T00:24:15.186 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.187+0000 7f0d199128c0 1 < completed delete operation key=OVLAP0OS78QG tag=DOPZVQE9T813 type=del 2024-09-12T00:24:15.192 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.191+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~Z7HKPVRNIO9J.0 size=1048576 2024-09-12T00:24:15.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.195+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~Z7HKPVRNIO9J.1 size=1048576 2024-09-12T00:24:15.197 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.195+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~Z7HKPVRNIO9J.2 size=885088 2024-09-12T00:24:15.197 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.195+0000 7f0d199128c0 1 > prepared multipart upload key=10YEWZDTTEV0 upload=Z7HKPVRNIO9J tag=8B1FYOEP2UOG type=write size=4030816 2024-09-12T00:24:15.200 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.199+0000 7f0d199128c0 1 < completed delete operation key=NXQYUQIR2APT tag=L4TTAFU0L5B1 type=del 2024-09-12T00:24:15.204 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.203+0000 7f0d199128c0 1 > prepared operation key=57W1IO3KSWBR tag=UNZ9Q6A8ZTEJ type=del size=850714 2024-09-12T00:24:15.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.211+0000 7f0d199128c0 1 < suggested remove operation key=RFCHRGVA9GOI tag=Z1TRRSQAWBSK type=del 2024-09-12T00:24:15.217 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.215+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=ZEOXSECL8F2M type=del size=3188993 2024-09-12T00:24:15.220 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.219+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~A9E1G4QLMUL1.0 size=1048576 2024-09-12T00:24:15.223 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.223+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~A9E1G4QLMUL1.1 size=1048576 2024-09-12T00:24:15.225 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.223+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~A9E1G4QLMUL1.2 size=966471 2024-09-12T00:24:15.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.231+0000 7f0d199128c0 1 < completed multipart upload key=9I6MZAEUS4I0 upload=A9E1G4QLMUL1 tag=PIEPXNUSN4S1 type=write size=4112199 2024-09-12T00:24:15.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.235+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=M7R00VQ1LNOI type=del size=198401 2024-09-12T00:24:15.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.235+0000 7f0d199128c0 1 < completed delete operation key=H604SA6XTFLY tag=AT475BDMROZY type=del 2024-09-12T00:24:15.240 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.239+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=QBQXU7VOVMT5 type=write size=346409 2024-09-12T00:24:15.243 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.243+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~9VVGRSNG6FCQ.0 size=1048576 2024-09-12T00:24:15.246 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.247+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~9VVGRSNG6FCQ.1 size=1048576 2024-09-12T00:24:15.249 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.247+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~9VVGRSNG6FCQ.2 size=114982 2024-09-12T00:24:15.254 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.255+0000 7f0d199128c0 1 < completed multipart upload key=J75P0821XGRO upload=9VVGRSNG6FCQ tag=P8C6KB4UFMQY type=write size=3260710 2024-09-12T00:24:15.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.259+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=N3DA45HATQR6 type=del size=2745649 2024-09-12T00:24:15.262 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.263+0000 7f0d199128c0 1 < completed write operation key=A529WOKFD1NI tag=8UI6PKW4WSS4 type=write size=275147 2024-09-12T00:24:15.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.267+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=VIHWVTMEXQ56 type=del size=3893233 2024-09-12T00:24:15.272 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.271+0000 7f0d199128c0 1 < suggested update operation key=NXQYUQIR2APT tag=VE03GIJAERJT type=del size=3379406 2024-09-12T00:24:15.279 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.279+0000 7f0d199128c0 1 > prepared part key=_multipart_RFCHRGVA9GOI.2~ZRQYU87B0GWL.0 size=414551 2024-09-12T00:24:15.279 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.279+0000 7f0d199128c0 1 > prepared multipart upload key=RFCHRGVA9GOI upload=ZRQYU87B0GWL tag=7AUIS9CT013J type=write size=1463127 2024-09-12T00:24:15.283 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.283+0000 7f0d199128c0 1 < completed delete operation key=FJ8YV026H0ZU tag=VGF78MLGTMI7 type=del 2024-09-12T00:24:15.286 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.287+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=1OAUTIT9M061 type=del size=577184 2024-09-12T00:24:15.292 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.291+0000 7f0d199128c0 1 < completed delete operation key=VXZI0ZTMQSV0 tag=G98K4JVJS9Z2 type=del 2024-09-12T00:24:15.296 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.295+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~RDV7928ZD70T.0 size=1048576 2024-09-12T00:24:15.299 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.299+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~RDV7928ZD70T.1 size=1011751 2024-09-12T00:24:15.299 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.299+0000 7f0d199128c0 1 > prepared multipart upload key=T6GOR4SBYU2Y upload=RDV7928ZD70T tag=1RNAJGM1EC0R type=write size=3108903 2024-09-12T00:24:15.303 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.303+0000 7f0d199128c0 1 < completed delete operation key=RX3RVT06SGJ4 tag=MTG7JGAQWPV3 type=del 2024-09-12T00:24:15.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.307+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=21U3ZV2SH3PW type=del size=163474 2024-09-12T00:24:15.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.311+0000 7f0d199128c0 -1 < failed to complete operation key=NXQYUQIR2APT tag=HBQ2Q6NK408T type=del size=2200079: (22) Invalid argument 2024-09-12T00:24:15.316 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.315+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~WX7XHTXD3Y2G.0 size=1048576 2024-09-12T00:24:15.319 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.319+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~WX7XHTXD3Y2G.1 size=1048576 2024-09-12T00:24:15.322 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.323+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~WX7XHTXD3Y2G.2 size=914057 2024-09-12T00:24:15.322 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.323+0000 7f0d199128c0 1 > prepared multipart upload key=J75P0821XGRO upload=WX7XHTXD3Y2G tag=5VO3BH9AQUVR type=write size=4059785 2024-09-12T00:24:15.328 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.327+0000 7f0d199128c0 1 < suggested update operation key=SITJU2EUVSR8 tag=YNSTQKTGDHBB type=del size=153432 2024-09-12T00:24:15.335 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.335+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~WFLK17WCMV4I.0 size=1048576 2024-09-12T00:24:15.337 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.339+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~WFLK17WCMV4I.1 size=336729 2024-09-12T00:24:15.338 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.339+0000 7f0d199128c0 1 > prepared multipart upload key=4K654PSDLDVI upload=WFLK17WCMV4I tag=5H6TVO877BNU type=write size=2433881 2024-09-12T00:24:15.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.339+0000 7f0d199128c0 1 < completed write operation key=37WTPAJGOX5L tag=XDCS25J0FN7I type=write size=841941 2024-09-12T00:24:15.347 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.347+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~1X29ALPBQ4OV.0 size=745909 2024-09-12T00:24:15.348 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.347+0000 7f0d199128c0 1 > prepared multipart upload key=OVLAP0OS78QG upload=1X29ALPBQ4OV tag=8NPTPFBF5B72 type=write size=1794485 2024-09-12T00:24:15.351 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.351+0000 7f0d199128c0 1 < completed write operation key=WPZOKZDFXK4S tag=2CUZF5MYIWMC type=write size=429086 2024-09-12T00:24:15.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.355+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=2N1U7LFT3JM8 type=del size=1608178 2024-09-12T00:24:15.358 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.359+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~AOORFC24SY55.0 size=1048576 2024-09-12T00:24:15.361 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.359+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~AOORFC24SY55.1 size=761057 2024-09-12T00:24:15.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.367+0000 7f0d199128c0 1 < completed multipart upload key=PK2CA62QBZXS upload=AOORFC24SY55 tag=2XZQBJ30UQEF type=write size=2858209 2024-09-12T00:24:15.373 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.371+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~1PXHTR63ALS3.0 size=149319 2024-09-12T00:24:15.373 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.371+0000 7f0d199128c0 1 > prepared multipart upload key=0ZT4NZYZKI5Z upload=1PXHTR63ALS3 tag=Z2XWAZM4ZTBG type=write size=1197895 2024-09-12T00:24:15.377 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.375+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~Z7HKPVRNIO9J.0 size=1048576 2024-09-12T00:24:15.377 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.375+0000 7f0d199128c0 1 < canceled part key=_multipart_10YEWZDTTEV0.2~Z7HKPVRNIO9J.1 size=1048576 2024-09-12T00:24:15.379 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.379+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~Z7HKPVRNIO9J.2 size=885088 2024-09-12T00:24:15.385 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.383+0000 7f0d199128c0 1 < canceled multipart upload key=10YEWZDTTEV0 upload=Z7HKPVRNIO9J tag=8B1FYOEP2UOG type=write size=4030816 2024-09-12T00:24:15.389 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.391+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=4QZP6DYCRDB6 type=del size=2564385 2024-09-12T00:24:15.393 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.391+0000 7f0d199128c0 1 < completed delete operation key=57W1IO3KSWBR tag=UNZ9Q6A8ZTEJ type=del 2024-09-12T00:24:15.397 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.395+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=AK7MIZHIDH0U type=del size=1363590 2024-09-12T00:24:15.401 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.399+0000 7f0d199128c0 1 < completed delete operation key=WPZOKZDFXK4S tag=ZEOXSECL8F2M type=del 2024-09-12T00:24:15.404 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.403+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=IYC7YT16O17V type=del size=3985543 2024-09-12T00:24:15.412 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.411+0000 7f0d199128c0 1 < suggested remove operation key=NXQYUQIR2APT tag=M7R00VQ1LNOI type=del 2024-09-12T00:24:15.415 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.415+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=8V9068DHOA6X type=del size=739752 2024-09-12T00:24:15.418 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.419+0000 7f0d199128c0 1 < completed write operation key=FJ8YV026H0ZU tag=QBQXU7VOVMT5 type=write size=346409 2024-09-12T00:24:15.423 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.423+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=S7USJYJKWMED type=del size=267045 2024-09-12T00:24:15.426 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.427+0000 7f0d199128c0 1 < completed delete operation key=RFCHRGVA9GOI tag=N3DA45HATQR6 type=del 2024-09-12T00:24:15.429 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.431+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=HXAI79ABF27G type=del size=1206064 2024-09-12T00:24:15.433 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.431+0000 7f0d199128c0 1 < completed delete operation key=IPJEXRBN96NB tag=VIHWVTMEXQ56 type=del 2024-09-12T00:24:15.436 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.435+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=T7SG5SMM7VLA type=del size=3309086 2024-09-12T00:24:15.439 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.439+0000 7f0d199128c0 1 < completed part key=_multipart_RFCHRGVA9GOI.2~ZRQYU87B0GWL.0 size=414551 2024-09-12T00:24:15.445 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.443+0000 7f0d199128c0 1 < completed multipart upload key=RFCHRGVA9GOI upload=ZRQYU87B0GWL tag=7AUIS9CT013J type=write size=1463127 2024-09-12T00:24:15.448 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.447+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=GOEE4YYHB2K1 type=write size=414902 2024-09-12T00:24:15.452 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.451+0000 7f0d199128c0 1 < completed delete operation key=JA6CSJF78VE2 tag=1OAUTIT9M061 type=del 2024-09-12T00:24:15.459 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.459+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~DUCNYXNOBI5C.0 size=707911 2024-09-12T00:24:15.459 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.459+0000 7f0d199128c0 1 > prepared multipart upload key=RX3RVT06SGJ4 upload=DUCNYXNOBI5C tag=XE98D2TE8G9O type=write size=1756487 2024-09-12T00:24:15.463 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.463+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~RDV7928ZD70T.0 size=1048576 2024-09-12T00:24:15.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.467+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~RDV7928ZD70T.1 size=1011751 2024-09-12T00:24:15.471 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.471+0000 7f0d199128c0 1 < completed multipart upload key=T6GOR4SBYU2Y upload=RDV7928ZD70T tag=1RNAJGM1EC0R type=write size=3108903 2024-09-12T00:24:15.475 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.475+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=0V26TC46SZJW type=del size=382469 2024-09-12T00:24:15.478 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.479+0000 7f0d199128c0 1 < completed delete operation key=B58RWC9W8THG tag=21U3ZV2SH3PW type=del 2024-09-12T00:24:15.481 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.479+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=MXKHL1Y7BP0C type=del size=3031004 2024-09-12T00:24:15.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.483+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~WX7XHTXD3Y2G.0 size=1048576 2024-09-12T00:24:15.488 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.487+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~WX7XHTXD3Y2G.1 size=1048576 2024-09-12T00:24:15.491 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.491+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~WX7XHTXD3Y2G.2 size=914057 2024-09-12T00:24:15.498 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.499+0000 7f0d199128c0 1 < completed multipart upload key=J75P0821XGRO upload=WX7XHTXD3Y2G tag=5VO3BH9AQUVR type=write size=4059785 2024-09-12T00:24:15.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.503+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=JW4DLOEVNZI3 type=del size=366384 2024-09-12T00:24:15.508 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.507+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~WFLK17WCMV4I.0 size=1048576 2024-09-12T00:24:15.510 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.511+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~WFLK17WCMV4I.1 size=336729 2024-09-12T00:24:15.516 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.515+0000 7f0d199128c0 1 < completed multipart upload key=4K654PSDLDVI upload=WFLK17WCMV4I tag=5H6TVO877BNU type=write size=2433881 2024-09-12T00:24:15.524 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.523+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~QQOIT2P5YCBC.0 size=1048576 2024-09-12T00:24:15.527 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.527+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~QQOIT2P5YCBC.1 size=1048576 2024-09-12T00:24:15.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.531+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~QQOIT2P5YCBC.2 size=850665 2024-09-12T00:24:15.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.531+0000 7f0d199128c0 1 > prepared multipart upload key=JA6CSJF78VE2 upload=QQOIT2P5YCBC tag=XOQMWQ8WYQD6 type=write size=3996393 2024-09-12T00:24:15.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.535+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~1X29ALPBQ4OV.0 size=745909 2024-09-12T00:24:15.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.539+0000 7f0d199128c0 1 < completed multipart upload key=OVLAP0OS78QG upload=1X29ALPBQ4OV tag=8NPTPFBF5B72 type=write size=1794485 2024-09-12T00:24:15.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.547+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~5AZGCMVF7UR5.0 size=1048576 2024-09-12T00:24:15.552 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.551+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~5AZGCMVF7UR5.1 size=1048576 2024-09-12T00:24:15.555 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.555+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~5AZGCMVF7UR5.2 size=576428 2024-09-12T00:24:15.555 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.555+0000 7f0d199128c0 1 > prepared multipart upload key=9I6MZAEUS4I0 upload=5AZGCMVF7UR5 tag=LBJS4LP28M3M type=write size=3722156 2024-09-12T00:24:15.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.559+0000 7f0d199128c0 1 < completed delete operation key=0EBWUENN0881 tag=2N1U7LFT3JM8 type=del 2024-09-12T00:24:15.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.563+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~ZH1KEFEW5KQV.0 size=1048576 2024-09-12T00:24:15.567 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.567+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~ZH1KEFEW5KQV.1 size=153264 2024-09-12T00:24:15.567 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.567+0000 7f0d199128c0 1 > prepared multipart upload key=JA6CSJF78VE2 upload=ZH1KEFEW5KQV tag=4GGGL8H900NV type=write size=2250416 2024-09-12T00:24:15.568 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.567+0000 7f0d199128c0 1 < canceled part key=_multipart_0ZT4NZYZKI5Z.2~1PXHTR63ALS3.0 size=149319 2024-09-12T00:24:15.573 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.575+0000 7f0d199128c0 1 < canceled multipart upload key=0ZT4NZYZKI5Z upload=1PXHTR63ALS3 tag=Z2XWAZM4ZTBG type=write size=1197895 2024-09-12T00:24:15.577 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.575+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=ENVVBOAEQPL7 type=del size=2621811 2024-09-12T00:24:15.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.579+0000 7f0d199128c0 1 < completed delete operation key=OVLAP0OS78QG tag=4QZP6DYCRDB6 type=del 2024-09-12T00:24:15.584 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.583+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=5ZX511JX2ECB type=del size=2096994 2024-09-12T00:24:15.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.587+0000 7f0d199128c0 1 < completed delete operation key=FJ8YV026H0ZU tag=AK7MIZHIDH0U type=del 2024-09-12T00:24:15.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.591+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=5WFBGZURJHIB type=del size=479695 2024-09-12T00:24:15.595 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.595+0000 7f0d199128c0 1 < completed delete operation key=VXZI0ZTMQSV0 tag=IYC7YT16O17V type=del 2024-09-12T00:24:15.601 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.603+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~UUCYGZ1Z94Z0.0 size=1048576 2024-09-12T00:24:15.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.603+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~UUCYGZ1Z94Z0.1 size=1048576 2024-09-12T00:24:15.607 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.607+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~UUCYGZ1Z94Z0.2 size=536979 2024-09-12T00:24:15.607 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.607+0000 7f0d199128c0 1 > prepared multipart upload key=JA6CSJF78VE2 upload=UUCYGZ1Z94Z0 tag=4ZGL82PDM7H6 type=write size=3682707 2024-09-12T00:24:15.614 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.615+0000 7f0d199128c0 1 < suggested update operation key=VXZI0ZTMQSV0 tag=8V9068DHOA6X type=del size=739752 2024-09-12T00:24:15.618 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.619+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=8TSLMQKADJJK type=write size=952276 2024-09-12T00:24:15.622 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.623+0000 7f0d199128c0 1 < completed delete operation key=OVLAP0OS78QG tag=S7USJYJKWMED type=del 2024-09-12T00:24:15.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.627+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=13EK0INGT3CZ type=del size=4103604 2024-09-12T00:24:15.630 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.631+0000 7f0d199128c0 1 < completed delete operation key=T6GOR4SBYU2Y tag=HXAI79ABF27G type=del 2024-09-12T00:24:15.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.635+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=PJFNOD73QKFF type=write size=161905 2024-09-12T00:24:15.637 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.639+0000 7f0d199128c0 1 < completed delete operation key=YTXW98O07966 tag=T7SG5SMM7VLA type=del 2024-09-12T00:24:15.644 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.643+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~FMGZYT759KVG.0 size=1048576 2024-09-12T00:24:15.647 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.647+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~FMGZYT759KVG.1 size=1048576 2024-09-12T00:24:15.650 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.651+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~FMGZYT759KVG.2 size=660793 2024-09-12T00:24:15.650 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.651+0000 7f0d199128c0 1 > prepared multipart upload key=WBGXMJB7U422 upload=FMGZYT759KVG tag=CFOICY1D4PYP type=write size=3806521 2024-09-12T00:24:15.653 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.655+0000 7f0d199128c0 1 < completed write operation key=GH0FNY2AI00G tag=GOEE4YYHB2K1 type=write size=414902 2024-09-12T00:24:15.661 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.659+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~UKZE8HSV7N0F.0 size=1048576 2024-09-12T00:24:15.664 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.663+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~UKZE8HSV7N0F.1 size=1048576 2024-09-12T00:24:15.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.667+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~UKZE8HSV7N0F.2 size=812206 2024-09-12T00:24:15.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.667+0000 7f0d199128c0 1 > prepared multipart upload key=2EK9CCKG26W2 upload=UKZE8HSV7N0F tag=IQL81UUSW3J9 type=write size=3957934 2024-09-12T00:24:15.671 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.671+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~DUCNYXNOBI5C.0 size=707911 2024-09-12T00:24:15.676 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.675+0000 7f0d199128c0 1 < completed multipart upload key=RX3RVT06SGJ4 upload=DUCNYXNOBI5C tag=XE98D2TE8G9O type=write size=1756487 2024-09-12T00:24:15.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.679+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=0PDWNWDXGZRU type=del size=802183 2024-09-12T00:24:15.691 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.691+0000 7f0d199128c0 1 < suggested update operation key=0EBWUENN0881 tag=0V26TC46SZJW type=del size=382469 2024-09-12T00:24:15.697 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.695+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~D4I79MZUCKMW.0 size=1048576 2024-09-12T00:24:15.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.699+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~D4I79MZUCKMW.1 size=279360 2024-09-12T00:24:15.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.699+0000 7f0d199128c0 1 > prepared multipart upload key=NXQYUQIR2APT upload=D4I79MZUCKMW tag=1JNDU9ECWPFA type=write size=2376512 2024-09-12T00:24:15.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.703+0000 7f0d199128c0 1 < completed delete operation key=QUO5ND3O41TY tag=MXKHL1Y7BP0C type=del 2024-09-12T00:24:15.707 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.707+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=03XP8HUNMSBE type=del size=3235014 2024-09-12T00:24:15.710 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.711+0000 7f0d199128c0 1 < completed delete operation key=0ZT4NZYZKI5Z tag=JW4DLOEVNZI3 type=del 2024-09-12T00:24:15.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.715+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~TNF482FR7SLW.0 size=1048576 2024-09-12T00:24:15.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.719+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~TNF482FR7SLW.1 size=373423 2024-09-12T00:24:15.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.719+0000 7f0d199128c0 1 > prepared multipart upload key=ZWGD87Z1MMNK upload=TNF482FR7SLW tag=Q6Q3YPT172DT type=write size=2470575 2024-09-12T00:24:15.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.723+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~QQOIT2P5YCBC.0 size=1048576 2024-09-12T00:24:15.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.723+0000 7f0d199128c0 1 < canceled part key=_multipart_JA6CSJF78VE2.2~QQOIT2P5YCBC.1 size=1048576 2024-09-12T00:24:15.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.727+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~QQOIT2P5YCBC.2 size=850665 2024-09-12T00:24:15.732 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.731+0000 7f0d199128c0 1 < canceled multipart upload key=JA6CSJF78VE2 upload=QQOIT2P5YCBC tag=XOQMWQ8WYQD6 type=write size=3996393 2024-09-12T00:24:15.738 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.739+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~F733R10OA1GC.0 size=1048576 2024-09-12T00:24:15.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.739+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~F733R10OA1GC.1 size=1048576 2024-09-12T00:24:15.743 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.743+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~F733R10OA1GC.2 size=1933 2024-09-12T00:24:15.743 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.743+0000 7f0d199128c0 1 > prepared multipart upload key=37WTPAJGOX5L upload=F733R10OA1GC tag=PSEPY1IOU47Y type=write size=3147661 2024-09-12T00:24:15.747 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.747+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~5AZGCMVF7UR5.0 size=1048576 2024-09-12T00:24:15.749 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.751+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~5AZGCMVF7UR5.1 size=1048576 2024-09-12T00:24:15.753 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.751+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~5AZGCMVF7UR5.2 size=576428 2024-09-12T00:24:15.759 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.759+0000 7f0d199128c0 1 < completed multipart upload key=9I6MZAEUS4I0 upload=5AZGCMVF7UR5 tag=LBJS4LP28M3M type=write size=3722156 2024-09-12T00:24:15.762 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.763+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=WNWX87WEH83P type=del size=3791439 2024-09-12T00:24:15.763 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.763+0000 7f0d199128c0 1 < canceled part key=_multipart_JA6CSJF78VE2.2~ZH1KEFEW5KQV.0 size=1048576 2024-09-12T00:24:15.767 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.767+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~ZH1KEFEW5KQV.1 size=153264 2024-09-12T00:24:15.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.775+0000 7f0d199128c0 1 < canceled multipart upload key=JA6CSJF78VE2 upload=ZH1KEFEW5KQV tag=4GGGL8H900NV type=write size=2250416 2024-09-12T00:24:15.777 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.775+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=6K139ZUEQ8T5 type=del size=3678629 2024-09-12T00:24:15.781 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.783+0000 7f0d199128c0 1 < completed delete operation key=37WTPAJGOX5L tag=ENVVBOAEQPL7 type=del 2024-09-12T00:24:15.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.787+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=3GZ1Y4QE87ZW type=del size=2494473 2024-09-12T00:24:15.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.791+0000 7f0d199128c0 1 < canceled operation key=OVLAP0OS78QG tag=5ZX511JX2ECB type=del size=2096994 2024-09-12T00:24:15.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.795+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=0DUH3QKEIRDT type=del size=1712908 2024-09-12T00:24:15.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.795+0000 7f0d199128c0 1 < completed delete operation key=T6GOR4SBYU2Y tag=5WFBGZURJHIB type=del 2024-09-12T00:24:15.801 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.803+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=FTHDT9URNYDZ type=del size=4134336 2024-09-12T00:24:15.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.803+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~UUCYGZ1Z94Z0.0 size=1048576 2024-09-12T00:24:15.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.807+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~UUCYGZ1Z94Z0.1 size=1048576 2024-09-12T00:24:15.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.807+0000 7f0d199128c0 1 < canceled part key=_multipart_JA6CSJF78VE2.2~UUCYGZ1Z94Z0.2 size=536979 2024-09-12T00:24:15.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.815+0000 7f0d199128c0 1 < canceled multipart upload key=JA6CSJF78VE2 upload=UUCYGZ1Z94Z0 tag=4ZGL82PDM7H6 type=write size=3682707 2024-09-12T00:24:15.817 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.819+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=SI8ZRZ1ANCK5 type=del size=4051598 2024-09-12T00:24:15.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.823+0000 7f0d199128c0 -1 < failed to complete operation key=0EBWUENN0881 tag=8TSLMQKADJJK type=write size=952276: (22) Invalid argument 2024-09-12T00:24:15.829 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.827+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~5A3XIXU9LNSN.0 size=1048576 2024-09-12T00:24:15.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.831+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~5A3XIXU9LNSN.1 size=53489 2024-09-12T00:24:15.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.831+0000 7f0d199128c0 1 > prepared multipart upload key=NXQYUQIR2APT upload=5A3XIXU9LNSN tag=7OZYFMP77UNG type=write size=2150641 2024-09-12T00:24:15.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.835+0000 7f0d199128c0 1 < canceled operation key=1Y6B1MJP5G4L tag=13EK0INGT3CZ type=del size=4103604 2024-09-12T00:24:15.839 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.839+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=LMRW3DONSRB3 type=del size=1050316 2024-09-12T00:24:15.842 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.843+0000 7f0d199128c0 1 < completed write operation key=RFCHRGVA9GOI tag=PJFNOD73QKFF type=write size=161905 2024-09-12T00:24:15.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.847+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~LAM1VLC54LBA.0 size=1048576 2024-09-12T00:24:15.852 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.851+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~LAM1VLC54LBA.1 size=309272 2024-09-12T00:24:15.852 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.851+0000 7f0d199128c0 1 > prepared multipart upload key=HXNC728XIWC1 upload=LAM1VLC54LBA tag=VOHB7KIDFCQJ type=write size=2406424 2024-09-12T00:24:15.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.855+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~FMGZYT759KVG.0 size=1048576 2024-09-12T00:24:15.858 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.859+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~FMGZYT759KVG.1 size=1048576 2024-09-12T00:24:15.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.859+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~FMGZYT759KVG.2 size=660793 2024-09-12T00:24:15.867 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.867+0000 7f0d199128c0 1 < completed multipart upload key=WBGXMJB7U422 upload=FMGZYT759KVG tag=CFOICY1D4PYP type=write size=3806521 2024-09-12T00:24:15.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.871+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=X31EBP6STJP4 type=del size=2433485 2024-09-12T00:24:15.875 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.875+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~UKZE8HSV7N0F.0 size=1048576 2024-09-12T00:24:15.878 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.879+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~UKZE8HSV7N0F.1 size=1048576 2024-09-12T00:24:15.881 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.879+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~UKZE8HSV7N0F.2 size=812206 2024-09-12T00:24:15.889 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.887+0000 7f0d199128c0 1 < completed multipart upload key=2EK9CCKG26W2 upload=UKZE8HSV7N0F tag=IQL81UUSW3J9 type=write size=3957934 2024-09-12T00:24:15.896 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.895+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~YEYNTW31P6EX.0 size=1048576 2024-09-12T00:24:15.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.899+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~YEYNTW31P6EX.1 size=61176 2024-09-12T00:24:15.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.899+0000 7f0d199128c0 1 > prepared multipart upload key=37WTPAJGOX5L upload=YEYNTW31P6EX tag=33JFNEIAZQF0 type=write size=2158328 2024-09-12T00:24:15.904 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.903+0000 7f0d199128c0 -1 < failed to complete operation key=0EBWUENN0881 tag=0PDWNWDXGZRU type=del size=802183: (22) Invalid argument 2024-09-12T00:24:15.906 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.907+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=5GW1WL5LST99 type=del size=25791 2024-09-12T00:24:15.909 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.907+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~D4I79MZUCKMW.0 size=1048576 2024-09-12T00:24:15.912 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.911+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~D4I79MZUCKMW.1 size=279360 2024-09-12T00:24:15.919 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.919+0000 7f0d199128c0 1 < completed multipart upload key=NXQYUQIR2APT upload=D4I79MZUCKMW tag=1JNDU9ECWPFA type=write size=2376512 2024-09-12T00:24:15.922 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.923+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=F03IUT6KNVY2 type=del size=3134360 2024-09-12T00:24:15.929 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.927+0000 7f0d199128c0 1 < suggested update operation key=OVLAP0OS78QG tag=03XP8HUNMSBE type=del size=3235014 2024-09-12T00:24:15.936 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.935+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~5G09BTOJCG0W.0 size=1048576 2024-09-12T00:24:15.939 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.939+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~5G09BTOJCG0W.1 size=284025 2024-09-12T00:24:15.939 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.939+0000 7f0d199128c0 1 > prepared multipart upload key=WBGXMJB7U422 upload=5G09BTOJCG0W tag=RMH2OAPVTMQ6 type=write size=2381177 2024-09-12T00:24:15.943 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.943+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~TNF482FR7SLW.0 size=1048576 2024-09-12T00:24:15.946 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.947+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~TNF482FR7SLW.1 size=373423 2024-09-12T00:24:15.953 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.951+0000 7f0d199128c0 1 < completed multipart upload key=ZWGD87Z1MMNK upload=TNF482FR7SLW tag=Q6Q3YPT172DT type=write size=2470575 2024-09-12T00:24:15.960 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.959+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~GDVGIGYBFB53.0 size=100178 2024-09-12T00:24:15.960 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.959+0000 7f0d199128c0 1 > prepared multipart upload key=A529WOKFD1NI upload=GDVGIGYBFB53 tag=1UG7BCHLA8WX type=write size=1148754 2024-09-12T00:24:15.964 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.963+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~F733R10OA1GC.0 size=1048576 2024-09-12T00:24:15.967 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.967+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~F733R10OA1GC.1 size=1048576 2024-09-12T00:24:15.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.971+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~F733R10OA1GC.2 size=1933 2024-09-12T00:24:15.976 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.975+0000 7f0d199128c0 1 < completed multipart upload key=37WTPAJGOX5L upload=F733R10OA1GC tag=PSEPY1IOU47Y type=write size=3147661 2024-09-12T00:24:15.980 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.979+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=8ZM96U5Z12RZ type=del size=881717 2024-09-12T00:24:15.986 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.987+0000 7f0d199128c0 1 < suggested remove operation key=SITJU2EUVSR8 tag=WNWX87WEH83P type=del 2024-09-12T00:24:15.993 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.991+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~WS9GLTEVWXA3.0 size=1048576 2024-09-12T00:24:15.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.995+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~WS9GLTEVWXA3.1 size=1048576 2024-09-12T00:24:15.998 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.999+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~WS9GLTEVWXA3.2 size=209666 2024-09-12T00:24:15.998 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:15.999+0000 7f0d199128c0 1 > prepared multipart upload key=YTXW98O07966 upload=WS9GLTEVWXA3 tag=92M1HOYTYB08 type=write size=3355394 2024-09-12T00:24:16.004 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.003+0000 7f0d199128c0 1 < suggested update operation key=JA6CSJF78VE2 tag=6K139ZUEQ8T5 type=del size=3678629 2024-09-12T00:24:16.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.011+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~J4F1X1KSHXYD.0 size=1048576 2024-09-12T00:24:16.013 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.011+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~J4F1X1KSHXYD.1 size=1048576 2024-09-12T00:24:16.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.015+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~J4F1X1KSHXYD.2 size=198984 2024-09-12T00:24:16.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.015+0000 7f0d199128c0 1 > prepared multipart upload key=PK2CA62QBZXS upload=J4F1X1KSHXYD tag=YI4R392A2YH6 type=write size=3344712 2024-09-12T00:24:16.019 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.019+0000 7f0d199128c0 1 < completed delete operation key=GH0FNY2AI00G tag=3GZ1Y4QE87ZW type=del 2024-09-12T00:24:16.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.023+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=OJ5329MMI9SB type=del size=183415 2024-09-12T00:24:16.026 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.027+0000 7f0d199128c0 1 < completed delete operation key=H604SA6XTFLY tag=0DUH3QKEIRDT type=del 2024-09-12T00:24:16.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.031+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=NOZENJY24EZO type=del size=4130534 2024-09-12T00:24:16.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.035+0000 7f0d199128c0 1 < suggested update operation key=WBGXMJB7U422 tag=FTHDT9URNYDZ type=del size=4134336 2024-09-12T00:24:16.040 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.039+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=OD453X985QJ9 type=del size=1396597 2024-09-12T00:24:16.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.043+0000 7f0d199128c0 1 < completed delete operation key=YTXW98O07966 tag=SI8ZRZ1ANCK5 type=del 2024-09-12T00:24:16.051 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.051+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~0KZJN57OQJDU.0 size=1048576 2024-09-12T00:24:16.053 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.055+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~0KZJN57OQJDU.1 size=274432 2024-09-12T00:24:16.053 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.055+0000 7f0d199128c0 1 > prepared multipart upload key=OVLAP0OS78QG upload=0KZJN57OQJDU tag=L1LEEG0CVERX type=write size=2371584 2024-09-12T00:24:16.057 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.055+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~5A3XIXU9LNSN.0 size=1048576 2024-09-12T00:24:16.060 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.059+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~5A3XIXU9LNSN.1 size=53489 2024-09-12T00:24:16.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.067+0000 7f0d199128c0 1 < completed multipart upload key=NXQYUQIR2APT upload=5A3XIXU9LNSN tag=7OZYFMP77UNG type=write size=2150641 2024-09-12T00:24:16.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.071+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~2W5CMK95KEU2.0 size=1048576 2024-09-12T00:24:16.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.075+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~2W5CMK95KEU2.1 size=1048576 2024-09-12T00:24:16.077 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.075+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~2W5CMK95KEU2.2 size=756315 2024-09-12T00:24:16.077 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.075+0000 7f0d199128c0 1 > prepared multipart upload key=A529WOKFD1NI upload=2W5CMK95KEU2 tag=ZVY1KYW77UDG type=write size=3902043 2024-09-12T00:24:16.082 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.079+0000 7f0d199128c0 1 < completed delete operation key=37WTPAJGOX5L tag=LMRW3DONSRB3 type=del 2024-09-12T00:24:16.084 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.083+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=5L8JI1WGFKJV type=write size=793655 2024-09-12T00:24:16.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.083+0000 7f0d199128c0 1 < canceled part key=_multipart_HXNC728XIWC1.2~LAM1VLC54LBA.0 size=1048576 2024-09-12T00:24:16.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.087+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~LAM1VLC54LBA.1 size=309272 2024-09-12T00:24:16.094 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.095+0000 7f0d199128c0 1 < canceled multipart upload key=HXNC728XIWC1 upload=LAM1VLC54LBA tag=VOHB7KIDFCQJ type=write size=2406424 2024-09-12T00:24:16.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.099+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~CQ0PXG7PQCNX.0 size=1048576 2024-09-12T00:24:16.102 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.103+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~CQ0PXG7PQCNX.1 size=482180 2024-09-12T00:24:16.103 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.103+0000 7f0d199128c0 1 > prepared multipart upload key=10YEWZDTTEV0 upload=CQ0PXG7PQCNX tag=05HMIIZ1OYIP type=write size=2579332 2024-09-12T00:24:16.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.107+0000 7f0d199128c0 -1 < failed to complete operation key=SITJU2EUVSR8 tag=X31EBP6STJP4 type=del size=2433485: (22) Invalid argument 2024-09-12T00:24:16.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.111+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=B9ZKRT8SDAL3 type=del size=3106994 2024-09-12T00:24:16.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.115+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~YEYNTW31P6EX.0 size=1048576 2024-09-12T00:24:16.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.115+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~YEYNTW31P6EX.1 size=61176 2024-09-12T00:24:16.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.123+0000 7f0d199128c0 1 < completed multipart upload key=37WTPAJGOX5L upload=YEYNTW31P6EX tag=33JFNEIAZQF0 type=write size=2158328 2024-09-12T00:24:16.125 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.123+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=RPJNVJV6QMAN type=del size=735622 2024-09-12T00:24:16.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.127+0000 7f0d199128c0 1 < completed delete operation key=T6GOR4SBYU2Y tag=5GW1WL5LST99 type=del 2024-09-12T00:24:16.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.131+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=KTRQP7NM1OFK type=del size=619423 2024-09-12T00:24:16.139 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.139+0000 7f0d199128c0 1 < suggested remove operation key=T6GOR4SBYU2Y tag=F03IUT6KNVY2 type=del 2024-09-12T00:24:16.143 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.143+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=SUKSEVQ2YUZ1 type=del size=3726880 2024-09-12T00:24:16.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.147+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~5G09BTOJCG0W.0 size=1048576 2024-09-12T00:24:16.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.147+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~5G09BTOJCG0W.1 size=284025 2024-09-12T00:24:16.154 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.155+0000 7f0d199128c0 1 < completed multipart upload key=WBGXMJB7U422 upload=5G09BTOJCG0W tag=RMH2OAPVTMQ6 type=write size=2381177 2024-09-12T00:24:16.157 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.155+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=88B4RAJ60H12 type=del size=197013 2024-09-12T00:24:16.160 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.159+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~GDVGIGYBFB53.0 size=100178 2024-09-12T00:24:16.165 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.167+0000 7f0d199128c0 1 < completed multipart upload key=A529WOKFD1NI upload=GDVGIGYBFB53 tag=1UG7BCHLA8WX type=write size=1148754 2024-09-12T00:24:16.169 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.167+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=VAA579WDQ226 type=del size=2700941 2024-09-12T00:24:16.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.171+0000 7f0d199128c0 -1 < failed to complete operation key=WBGXMJB7U422 tag=8ZM96U5Z12RZ type=del size=881717: (22) Invalid argument 2024-09-12T00:24:16.176 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.175+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=WWXEH86CX5Q2 type=del size=3623784 2024-09-12T00:24:16.179 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.179+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~WS9GLTEVWXA3.0 size=1048576 2024-09-12T00:24:16.182 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.183+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~WS9GLTEVWXA3.1 size=1048576 2024-09-12T00:24:16.185 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.183+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~WS9GLTEVWXA3.2 size=209666 2024-09-12T00:24:16.190 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.191+0000 7f0d199128c0 1 < completed multipart upload key=YTXW98O07966 upload=WS9GLTEVWXA3 tag=92M1HOYTYB08 type=write size=3355394 2024-09-12T00:24:16.196 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.195+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~1OU1456UQASH.0 size=1048576 2024-09-12T00:24:16.199 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.199+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~1OU1456UQASH.1 size=907256 2024-09-12T00:24:16.199 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.199+0000 7f0d199128c0 1 > prepared multipart upload key=9I6MZAEUS4I0 upload=1OU1456UQASH tag=WD5ARF3525K5 type=write size=3004408 2024-09-12T00:24:16.202 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.203+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~J4F1X1KSHXYD.0 size=1048576 2024-09-12T00:24:16.205 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.207+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~J4F1X1KSHXYD.1 size=1048576 2024-09-12T00:24:16.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.211+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~J4F1X1KSHXYD.2 size=198984 2024-09-12T00:24:16.216 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.215+0000 7f0d199128c0 1 < completed multipart upload key=PK2CA62QBZXS upload=J4F1X1KSHXYD tag=YI4R392A2YH6 type=write size=3344712 2024-09-12T00:24:16.221 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.219+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~FWY30HA7W724.0 size=1048576 2024-09-12T00:24:16.223 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.223+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~FWY30HA7W724.1 size=706963 2024-09-12T00:24:16.224 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.223+0000 7f0d199128c0 1 > prepared multipart upload key=0EBWUENN0881 upload=FWY30HA7W724 tag=5DA3KUK0A17F type=write size=2804115 2024-09-12T00:24:16.227 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.227+0000 7f0d199128c0 1 < completed delete operation key=IPJEXRBN96NB tag=OJ5329MMI9SB type=del 2024-09-12T00:24:16.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.231+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=HEV4A43GEL43 type=del size=3178555 2024-09-12T00:24:16.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.231+0000 7f0d199128c0 1 < completed delete operation key=0EBWUENN0881 tag=NOZENJY24EZO type=del 2024-09-12T00:24:16.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.235+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=NU3Y3O7T1A6C type=write size=799248 2024-09-12T00:24:16.240 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.239+0000 7f0d199128c0 1 < completed delete operation key=2EK9CCKG26W2 tag=OD453X985QJ9 type=del 2024-09-12T00:24:16.245 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.247+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~LA43CLXGTVC1.0 size=1048576 2024-09-12T00:24:16.248 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.247+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~LA43CLXGTVC1.1 size=1048576 2024-09-12T00:24:16.250 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.251+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~LA43CLXGTVC1.2 size=931782 2024-09-12T00:24:16.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.251+0000 7f0d199128c0 1 > prepared multipart upload key=9I6MZAEUS4I0 upload=LA43CLXGTVC1 tag=L4PZ6015IRNF type=write size=4077510 2024-09-12T00:24:16.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.251+0000 7f0d199128c0 1 < canceled part key=_multipart_OVLAP0OS78QG.2~0KZJN57OQJDU.0 size=1048576 2024-09-12T00:24:16.254 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.255+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~0KZJN57OQJDU.1 size=274432 2024-09-12T00:24:16.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.259+0000 7f0d199128c0 1 < canceled multipart upload key=OVLAP0OS78QG upload=0KZJN57OQJDU tag=L1LEEG0CVERX type=write size=2371584 2024-09-12T00:24:16.262 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.263+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=JLBXQ3LWWCAP type=del size=801051 2024-09-12T00:24:16.266 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.267+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~2W5CMK95KEU2.0 size=1048576 2024-09-12T00:24:16.269 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.267+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~2W5CMK95KEU2.1 size=1048576 2024-09-12T00:24:16.272 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.271+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~2W5CMK95KEU2.2 size=756315 2024-09-12T00:24:16.278 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.279+0000 7f0d199128c0 1 < completed multipart upload key=A529WOKFD1NI upload=2W5CMK95KEU2 tag=ZVY1KYW77UDG type=write size=3902043 2024-09-12T00:24:16.281 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.283+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=UIH8ZYL0MX51 type=write size=353361 2024-09-12T00:24:16.289 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.287+0000 7f0d199128c0 1 < suggested update operation key=QUO5ND3O41TY tag=5L8JI1WGFKJV type=write size=793655 2024-09-12T00:24:16.292 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.291+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=X5WVPPPPU0GW type=del size=458573 2024-09-12T00:24:16.296 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.295+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~CQ0PXG7PQCNX.0 size=1048576 2024-09-12T00:24:16.299 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.299+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~CQ0PXG7PQCNX.1 size=482180 2024-09-12T00:24:16.304 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.303+0000 7f0d199128c0 1 < completed multipart upload key=10YEWZDTTEV0 upload=CQ0PXG7PQCNX tag=05HMIIZ1OYIP type=write size=2579332 2024-09-12T00:24:16.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.307+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=OXB006ESM6NI type=del size=2611931 2024-09-12T00:24:16.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.311+0000 7f0d199128c0 1 < completed delete operation key=JA6CSJF78VE2 tag=B9ZKRT8SDAL3 type=del 2024-09-12T00:24:16.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.319+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~DBJFV6S50EO1.0 size=237814 2024-09-12T00:24:16.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.319+0000 7f0d199128c0 1 > prepared multipart upload key=FJ8YV026H0ZU upload=DBJFV6S50EO1 tag=EEH05B9QHEO4 type=write size=1286390 2024-09-12T00:24:16.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.323+0000 7f0d199128c0 1 < completed delete operation key=9I6MZAEUS4I0 tag=RPJNVJV6QMAN type=del 2024-09-12T00:24:16.325 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.323+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=6JOIGHGWDKN7 type=del size=1828116 2024-09-12T00:24:16.331 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.331+0000 7f0d199128c0 1 < suggested update operation key=WPZOKZDFXK4S tag=KTRQP7NM1OFK type=del size=619423 2024-09-12T00:24:16.338 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.339+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~7ODPLGVMC6F9.0 size=1048576 2024-09-12T00:24:16.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.339+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~7ODPLGVMC6F9.1 size=1048576 2024-09-12T00:24:16.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.343+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~7ODPLGVMC6F9.2 size=1024911 2024-09-12T00:24:16.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.343+0000 7f0d199128c0 1 > prepared multipart upload key=WBGXMJB7U422 upload=7ODPLGVMC6F9 tag=DNJRCC5NI1DZ type=write size=4170639 2024-09-12T00:24:16.347 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.347+0000 7f0d199128c0 1 < completed delete operation key=RX3RVT06SGJ4 tag=SUKSEVQ2YUZ1 type=del 2024-09-12T00:24:16.351 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.351+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=80OA5FINWI8W type=del size=175 2024-09-12T00:24:16.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.355+0000 7f0d199128c0 1 < completed delete operation key=37WTPAJGOX5L tag=88B4RAJ60H12 type=del 2024-09-12T00:24:16.358 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.359+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=VHDA0W5QJBSB type=del size=1598138 2024-09-12T00:24:16.361 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.359+0000 7f0d199128c0 -1 < failed to complete operation key=QUO5ND3O41TY tag=VAA579WDQ226 type=del size=2700941: (22) Invalid argument 2024-09-12T00:24:16.365 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.363+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=WU6NVBYEP9BX type=del size=1692255 2024-09-12T00:24:16.369 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.367+0000 7f0d199128c0 -1 < failed to complete operation key=QUO5ND3O41TY tag=WWXEH86CX5Q2 type=del size=3623784: (22) Invalid argument 2024-09-12T00:24:16.372 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.371+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=XUJRPLPRKTVU type=del size=587171 2024-09-12T00:24:16.376 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.375+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~1OU1456UQASH.0 size=1048576 2024-09-12T00:24:16.378 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.379+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~1OU1456UQASH.1 size=907256 2024-09-12T00:24:16.384 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.383+0000 7f0d199128c0 1 < completed multipart upload key=9I6MZAEUS4I0 upload=1OU1456UQASH tag=WD5ARF3525K5 type=write size=3004408 2024-09-12T00:24:16.388 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.387+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=3FEBR599G250 type=del size=1266124 2024-09-12T00:24:16.391 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.391+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~FWY30HA7W724.0 size=1048576 2024-09-12T00:24:16.391 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.391+0000 7f0d199128c0 1 < canceled part key=_multipart_0EBWUENN0881.2~FWY30HA7W724.1 size=706963 2024-09-12T00:24:16.397 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.395+0000 7f0d199128c0 1 < canceled multipart upload key=0EBWUENN0881 upload=FWY30HA7W724 tag=5DA3KUK0A17F type=write size=2804115 2024-09-12T00:24:16.400 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.399+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=M22SXVVN7LK7 type=del size=2676967 2024-09-12T00:24:16.404 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.403+0000 7f0d199128c0 1 < completed delete operation key=H604SA6XTFLY tag=HEV4A43GEL43 type=del 2024-09-12T00:24:16.408 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.407+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=9WSYICQHGACC type=write size=821190 2024-09-12T00:24:16.414 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.415+0000 7f0d199128c0 1 < suggested update operation key=FJ8YV026H0ZU tag=NU3Y3O7T1A6C type=write size=799248 2024-09-12T00:24:16.420 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.419+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=PGHHQEU5NNQW type=del size=3261117 2024-09-12T00:24:16.422 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.423+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~LA43CLXGTVC1.0 size=1048576 2024-09-12T00:24:16.424 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.423+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~LA43CLXGTVC1.1 size=1048576 2024-09-12T00:24:16.427 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.427+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~LA43CLXGTVC1.2 size=931782 2024-09-12T00:24:16.433 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.431+0000 7f0d199128c0 1 < completed multipart upload key=9I6MZAEUS4I0 upload=LA43CLXGTVC1 tag=L4PZ6015IRNF type=write size=4077510 2024-09-12T00:24:16.437 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.435+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=YJ18YB1A27EA type=del size=3719337 2024-09-12T00:24:16.440 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.439+0000 7f0d199128c0 1 < completed delete operation key=PK2CA62QBZXS tag=JLBXQ3LWWCAP type=del 2024-09-12T00:24:16.444 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.443+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=WTHDYU0DML1O type=del size=1983467 2024-09-12T00:24:16.447 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.447+0000 7f0d199128c0 1 < completed write operation key=HXNC728XIWC1 tag=UIH8ZYL0MX51 type=write size=353361 2024-09-12T00:24:16.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.455+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~QQD2PU1NJP66.0 size=1048576 2024-09-12T00:24:16.456 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.455+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~QQD2PU1NJP66.1 size=736760 2024-09-12T00:24:16.456 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.455+0000 7f0d199128c0 1 > prepared multipart upload key=J75P0821XGRO upload=QQD2PU1NJP66 tag=WXBNQ793LZQW type=write size=2833912 2024-09-12T00:24:16.460 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.459+0000 7f0d199128c0 1 < completed delete operation key=4K654PSDLDVI tag=X5WVPPPPU0GW type=del 2024-09-12T00:24:16.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.467+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~8HFNT9UZ7C4X.0 size=425762 2024-09-12T00:24:16.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.467+0000 7f0d199128c0 1 > prepared multipart upload key=HXNC728XIWC1 upload=8HFNT9UZ7C4X tag=3K4HHZYJSPCC type=write size=1474338 2024-09-12T00:24:16.472 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.471+0000 7f0d199128c0 1 < suggested remove operation key=JA6CSJF78VE2 tag=OXB006ESM6NI type=del 2024-09-12T00:24:16.478 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.479+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~V82RECFH40VA.0 size=13259 2024-09-12T00:24:16.478 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.479+0000 7f0d199128c0 1 > prepared multipart upload key=4K654PSDLDVI upload=V82RECFH40VA tag=LHMXYV9TD3A8 type=write size=1061835 2024-09-12T00:24:16.481 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.483+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~DBJFV6S50EO1.0 size=237814 2024-09-12T00:24:16.487 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.487+0000 7f0d199128c0 1 < completed multipart upload key=FJ8YV026H0ZU upload=DBJFV6S50EO1 tag=EEH05B9QHEO4 type=write size=1286390 2024-09-12T00:24:16.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.491+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~ZACG7BK2WN76.0 size=1048576 2024-09-12T00:24:16.495 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.495+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~ZACG7BK2WN76.1 size=1048576 2024-09-12T00:24:16.498 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.499+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~ZACG7BK2WN76.2 size=997157 2024-09-12T00:24:16.498 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.499+0000 7f0d199128c0 1 > prepared multipart upload key=1Y6B1MJP5G4L upload=ZACG7BK2WN76 tag=JZDWO8FSOOG9 type=write size=4142885 2024-09-12T00:24:16.501 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.503+0000 7f0d199128c0 1 < completed delete operation key=2EK9CCKG26W2 tag=6JOIGHGWDKN7 type=del 2024-09-12T00:24:16.508 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.507+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~F7H40OIMN5NN.0 size=1048576 2024-09-12T00:24:16.511 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.511+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~F7H40OIMN5NN.1 size=1048576 2024-09-12T00:24:16.513 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.511+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~F7H40OIMN5NN.2 size=232907 2024-09-12T00:24:16.513 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.511+0000 7f0d199128c0 1 > prepared multipart upload key=B58RWC9W8THG upload=F7H40OIMN5NN tag=HMG8RKIAFLHD type=write size=3378635 2024-09-12T00:24:16.514 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.515+0000 7f0d199128c0 1 < canceled part key=_multipart_WBGXMJB7U422.2~7ODPLGVMC6F9.0 size=1048576 2024-09-12T00:24:16.517 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.515+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~7ODPLGVMC6F9.1 size=1048576 2024-09-12T00:24:16.519 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.519+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~7ODPLGVMC6F9.2 size=1024911 2024-09-12T00:24:16.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.527+0000 7f0d199128c0 1 < canceled multipart upload key=WBGXMJB7U422 upload=7ODPLGVMC6F9 tag=DNJRCC5NI1DZ type=write size=4170639 2024-09-12T00:24:16.532 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.531+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~5V8WJDJAPJUN.0 size=1048576 2024-09-12T00:24:16.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.535+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~5V8WJDJAPJUN.1 size=1048576 2024-09-12T00:24:16.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.539+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~5V8WJDJAPJUN.2 size=488040 2024-09-12T00:24:16.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.539+0000 7f0d199128c0 1 > prepared multipart upload key=1Y6B1MJP5G4L upload=5V8WJDJAPJUN tag=W7THMCXA8CJ0 type=write size=3633768 2024-09-12T00:24:16.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.539+0000 7f0d199128c0 1 < completed delete operation key=HXNC728XIWC1 tag=80OA5FINWI8W type=del 2024-09-12T00:24:16.544 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.543+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=4CXHH4AFSHA5 type=del size=1193562 2024-09-12T00:24:16.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.547+0000 7f0d199128c0 1 < completed delete operation key=V6H6S9X0U2A0 tag=VHDA0W5QJBSB type=del 2024-09-12T00:24:16.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.551+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=14GT9LEEYND1 type=write size=183495 2024-09-12T00:24:16.554 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.555+0000 7f0d199128c0 1 < completed delete operation key=NXQYUQIR2APT tag=WU6NVBYEP9BX type=del 2024-09-12T00:24:16.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.559+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=OZUFOVVVDWII type=del size=3439419 2024-09-12T00:24:16.566 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.567+0000 7f0d199128c0 1 < suggested update operation key=0EBWUENN0881 tag=XUJRPLPRKTVU type=del size=587171 2024-09-12T00:24:16.572 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.571+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~WNCQ9AOSLGBC.0 size=492721 2024-09-12T00:24:16.572 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.571+0000 7f0d199128c0 1 > prepared multipart upload key=VXZI0ZTMQSV0 upload=WNCQ9AOSLGBC tag=4EMK87P2KXU8 type=write size=1541297 2024-09-12T00:24:16.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.575+0000 7f0d199128c0 1 < canceled operation key=YTXW98O07966 tag=3FEBR599G250 type=del size=1266124 2024-09-12T00:24:16.579 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.579+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=FXXO3NE29G68 type=del size=1712620 2024-09-12T00:24:16.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.583+0000 7f0d199128c0 1 < suggested remove operation key=T6GOR4SBYU2Y tag=M22SXVVN7LK7 type=del 2024-09-12T00:24:16.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.587+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=14VM1FZ5FJWA type=del size=257377 2024-09-12T00:24:16.592 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.591+0000 7f0d199128c0 1 < completed write operation key=10YEWZDTTEV0 tag=9WSYICQHGACC type=write size=821190 2024-09-12T00:24:16.595 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.595+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=I9YHW23TDFN9 type=del size=3742418 2024-09-12T00:24:16.599 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.599+0000 7f0d199128c0 1 < completed delete operation key=OVLAP0OS78QG tag=PGHHQEU5NNQW type=del 2024-09-12T00:24:16.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.603+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=CW71IMBGVCQB type=write size=69907 2024-09-12T00:24:16.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.607+0000 7f0d199128c0 1 < completed delete operation key=B58RWC9W8THG tag=YJ18YB1A27EA type=del 2024-09-12T00:24:16.609 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.607+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=MM2MQLZE14YB type=del size=2050106 2024-09-12T00:24:16.613 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.611+0000 7f0d199128c0 1 < completed delete operation key=9I6MZAEUS4I0 tag=WTHDYU0DML1O type=del 2024-09-12T00:24:16.616 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.615+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=0I5QDLMQVU2S type=del size=2300301 2024-09-12T00:24:16.619 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.619+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~QQD2PU1NJP66.0 size=1048576 2024-09-12T00:24:16.622 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.623+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~QQD2PU1NJP66.1 size=736760 2024-09-12T00:24:16.628 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.627+0000 7f0d199128c0 1 < completed multipart upload key=J75P0821XGRO upload=QQD2PU1NJP66 tag=WXBNQ793LZQW type=write size=2833912 2024-09-12T00:24:16.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.635+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~8M5B3MBVPUEA.0 size=490809 2024-09-12T00:24:16.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.635+0000 7f0d199128c0 1 > prepared multipart upload key=JA6CSJF78VE2 upload=8M5B3MBVPUEA tag=V9FHIPF3PMWQ type=write size=1539385 2024-09-12T00:24:16.638 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.639+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~8HFNT9UZ7C4X.0 size=425762 2024-09-12T00:24:16.644 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.643+0000 7f0d199128c0 1 < completed multipart upload key=HXNC728XIWC1 upload=8HFNT9UZ7C4X tag=3K4HHZYJSPCC type=write size=1474338 2024-09-12T00:24:16.648 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.647+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=8D9IQU0J7O6B type=del size=4088756 2024-09-12T00:24:16.649 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.647+0000 7f0d199128c0 1 < canceled part key=_multipart_4K654PSDLDVI.2~V82RECFH40VA.0 size=13259 2024-09-12T00:24:16.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.655+0000 7f0d199128c0 1 < canceled multipart upload key=4K654PSDLDVI upload=V82RECFH40VA tag=LHMXYV9TD3A8 type=write size=1061835 2024-09-12T00:24:16.659 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.659+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=HM8C3ELNZFJ1 type=write size=55887 2024-09-12T00:24:16.662 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.663+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~ZACG7BK2WN76.0 size=1048576 2024-09-12T00:24:16.665 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.663+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~ZACG7BK2WN76.1 size=1048576 2024-09-12T00:24:16.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.667+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~ZACG7BK2WN76.2 size=997157 2024-09-12T00:24:16.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.675+0000 7f0d199128c0 1 < completed multipart upload key=1Y6B1MJP5G4L upload=ZACG7BK2WN76 tag=JZDWO8FSOOG9 type=write size=4142885 2024-09-12T00:24:16.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.675+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=JHOOB8I0JBOO type=del size=117304 2024-09-12T00:24:16.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.679+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~F7H40OIMN5NN.0 size=1048576 2024-09-12T00:24:16.684 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.683+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~F7H40OIMN5NN.1 size=1048576 2024-09-12T00:24:16.688 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.687+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~F7H40OIMN5NN.2 size=232907 2024-09-12T00:24:16.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.695+0000 7f0d199128c0 1 < completed multipart upload key=B58RWC9W8THG upload=F7H40OIMN5NN tag=HMG8RKIAFLHD type=write size=3378635 2024-09-12T00:24:16.698 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.699+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=H6XF9XAOMN91 type=del size=1759225 2024-09-12T00:24:16.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.699+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~5V8WJDJAPJUN.0 size=1048576 2024-09-12T00:24:16.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.703+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~5V8WJDJAPJUN.1 size=1048576 2024-09-12T00:24:16.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.703+0000 7f0d199128c0 1 < canceled part key=_multipart_1Y6B1MJP5G4L.2~5V8WJDJAPJUN.2 size=488040 2024-09-12T00:24:16.710 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.711+0000 7f0d199128c0 1 < canceled multipart upload key=1Y6B1MJP5G4L upload=5V8WJDJAPJUN tag=W7THMCXA8CJ0 type=write size=3633768 2024-09-12T00:24:16.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.715+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~GLPDCKWP8MAP.0 size=929950 2024-09-12T00:24:16.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.715+0000 7f0d199128c0 1 > prepared multipart upload key=RX3RVT06SGJ4 upload=GLPDCKWP8MAP tag=QAZ4NEH2MIV5 type=write size=1978526 2024-09-12T00:24:16.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.719+0000 7f0d199128c0 1 < completed delete operation key=A529WOKFD1NI tag=4CXHH4AFSHA5 type=del 2024-09-12T00:24:16.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.723+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=XMDU4MLW2JEQ type=del size=2472609 2024-09-12T00:24:16.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.727+0000 7f0d199128c0 1 < completed write operation key=A529WOKFD1NI tag=14GT9LEEYND1 type=write size=183495 2024-09-12T00:24:16.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.727+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=DLO5SV8FVERL type=del size=1564883 2024-09-12T00:24:16.732 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.731+0000 7f0d199128c0 1 < completed delete operation key=4K654PSDLDVI tag=OZUFOVVVDWII type=del 2024-09-12T00:24:16.735 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.735+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=GD87KSA0KS8S type=del size=3550928 2024-09-12T00:24:16.738 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.739+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~WNCQ9AOSLGBC.0 size=492721 2024-09-12T00:24:16.743 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.743+0000 7f0d199128c0 1 < completed multipart upload key=VXZI0ZTMQSV0 upload=WNCQ9AOSLGBC tag=4EMK87P2KXU8 type=write size=1541297 2024-09-12T00:24:16.748 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.747+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~CEP529QYOB7D.0 size=1048576 2024-09-12T00:24:16.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.751+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~CEP529QYOB7D.1 size=178463 2024-09-12T00:24:16.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.751+0000 7f0d199128c0 1 > prepared multipart upload key=QUO5ND3O41TY upload=CEP529QYOB7D tag=MPVV1JEPBYH7 type=write size=2275615 2024-09-12T00:24:16.754 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.755+0000 7f0d199128c0 1 < completed delete operation key=V6H6S9X0U2A0 tag=FXXO3NE29G68 type=del 2024-09-12T00:24:16.757 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.755+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=QDDSMUSTUJ8H type=write size=555362 2024-09-12T00:24:16.760 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.759+0000 7f0d199128c0 1 < canceled operation key=WBGXMJB7U422 tag=14VM1FZ5FJWA type=del size=257377 2024-09-12T00:24:16.762 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.763+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=UOCNQSBF6KR4 type=del size=3463041 2024-09-12T00:24:16.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.767+0000 7f0d199128c0 1 < completed delete operation key=IPJEXRBN96NB tag=I9YHW23TDFN9 type=del 2024-09-12T00:24:16.770 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.771+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~08C5AB78TZWH.0 size=295198 2024-09-12T00:24:16.770 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.771+0000 7f0d199128c0 1 > prepared multipart upload key=FJ8YV026H0ZU upload=08C5AB78TZWH tag=YGZ9DMAQBD15 type=write size=1343774 2024-09-12T00:24:16.776 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.775+0000 7f0d199128c0 1 < suggested update operation key=A529WOKFD1NI tag=CW71IMBGVCQB type=write size=69907 2024-09-12T00:24:16.779 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.779+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=G98O86KWYYKH type=del size=659347 2024-09-12T00:24:16.781 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.783+0000 7f0d199128c0 1 < completed delete operation key=RFCHRGVA9GOI tag=MM2MQLZE14YB type=del 2024-09-12T00:24:16.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.787+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~YU3IR7CGF3CA.0 size=1048576 2024-09-12T00:24:16.788 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.787+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~YU3IR7CGF3CA.1 size=947108 2024-09-12T00:24:16.788 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.787+0000 7f0d199128c0 1 > prepared multipart upload key=GH0FNY2AI00G upload=YU3IR7CGF3CA tag=PKSPM21DZRUA type=write size=3044260 2024-09-12T00:24:16.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.791+0000 7f0d199128c0 1 < completed delete operation key=2EK9CCKG26W2 tag=0I5QDLMQVU2S type=del 2024-09-12T00:24:16.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.795+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=W4X2UR72I3QD type=del size=2656700 2024-09-12T00:24:16.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.795+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~8M5B3MBVPUEA.0 size=490809 2024-09-12T00:24:16.802 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.803+0000 7f0d199128c0 1 < completed multipart upload key=JA6CSJF78VE2 upload=8M5B3MBVPUEA tag=V9FHIPF3PMWQ type=write size=1539385 2024-09-12T00:24:16.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.807+0000 7f0d199128c0 1 > prepared operation key=57W1IO3KSWBR tag=TS87MRZQSY4D type=write size=561527 2024-09-12T00:24:16.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.807+0000 7f0d199128c0 1 < completed delete operation key=WPZOKZDFXK4S tag=8D9IQU0J7O6B type=del 2024-09-12T00:24:16.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.815+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~0A9ZBFAHRX3K.0 size=1048576 2024-09-12T00:24:16.817 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.815+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~0A9ZBFAHRX3K.1 size=1048576 2024-09-12T00:24:16.819 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.819+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~0A9ZBFAHRX3K.2 size=757328 2024-09-12T00:24:16.819 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.819+0000 7f0d199128c0 1 > prepared multipart upload key=JA6CSJF78VE2 upload=0A9ZBFAHRX3K tag=7PFKTRRWA740 type=write size=3903056 2024-09-12T00:24:16.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.823+0000 7f0d199128c0 1 < completed write operation key=1Y6B1MJP5G4L tag=HM8C3ELNZFJ1 type=write size=55887 2024-09-12T00:24:16.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.827+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=19FGF7FENPZH type=del size=3860871 2024-09-12T00:24:16.828 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.827+0000 7f0d199128c0 1 < completed delete operation key=HXNC728XIWC1 tag=JHOOB8I0JBOO type=del 2024-09-12T00:24:16.831 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.831+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=ODXYMAMQ9GNI type=write size=899236 2024-09-12T00:24:16.839 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.839+0000 7f0d199128c0 1 < suggested remove operation key=H604SA6XTFLY tag=H6XF9XAOMN91 type=del 2024-09-12T00:24:16.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.843+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~H63586N01Z8D.0 size=15756 2024-09-12T00:24:16.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.843+0000 7f0d199128c0 1 > prepared multipart upload key=B58RWC9W8THG upload=H63586N01Z8D tag=AOCQJZTNS2WY type=write size=1064332 2024-09-12T00:24:16.848 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.847+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~GLPDCKWP8MAP.0 size=929950 2024-09-12T00:24:16.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.851+0000 7f0d199128c0 1 < completed multipart upload key=RX3RVT06SGJ4 upload=GLPDCKWP8MAP tag=QAZ4NEH2MIV5 type=write size=1978526 2024-09-12T00:24:16.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.855+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=YZPVG4ITR03Y type=del size=23787 2024-09-12T00:24:16.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.863+0000 7f0d199128c0 1 < suggested update operation key=HXNC728XIWC1 tag=XMDU4MLW2JEQ type=del size=2472609 2024-09-12T00:24:16.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.871+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~G3UIPLL92C2P.0 size=1048576 2024-09-12T00:24:16.872 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.871+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~G3UIPLL92C2P.1 size=1048576 2024-09-12T00:24:16.875 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.875+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~G3UIPLL92C2P.2 size=459182 2024-09-12T00:24:16.875 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.875+0000 7f0d199128c0 1 > prepared multipart upload key=B58RWC9W8THG upload=G3UIPLL92C2P tag=BPV54BQTX6DX type=write size=3604910 2024-09-12T00:24:16.878 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.879+0000 7f0d199128c0 1 < canceled operation key=0EBWUENN0881 tag=DLO5SV8FVERL type=del size=1564883 2024-09-12T00:24:16.881 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.879+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=S34FVC6NWVHM type=write size=289631 2024-09-12T00:24:16.884 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.883+0000 7f0d199128c0 -1 < failed to complete operation key=A529WOKFD1NI tag=GD87KSA0KS8S type=del size=3550928: (22) Invalid argument 2024-09-12T00:24:16.889 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.887+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~3BUA8PK5Z3X3.0 size=287235 2024-09-12T00:24:16.889 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.887+0000 7f0d199128c0 1 > prepared multipart upload key=0ZT4NZYZKI5Z upload=3BUA8PK5Z3X3 tag=U7COBILBD1XD type=write size=1335811 2024-09-12T00:24:16.891 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.891+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~CEP529QYOB7D.0 size=1048576 2024-09-12T00:24:16.892 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.891+0000 7f0d199128c0 1 < canceled part key=_multipart_QUO5ND3O41TY.2~CEP529QYOB7D.1 size=178463 2024-09-12T00:24:16.896 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.895+0000 7f0d199128c0 1 < canceled multipart upload key=QUO5ND3O41TY upload=CEP529QYOB7D tag=MPVV1JEPBYH7 type=write size=2275615 2024-09-12T00:24:16.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.899+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=WJG41AQXCBPN type=del size=336704 2024-09-12T00:24:16.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.899+0000 7f0d199128c0 1 < completed write operation key=10YEWZDTTEV0 tag=QDDSMUSTUJ8H type=write size=555362 2024-09-12T00:24:16.906 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.907+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~GHY8E3178LWD.0 size=1048576 2024-09-12T00:24:16.908 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.907+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~GHY8E3178LWD.1 size=235247 2024-09-12T00:24:16.908 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.907+0000 7f0d199128c0 1 > prepared multipart upload key=QUO5ND3O41TY upload=GHY8E3178LWD tag=N1CZFG5K361R type=write size=2332399 2024-09-12T00:24:16.912 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.911+0000 7f0d199128c0 1 < completed delete operation key=OVLAP0OS78QG tag=UOCNQSBF6KR4 type=del 2024-09-12T00:24:16.914 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.915+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=NAG1A9DLOU52 type=del size=1043614 2024-09-12T00:24:16.917 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.915+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~08C5AB78TZWH.0 size=295198 2024-09-12T00:24:16.921 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.923+0000 7f0d199128c0 1 < completed multipart upload key=FJ8YV026H0ZU upload=08C5AB78TZWH tag=YGZ9DMAQBD15 type=write size=1343774 2024-09-12T00:24:16.924 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.923+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=3031C92S0434 type=del size=2111470 2024-09-12T00:24:16.929 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.927+0000 7f0d199128c0 1 < completed delete operation key=2EK9CCKG26W2 tag=G98O86KWYYKH type=del 2024-09-12T00:24:16.930 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.931+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=G9GFRX25BYV0 type=del size=813910 2024-09-12T00:24:16.931 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.931+0000 7f0d199128c0 1 < canceled part key=_multipart_GH0FNY2AI00G.2~YU3IR7CGF3CA.0 size=1048576 2024-09-12T00:24:16.931 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.931+0000 7f0d199128c0 1 < canceled part key=_multipart_GH0FNY2AI00G.2~YU3IR7CGF3CA.1 size=947108 2024-09-12T00:24:16.935 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.935+0000 7f0d199128c0 1 < canceled multipart upload key=GH0FNY2AI00G upload=YU3IR7CGF3CA tag=PKSPM21DZRUA type=write size=3044260 2024-09-12T00:24:16.938 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.939+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=K829HLXQRMGS type=del size=572635 2024-09-12T00:24:16.943 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.943+0000 7f0d199128c0 1 < suggested update operation key=WPZOKZDFXK4S tag=W4X2UR72I3QD type=del size=2656700 2024-09-12T00:24:16.946 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.947+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=R1F93BAD17JO type=write size=835141 2024-09-12T00:24:16.949 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.947+0000 7f0d199128c0 1 < completed write operation key=57W1IO3KSWBR tag=TS87MRZQSY4D type=write size=561527 2024-09-12T00:24:16.951 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.951+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=2N8XQH69DBB9 type=del size=1877237 2024-09-12T00:24:16.954 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.955+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~0A9ZBFAHRX3K.0 size=1048576 2024-09-12T00:24:16.956 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.955+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~0A9ZBFAHRX3K.1 size=1048576 2024-09-12T00:24:16.958 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.959+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~0A9ZBFAHRX3K.2 size=757328 2024-09-12T00:24:16.963 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.963+0000 7f0d199128c0 1 < completed multipart upload key=JA6CSJF78VE2 upload=0A9ZBFAHRX3K tag=7PFKTRRWA740 type=write size=3903056 2024-09-12T00:24:16.969 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.967+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~9B4D44A1V0VQ.0 size=1048576 2024-09-12T00:24:16.971 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.971+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~9B4D44A1V0VQ.1 size=1048576 2024-09-12T00:24:16.973 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.971+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~9B4D44A1V0VQ.2 size=530369 2024-09-12T00:24:16.973 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.971+0000 7f0d199128c0 1 > prepared multipart upload key=10YEWZDTTEV0 upload=9B4D44A1V0VQ tag=2JET7HBJFSP3 type=write size=3676097 2024-09-12T00:24:16.976 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.975+0000 7f0d199128c0 1 < completed delete operation key=ZWGD87Z1MMNK tag=19FGF7FENPZH type=del 2024-09-12T00:24:16.979 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.979+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=IQGV98G2A511 type=del size=691710 2024-09-12T00:24:16.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.983+0000 7f0d199128c0 1 < completed write operation key=PK2CA62QBZXS tag=ODXYMAMQ9GNI type=write size=899236 2024-09-12T00:24:16.985 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.983+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=A0U6KSUIH1LW type=write size=769768 2024-09-12T00:24:16.988 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.987+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~H63586N01Z8D.0 size=15756 2024-09-12T00:24:16.992 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.991+0000 7f0d199128c0 1 < completed multipart upload key=B58RWC9W8THG upload=H63586N01Z8D tag=AOCQJZTNS2WY type=write size=1064332 2024-09-12T00:24:16.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.995+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=ZRF8XW949NB7 type=del size=2771987 2024-09-12T00:24:16.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:16.999+0000 7f0d199128c0 1 < completed delete operation key=9I6MZAEUS4I0 tag=YZPVG4ITR03Y type=del 2024-09-12T00:24:17.002 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.003+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~PY42BAEJLGL5.0 size=1025522 2024-09-12T00:24:17.002 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.003+0000 7f0d199128c0 1 > prepared multipart upload key=J75P0821XGRO upload=PY42BAEJLGL5 tag=4TBWCL61O33S type=write size=2074098 2024-09-12T00:24:17.004 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.003+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~G3UIPLL92C2P.0 size=1048576 2024-09-12T00:24:17.006 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.007+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~G3UIPLL92C2P.1 size=1048576 2024-09-12T00:24:17.008 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.007+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~G3UIPLL92C2P.2 size=459182 2024-09-12T00:24:17.012 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.011+0000 7f0d199128c0 1 < completed multipart upload key=B58RWC9W8THG upload=G3UIPLL92C2P tag=BPV54BQTX6DX type=write size=3604910 2024-09-12T00:24:17.017 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.015+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~ZSFSEFUR8V09.0 size=1048576 2024-09-12T00:24:17.019 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.019+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~ZSFSEFUR8V09.1 size=49584 2024-09-12T00:24:17.019 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.019+0000 7f0d199128c0 1 > prepared multipart upload key=H604SA6XTFLY upload=ZSFSEFUR8V09 tag=YL3VKWO7HYH3 type=write size=2146736 2024-09-12T00:24:17.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.023+0000 7f0d199128c0 1 < completed write operation key=0ZT4NZYZKI5Z tag=S34FVC6NWVHM type=write size=289631 2024-09-12T00:24:17.024 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.023+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=W3CCH7YQY5TR type=del size=353884 2024-09-12T00:24:17.027 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.027+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~3BUA8PK5Z3X3.0 size=287235 2024-09-12T00:24:17.031 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.031+0000 7f0d199128c0 1 < completed multipart upload key=0ZT4NZYZKI5Z upload=3BUA8PK5Z3X3 tag=U7COBILBD1XD type=write size=1335811 2024-09-12T00:24:17.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.035+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~KZ6CL6V19VM8.0 size=289470 2024-09-12T00:24:17.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.035+0000 7f0d199128c0 1 > prepared multipart upload key=PK2CA62QBZXS upload=KZ6CL6V19VM8 tag=5LCU29QIYDWD type=write size=1338046 2024-09-12T00:24:17.041 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.043+0000 7f0d199128c0 1 < suggested remove operation key=10YEWZDTTEV0 tag=WJG41AQXCBPN type=del 2024-09-12T00:24:17.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.043+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=TL2NB7SQXM3T type=del size=2220084 2024-09-12T00:24:17.047 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.047+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~GHY8E3178LWD.0 size=1048576 2024-09-12T00:24:17.047 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.047+0000 7f0d199128c0 1 < canceled part key=_multipart_QUO5ND3O41TY.2~GHY8E3178LWD.1 size=235247 2024-09-12T00:24:17.051 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.051+0000 7f0d199128c0 1 < canceled multipart upload key=QUO5ND3O41TY upload=GHY8E3178LWD tag=N1CZFG5K361R type=write size=2332399 2024-09-12T00:24:17.055 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.055+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~0FW4EAZWJ5VB.0 size=1048576 2024-09-12T00:24:17.058 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.059+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~0FW4EAZWJ5VB.1 size=258844 2024-09-12T00:24:17.058 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.059+0000 7f0d199128c0 1 > prepared multipart upload key=57W1IO3KSWBR upload=0FW4EAZWJ5VB tag=Q9NN81Z9ZNVT type=write size=2355996 2024-09-12T00:24:17.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.063+0000 7f0d199128c0 1 < suggested remove operation key=WPZOKZDFXK4S tag=NAG1A9DLOU52 type=del 2024-09-12T00:24:17.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.067+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~THN6XGT051DV.0 size=242041 2024-09-12T00:24:17.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.067+0000 7f0d199128c0 1 > prepared multipart upload key=J75P0821XGRO upload=THN6XGT051DV tag=CL5C49MM2BFH type=write size=1290617 2024-09-12T00:24:17.071 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.071+0000 7f0d199128c0 1 < completed delete operation key=SITJU2EUVSR8 tag=3031C92S0434 type=del 2024-09-12T00:24:17.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.075+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=TGDC9IV9OG45 type=del size=2080824 2024-09-12T00:24:17.077 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.079+0000 7f0d199128c0 1 < completed delete operation key=WBGXMJB7U422 tag=G9GFRX25BYV0 type=del 2024-09-12T00:24:17.081 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.079+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=UZXGVSSBX10A type=write size=89541 2024-09-12T00:24:17.084 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.083+0000 7f0d199128c0 1 < canceled operation key=A529WOKFD1NI tag=K829HLXQRMGS type=del size=572635 2024-09-12T00:24:17.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.091+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~4EQLRSZEXAQA.0 size=1048576 2024-09-12T00:24:17.093 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.091+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~4EQLRSZEXAQA.1 size=1048576 2024-09-12T00:24:17.095 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.095+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~4EQLRSZEXAQA.2 size=891049 2024-09-12T00:24:17.095 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.095+0000 7f0d199128c0 1 > prepared multipart upload key=A529WOKFD1NI upload=4EQLRSZEXAQA tag=0A2GBFTTR4G5 type=write size=4036777 2024-09-12T00:24:17.105 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.103+0000 7f0d199128c0 1 < suggested update operation key=H604SA6XTFLY tag=R1F93BAD17JO type=write size=835141 2024-09-12T00:24:17.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.111+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~YM8TO2UMFC03.0 size=1048576 2024-09-12T00:24:17.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.111+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~YM8TO2UMFC03.1 size=275697 2024-09-12T00:24:17.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.111+0000 7f0d199128c0 1 > prepared multipart upload key=9I6MZAEUS4I0 upload=YM8TO2UMFC03 tag=IHD9FVW7UV9N type=write size=2372849 2024-09-12T00:24:17.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.115+0000 7f0d199128c0 1 < completed delete operation key=0EBWUENN0881 tag=2N8XQH69DBB9 type=del 2024-09-12T00:24:17.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.123+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~DJRZWM2DXWSV.0 size=1048576 2024-09-12T00:24:17.125 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.123+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~DJRZWM2DXWSV.1 size=1010308 2024-09-12T00:24:17.125 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.123+0000 7f0d199128c0 1 > prepared multipart upload key=T6GOR4SBYU2Y upload=DJRZWM2DXWSV tag=RY7XGXXLUZLG type=write size=3107460 2024-09-12T00:24:17.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.127+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~9B4D44A1V0VQ.0 size=1048576 2024-09-12T00:24:17.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.131+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~9B4D44A1V0VQ.1 size=1048576 2024-09-12T00:24:17.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.135+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~9B4D44A1V0VQ.2 size=530369 2024-09-12T00:24:17.139 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.139+0000 7f0d199128c0 1 < completed multipart upload key=10YEWZDTTEV0 upload=9B4D44A1V0VQ tag=2JET7HBJFSP3 type=write size=3676097 2024-09-12T00:24:17.144 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.143+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~L9EHG03EXKV3.0 size=1048576 2024-09-12T00:24:17.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.147+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~L9EHG03EXKV3.1 size=994347 2024-09-12T00:24:17.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.147+0000 7f0d199128c0 1 > prepared multipart upload key=IPJEXRBN96NB upload=L9EHG03EXKV3 tag=73HW016MHZIS type=write size=3091499 2024-09-12T00:24:17.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.147+0000 7f0d199128c0 -1 < failed to complete operation key=H604SA6XTFLY tag=IQGV98G2A511 type=del size=691710: (22) Invalid argument 2024-09-12T00:24:17.153 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.151+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=0UL98U5QMI95 type=del size=890181 2024-09-12T00:24:17.156 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.155+0000 7f0d199128c0 1 < canceled operation key=9I6MZAEUS4I0 tag=A0U6KSUIH1LW type=write size=769768 2024-09-12T00:24:17.159 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.159+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=VBOH0DG7SLTP type=del size=6779 2024-09-12T00:24:17.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.167+0000 7f0d199128c0 1 < suggested update operation key=PK2CA62QBZXS tag=ZRF8XW949NB7 type=del size=2771987 2024-09-12T00:24:17.169 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.167+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=RLIG26YBQE8F type=del size=1881348 2024-09-12T00:24:17.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.171+0000 7f0d199128c0 1 < canceled part key=_multipart_J75P0821XGRO.2~PY42BAEJLGL5.0 size=1025522 2024-09-12T00:24:17.174 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.175+0000 7f0d199128c0 1 < canceled multipart upload key=J75P0821XGRO upload=PY42BAEJLGL5 tag=4TBWCL61O33S type=write size=2074098 2024-09-12T00:24:17.178 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.179+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=V4ZB75VA6E8V type=del size=2993555 2024-09-12T00:24:17.178 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.179+0000 7f0d199128c0 1 < canceled part key=_multipart_H604SA6XTFLY.2~ZSFSEFUR8V09.0 size=1048576 2024-09-12T00:24:17.180 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.179+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~ZSFSEFUR8V09.1 size=49584 2024-09-12T00:24:17.185 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.187+0000 7f0d199128c0 1 < canceled multipart upload key=H604SA6XTFLY upload=ZSFSEFUR8V09 tag=YL3VKWO7HYH3 type=write size=2146736 2024-09-12T00:24:17.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.187+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=EZ1GQ4WOGQKO type=del size=3445114 2024-09-12T00:24:17.192 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.191+0000 7f0d199128c0 1 < completed delete operation key=RX3RVT06SGJ4 tag=W3CCH7YQY5TR type=del 2024-09-12T00:24:17.197 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.199+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~YZFHRJGGRPK0.0 size=767725 2024-09-12T00:24:17.198 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.199+0000 7f0d199128c0 1 > prepared multipart upload key=HXNC728XIWC1 upload=YZFHRJGGRPK0 tag=CZMT3LB51B7M type=write size=1816301 2024-09-12T00:24:17.200 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.199+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~KZ6CL6V19VM8.0 size=289470 2024-09-12T00:24:17.205 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.207+0000 7f0d199128c0 1 < completed multipart upload key=PK2CA62QBZXS upload=KZ6CL6V19VM8 tag=5LCU29QIYDWD type=write size=1338046 2024-09-12T00:24:17.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.207+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=F8PT1GRY5E7P type=write size=763479 2024-09-12T00:24:17.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.211+0000 7f0d199128c0 1 < completed delete operation key=JA6CSJF78VE2 tag=TL2NB7SQXM3T type=del 2024-09-12T00:24:17.214 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.215+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=L222SL0VFOF7 type=del size=3038571 2024-09-12T00:24:17.215 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.215+0000 7f0d199128c0 1 < canceled part key=_multipart_57W1IO3KSWBR.2~0FW4EAZWJ5VB.0 size=1048576 2024-09-12T00:24:17.217 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.219+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~0FW4EAZWJ5VB.1 size=258844 2024-09-12T00:24:17.222 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.223+0000 7f0d199128c0 1 < canceled multipart upload key=57W1IO3KSWBR upload=0FW4EAZWJ5VB tag=Q9NN81Z9ZNVT type=write size=2355996 2024-09-12T00:24:17.225 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.223+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=HEDSKE1YWQG5 type=del size=3032228 2024-09-12T00:24:17.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.227+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~THN6XGT051DV.0 size=242041 2024-09-12T00:24:17.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.231+0000 7f0d199128c0 1 < completed multipart upload key=J75P0821XGRO upload=THN6XGT051DV tag=CL5C49MM2BFH type=write size=1290617 2024-09-12T00:24:17.235 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.235+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=HDQPOL95R23B type=del size=770713 2024-09-12T00:24:17.241 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.243+0000 7f0d199128c0 1 < suggested remove operation key=H604SA6XTFLY tag=TGDC9IV9OG45 type=del 2024-09-12T00:24:17.247 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.247+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~G9SX5E8RULMM.0 size=1048576 2024-09-12T00:24:17.249 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.247+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~G9SX5E8RULMM.1 size=1048576 2024-09-12T00:24:17.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.251+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~G9SX5E8RULMM.2 size=626766 2024-09-12T00:24:17.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.251+0000 7f0d199128c0 1 > prepared multipart upload key=57W1IO3KSWBR upload=G9SX5E8RULMM tag=HYKKXMUS395X type=write size=3772494 2024-09-12T00:24:17.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.255+0000 7f0d199128c0 1 < suggested remove operation key=HXNC728XIWC1 tag=UZXGVSSBX10A type=write 2024-09-12T00:24:17.263 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.263+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~25PEHJ0UY0BV.0 size=1048576 2024-09-12T00:24:17.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.263+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~25PEHJ0UY0BV.1 size=518165 2024-09-12T00:24:17.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.263+0000 7f0d199128c0 1 > prepared multipart upload key=GH0FNY2AI00G upload=25PEHJ0UY0BV tag=RYQFMUAFN51Z type=write size=2615317 2024-09-12T00:24:17.268 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.267+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~4EQLRSZEXAQA.0 size=1048576 2024-09-12T00:24:17.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.271+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~4EQLRSZEXAQA.1 size=1048576 2024-09-12T00:24:17.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.275+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~4EQLRSZEXAQA.2 size=891049 2024-09-12T00:24:17.279 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.279+0000 7f0d199128c0 1 < completed multipart upload key=A529WOKFD1NI upload=4EQLRSZEXAQA tag=0A2GBFTTR4G5 type=write size=4036777 2024-09-12T00:24:17.282 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.283+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=4U2PTMZHCBZS type=del size=3981463 2024-09-12T00:24:17.285 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.283+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~YM8TO2UMFC03.0 size=1048576 2024-09-12T00:24:17.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.287+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~YM8TO2UMFC03.1 size=275697 2024-09-12T00:24:17.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.291+0000 7f0d199128c0 1 < completed multipart upload key=9I6MZAEUS4I0 upload=YM8TO2UMFC03 tag=IHD9FVW7UV9N type=write size=2372849 2024-09-12T00:24:17.296 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.295+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=76J4G7NBG2MU type=del size=591546 2024-09-12T00:24:17.299 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.299+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~DJRZWM2DXWSV.0 size=1048576 2024-09-12T00:24:17.302 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.303+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~DJRZWM2DXWSV.1 size=1010308 2024-09-12T00:24:17.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.307+0000 7f0d199128c0 1 < completed multipart upload key=T6GOR4SBYU2Y upload=DJRZWM2DXWSV tag=RY7XGXXLUZLG type=write size=3107460 2024-09-12T00:24:17.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.311+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~L9SGGDCT70O9.0 size=1048576 2024-09-12T00:24:17.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.315+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~L9SGGDCT70O9.1 size=1048576 2024-09-12T00:24:17.316 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.315+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~L9SGGDCT70O9.2 size=85186 2024-09-12T00:24:17.316 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.315+0000 7f0d199128c0 1 > prepared multipart upload key=IPJEXRBN96NB upload=L9SGGDCT70O9 tag=L3NXAFMSAX1Z type=write size=3230914 2024-09-12T00:24:17.319 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.319+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~L9EHG03EXKV3.0 size=1048576 2024-09-12T00:24:17.322 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.323+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~L9EHG03EXKV3.1 size=994347 2024-09-12T00:24:17.328 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.327+0000 7f0d199128c0 1 < completed multipart upload key=IPJEXRBN96NB upload=L9EHG03EXKV3 tag=73HW016MHZIS type=write size=3091499 2024-09-12T00:24:17.331 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.331+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=6D1QSCZ2SYI1 type=del size=109757 2024-09-12T00:24:17.336 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.335+0000 7f0d199128c0 1 < completed delete operation key=SITJU2EUVSR8 tag=0UL98U5QMI95 type=del 2024-09-12T00:24:17.338 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.339+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=GKJRZNACWF0R type=del size=3148398 2024-09-12T00:24:17.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.339+0000 7f0d199128c0 1 < completed delete operation key=0ZT4NZYZKI5Z tag=VBOH0DG7SLTP type=del 2024-09-12T00:24:17.343 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.343+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=I0AYNDTOAEM7 type=del size=1337968 2024-09-12T00:24:17.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.347+0000 7f0d199128c0 1 < completed delete operation key=ZWGD87Z1MMNK tag=RLIG26YBQE8F type=del 2024-09-12T00:24:17.349 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.347+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=6PGUC5PBYG4W type=del size=2237720 2024-09-12T00:24:17.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.355+0000 7f0d199128c0 1 < suggested remove operation key=0ZT4NZYZKI5Z tag=V4ZB75VA6E8V type=del 2024-09-12T00:24:17.357 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.355+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=1MJ1NBBPEDUK type=del size=4034580 2024-09-12T00:24:17.360 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.359+0000 7f0d199128c0 -1 < failed to complete operation key=HXNC728XIWC1 tag=EZ1GQ4WOGQKO type=del size=3445114: (22) Invalid argument 2024-09-12T00:24:17.365 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.363+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~Y2VEUNH1680N.0 size=699919 2024-09-12T00:24:17.365 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.363+0000 7f0d199128c0 1 > prepared multipart upload key=J75P0821XGRO upload=Y2VEUNH1680N tag=J01XX92ESEIL type=write size=1748495 2024-09-12T00:24:17.368 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.367+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~YZFHRJGGRPK0.0 size=767725 2024-09-12T00:24:17.372 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.371+0000 7f0d199128c0 1 < completed multipart upload key=HXNC728XIWC1 upload=YZFHRJGGRPK0 tag=CZMT3LB51B7M type=write size=1816301 2024-09-12T00:24:17.375 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.375+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=I1MEUF34J3GN type=del size=1458935 2024-09-12T00:24:17.378 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.379+0000 7f0d199128c0 1 < completed write operation key=RX3RVT06SGJ4 tag=F8PT1GRY5E7P type=write size=763479 2024-09-12T00:24:17.388 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.387+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~ANZ8JOEXCUL2.0 size=1048576 2024-09-12T00:24:17.390 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.391+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~ANZ8JOEXCUL2.1 size=1048576 2024-09-12T00:24:17.393 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.391+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~ANZ8JOEXCUL2.2 size=791663 2024-09-12T00:24:17.393 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.391+0000 7f0d199128c0 1 > prepared multipart upload key=2EK9CCKG26W2 upload=ANZ8JOEXCUL2 tag=YMFCB4YQ4SNJ type=write size=3937391 2024-09-12T00:24:17.395 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.395+0000 7f0d199128c0 1 < completed delete operation key=RFCHRGVA9GOI tag=L222SL0VFOF7 type=del 2024-09-12T00:24:17.401 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.399+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~32AV3MMG5FTK.0 size=1048576 2024-09-12T00:24:17.403 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.403+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~32AV3MMG5FTK.1 size=1048576 2024-09-12T00:24:17.406 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.407+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~32AV3MMG5FTK.2 size=966707 2024-09-12T00:24:17.406 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.407+0000 7f0d199128c0 1 > prepared multipart upload key=OVLAP0OS78QG upload=32AV3MMG5FTK tag=2SV23Y6WMZWL type=write size=4112435 2024-09-12T00:24:17.409 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.407+0000 7f0d199128c0 -1 < failed to complete operation key=0ZT4NZYZKI5Z tag=HEDSKE1YWQG5 type=del size=3032228: (22) Invalid argument 2024-09-12T00:24:17.413 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.411+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=9HQO7A9QEJOX type=del size=3979944 2024-09-12T00:24:17.416 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.415+0000 7f0d199128c0 -1 < failed to complete operation key=H604SA6XTFLY tag=HDQPOL95R23B type=del size=770713: (22) Invalid argument 2024-09-12T00:24:17.420 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.419+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=JMCQQ3NDC80S type=write size=434715 2024-09-12T00:24:17.423 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.423+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~G9SX5E8RULMM.0 size=1048576 2024-09-12T00:24:17.426 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.427+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~G9SX5E8RULMM.1 size=1048576 2024-09-12T00:24:17.429 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.427+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~G9SX5E8RULMM.2 size=626766 2024-09-12T00:24:17.435 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.435+0000 7f0d199128c0 1 < completed multipart upload key=57W1IO3KSWBR upload=G9SX5E8RULMM tag=HYKKXMUS395X type=write size=3772494 2024-09-12T00:24:17.442 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.443+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~SC7AJM4DVBFE.0 size=736812 2024-09-12T00:24:17.442 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.443+0000 7f0d199128c0 1 > prepared multipart upload key=1Y6B1MJP5G4L upload=SC7AJM4DVBFE tag=FHCD37FIB0MI type=write size=1785388 2024-09-12T00:24:17.450 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.443+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~25PEHJ0UY0BV.0 size=1048576 2024-09-12T00:24:17.450 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.447+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~25PEHJ0UY0BV.1 size=518165 2024-09-12T00:24:17.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.451+0000 7f0d199128c0 1 < completed multipart upload key=GH0FNY2AI00G upload=25PEHJ0UY0BV tag=RYQFMUAFN51Z type=write size=2615317 2024-09-12T00:24:17.457 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.455+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=QQ08CU12WYF7 type=del size=2500381 2024-09-12T00:24:17.460 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.459+0000 7f0d199128c0 1 < completed delete operation key=PK2CA62QBZXS tag=4U2PTMZHCBZS type=del 2024-09-12T00:24:17.464 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.463+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=NE9NKOR3JDRV type=del size=3369542 2024-09-12T00:24:17.467 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.467+0000 7f0d199128c0 1 < completed delete operation key=OVLAP0OS78QG tag=76J4G7NBG2MU type=del 2024-09-12T00:24:17.473 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.475+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~AOXPL5O5L3S7.0 size=1048576 2024-09-12T00:24:17.476 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.475+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~AOXPL5O5L3S7.1 size=1048576 2024-09-12T00:24:17.479 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.479+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~AOXPL5O5L3S7.2 size=332496 2024-09-12T00:24:17.479 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.479+0000 7f0d199128c0 1 > prepared multipart upload key=9I6MZAEUS4I0 upload=AOXPL5O5L3S7 tag=2423UUODXA54 type=write size=3478224 2024-09-12T00:24:17.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.483+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~L9SGGDCT70O9.0 size=1048576 2024-09-12T00:24:17.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.483+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~L9SGGDCT70O9.1 size=1048576 2024-09-12T00:24:17.488 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.487+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~L9SGGDCT70O9.2 size=85186 2024-09-12T00:24:17.493 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.491+0000 7f0d199128c0 1 < completed multipart upload key=IPJEXRBN96NB upload=L9SGGDCT70O9 tag=L3NXAFMSAX1Z type=write size=3230914 2024-09-12T00:24:17.499 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.499+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~MS7KHPC41NEO.0 size=443594 2024-09-12T00:24:17.499 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.499+0000 7f0d199128c0 1 > prepared multipart upload key=37WTPAJGOX5L upload=MS7KHPC41NEO tag=GBQYN8P7TU07 type=write size=1492170 2024-09-12T00:24:17.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.503+0000 7f0d199128c0 1 < completed delete operation key=2EK9CCKG26W2 tag=6D1QSCZ2SYI1 type=del 2024-09-12T00:24:17.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.507+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=XJ8NSME32XIP type=del size=3443455 2024-09-12T00:24:17.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.507+0000 7f0d199128c0 1 < completed delete operation key=RX3RVT06SGJ4 tag=GKJRZNACWF0R type=del 2024-09-12T00:24:17.515 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.515+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~UO20GITMHN44.0 size=1048576 2024-09-12T00:24:17.517 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.515+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~UO20GITMHN44.1 size=1048576 2024-09-12T00:24:17.520 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.519+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~UO20GITMHN44.2 size=108352 2024-09-12T00:24:17.520 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.519+0000 7f0d199128c0 1 > prepared multipart upload key=0EBWUENN0881 upload=UO20GITMHN44 tag=6YLMJRRXHZI9 type=write size=3254080 2024-09-12T00:24:17.523 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.523+0000 7f0d199128c0 1 < completed delete operation key=1Y6B1MJP5G4L tag=I0AYNDTOAEM7 type=del 2024-09-12T00:24:17.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.531+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~FJS958ZD9M28.0 size=1048576 2024-09-12T00:24:17.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.531+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~FJS958ZD9M28.1 size=1042877 2024-09-12T00:24:17.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.531+0000 7f0d199128c0 1 > prepared multipart upload key=J75P0821XGRO upload=FJS958ZD9M28 tag=MYS1J10P7K3O type=write size=3140029 2024-09-12T00:24:17.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.535+0000 7f0d199128c0 1 < completed delete operation key=1Y6B1MJP5G4L tag=6PGUC5PBYG4W type=del 2024-09-12T00:24:17.541 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.539+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=8EQRJGCDPE2R type=del size=3626214 2024-09-12T00:24:17.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.547+0000 7f0d199128c0 1 < suggested remove operation key=NXQYUQIR2APT tag=1MJ1NBBPEDUK type=del 2024-09-12T00:24:17.556 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.555+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~D7JNJQOR1UBP.0 size=1048576 2024-09-12T00:24:17.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.559+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~D7JNJQOR1UBP.1 size=879188 2024-09-12T00:24:17.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.559+0000 7f0d199128c0 1 > prepared multipart upload key=IPJEXRBN96NB upload=D7JNJQOR1UBP tag=W4G90TY1ZG9P type=write size=2976340 2024-09-12T00:24:17.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.563+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~Y2VEUNH1680N.0 size=699919 2024-09-12T00:24:17.569 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.571+0000 7f0d199128c0 1 < completed multipart upload key=J75P0821XGRO upload=Y2VEUNH1680N tag=J01XX92ESEIL type=write size=1748495 2024-09-12T00:24:17.573 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.575+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=MZDH35409A64 type=del size=3184672 2024-09-12T00:24:17.577 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.579+0000 7f0d199128c0 1 < completed delete operation key=37WTPAJGOX5L tag=I1MEUF34J3GN type=del 2024-09-12T00:24:17.581 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.583+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=H86IWJ17PYUJ type=del size=3184710 2024-09-12T00:24:17.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.587+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~ANZ8JOEXCUL2.0 size=1048576 2024-09-12T00:24:17.589 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.587+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~ANZ8JOEXCUL2.1 size=1048576 2024-09-12T00:24:17.592 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.591+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~ANZ8JOEXCUL2.2 size=791663 2024-09-12T00:24:17.599 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.599+0000 7f0d199128c0 1 < completed multipart upload key=2EK9CCKG26W2 upload=ANZ8JOEXCUL2 tag=YMFCB4YQ4SNJ type=write size=3937391 2024-09-12T00:24:17.603 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.603+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=GZ0QQQ2W2A4A type=del size=2935123 2024-09-12T00:24:17.608 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.607+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~32AV3MMG5FTK.0 size=1048576 2024-09-12T00:24:17.611 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.611+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~32AV3MMG5FTK.1 size=1048576 2024-09-12T00:24:17.614 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.615+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~32AV3MMG5FTK.2 size=966707 2024-09-12T00:24:17.621 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.619+0000 7f0d199128c0 1 < completed multipart upload key=OVLAP0OS78QG upload=32AV3MMG5FTK tag=2SV23Y6WMZWL type=write size=4112435 2024-09-12T00:24:17.625 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.623+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=DCIWY34PYMTQ type=write size=880538 2024-09-12T00:24:17.628 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.627+0000 7f0d199128c0 1 < completed delete operation key=VXZI0ZTMQSV0 tag=9HQO7A9QEJOX type=del 2024-09-12T00:24:17.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.635+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~IBXBTNITZ7Z9.0 size=356903 2024-09-12T00:24:17.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.635+0000 7f0d199128c0 1 > prepared multipart upload key=WBGXMJB7U422 upload=IBXBTNITZ7Z9 tag=0RWGNMZOTTQG type=write size=1405479 2024-09-12T00:24:17.639 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.639+0000 7f0d199128c0 1 < completed write operation key=10YEWZDTTEV0 tag=JMCQQ3NDC80S type=write size=434715 2024-09-12T00:24:17.646 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.647+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~I2VYJ00WKW8V.0 size=792247 2024-09-12T00:24:17.646 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.647+0000 7f0d199128c0 1 > prepared multipart upload key=WPZOKZDFXK4S upload=I2VYJ00WKW8V tag=9CCOAMVCZEGS type=write size=1840823 2024-09-12T00:24:17.650 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.651+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~SC7AJM4DVBFE.0 size=736812 2024-09-12T00:24:17.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.655+0000 7f0d199128c0 1 < completed multipart upload key=1Y6B1MJP5G4L upload=SC7AJM4DVBFE tag=FHCD37FIB0MI type=write size=1785388 2024-09-12T00:24:17.659 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.659+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=0VVLMLQXW51S type=write size=407568 2024-09-12T00:24:17.663 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.663+0000 7f0d199128c0 -1 < failed to complete operation key=NXQYUQIR2APT tag=QQ08CU12WYF7 type=del size=2500381: (22) Invalid argument 2024-09-12T00:24:17.666 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.667+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=7YGZD6NC1L3H type=del size=3048428 2024-09-12T00:24:17.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.671+0000 7f0d199128c0 1 < completed delete operation key=YTXW98O07966 tag=NE9NKOR3JDRV type=del 2024-09-12T00:24:17.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.679+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~DYD9YFJP095I.0 size=1048576 2024-09-12T00:24:17.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.679+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~DYD9YFJP095I.1 size=1048576 2024-09-12T00:24:17.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.683+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~DYD9YFJP095I.2 size=548079 2024-09-12T00:24:17.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.683+0000 7f0d199128c0 1 > prepared multipart upload key=4K654PSDLDVI upload=DYD9YFJP095I tag=VC72G30ZZ3J4 type=write size=3693807 2024-09-12T00:24:17.686 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.687+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~AOXPL5O5L3S7.0 size=1048576 2024-09-12T00:24:17.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.691+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~AOXPL5O5L3S7.1 size=1048576 2024-09-12T00:24:17.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.691+0000 7f0d199128c0 1 < canceled part key=_multipart_9I6MZAEUS4I0.2~AOXPL5O5L3S7.2 size=332496 2024-09-12T00:24:17.696 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.695+0000 7f0d199128c0 1 < canceled multipart upload key=9I6MZAEUS4I0 upload=AOXPL5O5L3S7 tag=2423UUODXA54 type=write size=3478224 2024-09-12T00:24:17.699 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.699+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=P09QOSJT55WM type=del size=3936968 2024-09-12T00:24:17.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.699+0000 7f0d199128c0 1 < canceled part key=_multipart_37WTPAJGOX5L.2~MS7KHPC41NEO.0 size=443594 2024-09-12T00:24:17.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.707+0000 7f0d199128c0 1 < canceled multipart upload key=37WTPAJGOX5L upload=MS7KHPC41NEO tag=GBQYN8P7TU07 type=write size=1492170 2024-09-12T00:24:17.709 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.707+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=SKLVKP1RPH86 type=del size=4085293 2024-09-12T00:24:17.718 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.719+0000 7f0d199128c0 1 < suggested remove operation key=10YEWZDTTEV0 tag=XJ8NSME32XIP type=del 2024-09-12T00:24:17.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.723+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~XIXDLK2FKGWO.0 size=3382 2024-09-12T00:24:17.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.723+0000 7f0d199128c0 1 > prepared multipart upload key=ZWGD87Z1MMNK upload=XIXDLK2FKGWO tag=X2ATK9NTRI3G type=write size=1051958 2024-09-12T00:24:17.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.723+0000 7f0d199128c0 1 < canceled part key=_multipart_0EBWUENN0881.2~UO20GITMHN44.0 size=1048576 2024-09-12T00:24:17.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.727+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~UO20GITMHN44.1 size=1048576 2024-09-12T00:24:17.730 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.731+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~UO20GITMHN44.2 size=108352 2024-09-12T00:24:17.737 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.735+0000 7f0d199128c0 1 < canceled multipart upload key=0EBWUENN0881 upload=UO20GITMHN44 tag=6YLMJRRXHZI9 type=write size=3254080 2024-09-12T00:24:17.740 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.739+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=YKD4MK4W1SLZ type=del size=2100793 2024-09-12T00:24:17.743 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.743+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~FJS958ZD9M28.0 size=1048576 2024-09-12T00:24:17.748 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.747+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~FJS958ZD9M28.1 size=1042877 2024-09-12T00:24:17.753 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.751+0000 7f0d199128c0 1 < completed multipart upload key=J75P0821XGRO upload=FJS958ZD9M28 tag=MYS1J10P7K3O type=write size=3140029 2024-09-12T00:24:17.756 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.755+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=8CEQEBJJK450 type=del size=3499916 2024-09-12T00:24:17.763 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.763+0000 7f0d199128c0 1 < suggested update operation key=QUO5ND3O41TY tag=8EQRJGCDPE2R type=del size=3626214 2024-09-12T00:24:17.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.767+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~F329AC6LE6O3.0 size=1048576 2024-09-12T00:24:17.772 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.771+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~F329AC6LE6O3.1 size=229257 2024-09-12T00:24:17.772 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.771+0000 7f0d199128c0 1 > prepared multipart upload key=IPJEXRBN96NB upload=F329AC6LE6O3 tag=T8HED1K66OA7 type=write size=2326409 2024-09-12T00:24:17.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.775+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~D7JNJQOR1UBP.0 size=1048576 2024-09-12T00:24:17.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.775+0000 7f0d199128c0 1 < canceled part key=_multipart_IPJEXRBN96NB.2~D7JNJQOR1UBP.1 size=879188 2024-09-12T00:24:17.781 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.779+0000 7f0d199128c0 1 < canceled multipart upload key=IPJEXRBN96NB upload=D7JNJQOR1UBP tag=W4G90TY1ZG9P type=write size=2976340 2024-09-12T00:24:17.788 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.787+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~LZ2F53TIJHL2.0 size=310411 2024-09-12T00:24:17.788 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.787+0000 7f0d199128c0 1 > prepared multipart upload key=H604SA6XTFLY upload=LZ2F53TIJHL2 tag=1MBQZ1RQ1MRL type=write size=1358987 2024-09-12T00:24:17.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.791+0000 7f0d199128c0 1 < completed delete operation key=9I6MZAEUS4I0 tag=MZDH35409A64 type=del 2024-09-12T00:24:17.795 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.795+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=D2WGM2NQLVY9 type=write size=44642 2024-09-12T00:24:17.799 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.799+0000 7f0d199128c0 1 < completed delete operation key=FJ8YV026H0ZU tag=H86IWJ17PYUJ type=del 2024-09-12T00:24:17.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.807+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~NEYK11UJ8GGK.0 size=1048576 2024-09-12T00:24:17.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.807+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~NEYK11UJ8GGK.1 size=635485 2024-09-12T00:24:17.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.807+0000 7f0d199128c0 1 > prepared multipart upload key=J75P0821XGRO upload=NEYK11UJ8GGK tag=E0UU14J8AP56 type=write size=2732637 2024-09-12T00:24:17.812 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.811+0000 7f0d199128c0 1 < completed delete operation key=JA6CSJF78VE2 tag=GZ0QQQ2W2A4A type=del 2024-09-12T00:24:17.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.815+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=RQUM56VFCQ84 type=write size=262196 2024-09-12T00:24:17.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.819+0000 7f0d199128c0 1 < completed write operation key=T6GOR4SBYU2Y tag=DCIWY34PYMTQ type=write size=880538 2024-09-12T00:24:17.827 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.827+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~O5CW6F3GN543.0 size=1048576 2024-09-12T00:24:17.830 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.831+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~O5CW6F3GN543.1 size=324084 2024-09-12T00:24:17.830 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.831+0000 7f0d199128c0 1 > prepared multipart upload key=SITJU2EUVSR8 upload=O5CW6F3GN543 tag=IN8PIQ0ADW2C type=write size=2421236 2024-09-12T00:24:17.834 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.835+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~IBXBTNITZ7Z9.0 size=356903 2024-09-12T00:24:17.840 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.839+0000 7f0d199128c0 1 < completed multipart upload key=WBGXMJB7U422 upload=IBXBTNITZ7Z9 tag=0RWGNMZOTTQG type=write size=1405479 2024-09-12T00:24:17.843 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.843+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=JM2CUUCSSGY2 type=del size=1225411 2024-09-12T00:24:17.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.847+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~I2VYJ00WKW8V.0 size=792247 2024-09-12T00:24:17.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.851+0000 7f0d199128c0 1 < completed multipart upload key=WPZOKZDFXK4S upload=I2VYJ00WKW8V tag=9CCOAMVCZEGS type=write size=1840823 2024-09-12T00:24:17.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.855+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=A1K7PK5DKJTS type=del size=1360788 2024-09-12T00:24:17.862 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.863+0000 7f0d199128c0 1 < suggested update operation key=4K654PSDLDVI tag=0VVLMLQXW51S type=write size=407568 2024-09-12T00:24:17.865 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.867+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=RTPQ506TL4AD type=del size=528641 2024-09-12T00:24:17.873 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.871+0000 7f0d199128c0 1 < suggested update operation key=WBGXMJB7U422 tag=7YGZD6NC1L3H type=del size=3048428 2024-09-12T00:24:17.876 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.875+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=ASZ39QA12LMS type=del size=3210831 2024-09-12T00:24:17.880 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.879+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~DYD9YFJP095I.0 size=1048576 2024-09-12T00:24:17.883 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.883+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~DYD9YFJP095I.1 size=1048576 2024-09-12T00:24:17.883 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.883+0000 7f0d199128c0 1 < canceled part key=_multipart_4K654PSDLDVI.2~DYD9YFJP095I.2 size=548079 2024-09-12T00:24:17.889 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.887+0000 7f0d199128c0 1 < canceled multipart upload key=4K654PSDLDVI upload=DYD9YFJP095I tag=VC72G30ZZ3J4 type=write size=3693807 2024-09-12T00:24:17.894 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.895+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~UABQPBN0LD30.0 size=1048576 2024-09-12T00:24:17.897 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.895+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~UABQPBN0LD30.1 size=1048576 2024-09-12T00:24:17.900 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.899+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~UABQPBN0LD30.2 size=541407 2024-09-12T00:24:17.900 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.899+0000 7f0d199128c0 1 > prepared multipart upload key=B58RWC9W8THG upload=UABQPBN0LD30 tag=0XRQFX9AJIVB type=write size=3687135 2024-09-12T00:24:17.903 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.903+0000 7f0d199128c0 1 < completed delete operation key=0ZT4NZYZKI5Z tag=P09QOSJT55WM type=del 2024-09-12T00:24:17.909 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.907+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~N4TWRQNZ0EFQ.0 size=536753 2024-09-12T00:24:17.909 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.907+0000 7f0d199128c0 1 > prepared multipart upload key=NXQYUQIR2APT upload=N4TWRQNZ0EFQ tag=BXUOPQHSTKPG type=write size=1585329 2024-09-12T00:24:17.916 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.915+0000 7f0d199128c0 1 < suggested update operation key=WBGXMJB7U422 tag=SKLVKP1RPH86 type=del size=4085293 2024-09-12T00:24:17.923 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.923+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~NE2TK9H7Z8VA.0 size=1048576 2024-09-12T00:24:17.925 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.923+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~NE2TK9H7Z8VA.1 size=436797 2024-09-12T00:24:17.925 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.923+0000 7f0d199128c0 1 > prepared multipart upload key=GH0FNY2AI00G upload=NE2TK9H7Z8VA tag=Q0RRQPNA3V9V type=write size=2533949 2024-09-12T00:24:17.928 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.927+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~XIXDLK2FKGWO.0 size=3382 2024-09-12T00:24:17.934 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.935+0000 7f0d199128c0 1 < completed multipart upload key=ZWGD87Z1MMNK upload=XIXDLK2FKGWO tag=X2ATK9NTRI3G type=write size=1051958 2024-09-12T00:24:17.941 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.939+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~7QXQPK7WS7JK.0 size=612939 2024-09-12T00:24:17.941 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.939+0000 7f0d199128c0 1 > prepared multipart upload key=QUO5ND3O41TY upload=7QXQPK7WS7JK tag=FV9Q1T76Z5JE type=write size=1661515 2024-09-12T00:24:17.944 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.943+0000 7f0d199128c0 1 < completed delete operation key=A529WOKFD1NI tag=YKD4MK4W1SLZ type=del 2024-09-12T00:24:17.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.947+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=VVL3AOCHLEV5 type=del size=323935 2024-09-12T00:24:17.952 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.951+0000 7f0d199128c0 1 < completed delete operation key=2EK9CCKG26W2 tag=8CEQEBJJK450 type=del 2024-09-12T00:24:17.958 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.959+0000 7f0d199128c0 1 > prepared part key=_multipart_RFCHRGVA9GOI.2~M9CWBIW2WZPZ.0 size=1048576 2024-09-12T00:24:17.961 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.959+0000 7f0d199128c0 1 > prepared part key=_multipart_RFCHRGVA9GOI.2~M9CWBIW2WZPZ.1 size=1048576 2024-09-12T00:24:17.963 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.963+0000 7f0d199128c0 1 > prepared part key=_multipart_RFCHRGVA9GOI.2~M9CWBIW2WZPZ.2 size=428776 2024-09-12T00:24:17.963 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.963+0000 7f0d199128c0 1 > prepared multipart upload key=RFCHRGVA9GOI upload=M9CWBIW2WZPZ tag=UY7MV5VNTMHS type=write size=3574504 2024-09-12T00:24:17.967 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.967+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~F329AC6LE6O3.0 size=1048576 2024-09-12T00:24:17.969 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.971+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~F329AC6LE6O3.1 size=229257 2024-09-12T00:24:17.975 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.975+0000 7f0d199128c0 1 < completed multipart upload key=IPJEXRBN96NB upload=F329AC6LE6O3 tag=T8HED1K66OA7 type=write size=2326409 2024-09-12T00:24:17.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.979+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~UCWBH67Y6OLF.0 size=1048576 2024-09-12T00:24:17.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.983+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~UCWBH67Y6OLF.1 size=1048576 2024-09-12T00:24:17.987 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.987+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~UCWBH67Y6OLF.2 size=630200 2024-09-12T00:24:17.987 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.987+0000 7f0d199128c0 1 > prepared multipart upload key=OVLAP0OS78QG upload=UCWBH67Y6OLF tag=N26PYGBLRJAJ type=write size=3775928 2024-09-12T00:24:17.991 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.991+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~LZ2F53TIJHL2.0 size=310411 2024-09-12T00:24:17.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:17.995+0000 7f0d199128c0 1 < completed multipart upload key=H604SA6XTFLY upload=LZ2F53TIJHL2 tag=1MBQZ1RQ1MRL type=write size=1358987 2024-09-12T00:24:18.003 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.003+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~JFIWY5CRWVFS.0 size=1048576 2024-09-12T00:24:18.006 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.007+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~JFIWY5CRWVFS.1 size=971928 2024-09-12T00:24:18.006 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.007+0000 7f0d199128c0 1 > prepared multipart upload key=WBGXMJB7U422 upload=JFIWY5CRWVFS tag=6NQ138OB2L0J type=write size=3069080 2024-09-12T00:24:18.009 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.011+0000 7f0d199128c0 1 < canceled operation key=J75P0821XGRO tag=D2WGM2NQLVY9 type=write size=44642 2024-09-12T00:24:18.013 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.011+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=CX1UGWO6QTL8 type=del size=3190363 2024-09-12T00:24:18.017 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.019+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~NEYK11UJ8GGK.0 size=1048576 2024-09-12T00:24:18.020 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.019+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~NEYK11UJ8GGK.1 size=635485 2024-09-12T00:24:18.026 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.027+0000 7f0d199128c0 1 < completed multipart upload key=J75P0821XGRO upload=NEYK11UJ8GGK tag=E0UU14J8AP56 type=write size=2732637 2024-09-12T00:24:18.030 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.031+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=I6UZ54K9UXNW type=write size=688933 2024-09-12T00:24:18.040 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.039+0000 7f0d199128c0 1 < suggested remove operation key=HXNC728XIWC1 tag=RQUM56VFCQ84 type=write 2024-09-12T00:24:18.047 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.047+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~EKOZL7RL3F5X.0 size=1048576 2024-09-12T00:24:18.050 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.051+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~EKOZL7RL3F5X.1 size=1048576 2024-09-12T00:24:18.053 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.051+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~EKOZL7RL3F5X.2 size=423821 2024-09-12T00:24:18.053 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.051+0000 7f0d199128c0 1 > prepared multipart upload key=57W1IO3KSWBR upload=EKOZL7RL3F5X tag=38VYOFYXQBIX type=write size=3569549 2024-09-12T00:24:18.057 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.055+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~O5CW6F3GN543.0 size=1048576 2024-09-12T00:24:18.060 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.059+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~O5CW6F3GN543.1 size=324084 2024-09-12T00:24:18.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.067+0000 7f0d199128c0 1 < completed multipart upload key=SITJU2EUVSR8 upload=O5CW6F3GN543 tag=IN8PIQ0ADW2C type=write size=2421236 2024-09-12T00:24:18.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.071+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=CAAGI51Q7WB5 type=write size=559711 2024-09-12T00:24:18.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.071+0000 7f0d199128c0 1 < completed delete operation key=YTXW98O07966 tag=JM2CUUCSSGY2 type=del 2024-09-12T00:24:18.076 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.075+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=W9V2WEUEJKAB type=del size=1890815 2024-09-12T00:24:18.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.079+0000 7f0d199128c0 1 < completed delete operation key=YTXW98O07966 tag=A1K7PK5DKJTS type=del 2024-09-12T00:24:18.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.087+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~JSF65JHPWVBJ.0 size=366350 2024-09-12T00:24:18.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.087+0000 7f0d199128c0 1 > prepared multipart upload key=WPZOKZDFXK4S upload=JSF65JHPWVBJ tag=TU6U31NVPM9R type=write size=1414926 2024-09-12T00:24:18.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.091+0000 7f0d199128c0 1 < completed delete operation key=9I6MZAEUS4I0 tag=RTPQ506TL4AD type=del 2024-09-12T00:24:18.094 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.095+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=W1VAYPZSQQ9D type=del size=2569784 2024-09-12T00:24:18.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.103+0000 7f0d199128c0 1 < suggested remove operation key=RFCHRGVA9GOI tag=ASZ39QA12LMS type=del 2024-09-12T00:24:18.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.107+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~HO7171MLZRY9.0 size=1048576 2024-09-12T00:24:18.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.111+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~HO7171MLZRY9.1 size=658975 2024-09-12T00:24:18.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.111+0000 7f0d199128c0 1 > prepared multipart upload key=HXNC728XIWC1 upload=HO7171MLZRY9 tag=S207DQ693MMF type=write size=2756127 2024-09-12T00:24:18.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.115+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~UABQPBN0LD30.0 size=1048576 2024-09-12T00:24:18.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.119+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~UABQPBN0LD30.1 size=1048576 2024-09-12T00:24:18.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.119+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~UABQPBN0LD30.2 size=541407 2024-09-12T00:24:18.126 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.127+0000 7f0d199128c0 1 < completed multipart upload key=B58RWC9W8THG upload=UABQPBN0LD30 tag=0XRQFX9AJIVB type=write size=3687135 2024-09-12T00:24:18.130 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.131+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=MA96MMB9E3DB type=write size=263654 2024-09-12T00:24:18.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.131+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~N4TWRQNZ0EFQ.0 size=536753 2024-09-12T00:24:18.139 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.139+0000 7f0d199128c0 1 < completed multipart upload key=NXQYUQIR2APT upload=N4TWRQNZ0EFQ tag=BXUOPQHSTKPG type=write size=1585329 2024-09-12T00:24:18.144 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.143+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~IUG94KG4AFUO.0 size=1048576 2024-09-12T00:24:18.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.147+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~IUG94KG4AFUO.1 size=1048576 2024-09-12T00:24:18.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.151+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~IUG94KG4AFUO.2 size=14091 2024-09-12T00:24:18.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.151+0000 7f0d199128c0 1 > prepared multipart upload key=T6GOR4SBYU2Y upload=IUG94KG4AFUO tag=24099JHUVI19 type=write size=3159819 2024-09-12T00:24:18.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.151+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~NE2TK9H7Z8VA.0 size=1048576 2024-09-12T00:24:18.155 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.155+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~NE2TK9H7Z8VA.1 size=436797 2024-09-12T00:24:18.161 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.159+0000 7f0d199128c0 1 < completed multipart upload key=GH0FNY2AI00G upload=NE2TK9H7Z8VA tag=Q0RRQPNA3V9V type=write size=2533949 2024-09-12T00:24:18.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.167+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~0N18K6DDNKHS.0 size=363429 2024-09-12T00:24:18.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.167+0000 7f0d199128c0 1 > prepared multipart upload key=FJ8YV026H0ZU upload=0N18K6DDNKHS tag=3K0P75H2IR0L type=write size=1412005 2024-09-12T00:24:18.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.171+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~7QXQPK7WS7JK.0 size=612939 2024-09-12T00:24:18.175 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.175+0000 7f0d199128c0 1 < completed multipart upload key=QUO5ND3O41TY upload=7QXQPK7WS7JK tag=FV9Q1T76Z5JE type=write size=1661515 2024-09-12T00:24:18.178 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.179+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=QJY291EOSDTX type=write size=1025299 2024-09-12T00:24:18.181 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.179+0000 7f0d199128c0 -1 < failed to complete operation key=RFCHRGVA9GOI tag=VVL3AOCHLEV5 type=del size=323935: (22) Invalid argument 2024-09-12T00:24:18.184 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.183+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=F8XLZ9E2S273 type=del size=1300187 2024-09-12T00:24:18.187 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.187+0000 7f0d199128c0 1 < completed part key=_multipart_RFCHRGVA9GOI.2~M9CWBIW2WZPZ.0 size=1048576 2024-09-12T00:24:18.190 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.191+0000 7f0d199128c0 1 < completed part key=_multipart_RFCHRGVA9GOI.2~M9CWBIW2WZPZ.1 size=1048576 2024-09-12T00:24:18.192 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.191+0000 7f0d199128c0 1 < completed part key=_multipart_RFCHRGVA9GOI.2~M9CWBIW2WZPZ.2 size=428776 2024-09-12T00:24:18.197 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.199+0000 7f0d199128c0 1 < completed multipart upload key=RFCHRGVA9GOI upload=M9CWBIW2WZPZ tag=UY7MV5VNTMHS type=write size=3574504 2024-09-12T00:24:18.201 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.199+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=WAUDLF6U0F4I type=del size=879968 2024-09-12T00:24:18.204 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.203+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~UCWBH67Y6OLF.0 size=1048576 2024-09-12T00:24:18.206 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.207+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~UCWBH67Y6OLF.1 size=1048576 2024-09-12T00:24:18.209 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.207+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~UCWBH67Y6OLF.2 size=630200 2024-09-12T00:24:18.214 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.215+0000 7f0d199128c0 1 < completed multipart upload key=OVLAP0OS78QG upload=UCWBH67Y6OLF tag=N26PYGBLRJAJ type=write size=3775928 2024-09-12T00:24:18.218 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.219+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=ZYPA7NJT7FFJ type=del size=3490285 2024-09-12T00:24:18.221 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.219+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~JFIWY5CRWVFS.0 size=1048576 2024-09-12T00:24:18.221 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.219+0000 7f0d199128c0 1 < canceled part key=_multipart_WBGXMJB7U422.2~JFIWY5CRWVFS.1 size=971928 2024-09-12T00:24:18.226 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.227+0000 7f0d199128c0 1 < canceled multipart upload key=WBGXMJB7U422 upload=JFIWY5CRWVFS tag=6NQ138OB2L0J type=write size=3069080 2024-09-12T00:24:18.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.231+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=NVOPVT3RKZJN type=del size=122557 2024-09-12T00:24:18.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.235+0000 7f0d199128c0 1 < suggested update operation key=QUO5ND3O41TY tag=CX1UGWO6QTL8 type=del size=3190363 2024-09-12T00:24:18.242 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.243+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~CHSGQ9B6IEP3.0 size=1048576 2024-09-12T00:24:18.245 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.243+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~CHSGQ9B6IEP3.1 size=768041 2024-09-12T00:24:18.245 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.243+0000 7f0d199128c0 1 > prepared multipart upload key=NXQYUQIR2APT upload=CHSGQ9B6IEP3 tag=ND57SCN2XRD6 type=write size=2865193 2024-09-12T00:24:18.248 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.247+0000 7f0d199128c0 1 < completed write operation key=FJ8YV026H0ZU tag=I6UZ54K9UXNW type=write size=688933 2024-09-12T00:24:18.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.251+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=847FXXLNS2UZ type=write size=287843 2024-09-12T00:24:18.255 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.255+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~EKOZL7RL3F5X.0 size=1048576 2024-09-12T00:24:18.255 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.255+0000 7f0d199128c0 1 < canceled part key=_multipart_57W1IO3KSWBR.2~EKOZL7RL3F5X.1 size=1048576 2024-09-12T00:24:18.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.255+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~EKOZL7RL3F5X.2 size=423821 2024-09-12T00:24:18.263 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.263+0000 7f0d199128c0 1 < canceled multipart upload key=57W1IO3KSWBR upload=EKOZL7RL3F5X tag=38VYOFYXQBIX type=write size=3569549 2024-09-12T00:24:18.266 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.267+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=M17F1JEBPHOL type=del size=1111148 2024-09-12T00:24:18.269 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.271+0000 7f0d199128c0 -1 < failed to complete operation key=QUO5ND3O41TY tag=CAAGI51Q7WB5 type=write size=559711: (22) Invalid argument 2024-09-12T00:24:18.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.271+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=8V2JF18GZ51A type=write size=501226 2024-09-12T00:24:18.276 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.275+0000 7f0d199128c0 1 < completed delete operation key=ZWGD87Z1MMNK tag=W9V2WEUEJKAB type=del 2024-09-12T00:24:18.279 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.279+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=RICR8U8TR7TT type=del size=3245149 2024-09-12T00:24:18.283 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.283+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~JSF65JHPWVBJ.0 size=366350 2024-09-12T00:24:18.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.287+0000 7f0d199128c0 1 < completed multipart upload key=WPZOKZDFXK4S upload=JSF65JHPWVBJ tag=TU6U31NVPM9R type=write size=1414926 2024-09-12T00:24:18.292 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.291+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=OXA00IJ5F2LB type=del size=1697366 2024-09-12T00:24:18.298 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.299+0000 7f0d199128c0 1 < suggested remove operation key=OVLAP0OS78QG tag=W1VAYPZSQQ9D type=del 2024-09-12T00:24:18.304 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.303+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~TDCQDVNA4XBC.0 size=1048576 2024-09-12T00:24:18.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.307+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~TDCQDVNA4XBC.1 size=1048576 2024-09-12T00:24:18.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.311+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~TDCQDVNA4XBC.2 size=30622 2024-09-12T00:24:18.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.311+0000 7f0d199128c0 1 > prepared multipart upload key=ZWGD87Z1MMNK upload=TDCQDVNA4XBC tag=13SVCXYADU4R type=write size=3176350 2024-09-12T00:24:18.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.311+0000 7f0d199128c0 1 < canceled part key=_multipart_HXNC728XIWC1.2~HO7171MLZRY9.0 size=1048576 2024-09-12T00:24:18.314 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.315+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~HO7171MLZRY9.1 size=658975 2024-09-12T00:24:18.320 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.319+0000 7f0d199128c0 1 < canceled multipart upload key=HXNC728XIWC1 upload=HO7171MLZRY9 tag=S207DQ693MMF type=write size=2756127 2024-09-12T00:24:18.323 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.323+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=8CBKY4WGTHHX type=write size=280464 2024-09-12T00:24:18.327 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.327+0000 7f0d199128c0 1 < completed write operation key=PK2CA62QBZXS tag=MA96MMB9E3DB type=write size=263654 2024-09-12T00:24:18.330 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.331+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=4O89ZU9E2UMM type=del size=1616467 2024-09-12T00:24:18.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.335+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~IUG94KG4AFUO.0 size=1048576 2024-09-12T00:24:18.337 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.335+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~IUG94KG4AFUO.1 size=1048576 2024-09-12T00:24:18.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.339+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~IUG94KG4AFUO.2 size=14091 2024-09-12T00:24:18.345 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.343+0000 7f0d199128c0 1 < completed multipart upload key=T6GOR4SBYU2Y upload=IUG94KG4AFUO tag=24099JHUVI19 type=write size=3159819 2024-09-12T00:24:18.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.355+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~RN88PVL8D33I.0 size=1048576 2024-09-12T00:24:18.357 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.359+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~RN88PVL8D33I.1 size=666300 2024-09-12T00:24:18.357 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.359+0000 7f0d199128c0 1 > prepared multipart upload key=37WTPAJGOX5L upload=RN88PVL8D33I tag=5XJ8Z89ONUZX type=write size=2763452 2024-09-12T00:24:18.361 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.359+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~0N18K6DDNKHS.0 size=363429 2024-09-12T00:24:18.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.367+0000 7f0d199128c0 1 < completed multipart upload key=FJ8YV026H0ZU upload=0N18K6DDNKHS tag=3K0P75H2IR0L type=write size=1412005 2024-09-12T00:24:18.372 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.371+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~FW9ZBJ8XWNLQ.0 size=136630 2024-09-12T00:24:18.372 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.371+0000 7f0d199128c0 1 > prepared multipart upload key=4K654PSDLDVI upload=FW9ZBJ8XWNLQ tag=2A1H8JG0RI32 type=write size=1185206 2024-09-12T00:24:18.376 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.375+0000 7f0d199128c0 1 < completed write operation key=PK2CA62QBZXS tag=QJY291EOSDTX type=write size=1025299 2024-09-12T00:24:18.379 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.379+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=B37FT298VDO7 type=write size=832252 2024-09-12T00:24:18.382 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.383+0000 7f0d199128c0 1 < completed delete operation key=1Y6B1MJP5G4L tag=F8XLZ9E2S273 type=del 2024-09-12T00:24:18.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.387+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=0ITNS8ODE23M type=write size=979988 2024-09-12T00:24:18.393 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.391+0000 7f0d199128c0 1 < suggested remove operation key=J75P0821XGRO tag=WAUDLF6U0F4I type=del 2024-09-12T00:24:18.399 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.399+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~GDGTUF20RI3L.0 size=958359 2024-09-12T00:24:18.399 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.399+0000 7f0d199128c0 1 > prepared multipart upload key=VXZI0ZTMQSV0 upload=GDGTUF20RI3L tag=R82PBL2MZGO7 type=write size=2006935 2024-09-12T00:24:18.406 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.407+0000 7f0d199128c0 1 < suggested remove operation key=ZWGD87Z1MMNK tag=ZYPA7NJT7FFJ type=del 2024-09-12T00:24:18.409 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.411+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=GI5UJRYYRY60 type=del size=2322149 2024-09-12T00:24:18.413 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.411+0000 7f0d199128c0 1 < completed delete operation key=B58RWC9W8THG tag=NVOPVT3RKZJN type=del 2024-09-12T00:24:18.417 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.415+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=MGDALNOUVD5A type=del size=3736585 2024-09-12T00:24:18.420 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.419+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~CHSGQ9B6IEP3.0 size=1048576 2024-09-12T00:24:18.423 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.423+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~CHSGQ9B6IEP3.1 size=768041 2024-09-12T00:24:18.429 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.427+0000 7f0d199128c0 1 < completed multipart upload key=NXQYUQIR2APT upload=CHSGQ9B6IEP3 tag=ND57SCN2XRD6 type=write size=2865193 2024-09-12T00:24:18.432 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.431+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=D1PM69QB7HXH type=write size=109514 2024-09-12T00:24:18.435 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.435+0000 7f0d199128c0 1 < completed write operation key=NXQYUQIR2APT tag=847FXXLNS2UZ type=write size=287843 2024-09-12T00:24:18.441 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.443+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~YXW9SFYJIL14.0 size=1048576 2024-09-12T00:24:18.444 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.443+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~YXW9SFYJIL14.1 size=1048576 2024-09-12T00:24:18.447 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.447+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~YXW9SFYJIL14.2 size=600311 2024-09-12T00:24:18.447 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.447+0000 7f0d199128c0 1 > prepared multipart upload key=1Y6B1MJP5G4L upload=YXW9SFYJIL14 tag=Y1RQ8M2Y3RIH type=write size=3746039 2024-09-12T00:24:18.450 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.451+0000 7f0d199128c0 -1 < failed to complete operation key=OVLAP0OS78QG tag=M17F1JEBPHOL type=del size=1111148: (22) Invalid argument 2024-09-12T00:24:18.456 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.455+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~02KE96DOVYD2.0 size=1048576 2024-09-12T00:24:18.459 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.459+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~02KE96DOVYD2.1 size=1048576 2024-09-12T00:24:18.462 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.463+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~02KE96DOVYD2.2 size=558402 2024-09-12T00:24:18.462 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.463+0000 7f0d199128c0 1 > prepared multipart upload key=OVLAP0OS78QG upload=02KE96DOVYD2 tag=CB1Y7UVVKSJ4 type=write size=3704130 2024-09-12T00:24:18.465 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.463+0000 7f0d199128c0 1 < completed write operation key=VXZI0ZTMQSV0 tag=8V2JF18GZ51A type=write size=501226 2024-09-12T00:24:18.469 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.467+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=WYWBZRZKB0WK type=del size=1345105 2024-09-12T00:24:18.472 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.471+0000 7f0d199128c0 1 < completed delete operation key=4K654PSDLDVI tag=RICR8U8TR7TT type=del 2024-09-12T00:24:18.475 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.475+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=0ISEWO3QSA6C type=del size=532967 2024-09-12T00:24:18.478 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.479+0000 7f0d199128c0 -1 < failed to complete operation key=J75P0821XGRO tag=OXA00IJ5F2LB type=del size=1697366: (22) Invalid argument 2024-09-12T00:24:18.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.483+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=VY9TF9KY9FVU type=write size=856636 2024-09-12T00:24:18.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.483+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~TDCQDVNA4XBC.0 size=1048576 2024-09-12T00:24:18.488 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.487+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~TDCQDVNA4XBC.1 size=1048576 2024-09-12T00:24:18.490 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.491+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~TDCQDVNA4XBC.2 size=30622 2024-09-12T00:24:18.496 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.495+0000 7f0d199128c0 1 < completed multipart upload key=ZWGD87Z1MMNK upload=TDCQDVNA4XBC tag=13SVCXYADU4R type=write size=3176350 2024-09-12T00:24:18.501 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.503+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~FKK7CBSYAV65.0 size=1048576 2024-09-12T00:24:18.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.503+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~FKK7CBSYAV65.1 size=481800 2024-09-12T00:24:18.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.503+0000 7f0d199128c0 1 > prepared multipart upload key=1Y6B1MJP5G4L upload=FKK7CBSYAV65 tag=34IJZUHAJTK1 type=write size=2578952 2024-09-12T00:24:18.507 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.507+0000 7f0d199128c0 1 < completed write operation key=HXNC728XIWC1 tag=8CBKY4WGTHHX type=write size=280464 2024-09-12T00:24:18.510 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.511+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=IR51X9D669P9 type=del size=3871552 2024-09-12T00:24:18.514 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.515+0000 7f0d199128c0 1 < completed delete operation key=GH0FNY2AI00G tag=4O89ZU9E2UMM type=del 2024-09-12T00:24:18.518 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.519+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=1EGCJBYR3VS8 type=del size=828896 2024-09-12T00:24:18.522 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.523+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~RN88PVL8D33I.0 size=1048576 2024-09-12T00:24:18.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.523+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~RN88PVL8D33I.1 size=666300 2024-09-12T00:24:18.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.531+0000 7f0d199128c0 1 < completed multipart upload key=37WTPAJGOX5L upload=RN88PVL8D33I tag=5XJ8Z89ONUZX type=write size=2763452 2024-09-12T00:24:18.536 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.535+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~YUH4OR3UPA1M.0 size=1048576 2024-09-12T00:24:18.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.539+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~YUH4OR3UPA1M.1 size=1048576 2024-09-12T00:24:18.541 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.539+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~YUH4OR3UPA1M.2 size=529911 2024-09-12T00:24:18.541 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.539+0000 7f0d199128c0 1 > prepared multipart upload key=NXQYUQIR2APT upload=YUH4OR3UPA1M tag=TXTUI9RAYIUM type=write size=3675639 2024-09-12T00:24:18.544 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.543+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~FW9ZBJ8XWNLQ.0 size=136630 2024-09-12T00:24:18.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.551+0000 7f0d199128c0 1 < completed multipart upload key=4K654PSDLDVI upload=FW9ZBJ8XWNLQ tag=2A1H8JG0RI32 type=write size=1185206 2024-09-12T00:24:18.556 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.555+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~8KGD14GEGG5C.0 size=1048576 2024-09-12T00:24:18.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.559+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~8KGD14GEGG5C.1 size=1048576 2024-09-12T00:24:18.561 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.559+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~8KGD14GEGG5C.2 size=852929 2024-09-12T00:24:18.561 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.559+0000 7f0d199128c0 1 > prepared multipart upload key=0EBWUENN0881 upload=8KGD14GEGG5C tag=4O2S01WKWCS7 type=write size=3998657 2024-09-12T00:24:18.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.563+0000 7f0d199128c0 1 < completed write operation key=QUO5ND3O41TY tag=B37FT298VDO7 type=write size=832252 2024-09-12T00:24:18.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.571+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~P115HPPHZ23K.0 size=994509 2024-09-12T00:24:18.571 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.571+0000 7f0d199128c0 1 > prepared multipart upload key=0EBWUENN0881 upload=P115HPPHZ23K tag=FBWU7M43NAUP type=write size=2043085 2024-09-12T00:24:18.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.575+0000 7f0d199128c0 1 < completed write operation key=WBGXMJB7U422 tag=0ITNS8ODE23M type=write size=979988 2024-09-12T00:24:18.578 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.579+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=5N4ENGTBCS13 type=del size=1469823 2024-09-12T00:24:18.581 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.583+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~GDGTUF20RI3L.0 size=958359 2024-09-12T00:24:18.587 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.587+0000 7f0d199128c0 1 < completed multipart upload key=VXZI0ZTMQSV0 upload=GDGTUF20RI3L tag=R82PBL2MZGO7 type=write size=2006935 2024-09-12T00:24:18.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.591+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=1G8LEJAO1U4J type=write size=663254 2024-09-12T00:24:18.594 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.595+0000 7f0d199128c0 1 < completed delete operation key=QUO5ND3O41TY tag=GI5UJRYYRY60 type=del 2024-09-12T00:24:18.597 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.595+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=TMJTSOPIFHDR type=del size=1890869 2024-09-12T00:24:18.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.603+0000 7f0d199128c0 1 < suggested update operation key=0ZT4NZYZKI5Z tag=MGDALNOUVD5A type=del size=3736585 2024-09-12T00:24:18.610 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.611+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~F3ME96SPUB7M.0 size=1048576 2024-09-12T00:24:18.613 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.611+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~F3ME96SPUB7M.1 size=1048576 2024-09-12T00:24:18.616 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.615+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~F3ME96SPUB7M.2 size=283885 2024-09-12T00:24:18.616 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.615+0000 7f0d199128c0 1 > prepared multipart upload key=0EBWUENN0881 upload=F3ME96SPUB7M tag=ZJ4W0W47XVKB type=write size=3429613 2024-09-12T00:24:18.619 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.619+0000 7f0d199128c0 1 < completed write operation key=NXQYUQIR2APT tag=D1PM69QB7HXH type=write size=109514 2024-09-12T00:24:18.622 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.623+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=0YQ26OU80RD4 type=del size=787300 2024-09-12T00:24:18.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.627+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~YXW9SFYJIL14.0 size=1048576 2024-09-12T00:24:18.628 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.627+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~YXW9SFYJIL14.1 size=1048576 2024-09-12T00:24:18.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.627+0000 7f0d199128c0 1 < canceled part key=_multipart_1Y6B1MJP5G4L.2~YXW9SFYJIL14.2 size=600311 2024-09-12T00:24:18.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.635+0000 7f0d199128c0 1 < canceled multipart upload key=1Y6B1MJP5G4L upload=YXW9SFYJIL14 tag=Y1RQ8M2Y3RIH type=write size=3746039 2024-09-12T00:24:18.638 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.639+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=008TYSXGQDM1 type=write size=1007667 2024-09-12T00:24:18.641 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.643+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~02KE96DOVYD2.0 size=1048576 2024-09-12T00:24:18.644 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.643+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~02KE96DOVYD2.1 size=1048576 2024-09-12T00:24:18.647 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.647+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~02KE96DOVYD2.2 size=558402 2024-09-12T00:24:18.653 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.651+0000 7f0d199128c0 1 < completed multipart upload key=OVLAP0OS78QG upload=02KE96DOVYD2 tag=CB1Y7UVVKSJ4 type=write size=3704130 2024-09-12T00:24:18.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.655+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=GS1BRVBYUBIH type=del size=1451636 2024-09-12T00:24:18.660 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.659+0000 7f0d199128c0 1 < completed delete operation key=2EK9CCKG26W2 tag=WYWBZRZKB0WK type=del 2024-09-12T00:24:18.669 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.671+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~DT1AOS0ME39Z.0 size=1048576 2024-09-12T00:24:18.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.671+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~DT1AOS0ME39Z.1 size=1048576 2024-09-12T00:24:18.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.675+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~DT1AOS0ME39Z.2 size=922792 2024-09-12T00:24:18.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.675+0000 7f0d199128c0 1 > prepared multipart upload key=2EK9CCKG26W2 upload=DT1AOS0ME39Z tag=JON2R65DVQ8D type=write size=4068520 2024-09-12T00:24:18.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.679+0000 7f0d199128c0 1 < suggested update operation key=IPJEXRBN96NB tag=0ISEWO3QSA6C type=del size=532967 2024-09-12T00:24:18.686 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.687+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~LZGCHQ3ZJPCP.0 size=1048576 2024-09-12T00:24:18.689 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.687+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~LZGCHQ3ZJPCP.1 size=1048576 2024-09-12T00:24:18.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.691+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~LZGCHQ3ZJPCP.2 size=14199 2024-09-12T00:24:18.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.691+0000 7f0d199128c0 1 > prepared multipart upload key=YTXW98O07966 upload=LZGCHQ3ZJPCP tag=25AK62SLOLG6 type=write size=3159927 2024-09-12T00:24:18.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.695+0000 7f0d199128c0 1 < completed write operation key=37WTPAJGOX5L tag=VY9TF9KY9FVU type=write size=856636 2024-09-12T00:24:18.699 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.699+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=8XQJYRIOJRBS type=del size=1511148 2024-09-12T00:24:18.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.703+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~FKK7CBSYAV65.0 size=1048576 2024-09-12T00:24:18.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.703+0000 7f0d199128c0 1 < canceled part key=_multipart_1Y6B1MJP5G4L.2~FKK7CBSYAV65.1 size=481800 2024-09-12T00:24:18.706 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.707+0000 7f0d199128c0 1 < canceled multipart upload key=1Y6B1MJP5G4L upload=FKK7CBSYAV65 tag=34IJZUHAJTK1 type=write size=2578952 2024-09-12T00:24:18.709 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.711+0000 7f0d199128c0 1 > prepared operation key=57W1IO3KSWBR tag=KPRL7PT0SIT3 type=del size=3893891 2024-09-12T00:24:18.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.711+0000 7f0d199128c0 -1 < failed to complete operation key=0ZT4NZYZKI5Z tag=IR51X9D669P9 type=del size=3871552: (22) Invalid argument 2024-09-12T00:24:18.715 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.715+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=W92OXMSLYLD8 type=del size=1658550 2024-09-12T00:24:18.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.719+0000 7f0d199128c0 1 < completed delete operation key=FJ8YV026H0ZU tag=1EGCJBYR3VS8 type=del 2024-09-12T00:24:18.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.723+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=B0EY1SA5OGSW type=del size=1451427 2024-09-12T00:24:18.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.723+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~YUH4OR3UPA1M.0 size=1048576 2024-09-12T00:24:18.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.727+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~YUH4OR3UPA1M.1 size=1048576 2024-09-12T00:24:18.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.727+0000 7f0d199128c0 1 < canceled part key=_multipart_NXQYUQIR2APT.2~YUH4OR3UPA1M.2 size=529911 2024-09-12T00:24:18.733 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.731+0000 7f0d199128c0 1 < canceled multipart upload key=NXQYUQIR2APT upload=YUH4OR3UPA1M tag=TXTUI9RAYIUM type=write size=3675639 2024-09-12T00:24:18.738 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.739+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~71EFL9811YWY.0 size=1048576 2024-09-12T00:24:18.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.739+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~71EFL9811YWY.1 size=927968 2024-09-12T00:24:18.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.739+0000 7f0d199128c0 1 > prepared multipart upload key=37WTPAJGOX5L upload=71EFL9811YWY tag=CRX6H1Q3VX8T type=write size=3025120 2024-09-12T00:24:18.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.743+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~8KGD14GEGG5C.0 size=1048576 2024-09-12T00:24:18.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.747+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~8KGD14GEGG5C.1 size=1048576 2024-09-12T00:24:18.749 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.747+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~8KGD14GEGG5C.2 size=852929 2024-09-12T00:24:18.755 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.755+0000 7f0d199128c0 1 < completed multipart upload key=0EBWUENN0881 upload=8KGD14GEGG5C tag=4O2S01WKWCS7 type=write size=3998657 2024-09-12T00:24:18.758 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.759+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=H4F113FDA75V type=del size=3045608 2024-09-12T00:24:18.762 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.763+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~P115HPPHZ23K.0 size=994509 2024-09-12T00:24:18.768 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.767+0000 7f0d199128c0 1 < completed multipart upload key=0EBWUENN0881 upload=P115HPPHZ23K tag=FBWU7M43NAUP type=write size=2043085 2024-09-12T00:24:18.770 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.771+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=6CTY0NY415WL type=del size=4012341 2024-09-12T00:24:18.774 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.775+0000 7f0d199128c0 1 < completed delete operation key=VXZI0ZTMQSV0 tag=5N4ENGTBCS13 type=del 2024-09-12T00:24:18.777 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.779+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=UX4XTF018CVG type=write size=407043 2024-09-12T00:24:18.781 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.779+0000 7f0d199128c0 1 < completed write operation key=JA6CSJF78VE2 tag=1G8LEJAO1U4J type=write size=663254 2024-09-12T00:24:18.787 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.787+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~9075C0EWTRZW.0 size=1048576 2024-09-12T00:24:18.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.791+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~9075C0EWTRZW.1 size=20202 2024-09-12T00:24:18.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.791+0000 7f0d199128c0 1 > prepared multipart upload key=NXQYUQIR2APT upload=9075C0EWTRZW tag=GS1MO89DUHCX type=write size=2117354 2024-09-12T00:24:18.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.795+0000 7f0d199128c0 1 < completed delete operation key=RX3RVT06SGJ4 tag=TMJTSOPIFHDR type=del 2024-09-12T00:24:18.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.799+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=4BIHA14L9TRX type=del size=3586070 2024-09-12T00:24:18.802 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.803+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~F3ME96SPUB7M.0 size=1048576 2024-09-12T00:24:18.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.803+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~F3ME96SPUB7M.1 size=1048576 2024-09-12T00:24:18.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.807+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~F3ME96SPUB7M.2 size=283885 2024-09-12T00:24:18.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.815+0000 7f0d199128c0 1 < completed multipart upload key=0EBWUENN0881 upload=F3ME96SPUB7M tag=ZJ4W0W47XVKB type=write size=3429613 2024-09-12T00:24:18.821 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.819+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~9B76COS5K8HS.0 size=953421 2024-09-12T00:24:18.821 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.819+0000 7f0d199128c0 1 > prepared multipart upload key=4K654PSDLDVI upload=9B76COS5K8HS tag=WTPV7BAC9U3O type=write size=2001997 2024-09-12T00:24:18.824 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.823+0000 7f0d199128c0 1 < completed delete operation key=B58RWC9W8THG tag=0YQ26OU80RD4 type=del 2024-09-12T00:24:18.828 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.827+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=HL3SQGP7VM4O type=write size=656177 2024-09-12T00:24:18.834 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.835+0000 7f0d199128c0 1 < suggested remove operation key=SITJU2EUVSR8 tag=008TYSXGQDM1 type=write 2024-09-12T00:24:18.838 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.839+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=0IDVRTTDEVW9 type=del size=446230 2024-09-12T00:24:18.841 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.843+0000 7f0d199128c0 1 < completed delete operation key=YTXW98O07966 tag=GS1BRVBYUBIH type=del 2024-09-12T00:24:18.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.843+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=HVSMUKLF47PJ type=del size=3106771 2024-09-12T00:24:18.848 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.847+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~DT1AOS0ME39Z.0 size=1048576 2024-09-12T00:24:18.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.851+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~DT1AOS0ME39Z.1 size=1048576 2024-09-12T00:24:18.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.855+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~DT1AOS0ME39Z.2 size=922792 2024-09-12T00:24:18.859 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.859+0000 7f0d199128c0 1 < completed multipart upload key=2EK9CCKG26W2 upload=DT1AOS0ME39Z tag=JON2R65DVQ8D type=write size=4068520 2024-09-12T00:24:18.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.863+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=YOC3GD84R0HF type=del size=697454 2024-09-12T00:24:18.867 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.867+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~LZGCHQ3ZJPCP.0 size=1048576 2024-09-12T00:24:18.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.871+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~LZGCHQ3ZJPCP.1 size=1048576 2024-09-12T00:24:18.873 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.871+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~LZGCHQ3ZJPCP.2 size=14199 2024-09-12T00:24:18.879 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.879+0000 7f0d199128c0 1 < completed multipart upload key=YTXW98O07966 upload=LZGCHQ3ZJPCP tag=25AK62SLOLG6 type=write size=3159927 2024-09-12T00:24:18.886 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.883+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~KOIMYGM76EK1.0 size=786301 2024-09-12T00:24:18.886 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.883+0000 7f0d199128c0 1 > prepared multipart upload key=NXQYUQIR2APT upload=KOIMYGM76EK1 tag=9RPY0AHWOJTI type=write size=1834877 2024-09-12T00:24:18.893 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.891+0000 7f0d199128c0 1 < suggested update operation key=ZWGD87Z1MMNK tag=8XQJYRIOJRBS type=del size=1511148 2024-09-12T00:24:18.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.899+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~MO1N6NPNJ6EM.0 size=1048576 2024-09-12T00:24:18.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.899+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~MO1N6NPNJ6EM.1 size=1048576 2024-09-12T00:24:18.904 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.903+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~MO1N6NPNJ6EM.2 size=937092 2024-09-12T00:24:18.904 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.903+0000 7f0d199128c0 1 > prepared multipart upload key=H604SA6XTFLY upload=MO1N6NPNJ6EM tag=0SKBE1ZV4OIQ type=write size=4082820 2024-09-12T00:24:18.907 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.907+0000 7f0d199128c0 1 < completed delete operation key=57W1IO3KSWBR tag=KPRL7PT0SIT3 type=del 2024-09-12T00:24:18.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.911+0000 7f0d199128c0 1 > prepared operation key=57W1IO3KSWBR tag=MMDV56HK4HOF type=del size=2862951 2024-09-12T00:24:18.915 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.915+0000 7f0d199128c0 1 < completed delete operation key=A529WOKFD1NI tag=W92OXMSLYLD8 type=del 2024-09-12T00:24:18.919 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.919+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=TOPJ1EAM6N2G type=write size=895644 2024-09-12T00:24:18.922 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.923+0000 7f0d199128c0 -1 < failed to complete operation key=ZWGD87Z1MMNK tag=B0EY1SA5OGSW type=del size=1451427: (22) Invalid argument 2024-09-12T00:24:18.928 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.927+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~IERRVNWUZFUA.0 size=1048576 2024-09-12T00:24:18.930 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.931+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~IERRVNWUZFUA.1 size=159126 2024-09-12T00:24:18.931 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.931+0000 7f0d199128c0 1 > prepared multipart upload key=10YEWZDTTEV0 upload=IERRVNWUZFUA tag=JTFU94NW1Y7T type=write size=2256278 2024-09-12T00:24:18.934 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.935+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~71EFL9811YWY.0 size=1048576 2024-09-12T00:24:18.936 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.935+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~71EFL9811YWY.1 size=927968 2024-09-12T00:24:18.941 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.943+0000 7f0d199128c0 1 < completed multipart upload key=37WTPAJGOX5L upload=71EFL9811YWY tag=CRX6H1Q3VX8T type=write size=3025120 2024-09-12T00:24:18.944 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.943+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=WIJG0FTFQJ3L type=del size=1193882 2024-09-12T00:24:18.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.947+0000 7f0d199128c0 1 < completed delete operation key=IPJEXRBN96NB tag=H4F113FDA75V type=del 2024-09-12T00:24:18.953 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.951+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~NXH0I6YOS97K.0 size=163484 2024-09-12T00:24:18.953 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.951+0000 7f0d199128c0 1 > prepared multipart upload key=0EBWUENN0881 upload=NXH0I6YOS97K tag=JH1JIK8NRQ6A type=write size=1212060 2024-09-12T00:24:18.956 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.955+0000 7f0d199128c0 -1 < failed to complete operation key=SITJU2EUVSR8 tag=6CTY0NY415WL type=del size=4012341: (22) Invalid argument 2024-09-12T00:24:18.959 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.959+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=6WMR3TK61HSI type=write size=73028 2024-09-12T00:24:18.962 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.963+0000 7f0d199128c0 1 < canceled operation key=4K654PSDLDVI tag=UX4XTF018CVG type=write size=407043 2024-09-12T00:24:18.968 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.967+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~4WXOI94HQ2NJ.0 size=1048576 2024-09-12T00:24:18.972 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.971+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~4WXOI94HQ2NJ.1 size=1048576 2024-09-12T00:24:18.976 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.975+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~4WXOI94HQ2NJ.2 size=757444 2024-09-12T00:24:18.976 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.975+0000 7f0d199128c0 1 > prepared multipart upload key=YTXW98O07966 upload=4WXOI94HQ2NJ tag=2HB9JSQI3RC0 type=write size=3903172 2024-09-12T00:24:18.979 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.979+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~9075C0EWTRZW.0 size=1048576 2024-09-12T00:24:18.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.983+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~9075C0EWTRZW.1 size=20202 2024-09-12T00:24:18.988 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.987+0000 7f0d199128c0 1 < completed multipart upload key=NXQYUQIR2APT upload=9075C0EWTRZW tag=GS1MO89DUHCX type=write size=2117354 2024-09-12T00:24:18.991 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.991+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=S3DOJKEDSQH6 type=del size=828687 2024-09-12T00:24:18.999 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:18.999+0000 7f0d199128c0 1 < suggested update operation key=QUO5ND3O41TY tag=4BIHA14L9TRX type=del size=3586070 2024-09-12T00:24:19.006 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.007+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~3CD41GR3L0X1.0 size=1048576 2024-09-12T00:24:19.008 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.007+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~3CD41GR3L0X1.1 size=916211 2024-09-12T00:24:19.008 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.007+0000 7f0d199128c0 1 > prepared multipart upload key=QUO5ND3O41TY upload=3CD41GR3L0X1 tag=5PCB5VIOBU7Y type=write size=3013363 2024-09-12T00:24:19.012 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.011+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~9B76COS5K8HS.0 size=953421 2024-09-12T00:24:19.017 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.015+0000 7f0d199128c0 1 < completed multipart upload key=4K654PSDLDVI upload=9B76COS5K8HS tag=WTPV7BAC9U3O type=write size=2001997 2024-09-12T00:24:19.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.023+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~WZ9V3CMX6DX3.0 size=1048576 2024-09-12T00:24:19.027 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.027+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~WZ9V3CMX6DX3.1 size=881183 2024-09-12T00:24:19.027 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.027+0000 7f0d199128c0 1 > prepared multipart upload key=57W1IO3KSWBR upload=WZ9V3CMX6DX3 tag=SCJ2FM1JZ2IJ type=write size=2978335 2024-09-12T00:24:19.032 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.031+0000 7f0d199128c0 1 < suggested update operation key=2EK9CCKG26W2 tag=HL3SQGP7VM4O type=write size=656177 2024-09-12T00:24:19.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.035+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=4WGZOHM77TVF type=del size=2386042 2024-09-12T00:24:19.040 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.039+0000 7f0d199128c0 1 < completed delete operation key=PK2CA62QBZXS tag=0IDVRTTDEVW9 type=del 2024-09-12T00:24:19.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.043+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=KATULKPQZ533 type=del size=2629367 2024-09-12T00:24:19.048 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.047+0000 7f0d199128c0 1 < completed delete operation key=NXQYUQIR2APT tag=HVSMUKLF47PJ type=del 2024-09-12T00:24:19.051 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.051+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=ZGRI0626K62H type=del size=333865 2024-09-12T00:24:19.058 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.059+0000 7f0d199128c0 1 < suggested remove operation key=H604SA6XTFLY tag=YOC3GD84R0HF type=del 2024-09-12T00:24:19.062 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.063+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=C9YHJ6LA8BLT type=del size=1219062 2024-09-12T00:24:19.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.063+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~KOIMYGM76EK1.0 size=786301 2024-09-12T00:24:19.071 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.071+0000 7f0d199128c0 1 < completed multipart upload key=NXQYUQIR2APT upload=KOIMYGM76EK1 tag=9RPY0AHWOJTI type=write size=1834877 2024-09-12T00:24:19.077 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.075+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~M9I1HHLE8RJG.0 size=1048576 2024-09-12T00:24:19.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.079+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~M9I1HHLE8RJG.1 size=1048576 2024-09-12T00:24:19.082 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.083+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~M9I1HHLE8RJG.2 size=51099 2024-09-12T00:24:19.082 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.083+0000 7f0d199128c0 1 > prepared multipart upload key=NXQYUQIR2APT upload=M9I1HHLE8RJG tag=NJJXH9EXFG8F type=write size=3196827 2024-09-12T00:24:19.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.087+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~MO1N6NPNJ6EM.0 size=1048576 2024-09-12T00:24:19.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.087+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~MO1N6NPNJ6EM.1 size=1048576 2024-09-12T00:24:19.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.091+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~MO1N6NPNJ6EM.2 size=937092 2024-09-12T00:24:19.096 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.095+0000 7f0d199128c0 1 < completed multipart upload key=H604SA6XTFLY upload=MO1N6NPNJ6EM tag=0SKBE1ZV4OIQ type=write size=4082820 2024-09-12T00:24:19.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.099+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=3OE8UXG17GNO type=del size=1908547 2024-09-12T00:24:19.103 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.103+0000 7f0d199128c0 1 < completed delete operation key=57W1IO3KSWBR tag=MMDV56HK4HOF type=del 2024-09-12T00:24:19.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.107+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=YXWQEIDFAM2B type=del size=3539522 2024-09-12T00:24:19.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.111+0000 7f0d199128c0 1 < completed write operation key=YTXW98O07966 tag=TOPJ1EAM6N2G type=write size=895644 2024-09-12T00:24:19.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.111+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=C4A2WZ9JXZUX type=del size=345337 2024-09-12T00:24:19.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.115+0000 7f0d199128c0 1 < canceled part key=_multipart_10YEWZDTTEV0.2~IERRVNWUZFUA.0 size=1048576 2024-09-12T00:24:19.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.115+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~IERRVNWUZFUA.1 size=159126 2024-09-12T00:24:19.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.123+0000 7f0d199128c0 1 < canceled multipart upload key=10YEWZDTTEV0 upload=IERRVNWUZFUA tag=JTFU94NW1Y7T type=write size=2256278 2024-09-12T00:24:19.126 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.127+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=H8BNWMZGKNYU type=del size=2762062 2024-09-12T00:24:19.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.131+0000 7f0d199128c0 1 < suggested remove operation key=0ZT4NZYZKI5Z tag=WIJG0FTFQJ3L type=del 2024-09-12T00:24:19.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.135+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=8QTETAVADM67 type=del size=1912131 2024-09-12T00:24:19.140 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.139+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~NXH0I6YOS97K.0 size=163484 2024-09-12T00:24:19.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.147+0000 7f0d199128c0 1 < completed multipart upload key=0EBWUENN0881 upload=NXH0I6YOS97K tag=JH1JIK8NRQ6A type=write size=1212060 2024-09-12T00:24:19.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.151+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=IES6MO6LHABX type=del size=2600294 2024-09-12T00:24:19.156 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.155+0000 7f0d199128c0 1 < suggested remove operation key=YTXW98O07966 tag=6WMR3TK61HSI type=write 2024-09-12T00:24:19.162 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.163+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~1HVBRN58W0ZR.0 size=1048576 2024-09-12T00:24:19.165 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.163+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~1HVBRN58W0ZR.1 size=319836 2024-09-12T00:24:19.165 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.163+0000 7f0d199128c0 1 > prepared multipart upload key=10YEWZDTTEV0 upload=1HVBRN58W0ZR tag=6E03ATANHQ3B type=write size=2416988 2024-09-12T00:24:19.169 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.167+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~4WXOI94HQ2NJ.0 size=1048576 2024-09-12T00:24:19.169 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.167+0000 7f0d199128c0 1 < canceled part key=_multipart_YTXW98O07966.2~4WXOI94HQ2NJ.1 size=1048576 2024-09-12T00:24:19.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.171+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~4WXOI94HQ2NJ.2 size=757444 2024-09-12T00:24:19.178 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.179+0000 7f0d199128c0 1 < canceled multipart upload key=YTXW98O07966 upload=4WXOI94HQ2NJ tag=2HB9JSQI3RC0 type=write size=3903172 2024-09-12T00:24:19.185 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.183+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~W00ZTZGBPFGU.0 size=1048576 2024-09-12T00:24:19.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.187+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~W00ZTZGBPFGU.1 size=28878 2024-09-12T00:24:19.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.187+0000 7f0d199128c0 1 > prepared multipart upload key=WPZOKZDFXK4S upload=W00ZTZGBPFGU tag=4BUE1Q3VZLPK type=write size=2126030 2024-09-12T00:24:19.191 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.191+0000 7f0d199128c0 1 < completed delete operation key=PK2CA62QBZXS tag=S3DOJKEDSQH6 type=del 2024-09-12T00:24:19.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.195+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=XH3E083TE4FR type=del size=3326831 2024-09-12T00:24:19.199 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.199+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~3CD41GR3L0X1.0 size=1048576 2024-09-12T00:24:19.202 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.203+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~3CD41GR3L0X1.1 size=916211 2024-09-12T00:24:19.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.207+0000 7f0d199128c0 1 < completed multipart upload key=QUO5ND3O41TY upload=3CD41GR3L0X1 tag=5PCB5VIOBU7Y type=write size=3013363 2024-09-12T00:24:19.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.211+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=JLOYLCTKKB6V type=del size=229800 2024-09-12T00:24:19.212 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.211+0000 7f0d199128c0 1 < canceled part key=_multipart_57W1IO3KSWBR.2~WZ9V3CMX6DX3.0 size=1048576 2024-09-12T00:24:19.215 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.215+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~WZ9V3CMX6DX3.1 size=881183 2024-09-12T00:24:19.221 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.219+0000 7f0d199128c0 1 < canceled multipart upload key=57W1IO3KSWBR upload=WZ9V3CMX6DX3 tag=SCJ2FM1JZ2IJ type=write size=2978335 2024-09-12T00:24:19.225 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.223+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=0WI643TVED3W type=del size=2210784 2024-09-12T00:24:19.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.227+0000 7f0d199128c0 1 < completed delete operation key=A529WOKFD1NI tag=4WGZOHM77TVF type=del 2024-09-12T00:24:19.232 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.231+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=7TLIZT7PWFLP type=del size=3711303 2024-09-12T00:24:19.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.235+0000 7f0d199128c0 1 < completed delete operation key=SITJU2EUVSR8 tag=KATULKPQZ533 type=del 2024-09-12T00:24:19.243 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.243+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~2XNQZJ3MHHDT.0 size=1048576 2024-09-12T00:24:19.245 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.247+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~2XNQZJ3MHHDT.1 size=440858 2024-09-12T00:24:19.246 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.247+0000 7f0d199128c0 1 > prepared multipart upload key=1Y6B1MJP5G4L upload=2XNQZJ3MHHDT tag=BEHAGCZFSK9E type=write size=2538010 2024-09-12T00:24:19.253 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.251+0000 7f0d199128c0 1 < suggested update operation key=V6H6S9X0U2A0 tag=ZGRI0626K62H type=del size=333865 2024-09-12T00:24:19.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.255+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~KQJ5IJ6O0HYF.0 size=1048576 2024-09-12T00:24:19.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.259+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~KQJ5IJ6O0HYF.1 size=1048576 2024-09-12T00:24:19.263 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.263+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~KQJ5IJ6O0HYF.2 size=195496 2024-09-12T00:24:19.263 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.263+0000 7f0d199128c0 1 > prepared multipart upload key=ZWGD87Z1MMNK upload=KQJ5IJ6O0HYF tag=2F0DE4O5BVCO type=write size=3341224 2024-09-12T00:24:19.266 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.267+0000 7f0d199128c0 1 < completed delete operation key=SITJU2EUVSR8 tag=C9YHJ6LA8BLT type=del 2024-09-12T00:24:19.272 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.271+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~2JDNTSA2UU2W.0 size=637376 2024-09-12T00:24:19.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.271+0000 7f0d199128c0 1 > prepared multipart upload key=4K654PSDLDVI upload=2JDNTSA2UU2W tag=L20177TXLT6H type=write size=1685952 2024-09-12T00:24:19.276 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.275+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~M9I1HHLE8RJG.0 size=1048576 2024-09-12T00:24:19.278 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.279+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~M9I1HHLE8RJG.1 size=1048576 2024-09-12T00:24:19.281 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.279+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~M9I1HHLE8RJG.2 size=51099 2024-09-12T00:24:19.286 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.287+0000 7f0d199128c0 1 < completed multipart upload key=NXQYUQIR2APT upload=M9I1HHLE8RJG tag=NJJXH9EXFG8F type=write size=3196827 2024-09-12T00:24:19.291 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.291+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~6DWBYFDCYV6H.0 size=1048576 2024-09-12T00:24:19.297 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.299+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~6DWBYFDCYV6H.1 size=906667 2024-09-12T00:24:19.297 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.299+0000 7f0d199128c0 1 > prepared multipart upload key=NXQYUQIR2APT upload=6DWBYFDCYV6H tag=5Z3SIBXIZ7LM type=write size=3003819 2024-09-12T00:24:19.301 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.299+0000 7f0d199128c0 1 < canceled operation key=T6GOR4SBYU2Y tag=3OE8UXG17GNO type=del size=1908547 2024-09-12T00:24:19.304 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.303+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=AE6XJHUT3074 type=del size=3068392 2024-09-12T00:24:19.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.307+0000 7f0d199128c0 1 < completed delete operation key=RFCHRGVA9GOI tag=YXWQEIDFAM2B type=del 2024-09-12T00:24:19.314 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.311+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~BXQWQEWCW5XG.0 size=1048576 2024-09-12T00:24:19.316 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.315+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~BXQWQEWCW5XG.1 size=134532 2024-09-12T00:24:19.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.315+0000 7f0d199128c0 1 > prepared multipart upload key=PK2CA62QBZXS upload=BXQWQEWCW5XG tag=RP5U5EQAMYYH type=write size=2231684 2024-09-12T00:24:19.322 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.323+0000 7f0d199128c0 1 < suggested update operation key=RX3RVT06SGJ4 tag=C4A2WZ9JXZUX type=del size=345337 2024-09-12T00:24:19.325 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.327+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=KM1FZB5ZDHX3 type=del size=3909928 2024-09-12T00:24:19.328 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.327+0000 7f0d199128c0 -1 < failed to complete operation key=0ZT4NZYZKI5Z tag=H8BNWMZGKNYU type=del size=2762062: (22) Invalid argument 2024-09-12T00:24:19.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.335+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~D83LWOC3HQTJ.0 size=1048576 2024-09-12T00:24:19.336 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.335+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~D83LWOC3HQTJ.1 size=1048576 2024-09-12T00:24:19.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.339+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~D83LWOC3HQTJ.2 size=10266 2024-09-12T00:24:19.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.339+0000 7f0d199128c0 1 > prepared multipart upload key=RX3RVT06SGJ4 upload=D83LWOC3HQTJ tag=AUZQ33BAA2G2 type=write size=3155994 2024-09-12T00:24:19.343 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.343+0000 7f0d199128c0 1 < completed delete operation key=FJ8YV026H0ZU tag=8QTETAVADM67 type=del 2024-09-12T00:24:19.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.347+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=EPHBTKDTW7A7 type=del size=3604585 2024-09-12T00:24:19.350 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.351+0000 7f0d199128c0 1 < completed delete operation key=H604SA6XTFLY tag=IES6MO6LHABX type=del 2024-09-12T00:24:19.353 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.355+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=DLFBXQDPZK1N type=del size=1690477 2024-09-12T00:24:19.357 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.355+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~1HVBRN58W0ZR.0 size=1048576 2024-09-12T00:24:19.359 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.359+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~1HVBRN58W0ZR.1 size=319836 2024-09-12T00:24:19.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.363+0000 7f0d199128c0 1 < completed multipart upload key=10YEWZDTTEV0 upload=1HVBRN58W0ZR tag=6E03ATANHQ3B type=write size=2416988 2024-09-12T00:24:19.368 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.367+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=OYQ6ZIS388TJ type=del size=3990351 2024-09-12T00:24:19.371 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.371+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~W00ZTZGBPFGU.0 size=1048576 2024-09-12T00:24:19.373 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.371+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~W00ZTZGBPFGU.1 size=28878 2024-09-12T00:24:19.380 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.379+0000 7f0d199128c0 1 < completed multipart upload key=WPZOKZDFXK4S upload=W00ZTZGBPFGU tag=4BUE1Q3VZLPK type=write size=2126030 2024-09-12T00:24:19.385 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.383+0000 7f0d199128c0 1 > prepared part key=_multipart_RFCHRGVA9GOI.2~U502OHVYIIZ0.0 size=1048576 2024-09-12T00:24:19.387 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.387+0000 7f0d199128c0 1 > prepared part key=_multipart_RFCHRGVA9GOI.2~U502OHVYIIZ0.1 size=523086 2024-09-12T00:24:19.388 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.387+0000 7f0d199128c0 1 > prepared multipart upload key=RFCHRGVA9GOI upload=U502OHVYIIZ0 tag=4A0T2E01IKCM type=write size=2620238 2024-09-12T00:24:19.391 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.391+0000 7f0d199128c0 1 < canceled operation key=IPJEXRBN96NB tag=XH3E083TE4FR type=del size=3326831 2024-09-12T00:24:19.395 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.395+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=PWTNX3EMYEJ9 type=del size=489941 2024-09-12T00:24:19.399 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.399+0000 7f0d199128c0 1 < completed delete operation key=IPJEXRBN96NB tag=JLOYLCTKKB6V type=del 2024-09-12T00:24:19.403 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.403+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=9Q4KV19M6KPO type=del size=1879023 2024-09-12T00:24:19.406 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.407+0000 7f0d199128c0 -1 < failed to complete operation key=V6H6S9X0U2A0 tag=0WI643TVED3W type=del size=2210784: (22) Invalid argument 2024-09-12T00:24:19.413 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.411+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~GI3DJD15OKSA.0 size=1048576 2024-09-12T00:24:19.416 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.415+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~GI3DJD15OKSA.1 size=316022 2024-09-12T00:24:19.416 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.415+0000 7f0d199128c0 1 > prepared multipart upload key=RX3RVT06SGJ4 upload=GI3DJD15OKSA tag=J4HCIYAVDV0V type=write size=2413174 2024-09-12T00:24:19.420 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.419+0000 7f0d199128c0 1 < completed delete operation key=B58RWC9W8THG tag=7TLIZT7PWFLP type=del 2024-09-12T00:24:19.426 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.427+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~O1603GMGORYW.0 size=1048576 2024-09-12T00:24:19.428 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.427+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~O1603GMGORYW.1 size=1048576 2024-09-12T00:24:19.431 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.431+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~O1603GMGORYW.2 size=93883 2024-09-12T00:24:19.431 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.431+0000 7f0d199128c0 1 > prepared multipart upload key=PK2CA62QBZXS upload=O1603GMGORYW tag=291JVY8IFF3Y type=write size=3239611 2024-09-12T00:24:19.432 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.431+0000 7f0d199128c0 1 < canceled part key=_multipart_1Y6B1MJP5G4L.2~2XNQZJ3MHHDT.0 size=1048576 2024-09-12T00:24:19.432 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.431+0000 7f0d199128c0 1 < canceled part key=_multipart_1Y6B1MJP5G4L.2~2XNQZJ3MHHDT.1 size=440858 2024-09-12T00:24:19.437 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.439+0000 7f0d199128c0 1 < canceled multipart upload key=1Y6B1MJP5G4L upload=2XNQZJ3MHHDT tag=BEHAGCZFSK9E type=write size=2538010 2024-09-12T00:24:19.441 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.439+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=6B6KJ0LPCU9W type=del size=3695393 2024-09-12T00:24:19.444 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.443+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~KQJ5IJ6O0HYF.0 size=1048576 2024-09-12T00:24:19.447 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.447+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~KQJ5IJ6O0HYF.1 size=1048576 2024-09-12T00:24:19.447 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.447+0000 7f0d199128c0 1 < canceled part key=_multipart_ZWGD87Z1MMNK.2~KQJ5IJ6O0HYF.2 size=195496 2024-09-12T00:24:19.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.451+0000 7f0d199128c0 1 < canceled multipart upload key=ZWGD87Z1MMNK upload=KQJ5IJ6O0HYF tag=2F0DE4O5BVCO type=write size=3341224 2024-09-12T00:24:19.459 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.459+0000 7f0d199128c0 1 > prepared part key=_multipart_RFCHRGVA9GOI.2~QZ4H29AJA63K.0 size=1048576 2024-09-12T00:24:19.461 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.459+0000 7f0d199128c0 1 > prepared part key=_multipart_RFCHRGVA9GOI.2~QZ4H29AJA63K.1 size=1048576 2024-09-12T00:24:19.463 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.463+0000 7f0d199128c0 1 > prepared part key=_multipart_RFCHRGVA9GOI.2~QZ4H29AJA63K.2 size=560221 2024-09-12T00:24:19.464 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.463+0000 7f0d199128c0 1 > prepared multipart upload key=RFCHRGVA9GOI upload=QZ4H29AJA63K tag=XZEHY3MBUUP8 type=write size=3705949 2024-09-12T00:24:19.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.467+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~2JDNTSA2UU2W.0 size=637376 2024-09-12T00:24:19.472 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.471+0000 7f0d199128c0 1 < completed multipart upload key=4K654PSDLDVI upload=2JDNTSA2UU2W tag=L20177TXLT6H type=write size=1685952 2024-09-12T00:24:19.475 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.475+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=LDH2PHBNK27A type=del size=760313 2024-09-12T00:24:19.479 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.479+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~6DWBYFDCYV6H.0 size=1048576 2024-09-12T00:24:19.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.483+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~6DWBYFDCYV6H.1 size=906667 2024-09-12T00:24:19.488 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.487+0000 7f0d199128c0 1 < completed multipart upload key=NXQYUQIR2APT upload=6DWBYFDCYV6H tag=5Z3SIBXIZ7LM type=write size=3003819 2024-09-12T00:24:19.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.491+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=MIYBFH04D48A type=del size=103929 2024-09-12T00:24:19.495 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.495+0000 7f0d199128c0 1 < completed delete operation key=0ZT4NZYZKI5Z tag=AE6XJHUT3074 type=del 2024-09-12T00:24:19.498 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.499+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=PSR1GB0Z02SO type=write size=728885 2024-09-12T00:24:19.499 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.499+0000 7f0d199128c0 1 < canceled part key=_multipart_PK2CA62QBZXS.2~BXQWQEWCW5XG.0 size=1048576 2024-09-12T00:24:19.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.503+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~BXQWQEWCW5XG.1 size=134532 2024-09-12T00:24:19.507 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.507+0000 7f0d199128c0 1 < canceled multipart upload key=PK2CA62QBZXS upload=BXQWQEWCW5XG tag=RP5U5EQAMYYH type=write size=2231684 2024-09-12T00:24:19.511 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.511+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=Y1ERIZXS3RCO type=del size=2423194 2024-09-12T00:24:19.514 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.515+0000 7f0d199128c0 1 < canceled operation key=NXQYUQIR2APT tag=KM1FZB5ZDHX3 type=del size=3909928 2024-09-12T00:24:19.518 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.519+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=JUU7MFISJ60D type=write size=994765 2024-09-12T00:24:19.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.519+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~D83LWOC3HQTJ.0 size=1048576 2024-09-12T00:24:19.523 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.523+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~D83LWOC3HQTJ.1 size=1048576 2024-09-12T00:24:19.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.527+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~D83LWOC3HQTJ.2 size=10266 2024-09-12T00:24:19.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.531+0000 7f0d199128c0 1 < completed multipart upload key=RX3RVT06SGJ4 upload=D83LWOC3HQTJ tag=AUZQ33BAA2G2 type=write size=3155994 2024-09-12T00:24:19.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.539+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~JJARNHGFZPV3.0 size=1048576 2024-09-12T00:24:19.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.539+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~JJARNHGFZPV3.1 size=428477 2024-09-12T00:24:19.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.539+0000 7f0d199128c0 1 > prepared multipart upload key=HXNC728XIWC1 upload=JJARNHGFZPV3 tag=VH79VROJQBL1 type=write size=2525629 2024-09-12T00:24:19.544 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.543+0000 7f0d199128c0 1 < completed delete operation key=0ZT4NZYZKI5Z tag=EPHBTKDTW7A7 type=del 2024-09-12T00:24:19.548 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.547+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=K8ODTBLVWDKZ type=del size=1418833 2024-09-12T00:24:19.554 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.555+0000 7f0d199128c0 1 < suggested remove operation key=V6H6S9X0U2A0 tag=DLFBXQDPZK1N type=del 2024-09-12T00:24:19.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.559+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=IQ09YOYD7M0Q type=del size=1819985 2024-09-12T00:24:19.561 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.559+0000 7f0d199128c0 1 < completed delete operation key=FJ8YV026H0ZU tag=OYQ6ZIS388TJ type=del 2024-09-12T00:24:19.567 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.567+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~PF8NR18R3H34.0 size=1048576 2024-09-12T00:24:19.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.571+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~PF8NR18R3H34.1 size=1048576 2024-09-12T00:24:19.573 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.571+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~PF8NR18R3H34.2 size=684832 2024-09-12T00:24:19.573 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.571+0000 7f0d199128c0 1 > prepared multipart upload key=V6H6S9X0U2A0 upload=PF8NR18R3H34 tag=3O1XKIL35IQP type=write size=3830560 2024-09-12T00:24:19.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.575+0000 7f0d199128c0 1 < completed part key=_multipart_RFCHRGVA9GOI.2~U502OHVYIIZ0.0 size=1048576 2024-09-12T00:24:19.579 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.579+0000 7f0d199128c0 1 < completed part key=_multipart_RFCHRGVA9GOI.2~U502OHVYIIZ0.1 size=523086 2024-09-12T00:24:19.584 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.583+0000 7f0d199128c0 1 < completed multipart upload key=RFCHRGVA9GOI upload=U502OHVYIIZ0 tag=4A0T2E01IKCM type=write size=2620238 2024-09-12T00:24:19.587 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.587+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=NGWM4A2HCNZB type=del size=2080534 2024-09-12T00:24:19.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.591+0000 7f0d199128c0 1 < completed delete operation key=PK2CA62QBZXS tag=PWTNX3EMYEJ9 type=del 2024-09-12T00:24:19.594 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.595+0000 7f0d199128c0 1 > prepared operation key=57W1IO3KSWBR tag=EU3F0KKAT1HH type=write size=429363 2024-09-12T00:24:19.601 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.599+0000 7f0d199128c0 1 < suggested update operation key=JA6CSJF78VE2 tag=9Q4KV19M6KPO type=del size=1879023 2024-09-12T00:24:19.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.603+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=6Z9392W6TFNK type=del size=1599206 2024-09-12T00:24:19.611 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.611+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~GI3DJD15OKSA.0 size=1048576 2024-09-12T00:24:19.614 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.615+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~GI3DJD15OKSA.1 size=316022 2024-09-12T00:24:19.619 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.619+0000 7f0d199128c0 1 < completed multipart upload key=RX3RVT06SGJ4 upload=GI3DJD15OKSA tag=J4HCIYAVDV0V type=write size=2413174 2024-09-12T00:24:19.622 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.623+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=7431E1H0Y9HF type=del size=1607998 2024-09-12T00:24:19.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.627+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~O1603GMGORYW.0 size=1048576 2024-09-12T00:24:19.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.627+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~O1603GMGORYW.1 size=1048576 2024-09-12T00:24:19.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.627+0000 7f0d199128c0 1 < canceled part key=_multipart_PK2CA62QBZXS.2~O1603GMGORYW.2 size=93883 2024-09-12T00:24:19.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.635+0000 7f0d199128c0 1 < canceled multipart upload key=PK2CA62QBZXS upload=O1603GMGORYW tag=291JVY8IFF3Y type=write size=3239611 2024-09-12T00:24:19.638 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.639+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=R454P01M0S0C type=write size=505764 2024-09-12T00:24:19.641 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.639+0000 7f0d199128c0 1 < completed delete operation key=2EK9CCKG26W2 tag=6B6KJ0LPCU9W type=del 2024-09-12T00:24:19.644 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.643+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=E2TUXV2JYXYB type=del size=4012283 2024-09-12T00:24:19.648 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.647+0000 7f0d199128c0 1 < completed part key=_multipart_RFCHRGVA9GOI.2~QZ4H29AJA63K.0 size=1048576 2024-09-12T00:24:19.651 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.651+0000 7f0d199128c0 1 < completed part key=_multipart_RFCHRGVA9GOI.2~QZ4H29AJA63K.1 size=1048576 2024-09-12T00:24:19.653 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.655+0000 7f0d199128c0 1 < completed part key=_multipart_RFCHRGVA9GOI.2~QZ4H29AJA63K.2 size=560221 2024-09-12T00:24:19.659 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.659+0000 7f0d199128c0 1 < completed multipart upload key=RFCHRGVA9GOI upload=QZ4H29AJA63K tag=XZEHY3MBUUP8 type=write size=3705949 2024-09-12T00:24:19.662 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.663+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=TRZEOBIBNS2Y type=del size=1892811 2024-09-12T00:24:19.666 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.667+0000 7f0d199128c0 1 < completed delete operation key=37WTPAJGOX5L tag=LDH2PHBNK27A type=del 2024-09-12T00:24:19.669 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.667+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=G0N3NCSA1JOF type=del size=2262102 2024-09-12T00:24:19.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.671+0000 7f0d199128c0 1 < completed delete operation key=4K654PSDLDVI tag=MIYBFH04D48A type=del 2024-09-12T00:24:19.676 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.675+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=EUSQHTUSYQOM type=del size=1640871 2024-09-12T00:24:19.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.683+0000 7f0d199128c0 1 < suggested remove operation key=4K654PSDLDVI tag=PSR1GB0Z02SO type=write 2024-09-12T00:24:19.689 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.691+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~38WSKCY32OZ4.0 size=221178 2024-09-12T00:24:19.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.691+0000 7f0d199128c0 1 > prepared multipart upload key=57W1IO3KSWBR upload=38WSKCY32OZ4 tag=T85IDVAEWI58 type=write size=1269754 2024-09-12T00:24:19.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.695+0000 7f0d199128c0 1 < canceled operation key=0ZT4NZYZKI5Z tag=Y1ERIZXS3RCO type=del size=2423194 2024-09-12T00:24:19.697 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.699+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=DT8UYN61CWH5 type=del size=894904 2024-09-12T00:24:19.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.703+0000 7f0d199128c0 1 < completed write operation key=WPZOKZDFXK4S tag=JUU7MFISJ60D type=write size=994765 2024-09-12T00:24:19.708 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.707+0000 7f0d199128c0 1 > prepared part key=_multipart_RFCHRGVA9GOI.2~50MKVYBGSJOG.0 size=1048576 2024-09-12T00:24:19.711 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.711+0000 7f0d199128c0 1 > prepared part key=_multipart_RFCHRGVA9GOI.2~50MKVYBGSJOG.1 size=1048576 2024-09-12T00:24:19.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.715+0000 7f0d199128c0 1 > prepared part key=_multipart_RFCHRGVA9GOI.2~50MKVYBGSJOG.2 size=792925 2024-09-12T00:24:19.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.715+0000 7f0d199128c0 1 > prepared multipart upload key=RFCHRGVA9GOI upload=50MKVYBGSJOG tag=ZQU2U2U6W1FI type=write size=3938653 2024-09-12T00:24:19.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.715+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~JJARNHGFZPV3.0 size=1048576 2024-09-12T00:24:19.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.719+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~JJARNHGFZPV3.1 size=428477 2024-09-12T00:24:19.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.727+0000 7f0d199128c0 1 < completed multipart upload key=HXNC728XIWC1 upload=JJARNHGFZPV3 tag=VH79VROJQBL1 type=write size=2525629 2024-09-12T00:24:19.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.731+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~0UYN1BGOH6V6.0 size=1048576 2024-09-12T00:24:19.733 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.735+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~0UYN1BGOH6V6.1 size=1048576 2024-09-12T00:24:19.736 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.735+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~0UYN1BGOH6V6.2 size=717509 2024-09-12T00:24:19.736 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.735+0000 7f0d199128c0 1 > prepared multipart upload key=RX3RVT06SGJ4 upload=0UYN1BGOH6V6 tag=70XL1OYTG6QJ type=write size=3863237 2024-09-12T00:24:19.742 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.743+0000 7f0d199128c0 1 < suggested update operation key=0EBWUENN0881 tag=K8ODTBLVWDKZ type=del size=1418833 2024-09-12T00:24:19.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.743+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=TPG5ZJOIWFNK type=del size=745462 2024-09-12T00:24:19.748 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.747+0000 7f0d199128c0 1 < completed delete operation key=IPJEXRBN96NB tag=IQ09YOYD7M0Q type=del 2024-09-12T00:24:19.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.751+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=D77RM7MRYZ7X type=del size=2733432 2024-09-12T00:24:19.755 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.755+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~PF8NR18R3H34.0 size=1048576 2024-09-12T00:24:19.757 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.755+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~PF8NR18R3H34.1 size=1048576 2024-09-12T00:24:19.760 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.759+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~PF8NR18R3H34.2 size=684832 2024-09-12T00:24:19.766 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.767+0000 7f0d199128c0 1 < completed multipart upload key=V6H6S9X0U2A0 upload=PF8NR18R3H34 tag=3O1XKIL35IQP type=write size=3830560 2024-09-12T00:24:19.772 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.771+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~GHL21XK1U6JQ.0 size=1048576 2024-09-12T00:24:19.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.775+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~GHL21XK1U6JQ.1 size=1048576 2024-09-12T00:24:19.778 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.779+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~GHL21XK1U6JQ.2 size=1027420 2024-09-12T00:24:19.778 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.779+0000 7f0d199128c0 1 > prepared multipart upload key=H604SA6XTFLY upload=GHL21XK1U6JQ tag=TLXJAZEWWCBB type=write size=4173148 2024-09-12T00:24:19.781 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.783+0000 7f0d199128c0 1 < completed delete operation key=V6H6S9X0U2A0 tag=NGWM4A2HCNZB type=del 2024-09-12T00:24:19.785 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.783+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=JOHA32YC1X10 type=del size=2662845 2024-09-12T00:24:19.789 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.787+0000 7f0d199128c0 1 < completed write operation key=57W1IO3KSWBR tag=EU3F0KKAT1HH type=write size=429363 2024-09-12T00:24:19.795 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.795+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~D5LH6P3OVH8N.0 size=1048576 2024-09-12T00:24:19.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.799+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~D5LH6P3OVH8N.1 size=650590 2024-09-12T00:24:19.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.799+0000 7f0d199128c0 1 > prepared multipart upload key=QUO5ND3O41TY upload=D5LH6P3OVH8N tag=JJ21LWT5YYZ3 type=write size=2747742 2024-09-12T00:24:19.801 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.799+0000 7f0d199128c0 1 < completed delete operation key=B58RWC9W8THG tag=6Z9392W6TFNK type=del 2024-09-12T00:24:19.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.803+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=5ZNKG1QO5TJB type=del size=3989225 2024-09-12T00:24:19.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.807+0000 7f0d199128c0 1 < canceled operation key=10YEWZDTTEV0 tag=7431E1H0Y9HF type=del size=1607998 2024-09-12T00:24:19.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.815+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~Y32OYN3OL0Y4.0 size=1048576 2024-09-12T00:24:19.817 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.815+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~Y32OYN3OL0Y4.1 size=1048576 2024-09-12T00:24:19.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.819+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~Y32OYN3OL0Y4.2 size=83997 2024-09-12T00:24:19.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.819+0000 7f0d199128c0 1 > prepared multipart upload key=FJ8YV026H0ZU upload=Y32OYN3OL0Y4 tag=3Z6D8UDJTL6W type=write size=3229725 2024-09-12T00:24:19.823 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.823+0000 7f0d199128c0 1 < completed write operation key=0ZT4NZYZKI5Z tag=R454P01M0S0C type=write size=505764 2024-09-12T00:24:19.826 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.827+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=32LIWGKQYO3M type=del size=1471667 2024-09-12T00:24:19.830 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.831+0000 7f0d199128c0 1 < completed delete operation key=10YEWZDTTEV0 tag=E2TUXV2JYXYB type=del 2024-09-12T00:24:19.837 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.835+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~JVM39QW70C9G.0 size=834332 2024-09-12T00:24:19.837 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.835+0000 7f0d199128c0 1 > prepared multipart upload key=4K654PSDLDVI upload=JVM39QW70C9G tag=N2N02EE6IOF1 type=write size=1882908 2024-09-12T00:24:19.843 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.843+0000 7f0d199128c0 1 < suggested remove operation key=WBGXMJB7U422 tag=TRZEOBIBNS2Y type=del 2024-09-12T00:24:19.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.847+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~D23QJF1UV8TS.0 size=959023 2024-09-12T00:24:19.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.847+0000 7f0d199128c0 1 > prepared multipart upload key=OVLAP0OS78QG upload=D23QJF1UV8TS tag=SN9Z54CSU89F type=write size=2007599 2024-09-12T00:24:19.852 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.851+0000 7f0d199128c0 1 < completed delete operation key=PK2CA62QBZXS tag=G0N3NCSA1JOF type=del 2024-09-12T00:24:19.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.855+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=VTJ4OEG8OQOE type=del size=609224 2024-09-12T00:24:19.859 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.859+0000 7f0d199128c0 1 < completed delete operation key=RX3RVT06SGJ4 tag=EUSQHTUSYQOM type=del 2024-09-12T00:24:19.865 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.863+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~L1N5MDCC1IVF.0 size=1048576 2024-09-12T00:24:19.868 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.867+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~L1N5MDCC1IVF.1 size=591333 2024-09-12T00:24:19.868 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.867+0000 7f0d199128c0 1 > prepared multipart upload key=57W1IO3KSWBR upload=L1N5MDCC1IVF tag=767OTSFBG3IT type=write size=2688485 2024-09-12T00:24:19.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.871+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~38WSKCY32OZ4.0 size=221178 2024-09-12T00:24:19.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.875+0000 7f0d199128c0 1 < completed multipart upload key=57W1IO3KSWBR upload=38WSKCY32OZ4 tag=T85IDVAEWI58 type=write size=1269754 2024-09-12T00:24:19.880 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.879+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=WGQCAKK0I0L6 type=del size=1762770 2024-09-12T00:24:19.883 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.883+0000 7f0d199128c0 1 < completed delete operation key=10YEWZDTTEV0 tag=DT8UYN61CWH5 type=del 2024-09-12T00:24:19.887 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.887+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=F14LVQRSYQ1P type=write size=1035271 2024-09-12T00:24:19.890 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.891+0000 7f0d199128c0 1 < completed part key=_multipart_RFCHRGVA9GOI.2~50MKVYBGSJOG.0 size=1048576 2024-09-12T00:24:19.893 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.891+0000 7f0d199128c0 1 < completed part key=_multipart_RFCHRGVA9GOI.2~50MKVYBGSJOG.1 size=1048576 2024-09-12T00:24:19.896 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.895+0000 7f0d199128c0 1 < completed part key=_multipart_RFCHRGVA9GOI.2~50MKVYBGSJOG.2 size=792925 2024-09-12T00:24:19.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.903+0000 7f0d199128c0 1 < completed multipart upload key=RFCHRGVA9GOI upload=50MKVYBGSJOG tag=ZQU2U2U6W1FI type=write size=3938653 2024-09-12T00:24:19.908 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.907+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~W5FJUHWXJMWS.0 size=331858 2024-09-12T00:24:19.908 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.907+0000 7f0d199128c0 1 > prepared multipart upload key=9I6MZAEUS4I0 upload=W5FJUHWXJMWS tag=D70E06GL4JL4 type=write size=1380434 2024-09-12T00:24:19.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.911+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~0UYN1BGOH6V6.0 size=1048576 2024-09-12T00:24:19.914 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.915+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~0UYN1BGOH6V6.1 size=1048576 2024-09-12T00:24:19.917 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.915+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~0UYN1BGOH6V6.2 size=717509 2024-09-12T00:24:19.927 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.927+0000 7f0d199128c0 1 < completed multipart upload key=RX3RVT06SGJ4 upload=0UYN1BGOH6V6 tag=70XL1OYTG6QJ type=write size=3863237 2024-09-12T00:24:19.930 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.931+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=P2WLBHNFC3NU type=del size=2213275 2024-09-12T00:24:19.933 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.935+0000 7f0d199128c0 -1 < failed to complete operation key=WBGXMJB7U422 tag=TPG5ZJOIWFNK type=del size=745462: (22) Invalid argument 2024-09-12T00:24:19.937 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.939+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=KG74DMOS91ZF type=del size=425963 2024-09-12T00:24:19.941 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.939+0000 7f0d199128c0 1 < completed delete operation key=B58RWC9W8THG tag=D77RM7MRYZ7X type=del 2024-09-12T00:24:19.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.947+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~OYG2ZTJAHZ94.0 size=1048576 2024-09-12T00:24:19.950 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.951+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~OYG2ZTJAHZ94.1 size=1048576 2024-09-12T00:24:19.953 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.951+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~OYG2ZTJAHZ94.2 size=618175 2024-09-12T00:24:19.953 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.951+0000 7f0d199128c0 1 > prepared multipart upload key=JA6CSJF78VE2 upload=OYG2ZTJAHZ94 tag=XQMMYCKQU5PD type=write size=3763903 2024-09-12T00:24:19.957 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.955+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~GHL21XK1U6JQ.0 size=1048576 2024-09-12T00:24:19.960 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.959+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~GHL21XK1U6JQ.1 size=1048576 2024-09-12T00:24:19.963 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.963+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~GHL21XK1U6JQ.2 size=1027420 2024-09-12T00:24:19.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.971+0000 7f0d199128c0 1 < completed multipart upload key=H604SA6XTFLY upload=GHL21XK1U6JQ tag=TLXJAZEWWCBB type=write size=4173148 2024-09-12T00:24:19.973 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.971+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=PUUF3A6SJ3QQ type=del size=1121388 2024-09-12T00:24:19.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.975+0000 7f0d199128c0 1 < completed delete operation key=0ZT4NZYZKI5Z tag=JOHA32YC1X10 type=del 2024-09-12T00:24:19.980 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.979+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=3BYVYTIG877K type=del size=2159769 2024-09-12T00:24:19.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.983+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~D5LH6P3OVH8N.0 size=1048576 2024-09-12T00:24:19.987 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.987+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~D5LH6P3OVH8N.1 size=650590 2024-09-12T00:24:19.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.995+0000 7f0d199128c0 1 < completed multipart upload key=QUO5ND3O41TY upload=D5LH6P3OVH8N tag=JJ21LWT5YYZ3 type=write size=2747742 2024-09-12T00:24:20.000 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:19.999+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~CMAYMPIO13NJ.0 size=1048576 2024-09-12T00:24:20.003 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.003+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~CMAYMPIO13NJ.1 size=95508 2024-09-12T00:24:20.003 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.003+0000 7f0d199128c0 1 > prepared multipart upload key=IPJEXRBN96NB upload=CMAYMPIO13NJ tag=KTTA5JJ8MSOG type=write size=2192660 2024-09-12T00:24:20.006 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.007+0000 7f0d199128c0 1 < canceled operation key=IPJEXRBN96NB tag=5ZNKG1QO5TJB type=del size=3989225 2024-09-12T00:24:20.011 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.011+0000 7f0d199128c0 1 > prepared part key=_multipart_RFCHRGVA9GOI.2~KEROI3V8OKL7.0 size=159842 2024-09-12T00:24:20.011 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.011+0000 7f0d199128c0 1 > prepared multipart upload key=RFCHRGVA9GOI upload=KEROI3V8OKL7 tag=8NL9ECSC3C1H type=write size=1208418 2024-09-12T00:24:20.014 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.015+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~Y32OYN3OL0Y4.0 size=1048576 2024-09-12T00:24:20.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.015+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~Y32OYN3OL0Y4.1 size=1048576 2024-09-12T00:24:20.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.015+0000 7f0d199128c0 1 < canceled part key=_multipart_FJ8YV026H0ZU.2~Y32OYN3OL0Y4.2 size=83997 2024-09-12T00:24:20.021 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.019+0000 7f0d199128c0 1 < canceled multipart upload key=FJ8YV026H0ZU upload=Y32OYN3OL0Y4 tag=3Z6D8UDJTL6W type=write size=3229725 2024-09-12T00:24:20.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.023+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=5YLI1T6TWJWY type=del size=3193597 2024-09-12T00:24:20.026 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.027+0000 7f0d199128c0 1 < canceled operation key=NXQYUQIR2APT tag=32LIWGKQYO3M type=del size=1471667 2024-09-12T00:24:20.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.027+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=EJVEH772TA2Z type=del size=2373022 2024-09-12T00:24:20.032 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.031+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~JVM39QW70C9G.0 size=834332 2024-09-12T00:24:20.037 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.035+0000 7f0d199128c0 1 < completed multipart upload key=4K654PSDLDVI upload=JVM39QW70C9G tag=N2N02EE6IOF1 type=write size=1882908 2024-09-12T00:24:20.040 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.039+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=2F1OGHPIPNTE type=write size=79846 2024-09-12T00:24:20.043 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.043+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~D23QJF1UV8TS.0 size=959023 2024-09-12T00:24:20.047 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.047+0000 7f0d199128c0 1 < completed multipart upload key=OVLAP0OS78QG upload=D23QJF1UV8TS tag=SN9Z54CSU89F type=write size=2007599 2024-09-12T00:24:20.053 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.051+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~A7OSC6PKWHM6.0 size=1048576 2024-09-12T00:24:20.055 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.055+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~A7OSC6PKWHM6.1 size=976092 2024-09-12T00:24:20.055 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.055+0000 7f0d199128c0 1 > prepared multipart upload key=VXZI0ZTMQSV0 upload=A7OSC6PKWHM6 tag=1KOJVPQAHR1P type=write size=3073244 2024-09-12T00:24:20.058 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.059+0000 7f0d199128c0 1 < completed delete operation key=GH0FNY2AI00G tag=VTJ4OEG8OQOE type=del 2024-09-12T00:24:20.061 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.059+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=02TIN4AV356C type=del size=1415659 2024-09-12T00:24:20.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.063+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~L1N5MDCC1IVF.0 size=1048576 2024-09-12T00:24:20.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.067+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~L1N5MDCC1IVF.1 size=591333 2024-09-12T00:24:20.071 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.071+0000 7f0d199128c0 1 < completed multipart upload key=57W1IO3KSWBR upload=L1N5MDCC1IVF tag=767OTSFBG3IT type=write size=2688485 2024-09-12T00:24:20.077 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.075+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~H2M1C8RGYT52.0 size=928053 2024-09-12T00:24:20.077 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.075+0000 7f0d199128c0 1 > prepared multipart upload key=2EK9CCKG26W2 upload=H2M1C8RGYT52 tag=Q2CSCJUP8IVB type=write size=1976629 2024-09-12T00:24:20.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.079+0000 7f0d199128c0 1 < canceled operation key=B58RWC9W8THG tag=WGQCAKK0I0L6 type=del size=1762770 2024-09-12T00:24:20.083 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.083+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=HWBWJVV08IJ0 type=del size=1233586 2024-09-12T00:24:20.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.087+0000 7f0d199128c0 1 < completed write operation key=WPZOKZDFXK4S tag=F14LVQRSYQ1P type=write size=1035271 2024-09-12T00:24:20.093 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.091+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~PQSENMZZBLMD.0 size=1048576 2024-09-12T00:24:20.096 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.095+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~PQSENMZZBLMD.1 size=471109 2024-09-12T00:24:20.096 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.095+0000 7f0d199128c0 1 > prepared multipart upload key=37WTPAJGOX5L upload=PQSENMZZBLMD tag=66GWPFRH3WQS type=write size=2568261 2024-09-12T00:24:20.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.099+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~W5FJUHWXJMWS.0 size=331858 2024-09-12T00:24:20.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.107+0000 7f0d199128c0 1 < completed multipart upload key=9I6MZAEUS4I0 upload=W5FJUHWXJMWS tag=D70E06GL4JL4 type=write size=1380434 2024-09-12T00:24:20.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.111+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=1TSWNUOPW60J type=del size=927092 2024-09-12T00:24:20.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.115+0000 7f0d199128c0 1 < completed delete operation key=ZWGD87Z1MMNK tag=P2WLBHNFC3NU type=del 2024-09-12T00:24:20.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.119+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=YXCF5KNHQVZQ type=del size=1542243 2024-09-12T00:24:20.121 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.119+0000 7f0d199128c0 1 < completed delete operation key=1Y6B1MJP5G4L tag=KG74DMOS91ZF type=del 2024-09-12T00:24:20.125 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.123+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=19LC5CAVQSGQ type=del size=324043 2024-09-12T00:24:20.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.127+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~OYG2ZTJAHZ94.0 size=1048576 2024-09-12T00:24:20.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.131+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~OYG2ZTJAHZ94.1 size=1048576 2024-09-12T00:24:20.135 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.135+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~OYG2ZTJAHZ94.2 size=618175 2024-09-12T00:24:20.140 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.139+0000 7f0d199128c0 1 < completed multipart upload key=JA6CSJF78VE2 upload=OYG2ZTJAHZ94 tag=XQMMYCKQU5PD type=write size=3763903 2024-09-12T00:24:20.144 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.143+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=VXOFEK5X5VJZ type=del size=3442355 2024-09-12T00:24:20.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.147+0000 7f0d199128c0 1 < completed delete operation key=WBGXMJB7U422 tag=PUUF3A6SJ3QQ type=del 2024-09-12T00:24:20.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.151+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~472NORHQFRM6.0 size=1048576 2024-09-12T00:24:20.155 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.155+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~472NORHQFRM6.1 size=1048576 2024-09-12T00:24:20.157 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.159+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~472NORHQFRM6.2 size=809084 2024-09-12T00:24:20.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.159+0000 7f0d199128c0 1 > prepared multipart upload key=FJ8YV026H0ZU upload=472NORHQFRM6 tag=PWJXDUYRHRNJ type=write size=3954812 2024-09-12T00:24:20.162 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.159+0000 7f0d199128c0 1 < completed delete operation key=ZWGD87Z1MMNK tag=3BYVYTIG877K type=del 2024-09-12T00:24:20.164 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.163+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=V3IKHEU2M7XK type=del size=3397424 2024-09-12T00:24:20.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.167+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~CMAYMPIO13NJ.0 size=1048576 2024-09-12T00:24:20.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.171+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~CMAYMPIO13NJ.1 size=95508 2024-09-12T00:24:20.175 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.175+0000 7f0d199128c0 1 < completed multipart upload key=IPJEXRBN96NB upload=CMAYMPIO13NJ tag=KTTA5JJ8MSOG type=write size=2192660 2024-09-12T00:24:20.180 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.179+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~K8LB6JQVQ2TD.0 size=428230 2024-09-12T00:24:20.181 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.179+0000 7f0d199128c0 1 > prepared multipart upload key=T6GOR4SBYU2Y upload=K8LB6JQVQ2TD tag=7EWJVFR2YUIQ type=write size=1476806 2024-09-12T00:24:20.184 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.183+0000 7f0d199128c0 1 < completed part key=_multipart_RFCHRGVA9GOI.2~KEROI3V8OKL7.0 size=159842 2024-09-12T00:24:20.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.187+0000 7f0d199128c0 1 < completed multipart upload key=RFCHRGVA9GOI upload=KEROI3V8OKL7 tag=8NL9ECSC3C1H type=write size=1208418 2024-09-12T00:24:20.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.195+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~671U3Z6N3CH3.0 size=254143 2024-09-12T00:24:20.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.195+0000 7f0d199128c0 1 > prepared multipart upload key=57W1IO3KSWBR upload=671U3Z6N3CH3 tag=6PB23XAN6YFF type=write size=1302719 2024-09-12T00:24:20.202 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.199+0000 7f0d199128c0 1 < completed delete operation key=ZWGD87Z1MMNK tag=5YLI1T6TWJWY type=del 2024-09-12T00:24:20.204 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.203+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~YKU1PKZ4OPNW.0 size=282983 2024-09-12T00:24:20.204 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.203+0000 7f0d199128c0 1 > prepared multipart upload key=HXNC728XIWC1 upload=YKU1PKZ4OPNW tag=96Z4FZDFUJHW type=write size=1331559 2024-09-12T00:24:20.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.211+0000 7f0d199128c0 1 < suggested remove operation key=ZWGD87Z1MMNK tag=EJVEH772TA2Z type=del 2024-09-12T00:24:20.214 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.215+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=S2W71MPG5PQY type=del size=1466761 2024-09-12T00:24:20.217 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.215+0000 7f0d199128c0 1 < completed write operation key=9I6MZAEUS4I0 tag=2F1OGHPIPNTE type=write size=79846 2024-09-12T00:24:20.220 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.219+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=1N3X6TY6GPM4 type=del size=610517 2024-09-12T00:24:20.224 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.223+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~A7OSC6PKWHM6.0 size=1048576 2024-09-12T00:24:20.224 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.223+0000 7f0d199128c0 1 < canceled part key=_multipart_VXZI0ZTMQSV0.2~A7OSC6PKWHM6.1 size=976092 2024-09-12T00:24:20.232 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.231+0000 7f0d199128c0 1 < canceled multipart upload key=VXZI0ZTMQSV0 upload=A7OSC6PKWHM6 tag=1KOJVPQAHR1P type=write size=3073244 2024-09-12T00:24:20.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.235+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=A6KASO8C9KGW type=del size=2716096 2024-09-12T00:24:20.239 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.239+0000 7f0d199128c0 1 < completed delete operation key=IPJEXRBN96NB tag=02TIN4AV356C type=del 2024-09-12T00:24:20.243 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.243+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=4NMBR6RQRIX0 type=del size=2762628 2024-09-12T00:24:20.246 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.247+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~H2M1C8RGYT52.0 size=928053 2024-09-12T00:24:20.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.251+0000 7f0d199128c0 1 < completed multipart upload key=2EK9CCKG26W2 upload=H2M1C8RGYT52 tag=Q2CSCJUP8IVB type=write size=1976629 2024-09-12T00:24:20.255 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.255+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=0LP3OJB9OVHP type=del size=2358773 2024-09-12T00:24:20.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.259+0000 7f0d199128c0 1 < completed delete operation key=H604SA6XTFLY tag=HWBWJVV08IJ0 type=del 2024-09-12T00:24:20.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.263+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~Z69RCWW4GEKL.0 size=1048576 2024-09-12T00:24:20.268 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.267+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~Z69RCWW4GEKL.1 size=284532 2024-09-12T00:24:20.268 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.267+0000 7f0d199128c0 1 > prepared multipart upload key=H604SA6XTFLY upload=Z69RCWW4GEKL tag=YP45G5DLOG5B type=write size=2381684 2024-09-12T00:24:20.269 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.267+0000 7f0d199128c0 1 < canceled part key=_multipart_37WTPAJGOX5L.2~PQSENMZZBLMD.0 size=1048576 2024-09-12T00:24:20.272 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.271+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~PQSENMZZBLMD.1 size=471109 2024-09-12T00:24:20.278 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.279+0000 7f0d199128c0 1 < canceled multipart upload key=37WTPAJGOX5L upload=PQSENMZZBLMD tag=66GWPFRH3WQS type=write size=2568261 2024-09-12T00:24:20.284 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.283+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~LL21VLQTYXNE.0 size=1048576 2024-09-12T00:24:20.287 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.287+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~LL21VLQTYXNE.1 size=1048576 2024-09-12T00:24:20.290 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.291+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~LL21VLQTYXNE.2 size=807104 2024-09-12T00:24:20.290 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.291+0000 7f0d199128c0 1 > prepared multipart upload key=0EBWUENN0881 upload=LL21VLQTYXNE tag=8J377JQR3MVE type=write size=3952832 2024-09-12T00:24:20.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.295+0000 7f0d199128c0 1 < completed delete operation key=SITJU2EUVSR8 tag=1TSWNUOPW60J type=del 2024-09-12T00:24:20.298 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.299+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=EGNSH9IUTNWN type=write size=734764 2024-09-12T00:24:20.301 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.303+0000 7f0d199128c0 1 < completed delete operation key=A529WOKFD1NI tag=YXCF5KNHQVZQ type=del 2024-09-12T00:24:20.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.303+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=BLWPD001997X type=del size=1158059 2024-09-12T00:24:20.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.307+0000 7f0d199128c0 1 < completed delete operation key=HXNC728XIWC1 tag=19LC5CAVQSGQ type=del 2024-09-12T00:24:20.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.315+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~UY0XRCBEFCDU.0 size=1048576 2024-09-12T00:24:20.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.319+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~UY0XRCBEFCDU.1 size=1048576 2024-09-12T00:24:20.320 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.319+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~UY0XRCBEFCDU.2 size=4204 2024-09-12T00:24:20.320 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.319+0000 7f0d199128c0 1 > prepared multipart upload key=0EBWUENN0881 upload=UY0XRCBEFCDU tag=7RSZO4LMOFQ8 type=write size=3149932 2024-09-12T00:24:20.323 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.323+0000 7f0d199128c0 1 < completed delete operation key=HXNC728XIWC1 tag=VXOFEK5X5VJZ type=del 2024-09-12T00:24:20.327 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.327+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=OW59F1IFIC9L type=del size=1382021 2024-09-12T00:24:20.327 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.327+0000 7f0d199128c0 1 < canceled part key=_multipart_FJ8YV026H0ZU.2~472NORHQFRM6.0 size=1048576 2024-09-12T00:24:20.330 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.331+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~472NORHQFRM6.1 size=1048576 2024-09-12T00:24:20.332 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.331+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~472NORHQFRM6.2 size=809084 2024-09-12T00:24:20.338 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.339+0000 7f0d199128c0 1 < canceled multipart upload key=FJ8YV026H0ZU upload=472NORHQFRM6 tag=PWJXDUYRHRNJ type=write size=3954812 2024-09-12T00:24:20.342 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.343+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=BQFFLLE4XPX0 type=del size=951360 2024-09-12T00:24:20.345 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.347+0000 7f0d199128c0 1 < completed delete operation key=QUO5ND3O41TY tag=V3IKHEU2M7XK type=del 2024-09-12T00:24:20.349 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.347+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=JPK1Z6D3OIOP type=del size=3445077 2024-09-12T00:24:20.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.351+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~K8LB6JQVQ2TD.0 size=428230 2024-09-12T00:24:20.357 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.359+0000 7f0d199128c0 1 < completed multipart upload key=T6GOR4SBYU2Y upload=K8LB6JQVQ2TD tag=7EWJVFR2YUIQ type=write size=1476806 2024-09-12T00:24:20.361 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.359+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=NWH2U6WTTABT type=del size=2448191 2024-09-12T00:24:20.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.363+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~671U3Z6N3CH3.0 size=254143 2024-09-12T00:24:20.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.371+0000 7f0d199128c0 1 < completed multipart upload key=57W1IO3KSWBR upload=671U3Z6N3CH3 tag=6PB23XAN6YFF type=write size=1302719 2024-09-12T00:24:20.376 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.375+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~63RDVAFMXHQO.0 size=297965 2024-09-12T00:24:20.376 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.375+0000 7f0d199128c0 1 > prepared multipart upload key=FJ8YV026H0ZU upload=63RDVAFMXHQO tag=IVWMSFKVHQT5 type=write size=1346541 2024-09-12T00:24:20.379 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.379+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~YKU1PKZ4OPNW.0 size=282983 2024-09-12T00:24:20.385 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.383+0000 7f0d199128c0 1 < completed multipart upload key=HXNC728XIWC1 upload=YKU1PKZ4OPNW tag=96Z4FZDFUJHW type=write size=1331559 2024-09-12T00:24:20.388 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.387+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=MNYA1BEORLK2 type=del size=3699089 2024-09-12T00:24:20.392 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.391+0000 7f0d199128c0 1 < completed delete operation key=B58RWC9W8THG tag=S2W71MPG5PQY type=del 2024-09-12T00:24:20.398 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.399+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~UQ88H0AQEW5T.0 size=1048576 2024-09-12T00:24:20.401 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.399+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~UQ88H0AQEW5T.1 size=1048576 2024-09-12T00:24:20.404 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.403+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~UQ88H0AQEW5T.2 size=269495 2024-09-12T00:24:20.404 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.403+0000 7f0d199128c0 1 > prepared multipart upload key=GH0FNY2AI00G upload=UQ88H0AQEW5T tag=VM0HQRZTZY0I type=write size=3415223 2024-09-12T00:24:20.408 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.407+0000 7f0d199128c0 1 < completed delete operation key=WBGXMJB7U422 tag=1N3X6TY6GPM4 type=del 2024-09-12T00:24:20.415 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.415+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~O0FABS4RMV1J.0 size=1048576 2024-09-12T00:24:20.417 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.415+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~O0FABS4RMV1J.1 size=712085 2024-09-12T00:24:20.417 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.415+0000 7f0d199128c0 1 > prepared multipart upload key=WPZOKZDFXK4S upload=O0FABS4RMV1J tag=25UKYDY4045V type=write size=2809237 2024-09-12T00:24:20.421 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.419+0000 7f0d199128c0 1 < completed delete operation key=OVLAP0OS78QG tag=A6KASO8C9KGW type=del 2024-09-12T00:24:20.427 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.427+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~5NY8AJFKL1KA.0 size=1046504 2024-09-12T00:24:20.427 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.427+0000 7f0d199128c0 1 > prepared multipart upload key=YTXW98O07966 upload=5NY8AJFKL1KA tag=54HCK2LNVUC4 type=write size=2095080 2024-09-12T00:24:20.431 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.431+0000 7f0d199128c0 1 < completed delete operation key=SITJU2EUVSR8 tag=4NMBR6RQRIX0 type=del 2024-09-12T00:24:20.434 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.435+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=Z64O9H6KDI4X type=del size=3726919 2024-09-12T00:24:20.438 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.439+0000 7f0d199128c0 1 < completed delete operation key=OVLAP0OS78QG tag=0LP3OJB9OVHP type=del 2024-09-12T00:24:20.441 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.439+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=NUSG7MLDM1HL type=del size=2342342 2024-09-12T00:24:20.450 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.447+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~Z69RCWW4GEKL.0 size=1048576 2024-09-12T00:24:20.450 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.447+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~Z69RCWW4GEKL.1 size=284532 2024-09-12T00:24:20.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.455+0000 7f0d199128c0 1 < completed multipart upload key=H604SA6XTFLY upload=Z69RCWW4GEKL tag=YP45G5DLOG5B type=write size=2381684 2024-09-12T00:24:20.461 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.459+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~A0UEJY2R9N8B.0 size=1048576 2024-09-12T00:24:20.464 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.463+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~A0UEJY2R9N8B.1 size=6012 2024-09-12T00:24:20.464 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.463+0000 7f0d199128c0 1 > prepared multipart upload key=0EBWUENN0881 upload=A0UEJY2R9N8B tag=4CMK1WZ2F31R type=write size=2103164 2024-09-12T00:24:20.467 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.467+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~LL21VLQTYXNE.0 size=1048576 2024-09-12T00:24:20.470 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.471+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~LL21VLQTYXNE.1 size=1048576 2024-09-12T00:24:20.473 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.471+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~LL21VLQTYXNE.2 size=807104 2024-09-12T00:24:20.478 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.479+0000 7f0d199128c0 1 < completed multipart upload key=0EBWUENN0881 upload=LL21VLQTYXNE tag=8J377JQR3MVE type=write size=3952832 2024-09-12T00:24:20.481 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.479+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=N25SI9C680DK type=write size=778693 2024-09-12T00:24:20.488 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.487+0000 7f0d199128c0 1 < suggested remove operation key=0EBWUENN0881 tag=EGNSH9IUTNWN type=write 2024-09-12T00:24:20.491 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.491+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=4YZFWTLIGM77 type=del size=1552777 2024-09-12T00:24:20.494 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.495+0000 7f0d199128c0 1 < completed delete operation key=SITJU2EUVSR8 tag=BLWPD001997X type=del 2024-09-12T00:24:20.500 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.499+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~L94UT3YGZNVO.0 size=1048576 2024-09-12T00:24:20.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.503+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~L94UT3YGZNVO.1 size=1048576 2024-09-12T00:24:20.505 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.503+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~L94UT3YGZNVO.2 size=455957 2024-09-12T00:24:20.505 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.503+0000 7f0d199128c0 1 > prepared multipart upload key=YTXW98O07966 upload=L94UT3YGZNVO tag=RPEN7UP144YR type=write size=3601685 2024-09-12T00:24:20.508 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.507+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~UY0XRCBEFCDU.0 size=1048576 2024-09-12T00:24:20.511 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.511+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~UY0XRCBEFCDU.1 size=1048576 2024-09-12T00:24:20.514 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.515+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~UY0XRCBEFCDU.2 size=4204 2024-09-12T00:24:20.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.519+0000 7f0d199128c0 1 < completed multipart upload key=0EBWUENN0881 upload=UY0XRCBEFCDU tag=7RSZO4LMOFQ8 type=write size=3149932 2024-09-12T00:24:20.524 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.523+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=ZMB55GF6UL81 type=del size=1443223 2024-09-12T00:24:20.527 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.527+0000 7f0d199128c0 1 < completed delete operation key=4K654PSDLDVI tag=OW59F1IFIC9L type=del 2024-09-12T00:24:20.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.531+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=CJDP5VT2VKCA type=del size=2081740 2024-09-12T00:24:20.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.535+0000 7f0d199128c0 1 < completed delete operation key=SITJU2EUVSR8 tag=BQFFLLE4XPX0 type=del 2024-09-12T00:24:20.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.539+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=U4FGF4XEJ8H3 type=del size=22988 2024-09-12T00:24:20.542 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.543+0000 7f0d199128c0 1 < completed delete operation key=0ZT4NZYZKI5Z tag=JPK1Z6D3OIOP type=del 2024-09-12T00:24:20.546 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.547+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=EJVSRD0CH823 type=write size=538961 2024-09-12T00:24:20.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.551+0000 7f0d199128c0 1 < completed delete operation key=T6GOR4SBYU2Y tag=NWH2U6WTTABT type=del 2024-09-12T00:24:20.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.555+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=V0LU3FIFBV83 type=del size=3547070 2024-09-12T00:24:20.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.559+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~63RDVAFMXHQO.0 size=297965 2024-09-12T00:24:20.567 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.567+0000 7f0d199128c0 1 < completed multipart upload key=FJ8YV026H0ZU upload=63RDVAFMXHQO tag=IVWMSFKVHQT5 type=write size=1346541 2024-09-12T00:24:20.571 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.571+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=YJ8YVRYPNCWI type=del size=2761656 2024-09-12T00:24:20.575 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.575+0000 7f0d199128c0 1 < completed delete operation key=GH0FNY2AI00G tag=MNYA1BEORLK2 type=del 2024-09-12T00:24:20.579 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.579+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=1BM7ZVSUCMP1 type=del size=932218 2024-09-12T00:24:20.584 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.583+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~UQ88H0AQEW5T.0 size=1048576 2024-09-12T00:24:20.587 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.587+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~UQ88H0AQEW5T.1 size=1048576 2024-09-12T00:24:20.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.591+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~UQ88H0AQEW5T.2 size=269495 2024-09-12T00:24:20.598 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.599+0000 7f0d199128c0 1 < completed multipart upload key=GH0FNY2AI00G upload=UQ88H0AQEW5T tag=VM0HQRZTZY0I type=write size=3415223 2024-09-12T00:24:20.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.603+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=1GHUDZM6B9X0 type=del size=2602180 2024-09-12T00:24:20.606 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.607+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~O0FABS4RMV1J.0 size=1048576 2024-09-12T00:24:20.609 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.607+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~O0FABS4RMV1J.1 size=712085 2024-09-12T00:24:20.615 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.615+0000 7f0d199128c0 1 < completed multipart upload key=WPZOKZDFXK4S upload=O0FABS4RMV1J tag=25UKYDY4045V type=write size=2809237 2024-09-12T00:24:20.618 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.619+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=5V8SIK81Y8XQ type=del size=1996348 2024-09-12T00:24:20.622 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.623+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~5NY8AJFKL1KA.0 size=1046504 2024-09-12T00:24:20.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.627+0000 7f0d199128c0 1 < completed multipart upload key=YTXW98O07966 upload=5NY8AJFKL1KA tag=54HCK2LNVUC4 type=write size=2095080 2024-09-12T00:24:20.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.635+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~B2QPR5SEWR8O.0 size=1048576 2024-09-12T00:24:20.637 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.635+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~B2QPR5SEWR8O.1 size=1048576 2024-09-12T00:24:20.639 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.639+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~B2QPR5SEWR8O.2 size=619219 2024-09-12T00:24:20.639 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.639+0000 7f0d199128c0 1 > prepared multipart upload key=T6GOR4SBYU2Y upload=B2QPR5SEWR8O tag=YWM7H511RD2R type=write size=3764947 2024-09-12T00:24:20.642 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.643+0000 7f0d199128c0 1 < canceled operation key=4K654PSDLDVI tag=Z64O9H6KDI4X type=del size=3726919 2024-09-12T00:24:20.646 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.647+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=5T3JWNE3I267 type=del size=4061823 2024-09-12T00:24:20.650 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.651+0000 7f0d199128c0 1 < completed delete operation key=1Y6B1MJP5G4L tag=NUSG7MLDM1HL type=del 2024-09-12T00:24:20.653 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.651+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=3PV210L2N7AC type=write size=317577 2024-09-12T00:24:20.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.655+0000 7f0d199128c0 1 < canceled part key=_multipart_0EBWUENN0881.2~A0UEJY2R9N8B.0 size=1048576 2024-09-12T00:24:20.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.655+0000 7f0d199128c0 1 < canceled part key=_multipart_0EBWUENN0881.2~A0UEJY2R9N8B.1 size=6012 2024-09-12T00:24:20.660 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.659+0000 7f0d199128c0 1 < canceled multipart upload key=0EBWUENN0881 upload=A0UEJY2R9N8B tag=4CMK1WZ2F31R type=write size=2103164 2024-09-12T00:24:20.663 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.663+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=1DT595B4EUAZ type=del size=2229064 2024-09-12T00:24:20.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.667+0000 7f0d199128c0 1 < completed write operation key=V6H6S9X0U2A0 tag=N25SI9C680DK type=write size=778693 2024-09-12T00:24:20.671 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.671+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=H1VBH0WZ0QEP type=del size=3811961 2024-09-12T00:24:20.675 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.675+0000 7f0d199128c0 1 < canceled operation key=0EBWUENN0881 tag=4YZFWTLIGM77 type=del size=1552777 2024-09-12T00:24:20.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.679+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=C9MQ4WCU5FS9 type=del size=3162225 2024-09-12T00:24:20.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.683+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~L94UT3YGZNVO.0 size=1048576 2024-09-12T00:24:20.686 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.687+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~L94UT3YGZNVO.1 size=1048576 2024-09-12T00:24:20.686 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.687+0000 7f0d199128c0 1 < canceled part key=_multipart_YTXW98O07966.2~L94UT3YGZNVO.2 size=455957 2024-09-12T00:24:20.691 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.691+0000 7f0d199128c0 1 < canceled multipart upload key=YTXW98O07966 upload=L94UT3YGZNVO tag=RPEN7UP144YR type=write size=3601685 2024-09-12T00:24:20.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.695+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=79CZJQE6JRA2 type=del size=84055 2024-09-12T00:24:20.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.703+0000 7f0d199128c0 1 < suggested update operation key=JA6CSJF78VE2 tag=ZMB55GF6UL81 type=del size=1443223 2024-09-12T00:24:20.708 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.707+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~NG4TED1RWHOK.0 size=937433 2024-09-12T00:24:20.708 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.707+0000 7f0d199128c0 1 > prepared multipart upload key=HXNC728XIWC1 upload=NG4TED1RWHOK tag=JK048UMQW8BW type=write size=1986009 2024-09-12T00:24:20.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.711+0000 7f0d199128c0 -1 < failed to complete operation key=JA6CSJF78VE2 tag=CJDP5VT2VKCA type=del size=2081740: (22) Invalid argument 2024-09-12T00:24:20.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.715+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=H0HN2OPTR9RH type=del size=3129440 2024-09-12T00:24:20.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.719+0000 7f0d199128c0 1 < completed delete operation key=SITJU2EUVSR8 tag=U4FGF4XEJ8H3 type=del 2024-09-12T00:24:20.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.723+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=KVA1P8QLBLDP type=write size=974661 2024-09-12T00:24:20.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.727+0000 7f0d199128c0 1 < completed write operation key=OVLAP0OS78QG tag=EJVSRD0CH823 type=write size=538961 2024-09-12T00:24:20.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.731+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=NZJCRPM5AGKN type=write size=279717 2024-09-12T00:24:20.733 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.731+0000 7f0d199128c0 1 < completed delete operation key=ZWGD87Z1MMNK tag=V0LU3FIFBV83 type=del 2024-09-12T00:24:20.739 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.739+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~PAAELJGCSYF7.0 size=1048576 2024-09-12T00:24:20.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.743+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~PAAELJGCSYF7.1 size=928902 2024-09-12T00:24:20.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.743+0000 7f0d199128c0 1 > prepared multipart upload key=A529WOKFD1NI upload=PAAELJGCSYF7 tag=ZOMPGLK0SQH5 type=write size=3026054 2024-09-12T00:24:20.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.743+0000 7f0d199128c0 1 < canceled operation key=10YEWZDTTEV0 tag=YJ8YVRYPNCWI type=del size=2761656 2024-09-12T00:24:20.748 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.747+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=9Y7OB13Z2TMV type=del size=1714053 2024-09-12T00:24:20.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.751+0000 7f0d199128c0 1 < completed delete operation key=H604SA6XTFLY tag=1BM7ZVSUCMP1 type=del 2024-09-12T00:24:20.754 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.755+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=JL8VQ22F1EWP type=del size=206132 2024-09-12T00:24:20.758 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.759+0000 7f0d199128c0 1 < completed delete operation key=A529WOKFD1NI tag=1GHUDZM6B9X0 type=del 2024-09-12T00:24:20.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.759+0000 7f0d199128c0 1 > prepared operation key=57W1IO3KSWBR tag=16B3LTHNWGIR type=del size=1581428 2024-09-12T00:24:20.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.763+0000 7f0d199128c0 1 < completed delete operation key=FJ8YV026H0ZU tag=5V8SIK81Y8XQ type=del 2024-09-12T00:24:20.770 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.771+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~66FLU1EEK3VC.0 size=602606 2024-09-12T00:24:20.770 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.771+0000 7f0d199128c0 1 > prepared multipart upload key=VXZI0ZTMQSV0 upload=66FLU1EEK3VC tag=SOR7IMBBG4SX type=write size=1651182 2024-09-12T00:24:20.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.771+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~B2QPR5SEWR8O.0 size=1048576 2024-09-12T00:24:20.776 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.775+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~B2QPR5SEWR8O.1 size=1048576 2024-09-12T00:24:20.778 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.779+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~B2QPR5SEWR8O.2 size=619219 2024-09-12T00:24:20.785 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.783+0000 7f0d199128c0 1 < completed multipart upload key=T6GOR4SBYU2Y upload=B2QPR5SEWR8O tag=YWM7H511RD2R type=write size=3764947 2024-09-12T00:24:20.788 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.787+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=7TJYZJAAUFNF type=del size=1836968 2024-09-12T00:24:20.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.791+0000 7f0d199128c0 1 < completed delete operation key=B58RWC9W8THG tag=5T3JWNE3I267 type=del 2024-09-12T00:24:20.796 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.795+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=B8QRQ8GLX0GC type=del size=3308238 2024-09-12T00:24:20.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.799+0000 7f0d199128c0 1 < completed write operation key=0EBWUENN0881 tag=3PV210L2N7AC type=write size=317577 2024-09-12T00:24:20.803 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.803+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=DU7OMWIT44UX type=write size=173348 2024-09-12T00:24:20.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.811+0000 7f0d199128c0 1 < suggested remove operation key=QUO5ND3O41TY tag=1DT595B4EUAZ type=del 2024-09-12T00:24:20.817 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.819+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~IZWH2I43E14V.0 size=1048576 2024-09-12T00:24:20.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.819+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~IZWH2I43E14V.1 size=65657 2024-09-12T00:24:20.821 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.819+0000 7f0d199128c0 1 > prepared multipart upload key=A529WOKFD1NI upload=IZWH2I43E14V tag=IKABUM8KBASD type=write size=2162809 2024-09-12T00:24:20.824 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.823+0000 7f0d199128c0 1 < completed delete operation key=NXQYUQIR2APT tag=H1VBH0WZ0QEP type=del 2024-09-12T00:24:20.827 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.827+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=1J68ZXNXTDP2 type=write size=836009 2024-09-12T00:24:20.831 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.831+0000 7f0d199128c0 1 < completed delete operation key=H604SA6XTFLY tag=C9MQ4WCU5FS9 type=del 2024-09-12T00:24:20.834 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.835+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=GXAC3NUT1OHC type=write size=752090 2024-09-12T00:24:20.838 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.839+0000 7f0d199128c0 1 < completed delete operation key=WPZOKZDFXK4S tag=79CZJQE6JRA2 type=del 2024-09-12T00:24:20.844 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.843+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~1L06REBS5RUR.0 size=347195 2024-09-12T00:24:20.844 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.843+0000 7f0d199128c0 1 > prepared multipart upload key=V6H6S9X0U2A0 upload=1L06REBS5RUR tag=PCFEWUUTTUWP type=write size=1395771 2024-09-12T00:24:20.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.843+0000 7f0d199128c0 1 < canceled part key=_multipart_HXNC728XIWC1.2~NG4TED1RWHOK.0 size=937433 2024-09-12T00:24:20.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.851+0000 7f0d199128c0 1 < canceled multipart upload key=HXNC728XIWC1 upload=NG4TED1RWHOK tag=JK048UMQW8BW type=write size=1986009 2024-09-12T00:24:20.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.855+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=4A8R4Z27RVER type=del size=2616568 2024-09-12T00:24:20.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.859+0000 7f0d199128c0 1 < completed delete operation key=37WTPAJGOX5L tag=H0HN2OPTR9RH type=del 2024-09-12T00:24:20.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.859+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=SJP949YR3P4I type=del size=363416 2024-09-12T00:24:20.865 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.863+0000 7f0d199128c0 1 < completed write operation key=4K654PSDLDVI tag=KVA1P8QLBLDP type=write size=974661 2024-09-12T00:24:20.872 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.871+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~20B34015D6DK.0 size=997801 2024-09-12T00:24:20.872 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.871+0000 7f0d199128c0 1 > prepared multipart upload key=B58RWC9W8THG upload=20B34015D6DK tag=W6PVD7C3FTNE type=write size=2046377 2024-09-12T00:24:20.876 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.875+0000 7f0d199128c0 1 < canceled operation key=9I6MZAEUS4I0 tag=NZJCRPM5AGKN type=write size=279717 2024-09-12T00:24:20.882 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.883+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~0441UG8PSHT6.0 size=1048576 2024-09-12T00:24:20.885 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.883+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~0441UG8PSHT6.1 size=427445 2024-09-12T00:24:20.885 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.883+0000 7f0d199128c0 1 > prepared multipart upload key=37WTPAJGOX5L upload=0441UG8PSHT6 tag=UNEGIZB4KM5S type=write size=2524597 2024-09-12T00:24:20.889 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.887+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~PAAELJGCSYF7.0 size=1048576 2024-09-12T00:24:20.891 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.891+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~PAAELJGCSYF7.1 size=928902 2024-09-12T00:24:20.900 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.899+0000 7f0d199128c0 1 < completed multipart upload key=A529WOKFD1NI upload=PAAELJGCSYF7 tag=ZOMPGLK0SQH5 type=write size=3026054 2024-09-12T00:24:20.903 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.903+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=HZ6PSKGSGNA3 type=del size=1069226 2024-09-12T00:24:20.909 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.911+0000 7f0d199128c0 1 < suggested update operation key=JA6CSJF78VE2 tag=9Y7OB13Z2TMV type=del size=1714053 2024-09-12T00:24:20.912 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.911+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=GE9JL11UIVXQ type=del size=4078095 2024-09-12T00:24:20.915 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.915+0000 7f0d199128c0 1 < completed delete operation key=V6H6S9X0U2A0 tag=JL8VQ22F1EWP type=del 2024-09-12T00:24:20.919 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.919+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=0WJVC1YJCYL8 type=del size=3904890 2024-09-12T00:24:20.922 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.923+0000 7f0d199128c0 1 < completed delete operation key=57W1IO3KSWBR tag=16B3LTHNWGIR type=del 2024-09-12T00:24:20.928 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.927+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~PZVM0XPJQD74.0 size=983232 2024-09-12T00:24:20.928 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.927+0000 7f0d199128c0 1 > prepared multipart upload key=HXNC728XIWC1 upload=PZVM0XPJQD74 tag=W0P3X93VSJJ2 type=write size=2031808 2024-09-12T00:24:20.931 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.931+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~66FLU1EEK3VC.0 size=602606 2024-09-12T00:24:20.936 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.935+0000 7f0d199128c0 1 < completed multipart upload key=VXZI0ZTMQSV0 upload=66FLU1EEK3VC tag=SOR7IMBBG4SX type=write size=1651182 2024-09-12T00:24:20.940 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.939+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=6CPZPOJEIKGU type=write size=318475 2024-09-12T00:24:20.944 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.943+0000 7f0d199128c0 1 < completed delete operation key=SITJU2EUVSR8 tag=7TJYZJAAUFNF type=del 2024-09-12T00:24:20.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.947+0000 7f0d199128c0 1 > prepared part key=_multipart_RFCHRGVA9GOI.2~JL9PLVENFKPR.0 size=1048576 2024-09-12T00:24:20.951 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.951+0000 7f0d199128c0 1 > prepared part key=_multipart_RFCHRGVA9GOI.2~JL9PLVENFKPR.1 size=1048576 2024-09-12T00:24:20.953 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.955+0000 7f0d199128c0 1 > prepared part key=_multipart_RFCHRGVA9GOI.2~JL9PLVENFKPR.2 size=569812 2024-09-12T00:24:20.954 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.955+0000 7f0d199128c0 1 > prepared multipart upload key=RFCHRGVA9GOI upload=JL9PLVENFKPR tag=E0PI74JE5X13 type=write size=3715540 2024-09-12T00:24:20.957 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.955+0000 7f0d199128c0 1 < completed delete operation key=9I6MZAEUS4I0 tag=B8QRQ8GLX0GC type=del 2024-09-12T00:24:20.961 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.959+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=79H0GX9W70TI type=write size=426661 2024-09-12T00:24:20.964 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.963+0000 7f0d199128c0 -1 < failed to complete operation key=QUO5ND3O41TY tag=DU7OMWIT44UX type=write size=173348: (22) Invalid argument 2024-09-12T00:24:20.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.971+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~UD678PG9REIS.0 size=814430 2024-09-12T00:24:20.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.971+0000 7f0d199128c0 1 > prepared multipart upload key=WPZOKZDFXK4S upload=UD678PG9REIS tag=06ND95AT7PHE type=write size=1863006 2024-09-12T00:24:20.973 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.975+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~IZWH2I43E14V.0 size=1048576 2024-09-12T00:24:20.976 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.975+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~IZWH2I43E14V.1 size=65657 2024-09-12T00:24:20.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.979+0000 7f0d199128c0 1 < completed multipart upload key=A529WOKFD1NI upload=IZWH2I43E14V tag=IKABUM8KBASD type=write size=2162809 2024-09-12T00:24:20.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.983+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=PM27UJPW5DGM type=del size=3537847 2024-09-12T00:24:20.988 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.987+0000 7f0d199128c0 1 < completed write operation key=QUO5ND3O41TY tag=1J68ZXNXTDP2 type=write size=836009 2024-09-12T00:24:20.991 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.991+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=CJOZP71RQRBT type=del size=3720516 2024-09-12T00:24:20.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.995+0000 7f0d199128c0 1 < completed write operation key=IPJEXRBN96NB tag=GXAC3NUT1OHC type=write size=752090 2024-09-12T00:24:20.999 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:20.999+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~02HR13P294OL.0 size=1048576 2024-09-12T00:24:21.002 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.003+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~02HR13P294OL.1 size=1048576 2024-09-12T00:24:21.005 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.003+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~02HR13P294OL.2 size=721784 2024-09-12T00:24:21.005 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.003+0000 7f0d199128c0 1 > prepared multipart upload key=VXZI0ZTMQSV0 upload=02HR13P294OL tag=U1XFDCJFYK1D type=write size=3867512 2024-09-12T00:24:21.008 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.007+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~1L06REBS5RUR.0 size=347195 2024-09-12T00:24:21.013 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.011+0000 7f0d199128c0 1 < completed multipart upload key=V6H6S9X0U2A0 upload=1L06REBS5RUR tag=PCFEWUUTTUWP type=write size=1395771 2024-09-12T00:24:21.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.015+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=7LD5H50IOO64 type=write size=662646 2024-09-12T00:24:21.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.023+0000 7f0d199128c0 1 < suggested update operation key=V6H6S9X0U2A0 tag=4A8R4Z27RVER type=del size=2616568 2024-09-12T00:24:21.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.027+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~3FGZ1FY7OP9J.0 size=141246 2024-09-12T00:24:21.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.027+0000 7f0d199128c0 1 > prepared multipart upload key=T6GOR4SBYU2Y upload=3FGZ1FY7OP9J tag=CLVXIJ75RMT1 type=write size=1189822 2024-09-12T00:24:21.032 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.031+0000 7f0d199128c0 1 < completed delete operation key=WPZOKZDFXK4S tag=SJP949YR3P4I type=del 2024-09-12T00:24:21.035 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.035+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=D25JTK9RW99Z type=del size=2666166 2024-09-12T00:24:21.038 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.039+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~20B34015D6DK.0 size=997801 2024-09-12T00:24:21.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.043+0000 7f0d199128c0 1 < completed multipart upload key=B58RWC9W8THG upload=20B34015D6DK tag=W6PVD7C3FTNE type=write size=2046377 2024-09-12T00:24:21.049 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.047+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~BYFMZTQP77NB.0 size=383382 2024-09-12T00:24:21.049 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.047+0000 7f0d199128c0 1 > prepared multipart upload key=1Y6B1MJP5G4L upload=BYFMZTQP77NB tag=W1DR7L0NHWAE type=write size=1431958 2024-09-12T00:24:21.052 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.051+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~0441UG8PSHT6.0 size=1048576 2024-09-12T00:24:21.055 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.055+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~0441UG8PSHT6.1 size=427445 2024-09-12T00:24:21.061 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.059+0000 7f0d199128c0 1 < completed multipart upload key=37WTPAJGOX5L upload=0441UG8PSHT6 tag=UNEGIZB4KM5S type=write size=2524597 2024-09-12T00:24:21.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.067+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~E7KEH18M2ZZ6.0 size=1048576 2024-09-12T00:24:21.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.067+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~E7KEH18M2ZZ6.1 size=1048576 2024-09-12T00:24:21.071 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.071+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~E7KEH18M2ZZ6.2 size=493115 2024-09-12T00:24:21.071 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.071+0000 7f0d199128c0 1 > prepared multipart upload key=1Y6B1MJP5G4L upload=E7KEH18M2ZZ6 tag=M2EMJ0T4QMQ2 type=write size=3638843 2024-09-12T00:24:21.075 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.075+0000 7f0d199128c0 1 < completed delete operation key=GH0FNY2AI00G tag=HZ6PSKGSGNA3 type=del 2024-09-12T00:24:21.081 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.079+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~I172R1171SQS.0 size=1048576 2024-09-12T00:24:21.083 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.083+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~I172R1171SQS.1 size=1048576 2024-09-12T00:24:21.086 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.087+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~I172R1171SQS.2 size=719303 2024-09-12T00:24:21.086 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.087+0000 7f0d199128c0 1 > prepared multipart upload key=V6H6S9X0U2A0 upload=I172R1171SQS tag=OWXQNLDBBNTF type=write size=3865031 2024-09-12T00:24:21.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.087+0000 7f0d199128c0 1 < completed delete operation key=JA6CSJF78VE2 tag=GE9JL11UIVXQ type=del 2024-09-12T00:24:21.092 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.091+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=W2W1OTCL27KZ type=del size=545221 2024-09-12T00:24:21.096 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.095+0000 7f0d199128c0 1 < completed delete operation key=IPJEXRBN96NB tag=0WJVC1YJCYL8 type=del 2024-09-12T00:24:21.102 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.103+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~0J3CZLUZFZJ7.0 size=52410 2024-09-12T00:24:21.102 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.103+0000 7f0d199128c0 1 > prepared multipart upload key=SITJU2EUVSR8 upload=0J3CZLUZFZJ7 tag=JYRM7Q8V2ZA7 type=write size=1100986 2024-09-12T00:24:21.105 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.103+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~PZVM0XPJQD74.0 size=983232 2024-09-12T00:24:21.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.111+0000 7f0d199128c0 1 < completed multipart upload key=HXNC728XIWC1 upload=PZVM0XPJQD74 tag=W0P3X93VSJJ2 type=write size=2031808 2024-09-12T00:24:21.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.115+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=BYAZ65G0F0HF type=write size=630615 2024-09-12T00:24:21.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.115+0000 7f0d199128c0 1 < canceled operation key=37WTPAJGOX5L tag=6CPZPOJEIKGU type=write size=318475 2024-09-12T00:24:21.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.123+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~I880P0CO8QWG.0 size=1048576 2024-09-12T00:24:21.125 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.123+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~I880P0CO8QWG.1 size=1048576 2024-09-12T00:24:21.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.127+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~I880P0CO8QWG.2 size=514845 2024-09-12T00:24:21.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.127+0000 7f0d199128c0 1 > prepared multipart upload key=PK2CA62QBZXS upload=I880P0CO8QWG tag=N2JI0XZ19L1V type=write size=3660573 2024-09-12T00:24:21.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.131+0000 7f0d199128c0 1 < completed part key=_multipart_RFCHRGVA9GOI.2~JL9PLVENFKPR.0 size=1048576 2024-09-12T00:24:21.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.135+0000 7f0d199128c0 1 < completed part key=_multipart_RFCHRGVA9GOI.2~JL9PLVENFKPR.1 size=1048576 2024-09-12T00:24:21.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.135+0000 7f0d199128c0 1 < completed part key=_multipart_RFCHRGVA9GOI.2~JL9PLVENFKPR.2 size=569812 2024-09-12T00:24:21.143 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.143+0000 7f0d199128c0 1 < completed multipart upload key=RFCHRGVA9GOI upload=JL9PLVENFKPR tag=E0PI74JE5X13 type=write size=3715540 2024-09-12T00:24:21.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.147+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~7527POJ0QIGF.0 size=1048576 2024-09-12T00:24:21.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.151+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~7527POJ0QIGF.1 size=425797 2024-09-12T00:24:21.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.151+0000 7f0d199128c0 1 > prepared multipart upload key=GH0FNY2AI00G upload=7527POJ0QIGF tag=DSNQR2BE4EHT type=write size=2522949 2024-09-12T00:24:21.155 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.155+0000 7f0d199128c0 1 < completed write operation key=YTXW98O07966 tag=79H0GX9W70TI type=write size=426661 2024-09-12T00:24:21.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.159+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=S57CLB65VMDL type=del size=932851 2024-09-12T00:24:21.162 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.163+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~UD678PG9REIS.0 size=814430 2024-09-12T00:24:21.168 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.167+0000 7f0d199128c0 1 < completed multipart upload key=WPZOKZDFXK4S upload=UD678PG9REIS tag=06ND95AT7PHE type=write size=1863006 2024-09-12T00:24:21.174 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.175+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~YD36RC6FEH5S.0 size=1048576 2024-09-12T00:24:21.177 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.175+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~YD36RC6FEH5S.1 size=207382 2024-09-12T00:24:21.177 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.175+0000 7f0d199128c0 1 > prepared multipart upload key=VXZI0ZTMQSV0 upload=YD36RC6FEH5S tag=ZQTG0GD0K255 type=write size=2304534 2024-09-12T00:24:21.181 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.179+0000 7f0d199128c0 1 < completed delete operation key=IPJEXRBN96NB tag=PM27UJPW5DGM type=del 2024-09-12T00:24:21.184 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.183+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=O0K0MKJPXKAV type=del size=2206643 2024-09-12T00:24:21.187 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.187+0000 7f0d199128c0 1 < completed delete operation key=2EK9CCKG26W2 tag=CJOZP71RQRBT type=del 2024-09-12T00:24:21.191 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.191+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=N19ZW0LLTYW8 type=del size=3413874 2024-09-12T00:24:21.192 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.191+0000 7f0d199128c0 1 < canceled part key=_multipart_VXZI0ZTMQSV0.2~02HR13P294OL.0 size=1048576 2024-09-12T00:24:21.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.195+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~02HR13P294OL.1 size=1048576 2024-09-12T00:24:21.202 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.203+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~02HR13P294OL.2 size=721784 2024-09-12T00:24:21.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.207+0000 7f0d199128c0 1 < canceled multipart upload key=VXZI0ZTMQSV0 upload=02HR13P294OL tag=U1XFDCJFYK1D type=write size=3867512 2024-09-12T00:24:21.214 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.215+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~K7A6UG1PB1M3.0 size=1048576 2024-09-12T00:24:21.217 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.215+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~K7A6UG1PB1M3.1 size=1048576 2024-09-12T00:24:21.220 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.219+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~K7A6UG1PB1M3.2 size=915350 2024-09-12T00:24:21.220 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.219+0000 7f0d199128c0 1 > prepared multipart upload key=PK2CA62QBZXS upload=K7A6UG1PB1M3 tag=NA2MW425W92H type=write size=4061078 2024-09-12T00:24:21.223 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.223+0000 7f0d199128c0 1 < completed write operation key=ZWGD87Z1MMNK tag=7LD5H50IOO64 type=write size=662646 2024-09-12T00:24:21.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.227+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=IEMDNR0P1E9I type=del size=3412782 2024-09-12T00:24:21.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.231+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~3FGZ1FY7OP9J.0 size=141246 2024-09-12T00:24:21.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.235+0000 7f0d199128c0 1 < completed multipart upload key=T6GOR4SBYU2Y upload=3FGZ1FY7OP9J tag=CLVXIJ75RMT1 type=write size=1189822 2024-09-12T00:24:21.239 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.239+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=3Y2LH4U4NQT2 type=del size=2393200 2024-09-12T00:24:21.242 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.243+0000 7f0d199128c0 1 < canceled operation key=J75P0821XGRO tag=D25JTK9RW99Z type=del size=2666166 2024-09-12T00:24:21.246 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.247+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=T8NFOUXJS9OE type=del size=1215508 2024-09-12T00:24:21.250 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.251+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~BYFMZTQP77NB.0 size=383382 2024-09-12T00:24:21.255 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.255+0000 7f0d199128c0 1 < completed multipart upload key=1Y6B1MJP5G4L upload=BYFMZTQP77NB tag=W1DR7L0NHWAE type=write size=1431958 2024-09-12T00:24:21.262 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.263+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~CN2G61KP87N1.0 size=976470 2024-09-12T00:24:21.262 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.263+0000 7f0d199128c0 1 > prepared multipart upload key=37WTPAJGOX5L upload=CN2G61KP87N1 tag=EM9CQWTFXDKI type=write size=2025046 2024-09-12T00:24:21.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.263+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~E7KEH18M2ZZ6.0 size=1048576 2024-09-12T00:24:21.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.263+0000 7f0d199128c0 1 < canceled part key=_multipart_1Y6B1MJP5G4L.2~E7KEH18M2ZZ6.1 size=1048576 2024-09-12T00:24:21.268 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.267+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~E7KEH18M2ZZ6.2 size=493115 2024-09-12T00:24:21.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.271+0000 7f0d199128c0 1 < canceled multipart upload key=1Y6B1MJP5G4L upload=E7KEH18M2ZZ6 tag=M2EMJ0T4QMQ2 type=write size=3638843 2024-09-12T00:24:21.276 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.275+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=DP4HYDQK8NJF type=del size=394764 2024-09-12T00:24:21.280 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.279+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~I172R1171SQS.0 size=1048576 2024-09-12T00:24:21.282 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.283+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~I172R1171SQS.1 size=1048576 2024-09-12T00:24:21.285 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.283+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~I172R1171SQS.2 size=719303 2024-09-12T00:24:21.290 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.291+0000 7f0d199128c0 1 < completed multipart upload key=V6H6S9X0U2A0 upload=I172R1171SQS tag=OWXQNLDBBNTF type=write size=3865031 2024-09-12T00:24:21.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.295+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=R02EFZ3TWNIS type=del size=4131806 2024-09-12T00:24:21.301 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.299+0000 7f0d199128c0 1 < suggested remove operation key=V6H6S9X0U2A0 tag=W2W1OTCL27KZ type=del 2024-09-12T00:24:21.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.307+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~0J9LK3HJ6VIH.0 size=1048576 2024-09-12T00:24:21.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.311+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~0J9LK3HJ6VIH.1 size=688440 2024-09-12T00:24:21.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.311+0000 7f0d199128c0 1 > prepared multipart upload key=QUO5ND3O41TY upload=0J9LK3HJ6VIH tag=MWD9TFHLC562 type=write size=2785592 2024-09-12T00:24:21.314 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.315+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~0J3CZLUZFZJ7.0 size=52410 2024-09-12T00:24:21.319 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.319+0000 7f0d199128c0 1 < completed multipart upload key=SITJU2EUVSR8 upload=0J3CZLUZFZJ7 tag=JYRM7Q8V2ZA7 type=write size=1100986 2024-09-12T00:24:21.323 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.323+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=U797PKQ2RH7X type=del size=2940633 2024-09-12T00:24:21.326 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.327+0000 7f0d199128c0 1 < completed write operation key=J75P0821XGRO tag=BYAZ65G0F0HF type=write size=630615 2024-09-12T00:24:21.332 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.331+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~LGMG2TGVYD20.0 size=1048576 2024-09-12T00:24:21.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.335+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~LGMG2TGVYD20.1 size=1048576 2024-09-12T00:24:21.337 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.335+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~LGMG2TGVYD20.2 size=516178 2024-09-12T00:24:21.337 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.335+0000 7f0d199128c0 1 > prepared multipart upload key=GH0FNY2AI00G upload=LGMG2TGVYD20 tag=Q0POJ8KZUZEK type=write size=3661906 2024-09-12T00:24:21.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.339+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~I880P0CO8QWG.0 size=1048576 2024-09-12T00:24:21.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.343+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~I880P0CO8QWG.1 size=1048576 2024-09-12T00:24:21.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.343+0000 7f0d199128c0 1 < canceled part key=_multipart_PK2CA62QBZXS.2~I880P0CO8QWG.2 size=514845 2024-09-12T00:24:21.349 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.351+0000 7f0d199128c0 1 < canceled multipart upload key=PK2CA62QBZXS upload=I880P0CO8QWG tag=N2JI0XZ19L1V type=write size=3660573 2024-09-12T00:24:21.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.355+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~3E1MNQTZTF5O.0 size=1048576 2024-09-12T00:24:21.358 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.359+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~3E1MNQTZTF5O.1 size=1048576 2024-09-12T00:24:21.361 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.359+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~3E1MNQTZTF5O.2 size=6531 2024-09-12T00:24:21.361 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.359+0000 7f0d199128c0 1 > prepared multipart upload key=RX3RVT06SGJ4 upload=3E1MNQTZTF5O tag=M9ET8830XL83 type=write size=3152259 2024-09-12T00:24:21.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.363+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~7527POJ0QIGF.0 size=1048576 2024-09-12T00:24:21.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.363+0000 7f0d199128c0 1 < canceled part key=_multipart_GH0FNY2AI00G.2~7527POJ0QIGF.1 size=425797 2024-09-12T00:24:21.369 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.371+0000 7f0d199128c0 1 < canceled multipart upload key=GH0FNY2AI00G upload=7527POJ0QIGF tag=DSNQR2BE4EHT type=write size=2522949 2024-09-12T00:24:21.373 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.371+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=WQAQBO9OJ5YJ type=del size=21687 2024-09-12T00:24:21.376 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.375+0000 7f0d199128c0 1 < completed delete operation key=VXZI0ZTMQSV0 tag=S57CLB65VMDL type=del 2024-09-12T00:24:21.382 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.383+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~TQO7AGXCPTMS.0 size=951235 2024-09-12T00:24:21.382 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.383+0000 7f0d199128c0 1 > prepared multipart upload key=4K654PSDLDVI upload=TQO7AGXCPTMS tag=MBTR21S71X9U type=write size=1999811 2024-09-12T00:24:21.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.387+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~YD36RC6FEH5S.0 size=1048576 2024-09-12T00:24:21.389 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.387+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~YD36RC6FEH5S.1 size=207382 2024-09-12T00:24:21.395 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.395+0000 7f0d199128c0 1 < completed multipart upload key=VXZI0ZTMQSV0 upload=YD36RC6FEH5S tag=ZQTG0GD0K255 type=write size=2304534 2024-09-12T00:24:21.400 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.399+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~PI4T8DPWLB8H.0 size=336955 2024-09-12T00:24:21.400 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.399+0000 7f0d199128c0 1 > prepared multipart upload key=T6GOR4SBYU2Y upload=PI4T8DPWLB8H tag=CI96SQNHA921 type=write size=1385531 2024-09-12T00:24:21.407 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.407+0000 7f0d199128c0 1 < suggested update operation key=VXZI0ZTMQSV0 tag=O0K0MKJPXKAV type=del size=2206643 2024-09-12T00:24:21.410 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.411+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=7Y00G75LP7GE type=write size=989977 2024-09-12T00:24:21.416 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.415+0000 7f0d199128c0 1 < suggested update operation key=HXNC728XIWC1 tag=N19ZW0LLTYW8 type=del size=3413874 2024-09-12T00:24:21.422 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.423+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~VA207JTOLY1M.0 size=1048576 2024-09-12T00:24:21.425 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.423+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~VA207JTOLY1M.1 size=1048576 2024-09-12T00:24:21.428 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.427+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~VA207JTOLY1M.2 size=902612 2024-09-12T00:24:21.428 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.427+0000 7f0d199128c0 1 > prepared multipart upload key=HXNC728XIWC1 upload=VA207JTOLY1M tag=YPM29VUW75RL type=write size=4048340 2024-09-12T00:24:21.432 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.431+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~K7A6UG1PB1M3.0 size=1048576 2024-09-12T00:24:21.434 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.435+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~K7A6UG1PB1M3.1 size=1048576 2024-09-12T00:24:21.434 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.435+0000 7f0d199128c0 1 < canceled part key=_multipart_PK2CA62QBZXS.2~K7A6UG1PB1M3.2 size=915350 2024-09-12T00:24:21.440 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.439+0000 7f0d199128c0 1 < canceled multipart upload key=PK2CA62QBZXS upload=K7A6UG1PB1M3 tag=NA2MW425W92H type=write size=4061078 2024-09-12T00:24:21.443 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.443+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=EZ1IP5GN3Q61 type=del size=53801 2024-09-12T00:24:21.449 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.447+0000 7f0d199128c0 1 < suggested update operation key=YTXW98O07966 tag=IEMDNR0P1E9I type=del size=3412782 2024-09-12T00:24:21.452 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.451+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=K2H5YUP3AFXV type=del size=1829681 2024-09-12T00:24:21.456 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.455+0000 7f0d199128c0 1 < completed delete operation key=9I6MZAEUS4I0 tag=3Y2LH4U4NQT2 type=del 2024-09-12T00:24:21.461 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.463+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~E0R7HAZ4UTDZ.0 size=1048576 2024-09-12T00:24:21.464 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.463+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~E0R7HAZ4UTDZ.1 size=705553 2024-09-12T00:24:21.464 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.463+0000 7f0d199128c0 1 > prepared multipart upload key=57W1IO3KSWBR upload=E0R7HAZ4UTDZ tag=T412DM0BNVK4 type=write size=2802705 2024-09-12T00:24:21.468 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.467+0000 7f0d199128c0 1 < completed delete operation key=10YEWZDTTEV0 tag=T8NFOUXJS9OE type=del 2024-09-12T00:24:21.473 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.475+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~T53ORY7KCXIN.0 size=1048576 2024-09-12T00:24:21.476 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.475+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~T53ORY7KCXIN.1 size=137072 2024-09-12T00:24:21.476 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.475+0000 7f0d199128c0 1 > prepared multipart upload key=2EK9CCKG26W2 upload=T53ORY7KCXIN tag=XJKMMGKYV2US type=write size=2234224 2024-09-12T00:24:21.480 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.479+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~CN2G61KP87N1.0 size=976470 2024-09-12T00:24:21.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.483+0000 7f0d199128c0 1 < completed multipart upload key=37WTPAJGOX5L upload=CN2G61KP87N1 tag=EM9CQWTFXDKI type=write size=2025046 2024-09-12T00:24:21.488 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.487+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=0W8UWMEYWZAG type=del size=1379376 2024-09-12T00:24:21.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.491+0000 7f0d199128c0 1 < completed delete operation key=GH0FNY2AI00G tag=DP4HYDQK8NJF type=del 2024-09-12T00:24:21.495 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.495+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=97HE7R1T2LEW type=write size=748506 2024-09-12T00:24:21.498 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.499+0000 7f0d199128c0 1 < completed delete operation key=9I6MZAEUS4I0 tag=R02EFZ3TWNIS type=del 2024-09-12T00:24:21.501 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.503+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=XBQJJ775MG8Y type=del size=3948852 2024-09-12T00:24:21.505 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.503+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~0J9LK3HJ6VIH.0 size=1048576 2024-09-12T00:24:21.512 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.511+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~0J9LK3HJ6VIH.1 size=688440 2024-09-12T00:24:21.517 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.519+0000 7f0d199128c0 1 < completed multipart upload key=QUO5ND3O41TY upload=0J9LK3HJ6VIH tag=MWD9TFHLC562 type=write size=2785592 2024-09-12T00:24:21.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.519+0000 7f0d199128c0 1 > prepared operation key=57W1IO3KSWBR tag=DFRLWZSY0UTH type=del size=4027523 2024-09-12T00:24:21.527 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.527+0000 7f0d199128c0 1 < suggested update operation key=WBGXMJB7U422 tag=U797PKQ2RH7X type=del size=2940633 2024-09-12T00:24:21.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.531+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=QJFK34PGCIBR type=del size=3417414 2024-09-12T00:24:21.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.535+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~LGMG2TGVYD20.0 size=1048576 2024-09-12T00:24:21.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.535+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~LGMG2TGVYD20.1 size=1048576 2024-09-12T00:24:21.539 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.539+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~LGMG2TGVYD20.2 size=516178 2024-09-12T00:24:21.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.543+0000 7f0d199128c0 1 < completed multipart upload key=GH0FNY2AI00G upload=LGMG2TGVYD20 tag=Q0POJ8KZUZEK type=write size=3661906 2024-09-12T00:24:21.548 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.547+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=Q4C8X6E6UBEA type=write size=857077 2024-09-12T00:24:21.552 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.551+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~3E1MNQTZTF5O.0 size=1048576 2024-09-12T00:24:21.555 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.555+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~3E1MNQTZTF5O.1 size=1048576 2024-09-12T00:24:21.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.559+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~3E1MNQTZTF5O.2 size=6531 2024-09-12T00:24:21.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.563+0000 7f0d199128c0 1 < completed multipart upload key=RX3RVT06SGJ4 upload=3E1MNQTZTF5O tag=M9ET8830XL83 type=write size=3152259 2024-09-12T00:24:21.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.571+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~MDOX8H14QSDJ.0 size=1048576 2024-09-12T00:24:21.573 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.571+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~MDOX8H14QSDJ.1 size=413897 2024-09-12T00:24:21.573 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.571+0000 7f0d199128c0 1 > prepared multipart upload key=IPJEXRBN96NB upload=MDOX8H14QSDJ tag=21C3N9MAFKZZ type=write size=2511049 2024-09-12T00:24:21.577 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.575+0000 7f0d199128c0 1 < completed delete operation key=PK2CA62QBZXS tag=WQAQBO9OJ5YJ type=del 2024-09-12T00:24:21.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.579+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=8121P0R1FVRR type=del size=2068356 2024-09-12T00:24:21.584 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.583+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~TQO7AGXCPTMS.0 size=951235 2024-09-12T00:24:21.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.591+0000 7f0d199128c0 1 < completed multipart upload key=4K654PSDLDVI upload=TQO7AGXCPTMS tag=MBTR21S71X9U type=write size=1999811 2024-09-12T00:24:21.596 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.595+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~CQIFOL3EM91H.0 size=1048576 2024-09-12T00:24:21.599 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.599+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~CQIFOL3EM91H.1 size=782765 2024-09-12T00:24:21.599 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.599+0000 7f0d199128c0 1 > prepared multipart upload key=WBGXMJB7U422 upload=CQIFOL3EM91H tag=6HBROZB0LSST type=write size=2879917 2024-09-12T00:24:21.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.603+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~PI4T8DPWLB8H.0 size=336955 2024-09-12T00:24:21.608 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.607+0000 7f0d199128c0 1 < completed multipart upload key=T6GOR4SBYU2Y upload=PI4T8DPWLB8H tag=CI96SQNHA921 type=write size=1385531 2024-09-12T00:24:21.614 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.615+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~H4D5FKEVAPLH.0 size=1048576 2024-09-12T00:24:21.617 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.615+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~H4D5FKEVAPLH.1 size=1048576 2024-09-12T00:24:21.619 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.619+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~H4D5FKEVAPLH.2 size=988760 2024-09-12T00:24:21.620 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.619+0000 7f0d199128c0 1 > prepared multipart upload key=VXZI0ZTMQSV0 upload=H4D5FKEVAPLH tag=KIYI1X2HSXGB type=write size=4134488 2024-09-12T00:24:21.623 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.623+0000 7f0d199128c0 1 < completed write operation key=IPJEXRBN96NB tag=7Y00G75LP7GE type=write size=989977 2024-09-12T00:24:21.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.627+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=PHNXNULQD2BA type=write size=688809 2024-09-12T00:24:21.630 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.631+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~VA207JTOLY1M.0 size=1048576 2024-09-12T00:24:21.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.631+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~VA207JTOLY1M.1 size=1048576 2024-09-12T00:24:21.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.635+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~VA207JTOLY1M.2 size=902612 2024-09-12T00:24:21.641 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.643+0000 7f0d199128c0 1 < completed multipart upload key=HXNC728XIWC1 upload=VA207JTOLY1M tag=YPM29VUW75RL type=write size=4048340 2024-09-12T00:24:21.648 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.647+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~KZVVJM0TYZPG.0 size=1048576 2024-09-12T00:24:21.650 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.651+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~KZVVJM0TYZPG.1 size=1048576 2024-09-12T00:24:21.653 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.651+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~KZVVJM0TYZPG.2 size=949530 2024-09-12T00:24:21.653 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.651+0000 7f0d199128c0 1 > prepared multipart upload key=T6GOR4SBYU2Y upload=KZVVJM0TYZPG tag=4YC823VELKLC type=write size=4095258 2024-09-12T00:24:21.657 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.655+0000 7f0d199128c0 1 < canceled operation key=VXZI0ZTMQSV0 tag=EZ1IP5GN3Q61 type=del size=53801 2024-09-12T00:24:21.661 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.659+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=LH9VLJFR89JY type=del size=2752833 2024-09-12T00:24:21.664 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.663+0000 7f0d199128c0 1 < completed delete operation key=JA6CSJF78VE2 tag=K2H5YUP3AFXV type=del 2024-09-12T00:24:21.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.671+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~HJZM2DCG1FXI.0 size=1048576 2024-09-12T00:24:21.673 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.671+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~HJZM2DCG1FXI.1 size=1048576 2024-09-12T00:24:21.675 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.675+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~HJZM2DCG1FXI.2 size=948342 2024-09-12T00:24:21.675 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.675+0000 7f0d199128c0 1 > prepared multipart upload key=GH0FNY2AI00G upload=HJZM2DCG1FXI tag=76CMY0MN0IBH type=write size=4094070 2024-09-12T00:24:21.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.679+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~E0R7HAZ4UTDZ.0 size=1048576 2024-09-12T00:24:21.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.683+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~E0R7HAZ4UTDZ.1 size=705553 2024-09-12T00:24:21.687 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.687+0000 7f0d199128c0 1 < completed multipart upload key=57W1IO3KSWBR upload=E0R7HAZ4UTDZ tag=T412DM0BNVK4 type=write size=2802705 2024-09-12T00:24:21.691 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.691+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=OSPX2T8YSV9Y type=del size=3188400 2024-09-12T00:24:21.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.695+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~T53ORY7KCXIN.0 size=1048576 2024-09-12T00:24:21.698 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.699+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~T53ORY7KCXIN.1 size=137072 2024-09-12T00:24:21.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.703+0000 7f0d199128c0 1 < completed multipart upload key=2EK9CCKG26W2 upload=T53ORY7KCXIN tag=XJKMMGKYV2US type=write size=2234224 2024-09-12T00:24:21.707 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.707+0000 7f0d199128c0 1 > prepared operation key=57W1IO3KSWBR tag=TBSCH5JUBW3T type=del size=3941518 2024-09-12T00:24:21.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.715+0000 7f0d199128c0 1 < suggested remove operation key=WPZOKZDFXK4S tag=0W8UWMEYWZAG type=del 2024-09-12T00:24:21.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.719+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~4OMNKGFS7ICA.0 size=1048576 2024-09-12T00:24:21.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.723+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~4OMNKGFS7ICA.1 size=1048576 2024-09-12T00:24:21.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.723+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~4OMNKGFS7ICA.2 size=434918 2024-09-12T00:24:21.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.723+0000 7f0d199128c0 1 > prepared multipart upload key=37WTPAJGOX5L upload=4OMNKGFS7ICA tag=JHX6IJK5CR7L type=write size=3580646 2024-09-12T00:24:21.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.727+0000 7f0d199128c0 1 < completed write operation key=4K654PSDLDVI tag=97HE7R1T2LEW type=write size=748506 2024-09-12T00:24:21.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.731+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=4GNZ4IL5YNEI type=del size=4174625 2024-09-12T00:24:21.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.735+0000 7f0d199128c0 1 < completed delete operation key=SITJU2EUVSR8 tag=XBQJJ775MG8Y type=del 2024-09-12T00:24:21.737 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.739+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=CO54EETA2R7K type=write size=199171 2024-09-12T00:24:21.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.739+0000 7f0d199128c0 1 < completed delete operation key=57W1IO3KSWBR tag=DFRLWZSY0UTH type=del 2024-09-12T00:24:21.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.747+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~HP0CUB6AGX8P.0 size=1048576 2024-09-12T00:24:21.748 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.747+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~HP0CUB6AGX8P.1 size=905391 2024-09-12T00:24:21.748 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.747+0000 7f0d199128c0 1 > prepared multipart upload key=FJ8YV026H0ZU upload=HP0CUB6AGX8P tag=9AYAKP2DUQJ1 type=write size=3002543 2024-09-12T00:24:21.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.751+0000 7f0d199128c0 1 < completed delete operation key=V6H6S9X0U2A0 tag=QJFK34PGCIBR type=del 2024-09-12T00:24:21.754 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.755+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=H7FEUP71RNS9 type=del size=793104 2024-09-12T00:24:21.758 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.759+0000 7f0d199128c0 1 < completed write operation key=VXZI0ZTMQSV0 tag=Q4C8X6E6UBEA type=write size=857077 2024-09-12T00:24:21.760 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.759+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=JG7V7AAUV0C4 type=write size=97516 2024-09-12T00:24:21.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.763+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~MDOX8H14QSDJ.0 size=1048576 2024-09-12T00:24:21.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.763+0000 7f0d199128c0 1 < canceled part key=_multipart_IPJEXRBN96NB.2~MDOX8H14QSDJ.1 size=413897 2024-09-12T00:24:21.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.767+0000 7f0d199128c0 1 < canceled multipart upload key=IPJEXRBN96NB upload=MDOX8H14QSDJ tag=21C3N9MAFKZZ type=write size=2511049 2024-09-12T00:24:21.772 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.771+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=7AMVOGSXEYTI type=del size=636847 2024-09-12T00:24:21.776 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.775+0000 7f0d199128c0 1 < completed delete operation key=37WTPAJGOX5L tag=8121P0R1FVRR type=del 2024-09-12T00:24:21.782 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.783+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~CHQSJHHQQEA6.0 size=397111 2024-09-12T00:24:21.782 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.783+0000 7f0d199128c0 1 > prepared multipart upload key=GH0FNY2AI00G upload=CHQSJHHQQEA6 tag=OQZTQ8BJQVMY type=write size=1445687 2024-09-12T00:24:21.785 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.787+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~CQIFOL3EM91H.0 size=1048576 2024-09-12T00:24:21.789 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.787+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~CQIFOL3EM91H.1 size=782765 2024-09-12T00:24:21.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.795+0000 7f0d199128c0 1 < completed multipart upload key=WBGXMJB7U422 upload=CQIFOL3EM91H tag=6HBROZB0LSST type=write size=2879917 2024-09-12T00:24:21.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.795+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=DWH5N3KISGKO type=del size=3779571 2024-09-12T00:24:21.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.799+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~H4D5FKEVAPLH.0 size=1048576 2024-09-12T00:24:21.803 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.803+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~H4D5FKEVAPLH.1 size=1048576 2024-09-12T00:24:21.803 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.803+0000 7f0d199128c0 1 < canceled part key=_multipart_VXZI0ZTMQSV0.2~H4D5FKEVAPLH.2 size=988760 2024-09-12T00:24:21.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.807+0000 7f0d199128c0 1 < canceled multipart upload key=VXZI0ZTMQSV0 upload=H4D5FKEVAPLH tag=KIYI1X2HSXGB type=write size=4134488 2024-09-12T00:24:21.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.815+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~XMF6XCF99FDV.0 size=1048576 2024-09-12T00:24:21.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.819+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~XMF6XCF99FDV.1 size=1048576 2024-09-12T00:24:21.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.823+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~XMF6XCF99FDV.2 size=153627 2024-09-12T00:24:21.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.823+0000 7f0d199128c0 1 > prepared multipart upload key=FJ8YV026H0ZU upload=XMF6XCF99FDV tag=DMRKEYONJHAD type=write size=3299355 2024-09-12T00:24:21.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.827+0000 7f0d199128c0 1 < canceled operation key=RFCHRGVA9GOI tag=PHNXNULQD2BA type=write size=688809 2024-09-12T00:24:21.829 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.827+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=F4ZVD101ZQR4 type=write size=230717 2024-09-12T00:24:21.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.831+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~KZVVJM0TYZPG.0 size=1048576 2024-09-12T00:24:21.834 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.835+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~KZVVJM0TYZPG.1 size=1048576 2024-09-12T00:24:21.837 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.835+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~KZVVJM0TYZPG.2 size=949530 2024-09-12T00:24:21.842 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.843+0000 7f0d199128c0 1 < completed multipart upload key=T6GOR4SBYU2Y upload=KZVVJM0TYZPG tag=4YC823VELKLC type=write size=4095258 2024-09-12T00:24:21.848 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.847+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~XG5XWK3HZ7TF.0 size=1048576 2024-09-12T00:24:21.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.851+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~XG5XWK3HZ7TF.1 size=1048576 2024-09-12T00:24:21.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.851+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~XG5XWK3HZ7TF.2 size=755792 2024-09-12T00:24:21.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.851+0000 7f0d199128c0 1 > prepared multipart upload key=NXQYUQIR2APT upload=XG5XWK3HZ7TF tag=3BADAXZKYICW type=write size=3901520 2024-09-12T00:24:21.859 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.859+0000 7f0d199128c0 1 < suggested remove operation key=A529WOKFD1NI tag=LH9VLJFR89JY type=del 2024-09-12T00:24:21.862 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.863+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=J49GAVZWFRWW type=del size=3887133 2024-09-12T00:24:21.866 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.867+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~HJZM2DCG1FXI.0 size=1048576 2024-09-12T00:24:21.868 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.867+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~HJZM2DCG1FXI.1 size=1048576 2024-09-12T00:24:21.872 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.871+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~HJZM2DCG1FXI.2 size=948342 2024-09-12T00:24:21.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.875+0000 7f0d199128c0 1 < completed multipart upload key=GH0FNY2AI00G upload=HJZM2DCG1FXI tag=76CMY0MN0IBH type=write size=4094070 2024-09-12T00:24:21.882 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.883+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~UHYE722UX4SU.0 size=149056 2024-09-12T00:24:21.883 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.883+0000 7f0d199128c0 1 > prepared multipart upload key=IPJEXRBN96NB upload=UHYE722UX4SU tag=200GCBP1K02C type=write size=1197632 2024-09-12T00:24:21.886 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.887+0000 7f0d199128c0 1 < completed delete operation key=NXQYUQIR2APT tag=OSPX2T8YSV9Y type=del 2024-09-12T00:24:21.893 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.891+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~HZV0FIEU7AU8.0 size=921245 2024-09-12T00:24:21.893 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.891+0000 7f0d199128c0 1 > prepared multipart upload key=37WTPAJGOX5L upload=HZV0FIEU7AU8 tag=E8VD50JT5FS0 type=write size=1969821 2024-09-12T00:24:21.897 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.895+0000 7f0d199128c0 1 < completed delete operation key=57W1IO3KSWBR tag=TBSCH5JUBW3T type=del 2024-09-12T00:24:21.903 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.903+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~5QHIW8XUIMNS.0 size=706174 2024-09-12T00:24:21.904 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.903+0000 7f0d199128c0 1 > prepared multipart upload key=A529WOKFD1NI upload=5QHIW8XUIMNS tag=H7QNJ7JFA7BT type=write size=1754750 2024-09-12T00:24:21.907 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.907+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~4OMNKGFS7ICA.0 size=1048576 2024-09-12T00:24:21.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.911+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~4OMNKGFS7ICA.1 size=1048576 2024-09-12T00:24:21.913 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.911+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~4OMNKGFS7ICA.2 size=434918 2024-09-12T00:24:21.918 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.919+0000 7f0d199128c0 1 < completed multipart upload key=37WTPAJGOX5L upload=4OMNKGFS7ICA tag=JHX6IJK5CR7L type=write size=3580646 2024-09-12T00:24:21.921 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.923+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=414M4Z19ZJ2R type=write size=230328 2024-09-12T00:24:21.927 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.927+0000 7f0d199128c0 1 < suggested update operation key=J75P0821XGRO tag=4GNZ4IL5YNEI type=del size=4174625 2024-09-12T00:24:21.934 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.935+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~V1YRDI9OXCUR.0 size=1048576 2024-09-12T00:24:21.936 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.935+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~V1YRDI9OXCUR.1 size=271628 2024-09-12T00:24:21.936 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.935+0000 7f0d199128c0 1 > prepared multipart upload key=WBGXMJB7U422 upload=V1YRDI9OXCUR tag=7ACCQYP6TN1C type=write size=2368780 2024-09-12T00:24:21.940 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.939+0000 7f0d199128c0 1 < completed write operation key=OVLAP0OS78QG tag=CO54EETA2R7K type=write size=199171 2024-09-12T00:24:21.943 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.943+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=XRVCDKGAQSVW type=del size=637830 2024-09-12T00:24:21.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.947+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~HP0CUB6AGX8P.0 size=1048576 2024-09-12T00:24:21.949 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.951+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~HP0CUB6AGX8P.1 size=905391 2024-09-12T00:24:21.955 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.955+0000 7f0d199128c0 1 < completed multipart upload key=FJ8YV026H0ZU upload=HP0CUB6AGX8P tag=9AYAKP2DUQJ1 type=write size=3002543 2024-09-12T00:24:21.961 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.959+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~294PB2HEAKZP.0 size=1048576 2024-09-12T00:24:21.964 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.963+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~294PB2HEAKZP.1 size=124358 2024-09-12T00:24:21.964 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.963+0000 7f0d199128c0 1 > prepared multipart upload key=1Y6B1MJP5G4L upload=294PB2HEAKZP tag=AQ23EKQQG37V type=write size=2221510 2024-09-12T00:24:21.967 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.967+0000 7f0d199128c0 1 < completed delete operation key=RFCHRGVA9GOI tag=H7FEUP71RNS9 type=del 2024-09-12T00:24:21.973 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.971+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~YGJCYQ8LS1LL.0 size=1048576 2024-09-12T00:24:21.975 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.975+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~YGJCYQ8LS1LL.1 size=1048576 2024-09-12T00:24:21.978 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.979+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~YGJCYQ8LS1LL.2 size=611491 2024-09-12T00:24:21.978 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.979+0000 7f0d199128c0 1 > prepared multipart upload key=10YEWZDTTEV0 upload=YGJCYQ8LS1LL tag=L5W8TDNFG4K3 type=write size=3757219 2024-09-12T00:24:21.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.983+0000 7f0d199128c0 1 < suggested update operation key=PK2CA62QBZXS tag=JG7V7AAUV0C4 type=write size=97516 2024-09-12T00:24:21.990 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.991+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~CQQ9UL309JP9.0 size=1048576 2024-09-12T00:24:21.993 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.991+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~CQQ9UL309JP9.1 size=1048576 2024-09-12T00:24:21.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.995+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~CQQ9UL309JP9.2 size=211963 2024-09-12T00:24:21.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.995+0000 7f0d199128c0 1 > prepared multipart upload key=0EBWUENN0881 upload=CQQ9UL309JP9 tag=NHRNF0DF1ZGU type=write size=3357691 2024-09-12T00:24:21.999 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:21.999+0000 7f0d199128c0 1 < completed delete operation key=SITJU2EUVSR8 tag=7AMVOGSXEYTI type=del 2024-09-12T00:24:22.002 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.003+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=BWF1D91B8034 type=write size=239386 2024-09-12T00:24:22.005 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.007+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~CHQSJHHQQEA6.0 size=397111 2024-09-12T00:24:22.011 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.011+0000 7f0d199128c0 1 < completed multipart upload key=GH0FNY2AI00G upload=CHQSJHHQQEA6 tag=OQZTQ8BJQVMY type=write size=1445687 2024-09-12T00:24:22.015 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.015+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=X58K7PHF6Y9B type=del size=2718936 2024-09-12T00:24:22.017 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.019+0000 7f0d199128c0 1 < completed delete operation key=HXNC728XIWC1 tag=DWH5N3KISGKO type=del 2024-09-12T00:24:22.021 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.019+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=6KDBEQFQ8DNO type=del size=94728 2024-09-12T00:24:22.025 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.023+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~XMF6XCF99FDV.0 size=1048576 2024-09-12T00:24:22.028 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.027+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~XMF6XCF99FDV.1 size=1048576 2024-09-12T00:24:22.030 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.031+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~XMF6XCF99FDV.2 size=153627 2024-09-12T00:24:22.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.035+0000 7f0d199128c0 1 < completed multipart upload key=FJ8YV026H0ZU upload=XMF6XCF99FDV tag=DMRKEYONJHAD type=write size=3299355 2024-09-12T00:24:22.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.043+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~ZEP3HTIQBMU6.0 size=1048576 2024-09-12T00:24:22.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.043+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~ZEP3HTIQBMU6.1 size=1048576 2024-09-12T00:24:22.047 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.047+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~ZEP3HTIQBMU6.2 size=330991 2024-09-12T00:24:22.047 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.047+0000 7f0d199128c0 1 > prepared multipart upload key=HXNC728XIWC1 upload=ZEP3HTIQBMU6 tag=V6V6FS0G7WCI type=write size=3476719 2024-09-12T00:24:22.049 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.047+0000 7f0d199128c0 1 < completed write operation key=H604SA6XTFLY tag=F4ZVD101ZQR4 type=write size=230717 2024-09-12T00:24:22.052 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.051+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=SCEM9ADY9QMK type=del size=4024814 2024-09-12T00:24:22.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.055+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~XG5XWK3HZ7TF.0 size=1048576 2024-09-12T00:24:22.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.055+0000 7f0d199128c0 1 < canceled part key=_multipart_NXQYUQIR2APT.2~XG5XWK3HZ7TF.1 size=1048576 2024-09-12T00:24:22.058 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.059+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~XG5XWK3HZ7TF.2 size=755792 2024-09-12T00:24:22.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.063+0000 7f0d199128c0 1 < canceled multipart upload key=NXQYUQIR2APT upload=XG5XWK3HZ7TF tag=3BADAXZKYICW type=write size=3901520 2024-09-12T00:24:22.071 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.071+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~BVCKFY2JUMYS.0 size=1048576 2024-09-12T00:24:22.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.071+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~BVCKFY2JUMYS.1 size=1048576 2024-09-12T00:24:22.076 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.075+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~BVCKFY2JUMYS.2 size=846105 2024-09-12T00:24:22.076 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.075+0000 7f0d199128c0 1 > prepared multipart upload key=2EK9CCKG26W2 upload=BVCKFY2JUMYS tag=OZNSCZ1WKWYV type=write size=3991833 2024-09-12T00:24:22.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.079+0000 7f0d199128c0 1 < completed delete operation key=OVLAP0OS78QG tag=J49GAVZWFRWW type=del 2024-09-12T00:24:22.082 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.083+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=34QEZ8S6JIIP type=del size=2536320 2024-09-12T00:24:22.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.087+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~UHYE722UX4SU.0 size=149056 2024-09-12T00:24:22.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.091+0000 7f0d199128c0 1 < completed multipart upload key=IPJEXRBN96NB upload=UHYE722UX4SU tag=200GCBP1K02C type=write size=1197632 2024-09-12T00:24:22.093 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.091+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=9F3UNS8NQ046 type=del size=3794044 2024-09-12T00:24:22.096 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.095+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~HZV0FIEU7AU8.0 size=921245 2024-09-12T00:24:22.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.099+0000 7f0d199128c0 1 < completed multipart upload key=37WTPAJGOX5L upload=HZV0FIEU7AU8 tag=E8VD50JT5FS0 type=write size=1969821 2024-09-12T00:24:22.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.103+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=EA500PLWTV0E type=del size=3617489 2024-09-12T00:24:22.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.107+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~5QHIW8XUIMNS.0 size=706174 2024-09-12T00:24:22.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.111+0000 7f0d199128c0 1 < completed multipart upload key=A529WOKFD1NI upload=5QHIW8XUIMNS tag=H7QNJ7JFA7BT type=write size=1754750 2024-09-12T00:24:22.119 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.119+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=KTLK34AKACYC type=write size=810892 2024-09-12T00:24:22.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.123+0000 7f0d199128c0 1 < completed write operation key=WPZOKZDFXK4S tag=414M4Z19ZJ2R type=write size=230328 2024-09-12T00:24:22.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.127+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~SR1Y5LO4V798.0 size=1048576 2024-09-12T00:24:22.130 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.131+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~SR1Y5LO4V798.1 size=615240 2024-09-12T00:24:22.130 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.131+0000 7f0d199128c0 1 > prepared multipart upload key=B58RWC9W8THG upload=SR1Y5LO4V798 tag=2GZ7WZXOJTKM type=write size=2712392 2024-09-12T00:24:22.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.131+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~V1YRDI9OXCUR.0 size=1048576 2024-09-12T00:24:22.135 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.135+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~V1YRDI9OXCUR.1 size=271628 2024-09-12T00:24:22.140 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.139+0000 7f0d199128c0 1 < completed multipart upload key=WBGXMJB7U422 upload=V1YRDI9OXCUR tag=7ACCQYP6TN1C type=write size=2368780 2024-09-12T00:24:22.143 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.143+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=CNQ7GJBSEA85 type=del size=3179675 2024-09-12T00:24:22.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.147+0000 7f0d199128c0 1 < completed delete operation key=9I6MZAEUS4I0 tag=XRVCDKGAQSVW type=del 2024-09-12T00:24:22.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.151+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~QC26QZRT51OU.0 size=1048576 2024-09-12T00:24:22.153 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.155+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~QC26QZRT51OU.1 size=1048576 2024-09-12T00:24:22.156 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.155+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~QC26QZRT51OU.2 size=517609 2024-09-12T00:24:22.157 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.155+0000 7f0d199128c0 1 > prepared multipart upload key=OVLAP0OS78QG upload=QC26QZRT51OU tag=1B68EFSQNPJK type=write size=3663337 2024-09-12T00:24:22.160 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.159+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~294PB2HEAKZP.0 size=1048576 2024-09-12T00:24:22.163 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.163+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~294PB2HEAKZP.1 size=124358 2024-09-12T00:24:22.169 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.167+0000 7f0d199128c0 1 < completed multipart upload key=1Y6B1MJP5G4L upload=294PB2HEAKZP tag=AQ23EKQQG37V type=write size=2221510 2024-09-12T00:24:22.176 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.175+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~2YG5D0LL4JDO.0 size=1048576 2024-09-12T00:24:22.179 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.179+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~2YG5D0LL4JDO.1 size=74441 2024-09-12T00:24:22.179 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.179+0000 7f0d199128c0 1 > prepared multipart upload key=57W1IO3KSWBR upload=2YG5D0LL4JDO tag=WFL2T13SM1T9 type=write size=2171593 2024-09-12T00:24:22.183 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.183+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~YGJCYQ8LS1LL.0 size=1048576 2024-09-12T00:24:22.185 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.183+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~YGJCYQ8LS1LL.1 size=1048576 2024-09-12T00:24:22.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.187+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~YGJCYQ8LS1LL.2 size=611491 2024-09-12T00:24:22.193 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.195+0000 7f0d199128c0 1 < completed multipart upload key=10YEWZDTTEV0 upload=YGJCYQ8LS1LL tag=L5W8TDNFG4K3 type=write size=3757219 2024-09-12T00:24:22.199 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.199+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~1YYAWH4L225S.0 size=1048576 2024-09-12T00:24:22.202 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.203+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~1YYAWH4L225S.1 size=934123 2024-09-12T00:24:22.202 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.203+0000 7f0d199128c0 1 > prepared multipart upload key=VXZI0ZTMQSV0 upload=1YYAWH4L225S tag=KQG2YUWLDOKS type=write size=3031275 2024-09-12T00:24:22.205 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.203+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~CQQ9UL309JP9.0 size=1048576 2024-09-12T00:24:22.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.207+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~CQQ9UL309JP9.1 size=1048576 2024-09-12T00:24:22.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.211+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~CQQ9UL309JP9.2 size=211963 2024-09-12T00:24:22.216 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.215+0000 7f0d199128c0 1 < completed multipart upload key=0EBWUENN0881 upload=CQQ9UL309JP9 tag=NHRNF0DF1ZGU type=write size=3357691 2024-09-12T00:24:22.223 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.223+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~FI82WGVE4OLF.0 size=724280 2024-09-12T00:24:22.223 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.223+0000 7f0d199128c0 1 > prepared multipart upload key=FJ8YV026H0ZU upload=FI82WGVE4OLF tag=NKO39QIBPTDA type=write size=1772856 2024-09-12T00:24:22.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.231+0000 7f0d199128c0 1 < suggested update operation key=VXZI0ZTMQSV0 tag=BWF1D91B8034 type=write size=239386 2024-09-12T00:24:22.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.235+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~BEXPWZRFB134.0 size=384214 2024-09-12T00:24:22.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.235+0000 7f0d199128c0 1 > prepared multipart upload key=B58RWC9W8THG upload=BEXPWZRFB134 tag=F5SCY131QL30 type=write size=1432790 2024-09-12T00:24:22.242 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.243+0000 7f0d199128c0 1 < suggested update operation key=V6H6S9X0U2A0 tag=X58K7PHF6Y9B type=del size=2718936 2024-09-12T00:24:22.246 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.247+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=3BFJJWW6Z01S type=del size=2095150 2024-09-12T00:24:22.248 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.247+0000 7f0d199128c0 1 < canceled operation key=NXQYUQIR2APT tag=6KDBEQFQ8DNO type=del size=94728 2024-09-12T00:24:22.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.251+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=8SB0FLZV1UYW type=del size=905847 2024-09-12T00:24:22.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.255+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~ZEP3HTIQBMU6.0 size=1048576 2024-09-12T00:24:22.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.255+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~ZEP3HTIQBMU6.1 size=1048576 2024-09-12T00:24:22.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.259+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~ZEP3HTIQBMU6.2 size=330991 2024-09-12T00:24:22.266 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.267+0000 7f0d199128c0 1 < completed multipart upload key=HXNC728XIWC1 upload=ZEP3HTIQBMU6 tag=V6V6FS0G7WCI type=write size=3476719 2024-09-12T00:24:22.272 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.271+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~48QPNXUB7E4W.0 size=1048576 2024-09-12T00:24:22.275 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.275+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~48QPNXUB7E4W.1 size=448175 2024-09-12T00:24:22.275 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.275+0000 7f0d199128c0 1 > prepared multipart upload key=4K654PSDLDVI upload=48QPNXUB7E4W tag=ALCO7SGY2CJ5 type=write size=2545327 2024-09-12T00:24:22.278 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.279+0000 7f0d199128c0 1 < completed delete operation key=IPJEXRBN96NB tag=SCEM9ADY9QMK type=del 2024-09-12T00:24:22.282 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.283+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=P55AFL0VV0WS type=del size=1803581 2024-09-12T00:24:22.282 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.283+0000 7f0d199128c0 1 < canceled part key=_multipart_2EK9CCKG26W2.2~BVCKFY2JUMYS.0 size=1048576 2024-09-12T00:24:22.285 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.283+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~BVCKFY2JUMYS.1 size=1048576 2024-09-12T00:24:22.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.287+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~BVCKFY2JUMYS.2 size=846105 2024-09-12T00:24:22.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.291+0000 7f0d199128c0 1 < canceled multipart upload key=2EK9CCKG26W2 upload=BVCKFY2JUMYS tag=OZNSCZ1WKWYV type=write size=3991833 2024-09-12T00:24:22.298 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.299+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~0GZ9VBCH6PSM.0 size=991727 2024-09-12T00:24:22.299 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.299+0000 7f0d199128c0 1 > prepared multipart upload key=WBGXMJB7U422 upload=0GZ9VBCH6PSM tag=DJRZ3IFWVUI9 type=write size=2040303 2024-09-12T00:24:22.301 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.303+0000 7f0d199128c0 1 < completed delete operation key=37WTPAJGOX5L tag=34QEZ8S6JIIP type=del 2024-09-12T00:24:22.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.307+0000 7f0d199128c0 1 > prepared part key=_multipart_RFCHRGVA9GOI.2~Z8I0Z3F3B51T.0 size=583247 2024-09-12T00:24:22.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.307+0000 7f0d199128c0 1 > prepared multipart upload key=RFCHRGVA9GOI upload=Z8I0Z3F3B51T tag=W7OBRKSNVOWE type=write size=1631823 2024-09-12T00:24:22.314 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.315+0000 7f0d199128c0 1 < suggested update operation key=2EK9CCKG26W2 tag=9F3UNS8NQ046 type=del size=3794044 2024-09-12T00:24:22.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.319+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=5Y9YFDZ7WHJC type=del size=1118143 2024-09-12T00:24:22.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.319+0000 7f0d199128c0 -1 < failed to complete operation key=VXZI0ZTMQSV0 tag=EA500PLWTV0E type=del size=3617489: (22) Invalid argument 2024-09-12T00:24:22.327 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.327+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~ID9R2ZGZWPT2.0 size=1048576 2024-09-12T00:24:22.330 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.331+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~ID9R2ZGZWPT2.1 size=1048576 2024-09-12T00:24:22.332 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.331+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~ID9R2ZGZWPT2.2 size=709887 2024-09-12T00:24:22.332 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.331+0000 7f0d199128c0 1 > prepared multipart upload key=V6H6S9X0U2A0 upload=ID9R2ZGZWPT2 tag=XEUTEIETCK01 type=write size=3855615 2024-09-12T00:24:22.336 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.335+0000 7f0d199128c0 -1 < failed to complete operation key=2EK9CCKG26W2 tag=KTLK34AKACYC type=write size=810892: (22) Invalid argument 2024-09-12T00:24:22.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.339+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=DYBH36LHQTGT type=write size=781055 2024-09-12T00:24:22.343 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.343+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~SR1Y5LO4V798.0 size=1048576 2024-09-12T00:24:22.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.347+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~SR1Y5LO4V798.1 size=615240 2024-09-12T00:24:22.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.351+0000 7f0d199128c0 1 < completed multipart upload key=B58RWC9W8THG upload=SR1Y5LO4V798 tag=2GZ7WZXOJTKM type=write size=2712392 2024-09-12T00:24:22.356 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.355+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=KMO2YOXUFMJ6 type=write size=487572 2024-09-12T00:24:22.360 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.359+0000 7f0d199128c0 1 < completed delete operation key=9I6MZAEUS4I0 tag=CNQ7GJBSEA85 type=del 2024-09-12T00:24:22.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.367+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~SAVK1OFRAUFN.0 size=768929 2024-09-12T00:24:22.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.367+0000 7f0d199128c0 1 > prepared multipart upload key=NXQYUQIR2APT upload=SAVK1OFRAUFN tag=NTY2NKNE3T5I type=write size=1817505 2024-09-12T00:24:22.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.371+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~QC26QZRT51OU.0 size=1048576 2024-09-12T00:24:22.373 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.371+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~QC26QZRT51OU.1 size=1048576 2024-09-12T00:24:22.376 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.375+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~QC26QZRT51OU.2 size=517609 2024-09-12T00:24:22.382 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.383+0000 7f0d199128c0 1 < completed multipart upload key=OVLAP0OS78QG upload=QC26QZRT51OU tag=1B68EFSQNPJK type=write size=3663337 2024-09-12T00:24:22.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.387+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=VAEP3UPBTTVH type=del size=3260188 2024-09-12T00:24:22.390 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.391+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~2YG5D0LL4JDO.0 size=1048576 2024-09-12T00:24:22.393 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.391+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~2YG5D0LL4JDO.1 size=74441 2024-09-12T00:24:22.399 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.399+0000 7f0d199128c0 1 < completed multipart upload key=57W1IO3KSWBR upload=2YG5D0LL4JDO tag=WFL2T13SM1T9 type=write size=2171593 2024-09-12T00:24:22.402 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.403+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=L23UOYGMPJ59 type=del size=3425392 2024-09-12T00:24:22.403 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.403+0000 7f0d199128c0 1 < canceled part key=_multipart_VXZI0ZTMQSV0.2~1YYAWH4L225S.0 size=1048576 2024-09-12T00:24:22.406 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.407+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~1YYAWH4L225S.1 size=934123 2024-09-12T00:24:22.412 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.411+0000 7f0d199128c0 1 < canceled multipart upload key=VXZI0ZTMQSV0 upload=1YYAWH4L225S tag=KQG2YUWLDOKS type=write size=3031275 2024-09-12T00:24:22.415 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.415+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=DNXWYB9B2L5J type=write size=65127 2024-09-12T00:24:22.419 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.419+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~FI82WGVE4OLF.0 size=724280 2024-09-12T00:24:22.431 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.431+0000 7f0d199128c0 1 < completed multipart upload key=FJ8YV026H0ZU upload=FI82WGVE4OLF tag=NKO39QIBPTDA type=write size=1772856 2024-09-12T00:24:22.435 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.435+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=9DI3GBPZO8Q0 type=write size=652154 2024-09-12T00:24:22.438 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.439+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~BEXPWZRFB134.0 size=384214 2024-09-12T00:24:22.444 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.443+0000 7f0d199128c0 1 < completed multipart upload key=B58RWC9W8THG upload=BEXPWZRFB134 tag=F5SCY131QL30 type=write size=1432790 2024-09-12T00:24:22.451 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.451+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~2L44H86FRMFO.0 size=1048576 2024-09-12T00:24:22.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.455+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~2L44H86FRMFO.1 size=1048576 2024-09-12T00:24:22.456 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.455+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~2L44H86FRMFO.2 size=1019112 2024-09-12T00:24:22.456 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.455+0000 7f0d199128c0 1 > prepared multipart upload key=10YEWZDTTEV0 upload=2L44H86FRMFO tag=TA65SD3CREDI type=write size=4164840 2024-09-12T00:24:22.460 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.459+0000 7f0d199128c0 1 < completed delete operation key=T6GOR4SBYU2Y tag=3BFJJWW6Z01S type=del 2024-09-12T00:24:22.463 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.463+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=PM6ETX8QHDTW type=del size=2097130 2024-09-12T00:24:22.467 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.467+0000 7f0d199128c0 1 < completed delete operation key=FJ8YV026H0ZU tag=8SB0FLZV1UYW type=del 2024-09-12T00:24:22.471 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.471+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=H299T0NU36D8 type=del size=3308958 2024-09-12T00:24:22.474 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.475+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~48QPNXUB7E4W.0 size=1048576 2024-09-12T00:24:22.477 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.475+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~48QPNXUB7E4W.1 size=448175 2024-09-12T00:24:22.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.483+0000 7f0d199128c0 1 < completed multipart upload key=4K654PSDLDVI upload=48QPNXUB7E4W tag=ALCO7SGY2CJ5 type=write size=2545327 2024-09-12T00:24:22.486 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.487+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=3CCRVHC2XV1T type=del size=613674 2024-09-12T00:24:22.493 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.491+0000 7f0d199128c0 1 < suggested remove operation key=WPZOKZDFXK4S tag=P55AFL0VV0WS type=del 2024-09-12T00:24:22.497 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.495+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=K7LLZ33CD21V type=write size=454524 2024-09-12T00:24:22.500 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.499+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~0GZ9VBCH6PSM.0 size=991727 2024-09-12T00:24:22.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.507+0000 7f0d199128c0 1 < completed multipart upload key=WBGXMJB7U422 upload=0GZ9VBCH6PSM tag=DJRZ3IFWVUI9 type=write size=2040303 2024-09-12T00:24:22.510 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.511+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=XX1WZ6EXVWSX type=del size=1766710 2024-09-12T00:24:22.513 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.515+0000 7f0d199128c0 1 < completed part key=_multipart_RFCHRGVA9GOI.2~Z8I0Z3F3B51T.0 size=583247 2024-09-12T00:24:22.519 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.519+0000 7f0d199128c0 1 < completed multipart upload key=RFCHRGVA9GOI upload=Z8I0Z3F3B51T tag=W7OBRKSNVOWE type=write size=1631823 2024-09-12T00:24:22.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.527+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~2S8JRG7GN5EM.0 size=87634 2024-09-12T00:24:22.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.527+0000 7f0d199128c0 1 > prepared multipart upload key=OVLAP0OS78QG upload=2S8JRG7GN5EM tag=RWSD563XQ25K type=write size=1136210 2024-09-12T00:24:22.529 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.527+0000 7f0d199128c0 1 < canceled operation key=9I6MZAEUS4I0 tag=5Y9YFDZ7WHJC type=del size=1118143 2024-09-12T00:24:22.536 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.535+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~4J7ZF2ANHH9X.0 size=1048576 2024-09-12T00:24:22.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.539+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~4J7ZF2ANHH9X.1 size=1048576 2024-09-12T00:24:22.541 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.539+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~4J7ZF2ANHH9X.2 size=1044734 2024-09-12T00:24:22.541 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.539+0000 7f0d199128c0 1 > prepared multipart upload key=RX3RVT06SGJ4 upload=4J7ZF2ANHH9X tag=KFCB5PCML4Y7 type=write size=4190462 2024-09-12T00:24:22.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.543+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~ID9R2ZGZWPT2.0 size=1048576 2024-09-12T00:24:22.548 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.547+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~ID9R2ZGZWPT2.1 size=1048576 2024-09-12T00:24:22.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.551+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~ID9R2ZGZWPT2.2 size=709887 2024-09-12T00:24:22.556 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.555+0000 7f0d199128c0 1 < completed multipart upload key=V6H6S9X0U2A0 upload=ID9R2ZGZWPT2 tag=XEUTEIETCK01 type=write size=3855615 2024-09-12T00:24:22.562 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.563+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~7GBN6AQ0DDQE.0 size=1048576 2024-09-12T00:24:22.565 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.563+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~7GBN6AQ0DDQE.1 size=392022 2024-09-12T00:24:22.565 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.563+0000 7f0d199128c0 1 > prepared multipart upload key=YTXW98O07966 upload=7GBN6AQ0DDQE tag=5TBMYCGZOU0C type=write size=2489174 2024-09-12T00:24:22.568 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.567+0000 7f0d199128c0 1 < completed write operation key=YTXW98O07966 tag=DYBH36LHQTGT type=write size=781055 2024-09-12T00:24:22.572 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.571+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=R6F5YBG20U9K type=del size=2057544 2024-09-12T00:24:22.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.575+0000 7f0d199128c0 1 < completed write operation key=T6GOR4SBYU2Y tag=KMO2YOXUFMJ6 type=write size=487572 2024-09-12T00:24:22.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.579+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=0GOK3PRO8DPM type=del size=3695732 2024-09-12T00:24:22.583 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.583+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~SAVK1OFRAUFN.0 size=768929 2024-09-12T00:24:22.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.591+0000 7f0d199128c0 1 < completed multipart upload key=NXQYUQIR2APT upload=SAVK1OFRAUFN tag=NTY2NKNE3T5I type=write size=1817505 2024-09-12T00:24:22.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.591+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=UJURREKFFILW type=del size=1724 2024-09-12T00:24:22.596 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.595+0000 7f0d199128c0 1 < completed delete operation key=PK2CA62QBZXS tag=VAEP3UPBTTVH type=del 2024-09-12T00:24:22.600 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.599+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=TR80B7F1DT33 type=del size=405778 2024-09-12T00:24:22.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.603+0000 7f0d199128c0 1 < completed delete operation key=IPJEXRBN96NB tag=L23UOYGMPJ59 type=del 2024-09-12T00:24:22.608 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.607+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=0FKNPKLSH2SM type=del size=401912 2024-09-12T00:24:22.612 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.611+0000 7f0d199128c0 1 < completed write operation key=H604SA6XTFLY tag=DNXWYB9B2L5J type=write size=65127 2024-09-12T00:24:22.618 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.619+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~1VH2IA7GLZ0B.0 size=1048576 2024-09-12T00:24:22.621 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.623+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~1VH2IA7GLZ0B.1 size=365871 2024-09-12T00:24:22.621 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.623+0000 7f0d199128c0 1 > prepared multipart upload key=1Y6B1MJP5G4L upload=1VH2IA7GLZ0B tag=1ARBLQ6ADA76 type=write size=2463023 2024-09-12T00:24:22.625 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.623+0000 7f0d199128c0 1 < completed write operation key=J75P0821XGRO tag=9DI3GBPZO8Q0 type=write size=652154 2024-09-12T00:24:22.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.627+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=191XH7RGUWPC type=write size=767383 2024-09-12T00:24:22.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.631+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~2L44H86FRMFO.0 size=1048576 2024-09-12T00:24:22.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.631+0000 7f0d199128c0 1 < canceled part key=_multipart_10YEWZDTTEV0.2~2L44H86FRMFO.1 size=1048576 2024-09-12T00:24:22.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.635+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~2L44H86FRMFO.2 size=1019112 2024-09-12T00:24:22.641 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.639+0000 7f0d199128c0 1 < canceled multipart upload key=10YEWZDTTEV0 upload=2L44H86FRMFO tag=TA65SD3CREDI type=write size=4164840 2024-09-12T00:24:22.647 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.647+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~IL0IK3R0C8FE.0 size=1048576 2024-09-12T00:24:22.650 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.651+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~IL0IK3R0C8FE.1 size=1048576 2024-09-12T00:24:22.653 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.651+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~IL0IK3R0C8FE.2 size=740071 2024-09-12T00:24:22.653 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.651+0000 7f0d199128c0 1 > prepared multipart upload key=SITJU2EUVSR8 upload=IL0IK3R0C8FE tag=G0CUGG73XF1D type=write size=3885799 2024-09-12T00:24:22.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.655+0000 7f0d199128c0 -1 < failed to complete operation key=WPZOKZDFXK4S tag=PM6ETX8QHDTW type=del size=2097130: (22) Invalid argument 2024-09-12T00:24:22.659 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.659+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=K831FV6KAJCR type=del size=4018004 2024-09-12T00:24:22.666 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.667+0000 7f0d199128c0 1 < suggested update operation key=WBGXMJB7U422 tag=H299T0NU36D8 type=del size=3308958 2024-09-12T00:24:22.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.671+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=VENQ13XV3F8U type=del size=192610 2024-09-12T00:24:22.677 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.675+0000 7f0d199128c0 1 < suggested remove operation key=SITJU2EUVSR8 tag=3CCRVHC2XV1T type=del 2024-09-12T00:24:22.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.683+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~MCZMVAMRURLN.0 size=1048576 2024-09-12T00:24:22.686 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.687+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~MCZMVAMRURLN.1 size=189351 2024-09-12T00:24:22.686 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.687+0000 7f0d199128c0 1 > prepared multipart upload key=JA6CSJF78VE2 upload=MCZMVAMRURLN tag=TSCPFT28THA1 type=write size=2286503 2024-09-12T00:24:22.689 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.691+0000 7f0d199128c0 1 < completed write operation key=RFCHRGVA9GOI tag=K7LLZ33CD21V type=write size=454524 2024-09-12T00:24:22.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.695+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~8199X0KUAST6.0 size=1048576 2024-09-12T00:24:22.699 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.699+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~8199X0KUAST6.1 size=1048576 2024-09-12T00:24:22.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.703+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~8199X0KUAST6.2 size=990573 2024-09-12T00:24:22.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.703+0000 7f0d199128c0 1 > prepared multipart upload key=T6GOR4SBYU2Y upload=8199X0KUAST6 tag=WWZJ5THL8Q6J type=write size=4136301 2024-09-12T00:24:22.710 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.711+0000 7f0d199128c0 1 < suggested remove operation key=RX3RVT06SGJ4 tag=XX1WZ6EXVWSX type=del 2024-09-12T00:24:22.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.715+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~E52VIBIKKZVL.0 size=54854 2024-09-12T00:24:22.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.715+0000 7f0d199128c0 1 > prepared multipart upload key=37WTPAJGOX5L upload=E52VIBIKKZVL tag=9QP3B4LAK9BM type=write size=1103430 2024-09-12T00:24:22.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.719+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~2S8JRG7GN5EM.0 size=87634 2024-09-12T00:24:22.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.727+0000 7f0d199128c0 1 < completed multipart upload key=OVLAP0OS78QG upload=2S8JRG7GN5EM tag=RWSD563XQ25K type=write size=1136210 2024-09-12T00:24:22.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.727+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=CQ31O1PMT0DU type=write size=59543 2024-09-12T00:24:22.733 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.731+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~4J7ZF2ANHH9X.0 size=1048576 2024-09-12T00:24:22.735 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.735+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~4J7ZF2ANHH9X.1 size=1048576 2024-09-12T00:24:22.735 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.735+0000 7f0d199128c0 1 < canceled part key=_multipart_RX3RVT06SGJ4.2~4J7ZF2ANHH9X.2 size=1044734 2024-09-12T00:24:22.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.739+0000 7f0d199128c0 1 < canceled multipart upload key=RX3RVT06SGJ4 upload=4J7ZF2ANHH9X tag=KFCB5PCML4Y7 type=write size=4190462 2024-09-12T00:24:22.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.743+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=GMCVTWD0E8CS type=del size=1364935 2024-09-12T00:24:22.749 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.747+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~7GBN6AQ0DDQE.0 size=1048576 2024-09-12T00:24:22.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.751+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~7GBN6AQ0DDQE.1 size=392022 2024-09-12T00:24:22.762 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.763+0000 7f0d199128c0 1 < completed multipart upload key=YTXW98O07966 upload=7GBN6AQ0DDQE tag=5TBMYCGZOU0C type=write size=2489174 2024-09-12T00:24:22.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.763+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=OV6NLCSJQB82 type=write size=905569 2024-09-12T00:24:22.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.767+0000 7f0d199128c0 1 < completed delete operation key=T6GOR4SBYU2Y tag=R6F5YBG20U9K type=del 2024-09-12T00:24:22.772 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.771+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=RF3F21F897RM type=del size=3438757 2024-09-12T00:24:22.776 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.775+0000 7f0d199128c0 1 < completed delete operation key=T6GOR4SBYU2Y tag=0GOK3PRO8DPM type=del 2024-09-12T00:24:22.782 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.783+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~EXY317TGPM1R.0 size=1048576 2024-09-12T00:24:22.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.787+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~EXY317TGPM1R.1 size=357746 2024-09-12T00:24:22.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.787+0000 7f0d199128c0 1 > prepared multipart upload key=0EBWUENN0881 upload=EXY317TGPM1R tag=5D8U0GSWX90N type=write size=2454898 2024-09-12T00:24:22.789 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.787+0000 7f0d199128c0 1 < completed delete operation key=37WTPAJGOX5L tag=UJURREKFFILW type=del 2024-09-12T00:24:22.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.791+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=1HF4EXMMGVU7 type=del size=2813395 2024-09-12T00:24:22.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.795+0000 7f0d199128c0 1 < completed delete operation key=J75P0821XGRO tag=TR80B7F1DT33 type=del 2024-09-12T00:24:22.803 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.803+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~RVY3FVUXWCCN.0 size=1048576 2024-09-12T00:24:22.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.807+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~RVY3FVUXWCCN.1 size=1048576 2024-09-12T00:24:22.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.807+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~RVY3FVUXWCCN.2 size=1046362 2024-09-12T00:24:22.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.807+0000 7f0d199128c0 1 > prepared multipart upload key=RX3RVT06SGJ4 upload=RVY3FVUXWCCN tag=YFH7AQHWYTBG type=write size=4192090 2024-09-12T00:24:22.812 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.811+0000 7f0d199128c0 1 < completed delete operation key=YTXW98O07966 tag=0FKNPKLSH2SM type=del 2024-09-12T00:24:22.819 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.819+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~ELEMTAOAAREV.0 size=1048576 2024-09-12T00:24:22.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.823+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~ELEMTAOAAREV.1 size=681334 2024-09-12T00:24:22.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.823+0000 7f0d199128c0 1 > prepared multipart upload key=4K654PSDLDVI upload=ELEMTAOAAREV tag=BBNW01NJ3OWM type=write size=2778486 2024-09-12T00:24:22.826 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.827+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~1VH2IA7GLZ0B.0 size=1048576 2024-09-12T00:24:22.829 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.827+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~1VH2IA7GLZ0B.1 size=365871 2024-09-12T00:24:22.834 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.835+0000 7f0d199128c0 1 < completed multipart upload key=1Y6B1MJP5G4L upload=1VH2IA7GLZ0B tag=1ARBLQ6ADA76 type=write size=2463023 2024-09-12T00:24:22.839 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.839+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=G2BELNORDEG1 type=write size=921970 2024-09-12T00:24:22.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.847+0000 7f0d199128c0 1 < suggested remove operation key=2EK9CCKG26W2 tag=191XH7RGUWPC type=write 2024-09-12T00:24:22.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.855+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~RPK5NA6IAJOO.0 size=1048576 2024-09-12T00:24:22.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.855+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~RPK5NA6IAJOO.1 size=1048576 2024-09-12T00:24:22.859 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.859+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~RPK5NA6IAJOO.2 size=996021 2024-09-12T00:24:22.859 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.859+0000 7f0d199128c0 1 > prepared multipart upload key=OVLAP0OS78QG upload=RPK5NA6IAJOO tag=0E70J12R4O5G type=write size=4141749 2024-09-12T00:24:22.862 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.863+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~IL0IK3R0C8FE.0 size=1048576 2024-09-12T00:24:22.865 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.863+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~IL0IK3R0C8FE.1 size=1048576 2024-09-12T00:24:22.868 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.867+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~IL0IK3R0C8FE.2 size=740071 2024-09-12T00:24:22.874 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.875+0000 7f0d199128c0 1 < completed multipart upload key=SITJU2EUVSR8 upload=IL0IK3R0C8FE tag=G0CUGG73XF1D type=write size=3885799 2024-09-12T00:24:22.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.875+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=F1R335YQXF2Z type=del size=1436496 2024-09-12T00:24:22.881 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.879+0000 7f0d199128c0 -1 < failed to complete operation key=RX3RVT06SGJ4 tag=K831FV6KAJCR type=del size=4018004: (22) Invalid argument 2024-09-12T00:24:22.884 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.883+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=3AZ0ZOZ9GUYO type=del size=1979623 2024-09-12T00:24:22.888 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.887+0000 7f0d199128c0 1 < canceled operation key=NXQYUQIR2APT tag=VENQ13XV3F8U type=del size=192610 2024-09-12T00:24:22.891 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.891+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=D2PDW3FAJKIE type=del size=360076 2024-09-12T00:24:22.892 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.891+0000 7f0d199128c0 1 < canceled part key=_multipart_JA6CSJF78VE2.2~MCZMVAMRURLN.0 size=1048576 2024-09-12T00:24:22.895 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.895+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~MCZMVAMRURLN.1 size=189351 2024-09-12T00:24:22.900 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.899+0000 7f0d199128c0 1 < canceled multipart upload key=JA6CSJF78VE2 upload=MCZMVAMRURLN tag=TSCPFT28THA1 type=write size=2286503 2024-09-12T00:24:22.904 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.903+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=6RQHX5PVH6DN type=del size=2627798 2024-09-12T00:24:22.907 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.907+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~8199X0KUAST6.0 size=1048576 2024-09-12T00:24:22.909 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.911+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~8199X0KUAST6.1 size=1048576 2024-09-12T00:24:22.912 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.911+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~8199X0KUAST6.2 size=990573 2024-09-12T00:24:22.917 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.915+0000 7f0d199128c0 1 < completed multipart upload key=T6GOR4SBYU2Y upload=8199X0KUAST6 tag=WWZJ5THL8Q6J type=write size=4136301 2024-09-12T00:24:22.919 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.919+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=H3K7UBMI18FW type=del size=519674 2024-09-12T00:24:22.922 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.923+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~E52VIBIKKZVL.0 size=54854 2024-09-12T00:24:22.926 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.927+0000 7f0d199128c0 1 < completed multipart upload key=37WTPAJGOX5L upload=E52VIBIKKZVL tag=9QP3B4LAK9BM type=write size=1103430 2024-09-12T00:24:22.929 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.931+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=TYBAMRCUKZ4P type=write size=512386 2024-09-12T00:24:22.935 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.935+0000 7f0d199128c0 1 < suggested update operation key=V6H6S9X0U2A0 tag=CQ31O1PMT0DU type=write size=59543 2024-09-12T00:24:22.940 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.939+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~LJMLU4H0LOFT.0 size=1048576 2024-09-12T00:24:22.943 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.943+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~LJMLU4H0LOFT.1 size=875894 2024-09-12T00:24:22.943 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.943+0000 7f0d199128c0 1 > prepared multipart upload key=0ZT4NZYZKI5Z upload=LJMLU4H0LOFT tag=WNI3OI1L35D2 type=write size=2973046 2024-09-12T00:24:22.945 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.947+0000 7f0d199128c0 1 < canceled operation key=10YEWZDTTEV0 tag=GMCVTWD0E8CS type=del size=1364935 2024-09-12T00:24:22.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.947+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=VS31E0QGCBTV type=write size=947660 2024-09-12T00:24:22.951 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.951+0000 7f0d199128c0 1 < completed write operation key=RFCHRGVA9GOI tag=OV6NLCSJQB82 type=write size=905569 2024-09-12T00:24:22.954 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.955+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=3K2Q44LDYTSM type=del size=1165110 2024-09-12T00:24:22.956 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.955+0000 7f0d199128c0 -1 < failed to complete operation key=2EK9CCKG26W2 tag=RF3F21F897RM type=del size=3438757: (22) Invalid argument 2024-09-12T00:24:22.959 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.959+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=DDV7Z23JSECQ type=del size=2973980 2024-09-12T00:24:22.961 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.963+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~EXY317TGPM1R.0 size=1048576 2024-09-12T00:24:22.964 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.963+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~EXY317TGPM1R.1 size=357746 2024-09-12T00:24:22.967 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.967+0000 7f0d199128c0 1 < completed multipart upload key=0EBWUENN0881 upload=EXY317TGPM1R tag=5D8U0GSWX90N type=write size=2454898 2024-09-12T00:24:22.971 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.971+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~X5KSONV1KJ2H.0 size=433790 2024-09-12T00:24:22.971 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.971+0000 7f0d199128c0 1 > prepared multipart upload key=PK2CA62QBZXS upload=X5KSONV1KJ2H tag=3QJT2CCMN5KR type=write size=1482366 2024-09-12T00:24:22.974 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.975+0000 7f0d199128c0 1 < completed delete operation key=RFCHRGVA9GOI tag=1HF4EXMMGVU7 type=del 2024-09-12T00:24:22.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.975+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=DLSGC82VVT01 type=del size=3907579 2024-09-12T00:24:22.980 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.979+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~RVY3FVUXWCCN.0 size=1048576 2024-09-12T00:24:22.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.983+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~RVY3FVUXWCCN.1 size=1048576 2024-09-12T00:24:22.985 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.983+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~RVY3FVUXWCCN.2 size=1046362 2024-09-12T00:24:22.989 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.991+0000 7f0d199128c0 1 < completed multipart upload key=RX3RVT06SGJ4 upload=RVY3FVUXWCCN tag=YFH7AQHWYTBG type=write size=4192090 2024-09-12T00:24:22.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.995+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~397RDBZZ21TO.0 size=1048576 2024-09-12T00:24:22.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.995+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~397RDBZZ21TO.1 size=1048576 2024-09-12T00:24:22.998 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.999+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~397RDBZZ21TO.2 size=304454 2024-09-12T00:24:22.999 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:22.999+0000 7f0d199128c0 1 > prepared multipart upload key=1Y6B1MJP5G4L upload=397RDBZZ21TO tag=S6F89CCEPOUN type=write size=3450182 2024-09-12T00:24:23.001 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.003+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~ELEMTAOAAREV.0 size=1048576 2024-09-12T00:24:23.002 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.003+0000 7f0d199128c0 1 < canceled part key=_multipart_4K654PSDLDVI.2~ELEMTAOAAREV.1 size=681334 2024-09-12T00:24:23.006 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.007+0000 7f0d199128c0 1 < canceled multipart upload key=4K654PSDLDVI upload=ELEMTAOAAREV tag=BBNW01NJ3OWM type=write size=2778486 2024-09-12T00:24:23.011 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.011+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~1ZSP79UQRXVM.0 size=915857 2024-09-12T00:24:23.011 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.011+0000 7f0d199128c0 1 > prepared multipart upload key=QUO5ND3O41TY upload=1ZSP79UQRXVM tag=XNKFX9IP6FT2 type=write size=1964433 2024-09-12T00:24:23.014 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.015+0000 7f0d199128c0 1 < completed write operation key=A529WOKFD1NI tag=G2BELNORDEG1 type=write size=921970 2024-09-12T00:24:23.017 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.015+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=34BBEEU270LG type=del size=3986073 2024-09-12T00:24:23.019 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.019+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~RPK5NA6IAJOO.0 size=1048576 2024-09-12T00:24:23.021 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.023+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~RPK5NA6IAJOO.1 size=1048576 2024-09-12T00:24:23.024 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.023+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~RPK5NA6IAJOO.2 size=996021 2024-09-12T00:24:23.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.027+0000 7f0d199128c0 1 < completed multipart upload key=OVLAP0OS78QG upload=RPK5NA6IAJOO tag=0E70J12R4O5G type=write size=4141749 2024-09-12T00:24:23.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.035+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~7VLRZGTEIQMQ.0 size=1048576 2024-09-12T00:24:23.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.035+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~7VLRZGTEIQMQ.1 size=606649 2024-09-12T00:24:23.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.035+0000 7f0d199128c0 1 > prepared multipart upload key=10YEWZDTTEV0 upload=7VLRZGTEIQMQ tag=PX0IGK3P7DMV type=write size=2703801 2024-09-12T00:24:23.041 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.039+0000 7f0d199128c0 1 < suggested remove operation key=QUO5ND3O41TY tag=F1R335YQXF2Z type=del 2024-09-12T00:24:23.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.043+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=NWA5YBS1ID4Q type=del size=2243712 2024-09-12T00:24:23.053 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.051+0000 7f0d199128c0 1 < suggested remove operation key=4K654PSDLDVI tag=3AZ0ZOZ9GUYO type=del 2024-09-12T00:24:23.055 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.055+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=W3JJA3C76TYU type=del size=1082679 2024-09-12T00:24:23.058 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.059+0000 7f0d199128c0 1 < completed delete operation key=J75P0821XGRO tag=D2PDW3FAJKIE type=del 2024-09-12T00:24:23.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.063+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~LMDGFBX5MBP1.0 size=1048576 2024-09-12T00:24:23.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.067+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~LMDGFBX5MBP1.1 size=1048576 2024-09-12T00:24:23.068 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.067+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~LMDGFBX5MBP1.2 size=937026 2024-09-12T00:24:23.068 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.067+0000 7f0d199128c0 1 > prepared multipart upload key=A529WOKFD1NI upload=LMDGFBX5MBP1 tag=H1GFOPY4N02Z type=write size=4082754 2024-09-12T00:24:23.071 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.071+0000 7f0d199128c0 1 < canceled operation key=A529WOKFD1NI tag=6RQHX5PVH6DN type=del size=2627798 2024-09-12T00:24:23.077 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.075+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~S9X8PAIW460A.0 size=1048576 2024-09-12T00:24:23.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.079+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~S9X8PAIW460A.1 size=1048576 2024-09-12T00:24:23.081 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.079+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~S9X8PAIW460A.2 size=452501 2024-09-12T00:24:23.081 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.079+0000 7f0d199128c0 1 > prepared multipart upload key=VXZI0ZTMQSV0 upload=S9X8PAIW460A tag=RH7EODD3ETOV type=write size=3598229 2024-09-12T00:24:23.084 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.083+0000 7f0d199128c0 1 < completed delete operation key=PK2CA62QBZXS tag=H3K7UBMI18FW type=del 2024-09-12T00:24:23.086 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.087+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=QRNG3DHJIG5K type=del size=2053292 2024-09-12T00:24:23.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.091+0000 7f0d199128c0 1 < completed write operation key=YTXW98O07966 tag=TYBAMRCUKZ4P type=write size=512386 2024-09-12T00:24:23.092 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.091+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=0TNKR7GT1NGL type=del size=1229092 2024-09-12T00:24:23.095 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.095+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~LJMLU4H0LOFT.0 size=1048576 2024-09-12T00:24:23.095 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.095+0000 7f0d199128c0 1 < canceled part key=_multipart_0ZT4NZYZKI5Z.2~LJMLU4H0LOFT.1 size=875894 2024-09-12T00:24:23.099 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.099+0000 7f0d199128c0 1 < canceled multipart upload key=0ZT4NZYZKI5Z upload=LJMLU4H0LOFT tag=WNI3OI1L35D2 type=write size=2973046 2024-09-12T00:24:23.102 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.103+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=5YEOJO0E3TVW type=write size=564019 2024-09-12T00:24:23.105 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.107+0000 7f0d199128c0 1 < completed write operation key=0ZT4NZYZKI5Z tag=VS31E0QGCBTV type=write size=947660 2024-09-12T00:24:23.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.111+0000 7f0d199128c0 1 > prepared part key=_multipart_RFCHRGVA9GOI.2~7VY1UNR25LK2.0 size=591616 2024-09-12T00:24:23.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.111+0000 7f0d199128c0 1 > prepared multipart upload key=RFCHRGVA9GOI upload=7VY1UNR25LK2 tag=QMWNQ81VNTXN type=write size=1640192 2024-09-12T00:24:23.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.115+0000 7f0d199128c0 1 < completed delete operation key=J75P0821XGRO tag=3K2Q44LDYTSM type=del 2024-09-12T00:24:23.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.115+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=EEAUWJH0Q5CU type=del size=2431208 2024-09-12T00:24:23.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.119+0000 7f0d199128c0 1 < canceled operation key=RFCHRGVA9GOI tag=DDV7Z23JSECQ type=del size=2973980 2024-09-12T00:24:23.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.123+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=OBWMD6VSM8WW type=write size=195035 2024-09-12T00:24:23.126 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.127+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~X5KSONV1KJ2H.0 size=433790 2024-09-12T00:24:23.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.131+0000 7f0d199128c0 1 < completed multipart upload key=PK2CA62QBZXS upload=X5KSONV1KJ2H tag=3QJT2CCMN5KR type=write size=1482366 2024-09-12T00:24:23.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.135+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=05CTNDVK31ZS type=del size=3283671 2024-09-12T00:24:23.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.135+0000 7f0d199128c0 -1 < failed to complete operation key=4K654PSDLDVI tag=DLSGC82VVT01 type=del size=3907579: (22) Invalid argument 2024-09-12T00:24:23.139 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.139+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=9V53SVP3TG52 type=del size=3007557 2024-09-12T00:24:23.140 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.139+0000 7f0d199128c0 1 < canceled part key=_multipart_1Y6B1MJP5G4L.2~397RDBZZ21TO.0 size=1048576 2024-09-12T00:24:23.142 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.143+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~397RDBZZ21TO.1 size=1048576 2024-09-12T00:24:23.142 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.143+0000 7f0d199128c0 1 < canceled part key=_multipart_1Y6B1MJP5G4L.2~397RDBZZ21TO.2 size=304454 2024-09-12T00:24:23.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.147+0000 7f0d199128c0 1 < canceled multipart upload key=1Y6B1MJP5G4L upload=397RDBZZ21TO tag=S6F89CCEPOUN type=write size=3450182 2024-09-12T00:24:23.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.151+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=9N4HISX6VJW5 type=del size=4166183 2024-09-12T00:24:23.153 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.151+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~1ZSP79UQRXVM.0 size=915857 2024-09-12T00:24:23.157 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.159+0000 7f0d199128c0 1 < completed multipart upload key=QUO5ND3O41TY upload=1ZSP79UQRXVM tag=XNKFX9IP6FT2 type=write size=1964433 2024-09-12T00:24:23.163 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.163+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~KPLGJA46HS6X.0 size=1048576 2024-09-12T00:24:23.165 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.163+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~KPLGJA46HS6X.1 size=910765 2024-09-12T00:24:23.165 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.163+0000 7f0d199128c0 1 > prepared multipart upload key=2EK9CCKG26W2 upload=KPLGJA46HS6X tag=N7ZBW4GWOH2C type=write size=3007917 2024-09-12T00:24:23.168 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.167+0000 7f0d199128c0 1 < completed delete operation key=RX3RVT06SGJ4 tag=34BBEEU270LG type=del 2024-09-12T00:24:23.173 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.171+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~2QJDULWDX9SF.0 size=1048576 2024-09-12T00:24:23.174 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.175+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~2QJDULWDX9SF.1 size=465181 2024-09-12T00:24:23.175 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.175+0000 7f0d199128c0 1 > prepared multipart upload key=B58RWC9W8THG upload=2QJDULWDX9SF tag=I4PC7DMGT7JQ type=write size=2562333 2024-09-12T00:24:23.178 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.179+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~7VLRZGTEIQMQ.0 size=1048576 2024-09-12T00:24:23.180 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.179+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~7VLRZGTEIQMQ.1 size=606649 2024-09-12T00:24:23.185 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.183+0000 7f0d199128c0 1 < completed multipart upload key=10YEWZDTTEV0 upload=7VLRZGTEIQMQ tag=PX0IGK3P7DMV type=write size=2703801 2024-09-12T00:24:23.191 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.191+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~7NVJO5XAAI1R.0 size=1048576 2024-09-12T00:24:23.193 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.191+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~7NVJO5XAAI1R.1 size=403106 2024-09-12T00:24:23.193 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.191+0000 7f0d199128c0 1 > prepared multipart upload key=ZWGD87Z1MMNK upload=7NVJO5XAAI1R tag=GSZRUO7ZAFL9 type=write size=2500258 2024-09-12T00:24:23.199 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.199+0000 7f0d199128c0 1 < suggested remove operation key=B58RWC9W8THG tag=NWA5YBS1ID4Q type=del 2024-09-12T00:24:23.202 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.203+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=8GY7JX12NYZY type=del size=3201123 2024-09-12T00:24:23.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.207+0000 7f0d199128c0 1 < suggested update operation key=T6GOR4SBYU2Y tag=W3JJA3C76TYU type=del size=1082679 2024-09-12T00:24:23.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.211+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=4NU0B9SH6GA1 type=del size=1202906 2024-09-12T00:24:23.214 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.215+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~LMDGFBX5MBP1.0 size=1048576 2024-09-12T00:24:23.216 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.215+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~LMDGFBX5MBP1.1 size=1048576 2024-09-12T00:24:23.219 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.219+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~LMDGFBX5MBP1.2 size=937026 2024-09-12T00:24:23.225 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.223+0000 7f0d199128c0 1 < completed multipart upload key=A529WOKFD1NI upload=LMDGFBX5MBP1 tag=H1GFOPY4N02Z type=write size=4082754 2024-09-12T00:24:23.231 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.231+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~FURFW0D73GPK.0 size=1048576 2024-09-12T00:24:23.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.231+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~FURFW0D73GPK.1 size=329498 2024-09-12T00:24:23.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.231+0000 7f0d199128c0 1 > prepared multipart upload key=QUO5ND3O41TY upload=FURFW0D73GPK tag=R53J96ZJIZXX type=write size=2426650 2024-09-12T00:24:23.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.235+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~S9X8PAIW460A.0 size=1048576 2024-09-12T00:24:23.238 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.239+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~S9X8PAIW460A.1 size=1048576 2024-09-12T00:24:23.240 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.239+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~S9X8PAIW460A.2 size=452501 2024-09-12T00:24:23.246 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.247+0000 7f0d199128c0 1 < completed multipart upload key=VXZI0ZTMQSV0 upload=S9X8PAIW460A tag=RH7EODD3ETOV type=write size=3598229 2024-09-12T00:24:23.249 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.247+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=R5K9UJLMFWWE type=del size=1121396 2024-09-12T00:24:23.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.251+0000 7f0d199128c0 1 < completed delete operation key=H604SA6XTFLY tag=QRNG3DHJIG5K type=del 2024-09-12T00:24:23.255 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.255+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=8JCAZFZXOIYE type=write size=351207 2024-09-12T00:24:23.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.259+0000 7f0d199128c0 1 < completed delete operation key=ZWGD87Z1MMNK tag=0TNKR7GT1NGL type=del 2024-09-12T00:24:23.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.263+0000 7f0d199128c0 1 > prepared operation key=57W1IO3KSWBR tag=2VGKXYF2MCN3 type=del size=785680 2024-09-12T00:24:23.268 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.267+0000 7f0d199128c0 1 < suggested update operation key=JA6CSJF78VE2 tag=5YEOJO0E3TVW type=write size=564019 2024-09-12T00:24:23.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.271+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=F7XBZ4R7AH85 type=del size=422041 2024-09-12T00:24:23.274 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.275+0000 7f0d199128c0 1 < completed part key=_multipart_RFCHRGVA9GOI.2~7VY1UNR25LK2.0 size=591616 2024-09-12T00:24:23.281 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.279+0000 7f0d199128c0 1 < completed multipart upload key=RFCHRGVA9GOI upload=7VY1UNR25LK2 tag=QMWNQ81VNTXN type=write size=1640192 2024-09-12T00:24:23.286 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.287+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~5LXYQ8OB3FYT.0 size=1048576 2024-09-12T00:24:23.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.287+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~5LXYQ8OB3FYT.1 size=219273 2024-09-12T00:24:23.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.287+0000 7f0d199128c0 1 > prepared multipart upload key=YTXW98O07966 upload=5LXYQ8OB3FYT tag=3F71GBRKSH8W type=write size=2316425 2024-09-12T00:24:23.292 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.291+0000 7f0d199128c0 1 < canceled operation key=1Y6B1MJP5G4L tag=EEAUWJH0Q5CU type=del size=2431208 2024-09-12T00:24:23.295 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.295+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=3N4LTDHSQOAJ type=del size=558964 2024-09-12T00:24:23.297 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.299+0000 7f0d199128c0 1 < completed write operation key=ZWGD87Z1MMNK tag=OBWMD6VSM8WW type=write size=195035 2024-09-12T00:24:23.301 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.299+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=1SN5H2FL5BGV type=del size=166588 2024-09-12T00:24:23.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.307+0000 7f0d199128c0 1 < suggested remove operation key=PK2CA62QBZXS tag=05CTNDVK31ZS type=del 2024-09-12T00:24:23.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.311+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=D32FPDHADK97 type=del size=1054121 2024-09-12T00:24:23.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.311+0000 7f0d199128c0 1 < completed delete operation key=NXQYUQIR2APT tag=9V53SVP3TG52 type=del 2024-09-12T00:24:23.316 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.315+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=PNQU7HLAAZB4 type=del size=4178008 2024-09-12T00:24:23.319 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.319+0000 7f0d199128c0 1 < canceled operation key=RFCHRGVA9GOI tag=9N4HISX6VJW5 type=del size=4166183 2024-09-12T00:24:23.324 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.323+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~QK98LSST2VXB.0 size=547491 2024-09-12T00:24:23.325 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.323+0000 7f0d199128c0 1 > prepared multipart upload key=4K654PSDLDVI upload=QK98LSST2VXB tag=XHRV7DNANIN2 type=write size=1596067 2024-09-12T00:24:23.331 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.331+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~KPLGJA46HS6X.0 size=1048576 2024-09-12T00:24:23.333 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.331+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~KPLGJA46HS6X.1 size=910765 2024-09-12T00:24:23.338 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.339+0000 7f0d199128c0 1 < completed multipart upload key=2EK9CCKG26W2 upload=KPLGJA46HS6X tag=N7ZBW4GWOH2C type=write size=3007917 2024-09-12T00:24:23.343 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.343+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~LWWY7UZ1ZXKS.0 size=1048576 2024-09-12T00:24:23.345 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.347+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~LWWY7UZ1ZXKS.1 size=695782 2024-09-12T00:24:23.345 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.347+0000 7f0d199128c0 1 > prepared multipart upload key=57W1IO3KSWBR upload=LWWY7UZ1ZXKS tag=FWNZ0BXR6E0R type=write size=2792934 2024-09-12T00:24:23.348 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.347+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~2QJDULWDX9SF.0 size=1048576 2024-09-12T00:24:23.350 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.351+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~2QJDULWDX9SF.1 size=465181 2024-09-12T00:24:23.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.355+0000 7f0d199128c0 1 < completed multipart upload key=B58RWC9W8THG upload=2QJDULWDX9SF tag=I4PC7DMGT7JQ type=write size=2562333 2024-09-12T00:24:23.359 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.359+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~793GIVG2YBGZ.0 size=1048576 2024-09-12T00:24:23.362 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.363+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~793GIVG2YBGZ.1 size=1048576 2024-09-12T00:24:23.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.363+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~793GIVG2YBGZ.2 size=853297 2024-09-12T00:24:23.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.363+0000 7f0d199128c0 1 > prepared multipart upload key=GH0FNY2AI00G upload=793GIVG2YBGZ tag=009WXDTTQIDL type=write size=3999025 2024-09-12T00:24:23.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.367+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~7NVJO5XAAI1R.0 size=1048576 2024-09-12T00:24:23.369 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.367+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~7NVJO5XAAI1R.1 size=403106 2024-09-12T00:24:23.373 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.371+0000 7f0d199128c0 1 < completed multipart upload key=ZWGD87Z1MMNK upload=7NVJO5XAAI1R tag=GSZRUO7ZAFL9 type=write size=2500258 2024-09-12T00:24:23.376 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.375+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=DCLPJN85P9QX type=write size=598796 2024-09-12T00:24:23.380 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.379+0000 7f0d199128c0 1 < completed delete operation key=FJ8YV026H0ZU tag=8GY7JX12NYZY type=del 2024-09-12T00:24:23.385 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.383+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~96UPWPDZWL2V.0 size=775822 2024-09-12T00:24:23.385 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.383+0000 7f0d199128c0 1 > prepared multipart upload key=9I6MZAEUS4I0 upload=96UPWPDZWL2V tag=VWBIM7LFPQP5 type=write size=1824398 2024-09-12T00:24:23.390 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.391+0000 7f0d199128c0 1 < suggested remove operation key=SITJU2EUVSR8 tag=4NU0B9SH6GA1 type=del 2024-09-12T00:24:23.393 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.391+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=CDCJ38PVO2H0 type=del size=1533395 2024-09-12T00:24:23.396 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.395+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~FURFW0D73GPK.0 size=1048576 2024-09-12T00:24:23.398 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.399+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~FURFW0D73GPK.1 size=329498 2024-09-12T00:24:23.402 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.403+0000 7f0d199128c0 1 < completed multipart upload key=QUO5ND3O41TY upload=FURFW0D73GPK tag=R53J96ZJIZXX type=write size=2426650 2024-09-12T00:24:23.407 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.407+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~74DW3VFFW762.0 size=1048576 2024-09-12T00:24:23.409 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.407+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~74DW3VFFW762.1 size=1048576 2024-09-12T00:24:23.411 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.411+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~74DW3VFFW762.2 size=191709 2024-09-12T00:24:23.411 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.411+0000 7f0d199128c0 1 > prepared multipart upload key=IPJEXRBN96NB upload=74DW3VFFW762 tag=W0G9DL4H6BQW type=write size=3337437 2024-09-12T00:24:23.414 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.415+0000 7f0d199128c0 1 < completed delete operation key=B58RWC9W8THG tag=R5K9UJLMFWWE type=del 2024-09-12T00:24:23.417 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.415+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=M2BVUQE0G5B1 type=del size=2962056 2024-09-12T00:24:23.420 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.419+0000 7f0d199128c0 1 < canceled operation key=2EK9CCKG26W2 tag=8JCAZFZXOIYE type=write size=351207 2024-09-12T00:24:23.423 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.423+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=62A6O3R9JUU9 type=del size=1775775 2024-09-12T00:24:23.426 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.427+0000 7f0d199128c0 1 < completed delete operation key=57W1IO3KSWBR tag=2VGKXYF2MCN3 type=del 2024-09-12T00:24:23.428 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.427+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=GKNB2QJGRAEB type=del size=2522083 2024-09-12T00:24:23.431 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.431+0000 7f0d199128c0 1 < completed delete operation key=4K654PSDLDVI tag=F7XBZ4R7AH85 type=del 2024-09-12T00:24:23.436 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.435+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~MIHHU93NGFZR.0 size=1048576 2024-09-12T00:24:23.438 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.439+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~MIHHU93NGFZR.1 size=384087 2024-09-12T00:24:23.438 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.439+0000 7f0d199128c0 1 > prepared multipart upload key=2EK9CCKG26W2 upload=MIHHU93NGFZR tag=1MHS862WW1LR type=write size=2481239 2024-09-12T00:24:23.441 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.443+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~5LXYQ8OB3FYT.0 size=1048576 2024-09-12T00:24:23.443 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.443+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~5LXYQ8OB3FYT.1 size=219273 2024-09-12T00:24:23.448 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.447+0000 7f0d199128c0 1 < completed multipart upload key=YTXW98O07966 upload=5LXYQ8OB3FYT tag=3F71GBRKSH8W type=write size=2316425 2024-09-12T00:24:23.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.451+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~OL4FPD7QXPPN.0 size=1048576 2024-09-12T00:24:23.455 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.455+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~OL4FPD7QXPPN.1 size=1048576 2024-09-12T00:24:23.457 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.455+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~OL4FPD7QXPPN.2 size=583067 2024-09-12T00:24:23.457 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.455+0000 7f0d199128c0 1 > prepared multipart upload key=2EK9CCKG26W2 upload=OL4FPD7QXPPN tag=VRRZ1ZM3N1HS type=write size=3728795 2024-09-12T00:24:23.460 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.459+0000 7f0d199128c0 1 < completed delete operation key=A529WOKFD1NI tag=3N4LTDHSQOAJ type=del 2024-09-12T00:24:23.463 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.463+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=W91L8STNQHHG type=del size=3578043 2024-09-12T00:24:23.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.467+0000 7f0d199128c0 1 < completed delete operation key=0EBWUENN0881 tag=1SN5H2FL5BGV type=del 2024-09-12T00:24:23.471 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.471+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~RSXWG2W9X1C8.0 size=541082 2024-09-12T00:24:23.471 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.471+0000 7f0d199128c0 1 > prepared multipart upload key=HXNC728XIWC1 upload=RSXWG2W9X1C8 tag=J0B0XD4J6AGL type=write size=1589658 2024-09-12T00:24:23.473 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.475+0000 7f0d199128c0 1 < completed delete operation key=V6H6S9X0U2A0 tag=D32FPDHADK97 type=del 2024-09-12T00:24:23.476 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.475+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=MMAMY8ULGP5T type=del size=113370 2024-09-12T00:24:23.479 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.479+0000 7f0d199128c0 1 < completed delete operation key=FJ8YV026H0ZU tag=PNQU7HLAAZB4 type=del 2024-09-12T00:24:23.484 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.483+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~YYSNASIP7QZ6.0 size=1048576 2024-09-12T00:24:23.486 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.487+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~YYSNASIP7QZ6.1 size=362071 2024-09-12T00:24:23.486 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.487+0000 7f0d199128c0 1 > prepared multipart upload key=2EK9CCKG26W2 upload=YYSNASIP7QZ6 tag=T6LVDXZ74ZYQ type=write size=2459223 2024-09-12T00:24:23.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.487+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~QK98LSST2VXB.0 size=547491 2024-09-12T00:24:23.494 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.495+0000 7f0d199128c0 1 < completed multipart upload key=4K654PSDLDVI upload=QK98LSST2VXB tag=XHRV7DNANIN2 type=write size=1596067 2024-09-12T00:24:23.496 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.495+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=PRQZS6J430D3 type=write size=772830 2024-09-12T00:24:23.499 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.499+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~LWWY7UZ1ZXKS.0 size=1048576 2024-09-12T00:24:23.501 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.499+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~LWWY7UZ1ZXKS.1 size=695782 2024-09-12T00:24:23.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.507+0000 7f0d199128c0 1 < completed multipart upload key=57W1IO3KSWBR upload=LWWY7UZ1ZXKS tag=FWNZ0BXR6E0R type=write size=2792934 2024-09-12T00:24:23.508 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.507+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=9NHO5LL4PKUJ type=del size=1166682 2024-09-12T00:24:23.511 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.511+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~793GIVG2YBGZ.0 size=1048576 2024-09-12T00:24:23.513 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.515+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~793GIVG2YBGZ.1 size=1048576 2024-09-12T00:24:23.516 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.515+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~793GIVG2YBGZ.2 size=853297 2024-09-12T00:24:23.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.519+0000 7f0d199128c0 1 < completed multipart upload key=GH0FNY2AI00G upload=793GIVG2YBGZ tag=009WXDTTQIDL type=write size=3999025 2024-09-12T00:24:23.524 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.523+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=G4937V98XKYC type=del size=1428616 2024-09-12T00:24:23.527 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.527+0000 7f0d199128c0 -1 < failed to complete operation key=SITJU2EUVSR8 tag=DCLPJN85P9QX type=write size=598796: (22) Invalid argument 2024-09-12T00:24:23.529 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.531+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=WS2MC12E3317 type=del size=469661 2024-09-12T00:24:23.532 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.531+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~96UPWPDZWL2V.0 size=775822 2024-09-12T00:24:23.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.535+0000 7f0d199128c0 1 < completed multipart upload key=9I6MZAEUS4I0 upload=96UPWPDZWL2V tag=VWBIM7LFPQP5 type=write size=1824398 2024-09-12T00:24:23.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.539+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=L6M5LQZ8NUK7 type=del size=260704 2024-09-12T00:24:23.543 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.543+0000 7f0d199128c0 1 < completed delete operation key=H604SA6XTFLY tag=CDCJ38PVO2H0 type=del 2024-09-12T00:24:23.546 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.547+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=6PI0P3EDVY22 type=write size=704105 2024-09-12T00:24:23.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.551+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~74DW3VFFW762.0 size=1048576 2024-09-12T00:24:23.553 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.551+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~74DW3VFFW762.1 size=1048576 2024-09-12T00:24:23.555 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.555+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~74DW3VFFW762.2 size=191709 2024-09-12T00:24:23.561 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.559+0000 7f0d199128c0 1 < completed multipart upload key=IPJEXRBN96NB upload=74DW3VFFW762 tag=W0G9DL4H6BQW type=write size=3337437 2024-09-12T00:24:23.566 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.567+0000 7f0d199128c0 1 > prepared part key=_multipart_RFCHRGVA9GOI.2~ISY7G1QOI7NU.0 size=776702 2024-09-12T00:24:23.567 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.567+0000 7f0d199128c0 1 > prepared multipart upload key=RFCHRGVA9GOI upload=ISY7G1QOI7NU tag=N2ZFXQW3HBZZ type=write size=1825278 2024-09-12T00:24:23.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.571+0000 7f0d199128c0 1 < completed delete operation key=A529WOKFD1NI tag=M2BVUQE0G5B1 type=del 2024-09-12T00:24:23.575 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.575+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~3B9BV4UN2EHR.0 size=1048576 2024-09-12T00:24:23.578 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.579+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~3B9BV4UN2EHR.1 size=1048576 2024-09-12T00:24:23.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.579+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~3B9BV4UN2EHR.2 size=828370 2024-09-12T00:24:23.581 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.579+0000 7f0d199128c0 1 > prepared multipart upload key=WPZOKZDFXK4S upload=3B9BV4UN2EHR tag=MXG8N8JN142T type=write size=3974098 2024-09-12T00:24:23.584 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.583+0000 7f0d199128c0 1 < completed delete operation key=OVLAP0OS78QG tag=62A6O3R9JUU9 type=del 2024-09-12T00:24:23.587 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.587+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=D0UVPHO18SBI type=del size=2341687 2024-09-12T00:24:23.595 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.595+0000 7f0d199128c0 1 < canceled operation key=QUO5ND3O41TY tag=GKNB2QJGRAEB type=del size=2522083 2024-09-12T00:24:23.599 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.599+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=2VR7GXIM8G4X type=write size=288399 2024-09-12T00:24:23.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.603+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~MIHHU93NGFZR.0 size=1048576 2024-09-12T00:24:23.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.603+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~MIHHU93NGFZR.1 size=384087 2024-09-12T00:24:23.610 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.611+0000 7f0d199128c0 1 < completed multipart upload key=2EK9CCKG26W2 upload=MIHHU93NGFZR tag=1MHS862WW1LR type=write size=2481239 2024-09-12T00:24:23.613 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.615+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=C4ZBNLEN833R type=write size=754507 2024-09-12T00:24:23.618 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.619+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~OL4FPD7QXPPN.0 size=1048576 2024-09-12T00:24:23.621 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.619+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~OL4FPD7QXPPN.1 size=1048576 2024-09-12T00:24:23.621 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.619+0000 7f0d199128c0 1 < canceled part key=_multipart_2EK9CCKG26W2.2~OL4FPD7QXPPN.2 size=583067 2024-09-12T00:24:23.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.627+0000 7f0d199128c0 1 < canceled multipart upload key=2EK9CCKG26W2 upload=OL4FPD7QXPPN tag=VRRZ1ZM3N1HS type=write size=3728795 2024-09-12T00:24:23.630 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.631+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=0AONPGCZQJJU type=del size=86564 2024-09-12T00:24:23.636 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.635+0000 7f0d199128c0 1 < suggested update operation key=A529WOKFD1NI tag=W91L8STNQHHG type=del size=3578043 2024-09-12T00:24:23.639 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.639+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=LNV24YI0GZQ2 type=del size=424040 2024-09-12T00:24:23.642 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.643+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~RSXWG2W9X1C8.0 size=541082 2024-09-12T00:24:23.647 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.647+0000 7f0d199128c0 1 < completed multipart upload key=HXNC728XIWC1 upload=RSXWG2W9X1C8 tag=J0B0XD4J6AGL type=write size=1589658 2024-09-12T00:24:23.650 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.651+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=SP9S97P2WCBK type=write size=716505 2024-09-12T00:24:23.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.655+0000 7f0d199128c0 1 < completed delete operation key=J75P0821XGRO tag=MMAMY8ULGP5T type=del 2024-09-12T00:24:23.659 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.659+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~EDDJOU886MLM.0 size=1048576 2024-09-12T00:24:23.662 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.663+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~EDDJOU886MLM.1 size=947100 2024-09-12T00:24:23.662 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.663+0000 7f0d199128c0 1 > prepared multipart upload key=QUO5ND3O41TY upload=EDDJOU886MLM tag=QQ2Z6VZS0RKY type=write size=3044252 2024-09-12T00:24:23.665 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.663+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~YYSNASIP7QZ6.0 size=1048576 2024-09-12T00:24:23.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.667+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~YYSNASIP7QZ6.1 size=362071 2024-09-12T00:24:23.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.671+0000 7f0d199128c0 1 < completed multipart upload key=2EK9CCKG26W2 upload=YYSNASIP7QZ6 tag=T6LVDXZ74ZYQ type=write size=2459223 2024-09-12T00:24:23.676 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.675+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=JPYY3VEMJHZT type=write size=717265 2024-09-12T00:24:23.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.679+0000 7f0d199128c0 1 < completed write operation key=PK2CA62QBZXS tag=PRQZS6J430D3 type=write size=772830 2024-09-12T00:24:23.685 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.687+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~1193CVXZQL9W.0 size=1048576 2024-09-12T00:24:23.688 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.687+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~1193CVXZQL9W.1 size=1048576 2024-09-12T00:24:23.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.691+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~1193CVXZQL9W.2 size=738330 2024-09-12T00:24:23.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.691+0000 7f0d199128c0 1 > prepared multipart upload key=RX3RVT06SGJ4 upload=1193CVXZQL9W tag=G27MQ64DHQXH type=write size=3884058 2024-09-12T00:24:23.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.695+0000 7f0d199128c0 1 < completed delete operation key=GH0FNY2AI00G tag=9NHO5LL4PKUJ type=del 2024-09-12T00:24:23.699 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.699+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~2SQS9107GZFR.0 size=1048576 2024-09-12T00:24:23.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.703+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~2SQS9107GZFR.1 size=1048576 2024-09-12T00:24:23.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.707+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~2SQS9107GZFR.2 size=426780 2024-09-12T00:24:23.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.707+0000 7f0d199128c0 1 > prepared multipart upload key=57W1IO3KSWBR upload=2SQS9107GZFR tag=TSE294EJLC25 type=write size=3572508 2024-09-12T00:24:23.708 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.707+0000 7f0d199128c0 1 < completed delete operation key=ZWGD87Z1MMNK tag=G4937V98XKYC type=del 2024-09-12T00:24:23.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.711+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=159RQKB6Q2XU type=del size=3727414 2024-09-12T00:24:23.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.715+0000 7f0d199128c0 1 < completed delete operation key=HXNC728XIWC1 tag=WS2MC12E3317 type=del 2024-09-12T00:24:23.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.723+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~NU74527XVIPW.0 size=1048576 2024-09-12T00:24:23.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.723+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~NU74527XVIPW.1 size=726638 2024-09-12T00:24:23.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.723+0000 7f0d199128c0 1 > prepared multipart upload key=VXZI0ZTMQSV0 upload=NU74527XVIPW tag=U0YW2P1POS3J type=write size=2823790 2024-09-12T00:24:23.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.727+0000 7f0d199128c0 1 < suggested update operation key=VXZI0ZTMQSV0 tag=L6M5LQZ8NUK7 type=del size=260704 2024-09-12T00:24:23.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.735+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~PQ73FNMMV53S.0 size=1048576 2024-09-12T00:24:23.736 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.735+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~PQ73FNMMV53S.1 size=1048576 2024-09-12T00:24:23.738 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.739+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~PQ73FNMMV53S.2 size=558297 2024-09-12T00:24:23.739 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.739+0000 7f0d199128c0 1 > prepared multipart upload key=2EK9CCKG26W2 upload=PQ73FNMMV53S tag=5PXDLKQO6QVF type=write size=3704025 2024-09-12T00:24:23.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.743+0000 7f0d199128c0 1 < completed write operation key=2EK9CCKG26W2 tag=6PI0P3EDVY22 type=write size=704105 2024-09-12T00:24:23.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.743+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=2CR8CU7OJ6PQ type=write size=325667 2024-09-12T00:24:23.747 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.747+0000 7f0d199128c0 1 < completed part key=_multipart_RFCHRGVA9GOI.2~ISY7G1QOI7NU.0 size=776702 2024-09-12T00:24:23.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.751+0000 7f0d199128c0 1 < completed multipart upload key=RFCHRGVA9GOI upload=ISY7G1QOI7NU tag=N2ZFXQW3HBZZ type=write size=1825278 2024-09-12T00:24:23.754 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.755+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=PJDZRHB4GIDB type=del size=124287 2024-09-12T00:24:23.755 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.755+0000 7f0d199128c0 1 < canceled part key=_multipart_WPZOKZDFXK4S.2~3B9BV4UN2EHR.0 size=1048576 2024-09-12T00:24:23.757 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.759+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~3B9BV4UN2EHR.1 size=1048576 2024-09-12T00:24:23.759 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.759+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~3B9BV4UN2EHR.2 size=828370 2024-09-12T00:24:23.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.763+0000 7f0d199128c0 1 < canceled multipart upload key=WPZOKZDFXK4S upload=3B9BV4UN2EHR tag=MXG8N8JN142T type=write size=3974098 2024-09-12T00:24:23.770 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.771+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~1YUP672K8BRG.0 size=1048576 2024-09-12T00:24:23.772 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.771+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~1YUP672K8BRG.1 size=1048576 2024-09-12T00:24:23.774 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.775+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~1YUP672K8BRG.2 size=798733 2024-09-12T00:24:23.774 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.775+0000 7f0d199128c0 1 > prepared multipart upload key=SITJU2EUVSR8 upload=1YUP672K8BRG tag=KQAMTVXF6ZG9 type=write size=3944461 2024-09-12T00:24:23.777 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.775+0000 7f0d199128c0 1 < completed delete operation key=0EBWUENN0881 tag=D0UVPHO18SBI type=del 2024-09-12T00:24:23.782 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.783+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~YIKQ7KPQEF6Y.0 size=1048576 2024-09-12T00:24:23.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.783+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~YIKQ7KPQEF6Y.1 size=666309 2024-09-12T00:24:23.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.783+0000 7f0d199128c0 1 > prepared multipart upload key=RX3RVT06SGJ4 upload=YIKQ7KPQEF6Y tag=YFKGGBDWFEEN type=write size=2763461 2024-09-12T00:24:23.787 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.787+0000 7f0d199128c0 1 < completed write operation key=WPZOKZDFXK4S tag=2VR7GXIM8G4X type=write size=288399 2024-09-12T00:24:23.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.791+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=KSHZB4MS3M0V type=del size=2232711 2024-09-12T00:24:23.796 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.795+0000 7f0d199128c0 1 < suggested remove operation key=IPJEXRBN96NB tag=C4ZBNLEN833R type=write 2024-09-12T00:24:23.799 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.799+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=J7H4N76LKJRE type=del size=2750960 2024-09-12T00:24:23.801 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.803+0000 7f0d199128c0 1 < completed delete operation key=4K654PSDLDVI tag=0AONPGCZQJJU type=del 2024-09-12T00:24:23.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.803+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=IFYVSHCBFV5Q type=del size=285430 2024-09-12T00:24:23.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.807+0000 7f0d199128c0 -1 < failed to complete operation key=VXZI0ZTMQSV0 tag=LNV24YI0GZQ2 type=del size=424040: (22) Invalid argument 2024-09-12T00:24:23.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.811+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~5FZ6CWW2QAVH.0 size=1048576 2024-09-12T00:24:23.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.815+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~5FZ6CWW2QAVH.1 size=542637 2024-09-12T00:24:23.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.815+0000 7f0d199128c0 1 > prepared multipart upload key=OVLAP0OS78QG upload=5FZ6CWW2QAVH tag=SFZK4N6BW7BI type=write size=2639789 2024-09-12T00:24:23.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.823+0000 7f0d199128c0 1 < suggested remove operation key=4K654PSDLDVI tag=SP9S97P2WCBK type=write 2024-09-12T00:24:23.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.827+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=Z4PKXCA3K2KO type=write size=393763 2024-09-12T00:24:23.828 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.827+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~EDDJOU886MLM.0 size=1048576 2024-09-12T00:24:23.831 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.831+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~EDDJOU886MLM.1 size=947100 2024-09-12T00:24:23.836 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.835+0000 7f0d199128c0 1 < completed multipart upload key=QUO5ND3O41TY upload=EDDJOU886MLM tag=QQ2Z6VZS0RKY type=write size=3044252 2024-09-12T00:24:23.839 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.839+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=W00A7G3H5E49 type=del size=3531428 2024-09-12T00:24:23.840 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.839+0000 7f0d199128c0 -1 < no bi entry to suggest for operation key=4K654PSDLDVI tag=JPYY3VEMJHZT type=write size=717265: (2) No such file or directory 2024-09-12T00:24:23.843 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.843+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=AJ8GGLL95I49 type=del size=164319 2024-09-12T00:24:23.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.847+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~1193CVXZQL9W.0 size=1048576 2024-09-12T00:24:23.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.847+0000 7f0d199128c0 1 < canceled part key=_multipart_RX3RVT06SGJ4.2~1193CVXZQL9W.1 size=1048576 2024-09-12T00:24:23.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.851+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~1193CVXZQL9W.2 size=738330 2024-09-12T00:24:23.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.855+0000 7f0d199128c0 1 < canceled multipart upload key=RX3RVT06SGJ4 upload=1193CVXZQL9W tag=G27MQ64DHQXH type=write size=3884058 2024-09-12T00:24:23.858 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.859+0000 7f0d199128c0 1 > prepared operation key=57W1IO3KSWBR tag=R0SPBVB7EIYA type=del size=3128648 2024-09-12T00:24:23.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.859+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~2SQS9107GZFR.0 size=1048576 2024-09-12T00:24:23.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.863+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~2SQS9107GZFR.1 size=1048576 2024-09-12T00:24:23.864 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.863+0000 7f0d199128c0 1 < canceled part key=_multipart_57W1IO3KSWBR.2~2SQS9107GZFR.2 size=426780 2024-09-12T00:24:23.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.871+0000 7f0d199128c0 1 < canceled multipart upload key=57W1IO3KSWBR upload=2SQS9107GZFR tag=TSE294EJLC25 type=write size=3572508 2024-09-12T00:24:23.873 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.871+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=8SFSTVXG142E type=del size=3975510 2024-09-12T00:24:23.879 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.879+0000 7f0d199128c0 1 < suggested update operation key=A529WOKFD1NI tag=159RQKB6Q2XU type=del size=3727414 2024-09-12T00:24:23.889 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.891+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~DNLQSLRV5R2L.0 size=1048576 2024-09-12T00:24:23.892 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.891+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~DNLQSLRV5R2L.1 size=1048576 2024-09-12T00:24:23.896 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.895+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~DNLQSLRV5R2L.2 size=64081 2024-09-12T00:24:23.896 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.895+0000 7f0d199128c0 1 > prepared multipart upload key=V6H6S9X0U2A0 upload=DNLQSLRV5R2L tag=XOIL6LRUMLF4 type=write size=3209809 2024-09-12T00:24:23.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.899+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~NU74527XVIPW.0 size=1048576 2024-09-12T00:24:23.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.899+0000 7f0d199128c0 1 < canceled part key=_multipart_VXZI0ZTMQSV0.2~NU74527XVIPW.1 size=726638 2024-09-12T00:24:23.905 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.903+0000 7f0d199128c0 1 < canceled multipart upload key=VXZI0ZTMQSV0 upload=NU74527XVIPW tag=U0YW2P1POS3J type=write size=2823790 2024-09-12T00:24:23.909 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.907+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=DERNIGPPAEAD type=del size=3577803 2024-09-12T00:24:23.912 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.911+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~PQ73FNMMV53S.0 size=1048576 2024-09-12T00:24:23.915 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.915+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~PQ73FNMMV53S.1 size=1048576 2024-09-12T00:24:23.917 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.919+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~PQ73FNMMV53S.2 size=558297 2024-09-12T00:24:23.922 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.923+0000 7f0d199128c0 1 < completed multipart upload key=2EK9CCKG26W2 upload=PQ73FNMMV53S tag=5PXDLKQO6QVF type=write size=3704025 2024-09-12T00:24:23.925 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.923+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=9PB937J3AK46 type=del size=145559 2024-09-12T00:24:23.932 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.931+0000 7f0d199128c0 1 < suggested update operation key=HXNC728XIWC1 tag=2CR8CU7OJ6PQ type=write size=325667 2024-09-12T00:24:23.934 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.935+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=G0F11RJITJ1O type=write size=226505 2024-09-12T00:24:23.937 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.939+0000 7f0d199128c0 1 < completed delete operation key=V6H6S9X0U2A0 tag=PJDZRHB4GIDB type=del 2024-09-12T00:24:23.941 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.939+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=AL2JRP27QPH7 type=del size=3583645 2024-09-12T00:24:23.943 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.943+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~1YUP672K8BRG.0 size=1048576 2024-09-12T00:24:23.946 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.947+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~1YUP672K8BRG.1 size=1048576 2024-09-12T00:24:23.946 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.947+0000 7f0d199128c0 1 < canceled part key=_multipart_SITJU2EUVSR8.2~1YUP672K8BRG.2 size=798733 2024-09-12T00:24:23.951 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.951+0000 7f0d199128c0 1 < canceled multipart upload key=SITJU2EUVSR8 upload=1YUP672K8BRG tag=KQAMTVXF6ZG9 type=write size=3944461 2024-09-12T00:24:23.954 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.955+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=4MM1I1UE41I0 type=del size=3110072 2024-09-12T00:24:23.955 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.955+0000 7f0d199128c0 1 < canceled part key=_multipart_RX3RVT06SGJ4.2~YIKQ7KPQEF6Y.0 size=1048576 2024-09-12T00:24:23.957 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.959+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~YIKQ7KPQEF6Y.1 size=666309 2024-09-12T00:24:23.962 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.963+0000 7f0d199128c0 1 < canceled multipart upload key=RX3RVT06SGJ4 upload=YIKQ7KPQEF6Y tag=YFKGGBDWFEEN type=write size=2763461 2024-09-12T00:24:23.965 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.967+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=JOPSJCHX9ZRE type=del size=2476300 2024-09-12T00:24:23.969 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.967+0000 7f0d199128c0 1 < completed delete operation key=VXZI0ZTMQSV0 tag=KSHZB4MS3M0V type=del 2024-09-12T00:24:23.975 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.975+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~XNHV7CI4G5RV.0 size=1048576 2024-09-12T00:24:23.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.979+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~XNHV7CI4G5RV.1 size=820143 2024-09-12T00:24:23.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.979+0000 7f0d199128c0 1 > prepared multipart upload key=IPJEXRBN96NB upload=XNHV7CI4G5RV tag=GT00GH5EN0A5 type=write size=2917295 2024-09-12T00:24:23.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.979+0000 7f0d199128c0 1 < canceled operation key=V6H6S9X0U2A0 tag=J7H4N76LKJRE type=del size=2750960 2024-09-12T00:24:23.985 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.983+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=BW42LW9VMKK2 type=del size=1169398 2024-09-12T00:24:23.988 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.987+0000 7f0d199128c0 1 < completed delete operation key=J75P0821XGRO tag=IFYVSHCBFV5Q type=del 2024-09-12T00:24:23.991 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.991+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=IZVZM8M41HN8 type=del size=872176 2024-09-12T00:24:23.992 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.991+0000 7f0d199128c0 1 < canceled part key=_multipart_OVLAP0OS78QG.2~5FZ6CWW2QAVH.0 size=1048576 2024-09-12T00:24:23.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.995+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~5FZ6CWW2QAVH.1 size=542637 2024-09-12T00:24:23.999 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:23.999+0000 7f0d199128c0 1 < canceled multipart upload key=OVLAP0OS78QG upload=5FZ6CWW2QAVH tag=SFZK4N6BW7BI type=write size=2639789 2024-09-12T00:24:24.002 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.003+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=T6X4FJFHOZO6 type=write size=852401 2024-09-12T00:24:24.005 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.003+0000 7f0d199128c0 1 < completed write operation key=J75P0821XGRO tag=Z4PKXCA3K2KO type=write size=393763 2024-09-12T00:24:24.008 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.007+0000 7f0d199128c0 1 > prepared operation key=57W1IO3KSWBR tag=O8BJE3QVALTZ type=del size=2305072 2024-09-12T00:24:24.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.011+0000 7f0d199128c0 -1 < failed to complete operation key=HXNC728XIWC1 tag=W00A7G3H5E49 type=del size=3531428: (22) Invalid argument 2024-09-12T00:24:24.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.015+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~E1VCNUZMVOFY.0 size=1048576 2024-09-12T00:24:24.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.019+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~E1VCNUZMVOFY.1 size=1048576 2024-09-12T00:24:24.021 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.019+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~E1VCNUZMVOFY.2 size=208218 2024-09-12T00:24:24.021 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.019+0000 7f0d199128c0 1 > prepared multipart upload key=YTXW98O07966 upload=E1VCNUZMVOFY tag=G84NQIRXB389 type=write size=3353946 2024-09-12T00:24:24.024 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.023+0000 7f0d199128c0 1 < completed delete operation key=H604SA6XTFLY tag=AJ8GGLL95I49 type=del 2024-09-12T00:24:24.027 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.027+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=512O6IM2FKAV type=write size=60183 2024-09-12T00:24:24.030 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.031+0000 7f0d199128c0 1 < completed delete operation key=57W1IO3KSWBR tag=R0SPBVB7EIYA type=del 2024-09-12T00:24:24.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.035+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~XV3BP1WLT999.0 size=740622 2024-09-12T00:24:24.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.035+0000 7f0d199128c0 1 > prepared multipart upload key=RX3RVT06SGJ4 upload=XV3BP1WLT999 tag=S1IQZZSOA3SB type=write size=1789198 2024-09-12T00:24:24.039 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.039+0000 7f0d199128c0 1 < completed delete operation key=B58RWC9W8THG tag=8SFSTVXG142E type=del 2024-09-12T00:24:24.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.043+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=RDUJ7PZ7LYZH type=del size=3625099 2024-09-12T00:24:24.045 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.047+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~DNLQSLRV5R2L.0 size=1048576 2024-09-12T00:24:24.048 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.047+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~DNLQSLRV5R2L.1 size=1048576 2024-09-12T00:24:24.050 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.051+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~DNLQSLRV5R2L.2 size=64081 2024-09-12T00:24:24.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.055+0000 7f0d199128c0 1 < completed multipart upload key=V6H6S9X0U2A0 upload=DNLQSLRV5R2L tag=XOIL6LRUMLF4 type=write size=3209809 2024-09-12T00:24:24.059 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.059+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=W03834IVWM8B type=del size=4112021 2024-09-12T00:24:24.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.067+0000 7f0d199128c0 1 < suggested update operation key=B58RWC9W8THG tag=DERNIGPPAEAD type=del size=3577803 2024-09-12T00:24:24.071 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.071+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~I6KBYQ1K2WD5.0 size=664049 2024-09-12T00:24:24.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.071+0000 7f0d199128c0 1 > prepared multipart upload key=57W1IO3KSWBR upload=I6KBYQ1K2WD5 tag=YA5DVEBL0QXW type=write size=1712625 2024-09-12T00:24:24.077 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.075+0000 7f0d199128c0 1 < suggested remove operation key=2EK9CCKG26W2 tag=9PB937J3AK46 type=del 2024-09-12T00:24:24.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.079+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=KMHZ151L905J type=del size=2601692 2024-09-12T00:24:24.084 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.083+0000 7f0d199128c0 1 < completed write operation key=HXNC728XIWC1 tag=G0F11RJITJ1O type=write size=226505 2024-09-12T00:24:24.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.087+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=VS7Q3NOWEYCL type=del size=4183800 2024-09-12T00:24:24.093 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.095+0000 7f0d199128c0 1 < suggested update operation key=PK2CA62QBZXS tag=AL2JRP27QPH7 type=del size=3583645 2024-09-12T00:24:24.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.099+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~N2JYCIIAN2FN.0 size=1048576 2024-09-12T00:24:24.103 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.103+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~N2JYCIIAN2FN.1 size=123386 2024-09-12T00:24:24.103 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.103+0000 7f0d199128c0 1 > prepared multipart upload key=T6GOR4SBYU2Y upload=N2JYCIIAN2FN tag=HT6L8YFBWK19 type=write size=2220538 2024-09-12T00:24:24.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.107+0000 7f0d199128c0 1 < completed delete operation key=9I6MZAEUS4I0 tag=4MM1I1UE41I0 type=del 2024-09-12T00:24:24.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.111+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=JDJABMW5Y2EV type=write size=938512 2024-09-12T00:24:24.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.115+0000 7f0d199128c0 1 < completed delete operation key=SITJU2EUVSR8 tag=JOPSJCHX9ZRE type=del 2024-09-12T00:24:24.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.115+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=KEC5U40DZ8FQ type=del size=4181790 2024-09-12T00:24:24.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.119+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~XNHV7CI4G5RV.0 size=1048576 2024-09-12T00:24:24.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.123+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~XNHV7CI4G5RV.1 size=820143 2024-09-12T00:24:24.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.127+0000 7f0d199128c0 1 < completed multipart upload key=IPJEXRBN96NB upload=XNHV7CI4G5RV tag=GT00GH5EN0A5 type=write size=2917295 2024-09-12T00:24:24.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.131+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=E1AAV5X91W6L type=del size=386093 2024-09-12T00:24:24.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.135+0000 7f0d199128c0 1 < canceled operation key=JA6CSJF78VE2 tag=BW42LW9VMKK2 type=del size=1169398 2024-09-12T00:24:24.145 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.143+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~UXKNM1XNHJBA.0 size=1048576 2024-09-12T00:24:24.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.147+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~UXKNM1XNHJBA.1 size=1048576 2024-09-12T00:24:24.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.147+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~UXKNM1XNHJBA.2 size=95633 2024-09-12T00:24:24.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.147+0000 7f0d199128c0 1 > prepared multipart upload key=VXZI0ZTMQSV0 upload=UXKNM1XNHJBA tag=OETGCS4CN1MA type=write size=3241361 2024-09-12T00:24:24.153 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.151+0000 7f0d199128c0 1 < canceled operation key=9I6MZAEUS4I0 tag=IZVZM8M41HN8 type=del size=872176 2024-09-12T00:24:24.157 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.155+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=H9PC6FIRS5G8 type=del size=1128090 2024-09-12T00:24:24.160 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.159+0000 7f0d199128c0 1 < completed write operation key=HXNC728XIWC1 tag=T6X4FJFHOZO6 type=write size=852401 2024-09-12T00:24:24.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.167+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~40JBGB3A21EO.0 size=1048576 2024-09-12T00:24:24.169 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.167+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~40JBGB3A21EO.1 size=1048576 2024-09-12T00:24:24.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.171+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~40JBGB3A21EO.2 size=946941 2024-09-12T00:24:24.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.171+0000 7f0d199128c0 1 > prepared multipart upload key=H604SA6XTFLY upload=40JBGB3A21EO tag=X4RH1BJTKWIC type=write size=4092669 2024-09-12T00:24:24.175 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.175+0000 7f0d199128c0 1 < completed delete operation key=57W1IO3KSWBR tag=O8BJE3QVALTZ type=del 2024-09-12T00:24:24.178 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.179+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=CTF74R7KP35Q type=del size=1438524 2024-09-12T00:24:24.179 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.179+0000 7f0d199128c0 1 < canceled part key=_multipart_YTXW98O07966.2~E1VCNUZMVOFY.0 size=1048576 2024-09-12T00:24:24.182 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.183+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~E1VCNUZMVOFY.1 size=1048576 2024-09-12T00:24:24.185 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.183+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~E1VCNUZMVOFY.2 size=208218 2024-09-12T00:24:24.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.195+0000 7f0d199128c0 1 < canceled multipart upload key=YTXW98O07966 upload=E1VCNUZMVOFY tag=G84NQIRXB389 type=write size=3353946 2024-09-12T00:24:24.198 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.199+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=VES6XLCVQP1Q type=del size=2161662 2024-09-12T00:24:24.201 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.199+0000 7f0d199128c0 -1 < failed to complete operation key=2EK9CCKG26W2 tag=512O6IM2FKAV type=write size=60183: (22) Invalid argument 2024-09-12T00:24:24.205 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.203+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=EWS030NVOSEM type=write size=136496 2024-09-12T00:24:24.209 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.207+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~XV3BP1WLT999.0 size=740622 2024-09-12T00:24:24.214 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.215+0000 7f0d199128c0 1 < completed multipart upload key=RX3RVT06SGJ4 upload=XV3BP1WLT999 tag=S1IQZZSOA3SB type=write size=1789198 2024-09-12T00:24:24.217 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.215+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=IBZF72DU7BXS type=del size=3000853 2024-09-12T00:24:24.224 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.223+0000 7f0d199128c0 1 < suggested remove operation key=0ZT4NZYZKI5Z tag=RDUJ7PZ7LYZH type=del 2024-09-12T00:24:24.227 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.227+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=UE8TN363W3IN type=del size=3584859 2024-09-12T00:24:24.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.231+0000 7f0d199128c0 1 < completed delete operation key=VXZI0ZTMQSV0 tag=W03834IVWM8B type=del 2024-09-12T00:24:24.237 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.235+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~U6R7X84R6FCC.0 size=588138 2024-09-12T00:24:24.237 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.235+0000 7f0d199128c0 1 > prepared multipart upload key=WPZOKZDFXK4S upload=U6R7X84R6FCC tag=DGJW4K2O87NL type=write size=1636714 2024-09-12T00:24:24.241 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.239+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~I6KBYQ1K2WD5.0 size=664049 2024-09-12T00:24:24.247 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.247+0000 7f0d199128c0 1 < completed multipart upload key=57W1IO3KSWBR upload=I6KBYQ1K2WD5 tag=YA5DVEBL0QXW type=write size=1712625 2024-09-12T00:24:24.250 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.251+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=PW0DHNZT09PN type=del size=882455 2024-09-12T00:24:24.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.255+0000 7f0d199128c0 1 < suggested update operation key=2EK9CCKG26W2 tag=KMHZ151L905J type=del size=2601692 2024-09-12T00:24:24.264 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.263+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~LC0FM45RSSFI.0 size=1048576 2024-09-12T00:24:24.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.267+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~LC0FM45RSSFI.1 size=1048576 2024-09-12T00:24:24.270 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.271+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~LC0FM45RSSFI.2 size=784636 2024-09-12T00:24:24.270 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.271+0000 7f0d199128c0 1 > prepared multipart upload key=WBGXMJB7U422 upload=LC0FM45RSSFI tag=PBNA5G7TSRD2 type=write size=3930364 2024-09-12T00:24:24.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.271+0000 7f0d199128c0 1 < completed delete operation key=1Y6B1MJP5G4L tag=VS7Q3NOWEYCL type=del 2024-09-12T00:24:24.279 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.279+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~F30MW5AZ2F7F.0 size=1048576 2024-09-12T00:24:24.281 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.283+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~F30MW5AZ2F7F.1 size=760114 2024-09-12T00:24:24.282 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.283+0000 7f0d199128c0 1 > prepared multipart upload key=A529WOKFD1NI upload=F30MW5AZ2F7F tag=QECE02TM27H5 type=write size=2857266 2024-09-12T00:24:24.286 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.287+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~N2JYCIIAN2FN.0 size=1048576 2024-09-12T00:24:24.286 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.287+0000 7f0d199128c0 1 < canceled part key=_multipart_T6GOR4SBYU2Y.2~N2JYCIIAN2FN.1 size=123386 2024-09-12T00:24:24.292 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.291+0000 7f0d199128c0 1 < canceled multipart upload key=T6GOR4SBYU2Y upload=N2JYCIIAN2FN tag=HT6L8YFBWK19 type=write size=2220538 2024-09-12T00:24:24.295 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.295+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=TX10RS210879 type=write size=591875 2024-09-12T00:24:24.299 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.299+0000 7f0d199128c0 1 < canceled operation key=PK2CA62QBZXS tag=JDJABMW5Y2EV type=write size=938512 2024-09-12T00:24:24.302 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.303+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=2EPJQJTO52B4 type=del size=1968166 2024-09-12T00:24:24.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.311+0000 7f0d199128c0 1 < suggested remove operation key=4K654PSDLDVI tag=KEC5U40DZ8FQ type=del 2024-09-12T00:24:24.316 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.315+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~4E3MQWYYW4NB.0 size=1048576 2024-09-12T00:24:24.319 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.319+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~4E3MQWYYW4NB.1 size=555601 2024-09-12T00:24:24.319 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.319+0000 7f0d199128c0 1 > prepared multipart upload key=NXQYUQIR2APT upload=4E3MQWYYW4NB tag=ZE606JLAL6TW type=write size=2652753 2024-09-12T00:24:24.322 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.323+0000 7f0d199128c0 1 < canceled operation key=10YEWZDTTEV0 tag=E1AAV5X91W6L type=del size=386093 2024-09-12T00:24:24.329 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.327+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~SOJ45X3WHMS9.0 size=1048576 2024-09-12T00:24:24.332 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.331+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~SOJ45X3WHMS9.1 size=1048576 2024-09-12T00:24:24.335 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.335+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~SOJ45X3WHMS9.2 size=1020916 2024-09-12T00:24:24.335 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.335+0000 7f0d199128c0 1 > prepared multipart upload key=RX3RVT06SGJ4 upload=SOJ45X3WHMS9 tag=AKFMSCGSCIDT type=write size=4166644 2024-09-12T00:24:24.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.339+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~UXKNM1XNHJBA.0 size=1048576 2024-09-12T00:24:24.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.343+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~UXKNM1XNHJBA.1 size=1048576 2024-09-12T00:24:24.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.343+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~UXKNM1XNHJBA.2 size=95633 2024-09-12T00:24:24.350 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.351+0000 7f0d199128c0 1 < completed multipart upload key=VXZI0ZTMQSV0 upload=UXKNM1XNHJBA tag=OETGCS4CN1MA type=write size=3241361 2024-09-12T00:24:24.353 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.355+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=CSWDA8KJ4X6D type=del size=3620579 2024-09-12T00:24:24.357 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.355+0000 7f0d199128c0 1 < completed delete operation key=PK2CA62QBZXS tag=H9PC6FIRS5G8 type=del 2024-09-12T00:24:24.363 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.363+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~UETKFKZSXS4E.0 size=1048576 2024-09-12T00:24:24.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.367+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~UETKFKZSXS4E.1 size=1048576 2024-09-12T00:24:24.369 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.367+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~UETKFKZSXS4E.2 size=576775 2024-09-12T00:24:24.369 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.367+0000 7f0d199128c0 1 > prepared multipart upload key=1Y6B1MJP5G4L upload=UETKFKZSXS4E tag=O7K2ACWI1O7V type=write size=3722503 2024-09-12T00:24:24.372 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.371+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~40JBGB3A21EO.0 size=1048576 2024-09-12T00:24:24.375 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.375+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~40JBGB3A21EO.1 size=1048576 2024-09-12T00:24:24.378 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.379+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~40JBGB3A21EO.2 size=946941 2024-09-12T00:24:24.384 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.383+0000 7f0d199128c0 1 < completed multipart upload key=H604SA6XTFLY upload=40JBGB3A21EO tag=X4RH1BJTKWIC type=write size=4092669 2024-09-12T00:24:24.393 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.391+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~SLMOXLGMELNP.0 size=1048576 2024-09-12T00:24:24.396 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.395+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~SLMOXLGMELNP.1 size=327974 2024-09-12T00:24:24.396 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.395+0000 7f0d199128c0 1 > prepared multipart upload key=37WTPAJGOX5L upload=SLMOXLGMELNP tag=VT8XY12OZRNO type=write size=2425126 2024-09-12T00:24:24.399 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.399+0000 7f0d199128c0 1 < completed delete operation key=YTXW98O07966 tag=CTF74R7KP35Q type=del 2024-09-12T00:24:24.406 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.407+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~USM0CB3001KW.0 size=1048576 2024-09-12T00:24:24.409 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.407+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~USM0CB3001KW.1 size=847261 2024-09-12T00:24:24.409 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.407+0000 7f0d199128c0 1 > prepared multipart upload key=YTXW98O07966 upload=USM0CB3001KW tag=RUDN31NU4HIR type=write size=2944413 2024-09-12T00:24:24.412 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.411+0000 7f0d199128c0 1 < completed delete operation key=RFCHRGVA9GOI tag=VES6XLCVQP1Q type=del 2024-09-12T00:24:24.419 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.419+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~5HC2ABE80MOO.0 size=345251 2024-09-12T00:24:24.419 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.419+0000 7f0d199128c0 1 > prepared multipart upload key=J75P0821XGRO upload=5HC2ABE80MOO tag=WDFGL5YZ52ZV type=write size=1393827 2024-09-12T00:24:24.421 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.419+0000 7f0d199128c0 -1 < no bi entry to suggest for operation key=4K654PSDLDVI tag=EWS030NVOSEM type=write size=136496: (2) No such file or directory 2024-09-12T00:24:24.429 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.427+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~ZJEPPUVLVWWD.0 size=1048576 2024-09-12T00:24:24.431 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.431+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~ZJEPPUVLVWWD.1 size=472736 2024-09-12T00:24:24.431 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.431+0000 7f0d199128c0 1 > prepared multipart upload key=4K654PSDLDVI upload=ZJEPPUVLVWWD tag=63V6UX4A9DZS type=write size=2569888 2024-09-12T00:24:24.435 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.435+0000 7f0d199128c0 1 < completed delete operation key=T6GOR4SBYU2Y tag=IBZF72DU7BXS type=del 2024-09-12T00:24:24.439 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.439+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=CFBLNE32TBUH type=del size=3188632 2024-09-12T00:24:24.445 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.447+0000 7f0d199128c0 1 < suggested remove operation key=JA6CSJF78VE2 tag=UE8TN363W3IN type=del 2024-09-12T00:24:24.449 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.447+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=IFP3YOL16B1I type=del size=187110 2024-09-12T00:24:24.452 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.451+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~U6R7X84R6FCC.0 size=588138 2024-09-12T00:24:24.458 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.459+0000 7f0d199128c0 1 < completed multipart upload key=WPZOKZDFXK4S upload=U6R7X84R6FCC tag=DGJW4K2O87NL type=write size=1636714 2024-09-12T00:24:24.464 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.463+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~6C3KGFZ2NU2X.0 size=1048576 2024-09-12T00:24:24.467 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.467+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~6C3KGFZ2NU2X.1 size=1048576 2024-09-12T00:24:24.469 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.467+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~6C3KGFZ2NU2X.2 size=341386 2024-09-12T00:24:24.469 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.467+0000 7f0d199128c0 1 > prepared multipart upload key=1Y6B1MJP5G4L upload=6C3KGFZ2NU2X tag=P64TS0SUMCZS type=write size=3487114 2024-09-12T00:24:24.472 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.471+0000 7f0d199128c0 -1 < failed to complete operation key=4K654PSDLDVI tag=PW0DHNZT09PN type=del size=882455: (22) Invalid argument 2024-09-12T00:24:24.476 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.475+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=5HDZGO14E2OD type=del size=1070005 2024-09-12T00:24:24.480 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.479+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~LC0FM45RSSFI.0 size=1048576 2024-09-12T00:24:24.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.483+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~LC0FM45RSSFI.1 size=1048576 2024-09-12T00:24:24.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.483+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~LC0FM45RSSFI.2 size=784636 2024-09-12T00:24:24.490 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.491+0000 7f0d199128c0 1 < completed multipart upload key=WBGXMJB7U422 upload=LC0FM45RSSFI tag=PBNA5G7TSRD2 type=write size=3930364 2024-09-12T00:24:24.497 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.495+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~L2Q8ZM3MWLBW.0 size=1048576 2024-09-12T00:24:24.499 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.499+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~L2Q8ZM3MWLBW.1 size=1048576 2024-09-12T00:24:24.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.503+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~L2Q8ZM3MWLBW.2 size=529683 2024-09-12T00:24:24.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.503+0000 7f0d199128c0 1 > prepared multipart upload key=57W1IO3KSWBR upload=L2Q8ZM3MWLBW tag=YTAP5SUKEOHX type=write size=3675411 2024-09-12T00:24:24.505 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.507+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~F30MW5AZ2F7F.0 size=1048576 2024-09-12T00:24:24.508 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.507+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~F30MW5AZ2F7F.1 size=760114 2024-09-12T00:24:24.514 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.515+0000 7f0d199128c0 1 < completed multipart upload key=A529WOKFD1NI upload=F30MW5AZ2F7F tag=QECE02TM27H5 type=write size=2857266 2024-09-12T00:24:24.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.527+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~ZJWBRZG2GZYU.0 size=344598 2024-09-12T00:24:24.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.527+0000 7f0d199128c0 1 > prepared multipart upload key=4K654PSDLDVI upload=ZJWBRZG2GZYU tag=8GQPFKA7F3TO type=write size=1393174 2024-09-12T00:24:24.529 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.531+0000 7f0d199128c0 1 < completed write operation key=YTXW98O07966 tag=TX10RS210879 type=write size=591875 2024-09-12T00:24:24.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.535+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=SRVDG8973PSQ type=del size=3742008 2024-09-12T00:24:24.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.535+0000 7f0d199128c0 1 < completed delete operation key=YTXW98O07966 tag=2EPJQJTO52B4 type=del 2024-09-12T00:24:24.541 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.539+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=EHPPFSAURKH9 type=del size=2535988 2024-09-12T00:24:24.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.543+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~4E3MQWYYW4NB.0 size=1048576 2024-09-12T00:24:24.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.547+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~4E3MQWYYW4NB.1 size=555601 2024-09-12T00:24:24.553 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.555+0000 7f0d199128c0 1 < completed multipart upload key=NXQYUQIR2APT upload=4E3MQWYYW4NB tag=ZE606JLAL6TW type=write size=2652753 2024-09-12T00:24:24.556 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.555+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=9W71ZZMHP31A type=del size=2447805 2024-09-12T00:24:24.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.559+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~SOJ45X3WHMS9.0 size=1048576 2024-09-12T00:24:24.563 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.563+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~SOJ45X3WHMS9.1 size=1048576 2024-09-12T00:24:24.566 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.567+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~SOJ45X3WHMS9.2 size=1020916 2024-09-12T00:24:24.572 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.571+0000 7f0d199128c0 1 < completed multipart upload key=RX3RVT06SGJ4 upload=SOJ45X3WHMS9 tag=AKFMSCGSCIDT type=write size=4166644 2024-09-12T00:24:24.579 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.579+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~6EYMVD31RERV.0 size=776366 2024-09-12T00:24:24.579 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.579+0000 7f0d199128c0 1 > prepared multipart upload key=WPZOKZDFXK4S upload=6EYMVD31RERV tag=5UOLWUV8EDDA type=write size=1824942 2024-09-12T00:24:24.583 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.583+0000 7f0d199128c0 1 < completed delete operation key=PK2CA62QBZXS tag=CSWDA8KJ4X6D type=del 2024-09-12T00:24:24.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.587+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=44SB7QH9RI1N type=del size=904088 2024-09-12T00:24:24.589 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.591+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~UETKFKZSXS4E.0 size=1048576 2024-09-12T00:24:24.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.595+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~UETKFKZSXS4E.1 size=1048576 2024-09-12T00:24:24.596 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.595+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~UETKFKZSXS4E.2 size=576775 2024-09-12T00:24:24.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.603+0000 7f0d199128c0 1 < completed multipart upload key=1Y6B1MJP5G4L upload=UETKFKZSXS4E tag=O7K2ACWI1O7V type=write size=3722503 2024-09-12T00:24:24.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.607+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=TKTVHQPDCWUW type=write size=531906 2024-09-12T00:24:24.609 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.607+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~SLMOXLGMELNP.0 size=1048576 2024-09-12T00:24:24.612 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.611+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~SLMOXLGMELNP.1 size=327974 2024-09-12T00:24:24.618 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.619+0000 7f0d199128c0 1 < completed multipart upload key=37WTPAJGOX5L upload=SLMOXLGMELNP tag=VT8XY12OZRNO type=write size=2425126 2024-09-12T00:24:24.621 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.623+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=FZY7CDF3FFGR type=del size=2181757 2024-09-12T00:24:24.625 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.623+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~USM0CB3001KW.0 size=1048576 2024-09-12T00:24:24.628 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.627+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~USM0CB3001KW.1 size=847261 2024-09-12T00:24:24.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.635+0000 7f0d199128c0 1 < completed multipart upload key=YTXW98O07966 upload=USM0CB3001KW tag=RUDN31NU4HIR type=write size=2944413 2024-09-12T00:24:24.638 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.639+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=3JKLB2XN8FNP type=write size=937538 2024-09-12T00:24:24.641 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.639+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~5HC2ABE80MOO.0 size=345251 2024-09-12T00:24:24.647 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.647+0000 7f0d199128c0 1 < completed multipart upload key=J75P0821XGRO upload=5HC2ABE80MOO tag=WDFGL5YZ52ZV type=write size=1393827 2024-09-12T00:24:24.653 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.651+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~NWGLC1O2J303.0 size=1048576 2024-09-12T00:24:24.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.655+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~NWGLC1O2J303.1 size=324804 2024-09-12T00:24:24.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.655+0000 7f0d199128c0 1 > prepared multipart upload key=GH0FNY2AI00G upload=NWGLC1O2J303 tag=C06G0AT8FRFN type=write size=2421956 2024-09-12T00:24:24.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.655+0000 7f0d199128c0 1 < canceled part key=_multipart_4K654PSDLDVI.2~ZJEPPUVLVWWD.0 size=1048576 2024-09-12T00:24:24.659 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.659+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~ZJEPPUVLVWWD.1 size=472736 2024-09-12T00:24:24.666 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.667+0000 7f0d199128c0 1 < canceled multipart upload key=4K654PSDLDVI upload=ZJEPPUVLVWWD tag=63V6UX4A9DZS type=write size=2569888 2024-09-12T00:24:24.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.671+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~Y3X23IKR945L.0 size=407449 2024-09-12T00:24:24.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.671+0000 7f0d199128c0 1 > prepared multipart upload key=T6GOR4SBYU2Y upload=Y3X23IKR945L tag=SVOHIQ5FQOJE type=write size=1456025 2024-09-12T00:24:24.675 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.675+0000 7f0d199128c0 1 < canceled operation key=9I6MZAEUS4I0 tag=CFBLNE32TBUH type=del size=3188632 2024-09-12T00:24:24.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.679+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=SKZMF2LW5HL3 type=del size=1278923 2024-09-12T00:24:24.682 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.683+0000 7f0d199128c0 1 < completed delete operation key=NXQYUQIR2APT tag=IFP3YOL16B1I type=del 2024-09-12T00:24:24.686 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.687+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=3A03F5L7UL64 type=write size=1037488 2024-09-12T00:24:24.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.691+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~6C3KGFZ2NU2X.0 size=1048576 2024-09-12T00:24:24.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.691+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~6C3KGFZ2NU2X.1 size=1048576 2024-09-12T00:24:24.696 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.695+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~6C3KGFZ2NU2X.2 size=341386 2024-09-12T00:24:24.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.703+0000 7f0d199128c0 1 < completed multipart upload key=1Y6B1MJP5G4L upload=6C3KGFZ2NU2X tag=P64TS0SUMCZS type=write size=3487114 2024-09-12T00:24:24.706 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.707+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=NZ01ICNMDF7Z type=write size=134295 2024-09-12T00:24:24.710 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.711+0000 7f0d199128c0 1 < canceled operation key=V6H6S9X0U2A0 tag=5HDZGO14E2OD type=del size=1070005 2024-09-12T00:24:24.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.715+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=V4N84QGE2O3T type=del size=3951055 2024-09-12T00:24:24.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.715+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~L2Q8ZM3MWLBW.0 size=1048576 2024-09-12T00:24:24.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.719+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~L2Q8ZM3MWLBW.1 size=1048576 2024-09-12T00:24:24.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.723+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~L2Q8ZM3MWLBW.2 size=529683 2024-09-12T00:24:24.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.727+0000 7f0d199128c0 1 < completed multipart upload key=57W1IO3KSWBR upload=L2Q8ZM3MWLBW tag=YTAP5SUKEOHX type=write size=3675411 2024-09-12T00:24:24.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.731+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=5ZF6JUMP72OP type=del size=1993436 2024-09-12T00:24:24.735 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.735+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~ZJWBRZG2GZYU.0 size=344598 2024-09-12T00:24:24.740 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.739+0000 7f0d199128c0 1 < completed multipart upload key=4K654PSDLDVI upload=ZJWBRZG2GZYU tag=8GQPFKA7F3TO type=write size=1393174 2024-09-12T00:24:24.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.743+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=X07PYD071CJ8 type=del size=2732636 2024-09-12T00:24:24.747 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.747+0000 7f0d199128c0 1 < completed delete operation key=VXZI0ZTMQSV0 tag=SRVDG8973PSQ type=del 2024-09-12T00:24:24.753 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.751+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~RI2S2C7OMBDP.0 size=26698 2024-09-12T00:24:24.753 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.751+0000 7f0d199128c0 1 > prepared multipart upload key=RX3RVT06SGJ4 upload=RI2S2C7OMBDP tag=SW4U7JT7L3AV type=write size=1075274 2024-09-12T00:24:24.757 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.755+0000 7f0d199128c0 1 < completed delete operation key=H604SA6XTFLY tag=EHPPFSAURKH9 type=del 2024-09-12T00:24:24.763 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.763+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~MJ1KGHJ647LE.0 size=1048576 2024-09-12T00:24:24.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.763+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~MJ1KGHJ647LE.1 size=368283 2024-09-12T00:24:24.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.763+0000 7f0d199128c0 1 > prepared multipart upload key=ZWGD87Z1MMNK upload=MJ1KGHJ647LE tag=4SZO4N2PETC0 type=write size=2465435 2024-09-12T00:24:24.768 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.767+0000 7f0d199128c0 1 < completed delete operation key=1Y6B1MJP5G4L tag=9W71ZZMHP31A type=del 2024-09-12T00:24:24.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.775+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~76ELBVNTL1L3.0 size=1048576 2024-09-12T00:24:24.777 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.775+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~76ELBVNTL1L3.1 size=701759 2024-09-12T00:24:24.777 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.775+0000 7f0d199128c0 1 > prepared multipart upload key=SITJU2EUVSR8 upload=76ELBVNTL1L3 tag=G8TB8KOBWBOA type=write size=2798911 2024-09-12T00:24:24.780 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.779+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~6EYMVD31RERV.0 size=776366 2024-09-12T00:24:24.785 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.783+0000 7f0d199128c0 1 < completed multipart upload key=WPZOKZDFXK4S upload=6EYMVD31RERV tag=5UOLWUV8EDDA type=write size=1824942 2024-09-12T00:24:24.788 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.787+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=3IB7XFAUXRFD type=del size=3385513 2024-09-12T00:24:24.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.791+0000 7f0d199128c0 1 < completed delete operation key=37WTPAJGOX5L tag=44SB7QH9RI1N type=del 2024-09-12T00:24:24.795 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.795+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=PPM9BTFRJH9A type=del size=3467869 2024-09-12T00:24:24.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.799+0000 7f0d199128c0 1 < completed write operation key=10YEWZDTTEV0 tag=TKTVHQPDCWUW type=write size=531906 2024-09-12T00:24:24.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.803+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~5BQN79D419AG.0 size=1048576 2024-09-12T00:24:24.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.807+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~5BQN79D419AG.1 size=524859 2024-09-12T00:24:24.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.807+0000 7f0d199128c0 1 > prepared multipart upload key=V6H6S9X0U2A0 upload=5BQN79D419AG tag=X0U0677IWDY4 type=write size=2622011 2024-09-12T00:24:24.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.815+0000 7f0d199128c0 1 < suggested update operation key=WBGXMJB7U422 tag=FZY7CDF3FFGR type=del size=2181757 2024-09-12T00:24:24.818 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.819+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=EFSQHL6SWMMM type=write size=883649 2024-09-12T00:24:24.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.823+0000 7f0d199128c0 1 < completed write operation key=1Y6B1MJP5G4L tag=3JKLB2XN8FNP type=write size=937538 2024-09-12T00:24:24.828 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.827+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~XA5JI5X4ZSUP.0 size=1048576 2024-09-12T00:24:24.831 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.831+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~XA5JI5X4ZSUP.1 size=643324 2024-09-12T00:24:24.831 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.831+0000 7f0d199128c0 1 > prepared multipart upload key=ZWGD87Z1MMNK upload=XA5JI5X4ZSUP tag=3BGGFEYDUKCJ type=write size=2740476 2024-09-12T00:24:24.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.835+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~NWGLC1O2J303.0 size=1048576 2024-09-12T00:24:24.837 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.835+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~NWGLC1O2J303.1 size=324804 2024-09-12T00:24:24.846 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.847+0000 7f0d199128c0 1 < completed multipart upload key=GH0FNY2AI00G upload=NWGLC1O2J303 tag=C06G0AT8FRFN type=write size=2421956 2024-09-12T00:24:24.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.851+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~1X3JM0X2Z88E.0 size=1048576 2024-09-12T00:24:24.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.855+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~1X3JM0X2Z88E.1 size=1048576 2024-09-12T00:24:24.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.855+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~1X3JM0X2Z88E.2 size=657507 2024-09-12T00:24:24.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.855+0000 7f0d199128c0 1 > prepared multipart upload key=NXQYUQIR2APT upload=1X3JM0X2Z88E tag=3QOE3JBNYXB3 type=write size=3803235 2024-09-12T00:24:24.860 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.859+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~Y3X23IKR945L.0 size=407449 2024-09-12T00:24:24.865 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.867+0000 7f0d199128c0 1 < completed multipart upload key=T6GOR4SBYU2Y upload=Y3X23IKR945L tag=SVOHIQ5FQOJE type=write size=1456025 2024-09-12T00:24:24.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.871+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~E54600CAPLKB.0 size=887124 2024-09-12T00:24:24.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.871+0000 7f0d199128c0 1 > prepared multipart upload key=T6GOR4SBYU2Y upload=E54600CAPLKB tag=QRTDS5IE9INI type=write size=1935700 2024-09-12T00:24:24.875 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.875+0000 7f0d199128c0 1 < completed delete operation key=IPJEXRBN96NB tag=SKZMF2LW5HL3 type=del 2024-09-12T00:24:24.879 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.879+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~KWOZ4QUAROT0.0 size=70484 2024-09-12T00:24:24.879 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.879+0000 7f0d199128c0 1 > prepared multipart upload key=4K654PSDLDVI upload=KWOZ4QUAROT0 tag=PJPWG8PYANEW type=write size=1119060 2024-09-12T00:24:24.883 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.883+0000 7f0d199128c0 1 < completed write operation key=0EBWUENN0881 tag=3A03F5L7UL64 type=write size=1037488 2024-09-12T00:24:24.885 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.887+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=0XSIWV29QPJS type=del size=3798886 2024-09-12T00:24:24.888 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.887+0000 7f0d199128c0 -1 < failed to complete operation key=WBGXMJB7U422 tag=NZ01ICNMDF7Z type=write size=134295: (22) Invalid argument 2024-09-12T00:24:24.890 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.891+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=BIULPNPI9YBY type=del size=3356023 2024-09-12T00:24:24.893 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.891+0000 7f0d199128c0 1 < completed delete operation key=YTXW98O07966 tag=V4N84QGE2O3T type=del 2024-09-12T00:24:24.895 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.895+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=DP9PLS1CTM6A type=del size=3957153 2024-09-12T00:24:24.897 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.899+0000 7f0d199128c0 1 < completed delete operation key=IPJEXRBN96NB tag=5ZF6JUMP72OP type=del 2024-09-12T00:24:24.902 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.903+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~1L38T85DUUGC.0 size=837962 2024-09-12T00:24:24.902 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.903+0000 7f0d199128c0 1 > prepared multipart upload key=4K654PSDLDVI upload=1L38T85DUUGC tag=VVPS2ECSQJJZ type=write size=1886538 2024-09-12T00:24:24.905 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.903+0000 7f0d199128c0 1 < completed delete operation key=WPZOKZDFXK4S tag=X07PYD071CJ8 type=del 2024-09-12T00:24:24.907 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.907+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=MJ33TXJCHETZ type=write size=435453 2024-09-12T00:24:24.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.911+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~RI2S2C7OMBDP.0 size=26698 2024-09-12T00:24:24.914 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.915+0000 7f0d199128c0 1 < completed multipart upload key=RX3RVT06SGJ4 upload=RI2S2C7OMBDP tag=SW4U7JT7L3AV type=write size=1075274 2024-09-12T00:24:24.917 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.915+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=4ZLK4I2XTFK3 type=write size=680424 2024-09-12T00:24:24.921 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.919+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~MJ1KGHJ647LE.0 size=1048576 2024-09-12T00:24:24.921 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.923+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~MJ1KGHJ647LE.1 size=368283 2024-09-12T00:24:24.925 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.927+0000 7f0d199128c0 1 < completed multipart upload key=ZWGD87Z1MMNK upload=MJ1KGHJ647LE tag=4SZO4N2PETC0 type=write size=2465435 2024-09-12T00:24:24.928 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.927+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=84MJTBMVX9IC type=del size=2680807 2024-09-12T00:24:24.930 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.931+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~76ELBVNTL1L3.0 size=1048576 2024-09-12T00:24:24.932 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.931+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~76ELBVNTL1L3.1 size=701759 2024-09-12T00:24:24.936 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.935+0000 7f0d199128c0 1 < completed multipart upload key=SITJU2EUVSR8 upload=76ELBVNTL1L3 tag=G8TB8KOBWBOA type=write size=2798911 2024-09-12T00:24:24.939 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.939+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=V9L1ESRX9833 type=del size=3222732 2024-09-12T00:24:24.941 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.939+0000 7f0d199128c0 1 < completed delete operation key=RX3RVT06SGJ4 tag=3IB7XFAUXRFD type=del 2024-09-12T00:24:24.945 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.943+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~J03KK2DDOIWA.0 size=585945 2024-09-12T00:24:24.945 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.943+0000 7f0d199128c0 1 > prepared multipart upload key=ZWGD87Z1MMNK upload=J03KK2DDOIWA tag=C9GKYZCIB0PL type=write size=1634521 2024-09-12T00:24:24.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.947+0000 7f0d199128c0 1 < completed delete operation key=10YEWZDTTEV0 tag=PPM9BTFRJH9A type=del 2024-09-12T00:24:24.950 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.951+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=6QES4XSZVQD1 type=del size=818975 2024-09-12T00:24:24.952 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.951+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~5BQN79D419AG.0 size=1048576 2024-09-12T00:24:24.954 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.955+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~5BQN79D419AG.1 size=524859 2024-09-12T00:24:24.958 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.959+0000 7f0d199128c0 1 < completed multipart upload key=V6H6S9X0U2A0 upload=5BQN79D419AG tag=X0U0677IWDY4 type=write size=2622011 2024-09-12T00:24:24.963 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.963+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~2TBZJWBPXV9J.0 size=1048576 2024-09-12T00:24:24.965 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.963+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~2TBZJWBPXV9J.1 size=1048576 2024-09-12T00:24:24.967 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.967+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~2TBZJWBPXV9J.2 size=920891 2024-09-12T00:24:24.967 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.967+0000 7f0d199128c0 1 > prepared multipart upload key=ZWGD87Z1MMNK upload=2TBZJWBPXV9J tag=SYC27E9ZBJ0P type=write size=4066619 2024-09-12T00:24:24.969 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.967+0000 7f0d199128c0 1 < completed write operation key=4K654PSDLDVI tag=EFSQHL6SWMMM type=write size=883649 2024-09-12T00:24:24.972 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.971+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=HSNRPVX55V3L type=del size=469293 2024-09-12T00:24:24.974 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.975+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~XA5JI5X4ZSUP.0 size=1048576 2024-09-12T00:24:24.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.975+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~XA5JI5X4ZSUP.1 size=643324 2024-09-12T00:24:24.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.983+0000 7f0d199128c0 1 < completed multipart upload key=ZWGD87Z1MMNK upload=XA5JI5X4ZSUP tag=3BGGFEYDUKCJ type=write size=2740476 2024-09-12T00:24:24.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.983+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=7C7NBMUQISDK type=write size=890498 2024-09-12T00:24:24.987 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.987+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~1X3JM0X2Z88E.0 size=1048576 2024-09-12T00:24:24.989 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.987+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~1X3JM0X2Z88E.1 size=1048576 2024-09-12T00:24:24.991 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.991+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~1X3JM0X2Z88E.2 size=657507 2024-09-12T00:24:24.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.995+0000 7f0d199128c0 1 < completed multipart upload key=NXQYUQIR2APT upload=1X3JM0X2Z88E tag=3QOE3JBNYXB3 type=write size=3803235 2024-09-12T00:24:24.998 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.999+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=WHKJTZRRLG7Q type=del size=1844434 2024-09-12T00:24:25.000 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:24.999+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~E54600CAPLKB.0 size=887124 2024-09-12T00:24:25.004 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.003+0000 7f0d199128c0 1 < completed multipart upload key=T6GOR4SBYU2Y upload=E54600CAPLKB tag=QRTDS5IE9INI type=write size=1935700 2024-09-12T00:24:25.009 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.007+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~DR2UBZDW1F7L.0 size=1048576 2024-09-12T00:24:25.011 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.011+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~DR2UBZDW1F7L.1 size=1048576 2024-09-12T00:24:25.013 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.011+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~DR2UBZDW1F7L.2 size=188245 2024-09-12T00:24:25.013 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.011+0000 7f0d199128c0 1 > prepared multipart upload key=4K654PSDLDVI upload=DR2UBZDW1F7L tag=7KL2I282JCCK type=write size=3333973 2024-09-12T00:24:25.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.015+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~KWOZ4QUAROT0.0 size=70484 2024-09-12T00:24:25.021 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.019+0000 7f0d199128c0 1 < completed multipart upload key=4K654PSDLDVI upload=KWOZ4QUAROT0 tag=PJPWG8PYANEW type=write size=1119060 2024-09-12T00:24:25.026 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.027+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~3EN1ET13P24Q.0 size=1048576 2024-09-12T00:24:25.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.027+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~3EN1ET13P24Q.1 size=371001 2024-09-12T00:24:25.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.027+0000 7f0d199128c0 1 > prepared multipart upload key=0ZT4NZYZKI5Z upload=3EN1ET13P24Q tag=166SMODWBS8S type=write size=2468153 2024-09-12T00:24:25.032 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.031+0000 7f0d199128c0 1 < completed delete operation key=SITJU2EUVSR8 tag=0XSIWV29QPJS type=del 2024-09-12T00:24:25.038 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.039+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~4AJ80VGMD1EA.0 size=24490 2024-09-12T00:24:25.038 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.039+0000 7f0d199128c0 1 > prepared multipart upload key=V6H6S9X0U2A0 upload=4AJ80VGMD1EA tag=JH5AR5X1YF8X type=write size=1073066 2024-09-12T00:24:25.041 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.039+0000 7f0d199128c0 1 < completed delete operation key=J75P0821XGRO tag=BIULPNPI9YBY type=del 2024-09-12T00:24:25.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.043+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=SIES3BJF9A56 type=del size=2164113 2024-09-12T00:24:25.047 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.047+0000 7f0d199128c0 1 < completed delete operation key=OVLAP0OS78QG tag=DP9PLS1CTM6A type=del 2024-09-12T00:24:25.051 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.051+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~34MRXQW0PMNJ.0 size=1036643 2024-09-12T00:24:25.051 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.051+0000 7f0d199128c0 1 > prepared multipart upload key=PK2CA62QBZXS upload=34MRXQW0PMNJ tag=GBROFYZ44ME8 type=write size=2085219 2024-09-12T00:24:25.054 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.055+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~1L38T85DUUGC.0 size=837962 2024-09-12T00:24:25.058 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.059+0000 7f0d199128c0 1 < completed multipart upload key=4K654PSDLDVI upload=1L38T85DUUGC tag=VVPS2ECSQJJZ type=write size=1886538 2024-09-12T00:24:25.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.063+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~4Y2UNX10C15W.0 size=1048576 2024-09-12T00:24:25.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.067+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~4Y2UNX10C15W.1 size=585064 2024-09-12T00:24:25.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.067+0000 7f0d199128c0 1 > prepared multipart upload key=PK2CA62QBZXS upload=4Y2UNX10C15W tag=QZT03WG24EVV type=write size=2682216 2024-09-12T00:24:25.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.067+0000 7f0d199128c0 1 < completed write operation key=10YEWZDTTEV0 tag=MJ33TXJCHETZ type=write size=435453 2024-09-12T00:24:25.071 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.071+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=FYUFBAP5J9MA type=del size=1385769 2024-09-12T00:24:25.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.075+0000 7f0d199128c0 1 < canceled operation key=VXZI0ZTMQSV0 tag=4ZLK4I2XTFK3 type=write size=680424 2024-09-12T00:24:25.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.079+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~AAYSD87MXM7J.0 size=1048576 2024-09-12T00:24:25.081 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.083+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~AAYSD87MXM7J.1 size=1048576 2024-09-12T00:24:25.084 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.083+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~AAYSD87MXM7J.2 size=744717 2024-09-12T00:24:25.084 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.083+0000 7f0d199128c0 1 > prepared multipart upload key=9I6MZAEUS4I0 upload=AAYSD87MXM7J tag=B0GYW5R7U0ED type=write size=3890445 2024-09-12T00:24:25.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.087+0000 7f0d199128c0 1 < completed delete operation key=HXNC728XIWC1 tag=84MJTBMVX9IC type=del 2024-09-12T00:24:25.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.091+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=RKUEF6CZM6M4 type=del size=1426068 2024-09-12T00:24:25.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.099+0000 7f0d199128c0 1 < suggested remove operation key=PK2CA62QBZXS tag=V9L1ESRX9833 type=del 2024-09-12T00:24:25.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.103+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=OEOICHCGL6YZ type=write size=7026 2024-09-12T00:24:25.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.103+0000 7f0d199128c0 1 < canceled part key=_multipart_ZWGD87Z1MMNK.2~J03KK2DDOIWA.0 size=585945 2024-09-12T00:24:25.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.111+0000 7f0d199128c0 1 < canceled multipart upload key=ZWGD87Z1MMNK upload=J03KK2DDOIWA tag=C9GKYZCIB0PL type=write size=1634521 2024-09-12T00:24:25.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.111+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=XYCBBIKVQNIK type=write size=965633 2024-09-12T00:24:25.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.115+0000 7f0d199128c0 1 < completed delete operation key=QUO5ND3O41TY tag=6QES4XSZVQD1 type=del 2024-09-12T00:24:25.125 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.123+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~W1L1YXMKA5PX.0 size=1048576 2024-09-12T00:24:25.125 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.123+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~W1L1YXMKA5PX.1 size=1048576 2024-09-12T00:24:25.127 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.127+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~W1L1YXMKA5PX.2 size=393332 2024-09-12T00:24:25.127 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.127+0000 7f0d199128c0 1 > prepared multipart upload key=FJ8YV026H0ZU upload=W1L1YXMKA5PX tag=9BCO6AN3AKKT type=write size=3539060 2024-09-12T00:24:25.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.131+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~2TBZJWBPXV9J.0 size=1048576 2024-09-12T00:24:25.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.131+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~2TBZJWBPXV9J.1 size=1048576 2024-09-12T00:24:25.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.135+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~2TBZJWBPXV9J.2 size=920891 2024-09-12T00:24:25.141 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.139+0000 7f0d199128c0 1 < completed multipart upload key=ZWGD87Z1MMNK upload=2TBZJWBPXV9J tag=SYC27E9ZBJ0P type=write size=4066619 2024-09-12T00:24:25.144 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.143+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=9AY81AOCNBZO type=write size=408410 2024-09-12T00:24:25.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.147+0000 7f0d199128c0 1 < completed delete operation key=NXQYUQIR2APT tag=HSNRPVX55V3L type=del 2024-09-12T00:24:25.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.151+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=MIKUNSL89GXY type=del size=2735517 2024-09-12T00:24:25.153 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.155+0000 7f0d199128c0 1 < canceled operation key=HXNC728XIWC1 tag=7C7NBMUQISDK type=write size=890498 2024-09-12T00:24:25.156 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.155+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=CS9DSV66ESGC type=del size=3110085 2024-09-12T00:24:25.160 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.159+0000 7f0d199128c0 1 < canceled operation key=0EBWUENN0881 tag=WHKJTZRRLG7Q type=del size=1844434 2024-09-12T00:24:25.163 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.163+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=RZBUHFQMWDAB type=del size=3688881 2024-09-12T00:24:25.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.167+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~DR2UBZDW1F7L.0 size=1048576 2024-09-12T00:24:25.168 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.167+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~DR2UBZDW1F7L.1 size=1048576 2024-09-12T00:24:25.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.171+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~DR2UBZDW1F7L.2 size=188245 2024-09-12T00:24:25.176 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.175+0000 7f0d199128c0 1 < completed multipart upload key=4K654PSDLDVI upload=DR2UBZDW1F7L tag=7KL2I282JCCK type=write size=3333973 2024-09-12T00:24:25.179 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.179+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=MIDFMVACEA7X type=write size=228511 2024-09-12T00:24:25.182 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.183+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~3EN1ET13P24Q.0 size=1048576 2024-09-12T00:24:25.184 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.183+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~3EN1ET13P24Q.1 size=371001 2024-09-12T00:24:25.190 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.191+0000 7f0d199128c0 1 < completed multipart upload key=0ZT4NZYZKI5Z upload=3EN1ET13P24Q tag=166SMODWBS8S type=write size=2468153 2024-09-12T00:24:25.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.195+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~XQ0T8QFCP8TT.0 size=1048576 2024-09-12T00:24:25.198 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.199+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~XQ0T8QFCP8TT.1 size=1048576 2024-09-12T00:24:25.201 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.199+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~XQ0T8QFCP8TT.2 size=1002740 2024-09-12T00:24:25.201 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.199+0000 7f0d199128c0 1 > prepared multipart upload key=ZWGD87Z1MMNK upload=XQ0T8QFCP8TT tag=URHU6Q27E95N type=write size=4148468 2024-09-12T00:24:25.204 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.203+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~4AJ80VGMD1EA.0 size=24490 2024-09-12T00:24:25.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.211+0000 7f0d199128c0 1 < completed multipart upload key=V6H6S9X0U2A0 upload=4AJ80VGMD1EA tag=JH5AR5X1YF8X type=write size=1073066 2024-09-12T00:24:25.214 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.215+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=FTVSY5D5IKRD type=del size=3791411 2024-09-12T00:24:25.218 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.219+0000 7f0d199128c0 1 < completed delete operation key=QUO5ND3O41TY tag=SIES3BJF9A56 type=del 2024-09-12T00:24:25.221 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.219+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=K3U9Z0KKDE4R type=write size=263372 2024-09-12T00:24:25.225 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.223+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~34MRXQW0PMNJ.0 size=1036643 2024-09-12T00:24:25.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.231+0000 7f0d199128c0 1 < completed multipart upload key=PK2CA62QBZXS upload=34MRXQW0PMNJ tag=GBROFYZ44ME8 type=write size=2085219 2024-09-12T00:24:25.235 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.235+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~V25X9A2VC2VI.0 size=1048576 2024-09-12T00:24:25.237 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.239+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~V25X9A2VC2VI.1 size=1048576 2024-09-12T00:24:25.240 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.239+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~V25X9A2VC2VI.2 size=888215 2024-09-12T00:24:25.240 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.239+0000 7f0d199128c0 1 > prepared multipart upload key=JA6CSJF78VE2 upload=V25X9A2VC2VI tag=Y12OUND5B75L type=write size=4033943 2024-09-12T00:24:25.243 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.243+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~4Y2UNX10C15W.0 size=1048576 2024-09-12T00:24:25.245 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.243+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~4Y2UNX10C15W.1 size=585064 2024-09-12T00:24:25.250 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.251+0000 7f0d199128c0 1 < completed multipart upload key=PK2CA62QBZXS upload=4Y2UNX10C15W tag=QZT03WG24EVV type=write size=2682216 2024-09-12T00:24:25.253 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.251+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=CCRPUCPF2U48 type=write size=284183 2024-09-12T00:24:25.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.255+0000 7f0d199128c0 1 < completed delete operation key=B58RWC9W8THG tag=FYUFBAP5J9MA type=del 2024-09-12T00:24:25.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.259+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=91SM6HYAPUSF type=del size=2583813 2024-09-12T00:24:25.262 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.263+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~AAYSD87MXM7J.0 size=1048576 2024-09-12T00:24:25.262 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.263+0000 7f0d199128c0 1 < canceled part key=_multipart_9I6MZAEUS4I0.2~AAYSD87MXM7J.1 size=1048576 2024-09-12T00:24:25.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.263+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~AAYSD87MXM7J.2 size=744717 2024-09-12T00:24:25.270 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.271+0000 7f0d199128c0 1 < canceled multipart upload key=9I6MZAEUS4I0 upload=AAYSD87MXM7J tag=B0GYW5R7U0ED type=write size=3890445 2024-09-12T00:24:25.276 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.275+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~A75082QRE407.0 size=770046 2024-09-12T00:24:25.276 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.275+0000 7f0d199128c0 1 > prepared multipart upload key=NXQYUQIR2APT upload=A75082QRE407 tag=2OAAT117EV4M type=write size=1818622 2024-09-12T00:24:25.282 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.283+0000 7f0d199128c0 1 < suggested update operation key=10YEWZDTTEV0 tag=RKUEF6CZM6M4 type=del size=1426068 2024-09-12T00:24:25.284 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.283+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=SLJW20ZR8HHW type=del size=3333797 2024-09-12T00:24:25.287 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.287+0000 7f0d199128c0 1 < completed write operation key=A529WOKFD1NI tag=OEOICHCGL6YZ type=write size=7026 2024-09-12T00:24:25.292 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.291+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~P284V75O2O0Z.0 size=283042 2024-09-12T00:24:25.292 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.291+0000 7f0d199128c0 1 > prepared multipart upload key=9I6MZAEUS4I0 upload=P284V75O2O0Z tag=CO2OQ03HQIRG type=write size=1331618 2024-09-12T00:24:25.295 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.295+0000 7f0d199128c0 1 < completed write operation key=H604SA6XTFLY tag=XYCBBIKVQNIK type=write size=965633 2024-09-12T00:24:25.301 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.299+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~9JH2BERPOWRS.0 size=1048576 2024-09-12T00:24:25.303 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.303+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~9JH2BERPOWRS.1 size=604619 2024-09-12T00:24:25.303 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.303+0000 7f0d199128c0 1 > prepared multipart upload key=A529WOKFD1NI upload=9JH2BERPOWRS tag=79W6IJ7JXQ0Q type=write size=2701771 2024-09-12T00:24:25.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.307+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~W1L1YXMKA5PX.0 size=1048576 2024-09-12T00:24:25.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.307+0000 7f0d199128c0 1 < canceled part key=_multipart_FJ8YV026H0ZU.2~W1L1YXMKA5PX.1 size=1048576 2024-09-12T00:24:25.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.307+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~W1L1YXMKA5PX.2 size=393332 2024-09-12T00:24:25.314 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.315+0000 7f0d199128c0 1 < canceled multipart upload key=FJ8YV026H0ZU upload=W1L1YXMKA5PX tag=9BCO6AN3AKKT type=write size=3539060 2024-09-12T00:24:25.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.319+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~GZWT1SMPUUF2.0 size=1048576 2024-09-12T00:24:25.323 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.323+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~GZWT1SMPUUF2.1 size=544438 2024-09-12T00:24:25.323 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.323+0000 7f0d199128c0 1 > prepared multipart upload key=A529WOKFD1NI upload=GZWT1SMPUUF2 tag=DDYNUHU498PR type=write size=2641590 2024-09-12T00:24:25.329 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.327+0000 7f0d199128c0 1 < completed write operation key=GH0FNY2AI00G tag=9AY81AOCNBZO type=write size=408410 2024-09-12T00:24:25.333 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.331+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~KW6WRWP6IH37.0 size=1048576 2024-09-12T00:24:25.335 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.335+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~KW6WRWP6IH37.1 size=1048576 2024-09-12T00:24:25.338 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.339+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~KW6WRWP6IH37.2 size=768026 2024-09-12T00:24:25.338 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.339+0000 7f0d199128c0 1 > prepared multipart upload key=WPZOKZDFXK4S upload=KW6WRWP6IH37 tag=8V5I1UL9GJT2 type=write size=3913754 2024-09-12T00:24:25.345 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.347+0000 7f0d199128c0 1 < suggested update operation key=0ZT4NZYZKI5Z tag=MIKUNSL89GXY type=del size=2735517 2024-09-12T00:24:25.349 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.347+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=E9A3J5PX7P6X type=del size=1771028 2024-09-12T00:24:25.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.351+0000 7f0d199128c0 1 < completed delete operation key=HXNC728XIWC1 tag=CS9DSV66ESGC type=del 2024-09-12T00:24:25.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.355+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=XU15DZR7JWKK type=del size=400828 2024-09-12T00:24:25.358 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.359+0000 7f0d199128c0 1 < canceled operation key=H604SA6XTFLY tag=RZBUHFQMWDAB type=del size=3688881 2024-09-12T00:24:25.365 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.363+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~8GW0ZLUIOC5Y.0 size=59794 2024-09-12T00:24:25.365 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.363+0000 7f0d199128c0 1 > prepared multipart upload key=FJ8YV026H0ZU upload=8GW0ZLUIOC5Y tag=GRKGSSBZ5CLO type=write size=1108370 2024-09-12T00:24:25.368 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.367+0000 7f0d199128c0 1 < completed write operation key=ZWGD87Z1MMNK tag=MIDFMVACEA7X type=write size=228511 2024-09-12T00:24:25.371 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.371+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=IIRPQELPB1IJ type=write size=35453 2024-09-12T00:24:25.374 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.375+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~XQ0T8QFCP8TT.0 size=1048576 2024-09-12T00:24:25.376 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.375+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~XQ0T8QFCP8TT.1 size=1048576 2024-09-12T00:24:25.379 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.379+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~XQ0T8QFCP8TT.2 size=1002740 2024-09-12T00:24:25.385 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.383+0000 7f0d199128c0 1 < completed multipart upload key=ZWGD87Z1MMNK upload=XQ0T8QFCP8TT tag=URHU6Q27E95N type=write size=4148468 2024-09-12T00:24:25.391 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.391+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=V16MFVU6LZM4 type=del size=4073647 2024-09-12T00:24:25.395 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.395+0000 7f0d199128c0 1 < completed delete operation key=37WTPAJGOX5L tag=FTVSY5D5IKRD type=del 2024-09-12T00:24:25.403 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.403+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~S7EE3SBD94C9.0 size=1048576 2024-09-12T00:24:25.405 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.407+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~S7EE3SBD94C9.1 size=462002 2024-09-12T00:24:25.406 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.407+0000 7f0d199128c0 1 > prepared multipart upload key=B58RWC9W8THG upload=S7EE3SBD94C9 tag=13WXSR8EVFE7 type=write size=2559154 2024-09-12T00:24:25.409 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.407+0000 7f0d199128c0 1 < completed write operation key=PK2CA62QBZXS tag=K3U9Z0KKDE4R type=write size=263372 2024-09-12T00:24:25.415 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.415+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~9ON00CGUG7MI.0 size=451329 2024-09-12T00:24:25.416 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.415+0000 7f0d199128c0 1 > prepared multipart upload key=OVLAP0OS78QG upload=9ON00CGUG7MI tag=ZME01EBE2DYI type=write size=1499905 2024-09-12T00:24:25.419 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.419+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~V25X9A2VC2VI.0 size=1048576 2024-09-12T00:24:25.419 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.419+0000 7f0d199128c0 1 < canceled part key=_multipart_JA6CSJF78VE2.2~V25X9A2VC2VI.1 size=1048576 2024-09-12T00:24:25.421 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.419+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~V25X9A2VC2VI.2 size=888215 2024-09-12T00:24:25.427 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.427+0000 7f0d199128c0 1 < canceled multipart upload key=JA6CSJF78VE2 upload=V25X9A2VC2VI tag=Y12OUND5B75L type=write size=4033943 2024-09-12T00:24:25.433 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.431+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~97CHX1WSGVCK.0 size=1048576 2024-09-12T00:24:25.435 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.435+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~97CHX1WSGVCK.1 size=1048576 2024-09-12T00:24:25.438 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.439+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~97CHX1WSGVCK.2 size=692474 2024-09-12T00:24:25.438 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.439+0000 7f0d199128c0 1 > prepared multipart upload key=SITJU2EUVSR8 upload=97CHX1WSGVCK tag=H0UKSY9GXTGS type=write size=3838202 2024-09-12T00:24:25.442 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.443+0000 7f0d199128c0 1 < canceled operation key=YTXW98O07966 tag=CCRPUCPF2U48 type=write size=284183 2024-09-12T00:24:25.445 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.443+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=1PWIHDNPHQUU type=del size=2190129 2024-09-12T00:24:25.448 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.447+0000 7f0d199128c0 1 < completed delete operation key=VXZI0ZTMQSV0 tag=91SM6HYAPUSF type=del 2024-09-12T00:24:25.452 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.451+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=NMYOQ0IPGZOM type=del size=3717778 2024-09-12T00:24:25.455 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.455+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~A75082QRE407.0 size=770046 2024-09-12T00:24:25.460 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.459+0000 7f0d199128c0 1 < completed multipart upload key=NXQYUQIR2APT upload=A75082QRE407 tag=2OAAT117EV4M type=write size=1818622 2024-09-12T00:24:25.463 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.463+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=CYBOK0Z9539Q type=del size=3322864 2024-09-12T00:24:25.467 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.467+0000 7f0d199128c0 1 < canceled operation key=B58RWC9W8THG tag=SLJW20ZR8HHW type=del size=3333797 2024-09-12T00:24:25.470 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.471+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=W58HHQJUONDG type=del size=3191240 2024-09-12T00:24:25.473 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.471+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~P284V75O2O0Z.0 size=283042 2024-09-12T00:24:25.479 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.479+0000 7f0d199128c0 1 < completed multipart upload key=9I6MZAEUS4I0 upload=P284V75O2O0Z tag=CO2OQ03HQIRG type=write size=1331618 2024-09-12T00:24:25.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.483+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~CE0JV3JKM7F4.0 size=1048576 2024-09-12T00:24:25.487 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.487+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~CE0JV3JKM7F4.1 size=1048576 2024-09-12T00:24:25.490 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.491+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~CE0JV3JKM7F4.2 size=862153 2024-09-12T00:24:25.490 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.491+0000 7f0d199128c0 1 > prepared multipart upload key=IPJEXRBN96NB upload=CE0JV3JKM7F4 tag=RULOQI26TR53 type=write size=4007881 2024-09-12T00:24:25.493 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.495+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~9JH2BERPOWRS.0 size=1048576 2024-09-12T00:24:25.496 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.495+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~9JH2BERPOWRS.1 size=604619 2024-09-12T00:24:25.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.503+0000 7f0d199128c0 1 < completed multipart upload key=A529WOKFD1NI upload=9JH2BERPOWRS tag=79W6IJ7JXQ0Q type=write size=2701771 2024-09-12T00:24:25.508 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.507+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~5V6LLF8P980D.0 size=608366 2024-09-12T00:24:25.508 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.507+0000 7f0d199128c0 1 > prepared multipart upload key=4K654PSDLDVI upload=5V6LLF8P980D tag=Y8SKI8OF6X5J type=write size=1656942 2024-09-12T00:24:25.511 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.511+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~GZWT1SMPUUF2.0 size=1048576 2024-09-12T00:24:25.514 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.515+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~GZWT1SMPUUF2.1 size=544438 2024-09-12T00:24:25.520 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.519+0000 7f0d199128c0 1 < completed multipart upload key=A529WOKFD1NI upload=GZWT1SMPUUF2 tag=DDYNUHU498PR type=write size=2641590 2024-09-12T00:24:25.523 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.523+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=F65IVCPS3GPE type=del size=2860675 2024-09-12T00:24:25.527 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.527+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~KW6WRWP6IH37.0 size=1048576 2024-09-12T00:24:25.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.531+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~KW6WRWP6IH37.1 size=1048576 2024-09-12T00:24:25.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.531+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~KW6WRWP6IH37.2 size=768026 2024-09-12T00:24:25.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.539+0000 7f0d199128c0 1 < completed multipart upload key=WPZOKZDFXK4S upload=KW6WRWP6IH37 tag=8V5I1UL9GJT2 type=write size=3913754 2024-09-12T00:24:25.542 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.543+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=6C2TSGHUZPMS type=del size=1140712 2024-09-12T00:24:25.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.547+0000 7f0d199128c0 1 < canceled operation key=A529WOKFD1NI tag=E9A3J5PX7P6X type=del size=1771028 2024-09-12T00:24:25.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.547+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=3Q4LQ3S9J3I2 type=write size=480001 2024-09-12T00:24:25.553 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.551+0000 7f0d199128c0 1 < completed delete operation key=1Y6B1MJP5G4L tag=XU15DZR7JWKK type=del 2024-09-12T00:24:25.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.555+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=YESOG7O824MB type=write size=59040 2024-09-12T00:24:25.561 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.559+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~8GW0ZLUIOC5Y.0 size=59794 2024-09-12T00:24:25.568 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.567+0000 7f0d199128c0 1 < completed multipart upload key=FJ8YV026H0ZU upload=8GW0ZLUIOC5Y tag=GRKGSSBZ5CLO type=write size=1108370 2024-09-12T00:24:25.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.571+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=291PT2Z1OZ48 type=del size=3172485 2024-09-12T00:24:25.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.575+0000 7f0d199128c0 1 < completed write operation key=NXQYUQIR2APT tag=IIRPQELPB1IJ type=write size=35453 2024-09-12T00:24:25.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.583+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~02REK2X2R7ZQ.0 size=185631 2024-09-12T00:24:25.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.583+0000 7f0d199128c0 1 > prepared multipart upload key=NXQYUQIR2APT upload=02REK2X2R7ZQ tag=499UT7ONZS3U type=write size=1234207 2024-09-12T00:24:25.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.587+0000 7f0d199128c0 1 < completed delete operation key=T6GOR4SBYU2Y tag=V16MFVU6LZM4 type=del 2024-09-12T00:24:25.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.591+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=7A01OV676L2X type=write size=141809 2024-09-12T00:24:25.595 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.595+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~S7EE3SBD94C9.0 size=1048576 2024-09-12T00:24:25.597 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.599+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~S7EE3SBD94C9.1 size=462002 2024-09-12T00:24:25.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.603+0000 7f0d199128c0 1 < completed multipart upload key=B58RWC9W8THG upload=S7EE3SBD94C9 tag=13WXSR8EVFE7 type=write size=2559154 2024-09-12T00:24:25.608 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.607+0000 7f0d199128c0 1 > prepared operation key=57W1IO3KSWBR tag=SC46XM78HWRG type=del size=916612 2024-09-12T00:24:25.612 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.611+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~9ON00CGUG7MI.0 size=451329 2024-09-12T00:24:25.618 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.619+0000 7f0d199128c0 1 < completed multipart upload key=OVLAP0OS78QG upload=9ON00CGUG7MI tag=ZME01EBE2DYI type=write size=1499905 2024-09-12T00:24:25.621 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.619+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=L9W1D9NMHQED type=write size=916370 2024-09-12T00:24:25.624 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.623+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~97CHX1WSGVCK.0 size=1048576 2024-09-12T00:24:25.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.627+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~97CHX1WSGVCK.1 size=1048576 2024-09-12T00:24:25.630 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.631+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~97CHX1WSGVCK.2 size=692474 2024-09-12T00:24:25.636 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.635+0000 7f0d199128c0 1 < completed multipart upload key=SITJU2EUVSR8 upload=97CHX1WSGVCK tag=H0UKSY9GXTGS type=write size=3838202 2024-09-12T00:24:25.639 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.639+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=KPOHRNQDX41D type=del size=757932 2024-09-12T00:24:25.648 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.647+0000 7f0d199128c0 1 < suggested update operation key=RX3RVT06SGJ4 tag=1PWIHDNPHQUU type=del size=2190129 2024-09-12T00:24:25.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.655+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~AXSD1W0B7H2A.0 size=1048576 2024-09-12T00:24:25.657 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.659+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~AXSD1W0B7H2A.1 size=1048576 2024-09-12T00:24:25.661 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.659+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~AXSD1W0B7H2A.2 size=230504 2024-09-12T00:24:25.661 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.659+0000 7f0d199128c0 1 > prepared multipart upload key=0EBWUENN0881 upload=AXSD1W0B7H2A tag=HG1A24HC5QX3 type=write size=3376232 2024-09-12T00:24:25.664 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.663+0000 7f0d199128c0 1 < completed delete operation key=JA6CSJF78VE2 tag=NMYOQ0IPGZOM type=del 2024-09-12T00:24:25.671 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.671+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~SNZXRGIA5YJ8.0 size=1048576 2024-09-12T00:24:25.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.675+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~SNZXRGIA5YJ8.1 size=63716 2024-09-12T00:24:25.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.675+0000 7f0d199128c0 1 > prepared multipart upload key=GH0FNY2AI00G upload=SNZXRGIA5YJ8 tag=8PVWDON05FS3 type=write size=2160868 2024-09-12T00:24:25.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.679+0000 7f0d199128c0 1 < completed delete operation key=2EK9CCKG26W2 tag=CYBOK0Z9539Q type=del 2024-09-12T00:24:25.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.683+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=4CV8ZIW0SN0X type=del size=2736461 2024-09-12T00:24:25.685 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.683+0000 7f0d199128c0 1 < completed delete operation key=H604SA6XTFLY tag=W58HHQJUONDG type=del 2024-09-12T00:24:25.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.691+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~EEZHEA3P3RVP.0 size=717188 2024-09-12T00:24:25.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.691+0000 7f0d199128c0 1 > prepared multipart upload key=SITJU2EUVSR8 upload=EEZHEA3P3RVP tag=RBHNGZXY2W37 type=write size=1765764 2024-09-12T00:24:25.696 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.695+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~CE0JV3JKM7F4.0 size=1048576 2024-09-12T00:24:25.699 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.699+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~CE0JV3JKM7F4.1 size=1048576 2024-09-12T00:24:25.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.703+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~CE0JV3JKM7F4.2 size=862153 2024-09-12T00:24:25.709 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.707+0000 7f0d199128c0 1 < completed multipart upload key=IPJEXRBN96NB upload=CE0JV3JKM7F4 tag=RULOQI26TR53 type=write size=4007881 2024-09-12T00:24:25.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.711+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=OE7LUSI0D771 type=write size=326821 2024-09-12T00:24:25.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.715+0000 7f0d199128c0 1 < canceled part key=_multipart_4K654PSDLDVI.2~5V6LLF8P980D.0 size=608366 2024-09-12T00:24:25.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.723+0000 7f0d199128c0 1 < canceled multipart upload key=4K654PSDLDVI upload=5V6LLF8P980D tag=Y8SKI8OF6X5J type=write size=1656942 2024-09-12T00:24:25.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.727+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=TXT8MFJ543MU type=write size=301708 2024-09-12T00:24:25.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.731+0000 7f0d199128c0 1 < completed delete operation key=VXZI0ZTMQSV0 tag=F65IVCPS3GPE type=del 2024-09-12T00:24:25.737 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.735+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~VW09YSIS52Q7.0 size=1048576 2024-09-12T00:24:25.739 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.739+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~VW09YSIS52Q7.1 size=330001 2024-09-12T00:24:25.740 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.739+0000 7f0d199128c0 1 > prepared multipart upload key=H604SA6XTFLY upload=VW09YSIS52Q7 tag=QKBJ5I8XS775 type=write size=2427153 2024-09-12T00:24:25.743 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.743+0000 7f0d199128c0 1 < completed delete operation key=IPJEXRBN96NB tag=6C2TSGHUZPMS type=del 2024-09-12T00:24:25.747 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.747+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=UTAFUE8I0YYH type=del size=2789089 2024-09-12T00:24:25.750 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.751+0000 7f0d199128c0 1 < completed write operation key=9I6MZAEUS4I0 tag=3Q4LQ3S9J3I2 type=write size=480001 2024-09-12T00:24:25.758 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.759+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~9V4MOEG5GFSP.0 size=1048576 2024-09-12T00:24:25.760 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.759+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~9V4MOEG5GFSP.1 size=130866 2024-09-12T00:24:25.760 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.759+0000 7f0d199128c0 1 > prepared multipart upload key=0ZT4NZYZKI5Z upload=9V4MOEG5GFSP tag=PG1IB74L4I7E type=write size=2228018 2024-09-12T00:24:25.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.763+0000 7f0d199128c0 1 < completed write operation key=NXQYUQIR2APT tag=YESOG7O824MB type=write size=59040 2024-09-12T00:24:25.770 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.771+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~X74DWSK1WMOZ.0 size=207594 2024-09-12T00:24:25.770 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.771+0000 7f0d199128c0 1 > prepared multipart upload key=FJ8YV026H0ZU upload=X74DWSK1WMOZ tag=2IW40OWZCVJ2 type=write size=1256170 2024-09-12T00:24:25.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.775+0000 7f0d199128c0 1 < completed delete operation key=PK2CA62QBZXS tag=291PT2Z1OZ48 type=del 2024-09-12T00:24:25.777 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.775+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=HPLIFSCEGXGR type=write size=155570 2024-09-12T00:24:25.780 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.779+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~02REK2X2R7ZQ.0 size=185631 2024-09-12T00:24:25.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.787+0000 7f0d199128c0 1 < completed multipart upload key=NXQYUQIR2APT upload=02REK2X2R7ZQ tag=499UT7ONZS3U type=write size=1234207 2024-09-12T00:24:25.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.791+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~O3Z6FF1XGEH0.0 size=1048576 2024-09-12T00:24:25.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.795+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~O3Z6FF1XGEH0.1 size=813128 2024-09-12T00:24:25.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.795+0000 7f0d199128c0 1 > prepared multipart upload key=B58RWC9W8THG upload=O3Z6FF1XGEH0 tag=YMQQZ7125GG2 type=write size=2910280 2024-09-12T00:24:25.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.799+0000 7f0d199128c0 1 < canceled operation key=V6H6S9X0U2A0 tag=7A01OV676L2X type=write size=141809 2024-09-12T00:24:25.801 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.803+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=XF9O1QTIQMZV type=del size=2751068 2024-09-12T00:24:25.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.807+0000 7f0d199128c0 1 < suggested remove operation key=57W1IO3KSWBR tag=SC46XM78HWRG type=del 2024-09-12T00:24:25.812 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.811+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=GM14DAM1GSRH type=del size=1228659 2024-09-12T00:24:25.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.815+0000 7f0d199128c0 1 < completed write operation key=HXNC728XIWC1 tag=L9W1D9NMHQED type=write size=916370 2024-09-12T00:24:25.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.823+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~T0GQIN58Q71A.0 size=1048576 2024-09-12T00:24:25.824 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.823+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~T0GQIN58Q71A.1 size=1000964 2024-09-12T00:24:25.824 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.823+0000 7f0d199128c0 1 > prepared multipart upload key=H604SA6XTFLY upload=T0GQIN58Q71A tag=SNJ308SJME1W type=write size=3098116 2024-09-12T00:24:25.831 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.831+0000 7f0d199128c0 1 < suggested remove operation key=10YEWZDTTEV0 tag=KPOHRNQDX41D type=del 2024-09-12T00:24:25.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.835+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=PUIEAIQVEZDS type=write size=606527 2024-09-12T00:24:25.839 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.839+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~AXSD1W0B7H2A.0 size=1048576 2024-09-12T00:24:25.839 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.839+0000 7f0d199128c0 1 < canceled part key=_multipart_0EBWUENN0881.2~AXSD1W0B7H2A.1 size=1048576 2024-09-12T00:24:25.841 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.843+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~AXSD1W0B7H2A.2 size=230504 2024-09-12T00:24:25.848 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.847+0000 7f0d199128c0 1 < canceled multipart upload key=0EBWUENN0881 upload=AXSD1W0B7H2A tag=HG1A24HC5QX3 type=write size=3376232 2024-09-12T00:24:25.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.855+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~0YJAUAJEMTWI.0 size=1048576 2024-09-12T00:24:25.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.855+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~0YJAUAJEMTWI.1 size=1048576 2024-09-12T00:24:25.859 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.859+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~0YJAUAJEMTWI.2 size=168363 2024-09-12T00:24:25.859 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.859+0000 7f0d199128c0 1 > prepared multipart upload key=WPZOKZDFXK4S upload=0YJAUAJEMTWI tag=N3D6HTGHWXQQ type=write size=3314091 2024-09-12T00:24:25.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.863+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~SNZXRGIA5YJ8.0 size=1048576 2024-09-12T00:24:25.865 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.867+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~SNZXRGIA5YJ8.1 size=63716 2024-09-12T00:24:25.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.871+0000 7f0d199128c0 1 < completed multipart upload key=GH0FNY2AI00G upload=SNZXRGIA5YJ8 tag=8PVWDON05FS3 type=write size=2160868 2024-09-12T00:24:25.874 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.875+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=D8FH036VYQH6 type=del size=573351 2024-09-12T00:24:25.878 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.879+0000 7f0d199128c0 1 < completed delete operation key=NXQYUQIR2APT tag=4CV8ZIW0SN0X type=del 2024-09-12T00:24:25.884 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.883+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~2HRDSEJL5FRY.0 size=1048576 2024-09-12T00:24:25.887 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.887+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~2HRDSEJL5FRY.1 size=320325 2024-09-12T00:24:25.887 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.887+0000 7f0d199128c0 1 > prepared multipart upload key=37WTPAJGOX5L upload=2HRDSEJL5FRY tag=0RDC67EDSJNG type=write size=2417477 2024-09-12T00:24:25.890 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.891+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~EEZHEA3P3RVP.0 size=717188 2024-09-12T00:24:25.895 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.895+0000 7f0d199128c0 1 < completed multipart upload key=SITJU2EUVSR8 upload=EEZHEA3P3RVP tag=RBHNGZXY2W37 type=write size=1765764 2024-09-12T00:24:25.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.899+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=QYJUEXE3ZTAD type=del size=1852971 2024-09-12T00:24:25.902 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.903+0000 7f0d199128c0 1 < completed write operation key=J75P0821XGRO tag=OE7LUSI0D771 type=write size=326821 2024-09-12T00:24:25.905 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.903+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=XJOBMVARA4PB type=del size=4046870 2024-09-12T00:24:25.909 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.907+0000 7f0d199128c0 1 < completed write operation key=B58RWC9W8THG tag=TXT8MFJ543MU type=write size=301708 2024-09-12T00:24:25.913 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.911+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=Y05HXF7IAA87 type=del size=1910555 2024-09-12T00:24:25.916 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.915+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~VW09YSIS52Q7.0 size=1048576 2024-09-12T00:24:25.919 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.919+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~VW09YSIS52Q7.1 size=330001 2024-09-12T00:24:25.925 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.923+0000 7f0d199128c0 1 < completed multipart upload key=H604SA6XTFLY upload=VW09YSIS52Q7 tag=QKBJ5I8XS775 type=write size=2427153 2024-09-12T00:24:25.932 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.931+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~LHQC2G1IZG1Q.0 size=1048576 2024-09-12T00:24:25.935 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.935+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~LHQC2G1IZG1Q.1 size=71930 2024-09-12T00:24:25.935 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.935+0000 7f0d199128c0 1 > prepared multipart upload key=OVLAP0OS78QG upload=LHQC2G1IZG1Q tag=IFKPE99L4W1A type=write size=2169082 2024-09-12T00:24:25.941 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.939+0000 7f0d199128c0 1 < completed delete operation key=37WTPAJGOX5L tag=UTAFUE8I0YYH type=del 2024-09-12T00:24:25.944 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.943+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~15K83AUYXA3F.0 size=533595 2024-09-12T00:24:25.944 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.943+0000 7f0d199128c0 1 > prepared multipart upload key=JA6CSJF78VE2 upload=15K83AUYXA3F tag=89GXMDDJFK4S type=write size=1582171 2024-09-12T00:24:25.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.947+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~9V4MOEG5GFSP.0 size=1048576 2024-09-12T00:24:25.951 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.951+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~9V4MOEG5GFSP.1 size=130866 2024-09-12T00:24:25.957 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.955+0000 7f0d199128c0 1 < completed multipart upload key=0ZT4NZYZKI5Z upload=9V4MOEG5GFSP tag=PG1IB74L4I7E type=write size=2228018 2024-09-12T00:24:25.963 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.963+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~Q93CXA6JETZS.0 size=1048576 2024-09-12T00:24:25.966 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.967+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~Q93CXA6JETZS.1 size=584042 2024-09-12T00:24:25.966 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.967+0000 7f0d199128c0 1 > prepared multipart upload key=57W1IO3KSWBR upload=Q93CXA6JETZS tag=Z4Z138IA6QHJ type=write size=2681194 2024-09-12T00:24:25.969 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.971+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~X74DWSK1WMOZ.0 size=207594 2024-09-12T00:24:25.975 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.975+0000 7f0d199128c0 1 < completed multipart upload key=FJ8YV026H0ZU upload=X74DWSK1WMOZ tag=2IW40OWZCVJ2 type=write size=1256170 2024-09-12T00:24:25.978 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.979+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=FQMUE0CBLY53 type=write size=53386 2024-09-12T00:24:25.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.983+0000 7f0d199128c0 1 < completed write operation key=RX3RVT06SGJ4 tag=HPLIFSCEGXGR type=write size=155570 2024-09-12T00:24:25.985 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.987+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=G9HVEE9PG9WI type=del size=3050132 2024-09-12T00:24:25.989 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.987+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~O3Z6FF1XGEH0.0 size=1048576 2024-09-12T00:24:25.992 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.991+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~O3Z6FF1XGEH0.1 size=813128 2024-09-12T00:24:25.998 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:25.999+0000 7f0d199128c0 1 < completed multipart upload key=B58RWC9W8THG upload=O3Z6FF1XGEH0 tag=YMQQZ7125GG2 type=write size=2910280 2024-09-12T00:24:26.006 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.007+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~XZ3IMVWAJYCG.0 size=514954 2024-09-12T00:24:26.006 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.007+0000 7f0d199128c0 1 > prepared multipart upload key=OVLAP0OS78QG upload=XZ3IMVWAJYCG tag=8GLDR4FL6829 type=write size=1563530 2024-09-12T00:24:26.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.011+0000 7f0d199128c0 1 < completed delete operation key=SITJU2EUVSR8 tag=XF9O1QTIQMZV type=del 2024-09-12T00:24:26.013 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.015+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=NVX95E7950ES type=write size=352387 2024-09-12T00:24:26.020 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.019+0000 7f0d199128c0 1 < suggested remove operation key=T6GOR4SBYU2Y tag=GM14DAM1GSRH type=del 2024-09-12T00:24:26.027 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.027+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~EQRS5S7Z0PVD.0 size=1048576 2024-09-12T00:24:26.030 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.031+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~EQRS5S7Z0PVD.1 size=896027 2024-09-12T00:24:26.030 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.031+0000 7f0d199128c0 1 > prepared multipart upload key=0ZT4NZYZKI5Z upload=EQRS5S7Z0PVD tag=LWS43L7O1KYV type=write size=2993179 2024-09-12T00:24:26.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.035+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~T0GQIN58Q71A.0 size=1048576 2024-09-12T00:24:26.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.035+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~T0GQIN58Q71A.1 size=1000964 2024-09-12T00:24:26.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.043+0000 7f0d199128c0 1 < completed multipart upload key=H604SA6XTFLY upload=T0GQIN58Q71A tag=SNJ308SJME1W type=write size=3098116 2024-09-12T00:24:26.050 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.051+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=ZFESZKM5LU2Y type=write size=389184 2024-09-12T00:24:26.054 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.055+0000 7f0d199128c0 1 < completed write operation key=RX3RVT06SGJ4 tag=PUIEAIQVEZDS type=write size=606527 2024-09-12T00:24:26.061 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.059+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~EFT3GMN82FX4.0 size=1048576 2024-09-12T00:24:26.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.063+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~EFT3GMN82FX4.1 size=558226 2024-09-12T00:24:26.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.063+0000 7f0d199128c0 1 > prepared multipart upload key=57W1IO3KSWBR upload=EFT3GMN82FX4 tag=B08JEAC99W8E type=write size=2655378 2024-09-12T00:24:26.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.067+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~0YJAUAJEMTWI.0 size=1048576 2024-09-12T00:24:26.070 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.071+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~0YJAUAJEMTWI.1 size=1048576 2024-09-12T00:24:26.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.071+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~0YJAUAJEMTWI.2 size=168363 2024-09-12T00:24:26.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.079+0000 7f0d199128c0 1 < completed multipart upload key=WPZOKZDFXK4S upload=0YJAUAJEMTWI tag=N3D6HTGHWXQQ type=write size=3314091 2024-09-12T00:24:26.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.083+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~RK9YB500LBM4.0 size=1048576 2024-09-12T00:24:26.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.087+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~RK9YB500LBM4.1 size=582889 2024-09-12T00:24:26.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.087+0000 7f0d199128c0 1 > prepared multipart upload key=GH0FNY2AI00G upload=RK9YB500LBM4 tag=UQ1CAQH2JHE3 type=write size=2680041 2024-09-12T00:24:26.096 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.095+0000 7f0d199128c0 1 < suggested remove operation key=V6H6S9X0U2A0 tag=D8FH036VYQH6 type=del 2024-09-12T00:24:26.099 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.099+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=8PPU4UGTJQV1 type=del size=1397890 2024-09-12T00:24:26.103 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.103+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~2HRDSEJL5FRY.0 size=1048576 2024-09-12T00:24:26.105 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.107+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~2HRDSEJL5FRY.1 size=320325 2024-09-12T00:24:26.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.111+0000 7f0d199128c0 1 < completed multipart upload key=37WTPAJGOX5L upload=2HRDSEJL5FRY tag=0RDC67EDSJNG type=write size=2417477 2024-09-12T00:24:26.118 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.119+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~PZGQQSDKI88S.0 size=254984 2024-09-12T00:24:26.118 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.119+0000 7f0d199128c0 1 > prepared multipart upload key=YTXW98O07966 upload=PZGQQSDKI88S tag=3M5CLGSBW0VK type=write size=1303560 2024-09-12T00:24:26.124 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.123+0000 7f0d199128c0 1 < suggested remove operation key=0ZT4NZYZKI5Z tag=QYJUEXE3ZTAD type=del 2024-09-12T00:24:26.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.127+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=5BQLQMDOUFMD type=del size=1172515 2024-09-12T00:24:26.135 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.135+0000 7f0d199128c0 1 < suggested remove operation key=J75P0821XGRO tag=XJOBMVARA4PB type=del 2024-09-12T00:24:26.144 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.143+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~UNU31DO9UZA3.0 size=1048576 2024-09-12T00:24:26.145 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.143+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~UNU31DO9UZA3.1 size=1048576 2024-09-12T00:24:26.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.147+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~UNU31DO9UZA3.2 size=245134 2024-09-12T00:24:26.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.147+0000 7f0d199128c0 1 > prepared multipart upload key=4K654PSDLDVI upload=UNU31DO9UZA3 tag=5Z94M8SO2QM5 type=write size=3390862 2024-09-12T00:24:26.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.151+0000 7f0d199128c0 1 < completed delete operation key=VXZI0ZTMQSV0 tag=Y05HXF7IAA87 type=del 2024-09-12T00:24:26.153 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.151+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=XVEYR8LLOY7D type=del size=1860576 2024-09-12T00:24:26.156 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.155+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~LHQC2G1IZG1Q.0 size=1048576 2024-09-12T00:24:26.159 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.159+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~LHQC2G1IZG1Q.1 size=71930 2024-09-12T00:24:26.164 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.163+0000 7f0d199128c0 1 < completed multipart upload key=OVLAP0OS78QG upload=LHQC2G1IZG1Q tag=IFKPE99L4W1A type=write size=2169082 2024-09-12T00:24:26.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.171+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~UVKA18U3MQ20.0 size=1048576 2024-09-12T00:24:26.173 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.171+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~UVKA18U3MQ20.1 size=1048576 2024-09-12T00:24:26.175 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.175+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~UVKA18U3MQ20.2 size=214218 2024-09-12T00:24:26.175 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.175+0000 7f0d199128c0 1 > prepared multipart upload key=1Y6B1MJP5G4L upload=UVKA18U3MQ20 tag=JO0E3L0CMKYL type=write size=3359946 2024-09-12T00:24:26.179 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.179+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~15K83AUYXA3F.0 size=533595 2024-09-12T00:24:26.184 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.183+0000 7f0d199128c0 1 < completed multipart upload key=JA6CSJF78VE2 upload=15K83AUYXA3F tag=89GXMDDJFK4S type=write size=1582171 2024-09-12T00:24:26.187 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.187+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=ZJ341EL54R1I type=del size=3808461 2024-09-12T00:24:26.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.187+0000 7f0d199128c0 1 < canceled part key=_multipart_57W1IO3KSWBR.2~Q93CXA6JETZS.0 size=1048576 2024-09-12T00:24:26.191 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.191+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~Q93CXA6JETZS.1 size=584042 2024-09-12T00:24:26.197 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.195+0000 7f0d199128c0 1 < canceled multipart upload key=57W1IO3KSWBR upload=Q93CXA6JETZS tag=Z4Z138IA6QHJ type=write size=2681194 2024-09-12T00:24:26.203 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.203+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~R4H8ACQNFFQ7.0 size=1048576 2024-09-12T00:24:26.206 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.207+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~R4H8ACQNFFQ7.1 size=1048576 2024-09-12T00:24:26.209 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.207+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~R4H8ACQNFFQ7.2 size=39364 2024-09-12T00:24:26.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.207+0000 7f0d199128c0 1 > prepared multipart upload key=J75P0821XGRO upload=R4H8ACQNFFQ7 tag=QRF4JN676AR3 type=write size=3185092 2024-09-12T00:24:26.213 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.215+0000 7f0d199128c0 1 < canceled operation key=4K654PSDLDVI tag=FQMUE0CBLY53 type=write size=53386 2024-09-12T00:24:26.217 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.215+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=0WG0LL4PFAG2 type=del size=3631677 2024-09-12T00:24:26.220 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.219+0000 7f0d199128c0 1 < canceled operation key=OVLAP0OS78QG tag=G9HVEE9PG9WI type=del size=3050132 2024-09-12T00:24:26.224 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.223+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=XSDLZVXH180H type=del size=3172511 2024-09-12T00:24:26.227 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.227+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~XZ3IMVWAJYCG.0 size=514954 2024-09-12T00:24:26.235 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.235+0000 7f0d199128c0 1 < completed multipart upload key=OVLAP0OS78QG upload=XZ3IMVWAJYCG tag=8GLDR4FL6829 type=write size=1563530 2024-09-12T00:24:26.242 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.243+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~GAO3T0J19PJT.0 size=477975 2024-09-12T00:24:26.242 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.243+0000 7f0d199128c0 1 > prepared multipart upload key=IPJEXRBN96NB upload=GAO3T0J19PJT tag=V15OBL80EXIV type=write size=1526551 2024-09-12T00:24:26.245 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.247+0000 7f0d199128c0 1 < canceled operation key=ZWGD87Z1MMNK tag=NVX95E7950ES type=write size=352387 2024-09-12T00:24:26.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.251+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~UXD1RO27TXT3.0 size=1048576 2024-09-12T00:24:26.255 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.255+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~UXD1RO27TXT3.1 size=1048576 2024-09-12T00:24:26.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.259+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~UXD1RO27TXT3.2 size=269813 2024-09-12T00:24:26.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.259+0000 7f0d199128c0 1 > prepared multipart upload key=GH0FNY2AI00G upload=UXD1RO27TXT3 tag=1CG9BX2QXNQK type=write size=3415541 2024-09-12T00:24:26.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.263+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~EQRS5S7Z0PVD.0 size=1048576 2024-09-12T00:24:26.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.263+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~EQRS5S7Z0PVD.1 size=896027 2024-09-12T00:24:26.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.271+0000 7f0d199128c0 1 < completed multipart upload key=0ZT4NZYZKI5Z upload=EQRS5S7Z0PVD tag=LWS43L7O1KYV type=write size=2993179 2024-09-12T00:24:26.275 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.275+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=EXOXUIY3YECA type=del size=3726446 2024-09-12T00:24:26.280 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.279+0000 7f0d199128c0 1 < canceled operation key=OVLAP0OS78QG tag=ZFESZKM5LU2Y type=write size=389184 2024-09-12T00:24:26.286 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.287+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~1TL8VTG0Q19L.0 size=1048576 2024-09-12T00:24:26.290 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.291+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~1TL8VTG0Q19L.1 size=1048576 2024-09-12T00:24:26.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.291+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~1TL8VTG0Q19L.2 size=332342 2024-09-12T00:24:26.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.291+0000 7f0d199128c0 1 > prepared multipart upload key=1Y6B1MJP5G4L upload=1TL8VTG0Q19L tag=EMIY5K9KOM7K type=write size=3478070 2024-09-12T00:24:26.297 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.295+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~EFT3GMN82FX4.0 size=1048576 2024-09-12T00:24:26.300 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.299+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~EFT3GMN82FX4.1 size=558226 2024-09-12T00:24:26.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.307+0000 7f0d199128c0 1 < completed multipart upload key=57W1IO3KSWBR upload=EFT3GMN82FX4 tag=B08JEAC99W8E type=write size=2655378 2024-09-12T00:24:26.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.311+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=3WOSZ22249MW type=del size=2167888 2024-09-12T00:24:26.314 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.315+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~RK9YB500LBM4.0 size=1048576 2024-09-12T00:24:26.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.315+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~RK9YB500LBM4.1 size=582889 2024-09-12T00:24:26.323 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.323+0000 7f0d199128c0 1 < completed multipart upload key=GH0FNY2AI00G upload=RK9YB500LBM4 tag=UQ1CAQH2JHE3 type=write size=2680041 2024-09-12T00:24:26.328 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.327+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~7FI4FSS8FMU9.0 size=1048576 2024-09-12T00:24:26.331 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.331+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~7FI4FSS8FMU9.1 size=247444 2024-09-12T00:24:26.331 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.331+0000 7f0d199128c0 1 > prepared multipart upload key=RX3RVT06SGJ4 upload=7FI4FSS8FMU9 tag=UQDUINPJGD0S type=write size=2344596 2024-09-12T00:24:26.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.335+0000 7f0d199128c0 1 < completed delete operation key=HXNC728XIWC1 tag=8PPU4UGTJQV1 type=del 2024-09-12T00:24:26.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.339+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~ATH0NM5XE0T9.0 size=314425 2024-09-12T00:24:26.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.339+0000 7f0d199128c0 1 > prepared multipart upload key=10YEWZDTTEV0 upload=ATH0NM5XE0T9 tag=AAEFZBQ2UYH9 type=write size=1363001 2024-09-12T00:24:26.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.339+0000 7f0d199128c0 1 < canceled part key=_multipart_YTXW98O07966.2~PZGQQSDKI88S.0 size=254984 2024-09-12T00:24:26.349 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.347+0000 7f0d199128c0 1 < canceled multipart upload key=YTXW98O07966 upload=PZGQQSDKI88S tag=3M5CLGSBW0VK type=write size=1303560 2024-09-12T00:24:26.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.351+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~44QBBRR1P7C9.0 size=1048576 2024-09-12T00:24:26.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.355+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~44QBBRR1P7C9.1 size=164260 2024-09-12T00:24:26.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.355+0000 7f0d199128c0 1 > prepared multipart upload key=10YEWZDTTEV0 upload=44QBBRR1P7C9 tag=6MZFUAO2VWUH type=write size=2261412 2024-09-12T00:24:26.358 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.359+0000 7f0d199128c0 1 < canceled operation key=JA6CSJF78VE2 tag=5BQLQMDOUFMD type=del size=1172515 2024-09-12T00:24:26.362 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.363+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=IIX2U6OA2VP9 type=del size=2404207 2024-09-12T00:24:26.362 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.363+0000 7f0d199128c0 1 < canceled part key=_multipart_4K654PSDLDVI.2~UNU31DO9UZA3.0 size=1048576 2024-09-12T00:24:26.365 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.363+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~UNU31DO9UZA3.1 size=1048576 2024-09-12T00:24:26.368 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.367+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~UNU31DO9UZA3.2 size=245134 2024-09-12T00:24:26.379 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.379+0000 7f0d199128c0 1 < canceled multipart upload key=4K654PSDLDVI upload=UNU31DO9UZA3 tag=5Z94M8SO2QM5 type=write size=3390862 2024-09-12T00:24:26.382 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.383+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=H9W1TOWIZNZU type=write size=773891 2024-09-12T00:24:26.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.387+0000 7f0d199128c0 1 < completed delete operation key=FJ8YV026H0ZU tag=XVEYR8LLOY7D type=del 2024-09-12T00:24:26.393 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.391+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~ETJTZN7QEOSN.0 size=1048576 2024-09-12T00:24:26.395 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.395+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~ETJTZN7QEOSN.1 size=1048576 2024-09-12T00:24:26.398 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.399+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~ETJTZN7QEOSN.2 size=3920 2024-09-12T00:24:26.398 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.399+0000 7f0d199128c0 1 > prepared multipart upload key=ZWGD87Z1MMNK upload=ETJTZN7QEOSN tag=ISBH0HAZUMQR type=write size=3149648 2024-09-12T00:24:26.402 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.403+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~UVKA18U3MQ20.0 size=1048576 2024-09-12T00:24:26.402 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.403+0000 7f0d199128c0 1 < canceled part key=_multipart_1Y6B1MJP5G4L.2~UVKA18U3MQ20.1 size=1048576 2024-09-12T00:24:26.405 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.403+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~UVKA18U3MQ20.2 size=214218 2024-09-12T00:24:26.411 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.411+0000 7f0d199128c0 1 < canceled multipart upload key=1Y6B1MJP5G4L upload=UVKA18U3MQ20 tag=JO0E3L0CMKYL type=write size=3359946 2024-09-12T00:24:26.414 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.415+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=KOPGOH8E7XRE type=del size=3989051 2024-09-12T00:24:26.418 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.419+0000 7f0d199128c0 1 < completed delete operation key=IPJEXRBN96NB tag=ZJ341EL54R1I type=del 2024-09-12T00:24:26.422 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.423+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=SUCZ60LPI3SL type=del size=2544453 2024-09-12T00:24:26.425 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.423+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~R4H8ACQNFFQ7.0 size=1048576 2024-09-12T00:24:26.428 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.427+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~R4H8ACQNFFQ7.1 size=1048576 2024-09-12T00:24:26.431 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.431+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~R4H8ACQNFFQ7.2 size=39364 2024-09-12T00:24:26.437 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.439+0000 7f0d199128c0 1 < completed multipart upload key=J75P0821XGRO upload=R4H8ACQNFFQ7 tag=QRF4JN676AR3 type=write size=3185092 2024-09-12T00:24:26.443 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.443+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~KTXFJAUY7JER.0 size=1048576 2024-09-12T00:24:26.446 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.447+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~KTXFJAUY7JER.1 size=748921 2024-09-12T00:24:26.446 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.447+0000 7f0d199128c0 1 > prepared multipart upload key=0EBWUENN0881 upload=KTXFJAUY7JER tag=D1MROALGVATP type=write size=2846073 2024-09-12T00:24:26.452 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.451+0000 7f0d199128c0 1 < suggested remove operation key=YTXW98O07966 tag=0WG0LL4PFAG2 type=del 2024-09-12T00:24:26.455 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.455+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=OD5CBSX15DCB type=del size=2271747 2024-09-12T00:24:26.458 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.459+0000 7f0d199128c0 1 < completed delete operation key=IPJEXRBN96NB tag=XSDLZVXH180H type=del 2024-09-12T00:24:26.461 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.463+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=JPDC9Z0KCNOD type=del size=3489527 2024-09-12T00:24:26.465 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.463+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~GAO3T0J19PJT.0 size=477975 2024-09-12T00:24:26.470 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.471+0000 7f0d199128c0 1 < completed multipart upload key=IPJEXRBN96NB upload=GAO3T0J19PJT tag=V15OBL80EXIV type=write size=1526551 2024-09-12T00:24:26.473 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.475+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=CAIZ506GTMMJ type=del size=1843084 2024-09-12T00:24:26.477 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.475+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~UXD1RO27TXT3.0 size=1048576 2024-09-12T00:24:26.477 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.475+0000 7f0d199128c0 1 < canceled part key=_multipart_GH0FNY2AI00G.2~UXD1RO27TXT3.1 size=1048576 2024-09-12T00:24:26.477 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.475+0000 7f0d199128c0 1 < canceled part key=_multipart_GH0FNY2AI00G.2~UXD1RO27TXT3.2 size=269813 2024-09-12T00:24:26.483 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.483+0000 7f0d199128c0 1 < canceled multipart upload key=GH0FNY2AI00G upload=UXD1RO27TXT3 tag=1CG9BX2QXNQK type=write size=3415541 2024-09-12T00:24:26.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.487+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~J4UFP3H3WX2D.0 size=1048576 2024-09-12T00:24:26.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.491+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~J4UFP3H3WX2D.1 size=831746 2024-09-12T00:24:26.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.491+0000 7f0d199128c0 1 > prepared multipart upload key=37WTPAJGOX5L upload=J4UFP3H3WX2D tag=A1BG5O4M3XU2 type=write size=2928898 2024-09-12T00:24:26.496 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.495+0000 7f0d199128c0 1 < completed delete operation key=1Y6B1MJP5G4L tag=EXOXUIY3YECA type=del 2024-09-12T00:24:26.500 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.499+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=1CC2GEQHP97I type=write size=608235 2024-09-12T00:24:26.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.503+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~1TL8VTG0Q19L.0 size=1048576 2024-09-12T00:24:26.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.507+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~1TL8VTG0Q19L.1 size=1048576 2024-09-12T00:24:26.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.507+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~1TL8VTG0Q19L.2 size=332342 2024-09-12T00:24:26.515 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.515+0000 7f0d199128c0 1 < completed multipart upload key=1Y6B1MJP5G4L upload=1TL8VTG0Q19L tag=EMIY5K9KOM7K type=write size=3478070 2024-09-12T00:24:26.519 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.519+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=0L7Q0QM5MQQ5 type=del size=1078910 2024-09-12T00:24:26.522 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.523+0000 7f0d199128c0 1 < completed delete operation key=A529WOKFD1NI tag=3WOSZ22249MW type=del 2024-09-12T00:24:26.527 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.527+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~NWX287VIKB7D.0 size=1048576 2024-09-12T00:24:26.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.531+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~NWX287VIKB7D.1 size=1048576 2024-09-12T00:24:26.532 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.531+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~NWX287VIKB7D.2 size=858733 2024-09-12T00:24:26.532 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.531+0000 7f0d199128c0 1 > prepared multipart upload key=YTXW98O07966 upload=NWX287VIKB7D tag=KJ71D5CB4WD8 type=write size=4004461 2024-09-12T00:24:26.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.535+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~7FI4FSS8FMU9.0 size=1048576 2024-09-12T00:24:26.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.539+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~7FI4FSS8FMU9.1 size=247444 2024-09-12T00:24:26.543 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.543+0000 7f0d199128c0 1 < completed multipart upload key=RX3RVT06SGJ4 upload=7FI4FSS8FMU9 tag=UQDUINPJGD0S type=write size=2344596 2024-09-12T00:24:26.546 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.547+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=BGM3ZU2SF1K2 type=del size=3539353 2024-09-12T00:24:26.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.551+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~ATH0NM5XE0T9.0 size=314425 2024-09-12T00:24:26.555 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.555+0000 7f0d199128c0 1 < completed multipart upload key=10YEWZDTTEV0 upload=ATH0NM5XE0T9 tag=AAEFZBQ2UYH9 type=write size=1363001 2024-09-12T00:24:26.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.559+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=WY1S51DAMQWB type=del size=3530235 2024-09-12T00:24:26.561 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.563+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~44QBBRR1P7C9.0 size=1048576 2024-09-12T00:24:26.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.563+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~44QBBRR1P7C9.1 size=164260 2024-09-12T00:24:26.569 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.567+0000 7f0d199128c0 1 < completed multipart upload key=10YEWZDTTEV0 upload=44QBBRR1P7C9 tag=6MZFUAO2VWUH type=write size=2261412 2024-09-12T00:24:26.573 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.571+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=IVOPURY9LF0A type=del size=2524491 2024-09-12T00:24:26.579 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.579+0000 7f0d199128c0 1 < suggested update operation key=GH0FNY2AI00G tag=IIX2U6OA2VP9 type=del size=2404207 2024-09-12T00:24:26.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.583+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=MFTVEEZPWR9K type=del size=348616 2024-09-12T00:24:26.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.587+0000 7f0d199128c0 1 < suggested remove operation key=1Y6B1MJP5G4L tag=H9W1TOWIZNZU type=write 2024-09-12T00:24:26.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.591+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=RA8OGEIJW39P type=del size=592184 2024-09-12T00:24:26.594 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.595+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~ETJTZN7QEOSN.0 size=1048576 2024-09-12T00:24:26.597 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.595+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~ETJTZN7QEOSN.1 size=1048576 2024-09-12T00:24:26.599 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.599+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~ETJTZN7QEOSN.2 size=3920 2024-09-12T00:24:26.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.603+0000 7f0d199128c0 1 < completed multipart upload key=ZWGD87Z1MMNK upload=ETJTZN7QEOSN tag=ISBH0HAZUMQR type=write size=3149648 2024-09-12T00:24:26.611 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.611+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~9H9MP6YOSL8Z.0 size=1048576 2024-09-12T00:24:26.613 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.611+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~9H9MP6YOSL8Z.1 size=1048576 2024-09-12T00:24:26.615 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.615+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~9H9MP6YOSL8Z.2 size=74417 2024-09-12T00:24:26.615 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.615+0000 7f0d199128c0 1 > prepared multipart upload key=ZWGD87Z1MMNK upload=9H9MP6YOSL8Z tag=QW9EX3PEKSHJ type=write size=3220145 2024-09-12T00:24:26.622 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.623+0000 7f0d199128c0 1 < suggested remove operation key=ZWGD87Z1MMNK tag=KOPGOH8E7XRE type=del 2024-09-12T00:24:26.625 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.623+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=J8J49STMJDXL type=del size=1096894 2024-09-12T00:24:26.628 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.627+0000 7f0d199128c0 1 < completed delete operation key=RX3RVT06SGJ4 tag=SUCZ60LPI3SL type=del 2024-09-12T00:24:26.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.635+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~H5Z0LE4VSXJJ.0 size=980286 2024-09-12T00:24:26.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.635+0000 7f0d199128c0 1 > prepared multipart upload key=0ZT4NZYZKI5Z upload=H5Z0LE4VSXJJ tag=OVFEMT5FIA71 type=write size=2028862 2024-09-12T00:24:26.637 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.639+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~KTXFJAUY7JER.0 size=1048576 2024-09-12T00:24:26.640 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.639+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~KTXFJAUY7JER.1 size=748921 2024-09-12T00:24:26.646 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.647+0000 7f0d199128c0 1 < completed multipart upload key=0EBWUENN0881 upload=KTXFJAUY7JER tag=D1MROALGVATP type=write size=2846073 2024-09-12T00:24:26.650 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.651+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=5H57SSF0D5YD type=del size=2257204 2024-09-12T00:24:26.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.655+0000 7f0d199128c0 1 < suggested update operation key=J75P0821XGRO tag=OD5CBSX15DCB type=del size=2271747 2024-09-12T00:24:26.659 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.659+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=DSLWNIEQGCRM type=del size=3087850 2024-09-12T00:24:26.665 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.663+0000 7f0d199128c0 1 < suggested update operation key=RX3RVT06SGJ4 tag=JPDC9Z0KCNOD type=del size=3489527 2024-09-12T00:24:26.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.667+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=EU168QN55LH2 type=del size=707003 2024-09-12T00:24:26.671 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.671+0000 7f0d199128c0 -1 < failed to complete operation key=RX3RVT06SGJ4 tag=CAIZ506GTMMJ type=del size=1843084: (22) Invalid argument 2024-09-12T00:24:26.677 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.679+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~J00OYDPT4H69.0 size=1048576 2024-09-12T00:24:26.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.683+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~J00OYDPT4H69.1 size=246956 2024-09-12T00:24:26.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.683+0000 7f0d199128c0 1 > prepared multipart upload key=ZWGD87Z1MMNK upload=J00OYDPT4H69 tag=WHZNGRQLYNJK type=write size=2344108 2024-09-12T00:24:26.687 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.687+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~J4UFP3H3WX2D.0 size=1048576 2024-09-12T00:24:26.689 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.691+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~J4UFP3H3WX2D.1 size=831746 2024-09-12T00:24:26.696 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.695+0000 7f0d199128c0 1 < completed multipart upload key=37WTPAJGOX5L upload=J4UFP3H3WX2D tag=A1BG5O4M3XU2 type=write size=2928898 2024-09-12T00:24:26.699 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.699+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=3BVB4BS4TRSR type=write size=403244 2024-09-12T00:24:26.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.703+0000 7f0d199128c0 1 < completed write operation key=PK2CA62QBZXS tag=1CC2GEQHP97I type=write size=608235 2024-09-12T00:24:26.709 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.711+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~6K51JAYS2O2B.0 size=1048576 2024-09-12T00:24:26.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.711+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~6K51JAYS2O2B.1 size=1048576 2024-09-12T00:24:26.715 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.715+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~6K51JAYS2O2B.2 size=209462 2024-09-12T00:24:26.715 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.715+0000 7f0d199128c0 1 > prepared multipart upload key=37WTPAJGOX5L upload=6K51JAYS2O2B tag=PCEICRV8CTG3 type=write size=3355190 2024-09-12T00:24:26.718 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.719+0000 7f0d199128c0 1 < completed delete operation key=9I6MZAEUS4I0 tag=0L7Q0QM5MQQ5 type=del 2024-09-12T00:24:26.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.723+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~CMH0ZHH00CD6.0 size=851538 2024-09-12T00:24:26.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.723+0000 7f0d199128c0 1 > prepared multipart upload key=HXNC728XIWC1 upload=CMH0ZHH00CD6 tag=ME11JBR260LU type=write size=1900114 2024-09-12T00:24:26.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.723+0000 7f0d199128c0 1 < canceled part key=_multipart_YTXW98O07966.2~NWX287VIKB7D.0 size=1048576 2024-09-12T00:24:26.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.727+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~NWX287VIKB7D.1 size=1048576 2024-09-12T00:24:26.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.727+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~NWX287VIKB7D.2 size=858733 2024-09-12T00:24:26.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.735+0000 7f0d199128c0 1 < canceled multipart upload key=YTXW98O07966 upload=NWX287VIKB7D tag=KJ71D5CB4WD8 type=write size=4004461 2024-09-12T00:24:26.738 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.739+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=5L3MADE6P7NG type=del size=1814089 2024-09-12T00:24:26.740 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.739+0000 7f0d199128c0 1 < canceled operation key=RFCHRGVA9GOI tag=BGM3ZU2SF1K2 type=del size=3539353 2024-09-12T00:24:26.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.743+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=RCYSP1KVI6C2 type=del size=3053295 2024-09-12T00:24:26.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.747+0000 7f0d199128c0 1 < completed delete operation key=YTXW98O07966 tag=WY1S51DAMQWB type=del 2024-09-12T00:24:26.750 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.751+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=SDW3N3LKUIHJ type=del size=3750743 2024-09-12T00:24:26.756 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.755+0000 7f0d199128c0 1 < suggested remove operation key=GH0FNY2AI00G tag=IVOPURY9LF0A type=del 2024-09-12T00:24:26.760 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.759+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=CUESL6PCZLWP type=del size=2591034 2024-09-12T00:24:26.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.763+0000 7f0d199128c0 1 < suggested remove operation key=0EBWUENN0881 tag=MFTVEEZPWR9K type=del 2024-09-12T00:24:26.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.771+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~WPD4QQOUO58P.0 size=474219 2024-09-12T00:24:26.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.771+0000 7f0d199128c0 1 > prepared multipart upload key=JA6CSJF78VE2 upload=WPD4QQOUO58P tag=6U40EA0S3042 type=write size=1522795 2024-09-12T00:24:26.774 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.775+0000 7f0d199128c0 -1 < failed to complete operation key=J75P0821XGRO tag=RA8OGEIJW39P type=del size=592184: (22) Invalid argument 2024-09-12T00:24:26.780 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.779+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~KGZ932UQ7OIK.0 size=1048576 2024-09-12T00:24:26.783 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.783+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~KGZ932UQ7OIK.1 size=1048576 2024-09-12T00:24:26.785 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.787+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~KGZ932UQ7OIK.2 size=988785 2024-09-12T00:24:26.785 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.787+0000 7f0d199128c0 1 > prepared multipart upload key=PK2CA62QBZXS upload=KGZ932UQ7OIK tag=FJ24MCO88YVP type=write size=4134513 2024-09-12T00:24:26.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.787+0000 7f0d199128c0 1 < canceled part key=_multipart_ZWGD87Z1MMNK.2~9H9MP6YOSL8Z.0 size=1048576 2024-09-12T00:24:26.789 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.787+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~9H9MP6YOSL8Z.1 size=1048576 2024-09-12T00:24:26.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.791+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~9H9MP6YOSL8Z.2 size=74417 2024-09-12T00:24:26.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.795+0000 7f0d199128c0 1 < canceled multipart upload key=ZWGD87Z1MMNK upload=9H9MP6YOSL8Z tag=QW9EX3PEKSHJ type=write size=3220145 2024-09-12T00:24:26.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.799+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=6WX5435ZQGEI type=del size=11764 2024-09-12T00:24:26.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.803+0000 7f0d199128c0 1 < canceled operation key=10YEWZDTTEV0 tag=J8J49STMJDXL type=del size=1096894 2024-09-12T00:24:26.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.807+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=TOR64XK0A3ZL type=del size=4092710 2024-09-12T00:24:26.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.811+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~H5Z0LE4VSXJJ.0 size=980286 2024-09-12T00:24:26.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.815+0000 7f0d199128c0 1 < completed multipart upload key=0ZT4NZYZKI5Z upload=H5Z0LE4VSXJJ tag=OVFEMT5FIA71 type=write size=2028862 2024-09-12T00:24:26.819 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.819+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=SJY94BJ4A71D type=del size=1147772 2024-09-12T00:24:26.826 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.827+0000 7f0d199128c0 1 < suggested remove operation key=WBGXMJB7U422 tag=5H57SSF0D5YD type=del 2024-09-12T00:24:26.829 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.831+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=NJUZ2FHAGSGP type=del size=3189075 2024-09-12T00:24:26.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.831+0000 7f0d199128c0 -1 < failed to complete operation key=RX3RVT06SGJ4 tag=DSLWNIEQGCRM type=del size=3087850: (22) Invalid argument 2024-09-12T00:24:26.836 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.835+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=3J2OPGO7DGQS type=write size=687035 2024-09-12T00:24:26.839 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.839+0000 7f0d199128c0 1 < completed delete operation key=T6GOR4SBYU2Y tag=EU168QN55LH2 type=del 2024-09-12T00:24:26.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.843+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~8Q011GB85ZVY.0 size=1048576 2024-09-12T00:24:26.848 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.847+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~8Q011GB85ZVY.1 size=1048576 2024-09-12T00:24:26.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.851+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~8Q011GB85ZVY.2 size=1042481 2024-09-12T00:24:26.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.851+0000 7f0d199128c0 1 > prepared multipart upload key=FJ8YV026H0ZU upload=8Q011GB85ZVY tag=GSWXP51PSKDP type=write size=4188209 2024-09-12T00:24:26.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.855+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~J00OYDPT4H69.0 size=1048576 2024-09-12T00:24:26.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.855+0000 7f0d199128c0 1 < canceled part key=_multipart_ZWGD87Z1MMNK.2~J00OYDPT4H69.1 size=246956 2024-09-12T00:24:26.860 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.859+0000 7f0d199128c0 1 < canceled multipart upload key=ZWGD87Z1MMNK upload=J00OYDPT4H69 tag=WHZNGRQLYNJK type=write size=2344108 2024-09-12T00:24:26.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.863+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=4AFJF46HGUJB type=del size=3996862 2024-09-12T00:24:26.866 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.867+0000 7f0d199128c0 -1 < failed to complete operation key=WBGXMJB7U422 tag=3BVB4BS4TRSR type=write size=403244: (22) Invalid argument 2024-09-12T00:24:26.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.871+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=8RGTPQ8DWOY2 type=del size=1672113 2024-09-12T00:24:26.873 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.875+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~6K51JAYS2O2B.0 size=1048576 2024-09-12T00:24:26.876 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.875+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~6K51JAYS2O2B.1 size=1048576 2024-09-12T00:24:26.879 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.879+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~6K51JAYS2O2B.2 size=209462 2024-09-12T00:24:26.884 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.883+0000 7f0d199128c0 1 < completed multipart upload key=37WTPAJGOX5L upload=6K51JAYS2O2B tag=PCEICRV8CTG3 type=write size=3355190 2024-09-12T00:24:26.889 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.887+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~GUIQBI7Q1NX0.0 size=1048576 2024-09-12T00:24:26.891 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.891+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~GUIQBI7Q1NX0.1 size=1048576 2024-09-12T00:24:26.893 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.895+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~GUIQBI7Q1NX0.2 size=94385 2024-09-12T00:24:26.894 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.895+0000 7f0d199128c0 1 > prepared multipart upload key=OVLAP0OS78QG upload=GUIQBI7Q1NX0 tag=K3ZO9QKEL8BE type=write size=3240113 2024-09-12T00:24:26.894 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.895+0000 7f0d199128c0 1 < canceled part key=_multipart_HXNC728XIWC1.2~CMH0ZHH00CD6.0 size=851538 2024-09-12T00:24:26.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.899+0000 7f0d199128c0 1 < canceled multipart upload key=HXNC728XIWC1 upload=CMH0ZHH00CD6 tag=ME11JBR260LU type=write size=1900114 2024-09-12T00:24:26.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.903+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=6LON2PQMABIO type=del size=2824116 2024-09-12T00:24:26.905 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.903+0000 7f0d199128c0 1 < completed delete operation key=9I6MZAEUS4I0 tag=5L3MADE6P7NG type=del 2024-09-12T00:24:26.908 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.907+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=24Y6VMYJ1J0X type=del size=665232 2024-09-12T00:24:26.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.911+0000 7f0d199128c0 1 < completed delete operation key=RFCHRGVA9GOI tag=RCYSP1KVI6C2 type=del 2024-09-12T00:24:26.916 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.915+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~CDNZ89W38V3N.0 size=1048576 2024-09-12T00:24:26.918 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.919+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~CDNZ89W38V3N.1 size=1048576 2024-09-12T00:24:26.921 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.919+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~CDNZ89W38V3N.2 size=783022 2024-09-12T00:24:26.921 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.919+0000 7f0d199128c0 1 > prepared multipart upload key=RX3RVT06SGJ4 upload=CDNZ89W38V3N tag=HKGIXX37MQRE type=write size=3928750 2024-09-12T00:24:26.926 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.927+0000 7f0d199128c0 1 < suggested update operation key=SITJU2EUVSR8 tag=SDW3N3LKUIHJ type=del size=3750743 2024-09-12T00:24:26.929 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.927+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=UKTYSE0AH93X type=del size=2677496 2024-09-12T00:24:26.932 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.931+0000 7f0d199128c0 1 < canceled operation key=A529WOKFD1NI tag=CUESL6PCZLWP type=del size=2591034 2024-09-12T00:24:26.934 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.935+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=U6QDLXW5DGEK type=del size=261776 2024-09-12T00:24:26.937 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.939+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~WPD4QQOUO58P.0 size=474219 2024-09-12T00:24:26.942 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.943+0000 7f0d199128c0 1 < completed multipart upload key=JA6CSJF78VE2 upload=WPD4QQOUO58P tag=6U40EA0S3042 type=write size=1522795 2024-09-12T00:24:26.945 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.947+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=RDSMC29EPK6A type=del size=452343 2024-09-12T00:24:26.946 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.947+0000 7f0d199128c0 1 < canceled part key=_multipart_PK2CA62QBZXS.2~KGZ932UQ7OIK.0 size=1048576 2024-09-12T00:24:26.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.947+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~KGZ932UQ7OIK.1 size=1048576 2024-09-12T00:24:26.950 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.951+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~KGZ932UQ7OIK.2 size=988785 2024-09-12T00:24:26.955 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.955+0000 7f0d199128c0 1 < canceled multipart upload key=PK2CA62QBZXS upload=KGZ932UQ7OIK tag=FJ24MCO88YVP type=write size=4134513 2024-09-12T00:24:26.960 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.959+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~JV1J8K7XDTFH.0 size=1048576 2024-09-12T00:24:26.964 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.963+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~JV1J8K7XDTFH.1 size=745357 2024-09-12T00:24:26.964 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.963+0000 7f0d199128c0 1 > prepared multipart upload key=J75P0821XGRO upload=JV1J8K7XDTFH tag=H11F6GGSWQ3D type=write size=2842509 2024-09-12T00:24:26.965 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.967+0000 7f0d199128c0 1 < completed delete operation key=RFCHRGVA9GOI tag=6WX5435ZQGEI type=del 2024-09-12T00:24:26.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.971+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~FG5ANI5FMPVY.0 size=1048576 2024-09-12T00:24:26.975 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.975+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~FG5ANI5FMPVY.1 size=1048576 2024-09-12T00:24:26.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.979+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~FG5ANI5FMPVY.2 size=823637 2024-09-12T00:24:26.978 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.979+0000 7f0d199128c0 1 > prepared multipart upload key=SITJU2EUVSR8 upload=FG5ANI5FMPVY tag=5HXATIJL01ZU type=write size=3969365 2024-09-12T00:24:26.980 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.979+0000 7f0d199128c0 1 < completed delete operation key=4K654PSDLDVI tag=TOR64XK0A3ZL type=del 2024-09-12T00:24:26.983 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.983+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=93LP273NYX6I type=write size=644094 2024-09-12T00:24:26.986 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.987+0000 7f0d199128c0 1 < completed delete operation key=RFCHRGVA9GOI tag=SJY94BJ4A71D type=del 2024-09-12T00:24:26.991 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.991+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~XK0NZ7HHUQ3C.0 size=1048576 2024-09-12T00:24:26.993 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.991+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~XK0NZ7HHUQ3C.1 size=1048576 2024-09-12T00:24:26.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.995+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~XK0NZ7HHUQ3C.2 size=1001598 2024-09-12T00:24:26.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.995+0000 7f0d199128c0 1 > prepared multipart upload key=B58RWC9W8THG upload=XK0NZ7HHUQ3C tag=D0C82TUXDK4S type=write size=4147326 2024-09-12T00:24:27.001 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:26.999+0000 7f0d199128c0 1 < suggested remove operation key=OVLAP0OS78QG tag=NJUZ2FHAGSGP type=del 2024-09-12T00:24:27.003 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.003+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=M3S99QLZVCES type=del size=1521272 2024-09-12T00:24:27.006 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.007+0000 7f0d199128c0 1 < completed write operation key=37WTPAJGOX5L tag=3J2OPGO7DGQS type=write size=687035 2024-09-12T00:24:27.011 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.011+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~BKAKCMFQ2EZ2.0 size=370094 2024-09-12T00:24:27.011 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.011+0000 7f0d199128c0 1 > prepared multipart upload key=NXQYUQIR2APT upload=BKAKCMFQ2EZ2 tag=JEUKX73DANBP type=write size=1418670 2024-09-12T00:24:27.014 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.015+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~8Q011GB85ZVY.0 size=1048576 2024-09-12T00:24:27.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.015+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~8Q011GB85ZVY.1 size=1048576 2024-09-12T00:24:27.019 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.019+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~8Q011GB85ZVY.2 size=1042481 2024-09-12T00:24:27.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.023+0000 7f0d199128c0 1 < completed multipart upload key=FJ8YV026H0ZU upload=8Q011GB85ZVY tag=GSWXP51PSKDP type=write size=4188209 2024-09-12T00:24:27.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.027+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~0V9P6SA4NEHX.0 size=1048576 2024-09-12T00:24:27.031 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.031+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~0V9P6SA4NEHX.1 size=1048576 2024-09-12T00:24:27.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.031+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~0V9P6SA4NEHX.2 size=283063 2024-09-12T00:24:27.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.031+0000 7f0d199128c0 1 > prepared multipart upload key=YTXW98O07966 upload=0V9P6SA4NEHX tag=WSD5179826CQ type=write size=3428791 2024-09-12T00:24:27.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.035+0000 7f0d199128c0 1 < completed delete operation key=WPZOKZDFXK4S tag=4AFJF46HGUJB type=del 2024-09-12T00:24:27.038 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.039+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=3OGLVA3AMQE2 type=del size=460556 2024-09-12T00:24:27.041 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.043+0000 7f0d199128c0 1 < completed delete operation key=JA6CSJF78VE2 tag=8RGTPQ8DWOY2 type=del 2024-09-12T00:24:27.046 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.047+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~9G52TVQ49QSV.0 size=1048576 2024-09-12T00:24:27.048 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.047+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~9G52TVQ49QSV.1 size=1048576 2024-09-12T00:24:27.050 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.051+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~9G52TVQ49QSV.2 size=204170 2024-09-12T00:24:27.050 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.051+0000 7f0d199128c0 1 > prepared multipart upload key=B58RWC9W8THG upload=9G52TVQ49QSV tag=VODHKJ0C84OA type=write size=3349898 2024-09-12T00:24:27.053 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.051+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~GUIQBI7Q1NX0.0 size=1048576 2024-09-12T00:24:27.055 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.055+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~GUIQBI7Q1NX0.1 size=1048576 2024-09-12T00:24:27.057 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.059+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~GUIQBI7Q1NX0.2 size=94385 2024-09-12T00:24:27.062 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.063+0000 7f0d199128c0 1 < completed multipart upload key=OVLAP0OS78QG upload=GUIQBI7Q1NX0 tag=K3ZO9QKEL8BE type=write size=3240113 2024-09-12T00:24:27.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.063+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=HXQ3GJ87O0UY type=del size=4135745 2024-09-12T00:24:27.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.067+0000 7f0d199128c0 1 < completed delete operation key=IPJEXRBN96NB tag=6LON2PQMABIO type=del 2024-09-12T00:24:27.070 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.071+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=YNTP7ZJTPFTS type=del size=1614330 2024-09-12T00:24:27.076 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.075+0000 7f0d199128c0 1 < suggested update operation key=9I6MZAEUS4I0 tag=24Y6VMYJ1J0X type=del size=665232 2024-09-12T00:24:27.081 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.083+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~3Y71SBU8BO6G.0 size=1048576 2024-09-12T00:24:27.083 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.083+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~3Y71SBU8BO6G.1 size=52483 2024-09-12T00:24:27.084 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.083+0000 7f0d199128c0 1 > prepared multipart upload key=IPJEXRBN96NB upload=3Y71SBU8BO6G tag=NH17518QZI25 type=write size=2149635 2024-09-12T00:24:27.086 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.087+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~CDNZ89W38V3N.0 size=1048576 2024-09-12T00:24:27.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.087+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~CDNZ89W38V3N.1 size=1048576 2024-09-12T00:24:27.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.091+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~CDNZ89W38V3N.2 size=783022 2024-09-12T00:24:27.096 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.095+0000 7f0d199128c0 1 < completed multipart upload key=RX3RVT06SGJ4 upload=CDNZ89W38V3N tag=HKGIXX37MQRE type=write size=3928750 2024-09-12T00:24:27.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.099+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~RX8ZRV679SX4.0 size=146926 2024-09-12T00:24:27.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.099+0000 7f0d199128c0 1 > prepared multipart upload key=YTXW98O07966 upload=RX8ZRV679SX4 tag=XP527MSD2BWO type=write size=1195502 2024-09-12T00:24:27.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.107+0000 7f0d199128c0 1 < suggested update operation key=OVLAP0OS78QG tag=UKTYSE0AH93X type=del size=2677496 2024-09-12T00:24:27.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.111+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~IX021WS9B307.0 size=162814 2024-09-12T00:24:27.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.111+0000 7f0d199128c0 1 > prepared multipart upload key=4K654PSDLDVI upload=IX021WS9B307 tag=W7R709J7RWKY type=write size=1211390 2024-09-12T00:24:27.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.115+0000 7f0d199128c0 1 < completed delete operation key=SITJU2EUVSR8 tag=U6QDLXW5DGEK type=del 2024-09-12T00:24:27.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.123+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~12JVJKX7Y76D.0 size=821960 2024-09-12T00:24:27.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.123+0000 7f0d199128c0 1 > prepared multipart upload key=FJ8YV026H0ZU upload=12JVJKX7Y76D tag=LZX2MIXEAI0Q type=write size=1870536 2024-09-12T00:24:27.125 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.127+0000 7f0d199128c0 1 < completed delete operation key=NXQYUQIR2APT tag=RDSMC29EPK6A type=del 2024-09-12T00:24:27.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.127+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=D9794COVL1JL type=del size=4164776 2024-09-12T00:24:27.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.131+0000 7f0d199128c0 1 < canceled part key=_multipart_J75P0821XGRO.2~JV1J8K7XDTFH.0 size=1048576 2024-09-12T00:24:27.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.131+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~JV1J8K7XDTFH.1 size=745357 2024-09-12T00:24:27.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.135+0000 7f0d199128c0 1 < canceled multipart upload key=J75P0821XGRO upload=JV1J8K7XDTFH tag=H11F6GGSWQ3D type=write size=2842509 2024-09-12T00:24:27.139 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.139+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=9QNQP5ZGI76S type=del size=3322300 2024-09-12T00:24:27.142 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.143+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~FG5ANI5FMPVY.0 size=1048576 2024-09-12T00:24:27.144 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.143+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~FG5ANI5FMPVY.1 size=1048576 2024-09-12T00:24:27.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.147+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~FG5ANI5FMPVY.2 size=823637 2024-09-12T00:24:27.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.151+0000 7f0d199128c0 1 < completed multipart upload key=SITJU2EUVSR8 upload=FG5ANI5FMPVY tag=5HXATIJL01ZU type=write size=3969365 2024-09-12T00:24:27.155 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.155+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=4DV9VA1HA1PM type=del size=1027136 2024-09-12T00:24:27.157 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.155+0000 7f0d199128c0 1 < completed write operation key=JA6CSJF78VE2 tag=93LP273NYX6I type=write size=644094 2024-09-12T00:24:27.160 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.159+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=LXSXK62U9P3Y type=write size=852936 2024-09-12T00:24:27.163 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.163+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~XK0NZ7HHUQ3C.0 size=1048576 2024-09-12T00:24:27.165 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.163+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~XK0NZ7HHUQ3C.1 size=1048576 2024-09-12T00:24:27.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.167+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~XK0NZ7HHUQ3C.2 size=1001598 2024-09-12T00:24:27.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.171+0000 7f0d199128c0 1 < completed multipart upload key=B58RWC9W8THG upload=XK0NZ7HHUQ3C tag=D0C82TUXDK4S type=write size=4147326 2024-09-12T00:24:27.174 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.175+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=RGR7HTTH766A type=del size=4126508 2024-09-12T00:24:27.177 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.175+0000 7f0d199128c0 1 < canceled operation key=A529WOKFD1NI tag=M3S99QLZVCES type=del size=1521272 2024-09-12T00:24:27.180 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.179+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=H9835KD0PE48 type=del size=8203 2024-09-12T00:24:27.182 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.183+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~BKAKCMFQ2EZ2.0 size=370094 2024-09-12T00:24:27.187 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.187+0000 7f0d199128c0 1 < completed multipart upload key=NXQYUQIR2APT upload=BKAKCMFQ2EZ2 tag=JEUKX73DANBP type=write size=1418670 2024-09-12T00:24:27.192 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.191+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~LTWCJ8DHF1MB.0 size=1048576 2024-09-12T00:24:27.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.195+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~LTWCJ8DHF1MB.1 size=768759 2024-09-12T00:24:27.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.195+0000 7f0d199128c0 1 > prepared multipart upload key=NXQYUQIR2APT upload=LTWCJ8DHF1MB tag=6NGSET0I2ZYB type=write size=2865911 2024-09-12T00:24:27.198 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.199+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~0V9P6SA4NEHX.0 size=1048576 2024-09-12T00:24:27.200 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.199+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~0V9P6SA4NEHX.1 size=1048576 2024-09-12T00:24:27.202 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.203+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~0V9P6SA4NEHX.2 size=283063 2024-09-12T00:24:27.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.207+0000 7f0d199128c0 1 < completed multipart upload key=YTXW98O07966 upload=0V9P6SA4NEHX tag=WSD5179826CQ type=write size=3428791 2024-09-12T00:24:27.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.211+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=OPS6RWBB6CGV type=del size=3721830 2024-09-12T00:24:27.213 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.211+0000 7f0d199128c0 -1 < failed to complete operation key=OVLAP0OS78QG tag=3OGLVA3AMQE2 type=del size=460556: (22) Invalid argument 2024-09-12T00:24:27.219 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.219+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~AH2P9DC0064D.0 size=1048576 2024-09-12T00:24:27.222 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.223+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~AH2P9DC0064D.1 size=501646 2024-09-12T00:24:27.222 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.223+0000 7f0d199128c0 1 > prepared multipart upload key=PK2CA62QBZXS upload=AH2P9DC0064D tag=H2RH1UUXSJNF type=write size=2598798 2024-09-12T00:24:27.225 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.223+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~9G52TVQ49QSV.0 size=1048576 2024-09-12T00:24:27.228 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.227+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~9G52TVQ49QSV.1 size=1048576 2024-09-12T00:24:27.231 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.231+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~9G52TVQ49QSV.2 size=204170 2024-09-12T00:24:27.241 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.239+0000 7f0d199128c0 1 < completed multipart upload key=B58RWC9W8THG upload=9G52TVQ49QSV tag=VODHKJ0C84OA type=write size=3349898 2024-09-12T00:24:27.247 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.247+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~K2YV38MUMXO5.0 size=1048576 2024-09-12T00:24:27.250 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.251+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~K2YV38MUMXO5.1 size=276720 2024-09-12T00:24:27.250 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.251+0000 7f0d199128c0 1 > prepared multipart upload key=1Y6B1MJP5G4L upload=K2YV38MUMXO5 tag=6MVG9KPNEAI2 type=write size=2373872 2024-09-12T00:24:27.253 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.251+0000 7f0d199128c0 -1 < failed to complete operation key=9I6MZAEUS4I0 tag=HXQ3GJ87O0UY type=del size=4135745: (22) Invalid argument 2024-09-12T00:24:27.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.259+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~Q4V7GS5MJXYM.0 size=423110 2024-09-12T00:24:27.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.259+0000 7f0d199128c0 1 > prepared multipart upload key=RX3RVT06SGJ4 upload=Q4V7GS5MJXYM tag=8767WL1QIDZ8 type=write size=1471686 2024-09-12T00:24:27.263 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.263+0000 7f0d199128c0 1 < completed delete operation key=SITJU2EUVSR8 tag=YNTP7ZJTPFTS type=del 2024-09-12T00:24:27.266 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.267+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=PJEJRDFS92N3 type=write size=730049 2024-09-12T00:24:27.270 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.271+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~3Y71SBU8BO6G.0 size=1048576 2024-09-12T00:24:27.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.271+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~3Y71SBU8BO6G.1 size=52483 2024-09-12T00:24:27.278 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.279+0000 7f0d199128c0 1 < completed multipart upload key=IPJEXRBN96NB upload=3Y71SBU8BO6G tag=NH17518QZI25 type=write size=2149635 2024-09-12T00:24:27.282 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.283+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=62QTE5SWEMRP type=del size=944824 2024-09-12T00:24:27.286 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.287+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~RX8ZRV679SX4.0 size=146926 2024-09-12T00:24:27.291 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.291+0000 7f0d199128c0 1 < completed multipart upload key=YTXW98O07966 upload=RX8ZRV679SX4 tag=XP527MSD2BWO type=write size=1195502 2024-09-12T00:24:27.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.295+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=Z0KAVU2SJY1J type=del size=1058016 2024-09-12T00:24:27.297 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.299+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~IX021WS9B307.0 size=162814 2024-09-12T00:24:27.303 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.303+0000 7f0d199128c0 1 < completed multipart upload key=4K654PSDLDVI upload=IX021WS9B307 tag=W7R709J7RWKY type=write size=1211390 2024-09-12T00:24:27.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.307+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~U7JE68P5CN3Z.0 size=1048576 2024-09-12T00:24:27.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.311+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~U7JE68P5CN3Z.1 size=455617 2024-09-12T00:24:27.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.311+0000 7f0d199128c0 1 > prepared multipart upload key=FJ8YV026H0ZU upload=U7JE68P5CN3Z tag=ZI564TM8DVRN type=write size=2552769 2024-09-12T00:24:27.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.315+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~12JVJKX7Y76D.0 size=821960 2024-09-12T00:24:27.322 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.323+0000 7f0d199128c0 1 < completed multipart upload key=FJ8YV026H0ZU upload=12JVJKX7Y76D tag=LZX2MIXEAI0Q type=write size=1870536 2024-09-12T00:24:27.327 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.327+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=V4LKTNG4THC6 type=del size=190528 2024-09-12T00:24:27.329 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.331+0000 7f0d199128c0 1 < completed delete operation key=HXNC728XIWC1 tag=D9794COVL1JL type=del 2024-09-12T00:24:27.333 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.331+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=BOIBCH7KHEMN type=del size=3854937 2024-09-12T00:24:27.336 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.335+0000 7f0d199128c0 1 < completed delete operation key=ZWGD87Z1MMNK tag=9QNQP5ZGI76S type=del 2024-09-12T00:24:27.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.339+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=AXQ953ICXJKM type=del size=116778 2024-09-12T00:24:27.342 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.343+0000 7f0d199128c0 1 < canceled operation key=10YEWZDTTEV0 tag=4DV9VA1HA1PM type=del size=1027136 2024-09-12T00:24:27.347 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.347+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=OK79B42POKDL type=write size=631220 2024-09-12T00:24:27.351 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.351+0000 7f0d199128c0 1 < completed write operation key=PK2CA62QBZXS tag=LXSXK62U9P3Y type=write size=852936 2024-09-12T00:24:27.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.355+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=QD49R87QPIIH type=del size=1052324 2024-09-12T00:24:27.357 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.359+0000 7f0d199128c0 1 < completed delete operation key=QUO5ND3O41TY tag=RGR7HTTH766A type=del 2024-09-12T00:24:27.361 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.359+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=ZVDSDK2DDRJQ type=del size=3979101 2024-09-12T00:24:27.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.363+0000 7f0d199128c0 1 < completed delete operation key=V6H6S9X0U2A0 tag=H9835KD0PE48 type=del 2024-09-12T00:24:27.371 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.371+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~V5XA9JA0CJT5.0 size=1048576 2024-09-12T00:24:27.373 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.371+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~V5XA9JA0CJT5.1 size=1048576 2024-09-12T00:24:27.376 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.375+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~V5XA9JA0CJT5.2 size=817816 2024-09-12T00:24:27.376 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.375+0000 7f0d199128c0 1 > prepared multipart upload key=OVLAP0OS78QG upload=V5XA9JA0CJT5 tag=LPU5Z563XQIC type=write size=3963544 2024-09-12T00:24:27.380 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.379+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~LTWCJ8DHF1MB.0 size=1048576 2024-09-12T00:24:27.382 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.383+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~LTWCJ8DHF1MB.1 size=768759 2024-09-12T00:24:27.388 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.387+0000 7f0d199128c0 1 < completed multipart upload key=NXQYUQIR2APT upload=LTWCJ8DHF1MB tag=6NGSET0I2ZYB type=write size=2865911 2024-09-12T00:24:27.394 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.395+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~S9Y4HTCR17Y1.0 size=24622 2024-09-12T00:24:27.394 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.395+0000 7f0d199128c0 1 > prepared multipart upload key=57W1IO3KSWBR upload=S9Y4HTCR17Y1 tag=9Z17TSBP02GL type=write size=1073198 2024-09-12T00:24:27.398 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.399+0000 7f0d199128c0 1 < canceled operation key=IPJEXRBN96NB tag=OPS6RWBB6CGV type=del size=3721830 2024-09-12T00:24:27.401 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.399+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=QXBN20PQKV41 type=del size=60404 2024-09-12T00:24:27.405 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.403+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~AH2P9DC0064D.0 size=1048576 2024-09-12T00:24:27.408 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.407+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~AH2P9DC0064D.1 size=501646 2024-09-12T00:24:27.415 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.415+0000 7f0d199128c0 1 < completed multipart upload key=PK2CA62QBZXS upload=AH2P9DC0064D tag=H2RH1UUXSJNF type=write size=2598798 2024-09-12T00:24:27.420 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.419+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=EDSIFFU4I1VY type=del size=3509851 2024-09-12T00:24:27.424 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.423+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~K2YV38MUMXO5.0 size=1048576 2024-09-12T00:24:27.427 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.427+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~K2YV38MUMXO5.1 size=276720 2024-09-12T00:24:27.433 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.435+0000 7f0d199128c0 1 < completed multipart upload key=1Y6B1MJP5G4L upload=K2YV38MUMXO5 tag=6MVG9KPNEAI2 type=write size=2373872 2024-09-12T00:24:27.437 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.435+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=9S4AN4UNFF3D type=del size=1575967 2024-09-12T00:24:27.440 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.439+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~Q4V7GS5MJXYM.0 size=423110 2024-09-12T00:24:27.445 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.447+0000 7f0d199128c0 1 < completed multipart upload key=RX3RVT06SGJ4 upload=Q4V7GS5MJXYM tag=8767WL1QIDZ8 type=write size=1471686 2024-09-12T00:24:27.452 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.451+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~A9WUA1Q6HDPI.0 size=1048576 2024-09-12T00:24:27.455 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.455+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~A9WUA1Q6HDPI.1 size=853726 2024-09-12T00:24:27.455 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.455+0000 7f0d199128c0 1 > prepared multipart upload key=B58RWC9W8THG upload=A9WUA1Q6HDPI tag=N5M30L26YODR type=write size=2950878 2024-09-12T00:24:27.458 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.459+0000 7f0d199128c0 1 < completed write operation key=B58RWC9W8THG tag=PJEJRDFS92N3 type=write size=730049 2024-09-12T00:24:27.461 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.463+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=K53AS7DK663G type=del size=3655930 2024-09-12T00:24:27.465 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.463+0000 7f0d199128c0 1 < canceled operation key=RX3RVT06SGJ4 tag=62QTE5SWEMRP type=del size=944824 2024-09-12T00:24:27.468 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.467+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=3I3WH5U1LQS0 type=del size=3846978 2024-09-12T00:24:27.475 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.475+0000 7f0d199128c0 1 < suggested update operation key=4K654PSDLDVI tag=Z0KAVU2SJY1J type=del size=1058016 2024-09-12T00:24:27.481 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.479+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~2EKN0RJMTX9Q.0 size=791792 2024-09-12T00:24:27.481 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.479+0000 7f0d199128c0 1 > prepared multipart upload key=10YEWZDTTEV0 upload=2EKN0RJMTX9Q tag=LPODIZQCEQGE type=write size=1840368 2024-09-12T00:24:27.484 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.483+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~U7JE68P5CN3Z.0 size=1048576 2024-09-12T00:24:27.487 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.487+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~U7JE68P5CN3Z.1 size=455617 2024-09-12T00:24:27.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.491+0000 7f0d199128c0 1 < completed multipart upload key=FJ8YV026H0ZU upload=U7JE68P5CN3Z tag=ZI564TM8DVRN type=write size=2552769 2024-09-12T00:24:27.495 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.495+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=Z6I1GHD161TP type=write size=551220 2024-09-12T00:24:27.498 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.499+0000 7f0d199128c0 1 < completed delete operation key=YTXW98O07966 tag=V4LKTNG4THC6 type=del 2024-09-12T00:24:27.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.503+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=WN5NBZP5LVB4 type=del size=69644 2024-09-12T00:24:27.505 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.503+0000 7f0d199128c0 1 < completed delete operation key=1Y6B1MJP5G4L tag=BOIBCH7KHEMN type=del 2024-09-12T00:24:27.508 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.507+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=O9IJ6J1ULXE0 type=write size=756754 2024-09-12T00:24:27.511 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.511+0000 7f0d199128c0 1 < completed delete operation key=GH0FNY2AI00G tag=AXQ953ICXJKM type=del 2024-09-12T00:24:27.515 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.515+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=4WPSOIDL6P8K type=del size=1498082 2024-09-12T00:24:27.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.519+0000 7f0d199128c0 1 < suggested remove operation key=RFCHRGVA9GOI tag=OK79B42POKDL type=write 2024-09-12T00:24:27.524 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.523+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=VO9Q19W8KVNY type=del size=3773292 2024-09-12T00:24:27.527 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.527+0000 7f0d199128c0 1 < completed delete operation key=NXQYUQIR2APT tag=QD49R87QPIIH type=del 2024-09-12T00:24:27.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.531+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=68TRBTQ81Q87 type=del size=4059553 2024-09-12T00:24:27.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.535+0000 7f0d199128c0 1 < suggested remove operation key=ZWGD87Z1MMNK tag=ZVDSDK2DDRJQ type=del 2024-09-12T00:24:27.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.539+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=H2SGGJ3YUGLI type=del size=1633897 2024-09-12T00:24:27.544 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.543+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~V5XA9JA0CJT5.0 size=1048576 2024-09-12T00:24:27.546 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.547+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~V5XA9JA0CJT5.1 size=1048576 2024-09-12T00:24:27.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.547+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~V5XA9JA0CJT5.2 size=817816 2024-09-12T00:24:27.554 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.555+0000 7f0d199128c0 1 < completed multipart upload key=OVLAP0OS78QG upload=V5XA9JA0CJT5 tag=LPU5Z563XQIC type=write size=3963544 2024-09-12T00:24:27.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.555+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=SZXIGA55W30O type=del size=1023575 2024-09-12T00:24:27.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.563+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~S9Y4HTCR17Y1.0 size=24622 2024-09-12T00:24:27.569 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.567+0000 7f0d199128c0 1 < completed multipart upload key=57W1IO3KSWBR upload=S9Y4HTCR17Y1 tag=9Z17TSBP02GL type=write size=1073198 2024-09-12T00:24:27.572 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.571+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=FHL4L623ZW64 type=del size=1236061 2024-09-12T00:24:27.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.575+0000 7f0d199128c0 -1 < failed to complete operation key=ZWGD87Z1MMNK tag=QXBN20PQKV41 type=del size=60404: (22) Invalid argument 2024-09-12T00:24:27.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.579+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~C929NAKSOAXW.0 size=1048576 2024-09-12T00:24:27.584 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.583+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~C929NAKSOAXW.1 size=1048576 2024-09-12T00:24:27.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.583+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~C929NAKSOAXW.2 size=633264 2024-09-12T00:24:27.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.583+0000 7f0d199128c0 1 > prepared multipart upload key=VXZI0ZTMQSV0 upload=C929NAKSOAXW tag=X9RYB5MQ3629 type=write size=3778992 2024-09-12T00:24:27.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.587+0000 7f0d199128c0 -1 < no bi entry to suggest for operation key=ZWGD87Z1MMNK tag=EDSIFFU4I1VY type=del size=3509851: (2) No such file or directory 2024-09-12T00:24:27.592 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.591+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~QGS5D4LX2WXM.0 size=630939 2024-09-12T00:24:27.592 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.591+0000 7f0d199128c0 1 > prepared multipart upload key=HXNC728XIWC1 upload=QGS5D4LX2WXM tag=PCAKXGZ2HS8M type=write size=1679515 2024-09-12T00:24:27.595 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.595+0000 7f0d199128c0 1 < completed delete operation key=OVLAP0OS78QG tag=9S4AN4UNFF3D type=del 2024-09-12T00:24:27.598 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.599+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=L7HOCQ2QBAUE type=write size=1000807 2024-09-12T00:24:27.601 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.599+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~A9WUA1Q6HDPI.0 size=1048576 2024-09-12T00:24:27.603 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.603+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~A9WUA1Q6HDPI.1 size=853726 2024-09-12T00:24:27.608 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.607+0000 7f0d199128c0 1 < completed multipart upload key=B58RWC9W8THG upload=A9WUA1Q6HDPI tag=N5M30L26YODR type=write size=2950878 2024-09-12T00:24:27.614 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.615+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~GTQ33G3XI58L.0 size=377387 2024-09-12T00:24:27.614 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.615+0000 7f0d199128c0 1 > prepared multipart upload key=JA6CSJF78VE2 upload=GTQ33G3XI58L tag=KEI9M6VG59CC type=write size=1425963 2024-09-12T00:24:27.617 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.619+0000 7f0d199128c0 1 < completed delete operation key=GH0FNY2AI00G tag=K53AS7DK663G type=del 2024-09-12T00:24:27.623 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.623+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=F1R0Q07GJ4F1 type=del size=2722604 2024-09-12T00:24:27.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.627+0000 7f0d199128c0 1 < completed delete operation key=YTXW98O07966 tag=3I3WH5U1LQS0 type=del 2024-09-12T00:24:27.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.627+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=Y0GN8HV8BYJ1 type=del size=1997347 2024-09-12T00:24:27.632 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.631+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~2EKN0RJMTX9Q.0 size=791792 2024-09-12T00:24:27.637 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.635+0000 7f0d199128c0 1 < completed multipart upload key=10YEWZDTTEV0 upload=2EKN0RJMTX9Q tag=LPODIZQCEQGE type=write size=1840368 2024-09-12T00:24:27.643 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.643+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~GBXKPNUZOJGT.0 size=1048576 2024-09-12T00:24:27.645 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.643+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~GBXKPNUZOJGT.1 size=935669 2024-09-12T00:24:27.645 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.643+0000 7f0d199128c0 1 > prepared multipart upload key=0ZT4NZYZKI5Z upload=GBXKPNUZOJGT tag=417NFBO7CQ6C type=write size=3032821 2024-09-12T00:24:27.648 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.647+0000 7f0d199128c0 1 < canceled operation key=H604SA6XTFLY tag=Z6I1GHD161TP type=write size=551220 2024-09-12T00:24:27.653 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.655+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~0A1JMOI2Q0OE.0 size=1048576 2024-09-12T00:24:27.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.655+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~0A1JMOI2Q0OE.1 size=1048576 2024-09-12T00:24:27.658 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.659+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~0A1JMOI2Q0OE.2 size=744682 2024-09-12T00:24:27.658 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.659+0000 7f0d199128c0 1 > prepared multipart upload key=HXNC728XIWC1 upload=0A1JMOI2Q0OE tag=ZB3B7YZAL20Q type=write size=3890410 2024-09-12T00:24:27.661 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.663+0000 7f0d199128c0 1 < completed delete operation key=0EBWUENN0881 tag=WN5NBZP5LVB4 type=del 2024-09-12T00:24:27.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.667+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~N28TC4R5EXB0.0 size=82247 2024-09-12T00:24:27.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.667+0000 7f0d199128c0 1 > prepared multipart upload key=H604SA6XTFLY upload=N28TC4R5EXB0 tag=32PX4HJ3AY3W type=write size=1130823 2024-09-12T00:24:27.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.671+0000 7f0d199128c0 -1 < failed to complete operation key=RFCHRGVA9GOI tag=O9IJ6J1ULXE0 type=write size=756754: (22) Invalid argument 2024-09-12T00:24:27.673 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.671+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=UV4FWLH080MK type=del size=4126592 2024-09-12T00:24:27.676 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.675+0000 7f0d199128c0 1 < completed delete operation key=J75P0821XGRO tag=4WPSOIDL6P8K type=del 2024-09-12T00:24:27.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.683+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~0XLHY3N912R8.0 size=1048576 2024-09-12T00:24:27.684 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.683+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~0XLHY3N912R8.1 size=950507 2024-09-12T00:24:27.684 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.683+0000 7f0d199128c0 1 > prepared multipart upload key=VXZI0ZTMQSV0 upload=0XLHY3N912R8 tag=PNQ28KKD56VM type=write size=3047659 2024-09-12T00:24:27.687 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.687+0000 7f0d199128c0 1 < completed delete operation key=WBGXMJB7U422 tag=VO9Q19W8KVNY type=del 2024-09-12T00:24:27.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.691+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~IPAOW2H8XYL6.0 size=1048576 2024-09-12T00:24:27.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.695+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~IPAOW2H8XYL6.1 size=1048576 2024-09-12T00:24:27.698 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.699+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~IPAOW2H8XYL6.2 size=268726 2024-09-12T00:24:27.698 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.699+0000 7f0d199128c0 1 > prepared multipart upload key=SITJU2EUVSR8 upload=IPAOW2H8XYL6 tag=CHS5SNI9YA32 type=write size=3414454 2024-09-12T00:24:27.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.699+0000 7f0d199128c0 1 < completed delete operation key=JA6CSJF78VE2 tag=68TRBTQ81Q87 type=del 2024-09-12T00:24:27.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.703+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=KNO2BWDWBBTU type=del size=1433164 2024-09-12T00:24:27.708 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.707+0000 7f0d199128c0 1 < completed delete operation key=B58RWC9W8THG tag=H2SGGJ3YUGLI type=del 2024-09-12T00:24:27.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.711+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=5PTMJ1E91E4A type=write size=458568 2024-09-12T00:24:27.715 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.715+0000 7f0d199128c0 1 < completed delete operation key=FJ8YV026H0ZU tag=SZXIGA55W30O type=del 2024-09-12T00:24:27.718 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.719+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=2L46E4ETY9ZT type=del size=3732118 2024-09-12T00:24:27.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.723+0000 7f0d199128c0 1 < completed delete operation key=1Y6B1MJP5G4L tag=FHL4L623ZW64 type=del 2024-09-12T00:24:27.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.727+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~U0MSKU3DTMS3.0 size=320466 2024-09-12T00:24:27.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.727+0000 7f0d199128c0 1 > prepared multipart upload key=IPJEXRBN96NB upload=U0MSKU3DTMS3 tag=9X7IK75P8OY9 type=write size=1369042 2024-09-12T00:24:27.730 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.731+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~C929NAKSOAXW.0 size=1048576 2024-09-12T00:24:27.732 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.731+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~C929NAKSOAXW.1 size=1048576 2024-09-12T00:24:27.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.735+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~C929NAKSOAXW.2 size=633264 2024-09-12T00:24:27.738 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.739+0000 7f0d199128c0 1 < completed multipart upload key=VXZI0ZTMQSV0 upload=C929NAKSOAXW tag=X9RYB5MQ3629 type=write size=3778992 2024-09-12T00:24:27.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.739+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=JBCBHAE70EHT type=write size=892209 2024-09-12T00:24:27.743 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.743+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~QGS5D4LX2WXM.0 size=630939 2024-09-12T00:24:27.748 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.747+0000 7f0d199128c0 1 < completed multipart upload key=HXNC728XIWC1 upload=QGS5D4LX2WXM tag=PCAKXGZ2HS8M type=write size=1679515 2024-09-12T00:24:27.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.751+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=M3D86373N592 type=write size=752016 2024-09-12T00:24:27.753 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.755+0000 7f0d199128c0 1 < completed write operation key=T6GOR4SBYU2Y tag=L7HOCQ2QBAUE type=write size=1000807 2024-09-12T00:24:27.756 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.755+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=DEYF92FN7JL0 type=del size=2984969 2024-09-12T00:24:27.759 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.759+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~GTQ33G3XI58L.0 size=377387 2024-09-12T00:24:27.763 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.763+0000 7f0d199128c0 1 < completed multipart upload key=JA6CSJF78VE2 upload=GTQ33G3XI58L tag=KEI9M6VG59CC type=write size=1425963 2024-09-12T00:24:27.768 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.767+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~26XMEQI37INS.0 size=1048576 2024-09-12T00:24:27.770 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.771+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~26XMEQI37INS.1 size=822152 2024-09-12T00:24:27.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.771+0000 7f0d199128c0 1 > prepared multipart upload key=H604SA6XTFLY upload=26XMEQI37INS tag=0DMJ4JD61APC type=write size=2919304 2024-09-12T00:24:27.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.771+0000 7f0d199128c0 1 < canceled operation key=37WTPAJGOX5L tag=F1R0Q07GJ4F1 type=del size=2722604 2024-09-12T00:24:27.776 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.775+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=81J29XU92VQK type=del size=1293878 2024-09-12T00:24:27.779 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.779+0000 7f0d199128c0 1 < completed delete operation key=NXQYUQIR2APT tag=Y0GN8HV8BYJ1 type=del 2024-09-12T00:24:27.782 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.783+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=Y8LQZC65RRTW type=del size=1136023 2024-09-12T00:24:27.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.783+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~GBXKPNUZOJGT.0 size=1048576 2024-09-12T00:24:27.787 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.787+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~GBXKPNUZOJGT.1 size=935669 2024-09-12T00:24:27.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.791+0000 7f0d199128c0 1 < completed multipart upload key=0ZT4NZYZKI5Z upload=GBXKPNUZOJGT tag=417NFBO7CQ6C type=write size=3032821 2024-09-12T00:24:27.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.799+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~2F1WXPPV4FSO.0 size=1048576 2024-09-12T00:24:27.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.799+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~2F1WXPPV4FSO.1 size=1048576 2024-09-12T00:24:27.802 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.803+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~2F1WXPPV4FSO.2 size=125248 2024-09-12T00:24:27.802 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.803+0000 7f0d199128c0 1 > prepared multipart upload key=0ZT4NZYZKI5Z upload=2F1WXPPV4FSO tag=G1Y8B0Y2248T type=write size=3270976 2024-09-12T00:24:27.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.807+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~0A1JMOI2Q0OE.0 size=1048576 2024-09-12T00:24:27.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.807+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~0A1JMOI2Q0OE.1 size=1048576 2024-09-12T00:24:27.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.811+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~0A1JMOI2Q0OE.2 size=744682 2024-09-12T00:24:27.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.815+0000 7f0d199128c0 1 < completed multipart upload key=HXNC728XIWC1 upload=0A1JMOI2Q0OE tag=ZB3B7YZAL20Q type=write size=3890410 2024-09-12T00:24:27.818 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.819+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=AS2PUIM1HMRU type=del size=1694870 2024-09-12T00:24:27.821 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.819+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~N28TC4R5EXB0.0 size=82247 2024-09-12T00:24:27.826 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.827+0000 7f0d199128c0 1 < completed multipart upload key=H604SA6XTFLY upload=N28TC4R5EXB0 tag=32PX4HJ3AY3W type=write size=1130823 2024-09-12T00:24:27.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.831+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~YF50U63D3FTD.0 size=478177 2024-09-12T00:24:27.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.831+0000 7f0d199128c0 1 > prepared multipart upload key=WPZOKZDFXK4S upload=YF50U63D3FTD tag=D2TGJ3KOQYGI type=write size=1526753 2024-09-12T00:24:27.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.835+0000 7f0d199128c0 1 < completed delete operation key=T6GOR4SBYU2Y tag=UV4FWLH080MK type=del 2024-09-12T00:24:27.839 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.839+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=XID3CT3GKNYZ type=write size=174411 2024-09-12T00:24:27.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.847+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~0XLHY3N912R8.0 size=1048576 2024-09-12T00:24:27.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.847+0000 7f0d199128c0 1 < canceled part key=_multipart_VXZI0ZTMQSV0.2~0XLHY3N912R8.1 size=950507 2024-09-12T00:24:27.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.851+0000 7f0d199128c0 1 < canceled multipart upload key=VXZI0ZTMQSV0 upload=0XLHY3N912R8 tag=PNQ28KKD56VM type=write size=3047659 2024-09-12T00:24:27.858 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.859+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~ZPASBIN4IPN9.0 size=349418 2024-09-12T00:24:27.858 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.859+0000 7f0d199128c0 1 > prepared multipart upload key=J75P0821XGRO upload=ZPASBIN4IPN9 tag=9Q04MZNHOE31 type=write size=1397994 2024-09-12T00:24:27.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.863+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~IPAOW2H8XYL6.0 size=1048576 2024-09-12T00:24:27.864 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.863+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~IPAOW2H8XYL6.1 size=1048576 2024-09-12T00:24:27.867 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.867+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~IPAOW2H8XYL6.2 size=268726 2024-09-12T00:24:27.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.871+0000 7f0d199128c0 1 < completed multipart upload key=SITJU2EUVSR8 upload=IPAOW2H8XYL6 tag=CHS5SNI9YA32 type=write size=3414454 2024-09-12T00:24:27.874 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.875+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=P0DODH2W4T80 type=del size=3871398 2024-09-12T00:24:27.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.875+0000 7f0d199128c0 1 < completed delete operation key=V6H6S9X0U2A0 tag=KNO2BWDWBBTU type=del 2024-09-12T00:24:27.881 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.879+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=GK2GW6J73UXA type=del size=3650435 2024-09-12T00:24:27.884 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.883+0000 7f0d199128c0 1 < canceled operation key=PK2CA62QBZXS tag=5PTMJ1E91E4A type=write size=458568 2024-09-12T00:24:27.887 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.887+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=5ENHMNQ2BYWL type=write size=944349 2024-09-12T00:24:27.890 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.891+0000 7f0d199128c0 1 < completed delete operation key=T6GOR4SBYU2Y tag=2L46E4ETY9ZT type=del 2024-09-12T00:24:27.893 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.895+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=6OFARN0F7B2K type=del size=2084133 2024-09-12T00:24:27.894 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.895+0000 7f0d199128c0 1 < canceled part key=_multipart_IPJEXRBN96NB.2~U0MSKU3DTMS3.0 size=320466 2024-09-12T00:24:27.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.899+0000 7f0d199128c0 1 < canceled multipart upload key=IPJEXRBN96NB upload=U0MSKU3DTMS3 tag=9X7IK75P8OY9 type=write size=1369042 2024-09-12T00:24:27.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.899+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=KU43E6JGYW52 type=write size=453059 2024-09-12T00:24:27.904 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.903+0000 7f0d199128c0 1 < completed write operation key=2EK9CCKG26W2 tag=JBCBHAE70EHT type=write size=892209 2024-09-12T00:24:27.907 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.907+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=O1GPTSHSPCVN type=del size=2173548 2024-09-12T00:24:27.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.911+0000 7f0d199128c0 1 < completed write operation key=J75P0821XGRO tag=M3D86373N592 type=write size=752016 2024-09-12T00:24:27.916 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.915+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~68D7BPUJ4H5E.0 size=438901 2024-09-12T00:24:27.916 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.915+0000 7f0d199128c0 1 > prepared multipart upload key=2EK9CCKG26W2 upload=68D7BPUJ4H5E tag=2CUCK3L0W276 type=write size=1487477 2024-09-12T00:24:27.919 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.919+0000 7f0d199128c0 1 < completed delete operation key=OVLAP0OS78QG tag=DEYF92FN7JL0 type=del 2024-09-12T00:24:27.921 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.923+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=OX1D35D890D3 type=del size=3910065 2024-09-12T00:24:27.924 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.923+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~26XMEQI37INS.0 size=1048576 2024-09-12T00:24:27.927 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.927+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~26XMEQI37INS.1 size=822152 2024-09-12T00:24:27.931 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.931+0000 7f0d199128c0 1 < completed multipart upload key=H604SA6XTFLY upload=26XMEQI37INS tag=0DMJ4JD61APC type=write size=2919304 2024-09-12T00:24:27.936 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.935+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~UQDS2RKLD7QU.0 size=1048576 2024-09-12T00:24:27.938 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.939+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~UQDS2RKLD7QU.1 size=1048576 2024-09-12T00:24:27.941 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.939+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~UQDS2RKLD7QU.2 size=820682 2024-09-12T00:24:27.941 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.939+0000 7f0d199128c0 1 > prepared multipart upload key=0ZT4NZYZKI5Z upload=UQDS2RKLD7QU tag=3MFPLA98FTGJ type=write size=3966410 2024-09-12T00:24:27.944 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.943+0000 7f0d199128c0 1 < completed delete operation key=A529WOKFD1NI tag=81J29XU92VQK type=del 2024-09-12T00:24:27.946 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.947+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=JZ5AUF51HGXI type=del size=3767840 2024-09-12T00:24:27.949 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.947+0000 7f0d199128c0 1 < completed delete operation key=WBGXMJB7U422 tag=Y8LQZC65RRTW type=del 2024-09-12T00:24:27.955 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.955+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~8YGPO0X42FIP.0 size=1048576 2024-09-12T00:24:27.957 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.959+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~8YGPO0X42FIP.1 size=1048576 2024-09-12T00:24:27.960 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.959+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~8YGPO0X42FIP.2 size=131142 2024-09-12T00:24:27.960 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.959+0000 7f0d199128c0 1 > prepared multipart upload key=VXZI0ZTMQSV0 upload=8YGPO0X42FIP tag=K3IUQFCNQIVE type=write size=3276870 2024-09-12T00:24:27.964 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.963+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~2F1WXPPV4FSO.0 size=1048576 2024-09-12T00:24:27.966 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.967+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~2F1WXPPV4FSO.1 size=1048576 2024-09-12T00:24:27.968 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.967+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~2F1WXPPV4FSO.2 size=125248 2024-09-12T00:24:27.973 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.975+0000 7f0d199128c0 1 < completed multipart upload key=0ZT4NZYZKI5Z upload=2F1WXPPV4FSO tag=G1Y8B0Y2248T type=write size=3270976 2024-09-12T00:24:27.980 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.979+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~0QRG823XDQX8.0 size=1048576 2024-09-12T00:24:27.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.983+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~0QRG823XDQX8.1 size=752533 2024-09-12T00:24:27.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.983+0000 7f0d199128c0 1 > prepared multipart upload key=T6GOR4SBYU2Y upload=0QRG823XDQX8 tag=0PCYRG77SW7W type=write size=2849685 2024-09-12T00:24:27.985 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.983+0000 7f0d199128c0 1 < completed delete operation key=4K654PSDLDVI tag=AS2PUIM1HMRU type=del 2024-09-12T00:24:27.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.991+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~QONEJJE7KLJU.0 size=969541 2024-09-12T00:24:27.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.991+0000 7f0d199128c0 1 > prepared multipart upload key=J75P0821XGRO upload=QONEJJE7KLJU tag=ZE6ST9E5R549 type=write size=2018117 2024-09-12T00:24:27.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.991+0000 7f0d199128c0 1 < canceled part key=_multipart_WPZOKZDFXK4S.2~YF50U63D3FTD.0 size=478177 2024-09-12T00:24:27.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.995+0000 7f0d199128c0 1 < canceled multipart upload key=WPZOKZDFXK4S upload=YF50U63D3FTD tag=D2TGJ3KOQYGI type=write size=1526753 2024-09-12T00:24:28.000 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:27.999+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=9G1IHJ17WXJW type=del size=253695 2024-09-12T00:24:28.003 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.003+0000 7f0d199128c0 1 < completed write operation key=ZWGD87Z1MMNK tag=XID3CT3GKNYZ type=write size=174411 2024-09-12T00:24:28.006 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.007+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=418A1KG8ICNN type=del size=3054084 2024-09-12T00:24:28.009 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.007+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~ZPASBIN4IPN9.0 size=349418 2024-09-12T00:24:28.015 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.015+0000 7f0d199128c0 1 < completed multipart upload key=J75P0821XGRO upload=ZPASBIN4IPN9 tag=9Q04MZNHOE31 type=write size=1397994 2024-09-12T00:24:28.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.019+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=S1C7Y35X3XJA type=del size=2214096 2024-09-12T00:24:28.021 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.019+0000 7f0d199128c0 1 < completed delete operation key=J75P0821XGRO tag=P0DODH2W4T80 type=del 2024-09-12T00:24:28.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.023+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=0L92YO4N7624 type=write size=271456 2024-09-12T00:24:28.026 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.027+0000 7f0d199128c0 1 < completed delete operation key=YTXW98O07966 tag=GK2GW6J73UXA type=del 2024-09-12T00:24:28.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.027+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=CFVMPRUP0WIA type=del size=4142262 2024-09-12T00:24:28.032 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.031+0000 7f0d199128c0 1 < canceled operation key=OVLAP0OS78QG tag=5ENHMNQ2BYWL type=write size=944349 2024-09-12T00:24:28.038 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.039+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~2W4K2FTJ53SS.0 size=1048576 2024-09-12T00:24:28.040 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.039+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~2W4K2FTJ53SS.1 size=1048576 2024-09-12T00:24:28.043 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.043+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~2W4K2FTJ53SS.2 size=364680 2024-09-12T00:24:28.043 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.043+0000 7f0d199128c0 1 > prepared multipart upload key=1Y6B1MJP5G4L upload=2W4K2FTJ53SS tag=D2N1MAA6YTM7 type=write size=3510408 2024-09-12T00:24:28.045 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.047+0000 7f0d199128c0 1 < canceled operation key=QUO5ND3O41TY tag=6OFARN0F7B2K type=del size=2084133 2024-09-12T00:24:28.050 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.051+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~KAO5MB70Q1EF.0 size=1048576 2024-09-12T00:24:28.053 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.051+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~KAO5MB70Q1EF.1 size=1041371 2024-09-12T00:24:28.053 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.051+0000 7f0d199128c0 1 > prepared multipart upload key=NXQYUQIR2APT upload=KAO5MB70Q1EF tag=T6P8UHNI0R74 type=write size=3138523 2024-09-12T00:24:28.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.055+0000 7f0d199128c0 1 < completed write operation key=1Y6B1MJP5G4L tag=KU43E6JGYW52 type=write size=453059 2024-09-12T00:24:28.059 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.059+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=V60R8ZW244RS type=del size=1954883 2024-09-12T00:24:28.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.067+0000 7f0d199128c0 1 < suggested update operation key=H604SA6XTFLY tag=O1GPTSHSPCVN type=del size=2173548 2024-09-12T00:24:28.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.071+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~UDZNSOZ07W4J.0 size=1048576 2024-09-12T00:24:28.075 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.075+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~UDZNSOZ07W4J.1 size=1048576 2024-09-12T00:24:28.077 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.075+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~UDZNSOZ07W4J.2 size=693496 2024-09-12T00:24:28.077 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.075+0000 7f0d199128c0 1 > prepared multipart upload key=V6H6S9X0U2A0 upload=UDZNSOZ07W4J tag=33AGEW0Q5ID4 type=write size=3839224 2024-09-12T00:24:28.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.079+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~68D7BPUJ4H5E.0 size=438901 2024-09-12T00:24:28.086 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.087+0000 7f0d199128c0 1 < completed multipart upload key=2EK9CCKG26W2 upload=68D7BPUJ4H5E tag=2CUCK3L0W276 type=write size=1487477 2024-09-12T00:24:28.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.087+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=OR1MP3ZJOCH4 type=del size=2042364 2024-09-12T00:24:28.092 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.091+0000 7f0d199128c0 1 < completed delete operation key=VXZI0ZTMQSV0 tag=OX1D35D890D3 type=del 2024-09-12T00:24:28.096 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.095+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=P8P462ZD8CFS type=del size=2119289 2024-09-12T00:24:28.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.099+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~UQDS2RKLD7QU.0 size=1048576 2024-09-12T00:24:28.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.099+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~UQDS2RKLD7QU.1 size=1048576 2024-09-12T00:24:28.103 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.103+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~UQDS2RKLD7QU.2 size=820682 2024-09-12T00:24:28.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.107+0000 7f0d199128c0 1 < completed multipart upload key=0ZT4NZYZKI5Z upload=UQDS2RKLD7QU tag=3MFPLA98FTGJ type=write size=3966410 2024-09-12T00:24:28.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.115+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~GGLD1QKMBLPA.0 size=1048576 2024-09-12T00:24:28.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.115+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~GGLD1QKMBLPA.1 size=913144 2024-09-12T00:24:28.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.115+0000 7f0d199128c0 1 > prepared multipart upload key=2EK9CCKG26W2 upload=GGLD1QKMBLPA tag=Y8X11DHPXYKG type=write size=3010296 2024-09-12T00:24:28.119 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.119+0000 7f0d199128c0 1 < canceled operation key=4K654PSDLDVI tag=JZ5AUF51HGXI type=del size=3767840 2024-09-12T00:24:28.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.123+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=58IDGI0CI3B1 type=write size=461334 2024-09-12T00:24:28.124 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.123+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~8YGPO0X42FIP.0 size=1048576 2024-09-12T00:24:28.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.127+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~8YGPO0X42FIP.1 size=1048576 2024-09-12T00:24:28.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.131+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~8YGPO0X42FIP.2 size=131142 2024-09-12T00:24:28.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.135+0000 7f0d199128c0 1 < completed multipart upload key=VXZI0ZTMQSV0 upload=8YGPO0X42FIP tag=K3IUQFCNQIVE type=write size=3276870 2024-09-12T00:24:28.139 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.139+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=LQTVQFHAMRQM type=del size=2652592 2024-09-12T00:24:28.142 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.143+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~0QRG823XDQX8.0 size=1048576 2024-09-12T00:24:28.144 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.143+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~0QRG823XDQX8.1 size=752533 2024-09-12T00:24:28.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.151+0000 7f0d199128c0 1 < completed multipart upload key=T6GOR4SBYU2Y upload=0QRG823XDQX8 tag=0PCYRG77SW7W type=write size=2849685 2024-09-12T00:24:28.154 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.155+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=E92OWOW0UP8Y type=del size=3304861 2024-09-12T00:24:28.154 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.155+0000 7f0d199128c0 1 < canceled part key=_multipart_J75P0821XGRO.2~QONEJJE7KLJU.0 size=969541 2024-09-12T00:24:28.159 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.159+0000 7f0d199128c0 1 < canceled multipart upload key=J75P0821XGRO upload=QONEJJE7KLJU tag=ZE6ST9E5R549 type=write size=2018117 2024-09-12T00:24:28.165 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.163+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~38824JUT0OB9.0 size=1048576 2024-09-12T00:24:28.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.167+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~38824JUT0OB9.1 size=201923 2024-09-12T00:24:28.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.167+0000 7f0d199128c0 1 > prepared multipart upload key=9I6MZAEUS4I0 upload=38824JUT0OB9 tag=6HAD43WR71PA type=write size=2299075 2024-09-12T00:24:28.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.171+0000 7f0d199128c0 1 < completed delete operation key=WPZOKZDFXK4S tag=9G1IHJ17WXJW type=del 2024-09-12T00:24:28.177 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.175+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~MTBEKWC3E82Y.0 size=739679 2024-09-12T00:24:28.177 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.175+0000 7f0d199128c0 1 > prepared multipart upload key=2EK9CCKG26W2 upload=MTBEKWC3E82Y tag=2EUEUF0I9QHS type=write size=1788255 2024-09-12T00:24:28.180 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.179+0000 7f0d199128c0 1 < completed delete operation key=WBGXMJB7U422 tag=418A1KG8ICNN type=del 2024-09-12T00:24:28.183 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.183+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=88BLVRZEF9JR type=del size=3269535 2024-09-12T00:24:28.186 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.187+0000 7f0d199128c0 1 < completed delete operation key=SITJU2EUVSR8 tag=S1C7Y35X3XJA type=del 2024-09-12T00:24:28.192 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.191+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~NRVL3C7GXV25.0 size=1048576 2024-09-12T00:24:28.196 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.195+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~NRVL3C7GXV25.1 size=296063 2024-09-12T00:24:28.197 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.195+0000 7f0d199128c0 1 > prepared multipart upload key=PK2CA62QBZXS upload=NRVL3C7GXV25 tag=BCL21OEJ9CKE type=write size=2393215 2024-09-12T00:24:28.201 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.203+0000 7f0d199128c0 1 < suggested update operation key=1Y6B1MJP5G4L tag=0L92YO4N7624 type=write size=271456 2024-09-12T00:24:28.205 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.203+0000 7f0d199128c0 1 > prepared operation key=57W1IO3KSWBR tag=9UO2Y9UV82PO type=del size=2495990 2024-09-12T00:24:28.212 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.211+0000 7f0d199128c0 1 < suggested update operation key=SITJU2EUVSR8 tag=CFVMPRUP0WIA type=del size=4142262 2024-09-12T00:24:28.216 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.215+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=B610O43CZPKZ type=del size=3211145 2024-09-12T00:24:28.219 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.219+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~2W4K2FTJ53SS.0 size=1048576 2024-09-12T00:24:28.222 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.223+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~2W4K2FTJ53SS.1 size=1048576 2024-09-12T00:24:28.222 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.223+0000 7f0d199128c0 1 < canceled part key=_multipart_1Y6B1MJP5G4L.2~2W4K2FTJ53SS.2 size=364680 2024-09-12T00:24:28.228 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.227+0000 7f0d199128c0 1 < canceled multipart upload key=1Y6B1MJP5G4L upload=2W4K2FTJ53SS tag=D2N1MAA6YTM7 type=write size=3510408 2024-09-12T00:24:28.232 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.231+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=VQW8SRXZWSVB type=del size=2935474 2024-09-12T00:24:28.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.235+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~KAO5MB70Q1EF.0 size=1048576 2024-09-12T00:24:28.238 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.239+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~KAO5MB70Q1EF.1 size=1041371 2024-09-12T00:24:28.243 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.243+0000 7f0d199128c0 1 < completed multipart upload key=NXQYUQIR2APT upload=KAO5MB70Q1EF tag=T6P8UHNI0R74 type=write size=3138523 2024-09-12T00:24:28.249 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.247+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~Z3O4PQ639IG0.0 size=1048576 2024-09-12T00:24:28.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.251+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~Z3O4PQ639IG0.1 size=1048576 2024-09-12T00:24:28.254 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.255+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~Z3O4PQ639IG0.2 size=928721 2024-09-12T00:24:28.254 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.255+0000 7f0d199128c0 1 > prepared multipart upload key=IPJEXRBN96NB upload=Z3O4PQ639IG0 tag=WSD43BNODNZE type=write size=4074449 2024-09-12T00:24:28.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.255+0000 7f0d199128c0 1 < completed delete operation key=WPZOKZDFXK4S tag=V60R8ZW244RS type=del 2024-09-12T00:24:28.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.259+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=Y2ZSLAJ34NH3 type=del size=3054128 2024-09-12T00:24:28.263 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.263+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~UDZNSOZ07W4J.0 size=1048576 2024-09-12T00:24:28.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.267+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~UDZNSOZ07W4J.1 size=1048576 2024-09-12T00:24:28.268 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.267+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~UDZNSOZ07W4J.2 size=693496 2024-09-12T00:24:28.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.271+0000 7f0d199128c0 1 < completed multipart upload key=V6H6S9X0U2A0 upload=UDZNSOZ07W4J tag=33AGEW0Q5ID4 type=write size=3839224 2024-09-12T00:24:28.275 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.275+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=ETOSD9F96PE1 type=del size=841098 2024-09-12T00:24:28.278 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.279+0000 7f0d199128c0 1 < completed delete operation key=FJ8YV026H0ZU tag=OR1MP3ZJOCH4 type=del 2024-09-12T00:24:28.284 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.283+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~4B1I508AVNU1.0 size=359924 2024-09-12T00:24:28.284 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.283+0000 7f0d199128c0 1 > prepared multipart upload key=T6GOR4SBYU2Y upload=4B1I508AVNU1 tag=AYHOZYX5FMIE type=write size=1408500 2024-09-12T00:24:28.286 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.287+0000 7f0d199128c0 -1 < failed to complete operation key=1Y6B1MJP5G4L tag=P8P462ZD8CFS type=del size=2119289: (22) Invalid argument 2024-09-12T00:24:28.289 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.287+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=5OMLIDGKJ359 type=del size=1261622 2024-09-12T00:24:28.292 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.291+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~GGLD1QKMBLPA.0 size=1048576 2024-09-12T00:24:28.295 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.295+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~GGLD1QKMBLPA.1 size=913144 2024-09-12T00:24:28.300 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.299+0000 7f0d199128c0 1 < completed multipart upload key=2EK9CCKG26W2 upload=GGLD1QKMBLPA tag=Y8X11DHPXYKG type=write size=3010296 2024-09-12T00:24:28.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.303+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~GO6HAP3H00G6.0 size=295023 2024-09-12T00:24:28.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.303+0000 7f0d199128c0 1 > prepared multipart upload key=VXZI0ZTMQSV0 upload=GO6HAP3H00G6 tag=QX1TR922NQRQ type=write size=1343599 2024-09-12T00:24:28.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.307+0000 7f0d199128c0 1 < completed write operation key=T6GOR4SBYU2Y tag=58IDGI0CI3B1 type=write size=461334 2024-09-12T00:24:28.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.311+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=IFTNANTZHXKQ type=del size=3982907 2024-09-12T00:24:28.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.315+0000 7f0d199128c0 1 < completed delete operation key=FJ8YV026H0ZU tag=LQTVQFHAMRQM type=del 2024-09-12T00:24:28.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.319+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~PCUP4I1KE0RY.0 size=1048576 2024-09-12T00:24:28.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.319+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~PCUP4I1KE0RY.1 size=1025225 2024-09-12T00:24:28.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.319+0000 7f0d199128c0 1 > prepared multipart upload key=WBGXMJB7U422 upload=PCUP4I1KE0RY tag=IT79MV4RO5GX type=write size=3122377 2024-09-12T00:24:28.326 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.327+0000 7f0d199128c0 1 < suggested remove operation key=A529WOKFD1NI tag=E92OWOW0UP8Y type=del 2024-09-12T00:24:28.331 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.331+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~9YPL6BQ9001O.0 size=1048576 2024-09-12T00:24:28.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.335+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~9YPL6BQ9001O.1 size=219559 2024-09-12T00:24:28.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.335+0000 7f0d199128c0 1 > prepared multipart upload key=WPZOKZDFXK4S upload=9YPL6BQ9001O tag=LNZX9FC9FU9T type=write size=2316711 2024-09-12T00:24:28.337 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.335+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~38824JUT0OB9.0 size=1048576 2024-09-12T00:24:28.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.339+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~38824JUT0OB9.1 size=201923 2024-09-12T00:24:28.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.343+0000 7f0d199128c0 1 < completed multipart upload key=9I6MZAEUS4I0 upload=38824JUT0OB9 tag=6HAD43WR71PA type=write size=2299075 2024-09-12T00:24:28.349 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.351+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~64ALSCNGCSRH.0 size=1048576 2024-09-12T00:24:28.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.351+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~64ALSCNGCSRH.1 size=1048576 2024-09-12T00:24:28.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.355+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~64ALSCNGCSRH.2 size=79232 2024-09-12T00:24:28.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.355+0000 7f0d199128c0 1 > prepared multipart upload key=FJ8YV026H0ZU upload=64ALSCNGCSRH tag=PW3DXVG06JH2 type=write size=3224960 2024-09-12T00:24:28.357 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.355+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~MTBEKWC3E82Y.0 size=739679 2024-09-12T00:24:28.362 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.363+0000 7f0d199128c0 1 < completed multipart upload key=2EK9CCKG26W2 upload=MTBEKWC3E82Y tag=2EUEUF0I9QHS type=write size=1788255 2024-09-12T00:24:28.365 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.367+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=Z851AL0OMO16 type=del size=3635121 2024-09-12T00:24:28.369 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.367+0000 7f0d199128c0 1 < completed delete operation key=4K654PSDLDVI tag=88BLVRZEF9JR type=del 2024-09-12T00:24:28.375 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.375+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=6JOAI5G53PYB type=del size=1521767 2024-09-12T00:24:28.378 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.379+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~NRVL3C7GXV25.0 size=1048576 2024-09-12T00:24:28.380 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.379+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~NRVL3C7GXV25.1 size=296063 2024-09-12T00:24:28.387 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.387+0000 7f0d199128c0 1 < completed multipart upload key=PK2CA62QBZXS upload=NRVL3C7GXV25 tag=BCL21OEJ9CKE type=write size=2393215 2024-09-12T00:24:28.390 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.391+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=U9PKJQNN6UD4 type=del size=471555 2024-09-12T00:24:28.394 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.395+0000 7f0d199128c0 1 < completed delete operation key=57W1IO3KSWBR tag=9UO2Y9UV82PO type=del 2024-09-12T00:24:28.402 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.399+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=KMKOYHC4XSYG type=write size=625223 2024-09-12T00:24:28.402 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.403+0000 7f0d199128c0 1 < completed delete operation key=RX3RVT06SGJ4 tag=B610O43CZPKZ type=del 2024-09-12T00:24:28.405 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.403+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=MA2EWN33A6VL type=del size=1220437 2024-09-12T00:24:28.409 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.407+0000 7f0d199128c0 1 < completed delete operation key=SITJU2EUVSR8 tag=VQW8SRXZWSVB type=del 2024-09-12T00:24:28.416 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.415+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~CDH6W8P4E3HD.0 size=396464 2024-09-12T00:24:28.416 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.415+0000 7f0d199128c0 1 > prepared multipart upload key=9I6MZAEUS4I0 upload=CDH6W8P4E3HD tag=ZAD5W7UO4B2M type=write size=1445040 2024-09-12T00:24:28.420 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.419+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~Z3O4PQ639IG0.0 size=1048576 2024-09-12T00:24:28.428 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.427+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~Z3O4PQ639IG0.1 size=1048576 2024-09-12T00:24:28.431 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.431+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~Z3O4PQ639IG0.2 size=928721 2024-09-12T00:24:28.437 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.435+0000 7f0d199128c0 1 < completed multipart upload key=IPJEXRBN96NB upload=Z3O4PQ639IG0 tag=WSD43BNODNZE type=write size=4074449 2024-09-12T00:24:28.441 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.439+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=3AQL19CYEJCY type=del size=4189852 2024-09-12T00:24:28.444 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.443+0000 7f0d199128c0 1 < completed delete operation key=J75P0821XGRO tag=Y2ZSLAJ34NH3 type=del 2024-09-12T00:24:28.452 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.451+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~NFNBHBD0EHBK.0 size=1048576 2024-09-12T00:24:28.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.455+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~NFNBHBD0EHBK.1 size=1048576 2024-09-12T00:24:28.456 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.455+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~NFNBHBD0EHBK.2 size=238079 2024-09-12T00:24:28.457 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.455+0000 7f0d199128c0 1 > prepared multipart upload key=QUO5ND3O41TY upload=NFNBHBD0EHBK tag=KN6KUVXY0OCK type=write size=3383807 2024-09-12T00:24:28.460 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.459+0000 7f0d199128c0 1 < completed delete operation key=RFCHRGVA9GOI tag=ETOSD9F96PE1 type=del 2024-09-12T00:24:28.463 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.463+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=9TI63BBQHOMI type=del size=3579131 2024-09-12T00:24:28.467 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.467+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~4B1I508AVNU1.0 size=359924 2024-09-12T00:24:28.474 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.475+0000 7f0d199128c0 1 < completed multipart upload key=T6GOR4SBYU2Y upload=4B1I508AVNU1 tag=AYHOZYX5FMIE type=write size=1408500 2024-09-12T00:24:28.478 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.479+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=ARCHKNX9XZ40 type=del size=2915774 2024-09-12T00:24:28.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.483+0000 7f0d199128c0 -1 < failed to complete operation key=A529WOKFD1NI tag=5OMLIDGKJ359 type=del size=1261622: (22) Invalid argument 2024-09-12T00:24:28.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.483+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=MJV2DQHCFK8E type=del size=3436678 2024-09-12T00:24:28.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.487+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~GO6HAP3H00G6.0 size=295023 2024-09-12T00:24:28.494 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.495+0000 7f0d199128c0 1 < completed multipart upload key=VXZI0ZTMQSV0 upload=GO6HAP3H00G6 tag=QX1TR922NQRQ type=write size=1343599 2024-09-12T00:24:28.498 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.499+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=MWUC0NTGONCQ type=del size=2654759 2024-09-12T00:24:28.505 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.503+0000 7f0d199128c0 1 < suggested update operation key=H604SA6XTFLY tag=IFTNANTZHXKQ type=del size=3982907 2024-09-12T00:24:28.512 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.511+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~IBNB5JAD4UF8.0 size=308822 2024-09-12T00:24:28.512 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.511+0000 7f0d199128c0 1 > prepared multipart upload key=JA6CSJF78VE2 upload=IBNB5JAD4UF8 tag=YX3OJJMI6N8Q type=write size=1357398 2024-09-12T00:24:28.515 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.515+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~PCUP4I1KE0RY.0 size=1048576 2024-09-12T00:24:28.518 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.519+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~PCUP4I1KE0RY.1 size=1025225 2024-09-12T00:24:28.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.523+0000 7f0d199128c0 1 < completed multipart upload key=WBGXMJB7U422 upload=PCUP4I1KE0RY tag=IT79MV4RO5GX type=write size=3122377 2024-09-12T00:24:28.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.527+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=X30LVUHIUD1T type=del size=710314 2024-09-12T00:24:28.532 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.531+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~9YPL6BQ9001O.0 size=1048576 2024-09-12T00:24:28.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.535+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~9YPL6BQ9001O.1 size=219559 2024-09-12T00:24:28.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.539+0000 7f0d199128c0 1 < completed multipart upload key=WPZOKZDFXK4S upload=9YPL6BQ9001O tag=LNZX9FC9FU9T type=write size=2316711 2024-09-12T00:24:28.544 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.543+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=IYY0CH7I511I type=del size=3752279 2024-09-12T00:24:28.548 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.547+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~64ALSCNGCSRH.0 size=1048576 2024-09-12T00:24:28.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.551+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~64ALSCNGCSRH.1 size=1048576 2024-09-12T00:24:28.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.551+0000 7f0d199128c0 1 < canceled part key=_multipart_FJ8YV026H0ZU.2~64ALSCNGCSRH.2 size=79232 2024-09-12T00:24:28.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.555+0000 7f0d199128c0 1 < canceled multipart upload key=FJ8YV026H0ZU upload=64ALSCNGCSRH tag=PW3DXVG06JH2 type=write size=3224960 2024-09-12T00:24:28.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.559+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=H8AHEWKK5UYS type=del size=3156124 2024-09-12T00:24:28.567 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.567+0000 7f0d199128c0 1 < suggested remove operation key=WBGXMJB7U422 tag=Z851AL0OMO16 type=del 2024-09-12T00:24:28.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.571+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=QSGTODJBKX2R type=write size=194757 2024-09-12T00:24:28.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.575+0000 7f0d199128c0 1 < completed delete operation key=GH0FNY2AI00G tag=6JOAI5G53PYB type=del 2024-09-12T00:24:28.577 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.579+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=WP2QNCU8FP2Y type=del size=1842440 2024-09-12T00:24:28.581 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.579+0000 7f0d199128c0 1 < completed delete operation key=RX3RVT06SGJ4 tag=U9PKJQNN6UD4 type=del 2024-09-12T00:24:28.584 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.583+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=6FQZMFUPGF6T type=write size=758889 2024-09-12T00:24:28.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.587+0000 7f0d199128c0 1 < canceled operation key=JA6CSJF78VE2 tag=KMKOYHC4XSYG type=write size=625223 2024-09-12T00:24:28.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.591+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=E4E1P8H89V5U type=write size=176613 2024-09-12T00:24:28.595 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.595+0000 7f0d199128c0 1 < completed delete operation key=T6GOR4SBYU2Y tag=MA2EWN33A6VL type=del 2024-09-12T00:24:28.599 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.599+0000 7f0d199128c0 1 > prepared operation key=57W1IO3KSWBR tag=TL70LNQ2WVT0 type=del size=903864 2024-09-12T00:24:28.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.603+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~CDH6W8P4E3HD.0 size=396464 2024-09-12T00:24:28.608 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.607+0000 7f0d199128c0 1 < completed multipart upload key=9I6MZAEUS4I0 upload=CDH6W8P4E3HD tag=ZAD5W7UO4B2M type=write size=1445040 2024-09-12T00:24:28.611 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.611+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=J5FJOD0NJCJD type=del size=3364200 2024-09-12T00:24:28.615 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.615+0000 7f0d199128c0 1 < completed delete operation key=HXNC728XIWC1 tag=3AQL19CYEJCY type=del 2024-09-12T00:24:28.621 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.619+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~AXROHXIGVGA3.0 size=1048576 2024-09-12T00:24:28.624 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.623+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~AXROHXIGVGA3.1 size=1048576 2024-09-12T00:24:28.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.627+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~AXROHXIGVGA3.2 size=67323 2024-09-12T00:24:28.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.627+0000 7f0d199128c0 1 > prepared multipart upload key=0EBWUENN0881 upload=AXROHXIGVGA3 tag=SIU16LN4CPNI type=write size=3213051 2024-09-12T00:24:28.631 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.631+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~NFNBHBD0EHBK.0 size=1048576 2024-09-12T00:24:28.631 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.631+0000 7f0d199128c0 1 < canceled part key=_multipart_QUO5ND3O41TY.2~NFNBHBD0EHBK.1 size=1048576 2024-09-12T00:24:28.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.635+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~NFNBHBD0EHBK.2 size=238079 2024-09-12T00:24:28.640 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.639+0000 7f0d199128c0 1 < canceled multipart upload key=QUO5ND3O41TY upload=NFNBHBD0EHBK tag=KN6KUVXY0OCK type=write size=3383807 2024-09-12T00:24:28.644 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.643+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=48US2EFWZ956 type=del size=2685098 2024-09-12T00:24:28.647 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.647+0000 7f0d199128c0 1 < completed delete operation key=YTXW98O07966 tag=9TI63BBQHOMI type=del 2024-09-12T00:24:28.651 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.651+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=TVSMBVW37NIJ type=del size=2291907 2024-09-12T00:24:28.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.655+0000 7f0d199128c0 1 < completed delete operation key=0EBWUENN0881 tag=ARCHKNX9XZ40 type=del 2024-09-12T00:24:28.661 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.659+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~1DCS31WIZL1M.0 size=1048576 2024-09-12T00:24:28.664 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.663+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~1DCS31WIZL1M.1 size=1048576 2024-09-12T00:24:28.666 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.667+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~1DCS31WIZL1M.2 size=455113 2024-09-12T00:24:28.666 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.667+0000 7f0d199128c0 1 > prepared multipart upload key=B58RWC9W8THG upload=1DCS31WIZL1M tag=M3KCSCNR0DAR type=write size=3600841 2024-09-12T00:24:28.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.671+0000 7f0d199128c0 1 < completed delete operation key=0ZT4NZYZKI5Z tag=MJV2DQHCFK8E type=del 2024-09-12T00:24:28.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.675+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=ZPHEX07X1619 type=del size=3856103 2024-09-12T00:24:28.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.679+0000 7f0d199128c0 1 < completed delete operation key=SITJU2EUVSR8 tag=MWUC0NTGONCQ type=del 2024-09-12T00:24:28.684 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.683+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~U0B1GLPATPCH.0 size=35030 2024-09-12T00:24:28.684 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.683+0000 7f0d199128c0 1 > prepared multipart upload key=JA6CSJF78VE2 upload=U0B1GLPATPCH tag=ZPEV2UIZRB3T type=write size=1083606 2024-09-12T00:24:28.687 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.687+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~IBNB5JAD4UF8.0 size=308822 2024-09-12T00:24:28.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.691+0000 7f0d199128c0 1 < completed multipart upload key=JA6CSJF78VE2 upload=IBNB5JAD4UF8 tag=YX3OJJMI6N8Q type=write size=1357398 2024-09-12T00:24:28.697 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.695+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=YANFBQNXSJPM type=del size=1284435 2024-09-12T00:24:28.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.699+0000 7f0d199128c0 1 < completed delete operation key=OVLAP0OS78QG tag=X30LVUHIUD1T type=del 2024-09-12T00:24:28.707 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.707+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~FA4ZN7ZNBJWS.0 size=810098 2024-09-12T00:24:28.707 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.707+0000 7f0d199128c0 1 > prepared multipart upload key=1Y6B1MJP5G4L upload=FA4ZN7ZNBJWS tag=I2TFIIF8MB5B type=write size=1858674 2024-09-12T00:24:28.711 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.711+0000 7f0d199128c0 1 < completed delete operation key=T6GOR4SBYU2Y tag=IYY0CH7I511I type=del 2024-09-12T00:24:28.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.719+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~LNU5JMHGQNSL.0 size=1048576 2024-09-12T00:24:28.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.723+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~LNU5JMHGQNSL.1 size=1048576 2024-09-12T00:24:28.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.723+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~LNU5JMHGQNSL.2 size=1015355 2024-09-12T00:24:28.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.723+0000 7f0d199128c0 1 > prepared multipart upload key=WBGXMJB7U422 upload=LNU5JMHGQNSL tag=R8O73HW4E1D0 type=write size=4161083 2024-09-12T00:24:28.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.727+0000 7f0d199128c0 1 < completed delete operation key=YTXW98O07966 tag=H8AHEWKK5UYS type=del 2024-09-12T00:24:28.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.735+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~CZ3GSLLBBHYT.0 size=748980 2024-09-12T00:24:28.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.735+0000 7f0d199128c0 1 > prepared multipart upload key=GH0FNY2AI00G upload=CZ3GSLLBBHYT tag=4BWLPYX72XZ1 type=write size=1797556 2024-09-12T00:24:28.737 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.739+0000 7f0d199128c0 1 < completed write operation key=WPZOKZDFXK4S tag=QSGTODJBKX2R type=write size=194757 2024-09-12T00:24:28.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.739+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=CCSTVO124N36 type=del size=1126519 2024-09-12T00:24:28.747 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.747+0000 7f0d199128c0 1 < suggested remove operation key=1Y6B1MJP5G4L tag=WP2QNCU8FP2Y type=del 2024-09-12T00:24:28.754 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.755+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~HTKHRA9ZCL6V.0 size=1015249 2024-09-12T00:24:28.754 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.755+0000 7f0d199128c0 1 > prepared multipart upload key=1Y6B1MJP5G4L upload=HTKHRA9ZCL6V tag=IOQELEEKLX0S type=write size=2063825 2024-09-12T00:24:28.757 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.755+0000 7f0d199128c0 1 < completed write operation key=T6GOR4SBYU2Y tag=6FQZMFUPGF6T type=write size=758889 2024-09-12T00:24:28.768 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.767+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~SAA763VKFTYZ.0 size=354331 2024-09-12T00:24:28.768 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.767+0000 7f0d199128c0 1 > prepared multipart upload key=ZWGD87Z1MMNK upload=SAA763VKFTYZ tag=IHACBT62YV5D type=write size=1402907 2024-09-12T00:24:28.772 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.771+0000 7f0d199128c0 1 < completed write operation key=YTXW98O07966 tag=E4E1P8H89V5U type=write size=176613 2024-09-12T00:24:28.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.775+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=DW11I603K3V1 type=write size=150852 2024-09-12T00:24:28.782 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.783+0000 7f0d199128c0 1 < suggested remove operation key=57W1IO3KSWBR tag=TL70LNQ2WVT0 type=del 2024-09-12T00:24:28.785 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.783+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=6M34NG2SDN3L type=del size=719554 2024-09-12T00:24:28.788 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.787+0000 7f0d199128c0 1 < completed delete operation key=PK2CA62QBZXS tag=J5FJOD0NJCJD type=del 2024-09-12T00:24:28.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.791+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=ZAJOMQG4WP9N type=del size=3248469 2024-09-12T00:24:28.795 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.795+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~AXROHXIGVGA3.0 size=1048576 2024-09-12T00:24:28.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.799+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~AXROHXIGVGA3.1 size=1048576 2024-09-12T00:24:28.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.799+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~AXROHXIGVGA3.2 size=67323 2024-09-12T00:24:28.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.807+0000 7f0d199128c0 1 < completed multipart upload key=0EBWUENN0881 upload=AXROHXIGVGA3 tag=SIU16LN4CPNI type=write size=3213051 2024-09-12T00:24:28.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.807+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=PPJ46UTLJR33 type=del size=1460130 2024-09-12T00:24:28.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.811+0000 7f0d199128c0 1 < completed delete operation key=HXNC728XIWC1 tag=48US2EFWZ956 type=del 2024-09-12T00:24:28.819 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.819+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~NQNZ1EFAYRPM.0 size=1048576 2024-09-12T00:24:28.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.823+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~NQNZ1EFAYRPM.1 size=971840 2024-09-12T00:24:28.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.823+0000 7f0d199128c0 1 > prepared multipart upload key=SITJU2EUVSR8 upload=NQNZ1EFAYRPM tag=7E7Q702VZJB3 type=write size=3068992 2024-09-12T00:24:28.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.823+0000 7f0d199128c0 1 < completed delete operation key=OVLAP0OS78QG tag=TVSMBVW37NIJ type=del 2024-09-12T00:24:28.829 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.827+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=HFWBYGUU8EO2 type=del size=2744010 2024-09-12T00:24:28.829 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.831+0000 7f0d199128c0 1 < canceled part key=_multipart_B58RWC9W8THG.2~1DCS31WIZL1M.0 size=1048576 2024-09-12T00:24:28.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.831+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~1DCS31WIZL1M.1 size=1048576 2024-09-12T00:24:28.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.835+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~1DCS31WIZL1M.2 size=455113 2024-09-12T00:24:28.840 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.839+0000 7f0d199128c0 1 < canceled multipart upload key=B58RWC9W8THG upload=1DCS31WIZL1M tag=M3KCSCNR0DAR type=write size=3600841 2024-09-12T00:24:28.843 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.843+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=21GDX8QKI5S1 type=write size=556081 2024-09-12T00:24:28.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.847+0000 7f0d199128c0 1 < completed delete operation key=OVLAP0OS78QG tag=ZPHEX07X1619 type=del 2024-09-12T00:24:28.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.851+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=P6C8ZTEDWQFF type=del size=1943001 2024-09-12T00:24:28.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.855+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~U0B1GLPATPCH.0 size=35030 2024-09-12T00:24:28.860 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.859+0000 7f0d199128c0 1 < completed multipart upload key=JA6CSJF78VE2 upload=U0B1GLPATPCH tag=ZPEV2UIZRB3T type=write size=1083606 2024-09-12T00:24:28.866 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.867+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~9PA7QSEE2673.0 size=172846 2024-09-12T00:24:28.866 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.867+0000 7f0d199128c0 1 > prepared multipart upload key=9I6MZAEUS4I0 upload=9PA7QSEE2673 tag=UIN0P4OP72AG type=write size=1221422 2024-09-12T00:24:28.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.867+0000 7f0d199128c0 1 < completed delete operation key=0ZT4NZYZKI5Z tag=YANFBQNXSJPM type=del 2024-09-12T00:24:28.873 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.871+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=N59EJ01BQ27V type=del size=2626221 2024-09-12T00:24:28.876 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.875+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~FA4ZN7ZNBJWS.0 size=810098 2024-09-12T00:24:28.882 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.883+0000 7f0d199128c0 1 < completed multipart upload key=1Y6B1MJP5G4L upload=FA4ZN7ZNBJWS tag=I2TFIIF8MB5B type=write size=1858674 2024-09-12T00:24:28.885 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.883+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=4IMHSJUU61I0 type=write size=251607 2024-09-12T00:24:28.890 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.891+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~LNU5JMHGQNSL.0 size=1048576 2024-09-12T00:24:28.892 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.891+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~LNU5JMHGQNSL.1 size=1048576 2024-09-12T00:24:28.892 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.891+0000 7f0d199128c0 1 < canceled part key=_multipart_WBGXMJB7U422.2~LNU5JMHGQNSL.2 size=1015355 2024-09-12T00:24:28.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.899+0000 7f0d199128c0 1 < canceled multipart upload key=WBGXMJB7U422 upload=LNU5JMHGQNSL tag=R8O73HW4E1D0 type=write size=4161083 2024-09-12T00:24:28.904 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.903+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~RPZ30SRG0ZSX.0 size=1048576 2024-09-12T00:24:28.906 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.907+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~RPZ30SRG0ZSX.1 size=1048576 2024-09-12T00:24:28.909 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.907+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~RPZ30SRG0ZSX.2 size=313288 2024-09-12T00:24:28.909 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.907+0000 7f0d199128c0 1 > prepared multipart upload key=9I6MZAEUS4I0 upload=RPZ30SRG0ZSX tag=1XG3M4YMSN5U type=write size=3459016 2024-09-12T00:24:28.912 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.911+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~CZ3GSLLBBHYT.0 size=748980 2024-09-12T00:24:28.917 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.919+0000 7f0d199128c0 1 < completed multipart upload key=GH0FNY2AI00G upload=CZ3GSLLBBHYT tag=4BWLPYX72XZ1 type=write size=1797556 2024-09-12T00:24:28.921 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.919+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=9IDKR70MC9WN type=del size=1824853 2024-09-12T00:24:28.924 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.923+0000 7f0d199128c0 1 < canceled operation key=T6GOR4SBYU2Y tag=CCSTVO124N36 type=del size=1126519 2024-09-12T00:24:28.927 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.927+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=0HNN8SYBOXGX type=write size=987172 2024-09-12T00:24:28.930 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.931+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~HTKHRA9ZCL6V.0 size=1015249 2024-09-12T00:24:28.935 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.935+0000 7f0d199128c0 1 < completed multipart upload key=1Y6B1MJP5G4L upload=HTKHRA9ZCL6V tag=IOQELEEKLX0S type=write size=2063825 2024-09-12T00:24:28.940 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.939+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~ETLDL5JSL36V.0 size=499984 2024-09-12T00:24:28.940 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.939+0000 7f0d199128c0 1 > prepared multipart upload key=FJ8YV026H0ZU upload=ETLDL5JSL36V tag=JUEVVS4XZ7WH type=write size=1548560 2024-09-12T00:24:28.942 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.943+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~SAA763VKFTYZ.0 size=354331 2024-09-12T00:24:28.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.947+0000 7f0d199128c0 1 < completed multipart upload key=ZWGD87Z1MMNK upload=SAA763VKFTYZ tag=IHACBT62YV5D type=write size=1402907 2024-09-12T00:24:28.952 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.951+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~FVOUYB0RFOES.0 size=1048576 2024-09-12T00:24:28.954 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.955+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~FVOUYB0RFOES.1 size=952886 2024-09-12T00:24:28.954 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.955+0000 7f0d199128c0 1 > prepared multipart upload key=YTXW98O07966 upload=FVOUYB0RFOES tag=MH013ZVFPV10 type=write size=3050038 2024-09-12T00:24:28.958 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.959+0000 7f0d199128c0 1 < completed write operation key=0ZT4NZYZKI5Z tag=DW11I603K3V1 type=write size=150852 2024-09-12T00:24:28.961 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.959+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=BC6VL5J10CPL type=del size=3804292 2024-09-12T00:24:28.965 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.963+0000 7f0d199128c0 1 < completed delete operation key=GH0FNY2AI00G tag=6M34NG2SDN3L type=del 2024-09-12T00:24:28.968 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.967+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=VH5GA14EIOQ4 type=write size=90068 2024-09-12T00:24:28.975 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.975+0000 7f0d199128c0 1 < suggested remove operation key=GH0FNY2AI00G tag=ZAJOMQG4WP9N type=del 2024-09-12T00:24:28.980 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.979+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~XJF5PNCUKQ4S.0 size=925059 2024-09-12T00:24:28.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.979+0000 7f0d199128c0 1 > prepared multipart upload key=NXQYUQIR2APT upload=XJF5PNCUKQ4S tag=GAA54FEJ7U19 type=write size=1973635 2024-09-12T00:24:28.986 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.987+0000 7f0d199128c0 1 < suggested update operation key=YTXW98O07966 tag=PPJ46UTLJR33 type=del size=1460130 2024-09-12T00:24:28.989 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.987+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=POBA2BZ8R4M2 type=del size=3563152 2024-09-12T00:24:28.990 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.991+0000 7f0d199128c0 1 < canceled part key=_multipart_SITJU2EUVSR8.2~NQNZ1EFAYRPM.0 size=1048576 2024-09-12T00:24:28.992 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.991+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~NQNZ1EFAYRPM.1 size=971840 2024-09-12T00:24:28.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:28.995+0000 7f0d199128c0 1 < canceled multipart upload key=SITJU2EUVSR8 upload=NQNZ1EFAYRPM tag=7E7Q702VZJB3 type=write size=3068992 2024-09-12T00:24:29.002 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.003+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~1R5K5RTE11G6.0 size=13267 2024-09-12T00:24:29.002 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.003+0000 7f0d199128c0 1 > prepared multipart upload key=2EK9CCKG26W2 upload=1R5K5RTE11G6 tag=VRKX03CQW3TO type=write size=1061843 2024-09-12T00:24:29.005 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.003+0000 7f0d199128c0 1 < completed delete operation key=V6H6S9X0U2A0 tag=HFWBYGUU8EO2 type=del 2024-09-12T00:24:29.008 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.007+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=RQ3YPKUEUTAG type=del size=790269 2024-09-12T00:24:29.011 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.011+0000 7f0d199128c0 1 < completed write operation key=VXZI0ZTMQSV0 tag=21GDX8QKI5S1 type=write size=556081 2024-09-12T00:24:29.017 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.015+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~8HX3TGA8W3LH.0 size=1048576 2024-09-12T00:24:29.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.019+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~8HX3TGA8W3LH.1 size=579751 2024-09-12T00:24:29.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.019+0000 7f0d199128c0 1 > prepared multipart upload key=0EBWUENN0881 upload=8HX3TGA8W3LH tag=N5D40K8PWZZK type=write size=2676903 2024-09-12T00:24:29.021 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.019+0000 7f0d199128c0 -1 < failed to complete operation key=YTXW98O07966 tag=P6C8ZTEDWQFF type=del size=1943001: (22) Invalid argument 2024-09-12T00:24:29.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.023+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=CYLXPDW2J7NE type=del size=1823876 2024-09-12T00:24:29.026 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.027+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~9PA7QSEE2673.0 size=172846 2024-09-12T00:24:29.031 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.031+0000 7f0d199128c0 1 < completed multipart upload key=9I6MZAEUS4I0 upload=9PA7QSEE2673 tag=UIN0P4OP72AG type=write size=1221422 2024-09-12T00:24:29.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.035+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=VXS6M7BAV1YZ type=write size=535937 2024-09-12T00:24:29.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.035+0000 7f0d199128c0 1 < completed delete operation key=37WTPAJGOX5L tag=N59EJ01BQ27V type=del 2024-09-12T00:24:29.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.043+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~3JOP4OLLAQBH.0 size=1048576 2024-09-12T00:24:29.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.043+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~3JOP4OLLAQBH.1 size=1048576 2024-09-12T00:24:29.046 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.047+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~3JOP4OLLAQBH.2 size=445727 2024-09-12T00:24:29.046 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.047+0000 7f0d199128c0 1 > prepared multipart upload key=H604SA6XTFLY upload=3JOP4OLLAQBH tag=D5YCHND3AVMI type=write size=3591455 2024-09-12T00:24:29.051 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.051+0000 7f0d199128c0 1 < suggested remove operation key=WBGXMJB7U422 tag=4IMHSJUU61I0 type=write 2024-09-12T00:24:29.054 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.055+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=5404OLWOBBBA type=del size=2038938 2024-09-12T00:24:29.060 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.059+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~RPZ30SRG0ZSX.0 size=1048576 2024-09-12T00:24:29.060 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.059+0000 7f0d199128c0 1 < canceled part key=_multipart_9I6MZAEUS4I0.2~RPZ30SRG0ZSX.1 size=1048576 2024-09-12T00:24:29.062 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.063+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~RPZ30SRG0ZSX.2 size=313288 2024-09-12T00:24:29.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.067+0000 7f0d199128c0 1 < canceled multipart upload key=9I6MZAEUS4I0 upload=RPZ30SRG0ZSX tag=1XG3M4YMSN5U type=write size=3459016 2024-09-12T00:24:29.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.071+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~A43928X5G5HN.0 size=1048576 2024-09-12T00:24:29.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.075+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~A43928X5G5HN.1 size=1048576 2024-09-12T00:24:29.077 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.075+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~A43928X5G5HN.2 size=208668 2024-09-12T00:24:29.077 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.075+0000 7f0d199128c0 1 > prepared multipart upload key=SITJU2EUVSR8 upload=A43928X5G5HN tag=8ZYE6PUSJZ9P type=write size=3354396 2024-09-12T00:24:29.082 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.083+0000 7f0d199128c0 1 < suggested update operation key=VXZI0ZTMQSV0 tag=9IDKR70MC9WN type=del size=1824853 2024-09-12T00:24:29.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.083+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=8RPR2JK24MBA type=del size=77829 2024-09-12T00:24:29.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.091+0000 7f0d199128c0 1 < suggested remove operation key=FJ8YV026H0ZU tag=0HNN8SYBOXGX type=write 2024-09-12T00:24:29.097 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.099+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~UYXSUHKA3NCX.0 size=1048576 2024-09-12T00:24:29.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.099+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~UYXSUHKA3NCX.1 size=319274 2024-09-12T00:24:29.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.099+0000 7f0d199128c0 1 > prepared multipart upload key=0ZT4NZYZKI5Z upload=UYXSUHKA3NCX tag=CR0M2Y0G43O5 type=write size=2416426 2024-09-12T00:24:29.102 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.103+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~ETLDL5JSL36V.0 size=499984 2024-09-12T00:24:29.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.107+0000 7f0d199128c0 1 < completed multipart upload key=FJ8YV026H0ZU upload=ETLDL5JSL36V tag=JUEVVS4XZ7WH type=write size=1548560 2024-09-12T00:24:29.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.111+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=M087VVEN3YW0 type=write size=334440 2024-09-12T00:24:29.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.111+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~FVOUYB0RFOES.0 size=1048576 2024-09-12T00:24:29.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.115+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~FVOUYB0RFOES.1 size=952886 2024-09-12T00:24:29.119 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.119+0000 7f0d199128c0 1 < completed multipart upload key=YTXW98O07966 upload=FVOUYB0RFOES tag=MH013ZVFPV10 type=write size=3050038 2024-09-12T00:24:29.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.123+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=1UERS1W95E8Z type=del size=3155057 2024-09-12T00:24:29.124 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.123+0000 7f0d199128c0 1 < completed delete operation key=HXNC728XIWC1 tag=BC6VL5J10CPL type=del 2024-09-12T00:24:29.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.131+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~8FF8MWFMGG2X.0 size=507903 2024-09-12T00:24:29.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.131+0000 7f0d199128c0 1 > prepared multipart upload key=WPZOKZDFXK4S upload=8FF8MWFMGG2X tag=MKOJI306R2SX type=write size=1556479 2024-09-12T00:24:29.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.131+0000 7f0d199128c0 1 < completed write operation key=RFCHRGVA9GOI tag=VH5GA14EIOQ4 type=write size=90068 2024-09-12T00:24:29.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.135+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~NDI17B523XGC.0 size=764268 2024-09-12T00:24:29.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.135+0000 7f0d199128c0 1 > prepared multipart upload key=HXNC728XIWC1 upload=NDI17B523XGC tag=78D2UT3E8K6Q type=write size=1812844 2024-09-12T00:24:29.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.135+0000 7f0d199128c0 1 < canceled part key=_multipart_NXQYUQIR2APT.2~XJF5PNCUKQ4S.0 size=925059 2024-09-12T00:24:29.140 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.139+0000 7f0d199128c0 1 < canceled multipart upload key=NXQYUQIR2APT upload=XJF5PNCUKQ4S tag=GAA54FEJ7U19 type=write size=1973635 2024-09-12T00:24:29.145 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.143+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~95U37G17OZ93.0 size=1048576 2024-09-12T00:24:29.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.147+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~95U37G17OZ93.1 size=1048576 2024-09-12T00:24:29.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.151+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~95U37G17OZ93.2 size=774281 2024-09-12T00:24:29.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.151+0000 7f0d199128c0 1 > prepared multipart upload key=IPJEXRBN96NB upload=95U37G17OZ93 tag=Q40HFZJL0N9C type=write size=3920009 2024-09-12T00:24:29.156 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.155+0000 7f0d199128c0 1 < suggested update operation key=FJ8YV026H0ZU tag=POBA2BZ8R4M2 type=del size=3563152 2024-09-12T00:24:29.159 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.159+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=YJR8L6N47930 type=del size=360239 2024-09-12T00:24:29.162 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.163+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~1R5K5RTE11G6.0 size=13267 2024-09-12T00:24:29.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.167+0000 7f0d199128c0 1 < completed multipart upload key=2EK9CCKG26W2 upload=1R5K5RTE11G6 tag=VRKX03CQW3TO type=write size=1061843 2024-09-12T00:24:29.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.171+0000 7f0d199128c0 1 > prepared operation key=57W1IO3KSWBR tag=8EN0HAVX17SH type=del size=116446 2024-09-12T00:24:29.173 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.175+0000 7f0d199128c0 1 < completed delete operation key=0EBWUENN0881 tag=RQ3YPKUEUTAG type=del 2024-09-12T00:24:29.176 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.175+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=LQQ5A36159LG type=del size=2584146 2024-09-12T00:24:29.178 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.179+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~8HX3TGA8W3LH.0 size=1048576 2024-09-12T00:24:29.181 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.179+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~8HX3TGA8W3LH.1 size=579751 2024-09-12T00:24:29.185 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.183+0000 7f0d199128c0 1 < completed multipart upload key=0EBWUENN0881 upload=8HX3TGA8W3LH tag=N5D40K8PWZZK type=write size=2676903 2024-09-12T00:24:29.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.191+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~9B6P5K1C0VBR.0 size=83136 2024-09-12T00:24:29.190 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.191+0000 7f0d199128c0 1 > prepared multipart upload key=NXQYUQIR2APT upload=9B6P5K1C0VBR tag=PJBED8XWFV7W type=write size=1131712 2024-09-12T00:24:29.192 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.191+0000 7f0d199128c0 -1 < failed to complete operation key=WBGXMJB7U422 tag=CYLXPDW2J7NE type=del size=1823876: (22) Invalid argument 2024-09-12T00:24:29.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.195+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=U42H3DEJX8OW type=del size=474119 2024-09-12T00:24:29.201 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.203+0000 7f0d199128c0 1 < suggested update operation key=YTXW98O07966 tag=VXS6M7BAV1YZ type=write size=535937 2024-09-12T00:24:29.204 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.203+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=37RLVZ4RGTVX type=del size=11207 2024-09-12T00:24:29.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.207+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~3JOP4OLLAQBH.0 size=1048576 2024-09-12T00:24:29.209 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.207+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~3JOP4OLLAQBH.1 size=1048576 2024-09-12T00:24:29.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.211+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~3JOP4OLLAQBH.2 size=445727 2024-09-12T00:24:29.216 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.215+0000 7f0d199128c0 1 < completed multipart upload key=H604SA6XTFLY upload=3JOP4OLLAQBH tag=D5YCHND3AVMI type=write size=3591455 2024-09-12T00:24:29.220 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.219+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~6KQNW20VFGRT.0 size=912958 2024-09-12T00:24:29.221 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.219+0000 7f0d199128c0 1 > prepared multipart upload key=J75P0821XGRO upload=6KQNW20VFGRT tag=4RYHU5F45CVZ type=write size=1961534 2024-09-12T00:24:29.223 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.223+0000 7f0d199128c0 1 < completed delete operation key=PK2CA62QBZXS tag=5404OLWOBBBA type=del 2024-09-12T00:24:29.225 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.227+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=UA66RVYL4EJ6 type=del size=1094535 2024-09-12T00:24:29.228 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.227+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~A43928X5G5HN.0 size=1048576 2024-09-12T00:24:29.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.231+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~A43928X5G5HN.1 size=1048576 2024-09-12T00:24:29.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.231+0000 7f0d199128c0 1 < canceled part key=_multipart_SITJU2EUVSR8.2~A43928X5G5HN.2 size=208668 2024-09-12T00:24:29.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.235+0000 7f0d199128c0 1 < canceled multipart upload key=SITJU2EUVSR8 upload=A43928X5G5HN tag=8ZYE6PUSJZ9P type=write size=3354396 2024-09-12T00:24:29.237 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.235+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=QNT2T5ESD7PI type=del size=4113977 2024-09-12T00:24:29.239 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.239+0000 7f0d199128c0 1 < completed delete operation key=V6H6S9X0U2A0 tag=8RPR2JK24MBA type=del 2024-09-12T00:24:29.244 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.243+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~D8XA3MOROJFI.0 size=1048576 2024-09-12T00:24:29.246 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.247+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~D8XA3MOROJFI.1 size=727343 2024-09-12T00:24:29.247 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.247+0000 7f0d199128c0 1 > prepared multipart upload key=A529WOKFD1NI upload=D8XA3MOROJFI tag=JAZO3RNAIVOO type=write size=2824495 2024-09-12T00:24:29.248 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.247+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~UYXSUHKA3NCX.0 size=1048576 2024-09-12T00:24:29.250 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.251+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~UYXSUHKA3NCX.1 size=319274 2024-09-12T00:24:29.254 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.255+0000 7f0d199128c0 1 < completed multipart upload key=0ZT4NZYZKI5Z upload=UYXSUHKA3NCX tag=CR0M2Y0G43O5 type=write size=2416426 2024-09-12T00:24:29.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.259+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~TD2NJOG0KE3Z.0 size=1048576 2024-09-12T00:24:29.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.259+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~TD2NJOG0KE3Z.1 size=514693 2024-09-12T00:24:29.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.259+0000 7f0d199128c0 1 > prepared multipart upload key=GH0FNY2AI00G upload=TD2NJOG0KE3Z tag=OPW3QS2RY358 type=write size=2611845 2024-09-12T00:24:29.264 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.263+0000 7f0d199128c0 1 < completed write operation key=QUO5ND3O41TY tag=M087VVEN3YW0 type=write size=334440 2024-09-12T00:24:29.268 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.267+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~RI5WUHK8BDPA.0 size=1048576 2024-09-12T00:24:29.270 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.271+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~RI5WUHK8BDPA.1 size=1048576 2024-09-12T00:24:29.272 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.271+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~RI5WUHK8BDPA.2 size=304581 2024-09-12T00:24:29.272 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.271+0000 7f0d199128c0 1 > prepared multipart upload key=NXQYUQIR2APT upload=RI5WUHK8BDPA tag=2V4R0UYKCF35 type=write size=3450309 2024-09-12T00:24:29.275 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.275+0000 7f0d199128c0 1 < completed delete operation key=VXZI0ZTMQSV0 tag=1UERS1W95E8Z type=del 2024-09-12T00:24:29.278 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.279+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=UHIWHUWTTDXQ type=del size=2073940 2024-09-12T00:24:29.280 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.279+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~8FF8MWFMGG2X.0 size=507903 2024-09-12T00:24:29.285 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.283+0000 7f0d199128c0 1 < completed multipart upload key=WPZOKZDFXK4S upload=8FF8MWFMGG2X tag=MKOJI306R2SX type=write size=1556479 2024-09-12T00:24:29.289 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.291+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~Q6G6FTHVEF61.0 size=1048576 2024-09-12T00:24:29.291 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.291+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~Q6G6FTHVEF61.1 size=1048576 2024-09-12T00:24:29.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.291+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~Q6G6FTHVEF61.2 size=902034 2024-09-12T00:24:29.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.291+0000 7f0d199128c0 1 > prepared multipart upload key=WPZOKZDFXK4S upload=Q6G6FTHVEF61 tag=TBZ6Y5O3GZEM type=write size=4047762 2024-09-12T00:24:29.296 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.295+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~NDI17B523XGC.0 size=764268 2024-09-12T00:24:29.299 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.299+0000 7f0d199128c0 1 < completed multipart upload key=HXNC728XIWC1 upload=NDI17B523XGC tag=78D2UT3E8K6Q type=write size=1812844 2024-09-12T00:24:29.302 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.303+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=91S5PZDWX36M type=del size=2925611 2024-09-12T00:24:29.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.307+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~95U37G17OZ93.0 size=1048576 2024-09-12T00:24:29.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.311+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~95U37G17OZ93.1 size=1048576 2024-09-12T00:24:29.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.311+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~95U37G17OZ93.2 size=774281 2024-09-12T00:24:29.316 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.315+0000 7f0d199128c0 1 < completed multipart upload key=IPJEXRBN96NB upload=95U37G17OZ93 tag=Q40HFZJL0N9C type=write size=3920009 2024-09-12T00:24:29.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.319+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~0FK0D45ZQUCL.0 size=730763 2024-09-12T00:24:29.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.319+0000 7f0d199128c0 1 > prepared multipart upload key=GH0FNY2AI00G upload=0FK0D45ZQUCL tag=8WN43YC13LNG type=write size=1779339 2024-09-12T00:24:29.324 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.323+0000 7f0d199128c0 1 < canceled operation key=FJ8YV026H0ZU tag=YJR8L6N47930 type=del size=360239 2024-09-12T00:24:29.328 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.327+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~1RC3O0YE9R9R.0 size=1048576 2024-09-12T00:24:29.330 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.331+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~1RC3O0YE9R9R.1 size=1040189 2024-09-12T00:24:29.330 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.331+0000 7f0d199128c0 1 > prepared multipart upload key=VXZI0ZTMQSV0 upload=1RC3O0YE9R9R tag=S6CJWWX4B5LK type=write size=3137341 2024-09-12T00:24:29.333 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.331+0000 7f0d199128c0 1 < canceled operation key=57W1IO3KSWBR tag=8EN0HAVX17SH type=del size=116446 2024-09-12T00:24:29.337 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.335+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~JNYYCB9Q05J0.0 size=1048576 2024-09-12T00:24:29.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.339+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~JNYYCB9Q05J0.1 size=1048040 2024-09-12T00:24:29.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.339+0000 7f0d199128c0 1 > prepared multipart upload key=37WTPAJGOX5L upload=JNYYCB9Q05J0 tag=K2GRP26NINZ7 type=write size=3145192 2024-09-12T00:24:29.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.343+0000 7f0d199128c0 1 < completed delete operation key=H604SA6XTFLY tag=LQQ5A36159LG type=del 2024-09-12T00:24:29.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.347+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~BBD60HCSEP6L.0 size=1048576 2024-09-12T00:24:29.348 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.347+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~BBD60HCSEP6L.1 size=1007726 2024-09-12T00:24:29.348 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.347+0000 7f0d199128c0 1 > prepared multipart upload key=37WTPAJGOX5L upload=BBD60HCSEP6L tag=XNVENM8Q3D3F type=write size=3104878 2024-09-12T00:24:29.350 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.351+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~9B6P5K1C0VBR.0 size=83136 2024-09-12T00:24:29.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.355+0000 7f0d199128c0 1 < completed multipart upload key=NXQYUQIR2APT upload=9B6P5K1C0VBR tag=PJBED8XWFV7W type=write size=1131712 2024-09-12T00:24:29.359 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.359+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~YFK840ZG8TMF.0 size=1048576 2024-09-12T00:24:29.361 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.363+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~YFK840ZG8TMF.1 size=1048576 2024-09-12T00:24:29.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.363+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~YFK840ZG8TMF.2 size=350962 2024-09-12T00:24:29.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.363+0000 7f0d199128c0 1 > prepared multipart upload key=H604SA6XTFLY upload=YFK840ZG8TMF tag=HH5MYFCK4F8T type=write size=3496690 2024-09-12T00:24:29.369 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.371+0000 7f0d199128c0 1 < suggested remove operation key=T6GOR4SBYU2Y tag=U42H3DEJX8OW type=del 2024-09-12T00:24:29.372 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.371+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=1AP7UTZUJOS2 type=del size=3882049 2024-09-12T00:24:29.375 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.375+0000 7f0d199128c0 1 < completed delete operation key=RFCHRGVA9GOI tag=37RLVZ4RGTVX type=del 2024-09-12T00:24:29.378 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.379+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=RXAITBYQXNE7 type=del size=731560 2024-09-12T00:24:29.381 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.379+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~6KQNW20VFGRT.0 size=912958 2024-09-12T00:24:29.385 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.387+0000 7f0d199128c0 1 < completed multipart upload key=J75P0821XGRO upload=6KQNW20VFGRT tag=4RYHU5F45CVZ type=write size=1961534 2024-09-12T00:24:29.391 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.391+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~OP686E9WKA92.0 size=92439 2024-09-12T00:24:29.391 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.391+0000 7f0d199128c0 1 > prepared multipart upload key=V6H6S9X0U2A0 upload=OP686E9WKA92 tag=EBBW8FRTJ1PR type=write size=1141015 2024-09-12T00:24:29.396 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.395+0000 7f0d199128c0 1 < suggested remove operation key=HXNC728XIWC1 tag=UA66RVYL4EJ6 type=del 2024-09-12T00:24:29.399 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.399+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=IRYVHH6DI2Q7 type=del size=3586080 2024-09-12T00:24:29.402 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.403+0000 7f0d199128c0 1 < completed delete operation key=VXZI0ZTMQSV0 tag=QNT2T5ESD7PI type=del 2024-09-12T00:24:29.407 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.407+0000 7f0d199128c0 1 > prepared part key=_multipart_RFCHRGVA9GOI.2~LHI43KRMHK55.0 size=195938 2024-09-12T00:24:29.407 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.407+0000 7f0d199128c0 1 > prepared multipart upload key=RFCHRGVA9GOI upload=LHI43KRMHK55 tag=I26ZJYEN6AOU type=write size=1244514 2024-09-12T00:24:29.410 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.411+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~D8XA3MOROJFI.0 size=1048576 2024-09-12T00:24:29.412 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.411+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~D8XA3MOROJFI.1 size=727343 2024-09-12T00:24:29.417 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.415+0000 7f0d199128c0 1 < completed multipart upload key=A529WOKFD1NI upload=D8XA3MOROJFI tag=JAZO3RNAIVOO type=write size=2824495 2024-09-12T00:24:29.422 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.423+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~06FLN8NVG0M4.0 size=870409 2024-09-12T00:24:29.422 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.423+0000 7f0d199128c0 1 > prepared multipart upload key=A529WOKFD1NI upload=06FLN8NVG0M4 tag=CK7Q0F5WZG9T type=write size=1918985 2024-09-12T00:24:29.424 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.423+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~TD2NJOG0KE3Z.0 size=1048576 2024-09-12T00:24:29.427 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.427+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~TD2NJOG0KE3Z.1 size=514693 2024-09-12T00:24:29.432 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.431+0000 7f0d199128c0 1 < completed multipart upload key=GH0FNY2AI00G upload=TD2NJOG0KE3Z tag=OPW3QS2RY358 type=write size=2611845 2024-09-12T00:24:29.439 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.439+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~9T5GLZU9GNEY.0 size=1048576 2024-09-12T00:24:29.442 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.443+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~9T5GLZU9GNEY.1 size=894085 2024-09-12T00:24:29.442 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.443+0000 7f0d199128c0 1 > prepared multipart upload key=T6GOR4SBYU2Y upload=9T5GLZU9GNEY tag=EUCHOZWRWWSY type=write size=2991237 2024-09-12T00:24:29.445 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.443+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~RI5WUHK8BDPA.0 size=1048576 2024-09-12T00:24:29.448 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.447+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~RI5WUHK8BDPA.1 size=1048576 2024-09-12T00:24:29.450 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.451+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~RI5WUHK8BDPA.2 size=304581 2024-09-12T00:24:29.456 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.455+0000 7f0d199128c0 1 < completed multipart upload key=NXQYUQIR2APT upload=RI5WUHK8BDPA tag=2V4R0UYKCF35 type=write size=3450309 2024-09-12T00:24:29.460 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.459+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=7OQ3X6P2GE4F type=del size=3125011 2024-09-12T00:24:29.464 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.463+0000 7f0d199128c0 1 < completed delete operation key=4K654PSDLDVI tag=UHIWHUWTTDXQ type=del 2024-09-12T00:24:29.470 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.471+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~3GCTEVR4QNZ9.0 size=1048576 2024-09-12T00:24:29.473 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.471+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~3GCTEVR4QNZ9.1 size=1048576 2024-09-12T00:24:29.475 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.475+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~3GCTEVR4QNZ9.2 size=729357 2024-09-12T00:24:29.475 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.475+0000 7f0d199128c0 1 > prepared multipart upload key=VXZI0ZTMQSV0 upload=3GCTEVR4QNZ9 tag=68N8DLV54HI3 type=write size=3875085 2024-09-12T00:24:29.478 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.479+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~Q6G6FTHVEF61.0 size=1048576 2024-09-12T00:24:29.480 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.479+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~Q6G6FTHVEF61.1 size=1048576 2024-09-12T00:24:29.483 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.483+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~Q6G6FTHVEF61.2 size=902034 2024-09-12T00:24:29.488 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.487+0000 7f0d199128c0 1 < completed multipart upload key=WPZOKZDFXK4S upload=Q6G6FTHVEF61 tag=TBZ6Y5O3GZEM type=write size=4047762 2024-09-12T00:24:29.493 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.495+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~M9BM9NOTS91Y.0 size=1048576 2024-09-12T00:24:29.496 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.495+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~M9BM9NOTS91Y.1 size=1048576 2024-09-12T00:24:29.499 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.499+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~M9BM9NOTS91Y.2 size=252491 2024-09-12T00:24:29.499 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.499+0000 7f0d199128c0 1 > prepared multipart upload key=SITJU2EUVSR8 upload=M9BM9NOTS91Y tag=LZ0P8GE72MHY type=write size=3398219 2024-09-12T00:24:29.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.503+0000 7f0d199128c0 1 < completed delete operation key=1Y6B1MJP5G4L tag=91S5PZDWX36M type=del 2024-09-12T00:24:29.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.507+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=SHCVL1NXUBIS type=write size=334022 2024-09-12T00:24:29.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.511+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~0FK0D45ZQUCL.0 size=730763 2024-09-12T00:24:29.515 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.515+0000 7f0d199128c0 1 < completed multipart upload key=GH0FNY2AI00G upload=0FK0D45ZQUCL tag=8WN43YC13LNG type=write size=1779339 2024-09-12T00:24:29.519 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.519+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=70N20A13ARON type=del size=3190897 2024-09-12T00:24:29.522 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.523+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~1RC3O0YE9R9R.0 size=1048576 2024-09-12T00:24:29.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.527+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~1RC3O0YE9R9R.1 size=1040189 2024-09-12T00:24:29.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.531+0000 7f0d199128c0 1 < completed multipart upload key=VXZI0ZTMQSV0 upload=1RC3O0YE9R9R tag=S6CJWWX4B5LK type=write size=3137341 2024-09-12T00:24:29.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.535+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=ZCD5637Q5ZK4 type=del size=1599840 2024-09-12T00:24:29.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.539+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~JNYYCB9Q05J0.0 size=1048576 2024-09-12T00:24:29.541 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.539+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~JNYYCB9Q05J0.1 size=1048040 2024-09-12T00:24:29.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.547+0000 7f0d199128c0 1 < completed multipart upload key=37WTPAJGOX5L upload=JNYYCB9Q05J0 tag=K2GRP26NINZ7 type=write size=3145192 2024-09-12T00:24:29.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.551+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=414GFE8RFH9O type=del size=1082393 2024-09-12T00:24:29.554 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.555+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~BBD60HCSEP6L.0 size=1048576 2024-09-12T00:24:29.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.555+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~BBD60HCSEP6L.1 size=1007726 2024-09-12T00:24:29.563 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.563+0000 7f0d199128c0 1 < completed multipart upload key=37WTPAJGOX5L upload=BBD60HCSEP6L tag=XNVENM8Q3D3F type=write size=3104878 2024-09-12T00:24:29.567 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.567+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=GYGOOXWVT4RZ type=del size=642321 2024-09-12T00:24:29.571 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.571+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~YFK840ZG8TMF.0 size=1048576 2024-09-12T00:24:29.571 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.571+0000 7f0d199128c0 1 < canceled part key=_multipart_H604SA6XTFLY.2~YFK840ZG8TMF.1 size=1048576 2024-09-12T00:24:29.573 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.575+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~YFK840ZG8TMF.2 size=350962 2024-09-12T00:24:29.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.579+0000 7f0d199128c0 1 < canceled multipart upload key=H604SA6XTFLY upload=YFK840ZG8TMF tag=HH5MYFCK4F8T type=write size=3496690 2024-09-12T00:24:29.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.591+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~2WWNZKHHQ03E.0 size=1048576 2024-09-12T00:24:29.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.591+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~2WWNZKHHQ03E.1 size=1048576 2024-09-12T00:24:29.595 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.595+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~2WWNZKHHQ03E.2 size=461095 2024-09-12T00:24:29.595 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.595+0000 7f0d199128c0 1 > prepared multipart upload key=QUO5ND3O41TY upload=2WWNZKHHQ03E tag=G43T1L3DJH44 type=write size=3606823 2024-09-12T00:24:29.598 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.599+0000 7f0d199128c0 1 < completed delete operation key=2EK9CCKG26W2 tag=1AP7UTZUJOS2 type=del 2024-09-12T00:24:29.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.603+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~WIKYP5XOZOOR.0 size=1048576 2024-09-12T00:24:29.606 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.607+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~WIKYP5XOZOOR.1 size=1048576 2024-09-12T00:24:29.609 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.607+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~WIKYP5XOZOOR.2 size=687849 2024-09-12T00:24:29.609 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.607+0000 7f0d199128c0 1 > prepared multipart upload key=PK2CA62QBZXS upload=WIKYP5XOZOOR tag=JBUJI3XGR8TW type=write size=3833577 2024-09-12T00:24:29.612 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.611+0000 7f0d199128c0 1 < completed delete operation key=IPJEXRBN96NB tag=RXAITBYQXNE7 type=del 2024-09-12T00:24:29.615 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.615+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=1HW1X0J9OCJA type=del size=77532 2024-09-12T00:24:29.615 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.615+0000 7f0d199128c0 1 < canceled part key=_multipart_V6H6S9X0U2A0.2~OP686E9WKA92.0 size=92439 2024-09-12T00:24:29.620 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.619+0000 7f0d199128c0 1 < canceled multipart upload key=V6H6S9X0U2A0 upload=OP686E9WKA92 tag=EBBW8FRTJ1PR type=write size=1141015 2024-09-12T00:24:29.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.627+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~V0QPE1KVURM7.0 size=1048576 2024-09-12T00:24:29.628 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.627+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~V0QPE1KVURM7.1 size=574092 2024-09-12T00:24:29.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.627+0000 7f0d199128c0 1 > prepared multipart upload key=B58RWC9W8THG upload=V0QPE1KVURM7 tag=DI0HKW7PLDZQ type=write size=2671244 2024-09-12T00:24:29.632 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.631+0000 7f0d199128c0 1 < canceled operation key=OVLAP0OS78QG tag=IRYVHH6DI2Q7 type=del size=3586080 2024-09-12T00:24:29.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.635+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=25HTOWH3I60S type=del size=1696144 2024-09-12T00:24:29.637 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.635+0000 7f0d199128c0 1 < completed part key=_multipart_RFCHRGVA9GOI.2~LHI43KRMHK55.0 size=195938 2024-09-12T00:24:29.642 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.643+0000 7f0d199128c0 1 < completed multipart upload key=RFCHRGVA9GOI upload=LHI43KRMHK55 tag=I26ZJYEN6AOU type=write size=1244514 2024-09-12T00:24:29.647 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.647+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~J1H883AYZSNW.0 size=1048576 2024-09-12T00:24:29.650 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.651+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~J1H883AYZSNW.1 size=606719 2024-09-12T00:24:29.650 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.651+0000 7f0d199128c0 1 > prepared multipart upload key=OVLAP0OS78QG upload=J1H883AYZSNW tag=FDSMBKIRPUWY type=write size=2703871 2024-09-12T00:24:29.653 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.651+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~06FLN8NVG0M4.0 size=870409 2024-09-12T00:24:29.658 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.659+0000 7f0d199128c0 1 < completed multipart upload key=A529WOKFD1NI upload=06FLN8NVG0M4 tag=CK7Q0F5WZG9T type=write size=1918985 2024-09-12T00:24:29.663 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.663+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~I995TW75Q4RB.0 size=1048576 2024-09-12T00:24:29.666 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.667+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~I995TW75Q4RB.1 size=1048576 2024-09-12T00:24:29.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.667+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~I995TW75Q4RB.2 size=475493 2024-09-12T00:24:29.669 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.667+0000 7f0d199128c0 1 > prepared multipart upload key=WBGXMJB7U422 upload=I995TW75Q4RB tag=D56A8AUKNI8D type=write size=3621221 2024-09-12T00:24:29.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.671+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~9T5GLZU9GNEY.0 size=1048576 2024-09-12T00:24:29.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.675+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~9T5GLZU9GNEY.1 size=894085 2024-09-12T00:24:29.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.679+0000 7f0d199128c0 1 < completed multipart upload key=T6GOR4SBYU2Y upload=9T5GLZU9GNEY tag=EUCHOZWRWWSY type=write size=2991237 2024-09-12T00:24:29.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.683+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=WBM1K0N06SW5 type=del size=3684816 2024-09-12T00:24:29.687 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.687+0000 7f0d199128c0 1 < completed delete operation key=OVLAP0OS78QG tag=7OQ3X6P2GE4F type=del 2024-09-12T00:24:29.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.691+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~98H506C09H6P.0 size=373203 2024-09-12T00:24:29.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.691+0000 7f0d199128c0 1 > prepared multipart upload key=RX3RVT06SGJ4 upload=98H506C09H6P tag=1DNGWO1ZIFLL type=write size=1421779 2024-09-12T00:24:29.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.695+0000 7f0d199128c0 1 < canceled part key=_multipart_VXZI0ZTMQSV0.2~3GCTEVR4QNZ9.0 size=1048576 2024-09-12T00:24:29.696 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.695+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~3GCTEVR4QNZ9.1 size=1048576 2024-09-12T00:24:29.696 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.695+0000 7f0d199128c0 1 < canceled part key=_multipart_VXZI0ZTMQSV0.2~3GCTEVR4QNZ9.2 size=729357 2024-09-12T00:24:29.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.703+0000 7f0d199128c0 1 < canceled multipart upload key=VXZI0ZTMQSV0 upload=3GCTEVR4QNZ9 tag=68N8DLV54HI3 type=write size=3875085 2024-09-12T00:24:29.706 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.707+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=7HT0OW43PC6Y type=del size=1992359 2024-09-12T00:24:29.708 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.707+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~M9BM9NOTS91Y.0 size=1048576 2024-09-12T00:24:29.710 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.711+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~M9BM9NOTS91Y.1 size=1048576 2024-09-12T00:24:29.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.711+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~M9BM9NOTS91Y.2 size=252491 2024-09-12T00:24:29.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.719+0000 7f0d199128c0 1 < completed multipart upload key=SITJU2EUVSR8 upload=M9BM9NOTS91Y tag=LZ0P8GE72MHY type=write size=3398219 2024-09-12T00:24:29.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.723+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~NXPB6EZ3171X.0 size=313137 2024-09-12T00:24:29.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.723+0000 7f0d199128c0 1 > prepared multipart upload key=10YEWZDTTEV0 upload=NXPB6EZ3171X tag=6IWTRGC6M5OE type=write size=1361713 2024-09-12T00:24:29.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.727+0000 7f0d199128c0 1 < completed write operation key=0ZT4NZYZKI5Z tag=SHCVL1NXUBIS type=write size=334022 2024-09-12T00:24:29.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.731+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=Q2IQ961AM00E type=del size=2586150 2024-09-12T00:24:29.732 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.731+0000 7f0d199128c0 1 < completed delete operation key=WBGXMJB7U422 tag=70N20A13ARON type=del 2024-09-12T00:24:29.735 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.735+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=EGQVSABY6ABN type=del size=3769005 2024-09-12T00:24:29.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.739+0000 7f0d199128c0 1 < suggested remove operation key=10YEWZDTTEV0 tag=ZCD5637Q5ZK4 type=del 2024-09-12T00:24:29.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.743+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=1IOABY5R81U7 type=del size=1898870 2024-09-12T00:24:29.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.747+0000 7f0d199128c0 -1 < no bi entry to suggest for operation key=10YEWZDTTEV0 tag=414GFE8RFH9O type=del size=1082393: (2) No such file or directory 2024-09-12T00:24:29.752 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.751+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~U2TICBZPIWYG.0 size=819923 2024-09-12T00:24:29.752 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.751+0000 7f0d199128c0 1 > prepared multipart upload key=VXZI0ZTMQSV0 upload=U2TICBZPIWYG tag=G3RO5OXMJUDT type=write size=1868499 2024-09-12T00:24:29.755 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.755+0000 7f0d199128c0 1 < completed delete operation key=V6H6S9X0U2A0 tag=GYGOOXWVT4RZ type=del 2024-09-12T00:24:29.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.759+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~AS9VU2TBSBY1.0 size=1048576 2024-09-12T00:24:29.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.763+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~AS9VU2TBSBY1.1 size=1048576 2024-09-12T00:24:29.766 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.767+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~AS9VU2TBSBY1.2 size=139172 2024-09-12T00:24:29.767 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.767+0000 7f0d199128c0 1 > prepared multipart upload key=T6GOR4SBYU2Y upload=AS9VU2TBSBY1 tag=H8JKWGY4VAEE type=write size=3284900 2024-09-12T00:24:29.770 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.771+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~2WWNZKHHQ03E.0 size=1048576 2024-09-12T00:24:29.772 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.771+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~2WWNZKHHQ03E.1 size=1048576 2024-09-12T00:24:29.774 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.775+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~2WWNZKHHQ03E.2 size=461095 2024-09-12T00:24:29.780 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.779+0000 7f0d199128c0 1 < completed multipart upload key=QUO5ND3O41TY upload=2WWNZKHHQ03E tag=G43T1L3DJH44 type=write size=3606823 2024-09-12T00:24:29.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.787+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~H975W7MKBWVR.0 size=1048576 2024-09-12T00:24:29.788 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.787+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~H975W7MKBWVR.1 size=1048576 2024-09-12T00:24:29.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.791+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~H975W7MKBWVR.2 size=83014 2024-09-12T00:24:29.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.791+0000 7f0d199128c0 1 > prepared multipart upload key=IPJEXRBN96NB upload=H975W7MKBWVR tag=ZU8BGCCB0UVM type=write size=3228742 2024-09-12T00:24:29.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.795+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~WIKYP5XOZOOR.0 size=1048576 2024-09-12T00:24:29.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.795+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~WIKYP5XOZOOR.1 size=1048576 2024-09-12T00:24:29.799 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.799+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~WIKYP5XOZOOR.2 size=687849 2024-09-12T00:24:29.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.803+0000 7f0d199128c0 1 < completed multipart upload key=PK2CA62QBZXS upload=WIKYP5XOZOOR tag=JBUJI3XGR8TW type=write size=3833577 2024-09-12T00:24:29.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.807+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=QJ2X6YLKG19R type=del size=2434576 2024-09-12T00:24:29.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.811+0000 7f0d199128c0 1 < completed delete operation key=OVLAP0OS78QG tag=1HW1X0J9OCJA type=del 2024-09-12T00:24:29.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.815+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~EU4CEHI78VKX.0 size=1048576 2024-09-12T00:24:29.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.815+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~EU4CEHI78VKX.1 size=583219 2024-09-12T00:24:29.817 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.815+0000 7f0d199128c0 1 > prepared multipart upload key=2EK9CCKG26W2 upload=EU4CEHI78VKX tag=3RBX4RF8EUNN type=write size=2680371 2024-09-12T00:24:29.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.819+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~V0QPE1KVURM7.0 size=1048576 2024-09-12T00:24:29.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.823+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~V0QPE1KVURM7.1 size=574092 2024-09-12T00:24:29.828 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.827+0000 7f0d199128c0 1 < completed multipart upload key=B58RWC9W8THG upload=V0QPE1KVURM7 tag=DI0HKW7PLDZQ type=write size=2671244 2024-09-12T00:24:29.831 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.831+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=8UPFKMMD7YGK type=del size=1353906 2024-09-12T00:24:29.837 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.835+0000 7f0d199128c0 1 < completed delete operation key=FJ8YV026H0ZU tag=25HTOWH3I60S type=del 2024-09-12T00:24:29.837 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.835+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=SQGF4NLN75XE type=write size=805412 2024-09-12T00:24:29.837 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.839+0000 7f0d199128c0 1 < canceled part key=_multipart_OVLAP0OS78QG.2~J1H883AYZSNW.0 size=1048576 2024-09-12T00:24:29.840 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.839+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~J1H883AYZSNW.1 size=606719 2024-09-12T00:24:29.844 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.843+0000 7f0d199128c0 1 < canceled multipart upload key=OVLAP0OS78QG upload=J1H883AYZSNW tag=FDSMBKIRPUWY type=write size=2703871 2024-09-12T00:24:29.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.847+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=DLWFD6BCZ0GM type=del size=3009378 2024-09-12T00:24:29.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.851+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~I995TW75Q4RB.0 size=1048576 2024-09-12T00:24:29.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.855+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~I995TW75Q4RB.1 size=1048576 2024-09-12T00:24:29.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.855+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~I995TW75Q4RB.2 size=475493 2024-09-12T00:24:29.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.859+0000 7f0d199128c0 1 < completed multipart upload key=WBGXMJB7U422 upload=I995TW75Q4RB tag=D56A8AUKNI8D type=write size=3621221 2024-09-12T00:24:29.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.871+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~VHGROEQ6LJRV.0 size=1048576 2024-09-12T00:24:29.874 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.875+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~VHGROEQ6LJRV.1 size=1048576 2024-09-12T00:24:29.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.875+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~VHGROEQ6LJRV.2 size=76181 2024-09-12T00:24:29.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.875+0000 7f0d199128c0 1 > prepared multipart upload key=A529WOKFD1NI upload=VHGROEQ6LJRV tag=SRO2IEW8CLJW type=write size=3221909 2024-09-12T00:24:29.885 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.883+0000 7f0d199128c0 1 < suggested remove operation key=IPJEXRBN96NB tag=WBM1K0N06SW5 type=del 2024-09-12T00:24:29.888 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.887+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=01WRCUM5T2SJ type=del size=3954445 2024-09-12T00:24:29.891 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.891+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~98H506C09H6P.0 size=373203 2024-09-12T00:24:29.897 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.895+0000 7f0d199128c0 1 < completed multipart upload key=RX3RVT06SGJ4 upload=98H506C09H6P tag=1DNGWO1ZIFLL type=write size=1421779 2024-09-12T00:24:29.903 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.903+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~BSMPRE7FH0XG.0 size=1048576 2024-09-12T00:24:29.906 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.907+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~BSMPRE7FH0XG.1 size=107781 2024-09-12T00:24:29.906 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.907+0000 7f0d199128c0 1 > prepared multipart upload key=57W1IO3KSWBR upload=BSMPRE7FH0XG tag=OAVPMHWNOAWF type=write size=2204933 2024-09-12T00:24:29.912 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.911+0000 7f0d199128c0 1 < suggested update operation key=T6GOR4SBYU2Y tag=7HT0OW43PC6Y type=del size=1992359 2024-09-12T00:24:29.916 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.915+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=8E3786IQRZ7N type=del size=2131534 2024-09-12T00:24:29.919 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.919+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~NXPB6EZ3171X.0 size=313137 2024-09-12T00:24:29.925 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.923+0000 7f0d199128c0 1 < completed multipart upload key=10YEWZDTTEV0 upload=NXPB6EZ3171X tag=6IWTRGC6M5OE type=write size=1361713 2024-09-12T00:24:29.930 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.931+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~P4FH99K9HDXC.0 size=1048576 2024-09-12T00:24:29.932 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.931+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~P4FH99K9HDXC.1 size=186351 2024-09-12T00:24:29.933 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.931+0000 7f0d199128c0 1 > prepared multipart upload key=0ZT4NZYZKI5Z upload=P4FH99K9HDXC tag=ZQEAG3ZTCR2L type=write size=2283503 2024-09-12T00:24:29.936 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.935+0000 7f0d199128c0 1 < completed delete operation key=J75P0821XGRO tag=Q2IQ961AM00E type=del 2024-09-12T00:24:29.942 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.943+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~RM0PSIY5O22S.0 size=1048576 2024-09-12T00:24:29.945 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.943+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~RM0PSIY5O22S.1 size=1048576 2024-09-12T00:24:29.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.947+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~RM0PSIY5O22S.2 size=742333 2024-09-12T00:24:29.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.947+0000 7f0d199128c0 1 > prepared multipart upload key=2EK9CCKG26W2 upload=RM0PSIY5O22S tag=JADO5LKV5LJG type=write size=3888061 2024-09-12T00:24:29.951 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.951+0000 7f0d199128c0 1 < completed delete operation key=WBGXMJB7U422 tag=EGQVSABY6ABN type=del 2024-09-12T00:24:29.954 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.955+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=IQ919TDBFX06 type=write size=651351 2024-09-12T00:24:29.957 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.959+0000 7f0d199128c0 1 < completed delete operation key=2EK9CCKG26W2 tag=1IOABY5R81U7 type=del 2024-09-12T00:24:29.961 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.959+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=M53D84044ABF type=write size=887528 2024-09-12T00:24:29.964 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.963+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~U2TICBZPIWYG.0 size=819923 2024-09-12T00:24:29.969 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.971+0000 7f0d199128c0 1 < completed multipart upload key=VXZI0ZTMQSV0 upload=U2TICBZPIWYG tag=G3RO5OXMJUDT type=write size=1868499 2024-09-12T00:24:29.972 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.971+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=1DQ0WQOSLKSQ type=del size=2637256 2024-09-12T00:24:29.975 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.975+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~AS9VU2TBSBY1.0 size=1048576 2024-09-12T00:24:29.978 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.979+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~AS9VU2TBSBY1.1 size=1048576 2024-09-12T00:24:29.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.979+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~AS9VU2TBSBY1.2 size=139172 2024-09-12T00:24:29.987 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.987+0000 7f0d199128c0 1 < completed multipart upload key=T6GOR4SBYU2Y upload=AS9VU2TBSBY1 tag=H8JKWGY4VAEE type=write size=3284900 2024-09-12T00:24:29.990 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.991+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=YQYV7H3I3L9P type=del size=1961451 2024-09-12T00:24:29.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.995+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~H975W7MKBWVR.0 size=1048576 2024-09-12T00:24:29.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.995+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~H975W7MKBWVR.1 size=1048576 2024-09-12T00:24:29.999 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:29.999+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~H975W7MKBWVR.2 size=83014 2024-09-12T00:24:30.005 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.003+0000 7f0d199128c0 1 < completed multipart upload key=IPJEXRBN96NB upload=H975W7MKBWVR tag=ZU8BGCCB0UVM type=write size=3228742 2024-09-12T00:24:30.008 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.007+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=D9LV110KJEZQ type=write size=227516 2024-09-12T00:24:30.012 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.011+0000 7f0d199128c0 1 < completed delete operation key=HXNC728XIWC1 tag=QJ2X6YLKG19R type=del 2024-09-12T00:24:30.015 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.015+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=Q0OGNPI6DEPQ type=del size=1613657 2024-09-12T00:24:30.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.019+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~EU4CEHI78VKX.0 size=1048576 2024-09-12T00:24:30.021 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.019+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~EU4CEHI78VKX.1 size=583219 2024-09-12T00:24:30.027 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.027+0000 7f0d199128c0 1 < completed multipart upload key=2EK9CCKG26W2 upload=EU4CEHI78VKX tag=3RBX4RF8EUNN type=write size=2680371 2024-09-12T00:24:30.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.031+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~ZG2AB34Y7M4Z.0 size=1048576 2024-09-12T00:24:30.035 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.035+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~ZG2AB34Y7M4Z.1 size=651673 2024-09-12T00:24:30.035 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.035+0000 7f0d199128c0 1 > prepared multipart upload key=RX3RVT06SGJ4 upload=ZG2AB34Y7M4Z tag=GA6ZB6HH74W2 type=write size=2748825 2024-09-12T00:24:30.041 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.039+0000 7f0d199128c0 1 < completed delete operation key=J75P0821XGRO tag=8UPFKMMD7YGK type=del 2024-09-12T00:24:30.043 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.043+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~PLLGGO982RJQ.0 size=1048576 2024-09-12T00:24:30.046 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.047+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~PLLGGO982RJQ.1 size=1048576 2024-09-12T00:24:30.048 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.047+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~PLLGGO982RJQ.2 size=362595 2024-09-12T00:24:30.048 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.047+0000 7f0d199128c0 1 > prepared multipart upload key=4K654PSDLDVI upload=PLLGGO982RJQ tag=6APETZF62DSR type=write size=3508323 2024-09-12T00:24:30.051 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.051+0000 7f0d199128c0 -1 < failed to complete operation key=T6GOR4SBYU2Y tag=SQGF4NLN75XE type=write size=805412: (22) Invalid argument 2024-09-12T00:24:30.054 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.055+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=MG19DMIUDS1Q type=del size=2370502 2024-09-12T00:24:30.060 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.059+0000 7f0d199128c0 1 < suggested remove operation key=10YEWZDTTEV0 tag=DLWFD6BCZ0GM type=del 2024-09-12T00:24:30.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.063+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=0T25BUCXDL9Z type=del size=2352206 2024-09-12T00:24:30.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.067+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~VHGROEQ6LJRV.0 size=1048576 2024-09-12T00:24:30.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.067+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~VHGROEQ6LJRV.1 size=1048576 2024-09-12T00:24:30.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.071+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~VHGROEQ6LJRV.2 size=76181 2024-09-12T00:24:30.077 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.075+0000 7f0d199128c0 1 < completed multipart upload key=A529WOKFD1NI upload=VHGROEQ6LJRV tag=SRO2IEW8CLJW type=write size=3221909 2024-09-12T00:24:30.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.079+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=Z5I66GPXIHU1 type=del size=3803606 2024-09-12T00:24:30.083 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.083+0000 7f0d199128c0 1 < completed delete operation key=OVLAP0OS78QG tag=01WRCUM5T2SJ type=del 2024-09-12T00:24:30.086 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.087+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=71AXY2AMPD2R type=del size=4136399 2024-09-12T00:24:30.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.091+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~BSMPRE7FH0XG.0 size=1048576 2024-09-12T00:24:30.092 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.091+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~BSMPRE7FH0XG.1 size=107781 2024-09-12T00:24:30.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.099+0000 7f0d199128c0 1 < completed multipart upload key=57W1IO3KSWBR upload=BSMPRE7FH0XG tag=OAVPMHWNOAWF type=write size=2204933 2024-09-12T00:24:30.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.103+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=4XCCJ76PQSFM type=del size=2966610 2024-09-12T00:24:30.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.107+0000 7f0d199128c0 1 < suggested remove operation key=IPJEXRBN96NB tag=8E3786IQRZ7N type=del 2024-09-12T00:24:30.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.111+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=QAKPO4SQQF2R type=del size=2720775 2024-09-12T00:24:30.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.115+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~P4FH99K9HDXC.0 size=1048576 2024-09-12T00:24:30.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.115+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~P4FH99K9HDXC.1 size=186351 2024-09-12T00:24:30.121 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.119+0000 7f0d199128c0 1 < completed multipart upload key=0ZT4NZYZKI5Z upload=P4FH99K9HDXC tag=ZQEAG3ZTCR2L type=write size=2283503 2024-09-12T00:24:30.126 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.127+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~WUUIIRHPBKD0.0 size=1048576 2024-09-12T00:24:30.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.127+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~WUUIIRHPBKD0.1 size=522962 2024-09-12T00:24:30.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.127+0000 7f0d199128c0 1 > prepared multipart upload key=WPZOKZDFXK4S upload=WUUIIRHPBKD0 tag=SUZYN5BQGA9L type=write size=2620114 2024-09-12T00:24:30.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.131+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~RM0PSIY5O22S.0 size=1048576 2024-09-12T00:24:30.135 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.135+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~RM0PSIY5O22S.1 size=1048576 2024-09-12T00:24:30.138 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.139+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~RM0PSIY5O22S.2 size=742333 2024-09-12T00:24:30.144 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.143+0000 7f0d199128c0 1 < completed multipart upload key=2EK9CCKG26W2 upload=RM0PSIY5O22S tag=JADO5LKV5LJG type=write size=3888061 2024-09-12T00:24:30.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.147+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=802NJI6DZWXN type=del size=583074 2024-09-12T00:24:30.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.151+0000 7f0d199128c0 1 < completed write operation key=A529WOKFD1NI tag=IQ919TDBFX06 type=write size=651351 2024-09-12T00:24:30.155 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.155+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=5KX6A5N76FL4 type=del size=3331702 2024-09-12T00:24:30.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.159+0000 7f0d199128c0 1 < completed write operation key=GH0FNY2AI00G tag=M53D84044ABF type=write size=887528 2024-09-12T00:24:30.162 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.163+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=CM8TAQNGFZKF type=del size=2825901 2024-09-12T00:24:30.165 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.163+0000 7f0d199128c0 1 < completed delete operation key=YTXW98O07966 tag=1DQ0WQOSLKSQ type=del 2024-09-12T00:24:30.168 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.167+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=E62KY4H4O0ZW type=del size=1566670 2024-09-12T00:24:30.177 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.175+0000 7f0d199128c0 1 < completed delete operation key=H604SA6XTFLY tag=YQYV7H3I3L9P type=del 2024-09-12T00:24:30.179 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.179+0000 7f0d199128c0 1 > prepared operation key=57W1IO3KSWBR tag=DRGNI6E64CKV type=del size=2223043 2024-09-12T00:24:30.183 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.183+0000 7f0d199128c0 1 < completed write operation key=SITJU2EUVSR8 tag=D9LV110KJEZQ type=write size=227516 2024-09-12T00:24:30.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.187+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=OA0P0US0S5QR type=del size=547507 2024-09-12T00:24:30.190 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.191+0000 7f0d199128c0 1 < completed delete operation key=YTXW98O07966 tag=Q0OGNPI6DEPQ type=del 2024-09-12T00:24:30.193 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.191+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=YXCYALKP1OIU type=write size=787401 2024-09-12T00:24:30.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.195+0000 7f0d199128c0 1 < canceled part key=_multipart_RX3RVT06SGJ4.2~ZG2AB34Y7M4Z.0 size=1048576 2024-09-12T00:24:30.196 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.195+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~ZG2AB34Y7M4Z.1 size=651673 2024-09-12T00:24:30.202 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.203+0000 7f0d199128c0 1 < canceled multipart upload key=RX3RVT06SGJ4 upload=ZG2AB34Y7M4Z tag=GA6ZB6HH74W2 type=write size=2748825 2024-09-12T00:24:30.209 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.207+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~SDGVZ5ITUNEG.0 size=588404 2024-09-12T00:24:30.209 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.207+0000 7f0d199128c0 1 > prepared multipart upload key=WPZOKZDFXK4S upload=SDGVZ5ITUNEG tag=UK38LBEN6XK1 type=write size=1636980 2024-09-12T00:24:30.212 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.211+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~PLLGGO982RJQ.0 size=1048576 2024-09-12T00:24:30.215 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.215+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~PLLGGO982RJQ.1 size=1048576 2024-09-12T00:24:30.217 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.219+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~PLLGGO982RJQ.2 size=362595 2024-09-12T00:24:30.223 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.223+0000 7f0d199128c0 1 < completed multipart upload key=4K654PSDLDVI upload=PLLGGO982RJQ tag=6APETZF62DSR type=write size=3508323 2024-09-12T00:24:30.227 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.227+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=T1V192M41BGR type=del size=3685390 2024-09-12T00:24:30.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.231+0000 7f0d199128c0 1 < completed delete operation key=A529WOKFD1NI tag=MG19DMIUDS1Q type=del 2024-09-12T00:24:30.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.235+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=0ZQCF1BJXDGU type=del size=3672961 2024-09-12T00:24:30.241 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.239+0000 7f0d199128c0 1 < suggested update operation key=4K654PSDLDVI tag=0T25BUCXDL9Z type=del size=2352206 2024-09-12T00:24:30.244 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.243+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=3SGWV39W8DWD type=del size=272665 2024-09-12T00:24:30.248 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.247+0000 7f0d199128c0 1 < completed delete operation key=A529WOKFD1NI tag=Z5I66GPXIHU1 type=del 2024-09-12T00:24:30.254 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.255+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~AC3HOKYVKW3L.0 size=1048576 2024-09-12T00:24:30.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.255+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~AC3HOKYVKW3L.1 size=1048576 2024-09-12T00:24:30.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.259+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~AC3HOKYVKW3L.2 size=897378 2024-09-12T00:24:30.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.259+0000 7f0d199128c0 1 > prepared multipart upload key=JA6CSJF78VE2 upload=AC3HOKYVKW3L tag=O6LD4TWA5MP8 type=write size=4043106 2024-09-12T00:24:30.262 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.263+0000 7f0d199128c0 1 < completed delete operation key=RFCHRGVA9GOI tag=71AXY2AMPD2R type=del 2024-09-12T00:24:30.266 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.267+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=910GHJK89PZ9 type=write size=453349 2024-09-12T00:24:30.269 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.267+0000 7f0d199128c0 1 < canceled operation key=QUO5ND3O41TY tag=4XCCJ76PQSFM type=del size=2966610 2024-09-12T00:24:30.272 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.271+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=NP6MD8797H69 type=del size=2884225 2024-09-12T00:24:30.275 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.275+0000 7f0d199128c0 1 < completed delete operation key=J75P0821XGRO tag=QAKPO4SQQF2R type=del 2024-09-12T00:24:30.279 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.279+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=C4J6XB9MOLA6 type=del size=70676 2024-09-12T00:24:30.282 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.283+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~WUUIIRHPBKD0.0 size=1048576 2024-09-12T00:24:30.285 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.283+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~WUUIIRHPBKD0.1 size=522962 2024-09-12T00:24:30.290 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.291+0000 7f0d199128c0 1 < completed multipart upload key=WPZOKZDFXK4S upload=WUUIIRHPBKD0 tag=SUZYN5BQGA9L type=write size=2620114 2024-09-12T00:24:30.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.295+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=ZGL0GS362UN6 type=del size=3361257 2024-09-12T00:24:30.297 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.299+0000 7f0d199128c0 1 < completed delete operation key=FJ8YV026H0ZU tag=802NJI6DZWXN type=del 2024-09-12T00:24:30.303 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.303+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~T0X3FOLSN5VP.0 size=1048576 2024-09-12T00:24:30.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.307+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~T0X3FOLSN5VP.1 size=1048576 2024-09-12T00:24:30.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.307+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~T0X3FOLSN5VP.2 size=538926 2024-09-12T00:24:30.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.307+0000 7f0d199128c0 1 > prepared multipart upload key=0ZT4NZYZKI5Z upload=T0X3FOLSN5VP tag=AD8WPJT8R1YV type=write size=3684654 2024-09-12T00:24:30.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.311+0000 7f0d199128c0 1 < completed delete operation key=2EK9CCKG26W2 tag=5KX6A5N76FL4 type=del 2024-09-12T00:24:30.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.315+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=CJATJO7YDBKU type=del size=3517301 2024-09-12T00:24:30.319 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.319+0000 7f0d199128c0 1 < completed delete operation key=0EBWUENN0881 tag=CM8TAQNGFZKF type=del 2024-09-12T00:24:30.322 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.323+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=6B07EIHNYB2Z type=del size=2373063 2024-09-12T00:24:30.325 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.327+0000 7f0d199128c0 1 < completed delete operation key=0EBWUENN0881 tag=E62KY4H4O0ZW type=del 2024-09-12T00:24:30.329 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.327+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=OXC31MLE3UMF type=del size=198580 2024-09-12T00:24:30.335 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.335+0000 7f0d199128c0 1 < suggested update operation key=57W1IO3KSWBR tag=DRGNI6E64CKV type=del size=2223043 2024-09-12T00:24:30.342 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.343+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~F4VEHU5PL4WF.0 size=1048576 2024-09-12T00:24:30.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.343+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~F4VEHU5PL4WF.1 size=583750 2024-09-12T00:24:30.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.343+0000 7f0d199128c0 1 > prepared multipart upload key=0ZT4NZYZKI5Z upload=F4VEHU5PL4WF tag=XT9KOUVKOJ2S type=write size=2680902 2024-09-12T00:24:30.347 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.347+0000 7f0d199128c0 1 < completed delete operation key=IPJEXRBN96NB tag=OA0P0US0S5QR type=del 2024-09-12T00:24:30.353 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.355+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~IXLKQK5DVSJN.0 size=1048576 2024-09-12T00:24:30.356 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.355+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~IXLKQK5DVSJN.1 size=241736 2024-09-12T00:24:30.356 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.355+0000 7f0d199128c0 1 > prepared multipart upload key=9I6MZAEUS4I0 upload=IXLKQK5DVSJN tag=H7UJ4C7LYWS9 type=write size=2338888 2024-09-12T00:24:30.360 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.359+0000 7f0d199128c0 1 < completed write operation key=WBGXMJB7U422 tag=YXCYALKP1OIU type=write size=787401 2024-09-12T00:24:30.363 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.363+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=6WK1YQXZSXNI type=del size=396412 2024-09-12T00:24:30.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.367+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~SDGVZ5ITUNEG.0 size=588404 2024-09-12T00:24:30.372 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.371+0000 7f0d199128c0 1 < completed multipart upload key=WPZOKZDFXK4S upload=SDGVZ5ITUNEG tag=UK38LBEN6XK1 type=write size=1636980 2024-09-12T00:24:30.378 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.379+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~0EK3XWG5NHSK.0 size=1048576 2024-09-12T00:24:30.381 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.379+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~0EK3XWG5NHSK.1 size=1048576 2024-09-12T00:24:30.383 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.383+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~0EK3XWG5NHSK.2 size=108419 2024-09-12T00:24:30.383 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.383+0000 7f0d199128c0 1 > prepared multipart upload key=HXNC728XIWC1 upload=0EK3XWG5NHSK tag=YDSJ26OA6VBY type=write size=3254147 2024-09-12T00:24:30.389 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.391+0000 7f0d199128c0 1 < suggested remove operation key=SITJU2EUVSR8 tag=T1V192M41BGR type=del 2024-09-12T00:24:30.393 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.391+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=GAFOWFLY34OW type=del size=2160921 2024-09-12T00:24:30.401 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.399+0000 7f0d199128c0 1 < suggested update operation key=RX3RVT06SGJ4 tag=0ZQCF1BJXDGU type=del size=3672961 2024-09-12T00:24:30.405 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.403+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=AK582Z9SAM3W type=del size=4116029 2024-09-12T00:24:30.411 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.411+0000 7f0d199128c0 1 < suggested update operation key=0ZT4NZYZKI5Z tag=3SGWV39W8DWD type=del size=272665 2024-09-12T00:24:30.419 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.419+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~4P42KV2IM5WM.0 size=1048576 2024-09-12T00:24:30.421 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.419+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~4P42KV2IM5WM.1 size=924337 2024-09-12T00:24:30.421 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.419+0000 7f0d199128c0 1 > prepared multipart upload key=FJ8YV026H0ZU upload=4P42KV2IM5WM tag=0WKZ056MRNH3 type=write size=3021489 2024-09-12T00:24:30.425 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.423+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~AC3HOKYVKW3L.0 size=1048576 2024-09-12T00:24:30.427 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.427+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~AC3HOKYVKW3L.1 size=1048576 2024-09-12T00:24:30.430 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.431+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~AC3HOKYVKW3L.2 size=897378 2024-09-12T00:24:30.436 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.435+0000 7f0d199128c0 1 < completed multipart upload key=JA6CSJF78VE2 upload=AC3HOKYVKW3L tag=O6LD4TWA5MP8 type=write size=4043106 2024-09-12T00:24:30.440 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.439+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=DB4MHCUAEDMQ type=write size=930339 2024-09-12T00:24:30.444 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.443+0000 7f0d199128c0 1 < completed write operation key=9I6MZAEUS4I0 tag=910GHJK89PZ9 type=write size=453349 2024-09-12T00:24:30.452 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.451+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~UY5AMRRYER1V.0 size=1048576 2024-09-12T00:24:30.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.451+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~UY5AMRRYER1V.1 size=101933 2024-09-12T00:24:30.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.451+0000 7f0d199128c0 1 > prepared multipart upload key=ZWGD87Z1MMNK upload=UY5AMRRYER1V tag=IK0DO1Z02XM2 type=write size=2199085 2024-09-12T00:24:30.456 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.455+0000 7f0d199128c0 1 < completed delete operation key=VXZI0ZTMQSV0 tag=NP6MD8797H69 type=del 2024-09-12T00:24:30.459 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.459+0000 7f0d199128c0 1 > prepared operation key=57W1IO3KSWBR tag=6T56D9QTT3HO type=del size=38047 2024-09-12T00:24:30.467 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.467+0000 7f0d199128c0 1 < suggested update operation key=OVLAP0OS78QG tag=C4J6XB9MOLA6 type=del size=70676 2024-09-12T00:24:30.473 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.471+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~J6EYU4228QX7.0 size=1048576 2024-09-12T00:24:30.475 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.475+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~J6EYU4228QX7.1 size=1048576 2024-09-12T00:24:30.478 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.479+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~J6EYU4228QX7.2 size=389052 2024-09-12T00:24:30.478 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.479+0000 7f0d199128c0 1 > prepared multipart upload key=GH0FNY2AI00G upload=J6EYU4228QX7 tag=CGL1FDTVBNLS type=write size=3534780 2024-09-12T00:24:30.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.483+0000 7f0d199128c0 -1 < failed to complete operation key=SITJU2EUVSR8 tag=ZGL0GS362UN6 type=del size=3361257: (22) Invalid argument 2024-09-12T00:24:30.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.487+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=O2DFZK5XUMDJ type=del size=1551062 2024-09-12T00:24:30.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.487+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~T0X3FOLSN5VP.0 size=1048576 2024-09-12T00:24:30.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.491+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~T0X3FOLSN5VP.1 size=1048576 2024-09-12T00:24:30.499 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.499+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~T0X3FOLSN5VP.2 size=538926 2024-09-12T00:24:30.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.507+0000 7f0d199128c0 1 < completed multipart upload key=0ZT4NZYZKI5Z upload=T0X3FOLSN5VP tag=AD8WPJT8R1YV type=write size=3684654 2024-09-12T00:24:30.514 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.515+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~ZU9RX8MV2Y2W.0 size=159653 2024-09-12T00:24:30.514 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.515+0000 7f0d199128c0 1 > prepared multipart upload key=FJ8YV026H0ZU upload=ZU9RX8MV2Y2W tag=EPUF6YE1ZY8A type=write size=1208229 2024-09-12T00:24:30.517 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.519+0000 7f0d199128c0 1 < canceled operation key=37WTPAJGOX5L tag=CJATJO7YDBKU type=del size=3517301 2024-09-12T00:24:30.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.523+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~YRX7NUWQCF1J.0 size=1048576 2024-09-12T00:24:30.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.527+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~YRX7NUWQCF1J.1 size=148378 2024-09-12T00:24:30.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.527+0000 7f0d199128c0 1 > prepared multipart upload key=ZWGD87Z1MMNK upload=YRX7NUWQCF1J tag=77UOBN6UL8SQ type=write size=2245530 2024-09-12T00:24:30.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.531+0000 7f0d199128c0 -1 < failed to complete operation key=SITJU2EUVSR8 tag=6B07EIHNYB2Z type=del size=2373063: (22) Invalid argument 2024-09-12T00:24:30.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.539+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~5HMJ15CRJKTH.0 size=1048576 2024-09-12T00:24:30.541 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.539+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~5HMJ15CRJKTH.1 size=1048576 2024-09-12T00:24:30.544 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.543+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~5HMJ15CRJKTH.2 size=823696 2024-09-12T00:24:30.544 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.543+0000 7f0d199128c0 1 > prepared multipart upload key=GH0FNY2AI00G upload=5HMJ15CRJKTH tag=39IA068SK1DD type=write size=3969424 2024-09-12T00:24:30.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.547+0000 7f0d199128c0 1 < completed delete operation key=H604SA6XTFLY tag=OXC31MLE3UMF type=del 2024-09-12T00:24:30.552 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.551+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=RRQJ54KADDK2 type=del size=806477 2024-09-12T00:24:30.555 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.555+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~F4VEHU5PL4WF.0 size=1048576 2024-09-12T00:24:30.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.559+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~F4VEHU5PL4WF.1 size=583750 2024-09-12T00:24:30.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.563+0000 7f0d199128c0 1 < completed multipart upload key=0ZT4NZYZKI5Z upload=F4VEHU5PL4WF tag=XT9KOUVKOJ2S type=write size=2680902 2024-09-12T00:24:30.568 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.567+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=2676K9UB2LLW type=del size=3773601 2024-09-12T00:24:30.572 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.571+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~IXLKQK5DVSJN.0 size=1048576 2024-09-12T00:24:30.575 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.575+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~IXLKQK5DVSJN.1 size=241736 2024-09-12T00:24:30.581 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.579+0000 7f0d199128c0 1 < completed multipart upload key=9I6MZAEUS4I0 upload=IXLKQK5DVSJN tag=H7UJ4C7LYWS9 type=write size=2338888 2024-09-12T00:24:30.589 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.587+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~ICVYQG5L50US.0 size=1048576 2024-09-12T00:24:30.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.591+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~ICVYQG5L50US.1 size=1048576 2024-09-12T00:24:30.594 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.595+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~ICVYQG5L50US.2 size=557745 2024-09-12T00:24:30.594 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.595+0000 7f0d199128c0 1 > prepared multipart upload key=OVLAP0OS78QG upload=ICVYQG5L50US tag=JK3SZHIFU4LR type=write size=3703473 2024-09-12T00:24:30.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.603+0000 7f0d199128c0 1 < suggested remove operation key=PK2CA62QBZXS tag=6WK1YQXZSXNI type=del 2024-09-12T00:24:30.606 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.607+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=YYKDINL3R26G type=del size=3999854 2024-09-12T00:24:30.609 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.611+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~0EK3XWG5NHSK.0 size=1048576 2024-09-12T00:24:30.613 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.611+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~0EK3XWG5NHSK.1 size=1048576 2024-09-12T00:24:30.616 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.615+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~0EK3XWG5NHSK.2 size=108419 2024-09-12T00:24:30.622 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.623+0000 7f0d199128c0 1 < completed multipart upload key=HXNC728XIWC1 upload=0EK3XWG5NHSK tag=YDSJ26OA6VBY type=write size=3254147 2024-09-12T00:24:30.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.627+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=WM4PKMGT9JTB type=del size=1548455 2024-09-12T00:24:30.631 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.631+0000 7f0d199128c0 1 < completed delete operation key=NXQYUQIR2APT tag=GAFOWFLY34OW type=del 2024-09-12T00:24:30.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.635+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=MR07ZYDHFFBR type=del size=174881 2024-09-12T00:24:30.638 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.639+0000 7f0d199128c0 1 < completed delete operation key=YTXW98O07966 tag=AK582Z9SAM3W type=del 2024-09-12T00:24:30.645 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.643+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~3QXF63AHC7CZ.0 size=1048576 2024-09-12T00:24:30.648 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.647+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~3QXF63AHC7CZ.1 size=1048576 2024-09-12T00:24:30.651 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.651+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~3QXF63AHC7CZ.2 size=513260 2024-09-12T00:24:30.651 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.651+0000 7f0d199128c0 1 > prepared multipart upload key=H604SA6XTFLY upload=3QXF63AHC7CZ tag=ENTM77DWHPVK type=write size=3658988 2024-09-12T00:24:30.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.655+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~4P42KV2IM5WM.0 size=1048576 2024-09-12T00:24:30.657 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.659+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~4P42KV2IM5WM.1 size=924337 2024-09-12T00:24:30.663 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.663+0000 7f0d199128c0 1 < completed multipart upload key=FJ8YV026H0ZU upload=4P42KV2IM5WM tag=0WKZ056MRNH3 type=write size=3021489 2024-09-12T00:24:30.669 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.671+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~70HV4KGFKXQT.0 size=1048576 2024-09-12T00:24:30.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.671+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~70HV4KGFKXQT.1 size=423602 2024-09-12T00:24:30.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.671+0000 7f0d199128c0 1 > prepared multipart upload key=H604SA6XTFLY upload=70HV4KGFKXQT tag=LK4X7GM552EI type=write size=2520754 2024-09-12T00:24:30.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.679+0000 7f0d199128c0 1 < suggested update operation key=VXZI0ZTMQSV0 tag=DB4MHCUAEDMQ type=write size=930339 2024-09-12T00:24:30.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.683+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=RU3LCRXBR3AX type=del size=3574051 2024-09-12T00:24:30.686 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.687+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~UY5AMRRYER1V.0 size=1048576 2024-09-12T00:24:30.689 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.687+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~UY5AMRRYER1V.1 size=101933 2024-09-12T00:24:30.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.695+0000 7f0d199128c0 1 < completed multipart upload key=ZWGD87Z1MMNK upload=UY5AMRRYER1V tag=IK0DO1Z02XM2 type=write size=2199085 2024-09-12T00:24:30.699 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.699+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=KV901SM3LTT9 type=del size=1153761 2024-09-12T00:24:30.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.707+0000 7f0d199128c0 1 < suggested remove operation key=57W1IO3KSWBR tag=6T56D9QTT3HO type=del 2024-09-12T00:24:30.711 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.711+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~M2CN70SDDHJV.0 size=1048576 2024-09-12T00:24:30.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.715+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~M2CN70SDDHJV.1 size=1048576 2024-09-12T00:24:30.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.715+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~M2CN70SDDHJV.2 size=223810 2024-09-12T00:24:30.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.715+0000 7f0d199128c0 1 > prepared multipart upload key=SITJU2EUVSR8 upload=M2CN70SDDHJV tag=6HKTLH15BYB0 type=write size=3369538 2024-09-12T00:24:30.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.719+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~J6EYU4228QX7.0 size=1048576 2024-09-12T00:24:30.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.723+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~J6EYU4228QX7.1 size=1048576 2024-09-12T00:24:30.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.727+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~J6EYU4228QX7.2 size=389052 2024-09-12T00:24:30.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.731+0000 7f0d199128c0 1 < completed multipart upload key=GH0FNY2AI00G upload=J6EYU4228QX7 tag=CGL1FDTVBNLS type=write size=3534780 2024-09-12T00:24:30.736 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.735+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~ZA4IMNYYP7FP.0 size=1048576 2024-09-12T00:24:30.738 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.739+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~ZA4IMNYYP7FP.1 size=1048576 2024-09-12T00:24:30.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.739+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~ZA4IMNYYP7FP.2 size=564919 2024-09-12T00:24:30.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.739+0000 7f0d199128c0 1 > prepared multipart upload key=HXNC728XIWC1 upload=ZA4IMNYYP7FP tag=4MCADAWLOVXN type=write size=3710647 2024-09-12T00:24:30.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.743+0000 7f0d199128c0 1 < completed delete operation key=WPZOKZDFXK4S tag=O2DFZK5XUMDJ type=del 2024-09-12T00:24:30.750 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.751+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~HU2D7Y7ZYDBI.0 size=39493 2024-09-12T00:24:30.750 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.751+0000 7f0d199128c0 1 > prepared multipart upload key=WPZOKZDFXK4S upload=HU2D7Y7ZYDBI tag=LUNIXP2RY4RP type=write size=1088069 2024-09-12T00:24:30.753 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.751+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~ZU9RX8MV2Y2W.0 size=159653 2024-09-12T00:24:30.758 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.759+0000 7f0d199128c0 1 < completed multipart upload key=FJ8YV026H0ZU upload=ZU9RX8MV2Y2W tag=EPUF6YE1ZY8A type=write size=1208229 2024-09-12T00:24:30.763 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.763+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~S0NIVW31HCT5.0 size=401228 2024-09-12T00:24:30.763 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.763+0000 7f0d199128c0 1 > prepared multipart upload key=V6H6S9X0U2A0 upload=S0NIVW31HCT5 tag=0SLKHSMN6FFN type=write size=1449804 2024-09-12T00:24:30.766 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.767+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~YRX7NUWQCF1J.0 size=1048576 2024-09-12T00:24:30.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.767+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~YRX7NUWQCF1J.1 size=148378 2024-09-12T00:24:30.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.771+0000 7f0d199128c0 1 < completed multipart upload key=ZWGD87Z1MMNK upload=YRX7NUWQCF1J tag=77UOBN6UL8SQ type=write size=2245530 2024-09-12T00:24:30.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.775+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=F9YRD0MPH8CV type=del size=27881 2024-09-12T00:24:30.779 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.779+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~5HMJ15CRJKTH.0 size=1048576 2024-09-12T00:24:30.781 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.779+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~5HMJ15CRJKTH.1 size=1048576 2024-09-12T00:24:30.783 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.783+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~5HMJ15CRJKTH.2 size=823696 2024-09-12T00:24:30.788 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.787+0000 7f0d199128c0 1 < completed multipart upload key=GH0FNY2AI00G upload=5HMJ15CRJKTH tag=39IA068SK1DD type=write size=3969424 2024-09-12T00:24:30.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.791+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=A07YVWK14RMW type=del size=242650 2024-09-12T00:24:30.795 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.795+0000 7f0d199128c0 1 < completed delete operation key=QUO5ND3O41TY tag=RRQJ54KADDK2 type=del 2024-09-12T00:24:30.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.799+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=I74ILZCIM26Z type=del size=1194548 2024-09-12T00:24:30.801 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.799+0000 7f0d199128c0 1 < completed delete operation key=B58RWC9W8THG tag=2676K9UB2LLW type=del 2024-09-12T00:24:30.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.803+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=YHXRQ12VAF44 type=del size=3517792 2024-09-12T00:24:30.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.807+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~ICVYQG5L50US.0 size=1048576 2024-09-12T00:24:30.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.811+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~ICVYQG5L50US.1 size=1048576 2024-09-12T00:24:30.817 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.815+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~ICVYQG5L50US.2 size=557745 2024-09-12T00:24:30.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.823+0000 7f0d199128c0 1 < completed multipart upload key=OVLAP0OS78QG upload=ICVYQG5L50US tag=JK3SZHIFU4LR type=write size=3703473 2024-09-12T00:24:30.826 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.827+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=QWTRXK2XD6V2 type=del size=4131949 2024-09-12T00:24:30.829 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.827+0000 7f0d199128c0 1 < completed delete operation key=JA6CSJF78VE2 tag=YYKDINL3R26G type=del 2024-09-12T00:24:30.834 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.835+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~MQ0HTHOT0KV2.0 size=1048576 2024-09-12T00:24:30.837 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.835+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~MQ0HTHOT0KV2.1 size=942284 2024-09-12T00:24:30.837 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.835+0000 7f0d199128c0 1 > prepared multipart upload key=HXNC728XIWC1 upload=MQ0HTHOT0KV2 tag=92SB4YTK5GZE type=write size=3039436 2024-09-12T00:24:30.840 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.839+0000 7f0d199128c0 1 < completed delete operation key=H604SA6XTFLY tag=WM4PKMGT9JTB type=del 2024-09-12T00:24:30.846 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.847+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~HU018QN2GXGY.0 size=1048576 2024-09-12T00:24:30.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.847+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~HU018QN2GXGY.1 size=509256 2024-09-12T00:24:30.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.847+0000 7f0d199128c0 1 > prepared multipart upload key=YTXW98O07966 upload=HU018QN2GXGY tag=W4D6JSDNCK6B type=write size=2606408 2024-09-12T00:24:30.852 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.851+0000 7f0d199128c0 1 < completed delete operation key=PK2CA62QBZXS tag=MR07ZYDHFFBR type=del 2024-09-12T00:24:30.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.855+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=NZCGJR6M9XWH type=del size=957823 2024-09-12T00:24:30.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.855+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~3QXF63AHC7CZ.0 size=1048576 2024-09-12T00:24:30.859 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.859+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~3QXF63AHC7CZ.1 size=1048576 2024-09-12T00:24:30.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.863+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~3QXF63AHC7CZ.2 size=513260 2024-09-12T00:24:30.866 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.867+0000 7f0d199128c0 1 < completed multipart upload key=H604SA6XTFLY upload=3QXF63AHC7CZ tag=ENTM77DWHPVK type=write size=3658988 2024-09-12T00:24:30.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.867+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=X5NCQZR3YGGL type=del size=489425 2024-09-12T00:24:30.873 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.871+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~70HV4KGFKXQT.0 size=1048576 2024-09-12T00:24:30.875 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.875+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~70HV4KGFKXQT.1 size=423602 2024-09-12T00:24:30.879 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.879+0000 7f0d199128c0 1 < completed multipart upload key=H604SA6XTFLY upload=70HV4KGFKXQT tag=LK4X7GM552EI type=write size=2520754 2024-09-12T00:24:30.884 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.883+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~01G60R571AJ0.0 size=1048576 2024-09-12T00:24:30.886 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.887+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~01G60R571AJ0.1 size=1048576 2024-09-12T00:24:30.888 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.887+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~01G60R571AJ0.2 size=186643 2024-09-12T00:24:30.889 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.887+0000 7f0d199128c0 1 > prepared multipart upload key=SITJU2EUVSR8 upload=01G60R571AJ0 tag=TBZFI652WOA8 type=write size=3332371 2024-09-12T00:24:30.891 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.891+0000 7f0d199128c0 1 < canceled operation key=1Y6B1MJP5G4L tag=RU3LCRXBR3AX type=del size=3574051 2024-09-12T00:24:30.897 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.895+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~9I0QJN5RW6EI.0 size=1048576 2024-09-12T00:24:30.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.899+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~9I0QJN5RW6EI.1 size=1048576 2024-09-12T00:24:30.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.899+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~9I0QJN5RW6EI.2 size=149835 2024-09-12T00:24:30.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.899+0000 7f0d199128c0 1 > prepared multipart upload key=PK2CA62QBZXS upload=9I0QJN5RW6EI tag=CVLL2UFMRO2C type=write size=3295563 2024-09-12T00:24:30.904 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.903+0000 7f0d199128c0 1 < completed delete operation key=HXNC728XIWC1 tag=KV901SM3LTT9 type=del 2024-09-12T00:24:30.908 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.907+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~C7EINP2LXFIX.0 size=950349 2024-09-12T00:24:30.908 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.907+0000 7f0d199128c0 1 > prepared multipart upload key=YTXW98O07966 upload=C7EINP2LXFIX tag=O5D1IMZNGRLP type=write size=1998925 2024-09-12T00:24:30.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.911+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~M2CN70SDDHJV.0 size=1048576 2024-09-12T00:24:30.913 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.911+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~M2CN70SDDHJV.1 size=1048576 2024-09-12T00:24:30.915 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.915+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~M2CN70SDDHJV.2 size=223810 2024-09-12T00:24:30.919 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.919+0000 7f0d199128c0 1 < completed multipart upload key=SITJU2EUVSR8 upload=M2CN70SDDHJV tag=6HKTLH15BYB0 type=write size=3369538 2024-09-12T00:24:30.922 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.923+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=BPTLLZYR1H70 type=write size=900508 2024-09-12T00:24:30.924 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.923+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~ZA4IMNYYP7FP.0 size=1048576 2024-09-12T00:24:30.926 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.927+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~ZA4IMNYYP7FP.1 size=1048576 2024-09-12T00:24:30.928 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.927+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~ZA4IMNYYP7FP.2 size=564919 2024-09-12T00:24:30.932 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.931+0000 7f0d199128c0 1 < completed multipart upload key=HXNC728XIWC1 upload=ZA4IMNYYP7FP tag=4MCADAWLOVXN type=write size=3710647 2024-09-12T00:24:30.937 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.939+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~Y4CLD5ZQ8RWU.0 size=1048576 2024-09-12T00:24:30.941 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.939+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~Y4CLD5ZQ8RWU.1 size=1048576 2024-09-12T00:24:30.942 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.939+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~Y4CLD5ZQ8RWU.2 size=855311 2024-09-12T00:24:30.942 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.939+0000 7f0d199128c0 1 > prepared multipart upload key=B58RWC9W8THG upload=Y4CLD5ZQ8RWU tag=D4GC4W08ZCXP type=write size=4001039 2024-09-12T00:24:30.943 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.943+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~HU2D7Y7ZYDBI.0 size=39493 2024-09-12T00:24:30.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.947+0000 7f0d199128c0 1 < completed multipart upload key=WPZOKZDFXK4S upload=HU2D7Y7ZYDBI tag=LUNIXP2RY4RP type=write size=1088069 2024-09-12T00:24:30.949 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.951+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=EGKRDXZ0T8B2 type=del size=500996 2024-09-12T00:24:30.952 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.951+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~S0NIVW31HCT5.0 size=401228 2024-09-12T00:24:30.956 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.955+0000 7f0d199128c0 1 < completed multipart upload key=V6H6S9X0U2A0 upload=S0NIVW31HCT5 tag=0SLKHSMN6FFN type=write size=1449804 2024-09-12T00:24:30.958 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.959+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=2NHPPDIQA9V1 type=del size=341687 2024-09-12T00:24:30.960 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.959+0000 7f0d199128c0 1 < completed delete operation key=V6H6S9X0U2A0 tag=F9YRD0MPH8CV type=del 2024-09-12T00:24:30.963 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.963+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=T0W4UB8F6MRA type=del size=1687694 2024-09-12T00:24:30.965 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.963+0000 7f0d199128c0 1 < completed delete operation key=WPZOKZDFXK4S tag=A07YVWK14RMW type=del 2024-09-12T00:24:30.968 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.967+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=7XTW4QOPC0S3 type=del size=1476790 2024-09-12T00:24:30.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.971+0000 7f0d199128c0 1 < canceled operation key=NXQYUQIR2APT tag=I74ILZCIM26Z type=del size=1194548 2024-09-12T00:24:30.973 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.971+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=O0STGRVFI844 type=del size=1786028 2024-09-12T00:24:30.976 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.975+0000 7f0d199128c0 1 < completed delete operation key=37WTPAJGOX5L tag=YHXRQ12VAF44 type=del 2024-09-12T00:24:30.980 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.979+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=V28CFDOJVLIB type=del size=2822813 2024-09-12T00:24:30.986 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.987+0000 7f0d199128c0 1 < suggested remove operation key=YTXW98O07966 tag=QWTRXK2XD6V2 type=del 2024-09-12T00:24:30.989 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.991+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=I3BNABXAPBD2 type=write size=55070 2024-09-12T00:24:30.993 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.991+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~MQ0HTHOT0KV2.0 size=1048576 2024-09-12T00:24:30.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:30.995+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~MQ0HTHOT0KV2.1 size=942284 2024-09-12T00:24:31.001 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.003+0000 7f0d199128c0 1 < completed multipart upload key=HXNC728XIWC1 upload=MQ0HTHOT0KV2 tag=92SB4YTK5GZE type=write size=3039436 2024-09-12T00:24:31.005 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.003+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=635OMZ49JDS2 type=write size=454852 2024-09-12T00:24:31.005 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.007+0000 7f0d199128c0 1 < canceled part key=_multipart_YTXW98O07966.2~HU018QN2GXGY.0 size=1048576 2024-09-12T00:24:31.008 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.007+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~HU018QN2GXGY.1 size=509256 2024-09-12T00:24:31.014 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.015+0000 7f0d199128c0 1 < canceled multipart upload key=YTXW98O07966 upload=HU018QN2GXGY tag=W4D6JSDNCK6B type=write size=2606408 2024-09-12T00:24:31.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.019+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=Q2PPAMISG102 type=del size=469368 2024-09-12T00:24:31.025 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.023+0000 7f0d199128c0 1 < suggested update operation key=RX3RVT06SGJ4 tag=NZCGJR6M9XWH type=del size=957823 2024-09-12T00:24:31.031 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.031+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~48B82BXDWFVP.0 size=1048576 2024-09-12T00:24:31.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.031+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~48B82BXDWFVP.1 size=630945 2024-09-12T00:24:31.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.031+0000 7f0d199128c0 1 > prepared multipart upload key=JA6CSJF78VE2 upload=48B82BXDWFVP tag=IPXBCIYC6EC7 type=write size=2728097 2024-09-12T00:24:31.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.035+0000 7f0d199128c0 1 < completed delete operation key=IPJEXRBN96NB tag=X5NCQZR3YGGL type=del 2024-09-12T00:24:31.038 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.039+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=XLZOUBE7D39Z type=del size=3561906 2024-09-12T00:24:31.039 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.039+0000 7f0d199128c0 1 < canceled part key=_multipart_SITJU2EUVSR8.2~01G60R571AJ0.0 size=1048576 2024-09-12T00:24:31.041 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.043+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~01G60R571AJ0.1 size=1048576 2024-09-12T00:24:31.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.043+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~01G60R571AJ0.2 size=186643 2024-09-12T00:24:31.049 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.047+0000 7f0d199128c0 1 < canceled multipart upload key=SITJU2EUVSR8 upload=01G60R571AJ0 tag=TBZFI652WOA8 type=write size=3332371 2024-09-12T00:24:31.054 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.055+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~N4B7FPOOWG1N.0 size=1048576 2024-09-12T00:24:31.057 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.055+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~N4B7FPOOWG1N.1 size=1048576 2024-09-12T00:24:31.059 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.059+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~N4B7FPOOWG1N.2 size=351060 2024-09-12T00:24:31.059 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.059+0000 7f0d199128c0 1 > prepared multipart upload key=PK2CA62QBZXS upload=N4B7FPOOWG1N tag=29XE7MKQ0JKD type=write size=3496788 2024-09-12T00:24:31.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.063+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~9I0QJN5RW6EI.0 size=1048576 2024-09-12T00:24:31.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.063+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~9I0QJN5RW6EI.1 size=1048576 2024-09-12T00:24:31.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.067+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~9I0QJN5RW6EI.2 size=149835 2024-09-12T00:24:31.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.071+0000 7f0d199128c0 1 < completed multipart upload key=PK2CA62QBZXS upload=9I0QJN5RW6EI tag=CVLL2UFMRO2C type=write size=3295563 2024-09-12T00:24:31.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.075+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=SVWTN7OWATYC type=del size=1802548 2024-09-12T00:24:31.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.079+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~C7EINP2LXFIX.0 size=950349 2024-09-12T00:24:31.084 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.083+0000 7f0d199128c0 1 < completed multipart upload key=YTXW98O07966 upload=C7EINP2LXFIX tag=O5D1IMZNGRLP type=write size=1998925 2024-09-12T00:24:31.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.087+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=YNBBB7JD7PQ7 type=del size=1619283 2024-09-12T00:24:31.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.091+0000 7f0d199128c0 1 < completed write operation key=B58RWC9W8THG tag=BPTLLZYR1H70 type=write size=900508 2024-09-12T00:24:31.093 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.091+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=FK1M2OKKSR15 type=del size=260423 2024-09-12T00:24:31.096 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.095+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~Y4CLD5ZQ8RWU.0 size=1048576 2024-09-12T00:24:31.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.099+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~Y4CLD5ZQ8RWU.1 size=1048576 2024-09-12T00:24:31.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.099+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~Y4CLD5ZQ8RWU.2 size=855311 2024-09-12T00:24:31.105 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.107+0000 7f0d199128c0 1 < completed multipart upload key=B58RWC9W8THG upload=Y4CLD5ZQ8RWU tag=D4GC4W08ZCXP type=write size=4001039 2024-09-12T00:24:31.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.107+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=B2IPMCJMHT8B type=del size=2694417 2024-09-12T00:24:31.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.111+0000 7f0d199128c0 1 < completed delete operation key=J75P0821XGRO tag=EGKRDXZ0T8B2 type=del 2024-09-12T00:24:31.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.115+0000 7f0d199128c0 1 > prepared operation key=57W1IO3KSWBR tag=3HAMKXZXUTP2 type=del size=1576832 2024-09-12T00:24:31.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.119+0000 7f0d199128c0 1 < suggested update operation key=HXNC728XIWC1 tag=2NHPPDIQA9V1 type=del size=341687 2024-09-12T00:24:31.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.123+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=08WLI84H8CZI type=write size=511753 2024-09-12T00:24:31.126 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.127+0000 7f0d199128c0 1 < completed delete operation key=IPJEXRBN96NB tag=T0W4UB8F6MRA type=del 2024-09-12T00:24:31.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.127+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=SCZYHC0PH0IS type=del size=2966251 2024-09-12T00:24:31.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.131+0000 7f0d199128c0 1 < completed delete operation key=B58RWC9W8THG tag=7XTW4QOPC0S3 type=del 2024-09-12T00:24:31.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.135+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~KHG822SPBEF3.0 size=1048576 2024-09-12T00:24:31.139 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.139+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~KHG822SPBEF3.1 size=1048576 2024-09-12T00:24:31.141 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.139+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~KHG822SPBEF3.2 size=57320 2024-09-12T00:24:31.141 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.139+0000 7f0d199128c0 1 > prepared multipart upload key=J75P0821XGRO upload=KHG822SPBEF3 tag=J9JZPOU0BEWP type=write size=3203048 2024-09-12T00:24:31.144 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.143+0000 7f0d199128c0 1 < completed delete operation key=IPJEXRBN96NB tag=O0STGRVFI844 type=del 2024-09-12T00:24:31.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.147+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=RO1OI2WVLVYJ type=del size=319130 2024-09-12T00:24:31.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.151+0000 7f0d199128c0 1 < suggested remove operation key=10YEWZDTTEV0 tag=V28CFDOJVLIB type=del 2024-09-12T00:24:31.154 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.155+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=ORHAQ2HG28I6 type=del size=2025772 2024-09-12T00:24:31.157 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.155+0000 7f0d199128c0 1 < completed write operation key=9I6MZAEUS4I0 tag=I3BNABXAPBD2 type=write size=55070 2024-09-12T00:24:31.160 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.159+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=RN1G7WYWQRUD type=del size=155975 2024-09-12T00:24:31.162 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.163+0000 7f0d199128c0 -1 < failed to complete operation key=RX3RVT06SGJ4 tag=635OMZ49JDS2 type=write size=454852: (22) Invalid argument 2024-09-12T00:24:31.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.167+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=Z1RGEQ6IRAUZ type=write size=249070 2024-09-12T00:24:31.169 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.167+0000 7f0d199128c0 1 < canceled operation key=PK2CA62QBZXS tag=Q2PPAMISG102 type=del size=469368 2024-09-12T00:24:31.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.171+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=DL1UAZMYBMQ4 type=del size=3777905 2024-09-12T00:24:31.174 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.175+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~48B82BXDWFVP.0 size=1048576 2024-09-12T00:24:31.177 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.175+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~48B82BXDWFVP.1 size=630945 2024-09-12T00:24:31.181 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.183+0000 7f0d199128c0 1 < completed multipart upload key=JA6CSJF78VE2 upload=48B82BXDWFVP tag=IPXBCIYC6EC7 type=write size=2728097 2024-09-12T00:24:31.184 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.183+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=66MY6US4IEUD type=del size=3161999 2024-09-12T00:24:31.187 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.187+0000 7f0d199128c0 1 < completed delete operation key=PK2CA62QBZXS tag=XLZOUBE7D39Z type=del 2024-09-12T00:24:31.190 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.191+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=LRB9M6DXLY2L type=del size=1853542 2024-09-12T00:24:31.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.195+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~N4B7FPOOWG1N.0 size=1048576 2024-09-12T00:24:31.196 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.195+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~N4B7FPOOWG1N.1 size=1048576 2024-09-12T00:24:31.196 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.195+0000 7f0d199128c0 1 < canceled part key=_multipart_PK2CA62QBZXS.2~N4B7FPOOWG1N.2 size=351060 2024-09-12T00:24:31.201 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.199+0000 7f0d199128c0 1 < canceled multipart upload key=PK2CA62QBZXS upload=N4B7FPOOWG1N tag=29XE7MKQ0JKD type=write size=3496788 2024-09-12T00:24:31.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.207+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~AVD46MSZB4GU.0 size=1048576 2024-09-12T00:24:31.209 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.211+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~AVD46MSZB4GU.1 size=948481 2024-09-12T00:24:31.209 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.211+0000 7f0d199128c0 1 > prepared multipart upload key=9I6MZAEUS4I0 upload=AVD46MSZB4GU tag=U7ZEBKAOCQVL type=write size=3045633 2024-09-12T00:24:31.212 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.211+0000 7f0d199128c0 1 < completed delete operation key=QUO5ND3O41TY tag=SVWTN7OWATYC type=del 2024-09-12T00:24:31.216 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.215+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=M072EAB732CR type=write size=194100 2024-09-12T00:24:31.223 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.223+0000 7f0d199128c0 1 < suggested remove operation key=HXNC728XIWC1 tag=YNBBB7JD7PQ7 type=del 2024-09-12T00:24:31.227 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.227+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=QYHLP6DP77GJ type=write size=740046 2024-09-12T00:24:31.231 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.231+0000 7f0d199128c0 1 < completed delete operation key=B58RWC9W8THG tag=FK1M2OKKSR15 type=del 2024-09-12T00:24:31.237 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.235+0000 7f0d199128c0 1 > prepared part key=_multipart_RFCHRGVA9GOI.2~0OEHX3FFFBZ2.0 size=518044 2024-09-12T00:24:31.237 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.235+0000 7f0d199128c0 1 > prepared multipart upload key=RFCHRGVA9GOI upload=0OEHX3FFFBZ2 tag=J1VRXJ80ZAW0 type=write size=1566620 2024-09-12T00:24:31.240 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.239+0000 7f0d199128c0 1 < completed delete operation key=J75P0821XGRO tag=B2IPMCJMHT8B type=del 2024-09-12T00:24:31.244 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.243+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=0BLLYX2FXL33 type=write size=1018956 2024-09-12T00:24:31.247 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.247+0000 7f0d199128c0 1 < canceled operation key=57W1IO3KSWBR tag=3HAMKXZXUTP2 type=del size=1576832 2024-09-12T00:24:31.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.251+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=71WZ33A3WA1V type=del size=2552195 2024-09-12T00:24:31.255 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.255+0000 7f0d199128c0 1 < completed write operation key=9I6MZAEUS4I0 tag=08WLI84H8CZI type=write size=511753 2024-09-12T00:24:31.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.259+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~CIZPL0JL471X.0 size=715748 2024-09-12T00:24:31.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.259+0000 7f0d199128c0 1 > prepared multipart upload key=4K654PSDLDVI upload=CIZPL0JL471X tag=EO0CQ00XLU6X type=write size=1764324 2024-09-12T00:24:31.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.263+0000 7f0d199128c0 1 < canceled operation key=9I6MZAEUS4I0 tag=SCZYHC0PH0IS type=del size=2966251 2024-09-12T00:24:31.270 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.271+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~3DXL6ELQPGBX.0 size=152054 2024-09-12T00:24:31.270 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.271+0000 7f0d199128c0 1 > prepared multipart upload key=JA6CSJF78VE2 upload=3DXL6ELQPGBX tag=VCU3KNI4YID3 type=write size=1200630 2024-09-12T00:24:31.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.275+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~KHG822SPBEF3.0 size=1048576 2024-09-12T00:24:31.276 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.275+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~KHG822SPBEF3.1 size=1048576 2024-09-12T00:24:31.279 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.279+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~KHG822SPBEF3.2 size=57320 2024-09-12T00:24:31.286 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.287+0000 7f0d199128c0 1 < completed multipart upload key=J75P0821XGRO upload=KHG822SPBEF3 tag=J9JZPOU0BEWP type=write size=3203048 2024-09-12T00:24:31.290 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.291+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=WZMW1PQ8VS5T type=write size=952402 2024-09-12T00:24:31.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.295+0000 7f0d199128c0 1 < completed delete operation key=OVLAP0OS78QG tag=RO1OI2WVLVYJ type=del 2024-09-12T00:24:31.298 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.299+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=QQ8SY49ZMO2J type=del size=2082512 2024-09-12T00:24:31.303 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.303+0000 7f0d199128c0 1 < completed delete operation key=RX3RVT06SGJ4 tag=ORHAQ2HG28I6 type=del 2024-09-12T00:24:31.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.307+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=GQO1M3FPBGFN type=del size=98323 2024-09-12T00:24:31.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.315+0000 7f0d199128c0 1 < suggested remove operation key=J75P0821XGRO tag=RN1G7WYWQRUD type=del 2024-09-12T00:24:31.322 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.323+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~5ICUTXE00DFO.0 size=175111 2024-09-12T00:24:31.322 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.323+0000 7f0d199128c0 1 > prepared multipart upload key=ZWGD87Z1MMNK upload=5ICUTXE00DFO tag=3WNEG37UKPOA type=write size=1223687 2024-09-12T00:24:31.325 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.327+0000 7f0d199128c0 1 < completed write operation key=IPJEXRBN96NB tag=Z1RGEQ6IRAUZ type=write size=249070 2024-09-12T00:24:31.329 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.327+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=5JXU46ONKSHD type=del size=4298 2024-09-12T00:24:31.336 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.335+0000 7f0d199128c0 1 < suggested update operation key=A529WOKFD1NI tag=DL1UAZMYBMQ4 type=del size=3777905 2024-09-12T00:24:31.343 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.343+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~01DCODUL0WZQ.0 size=647512 2024-09-12T00:24:31.343 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.343+0000 7f0d199128c0 1 > prepared multipart upload key=VXZI0ZTMQSV0 upload=01DCODUL0WZQ tag=2YOMKSJF58SO type=write size=1696088 2024-09-12T00:24:31.351 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.351+0000 7f0d199128c0 1 < suggested update operation key=2EK9CCKG26W2 tag=66MY6US4IEUD type=del size=3161999 2024-09-12T00:24:31.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.355+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=LQ495R4SF9P6 type=del size=2217519 2024-09-12T00:24:31.358 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.359+0000 7f0d199128c0 1 < completed delete operation key=1Y6B1MJP5G4L tag=LRB9M6DXLY2L type=del 2024-09-12T00:24:31.362 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.363+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=4O7WJUD7NSQ1 type=del size=586649 2024-09-12T00:24:31.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.367+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~AVD46MSZB4GU.0 size=1048576 2024-09-12T00:24:31.369 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.367+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~AVD46MSZB4GU.1 size=948481 2024-09-12T00:24:31.375 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.375+0000 7f0d199128c0 1 < completed multipart upload key=9I6MZAEUS4I0 upload=AVD46MSZB4GU tag=U7ZEBKAOCQVL type=write size=3045633 2024-09-12T00:24:31.381 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.383+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~MLHI82JE1U1Z.0 size=1048576 2024-09-12T00:24:31.384 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.383+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~MLHI82JE1U1Z.1 size=157092 2024-09-12T00:24:31.384 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.383+0000 7f0d199128c0 1 > prepared multipart upload key=1Y6B1MJP5G4L upload=MLHI82JE1U1Z tag=NTNUY60GXWTA type=write size=2254244 2024-09-12T00:24:31.388 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.387+0000 7f0d199128c0 1 < completed write operation key=VXZI0ZTMQSV0 tag=M072EAB732CR type=write size=194100 2024-09-12T00:24:31.396 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.395+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=X6XBH92NZJNG type=del size=2548859 2024-09-12T00:24:31.399 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.399+0000 7f0d199128c0 1 < completed write operation key=GH0FNY2AI00G tag=QYHLP6DP77GJ type=write size=740046 2024-09-12T00:24:31.404 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.403+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=I62A38853M1I type=write size=119904 2024-09-12T00:24:31.407 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.407+0000 7f0d199128c0 1 < completed part key=_multipart_RFCHRGVA9GOI.2~0OEHX3FFFBZ2.0 size=518044 2024-09-12T00:24:31.414 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.415+0000 7f0d199128c0 1 < completed multipart upload key=RFCHRGVA9GOI upload=0OEHX3FFFBZ2 tag=J1VRXJ80ZAW0 type=write size=1566620 2024-09-12T00:24:31.417 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.415+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=MVH5LLQAH9JT type=write size=688028 2024-09-12T00:24:31.421 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.419+0000 7f0d199128c0 1 < completed write operation key=0EBWUENN0881 tag=0BLLYX2FXL33 type=write size=1018956 2024-09-12T00:24:31.428 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.427+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~KNXSEXYS8Z2R.0 size=1048576 2024-09-12T00:24:31.431 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.431+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~KNXSEXYS8Z2R.1 size=1048576 2024-09-12T00:24:31.434 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.435+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~KNXSEXYS8Z2R.2 size=445089 2024-09-12T00:24:31.434 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.435+0000 7f0d199128c0 1 > prepared multipart upload key=4K654PSDLDVI upload=KNXSEXYS8Z2R tag=L00AMDA7E1ES type=write size=3590817 2024-09-12T00:24:31.437 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.439+0000 7f0d199128c0 1 < completed delete operation key=FJ8YV026H0ZU tag=71WZ33A3WA1V type=del 2024-09-12T00:24:31.440 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.439+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=J39BM5ACZYYH type=del size=732432 2024-09-12T00:24:31.444 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.443+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~CIZPL0JL471X.0 size=715748 2024-09-12T00:24:31.450 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.451+0000 7f0d199128c0 1 < completed multipart upload key=4K654PSDLDVI upload=CIZPL0JL471X tag=EO0CQ00XLU6X type=write size=1764324 2024-09-12T00:24:31.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.455+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=BS7OPOCAFFHO type=write size=968030 2024-09-12T00:24:31.457 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.459+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~3DXL6ELQPGBX.0 size=152054 2024-09-12T00:24:31.463 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.463+0000 7f0d199128c0 1 < completed multipart upload key=JA6CSJF78VE2 upload=3DXL6ELQPGBX tag=VCU3KNI4YID3 type=write size=1200630 2024-09-12T00:24:31.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.467+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=AMI7OJQP6UR8 type=del size=2172873 2024-09-12T00:24:31.470 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.471+0000 7f0d199128c0 1 < completed write operation key=1Y6B1MJP5G4L tag=WZMW1PQ8VS5T type=write size=952402 2024-09-12T00:24:31.476 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.475+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=438N2BF4IY1E type=del size=2924569 2024-09-12T00:24:31.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.483+0000 7f0d199128c0 1 < suggested update operation key=YTXW98O07966 tag=QQ8SY49ZMO2J type=del size=2082512 2024-09-12T00:24:31.486 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.487+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=1S2A0DRG4GNA type=del size=344298 2024-09-12T00:24:31.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.487+0000 7f0d199128c0 -1 < failed to complete operation key=A529WOKFD1NI tag=GQO1M3FPBGFN type=del size=98323: (22) Invalid argument 2024-09-12T00:24:31.493 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.495+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=HQI36P7DZ9OX type=del size=3666501 2024-09-12T00:24:31.498 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.499+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~5ICUTXE00DFO.0 size=175111 2024-09-12T00:24:31.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.503+0000 7f0d199128c0 1 < completed multipart upload key=ZWGD87Z1MMNK upload=5ICUTXE00DFO tag=3WNEG37UKPOA type=write size=1223687 2024-09-12T00:24:31.512 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.511+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~M7C13GGJZIR3.0 size=1048576 2024-09-12T00:24:31.515 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.515+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~M7C13GGJZIR3.1 size=1048576 2024-09-12T00:24:31.518 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.519+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~M7C13GGJZIR3.2 size=53426 2024-09-12T00:24:31.518 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.519+0000 7f0d199128c0 1 > prepared multipart upload key=RX3RVT06SGJ4 upload=M7C13GGJZIR3 tag=BT0L5YCB9U2Y type=write size=3199154 2024-09-12T00:24:31.527 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.527+0000 7f0d199128c0 1 < suggested remove operation key=GH0FNY2AI00G tag=5JXU46ONKSHD type=del 2024-09-12T00:24:31.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.531+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=RUIMBX2QSGCE type=del size=2046121 2024-09-12T00:24:31.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.535+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~01DCODUL0WZQ.0 size=647512 2024-09-12T00:24:31.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.539+0000 7f0d199128c0 1 < completed multipart upload key=VXZI0ZTMQSV0 upload=01DCODUL0WZQ tag=2YOMKSJF58SO type=write size=1696088 2024-09-12T00:24:31.546 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.547+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~U3G0H2OM8K1J.0 size=1048576 2024-09-12T00:24:31.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.547+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~U3G0H2OM8K1J.1 size=263701 2024-09-12T00:24:31.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.547+0000 7f0d199128c0 1 > prepared multipart upload key=T6GOR4SBYU2Y upload=U3G0H2OM8K1J tag=VEFBRMTG0TSO type=write size=2360853 2024-09-12T00:24:31.552 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.551+0000 7f0d199128c0 1 < completed delete operation key=0EBWUENN0881 tag=LQ495R4SF9P6 type=del 2024-09-12T00:24:31.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.559+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~9M3BEJTX6RZV.0 size=1048576 2024-09-12T00:24:31.561 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.559+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~9M3BEJTX6RZV.1 size=1048576 2024-09-12T00:24:31.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.563+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~9M3BEJTX6RZV.2 size=751701 2024-09-12T00:24:31.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.563+0000 7f0d199128c0 1 > prepared multipart upload key=RX3RVT06SGJ4 upload=9M3BEJTX6RZV tag=KVNRXZWVG1VM type=write size=3897429 2024-09-12T00:24:31.567 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.567+0000 7f0d199128c0 1 < completed delete operation key=OVLAP0OS78QG tag=4O7WJUD7NSQ1 type=del 2024-09-12T00:24:31.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.571+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=QF8RMCOHMLAT type=del size=3020175 2024-09-12T00:24:31.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.575+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~MLHI82JE1U1Z.0 size=1048576 2024-09-12T00:24:31.577 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.575+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~MLHI82JE1U1Z.1 size=157092 2024-09-12T00:24:31.583 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.583+0000 7f0d199128c0 1 < completed multipart upload key=1Y6B1MJP5G4L upload=MLHI82JE1U1Z tag=NTNUY60GXWTA type=write size=2254244 2024-09-12T00:24:31.589 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.591+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~GAE36O0RJJYG.0 size=1048576 2024-09-12T00:24:31.592 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.591+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~GAE36O0RJJYG.1 size=689443 2024-09-12T00:24:31.592 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.591+0000 7f0d199128c0 1 > prepared multipart upload key=0EBWUENN0881 upload=GAE36O0RJJYG tag=YNGF64O62J5B type=write size=2786595 2024-09-12T00:24:31.595 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.595+0000 7f0d199128c0 1 < completed delete operation key=OVLAP0OS78QG tag=X6XBH92NZJNG type=del 2024-09-12T00:24:31.598 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.599+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=4EDLMNGONX9M type=del size=436343 2024-09-12T00:24:31.601 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.603+0000 7f0d199128c0 1 < canceled operation key=SITJU2EUVSR8 tag=I62A38853M1I type=write size=119904 2024-09-12T00:24:31.607 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.607+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~8L0ECZ7UY9VX.0 size=501411 2024-09-12T00:24:31.608 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.607+0000 7f0d199128c0 1 > prepared multipart upload key=SITJU2EUVSR8 upload=8L0ECZ7UY9VX tag=6CPHAZLXVMSS type=write size=1549987 2024-09-12T00:24:31.611 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.611+0000 7f0d199128c0 1 < completed write operation key=0EBWUENN0881 tag=MVH5LLQAH9JT type=write size=688028 2024-09-12T00:24:31.614 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.615+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=DQJ0IPWV12BP type=del size=169297 2024-09-12T00:24:31.615 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.615+0000 7f0d199128c0 1 < canceled part key=_multipart_4K654PSDLDVI.2~KNXSEXYS8Z2R.0 size=1048576 2024-09-12T00:24:31.617 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.619+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~KNXSEXYS8Z2R.1 size=1048576 2024-09-12T00:24:31.620 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.619+0000 7f0d199128c0 1 < completed part key=_multipart_4K654PSDLDVI.2~KNXSEXYS8Z2R.2 size=445089 2024-09-12T00:24:31.625 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.623+0000 7f0d199128c0 1 < canceled multipart upload key=4K654PSDLDVI upload=KNXSEXYS8Z2R tag=L00AMDA7E1ES type=write size=3590817 2024-09-12T00:24:31.632 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.631+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~LARCPENMB1GK.0 size=118436 2024-09-12T00:24:31.632 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.631+0000 7f0d199128c0 1 > prepared multipart upload key=JA6CSJF78VE2 upload=LARCPENMB1GK tag=EH58YC1739AO type=write size=1167012 2024-09-12T00:24:31.639 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.639+0000 7f0d199128c0 1 < suggested update operation key=B58RWC9W8THG tag=J39BM5ACZYYH type=del size=732432 2024-09-12T00:24:31.646 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.647+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~PHD83K6QRWDD.0 size=1048576 2024-09-12T00:24:31.648 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.647+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~PHD83K6QRWDD.1 size=195713 2024-09-12T00:24:31.648 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.647+0000 7f0d199128c0 1 > prepared multipart upload key=1Y6B1MJP5G4L upload=PHD83K6QRWDD tag=219Y16964L6W type=write size=2292865 2024-09-12T00:24:31.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.651+0000 7f0d199128c0 1 < completed write operation key=ZWGD87Z1MMNK tag=BS7OPOCAFFHO type=write size=968030 2024-09-12T00:24:31.658 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.659+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~U43KE39XLBYV.0 size=1048576 2024-09-12T00:24:31.661 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.659+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~U43KE39XLBYV.1 size=1048576 2024-09-12T00:24:31.663 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.663+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~U43KE39XLBYV.2 size=736855 2024-09-12T00:24:31.663 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.663+0000 7f0d199128c0 1 > prepared multipart upload key=H604SA6XTFLY upload=U43KE39XLBYV tag=M4F0ER5VWJMY type=write size=3882583 2024-09-12T00:24:31.666 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.667+0000 7f0d199128c0 1 < completed delete operation key=37WTPAJGOX5L tag=AMI7OJQP6UR8 type=del 2024-09-12T00:24:31.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.671+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~1TC8OZI8HZXO.0 size=1048576 2024-09-12T00:24:31.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.675+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~1TC8OZI8HZXO.1 size=1048576 2024-09-12T00:24:31.677 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.675+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~1TC8OZI8HZXO.2 size=670956 2024-09-12T00:24:31.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.675+0000 7f0d199128c0 1 > prepared multipart upload key=9I6MZAEUS4I0 upload=1TC8OZI8HZXO tag=6YSI3ZJJD7LE type=write size=3816684 2024-09-12T00:24:31.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.679+0000 7f0d199128c0 1 < completed delete operation key=QUO5ND3O41TY tag=438N2BF4IY1E type=del 2024-09-12T00:24:31.684 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.683+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=0XJWKF41FB3G type=del size=1117971 2024-09-12T00:24:31.687 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.687+0000 7f0d199128c0 1 < canceled operation key=WPZOKZDFXK4S tag=1S2A0DRG4GNA type=del size=344298 2024-09-12T00:24:31.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.691+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~TL1Y8TWXR3KE.0 size=659302 2024-09-12T00:24:31.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.691+0000 7f0d199128c0 1 > prepared multipart upload key=A529WOKFD1NI upload=TL1Y8TWXR3KE tag=YDJLTUGIQE8V type=write size=1707878 2024-09-12T00:24:31.699 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.699+0000 7f0d199128c0 1 < suggested remove operation key=QUO5ND3O41TY tag=HQI36P7DZ9OX type=del 2024-09-12T00:24:31.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.703+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=2X2ACCAFR1OO type=del size=1137683 2024-09-12T00:24:31.706 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.707+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~M7C13GGJZIR3.0 size=1048576 2024-09-12T00:24:31.709 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.707+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~M7C13GGJZIR3.1 size=1048576 2024-09-12T00:24:31.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.711+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~M7C13GGJZIR3.2 size=53426 2024-09-12T00:24:31.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.719+0000 7f0d199128c0 1 < completed multipart upload key=RX3RVT06SGJ4 upload=M7C13GGJZIR3 tag=BT0L5YCB9U2Y type=write size=3199154 2024-09-12T00:24:31.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.727+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=I3KV19ABNP0X type=del size=1584923 2024-09-12T00:24:31.730 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.731+0000 7f0d199128c0 1 < completed delete operation key=VXZI0ZTMQSV0 tag=RUIMBX2QSGCE type=del 2024-09-12T00:24:31.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.735+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=B3UZFBMPXS14 type=del size=447492 2024-09-12T00:24:31.737 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.739+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~U3G0H2OM8K1J.0 size=1048576 2024-09-12T00:24:31.740 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.739+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~U3G0H2OM8K1J.1 size=263701 2024-09-12T00:24:31.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.747+0000 7f0d199128c0 1 < completed multipart upload key=T6GOR4SBYU2Y upload=U3G0H2OM8K1J tag=VEFBRMTG0TSO type=write size=2360853 2024-09-12T00:24:31.749 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.751+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=TUKIC53YGF3J type=del size=3162633 2024-09-12T00:24:31.753 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.751+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~9M3BEJTX6RZV.0 size=1048576 2024-09-12T00:24:31.755 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.755+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~9M3BEJTX6RZV.1 size=1048576 2024-09-12T00:24:31.758 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.759+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~9M3BEJTX6RZV.2 size=751701 2024-09-12T00:24:31.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.763+0000 7f0d199128c0 1 < completed multipart upload key=RX3RVT06SGJ4 upload=9M3BEJTX6RZV tag=KVNRXZWVG1VM type=write size=3897429 2024-09-12T00:24:31.768 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.767+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=2X81Z6WCB3LT type=del size=251309 2024-09-12T00:24:31.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.771+0000 7f0d199128c0 1 < canceled operation key=T6GOR4SBYU2Y tag=QF8RMCOHMLAT type=del size=3020175 2024-09-12T00:24:31.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.775+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=68Y40TS64CG0 type=del size=1091234 2024-09-12T00:24:31.779 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.779+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~GAE36O0RJJYG.0 size=1048576 2024-09-12T00:24:31.782 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.783+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~GAE36O0RJJYG.1 size=689443 2024-09-12T00:24:31.788 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.787+0000 7f0d199128c0 1 < completed multipart upload key=0EBWUENN0881 upload=GAE36O0RJJYG tag=YNGF64O62J5B type=write size=2786595 2024-09-12T00:24:31.795 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.795+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~NFYL4AGNFNO8.0 size=1048576 2024-09-12T00:24:31.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.799+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~NFYL4AGNFNO8.1 size=1048576 2024-09-12T00:24:31.801 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.799+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~NFYL4AGNFNO8.2 size=592033 2024-09-12T00:24:31.801 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.799+0000 7f0d199128c0 1 > prepared multipart upload key=IPJEXRBN96NB upload=NFYL4AGNFNO8 tag=1OPQGNLASUCH type=write size=3737761 2024-09-12T00:24:31.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.803+0000 7f0d199128c0 1 < completed delete operation key=HXNC728XIWC1 tag=4EDLMNGONX9M type=del 2024-09-12T00:24:31.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.807+0000 7f0d199128c0 1 > prepared operation key=57W1IO3KSWBR tag=HY91SQU1K0X8 type=del size=1910284 2024-09-12T00:24:31.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.811+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~8L0ECZ7UY9VX.0 size=501411 2024-09-12T00:24:31.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.815+0000 7f0d199128c0 1 < completed multipart upload key=SITJU2EUVSR8 upload=8L0ECZ7UY9VX tag=6CPHAZLXVMSS type=write size=1549987 2024-09-12T00:24:31.819 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.819+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=828QYO0ZX4WF type=del size=2247799 2024-09-12T00:24:31.823 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.823+0000 7f0d199128c0 1 < completed delete operation key=WPZOKZDFXK4S tag=DQJ0IPWV12BP type=del 2024-09-12T00:24:31.829 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.827+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~8SWCL1CZKDBL.0 size=1048576 2024-09-12T00:24:31.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.831+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~8SWCL1CZKDBL.1 size=837630 2024-09-12T00:24:31.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.831+0000 7f0d199128c0 1 > prepared multipart upload key=0ZT4NZYZKI5Z upload=8SWCL1CZKDBL tag=JWI49OZ21LF2 type=write size=2934782 2024-09-12T00:24:31.836 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.835+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~LARCPENMB1GK.0 size=118436 2024-09-12T00:24:31.842 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.843+0000 7f0d199128c0 1 < completed multipart upload key=JA6CSJF78VE2 upload=LARCPENMB1GK tag=EH58YC1739AO type=write size=1167012 2024-09-12T00:24:31.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.843+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=7ZDUL6W2SCLD type=del size=250511 2024-09-12T00:24:31.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.847+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~PHD83K6QRWDD.0 size=1048576 2024-09-12T00:24:31.852 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.851+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~PHD83K6QRWDD.1 size=195713 2024-09-12T00:24:31.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.855+0000 7f0d199128c0 1 < completed multipart upload key=1Y6B1MJP5G4L upload=PHD83K6QRWDD tag=219Y16964L6W type=write size=2292865 2024-09-12T00:24:31.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.863+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~81UUVU3SJ90X.0 size=1048576 2024-09-12T00:24:31.866 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.867+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~81UUVU3SJ90X.1 size=1048576 2024-09-12T00:24:31.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.867+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~81UUVU3SJ90X.2 size=462707 2024-09-12T00:24:31.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.867+0000 7f0d199128c0 1 > prepared multipart upload key=H604SA6XTFLY upload=81UUVU3SJ90X tag=JS3GET8GVBFK type=write size=3608435 2024-09-12T00:24:31.872 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.871+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~U43KE39XLBYV.0 size=1048576 2024-09-12T00:24:31.875 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.875+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~U43KE39XLBYV.1 size=1048576 2024-09-12T00:24:31.875 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.875+0000 7f0d199128c0 1 < canceled part key=_multipart_H604SA6XTFLY.2~U43KE39XLBYV.2 size=736855 2024-09-12T00:24:31.884 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.879+0000 7f0d199128c0 1 < canceled multipart upload key=H604SA6XTFLY upload=U43KE39XLBYV tag=M4F0ER5VWJMY type=write size=3882583 2024-09-12T00:24:31.887 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.887+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~P84R2S04PZT9.0 size=1048576 2024-09-12T00:24:31.889 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.891+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~P84R2S04PZT9.1 size=464086 2024-09-12T00:24:31.889 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.891+0000 7f0d199128c0 1 > prepared multipart upload key=B58RWC9W8THG upload=P84R2S04PZT9 tag=2Q8J9BYUANLR type=write size=2561238 2024-09-12T00:24:31.890 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.891+0000 7f0d199128c0 1 < canceled part key=_multipart_9I6MZAEUS4I0.2~1TC8OZI8HZXO.0 size=1048576 2024-09-12T00:24:31.894 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.895+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~1TC8OZI8HZXO.1 size=1048576 2024-09-12T00:24:31.897 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.895+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~1TC8OZI8HZXO.2 size=670956 2024-09-12T00:24:31.903 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.903+0000 7f0d199128c0 1 < canceled multipart upload key=9I6MZAEUS4I0 upload=1TC8OZI8HZXO tag=6YSI3ZJJD7LE type=write size=3816684 2024-09-12T00:24:31.909 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.907+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~MU2SXCRZXEGO.0 size=1048576 2024-09-12T00:24:31.912 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.911+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~MU2SXCRZXEGO.1 size=1048576 2024-09-12T00:24:31.915 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.915+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~MU2SXCRZXEGO.2 size=396737 2024-09-12T00:24:31.915 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.915+0000 7f0d199128c0 1 > prepared multipart upload key=10YEWZDTTEV0 upload=MU2SXCRZXEGO tag=0V2FDIMSIOPM type=write size=3542465 2024-09-12T00:24:31.922 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.923+0000 7f0d199128c0 1 < suggested remove operation key=RFCHRGVA9GOI tag=0XJWKF41FB3G type=del 2024-09-12T00:24:31.928 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.927+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~XIF6ZWBQGE3Z.0 size=728548 2024-09-12T00:24:31.928 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.927+0000 7f0d199128c0 1 > prepared multipart upload key=OVLAP0OS78QG upload=XIF6ZWBQGE3Z tag=KWC7CUQXUO4X type=write size=1777124 2024-09-12T00:24:31.931 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.931+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~TL1Y8TWXR3KE.0 size=659302 2024-09-12T00:24:31.937 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.935+0000 7f0d199128c0 1 < completed multipart upload key=A529WOKFD1NI upload=TL1Y8TWXR3KE tag=YDJLTUGIQE8V type=write size=1707878 2024-09-12T00:24:31.943 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.943+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~9SKARIXT9QYI.0 size=122503 2024-09-12T00:24:31.943 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.943+0000 7f0d199128c0 1 > prepared multipart upload key=QUO5ND3O41TY upload=9SKARIXT9QYI tag=DVQY71YP3JXA type=write size=1171079 2024-09-12T00:24:31.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.947+0000 7f0d199128c0 -1 < failed to complete operation key=RFCHRGVA9GOI tag=2X2ACCAFR1OO type=del size=1137683: (22) Invalid argument 2024-09-12T00:24:31.953 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.951+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~B1ZJ8NHDHOPA.0 size=825900 2024-09-12T00:24:31.953 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.951+0000 7f0d199128c0 1 > prepared multipart upload key=OVLAP0OS78QG upload=B1ZJ8NHDHOPA tag=YCMBSU2CG3F6 type=write size=1874476 2024-09-12T00:24:31.956 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.955+0000 7f0d199128c0 -1 < failed to complete operation key=RFCHRGVA9GOI tag=I3KV19ABNP0X type=del size=1584923: (22) Invalid argument 2024-09-12T00:24:31.959 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.959+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=HK0Q3PK6WF7Z type=del size=1357533 2024-09-12T00:24:31.966 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.967+0000 7f0d199128c0 1 < suggested update operation key=1Y6B1MJP5G4L tag=B3UZFBMPXS14 type=del size=447492 2024-09-12T00:24:31.969 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.971+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=UJHBQQE62WAY type=del size=3703701 2024-09-12T00:24:31.975 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.975+0000 7f0d199128c0 1 < suggested update operation key=0ZT4NZYZKI5Z tag=TUKIC53YGF3J type=del size=3162633 2024-09-12T00:24:31.978 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.979+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=DRK9DL4I1JXT type=del size=1640481 2024-09-12T00:24:31.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.983+0000 7f0d199128c0 1 < completed delete operation key=PK2CA62QBZXS tag=2X81Z6WCB3LT type=del 2024-09-12T00:24:31.989 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.987+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~F3BO0WY49KCD.0 size=1048576 2024-09-12T00:24:31.991 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.991+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~F3BO0WY49KCD.1 size=1048576 2024-09-12T00:24:31.993 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.991+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~F3BO0WY49KCD.2 size=989161 2024-09-12T00:24:31.993 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.991+0000 7f0d199128c0 1 > prepared multipart upload key=WBGXMJB7U422 upload=F3BO0WY49KCD tag=DBSVLLYGKAD0 type=write size=4134889 2024-09-12T00:24:31.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.995+0000 7f0d199128c0 1 < completed delete operation key=ZWGD87Z1MMNK tag=68Y40TS64CG0 type=del 2024-09-12T00:24:32.000 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:31.999+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=7PKAOOQZBFR4 type=del size=3119398 2024-09-12T00:24:32.003 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.003+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~NFYL4AGNFNO8.0 size=1048576 2024-09-12T00:24:32.005 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.007+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~NFYL4AGNFNO8.1 size=1048576 2024-09-12T00:24:32.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.007+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~NFYL4AGNFNO8.2 size=592033 2024-09-12T00:24:32.012 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.011+0000 7f0d199128c0 1 < completed multipart upload key=IPJEXRBN96NB upload=NFYL4AGNFNO8 tag=1OPQGNLASUCH type=write size=3737761 2024-09-12T00:24:32.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.019+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~SRXG68EQ1URQ.0 size=793787 2024-09-12T00:24:32.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.019+0000 7f0d199128c0 1 > prepared multipart upload key=9I6MZAEUS4I0 upload=SRXG68EQ1URQ tag=LTX1FZDOKG7S type=write size=1842363 2024-09-12T00:24:32.025 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.023+0000 7f0d199128c0 1 < suggested update operation key=57W1IO3KSWBR tag=HY91SQU1K0X8 type=del size=1910284 2024-09-12T00:24:32.030 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.031+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~J2KARI7LGLTC.0 size=1048576 2024-09-12T00:24:32.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.031+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~J2KARI7LGLTC.1 size=165416 2024-09-12T00:24:32.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.031+0000 7f0d199128c0 1 > prepared multipart upload key=ZWGD87Z1MMNK upload=J2KARI7LGLTC tag=X29ZWIOEMFWG type=write size=2262568 2024-09-12T00:24:32.039 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.039+0000 7f0d199128c0 1 < completed delete operation key=J75P0821XGRO tag=828QYO0ZX4WF type=del 2024-09-12T00:24:32.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.043+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~9AO0YN8B8B1S.0 size=420098 2024-09-12T00:24:32.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.043+0000 7f0d199128c0 1 > prepared multipart upload key=FJ8YV026H0ZU upload=9AO0YN8B8B1S tag=GGEZ2B518CZ2 type=write size=1468674 2024-09-12T00:24:32.047 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.047+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~8SWCL1CZKDBL.0 size=1048576 2024-09-12T00:24:32.050 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.051+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~8SWCL1CZKDBL.1 size=837630 2024-09-12T00:24:32.055 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.055+0000 7f0d199128c0 1 < completed multipart upload key=0ZT4NZYZKI5Z upload=8SWCL1CZKDBL tag=JWI49OZ21LF2 type=write size=2934782 2024-09-12T00:24:32.057 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.059+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=C679JHB3Y0T3 type=del size=1616668 2024-09-12T00:24:32.060 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.059+0000 7f0d199128c0 1 < completed delete operation key=PK2CA62QBZXS tag=7ZDUL6W2SCLD type=del 2024-09-12T00:24:32.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.067+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~645LTO2NRONM.0 size=1024615 2024-09-12T00:24:32.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.067+0000 7f0d199128c0 1 > prepared multipart upload key=FJ8YV026H0ZU upload=645LTO2NRONM tag=S4UHD9XVGW14 type=write size=2073191 2024-09-12T00:24:32.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.071+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~81UUVU3SJ90X.0 size=1048576 2024-09-12T00:24:32.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.071+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~81UUVU3SJ90X.1 size=1048576 2024-09-12T00:24:32.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.075+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~81UUVU3SJ90X.2 size=462707 2024-09-12T00:24:32.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.079+0000 7f0d199128c0 1 < completed multipart upload key=H604SA6XTFLY upload=81UUVU3SJ90X tag=JS3GET8GVBFK type=write size=3608435 2024-09-12T00:24:32.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.083+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=SB6QWSZZ97KQ type=del size=1533063 2024-09-12T00:24:32.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.087+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~P84R2S04PZT9.0 size=1048576 2024-09-12T00:24:32.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.087+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~P84R2S04PZT9.1 size=464086 2024-09-12T00:24:32.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.095+0000 7f0d199128c0 1 < completed multipart upload key=B58RWC9W8THG upload=P84R2S04PZT9 tag=2Q8J9BYUANLR type=write size=2561238 2024-09-12T00:24:32.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.095+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=N84M2G37FP7W type=del size=3033950 2024-09-12T00:24:32.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.099+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~MU2SXCRZXEGO.0 size=1048576 2024-09-12T00:24:32.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.103+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~MU2SXCRZXEGO.1 size=1048576 2024-09-12T00:24:32.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.103+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~MU2SXCRZXEGO.2 size=396737 2024-09-12T00:24:32.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.111+0000 7f0d199128c0 1 < completed multipart upload key=10YEWZDTTEV0 upload=MU2SXCRZXEGO tag=0V2FDIMSIOPM type=write size=3542465 2024-09-12T00:24:32.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.115+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=7NKOGV2EZTJZ type=del size=2959748 2024-09-12T00:24:32.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.119+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~XIF6ZWBQGE3Z.0 size=728548 2024-09-12T00:24:32.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.123+0000 7f0d199128c0 1 < completed multipart upload key=OVLAP0OS78QG upload=XIF6ZWBQGE3Z tag=KWC7CUQXUO4X type=write size=1777124 2024-09-12T00:24:32.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.127+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~CFEO0EMV1VLL.0 size=937675 2024-09-12T00:24:32.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.127+0000 7f0d199128c0 1 > prepared multipart upload key=GH0FNY2AI00G upload=CFEO0EMV1VLL tag=J5DUL1KMLCLZ type=write size=1986251 2024-09-12T00:24:32.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.131+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~9SKARIXT9QYI.0 size=122503 2024-09-12T00:24:32.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.135+0000 7f0d199128c0 1 < completed multipart upload key=QUO5ND3O41TY upload=9SKARIXT9QYI tag=DVQY71YP3JXA type=write size=1171079 2024-09-12T00:24:32.143 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.143+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~1XIY85F21OTG.0 size=748318 2024-09-12T00:24:32.143 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.143+0000 7f0d199128c0 1 > prepared multipart upload key=VXZI0ZTMQSV0 upload=1XIY85F21OTG tag=XH60L5XNRON6 type=write size=1796894 2024-09-12T00:24:32.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.147+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~B1ZJ8NHDHOPA.0 size=825900 2024-09-12T00:24:32.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.151+0000 7f0d199128c0 1 < completed multipart upload key=OVLAP0OS78QG upload=B1ZJ8NHDHOPA tag=YCMBSU2CG3F6 type=write size=1874476 2024-09-12T00:24:32.157 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.159+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~MW0050HUJZEC.0 size=1048576 2024-09-12T00:24:32.160 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.159+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~MW0050HUJZEC.1 size=1048576 2024-09-12T00:24:32.162 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.163+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~MW0050HUJZEC.2 size=785993 2024-09-12T00:24:32.163 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.163+0000 7f0d199128c0 1 > prepared multipart upload key=H604SA6XTFLY upload=MW0050HUJZEC tag=SL31UR6DMQA9 type=write size=3931721 2024-09-12T00:24:32.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.167+0000 7f0d199128c0 1 < canceled operation key=HXNC728XIWC1 tag=HK0Q3PK6WF7Z type=del size=1357533 2024-09-12T00:24:32.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.171+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~Z2HWHBLOP01C.0 size=1048576 2024-09-12T00:24:32.175 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.175+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~Z2HWHBLOP01C.1 size=260972 2024-09-12T00:24:32.175 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.175+0000 7f0d199128c0 1 > prepared multipart upload key=B58RWC9W8THG upload=Z2HWHBLOP01C tag=76MS1QV6638J type=write size=2358124 2024-09-12T00:24:32.179 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.179+0000 7f0d199128c0 1 < completed delete operation key=NXQYUQIR2APT tag=UJHBQQE62WAY type=del 2024-09-12T00:24:32.182 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.183+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=72VDC7RFHQSW type=del size=667236 2024-09-12T00:24:32.186 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.187+0000 7f0d199128c0 1 < completed delete operation key=RX3RVT06SGJ4 tag=DRK9DL4I1JXT type=del 2024-09-12T00:24:32.192 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.191+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~TF7KQRP6TFYS.0 size=1048576 2024-09-12T00:24:32.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.195+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~TF7KQRP6TFYS.1 size=941976 2024-09-12T00:24:32.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.195+0000 7f0d199128c0 1 > prepared multipart upload key=2EK9CCKG26W2 upload=TF7KQRP6TFYS tag=PZDZHSJDHLDC type=write size=3039128 2024-09-12T00:24:32.198 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.199+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~F3BO0WY49KCD.0 size=1048576 2024-09-12T00:24:32.199 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.199+0000 7f0d199128c0 1 < canceled part key=_multipart_WBGXMJB7U422.2~F3BO0WY49KCD.1 size=1048576 2024-09-12T00:24:32.201 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.203+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~F3BO0WY49KCD.2 size=989161 2024-09-12T00:24:32.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.207+0000 7f0d199128c0 1 < canceled multipart upload key=WBGXMJB7U422 upload=F3BO0WY49KCD tag=DBSVLLYGKAD0 type=write size=4134889 2024-09-12T00:24:32.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.211+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=5LYBNZXB7VO0 type=del size=525477 2024-09-12T00:24:32.213 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.215+0000 7f0d199128c0 1 < completed delete operation key=RX3RVT06SGJ4 tag=7PKAOOQZBFR4 type=del 2024-09-12T00:24:32.216 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.215+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=VVQ1BSTN7L6N type=write size=214589 2024-09-12T00:24:32.219 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.219+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~SRXG68EQ1URQ.0 size=793787 2024-09-12T00:24:32.225 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.223+0000 7f0d199128c0 1 < completed multipart upload key=9I6MZAEUS4I0 upload=SRXG68EQ1URQ tag=LTX1FZDOKG7S type=write size=1842363 2024-09-12T00:24:32.227 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.227+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=HR6I9OKUMNL4 type=del size=586531 2024-09-12T00:24:32.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.231+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~J2KARI7LGLTC.0 size=1048576 2024-09-12T00:24:32.231 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.231+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~J2KARI7LGLTC.1 size=165416 2024-09-12T00:24:32.235 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.235+0000 7f0d199128c0 1 < completed multipart upload key=ZWGD87Z1MMNK upload=J2KARI7LGLTC tag=X29ZWIOEMFWG type=write size=2262568 2024-09-12T00:24:32.237 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.235+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=2KGOKJUROJXO type=write size=18720 2024-09-12T00:24:32.239 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.239+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~9AO0YN8B8B1S.0 size=420098 2024-09-12T00:24:32.243 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.243+0000 7f0d199128c0 1 < completed multipart upload key=FJ8YV026H0ZU upload=9AO0YN8B8B1S tag=GGEZ2B518CZ2 type=write size=1468674 2024-09-12T00:24:32.245 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.243+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=O9O17OPWI0TZ type=del size=327281 2024-09-12T00:24:32.248 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.247+0000 7f0d199128c0 1 < completed delete operation key=0ZT4NZYZKI5Z tag=C679JHB3Y0T3 type=del 2024-09-12T00:24:32.254 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.255+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~V5DE68EAM5HV.0 size=515893 2024-09-12T00:24:32.254 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.255+0000 7f0d199128c0 1 > prepared multipart upload key=1Y6B1MJP5G4L upload=V5DE68EAM5HV tag=JZPT0CNW5CKI type=write size=1564469 2024-09-12T00:24:32.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.255+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~645LTO2NRONM.0 size=1024615 2024-09-12T00:24:32.262 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.263+0000 7f0d199128c0 1 < completed multipart upload key=FJ8YV026H0ZU upload=645LTO2NRONM tag=S4UHD9XVGW14 type=write size=2073191 2024-09-12T00:24:32.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.263+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=WTLCDG3W1ZQG type=del size=3391017 2024-09-12T00:24:32.268 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.267+0000 7f0d199128c0 1 < completed delete operation key=V6H6S9X0U2A0 tag=SB6QWSZZ97KQ type=del 2024-09-12T00:24:32.270 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.271+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=INN0YKI8N229 type=del size=3187469 2024-09-12T00:24:32.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.271+0000 7f0d199128c0 1 < completed delete operation key=YTXW98O07966 tag=N84M2G37FP7W type=del 2024-09-12T00:24:32.276 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.275+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=S18RWNV0YD37 type=del size=1293257 2024-09-12T00:24:32.279 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.279+0000 7f0d199128c0 1 < canceled operation key=FJ8YV026H0ZU tag=7NKOGV2EZTJZ type=del size=2959748 2024-09-12T00:24:32.282 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.283+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=TJBKD1YEP9O3 type=del size=526483 2024-09-12T00:24:32.285 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.283+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~CFEO0EMV1VLL.0 size=937675 2024-09-12T00:24:32.290 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.291+0000 7f0d199128c0 1 < completed multipart upload key=GH0FNY2AI00G upload=CFEO0EMV1VLL tag=J5DUL1KMLCLZ type=write size=1986251 2024-09-12T00:24:32.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.291+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=FJDYUYDBX8AX type=del size=788067 2024-09-12T00:24:32.295 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.295+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~1XIY85F21OTG.0 size=748318 2024-09-12T00:24:32.300 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.299+0000 7f0d199128c0 1 < completed multipart upload key=VXZI0ZTMQSV0 upload=1XIY85F21OTG tag=XH60L5XNRON6 type=write size=1796894 2024-09-12T00:24:32.303 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.303+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=XU4UXPZA25EC type=del size=3593188 2024-09-12T00:24:32.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.307+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~MW0050HUJZEC.0 size=1048576 2024-09-12T00:24:32.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.307+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~MW0050HUJZEC.1 size=1048576 2024-09-12T00:24:32.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.307+0000 7f0d199128c0 1 < canceled part key=_multipart_H604SA6XTFLY.2~MW0050HUJZEC.2 size=785993 2024-09-12T00:24:32.314 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.315+0000 7f0d199128c0 1 < canceled multipart upload key=H604SA6XTFLY upload=MW0050HUJZEC tag=SL31UR6DMQA9 type=write size=3931721 2024-09-12T00:24:32.325 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.323+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~0LPJP8HPRP7Y.0 size=689787 2024-09-12T00:24:32.325 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.323+0000 7f0d199128c0 1 > prepared multipart upload key=IPJEXRBN96NB upload=0LPJP8HPRP7Y tag=SNJE1814I3BQ type=write size=1738363 2024-09-12T00:24:32.327 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.327+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~Z2HWHBLOP01C.0 size=1048576 2024-09-12T00:24:32.329 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.327+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~Z2HWHBLOP01C.1 size=260972 2024-09-12T00:24:32.333 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.331+0000 7f0d199128c0 1 < completed multipart upload key=B58RWC9W8THG upload=Z2HWHBLOP01C tag=76MS1QV6638J type=write size=2358124 2024-09-12T00:24:32.335 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.335+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=W54KUA0Z69RK type=del size=2091339 2024-09-12T00:24:32.338 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.339+0000 7f0d199128c0 1 < completed delete operation key=A529WOKFD1NI tag=72VDC7RFHQSW type=del 2024-09-12T00:24:32.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.339+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~CVYEUQ1H5HGT.0 size=1048576 2024-09-12T00:24:32.343 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.343+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~CVYEUQ1H5HGT.1 size=1048576 2024-09-12T00:24:32.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.343+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~CVYEUQ1H5HGT.2 size=865041 2024-09-12T00:24:32.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.343+0000 7f0d199128c0 1 > prepared multipart upload key=OVLAP0OS78QG upload=CVYEUQ1H5HGT tag=B0DIKVQSEX8Q type=write size=4010769 2024-09-12T00:24:32.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.347+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~TF7KQRP6TFYS.0 size=1048576 2024-09-12T00:24:32.348 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.347+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~TF7KQRP6TFYS.1 size=941976 2024-09-12T00:24:32.351 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.351+0000 7f0d199128c0 1 < completed multipart upload key=2EK9CCKG26W2 upload=TF7KQRP6TFYS tag=PZDZHSJDHLDC type=write size=3039128 2024-09-12T00:24:32.353 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.351+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=PG27NZFA1AM4 type=del size=1700018 2024-09-12T00:24:32.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.355+0000 7f0d199128c0 1 < completed delete operation key=YTXW98O07966 tag=5LYBNZXB7VO0 type=del 2024-09-12T00:24:32.358 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.359+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~96VZSZRPCYNU.0 size=1048576 2024-09-12T00:24:32.360 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.359+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~96VZSZRPCYNU.1 size=1048576 2024-09-12T00:24:32.362 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.363+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~96VZSZRPCYNU.2 size=114648 2024-09-12T00:24:32.362 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.363+0000 7f0d199128c0 1 > prepared multipart upload key=WBGXMJB7U422 upload=96VZSZRPCYNU tag=N7ZU012BI637 type=write size=3260376 2024-09-12T00:24:32.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.367+0000 7f0d199128c0 1 < suggested update operation key=WBGXMJB7U422 tag=VVQ1BSTN7L6N type=write size=214589 2024-09-12T00:24:32.368 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.367+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=IQXV78J17FU1 type=del size=1316573 2024-09-12T00:24:32.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.371+0000 7f0d199128c0 1 < completed delete operation key=ZWGD87Z1MMNK tag=HR6I9OKUMNL4 type=del 2024-09-12T00:24:32.372 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.371+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=HRQ6WB5Y8D5R type=del size=1929287 2024-09-12T00:24:32.374 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.375+0000 7f0d199128c0 1 < completed write operation key=QUO5ND3O41TY tag=2KGOKJUROJXO type=write size=18720 2024-09-12T00:24:32.376 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.375+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=UX6F9BCLCI48 type=del size=3578288 2024-09-12T00:24:32.378 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.379+0000 7f0d199128c0 1 < completed delete operation key=V6H6S9X0U2A0 tag=O9O17OPWI0TZ type=del 2024-09-12T00:24:32.383 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.383+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~5A17FYG8UP8H.0 size=143016 2024-09-12T00:24:32.383 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.383+0000 7f0d199128c0 1 > prepared multipart upload key=NXQYUQIR2APT upload=5A17FYG8UP8H tag=DDDEWOJ83SS1 type=write size=1191592 2024-09-12T00:24:32.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.387+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~V5DE68EAM5HV.0 size=515893 2024-09-12T00:24:32.392 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.391+0000 7f0d199128c0 1 < completed multipart upload key=1Y6B1MJP5G4L upload=V5DE68EAM5HV tag=JZPT0CNW5CKI type=write size=1564469 2024-09-12T00:24:32.397 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.395+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~OD0FU18ZG90Z.0 size=533629 2024-09-12T00:24:32.397 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.395+0000 7f0d199128c0 1 > prepared multipart upload key=37WTPAJGOX5L upload=OD0FU18ZG90Z tag=TUTR8EBEMFLN type=write size=1582205 2024-09-12T00:24:32.400 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.399+0000 7f0d199128c0 1 < completed delete operation key=YTXW98O07966 tag=WTLCDG3W1ZQG type=del 2024-09-12T00:24:32.407 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.407+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~XSWEOG7JGVHK.0 size=1048576 2024-09-12T00:24:32.408 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.407+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~XSWEOG7JGVHK.1 size=1048576 2024-09-12T00:24:32.410 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.411+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~XSWEOG7JGVHK.2 size=733389 2024-09-12T00:24:32.410 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.411+0000 7f0d199128c0 1 > prepared multipart upload key=H604SA6XTFLY upload=XSWEOG7JGVHK tag=L7OLHCP01MW2 type=write size=3879117 2024-09-12T00:24:32.413 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.415+0000 7f0d199128c0 1 < completed delete operation key=T6GOR4SBYU2Y tag=INN0YKI8N229 type=del 2024-09-12T00:24:32.416 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.415+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=TNXTIYJLTNAP type=write size=396915 2024-09-12T00:24:32.420 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.419+0000 7f0d199128c0 1 < completed delete operation key=RFCHRGVA9GOI tag=S18RWNV0YD37 type=del 2024-09-12T00:24:32.424 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.423+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=J3WUY5DESXJ6 type=write size=792466 2024-09-12T00:24:32.430 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.431+0000 7f0d199128c0 1 < suggested remove operation key=ZWGD87Z1MMNK tag=TJBKD1YEP9O3 type=del 2024-09-12T00:24:32.433 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.435+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=HTWEWDKIADKJ type=del size=111398 2024-09-12T00:24:32.437 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.439+0000 7f0d199128c0 1 < completed delete operation key=WPZOKZDFXK4S tag=FJDYUYDBX8AX type=del 2024-09-12T00:24:32.441 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.439+0000 7f0d199128c0 1 > prepared operation key=57W1IO3KSWBR tag=VI7MT8E7HADT type=del size=3149085 2024-09-12T00:24:32.444 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.443+0000 7f0d199128c0 1 < canceled operation key=37WTPAJGOX5L tag=XU4UXPZA25EC type=del size=3593188 2024-09-12T00:24:32.450 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.451+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~XZT2W4ROB2RH.0 size=1048576 2024-09-12T00:24:32.452 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.451+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~XZT2W4ROB2RH.1 size=1048576 2024-09-12T00:24:32.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.455+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~XZT2W4ROB2RH.2 size=976650 2024-09-12T00:24:32.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.455+0000 7f0d199128c0 1 > prepared multipart upload key=WBGXMJB7U422 upload=XZT2W4ROB2RH tag=ZAH4P19OEDF9 type=write size=4122378 2024-09-12T00:24:32.457 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.459+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~0LPJP8HPRP7Y.0 size=689787 2024-09-12T00:24:32.462 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.463+0000 7f0d199128c0 1 < completed multipart upload key=IPJEXRBN96NB upload=0LPJP8HPRP7Y tag=SNJE1814I3BQ type=write size=1738363 2024-09-12T00:24:32.465 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.463+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=U2MB7MKMP843 type=del size=82834 2024-09-12T00:24:32.471 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.471+0000 7f0d199128c0 1 < suggested remove operation key=B58RWC9W8THG tag=W54KUA0Z69RK type=del 2024-09-12T00:24:32.474 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.475+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=1HYKRCKQW5FE type=del size=386822 2024-09-12T00:24:32.475 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.475+0000 7f0d199128c0 1 < canceled part key=_multipart_OVLAP0OS78QG.2~CVYEUQ1H5HGT.0 size=1048576 2024-09-12T00:24:32.477 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.475+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~CVYEUQ1H5HGT.1 size=1048576 2024-09-12T00:24:32.479 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.479+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~CVYEUQ1H5HGT.2 size=865041 2024-09-12T00:24:32.484 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.483+0000 7f0d199128c0 1 < canceled multipart upload key=OVLAP0OS78QG upload=CVYEUQ1H5HGT tag=B0DIKVQSEX8Q type=write size=4010769 2024-09-12T00:24:32.487 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.487+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=2BKKV0HY7BDJ type=del size=520909 2024-09-12T00:24:32.493 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.491+0000 7f0d199128c0 1 < suggested remove operation key=V6H6S9X0U2A0 tag=PG27NZFA1AM4 type=del 2024-09-12T00:24:32.496 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.495+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=A0YHJE8CK47C type=del size=2221606 2024-09-12T00:24:32.499 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.499+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~96VZSZRPCYNU.0 size=1048576 2024-09-12T00:24:32.501 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.503+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~96VZSZRPCYNU.1 size=1048576 2024-09-12T00:24:32.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.503+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~96VZSZRPCYNU.2 size=114648 2024-09-12T00:24:32.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.511+0000 7f0d199128c0 1 < completed multipart upload key=WBGXMJB7U422 upload=96VZSZRPCYNU tag=N7ZU012BI637 type=write size=3260376 2024-09-12T00:24:32.513 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.511+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=AVC6H2DKJ0FQ type=del size=3707905 2024-09-12T00:24:32.516 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.515+0000 7f0d199128c0 1 < completed delete operation key=0ZT4NZYZKI5Z tag=IQXV78J17FU1 type=del 2024-09-12T00:24:32.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.519+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~3OJXXBYA0WHN.0 size=1048576 2024-09-12T00:24:32.524 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.523+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~3OJXXBYA0WHN.1 size=62602 2024-09-12T00:24:32.524 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.523+0000 7f0d199128c0 1 > prepared multipart upload key=0EBWUENN0881 upload=3OJXXBYA0WHN tag=61QN2I5WKWLG type=write size=2159754 2024-09-12T00:24:32.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.527+0000 7f0d199128c0 1 < completed delete operation key=WBGXMJB7U422 tag=HRQ6WB5Y8D5R type=del 2024-09-12T00:24:32.529 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.527+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=IIWBOCD506BE type=del size=2196523 2024-09-12T00:24:32.532 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.531+0000 7f0d199128c0 1 < completed delete operation key=37WTPAJGOX5L tag=UX6F9BCLCI48 type=del 2024-09-12T00:24:32.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.539+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~SN03687PUW2T.0 size=1048576 2024-09-12T00:24:32.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.539+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~SN03687PUW2T.1 size=625922 2024-09-12T00:24:32.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.539+0000 7f0d199128c0 1 > prepared multipart upload key=NXQYUQIR2APT upload=SN03687PUW2T tag=CSJE8043F24F type=write size=2723074 2024-09-12T00:24:32.543 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.543+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~5A17FYG8UP8H.0 size=143016 2024-09-12T00:24:32.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.547+0000 7f0d199128c0 1 < completed multipart upload key=NXQYUQIR2APT upload=5A17FYG8UP8H tag=DDDEWOJ83SS1 type=write size=1191592 2024-09-12T00:24:32.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.551+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=77ZLUTCNQ7CD type=write size=272723 2024-09-12T00:24:32.554 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.555+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~OD0FU18ZG90Z.0 size=533629 2024-09-12T00:24:32.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.559+0000 7f0d199128c0 1 < completed multipart upload key=37WTPAJGOX5L upload=OD0FU18ZG90Z tag=TUTR8EBEMFLN type=write size=1582205 2024-09-12T00:24:32.562 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.563+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=PAHPIP87ENY4 type=write size=115068 2024-09-12T00:24:32.566 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.567+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~XSWEOG7JGVHK.0 size=1048576 2024-09-12T00:24:32.568 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.567+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~XSWEOG7JGVHK.1 size=1048576 2024-09-12T00:24:32.571 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.571+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~XSWEOG7JGVHK.2 size=733389 2024-09-12T00:24:32.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.575+0000 7f0d199128c0 1 < completed multipart upload key=H604SA6XTFLY upload=XSWEOG7JGVHK tag=L7OLHCP01MW2 type=write size=3879117 2024-09-12T00:24:32.584 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.583+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=WHMNXX6HQQ79 type=write size=1002637 2024-09-12T00:24:32.587 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.587+0000 7f0d199128c0 1 < completed write operation key=0EBWUENN0881 tag=TNXTIYJLTNAP type=write size=396915 2024-09-12T00:24:32.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.591+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=8ZTCHTLHL94Q type=del size=275210 2024-09-12T00:24:32.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.591+0000 7f0d199128c0 1 < completed write operation key=0EBWUENN0881 tag=J3WUY5DESXJ6 type=write size=792466 2024-09-12T00:24:32.600 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.599+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~W20R822YO3B0.0 size=1048576 2024-09-12T00:24:32.603 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.603+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~W20R822YO3B0.1 size=1028741 2024-09-12T00:24:32.603 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.603+0000 7f0d199128c0 1 > prepared multipart upload key=10YEWZDTTEV0 upload=W20R822YO3B0 tag=CGSBS7LIBJ6S type=write size=3125893 2024-09-12T00:24:32.607 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.607+0000 7f0d199128c0 1 < completed delete operation key=OVLAP0OS78QG tag=HTWEWDKIADKJ type=del 2024-09-12T00:24:32.611 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.611+0000 7f0d199128c0 1 > prepared operation key=57W1IO3KSWBR tag=XAG2ASX83L5G type=del size=2037067 2024-09-12T00:24:32.614 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.615+0000 7f0d199128c0 1 < completed delete operation key=57W1IO3KSWBR tag=VI7MT8E7HADT type=del 2024-09-12T00:24:32.618 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.619+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=8L3KTYFUK7C7 type=del size=3054788 2024-09-12T00:24:32.623 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.623+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~XZT2W4ROB2RH.0 size=1048576 2024-09-12T00:24:32.625 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.623+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~XZT2W4ROB2RH.1 size=1048576 2024-09-12T00:24:32.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.627+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~XZT2W4ROB2RH.2 size=976650 2024-09-12T00:24:32.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.635+0000 7f0d199128c0 1 < completed multipart upload key=WBGXMJB7U422 upload=XZT2W4ROB2RH tag=ZAH4P19OEDF9 type=write size=4122378 2024-09-12T00:24:32.639 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.639+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~9HIFMH9M2XA7.0 size=1048576 2024-09-12T00:24:32.641 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.643+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~9HIFMH9M2XA7.1 size=911232 2024-09-12T00:24:32.642 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.643+0000 7f0d199128c0 1 > prepared multipart upload key=A529WOKFD1NI upload=9HIFMH9M2XA7 tag=1ZVOWJPXLIFT type=write size=3008384 2024-09-12T00:24:32.644 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.643+0000 7f0d199128c0 1 < completed delete operation key=RFCHRGVA9GOI tag=U2MB7MKMP843 type=del 2024-09-12T00:24:32.647 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.647+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=XX8BQQ7EJ048 type=del size=462653 2024-09-12T00:24:32.653 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.651+0000 7f0d199128c0 1 < suggested remove operation key=VXZI0ZTMQSV0 tag=1HYKRCKQW5FE type=del 2024-09-12T00:24:32.658 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.659+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~1IV8416JWFO2.0 size=1048576 2024-09-12T00:24:32.660 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.659+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~1IV8416JWFO2.1 size=940701 2024-09-12T00:24:32.661 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.659+0000 7f0d199128c0 1 > prepared multipart upload key=SITJU2EUVSR8 upload=1IV8416JWFO2 tag=G7DQOHJKE819 type=write size=3037853 2024-09-12T00:24:32.666 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.667+0000 7f0d199128c0 1 < suggested remove operation key=0EBWUENN0881 tag=2BKKV0HY7BDJ type=del 2024-09-12T00:24:32.669 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.667+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=4RW8BN21S629 type=del size=1843450 2024-09-12T00:24:32.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.671+0000 7f0d199128c0 1 < completed delete operation key=1Y6B1MJP5G4L tag=A0YHJE8CK47C type=del 2024-09-12T00:24:32.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.675+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=8RABU8XSX983 type=del size=3834479 2024-09-12T00:24:32.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.679+0000 7f0d199128c0 1 < suggested update operation key=GH0FNY2AI00G tag=AVC6H2DKJ0FQ type=del size=3707905 2024-09-12T00:24:32.684 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.683+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=7H6YKDJJQ611 type=write size=156565 2024-09-12T00:24:32.688 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.687+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~3OJXXBYA0WHN.0 size=1048576 2024-09-12T00:24:32.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.691+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~3OJXXBYA0WHN.1 size=62602 2024-09-12T00:24:32.696 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.695+0000 7f0d199128c0 1 < completed multipart upload key=0EBWUENN0881 upload=3OJXXBYA0WHN tag=61QN2I5WKWLG type=write size=2159754 2024-09-12T00:24:32.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.699+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=TIK3KRRCOSYN type=del size=1418559 2024-09-12T00:24:32.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.703+0000 7f0d199128c0 1 < suggested remove operation key=2EK9CCKG26W2 tag=IIWBOCD506BE type=del 2024-09-12T00:24:32.707 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.707+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=ZEK3VDJG051X type=del size=3737685 2024-09-12T00:24:32.708 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.707+0000 7f0d199128c0 1 < canceled part key=_multipart_NXQYUQIR2APT.2~SN03687PUW2T.0 size=1048576 2024-09-12T00:24:32.710 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.711+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~SN03687PUW2T.1 size=625922 2024-09-12T00:24:32.715 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.715+0000 7f0d199128c0 1 < canceled multipart upload key=NXQYUQIR2APT upload=SN03687PUW2T tag=CSJE8043F24F type=write size=2723074 2024-09-12T00:24:32.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.719+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=9H2GOO8S2D6B type=del size=3952288 2024-09-12T00:24:32.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.719+0000 7f0d199128c0 -1 < no bi entry to suggest for operation key=2EK9CCKG26W2 tag=77ZLUTCNQ7CD type=write size=272723: (2) No such file or directory 2024-09-12T00:24:32.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.723+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=X89ALTHL3L6K type=del size=423182 2024-09-12T00:24:32.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.727+0000 7f0d199128c0 1 < completed write operation key=FJ8YV026H0ZU tag=PAHPIP87ENY4 type=write size=115068 2024-09-12T00:24:32.732 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.731+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~I233FEHKWVH4.0 size=1048576 2024-09-12T00:24:32.735 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.735+0000 7f0d199128c0 1 > prepared part key=_multipart_0ZT4NZYZKI5Z.2~I233FEHKWVH4.1 size=426261 2024-09-12T00:24:32.735 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.735+0000 7f0d199128c0 1 > prepared multipart upload key=0ZT4NZYZKI5Z upload=I233FEHKWVH4 tag=8HV323DOSZP9 type=write size=2523413 2024-09-12T00:24:32.738 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.739+0000 7f0d199128c0 1 < completed write operation key=H604SA6XTFLY tag=WHMNXX6HQQ79 type=write size=1002637 2024-09-12T00:24:32.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.743+0000 7f0d199128c0 1 > prepared operation key=57W1IO3KSWBR tag=5ZDX0IYCXULF type=del size=3581354 2024-09-12T00:24:32.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.743+0000 7f0d199128c0 1 < completed delete operation key=FJ8YV026H0ZU tag=8ZTCHTLHL94Q type=del 2024-09-12T00:24:32.749 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.747+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=GR63XSE9S7N3 type=del size=420911 2024-09-12T00:24:32.752 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.751+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~W20R822YO3B0.0 size=1048576 2024-09-12T00:24:32.755 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.755+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~W20R822YO3B0.1 size=1028741 2024-09-12T00:24:32.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.759+0000 7f0d199128c0 1 < completed multipart upload key=10YEWZDTTEV0 upload=W20R822YO3B0 tag=CGSBS7LIBJ6S type=write size=3125893 2024-09-12T00:24:32.767 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.767+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~QQ5LPFOKF7U0.0 size=1048576 2024-09-12T00:24:32.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.767+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~QQ5LPFOKF7U0.1 size=1048576 2024-09-12T00:24:32.772 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.771+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~QQ5LPFOKF7U0.2 size=507461 2024-09-12T00:24:32.772 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.771+0000 7f0d199128c0 1 > prepared multipart upload key=WBGXMJB7U422 upload=QQ5LPFOKF7U0 tag=ONQWI5XIVTLY type=write size=3653189 2024-09-12T00:24:32.778 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.779+0000 7f0d199128c0 1 < suggested update operation key=57W1IO3KSWBR tag=XAG2ASX83L5G type=del size=2037067 2024-09-12T00:24:32.781 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.783+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=9IUJTX7UL3NB type=del size=3600241 2024-09-12T00:24:32.785 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.783+0000 7f0d199128c0 1 < completed delete operation key=JA6CSJF78VE2 tag=8L3KTYFUK7C7 type=del 2024-09-12T00:24:32.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.791+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~27IKM6KOSJ9L.0 size=1048576 2024-09-12T00:24:32.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.795+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~27IKM6KOSJ9L.1 size=1048576 2024-09-12T00:24:32.796 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.795+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~27IKM6KOSJ9L.2 size=166097 2024-09-12T00:24:32.796 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.795+0000 7f0d199128c0 1 > prepared multipart upload key=FJ8YV026H0ZU upload=27IKM6KOSJ9L tag=GV10OPX1EHBK type=write size=3311825 2024-09-12T00:24:32.799 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.799+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~9HIFMH9M2XA7.0 size=1048576 2024-09-12T00:24:32.802 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.803+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~9HIFMH9M2XA7.1 size=911232 2024-09-12T00:24:32.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.807+0000 7f0d199128c0 1 < completed multipart upload key=A529WOKFD1NI upload=9HIFMH9M2XA7 tag=1ZVOWJPXLIFT type=write size=3008384 2024-09-12T00:24:32.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.811+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=5TO6S0ITG4SB type=del size=217401 2024-09-12T00:24:32.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.815+0000 7f0d199128c0 1 < completed delete operation key=PK2CA62QBZXS tag=XX8BQQ7EJ048 type=del 2024-09-12T00:24:32.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.819+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~B6JBGR7MCJ1T.0 size=1048576 2024-09-12T00:24:32.823 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.823+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~B6JBGR7MCJ1T.1 size=1048576 2024-09-12T00:24:32.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.827+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~B6JBGR7MCJ1T.2 size=500943 2024-09-12T00:24:32.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.827+0000 7f0d199128c0 1 > prepared multipart upload key=YTXW98O07966 upload=B6JBGR7MCJ1T tag=8D282B9AGH2D type=write size=3646671 2024-09-12T00:24:32.826 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.827+0000 7f0d199128c0 1 < canceled part key=_multipart_SITJU2EUVSR8.2~1IV8416JWFO2.0 size=1048576 2024-09-12T00:24:32.829 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.827+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~1IV8416JWFO2.1 size=940701 2024-09-12T00:24:32.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.835+0000 7f0d199128c0 1 < canceled multipart upload key=SITJU2EUVSR8 upload=1IV8416JWFO2 tag=G7DQOHJKE819 type=write size=3037853 2024-09-12T00:24:32.842 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.843+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~L1ZK8ZPRSGD5.0 size=989521 2024-09-12T00:24:32.842 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.843+0000 7f0d199128c0 1 > prepared multipart upload key=V6H6S9X0U2A0 upload=L1ZK8ZPRSGD5 tag=RYAO7VTM6Q9I type=write size=2038097 2024-09-12T00:24:32.846 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.847+0000 7f0d199128c0 1 < completed delete operation key=37WTPAJGOX5L tag=4RW8BN21S629 type=del 2024-09-12T00:24:32.852 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.851+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~AJ8N7YKGWFVU.0 size=487394 2024-09-12T00:24:32.852 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.851+0000 7f0d199128c0 1 > prepared multipart upload key=PK2CA62QBZXS upload=AJ8N7YKGWFVU tag=PAA4017OLFN6 type=write size=1535970 2024-09-12T00:24:32.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.855+0000 7f0d199128c0 1 < completed delete operation key=SITJU2EUVSR8 tag=8RABU8XSX983 type=del 2024-09-12T00:24:32.862 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.863+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~33YVDDYRI4AY.0 size=1048576 2024-09-12T00:24:32.866 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.867+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~33YVDDYRI4AY.1 size=1048576 2024-09-12T00:24:32.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.871+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~33YVDDYRI4AY.2 size=534878 2024-09-12T00:24:32.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.871+0000 7f0d199128c0 1 > prepared multipart upload key=ZWGD87Z1MMNK upload=33YVDDYRI4AY tag=3BTD40D7O35V type=write size=3680606 2024-09-12T00:24:32.873 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.871+0000 7f0d199128c0 1 < completed write operation key=0EBWUENN0881 tag=7H6YKDJJQ611 type=write size=156565 2024-09-12T00:24:32.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.875+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=07C9HEUO2TMI type=del size=515662 2024-09-12T00:24:32.882 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.883+0000 7f0d199128c0 1 < suggested remove operation key=YTXW98O07966 tag=TIK3KRRCOSYN type=del 2024-09-12T00:24:32.885 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.883+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=T1F5KLKFNKHS type=del size=496402 2024-09-12T00:24:32.894 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.895+0000 7f0d199128c0 1 < suggested remove operation key=0EBWUENN0881 tag=ZEK3VDJG051X type=del 2024-09-12T00:24:32.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.899+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=M07KQ4E8VCQL type=del size=1712744 2024-09-12T00:24:32.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.899+0000 7f0d199128c0 1 < completed delete operation key=OVLAP0OS78QG tag=9H2GOO8S2D6B type=del 2024-09-12T00:24:32.904 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.903+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=TOIN2TTV081O type=del size=2642816 2024-09-12T00:24:32.908 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.907+0000 7f0d199128c0 1 < completed delete operation key=RFCHRGVA9GOI tag=X89ALTHL3L6K type=del 2024-09-12T00:24:32.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.911+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=L43AF0TL9OR2 type=write size=145360 2024-09-12T00:24:32.913 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.911+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~I233FEHKWVH4.0 size=1048576 2024-09-12T00:24:32.915 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.915+0000 7f0d199128c0 1 < completed part key=_multipart_0ZT4NZYZKI5Z.2~I233FEHKWVH4.1 size=426261 2024-09-12T00:24:32.920 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.919+0000 7f0d199128c0 1 < completed multipart upload key=0ZT4NZYZKI5Z upload=I233FEHKWVH4 tag=8HV323DOSZP9 type=write size=2523413 2024-09-12T00:24:32.923 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.923+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=M52OKLKNB3GM type=del size=2240075 2024-09-12T00:24:32.926 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.927+0000 7f0d199128c0 -1 < failed to complete operation key=57W1IO3KSWBR tag=5ZDX0IYCXULF type=del size=3581354: (22) Invalid argument 2024-09-12T00:24:32.931 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.931+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~CILFS1CCXXGB.0 size=548405 2024-09-12T00:24:32.931 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.931+0000 7f0d199128c0 1 > prepared multipart upload key=IPJEXRBN96NB upload=CILFS1CCXXGB tag=L5615B69826Z type=write size=1596981 2024-09-12T00:24:32.933 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.935+0000 7f0d199128c0 1 < completed delete operation key=RX3RVT06SGJ4 tag=GR63XSE9S7N3 type=del 2024-09-12T00:24:32.938 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.939+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~MIT90V8FXV3V.0 size=566559 2024-09-12T00:24:32.938 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.939+0000 7f0d199128c0 1 > prepared multipart upload key=WPZOKZDFXK4S upload=MIT90V8FXV3V tag=SF92DUESELLA type=write size=1615135 2024-09-12T00:24:32.941 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.939+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~QQ5LPFOKF7U0.0 size=1048576 2024-09-12T00:24:32.943 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.943+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~QQ5LPFOKF7U0.1 size=1048576 2024-09-12T00:24:32.945 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.943+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~QQ5LPFOKF7U0.2 size=507461 2024-09-12T00:24:32.950 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.951+0000 7f0d199128c0 1 < completed multipart upload key=WBGXMJB7U422 upload=QQ5LPFOKF7U0 tag=ONQWI5XIVTLY type=write size=3653189 2024-09-12T00:24:32.955 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.955+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~F7KOYNJT93VM.0 size=1048576 2024-09-12T00:24:32.956 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.955+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~F7KOYNJT93VM.1 size=1048576 2024-09-12T00:24:32.958 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.959+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~F7KOYNJT93VM.2 size=246170 2024-09-12T00:24:32.959 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.959+0000 7f0d199128c0 1 > prepared multipart upload key=V6H6S9X0U2A0 upload=F7KOYNJT93VM tag=CCJMY0TY15NH type=write size=3391898 2024-09-12T00:24:32.964 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.963+0000 7f0d199128c0 1 < suggested update operation key=WPZOKZDFXK4S tag=9IUJTX7UL3NB type=del size=3600241 2024-09-12T00:24:32.967 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.967+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=4NKCSVEMC6HZ type=del size=2122718 2024-09-12T00:24:32.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.971+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~27IKM6KOSJ9L.0 size=1048576 2024-09-12T00:24:32.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.971+0000 7f0d199128c0 1 < canceled part key=_multipart_FJ8YV026H0ZU.2~27IKM6KOSJ9L.1 size=1048576 2024-09-12T00:24:32.972 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.971+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~27IKM6KOSJ9L.2 size=166097 2024-09-12T00:24:32.976 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.975+0000 7f0d199128c0 1 < canceled multipart upload key=FJ8YV026H0ZU upload=27IKM6KOSJ9L tag=GV10OPX1EHBK type=write size=3311825 2024-09-12T00:24:32.979 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.979+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=42QCKUKT28IM type=del size=3579085 2024-09-12T00:24:32.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.979+0000 7f0d199128c0 1 < completed delete operation key=JA6CSJF78VE2 tag=5TO6S0ITG4SB type=del 2024-09-12T00:24:32.983 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.983+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=60LSN2DPZEF0 type=write size=420773 2024-09-12T00:24:32.986 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.987+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~B6JBGR7MCJ1T.0 size=1048576 2024-09-12T00:24:32.988 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.987+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~B6JBGR7MCJ1T.1 size=1048576 2024-09-12T00:24:32.988 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.987+0000 7f0d199128c0 1 < canceled part key=_multipart_YTXW98O07966.2~B6JBGR7MCJ1T.2 size=500943 2024-09-12T00:24:32.992 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.991+0000 7f0d199128c0 1 < canceled multipart upload key=YTXW98O07966 upload=B6JBGR7MCJ1T tag=8D282B9AGH2D type=write size=3646671 2024-09-12T00:24:32.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.995+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=3E6KK219KBUB type=del size=2635521 2024-09-12T00:24:32.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.995+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~L1ZK8ZPRSGD5.0 size=989521 2024-09-12T00:24:33.000 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:32.999+0000 7f0d199128c0 1 < completed multipart upload key=V6H6S9X0U2A0 upload=L1ZK8ZPRSGD5 tag=RYAO7VTM6Q9I type=write size=2038097 2024-09-12T00:24:33.003 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.003+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=FSLNC8BYKW9X type=del size=2077613 2024-09-12T00:24:33.005 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.007+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~AJ8N7YKGWFVU.0 size=487394 2024-09-12T00:24:33.009 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.007+0000 7f0d199128c0 1 < completed multipart upload key=PK2CA62QBZXS upload=AJ8N7YKGWFVU tag=PAA4017OLFN6 type=write size=1535970 2024-09-12T00:24:33.013 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.015+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~4UK06Z3135TT.0 size=1048576 2024-09-12T00:24:33.015 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.015+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~4UK06Z3135TT.1 size=1020226 2024-09-12T00:24:33.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.015+0000 7f0d199128c0 1 > prepared multipart upload key=OVLAP0OS78QG upload=4UK06Z3135TT tag=G0IL2FXZY42T type=write size=3117378 2024-09-12T00:24:33.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.019+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~33YVDDYRI4AY.0 size=1048576 2024-09-12T00:24:33.020 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.019+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~33YVDDYRI4AY.1 size=1048576 2024-09-12T00:24:33.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.023+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~33YVDDYRI4AY.2 size=534878 2024-09-12T00:24:33.027 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.027+0000 7f0d199128c0 1 < completed multipart upload key=ZWGD87Z1MMNK upload=33YVDDYRI4AY tag=3BTD40D7O35V type=write size=3680606 2024-09-12T00:24:33.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.031+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=SFI5VRFQDNU3 type=del size=3921726 2024-09-12T00:24:33.032 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.031+0000 7f0d199128c0 1 < canceled operation key=0ZT4NZYZKI5Z tag=07C9HEUO2TMI type=del size=515662 2024-09-12T00:24:33.035 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.035+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=NN3DZ6XPWMLE type=write size=842740 2024-09-12T00:24:33.037 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.039+0000 7f0d199128c0 1 < completed delete operation key=9I6MZAEUS4I0 tag=T1F5KLKFNKHS type=del 2024-09-12T00:24:33.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.043+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~LSETPFZ77VGQ.0 size=1048576 2024-09-12T00:24:33.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.043+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~LSETPFZ77VGQ.1 size=1048576 2024-09-12T00:24:33.046 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.047+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~LSETPFZ77VGQ.2 size=132931 2024-09-12T00:24:33.046 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.047+0000 7f0d199128c0 1 > prepared multipart upload key=WPZOKZDFXK4S upload=LSETPFZ77VGQ tag=KZT2UB2FCBQH type=write size=3278659 2024-09-12T00:24:33.051 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.051+0000 7f0d199128c0 1 < suggested remove operation key=JA6CSJF78VE2 tag=M07KQ4E8VCQL type=del 2024-09-12T00:24:33.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.055+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~ZQHBL5ZZETWA.0 size=1048576 2024-09-12T00:24:33.059 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.059+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~ZQHBL5ZZETWA.1 size=1048576 2024-09-12T00:24:33.061 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.059+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~ZQHBL5ZZETWA.2 size=733802 2024-09-12T00:24:33.061 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.059+0000 7f0d199128c0 1 > prepared multipart upload key=HXNC728XIWC1 upload=ZQHBL5ZZETWA tag=17WU8QR23NYN type=write size=3879530 2024-09-12T00:24:33.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.063+0000 7f0d199128c0 1 < completed delete operation key=NXQYUQIR2APT tag=TOIN2TTV081O type=del 2024-09-12T00:24:33.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.067+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=IIF3JPQA9JWQ type=del size=1843295 2024-09-12T00:24:33.070 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.071+0000 7f0d199128c0 1 < completed write operation key=0ZT4NZYZKI5Z tag=L43AF0TL9OR2 type=write size=145360 2024-09-12T00:24:33.075 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.075+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~PA5V0R8OW65L.0 size=1048576 2024-09-12T00:24:33.078 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.079+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~PA5V0R8OW65L.1 size=30935 2024-09-12T00:24:33.078 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.079+0000 7f0d199128c0 1 > prepared multipart upload key=YTXW98O07966 upload=PA5V0R8OW65L tag=0HF5FYIU6AD1 type=write size=2128087 2024-09-12T00:24:33.082 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.083+0000 7f0d199128c0 1 < completed delete operation key=YTXW98O07966 tag=M52OKLKNB3GM type=del 2024-09-12T00:24:33.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.087+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~T5ESACZEZPPP.0 size=1048576 2024-09-12T00:24:33.093 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.091+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~T5ESACZEZPPP.1 size=1048576 2024-09-12T00:24:33.093 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.091+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~T5ESACZEZPPP.2 size=922738 2024-09-12T00:24:33.093 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.091+0000 7f0d199128c0 1 > prepared multipart upload key=ZWGD87Z1MMNK upload=T5ESACZEZPPP tag=AEBBPPQQOK5A type=write size=4068466 2024-09-12T00:24:33.097 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.095+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~CILFS1CCXXGB.0 size=548405 2024-09-12T00:24:33.102 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.103+0000 7f0d199128c0 1 < completed multipart upload key=IPJEXRBN96NB upload=CILFS1CCXXGB tag=L5615B69826Z type=write size=1596981 2024-09-12T00:24:33.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.107+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~0584YHVYBQ6Y.0 size=92735 2024-09-12T00:24:33.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.107+0000 7f0d199128c0 1 > prepared multipart upload key=J75P0821XGRO upload=0584YHVYBQ6Y tag=S5ZTCTZV1B4H type=write size=1141311 2024-09-12T00:24:33.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.111+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~MIT90V8FXV3V.0 size=566559 2024-09-12T00:24:33.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.115+0000 7f0d199128c0 1 < completed multipart upload key=WPZOKZDFXK4S upload=MIT90V8FXV3V tag=SF92DUESELLA type=write size=1615135 2024-09-12T00:24:33.118 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.119+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=IHEAT9ZJY8WU type=write size=864518 2024-09-12T00:24:33.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.119+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~F7KOYNJT93VM.0 size=1048576 2024-09-12T00:24:33.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.123+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~F7KOYNJT93VM.1 size=1048576 2024-09-12T00:24:33.125 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.123+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~F7KOYNJT93VM.2 size=246170 2024-09-12T00:24:33.130 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.131+0000 7f0d199128c0 1 < completed multipart upload key=V6H6S9X0U2A0 upload=F7KOYNJT93VM tag=CCJMY0TY15NH type=write size=3391898 2024-09-12T00:24:33.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.131+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=RN04OJFOTNNF type=write size=3830 2024-09-12T00:24:33.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.135+0000 7f0d199128c0 1 < completed delete operation key=OVLAP0OS78QG tag=4NKCSVEMC6HZ type=del 2024-09-12T00:24:33.140 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.139+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=Q5JKICGN7GVJ type=del size=3570136 2024-09-12T00:24:33.143 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.143+0000 7f0d199128c0 -1 < failed to complete operation key=JA6CSJF78VE2 tag=42QCKUKT28IM type=del size=3579085: (22) Invalid argument 2024-09-12T00:24:33.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.151+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~CZBHBH6LHQJL.0 size=1048576 2024-09-12T00:24:33.154 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.155+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~CZBHBH6LHQJL.1 size=306881 2024-09-12T00:24:33.154 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.155+0000 7f0d199128c0 1 > prepared multipart upload key=10YEWZDTTEV0 upload=CZBHBH6LHQJL tag=4KM64N1UAY0F type=write size=2404033 2024-09-12T00:24:33.157 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.159+0000 7f0d199128c0 1 < completed write operation key=1Y6B1MJP5G4L tag=60LSN2DPZEF0 type=write size=420773 2024-09-12T00:24:33.163 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.163+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~XD8WEC6QKANT.0 size=299257 2024-09-12T00:24:33.163 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.163+0000 7f0d199128c0 1 > prepared multipart upload key=T6GOR4SBYU2Y upload=XD8WEC6QKANT tag=2UW28UBA6A0H type=write size=1347833 2024-09-12T00:24:33.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.167+0000 7f0d199128c0 1 < completed delete operation key=H604SA6XTFLY tag=3E6KK219KBUB type=del 2024-09-12T00:24:33.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.171+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~AJZ6U23W2KS1.0 size=1048576 2024-09-12T00:24:33.174 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.175+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~AJZ6U23W2KS1.1 size=1048576 2024-09-12T00:24:33.176 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.175+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~AJZ6U23W2KS1.2 size=511 2024-09-12T00:24:33.176 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.175+0000 7f0d199128c0 1 > prepared multipart upload key=SITJU2EUVSR8 upload=AJZ6U23W2KS1 tag=WW6KVC1V97LQ type=write size=3146239 2024-09-12T00:24:33.180 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.179+0000 7f0d199128c0 1 < completed delete operation key=0EBWUENN0881 tag=FSLNC8BYKW9X type=del 2024-09-12T00:24:33.183 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.183+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=6Y4I9HSV3XZL type=write size=806805 2024-09-12T00:24:33.186 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.187+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~4UK06Z3135TT.0 size=1048576 2024-09-12T00:24:33.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.187+0000 7f0d199128c0 1 < completed part key=_multipart_OVLAP0OS78QG.2~4UK06Z3135TT.1 size=1020226 2024-09-12T00:24:33.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.195+0000 7f0d199128c0 1 < completed multipart upload key=OVLAP0OS78QG upload=4UK06Z3135TT tag=G0IL2FXZY42T type=write size=3117378 2024-09-12T00:24:33.200 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.199+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~WV8YKQWF9AWW.0 size=1048576 2024-09-12T00:24:33.203 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.203+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~WV8YKQWF9AWW.1 size=1048576 2024-09-12T00:24:33.205 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.203+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~WV8YKQWF9AWW.2 size=42123 2024-09-12T00:24:33.205 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.203+0000 7f0d199128c0 1 > prepared multipart upload key=WBGXMJB7U422 upload=WV8YKQWF9AWW tag=W1YGVG2IBDEL type=write size=3187851 2024-09-12T00:24:33.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.207+0000 7f0d199128c0 1 < canceled operation key=OVLAP0OS78QG tag=SFI5VRFQDNU3 type=del size=3921726 2024-09-12T00:24:33.212 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.211+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=JN9ZBKQAQ63S type=del size=1367321 2024-09-12T00:24:33.218 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.219+0000 7f0d199128c0 1 < suggested remove operation key=SITJU2EUVSR8 tag=NN3DZ6XPWMLE type=write 2024-09-12T00:24:33.221 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.223+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=CP9NRBWQQYQH type=del size=1034440 2024-09-12T00:24:33.222 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.223+0000 7f0d199128c0 1 < canceled part key=_multipart_WPZOKZDFXK4S.2~LSETPFZ77VGQ.0 size=1048576 2024-09-12T00:24:33.225 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.223+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~LSETPFZ77VGQ.1 size=1048576 2024-09-12T00:24:33.225 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.223+0000 7f0d199128c0 1 < canceled part key=_multipart_WPZOKZDFXK4S.2~LSETPFZ77VGQ.2 size=132931 2024-09-12T00:24:33.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.231+0000 7f0d199128c0 1 < canceled multipart upload key=WPZOKZDFXK4S upload=LSETPFZ77VGQ tag=KZT2UB2FCBQH type=write size=3278659 2024-09-12T00:24:33.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.235+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=AU3WJ6J2F86Q type=del size=724735 2024-09-12T00:24:33.237 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.235+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~ZQHBL5ZZETWA.0 size=1048576 2024-09-12T00:24:33.239 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.239+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~ZQHBL5ZZETWA.1 size=1048576 2024-09-12T00:24:33.242 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.243+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~ZQHBL5ZZETWA.2 size=733802 2024-09-12T00:24:33.248 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.247+0000 7f0d199128c0 1 < completed multipart upload key=HXNC728XIWC1 upload=ZQHBL5ZZETWA tag=17WU8QR23NYN type=write size=3879530 2024-09-12T00:24:33.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.251+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=11KEQ9V0I9JV type=del size=837452 2024-09-12T00:24:33.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.259+0000 7f0d199128c0 1 < suggested remove operation key=RX3RVT06SGJ4 tag=IIF3JPQA9JWQ type=del 2024-09-12T00:24:33.262 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.263+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=ILFXZJ0NFYVG type=del size=555772 2024-09-12T00:24:33.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.263+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~PA5V0R8OW65L.0 size=1048576 2024-09-12T00:24:33.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.267+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~PA5V0R8OW65L.1 size=30935 2024-09-12T00:24:33.272 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.271+0000 7f0d199128c0 1 < completed multipart upload key=YTXW98O07966 upload=PA5V0R8OW65L tag=0HF5FYIU6AD1 type=write size=2128087 2024-09-12T00:24:33.278 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.279+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~JVE8LBGVZDU4.0 size=681039 2024-09-12T00:24:33.278 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.279+0000 7f0d199128c0 1 > prepared multipart upload key=SITJU2EUVSR8 upload=JVE8LBGVZDU4 tag=7FH5R9D3Z20D type=write size=1729615 2024-09-12T00:24:33.282 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.283+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~T5ESACZEZPPP.0 size=1048576 2024-09-12T00:24:33.284 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.283+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~T5ESACZEZPPP.1 size=1048576 2024-09-12T00:24:33.284 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.283+0000 7f0d199128c0 1 < canceled part key=_multipart_ZWGD87Z1MMNK.2~T5ESACZEZPPP.2 size=922738 2024-09-12T00:24:33.289 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.291+0000 7f0d199128c0 1 < canceled multipart upload key=ZWGD87Z1MMNK upload=T5ESACZEZPPP tag=AEBBPPQQOK5A type=write size=4068466 2024-09-12T00:24:33.295 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.295+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~D1X18VM347BT.0 size=331724 2024-09-12T00:24:33.296 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.295+0000 7f0d199128c0 1 > prepared multipart upload key=57W1IO3KSWBR upload=D1X18VM347BT tag=DLR21Z6RFMHZ type=write size=1380300 2024-09-12T00:24:33.299 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.299+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~0584YHVYBQ6Y.0 size=92735 2024-09-12T00:24:33.304 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.303+0000 7f0d199128c0 1 < completed multipart upload key=J75P0821XGRO upload=0584YHVYBQ6Y tag=S5ZTCTZV1B4H type=write size=1141311 2024-09-12T00:24:33.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.307+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=64IQBL8HDDXD type=del size=617019 2024-09-12T00:24:33.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.311+0000 7f0d199128c0 1 < completed write operation key=OVLAP0OS78QG tag=IHEAT9ZJY8WU type=write size=864518 2024-09-12T00:24:33.316 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.315+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=E2LL9HLGWRY7 type=del size=775563 2024-09-12T00:24:33.320 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.319+0000 7f0d199128c0 1 < completed write operation key=B58RWC9W8THG tag=RN04OJFOTNNF type=write size=3830 2024-09-12T00:24:33.328 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.327+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~3DR4BVT4KUR6.0 size=1048576 2024-09-12T00:24:33.331 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.331+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~3DR4BVT4KUR6.1 size=1048576 2024-09-12T00:24:33.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.335+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~3DR4BVT4KUR6.2 size=214333 2024-09-12T00:24:33.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.335+0000 7f0d199128c0 1 > prepared multipart upload key=37WTPAJGOX5L upload=3DR4BVT4KUR6 tag=2VKLC2WMFZMC type=write size=3360061 2024-09-12T00:24:33.337 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.335+0000 7f0d199128c0 1 < completed delete operation key=9I6MZAEUS4I0 tag=Q5JKICGN7GVJ type=del 2024-09-12T00:24:33.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.339+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=2MFSAT3JWC12 type=write size=62969 2024-09-12T00:24:33.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.343+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~CZBHBH6LHQJL.0 size=1048576 2024-09-12T00:24:33.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.347+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~CZBHBH6LHQJL.1 size=306881 2024-09-12T00:24:33.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.351+0000 7f0d199128c0 1 < completed multipart upload key=10YEWZDTTEV0 upload=CZBHBH6LHQJL tag=4KM64N1UAY0F type=write size=2404033 2024-09-12T00:24:33.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.355+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=KKOX79NSSOYJ type=del size=2642458 2024-09-12T00:24:33.359 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.359+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~XD8WEC6QKANT.0 size=299257 2024-09-12T00:24:33.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.363+0000 7f0d199128c0 1 < completed multipart upload key=T6GOR4SBYU2Y upload=XD8WEC6QKANT tag=2UW28UBA6A0H type=write size=1347833 2024-09-12T00:24:33.371 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.371+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~ITZGZHPRN2RQ.0 size=1048576 2024-09-12T00:24:33.373 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.375+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~ITZGZHPRN2RQ.1 size=1048576 2024-09-12T00:24:33.441 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.375+0000 7f0d199128c0 1 > prepared part key=_multipart_T6GOR4SBYU2Y.2~ITZGZHPRN2RQ.2 size=84318 2024-09-12T00:24:33.441 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.375+0000 7f0d199128c0 1 > prepared multipart upload key=T6GOR4SBYU2Y upload=ITZGZHPRN2RQ tag=UDXYQDEYMUPK type=write size=3230046 2024-09-12T00:24:33.441 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.379+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~AJZ6U23W2KS1.0 size=1048576 2024-09-12T00:24:33.442 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.383+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~AJZ6U23W2KS1.1 size=1048576 2024-09-12T00:24:33.442 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.383+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~AJZ6U23W2KS1.2 size=511 2024-09-12T00:24:33.442 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.391+0000 7f0d199128c0 1 < completed multipart upload key=SITJU2EUVSR8 upload=AJZ6U23W2KS1 tag=WW6KVC1V97LQ type=write size=3146239 2024-09-12T00:24:33.442 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.395+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=2QBDDH33V1OX type=del size=604739 2024-09-12T00:24:33.442 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.395+0000 7f0d199128c0 1 < completed write operation key=9I6MZAEUS4I0 tag=6Y4I9HSV3XZL type=write size=806805 2024-09-12T00:24:33.443 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.443+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~HFZUK83N07WB.0 size=1048576 2024-09-12T00:24:33.445 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.443+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~HFZUK83N07WB.1 size=802141 2024-09-12T00:24:33.445 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.443+0000 7f0d199128c0 1 > prepared multipart upload key=WPZOKZDFXK4S upload=HFZUK83N07WB tag=83ED9MHBE2PH type=write size=2899293 2024-09-12T00:24:33.446 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.447+0000 7f0d199128c0 1 < canceled part key=_multipart_WBGXMJB7U422.2~WV8YKQWF9AWW.0 size=1048576 2024-09-12T00:24:33.449 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.447+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~WV8YKQWF9AWW.1 size=1048576 2024-09-12T00:24:33.452 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.451+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~WV8YKQWF9AWW.2 size=42123 2024-09-12T00:24:33.459 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.459+0000 7f0d199128c0 1 < canceled multipart upload key=WBGXMJB7U422 upload=WV8YKQWF9AWW tag=W1YGVG2IBDEL type=write size=3187851 2024-09-12T00:24:33.463 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.463+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=IR4T2LPWSR0R type=del size=1440967 2024-09-12T00:24:33.467 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.467+0000 7f0d199128c0 1 < completed delete operation key=GH0FNY2AI00G tag=JN9ZBKQAQ63S type=del 2024-09-12T00:24:33.473 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.475+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~SBI1L542BSEC.0 size=1048576 2024-09-12T00:24:33.476 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.475+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~SBI1L542BSEC.1 size=1048576 2024-09-12T00:24:33.479 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.479+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~SBI1L542BSEC.2 size=390387 2024-09-12T00:24:33.479 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.479+0000 7f0d199128c0 1 > prepared multipart upload key=9I6MZAEUS4I0 upload=SBI1L542BSEC tag=AHD5Y1QMWMFT type=write size=3536115 2024-09-12T00:24:33.483 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.483+0000 7f0d199128c0 1 < completed delete operation key=PK2CA62QBZXS tag=CP9NRBWQQYQH type=del 2024-09-12T00:24:33.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.487+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~CYPTV7OOXCKV.0 size=1048576 2024-09-12T00:24:33.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.491+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~CYPTV7OOXCKV.1 size=1048576 2024-09-12T00:24:33.495 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.495+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~CYPTV7OOXCKV.2 size=235909 2024-09-12T00:24:33.495 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.495+0000 7f0d199128c0 1 > prepared multipart upload key=GH0FNY2AI00G upload=CYPTV7OOXCKV tag=GUDUK4XHUOK9 type=write size=3381637 2024-09-12T00:24:33.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.503+0000 7f0d199128c0 1 < canceled operation key=OVLAP0OS78QG tag=AU3WJ6J2F86Q type=del size=724735 2024-09-12T00:24:33.507 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.507+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=V6E6Q04WV0RH type=del size=153118 2024-09-12T00:24:33.511 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.511+0000 7f0d199128c0 1 < completed delete operation key=0ZT4NZYZKI5Z tag=11KEQ9V0I9JV type=del 2024-09-12T00:24:33.515 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.515+0000 7f0d199128c0 1 > prepared operation key=57W1IO3KSWBR tag=7P30BDD13DHO type=del size=3706048 2024-09-12T00:24:33.518 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.519+0000 7f0d199128c0 1 < completed delete operation key=H604SA6XTFLY tag=ILFXZJ0NFYVG type=del 2024-09-12T00:24:33.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.523+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~TSR8XO306FG3.0 size=1048576 2024-09-12T00:24:33.529 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.527+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~TSR8XO306FG3.1 size=1048576 2024-09-12T00:24:33.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.531+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~TSR8XO306FG3.2 size=1047716 2024-09-12T00:24:33.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.531+0000 7f0d199128c0 1 > prepared multipart upload key=WBGXMJB7U422 upload=TSR8XO306FG3 tag=6UJ8FAF8ZBYA type=write size=4193444 2024-09-12T00:24:33.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.535+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~JVE8LBGVZDU4.0 size=681039 2024-09-12T00:24:33.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.539+0000 7f0d199128c0 1 < completed multipart upload key=SITJU2EUVSR8 upload=JVE8LBGVZDU4 tag=7FH5R9D3Z20D type=write size=1729615 2024-09-12T00:24:33.544 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.543+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=APGZ8DHE1Z1Q type=del size=3673975 2024-09-12T00:24:33.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.547+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~D1X18VM347BT.0 size=331724 2024-09-12T00:24:33.554 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.555+0000 7f0d199128c0 1 < completed multipart upload key=57W1IO3KSWBR upload=D1X18VM347BT tag=DLR21Z6RFMHZ type=write size=1380300 2024-09-12T00:24:33.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.555+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=J3JMPC4LP22T type=write size=473475 2024-09-12T00:24:33.561 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.559+0000 7f0d199128c0 1 < completed delete operation key=RFCHRGVA9GOI tag=64IQBL8HDDXD type=del 2024-09-12T00:24:33.567 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.567+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~01KUTECH76SY.0 size=1048576 2024-09-12T00:24:33.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.571+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~01KUTECH76SY.1 size=261491 2024-09-12T00:24:33.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.571+0000 7f0d199128c0 1 > prepared multipart upload key=QUO5ND3O41TY upload=01KUTECH76SY tag=ULT9VYYM5YA1 type=write size=2358643 2024-09-12T00:24:33.573 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.575+0000 7f0d199128c0 1 < completed delete operation key=B58RWC9W8THG tag=E2LL9HLGWRY7 type=del 2024-09-12T00:24:33.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.579+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~XKAMTA9ACTRR.0 size=1048576 2024-09-12T00:24:33.583 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.583+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~XKAMTA9ACTRR.1 size=848118 2024-09-12T00:24:33.583 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.583+0000 7f0d199128c0 1 > prepared multipart upload key=VXZI0ZTMQSV0 upload=XKAMTA9ACTRR tag=Z3T0DQA6XVTJ type=write size=2945270 2024-09-12T00:24:33.587 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.587+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~3DR4BVT4KUR6.0 size=1048576 2024-09-12T00:24:33.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.591+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~3DR4BVT4KUR6.1 size=1048576 2024-09-12T00:24:33.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.591+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~3DR4BVT4KUR6.2 size=214333 2024-09-12T00:24:33.599 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.599+0000 7f0d199128c0 1 < completed multipart upload key=37WTPAJGOX5L upload=3DR4BVT4KUR6 tag=2VKLC2WMFZMC type=write size=3360061 2024-09-12T00:24:33.606 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.607+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~RPCJFPU5SHJY.0 size=788372 2024-09-12T00:24:33.606 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.607+0000 7f0d199128c0 1 > prepared multipart upload key=PK2CA62QBZXS upload=RPCJFPU5SHJY tag=A5IULKAKDJ4B type=write size=1836948 2024-09-12T00:24:33.609 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.607+0000 7f0d199128c0 1 < completed write operation key=QUO5ND3O41TY tag=2MFSAT3JWC12 type=write size=62969 2024-09-12T00:24:33.613 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.611+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=MGQMO4DPF4QP type=write size=634154 2024-09-12T00:24:33.620 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.619+0000 7f0d199128c0 1 < suggested update operation key=1Y6B1MJP5G4L tag=KKOX79NSSOYJ type=del size=2642458 2024-09-12T00:24:33.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.627+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~U8IQ5MN7P2BC.0 size=130446 2024-09-12T00:24:33.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.627+0000 7f0d199128c0 1 > prepared multipart upload key=2EK9CCKG26W2 upload=U8IQ5MN7P2BC tag=BSI2P1TU3FK4 type=write size=1179022 2024-09-12T00:24:33.630 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.631+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~ITZGZHPRN2RQ.0 size=1048576 2024-09-12T00:24:33.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.631+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~ITZGZHPRN2RQ.1 size=1048576 2024-09-12T00:24:33.636 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.635+0000 7f0d199128c0 1 < completed part key=_multipart_T6GOR4SBYU2Y.2~ITZGZHPRN2RQ.2 size=84318 2024-09-12T00:24:33.642 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.643+0000 7f0d199128c0 1 < completed multipart upload key=T6GOR4SBYU2Y upload=ITZGZHPRN2RQ tag=UDXYQDEYMUPK type=write size=3230046 2024-09-12T00:24:33.648 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.647+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~WW62YZH70302.0 size=1048576 2024-09-12T00:24:33.651 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.651+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~WW62YZH70302.1 size=290512 2024-09-12T00:24:33.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.651+0000 7f0d199128c0 1 > prepared multipart upload key=IPJEXRBN96NB upload=WW62YZH70302 tag=72FYHE4FSICZ type=write size=2387664 2024-09-12T00:24:33.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.655+0000 7f0d199128c0 1 < completed delete operation key=T6GOR4SBYU2Y tag=2QBDDH33V1OX type=del 2024-09-12T00:24:33.659 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.659+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=07MWRB2N6WY7 type=write size=307447 2024-09-12T00:24:33.662 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.663+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~HFZUK83N07WB.0 size=1048576 2024-09-12T00:24:33.665 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.663+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~HFZUK83N07WB.1 size=802141 2024-09-12T00:24:33.671 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.671+0000 7f0d199128c0 1 < completed multipart upload key=WPZOKZDFXK4S upload=HFZUK83N07WB tag=83ED9MHBE2PH type=write size=2899293 2024-09-12T00:24:33.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.675+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=T9XDEZY3PK5V type=write size=570857 2024-09-12T00:24:33.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.679+0000 7f0d199128c0 -1 < failed to complete operation key=1Y6B1MJP5G4L tag=IR4T2LPWSR0R type=del size=1440967: (22) Invalid argument 2024-09-12T00:24:33.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.683+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=YE03EY69TITU type=del size=841609 2024-09-12T00:24:33.685 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.683+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~SBI1L542BSEC.0 size=1048576 2024-09-12T00:24:33.688 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.687+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~SBI1L542BSEC.1 size=1048576 2024-09-12T00:24:33.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.691+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~SBI1L542BSEC.2 size=390387 2024-09-12T00:24:33.696 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.695+0000 7f0d199128c0 1 < completed multipart upload key=9I6MZAEUS4I0 upload=SBI1L542BSEC tag=AHD5Y1QMWMFT type=write size=3536115 2024-09-12T00:24:33.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.699+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=5UFFT9IDIXI6 type=write size=479339 2024-09-12T00:24:33.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.699+0000 7f0d199128c0 1 < canceled part key=_multipart_GH0FNY2AI00G.2~CYPTV7OOXCKV.0 size=1048576 2024-09-12T00:24:33.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.703+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~CYPTV7OOXCKV.1 size=1048576 2024-09-12T00:24:33.707 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.707+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~CYPTV7OOXCKV.2 size=235909 2024-09-12T00:24:33.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.711+0000 7f0d199128c0 1 < canceled multipart upload key=GH0FNY2AI00G upload=CYPTV7OOXCKV tag=GUDUK4XHUOK9 type=write size=3381637 2024-09-12T00:24:33.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.719+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~JXDO3V4TMZGP.0 size=1048576 2024-09-12T00:24:33.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.723+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~JXDO3V4TMZGP.1 size=1048576 2024-09-12T00:24:33.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.727+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~JXDO3V4TMZGP.2 size=968205 2024-09-12T00:24:33.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.727+0000 7f0d199128c0 1 > prepared multipart upload key=B58RWC9W8THG upload=JXDO3V4TMZGP tag=1ODKZF698S71 type=write size=4113933 2024-09-12T00:24:33.733 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.731+0000 7f0d199128c0 1 < completed delete operation key=OVLAP0OS78QG tag=V6E6Q04WV0RH type=del 2024-09-12T00:24:33.733 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.735+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=NKL19PZ2M7EG type=del size=3666811 2024-09-12T00:24:33.737 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.735+0000 7f0d199128c0 1 < completed delete operation key=57W1IO3KSWBR tag=7P30BDD13DHO type=del 2024-09-12T00:24:33.740 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.739+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=7DHOO18PYGK2 type=del size=3521866 2024-09-12T00:24:33.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.743+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~TSR8XO306FG3.0 size=1048576 2024-09-12T00:24:33.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.747+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~TSR8XO306FG3.1 size=1048576 2024-09-12T00:24:33.749 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.747+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~TSR8XO306FG3.2 size=1047716 2024-09-12T00:24:33.754 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.755+0000 7f0d199128c0 1 < completed multipart upload key=WBGXMJB7U422 upload=TSR8XO306FG3 tag=6UJ8FAF8ZBYA type=write size=4193444 2024-09-12T00:24:33.760 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.759+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~7GDOEH40G80G.0 size=1048576 2024-09-12T00:24:33.763 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.763+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~7GDOEH40G80G.1 size=1048576 2024-09-12T00:24:33.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.767+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~7GDOEH40G80G.2 size=898293 2024-09-12T00:24:33.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.767+0000 7f0d199128c0 1 > prepared multipart upload key=JA6CSJF78VE2 upload=7GDOEH40G80G tag=5IN6NMBA1NUJ type=write size=4044021 2024-09-12T00:24:33.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.771+0000 7f0d199128c0 1 < suggested update operation key=GH0FNY2AI00G tag=APGZ8DHE1Z1Q type=del size=3673975 2024-09-12T00:24:33.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.775+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=EOQKZLHFMNAS type=del size=4040223 2024-09-12T00:24:33.778 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.779+0000 7f0d199128c0 1 < completed write operation key=T6GOR4SBYU2Y tag=J3JMPC4LP22T type=write size=473475 2024-09-12T00:24:33.781 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.783+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=OXJYVJJOSD9C type=del size=42731 2024-09-12T00:24:33.785 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.783+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~01KUTECH76SY.0 size=1048576 2024-09-12T00:24:33.788 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.787+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~01KUTECH76SY.1 size=261491 2024-09-12T00:24:33.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.791+0000 7f0d199128c0 1 < completed multipart upload key=QUO5ND3O41TY upload=01KUTECH76SY tag=ULT9VYYM5YA1 type=write size=2358643 2024-09-12T00:24:33.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.795+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=I1WQMEY4TRTM type=write size=393904 2024-09-12T00:24:33.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.799+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~XKAMTA9ACTRR.0 size=1048576 2024-09-12T00:24:33.802 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.803+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~XKAMTA9ACTRR.1 size=848118 2024-09-12T00:24:33.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.807+0000 7f0d199128c0 1 < completed multipart upload key=VXZI0ZTMQSV0 upload=XKAMTA9ACTRR tag=Z3T0DQA6XVTJ type=write size=2945270 2024-09-12T00:24:33.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.815+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~6KSHC94SCLPB.0 size=971607 2024-09-12T00:24:33.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.815+0000 7f0d199128c0 1 > prepared multipart upload key=J75P0821XGRO upload=6KSHC94SCLPB tag=0ZVRV7IUA0B9 type=write size=2020183 2024-09-12T00:24:33.818 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.819+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~RPCJFPU5SHJY.0 size=788372 2024-09-12T00:24:33.828 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.827+0000 7f0d199128c0 1 < completed multipart upload key=PK2CA62QBZXS upload=RPCJFPU5SHJY tag=A5IULKAKDJ4B type=write size=1836948 2024-09-12T00:24:33.831 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.831+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=B8T1HSSQCCZN type=del size=910233 2024-09-12T00:24:33.838 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.839+0000 7f0d199128c0 1 < suggested remove operation key=T6GOR4SBYU2Y tag=MGQMO4DPF4QP type=write 2024-09-12T00:24:33.843 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.843+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~6X3WKTIBVNPS.0 size=1048576 2024-09-12T00:24:33.846 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.847+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~6X3WKTIBVNPS.1 size=1048576 2024-09-12T00:24:33.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.847+0000 7f0d199128c0 1 > prepared part key=_multipart_QUO5ND3O41TY.2~6X3WKTIBVNPS.2 size=331435 2024-09-12T00:24:33.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.847+0000 7f0d199128c0 1 > prepared multipart upload key=QUO5ND3O41TY upload=6X3WKTIBVNPS tag=1ALU1ZWO853O type=write size=3477163 2024-09-12T00:24:33.852 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.851+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~U8IQ5MN7P2BC.0 size=130446 2024-09-12T00:24:33.858 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.859+0000 7f0d199128c0 1 < completed multipart upload key=2EK9CCKG26W2 upload=U8IQ5MN7P2BC tag=BSI2P1TU3FK4 type=write size=1179022 2024-09-12T00:24:33.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.863+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=OBF7YLU0CBEX type=del size=1151025 2024-09-12T00:24:33.865 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.863+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~WW62YZH70302.0 size=1048576 2024-09-12T00:24:33.867 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.867+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~WW62YZH70302.1 size=290512 2024-09-12T00:24:33.873 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.871+0000 7f0d199128c0 1 < completed multipart upload key=IPJEXRBN96NB upload=WW62YZH70302 tag=72FYHE4FSICZ type=write size=2387664 2024-09-12T00:24:33.876 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.875+0000 7f0d199128c0 1 > prepared operation key=57W1IO3KSWBR tag=ZVODUHNMJ64P type=del size=2174561 2024-09-12T00:24:33.880 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.879+0000 7f0d199128c0 1 < completed write operation key=YTXW98O07966 tag=07MWRB2N6WY7 type=write size=307447 2024-09-12T00:24:33.887 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.887+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~D527KZUJ0CZR.0 size=979398 2024-09-12T00:24:33.887 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.887+0000 7f0d199128c0 1 > prepared multipart upload key=IPJEXRBN96NB upload=D527KZUJ0CZR tag=J0QNQHRSRTGB type=write size=2027974 2024-09-12T00:24:33.890 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.891+0000 7f0d199128c0 1 < completed write operation key=WBGXMJB7U422 tag=T9XDEZY3PK5V type=write size=570857 2024-09-12T00:24:33.894 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.895+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=AJM4FMIQ7224 type=write size=66524 2024-09-12T00:24:33.897 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.899+0000 7f0d199128c0 1 < canceled operation key=JA6CSJF78VE2 tag=YE03EY69TITU type=del size=841609 2024-09-12T00:24:33.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.899+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=4RZZTMAVV80R type=write size=960945 2024-09-12T00:24:33.905 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.903+0000 7f0d199128c0 1 < canceled operation key=NXQYUQIR2APT tag=5UFFT9IDIXI6 type=write size=479339 2024-09-12T00:24:33.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.911+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~T2PEJAGPDHAN.0 size=182101 2024-09-12T00:24:33.912 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.911+0000 7f0d199128c0 1 > prepared multipart upload key=PK2CA62QBZXS upload=T2PEJAGPDHAN tag=TBI8TFHMCM58 type=write size=1230677 2024-09-12T00:24:33.915 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.915+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~JXDO3V4TMZGP.0 size=1048576 2024-09-12T00:24:33.918 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.919+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~JXDO3V4TMZGP.1 size=1048576 2024-09-12T00:24:33.918 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.919+0000 7f0d199128c0 1 < canceled part key=_multipart_B58RWC9W8THG.2~JXDO3V4TMZGP.2 size=968205 2024-09-12T00:24:33.923 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.923+0000 7f0d199128c0 1 < canceled multipart upload key=B58RWC9W8THG upload=JXDO3V4TMZGP tag=1ODKZF698S71 type=write size=4113933 2024-09-12T00:24:33.927 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.927+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=D3RTP3QRC99W type=write size=513556 2024-09-12T00:24:33.931 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.931+0000 7f0d199128c0 1 < completed delete operation key=37WTPAJGOX5L tag=NKL19PZ2M7EG type=del 2024-09-12T00:24:33.937 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.935+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=7NBJ7CH3739D type=del size=2227685 2024-09-12T00:24:33.943 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.943+0000 7f0d199128c0 1 < suggested update operation key=J75P0821XGRO tag=7DHOO18PYGK2 type=del size=3521866 2024-09-12T00:24:33.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.947+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=2GIL7WCY0EZG type=del size=3894365 2024-09-12T00:24:33.951 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.951+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~7GDOEH40G80G.0 size=1048576 2024-09-12T00:24:33.954 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.955+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~7GDOEH40G80G.1 size=1048576 2024-09-12T00:24:33.958 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.959+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~7GDOEH40G80G.2 size=898293 2024-09-12T00:24:33.964 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.963+0000 7f0d199128c0 1 < completed multipart upload key=JA6CSJF78VE2 upload=7GDOEH40G80G tag=5IN6NMBA1NUJ type=write size=4044021 2024-09-12T00:24:33.972 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.971+0000 7f0d199128c0 1 > prepared part key=_multipart_HXNC728XIWC1.2~BQ0ZEWP1ZC17.0 size=1042022 2024-09-12T00:24:33.972 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.971+0000 7f0d199128c0 1 > prepared multipart upload key=HXNC728XIWC1 upload=BQ0ZEWP1ZC17 tag=B04VGUWL2JLD type=write size=2090598 2024-09-12T00:24:33.975 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.975+0000 7f0d199128c0 1 < completed delete operation key=JA6CSJF78VE2 tag=EOQKZLHFMNAS type=del 2024-09-12T00:24:33.979 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.979+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=X8HYU0GWUQ32 type=del size=2179830 2024-09-12T00:24:33.983 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.983+0000 7f0d199128c0 1 < completed delete operation key=WBGXMJB7U422 tag=OXJYVJJOSD9C type=del 2024-09-12T00:24:33.986 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.987+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=1F24XXBNSMGN type=del size=1322 2024-09-12T00:24:33.993 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.995+0000 7f0d199128c0 1 < suggested remove operation key=1Y6B1MJP5G4L tag=I1WQMEY4TRTM type=write 2024-09-12T00:24:33.999 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.999+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~ZMHFOJNVJLP4.0 size=803707 2024-09-12T00:24:34.000 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:33.999+0000 7f0d199128c0 1 > prepared multipart upload key=1Y6B1MJP5G4L upload=ZMHFOJNVJLP4 tag=QOE1DRY5M5J8 type=write size=1852283 2024-09-12T00:24:34.003 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.003+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~6KSHC94SCLPB.0 size=971607 2024-09-12T00:24:34.009 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.007+0000 7f0d199128c0 1 < completed multipart upload key=J75P0821XGRO upload=6KSHC94SCLPB tag=0ZVRV7IUA0B9 type=write size=2020183 2024-09-12T00:24:34.013 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.011+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=2RY9C0SR4OYT type=del size=243913 2024-09-12T00:24:34.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.015+0000 7f0d199128c0 1 < completed delete operation key=9I6MZAEUS4I0 tag=B8T1HSSQCCZN type=del 2024-09-12T00:24:34.020 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.019+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=2L6EYYX7VUIL type=write size=745087 2024-09-12T00:24:34.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.023+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~6X3WKTIBVNPS.0 size=1048576 2024-09-12T00:24:34.026 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.027+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~6X3WKTIBVNPS.1 size=1048576 2024-09-12T00:24:34.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.027+0000 7f0d199128c0 1 < completed part key=_multipart_QUO5ND3O41TY.2~6X3WKTIBVNPS.2 size=331435 2024-09-12T00:24:34.034 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.035+0000 7f0d199128c0 1 < completed multipart upload key=QUO5ND3O41TY upload=6X3WKTIBVNPS tag=1ALU1ZWO853O type=write size=3477163 2024-09-12T00:24:34.038 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.039+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=SES55083M98H type=del size=3035001 2024-09-12T00:24:34.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.043+0000 7f0d199128c0 1 < completed delete operation key=RX3RVT06SGJ4 tag=OBF7YLU0CBEX type=del 2024-09-12T00:24:34.048 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.047+0000 7f0d199128c0 1 > prepared part key=_multipart_NXQYUQIR2APT.2~MQRT9W0O2HVZ.0 size=689838 2024-09-12T00:24:34.048 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.047+0000 7f0d199128c0 1 > prepared multipart upload key=NXQYUQIR2APT upload=MQRT9W0O2HVZ tag=DC5H4NW11LRI type=write size=1738414 2024-09-12T00:24:34.051 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.051+0000 7f0d199128c0 1 < completed delete operation key=57W1IO3KSWBR tag=ZVODUHNMJ64P type=del 2024-09-12T00:24:34.054 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.055+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=DPSLV722NISO type=del size=2045530 2024-09-12T00:24:34.058 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.059+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~D527KZUJ0CZR.0 size=979398 2024-09-12T00:24:34.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.063+0000 7f0d199128c0 1 < completed multipart upload key=IPJEXRBN96NB upload=D527KZUJ0CZR tag=J0QNQHRSRTGB type=write size=2027974 2024-09-12T00:24:34.068 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.067+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=4ONLBOP0P1QU type=del size=1346084 2024-09-12T00:24:34.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.071+0000 7f0d199128c0 1 < completed write operation key=37WTPAJGOX5L tag=AJM4FMIQ7224 type=write size=66524 2024-09-12T00:24:34.076 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.075+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=3WVOWDZW8EZP type=del size=1259470 2024-09-12T00:24:34.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.079+0000 7f0d199128c0 1 < completed write operation key=0ZT4NZYZKI5Z tag=4RZZTMAVV80R type=write size=960945 2024-09-12T00:24:34.084 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.083+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=EX0NLR0THYE6 type=del size=3991653 2024-09-12T00:24:34.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.087+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~T2PEJAGPDHAN.0 size=182101 2024-09-12T00:24:34.094 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.095+0000 7f0d199128c0 1 < completed multipart upload key=PK2CA62QBZXS upload=T2PEJAGPDHAN tag=TBI8TFHMCM58 type=write size=1230677 2024-09-12T00:24:34.099 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.099+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=MFUV32VKLJJJ type=del size=1811750 2024-09-12T00:24:34.103 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.103+0000 7f0d199128c0 1 < completed write operation key=WPZOKZDFXK4S tag=D3RTP3QRC99W type=write size=513556 2024-09-12T00:24:34.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.107+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=H86OB9GCCY0E type=del size=784910 2024-09-12T00:24:34.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.111+0000 7f0d199128c0 -1 < failed to complete operation key=J75P0821XGRO tag=7NBJ7CH3739D type=del size=2227685: (22) Invalid argument 2024-09-12T00:24:34.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.115+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=VC5L7OGGIWZ0 type=write size=44867 2024-09-12T00:24:34.119 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.119+0000 7f0d199128c0 1 < completed delete operation key=IPJEXRBN96NB tag=2GIL7WCY0EZG type=del 2024-09-12T00:24:34.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.123+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=ANMN1PTTD9TJ type=del size=259722 2024-09-12T00:24:34.126 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.127+0000 7f0d199128c0 1 < completed part key=_multipart_HXNC728XIWC1.2~BQ0ZEWP1ZC17.0 size=1042022 2024-09-12T00:24:34.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.131+0000 7f0d199128c0 1 < completed multipart upload key=HXNC728XIWC1 upload=BQ0ZEWP1ZC17 tag=B04VGUWL2JLD type=write size=2090598 2024-09-12T00:24:34.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.135+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=XCI4I3FMVEWU type=write size=241595 2024-09-12T00:24:34.143 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.143+0000 7f0d199128c0 1 < suggested remove operation key=B58RWC9W8THG tag=X8HYU0GWUQ32 type=del 2024-09-12T00:24:34.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.147+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=G0RGUO34MGJF type=write size=908920 2024-09-12T00:24:34.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.151+0000 7f0d199128c0 1 < canceled operation key=T6GOR4SBYU2Y tag=1F24XXBNSMGN type=del size=1322 2024-09-12T00:24:34.153 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.155+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=C1U9V1A9DL9R type=del size=3836941 2024-09-12T00:24:34.157 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.155+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~ZMHFOJNVJLP4.0 size=803707 2024-09-12T00:24:34.163 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.163+0000 7f0d199128c0 1 < completed multipart upload key=1Y6B1MJP5G4L upload=ZMHFOJNVJLP4 tag=QOE1DRY5M5J8 type=write size=1852283 2024-09-12T00:24:34.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.167+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=0W377G7H91WO type=del size=3795771 2024-09-12T00:24:34.176 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.175+0000 7f0d199128c0 1 < completed delete operation key=2EK9CCKG26W2 tag=2RY9C0SR4OYT type=del 2024-09-12T00:24:34.182 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.183+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~B69V0CHQS00L.0 size=1048576 2024-09-12T00:24:34.184 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.183+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~B69V0CHQS00L.1 size=1048576 2024-09-12T00:24:34.187 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.187+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~B69V0CHQS00L.2 size=110167 2024-09-12T00:24:34.187 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.187+0000 7f0d199128c0 1 > prepared multipart upload key=J75P0821XGRO upload=B69V0CHQS00L tag=QWTVPL5V7YT3 type=write size=3255895 2024-09-12T00:24:34.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.195+0000 7f0d199128c0 1 < suggested remove operation key=10YEWZDTTEV0 tag=2L6EYYX7VUIL type=write 2024-09-12T00:24:34.201 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.199+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~2C7AFP5KXGKC.0 size=1048576 2024-09-12T00:24:34.204 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.203+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~2C7AFP5KXGKC.1 size=398625 2024-09-12T00:24:34.204 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.203+0000 7f0d199128c0 1 > prepared multipart upload key=37WTPAJGOX5L upload=2C7AFP5KXGKC tag=9BNOPL68PKWQ type=write size=2495777 2024-09-12T00:24:34.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.211+0000 7f0d199128c0 1 < suggested remove operation key=RX3RVT06SGJ4 tag=SES55083M98H type=del 2024-09-12T00:24:34.215 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.215+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=50VOK604XFBM type=del size=3781091 2024-09-12T00:24:34.218 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.219+0000 7f0d199128c0 1 < completed part key=_multipart_NXQYUQIR2APT.2~MQRT9W0O2HVZ.0 size=689838 2024-09-12T00:24:34.224 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.223+0000 7f0d199128c0 1 < completed multipart upload key=NXQYUQIR2APT upload=MQRT9W0O2HVZ tag=DC5H4NW11LRI type=write size=1738414 2024-09-12T00:24:34.231 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.231+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~AYNO9GNGKRYS.0 size=298731 2024-09-12T00:24:34.231 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.231+0000 7f0d199128c0 1 > prepared multipart upload key=V6H6S9X0U2A0 upload=AYNO9GNGKRYS tag=7GZTA2NRTW94 type=write size=1347307 2024-09-12T00:24:34.238 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.239+0000 7f0d199128c0 1 < suggested remove operation key=A529WOKFD1NI tag=DPSLV722NISO type=del 2024-09-12T00:24:34.244 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.243+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~L46T0DELHE3J.0 size=1048576 2024-09-12T00:24:34.247 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.247+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~L46T0DELHE3J.1 size=1048576 2024-09-12T00:24:34.250 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.251+0000 7f0d199128c0 1 > prepared part key=_multipart_YTXW98O07966.2~L46T0DELHE3J.2 size=138135 2024-09-12T00:24:34.250 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.251+0000 7f0d199128c0 1 > prepared multipart upload key=YTXW98O07966 upload=L46T0DELHE3J tag=BBDZC3Y76NP6 type=write size=3283863 2024-09-12T00:24:34.253 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.251+0000 7f0d199128c0 1 < canceled operation key=J75P0821XGRO tag=4ONLBOP0P1QU type=del size=1346084 2024-09-12T00:24:34.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.255+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=1Y2XD5WES6RJ type=del size=2180634 2024-09-12T00:24:34.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.259+0000 7f0d199128c0 -1 < failed to complete operation key=B58RWC9W8THG tag=3WVOWDZW8EZP type=del size=1259470: (22) Invalid argument 2024-09-12T00:24:34.266 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.267+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~G24ZP3WQZHK7.0 size=1007492 2024-09-12T00:24:34.266 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.267+0000 7f0d199128c0 1 > prepared multipart upload key=A529WOKFD1NI upload=G24ZP3WQZHK7 tag=ZX7TTFH7WGSZ type=write size=2056068 2024-09-12T00:24:34.270 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.271+0000 7f0d199128c0 1 < completed delete operation key=2EK9CCKG26W2 tag=EX0NLR0THYE6 type=del 2024-09-12T00:24:34.276 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.275+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~PXHOXVK36RKY.0 size=476703 2024-09-12T00:24:34.276 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.275+0000 7f0d199128c0 1 > prepared multipart upload key=57W1IO3KSWBR upload=PXHOXVK36RKY tag=TRKEFIV7IYT2 type=write size=1525279 2024-09-12T00:24:34.280 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.279+0000 7f0d199128c0 1 < canceled operation key=RFCHRGVA9GOI tag=MFUV32VKLJJJ type=del size=1811750 2024-09-12T00:24:34.284 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.283+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=TPELJQCPJUFP type=del size=644219 2024-09-12T00:24:34.287 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.287+0000 7f0d199128c0 -1 < failed to complete operation key=B58RWC9W8THG tag=H86OB9GCCY0E type=del size=784910: (22) Invalid argument 2024-09-12T00:24:34.290 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.291+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=Q29Q3QNGDCPQ type=del size=4169738 2024-09-12T00:24:34.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.295+0000 7f0d199128c0 -1 < failed to complete operation key=A529WOKFD1NI tag=VC5L7OGGIWZ0 type=write size=44867: (22) Invalid argument 2024-09-12T00:24:34.300 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.299+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~M35IDDG75CV1.0 size=895905 2024-09-12T00:24:34.300 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.299+0000 7f0d199128c0 1 > prepared multipart upload key=PK2CA62QBZXS upload=M35IDDG75CV1 tag=PCXFPE7UUV4Z type=write size=1944481 2024-09-12T00:24:34.304 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.303+0000 7f0d199128c0 1 < completed delete operation key=1Y6B1MJP5G4L tag=ANMN1PTTD9TJ type=del 2024-09-12T00:24:34.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.311+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~VS5N118DZ40L.0 size=1048576 2024-09-12T00:24:34.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.311+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~VS5N118DZ40L.1 size=475235 2024-09-12T00:24:34.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.311+0000 7f0d199128c0 1 > prepared multipart upload key=SITJU2EUVSR8 upload=VS5N118DZ40L tag=R8IF85J256W4 type=write size=2572387 2024-09-12T00:24:34.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.315+0000 7f0d199128c0 1 < completed write operation key=JA6CSJF78VE2 tag=XCI4I3FMVEWU type=write size=241595 2024-09-12T00:24:34.319 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.319+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=3PUOYI9U5I0E type=del size=3890932 2024-09-12T00:24:34.322 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.323+0000 7f0d199128c0 1 < completed write operation key=0EBWUENN0881 tag=G0RGUO34MGJF type=write size=908920 2024-09-12T00:24:34.328 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.327+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~BQQB29YFLSRT.0 size=610244 2024-09-12T00:24:34.328 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.327+0000 7f0d199128c0 1 > prepared multipart upload key=VXZI0ZTMQSV0 upload=BQQB29YFLSRT tag=CZ6QVHOOB26R type=write size=1658820 2024-09-12T00:24:34.331 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.331+0000 7f0d199128c0 1 < canceled operation key=HXNC728XIWC1 tag=C1U9V1A9DL9R type=del size=3836941 2024-09-12T00:24:34.338 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.339+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~9HKMHNGKJGHH.0 size=1048576 2024-09-12T00:24:34.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.339+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~9HKMHNGKJGHH.1 size=443095 2024-09-12T00:24:34.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.339+0000 7f0d199128c0 1 > prepared multipart upload key=WBGXMJB7U422 upload=9HKMHNGKJGHH tag=OX49UWEDGXGY type=write size=2540247 2024-09-12T00:24:34.347 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.347+0000 7f0d199128c0 1 < suggested update operation key=PK2CA62QBZXS tag=0W377G7H91WO type=del size=3795771 2024-09-12T00:24:34.350 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.351+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=ZA0Y1ZIL9RFN type=del size=892488 2024-09-12T00:24:34.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.355+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~B69V0CHQS00L.0 size=1048576 2024-09-12T00:24:34.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.355+0000 7f0d199128c0 1 < canceled part key=_multipart_J75P0821XGRO.2~B69V0CHQS00L.1 size=1048576 2024-09-12T00:24:34.358 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.359+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~B69V0CHQS00L.2 size=110167 2024-09-12T00:24:34.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.363+0000 7f0d199128c0 1 < canceled multipart upload key=J75P0821XGRO upload=B69V0CHQS00L tag=QWTVPL5V7YT3 type=write size=3255895 2024-09-12T00:24:34.371 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.371+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~ELTLHDZP6OOM.0 size=1048576 2024-09-12T00:24:34.373 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.375+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~ELTLHDZP6OOM.1 size=481201 2024-09-12T00:24:34.373 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.375+0000 7f0d199128c0 1 > prepared multipart upload key=9I6MZAEUS4I0 upload=ELTLHDZP6OOM tag=7O4743A68O47 type=write size=2578353 2024-09-12T00:24:34.377 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.375+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~2C7AFP5KXGKC.0 size=1048576 2024-09-12T00:24:34.381 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.379+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~2C7AFP5KXGKC.1 size=398625 2024-09-12T00:24:34.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.387+0000 7f0d199128c0 1 < completed multipart upload key=37WTPAJGOX5L upload=2C7AFP5KXGKC tag=9BNOPL68PKWQ type=write size=2495777 2024-09-12T00:24:34.390 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.391+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=LIH2APHLUDWW type=del size=4085798 2024-09-12T00:24:34.397 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.395+0000 7f0d199128c0 1 < suggested remove operation key=HXNC728XIWC1 tag=50VOK604XFBM type=del 2024-09-12T00:24:34.403 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.403+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~FBB3ARV0B643.0 size=1048576 2024-09-12T00:24:34.406 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.407+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~FBB3ARV0B643.1 size=1048576 2024-09-12T00:24:34.409 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.407+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~FBB3ARV0B643.2 size=837158 2024-09-12T00:24:34.409 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.407+0000 7f0d199128c0 1 > prepared multipart upload key=SITJU2EUVSR8 upload=FBB3ARV0B643 tag=0X7RXZB73EPN type=write size=3982886 2024-09-12T00:24:34.413 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.411+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~AYNO9GNGKRYS.0 size=298731 2024-09-12T00:24:34.418 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.419+0000 7f0d199128c0 1 < completed multipart upload key=V6H6S9X0U2A0 upload=AYNO9GNGKRYS tag=7GZTA2NRTW94 type=write size=1347307 2024-09-12T00:24:34.421 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.423+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=581QN79P3BW4 type=del size=436504 2024-09-12T00:24:34.425 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.423+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~L46T0DELHE3J.0 size=1048576 2024-09-12T00:24:34.425 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.423+0000 7f0d199128c0 1 < canceled part key=_multipart_YTXW98O07966.2~L46T0DELHE3J.1 size=1048576 2024-09-12T00:24:34.428 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.427+0000 7f0d199128c0 1 < completed part key=_multipart_YTXW98O07966.2~L46T0DELHE3J.2 size=138135 2024-09-12T00:24:34.433 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.435+0000 7f0d199128c0 1 < canceled multipart upload key=YTXW98O07966 upload=L46T0DELHE3J tag=BBDZC3Y76NP6 type=write size=3283863 2024-09-12T00:24:34.437 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.435+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=SCFH7VSY8JC4 type=write size=93480 2024-09-12T00:24:34.440 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.439+0000 7f0d199128c0 1 < completed delete operation key=JA6CSJF78VE2 tag=1Y2XD5WES6RJ type=del 2024-09-12T00:24:34.446 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.447+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~XRU9BCFN7KRY.0 size=1048576 2024-09-12T00:24:34.449 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.447+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~XRU9BCFN7KRY.1 size=612531 2024-09-12T00:24:34.449 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.451+0000 7f0d199128c0 1 > prepared multipart upload key=FJ8YV026H0ZU upload=XRU9BCFN7KRY tag=D38L4NC0VTHR type=write size=2709683 2024-09-12T00:24:34.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.451+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~G24ZP3WQZHK7.0 size=1007492 2024-09-12T00:24:34.459 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.459+0000 7f0d199128c0 1 < completed multipart upload key=A529WOKFD1NI upload=G24ZP3WQZHK7 tag=ZX7TTFH7WGSZ type=write size=2056068 2024-09-12T00:24:34.463 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.463+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=FF3P6ZGDDM18 type=del size=2061983 2024-09-12T00:24:34.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.467+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~PXHOXVK36RKY.0 size=476703 2024-09-12T00:24:34.471 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.471+0000 7f0d199128c0 1 < completed multipart upload key=57W1IO3KSWBR upload=PXHOXVK36RKY tag=TRKEFIV7IYT2 type=write size=1525279 2024-09-12T00:24:34.477 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.479+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~NZWJOD92BP2P.0 size=1048576 2024-09-12T00:24:34.480 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.479+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~NZWJOD92BP2P.1 size=1048576 2024-09-12T00:24:34.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.483+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~NZWJOD92BP2P.2 size=500688 2024-09-12T00:24:34.483 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.483+0000 7f0d199128c0 1 > prepared multipart upload key=H604SA6XTFLY upload=NZWJOD92BP2P tag=DV03PEWY5558 type=write size=3646416 2024-09-12T00:24:34.486 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.487+0000 7f0d199128c0 1 < canceled operation key=FJ8YV026H0ZU tag=TPELJQCPJUFP type=del size=644219 2024-09-12T00:24:34.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.487+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=AJ8Y52HTJC9K type=write size=118280 2024-09-12T00:24:34.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.491+0000 7f0d199128c0 1 < canceled operation key=GH0FNY2AI00G tag=Q29Q3QNGDCPQ type=del size=4169738 2024-09-12T00:24:34.500 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.499+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=5AEGWQ9YPYFF type=del size=3411575 2024-09-12T00:24:34.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.503+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~M35IDDG75CV1.0 size=895905 2024-09-12T00:24:34.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.507+0000 7f0d199128c0 1 < completed multipart upload key=PK2CA62QBZXS upload=M35IDDG75CV1 tag=PCXFPE7UUV4Z type=write size=1944481 2024-09-12T00:24:34.512 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.511+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=T0JG74P6T6TQ type=del size=2164457 2024-09-12T00:24:34.516 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.515+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~VS5N118DZ40L.0 size=1048576 2024-09-12T00:24:34.518 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.519+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~VS5N118DZ40L.1 size=475235 2024-09-12T00:24:34.523 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.523+0000 7f0d199128c0 1 < completed multipart upload key=SITJU2EUVSR8 upload=VS5N118DZ40L tag=R8IF85J256W4 type=write size=2572387 2024-09-12T00:24:34.529 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.527+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~K3VQVBAV50PP.0 size=1048576 2024-09-12T00:24:34.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.531+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~K3VQVBAV50PP.1 size=1048576 2024-09-12T00:24:34.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.535+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~K3VQVBAV50PP.2 size=1014848 2024-09-12T00:24:34.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.535+0000 7f0d199128c0 1 > prepared multipart upload key=2EK9CCKG26W2 upload=K3VQVBAV50PP tag=0N26PNMB81PL type=write size=4160576 2024-09-12T00:24:34.541 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.539+0000 7f0d199128c0 1 < suggested remove operation key=PK2CA62QBZXS tag=3PUOYI9U5I0E type=del 2024-09-12T00:24:34.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.547+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~6X2PZKCF6QVT.0 size=1048576 2024-09-12T00:24:34.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.547+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~6X2PZKCF6QVT.1 size=261175 2024-09-12T00:24:34.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.547+0000 7f0d199128c0 1 > prepared multipart upload key=9I6MZAEUS4I0 upload=6X2PZKCF6QVT tag=AY2VJGHGTX1I type=write size=2358327 2024-09-12T00:24:34.552 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.551+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~BQQB29YFLSRT.0 size=610244 2024-09-12T00:24:34.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.559+0000 7f0d199128c0 1 < completed multipart upload key=VXZI0ZTMQSV0 upload=BQQB29YFLSRT tag=CZ6QVHOOB26R type=write size=1658820 2024-09-12T00:24:34.561 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.563+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=J0Z1GESL0K1O type=write size=719683 2024-09-12T00:24:34.565 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.563+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~9HKMHNGKJGHH.0 size=1048576 2024-09-12T00:24:34.567 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.567+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~9HKMHNGKJGHH.1 size=443095 2024-09-12T00:24:34.573 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.575+0000 7f0d199128c0 1 < completed multipart upload key=WBGXMJB7U422 upload=9HKMHNGKJGHH tag=OX49UWEDGXGY type=write size=2540247 2024-09-12T00:24:34.577 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.575+0000 7f0d199128c0 1 > prepared operation key=57W1IO3KSWBR tag=BBGCY7PNMLV4 type=del size=324613 2024-09-12T00:24:34.583 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.583+0000 7f0d199128c0 1 < suggested remove operation key=0EBWUENN0881 tag=ZA0Y1ZIL9RFN type=del 2024-09-12T00:24:34.589 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.591+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~5TG90KD1YCAZ.0 size=631534 2024-09-12T00:24:34.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.591+0000 7f0d199128c0 1 > prepared multipart upload key=57W1IO3KSWBR upload=5TG90KD1YCAZ tag=2QI35MNES3QD type=write size=1680110 2024-09-12T00:24:34.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.591+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~ELTLHDZP6OOM.0 size=1048576 2024-09-12T00:24:34.596 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.595+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~ELTLHDZP6OOM.1 size=481201 2024-09-12T00:24:34.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.603+0000 7f0d199128c0 1 < completed multipart upload key=9I6MZAEUS4I0 upload=ELTLHDZP6OOM tag=7O4743A68O47 type=write size=2578353 2024-09-12T00:24:34.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.603+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=GZTULSIJZUWU type=del size=1007729 2024-09-12T00:24:34.612 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.611+0000 7f0d199128c0 1 < suggested update operation key=B58RWC9W8THG tag=LIH2APHLUDWW type=del size=4085798 2024-09-12T00:24:34.616 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.615+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=1S5MU2KVUVZL type=del size=40368 2024-09-12T00:24:34.619 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.619+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~FBB3ARV0B643.0 size=1048576 2024-09-12T00:24:34.620 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.619+0000 7f0d199128c0 1 < canceled part key=_multipart_SITJU2EUVSR8.2~FBB3ARV0B643.1 size=1048576 2024-09-12T00:24:34.622 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.623+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~FBB3ARV0B643.2 size=837158 2024-09-12T00:24:34.628 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.627+0000 7f0d199128c0 1 < canceled multipart upload key=SITJU2EUVSR8 upload=FBB3ARV0B643 tag=0X7RXZB73EPN type=write size=3982886 2024-09-12T00:24:34.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.635+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~12ZXM68YB8AZ.0 size=968389 2024-09-12T00:24:34.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.635+0000 7f0d199128c0 1 > prepared multipart upload key=0EBWUENN0881 upload=12ZXM68YB8AZ tag=Q9ZSMN49E4B1 type=write size=2016965 2024-09-12T00:24:34.638 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.639+0000 7f0d199128c0 1 < completed delete operation key=H604SA6XTFLY tag=581QN79P3BW4 type=del 2024-09-12T00:24:34.642 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.643+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=XH89OMNMYKFC type=del size=2712604 2024-09-12T00:24:34.646 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.647+0000 7f0d199128c0 1 < completed write operation key=OVLAP0OS78QG tag=SCFH7VSY8JC4 type=write size=93480 2024-09-12T00:24:34.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.651+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~4ZK8BH0MM5F2.0 size=1048576 2024-09-12T00:24:34.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.655+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~4ZK8BH0MM5F2.1 size=906150 2024-09-12T00:24:34.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.655+0000 7f0d199128c0 1 > prepared multipart upload key=VXZI0ZTMQSV0 upload=4ZK8BH0MM5F2 tag=DGJ2J3U22XVE type=write size=3003302 2024-09-12T00:24:34.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.655+0000 7f0d199128c0 1 < canceled part key=_multipart_FJ8YV026H0ZU.2~XRU9BCFN7KRY.0 size=1048576 2024-09-12T00:24:34.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.655+0000 7f0d199128c0 1 < canceled part key=_multipart_FJ8YV026H0ZU.2~XRU9BCFN7KRY.1 size=612531 2024-09-12T00:24:34.661 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.663+0000 7f0d199128c0 1 < canceled multipart upload key=FJ8YV026H0ZU upload=XRU9BCFN7KRY tag=D38L4NC0VTHR type=write size=2709683 2024-09-12T00:24:34.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.667+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~EH6JN0F4G2M1.0 size=1048576 2024-09-12T00:24:34.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.671+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~EH6JN0F4G2M1.1 size=660523 2024-09-12T00:24:34.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.671+0000 7f0d199128c0 1 > prepared multipart upload key=JA6CSJF78VE2 upload=EH6JN0F4G2M1 tag=88ZFCCUKISII type=write size=2757675 2024-09-12T00:24:34.673 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.671+0000 7f0d199128c0 -1 < failed to complete operation key=B58RWC9W8THG tag=FF3P6ZGDDM18 type=del size=2061983: (22) Invalid argument 2024-09-12T00:24:34.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.679+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~NB8OKWIEQO6J.0 size=1048576 2024-09-12T00:24:34.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.683+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~NB8OKWIEQO6J.1 size=377218 2024-09-12T00:24:34.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.683+0000 7f0d199128c0 1 > prepared multipart upload key=1Y6B1MJP5G4L upload=NB8OKWIEQO6J tag=DE1N3UYSLABM type=write size=2474370 2024-09-12T00:24:34.685 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.683+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~NZWJOD92BP2P.0 size=1048576 2024-09-12T00:24:34.688 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.687+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~NZWJOD92BP2P.1 size=1048576 2024-09-12T00:24:34.691 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.691+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~NZWJOD92BP2P.2 size=500688 2024-09-12T00:24:34.697 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.695+0000 7f0d199128c0 1 < completed multipart upload key=H604SA6XTFLY upload=NZWJOD92BP2P tag=DV03PEWY5558 type=write size=3646416 2024-09-12T00:24:34.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.699+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=SNDTWEF0RW2P type=write size=291173 2024-09-12T00:24:34.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.703+0000 7f0d199128c0 1 < completed write operation key=FJ8YV026H0ZU tag=AJ8Y52HTJC9K type=write size=118280 2024-09-12T00:24:34.709 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.707+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=4T6F87RXRP4L type=del size=2900760 2024-09-12T00:24:34.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.711+0000 7f0d199128c0 1 < completed delete operation key=NXQYUQIR2APT tag=5AEGWQ9YPYFF type=del 2024-09-12T00:24:34.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.719+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~BEKT74P0CIU6.0 size=1048576 2024-09-12T00:24:34.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.723+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~BEKT74P0CIU6.1 size=794967 2024-09-12T00:24:34.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.723+0000 7f0d199128c0 1 > prepared multipart upload key=2EK9CCKG26W2 upload=BEKT74P0CIU6 tag=KNR3PSS0O7DW type=write size=2892119 2024-09-12T00:24:34.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.727+0000 7f0d199128c0 1 < completed delete operation key=T6GOR4SBYU2Y tag=T0JG74P6T6TQ type=del 2024-09-12T00:24:34.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.735+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~VCXMQIEWFR2V.0 size=566401 2024-09-12T00:24:34.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.735+0000 7f0d199128c0 1 > prepared multipart upload key=57W1IO3KSWBR upload=VCXMQIEWFR2V tag=YEF90VXR50ME type=write size=1614977 2024-09-12T00:24:34.737 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.739+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~K3VQVBAV50PP.0 size=1048576 2024-09-12T00:24:34.740 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.739+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~K3VQVBAV50PP.1 size=1048576 2024-09-12T00:24:34.743 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.743+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~K3VQVBAV50PP.2 size=1014848 2024-09-12T00:24:34.749 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.747+0000 7f0d199128c0 1 < completed multipart upload key=2EK9CCKG26W2 upload=K3VQVBAV50PP tag=0N26PNMB81PL type=write size=4160576 2024-09-12T00:24:34.752 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.751+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=W9SBOY7R7F3E type=del size=2226387 2024-09-12T00:24:34.756 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.755+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~6X2PZKCF6QVT.0 size=1048576 2024-09-12T00:24:34.759 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.759+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~6X2PZKCF6QVT.1 size=261175 2024-09-12T00:24:34.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.763+0000 7f0d199128c0 1 < completed multipart upload key=9I6MZAEUS4I0 upload=6X2PZKCF6QVT tag=AY2VJGHGTX1I type=write size=2358327 2024-09-12T00:24:34.768 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.767+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=I18XGH1U7PQF type=del size=2120791 2024-09-12T00:24:34.772 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.771+0000 7f0d199128c0 -1 < failed to complete operation key=0EBWUENN0881 tag=J0Z1GESL0K1O type=write size=719683: (22) Invalid argument 2024-09-12T00:24:34.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.775+0000 7f0d199128c0 1 > prepared operation key=WPZOKZDFXK4S tag=7L9SUPUWWTT8 type=del size=997432 2024-09-12T00:24:34.779 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.779+0000 7f0d199128c0 1 < canceled operation key=57W1IO3KSWBR tag=BBGCY7PNMLV4 type=del size=324613 2024-09-12T00:24:34.783 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.783+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=18D528FYZWBZ type=del size=2375733 2024-09-12T00:24:34.787 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.787+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~5TG90KD1YCAZ.0 size=631534 2024-09-12T00:24:34.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.791+0000 7f0d199128c0 1 < completed multipart upload key=57W1IO3KSWBR upload=5TG90KD1YCAZ tag=2QI35MNES3QD type=write size=1680110 2024-09-12T00:24:34.799 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.799+0000 7f0d199128c0 1 > prepared part key=_multipart_ZWGD87Z1MMNK.2~R34FCA0FIAR2.0 size=951507 2024-09-12T00:24:34.799 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.799+0000 7f0d199128c0 1 > prepared multipart upload key=ZWGD87Z1MMNK upload=R34FCA0FIAR2 tag=XR1T6CZF6E9Q type=write size=2000083 2024-09-12T00:24:34.803 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.803+0000 7f0d199128c0 1 < completed delete operation key=J75P0821XGRO tag=GZTULSIJZUWU type=del 2024-09-12T00:24:34.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.807+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=1DVS09QTUDU0 type=write size=459888 2024-09-12T00:24:34.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.815+0000 7f0d199128c0 1 < suggested remove operation key=WBGXMJB7U422 tag=1S5MU2KVUVZL type=del 2024-09-12T00:24:34.817 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.819+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=F3FAE58GZ8AT type=del size=2762251 2024-09-12T00:24:34.826 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.827+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~12ZXM68YB8AZ.0 size=968389 2024-09-12T00:24:34.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.831+0000 7f0d199128c0 1 < completed multipart upload key=0EBWUENN0881 upload=12ZXM68YB8AZ tag=Q9ZSMN49E4B1 type=write size=2016965 2024-09-12T00:24:34.836 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.835+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=2ZPJPCIPS0IH type=del size=2134257 2024-09-12T00:24:34.839 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.839+0000 7f0d199128c0 1 < completed delete operation key=PK2CA62QBZXS tag=XH89OMNMYKFC type=del 2024-09-12T00:24:34.843 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.843+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=TVJCS3WNQC0O type=del size=3187580 2024-09-12T00:24:34.844 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.843+0000 7f0d199128c0 1 < canceled part key=_multipart_VXZI0ZTMQSV0.2~4ZK8BH0MM5F2.0 size=1048576 2024-09-12T00:24:34.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.847+0000 7f0d199128c0 1 < completed part key=_multipart_VXZI0ZTMQSV0.2~4ZK8BH0MM5F2.1 size=906150 2024-09-12T00:24:34.852 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.851+0000 7f0d199128c0 1 < canceled multipart upload key=VXZI0ZTMQSV0 upload=4ZK8BH0MM5F2 tag=DGJ2J3U22XVE type=write size=3003302 2024-09-12T00:24:34.859 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.859+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~O6PXZ1EI3FOG.0 size=208332 2024-09-12T00:24:34.859 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.859+0000 7f0d199128c0 1 > prepared multipart upload key=10YEWZDTTEV0 upload=O6PXZ1EI3FOG tag=KDVUA3R7TG7O type=write size=1256908 2024-09-12T00:24:34.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.863+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~EH6JN0F4G2M1.0 size=1048576 2024-09-12T00:24:34.866 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.867+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~EH6JN0F4G2M1.1 size=660523 2024-09-12T00:24:34.872 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.871+0000 7f0d199128c0 1 < completed multipart upload key=JA6CSJF78VE2 upload=EH6JN0F4G2M1 tag=88ZFCCUKISII type=write size=2757675 2024-09-12T00:24:34.879 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.879+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~5O4557Z50KXY.0 size=1048576 2024-09-12T00:24:34.881 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.883+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~5O4557Z50KXY.1 size=1048576 2024-09-12T00:24:34.884 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.883+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~5O4557Z50KXY.2 size=745408 2024-09-12T00:24:34.884 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.883+0000 7f0d199128c0 1 > prepared multipart upload key=57W1IO3KSWBR upload=5O4557Z50KXY tag=6S02PN83CBED type=write size=3891136 2024-09-12T00:24:34.888 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.887+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~NB8OKWIEQO6J.0 size=1048576 2024-09-12T00:24:34.892 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.891+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~NB8OKWIEQO6J.1 size=377218 2024-09-12T00:24:34.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.899+0000 7f0d199128c0 1 < completed multipart upload key=1Y6B1MJP5G4L upload=NB8OKWIEQO6J tag=DE1N3UYSLABM type=write size=2474370 2024-09-12T00:24:34.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.899+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=1R7I8MZO0C8H type=del size=3519824 2024-09-12T00:24:34.905 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.903+0000 7f0d199128c0 1 < completed write operation key=0EBWUENN0881 tag=SNDTWEF0RW2P type=write size=291173 2024-09-12T00:24:34.908 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.907+0000 7f0d199128c0 1 > prepared operation key=57W1IO3KSWBR tag=932XTKWQWKFG type=del size=1198873 2024-09-12T00:24:34.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.911+0000 7f0d199128c0 1 < completed delete operation key=37WTPAJGOX5L tag=4T6F87RXRP4L type=del 2024-09-12T00:24:34.915 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.915+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=UD10WCXHZBD3 type=del size=3560541 2024-09-12T00:24:34.918 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.919+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~BEKT74P0CIU6.0 size=1048576 2024-09-12T00:24:34.921 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.923+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~BEKT74P0CIU6.1 size=794967 2024-09-12T00:24:34.927 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.927+0000 7f0d199128c0 1 < completed multipart upload key=2EK9CCKG26W2 upload=BEKT74P0CIU6 tag=KNR3PSS0O7DW type=write size=2892119 2024-09-12T00:24:34.930 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.931+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=DGWZBUJKNNWD type=del size=1889736 2024-09-12T00:24:34.934 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.935+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~VCXMQIEWFR2V.0 size=566401 2024-09-12T00:24:34.939 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.939+0000 7f0d199128c0 1 < completed multipart upload key=57W1IO3KSWBR upload=VCXMQIEWFR2V tag=YEF90VXR50ME type=write size=1614977 2024-09-12T00:24:34.945 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.947+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~QTYCEGU6LFA9.0 size=1048576 2024-09-12T00:24:34.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.947+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~QTYCEGU6LFA9.1 size=998599 2024-09-12T00:24:34.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.947+0000 7f0d199128c0 1 > prepared multipart upload key=IPJEXRBN96NB upload=QTYCEGU6LFA9 tag=HR3LRZMK8J9A type=write size=3095751 2024-09-12T00:24:34.952 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.951+0000 7f0d199128c0 1 < completed delete operation key=0ZT4NZYZKI5Z tag=W9SBOY7R7F3E type=del 2024-09-12T00:24:34.956 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.955+0000 7f0d199128c0 1 > prepared operation key=H604SA6XTFLY tag=EXMV04YDPRFB type=write size=1045909 2024-09-12T00:24:34.960 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.959+0000 7f0d199128c0 1 < completed delete operation key=1Y6B1MJP5G4L tag=I18XGH1U7PQF type=del 2024-09-12T00:24:34.965 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.963+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=39YXI27GMB9X type=del size=1804716 2024-09-12T00:24:34.969 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.967+0000 7f0d199128c0 1 < completed delete operation key=WPZOKZDFXK4S tag=7L9SUPUWWTT8 type=del 2024-09-12T00:24:34.973 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.975+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=E6VHZL3NPWM6 type=write size=860982 2024-09-12T00:24:34.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.979+0000 7f0d199128c0 1 < completed delete operation key=37WTPAJGOX5L tag=18D528FYZWBZ type=del 2024-09-12T00:24:34.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.983+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=69EE666EYUKP type=write size=603575 2024-09-12T00:24:34.986 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.987+0000 7f0d199128c0 1 < completed part key=_multipart_ZWGD87Z1MMNK.2~R34FCA0FIAR2.0 size=951507 2024-09-12T00:24:34.993 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.995+0000 7f0d199128c0 1 < completed multipart upload key=ZWGD87Z1MMNK upload=R34FCA0FIAR2 tag=XR1T6CZF6E9Q type=write size=2000083 2024-09-12T00:24:35.001 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:34.999+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~NB9PGJXV8VWB.0 size=1048576 2024-09-12T00:24:35.004 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.003+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~NB9PGJXV8VWB.1 size=1048576 2024-09-12T00:24:35.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.007+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~NB9PGJXV8VWB.2 size=851853 2024-09-12T00:24:35.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.007+0000 7f0d199128c0 1 > prepared multipart upload key=B58RWC9W8THG upload=NB9PGJXV8VWB tag=UG369YBYOF8W type=write size=3997581 2024-09-12T00:24:35.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.011+0000 7f0d199128c0 1 < completed write operation key=SITJU2EUVSR8 tag=1DVS09QTUDU0 type=write size=459888 2024-09-12T00:24:35.014 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.015+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=24D9T9GOU9GE type=del size=3244110 2024-09-12T00:24:35.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.019+0000 7f0d199128c0 1 < canceled operation key=GH0FNY2AI00G tag=F3FAE58GZ8AT type=del size=2762251 2024-09-12T00:24:35.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.023+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=UI6SZQMFZ1BY type=del size=3896587 2024-09-12T00:24:35.025 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.027+0000 7f0d199128c0 1 < completed delete operation key=T6GOR4SBYU2Y tag=2ZPJPCIPS0IH type=del 2024-09-12T00:24:35.032 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.031+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~YYFZXGJ4WKK1.0 size=1048576 2024-09-12T00:24:35.034 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.035+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~YYFZXGJ4WKK1.1 size=1048576 2024-09-12T00:24:35.037 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.035+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~YYFZXGJ4WKK1.2 size=189323 2024-09-12T00:24:35.037 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.035+0000 7f0d199128c0 1 > prepared multipart upload key=A529WOKFD1NI upload=YYFZXGJ4WKK1 tag=IDFI1KWUQ5A1 type=write size=3335051 2024-09-12T00:24:35.040 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.039+0000 7f0d199128c0 1 < completed delete operation key=WBGXMJB7U422 tag=TVJCS3WNQC0O type=del 2024-09-12T00:24:35.046 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.047+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~WGMK3BW7827N.0 size=1048576 2024-09-12T00:24:35.050 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.047+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~WGMK3BW7827N.1 size=8599 2024-09-12T00:24:35.050 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.047+0000 7f0d199128c0 1 > prepared multipart upload key=H604SA6XTFLY upload=WGMK3BW7827N tag=QOCVGOBN01JF type=write size=2105751 2024-09-12T00:24:35.053 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.051+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~O6PXZ1EI3FOG.0 size=208332 2024-09-12T00:24:35.058 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.059+0000 7f0d199128c0 1 < completed multipart upload key=10YEWZDTTEV0 upload=O6PXZ1EI3FOG tag=KDVUA3R7TG7O type=write size=1256908 2024-09-12T00:24:35.061 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.063+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=XGMM7LUTQLT8 type=del size=1872204 2024-09-12T00:24:35.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.063+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~5O4557Z50KXY.0 size=1048576 2024-09-12T00:24:35.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.067+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~5O4557Z50KXY.1 size=1048576 2024-09-12T00:24:35.070 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.071+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~5O4557Z50KXY.2 size=745408 2024-09-12T00:24:35.076 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.075+0000 7f0d199128c0 1 < completed multipart upload key=57W1IO3KSWBR upload=5O4557Z50KXY tag=6S02PN83CBED type=write size=3891136 2024-09-12T00:24:35.082 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.083+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~99Y81DWNCWKF.0 size=1048576 2024-09-12T00:24:35.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.083+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~99Y81DWNCWKF.1 size=1048576 2024-09-12T00:24:35.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.087+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~99Y81DWNCWKF.2 size=56551 2024-09-12T00:24:35.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.087+0000 7f0d199128c0 1 > prepared multipart upload key=9I6MZAEUS4I0 upload=99Y81DWNCWKF tag=TCE779DWZ35S type=write size=3202279 2024-09-12T00:24:35.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.091+0000 7f0d199128c0 1 < completed delete operation key=NXQYUQIR2APT tag=1R7I8MZO0C8H type=del 2024-09-12T00:24:35.094 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.095+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=A1RXKV2W08W1 type=del size=924620 2024-09-12T00:24:35.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.099+0000 7f0d199128c0 1 < completed delete operation key=57W1IO3KSWBR tag=932XTKWQWKFG type=del 2024-09-12T00:24:35.105 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.103+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~W5MM8UKLKSD5.0 size=1048576 2024-09-12T00:24:35.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.107+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~W5MM8UKLKSD5.1 size=1048576 2024-09-12T00:24:35.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.111+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~W5MM8UKLKSD5.2 size=686794 2024-09-12T00:24:35.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.111+0000 7f0d199128c0 1 > prepared multipart upload key=V6H6S9X0U2A0 upload=W5MM8UKLKSD5 tag=8WCE23WOGGKD type=write size=3832522 2024-09-12T00:24:35.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.115+0000 7f0d199128c0 1 < completed delete operation key=10YEWZDTTEV0 tag=UD10WCXHZBD3 type=del 2024-09-12T00:24:35.118 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.119+0000 7f0d199128c0 1 > prepared operation key=4K654PSDLDVI tag=0WFPP86SDCV0 type=del size=327236 2024-09-12T00:24:35.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.123+0000 7f0d199128c0 1 < completed delete operation key=J75P0821XGRO tag=DGWZBUJKNNWD type=del 2024-09-12T00:24:35.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.127+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~TC4ZP3BL71QI.0 size=1048576 2024-09-12T00:24:35.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.131+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~TC4ZP3BL71QI.1 size=140047 2024-09-12T00:24:35.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.131+0000 7f0d199128c0 1 > prepared multipart upload key=1Y6B1MJP5G4L upload=TC4ZP3BL71QI tag=1WGLS88WIPF0 type=write size=2237199 2024-09-12T00:24:35.135 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.135+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~QTYCEGU6LFA9.0 size=1048576 2024-09-12T00:24:35.138 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.139+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~QTYCEGU6LFA9.1 size=998599 2024-09-12T00:24:35.144 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.143+0000 7f0d199128c0 1 < completed multipart upload key=IPJEXRBN96NB upload=QTYCEGU6LFA9 tag=HR3LRZMK8J9A type=write size=3095751 2024-09-12T00:24:35.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.147+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=V0WG31UDNWPC type=del size=2707244 2024-09-12T00:24:35.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.151+0000 7f0d199128c0 1 < canceled operation key=H604SA6XTFLY tag=EXMV04YDPRFB type=write size=1045909 2024-09-12T00:24:35.163 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.163+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~8UDIB2H5USWM.0 size=924753 2024-09-12T00:24:35.163 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.163+0000 7f0d199128c0 1 > prepared multipart upload key=V6H6S9X0U2A0 upload=8UDIB2H5USWM tag=78HX3WBUSNIY type=write size=1973329 2024-09-12T00:24:35.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.167+0000 7f0d199128c0 1 < completed delete operation key=GH0FNY2AI00G tag=39YXI27GMB9X type=del 2024-09-12T00:24:35.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.171+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=1B39OPOEPV58 type=del size=3118012 2024-09-12T00:24:35.175 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.175+0000 7f0d199128c0 1 < completed write operation key=SITJU2EUVSR8 tag=E6VHZL3NPWM6 type=write size=860982 2024-09-12T00:24:35.182 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.183+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~1FYA293M660Y.0 size=1048576 2024-09-12T00:24:35.185 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.183+0000 7f0d199128c0 1 > prepared part key=_multipart_J75P0821XGRO.2~1FYA293M660Y.1 size=477385 2024-09-12T00:24:35.185 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.183+0000 7f0d199128c0 1 > prepared multipart upload key=J75P0821XGRO upload=1FYA293M660Y tag=ZJMJ6G7ZSR65 type=write size=2574537 2024-09-12T00:24:35.192 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.191+0000 7f0d199128c0 1 < suggested remove operation key=V6H6S9X0U2A0 tag=69EE666EYUKP type=write 2024-09-12T00:24:35.196 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.195+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=PV63KYHXLH2U type=del size=1668809 2024-09-12T00:24:35.196 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.195+0000 7f0d199128c0 1 < canceled part key=_multipart_B58RWC9W8THG.2~NB9PGJXV8VWB.0 size=1048576 2024-09-12T00:24:35.199 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.199+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~NB9PGJXV8VWB.1 size=1048576 2024-09-12T00:24:35.202 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.203+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~NB9PGJXV8VWB.2 size=851853 2024-09-12T00:24:35.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.207+0000 7f0d199128c0 1 < canceled multipart upload key=B58RWC9W8THG upload=NB9PGJXV8VWB tag=UG369YBYOF8W type=write size=3997581 2024-09-12T00:24:35.216 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.215+0000 7f0d199128c0 1 > prepared part key=_multipart_V6H6S9X0U2A0.2~W6GI8GV9C8JU.0 size=104981 2024-09-12T00:24:35.216 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.215+0000 7f0d199128c0 1 > prepared multipart upload key=V6H6S9X0U2A0 upload=W6GI8GV9C8JU tag=3PK16K1C40OU type=write size=1153557 2024-09-12T00:24:35.219 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.219+0000 7f0d199128c0 1 < completed delete operation key=1Y6B1MJP5G4L tag=24D9T9GOU9GE type=del 2024-09-12T00:24:35.226 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.227+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~SKCR1AO4O5VY.0 size=1038091 2024-09-12T00:24:35.227 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.227+0000 7f0d199128c0 1 > prepared multipart upload key=1Y6B1MJP5G4L upload=SKCR1AO4O5VY tag=0W310RIOSLDL type=write size=2086667 2024-09-12T00:24:35.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.235+0000 7f0d199128c0 1 < suggested update operation key=9I6MZAEUS4I0 tag=UI6SZQMFZ1BY type=del size=3896587 2024-09-12T00:24:35.237 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.235+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=NE0I8FIFAACQ type=del size=3342203 2024-09-12T00:24:35.241 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.243+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~YYFZXGJ4WKK1.0 size=1048576 2024-09-12T00:24:35.244 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.243+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~YYFZXGJ4WKK1.1 size=1048576 2024-09-12T00:24:35.245 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.243+0000 7f0d199128c0 1 < canceled part key=_multipart_A529WOKFD1NI.2~YYFZXGJ4WKK1.2 size=189323 2024-09-12T00:24:35.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.251+0000 7f0d199128c0 1 < canceled multipart upload key=A529WOKFD1NI upload=YYFZXGJ4WKK1 tag=IDFI1KWUQ5A1 type=write size=3335051 2024-09-12T00:24:35.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.255+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=P11705Z2KT0K type=del size=2486778 2024-09-12T00:24:35.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.259+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~WGMK3BW7827N.0 size=1048576 2024-09-12T00:24:35.264 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.263+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~WGMK3BW7827N.1 size=8599 2024-09-12T00:24:35.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.271+0000 7f0d199128c0 1 < completed multipart upload key=H604SA6XTFLY upload=WGMK3BW7827N tag=QOCVGOBN01JF type=write size=2105751 2024-09-12T00:24:35.279 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.279+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~KTXRTLERCJOR.0 size=30079 2024-09-12T00:24:35.279 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.279+0000 7f0d199128c0 1 > prepared multipart upload key=IPJEXRBN96NB upload=KTXRTLERCJOR tag=5TYI9JEFGO06 type=write size=1078655 2024-09-12T00:24:35.282 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.283+0000 7f0d199128c0 1 < completed delete operation key=OVLAP0OS78QG tag=XGMM7LUTQLT8 type=del 2024-09-12T00:24:35.286 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.287+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=BUZWHNKN4G02 type=del size=2738102 2024-09-12T00:24:35.289 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.287+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~99Y81DWNCWKF.0 size=1048576 2024-09-12T00:24:35.292 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.291+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~99Y81DWNCWKF.1 size=1048576 2024-09-12T00:24:35.295 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.295+0000 7f0d199128c0 1 < completed part key=_multipart_9I6MZAEUS4I0.2~99Y81DWNCWKF.2 size=56551 2024-09-12T00:24:35.301 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.299+0000 7f0d199128c0 1 < completed multipart upload key=9I6MZAEUS4I0 upload=99Y81DWNCWKF tag=TCE779DWZ35S type=write size=3202279 2024-09-12T00:24:35.304 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.303+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=PXPJVE4RPT6W type=del size=725323 2024-09-12T00:24:35.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.307+0000 7f0d199128c0 1 < completed delete operation key=4K654PSDLDVI tag=A1RXKV2W08W1 type=del 2024-09-12T00:24:35.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.311+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=AYPN5W5JY7XV type=del size=348446 2024-09-12T00:24:35.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.315+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~W5MM8UKLKSD5.0 size=1048576 2024-09-12T00:24:35.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.319+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~W5MM8UKLKSD5.1 size=1048576 2024-09-12T00:24:35.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.319+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~W5MM8UKLKSD5.2 size=686794 2024-09-12T00:24:35.327 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.327+0000 7f0d199128c0 1 < completed multipart upload key=V6H6S9X0U2A0 upload=W5MM8UKLKSD5 tag=8WCE23WOGGKD type=write size=3832522 2024-09-12T00:24:35.333 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.331+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~6DINY8K4ZK5L.0 size=1048576 2024-09-12T00:24:35.336 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.335+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~6DINY8K4ZK5L.1 size=290547 2024-09-12T00:24:35.336 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.335+0000 7f0d199128c0 1 > prepared multipart upload key=PK2CA62QBZXS upload=6DINY8K4ZK5L tag=80BDXL5YS3GV type=write size=2387699 2024-09-12T00:24:35.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.339+0000 7f0d199128c0 1 < canceled operation key=4K654PSDLDVI tag=0WFPP86SDCV0 type=del size=327236 2024-09-12T00:24:35.343 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.343+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=2RPO1OL8CNDE type=del size=2532139 2024-09-12T00:24:35.347 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.347+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~TC4ZP3BL71QI.0 size=1048576 2024-09-12T00:24:35.351 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.351+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~TC4ZP3BL71QI.1 size=140047 2024-09-12T00:24:35.358 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.359+0000 7f0d199128c0 1 < completed multipart upload key=1Y6B1MJP5G4L upload=TC4ZP3BL71QI tag=1WGLS88WIPF0 type=write size=2237199 2024-09-12T00:24:35.365 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.363+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~DRQJUDP19Y64.0 size=1048576 2024-09-12T00:24:35.368 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.367+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~DRQJUDP19Y64.1 size=1048576 2024-09-12T00:24:35.371 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.371+0000 7f0d199128c0 1 > prepared part key=_multipart_SITJU2EUVSR8.2~DRQJUDP19Y64.2 size=574394 2024-09-12T00:24:35.371 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.371+0000 7f0d199128c0 1 > prepared multipart upload key=SITJU2EUVSR8 upload=DRQJUDP19Y64 tag=03H5ECJXD9V3 type=write size=3720122 2024-09-12T00:24:35.375 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.375+0000 7f0d199128c0 1 < completed delete operation key=JA6CSJF78VE2 tag=V0WG31UDNWPC type=del 2024-09-12T00:24:35.379 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.379+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=7WKT3CW03AKM type=del size=4022588 2024-09-12T00:24:35.384 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.383+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~8UDIB2H5USWM.0 size=924753 2024-09-12T00:24:35.390 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.391+0000 7f0d199128c0 1 < completed multipart upload key=V6H6S9X0U2A0 upload=8UDIB2H5USWM tag=78HX3WBUSNIY type=write size=1973329 2024-09-12T00:24:35.394 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.395+0000 7f0d199128c0 1 > prepared operation key=GH0FNY2AI00G tag=C1VM79SUG7PP type=del size=2815696 2024-09-12T00:24:35.398 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.399+0000 7f0d199128c0 1 < completed delete operation key=IPJEXRBN96NB tag=1B39OPOEPV58 type=del 2024-09-12T00:24:35.402 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.403+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=7NHI3G2UB52Q type=del size=1246012 2024-09-12T00:24:35.407 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.407+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~1FYA293M660Y.0 size=1048576 2024-09-12T00:24:35.410 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.411+0000 7f0d199128c0 1 < completed part key=_multipart_J75P0821XGRO.2~1FYA293M660Y.1 size=477385 2024-09-12T00:24:35.417 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.415+0000 7f0d199128c0 1 < completed multipart upload key=J75P0821XGRO upload=1FYA293M660Y tag=ZJMJ6G7ZSR65 type=write size=2574537 2024-09-12T00:24:35.425 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.423+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~22FBSW3TIBAX.0 size=1048576 2024-09-12T00:24:35.428 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.427+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~22FBSW3TIBAX.1 size=1048576 2024-09-12T00:24:35.430 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.431+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~22FBSW3TIBAX.2 size=751329 2024-09-12T00:24:35.431 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.431+0000 7f0d199128c0 1 > prepared multipart upload key=1Y6B1MJP5G4L upload=22FBSW3TIBAX tag=PTT0CMJ1XL3G type=write size=3897057 2024-09-12T00:24:35.434 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.435+0000 7f0d199128c0 1 < completed delete operation key=FJ8YV026H0ZU tag=PV63KYHXLH2U type=del 2024-09-12T00:24:35.438 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.439+0000 7f0d199128c0 1 > prepared operation key=2EK9CCKG26W2 tag=CX5O8H1XB4YK type=del size=4163203 2024-09-12T00:24:35.442 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.443+0000 7f0d199128c0 1 < completed part key=_multipart_V6H6S9X0U2A0.2~W6GI8GV9C8JU.0 size=104981 2024-09-12T00:24:35.447 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.447+0000 7f0d199128c0 1 < completed multipart upload key=V6H6S9X0U2A0 upload=W6GI8GV9C8JU tag=3PK16K1C40OU type=write size=1153557 2024-09-12T00:24:35.451 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.451+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=4792C1GN51W1 type=del size=1334966 2024-09-12T00:24:35.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.455+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~SKCR1AO4O5VY.0 size=1038091 2024-09-12T00:24:35.460 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.459+0000 7f0d199128c0 1 < completed multipart upload key=1Y6B1MJP5G4L upload=SKCR1AO4O5VY tag=0W310RIOSLDL type=write size=2086667 2024-09-12T00:24:35.463 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.463+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=PHK3LZDDOKYY type=del size=1248681 2024-09-12T00:24:35.467 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.467+0000 7f0d199128c0 1 < completed delete operation key=0ZT4NZYZKI5Z tag=NE0I8FIFAACQ type=del 2024-09-12T00:24:35.471 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.471+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=Q76KY2JVERVG type=del size=1059541 2024-09-12T00:24:35.474 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.475+0000 7f0d199128c0 1 < completed delete operation key=WBGXMJB7U422 tag=P11705Z2KT0K type=del 2024-09-12T00:24:35.481 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.479+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~SGL9HRDWHOFZ.0 size=1048576 2024-09-12T00:24:35.484 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.483+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~SGL9HRDWHOFZ.1 size=626543 2024-09-12T00:24:35.484 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.483+0000 7f0d199128c0 1 > prepared multipart upload key=IPJEXRBN96NB upload=SGL9HRDWHOFZ tag=3VF0U36XMESJ type=write size=2723695 2024-09-12T00:24:35.488 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.487+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~KTXRTLERCJOR.0 size=30079 2024-09-12T00:24:35.494 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.495+0000 7f0d199128c0 1 < completed multipart upload key=IPJEXRBN96NB upload=KTXRTLERCJOR tag=5TYI9JEFGO06 type=write size=1078655 2024-09-12T00:24:35.497 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.499+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=6F0EU0C9L4Q9 type=del size=1325667 2024-09-12T00:24:35.501 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.503+0000 7f0d199128c0 1 < completed delete operation key=37WTPAJGOX5L tag=BUZWHNKN4G02 type=del 2024-09-12T00:24:35.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.507+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=PQ5KX40Q7O12 type=del size=2993998 2024-09-12T00:24:35.510 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.511+0000 7f0d199128c0 1 < completed delete operation key=JA6CSJF78VE2 tag=PXPJVE4RPT6W type=del 2024-09-12T00:24:35.519 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.519+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=2LGG2F419I65 type=write size=528570 2024-09-12T00:24:35.523 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.523+0000 7f0d199128c0 1 < completed delete operation key=V6H6S9X0U2A0 tag=AYPN5W5JY7XV type=del 2024-09-12T00:24:35.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.527+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=0AOTUL5AUIOO type=del size=2486638 2024-09-12T00:24:35.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.531+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~6DINY8K4ZK5L.0 size=1048576 2024-09-12T00:24:35.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.535+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~6DINY8K4ZK5L.1 size=290547 2024-09-12T00:24:35.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.539+0000 7f0d199128c0 1 < completed multipart upload key=PK2CA62QBZXS upload=6DINY8K4ZK5L tag=80BDXL5YS3GV type=write size=2387699 2024-09-12T00:24:35.544 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.543+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=EQO6AWTAAZBO type=del size=2615511 2024-09-12T00:24:35.552 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.551+0000 7f0d199128c0 1 < suggested update operation key=GH0FNY2AI00G tag=2RPO1OL8CNDE type=del size=2532139 2024-09-12T00:24:35.555 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.555+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=57IL0OZFZYPR type=write size=667201 2024-09-12T00:24:35.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.559+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~DRQJUDP19Y64.0 size=1048576 2024-09-12T00:24:35.561 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.559+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~DRQJUDP19Y64.1 size=1048576 2024-09-12T00:24:35.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.563+0000 7f0d199128c0 1 < completed part key=_multipart_SITJU2EUVSR8.2~DRQJUDP19Y64.2 size=574394 2024-09-12T00:24:35.569 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.571+0000 7f0d199128c0 1 < completed multipart upload key=SITJU2EUVSR8 upload=DRQJUDP19Y64 tag=03H5ECJXD9V3 type=write size=3720122 2024-09-12T00:24:35.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.575+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~ZI029ON8F4FV.0 size=184146 2024-09-12T00:24:35.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.575+0000 7f0d199128c0 1 > prepared multipart upload key=H604SA6XTFLY upload=ZI029ON8F4FV tag=2U44QF5V3GQA type=write size=1232722 2024-09-12T00:24:35.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.579+0000 7f0d199128c0 1 < completed delete operation key=NXQYUQIR2APT tag=7WKT3CW03AKM type=del 2024-09-12T00:24:35.587 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.587+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~6QBCPXB8TH76.0 size=1048576 2024-09-12T00:24:35.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.591+0000 7f0d199128c0 1 > prepared part key=_multipart_57W1IO3KSWBR.2~6QBCPXB8TH76.1 size=235543 2024-09-12T00:24:35.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.591+0000 7f0d199128c0 1 > prepared multipart upload key=57W1IO3KSWBR upload=6QBCPXB8TH76 tag=KIYUEY73YE4D type=write size=2332695 2024-09-12T00:24:35.594 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.595+0000 7f0d199128c0 -1 < failed to complete operation key=GH0FNY2AI00G tag=C1VM79SUG7PP type=del size=2815696: (22) Invalid argument 2024-09-12T00:24:35.601 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.599+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~NL9ODNJRPP5H.0 size=1048576 2024-09-12T00:24:35.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.603+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~NL9ODNJRPP5H.1 size=297638 2024-09-12T00:24:35.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.603+0000 7f0d199128c0 1 > prepared multipart upload key=RX3RVT06SGJ4 upload=NL9ODNJRPP5H tag=PBEB8I8WP9YS type=write size=2394790 2024-09-12T00:24:35.608 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.607+0000 7f0d199128c0 1 < completed delete operation key=10YEWZDTTEV0 tag=7NHI3G2UB52Q type=del 2024-09-12T00:24:35.612 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.611+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=V2L0184YAJXU type=del size=2692694 2024-09-12T00:24:35.616 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.615+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~22FBSW3TIBAX.0 size=1048576 2024-09-12T00:24:35.619 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.619+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~22FBSW3TIBAX.1 size=1048576 2024-09-12T00:24:35.624 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.623+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~22FBSW3TIBAX.2 size=751329 2024-09-12T00:24:35.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.627+0000 7f0d199128c0 1 < completed multipart upload key=1Y6B1MJP5G4L upload=22FBSW3TIBAX tag=PTT0CMJ1XL3G type=write size=3897057 2024-09-12T00:24:35.636 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.635+0000 7f0d199128c0 1 > prepared part key=_multipart_IPJEXRBN96NB.2~SOGM1SP9KTFD.0 size=734215 2024-09-12T00:24:35.636 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.635+0000 7f0d199128c0 1 > prepared multipart upload key=IPJEXRBN96NB upload=SOGM1SP9KTFD tag=R5CAGU71UECA type=write size=1782791 2024-09-12T00:24:35.639 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.639+0000 7f0d199128c0 1 < completed delete operation key=2EK9CCKG26W2 tag=CX5O8H1XB4YK type=del 2024-09-12T00:24:35.643 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.643+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=NEKM3MFVGQDT type=del size=920249 2024-09-12T00:24:35.647 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.647+0000 7f0d199128c0 1 < completed delete operation key=37WTPAJGOX5L tag=4792C1GN51W1 type=del 2024-09-12T00:24:35.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.655+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~4F8RYXYCIUHF.0 size=1048576 2024-09-12T00:24:35.657 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.655+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~4F8RYXYCIUHF.1 size=1048576 2024-09-12T00:24:35.659 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.659+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~4F8RYXYCIUHF.2 size=833559 2024-09-12T00:24:35.660 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.659+0000 7f0d199128c0 1 > prepared multipart upload key=37WTPAJGOX5L upload=4F8RYXYCIUHF tag=P9O4C9NLWMIB type=write size=3979287 2024-09-12T00:24:35.666 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.667+0000 7f0d199128c0 1 < suggested remove operation key=A529WOKFD1NI tag=PHK3LZDDOKYY type=del 2024-09-12T00:24:35.673 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.671+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~26NIO2VZ2ZL6.0 size=1048576 2024-09-12T00:24:35.675 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.675+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~26NIO2VZ2ZL6.1 size=740623 2024-09-12T00:24:35.675 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.675+0000 7f0d199128c0 1 > prepared multipart upload key=H604SA6XTFLY upload=26NIO2VZ2ZL6 tag=9A7ERGQ64OT0 type=write size=2837775 2024-09-12T00:24:35.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.679+0000 7f0d199128c0 1 < canceled operation key=PK2CA62QBZXS tag=Q76KY2JVERVG type=del size=1059541 2024-09-12T00:24:35.685 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.683+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~54D3BW12HY57.0 size=42923 2024-09-12T00:24:35.685 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.683+0000 7f0d199128c0 1 > prepared multipart upload key=37WTPAJGOX5L upload=54D3BW12HY57 tag=QH08ZF5Z9IJN type=write size=1091499 2024-09-12T00:24:35.688 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.687+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~SGL9HRDWHOFZ.0 size=1048576 2024-09-12T00:24:35.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.691+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~SGL9HRDWHOFZ.1 size=626543 2024-09-12T00:24:35.698 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.699+0000 7f0d199128c0 1 < completed multipart upload key=IPJEXRBN96NB upload=SGL9HRDWHOFZ tag=3VF0U36XMESJ type=write size=2723695 2024-09-12T00:24:35.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.703+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=VL3T2OJMNRXP type=del size=3990624 2024-09-12T00:24:35.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.707+0000 7f0d199128c0 1 < completed delete operation key=10YEWZDTTEV0 tag=6F0EU0C9L4Q9 type=del 2024-09-12T00:24:35.710 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.711+0000 7f0d199128c0 1 > prepared operation key=V6H6S9X0U2A0 tag=LJ0UPMX7DC18 type=del size=3018904 2024-09-12T00:24:35.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.715+0000 7f0d199128c0 1 < completed delete operation key=WBGXMJB7U422 tag=PQ5KX40Q7O12 type=del 2024-09-12T00:24:35.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.719+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=XAO8RUS1BVCO type=del size=602130 2024-09-12T00:24:35.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.723+0000 7f0d199128c0 1 < canceled operation key=JA6CSJF78VE2 tag=2LGG2F419I65 type=write size=528570 2024-09-12T00:24:35.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.727+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=6MZVPYRX7K2B type=del size=2156805 2024-09-12T00:24:35.735 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.735+0000 7f0d199128c0 1 < completed delete operation key=QUO5ND3O41TY tag=0AOTUL5AUIOO type=del 2024-09-12T00:24:35.739 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.739+0000 7f0d199128c0 1 > prepared operation key=FJ8YV026H0ZU tag=CEOCIGDVRG5U type=del size=819331 2024-09-12T00:24:35.742 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.743+0000 7f0d199128c0 1 < completed delete operation key=1Y6B1MJP5G4L tag=EQO6AWTAAZBO type=del 2024-09-12T00:24:35.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.747+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=G97R18RHJ1BM type=del size=99805 2024-09-12T00:24:35.752 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.751+0000 7f0d199128c0 1 < suggested update operation key=T6GOR4SBYU2Y tag=57IL0OZFZYPR type=write size=667201 2024-09-12T00:24:35.755 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.755+0000 7f0d199128c0 1 > prepared operation key=JA6CSJF78VE2 tag=4KC3I5UIUUWC type=del size=3631046 2024-09-12T00:24:35.758 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.759+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~ZI029ON8F4FV.0 size=184146 2024-09-12T00:24:35.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.763+0000 7f0d199128c0 1 < completed multipart upload key=H604SA6XTFLY upload=ZI029ON8F4FV tag=2U44QF5V3GQA type=write size=1232722 2024-09-12T00:24:35.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.771+0000 7f0d199128c0 1 > prepared part key=_multipart_37WTPAJGOX5L.2~MYSU6P7NS68I.0 size=9732 2024-09-12T00:24:35.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.771+0000 7f0d199128c0 1 > prepared multipart upload key=37WTPAJGOX5L upload=MYSU6P7NS68I tag=WWV4GGH2O0E0 type=write size=1058308 2024-09-12T00:24:35.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.775+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~6QBCPXB8TH76.0 size=1048576 2024-09-12T00:24:35.778 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.779+0000 7f0d199128c0 1 < completed part key=_multipart_57W1IO3KSWBR.2~6QBCPXB8TH76.1 size=235543 2024-09-12T00:24:35.783 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.783+0000 7f0d199128c0 1 < completed multipart upload key=57W1IO3KSWBR upload=6QBCPXB8TH76 tag=KIYUEY73YE4D type=write size=2332695 2024-09-12T00:24:35.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.791+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~0OWCHHF07YUV.0 size=1048576 2024-09-12T00:24:35.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.791+0000 7f0d199128c0 1 > prepared part key=_multipart_A529WOKFD1NI.2~0OWCHHF07YUV.1 size=390644 2024-09-12T00:24:35.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.791+0000 7f0d199128c0 1 > prepared multipart upload key=A529WOKFD1NI upload=0OWCHHF07YUV tag=UME0LWKCG60W type=write size=2487796 2024-09-12T00:24:35.796 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.795+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~NL9ODNJRPP5H.0 size=1048576 2024-09-12T00:24:35.799 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.799+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~NL9ODNJRPP5H.1 size=297638 2024-09-12T00:24:35.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.803+0000 7f0d199128c0 1 < completed multipart upload key=RX3RVT06SGJ4 upload=NL9ODNJRPP5H tag=PBEB8I8WP9YS type=write size=2394790 2024-09-12T00:24:35.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.807+0000 7f0d199128c0 1 > prepared operation key=RFCHRGVA9GOI tag=1T0Y8ZB0KXDU type=del size=3255550 2024-09-12T00:24:35.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.811+0000 7f0d199128c0 1 < completed delete operation key=NXQYUQIR2APT tag=V2L0184YAJXU type=del 2024-09-12T00:24:35.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.815+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~BV79RPR1RFAH.0 size=357818 2024-09-12T00:24:35.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.815+0000 7f0d199128c0 1 > prepared multipart upload key=GH0FNY2AI00G upload=BV79RPR1RFAH tag=C66V2YJRW8RR type=write size=1406394 2024-09-12T00:24:35.819 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.819+0000 7f0d199128c0 1 < completed part key=_multipart_IPJEXRBN96NB.2~SOGM1SP9KTFD.0 size=734215 2024-09-12T00:24:35.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.823+0000 7f0d199128c0 1 < completed multipart upload key=IPJEXRBN96NB upload=SOGM1SP9KTFD tag=R5CAGU71UECA type=write size=1782791 2024-09-12T00:24:35.829 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.827+0000 7f0d199128c0 1 > prepared operation key=0ZT4NZYZKI5Z tag=S2VB97BK4O11 type=del size=534021 2024-09-12T00:24:35.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.831+0000 7f0d199128c0 1 < completed delete operation key=OVLAP0OS78QG tag=NEKM3MFVGQDT type=del 2024-09-12T00:24:35.838 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.839+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~6UBL8CTRQ5PF.0 size=1048576 2024-09-12T00:24:35.841 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.839+0000 7f0d199128c0 1 > prepared part key=_multipart_1Y6B1MJP5G4L.2~6UBL8CTRQ5PF.1 size=904760 2024-09-12T00:24:35.841 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.839+0000 7f0d199128c0 1 > prepared multipart upload key=1Y6B1MJP5G4L upload=6UBL8CTRQ5PF tag=BLNZYP5GRA9X type=write size=3001912 2024-09-12T00:24:35.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.843+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~4F8RYXYCIUHF.0 size=1048576 2024-09-12T00:24:35.848 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.847+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~4F8RYXYCIUHF.1 size=1048576 2024-09-12T00:24:35.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.851+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~4F8RYXYCIUHF.2 size=833559 2024-09-12T00:24:35.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.863+0000 7f0d199128c0 1 < completed multipart upload key=37WTPAJGOX5L upload=4F8RYXYCIUHF tag=P9O4C9NLWMIB type=write size=3979287 2024-09-12T00:24:35.865 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.867+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=7M9ZCAT2TZ7W type=write size=82010 2024-09-12T00:24:35.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.867+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~26NIO2VZ2ZL6.0 size=1048576 2024-09-12T00:24:35.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.871+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~26NIO2VZ2ZL6.1 size=740623 2024-09-12T00:24:35.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.879+0000 7f0d199128c0 1 < completed multipart upload key=H604SA6XTFLY upload=26NIO2VZ2ZL6 tag=9A7ERGQ64OT0 type=write size=2837775 2024-09-12T00:24:35.881 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.879+0000 7f0d199128c0 1 > prepared operation key=YTXW98O07966 tag=ZK9MYMVFEPV0 type=del size=731558 2024-09-12T00:24:35.885 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.883+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~54D3BW12HY57.0 size=42923 2024-09-12T00:24:35.890 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.891+0000 7f0d199128c0 1 < completed multipart upload key=37WTPAJGOX5L upload=54D3BW12HY57 tag=QH08ZF5Z9IJN type=write size=1091499 2024-09-12T00:24:35.894 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.895+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=L34IX3P5XXII type=del size=1952129 2024-09-12T00:24:35.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.899+0000 7f0d199128c0 1 < canceled operation key=VXZI0ZTMQSV0 tag=VL3T2OJMNRXP type=del size=3990624 2024-09-12T00:24:35.904 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.903+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~RIC1H0OTT6I0.0 size=1048576 2024-09-12T00:24:35.906 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.907+0000 7f0d199128c0 1 > prepared part key=_multipart_WPZOKZDFXK4S.2~RIC1H0OTT6I0.1 size=318570 2024-09-12T00:24:35.906 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.907+0000 7f0d199128c0 1 > prepared multipart upload key=WPZOKZDFXK4S upload=RIC1H0OTT6I0 tag=3C9W18Y2NKTB type=write size=2415722 2024-09-12T00:24:35.913 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.915+0000 7f0d199128c0 1 < suggested update operation key=V6H6S9X0U2A0 tag=LJ0UPMX7DC18 type=del size=3018904 2024-09-12T00:24:35.920 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.919+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~VCESLXKZ8L5K.0 size=1048576 2024-09-12T00:24:35.923 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.923+0000 7f0d199128c0 1 > prepared part key=_multipart_10YEWZDTTEV0.2~VCESLXKZ8L5K.1 size=374669 2024-09-12T00:24:35.923 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.923+0000 7f0d199128c0 1 > prepared multipart upload key=10YEWZDTTEV0 upload=VCESLXKZ8L5K tag=DWMZ9T10D43W type=write size=2471821 2024-09-12T00:24:35.926 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.927+0000 7f0d199128c0 1 < completed delete operation key=FJ8YV026H0ZU tag=XAO8RUS1BVCO type=del 2024-09-12T00:24:35.930 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.931+0000 7f0d199128c0 1 > prepared operation key=SITJU2EUVSR8 tag=0U1PE5ZLXVRG type=del size=1241882 2024-09-12T00:24:35.934 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.935+0000 7f0d199128c0 1 < completed delete operation key=A529WOKFD1NI tag=6MZVPYRX7K2B type=del 2024-09-12T00:24:35.937 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.939+0000 7f0d199128c0 1 > prepared operation key=ZWGD87Z1MMNK tag=M3ZKDLIO1QXG type=del size=3704768 2024-09-12T00:24:35.941 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.939+0000 7f0d199128c0 1 < completed delete operation key=FJ8YV026H0ZU tag=CEOCIGDVRG5U type=del 2024-09-12T00:24:35.945 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.943+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=TWQMZUKT5NBZ type=del size=2082362 2024-09-12T00:24:35.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.947+0000 7f0d199128c0 1 < completed delete operation key=PK2CA62QBZXS tag=G97R18RHJ1BM type=del 2024-09-12T00:24:35.951 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.951+0000 7f0d199128c0 1 > prepared operation key=OVLAP0OS78QG tag=5UKK4Y1X5RHM type=del size=322829 2024-09-12T00:24:35.955 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.955+0000 7f0d199128c0 1 < canceled operation key=JA6CSJF78VE2 tag=4KC3I5UIUUWC type=del size=3631046 2024-09-12T00:24:35.961 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.959+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~F4QPBI3TZMYR.0 size=1048576 2024-09-12T00:24:35.963 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.963+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~F4QPBI3TZMYR.1 size=1048576 2024-09-12T00:24:35.966 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.967+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~F4QPBI3TZMYR.2 size=259449 2024-09-12T00:24:35.966 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.967+0000 7f0d199128c0 1 > prepared multipart upload key=PK2CA62QBZXS upload=F4QPBI3TZMYR tag=JFMPWIYRQZM6 type=write size=3405177 2024-09-12T00:24:35.969 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.971+0000 7f0d199128c0 1 < completed part key=_multipart_37WTPAJGOX5L.2~MYSU6P7NS68I.0 size=9732 2024-09-12T00:24:35.976 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.975+0000 7f0d199128c0 1 < completed multipart upload key=37WTPAJGOX5L upload=MYSU6P7NS68I tag=WWV4GGH2O0E0 type=write size=1058308 2024-09-12T00:24:35.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.979+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~G5BT5SNNDASC.0 size=1048576 2024-09-12T00:24:35.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.983+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~G5BT5SNNDASC.1 size=1048576 2024-09-12T00:24:35.987 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.987+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~G5BT5SNNDASC.2 size=417539 2024-09-12T00:24:35.987 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.987+0000 7f0d199128c0 1 > prepared multipart upload key=JA6CSJF78VE2 upload=G5BT5SNNDASC tag=P5KSYLLTP956 type=write size=3563267 2024-09-12T00:24:35.990 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.991+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~0OWCHHF07YUV.0 size=1048576 2024-09-12T00:24:35.993 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.991+0000 7f0d199128c0 1 < completed part key=_multipart_A529WOKFD1NI.2~0OWCHHF07YUV.1 size=390644 2024-09-12T00:24:35.998 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:35.999+0000 7f0d199128c0 1 < completed multipart upload key=A529WOKFD1NI upload=0OWCHHF07YUV tag=UME0LWKCG60W type=write size=2487796 2024-09-12T00:24:36.001 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.003+0000 7f0d199128c0 1 > prepared operation key=HXNC728XIWC1 tag=8U2S214FZIN1 type=del size=4060587 2024-09-12T00:24:36.005 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.003+0000 7f0d199128c0 1 < completed delete operation key=RFCHRGVA9GOI tag=1T0Y8ZB0KXDU type=del 2024-09-12T00:24:36.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.007+0000 7f0d199128c0 1 > prepared operation key=1Y6B1MJP5G4L tag=Y7CQ3GOV702H type=del size=3432234 2024-09-12T00:24:36.012 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.011+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~BV79RPR1RFAH.0 size=357818 2024-09-12T00:24:36.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.019+0000 7f0d199128c0 1 < completed multipart upload key=GH0FNY2AI00G upload=BV79RPR1RFAH tag=C66V2YJRW8RR type=write size=1406394 2024-09-12T00:24:36.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.023+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=58U5CW8HU6Y8 type=del size=1678182 2024-09-12T00:24:36.025 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.027+0000 7f0d199128c0 1 < completed delete operation key=0ZT4NZYZKI5Z tag=S2VB97BK4O11 type=del 2024-09-12T00:24:36.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.027+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=5RTC12BU5RZA type=del size=74723 2024-09-12T00:24:36.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.031+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~6UBL8CTRQ5PF.0 size=1048576 2024-09-12T00:24:36.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.035+0000 7f0d199128c0 1 < completed part key=_multipart_1Y6B1MJP5G4L.2~6UBL8CTRQ5PF.1 size=904760 2024-09-12T00:24:36.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.043+0000 7f0d199128c0 1 < completed multipart upload key=1Y6B1MJP5G4L upload=6UBL8CTRQ5PF tag=BLNZYP5GRA9X type=write size=3001912 2024-09-12T00:24:36.048 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.047+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~UU8TH65QD0E7.0 size=1048576 2024-09-12T00:24:36.051 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.051+0000 7f0d199128c0 1 > prepared part key=_multipart_WBGXMJB7U422.2~UU8TH65QD0E7.1 size=387136 2024-09-12T00:24:36.051 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.051+0000 7f0d199128c0 1 > prepared multipart upload key=WBGXMJB7U422 upload=UU8TH65QD0E7 tag=YEAFM20HD9AB type=write size=2484288 2024-09-12T00:24:36.055 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.055+0000 7f0d199128c0 1 < completed write operation key=T6GOR4SBYU2Y tag=7M9ZCAT2TZ7W type=write size=82010 2024-09-12T00:24:36.060 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.059+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~HJ38XML09MHP.0 size=1048576 2024-09-12T00:24:36.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.063+0000 7f0d199128c0 1 > prepared part key=_multipart_PK2CA62QBZXS.2~HJ38XML09MHP.1 size=522949 2024-09-12T00:24:36.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.063+0000 7f0d199128c0 1 > prepared multipart upload key=PK2CA62QBZXS upload=HJ38XML09MHP tag=PFBIU56ADLZG type=write size=2620101 2024-09-12T00:24:36.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.067+0000 7f0d199128c0 1 < completed delete operation key=YTXW98O07966 tag=ZK9MYMVFEPV0 type=del 2024-09-12T00:24:36.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.071+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~M8ZPRGL1QTNF.0 size=113625 2024-09-12T00:24:36.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.071+0000 7f0d199128c0 1 > prepared multipart upload key=RX3RVT06SGJ4 upload=M8ZPRGL1QTNF tag=AID188NC2CVM type=write size=1162201 2024-09-12T00:24:36.076 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.075+0000 7f0d199128c0 1 < completed delete operation key=NXQYUQIR2APT tag=L34IX3P5XXII type=del 2024-09-12T00:24:36.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.079+0000 7f0d199128c0 1 > prepared operation key=A529WOKFD1NI tag=ZA1D9RJXEHMH type=del size=1461869 2024-09-12T00:24:36.083 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.083+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~RIC1H0OTT6I0.0 size=1048576 2024-09-12T00:24:36.086 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.087+0000 7f0d199128c0 1 < completed part key=_multipart_WPZOKZDFXK4S.2~RIC1H0OTT6I0.1 size=318570 2024-09-12T00:24:36.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.091+0000 7f0d199128c0 1 < completed multipart upload key=WPZOKZDFXK4S upload=RIC1H0OTT6I0 tag=3C9W18Y2NKTB type=write size=2415722 2024-09-12T00:24:36.094 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.095+0000 7f0d199128c0 1 > prepared operation key=0EBWUENN0881 tag=A0091HDPZGOE type=del size=70556 2024-09-12T00:24:36.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.099+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~VCESLXKZ8L5K.0 size=1048576 2024-09-12T00:24:36.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.099+0000 7f0d199128c0 1 < completed part key=_multipart_10YEWZDTTEV0.2~VCESLXKZ8L5K.1 size=374669 2024-09-12T00:24:36.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.107+0000 7f0d199128c0 1 < completed multipart upload key=10YEWZDTTEV0 upload=VCESLXKZ8L5K tag=DWMZ9T10D43W type=write size=2471821 2024-09-12T00:24:36.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.111+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~UKC9M35ZNWTP.0 size=101913 2024-09-12T00:24:36.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.111+0000 7f0d199128c0 1 > prepared multipart upload key=VXZI0ZTMQSV0 upload=UKC9M35ZNWTP tag=UH9ETJ200XB6 type=write size=1150489 2024-09-12T00:24:36.119 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.119+0000 7f0d199128c0 1 < suggested update operation key=SITJU2EUVSR8 tag=0U1PE5ZLXVRG type=del size=1241882 2024-09-12T00:24:36.125 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.123+0000 7f0d199128c0 1 > prepared part key=_multipart_2EK9CCKG26W2.2~O2MF4UE7D2L2.0 size=181164 2024-09-12T00:24:36.125 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.123+0000 7f0d199128c0 1 > prepared multipart upload key=2EK9CCKG26W2 upload=O2MF4UE7D2L2 tag=N0USO73HNR83 type=write size=1229740 2024-09-12T00:24:36.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.127+0000 7f0d199128c0 1 < canceled operation key=ZWGD87Z1MMNK tag=M3ZKDLIO1QXG type=del size=3704768 2024-09-12T00:24:36.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.131+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=1LMCNNKR1VRB type=del size=1590808 2024-09-12T00:24:36.135 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.135+0000 7f0d199128c0 1 < canceled operation key=37WTPAJGOX5L tag=TWQMZUKT5NBZ type=del size=2082362 2024-09-12T00:24:36.141 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.143+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~MKYH71B2U4V4.0 size=1048576 2024-09-12T00:24:36.144 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.143+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~MKYH71B2U4V4.1 size=1048576 2024-09-12T00:24:36.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.147+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~MKYH71B2U4V4.2 size=1030531 2024-09-12T00:24:36.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.147+0000 7f0d199128c0 1 > prepared multipart upload key=JA6CSJF78VE2 upload=MKYH71B2U4V4 tag=1BO33JSSM1Q0 type=write size=4176259 2024-09-12T00:24:36.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.151+0000 7f0d199128c0 1 < canceled operation key=OVLAP0OS78QG tag=5UKK4Y1X5RHM type=del size=322829 2024-09-12T00:24:36.153 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.151+0000 7f0d199128c0 1 > prepared operation key=10YEWZDTTEV0 tag=O5DSU82C2FBY type=del size=2579633 2024-09-12T00:24:36.156 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.155+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~F4QPBI3TZMYR.0 size=1048576 2024-09-12T00:24:36.159 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.159+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~F4QPBI3TZMYR.1 size=1048576 2024-09-12T00:24:36.162 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.163+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~F4QPBI3TZMYR.2 size=259449 2024-09-12T00:24:36.168 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.167+0000 7f0d199128c0 1 < completed multipart upload key=PK2CA62QBZXS upload=F4QPBI3TZMYR tag=JFMPWIYRQZM6 type=write size=3405177 2024-09-12T00:24:36.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.171+0000 7f0d199128c0 1 > prepared operation key=T6GOR4SBYU2Y tag=M2ACI4AXDALH type=del size=1635613 2024-09-12T00:24:36.175 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.175+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~G5BT5SNNDASC.0 size=1048576 2024-09-12T00:24:36.181 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.179+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~G5BT5SNNDASC.1 size=1048576 2024-09-12T00:24:36.183 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.183+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~G5BT5SNNDASC.2 size=417539 2024-09-12T00:24:36.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.187+0000 7f0d199128c0 1 < completed multipart upload key=JA6CSJF78VE2 upload=G5BT5SNNDASC tag=P5KSYLLTP956 type=write size=3563267 2024-09-12T00:24:36.196 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.195+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~9OIBH07HS9B9.0 size=1048576 2024-09-12T00:24:36.199 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.199+0000 7f0d199128c0 1 > prepared part key=_multipart_B58RWC9W8THG.2~9OIBH07HS9B9.1 size=365572 2024-09-12T00:24:36.199 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.199+0000 7f0d199128c0 1 > prepared multipart upload key=B58RWC9W8THG upload=9OIBH07HS9B9 tag=40XCY8DZ5950 type=write size=2462724 2024-09-12T00:24:36.206 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.207+0000 7f0d199128c0 1 < suggested update operation key=HXNC728XIWC1 tag=8U2S214FZIN1 type=del size=4060587 2024-09-12T00:24:36.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.211+0000 7f0d199128c0 1 > prepared operation key=VXZI0ZTMQSV0 tag=OGWIDRDJNPUJ type=del size=123605 2024-09-12T00:24:36.214 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.215+0000 7f0d199128c0 1 < completed delete operation key=1Y6B1MJP5G4L tag=Y7CQ3GOV702H type=del 2024-09-12T00:24:36.217 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.219+0000 7f0d199128c0 1 > prepared operation key=RX3RVT06SGJ4 tag=E9R7L05J5MAQ type=write size=569085 2024-09-12T00:24:36.221 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.219+0000 7f0d199128c0 1 < completed delete operation key=9I6MZAEUS4I0 tag=58U5CW8HU6Y8 type=del 2024-09-12T00:24:36.228 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.227+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~04XV0EUPAMW2.0 size=1048576 2024-09-12T00:24:36.231 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.231+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~04XV0EUPAMW2.1 size=1048576 2024-09-12T00:24:36.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.235+0000 7f0d199128c0 1 > prepared part key=_multipart_H604SA6XTFLY.2~04XV0EUPAMW2.2 size=280155 2024-09-12T00:24:36.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.235+0000 7f0d199128c0 1 > prepared multipart upload key=H604SA6XTFLY upload=04XV0EUPAMW2 tag=DBFIZ62HVHIV type=write size=3425883 2024-09-12T00:24:36.237 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.235+0000 7f0d199128c0 1 < canceled operation key=J75P0821XGRO tag=5RTC12BU5RZA type=del size=74723 2024-09-12T00:24:36.241 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.239+0000 7f0d199128c0 1 > prepared operation key=IPJEXRBN96NB tag=D6U2PXVF3JYU type=del size=4037764 2024-09-12T00:24:36.245 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.243+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~UU8TH65QD0E7.0 size=1048576 2024-09-12T00:24:36.248 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.247+0000 7f0d199128c0 1 < completed part key=_multipart_WBGXMJB7U422.2~UU8TH65QD0E7.1 size=387136 2024-09-12T00:24:36.254 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.255+0000 7f0d199128c0 1 < completed multipart upload key=WBGXMJB7U422 upload=UU8TH65QD0E7 tag=YEAFM20HD9AB type=write size=2484288 2024-09-12T00:24:36.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.263+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~5QA4GXNPVOOF.0 size=1048576 2024-09-12T00:24:36.264 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.263+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~5QA4GXNPVOOF.1 size=1048576 2024-09-12T00:24:36.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.267+0000 7f0d199128c0 1 > prepared part key=_multipart_GH0FNY2AI00G.2~5QA4GXNPVOOF.2 size=742198 2024-09-12T00:24:36.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.267+0000 7f0d199128c0 1 > prepared multipart upload key=GH0FNY2AI00G upload=5QA4GXNPVOOF tag=PTY5EYG68JXG type=write size=3887926 2024-09-12T00:24:36.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.271+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~HJ38XML09MHP.0 size=1048576 2024-09-12T00:24:36.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.275+0000 7f0d199128c0 1 < completed part key=_multipart_PK2CA62QBZXS.2~HJ38XML09MHP.1 size=522949 2024-09-12T00:24:36.278 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.279+0000 7f0d199128c0 1 < completed multipart upload key=PK2CA62QBZXS upload=HJ38XML09MHP tag=PFBIU56ADLZG type=write size=2620101 2024-09-12T00:24:36.285 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.283+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~2L0VPPPFB7NR.0 size=1048576 2024-09-12T00:24:36.287 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.287+0000 7f0d199128c0 1 > prepared part key=_multipart_0EBWUENN0881.2~2L0VPPPFB7NR.1 size=499348 2024-09-12T00:24:36.287 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.287+0000 7f0d199128c0 1 > prepared multipart upload key=0EBWUENN0881 upload=2L0VPPPFB7NR tag=THKC8S6ZMO93 type=write size=2596500 2024-09-12T00:24:36.291 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.291+0000 7f0d199128c0 1 < completed part key=_multipart_RX3RVT06SGJ4.2~M8ZPRGL1QTNF.0 size=113625 2024-09-12T00:24:36.296 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.295+0000 7f0d199128c0 1 < completed multipart upload key=RX3RVT06SGJ4 upload=M8ZPRGL1QTNF tag=AID188NC2CVM type=write size=1162201 2024-09-12T00:24:36.302 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.303+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~YTYIRLYSVQEI.0 size=1048576 2024-09-12T00:24:36.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.303+0000 7f0d199128c0 1 > prepared part key=_multipart_FJ8YV026H0ZU.2~YTYIRLYSVQEI.1 size=466331 2024-09-12T00:24:36.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.303+0000 7f0d199128c0 1 > prepared multipart upload key=FJ8YV026H0ZU upload=YTYIRLYSVQEI tag=SA1AMCWDYB9N type=write size=2563483 2024-09-12T00:24:36.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.307+0000 7f0d199128c0 1 < canceled operation key=A529WOKFD1NI tag=ZA1D9RJXEHMH type=del size=1461869 2024-09-12T00:24:36.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.311+0000 7f0d199128c0 1 > prepared operation key=NXQYUQIR2APT tag=OC2XA29035A3 type=del size=940940 2024-09-12T00:24:36.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.315+0000 7f0d199128c0 1 < canceled operation key=0EBWUENN0881 tag=A0091HDPZGOE type=del size=70556 2024-09-12T00:24:36.322 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.323+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~GESZYX3WJ190.0 size=1048576 2024-09-12T00:24:36.325 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.323+0000 7f0d199128c0 1 > prepared part key=_multipart_VXZI0ZTMQSV0.2~GESZYX3WJ190.1 size=251282 2024-09-12T00:24:36.325 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.323+0000 7f0d199128c0 1 > prepared multipart upload key=VXZI0ZTMQSV0 upload=GESZYX3WJ190 tag=AQJSUMY3NONN type=write size=2348434 2024-09-12T00:24:36.326 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.327+0000 7f0d199128c0 1 < canceled part key=_multipart_VXZI0ZTMQSV0.2~UKC9M35ZNWTP.0 size=101913 2024-09-12T00:24:36.331 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.331+0000 7f0d199128c0 1 < canceled multipart upload key=VXZI0ZTMQSV0 upload=UKC9M35ZNWTP tag=UH9ETJ200XB6 type=write size=1150489 2024-09-12T00:24:36.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.335+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=3U2T92SLP34X type=del size=4141157 2024-09-12T00:24:36.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.339+0000 7f0d199128c0 1 < completed part key=_multipart_2EK9CCKG26W2.2~O2MF4UE7D2L2.0 size=181164 2024-09-12T00:24:36.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.343+0000 7f0d199128c0 1 < completed multipart upload key=2EK9CCKG26W2 upload=O2MF4UE7D2L2 tag=N0USO73HNR83 type=write size=1229740 2024-09-12T00:24:36.349 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.351+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~U1V5CHEFIRW5.0 size=1048576 2024-09-12T00:24:36.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.351+0000 7f0d199128c0 1 > prepared part key=_multipart_9I6MZAEUS4I0.2~U1V5CHEFIRW5.1 size=466733 2024-09-12T00:24:36.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.351+0000 7f0d199128c0 1 > prepared multipart upload key=9I6MZAEUS4I0 upload=U1V5CHEFIRW5 tag=95M0CIYT3MEG type=write size=2563885 2024-09-12T00:24:36.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.355+0000 7f0d199128c0 1 < completed delete operation key=PK2CA62QBZXS tag=1LMCNNKR1VRB type=del 2024-09-12T00:24:36.358 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.359+0000 7f0d199128c0 1 > prepared operation key=B58RWC9W8THG tag=YYA8CB3FEN05 type=del size=1162369 2024-09-12T00:24:36.361 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.359+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~MKYH71B2U4V4.0 size=1048576 2024-09-12T00:24:36.363 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.363+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~MKYH71B2U4V4.1 size=1048576 2024-09-12T00:24:36.365 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.367+0000 7f0d199128c0 1 < completed part key=_multipart_JA6CSJF78VE2.2~MKYH71B2U4V4.2 size=1030531 2024-09-12T00:24:36.371 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.371+0000 7f0d199128c0 1 < completed multipart upload key=JA6CSJF78VE2 upload=MKYH71B2U4V4 tag=1BO33JSSM1Q0 type=write size=4176259 2024-09-12T00:24:36.376 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.375+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~1JTPWEDTPCG3.0 size=621324 2024-09-12T00:24:36.376 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.375+0000 7f0d199128c0 1 > prepared multipart upload key=RX3RVT06SGJ4 upload=1JTPWEDTPCG3 tag=DYS2FZVD1GI7 type=write size=1669900 2024-09-12T00:24:36.379 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.379+0000 7f0d199128c0 1 < completed delete operation key=10YEWZDTTEV0 tag=O5DSU82C2FBY type=del 2024-09-12T00:24:36.385 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.387+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~J7W8WE854NST.0 size=1048576 2024-09-12T00:24:36.387 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.387+0000 7f0d199128c0 1 > prepared part key=_multipart_JA6CSJF78VE2.2~J7W8WE854NST.1 size=3322 2024-09-12T00:24:36.388 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.387+0000 7f0d199128c0 1 > prepared multipart upload key=JA6CSJF78VE2 upload=J7W8WE854NST tag=YZR38JNSDC5T type=write size=2100474 2024-09-12T00:24:36.390 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.391+0000 7f0d199128c0 1 < completed delete operation key=T6GOR4SBYU2Y tag=M2ACI4AXDALH type=del 2024-09-12T00:24:36.396 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.395+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~YN8EUXCE3HS3.0 size=1048576 2024-09-12T00:24:36.399 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.399+0000 7f0d199128c0 1 > prepared part key=_multipart_RX3RVT06SGJ4.2~YN8EUXCE3HS3.1 size=732071 2024-09-12T00:24:36.399 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.399+0000 7f0d199128c0 1 > prepared multipart upload key=RX3RVT06SGJ4 upload=YN8EUXCE3HS3 tag=PHBJSOQPOP6P type=write size=2829223 2024-09-12T00:24:36.401 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.399+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~9OIBH07HS9B9.0 size=1048576 2024-09-12T00:24:36.403 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.403+0000 7f0d199128c0 1 < completed part key=_multipart_B58RWC9W8THG.2~9OIBH07HS9B9.1 size=365572 2024-09-12T00:24:36.408 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.407+0000 7f0d199128c0 1 < completed multipart upload key=B58RWC9W8THG upload=9OIBH07HS9B9 tag=40XCY8DZ5950 type=write size=2462724 2024-09-12T00:24:36.411 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.411+0000 7f0d199128c0 1 > prepared operation key=37WTPAJGOX5L tag=UNZ4A2CV8LAH type=del size=1984337 2024-09-12T00:24:36.413 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.415+0000 7f0d199128c0 1 < completed delete operation key=VXZI0ZTMQSV0 tag=OGWIDRDJNPUJ type=del 2024-09-12T00:24:36.419 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.419+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~XFYD5W38JMJJ.0 size=1048576 2024-09-12T00:24:36.421 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.423+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~XFYD5W38JMJJ.1 size=1048576 2024-09-12T00:24:36.424 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.423+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~XFYD5W38JMJJ.2 size=316489 2024-09-12T00:24:36.424 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.423+0000 7f0d199128c0 1 > prepared multipart upload key=4K654PSDLDVI upload=XFYD5W38JMJJ tag=6ANQOAZ15IRQ type=write size=3462217 2024-09-12T00:24:36.427 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.427+0000 7f0d199128c0 1 < completed write operation key=RX3RVT06SGJ4 tag=E9R7L05J5MAQ type=write size=569085 2024-09-12T00:24:36.431 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.431+0000 7f0d199128c0 1 > prepared operation key=9I6MZAEUS4I0 tag=7ONYMX6NDD1J type=del size=1223012 2024-09-12T00:24:36.434 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.435+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~04XV0EUPAMW2.0 size=1048576 2024-09-12T00:24:36.436 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.435+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~04XV0EUPAMW2.1 size=1048576 2024-09-12T00:24:36.439 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.439+0000 7f0d199128c0 1 < completed part key=_multipart_H604SA6XTFLY.2~04XV0EUPAMW2.2 size=280155 2024-09-12T00:24:36.444 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.443+0000 7f0d199128c0 1 < completed multipart upload key=H604SA6XTFLY upload=04XV0EUPAMW2 tag=DBFIZ62HVHIV type=write size=3425883 2024-09-12T00:24:36.447 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.447+0000 7f0d199128c0 1 > prepared operation key=QUO5ND3O41TY tag=E6ML84JR6DX1 type=del size=1695796 2024-09-12T00:24:36.450 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.451+0000 7f0d199128c0 1 < completed delete operation key=IPJEXRBN96NB tag=D6U2PXVF3JYU type=del 2024-09-12T00:24:36.455 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.455+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~MMZEW7901YCE.0 size=1048576 2024-09-12T00:24:36.457 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.459+0000 7f0d199128c0 1 > prepared part key=_multipart_OVLAP0OS78QG.2~MMZEW7901YCE.1 size=917862 2024-09-12T00:24:36.457 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.459+0000 7f0d199128c0 1 > prepared multipart upload key=OVLAP0OS78QG upload=MMZEW7901YCE tag=I38S21RCKVWE type=write size=3015014 2024-09-12T00:24:36.460 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.459+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~5QA4GXNPVOOF.0 size=1048576 2024-09-12T00:24:36.462 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.463+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~5QA4GXNPVOOF.1 size=1048576 2024-09-12T00:24:36.464 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.463+0000 7f0d199128c0 1 < completed part key=_multipart_GH0FNY2AI00G.2~5QA4GXNPVOOF.2 size=742198 2024-09-12T00:24:36.469 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.467+0000 7f0d199128c0 1 < completed multipart upload key=GH0FNY2AI00G upload=5QA4GXNPVOOF tag=PTY5EYG68JXG type=write size=3887926 2024-09-12T00:24:36.477 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.475+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~OOOU3JAUQ6PU.0 size=1048576 2024-09-12T00:24:36.479 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.479+0000 7f0d199128c0 1 > prepared part key=_multipart_4K654PSDLDVI.2~OOOU3JAUQ6PU.1 size=804990 2024-09-12T00:24:36.479 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.479+0000 7f0d199128c0 1 > prepared multipart upload key=4K654PSDLDVI upload=OOOU3JAUQ6PU tag=0PAUJ1CCRX54 type=write size=2902142 2024-09-12T00:24:36.481 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.483+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~2L0VPPPFB7NR.0 size=1048576 2024-09-12T00:24:36.484 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.483+0000 7f0d199128c0 1 < completed part key=_multipart_0EBWUENN0881.2~2L0VPPPFB7NR.1 size=499348 2024-09-12T00:24:36.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.491+0000 7f0d199128c0 1 < completed multipart upload key=0EBWUENN0881 upload=2L0VPPPFB7NR tag=THKC8S6ZMO93 type=write size=2596500 2024-09-12T00:24:36.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.491+0000 7f0d199128c0 1 > prepared operation key=WBGXMJB7U422 tag=VPE1T5MOZJ3Y type=del size=880399 2024-09-12T00:24:36.496 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.495+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~YTYIRLYSVQEI.0 size=1048576 2024-09-12T00:24:36.498 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.499+0000 7f0d199128c0 1 < completed part key=_multipart_FJ8YV026H0ZU.2~YTYIRLYSVQEI.1 size=466331 2024-09-12T00:24:36.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.503+0000 7f0d199128c0 1 < completed multipart upload key=FJ8YV026H0ZU upload=YTYIRLYSVQEI tag=SA1AMCWDYB9N type=write size=2563483 2024-09-12T00:24:36.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.507+0000 7f0d199128c0 1 > prepared operation key=PK2CA62QBZXS tag=315U37X6TPQK type=write size=600659 2024-09-12T00:24:36.512 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.511+0000 7f0d199128c0 1 < suggested update operation key=NXQYUQIR2APT tag=OC2XA29035A3 type=del size=940940 2024-09-12T00:24:36.515 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:24:36.515+0000 7f0d199128c0 1 > prepared operation key=J75P0821XGRO tag=LVZ7HPNQR9SM type=del size=3598938 2024-09-12T00:24:36.516 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] cls_rgw_stats.simulate (24823 ms) 2024-09-12T00:24:36.516 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 1 test from cls_rgw_stats (24823 ms total) 2024-09-12T00:24:36.516 INFO:tasks.workunit.client.0.smithi043.stdout: 2024-09-12T00:24:36.516 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment tear-down 2024-09-12T00:24:36.747 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] 1 test from 1 test suite ran. (26914 ms total) 2024-09-12T00:24:36.747 INFO:tasks.workunit.client.0.smithi043.stdout:[ PASSED ] 1 test. 2024-09-12T00:24:36.756 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:24:36.757 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:24:36.811 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-12T00:24:36.813 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-12T00:24:36.813 DEBUG:teuthology.orchestra.run.smithi043:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-12T00:24:36.876 INFO:tasks.workunit.client.0.smithi043.stdout:Running main() from gmock_main.cc 2024-09-12T00:24:36.876 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-12T00:24:36.876 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment set-up. 2024-09-12T00:24:38.754 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 31 tests from CmpOmap 2024-09-12T00:24:38.754 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-12T00:24:38.786 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (32 ms) 2024-09-12T00:24:38.786 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-12T00:24:38.801 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (15 ms) 2024-09-12T00:24:38.802 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-12T00:24:38.807 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (7 ms) 2024-09-12T00:24:38.807 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-12T00:24:38.815 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (7 ms) 2024-09-12T00:24:38.815 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-12T00:24:38.832 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_vals_str (17 ms) 2024-09-12T00:24:38.832 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-12T00:24:38.843 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_vals_u64 (11 ms) 2024-09-12T00:24:38.843 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-12T00:24:38.851 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (8 ms) 2024-09-12T00:24:38.851 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-12T00:24:38.859 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (8 ms) 2024-09-12T00:24:38.859 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-12T00:24:38.869 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (11 ms) 2024-09-12T00:24:38.870 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-12T00:24:38.881 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (11 ms) 2024-09-12T00:24:38.881 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-12T00:24:38.882 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-12T00:24:38.882 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-12T00:24:38.883 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-09-12T00:24:38.884 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-12T00:24:38.901 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (17 ms) 2024-09-12T00:24:38.901 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-12T00:24:38.917 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (16 ms) 2024-09-12T00:24:38.917 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-12T00:24:38.933 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (16 ms) 2024-09-12T00:24:38.933 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-12T00:24:38.946 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (13 ms) 2024-09-12T00:24:38.946 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-12T00:24:38.966 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_set_vals_str (20 ms) 2024-09-12T00:24:38.966 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-12T00:24:38.988 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (22 ms) 2024-09-12T00:24:38.988 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-12T00:24:38.995 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (7 ms) 2024-09-12T00:24:38.995 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-12T00:24:39.000 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (6 ms) 2024-09-12T00:24:39.001 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-12T00:24:39.003 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (2 ms) 2024-09-12T00:24:39.003 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-12T00:24:39.005 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (2 ms) 2024-09-12T00:24:39.005 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-12T00:24:39.022 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (17 ms) 2024-09-12T00:24:39.022 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-12T00:24:39.040 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (16 ms) 2024-09-12T00:24:39.041 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-12T00:24:39.059 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (21 ms) 2024-09-12T00:24:39.059 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-12T00:24:39.080 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (21 ms) 2024-09-12T00:24:39.080 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-12T00:24:39.086 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (6 ms) 2024-09-12T00:24:39.086 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-12T00:24:39.093 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (7 ms) 2024-09-12T00:24:39.093 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-12T00:24:39.096 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (3 ms) 2024-09-12T00:24:39.096 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-12T00:24:39.098 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (2 ms) 2024-09-12T00:24:39.098 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-12T00:24:39.120 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (22 ms) 2024-09-12T00:24:39.120 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 31 tests from CmpOmap (366 ms total) 2024-09-12T00:24:39.120 INFO:tasks.workunit.client.0.smithi043.stdout: 2024-09-12T00:24:39.120 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment tear-down 2024-09-12T00:24:39.761 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] 31 tests from 1 test suite ran. (2885 ms total) 2024-09-12T00:24:39.761 INFO:tasks.workunit.client.0.smithi043.stdout:[ PASSED ] 31 tests. 2024-09-12T00:24:39.768 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:24:39.768 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:24:39.827 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-12T00:24:39.828 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-12T00:24:39.828 DEBUG:teuthology.orchestra.run.smithi043:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-12T00:24:39.893 INFO:tasks.workunit.client.0.smithi043.stdout:Running main() from gmock_main.cc 2024-09-12T00:24:39.893 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:24:39.893 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment set-up. 2024-09-12T00:24:39.893 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-12T00:24:39.893 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-12T00:24:42.827 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2934 ms) 2024-09-12T00:24:42.828 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-12T00:24:45.896 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3069 ms) 2024-09-12T00:24:45.896 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-12T00:24:48.935 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] TestCls2PCQueue.Reserve (3039 ms) 2024-09-12T00:24:48.935 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-12T00:24:51.938 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3002 ms) 2024-09-12T00:24:51.938 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-12T00:24:56.033 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] TestCls2PCQueue.Commit (4095 ms) 2024-09-12T00:24:56.033 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-12T00:25:00.075 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] TestCls2PCQueue.Stats (4041 ms) 2024-09-12T00:25:00.075 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-12T00:25:05.129 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (5055 ms) 2024-09-12T00:25:05.129 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-12T00:25:08.144 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] TestCls2PCQueue.Abort (3013 ms) 2024-09-12T00:25:08.145 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-12T00:25:11.196 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] TestCls2PCQueue.ReserveError (3054 ms) 2024-09-12T00:25:11.196 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-12T00:25:14.258 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] TestCls2PCQueue.CommitError (3059 ms) 2024-09-12T00:25:14.258 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-12T00:25:17.313 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] TestCls2PCQueue.AbortError (3058 ms) 2024-09-12T00:25:17.313 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-12T00:25:20.355 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3042 ms) 2024-09-12T00:25:20.355 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-12T00:25:23.414 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3059 ms) 2024-09-12T00:25:23.414 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-12T00:25:26.440 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3026 ms) 2024-09-12T00:25:26.440 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-12T00:25:29.469 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3025 ms) 2024-09-12T00:25:29.470 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-12T00:25:32.525 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3060 ms) 2024-09-12T00:25:32.525 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-12T00:25:35.568 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3043 ms) 2024-09-12T00:25:35.568 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-12T00:25:38.604 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] TestCls2PCQueue.Cleanup (3036 ms) 2024-09-12T00:25:38.604 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-12T00:25:51.697 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] TestCls2PCQueue.MultiProducer (13093 ms) 2024-09-12T00:25:51.698 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-12T00:25:55.946 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (4249 ms) 2024-09-12T00:25:55.946 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-12T00:26:10.001 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (14055 ms) 2024-09-12T00:26:10.002 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-12T00:26:16.088 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (6087 ms) 2024-09-12T00:26:16.088 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-12T00:26:26.153 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (10065 ms) 2024-09-12T00:26:26.153 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-12T00:26:36.237 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (10084 ms) 2024-09-12T00:26:36.238 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 24 tests from TestCls2PCQueue (116344 ms total) 2024-09-12T00:26:36.238 INFO:tasks.workunit.client.0.smithi043.stdout: 2024-09-12T00:26:36.238 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment tear-down 2024-09-12T00:26:36.238 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] 24 tests from 1 test suite ran. (116344 ms total) 2024-09-12T00:26:36.238 INFO:tasks.workunit.client.0.smithi043.stdout:[ PASSED ] 24 tests. 2024-09-12T00:26:36.245 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:26:36.245 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:26:36.303 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-12T00:26:36.304 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-12T00:26:36.304 DEBUG:teuthology.orchestra.run.smithi043:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-12T00:26:36.395 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:36.395 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:36.395 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:26:36.395 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment set-up. 2024-09-12T00:26:38.268 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 4 tests from ClsAccount 2024-09-12T00:26:38.268 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] ClsAccount.add 2024-09-12T00:26:38.309 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] ClsAccount.add (41 ms) 2024-09-12T00:26:38.309 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] ClsAccount.get 2024-09-12T00:26:38.317 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] ClsAccount.get (9 ms) 2024-09-12T00:26:38.317 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] ClsAccount.rm 2024-09-12T00:26:38.329 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] ClsAccount.rm (11 ms) 2024-09-12T00:26:38.329 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] ClsAccount.list 2024-09-12T00:26:38.378 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] ClsAccount.list (49 ms) 2024-09-12T00:26:38.378 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 4 tests from ClsAccount (110 ms total) 2024-09-12T00:26:38.378 INFO:tasks.workunit.client.0.smithi043.stdout: 2024-09-12T00:26:38.378 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment tear-down 2024-09-12T00:26:39.275 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] 4 tests from 1 test suite ran. (2880 ms total) 2024-09-12T00:26:39.275 INFO:tasks.workunit.client.0.smithi043.stdout:[ PASSED ] 4 tests. 2024-09-12T00:26:39.282 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:26:39.283 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:26:39.296 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-12T00:26:39.297 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-12T00:26:39.297 DEBUG:teuthology.orchestra.run.smithi043:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-12T00:26:39.371 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:39.371 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:39.371 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-12T00:26:39.372 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment set-up. 2024-09-12T00:26:41.283 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 6 tests from rgw_gc_log 2024-09-12T00:26:41.283 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-12T00:26:41.322 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] rgw_gc_log.init_existing_queue (40 ms) 2024-09-12T00:26:41.323 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-12T00:26:41.327 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] rgw_gc_log.init_existing_omap (5 ms) 2024-09-12T00:26:41.327 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-12T00:26:41.334 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (6 ms) 2024-09-12T00:26:41.334 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-12T00:26:41.337 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (3 ms) 2024-09-12T00:26:41.337 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-12T00:26:41.341 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] rgw_gc_log.defer1_after_init (4 ms) 2024-09-12T00:26:41.341 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-12T00:26:41.344 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] rgw_gc_log.defer2_before_init (3 ms) 2024-09-12T00:26:41.344 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 6 tests from rgw_gc_log (61 ms total) 2024-09-12T00:26:41.344 INFO:tasks.workunit.client.0.smithi043.stdout: 2024-09-12T00:26:41.344 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment tear-down 2024-09-12T00:26:42.293 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] 6 tests from 1 test suite ran. (2922 ms total) 2024-09-12T00:26:42.293 INFO:tasks.workunit.client.0.smithi043.stdout:[ PASSED ] 6 tests. 2024-09-12T00:26:42.299 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:26:42.299 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:26:42.355 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-12T00:26:42.356 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-12T00:26:42.356 DEBUG:teuthology.orchestra.run.smithi043:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-12T00:26:42.430 INFO:tasks.workunit.client.0.smithi043.stdout:Running main() from gmock_main.cc 2024-09-12T00:26:42.430 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:26:42.430 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment set-up. 2024-09-12T00:26:42.430 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 4 tests from TestRGWObj 2024-09-12T00:26:42.430 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] TestRGWObj.underscore 2024-09-12T00:26:42.431 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: _obj 2024-09-12T00:26:42.431 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: _obj 2024-09-12T00:26:42.431 INFO:tasks.workunit.client.0.smithi043.stdout:stripped: _obj ns= i= 2024-09-12T00:26:42.431 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: _obj 2024-09-12T00:26:42.431 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: _obj 2024-09-12T00:26:42.431 INFO:tasks.workunit.client.0.smithi043.stdout:stripped: _obj ns= i= 2024-09-12T00:26:42.431 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: _obj 2024-09-12T00:26:42.431 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: _obj 2024-09-12T00:26:42.431 INFO:tasks.workunit.client.0.smithi043.stdout:stripped: _obj ns= i= 2024-09-12T00:26:42.431 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.431 INFO:tasks.workunit.client.0.smithi043.stdout: "obj1": { 2024-09-12T00:26:42.431 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.431 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.432 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.432 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.432 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.432 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.432 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.432 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.432 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.432 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.432 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.432 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.432 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_obj", 2024-09-12T00:26:42.432 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.432 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.433 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.433 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.433 INFO:tasks.workunit.client.0.smithi043.stdout: "obj2": { 2024-09-12T00:26:42.433 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.433 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.433 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.433 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.433 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.433 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.433 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.433 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.433 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.434 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.434 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.434 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.434 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_obj", 2024-09-12T00:26:42.434 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.434 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.434 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.434 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.434 INFO:tasks.workunit.client.0.smithi043.stdout: "obj3": { 2024-09-12T00:26:42.434 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.434 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.434 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.434 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.435 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.435 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.435 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.435 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.435 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.435 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.435 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.435 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.435 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_obj", 2024-09-12T00:26:42.435 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.435 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.435 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.435 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.435 INFO:tasks.workunit.client.0.smithi043.stdout: "obj3-2": { 2024-09-12T00:26:42.436 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.436 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.436 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.436 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.436 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.436 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.436 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.436 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.436 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.436 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.436 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.436 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.437 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_obj", 2024-09-12T00:26:42.437 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.437 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.437 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.437 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.437 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.437 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: _obj 2024-09-12T00:26:42.437 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: _obj 2024-09-12T00:26:42.437 INFO:tasks.workunit.client.0.smithi043.stdout:stripped: _obj ns=ns i= 2024-09-12T00:26:42.437 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: _obj 2024-09-12T00:26:42.437 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: _obj 2024-09-12T00:26:42.437 INFO:tasks.workunit.client.0.smithi043.stdout:stripped: _obj ns=ns i= 2024-09-12T00:26:42.438 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: _obj 2024-09-12T00:26:42.438 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: _obj 2024-09-12T00:26:42.438 INFO:tasks.workunit.client.0.smithi043.stdout:stripped: _obj ns=ns i= 2024-09-12T00:26:42.438 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.438 INFO:tasks.workunit.client.0.smithi043.stdout: "obj1": { 2024-09-12T00:26:42.438 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.438 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.438 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.438 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.438 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.438 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.438 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.438 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.439 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.439 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.439 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.439 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.439 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_obj", 2024-09-12T00:26:42.439 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.439 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.439 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.439 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.439 INFO:tasks.workunit.client.0.smithi043.stdout: "obj2": { 2024-09-12T00:26:42.439 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.439 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.439 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.439 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.440 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.440 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.440 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.440 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.440 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.440 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.440 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.440 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.440 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_obj", 2024-09-12T00:26:42.440 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.440 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.440 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.440 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.440 INFO:tasks.workunit.client.0.smithi043.stdout: "obj3": { 2024-09-12T00:26:42.441 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.441 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.441 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.441 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.441 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.441 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.441 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.441 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.441 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.441 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.441 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.441 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.441 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_obj", 2024-09-12T00:26:42.441 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.442 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.442 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.442 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.442 INFO:tasks.workunit.client.0.smithi043.stdout: "obj3-2": { 2024-09-12T00:26:42.442 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.442 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.442 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.442 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.442 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.442 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.442 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.442 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.442 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.443 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.443 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.443 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.443 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_obj", 2024-09-12T00:26:42.443 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.443 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.443 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.443 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.443 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.443 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: _obj[v1] 2024-09-12T00:26:42.443 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: _obj[v1] 2024-09-12T00:26:42.443 INFO:tasks.workunit.client.0.smithi043.stdout:stripped: _obj ns= i=v1 2024-09-12T00:26:42.444 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: _obj[v1] 2024-09-12T00:26:42.444 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: _obj[v1] 2024-09-12T00:26:42.444 INFO:tasks.workunit.client.0.smithi043.stdout:stripped: _obj ns= i=v1 2024-09-12T00:26:42.444 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: _obj[v1] 2024-09-12T00:26:42.444 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: _obj[v1] 2024-09-12T00:26:42.444 INFO:tasks.workunit.client.0.smithi043.stdout:stripped: _obj ns= i=v1 2024-09-12T00:26:42.444 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.444 INFO:tasks.workunit.client.0.smithi043.stdout: "obj1": { 2024-09-12T00:26:42.444 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.444 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.444 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.444 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.445 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.445 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.445 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.445 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.445 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.445 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.445 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.445 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.445 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_obj", 2024-09-12T00:26:42.445 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "v1", 2024-09-12T00:26:42.445 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.445 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.445 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.446 INFO:tasks.workunit.client.0.smithi043.stdout: "obj2": { 2024-09-12T00:26:42.446 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.446 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.446 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.446 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.446 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.446 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.446 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.446 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.446 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.446 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.446 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.447 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.447 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_obj", 2024-09-12T00:26:42.447 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "v1", 2024-09-12T00:26:42.447 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.447 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.447 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.447 INFO:tasks.workunit.client.0.smithi043.stdout: "obj3": { 2024-09-12T00:26:42.447 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.447 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.447 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.447 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.447 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.447 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.448 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.448 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.448 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.448 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.448 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.448 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.448 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_obj", 2024-09-12T00:26:42.448 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.448 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.448 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.448 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.448 INFO:tasks.workunit.client.0.smithi043.stdout: "obj3-2": { 2024-09-12T00:26:42.448 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.448 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.449 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.449 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.449 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.449 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.449 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.449 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.449 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.449 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.449 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.449 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.449 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_obj", 2024-09-12T00:26:42.449 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "v1", 2024-09-12T00:26:42.450 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.450 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.450 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.450 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.450 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: _obj[v1] 2024-09-12T00:26:42.450 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: _obj[v1] 2024-09-12T00:26:42.450 INFO:tasks.workunit.client.0.smithi043.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:26:42.450 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: _obj[v1] 2024-09-12T00:26:42.450 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: _obj[v1] 2024-09-12T00:26:42.450 INFO:tasks.workunit.client.0.smithi043.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:26:42.450 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: _obj[v1] 2024-09-12T00:26:42.450 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: _obj[v1] 2024-09-12T00:26:42.450 INFO:tasks.workunit.client.0.smithi043.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:26:42.451 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.451 INFO:tasks.workunit.client.0.smithi043.stdout: "obj1": { 2024-09-12T00:26:42.451 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.451 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.451 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.451 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.451 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.451 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.451 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.451 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.451 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.451 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.451 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.451 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.451 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_obj", 2024-09-12T00:26:42.452 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "v1", 2024-09-12T00:26:42.452 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.452 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.452 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.452 INFO:tasks.workunit.client.0.smithi043.stdout: "obj2": { 2024-09-12T00:26:42.452 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.452 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.452 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.452 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.452 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.452 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.452 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.452 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.452 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.453 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.453 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.453 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.453 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_obj", 2024-09-12T00:26:42.453 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "v1", 2024-09-12T00:26:42.453 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.453 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.453 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.453 INFO:tasks.workunit.client.0.smithi043.stdout: "obj3": { 2024-09-12T00:26:42.453 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.453 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.453 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.453 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.454 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.454 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.454 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.454 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.454 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.454 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.454 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.454 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.454 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_obj", 2024-09-12T00:26:42.454 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.454 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.454 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.454 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.454 INFO:tasks.workunit.client.0.smithi043.stdout: "obj3-2": { 2024-09-12T00:26:42.455 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.455 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.455 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.455 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.455 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.455 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.455 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.455 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.455 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.455 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.455 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.455 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.455 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_obj", 2024-09-12T00:26:42.456 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "v1", 2024-09-12T00:26:42.456 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.456 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.456 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.456 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.456 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] TestRGWObj.underscore (1 ms) 2024-09-12T00:26:42.456 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-12T00:26:42.457 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: obj 2024-09-12T00:26:42.457 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: obj 2024-09-12T00:26:42.457 INFO:tasks.workunit.client.0.smithi043.stdout:stripped: obj ns= i= 2024-09-12T00:26:42.457 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: obj 2024-09-12T00:26:42.457 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: obj 2024-09-12T00:26:42.457 INFO:tasks.workunit.client.0.smithi043.stdout:stripped: obj ns= i= 2024-09-12T00:26:42.457 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: obj 2024-09-12T00:26:42.457 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: obj 2024-09-12T00:26:42.457 INFO:tasks.workunit.client.0.smithi043.stdout:stripped: obj ns= i= 2024-09-12T00:26:42.457 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.457 INFO:tasks.workunit.client.0.smithi043.stdout: "obj1": { 2024-09-12T00:26:42.457 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.457 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.458 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.458 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.458 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.458 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.458 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.458 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.458 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.458 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.458 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.458 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.458 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "obj", 2024-09-12T00:26:42.458 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.458 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.458 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.459 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.459 INFO:tasks.workunit.client.0.smithi043.stdout: "obj2": { 2024-09-12T00:26:42.459 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.459 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.459 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.459 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.459 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.459 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.459 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.459 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.459 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.459 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.459 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.460 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.460 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "obj", 2024-09-12T00:26:42.460 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.460 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.460 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.460 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.460 INFO:tasks.workunit.client.0.smithi043.stdout: "obj3": { 2024-09-12T00:26:42.460 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.460 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.460 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.460 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.460 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.460 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.460 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.461 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.461 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.461 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.461 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.461 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.461 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "obj", 2024-09-12T00:26:42.461 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.461 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.461 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.461 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.461 INFO:tasks.workunit.client.0.smithi043.stdout: "obj3-2": { 2024-09-12T00:26:42.461 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.461 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.462 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.462 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.462 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.462 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.462 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.462 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.462 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.462 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.462 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.462 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.462 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "obj", 2024-09-12T00:26:42.462 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.462 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.463 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.463 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.463 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.463 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: obj 2024-09-12T00:26:42.463 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: obj 2024-09-12T00:26:42.463 INFO:tasks.workunit.client.0.smithi043.stdout:stripped: obj ns=ns i= 2024-09-12T00:26:42.463 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: obj 2024-09-12T00:26:42.463 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: obj 2024-09-12T00:26:42.463 INFO:tasks.workunit.client.0.smithi043.stdout:stripped: obj ns=ns i= 2024-09-12T00:26:42.463 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: obj 2024-09-12T00:26:42.463 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: obj 2024-09-12T00:26:42.463 INFO:tasks.workunit.client.0.smithi043.stdout:stripped: obj ns=ns i= 2024-09-12T00:26:42.463 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.463 INFO:tasks.workunit.client.0.smithi043.stdout: "obj1": { 2024-09-12T00:26:42.464 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.464 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.464 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.464 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.464 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.464 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.464 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.464 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.464 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.464 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.464 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.464 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.464 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "obj", 2024-09-12T00:26:42.465 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.465 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.465 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.465 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.465 INFO:tasks.workunit.client.0.smithi043.stdout: "obj2": { 2024-09-12T00:26:42.465 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.465 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.465 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.465 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.465 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.465 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.465 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.465 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.466 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.466 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.466 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.466 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.466 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "obj", 2024-09-12T00:26:42.466 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.466 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.466 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.466 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.466 INFO:tasks.workunit.client.0.smithi043.stdout: "obj3": { 2024-09-12T00:26:42.466 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.466 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.466 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.467 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.467 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.467 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.467 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.467 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.467 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.467 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.467 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.467 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.467 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "obj", 2024-09-12T00:26:42.467 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.467 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.467 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.468 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.468 INFO:tasks.workunit.client.0.smithi043.stdout: "obj3-2": { 2024-09-12T00:26:42.468 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.468 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.468 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.468 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.468 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.468 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.468 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.468 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.468 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.468 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.468 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.468 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.469 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "obj", 2024-09-12T00:26:42.469 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.469 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.469 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.469 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.469 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.469 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: obj[v1] 2024-09-12T00:26:42.469 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: obj[v1] 2024-09-12T00:26:42.469 INFO:tasks.workunit.client.0.smithi043.stdout:stripped: obj ns= i=v1 2024-09-12T00:26:42.469 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: obj[v1] 2024-09-12T00:26:42.469 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: obj[v1] 2024-09-12T00:26:42.469 INFO:tasks.workunit.client.0.smithi043.stdout:stripped: obj ns= i=v1 2024-09-12T00:26:42.469 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: obj[v1] 2024-09-12T00:26:42.469 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: obj[v1] 2024-09-12T00:26:42.470 INFO:tasks.workunit.client.0.smithi043.stdout:stripped: obj ns= i=v1 2024-09-12T00:26:42.470 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.470 INFO:tasks.workunit.client.0.smithi043.stdout: "obj1": { 2024-09-12T00:26:42.470 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.470 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.470 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.470 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.470 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.470 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.470 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.470 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.470 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.470 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.470 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.470 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.471 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "obj", 2024-09-12T00:26:42.471 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "v1", 2024-09-12T00:26:42.471 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.471 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.471 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.471 INFO:tasks.workunit.client.0.smithi043.stdout: "obj2": { 2024-09-12T00:26:42.471 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.471 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.471 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.471 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.471 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.471 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.471 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.471 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.471 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.472 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.472 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.472 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.472 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "obj", 2024-09-12T00:26:42.472 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "v1", 2024-09-12T00:26:42.472 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.472 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.472 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.472 INFO:tasks.workunit.client.0.smithi043.stdout: "obj3": { 2024-09-12T00:26:42.472 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.472 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.472 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.472 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.473 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.473 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.473 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.473 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.473 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.473 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.473 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.473 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.473 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "obj", 2024-09-12T00:26:42.473 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.473 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.473 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.473 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.474 INFO:tasks.workunit.client.0.smithi043.stdout: "obj3-2": { 2024-09-12T00:26:42.474 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.474 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.474 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.474 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.474 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.474 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.474 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.474 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.474 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.474 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.474 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.474 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.475 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "obj", 2024-09-12T00:26:42.475 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "v1", 2024-09-12T00:26:42.475 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.475 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.475 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.475 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.475 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: obj[v1] 2024-09-12T00:26:42.475 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: obj[v1] 2024-09-12T00:26:42.475 INFO:tasks.workunit.client.0.smithi043.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:26:42.475 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: obj[v1] 2024-09-12T00:26:42.475 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: obj[v1] 2024-09-12T00:26:42.475 INFO:tasks.workunit.client.0.smithi043.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:26:42.475 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: obj[v1] 2024-09-12T00:26:42.476 INFO:tasks.workunit.client.0.smithi043.stdout:parsed: obj[v1] 2024-09-12T00:26:42.476 INFO:tasks.workunit.client.0.smithi043.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:26:42.476 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.476 INFO:tasks.workunit.client.0.smithi043.stdout: "obj1": { 2024-09-12T00:26:42.476 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.476 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.476 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.476 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.476 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.476 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.476 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.476 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.476 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.477 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.477 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.477 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.477 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "obj", 2024-09-12T00:26:42.477 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "v1", 2024-09-12T00:26:42.477 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.477 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.477 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.477 INFO:tasks.workunit.client.0.smithi043.stdout: "obj2": { 2024-09-12T00:26:42.477 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.477 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.477 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.477 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.478 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.478 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.478 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.478 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.478 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.478 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.478 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.478 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.478 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "obj", 2024-09-12T00:26:42.478 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "v1", 2024-09-12T00:26:42.478 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.478 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.478 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.479 INFO:tasks.workunit.client.0.smithi043.stdout: "obj3": { 2024-09-12T00:26:42.479 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.479 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.479 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.479 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.479 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.479 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.479 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.479 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.479 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.479 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.479 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.479 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.479 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "obj", 2024-09-12T00:26:42.480 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.480 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.480 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.480 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.480 INFO:tasks.workunit.client.0.smithi043.stdout: "obj3-2": { 2024-09-12T00:26:42.480 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.480 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.480 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.480 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.480 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.480 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.480 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.480 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.480 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.481 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.481 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.481 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.481 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "obj", 2024-09-12T00:26:42.481 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "v1", 2024-09-12T00:26:42.481 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.481 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.481 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.481 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.481 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-12T00:26:42.481 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-12T00:26:42.481 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.482 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.482 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.482 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.482 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.482 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.482 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.482 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.482 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.482 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.482 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.482 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.482 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.482 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.482 INFO:tasks.workunit.client.0.smithi043.stdout: "obj": { 2024-09-12T00:26:42.483 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.483 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.483 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.483 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.483 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.483 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.483 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.483 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.483 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.483 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.483 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.483 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.483 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "myobj", 2024-09-12T00:26:42.483 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.484 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.484 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.484 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.484 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.484 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.484 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.484 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": "default-placement.data", 2024-09-12T00:26:42.484 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker_myobj", 2024-09-12T00:26:42.484 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.484 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.484 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.484 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.484 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.484 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.485 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.485 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.485 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.485 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.485 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.485 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.485 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.485 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.485 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.485 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.485 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.485 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "myobj", 2024-09-12T00:26:42.485 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.485 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.486 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.486 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.486 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.486 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.486 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.486 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.486 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.486 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.486 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.486 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.486 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.486 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.486 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.487 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.487 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.487 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.487 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.487 INFO:tasks.workunit.client.0.smithi043.stdout: "obj": { 2024-09-12T00:26:42.487 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.487 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.487 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.487 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.487 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.487 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.487 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.487 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.488 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.488 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.488 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.488 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.488 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "myobj", 2024-09-12T00:26:42.488 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.488 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.488 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.488 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.488 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.488 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.488 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.489 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.489 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker_myobj", 2024-09-12T00:26:42.489 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.489 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.489 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.489 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.489 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.489 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.489 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.489 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.489 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.489 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.489 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.490 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.490 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.490 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.490 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.490 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.490 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.490 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "myobj", 2024-09-12T00:26:42.490 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.490 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.490 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.490 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.490 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.490 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.490 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.491 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.491 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.491 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.491 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.491 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.491 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.491 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.491 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.491 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.491 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.491 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.491 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.491 INFO:tasks.workunit.client.0.smithi043.stdout: "obj": { 2024-09-12T00:26:42.492 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.492 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.492 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.492 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.492 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.492 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.492 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.492 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.492 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.492 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.492 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.492 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.492 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "myobj", 2024-09-12T00:26:42.492 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.493 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.493 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.493 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.493 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.493 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.493 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.493 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": "default-placement.data", 2024-09-12T00:26:42.493 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:26:42.493 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.493 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.493 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.493 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.493 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.493 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.494 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.494 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.494 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.494 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.494 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.494 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.494 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.494 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.494 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.494 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.494 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.494 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "myobj", 2024-09-12T00:26:42.495 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.495 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.495 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.495 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.495 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.495 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.495 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.495 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.495 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.495 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.495 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.495 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.495 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.495 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.496 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.496 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.496 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.496 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.496 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.496 INFO:tasks.workunit.client.0.smithi043.stdout: "obj": { 2024-09-12T00:26:42.496 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.496 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.496 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.496 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.496 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.496 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.496 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.496 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.497 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.497 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.497 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.497 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.497 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "myobj", 2024-09-12T00:26:42.497 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.497 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.497 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.497 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.497 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.497 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.497 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.498 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.498 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:26:42.498 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.498 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.498 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.498 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.498 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.498 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.498 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.498 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.498 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.498 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.498 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.498 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.499 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.499 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.499 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.499 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.499 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.499 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "myobj", 2024-09-12T00:26:42.499 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.499 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.499 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.499 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.499 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.499 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.499 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.499 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.500 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.500 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.500 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.500 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.500 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.500 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.500 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.500 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.500 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.500 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.500 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.500 INFO:tasks.workunit.client.0.smithi043.stdout: "obj": { 2024-09-12T00:26:42.500 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.501 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.501 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.501 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.501 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.501 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.501 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.501 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.501 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.501 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.501 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.501 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.501 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "myobj", 2024-09-12T00:26:42.501 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.502 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.502 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.502 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.502 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.502 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.502 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.502 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": "default-placement.data", 2024-09-12T00:26:42.502 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:26:42.502 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.502 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.502 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.503 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.503 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.503 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.503 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.503 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.503 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.503 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.503 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.503 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.503 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.503 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.503 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.503 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.504 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.504 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "myobj", 2024-09-12T00:26:42.504 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.504 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.504 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.504 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.504 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.504 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.504 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.504 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.504 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.504 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.504 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.505 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.505 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.505 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.505 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.505 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.505 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.505 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.505 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.505 INFO:tasks.workunit.client.0.smithi043.stdout: "obj": { 2024-09-12T00:26:42.505 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.505 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.505 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.505 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.505 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.506 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.506 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.506 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.506 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.506 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.506 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.506 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.506 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "myobj", 2024-09-12T00:26:42.506 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.506 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.506 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.506 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.507 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.507 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.507 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.507 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.507 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:26:42.507 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.507 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.507 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.507 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.507 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.507 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.507 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.507 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.507 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.508 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.508 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.508 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.508 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.508 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.508 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.508 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.508 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.508 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "myobj", 2024-09-12T00:26:42.508 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.508 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.508 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.508 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.509 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.509 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.509 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.509 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.509 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.509 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.509 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.509 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.509 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.509 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.509 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.509 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.509 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.510 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.510 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.510 INFO:tasks.workunit.client.0.smithi043.stdout: "obj": { 2024-09-12T00:26:42.510 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.510 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.510 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.510 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.510 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.510 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.510 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.510 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.510 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.510 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.511 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.511 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.511 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "myobj", 2024-09-12T00:26:42.511 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.511 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.511 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.511 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.511 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.511 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.511 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.511 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": "default-placement.data", 2024-09-12T00:26:42.511 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:26:42.511 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.511 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.512 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.512 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.512 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.512 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.512 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.512 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.512 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.512 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.512 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.512 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.512 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.512 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.512 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.513 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.513 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.513 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "myobj", 2024-09-12T00:26:42.513 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.513 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.513 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.513 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.513 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.513 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.513 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.513 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.513 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.513 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.514 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.514 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.514 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.514 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.514 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.514 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.514 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.514 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.514 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.514 INFO:tasks.workunit.client.0.smithi043.stdout: "obj": { 2024-09-12T00:26:42.514 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.514 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.515 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.515 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.515 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.515 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.515 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.515 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.515 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.515 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.515 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.515 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.515 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "myobj", 2024-09-12T00:26:42.515 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.515 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.515 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.516 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.516 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.516 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.516 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.516 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.516 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:26:42.516 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.516 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.516 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.516 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.516 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.516 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.516 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.516 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.517 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.517 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.517 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.517 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.517 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.517 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.517 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.517 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.517 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.517 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "myobj", 2024-09-12T00:26:42.517 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.517 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.518 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.518 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.518 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.518 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.518 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.518 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.518 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.518 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.518 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.518 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.518 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.518 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.518 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.518 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.519 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.519 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.519 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.519 INFO:tasks.workunit.client.0.smithi043.stdout: "obj": { 2024-09-12T00:26:42.519 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.519 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.519 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.519 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.519 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.519 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.519 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.519 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.519 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.519 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.520 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.520 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.520 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj", 2024-09-12T00:26:42.520 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.520 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.520 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.520 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.520 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.520 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.520 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.520 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": "default-placement.data", 2024-09-12T00:26:42.520 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker___myobj", 2024-09-12T00:26:42.520 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "marker__myobj" 2024-09-12T00:26:42.521 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.521 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.521 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.521 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.521 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.521 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.521 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.521 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.521 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.521 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.521 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.521 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.521 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.521 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.522 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.522 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.522 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj", 2024-09-12T00:26:42.522 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.522 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.522 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.522 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.522 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.522 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.522 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.522 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.522 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.522 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.522 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.523 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.523 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.523 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.523 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.523 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.523 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.523 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.523 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.523 INFO:tasks.workunit.client.0.smithi043.stdout: "obj": { 2024-09-12T00:26:42.523 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.523 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.523 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.523 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.523 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.524 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.524 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.524 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.524 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.524 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.524 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.524 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.524 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj", 2024-09-12T00:26:42.524 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.524 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.524 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.524 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.524 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.525 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.525 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.525 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.525 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker___myobj", 2024-09-12T00:26:42.525 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "marker__myobj" 2024-09-12T00:26:42.525 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.525 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.525 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.525 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.525 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.525 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.525 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.525 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.526 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.526 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.526 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.526 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.526 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.526 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.526 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.526 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.526 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj", 2024-09-12T00:26:42.526 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.526 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.526 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.526 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.526 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.527 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.527 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.527 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.527 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.527 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.527 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.527 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.527 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.527 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.527 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.527 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.527 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.527 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.528 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.528 INFO:tasks.workunit.client.0.smithi043.stdout: "obj": { 2024-09-12T00:26:42.528 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.528 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.528 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.528 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.528 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.528 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.528 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.528 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.528 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.528 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.528 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.529 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.529 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj", 2024-09-12T00:26:42.529 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.529 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.529 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.529 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.529 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.529 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.529 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.529 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": "default-placement.data", 2024-09-12T00:26:42.529 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:26:42.529 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.529 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.530 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.530 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.530 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.530 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.530 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.530 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.530 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.530 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.530 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.530 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.530 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.530 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.530 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.530 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.531 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.531 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj", 2024-09-12T00:26:42.531 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.531 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.531 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.531 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.531 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.531 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.531 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.531 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.531 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.531 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.531 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.532 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.532 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.532 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.532 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.532 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.532 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.532 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.532 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.532 INFO:tasks.workunit.client.0.smithi043.stdout: "obj": { 2024-09-12T00:26:42.532 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.532 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.532 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.532 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.532 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.533 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.533 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.533 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.533 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.533 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.533 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.533 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.533 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj", 2024-09-12T00:26:42.534 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.534 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.534 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.534 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.534 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.534 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.534 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.534 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.534 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:26:42.534 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.534 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.534 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.535 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.535 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.535 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.535 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.535 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.535 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.535 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.535 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.535 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.535 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.535 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.535 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.535 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.536 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.536 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj", 2024-09-12T00:26:42.536 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.536 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.536 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.536 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.536 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.536 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.536 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.536 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.536 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.536 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.536 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.537 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.537 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.537 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.537 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.537 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.537 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.537 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.537 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.537 INFO:tasks.workunit.client.0.smithi043.stdout: "obj": { 2024-09-12T00:26:42.537 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.537 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.537 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.537 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.538 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.538 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.538 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.538 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.538 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.538 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.538 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.538 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.538 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj", 2024-09-12T00:26:42.538 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.538 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.538 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.538 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.539 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.539 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.539 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.539 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": "default-placement.data", 2024-09-12T00:26:42.539 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:26:42.539 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "marker__myobj" 2024-09-12T00:26:42.539 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.539 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.539 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.539 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.539 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.539 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.539 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.540 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.540 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.540 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.540 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.540 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.540 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.540 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.540 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.540 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.540 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj", 2024-09-12T00:26:42.540 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.540 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.540 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.541 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.541 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.541 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.541 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.541 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.541 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.541 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.541 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.541 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.541 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.541 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.541 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.542 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.542 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.542 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.542 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.542 INFO:tasks.workunit.client.0.smithi043.stdout: "obj": { 2024-09-12T00:26:42.542 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.542 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.542 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.542 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.542 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.542 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.542 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.542 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.542 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.543 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.543 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.543 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.543 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj", 2024-09-12T00:26:42.543 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.543 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.543 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.543 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.543 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.543 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.543 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.543 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.543 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:26:42.544 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "marker__myobj" 2024-09-12T00:26:42.544 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.544 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.544 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.544 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.544 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.544 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.544 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.544 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.544 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.544 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.544 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.544 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.545 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.545 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.545 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.545 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.545 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj", 2024-09-12T00:26:42.545 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.545 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.545 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.545 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.545 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.545 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.545 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.546 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.546 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.546 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.546 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.546 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.546 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.546 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.546 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.546 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.546 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.546 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.546 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.546 INFO:tasks.workunit.client.0.smithi043.stdout: "obj": { 2024-09-12T00:26:42.546 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.547 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.547 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.547 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.547 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.547 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.547 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.547 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.547 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.547 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.547 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.547 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.547 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj", 2024-09-12T00:26:42.547 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.547 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.548 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.548 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.548 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.548 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.548 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.548 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": "default-placement.data", 2024-09-12T00:26:42.548 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:26:42.548 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.548 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.548 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.548 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.548 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.548 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.549 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.549 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.549 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.549 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.549 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.549 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.549 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.549 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.549 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.549 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.549 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.549 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj", 2024-09-12T00:26:42.549 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.550 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.550 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.550 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.550 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.550 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.550 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.550 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.550 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.550 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.550 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.550 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.550 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.550 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.551 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.551 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.551 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.551 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.551 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.551 INFO:tasks.workunit.client.0.smithi043.stdout: "obj": { 2024-09-12T00:26:42.551 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.551 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.551 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.551 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.551 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.551 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.551 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.551 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.552 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.552 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.552 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.552 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.552 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj", 2024-09-12T00:26:42.552 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.552 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.552 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.552 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.552 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.552 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.552 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.553 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.553 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:26:42.553 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.553 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.553 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.553 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.553 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.553 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.553 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.553 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.553 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.553 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.553 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.554 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.554 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.554 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.554 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.554 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.554 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.554 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj", 2024-09-12T00:26:42.554 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.554 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.554 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.554 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.554 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.554 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.555 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.555 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.555 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.555 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.555 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.555 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.555 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.555 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.555 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.555 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.555 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.555 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.556 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.556 INFO:tasks.workunit.client.0.smithi043.stdout: "obj": { 2024-09-12T00:26:42.556 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.556 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.556 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.556 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.556 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.556 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.556 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.556 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.557 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.557 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.557 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.557 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.557 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj_", 2024-09-12T00:26:42.557 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.557 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.557 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.557 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.557 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.557 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.557 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.557 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": "default-placement.data", 2024-09-12T00:26:42.557 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker___myobj_", 2024-09-12T00:26:42.558 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "marker__myobj_" 2024-09-12T00:26:42.558 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.558 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.558 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.558 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.558 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.558 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.558 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.558 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.558 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.558 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.558 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.558 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.559 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.559 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.559 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.559 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.559 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj_", 2024-09-12T00:26:42.559 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.559 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.559 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.559 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.559 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.559 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.559 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.559 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.559 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.560 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.560 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.560 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.560 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.560 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.560 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.560 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.560 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.560 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.560 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.560 INFO:tasks.workunit.client.0.smithi043.stdout: "obj": { 2024-09-12T00:26:42.560 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.560 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.561 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.561 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.561 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.561 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.561 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.561 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.561 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.561 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.561 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.561 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.561 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj_", 2024-09-12T00:26:42.561 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.561 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.561 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.562 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.562 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.562 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.562 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.562 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.562 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker___myobj_", 2024-09-12T00:26:42.562 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "marker__myobj_" 2024-09-12T00:26:42.562 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.562 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.562 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.562 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.562 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.562 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.563 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.563 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.563 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.563 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.563 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.563 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.563 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.563 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.563 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.563 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.563 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj_", 2024-09-12T00:26:42.563 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.563 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.563 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.563 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.564 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.564 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.564 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.564 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.564 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.564 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.564 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.564 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.564 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.564 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.564 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.564 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.564 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.565 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.565 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.565 INFO:tasks.workunit.client.0.smithi043.stdout: "obj": { 2024-09-12T00:26:42.565 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.565 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.565 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.565 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.565 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.565 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.565 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.565 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.565 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.565 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.565 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.565 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.566 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj_", 2024-09-12T00:26:42.566 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.566 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.566 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.566 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.566 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.566 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.566 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.566 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": "default-placement.data", 2024-09-12T00:26:42.566 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:26:42.566 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.566 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.566 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.566 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.567 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.567 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.567 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.567 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.567 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.567 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.567 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.567 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.567 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.567 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.567 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.567 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.567 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.567 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj_", 2024-09-12T00:26:42.568 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.568 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.568 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.568 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.568 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.568 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.568 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.568 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.568 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.568 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.568 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.568 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.568 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.569 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.569 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.569 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.569 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.569 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.569 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.569 INFO:tasks.workunit.client.0.smithi043.stdout: "obj": { 2024-09-12T00:26:42.569 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.569 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.569 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.569 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.569 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.569 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.570 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.570 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.570 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.570 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.570 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.570 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.570 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj_", 2024-09-12T00:26:42.570 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.570 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.570 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.570 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.570 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.570 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.570 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.571 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.571 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:26:42.571 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.571 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.571 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.571 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.571 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.571 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.571 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.571 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.571 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.571 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.571 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.572 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.572 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.572 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.572 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.572 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.572 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.572 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj_", 2024-09-12T00:26:42.572 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.572 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.572 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.572 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.572 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.572 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.573 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.573 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.573 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.573 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.573 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.573 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.573 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.573 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.573 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.573 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.573 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.573 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.573 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.573 INFO:tasks.workunit.client.0.smithi043.stdout: "obj": { 2024-09-12T00:26:42.574 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.574 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.574 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.574 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.574 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.574 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.574 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.574 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.574 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.574 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.574 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.574 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.574 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj_", 2024-09-12T00:26:42.574 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.575 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.575 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.575 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.575 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.575 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.575 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.575 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": "default-placement.data", 2024-09-12T00:26:42.575 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:26:42.575 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "marker__myobj_" 2024-09-12T00:26:42.575 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.575 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.575 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.575 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.575 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.576 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.576 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.576 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.576 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.576 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.576 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.576 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.576 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.576 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.576 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.576 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.576 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj_", 2024-09-12T00:26:42.576 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.577 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.577 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.577 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.577 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.577 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.577 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.577 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.577 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.577 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.577 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.577 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.577 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.577 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.578 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.578 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.578 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.578 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.578 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.578 INFO:tasks.workunit.client.0.smithi043.stdout: "obj": { 2024-09-12T00:26:42.578 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.578 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.578 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.578 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.578 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.578 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.578 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.578 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.579 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.579 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.579 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.579 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.579 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj_", 2024-09-12T00:26:42.579 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.579 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.579 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.579 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.579 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.579 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.579 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.579 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.580 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:26:42.580 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "marker__myobj_" 2024-09-12T00:26:42.580 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.580 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.580 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.580 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.580 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.580 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.580 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.580 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.580 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.580 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.580 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.581 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.581 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.581 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.581 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.581 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.581 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj_", 2024-09-12T00:26:42.581 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.581 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.581 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.581 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.581 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.581 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.582 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.582 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.582 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.582 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.582 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.582 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.582 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.582 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.582 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.582 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.582 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.582 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.582 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.582 INFO:tasks.workunit.client.0.smithi043.stdout: "obj": { 2024-09-12T00:26:42.583 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.583 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.583 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.583 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.583 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.583 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.583 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.583 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.583 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.583 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.583 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.583 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.583 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj_", 2024-09-12T00:26:42.583 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.584 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.584 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.584 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.584 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.584 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.584 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.584 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": "default-placement.data", 2024-09-12T00:26:42.584 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:26:42.584 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.584 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.584 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.584 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.584 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.585 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.585 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "test", 2024-09-12T00:26:42.585 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.585 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.585 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.585 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.585 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": "", 2024-09-12T00:26:42.585 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.585 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": "" 2024-09-12T00:26:42.585 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.585 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.585 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.585 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj_", 2024-09-12T00:26:42.585 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.586 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.586 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.586 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.586 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.586 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.586 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.586 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.586 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.586 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.586 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.586 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.586 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.586 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.586 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.587 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.587 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.587 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.587 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.587 INFO:tasks.workunit.client.0.smithi043.stdout: "obj": { 2024-09-12T00:26:42.587 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.587 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.587 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.587 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.587 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.587 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.587 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.587 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.587 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.588 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.588 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.588 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.588 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj_", 2024-09-12T00:26:42.588 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.588 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.588 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.588 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.588 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.588 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.588 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.588 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.588 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:26:42.589 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.589 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.589 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.589 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.589 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.589 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.589 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.589 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.589 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.589 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.589 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.589 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.589 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.590 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.590 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.590 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.590 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.590 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj_", 2024-09-12T00:26:42.590 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.590 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.590 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.590 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.590 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.590 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2024-09-12T00:26:42.590 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-12T00:26:42.590 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.591 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.591 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.591 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker_myobj", 2024-09-12T00:26:42.591 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.591 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.591 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.591 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.591 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.591 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.591 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.591 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.591 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.591 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.591 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.592 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.592 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.592 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.592 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.592 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.592 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.592 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "myobj", 2024-09-12T00:26:42.592 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.592 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.592 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.592 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.592 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.592 INFO:tasks.workunit.client.0.smithi043.stdout:raw=.data-pool:marker_myobj 2024-09-12T00:26:42.593 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.593 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj2": { 2024-09-12T00:26:42.593 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.593 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker_myobj", 2024-09-12T00:26:42.593 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.593 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.593 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.593 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.593 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj2": { 2024-09-12T00:26:42.593 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.593 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.593 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.593 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.593 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.594 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.594 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.594 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.594 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.594 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.594 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.594 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.594 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "myobj", 2024-09-12T00:26:42.594 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.594 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.594 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.594 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.594 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.594 INFO:tasks.workunit.client.0.smithi043.stdout:raw2=.data-pool:marker_myobj 2024-09-12T00:26:42.595 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.595 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.595 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.595 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:26:42.595 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.595 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.595 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.595 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.595 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.595 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.595 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.595 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.595 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.595 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.596 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.596 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.596 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.596 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.596 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.596 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.596 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.596 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "myobj", 2024-09-12T00:26:42.596 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.596 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.596 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.596 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.596 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.596 INFO:tasks.workunit.client.0.smithi043.stdout:raw=.data-pool:marker__ns_myobj 2024-09-12T00:26:42.597 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.597 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj2": { 2024-09-12T00:26:42.597 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.597 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:26:42.597 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.597 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.597 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.597 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.597 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj2": { 2024-09-12T00:26:42.597 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.597 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.597 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.597 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.598 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.600 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.600 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.600 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.600 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.600 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.600 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.600 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.600 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "myobj", 2024-09-12T00:26:42.600 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.600 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.601 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.601 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.601 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.601 INFO:tasks.workunit.client.0.smithi043.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-12T00:26:42.601 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.601 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.601 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.601 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:26:42.601 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.601 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.601 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.601 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.601 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.602 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.602 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.602 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.602 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.602 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.602 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.602 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.602 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.602 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.602 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.602 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.602 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.602 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "myobj", 2024-09-12T00:26:42.603 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.603 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.603 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.603 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.603 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.603 INFO:tasks.workunit.client.0.smithi043.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-12T00:26:42.603 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.603 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj2": { 2024-09-12T00:26:42.603 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.603 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:26:42.603 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.603 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.603 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.603 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.604 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj2": { 2024-09-12T00:26:42.604 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.604 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.604 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.604 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.604 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.604 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.604 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.604 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.604 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.604 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.604 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.604 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.605 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "myobj", 2024-09-12T00:26:42.605 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.605 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.605 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.605 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.605 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.605 INFO:tasks.workunit.client.0.smithi043.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-12T00:26:42.605 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.605 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.605 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.605 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:26:42.605 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.605 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.605 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.606 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.606 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.606 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.606 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.606 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.606 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.606 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.606 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.606 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.606 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.606 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.606 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.606 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.607 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.607 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "myobj", 2024-09-12T00:26:42.607 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.607 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.607 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.607 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.607 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.607 INFO:tasks.workunit.client.0.smithi043.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-12T00:26:42.607 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.607 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj2": { 2024-09-12T00:26:42.607 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.607 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:26:42.608 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.608 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.608 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.608 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.608 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj2": { 2024-09-12T00:26:42.608 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.608 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.608 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.608 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.608 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.608 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.608 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.608 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.609 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.609 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.609 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.609 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.609 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "myobj", 2024-09-12T00:26:42.609 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.609 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.609 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.609 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.609 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.609 INFO:tasks.workunit.client.0.smithi043.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-12T00:26:42.609 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.609 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.609 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.610 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker___myobj", 2024-09-12T00:26:42.610 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "marker__myobj" 2024-09-12T00:26:42.610 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.610 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.610 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.610 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.610 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.610 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.610 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.610 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.610 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.610 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.610 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.611 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.611 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.611 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.611 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.611 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.611 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj", 2024-09-12T00:26:42.611 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.611 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.611 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.611 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.611 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.611 INFO:tasks.workunit.client.0.smithi043.stdout:raw=.data-pool:marker___myobj 2024-09-12T00:26:42.611 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.611 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj2": { 2024-09-12T00:26:42.612 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.612 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker___myobj", 2024-09-12T00:26:42.612 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "marker__myobj" 2024-09-12T00:26:42.612 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.612 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.612 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.612 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj2": { 2024-09-12T00:26:42.612 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.612 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.612 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.612 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.612 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.612 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.612 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.613 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.613 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.613 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.613 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.613 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.613 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj", 2024-09-12T00:26:42.613 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.613 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.613 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.613 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.613 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.613 INFO:tasks.workunit.client.0.smithi043.stdout:raw2=.data-pool:marker___myobj 2024-09-12T00:26:42.613 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.614 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.614 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.614 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:26:42.614 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.614 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.614 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.614 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.614 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.614 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.614 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.614 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.614 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.614 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.614 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.615 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.615 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.615 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.615 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.615 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.615 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.615 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj", 2024-09-12T00:26:42.615 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.615 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.615 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.615 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.615 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.616 INFO:tasks.workunit.client.0.smithi043.stdout:raw=.data-pool:marker__ns__myobj 2024-09-12T00:26:42.616 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.616 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj2": { 2024-09-12T00:26:42.616 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.616 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:26:42.616 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.616 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.616 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.616 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.616 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj2": { 2024-09-12T00:26:42.616 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.616 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.616 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.617 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.617 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.617 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.617 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.617 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.617 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.617 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.617 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.617 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.617 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj", 2024-09-12T00:26:42.617 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.617 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.617 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.618 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.618 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.618 INFO:tasks.workunit.client.0.smithi043.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-12T00:26:42.618 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.618 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.618 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.618 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:26:42.618 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "marker__myobj" 2024-09-12T00:26:42.618 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.618 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.618 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.618 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.618 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.619 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.619 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.619 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.619 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.619 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.619 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.619 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.619 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.619 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.619 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.619 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.619 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj", 2024-09-12T00:26:42.619 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.620 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.620 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.620 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.620 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.620 INFO:tasks.workunit.client.0.smithi043.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-12T00:26:42.620 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.620 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj2": { 2024-09-12T00:26:42.620 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.620 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:26:42.620 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "marker__myobj" 2024-09-12T00:26:42.620 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.620 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.620 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.620 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj2": { 2024-09-12T00:26:42.621 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.621 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.621 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.621 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.621 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.621 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.621 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.621 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.621 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.621 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.621 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.621 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.622 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj", 2024-09-12T00:26:42.622 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.622 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.622 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.622 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.622 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.622 INFO:tasks.workunit.client.0.smithi043.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-12T00:26:42.622 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.622 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.622 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.622 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:26:42.622 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.622 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.622 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.623 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.623 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.623 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.623 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.623 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.623 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.623 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.623 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.623 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.623 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.623 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.623 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.623 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.623 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.624 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj", 2024-09-12T00:26:42.624 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.624 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.624 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.624 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.624 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.624 INFO:tasks.workunit.client.0.smithi043.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-12T00:26:42.624 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.624 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj2": { 2024-09-12T00:26:42.624 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.624 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:26:42.624 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.624 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.625 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.625 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.625 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj2": { 2024-09-12T00:26:42.625 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.625 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.625 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.625 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.625 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.625 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.625 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.625 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.625 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.625 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.625 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.626 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.626 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj", 2024-09-12T00:26:42.626 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.626 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.626 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.626 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.626 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.626 INFO:tasks.workunit.client.0.smithi043.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-12T00:26:42.626 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.626 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.626 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.626 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker___myobj_", 2024-09-12T00:26:42.626 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "marker__myobj_" 2024-09-12T00:26:42.627 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.627 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.627 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.627 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.627 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.627 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.627 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.627 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.627 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.627 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.627 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.627 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.627 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.627 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.628 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.628 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.628 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj_", 2024-09-12T00:26:42.628 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.628 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.628 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.628 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.628 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.628 INFO:tasks.workunit.client.0.smithi043.stdout:raw=.data-pool:marker___myobj_ 2024-09-12T00:26:42.628 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.628 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj2": { 2024-09-12T00:26:42.628 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.628 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker___myobj_", 2024-09-12T00:26:42.629 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "marker__myobj_" 2024-09-12T00:26:42.629 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.629 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.629 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.629 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj2": { 2024-09-12T00:26:42.629 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.629 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.629 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.629 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.629 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.629 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.629 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.629 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.629 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.630 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.630 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.630 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.630 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj_", 2024-09-12T00:26:42.630 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.630 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.630 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.630 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.630 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.630 INFO:tasks.workunit.client.0.smithi043.stdout:raw2=.data-pool:marker___myobj_ 2024-09-12T00:26:42.630 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.630 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.630 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.631 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:26:42.631 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.631 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.631 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.631 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.631 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.631 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.631 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.631 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.631 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.631 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.631 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.632 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.632 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.632 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.632 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.632 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.632 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.632 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj_", 2024-09-12T00:26:42.632 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.632 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.632 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.632 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.632 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.632 INFO:tasks.workunit.client.0.smithi043.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-12T00:26:42.633 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.633 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj2": { 2024-09-12T00:26:42.633 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.633 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:26:42.633 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.633 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.633 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.633 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.633 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj2": { 2024-09-12T00:26:42.633 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.633 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.633 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.633 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.634 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.634 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.634 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.634 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.634 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.634 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.634 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.634 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.634 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj_", 2024-09-12T00:26:42.634 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "", 2024-09-12T00:26:42.634 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.634 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.634 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.634 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.635 INFO:tasks.workunit.client.0.smithi043.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-12T00:26:42.635 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.635 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.635 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.635 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:26:42.635 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "marker__myobj_" 2024-09-12T00:26:42.635 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.635 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.635 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.635 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.635 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.635 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.635 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.636 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.636 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.636 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.636 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.636 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.636 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.636 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.636 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.636 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.636 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj_", 2024-09-12T00:26:42.636 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.636 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.636 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.637 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.637 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.637 INFO:tasks.workunit.client.0.smithi043.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-12T00:26:42.637 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.637 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj2": { 2024-09-12T00:26:42.637 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.637 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:26:42.637 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "marker__myobj_" 2024-09-12T00:26:42.637 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.637 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.637 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.637 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj2": { 2024-09-12T00:26:42.637 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.638 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.638 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.638 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.638 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.638 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.638 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.638 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.638 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.638 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.638 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.638 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.638 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj_", 2024-09-12T00:26:42.638 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.638 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "" 2024-09-12T00:26:42.639 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.639 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.639 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.639 INFO:tasks.workunit.client.0.smithi043.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-12T00:26:42.639 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.639 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj": { 2024-09-12T00:26:42.639 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.639 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:26:42.639 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.639 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.639 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.639 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.639 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj": { 2024-09-12T00:26:42.639 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.640 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.640 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.640 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.640 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.640 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.640 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.640 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.640 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.640 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.640 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.640 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.640 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj_", 2024-09-12T00:26:42.640 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.641 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.641 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.641 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.641 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.641 INFO:tasks.workunit.client.0.smithi043.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-12T00:26:42.641 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.641 INFO:tasks.workunit.client.0.smithi043.stdout: "raw_obj2": { 2024-09-12T00:26:42.641 INFO:tasks.workunit.client.0.smithi043.stdout: "pool": ".data-pool", 2024-09-12T00:26:42.641 INFO:tasks.workunit.client.0.smithi043.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:26:42.641 INFO:tasks.workunit.client.0.smithi043.stdout: "loc": "" 2024-09-12T00:26:42.641 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.641 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.641 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.641 INFO:tasks.workunit.client.0.smithi043.stdout: "new_obj2": { 2024-09-12T00:26:42.642 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket": { 2024-09-12T00:26:42.642 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "ebtest", 2024-09-12T00:26:42.642 INFO:tasks.workunit.client.0.smithi043.stdout: "marker": "marker", 2024-09-12T00:26:42.642 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_id": "bucket-id", 2024-09-12T00:26:42.642 INFO:tasks.workunit.client.0.smithi043.stdout: "tenant": "", 2024-09-12T00:26:42.642 INFO:tasks.workunit.client.0.smithi043.stdout: "explicit_placement": { 2024-09-12T00:26:42.642 INFO:tasks.workunit.client.0.smithi043.stdout: "data_pool": ".data-pool", 2024-09-12T00:26:42.642 INFO:tasks.workunit.client.0.smithi043.stdout: "data_extra_pool": "", 2024-09-12T00:26:42.642 INFO:tasks.workunit.client.0.smithi043.stdout: "index_pool": ".index-pool" 2024-09-12T00:26:42.642 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.642 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.642 INFO:tasks.workunit.client.0.smithi043.stdout: "key": { 2024-09-12T00:26:42.642 INFO:tasks.workunit.client.0.smithi043.stdout: "name": "_myobj_", 2024-09-12T00:26:42.643 INFO:tasks.workunit.client.0.smithi043.stdout: "instance": "inst", 2024-09-12T00:26:42.643 INFO:tasks.workunit.client.0.smithi043.stdout: "ns": "ns" 2024-09-12T00:26:42.643 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.643 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.643 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.643 INFO:tasks.workunit.client.0.smithi043.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-12T00:26:42.643 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-12T00:26:42.643 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-12T00:26:42.643 INFO:tasks.workunit.client.0.smithi043.stdout: 2024-09-12T00:26:42.643 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment tear-down 2024-09-12T00:26:42.643 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-12T00:26:42.643 INFO:tasks.workunit.client.0.smithi043.stdout:[ PASSED ] 4 tests. 2024-09-12T00:26:42.644 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:26:42.644 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:26:42.658 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-12T00:26:42.660 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-12T00:26:42.660 DEBUG:teuthology.orchestra.run.smithi043:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-12T00:26:42.767 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:42.767 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:42.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.809+0000 7f167b0bf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:42.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.809+0000 7f167b0bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:42.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.809+0000 7f167b0bf9c0 20 realm 2024-09-12T00:26:42.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.809+0000 7f167b0bf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:42.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.809+0000 7f167b0bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:42.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.809+0000 7f167b0bf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:42.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.809+0000 7f167b0bf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:42.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.809+0000 7f167b0bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:42.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.809+0000 7f167b0bf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:42.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.813+0000 7f167b0bf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:42.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.813+0000 7f167b0bf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:42.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.813+0000 7f167b0bf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:42.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.813+0000 7f167b0bf9c0 20 searching for the correct realm 2024-09-12T00:26:42.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.821+0000 7f16783c4640 0 -- 172.21.15.43:0/613595491 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f166c12d050 msgr2=0x7f166c0fd9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:42.829 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.825+0000 7f16793c6640 0 -- 172.21.15.43:0/613595491 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f166c10e870 msgr2=0x7f166c0c0810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:26:42.838 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.837+0000 7f167b0bf9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:26:42.838 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.837+0000 7f167b0bf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:42.838 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.837+0000 7f167b0bf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:42.838 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.837+0000 7f167b0bf9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:26:42.838 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.837+0000 7f167b0bf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:42.838 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.837+0000 7f167b0bf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:42.838 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.837+0000 7f167b0bf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:42.838 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.837+0000 7f167b0bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:42.838 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.837+0000 7f167b0bf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:42.839 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.837+0000 7f167b0bf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:42.839 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.837+0000 7f167b0bf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:42.839 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.837+0000 7f167b0bf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:42.839 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.837+0000 7f167b0bf9c0 20 zone default found 2024-09-12T00:26:42.839 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.837+0000 7f167b0bf9c0 4 Realm: () 2024-09-12T00:26:42.840 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.837+0000 7f167b0bf9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:26:42.840 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.837+0000 7f167b0bf9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:26:42.840 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.837+0000 7f167b0bf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:42.840 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.837+0000 7f167b0bf9c0 20 zonegroup default 2024-09-12T00:26:42.840 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.837+0000 7f167b0bf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:42.840 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.837+0000 7f167b0bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:42.840 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.837+0000 7f167b0bf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:42.841 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.837+0000 7f167b0bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:42.841 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.837+0000 7f167b0bf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:42.841 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.837+0000 7f167b0bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:42.841 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.837+0000 7f167b0bf9c0 20 started sync module instance, tier type = 2024-09-12T00:26:42.841 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.837+0000 7f167b0bf9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:26:42.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.853+0000 7f167b0bf9c0 20 add_watcher() i=0 2024-09-12T00:26:42.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.853+0000 7f167b0bf9c0 20 add_watcher() i=1 2024-09-12T00:26:42.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.853+0000 7f167b0bf9c0 20 add_watcher() i=2 2024-09-12T00:26:42.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.853+0000 7f167b0bf9c0 20 add_watcher() i=3 2024-09-12T00:26:42.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.853+0000 7f167b0bf9c0 20 add_watcher() i=4 2024-09-12T00:26:42.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.853+0000 7f167b0bf9c0 20 add_watcher() i=5 2024-09-12T00:26:42.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.853+0000 7f167b0bf9c0 20 add_watcher() i=6 2024-09-12T00:26:42.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.853+0000 7f167b0bf9c0 20 add_watcher() i=7 2024-09-12T00:26:42.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.853+0000 7f167b0bf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:42.860 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.857+0000 7f152efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:42.860 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.857+0000 7f167b0bf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:42.860 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.857+0000 7f167b0bf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:42.860 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.857+0000 7f167b0bf9c0 5 note: GC not initialized 2024-09-12T00:26:42.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.857+0000 7f152dfe3640 20 reqs_thread_entry: start 2024-09-12T00:26:42.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.857+0000 7f167b0bf9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:26:42.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.857+0000 7f167b0bf9c0 20 Filter name: none 2024-09-12T00:26:42.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.857+0000 7f149f7fe640 20 reqs_thread_entry: start 2024-09-12T00:26:42.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.857+0000 7f167b0bf9c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-12T00:26:42.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.857+0000 7f167b0bf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:42.862 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.861+0000 7f167b0bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:42.862 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.861+0000 7f167b0bf9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-12T00:26:42.862 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.861+0000 7f167b0bf9c0 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:26:42.862 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.861+0000 7f167b0bf9c0 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-12T00:26:42.862 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.861+0000 7f167b0bf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:42.862 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.861+0000 7f167b0bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:42.862 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.861+0000 7f167b0bf9c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-12T00:26:42.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.861+0000 7f167b0bf9c0 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:26:42.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.861+0000 7f167b0bf9c0 10 cache get: name=default.rgw.meta+users.keys+QJA8kcpI4mPqMlp2oBtfqoJZm18= : miss 2024-09-12T00:26:42.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.861+0000 7f167b0bf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:42.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.861+0000 7f167b0bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:42.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.861+0000 7f167b0bf9c0 10 cache put: name=default.rgw.meta+users.keys+QJA8kcpI4mPqMlp2oBtfqoJZm18= info.flags=0x0 2024-09-12T00:26:42.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.861+0000 7f167b0bf9c0 10 adding default.rgw.meta+users.keys+QJA8kcpI4mPqMlp2oBtfqoJZm18= to cache LRU end 2024-09-12T00:26:42.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.861+0000 7f167b0bf9c0 10 cache get: name=default.rgw.meta+users.keys+QJA8kcpI4mPqMlp2oBtfqoJZm18= : hit (negative entry) 2024-09-12T00:26:42.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.861+0000 7f167b0bf9c0 10 cache get: name=default.rgw.meta+users.keys+QJA8kcpI4mPqMlp2oBtfqoJZm18= : hit (negative entry) 2024-09-12T00:26:42.865 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.865+0000 7f167b0bf9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T00:26:42.865 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.865+0000 7f167b0bf9c0 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:26:42.865 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.865+0000 7f167b0bf9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-12T00:26:42.866 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.865+0000 7f154ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693185 cookie 94755915738448 notifier 5309 bl.length()=697 2024-09-12T00:26:42.866 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.865+0000 7f154ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T00:26:42.866 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.865+0000 7f154ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:26:42.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.869+0000 7f167b0bf9c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T00:26:42.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.869+0000 7f167b0bf9c0 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:26:42.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.869+0000 7f167b0bf9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-12T00:26:42.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.869+0000 7f154ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693184 cookie 94755915733824 notifier 5309 bl.length()=194 2024-09-12T00:26:42.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.869+0000 7f154ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T00:26:42.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.869+0000 7f154ffff640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:26:42.874 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.873+0000 7f167b0bf9c0 10 cache put: name=default.rgw.meta+users.keys+QJA8kcpI4mPqMlp2oBtfqoJZm18= info.flags=0x7 2024-09-12T00:26:42.874 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.873+0000 7f167b0bf9c0 10 moving default.rgw.meta+users.keys+QJA8kcpI4mPqMlp2oBtfqoJZm18= to cache LRU end 2024-09-12T00:26:42.874 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.873+0000 7f167b0bf9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:QJA8kcpI4mPqMlp2oBtfqoJZm18=, ofs0, ns] 2024-09-12T00:26:42.875 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.873+0000 7f154f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693184 cookie 94755915740560 notifier 5309 bl.length()=203 2024-09-12T00:26:42.875 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.873+0000 7f154f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+QJA8kcpI4mPqMlp2oBtfqoJZm18= info.flags=0x7 2024-09-12T00:26:42.875 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.873+0000 7f154f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+QJA8kcpI4mPqMlp2oBtfqoJZm18= to cache LRU end 2024-09-12T00:26:42.875 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:26:42.875 INFO:tasks.workunit.client.0.smithi043.stdout: "user_id": "ceph-test-librgw-file", 2024-09-12T00:26:42.875 INFO:tasks.workunit.client.0.smithi043.stdout: "display_name": "librgw test user", 2024-09-12T00:26:42.875 INFO:tasks.workunit.client.0.smithi043.stdout: "email": "librgw@example.com", 2024-09-12T00:26:42.875 INFO:tasks.workunit.client.0.smithi043.stdout: "suspended": 0, 2024-09-12T00:26:42.875 INFO:tasks.workunit.client.0.smithi043.stdout: "max_buckets": 1000, 2024-09-12T00:26:42.876 INFO:tasks.workunit.client.0.smithi043.stdout: "subusers": [], 2024-09-12T00:26:42.876 INFO:tasks.workunit.client.0.smithi043.stdout: "keys": [ 2024-09-12T00:26:42.876 INFO:tasks.workunit.client.0.smithi043.stdout: { 2024-09-12T00:26:42.876 INFO:tasks.workunit.client.0.smithi043.stdout: "user": "ceph-test-librgw-file", 2024-09-12T00:26:42.876 INFO:tasks.workunit.client.0.smithi043.stdout: "access_key": "QJA8kcpI4mPqMlp2oBtfqoJZm18=", 2024-09-12T00:26:42.876 INFO:tasks.workunit.client.0.smithi043.stdout: "secret_key": "J920To0bArO0yjVbnnPB5A2hC02mrFcNBgPfFZoDZEoy+NZLKXbIXg==", 2024-09-12T00:26:42.876 INFO:tasks.workunit.client.0.smithi043.stdout: "active": true, 2024-09-12T00:26:42.876 INFO:tasks.workunit.client.0.smithi043.stdout: "create_date": "2024-09-12T00:26:42.866261Z" 2024-09-12T00:26:42.876 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:26:42.876 INFO:tasks.workunit.client.0.smithi043.stdout: ], 2024-09-12T00:26:42.876 INFO:tasks.workunit.client.0.smithi043.stdout: "swift_keys": [], 2024-09-12T00:26:42.876 INFO:tasks.workunit.client.0.smithi043.stdout: "caps": [], 2024-09-12T00:26:42.877 INFO:tasks.workunit.client.0.smithi043.stdout: "op_mask": "read, write, delete", 2024-09-12T00:26:42.877 INFO:tasks.workunit.client.0.smithi043.stdout: "default_placement": "", 2024-09-12T00:26:42.877 INFO:tasks.workunit.client.0.smithi043.stdout: "default_storage_class": "", 2024-09-12T00:26:42.877 INFO:tasks.workunit.client.0.smithi043.stdout: "placement_tags": [], 2024-09-12T00:26:42.877 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_quota": { 2024-09-12T00:26:42.877 INFO:tasks.workunit.client.0.smithi043.stdout: "enabled": false, 2024-09-12T00:26:42.877 INFO:tasks.workunit.client.0.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:26:42.877 INFO:tasks.workunit.client.0.smithi043.stdout: "max_size": -1, 2024-09-12T00:26:42.877 INFO:tasks.workunit.client.0.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:26:42.877 INFO:tasks.workunit.client.0.smithi043.stdout: "max_objects": -1 2024-09-12T00:26:42.877 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.877 INFO:tasks.workunit.client.0.smithi043.stdout: "user_quota": { 2024-09-12T00:26:42.878 INFO:tasks.workunit.client.0.smithi043.stdout: "enabled": false, 2024-09-12T00:26:42.878 INFO:tasks.workunit.client.0.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:26:42.878 INFO:tasks.workunit.client.0.smithi043.stdout: "max_size": -1, 2024-09-12T00:26:42.878 INFO:tasks.workunit.client.0.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:26:42.878 INFO:tasks.workunit.client.0.smithi043.stdout: "max_objects": -1 2024-09-12T00:26:42.878 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:26:42.878 INFO:tasks.workunit.client.0.smithi043.stdout: "temp_url_keys": [], 2024-09-12T00:26:42.878 INFO:tasks.workunit.client.0.smithi043.stdout: "type": "rgw", 2024-09-12T00:26:42.878 INFO:tasks.workunit.client.0.smithi043.stdout: "mfa_ids": [], 2024-09-12T00:26:42.878 INFO:tasks.workunit.client.0.smithi043.stdout: "account_id": "", 2024-09-12T00:26:42.878 INFO:tasks.workunit.client.0.smithi043.stdout: "path": "/", 2024-09-12T00:26:42.878 INFO:tasks.workunit.client.0.smithi043.stdout: "create_date": "2024-09-12T00:26:42.866239Z", 2024-09-12T00:26:42.879 INFO:tasks.workunit.client.0.smithi043.stdout: "tags": [], 2024-09-12T00:26:42.879 INFO:tasks.workunit.client.0.smithi043.stdout: "group_ids": [] 2024-09-12T00:26:42.879 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:26:42.879 INFO:tasks.workunit.client.0.smithi043.stdout: 2024-09-12T00:26:42.879 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.873+0000 7f152efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:42.881 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.877+0000 7f167b0bf9c0 20 remove_watcher() i=0 2024-09-12T00:26:42.881 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.877+0000 7f167b0bf9c0 2 removed watcher, disabling cache 2024-09-12T00:26:42.883 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.881+0000 7f167b0bf9c0 20 remove_watcher() i=1 2024-09-12T00:26:42.885 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.885+0000 7f167b0bf9c0 20 remove_watcher() i=2 2024-09-12T00:26:42.887 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.885+0000 7f167b0bf9c0 20 remove_watcher() i=3 2024-09-12T00:26:42.889 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.889+0000 7f167b0bf9c0 20 remove_watcher() i=4 2024-09-12T00:26:42.891 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.889+0000 7f167b0bf9c0 20 remove_watcher() i=5 2024-09-12T00:26:42.892 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.889+0000 7f167b0bf9c0 20 remove_watcher() i=6 2024-09-12T00:26:42.893 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:42.893+0000 7f167b0bf9c0 20 remove_watcher() i=7 2024-09-12T00:26:42.907 INFO:tasks.workunit.client.0.smithi043.stdout:phase 1.1 2024-09-12T00:26:42.925 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:26:42.925 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment set-up. 2024-09-12T00:26:42.926 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:26:42.926 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:26:42.938 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:42.938 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:43.254 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.INIT (329 ms) 2024-09-12T00:26:43.255 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:26:43.256 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T00:26:43.256 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:26:43.256 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:26:43.256 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:26:43.272 INFO:tasks.workunit.client.0.smithi043.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-12T00:26:43.280 INFO:tasks.workunit.client.0.smithi043.stdout:creating: nfsroot:foo/f1 2024-09-12T00:26:43.284 INFO:tasks.workunit.client.0.smithi043.stdout:creating: nfsroot:foo/f2 2024-09-12T00:26:43.289 INFO:tasks.workunit.client.0.smithi043.stdout:creating: nfsroot:foo/bar/f1 2024-09-12T00:26:43.294 INFO:tasks.workunit.client.0.smithi043.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-12T00:26:43.301 INFO:tasks.workunit.client.0.smithi043.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-12T00:26:43.307 INFO:tasks.workunit.client.0.smithi043.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-12T00:26:43.313 INFO:tasks.workunit.client.0.smithi043.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-12T00:26:43.319 INFO:tasks.workunit.client.0.smithi043.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-12T00:26:43.325 INFO:tasks.workunit.client.0.smithi043.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-12T00:26:43.331 INFO:tasks.workunit.client.0.smithi043.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-12T00:26:43.335 INFO:tasks.workunit.client.0.smithi043.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-12T00:26:43.342 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.SETUP_HIER1 (86 ms) 2024-09-12T00:26:43.342 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:26:43.589 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.SETUP_DIRS1 (246 ms) 2024-09-12T00:26:43.589 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:26:43.589 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:26:43.589 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:26:43.631 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (43 ms) 2024-09-12T00:26:43.631 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:26:43.725 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (94 ms) 2024-09-12T00:26:43.725 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:26:43.725 INFO:tasks.workunit.client.0.smithi043.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-12T00:26:43.740 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (15 ms) 2024-09-12T00:26:43.740 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:26:43.740 INFO:tasks.workunit.client.0.smithi043.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-12T00:26:43.754 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (14 ms) 2024-09-12T00:26:43.755 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:26:43.755 INFO:tasks.workunit.client.0.smithi043.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T00:26:43.755 INFO:tasks.workunit.client.0.smithi043.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:26:43.755 INFO:tasks.workunit.client.0.smithi043.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:26:43.755 INFO:tasks.workunit.client.0.smithi043.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:26:43.755 INFO:tasks.workunit.client.0.smithi043.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:26:43.755 INFO:tasks.workunit.client.0.smithi043.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T00:26:43.755 INFO:tasks.workunit.client.0.smithi043.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:26:43.755 INFO:tasks.workunit.client.0.smithi043.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:26:43.755 INFO:tasks.workunit.client.0.smithi043.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:26:43.755 INFO:tasks.workunit.client.0.smithi043.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:26:43.756 INFO:tasks.workunit.client.0.smithi043.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T00:26:43.756 INFO:tasks.workunit.client.0.smithi043.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:26:43.756 INFO:tasks.workunit.client.0.smithi043.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:26:43.756 INFO:tasks.workunit.client.0.smithi043.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:26:43.756 INFO:tasks.workunit.client.0.smithi043.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:26:43.756 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:26:43.756 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:26:43.756 INFO:tasks.workunit.client.0.smithi043.stdout:read back objects in /bdirs1/dir_0 2024-09-12T00:26:43.756 INFO:tasks.workunit.client.0.smithi043.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T00:26:43.757 INFO:tasks.workunit.client.0.smithi043.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:26:43.757 INFO:tasks.workunit.client.0.smithi043.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T00:26:43.759 INFO:tasks.workunit.client.0.smithi043.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:26:43.759 INFO:tasks.workunit.client.0.smithi043.stdout:read back objects in /bdirs1/dir_1 2024-09-12T00:26:43.759 INFO:tasks.workunit.client.0.smithi043.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T00:26:43.761 INFO:tasks.workunit.client.0.smithi043.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:26:43.761 INFO:tasks.workunit.client.0.smithi043.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T00:26:43.763 INFO:tasks.workunit.client.0.smithi043.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:26:43.764 INFO:tasks.workunit.client.0.smithi043.stdout:read back objects in /bdirs1/dir_2 2024-09-12T00:26:43.764 INFO:tasks.workunit.client.0.smithi043.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T00:26:43.766 INFO:tasks.workunit.client.0.smithi043.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:26:43.766 INFO:tasks.workunit.client.0.smithi043.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T00:26:43.768 INFO:tasks.workunit.client.0.smithi043.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:26:43.768 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.READ_DIRS1 (14 ms) 2024-09-12T00:26:43.768 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:26:43.973 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.READF_SETUP1 (205 ms) 2024-09-12T00:26:43.973 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:26:43.974 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:26:43.974 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:26:43.974 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:26:43.974 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:26:43.974 INFO:tasks.workunit.client.0.smithi043.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:26:43.974 INFO:tasks.workunit.client.0.smithi043.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:26:43.974 INFO:tasks.workunit.client.0.smithi043.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:26:43.974 INFO:tasks.workunit.client.0.smithi043.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:26:43.974 INFO:tasks.workunit.client.0.smithi043.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:26:43.974 INFO:tasks.workunit.client.0.smithi043.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:26:43.974 INFO:tasks.workunit.client.0.smithi043.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:26:43.974 INFO:tasks.workunit.client.0.smithi043.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:26:43.974 INFO:tasks.workunit.client.0.smithi043.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:26:43.974 INFO:tasks.workunit.client.0.smithi043.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:26:43.974 INFO:tasks.workunit.client.0.smithi043.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:26:43.975 INFO:tasks.workunit.client.0.smithi043.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:26:43.975 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:26:43.975 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:26:43.992 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T00:26:43.993 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T00:26:44.000 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T00:26:44.004 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T00:26:44.013 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:26:44.015 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:26:44.015 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T00:26:44.017 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T00:26:44.018 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:26:44.018 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:26:44.020 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T00:26:44.024 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T00:26:44.024 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T00:26:44.025 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T00:26:44.025 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot/foo (foo): DIR 2024-09-12T00:26:44.025 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot (nfsroot): DIR 2024-09-12T00:26:44.025 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.HIER1 (51 ms) 2024-09-12T00:26:44.025 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:26:44.025 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:26:44.025 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:26:44.025 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:26:44.025 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:26:44.025 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:26:44.025 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:26:44.025 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:26:44.025 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:26:44.026 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:26:44.026 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:26:44.026 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:26:44.026 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:26:44.026 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:44.021+0000 7f1331e1ea80 -1 shutting down 2024-09-12T00:26:44.027 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:26:44.025+0000 7f120bb70640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 55502, si_uid : 1000, si_addr0x3e80000d8ce, si_status0 2024-09-12T00:27:13.498 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.SHUTDOWN (29474 ms) 2024-09-12T00:27:13.499 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 24 tests from LibRGW (30572 ms total) 2024-09-12T00:27:13.499 INFO:tasks.workunit.client.0.smithi043.stdout: 2024-09-12T00:27:13.499 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment tear-down 2024-09-12T00:27:13.499 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] 24 tests from 1 test suite ran. (30572 ms total) 2024-09-12T00:27:13.499 INFO:tasks.workunit.client.0.smithi043.stdout:[ PASSED ] 24 tests. 2024-09-12T00:27:13.513 INFO:tasks.workunit.client.0.smithi043.stdout:phase 1.2 2024-09-12T00:27:13.538 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:27:13.538 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment set-up. 2024-09-12T00:27:13.538 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:27:13.538 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:27:13.548 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:13.549 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:13.838 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.INIT (301 ms) 2024-09-12T00:27:13.839 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:27:13.840 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T00:27:13.840 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:27:13.840 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:27:13.841 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:27:13.841 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-12T00:27:13.841 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:27:13.841 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-12T00:27:13.841 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:27:13.841 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:27:13.841 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:27:13.841 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T00:27:13.841 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:27:13.841 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T00:27:13.841 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:27:13.841 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T00:27:13.841 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:27:13.841 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T00:27:13.842 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:27:13.842 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:27:13.842 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:27:13.842 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-12T00:27:13.842 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:27:13.842 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T00:27:13.842 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:27:13.842 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:27:13.842 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:27:13.842 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:27:13.842 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:27:13.842 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:27:13.843 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:27:13.843 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-12T00:27:13.843 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:27:13.843 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:27:13.843 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:27:13.843 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:27:13.843 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:27:13.843 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:27:13.843 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:27:13.843 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:27:13.843 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:27:13.843 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:27:13.843 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:27:13.843 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:27:13.844 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:27:13.844 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:27:13.837+0000 7fdb03224a80 -1 shutting down 2024-09-12T00:27:13.844 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:27:13.841+0000 7fd9dcf76640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 56147, si_uid : 1000, si_addr0x3e80000db53, si_status0 2024-09-12T00:27:44.163 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.SHUTDOWN (30323 ms) 2024-09-12T00:27:44.163 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 24 tests from LibRGW (30625 ms total) 2024-09-12T00:27:44.163 INFO:tasks.workunit.client.0.smithi043.stdout: 2024-09-12T00:27:44.164 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment tear-down 2024-09-12T00:27:44.164 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] 24 tests from 1 test suite ran. (30625 ms total) 2024-09-12T00:27:44.164 INFO:tasks.workunit.client.0.smithi043.stdout:[ PASSED ] 24 tests. 2024-09-12T00:27:44.176 INFO:tasks.workunit.client.0.smithi043.stdout:phase 1.3 2024-09-12T00:27:44.199 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:27:44.199 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment set-up. 2024-09-12T00:27:44.199 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:27:44.200 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:27:44.212 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:44.212 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:44.764 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.INIT (565 ms) 2024-09-12T00:27:44.764 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:27:44.766 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-12T00:27:44.766 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:27:44.766 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:27:44.766 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:27:44.772 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.SETUP_HIER1 (7 ms) 2024-09-12T00:27:44.772 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:27:44.883 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.SETUP_DIRS1 (110 ms) 2024-09-12T00:27:44.883 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:27:44.883 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:27:44.883 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:27:44.883 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T00:27:44.883 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:27:44.883 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T00:27:44.883 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:27:44.884 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T00:27:44.884 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:27:44.884 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T00:27:44.884 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:27:44.884 INFO:tasks.workunit.client.0.smithi043.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T00:27:44.884 INFO:tasks.workunit.client.0.smithi043.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:27:44.884 INFO:tasks.workunit.client.0.smithi043.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:27:44.884 INFO:tasks.workunit.client.0.smithi043.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:27:44.884 INFO:tasks.workunit.client.0.smithi043.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:27:44.884 INFO:tasks.workunit.client.0.smithi043.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T00:27:44.884 INFO:tasks.workunit.client.0.smithi043.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:27:44.884 INFO:tasks.workunit.client.0.smithi043.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:27:44.884 INFO:tasks.workunit.client.0.smithi043.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:27:44.885 INFO:tasks.workunit.client.0.smithi043.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:27:44.885 INFO:tasks.workunit.client.0.smithi043.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T00:27:44.885 INFO:tasks.workunit.client.0.smithi043.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:27:44.885 INFO:tasks.workunit.client.0.smithi043.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:27:44.885 INFO:tasks.workunit.client.0.smithi043.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:27:44.885 INFO:tasks.workunit.client.0.smithi043.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:27:44.885 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:27:44.885 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:27:44.885 INFO:tasks.workunit.client.0.smithi043.stdout:read back objects in /bdirs1/dir_0 2024-09-12T00:27:44.885 INFO:tasks.workunit.client.0.smithi043.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T00:27:44.888 INFO:tasks.workunit.client.0.smithi043.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:27:44.889 INFO:tasks.workunit.client.0.smithi043.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T00:27:44.889 INFO:tasks.workunit.client.0.smithi043.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:27:44.889 INFO:tasks.workunit.client.0.smithi043.stdout:read back objects in /bdirs1/dir_1 2024-09-12T00:27:44.889 INFO:tasks.workunit.client.0.smithi043.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T00:27:44.889 INFO:tasks.workunit.client.0.smithi043.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:27:44.889 INFO:tasks.workunit.client.0.smithi043.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T00:27:44.892 INFO:tasks.workunit.client.0.smithi043.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:27:44.892 INFO:tasks.workunit.client.0.smithi043.stdout:read back objects in /bdirs1/dir_2 2024-09-12T00:27:44.892 INFO:tasks.workunit.client.0.smithi043.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T00:27:44.893 INFO:tasks.workunit.client.0.smithi043.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:27:44.893 INFO:tasks.workunit.client.0.smithi043.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T00:27:44.895 INFO:tasks.workunit.client.0.smithi043.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:27:44.896 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.READ_DIRS1 (13 ms) 2024-09-12T00:27:44.896 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:27:44.896 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T00:27:44.896 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:27:44.896 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:27:44.896 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:27:44.896 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:27:44.896 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:27:44.896 INFO:tasks.workunit.client.0.smithi043.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:27:44.896 INFO:tasks.workunit.client.0.smithi043.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:27:44.896 INFO:tasks.workunit.client.0.smithi043.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:27:44.896 INFO:tasks.workunit.client.0.smithi043.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:27:44.897 INFO:tasks.workunit.client.0.smithi043.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:27:44.897 INFO:tasks.workunit.client.0.smithi043.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:27:44.897 INFO:tasks.workunit.client.0.smithi043.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:27:44.897 INFO:tasks.workunit.client.0.smithi043.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:27:44.897 INFO:tasks.workunit.client.0.smithi043.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:27:44.897 INFO:tasks.workunit.client.0.smithi043.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:27:44.897 INFO:tasks.workunit.client.0.smithi043.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:27:44.897 INFO:tasks.workunit.client.0.smithi043.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:27:44.897 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:27:44.897 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:27:44.913 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T00:27:44.915 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T00:27:44.922 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T00:27:44.927 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T00:27:44.934 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:27:44.935 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:27:44.936 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T00:27:44.938 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T00:27:44.938 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:27:44.939 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:27:44.940 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T00:27:44.946 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T00:27:44.946 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T00:27:44.946 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T00:27:44.946 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot/foo (foo): DIR 2024-09-12T00:27:44.946 INFO:tasks.workunit.client.0.smithi043.stdout:/nfsroot (nfsroot): DIR 2024-09-12T00:27:44.946 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.HIER1 (50 ms) 2024-09-12T00:27:44.946 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:27:44.946 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:27:44.946 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:27:44.947 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:27:44.947 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:27:44.947 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:27:44.947 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:27:44.947 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:27:44.947 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:27:44.947 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:27:44.947 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:27:44.947 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:27:44.947 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:27:44.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:27:44.945+0000 7fb74a7e2a80 -1 shutting down 2024-09-12T00:27:44.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:27:44.945+0000 7fb624534640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 56792, si_uid : 1000, si_addr0x3e80000ddd8, si_status0 2024-09-12T00:28:14.951 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.SHUTDOWN (30005 ms) 2024-09-12T00:28:14.951 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 24 tests from LibRGW (30752 ms total) 2024-09-12T00:28:14.952 INFO:tasks.workunit.client.0.smithi043.stdout: 2024-09-12T00:28:14.952 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment tear-down 2024-09-12T00:28:14.952 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] 24 tests from 1 test suite ran. (30752 ms total) 2024-09-12T00:28:14.952 INFO:tasks.workunit.client.0.smithi043.stdout:[ PASSED ] 24 tests. 2024-09-12T00:28:14.965 INFO:tasks.workunit.client.0.smithi043.stdout:phase 2.1 2024-09-12T00:28:14.989 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:28:14.990 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment set-up. 2024-09-12T00:28:14.990 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 9 tests from LibRGW 2024-09-12T00:28:14.990 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:28:15.001 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:15.001 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:15.318 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.INIT (328 ms) 2024-09-12T00:28:15.318 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:28:15.319 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T00:28:15.319 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:28:15.336 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.CREATE_BUCKET (16 ms) 2024-09-12T00:28:15.336 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:28:15.336 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:28:15.336 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T00:28:15.352 INFO:tasks.workunit.client.0.smithi043.stdout:created: sorrydave0 2024-09-12T00:28:15.373 INFO:tasks.workunit.client.0.smithi043.stdout:created: sorrydave1 2024-09-12T00:28:15.393 INFO:tasks.workunit.client.0.smithi043.stdout:created: sorrydave2 2024-09-12T00:28:15.410 INFO:tasks.workunit.client.0.smithi043.stdout:created: sorrydave3 2024-09-12T00:28:15.428 INFO:tasks.workunit.client.0.smithi043.stdout:created: sorrydave4 2024-09-12T00:28:15.444 INFO:tasks.workunit.client.0.smithi043.stdout:created: sorrydave5 2024-09-12T00:28:15.465 INFO:tasks.workunit.client.0.smithi043.stdout:created: sorrydave6 2024-09-12T00:28:15.484 INFO:tasks.workunit.client.0.smithi043.stdout:created: sorrydave7 2024-09-12T00:28:15.502 INFO:tasks.workunit.client.0.smithi043.stdout:created: sorrydave8 2024-09-12T00:28:15.521 INFO:tasks.workunit.client.0.smithi043.stdout:created: sorrydave9 2024-09-12T00:28:15.521 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (185 ms) 2024-09-12T00:28:15.521 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T00:28:16.252 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (731 ms) 2024-09-12T00:28:16.252 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:28:16.252 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:28:16.253 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:28:16.253 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:28:16.253 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:28:16.253 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:28:16.248+0000 7f9aa01eda80 -1 shutting down 2024-09-12T00:28:16.255 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:28:16.252+0000 7f9979f3f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 57439, si_uid : 1000, si_addr0x3e80000e05f, si_status0 2024-09-12T00:28:45.586 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.SHUTDOWN (29334 ms) 2024-09-12T00:28:45.586 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 9 tests from LibRGW (30596 ms total) 2024-09-12T00:28:45.586 INFO:tasks.workunit.client.0.smithi043.stdout: 2024-09-12T00:28:45.586 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment tear-down 2024-09-12T00:28:45.587 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] 9 tests from 1 test suite ran. (30596 ms total) 2024-09-12T00:28:45.587 INFO:tasks.workunit.client.0.smithi043.stdout:[ PASSED ] 9 tests. 2024-09-12T00:28:45.600 INFO:tasks.workunit.client.0.smithi043.stdout:phase 2.2 2024-09-12T00:28:45.625 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:28:45.625 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment set-up. 2024-09-12T00:28:45.625 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 9 tests from LibRGW 2024-09-12T00:28:45.625 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:28:45.636 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:45.637 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:45.925 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.INIT (301 ms) 2024-09-12T00:28:45.926 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:28:45.927 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:28:45.927 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:28:45.927 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:28:45.927 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:28:45.988 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.DELETE_BUCKET (61 ms) 2024-09-12T00:28:45.988 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T00:28:46.004 INFO:tasks.workunit.client.0.smithi043.stdout:created: sorrydave0 2024-09-12T00:28:46.022 INFO:tasks.workunit.client.0.smithi043.stdout:created: sorrydave1 2024-09-12T00:28:46.040 INFO:tasks.workunit.client.0.smithi043.stdout:created: sorrydave2 2024-09-12T00:28:46.061 INFO:tasks.workunit.client.0.smithi043.stdout:created: sorrydave3 2024-09-12T00:28:46.080 INFO:tasks.workunit.client.0.smithi043.stdout:created: sorrydave4 2024-09-12T00:28:46.098 INFO:tasks.workunit.client.0.smithi043.stdout:created: sorrydave5 2024-09-12T00:28:46.117 INFO:tasks.workunit.client.0.smithi043.stdout:created: sorrydave6 2024-09-12T00:28:46.136 INFO:tasks.workunit.client.0.smithi043.stdout:created: sorrydave7 2024-09-12T00:28:46.157 INFO:tasks.workunit.client.0.smithi043.stdout:created: sorrydave8 2024-09-12T00:28:46.178 INFO:tasks.workunit.client.0.smithi043.stdout:created: sorrydave9 2024-09-12T00:28:46.178 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (190 ms) 2024-09-12T00:28:46.178 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T00:28:46.931 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (753 ms) 2024-09-12T00:28:46.931 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:28:46.931 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:28:46.931 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:28:46.931 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:28:46.931 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:28:46.932 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:28:46.932+0000 7f39daaf8a80 -1 shutting down 2024-09-12T00:28:46.932 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:28:46.932+0000 7f38b484a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58084, si_uid : 1000, si_addr0x3e80000e2e4, si_status0 2024-09-12T00:29:16.168 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.SHUTDOWN (29237 ms) 2024-09-12T00:29:16.168 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 9 tests from LibRGW (30543 ms total) 2024-09-12T00:29:16.168 INFO:tasks.workunit.client.0.smithi043.stdout: 2024-09-12T00:29:16.169 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment tear-down 2024-09-12T00:29:16.169 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] 9 tests from 1 test suite ran. (30543 ms total) 2024-09-12T00:29:16.169 INFO:tasks.workunit.client.0.smithi043.stdout:[ PASSED ] 9 tests. 2024-09-12T00:29:16.181 INFO:tasks.workunit.client.0.smithi043.stdout:phase 3.1 2024-09-12T00:29:16.526 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T00:29:16.527 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment set-up. 2024-09-12T00:29:16.527 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 13 tests from LibRGW 2024-09-12T00:29:16.527 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:29:16.536 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:16.537 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:17.090 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.INIT (563 ms) 2024-09-12T00:29:17.090 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:29:17.091 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T00:29:17.091 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:29:17.105 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.CREATE_BUCKET (14 ms) 2024-09-12T00:29:17.105 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:29:17.110 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-12T00:29:17.110 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:29:17.112 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-09-12T00:29:17.112 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T00:29:17.193 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.LARGE1 (81 ms) 2024-09-12T00:29:17.193 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T00:29:17.260 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.LARGE2 (66 ms) 2024-09-12T00:29:17.260 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:29:17.260 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:29:17.260 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:29:17.260 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T00:29:17.260 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:29:17.260 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:29:17.260 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:29:17.260 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:29:17.261 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:29:17.261 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:29:17.261 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:29:17.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:29:17.260+0000 7fec86440a80 -1 shutting down 2024-09-12T00:29:17.263 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:29:17.264+0000 7feb60192640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58729, si_uid : 1000, si_addr0x3e80000e569, si_status0 2024-09-12T00:29:47.181 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.SHUTDOWN (29921 ms) 2024-09-12T00:29:47.181 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 13 tests from LibRGW (30654 ms total) 2024-09-12T00:29:47.181 INFO:tasks.workunit.client.0.smithi043.stdout: 2024-09-12T00:29:47.181 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment tear-down 2024-09-12T00:29:47.181 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] 13 tests from 1 test suite ran. (30654 ms total) 2024-09-12T00:29:47.181 INFO:tasks.workunit.client.0.smithi043.stdout:[ PASSED ] 13 tests. 2024-09-12T00:29:47.200 INFO:tasks.workunit.client.0.smithi043.stdout:phase 3.2 2024-09-12T00:29:47.543 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T00:29:47.543 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment set-up. 2024-09-12T00:29:47.543 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 13 tests from LibRGW 2024-09-12T00:29:47.543 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:29:47.552 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:47.552 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:48.114 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.INIT (570 ms) 2024-09-12T00:29:48.114 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:29:48.115 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T00:29:48.115 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:29:48.115 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:29:48.115 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:29:48.123 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (7 ms) 2024-09-12T00:29:48.123 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:29:48.127 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (5 ms) 2024-09-12T00:29:48.127 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T00:29:48.650 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.LARGE1 (523 ms) 2024-09-12T00:29:48.651 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T00:29:48.651 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-12T00:29:48.651 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:29:48.651 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:29:48.651 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:29:48.660 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.DELETE_OBJECT (10 ms) 2024-09-12T00:29:48.660 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:29:48.716 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.DELETE_BUCKET (55 ms) 2024-09-12T00:29:48.716 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:29:48.716 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:29:48.716 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:29:48.716 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:29:48.716 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:29:48.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:29:48.715+0000 7f9ba9c03a80 -1 shutting down 2024-09-12T00:29:48.718 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:29:48.719+0000 7f9a83955640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59375, si_uid : 1000, si_addr0x3e80000e7ef, si_status0 2024-09-12T00:30:18.265 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.SHUTDOWN (29549 ms) 2024-09-12T00:30:18.265 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 13 tests from LibRGW (30721 ms total) 2024-09-12T00:30:18.265 INFO:tasks.workunit.client.0.smithi043.stdout: 2024-09-12T00:30:18.265 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment tear-down 2024-09-12T00:30:18.265 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] 13 tests from 1 test suite ran. (30721 ms total) 2024-09-12T00:30:18.265 INFO:tasks.workunit.client.0.smithi043.stdout:[ PASSED ] 13 tests. 2024-09-12T00:30:18.283 INFO:tasks.workunit.client.0.smithi043.stdout:phase 4.1 2024-09-12T00:30:18.307 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:30:18.307 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment set-up. 2024-09-12T00:30:18.307 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 11 tests from LibRGW 2024-09-12T00:30:18.307 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T00:30:18.307 INFO:tasks.workunit.client.0.smithi043.stdout:read i1: 64001 2024-09-12T00:30:18.307 INFO:tasks.workunit.client.0.smithi043.stdout:read s1: blunderbuss 2024-09-12T00:30:18.307 INFO:tasks.workunit.client.0.smithi043.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T00:30:18.307 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:30:18.321 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:18.321 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:18.611 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.INIT (304 ms) 2024-09-12T00:30:18.611 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:30:18.612 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T00:30:18.612 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:30:18.644 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (32 ms) 2024-09-12T00:30:18.644 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:30:20.082 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_0 2024-09-12T00:30:20.082 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_1 2024-09-12T00:30:20.083 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_2 2024-09-12T00:30:20.083 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_3 2024-09-12T00:30:20.083 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_4 2024-09-12T00:30:20.083 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_5 2024-09-12T00:30:20.083 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_6 2024-09-12T00:30:20.083 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_7 2024-09-12T00:30:20.083 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_8 2024-09-12T00:30:20.083 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_9 2024-09-12T00:30:20.083 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_10 2024-09-12T00:30:20.084 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_11 2024-09-12T00:30:20.084 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_12 2024-09-12T00:30:20.084 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_13 2024-09-12T00:30:20.084 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_14 2024-09-12T00:30:20.084 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_15 2024-09-12T00:30:20.084 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_16 2024-09-12T00:30:20.084 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_17 2024-09-12T00:30:20.084 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_18 2024-09-12T00:30:20.084 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_19 2024-09-12T00:30:20.084 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_20 2024-09-12T00:30:20.084 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_21 2024-09-12T00:30:20.085 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_22 2024-09-12T00:30:20.085 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_23 2024-09-12T00:30:20.085 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_24 2024-09-12T00:30:20.085 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_25 2024-09-12T00:30:20.085 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_26 2024-09-12T00:30:20.085 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_27 2024-09-12T00:30:20.085 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_28 2024-09-12T00:30:20.085 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_29 2024-09-12T00:30:20.085 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_30 2024-09-12T00:30:20.086 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_31 2024-09-12T00:30:20.086 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_32 2024-09-12T00:30:20.086 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_33 2024-09-12T00:30:20.086 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_34 2024-09-12T00:30:20.086 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_35 2024-09-12T00:30:20.087 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_36 2024-09-12T00:30:20.087 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_37 2024-09-12T00:30:20.087 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_38 2024-09-12T00:30:20.087 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_39 2024-09-12T00:30:20.087 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_40 2024-09-12T00:30:20.088 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_41 2024-09-12T00:30:20.088 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_42 2024-09-12T00:30:20.088 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_43 2024-09-12T00:30:20.088 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_44 2024-09-12T00:30:20.089 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_45 2024-09-12T00:30:20.089 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_46 2024-09-12T00:30:20.089 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_47 2024-09-12T00:30:20.089 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_48 2024-09-12T00:30:20.089 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_49 2024-09-12T00:30:20.089 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_50 2024-09-12T00:30:20.089 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_51 2024-09-12T00:30:20.089 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_52 2024-09-12T00:30:20.090 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_53 2024-09-12T00:30:20.090 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_54 2024-09-12T00:30:20.090 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_55 2024-09-12T00:30:20.090 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_56 2024-09-12T00:30:20.090 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_57 2024-09-12T00:30:20.090 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_58 2024-09-12T00:30:20.090 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_59 2024-09-12T00:30:20.090 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_60 2024-09-12T00:30:20.090 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_61 2024-09-12T00:30:20.090 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_62 2024-09-12T00:30:20.090 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_63 2024-09-12T00:30:20.090 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_64 2024-09-12T00:30:20.090 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_65 2024-09-12T00:30:20.090 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_66 2024-09-12T00:30:20.091 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_67 2024-09-12T00:30:20.091 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_68 2024-09-12T00:30:20.091 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_69 2024-09-12T00:30:20.091 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_70 2024-09-12T00:30:20.091 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_71 2024-09-12T00:30:20.091 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_72 2024-09-12T00:30:20.091 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_73 2024-09-12T00:30:20.091 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_74 2024-09-12T00:30:20.091 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_75 2024-09-12T00:30:20.092 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_76 2024-09-12T00:30:20.092 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_77 2024-09-12T00:30:20.092 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_78 2024-09-12T00:30:20.092 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_79 2024-09-12T00:30:20.092 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_80 2024-09-12T00:30:20.092 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_81 2024-09-12T00:30:20.092 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_82 2024-09-12T00:30:20.092 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_83 2024-09-12T00:30:20.092 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_84 2024-09-12T00:30:20.092 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_85 2024-09-12T00:30:20.093 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_86 2024-09-12T00:30:20.093 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_87 2024-09-12T00:30:20.093 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_88 2024-09-12T00:30:20.093 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_89 2024-09-12T00:30:20.093 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_90 2024-09-12T00:30:20.093 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_91 2024-09-12T00:30:20.093 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_92 2024-09-12T00:30:20.093 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_93 2024-09-12T00:30:20.093 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_94 2024-09-12T00:30:20.093 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_95 2024-09-12T00:30:20.093 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_96 2024-09-12T00:30:20.093 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_97 2024-09-12T00:30:20.093 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_98 2024-09-12T00:30:20.094 INFO:tasks.workunit.client.0.smithi043.stdout:created: dmarker:f_99 2024-09-12T00:30:20.094 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (1438 ms) 2024-09-12T00:30:20.094 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:30:20.094 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-12T00:30:20.095 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-12T00:30:20.095 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:30:20.095 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:30:20.095 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:30:20.095 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:30:20.095 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:30:20.095 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:30:20.095 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:30:20.095 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:30:20.095 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:30:20.095 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:30:20.096 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:30:20.096 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:30:20.096 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:30:20.096 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:30:20.096 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:30:20.096 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:30:20.096 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:30:20.096 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:30:20.096 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:30:20.097 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:30:20.097 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:30:20.097 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:30:20.097 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:30:20.097 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:30:20.097 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:30:20.097 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:30:20.097 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:30:20.097 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:30:20.097 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:30:20.097 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:30:20.098 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:30:20.098 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:30:20.098 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:30:20.098 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:30:20.098 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:30:20.098 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:30:20.098 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:30:20.098 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:30:20.098 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:30:20.098 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:30:20.098 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:30:20.098 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:30:20.098 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:30:20.099 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:30:20.099 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:30:20.099 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:30:20.099 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:30:20.099 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:30:20.099 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:30:20.099 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:30:20.099 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:30:20.099 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:30:20.099 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:30:20.099 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:30:20.100 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:30:20.100 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:30:20.100 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:30:20.100 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:30:20.100 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:30:20.100 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:30:20.100 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:30:20.100 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:30:20.100 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:30:20.100 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:30:20.100 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:30:20.100 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:30:20.100 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:30:20.101 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:30:20.101 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:30:20.101 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:30:20.101 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:30:20.101 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:30:20.101 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:30:20.101 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:30:20.101 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:30:20.101 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:30:20.101 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:30:20.101 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:30:20.101 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:30:20.102 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:30:20.102 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:30:20.102 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:30:20.102 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:30:20.102 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:30:20.102 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:30:20.102 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:30:20.102 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:30:20.102 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:30:20.102 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:30:20.102 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:30:20.102 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:30:20.102 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:30:20.103 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:30:20.103 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:30:20.103 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:30:20.103 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:30:20.103 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:30:20.103 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:30:20.103 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:30:20.103 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:30:20.103 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MARKER1_READDIR (7 ms) 2024-09-12T00:30:20.103 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T00:30:20.104 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:30:20.104 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:30:20.104 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:30:20.104 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:30:20.104 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:30:20.105 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:30:20.105 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:30:20.105 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:30:20.105 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:30:20.105 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:30:20.105 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:30:20.105 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:30:20.105 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:30:20.105 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:30:20.106 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:30:20.106 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:30:20.106 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:30:20.106 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:30:20.106 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:30:20.106 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:30:20.106 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:30:20.106 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:30:20.106 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:30:20.106 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:30:20.106 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:30:20.106 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:30:20.106 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:30:20.107 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:30:20.107 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:30:20.107 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:30:20.107 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:30:20.107 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:30:20.107 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:30:20.107 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:30:20.107 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:30:20.107 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:30:20.107 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:30:20.108 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:30:20.108 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:30:20.108 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:30:20.108 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:30:20.108 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:30:20.108 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:30:20.108 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:30:20.108 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:30:20.108 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:30:20.109 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:30:20.109 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:30:20.109 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:30:20.109 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:30:20.109 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:30:20.109 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:30:20.109 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:30:20.109 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:30:20.109 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:30:20.109 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:30:20.109 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:30:20.110 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:30:20.110 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:30:20.110 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:30:20.110 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:30:20.110 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:30:20.110 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:30:20.110 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:30:20.110 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:30:20.110 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:30:20.110 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:30:20.110 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:30:20.110 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:30:20.111 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:30:20.111 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:30:20.111 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:30:20.111 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:30:20.111 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:30:20.111 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:30:20.111 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:30:20.111 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:30:20.111 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:30:20.111 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:30:20.111 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:30:20.111 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:30:20.111 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:30:20.112 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:30:20.112 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:30:20.112 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:30:20.112 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:30:20.112 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:30:20.112 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:30:20.112 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:30:20.112 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:30:20.112 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:30:20.112 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:30:20.112 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:30:20.112 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:30:20.112 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:30:20.113 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:30:20.113 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:30:20.113 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:30:20.113 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:30:20.113 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:30:20.113 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MARKER2_READDIR (7 ms) 2024-09-12T00:30:20.113 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:30:20.113 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:30:20.113 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:30:20.113 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:30:20.113 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:30:20.113 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:30:20.113 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:30:20.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:30:20.095+0000 7f989dae8a80 -1 shutting down 2024-09-12T00:30:20.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:30:20.099+0000 7f977783a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60021, si_uid : 1000, si_addr0x3e80000ea75, si_status0 2024-09-12T00:30:48.734 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.SHUTDOWN (28637 ms) 2024-09-12T00:30:48.734 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 11 tests from LibRGW (30427 ms total) 2024-09-12T00:30:48.734 INFO:tasks.workunit.client.0.smithi043.stdout: 2024-09-12T00:30:48.734 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment tear-down 2024-09-12T00:30:48.734 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] 11 tests from 1 test suite ran. (30427 ms total) 2024-09-12T00:30:48.734 INFO:tasks.workunit.client.0.smithi043.stdout:[ PASSED ] 11 tests. 2024-09-12T00:30:48.749 INFO:tasks.workunit.client.0.smithi043.stdout:phase 4.2 2024-09-12T00:30:48.773 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:30:48.773 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment set-up. 2024-09-12T00:30:48.773 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 11 tests from LibRGW 2024-09-12T00:30:48.773 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T00:30:48.774 INFO:tasks.workunit.client.0.smithi043.stdout:read i1: 64001 2024-09-12T00:30:48.774 INFO:tasks.workunit.client.0.smithi043.stdout:read s1: blunderbuss 2024-09-12T00:30:48.774 INFO:tasks.workunit.client.0.smithi043.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T00:30:48.774 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:30:48.784 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:48.784 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:49.333 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.INIT (560 ms) 2024-09-12T00:30:49.333 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:30:49.334 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:30:49.335 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:30:49.353 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (19 ms) 2024-09-12T00:30:49.353 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:30:49.353 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:30:49.353 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:30:49.353 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:30:49.353 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T00:30:49.357 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:30:49.357 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:30:49.357 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:30:49.357 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:30:49.357 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:30:49.357 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:30:49.357 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:30:49.357 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:30:49.357 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:30:49.357 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:30:49.357 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:30:49.358 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:30:49.358 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:30:49.358 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:30:49.358 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:30:49.358 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:30:49.358 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:30:49.358 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:30:49.358 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:30:49.358 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:30:49.358 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:30:49.358 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:30:49.358 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:30:49.358 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:30:49.359 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:30:49.359 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:30:49.359 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:30:49.359 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:30:49.359 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:30:49.359 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:30:49.359 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:30:49.359 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:30:49.359 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:30:49.359 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:30:49.360 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:30:49.360 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:30:49.360 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:30:49.360 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:30:49.360 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:30:49.360 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:30:49.360 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:30:49.360 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:30:49.360 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:30:49.360 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:30:49.360 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:30:49.360 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:30:49.360 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:30:49.361 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:30:49.361 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:30:49.361 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:30:49.361 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:30:49.361 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:30:49.361 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:30:49.361 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:30:49.361 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:30:49.361 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:30:49.361 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:30:49.361 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:30:49.361 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:30:49.362 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:30:49.362 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:30:49.362 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:30:49.362 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:30:49.362 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:30:49.362 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:30:49.362 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:30:49.362 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:30:49.362 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:30:49.362 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:30:49.362 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:30:49.362 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:30:49.362 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:30:49.363 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:30:49.363 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:30:49.363 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:30:49.363 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:30:49.363 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:30:49.363 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:30:49.363 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:30:49.363 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:30:49.363 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:30:49.363 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:30:49.363 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:30:49.363 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:30:49.363 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:30:49.364 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:30:49.364 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:30:49.364 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:30:49.364 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:30:49.364 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:30:49.364 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:30:49.364 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:30:49.364 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:30:49.364 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:30:49.364 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:30:49.364 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:30:49.364 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:30:49.364 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:30:49.365 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:30:49.365 INFO:tasks.workunit.client.0.smithi043.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:30:49.365 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MARKER2_READDIR (3 ms) 2024-09-12T00:30:49.365 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:30:49.365 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:30:49.365 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:30:49.365 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:30:49.365 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:30:49.365 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:30:49.365 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:30:49.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:30:49.355+0000 7f01291aca80 -1 shutting down 2024-09-12T00:30:49.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:30:49.359+0000 7f0002efe640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60666, si_uid : 1000, si_addr0x3e80000ecfa, si_status0 2024-09-12T00:31:19.457 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.SHUTDOWN (30100 ms) 2024-09-12T00:31:19.457 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 11 tests from LibRGW (30683 ms total) 2024-09-12T00:31:19.457 INFO:tasks.workunit.client.0.smithi043.stdout: 2024-09-12T00:31:19.457 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment tear-down 2024-09-12T00:31:19.458 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] 11 tests from 1 test suite ran. (30683 ms total) 2024-09-12T00:31:19.458 INFO:tasks.workunit.client.0.smithi043.stdout:[ PASSED ] 11 tests. 2024-09-12T00:31:19.468 INFO:tasks.workunit.client.0.smithi043.stdout:phase 5.1 2024-09-12T00:31:19.504 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:31:19.504 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment set-up. 2024-09-12T00:31:19.504 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 19 tests from LibRGW 2024-09-12T00:31:19.504 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:31:19.516 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:19.516 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:20.060 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.INIT (556 ms) 2024-09-12T00:31:20.060 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:31:20.061 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:31:20.061 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:31:20.077 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.CREATE_BUCKET (16 ms) 2024-09-12T00:31:20.077 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:31:20.082 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-12T00:31:20.083 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T00:31:20.083 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T00:31:20.083 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:31:20.086 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-12T00:31:20.086 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T00:31:20.086 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T00:31:20.086 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T00:31:20.095 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.PUT_OBJECT (9 ms) 2024-09-12T00:31:20.095 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T00:31:20.098 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.GET_OBJECT (2 ms) 2024-09-12T00:31:20.098 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:31:20.098 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:31:20.098 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T00:31:20.098 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T00:31:20.098 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T00:31:20.098 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T00:31:20.098 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.READV 2024-09-12T00:31:20.098 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T00:31:20.099 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T00:31:20.099 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T00:31:20.099 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:31:20.099 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T00:31:20.099 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:31:20.099 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:31:20.099 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:31:20.099 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:31:20.099 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:31:20.099 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:31:20.099 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:31:20.099 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:31:20.099+0000 7f92d8587a80 -1 shutting down 2024-09-12T00:31:20.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:31:20.099+0000 7f91b22d9640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61311, si_uid : 1000, si_addr0x3e80000ef7f, si_status0 2024-09-12T00:31:50.101 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.SHUTDOWN (30002 ms) 2024-09-12T00:31:50.101 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 19 tests from LibRGW (30596 ms total) 2024-09-12T00:31:50.101 INFO:tasks.workunit.client.0.smithi043.stdout: 2024-09-12T00:31:50.102 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment tear-down 2024-09-12T00:31:50.102 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] 19 tests from 1 test suite ran. (30596 ms total) 2024-09-12T00:31:50.102 INFO:tasks.workunit.client.0.smithi043.stdout:[ PASSED ] 19 tests. 2024-09-12T00:31:50.111 INFO:tasks.workunit.client.0.smithi043.stdout:phase 5.2 2024-09-12T00:31:50.145 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:31:50.146 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment set-up. 2024-09-12T00:31:50.146 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 19 tests from LibRGW 2024-09-12T00:31:50.146 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:31:50.154 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:50.155 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:50.698 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.INIT (552 ms) 2024-09-12T00:31:50.699 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:31:50.699 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:31:50.699 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:31:50.700 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:31:50.700 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:31:50.709 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (9 ms) 2024-09-12T00:31:50.709 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T00:31:50.709 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T00:31:50.709 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:31:50.709 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-12T00:31:50.709 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T00:31:50.709 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T00:31:50.709 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T00:31:50.710 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-12T00:31:50.710 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T00:31:50.710 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-12T00:31:50.710 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:31:50.710 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:31:50.710 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T00:31:50.710 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T00:31:50.710 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T00:31:50.710 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T00:31:50.710 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.READV 2024-09-12T00:31:50.710 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T00:31:50.711 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T00:31:50.711 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T00:31:50.711 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:31:50.719 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.DELETE_OBJECT (11 ms) 2024-09-12T00:31:50.719 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:31:50.779 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.DELETE_BUCKET (59 ms) 2024-09-12T00:31:50.779 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:31:50.779 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:31:50.779 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:31:50.779 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:31:50.779 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:31:50.779 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:31:50.778+0000 7f1bd106ca80 -1 shutting down 2024-09-12T00:31:50.781 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:31:50.782+0000 7f1aaadbe640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61956, si_uid : 1000, si_addr0x3e80000f204, si_status0 2024-09-12T00:32:20.992 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.SHUTDOWN (30214 ms) 2024-09-12T00:32:20.993 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 19 tests from LibRGW (30846 ms total) 2024-09-12T00:32:20.993 INFO:tasks.workunit.client.0.smithi043.stdout: 2024-09-12T00:32:20.993 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment tear-down 2024-09-12T00:32:20.993 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] 19 tests from 1 test suite ran. (30846 ms total) 2024-09-12T00:32:20.993 INFO:tasks.workunit.client.0.smithi043.stdout:[ PASSED ] 19 tests. 2024-09-12T00:32:21.006 INFO:tasks.workunit.client.0.smithi043.stdout:phase 6.1 2024-09-12T00:32:21.030 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T00:32:21.030 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment set-up. 2024-09-12T00:32:21.030 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 10 tests from LibRGW 2024-09-12T00:32:21.030 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:32:21.040 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:21.040 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:21.329 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.INIT (299 ms) 2024-09-12T00:32:21.329 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:32:21.330 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:32:21.330 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-12T00:32:21.360 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.CREATE_BUCKETS (30 ms) 2024-09-12T00:32:21.360 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-12T00:32:21.369 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (9 ms) 2024-09-12T00:32:21.369 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-12T00:32:21.400 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.TOPDIR_RENAME (31 ms) 2024-09-12T00:32:21.400 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-12T00:32:21.444 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.SUBDIR_RENAME (44 ms) 2024-09-12T00:32:21.444 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-12T00:32:21.490 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (46 ms) 2024-09-12T00:32:21.491 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:32:21.491 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:32:21.491 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:32:21.491 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:32:21.491 INFO:tasks.workunit.client.0.smithi043.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:32:21.491 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:21.490+0000 7fe17f79fa80 -1 shutting down 2024-09-12T00:32:21.493 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:21.494+0000 7fe0594f1640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62601, si_uid : 1000, si_addr0x3e80000f489, si_status0 2024-09-12T00:32:51.542 INFO:tasks.workunit.client.0.smithi043.stdout:[ OK ] LibRGW.SHUTDOWN (30051 ms) 2024-09-12T00:32:51.542 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] 10 tests from LibRGW (30511 ms total) 2024-09-12T00:32:51.542 INFO:tasks.workunit.client.0.smithi043.stdout: 2024-09-12T00:32:51.542 INFO:tasks.workunit.client.0.smithi043.stdout:[----------] Global test environment tear-down 2024-09-12T00:32:51.542 INFO:tasks.workunit.client.0.smithi043.stdout:[==========] 10 tests from 1 test suite ran. (30511 ms total) 2024-09-12T00:32:51.542 INFO:tasks.workunit.client.0.smithi043.stdout:[ PASSED ] 10 tests. 2024-09-12T00:32:51.557 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:32:51.557 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:32:51.574 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-12T00:32:51.575 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-12T00:32:51.575 DEBUG:teuthology.orchestra.run.smithi043:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-12T00:32:51.626 INFO:tasks.workunit.client.0.smithi043.stderr:+ [ -z ] 2024-09-12T00:32:51.626 INFO:tasks.workunit.client.0.smithi043.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:32:51.626 INFO:tasks.workunit.client.0.smithi043.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:32:51.626 INFO:tasks.workunit.client.0.smithi043.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name maven test user --email sigv4@example.com 2024-09-12T00:32:51.668 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:51.668 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:51.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.713+0000 7f15627be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:51.715 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.713+0000 7f15627be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:51.715 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.713+0000 7f15627be9c0 20 realm 2024-09-12T00:32:51.715 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.713+0000 7f15627be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:51.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.713+0000 7f15627be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:51.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.713+0000 7f15627be9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:51.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.713+0000 7f15627be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:51.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.713+0000 7f15627be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:51.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.713+0000 7f15627be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:51.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.717+0000 7f15627be9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:51.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.717+0000 7f15627be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:51.718 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.717+0000 7f15627be9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:51.718 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.717+0000 7f15627be9c0 20 searching for the correct realm 2024-09-12T00:32:51.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.721+0000 7f15602c4640 0 -- 172.21.15.43:0/1697600220 >> [v2:172.21.15.97:6816/489545787,v1:172.21.15.97:6817/489545787] conn(0x7f15580fbb40 msgr2=0x7f15580fa5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:51.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.729+0000 7f15602c4640 0 -- 172.21.15.43:0/1697600220 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f1554008430 msgr2=0x7f15540088b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:51.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.945+0000 7f15627be9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:32:51.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.945+0000 7f15627be9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:51.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.945+0000 7f15627be9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:51.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.945+0000 7f15627be9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:32:51.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.945+0000 7f15627be9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:51.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.945+0000 7f15627be9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:51.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.945+0000 7f15627be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:51.949 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.945+0000 7f15627be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:51.949 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.945+0000 7f15627be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:51.949 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.949+0000 7f15627be9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:51.949 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.949+0000 7f15627be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:51.950 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.949+0000 7f15627be9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:51.950 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.949+0000 7f15627be9c0 20 zone default found 2024-09-12T00:32:51.950 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.949+0000 7f15627be9c0 4 Realm: () 2024-09-12T00:32:51.950 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.949+0000 7f15627be9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:32:51.950 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.949+0000 7f15627be9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:32:51.950 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.949+0000 7f15627be9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:51.951 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.949+0000 7f15627be9c0 20 zonegroup default 2024-09-12T00:32:51.951 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.949+0000 7f15627be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:51.951 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.949+0000 7f15627be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:51.951 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.949+0000 7f15627be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:51.952 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.949+0000 7f15627be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:51.952 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.949+0000 7f15627be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:51.952 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.949+0000 7f15627be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:51.952 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.949+0000 7f15627be9c0 20 started sync module instance, tier type = 2024-09-12T00:32:51.952 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.953+0000 7f15627be9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:32:51.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.973+0000 7f15627be9c0 20 add_watcher() i=0 2024-09-12T00:32:51.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.977+0000 7f15627be9c0 20 add_watcher() i=1 2024-09-12T00:32:51.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.977+0000 7f15627be9c0 20 add_watcher() i=2 2024-09-12T00:32:51.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.977+0000 7f15627be9c0 20 add_watcher() i=3 2024-09-12T00:32:51.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.977+0000 7f15627be9c0 20 add_watcher() i=4 2024-09-12T00:32:51.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.977+0000 7f15627be9c0 20 add_watcher() i=5 2024-09-12T00:32:51.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.977+0000 7f15627be9c0 20 add_watcher() i=6 2024-09-12T00:32:51.979 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.977+0000 7f15627be9c0 20 add_watcher() i=7 2024-09-12T00:32:51.979 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.977+0000 7f15627be9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:51.983 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.981+0000 7f14167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:51.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.981+0000 7f15627be9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:51.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.981+0000 7f15627be9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:51.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.981+0000 7f15627be9c0 5 note: GC not initialized 2024-09-12T00:32:51.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.985+0000 7f14157e2640 20 reqs_thread_entry: start 2024-09-12T00:32:51.985 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.985+0000 7f15627be9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:32:51.985 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.985+0000 7f15627be9c0 20 Filter name: none 2024-09-12T00:32:51.986 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.985+0000 7f1386ffd640 20 reqs_thread_entry: start 2024-09-12T00:32:51.986 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.985+0000 7f15627be9c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-12T00:32:51.986 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.985+0000 7f15627be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:51.987 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.985+0000 7f15627be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:51.987 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.985+0000 7f15627be9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-12T00:32:51.987 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.985+0000 7f15627be9c0 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:32:51.987 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.985+0000 7f15627be9c0 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-12T00:32:51.987 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.985+0000 7f15627be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:51.987 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.985+0000 7f15627be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:51.987 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.985+0000 7f15627be9c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-12T00:32:51.987 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.985+0000 7f15627be9c0 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:32:51.987 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.985+0000 7f15627be9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-12T00:32:51.987 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.985+0000 7f15627be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:51.988 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.985+0000 7f15627be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:51.988 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.985+0000 7f15627be9c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-12T00:32:51.988 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.985+0000 7f15627be9c0 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:32:51.988 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.985+0000 7f15627be9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T00:32:51.988 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.985+0000 7f15627be9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T00:32:51.989 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.989+0000 7f15627be9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T00:32:51.989 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.989+0000 7f15627be9c0 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:32:51.989 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.989+0000 7f15627be9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-12T00:32:51.990 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.989+0000 7f143f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693197 cookie 94215457920352 notifier 5733 bl.length()=677 2024-09-12T00:32:51.990 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.989+0000 7f143f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T00:32:51.990 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.989+0000 7f143f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:32:51.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.993+0000 7f15627be9c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T00:32:51.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.993+0000 7f15627be9c0 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:32:51.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.993+0000 7f15627be9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-12T00:32:51.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.993+0000 7f143f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693238 cookie 94215457909680 notifier 5733 bl.length()=187 2024-09-12T00:32:51.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.993+0000 7f143f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T00:32:51.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.993+0000 7f143f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:32:51.998 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.997+0000 7f15627be9c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T00:32:51.998 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.997+0000 7f15627be9c0 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:32:51.998 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.997+0000 7f15627be9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-12T00:32:51.999 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.997+0000 7f143f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693239 cookie 94215457909680 notifier 5733 bl.length()=197 2024-09-12T00:32:51.999 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.997+0000 7f143f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T00:32:51.999 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:51.997+0000 7f143f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:32:52.000 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:32:52.000 INFO:tasks.workunit.client.0.smithi043.stdout: "user_id": "ceph-test-maven", 2024-09-12T00:32:52.000 INFO:tasks.workunit.client.0.smithi043.stdout: "display_name": "maven test user", 2024-09-12T00:32:52.000 INFO:tasks.workunit.client.0.smithi043.stdout: "email": "sigv4@example.com", 2024-09-12T00:32:52.000 INFO:tasks.workunit.client.0.smithi043.stdout: "suspended": 0, 2024-09-12T00:32:52.001 INFO:tasks.workunit.client.0.smithi043.stdout: "max_buckets": 1000, 2024-09-12T00:32:52.001 INFO:tasks.workunit.client.0.smithi043.stdout: "subusers": [], 2024-09-12T00:32:52.001 INFO:tasks.workunit.client.0.smithi043.stdout: "keys": [ 2024-09-12T00:32:52.001 INFO:tasks.workunit.client.0.smithi043.stdout: { 2024-09-12T00:32:52.001 INFO:tasks.workunit.client.0.smithi043.stdout: "user": "ceph-test-maven", 2024-09-12T00:32:52.001 INFO:tasks.workunit.client.0.smithi043.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-12T00:32:52.001 INFO:tasks.workunit.client.0.smithi043.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-12T00:32:52.001 INFO:tasks.workunit.client.0.smithi043.stdout: "active": true, 2024-09-12T00:32:52.001 INFO:tasks.workunit.client.0.smithi043.stdout: "create_date": "2024-09-12T00:32:51.991732Z" 2024-09-12T00:32:52.001 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:32:52.001 INFO:tasks.workunit.client.0.smithi043.stdout: ], 2024-09-12T00:32:52.001 INFO:tasks.workunit.client.0.smithi043.stdout: "swift_keys": [], 2024-09-12T00:32:52.002 INFO:tasks.workunit.client.0.smithi043.stdout: "caps": [], 2024-09-12T00:32:52.002 INFO:tasks.workunit.client.0.smithi043.stdout: "op_mask": "read, write, delete", 2024-09-12T00:32:52.002 INFO:tasks.workunit.client.0.smithi043.stdout: "default_placement": "", 2024-09-12T00:32:52.002 INFO:tasks.workunit.client.0.smithi043.stdout: "default_storage_class": "", 2024-09-12T00:32:52.002 INFO:tasks.workunit.client.0.smithi043.stdout: "placement_tags": [], 2024-09-12T00:32:52.002 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_quota": { 2024-09-12T00:32:52.002 INFO:tasks.workunit.client.0.smithi043.stdout: "enabled": false, 2024-09-12T00:32:52.002 INFO:tasks.workunit.client.0.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:32:52.002 INFO:tasks.workunit.client.0.smithi043.stdout: "max_size": -1, 2024-09-12T00:32:52.002 INFO:tasks.workunit.client.0.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:32:52.002 INFO:tasks.workunit.client.0.smithi043.stdout: "max_objects": -1 2024-09-12T00:32:52.002 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:32:52.002 INFO:tasks.workunit.client.0.smithi043.stdout: "user_quota": { 2024-09-12T00:32:52.002 INFO:tasks.workunit.client.0.smithi043.stdout: "enabled": false, 2024-09-12T00:32:52.003 INFO:tasks.workunit.client.0.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:32:52.003 INFO:tasks.workunit.client.0.smithi043.stdout: "max_size": -1, 2024-09-12T00:32:52.003 INFO:tasks.workunit.client.0.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:32:52.003 INFO:tasks.workunit.client.0.smithi043.stdout: "max_objects": -1 2024-09-12T00:32:52.003 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:32:52.003 INFO:tasks.workunit.client.0.smithi043.stdout: "temp_url_keys": [], 2024-09-12T00:32:52.003 INFO:tasks.workunit.client.0.smithi043.stdout: "type": "rgw", 2024-09-12T00:32:52.003 INFO:tasks.workunit.client.0.smithi043.stdout: "mfa_ids": [], 2024-09-12T00:32:52.003 INFO:tasks.workunit.client.0.smithi043.stdout: "account_id": "", 2024-09-12T00:32:52.003 INFO:tasks.workunit.client.0.smithi043.stdout: "path": "/", 2024-09-12T00:32:52.003 INFO:tasks.workunit.client.0.smithi043.stdout: "create_date": "2024-09-12T00:32:51.991684Z", 2024-09-12T00:32:52.003 INFO:tasks.workunit.client.0.smithi043.stdout: "tags": [], 2024-09-12T00:32:52.003 INFO:tasks.workunit.client.0.smithi043.stdout: "group_ids": [] 2024-09-12T00:32:52.003 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:32:52.004 INFO:tasks.workunit.client.0.smithi043.stdout: 2024-09-12T00:32:52.004 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:52.001+0000 7f14167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:52.006 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:52.005+0000 7f15627be9c0 20 remove_watcher() i=0 2024-09-12T00:32:52.006 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:52.005+0000 7f15627be9c0 2 removed watcher, disabling cache 2024-09-12T00:32:52.009 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:52.009+0000 7f15627be9c0 20 remove_watcher() i=1 2024-09-12T00:32:52.011 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:52.009+0000 7f15627be9c0 20 remove_watcher() i=2 2024-09-12T00:32:52.014 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:52.013+0000 7f15627be9c0 20 remove_watcher() i=3 2024-09-12T00:32:52.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:52.013+0000 7f15627be9c0 20 remove_watcher() i=4 2024-09-12T00:32:52.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:52.017+0000 7f15627be9c0 20 remove_watcher() i=5 2024-09-12T00:32:52.019 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:52.017+0000 7f15627be9c0 20 remove_watcher() i=6 2024-09-12T00:32:52.020 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:32:52.021+0000 7f15627be9c0 20 remove_watcher() i=7 2024-09-12T00:32:52.041 INFO:tasks.workunit.client.0.smithi043.stderr:+ [ -z ] 2024-09-12T00:32:52.041 INFO:tasks.workunit.client.0.smithi043.stderr:+ [ -z /home/ubuntu/cephtest ] 2024-09-12T00:32:52.041 INFO:tasks.workunit.client.0.smithi043.stderr:+ cat /home/ubuntu/cephtest/url_file 2024-09-12T00:32:52.042 INFO:tasks.workunit.client.0.smithi043.stderr:+ export RGW_HTTP_ENDPOINT_URL=https://smithi043.front.sepia.ceph.com:443 2024-09-12T00:32:52.042 INFO:tasks.workunit.client.0.smithi043.stderr:+ [ -z /home/ubuntu/cephtest/clone.client.0 ] 2024-09-12T00:32:52.042 INFO:tasks.workunit.client.0.smithi043.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-12T00:32:52.042 INFO:tasks.workunit.client.0.smithi043.stderr:+ ./mvnw clean package 2024-09-12T00:32:52.050 INFO:tasks.workunit.client.0.smithi043.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T00:32:54.650 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] Scanning for projects... 2024-09-12T00:32:54.799 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-12T00:32:54.913 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 48 kB/s) 2024-09-12T00:32:54.940 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-12T00:32:54.977 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 18/83 kB Progress (1): 19/83 kB Progress (1): 21/83 kB Progress (1): 22/83 kB Progress (1): 23/83 kB Progress (1): 25/83 kB Progress (1): 26/83 kB Progress (1): 27/83 kB Progress (1): 29/83 kB Progress (1): 30/83 kB Progress (1): 32/83 kB Progress (1): 33/83 kB Progress (1): 34/83 kB Progress (1): 36/83 kB Progress (1): 37/83 kB Progress (1): 38/83 kB Progress (1): 40/83 kB Progress (1): 41/83 kB Progress (1): 43/83 kB Progress (1): 44/83 kB Progress (1): 45/83 kB Progress (1): 47/83 kB Progress (1): 48/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.2 MB/s) 2024-09-12T00:32:54.986 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-12T00:32:55.011 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 15/77 kB Progress (1): 31/77 kB Progress (1): 48/77 kB Progress (1): 64/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.1 MB/s) 2024-09-12T00:32:55.044 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] 2024-09-12T00:32:55.044 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T00:32:55.044 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] Building jcksum 1.0 2024-09-12T00:32:55.044 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] from pom.xml 2024-09-12T00:32:55.044 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T00:32:55.048 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-12T00:32:55.066 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 295 kB/s) 2024-09-12T00:32:55.075 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-12T00:32:55.096 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 472 kB/s) 2024-09-12T00:32:55.101 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-12T00:32:55.130 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 1.6 MB/s) 2024-09-12T00:32:55.138 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-12T00:32:55.155 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.1 MB/s) 2024-09-12T00:32:55.173 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-12T00:32:55.208 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/36 kB Progress (1): 32/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 1.0 MB/s) 2024-09-12T00:32:55.219 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-12T00:32:55.255 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 227 kB/s) 2024-09-12T00:32:55.260 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-12T00:32:55.292 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 253 kB/s) 2024-09-12T00:32:55.298 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-12T00:32:55.325 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/48 kB Progress (1): 32/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 1.8 MB/s) 2024-09-12T00:32:55.338 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-12T00:32:55.359 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 987 kB/s) 2024-09-12T00:32:55.371 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-12T00:32:55.397 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.2 MB/s) 2024-09-12T00:32:55.406 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-12T00:32:55.426 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 467 kB/s) 2024-09-12T00:32:55.439 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-12T00:32:55.466 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/66 kB Progress (1): 32/66 kB Progress (1): 49/66 kB Progress (1): 65/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 2.4 MB/s) 2024-09-12T00:32:55.483 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-12T00:32:55.503 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 253 kB/s) 2024-09-12T00:32:55.508 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-12T00:32:55.530 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 997 kB/s) 2024-09-12T00:32:55.536 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-12T00:32:55.557 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 15/50 kB Progress (1): 31/50 kB Progress (1): 48/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.4 MB/s) 2024-09-12T00:32:55.568 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-12T00:32:55.592 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 980 kB/s) 2024-09-12T00:32:55.605 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-12T00:32:55.625 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 282 kB/s) 2024-09-12T00:32:55.632 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-12T00:32:55.669 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 1.2 MB/s) 2024-09-12T00:32:55.681 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-12T00:32:55.706 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 307 kB/s) 2024-09-12T00:32:55.708 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-12T00:32:55.728 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 495 kB/s) 2024-09-12T00:32:55.734 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-12T00:32:55.754 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 15/46 kB Progress (1): 31/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.3 MB/s) 2024-09-12T00:32:55.762 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-12T00:32:55.780 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.1 MB/s) 2024-09-12T00:32:55.789 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-12T00:32:55.810 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.2 MB/s) 2024-09-12T00:32:55.846 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-12T00:32:55.865 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 320 kB/s) 2024-09-12T00:32:55.871 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-12T00:32:55.894 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 888 kB/s) 2024-09-12T00:32:55.904 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-12T00:32:55.921 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.1 MB/s) 2024-09-12T00:32:55.937 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-12T00:32:55.956 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 211 kB/s) 2024-09-12T00:32:55.960 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-12T00:32:55.977 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 91 kB/s) 2024-09-12T00:32:55.980 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-12T00:32:55.996 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 139 kB/s) 2024-09-12T00:32:56.005 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-12T00:32:56.029 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 152 kB/s) 2024-09-12T00:32:56.036 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-12T00:32:56.055 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 170 kB/s) 2024-09-12T00:32:56.062 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-12T00:32:56.084 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 522 kB/s) 2024-09-12T00:32:56.092 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-12T00:32:56.111 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 89 kB/s) 2024-09-12T00:32:56.120 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-12T00:32:56.138 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 212 kB/s) 2024-09-12T00:32:56.147 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-12T00:32:56.164 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 289 kB/s) 2024-09-12T00:32:56.172 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-12T00:32:56.190 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 64 kB/s) 2024-09-12T00:32:56.194 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-12T00:32:56.214 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 192 kB/s) 2024-09-12T00:32:56.219 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-12T00:32:56.236 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 767 kB/s) 2024-09-12T00:32:56.243 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-12T00:32:56.270 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 131 kB/s) 2024-09-12T00:32:56.281 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-12T00:32:56.320 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 64 kB/s) 2024-09-12T00:32:56.328 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-12T00:32:56.349 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 139 kB/s) 2024-09-12T00:32:56.360 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-12T00:32:56.380 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 353 kB/s) 2024-09-12T00:32:56.390 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-12T00:32:56.410 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 273 kB/s) 2024-09-12T00:32:56.420 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-12T00:32:56.438 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 194 kB/s) 2024-09-12T00:32:56.449 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-12T00:32:56.468 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 231 kB/s) 2024-09-12T00:32:56.472 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-12T00:32:56.491 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 127 kB/s) 2024-09-12T00:32:56.499 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-12T00:32:56.518 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 358 kB/s) 2024-09-12T00:32:56.528 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-12T00:32:56.548 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 319 kB/s) 2024-09-12T00:32:56.556 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-12T00:32:56.573 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 165 kB/s) 2024-09-12T00:32:56.582 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-12T00:32:56.601 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 183 kB/s) 2024-09-12T00:32:56.611 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-12T00:32:56.629 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 227 kB/s) 2024-09-12T00:32:56.634 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-12T00:32:56.651 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 105 kB/s) 2024-09-12T00:32:56.662 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-12T00:32:56.679 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 389 kB/s) 2024-09-12T00:32:56.684 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-12T00:32:56.701 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 910 kB/s) 2024-09-12T00:32:56.707 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-12T00:32:56.726 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/35 kB Progress (1): 32/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 1.8 MB/s) 2024-09-12T00:32:56.734 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-12T00:32:56.751 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.0 MB/s) 2024-09-12T00:32:56.761 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-12T00:32:56.778 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 261 kB/s) 2024-09-12T00:32:56.785 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-12T00:32:56.803 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 732 kB/s) 2024-09-12T00:32:56.816 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-12T00:32:56.836 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 698 kB/s) 2024-09-12T00:32:56.844 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-12T00:32:56.866 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 37/68 kB Progress (1): 53/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.1 MB/s) 2024-09-12T00:32:56.906 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-12T00:32:56.925 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 825 kB/s) 2024-09-12T00:32:56.941 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-12T00:32:56.959 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 858 kB/s) 2024-09-12T00:32:56.964 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-12T00:32:56.985 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 3.8 MB/s) 2024-09-12T00:32:57.001 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-12T00:32:57.021 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 921 kB/s) 2024-09-12T00:32:57.032 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-12T00:32:57.052 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 951 kB/s) 2024-09-12T00:32:57.060 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-12T00:32:57.090 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 64/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 2.6 MB/s) 2024-09-12T00:32:57.112 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-12T00:32:57.139 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 132 kB/s) 2024-09-12T00:32:57.144 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-12T00:32:57.161 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 812 kB/s) 2024-09-12T00:32:57.167 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-12T00:32:57.184 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 189 kB/s) 2024-09-12T00:32:57.190 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-12T00:32:57.208 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 177 kB/s) 2024-09-12T00:32:57.214 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-12T00:32:57.232 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 113 kB/s) 2024-09-12T00:32:57.237 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-12T00:32:57.255 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 157 kB/s) 2024-09-12T00:32:57.262 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-12T00:32:57.280 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 85 kB/s) 2024-09-12T00:32:57.286 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-12T00:32:57.304 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 167 kB/s) 2024-09-12T00:32:57.312 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-12T00:32:57.331 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 169 kB/s) 2024-09-12T00:32:57.337 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-12T00:32:57.356 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 169 kB/s) 2024-09-12T00:32:57.364 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-12T00:32:57.384 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 51 kB/s) 2024-09-12T00:32:57.394 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-12T00:32:57.411 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 57 kB/s) 2024-09-12T00:32:57.419 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-12T00:32:57.436 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 180 kB/s) 2024-09-12T00:32:57.441 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-12T00:32:57.460 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 160 kB/s) 2024-09-12T00:32:57.466 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-12T00:32:57.507 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 84 kB/s) 2024-09-12T00:32:57.514 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-12T00:32:57.532 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 191 kB/s) 2024-09-12T00:32:57.539 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-12T00:32:57.558 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 159 kB/s) 2024-09-12T00:32:57.623 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-12T00:32:57.754 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 25 MB/s) 2024-09-12T00:32:57.756 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-12T00:32:57.756 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-12T00:32:57.757 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-12T00:32:57.757 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-12T00:32:57.757 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-12T00:32:57.789 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 1.1 MB/s) 2024-09-12T00:32:57.789 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-12T00:32:57.805 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 15/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 334 kB/s) 2024-09-12T00:32:57.805 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-12T00:32:57.833 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 1.4/49 kB Progress (1): 2.8/49 kB Progress (1): 4.1/49 kB Progress (1): 5.5/49 kB Progress (1): 6.9/49 kB Progress (1): 8.3/49 kB Progress (1): 9.7/49 kB Progress (1): 11/49 kB Progress (1): 12/49 kB Progress (1): 14/49 kB Progress (1): 15/49 kB Progress (1): 16/49 kB Progress (1): 18/49 kB Progress (1): 19/49 kB Progress (1): 21/49 kB Progress (2): 21/49 kB | 16/782 kB Progress (2): 22/49 kB | 16/782 kB Progress (2): 23/49 kB | 16/782 kB Progress (2): 23/49 kB | 33/782 kB Progress (2): 23/49 kB | 49/782 kB Progress (2): 25/49 kB | 49/782 kB Progress (2): 26/49 kB | 49/782 kB Progress (2): 26/49 kB | 65/782 kB Progress (2): 27/49 kB | 65/782 kB Progress (2): 27/49 kB | 82/782 kB Progress (2): 29/49 kB | 82/782 kB Progress (2): 29/49 kB | 98/782 kB Progress (3): 29/49 kB | 98/782 kB | 1.4/71 kB Progress (3): 30/49 kB | 98/782 kB | 1.4/71 kB Progress (3): 30/49 kB | 98/782 kB | 2.8/71 kB Progress (3): 32/49 kB | 98/782 kB | 2.8/71 kB Progress (3): 32/49 kB | 98/782 kB | 4.1/71 kB Progress (3): 32/49 kB | 115/782 kB | 4.1/71 kB Progress (3): 32/49 kB | 115/782 kB | 5.5/71 kB Progress (3): 32/49 kB | 115/782 kB | 6.9/71 kB Progress (3): 32/49 kB | 115/782 kB | 8.3/71 kB Progress (3): 32/49 kB | 131/782 kB | 8.3/71 kB Progress (3): 32/49 kB | 131/782 kB | 9.7/71 kB Progress (3): 32/49 kB | 131/782 kB | 11/71 kB Progress (3): 33/49 kB | 131/782 kB | 11/71 kB Progress (3): 33/49 kB | 147/782 kB | 11/71 kB Progress (3): 34/49 kB | 147/782 kB | 11/71 kB Progress (3): 34/49 kB | 147/782 kB | 12/71 kB Progress (3): 34/49 kB | 164/782 kB | 12/71 kB Progress (3): 34/49 kB | 164/782 kB | 14/71 kB Progress (3): 34/49 kB | 180/782 kB | 14/71 kB Progress (3): 34/49 kB | 180/782 kB | 15/71 kB Progress (3): 36/49 kB | 180/782 kB | 15/71 kB Progress (3): 37/49 kB | 180/782 kB | 15/71 kB Progress (3): 37/49 kB | 197/782 kB | 15/71 kB Progress (3): 37/49 kB | 213/782 kB | 15/71 kB Progress (3): 37/49 kB | 213/782 kB | 17/71 kB Progress (3): 37/49 kB | 213/782 kB | 18/71 kB Progress (3): 37/49 kB | 229/782 kB | 18/71 kB Progress (3): 38/49 kB | 229/782 kB | 18/71 kB Progress (3): 38/49 kB | 246/782 kB | 18/71 kB Progress (3): 38/49 kB | 262/782 kB | 18/71 kB Progress (3): 38/49 kB | 262/782 kB | 19/71 kB Progress (3): 38/49 kB | 262/782 kB | 21/71 kB Progress (3): 38/49 kB | 278/782 kB | 21/71 kB Progress (3): 38/49 kB | 295/782 kB | 21/71 kB Progress (3): 38/49 kB | 311/782 kB | 21/71 kB Progress (3): 38/49 kB | 311/782 kB | 22/71 kB Progress (3): 38/49 kB | 311/782 kB | 23/71 kB Progress (3): 38/49 kB | 328/782 kB | 23/71 kB Progress (4): 38/49 kB | 328/782 kB | 23/71 kB | 1.4/98 kB Progress (4): 38/49 kB | 344/782 kB | 23/71 kB | 1.4/98 kB Progress (4): 38/49 kB | 344/782 kB | 23/71 kB | 2.8/98 kB Progress (4): 38/49 kB | 344/782 kB | 23/71 kB | 4.1/98 kB Progress (4): 38/49 kB | 344/782 kB | 25/71 kB | 4.1/98 kB Progress (4): 38/49 kB | 344/782 kB | 25/71 kB | 5.5/98 kB Progress (4): 40/49 kB | 344/782 kB | 25/71 kB | 5.5/98 kB Progress (4): 40/49 kB | 344/782 kB | 25/71 kB | 6.9/98 kB Progress (5): 40/49 kB | 344/782 kB | 25/71 kB | 6.9/98 kB | 1.4/16 kB Progress (5): 40/49 kB | 360/782 kB | 25/71 kB | 6.9/98 kB | 1.4/16 kB Progress (5): 40/49 kB | 360/782 kB | 26/71 kB | 6.9/98 kB | 1.4/16 kB Progress (5): 40/49 kB | 360/782 kB | 26/71 kB | 6.9/98 kB | 2.8/16 kB Progress (5): 40/49 kB | 360/782 kB | 26/71 kB | 8.3/98 kB | 2.8/16 kB Progress (5): 40/49 kB | 360/782 kB | 26/71 kB | 8.3/98 kB | 4.1/16 kB Progress (5): 41/49 kB | 360/782 kB | 26/71 kB | 8.3/98 kB | 4.1/16 kB Progress (5): 41/49 kB | 360/782 kB | 28/71 kB | 8.3/98 kB | 4.1/16 kB Progress (5): 41/49 kB | 360/782 kB | 28/71 kB | 8.3/98 kB | 5.5/16 kB Progress (5): 41/49 kB | 377/782 kB | 28/71 kB | 8.3/98 kB | 5.5/16 kB Progress (5): 41/49 kB | 377/782 kB | 28/71 kB | 9.7/98 kB | 5.5/16 kB Progress (5): 41/49 kB | 377/782 kB | 28/71 kB | 9.7/98 kB | 6.9/16 kB Progress (5): 41/49 kB | 377/782 kB | 29/71 kB | 9.7/98 kB | 6.9/16 kB Progress (5): 43/49 kB | 377/782 kB | 29/71 kB | 9.7/98 kB | 6.9/16 kB Progress (5): 43/49 kB | 393/782 kB | 29/71 kB | 9.7/98 kB | 6.9/16 kB Progress (5): 43/49 kB | 393/782 kB | 29/71 kB | 9.7/98 kB | 8.3/16 kB Progress (5): 43/49 kB | 393/782 kB | 29/71 kB | 11/98 kB | 8.3/16 kB Progress (5): 43/49 kB | 393/782 kB | 29/71 kB | 11/98 kB | 9.7/16 kB Progress (5): 43/49 kB | 393/782 kB | 30/71 kB | 11/98 kB | 9.7/16 kB Progress (5): 43/49 kB | 410/782 kB | 30/71 kB | 11/98 kB | 9.7/16 kB Progress (5): 44/49 kB | 410/782 kB | 30/71 kB | 11/98 kB | 9.7/16 kB Progress (5): 44/49 kB | 410/782 kB | 32/71 kB | 11/98 kB | 9.7/16 kB Progress (5): 44/49 kB | 410/782 kB | 32/71 kB | 11/98 kB | 11/16 kB Progress (5): 44/49 kB | 410/782 kB | 32/71 kB | 12/98 kB | 11/16 kB Progress (5): 44/49 kB | 410/782 kB | 32/71 kB | 12/98 kB | 12/16 kB Progress (5): 45/49 kB | 410/782 kB | 32/71 kB | 12/98 kB | 12/16 kB Progress (5): 45/49 kB | 410/782 kB | 32/71 kB | 12/98 kB | 14/16 kB Progress (5): 47/49 kB | 410/782 kB | 32/71 kB | 12/98 kB | 14/16 kB Progress (5): 47/49 kB | 410/782 kB | 32/71 kB | 14/98 kB | 14/16 kB Progress (5): 47/49 kB | 426/782 kB | 32/71 kB | 14/98 kB | 14/16 kB Progress (5): 48/49 kB | 426/782 kB | 32/71 kB | 14/98 kB | 14/16 kB Progress (5): 48/49 kB | 426/782 kB | 32/71 kB | 14/98 kB | 15/16 kB Progress (5): 48/49 kB | 426/782 kB | 33/71 kB | 14/98 kB | 15/16 kB Progress (5): 48/49 kB | 426/782 kB | 33/71 kB | 14/98 kB | 16 kB Progress (5): 48/49 kB | 442/782 kB | 33/71 kB | 14/98 kB | 16 kB Progress (5): 49 kB | 442/782 kB | 33/71 kB | 14/98 kB | 16 kB Progress (5): 49 kB | 442/782 kB | 33/71 kB | 15/98 kB | 16 kB Progress (5): 49 kB | 442/782 kB | 33/71 kB | 16/98 kB | 16 kB Progress (5): 49 kB | 459/782 kB | 33/71 kB | 16/98 kB | 16 kB Progress (5): 49 kB | 459/782 kB | 34/71 kB | 16/98 kB | 16 kB Progress (5): 49 kB | 459/782 kB | 34/71 kB | 18/98 kB | 16 kB Progress (5): 49 kB | 459/782 kB | 34/71 kB | 19/98 kB | 16 kB Progress (5): 49 kB | 475/782 kB | 34/71 kB | 19/98 kB | 16 kB Progress (5): 49 kB | 475/782 kB | 36/71 kB | 19/98 kB | 16 kB Progress (5): 49 kB | 475/782 kB | 36/71 kB | 21/98 kB | 16 kB Progress (5): 49 kB | 475/782 kB | 37/71 kB | 21/98 kB | 16 kB Progress (5): 49 kB | 491/782 kB | 37/71 kB | 21/98 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 208 kB/s) 2024-09-12T00:32:57.833 INFO:tasks.workunit.client.0.smithi043.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 656 kB/s) 2024-09-12T00:32:57.834 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-12T00:32:57.834 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (3): 491/782 kB | 39/71 kB | 21/98 kB Progress (3): 491/782 kB | 39/71 kB | 22/98 kB Progress (3): 508/782 kB | 39/71 kB | 22/98 kB Progress (3): 508/782 kB | 39/71 kB | 23/98 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-12T00:32:57.841 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (3): 508/782 kB | 39/71 kB | 25/98 kB Progress (3): 508/782 kB | 39/71 kB | 26/98 kB Progress (3): 524/782 kB | 39/71 kB | 26/98 kB Progress (3): 524/782 kB | 39/71 kB | 27/98 kB Progress (3): 524/782 kB | 40/71 kB | 27/98 kB Progress (3): 524/782 kB | 40/71 kB | 29/98 kB Progress (3): 524/782 kB | 41/71 kB | 29/98 kB Progress (3): 524/782 kB | 41/71 kB | 30/98 kB Progress (3): 541/782 kB | 41/71 kB | 30/98 kB Progress (3): 541/782 kB | 43/71 kB | 30/98 kB Progress (3): 541/782 kB | 43/71 kB | 32/98 kB Progress (3): 541/782 kB | 44/71 kB | 32/98 kB Progress (3): 541/782 kB | 44/71 kB | 33/98 kB Progress (3): 541/782 kB | 44/71 kB | 34/98 kB Progress (3): 557/782 kB | 44/71 kB | 34/98 kB Progress (3): 557/782 kB | 44/71 kB | 36/98 kB Progress (3): 557/782 kB | 46/71 kB | 36/98 kB Progress (3): 557/782 kB | 46/71 kB | 37/98 kB Progress (3): 557/782 kB | 47/71 kB | 37/98 kB Progress (3): 557/782 kB | 47/71 kB | 38/98 kB Progress (3): 573/782 kB | 47/71 kB | 38/98 kB Progress (3): 573/782 kB | 48/71 kB | 38/98 kB Progress (3): 573/782 kB | 49/71 kB | 38/98 kB Progress (3): 590/782 kB | 49/71 kB | 38/98 kB Progress (3): 606/782 kB | 49/71 kB | 38/98 kB Progress (3): 623/782 kB | 49/71 kB | 38/98 kB Progress (3): 639/782 kB | 49/71 kB | 38/98 kB Progress (3): 655/782 kB | 49/71 kB | 38/98 kB Progress (3): 672/782 kB | 49/71 kB | 38/98 kB Progress (3): 688/782 kB | 49/71 kB | 38/98 kB Progress (3): 704/782 kB | 49/71 kB | 38/98 kB Progress (3): 721/782 kB | 49/71 kB | 38/98 kB Progress (3): 721/782 kB | 49/71 kB | 40/98 kB Progress (3): 737/782 kB | 49/71 kB | 40/98 kB Progress (3): 737/782 kB | 49/71 kB | 41/98 kB Progress (3): 737/782 kB | 66/71 kB | 41/98 kB Progress (3): 737/782 kB | 66/71 kB | 43/98 kB Progress (3): 754/782 kB | 66/71 kB | 43/98 kB Progress (3): 754/782 kB | 66/71 kB | 44/98 kB Progress (3): 754/782 kB | 71 kB | 44/98 kB Progress (3): 754/782 kB | 71 kB | 45/98 kB Progress (3): 770/782 kB | 71 kB | 45/98 kB Progress (3): 770/782 kB | 71 kB | 47/98 kB Progress (3): 770/782 kB | 71 kB | 48/98 kB Progress (3): 782 kB | 71 kB | 48/98 kB Progress (3): 782 kB | 71 kB | 49/98 kB Progress (3): 782 kB | 71 kB | 51/98 kB Progress (3): 782 kB | 71 kB | 52/98 kB Progress (3): 782 kB | 71 kB | 53/98 kB Progress (3): 782 kB | 71 kB | 55/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 830 kB/s) 2024-09-12T00:32:57.841 INFO:tasks.workunit.client.0.smithi043.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 9.3 MB/s) 2024-09-12T00:32:57.841 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 56/98 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-12T00:32:57.841 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-12T00:32:57.851 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 57/98 kB Progress (1): 59/98 kB Progress (1): 60/98 kB Progress (1): 62/98 kB Progress (1): 63/98 kB Progress (2): 63/98 kB | 1.4/11 kB Progress (2): 63/98 kB | 2.8/11 kB Progress (2): 63/98 kB | 4.1/11 kB Progress (2): 63/98 kB | 5.5/11 kB Progress (2): 63/98 kB | 6.9/11 kB Progress (2): 63/98 kB | 8.3/11 kB Progress (2): 63/98 kB | 9.7/11 kB Progress (2): 63/98 kB | 11/11 kB Progress (2): 63/98 kB | 11 kB Progress (2): 79/98 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 121 kB/s) 2024-09-12T00:32:57.851 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-12T00:32:57.852 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 95/98 kB Progress (1): 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.0 MB/s) 2024-09-12T00:32:57.853 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-12T00:32:57.866 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/205 kB Progress (1): 33/205 kB Progress (2): 33/205 kB | 16/81 kB Progress (2): 33/205 kB | 32/81 kB Progress (2): 33/205 kB | 49/81 kB Progress (2): 33/205 kB | 65/81 kB Progress (2): 49/205 kB | 65/81 kB Progress (2): 49/205 kB | 81 kB Progress (3): 49/205 kB | 81 kB | 16/30 kB Progress (3): 49/205 kB | 81 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 759 kB/s) 2024-09-12T00:32:57.866 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-12T00:32:57.866 INFO:tasks.workunit.client.0.smithi043.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 280 kB/s) 2024-09-12T00:32:57.866 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 66/205 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-12T00:32:57.868 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (2): 66/205 kB | 16/798 kB Progress (3): 66/205 kB | 16/798 kB | 13 kB Progress (3): 66/205 kB | 33/798 kB | 13 kB Progress (3): 82/205 kB | 33/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 121 kB/s) 2024-09-12T00:32:57.868 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-12T00:32:57.882 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (2): 82/205 kB | 49/798 kB Progress (2): 98/205 kB | 49/798 kB Progress (2): 98/205 kB | 62/798 kB Progress (2): 98/205 kB | 78/798 kB Progress (2): 115/205 kB | 78/798 kB Progress (2): 131/205 kB | 78/798 kB Progress (2): 147/205 kB | 78/798 kB Progress (2): 147/205 kB | 95/798 kB Progress (2): 164/205 kB | 95/798 kB Progress (2): 164/205 kB | 111/798 kB Progress (2): 164/205 kB | 128/798 kB Progress (2): 179/205 kB | 128/798 kB Progress (2): 195/205 kB | 128/798 kB Progress (3): 195/205 kB | 128/798 kB | 16/151 kB Progress (3): 195/205 kB | 144/798 kB | 16/151 kB Progress (3): 205 kB | 144/798 kB | 16/151 kB Progress (3): 205 kB | 144/798 kB | 33/151 kB Progress (3): 205 kB | 160/798 kB | 33/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 1.7 MB/s) 2024-09-12T00:32:57.882 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (3): 160/798 kB | 33/151 kB | 16/182 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-12T00:32:57.884 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (3): 160/798 kB | 49/151 kB | 16/182 kB Progress (3): 177/798 kB | 49/151 kB | 16/182 kB Progress (3): 177/798 kB | 49/151 kB | 33/182 kB Progress (3): 177/798 kB | 62/151 kB | 33/182 kB Progress (3): 177/798 kB | 62/151 kB | 49/182 kB Progress (3): 177/798 kB | 79/151 kB | 49/182 kB Progress (3): 177/798 kB | 79/151 kB | 62/182 kB Progress (3): 193/798 kB | 79/151 kB | 62/182 kB Progress (3): 193/798 kB | 79/151 kB | 78/182 kB Progress (4): 193/798 kB | 79/151 kB | 78/182 kB | 16/27 kB Progress (4): 193/798 kB | 95/151 kB | 78/182 kB | 16/27 kB Progress (4): 193/798 kB | 95/151 kB | 94/182 kB | 16/27 kB Progress (4): 193/798 kB | 95/151 kB | 94/182 kB | 27 kB Progress (4): 209/798 kB | 95/151 kB | 94/182 kB | 27 kB Progress (4): 209/798 kB | 95/151 kB | 111/182 kB | 27 kB Progress (4): 226/798 kB | 95/151 kB | 111/182 kB | 27 kB Progress (4): 226/798 kB | 95/151 kB | 127/182 kB | 27 kB Progress (4): 226/798 kB | 111/151 kB | 127/182 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 218 kB/s) 2024-09-12T00:32:57.884 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-12T00:32:57.885 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (3): 226/798 kB | 111/151 kB | 143/182 kB Progress (3): 226/798 kB | 128/151 kB | 143/182 kB Progress (3): 242/798 kB | 128/151 kB | 143/182 kB Progress (3): 242/798 kB | 128/151 kB | 160/182 kB Progress (3): 242/798 kB | 128/151 kB | 176/182 kB Progress (3): 242/798 kB | 128/151 kB | 182 kB Progress (3): 242/798 kB | 144/151 kB | 182 kB Progress (3): 259/798 kB | 144/151 kB | 182 kB Progress (3): 259/798 kB | 151 kB | 182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.4 MB/s) 2024-09-12T00:32:57.886 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-12T00:32:57.886 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (2): 275/798 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.2 MB/s) 2024-09-12T00:32:57.886 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-12T00:32:57.898 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 291/798 kB Progress (1): 308/798 kB Progress (1): 324/798 kB Progress (1): 341/798 kB Progress (1): 357/798 kB Progress (1): 373/798 kB Progress (1): 390/798 kB Progress (1): 406/798 kB Progress (1): 422/798 kB Progress (1): 439/798 kB Progress (1): 455/798 kB Progress (1): 472/798 kB Progress (1): 488/798 kB Progress (1): 504/798 kB Progress (1): 521/798 kB Progress (1): 537/798 kB Progress (1): 554/798 kB Progress (1): 570/798 kB Progress (1): 586/798 kB Progress (1): 603/798 kB Progress (1): 619/798 kB Progress (2): 619/798 kB | 16/30 kB Progress (2): 635/798 kB | 16/30 kB Progress (2): 635/798 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 216 kB/s) 2024-09-12T00:32:57.898 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-12T00:32:57.900 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (2): 635/798 kB | 16/75 kB Progress (3): 635/798 kB | 16/75 kB | 13 kB Progress (3): 635/798 kB | 33/75 kB | 13 kB Progress (3): 635/798 kB | 49/75 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 93 kB/s) 2024-09-12T00:32:57.900 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (2): 635/798 kB | 61/75 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-12T00:32:57.915 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (2): 635/798 kB | 75 kB Progress (2): 652/798 kB | 75 kB Progress (3): 652/798 kB | 75 kB | 16/385 kB Progress (3): 668/798 kB | 75 kB | 16/385 kB Progress (3): 668/798 kB | 75 kB | 33/385 kB Progress (4): 668/798 kB | 75 kB | 33/385 kB | 16/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 481 kB/s) 2024-09-12T00:32:57.915 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-12T00:32:57.919 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (3): 685/798 kB | 33/385 kB | 16/780 kB Progress (3): 685/798 kB | 49/385 kB | 16/780 kB Progress (3): 685/798 kB | 49/385 kB | 33/780 kB Progress (3): 701/798 kB | 49/385 kB | 33/780 kB Progress (3): 701/798 kB | 66/385 kB | 33/780 kB Progress (3): 701/798 kB | 66/385 kB | 49/780 kB Progress (3): 701/798 kB | 66/385 kB | 62/780 kB Progress (3): 717/798 kB | 66/385 kB | 62/780 kB Progress (3): 717/798 kB | 82/385 kB | 62/780 kB Progress (3): 717/798 kB | 82/385 kB | 79/780 kB Progress (3): 734/798 kB | 82/385 kB | 79/780 kB Progress (3): 734/798 kB | 82/385 kB | 95/780 kB Progress (3): 734/798 kB | 98/385 kB | 95/780 kB Progress (3): 734/798 kB | 98/385 kB | 111/780 kB Progress (3): 750/798 kB | 98/385 kB | 111/780 kB Progress (3): 750/798 kB | 114/385 kB | 111/780 kB Progress (3): 750/798 kB | 114/385 kB | 128/780 kB Progress (3): 766/798 kB | 114/385 kB | 128/780 kB Progress (3): 766/798 kB | 114/385 kB | 144/780 kB Progress (3): 766/798 kB | 131/385 kB | 144/780 kB Progress (3): 766/798 kB | 131/385 kB | 160/780 kB Progress (3): 783/798 kB | 131/385 kB | 160/780 kB Progress (3): 783/798 kB | 147/385 kB | 160/780 kB Progress (3): 783/798 kB | 147/385 kB | 177/780 kB Progress (3): 798 kB | 147/385 kB | 177/780 kB Progress (3): 798 kB | 147/385 kB | 193/780 kB Progress (3): 798 kB | 164/385 kB | 193/780 kB Progress (3): 798 kB | 164/385 kB | 210/780 kB Progress (3): 798 kB | 180/385 kB | 210/780 kB Progress (3): 798 kB | 180/385 kB | 226/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 5.0 MB/s) 2024-09-12T00:32:57.919 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-12T00:32:57.927 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (2): 180/385 kB | 242/780 kB Progress (2): 196/385 kB | 242/780 kB Progress (2): 213/385 kB | 242/780 kB Progress (2): 229/385 kB | 242/780 kB Progress (2): 245/385 kB | 242/780 kB Progress (2): 262/385 kB | 242/780 kB Progress (2): 278/385 kB | 242/780 kB Progress (2): 295/385 kB | 242/780 kB Progress (2): 311/385 kB | 242/780 kB Progress (2): 311/385 kB | 259/780 kB Progress (2): 311/385 kB | 275/780 kB Progress (2): 311/385 kB | 292/780 kB Progress (2): 311/385 kB | 308/780 kB Progress (2): 311/385 kB | 324/780 kB Progress (2): 327/385 kB | 324/780 kB Progress (2): 344/385 kB | 324/780 kB Progress (2): 344/385 kB | 341/780 kB Progress (2): 344/385 kB | 357/780 kB Progress (2): 360/385 kB | 357/780 kB Progress (2): 360/385 kB | 373/780 kB Progress (2): 376/385 kB | 373/780 kB Progress (2): 376/385 kB | 390/780 kB Progress (2): 385 kB | 390/780 kB Progress (2): 385 kB | 406/780 kB Progress (2): 385 kB | 423/780 kB Progress (2): 385 kB | 439/780 kB Progress (2): 385 kB | 455/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.3 MB/s) 2024-09-12T00:32:57.928 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-12T00:32:57.938 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 472/780 kB Progress (1): 488/780 kB Progress (1): 504/780 kB Progress (1): 521/780 kB Progress (2): 521/780 kB | 16/329 kB Progress (2): 537/780 kB | 16/329 kB Progress (2): 537/780 kB | 33/329 kB Progress (2): 537/780 kB | 49/329 kB Progress (2): 554/780 kB | 49/329 kB Progress (3): 554/780 kB | 49/329 kB | 16/501 kB Progress (3): 554/780 kB | 66/329 kB | 16/501 kB Progress (3): 570/780 kB | 66/329 kB | 16/501 kB Progress (3): 570/780 kB | 66/329 kB | 31/501 kB Progress (3): 570/780 kB | 82/329 kB | 31/501 kB Progress (3): 586/780 kB | 82/329 kB | 31/501 kB Progress (3): 586/780 kB | 82/329 kB | 48/501 kB Progress (3): 586/780 kB | 98/329 kB | 48/501 kB Progress (3): 603/780 kB | 98/329 kB | 48/501 kB Progress (3): 603/780 kB | 98/329 kB | 64/501 kB Progress (3): 603/780 kB | 115/329 kB | 64/501 kB Progress (3): 619/780 kB | 115/329 kB | 64/501 kB Progress (3): 619/780 kB | 115/329 kB | 81/501 kB Progress (3): 619/780 kB | 131/329 kB | 81/501 kB Progress (3): 636/780 kB | 131/329 kB | 81/501 kB Progress (3): 636/780 kB | 131/329 kB | 97/501 kB Progress (3): 636/780 kB | 147/329 kB | 97/501 kB Progress (3): 652/780 kB | 147/329 kB | 97/501 kB Progress (3): 652/780 kB | 147/329 kB | 113/501 kB Progress (3): 652/780 kB | 164/329 kB | 113/501 kB Progress (3): 668/780 kB | 164/329 kB | 113/501 kB Progress (3): 668/780 kB | 164/329 kB | 130/501 kB Progress (3): 685/780 kB | 164/329 kB | 130/501 kB Progress (3): 685/780 kB | 180/329 kB | 130/501 kB Progress (3): 701/780 kB | 180/329 kB | 130/501 kB Progress (3): 701/780 kB | 180/329 kB | 146/501 kB Progress (3): 701/780 kB | 197/329 kB | 146/501 kB Progress (3): 717/780 kB | 197/329 kB | 146/501 kB Progress (3): 717/780 kB | 197/329 kB | 162/501 kB Progress (3): 717/780 kB | 213/329 kB | 162/501 kB Progress (3): 734/780 kB | 213/329 kB | 162/501 kB Progress (3): 734/780 kB | 213/329 kB | 179/501 kB Progress (3): 734/780 kB | 229/329 kB | 179/501 kB Progress (4): 734/780 kB | 229/329 kB | 179/501 kB | 16/354 kB Progress (4): 734/780 kB | 246/329 kB | 179/501 kB | 16/354 kB Progress (4): 734/780 kB | 246/329 kB | 195/501 kB | 16/354 kB Progress (4): 734/780 kB | 246/329 kB | 195/501 kB | 33/354 kB Progress (4): 734/780 kB | 256/329 kB | 195/501 kB | 33/354 kB Progress (4): 734/780 kB | 256/329 kB | 212/501 kB | 33/354 kB Progress (4): 734/780 kB | 256/329 kB | 212/501 kB | 49/354 kB Progress (4): 734/780 kB | 272/329 kB | 212/501 kB | 49/354 kB Progress (4): 750/780 kB | 272/329 kB | 212/501 kB | 49/354 kB Progress (4): 750/780 kB | 272/329 kB | 228/501 kB | 49/354 kB Progress (4): 750/780 kB | 272/329 kB | 228/501 kB | 66/354 kB Progress (4): 750/780 kB | 289/329 kB | 228/501 kB | 66/354 kB Progress (4): 767/780 kB | 289/329 kB | 228/501 kB | 66/354 kB Progress (4): 767/780 kB | 289/329 kB | 244/501 kB | 66/354 kB Progress (4): 767/780 kB | 305/329 kB | 244/501 kB | 66/354 kB Progress (4): 767/780 kB | 305/329 kB | 244/501 kB | 82/354 kB Progress (4): 780 kB | 305/329 kB | 244/501 kB | 82/354 kB Progress (4): 780 kB | 305/329 kB | 261/501 kB | 82/354 kB Progress (4): 780 kB | 321/329 kB | 261/501 kB | 82/354 kB Progress (4): 780 kB | 321/329 kB | 261/501 kB | 98/354 kB Progress (4): 780 kB | 329 kB | 261/501 kB | 98/354 kB Progress (4): 780 kB | 329 kB | 277/501 kB | 98/354 kB Progress (4): 780 kB | 329 kB | 277/501 kB | 115/354 kB Progress (4): 780 kB | 329 kB | 294/501 kB | 115/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.4 MB/s) 2024-09-12T00:32:57.938 INFO:tasks.workunit.client.0.smithi043.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 1.8 MB/s) 2024-09-12T00:32:57.938 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (2): 294/501 kB | 131/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-12T00:32:57.938 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-12T00:32:57.945 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (2): 310/501 kB | 131/354 kB Progress (2): 310/501 kB | 147/354 kB Progress (2): 310/501 kB | 164/354 kB Progress (2): 310/501 kB | 180/354 kB Progress (2): 310/501 kB | 197/354 kB Progress (2): 310/501 kB | 213/354 kB Progress (2): 326/501 kB | 213/354 kB Progress (2): 326/501 kB | 229/354 kB Progress (2): 343/501 kB | 229/354 kB Progress (2): 343/501 kB | 246/354 kB Progress (2): 359/501 kB | 246/354 kB Progress (2): 359/501 kB | 256/354 kB Progress (2): 375/501 kB | 256/354 kB Progress (2): 375/501 kB | 272/354 kB Progress (2): 392/501 kB | 272/354 kB Progress (2): 408/501 kB | 272/354 kB Progress (2): 408/501 kB | 289/354 kB Progress (2): 425/501 kB | 289/354 kB Progress (2): 425/501 kB | 305/354 kB Progress (2): 441/501 kB | 305/354 kB Progress (2): 441/501 kB | 321/354 kB Progress (2): 457/501 kB | 321/354 kB Progress (2): 474/501 kB | 321/354 kB Progress (2): 474/501 kB | 338/354 kB Progress (2): 490/501 kB | 338/354 kB Progress (2): 501 kB | 338/354 kB Progress (2): 501 kB | 354 kB Progress (3): 501 kB | 354 kB | 16/41 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 2.7 MB/s) 2024-09-12T00:32:57.945 INFO:tasks.workunit.client.0.smithi043.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 1.9 MB/s) 2024-09-12T00:32:57.945 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 33/41 kB Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-12T00:32:57.945 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-12T00:32:57.945 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 221 kB/s) 2024-09-12T00:32:57.945 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-12T00:32:57.970 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/586 kB Progress (1): 33/586 kB Progress (1): 49/586 kB Progress (1): 66/586 kB Progress (1): 82/586 kB Progress (1): 95/586 kB Progress (1): 111/586 kB Progress (1): 127/586 kB Progress (1): 144/586 kB Progress (1): 160/586 kB Progress (1): 176/586 kB Progress (2): 176/586 kB | 6.4 kB Progress (2): 193/586 kB | 6.4 kB Progress (2): 209/586 kB | 6.4 kB Progress (2): 226/586 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 32 kB/s) 2024-09-12T00:32:57.970 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-12T00:32:57.970 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 242/586 kB Progress (1): 258/586 kB Progress (1): 275/586 kB Progress (1): 291/586 kB Progress (1): 308/586 kB Progress (1): 324/586 kB Progress (1): 340/586 kB Progress (1): 357/586 kB Progress (1): 373/586 kB Progress (2): 373/586 kB | 16/106 kB Progress (2): 389/586 kB | 16/106 kB Progress (2): 389/586 kB | 32/106 kB Progress (3): 389/586 kB | 32/106 kB | 16/211 kB Progress (3): 389/586 kB | 49/106 kB | 16/211 kB Progress (3): 406/586 kB | 49/106 kB | 16/211 kB Progress (3): 406/586 kB | 49/106 kB | 33/211 kB Progress (3): 406/586 kB | 65/106 kB | 33/211 kB Progress (3): 422/586 kB | 65/106 kB | 33/211 kB Progress (3): 422/586 kB | 81/106 kB | 33/211 kB Progress (3): 422/586 kB | 81/106 kB | 49/211 kB Progress (4): 422/586 kB | 81/106 kB | 49/211 kB | 14 kB Progress (4): 422/586 kB | 98/106 kB | 49/211 kB | 14 kB Progress (4): 439/586 kB | 98/106 kB | 49/211 kB | 14 kB Progress (4): 439/586 kB | 98/106 kB | 65/211 kB | 14 kB Progress (4): 439/586 kB | 106 kB | 65/211 kB | 14 kB Progress (4): 455/586 kB | 106 kB | 65/211 kB | 14 kB Progress (4): 455/586 kB | 106 kB | 81/211 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 70 kB/s) 2024-09-12T00:32:57.971 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-12T00:32:57.971 INFO:tasks.workunit.client.0.smithi043.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 526 kB/s) 2024-09-12T00:32:57.971 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (2): 455/586 kB | 98/211 kB Progress (2): 471/586 kB | 98/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-12T00:32:57.971 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (2): 471/586 kB | 114/211 kB Progress (2): 488/586 kB | 114/211 kB Progress (2): 488/586 kB | 131/211 kB Progress (2): 504/586 kB | 131/211 kB Progress (2): 504/586 kB | 147/211 kB Progress (2): 521/586 kB | 147/211 kB Progress (2): 521/586 kB | 163/211 kB Progress (2): 537/586 kB | 163/211 kB Progress (2): 537/586 kB | 180/211 kB Progress (2): 553/586 kB | 180/211 kB Progress (2): 553/586 kB | 196/211 kB Progress (2): 570/586 kB | 196/211 kB Progress (2): 570/586 kB | 211 kB Progress (2): 586 kB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 2.8 MB/s) 2024-09-12T00:32:57.971 INFO:tasks.workunit.client.0.smithi043.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.0 MB/s) 2024-09-12T00:32:57.971 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-12T00:32:57.971 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-12T00:32:57.973 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 32 kB/s) 2024-09-12T00:32:57.973 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-12T00:32:57.980 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 15/245 kB Progress (2): 15/245 kB | 16/205 kB Progress (2): 31/245 kB | 16/205 kB Progress (2): 31/245 kB | 33/205 kB Progress (2): 48/245 kB | 33/205 kB Progress (2): 48/245 kB | 49/205 kB Progress (2): 48/245 kB | 65/205 kB Progress (2): 64/245 kB | 65/205 kB Progress (2): 64/245 kB | 81/205 kB Progress (2): 81/245 kB | 81/205 kB Progress (2): 81/245 kB | 98/205 kB Progress (2): 95/245 kB | 98/205 kB Progress (2): 95/245 kB | 114/205 kB Progress (3): 95/245 kB | 114/205 kB | 16/16 kB Progress (3): 95/245 kB | 114/205 kB | 16 kB Progress (3): 95/245 kB | 130/205 kB | 16 kB Progress (3): 112/245 kB | 130/205 kB | 16 kB Progress (3): 112/245 kB | 147/205 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 75 kB/s) 2024-09-12T00:32:57.981 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (2): 128/245 kB | 147/205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-12T00:32:57.982 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (2): 128/245 kB | 163/205 kB Progress (2): 145/245 kB | 163/205 kB Progress (2): 145/245 kB | 180/205 kB Progress (3): 145/245 kB | 180/205 kB | 15 kB Progress (3): 161/245 kB | 180/205 kB | 15 kB Progress (3): 161/245 kB | 196/205 kB | 15 kB Progress (3): 161/245 kB | 205 kB | 15 kB Progress (3): 177/245 kB | 205 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 69 kB/s) 2024-09-12T00:32:57.982 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-12T00:32:57.982 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (2): 194/245 kB | 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 923 kB/s) 2024-09-12T00:32:57.983 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-12T00:32:57.984 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 210/245 kB Progress (1): 226/245 kB Progress (1): 243/245 kB Progress (1): 245 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.1 MB/s) 2024-09-12T00:32:57.984 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-12T00:32:57.995 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 27 kB/s) 2024-09-12T00:32:57.997 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 95 kB/s) 2024-09-12T00:32:57.998 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 73 kB/s) 2024-09-12T00:32:58.000 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 15/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 101 kB/s) 2024-09-12T00:32:58.005 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/184 kB Progress (1): 32/184 kB Progress (1): 49/184 kB Progress (1): 65/184 kB Progress (1): 81/184 kB Progress (1): 98/184 kB Progress (1): 114/184 kB Progress (1): 130/184 kB Progress (1): 147/184 kB Progress (1): 163/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 750 kB/s) 2024-09-12T00:32:58.025 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] 2024-09-12T00:32:58.025 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-12T00:32:58.032 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-12T00:32:58.047 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 389 kB/s) 2024-09-12T00:32:58.049 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-12T00:32:58.065 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 318 kB/s) 2024-09-12T00:32:58.066 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-12T00:32:58.081 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/43 kB Progress (1): 32/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.9 MB/s) 2024-09-12T00:32:58.086 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-12T00:32:58.100 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 1.0 MB/s) 2024-09-12T00:32:58.105 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-12T00:32:58.135 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/153 kB Progress (1): 32/153 kB Progress (1): 49/153 kB Progress (1): 65/153 kB Progress (1): 81/153 kB Progress (1): 98/153 kB Progress (1): 114/153 kB Progress (1): 130/153 kB Progress (1): 145/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 5.1 MB/s) 2024-09-12T00:32:58.135 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-12T00:32:58.175 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/215 kB Progress (1): 32/215 kB Progress (1): 49/215 kB Progress (1): 65/215 kB Progress (1): 79/215 kB Progress (1): 96/215 kB Progress (1): 112/215 kB Progress (1): 128/215 kB Progress (1): 145/215 kB Progress (1): 161/215 kB Progress (1): 178/215 kB Progress (1): 194/215 kB Progress (1): 210/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 5.4 MB/s) 2024-09-12T00:32:58.241 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] 2024-09-12T00:32:58.241 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T00:32:58.245 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-12T00:32:58.298 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 50 kB/s) 2024-09-12T00:32:58.300 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-12T00:32:58.389 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 253 kB/s) 2024-09-12T00:32:58.395 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-12T00:32:58.430 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 251 kB/s) 2024-09-12T00:32:58.434 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-12T00:32:58.470 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 706 kB/s) 2024-09-12T00:32:58.475 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-12T00:32:58.500 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 241 kB/s) 2024-09-12T00:32:58.504 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-12T00:32:58.524 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 161 kB/s) 2024-09-12T00:32:58.530 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-12T00:32:58.553 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 27 kB/s) 2024-09-12T00:32:58.556 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-12T00:32:58.600 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 62 kB/s) 2024-09-12T00:32:58.603 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-12T00:32:58.704 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 140 kB/s) 2024-09-12T00:32:58.710 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-12T00:32:58.739 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 110 kB/s) 2024-09-12T00:32:58.743 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-12T00:32:58.792 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 171 kB/s) 2024-09-12T00:32:58.796 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-12T00:32:58.822 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 322 kB/s) 2024-09-12T00:32:58.828 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-12T00:32:58.855 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 297 kB/s) 2024-09-12T00:32:58.861 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-12T00:32:58.901 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 493 kB/s) 2024-09-12T00:32:58.911 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-12T00:32:58.928 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 300 kB/s) 2024-09-12T00:32:58.933 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-12T00:32:58.952 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 1.6 MB/s) 2024-09-12T00:32:58.966 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-12T00:32:58.982 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 319 kB/s) 2024-09-12T00:32:58.995 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-12T00:32:59.017 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/85 kB Progress (1): 32/85 kB Progress (1): 49/85 kB Progress (1): 65/85 kB Progress (1): 81/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 3.9 MB/s) 2024-09-12T00:32:59.017 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-12T00:32:59.018 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-12T00:32:59.018 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-12T00:32:59.019 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-12T00:32:59.019 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-12T00:32:59.036 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/269 kB Progress (2): 16/269 kB | 2.5 kB Progress (3): 16/269 kB | 2.5 kB | 16/55 kB Progress (3): 33/269 kB | 2.5 kB | 16/55 kB Progress (4): 33/269 kB | 2.5 kB | 16/55 kB | 8.5 kB Progress (4): 33/269 kB | 2.5 kB | 32/55 kB | 8.5 kB Progress (4): 49/269 kB | 2.5 kB | 32/55 kB | 8.5 kB Progress (5): 49/269 kB | 2.5 kB | 32/55 kB | 8.5 kB | 16/41 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 147 kB/s) 2024-09-12T00:32:59.037 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (4): 66/269 kB | 32/55 kB | 8.5 kB | 16/41 kB Progress (4): 66/269 kB | 49/55 kB | 8.5 kB | 16/41 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-12T00:32:59.037 INFO:tasks.workunit.client.0.smithi043.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 499 kB/s) 2024-09-12T00:32:59.037 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (3): 66/269 kB | 55 kB | 16/41 kB Progress (3): 66/269 kB | 55 kB | 32/41 kB Progress (3): 82/269 kB | 55 kB | 32/41 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-12T00:32:59.037 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (3): 82/269 kB | 55 kB | 41 kB Progress (3): 98/269 kB | 55 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 2.9 MB/s) 2024-09-12T00:32:59.038 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (2): 115/269 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.2 MB/s) 2024-09-12T00:32:59.042 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 131/269 kB Progress (1): 147/269 kB Progress (1): 164/269 kB Progress (1): 180/269 kB Progress (1): 197/269 kB Progress (1): 213/269 kB Progress (1): 229/269 kB Progress (1): 246/269 kB Progress (1): 262/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 11 MB/s) 2024-09-12T00:32:59.060 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/327 kB Progress (1): 33/327 kB Progress (1): 49/327 kB Progress (1): 64/327 kB Progress (1): 81/327 kB Progress (1): 97/327 kB Progress (2): 97/327 kB | 16/587 kB Progress (2): 113/327 kB | 16/587 kB Progress (2): 130/327 kB | 16/587 kB Progress (2): 130/327 kB | 33/587 kB Progress (2): 146/327 kB | 33/587 kB Progress (2): 146/327 kB | 49/587 kB Progress (2): 163/327 kB | 49/587 kB Progress (2): 179/327 kB | 49/587 kB Progress (2): 179/327 kB | 64/587 kB Progress (2): 195/327 kB | 64/587 kB Progress (2): 195/327 kB | 80/587 kB Progress (2): 212/327 kB | 80/587 kB Progress (2): 228/327 kB | 80/587 kB Progress (2): 228/327 kB | 97/587 kB Progress (2): 244/327 kB | 97/587 kB Progress (2): 261/327 kB | 97/587 kB Progress (2): 261/327 kB | 113/587 kB Progress (2): 277/327 kB | 113/587 kB Progress (2): 277/327 kB | 129/587 kB Progress (2): 294/327 kB | 129/587 kB Progress (2): 310/327 kB | 129/587 kB Progress (2): 310/327 kB | 146/587 kB Progress (2): 326/327 kB | 146/587 kB Progress (2): 327 kB | 146/587 kB Progress (2): 327 kB | 162/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 8.2 MB/s) 2024-09-12T00:32:59.075 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 179/587 kB Progress (1): 195/587 kB Progress (1): 211/587 kB Progress (1): 228/587 kB Progress (1): 244/587 kB Progress (1): 261/587 kB Progress (1): 277/587 kB Progress (1): 293/587 kB Progress (1): 310/587 kB Progress (1): 326/587 kB Progress (1): 342/587 kB Progress (1): 359/587 kB Progress (1): 375/587 kB Progress (1): 392/587 kB Progress (1): 408/587 kB Progress (1): 424/587 kB Progress (1): 441/587 kB Progress (1): 457/587 kB Progress (1): 474/587 kB Progress (1): 490/587 kB Progress (1): 506/587 kB Progress (1): 523/587 kB Progress (1): 539/587 kB Progress (1): 555/587 kB Progress (1): 572/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 11 MB/s) 2024-09-12T00:32:59.129 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T00:32:59.130 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] 2024-09-12T00:32:59.130 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T00:32:59.137 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-12T00:32:59.158 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 226 kB/s) 2024-09-12T00:32:59.161 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-12T00:32:59.186 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 254 kB/s) 2024-09-12T00:32:59.189 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-12T00:32:59.205 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/33 kB Progress (1): 32/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.0 MB/s) 2024-09-12T00:32:59.208 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-12T00:32:59.227 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 735 kB/s) 2024-09-12T00:32:59.232 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-12T00:32:59.249 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 48 kB/s) 2024-09-12T00:32:59.252 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-12T00:32:59.267 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 265 kB/s) 2024-09-12T00:32:59.270 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-12T00:32:59.286 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.0 MB/s) 2024-09-12T00:32:59.291 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-12T00:32:59.310 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 262 kB/s) 2024-09-12T00:32:59.314 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-12T00:32:59.329 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 276 kB/s) 2024-09-12T00:32:59.335 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-12T00:32:59.363 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 82 kB/s) 2024-09-12T00:32:59.366 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-12T00:32:59.382 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 706 kB/s) 2024-09-12T00:32:59.386 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-12T00:32:59.402 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.1 MB/s) 2024-09-12T00:32:59.406 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-12T00:32:59.423 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 386 kB/s) 2024-09-12T00:32:59.428 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-12T00:32:59.445 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 62 kB/s) 2024-09-12T00:32:59.448 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-12T00:32:59.463 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 559 kB/s) 2024-09-12T00:32:59.466 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-12T00:32:59.483 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 158 kB/s) 2024-09-12T00:32:59.488 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-12T00:32:59.504 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 352 kB/s) 2024-09-12T00:32:59.512 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-12T00:32:59.529 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 67 kB/s) 2024-09-12T00:32:59.536 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-12T00:32:59.556 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 38 kB/s) 2024-09-12T00:32:59.560 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-12T00:32:59.577 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 355 kB/s) 2024-09-12T00:32:59.581 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-12T00:32:59.598 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.5 MB/s) 2024-09-12T00:32:59.608 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-12T00:32:59.622 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 71 kB/s) 2024-09-12T00:32:59.627 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-12T00:32:59.643 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 83 kB/s) 2024-09-12T00:32:59.662 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-12T00:32:59.679 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 796 kB/s) 2024-09-12T00:32:59.679 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-12T00:32:59.680 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-12T00:32:59.680 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-12T00:32:59.680 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-12T00:32:59.681 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-12T00:32:59.706 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 15/122 kB Progress (2): 15/122 kB | 16/55 kB Progress (2): 31/122 kB | 16/55 kB Progress (2): 31/122 kB | 32/55 kB Progress (2): 48/122 kB | 32/55 kB Progress (2): 48/122 kB | 49/55 kB Progress (2): 64/122 kB | 49/55 kB Progress (2): 64/122 kB | 55 kB Progress (2): 81/122 kB | 55 kB Progress (2): 97/122 kB | 55 kB Progress (2): 113/122 kB | 55 kB Progress (2): 122 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 2.1 MB/s) 2024-09-12T00:32:59.707 INFO:tasks.workunit.client.0.smithi043.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 4.9 MB/s) 2024-09-12T00:32:59.707 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-12T00:32:59.707 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 16/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-12T00:32:59.707 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (3): 4.2 kB | 16/334 kB | 16/27 kB Progress (3): 4.2 kB | 16/334 kB | 27 kB Progress (3): 4.2 kB | 32/334 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 150 kB/s) 2024-09-12T00:32:59.707 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-12T00:32:59.707 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (2): 49/334 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.0 MB/s) 2024-09-12T00:32:59.714 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 65/334 kB Progress (1): 81/334 kB Progress (1): 98/334 kB Progress (1): 114/334 kB Progress (1): 130/334 kB Progress (1): 147/334 kB Progress (1): 163/334 kB Progress (1): 180/334 kB Progress (1): 196/334 kB Progress (1): 212/334 kB Progress (1): 229/334 kB Progress (1): 245/334 kB Progress (1): 262/334 kB Progress (1): 278/334 kB Progress (1): 294/334 kB Progress (1): 311/334 kB Progress (1): 327/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 9.8 MB/s) 2024-09-12T00:32:59.721 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 116 kB/s) 2024-09-12T00:32:59.723 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/267 kB Progress (1): 33/267 kB Progress (1): 49/267 kB Progress (2): 49/267 kB | 16/23 kB Progress (2): 49/267 kB | 23 kB Progress (2): 66/267 kB | 23 kB Progress (2): 82/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 543 kB/s) 2024-09-12T00:32:59.729 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 98/267 kB Progress (1): 115/267 kB Progress (1): 131/267 kB Progress (1): 147/267 kB Progress (1): 164/267 kB Progress (1): 180/267 kB Progress (1): 197/267 kB Progress (1): 213/267 kB Progress (1): 229/267 kB Progress (1): 246/267 kB Progress (1): 262/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 5.6 MB/s) 2024-09-12T00:32:59.871 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-12T00:32:59.873 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-12T00:33:01.011 INFO:tasks.workunit.client.0.smithi043.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T00:33:01.011 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] 2024-09-12T00:33:01.012 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T00:33:01.015 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T00:33:01.015 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] 2024-09-12T00:33:01.016 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T00:33:01.024 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-12T00:33:01.024 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-12T00:33:01.259 INFO:tasks.workunit.client.0.smithi043.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T00:33:01.259 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] 2024-09-12T00:33:01.259 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T00:33:01.265 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-12T00:33:01.283 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 329 kB/s) 2024-09-12T00:33:01.287 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-12T00:33:01.306 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 186 kB/s) 2024-09-12T00:33:01.310 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-12T00:33:01.332 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 148 kB/s) 2024-09-12T00:33:01.336 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-12T00:33:01.351 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 271 kB/s) 2024-09-12T00:33:01.356 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-12T00:33:01.372 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 194 kB/s) 2024-09-12T00:33:01.376 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-12T00:33:01.391 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 297 kB/s) 2024-09-12T00:33:01.395 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-12T00:33:01.410 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 110 kB/s) 2024-09-12T00:33:01.414 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-12T00:33:01.429 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 146 kB/s) 2024-09-12T00:33:01.430 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-12T00:33:01.445 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 1.9 MB/s) 2024-09-12T00:33:01.448 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-12T00:33:01.464 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 118 kB/s) 2024-09-12T00:33:01.466 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-12T00:33:01.481 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 387 kB/s) 2024-09-12T00:33:01.484 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-12T00:33:01.498 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 168 kB/s) 2024-09-12T00:33:01.500 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-12T00:33:01.516 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.4 MB/s) 2024-09-12T00:33:01.519 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-12T00:33:01.535 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/37 kB Progress (1): 32/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.5 MB/s) 2024-09-12T00:33:01.538 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-12T00:33:01.553 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.0 MB/s) 2024-09-12T00:33:01.558 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-12T00:33:01.574 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 541 kB/s) 2024-09-12T00:33:01.577 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-12T00:33:01.593 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.8 MB/s) 2024-09-12T00:33:01.599 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-12T00:33:01.615 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 504 kB/s) 2024-09-12T00:33:01.621 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-12T00:33:01.639 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 121 kB/s) 2024-09-12T00:33:01.645 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-12T00:33:01.662 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 153 kB/s) 2024-09-12T00:33:01.668 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-12T00:33:01.685 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 91 kB/s) 2024-09-12T00:33:01.689 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-12T00:33:01.707 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 161 kB/s) 2024-09-12T00:33:01.710 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-12T00:33:01.731 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 929 kB/s) 2024-09-12T00:33:01.735 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-12T00:33:01.772 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 188 kB/s) 2024-09-12T00:33:01.776 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-12T00:33:01.811 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 387 kB/s) 2024-09-12T00:33:01.817 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-12T00:33:01.839 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 135 kB/s) 2024-09-12T00:33:01.843 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-12T00:33:01.864 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 309 kB/s) 2024-09-12T00:33:01.869 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-12T00:33:01.887 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 442 kB/s) 2024-09-12T00:33:01.892 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-12T00:33:01.909 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 121 kB/s) 2024-09-12T00:33:01.915 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-12T00:33:01.930 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 149 kB/s) 2024-09-12T00:33:01.939 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-12T00:33:01.954 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 202 kB/s) 2024-09-12T00:33:01.961 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-12T00:33:01.980 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 788 kB/s) 2024-09-12T00:33:01.984 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-12T00:33:02.002 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 806 kB/s) 2024-09-12T00:33:02.009 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-12T00:33:02.026 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 790 kB/s) 2024-09-12T00:33:02.030 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-12T00:33:02.046 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 299 kB/s) 2024-09-12T00:33:02.050 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-12T00:33:02.076 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 241 kB/s) 2024-09-12T00:33:02.080 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-12T00:33:02.110 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/32 kB Progress (1): 32/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 1.1 MB/s) 2024-09-12T00:33:02.117 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-12T00:33:02.134 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.0 MB/s) 2024-09-12T00:33:02.138 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-12T00:33:02.154 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 925 kB/s) 2024-09-12T00:33:02.160 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-12T00:33:02.178 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 42 kB/s) 2024-09-12T00:33:02.181 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-12T00:33:02.197 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 300 kB/s) 2024-09-12T00:33:02.202 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-12T00:33:02.220 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 440 kB/s) 2024-09-12T00:33:02.226 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-12T00:33:02.243 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 176 kB/s) 2024-09-12T00:33:02.250 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-12T00:33:02.268 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 266 kB/s) 2024-09-12T00:33:02.273 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-12T00:33:02.292 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 108 kB/s) 2024-09-12T00:33:02.300 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-12T00:33:02.318 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 193 kB/s) 2024-09-12T00:33:02.325 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-12T00:33:02.342 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 643 kB/s) 2024-09-12T00:33:02.346 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-12T00:33:02.363 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 793 kB/s) 2024-09-12T00:33:02.368 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-12T00:33:02.383 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.2 MB/s) 2024-09-12T00:33:02.390 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-12T00:33:02.406 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 23 kB/s) 2024-09-12T00:33:02.410 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-12T00:33:02.426 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 381 kB/s) 2024-09-12T00:33:02.429 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-12T00:33:02.445 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 458 kB/s) 2024-09-12T00:33:02.450 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-12T00:33:02.467 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 284 kB/s) 2024-09-12T00:33:02.476 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-12T00:33:02.501 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 271 kB/s) 2024-09-12T00:33:02.508 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-12T00:33:02.530 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 15/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 984 kB/s) 2024-09-12T00:33:02.535 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-12T00:33:02.555 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 3.9 MB/s) 2024-09-12T00:33:02.564 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-12T00:33:02.583 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.2 MB/s) 2024-09-12T00:33:02.590 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-12T00:33:02.605 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 377 kB/s) 2024-09-12T00:33:02.610 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-12T00:33:02.633 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 186 kB/s) 2024-09-12T00:33:02.637 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-12T00:33:02.656 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 168 kB/s) 2024-09-12T00:33:02.659 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-12T00:33:02.677 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.5 MB/s) 2024-09-12T00:33:02.683 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-12T00:33:02.700 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 139 kB/s) 2024-09-12T00:33:02.712 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-12T00:33:02.742 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/308 kB Progress (1): 32/308 kB Progress (1): 49/308 kB Progress (1): 65/308 kB Progress (1): 81/308 kB Progress (1): 98/308 kB Progress (1): 114/308 kB Progress (1): 130/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 10 MB/s) 2024-09-12T00:33:02.743 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-12T00:33:02.743 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-12T00:33:02.744 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-12T00:33:02.744 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-12T00:33:02.744 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-12T00:33:02.763 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/171 kB Progress (1): 32/171 kB Progress (1): 49/171 kB Progress (1): 65/171 kB Progress (1): 81/171 kB Progress (1): 98/171 kB Progress (1): 114/171 kB Progress (2): 114/171 kB | 16/118 kB Progress (3): 114/171 kB | 16/118 kB | 16/26 kB Progress (3): 130/171 kB | 16/118 kB | 16/26 kB Progress (4): 130/171 kB | 16/118 kB | 16/26 kB | 14 kB Progress (4): 130/171 kB | 16/118 kB | 26 kB | 14 kB Progress (4): 147/171 kB | 16/118 kB | 26 kB | 14 kB Progress (4): 147/171 kB | 33/118 kB | 26 kB | 14 kB Progress (4): 163/171 kB | 33/118 kB | 26 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 679 kB/s) 2024-09-12T00:33:02.763 INFO:tasks.workunit.client.0.smithi043.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.3 MB/s) 2024-09-12T00:33:02.763 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (2): 171 kB | 33/118 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-12T00:33:02.763 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-12T00:33:02.764 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (2): 171 kB | 49/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 7.8 MB/s) 2024-09-12T00:33:02.764 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-12T00:33:02.766 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 64/118 kB Progress (1): 80/118 kB Progress (1): 97/118 kB Progress (2): 97/118 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 372 kB/s) 2024-09-12T00:33:02.766 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 113/118 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-12T00:33:02.767 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 4.9 MB/s) 2024-09-12T00:33:02.767 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-12T00:33:02.779 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/61 kB Progress (1): 33/61 kB Progress (2): 33/61 kB | 16/136 kB Progress (3): 33/61 kB | 16/136 kB | 16/146 kB Progress (3): 49/61 kB | 16/136 kB | 16/146 kB Progress (3): 49/61 kB | 33/136 kB | 16/146 kB Progress (3): 61 kB | 33/136 kB | 16/146 kB Progress (3): 61 kB | 33/136 kB | 32/146 kB Progress (3): 61 kB | 49/136 kB | 32/146 kB Progress (3): 61 kB | 49/136 kB | 49/146 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.7 MB/s) 2024-09-12T00:33:02.779 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (2): 65/136 kB | 49/146 kB Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-12T00:33:02.781 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (2): 65/136 kB | 65/146 kB Progress (2): 82/136 kB | 65/146 kB Progress (2): 98/136 kB | 65/146 kB Progress (2): 98/136 kB | 81/146 kB Progress (2): 114/136 kB | 81/146 kB Progress (2): 131/136 kB | 81/146 kB Progress (2): 136 kB | 81/146 kB Progress (2): 136 kB | 98/146 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 3.7 MB/s) 2024-09-12T00:33:02.781 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-12T00:33:02.782 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 114/146 kB Progress (1): 130/146 kB Progress (2): 130/146 kB | 16/501 kB Progress (2): 146 kB | 16/501 kB Progress (2): 146 kB | 32/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 3.8 MB/s) 2024-09-12T00:33:02.787 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 49/501 kB Progress (1): 65/501 kB Progress (1): 81/501 kB Progress (1): 98/501 kB Progress (1): 114/501 kB Progress (2): 114/501 kB | 16/58 kB Progress (2): 131/501 kB | 16/58 kB Progress (2): 143/501 kB | 16/58 kB Progress (2): 143/501 kB | 32/58 kB Progress (2): 159/501 kB | 32/58 kB Progress (2): 159/501 kB | 49/58 kB Progress (2): 159/501 kB | 58 kB Progress (2): 175/501 kB | 58 kB Progress (2): 192/501 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.3 MB/s) 2024-09-12T00:33:02.796 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 208/501 kB Progress (1): 224/501 kB Progress (1): 241/501 kB Progress (1): 257/501 kB Progress (1): 274/501 kB Progress (1): 278/501 kB Progress (1): 294/501 kB Progress (1): 310/501 kB Progress (1): 327/501 kB Progress (1): 343/501 kB Progress (1): 360/501 kB Progress (1): 376/501 kB Progress (1): 392/501 kB Progress (1): 409/501 kB Progress (1): 425/501 kB Progress (1): 442/501 kB Progress (1): 458/501 kB Progress (1): 474/501 kB Progress (2): 474/501 kB | 15/124 kB Progress (2): 491/501 kB | 15/124 kB Progress (2): 491/501 kB | 31/124 kB Progress (2): 501 kB | 31/124 kB Progress (2): 501 kB | 48/124 kB Progress (3): 501 kB | 48/124 kB | 0/2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 9.6 MB/s) 2024-09-12T00:33:02.798 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (2): 64/124 kB | 0/2.4 MB Progress (2): 64/124 kB | 0/2.4 MB Progress (2): 64/124 kB | 0/2.4 MB Progress (2): 81/124 kB | 0/2.4 MB Progress (2): 81/124 kB | 0.1/2.4 MB Progress (2): 97/124 kB | 0.1/2.4 MB Progress (2): 97/124 kB | 0.1/2.4 MB Progress (2): 113/124 kB | 0.1/2.4 MB Progress (2): 124 kB | 0.1/2.4 MB Progress (2): 124 kB | 0.1/2.4 MB Progress (2): 124 kB | 0.1/2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.3 MB/s) 2024-09-12T00:33:02.834 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 27 MB/s) 2024-09-12T00:33:02.927 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] 2024-09-12T00:33:02.927 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-12T00:33:02.930 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-12T00:33:02.944 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 320 kB/s) 2024-09-12T00:33:02.946 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-12T00:33:02.960 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 326 kB/s) 2024-09-12T00:33:02.962 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-12T00:33:02.977 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 15/45 kB Progress (1): 31/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.0 MB/s) 2024-09-12T00:33:02.979 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-12T00:33:02.994 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.5 MB/s) 2024-09-12T00:33:02.997 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-12T00:33:03.014 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 305 kB/s) 2024-09-12T00:33:03.017 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-12T00:33:03.031 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 280 kB/s) 2024-09-12T00:33:03.034 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-12T00:33:03.048 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 430 kB/s) 2024-09-12T00:33:03.050 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-12T00:33:03.064 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 447 kB/s) 2024-09-12T00:33:03.067 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-12T00:33:03.082 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.2 MB/s) 2024-09-12T00:33:03.088 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-12T00:33:03.101 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 1.0 MB/s) 2024-09-12T00:33:03.103 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-12T00:33:03.117 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 146 kB/s) 2024-09-12T00:33:03.119 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-12T00:33:03.135 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 514 kB/s) 2024-09-12T00:33:03.137 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-12T00:33:03.152 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.7 MB/s) 2024-09-12T00:33:03.157 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-12T00:33:03.172 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.4 MB/s) 2024-09-12T00:33:03.172 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-12T00:33:03.173 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-12T00:33:03.173 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-12T00:33:03.173 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-12T00:33:03.173 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-12T00:33:03.188 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/58 kB Progress (2): 16/58 kB | 16/26 kB Progress (2): 16/58 kB | 26 kB Progress (2): 33/58 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.6 MB/s) 2024-09-12T00:33:03.188 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 49/58 kB Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-12T00:33:03.189 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 58 kB Progress (2): 58 kB | 16/79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.6 MB/s) 2024-09-12T00:33:03.189 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-12T00:33:03.191 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Progress (2): 79 kB | 0/1.0 MB Progress (3): 79 kB | 0/1.0 MB | 15/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.2 MB/s) 2024-09-12T00:33:03.197 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (2): 0/1.0 MB | 15/211 kB Progress (2): 0/1.0 MB | 31/211 kB Progress (2): 0/1.0 MB | 31/211 kB Progress (2): 0.1/1.0 MB | 31/211 kB Progress (2): 0.1/1.0 MB | 48/211 kB Progress (2): 0.1/1.0 MB | 48/211 kB Progress (2): 0.1/1.0 MB | 48/211 kB Progress (2): 0.1/1.0 MB | 64/211 kB Progress (2): 0.1/1.0 MB | 64/211 kB Progress (2): 0.1/1.0 MB | 79/211 kB Progress (2): 0.1/1.0 MB | 79/211 kB Progress (2): 0.1/1.0 MB | 95/211 kB Progress (2): 0.1/1.0 MB | 95/211 kB Progress (2): 0.2/1.0 MB | 95/211 kB Progress (2): 0.2/1.0 MB | 112/211 kB Progress (2): 0.2/1.0 MB | 112/211 kB Progress (2): 0.2/1.0 MB | 128/211 kB Progress (2): 0.2/1.0 MB | 128/211 kB Progress (2): 0.2/1.0 MB | 145/211 kB Progress (2): 0.2/1.0 MB | 145/211 kB Progress (2): 0.2/1.0 MB | 145/211 kB Progress (2): 0.2/1.0 MB | 161/211 kB Progress (2): 0.2/1.0 MB | 161/211 kB Progress (2): 0.2/1.0 MB | 177/211 kB Progress (2): 0.3/1.0 MB | 177/211 kB Progress (2): 0.3/1.0 MB | 194/211 kB Progress (2): 0.3/1.0 MB | 194/211 kB Progress (2): 0.3/1.0 MB | 210/211 kB Progress (2): 0.3/1.0 MB | 211 kB Progress (2): 0.3/1.0 MB | 211 kB Progress (2): 0.3/1.0 MB | 211 kB Progress (2): 0.3/1.0 MB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 8.8 MB/s) 2024-09-12T00:33:03.204 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (2): 0.5/1.0 MB | 16/116 kB Progress (2): 0.6/1.0 MB | 16/116 kB Progress (2): 0.6/1.0 MB | 33/116 kB Progress (2): 0.6/1.0 MB | 49/116 kB Progress (2): 0.6/1.0 MB | 49/116 kB Progress (2): 0.6/1.0 MB | 66/116 kB Progress (2): 0.6/1.0 MB | 66/116 kB Progress (2): 0.6/1.0 MB | 82/116 kB Progress (2): 0.6/1.0 MB | 98/116 kB Progress (2): 0.6/1.0 MB | 98/116 kB Progress (2): 0.6/1.0 MB | 115/116 kB Progress (2): 0.6/1.0 MB | 116 kB Progress (2): 0.6/1.0 MB | 116 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.7 MB/s) 2024-09-12T00:33:03.214 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 25 MB/s) 2024-09-12T00:33:03.224 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 16/267 kB Progress (1): 32/267 kB Progress (1): 49/267 kB Progress (1): 65/267 kB Progress (1): 81/267 kB Progress (1): 98/267 kB Progress (1): 114/267 kB Progress (1): 130/267 kB Progress (1): 145/267 kB Progress (1): 161/267 kB Progress (1): 178/267 kB Progress (1): 194/267 kB Progress (1): 210/267 kB Progress (1): 227/267 kB Progress (1): 243/267 kB Progress (1): 260/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 5.2 MB/s) 2024-09-12T00:33:03.419 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-12T00:33:03.450 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:33:03.450 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] BUILD SUCCESS 2024-09-12T00:33:03.450 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:33:03.451 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] Total time: 8.839 s 2024-09-12T00:33:03.451 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] Finished at: 2024-09-12T00:33:03Z 2024-09-12T00:33:03.451 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:33:03.486 INFO:tasks.workunit.client.0.smithi043.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-12T00:33:03.493 INFO:tasks.workunit.client.0.smithi043.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T00:33:04.830 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] Scanning for projects... 2024-09-12T00:33:04.938 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] 2024-09-12T00:33:04.938 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T00:33:04.938 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] Building jcksum 1.0 2024-09-12T00:33:04.939 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] from pom.xml 2024-09-12T00:33:04.939 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T00:33:05.204 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] 2024-09-12T00:33:05.204 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T00:33:05.320 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T00:33:05.321 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] 2024-09-12T00:33:05.321 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T00:33:05.417 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T00:33:05.417 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] 2024-09-12T00:33:05.417 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T00:33:05.419 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T00:33:05.420 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] 2024-09-12T00:33:05.420 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T00:33:05.425 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T00:33:05.425 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] 2024-09-12T00:33:05.425 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T00:33:05.630 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-12T00:33:05.840 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-12T00:33:06.051 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 22 kB/s) 2024-09-12T00:33:06.059 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-12T00:33:06.077 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 145 kB/s) 2024-09-12T00:33:06.082 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-12T00:33:06.100 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 156 kB/s) 2024-09-12T00:33:06.105 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-12T00:33:06.122 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 178 kB/s) 2024-09-12T00:33:06.124 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-12T00:33:06.142 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 178 kB/s) 2024-09-12T00:33:06.145 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-12T00:33:06.161 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 105 kB/s) 2024-09-12T00:33:06.163 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-12T00:33:06.181 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 157 kB/s) 2024-09-12T00:33:06.188 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-12T00:33:06.215 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 16/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.0 MB/s) 2024-09-12T00:33:06.217 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-12T00:33:06.217 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-12T00:33:06.217 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-12T00:33:06.218 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-12T00:33:06.218 INFO:tasks.workunit.client.0.smithi043.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-12T00:33:06.240 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 15/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 702 kB/s) 2024-09-12T00:33:06.273 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 1.4/103 kB Progress (2): 1.4/103 kB | 1.4/189 kB Progress (3): 1.4/103 kB | 1.4/189 kB | 1.4/7.7 kB Progress (4): 1.4/103 kB | 1.4/189 kB | 1.4/7.7 kB | 1.4/169 kB Progress (4): 1.4/103 kB | 1.4/189 kB | 2.8/7.7 kB | 1.4/169 kB Progress (4): 1.4/103 kB | 2.8/189 kB | 2.8/7.7 kB | 1.4/169 kB Progress (4): 2.8/103 kB | 2.8/189 kB | 2.8/7.7 kB | 1.4/169 kB Progress (4): 2.8/103 kB | 4.1/189 kB | 2.8/7.7 kB | 1.4/169 kB Progress (4): 2.8/103 kB | 4.1/189 kB | 4.1/7.7 kB | 1.4/169 kB Progress (4): 2.8/103 kB | 4.1/189 kB | 4.1/7.7 kB | 2.8/169 kB Progress (4): 2.8/103 kB | 4.1/189 kB | 5.5/7.7 kB | 2.8/169 kB Progress (4): 2.8/103 kB | 5.5/189 kB | 5.5/7.7 kB | 2.8/169 kB Progress (4): 4.1/103 kB | 5.5/189 kB | 5.5/7.7 kB | 2.8/169 kB Progress (4): 4.1/103 kB | 6.9/189 kB | 5.5/7.7 kB | 2.8/169 kB Progress (4): 4.1/103 kB | 6.9/189 kB | 6.9/7.7 kB | 2.8/169 kB Progress (4): 4.1/103 kB | 6.9/189 kB | 6.9/7.7 kB | 4.1/169 kB Progress (4): 4.1/103 kB | 6.9/189 kB | 7.7 kB | 4.1/169 kB Progress (4): 4.1/103 kB | 8.3/189 kB | 7.7 kB | 4.1/169 kB Progress (4): 5.5/103 kB | 8.3/189 kB | 7.7 kB | 4.1/169 kB Progress (4): 5.5/103 kB | 9.7/189 kB | 7.7 kB | 4.1/169 kB Progress (4): 5.5/103 kB | 9.7/189 kB | 7.7 kB | 5.5/169 kB Progress (4): 5.5/103 kB | 11/189 kB | 7.7 kB | 5.5/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 137 kB/s) 2024-09-12T00:33:06.302 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (3): 6.9/103 kB | 11/189 kB | 5.5/169 kB Progress (3): 6.9/103 kB | 12/189 kB | 5.5/169 kB Progress (3): 6.9/103 kB | 12/189 kB | 6.9/169 kB Progress (3): 8.3/103 kB | 12/189 kB | 6.9/169 kB Progress (3): 8.3/103 kB | 12/189 kB | 8.3/169 kB Progress (3): 8.3/103 kB | 14/189 kB | 8.3/169 kB Progress (3): 8.3/103 kB | 14/189 kB | 9.7/169 kB Progress (3): 9.7/103 kB | 14/189 kB | 9.7/169 kB Progress (3): 9.7/103 kB | 14/189 kB | 11/169 kB Progress (3): 9.7/103 kB | 15/189 kB | 11/169 kB Progress (3): 9.7/103 kB | 15/189 kB | 12/169 kB Progress (3): 11/103 kB | 15/189 kB | 12/169 kB Progress (3): 11/103 kB | 15/189 kB | 14/169 kB Progress (3): 11/103 kB | 16/189 kB | 14/169 kB Progress (3): 11/103 kB | 16/189 kB | 15/169 kB Progress (3): 12/103 kB | 16/189 kB | 15/169 kB Progress (3): 12/103 kB | 16/189 kB | 17/169 kB Progress (3): 14/103 kB | 16/189 kB | 17/169 kB Progress (3): 14/103 kB | 16/189 kB | 18/169 kB Progress (3): 15/103 kB | 16/189 kB | 18/169 kB Progress (3): 15/103 kB | 16/189 kB | 19/169 kB Progress (3): 16/103 kB | 16/189 kB | 19/169 kB Progress (3): 16/103 kB | 16/189 kB | 21/169 kB Progress (3): 16/103 kB | 32/189 kB | 21/169 kB Progress (3): 16/103 kB | 32/189 kB | 22/169 kB Progress (3): 16/103 kB | 32/189 kB | 23/169 kB Progress (3): 16/103 kB | 32/189 kB | 25/169 kB Progress (3): 16/103 kB | 32/189 kB | 26/169 kB Progress (3): 32/103 kB | 32/189 kB | 26/169 kB Progress (3): 32/103 kB | 32/189 kB | 28/169 kB Progress (3): 32/103 kB | 49/189 kB | 28/169 kB Progress (3): 32/103 kB | 49/189 kB | 29/169 kB Progress (3): 32/103 kB | 49/189 kB | 30/169 kB Progress (3): 32/103 kB | 49/189 kB | 32/169 kB Progress (3): 32/103 kB | 49/189 kB | 33/169 kB Progress (3): 32/103 kB | 49/189 kB | 34/169 kB Progress (3): 32/103 kB | 49/189 kB | 36/169 kB Progress (3): 49/103 kB | 49/189 kB | 36/169 kB Progress (3): 49/103 kB | 65/189 kB | 36/169 kB Progress (3): 49/103 kB | 65/189 kB | 37/169 kB Progress (3): 49/103 kB | 65/189 kB | 39/169 kB Progress (3): 49/103 kB | 65/189 kB | 40/169 kB Progress (3): 65/103 kB | 65/189 kB | 40/169 kB Progress (3): 65/103 kB | 65/189 kB | 41/169 kB Progress (3): 65/103 kB | 65/189 kB | 42/169 kB Progress (3): 65/103 kB | 81/189 kB | 42/169 kB Progress (3): 65/103 kB | 81/189 kB | 58/169 kB Progress (3): 65/103 kB | 98/189 kB | 58/169 kB Progress (3): 65/103 kB | 98/189 kB | 75/169 kB Progress (3): 81/103 kB | 98/189 kB | 75/169 kB Progress (3): 81/103 kB | 114/189 kB | 75/169 kB Progress (3): 81/103 kB | 114/189 kB | 91/169 kB Progress (3): 98/103 kB | 114/189 kB | 91/169 kB Progress (3): 103 kB | 114/189 kB | 91/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.2 MB/s) 2024-09-12T00:33:06.312 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (2): 114/189 kB | 108/169 kB Progress (2): 130/189 kB | 108/169 kB Progress (2): 130/189 kB | 124/169 kB Progress (2): 147/189 kB | 124/169 kB Progress (2): 147/189 kB | 140/169 kB Progress (2): 147/189 kB | 157/169 kB Progress (2): 163/189 kB | 157/169 kB Progress (2): 163/189 kB | 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 1.8 MB/s) 2024-09-12T00:33:06.314 INFO:tasks.workunit.client.0.smithi043.stdout:Progress (1): 180/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.0 MB/s) 2024-09-12T00:33:06.333 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] 2024-09-12T00:33:06.333 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] ------------------------------------------------------- 2024-09-12T00:33:06.333 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] T E S T S 2024-09-12T00:33:06.333 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] ------------------------------------------------------- 2024-09-12T00:33:06.899 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-12T00:33:06.974 INFO:tasks.workunit.client.0.smithi043.stdout:PutObjects.java: starting test run: 2024-09-12T00:33:06.974 INFO:tasks.workunit.client.0.smithi043.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:33:06.974 INFO:tasks.workunit.client.0.smithi043.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:33:06.974 INFO:tasks.workunit.client.0.smithi043.stdout: EndpointUrl=https://smithi043.front.sepia.ceph.com:443 2024-09-12T00:33:06.975 INFO:tasks.workunit.client.0.smithi043.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-12T00:33:07.172 INFO:tasks.workunit.client.0.smithi043.stdout:DEBUG: Environment Variables Read 2024-09-12T00:33:07.474 INFO:tasks.workunit.client.0.smithi043.stdout:DEBUG: S3 Client Initialized 2024-09-12T00:33:07.474 INFO:tasks.workunit.client.0.smithi043.stdout:DEBUG: Generating File 2024-09-12T00:33:07.474 INFO:tasks.workunit.client.0.smithi043.stdout:DEBUG: File Generated 2024-09-12T00:33:07.474 INFO:tasks.workunit.client.0.smithi043.stdout:DEBUG: Generating File 2024-09-12T00:33:07.475 INFO:tasks.workunit.client.0.smithi043.stdout:DEBUG: File Generated 2024-09-12T00:33:07.475 INFO:tasks.workunit.client.0.smithi043.stdout:DEBUG: Generating File 2024-09-12T00:33:07.475 INFO:tasks.workunit.client.0.smithi043.stdout:DEBUG: File Generated 2024-09-12T00:33:07.475 INFO:tasks.workunit.client.0.smithi043.stdout:DEBUG: Generating File 2024-09-12T00:33:07.475 INFO:tasks.workunit.client.0.smithi043.stdout:DEBUG: File Generated 2024-09-12T00:33:07.475 INFO:tasks.workunit.client.0.smithi043.stdout:DEBUG: Generating File 2024-09-12T00:33:07.475 INFO:tasks.workunit.client.0.smithi043.stdout:DEBUG: File Generated 2024-09-12T00:33:07.475 INFO:tasks.workunit.client.0.smithi043.stdout:DEBUG: Generating File 2024-09-12T00:33:07.475 INFO:tasks.workunit.client.0.smithi043.stdout:DEBUG: File Generated 2024-09-12T00:33:07.475 INFO:tasks.workunit.client.0.smithi043.stdout:DEBUG: Generated Big Files 2024-09-12T00:33:07.852 INFO:tasks.workunit.client.0.smithi043.stdout:HeadBucketResponse() 2024-09-12T00:33:07.852 INFO:tasks.workunit.client.0.smithi043.stdout:sheik is ready 2024-09-12T00:33:07.852 INFO:tasks.workunit.client.0.smithi043.stdout:DEBUG: Test Bucket Created 2024-09-12T00:33:07.874 INFO:tasks.workunit.client.0.smithi043.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-12T00:33:08.075 INFO:tasks.workunit.client.0.smithi043.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-12T00:33:08.168 INFO:tasks.workunit.client.0.smithi043.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-12T00:33:08.175 INFO:tasks.workunit.client.0.smithi043.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-12T00:33:08.370 INFO:tasks.workunit.client.0.smithi043.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-12T00:33:08.376 INFO:tasks.workunit.client.0.smithi043.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-12T00:33:08.576 INFO:tasks.workunit.client.0.smithi043.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-12T00:33:08.676 INFO:tasks.workunit.client.0.smithi043.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-12T00:33:08.776 INFO:tasks.workunit.client.0.smithi043.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-12T00:33:08.977 INFO:tasks.workunit.client.0.smithi043.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-12T00:33:11.583 INFO:tasks.workunit.client.0.smithi043.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-12T00:33:12.585 INFO:tasks.workunit.client.0.smithi043.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-12T00:33:16.076 INFO:tasks.workunit.client.0.smithi043.stdout:arg: file-0b 2024-09-12T00:33:16.077 INFO:tasks.workunit.client.0.smithi043.stdout:arg: file-8b 2024-09-12T00:33:16.079 INFO:tasks.workunit.client.0.smithi043.stdout:arg: file-200b 2024-09-12T00:33:16.080 INFO:tasks.workunit.client.0.smithi043.stdout:arg: file-21983b 2024-09-12T00:33:16.081 INFO:tasks.workunit.client.0.smithi043.stdout:arg: file-5519b 2024-09-12T00:33:16.082 INFO:tasks.workunit.client.0.smithi043.stdout:arg: file-204329b 2024-09-12T00:33:16.083 INFO:tasks.workunit.client.0.smithi043.stdout:arg: file-256k 2024-09-12T00:33:16.084 INFO:tasks.workunit.client.0.smithi043.stdout:arg: file-1m 2024-09-12T00:33:16.085 INFO:tasks.workunit.client.0.smithi043.stdout:arg: file-1038757b 2024-09-12T00:33:16.092 INFO:tasks.workunit.client.0.smithi043.stdout:putObjectFromFileCksum called with file-0b 2024-09-12T00:33:16.130 INFO:tasks.workunit.client.0.smithi043.stdout:PutObjectResponse 2024-09-12T00:33:16.193 INFO:tasks.workunit.client.0.smithi043.stdout:putObjectFromFileCksum called with file-8b 2024-09-12T00:33:16.193 INFO:tasks.workunit.client.0.smithi043.stdout:PutObjectResponse 2024-09-12T00:33:16.271 INFO:tasks.workunit.client.0.smithi043.stdout:putObjectFromFileCksum called with file-200b 2024-09-12T00:33:16.271 INFO:tasks.workunit.client.0.smithi043.stdout:PutObjectResponse 2024-09-12T00:33:16.293 INFO:tasks.workunit.client.0.smithi043.stdout:putObjectFromFileCksum called with file-21983b 2024-09-12T00:33:16.355 INFO:tasks.workunit.client.0.smithi043.stdout:PutObjectResponse 2024-09-12T00:33:16.394 INFO:tasks.workunit.client.0.smithi043.stdout:putObjectFromFileCksum called with file-5519b 2024-09-12T00:33:16.394 INFO:tasks.workunit.client.0.smithi043.stdout:PutObjectResponse 2024-09-12T00:33:16.494 INFO:tasks.workunit.client.0.smithi043.stdout:putObjectFromFileCksum called with file-204329b 2024-09-12T00:33:16.526 INFO:tasks.workunit.client.0.smithi043.stdout:PutObjectResponse 2024-09-12T00:33:16.594 INFO:tasks.workunit.client.0.smithi043.stdout:putObjectFromFileCksum called with file-256k 2024-09-12T00:33:16.595 INFO:tasks.workunit.client.0.smithi043.stdout:PutObjectResponse 2024-09-12T00:33:16.694 INFO:tasks.workunit.client.0.smithi043.stdout:putObjectFromFileCksum called with file-1m 2024-09-12T00:33:16.694 INFO:tasks.workunit.client.0.smithi043.stdout:PutObjectResponse 2024-09-12T00:33:16.794 INFO:tasks.workunit.client.0.smithi043.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-12T00:33:16.873 INFO:tasks.workunit.client.0.smithi043.stdout:PutObjectResponse 2024-09-12T00:33:16.894 INFO:tasks.workunit.client.0.smithi043.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-12T00:33:17.596 INFO:tasks.workunit.client.0.smithi043.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-12T00:33:18.197 INFO:tasks.workunit.client.0.smithi043.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-12T00:33:25.257 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.34 s -- in io.ceph.jcksum.PutObjects 2024-09-12T00:33:25.299 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] 2024-09-12T00:33:25.299 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] Results: 2024-09-12T00:33:25.299 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] 2024-09-12T00:33:25.299 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-12T00:33:25.299 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] 2024-09-12T00:33:25.301 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:33:25.302 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] BUILD SUCCESS 2024-09-12T00:33:25.302 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:33:25.302 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] Total time: 20.498 s 2024-09-12T00:33:25.302 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] Finished at: 2024-09-12T00:33:25Z 2024-09-12T00:33:25.303 INFO:tasks.workunit.client.0.smithi043.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:33:25.324 INFO:tasks.workunit.client.0.smithi043.stderr:+ exit 2024-09-12T00:33:25.405 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:33:25.405 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:33:25.420 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-12T00:33:25.420 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:33:25.837 DEBUG:teuthology.parallel:result is None 2024-09-12T00:33:25.838 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:33:25.850 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:33:25.851 DEBUG:teuthology.orchestra.run.smithi043:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:33:25.901 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:33:25.901 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:33:25.913 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:33:25.913 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:33:25.913 DEBUG:teuthology.orchestra.run.smithi043:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:33:25.949 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:33:25.950 INFO:teuthology.orchestra.run.smithi043.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:33:25.950 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:33:25.997 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:33:25.998 DEBUG:teuthology.orchestra.run.smithi043:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:33:26.045 INFO:tasks.workunit:timeout=3h 2024-09-12T00:33:26.045 INFO:tasks.workunit:cleanup=True 2024-09-12T00:33:26.046 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:33:26.096 INFO:tasks.workunit.client.0.smithi043.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:34:11.137 INFO:tasks.workunit.client.0.smithi043.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:34:11.137 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:34:11.138 INFO:tasks.workunit.client.0.smithi043.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:34:11.138 INFO:tasks.workunit.client.0.smithi043.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:34:11.138 INFO:tasks.workunit.client.0.smithi043.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:34:11.138 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:34:11.138 INFO:tasks.workunit.client.0.smithi043.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:34:11.138 INFO:tasks.workunit.client.0.smithi043.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:34:11.138 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:34:11.138 INFO:tasks.workunit.client.0.smithi043.stderr: git switch -c 2024-09-12T00:34:11.138 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:34:11.138 INFO:tasks.workunit.client.0.smithi043.stderr:Or undo this operation with: 2024-09-12T00:34:11.138 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:34:11.138 INFO:tasks.workunit.client.0.smithi043.stderr: git switch - 2024-09-12T00:34:11.139 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:34:11.139 INFO:tasks.workunit.client.0.smithi043.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:34:11.139 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:34:11.139 INFO:tasks.workunit.client.0.smithi043.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:34:11.143 DEBUG:teuthology.orchestra.run.smithi043:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:34:11.190 INFO:tasks.workunit.client.0.smithi043.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:34:11.193 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:34:11.193 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:34:11.250 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:34:11.303 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:34:11.351 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:34:11.352 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:34:11.353 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:34:11.403 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:34:11.407 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:34:11.407 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:34:11.458 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-12T00:34:11.459 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-12T00:34:11.459 DEBUG:teuthology.orchestra.run.smithi043:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-12T00:34:11.514 INFO:tasks.workunit.client.0.smithi043.stdout:INFO: fully qualified domain name: smithi043.front.sepia.ceph.com 2024-09-12T00:34:11.514 INFO:tasks.workunit.client.0.smithi043.stdout:== TESTING *ABORTING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-12T00:34:11.515 INFO:tasks.workunit.client.0.smithi043.stdout:== TESTING NON-VERSIONED BUCKET == 2024-09-12T00:34:15.021 INFO:tasks.workunit.client.0.smithi043.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T00:34:15.236 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting pip 2024-09-12T00:34:15.242 INFO:tasks.workunit.client.0.smithi043.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:34:15.279 INFO:tasks.workunit.client.0.smithi043.stdout:Installing collected packages: pip 2024-09-12T00:34:15.279 INFO:tasks.workunit.client.0.smithi043.stdout: Attempting uninstall: pip 2024-09-12T00:34:15.279 INFO:tasks.workunit.client.0.smithi043.stdout: Found existing installation: pip 22.0.2 2024-09-12T00:34:15.553 INFO:tasks.workunit.client.0.smithi043.stdout: Uninstalling pip-22.0.2: 2024-09-12T00:34:15.559 INFO:tasks.workunit.client.0.smithi043.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T00:34:16.326 INFO:tasks.workunit.client.0.smithi043.stdout:Successfully installed pip-24.2 2024-09-12T00:34:17.423 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting boto3 2024-09-12T00:34:17.425 INFO:tasks.workunit.client.0.smithi043.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:34:17.943 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:34:17.944 INFO:tasks.workunit.client.0.smithi043.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:34:17.991 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:34:17.993 INFO:tasks.workunit.client.0.smithi043.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:34:18.038 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:34:18.039 INFO:tasks.workunit.client.0.smithi043.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:34:18.090 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:34:18.091 INFO:tasks.workunit.client.0.smithi043.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:34:18.188 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:34:18.190 INFO:tasks.workunit.client.0.smithi043.stdout: Using cached urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-09-12T00:34:18.346 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:34:18.347 INFO:tasks.workunit.client.0.smithi043.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:34:18.351 INFO:tasks.workunit.client.0.smithi043.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:34:18.353 INFO:tasks.workunit.client.0.smithi043.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:34:18.363 INFO:tasks.workunit.client.0.smithi043.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:34:18.365 INFO:tasks.workunit.client.0.smithi043.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:34:18.366 INFO:tasks.workunit.client.0.smithi043.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:34:18.368 INFO:tasks.workunit.client.0.smithi043.stdout:Using cached urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-09-12T00:34:18.369 INFO:tasks.workunit.client.0.smithi043.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:34:18.446 INFO:tasks.workunit.client.0.smithi043.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:34:19.601 INFO:tasks.workunit.client.0.smithi043.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-09-12T00:34:20.214 INFO:tasks.workunit.client.0.smithi043.stdout:INFO: creating user 2024-09-12T00:34:20.588 INFO:tasks.workunit.client.0.smithi043.stdout:{ 2024-09-12T00:34:20.588 INFO:tasks.workunit.client.0.smithi043.stdout: "user_id": "testid", 2024-09-12T00:34:20.588 INFO:tasks.workunit.client.0.smithi043.stdout: "display_name": "M. Tester", 2024-09-12T00:34:20.589 INFO:tasks.workunit.client.0.smithi043.stdout: "email": "tester@ceph.com", 2024-09-12T00:34:20.589 INFO:tasks.workunit.client.0.smithi043.stdout: "suspended": 0, 2024-09-12T00:34:20.589 INFO:tasks.workunit.client.0.smithi043.stdout: "max_buckets": 1000, 2024-09-12T00:34:20.589 INFO:tasks.workunit.client.0.smithi043.stdout: "subusers": [], 2024-09-12T00:34:20.589 INFO:tasks.workunit.client.0.smithi043.stdout: "keys": [ 2024-09-12T00:34:20.589 INFO:tasks.workunit.client.0.smithi043.stdout: { 2024-09-12T00:34:20.589 INFO:tasks.workunit.client.0.smithi043.stdout: "user": "testid", 2024-09-12T00:34:20.589 INFO:tasks.workunit.client.0.smithi043.stdout: "access_key": "0555b35654ad1656d804", 2024-09-12T00:34:20.589 INFO:tasks.workunit.client.0.smithi043.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-12T00:34:20.590 INFO:tasks.workunit.client.0.smithi043.stdout: "active": true, 2024-09-12T00:34:20.590 INFO:tasks.workunit.client.0.smithi043.stdout: "create_date": "2024-09-12T00:34:20.580640Z" 2024-09-12T00:34:20.590 INFO:tasks.workunit.client.0.smithi043.stdout: } 2024-09-12T00:34:20.590 INFO:tasks.workunit.client.0.smithi043.stdout: ], 2024-09-12T00:34:20.590 INFO:tasks.workunit.client.0.smithi043.stdout: "swift_keys": [], 2024-09-12T00:34:20.590 INFO:tasks.workunit.client.0.smithi043.stdout: "caps": [], 2024-09-12T00:34:20.590 INFO:tasks.workunit.client.0.smithi043.stdout: "op_mask": "read, write, delete", 2024-09-12T00:34:20.590 INFO:tasks.workunit.client.0.smithi043.stdout: "default_placement": "", 2024-09-12T00:34:20.590 INFO:tasks.workunit.client.0.smithi043.stdout: "default_storage_class": "", 2024-09-12T00:34:20.590 INFO:tasks.workunit.client.0.smithi043.stdout: "placement_tags": [], 2024-09-12T00:34:20.590 INFO:tasks.workunit.client.0.smithi043.stdout: "bucket_quota": { 2024-09-12T00:34:20.590 INFO:tasks.workunit.client.0.smithi043.stdout: "enabled": false, 2024-09-12T00:34:20.590 INFO:tasks.workunit.client.0.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:34:20.591 INFO:tasks.workunit.client.0.smithi043.stdout: "max_size": -1, 2024-09-12T00:34:20.591 INFO:tasks.workunit.client.0.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:34:20.591 INFO:tasks.workunit.client.0.smithi043.stdout: "max_objects": -1 2024-09-12T00:34:20.591 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:34:20.591 INFO:tasks.workunit.client.0.smithi043.stdout: "user_quota": { 2024-09-12T00:34:20.591 INFO:tasks.workunit.client.0.smithi043.stdout: "enabled": false, 2024-09-12T00:34:20.591 INFO:tasks.workunit.client.0.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:34:20.591 INFO:tasks.workunit.client.0.smithi043.stdout: "max_size": -1, 2024-09-12T00:34:20.591 INFO:tasks.workunit.client.0.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:34:20.591 INFO:tasks.workunit.client.0.smithi043.stdout: "max_objects": -1 2024-09-12T00:34:20.592 INFO:tasks.workunit.client.0.smithi043.stdout: }, 2024-09-12T00:34:20.592 INFO:tasks.workunit.client.0.smithi043.stdout: "temp_url_keys": [], 2024-09-12T00:34:20.592 INFO:tasks.workunit.client.0.smithi043.stdout: "type": "rgw", 2024-09-12T00:34:20.592 INFO:tasks.workunit.client.0.smithi043.stdout: "mfa_ids": [], 2024-09-12T00:34:20.592 INFO:tasks.workunit.client.0.smithi043.stdout: "account_id": "", 2024-09-12T00:34:20.592 INFO:tasks.workunit.client.0.smithi043.stdout: "path": "/", 2024-09-12T00:34:20.592 INFO:tasks.workunit.client.0.smithi043.stdout: "create_date": "2024-09-12T00:34:20.580611Z", 2024-09-12T00:34:20.592 INFO:tasks.workunit.client.0.smithi043.stdout: "tags": [], 2024-09-12T00:34:20.592 INFO:tasks.workunit.client.0.smithi043.stdout: "group_ids": [] 2024-09-12T00:34:20.592 INFO:tasks.workunit.client.0.smithi043.stdout:} 2024-09-12T00:34:20.592 INFO:tasks.workunit.client.0.smithi043.stdout: 2024-09-12T00:34:29.307 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi043.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:29.307 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:34:29.358 INFO:tasks.workunit.client.0.smithi043.stderr:5+0 records in 2024-09-12T00:34:29.359 INFO:tasks.workunit.client.0.smithi043.stderr:5+0 records out 2024-09-12T00:34:29.359 INFO:tasks.workunit.client.0.smithi043.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0226338 s, 232 MB/s 2024-09-12T00:34:29.362 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi043.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:29.362 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:34:29.443 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi043.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:29.443 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:34:29.595 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi043.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:29.595 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:34:29.709 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi043.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:29.709 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:34:29.856 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi043.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:29.857 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:34:30.004 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi043.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:30.004 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:34:30.152 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi043.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:30.152 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:34:30.309 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi043.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:30.309 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:34:30.459 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi043.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:30.459 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:34:30.604 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi043.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:30.604 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:34:30.747 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi043.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:30.748 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:34:30.899 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi043.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:30.899 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:34:31.045 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi043.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:31.045 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:34:31.192 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi043.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:31.192 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:34:31.319 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi043.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:31.319 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:34:31.339 INFO:tasks.workunit.client.0.smithi043.stdout:bucket nams is reupload-bkt-120367 2024-09-12T00:34:31.340 INFO:tasks.workunit.client.0.smithi043.stdout:endpoint is https://smithi043.front.sepia.ceph.com:443 2024-09-12T00:34:31.340 INFO:tasks.workunit.client.0.smithi043.stdout:start UploadId=2~kFuPXETR7_hWyUrsgZk0fFoU7SVnaqu 2024-09-12T00:34:31.340 INFO:tasks.workunit.client.0.smithi043.stdout:phase 1 uploaded part {'ETag': '"985630856e707767d53de41ae2ac3ba2"', 'PartNumber': 1} 2024-09-12T00:34:31.340 INFO:tasks.workunit.client.0.smithi043.stdout:phase 1 uploaded part {'ETag': '"985630856e707767d53de41ae2ac3ba2"', 'PartNumber': 2} 2024-09-12T00:34:31.340 INFO:tasks.workunit.client.0.smithi043.stdout:phase 2 uploaded part {'ETag': '"985630856e707767d53de41ae2ac3ba2"', 'PartNumber': 1} 2024-09-12T00:34:31.340 INFO:tasks.workunit.client.0.smithi043.stdout:phase 2 uploaded part {'ETag': '"985630856e707767d53de41ae2ac3ba2"', 'PartNumber': 1} 2024-09-12T00:34:31.340 INFO:tasks.workunit.client.0.smithi043.stdout:phase 2 uploaded part {'ETag': '"985630856e707767d53de41ae2ac3ba2"', 'PartNumber': 1} 2024-09-12T00:34:31.340 INFO:tasks.workunit.client.0.smithi043.stdout:phase 2 uploaded part {'ETag': '"985630856e707767d53de41ae2ac3ba2"', 'PartNumber': 1} 2024-09-12T00:34:31.340 INFO:tasks.workunit.client.0.smithi043.stdout:phase 2 uploaded part {'ETag': '"985630856e707767d53de41ae2ac3ba2"', 'PartNumber': 1} 2024-09-12T00:34:31.340 INFO:tasks.workunit.client.0.smithi043.stdout:phase 2 uploaded part {'ETag': '"985630856e707767d53de41ae2ac3ba2"', 'PartNumber': 1} 2024-09-12T00:34:31.340 INFO:tasks.workunit.client.0.smithi043.stdout:phase 2 uploaded part {'ETag': '"985630856e707767d53de41ae2ac3ba2"', 'PartNumber': 1} 2024-09-12T00:34:31.340 INFO:tasks.workunit.client.0.smithi043.stdout:phase 2 uploaded part {'ETag': '"985630856e707767d53de41ae2ac3ba2"', 'PartNumber': 1} 2024-09-12T00:34:31.340 INFO:tasks.workunit.client.0.smithi043.stdout:phase 2 uploaded part {'ETag': '"985630856e707767d53de41ae2ac3ba2"', 'PartNumber': 1} 2024-09-12T00:34:31.341 INFO:tasks.workunit.client.0.smithi043.stdout:phase 2 uploaded part {'ETag': '"985630856e707767d53de41ae2ac3ba2"', 'PartNumber': 1} 2024-09-12T00:34:31.341 INFO:tasks.workunit.client.0.smithi043.stdout:phase 2 uploaded part {'ETag': '"985630856e707767d53de41ae2ac3ba2"', 'PartNumber': 1} 2024-09-12T00:34:31.341 INFO:tasks.workunit.client.0.smithi043.stdout:aborting multipart upload, parts=[{'ETag': '"985630856e707767d53de41ae2ac3ba2"', 'PartNumber': 1}, {'ETag': '"985630856e707767d53de41ae2ac3ba2"', 'PartNumber': 2}] 2024-09-12T00:34:32.951 INFO:tasks.workunit.client.0.smithi043.stdout:radosgw-admin bucket radoslist: 2024-09-12T00:34:33.043 INFO:tasks.workunit.client.0.smithi043.stdout:rados ls: 2024-09-12T00:34:33.059 INFO:tasks.workunit.client.0.smithi043.stdout:== PASSED == 2024-09-12T00:34:33.059 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:34:33.059 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:34:33.116 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-12T00:34:33.116 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:34:33.540 DEBUG:teuthology.parallel:result is None 2024-09-12T00:34:33.540 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:34:33.552 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:34:33.553 DEBUG:teuthology.orchestra.run.smithi043:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:34:33.601 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:34:33.601 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-12T00:34:33.615 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'force-branch': 'wip-67986', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-12T00:34:33.615 INFO:tasks.ragweed:Downloading ragweed... 2024-09-12T00:34:33.616 INFO:tasks.ragweed:Using branch 'wip-67986' for ragweed 2024-09-12T00:34:33.616 DEBUG:teuthology.orchestra.run.smithi043:> git clone -b wip-67986 https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:34:33.653 INFO:teuthology.orchestra.run.smithi043.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T00:34:33.836 INFO:tasks.ragweed:Creating rgw users... 2024-09-12T00:34:33.836 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-12T00:34:33.836 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key GQELIEBLLSNYODPWTIGW --secret X/EfpHbf3e0ZvsON0XAPaQ2i2XhZBluTzAfnrK0pE0Zyw0VP4EZnHA== --email ragweed.client.0+test@test.test --system false 2024-09-12T00:34:33.926 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:33.926 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:33.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.968+0000 7f372be7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:33.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.968+0000 7f372be7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:33.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.968+0000 7f372be7a9c0 20 realm 2024-09-12T00:34:33.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.968+0000 7f372be7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:33.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.968+0000 7f372be7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:33.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.968+0000 7f372be7a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:33.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.968+0000 7f372be7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:33.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.968+0000 7f372be7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:33.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.968+0000 7f372be7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:33.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.972+0000 7f372be7a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:33.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.972+0000 7f372be7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:33.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.972+0000 7f372be7a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:33.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.972+0000 7f372be7a9c0 20 searching for the correct realm 2024-09-12T00:34:33.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.980+0000 7f372917f640 0 -- 172.21.15.43:0/3658307128 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f3720027040 msgr2=0x7f3720027930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:33.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.984+0000 7f372917f640 0 -- 172.21.15.43:0/3658307128 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f35f407ef80 msgr2=0x7f35f40813b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:33.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.992+0000 7f372be7a9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:34:33.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.992+0000 7f372be7a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:33.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.992+0000 7f372be7a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:33.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.992+0000 7f372be7a9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:34:33.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.992+0000 7f372be7a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:33.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.992+0000 7f372be7a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:33.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.992+0000 7f372be7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:33.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.992+0000 7f372be7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:33.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.992+0000 7f372be7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:33.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.992+0000 7f372be7a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:33.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.992+0000 7f372be7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:33.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.992+0000 7f372be7a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:33.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.992+0000 7f372be7a9c0 20 zone default found 2024-09-12T00:34:33.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.992+0000 7f372be7a9c0 4 Realm: () 2024-09-12T00:34:33.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.992+0000 7f372be7a9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:34:33.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.992+0000 7f372be7a9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:34:33.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.992+0000 7f372be7a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:33.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.992+0000 7f372be7a9c0 20 zonegroup default 2024-09-12T00:34:33.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.992+0000 7f372be7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:33.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.992+0000 7f372be7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:33.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.992+0000 7f372be7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:33.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.992+0000 7f372be7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:33.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.992+0000 7f372be7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:33.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.992+0000 7f372be7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:33.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.992+0000 7f372be7a9c0 20 started sync module instance, tier type = 2024-09-12T00:34:33.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:33.992+0000 7f372be7a9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:34:34.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.008+0000 7f372be7a9c0 20 add_watcher() i=0 2024-09-12T00:34:34.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.008+0000 7f372be7a9c0 20 add_watcher() i=1 2024-09-12T00:34:34.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.008+0000 7f372be7a9c0 20 add_watcher() i=2 2024-09-12T00:34:34.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.008+0000 7f372be7a9c0 20 add_watcher() i=3 2024-09-12T00:34:34.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.008+0000 7f372be7a9c0 20 add_watcher() i=4 2024-09-12T00:34:34.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.008+0000 7f372be7a9c0 20 add_watcher() i=5 2024-09-12T00:34:34.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.008+0000 7f372be7a9c0 20 add_watcher() i=6 2024-09-12T00:34:34.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.012+0000 7f372be7a9c0 20 add_watcher() i=7 2024-09-12T00:34:34.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.012+0000 7f372be7a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:34.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.012+0000 7f35db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:34.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.012+0000 7f372be7a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:34.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.012+0000 7f372be7a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:34.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.012+0000 7f372be7a9c0 5 note: GC not initialized 2024-09-12T00:34:34.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.012+0000 7f35da7fc640 20 reqs_thread_entry: start 2024-09-12T00:34:34.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.012+0000 7f372be7a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:34.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.012+0000 7f372be7a9c0 20 Filter name: none 2024-09-12T00:34:34.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.012+0000 7f354bfff640 20 reqs_thread_entry: start 2024-09-12T00:34:34.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.016+0000 7f372be7a9c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T00:34:34.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.016+0000 7f372be7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.016+0000 7f372be7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:34.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.016+0000 7f372be7a9c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-12T00:34:34.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.016+0000 7f372be7a9c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:34:34.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.016+0000 7f372be7a9c0 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-12T00:34:34.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.016+0000 7f372be7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.016+0000 7f372be7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:34.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.016+0000 7f372be7a9c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-12T00:34:34.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.016+0000 7f372be7a9c0 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:34:34.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.016+0000 7f372be7a9c0 10 cache get: name=default.rgw.meta+users.keys+GQELIEBLLSNYODPWTIGW : miss 2024-09-12T00:34:34.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.016+0000 7f372be7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.016+0000 7f372be7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:34.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.016+0000 7f372be7a9c0 10 cache put: name=default.rgw.meta+users.keys+GQELIEBLLSNYODPWTIGW info.flags=0x0 2024-09-12T00:34:34.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.016+0000 7f372be7a9c0 10 adding default.rgw.meta+users.keys+GQELIEBLLSNYODPWTIGW to cache LRU end 2024-09-12T00:34:34.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.016+0000 7f372be7a9c0 10 cache get: name=default.rgw.meta+users.keys+GQELIEBLLSNYODPWTIGW : hit (negative entry) 2024-09-12T00:34:34.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.016+0000 7f372be7a9c0 10 cache get: name=default.rgw.meta+users.keys+GQELIEBLLSNYODPWTIGW : hit (negative entry) 2024-09-12T00:34:34.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.020+0000 7f372be7a9c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T00:34:34.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.020+0000 7f372be7a9c0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:34:34.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.020+0000 7f372be7a9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T00:34:34.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.020+0000 7f360d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595091 cookie 94352461079232 notifier 5648 bl.length()=675 2024-09-12T00:34:34.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.020+0000 7f360d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T00:34:34.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.020+0000 7f360d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:34:34.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.024+0000 7f372be7a9c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T00:34:34.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.024+0000 7f372be7a9c0 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:34:34.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.024+0000 7f372be7a9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T00:34:34.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.024+0000 7f360d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595128 cookie 94352461065600 notifier 5648 bl.length()=202 2024-09-12T00:34:34.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.024+0000 7f360d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T00:34:34.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.024+0000 7f360d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:34:34.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.028+0000 7f372be7a9c0 10 cache put: name=default.rgw.meta+users.keys+GQELIEBLLSNYODPWTIGW info.flags=0x7 2024-09-12T00:34:34.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.028+0000 7f372be7a9c0 10 moving default.rgw.meta+users.keys+GQELIEBLLSNYODPWTIGW to cache LRU end 2024-09-12T00:34:34.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.028+0000 7f372be7a9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:GQELIEBLLSNYODPWTIGW, ofs0, ns] 2024-09-12T00:34:34.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.028+0000 7f360cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595085 cookie 94352461086624 notifier 5648 bl.length()=190 2024-09-12T00:34:34.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.028+0000 7f360cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+GQELIEBLLSNYODPWTIGW info.flags=0x7 2024-09-12T00:34:34.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.028+0000 7f360cff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+GQELIEBLLSNYODPWTIGW to cache LRU end 2024-09-12T00:34:34.028 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T00:34:34.029 INFO:teuthology.orchestra.run.smithi043.stdout: "user_id": "ragweed.client.0", 2024-09-12T00:34:34.029 INFO:teuthology.orchestra.run.smithi043.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-12T00:34:34.029 INFO:teuthology.orchestra.run.smithi043.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-12T00:34:34.029 INFO:teuthology.orchestra.run.smithi043.stdout: "suspended": 0, 2024-09-12T00:34:34.029 INFO:teuthology.orchestra.run.smithi043.stdout: "max_buckets": 1000, 2024-09-12T00:34:34.029 INFO:teuthology.orchestra.run.smithi043.stdout: "subusers": [], 2024-09-12T00:34:34.029 INFO:teuthology.orchestra.run.smithi043.stdout: "keys": [ 2024-09-12T00:34:34.029 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T00:34:34.029 INFO:teuthology.orchestra.run.smithi043.stdout: "user": "ragweed.client.0", 2024-09-12T00:34:34.029 INFO:teuthology.orchestra.run.smithi043.stdout: "access_key": "GQELIEBLLSNYODPWTIGW", 2024-09-12T00:34:34.029 INFO:teuthology.orchestra.run.smithi043.stdout: "secret_key": "X/EfpHbf3e0ZvsON0XAPaQ2i2XhZBluTzAfnrK0pE0Zyw0VP4EZnHA==", 2024-09-12T00:34:34.030 INFO:teuthology.orchestra.run.smithi043.stdout: "active": true, 2024-09-12T00:34:34.030 INFO:teuthology.orchestra.run.smithi043.stdout: "create_date": "2024-09-12T00:34:34.019124Z" 2024-09-12T00:34:34.030 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T00:34:34.030 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-12T00:34:34.030 INFO:teuthology.orchestra.run.smithi043.stdout: "swift_keys": [], 2024-09-12T00:34:34.030 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": [], 2024-09-12T00:34:34.030 INFO:teuthology.orchestra.run.smithi043.stdout: "op_mask": "read, write, delete", 2024-09-12T00:34:34.030 INFO:teuthology.orchestra.run.smithi043.stdout: "default_placement": "", 2024-09-12T00:34:34.030 INFO:teuthology.orchestra.run.smithi043.stdout: "default_storage_class": "", 2024-09-12T00:34:34.030 INFO:teuthology.orchestra.run.smithi043.stdout: "placement_tags": [], 2024-09-12T00:34:34.031 INFO:teuthology.orchestra.run.smithi043.stdout: "bucket_quota": { 2024-09-12T00:34:34.031 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": false, 2024-09-12T00:34:34.031 INFO:teuthology.orchestra.run.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:34:34.031 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size": -1, 2024-09-12T00:34:34.031 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:34:34.031 INFO:teuthology.orchestra.run.smithi043.stdout: "max_objects": -1 2024-09-12T00:34:34.031 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T00:34:34.031 INFO:teuthology.orchestra.run.smithi043.stdout: "user_quota": { 2024-09-12T00:34:34.031 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": false, 2024-09-12T00:34:34.031 INFO:teuthology.orchestra.run.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:34:34.031 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size": -1, 2024-09-12T00:34:34.031 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:34:34.031 INFO:teuthology.orchestra.run.smithi043.stdout: "max_objects": -1 2024-09-12T00:34:34.032 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T00:34:34.032 INFO:teuthology.orchestra.run.smithi043.stdout: "temp_url_keys": [], 2024-09-12T00:34:34.032 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "rgw", 2024-09-12T00:34:34.032 INFO:teuthology.orchestra.run.smithi043.stdout: "mfa_ids": [], 2024-09-12T00:34:34.032 INFO:teuthology.orchestra.run.smithi043.stdout: "account_id": "", 2024-09-12T00:34:34.032 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-09-12T00:34:34.032 INFO:teuthology.orchestra.run.smithi043.stdout: "create_date": "2024-09-12T00:34:34.019110Z", 2024-09-12T00:34:34.032 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-09-12T00:34:34.032 INFO:teuthology.orchestra.run.smithi043.stdout: "group_ids": [] 2024-09-12T00:34:34.032 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T00:34:34.032 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:34:34.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.032+0000 7f35db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:34.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.036+0000 7f372be7a9c0 20 remove_watcher() i=0 2024-09-12T00:34:34.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.036+0000 7f372be7a9c0 2 removed watcher, disabling cache 2024-09-12T00:34:34.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.040+0000 7f372be7a9c0 20 remove_watcher() i=1 2024-09-12T00:34:34.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.040+0000 7f372be7a9c0 20 remove_watcher() i=2 2024-09-12T00:34:34.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.044+0000 7f372be7a9c0 20 remove_watcher() i=3 2024-09-12T00:34:34.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.044+0000 7f372be7a9c0 20 remove_watcher() i=4 2024-09-12T00:34:34.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.048+0000 7f372be7a9c0 20 remove_watcher() i=5 2024-09-12T00:34:34.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.048+0000 7f372be7a9c0 20 remove_watcher() i=6 2024-09-12T00:34:34.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.048+0000 7f372be7a9c0 20 remove_watcher() i=7 2024-09-12T00:34:34.062 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-12T00:34:34.062 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key ELDSYCACUHKWGHYUFSRT --secret DBAFjZqpKYfKtIwH5liuKsm9iF5uKts1TMylLm+snQD8ALTJJiwDRg== --email sysuser.client.0+test@test.test --system true 2024-09-12T00:34:34.105 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:34.105 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:34.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.148+0000 7f02ae43e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.148+0000 7f02ae43e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:34.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.148+0000 7f02ae43e9c0 20 realm 2024-09-12T00:34:34.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.148+0000 7f02ae43e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.148+0000 7f02ae43e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:34.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.148+0000 7f02ae43e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:34.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.148+0000 7f02ae43e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.148+0000 7f02ae43e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:34.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.148+0000 7f02ae43e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.152+0000 7f02ae43e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:34.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.152+0000 7f02ae43e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.152+0000 7f02ae43e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:34.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.152+0000 7f02ae43e9c0 20 searching for the correct realm 2024-09-12T00:34:34.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.156+0000 7f02ac745640 0 -- 172.21.15.43:0/530769021 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f02940f7550 msgr2=0x7f02941193b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:34.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.372+0000 7f02abf44640 0 -- 172.21.15.43:0/530769021 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x558bc54fd350 msgr2=0x558bc54ff810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:34.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.380+0000 7f02ae43e9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:34:34.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.380+0000 7f02ae43e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:34.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.380+0000 7f02ae43e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:34.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.380+0000 7f02ae43e9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:34:34.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.380+0000 7f02ae43e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:34.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.380+0000 7f02ae43e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:34.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.380+0000 7f02ae43e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.384+0000 7f02ae43e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:34.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.384+0000 7f02ae43e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.384+0000 7f02ae43e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:34.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.384+0000 7f02ae43e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.384+0000 7f02ae43e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:34.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.384+0000 7f02ae43e9c0 20 zone default found 2024-09-12T00:34:34.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.384+0000 7f02ae43e9c0 4 Realm: () 2024-09-12T00:34:34.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.384+0000 7f02ae43e9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:34:34.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.384+0000 7f02ae43e9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:34:34.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.384+0000 7f02ae43e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:34.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.384+0000 7f02ae43e9c0 20 zonegroup default 2024-09-12T00:34:34.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.384+0000 7f02ae43e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.384+0000 7f02ae43e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:34.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.384+0000 7f02ae43e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.384+0000 7f02ae43e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:34.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.384+0000 7f02ae43e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.384+0000 7f02ae43e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:34.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.384+0000 7f02ae43e9c0 20 started sync module instance, tier type = 2024-09-12T00:34:34.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.384+0000 7f02ae43e9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:34:34.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.408+0000 7f02ae43e9c0 20 add_watcher() i=0 2024-09-12T00:34:34.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.408+0000 7f02ae43e9c0 20 add_watcher() i=1 2024-09-12T00:34:34.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.408+0000 7f02ae43e9c0 20 add_watcher() i=2 2024-09-12T00:34:34.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.408+0000 7f02ae43e9c0 20 add_watcher() i=3 2024-09-12T00:34:34.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.408+0000 7f02ae43e9c0 20 add_watcher() i=4 2024-09-12T00:34:34.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.408+0000 7f02ae43e9c0 20 add_watcher() i=5 2024-09-12T00:34:34.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.408+0000 7f02ae43e9c0 20 add_watcher() i=6 2024-09-12T00:34:34.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.412+0000 7f02ae43e9c0 20 add_watcher() i=7 2024-09-12T00:34:34.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.412+0000 7f02ae43e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:34.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.416+0000 7f0161fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:34.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.416+0000 7f02ae43e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:34.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.416+0000 7f02ae43e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:34.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.416+0000 7f02ae43e9c0 5 note: GC not initialized 2024-09-12T00:34:34.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.416+0000 7f0160fe1640 20 reqs_thread_entry: start 2024-09-12T00:34:34.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.416+0000 7f02ae43e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:34.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.416+0000 7f02ae43e9c0 20 Filter name: none 2024-09-12T00:34:34.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.416+0000 7f00da7fc640 20 reqs_thread_entry: start 2024-09-12T00:34:34.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.416+0000 7f02ae43e9c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T00:34:34.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.416+0000 7f02ae43e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.420+0000 7f02ae43e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:34.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.420+0000 7f02ae43e9c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-12T00:34:34.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.420+0000 7f02ae43e9c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:34:34.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.420+0000 7f02ae43e9c0 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-12T00:34:34.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.420+0000 7f02ae43e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.420+0000 7f02ae43e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:34.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.420+0000 7f02ae43e9c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-12T00:34:34.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.420+0000 7f02ae43e9c0 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:34:34.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.420+0000 7f02ae43e9c0 10 cache get: name=default.rgw.meta+users.keys+ELDSYCACUHKWGHYUFSRT : miss 2024-09-12T00:34:34.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.420+0000 7f02ae43e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.420+0000 7f02ae43e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:34.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.420+0000 7f02ae43e9c0 10 cache put: name=default.rgw.meta+users.keys+ELDSYCACUHKWGHYUFSRT info.flags=0x0 2024-09-12T00:34:34.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.420+0000 7f02ae43e9c0 10 adding default.rgw.meta+users.keys+ELDSYCACUHKWGHYUFSRT to cache LRU end 2024-09-12T00:34:34.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.420+0000 7f02ae43e9c0 10 cache get: name=default.rgw.meta+users.keys+ELDSYCACUHKWGHYUFSRT : hit (negative entry) 2024-09-12T00:34:34.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.420+0000 7f02ae43e9c0 10 cache get: name=default.rgw.meta+users.keys+ELDSYCACUHKWGHYUFSRT : hit (negative entry) 2024-09-12T00:34:34.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.424+0000 7f02ae43e9c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T00:34:34.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.424+0000 7f02ae43e9c0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:34:34.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.424+0000 7f02ae43e9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T00:34:34.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.424+0000 7f018affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595129 cookie 94058799209328 notifier 5666 bl.length()=675 2024-09-12T00:34:34.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.424+0000 7f018affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T00:34:34.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.424+0000 7f018affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:34:34.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.428+0000 7f02ae43e9c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T00:34:34.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.428+0000 7f02ae43e9c0 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:34:34.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.428+0000 7f02ae43e9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T00:34:34.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.428+0000 7f018affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595092 cookie 94058799215600 notifier 5666 bl.length()=202 2024-09-12T00:34:34.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.428+0000 7f018affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T00:34:34.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.428+0000 7f018affd640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:34:34.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.432+0000 7f02ae43e9c0 10 cache put: name=default.rgw.meta+users.keys+ELDSYCACUHKWGHYUFSRT info.flags=0x7 2024-09-12T00:34:34.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.432+0000 7f02ae43e9c0 10 moving default.rgw.meta+users.keys+ELDSYCACUHKWGHYUFSRT to cache LRU end 2024-09-12T00:34:34.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.432+0000 7f02ae43e9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:ELDSYCACUHKWGHYUFSRT, ofs0, ns] 2024-09-12T00:34:34.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.432+0000 7f018a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595093 cookie 94058799166752 notifier 5666 bl.length()=190 2024-09-12T00:34:34.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.432+0000 7f018a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ELDSYCACUHKWGHYUFSRT info.flags=0x7 2024-09-12T00:34:34.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.432+0000 7f018a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ELDSYCACUHKWGHYUFSRT to cache LRU end 2024-09-12T00:34:34.431 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T00:34:34.432 INFO:teuthology.orchestra.run.smithi043.stdout: "user_id": "sysuser.client.0", 2024-09-12T00:34:34.432 INFO:teuthology.orchestra.run.smithi043.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-12T00:34:34.432 INFO:teuthology.orchestra.run.smithi043.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-12T00:34:34.432 INFO:teuthology.orchestra.run.smithi043.stdout: "suspended": 0, 2024-09-12T00:34:34.432 INFO:teuthology.orchestra.run.smithi043.stdout: "max_buckets": 1000, 2024-09-12T00:34:34.432 INFO:teuthology.orchestra.run.smithi043.stdout: "subusers": [], 2024-09-12T00:34:34.432 INFO:teuthology.orchestra.run.smithi043.stdout: "keys": [ 2024-09-12T00:34:34.432 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T00:34:34.432 INFO:teuthology.orchestra.run.smithi043.stdout: "user": "sysuser.client.0", 2024-09-12T00:34:34.432 INFO:teuthology.orchestra.run.smithi043.stdout: "access_key": "ELDSYCACUHKWGHYUFSRT", 2024-09-12T00:34:34.432 INFO:teuthology.orchestra.run.smithi043.stdout: "secret_key": "DBAFjZqpKYfKtIwH5liuKsm9iF5uKts1TMylLm+snQD8ALTJJiwDRg==", 2024-09-12T00:34:34.433 INFO:teuthology.orchestra.run.smithi043.stdout: "active": true, 2024-09-12T00:34:34.433 INFO:teuthology.orchestra.run.smithi043.stdout: "create_date": "2024-09-12T00:34:34.422321Z" 2024-09-12T00:34:34.433 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T00:34:34.433 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-12T00:34:34.433 INFO:teuthology.orchestra.run.smithi043.stdout: "swift_keys": [], 2024-09-12T00:34:34.433 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": [], 2024-09-12T00:34:34.433 INFO:teuthology.orchestra.run.smithi043.stdout: "op_mask": "read, write, delete", 2024-09-12T00:34:34.433 INFO:teuthology.orchestra.run.smithi043.stdout: "system": true, 2024-09-12T00:34:34.433 INFO:teuthology.orchestra.run.smithi043.stdout: "default_placement": "", 2024-09-12T00:34:34.433 INFO:teuthology.orchestra.run.smithi043.stdout: "default_storage_class": "", 2024-09-12T00:34:34.434 INFO:teuthology.orchestra.run.smithi043.stdout: "placement_tags": [], 2024-09-12T00:34:34.434 INFO:teuthology.orchestra.run.smithi043.stdout: "bucket_quota": { 2024-09-12T00:34:34.434 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": false, 2024-09-12T00:34:34.434 INFO:teuthology.orchestra.run.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:34:34.434 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size": -1, 2024-09-12T00:34:34.434 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:34:34.434 INFO:teuthology.orchestra.run.smithi043.stdout: "max_objects": -1 2024-09-12T00:34:34.434 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T00:34:34.434 INFO:teuthology.orchestra.run.smithi043.stdout: "user_quota": { 2024-09-12T00:34:34.434 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": false, 2024-09-12T00:34:34.434 INFO:teuthology.orchestra.run.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:34:34.434 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size": -1, 2024-09-12T00:34:34.435 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:34:34.435 INFO:teuthology.orchestra.run.smithi043.stdout: "max_objects": -1 2024-09-12T00:34:34.435 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T00:34:34.435 INFO:teuthology.orchestra.run.smithi043.stdout: "temp_url_keys": [], 2024-09-12T00:34:34.435 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "rgw", 2024-09-12T00:34:34.435 INFO:teuthology.orchestra.run.smithi043.stdout: "mfa_ids": [], 2024-09-12T00:34:34.435 INFO:teuthology.orchestra.run.smithi043.stdout: "account_id": "", 2024-09-12T00:34:34.435 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-09-12T00:34:34.435 INFO:teuthology.orchestra.run.smithi043.stdout: "create_date": "2024-09-12T00:34:34.422284Z", 2024-09-12T00:34:34.435 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-09-12T00:34:34.436 INFO:teuthology.orchestra.run.smithi043.stdout: "group_ids": [] 2024-09-12T00:34:34.436 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T00:34:34.436 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:34:34.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.436+0000 7f0161fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:34.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.440+0000 7f02ae43e9c0 20 remove_watcher() i=0 2024-09-12T00:34:34.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.440+0000 7f02ae43e9c0 2 removed watcher, disabling cache 2024-09-12T00:34:34.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.444+0000 7f02ae43e9c0 20 remove_watcher() i=1 2024-09-12T00:34:34.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.444+0000 7f02ae43e9c0 20 remove_watcher() i=2 2024-09-12T00:34:34.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.448+0000 7f02ae43e9c0 20 remove_watcher() i=3 2024-09-12T00:34:34.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.448+0000 7f02ae43e9c0 20 remove_watcher() i=4 2024-09-12T00:34:34.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.452+0000 7f02ae43e9c0 20 remove_watcher() i=5 2024-09-12T00:34:34.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.452+0000 7f02ae43e9c0 20 remove_watcher() i=6 2024-09-12T00:34:34.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:34:34.452+0000 7f02ae43e9c0 20 remove_watcher() i=7 2024-09-12T00:34:34.469 INFO:tasks.ragweed:Configuring ragweed... 2024-09-12T00:34:34.470 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:34:34.470 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-12T00:34:34.518 INFO:tasks.ragweed:Configuring boto... 2024-09-12T00:34:34.518 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:34:34.519 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-12T00:34:34.566 DEBUG:teuthology.orchestra.run.smithi043:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-12T00:34:34.758 INFO:teuthology.orchestra.run.smithi043.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-12T00:34:34.943 INFO:teuthology.orchestra.run.smithi043.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-12T00:34:35.619 INFO:teuthology.orchestra.run.smithi043.stdout:py installdeps: -rrequirements.txt 2024-09-12T00:34:38.378 INFO:teuthology.orchestra.run.smithi043.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-12T00:34:42.913 INFO:teuthology.orchestra.run.smithi043.stdout:py installed: appdirs==1.4.4,asyncssh==2.5.0,attrs==21.2.0,Babel==2.8.0,bcrypt==3.2.0,beautifulsoup4==4.10.0,beniget==0.4.1,blinker==1.4,boto==2.49.0,Brotli==1.0.9,cachetools==5.0.0,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2020.6.20,chardet==4.0.0,cheroot==8.5.2+ds1,CherryPy==18.6.1,command-not-found==0.3,configobj==5.0.6,cryptography==3.4.8,cycler==0.11.0,dbus-python==1.2.18,decorator==4.4.2,distlib==0.3.4,distro==1.7.0,distro-info===1.1build1,docopt==0.6.2,execnet==1.9.0,filelock==3.6.0,fonttools==4.29.1,fs==2.4.12,gast==0.5.2,gevent==21.8.0,google-auth==1.5.1,greenlet==1.1.2,html5lib==1.1,httplib2==0.20.2,idna==3.3,importlib-metadata==4.6.4,iniconfig==1.1.1,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.4.0,jaraco.functools==3.4.0,jaraco.text==3.6.0,jeepney==0.7.1,Jinja2==3.0.3,joblib==0.17.0,keyring==23.5.0,kiwisolver==1.3.2,kubernetes==12.0.1,language-selector==0.1,launchpadlib==1.10.16,lazr.restfulclient==0.14.4,lazr.uri==1.0.6,logutils==0.3.3,lxml==4.8.0,lz4==3.1.3+dfsg,Mako==1.1.3,MarkupSafe==2.0.1,matplotlib==3.5.1,more-itertools==8.10.0,mpmath==0.0.0,munch==4.0.0,natsort==8.0.2,netifaces==0.11.0,nose==1.3.7,numpy==1.21.5,oauthlib==3.2.0,olefile==0.46,packaging==21.3,Paste==3.5.0,PasteDeploy==2.1.1,PasteScript==2.0.2,pecan==1.3.3,Pillow==9.0.1,platformdirs==2.5.1,pluggy==0.13.0,ply==3.11,portend==3.0.0,prettytable==2.5.0,psutil==5.9.0,py==1.10.0,pyasn1==0.4.8,pyasn1-modules==0.2.1,Pygments==2.11.2,PyGObject==3.42.1,pyinotify==0.9.6,PyJWT==2.3.0,pymacaroons==0.13.0,PyNaCl==1.5.0,pyOpenSSL==21.0.0,pyparsing==2.4.7,pytest==6.2.5,python-apt==2.3.0+ubuntu2.1,python-dateutil==2.8.1,python-magic==0.4.24,pythran==0.10.0,pytz==2022.1,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=aca88438b9c4f273c938dd4ca878a762205e81aedb1a16f6a34d120fc539e273,rbd==2.0.0,registries-conf-ctl @ git+https://github.com/sebastian-philipp/registries-conf-ctl@0e9bf2dc202aa9be9b0bf8e8265aac3f2308f9db,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rsa==4.8,s3cmd==2.2.0,scikit-learn==0.23.2,scipy==1.8.0,SecretStorage==3.3.1,simplegeneric==0.8.1,simplejson==3.17.6,six==1.16.0,soupsieve==2.3.1,ssh-import-id==5.11,sympy==1.9,Tempita==0.5.2,tempora==4.1.2,threadpoolctl==3.1.0,toml==0.10.2,ubuntu-advantage-tools==27.12,ufoLib2==0.13.1,ufw==0.36.1,unattended-upgrades==0.1,unicodedata2==14.0.0,urllib3==1.26.5,virtualenv==20.13.0+ds,wadllib==1.3.6,waitress==1.4.4,wcwidth==0.2.5,webencodings==0.5.1,WebOb==1.8.6,websocket-client==1.2.3,WebTest==2.0.35,Werkzeug==2.0.2,zc.lockfile==2.0,zipp==1.0.0,zope.event==4.4,zope.interface==5.4.0 2024-09-12T00:34:42.914 INFO:teuthology.orchestra.run.smithi043.stdout:py run-test-pre: PYTHONHASHSEED='3421087885' 2024-09-12T00:34:42.914 INFO:teuthology.orchestra.run.smithi043.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-12T00:34:43.093 INFO:teuthology.orchestra.run.smithi043.stdout:============================= test session starts ============================== 2024-09-12T00:34:43.093 INFO:teuthology.orchestra.run.smithi043.stdout:platform linux -- Python 3.10.6, pytest-6.2.5, py-1.10.0, pluggy-0.13.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-12T00:34:43.093 INFO:teuthology.orchestra.run.smithi043.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T00:34:43.093 INFO:teuthology.orchestra.run.smithi043.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0, configfile: pytest.ini 2024-09-12T00:34:43.252 INFO:teuthology.orchestra.run.smithi043.stdout:collecting ... collected 9 items 2024-09-12T00:34:43.252 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:34:45.474 INFO:teuthology.orchestra.run.smithi043.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-12T00:34:46.754 INFO:teuthology.orchestra.run.smithi043.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-12T00:34:47.784 INFO:teuthology.orchestra.run.smithi043.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-12T00:34:49.070 INFO:teuthology.orchestra.run.smithi043.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-12T00:34:50.207 INFO:teuthology.orchestra.run.smithi043.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-12T00:34:57.304 INFO:teuthology.orchestra.run.smithi043.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-12T00:34:59.703 INFO:teuthology.orchestra.run.smithi043.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-12T00:35:02.783 INFO:teuthology.orchestra.run.smithi043.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-12T00:35:07.563 INFO:teuthology.orchestra.run.smithi043.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-12T00:35:07.563 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:35:07.563 INFO:teuthology.orchestra.run.smithi043.stdout:=============================== warnings summary =============================== 2024-09-12T00:35:07.564 INFO:teuthology.orchestra.run.smithi043.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-12T00:35:07.564 INFO:teuthology.orchestra.run.smithi043.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-12T00:35:07.564 INFO:teuthology.orchestra.run.smithi043.stdout: import imp 2024-09-12T00:35:07.564 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:35:07.564 INFO:teuthology.orchestra.run.smithi043.stdout:-- Docs: https://docs.pytest.org/en/stable/warnings.html 2024-09-12T00:35:07.564 INFO:teuthology.orchestra.run.smithi043.stdout:======================== 9 passed, 1 warning in 24.47s ========================= 2024-09-12T00:35:07.610 INFO:teuthology.orchestra.run.smithi043.stdout:___________________________________ summary ____________________________________ 2024-09-12T00:35:07.610 INFO:teuthology.orchestra.run.smithi043.stdout: py: commands succeeded 2024-09-12T00:35:07.610 INFO:teuthology.orchestra.run.smithi043.stdout: congratulations :) 2024-09-12T00:35:07.635 INFO:tasks.ragweed:Cleaning up boto... 2024-09-12T00:35:07.636 DEBUG:teuthology.orchestra.run.smithi043:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-12T00:35:07.642 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-12T00:35:07.721 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:07.721 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:07.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:07.764+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:07.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:07.768+0000 7fd6545669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:07.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:07.768+0000 7fd6545669c0 20 realm 2024-09-12T00:35:07.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:07.768+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:07.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:07.768+0000 7fd6545669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:07.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:07.768+0000 7fd6545669c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:07.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:07.768+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:07.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:07.768+0000 7fd6545669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:07.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:07.768+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:07.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:07.768+0000 7fd6545669c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:07.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:07.768+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:07.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:07.768+0000 7fd6545669c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:07.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:07.768+0000 7fd6545669c0 20 searching for the correct realm 2024-09-12T00:35:07.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:07.776+0000 7fd65286d640 0 -- 172.21.15.43:0/1781388923 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7fd63c01b040 msgr2=0x7fd63c03e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:07.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:07.992+0000 7fd65206c640 0 -- 172.21.15.43:0/1781388923 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x55eca8636cb0 msgr2=0x55eca86390a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:07.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.000+0000 7fd6545669c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:35:07.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.000+0000 7fd6545669c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:07.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.000+0000 7fd6545669c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:07.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.000+0000 7fd6545669c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:35:07.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.000+0000 7fd6545669c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:07.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.000+0000 7fd6545669c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:07.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.000+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:07.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.000+0000 7fd6545669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:07.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.000+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.000+0000 7fd6545669c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:08.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.000+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.004+0000 7fd6545669c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:08.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.004+0000 7fd6545669c0 20 zone default found 2024-09-12T00:35:08.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.004+0000 7fd6545669c0 4 Realm: () 2024-09-12T00:35:08.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.004+0000 7fd6545669c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:35:08.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.004+0000 7fd6545669c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:35:08.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.004+0000 7fd6545669c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:08.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.004+0000 7fd6545669c0 20 zonegroup default 2024-09-12T00:35:08.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.004+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.004+0000 7fd6545669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:08.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.004+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.004+0000 7fd6545669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:08.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.004+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.004+0000 7fd6545669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:08.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.004+0000 7fd6545669c0 20 started sync module instance, tier type = 2024-09-12T00:35:08.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.004+0000 7fd6545669c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:35:08.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.028+0000 7fd6545669c0 20 add_watcher() i=0 2024-09-12T00:35:08.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.028+0000 7fd6545669c0 20 add_watcher() i=1 2024-09-12T00:35:08.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.028+0000 7fd6545669c0 20 add_watcher() i=2 2024-09-12T00:35:08.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.028+0000 7fd6545669c0 20 add_watcher() i=3 2024-09-12T00:35:08.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.028+0000 7fd6545669c0 20 add_watcher() i=4 2024-09-12T00:35:08.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.028+0000 7fd6545669c0 20 add_watcher() i=5 2024-09-12T00:35:08.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.028+0000 7fd6545669c0 20 add_watcher() i=6 2024-09-12T00:35:08.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.032+0000 7fd6545669c0 20 add_watcher() i=7 2024-09-12T00:35:08.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.032+0000 7fd6545669c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:08.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.036+0000 7fd5097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:08.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.036+0000 7fd6545669c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:08.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.036+0000 7fd6545669c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:08.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.128+0000 7fd5037fe640 20 reqs_thread_entry: start 2024-09-12T00:35:08.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.128+0000 7fd6545669c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:08.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.128+0000 7fd6545669c0 20 Filter name: none 2024-09-12T00:35:08.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.128+0000 7fd5017fa640 20 reqs_thread_entry: start 2024-09-12T00:35:08.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.128+0000 7fd6545669c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T00:35:08.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.128+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.132+0000 7fd6545669c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:35:08.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.132+0000 7fd6545669c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-12T00:35:08.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.132+0000 7fd6545669c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:35:08.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.132+0000 7fd6545669c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:08.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.132+0000 7fd6545669c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4 : miss 2024-09-12T00:35:08.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.132+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.132+0000 7fd6545669c0 20 rados_obj.operate() r=0 bl.length=426 2024-09-12T00:35:08.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.132+0000 7fd6545669c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4 info.flags=0x17 2024-09-12T00:35:08.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.132+0000 7fd6545669c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4 to cache LRU end 2024-09-12T00:35:08.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.132+0000 7fd6545669c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:08.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.132+0000 7fd6545669c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:35:08.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.132+0000 7fd6545669c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4 2024-09-12T00:35:08.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.136+0000 7fd6545669c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-12T00:35:08.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.136+0000 7fd6545669c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-12T00:35:08.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.136+0000 7fd6545669c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-12T00:35:08.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.136+0000 7fd6545669c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-12T00:35:08.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.136+0000 7fd6545669c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-12T00:35:08.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.136+0000 7fd6545669c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-12T00:35:08.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.140+0000 7fd6545669c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-12T00:35:08.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.140+0000 7fd6545669c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-12T00:35:08.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.140+0000 7fd6545669c0 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-12T00:35:08.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.144+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd63c01b940 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55eca86f0e48 s->prefetch_data=0 2024-09-12T00:35:08.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.144+0000 7fd6545669c0 10 manifest: total_size = 15981 2024-09-12T00:35:08.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.144+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7623603643247110329 2024-09-12T00:35:08.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.144+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd63c01b940 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55eca86f0e48 s->prefetch_data=0 2024-09-12T00:35:08.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.144+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca86f0e48 2024-09-12T00:35:08.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.144+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4.1 2024-09-12T00:35:08.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.148+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.148+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=15981 stripe_ofs=15981 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.148+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7623603643247110329 2024-09-12T00:35:08.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.148+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.148+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4__shadow_.2mkaUfsjbDWY8SoTsM_H2kGaZOeH9gu_0 2024-09-12T00:35:08.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.148+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:35:08.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.148+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.148+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7623603643247110329 2024-09-12T00:35:08.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.152+0000 7fd535ffb640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-12T00:35:08.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.152+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd63c01b940 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55eca86f0e48 s->prefetch_data=0 2024-09-12T00:35:08.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.152+0000 7fd6545669c0 10 manifest: total_size = 7412 2024-09-12T00:35:08.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.152+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12444483010910242781 2024-09-12T00:35:08.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.152+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd63c01b940 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55eca86f0e48 s->prefetch_data=0 2024-09-12T00:35:08.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.152+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca86f0e48 2024-09-12T00:35:08.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.152+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4.2 2024-09-12T00:35:08.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.160+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.160+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=7412 stripe_ofs=7412 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.160+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12444483010910242781 2024-09-12T00:35:08.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.160+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.160+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4__shadow_.f7zIRSQb3Jhvb8R_YaE7Dge7pqpatgZ_0 2024-09-12T00:35:08.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.160+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:35:08.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.160+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.160+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12444483010910242781 2024-09-12T00:35:08.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.160+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd63c01b940 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55eca86f0e48 s->prefetch_data=0 2024-09-12T00:35:08.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.160+0000 7fd6545669c0 10 manifest: total_size = 5244 2024-09-12T00:35:08.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.160+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14372164355579038794 2024-09-12T00:35:08.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.160+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd63c01b940 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55eca86f0e48 s->prefetch_data=0 2024-09-12T00:35:08.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.160+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca86f0e48 2024-09-12T00:35:08.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.160+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4.2 2024-09-12T00:35:08.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.160+0000 7fd5357fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-12T00:35:08.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.164+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.164+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=5244 stripe_ofs=5244 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.164+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14372164355579038794 2024-09-12T00:35:08.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.164+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.164+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4__shadow_.AtXnAxgcNNNCgL15Taqdiq6qW520Edf_0 2024-09-12T00:35:08.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.164+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:35:08.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.164+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.164+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14372164355579038794 2024-09-12T00:35:08.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.168+0000 7fd535ffb640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-12T00:35:08.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.168+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd63c01b940 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55eca86f0e48 s->prefetch_data=0 2024-09-12T00:35:08.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.172+0000 7fd6545669c0 10 manifest: total_size = 7674 2024-09-12T00:35:08.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.172+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15160258414115161592 2024-09-12T00:35:08.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.172+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd63c01b940 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55eca86f0e48 s->prefetch_data=0 2024-09-12T00:35:08.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.172+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca86f0e48 2024-09-12T00:35:08.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.172+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4.3 2024-09-12T00:35:08.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.176+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.176+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=7674 stripe_ofs=7674 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.176+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15160258414115161592 2024-09-12T00:35:08.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.176+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.176+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4__shadow_.Ykfalf48tfMKxDOqzf1X0P8onhHSSje_0 2024-09-12T00:35:08.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.176+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:35:08.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.176+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.176+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15160258414115161592 2024-09-12T00:35:08.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.176+0000 7fd5357fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-12T00:35:08.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.180+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca867b840 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55eca86f0e48 s->prefetch_data=0 2024-09-12T00:35:08.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.180+0000 7fd6545669c0 10 manifest: total_size = 5004 2024-09-12T00:35:08.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.180+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13249047012784091754 2024-09-12T00:35:08.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.180+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca867b840 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55eca86f0e48 s->prefetch_data=0 2024-09-12T00:35:08.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.180+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca86f0e48 2024-09-12T00:35:08.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.180+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4.4 2024-09-12T00:35:08.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.188+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.188+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=5004 stripe_ofs=5004 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.188+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13249047012784091754 2024-09-12T00:35:08.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.188+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.188+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4__shadow_.fNABO4F-DcNOJ8UbEwB7b0yZ2jXCNOS_0 2024-09-12T00:35:08.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.188+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:35:08.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.188+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.188+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13249047012784091754 2024-09-12T00:35:08.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.188+0000 7fd535ffb640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-12T00:35:08.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.192+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd64c003150 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55eca86f0e48 s->prefetch_data=0 2024-09-12T00:35:08.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.192+0000 7fd6545669c0 10 manifest: total_size = 7542 2024-09-12T00:35:08.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.192+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6626871108789907218 2024-09-12T00:35:08.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.192+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd64c003150 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55eca86f0e48 s->prefetch_data=0 2024-09-12T00:35:08.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.192+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca86f0e48 2024-09-12T00:35:08.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.192+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4.4 2024-09-12T00:35:08.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.196+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.196+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=7542 stripe_ofs=7542 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.196+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6626871108789907218 2024-09-12T00:35:08.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.196+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.196+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4__shadow_.zpQPw-g60cUo44-bW66Xe7ep-vbnEag_0 2024-09-12T00:35:08.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.196+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:35:08.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.196+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.196+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6626871108789907218 2024-09-12T00:35:08.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.200+0000 7fd5357fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-12T00:35:08.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.200+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd63c01b940 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55eca86f0e48 s->prefetch_data=0 2024-09-12T00:35:08.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.200+0000 7fd6545669c0 10 manifest: total_size = 12855 2024-09-12T00:35:08.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.200+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14772207261947257703 2024-09-12T00:35:08.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.200+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd63c01b940 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55eca86f0e48 s->prefetch_data=0 2024-09-12T00:35:08.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.200+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca86f0e48 2024-09-12T00:35:08.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.200+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4.5 2024-09-12T00:35:08.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.204+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.204+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=12855 stripe_ofs=12855 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.204+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14772207261947257703 2024-09-12T00:35:08.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.204+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.204+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4__shadow_._Li8sdIe3PxXOZQentqAnQQAkInlisS_0 2024-09-12T00:35:08.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.204+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:35:08.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.204+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.204+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14772207261947257703 2024-09-12T00:35:08.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.208+0000 7fd535ffb640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-12T00:35:08.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.208+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd63c01b940 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55eca86f0e48 s->prefetch_data=0 2024-09-12T00:35:08.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.208+0000 7fd6545669c0 10 manifest: total_size = 14228 2024-09-12T00:35:08.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.208+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15967492463432406209 2024-09-12T00:35:08.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.208+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd63c01b940 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55eca86f0e48 s->prefetch_data=0 2024-09-12T00:35:08.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.208+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca86f0e48 2024-09-12T00:35:08.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.208+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4.7 2024-09-12T00:35:08.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.216+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.216+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=14228 stripe_ofs=14228 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.216+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15967492463432406209 2024-09-12T00:35:08.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.216+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.216+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4__shadow_.BjYh_e6yPM7arlmrhLiygPByYLgCmlS_0 2024-09-12T00:35:08.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.216+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:35:08.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.216+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.216+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15967492463432406209 2024-09-12T00:35:08.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.216+0000 7fd5357fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-12T00:35:08.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.220+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca8671890 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55eca86f0e48 s->prefetch_data=0 2024-09-12T00:35:08.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.220+0000 7fd6545669c0 10 manifest: total_size = 38611 2024-09-12T00:35:08.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.220+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5335102579593868853 2024-09-12T00:35:08.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.220+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca8671890 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55eca86f0e48 s->prefetch_data=0 2024-09-12T00:35:08.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.220+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca86f0e48 2024-09-12T00:35:08.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.220+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4.8 2024-09-12T00:35:08.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.224+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.224+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=38611 stripe_ofs=38611 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.224+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5335102579593868853 2024-09-12T00:35:08.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.224+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.224+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4__shadow_.mfwRm_oWd6uHzAEgx8dxMBZIIUUFPl__0 2024-09-12T00:35:08.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.224+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:35:08.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.224+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.224+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5335102579593868853 2024-09-12T00:35:08.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.228+0000 7fd535ffb640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-12T00:35:08.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.228+0000 7fd6545669c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:35:08.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.228+0000 7fd6545669c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:35:08.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.232+0000 7fd6545669c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:35:08.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.232+0000 7fd6545669c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:35:08.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.232+0000 7fd6545669c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:35:08.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.232+0000 7fd6545669c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:35:08.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.232+0000 7fd6545669c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4])"; uploads.size()=0; is_truncated=0 2024-09-12T00:35:08.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.236+0000 7fd6545669c0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-12T00:35:08.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.236+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.236+0000 7fd6545669c0 20 rados_obj.operate() r=0 bl.length=204 2024-09-12T00:35:08.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.236+0000 7fd6545669c0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-12T00:35:08.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.236+0000 7fd6545669c0 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-12T00:35:08.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.236+0000 7fd6545669c0 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-12T00:35:08.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.236+0000 7fd6545669c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-12T00:35:08.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.240+0000 7fd5357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398878 cookie 94474925738864 notifier 5687 bl.length()=162 2024-09-12T00:35:08.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.240+0000 7fd6545669c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4 from cache 2024-09-12T00:35:08.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.240+0000 7fd6545669c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4, ofs0, ns] 2024-09-12T00:35:08.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.244+0000 7fd535ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398898 cookie 94474925777600 notifier 5687 bl.length()=219 2024-09-12T00:35:08.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.248+0000 7fd6545669c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4 : miss 2024-09-12T00:35:08.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.248+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.248+0000 7fd6545669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:08.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.248+0000 7fd6545669c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4 info.flags=0x0 2024-09-12T00:35:08.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.248+0000 7fd6545669c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4 to cache LRU end 2024-09-12T00:35:08.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.256+0000 7fd6545669c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11 : miss 2024-09-12T00:35:08.253 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.256+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.256+0000 7fd6545669c0 20 rados_obj.operate() r=0 bl.length=457 2024-09-12T00:35:08.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.256+0000 7fd6545669c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11 info.flags=0x17 2024-09-12T00:35:08.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.256+0000 7fd6545669c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11 to cache LRU end 2024-09-12T00:35:08.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.256+0000 7fd6545669c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:08.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.256+0000 7fd6545669c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:35:08.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.256+0000 7fd6545669c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11 2024-09-12T00:35:08.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.264+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo 2024-09-12T00:35:08.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.264+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd64c0b7930 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55eca8671c38 s->prefetch_data=0 2024-09-12T00:35:08.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.264+0000 7fd6545669c0 10 manifest: total_size = 18874368 2024-09-12T00:35:08.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.264+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13360977697804433289 2024-09-12T00:35:08.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.264+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd64c0b7930 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55eca8671c38 s->prefetch_data=0 2024-09-12T00:35:08.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.264+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca8671c38 2024-09-12T00:35:08.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.264+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11.10 2024-09-12T00:35:08.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:35:08.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:35:08.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:35:08.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-12T00:35:08.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2024-09-12T00:35:08.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=14680064 stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2024-09-12T00:35:08.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=18874368 part_ofs=10485760 rule->part_size=5242880 2024-09-12T00:35:08.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-12T00:35:08.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-12T00:35:08.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=19922944 part_ofs=15728640 rule->part_size=3145728 2024-09-12T00:35:08.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-12T00:35:08.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13360977697804433289 2024-09-12T00:35:08.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11__multipart_foo.2~zofgijrsM6nj1nx9r6w9ismHFDpTYuk.1 2024-09-12T00:35:08.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T00:35:08.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11__shadow_foo.2~zofgijrsM6nj1nx9r6w9ismHFDpTYuk.1_1 2024-09-12T00:35:08.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 591 2024-09-12T00:35:08.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11__multipart_foo.2~zofgijrsM6nj1nx9r6w9ismHFDpTYuk.2 2024-09-12T00:35:08.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 837 2024-09-12T00:35:08.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11__shadow_foo.2~zofgijrsM6nj1nx9r6w9ismHFDpTYuk.2_1 2024-09-12T00:35:08.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1081 2024-09-12T00:35:08.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11__multipart_foo.2~zofgijrsM6nj1nx9r6w9ismHFDpTYuk.3 2024-09-12T00:35:08.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1327 2024-09-12T00:35:08.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11__shadow_foo.2~zofgijrsM6nj1nx9r6w9ismHFDpTYuk.3_1 2024-09-12T00:35:08.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1571 2024-09-12T00:35:08.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11__multipart_foo.2~zofgijrsM6nj1nx9r6w9ismHFDpTYuk.4 2024-09-12T00:35:08.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1817 2024-09-12T00:35:08.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.268+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13360977697804433289 2024-09-12T00:35:08.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.272+0000 7fd5357fa640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:35:08.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.272+0000 7fd6545669c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:35:08.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.272+0000 7fd6545669c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:35:08.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.272+0000 7fd6545669c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:35:08.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.272+0000 7fd6545669c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:35:08.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.272+0000 7fd6545669c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:35:08.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.272+0000 7fd6545669c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:35:08.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.272+0000 7fd6545669c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11])"; uploads.size()=0; is_truncated=0 2024-09-12T00:35:08.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.276+0000 7fd6545669c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-12T00:35:08.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.276+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.280+0000 7fd6545669c0 20 rados_obj.operate() r=0 bl.length=235 2024-09-12T00:35:08.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.280+0000 7fd6545669c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-12T00:35:08.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.280+0000 7fd6545669c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-12T00:35:08.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.280+0000 7fd6545669c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-12T00:35:08.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.280+0000 7fd6545669c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-12T00:35:08.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.284+0000 7fd5357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398899 cookie 94474925777600 notifier 5687 bl.length()=191 2024-09-12T00:35:08.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.288+0000 7fd6545669c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11 from cache 2024-09-12T00:35:08.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.288+0000 7fd6545669c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11, ofs0, ns] 2024-09-12T00:35:08.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.288+0000 7fd5357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398864 cookie 94474925787488 notifier 5687 bl.length()=249 2024-09-12T00:35:08.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.292+0000 7fd6545669c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11 : miss 2024-09-12T00:35:08.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.292+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.292+0000 7fd6545669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:08.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.296+0000 7fd6545669c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11 info.flags=0x0 2024-09-12T00:35:08.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.296+0000 7fd6545669c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11 to cache LRU end 2024-09-12T00:35:08.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.300+0000 7fd6545669c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12 : miss 2024-09-12T00:35:08.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.300+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.300+0000 7fd6545669c0 20 rados_obj.operate() r=0 bl.length=464 2024-09-12T00:35:08.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.300+0000 7fd6545669c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12 info.flags=0x17 2024-09-12T00:35:08.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.300+0000 7fd6545669c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12 to cache LRU end 2024-09-12T00:35:08.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.300+0000 7fd6545669c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:08.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.300+0000 7fd6545669c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:35:08.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.300+0000 7fd6545669c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12 2024-09-12T00:35:08.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.312+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo 2024-09-12T00:35:08.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.312+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca86f15d0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55eca8671b78 s->prefetch_data=0 2024-09-12T00:35:08.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.312+0000 7fd6545669c0 10 manifest: total_size = 74198 2024-09-12T00:35:08.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.312+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5459513624560110133 2024-09-12T00:35:08.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.312+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca86f15d0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55eca8671b78 s->prefetch_data=0 2024-09-12T00:35:08.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.312+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca8671b78 2024-09-12T00:35:08.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.312+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12.10 2024-09-12T00:35:08.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.316+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:35:08.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.316+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-09-12T00:35:08.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.316+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T00:35:08.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.316+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:35:08.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.316+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-09-12T00:35:08.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.316+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-12T00:35:08.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.316+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:35:08.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.316+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=20613 2024-09-12T00:35:08.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.316+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-12T00:35:08.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.316+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-12T00:35:08.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.316+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=4256143 part_ofs=61839 rule->part_size=12359 2024-09-12T00:35:08.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.316+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-12T00:35:08.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.316+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5459513624560110133 2024-09-12T00:35:08.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.316+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.316+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12__multipart_foo.2~9Dew88ClR_Fpi6L72VzjdXDDAFHFR5Y.1 2024-09-12T00:35:08.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.316+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T00:35:08.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.316+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12__multipart_foo.2~9Dew88ClR_Fpi6L72VzjdXDDAFHFR5Y.2 2024-09-12T00:35:08.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.316+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T00:35:08.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.316+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12__multipart_foo.2~9Dew88ClR_Fpi6L72VzjdXDDAFHFR5Y.3 2024-09-12T00:35:08.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.316+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T00:35:08.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.316+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12__multipart_foo.2~9Dew88ClR_Fpi6L72VzjdXDDAFHFR5Y.4 2024-09-12T00:35:08.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.316+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T00:35:08.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.316+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.316+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5459513624560110133 2024-09-12T00:35:08.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.320+0000 7fd5357fa640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:35:08.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.320+0000 7fd6545669c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:35:08.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.320+0000 7fd6545669c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:35:08.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.320+0000 7fd6545669c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:35:08.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.320+0000 7fd6545669c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:35:08.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.320+0000 7fd6545669c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:35:08.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.320+0000 7fd6545669c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:35:08.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.320+0000 7fd6545669c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12])"; uploads.size()=0; is_truncated=0 2024-09-12T00:35:08.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.324+0000 7fd6545669c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-12T00:35:08.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.324+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.328+0000 7fd6545669c0 20 rados_obj.operate() r=0 bl.length=242 2024-09-12T00:35:08.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.328+0000 7fd6545669c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-12T00:35:08.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.328+0000 7fd6545669c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-12T00:35:08.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.328+0000 7fd6545669c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-12T00:35:08.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.328+0000 7fd6545669c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-12T00:35:08.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.332+0000 7fd5357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398912 cookie 94474925782832 notifier 5687 bl.length()=198 2024-09-12T00:35:08.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.332+0000 7fd6545669c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12 from cache 2024-09-12T00:35:08.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.332+0000 7fd6545669c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12, ofs0, ns] 2024-09-12T00:35:08.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.336+0000 7fd535ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398913 cookie 94474925782832 notifier 5687 bl.length()=256 2024-09-12T00:35:08.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.340+0000 7fd6545669c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12 : miss 2024-09-12T00:35:08.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.340+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.340+0000 7fd6545669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:08.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.340+0000 7fd6545669c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12 info.flags=0x0 2024-09-12T00:35:08.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.340+0000 7fd6545669c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12 to cache LRU end 2024-09-12T00:35:08.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.344+0000 7fd6545669c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10 : miss 2024-09-12T00:35:08.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.344+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.348+0000 7fd6545669c0 20 rados_obj.operate() r=0 bl.length=459 2024-09-12T00:35:08.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.348+0000 7fd6545669c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10 info.flags=0x17 2024-09-12T00:35:08.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.348+0000 7fd6545669c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10 to cache LRU end 2024-09-12T00:35:08.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.348+0000 7fd6545669c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:08.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.348+0000 7fd6545669c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:35:08.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.348+0000 7fd6545669c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10 2024-09-12T00:35:08.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.356+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo[S6aOUlqJ62UyUOehqUHxYexUKc0wasx] 2024-09-12T00:35:08.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.356+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10.10 2024-09-12T00:35:08.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.356+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca8688830 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55eca84fbca8 s->prefetch_data=0 2024-09-12T00:35:08.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.360+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to m688hf977tv6i8jjxdy98ksmblc4wv0r 2024-09-12T00:35:08.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.360+0000 7fd6545669c0 20 get_obj_state_impl: setting s->olh_tag to f1o5t4owf4764broxnw02mnf376pxo9z 2024-09-12T00:35:08.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.360+0000 7fd6545669c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=f1o5t4owf4764broxnw02mnf376pxo9z 2024-09-12T00:35:08.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.360+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10.10 2024-09-12T00:35:08.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.364+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10.10 2024-09-12T00:35:08.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.364+0000 7fd6545669c0 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-12T00:35:08.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.364+0000 7fd6545669c0 20 olh_log_entry: epoch=3 op=3 key=foo[S6aOUlqJ62UyUOehqUHxYexUKc0wasx] 2024-09-12T00:35:08.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.364+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca8688830 obj=test-client.0-r-test-multipart-index-versioning.1:_:S6aOUlqJ62UyUOehqUHxYexUKc0wasx_foo state=0x55eca868bb88 s->prefetch_data=0 2024-09-12T00:35:08.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.364+0000 7fd6545669c0 10 manifest: total_size = 74198 2024-09-12T00:35:08.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.364+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13875580690895315447 2024-09-12T00:35:08.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.364+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca8688830 obj=test-client.0-r-test-multipart-index-versioning.1:_:S6aOUlqJ62UyUOehqUHxYexUKc0wasx_foo state=0x55eca868bb88 s->prefetch_data=0 2024-09-12T00:35:08.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.364+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca868bb88 2024-09-12T00:35:08.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.364+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10.10 2024-09-12T00:35:08.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.372+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:35:08.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.372+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-09-12T00:35:08.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.372+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T00:35:08.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.372+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:35:08.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.372+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-09-12T00:35:08.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.372+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-12T00:35:08.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.372+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:35:08.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.372+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=20613 2024-09-12T00:35:08.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.372+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-12T00:35:08.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.372+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-12T00:35:08.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.372+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=4256143 part_ofs=61839 rule->part_size=12359 2024-09-12T00:35:08.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.372+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-12T00:35:08.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.372+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13875580690895315447 2024-09-12T00:35:08.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.372+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.372+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10__multipart_foo.2~MIb35QPzzWMm1zQkwffj8r32MA0MyoB.1 2024-09-12T00:35:08.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.372+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T00:35:08.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.372+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10__multipart_foo.2~MIb35QPzzWMm1zQkwffj8r32MA0MyoB.2 2024-09-12T00:35:08.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.372+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-12T00:35:08.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.372+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10__multipart_foo.2~MIb35QPzzWMm1zQkwffj8r32MA0MyoB.3 2024-09-12T00:35:08.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.372+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-12T00:35:08.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.372+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10__multipart_foo.2~MIb35QPzzWMm1zQkwffj8r32MA0MyoB.4 2024-09-12T00:35:08.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.372+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-12T00:35:08.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.372+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.372+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13875580690895315447 2024-09-12T00:35:08.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.372+0000 7fd535ffb640 20 handle_completion(): completion ok for obj=foo[S6aOUlqJ62UyUOehqUHxYexUKc0wasx] 2024-09-12T00:35:08.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.376+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca8688830 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55eca84fbca8 s->prefetch_data=0 2024-09-12T00:35:08.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.380+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10.10 2024-09-12T00:35:08.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.384+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10.10 2024-09-12T00:35:08.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.384+0000 7fd6545669c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:35:08.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.384+0000 7fd6545669c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:35:08.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.384+0000 7fd6545669c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:35:08.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.384+0000 7fd6545669c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:35:08.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.384+0000 7fd6545669c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:35:08.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.384+0000 7fd6545669c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:35:08.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.384+0000 7fd6545669c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10])"; uploads.size()=0; is_truncated=0 2024-09-12T00:35:08.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.388+0000 7fd6545669c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-12T00:35:08.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.388+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.388+0000 7fd6545669c0 20 rados_obj.operate() r=0 bl.length=237 2024-09-12T00:35:08.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.388+0000 7fd6545669c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-12T00:35:08.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.388+0000 7fd6545669c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-12T00:35:08.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.392+0000 7fd6545669c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-12T00:35:08.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.392+0000 7fd6545669c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-12T00:35:08.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.392+0000 7fd5357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398914 cookie 94474925782832 notifier 5687 bl.length()=193 2024-09-12T00:35:08.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.396+0000 7fd6545669c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10 from cache 2024-09-12T00:35:08.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.396+0000 7fd6545669c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10, ofs0, ns] 2024-09-12T00:35:08.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.396+0000 7fd535ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398879 cookie 94474925738864 notifier 5687 bl.length()=251 2024-09-12T00:35:08.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.404+0000 7fd6545669c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10 : miss 2024-09-12T00:35:08.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.404+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.404+0000 7fd6545669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:08.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.404+0000 7fd6545669c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10 info.flags=0x0 2024-09-12T00:35:08.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.404+0000 7fd6545669c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10 to cache LRU end 2024-09-12T00:35:08.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.408+0000 7fd6545669c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9 : miss 2024-09-12T00:35:08.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.408+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.412+0000 7fd6545669c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:35:08.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.412+0000 7fd6545669c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9 info.flags=0x17 2024-09-12T00:35:08.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.412+0000 7fd6545669c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9 to cache LRU end 2024-09-12T00:35:08.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.412+0000 7fd6545669c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:08.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.412+0000 7fd6545669c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:35:08.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.412+0000 7fd6545669c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9 2024-09-12T00:35:08.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.420+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo 2024-09-12T00:35:08.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.420+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca868df00 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55eca8698e38 s->prefetch_data=0 2024-09-12T00:35:08.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.424+0000 7fd6545669c0 10 manifest: total_size = 18874368 2024-09-12T00:35:08.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.424+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14954424204415789423 2024-09-12T00:35:08.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.424+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca868df00 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55eca8698e38 s->prefetch_data=0 2024-09-12T00:35:08.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.424+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca8698e38 2024-09-12T00:35:08.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.424+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9.10 2024-09-12T00:35:08.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:35:08.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:35:08.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:35:08.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-12T00:35:08.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2024-09-12T00:35:08.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=14680064 stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2024-09-12T00:35:08.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=18874368 part_ofs=10485760 rule->part_size=5242880 2024-09-12T00:35:08.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-12T00:35:08.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-12T00:35:08.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=19922944 part_ofs=15728640 rule->part_size=3145728 2024-09-12T00:35:08.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-12T00:35:08.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14954424204415789423 2024-09-12T00:35:08.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9__multipart_foo.2~Aw7ggfrv6dSKY2rz2U8_4LhEUs0CHjl.1 2024-09-12T00:35:08.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 345 2024-09-12T00:35:08.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9__shadow_foo.2~Aw7ggfrv6dSKY2rz2U8_4LhEUs0CHjl.1_1 2024-09-12T00:35:08.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 587 2024-09-12T00:35:08.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9__multipart_foo.2~Aw7ggfrv6dSKY2rz2U8_4LhEUs0CHjl.2 2024-09-12T00:35:08.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 831 2024-09-12T00:35:08.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9__shadow_foo.2~Aw7ggfrv6dSKY2rz2U8_4LhEUs0CHjl.2_1 2024-09-12T00:35:08.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1073 2024-09-12T00:35:08.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9__multipart_foo.2~Aw7ggfrv6dSKY2rz2U8_4LhEUs0CHjl.3 2024-09-12T00:35:08.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1317 2024-09-12T00:35:08.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9__shadow_foo.2~Aw7ggfrv6dSKY2rz2U8_4LhEUs0CHjl.3_1 2024-09-12T00:35:08.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1559 2024-09-12T00:35:08.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9__multipart_foo.2~Aw7ggfrv6dSKY2rz2U8_4LhEUs0CHjl.4 2024-09-12T00:35:08.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1803 2024-09-12T00:35:08.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.428+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14954424204415789423 2024-09-12T00:35:08.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.432+0000 7fd535ffb640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:35:08.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.432+0000 7fd6545669c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:35:08.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.432+0000 7fd6545669c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:35:08.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.432+0000 7fd6545669c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:35:08.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.432+0000 7fd6545669c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:35:08.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.432+0000 7fd6545669c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:35:08.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.432+0000 7fd6545669c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:35:08.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.432+0000 7fd6545669c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9])"; uploads.size()=0; is_truncated=0 2024-09-12T00:35:08.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.436+0000 7fd6545669c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-12T00:35:08.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.436+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.436+0000 7fd6545669c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:35:08.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.440+0000 7fd6545669c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-12T00:35:08.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.440+0000 7fd6545669c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-12T00:35:08.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.440+0000 7fd6545669c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-12T00:35:08.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.440+0000 7fd6545669c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-12T00:35:08.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.440+0000 7fd5357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398880 cookie 94474925780704 notifier 5687 bl.length()=183 2024-09-12T00:35:08.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.444+0000 7fd6545669c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9 from cache 2024-09-12T00:35:08.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.444+0000 7fd6545669c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9, ofs0, ns] 2024-09-12T00:35:08.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.444+0000 7fd535ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398864 cookie 94474925798960 notifier 5687 bl.length()=240 2024-09-12T00:35:08.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.452+0000 7fd6545669c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9 : miss 2024-09-12T00:35:08.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.452+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.452+0000 7fd6545669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:08.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.452+0000 7fd6545669c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9 info.flags=0x0 2024-09-12T00:35:08.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.452+0000 7fd6545669c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9 to cache LRU end 2024-09-12T00:35:08.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.456+0000 7fd6545669c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15 : miss 2024-09-12T00:35:08.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.456+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.460+0000 7fd6545669c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:35:08.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.460+0000 7fd6545669c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15 info.flags=0x17 2024-09-12T00:35:08.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.460+0000 7fd6545669c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15 to cache LRU end 2024-09-12T00:35:08.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.460+0000 7fd6545669c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:08.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.460+0000 7fd6545669c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:35:08.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.460+0000 7fd6545669c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15 2024-09-12T00:35:08.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.460+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T00:35:08.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.464+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T00:35:08.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.464+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:35:08.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.464+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T00:35:08.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.464+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T00:35:08.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.464+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:35:08.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.468+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T00:35:08.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.468+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:35:08.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.468+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T00:35:08.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.468+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T00:35:08.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.468+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T00:35:08.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.468+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T00:35:08.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.468+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca867aef0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55eca86969d8 s->prefetch_data=0 2024-09-12T00:35:08.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.468+0000 7fd6545669c0 10 manifest: total_size = 324647 2024-09-12T00:35:08.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.468+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to _s5OTykFVhm4tdM9vUG9sCbw_xicEQPp 2024-09-12T00:35:08.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.468+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca867aef0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55eca86969d8 s->prefetch_data=0 2024-09-12T00:35:08.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.468+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca86969d8 2024-09-12T00:35:08.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.468+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15.0 2024-09-12T00:35:08.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.476+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.476+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.476+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: _s5OTykFVhm4tdM9vUG9sCbw_xicEQPp 2024-09-12T00:35:08.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.476+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.476+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.D8Y3JDJobKId1bdFTzSW4XXRYqaqEeU_0 2024-09-12T00:35:08.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.476+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:35:08.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.476+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.476+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: _s5OTykFVhm4tdM9vUG9sCbw_xicEQPp 2024-09-12T00:35:08.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.480+0000 7fd5357fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T00:35:08.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.480+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca867aef0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55eca86969d8 s->prefetch_data=0 2024-09-12T00:35:08.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.480+0000 7fd6545669c0 10 manifest: total_size = 5242880 2024-09-12T00:35:08.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.480+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to _qS40cf-7sizjH3FLdbNDoa7__HZv6JP 2024-09-12T00:35:08.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.480+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca867aef0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55eca86969d8 s->prefetch_data=0 2024-09-12T00:35:08.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.480+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca86969d8 2024-09-12T00:35:08.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.480+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15.2 2024-09-12T00:35:08.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.484+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.484+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.484+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.484+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.484+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: _qS40cf-7sizjH3FLdbNDoa7__HZv6JP 2024-09-12T00:35:08.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.484+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.484+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.AMSzQMEUvh_fIqHhN5Gy0TdTNmV5XwB_0 2024-09-12T00:35:08.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.484+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:35:08.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.484+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.AMSzQMEUvh_fIqHhN5Gy0TdTNmV5XwB_1 2024-09-12T00:35:08.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.484+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:35:08.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.484+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.484+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: _qS40cf-7sizjH3FLdbNDoa7__HZv6JP 2024-09-12T00:35:08.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.488+0000 7fd535ffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T00:35:08.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.488+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca86f1b10 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55eca86969d8 s->prefetch_data=0 2024-09-12T00:35:08.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.488+0000 7fd6545669c0 10 manifest: total_size = 5242880 2024-09-12T00:35:08.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.488+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2449635637688319742 2024-09-12T00:35:08.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.488+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca86f1b10 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55eca86969d8 s->prefetch_data=0 2024-09-12T00:35:08.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.488+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca86969d8 2024-09-12T00:35:08.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.488+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15.3 2024-09-12T00:35:08.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.496+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.496+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.496+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.496+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.496+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2449635637688319742 2024-09-12T00:35:08.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.496+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.496+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.tCBhBNlpepoDcbgZ3JBaCS2QGmzUilW_0 2024-09-12T00:35:08.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.496+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T00:35:08.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.496+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.tCBhBNlpepoDcbgZ3JBaCS2QGmzUilW_1 2024-09-12T00:35:08.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.496+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-12T00:35:08.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.496+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.496+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2449635637688319742 2024-09-12T00:35:08.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.500+0000 7fd5357fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:35:08.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.500+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd64405fb60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55eca86969d8 s->prefetch_data=0 2024-09-12T00:35:08.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.500+0000 7fd6545669c0 10 manifest: total_size = 5242880 2024-09-12T00:35:08.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.500+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to _VAwJIkTR1j6gp-slQW3US3DEiRYtKE2 2024-09-12T00:35:08.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.500+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd64405fb60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55eca86969d8 s->prefetch_data=0 2024-09-12T00:35:08.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.500+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca86969d8 2024-09-12T00:35:08.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.500+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15.5 2024-09-12T00:35:08.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.508+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.508+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.508+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.508+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.508+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: _VAwJIkTR1j6gp-slQW3US3DEiRYtKE2 2024-09-12T00:35:08.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.508+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.508+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.G2LxGz2j8OZF8DMwodCfmzEWeJ8o-gg_0 2024-09-12T00:35:08.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.508+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:35:08.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.508+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.G2LxGz2j8OZF8DMwodCfmzEWeJ8o-gg_1 2024-09-12T00:35:08.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.508+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T00:35:08.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.508+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.508+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: _VAwJIkTR1j6gp-slQW3US3DEiRYtKE2 2024-09-12T00:35:08.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.512+0000 7fd535ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T00:35:08.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.512+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd63c06cbe0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55eca86969d8 s->prefetch_data=0 2024-09-12T00:35:08.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.512+0000 7fd6545669c0 10 manifest: total_size = 5242880 2024-09-12T00:35:08.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.512+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to _BB-e0JI5HEA3gJifIqJAtZaZcxalluC 2024-09-12T00:35:08.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.512+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd63c06cbe0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55eca86969d8 s->prefetch_data=0 2024-09-12T00:35:08.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.512+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca86969d8 2024-09-12T00:35:08.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.512+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15.5 2024-09-12T00:35:08.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.516+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.516+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.516+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.516+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.516+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: _BB-e0JI5HEA3gJifIqJAtZaZcxalluC 2024-09-12T00:35:08.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.516+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.516+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.CSIv5sukHA_iZVx7P4MTuQArB23AeMK_0 2024-09-12T00:35:08.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.516+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:35:08.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.516+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.CSIv5sukHA_iZVx7P4MTuQArB23AeMK_1 2024-09-12T00:35:08.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.516+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T00:35:08.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.516+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.516+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _BB-e0JI5HEA3gJifIqJAtZaZcxalluC 2024-09-12T00:35:08.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.520+0000 7fd5357fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T00:35:08.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.520+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd644099580 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55eca86969d8 s->prefetch_data=0 2024-09-12T00:35:08.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.520+0000 7fd6545669c0 10 manifest: total_size = 324647 2024-09-12T00:35:08.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.520+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17238642701190401679 2024-09-12T00:35:08.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.520+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd644099580 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55eca86969d8 s->prefetch_data=0 2024-09-12T00:35:08.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.520+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca86969d8 2024-09-12T00:35:08.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.520+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15.5 2024-09-12T00:35:08.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.528+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.528+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.528+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17238642701190401679 2024-09-12T00:35:08.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.528+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.528+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.RUgoiCCOpjQyf-xh9hXB5YFtkU8KlGO_0 2024-09-12T00:35:08.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.528+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-12T00:35:08.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.528+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.528+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17238642701190401679 2024-09-12T00:35:08.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.532+0000 7fd535ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:35:08.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.532+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca86f11f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55eca86969d8 s->prefetch_data=0 2024-09-12T00:35:08.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.532+0000 7fd6545669c0 10 manifest: total_size = 5242880 2024-09-12T00:35:08.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.532+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to _y3du6iPZhLpkNFiZh2qPAxcM8ZlOXtc 2024-09-12T00:35:08.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.532+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca86f11f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55eca86969d8 s->prefetch_data=0 2024-09-12T00:35:08.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.532+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca86969d8 2024-09-12T00:35:08.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.532+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15.7 2024-09-12T00:35:08.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.536+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.536+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.536+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.536+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.536+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: _y3du6iPZhLpkNFiZh2qPAxcM8ZlOXtc 2024-09-12T00:35:08.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.536+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.536+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.Ra60X8l2cUmq55W7c_gWxF5KZTDeaDt_0 2024-09-12T00:35:08.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.536+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:35:08.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.536+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.Ra60X8l2cUmq55W7c_gWxF5KZTDeaDt_1 2024-09-12T00:35:08.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.536+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:35:08.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.536+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.536+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _y3du6iPZhLpkNFiZh2qPAxcM8ZlOXtc 2024-09-12T00:35:08.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.540+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca8679150 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55eca8699e48 s->prefetch_data=0 2024-09-12T00:35:08.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.540+0000 7fd5357fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T00:35:08.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.540+0000 7fd6545669c0 10 manifest: total_size = 5242880 2024-09-12T00:35:08.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.540+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2861853666878033982 2024-09-12T00:35:08.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.540+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca8679150 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55eca8699e48 s->prefetch_data=0 2024-09-12T00:35:08.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.540+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca8699e48 2024-09-12T00:35:08.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.540+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15.7 2024-09-12T00:35:08.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.548+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.548+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.548+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.548+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.548+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2861853666878033982 2024-09-12T00:35:08.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.548+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.548+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.Bs27V-xphV2lwNEmPIweEYK_Evf4vCe_0 2024-09-12T00:35:08.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.548+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T00:35:08.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.548+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.Bs27V-xphV2lwNEmPIweEYK_Evf4vCe_1 2024-09-12T00:35:08.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.548+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-12T00:35:08.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.548+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.548+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2861853666878033982 2024-09-12T00:35:08.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.552+0000 7fd535ffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:35:08.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.552+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd644099580 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55eca86969d8 s->prefetch_data=0 2024-09-12T00:35:08.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.552+0000 7fd6545669c0 10 manifest: total_size = 324647 2024-09-12T00:35:08.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.552+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7705214658434883746 2024-09-12T00:35:08.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.552+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd644099580 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55eca86969d8 s->prefetch_data=0 2024-09-12T00:35:08.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.552+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca86969d8 2024-09-12T00:35:08.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.552+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15.7 2024-09-12T00:35:08.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.560+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.560+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.560+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7705214658434883746 2024-09-12T00:35:08.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.560+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.560+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.RUgoiCCOpjQyf-xh9hXB5YFtkU8KlGO_0 2024-09-12T00:35:08.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.560+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T00:35:08.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.560+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.560+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7705214658434883746 2024-09-12T00:35:08.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.560+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca867aef0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55eca8699e48 s->prefetch_data=0 2024-09-12T00:35:08.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.560+0000 7fd5357fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T00:35:08.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.564+0000 7fd6545669c0 10 manifest: total_size = 5242880 2024-09-12T00:35:08.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.564+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11206897429987024110 2024-09-12T00:35:08.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.564+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca867aef0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55eca8699e48 s->prefetch_data=0 2024-09-12T00:35:08.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.564+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca8699e48 2024-09-12T00:35:08.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.564+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15.8 2024-09-12T00:35:08.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.568+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.568+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.568+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.568+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.568+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11206897429987024110 2024-09-12T00:35:08.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.568+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.568+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.Bs27V-xphV2lwNEmPIweEYK_Evf4vCe_0 2024-09-12T00:35:08.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.568+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-12T00:35:08.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.568+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.Bs27V-xphV2lwNEmPIweEYK_Evf4vCe_1 2024-09-12T00:35:08.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.568+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-12T00:35:08.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.568+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.568+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11206897429987024110 2024-09-12T00:35:08.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.568+0000 7fd535ffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T00:35:08.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.572+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca86f1b10 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55eca86969d8 s->prefetch_data=0 2024-09-12T00:35:08.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.572+0000 7fd6545669c0 10 manifest: total_size = 324647 2024-09-12T00:35:08.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.572+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to _RZndSblRE-V1Y6v4HpJwZAiNceZoZYI 2024-09-12T00:35:08.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.572+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca86f1b10 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55eca86969d8 s->prefetch_data=0 2024-09-12T00:35:08.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.572+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca86969d8 2024-09-12T00:35:08.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.572+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15.8 2024-09-12T00:35:08.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.576+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.576+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.576+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: _RZndSblRE-V1Y6v4HpJwZAiNceZoZYI 2024-09-12T00:35:08.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.576+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.576+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.1A45EF1K_FVEZwcoCOGm40QTisr6gb1_0 2024-09-12T00:35:08.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.576+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:35:08.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.576+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.576+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: _RZndSblRE-V1Y6v4HpJwZAiNceZoZYI 2024-09-12T00:35:08.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.580+0000 7fd5357fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T00:35:08.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.580+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd64c116690 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55eca86969d8 s->prefetch_data=0 2024-09-12T00:35:08.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.580+0000 7fd6545669c0 10 manifest: total_size = 5242880 2024-09-12T00:35:08.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.580+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10616644943096295758 2024-09-12T00:35:08.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.580+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd64c116690 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55eca86969d8 s->prefetch_data=0 2024-09-12T00:35:08.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.580+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca86969d8 2024-09-12T00:35:08.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.580+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15.9 2024-09-12T00:35:08.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.588+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.588+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.588+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.588+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.588+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10616644943096295758 2024-09-12T00:35:08.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.588+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.588+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.tCBhBNlpepoDcbgZ3JBaCS2QGmzUilW_0 2024-09-12T00:35:08.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.588+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T00:35:08.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.588+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.tCBhBNlpepoDcbgZ3JBaCS2QGmzUilW_1 2024-09-12T00:35:08.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.588+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-12T00:35:08.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.588+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.588+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10616644943096295758 2024-09-12T00:35:08.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.588+0000 7fd535ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T00:35:08.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.588+0000 7fd6545669c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:35:08.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.588+0000 7fd6545669c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:35:08.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.592+0000 7fd6545669c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:35:08.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.592+0000 7fd6545669c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:35:08.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.592+0000 7fd6545669c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:35:08.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.592+0000 7fd6545669c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:35:08.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.592+0000 7fd6545669c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15])"; uploads.size()=0; is_truncated=0 2024-09-12T00:35:08.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.596+0000 7fd6545669c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-12T00:35:08.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.596+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.596+0000 7fd6545669c0 20 rados_obj.operate() r=0 bl.length=233 2024-09-12T00:35:08.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.596+0000 7fd6545669c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-12T00:35:08.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.596+0000 7fd6545669c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-12T00:35:08.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.600+0000 7fd6545669c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-12T00:35:08.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.600+0000 7fd6545669c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-12T00:35:08.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.600+0000 7fd535ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398915 cookie 94474925782832 notifier 5687 bl.length()=189 2024-09-12T00:35:08.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.604+0000 7fd6545669c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15 from cache 2024-09-12T00:35:08.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.604+0000 7fd6545669c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15, ofs0, ns] 2024-09-12T00:35:08.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.604+0000 7fd535ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398881 cookie 94474925738864 notifier 5687 bl.length()=247 2024-09-12T00:35:08.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.612+0000 7fd6545669c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15 : miss 2024-09-12T00:35:08.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.612+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.612+0000 7fd6545669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:08.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.612+0000 7fd6545669c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15 info.flags=0x0 2024-09-12T00:35:08.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.612+0000 7fd6545669c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15 to cache LRU end 2024-09-12T00:35:08.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.616+0000 7fd6545669c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16 : miss 2024-09-12T00:35:08.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.616+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.616+0000 7fd6545669c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:35:08.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.616+0000 7fd6545669c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16 info.flags=0x17 2024-09-12T00:35:08.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.616+0000 7fd6545669c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16 to cache LRU end 2024-09-12T00:35:08.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.616+0000 7fd6545669c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:08.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.616+0000 7fd6545669c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:35:08.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.620+0000 7fd6545669c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16 2024-09-12T00:35:08.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.620+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T00:35:08.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.620+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T00:35:08.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.620+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:35:08.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.624+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T00:35:08.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.624+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T00:35:08.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.624+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:35:08.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.624+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T00:35:08.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.624+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:35:08.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.624+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T00:35:08.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.628+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T00:35:08.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.628+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T00:35:08.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.628+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T00:35:08.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.628+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd644068580 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55eca8698d08 s->prefetch_data=0 2024-09-12T00:35:08.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.628+0000 7fd6545669c0 10 manifest: total_size = 541681 2024-09-12T00:35:08.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.628+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to _jO0hTDk_eV72cU_S7JCPJseFID8bWNd 2024-09-12T00:35:08.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.628+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd644068580 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55eca8698d08 s->prefetch_data=0 2024-09-12T00:35:08.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.628+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca8698d08 2024-09-12T00:35:08.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.628+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16.0 2024-09-12T00:35:08.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.632+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.632+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.632+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: _jO0hTDk_eV72cU_S7JCPJseFID8bWNd 2024-09-12T00:35:08.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.632+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.632+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_.RnThhTntAdhJhwn9cqlZEa4dqYfuoyT_0 2024-09-12T00:35:08.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.632+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:35:08.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.632+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.632+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: _jO0hTDk_eV72cU_S7JCPJseFID8bWNd 2024-09-12T00:35:08.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.636+0000 7fd5357fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T00:35:08.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.636+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd644099580 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55eca8698d08 s->prefetch_data=0 2024-09-12T00:35:08.636 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.640+0000 7fd6545669c0 10 manifest: total_size = 11534336 2024-09-12T00:35:08.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.640+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to _8M3QapkVCvt4cF1dY0jRAqVEl3yl1iS 2024-09-12T00:35:08.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.640+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd644099580 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55eca8698d08 s->prefetch_data=0 2024-09-12T00:35:08.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.640+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca8698d08 2024-09-12T00:35:08.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.640+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16.2 2024-09-12T00:35:08.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.644+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.644+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.644+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.644+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.644+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.644+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.644+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: _8M3QapkVCvt4cF1dY0jRAqVEl3yl1iS 2024-09-12T00:35:08.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.644+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.644+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_.S1qcVQOZ1VV5eoIcU7MP_y1W_NItoMJ_0 2024-09-12T00:35:08.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.644+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:35:08.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.644+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_.S1qcVQOZ1VV5eoIcU7MP_y1W_NItoMJ_1 2024-09-12T00:35:08.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.644+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:35:08.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.644+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_.S1qcVQOZ1VV5eoIcU7MP_y1W_NItoMJ_2 2024-09-12T00:35:08.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.644+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-12T00:35:08.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.644+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.644+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: _8M3QapkVCvt4cF1dY0jRAqVEl3yl1iS 2024-09-12T00:35:08.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.648+0000 7fd535ffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T00:35:08.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.648+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd64c116830 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55eca8698d08 s->prefetch_data=0 2024-09-12T00:35:08.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.648+0000 7fd6545669c0 10 manifest: total_size = 11534336 2024-09-12T00:35:08.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.648+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6150661601250211561 2024-09-12T00:35:08.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.648+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd64c116830 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55eca8698d08 s->prefetch_data=0 2024-09-12T00:35:08.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.648+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca8698d08 2024-09-12T00:35:08.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.648+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16.3 2024-09-12T00:35:08.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.652+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.652+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:35:08.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.652+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:35:08.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.652+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.652+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:35:08.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.652+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.652+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.652+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.652+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.652+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.652+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.652+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:35:08.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.652+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:35:08.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.652+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:35:08.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.652+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:35:08.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.652+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6150661601250211561 2024-09-12T00:35:08.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.652+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.652+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-FROZEN.2~P942SXcFkTD-6dFquWC0zIBymeiN8WY.1 2024-09-12T00:35:08.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.652+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T00:35:08.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.652+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_foo-FROZEN.2~P942SXcFkTD-6dFquWC0zIBymeiN8WY.1_1 2024-09-12T00:35:08.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.652+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-12T00:35:08.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.652+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-FROZEN.2~P942SXcFkTD-6dFquWC0zIBymeiN8WY.2 2024-09-12T00:35:08.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.652+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-12T00:35:08.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.652+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_foo-FROZEN.2~P942SXcFkTD-6dFquWC0zIBymeiN8WY.2_1 2024-09-12T00:35:08.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.652+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-12T00:35:08.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.652+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-FROZEN.2~P942SXcFkTD-6dFquWC0zIBymeiN8WY.3 2024-09-12T00:35:08.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.652+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-12T00:35:08.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.652+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.652+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6150661601250211561 2024-09-12T00:35:08.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.656+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd644099580 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55eca8698d08 s->prefetch_data=0 2024-09-12T00:35:08.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.656+0000 7fd5357fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:35:08.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.656+0000 7fd6545669c0 10 manifest: total_size = 11534336 2024-09-12T00:35:08.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.656+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to _QXCBjskwr6zeSMRth9uycTWo8UcTQqM 2024-09-12T00:35:08.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.656+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd644099580 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55eca8698d08 s->prefetch_data=0 2024-09-12T00:35:08.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.656+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca8698d08 2024-09-12T00:35:08.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.656+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16.5 2024-09-12T00:35:08.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.660+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.660+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.660+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.660+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.660+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.660+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.660+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: _QXCBjskwr6zeSMRth9uycTWo8UcTQqM 2024-09-12T00:35:08.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.660+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.660+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_.pheGyNTOXoufeFeT1Jlo7SQdcXVvzRO_0 2024-09-12T00:35:08.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.660+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:35:08.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.660+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_.pheGyNTOXoufeFeT1Jlo7SQdcXVvzRO_1 2024-09-12T00:35:08.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.660+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T00:35:08.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.660+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_.pheGyNTOXoufeFeT1Jlo7SQdcXVvzRO_2 2024-09-12T00:35:08.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.660+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-09-12T00:35:08.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.660+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.660+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: _QXCBjskwr6zeSMRth9uycTWo8UcTQqM 2024-09-12T00:35:08.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.664+0000 7fd535ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T00:35:08.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.664+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd63c00af30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55eca8698d08 s->prefetch_data=0 2024-09-12T00:35:08.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.668+0000 7fd6545669c0 10 manifest: total_size = 11534336 2024-09-12T00:35:08.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.668+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to _d7xCprjA_tQPtuEP90fv8OZUjE4eNvs 2024-09-12T00:35:08.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.668+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd63c00af30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55eca8698d08 s->prefetch_data=0 2024-09-12T00:35:08.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.668+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca8698d08 2024-09-12T00:35:08.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.668+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16.5 2024-09-12T00:35:08.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.672+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.672+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.672+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.672+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.672+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.672+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.672+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: _d7xCprjA_tQPtuEP90fv8OZUjE4eNvs 2024-09-12T00:35:08.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.672+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.672+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_.7kgpzEcNKXJD0h9k5wMXYNkXLpknbdS_0 2024-09-12T00:35:08.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.672+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:35:08.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.672+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_.7kgpzEcNKXJD0h9k5wMXYNkXLpknbdS_1 2024-09-12T00:35:08.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.672+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T00:35:08.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.672+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_.7kgpzEcNKXJD0h9k5wMXYNkXLpknbdS_2 2024-09-12T00:35:08.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.672+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-09-12T00:35:08.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.672+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.672+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: _d7xCprjA_tQPtuEP90fv8OZUjE4eNvs 2024-09-12T00:35:08.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.676+0000 7fd5357fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T00:35:08.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.676+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd644099420 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55eca8698d08 s->prefetch_data=0 2024-09-12T00:35:08.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.676+0000 7fd6545669c0 10 manifest: total_size = 541681 2024-09-12T00:35:08.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.676+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10642165982363841067 2024-09-12T00:35:08.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.676+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd644099420 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55eca8698d08 s->prefetch_data=0 2024-09-12T00:35:08.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.676+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca8698d08 2024-09-12T00:35:08.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.676+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16.5 2024-09-12T00:35:08.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.684+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:35:08.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.684+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-09-12T00:35:08.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.684+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T00:35:08.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.684+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:35:08.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.684+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-09-12T00:35:08.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.684+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-09-12T00:35:08.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.684+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-09-12T00:35:08.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.684+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=49187 2024-09-12T00:35:08.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.684+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-09-12T00:35:08.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.684+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10642165982363841067 2024-09-12T00:35:08.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.684+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.684+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-STANDARD.2~pkEBWl0mZWzQQaTpir-Pl3XhXNx1pS9.1 2024-09-12T00:35:08.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.684+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-12T00:35:08.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.684+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-STANDARD.2~pkEBWl0mZWzQQaTpir-Pl3XhXNx1pS9.2 2024-09-12T00:35:08.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.684+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-12T00:35:08.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.684+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-STANDARD.2~pkEBWl0mZWzQQaTpir-Pl3XhXNx1pS9.3 2024-09-12T00:35:08.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.684+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-12T00:35:08.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.684+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.684+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10642165982363841067 2024-09-12T00:35:08.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.684+0000 7fd535ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:35:08.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.688+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd64405fc10 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55eca8698d08 s->prefetch_data=0 2024-09-12T00:35:08.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.688+0000 7fd6545669c0 10 manifest: total_size = 11534336 2024-09-12T00:35:08.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.688+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to _HaYlq00XhTSIDzkmRbxQWhP10ut6PY1 2024-09-12T00:35:08.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.688+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd64405fc10 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55eca8698d08 s->prefetch_data=0 2024-09-12T00:35:08.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.688+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca8698d08 2024-09-12T00:35:08.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.688+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16.7 2024-09-12T00:35:08.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.692+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.692+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.692+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.692+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.692+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.692+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.692+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: _HaYlq00XhTSIDzkmRbxQWhP10ut6PY1 2024-09-12T00:35:08.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.692+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.692+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_.1Hzx4rgWbOUsSchanZ3HZZJbIz_hiKU_0 2024-09-12T00:35:08.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.692+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:35:08.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.692+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_.1Hzx4rgWbOUsSchanZ3HZZJbIz_hiKU_1 2024-09-12T00:35:08.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.692+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:35:08.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.692+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_.1Hzx4rgWbOUsSchanZ3HZZJbIz_hiKU_2 2024-09-12T00:35:08.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.692+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-12T00:35:08.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.692+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.692+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: _HaYlq00XhTSIDzkmRbxQWhP10ut6PY1 2024-09-12T00:35:08.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.696+0000 7fd5357fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T00:35:08.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.696+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd63c00af30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55eca8698d08 s->prefetch_data=0 2024-09-12T00:35:08.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.696+0000 7fd6545669c0 10 manifest: total_size = 11534336 2024-09-12T00:35:08.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.696+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2352214303254513595 2024-09-12T00:35:08.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.696+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd63c00af30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55eca8698d08 s->prefetch_data=0 2024-09-12T00:35:08.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.696+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca8698d08 2024-09-12T00:35:08.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.696+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16.7 2024-09-12T00:35:08.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.704+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.704+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:35:08.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.704+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:35:08.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.704+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.704+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:35:08.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.704+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.704+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.704+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.704+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.704+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.704+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.704+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:35:08.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.704+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:35:08.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.704+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:35:08.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.704+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:35:08.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.704+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2352214303254513595 2024-09-12T00:35:08.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.704+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.704+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-LUKEWARM.2~I6VWkIEcOnMRv2E23H5sn0xUFVOs3rD.1 2024-09-12T00:35:08.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.704+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T00:35:08.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.704+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_foo-LUKEWARM.2~I6VWkIEcOnMRv2E23H5sn0xUFVOs3rD.1_1 2024-09-12T00:35:08.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.704+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-12T00:35:08.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.704+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-LUKEWARM.2~I6VWkIEcOnMRv2E23H5sn0xUFVOs3rD.2 2024-09-12T00:35:08.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.704+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-12T00:35:08.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.704+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_foo-LUKEWARM.2~I6VWkIEcOnMRv2E23H5sn0xUFVOs3rD.2_1 2024-09-12T00:35:08.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.704+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-12T00:35:08.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.704+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-LUKEWARM.2~I6VWkIEcOnMRv2E23H5sn0xUFVOs3rD.3 2024-09-12T00:35:08.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.704+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-12T00:35:08.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.704+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.704+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2352214303254513595 2024-09-12T00:35:08.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.704+0000 7fd535ffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:35:08.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.708+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd63c01b940 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55eca8698d08 s->prefetch_data=0 2024-09-12T00:35:08.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.708+0000 7fd6545669c0 10 manifest: total_size = 541681 2024-09-12T00:35:08.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.708+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17914431900669736775 2024-09-12T00:35:08.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.708+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd63c01b940 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55eca8698d08 s->prefetch_data=0 2024-09-12T00:35:08.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.708+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca8698d08 2024-09-12T00:35:08.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.708+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16.7 2024-09-12T00:35:08.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.712+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:35:08.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.712+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-09-12T00:35:08.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.712+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T00:35:08.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.712+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:35:08.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.712+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-09-12T00:35:08.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.712+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-09-12T00:35:08.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.712+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-09-12T00:35:08.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.712+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=49187 2024-09-12T00:35:08.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.712+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-09-12T00:35:08.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.712+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17914431900669736775 2024-09-12T00:35:08.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.712+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.712+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-STANDARD.2~pkEBWl0mZWzQQaTpir-Pl3XhXNx1pS9.1 2024-09-12T00:35:08.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.712+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-12T00:35:08.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.712+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-STANDARD.2~pkEBWl0mZWzQQaTpir-Pl3XhXNx1pS9.2 2024-09-12T00:35:08.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.712+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-12T00:35:08.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.712+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-STANDARD.2~pkEBWl0mZWzQQaTpir-Pl3XhXNx1pS9.3 2024-09-12T00:35:08.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.712+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-12T00:35:08.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.712+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.712+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17914431900669736775 2024-09-12T00:35:08.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.716+0000 7fd5357fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T00:35:08.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.716+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd644099420 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55eca8698d08 s->prefetch_data=0 2024-09-12T00:35:08.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.716+0000 7fd6545669c0 10 manifest: total_size = 11534336 2024-09-12T00:35:08.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.716+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18073498457538430223 2024-09-12T00:35:08.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.716+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd644099420 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55eca8698d08 s->prefetch_data=0 2024-09-12T00:35:08.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.716+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca8698d08 2024-09-12T00:35:08.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.716+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16.8 2024-09-12T00:35:08.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.724+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.724+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:35:08.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.724+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:35:08.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.724+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.724+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:35:08.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.724+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.724+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.724+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.724+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.724+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.724+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.724+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:35:08.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.724+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:35:08.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.724+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:35:08.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.724+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:35:08.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.724+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18073498457538430223 2024-09-12T00:35:08.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.724+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.724+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-LUKEWARM.2~I6VWkIEcOnMRv2E23H5sn0xUFVOs3rD.1 2024-09-12T00:35:08.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.724+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T00:35:08.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.724+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_foo-LUKEWARM.2~I6VWkIEcOnMRv2E23H5sn0xUFVOs3rD.1_1 2024-09-12T00:35:08.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.724+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-12T00:35:08.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.724+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-LUKEWARM.2~I6VWkIEcOnMRv2E23H5sn0xUFVOs3rD.2 2024-09-12T00:35:08.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.724+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-12T00:35:08.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.724+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_foo-LUKEWARM.2~I6VWkIEcOnMRv2E23H5sn0xUFVOs3rD.2_1 2024-09-12T00:35:08.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.724+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-12T00:35:08.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.724+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-LUKEWARM.2~I6VWkIEcOnMRv2E23H5sn0xUFVOs3rD.3 2024-09-12T00:35:08.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.724+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-12T00:35:08.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.724+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.724+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18073498457538430223 2024-09-12T00:35:08.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.724+0000 7fd535ffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T00:35:08.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.728+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca8672340 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55eca8698d08 s->prefetch_data=0 2024-09-12T00:35:08.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.728+0000 7fd6545669c0 10 manifest: total_size = 541681 2024-09-12T00:35:08.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.728+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to _n240v2xxlm35e7Lk09bzDvFASMqNG2A 2024-09-12T00:35:08.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.728+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca8672340 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55eca8698d08 s->prefetch_data=0 2024-09-12T00:35:08.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.728+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca8698d08 2024-09-12T00:35:08.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.728+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16.8 2024-09-12T00:35:08.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.732+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.732+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.732+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: _n240v2xxlm35e7Lk09bzDvFASMqNG2A 2024-09-12T00:35:08.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.732+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.732+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_.WJ_sUtdtGu3s5Y8-eF8_JZYh40VouDg_0 2024-09-12T00:35:08.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.732+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:35:08.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.732+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.732+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: _n240v2xxlm35e7Lk09bzDvFASMqNG2A 2024-09-12T00:35:08.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.736+0000 7fd5357fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T00:35:08.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.736+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd644099420 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55eca8698d08 s->prefetch_data=0 2024-09-12T00:35:08.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.736+0000 7fd6545669c0 10 manifest: total_size = 11534336 2024-09-12T00:35:08.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.736+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6579173781538069849 2024-09-12T00:35:08.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.736+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd644099420 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55eca8698d08 s->prefetch_data=0 2024-09-12T00:35:08.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.736+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca8698d08 2024-09-12T00:35:08.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.736+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16.9 2024-09-12T00:35:08.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.744+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.744+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:35:08.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.744+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:35:08.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.744+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.744+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:35:08.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.744+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.744+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.744+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.744+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.744+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.744+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.744+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:35:08.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.744+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:35:08.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.744+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:35:08.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.744+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:35:08.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.744+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6579173781538069849 2024-09-12T00:35:08.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.744+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.744+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-FROZEN.2~P942SXcFkTD-6dFquWC0zIBymeiN8WY.1 2024-09-12T00:35:08.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.744+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T00:35:08.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.744+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_foo-FROZEN.2~P942SXcFkTD-6dFquWC0zIBymeiN8WY.1_1 2024-09-12T00:35:08.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.744+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-12T00:35:08.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.744+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-FROZEN.2~P942SXcFkTD-6dFquWC0zIBymeiN8WY.2 2024-09-12T00:35:08.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.744+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-12T00:35:08.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.744+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_foo-FROZEN.2~P942SXcFkTD-6dFquWC0zIBymeiN8WY.2_1 2024-09-12T00:35:08.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.744+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-12T00:35:08.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.744+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-FROZEN.2~P942SXcFkTD-6dFquWC0zIBymeiN8WY.3 2024-09-12T00:35:08.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.744+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-12T00:35:08.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.744+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.744+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6579173781538069849 2024-09-12T00:35:08.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.744+0000 7fd535ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T00:35:08.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.748+0000 7fd6545669c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:35:08.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.748+0000 7fd6545669c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:35:08.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.748+0000 7fd6545669c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:35:08.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.748+0000 7fd6545669c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:35:08.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.748+0000 7fd6545669c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:35:08.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.748+0000 7fd6545669c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:35:08.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.748+0000 7fd6545669c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16])"; uploads.size()=0; is_truncated=0 2024-09-12T00:35:08.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.752+0000 7fd6545669c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-12T00:35:08.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.752+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.752+0000 7fd6545669c0 20 rados_obj.operate() r=0 bl.length=243 2024-09-12T00:35:08.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.752+0000 7fd6545669c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-12T00:35:08.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.752+0000 7fd6545669c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-12T00:35:08.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.756+0000 7fd6545669c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-12T00:35:08.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.756+0000 7fd6545669c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-12T00:35:08.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.756+0000 7fd5357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398865 cookie 94474925786432 notifier 5687 bl.length()=199 2024-09-12T00:35:08.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.760+0000 7fd6545669c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16 from cache 2024-09-12T00:35:08.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.760+0000 7fd6545669c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16, ofs0, ns] 2024-09-12T00:35:08.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.760+0000 7fd5357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398866 cookie 94474925786432 notifier 5687 bl.length()=257 2024-09-12T00:35:08.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.768+0000 7fd6545669c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16 : miss 2024-09-12T00:35:08.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.768+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.768+0000 7fd6545669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:08.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.768+0000 7fd6545669c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16 info.flags=0x0 2024-09-12T00:35:08.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.768+0000 7fd6545669c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16 to cache LRU end 2024-09-12T00:35:08.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.772+0000 7fd6545669c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14 : miss 2024-09-12T00:35:08.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.772+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.772+0000 7fd6545669c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T00:35:08.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.772+0000 7fd6545669c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14 info.flags=0x17 2024-09-12T00:35:08.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.772+0000 7fd6545669c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14 to cache LRU end 2024-09-12T00:35:08.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.772+0000 7fd6545669c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:08.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.772+0000 7fd6545669c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:35:08.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.772+0000 7fd6545669c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14 2024-09-12T00:35:08.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.776+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:35:08.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.780+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:35:08.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.784+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:35:08.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.784+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd63c01b940 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:08.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.788+0000 7fd6545669c0 10 manifest: total_size = 11534336 2024-09-12T00:35:08.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.788+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6261725679642698152 2024-09-12T00:35:08.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.788+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd63c01b940 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:08.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.788+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca869b138 2024-09-12T00:35:08.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.788+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14.3 2024-09-12T00:35:08.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.792+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.792+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:35:08.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.792+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:35:08.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.792+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.792+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:35:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.792+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.792+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.792+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.792+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.792+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.792+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.792+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:35:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.792+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:35:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.792+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:35:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.792+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:35:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.792+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6261725679642698152 2024-09-12T00:35:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.792+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.792+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14__multipart_foo-FROZEN.2~8Tb0d0HLK7VKitWIJzK_NYkX2YK_X6y.1 2024-09-12T00:35:08.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.792+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T00:35:08.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.792+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14__shadow_foo-FROZEN.2~8Tb0d0HLK7VKitWIJzK_NYkX2YK_X6y.1_1 2024-09-12T00:35:08.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.792+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-12T00:35:08.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.792+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14__multipart_foo-FROZEN.2~8Tb0d0HLK7VKitWIJzK_NYkX2YK_X6y.2 2024-09-12T00:35:08.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.792+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-12T00:35:08.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.792+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14__shadow_foo-FROZEN.2~8Tb0d0HLK7VKitWIJzK_NYkX2YK_X6y.2_1 2024-09-12T00:35:08.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.792+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-12T00:35:08.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.792+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14__multipart_foo-FROZEN.2~8Tb0d0HLK7VKitWIJzK_NYkX2YK_X6y.3 2024-09-12T00:35:08.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.792+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-12T00:35:08.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.792+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.792+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6261725679642698152 2024-09-12T00:35:08.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.796+0000 7fd5357fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:35:08.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.796+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd6440059f0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:08.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.796+0000 7fd6545669c0 10 manifest: total_size = 541681 2024-09-12T00:35:08.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.796+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15539763064239720463 2024-09-12T00:35:08.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.796+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd6440059f0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:08.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.796+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca869b138 2024-09-12T00:35:08.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.796+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14.5 2024-09-12T00:35:08.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.804+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:35:08.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.804+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-09-12T00:35:08.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.804+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T00:35:08.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.804+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:35:08.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.804+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-09-12T00:35:08.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.804+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-09-12T00:35:08.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.804+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-09-12T00:35:08.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.804+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=49187 2024-09-12T00:35:08.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.804+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-09-12T00:35:08.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.804+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15539763064239720463 2024-09-12T00:35:08.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.804+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.804+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14__multipart_foo-STANDARD.2~Gw86xeAuK-qODsh5PSJvZ8Ce9zud5CN.1 2024-09-12T00:35:08.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.804+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-12T00:35:08.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.804+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14__multipart_foo-STANDARD.2~Gw86xeAuK-qODsh5PSJvZ8Ce9zud5CN.2 2024-09-12T00:35:08.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.804+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-12T00:35:08.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.804+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14__multipart_foo-STANDARD.2~Gw86xeAuK-qODsh5PSJvZ8Ce9zud5CN.3 2024-09-12T00:35:08.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.804+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-12T00:35:08.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.804+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.804+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15539763064239720463 2024-09-12T00:35:08.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.804+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd644068580 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:08.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.804+0000 7fd535ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:35:08.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.804+0000 7fd6545669c0 10 manifest: total_size = 11534336 2024-09-12T00:35:08.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.804+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18115602907625153674 2024-09-12T00:35:08.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.804+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd644068580 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:08.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.804+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca869b138 2024-09-12T00:35:08.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.804+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14.7 2024-09-12T00:35:08.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:35:08.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:35:08.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:35:08.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:35:08.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:35:08.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:35:08.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:35:08.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:35:08.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:35:08.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18115602907625153674 2024-09-12T00:35:08.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14__multipart_foo-LUKEWARM.2~uJz645vOnV6b5lZgZr77No03RPpqHQh.1 2024-09-12T00:35:08.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T00:35:08.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14__shadow_foo-LUKEWARM.2~uJz645vOnV6b5lZgZr77No03RPpqHQh.1_1 2024-09-12T00:35:08.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-12T00:35:08.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14__multipart_foo-LUKEWARM.2~uJz645vOnV6b5lZgZr77No03RPpqHQh.2 2024-09-12T00:35:08.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-12T00:35:08.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14__shadow_foo-LUKEWARM.2~uJz645vOnV6b5lZgZr77No03RPpqHQh.2_1 2024-09-12T00:35:08.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-12T00:35:08.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14__multipart_foo-LUKEWARM.2~uJz645vOnV6b5lZgZr77No03RPpqHQh.3 2024-09-12T00:35:08.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-12T00:35:08.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18115602907625153674 2024-09-12T00:35:08.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:35:08.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.812+0000 7fd6545669c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:35:08.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.816+0000 7fd535ffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:35:08.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.816+0000 7fd6545669c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:35:08.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.816+0000 7fd6545669c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:35:08.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.816+0000 7fd6545669c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:35:08.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.816+0000 7fd6545669c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:35:08.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.816+0000 7fd6545669c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14])"; uploads.size()=0; is_truncated=0 2024-09-12T00:35:08.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.820+0000 7fd6545669c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-12T00:35:08.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.820+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.820+0000 7fd6545669c0 20 rados_obj.operate() r=0 bl.length=238 2024-09-12T00:35:08.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.820+0000 7fd6545669c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-12T00:35:08.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.820+0000 7fd6545669c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-12T00:35:08.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.824+0000 7fd6545669c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-12T00:35:08.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.824+0000 7fd6545669c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-12T00:35:08.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.824+0000 7fd5357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398865 cookie 94474925787488 notifier 5687 bl.length()=194 2024-09-12T00:35:08.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.828+0000 7fd6545669c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14 from cache 2024-09-12T00:35:08.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.828+0000 7fd6545669c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14, ofs0, ns] 2024-09-12T00:35:08.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.828+0000 7fd5357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398867 cookie 94474925786432 notifier 5687 bl.length()=252 2024-09-12T00:35:08.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.836+0000 7fd6545669c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14 : miss 2024-09-12T00:35:08.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.836+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.836+0000 7fd6545669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:08.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.836+0000 7fd6545669c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14 info.flags=0x0 2024-09-12T00:35:08.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.836+0000 7fd6545669c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14 to cache LRU end 2024-09-12T00:35:08.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.840+0000 7fd6545669c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13 : miss 2024-09-12T00:35:08.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.840+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.844+0000 7fd6545669c0 20 rados_obj.operate() r=0 bl.length=450 2024-09-12T00:35:08.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.844+0000 7fd6545669c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13 info.flags=0x17 2024-09-12T00:35:08.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.844+0000 7fd6545669c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13 to cache LRU end 2024-09-12T00:35:08.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.844+0000 7fd6545669c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:08.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.844+0000 7fd6545669c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:35:08.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.844+0000 7fd6545669c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13 2024-09-12T00:35:08.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.848+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:35:08.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.848+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:35:08.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.848+0000 7fd6545669c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:35:08.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.852+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca86988d0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:08.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.852+0000 7fd6545669c0 10 manifest: total_size = 10485760 2024-09-12T00:35:08.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.852+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4234664961166927016 2024-09-12T00:35:08.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.852+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca86988d0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:08.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.852+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca869b138 2024-09-12T00:35:08.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.852+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13.3 2024-09-12T00:35:08.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.860+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.860+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.860+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.860+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.860+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.860+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.860+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4234664961166927016 2024-09-12T00:35:08.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.860+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.860+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13__shadow_.YzC_ZWEAy9Okmq3mSFpjO_dWedrnDhn_0 2024-09-12T00:35:08.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.860+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T00:35:08.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.860+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13__shadow_.YzC_ZWEAy9Okmq3mSFpjO_dWedrnDhn_1 2024-09-12T00:35:08.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.860+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-12T00:35:08.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.860+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13__shadow_.YzC_ZWEAy9Okmq3mSFpjO_dWedrnDhn_2 2024-09-12T00:35:08.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.860+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 811 2024-09-12T00:35:08.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.860+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.860+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4234664961166927016 2024-09-12T00:35:08.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.864+0000 7fd535ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:35:08.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.864+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd64c1169f0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:08.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.864+0000 7fd6545669c0 10 manifest: total_size = 10485760 2024-09-12T00:35:08.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.864+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17534021336069014442 2024-09-12T00:35:08.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.864+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd64c1169f0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:08.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.864+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca869b138 2024-09-12T00:35:08.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.864+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13.5 2024-09-12T00:35:08.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.868+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.868+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.868+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.868+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.868+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.868+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.868+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17534021336069014442 2024-09-12T00:35:08.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.868+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.868+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13__shadow_.gczsEnIPgY29ydNRw4obXtKfciyEE_O_0 2024-09-12T00:35:08.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.868+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-12T00:35:08.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.868+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13__shadow_.gczsEnIPgY29ydNRw4obXtKfciyEE_O_1 2024-09-12T00:35:08.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.868+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 561 2024-09-12T00:35:08.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.868+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13__shadow_.gczsEnIPgY29ydNRw4obXtKfciyEE_O_2 2024-09-12T00:35:08.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.868+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 791 2024-09-12T00:35:08.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.868+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.868+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17534021336069014442 2024-09-12T00:35:08.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.872+0000 7fd5357fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:35:08.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.912+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca867aef0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:08.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.912+0000 7fd6545669c0 10 manifest: total_size = 10485760 2024-09-12T00:35:08.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.912+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8042236088785303579 2024-09-12T00:35:08.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.912+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca867aef0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:08.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.912+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca869b138 2024-09-12T00:35:08.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.912+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13.7 2024-09-12T00:35:08.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.920+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.920+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.920+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.920+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.920+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:08.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.920+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:35:08.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.920+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8042236088785303579 2024-09-12T00:35:08.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.920+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:08.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.920+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13__shadow_.aq7oKlUzCTOhGFn7xgqvSoEhj8S94NP_0 2024-09-12T00:35:08.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.920+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T00:35:08.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.920+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13__shadow_.aq7oKlUzCTOhGFn7xgqvSoEhj8S94NP_1 2024-09-12T00:35:08.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.920+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-12T00:35:08.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.920+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13__shadow_.aq7oKlUzCTOhGFn7xgqvSoEhj8S94NP_2 2024-09-12T00:35:08.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.920+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 817 2024-09-12T00:35:08.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.920+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:08.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.920+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8042236088785303579 2024-09-12T00:35:08.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.924+0000 7fd535ffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:35:08.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.924+0000 7fd6545669c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:35:08.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.924+0000 7fd6545669c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:35:08.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.928+0000 7fd6545669c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:35:08.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.928+0000 7fd6545669c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:35:08.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.928+0000 7fd6545669c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:35:08.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.928+0000 7fd6545669c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:35:08.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.928+0000 7fd6545669c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13])"; uploads.size()=0; is_truncated=0 2024-09-12T00:35:08.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.932+0000 7fd6545669c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-12T00:35:08.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.932+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.936+0000 7fd6545669c0 20 rados_obj.operate() r=0 bl.length=228 2024-09-12T00:35:08.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.936+0000 7fd6545669c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-12T00:35:08.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.936+0000 7fd6545669c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-12T00:35:08.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.936+0000 7fd6545669c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-12T00:35:08.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.936+0000 7fd6545669c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-12T00:35:08.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.936+0000 7fd5357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398916 cookie 94474925782832 notifier 5687 bl.length()=184 2024-09-12T00:35:08.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.940+0000 7fd6545669c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13 from cache 2024-09-12T00:35:08.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.940+0000 7fd6545669c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13, ofs0, ns] 2024-09-12T00:35:08.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.944+0000 7fd5357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398917 cookie 94474925782832 notifier 5687 bl.length()=242 2024-09-12T00:35:08.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.952+0000 7fd6545669c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13 : miss 2024-09-12T00:35:08.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.952+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.952+0000 7fd6545669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:08.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.952+0000 7fd6545669c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13 info.flags=0x0 2024-09-12T00:35:08.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.952+0000 7fd6545669c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13 to cache LRU end 2024-09-12T00:35:08.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.956+0000 7fd6545669c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6 : miss 2024-09-12T00:35:08.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.956+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:08.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.956+0000 7fd6545669c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:35:08.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.956+0000 7fd6545669c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6 info.flags=0x17 2024-09-12T00:35:08.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.956+0000 7fd6545669c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6 to cache LRU end 2024-09-12T00:35:08.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.956+0000 7fd6545669c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:08.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.956+0000 7fd6545669c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:35:08.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.956+0000 7fd6545669c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6 2024-09-12T00:35:08.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.960+0000 7fd6545669c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:35:08.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.960+0000 7fd6545669c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:35:08.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.964+0000 7fd6545669c0 10 cls_bucket_list_unordered: got __ 2024-09-12T00:35:08.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.968+0000 7fd6545669c0 10 cls_bucket_list_unordered: got obj 2024-09-12T00:35:08.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.968+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca8696b90 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:08.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.972+0000 7fd6545669c0 10 manifest: total_size = 0 2024-09-12T00:35:08.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.972+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10240806239455260793 2024-09-12T00:35:08.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.972+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca8696b90 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:08.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.972+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca869b138 2024-09-12T00:35:08.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.972+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6.2 2024-09-12T00:35:08.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.976+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca8696b90 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:08.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.976+0000 7fd6545669c0 10 manifest: total_size = 0 2024-09-12T00:35:08.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.976+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11275696509011420517 2024-09-12T00:35:08.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.976+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca8696b90 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:08.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.976+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca869b138 2024-09-12T00:35:08.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.976+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6.3 2024-09-12T00:35:08.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.980+0000 7fd5357fa640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:35:08.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.984+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca8696b90 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:08.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.984+0000 7fd6545669c0 10 manifest: total_size = 0 2024-09-12T00:35:08.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.984+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17920187618499200777 2024-09-12T00:35:08.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.984+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca8696b90 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:08.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.984+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca869b138 2024-09-12T00:35:08.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.984+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6.6 2024-09-12T00:35:08.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.988+0000 7fd535ffb640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:35:08.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.992+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca8696b90 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:08.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.992+0000 7fd6545669c0 10 manifest: total_size = 0 2024-09-12T00:35:08.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.992+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16460453679254281165 2024-09-12T00:35:08.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.992+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca8696b90 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:08.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.992+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca869b138 2024-09-12T00:35:08.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.992+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6.8 2024-09-12T00:35:08.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:08.996+0000 7fd5357fa640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:35:08.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.000+0000 7fd6545669c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:35:08.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.000+0000 7fd6545669c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:35:09.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.004+0000 7fd5357fa640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:35:09.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.004+0000 7fd6545669c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:35:09.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.004+0000 7fd6545669c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:35:09.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.004+0000 7fd6545669c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:35:09.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.004+0000 7fd6545669c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:35:09.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.004+0000 7fd6545669c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6])"; uploads.size()=0; is_truncated=0 2024-09-12T00:35:09.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.008+0000 7fd6545669c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-12T00:35:09.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.008+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:09.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.008+0000 7fd6545669c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:35:09.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.008+0000 7fd6545669c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-12T00:35:09.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.008+0000 7fd6545669c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-12T00:35:09.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.012+0000 7fd6545669c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-12T00:35:09.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.012+0000 7fd6545669c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-12T00:35:09.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.012+0000 7fd535ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398900 cookie 94474925777600 notifier 5687 bl.length()=181 2024-09-12T00:35:09.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.016+0000 7fd6545669c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6 from cache 2024-09-12T00:35:09.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.020+0000 7fd6545669c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6, ofs0, ns] 2024-09-12T00:35:09.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.020+0000 7fd535ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398882 cookie 94474925780704 notifier 5687 bl.length()=238 2024-09-12T00:35:09.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.024+0000 7fd6545669c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6 : miss 2024-09-12T00:35:09.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.028+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:09.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.028+0000 7fd6545669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:09.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.028+0000 7fd6545669c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6 info.flags=0x0 2024-09-12T00:35:09.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.028+0000 7fd6545669c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6 to cache LRU end 2024-09-12T00:35:09.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.032+0000 7fd6545669c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7 : miss 2024-09-12T00:35:09.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.032+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:09.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.032+0000 7fd6545669c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:35:09.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.032+0000 7fd6545669c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7 info.flags=0x17 2024-09-12T00:35:09.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.032+0000 7fd6545669c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7 to cache LRU end 2024-09-12T00:35:09.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.032+0000 7fd6545669c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:09.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.032+0000 7fd6545669c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:35:09.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.032+0000 7fd6545669c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7 2024-09-12T00:35:09.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.036+0000 7fd6545669c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:35:09.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.036+0000 7fd6545669c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:35:09.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.040+0000 7fd6545669c0 10 cls_bucket_list_unordered: got __ 2024-09-12T00:35:09.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.044+0000 7fd6545669c0 10 cls_bucket_list_unordered: got obj 2024-09-12T00:35:09.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.044+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd64c0b7f40 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:09.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.048+0000 7fd6545669c0 10 manifest: total_size = 38 2024-09-12T00:35:09.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.048+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8405398835991645494 2024-09-12T00:35:09.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.048+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd64c0b7f40 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:09.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.048+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca869b138 2024-09-12T00:35:09.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.048+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7.2 2024-09-12T00:35:09.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.052+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:09.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.052+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=38 stripe_ofs=38 part_ofs=0 rule->part_size=0 2024-09-12T00:35:09.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.052+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8405398835991645494 2024-09-12T00:35:09.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.052+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:09.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.052+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7__shadow_.tFeP0R_VrxpZvsefGLxxgpEToyMBDLf_0 2024-09-12T00:35:09.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.052+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:35:09.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.052+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:09.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.052+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8405398835991645494 2024-09-12T00:35:09.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.056+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd64c0b7f40 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:09.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.056+0000 7fd5357fa640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:35:09.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.056+0000 7fd6545669c0 10 manifest: total_size = 2078 2024-09-12T00:35:09.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.056+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6953081409821640512 2024-09-12T00:35:09.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.056+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd64c0b7f40 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:09.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.056+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca869b138 2024-09-12T00:35:09.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.056+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7.3 2024-09-12T00:35:09.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.064+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:09.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.064+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2024-09-12T00:35:09.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.064+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6953081409821640512 2024-09-12T00:35:09.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.064+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:09.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.064+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7__shadow_.KHvl5_zTS_qvk_0_AliMwNV-lM8wtyz_0 2024-09-12T00:35:09.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.064+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:35:09.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.064+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:09.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.064+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6953081409821640512 2024-09-12T00:35:09.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.068+0000 7fd535ffb640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:35:09.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.068+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd64c0b7f40 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:09.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.068+0000 7fd6545669c0 10 manifest: total_size = 24595 2024-09-12T00:35:09.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.068+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15982157754764336192 2024-09-12T00:35:09.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.068+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd64c0b7f40 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:09.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.068+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca869b138 2024-09-12T00:35:09.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.068+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7.6 2024-09-12T00:35:09.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.076+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:09.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.076+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-09-12T00:35:09.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.076+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15982157754764336192 2024-09-12T00:35:09.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.076+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:09.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.076+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7__shadow_.5E5v4SvwsPEdnsTP_f9zUOxXC22_Jkt_0 2024-09-12T00:35:09.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.076+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:35:09.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.076+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:09.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.076+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15982157754764336192 2024-09-12T00:35:09.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.076+0000 7fd5357fa640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:35:09.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.076+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd63c00af30 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:09.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.080+0000 7fd6545669c0 10 manifest: total_size = 2078 2024-09-12T00:35:09.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.080+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7994217959325778452 2024-09-12T00:35:09.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.080+0000 7fd6545669c0 20 get_obj_state: octx=0x7fd63c00af30 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:09.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.080+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca869b138 2024-09-12T00:35:09.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.080+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7.8 2024-09-12T00:35:09.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.084+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:09.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.084+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2024-09-12T00:35:09.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.084+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7994217959325778452 2024-09-12T00:35:09.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.084+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:09.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.084+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7__shadow_.9eZP4pB8ahN7gyXXmYaXOOhoBh6z-ib_0 2024-09-12T00:35:09.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.084+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:35:09.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.084+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:09.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.084+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7994217959325778452 2024-09-12T00:35:09.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.088+0000 7fd6545669c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:35:09.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.088+0000 7fd6545669c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:35:09.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.088+0000 7fd535ffb640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:35:09.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.092+0000 7fd6545669c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:35:09.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.092+0000 7fd6545669c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:35:09.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.092+0000 7fd6545669c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:35:09.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.092+0000 7fd6545669c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:35:09.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.092+0000 7fd6545669c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7])"; uploads.size()=0; is_truncated=0 2024-09-12T00:35:09.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.096+0000 7fd6545669c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-12T00:35:09.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.096+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:09.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.096+0000 7fd6545669c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:35:09.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.096+0000 7fd6545669c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-12T00:35:09.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.096+0000 7fd6545669c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-12T00:35:09.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.100+0000 7fd6545669c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-12T00:35:09.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.100+0000 7fd6545669c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-12T00:35:09.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.100+0000 7fd535ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398901 cookie 94474925777600 notifier 5687 bl.length()=181 2024-09-12T00:35:09.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.104+0000 7fd6545669c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7 from cache 2024-09-12T00:35:09.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.104+0000 7fd6545669c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7, ofs0, ns] 2024-09-12T00:35:09.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.108+0000 7fd5357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398883 cookie 94474925780704 notifier 5687 bl.length()=238 2024-09-12T00:35:09.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.112+0000 7fd6545669c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7 : miss 2024-09-12T00:35:09.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.112+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:09.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.112+0000 7fd6545669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:09.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.112+0000 7fd6545669c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7 info.flags=0x0 2024-09-12T00:35:09.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.112+0000 7fd6545669c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7 to cache LRU end 2024-09-12T00:35:09.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.120+0000 7fd6545669c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8 : miss 2024-09-12T00:35:09.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.120+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:09.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.120+0000 7fd6545669c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:35:09.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.120+0000 7fd6545669c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8 info.flags=0x17 2024-09-12T00:35:09.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.120+0000 7fd6545669c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8 to cache LRU end 2024-09-12T00:35:09.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.120+0000 7fd6545669c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:09.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.120+0000 7fd6545669c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:35:09.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.120+0000 7fd6545669c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8 2024-09-12T00:35:09.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.124+0000 7fd6545669c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:35:09.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.124+0000 7fd6545669c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:35:09.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.128+0000 7fd6545669c0 10 cls_bucket_list_unordered: got __ 2024-09-12T00:35:09.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.132+0000 7fd6545669c0 10 cls_bucket_list_unordered: got obj 2024-09-12T00:35:09.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.132+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca869a5e0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:09.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.136+0000 7fd6545669c0 10 manifest: total_size = 55 2024-09-12T00:35:09.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.136+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3401684707159640040 2024-09-12T00:35:09.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.136+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca869a5e0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:09.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.136+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca869b138 2024-09-12T00:35:09.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.136+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8.2 2024-09-12T00:35:09.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.140+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:09.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.140+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=55 stripe_ofs=55 part_ofs=0 rule->part_size=0 2024-09-12T00:35:09.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.140+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3401684707159640040 2024-09-12T00:35:09.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.140+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:09.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.140+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8__shadow_.af8Dw25W6IGdj_IxTUg1z66_Xyxt7d-_0 2024-09-12T00:35:09.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.140+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:35:09.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.140+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:09.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.140+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3401684707159640040 2024-09-12T00:35:09.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.144+0000 7fd5357fa640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:35:09.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.144+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca869a5e0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:09.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.144+0000 7fd6545669c0 10 manifest: total_size = 1048576 2024-09-12T00:35:09.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.144+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8701766590251490010 2024-09-12T00:35:09.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.144+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca869a5e0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:09.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.144+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca869b138 2024-09-12T00:35:09.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.144+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8.3 2024-09-12T00:35:09.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.152+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:09.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.152+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0 2024-09-12T00:35:09.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.152+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8701766590251490010 2024-09-12T00:35:09.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.152+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:09.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.152+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8__shadow_.i7UJRciKOHV8B6iLW9rGGeC1xWJquJY_0 2024-09-12T00:35:09.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.152+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:35:09.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.152+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:09.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.152+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8701766590251490010 2024-09-12T00:35:09.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.152+0000 7fd535ffb640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:35:09.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.152+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca869a5e0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:09.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.156+0000 7fd6545669c0 10 manifest: total_size = 4134 2024-09-12T00:35:09.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.156+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10899536655267624408 2024-09-12T00:35:09.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.156+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca869a5e0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:09.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.156+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca869b138 2024-09-12T00:35:09.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.156+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8.6 2024-09-12T00:35:09.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.160+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:09.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.160+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-09-12T00:35:09.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.160+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10899536655267624408 2024-09-12T00:35:09.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.160+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:09.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.160+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8__shadow_.wIjhIrdGmj7UjqUec5gOuR2-VfWJFL3_0 2024-09-12T00:35:09.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.160+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:35:09.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.160+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:09.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.160+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10899536655267624408 2024-09-12T00:35:09.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.164+0000 7fd5357fa640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:35:09.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.164+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca86f0760 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:09.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.164+0000 7fd6545669c0 10 manifest: total_size = 55 2024-09-12T00:35:09.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.164+0000 7fd6545669c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12556509869590871468 2024-09-12T00:35:09.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.164+0000 7fd6545669c0 20 get_obj_state: octx=0x55eca86f0760 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55eca869b138 s->prefetch_data=0 2024-09-12T00:35:09.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.164+0000 7fd6545669c0 20 prepare_atomic_modification: state is not atomic. state=0x55eca869b138 2024-09-12T00:35:09.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.164+0000 7fd6545669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8.8 2024-09-12T00:35:09.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.172+0000 7fd6545669c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:35:09.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.172+0000 7fd6545669c0 20 RGWObjManifest::operator++(): result: ofs=55 stripe_ofs=55 part_ofs=0 rule->part_size=0 2024-09-12T00:35:09.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.172+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12556509869590871468 2024-09-12T00:35:09.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.172+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:35:09.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.172+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8__shadow_.3zK5jbOhvnANFWhyI1KFCxQqSDBrBOD_0 2024-09-12T00:35:09.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.172+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:35:09.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.172+0000 7fd6545669c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:35:09.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.172+0000 7fd6545669c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12556509869590871468 2024-09-12T00:35:09.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.176+0000 7fd6545669c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:35:09.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.176+0000 7fd535ffb640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:35:09.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.176+0000 7fd6545669c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:35:09.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.176+0000 7fd6545669c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:35:09.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.176+0000 7fd6545669c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:35:09.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.176+0000 7fd6545669c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:35:09.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.176+0000 7fd6545669c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:35:09.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.176+0000 7fd6545669c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8])"; uploads.size()=0; is_truncated=0 2024-09-12T00:35:09.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.180+0000 7fd6545669c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-12T00:35:09.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.180+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:09.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.184+0000 7fd6545669c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:35:09.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.184+0000 7fd6545669c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-12T00:35:09.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.184+0000 7fd6545669c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-12T00:35:09.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.184+0000 7fd6545669c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-12T00:35:09.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.184+0000 7fd6545669c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-12T00:35:09.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.184+0000 7fd5357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398902 cookie 94474925777600 notifier 5687 bl.length()=181 2024-09-12T00:35:09.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.192+0000 7fd6545669c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8 from cache 2024-09-12T00:35:09.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.192+0000 7fd6545669c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8, ofs0, ns] 2024-09-12T00:35:09.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.192+0000 7fd5357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398884 cookie 94474925780704 notifier 5687 bl.length()=238 2024-09-12T00:35:09.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.200+0000 7fd6545669c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8 : miss 2024-09-12T00:35:09.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.200+0000 7fd6545669c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:09.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.200+0000 7fd6545669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:09.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.200+0000 7fd6545669c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8 info.flags=0x0 2024-09-12T00:35:09.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.200+0000 7fd6545669c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8 to cache LRU end 2024-09-12T00:35:09.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.204+0000 7fd6545669c0 10 removing key index: GQELIEBLLSNYODPWTIGW 2024-09-12T00:35:09.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.208+0000 7fd6545669c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.keys:GQELIEBLLSNYODPWTIGW, ofs0, ns] 2024-09-12T00:35:09.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.208+0000 7fd5357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398866 cookie 94474925794960 notifier 5687 bl.length()=170 2024-09-12T00:35:09.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.208+0000 7fd6545669c0 10 removing email index: ragweed.client.0+test@test.test 2024-09-12T00:35:09.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.212+0000 7fd6545669c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T00:35:09.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.212+0000 7fd535ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398918 cookie 94474925782832 notifier 5687 bl.length()=182 2024-09-12T00:35:09.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.216+0000 7fd6545669c0 10 removing user buckets index 2024-09-12T00:35:09.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.216+0000 7fd6545669c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-12T00:35:09.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.216+0000 7fd535ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398867 cookie 94474925787488 notifier 5687 bl.length()=173 2024-09-12T00:35:09.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.220+0000 7fd6545669c0 10 removing user index: ragweed.client.0 2024-09-12T00:35:09.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.220+0000 7fd6545669c0 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-12T00:35:09.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.220+0000 7fd6545669c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T00:35:09.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.224+0000 7fd5357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398885 cookie 94474925780704 notifier 5687 bl.length()=165 2024-09-12T00:35:09.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.224+0000 7fd5097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:09.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.232+0000 7fd6545669c0 20 remove_watcher() i=0 2024-09-12T00:35:09.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.232+0000 7fd6545669c0 2 removed watcher, disabling cache 2024-09-12T00:35:09.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.236+0000 7fd6545669c0 20 remove_watcher() i=1 2024-09-12T00:35:09.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.236+0000 7fd6545669c0 20 remove_watcher() i=2 2024-09-12T00:35:09.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.240+0000 7fd6545669c0 20 remove_watcher() i=3 2024-09-12T00:35:09.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.244+0000 7fd6545669c0 20 remove_watcher() i=4 2024-09-12T00:35:09.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.244+0000 7fd6545669c0 20 remove_watcher() i=5 2024-09-12T00:35:09.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.248+0000 7fd6545669c0 20 remove_watcher() i=6 2024-09-12T00:35:09.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.248+0000 7fd6545669c0 20 remove_watcher() i=7 2024-09-12T00:35:09.268 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-12T00:35:09.348 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:09.348 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:09.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.392+0000 7f9de135b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:09.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.396+0000 7f9de135b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:09.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.396+0000 7f9de135b9c0 20 realm 2024-09-12T00:35:09.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.396+0000 7f9de135b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:09.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.396+0000 7f9de135b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:09.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.396+0000 7f9de135b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:09.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.396+0000 7f9de135b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:09.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.396+0000 7f9de135b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:09.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.396+0000 7f9de135b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:09.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.396+0000 7f9de135b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:09.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.396+0000 7f9de135b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:09.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.396+0000 7f9de135b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:09.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.396+0000 7f9de135b9c0 20 searching for the correct realm 2024-09-12T00:35:09.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.404+0000 7f9dde660640 0 -- 172.21.15.43:0/2117113234 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f9dc804fc20 msgr2=0x7f9dc8011400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:09.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.412+0000 7f9dde660640 0 -- 172.21.15.43:0/2117113234 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f9ca8080b00 msgr2=0x7f9ca8082f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:09.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.420+0000 7f9de135b9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:35:09.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.420+0000 7f9de135b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:09.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.420+0000 7f9de135b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:09.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.420+0000 7f9de135b9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:35:09.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.420+0000 7f9de135b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:09.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.420+0000 7f9de135b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:09.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.420+0000 7f9de135b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:09.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.420+0000 7f9de135b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:09.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.420+0000 7f9de135b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:09.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.420+0000 7f9de135b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:09.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.420+0000 7f9de135b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:09.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.420+0000 7f9de135b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:09.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.420+0000 7f9de135b9c0 20 zone default found 2024-09-12T00:35:09.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.420+0000 7f9de135b9c0 4 Realm: () 2024-09-12T00:35:09.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.420+0000 7f9de135b9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:35:09.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.420+0000 7f9de135b9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:35:09.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.420+0000 7f9de135b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:09.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.420+0000 7f9de135b9c0 20 zonegroup default 2024-09-12T00:35:09.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.420+0000 7f9de135b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:09.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.420+0000 7f9de135b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:09.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.420+0000 7f9de135b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:09.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.424+0000 7f9de135b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:09.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.424+0000 7f9de135b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:09.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.424+0000 7f9de135b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:09.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.424+0000 7f9de135b9c0 20 started sync module instance, tier type = 2024-09-12T00:35:09.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.424+0000 7f9de135b9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:35:09.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.440+0000 7f9de135b9c0 20 add_watcher() i=0 2024-09-12T00:35:09.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.440+0000 7f9de135b9c0 20 add_watcher() i=1 2024-09-12T00:35:09.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.440+0000 7f9de135b9c0 20 add_watcher() i=2 2024-09-12T00:35:09.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.440+0000 7f9de135b9c0 20 add_watcher() i=3 2024-09-12T00:35:09.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.440+0000 7f9de135b9c0 20 add_watcher() i=4 2024-09-12T00:35:09.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.440+0000 7f9de135b9c0 20 add_watcher() i=5 2024-09-12T00:35:09.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.440+0000 7f9de135b9c0 20 add_watcher() i=6 2024-09-12T00:35:09.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.440+0000 7f9de135b9c0 20 add_watcher() i=7 2024-09-12T00:35:09.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.440+0000 7f9de135b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:09.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.440+0000 7f9c957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:09.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.444+0000 7f9de135b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:09.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.444+0000 7f9de135b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:09.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.516+0000 7f9c0ffff640 20 reqs_thread_entry: start 2024-09-12T00:35:09.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.516+0000 7f9de135b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:09.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.516+0000 7f9de135b9c0 20 Filter name: none 2024-09-12T00:35:09.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.516+0000 7f9c0dffb640 20 reqs_thread_entry: start 2024-09-12T00:35:09.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.516+0000 7f9de135b9c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T00:35:09.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.516+0000 7f9de135b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:09.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.520+0000 7f9de135b9c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:35:09.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.520+0000 7f9de135b9c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-12T00:35:09.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.520+0000 7f9de135b9c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:35:09.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.520+0000 7f9de135b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:09.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.520+0000 7f9de135b9c0 10 removing key index: ELDSYCACUHKWGHYUFSRT 2024-09-12T00:35:09.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.520+0000 7f9de135b9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.keys:ELDSYCACUHKWGHYUFSRT, ofs0, ns] 2024-09-12T00:35:09.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.520+0000 7f9cc27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398886 cookie 94460698447088 notifier 5705 bl.length()=170 2024-09-12T00:35:09.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.524+0000 7f9de135b9c0 10 removing email index: sysuser.client.0+test@test.test 2024-09-12T00:35:09.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.524+0000 7f9de135b9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T00:35:09.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.524+0000 7f9cc27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398887 cookie 94460698461104 notifier 5705 bl.length()=182 2024-09-12T00:35:09.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.528+0000 7f9de135b9c0 10 removing user buckets index 2024-09-12T00:35:09.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.528+0000 7f9de135b9c0 10 removing user index: sysuser.client.0 2024-09-12T00:35:09.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.532+0000 7f9de135b9c0 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-12T00:35:09.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.532+0000 7f9de135b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T00:35:09.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.532+0000 7f9cc27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398919 cookie 94460698448448 notifier 5705 bl.length()=165 2024-09-12T00:35:09.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.536+0000 7f9c957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:09.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.540+0000 7f9de135b9c0 20 remove_watcher() i=0 2024-09-12T00:35:09.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.540+0000 7f9de135b9c0 2 removed watcher, disabling cache 2024-09-12T00:35:09.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.544+0000 7f9de135b9c0 20 remove_watcher() i=1 2024-09-12T00:35:09.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.548+0000 7f9de135b9c0 20 remove_watcher() i=2 2024-09-12T00:35:09.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.548+0000 7f9de135b9c0 20 remove_watcher() i=3 2024-09-12T00:35:09.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.552+0000 7f9de135b9c0 20 remove_watcher() i=4 2024-09-12T00:35:09.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.552+0000 7f9de135b9c0 20 remove_watcher() i=5 2024-09-12T00:35:09.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.556+0000 7f9de135b9c0 20 remove_watcher() i=6 2024-09-12T00:35:09.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:35:09.556+0000 7f9de135b9c0 20 remove_watcher() i=7 2024-09-12T00:35:09.572 INFO:tasks.ragweed:Removing ragweed... 2024-09-12T00:35:09.572 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:35:09.668 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:35:09.679 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:35:09.679 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:35:09.679 DEBUG:teuthology.orchestra.run.smithi043:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:35:09.685 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:35:09.685 INFO:teuthology.orchestra.run.smithi043.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:35:09.685 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:35:09.733 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:35:09.734 DEBUG:teuthology.orchestra.run.smithi043:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:35:09.785 INFO:tasks.workunit:timeout=3h 2024-09-12T00:35:09.785 INFO:tasks.workunit:cleanup=True 2024-09-12T00:35:09.786 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:35:09.835 INFO:tasks.workunit.client.0.smithi043.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:35:54.355 INFO:tasks.workunit.client.0.smithi043.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:35:54.356 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:35:54.356 INFO:tasks.workunit.client.0.smithi043.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:35:54.356 INFO:tasks.workunit.client.0.smithi043.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:35:54.356 INFO:tasks.workunit.client.0.smithi043.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:35:54.356 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:35:54.356 INFO:tasks.workunit.client.0.smithi043.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:35:54.356 INFO:tasks.workunit.client.0.smithi043.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:35:54.356 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:35:54.356 INFO:tasks.workunit.client.0.smithi043.stderr: git switch -c 2024-09-12T00:35:54.356 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:35:54.357 INFO:tasks.workunit.client.0.smithi043.stderr:Or undo this operation with: 2024-09-12T00:35:54.357 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:35:54.357 INFO:tasks.workunit.client.0.smithi043.stderr: git switch - 2024-09-12T00:35:54.357 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:35:54.357 INFO:tasks.workunit.client.0.smithi043.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:35:54.357 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:35:54.357 INFO:tasks.workunit.client.0.smithi043.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:35:54.363 DEBUG:teuthology.orchestra.run.smithi043:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:35:54.411 INFO:tasks.workunit.client.0.smithi043.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:35:54.414 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:35:54.414 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:35:54.480 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:35:54.543 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:35:54.594 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:35:54.596 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:35:54.596 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:35:54.639 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:35:54.642 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:35:54.642 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:35:54.689 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-12T00:35:54.690 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-12T00:35:54.690 DEBUG:teuthology.orchestra.run.smithi043:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T00:35:54.747 INFO:tasks.workunit.client.0.smithi043.stderr:+ ulimit -c 0 2024-09-12T00:35:54.747 INFO:tasks.workunit.client.0.smithi043.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T00:35:54.748 INFO:tasks.workunit.client.0.smithi043.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:35:54.748 INFO:tasks.workunit.client.0.smithi043.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:35:57.743 INFO:tasks.workunit.client.0.smithi043.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:35:57.743 INFO:tasks.workunit.client.0.smithi043.stderr:++ deactivate nondestructive 2024-09-12T00:35:57.743 INFO:tasks.workunit.client.0.smithi043.stderr:++ '[' -n '' ']' 2024-09-12T00:35:57.743 INFO:tasks.workunit.client.0.smithi043.stderr:++ '[' -n '' ']' 2024-09-12T00:35:57.744 INFO:tasks.workunit.client.0.smithi043.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:35:57.744 INFO:tasks.workunit.client.0.smithi043.stderr:++ hash -r 2024-09-12T00:35:57.744 INFO:tasks.workunit.client.0.smithi043.stderr:++ '[' -n '' ']' 2024-09-12T00:35:57.744 INFO:tasks.workunit.client.0.smithi043.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:35:57.744 INFO:tasks.workunit.client.0.smithi043.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T00:35:57.744 INFO:tasks.workunit.client.0.smithi043.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:35:57.744 INFO:tasks.workunit.client.0.smithi043.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:35:57.745 INFO:tasks.workunit.client.0.smithi043.stderr:++ export VIRTUAL_ENV 2024-09-12T00:35:57.745 INFO:tasks.workunit.client.0.smithi043.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:35:57.745 INFO:tasks.workunit.client.0.smithi043.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:35:57.745 INFO:tasks.workunit.client.0.smithi043.stderr:++ export PATH 2024-09-12T00:35:57.745 INFO:tasks.workunit.client.0.smithi043.stderr:++ '[' -n '' ']' 2024-09-12T00:35:57.745 INFO:tasks.workunit.client.0.smithi043.stderr:++ '[' -z '' ']' 2024-09-12T00:35:57.745 INFO:tasks.workunit.client.0.smithi043.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:35:57.746 INFO:tasks.workunit.client.0.smithi043.stderr:++ PS1='(rgw) ' 2024-09-12T00:35:57.746 INFO:tasks.workunit.client.0.smithi043.stderr:++ export PS1 2024-09-12T00:35:57.746 INFO:tasks.workunit.client.0.smithi043.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T00:35:57.746 INFO:tasks.workunit.client.0.smithi043.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T00:35:57.746 INFO:tasks.workunit.client.0.smithi043.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:35:57.746 INFO:tasks.workunit.client.0.smithi043.stderr:++ hash -r 2024-09-12T00:35:57.746 INFO:tasks.workunit.client.0.smithi043.stderr:+ pip install pip --upgrade 2024-09-12T00:35:58.115 INFO:tasks.workunit.client.0.smithi043.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T00:35:58.323 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting pip 2024-09-12T00:35:58.328 INFO:tasks.workunit.client.0.smithi043.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:35:58.366 INFO:tasks.workunit.client.0.smithi043.stdout:Installing collected packages: pip 2024-09-12T00:35:58.366 INFO:tasks.workunit.client.0.smithi043.stdout: Attempting uninstall: pip 2024-09-12T00:35:58.366 INFO:tasks.workunit.client.0.smithi043.stdout: Found existing installation: pip 22.0.2 2024-09-12T00:35:58.656 INFO:tasks.workunit.client.0.smithi043.stdout: Uninstalling pip-22.0.2: 2024-09-12T00:35:58.662 INFO:tasks.workunit.client.0.smithi043.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T00:35:59.433 INFO:tasks.workunit.client.0.smithi043.stdout:Successfully installed pip-24.2 2024-09-12T00:35:59.498 INFO:tasks.workunit.client.0.smithi043.stderr:+ pip install boto3 2024-09-12T00:36:00.591 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting boto3 2024-09-12T00:36:00.597 INFO:tasks.workunit.client.0.smithi043.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:36:01.140 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:36:01.141 INFO:tasks.workunit.client.0.smithi043.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:36:01.189 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:36:01.190 INFO:tasks.workunit.client.0.smithi043.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:36:01.236 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:36:01.238 INFO:tasks.workunit.client.0.smithi043.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:36:01.287 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:36:01.288 INFO:tasks.workunit.client.0.smithi043.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:36:01.402 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:36:01.403 INFO:tasks.workunit.client.0.smithi043.stdout: Using cached urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-09-12T00:36:01.551 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:36:01.552 INFO:tasks.workunit.client.0.smithi043.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:36:01.556 INFO:tasks.workunit.client.0.smithi043.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:36:01.557 INFO:tasks.workunit.client.0.smithi043.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:36:01.567 INFO:tasks.workunit.client.0.smithi043.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:36:01.568 INFO:tasks.workunit.client.0.smithi043.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:36:01.570 INFO:tasks.workunit.client.0.smithi043.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:36:01.571 INFO:tasks.workunit.client.0.smithi043.stdout:Using cached urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-09-12T00:36:01.572 INFO:tasks.workunit.client.0.smithi043.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:36:01.643 INFO:tasks.workunit.client.0.smithi043.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:36:02.626 INFO:tasks.workunit.client.0.smithi043.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-09-12T00:36:02.833 INFO:tasks.workunit.client.0.smithi043.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-12T00:36:02.960 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-12T00:36:02.998 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:02.999 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:03.038 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.039+0000 7fdc609f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.041 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.039+0000 7fdc609f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.041 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.039+0000 7fdc609f29c0 20 realm 2024-09-12T00:36:03.041 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.039+0000 7fdc609f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.041 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.039+0000 7fdc609f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.041 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.039+0000 7fdc609f29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:03.041 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.039+0000 7fdc609f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.039+0000 7fdc609f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.043+0000 7fdc609f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.043+0000 7fdc609f29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:03.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.043+0000 7fdc609f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.043 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.043+0000 7fdc609f29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:03.043 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.043+0000 7fdc609f29c0 20 searching for the correct realm 2024-09-12T00:36:03.050 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.051+0000 7fdc5ecf9640 0 -- 172.21.15.43:0/2484103487 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7fdc480669f0 msgr2=0x7fdc480379d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:03.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.267+0000 7fdc5e4f8640 0 -- 172.21.15.43:0/2484103487 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x557ceceeaaa0 msgr2=0x557ceceecf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:03.274 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.275+0000 7fdc609f29c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:36:03.274 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.275+0000 7fdc609f29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:03.274 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.275+0000 7fdc609f29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:03.274 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.275+0000 7fdc609f29c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:36:03.274 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.275+0000 7fdc609f29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:03.275 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.275+0000 7fdc609f29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:03.275 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.275+0000 7fdc609f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.275 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.275+0000 7fdc609f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.275 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.275+0000 7fdc609f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.276 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.275+0000 7fdc609f29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:03.276 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.275+0000 7fdc609f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.277 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.279+0000 7fdc609f29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:03.277 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.279+0000 7fdc609f29c0 20 zone default found 2024-09-12T00:36:03.277 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.279+0000 7fdc609f29c0 4 Realm: () 2024-09-12T00:36:03.277 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.279+0000 7fdc609f29c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:36:03.277 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.279+0000 7fdc609f29c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:36:03.277 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.279+0000 7fdc609f29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:03.277 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.279+0000 7fdc609f29c0 20 zonegroup default 2024-09-12T00:36:03.277 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.279+0000 7fdc609f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.278 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.279+0000 7fdc609f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.278 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.279+0000 7fdc609f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.278 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.279+0000 7fdc609f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.278 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.279+0000 7fdc609f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.279 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.279+0000 7fdc609f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.279 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.279+0000 7fdc609f29c0 20 started sync module instance, tier type = 2024-09-12T00:36:03.279 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.279+0000 7fdc609f29c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:36:03.302 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.303+0000 7fdc609f29c0 20 add_watcher() i=0 2024-09-12T00:36:03.302 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.303+0000 7fdc609f29c0 20 add_watcher() i=1 2024-09-12T00:36:03.302 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.303+0000 7fdc609f29c0 20 add_watcher() i=2 2024-09-12T00:36:03.302 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.303+0000 7fdc609f29c0 20 add_watcher() i=3 2024-09-12T00:36:03.302 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.303+0000 7fdc609f29c0 20 add_watcher() i=4 2024-09-12T00:36:03.302 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.303+0000 7fdc609f29c0 20 add_watcher() i=5 2024-09-12T00:36:03.302 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.303+0000 7fdc609f29c0 20 add_watcher() i=6 2024-09-12T00:36:03.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.307+0000 7fdc609f29c0 20 add_watcher() i=7 2024-09-12T00:36:03.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.307+0000 7fdc609f29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:03.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.307+0000 7fdb14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:03.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.311+0000 7fdc609f29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:03.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.311+0000 7fdc609f29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:03.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.311+0000 7fdc609f29c0 5 note: GC not initialized 2024-09-12T00:36:03.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.311+0000 7fda8f7fe640 20 reqs_thread_entry: start 2024-09-12T00:36:03.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.311+0000 7fdc609f29c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:03.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.311+0000 7fdc609f29c0 20 Filter name: none 2024-09-12T00:36:03.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.311+0000 7fda8d7fa640 20 reqs_thread_entry: start 2024-09-12T00:36:03.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.311+0000 7fdc609f29c0 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-12T00:36:03.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.311+0000 7fdc609f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.311+0000 7fdc609f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.311+0000 7fdc609f29c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-12T00:36:03.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.311+0000 7fdc609f29c0 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T00:36:03.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.311+0000 7fdc609f29c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-12T00:36:03.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.311+0000 7fdc609f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.311+0000 7fdc609f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.311+0000 7fdc609f29c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-12T00:36:03.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.311+0000 7fdc609f29c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:36:03.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.311+0000 7fdc609f29c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T00:36:03.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.311+0000 7fdc609f29c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T00:36:03.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.315+0000 7fdc609f29c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-12T00:36:03.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.315+0000 7fdc609f29c0 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T00:36:03.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.315+0000 7fdc609f29c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-09-12T00:36:03.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.315+0000 7fdb41ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333460 cookie 93995039433248 notifier 5720 bl.length()=569 2024-09-12T00:36:03.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.315+0000 7fdb41ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-12T00:36:03.316 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.315+0000 7fdb41ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T00:36:03.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.319+0000 7fdc609f29c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T00:36:03.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.319+0000 7fdc609f29c0 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:36:03.319 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.319+0000 7fdc609f29c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-12T00:36:03.319 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.319+0000 7fdb417fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333461 cookie 93995039430272 notifier 5720 bl.length()=180 2024-09-12T00:36:03.319 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.319+0000 7fdb417fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T00:36:03.319 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.319+0000 7fdb417fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:36:03.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.323+0000 7fdb14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:03.326 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.327+0000 7fdc609f29c0 20 remove_watcher() i=0 2024-09-12T00:36:03.326 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.327+0000 7fdc609f29c0 2 removed watcher, disabling cache 2024-09-12T00:36:03.328 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.331+0000 7fdc609f29c0 20 remove_watcher() i=1 2024-09-12T00:36:03.331 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.331+0000 7fdc609f29c0 20 remove_watcher() i=2 2024-09-12T00:36:03.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.335+0000 7fdc609f29c0 20 remove_watcher() i=3 2024-09-12T00:36:03.336 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.335+0000 7fdc609f29c0 20 remove_watcher() i=4 2024-09-12T00:36:03.337 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.339+0000 7fdc609f29c0 20 remove_watcher() i=5 2024-09-12T00:36:03.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.339+0000 7fdc609f29c0 20 remove_watcher() i=6 2024-09-12T00:36:03.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:03.343+0000 7fdc609f29c0 20 remove_watcher() i=7 2024-09-12T00:36:15.342 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:15.343 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:15.394 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:15.394 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:15.424 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:15.424 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:15.455 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:15.455 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:15.468 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:15.468 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:15.516 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:15.517 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:15.561 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: reshard add 2024-09-12T00:36:15.562 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:15.562 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:36:15.598 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:15.598 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:15.644 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.643+0000 7f0c20cae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.646 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.647+0000 7f0c20cae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.646 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.647+0000 7f0c20cae9c0 20 realm 2024-09-12T00:36:15.646 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.647+0000 7f0c20cae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.646 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.647+0000 7f0c20cae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.646 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.647+0000 7f0c20cae9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:15.646 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.647+0000 7f0c20cae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.646 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.647+0000 7f0c20cae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.647 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.647+0000 7f0c20cae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.648 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.647+0000 7f0c20cae9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:15.648 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.647+0000 7f0c20cae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.649 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.651+0000 7f0c20cae9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:15.649 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.651+0000 7f0c20cae9c0 20 searching for the correct realm 2024-09-12T00:36:15.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.655+0000 7f0c1efb5640 0 -- 172.21.15.43:0/2777498183 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55f69ab95ba0 msgr2=0x55f69ab98020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:15.662 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.663+0000 7f0c1dfb3640 0 -- 172.21.15.43:0/2777498183 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f0c1401f040 msgr2=0x7f0c1401e440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:15.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.671+0000 7f0c20cae9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:36:15.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.671+0000 7f0c20cae9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:15.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.671+0000 7f0c20cae9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:15.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.671+0000 7f0c20cae9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:36:15.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.671+0000 7f0c20cae9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:15.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.671+0000 7f0c20cae9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:15.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.671+0000 7f0c20cae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.671 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.671+0000 7f0c20cae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.671 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.671+0000 7f0c20cae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.671+0000 7f0c20cae9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:15.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.671+0000 7f0c20cae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.671+0000 7f0c20cae9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:15.673 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.671+0000 7f0c20cae9c0 20 zone default found 2024-09-12T00:36:15.673 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.671+0000 7f0c20cae9c0 4 Realm: () 2024-09-12T00:36:15.673 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.671+0000 7f0c20cae9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:36:15.673 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.671+0000 7f0c20cae9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:36:15.673 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.671+0000 7f0c20cae9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:15.673 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.671+0000 7f0c20cae9c0 20 zonegroup default 2024-09-12T00:36:15.673 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.671+0000 7f0c20cae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.673 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.671+0000 7f0c20cae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.671+0000 7f0c20cae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.671+0000 7f0c20cae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.671+0000 7f0c20cae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.671+0000 7f0c20cae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.671+0000 7f0c20cae9c0 20 started sync module instance, tier type = 2024-09-12T00:36:15.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.671+0000 7f0c20cae9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:36:15.689 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.691+0000 7f0c20cae9c0 20 add_watcher() i=0 2024-09-12T00:36:15.689 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.691+0000 7f0c20cae9c0 20 add_watcher() i=1 2024-09-12T00:36:15.689 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.691+0000 7f0c20cae9c0 20 add_watcher() i=2 2024-09-12T00:36:15.689 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.691+0000 7f0c20cae9c0 20 add_watcher() i=3 2024-09-12T00:36:15.689 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.691+0000 7f0c20cae9c0 20 add_watcher() i=4 2024-09-12T00:36:15.689 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.691+0000 7f0c20cae9c0 20 add_watcher() i=5 2024-09-12T00:36:15.689 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.691+0000 7f0c20cae9c0 20 add_watcher() i=6 2024-09-12T00:36:15.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.691+0000 7f0c20cae9c0 20 add_watcher() i=7 2024-09-12T00:36:15.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.691+0000 7f0c20cae9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:15.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.695+0000 7f0ad4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:15.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.695+0000 7f0c20cae9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:15.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.695+0000 7f0c20cae9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:15.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.695+0000 7f0c20cae9c0 5 note: GC not initialized 2024-09-12T00:36:15.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.695+0000 7f0a4f7fe640 20 reqs_thread_entry: start 2024-09-12T00:36:15.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.695+0000 7f0c20cae9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:15.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.695+0000 7f0c20cae9c0 20 Filter name: none 2024-09-12T00:36:15.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.695+0000 7f0a4d7fa640 20 reqs_thread_entry: start 2024-09-12T00:36:15.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.695+0000 7f0c20cae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.695+0000 7f0c20cae9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:36:15.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.695+0000 7f0c20cae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.697 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.699+0000 7f0c20cae9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:36:15.697 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.699+0000 7f0c20cae9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:15.698 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.699+0000 7f0c20cae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.698 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.699+0000 7f0c20cae9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:36:15.699 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.699+0000 7f0c20cae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.699+0000 7f0c20cae9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:36:15.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.699+0000 7f0c20cae9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:15.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.703+0000 7f0ad4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:15.707 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.707+0000 7f0c20cae9c0 20 remove_watcher() i=0 2024-09-12T00:36:15.707 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.707+0000 7f0c20cae9c0 2 removed watcher, disabling cache 2024-09-12T00:36:15.710 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.711+0000 7f0c20cae9c0 20 remove_watcher() i=1 2024-09-12T00:36:15.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.711+0000 7f0c20cae9c0 20 remove_watcher() i=2 2024-09-12T00:36:15.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.715+0000 7f0c20cae9c0 20 remove_watcher() i=3 2024-09-12T00:36:15.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.715+0000 7f0c20cae9c0 20 remove_watcher() i=4 2024-09-12T00:36:15.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.719+0000 7f0c20cae9c0 20 remove_watcher() i=5 2024-09-12T00:36:15.718 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.719+0000 7f0c20cae9c0 20 remove_watcher() i=6 2024-09-12T00:36:15.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.719+0000 7f0c20cae9c0 20 remove_watcher() i=7 2024-09-12T00:36:15.735 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:15.735 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:36:15.735 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: a-bucket id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-12T00:36:15.735 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:15.735 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-09-12T00:36:15.764 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:15.764 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:15.989 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:15.991+0000 7fcc832db640 0 --2- 172.21.15.43:0/1139258280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568807409c0 0x556880893370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:36:16.019 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.019+0000 7fcc85fd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.021 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.023+0000 7fcc85fd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:16.021 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.023+0000 7fcc85fd69c0 20 realm 2024-09-12T00:36:16.021 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.023+0000 7fcc85fd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.023+0000 7fcc85fd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:16.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.023+0000 7fcc85fd69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:16.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.023+0000 7fcc85fd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.023+0000 7fcc85fd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:16.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.023+0000 7fcc85fd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.023+0000 7fcc85fd69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:16.024 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.023+0000 7fcc85fd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.025 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.027+0000 7fcc85fd69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:16.025 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.027+0000 7fcc85fd69c0 20 searching for the correct realm 2024-09-12T00:36:16.028 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.027+0000 7fcc832db640 0 -- 172.21.15.43:0/2767209331 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fcc78040c20 msgr2=0x7fcc78060400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:16.243 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.243+0000 7fcc83adc640 0 -- 172.21.15.43:0/2767209331 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fcc7800dbb0 msgr2=0x7fcc78015330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:16.461 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.459+0000 7fcc85fd69c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:36:16.461 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.459+0000 7fcc85fd69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:16.461 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.459+0000 7fcc85fd69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:16.461 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.459+0000 7fcc85fd69c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:36:16.461 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.459+0000 7fcc85fd69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:16.461 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.459+0000 7fcc85fd69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:16.461 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.459+0000 7fcc85fd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.461 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.463+0000 7fcc85fd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:16.462 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.463+0000 7fcc85fd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.462 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.463+0000 7fcc85fd69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:16.462 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.463+0000 7fcc85fd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.463 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.463+0000 7fcc85fd69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:16.463 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.463+0000 7fcc85fd69c0 20 zone default found 2024-09-12T00:36:16.463 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.463+0000 7fcc85fd69c0 4 Realm: () 2024-09-12T00:36:16.463 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.463+0000 7fcc85fd69c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:36:16.464 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.463+0000 7fcc85fd69c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:36:16.464 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.463+0000 7fcc85fd69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:16.464 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.463+0000 7fcc85fd69c0 20 zonegroup default 2024-09-12T00:36:16.464 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.463+0000 7fcc85fd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.464 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.463+0000 7fcc85fd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:16.464 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.463+0000 7fcc85fd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.465 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.467+0000 7fcc85fd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:16.465 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.467+0000 7fcc85fd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.467+0000 7fcc85fd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:16.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.467+0000 7fcc85fd69c0 20 started sync module instance, tier type = 2024-09-12T00:36:16.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.467+0000 7fcc85fd69c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:36:16.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.491+0000 7fcc85fd69c0 20 add_watcher() i=0 2024-09-12T00:36:16.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.491+0000 7fcc85fd69c0 20 add_watcher() i=1 2024-09-12T00:36:16.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.491+0000 7fcc85fd69c0 20 add_watcher() i=2 2024-09-12T00:36:16.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.491+0000 7fcc85fd69c0 20 add_watcher() i=3 2024-09-12T00:36:16.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.491+0000 7fcc85fd69c0 20 add_watcher() i=4 2024-09-12T00:36:16.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.491+0000 7fcc85fd69c0 20 add_watcher() i=5 2024-09-12T00:36:16.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.491+0000 7fcc85fd69c0 20 add_watcher() i=6 2024-09-12T00:36:16.491 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.491+0000 7fcc85fd69c0 20 add_watcher() i=7 2024-09-12T00:36:16.491 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.491+0000 7fcc85fd69c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:16.496 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.495+0000 7fcb39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:16.496 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.495+0000 7fcc85fd69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:16.496 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.495+0000 7fcc85fd69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:16.497 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.495+0000 7fcc85fd69c0 5 note: GC not initialized 2024-09-12T00:36:16.497 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.499+0000 7fcb38fe1640 20 reqs_thread_entry: start 2024-09-12T00:36:16.497 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.499+0000 7fcc85fd69c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:16.497 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.499+0000 7fcc85fd69c0 20 Filter name: none 2024-09-12T00:36:16.498 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.499+0000 7fcab27fc640 20 reqs_thread_entry: start 2024-09-12T00:36:16.498 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.499+0000 7fcc85fd69c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:36:16.498 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.499+0000 7fcc85fd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.499 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.499+0000 7fcc85fd69c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:36:16.499 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.499+0000 7fcc85fd69c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:36:16.499 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.499+0000 7fcc85fd69c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:36:16.499 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.499+0000 7fcc85fd69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 : miss 2024-09-12T00:36:16.499 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.499+0000 7fcc85fd69c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.500 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.499+0000 7fcc85fd69c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:36:16.500 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.499+0000 7fcc85fd69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:36:16.500 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.499+0000 7fcc85fd69c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:36:16.500 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.499+0000 7fcc85fd69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:16.500 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.499+0000 7fcc85fd69c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:16.500 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.499+0000 7fcc85fd69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 2024-09-12T00:36:16.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.503+0000 7fcb39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:16.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.511+0000 7fcc85fd69c0 20 remove_watcher() i=0 2024-09-12T00:36:16.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.511+0000 7fcc85fd69c0 2 removed watcher, disabling cache 2024-09-12T00:36:16.512 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.511+0000 7fcc85fd69c0 20 remove_watcher() i=1 2024-09-12T00:36:16.514 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.515+0000 7fcc85fd69c0 20 remove_watcher() i=2 2024-09-12T00:36:16.517 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.519+0000 7fcc85fd69c0 20 remove_watcher() i=3 2024-09-12T00:36:16.519 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.519+0000 7fcc85fd69c0 20 remove_watcher() i=4 2024-09-12T00:36:16.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.523+0000 7fcc85fd69c0 20 remove_watcher() i=5 2024-09-12T00:36:16.523 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.523+0000 7fcc85fd69c0 20 remove_watcher() i=6 2024-09-12T00:36:16.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.527+0000 7fcc85fd69c0 20 remove_watcher() i=7 2024-09-12T00:36:16.544 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin reshard list 2024-09-12T00:36:16.575 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:16.575 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:16.622 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.623+0000 7f03a37cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.624 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.623+0000 7f03a37cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:16.624 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.623+0000 7f03a37cc9c0 20 realm 2024-09-12T00:36:16.624 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.623+0000 7f03a37cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.624 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.623+0000 7f03a37cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:16.624 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.623+0000 7f03a37cc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:16.624 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.623+0000 7f03a37cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.624 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.623+0000 7f03a37cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:16.625 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.623+0000 7f03a37cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.627+0000 7f03a37cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:16.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.627+0000 7f03a37cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.627+0000 7f03a37cc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:16.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.627+0000 7f03a37cc9c0 20 searching for the correct realm 2024-09-12T00:36:16.632 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.631+0000 7f03a12d2640 0 -- 172.21.15.43:0/3482258626 >> [v2:172.21.15.97:6816/489545787,v1:172.21.15.97:6817/489545787] conn(0x7f039c103870 msgr2=0x7f039c0f97f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:16.638 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.639+0000 7f03a12d2640 0 -- 172.21.15.43:0/3482258626 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f03980913a0 msgr2=0x7f03980830c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:16.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.855+0000 7f03a37cc9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:36:16.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.855+0000 7f03a37cc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:16.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.855+0000 7f03a37cc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:16.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.855+0000 7f03a37cc9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:36:16.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.855+0000 7f03a37cc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:16.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.855+0000 7f03a37cc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:16.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.855+0000 7f03a37cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.855+0000 7f03a37cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:16.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.855+0000 7f03a37cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.855+0000 7f03a37cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:16.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.855+0000 7f03a37cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.859+0000 7f03a37cc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:16.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.859+0000 7f03a37cc9c0 20 zone default found 2024-09-12T00:36:16.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.859+0000 7f03a37cc9c0 4 Realm: () 2024-09-12T00:36:16.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.859+0000 7f03a37cc9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:36:16.858 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.859+0000 7f03a37cc9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:36:16.858 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.859+0000 7f03a37cc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:16.858 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.859+0000 7f03a37cc9c0 20 zonegroup default 2024-09-12T00:36:16.858 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.859+0000 7f03a37cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.858 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.859+0000 7f03a37cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:16.858 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.859+0000 7f03a37cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.859 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.859+0000 7f03a37cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:16.859 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.859+0000 7f03a37cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.860 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.859+0000 7f03a37cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:16.860 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.859+0000 7f03a37cc9c0 20 started sync module instance, tier type = 2024-09-12T00:36:16.860 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.859+0000 7f03a37cc9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:36:16.890 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.891+0000 7f03a37cc9c0 20 add_watcher() i=0 2024-09-12T00:36:16.890 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.891+0000 7f03a37cc9c0 20 add_watcher() i=1 2024-09-12T00:36:16.890 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.891+0000 7f03a37cc9c0 20 add_watcher() i=2 2024-09-12T00:36:16.890 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.891+0000 7f03a37cc9c0 20 add_watcher() i=3 2024-09-12T00:36:16.890 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.891+0000 7f03a37cc9c0 20 add_watcher() i=4 2024-09-12T00:36:16.890 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.891+0000 7f03a37cc9c0 20 add_watcher() i=5 2024-09-12T00:36:16.890 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.891+0000 7f03a37cc9c0 20 add_watcher() i=6 2024-09-12T00:36:16.892 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.891+0000 7f03a37cc9c0 20 add_watcher() i=7 2024-09-12T00:36:16.892 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.891+0000 7f03a37cc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:16.897 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.899+0000 7f02577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:16.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.899+0000 7f03a37cc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:16.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.899+0000 7f03a37cc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:16.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.899+0000 7f03a37cc9c0 5 note: GC not initialized 2024-09-12T00:36:16.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.899+0000 7f02567e4640 20 reqs_thread_entry: start 2024-09-12T00:36:16.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.899+0000 7f03a37cc9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:16.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.899+0000 7f03a37cc9c0 20 Filter name: none 2024-09-12T00:36:16.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.899+0000 7f01c7fff640 20 reqs_thread_entry: start 2024-09-12T00:36:16.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.911+0000 7f02577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:16.915 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.915+0000 7f03a37cc9c0 20 remove_watcher() i=0 2024-09-12T00:36:16.915 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.915+0000 7f03a37cc9c0 2 removed watcher, disabling cache 2024-09-12T00:36:16.919 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.919+0000 7f03a37cc9c0 20 remove_watcher() i=1 2024-09-12T00:36:16.921 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.923+0000 7f03a37cc9c0 20 remove_watcher() i=2 2024-09-12T00:36:16.923 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.923+0000 7f03a37cc9c0 20 remove_watcher() i=3 2024-09-12T00:36:16.925 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.927+0000 7f03a37cc9c0 20 remove_watcher() i=4 2024-09-12T00:36:16.927 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.927+0000 7f03a37cc9c0 20 remove_watcher() i=5 2024-09-12T00:36:16.929 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.931+0000 7f03a37cc9c0 20 remove_watcher() i=6 2024-09-12T00:36:16.930 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:16.931+0000 7f03a37cc9c0 20 remove_watcher() i=7 2024-09-12T00:36:16.948 INFO:tasks.workunit.client.0.smithi043.stderr:bucket name a-bucket 2024-09-12T00:36:16.949 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: reshard process 2024-09-12T00:36:16.949 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:16.949 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin reshard process 2024-09-12T00:36:16.981 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:16.981 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:17.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.023+0000 7f4466f1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.023+0000 7f4466f1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:17.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.023+0000 7f4466f1a9c0 20 realm 2024-09-12T00:36:17.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.023+0000 7f4466f1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.023+0000 7f4466f1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:17.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.023+0000 7f4466f1a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:17.024 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.023+0000 7f4466f1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.024 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.023+0000 7f4466f1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:17.024 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.023+0000 7f4466f1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.025 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.027+0000 7f4466f1a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:17.026 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.027+0000 7f4466f1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.026 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.027+0000 7f4466f1a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:17.026 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.027+0000 7f4466f1a9c0 20 searching for the correct realm 2024-09-12T00:36:17.032 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.031+0000 7f4465221640 0 -- 172.21.15.43:0/1209373859 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55632e3ab3d0 msgr2=0x55632e3ad7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:17.039 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.039+0000 7f446421f640 0 -- 172.21.15.43:0/1209373859 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f445803f040 msgr2=0x7f4458032460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:17.046 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.047+0000 7f4466f1a9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:36:17.046 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.047+0000 7f4466f1a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:17.047 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.047+0000 7f4466f1a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:17.047 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.047+0000 7f4466f1a9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:36:17.047 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.047+0000 7f4466f1a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:17.047 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.047+0000 7f4466f1a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:17.047 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.047+0000 7f4466f1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.047 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.047+0000 7f4466f1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:17.047 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.047+0000 7f4466f1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.048 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.047+0000 7f4466f1a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:17.048 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.047+0000 7f4466f1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.048 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.047+0000 7f4466f1a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:17.048 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.047+0000 7f4466f1a9c0 20 zone default found 2024-09-12T00:36:17.048 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.047+0000 7f4466f1a9c0 4 Realm: () 2024-09-12T00:36:17.048 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.047+0000 7f4466f1a9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:36:17.048 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.047+0000 7f4466f1a9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:36:17.048 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.047+0000 7f4466f1a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:17.048 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.047+0000 7f4466f1a9c0 20 zonegroup default 2024-09-12T00:36:17.049 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.047+0000 7f4466f1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.049 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.047+0000 7f4466f1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:17.049 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.047+0000 7f4466f1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.049 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.051+0000 7f4466f1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:17.049 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.051+0000 7f4466f1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.050 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.051+0000 7f4466f1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:17.050 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.051+0000 7f4466f1a9c0 20 started sync module instance, tier type = 2024-09-12T00:36:17.050 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.051+0000 7f4466f1a9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:36:17.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.067+0000 7f4466f1a9c0 20 add_watcher() i=0 2024-09-12T00:36:17.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.067+0000 7f4466f1a9c0 20 add_watcher() i=1 2024-09-12T00:36:17.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.067+0000 7f4466f1a9c0 20 add_watcher() i=2 2024-09-12T00:36:17.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.067+0000 7f4466f1a9c0 20 add_watcher() i=3 2024-09-12T00:36:17.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.067+0000 7f4466f1a9c0 20 add_watcher() i=4 2024-09-12T00:36:17.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.067+0000 7f4466f1a9c0 20 add_watcher() i=5 2024-09-12T00:36:17.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.067+0000 7f4466f1a9c0 20 add_watcher() i=6 2024-09-12T00:36:17.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.067+0000 7f4466f1a9c0 20 add_watcher() i=7 2024-09-12T00:36:17.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.067+0000 7f4466f1a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:17.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.067+0000 7f431afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:17.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.071+0000 7f4466f1a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:17.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.071+0000 7f4466f1a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:17.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.071+0000 7f4466f1a9c0 5 note: GC not initialized 2024-09-12T00:36:17.070 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.071+0000 7f4319fe3640 20 reqs_thread_entry: start 2024-09-12T00:36:17.070 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.071+0000 7f4466f1a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:17.070 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.071+0000 7f4466f1a9c0 20 Filter name: none 2024-09-12T00:36:17.070 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.071+0000 7f428b7fe640 20 reqs_thread_entry: start 2024-09-12T00:36:17.070 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.071+0000 7f4466f1a9c0 20 processing logshard = reshard.0000000000 2024-09-12T00:36:17.076 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.075+0000 7f4466f1a9c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T00:36:17.076 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.075+0000 7f4466f1a9c0 20 processing logshard = reshard.0000000001 2024-09-12T00:36:17.081 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.079+0000 7f4466f1a9c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T00:36:17.081 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.079+0000 7f4466f1a9c0 20 processing logshard = reshard.0000000002 2024-09-12T00:36:17.086 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.087+0000 7f4466f1a9c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T00:36:17.086 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.087+0000 7f4466f1a9c0 20 processing logshard = reshard.0000000003 2024-09-12T00:36:17.092 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.091+0000 7f4466f1a9c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T00:36:17.092 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.091+0000 7f4466f1a9c0 20 processing logshard = reshard.0000000004 2024-09-12T00:36:17.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.099+0000 7f4466f1a9c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T00:36:17.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.099+0000 7f4466f1a9c0 20 processing logshard = reshard.0000000005 2024-09-12T00:36:17.103 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.103+0000 7f4466f1a9c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T00:36:17.103 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.103+0000 7f4466f1a9c0 20 processing logshard = reshard.0000000006 2024-09-12T00:36:17.105 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.107+0000 7f4466f1a9c0 20 process_entry resharding a-bucket 2024-09-12T00:36:17.105 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.107+0000 7f4466f1a9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:36:17.105 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.107+0000 7f4466f1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.107+0000 7f4466f1a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:36:17.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.107+0000 7f4466f1a9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T00:36:17.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.107+0000 7f4466f1a9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:36:17.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.107+0000 7f4466f1a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 : miss 2024-09-12T00:36:17.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.107+0000 7f4466f1a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.107+0000 7f4466f1a9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:36:17.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.107+0000 7f4466f1a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:36:17.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.107+0000 7f4466f1a9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:36:17.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.107+0000 7f4466f1a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:17.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.107+0000 7f4466f1a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:17.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.107+0000 7f4466f1a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 2024-09-12T00:36:17.121 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.123+0000 7f4466f1a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:36:17.121 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.123+0000 7f4466f1a9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:36:17.121 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.123+0000 7f4466f1a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:17.121 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.123+0000 7f4466f1a9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17, ofs0, ns] 2024-09-12T00:36:17.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.123+0000 7f433bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333465 cookie 93884465797264 notifier 5789 bl.length()=827 2024-09-12T00:36:17.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.123+0000 7f433bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:36:17.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.123+0000 7f433bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:36:17.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.123+0000 7f433bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:17.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.123+0000 7f4466f1a9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_sources= new_sources= 2024-09-12T00:36:17.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.123+0000 7f4466f1a9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential sources added=[] removed=[] 2024-09-12T00:36:17.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.123+0000 7f4466f1a9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_dests= new_dests= 2024-09-12T00:36:17.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.123+0000 7f4466f1a9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential dests added=[] removed=[] 2024-09-12T00:36:17.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.131+0000 7f4466f1a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.0 2024-09-12T00:36:17.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.131+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.0 2024-09-12T00:36:17.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.131+0000 7f4466f1a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.1 2024-09-12T00:36:17.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.131+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.1 2024-09-12T00:36:17.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.131+0000 7f4466f1a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.2 2024-09-12T00:36:17.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.131+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.2 2024-09-12T00:36:17.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.131+0000 7f4466f1a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.3 2024-09-12T00:36:17.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.131+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.3 2024-09-12T00:36:17.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.131+0000 7f4466f1a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.4 2024-09-12T00:36:17.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.131+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.4 2024-09-12T00:36:17.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.131+0000 7f4466f1a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.5 2024-09-12T00:36:17.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.131+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.5 2024-09-12T00:36:17.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.131+0000 7f4466f1a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.6 2024-09-12T00:36:17.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.131+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.6 2024-09-12T00:36:17.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.131+0000 7f4466f1a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.7 2024-09-12T00:36:17.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.131+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.7 2024-09-12T00:36:17.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.131+0000 7f4466f1a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.8 2024-09-12T00:36:17.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.131+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.8 2024-09-12T00:36:17.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.131+0000 7f4466f1a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.9 2024-09-12T00:36:17.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.131+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.9 2024-09-12T00:36:17.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.131+0000 7f4466f1a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.10 2024-09-12T00:36:17.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.131+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.10 2024-09-12T00:36:17.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.131+0000 7f4466f1a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.11 2024-09-12T00:36:17.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.131+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.11 2024-09-12T00:36:17.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.131+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.0 2024-09-12T00:36:17.135 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.135+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1 2024-09-12T00:36:17.135 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.135+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2 2024-09-12T00:36:17.135 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.135+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3 2024-09-12T00:36:17.135 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.135+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.4 2024-09-12T00:36:17.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.135+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.5 2024-09-12T00:36:17.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.139+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.6 2024-09-12T00:36:17.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.139+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.7 2024-09-12T00:36:17.138 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.139+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.8 2024-09-12T00:36:17.139 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.139+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.9 2024-09-12T00:36:17.140 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.139+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.10 2024-09-12T00:36:17.141 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.143+0000 7f4466f1a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:17.141 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.143+0000 7f4466f1a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 2024-09-12T00:36:17.143 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.143+0000 7f4466f1a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:36:17.143 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.143+0000 7f4466f1a9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:36:17.143 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.143+0000 7f4466f1a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:17.143 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.143+0000 7f4466f1a9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17, ofs0, ns] 2024-09-12T00:36:17.144 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.143+0000 7f433b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333466 cookie 93884465797264 notifier 5789 bl.length()=827 2024-09-12T00:36:17.144 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.143+0000 7f433b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:36:17.144 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.143+0000 7f433b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:36:17.144 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.143+0000 7f433b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:17.144 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.143+0000 7f4466f1a9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_sources= new_sources= 2024-09-12T00:36:17.144 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.143+0000 7f4466f1a9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential sources added=[] removed=[] 2024-09-12T00:36:17.145 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.143+0000 7f4466f1a9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_dests= new_dests= 2024-09-12T00:36:17.145 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.143+0000 7f4466f1a9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential dests added=[] removed=[] 2024-09-12T00:36:17.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.147+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.0 2024-09-12T00:36:17.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.151+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1 2024-09-12T00:36:17.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.151+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2 2024-09-12T00:36:17.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.151+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3 2024-09-12T00:36:17.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.151+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.4 2024-09-12T00:36:17.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.151+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.5 2024-09-12T00:36:17.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.151+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.6 2024-09-12T00:36:17.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.151+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.7 2024-09-12T00:36:17.153 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.155+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.8 2024-09-12T00:36:17.153 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.155+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.9 2024-09-12T00:36:17.154 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.155+0000 7f4466f1a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.10 2024-09-12T00:36:17.154 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.155+0000 7f4466f1a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:17.155 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.155+0000 7f4466f1a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 2024-09-12T00:36:17.157 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.159+0000 7f4466f1a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:36:17.157 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.159+0000 7f4466f1a9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:36:17.157 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.159+0000 7f4466f1a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:17.157 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.159+0000 7f4466f1a9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17, ofs0, ns] 2024-09-12T00:36:17.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.159+0000 7f433bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333467 cookie 93884465797264 notifier 5789 bl.length()=795 2024-09-12T00:36:17.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.159+0000 7f433bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:36:17.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.159+0000 7f433bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:36:17.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.159+0000 7f433bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:17.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.159+0000 7f4466f1a9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_sources= new_sources= 2024-09-12T00:36:17.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.159+0000 7f4466f1a9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential sources added=[] removed=[] 2024-09-12T00:36:17.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.159+0000 7f4466f1a9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_dests= new_dests= 2024-09-12T00:36:17.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.159+0000 7f4466f1a9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential dests added=[] removed=[] 2024-09-12T00:36:17.163 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.163+0000 7f4466f1a9c0 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-09-12T00:36:17.165 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.167+0000 7f4466f1a9c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T00:36:17.169 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.171+0000 7f4466f1a9c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T00:36:17.169 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.171+0000 7f4466f1a9c0 20 processing logshard = reshard.0000000007 2024-09-12T00:36:17.173 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.175+0000 7f4466f1a9c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T00:36:17.173 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.175+0000 7f4466f1a9c0 20 processing logshard = reshard.0000000008 2024-09-12T00:36:17.179 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.179+0000 7f4466f1a9c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T00:36:17.179 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.179+0000 7f4466f1a9c0 20 processing logshard = reshard.0000000009 2024-09-12T00:36:17.186 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.187+0000 7f4466f1a9c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T00:36:17.186 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.187+0000 7f4466f1a9c0 20 processing logshard = reshard.0000000010 2024-09-12T00:36:17.190 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.191+0000 7f4466f1a9c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T00:36:17.190 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.191+0000 7f4466f1a9c0 20 processing logshard = reshard.0000000011 2024-09-12T00:36:17.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.195+0000 7f4466f1a9c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T00:36:17.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.195+0000 7f4466f1a9c0 20 processing logshard = reshard.0000000012 2024-09-12T00:36:17.202 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.203+0000 7f4466f1a9c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T00:36:17.202 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.203+0000 7f4466f1a9c0 20 processing logshard = reshard.0000000013 2024-09-12T00:36:17.206 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.207+0000 7f4466f1a9c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T00:36:17.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.207+0000 7f4466f1a9c0 20 processing logshard = reshard.0000000014 2024-09-12T00:36:17.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.211+0000 7f4466f1a9c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T00:36:17.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.211+0000 7f4466f1a9c0 20 processing logshard = reshard.0000000015 2024-09-12T00:36:17.217 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.219+0000 7f4466f1a9c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T00:36:17.218 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.219+0000 7f431afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:17.223 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.223+0000 7f4466f1a9c0 20 remove_watcher() i=0 2024-09-12T00:36:17.223 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.223+0000 7f4466f1a9c0 2 removed watcher, disabling cache 2024-09-12T00:36:17.226 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.227+0000 7f4466f1a9c0 20 remove_watcher() i=1 2024-09-12T00:36:17.228 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.227+0000 7f4466f1a9c0 20 remove_watcher() i=2 2024-09-12T00:36:17.231 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.231+0000 7f4466f1a9c0 20 remove_watcher() i=3 2024-09-12T00:36:17.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.235+0000 7f4466f1a9c0 20 remove_watcher() i=4 2024-09-12T00:36:17.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.235+0000 7f4466f1a9c0 20 remove_watcher() i=5 2024-09-12T00:36:17.238 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.239+0000 7f4466f1a9c0 20 remove_watcher() i=6 2024-09-12T00:36:17.240 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:17.239+0000 7f4466f1a9c0 20 remove_watcher() i=7 2024-09-12T00:36:22.262 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:36:22.296 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:22.297 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:22.343 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.343+0000 7f8054a569c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.343+0000 7f8054a569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.343+0000 7f8054a569c0 20 realm 2024-09-12T00:36:22.345 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.343+0000 7f8054a569c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.345 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.347+0000 7f8054a569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.345 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.347+0000 7f8054a569c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:22.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.347+0000 7f8054a569c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.347+0000 7f8054a569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.347+0000 7f8054a569c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.347 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.347+0000 7f8054a569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:22.347 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.347+0000 7f8054a569c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.347 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.347+0000 7f8054a569c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:22.348 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.347+0000 7f8054a569c0 20 searching for the correct realm 2024-09-12T00:36:22.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.355+0000 7f8051d5b640 0 -- 172.21.15.43:0/2417436732 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f80480d5400 msgr2=0x7f80480d5800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:22.360 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.363+0000 7f8051d5b640 0 -- 172.21.15.43:0/2417436732 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f7f1c080b80 msgr2=0x7f7f1c082fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:22.368 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.367+0000 7f8054a569c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:36:22.368 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.367+0000 7f8054a569c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:22.368 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.367+0000 7f8054a569c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:22.368 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.367+0000 7f8054a569c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:36:22.368 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.367+0000 7f8054a569c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:22.368 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.367+0000 7f8054a569c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:22.369 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.367+0000 7f8054a569c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.369 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.367+0000 7f8054a569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.369 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.367+0000 7f8054a569c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.369 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.371+0000 7f8054a569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:22.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.371+0000 7f8054a569c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.371+0000 7f8054a569c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:22.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.371+0000 7f8054a569c0 20 zone default found 2024-09-12T00:36:22.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.371+0000 7f8054a569c0 4 Realm: () 2024-09-12T00:36:22.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.371+0000 7f8054a569c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:36:22.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.371+0000 7f8054a569c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:36:22.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.371+0000 7f8054a569c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:22.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.371+0000 7f8054a569c0 20 zonegroup default 2024-09-12T00:36:22.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.371+0000 7f8054a569c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.371+0000 7f8054a569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.371 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.371+0000 7f8054a569c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.371 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.371+0000 7f8054a569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.371 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.371+0000 7f8054a569c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.371 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.371+0000 7f8054a569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.371 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.371+0000 7f8054a569c0 20 started sync module instance, tier type = 2024-09-12T00:36:22.371 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.371+0000 7f8054a569c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:36:22.388 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.387+0000 7f8054a569c0 20 add_watcher() i=0 2024-09-12T00:36:22.388 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.387+0000 7f8054a569c0 20 add_watcher() i=1 2024-09-12T00:36:22.388 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.387+0000 7f8054a569c0 20 add_watcher() i=2 2024-09-12T00:36:22.389 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.391+0000 7f8054a569c0 20 add_watcher() i=3 2024-09-12T00:36:22.389 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.391+0000 7f8054a569c0 20 add_watcher() i=4 2024-09-12T00:36:22.389 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.391+0000 7f8054a569c0 20 add_watcher() i=5 2024-09-12T00:36:22.390 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.391+0000 7f8054a569c0 20 add_watcher() i=6 2024-09-12T00:36:22.390 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.391+0000 7f8054a569c0 20 add_watcher() i=7 2024-09-12T00:36:22.390 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.391+0000 7f8054a569c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:22.392 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.391+0000 7f7f08fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:22.393 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.395+0000 7f8054a569c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:22.393 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.395+0000 7f8054a569c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:22.393 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.395+0000 7f8054a569c0 5 note: GC not initialized 2024-09-12T00:36:22.394 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.395+0000 7f7e837fe640 20 reqs_thread_entry: start 2024-09-12T00:36:22.394 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.395+0000 7f8054a569c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:22.394 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.395+0000 7f8054a569c0 20 Filter name: none 2024-09-12T00:36:22.394 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.395+0000 7f7e817fa640 20 reqs_thread_entry: start 2024-09-12T00:36:22.394 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.395+0000 7f8054a569c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.395 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.395+0000 7f8054a569c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:36:22.395 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.395+0000 7f8054a569c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.396 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.395+0000 7f8054a569c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:36:22.396 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.395+0000 7f8054a569c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:22.396 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.395+0000 7f8054a569c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.397 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.399+0000 7f8054a569c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:36:22.397 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.399+0000 7f8054a569c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.398 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.399+0000 7f8054a569c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:36:22.398 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.399+0000 7f8054a569c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:22.401 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.403+0000 7f7f08fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:22.406 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.407+0000 7f8054a569c0 20 remove_watcher() i=0 2024-09-12T00:36:22.406 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.407+0000 7f8054a569c0 2 removed watcher, disabling cache 2024-09-12T00:36:22.408 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.407+0000 7f8054a569c0 20 remove_watcher() i=1 2024-09-12T00:36:22.410 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.411+0000 7f8054a569c0 20 remove_watcher() i=2 2024-09-12T00:36:22.413 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.415+0000 7f8054a569c0 20 remove_watcher() i=3 2024-09-12T00:36:22.415 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.415+0000 7f8054a569c0 20 remove_watcher() i=4 2024-09-12T00:36:22.417 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.419+0000 7f8054a569c0 20 remove_watcher() i=5 2024-09-12T00:36:22.418 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.419+0000 7f8054a569c0 20 remove_watcher() i=6 2024-09-12T00:36:22.420 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.419+0000 7f8054a569c0 20 remove_watcher() i=7 2024-09-12T00:36:22.435 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:22.436 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:36:22.436 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: a-bucket id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T00:36:22.436 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:22.436 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: reshard add non empty bucket 2024-09-12T00:36:22.436 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:22.439 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.439 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:22.452 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.452 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:22.464 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.464 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:22.476 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.476 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:22.488 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.488 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:22.500 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.500 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:22.517 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.517 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:22.534 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.534 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:22.548 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:36:22.583 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:22.583 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:22.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.631+0000 7f8aabaa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.631 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.631+0000 7f8aabaa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.631 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.631+0000 7f8aabaa39c0 20 realm 2024-09-12T00:36:22.631 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.631+0000 7f8aabaa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.631 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.631+0000 7f8aabaa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.631 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.631+0000 7f8aabaa39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:22.631 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.631+0000 7f8aabaa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.632 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.631+0000 7f8aabaa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.632 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.631+0000 7f8aabaa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.635+0000 7f8aabaa39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:22.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.635+0000 7f8aabaa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.635+0000 7f8aabaa39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:22.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.635+0000 7f8aabaa39c0 20 searching for the correct realm 2024-09-12T00:36:22.637 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.639+0000 7f8aa8da8640 0 -- 172.21.15.43:0/2494605590 >> [v2:172.21.15.43:6816/653473197,v1:172.21.15.43:6817/653473197] conn(0x56517919cb80 msgr2=0x56517919ef70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:22.644 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.643+0000 7f8aa8da8640 0 -- 172.21.15.43:0/2494605590 >> [v2:172.21.15.43:6816/653473197,v1:172.21.15.43:6817/653473197] conn(0x7f8974080b80 msgr2=0x7f8974082fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:22.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.655+0000 7f8aabaa39c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:36:22.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.655+0000 7f8aabaa39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:22.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.655+0000 7f8aabaa39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:22.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.655+0000 7f8aabaa39c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:36:22.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.655+0000 7f8aabaa39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:22.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.655+0000 7f8aabaa39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:22.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.655+0000 7f8aabaa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.655+0000 7f8aabaa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.655+0000 7f8aabaa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.655+0000 7f8aabaa39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:22.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.655+0000 7f8aabaa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.655+0000 7f8aabaa39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:22.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.655+0000 7f8aabaa39c0 20 zone default found 2024-09-12T00:36:22.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.655+0000 7f8aabaa39c0 4 Realm: () 2024-09-12T00:36:22.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.655+0000 7f8aabaa39c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:36:22.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.655+0000 7f8aabaa39c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:36:22.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.655+0000 7f8aabaa39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:22.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.655+0000 7f8aabaa39c0 20 zonegroup default 2024-09-12T00:36:22.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.655+0000 7f8aabaa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.655+0000 7f8aabaa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.655+0000 7f8aabaa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.657 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.655+0000 7f8aabaa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.657 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.655+0000 7f8aabaa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.657 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.659+0000 7f8aabaa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.657 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.659+0000 7f8aabaa39c0 20 started sync module instance, tier type = 2024-09-12T00:36:22.657 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.659+0000 7f8aabaa39c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:36:22.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.671+0000 7f8aabaa39c0 20 add_watcher() i=0 2024-09-12T00:36:22.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.671+0000 7f8aabaa39c0 20 add_watcher() i=1 2024-09-12T00:36:22.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.671+0000 7f8aabaa39c0 20 add_watcher() i=2 2024-09-12T00:36:22.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.671+0000 7f8aabaa39c0 20 add_watcher() i=3 2024-09-12T00:36:22.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.671+0000 7f8aabaa39c0 20 add_watcher() i=4 2024-09-12T00:36:22.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.671+0000 7f8aabaa39c0 20 add_watcher() i=5 2024-09-12T00:36:22.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.671+0000 7f8aabaa39c0 20 add_watcher() i=6 2024-09-12T00:36:22.673 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.675+0000 7f8aabaa39c0 20 add_watcher() i=7 2024-09-12T00:36:22.673 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.675+0000 7f8aabaa39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:22.675 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.675+0000 7f895f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:22.676 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.675+0000 7f8aabaa39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:22.677 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.675+0000 7f8aabaa39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:22.677 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.675+0000 7f8aabaa39c0 5 note: GC not initialized 2024-09-12T00:36:22.677 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.675+0000 7f895e7e4640 20 reqs_thread_entry: start 2024-09-12T00:36:22.677 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.675+0000 7f8aabaa39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:22.677 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.675+0000 7f8aabaa39c0 20 Filter name: none 2024-09-12T00:36:22.677 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.679+0000 7f88cffff640 20 reqs_thread_entry: start 2024-09-12T00:36:22.677 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.679+0000 7f8aabaa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.679+0000 7f8aabaa39c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:36:22.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.679+0000 7f8aabaa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.679+0000 7f8aabaa39c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:36:22.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.679+0000 7f8aabaa39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:22.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.679+0000 7f8aabaa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.679+0000 7f8aabaa39c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:36:22.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.679+0000 7f8aabaa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.679+0000 7f8aabaa39c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:36:22.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.679+0000 7f8aabaa39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:22.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.683+0000 7f895f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:22.688 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.687+0000 7f8aabaa39c0 20 remove_watcher() i=0 2024-09-12T00:36:22.688 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.687+0000 7f8aabaa39c0 2 removed watcher, disabling cache 2024-09-12T00:36:22.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.691+0000 7f8aabaa39c0 20 remove_watcher() i=1 2024-09-12T00:36:22.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.691+0000 7f8aabaa39c0 20 remove_watcher() i=2 2024-09-12T00:36:22.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.695+0000 7f8aabaa39c0 20 remove_watcher() i=3 2024-09-12T00:36:22.697 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.699+0000 7f8aabaa39c0 20 remove_watcher() i=4 2024-09-12T00:36:22.698 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.699+0000 7f8aabaa39c0 20 remove_watcher() i=5 2024-09-12T00:36:22.699 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.699+0000 7f8aabaa39c0 20 remove_watcher() i=6 2024-09-12T00:36:22.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.703+0000 7f8aabaa39c0 20 remove_watcher() i=7 2024-09-12T00:36:22.721 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:22.721 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:36:22.721 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: a-bucket id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 num_objects: 8 size_kb: 1 num_shards: 12 2024-09-12T00:36:22.721 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:22.721 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-09-12T00:36:22.749 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:22.749 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:22.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.795+0000 7fd565be39c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.795 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.795+0000 7fd565be39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.795 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.795+0000 7fd565be39c0 20 realm 2024-09-12T00:36:22.796 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.795+0000 7fd565be39c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.796 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.795+0000 7fd565be39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.796 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.795+0000 7fd565be39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:22.796 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.795+0000 7fd565be39c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.796 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.795+0000 7fd565be39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.796 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.795+0000 7fd565be39c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.799+0000 7fd565be39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:22.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.799+0000 7fd565be39c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.799+0000 7fd565be39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:22.799 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.799+0000 7fd565be39c0 20 searching for the correct realm 2024-09-12T00:36:22.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:22.807+0000 7fd563eea640 0 -- 172.21.15.43:0/2436225587 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7fd558045410 msgr2=0x7fd558045870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:23.024 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.023+0000 7fd5636e9640 0 -- 172.21.15.43:0/2436225587 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x5611e98791e0 msgr2=0x5611e987b5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:23.032 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.031+0000 7fd565be39c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:36:23.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.031+0000 7fd565be39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:23.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.031+0000 7fd565be39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:23.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.031+0000 7fd565be39c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:36:23.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.031+0000 7fd565be39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:23.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.031+0000 7fd565be39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:23.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.031+0000 7fd565be39c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.035+0000 7fd565be39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.035+0000 7fd565be39c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.034 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.035+0000 7fd565be39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:23.034 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.035+0000 7fd565be39c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.035 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.035+0000 7fd565be39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:23.035 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.035+0000 7fd565be39c0 20 zone default found 2024-09-12T00:36:23.035 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.035+0000 7fd565be39c0 4 Realm: () 2024-09-12T00:36:23.035 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.035+0000 7fd565be39c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:36:23.035 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.035+0000 7fd565be39c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:36:23.035 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.035+0000 7fd565be39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:23.035 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.035+0000 7fd565be39c0 20 zonegroup default 2024-09-12T00:36:23.035 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.035+0000 7fd565be39c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.035+0000 7fd565be39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.035+0000 7fd565be39c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.035+0000 7fd565be39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.035+0000 7fd565be39c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.037 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.039+0000 7fd565be39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.037 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.039+0000 7fd565be39c0 20 started sync module instance, tier type = 2024-09-12T00:36:23.037 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.039+0000 7fd565be39c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:36:23.060 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.059+0000 7fd565be39c0 20 add_watcher() i=0 2024-09-12T00:36:23.060 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.059+0000 7fd565be39c0 20 add_watcher() i=1 2024-09-12T00:36:23.061 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.059+0000 7fd565be39c0 20 add_watcher() i=2 2024-09-12T00:36:23.061 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.059+0000 7fd565be39c0 20 add_watcher() i=3 2024-09-12T00:36:23.061 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.059+0000 7fd565be39c0 20 add_watcher() i=4 2024-09-12T00:36:23.061 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.059+0000 7fd565be39c0 20 add_watcher() i=5 2024-09-12T00:36:23.061 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.059+0000 7fd565be39c0 20 add_watcher() i=6 2024-09-12T00:36:23.062 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.063+0000 7fd565be39c0 20 add_watcher() i=7 2024-09-12T00:36:23.062 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.063+0000 7fd565be39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:23.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.067+0000 7fd419fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:23.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.067+0000 7fd565be39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:23.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.067+0000 7fd565be39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:23.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.067+0000 7fd565be39c0 5 note: GC not initialized 2024-09-12T00:36:23.068 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.067+0000 7fd418fe1640 20 reqs_thread_entry: start 2024-09-12T00:36:23.068 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.067+0000 7fd565be39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:23.068 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.067+0000 7fd565be39c0 20 Filter name: none 2024-09-12T00:36:23.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.067+0000 7fd3927fc640 20 reqs_thread_entry: start 2024-09-12T00:36:23.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.067+0000 7fd565be39c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:36:23.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.067+0000 7fd565be39c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.071+0000 7fd565be39c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:36:23.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.071+0000 7fd565be39c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:36:23.070 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.071+0000 7fd565be39c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:36:23.070 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.071+0000 7fd565be39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 : miss 2024-09-12T00:36:23.070 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.071+0000 7fd565be39c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.071 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.071+0000 7fd565be39c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:36:23.071 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.071+0000 7fd565be39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:36:23.071 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.071+0000 7fd565be39c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:36:23.071 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.071+0000 7fd565be39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:23.071 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.071+0000 7fd565be39c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:23.071 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.071+0000 7fd565be39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 2024-09-12T00:36:23.075 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.075+0000 7fd419fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:23.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.079+0000 7fd565be39c0 20 remove_watcher() i=0 2024-09-12T00:36:23.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.079+0000 7fd565be39c0 2 removed watcher, disabling cache 2024-09-12T00:36:23.082 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.083+0000 7fd565be39c0 20 remove_watcher() i=1 2024-09-12T00:36:23.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.087+0000 7fd565be39c0 20 remove_watcher() i=2 2024-09-12T00:36:23.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.087+0000 7fd565be39c0 20 remove_watcher() i=3 2024-09-12T00:36:23.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.091+0000 7fd565be39c0 20 remove_watcher() i=4 2024-09-12T00:36:23.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.091+0000 7fd565be39c0 20 remove_watcher() i=5 2024-09-12T00:36:23.093 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.095+0000 7fd565be39c0 20 remove_watcher() i=6 2024-09-12T00:36:23.094 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.095+0000 7fd565be39c0 20 remove_watcher() i=7 2024-09-12T00:36:23.111 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin reshard list 2024-09-12T00:36:23.141 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:23.141 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:23.185 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.187+0000 7f8f34c849c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.187 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.187+0000 7f8f34c849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.187+0000 7f8f34c849c0 20 realm 2024-09-12T00:36:23.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.187+0000 7f8f34c849c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.187+0000 7f8f34c849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.187+0000 7f8f34c849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:23.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.187+0000 7f8f34c849c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.187+0000 7f8f34c849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.187+0000 7f8f34c849c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.191+0000 7f8f34c849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:23.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.191+0000 7f8f34c849c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.190 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.191+0000 7f8f34c849c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:23.190 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.191+0000 7f8f34c849c0 20 searching for the correct realm 2024-09-12T00:36:23.196 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.199+0000 7f8f2bfff640 0 -- 172.21.15.43:0/3522188350 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f8f1c034040 msgr2=0x7f8f1c073040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:23.202 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.203+0000 7f8f32f8b640 0 -- 172.21.15.43:0/3522188350 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f8f1c008040 msgr2=0x7f8f1c08f100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:23.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.211+0000 7f8f34c849c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:36:23.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.211+0000 7f8f34c849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:23.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.211+0000 7f8f34c849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:23.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.211+0000 7f8f34c849c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:36:23.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.211+0000 7f8f34c849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:23.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.211+0000 7f8f34c849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:23.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.211+0000 7f8f34c849c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.211+0000 7f8f34c849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.211+0000 7f8f34c849c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.212 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.211+0000 7f8f34c849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:23.212 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.211+0000 7f8f34c849c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.213 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.211+0000 7f8f34c849c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:23.213 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.211+0000 7f8f34c849c0 20 zone default found 2024-09-12T00:36:23.213 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.211+0000 7f8f34c849c0 4 Realm: () 2024-09-12T00:36:23.213 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.211+0000 7f8f34c849c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:36:23.213 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.211+0000 7f8f34c849c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:36:23.213 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.211+0000 7f8f34c849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:23.213 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.211+0000 7f8f34c849c0 20 zonegroup default 2024-09-12T00:36:23.213 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.211+0000 7f8f34c849c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.213 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.211+0000 7f8f34c849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.213 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.211+0000 7f8f34c849c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.213 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.215+0000 7f8f34c849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.213 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.215+0000 7f8f34c849c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.214 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.215+0000 7f8f34c849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.214 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.215+0000 7f8f34c849c0 20 started sync module instance, tier type = 2024-09-12T00:36:23.214 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.215+0000 7f8f34c849c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:36:23.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.231+0000 7f8f34c849c0 20 add_watcher() i=0 2024-09-12T00:36:23.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.231+0000 7f8f34c849c0 20 add_watcher() i=1 2024-09-12T00:36:23.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.231+0000 7f8f34c849c0 20 add_watcher() i=2 2024-09-12T00:36:23.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.231+0000 7f8f34c849c0 20 add_watcher() i=3 2024-09-12T00:36:23.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.231+0000 7f8f34c849c0 20 add_watcher() i=4 2024-09-12T00:36:23.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.231+0000 7f8f34c849c0 20 add_watcher() i=5 2024-09-12T00:36:23.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.231+0000 7f8f34c849c0 20 add_watcher() i=6 2024-09-12T00:36:23.231 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.231+0000 7f8f34c849c0 20 add_watcher() i=7 2024-09-12T00:36:23.231 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.231+0000 7f8f34c849c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:23.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.235+0000 7f8de8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:23.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.235+0000 7f8f34c849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:23.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.235+0000 7f8f34c849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:23.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.235+0000 7f8f34c849c0 5 note: GC not initialized 2024-09-12T00:36:23.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.235+0000 7f8d637fe640 20 reqs_thread_entry: start 2024-09-12T00:36:23.235 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.235+0000 7f8f34c849c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:23.235 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.235+0000 7f8f34c849c0 20 Filter name: none 2024-09-12T00:36:23.235 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.235+0000 7f8d617fa640 20 reqs_thread_entry: start 2024-09-12T00:36:23.245 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.247+0000 7f8de8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:23.249 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.251+0000 7f8f34c849c0 20 remove_watcher() i=0 2024-09-12T00:36:23.249 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.251+0000 7f8f34c849c0 2 removed watcher, disabling cache 2024-09-12T00:36:23.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.251+0000 7f8f34c849c0 20 remove_watcher() i=1 2024-09-12T00:36:23.254 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.255+0000 7f8f34c849c0 20 remove_watcher() i=2 2024-09-12T00:36:23.255 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.255+0000 7f8f34c849c0 20 remove_watcher() i=3 2024-09-12T00:36:23.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.259+0000 7f8f34c849c0 20 remove_watcher() i=4 2024-09-12T00:36:23.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.259+0000 7f8f34c849c0 20 remove_watcher() i=5 2024-09-12T00:36:23.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.259+0000 7f8f34c849c0 20 remove_watcher() i=6 2024-09-12T00:36:23.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.263+0000 7f8f34c849c0 20 remove_watcher() i=7 2024-09-12T00:36:23.276 INFO:tasks.workunit.client.0.smithi043.stderr:bucket name a-bucket 2024-09-12T00:36:23.276 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: reshard process non empty bucket 2024-09-12T00:36:23.276 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:23.276 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin reshard process 2024-09-12T00:36:23.300 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:23.300 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:23.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.343+0000 7fea0cb9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.347+0000 7fea0cb9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.347+0000 7fea0cb9d9c0 20 realm 2024-09-12T00:36:23.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.347+0000 7fea0cb9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.347+0000 7fea0cb9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.347+0000 7fea0cb9d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:23.347 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.347+0000 7fea0cb9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.347 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.347+0000 7fea0cb9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.347 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.347+0000 7fea0cb9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.348 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.347+0000 7fea0cb9d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:23.348 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.347+0000 7fea0cb9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.349 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.351+0000 7fea0cb9d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:23.349 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.351+0000 7fea0cb9d9c0 20 searching for the correct realm 2024-09-12T00:36:23.353 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.355+0000 7fea09ea2640 0 -- 172.21.15.43:0/61537086 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fea00048040 msgr2=0x7fea0005be90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:23.568 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.567+0000 7fea09ea2640 0 -- 172.21.15.43:0/61537086 >> [v2:172.21.15.43:6816/653473197,v1:172.21.15.43:6817/653473197] conn(0x5575648d8840 msgr2=0x5575648dac30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:23.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.587+0000 7fea0cb9d9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:36:23.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.587+0000 7fea0cb9d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:23.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.587+0000 7fea0cb9d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:23.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.587+0000 7fea0cb9d9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:36:23.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.587+0000 7fea0cb9d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:23.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.587+0000 7fea0cb9d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:23.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.587+0000 7fea0cb9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.587 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.587+0000 7fea0cb9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.587 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.587+0000 7fea0cb9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.587 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.587+0000 7fea0cb9d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:23.587 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.587+0000 7fea0cb9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.587+0000 7fea0cb9d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:23.589 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.587+0000 7fea0cb9d9c0 20 zone default found 2024-09-12T00:36:23.589 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.587+0000 7fea0cb9d9c0 4 Realm: () 2024-09-12T00:36:23.589 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.587+0000 7fea0cb9d9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:36:23.589 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.587+0000 7fea0cb9d9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:36:23.589 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.587+0000 7fea0cb9d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:23.589 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.587+0000 7fea0cb9d9c0 20 zonegroup default 2024-09-12T00:36:23.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.587+0000 7fea0cb9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.587+0000 7fea0cb9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.591+0000 7fea0cb9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.591+0000 7fea0cb9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.591+0000 7fea0cb9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.591+0000 7fea0cb9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.591+0000 7fea0cb9d9c0 20 started sync module instance, tier type = 2024-09-12T00:36:23.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.591+0000 7fea0cb9d9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:36:23.614 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.615+0000 7fea0cb9d9c0 20 add_watcher() i=0 2024-09-12T00:36:23.614 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.615+0000 7fea0cb9d9c0 20 add_watcher() i=1 2024-09-12T00:36:23.614 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.615+0000 7fea0cb9d9c0 20 add_watcher() i=2 2024-09-12T00:36:23.614 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.615+0000 7fea0cb9d9c0 20 add_watcher() i=3 2024-09-12T00:36:23.614 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.615+0000 7fea0cb9d9c0 20 add_watcher() i=4 2024-09-12T00:36:23.614 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.615+0000 7fea0cb9d9c0 20 add_watcher() i=5 2024-09-12T00:36:23.614 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.615+0000 7fea0cb9d9c0 20 add_watcher() i=6 2024-09-12T00:36:23.616 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.615+0000 7fea0cb9d9c0 20 add_watcher() i=7 2024-09-12T00:36:23.616 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.615+0000 7fea0cb9d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:23.620 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.619+0000 7fe8c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:23.621 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.623+0000 7fea0cb9d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:23.621 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.623+0000 7fea0cb9d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:23.622 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.623+0000 7fea0cb9d9c0 5 note: GC not initialized 2024-09-12T00:36:23.622 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.623+0000 7fe8bb7fe640 20 reqs_thread_entry: start 2024-09-12T00:36:23.623 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.623+0000 7fea0cb9d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:23.623 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.623+0000 7fea0cb9d9c0 20 Filter name: none 2024-09-12T00:36:23.623 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.623+0000 7fe8b97fa640 20 reqs_thread_entry: start 2024-09-12T00:36:23.623 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.623+0000 7fea0cb9d9c0 20 processing logshard = reshard.0000000000 2024-09-12T00:36:23.630 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.631+0000 7fea0cb9d9c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T00:36:23.630 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.631+0000 7fea0cb9d9c0 20 processing logshard = reshard.0000000001 2024-09-12T00:36:23.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.635+0000 7fea0cb9d9c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T00:36:23.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.635+0000 7fea0cb9d9c0 20 processing logshard = reshard.0000000002 2024-09-12T00:36:23.640 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.639+0000 7fea0cb9d9c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T00:36:23.640 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.639+0000 7fea0cb9d9c0 20 processing logshard = reshard.0000000003 2024-09-12T00:36:23.646 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.647+0000 7fea0cb9d9c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T00:36:23.646 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.647+0000 7fea0cb9d9c0 20 processing logshard = reshard.0000000004 2024-09-12T00:36:23.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.651+0000 7fea0cb9d9c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T00:36:23.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.651+0000 7fea0cb9d9c0 20 processing logshard = reshard.0000000005 2024-09-12T00:36:23.657 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.659+0000 7fea0cb9d9c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T00:36:23.658 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.659+0000 7fea0cb9d9c0 20 processing logshard = reshard.0000000006 2024-09-12T00:36:23.661 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.659+0000 7fea0cb9d9c0 20 process_entry resharding a-bucket 2024-09-12T00:36:23.661 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.659+0000 7fea0cb9d9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:36:23.661 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.659+0000 7fea0cb9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.662 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.663+0000 7fea0cb9d9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:36:23.662 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.663+0000 7fea0cb9d9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T00:36:23.662 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.663+0000 7fea0cb9d9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:36:23.662 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.663+0000 7fea0cb9d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 : miss 2024-09-12T00:36:23.662 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.663+0000 7fea0cb9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.663 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.663+0000 7fea0cb9d9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:36:23.663 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.663+0000 7fea0cb9d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:36:23.663 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.663+0000 7fea0cb9d9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:36:23.663 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.663+0000 7fea0cb9d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:23.663 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.663+0000 7fea0cb9d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:23.663 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.663+0000 7fea0cb9d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 2024-09-12T00:36:23.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.679+0000 7fea0cb9d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:36:23.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.679+0000 7fea0cb9d9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:36:23.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.679+0000 7fea0cb9d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:23.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.679+0000 7fea0cb9d9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17, ofs0, ns] 2024-09-12T00:36:23.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.679+0000 7fe8edffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333468 cookie 93962686570352 notifier 5873 bl.length()=827 2024-09-12T00:36:23.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.679+0000 7fe8edffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:36:23.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.679+0000 7fe8edffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:36:23.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.679+0000 7fe8edffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:23.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.683+0000 7fea0cb9d9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_sources= new_sources= 2024-09-12T00:36:23.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.683+0000 7fea0cb9d9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential sources added=[] removed=[] 2024-09-12T00:36:23.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.683+0000 7fea0cb9d9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_dests= new_dests= 2024-09-12T00:36:23.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.683+0000 7fea0cb9d9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential dests added=[] removed=[] 2024-09-12T00:36:23.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.691+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.0 2024-09-12T00:36:23.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.691+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.0 2024-09-12T00:36:23.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.691+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.1 2024-09-12T00:36:23.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.691+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.1 2024-09-12T00:36:23.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.691+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.2 2024-09-12T00:36:23.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.691+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.2 2024-09-12T00:36:23.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.691+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.3 2024-09-12T00:36:23.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.691+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.3 2024-09-12T00:36:23.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.691+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.4 2024-09-12T00:36:23.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.691+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.4 2024-09-12T00:36:23.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.691+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.5 2024-09-12T00:36:23.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.691+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.5 2024-09-12T00:36:23.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.691+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.6 2024-09-12T00:36:23.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.691+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.6 2024-09-12T00:36:23.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.691+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.7 2024-09-12T00:36:23.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.691+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.7 2024-09-12T00:36:23.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.691+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.8 2024-09-12T00:36:23.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.691+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.8 2024-09-12T00:36:23.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.691+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.9 2024-09-12T00:36:23.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.691+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.9 2024-09-12T00:36:23.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.691+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.10 2024-09-12T00:36:23.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.691+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.10 2024-09-12T00:36:23.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.691+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.11 2024-09-12T00:36:23.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.691+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.11 2024-09-12T00:36:23.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.691+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.12 2024-09-12T00:36:23.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.691+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.12 2024-09-12T00:36:23.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.691+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.0 2024-09-12T00:36:23.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.691+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.0 2024-09-12T00:36:23.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.695+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.1 2024-09-12T00:36:23.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.695+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.1 2024-09-12T00:36:23.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.695+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.2 2024-09-12T00:36:23.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.695+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.2 2024-09-12T00:36:23.696 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.695+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.3 2024-09-12T00:36:23.696 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.695+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.3 2024-09-12T00:36:23.697 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.699+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.4 2024-09-12T00:36:23.697 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.699+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.4 2024-09-12T00:36:23.698 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.699+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.5 2024-09-12T00:36:23.698 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.699+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.5 2024-09-12T00:36:23.699 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.699+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.6 2024-09-12T00:36:23.699 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.699+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.6 2024-09-12T00:36:23.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.699+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.7 2024-09-12T00:36:23.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.699+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.7 2024-09-12T00:36:23.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.703+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.8 2024-09-12T00:36:23.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.703+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.8 2024-09-12T00:36:23.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.703+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.9 2024-09-12T00:36:23.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.703+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.9 2024-09-12T00:36:23.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.703+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.10 2024-09-12T00:36:23.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.703+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.10 2024-09-12T00:36:23.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.707+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.11 2024-09-12T00:36:23.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.707+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.11 2024-09-12T00:36:23.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.711+0000 7fea0cb9d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:23.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.711+0000 7fea0cb9d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 2024-09-12T00:36:23.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.715+0000 7fea0cb9d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:36:23.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.715+0000 7fea0cb9d9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:36:23.715 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.715+0000 7fea0cb9d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:23.715 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.715+0000 7fea0cb9d9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17, ofs0, ns] 2024-09-12T00:36:23.715 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.715+0000 7fe8edffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333469 cookie 93962686570352 notifier 5873 bl.length()=827 2024-09-12T00:36:23.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.715+0000 7fe8edffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:36:23.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.715+0000 7fe8edffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:36:23.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.715+0000 7fe8edffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:23.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.715+0000 7fea0cb9d9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_sources= new_sources= 2024-09-12T00:36:23.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.715+0000 7fea0cb9d9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential sources added=[] removed=[] 2024-09-12T00:36:23.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.715+0000 7fea0cb9d9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_dests= new_dests= 2024-09-12T00:36:23.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.715+0000 7fea0cb9d9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential dests added=[] removed=[] 2024-09-12T00:36:23.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.723+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.0 2024-09-12T00:36:23.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.723+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.0 2024-09-12T00:36:23.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.723+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.1 2024-09-12T00:36:23.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.723+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.1 2024-09-12T00:36:23.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.723+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.2 2024-09-12T00:36:23.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.723+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.2 2024-09-12T00:36:23.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.723+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.3 2024-09-12T00:36:23.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.723+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.3 2024-09-12T00:36:23.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.727+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.4 2024-09-12T00:36:23.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.727+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.4 2024-09-12T00:36:23.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.727+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.5 2024-09-12T00:36:23.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.727+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.5 2024-09-12T00:36:23.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.727+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.6 2024-09-12T00:36:23.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.727+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.6 2024-09-12T00:36:23.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.727+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.7 2024-09-12T00:36:23.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.727+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.7 2024-09-12T00:36:23.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.727+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.8 2024-09-12T00:36:23.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.727+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.8 2024-09-12T00:36:23.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.727+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.9 2024-09-12T00:36:23.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.727+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.9 2024-09-12T00:36:23.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.731+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.10 2024-09-12T00:36:23.730 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.731+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.10 2024-09-12T00:36:23.730 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.731+0000 7fea0cb9d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.11 2024-09-12T00:36:23.730 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.731+0000 7fea0cb9d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.1.11 2024-09-12T00:36:23.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.731+0000 7fea0cb9d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:23.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.731+0000 7fea0cb9d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 2024-09-12T00:36:23.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.735+0000 7fea0cb9d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:36:23.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.735+0000 7fea0cb9d9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:36:23.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.735+0000 7fea0cb9d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:23.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.735+0000 7fea0cb9d9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17, ofs0, ns] 2024-09-12T00:36:23.735 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.735+0000 7fe8edffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333470 cookie 93962686570352 notifier 5873 bl.length()=795 2024-09-12T00:36:23.736 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.735+0000 7fe8edffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:36:23.736 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.735+0000 7fe8edffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:36:23.736 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.735+0000 7fe8edffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:23.736 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.735+0000 7fea0cb9d9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_sources= new_sources= 2024-09-12T00:36:23.736 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.735+0000 7fea0cb9d9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential sources added=[] removed=[] 2024-09-12T00:36:23.736 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.735+0000 7fea0cb9d9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_dests= new_dests= 2024-09-12T00:36:23.737 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.735+0000 7fea0cb9d9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential dests added=[] removed=[] 2024-09-12T00:36:23.742 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.743+0000 7fea0cb9d9c0 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-09-12T00:36:23.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.743+0000 7fea0cb9d9c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T00:36:23.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.751+0000 7fea0cb9d9c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T00:36:23.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.751+0000 7fea0cb9d9c0 20 processing logshard = reshard.0000000007 2024-09-12T00:36:23.756 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.755+0000 7fea0cb9d9c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T00:36:23.756 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.755+0000 7fea0cb9d9c0 20 processing logshard = reshard.0000000008 2024-09-12T00:36:23.763 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.763+0000 7fea0cb9d9c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T00:36:23.763 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.763+0000 7fea0cb9d9c0 20 processing logshard = reshard.0000000009 2024-09-12T00:36:23.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.771+0000 7fea0cb9d9c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T00:36:23.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.771+0000 7fea0cb9d9c0 20 processing logshard = reshard.0000000010 2024-09-12T00:36:23.774 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.775+0000 7fea0cb9d9c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T00:36:23.774 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.775+0000 7fea0cb9d9c0 20 processing logshard = reshard.0000000011 2024-09-12T00:36:23.779 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.779+0000 7fea0cb9d9c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T00:36:23.780 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.779+0000 7fea0cb9d9c0 20 processing logshard = reshard.0000000012 2024-09-12T00:36:23.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.787+0000 7fea0cb9d9c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T00:36:23.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.787+0000 7fea0cb9d9c0 20 processing logshard = reshard.0000000013 2024-09-12T00:36:23.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.795+0000 7fea0cb9d9c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T00:36:23.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.795+0000 7fea0cb9d9c0 20 processing logshard = reshard.0000000014 2024-09-12T00:36:23.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.799+0000 7fea0cb9d9c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T00:36:23.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.799+0000 7fea0cb9d9c0 20 processing logshard = reshard.0000000015 2024-09-12T00:36:23.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.807+0000 7fea0cb9d9c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T00:36:23.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.811+0000 7fe8c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:23.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.815+0000 7fea0cb9d9c0 20 remove_watcher() i=0 2024-09-12T00:36:23.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.815+0000 7fea0cb9d9c0 2 removed watcher, disabling cache 2024-09-12T00:36:23.817 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.819+0000 7fea0cb9d9c0 20 remove_watcher() i=1 2024-09-12T00:36:23.819 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.819+0000 7fea0cb9d9c0 20 remove_watcher() i=2 2024-09-12T00:36:23.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.823+0000 7fea0cb9d9c0 20 remove_watcher() i=3 2024-09-12T00:36:23.824 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.823+0000 7fea0cb9d9c0 20 remove_watcher() i=4 2024-09-12T00:36:23.826 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.827+0000 7fea0cb9d9c0 20 remove_watcher() i=5 2024-09-12T00:36:23.829 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.831+0000 7fea0cb9d9c0 20 remove_watcher() i=6 2024-09-12T00:36:23.830 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.831+0000 7fea0cb9d9c0 20 remove_watcher() i=7 2024-09-12T00:36:23.852 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:36:23.885 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:23.885 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:23.931 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.931+0000 7ff8f7a299c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.933 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.935+0000 7ff8f7a299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.933 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.935+0000 7ff8f7a299c0 20 realm 2024-09-12T00:36:23.933 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.935+0000 7ff8f7a299c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.934 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.935+0000 7ff8f7a299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.934 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.935+0000 7ff8f7a299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:23.934 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.935+0000 7ff8f7a299c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.934 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.935+0000 7ff8f7a299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.934 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.935+0000 7ff8f7a299c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.935 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.935+0000 7ff8f7a299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:23.935 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.935+0000 7ff8f7a299c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.936 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.935+0000 7ff8f7a299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:23.936 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.935+0000 7ff8f7a299c0 20 searching for the correct realm 2024-09-12T00:36:23.939 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.939+0000 7ff8f552f640 0 -- 172.21.15.43:0/853222869 >> [v2:172.21.15.97:6816/489545787,v1:172.21.15.97:6817/489545787] conn(0x7ff8f0017070 msgr2=0x7ff8f0029430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:23.945 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.947+0000 7ff8f4d2e640 0 -- 172.21.15.43:0/853222869 >> [v2:172.21.15.43:6816/653473197,v1:172.21.15.43:6817/653473197] conn(0x5653d56a4430 msgr2=0x5653d56a6820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:23.956 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.955+0000 7ff8f7a299c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:36:23.956 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.955+0000 7ff8f7a299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:23.956 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.955+0000 7ff8f7a299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:23.956 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.955+0000 7ff8f7a299c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:36:23.956 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.955+0000 7ff8f7a299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:23.956 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.955+0000 7ff8f7a299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:23.957 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.955+0000 7ff8f7a299c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.957 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.955+0000 7ff8f7a299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.957 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.955+0000 7ff8f7a299c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.958 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.955+0000 7ff8f7a299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:23.958 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.955+0000 7ff8f7a299c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.958 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.959+0000 7ff8f7a299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:23.958 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.959+0000 7ff8f7a299c0 20 zone default found 2024-09-12T00:36:23.959 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.959+0000 7ff8f7a299c0 4 Realm: () 2024-09-12T00:36:23.959 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.959+0000 7ff8f7a299c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:36:23.959 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.959+0000 7ff8f7a299c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:36:23.959 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.959+0000 7ff8f7a299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:23.959 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.959+0000 7ff8f7a299c0 20 zonegroup default 2024-09-12T00:36:23.959 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.959+0000 7ff8f7a299c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.959 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.959+0000 7ff8f7a299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.959 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.959+0000 7ff8f7a299c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.959 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.959+0000 7ff8f7a299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.959 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.959+0000 7ff8f7a299c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.959 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.959+0000 7ff8f7a299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.959 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.959+0000 7ff8f7a299c0 20 started sync module instance, tier type = 2024-09-12T00:36:23.959 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.959+0000 7ff8f7a299c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:36:23.974 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.975+0000 7ff8f7a299c0 20 add_watcher() i=0 2024-09-12T00:36:23.974 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.975+0000 7ff8f7a299c0 20 add_watcher() i=1 2024-09-12T00:36:23.974 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.975+0000 7ff8f7a299c0 20 add_watcher() i=2 2024-09-12T00:36:23.974 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.975+0000 7ff8f7a299c0 20 add_watcher() i=3 2024-09-12T00:36:23.974 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.975+0000 7ff8f7a299c0 20 add_watcher() i=4 2024-09-12T00:36:23.974 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.975+0000 7ff8f7a299c0 20 add_watcher() i=5 2024-09-12T00:36:23.974 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.975+0000 7ff8f7a299c0 20 add_watcher() i=6 2024-09-12T00:36:23.975 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.975+0000 7ff8f7a299c0 20 add_watcher() i=7 2024-09-12T00:36:23.975 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.975+0000 7ff8f7a299c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:23.979 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.979+0000 7ff7abfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:23.979 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.979+0000 7ff8f7a299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:23.979 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.979+0000 7ff8f7a299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:23.979 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.979+0000 7ff8f7a299c0 5 note: GC not initialized 2024-09-12T00:36:23.979 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.979+0000 7ff7aafe5640 20 reqs_thread_entry: start 2024-09-12T00:36:23.979 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.979+0000 7ff8f7a299c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:23.979 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.979+0000 7ff8f7a299c0 20 Filter name: none 2024-09-12T00:36:23.980 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.979+0000 7ff7a8fe1640 20 reqs_thread_entry: start 2024-09-12T00:36:23.980 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.979+0000 7ff8f7a299c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.980 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.979+0000 7ff8f7a299c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:36:23.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.979+0000 7ff8f7a299c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.983+0000 7ff8f7a299c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:36:23.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.983+0000 7ff8f7a299c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:23.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.983+0000 7ff8f7a299c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.983+0000 7ff8f7a299c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:36:23.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.983+0000 7ff8f7a299c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.983 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.983+0000 7ff8f7a299c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:36:23.983 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.983+0000 7ff8f7a299c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:23.986 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.987+0000 7ff7abfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:23.991 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.991+0000 7ff8f7a299c0 20 remove_watcher() i=0 2024-09-12T00:36:23.992 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.991+0000 7ff8f7a299c0 2 removed watcher, disabling cache 2024-09-12T00:36:23.993 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.995+0000 7ff8f7a299c0 20 remove_watcher() i=1 2024-09-12T00:36:23.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.995+0000 7ff8f7a299c0 20 remove_watcher() i=2 2024-09-12T00:36:23.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.999+0000 7ff8f7a299c0 20 remove_watcher() i=3 2024-09-12T00:36:23.999 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:23.999+0000 7ff8f7a299c0 20 remove_watcher() i=4 2024-09-12T00:36:24.001 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.003+0000 7ff8f7a299c0 20 remove_watcher() i=5 2024-09-12T00:36:24.002 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.003+0000 7ff8f7a299c0 20 remove_watcher() i=6 2024-09-12T00:36:24.003 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.003+0000 7ff8f7a299c0 20 remove_watcher() i=7 2024-09-12T00:36:24.018 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:24.018 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:36:24.018 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: a-bucket id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-12T00:36:24.019 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:24.019 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-12T00:36:24.019 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:24.020 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.020 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:24.040 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.041 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:24.087 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.087 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:24.105 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.106 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:24.124 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.124 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:24.142 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.143 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:24.161 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.161 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:24.181 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.181 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:24.201 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.201 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:24.219 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.220 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:24.238 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.238 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:24.257 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.257 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:24.277 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.278 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:24.297 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.297 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:24.316 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.316 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:24.335 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.335 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:24.356 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.356 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:24.374 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.374 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:24.393 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.393 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:24.412 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.413 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:24.431 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.431 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:24.449 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.449 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:24.465 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:36:24.499 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:24.499 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:24.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.547+0000 7f1d7580e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.547+0000 7f1d7580e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.548 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.547+0000 7f1d7580e9c0 20 realm 2024-09-12T00:36:24.548 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.547+0000 7f1d7580e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.548 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.547+0000 7f1d7580e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.548 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.547+0000 7f1d7580e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:24.548 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.547+0000 7f1d7580e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.548 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.547+0000 7f1d7580e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.548 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.547+0000 7f1d7580e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.551+0000 7f1d7580e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:24.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.551+0000 7f1d7580e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.551+0000 7f1d7580e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:24.551 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.551+0000 7f1d7580e9c0 20 searching for the correct realm 2024-09-12T00:36:24.556 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.555+0000 7f1d73314640 0 -- 172.21.15.43:0/736755195 >> [v2:172.21.15.97:6816/489545787,v1:172.21.15.97:6817/489545787] conn(0x7f1d6c020040 msgr2=0x7f1d6c020930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:24.562 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.563+0000 7f1d73314640 0 -- 172.21.15.43:0/736755195 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f1d5c124a60 msgr2=0x7f1d5c119030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:24.781 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.783+0000 7f1d7580e9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:36:24.782 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.783+0000 7f1d7580e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:24.782 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.783+0000 7f1d7580e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:24.782 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.783+0000 7f1d7580e9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:36:24.782 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.783+0000 7f1d7580e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:24.782 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.783+0000 7f1d7580e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:24.782 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.783+0000 7f1d7580e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.782 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.783+0000 7f1d7580e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.782 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.783+0000 7f1d7580e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.783 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.783+0000 7f1d7580e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:24.783 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.783+0000 7f1d7580e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.783+0000 7f1d7580e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:24.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.783+0000 7f1d7580e9c0 20 zone default found 2024-09-12T00:36:24.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.783+0000 7f1d7580e9c0 4 Realm: () 2024-09-12T00:36:24.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.783+0000 7f1d7580e9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:36:24.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.783+0000 7f1d7580e9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:36:24.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.783+0000 7f1d7580e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:24.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.783+0000 7f1d7580e9c0 20 zonegroup default 2024-09-12T00:36:24.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.783+0000 7f1d7580e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.785 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.783+0000 7f1d7580e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.785 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.783+0000 7f1d7580e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.785 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.787+0000 7f1d7580e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.785 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.787+0000 7f1d7580e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.787+0000 7f1d7580e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.787+0000 7f1d7580e9c0 20 started sync module instance, tier type = 2024-09-12T00:36:24.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.787+0000 7f1d7580e9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:36:24.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.811+0000 7f1d7580e9c0 20 add_watcher() i=0 2024-09-12T00:36:24.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.811+0000 7f1d7580e9c0 20 add_watcher() i=1 2024-09-12T00:36:24.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.811+0000 7f1d7580e9c0 20 add_watcher() i=2 2024-09-12T00:36:24.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.811+0000 7f1d7580e9c0 20 add_watcher() i=3 2024-09-12T00:36:24.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.811+0000 7f1d7580e9c0 20 add_watcher() i=4 2024-09-12T00:36:24.812 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.811+0000 7f1d7580e9c0 20 add_watcher() i=5 2024-09-12T00:36:24.812 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.811+0000 7f1d7580e9c0 20 add_watcher() i=6 2024-09-12T00:36:24.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.815+0000 7f1d7580e9c0 20 add_watcher() i=7 2024-09-12T00:36:24.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.815+0000 7f1d7580e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:24.817 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.819+0000 7f1c29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:24.818 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.819+0000 7f1d7580e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:24.818 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.819+0000 7f1d7580e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:24.818 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.819+0000 7f1d7580e9c0 5 note: GC not initialized 2024-09-12T00:36:24.819 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.819+0000 7f1c28fe1640 20 reqs_thread_entry: start 2024-09-12T00:36:24.819 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.819+0000 7f1d7580e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:24.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.819+0000 7f1d7580e9c0 20 Filter name: none 2024-09-12T00:36:24.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.819+0000 7f1ba27fc640 20 reqs_thread_entry: start 2024-09-12T00:36:24.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.819+0000 7f1d7580e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.821 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.823+0000 7f1d7580e9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:36:24.821 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.823+0000 7f1d7580e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.823+0000 7f1d7580e9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:36:24.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.823+0000 7f1d7580e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:24.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.823+0000 7f1d7580e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.823 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.823+0000 7f1d7580e9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:36:24.823 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.823+0000 7f1d7580e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.824 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.823+0000 7f1d7580e9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:36:24.824 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.823+0000 7f1d7580e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:24.827 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.827+0000 7f1c29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:24.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.831+0000 7f1d7580e9c0 20 remove_watcher() i=0 2024-09-12T00:36:24.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.831+0000 7f1d7580e9c0 2 removed watcher, disabling cache 2024-09-12T00:36:24.834 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.835+0000 7f1d7580e9c0 20 remove_watcher() i=1 2024-09-12T00:36:24.836 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.835+0000 7f1d7580e9c0 20 remove_watcher() i=2 2024-09-12T00:36:24.838 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.839+0000 7f1d7580e9c0 20 remove_watcher() i=3 2024-09-12T00:36:24.841 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.843+0000 7f1d7580e9c0 20 remove_watcher() i=4 2024-09-12T00:36:24.842 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.843+0000 7f1d7580e9c0 20 remove_watcher() i=5 2024-09-12T00:36:24.844 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.843+0000 7f1d7580e9c0 20 remove_watcher() i=6 2024-09-12T00:36:24.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.847+0000 7f1d7580e9c0 20 remove_watcher() i=7 2024-09-12T00:36:24.861 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:24.861 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:36:24.861 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-init-index id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:36:24.861 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:24.861 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-12T00:36:24.898 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:24.898 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:24.945 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.947+0000 7f24f7d349c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.947+0000 7f24f7d349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.947+0000 7f24f7d349c0 20 realm 2024-09-12T00:36:24.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.947+0000 7f24f7d349c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.947+0000 7f24f7d349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.947+0000 7f24f7d349c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:24.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.947+0000 7f24f7d349c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.947+0000 7f24f7d349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.947+0000 7f24f7d349c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.949 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.951+0000 7f24f7d349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:24.949 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.951+0000 7f24f7d349c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.950 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.951+0000 7f24f7d349c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:24.950 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.951+0000 7f24f7d349c0 20 searching for the correct realm 2024-09-12T00:36:24.956 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.955+0000 7f24f5039640 0 -- 172.21.15.43:0/3000171336 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f24ec113b60 msgr2=0x7f24ec12a340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:24.965 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.963+0000 7f24f5039640 0 -- 172.21.15.43:0/3000171336 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f23c0080bb0 msgr2=0x7f23c0082fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:24.971 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.971+0000 7f24f7d349c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:36:24.971 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.971+0000 7f24f7d349c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:24.971 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.971+0000 7f24f7d349c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:24.971 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.971+0000 7f24f7d349c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:36:24.972 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.971+0000 7f24f7d349c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:24.972 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.971+0000 7f24f7d349c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:24.972 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.971+0000 7f24f7d349c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.972 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.971+0000 7f24f7d349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.972 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.971+0000 7f24f7d349c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.973 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.971+0000 7f24f7d349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:24.973 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.971+0000 7f24f7d349c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.973 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.971+0000 7f24f7d349c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:24.973 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.975+0000 7f24f7d349c0 20 zone default found 2024-09-12T00:36:24.973 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.975+0000 7f24f7d349c0 4 Realm: () 2024-09-12T00:36:24.973 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.975+0000 7f24f7d349c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:36:24.973 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.975+0000 7f24f7d349c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:36:24.973 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.975+0000 7f24f7d349c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:24.973 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.975+0000 7f24f7d349c0 20 zonegroup default 2024-09-12T00:36:24.973 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.975+0000 7f24f7d349c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.974 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.975+0000 7f24f7d349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.974 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.975+0000 7f24f7d349c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.974 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.975+0000 7f24f7d349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.974 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.975+0000 7f24f7d349c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.974 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.975+0000 7f24f7d349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.974 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.975+0000 7f24f7d349c0 20 started sync module instance, tier type = 2024-09-12T00:36:24.974 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.975+0000 7f24f7d349c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:36:24.990 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.991+0000 7f24f7d349c0 20 add_watcher() i=0 2024-09-12T00:36:24.991 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.991+0000 7f24f7d349c0 20 add_watcher() i=1 2024-09-12T00:36:24.991 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.991+0000 7f24f7d349c0 20 add_watcher() i=2 2024-09-12T00:36:24.991 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.991+0000 7f24f7d349c0 20 add_watcher() i=3 2024-09-12T00:36:24.991 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.991+0000 7f24f7d349c0 20 add_watcher() i=4 2024-09-12T00:36:24.991 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.991+0000 7f24f7d349c0 20 add_watcher() i=5 2024-09-12T00:36:24.991 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.991+0000 7f24f7d349c0 20 add_watcher() i=6 2024-09-12T00:36:24.992 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.991+0000 7f24f7d349c0 20 add_watcher() i=7 2024-09-12T00:36:24.992 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.991+0000 7f24f7d349c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:24.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.995+0000 7f23abfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:24.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.995+0000 7f24f7d349c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:24.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.995+0000 7f24f7d349c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:24.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.995+0000 7f24f7d349c0 5 note: GC not initialized 2024-09-12T00:36:24.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.995+0000 7f23aafe5640 20 reqs_thread_entry: start 2024-09-12T00:36:24.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.995+0000 7f24f7d349c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:24.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.995+0000 7f24f7d349c0 20 Filter name: none 2024-09-12T00:36:24.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.995+0000 7f23a8fe1640 20 reqs_thread_entry: start 2024-09-12T00:36:24.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.995+0000 7f24f7d349c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:36:24.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.995+0000 7f24f7d349c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.995+0000 7f24f7d349c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:36:24.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.995+0000 7f24f7d349c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:36:24.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.995+0000 7f24f7d349c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:36:24.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.995+0000 7f24f7d349c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19 : miss 2024-09-12T00:36:24.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.995+0000 7f24f7d349c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.999+0000 7f24f7d349c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:36:24.998 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.999+0000 7f24f7d349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19 info.flags=0x17 2024-09-12T00:36:24.998 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.999+0000 7f24f7d349c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19 to cache LRU end 2024-09-12T00:36:24.998 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.999+0000 7f24f7d349c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:24.998 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.999+0000 7f24f7d349c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:24.998 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.999+0000 7f24f7d349c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19 2024-09-12T00:36:25.000 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.999+0000 7f24f7d349c0 -1 Injecting error=-5 at location=init_index 2024-09-12T00:36:25.000 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:24.999+0000 7f24f7d349c0 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-12T00:36:25.003 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.003+0000 7f23abfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:25.008 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.007+0000 7f24f7d349c0 20 remove_watcher() i=0 2024-09-12T00:36:25.008 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.007+0000 7f24f7d349c0 2 removed watcher, disabling cache 2024-09-12T00:36:25.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.011+0000 7f24f7d349c0 20 remove_watcher() i=1 2024-09-12T00:36:25.012 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.011+0000 7f24f7d349c0 20 remove_watcher() i=2 2024-09-12T00:36:25.014 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.015+0000 7f24f7d349c0 20 remove_watcher() i=3 2024-09-12T00:36:25.017 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.019+0000 7f24f7d349c0 20 remove_watcher() i=4 2024-09-12T00:36:25.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.019+0000 7f24f7d349c0 20 remove_watcher() i=5 2024-09-12T00:36:25.019 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.019+0000 7f24f7d349c0 20 remove_watcher() i=6 2024-09-12T00:36:25.020 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.023+0000 7f24f7d349c0 20 remove_watcher() i=7 2024-09-12T00:36:25.035 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:36:25.064 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:25.064 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:25.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.107+0000 7fe642b4d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.111+0000 7fe642b4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.111+0000 7fe642b4d9c0 20 realm 2024-09-12T00:36:25.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.111+0000 7fe642b4d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.111+0000 7fe642b4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.111+0000 7fe642b4d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:25.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.111+0000 7fe642b4d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.111+0000 7fe642b4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.111+0000 7fe642b4d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.111+0000 7fe642b4d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:25.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.111+0000 7fe642b4d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.115+0000 7fe642b4d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:25.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.115+0000 7fe642b4d9c0 20 searching for the correct realm 2024-09-12T00:36:25.121 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.123+0000 7fe640e54640 0 -- 172.21.15.43:0/1455731213 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7fe63405d9e0 msgr2=0x7fe63408f1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:25.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.131+0000 7fe63fe52640 0 -- 172.21.15.43:0/1455731213 >> [v2:172.21.15.43:6816/653473197,v1:172.21.15.43:6817/653473197] conn(0x55e40de053f0 msgr2=0x55e40de077e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:25.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.135+0000 7fe642b4d9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:36:25.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.135+0000 7fe642b4d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:25.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.135+0000 7fe642b4d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:25.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.135+0000 7fe642b4d9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:36:25.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.135+0000 7fe642b4d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:25.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.135+0000 7fe642b4d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:25.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.135+0000 7fe642b4d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.135+0000 7fe642b4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.135+0000 7fe642b4d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.135 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.135+0000 7fe642b4d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:25.135 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.135+0000 7fe642b4d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.135 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.135+0000 7fe642b4d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:25.135 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.135+0000 7fe642b4d9c0 20 zone default found 2024-09-12T00:36:25.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.135+0000 7fe642b4d9c0 4 Realm: () 2024-09-12T00:36:25.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.135+0000 7fe642b4d9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:36:25.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.135+0000 7fe642b4d9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:36:25.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.135+0000 7fe642b4d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:25.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.135+0000 7fe642b4d9c0 20 zonegroup default 2024-09-12T00:36:25.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.135+0000 7fe642b4d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.135+0000 7fe642b4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.135+0000 7fe642b4d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.135+0000 7fe642b4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.135+0000 7fe642b4d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.135+0000 7fe642b4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.135+0000 7fe642b4d9c0 20 started sync module instance, tier type = 2024-09-12T00:36:25.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.135+0000 7fe642b4d9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:36:25.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.151+0000 7fe642b4d9c0 20 add_watcher() i=0 2024-09-12T00:36:25.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.151+0000 7fe642b4d9c0 20 add_watcher() i=1 2024-09-12T00:36:25.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.151+0000 7fe642b4d9c0 20 add_watcher() i=2 2024-09-12T00:36:25.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.151+0000 7fe642b4d9c0 20 add_watcher() i=3 2024-09-12T00:36:25.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.151+0000 7fe642b4d9c0 20 add_watcher() i=4 2024-09-12T00:36:25.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.151+0000 7fe642b4d9c0 20 add_watcher() i=5 2024-09-12T00:36:25.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.151+0000 7fe642b4d9c0 20 add_watcher() i=6 2024-09-12T00:36:25.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.151+0000 7fe642b4d9c0 20 add_watcher() i=7 2024-09-12T00:36:25.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.151+0000 7fe642b4d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:25.155 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.155+0000 7fe4f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:25.156 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.155+0000 7fe642b4d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:25.156 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.155+0000 7fe642b4d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:25.156 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.155+0000 7fe642b4d9c0 5 note: GC not initialized 2024-09-12T00:36:25.156 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.155+0000 7fe4f5fdb640 20 reqs_thread_entry: start 2024-09-12T00:36:25.156 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.155+0000 7fe642b4d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:25.156 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.155+0000 7fe642b4d9c0 20 Filter name: none 2024-09-12T00:36:25.156 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.155+0000 7fe4677fe640 20 reqs_thread_entry: start 2024-09-12T00:36:25.156 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.155+0000 7fe642b4d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.157 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.159+0000 7fe642b4d9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:36:25.157 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.159+0000 7fe642b4d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.159+0000 7fe642b4d9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:36:25.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.159+0000 7fe642b4d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:25.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.159+0000 7fe642b4d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.159+0000 7fe642b4d9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:36:25.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.159+0000 7fe642b4d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.159 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.159+0000 7fe642b4d9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:36:25.159 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.159+0000 7fe642b4d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:25.161 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.163+0000 7fe4f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:25.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.167+0000 7fe642b4d9c0 20 remove_watcher() i=0 2024-09-12T00:36:25.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.167+0000 7fe642b4d9c0 2 removed watcher, disabling cache 2024-09-12T00:36:25.168 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.167+0000 7fe642b4d9c0 20 remove_watcher() i=1 2024-09-12T00:36:25.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.171+0000 7fe642b4d9c0 20 remove_watcher() i=2 2024-09-12T00:36:25.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.171+0000 7fe642b4d9c0 20 remove_watcher() i=3 2024-09-12T00:36:25.174 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.175+0000 7fe642b4d9c0 20 remove_watcher() i=4 2024-09-12T00:36:25.175 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.175+0000 7fe642b4d9c0 20 remove_watcher() i=5 2024-09-12T00:36:25.177 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.179+0000 7fe642b4d9c0 20 remove_watcher() i=6 2024-09-12T00:36:25.178 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.179+0000 7fe642b4d9c0 20 remove_watcher() i=7 2024-09-12T00:36:25.191 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:25.192 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:36:25.192 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-init-index id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:36:25.192 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:25.193 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:25.193 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:25.204 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:25.204 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:25.250 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:36:25.284 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:25.284 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:25.328 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.327+0000 7f1b87b5a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.330 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.331+0000 7f1b87b5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.330 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.331+0000 7f1b87b5a9c0 20 realm 2024-09-12T00:36:25.331 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.331+0000 7f1b87b5a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.331 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.331+0000 7f1b87b5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.331 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.331+0000 7f1b87b5a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:25.331 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.331+0000 7f1b87b5a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.331 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.331+0000 7f1b87b5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.331 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.331+0000 7f1b87b5a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.332 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.331+0000 7f1b87b5a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:25.332 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.331+0000 7f1b87b5a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.333 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.335+0000 7f1b87b5a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:25.333 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.335+0000 7f1b87b5a9c0 20 searching for the correct realm 2024-09-12T00:36:25.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.339+0000 7f1b84e5f640 0 -- 172.21.15.43:0/1768216491 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f1b7c028070 msgr2=0x7f1b7c05d320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:25.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.347+0000 7f1b85e61640 0 -- 172.21.15.43:0/1768216491 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f1b7c013030 msgr2=0x7f1b7c064fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:25.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.351+0000 7f1b87b5a9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:36:25.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.351+0000 7f1b87b5a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:25.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.351+0000 7f1b87b5a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:25.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.351+0000 7f1b87b5a9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:36:25.353 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.351+0000 7f1b87b5a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:25.353 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.351+0000 7f1b87b5a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:25.353 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.351+0000 7f1b87b5a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.353 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.351+0000 7f1b87b5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.353 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.351+0000 7f1b87b5a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.355+0000 7f1b87b5a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:25.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.355+0000 7f1b87b5a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.355+0000 7f1b87b5a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:25.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.355+0000 7f1b87b5a9c0 20 zone default found 2024-09-12T00:36:25.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.355+0000 7f1b87b5a9c0 4 Realm: () 2024-09-12T00:36:25.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.355+0000 7f1b87b5a9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:36:25.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.355+0000 7f1b87b5a9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:36:25.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.355+0000 7f1b87b5a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:25.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.355+0000 7f1b87b5a9c0 20 zonegroup default 2024-09-12T00:36:25.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.355+0000 7f1b87b5a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.355+0000 7f1b87b5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.355+0000 7f1b87b5a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.355+0000 7f1b87b5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.355+0000 7f1b87b5a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.356 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.355+0000 7f1b87b5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.356 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.355+0000 7f1b87b5a9c0 20 started sync module instance, tier type = 2024-09-12T00:36:25.356 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.355+0000 7f1b87b5a9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:36:25.371 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.371+0000 7f1b87b5a9c0 20 add_watcher() i=0 2024-09-12T00:36:25.371 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.371+0000 7f1b87b5a9c0 20 add_watcher() i=1 2024-09-12T00:36:25.371 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.371+0000 7f1b87b5a9c0 20 add_watcher() i=2 2024-09-12T00:36:25.371 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.371+0000 7f1b87b5a9c0 20 add_watcher() i=3 2024-09-12T00:36:25.371 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.371+0000 7f1b87b5a9c0 20 add_watcher() i=4 2024-09-12T00:36:25.371 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.371+0000 7f1b87b5a9c0 20 add_watcher() i=5 2024-09-12T00:36:25.371 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.371+0000 7f1b87b5a9c0 20 add_watcher() i=6 2024-09-12T00:36:25.371 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.371+0000 7f1b87b5a9c0 20 add_watcher() i=7 2024-09-12T00:36:25.372 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.371+0000 7f1b87b5a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:25.375 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.375+0000 7f1a3b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:25.376 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.375+0000 7f1b87b5a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:25.376 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.375+0000 7f1b87b5a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:25.376 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.375+0000 7f1b87b5a9c0 5 note: GC not initialized 2024-09-12T00:36:25.376 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.375+0000 7f1a3a7e4640 20 reqs_thread_entry: start 2024-09-12T00:36:25.376 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.375+0000 7f1b87b5a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:25.377 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.375+0000 7f1b87b5a9c0 20 Filter name: none 2024-09-12T00:36:25.377 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.375+0000 7f19abfff640 20 reqs_thread_entry: start 2024-09-12T00:36:25.377 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.375+0000 7f1b87b5a9c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:36:25.377 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.375+0000 7f1b87b5a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.378 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.375+0000 7f1b87b5a9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:36:25.378 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.375+0000 7f1b87b5a9c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:36:25.378 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.375+0000 7f1b87b5a9c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:36:25.378 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.375+0000 7f1b87b5a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19 : miss 2024-09-12T00:36:25.378 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.375+0000 7f1b87b5a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.379 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.379+0000 7f1b87b5a9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:36:25.379 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.379+0000 7f1b87b5a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19 info.flags=0x17 2024-09-12T00:36:25.379 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.379+0000 7f1b87b5a9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19 to cache LRU end 2024-09-12T00:36:25.379 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.379+0000 7f1b87b5a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:25.379 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.379+0000 7f1b87b5a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:25.379 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.379+0000 7f1b87b5a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19 2024-09-12T00:36:25.387 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.387+0000 7f1b87b5a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19 info.flags=0x17 2024-09-12T00:36:25.387 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.387+0000 7f1b87b5a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19 to cache LRU end 2024-09-12T00:36:25.387 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.387+0000 7f1b87b5a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:25.388 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.387+0000 7f1b87b5a9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19, ofs0, ns] 2024-09-12T00:36:25.388 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.387+0000 7f1a68ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333459 cookie 94444630913968 notifier 6189 bl.length()=911 2024-09-12T00:36:25.388 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.387+0000 7f1a68ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19 info.flags=0x17 2024-09-12T00:36:25.388 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.387+0000 7f1a68ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19 to cache LRU end 2024-09-12T00:36:25.388 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.387+0000 7f1a68ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:25.388 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.387+0000 7f1b87b5a9c0 20 handle_bi_update(): bucket=:error-at-init-index[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19]): orig_sources= new_sources= 2024-09-12T00:36:25.389 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.387+0000 7f1b87b5a9c0 20 handle_bi_update(): bucket=:error-at-init-index[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19]): potential sources added=[] removed=[] 2024-09-12T00:36:25.389 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.387+0000 7f1b87b5a9c0 20 handle_bi_update(): bucket=:error-at-init-index[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19]): orig_dests= new_dests= 2024-09-12T00:36:25.389 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.387+0000 7f1b87b5a9c0 20 handle_bi_update(): bucket=:error-at-init-index[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19]): potential dests added=[] removed=[] 2024-09-12T00:36:25.397 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.395+0000 7f1b87b5a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.1.0 2024-09-12T00:36:25.398 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.395+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.1.0 2024-09-12T00:36:25.398 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.395+0000 7f1b87b5a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.1.1 2024-09-12T00:36:25.398 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.395+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.1.1 2024-09-12T00:36:25.398 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.395+0000 7f1b87b5a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.1.2 2024-09-12T00:36:25.398 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.395+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.1.2 2024-09-12T00:36:25.398 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.395+0000 7f1b87b5a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.1.3 2024-09-12T00:36:25.398 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.395+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.1.3 2024-09-12T00:36:25.398 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.395+0000 7f1b87b5a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.1.4 2024-09-12T00:36:25.398 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.395+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.1.4 2024-09-12T00:36:25.398 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.395+0000 7f1b87b5a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.1.5 2024-09-12T00:36:25.398 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.395+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.1.5 2024-09-12T00:36:25.399 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.395+0000 7f1b87b5a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.1.6 2024-09-12T00:36:25.399 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.395+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.1.6 2024-09-12T00:36:25.399 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.395+0000 7f1b87b5a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.1.7 2024-09-12T00:36:25.399 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.399+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.1.7 2024-09-12T00:36:25.399 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.399+0000 7f1b87b5a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.1.8 2024-09-12T00:36:25.399 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.399+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.1.8 2024-09-12T00:36:25.399 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.399+0000 7f1b87b5a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.1.9 2024-09-12T00:36:25.399 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.399+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.1.9 2024-09-12T00:36:25.399 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.399+0000 7f1b87b5a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.1.10 2024-09-12T00:36:25.399 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.399+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.1.10 2024-09-12T00:36:25.399 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.399+0000 7f1b87b5a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.1.11 2024-09-12T00:36:25.399 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.399+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.1.11 2024-09-12T00:36:25.399 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.399+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.0 2024-09-12T00:36:25.400 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.399+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.1 2024-09-12T00:36:25.400 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.399+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.2 2024-09-12T00:36:25.400 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.399+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.3 2024-09-12T00:36:25.400 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.399+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.4 2024-09-12T00:36:25.401 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.399+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.5 2024-09-12T00:36:25.401 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.399+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.6 2024-09-12T00:36:25.402 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.403+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.7 2024-09-12T00:36:25.402 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.403+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.8 2024-09-12T00:36:25.403 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.403+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.9 2024-09-12T00:36:25.404 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.403+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.10 2024-09-12T00:36:25.409 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.411+0000 7f1b87b5a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:25.409 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.411+0000 7f1b87b5a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19 2024-09-12T00:36:25.411 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.411+0000 7f1b87b5a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19 info.flags=0x17 2024-09-12T00:36:25.411 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.411+0000 7f1b87b5a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19 to cache LRU end 2024-09-12T00:36:25.411 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.411+0000 7f1b87b5a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:25.412 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.411+0000 7f1b87b5a9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19, ofs0, ns] 2024-09-12T00:36:25.412 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.411+0000 7f1a68ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333460 cookie 94444630913968 notifier 6189 bl.length()=911 2024-09-12T00:36:25.412 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.411+0000 7f1a68ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19 info.flags=0x17 2024-09-12T00:36:25.412 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.411+0000 7f1a68ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19 to cache LRU end 2024-09-12T00:36:25.412 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.411+0000 7f1a68ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:25.412 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.411+0000 7f1b87b5a9c0 20 handle_bi_update(): bucket=:error-at-init-index[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19]): orig_sources= new_sources= 2024-09-12T00:36:25.412 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.411+0000 7f1b87b5a9c0 20 handle_bi_update(): bucket=:error-at-init-index[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19]): potential sources added=[] removed=[] 2024-09-12T00:36:25.412 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.411+0000 7f1b87b5a9c0 20 handle_bi_update(): bucket=:error-at-init-index[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19]): orig_dests= new_dests= 2024-09-12T00:36:25.413 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.411+0000 7f1b87b5a9c0 20 handle_bi_update(): bucket=:error-at-init-index[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19]): potential dests added=[] removed=[] 2024-09-12T00:36:25.417 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.419+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.0 2024-09-12T00:36:25.417 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.419+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.1 2024-09-12T00:36:25.417 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.419+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.2 2024-09-12T00:36:25.418 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.419+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.3 2024-09-12T00:36:25.418 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.419+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.4 2024-09-12T00:36:25.419 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.419+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.5 2024-09-12T00:36:25.419 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.419+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.6 2024-09-12T00:36:25.420 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.419+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.7 2024-09-12T00:36:25.421 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.423+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.8 2024-09-12T00:36:25.421 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.423+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.9 2024-09-12T00:36:25.422 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.423+0000 7f1b87b5a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19.10 2024-09-12T00:36:25.422 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.423+0000 7f1b87b5a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:25.422 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.423+0000 7f1b87b5a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19 2024-09-12T00:36:25.424 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.427+0000 7f1b87b5a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19 info.flags=0x17 2024-09-12T00:36:25.425 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.427+0000 7f1b87b5a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19 to cache LRU end 2024-09-12T00:36:25.425 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.427+0000 7f1b87b5a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:25.425 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.427+0000 7f1b87b5a9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19, ofs0, ns] 2024-09-12T00:36:25.425 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.427+0000 7f1a57fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333461 cookie 94444630913968 notifier 6189 bl.length()=879 2024-09-12T00:36:25.425 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.427+0000 7f1a57fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19 info.flags=0x17 2024-09-12T00:36:25.426 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.427+0000 7f1a57fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19 to cache LRU end 2024-09-12T00:36:25.426 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.427+0000 7f1a57fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:25.426 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.427+0000 7f1b87b5a9c0 20 handle_bi_update(): bucket=:error-at-init-index[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19]): orig_sources= new_sources= 2024-09-12T00:36:25.426 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.427+0000 7f1b87b5a9c0 20 handle_bi_update(): bucket=:error-at-init-index[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19]): potential sources added=[] removed=[] 2024-09-12T00:36:25.426 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.427+0000 7f1b87b5a9c0 20 handle_bi_update(): bucket=:error-at-init-index[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19]): orig_dests= new_dests= 2024-09-12T00:36:25.426 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.427+0000 7f1b87b5a9c0 20 handle_bi_update(): bucket=:error-at-init-index[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19]): potential dests added=[] removed=[] 2024-09-12T00:36:25.430 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.431+0000 7f1b87b5a9c0 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-12T00:36:25.433 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.435+0000 7f1a3b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:25.438 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.439+0000 7f1b87b5a9c0 20 remove_watcher() i=0 2024-09-12T00:36:25.438 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.439+0000 7f1b87b5a9c0 2 removed watcher, disabling cache 2024-09-12T00:36:25.440 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.439+0000 7f1b87b5a9c0 20 remove_watcher() i=1 2024-09-12T00:36:25.442 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.443+0000 7f1b87b5a9c0 20 remove_watcher() i=2 2024-09-12T00:36:25.444 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.443+0000 7f1b87b5a9c0 20 remove_watcher() i=3 2024-09-12T00:36:25.446 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.447+0000 7f1b87b5a9c0 20 remove_watcher() i=4 2024-09-12T00:36:25.447 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.447+0000 7f1b87b5a9c0 20 remove_watcher() i=5 2024-09-12T00:36:25.448 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.447+0000 7f1b87b5a9c0 20 remove_watcher() i=6 2024-09-12T00:36:25.449 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.451+0000 7f1b87b5a9c0 20 remove_watcher() i=7 2024-09-12T00:36:25.464 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:36:25.490 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:25.490 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:25.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.535+0000 7f660c4249c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.535+0000 7f660c4249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.535+0000 7f660c4249c0 20 realm 2024-09-12T00:36:25.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.535+0000 7f660c4249c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.535+0000 7f660c4249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.535+0000 7f660c4249c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:25.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.535+0000 7f660c4249c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.536 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.535+0000 7f660c4249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.536 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.535+0000 7f660c4249c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.539+0000 7f660c4249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:25.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.539+0000 7f660c4249c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.539+0000 7f660c4249c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:25.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.539+0000 7f660c4249c0 20 searching for the correct realm 2024-09-12T00:36:25.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.547+0000 7f660a72b640 0 -- 172.21.15.43:0/2205600156 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f6600112a20 msgr2=0x7f66000ad9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:25.763 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.763+0000 7f6609f2a640 0 -- 172.21.15.43:0/2205600156 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x55b85b723440 msgr2=0x55b85b725830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:25.770 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.771+0000 7f660c4249c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:36:25.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.771+0000 7f660c4249c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:25.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.771+0000 7f660c4249c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:25.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.771+0000 7f660c4249c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:36:25.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.771+0000 7f660c4249c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:25.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.771+0000 7f660c4249c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:25.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.771+0000 7f660c4249c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.771+0000 7f660c4249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.771+0000 7f660c4249c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.772 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.771+0000 7f660c4249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:25.772 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.771+0000 7f660c4249c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.775+0000 7f660c4249c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:25.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.775+0000 7f660c4249c0 20 zone default found 2024-09-12T00:36:25.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.775+0000 7f660c4249c0 4 Realm: () 2024-09-12T00:36:25.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.775+0000 7f660c4249c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:36:25.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.775+0000 7f660c4249c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:36:25.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.775+0000 7f660c4249c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:25.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.775+0000 7f660c4249c0 20 zonegroup default 2024-09-12T00:36:25.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.775+0000 7f660c4249c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.774 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.775+0000 7f660c4249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.774 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.775+0000 7f660c4249c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.774 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.775+0000 7f660c4249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.774 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.775+0000 7f660c4249c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.775+0000 7f660c4249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.775+0000 7f660c4249c0 20 started sync module instance, tier type = 2024-09-12T00:36:25.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.775+0000 7f660c4249c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:36:25.799 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.799+0000 7f660c4249c0 20 add_watcher() i=0 2024-09-12T00:36:25.799 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.799+0000 7f660c4249c0 20 add_watcher() i=1 2024-09-12T00:36:25.799 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.799+0000 7f660c4249c0 20 add_watcher() i=2 2024-09-12T00:36:25.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.799+0000 7f660c4249c0 20 add_watcher() i=3 2024-09-12T00:36:25.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.799+0000 7f660c4249c0 20 add_watcher() i=4 2024-09-12T00:36:25.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.799+0000 7f660c4249c0 20 add_watcher() i=5 2024-09-12T00:36:25.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.799+0000 7f660c4249c0 20 add_watcher() i=6 2024-09-12T00:36:25.801 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.803+0000 7f660c4249c0 20 add_watcher() i=7 2024-09-12T00:36:25.801 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.803+0000 7f660c4249c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:25.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.811+0000 7f649b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:25.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.811+0000 7f660c4249c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:25.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.811+0000 7f660c4249c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:25.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.811+0000 7f660c4249c0 5 note: GC not initialized 2024-09-12T00:36:25.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.811+0000 7f649a7fc640 20 reqs_thread_entry: start 2024-09-12T00:36:25.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.811+0000 7f660c4249c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:25.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.811+0000 7f660c4249c0 20 Filter name: none 2024-09-12T00:36:25.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.811+0000 7f642bfff640 20 reqs_thread_entry: start 2024-09-12T00:36:25.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.811+0000 7f660c4249c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.812 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.811+0000 7f660c4249c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:36:25.812 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.811+0000 7f660c4249c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.815+0000 7f660c4249c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:36:25.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.815+0000 7f660c4249c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:25.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.815+0000 7f660c4249c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.815+0000 7f660c4249c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:36:25.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.815+0000 7f660c4249c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.817 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.819+0000 7f660c4249c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:36:25.817 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.819+0000 7f660c4249c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:25.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.819+0000 7f649b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:25.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.827+0000 7f660c4249c0 20 remove_watcher() i=0 2024-09-12T00:36:25.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.827+0000 7f660c4249c0 2 removed watcher, disabling cache 2024-09-12T00:36:25.828 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.827+0000 7f660c4249c0 20 remove_watcher() i=1 2024-09-12T00:36:25.830 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.831+0000 7f660c4249c0 20 remove_watcher() i=2 2024-09-12T00:36:25.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.835+0000 7f660c4249c0 20 remove_watcher() i=3 2024-09-12T00:36:25.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.835+0000 7f660c4249c0 20 remove_watcher() i=4 2024-09-12T00:36:25.836 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.835+0000 7f660c4249c0 20 remove_watcher() i=5 2024-09-12T00:36:25.838 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.839+0000 7f660c4249c0 20 remove_watcher() i=6 2024-09-12T00:36:25.840 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:25.839+0000 7f660c4249c0 20 remove_watcher() i=7 2024-09-12T00:36:25.856 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:25.857 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:36:25.857 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-init-index id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:36:25.857 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:25.858 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:25.858 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:25.863 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:25.863 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:25.907 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:25.907 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:25.962 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-12T00:36:25.962 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:25.963 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:25.963 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:25.983 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:25.983 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:26.032 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.032 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:26.051 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.052 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:26.069 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.069 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:26.090 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.090 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:26.108 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.109 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:26.127 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.128 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:26.146 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.146 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:26.165 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.165 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:26.184 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.184 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:26.203 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.203 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:26.221 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.221 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:26.239 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.239 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:26.257 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.257 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:26.277 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.277 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:26.294 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.294 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:26.312 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.312 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:26.331 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.331 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:26.349 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.349 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:26.370 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.370 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:26.388 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.388 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:26.405 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:36:26.439 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:26.439 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:26.483 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.483+0000 7fe57bd1c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.487+0000 7fe57bd1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.487+0000 7fe57bd1c9c0 20 realm 2024-09-12T00:36:26.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.487+0000 7fe57bd1c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.486 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.487+0000 7fe57bd1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.486 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.487+0000 7fe57bd1c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:26.486 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.487+0000 7fe57bd1c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.486 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.487+0000 7fe57bd1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.487 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.487+0000 7fe57bd1c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.487 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.487+0000 7fe57bd1c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:26.487 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.487+0000 7fe57bd1c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.488 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.487+0000 7fe57bd1c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:26.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.487+0000 7fe57bd1c9c0 20 searching for the correct realm 2024-09-12T00:36:26.495 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.495+0000 7fe579021640 0 -- 172.21.15.43:0/1659283897 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fe570008040 msgr2=0x7fe570028410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:26.501 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.503+0000 7fe579021640 0 -- 172.21.15.43:0/1659283897 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fe444080b80 msgr2=0x7fe444082fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:26.508 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.507+0000 7fe57bd1c9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:36:26.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.507+0000 7fe57bd1c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:26.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.507+0000 7fe57bd1c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:26.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.507+0000 7fe57bd1c9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:36:26.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.507+0000 7fe57bd1c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:26.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.507+0000 7fe57bd1c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:26.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.507+0000 7fe57bd1c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.511+0000 7fe57bd1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.511+0000 7fe57bd1c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.511+0000 7fe57bd1c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:26.510 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.511+0000 7fe57bd1c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.510 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.511+0000 7fe57bd1c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:26.510 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.511+0000 7fe57bd1c9c0 20 zone default found 2024-09-12T00:36:26.510 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.511+0000 7fe57bd1c9c0 4 Realm: () 2024-09-12T00:36:26.511 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.511+0000 7fe57bd1c9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:36:26.511 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.511+0000 7fe57bd1c9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:36:26.511 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.511+0000 7fe57bd1c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:26.511 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.511+0000 7fe57bd1c9c0 20 zonegroup default 2024-09-12T00:36:26.511 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.511+0000 7fe57bd1c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.511 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.511+0000 7fe57bd1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.511 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.511+0000 7fe57bd1c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.511 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.511+0000 7fe57bd1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.512 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.511+0000 7fe57bd1c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.512 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.511+0000 7fe57bd1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.512 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.511+0000 7fe57bd1c9c0 20 started sync module instance, tier type = 2024-09-12T00:36:26.512 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.511+0000 7fe57bd1c9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:36:26.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.527+0000 7fe57bd1c9c0 20 add_watcher() i=0 2024-09-12T00:36:26.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.527+0000 7fe57bd1c9c0 20 add_watcher() i=1 2024-09-12T00:36:26.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.527+0000 7fe57bd1c9c0 20 add_watcher() i=2 2024-09-12T00:36:26.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.527+0000 7fe57bd1c9c0 20 add_watcher() i=3 2024-09-12T00:36:26.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.527+0000 7fe57bd1c9c0 20 add_watcher() i=4 2024-09-12T00:36:26.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.527+0000 7fe57bd1c9c0 20 add_watcher() i=5 2024-09-12T00:36:26.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.527+0000 7fe57bd1c9c0 20 add_watcher() i=6 2024-09-12T00:36:26.529 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.531+0000 7fe57bd1c9c0 20 add_watcher() i=7 2024-09-12T00:36:26.529 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.531+0000 7fe57bd1c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:26.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.531+0000 7fe42b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:26.532 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.531+0000 7fe57bd1c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:26.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.531+0000 7fe57bd1c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:26.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.531+0000 7fe57bd1c9c0 5 note: GC not initialized 2024-09-12T00:36:26.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.531+0000 7fe42a7fc640 20 reqs_thread_entry: start 2024-09-12T00:36:26.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.531+0000 7fe57bd1c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:26.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.531+0000 7fe57bd1c9c0 20 Filter name: none 2024-09-12T00:36:26.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.531+0000 7fe39bfff640 20 reqs_thread_entry: start 2024-09-12T00:36:26.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.531+0000 7fe57bd1c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.535+0000 7fe57bd1c9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:36:26.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.535+0000 7fe57bd1c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.536 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.535+0000 7fe57bd1c9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:36:26.536 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.535+0000 7fe57bd1c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:26.536 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.535+0000 7fe57bd1c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.539+0000 7fe57bd1c9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:36:26.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.539+0000 7fe57bd1c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.539+0000 7fe57bd1c9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:36:26.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.539+0000 7fe57bd1c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:26.541 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.543+0000 7fe42b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:26.546 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.547+0000 7fe57bd1c9c0 20 remove_watcher() i=0 2024-09-12T00:36:26.546 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.547+0000 7fe57bd1c9c0 2 removed watcher, disabling cache 2024-09-12T00:36:26.548 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.547+0000 7fe57bd1c9c0 20 remove_watcher() i=1 2024-09-12T00:36:26.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.551+0000 7fe57bd1c9c0 20 remove_watcher() i=2 2024-09-12T00:36:26.552 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.551+0000 7fe57bd1c9c0 20 remove_watcher() i=3 2024-09-12T00:36:26.554 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.555+0000 7fe57bd1c9c0 20 remove_watcher() i=4 2024-09-12T00:36:26.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.559+0000 7fe57bd1c9c0 20 remove_watcher() i=5 2024-09-12T00:36:26.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.559+0000 7fe57bd1c9c0 20 remove_watcher() i=6 2024-09-12T00:36:26.562 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.563+0000 7fe57bd1c9c0 20 remove_watcher() i=7 2024-09-12T00:36:26.576 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:26.577 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:36:26.577 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-init-index id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:36:26.577 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:26.577 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-12T00:36:26.611 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:26.611 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:26.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.655+0000 7f5f99bd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.655+0000 7f5f99bd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.655+0000 7f5f99bd89c0 20 realm 2024-09-12T00:36:26.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.655+0000 7f5f99bd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.655+0000 7f5f99bd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.655+0000 7f5f99bd89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:26.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.655+0000 7f5f99bd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.655+0000 7f5f99bd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.655+0000 7f5f99bd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.658 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.659+0000 7f5f99bd89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:26.658 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.659+0000 7f5f99bd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.659 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.659+0000 7f5f99bd89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:26.659 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.659+0000 7f5f99bd89c0 20 searching for the correct realm 2024-09-12T00:36:26.664 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.663+0000 7f5f97edf640 0 -- 172.21.15.43:0/1477444859 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55ec577ff410 msgr2=0x55ec57801830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:26.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.671+0000 7f5f96edd640 0 -- 172.21.15.43:0/1477444859 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f5f8c008070 msgr2=0x7f5f8c00bb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:26.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.679+0000 7f5f99bd89c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:36:26.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.679+0000 7f5f99bd89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:26.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.679+0000 7f5f99bd89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:26.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.679+0000 7f5f99bd89c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:36:26.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.679+0000 7f5f99bd89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:26.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.679+0000 7f5f99bd89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:26.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.679+0000 7f5f99bd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.679+0000 7f5f99bd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.679+0000 7f5f99bd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.683+0000 7f5f99bd89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:26.682 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.683+0000 7f5f99bd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.682 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.683+0000 7f5f99bd89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:26.682 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.683+0000 7f5f99bd89c0 20 zone default found 2024-09-12T00:36:26.682 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.683+0000 7f5f99bd89c0 4 Realm: () 2024-09-12T00:36:26.682 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.683+0000 7f5f99bd89c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:36:26.682 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.683+0000 7f5f99bd89c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:36:26.682 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.683+0000 7f5f99bd89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:26.682 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.683+0000 7f5f99bd89c0 20 zonegroup default 2024-09-12T00:36:26.682 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.683+0000 7f5f99bd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.682 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.683+0000 7f5f99bd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.682 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.683+0000 7f5f99bd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.683+0000 7f5f99bd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.683+0000 7f5f99bd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.683+0000 7f5f99bd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.683+0000 7f5f99bd89c0 20 started sync module instance, tier type = 2024-09-12T00:36:26.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.683+0000 7f5f99bd89c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:36:26.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.703+0000 7f5f99bd89c0 20 add_watcher() i=0 2024-09-12T00:36:26.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.703+0000 7f5f99bd89c0 20 add_watcher() i=1 2024-09-12T00:36:26.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.703+0000 7f5f99bd89c0 20 add_watcher() i=2 2024-09-12T00:36:26.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.703+0000 7f5f99bd89c0 20 add_watcher() i=3 2024-09-12T00:36:26.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.703+0000 7f5f99bd89c0 20 add_watcher() i=4 2024-09-12T00:36:26.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.703+0000 7f5f99bd89c0 20 add_watcher() i=5 2024-09-12T00:36:26.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.703+0000 7f5f99bd89c0 20 add_watcher() i=6 2024-09-12T00:36:26.706 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.707+0000 7f5f99bd89c0 20 add_watcher() i=7 2024-09-12T00:36:26.706 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.707+0000 7f5f99bd89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:26.709 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.707+0000 7f5e4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:26.709 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.707+0000 7f5f99bd89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:26.710 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.707+0000 7f5f99bd89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:26.710 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.707+0000 7f5f99bd89c0 5 note: GC not initialized 2024-09-12T00:36:26.710 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.711+0000 7f5e4cfe1640 20 reqs_thread_entry: start 2024-09-12T00:36:26.710 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.711+0000 7f5f99bd89c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:26.710 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.711+0000 7f5f99bd89c0 20 Filter name: none 2024-09-12T00:36:26.710 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.711+0000 7f5dc67fc640 20 reqs_thread_entry: start 2024-09-12T00:36:26.710 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.711+0000 7f5f99bd89c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:36:26.710 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.711+0000 7f5f99bd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.711 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.711+0000 7f5f99bd89c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:36:26.711 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.711+0000 7f5f99bd89c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:36:26.711 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.711+0000 7f5f99bd89c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:36:26.711 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.711+0000 7f5f99bd89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20 : miss 2024-09-12T00:36:26.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.711+0000 7f5f99bd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.711+0000 7f5f99bd89c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:36:26.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.711+0000 7f5f99bd89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20 info.flags=0x17 2024-09-12T00:36:26.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.711+0000 7f5f99bd89c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20 to cache LRU end 2024-09-12T00:36:26.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.711+0000 7f5f99bd89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:26.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.711+0000 7f5f99bd89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:26.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.711+0000 7f5f99bd89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20 2024-09-12T00:36:26.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.715+0000 7f5f99bd89c0 -1 Injecting error=-95 at location=init_index 2024-09-12T00:36:26.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.715+0000 7f5f99bd89c0 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-12T00:36:26.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.723+0000 7f5f99bd89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20 info.flags=0x17 2024-09-12T00:36:26.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.723+0000 7f5f99bd89c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20 to cache LRU end 2024-09-12T00:36:26.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.723+0000 7f5f99bd89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:26.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.723+0000 7f5f99bd89c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20, ofs0, ns] 2024-09-12T00:36:26.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.723+0000 7f5e7a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333466 cookie 94473568720832 notifier 6008 bl.length()=911 2024-09-12T00:36:26.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.723+0000 7f5e7a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20 info.flags=0x17 2024-09-12T00:36:26.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.723+0000 7f5e7a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20 to cache LRU end 2024-09-12T00:36:26.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.723+0000 7f5e7a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:26.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.723+0000 7f5f99bd89c0 20 handle_bi_update(): bucket=:error-at-init-index[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20]): orig_sources= new_sources= 2024-09-12T00:36:26.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.723+0000 7f5f99bd89c0 20 handle_bi_update(): bucket=:error-at-init-index[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20]): potential sources added=[] removed=[] 2024-09-12T00:36:26.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.723+0000 7f5f99bd89c0 20 handle_bi_update(): bucket=:error-at-init-index[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20]): orig_dests= new_dests= 2024-09-12T00:36:26.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.723+0000 7f5f99bd89c0 20 handle_bi_update(): bucket=:error-at-init-index[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20]): potential dests added=[] removed=[] 2024-09-12T00:36:26.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.727+0000 7f5f99bd89c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.1.0 2024-09-12T00:36:26.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.727+0000 7f5f99bd89c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.1.0 2024-09-12T00:36:26.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.727+0000 7f5f99bd89c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.1.1 2024-09-12T00:36:26.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.727+0000 7f5f99bd89c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.1.1 2024-09-12T00:36:26.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.727+0000 7f5f99bd89c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.1.2 2024-09-12T00:36:26.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.727+0000 7f5f99bd89c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.1.2 2024-09-12T00:36:26.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.727+0000 7f5f99bd89c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.1.3 2024-09-12T00:36:26.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.727+0000 7f5f99bd89c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.1.3 2024-09-12T00:36:26.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.727+0000 7f5f99bd89c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.1.4 2024-09-12T00:36:26.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.727+0000 7f5f99bd89c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.1.4 2024-09-12T00:36:26.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.727+0000 7f5f99bd89c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.1.5 2024-09-12T00:36:26.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.727+0000 7f5f99bd89c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.1.5 2024-09-12T00:36:26.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.727+0000 7f5f99bd89c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.1.6 2024-09-12T00:36:26.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.727+0000 7f5f99bd89c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.1.6 2024-09-12T00:36:26.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.727+0000 7f5f99bd89c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.1.7 2024-09-12T00:36:26.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.727+0000 7f5f99bd89c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.1.7 2024-09-12T00:36:26.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.727+0000 7f5f99bd89c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.1.8 2024-09-12T00:36:26.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.727+0000 7f5f99bd89c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.1.8 2024-09-12T00:36:26.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.727+0000 7f5f99bd89c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.1.9 2024-09-12T00:36:26.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.727+0000 7f5f99bd89c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.1.9 2024-09-12T00:36:26.730 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.727+0000 7f5f99bd89c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.1.10 2024-09-12T00:36:26.730 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.727+0000 7f5f99bd89c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.1.10 2024-09-12T00:36:26.730 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.727+0000 7f5f99bd89c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.1.11 2024-09-12T00:36:26.730 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.727+0000 7f5f99bd89c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.1.11 2024-09-12T00:36:26.730 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.727+0000 7f5f99bd89c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.0 2024-09-12T00:36:26.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.727+0000 7f5f99bd89c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.1 2024-09-12T00:36:26.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.731+0000 7f5f99bd89c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.2 2024-09-12T00:36:26.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.731+0000 7f5f99bd89c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.3 2024-09-12T00:36:26.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.731+0000 7f5f99bd89c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.4 2024-09-12T00:36:26.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.731+0000 7f5f99bd89c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.5 2024-09-12T00:36:26.732 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.731+0000 7f5f99bd89c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.6 2024-09-12T00:36:26.733 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.735+0000 7f5f99bd89c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.7 2024-09-12T00:36:26.733 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.735+0000 7f5f99bd89c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.8 2024-09-12T00:36:26.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.735+0000 7f5f99bd89c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.9 2024-09-12T00:36:26.736 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.735+0000 7f5f99bd89c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20.10 2024-09-12T00:36:26.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.743+0000 7f5f99bd89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:26.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.743+0000 7f5f99bd89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20 2024-09-12T00:36:26.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.743+0000 7f5f99bd89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20 info.flags=0x17 2024-09-12T00:36:26.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.743+0000 7f5f99bd89c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20 to cache LRU end 2024-09-12T00:36:26.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.743+0000 7f5f99bd89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:26.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.743+0000 7f5f99bd89c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20, ofs0, ns] 2024-09-12T00:36:26.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.747+0000 7f5e7affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333467 cookie 94473568720832 notifier 6008 bl.length()=879 2024-09-12T00:36:26.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.747+0000 7f5e7affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20 info.flags=0x17 2024-09-12T00:36:26.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.747+0000 7f5e7affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20 to cache LRU end 2024-09-12T00:36:26.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.747+0000 7f5e7affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:26.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.747+0000 7f5f99bd89c0 20 handle_bi_update(): bucket=:error-at-init-index[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20]): orig_sources= new_sources= 2024-09-12T00:36:26.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.747+0000 7f5f99bd89c0 20 handle_bi_update(): bucket=:error-at-init-index[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20]): potential sources added=[] removed=[] 2024-09-12T00:36:26.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.747+0000 7f5f99bd89c0 20 handle_bi_update(): bucket=:error-at-init-index[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20]): orig_dests= new_dests= 2024-09-12T00:36:26.747 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.747+0000 7f5f99bd89c0 20 handle_bi_update(): bucket=:error-at-init-index[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20]): potential dests added=[] removed=[] 2024-09-12T00:36:26.749 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.751+0000 7f5f99bd89c0 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-12T00:36:26.752 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.751+0000 7f5e4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:26.760 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.759+0000 7f5f99bd89c0 20 remove_watcher() i=0 2024-09-12T00:36:26.760 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.759+0000 7f5f99bd89c0 2 removed watcher, disabling cache 2024-09-12T00:36:26.762 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.763+0000 7f5f99bd89c0 20 remove_watcher() i=1 2024-09-12T00:36:26.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.763+0000 7f5f99bd89c0 20 remove_watcher() i=2 2024-09-12T00:36:26.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.767+0000 7f5f99bd89c0 20 remove_watcher() i=3 2024-09-12T00:36:26.770 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.771+0000 7f5f99bd89c0 20 remove_watcher() i=4 2024-09-12T00:36:26.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.771+0000 7f5f99bd89c0 20 remove_watcher() i=5 2024-09-12T00:36:26.772 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.771+0000 7f5f99bd89c0 20 remove_watcher() i=6 2024-09-12T00:36:26.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.775+0000 7f5f99bd89c0 20 remove_watcher() i=7 2024-09-12T00:36:26.788 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:36:26.815 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:26.815 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:26.858 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.859+0000 7fa19571c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.860 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.859+0000 7fa19571c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.860 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.859+0000 7fa19571c9c0 20 realm 2024-09-12T00:36:26.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.859+0000 7fa19571c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.859+0000 7fa19571c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.859+0000 7fa19571c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:26.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.863+0000 7fa19571c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.863+0000 7fa19571c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.863+0000 7fa19571c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.862 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.863+0000 7fa19571c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:26.862 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.863+0000 7fa19571c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.863+0000 7fa19571c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:26.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.863+0000 7fa19571c9c0 20 searching for the correct realm 2024-09-12T00:36:26.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:26.871+0000 7fa193a23640 0 -- 172.21.15.43:0/2029704331 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7fa1881168b0 msgr2=0x7fa1880d1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:27.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.087+0000 7fa193222640 0 -- 172.21.15.43:0/2029704331 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x55d63c4ebbc0 msgr2=0x55d63c4edfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:27.094 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.095+0000 7fa19571c9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:36:27.095 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.095+0000 7fa19571c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:27.095 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.095+0000 7fa19571c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:27.095 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.095+0000 7fa19571c9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:36:27.095 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.095+0000 7fa19571c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:27.095 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.095+0000 7fa19571c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:27.095 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.095+0000 7fa19571c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.095 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.095+0000 7fa19571c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.095 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.095+0000 7fa19571c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.096 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.095+0000 7fa19571c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:27.096 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.095+0000 7fa19571c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.097 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.099+0000 7fa19571c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:27.097 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.099+0000 7fa19571c9c0 20 zone default found 2024-09-12T00:36:27.097 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.099+0000 7fa19571c9c0 4 Realm: () 2024-09-12T00:36:27.097 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.099+0000 7fa19571c9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:36:27.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.099+0000 7fa19571c9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:36:27.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.099+0000 7fa19571c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:27.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.099+0000 7fa19571c9c0 20 zonegroup default 2024-09-12T00:36:27.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.099+0000 7fa19571c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.099+0000 7fa19571c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.099+0000 7fa19571c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.099 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.099+0000 7fa19571c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.099 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.099+0000 7fa19571c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.099+0000 7fa19571c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.099+0000 7fa19571c9c0 20 started sync module instance, tier type = 2024-09-12T00:36:27.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.099+0000 7fa19571c9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:36:27.124 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.123+0000 7fa19571c9c0 20 add_watcher() i=0 2024-09-12T00:36:27.124 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.123+0000 7fa19571c9c0 20 add_watcher() i=1 2024-09-12T00:36:27.124 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.123+0000 7fa19571c9c0 20 add_watcher() i=2 2024-09-12T00:36:27.124 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.123+0000 7fa19571c9c0 20 add_watcher() i=3 2024-09-12T00:36:27.124 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.123+0000 7fa19571c9c0 20 add_watcher() i=4 2024-09-12T00:36:27.124 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.123+0000 7fa19571c9c0 20 add_watcher() i=5 2024-09-12T00:36:27.124 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.123+0000 7fa19571c9c0 20 add_watcher() i=6 2024-09-12T00:36:27.126 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.127+0000 7fa19571c9c0 20 add_watcher() i=7 2024-09-12T00:36:27.126 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.127+0000 7fa19571c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:27.130 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.131+0000 7fa049fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:27.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.131+0000 7fa19571c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:27.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.131+0000 7fa19571c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:27.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.131+0000 7fa19571c9c0 5 note: GC not initialized 2024-09-12T00:36:27.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.131+0000 7fa048fe1640 20 reqs_thread_entry: start 2024-09-12T00:36:27.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.131+0000 7fa19571c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:27.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.131+0000 7fa19571c9c0 20 Filter name: none 2024-09-12T00:36:27.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.131+0000 7f9fc27fc640 20 reqs_thread_entry: start 2024-09-12T00:36:27.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.135+0000 7fa19571c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.135+0000 7fa19571c9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:36:27.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.135+0000 7fa19571c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.135 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.135+0000 7fa19571c9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:36:27.135 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.135+0000 7fa19571c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:27.135 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.135+0000 7fa19571c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.135+0000 7fa19571c9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:36:27.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.135+0000 7fa19571c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.139+0000 7fa19571c9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:36:27.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.139+0000 7fa19571c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:27.141 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.143+0000 7fa049fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:27.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.147+0000 7fa19571c9c0 20 remove_watcher() i=0 2024-09-12T00:36:27.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.147+0000 7fa19571c9c0 2 removed watcher, disabling cache 2024-09-12T00:36:27.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.147+0000 7fa19571c9c0 20 remove_watcher() i=1 2024-09-12T00:36:27.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.151+0000 7fa19571c9c0 20 remove_watcher() i=2 2024-09-12T00:36:27.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.151+0000 7fa19571c9c0 20 remove_watcher() i=3 2024-09-12T00:36:27.156 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.155+0000 7fa19571c9c0 20 remove_watcher() i=4 2024-09-12T00:36:27.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.159+0000 7fa19571c9c0 20 remove_watcher() i=5 2024-09-12T00:36:27.159 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.159+0000 7fa19571c9c0 20 remove_watcher() i=6 2024-09-12T00:36:27.161 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.163+0000 7fa19571c9c0 20 remove_watcher() i=7 2024-09-12T00:36:27.180 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:27.180 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:36:27.180 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-init-index id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T00:36:27.180 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:27.181 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:27.181 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:27.185 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:27.185 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:27.231 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:27.231 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:27.280 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: reshard bucket with abort at init_index 2024-09-12T00:36:27.280 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:27.282 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:27.282 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:27.306 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:27.306 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:27.353 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:27.353 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:27.372 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:27.373 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:27.392 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:27.392 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:27.411 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:27.411 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:27.431 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:27.431 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:27.450 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:27.450 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:27.469 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:27.469 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:27.488 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:27.488 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:27.508 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:27.508 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:27.527 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:27.528 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:27.547 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:27.547 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:27.568 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:27.568 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:27.588 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:27.589 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:27.608 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:27.608 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:27.627 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:27.627 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:27.646 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:27.647 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:27.666 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:27.666 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:27.686 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:27.686 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:27.704 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:27.704 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:27.724 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:27.724 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:27.740 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:36:27.775 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:27.775 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:27.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.819+0000 7f0efcf7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.823+0000 7f0efcf7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.823+0000 7f0efcf7d9c0 20 realm 2024-09-12T00:36:27.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.823+0000 7f0efcf7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.823+0000 7f0efcf7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.823+0000 7f0efcf7d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:27.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.823+0000 7f0efcf7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.823+0000 7f0efcf7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.823 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.823+0000 7f0efcf7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.824 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.823+0000 7f0efcf7d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:27.824 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.823+0000 7f0efcf7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.827+0000 7f0efcf7d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:27.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.827+0000 7f0efcf7d9c0 20 searching for the correct realm 2024-09-12T00:36:27.830 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.831+0000 7f0efb284640 0 -- 172.21.15.43:0/3900590637 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x56026395e3f0 msgr2=0x560263960880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:27.837 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.835+0000 7f0efaa83640 0 -- 172.21.15.43:0/3900590637 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f0ef0078780 msgr2=0x7f0ef004b8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:27.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.843+0000 7f0efcf7d9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:36:27.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.843+0000 7f0efcf7d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:27.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.843+0000 7f0efcf7d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:27.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.843+0000 7f0efcf7d9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:36:27.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.843+0000 7f0efcf7d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:27.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.843+0000 7f0efcf7d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:27.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.843+0000 7f0efcf7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.847+0000 7f0efcf7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.847+0000 7f0efcf7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.846 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.847+0000 7f0efcf7d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:27.846 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.847+0000 7f0efcf7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.847+0000 7f0efcf7d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:27.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.847+0000 7f0efcf7d9c0 20 zone default found 2024-09-12T00:36:27.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.847+0000 7f0efcf7d9c0 4 Realm: () 2024-09-12T00:36:27.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.847+0000 7f0efcf7d9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:36:27.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.847+0000 7f0efcf7d9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:36:27.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.847+0000 7f0efcf7d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:27.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.847+0000 7f0efcf7d9c0 20 zonegroup default 2024-09-12T00:36:27.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.847+0000 7f0efcf7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.847+0000 7f0efcf7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.847+0000 7f0efcf7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.848 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.847+0000 7f0efcf7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.848 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.847+0000 7f0efcf7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.848 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.847+0000 7f0efcf7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.848 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.847+0000 7f0efcf7d9c0 20 started sync module instance, tier type = 2024-09-12T00:36:27.848 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.847+0000 7f0efcf7d9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:36:27.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.863+0000 7f0efcf7d9c0 20 add_watcher() i=0 2024-09-12T00:36:27.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.863+0000 7f0efcf7d9c0 20 add_watcher() i=1 2024-09-12T00:36:27.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.863+0000 7f0efcf7d9c0 20 add_watcher() i=2 2024-09-12T00:36:27.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.863+0000 7f0efcf7d9c0 20 add_watcher() i=3 2024-09-12T00:36:27.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.863+0000 7f0efcf7d9c0 20 add_watcher() i=4 2024-09-12T00:36:27.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.863+0000 7f0efcf7d9c0 20 add_watcher() i=5 2024-09-12T00:36:27.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.863+0000 7f0efcf7d9c0 20 add_watcher() i=6 2024-09-12T00:36:27.864 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.863+0000 7f0efcf7d9c0 20 add_watcher() i=7 2024-09-12T00:36:27.864 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.863+0000 7f0efcf7d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:27.866 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.867+0000 7f0db17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:27.868 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.867+0000 7f0efcf7d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:27.868 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.867+0000 7f0efcf7d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:27.868 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.867+0000 7f0efcf7d9c0 5 note: GC not initialized 2024-09-12T00:36:27.868 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.867+0000 7f0d2bfff640 20 reqs_thread_entry: start 2024-09-12T00:36:27.868 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.867+0000 7f0efcf7d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:27.868 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.867+0000 7f0efcf7d9c0 20 Filter name: none 2024-09-12T00:36:27.868 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.867+0000 7f0d29ffb640 20 reqs_thread_entry: start 2024-09-12T00:36:27.868 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.867+0000 7f0efcf7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.867+0000 7f0efcf7d9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:36:27.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.867+0000 7f0efcf7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.871+0000 7f0efcf7d9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:36:27.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.871+0000 7f0efcf7d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:27.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.871+0000 7f0efcf7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.871+0000 7f0efcf7d9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:36:27.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.871+0000 7f0efcf7d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.871+0000 7f0efcf7d9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:36:27.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.871+0000 7f0efcf7d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:27.872 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.871+0000 7f0db17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:27.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.879+0000 7f0efcf7d9c0 20 remove_watcher() i=0 2024-09-12T00:36:27.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.879+0000 7f0efcf7d9c0 2 removed watcher, disabling cache 2024-09-12T00:36:27.879 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.879+0000 7f0efcf7d9c0 20 remove_watcher() i=1 2024-09-12T00:36:27.881 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.883+0000 7f0efcf7d9c0 20 remove_watcher() i=2 2024-09-12T00:36:27.883 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.883+0000 7f0efcf7d9c0 20 remove_watcher() i=3 2024-09-12T00:36:27.885 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.887+0000 7f0efcf7d9c0 20 remove_watcher() i=4 2024-09-12T00:36:27.886 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.887+0000 7f0efcf7d9c0 20 remove_watcher() i=5 2024-09-12T00:36:27.887 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.887+0000 7f0efcf7d9c0 20 remove_watcher() i=6 2024-09-12T00:36:27.889 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.891+0000 7f0efcf7d9c0 20 remove_watcher() i=7 2024-09-12T00:36:27.903 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:27.903 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:36:27.903 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: abort-at-init-indext id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:36:27.903 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:27.904 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-12T00:36:27.935 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:27.936 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:27.978 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.979+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.979 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.979+0000 7faab10a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.979 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.979+0000 7faab10a09c0 20 realm 2024-09-12T00:36:27.980 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.979+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.980 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.979+0000 7faab10a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.980 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.979+0000 7faab10a09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:27.980 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.979+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.980 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.979+0000 7faab10a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.979+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.983+0000 7faab10a09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:27.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.983+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.983+0000 7faab10a09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:27.983 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.983+0000 7faab10a09c0 20 searching for the correct realm 2024-09-12T00:36:27.988 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.987+0000 7faaaf3a7640 0 -- 172.21.15.43:0/4163552575 >> [v2:172.21.15.43:6808/2258408181,v1:172.21.15.43:6809/2258408181] conn(0x559662f517d0 msgr2=0x559662f53c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:27.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:27.995+0000 7faaaeba6640 0 -- 172.21.15.43:0/4163552575 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7faaa406b3b0 msgr2=0x7faaa407d490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:28.003 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.003+0000 7faab10a09c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:36:28.003 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.003+0000 7faab10a09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:28.003 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.003+0000 7faab10a09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:28.004 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.003+0000 7faab10a09c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:36:28.004 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.003+0000 7faab10a09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:28.004 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.003+0000 7faab10a09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:28.004 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.003+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.004 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.003+0000 7faab10a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.004 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.003+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.004 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.003+0000 7faab10a09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:28.004 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.003+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.005 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.007+0000 7faab10a09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:28.005 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.007+0000 7faab10a09c0 20 zone default found 2024-09-12T00:36:28.005 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.007+0000 7faab10a09c0 4 Realm: () 2024-09-12T00:36:28.005 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.007+0000 7faab10a09c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:36:28.006 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.007+0000 7faab10a09c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:36:28.006 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.007+0000 7faab10a09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:28.006 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.007+0000 7faab10a09c0 20 zonegroup default 2024-09-12T00:36:28.006 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.007+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.006 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.007+0000 7faab10a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.006 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.007+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.007+0000 7faab10a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.007+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.007+0000 7faab10a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.007+0000 7faab10a09c0 20 started sync module instance, tier type = 2024-09-12T00:36:28.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.007+0000 7faab10a09c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:36:28.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.023+0000 7faab10a09c0 20 add_watcher() i=0 2024-09-12T00:36:28.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.023+0000 7faab10a09c0 20 add_watcher() i=1 2024-09-12T00:36:28.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.023+0000 7faab10a09c0 20 add_watcher() i=2 2024-09-12T00:36:28.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.023+0000 7faab10a09c0 20 add_watcher() i=3 2024-09-12T00:36:28.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.023+0000 7faab10a09c0 20 add_watcher() i=4 2024-09-12T00:36:28.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.023+0000 7faab10a09c0 20 add_watcher() i=5 2024-09-12T00:36:28.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.023+0000 7faab10a09c0 20 add_watcher() i=6 2024-09-12T00:36:28.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.023+0000 7faab10a09c0 20 add_watcher() i=7 2024-09-12T00:36:28.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.023+0000 7faab10a09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:28.026 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.027+0000 7fa9657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:28.027 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.027+0000 7faab10a09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:28.027 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.027+0000 7faab10a09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:28.027 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.027+0000 7faab10a09c0 5 note: GC not initialized 2024-09-12T00:36:28.027 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.027+0000 7fa8dffff640 20 reqs_thread_entry: start 2024-09-12T00:36:28.027 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.027+0000 7faab10a09c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:28.027 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.027+0000 7faab10a09c0 20 Filter name: none 2024-09-12T00:36:28.028 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.027+0000 7fa8ddffb640 20 reqs_thread_entry: start 2024-09-12T00:36:28.028 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.027+0000 7faab10a09c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:36:28.028 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.027+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.027+0000 7faab10a09c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:36:28.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.027+0000 7faab10a09c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:36:28.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.027+0000 7faab10a09c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:36:28.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.027+0000 7faab10a09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 : miss 2024-09-12T00:36:28.030 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.027+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.030 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.027+0000 7faab10a09c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:36:28.030 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.027+0000 7faab10a09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 info.flags=0x17 2024-09-12T00:36:28.030 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.027+0000 7faab10a09c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 to cache LRU end 2024-09-12T00:36:28.030 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.027+0000 7faab10a09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:28.030 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.027+0000 7faab10a09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:28.030 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.027+0000 7faab10a09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 2024-09-12T00:36:28.031 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7faab10a09c0 time 2024-09-12T00:36:28.035253+0000 2024-09-12T00:36:28.031 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:36:28.032 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:28.032 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7faab497a2eb] 2024-09-12T00:36:28.033 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7faab497a49f] 2024-09-12T00:36:28.033 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559660b81cc1] 2024-09-12T00:36:28.033 INFO:tasks.workunit.client.0.smithi043.stderr: 4: radosgw-admin(+0x1421f32) [0x5596615def32] 2024-09-12T00:36:28.033 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559660b96ced] 2024-09-12T00:36:28.033 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:36:28.033 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7faab37e0d90] 2024-09-12T00:36:28.033 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:36:28.033 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:36:28.033 INFO:tasks.workunit.client.0.smithi043.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:36:28.033 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7faab10a09c0 thread_name:radosgw-admin 2024-09-12T00:36:28.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.031+0000 7faab10a09c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7faab10a09c0 time 2024-09-12T00:36:28.035253+0000 2024-09-12T00:36:28.033 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:36:28.034 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.034 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:28.034 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7faab497a2eb] 2024-09-12T00:36:28.034 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7faab497a49f] 2024-09-12T00:36:28.034 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559660b81cc1] 2024-09-12T00:36:28.034 INFO:tasks.workunit.client.0.smithi043.stderr: 4: radosgw-admin(+0x1421f32) [0x5596615def32] 2024-09-12T00:36:28.034 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559660b96ced] 2024-09-12T00:36:28.034 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:36:28.034 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7faab37e0d90] 2024-09-12T00:36:28.034 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:36:28.034 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:36:28.034 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.047 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:28.048 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7faab37f9520] 2024-09-12T00:36:28.048 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:36:28.048 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:36:28.048 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:36:28.048 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7faab497a345] 2024-09-12T00:36:28.048 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7faab497a49f] 2024-09-12T00:36:28.048 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559660b81cc1] 2024-09-12T00:36:28.048 INFO:tasks.workunit.client.0.smithi043.stderr: 8: radosgw-admin(+0x1421f32) [0x5596615def32] 2024-09-12T00:36:28.048 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559660b96ced] 2024-09-12T00:36:28.048 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:36:28.048 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7faab37e0d90] 2024-09-12T00:36:28.049 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:36:28.049 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:36:28.049 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.035+0000 7faab10a09c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:36:28.049 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7faab10a09c0 thread_name:radosgw-admin 2024-09-12T00:36:28.049 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.049 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:28.049 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7faab37f9520] 2024-09-12T00:36:28.049 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:36:28.049 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:36:28.049 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:36:28.049 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7faab497a345] 2024-09-12T00:36:28.049 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7faab497a49f] 2024-09-12T00:36:28.049 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559660b81cc1] 2024-09-12T00:36:28.050 INFO:tasks.workunit.client.0.smithi043.stderr: 8: radosgw-admin(+0x1421f32) [0x5596615def32] 2024-09-12T00:36:28.050 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559660b96ced] 2024-09-12T00:36:28.050 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:36:28.050 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7faab37e0d90] 2024-09-12T00:36:28.050 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:36:28.050 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:36:28.050 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:36:28.050 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.050 INFO:tasks.workunit.client.0.smithi043.stderr:--- begin dump of recent events --- 2024-09-12T00:36:28.050 INFO:tasks.workunit.client.0.smithi043.stderr: -499> 2024-09-12T00:36:27.959+0000 7faaaeba6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:28.050 INFO:tasks.workunit.client.0.smithi043.stderr: -498> 2024-09-12T00:36:27.959+0000 7faaaf3a7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:28.050 INFO:tasks.workunit.client.0.smithi043.stderr: -497> 2024-09-12T00:36:27.959+0000 7faaaf3a7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:28.050 INFO:tasks.workunit.client.0.smithi043.stderr: -496> 2024-09-12T00:36:27.959+0000 7faaaf3a7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:28.051 INFO:tasks.workunit.client.0.smithi043.stderr: -495> 2024-09-12T00:36:27.959+0000 7faaaeba6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:28.051 INFO:tasks.workunit.client.0.smithi043.stderr: -494> 2024-09-12T00:36:27.959+0000 7faaaeba6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:28.051 INFO:tasks.workunit.client.0.smithi043.stderr: -493> 2024-09-12T00:36:27.959+0000 7faaaeba6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:28.051 INFO:tasks.workunit.client.0.smithi043.stderr: -492> 2024-09-12T00:36:27.959+0000 7faaaf3a7640 10 monclient(hunting): handle_auth_done global_id 6050 payload 274 2024-09-12T00:36:28.051 INFO:tasks.workunit.client.0.smithi043.stderr: -491> 2024-09-12T00:36:27.959+0000 7faaaf3a7640 10 monclient: _finish_hunting 0 2024-09-12T00:36:28.051 INFO:tasks.workunit.client.0.smithi043.stderr: -490> 2024-09-12T00:36:27.959+0000 7faaaf3a7640 1 monclient: found mon.noname-c 2024-09-12T00:36:28.051 INFO:tasks.workunit.client.0.smithi043.stderr: -489> 2024-09-12T00:36:27.959+0000 7faaaf3a7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:36:28.051 INFO:tasks.workunit.client.0.smithi043.stderr: -488> 2024-09-12T00:36:27.959+0000 7faaae3a5640 10 monclient: get_auth_request con 0x559662ceba70 auth_method 0 2024-09-12T00:36:28.051 INFO:tasks.workunit.client.0.smithi043.stderr: -487> 2024-09-12T00:36:27.959+0000 7fa99ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:28.051 INFO:tasks.workunit.client.0.smithi043.stderr: -486> 2024-09-12T00:36:27.959+0000 7fa99ce09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:28.051 INFO:tasks.workunit.client.0.smithi043.stderr: -485> 2024-09-12T00:36:27.959+0000 7fa99ce09640 10 monclient: dump: 2024-09-12T00:36:28.051 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:36:28.052 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:36:28.052 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.052 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.052 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:28.052 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:36:28.052 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:36:28.052 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:36:28.052 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:36:28.052 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.052 INFO:tasks.workunit.client.0.smithi043.stderr: -484> 2024-09-12T00:36:27.959+0000 7fa99ce09640 10 monclient: _finish_auth 0 2024-09-12T00:36:28.052 INFO:tasks.workunit.client.0.smithi043.stderr: -483> 2024-09-12T00:36:27.959+0000 7fa99ce09640 10 monclient: _check_auth_tickets 2024-09-12T00:36:28.052 INFO:tasks.workunit.client.0.smithi043.stderr: -482> 2024-09-12T00:36:27.959+0000 7fa99ce09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:28.052 INFO:tasks.workunit.client.0.smithi043.stderr: -481> 2024-09-12T00:36:27.959+0000 7fa99ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:28.053 INFO:tasks.workunit.client.0.smithi043.stderr: -480> 2024-09-12T00:36:27.959+0000 7fa99ce09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:28.053 INFO:tasks.workunit.client.0.smithi043.stderr: -479> 2024-09-12T00:36:27.959+0000 7fa99ce09640 10 monclient: dump: 2024-09-12T00:36:28.053 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:36:28.053 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:36:28.053 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.053 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.053 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:28.053 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:36:28.053 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:36:28.053 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:36:28.053 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:36:28.053 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.054 INFO:tasks.workunit.client.0.smithi043.stderr: -478> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 monclient: authenticate success, global_id 6050 2024-09-12T00:36:28.054 INFO:tasks.workunit.client.0.smithi043.stderr: -477> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient: get_monmap_and_config success 2024-09-12T00:36:28.054 INFO:tasks.workunit.client.0.smithi043.stderr: -476> 2024-09-12T00:36:27.959+0000 7faab10a09c0 4 set_mon_vals no callback set 2024-09-12T00:36:28.054 INFO:tasks.workunit.client.0.smithi043.stderr: -475> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient: shutdown 2024-09-12T00:36:28.054 INFO:tasks.workunit.client.0.smithi043.stderr: -474> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 asok(0x559662c512b0) unregister_commands rotate-key 2024-09-12T00:36:28.054 INFO:tasks.workunit.client.0.smithi043.stderr: -473> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient: build_initial_monmap 2024-09-12T00:36:28.054 INFO:tasks.workunit.client.0.smithi043.stderr: -472> 2024-09-12T00:36:27.959+0000 7faab10a09c0 1 build_initial for_mkfs: 0 2024-09-12T00:36:28.054 INFO:tasks.workunit.client.0.smithi043.stderr: -471> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient: monmap: 2024-09-12T00:36:28.054 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:36:28.054 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:28.054 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:36:28.054 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:36:28.054 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:28.055 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:36:28.055 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:36:28.055 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:36:28.055 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:36:28.055 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.055 INFO:tasks.workunit.client.0.smithi043.stderr: -470> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e85820) adding auth protocol: cephx 2024-09-12T00:36:28.055 INFO:tasks.workunit.client.0.smithi043.stderr: -469> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e85820) adding auth protocol: cephx 2024-09-12T00:36:28.055 INFO:tasks.workunit.client.0.smithi043.stderr: -468> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e85820) adding auth protocol: cephx 2024-09-12T00:36:28.055 INFO:tasks.workunit.client.0.smithi043.stderr: -467> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e85820) adding con mode: secure 2024-09-12T00:36:28.055 INFO:tasks.workunit.client.0.smithi043.stderr: -466> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e85820) adding con mode: crc 2024-09-12T00:36:28.055 INFO:tasks.workunit.client.0.smithi043.stderr: -465> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e85820) adding con mode: secure 2024-09-12T00:36:28.055 INFO:tasks.workunit.client.0.smithi043.stderr: -464> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e85820) adding con mode: crc 2024-09-12T00:36:28.056 INFO:tasks.workunit.client.0.smithi043.stderr: -463> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e85820) adding con mode: secure 2024-09-12T00:36:28.056 INFO:tasks.workunit.client.0.smithi043.stderr: -462> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e85820) adding con mode: crc 2024-09-12T00:36:28.056 INFO:tasks.workunit.client.0.smithi043.stderr: -461> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e85820) adding con mode: crc 2024-09-12T00:36:28.056 INFO:tasks.workunit.client.0.smithi043.stderr: -460> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e85820) adding con mode: secure 2024-09-12T00:36:28.056 INFO:tasks.workunit.client.0.smithi043.stderr: -459> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e85820) adding con mode: crc 2024-09-12T00:36:28.056 INFO:tasks.workunit.client.0.smithi043.stderr: -458> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e85820) adding con mode: secure 2024-09-12T00:36:28.056 INFO:tasks.workunit.client.0.smithi043.stderr: -457> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e85820) adding con mode: crc 2024-09-12T00:36:28.056 INFO:tasks.workunit.client.0.smithi043.stderr: -456> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e85820) adding con mode: secure 2024-09-12T00:36:28.056 INFO:tasks.workunit.client.0.smithi043.stderr: -455> 2024-09-12T00:36:27.959+0000 7faab10a09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:28.056 INFO:tasks.workunit.client.0.smithi043.stderr: -454> 2024-09-12T00:36:27.959+0000 7faab10a09c0 1 librados: starting msgr at 2024-09-12T00:36:28.056 INFO:tasks.workunit.client.0.smithi043.stderr: -453> 2024-09-12T00:36:27.959+0000 7faab10a09c0 1 librados: starting objecter 2024-09-12T00:36:28.056 INFO:tasks.workunit.client.0.smithi043.stderr: -452> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command objecter_requests hook 0x559662da4d50 2024-09-12T00:36:28.057 INFO:tasks.workunit.client.0.smithi043.stderr: -451> 2024-09-12T00:36:27.959+0000 7faab10a09c0 1 librados: setting wanted keys 2024-09-12T00:36:28.057 INFO:tasks.workunit.client.0.smithi043.stderr: -450> 2024-09-12T00:36:27.959+0000 7faab10a09c0 1 librados: calling monclient init 2024-09-12T00:36:28.057 INFO:tasks.workunit.client.0.smithi043.stderr: -449> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient: init 2024-09-12T00:36:28.057 INFO:tasks.workunit.client.0.smithi043.stderr: -448> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e5ae00) adding auth protocol: cephx 2024-09-12T00:36:28.057 INFO:tasks.workunit.client.0.smithi043.stderr: -447> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e5ae00) adding auth protocol: cephx 2024-09-12T00:36:28.057 INFO:tasks.workunit.client.0.smithi043.stderr: -446> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e5ae00) adding auth protocol: cephx 2024-09-12T00:36:28.057 INFO:tasks.workunit.client.0.smithi043.stderr: -445> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e5ae00) adding con mode: secure 2024-09-12T00:36:28.057 INFO:tasks.workunit.client.0.smithi043.stderr: -444> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e5ae00) adding con mode: crc 2024-09-12T00:36:28.057 INFO:tasks.workunit.client.0.smithi043.stderr: -443> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e5ae00) adding con mode: secure 2024-09-12T00:36:28.057 INFO:tasks.workunit.client.0.smithi043.stderr: -442> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e5ae00) adding con mode: crc 2024-09-12T00:36:28.057 INFO:tasks.workunit.client.0.smithi043.stderr: -441> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e5ae00) adding con mode: secure 2024-09-12T00:36:28.057 INFO:tasks.workunit.client.0.smithi043.stderr: -440> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e5ae00) adding con mode: crc 2024-09-12T00:36:28.057 INFO:tasks.workunit.client.0.smithi043.stderr: -439> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e5ae00) adding con mode: crc 2024-09-12T00:36:28.058 INFO:tasks.workunit.client.0.smithi043.stderr: -438> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e5ae00) adding con mode: secure 2024-09-12T00:36:28.058 INFO:tasks.workunit.client.0.smithi043.stderr: -437> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e5ae00) adding con mode: crc 2024-09-12T00:36:28.058 INFO:tasks.workunit.client.0.smithi043.stderr: -436> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e5ae00) adding con mode: secure 2024-09-12T00:36:28.058 INFO:tasks.workunit.client.0.smithi043.stderr: -435> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e5ae00) adding con mode: crc 2024-09-12T00:36:28.058 INFO:tasks.workunit.client.0.smithi043.stderr: -434> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e5ae00) adding con mode: secure 2024-09-12T00:36:28.058 INFO:tasks.workunit.client.0.smithi043.stderr: -433> 2024-09-12T00:36:27.959+0000 7faab10a09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:28.058 INFO:tasks.workunit.client.0.smithi043.stderr: -432> 2024-09-12T00:36:27.959+0000 7faab10a09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:28.058 INFO:tasks.workunit.client.0.smithi043.stderr: -431> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command rotate-key hook 0x559662e5af48 2024-09-12T00:36:28.058 INFO:tasks.workunit.client.0.smithi043.stderr: -430> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:28.058 INFO:tasks.workunit.client.0.smithi043.stderr: -429> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:36:28.058 INFO:tasks.workunit.client.0.smithi043.stderr: -428> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient(hunting): picked mon.noname-a con 0x559662ceb2c0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:36:28.059 INFO:tasks.workunit.client.0.smithi043.stderr: -427> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient(hunting): picked mon.noname-c con 0x559662ceba70 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:36:28.059 INFO:tasks.workunit.client.0.smithi043.stderr: -426> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient(hunting): picked mon.noname-b con 0x559662da12d0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:36:28.059 INFO:tasks.workunit.client.0.smithi043.stderr: -425> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:28.059 INFO:tasks.workunit.client.0.smithi043.stderr: -424> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:28.059 INFO:tasks.workunit.client.0.smithi043.stderr: -423> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:28.059 INFO:tasks.workunit.client.0.smithi043.stderr: -422> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:28.059 INFO:tasks.workunit.client.0.smithi043.stderr: -421> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient(hunting): authenticate will time out at 2083.950810s 2024-09-12T00:36:28.059 INFO:tasks.workunit.client.0.smithi043.stderr: -420> 2024-09-12T00:36:27.959+0000 7faaae3a5640 10 monclient(hunting): get_auth_request con 0x559662ceba70 auth_method 0 2024-09-12T00:36:28.059 INFO:tasks.workunit.client.0.smithi043.stderr: -419> 2024-09-12T00:36:27.959+0000 7faaae3a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:28.059 INFO:tasks.workunit.client.0.smithi043.stderr: -418> 2024-09-12T00:36:27.959+0000 7faaae3a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:28.059 INFO:tasks.workunit.client.0.smithi043.stderr: -417> 2024-09-12T00:36:27.959+0000 7faaae3a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:28.059 INFO:tasks.workunit.client.0.smithi043.stderr: -416> 2024-09-12T00:36:27.959+0000 7faaaeba6640 10 monclient(hunting): get_auth_request con 0x559662ceb2c0 auth_method 0 2024-09-12T00:36:28.059 INFO:tasks.workunit.client.0.smithi043.stderr: -415> 2024-09-12T00:36:27.959+0000 7faaaeba6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:28.060 INFO:tasks.workunit.client.0.smithi043.stderr: -414> 2024-09-12T00:36:27.959+0000 7faaaeba6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:28.060 INFO:tasks.workunit.client.0.smithi043.stderr: -413> 2024-09-12T00:36:27.959+0000 7faaaeba6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:28.060 INFO:tasks.workunit.client.0.smithi043.stderr: -412> 2024-09-12T00:36:27.959+0000 7faaae3a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:28.060 INFO:tasks.workunit.client.0.smithi043.stderr: -411> 2024-09-12T00:36:27.959+0000 7faaae3a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:28.060 INFO:tasks.workunit.client.0.smithi043.stderr: -410> 2024-09-12T00:36:27.959+0000 7faaae3a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:28.060 INFO:tasks.workunit.client.0.smithi043.stderr: -409> 2024-09-12T00:36:27.959+0000 7faaaeba6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:28.060 INFO:tasks.workunit.client.0.smithi043.stderr: -408> 2024-09-12T00:36:27.959+0000 7faaaeba6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:28.060 INFO:tasks.workunit.client.0.smithi043.stderr: -407> 2024-09-12T00:36:27.959+0000 7faaaeba6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:28.060 INFO:tasks.workunit.client.0.smithi043.stderr: -406> 2024-09-12T00:36:27.959+0000 7faaaf3a7640 10 monclient(hunting): get_auth_request con 0x559662da12d0 auth_method 0 2024-09-12T00:36:28.060 INFO:tasks.workunit.client.0.smithi043.stderr: -405> 2024-09-12T00:36:27.959+0000 7faaaf3a7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:28.060 INFO:tasks.workunit.client.0.smithi043.stderr: -404> 2024-09-12T00:36:27.959+0000 7faaaf3a7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:28.060 INFO:tasks.workunit.client.0.smithi043.stderr: -403> 2024-09-12T00:36:27.959+0000 7faaaf3a7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:28.061 INFO:tasks.workunit.client.0.smithi043.stderr: -402> 2024-09-12T00:36:27.959+0000 7faaae3a5640 10 monclient(hunting): handle_auth_done global_id 6053 payload 824 2024-09-12T00:36:28.061 INFO:tasks.workunit.client.0.smithi043.stderr: -401> 2024-09-12T00:36:27.959+0000 7faaae3a5640 10 monclient: _finish_hunting 0 2024-09-12T00:36:28.061 INFO:tasks.workunit.client.0.smithi043.stderr: -400> 2024-09-12T00:36:27.959+0000 7faaae3a5640 1 monclient: found mon.noname-c 2024-09-12T00:36:28.061 INFO:tasks.workunit.client.0.smithi043.stderr: -399> 2024-09-12T00:36:27.959+0000 7faaae3a5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:36:28.061 INFO:tasks.workunit.client.0.smithi043.stderr: -398> 2024-09-12T00:36:27.959+0000 7fa99b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:28.061 INFO:tasks.workunit.client.0.smithi043.stderr: -397> 2024-09-12T00:36:27.959+0000 7fa99b606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:28.061 INFO:tasks.workunit.client.0.smithi043.stderr: -396> 2024-09-12T00:36:27.959+0000 7fa99b606640 10 monclient: dump: 2024-09-12T00:36:28.061 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:36:28.061 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:36:28.061 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.061 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.061 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:28.061 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:36:28.062 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:36:28.062 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:36:28.062 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:36:28.062 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.062 INFO:tasks.workunit.client.0.smithi043.stderr: -395> 2024-09-12T00:36:27.959+0000 7fa99b606640 10 monclient: _finish_auth 0 2024-09-12T00:36:28.062 INFO:tasks.workunit.client.0.smithi043.stderr: -394> 2024-09-12T00:36:27.959+0000 7fa99b606640 10 monclient: _check_auth_tickets 2024-09-12T00:36:28.062 INFO:tasks.workunit.client.0.smithi043.stderr: -393> 2024-09-12T00:36:27.959+0000 7fa99b606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:28.062 INFO:tasks.workunit.client.0.smithi043.stderr: -392> 2024-09-12T00:36:27.959+0000 7fa99b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:28.062 INFO:tasks.workunit.client.0.smithi043.stderr: -391> 2024-09-12T00:36:27.959+0000 7fa99b606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:28.062 INFO:tasks.workunit.client.0.smithi043.stderr: -390> 2024-09-12T00:36:27.959+0000 7fa99b606640 10 monclient: dump: 2024-09-12T00:36:28.062 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:36:28.062 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:36:28.063 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.063 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.063 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:28.063 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:36:28.063 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:36:28.063 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:36:28.063 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:36:28.063 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.063 INFO:tasks.workunit.client.0.smithi043.stderr: -389> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 monclient: authenticate success, global_id 6053 2024-09-12T00:36:28.063 INFO:tasks.workunit.client.0.smithi043.stderr: -388> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient: _renew_subs 2024-09-12T00:36:28.063 INFO:tasks.workunit.client.0.smithi043.stderr: -387> 2024-09-12T00:36:27.959+0000 7fa99ce09640 4 set_mon_vals no callback set 2024-09-12T00:36:28.063 INFO:tasks.workunit.client.0.smithi043.stderr: -386> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:36:28.063 INFO:tasks.workunit.client.0.smithi043.stderr: -385> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient: _renew_subs 2024-09-12T00:36:28.064 INFO:tasks.workunit.client.0.smithi043.stderr: -384> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:36:28.064 INFO:tasks.workunit.client.0.smithi043.stderr: -383> 2024-09-12T00:36:27.959+0000 7faab10a09c0 1 librados: init done 2024-09-12T00:36:28.064 INFO:tasks.workunit.client.0.smithi043.stderr: -382> 2024-09-12T00:36:27.963+0000 7fa99b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:36:28.064 INFO:tasks.workunit.client.0.smithi043.stderr: -381> 2024-09-12T00:36:27.963+0000 7fa99b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:36:28.064 INFO:tasks.workunit.client.0.smithi043.stderr: -380> 2024-09-12T00:36:27.963+0000 7fa99b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:36:28.064 INFO:tasks.workunit.client.0.smithi043.stderr: -379> 2024-09-12T00:36:27.963+0000 7faaaeba6640 10 monclient: get_auth_request con 0x7fa994070c80 auth_method 0 2024-09-12T00:36:28.064 INFO:tasks.workunit.client.0.smithi043.stderr: -378> 2024-09-12T00:36:27.963+0000 7faaaf3a7640 10 monclient: get_auth_request con 0x559662e83740 auth_method 0 2024-09-12T00:36:28.064 INFO:tasks.workunit.client.0.smithi043.stderr: -377> 2024-09-12T00:36:27.963+0000 7faaaeba6640 10 monclient: get_auth_request con 0x559662ea67d0 auth_method 0 2024-09-12T00:36:28.064 INFO:tasks.workunit.client.0.smithi043.stderr: -376> 2024-09-12T00:36:27.967+0000 7faaae3a5640 10 monclient: get_auth_request con 0x559662eaae70 auth_method 0 2024-09-12T00:36:28.064 INFO:tasks.workunit.client.0.smithi043.stderr: -375> 2024-09-12T00:36:27.967+0000 7faab10a09c0 10 monclient: build_initial_monmap 2024-09-12T00:36:28.064 INFO:tasks.workunit.client.0.smithi043.stderr: -374> 2024-09-12T00:36:27.967+0000 7faab10a09c0 1 build_initial for_mkfs: 0 2024-09-12T00:36:28.065 INFO:tasks.workunit.client.0.smithi043.stderr: -373> 2024-09-12T00:36:27.967+0000 7faab10a09c0 10 monclient: monmap: 2024-09-12T00:36:28.065 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:36:28.065 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:28.065 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:36:28.065 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:36:28.065 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:28.065 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:36:28.065 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:36:28.065 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:36:28.065 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:36:28.065 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.066 INFO:tasks.workunit.client.0.smithi043.stderr: -372> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eafc60) adding auth protocol: cephx 2024-09-12T00:36:28.066 INFO:tasks.workunit.client.0.smithi043.stderr: -371> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eafc60) adding auth protocol: cephx 2024-09-12T00:36:28.066 INFO:tasks.workunit.client.0.smithi043.stderr: -370> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eafc60) adding auth protocol: cephx 2024-09-12T00:36:28.066 INFO:tasks.workunit.client.0.smithi043.stderr: -369> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eafc60) adding con mode: secure 2024-09-12T00:36:28.066 INFO:tasks.workunit.client.0.smithi043.stderr: -368> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eafc60) adding con mode: crc 2024-09-12T00:36:28.066 INFO:tasks.workunit.client.0.smithi043.stderr: -367> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eafc60) adding con mode: secure 2024-09-12T00:36:28.066 INFO:tasks.workunit.client.0.smithi043.stderr: -366> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eafc60) adding con mode: crc 2024-09-12T00:36:28.066 INFO:tasks.workunit.client.0.smithi043.stderr: -365> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eafc60) adding con mode: secure 2024-09-12T00:36:28.066 INFO:tasks.workunit.client.0.smithi043.stderr: -364> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eafc60) adding con mode: crc 2024-09-12T00:36:28.066 INFO:tasks.workunit.client.0.smithi043.stderr: -363> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eafc60) adding con mode: crc 2024-09-12T00:36:28.066 INFO:tasks.workunit.client.0.smithi043.stderr: -362> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eafc60) adding con mode: secure 2024-09-12T00:36:28.066 INFO:tasks.workunit.client.0.smithi043.stderr: -361> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eafc60) adding con mode: crc 2024-09-12T00:36:28.067 INFO:tasks.workunit.client.0.smithi043.stderr: -360> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eafc60) adding con mode: secure 2024-09-12T00:36:28.067 INFO:tasks.workunit.client.0.smithi043.stderr: -359> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eafc60) adding con mode: crc 2024-09-12T00:36:28.067 INFO:tasks.workunit.client.0.smithi043.stderr: -358> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eafc60) adding con mode: secure 2024-09-12T00:36:28.067 INFO:tasks.workunit.client.0.smithi043.stderr: -357> 2024-09-12T00:36:27.967+0000 7faab10a09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:28.067 INFO:tasks.workunit.client.0.smithi043.stderr: -356> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command objecter_requests cmddesc objecter_requests hook 0x559662eb3580 EEXIST 2024-09-12T00:36:28.067 INFO:tasks.workunit.client.0.smithi043.stderr: -355> 2024-09-12T00:36:27.967+0000 7faab10a09c0 10 monclient: init 2024-09-12T00:36:28.067 INFO:tasks.workunit.client.0.smithi043.stderr: -354> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eae278) adding auth protocol: cephx 2024-09-12T00:36:28.067 INFO:tasks.workunit.client.0.smithi043.stderr: -353> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eae278) adding auth protocol: cephx 2024-09-12T00:36:28.067 INFO:tasks.workunit.client.0.smithi043.stderr: -352> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eae278) adding auth protocol: cephx 2024-09-12T00:36:28.067 INFO:tasks.workunit.client.0.smithi043.stderr: -351> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eae278) adding con mode: secure 2024-09-12T00:36:28.067 INFO:tasks.workunit.client.0.smithi043.stderr: -350> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eae278) adding con mode: crc 2024-09-12T00:36:28.067 INFO:tasks.workunit.client.0.smithi043.stderr: -349> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eae278) adding con mode: secure 2024-09-12T00:36:28.068 INFO:tasks.workunit.client.0.smithi043.stderr: -348> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eae278) adding con mode: crc 2024-09-12T00:36:28.068 INFO:tasks.workunit.client.0.smithi043.stderr: -347> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eae278) adding con mode: secure 2024-09-12T00:36:28.068 INFO:tasks.workunit.client.0.smithi043.stderr: -346> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eae278) adding con mode: crc 2024-09-12T00:36:28.068 INFO:tasks.workunit.client.0.smithi043.stderr: -345> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eae278) adding con mode: crc 2024-09-12T00:36:28.068 INFO:tasks.workunit.client.0.smithi043.stderr: -344> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eae278) adding con mode: secure 2024-09-12T00:36:28.068 INFO:tasks.workunit.client.0.smithi043.stderr: -343> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eae278) adding con mode: crc 2024-09-12T00:36:28.068 INFO:tasks.workunit.client.0.smithi043.stderr: -342> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eae278) adding con mode: secure 2024-09-12T00:36:28.068 INFO:tasks.workunit.client.0.smithi043.stderr: -341> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eae278) adding con mode: crc 2024-09-12T00:36:28.068 INFO:tasks.workunit.client.0.smithi043.stderr: -340> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eae278) adding con mode: secure 2024-09-12T00:36:28.068 INFO:tasks.workunit.client.0.smithi043.stderr: -339> 2024-09-12T00:36:27.967+0000 7faab10a09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:28.068 INFO:tasks.workunit.client.0.smithi043.stderr: -338> 2024-09-12T00:36:27.971+0000 7faab10a09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:28.068 INFO:tasks.workunit.client.0.smithi043.stderr: -337> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command rotate-key cmddesc rotate-key hook 0x559662eae3c0 EEXIST 2024-09-12T00:36:28.069 INFO:tasks.workunit.client.0.smithi043.stderr: -336> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:28.069 INFO:tasks.workunit.client.0.smithi043.stderr: -335> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:36:28.069 INFO:tasks.workunit.client.0.smithi043.stderr: -334> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient(hunting): picked mon.noname-c con 0x559662ed7730 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:36:28.069 INFO:tasks.workunit.client.0.smithi043.stderr: -333> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient(hunting): picked mon.noname-b con 0x559662ed7060 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:36:28.069 INFO:tasks.workunit.client.0.smithi043.stderr: -332> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient(hunting): picked mon.noname-a con 0x559662ed5a40 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:36:28.069 INFO:tasks.workunit.client.0.smithi043.stderr: -331> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:28.069 INFO:tasks.workunit.client.0.smithi043.stderr: -330> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:28.069 INFO:tasks.workunit.client.0.smithi043.stderr: -329> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:28.069 INFO:tasks.workunit.client.0.smithi043.stderr: -328> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:28.069 INFO:tasks.workunit.client.0.smithi043.stderr: -327> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient(hunting): authenticate will time out at 2083.960217s 2024-09-12T00:36:28.069 INFO:tasks.workunit.client.0.smithi043.stderr: -326> 2024-09-12T00:36:27.971+0000 7faaaeba6640 10 monclient(hunting): get_auth_request con 0x559662ed7730 auth_method 0 2024-09-12T00:36:28.069 INFO:tasks.workunit.client.0.smithi043.stderr: -325> 2024-09-12T00:36:27.971+0000 7faaaeba6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:28.069 INFO:tasks.workunit.client.0.smithi043.stderr: -324> 2024-09-12T00:36:27.971+0000 7faaaeba6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:28.070 INFO:tasks.workunit.client.0.smithi043.stderr: -323> 2024-09-12T00:36:27.971+0000 7faaaeba6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:28.070 INFO:tasks.workunit.client.0.smithi043.stderr: -322> 2024-09-12T00:36:27.971+0000 7faaaf3a7640 10 monclient(hunting): get_auth_request con 0x559662ed5a40 auth_method 0 2024-09-12T00:36:28.070 INFO:tasks.workunit.client.0.smithi043.stderr: -321> 2024-09-12T00:36:27.971+0000 7faaaf3a7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:28.070 INFO:tasks.workunit.client.0.smithi043.stderr: -320> 2024-09-12T00:36:27.971+0000 7faaaf3a7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:28.070 INFO:tasks.workunit.client.0.smithi043.stderr: -319> 2024-09-12T00:36:27.971+0000 7faaaf3a7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:28.070 INFO:tasks.workunit.client.0.smithi043.stderr: -318> 2024-09-12T00:36:27.971+0000 7faaaf3a7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:28.070 INFO:tasks.workunit.client.0.smithi043.stderr: -317> 2024-09-12T00:36:27.971+0000 7faaaf3a7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:28.070 INFO:tasks.workunit.client.0.smithi043.stderr: -316> 2024-09-12T00:36:27.971+0000 7faaaf3a7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:28.070 INFO:tasks.workunit.client.0.smithi043.stderr: -315> 2024-09-12T00:36:27.971+0000 7faaaeba6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:28.070 INFO:tasks.workunit.client.0.smithi043.stderr: -314> 2024-09-12T00:36:27.971+0000 7faaaeba6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:28.070 INFO:tasks.workunit.client.0.smithi043.stderr: -313> 2024-09-12T00:36:27.971+0000 7faaaeba6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:28.070 INFO:tasks.workunit.client.0.smithi043.stderr: -312> 2024-09-12T00:36:27.971+0000 7faaae3a5640 10 monclient(hunting): get_auth_request con 0x559662ed7060 auth_method 0 2024-09-12T00:36:28.071 INFO:tasks.workunit.client.0.smithi043.stderr: -311> 2024-09-12T00:36:27.971+0000 7faaae3a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:28.071 INFO:tasks.workunit.client.0.smithi043.stderr: -310> 2024-09-12T00:36:27.971+0000 7faaae3a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:28.071 INFO:tasks.workunit.client.0.smithi043.stderr: -309> 2024-09-12T00:36:27.971+0000 7faaae3a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:28.071 INFO:tasks.workunit.client.0.smithi043.stderr: -308> 2024-09-12T00:36:27.971+0000 7faaaf3a7640 10 monclient(hunting): handle_auth_done global_id 6285 payload 824 2024-09-12T00:36:28.071 INFO:tasks.workunit.client.0.smithi043.stderr: -307> 2024-09-12T00:36:27.971+0000 7faaaf3a7640 10 monclient: _finish_hunting 0 2024-09-12T00:36:28.071 INFO:tasks.workunit.client.0.smithi043.stderr: -306> 2024-09-12T00:36:27.971+0000 7faaaf3a7640 1 monclient: found mon.noname-a 2024-09-12T00:36:28.071 INFO:tasks.workunit.client.0.smithi043.stderr: -305> 2024-09-12T00:36:27.971+0000 7faaaf3a7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:36:28.071 INFO:tasks.workunit.client.0.smithi043.stderr: -304> 2024-09-12T00:36:27.971+0000 7fa998e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:28.071 INFO:tasks.workunit.client.0.smithi043.stderr: -303> 2024-09-12T00:36:27.971+0000 7fa998e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:36:28.071 INFO:tasks.workunit.client.0.smithi043.stderr: -302> 2024-09-12T00:36:27.971+0000 7fa998e01640 10 monclient: dump: 2024-09-12T00:36:28.071 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:36:28.071 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:36:28.071 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.072 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.072 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:28.072 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:36:28.072 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:36:28.072 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:36:28.072 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:36:28.072 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.072 INFO:tasks.workunit.client.0.smithi043.stderr: -301> 2024-09-12T00:36:27.971+0000 7fa998e01640 10 monclient: _finish_auth 0 2024-09-12T00:36:28.072 INFO:tasks.workunit.client.0.smithi043.stderr: -300> 2024-09-12T00:36:27.971+0000 7fa998e01640 10 monclient: _check_auth_tickets 2024-09-12T00:36:28.072 INFO:tasks.workunit.client.0.smithi043.stderr: -299> 2024-09-12T00:36:27.971+0000 7fa998e01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:28.072 INFO:tasks.workunit.client.0.smithi043.stderr: -298> 2024-09-12T00:36:27.971+0000 7fa998e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:28.072 INFO:tasks.workunit.client.0.smithi043.stderr: -297> 2024-09-12T00:36:27.971+0000 7fa998e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:36:28.073 INFO:tasks.workunit.client.0.smithi043.stderr: -296> 2024-09-12T00:36:27.971+0000 7fa998e01640 10 monclient: dump: 2024-09-12T00:36:28.073 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:36:28.073 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:36:28.073 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.073 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.073 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:28.073 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:36:28.073 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:36:28.073 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:36:28.073 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:36:28.073 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.074 INFO:tasks.workunit.client.0.smithi043.stderr: -295> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 monclient: authenticate success, global_id 6285 2024-09-12T00:36:28.074 INFO:tasks.workunit.client.0.smithi043.stderr: -294> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient: _renew_subs 2024-09-12T00:36:28.074 INFO:tasks.workunit.client.0.smithi043.stderr: -293> 2024-09-12T00:36:27.971+0000 7faaadba4640 4 set_mon_vals no callback set 2024-09-12T00:36:28.074 INFO:tasks.workunit.client.0.smithi043.stderr: -292> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:36:28.074 INFO:tasks.workunit.client.0.smithi043.stderr: -291> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient: _renew_subs 2024-09-12T00:36:28.074 INFO:tasks.workunit.client.0.smithi043.stderr: -290> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:36:28.074 INFO:tasks.workunit.client.0.smithi043.stderr: -289> 2024-09-12T00:36:27.971+0000 7fa998e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:36:28.074 INFO:tasks.workunit.client.0.smithi043.stderr: -288> 2024-09-12T00:36:27.971+0000 7fa998e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:36:28.074 INFO:tasks.workunit.client.0.smithi043.stderr: -287> 2024-09-12T00:36:27.971+0000 7fa998e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:36:28.075 INFO:tasks.workunit.client.0.smithi043.stderr: -286> 2024-09-12T00:36:27.971+0000 7faaaeba6640 10 monclient: get_auth_request con 0x7fa988070a20 auth_method 0 2024-09-12T00:36:28.075 INFO:tasks.workunit.client.0.smithi043.stderr: -285> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient: get_monmap_and_config 2024-09-12T00:36:28.075 INFO:tasks.workunit.client.0.smithi043.stderr: -284> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient: build_initial_monmap 2024-09-12T00:36:28.075 INFO:tasks.workunit.client.0.smithi043.stderr: -283> 2024-09-12T00:36:27.971+0000 7faab10a09c0 1 build_initial for_mkfs: 0 2024-09-12T00:36:28.075 INFO:tasks.workunit.client.0.smithi043.stderr: -282> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient: monmap: 2024-09-12T00:36:28.075 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:36:28.075 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:28.075 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:36:28.075 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:36:28.075 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:28.075 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:36:28.075 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:36:28.076 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:36:28.076 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:36:28.076 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.076 INFO:tasks.workunit.client.0.smithi043.stderr: -281> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x559662ef6f40) adding auth protocol: cephx 2024-09-12T00:36:28.076 INFO:tasks.workunit.client.0.smithi043.stderr: -280> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x559662ef6f40) adding auth protocol: cephx 2024-09-12T00:36:28.076 INFO:tasks.workunit.client.0.smithi043.stderr: -279> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x559662ef6f40) adding auth protocol: cephx 2024-09-12T00:36:28.076 INFO:tasks.workunit.client.0.smithi043.stderr: -278> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x559662ef6f40) adding con mode: secure 2024-09-12T00:36:28.076 INFO:tasks.workunit.client.0.smithi043.stderr: -277> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x559662ef6f40) adding con mode: crc 2024-09-12T00:36:28.076 INFO:tasks.workunit.client.0.smithi043.stderr: -276> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x559662ef6f40) adding con mode: secure 2024-09-12T00:36:28.076 INFO:tasks.workunit.client.0.smithi043.stderr: -275> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x559662ef6f40) adding con mode: crc 2024-09-12T00:36:28.076 INFO:tasks.workunit.client.0.smithi043.stderr: -274> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x559662ef6f40) adding con mode: secure 2024-09-12T00:36:28.076 INFO:tasks.workunit.client.0.smithi043.stderr: -273> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x559662ef6f40) adding con mode: crc 2024-09-12T00:36:28.076 INFO:tasks.workunit.client.0.smithi043.stderr: -272> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x559662ef6f40) adding con mode: crc 2024-09-12T00:36:28.077 INFO:tasks.workunit.client.0.smithi043.stderr: -271> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x559662ef6f40) adding con mode: secure 2024-09-12T00:36:28.077 INFO:tasks.workunit.client.0.smithi043.stderr: -270> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x559662ef6f40) adding con mode: crc 2024-09-12T00:36:28.077 INFO:tasks.workunit.client.0.smithi043.stderr: -269> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x559662ef6f40) adding con mode: secure 2024-09-12T00:36:28.077 INFO:tasks.workunit.client.0.smithi043.stderr: -268> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x559662ef6f40) adding con mode: crc 2024-09-12T00:36:28.077 INFO:tasks.workunit.client.0.smithi043.stderr: -267> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x559662ef6f40) adding con mode: secure 2024-09-12T00:36:28.077 INFO:tasks.workunit.client.0.smithi043.stderr: -266> 2024-09-12T00:36:27.971+0000 7faab10a09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:28.077 INFO:tasks.workunit.client.0.smithi043.stderr: -265> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient: init 2024-09-12T00:36:28.077 INFO:tasks.workunit.client.0.smithi043.stderr: -264> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a79e0) adding auth protocol: cephx 2024-09-12T00:36:28.077 INFO:tasks.workunit.client.0.smithi043.stderr: -263> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a79e0) adding auth protocol: cephx 2024-09-12T00:36:28.077 INFO:tasks.workunit.client.0.smithi043.stderr: -262> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a79e0) adding auth protocol: cephx 2024-09-12T00:36:28.077 INFO:tasks.workunit.client.0.smithi043.stderr: -261> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a79e0) adding con mode: secure 2024-09-12T00:36:28.077 INFO:tasks.workunit.client.0.smithi043.stderr: -260> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a79e0) adding con mode: crc 2024-09-12T00:36:28.078 INFO:tasks.workunit.client.0.smithi043.stderr: -259> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a79e0) adding con mode: secure 2024-09-12T00:36:28.078 INFO:tasks.workunit.client.0.smithi043.stderr: -258> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a79e0) adding con mode: crc 2024-09-12T00:36:28.078 INFO:tasks.workunit.client.0.smithi043.stderr: -257> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a79e0) adding con mode: secure 2024-09-12T00:36:28.078 INFO:tasks.workunit.client.0.smithi043.stderr: -256> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a79e0) adding con mode: crc 2024-09-12T00:36:28.078 INFO:tasks.workunit.client.0.smithi043.stderr: -255> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a79e0) adding con mode: crc 2024-09-12T00:36:28.078 INFO:tasks.workunit.client.0.smithi043.stderr: -254> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a79e0) adding con mode: secure 2024-09-12T00:36:28.078 INFO:tasks.workunit.client.0.smithi043.stderr: -253> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a79e0) adding con mode: crc 2024-09-12T00:36:28.078 INFO:tasks.workunit.client.0.smithi043.stderr: -252> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a79e0) adding con mode: secure 2024-09-12T00:36:28.078 INFO:tasks.workunit.client.0.smithi043.stderr: -251> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a79e0) adding con mode: crc 2024-09-12T00:36:28.078 INFO:tasks.workunit.client.0.smithi043.stderr: -250> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a79e0) adding con mode: secure 2024-09-12T00:36:28.078 INFO:tasks.workunit.client.0.smithi043.stderr: -249> 2024-09-12T00:36:27.975+0000 7faab10a09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:28.078 INFO:tasks.workunit.client.0.smithi043.stderr: -248> 2024-09-12T00:36:27.975+0000 7faab10a09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:28.078 INFO:tasks.workunit.client.0.smithi043.stderr: -247> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command rotate-key cmddesc rotate-key hook 0x7ffca88a7b28 EEXIST 2024-09-12T00:36:28.079 INFO:tasks.workunit.client.0.smithi043.stderr: -246> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:28.079 INFO:tasks.workunit.client.0.smithi043.stderr: -245> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:36:28.079 INFO:tasks.workunit.client.0.smithi043.stderr: -244> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): picked mon.noname-a con 0x559662f2b460 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:36:28.079 INFO:tasks.workunit.client.0.smithi043.stderr: -243> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): picked mon.noname-b con 0x559662f26850 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:36:28.079 INFO:tasks.workunit.client.0.smithi043.stderr: -242> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): picked mon.noname-c con 0x559662f271d0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:36:28.079 INFO:tasks.workunit.client.0.smithi043.stderr: -241> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:28.079 INFO:tasks.workunit.client.0.smithi043.stderr: -240> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:28.079 INFO:tasks.workunit.client.0.smithi043.stderr: -239> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:28.079 INFO:tasks.workunit.client.0.smithi043.stderr: -238> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:28.079 INFO:tasks.workunit.client.0.smithi043.stderr: -237> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): authenticate will time out at 2083.964451s 2024-09-12T00:36:28.079 INFO:tasks.workunit.client.0.smithi043.stderr: -236> 2024-09-12T00:36:27.975+0000 7faaaeba6640 10 monclient(hunting): get_auth_request con 0x559662f2b460 auth_method 0 2024-09-12T00:36:28.079 INFO:tasks.workunit.client.0.smithi043.stderr: -235> 2024-09-12T00:36:27.975+0000 7faaaeba6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:28.080 INFO:tasks.workunit.client.0.smithi043.stderr: -234> 2024-09-12T00:36:27.975+0000 7faaaeba6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:28.080 INFO:tasks.workunit.client.0.smithi043.stderr: -233> 2024-09-12T00:36:27.975+0000 7faaaeba6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:28.080 INFO:tasks.workunit.client.0.smithi043.stderr: -232> 2024-09-12T00:36:27.975+0000 7faaaf3a7640 10 monclient(hunting): get_auth_request con 0x559662f271d0 auth_method 0 2024-09-12T00:36:28.080 INFO:tasks.workunit.client.0.smithi043.stderr: -231> 2024-09-12T00:36:27.975+0000 7faaaf3a7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:28.080 INFO:tasks.workunit.client.0.smithi043.stderr: -230> 2024-09-12T00:36:27.975+0000 7faaaf3a7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:28.080 INFO:tasks.workunit.client.0.smithi043.stderr: -229> 2024-09-12T00:36:27.975+0000 7faaaf3a7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:28.080 INFO:tasks.workunit.client.0.smithi043.stderr: -228> 2024-09-12T00:36:27.975+0000 7faaaeba6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:28.080 INFO:tasks.workunit.client.0.smithi043.stderr: -227> 2024-09-12T00:36:27.975+0000 7faaaeba6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:28.080 INFO:tasks.workunit.client.0.smithi043.stderr: -226> 2024-09-12T00:36:27.975+0000 7faaaeba6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:28.080 INFO:tasks.workunit.client.0.smithi043.stderr: -225> 2024-09-12T00:36:27.975+0000 7faaaf3a7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:28.080 INFO:tasks.workunit.client.0.smithi043.stderr: -224> 2024-09-12T00:36:27.975+0000 7faaaf3a7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:28.080 INFO:tasks.workunit.client.0.smithi043.stderr: -223> 2024-09-12T00:36:27.975+0000 7faaaf3a7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:28.081 INFO:tasks.workunit.client.0.smithi043.stderr: -222> 2024-09-12T00:36:27.975+0000 7faaaeba6640 10 monclient(hunting): handle_auth_done global_id 6288 payload 274 2024-09-12T00:36:28.081 INFO:tasks.workunit.client.0.smithi043.stderr: -221> 2024-09-12T00:36:27.975+0000 7faaaeba6640 10 monclient: _finish_hunting 0 2024-09-12T00:36:28.081 INFO:tasks.workunit.client.0.smithi043.stderr: -220> 2024-09-12T00:36:27.975+0000 7faaaeba6640 1 monclient: found mon.noname-a 2024-09-12T00:36:28.081 INFO:tasks.workunit.client.0.smithi043.stderr: -219> 2024-09-12T00:36:27.975+0000 7faaaeba6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:36:28.081 INFO:tasks.workunit.client.0.smithi043.stderr: -218> 2024-09-12T00:36:27.975+0000 7faaae3a5640 10 monclient: get_auth_request con 0x559662f26850 auth_method 0 2024-09-12T00:36:28.081 INFO:tasks.workunit.client.0.smithi043.stderr: -217> 2024-09-12T00:36:27.975+0000 7fa9927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:28.081 INFO:tasks.workunit.client.0.smithi043.stderr: -216> 2024-09-12T00:36:27.975+0000 7fa9927fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:36:28.081 INFO:tasks.workunit.client.0.smithi043.stderr: -215> 2024-09-12T00:36:27.975+0000 7fa9927fc640 10 monclient: dump: 2024-09-12T00:36:28.081 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:36:28.081 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:36:28.081 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.081 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.081 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:28.082 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:36:28.082 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:36:28.082 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:36:28.082 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:36:28.082 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.082 INFO:tasks.workunit.client.0.smithi043.stderr: -214> 2024-09-12T00:36:27.975+0000 7fa9927fc640 10 monclient: _finish_auth 0 2024-09-12T00:36:28.082 INFO:tasks.workunit.client.0.smithi043.stderr: -213> 2024-09-12T00:36:27.975+0000 7fa9927fc640 10 monclient: _check_auth_tickets 2024-09-12T00:36:28.082 INFO:tasks.workunit.client.0.smithi043.stderr: -212> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 monclient: authenticate success, global_id 6288 2024-09-12T00:36:28.082 INFO:tasks.workunit.client.0.smithi043.stderr: -211> 2024-09-12T00:36:27.975+0000 7fa9927fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:28.083 INFO:tasks.workunit.client.0.smithi043.stderr: -210> 2024-09-12T00:36:27.975+0000 7fa9927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:28.083 INFO:tasks.workunit.client.0.smithi043.stderr: -209> 2024-09-12T00:36:27.975+0000 7fa9927fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:36:28.083 INFO:tasks.workunit.client.0.smithi043.stderr: -208> 2024-09-12T00:36:27.975+0000 7fa9927fc640 10 monclient: dump: 2024-09-12T00:36:28.083 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:36:28.083 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:36:28.083 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.083 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.083 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:28.083 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:36:28.083 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:36:28.083 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:36:28.083 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:36:28.084 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.084 INFO:tasks.workunit.client.0.smithi043.stderr: -207> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient: get_monmap_and_config success 2024-09-12T00:36:28.084 INFO:tasks.workunit.client.0.smithi043.stderr: -206> 2024-09-12T00:36:27.975+0000 7faab10a09c0 4 set_mon_vals no callback set 2024-09-12T00:36:28.084 INFO:tasks.workunit.client.0.smithi043.stderr: -205> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient: shutdown 2024-09-12T00:36:28.084 INFO:tasks.workunit.client.0.smithi043.stderr: -204> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient: build_initial_monmap 2024-09-12T00:36:28.084 INFO:tasks.workunit.client.0.smithi043.stderr: -203> 2024-09-12T00:36:27.975+0000 7faab10a09c0 1 build_initial for_mkfs: 0 2024-09-12T00:36:28.084 INFO:tasks.workunit.client.0.smithi043.stderr: -202> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient: monmap: 2024-09-12T00:36:28.084 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:36:28.084 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:28.084 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:36:28.084 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:36:28.084 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:28.085 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:36:28.085 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:36:28.085 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:36:28.085 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:36:28.085 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.085 INFO:tasks.workunit.client.0.smithi043.stderr: -201> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662f1d840) adding auth protocol: cephx 2024-09-12T00:36:28.085 INFO:tasks.workunit.client.0.smithi043.stderr: -200> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662f1d840) adding auth protocol: cephx 2024-09-12T00:36:28.085 INFO:tasks.workunit.client.0.smithi043.stderr: -199> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662f1d840) adding auth protocol: cephx 2024-09-12T00:36:28.085 INFO:tasks.workunit.client.0.smithi043.stderr: -198> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662f1d840) adding con mode: secure 2024-09-12T00:36:28.085 INFO:tasks.workunit.client.0.smithi043.stderr: -197> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662f1d840) adding con mode: crc 2024-09-12T00:36:28.085 INFO:tasks.workunit.client.0.smithi043.stderr: -196> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662f1d840) adding con mode: secure 2024-09-12T00:36:28.085 INFO:tasks.workunit.client.0.smithi043.stderr: -195> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662f1d840) adding con mode: crc 2024-09-12T00:36:28.085 INFO:tasks.workunit.client.0.smithi043.stderr: -194> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662f1d840) adding con mode: secure 2024-09-12T00:36:28.086 INFO:tasks.workunit.client.0.smithi043.stderr: -193> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662f1d840) adding con mode: crc 2024-09-12T00:36:28.086 INFO:tasks.workunit.client.0.smithi043.stderr: -192> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662f1d840) adding con mode: crc 2024-09-12T00:36:28.086 INFO:tasks.workunit.client.0.smithi043.stderr: -191> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662f1d840) adding con mode: secure 2024-09-12T00:36:28.086 INFO:tasks.workunit.client.0.smithi043.stderr: -190> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662f1d840) adding con mode: crc 2024-09-12T00:36:28.086 INFO:tasks.workunit.client.0.smithi043.stderr: -189> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662f1d840) adding con mode: secure 2024-09-12T00:36:28.086 INFO:tasks.workunit.client.0.smithi043.stderr: -188> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662f1d840) adding con mode: crc 2024-09-12T00:36:28.086 INFO:tasks.workunit.client.0.smithi043.stderr: -187> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662f1d840) adding con mode: secure 2024-09-12T00:36:28.086 INFO:tasks.workunit.client.0.smithi043.stderr: -186> 2024-09-12T00:36:27.975+0000 7faab10a09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:28.086 INFO:tasks.workunit.client.0.smithi043.stderr: -185> 2024-09-12T00:36:27.975+0000 7faab10a09c0 1 librados: starting msgr at 2024-09-12T00:36:28.086 INFO:tasks.workunit.client.0.smithi043.stderr: -184> 2024-09-12T00:36:27.975+0000 7faab10a09c0 1 librados: starting objecter 2024-09-12T00:36:28.086 INFO:tasks.workunit.client.0.smithi043.stderr: -183> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command objecter_requests cmddesc objecter_requests hook 0x559662efc950 EEXIST 2024-09-12T00:36:28.086 INFO:tasks.workunit.client.0.smithi043.stderr: -182> 2024-09-12T00:36:27.975+0000 7faab10a09c0 1 librados: setting wanted keys 2024-09-12T00:36:28.086 INFO:tasks.workunit.client.0.smithi043.stderr: -181> 2024-09-12T00:36:27.975+0000 7faab10a09c0 1 librados: calling monclient init 2024-09-12T00:36:28.087 INFO:tasks.workunit.client.0.smithi043.stderr: -180> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient: init 2024-09-12T00:36:28.087 INFO:tasks.workunit.client.0.smithi043.stderr: -179> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662ed9550) adding auth protocol: cephx 2024-09-12T00:36:28.087 INFO:tasks.workunit.client.0.smithi043.stderr: -178> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662ed9550) adding auth protocol: cephx 2024-09-12T00:36:28.087 INFO:tasks.workunit.client.0.smithi043.stderr: -177> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662ed9550) adding auth protocol: cephx 2024-09-12T00:36:28.087 INFO:tasks.workunit.client.0.smithi043.stderr: -176> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662ed9550) adding con mode: secure 2024-09-12T00:36:28.087 INFO:tasks.workunit.client.0.smithi043.stderr: -175> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662ed9550) adding con mode: crc 2024-09-12T00:36:28.087 INFO:tasks.workunit.client.0.smithi043.stderr: -174> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662ed9550) adding con mode: secure 2024-09-12T00:36:28.087 INFO:tasks.workunit.client.0.smithi043.stderr: -173> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662ed9550) adding con mode: crc 2024-09-12T00:36:28.087 INFO:tasks.workunit.client.0.smithi043.stderr: -172> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662ed9550) adding con mode: secure 2024-09-12T00:36:28.087 INFO:tasks.workunit.client.0.smithi043.stderr: -171> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662ed9550) adding con mode: crc 2024-09-12T00:36:28.087 INFO:tasks.workunit.client.0.smithi043.stderr: -170> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662ed9550) adding con mode: crc 2024-09-12T00:36:28.087 INFO:tasks.workunit.client.0.smithi043.stderr: -169> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662ed9550) adding con mode: secure 2024-09-12T00:36:28.088 INFO:tasks.workunit.client.0.smithi043.stderr: -168> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662ed9550) adding con mode: crc 2024-09-12T00:36:28.088 INFO:tasks.workunit.client.0.smithi043.stderr: -167> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662ed9550) adding con mode: secure 2024-09-12T00:36:28.088 INFO:tasks.workunit.client.0.smithi043.stderr: -166> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662ed9550) adding con mode: crc 2024-09-12T00:36:28.088 INFO:tasks.workunit.client.0.smithi043.stderr: -165> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662ed9550) adding con mode: secure 2024-09-12T00:36:28.088 INFO:tasks.workunit.client.0.smithi043.stderr: -164> 2024-09-12T00:36:27.975+0000 7faab10a09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:28.088 INFO:tasks.workunit.client.0.smithi043.stderr: -163> 2024-09-12T00:36:27.975+0000 7faab10a09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:28.088 INFO:tasks.workunit.client.0.smithi043.stderr: -162> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command rotate-key cmddesc rotate-key hook 0x559662ed9698 EEXIST 2024-09-12T00:36:28.088 INFO:tasks.workunit.client.0.smithi043.stderr: -161> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:28.088 INFO:tasks.workunit.client.0.smithi043.stderr: -160> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:36:28.088 INFO:tasks.workunit.client.0.smithi043.stderr: -159> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): picked mon.noname-b con 0x559662f26850 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:36:28.088 INFO:tasks.workunit.client.0.smithi043.stderr: -158> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): picked mon.noname-c con 0x559662f271d0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:36:28.088 INFO:tasks.workunit.client.0.smithi043.stderr: -157> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): picked mon.noname-a con 0x559662f2b460 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:36:28.089 INFO:tasks.workunit.client.0.smithi043.stderr: -156> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:28.089 INFO:tasks.workunit.client.0.smithi043.stderr: -155> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:28.089 INFO:tasks.workunit.client.0.smithi043.stderr: -154> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:28.089 INFO:tasks.workunit.client.0.smithi043.stderr: -153> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:28.089 INFO:tasks.workunit.client.0.smithi043.stderr: -152> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): authenticate will time out at 2083.967149s 2024-09-12T00:36:28.089 INFO:tasks.workunit.client.0.smithi043.stderr: -151> 2024-09-12T00:36:27.975+0000 7faaae3a5640 10 monclient(hunting): get_auth_request con 0x559662f271d0 auth_method 0 2024-09-12T00:36:28.089 INFO:tasks.workunit.client.0.smithi043.stderr: -150> 2024-09-12T00:36:27.975+0000 7faaae3a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:28.089 INFO:tasks.workunit.client.0.smithi043.stderr: -149> 2024-09-12T00:36:27.975+0000 7faaae3a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:28.089 INFO:tasks.workunit.client.0.smithi043.stderr: -148> 2024-09-12T00:36:27.975+0000 7faaae3a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:28.089 INFO:tasks.workunit.client.0.smithi043.stderr: -147> 2024-09-12T00:36:27.975+0000 7faaaf3a7640 10 monclient(hunting): get_auth_request con 0x559662f2b460 auth_method 0 2024-09-12T00:36:28.089 INFO:tasks.workunit.client.0.smithi043.stderr: -146> 2024-09-12T00:36:27.975+0000 7faaaf3a7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:28.089 INFO:tasks.workunit.client.0.smithi043.stderr: -145> 2024-09-12T00:36:27.975+0000 7faaaf3a7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:28.089 INFO:tasks.workunit.client.0.smithi043.stderr: -144> 2024-09-12T00:36:27.975+0000 7faaaf3a7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:28.090 INFO:tasks.workunit.client.0.smithi043.stderr: -143> 2024-09-12T00:36:27.975+0000 7faaae3a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:28.090 INFO:tasks.workunit.client.0.smithi043.stderr: -142> 2024-09-12T00:36:27.975+0000 7faaae3a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:28.090 INFO:tasks.workunit.client.0.smithi043.stderr: -141> 2024-09-12T00:36:27.975+0000 7faaae3a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:28.090 INFO:tasks.workunit.client.0.smithi043.stderr: -140> 2024-09-12T00:36:27.975+0000 7faaaf3a7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:28.090 INFO:tasks.workunit.client.0.smithi043.stderr: -139> 2024-09-12T00:36:27.975+0000 7faaaf3a7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:28.090 INFO:tasks.workunit.client.0.smithi043.stderr: -138> 2024-09-12T00:36:27.975+0000 7faaaf3a7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:28.090 INFO:tasks.workunit.client.0.smithi043.stderr: -137> 2024-09-12T00:36:27.975+0000 7faaae3a5640 10 monclient(hunting): handle_auth_done global_id 6062 payload 824 2024-09-12T00:36:28.090 INFO:tasks.workunit.client.0.smithi043.stderr: -136> 2024-09-12T00:36:27.975+0000 7faaae3a5640 10 monclient: _finish_hunting 0 2024-09-12T00:36:28.090 INFO:tasks.workunit.client.0.smithi043.stderr: -135> 2024-09-12T00:36:27.975+0000 7faaae3a5640 1 monclient: found mon.noname-c 2024-09-12T00:36:28.090 INFO:tasks.workunit.client.0.smithi043.stderr: -134> 2024-09-12T00:36:27.975+0000 7faaae3a5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:36:28.090 INFO:tasks.workunit.client.0.smithi043.stderr: -133> 2024-09-12T00:36:27.975+0000 7fa990ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:28.090 INFO:tasks.workunit.client.0.smithi043.stderr: -132> 2024-09-12T00:36:27.975+0000 7fa990ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:28.090 INFO:tasks.workunit.client.0.smithi043.stderr: -131> 2024-09-12T00:36:27.975+0000 7fa990ff9640 10 monclient: dump: 2024-09-12T00:36:28.091 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:36:28.091 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:36:28.091 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.091 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.091 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:28.091 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:36:28.091 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:36:28.091 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:36:28.091 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:36:28.091 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.091 INFO:tasks.workunit.client.0.smithi043.stderr: -130> 2024-09-12T00:36:27.975+0000 7fa990ff9640 10 monclient: _finish_auth 0 2024-09-12T00:36:28.091 INFO:tasks.workunit.client.0.smithi043.stderr: -129> 2024-09-12T00:36:27.975+0000 7fa990ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:36:28.092 INFO:tasks.workunit.client.0.smithi043.stderr: -128> 2024-09-12T00:36:27.975+0000 7fa990ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:28.092 INFO:tasks.workunit.client.0.smithi043.stderr: -127> 2024-09-12T00:36:27.975+0000 7fa990ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:28.092 INFO:tasks.workunit.client.0.smithi043.stderr: -126> 2024-09-12T00:36:27.975+0000 7fa990ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:28.092 INFO:tasks.workunit.client.0.smithi043.stderr: -125> 2024-09-12T00:36:27.975+0000 7fa990ff9640 10 monclient: dump: 2024-09-12T00:36:28.092 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:36:28.092 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:36:28.092 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.092 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.092 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:28.092 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:36:28.092 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:36:28.092 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:36:28.092 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:36:28.093 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.093 INFO:tasks.workunit.client.0.smithi043.stderr: -124> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 monclient: authenticate success, global_id 6062 2024-09-12T00:36:28.093 INFO:tasks.workunit.client.0.smithi043.stderr: -123> 2024-09-12T00:36:27.975+0000 7fa9927fc640 4 set_mon_vals no callback set 2024-09-12T00:36:28.093 INFO:tasks.workunit.client.0.smithi043.stderr: -122> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient: _renew_subs 2024-09-12T00:36:28.093 INFO:tasks.workunit.client.0.smithi043.stderr: -121> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:36:28.093 INFO:tasks.workunit.client.0.smithi043.stderr: -120> 2024-09-12T00:36:27.979+0000 7faab10a09c0 10 monclient: _renew_subs 2024-09-12T00:36:28.093 INFO:tasks.workunit.client.0.smithi043.stderr: -119> 2024-09-12T00:36:27.979+0000 7faab10a09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:36:28.093 INFO:tasks.workunit.client.0.smithi043.stderr: -118> 2024-09-12T00:36:27.979+0000 7faab10a09c0 1 librados: init done 2024-09-12T00:36:28.094 INFO:tasks.workunit.client.0.smithi043.stderr: -117> 2024-09-12T00:36:27.979+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command cr dump hook 0x559662f21458 2024-09-12T00:36:28.094 INFO:tasks.workunit.client.0.smithi043.stderr: -116> 2024-09-12T00:36:27.979+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.094 INFO:tasks.workunit.client.0.smithi043.stderr: -115> 2024-09-12T00:36:27.979+0000 7fa990ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:36:28.094 INFO:tasks.workunit.client.0.smithi043.stderr: -114> 2024-09-12T00:36:27.979+0000 7fa990ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:36:28.094 INFO:tasks.workunit.client.0.smithi043.stderr: -113> 2024-09-12T00:36:27.979+0000 7fa990ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:36:28.094 INFO:tasks.workunit.client.0.smithi043.stderr: -112> 2024-09-12T00:36:27.979+0000 7faaaeba6640 10 monclient: get_auth_request con 0x7fa978070b10 auth_method 0 2024-09-12T00:36:28.094 INFO:tasks.workunit.client.0.smithi043.stderr: -111> 2024-09-12T00:36:27.979+0000 7faaaf3a7640 10 monclient: get_auth_request con 0x559662f44ff0 auth_method 0 2024-09-12T00:36:28.094 INFO:tasks.workunit.client.0.smithi043.stderr: -110> 2024-09-12T00:36:27.979+0000 7faab10a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.094 INFO:tasks.workunit.client.0.smithi043.stderr: -109> 2024-09-12T00:36:27.979+0000 7faab10a09c0 20 realm 2024-09-12T00:36:28.094 INFO:tasks.workunit.client.0.smithi043.stderr: -108> 2024-09-12T00:36:27.979+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.094 INFO:tasks.workunit.client.0.smithi043.stderr: -107> 2024-09-12T00:36:27.979+0000 7faab10a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.094 INFO:tasks.workunit.client.0.smithi043.stderr: -106> 2024-09-12T00:36:27.979+0000 7faab10a09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:28.094 INFO:tasks.workunit.client.0.smithi043.stderr: -105> 2024-09-12T00:36:27.979+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.095 INFO:tasks.workunit.client.0.smithi043.stderr: -104> 2024-09-12T00:36:27.979+0000 7faab10a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.095 INFO:tasks.workunit.client.0.smithi043.stderr: -103> 2024-09-12T00:36:27.979+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.095 INFO:tasks.workunit.client.0.smithi043.stderr: -102> 2024-09-12T00:36:27.979+0000 7faaaeba6640 10 monclient: get_auth_request con 0x559662f49330 auth_method 0 2024-09-12T00:36:28.095 INFO:tasks.workunit.client.0.smithi043.stderr: -101> 2024-09-12T00:36:27.983+0000 7faab10a09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:28.095 INFO:tasks.workunit.client.0.smithi043.stderr: -100> 2024-09-12T00:36:27.983+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.095 INFO:tasks.workunit.client.0.smithi043.stderr: -99> 2024-09-12T00:36:27.983+0000 7faaae3a5640 10 monclient: get_auth_request con 0x559662f4ca50 auth_method 0 2024-09-12T00:36:28.095 INFO:tasks.workunit.client.0.smithi043.stderr: -98> 2024-09-12T00:36:27.983+0000 7faab10a09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:28.095 INFO:tasks.workunit.client.0.smithi043.stderr: -97> 2024-09-12T00:36:27.983+0000 7faab10a09c0 20 searching for the correct realm 2024-09-12T00:36:28.095 INFO:tasks.workunit.client.0.smithi043.stderr: -96> 2024-09-12T00:36:27.983+0000 7faaaf3a7640 10 monclient: get_auth_request con 0x559662f517d0 auth_method 0 2024-09-12T00:36:28.095 INFO:tasks.workunit.client.0.smithi043.stderr: -95> 2024-09-12T00:36:27.983+0000 7faaaeba6640 10 monclient: get_auth_request con 0x7faaa802e020 auth_method 0 2024-09-12T00:36:28.095 INFO:tasks.workunit.client.0.smithi043.stderr: -94> 2024-09-12T00:36:27.987+0000 7faaae3a5640 10 monclient: get_auth_request con 0x7faaa400e070 auth_method 0 2024-09-12T00:36:28.095 INFO:tasks.workunit.client.0.smithi043.stderr: -93> 2024-09-12T00:36:27.987+0000 7faaaf3a7640 0 -- 172.21.15.43:0/4163552575 >> [v2:172.21.15.43:6808/2258408181,v1:172.21.15.43:6809/2258408181] conn(0x559662f517d0 msgr2=0x559662f53c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:28.096 INFO:tasks.workunit.client.0.smithi043.stderr: -92> 2024-09-12T00:36:27.987+0000 7fa990ff9640 1 client.6062.objecter ms_handle_reset 0x559662f517d0 session 0x559662f51150 osd.3 2024-09-12T00:36:28.096 INFO:tasks.workunit.client.0.smithi043.stderr: -91> 2024-09-12T00:36:27.987+0000 7fa990ff9640 10 monclient: _renew_subs 2024-09-12T00:36:28.096 INFO:tasks.workunit.client.0.smithi043.stderr: -90> 2024-09-12T00:36:27.987+0000 7fa990ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:36:28.096 INFO:tasks.workunit.client.0.smithi043.stderr: -89> 2024-09-12T00:36:27.987+0000 7faaaf3a7640 10 monclient: get_auth_request con 0x7fa978080bb0 auth_method 0 2024-09-12T00:36:28.096 INFO:tasks.workunit.client.0.smithi043.stderr: -88> 2024-09-12T00:36:27.991+0000 7faaaf3a7640 10 monclient: get_auth_request con 0x7faaa407a3b0 auth_method 0 2024-09-12T00:36:28.096 INFO:tasks.workunit.client.0.smithi043.stderr: -87> 2024-09-12T00:36:27.995+0000 7faaaeba6640 10 monclient: get_auth_request con 0x7faaa406b3b0 auth_method 0 2024-09-12T00:36:28.096 INFO:tasks.workunit.client.0.smithi043.stderr: -86> 2024-09-12T00:36:27.995+0000 7faaaeba6640 0 -- 172.21.15.43:0/4163552575 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7faaa406b3b0 msgr2=0x7faaa407d490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:28.096 INFO:tasks.workunit.client.0.smithi043.stderr: -85> 2024-09-12T00:36:27.995+0000 7fa990ff9640 1 client.6062.objecter ms_handle_reset 0x7faaa406b3b0 session 0x7faaa406b180 osd.0 2024-09-12T00:36:28.096 INFO:tasks.workunit.client.0.smithi043.stderr: -84> 2024-09-12T00:36:27.995+0000 7faaaeba6640 10 monclient: get_auth_request con 0x559662f517d0 auth_method 0 2024-09-12T00:36:28.096 INFO:tasks.workunit.client.0.smithi043.stderr: -83> 2024-09-12T00:36:28.003+0000 7fa990ff9640 1 client.6062.objecter ms_handle_reset 0x559662f49330 session 0x559662f481b0 osd.5 2024-09-12T00:36:28.096 INFO:tasks.workunit.client.0.smithi043.stderr: -82> 2024-09-12T00:36:28.003+0000 7faaaeba6640 10 monclient: get_auth_request con 0x7faaa406b3b0 auth_method 0 2024-09-12T00:36:28.096 INFO:tasks.workunit.client.0.smithi043.stderr: -81> 2024-09-12T00:36:28.003+0000 7faab10a09c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:36:28.097 INFO:tasks.workunit.client.0.smithi043.stderr: -80> 2024-09-12T00:36:28.003+0000 7faab10a09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:28.097 INFO:tasks.workunit.client.0.smithi043.stderr: -79> 2024-09-12T00:36:28.003+0000 7faab10a09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:28.097 INFO:tasks.workunit.client.0.smithi043.stderr: -78> 2024-09-12T00:36:28.003+0000 7faab10a09c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:36:28.097 INFO:tasks.workunit.client.0.smithi043.stderr: -77> 2024-09-12T00:36:28.003+0000 7faab10a09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:28.097 INFO:tasks.workunit.client.0.smithi043.stderr: -76> 2024-09-12T00:36:28.003+0000 7faab10a09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:28.097 INFO:tasks.workunit.client.0.smithi043.stderr: -75> 2024-09-12T00:36:28.003+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.097 INFO:tasks.workunit.client.0.smithi043.stderr: -74> 2024-09-12T00:36:28.003+0000 7faab10a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.097 INFO:tasks.workunit.client.0.smithi043.stderr: -73> 2024-09-12T00:36:28.003+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.097 INFO:tasks.workunit.client.0.smithi043.stderr: -72> 2024-09-12T00:36:28.003+0000 7faab10a09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:28.097 INFO:tasks.workunit.client.0.smithi043.stderr: -71> 2024-09-12T00:36:28.003+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.097 INFO:tasks.workunit.client.0.smithi043.stderr: -70> 2024-09-12T00:36:28.007+0000 7faab10a09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:28.097 INFO:tasks.workunit.client.0.smithi043.stderr: -69> 2024-09-12T00:36:28.007+0000 7faab10a09c0 20 zone default found 2024-09-12T00:36:28.097 INFO:tasks.workunit.client.0.smithi043.stderr: -68> 2024-09-12T00:36:28.007+0000 7faab10a09c0 4 Realm: () 2024-09-12T00:36:28.098 INFO:tasks.workunit.client.0.smithi043.stderr: -67> 2024-09-12T00:36:28.007+0000 7faab10a09c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:36:28.098 INFO:tasks.workunit.client.0.smithi043.stderr: -66> 2024-09-12T00:36:28.007+0000 7faab10a09c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:36:28.098 INFO:tasks.workunit.client.0.smithi043.stderr: -65> 2024-09-12T00:36:28.007+0000 7faab10a09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:28.098 INFO:tasks.workunit.client.0.smithi043.stderr: -64> 2024-09-12T00:36:28.007+0000 7faab10a09c0 20 zonegroup default 2024-09-12T00:36:28.098 INFO:tasks.workunit.client.0.smithi043.stderr: -63> 2024-09-12T00:36:28.007+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.098 INFO:tasks.workunit.client.0.smithi043.stderr: -62> 2024-09-12T00:36:28.007+0000 7faab10a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.098 INFO:tasks.workunit.client.0.smithi043.stderr: -61> 2024-09-12T00:36:28.007+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.098 INFO:tasks.workunit.client.0.smithi043.stderr: -60> 2024-09-12T00:36:28.007+0000 7faab10a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.098 INFO:tasks.workunit.client.0.smithi043.stderr: -59> 2024-09-12T00:36:28.007+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.098 INFO:tasks.workunit.client.0.smithi043.stderr: -58> 2024-09-12T00:36:28.007+0000 7faab10a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.098 INFO:tasks.workunit.client.0.smithi043.stderr: -57> 2024-09-12T00:36:28.007+0000 7faab10a09c0 20 started sync module instance, tier type = 2024-09-12T00:36:28.098 INFO:tasks.workunit.client.0.smithi043.stderr: -56> 2024-09-12T00:36:28.007+0000 7faab10a09c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:36:28.098 INFO:tasks.workunit.client.0.smithi043.stderr: -55> 2024-09-12T00:36:28.023+0000 7faab10a09c0 20 add_watcher() i=0 2024-09-12T00:36:28.099 INFO:tasks.workunit.client.0.smithi043.stderr: -54> 2024-09-12T00:36:28.023+0000 7faab10a09c0 20 add_watcher() i=1 2024-09-12T00:36:28.099 INFO:tasks.workunit.client.0.smithi043.stderr: -53> 2024-09-12T00:36:28.023+0000 7faab10a09c0 20 add_watcher() i=2 2024-09-12T00:36:28.099 INFO:tasks.workunit.client.0.smithi043.stderr: -52> 2024-09-12T00:36:28.023+0000 7faab10a09c0 20 add_watcher() i=3 2024-09-12T00:36:28.099 INFO:tasks.workunit.client.0.smithi043.stderr: -51> 2024-09-12T00:36:28.023+0000 7faab10a09c0 20 add_watcher() i=4 2024-09-12T00:36:28.099 INFO:tasks.workunit.client.0.smithi043.stderr: -50> 2024-09-12T00:36:28.023+0000 7faab10a09c0 20 add_watcher() i=5 2024-09-12T00:36:28.099 INFO:tasks.workunit.client.0.smithi043.stderr: -49> 2024-09-12T00:36:28.023+0000 7faab10a09c0 20 add_watcher() i=6 2024-09-12T00:36:28.099 INFO:tasks.workunit.client.0.smithi043.stderr: -48> 2024-09-12T00:36:28.023+0000 7faab10a09c0 20 add_watcher() i=7 2024-09-12T00:36:28.099 INFO:tasks.workunit.client.0.smithi043.stderr: -47> 2024-09-12T00:36:28.023+0000 7faab10a09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:28.099 INFO:tasks.workunit.client.0.smithi043.stderr: -46> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a7ec0) adding auth protocol: cephx 2024-09-12T00:36:28.099 INFO:tasks.workunit.client.0.smithi043.stderr: -45> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a7ec0) adding auth protocol: cephx 2024-09-12T00:36:28.099 INFO:tasks.workunit.client.0.smithi043.stderr: -44> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a7ec0) adding auth protocol: cephx 2024-09-12T00:36:28.099 INFO:tasks.workunit.client.0.smithi043.stderr: -43> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a7ec0) adding con mode: secure 2024-09-12T00:36:28.099 INFO:tasks.workunit.client.0.smithi043.stderr: -42> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a7ec0) adding con mode: crc 2024-09-12T00:36:28.100 INFO:tasks.workunit.client.0.smithi043.stderr: -41> 2024-09-12T00:36:28.027+0000 7fa9657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:28.100 INFO:tasks.workunit.client.0.smithi043.stderr: -40> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a7ec0) adding con mode: secure 2024-09-12T00:36:28.100 INFO:tasks.workunit.client.0.smithi043.stderr: -39> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a7ec0) adding con mode: crc 2024-09-12T00:36:28.100 INFO:tasks.workunit.client.0.smithi043.stderr: -38> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a7ec0) adding con mode: secure 2024-09-12T00:36:28.100 INFO:tasks.workunit.client.0.smithi043.stderr: -37> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a7ec0) adding con mode: crc 2024-09-12T00:36:28.100 INFO:tasks.workunit.client.0.smithi043.stderr: -36> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a7ec0) adding con mode: crc 2024-09-12T00:36:28.100 INFO:tasks.workunit.client.0.smithi043.stderr: -35> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a7ec0) adding con mode: secure 2024-09-12T00:36:28.100 INFO:tasks.workunit.client.0.smithi043.stderr: -34> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a7ec0) adding con mode: crc 2024-09-12T00:36:28.100 INFO:tasks.workunit.client.0.smithi043.stderr: -33> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a7ec0) adding con mode: secure 2024-09-12T00:36:28.100 INFO:tasks.workunit.client.0.smithi043.stderr: -32> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a7ec0) adding con mode: crc 2024-09-12T00:36:28.100 INFO:tasks.workunit.client.0.smithi043.stderr: -31> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a7ec0) adding con mode: secure 2024-09-12T00:36:28.100 INFO:tasks.workunit.client.0.smithi043.stderr: -30> 2024-09-12T00:36:28.027+0000 7faab10a09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:28.101 INFO:tasks.workunit.client.0.smithi043.stderr: -29> 2024-09-12T00:36:28.027+0000 7faab10a09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:28.101 INFO:tasks.workunit.client.0.smithi043.stderr: -28> 2024-09-12T00:36:28.027+0000 7faab10a09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:28.101 INFO:tasks.workunit.client.0.smithi043.stderr: -27> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command cache list hook 0x559662f1f7e0 2024-09-12T00:36:28.101 INFO:tasks.workunit.client.0.smithi043.stderr: -26> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command cache inspect hook 0x559662f1f7e0 2024-09-12T00:36:28.101 INFO:tasks.workunit.client.0.smithi043.stderr: -25> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command cache erase hook 0x559662f1f7e0 2024-09-12T00:36:28.101 INFO:tasks.workunit.client.0.smithi043.stderr: -24> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command cache zap hook 0x559662f1f7e0 2024-09-12T00:36:28.101 INFO:tasks.workunit.client.0.smithi043.stderr: -23> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 note: GC not initialized 2024-09-12T00:36:28.101 INFO:tasks.workunit.client.0.smithi043.stderr: -22> 2024-09-12T00:36:28.027+0000 7fa8dffff640 20 reqs_thread_entry: start 2024-09-12T00:36:28.101 INFO:tasks.workunit.client.0.smithi043.stderr: -21> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command sync trace show hook 0x7faaa00bc070 2024-09-12T00:36:28.101 INFO:tasks.workunit.client.0.smithi043.stderr: -20> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command sync trace history hook 0x7faaa00bc070 2024-09-12T00:36:28.101 INFO:tasks.workunit.client.0.smithi043.stderr: -19> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command sync trace active hook 0x7faaa00bc070 2024-09-12T00:36:28.101 INFO:tasks.workunit.client.0.smithi043.stderr: -18> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command sync trace active_short hook 0x7faaa00bc070 2024-09-12T00:36:28.101 INFO:tasks.workunit.client.0.smithi043.stderr: -17> 2024-09-12T00:36:28.027+0000 7faab10a09c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:28.102 INFO:tasks.workunit.client.0.smithi043.stderr: -16> 2024-09-12T00:36:28.027+0000 7faab10a09c0 20 Filter name: none 2024-09-12T00:36:28.102 INFO:tasks.workunit.client.0.smithi043.stderr: -15> 2024-09-12T00:36:28.027+0000 7fa8ddffb640 20 reqs_thread_entry: start 2024-09-12T00:36:28.102 INFO:tasks.workunit.client.0.smithi043.stderr: -14> 2024-09-12T00:36:28.027+0000 7faab10a09c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:36:28.102 INFO:tasks.workunit.client.0.smithi043.stderr: -13> 2024-09-12T00:36:28.027+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.102 INFO:tasks.workunit.client.0.smithi043.stderr: -12> 2024-09-12T00:36:28.027+0000 7faab10a09c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:36:28.102 INFO:tasks.workunit.client.0.smithi043.stderr: -11> 2024-09-12T00:36:28.027+0000 7faab10a09c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:36:28.102 INFO:tasks.workunit.client.0.smithi043.stderr: -10> 2024-09-12T00:36:28.027+0000 7faab10a09c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:36:28.102 INFO:tasks.workunit.client.0.smithi043.stderr: -9> 2024-09-12T00:36:28.027+0000 7faab10a09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 : miss 2024-09-12T00:36:28.102 INFO:tasks.workunit.client.0.smithi043.stderr: -8> 2024-09-12T00:36:28.027+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.102 INFO:tasks.workunit.client.0.smithi043.stderr: -7> 2024-09-12T00:36:28.027+0000 7faab10a09c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:36:28.102 INFO:tasks.workunit.client.0.smithi043.stderr: -6> 2024-09-12T00:36:28.027+0000 7faab10a09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 info.flags=0x17 2024-09-12T00:36:28.102 INFO:tasks.workunit.client.0.smithi043.stderr: -5> 2024-09-12T00:36:28.027+0000 7faab10a09c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 to cache LRU end 2024-09-12T00:36:28.103 INFO:tasks.workunit.client.0.smithi043.stderr: -4> 2024-09-12T00:36:28.027+0000 7faab10a09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:28.103 INFO:tasks.workunit.client.0.smithi043.stderr: -3> 2024-09-12T00:36:28.027+0000 7faab10a09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:28.103 INFO:tasks.workunit.client.0.smithi043.stderr: -2> 2024-09-12T00:36:28.027+0000 7faab10a09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 2024-09-12T00:36:28.103 INFO:tasks.workunit.client.0.smithi043.stderr: -1> 2024-09-12T00:36:28.031+0000 7faab10a09c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7faab10a09c0 time 2024-09-12T00:36:28.035253+0000 2024-09-12T00:36:28.103 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:36:28.103 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.103 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:28.103 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7faab497a2eb] 2024-09-12T00:36:28.103 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7faab497a49f] 2024-09-12T00:36:28.103 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559660b81cc1] 2024-09-12T00:36:28.103 INFO:tasks.workunit.client.0.smithi043.stderr: 4: radosgw-admin(+0x1421f32) [0x5596615def32] 2024-09-12T00:36:28.103 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559660b96ced] 2024-09-12T00:36:28.104 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:36:28.104 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7faab37e0d90] 2024-09-12T00:36:28.104 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:36:28.104 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:36:28.104 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.104 INFO:tasks.workunit.client.0.smithi043.stderr: 0> 2024-09-12T00:36:28.035+0000 7faab10a09c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:36:28.104 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7faab10a09c0 thread_name:radosgw-admin 2024-09-12T00:36:28.104 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.104 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:28.104 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7faab37f9520] 2024-09-12T00:36:28.104 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:36:28.104 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:36:28.104 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:36:28.105 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7faab497a345] 2024-09-12T00:36:28.105 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7faab497a49f] 2024-09-12T00:36:28.105 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559660b81cc1] 2024-09-12T00:36:28.105 INFO:tasks.workunit.client.0.smithi043.stderr: 8: radosgw-admin(+0x1421f32) [0x5596615def32] 2024-09-12T00:36:28.105 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559660b96ced] 2024-09-12T00:36:28.105 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:36:28.105 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7faab37e0d90] 2024-09-12T00:36:28.105 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:36:28.105 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:36:28.105 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:36:28.105 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.105 INFO:tasks.workunit.client.0.smithi043.stderr:--- logging levels --- 2024-09-12T00:36:28.105 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 none 2024-09-12T00:36:28.106 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 lockdep 2024-09-12T00:36:28.106 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 context 2024-09-12T00:36:28.106 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 crush 2024-09-12T00:36:28.106 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds 2024-09-12T00:36:28.106 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_balancer 2024-09-12T00:36:28.106 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_locker 2024-09-12T00:36:28.106 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log 2024-09-12T00:36:28.106 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log_expire 2024-09-12T00:36:28.106 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_migrator 2024-09-12T00:36:28.106 INFO:tasks.workunit.client.0.smithi043.stderr: 3/ 5 mds_quiesce 2024-09-12T00:36:28.106 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 buffer 2024-09-12T00:36:28.106 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 timer 2024-09-12T00:36:28.106 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 filer 2024-09-12T00:36:28.106 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 striper 2024-09-12T00:36:28.107 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 objecter 2024-09-12T00:36:28.107 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rados 2024-09-12T00:36:28.107 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd 2024-09-12T00:36:28.107 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_mirror 2024-09-12T00:36:28.107 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_replay 2024-09-12T00:36:28.107 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_pwl 2024-09-12T00:36:28.107 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 journaler 2024-09-12T00:36:28.107 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objectcacher 2024-09-12T00:36:28.107 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:36:28.107 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 client 2024-09-12T00:36:28.107 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 osd 2024-09-12T00:36:28.107 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 optracker 2024-09-12T00:36:28.107 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objclass 2024-09-12T00:36:28.108 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 filestore 2024-09-12T00:36:28.108 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 journal 2024-09-12T00:36:28.108 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 ms 2024-09-12T00:36:28.108 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mon 2024-09-12T00:36:28.108 INFO:tasks.workunit.client.0.smithi043.stderr: 0/10 monc 2024-09-12T00:36:28.108 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 paxos 2024-09-12T00:36:28.108 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 tp 2024-09-12T00:36:28.108 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 auth 2024-09-12T00:36:28.108 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 crypto 2024-09-12T00:36:28.108 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 finisher 2024-09-12T00:36:28.108 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 reserver 2024-09-12T00:36:28.108 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 heartbeatmap 2024-09-12T00:36:28.108 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 perfcounter 2024-09-12T00:36:28.109 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw 2024-09-12T00:36:28.109 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_sync 2024-09-12T00:36:28.109 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_datacache 2024-09-12T00:36:28.109 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_access 2024-09-12T00:36:28.109 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:36:28.109 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_flight 2024-09-12T00:36:28.109 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:36:28.109 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw_notification 2024-09-12T00:36:28.109 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 javaclient 2024-09-12T00:36:28.109 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 asok 2024-09-12T00:36:28.109 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 throttle 2024-09-12T00:36:28.109 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 refs 2024-09-12T00:36:28.109 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 compressor 2024-09-12T00:36:28.110 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluestore 2024-09-12T00:36:28.110 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluefs 2024-09-12T00:36:28.110 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 bdev 2024-09-12T00:36:28.110 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 kstore 2024-09-12T00:36:28.110 INFO:tasks.workunit.client.0.smithi043.stderr: 4/ 5 rocksdb 2024-09-12T00:36:28.110 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 fuse 2024-09-12T00:36:28.110 INFO:tasks.workunit.client.0.smithi043.stderr: 2/ 5 mgr 2024-09-12T00:36:28.110 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mgrc 2024-09-12T00:36:28.110 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 dpdk 2024-09-12T00:36:28.110 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 eventtrace 2024-09-12T00:36:28.110 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 prioritycache 2024-09-12T00:36:28.110 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 test 2024-09-12T00:36:28.111 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:36:28.111 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephsqlite 2024-09-12T00:36:28.111 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:36:28.111 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore 2024-09-12T00:36:28.111 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_onode 2024-09-12T00:36:28.111 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_odata 2024-09-12T00:36:28.111 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_omap 2024-09-12T00:36:28.111 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_tm 2024-09-12T00:36:28.111 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_t 2024-09-12T00:36:28.111 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:36:28.111 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_epm 2024-09-12T00:36:28.111 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_lba 2024-09-12T00:36:28.111 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:36:28.112 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cache 2024-09-12T00:36:28.112 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_journal 2024-09-12T00:36:28.112 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_device 2024-09-12T00:36:28.112 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_backref 2024-09-12T00:36:28.112 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 alienstore 2024-09-12T00:36:28.112 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mclock 2024-09-12T00:36:28.112 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cyanstore 2024-09-12T00:36:28.112 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 ceph_exporter 2024-09-12T00:36:28.112 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 memstore 2024-09-12T00:36:28.112 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 trace 2024-09-12T00:36:28.112 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 ceph_dedup 2024-09-12T00:36:28.112 INFO:tasks.workunit.client.0.smithi043.stderr: -2/-2 (syslog threshold) 2024-09-12T00:36:28.113 INFO:tasks.workunit.client.0.smithi043.stderr: 99/99 (stderr threshold) 2024-09-12T00:36:28.113 INFO:tasks.workunit.client.0.smithi043.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:36:28.113 INFO:tasks.workunit.client.0.smithi043.stderr: 7fa8ddffb640 / http_manager 2024-09-12T00:36:28.113 INFO:tasks.workunit.client.0.smithi043.stderr: 7fa8dffff640 / http_manager 2024-09-12T00:36:28.113 INFO:tasks.workunit.client.0.smithi043.stderr: 7fa9657e2640 / rgw_dt_lg_renew 2024-09-12T00:36:28.113 INFO:tasks.workunit.client.0.smithi043.stderr: 7fa990ff9640 / ms_dispatch 2024-09-12T00:36:28.113 INFO:tasks.workunit.client.0.smithi043.stderr: 7fa9927fc640 / io_context_pool 2024-09-12T00:36:28.113 INFO:tasks.workunit.client.0.smithi043.stderr: 7fa998e01640 / ms_dispatch 2024-09-12T00:36:28.113 INFO:tasks.workunit.client.0.smithi043.stderr: 7fa99b606640 / ms_dispatch 2024-09-12T00:36:28.113 INFO:tasks.workunit.client.0.smithi043.stderr: 7fa99ce09640 / io_context_pool 2024-09-12T00:36:28.113 INFO:tasks.workunit.client.0.smithi043.stderr: 7faaadba4640 / io_context_pool 2024-09-12T00:36:28.113 INFO:tasks.workunit.client.0.smithi043.stderr: 7faaae3a5640 / msgr-worker-2 2024-09-12T00:36:28.113 INFO:tasks.workunit.client.0.smithi043.stderr: 7faaaeba6640 / msgr-worker-1 2024-09-12T00:36:28.114 INFO:tasks.workunit.client.0.smithi043.stderr: 7faaaf3a7640 / msgr-worker-0 2024-09-12T00:36:28.114 INFO:tasks.workunit.client.0.smithi043.stderr: 7faab10a09c0 / radosgw-admin 2024-09-12T00:36:28.114 INFO:tasks.workunit.client.0.smithi043.stderr: max_recent 500 2024-09-12T00:36:28.114 INFO:tasks.workunit.client.0.smithi043.stderr: max_new 1000 2024-09-12T00:36:28.114 INFO:tasks.workunit.client.0.smithi043.stderr: log_file /var/log/ceph/ceph-client.admin.81426.log 2024-09-12T00:36:28.114 INFO:tasks.workunit.client.0.smithi043.stderr:--- end dump of recent events --- 2024-09-12T00:36:28.114 INFO:tasks.workunit.client.0.smithi043.stderr:--- begin dump of recent events --- 2024-09-12T00:36:28.114 INFO:tasks.workunit.client.0.smithi043.stderr: -499> 2024-09-12T00:36:27.959+0000 7faaaeba6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:28.114 INFO:tasks.workunit.client.0.smithi043.stderr: -498> 2024-09-12T00:36:27.959+0000 7faaaf3a7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:28.114 INFO:tasks.workunit.client.0.smithi043.stderr: -497> 2024-09-12T00:36:27.959+0000 7faaaf3a7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:28.114 INFO:tasks.workunit.client.0.smithi043.stderr: -496> 2024-09-12T00:36:27.959+0000 7faaaf3a7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:28.114 INFO:tasks.workunit.client.0.smithi043.stderr: -495> 2024-09-12T00:36:27.959+0000 7faaaeba6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:28.114 INFO:tasks.workunit.client.0.smithi043.stderr: -494> 2024-09-12T00:36:27.959+0000 7faaaeba6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:28.115 INFO:tasks.workunit.client.0.smithi043.stderr: -493> 2024-09-12T00:36:27.959+0000 7faaaeba6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:28.115 INFO:tasks.workunit.client.0.smithi043.stderr: -492> 2024-09-12T00:36:27.959+0000 7faaaf3a7640 10 monclient(hunting): handle_auth_done global_id 6050 payload 274 2024-09-12T00:36:28.115 INFO:tasks.workunit.client.0.smithi043.stderr: -491> 2024-09-12T00:36:27.959+0000 7faaaf3a7640 10 monclient: _finish_hunting 0 2024-09-12T00:36:28.115 INFO:tasks.workunit.client.0.smithi043.stderr: -490> 2024-09-12T00:36:27.959+0000 7faaaf3a7640 1 monclient: found mon.noname-c 2024-09-12T00:36:28.115 INFO:tasks.workunit.client.0.smithi043.stderr: -489> 2024-09-12T00:36:27.959+0000 7faaaf3a7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:36:28.115 INFO:tasks.workunit.client.0.smithi043.stderr: -488> 2024-09-12T00:36:27.959+0000 7faaae3a5640 10 monclient: get_auth_request con 0x559662ceba70 auth_method 0 2024-09-12T00:36:28.115 INFO:tasks.workunit.client.0.smithi043.stderr: -487> 2024-09-12T00:36:27.959+0000 7fa99ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:28.115 INFO:tasks.workunit.client.0.smithi043.stderr: -486> 2024-09-12T00:36:27.959+0000 7fa99ce09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:28.115 INFO:tasks.workunit.client.0.smithi043.stderr: -485> 2024-09-12T00:36:27.959+0000 7fa99ce09640 10 monclient: dump: 2024-09-12T00:36:28.115 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:36:28.115 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:36:28.115 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.116 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.116 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:28.116 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:36:28.116 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:36:28.116 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:36:28.116 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:36:28.116 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.116 INFO:tasks.workunit.client.0.smithi043.stderr: -484> 2024-09-12T00:36:27.959+0000 7fa99ce09640 10 monclient: _finish_auth 0 2024-09-12T00:36:28.116 INFO:tasks.workunit.client.0.smithi043.stderr: -483> 2024-09-12T00:36:27.959+0000 7fa99ce09640 10 monclient: _check_auth_tickets 2024-09-12T00:36:28.116 INFO:tasks.workunit.client.0.smithi043.stderr: -482> 2024-09-12T00:36:27.959+0000 7fa99ce09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:28.116 INFO:tasks.workunit.client.0.smithi043.stderr: -481> 2024-09-12T00:36:27.959+0000 7fa99ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:28.116 INFO:tasks.workunit.client.0.smithi043.stderr: -480> 2024-09-12T00:36:27.959+0000 7fa99ce09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:28.117 INFO:tasks.workunit.client.0.smithi043.stderr: -479> 2024-09-12T00:36:27.959+0000 7fa99ce09640 10 monclient: dump: 2024-09-12T00:36:28.117 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:36:28.117 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:36:28.117 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.117 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.117 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:28.117 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:36:28.117 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:36:28.117 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:36:28.117 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:36:28.117 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.117 INFO:tasks.workunit.client.0.smithi043.stderr: -478> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 monclient: authenticate success, global_id 6050 2024-09-12T00:36:28.118 INFO:tasks.workunit.client.0.smithi043.stderr: -477> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient: get_monmap_and_config success 2024-09-12T00:36:28.118 INFO:tasks.workunit.client.0.smithi043.stderr: -476> 2024-09-12T00:36:27.959+0000 7faab10a09c0 4 set_mon_vals no callback set 2024-09-12T00:36:28.118 INFO:tasks.workunit.client.0.smithi043.stderr: -475> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient: shutdown 2024-09-12T00:36:28.118 INFO:tasks.workunit.client.0.smithi043.stderr: -474> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 asok(0x559662c512b0) unregister_commands rotate-key 2024-09-12T00:36:28.118 INFO:tasks.workunit.client.0.smithi043.stderr: -473> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient: build_initial_monmap 2024-09-12T00:36:28.118 INFO:tasks.workunit.client.0.smithi043.stderr: -472> 2024-09-12T00:36:27.959+0000 7faab10a09c0 1 build_initial for_mkfs: 0 2024-09-12T00:36:28.118 INFO:tasks.workunit.client.0.smithi043.stderr: -471> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient: monmap: 2024-09-12T00:36:28.118 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:36:28.118 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:28.118 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:36:28.118 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:36:28.118 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:28.118 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:36:28.119 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:36:28.119 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:36:28.119 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:36:28.119 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.119 INFO:tasks.workunit.client.0.smithi043.stderr: -470> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e85820) adding auth protocol: cephx 2024-09-12T00:36:28.119 INFO:tasks.workunit.client.0.smithi043.stderr: -469> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e85820) adding auth protocol: cephx 2024-09-12T00:36:28.119 INFO:tasks.workunit.client.0.smithi043.stderr: -468> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e85820) adding auth protocol: cephx 2024-09-12T00:36:28.119 INFO:tasks.workunit.client.0.smithi043.stderr: -467> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e85820) adding con mode: secure 2024-09-12T00:36:28.119 INFO:tasks.workunit.client.0.smithi043.stderr: -466> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e85820) adding con mode: crc 2024-09-12T00:36:28.119 INFO:tasks.workunit.client.0.smithi043.stderr: -465> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e85820) adding con mode: secure 2024-09-12T00:36:28.119 INFO:tasks.workunit.client.0.smithi043.stderr: -464> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e85820) adding con mode: crc 2024-09-12T00:36:28.119 INFO:tasks.workunit.client.0.smithi043.stderr: -463> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e85820) adding con mode: secure 2024-09-12T00:36:28.119 INFO:tasks.workunit.client.0.smithi043.stderr: -462> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e85820) adding con mode: crc 2024-09-12T00:36:28.120 INFO:tasks.workunit.client.0.smithi043.stderr: -461> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e85820) adding con mode: crc 2024-09-12T00:36:28.120 INFO:tasks.workunit.client.0.smithi043.stderr: -460> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e85820) adding con mode: secure 2024-09-12T00:36:28.120 INFO:tasks.workunit.client.0.smithi043.stderr: -459> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e85820) adding con mode: crc 2024-09-12T00:36:28.120 INFO:tasks.workunit.client.0.smithi043.stderr: -458> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e85820) adding con mode: secure 2024-09-12T00:36:28.120 INFO:tasks.workunit.client.0.smithi043.stderr: -457> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e85820) adding con mode: crc 2024-09-12T00:36:28.120 INFO:tasks.workunit.client.0.smithi043.stderr: -456> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e85820) adding con mode: secure 2024-09-12T00:36:28.120 INFO:tasks.workunit.client.0.smithi043.stderr: -455> 2024-09-12T00:36:27.959+0000 7faab10a09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:28.120 INFO:tasks.workunit.client.0.smithi043.stderr: -454> 2024-09-12T00:36:27.959+0000 7faab10a09c0 1 librados: starting msgr at 2024-09-12T00:36:28.120 INFO:tasks.workunit.client.0.smithi043.stderr: -453> 2024-09-12T00:36:27.959+0000 7faab10a09c0 1 librados: starting objecter 2024-09-12T00:36:28.120 INFO:tasks.workunit.client.0.smithi043.stderr: -452> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command objecter_requests hook 0x559662da4d50 2024-09-12T00:36:28.121 INFO:tasks.workunit.client.0.smithi043.stderr: -451> 2024-09-12T00:36:27.959+0000 7faab10a09c0 1 librados: setting wanted keys 2024-09-12T00:36:28.121 INFO:tasks.workunit.client.0.smithi043.stderr: -450> 2024-09-12T00:36:27.959+0000 7faab10a09c0 1 librados: calling monclient init 2024-09-12T00:36:28.121 INFO:tasks.workunit.client.0.smithi043.stderr: -449> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient: init 2024-09-12T00:36:28.121 INFO:tasks.workunit.client.0.smithi043.stderr: -448> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e5ae00) adding auth protocol: cephx 2024-09-12T00:36:28.121 INFO:tasks.workunit.client.0.smithi043.stderr: -447> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e5ae00) adding auth protocol: cephx 2024-09-12T00:36:28.121 INFO:tasks.workunit.client.0.smithi043.stderr: -446> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e5ae00) adding auth protocol: cephx 2024-09-12T00:36:28.121 INFO:tasks.workunit.client.0.smithi043.stderr: -445> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e5ae00) adding con mode: secure 2024-09-12T00:36:28.121 INFO:tasks.workunit.client.0.smithi043.stderr: -444> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e5ae00) adding con mode: crc 2024-09-12T00:36:28.121 INFO:tasks.workunit.client.0.smithi043.stderr: -443> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e5ae00) adding con mode: secure 2024-09-12T00:36:28.121 INFO:tasks.workunit.client.0.smithi043.stderr: -442> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e5ae00) adding con mode: crc 2024-09-12T00:36:28.121 INFO:tasks.workunit.client.0.smithi043.stderr: -441> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e5ae00) adding con mode: secure 2024-09-12T00:36:28.121 INFO:tasks.workunit.client.0.smithi043.stderr: -440> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e5ae00) adding con mode: crc 2024-09-12T00:36:28.122 INFO:tasks.workunit.client.0.smithi043.stderr: -439> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e5ae00) adding con mode: crc 2024-09-12T00:36:28.122 INFO:tasks.workunit.client.0.smithi043.stderr: -438> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e5ae00) adding con mode: secure 2024-09-12T00:36:28.122 INFO:tasks.workunit.client.0.smithi043.stderr: -437> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e5ae00) adding con mode: crc 2024-09-12T00:36:28.122 INFO:tasks.workunit.client.0.smithi043.stderr: -436> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e5ae00) adding con mode: secure 2024-09-12T00:36:28.122 INFO:tasks.workunit.client.0.smithi043.stderr: -435> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e5ae00) adding con mode: crc 2024-09-12T00:36:28.122 INFO:tasks.workunit.client.0.smithi043.stderr: -434> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 AuthRegistry(0x559662e5ae00) adding con mode: secure 2024-09-12T00:36:28.122 INFO:tasks.workunit.client.0.smithi043.stderr: -433> 2024-09-12T00:36:27.959+0000 7faab10a09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:28.122 INFO:tasks.workunit.client.0.smithi043.stderr: -432> 2024-09-12T00:36:27.959+0000 7faab10a09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:28.122 INFO:tasks.workunit.client.0.smithi043.stderr: -431> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command rotate-key hook 0x559662e5af48 2024-09-12T00:36:28.122 INFO:tasks.workunit.client.0.smithi043.stderr: -430> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:28.122 INFO:tasks.workunit.client.0.smithi043.stderr: -429> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:36:28.122 INFO:tasks.workunit.client.0.smithi043.stderr: -428> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient(hunting): picked mon.noname-a con 0x559662ceb2c0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:36:28.123 INFO:tasks.workunit.client.0.smithi043.stderr: -427> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient(hunting): picked mon.noname-c con 0x559662ceba70 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:36:28.123 INFO:tasks.workunit.client.0.smithi043.stderr: -426> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient(hunting): picked mon.noname-b con 0x559662da12d0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:36:28.123 INFO:tasks.workunit.client.0.smithi043.stderr: -425> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:28.123 INFO:tasks.workunit.client.0.smithi043.stderr: -424> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:28.123 INFO:tasks.workunit.client.0.smithi043.stderr: -423> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:28.123 INFO:tasks.workunit.client.0.smithi043.stderr: -422> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:28.123 INFO:tasks.workunit.client.0.smithi043.stderr: -421> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient(hunting): authenticate will time out at 2083.950810s 2024-09-12T00:36:28.123 INFO:tasks.workunit.client.0.smithi043.stderr: -420> 2024-09-12T00:36:27.959+0000 7faaae3a5640 10 monclient(hunting): get_auth_request con 0x559662ceba70 auth_method 0 2024-09-12T00:36:28.123 INFO:tasks.workunit.client.0.smithi043.stderr: -419> 2024-09-12T00:36:27.959+0000 7faaae3a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:28.123 INFO:tasks.workunit.client.0.smithi043.stderr: -418> 2024-09-12T00:36:27.959+0000 7faaae3a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:28.123 INFO:tasks.workunit.client.0.smithi043.stderr: -417> 2024-09-12T00:36:27.959+0000 7faaae3a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:28.123 INFO:tasks.workunit.client.0.smithi043.stderr: -416> 2024-09-12T00:36:27.959+0000 7faaaeba6640 10 monclient(hunting): get_auth_request con 0x559662ceb2c0 auth_method 0 2024-09-12T00:36:28.124 INFO:tasks.workunit.client.0.smithi043.stderr: -415> 2024-09-12T00:36:27.959+0000 7faaaeba6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:28.124 INFO:tasks.workunit.client.0.smithi043.stderr: -414> 2024-09-12T00:36:27.959+0000 7faaaeba6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:28.124 INFO:tasks.workunit.client.0.smithi043.stderr: -413> 2024-09-12T00:36:27.959+0000 7faaaeba6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:28.124 INFO:tasks.workunit.client.0.smithi043.stderr: -412> 2024-09-12T00:36:27.959+0000 7faaae3a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:28.124 INFO:tasks.workunit.client.0.smithi043.stderr: -411> 2024-09-12T00:36:27.959+0000 7faaae3a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:28.124 INFO:tasks.workunit.client.0.smithi043.stderr: -410> 2024-09-12T00:36:27.959+0000 7faaae3a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:28.124 INFO:tasks.workunit.client.0.smithi043.stderr: -409> 2024-09-12T00:36:27.959+0000 7faaaeba6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:28.124 INFO:tasks.workunit.client.0.smithi043.stderr: -408> 2024-09-12T00:36:27.959+0000 7faaaeba6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:28.124 INFO:tasks.workunit.client.0.smithi043.stderr: -407> 2024-09-12T00:36:27.959+0000 7faaaeba6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:28.124 INFO:tasks.workunit.client.0.smithi043.stderr: -406> 2024-09-12T00:36:27.959+0000 7faaaf3a7640 10 monclient(hunting): get_auth_request con 0x559662da12d0 auth_method 0 2024-09-12T00:36:28.124 INFO:tasks.workunit.client.0.smithi043.stderr: -405> 2024-09-12T00:36:27.959+0000 7faaaf3a7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:28.124 INFO:tasks.workunit.client.0.smithi043.stderr: -404> 2024-09-12T00:36:27.959+0000 7faaaf3a7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:28.125 INFO:tasks.workunit.client.0.smithi043.stderr: -403> 2024-09-12T00:36:27.959+0000 7faaaf3a7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:28.125 INFO:tasks.workunit.client.0.smithi043.stderr: -402> 2024-09-12T00:36:27.959+0000 7faaae3a5640 10 monclient(hunting): handle_auth_done global_id 6053 payload 824 2024-09-12T00:36:28.125 INFO:tasks.workunit.client.0.smithi043.stderr: -401> 2024-09-12T00:36:27.959+0000 7faaae3a5640 10 monclient: _finish_hunting 0 2024-09-12T00:36:28.125 INFO:tasks.workunit.client.0.smithi043.stderr: -400> 2024-09-12T00:36:27.959+0000 7faaae3a5640 1 monclient: found mon.noname-c 2024-09-12T00:36:28.125 INFO:tasks.workunit.client.0.smithi043.stderr: -399> 2024-09-12T00:36:27.959+0000 7faaae3a5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:36:28.125 INFO:tasks.workunit.client.0.smithi043.stderr: -398> 2024-09-12T00:36:27.959+0000 7fa99b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:28.125 INFO:tasks.workunit.client.0.smithi043.stderr: -397> 2024-09-12T00:36:27.959+0000 7fa99b606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:28.125 INFO:tasks.workunit.client.0.smithi043.stderr: -396> 2024-09-12T00:36:27.959+0000 7fa99b606640 10 monclient: dump: 2024-09-12T00:36:28.125 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:36:28.125 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:36:28.125 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.125 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.125 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:28.126 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:36:28.126 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:36:28.126 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:36:28.126 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:36:28.126 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.126 INFO:tasks.workunit.client.0.smithi043.stderr: -395> 2024-09-12T00:36:27.959+0000 7fa99b606640 10 monclient: _finish_auth 0 2024-09-12T00:36:28.126 INFO:tasks.workunit.client.0.smithi043.stderr: -394> 2024-09-12T00:36:27.959+0000 7fa99b606640 10 monclient: _check_auth_tickets 2024-09-12T00:36:28.126 INFO:tasks.workunit.client.0.smithi043.stderr: -393> 2024-09-12T00:36:27.959+0000 7fa99b606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:28.126 INFO:tasks.workunit.client.0.smithi043.stderr: -392> 2024-09-12T00:36:27.959+0000 7fa99b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:28.126 INFO:tasks.workunit.client.0.smithi043.stderr: -391> 2024-09-12T00:36:27.959+0000 7fa99b606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:28.126 INFO:tasks.workunit.client.0.smithi043.stderr: -390> 2024-09-12T00:36:27.959+0000 7fa99b606640 10 monclient: dump: 2024-09-12T00:36:28.126 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:36:28.127 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:36:28.127 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.127 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.127 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:28.127 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:36:28.127 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:36:28.127 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:36:28.127 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:36:28.127 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.127 INFO:tasks.workunit.client.0.smithi043.stderr: -389> 2024-09-12T00:36:27.959+0000 7faab10a09c0 5 monclient: authenticate success, global_id 6053 2024-09-12T00:36:28.127 INFO:tasks.workunit.client.0.smithi043.stderr: -388> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient: _renew_subs 2024-09-12T00:36:28.127 INFO:tasks.workunit.client.0.smithi043.stderr: -387> 2024-09-12T00:36:27.959+0000 7fa99ce09640 4 set_mon_vals no callback set 2024-09-12T00:36:28.127 INFO:tasks.workunit.client.0.smithi043.stderr: -386> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:36:28.128 INFO:tasks.workunit.client.0.smithi043.stderr: -385> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient: _renew_subs 2024-09-12T00:36:28.128 INFO:tasks.workunit.client.0.smithi043.stderr: -384> 2024-09-12T00:36:27.959+0000 7faab10a09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:36:28.128 INFO:tasks.workunit.client.0.smithi043.stderr: -383> 2024-09-12T00:36:27.959+0000 7faab10a09c0 1 librados: init done 2024-09-12T00:36:28.128 INFO:tasks.workunit.client.0.smithi043.stderr: -382> 2024-09-12T00:36:27.963+0000 7fa99b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:36:28.128 INFO:tasks.workunit.client.0.smithi043.stderr: -381> 2024-09-12T00:36:27.963+0000 7fa99b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:36:28.128 INFO:tasks.workunit.client.0.smithi043.stderr: -380> 2024-09-12T00:36:27.963+0000 7fa99b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:36:28.128 INFO:tasks.workunit.client.0.smithi043.stderr: -379> 2024-09-12T00:36:27.963+0000 7faaaeba6640 10 monclient: get_auth_request con 0x7fa994070c80 auth_method 0 2024-09-12T00:36:28.128 INFO:tasks.workunit.client.0.smithi043.stderr: -378> 2024-09-12T00:36:27.963+0000 7faaaf3a7640 10 monclient: get_auth_request con 0x559662e83740 auth_method 0 2024-09-12T00:36:28.128 INFO:tasks.workunit.client.0.smithi043.stderr: -377> 2024-09-12T00:36:27.963+0000 7faaaeba6640 10 monclient: get_auth_request con 0x559662ea67d0 auth_method 0 2024-09-12T00:36:28.128 INFO:tasks.workunit.client.0.smithi043.stderr: -376> 2024-09-12T00:36:27.967+0000 7faaae3a5640 10 monclient: get_auth_request con 0x559662eaae70 auth_method 0 2024-09-12T00:36:28.128 INFO:tasks.workunit.client.0.smithi043.stderr: -375> 2024-09-12T00:36:27.967+0000 7faab10a09c0 10 monclient: build_initial_monmap 2024-09-12T00:36:28.128 INFO:tasks.workunit.client.0.smithi043.stderr: -374> 2024-09-12T00:36:27.967+0000 7faab10a09c0 1 build_initial for_mkfs: 0 2024-09-12T00:36:28.129 INFO:tasks.workunit.client.0.smithi043.stderr: -373> 2024-09-12T00:36:27.967+0000 7faab10a09c0 10 monclient: monmap: 2024-09-12T00:36:28.129 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:36:28.129 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:28.129 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:36:28.129 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:36:28.129 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:28.129 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:36:28.129 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:36:28.129 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:36:28.130 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:36:28.130 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.130 INFO:tasks.workunit.client.0.smithi043.stderr: -372> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eafc60) adding auth protocol: cephx 2024-09-12T00:36:28.130 INFO:tasks.workunit.client.0.smithi043.stderr: -371> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eafc60) adding auth protocol: cephx 2024-09-12T00:36:28.130 INFO:tasks.workunit.client.0.smithi043.stderr: -370> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eafc60) adding auth protocol: cephx 2024-09-12T00:36:28.130 INFO:tasks.workunit.client.0.smithi043.stderr: -369> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eafc60) adding con mode: secure 2024-09-12T00:36:28.130 INFO:tasks.workunit.client.0.smithi043.stderr: -368> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eafc60) adding con mode: crc 2024-09-12T00:36:28.130 INFO:tasks.workunit.client.0.smithi043.stderr: -367> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eafc60) adding con mode: secure 2024-09-12T00:36:28.130 INFO:tasks.workunit.client.0.smithi043.stderr: -366> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eafc60) adding con mode: crc 2024-09-12T00:36:28.130 INFO:tasks.workunit.client.0.smithi043.stderr: -365> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eafc60) adding con mode: secure 2024-09-12T00:36:28.130 INFO:tasks.workunit.client.0.smithi043.stderr: -364> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eafc60) adding con mode: crc 2024-09-12T00:36:28.130 INFO:tasks.workunit.client.0.smithi043.stderr: -363> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eafc60) adding con mode: crc 2024-09-12T00:36:28.131 INFO:tasks.workunit.client.0.smithi043.stderr: -362> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eafc60) adding con mode: secure 2024-09-12T00:36:28.131 INFO:tasks.workunit.client.0.smithi043.stderr: -361> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eafc60) adding con mode: crc 2024-09-12T00:36:28.131 INFO:tasks.workunit.client.0.smithi043.stderr: -360> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eafc60) adding con mode: secure 2024-09-12T00:36:28.131 INFO:tasks.workunit.client.0.smithi043.stderr: -359> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eafc60) adding con mode: crc 2024-09-12T00:36:28.131 INFO:tasks.workunit.client.0.smithi043.stderr: -358> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eafc60) adding con mode: secure 2024-09-12T00:36:28.131 INFO:tasks.workunit.client.0.smithi043.stderr: -357> 2024-09-12T00:36:27.967+0000 7faab10a09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:28.131 INFO:tasks.workunit.client.0.smithi043.stderr: -356> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command objecter_requests cmddesc objecter_requests hook 0x559662eb3580 EEXIST 2024-09-12T00:36:28.131 INFO:tasks.workunit.client.0.smithi043.stderr: -355> 2024-09-12T00:36:27.967+0000 7faab10a09c0 10 monclient: init 2024-09-12T00:36:28.131 INFO:tasks.workunit.client.0.smithi043.stderr: -354> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eae278) adding auth protocol: cephx 2024-09-12T00:36:28.131 INFO:tasks.workunit.client.0.smithi043.stderr: -353> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eae278) adding auth protocol: cephx 2024-09-12T00:36:28.131 INFO:tasks.workunit.client.0.smithi043.stderr: -352> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eae278) adding auth protocol: cephx 2024-09-12T00:36:28.131 INFO:tasks.workunit.client.0.smithi043.stderr: -351> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eae278) adding con mode: secure 2024-09-12T00:36:28.131 INFO:tasks.workunit.client.0.smithi043.stderr: -350> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eae278) adding con mode: crc 2024-09-12T00:36:28.132 INFO:tasks.workunit.client.0.smithi043.stderr: -349> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eae278) adding con mode: secure 2024-09-12T00:36:28.132 INFO:tasks.workunit.client.0.smithi043.stderr: -348> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eae278) adding con mode: crc 2024-09-12T00:36:28.132 INFO:tasks.workunit.client.0.smithi043.stderr: -347> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eae278) adding con mode: secure 2024-09-12T00:36:28.132 INFO:tasks.workunit.client.0.smithi043.stderr: -346> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eae278) adding con mode: crc 2024-09-12T00:36:28.132 INFO:tasks.workunit.client.0.smithi043.stderr: -345> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eae278) adding con mode: crc 2024-09-12T00:36:28.132 INFO:tasks.workunit.client.0.smithi043.stderr: -344> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eae278) adding con mode: secure 2024-09-12T00:36:28.132 INFO:tasks.workunit.client.0.smithi043.stderr: -343> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eae278) adding con mode: crc 2024-09-12T00:36:28.132 INFO:tasks.workunit.client.0.smithi043.stderr: -342> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eae278) adding con mode: secure 2024-09-12T00:36:28.132 INFO:tasks.workunit.client.0.smithi043.stderr: -341> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eae278) adding con mode: crc 2024-09-12T00:36:28.132 INFO:tasks.workunit.client.0.smithi043.stderr: -340> 2024-09-12T00:36:27.967+0000 7faab10a09c0 5 AuthRegistry(0x559662eae278) adding con mode: secure 2024-09-12T00:36:28.132 INFO:tasks.workunit.client.0.smithi043.stderr: -339> 2024-09-12T00:36:27.967+0000 7faab10a09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:28.132 INFO:tasks.workunit.client.0.smithi043.stderr: -338> 2024-09-12T00:36:27.971+0000 7faab10a09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:28.133 INFO:tasks.workunit.client.0.smithi043.stderr: -337> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command rotate-key cmddesc rotate-key hook 0x559662eae3c0 EEXIST 2024-09-12T00:36:28.133 INFO:tasks.workunit.client.0.smithi043.stderr: -336> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:28.133 INFO:tasks.workunit.client.0.smithi043.stderr: -335> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:36:28.133 INFO:tasks.workunit.client.0.smithi043.stderr: -334> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient(hunting): picked mon.noname-c con 0x559662ed7730 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:36:28.133 INFO:tasks.workunit.client.0.smithi043.stderr: -333> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient(hunting): picked mon.noname-b con 0x559662ed7060 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:36:28.133 INFO:tasks.workunit.client.0.smithi043.stderr: -332> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient(hunting): picked mon.noname-a con 0x559662ed5a40 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:36:28.133 INFO:tasks.workunit.client.0.smithi043.stderr: -331> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:28.133 INFO:tasks.workunit.client.0.smithi043.stderr: -330> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:28.133 INFO:tasks.workunit.client.0.smithi043.stderr: -329> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:28.133 INFO:tasks.workunit.client.0.smithi043.stderr: -328> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:28.133 INFO:tasks.workunit.client.0.smithi043.stderr: -327> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient(hunting): authenticate will time out at 2083.960217s 2024-09-12T00:36:28.133 INFO:tasks.workunit.client.0.smithi043.stderr: -326> 2024-09-12T00:36:27.971+0000 7faaaeba6640 10 monclient(hunting): get_auth_request con 0x559662ed7730 auth_method 0 2024-09-12T00:36:28.133 INFO:tasks.workunit.client.0.smithi043.stderr: -325> 2024-09-12T00:36:27.971+0000 7faaaeba6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:28.134 INFO:tasks.workunit.client.0.smithi043.stderr: -324> 2024-09-12T00:36:27.971+0000 7faaaeba6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:28.134 INFO:tasks.workunit.client.0.smithi043.stderr: -323> 2024-09-12T00:36:27.971+0000 7faaaeba6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:28.134 INFO:tasks.workunit.client.0.smithi043.stderr: -322> 2024-09-12T00:36:27.971+0000 7faaaf3a7640 10 monclient(hunting): get_auth_request con 0x559662ed5a40 auth_method 0 2024-09-12T00:36:28.134 INFO:tasks.workunit.client.0.smithi043.stderr: -321> 2024-09-12T00:36:27.971+0000 7faaaf3a7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:28.134 INFO:tasks.workunit.client.0.smithi043.stderr: -320> 2024-09-12T00:36:27.971+0000 7faaaf3a7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:28.134 INFO:tasks.workunit.client.0.smithi043.stderr: -319> 2024-09-12T00:36:27.971+0000 7faaaf3a7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:28.134 INFO:tasks.workunit.client.0.smithi043.stderr: -318> 2024-09-12T00:36:27.971+0000 7faaaf3a7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:28.134 INFO:tasks.workunit.client.0.smithi043.stderr: -317> 2024-09-12T00:36:27.971+0000 7faaaf3a7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:28.134 INFO:tasks.workunit.client.0.smithi043.stderr: -316> 2024-09-12T00:36:27.971+0000 7faaaf3a7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:28.134 INFO:tasks.workunit.client.0.smithi043.stderr: -315> 2024-09-12T00:36:27.971+0000 7faaaeba6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:28.134 INFO:tasks.workunit.client.0.smithi043.stderr: -314> 2024-09-12T00:36:27.971+0000 7faaaeba6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:28.134 INFO:tasks.workunit.client.0.smithi043.stderr: -313> 2024-09-12T00:36:27.971+0000 7faaaeba6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:28.134 INFO:tasks.workunit.client.0.smithi043.stderr: -312> 2024-09-12T00:36:27.971+0000 7faaae3a5640 10 monclient(hunting): get_auth_request con 0x559662ed7060 auth_method 0 2024-09-12T00:36:28.135 INFO:tasks.workunit.client.0.smithi043.stderr: -311> 2024-09-12T00:36:27.971+0000 7faaae3a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:28.135 INFO:tasks.workunit.client.0.smithi043.stderr: -310> 2024-09-12T00:36:27.971+0000 7faaae3a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:28.135 INFO:tasks.workunit.client.0.smithi043.stderr: -309> 2024-09-12T00:36:27.971+0000 7faaae3a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:28.135 INFO:tasks.workunit.client.0.smithi043.stderr: -308> 2024-09-12T00:36:27.971+0000 7faaaf3a7640 10 monclient(hunting): handle_auth_done global_id 6285 payload 824 2024-09-12T00:36:28.135 INFO:tasks.workunit.client.0.smithi043.stderr: -307> 2024-09-12T00:36:27.971+0000 7faaaf3a7640 10 monclient: _finish_hunting 0 2024-09-12T00:36:28.135 INFO:tasks.workunit.client.0.smithi043.stderr: -306> 2024-09-12T00:36:27.971+0000 7faaaf3a7640 1 monclient: found mon.noname-a 2024-09-12T00:36:28.135 INFO:tasks.workunit.client.0.smithi043.stderr: -305> 2024-09-12T00:36:27.971+0000 7faaaf3a7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:36:28.135 INFO:tasks.workunit.client.0.smithi043.stderr: -304> 2024-09-12T00:36:27.971+0000 7fa998e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:28.135 INFO:tasks.workunit.client.0.smithi043.stderr: -303> 2024-09-12T00:36:27.971+0000 7fa998e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:36:28.135 INFO:tasks.workunit.client.0.smithi043.stderr: -302> 2024-09-12T00:36:27.971+0000 7fa998e01640 10 monclient: dump: 2024-09-12T00:36:28.135 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:36:28.135 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:36:28.135 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.136 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.136 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:28.136 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:36:28.136 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:36:28.136 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:36:28.136 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:36:28.136 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.136 INFO:tasks.workunit.client.0.smithi043.stderr: -301> 2024-09-12T00:36:27.971+0000 7fa998e01640 10 monclient: _finish_auth 0 2024-09-12T00:36:28.136 INFO:tasks.workunit.client.0.smithi043.stderr: -300> 2024-09-12T00:36:27.971+0000 7fa998e01640 10 monclient: _check_auth_tickets 2024-09-12T00:36:28.136 INFO:tasks.workunit.client.0.smithi043.stderr: -299> 2024-09-12T00:36:27.971+0000 7fa998e01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:28.136 INFO:tasks.workunit.client.0.smithi043.stderr: -298> 2024-09-12T00:36:27.971+0000 7fa998e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:28.136 INFO:tasks.workunit.client.0.smithi043.stderr: -297> 2024-09-12T00:36:27.971+0000 7fa998e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:36:28.136 INFO:tasks.workunit.client.0.smithi043.stderr: -296> 2024-09-12T00:36:27.971+0000 7fa998e01640 10 monclient: dump: 2024-09-12T00:36:28.137 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:36:28.137 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:36:28.137 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.137 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.137 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:28.137 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:36:28.137 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:36:28.137 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:36:28.137 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:36:28.137 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.137 INFO:tasks.workunit.client.0.smithi043.stderr: -295> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 monclient: authenticate success, global_id 6285 2024-09-12T00:36:28.137 INFO:tasks.workunit.client.0.smithi043.stderr: -294> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient: _renew_subs 2024-09-12T00:36:28.137 INFO:tasks.workunit.client.0.smithi043.stderr: -293> 2024-09-12T00:36:27.971+0000 7faaadba4640 4 set_mon_vals no callback set 2024-09-12T00:36:28.138 INFO:tasks.workunit.client.0.smithi043.stderr: -292> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:36:28.138 INFO:tasks.workunit.client.0.smithi043.stderr: -291> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient: _renew_subs 2024-09-12T00:36:28.138 INFO:tasks.workunit.client.0.smithi043.stderr: -290> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:36:28.138 INFO:tasks.workunit.client.0.smithi043.stderr: -289> 2024-09-12T00:36:27.971+0000 7fa998e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:36:28.138 INFO:tasks.workunit.client.0.smithi043.stderr: -288> 2024-09-12T00:36:27.971+0000 7fa998e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:36:28.138 INFO:tasks.workunit.client.0.smithi043.stderr: -287> 2024-09-12T00:36:27.971+0000 7fa998e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:36:28.138 INFO:tasks.workunit.client.0.smithi043.stderr: -286> 2024-09-12T00:36:27.971+0000 7faaaeba6640 10 monclient: get_auth_request con 0x7fa988070a20 auth_method 0 2024-09-12T00:36:28.138 INFO:tasks.workunit.client.0.smithi043.stderr: -285> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient: get_monmap_and_config 2024-09-12T00:36:28.138 INFO:tasks.workunit.client.0.smithi043.stderr: -284> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient: build_initial_monmap 2024-09-12T00:36:28.138 INFO:tasks.workunit.client.0.smithi043.stderr: -283> 2024-09-12T00:36:27.971+0000 7faab10a09c0 1 build_initial for_mkfs: 0 2024-09-12T00:36:28.138 INFO:tasks.workunit.client.0.smithi043.stderr: -282> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient: monmap: 2024-09-12T00:36:28.138 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:36:28.139 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:28.139 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:36:28.139 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:36:28.139 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:28.139 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:36:28.139 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:36:28.139 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:36:28.139 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:36:28.139 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.139 INFO:tasks.workunit.client.0.smithi043.stderr: -281> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x559662ef6f40) adding auth protocol: cephx 2024-09-12T00:36:28.139 INFO:tasks.workunit.client.0.smithi043.stderr: -280> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x559662ef6f40) adding auth protocol: cephx 2024-09-12T00:36:28.139 INFO:tasks.workunit.client.0.smithi043.stderr: -279> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x559662ef6f40) adding auth protocol: cephx 2024-09-12T00:36:28.139 INFO:tasks.workunit.client.0.smithi043.stderr: -278> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x559662ef6f40) adding con mode: secure 2024-09-12T00:36:28.139 INFO:tasks.workunit.client.0.smithi043.stderr: -277> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x559662ef6f40) adding con mode: crc 2024-09-12T00:36:28.140 INFO:tasks.workunit.client.0.smithi043.stderr: -276> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x559662ef6f40) adding con mode: secure 2024-09-12T00:36:28.140 INFO:tasks.workunit.client.0.smithi043.stderr: -275> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x559662ef6f40) adding con mode: crc 2024-09-12T00:36:28.140 INFO:tasks.workunit.client.0.smithi043.stderr: -274> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x559662ef6f40) adding con mode: secure 2024-09-12T00:36:28.140 INFO:tasks.workunit.client.0.smithi043.stderr: -273> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x559662ef6f40) adding con mode: crc 2024-09-12T00:36:28.140 INFO:tasks.workunit.client.0.smithi043.stderr: -272> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x559662ef6f40) adding con mode: crc 2024-09-12T00:36:28.140 INFO:tasks.workunit.client.0.smithi043.stderr: -271> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x559662ef6f40) adding con mode: secure 2024-09-12T00:36:28.140 INFO:tasks.workunit.client.0.smithi043.stderr: -270> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x559662ef6f40) adding con mode: crc 2024-09-12T00:36:28.140 INFO:tasks.workunit.client.0.smithi043.stderr: -269> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x559662ef6f40) adding con mode: secure 2024-09-12T00:36:28.140 INFO:tasks.workunit.client.0.smithi043.stderr: -268> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x559662ef6f40) adding con mode: crc 2024-09-12T00:36:28.140 INFO:tasks.workunit.client.0.smithi043.stderr: -267> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x559662ef6f40) adding con mode: secure 2024-09-12T00:36:28.140 INFO:tasks.workunit.client.0.smithi043.stderr: -266> 2024-09-12T00:36:27.971+0000 7faab10a09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:28.140 INFO:tasks.workunit.client.0.smithi043.stderr: -265> 2024-09-12T00:36:27.971+0000 7faab10a09c0 10 monclient: init 2024-09-12T00:36:28.141 INFO:tasks.workunit.client.0.smithi043.stderr: -264> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a79e0) adding auth protocol: cephx 2024-09-12T00:36:28.141 INFO:tasks.workunit.client.0.smithi043.stderr: -263> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a79e0) adding auth protocol: cephx 2024-09-12T00:36:28.141 INFO:tasks.workunit.client.0.smithi043.stderr: -262> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a79e0) adding auth protocol: cephx 2024-09-12T00:36:28.141 INFO:tasks.workunit.client.0.smithi043.stderr: -261> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a79e0) adding con mode: secure 2024-09-12T00:36:28.141 INFO:tasks.workunit.client.0.smithi043.stderr: -260> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a79e0) adding con mode: crc 2024-09-12T00:36:28.141 INFO:tasks.workunit.client.0.smithi043.stderr: -259> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a79e0) adding con mode: secure 2024-09-12T00:36:28.141 INFO:tasks.workunit.client.0.smithi043.stderr: -258> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a79e0) adding con mode: crc 2024-09-12T00:36:28.141 INFO:tasks.workunit.client.0.smithi043.stderr: -257> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a79e0) adding con mode: secure 2024-09-12T00:36:28.141 INFO:tasks.workunit.client.0.smithi043.stderr: -256> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a79e0) adding con mode: crc 2024-09-12T00:36:28.141 INFO:tasks.workunit.client.0.smithi043.stderr: -255> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a79e0) adding con mode: crc 2024-09-12T00:36:28.141 INFO:tasks.workunit.client.0.smithi043.stderr: -254> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a79e0) adding con mode: secure 2024-09-12T00:36:28.141 INFO:tasks.workunit.client.0.smithi043.stderr: -253> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a79e0) adding con mode: crc 2024-09-12T00:36:28.141 INFO:tasks.workunit.client.0.smithi043.stderr: -252> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a79e0) adding con mode: secure 2024-09-12T00:36:28.142 INFO:tasks.workunit.client.0.smithi043.stderr: -251> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a79e0) adding con mode: crc 2024-09-12T00:36:28.142 INFO:tasks.workunit.client.0.smithi043.stderr: -250> 2024-09-12T00:36:27.971+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a79e0) adding con mode: secure 2024-09-12T00:36:28.142 INFO:tasks.workunit.client.0.smithi043.stderr: -249> 2024-09-12T00:36:27.975+0000 7faab10a09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:28.142 INFO:tasks.workunit.client.0.smithi043.stderr: -248> 2024-09-12T00:36:27.975+0000 7faab10a09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:28.142 INFO:tasks.workunit.client.0.smithi043.stderr: -247> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command rotate-key cmddesc rotate-key hook 0x7ffca88a7b28 EEXIST 2024-09-12T00:36:28.142 INFO:tasks.workunit.client.0.smithi043.stderr: -246> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:28.142 INFO:tasks.workunit.client.0.smithi043.stderr: -245> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:36:28.142 INFO:tasks.workunit.client.0.smithi043.stderr: -244> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): picked mon.noname-a con 0x559662f2b460 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:36:28.142 INFO:tasks.workunit.client.0.smithi043.stderr: -243> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): picked mon.noname-b con 0x559662f26850 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:36:28.142 INFO:tasks.workunit.client.0.smithi043.stderr: -242> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): picked mon.noname-c con 0x559662f271d0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:36:28.142 INFO:tasks.workunit.client.0.smithi043.stderr: -241> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:28.142 INFO:tasks.workunit.client.0.smithi043.stderr: -240> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:28.142 INFO:tasks.workunit.client.0.smithi043.stderr: -239> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:28.143 INFO:tasks.workunit.client.0.smithi043.stderr: -238> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:28.143 INFO:tasks.workunit.client.0.smithi043.stderr: -237> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): authenticate will time out at 2083.964451s 2024-09-12T00:36:28.143 INFO:tasks.workunit.client.0.smithi043.stderr: -236> 2024-09-12T00:36:27.975+0000 7faaaeba6640 10 monclient(hunting): get_auth_request con 0x559662f2b460 auth_method 0 2024-09-12T00:36:28.143 INFO:tasks.workunit.client.0.smithi043.stderr: -235> 2024-09-12T00:36:27.975+0000 7faaaeba6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:28.143 INFO:tasks.workunit.client.0.smithi043.stderr: -234> 2024-09-12T00:36:27.975+0000 7faaaeba6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:28.143 INFO:tasks.workunit.client.0.smithi043.stderr: -233> 2024-09-12T00:36:27.975+0000 7faaaeba6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:28.143 INFO:tasks.workunit.client.0.smithi043.stderr: -232> 2024-09-12T00:36:27.975+0000 7faaaf3a7640 10 monclient(hunting): get_auth_request con 0x559662f271d0 auth_method 0 2024-09-12T00:36:28.143 INFO:tasks.workunit.client.0.smithi043.stderr: -231> 2024-09-12T00:36:27.975+0000 7faaaf3a7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:28.143 INFO:tasks.workunit.client.0.smithi043.stderr: -230> 2024-09-12T00:36:27.975+0000 7faaaf3a7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:28.143 INFO:tasks.workunit.client.0.smithi043.stderr: -229> 2024-09-12T00:36:27.975+0000 7faaaf3a7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:28.143 INFO:tasks.workunit.client.0.smithi043.stderr: -228> 2024-09-12T00:36:27.975+0000 7faaaeba6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:28.143 INFO:tasks.workunit.client.0.smithi043.stderr: -227> 2024-09-12T00:36:27.975+0000 7faaaeba6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:28.143 INFO:tasks.workunit.client.0.smithi043.stderr: -226> 2024-09-12T00:36:27.975+0000 7faaaeba6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:28.144 INFO:tasks.workunit.client.0.smithi043.stderr: -225> 2024-09-12T00:36:27.975+0000 7faaaf3a7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:28.144 INFO:tasks.workunit.client.0.smithi043.stderr: -224> 2024-09-12T00:36:27.975+0000 7faaaf3a7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:28.144 INFO:tasks.workunit.client.0.smithi043.stderr: -223> 2024-09-12T00:36:27.975+0000 7faaaf3a7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:28.144 INFO:tasks.workunit.client.0.smithi043.stderr: -222> 2024-09-12T00:36:27.975+0000 7faaaeba6640 10 monclient(hunting): handle_auth_done global_id 6288 payload 274 2024-09-12T00:36:28.144 INFO:tasks.workunit.client.0.smithi043.stderr: -221> 2024-09-12T00:36:27.975+0000 7faaaeba6640 10 monclient: _finish_hunting 0 2024-09-12T00:36:28.144 INFO:tasks.workunit.client.0.smithi043.stderr: -220> 2024-09-12T00:36:27.975+0000 7faaaeba6640 1 monclient: found mon.noname-a 2024-09-12T00:36:28.144 INFO:tasks.workunit.client.0.smithi043.stderr: -219> 2024-09-12T00:36:27.975+0000 7faaaeba6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:36:28.144 INFO:tasks.workunit.client.0.smithi043.stderr: -218> 2024-09-12T00:36:27.975+0000 7faaae3a5640 10 monclient: get_auth_request con 0x559662f26850 auth_method 0 2024-09-12T00:36:28.144 INFO:tasks.workunit.client.0.smithi043.stderr: -217> 2024-09-12T00:36:27.975+0000 7fa9927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:28.144 INFO:tasks.workunit.client.0.smithi043.stderr: -216> 2024-09-12T00:36:27.975+0000 7fa9927fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:36:28.144 INFO:tasks.workunit.client.0.smithi043.stderr: -215> 2024-09-12T00:36:27.975+0000 7fa9927fc640 10 monclient: dump: 2024-09-12T00:36:28.144 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:36:28.144 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:36:28.145 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.145 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.145 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:28.145 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:36:28.145 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:36:28.145 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:36:28.145 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:36:28.145 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.145 INFO:tasks.workunit.client.0.smithi043.stderr: -214> 2024-09-12T00:36:27.975+0000 7fa9927fc640 10 monclient: _finish_auth 0 2024-09-12T00:36:28.145 INFO:tasks.workunit.client.0.smithi043.stderr: -213> 2024-09-12T00:36:27.975+0000 7fa9927fc640 10 monclient: _check_auth_tickets 2024-09-12T00:36:28.145 INFO:tasks.workunit.client.0.smithi043.stderr: -212> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 monclient: authenticate success, global_id 6288 2024-09-12T00:36:28.145 INFO:tasks.workunit.client.0.smithi043.stderr: -211> 2024-09-12T00:36:27.975+0000 7fa9927fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:28.145 INFO:tasks.workunit.client.0.smithi043.stderr: -210> 2024-09-12T00:36:27.975+0000 7fa9927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:28.146 INFO:tasks.workunit.client.0.smithi043.stderr: -209> 2024-09-12T00:36:27.975+0000 7fa9927fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:36:28.146 INFO:tasks.workunit.client.0.smithi043.stderr: -208> 2024-09-12T00:36:27.975+0000 7fa9927fc640 10 monclient: dump: 2024-09-12T00:36:28.146 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:36:28.146 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:36:28.146 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.146 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.146 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:28.146 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:36:28.146 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:36:28.146 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:36:28.146 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:36:28.146 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.146 INFO:tasks.workunit.client.0.smithi043.stderr: -207> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient: get_monmap_and_config success 2024-09-12T00:36:28.147 INFO:tasks.workunit.client.0.smithi043.stderr: -206> 2024-09-12T00:36:27.975+0000 7faab10a09c0 4 set_mon_vals no callback set 2024-09-12T00:36:28.147 INFO:tasks.workunit.client.0.smithi043.stderr: -205> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient: shutdown 2024-09-12T00:36:28.147 INFO:tasks.workunit.client.0.smithi043.stderr: -204> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient: build_initial_monmap 2024-09-12T00:36:28.147 INFO:tasks.workunit.client.0.smithi043.stderr: -203> 2024-09-12T00:36:27.975+0000 7faab10a09c0 1 build_initial for_mkfs: 0 2024-09-12T00:36:28.147 INFO:tasks.workunit.client.0.smithi043.stderr: -202> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient: monmap: 2024-09-12T00:36:28.147 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:36:28.147 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:28.147 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:36:28.147 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:36:28.147 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:28.147 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:36:28.147 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:36:28.147 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:36:28.148 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:36:28.148 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.148 INFO:tasks.workunit.client.0.smithi043.stderr: -201> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662f1d840) adding auth protocol: cephx 2024-09-12T00:36:28.148 INFO:tasks.workunit.client.0.smithi043.stderr: -200> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662f1d840) adding auth protocol: cephx 2024-09-12T00:36:28.148 INFO:tasks.workunit.client.0.smithi043.stderr: -199> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662f1d840) adding auth protocol: cephx 2024-09-12T00:36:28.148 INFO:tasks.workunit.client.0.smithi043.stderr: -198> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662f1d840) adding con mode: secure 2024-09-12T00:36:28.148 INFO:tasks.workunit.client.0.smithi043.stderr: -197> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662f1d840) adding con mode: crc 2024-09-12T00:36:28.148 INFO:tasks.workunit.client.0.smithi043.stderr: -196> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662f1d840) adding con mode: secure 2024-09-12T00:36:28.148 INFO:tasks.workunit.client.0.smithi043.stderr: -195> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662f1d840) adding con mode: crc 2024-09-12T00:36:28.148 INFO:tasks.workunit.client.0.smithi043.stderr: -194> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662f1d840) adding con mode: secure 2024-09-12T00:36:28.148 INFO:tasks.workunit.client.0.smithi043.stderr: -193> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662f1d840) adding con mode: crc 2024-09-12T00:36:28.148 INFO:tasks.workunit.client.0.smithi043.stderr: -192> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662f1d840) adding con mode: crc 2024-09-12T00:36:28.149 INFO:tasks.workunit.client.0.smithi043.stderr: -191> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662f1d840) adding con mode: secure 2024-09-12T00:36:28.149 INFO:tasks.workunit.client.0.smithi043.stderr: -190> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662f1d840) adding con mode: crc 2024-09-12T00:36:28.149 INFO:tasks.workunit.client.0.smithi043.stderr: -189> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662f1d840) adding con mode: secure 2024-09-12T00:36:28.149 INFO:tasks.workunit.client.0.smithi043.stderr: -188> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662f1d840) adding con mode: crc 2024-09-12T00:36:28.149 INFO:tasks.workunit.client.0.smithi043.stderr: -187> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662f1d840) adding con mode: secure 2024-09-12T00:36:28.149 INFO:tasks.workunit.client.0.smithi043.stderr: -186> 2024-09-12T00:36:27.975+0000 7faab10a09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:28.149 INFO:tasks.workunit.client.0.smithi043.stderr: -185> 2024-09-12T00:36:27.975+0000 7faab10a09c0 1 librados: starting msgr at 2024-09-12T00:36:28.149 INFO:tasks.workunit.client.0.smithi043.stderr: -184> 2024-09-12T00:36:27.975+0000 7faab10a09c0 1 librados: starting objecter 2024-09-12T00:36:28.149 INFO:tasks.workunit.client.0.smithi043.stderr: -183> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command objecter_requests cmddesc objecter_requests hook 0x559662efc950 EEXIST 2024-09-12T00:36:28.149 INFO:tasks.workunit.client.0.smithi043.stderr: -182> 2024-09-12T00:36:27.975+0000 7faab10a09c0 1 librados: setting wanted keys 2024-09-12T00:36:28.149 INFO:tasks.workunit.client.0.smithi043.stderr: -181> 2024-09-12T00:36:27.975+0000 7faab10a09c0 1 librados: calling monclient init 2024-09-12T00:36:28.149 INFO:tasks.workunit.client.0.smithi043.stderr: -180> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient: init 2024-09-12T00:36:28.149 INFO:tasks.workunit.client.0.smithi043.stderr: -179> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662ed9550) adding auth protocol: cephx 2024-09-12T00:36:28.150 INFO:tasks.workunit.client.0.smithi043.stderr: -178> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662ed9550) adding auth protocol: cephx 2024-09-12T00:36:28.150 INFO:tasks.workunit.client.0.smithi043.stderr: -177> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662ed9550) adding auth protocol: cephx 2024-09-12T00:36:28.150 INFO:tasks.workunit.client.0.smithi043.stderr: -176> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662ed9550) adding con mode: secure 2024-09-12T00:36:28.150 INFO:tasks.workunit.client.0.smithi043.stderr: -175> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662ed9550) adding con mode: crc 2024-09-12T00:36:28.150 INFO:tasks.workunit.client.0.smithi043.stderr: -174> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662ed9550) adding con mode: secure 2024-09-12T00:36:28.150 INFO:tasks.workunit.client.0.smithi043.stderr: -173> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662ed9550) adding con mode: crc 2024-09-12T00:36:28.150 INFO:tasks.workunit.client.0.smithi043.stderr: -172> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662ed9550) adding con mode: secure 2024-09-12T00:36:28.150 INFO:tasks.workunit.client.0.smithi043.stderr: -171> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662ed9550) adding con mode: crc 2024-09-12T00:36:28.150 INFO:tasks.workunit.client.0.smithi043.stderr: -170> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662ed9550) adding con mode: crc 2024-09-12T00:36:28.150 INFO:tasks.workunit.client.0.smithi043.stderr: -169> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662ed9550) adding con mode: secure 2024-09-12T00:36:28.150 INFO:tasks.workunit.client.0.smithi043.stderr: -168> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662ed9550) adding con mode: crc 2024-09-12T00:36:28.150 INFO:tasks.workunit.client.0.smithi043.stderr: -167> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662ed9550) adding con mode: secure 2024-09-12T00:36:28.150 INFO:tasks.workunit.client.0.smithi043.stderr: -166> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662ed9550) adding con mode: crc 2024-09-12T00:36:28.151 INFO:tasks.workunit.client.0.smithi043.stderr: -165> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 AuthRegistry(0x559662ed9550) adding con mode: secure 2024-09-12T00:36:28.151 INFO:tasks.workunit.client.0.smithi043.stderr: -164> 2024-09-12T00:36:27.975+0000 7faab10a09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:28.151 INFO:tasks.workunit.client.0.smithi043.stderr: -163> 2024-09-12T00:36:27.975+0000 7faab10a09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:28.151 INFO:tasks.workunit.client.0.smithi043.stderr: -162> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command rotate-key cmddesc rotate-key hook 0x559662ed9698 EEXIST 2024-09-12T00:36:28.151 INFO:tasks.workunit.client.0.smithi043.stderr: -161> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:28.151 INFO:tasks.workunit.client.0.smithi043.stderr: -160> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:36:28.151 INFO:tasks.workunit.client.0.smithi043.stderr: -159> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): picked mon.noname-b con 0x559662f26850 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:36:28.151 INFO:tasks.workunit.client.0.smithi043.stderr: -158> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): picked mon.noname-c con 0x559662f271d0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:36:28.151 INFO:tasks.workunit.client.0.smithi043.stderr: -157> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): picked mon.noname-a con 0x559662f2b460 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:36:28.151 INFO:tasks.workunit.client.0.smithi043.stderr: -156> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:28.151 INFO:tasks.workunit.client.0.smithi043.stderr: -155> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:28.151 INFO:tasks.workunit.client.0.smithi043.stderr: -154> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:28.151 INFO:tasks.workunit.client.0.smithi043.stderr: -153> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:28.152 INFO:tasks.workunit.client.0.smithi043.stderr: -152> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient(hunting): authenticate will time out at 2083.967149s 2024-09-12T00:36:28.152 INFO:tasks.workunit.client.0.smithi043.stderr: -151> 2024-09-12T00:36:27.975+0000 7faaae3a5640 10 monclient(hunting): get_auth_request con 0x559662f271d0 auth_method 0 2024-09-12T00:36:28.152 INFO:tasks.workunit.client.0.smithi043.stderr: -150> 2024-09-12T00:36:27.975+0000 7faaae3a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:28.152 INFO:tasks.workunit.client.0.smithi043.stderr: -149> 2024-09-12T00:36:27.975+0000 7faaae3a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:28.152 INFO:tasks.workunit.client.0.smithi043.stderr: -148> 2024-09-12T00:36:27.975+0000 7faaae3a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:28.152 INFO:tasks.workunit.client.0.smithi043.stderr: -147> 2024-09-12T00:36:27.975+0000 7faaaf3a7640 10 monclient(hunting): get_auth_request con 0x559662f2b460 auth_method 0 2024-09-12T00:36:28.152 INFO:tasks.workunit.client.0.smithi043.stderr: -146> 2024-09-12T00:36:27.975+0000 7faaaf3a7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:28.152 INFO:tasks.workunit.client.0.smithi043.stderr: -145> 2024-09-12T00:36:27.975+0000 7faaaf3a7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:28.152 INFO:tasks.workunit.client.0.smithi043.stderr: -144> 2024-09-12T00:36:27.975+0000 7faaaf3a7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:28.152 INFO:tasks.workunit.client.0.smithi043.stderr: -143> 2024-09-12T00:36:27.975+0000 7faaae3a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:28.152 INFO:tasks.workunit.client.0.smithi043.stderr: -142> 2024-09-12T00:36:27.975+0000 7faaae3a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:28.152 INFO:tasks.workunit.client.0.smithi043.stderr: -141> 2024-09-12T00:36:27.975+0000 7faaae3a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:28.152 INFO:tasks.workunit.client.0.smithi043.stderr: -140> 2024-09-12T00:36:27.975+0000 7faaaf3a7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:28.153 INFO:tasks.workunit.client.0.smithi043.stderr: -139> 2024-09-12T00:36:27.975+0000 7faaaf3a7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:28.153 INFO:tasks.workunit.client.0.smithi043.stderr: -138> 2024-09-12T00:36:27.975+0000 7faaaf3a7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:28.153 INFO:tasks.workunit.client.0.smithi043.stderr: -137> 2024-09-12T00:36:27.975+0000 7faaae3a5640 10 monclient(hunting): handle_auth_done global_id 6062 payload 824 2024-09-12T00:36:28.153 INFO:tasks.workunit.client.0.smithi043.stderr: -136> 2024-09-12T00:36:27.975+0000 7faaae3a5640 10 monclient: _finish_hunting 0 2024-09-12T00:36:28.153 INFO:tasks.workunit.client.0.smithi043.stderr: -135> 2024-09-12T00:36:27.975+0000 7faaae3a5640 1 monclient: found mon.noname-c 2024-09-12T00:36:28.153 INFO:tasks.workunit.client.0.smithi043.stderr: -134> 2024-09-12T00:36:27.975+0000 7faaae3a5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:36:28.153 INFO:tasks.workunit.client.0.smithi043.stderr: -133> 2024-09-12T00:36:27.975+0000 7fa990ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:28.153 INFO:tasks.workunit.client.0.smithi043.stderr: -132> 2024-09-12T00:36:27.975+0000 7fa990ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:28.153 INFO:tasks.workunit.client.0.smithi043.stderr: -131> 2024-09-12T00:36:27.975+0000 7fa990ff9640 10 monclient: dump: 2024-09-12T00:36:28.153 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:36:28.153 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:36:28.153 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.153 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.154 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:28.154 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:36:28.154 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:36:28.154 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:36:28.154 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:36:28.154 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.154 INFO:tasks.workunit.client.0.smithi043.stderr: -130> 2024-09-12T00:36:27.975+0000 7fa990ff9640 10 monclient: _finish_auth 0 2024-09-12T00:36:28.154 INFO:tasks.workunit.client.0.smithi043.stderr: -129> 2024-09-12T00:36:27.975+0000 7fa990ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:36:28.154 INFO:tasks.workunit.client.0.smithi043.stderr: -128> 2024-09-12T00:36:27.975+0000 7fa990ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:28.154 INFO:tasks.workunit.client.0.smithi043.stderr: -127> 2024-09-12T00:36:27.975+0000 7fa990ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:28.154 INFO:tasks.workunit.client.0.smithi043.stderr: -126> 2024-09-12T00:36:27.975+0000 7fa990ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:28.154 INFO:tasks.workunit.client.0.smithi043.stderr: -125> 2024-09-12T00:36:27.975+0000 7fa990ff9640 10 monclient: dump: 2024-09-12T00:36:28.155 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:36:28.155 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:36:28.155 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.155 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:36:28.155 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:28.155 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:36:28.155 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:36:28.155 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:36:28.155 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:36:28.155 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.155 INFO:tasks.workunit.client.0.smithi043.stderr: -124> 2024-09-12T00:36:27.975+0000 7faab10a09c0 5 monclient: authenticate success, global_id 6062 2024-09-12T00:36:28.155 INFO:tasks.workunit.client.0.smithi043.stderr: -123> 2024-09-12T00:36:27.975+0000 7fa9927fc640 4 set_mon_vals no callback set 2024-09-12T00:36:28.155 INFO:tasks.workunit.client.0.smithi043.stderr: -122> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient: _renew_subs 2024-09-12T00:36:28.156 INFO:tasks.workunit.client.0.smithi043.stderr: -121> 2024-09-12T00:36:27.975+0000 7faab10a09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:36:28.156 INFO:tasks.workunit.client.0.smithi043.stderr: -120> 2024-09-12T00:36:27.979+0000 7faab10a09c0 10 monclient: _renew_subs 2024-09-12T00:36:28.156 INFO:tasks.workunit.client.0.smithi043.stderr: -119> 2024-09-12T00:36:27.979+0000 7faab10a09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:36:28.156 INFO:tasks.workunit.client.0.smithi043.stderr: -118> 2024-09-12T00:36:27.979+0000 7faab10a09c0 1 librados: init done 2024-09-12T00:36:28.156 INFO:tasks.workunit.client.0.smithi043.stderr: -117> 2024-09-12T00:36:27.979+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command cr dump hook 0x559662f21458 2024-09-12T00:36:28.156 INFO:tasks.workunit.client.0.smithi043.stderr: -116> 2024-09-12T00:36:27.979+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.156 INFO:tasks.workunit.client.0.smithi043.stderr: -115> 2024-09-12T00:36:27.979+0000 7fa990ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:36:28.156 INFO:tasks.workunit.client.0.smithi043.stderr: -114> 2024-09-12T00:36:27.979+0000 7fa990ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:36:28.156 INFO:tasks.workunit.client.0.smithi043.stderr: -113> 2024-09-12T00:36:27.979+0000 7fa990ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:36:28.156 INFO:tasks.workunit.client.0.smithi043.stderr: -112> 2024-09-12T00:36:27.979+0000 7faaaeba6640 10 monclient: get_auth_request con 0x7fa978070b10 auth_method 0 2024-09-12T00:36:28.156 INFO:tasks.workunit.client.0.smithi043.stderr: -111> 2024-09-12T00:36:27.979+0000 7faaaf3a7640 10 monclient: get_auth_request con 0x559662f44ff0 auth_method 0 2024-09-12T00:36:28.156 INFO:tasks.workunit.client.0.smithi043.stderr: -110> 2024-09-12T00:36:27.979+0000 7faab10a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.157 INFO:tasks.workunit.client.0.smithi043.stderr: -109> 2024-09-12T00:36:27.979+0000 7faab10a09c0 20 realm 2024-09-12T00:36:28.157 INFO:tasks.workunit.client.0.smithi043.stderr: -108> 2024-09-12T00:36:27.979+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.157 INFO:tasks.workunit.client.0.smithi043.stderr: -107> 2024-09-12T00:36:27.979+0000 7faab10a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.157 INFO:tasks.workunit.client.0.smithi043.stderr: -106> 2024-09-12T00:36:27.979+0000 7faab10a09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:28.157 INFO:tasks.workunit.client.0.smithi043.stderr: -105> 2024-09-12T00:36:27.979+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.157 INFO:tasks.workunit.client.0.smithi043.stderr: -104> 2024-09-12T00:36:27.979+0000 7faab10a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.157 INFO:tasks.workunit.client.0.smithi043.stderr: -103> 2024-09-12T00:36:27.979+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.157 INFO:tasks.workunit.client.0.smithi043.stderr: -102> 2024-09-12T00:36:27.979+0000 7faaaeba6640 10 monclient: get_auth_request con 0x559662f49330 auth_method 0 2024-09-12T00:36:28.157 INFO:tasks.workunit.client.0.smithi043.stderr: -101> 2024-09-12T00:36:27.983+0000 7faab10a09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:28.157 INFO:tasks.workunit.client.0.smithi043.stderr: -100> 2024-09-12T00:36:27.983+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.157 INFO:tasks.workunit.client.0.smithi043.stderr: -99> 2024-09-12T00:36:27.983+0000 7faaae3a5640 10 monclient: get_auth_request con 0x559662f4ca50 auth_method 0 2024-09-12T00:36:28.157 INFO:tasks.workunit.client.0.smithi043.stderr: -98> 2024-09-12T00:36:27.983+0000 7faab10a09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:28.157 INFO:tasks.workunit.client.0.smithi043.stderr: -97> 2024-09-12T00:36:27.983+0000 7faab10a09c0 20 searching for the correct realm 2024-09-12T00:36:28.158 INFO:tasks.workunit.client.0.smithi043.stderr: -96> 2024-09-12T00:36:27.983+0000 7faaaf3a7640 10 monclient: get_auth_request con 0x559662f517d0 auth_method 0 2024-09-12T00:36:28.158 INFO:tasks.workunit.client.0.smithi043.stderr: -95> 2024-09-12T00:36:27.983+0000 7faaaeba6640 10 monclient: get_auth_request con 0x7faaa802e020 auth_method 0 2024-09-12T00:36:28.158 INFO:tasks.workunit.client.0.smithi043.stderr: -94> 2024-09-12T00:36:27.987+0000 7faaae3a5640 10 monclient: get_auth_request con 0x7faaa400e070 auth_method 0 2024-09-12T00:36:28.158 INFO:tasks.workunit.client.0.smithi043.stderr: -93> 2024-09-12T00:36:27.987+0000 7faaaf3a7640 0 -- 172.21.15.43:0/4163552575 >> [v2:172.21.15.43:6808/2258408181,v1:172.21.15.43:6809/2258408181] conn(0x559662f517d0 msgr2=0x559662f53c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:28.158 INFO:tasks.workunit.client.0.smithi043.stderr: -92> 2024-09-12T00:36:27.987+0000 7fa990ff9640 1 client.6062.objecter ms_handle_reset 0x559662f517d0 session 0x559662f51150 osd.3 2024-09-12T00:36:28.158 INFO:tasks.workunit.client.0.smithi043.stderr: -91> 2024-09-12T00:36:27.987+0000 7fa990ff9640 10 monclient: _renew_subs 2024-09-12T00:36:28.158 INFO:tasks.workunit.client.0.smithi043.stderr: -90> 2024-09-12T00:36:27.987+0000 7fa990ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:36:28.158 INFO:tasks.workunit.client.0.smithi043.stderr: -89> 2024-09-12T00:36:27.987+0000 7faaaf3a7640 10 monclient: get_auth_request con 0x7fa978080bb0 auth_method 0 2024-09-12T00:36:28.158 INFO:tasks.workunit.client.0.smithi043.stderr: -88> 2024-09-12T00:36:27.991+0000 7faaaf3a7640 10 monclient: get_auth_request con 0x7faaa407a3b0 auth_method 0 2024-09-12T00:36:28.158 INFO:tasks.workunit.client.0.smithi043.stderr: -87> 2024-09-12T00:36:27.995+0000 7faaaeba6640 10 monclient: get_auth_request con 0x7faaa406b3b0 auth_method 0 2024-09-12T00:36:28.158 INFO:tasks.workunit.client.0.smithi043.stderr: -86> 2024-09-12T00:36:27.995+0000 7faaaeba6640 0 -- 172.21.15.43:0/4163552575 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7faaa406b3b0 msgr2=0x7faaa407d490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:28.158 INFO:tasks.workunit.client.0.smithi043.stderr: -85> 2024-09-12T00:36:27.995+0000 7fa990ff9640 1 client.6062.objecter ms_handle_reset 0x7faaa406b3b0 session 0x7faaa406b180 osd.0 2024-09-12T00:36:28.158 INFO:tasks.workunit.client.0.smithi043.stderr: -84> 2024-09-12T00:36:27.995+0000 7faaaeba6640 10 monclient: get_auth_request con 0x559662f517d0 auth_method 0 2024-09-12T00:36:28.159 INFO:tasks.workunit.client.0.smithi043.stderr: -83> 2024-09-12T00:36:28.003+0000 7fa990ff9640 1 client.6062.objecter ms_handle_reset 0x559662f49330 session 0x559662f481b0 osd.5 2024-09-12T00:36:28.159 INFO:tasks.workunit.client.0.smithi043.stderr: -82> 2024-09-12T00:36:28.003+0000 7faaaeba6640 10 monclient: get_auth_request con 0x7faaa406b3b0 auth_method 0 2024-09-12T00:36:28.159 INFO:tasks.workunit.client.0.smithi043.stderr: -81> 2024-09-12T00:36:28.003+0000 7faab10a09c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:36:28.159 INFO:tasks.workunit.client.0.smithi043.stderr: -80> 2024-09-12T00:36:28.003+0000 7faab10a09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:28.159 INFO:tasks.workunit.client.0.smithi043.stderr: -79> 2024-09-12T00:36:28.003+0000 7faab10a09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:28.159 INFO:tasks.workunit.client.0.smithi043.stderr: -78> 2024-09-12T00:36:28.003+0000 7faab10a09c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:36:28.159 INFO:tasks.workunit.client.0.smithi043.stderr: -77> 2024-09-12T00:36:28.003+0000 7faab10a09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:28.159 INFO:tasks.workunit.client.0.smithi043.stderr: -76> 2024-09-12T00:36:28.003+0000 7faab10a09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:28.159 INFO:tasks.workunit.client.0.smithi043.stderr: -75> 2024-09-12T00:36:28.003+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.159 INFO:tasks.workunit.client.0.smithi043.stderr: -74> 2024-09-12T00:36:28.003+0000 7faab10a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.159 INFO:tasks.workunit.client.0.smithi043.stderr: -73> 2024-09-12T00:36:28.003+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.159 INFO:tasks.workunit.client.0.smithi043.stderr: -72> 2024-09-12T00:36:28.003+0000 7faab10a09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:28.160 INFO:tasks.workunit.client.0.smithi043.stderr: -71> 2024-09-12T00:36:28.003+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.160 INFO:tasks.workunit.client.0.smithi043.stderr: -70> 2024-09-12T00:36:28.007+0000 7faab10a09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:28.160 INFO:tasks.workunit.client.0.smithi043.stderr: -69> 2024-09-12T00:36:28.007+0000 7faab10a09c0 20 zone default found 2024-09-12T00:36:28.160 INFO:tasks.workunit.client.0.smithi043.stderr: -68> 2024-09-12T00:36:28.007+0000 7faab10a09c0 4 Realm: () 2024-09-12T00:36:28.160 INFO:tasks.workunit.client.0.smithi043.stderr: -67> 2024-09-12T00:36:28.007+0000 7faab10a09c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:36:28.160 INFO:tasks.workunit.client.0.smithi043.stderr: -66> 2024-09-12T00:36:28.007+0000 7faab10a09c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:36:28.160 INFO:tasks.workunit.client.0.smithi043.stderr: -65> 2024-09-12T00:36:28.007+0000 7faab10a09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:28.160 INFO:tasks.workunit.client.0.smithi043.stderr: -64> 2024-09-12T00:36:28.007+0000 7faab10a09c0 20 zonegroup default 2024-09-12T00:36:28.160 INFO:tasks.workunit.client.0.smithi043.stderr: -63> 2024-09-12T00:36:28.007+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.160 INFO:tasks.workunit.client.0.smithi043.stderr: -62> 2024-09-12T00:36:28.007+0000 7faab10a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.160 INFO:tasks.workunit.client.0.smithi043.stderr: -61> 2024-09-12T00:36:28.007+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.160 INFO:tasks.workunit.client.0.smithi043.stderr: -60> 2024-09-12T00:36:28.007+0000 7faab10a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.161 INFO:tasks.workunit.client.0.smithi043.stderr: -59> 2024-09-12T00:36:28.007+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.161 INFO:tasks.workunit.client.0.smithi043.stderr: -58> 2024-09-12T00:36:28.007+0000 7faab10a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.161 INFO:tasks.workunit.client.0.smithi043.stderr: -57> 2024-09-12T00:36:28.007+0000 7faab10a09c0 20 started sync module instance, tier type = 2024-09-12T00:36:28.161 INFO:tasks.workunit.client.0.smithi043.stderr: -56> 2024-09-12T00:36:28.007+0000 7faab10a09c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:36:28.161 INFO:tasks.workunit.client.0.smithi043.stderr: -55> 2024-09-12T00:36:28.023+0000 7faab10a09c0 20 add_watcher() i=0 2024-09-12T00:36:28.161 INFO:tasks.workunit.client.0.smithi043.stderr: -54> 2024-09-12T00:36:28.023+0000 7faab10a09c0 20 add_watcher() i=1 2024-09-12T00:36:28.161 INFO:tasks.workunit.client.0.smithi043.stderr: -53> 2024-09-12T00:36:28.023+0000 7faab10a09c0 20 add_watcher() i=2 2024-09-12T00:36:28.161 INFO:tasks.workunit.client.0.smithi043.stderr: -52> 2024-09-12T00:36:28.023+0000 7faab10a09c0 20 add_watcher() i=3 2024-09-12T00:36:28.161 INFO:tasks.workunit.client.0.smithi043.stderr: -51> 2024-09-12T00:36:28.023+0000 7faab10a09c0 20 add_watcher() i=4 2024-09-12T00:36:28.161 INFO:tasks.workunit.client.0.smithi043.stderr: -50> 2024-09-12T00:36:28.023+0000 7faab10a09c0 20 add_watcher() i=5 2024-09-12T00:36:28.161 INFO:tasks.workunit.client.0.smithi043.stderr: -49> 2024-09-12T00:36:28.023+0000 7faab10a09c0 20 add_watcher() i=6 2024-09-12T00:36:28.161 INFO:tasks.workunit.client.0.smithi043.stderr: -48> 2024-09-12T00:36:28.023+0000 7faab10a09c0 20 add_watcher() i=7 2024-09-12T00:36:28.161 INFO:tasks.workunit.client.0.smithi043.stderr: -47> 2024-09-12T00:36:28.023+0000 7faab10a09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:28.162 INFO:tasks.workunit.client.0.smithi043.stderr: -46> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a7ec0) adding auth protocol: cephx 2024-09-12T00:36:28.162 INFO:tasks.workunit.client.0.smithi043.stderr: -45> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a7ec0) adding auth protocol: cephx 2024-09-12T00:36:28.162 INFO:tasks.workunit.client.0.smithi043.stderr: -44> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a7ec0) adding auth protocol: cephx 2024-09-12T00:36:28.162 INFO:tasks.workunit.client.0.smithi043.stderr: -43> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a7ec0) adding con mode: secure 2024-09-12T00:36:28.162 INFO:tasks.workunit.client.0.smithi043.stderr: -42> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a7ec0) adding con mode: crc 2024-09-12T00:36:28.162 INFO:tasks.workunit.client.0.smithi043.stderr: -41> 2024-09-12T00:36:28.027+0000 7fa9657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:28.162 INFO:tasks.workunit.client.0.smithi043.stderr: -40> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a7ec0) adding con mode: secure 2024-09-12T00:36:28.162 INFO:tasks.workunit.client.0.smithi043.stderr: -39> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a7ec0) adding con mode: crc 2024-09-12T00:36:28.162 INFO:tasks.workunit.client.0.smithi043.stderr: -38> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a7ec0) adding con mode: secure 2024-09-12T00:36:28.162 INFO:tasks.workunit.client.0.smithi043.stderr: -37> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a7ec0) adding con mode: crc 2024-09-12T00:36:28.162 INFO:tasks.workunit.client.0.smithi043.stderr: -36> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a7ec0) adding con mode: crc 2024-09-12T00:36:28.162 INFO:tasks.workunit.client.0.smithi043.stderr: -35> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a7ec0) adding con mode: secure 2024-09-12T00:36:28.163 INFO:tasks.workunit.client.0.smithi043.stderr: -34> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a7ec0) adding con mode: crc 2024-09-12T00:36:28.163 INFO:tasks.workunit.client.0.smithi043.stderr: -33> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a7ec0) adding con mode: secure 2024-09-12T00:36:28.163 INFO:tasks.workunit.client.0.smithi043.stderr: -32> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a7ec0) adding con mode: crc 2024-09-12T00:36:28.163 INFO:tasks.workunit.client.0.smithi043.stderr: -31> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 AuthRegistry(0x7ffca88a7ec0) adding con mode: secure 2024-09-12T00:36:28.163 INFO:tasks.workunit.client.0.smithi043.stderr: -30> 2024-09-12T00:36:28.027+0000 7faab10a09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:28.163 INFO:tasks.workunit.client.0.smithi043.stderr: -29> 2024-09-12T00:36:28.027+0000 7faab10a09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:28.163 INFO:tasks.workunit.client.0.smithi043.stderr: -28> 2024-09-12T00:36:28.027+0000 7faab10a09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:28.163 INFO:tasks.workunit.client.0.smithi043.stderr: -27> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command cache list hook 0x559662f1f7e0 2024-09-12T00:36:28.163 INFO:tasks.workunit.client.0.smithi043.stderr: -26> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command cache inspect hook 0x559662f1f7e0 2024-09-12T00:36:28.163 INFO:tasks.workunit.client.0.smithi043.stderr: -25> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command cache erase hook 0x559662f1f7e0 2024-09-12T00:36:28.163 INFO:tasks.workunit.client.0.smithi043.stderr: -24> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command cache zap hook 0x559662f1f7e0 2024-09-12T00:36:28.163 INFO:tasks.workunit.client.0.smithi043.stderr: -23> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 note: GC not initialized 2024-09-12T00:36:28.163 INFO:tasks.workunit.client.0.smithi043.stderr: -22> 2024-09-12T00:36:28.027+0000 7fa8dffff640 20 reqs_thread_entry: start 2024-09-12T00:36:28.164 INFO:tasks.workunit.client.0.smithi043.stderr: -21> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command sync trace show hook 0x7faaa00bc070 2024-09-12T00:36:28.164 INFO:tasks.workunit.client.0.smithi043.stderr: -20> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command sync trace history hook 0x7faaa00bc070 2024-09-12T00:36:28.164 INFO:tasks.workunit.client.0.smithi043.stderr: -19> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command sync trace active hook 0x7faaa00bc070 2024-09-12T00:36:28.164 INFO:tasks.workunit.client.0.smithi043.stderr: -18> 2024-09-12T00:36:28.027+0000 7faab10a09c0 5 asok(0x559662c512b0) register_command sync trace active_short hook 0x7faaa00bc070 2024-09-12T00:36:28.164 INFO:tasks.workunit.client.0.smithi043.stderr: -17> 2024-09-12T00:36:28.027+0000 7faab10a09c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:28.164 INFO:tasks.workunit.client.0.smithi043.stderr: -16> 2024-09-12T00:36:28.027+0000 7faab10a09c0 20 Filter name: none 2024-09-12T00:36:28.164 INFO:tasks.workunit.client.0.smithi043.stderr: -15> 2024-09-12T00:36:28.027+0000 7fa8ddffb640 20 reqs_thread_entry: start 2024-09-12T00:36:28.164 INFO:tasks.workunit.client.0.smithi043.stderr: -14> 2024-09-12T00:36:28.027+0000 7faab10a09c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:36:28.164 INFO:tasks.workunit.client.0.smithi043.stderr: -13> 2024-09-12T00:36:28.027+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.164 INFO:tasks.workunit.client.0.smithi043.stderr: -12> 2024-09-12T00:36:28.027+0000 7faab10a09c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:36:28.164 INFO:tasks.workunit.client.0.smithi043.stderr: -11> 2024-09-12T00:36:28.027+0000 7faab10a09c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:36:28.164 INFO:tasks.workunit.client.0.smithi043.stderr: -10> 2024-09-12T00:36:28.027+0000 7faab10a09c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:36:28.165 INFO:tasks.workunit.client.0.smithi043.stderr: -9> 2024-09-12T00:36:28.027+0000 7faab10a09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 : miss 2024-09-12T00:36:28.165 INFO:tasks.workunit.client.0.smithi043.stderr: -8> 2024-09-12T00:36:28.027+0000 7faab10a09c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.165 INFO:tasks.workunit.client.0.smithi043.stderr: -7> 2024-09-12T00:36:28.027+0000 7faab10a09c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:36:28.165 INFO:tasks.workunit.client.0.smithi043.stderr: -6> 2024-09-12T00:36:28.027+0000 7faab10a09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 info.flags=0x17 2024-09-12T00:36:28.165 INFO:tasks.workunit.client.0.smithi043.stderr: -5> 2024-09-12T00:36:28.027+0000 7faab10a09c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 to cache LRU end 2024-09-12T00:36:28.165 INFO:tasks.workunit.client.0.smithi043.stderr: -4> 2024-09-12T00:36:28.027+0000 7faab10a09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:28.165 INFO:tasks.workunit.client.0.smithi043.stderr: -3> 2024-09-12T00:36:28.027+0000 7faab10a09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:28.165 INFO:tasks.workunit.client.0.smithi043.stderr: -2> 2024-09-12T00:36:28.027+0000 7faab10a09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 2024-09-12T00:36:28.165 INFO:tasks.workunit.client.0.smithi043.stderr: -1> 2024-09-12T00:36:28.031+0000 7faab10a09c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7faab10a09c0 time 2024-09-12T00:36:28.035253+0000 2024-09-12T00:36:28.165 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:36:28.165 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.166 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:28.166 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7faab497a2eb] 2024-09-12T00:36:28.166 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7faab497a49f] 2024-09-12T00:36:28.166 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559660b81cc1] 2024-09-12T00:36:28.166 INFO:tasks.workunit.client.0.smithi043.stderr: 4: radosgw-admin(+0x1421f32) [0x5596615def32] 2024-09-12T00:36:28.166 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559660b96ced] 2024-09-12T00:36:28.166 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:36:28.166 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7faab37e0d90] 2024-09-12T00:36:28.166 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:36:28.166 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:36:28.166 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.166 INFO:tasks.workunit.client.0.smithi043.stderr: 0> 2024-09-12T00:36:28.035+0000 7faab10a09c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:36:28.166 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7faab10a09c0 thread_name:radosgw-admin 2024-09-12T00:36:28.167 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.167 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:28.167 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7faab37f9520] 2024-09-12T00:36:28.167 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:36:28.167 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:36:28.167 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:36:28.167 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7faab497a345] 2024-09-12T00:36:28.167 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7faab497a49f] 2024-09-12T00:36:28.167 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559660b81cc1] 2024-09-12T00:36:28.167 INFO:tasks.workunit.client.0.smithi043.stderr: 8: radosgw-admin(+0x1421f32) [0x5596615def32] 2024-09-12T00:36:28.167 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559660b96ced] 2024-09-12T00:36:28.167 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:36:28.168 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7faab37e0d90] 2024-09-12T00:36:28.168 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:36:28.168 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:36:28.168 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:36:28.168 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.168 INFO:tasks.workunit.client.0.smithi043.stderr:--- logging levels --- 2024-09-12T00:36:28.168 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 none 2024-09-12T00:36:28.168 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 lockdep 2024-09-12T00:36:28.168 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 context 2024-09-12T00:36:28.168 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 crush 2024-09-12T00:36:28.168 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds 2024-09-12T00:36:28.168 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_balancer 2024-09-12T00:36:28.168 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_locker 2024-09-12T00:36:28.169 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log 2024-09-12T00:36:28.169 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log_expire 2024-09-12T00:36:28.169 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_migrator 2024-09-12T00:36:28.169 INFO:tasks.workunit.client.0.smithi043.stderr: 3/ 5 mds_quiesce 2024-09-12T00:36:28.169 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 buffer 2024-09-12T00:36:28.169 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 timer 2024-09-12T00:36:28.169 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 filer 2024-09-12T00:36:28.169 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 striper 2024-09-12T00:36:28.169 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 objecter 2024-09-12T00:36:28.169 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rados 2024-09-12T00:36:28.169 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd 2024-09-12T00:36:28.169 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_mirror 2024-09-12T00:36:28.169 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_replay 2024-09-12T00:36:28.169 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_pwl 2024-09-12T00:36:28.170 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 journaler 2024-09-12T00:36:28.170 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objectcacher 2024-09-12T00:36:28.170 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:36:28.170 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 client 2024-09-12T00:36:28.170 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 osd 2024-09-12T00:36:28.170 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 optracker 2024-09-12T00:36:28.170 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objclass 2024-09-12T00:36:28.170 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 filestore 2024-09-12T00:36:28.170 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 journal 2024-09-12T00:36:28.170 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 ms 2024-09-12T00:36:28.170 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mon 2024-09-12T00:36:28.170 INFO:tasks.workunit.client.0.smithi043.stderr: 0/10 monc 2024-09-12T00:36:28.170 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 paxos 2024-09-12T00:36:28.171 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 tp 2024-09-12T00:36:28.171 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 auth 2024-09-12T00:36:28.171 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 crypto 2024-09-12T00:36:28.171 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 finisher 2024-09-12T00:36:28.171 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 reserver 2024-09-12T00:36:28.171 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 heartbeatmap 2024-09-12T00:36:28.171 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 perfcounter 2024-09-12T00:36:28.171 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw 2024-09-12T00:36:28.171 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_sync 2024-09-12T00:36:28.171 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_datacache 2024-09-12T00:36:28.171 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_access 2024-09-12T00:36:28.171 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:36:28.171 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_flight 2024-09-12T00:36:28.172 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:36:28.172 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw_notification 2024-09-12T00:36:28.172 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 javaclient 2024-09-12T00:36:28.172 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 asok 2024-09-12T00:36:28.172 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 throttle 2024-09-12T00:36:28.172 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 refs 2024-09-12T00:36:28.172 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 compressor 2024-09-12T00:36:28.172 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluestore 2024-09-12T00:36:28.172 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluefs 2024-09-12T00:36:28.172 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 bdev 2024-09-12T00:36:28.172 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 kstore 2024-09-12T00:36:28.172 INFO:tasks.workunit.client.0.smithi043.stderr: 4/ 5 rocksdb 2024-09-12T00:36:28.172 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 fuse 2024-09-12T00:36:28.173 INFO:tasks.workunit.client.0.smithi043.stderr: 2/ 5 mgr 2024-09-12T00:36:28.173 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mgrc 2024-09-12T00:36:28.173 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 dpdk 2024-09-12T00:36:28.173 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 eventtrace 2024-09-12T00:36:28.173 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 prioritycache 2024-09-12T00:36:28.173 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 test 2024-09-12T00:36:28.173 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:36:28.173 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephsqlite 2024-09-12T00:36:28.173 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:36:28.173 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore 2024-09-12T00:36:28.173 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_onode 2024-09-12T00:36:28.173 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_odata 2024-09-12T00:36:28.173 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_omap 2024-09-12T00:36:28.173 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_tm 2024-09-12T00:36:28.174 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_t 2024-09-12T00:36:28.174 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:36:28.174 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_epm 2024-09-12T00:36:28.174 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_lba 2024-09-12T00:36:28.174 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:36:28.174 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cache 2024-09-12T00:36:28.174 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_journal 2024-09-12T00:36:28.174 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_device 2024-09-12T00:36:28.174 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_backref 2024-09-12T00:36:28.174 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 alienstore 2024-09-12T00:36:28.174 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mclock 2024-09-12T00:36:28.174 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cyanstore 2024-09-12T00:36:28.175 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 ceph_exporter 2024-09-12T00:36:28.175 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 memstore 2024-09-12T00:36:28.175 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 trace 2024-09-12T00:36:28.175 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 ceph_dedup 2024-09-12T00:36:28.175 INFO:tasks.workunit.client.0.smithi043.stderr: -2/-2 (syslog threshold) 2024-09-12T00:36:28.175 INFO:tasks.workunit.client.0.smithi043.stderr: 99/99 (stderr threshold) 2024-09-12T00:36:28.175 INFO:tasks.workunit.client.0.smithi043.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:36:28.175 INFO:tasks.workunit.client.0.smithi043.stderr: 7fa8ddffb640 / http_manager 2024-09-12T00:36:28.175 INFO:tasks.workunit.client.0.smithi043.stderr: 7fa8dffff640 / http_manager 2024-09-12T00:36:28.175 INFO:tasks.workunit.client.0.smithi043.stderr: 7fa9657e2640 / rgw_dt_lg_renew 2024-09-12T00:36:28.175 INFO:tasks.workunit.client.0.smithi043.stderr: 7fa990ff9640 / ms_dispatch 2024-09-12T00:36:28.175 INFO:tasks.workunit.client.0.smithi043.stderr: 7fa9927fc640 / io_context_pool 2024-09-12T00:36:28.175 INFO:tasks.workunit.client.0.smithi043.stderr: 7fa998e01640 / ms_dispatch 2024-09-12T00:36:28.176 INFO:tasks.workunit.client.0.smithi043.stderr: 7fa99b606640 / ms_dispatch 2024-09-12T00:36:28.176 INFO:tasks.workunit.client.0.smithi043.stderr: 7fa99ce09640 / io_context_pool 2024-09-12T00:36:28.176 INFO:tasks.workunit.client.0.smithi043.stderr: 7faaadba4640 / io_context_pool 2024-09-12T00:36:28.176 INFO:tasks.workunit.client.0.smithi043.stderr: 7faaae3a5640 / msgr-worker-2 2024-09-12T00:36:28.176 INFO:tasks.workunit.client.0.smithi043.stderr: 7faaaeba6640 / msgr-worker-1 2024-09-12T00:36:28.176 INFO:tasks.workunit.client.0.smithi043.stderr: 7faaaf3a7640 / msgr-worker-0 2024-09-12T00:36:28.176 INFO:tasks.workunit.client.0.smithi043.stderr: 7faab10a09c0 / radosgw-admin 2024-09-12T00:36:28.176 INFO:tasks.workunit.client.0.smithi043.stderr: max_recent 500 2024-09-12T00:36:28.176 INFO:tasks.workunit.client.0.smithi043.stderr: max_new 1000 2024-09-12T00:36:28.176 INFO:tasks.workunit.client.0.smithi043.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:36:28.037928Z_8dcf043c-89d5-4d7b-a31a-d0ffeacf5ee6/log 2024-09-12T00:36:28.176 INFO:tasks.workunit.client.0.smithi043.stderr:--- end dump of recent events --- 2024-09-12T00:36:28.176 INFO:tasks.workunit.client.0.smithi043.stderr:Aborted 2024-09-12T00:36:28.176 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:36:28.178 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:28.178 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:28.178 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.111+0000 7f65106d49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.178 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.115+0000 7f65106d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.178 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.115+0000 7f65106d49c0 20 realm 2024-09-12T00:36:28.178 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.115+0000 7f65106d49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.178 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.115+0000 7f65106d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.179 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.115+0000 7f65106d49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:28.179 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.115+0000 7f65106d49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.179 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.115+0000 7f65106d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.179 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.115+0000 7f65106d49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.179 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.119+0000 7f65106d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:28.179 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.119+0000 7f65106d49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.179 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.119+0000 7f65106d49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:28.179 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.119+0000 7f65106d49c0 20 searching for the correct realm 2024-09-12T00:36:28.179 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.123+0000 7f650e9db640 0 -- 172.21.15.43:0/917287182 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f6504066e50 msgr2=0x7f65040738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:28.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.339+0000 7f650e1da640 0 -- 172.21.15.43:0/917287182 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x55c878065fd0 msgr2=0x55c878068490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:28.348 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.347+0000 7f65106d49c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:36:28.348 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.347+0000 7f65106d49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:28.348 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.347+0000 7f65106d49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:28.348 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.347+0000 7f65106d49c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:36:28.348 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.347+0000 7f65106d49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:28.348 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.347+0000 7f65106d49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:28.348 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.347+0000 7f65106d49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.349 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.347+0000 7f65106d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.349 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.347+0000 7f65106d49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.349 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.351+0000 7f65106d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:28.349 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.351+0000 7f65106d49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.350 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.351+0000 7f65106d49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:28.350 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.351+0000 7f65106d49c0 20 zone default found 2024-09-12T00:36:28.350 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.351+0000 7f65106d49c0 4 Realm: () 2024-09-12T00:36:28.350 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.351+0000 7f65106d49c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:36:28.350 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.351+0000 7f65106d49c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:36:28.350 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.351+0000 7f65106d49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:28.350 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.351+0000 7f65106d49c0 20 zonegroup default 2024-09-12T00:36:28.350 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.351+0000 7f65106d49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.351 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.351+0000 7f65106d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.351 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.351+0000 7f65106d49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.351 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.351+0000 7f65106d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.351 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.351+0000 7f65106d49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.351+0000 7f65106d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.351+0000 7f65106d49c0 20 started sync module instance, tier type = 2024-09-12T00:36:28.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.351+0000 7f65106d49c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:36:28.374 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.375+0000 7f65106d49c0 20 add_watcher() i=0 2024-09-12T00:36:28.375 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.375+0000 7f65106d49c0 20 add_watcher() i=1 2024-09-12T00:36:28.375 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.375+0000 7f65106d49c0 20 add_watcher() i=2 2024-09-12T00:36:28.375 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.375+0000 7f65106d49c0 20 add_watcher() i=3 2024-09-12T00:36:28.375 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.375+0000 7f65106d49c0 20 add_watcher() i=4 2024-09-12T00:36:28.375 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.375+0000 7f65106d49c0 20 add_watcher() i=5 2024-09-12T00:36:28.375 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.375+0000 7f65106d49c0 20 add_watcher() i=6 2024-09-12T00:36:28.376 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.375+0000 7f65106d49c0 20 add_watcher() i=7 2024-09-12T00:36:28.376 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.375+0000 7f65106d49c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:28.380 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.379+0000 7f63c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:28.381 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.383+0000 7f65106d49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:28.381 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.383+0000 7f65106d49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:28.381 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.383+0000 7f65106d49c0 5 note: GC not initialized 2024-09-12T00:36:28.382 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.383+0000 7f633f7fe640 20 reqs_thread_entry: start 2024-09-12T00:36:28.382 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.383+0000 7f65106d49c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:28.383 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.383+0000 7f65106d49c0 20 Filter name: none 2024-09-12T00:36:28.383 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.383+0000 7f633d7fa640 20 reqs_thread_entry: start 2024-09-12T00:36:28.383 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.383+0000 7f65106d49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.383 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.383+0000 7f65106d49c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:36:28.383 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.383+0000 7f65106d49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.385 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.383+0000 7f65106d49c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:36:28.385 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.383+0000 7f65106d49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:28.385 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.383+0000 7f65106d49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.385 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.387+0000 7f65106d49c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:36:28.385 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.387+0000 7f65106d49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.387+0000 7f65106d49c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:36:28.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.387+0000 7f65106d49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:28.389 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.391+0000 7f63c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:28.394 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.395+0000 7f65106d49c0 20 remove_watcher() i=0 2024-09-12T00:36:28.394 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.395+0000 7f65106d49c0 2 removed watcher, disabling cache 2024-09-12T00:36:28.396 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.399+0000 7f65106d49c0 20 remove_watcher() i=1 2024-09-12T00:36:28.399 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.399+0000 7f65106d49c0 20 remove_watcher() i=2 2024-09-12T00:36:28.401 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.403+0000 7f65106d49c0 20 remove_watcher() i=3 2024-09-12T00:36:28.403 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.403+0000 7f65106d49c0 20 remove_watcher() i=4 2024-09-12T00:36:28.405 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.407+0000 7f65106d49c0 20 remove_watcher() i=5 2024-09-12T00:36:28.406 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.407+0000 7f65106d49c0 20 remove_watcher() i=6 2024-09-12T00:36:28.407 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.407+0000 7f65106d49c0 20 remove_watcher() i=7 2024-09-12T00:36:28.424 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.425 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:36:28.425 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: abort-at-init-indext id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:36:28.425 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:28.427 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:28.427 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:28.441 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:28.441 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:28.486 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:36:28.524 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:28.524 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:28.569 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.571+0000 7f4d04a389c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.571+0000 7f4d04a389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.571+0000 7f4d04a389c0 20 realm 2024-09-12T00:36:28.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.571+0000 7f4d04a389c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.571 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.571+0000 7f4d04a389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.571 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.571+0000 7f4d04a389c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:28.571 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.571+0000 7f4d04a389c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.571 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.571+0000 7f4d04a389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.571 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.571+0000 7f4d04a389c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.572 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.571+0000 7f4d04a389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:28.572 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.571+0000 7f4d04a389c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.573 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.575+0000 7f4d04a389c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:28.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.575+0000 7f4d04a389c0 20 searching for the correct realm 2024-09-12T00:36:28.578 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.579+0000 7f4d02d3f640 0 -- 172.21.15.43:0/2039680778 >> [v2:172.21.15.43:6808/2258408181,v1:172.21.15.43:6809/2258408181] conn(0x55eb0fb91af0 msgr2=0x55eb0fb93fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:28.584 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.583+0000 7f4d0253e640 0 -- 172.21.15.43:0/2039680778 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f4cf0008040 msgr2=0x7f4cf009b040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:28.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.591+0000 7f4d04a389c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:36:28.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.591+0000 7f4d04a389c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:28.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.591+0000 7f4d04a389c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:28.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.591+0000 7f4d04a389c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:36:28.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.591+0000 7f4d04a389c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:28.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.591+0000 7f4d04a389c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:28.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.591+0000 7f4d04a389c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.595+0000 7f4d04a389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.594 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.595+0000 7f4d04a389c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.595 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.595+0000 7f4d04a389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:28.595 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.595+0000 7f4d04a389c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.595 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.595+0000 7f4d04a389c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:28.595 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.595+0000 7f4d04a389c0 20 zone default found 2024-09-12T00:36:28.595 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.595+0000 7f4d04a389c0 4 Realm: () 2024-09-12T00:36:28.595 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.595+0000 7f4d04a389c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:36:28.595 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.595+0000 7f4d04a389c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:36:28.595 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.595+0000 7f4d04a389c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:28.595 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.595+0000 7f4d04a389c0 20 zonegroup default 2024-09-12T00:36:28.595 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.595+0000 7f4d04a389c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.596 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.595+0000 7f4d04a389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.596 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.595+0000 7f4d04a389c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.596 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.595+0000 7f4d04a389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.596 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.595+0000 7f4d04a389c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.596 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.595+0000 7f4d04a389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.596 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.595+0000 7f4d04a389c0 20 started sync module instance, tier type = 2024-09-12T00:36:28.597 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.595+0000 7f4d04a389c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:36:28.610 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.611+0000 7f4d04a389c0 20 add_watcher() i=0 2024-09-12T00:36:28.610 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.611+0000 7f4d04a389c0 20 add_watcher() i=1 2024-09-12T00:36:28.611 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.611+0000 7f4d04a389c0 20 add_watcher() i=2 2024-09-12T00:36:28.611 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.611+0000 7f4d04a389c0 20 add_watcher() i=3 2024-09-12T00:36:28.611 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.611+0000 7f4d04a389c0 20 add_watcher() i=4 2024-09-12T00:36:28.611 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.611+0000 7f4d04a389c0 20 add_watcher() i=5 2024-09-12T00:36:28.611 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.611+0000 7f4d04a389c0 20 add_watcher() i=6 2024-09-12T00:36:28.611 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.611+0000 7f4d04a389c0 20 add_watcher() i=7 2024-09-12T00:36:28.612 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.611+0000 7f4d04a389c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:28.614 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.615+0000 7f4bb7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:28.616 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.615+0000 7f4d04a389c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:28.616 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.615+0000 7f4d04a389c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:28.616 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.615+0000 7f4d04a389c0 5 note: GC not initialized 2024-09-12T00:36:28.616 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.615+0000 7f4bb6fe5640 20 reqs_thread_entry: start 2024-09-12T00:36:28.616 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.615+0000 7f4d04a389c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:28.616 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.615+0000 7f4d04a389c0 20 Filter name: none 2024-09-12T00:36:28.616 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.615+0000 7f4bb4fe1640 20 reqs_thread_entry: start 2024-09-12T00:36:28.616 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.615+0000 7f4d04a389c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:36:28.616 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.615+0000 7f4d04a389c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.616 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.615+0000 7f4d04a389c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:36:28.616 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.615+0000 7f4d04a389c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:36:28.617 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.615+0000 7f4d04a389c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:36:28.617 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.615+0000 7f4d04a389c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 : miss 2024-09-12T00:36:28.617 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.615+0000 7f4d04a389c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.617 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.615+0000 7f4d04a389c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:36:28.617 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.615+0000 7f4d04a389c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 info.flags=0x17 2024-09-12T00:36:28.617 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.615+0000 7f4d04a389c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 to cache LRU end 2024-09-12T00:36:28.617 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.615+0000 7f4d04a389c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:28.617 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.615+0000 7f4d04a389c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:28.617 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.615+0000 7f4d04a389c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 2024-09-12T00:36:28.619 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.619+0000 7f4d04a389c0 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 to be held by another RGW process; skipping for now 2024-09-12T00:36:28.620 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.619+0000 7f4bb7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:28.625 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.627+0000 7f4d04a389c0 20 remove_watcher() i=0 2024-09-12T00:36:28.625 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.627+0000 7f4d04a389c0 2 removed watcher, disabling cache 2024-09-12T00:36:28.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.627+0000 7f4d04a389c0 20 remove_watcher() i=1 2024-09-12T00:36:28.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.631+0000 7f4d04a389c0 20 remove_watcher() i=2 2024-09-12T00:36:28.631 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.631+0000 7f4d04a389c0 20 remove_watcher() i=3 2024-09-12T00:36:28.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.635+0000 7f4d04a389c0 20 remove_watcher() i=4 2024-09-12T00:36:28.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.635+0000 7f4d04a389c0 20 remove_watcher() i=5 2024-09-12T00:36:28.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.635+0000 7f4d04a389c0 20 remove_watcher() i=6 2024-09-12T00:36:28.636 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:28.635+0000 7f4d04a389c0 20 remove_watcher() i=7 2024-09-12T00:36:28.650 INFO:tasks.workunit.client.0.smithi043.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:36:58.662 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:36:58.700 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:58.701 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:58.747 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.746+0000 7f08c98449c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.748 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.746+0000 7f08c98449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:58.748 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.746+0000 7f08c98449c0 20 realm 2024-09-12T00:36:58.748 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.746+0000 7f08c98449c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.748 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.746+0000 7f08c98449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:58.749 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.746+0000 7f08c98449c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:58.749 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.746+0000 7f08c98449c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.749 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.746+0000 7f08c98449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:58.749 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.746+0000 7f08c98449c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.750 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.750+0000 7f08c98449c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:58.750 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.750+0000 7f08c98449c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.750+0000 7f08c98449c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:58.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.750+0000 7f08c98449c0 20 searching for the correct realm 2024-09-12T00:36:58.756 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.754+0000 7f08c6b49640 0 -- 172.21.15.43:0/3101549973 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f08bc0e5430 msgr2=0x7f08bc0e5850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:58.763 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.762+0000 7f08c734a640 0 -- 172.21.15.43:0/3101549973 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f08bc0ce3e0 msgr2=0x7f08bc0ce840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:58.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.978+0000 7f08c98449c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:36:58.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.978+0000 7f08c98449c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:58.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.978+0000 7f08c98449c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:58.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.978+0000 7f08c98449c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:36:58.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.978+0000 7f08c98449c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:58.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.978+0000 7f08c98449c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:58.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.978+0000 7f08c98449c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.982+0000 7f08c98449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:58.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.982+0000 7f08c98449c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.982+0000 7f08c98449c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:58.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.982+0000 7f08c98449c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.983 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.982+0000 7f08c98449c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:58.983 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.982+0000 7f08c98449c0 20 zone default found 2024-09-12T00:36:58.983 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.982+0000 7f08c98449c0 4 Realm: () 2024-09-12T00:36:58.983 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.982+0000 7f08c98449c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:36:58.983 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.982+0000 7f08c98449c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:36:58.983 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.982+0000 7f08c98449c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:58.983 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.982+0000 7f08c98449c0 20 zonegroup default 2024-09-12T00:36:58.983 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.982+0000 7f08c98449c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.982+0000 7f08c98449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:58.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.982+0000 7f08c98449c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.982+0000 7f08c98449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:58.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.982+0000 7f08c98449c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.985 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.986+0000 7f08c98449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:58.985 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.986+0000 7f08c98449c0 20 started sync module instance, tier type = 2024-09-12T00:36:58.985 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:58.986+0000 7f08c98449c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:36:59.008 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.006+0000 7f08c98449c0 20 add_watcher() i=0 2024-09-12T00:36:59.008 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.006+0000 7f08c98449c0 20 add_watcher() i=1 2024-09-12T00:36:59.008 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.006+0000 7f08c98449c0 20 add_watcher() i=2 2024-09-12T00:36:59.008 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.006+0000 7f08c98449c0 20 add_watcher() i=3 2024-09-12T00:36:59.008 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.006+0000 7f08c98449c0 20 add_watcher() i=4 2024-09-12T00:36:59.009 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.006+0000 7f08c98449c0 20 add_watcher() i=5 2024-09-12T00:36:59.009 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.006+0000 7f08c98449c0 20 add_watcher() i=6 2024-09-12T00:36:59.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.010+0000 7f08c98449c0 20 add_watcher() i=7 2024-09-12T00:36:59.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.010+0000 7f08c98449c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:59.014 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.014+0000 7f077dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:59.015 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.014+0000 7f08c98449c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:59.015 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.014+0000 7f08c98449c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:59.015 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.014+0000 7f08c98449c0 5 note: GC not initialized 2024-09-12T00:36:59.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.014+0000 7f077cfe1640 20 reqs_thread_entry: start 2024-09-12T00:36:59.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.014+0000 7f08c98449c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:59.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.014+0000 7f08c98449c0 20 Filter name: none 2024-09-12T00:36:59.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.014+0000 7f06f67fc640 20 reqs_thread_entry: start 2024-09-12T00:36:59.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.014+0000 7f08c98449c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:36:59.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.014+0000 7f08c98449c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.017 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.018+0000 7f08c98449c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:36:59.017 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.018+0000 7f08c98449c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:36:59.017 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.018+0000 7f08c98449c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:36:59.017 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.018+0000 7f08c98449c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 : miss 2024-09-12T00:36:59.017 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.018+0000 7f08c98449c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.018+0000 7f08c98449c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:36:59.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.018+0000 7f08c98449c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 info.flags=0x17 2024-09-12T00:36:59.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.018+0000 7f08c98449c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 to cache LRU end 2024-09-12T00:36:59.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.018+0000 7f08c98449c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:59.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.018+0000 7f08c98449c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:59.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.018+0000 7f08c98449c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 2024-09-12T00:36:59.028 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.026+0000 7f08c98449c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 info.flags=0x17 2024-09-12T00:36:59.028 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.026+0000 7f08c98449c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 to cache LRU end 2024-09-12T00:36:59.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.026+0000 7f08c98449c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:59.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.026+0000 7f08c98449c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21, ofs0, ns] 2024-09-12T00:36:59.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.030+0000 7f07aa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333471 cookie 94271352774256 notifier 6110 bl.length()=913 2024-09-12T00:36:59.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.030+0000 7f07aa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 info.flags=0x17 2024-09-12T00:36:59.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.030+0000 7f07aa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 to cache LRU end 2024-09-12T00:36:59.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.030+0000 7f07aa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:59.030 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.030+0000 7f08c98449c0 20 handle_bi_update(): bucket=:abort-at-init-indext[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21]): orig_sources= new_sources= 2024-09-12T00:36:59.030 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.030+0000 7f08c98449c0 20 handle_bi_update(): bucket=:abort-at-init-indext[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21]): potential sources added=[] removed=[] 2024-09-12T00:36:59.030 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.030+0000 7f08c98449c0 20 handle_bi_update(): bucket=:abort-at-init-indext[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21]): orig_dests= new_dests= 2024-09-12T00:36:59.030 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.030+0000 7f08c98449c0 20 handle_bi_update(): bucket=:abort-at-init-indext[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21]): potential dests added=[] removed=[] 2024-09-12T00:36:59.040 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.038+0000 7f08c98449c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.1.0 2024-09-12T00:36:59.040 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.038+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.1.0 2024-09-12T00:36:59.041 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.038+0000 7f08c98449c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.1.1 2024-09-12T00:36:59.041 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.038+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.1.1 2024-09-12T00:36:59.041 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.038+0000 7f08c98449c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.1.2 2024-09-12T00:36:59.041 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.038+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.1.2 2024-09-12T00:36:59.041 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.038+0000 7f08c98449c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.1.3 2024-09-12T00:36:59.041 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.038+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.1.3 2024-09-12T00:36:59.041 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.038+0000 7f08c98449c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.1.4 2024-09-12T00:36:59.041 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.038+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.1.4 2024-09-12T00:36:59.041 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.038+0000 7f08c98449c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.1.5 2024-09-12T00:36:59.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.038+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.1.5 2024-09-12T00:36:59.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.038+0000 7f08c98449c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.1.6 2024-09-12T00:36:59.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.038+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.1.6 2024-09-12T00:36:59.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.038+0000 7f08c98449c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.1.7 2024-09-12T00:36:59.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.038+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.1.7 2024-09-12T00:36:59.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.038+0000 7f08c98449c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.1.8 2024-09-12T00:36:59.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.038+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.1.8 2024-09-12T00:36:59.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.038+0000 7f08c98449c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.1.9 2024-09-12T00:36:59.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.038+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.1.9 2024-09-12T00:36:59.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.038+0000 7f08c98449c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.1.10 2024-09-12T00:36:59.043 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.038+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.1.10 2024-09-12T00:36:59.043 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.038+0000 7f08c98449c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.1.11 2024-09-12T00:36:59.043 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.038+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.1.11 2024-09-12T00:36:59.043 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.038+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.0 2024-09-12T00:36:59.043 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.038+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.1 2024-09-12T00:36:59.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.042+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.2 2024-09-12T00:36:59.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.042+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.3 2024-09-12T00:36:59.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.042+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.4 2024-09-12T00:36:59.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.042+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.5 2024-09-12T00:36:59.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.042+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.6 2024-09-12T00:36:59.045 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.046+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.7 2024-09-12T00:36:59.046 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.046+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.8 2024-09-12T00:36:59.047 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.046+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.9 2024-09-12T00:36:59.048 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.046+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.10 2024-09-12T00:36:59.054 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.054+0000 7f08c98449c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:59.055 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.054+0000 7f08c98449c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 2024-09-12T00:36:59.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.054+0000 7f08c98449c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 info.flags=0x17 2024-09-12T00:36:59.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.054+0000 7f08c98449c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 to cache LRU end 2024-09-12T00:36:59.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.054+0000 7f08c98449c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:59.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.054+0000 7f08c98449c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21, ofs0, ns] 2024-09-12T00:36:59.057 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.058+0000 7f07aa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333472 cookie 94271352774256 notifier 6110 bl.length()=913 2024-09-12T00:36:59.057 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.058+0000 7f07aa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 info.flags=0x17 2024-09-12T00:36:59.057 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.058+0000 7f07aa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 to cache LRU end 2024-09-12T00:36:59.057 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.058+0000 7f07aa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:59.057 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.058+0000 7f08c98449c0 20 handle_bi_update(): bucket=:abort-at-init-indext[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21]): orig_sources= new_sources= 2024-09-12T00:36:59.057 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.058+0000 7f08c98449c0 20 handle_bi_update(): bucket=:abort-at-init-indext[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21]): potential sources added=[] removed=[] 2024-09-12T00:36:59.058 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.058+0000 7f08c98449c0 20 handle_bi_update(): bucket=:abort-at-init-indext[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21]): orig_dests= new_dests= 2024-09-12T00:36:59.058 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.058+0000 7f08c98449c0 20 handle_bi_update(): bucket=:abort-at-init-indext[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21]): potential dests added=[] removed=[] 2024-09-12T00:36:59.062 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.062+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.0 2024-09-12T00:36:59.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.062+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.1 2024-09-12T00:36:59.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.062+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.2 2024-09-12T00:36:59.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.062+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.3 2024-09-12T00:36:59.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.066+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.4 2024-09-12T00:36:59.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.066+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.5 2024-09-12T00:36:59.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.066+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.6 2024-09-12T00:36:59.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.066+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.7 2024-09-12T00:36:59.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.066+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.8 2024-09-12T00:36:59.068 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.066+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.9 2024-09-12T00:36:59.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.070+0000 7f08c98449c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21.10 2024-09-12T00:36:59.070 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.070+0000 7f08c98449c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:59.070 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.070+0000 7f08c98449c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 2024-09-12T00:36:59.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.070+0000 7f08c98449c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 info.flags=0x17 2024-09-12T00:36:59.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.070+0000 7f08c98449c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 to cache LRU end 2024-09-12T00:36:59.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.070+0000 7f08c98449c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:59.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.070+0000 7f08c98449c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21, ofs0, ns] 2024-09-12T00:36:59.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.070+0000 7f07aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333473 cookie 94271352774256 notifier 6110 bl.length()=881 2024-09-12T00:36:59.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.070+0000 7f07aaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 info.flags=0x17 2024-09-12T00:36:59.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.070+0000 7f07aaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 to cache LRU end 2024-09-12T00:36:59.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.070+0000 7f07aaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:59.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.074+0000 7f08c98449c0 20 handle_bi_update(): bucket=:abort-at-init-indext[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21]): orig_sources= new_sources= 2024-09-12T00:36:59.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.074+0000 7f08c98449c0 20 handle_bi_update(): bucket=:abort-at-init-indext[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21]): potential sources added=[] removed=[] 2024-09-12T00:36:59.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.074+0000 7f08c98449c0 20 handle_bi_update(): bucket=:abort-at-init-indext[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21]): orig_dests= new_dests= 2024-09-12T00:36:59.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.074+0000 7f08c98449c0 20 handle_bi_update(): bucket=:abort-at-init-indext[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21]): potential dests added=[] removed=[] 2024-09-12T00:36:59.078 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.078+0000 7f08c98449c0 1 execute INFO: reshard of bucket "abort-at-init-indext" from 11 shards to 12 shards completed successfully 2024-09-12T00:36:59.082 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.082+0000 7f077dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:59.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.086+0000 7f08c98449c0 20 remove_watcher() i=0 2024-09-12T00:36:59.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.086+0000 7f08c98449c0 2 removed watcher, disabling cache 2024-09-12T00:36:59.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.090+0000 7f08c98449c0 20 remove_watcher() i=1 2024-09-12T00:36:59.092 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.090+0000 7f08c98449c0 20 remove_watcher() i=2 2024-09-12T00:36:59.095 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.094+0000 7f08c98449c0 20 remove_watcher() i=3 2024-09-12T00:36:59.097 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.098+0000 7f08c98449c0 20 remove_watcher() i=4 2024-09-12T00:36:59.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.098+0000 7f08c98449c0 20 remove_watcher() i=5 2024-09-12T00:36:59.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.098+0000 7f08c98449c0 20 remove_watcher() i=6 2024-09-12T00:36:59.102 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.102+0000 7f08c98449c0 20 remove_watcher() i=7 2024-09-12T00:36:59.120 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:36:59.148 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:59.148 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:59.193 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.194+0000 7f491fc509c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.194+0000 7f491fc509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:59.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.194+0000 7f491fc509c0 20 realm 2024-09-12T00:36:59.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.194+0000 7f491fc509c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.194+0000 7f491fc509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:59.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.194+0000 7f491fc509c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:59.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.194+0000 7f491fc509c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.194+0000 7f491fc509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:59.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.194+0000 7f491fc509c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.197 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.198+0000 7f491fc509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:59.197 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.198+0000 7f491fc509c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.200 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.198+0000 7f491fc509c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:59.200 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.198+0000 7f491fc509c0 20 searching for the correct realm 2024-09-12T00:36:59.203 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.202+0000 7f491cf55640 0 -- 172.21.15.43:0/1069493303 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x562467b678d0 msgr2=0x562467b69d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:59.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.210+0000 7f491d756640 0 -- 172.21.15.43:0/1069493303 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f4914098bd0 msgr2=0x7f4914091130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:59.218 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.218+0000 7f491fc509c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:36:59.218 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.218+0000 7f491fc509c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:59.218 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.218+0000 7f491fc509c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:59.218 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.218+0000 7f491fc509c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:36:59.218 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.218+0000 7f491fc509c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:59.218 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.218+0000 7f491fc509c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:59.219 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.218+0000 7f491fc509c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.219 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.218+0000 7f491fc509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:59.219 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.218+0000 7f491fc509c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.220 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.218+0000 7f491fc509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:59.220 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.218+0000 7f491fc509c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.220 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.218+0000 7f491fc509c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:59.220 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.218+0000 7f491fc509c0 20 zone default found 2024-09-12T00:36:59.220 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.218+0000 7f491fc509c0 4 Realm: () 2024-09-12T00:36:59.220 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.218+0000 7f491fc509c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:36:59.220 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.218+0000 7f491fc509c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:36:59.220 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.218+0000 7f491fc509c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:59.220 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.218+0000 7f491fc509c0 20 zonegroup default 2024-09-12T00:36:59.220 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.218+0000 7f491fc509c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.221 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.218+0000 7f491fc509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:59.221 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.218+0000 7f491fc509c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.221 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.218+0000 7f491fc509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:59.221 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.218+0000 7f491fc509c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.221 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.218+0000 7f491fc509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:59.222 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.218+0000 7f491fc509c0 20 started sync module instance, tier type = 2024-09-12T00:36:59.222 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.222+0000 7f491fc509c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:36:59.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.234+0000 7f491fc509c0 20 add_watcher() i=0 2024-09-12T00:36:59.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.234+0000 7f491fc509c0 20 add_watcher() i=1 2024-09-12T00:36:59.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.234+0000 7f491fc509c0 20 add_watcher() i=2 2024-09-12T00:36:59.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.234+0000 7f491fc509c0 20 add_watcher() i=3 2024-09-12T00:36:59.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.234+0000 7f491fc509c0 20 add_watcher() i=4 2024-09-12T00:36:59.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.234+0000 7f491fc509c0 20 add_watcher() i=5 2024-09-12T00:36:59.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.234+0000 7f491fc509c0 20 add_watcher() i=6 2024-09-12T00:36:59.237 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.238+0000 7f491fc509c0 20 add_watcher() i=7 2024-09-12T00:36:59.237 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.238+0000 7f491fc509c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:59.239 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.238+0000 7f47d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:59.240 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.238+0000 7f491fc509c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:59.240 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.238+0000 7f491fc509c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:59.240 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.238+0000 7f491fc509c0 5 note: GC not initialized 2024-09-12T00:36:59.240 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.238+0000 7f47d27e4640 20 reqs_thread_entry: start 2024-09-12T00:36:59.240 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.238+0000 7f491fc509c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:59.240 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.238+0000 7f491fc509c0 20 Filter name: none 2024-09-12T00:36:59.241 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.238+0000 7f4743fff640 20 reqs_thread_entry: start 2024-09-12T00:36:59.241 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.238+0000 7f491fc509c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.241 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.238+0000 7f491fc509c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:36:59.241 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.238+0000 7f491fc509c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.241 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.242+0000 7f491fc509c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:36:59.242 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.242+0000 7f491fc509c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:59.242 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.242+0000 7f491fc509c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.242 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.242+0000 7f491fc509c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:36:59.242 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.242+0000 7f491fc509c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.242 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.242+0000 7f491fc509c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:36:59.243 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.242+0000 7f491fc509c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:59.245 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.246+0000 7f47d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:59.250 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.250+0000 7f491fc509c0 20 remove_watcher() i=0 2024-09-12T00:36:59.250 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.250+0000 7f491fc509c0 2 removed watcher, disabling cache 2024-09-12T00:36:59.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.250+0000 7f491fc509c0 20 remove_watcher() i=1 2024-09-12T00:36:59.254 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.254+0000 7f491fc509c0 20 remove_watcher() i=2 2024-09-12T00:36:59.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.254+0000 7f491fc509c0 20 remove_watcher() i=3 2024-09-12T00:36:59.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.258+0000 7f491fc509c0 20 remove_watcher() i=4 2024-09-12T00:36:59.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.258+0000 7f491fc509c0 20 remove_watcher() i=5 2024-09-12T00:36:59.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.262+0000 7f491fc509c0 20 remove_watcher() i=6 2024-09-12T00:36:59.262 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.262+0000 7f491fc509c0 20 remove_watcher() i=7 2024-09-12T00:36:59.276 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:59.276 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:36:59.276 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: abort-at-init-indext id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:36:59.276 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:59.277 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.277 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:59.281 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.281 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:59.327 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.327 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:59.372 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-12T00:36:59.372 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:59.374 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.374 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:59.396 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.396 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:59.444 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.444 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:59.464 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.464 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:59.484 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.485 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:59.504 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.504 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:59.526 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.526 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:59.545 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.545 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:59.565 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.565 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:59.583 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.584 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:59.603 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.603 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:59.622 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.622 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:59.641 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.641 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:59.660 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.660 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:59.679 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.679 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:59.699 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.699 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:59.719 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.719 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:59.739 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.739 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:59.758 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.758 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:59.777 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.777 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:59.798 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.798 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:59.819 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.819 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:36:59.836 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:36:59.869 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:59.869 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:59.914 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.914+0000 7fd6150ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.916 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.914+0000 7fd6150ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:59.916 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.914+0000 7fd6150ad9c0 20 realm 2024-09-12T00:36:59.916 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.914+0000 7fd6150ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.916 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.914+0000 7fd6150ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:59.917 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.914+0000 7fd6150ad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:59.917 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.914+0000 7fd6150ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.917 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.914+0000 7fd6150ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:59.917 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.914+0000 7fd6150ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.918 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.918+0000 7fd6150ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:59.918 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.918+0000 7fd6150ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.919 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.918+0000 7fd6150ad9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:59.919 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.918+0000 7fd6150ad9c0 20 searching for the correct realm 2024-09-12T00:36:59.924 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.922+0000 7fd6133b4640 0 -- 172.21.15.43:0/535233931 >> [v2:172.21.15.43:6808/2258408181,v1:172.21.15.43:6809/2258408181] conn(0x555780db1200 msgr2=0x555780db36c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:59.928 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.926+0000 7fd60bfff640 0 -- 172.21.15.43:0/535233931 >> [v2:172.21.15.43:6816/653473197,v1:172.21.15.43:6817/653473197] conn(0x555780dac490 msgr2=0x555780dae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:59.940 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.938+0000 7fd6150ad9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:36:59.940 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.938+0000 7fd6150ad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:59.940 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.938+0000 7fd6150ad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:59.940 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.938+0000 7fd6150ad9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:36:59.940 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.938+0000 7fd6150ad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:59.940 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.938+0000 7fd6150ad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:59.940 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.938+0000 7fd6150ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.940 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.938+0000 7fd6150ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:59.940 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.938+0000 7fd6150ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.941 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.938+0000 7fd6150ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:59.942 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.938+0000 7fd6150ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.942 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.942+0000 7fd6150ad9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:59.942 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.942+0000 7fd6150ad9c0 20 zone default found 2024-09-12T00:36:59.942 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.942+0000 7fd6150ad9c0 4 Realm: () 2024-09-12T00:36:59.942 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.942+0000 7fd6150ad9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:36:59.942 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.942+0000 7fd6150ad9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:36:59.942 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.942+0000 7fd6150ad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:59.942 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.942+0000 7fd6150ad9c0 20 zonegroup default 2024-09-12T00:36:59.942 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.942+0000 7fd6150ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.942 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.942+0000 7fd6150ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:59.942 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.942+0000 7fd6150ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.943 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.942+0000 7fd6150ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:59.943 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.942+0000 7fd6150ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.943 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.942+0000 7fd6150ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:59.943 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.942+0000 7fd6150ad9c0 20 started sync module instance, tier type = 2024-09-12T00:36:59.943 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.942+0000 7fd6150ad9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:36:59.958 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.958+0000 7fd6150ad9c0 20 add_watcher() i=0 2024-09-12T00:36:59.958 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.958+0000 7fd6150ad9c0 20 add_watcher() i=1 2024-09-12T00:36:59.958 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.958+0000 7fd6150ad9c0 20 add_watcher() i=2 2024-09-12T00:36:59.958 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.958+0000 7fd6150ad9c0 20 add_watcher() i=3 2024-09-12T00:36:59.958 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.958+0000 7fd6150ad9c0 20 add_watcher() i=4 2024-09-12T00:36:59.958 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.958+0000 7fd6150ad9c0 20 add_watcher() i=5 2024-09-12T00:36:59.958 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.958+0000 7fd6150ad9c0 20 add_watcher() i=6 2024-09-12T00:36:59.959 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.958+0000 7fd6150ad9c0 20 add_watcher() i=7 2024-09-12T00:36:59.959 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.958+0000 7fd6150ad9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:59.962 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.962+0000 7fd4c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:59.963 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.962+0000 7fd6150ad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:59.963 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.962+0000 7fd6150ad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:59.963 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.962+0000 7fd6150ad9c0 5 note: GC not initialized 2024-09-12T00:36:59.963 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.962+0000 7fd443fff640 20 reqs_thread_entry: start 2024-09-12T00:36:59.963 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.962+0000 7fd6150ad9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:59.963 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.962+0000 7fd6150ad9c0 20 Filter name: none 2024-09-12T00:36:59.963 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.962+0000 7fd441ffb640 20 reqs_thread_entry: start 2024-09-12T00:36:59.963 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.962+0000 7fd6150ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.964 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.962+0000 7fd6150ad9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:36:59.964 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.962+0000 7fd6150ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.965 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.962+0000 7fd6150ad9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:36:59.965 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.962+0000 7fd6150ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:59.965 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.962+0000 7fd6150ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.965 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.966+0000 7fd6150ad9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:36:59.965 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.966+0000 7fd6150ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.966 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.966+0000 7fd6150ad9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:36:59.966 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.966+0000 7fd6150ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:59.968 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.966+0000 7fd4c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:59.973 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.974+0000 7fd6150ad9c0 20 remove_watcher() i=0 2024-09-12T00:36:59.973 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.974+0000 7fd6150ad9c0 2 removed watcher, disabling cache 2024-09-12T00:36:59.976 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.974+0000 7fd6150ad9c0 20 remove_watcher() i=1 2024-09-12T00:36:59.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.978+0000 7fd6150ad9c0 20 remove_watcher() i=2 2024-09-12T00:36:59.979 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.978+0000 7fd6150ad9c0 20 remove_watcher() i=3 2024-09-12T00:36:59.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.982+0000 7fd6150ad9c0 20 remove_watcher() i=4 2024-09-12T00:36:59.983 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.982+0000 7fd6150ad9c0 20 remove_watcher() i=5 2024-09-12T00:36:59.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.982+0000 7fd6150ad9c0 20 remove_watcher() i=6 2024-09-12T00:36:59.985 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:36:59.986+0000 7fd6150ad9c0 20 remove_watcher() i=7 2024-09-12T00:36:59.999 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:36:59.999 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:36:59.999 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-set-target-layout id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:36:59.999 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:00.000 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-12T00:37:00.031 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:00.032 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:00.075 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.074+0000 7f27afc369c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.077 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.078+0000 7f27afc369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.077 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.078+0000 7f27afc369c0 20 realm 2024-09-12T00:37:00.077 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.078+0000 7f27afc369c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.077 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.078+0000 7f27afc369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.078 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.078+0000 7f27afc369c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:00.078 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.078+0000 7f27afc369c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.078 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.078+0000 7f27afc369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.078 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.078+0000 7f27afc369c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.078+0000 7f27afc369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:00.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.078+0000 7f27afc369c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.078+0000 7f27afc369c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:00.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.078+0000 7f27afc369c0 20 searching for the correct realm 2024-09-12T00:37:00.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.086+0000 7f27ad73c640 0 -- 172.21.15.43:0/3325408848 >> [v2:172.21.15.97:6816/489545787,v1:172.21.15.97:6817/489545787] conn(0x7f27a8060800 msgr2=0x7f27a805f270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:00.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.090+0000 7f27ad73c640 0 -- 172.21.15.43:0/3325408848 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f27a40f78c0 msgr2=0x7f27a410e300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:37:00.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.306+0000 7f27afc369c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:37:00.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.306+0000 7f27afc369c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:00.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.306+0000 7f27afc369c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:00.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.306+0000 7f27afc369c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:37:00.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.306+0000 7f27afc369c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:00.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.306+0000 7f27afc369c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:00.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.306+0000 7f27afc369c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.310+0000 7f27afc369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.310+0000 7f27afc369c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.310+0000 7f27afc369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:00.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.310+0000 7f27afc369c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.310+0000 7f27afc369c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:00.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.310+0000 7f27afc369c0 20 zone default found 2024-09-12T00:37:00.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.310+0000 7f27afc369c0 4 Realm: () 2024-09-12T00:37:00.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.310+0000 7f27afc369c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:37:00.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.310+0000 7f27afc369c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:37:00.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.310+0000 7f27afc369c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:00.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.310+0000 7f27afc369c0 20 zonegroup default 2024-09-12T00:37:00.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.310+0000 7f27afc369c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.310+0000 7f27afc369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.310+0000 7f27afc369c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.310+0000 7f27afc369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.310+0000 7f27afc369c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.314+0000 7f27afc369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.314+0000 7f27afc369c0 20 started sync module instance, tier type = 2024-09-12T00:37:00.314 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.314+0000 7f27afc369c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:37:00.336 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.334+0000 7f27afc369c0 20 add_watcher() i=0 2024-09-12T00:37:00.336 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.334+0000 7f27afc369c0 20 add_watcher() i=1 2024-09-12T00:37:00.336 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.334+0000 7f27afc369c0 20 add_watcher() i=2 2024-09-12T00:37:00.337 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.334+0000 7f27afc369c0 20 add_watcher() i=3 2024-09-12T00:37:00.337 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.334+0000 7f27afc369c0 20 add_watcher() i=4 2024-09-12T00:37:00.337 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.334+0000 7f27afc369c0 20 add_watcher() i=5 2024-09-12T00:37:00.337 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.338+0000 7f27afc369c0 20 add_watcher() i=6 2024-09-12T00:37:00.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.338+0000 7f27afc369c0 20 add_watcher() i=7 2024-09-12T00:37:00.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.338+0000 7f27afc369c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:00.343 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.342+0000 7f2663fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:00.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.342+0000 7f27afc369c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:00.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.342+0000 7f27afc369c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:00.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.342+0000 7f27afc369c0 5 note: GC not initialized 2024-09-12T00:37:00.345 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.342+0000 7f2662fe5640 20 reqs_thread_entry: start 2024-09-12T00:37:00.345 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.346+0000 7f27afc369c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:00.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.346+0000 7f27afc369c0 20 Filter name: none 2024-09-12T00:37:00.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.346+0000 7f2660fe1640 20 reqs_thread_entry: start 2024-09-12T00:37:00.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.346+0000 7f27afc369c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:37:00.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.346+0000 7f27afc369c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.346+0000 7f27afc369c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:37:00.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.346+0000 7f27afc369c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:37:00.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.346+0000 7f27afc369c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:37:00.347 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.346+0000 7f27afc369c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22 : miss 2024-09-12T00:37:00.347 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.346+0000 7f27afc369c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.347 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.346+0000 7f27afc369c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:37:00.347 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.346+0000 7f27afc369c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22 info.flags=0x17 2024-09-12T00:37:00.347 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.346+0000 7f27afc369c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22 to cache LRU end 2024-09-12T00:37:00.348 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.346+0000 7f27afc369c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:00.348 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.346+0000 7f27afc369c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:00.348 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.346+0000 7f27afc369c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22 2024-09-12T00:37:00.356 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.354+0000 7f27afc369c0 -1 Injecting error=-5 at location=set_target_layout 2024-09-12T00:37:00.356 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.354+0000 7f27afc369c0 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-12T00:37:00.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.366+0000 7f2663fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:00.371 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.370+0000 7f27afc369c0 20 remove_watcher() i=0 2024-09-12T00:37:00.371 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.370+0000 7f27afc369c0 2 removed watcher, disabling cache 2024-09-12T00:37:00.374 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.374+0000 7f27afc369c0 20 remove_watcher() i=1 2024-09-12T00:37:00.376 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.374+0000 7f27afc369c0 20 remove_watcher() i=2 2024-09-12T00:37:00.378 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.378+0000 7f27afc369c0 20 remove_watcher() i=3 2024-09-12T00:37:00.381 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.378+0000 7f27afc369c0 20 remove_watcher() i=4 2024-09-12T00:37:00.382 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.382+0000 7f27afc369c0 20 remove_watcher() i=5 2024-09-12T00:37:00.383 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.382+0000 7f27afc369c0 20 remove_watcher() i=6 2024-09-12T00:37:00.385 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.386+0000 7f27afc369c0 20 remove_watcher() i=7 2024-09-12T00:37:00.401 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:37:00.432 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:00.433 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:00.477 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.478+0000 7fda8250d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.480 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.478+0000 7fda8250d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.480 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.478+0000 7fda8250d9c0 20 realm 2024-09-12T00:37:00.480 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.478+0000 7fda8250d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.480 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.478+0000 7fda8250d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.480 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.478+0000 7fda8250d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:00.480 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.478+0000 7fda8250d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.480 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.478+0000 7fda8250d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.480 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.478+0000 7fda8250d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.481 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.482+0000 7fda8250d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:00.481 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.482+0000 7fda8250d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.482+0000 7fda8250d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:00.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.482+0000 7fda8250d9c0 20 searching for the correct realm 2024-09-12T00:37:00.488 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.486+0000 7fda7f812640 0 -- 172.21.15.43:0/3319041521 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x5572dde1e520 msgr2=0x5572dde20930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:00.495 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.494+0000 7fda7f812640 0 -- 172.21.15.43:0/3319041521 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fda74029040 msgr2=0x7fda7400a450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:00.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.502+0000 7fda8250d9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:37:00.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.502+0000 7fda8250d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:00.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.502+0000 7fda8250d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:00.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.502+0000 7fda8250d9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:37:00.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.502+0000 7fda8250d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:00.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.502+0000 7fda8250d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:00.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.502+0000 7fda8250d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.502+0000 7fda8250d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.502+0000 7fda8250d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.502+0000 7fda8250d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:00.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.502+0000 7fda8250d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.502+0000 7fda8250d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:00.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.502+0000 7fda8250d9c0 20 zone default found 2024-09-12T00:37:00.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.502+0000 7fda8250d9c0 4 Realm: () 2024-09-12T00:37:00.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.502+0000 7fda8250d9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:37:00.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.502+0000 7fda8250d9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:37:00.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.502+0000 7fda8250d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:00.505 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.502+0000 7fda8250d9c0 20 zonegroup default 2024-09-12T00:37:00.505 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.502+0000 7fda8250d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.505 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.502+0000 7fda8250d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.505 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.502+0000 7fda8250d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.505 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.506+0000 7fda8250d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.505 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.506+0000 7fda8250d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.505 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.506+0000 7fda8250d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.506+0000 7fda8250d9c0 20 started sync module instance, tier type = 2024-09-12T00:37:00.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.506+0000 7fda8250d9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:37:00.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.518+0000 7fda8250d9c0 20 add_watcher() i=0 2024-09-12T00:37:00.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.518+0000 7fda8250d9c0 20 add_watcher() i=1 2024-09-12T00:37:00.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.518+0000 7fda8250d9c0 20 add_watcher() i=2 2024-09-12T00:37:00.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.518+0000 7fda8250d9c0 20 add_watcher() i=3 2024-09-12T00:37:00.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.518+0000 7fda8250d9c0 20 add_watcher() i=4 2024-09-12T00:37:00.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.518+0000 7fda8250d9c0 20 add_watcher() i=5 2024-09-12T00:37:00.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.518+0000 7fda8250d9c0 20 add_watcher() i=6 2024-09-12T00:37:00.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.522+0000 7fda8250d9c0 20 add_watcher() i=7 2024-09-12T00:37:00.522 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.522+0000 7fda8250d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:00.524 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.522+0000 7fd936fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:00.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.522+0000 7fda8250d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:00.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.522+0000 7fda8250d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:00.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.522+0000 7fda8250d9c0 5 note: GC not initialized 2024-09-12T00:37:00.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.526+0000 7fd935fdb640 20 reqs_thread_entry: start 2024-09-12T00:37:00.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.526+0000 7fda8250d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:00.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.526+0000 7fda8250d9c0 20 Filter name: none 2024-09-12T00:37:00.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.526+0000 7fd8a77fe640 20 reqs_thread_entry: start 2024-09-12T00:37:00.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.526+0000 7fda8250d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.526+0000 7fda8250d9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:37:00.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.526+0000 7fda8250d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.527 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.526+0000 7fda8250d9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:37:00.527 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.526+0000 7fda8250d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:00.527 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.526+0000 7fda8250d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.527 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.526+0000 7fda8250d9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:37:00.527 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.526+0000 7fda8250d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.526+0000 7fda8250d9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:37:00.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.526+0000 7fda8250d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:00.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.530+0000 7fd936fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:00.536 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.534+0000 7fda8250d9c0 20 remove_watcher() i=0 2024-09-12T00:37:00.536 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.534+0000 7fda8250d9c0 2 removed watcher, disabling cache 2024-09-12T00:37:00.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.538+0000 7fda8250d9c0 20 remove_watcher() i=1 2024-09-12T00:37:00.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.538+0000 7fda8250d9c0 20 remove_watcher() i=2 2024-09-12T00:37:00.542 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.542+0000 7fda8250d9c0 20 remove_watcher() i=3 2024-09-12T00:37:00.544 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.542+0000 7fda8250d9c0 20 remove_watcher() i=4 2024-09-12T00:37:00.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.546+0000 7fda8250d9c0 20 remove_watcher() i=5 2024-09-12T00:37:00.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.546+0000 7fda8250d9c0 20 remove_watcher() i=6 2024-09-12T00:37:00.548 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.546+0000 7fda8250d9c0 20 remove_watcher() i=7 2024-09-12T00:37:00.561 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:00.562 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:37:00.562 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-set-target-layout id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:37:00.562 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:00.563 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:00.563 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:00.575 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:00.575 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:00.618 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:37:00.655 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:00.655 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:00.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.698+0000 7efea831b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.702+0000 7efea831b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.702+0000 7efea831b9c0 20 realm 2024-09-12T00:37:00.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.702+0000 7efea831b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.702+0000 7efea831b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.702+0000 7efea831b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:00.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.702+0000 7efea831b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.702+0000 7efea831b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.702+0000 7efea831b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.702+0000 7efea831b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:00.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.702+0000 7efea831b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.706+0000 7efea831b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:00.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.706+0000 7efea831b9c0 20 searching for the correct realm 2024-09-12T00:37:00.711 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.710+0000 7efea6622640 0 -- 172.21.15.43:0/894429285 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55ece4f0e7c0 msgr2=0x55ece4f10c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:00.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.718+0000 7efea5e21640 0 -- 172.21.15.43:0/894429285 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7efe9c0f8460 msgr2=0x7efe9c0f88c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:00.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.726+0000 7efea831b9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:37:00.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.726+0000 7efea831b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:00.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.726+0000 7efea831b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:00.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.726+0000 7efea831b9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:37:00.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.726+0000 7efea831b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:00.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.726+0000 7efea831b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:00.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.726+0000 7efea831b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.726+0000 7efea831b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.726+0000 7efea831b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.726+0000 7efea831b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:00.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.726+0000 7efea831b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.726+0000 7efea831b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:00.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.726+0000 7efea831b9c0 20 zone default found 2024-09-12T00:37:00.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.726+0000 7efea831b9c0 4 Realm: () 2024-09-12T00:37:00.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.726+0000 7efea831b9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:37:00.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.726+0000 7efea831b9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:37:00.730 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.726+0000 7efea831b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:00.730 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.726+0000 7efea831b9c0 20 zonegroup default 2024-09-12T00:37:00.730 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.726+0000 7efea831b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.730 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.726+0000 7efea831b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.730 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.726+0000 7efea831b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.730 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.726+0000 7efea831b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.726+0000 7efea831b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.726+0000 7efea831b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.726+0000 7efea831b9c0 20 started sync module instance, tier type = 2024-09-12T00:37:00.732 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.726+0000 7efea831b9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:37:00.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.742+0000 7efea831b9c0 20 add_watcher() i=0 2024-09-12T00:37:00.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.742+0000 7efea831b9c0 20 add_watcher() i=1 2024-09-12T00:37:00.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.742+0000 7efea831b9c0 20 add_watcher() i=2 2024-09-12T00:37:00.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.742+0000 7efea831b9c0 20 add_watcher() i=3 2024-09-12T00:37:00.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.742+0000 7efea831b9c0 20 add_watcher() i=4 2024-09-12T00:37:00.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.742+0000 7efea831b9c0 20 add_watcher() i=5 2024-09-12T00:37:00.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.742+0000 7efea831b9c0 20 add_watcher() i=6 2024-09-12T00:37:00.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.746+0000 7efea831b9c0 20 add_watcher() i=7 2024-09-12T00:37:00.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.746+0000 7efea831b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:00.748 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.746+0000 7efd577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:00.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.746+0000 7efea831b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:00.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.746+0000 7efea831b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:00.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.746+0000 7efea831b9c0 5 note: GC not initialized 2024-09-12T00:37:00.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.746+0000 7efd567fc640 20 reqs_thread_entry: start 2024-09-12T00:37:00.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.746+0000 7efea831b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:00.752 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.750+0000 7efea831b9c0 20 Filter name: none 2024-09-12T00:37:00.752 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.750+0000 7efcc7fff640 20 reqs_thread_entry: start 2024-09-12T00:37:00.753 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.750+0000 7efea831b9c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:37:00.753 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.750+0000 7efea831b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.753 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.750+0000 7efea831b9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:37:00.753 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.750+0000 7efea831b9c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:37:00.753 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.750+0000 7efea831b9c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:37:00.753 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.750+0000 7efea831b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22 : miss 2024-09-12T00:37:00.754 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.750+0000 7efea831b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.754 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.750+0000 7efea831b9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:37:00.754 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.750+0000 7efea831b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22 info.flags=0x17 2024-09-12T00:37:00.754 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.750+0000 7efea831b9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22 to cache LRU end 2024-09-12T00:37:00.754 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.750+0000 7efea831b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:00.754 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.750+0000 7efea831b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:00.754 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.750+0000 7efea831b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22 2024-09-12T00:37:00.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.762+0000 7efea831b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22 info.flags=0x17 2024-09-12T00:37:00.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.762+0000 7efea831b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22 to cache LRU end 2024-09-12T00:37:00.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.762+0000 7efea831b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:00.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.762+0000 7efea831b9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22, ofs0, ns] 2024-09-12T00:37:00.762 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.762+0000 7efd897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333472 cookie 94475941713488 notifier 6444 bl.length()=925 2024-09-12T00:37:00.762 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.762+0000 7efd897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22 info.flags=0x17 2024-09-12T00:37:00.762 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.762+0000 7efd897fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22 to cache LRU end 2024-09-12T00:37:00.762 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.762+0000 7efd897fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:00.762 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.762+0000 7efea831b9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22]): orig_sources= new_sources= 2024-09-12T00:37:00.762 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.762+0000 7efea831b9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22]): potential sources added=[] removed=[] 2024-09-12T00:37:00.763 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.762+0000 7efea831b9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22]): orig_dests= new_dests= 2024-09-12T00:37:00.763 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.762+0000 7efea831b9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22]): potential dests added=[] removed=[] 2024-09-12T00:37:00.772 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.770+0000 7efea831b9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.1.0 2024-09-12T00:37:00.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.770+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.1.0 2024-09-12T00:37:00.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.770+0000 7efea831b9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.1.1 2024-09-12T00:37:00.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.770+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.1.1 2024-09-12T00:37:00.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.770+0000 7efea831b9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.1.2 2024-09-12T00:37:00.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.770+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.1.2 2024-09-12T00:37:00.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.770+0000 7efea831b9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.1.3 2024-09-12T00:37:00.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.770+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.1.3 2024-09-12T00:37:00.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.770+0000 7efea831b9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.1.4 2024-09-12T00:37:00.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.770+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.1.4 2024-09-12T00:37:00.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.770+0000 7efea831b9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.1.5 2024-09-12T00:37:00.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.770+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.1.5 2024-09-12T00:37:00.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.770+0000 7efea831b9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.1.6 2024-09-12T00:37:00.774 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.770+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.1.6 2024-09-12T00:37:00.774 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.770+0000 7efea831b9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.1.7 2024-09-12T00:37:00.774 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.770+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.1.7 2024-09-12T00:37:00.774 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.770+0000 7efea831b9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.1.8 2024-09-12T00:37:00.774 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.770+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.1.8 2024-09-12T00:37:00.774 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.770+0000 7efea831b9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.1.9 2024-09-12T00:37:00.774 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.770+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.1.9 2024-09-12T00:37:00.774 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.770+0000 7efea831b9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.1.10 2024-09-12T00:37:00.774 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.770+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.1.10 2024-09-12T00:37:00.774 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.770+0000 7efea831b9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.1.11 2024-09-12T00:37:00.774 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.770+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.1.11 2024-09-12T00:37:00.774 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.770+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.0 2024-09-12T00:37:00.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.774+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.1 2024-09-12T00:37:00.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.774+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.2 2024-09-12T00:37:00.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.774+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.3 2024-09-12T00:37:00.777 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.778+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.4 2024-09-12T00:37:00.778 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.778+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.5 2024-09-12T00:37:00.779 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.778+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.6 2024-09-12T00:37:00.780 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.778+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.7 2024-09-12T00:37:00.781 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.782+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.8 2024-09-12T00:37:00.783 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.782+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.9 2024-09-12T00:37:00.783 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.782+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.10 2024-09-12T00:37:00.788 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.786+0000 7efea831b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22 : hit (requested=0x17, cached=0x17) 2024-09-12T00:37:00.788 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.786+0000 7efea831b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22 2024-09-12T00:37:00.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.790+0000 7efea831b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22 info.flags=0x17 2024-09-12T00:37:00.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.790+0000 7efea831b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22 to cache LRU end 2024-09-12T00:37:00.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.790+0000 7efea831b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:00.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.790+0000 7efea831b9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22, ofs0, ns] 2024-09-12T00:37:00.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.790+0000 7efd88ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333473 cookie 94475941713488 notifier 6444 bl.length()=925 2024-09-12T00:37:00.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.790+0000 7efd88ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22 info.flags=0x17 2024-09-12T00:37:00.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.790+0000 7efd88ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22 to cache LRU end 2024-09-12T00:37:00.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.790+0000 7efd88ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:00.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.790+0000 7efea831b9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22]): orig_sources= new_sources= 2024-09-12T00:37:00.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.790+0000 7efea831b9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22]): potential sources added=[] removed=[] 2024-09-12T00:37:00.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.790+0000 7efea831b9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22]): orig_dests= new_dests= 2024-09-12T00:37:00.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.790+0000 7efea831b9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22]): potential dests added=[] removed=[] 2024-09-12T00:37:00.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.798+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.0 2024-09-12T00:37:00.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.798+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.1 2024-09-12T00:37:00.799 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.798+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.2 2024-09-12T00:37:00.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.798+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.3 2024-09-12T00:37:00.801 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.802+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.4 2024-09-12T00:37:00.801 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.802+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.5 2024-09-12T00:37:00.802 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.802+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.6 2024-09-12T00:37:00.803 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.802+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.7 2024-09-12T00:37:00.803 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.802+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.8 2024-09-12T00:37:00.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.802+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.9 2024-09-12T00:37:00.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.806+0000 7efea831b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22.10 2024-09-12T00:37:00.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.806+0000 7efea831b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22 : hit (requested=0x17, cached=0x17) 2024-09-12T00:37:00.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.806+0000 7efea831b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22 2024-09-12T00:37:00.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.806+0000 7efea831b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22 info.flags=0x17 2024-09-12T00:37:00.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.806+0000 7efea831b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22 to cache LRU end 2024-09-12T00:37:00.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.806+0000 7efea831b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:00.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.806+0000 7efea831b9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22, ofs0, ns] 2024-09-12T00:37:00.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.810+0000 7efd897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333474 cookie 94475941713488 notifier 6444 bl.length()=893 2024-09-12T00:37:00.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.810+0000 7efd897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22 info.flags=0x17 2024-09-12T00:37:00.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.810+0000 7efd897fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22 to cache LRU end 2024-09-12T00:37:00.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.810+0000 7efd897fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:00.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.810+0000 7efea831b9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22]): orig_sources= new_sources= 2024-09-12T00:37:00.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.810+0000 7efea831b9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22]): potential sources added=[] removed=[] 2024-09-12T00:37:00.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.810+0000 7efea831b9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22]): orig_dests= new_dests= 2024-09-12T00:37:00.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.810+0000 7efea831b9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22]): potential dests added=[] removed=[] 2024-09-12T00:37:00.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.814+0000 7efea831b9c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:37:00.818 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.818+0000 7efd577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:00.823 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.822+0000 7efea831b9c0 20 remove_watcher() i=0 2024-09-12T00:37:00.823 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.822+0000 7efea831b9c0 2 removed watcher, disabling cache 2024-09-12T00:37:00.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.826+0000 7efea831b9c0 20 remove_watcher() i=1 2024-09-12T00:37:00.827 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.826+0000 7efea831b9c0 20 remove_watcher() i=2 2024-09-12T00:37:00.829 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.830+0000 7efea831b9c0 20 remove_watcher() i=3 2024-09-12T00:37:00.831 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.830+0000 7efea831b9c0 20 remove_watcher() i=4 2024-09-12T00:37:00.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.834+0000 7efea831b9c0 20 remove_watcher() i=5 2024-09-12T00:37:00.834 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.834+0000 7efea831b9c0 20 remove_watcher() i=6 2024-09-12T00:37:00.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.834+0000 7efea831b9c0 20 remove_watcher() i=7 2024-09-12T00:37:00.850 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:37:00.878 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:00.878 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:00.923 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.922+0000 7f8c2462c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.926 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.926+0000 7f8c2462c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.926 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.926+0000 7f8c2462c9c0 20 realm 2024-09-12T00:37:00.926 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.926+0000 7f8c2462c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.926 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.926+0000 7f8c2462c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.926 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.926+0000 7f8c2462c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:00.926 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.926+0000 7f8c2462c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.927 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.926+0000 7f8c2462c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.927 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.926+0000 7f8c2462c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.928 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.926+0000 7f8c2462c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:00.928 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.926+0000 7f8c2462c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.929 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.926+0000 7f8c2462c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:00.929 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.930+0000 7f8c2462c9c0 20 searching for the correct realm 2024-09-12T00:37:00.931 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.930+0000 7f8c22132640 0 -- 172.21.15.43:0/2158226101 >> [v2:172.21.15.97:6816/489545787,v1:172.21.15.97:6817/489545787] conn(0x7f8c1c0c5040 msgr2=0x7f8c1c0c6940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:00.937 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.938+0000 7f8c21931640 0 -- 172.21.15.43:0/2158226101 >> [v2:172.21.15.43:6816/653473197,v1:172.21.15.43:6817/653473197] conn(0x55c57929d6e0 msgr2=0x55c57929fad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:00.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.946+0000 7f8c2462c9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:37:00.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.946+0000 7f8c2462c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:00.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.946+0000 7f8c2462c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:00.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.946+0000 7f8c2462c9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:37:00.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.946+0000 7f8c2462c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:00.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.946+0000 7f8c2462c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:00.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.946+0000 7f8c2462c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.946+0000 7f8c2462c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.946+0000 7f8c2462c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.949 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.946+0000 7f8c2462c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:00.949 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.946+0000 7f8c2462c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.949 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.950+0000 7f8c2462c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:00.950 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.950+0000 7f8c2462c9c0 20 zone default found 2024-09-12T00:37:00.950 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.950+0000 7f8c2462c9c0 4 Realm: () 2024-09-12T00:37:00.950 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.950+0000 7f8c2462c9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:37:00.950 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.950+0000 7f8c2462c9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:37:00.950 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.950+0000 7f8c2462c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:00.950 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.950+0000 7f8c2462c9c0 20 zonegroup default 2024-09-12T00:37:00.950 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.950+0000 7f8c2462c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.950 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.950+0000 7f8c2462c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.950 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.950+0000 7f8c2462c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.950 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.950+0000 7f8c2462c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.950 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.950+0000 7f8c2462c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.951 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.950+0000 7f8c2462c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.951 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.950+0000 7f8c2462c9c0 20 started sync module instance, tier type = 2024-09-12T00:37:00.951 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.950+0000 7f8c2462c9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:37:00.966 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.966+0000 7f8c2462c9c0 20 add_watcher() i=0 2024-09-12T00:37:00.966 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.966+0000 7f8c2462c9c0 20 add_watcher() i=1 2024-09-12T00:37:00.966 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.966+0000 7f8c2462c9c0 20 add_watcher() i=2 2024-09-12T00:37:00.966 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.966+0000 7f8c2462c9c0 20 add_watcher() i=3 2024-09-12T00:37:00.966 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.966+0000 7f8c2462c9c0 20 add_watcher() i=4 2024-09-12T00:37:00.966 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.966+0000 7f8c2462c9c0 20 add_watcher() i=5 2024-09-12T00:37:00.966 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.966+0000 7f8c2462c9c0 20 add_watcher() i=6 2024-09-12T00:37:00.967 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.966+0000 7f8c2462c9c0 20 add_watcher() i=7 2024-09-12T00:37:00.967 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.966+0000 7f8c2462c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:00.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.970+0000 7f8ad8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:00.971 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.970+0000 7f8c2462c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:00.971 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.970+0000 7f8c2462c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:00.971 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.970+0000 7f8c2462c9c0 5 note: GC not initialized 2024-09-12T00:37:00.971 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.970+0000 7f8a537fe640 20 reqs_thread_entry: start 2024-09-12T00:37:00.971 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.970+0000 7f8c2462c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:00.971 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.970+0000 7f8c2462c9c0 20 Filter name: none 2024-09-12T00:37:00.971 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.970+0000 7f8a517fa640 20 reqs_thread_entry: start 2024-09-12T00:37:00.971 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.970+0000 7f8c2462c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.972 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.970+0000 7f8c2462c9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:37:00.972 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.970+0000 7f8c2462c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.973 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.970+0000 7f8c2462c9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:37:00.973 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.970+0000 7f8c2462c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:00.973 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.970+0000 7f8c2462c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.973 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.974+0000 7f8c2462c9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:37:00.973 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.974+0000 7f8c2462c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.973 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.974+0000 7f8c2462c9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:37:00.973 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.974+0000 7f8c2462c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:00.976 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.974+0000 7f8ad8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:00.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.982+0000 7f8c2462c9c0 20 remove_watcher() i=0 2024-09-12T00:37:00.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.982+0000 7f8c2462c9c0 2 removed watcher, disabling cache 2024-09-12T00:37:00.983 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.982+0000 7f8c2462c9c0 20 remove_watcher() i=1 2024-09-12T00:37:00.985 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.986+0000 7f8c2462c9c0 20 remove_watcher() i=2 2024-09-12T00:37:00.987 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.986+0000 7f8c2462c9c0 20 remove_watcher() i=3 2024-09-12T00:37:00.989 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.990+0000 7f8c2462c9c0 20 remove_watcher() i=4 2024-09-12T00:37:00.990 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.990+0000 7f8c2462c9c0 20 remove_watcher() i=5 2024-09-12T00:37:00.992 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.990+0000 7f8c2462c9c0 20 remove_watcher() i=6 2024-09-12T00:37:00.993 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:00.994+0000 7f8c2462c9c0 20 remove_watcher() i=7 2024-09-12T00:37:01.007 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:01.007 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:37:01.007 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-set-target-layout id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:37:01.007 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:01.008 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.008 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:01.011 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.011 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:01.055 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.055 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:01.096 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-12T00:37:01.096 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:01.097 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.097 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:01.115 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.115 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:01.158 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.158 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:01.177 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.177 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:01.195 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.195 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:01.213 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.213 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:01.233 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.233 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:01.251 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.251 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:01.270 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.270 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:01.288 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.288 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:01.308 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.308 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:01.327 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.327 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:01.345 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.345 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:01.364 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.364 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:01.383 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.383 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:01.401 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.401 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:01.419 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.419 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:01.437 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.438 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:01.458 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.458 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:01.476 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.477 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:01.494 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.494 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:01.512 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.512 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:01.529 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:37:01.563 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:01.563 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:01.608 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.606+0000 7f6767de89c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.610 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.610+0000 7f6767de89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.610 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.610+0000 7f6767de89c0 20 realm 2024-09-12T00:37:01.610 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.610+0000 7f6767de89c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.610 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.610+0000 7f6767de89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.611 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.610+0000 7f6767de89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:01.611 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.610+0000 7f6767de89c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.611 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.610+0000 7f6767de89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.611 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.610+0000 7f6767de89c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.612 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.610+0000 7f6767de89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:01.612 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.610+0000 7f6767de89c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.613 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.614+0000 7f6767de89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:01.613 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.614+0000 7f6767de89c0 20 searching for the correct realm 2024-09-12T00:37:01.620 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.618+0000 7f67650ed640 0 -- 172.21.15.43:0/889259376 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f675c024070 msgr2=0x7f675c092a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:01.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.626+0000 7f67650ed640 0 -- 172.21.15.43:0/889259376 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f6630080b00 msgr2=0x7f6630082f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:01.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.634+0000 7f6767de89c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:37:01.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.634+0000 7f6767de89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:01.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.634+0000 7f6767de89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:01.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.634+0000 7f6767de89c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:37:01.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.634+0000 7f6767de89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:01.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.634+0000 7f6767de89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:01.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.634+0000 7f6767de89c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.634+0000 7f6767de89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.634+0000 7f6767de89c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.634+0000 7f6767de89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:01.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.634+0000 7f6767de89c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.634+0000 7f6767de89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:01.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.634+0000 7f6767de89c0 20 zone default found 2024-09-12T00:37:01.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.634+0000 7f6767de89c0 4 Realm: () 2024-09-12T00:37:01.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.634+0000 7f6767de89c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:37:01.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.634+0000 7f6767de89c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:37:01.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.634+0000 7f6767de89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:01.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.634+0000 7f6767de89c0 20 zonegroup default 2024-09-12T00:37:01.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.634+0000 7f6767de89c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.634+0000 7f6767de89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.634+0000 7f6767de89c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.636 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.634+0000 7f6767de89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.636 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.634+0000 7f6767de89c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.636 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.634+0000 7f6767de89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.636 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.634+0000 7f6767de89c0 20 started sync module instance, tier type = 2024-09-12T00:37:01.636 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.634+0000 7f6767de89c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:37:01.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.650+0000 7f6767de89c0 20 add_watcher() i=0 2024-09-12T00:37:01.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.650+0000 7f6767de89c0 20 add_watcher() i=1 2024-09-12T00:37:01.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.650+0000 7f6767de89c0 20 add_watcher() i=2 2024-09-12T00:37:01.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.650+0000 7f6767de89c0 20 add_watcher() i=3 2024-09-12T00:37:01.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.650+0000 7f6767de89c0 20 add_watcher() i=4 2024-09-12T00:37:01.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.650+0000 7f6767de89c0 20 add_watcher() i=5 2024-09-12T00:37:01.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.650+0000 7f6767de89c0 20 add_watcher() i=6 2024-09-12T00:37:01.653 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.654+0000 7f6767de89c0 20 add_watcher() i=7 2024-09-12T00:37:01.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.654+0000 7f6767de89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:01.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.654+0000 7f66177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:01.657 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.654+0000 7f6767de89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:01.657 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.654+0000 7f6767de89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:01.657 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.654+0000 7f6767de89c0 5 note: GC not initialized 2024-09-12T00:37:01.657 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.654+0000 7f66167fc640 20 reqs_thread_entry: start 2024-09-12T00:37:01.657 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.654+0000 7f6767de89c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:01.657 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.654+0000 7f6767de89c0 20 Filter name: none 2024-09-12T00:37:01.657 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.654+0000 7f6587fff640 20 reqs_thread_entry: start 2024-09-12T00:37:01.657 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.658+0000 7f6767de89c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.658 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.658+0000 7f6767de89c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:37:01.658 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.658+0000 7f6767de89c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.658 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.658+0000 7f6767de89c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:37:01.658 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.658+0000 7f6767de89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:01.659 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.658+0000 7f6767de89c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.659 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.658+0000 7f6767de89c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:37:01.659 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.658+0000 7f6767de89c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.659 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.658+0000 7f6767de89c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:37:01.660 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.658+0000 7f6767de89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:01.662 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.662+0000 7f66177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:01.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.666+0000 7f6767de89c0 20 remove_watcher() i=0 2024-09-12T00:37:01.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.666+0000 7f6767de89c0 2 removed watcher, disabling cache 2024-09-12T00:37:01.669 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.670+0000 7f6767de89c0 20 remove_watcher() i=1 2024-09-12T00:37:01.671 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.670+0000 7f6767de89c0 20 remove_watcher() i=2 2024-09-12T00:37:01.673 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.674+0000 7f6767de89c0 20 remove_watcher() i=3 2024-09-12T00:37:01.675 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.674+0000 7f6767de89c0 20 remove_watcher() i=4 2024-09-12T00:37:01.676 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.674+0000 7f6767de89c0 20 remove_watcher() i=5 2024-09-12T00:37:01.677 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.678+0000 7f6767de89c0 20 remove_watcher() i=6 2024-09-12T00:37:01.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.678+0000 7f6767de89c0 20 remove_watcher() i=7 2024-09-12T00:37:01.693 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:01.693 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:37:01.694 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-set-target-layout id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:37:01.694 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:01.694 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-12T00:37:01.729 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:01.730 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:01.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.774+0000 7f8e4c6e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.774+0000 7f8e4c6e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.774+0000 7f8e4c6e49c0 20 realm 2024-09-12T00:37:01.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.774+0000 7f8e4c6e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.774+0000 7f8e4c6e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.774+0000 7f8e4c6e49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:01.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.774+0000 7f8e4c6e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.776 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.774+0000 7f8e4c6e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.776 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.774+0000 7f8e4c6e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.777 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.778+0000 7f8e4c6e49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:01.777 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.778+0000 7f8e4c6e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.778 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.778+0000 7f8e4c6e49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:01.778 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.778+0000 7f8e4c6e49c0 20 searching for the correct realm 2024-09-12T00:37:01.783 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.782+0000 7f8e4a9eb640 0 -- 172.21.15.43:0/4187542755 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55f5f2cc21c0 msgr2=0x55f5f2cc4650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:01.789 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.790+0000 7f8e4a1ea640 0 -- 172.21.15.43:0/4187542755 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f8e40052460 msgr2=0x7f8e400528c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:01.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.798+0000 7f8e4c6e49c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:37:01.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.798+0000 7f8e4c6e49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:01.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.798+0000 7f8e4c6e49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:01.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.798+0000 7f8e4c6e49c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:37:01.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.798+0000 7f8e4c6e49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:01.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.798+0000 7f8e4c6e49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:01.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.798+0000 7f8e4c6e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.798+0000 7f8e4c6e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.798+0000 7f8e4c6e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.798+0000 7f8e4c6e49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:01.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.798+0000 7f8e4c6e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.799 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.798+0000 7f8e4c6e49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:01.799 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.798+0000 7f8e4c6e49c0 20 zone default found 2024-09-12T00:37:01.799 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.798+0000 7f8e4c6e49c0 4 Realm: () 2024-09-12T00:37:01.799 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.798+0000 7f8e4c6e49c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:37:01.799 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.798+0000 7f8e4c6e49c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:37:01.799 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.798+0000 7f8e4c6e49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:01.799 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.798+0000 7f8e4c6e49c0 20 zonegroup default 2024-09-12T00:37:01.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.798+0000 7f8e4c6e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.798+0000 7f8e4c6e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.798+0000 7f8e4c6e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.798+0000 7f8e4c6e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.798+0000 7f8e4c6e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.798+0000 7f8e4c6e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.798+0000 7f8e4c6e49c0 20 started sync module instance, tier type = 2024-09-12T00:37:01.801 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.798+0000 7f8e4c6e49c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:37:01.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.814+0000 7f8e4c6e49c0 20 add_watcher() i=0 2024-09-12T00:37:01.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.814+0000 7f8e4c6e49c0 20 add_watcher() i=1 2024-09-12T00:37:01.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.814+0000 7f8e4c6e49c0 20 add_watcher() i=2 2024-09-12T00:37:01.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.814+0000 7f8e4c6e49c0 20 add_watcher() i=3 2024-09-12T00:37:01.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.814+0000 7f8e4c6e49c0 20 add_watcher() i=4 2024-09-12T00:37:01.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.814+0000 7f8e4c6e49c0 20 add_watcher() i=5 2024-09-12T00:37:01.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.814+0000 7f8e4c6e49c0 20 add_watcher() i=6 2024-09-12T00:37:01.817 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.818+0000 7f8e4c6e49c0 20 add_watcher() i=7 2024-09-12T00:37:01.817 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.818+0000 7f8e4c6e49c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:01.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.818+0000 7f8d00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:01.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.818+0000 7f8e4c6e49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:01.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.818+0000 7f8e4c6e49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:01.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.818+0000 7f8e4c6e49c0 5 note: GC not initialized 2024-09-12T00:37:01.821 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.818+0000 7f8c7b7fe640 20 reqs_thread_entry: start 2024-09-12T00:37:01.821 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.818+0000 7f8e4c6e49c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:01.821 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.818+0000 7f8e4c6e49c0 20 Filter name: none 2024-09-12T00:37:01.821 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.818+0000 7f8c797fa640 20 reqs_thread_entry: start 2024-09-12T00:37:01.821 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.818+0000 7f8e4c6e49c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:37:01.821 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.818+0000 7f8e4c6e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.821 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.822+0000 7f8e4c6e49c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:37:01.821 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.822+0000 7f8e4c6e49c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:37:01.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.822+0000 7f8e4c6e49c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:37:01.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.822+0000 7f8e4c6e49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23 : miss 2024-09-12T00:37:01.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.822+0000 7f8e4c6e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.822+0000 7f8e4c6e49c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:37:01.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.822+0000 7f8e4c6e49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23 info.flags=0x17 2024-09-12T00:37:01.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.822+0000 7f8e4c6e49c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23 to cache LRU end 2024-09-12T00:37:01.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.822+0000 7f8e4c6e49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:01.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.822+0000 7f8e4c6e49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:01.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.822+0000 7f8e4c6e49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23 2024-09-12T00:37:01.828 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.826+0000 7f8e4c6e49c0 -1 Injecting error=-125 at location=set_target_layout 2024-09-12T00:37:01.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.830+0000 7f8e4c6e49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23 info.flags=0x17 2024-09-12T00:37:01.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.830+0000 7f8e4c6e49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23 to cache LRU end 2024-09-12T00:37:01.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.830+0000 7f8e4c6e49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:01.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.830+0000 7f8e4c6e49c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23, ofs0, ns] 2024-09-12T00:37:01.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.830+0000 7f8d2dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333477 cookie 94514828890992 notifier 6239 bl.length()=925 2024-09-12T00:37:01.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.830+0000 7f8d2dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23 info.flags=0x17 2024-09-12T00:37:01.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.830+0000 7f8d2dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23 to cache LRU end 2024-09-12T00:37:01.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.830+0000 7f8d2dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:01.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.834+0000 7f8e4c6e49c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23]): orig_sources= new_sources= 2024-09-12T00:37:01.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.834+0000 7f8e4c6e49c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23]): potential sources added=[] removed=[] 2024-09-12T00:37:01.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.834+0000 7f8e4c6e49c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23]): orig_dests= new_dests= 2024-09-12T00:37:01.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.834+0000 7f8e4c6e49c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23]): potential dests added=[] removed=[] 2024-09-12T00:37:01.844 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.842+0000 7f8e4c6e49c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.1.0 2024-09-12T00:37:01.844 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.842+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.1.0 2024-09-12T00:37:01.844 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.842+0000 7f8e4c6e49c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.1.1 2024-09-12T00:37:01.844 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.842+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.1.1 2024-09-12T00:37:01.844 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.842+0000 7f8e4c6e49c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.1.2 2024-09-12T00:37:01.844 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.842+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.1.2 2024-09-12T00:37:01.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.842+0000 7f8e4c6e49c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.1.3 2024-09-12T00:37:01.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.842+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.1.3 2024-09-12T00:37:01.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.842+0000 7f8e4c6e49c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.1.4 2024-09-12T00:37:01.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.842+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.1.4 2024-09-12T00:37:01.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.842+0000 7f8e4c6e49c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.1.5 2024-09-12T00:37:01.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.842+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.1.5 2024-09-12T00:37:01.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.842+0000 7f8e4c6e49c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.1.6 2024-09-12T00:37:01.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.842+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.1.6 2024-09-12T00:37:01.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.842+0000 7f8e4c6e49c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.1.7 2024-09-12T00:37:01.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.842+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.1.7 2024-09-12T00:37:01.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.842+0000 7f8e4c6e49c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.1.8 2024-09-12T00:37:01.846 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.842+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.1.8 2024-09-12T00:37:01.846 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.842+0000 7f8e4c6e49c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.1.9 2024-09-12T00:37:01.846 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.842+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.1.9 2024-09-12T00:37:01.846 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.842+0000 7f8e4c6e49c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.1.10 2024-09-12T00:37:01.846 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.842+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.1.10 2024-09-12T00:37:01.846 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.842+0000 7f8e4c6e49c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.1.11 2024-09-12T00:37:01.846 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.842+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.1.11 2024-09-12T00:37:01.846 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.842+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.0 2024-09-12T00:37:01.846 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.842+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.1 2024-09-12T00:37:01.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.846+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.2 2024-09-12T00:37:01.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.846+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.3 2024-09-12T00:37:01.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.846+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.4 2024-09-12T00:37:01.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.850+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.5 2024-09-12T00:37:01.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.850+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.6 2024-09-12T00:37:01.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.850+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.7 2024-09-12T00:37:01.852 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.850+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.8 2024-09-12T00:37:01.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.854+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.9 2024-09-12T00:37:01.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.854+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.10 2024-09-12T00:37:01.860 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.858+0000 7f8e4c6e49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23 : hit (requested=0x17, cached=0x17) 2024-09-12T00:37:01.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.858+0000 7f8e4c6e49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23 2024-09-12T00:37:01.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.862+0000 7f8e4c6e49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23 info.flags=0x17 2024-09-12T00:37:01.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.862+0000 7f8e4c6e49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23 to cache LRU end 2024-09-12T00:37:01.864 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.862+0000 7f8e4c6e49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:01.864 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.862+0000 7f8e4c6e49c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23, ofs0, ns] 2024-09-12T00:37:01.864 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.862+0000 7f8d2d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333478 cookie 94514828890992 notifier 6239 bl.length()=925 2024-09-12T00:37:01.864 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.862+0000 7f8d2d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23 info.flags=0x17 2024-09-12T00:37:01.864 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.862+0000 7f8d2d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23 to cache LRU end 2024-09-12T00:37:01.864 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.862+0000 7f8d2d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:01.865 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.862+0000 7f8e4c6e49c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23]): orig_sources= new_sources= 2024-09-12T00:37:01.865 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.862+0000 7f8e4c6e49c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23]): potential sources added=[] removed=[] 2024-09-12T00:37:01.865 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.862+0000 7f8e4c6e49c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23]): orig_dests= new_dests= 2024-09-12T00:37:01.865 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.862+0000 7f8e4c6e49c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23]): potential dests added=[] removed=[] 2024-09-12T00:37:01.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.870+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.0 2024-09-12T00:37:01.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.870+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.1 2024-09-12T00:37:01.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.870+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.2 2024-09-12T00:37:01.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.870+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.3 2024-09-12T00:37:01.872 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.870+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.4 2024-09-12T00:37:01.873 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.874+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.5 2024-09-12T00:37:01.874 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.874+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.6 2024-09-12T00:37:01.874 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.874+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.7 2024-09-12T00:37:01.875 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.874+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.8 2024-09-12T00:37:01.876 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.874+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.9 2024-09-12T00:37:01.876 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.874+0000 7f8e4c6e49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23.10 2024-09-12T00:37:01.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.878+0000 7f8e4c6e49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23 : hit (requested=0x17, cached=0x17) 2024-09-12T00:37:01.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.878+0000 7f8e4c6e49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23 2024-09-12T00:37:01.880 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.878+0000 7f8e4c6e49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23 info.flags=0x17 2024-09-12T00:37:01.880 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.878+0000 7f8e4c6e49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23 to cache LRU end 2024-09-12T00:37:01.880 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.878+0000 7f8e4c6e49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:01.880 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.878+0000 7f8e4c6e49c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23, ofs0, ns] 2024-09-12T00:37:01.881 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.878+0000 7f8d2dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333479 cookie 94514828890992 notifier 6239 bl.length()=893 2024-09-12T00:37:01.881 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.878+0000 7f8d2dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23 info.flags=0x17 2024-09-12T00:37:01.881 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.878+0000 7f8d2dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23 to cache LRU end 2024-09-12T00:37:01.882 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.878+0000 7f8d2dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:01.882 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.882+0000 7f8e4c6e49c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23]): orig_sources= new_sources= 2024-09-12T00:37:01.882 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.882+0000 7f8e4c6e49c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23]): potential sources added=[] removed=[] 2024-09-12T00:37:01.882 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.882+0000 7f8e4c6e49c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23]): orig_dests= new_dests= 2024-09-12T00:37:01.882 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.882+0000 7f8e4c6e49c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23]): potential dests added=[] removed=[] 2024-09-12T00:37:01.887 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.886+0000 7f8e4c6e49c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:37:01.890 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.890+0000 7f8d00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:01.895 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.894+0000 7f8e4c6e49c0 20 remove_watcher() i=0 2024-09-12T00:37:01.895 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.894+0000 7f8e4c6e49c0 2 removed watcher, disabling cache 2024-09-12T00:37:01.897 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.898+0000 7f8e4c6e49c0 20 remove_watcher() i=1 2024-09-12T00:37:01.900 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.898+0000 7f8e4c6e49c0 20 remove_watcher() i=2 2024-09-12T00:37:01.902 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.902+0000 7f8e4c6e49c0 20 remove_watcher() i=3 2024-09-12T00:37:01.904 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.902+0000 7f8e4c6e49c0 20 remove_watcher() i=4 2024-09-12T00:37:01.905 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.906+0000 7f8e4c6e49c0 20 remove_watcher() i=5 2024-09-12T00:37:01.906 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.906+0000 7f8e4c6e49c0 20 remove_watcher() i=6 2024-09-12T00:37:01.908 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.906+0000 7f8e4c6e49c0 20 remove_watcher() i=7 2024-09-12T00:37:01.923 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:37:01.950 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:01.951 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:01.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.994+0000 7f0ecd9719c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.994+0000 7f0ecd9719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.994+0000 7f0ecd9719c0 20 realm 2024-09-12T00:37:01.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.994+0000 7f0ecd9719c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.994+0000 7f0ecd9719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.994+0000 7f0ecd9719c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:01.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.994+0000 7f0ecd9719c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.994+0000 7f0ecd9719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.994+0000 7f0ecd9719c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.998 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.998+0000 7f0ecd9719c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:01.998 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.998+0000 7f0ecd9719c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.999 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.998+0000 7f0ecd9719c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:01.999 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:01.998+0000 7f0ecd9719c0 20 searching for the correct realm 2024-09-12T00:37:02.004 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.002+0000 7f0ecbc78640 0 -- 172.21.15.43:0/13435989 >> [v2:172.21.15.43:6808/2258408181,v1:172.21.15.43:6809/2258408181] conn(0x555d958d8d00 msgr2=0x555d958db1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:02.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.010+0000 7f0ecb477640 0 -- 172.21.15.43:0/13435989 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f0ec00f7780 msgr2=0x7f0ec00f9850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:02.019 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.018+0000 7f0ecd9719c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:37:02.019 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.018+0000 7f0ecd9719c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:02.019 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.018+0000 7f0ecd9719c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:02.019 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.018+0000 7f0ecd9719c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:37:02.019 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.018+0000 7f0ecd9719c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:02.019 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.018+0000 7f0ecd9719c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:02.019 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.018+0000 7f0ecd9719c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.019 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.018+0000 7f0ecd9719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.019 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.018+0000 7f0ecd9719c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.020 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.018+0000 7f0ecd9719c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:02.020 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.018+0000 7f0ecd9719c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.020 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.018+0000 7f0ecd9719c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:02.021 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.018+0000 7f0ecd9719c0 20 zone default found 2024-09-12T00:37:02.021 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.018+0000 7f0ecd9719c0 4 Realm: () 2024-09-12T00:37:02.021 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.018+0000 7f0ecd9719c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:37:02.021 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.018+0000 7f0ecd9719c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:37:02.021 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.018+0000 7f0ecd9719c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:02.021 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.018+0000 7f0ecd9719c0 20 zonegroup default 2024-09-12T00:37:02.021 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.018+0000 7f0ecd9719c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.021 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.018+0000 7f0ecd9719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.021 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.018+0000 7f0ecd9719c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.022+0000 7f0ecd9719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.022+0000 7f0ecd9719c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.022+0000 7f0ecd9719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.022+0000 7f0ecd9719c0 20 started sync module instance, tier type = 2024-09-12T00:37:02.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.022+0000 7f0ecd9719c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:37:02.037 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.038+0000 7f0ecd9719c0 20 add_watcher() i=0 2024-09-12T00:37:02.038 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.038+0000 7f0ecd9719c0 20 add_watcher() i=1 2024-09-12T00:37:02.038 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.038+0000 7f0ecd9719c0 20 add_watcher() i=2 2024-09-12T00:37:02.038 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.038+0000 7f0ecd9719c0 20 add_watcher() i=3 2024-09-12T00:37:02.038 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.038+0000 7f0ecd9719c0 20 add_watcher() i=4 2024-09-12T00:37:02.038 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.038+0000 7f0ecd9719c0 20 add_watcher() i=5 2024-09-12T00:37:02.038 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.038+0000 7f0ecd9719c0 20 add_watcher() i=6 2024-09-12T00:37:02.039 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.038+0000 7f0ecd9719c0 20 add_watcher() i=7 2024-09-12T00:37:02.039 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.038+0000 7f0ecd9719c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:02.041 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.042+0000 7f0d81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:02.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.042+0000 7f0ecd9719c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:02.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.042+0000 7f0ecd9719c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:02.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.042+0000 7f0ecd9719c0 5 note: GC not initialized 2024-09-12T00:37:02.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.042+0000 7f0d80fe1640 20 reqs_thread_entry: start 2024-09-12T00:37:02.043 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.042+0000 7f0ecd9719c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:02.043 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.042+0000 7f0ecd9719c0 20 Filter name: none 2024-09-12T00:37:02.043 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.042+0000 7f0cfa7fc640 20 reqs_thread_entry: start 2024-09-12T00:37:02.043 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.042+0000 7f0ecd9719c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.043 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.042+0000 7f0ecd9719c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:37:02.043 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.042+0000 7f0ecd9719c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.042+0000 7f0ecd9719c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:37:02.045 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.042+0000 7f0ecd9719c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:02.045 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.042+0000 7f0ecd9719c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.045 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.042+0000 7f0ecd9719c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:37:02.045 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.042+0000 7f0ecd9719c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.046 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.046+0000 7f0ecd9719c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:37:02.046 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.046+0000 7f0ecd9719c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:02.048 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.046+0000 7f0d81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:02.053 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.054+0000 7f0ecd9719c0 20 remove_watcher() i=0 2024-09-12T00:37:02.053 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.054+0000 7f0ecd9719c0 2 removed watcher, disabling cache 2024-09-12T00:37:02.055 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.054+0000 7f0ecd9719c0 20 remove_watcher() i=1 2024-09-12T00:37:02.057 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.058+0000 7f0ecd9719c0 20 remove_watcher() i=2 2024-09-12T00:37:02.059 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.058+0000 7f0ecd9719c0 20 remove_watcher() i=3 2024-09-12T00:37:02.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.062+0000 7f0ecd9719c0 20 remove_watcher() i=4 2024-09-12T00:37:02.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.062+0000 7f0ecd9719c0 20 remove_watcher() i=5 2024-09-12T00:37:02.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.062+0000 7f0ecd9719c0 20 remove_watcher() i=6 2024-09-12T00:37:02.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.066+0000 7f0ecd9719c0 20 remove_watcher() i=7 2024-09-12T00:37:02.079 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:02.079 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:37:02.079 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-set-target-layout id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T00:37:02.079 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:02.080 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.081 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:02.083 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.083 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:02.127 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.127 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:02.172 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-12T00:37:02.173 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:02.174 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.174 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:02.195 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.195 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:02.245 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.245 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:02.265 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.265 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:02.285 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.285 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:02.305 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.305 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:02.324 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.324 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:02.344 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.344 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:02.366 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.367 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:02.385 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.385 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:02.405 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.405 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:02.424 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.424 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:02.444 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.444 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:02.463 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.463 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:02.482 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.482 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:02.501 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.501 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:02.520 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.520 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:02.539 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.540 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:02.559 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.559 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:02.577 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.577 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:02.596 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.596 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:02.615 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.616 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:02.632 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:37:02.665 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:02.665 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:02.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.710+0000 7f82173b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.714+0000 7f82173b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.714+0000 7f82173b69c0 20 realm 2024-09-12T00:37:02.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.714+0000 7f82173b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.714+0000 7f82173b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.714+0000 7f82173b69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:02.715 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.714+0000 7f82173b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.715 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.714+0000 7f82173b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.715 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.714+0000 7f82173b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.714+0000 7f82173b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:02.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.714+0000 7f82173b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.718+0000 7f82173b69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:02.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.718+0000 7f82173b69c0 20 searching for the correct realm 2024-09-12T00:37:02.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.722+0000 7f8214ebc640 0 -- 172.21.15.43:0/738393078 >> [v2:172.21.15.97:6816/489545787,v1:172.21.15.97:6817/489545787] conn(0x7f820c0623e0 msgr2=0x7f820c060e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:02.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.726+0000 7f8214ebc640 0 -- 172.21.15.43:0/738393078 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f82080df420 msgr2=0x7f82080df8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:37:02.944 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.942+0000 7f82173b69c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:37:02.944 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.942+0000 7f82173b69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:02.944 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.942+0000 7f82173b69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:02.944 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.942+0000 7f82173b69c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:37:02.944 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.942+0000 7f82173b69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:02.945 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.942+0000 7f82173b69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:02.945 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.942+0000 7f82173b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.945 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.942+0000 7f82173b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.945 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.942+0000 7f82173b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.945 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.946+0000 7f82173b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:02.946 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.946+0000 7f82173b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.946 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.946+0000 7f82173b69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:02.946 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.946+0000 7f82173b69c0 20 zone default found 2024-09-12T00:37:02.946 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.946+0000 7f82173b69c0 4 Realm: () 2024-09-12T00:37:02.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.946+0000 7f82173b69c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:37:02.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.946+0000 7f82173b69c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:37:02.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.946+0000 7f82173b69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:02.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.946+0000 7f82173b69c0 20 zonegroup default 2024-09-12T00:37:02.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.946+0000 7f82173b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.946+0000 7f82173b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.946+0000 7f82173b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.946+0000 7f82173b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.946+0000 7f82173b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.949 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.950+0000 7f82173b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.949 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.950+0000 7f82173b69c0 20 started sync module instance, tier type = 2024-09-12T00:37:02.949 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.950+0000 7f82173b69c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:37:02.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.970+0000 7f82173b69c0 20 add_watcher() i=0 2024-09-12T00:37:02.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.970+0000 7f82173b69c0 20 add_watcher() i=1 2024-09-12T00:37:02.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.970+0000 7f82173b69c0 20 add_watcher() i=2 2024-09-12T00:37:02.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.970+0000 7f82173b69c0 20 add_watcher() i=3 2024-09-12T00:37:02.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.970+0000 7f82173b69c0 20 add_watcher() i=4 2024-09-12T00:37:02.971 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.970+0000 7f82173b69c0 20 add_watcher() i=5 2024-09-12T00:37:02.971 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.970+0000 7f82173b69c0 20 add_watcher() i=6 2024-09-12T00:37:02.972 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.970+0000 7f82173b69c0 20 add_watcher() i=7 2024-09-12T00:37:02.972 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.970+0000 7f82173b69c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:02.976 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.974+0000 7f80cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:02.976 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.974+0000 7f82173b69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:02.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.974+0000 7f82173b69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:02.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.974+0000 7f82173b69c0 5 note: GC not initialized 2024-09-12T00:37:02.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.978+0000 7f80ca7e4640 20 reqs_thread_entry: start 2024-09-12T00:37:02.978 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.978+0000 7f82173b69c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:02.978 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.978+0000 7f82173b69c0 20 Filter name: none 2024-09-12T00:37:02.978 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.978+0000 7f80c37fe640 20 reqs_thread_entry: start 2024-09-12T00:37:02.978 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.978+0000 7f82173b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.979 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.978+0000 7f82173b69c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:37:02.979 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.978+0000 7f82173b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.980 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.978+0000 7f82173b69c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:37:02.980 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.978+0000 7f82173b69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:02.980 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.978+0000 7f82173b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.982+0000 7f82173b69c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:37:02.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.982+0000 7f82173b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.982+0000 7f82173b69c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:37:02.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.982+0000 7f82173b69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:02.985 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.986+0000 7f80cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:02.990 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.990+0000 7f82173b69c0 20 remove_watcher() i=0 2024-09-12T00:37:02.991 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.990+0000 7f82173b69c0 2 removed watcher, disabling cache 2024-09-12T00:37:02.993 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.994+0000 7f82173b69c0 20 remove_watcher() i=1 2024-09-12T00:37:02.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.994+0000 7f82173b69c0 20 remove_watcher() i=2 2024-09-12T00:37:02.998 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:02.998+0000 7f82173b69c0 20 remove_watcher() i=3 2024-09-12T00:37:03.001 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.002+0000 7f82173b69c0 20 remove_watcher() i=4 2024-09-12T00:37:03.002 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.002+0000 7f82173b69c0 20 remove_watcher() i=5 2024-09-12T00:37:03.004 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.002+0000 7f82173b69c0 20 remove_watcher() i=6 2024-09-12T00:37:03.005 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.006+0000 7f82173b69c0 20 remove_watcher() i=7 2024-09-12T00:37:03.020 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.020 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:37:03.020 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: abort-at-set-target-layout id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:37:03.020 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.021 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-12T00:37:03.059 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:03.059 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:03.102 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.102+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.102+0000 7fad7cce79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.102+0000 7fad7cce79c0 20 realm 2024-09-12T00:37:03.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.102+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.102+0000 7fad7cce79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.102+0000 7fad7cce79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:03.105 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.102+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.105 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.102+0000 7fad7cce79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.105 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.102+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.106+0000 7fad7cce79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:03.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.106+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.106+0000 7fad7cce79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:03.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.106+0000 7fad7cce79c0 20 searching for the correct realm 2024-09-12T00:37:03.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.110+0000 7fad79fec640 0 -- 172.21.15.43:0/1311472971 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x559c3a6af940 msgr2=0x559c3a6b1dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:03.119 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.118+0000 7fad7a7ed640 0 -- 172.21.15.43:0/1311472971 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fad70061940 msgr2=0x7fad70034410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:03.127 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:37:03.127 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:03.127 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:03.127 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:37:03.127 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:03.127 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:03.127 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:03.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:03.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 zone default found 2024-09-12T00:37:03.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.126+0000 7fad7cce79c0 4 Realm: () 2024-09-12T00:37:03.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.126+0000 7fad7cce79c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:37:03.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.126+0000 7fad7cce79c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:37:03.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.126+0000 7fad7cce79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:03.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 zonegroup default 2024-09-12T00:37:03.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.130 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.130+0000 7fad7cce79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.130 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.130+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.130 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.130+0000 7fad7cce79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.130 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.130+0000 7fad7cce79c0 20 started sync module instance, tier type = 2024-09-12T00:37:03.130 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.130+0000 7fad7cce79c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:37:03.145 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.146+0000 7fad7cce79c0 20 add_watcher() i=0 2024-09-12T00:37:03.145 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.146+0000 7fad7cce79c0 20 add_watcher() i=1 2024-09-12T00:37:03.145 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.146+0000 7fad7cce79c0 20 add_watcher() i=2 2024-09-12T00:37:03.145 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.146+0000 7fad7cce79c0 20 add_watcher() i=3 2024-09-12T00:37:03.145 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.146+0000 7fad7cce79c0 20 add_watcher() i=4 2024-09-12T00:37:03.145 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.146+0000 7fad7cce79c0 20 add_watcher() i=5 2024-09-12T00:37:03.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.146+0000 7fad7cce79c0 20 add_watcher() i=6 2024-09-12T00:37:03.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.146+0000 7fad7cce79c0 20 add_watcher() i=7 2024-09-12T00:37:03.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.146+0000 7fad7cce79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:03.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.146+0000 7fac30fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:03.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.150+0000 7fad7cce79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:03.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.150+0000 7fad7cce79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:03.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 note: GC not initialized 2024-09-12T00:37:03.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.150+0000 7fabab7fe640 20 reqs_thread_entry: start 2024-09-12T00:37:03.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.150+0000 7fad7cce79c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:03.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.150+0000 7fad7cce79c0 20 Filter name: none 2024-09-12T00:37:03.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.150+0000 7faba97fa640 20 reqs_thread_entry: start 2024-09-12T00:37:03.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.150+0000 7fad7cce79c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:37:03.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.150+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.150+0000 7fad7cce79c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:37:03.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.150+0000 7fad7cce79c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:37:03.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.150+0000 7fad7cce79c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:37:03.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.150+0000 7fad7cce79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 : miss 2024-09-12T00:37:03.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.150+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.150+0000 7fad7cce79c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:37:03.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.150+0000 7fad7cce79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 info.flags=0x17 2024-09-12T00:37:03.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.150+0000 7fad7cce79c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 to cache LRU end 2024-09-12T00:37:03.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.150+0000 7fad7cce79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:03.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.150+0000 7fad7cce79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:03.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.150+0000 7fad7cce79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 2024-09-12T00:37:03.158 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fad7cce79c0 time 2024-09-12T00:37:03.162508+0000 2024-09-12T00:37:03.158 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:37:03.159 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:03.160 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fad805c12eb] 2024-09-12T00:37:03.160 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fad805c149f] 2024-09-12T00:37:03.160 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559c38ed2cc1] 2024-09-12T00:37:03.160 INFO:tasks.workunit.client.0.smithi043.stderr: 4: radosgw-admin(+0x1422078) [0x559c39930078] 2024-09-12T00:37:03.160 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559c38ee7ced] 2024-09-12T00:37:03.160 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:37:03.160 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fad7f427d90] 2024-09-12T00:37:03.160 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:37:03.160 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:37:03.160 INFO:tasks.workunit.client.0.smithi043.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:37:03.160 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7fad7cce79c0 thread_name:radosgw-admin 2024-09-12T00:37:03.160 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.158+0000 7fad7cce79c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fad7cce79c0 time 2024-09-12T00:37:03.162508+0000 2024-09-12T00:37:03.160 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:37:03.161 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.161 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:03.161 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fad805c12eb] 2024-09-12T00:37:03.161 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fad805c149f] 2024-09-12T00:37:03.161 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559c38ed2cc1] 2024-09-12T00:37:03.161 INFO:tasks.workunit.client.0.smithi043.stderr: 4: radosgw-admin(+0x1422078) [0x559c39930078] 2024-09-12T00:37:03.161 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559c38ee7ced] 2024-09-12T00:37:03.161 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:37:03.161 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fad7f427d90] 2024-09-12T00:37:03.161 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:37:03.161 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:37:03.161 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.178 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:03.178 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fad7f440520] 2024-09-12T00:37:03.178 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:37:03.178 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:37:03.179 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:37:03.179 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fad805c1345] 2024-09-12T00:37:03.179 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fad805c149f] 2024-09-12T00:37:03.179 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559c38ed2cc1] 2024-09-12T00:37:03.179 INFO:tasks.workunit.client.0.smithi043.stderr: 8: radosgw-admin(+0x1422078) [0x559c39930078] 2024-09-12T00:37:03.179 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559c38ee7ced] 2024-09-12T00:37:03.179 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:37:03.179 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fad7f427d90] 2024-09-12T00:37:03.179 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:37:03.179 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:37:03.179 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.162+0000 7fad7cce79c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:37:03.179 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7fad7cce79c0 thread_name:radosgw-admin 2024-09-12T00:37:03.180 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.180 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:03.180 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fad7f440520] 2024-09-12T00:37:03.180 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:37:03.180 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:37:03.180 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:37:03.180 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fad805c1345] 2024-09-12T00:37:03.180 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fad805c149f] 2024-09-12T00:37:03.180 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559c38ed2cc1] 2024-09-12T00:37:03.180 INFO:tasks.workunit.client.0.smithi043.stderr: 8: radosgw-admin(+0x1422078) [0x559c39930078] 2024-09-12T00:37:03.180 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559c38ee7ced] 2024-09-12T00:37:03.180 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:37:03.180 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fad7f427d90] 2024-09-12T00:37:03.181 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:37:03.181 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:37:03.181 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:37:03.181 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.181 INFO:tasks.workunit.client.0.smithi043.stderr:--- begin dump of recent events --- 2024-09-12T00:37:03.181 INFO:tasks.workunit.client.0.smithi043.stderr: -499> 2024-09-12T00:37:03.078+0000 7fad7a7ed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:03.181 INFO:tasks.workunit.client.0.smithi043.stderr: -498> 2024-09-12T00:37:03.078+0000 7fad7a7ed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:03.181 INFO:tasks.workunit.client.0.smithi043.stderr: -497> 2024-09-12T00:37:03.078+0000 7fad7afee640 10 monclient(hunting): get_auth_request con 0x559c3a512170 auth_method 0 2024-09-12T00:37:03.181 INFO:tasks.workunit.client.0.smithi043.stderr: -496> 2024-09-12T00:37:03.078+0000 7fad7afee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.181 INFO:tasks.workunit.client.0.smithi043.stderr: -495> 2024-09-12T00:37:03.078+0000 7fad7afee640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.181 INFO:tasks.workunit.client.0.smithi043.stderr: -494> 2024-09-12T00:37:03.078+0000 7fad7afee640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.181 INFO:tasks.workunit.client.0.smithi043.stderr: -493> 2024-09-12T00:37:03.078+0000 7fad7a7ed640 10 monclient(hunting): handle_auth_done global_id 6549 payload 274 2024-09-12T00:37:03.181 INFO:tasks.workunit.client.0.smithi043.stderr: -492> 2024-09-12T00:37:03.078+0000 7fad7a7ed640 10 monclient: _finish_hunting 0 2024-09-12T00:37:03.182 INFO:tasks.workunit.client.0.smithi043.stderr: -491> 2024-09-12T00:37:03.078+0000 7fad7a7ed640 1 monclient: found mon.noname-a 2024-09-12T00:37:03.182 INFO:tasks.workunit.client.0.smithi043.stderr: -490> 2024-09-12T00:37:03.078+0000 7fad7a7ed640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:37:03.182 INFO:tasks.workunit.client.0.smithi043.stderr: -489> 2024-09-12T00:37:03.082+0000 7fac68608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:03.182 INFO:tasks.workunit.client.0.smithi043.stderr: -488> 2024-09-12T00:37:03.082+0000 7fac68608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:03.182 INFO:tasks.workunit.client.0.smithi043.stderr: -487> 2024-09-12T00:37:03.082+0000 7fac68608640 10 monclient: dump: 2024-09-12T00:37:03.182 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:03.182 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:03.182 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.182 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.182 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:03.182 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:03.182 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:03.182 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:03.182 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:03.183 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.183 INFO:tasks.workunit.client.0.smithi043.stderr: -486> 2024-09-12T00:37:03.082+0000 7fac68608640 10 monclient: _finish_auth 0 2024-09-12T00:37:03.183 INFO:tasks.workunit.client.0.smithi043.stderr: -485> 2024-09-12T00:37:03.082+0000 7fac68608640 10 monclient: _check_auth_tickets 2024-09-12T00:37:03.183 INFO:tasks.workunit.client.0.smithi043.stderr: -484> 2024-09-12T00:37:03.082+0000 7fac68608640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:03.183 INFO:tasks.workunit.client.0.smithi043.stderr: -483> 2024-09-12T00:37:03.082+0000 7fac68608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:03.183 INFO:tasks.workunit.client.0.smithi043.stderr: -482> 2024-09-12T00:37:03.082+0000 7fac68608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:03.183 INFO:tasks.workunit.client.0.smithi043.stderr: -481> 2024-09-12T00:37:03.082+0000 7fac68608640 10 monclient: dump: 2024-09-12T00:37:03.183 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:03.183 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:03.183 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.183 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.183 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:03.183 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:03.183 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:03.184 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:03.184 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:03.184 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.184 INFO:tasks.workunit.client.0.smithi043.stderr: -480> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 monclient: authenticate success, global_id 6549 2024-09-12T00:37:03.184 INFO:tasks.workunit.client.0.smithi043.stderr: -479> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient: get_monmap_and_config success 2024-09-12T00:37:03.184 INFO:tasks.workunit.client.0.smithi043.stderr: -478> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 4 set_mon_vals no callback set 2024-09-12T00:37:03.184 INFO:tasks.workunit.client.0.smithi043.stderr: -477> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient: shutdown 2024-09-12T00:37:03.184 INFO:tasks.workunit.client.0.smithi043.stderr: -476> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) unregister_commands rotate-key 2024-09-12T00:37:03.184 INFO:tasks.workunit.client.0.smithi043.stderr: -475> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient: build_initial_monmap 2024-09-12T00:37:03.184 INFO:tasks.workunit.client.0.smithi043.stderr: -474> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:03.184 INFO:tasks.workunit.client.0.smithi043.stderr: -473> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient: monmap: 2024-09-12T00:37:03.184 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:37:03.184 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:03.184 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:37:03.185 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:37:03.185 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:03.185 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:03.185 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:37:03.185 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:37:03.185 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:37:03.185 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.185 INFO:tasks.workunit.client.0.smithi043.stderr: -472> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5cc8a0) adding auth protocol: cephx 2024-09-12T00:37:03.185 INFO:tasks.workunit.client.0.smithi043.stderr: -471> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5cc8a0) adding auth protocol: cephx 2024-09-12T00:37:03.185 INFO:tasks.workunit.client.0.smithi043.stderr: -470> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5cc8a0) adding auth protocol: cephx 2024-09-12T00:37:03.185 INFO:tasks.workunit.client.0.smithi043.stderr: -469> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5cc8a0) adding con mode: secure 2024-09-12T00:37:03.185 INFO:tasks.workunit.client.0.smithi043.stderr: -468> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5cc8a0) adding con mode: crc 2024-09-12T00:37:03.185 INFO:tasks.workunit.client.0.smithi043.stderr: -467> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5cc8a0) adding con mode: secure 2024-09-12T00:37:03.186 INFO:tasks.workunit.client.0.smithi043.stderr: -466> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5cc8a0) adding con mode: crc 2024-09-12T00:37:03.186 INFO:tasks.workunit.client.0.smithi043.stderr: -465> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5cc8a0) adding con mode: secure 2024-09-12T00:37:03.186 INFO:tasks.workunit.client.0.smithi043.stderr: -464> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5cc8a0) adding con mode: crc 2024-09-12T00:37:03.186 INFO:tasks.workunit.client.0.smithi043.stderr: -463> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5cc8a0) adding con mode: crc 2024-09-12T00:37:03.186 INFO:tasks.workunit.client.0.smithi043.stderr: -462> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5cc8a0) adding con mode: secure 2024-09-12T00:37:03.186 INFO:tasks.workunit.client.0.smithi043.stderr: -461> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5cc8a0) adding con mode: crc 2024-09-12T00:37:03.186 INFO:tasks.workunit.client.0.smithi043.stderr: -460> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5cc8a0) adding con mode: secure 2024-09-12T00:37:03.186 INFO:tasks.workunit.client.0.smithi043.stderr: -459> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5cc8a0) adding con mode: crc 2024-09-12T00:37:03.186 INFO:tasks.workunit.client.0.smithi043.stderr: -458> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5cc8a0) adding con mode: secure 2024-09-12T00:37:03.186 INFO:tasks.workunit.client.0.smithi043.stderr: -457> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.186 INFO:tasks.workunit.client.0.smithi043.stderr: -456> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 1 librados: starting msgr at 2024-09-12T00:37:03.186 INFO:tasks.workunit.client.0.smithi043.stderr: -455> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 1 librados: starting objecter 2024-09-12T00:37:03.186 INFO:tasks.workunit.client.0.smithi043.stderr: -454> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command objecter_requests hook 0x559c3a395d30 2024-09-12T00:37:03.187 INFO:tasks.workunit.client.0.smithi043.stderr: -453> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 1 librados: setting wanted keys 2024-09-12T00:37:03.187 INFO:tasks.workunit.client.0.smithi043.stderr: -452> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 1 librados: calling monclient init 2024-09-12T00:37:03.187 INFO:tasks.workunit.client.0.smithi043.stderr: -451> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient: init 2024-09-12T00:37:03.187 INFO:tasks.workunit.client.0.smithi043.stderr: -450> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5c6d60) adding auth protocol: cephx 2024-09-12T00:37:03.187 INFO:tasks.workunit.client.0.smithi043.stderr: -449> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5c6d60) adding auth protocol: cephx 2024-09-12T00:37:03.187 INFO:tasks.workunit.client.0.smithi043.stderr: -448> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5c6d60) adding auth protocol: cephx 2024-09-12T00:37:03.187 INFO:tasks.workunit.client.0.smithi043.stderr: -447> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5c6d60) adding con mode: secure 2024-09-12T00:37:03.187 INFO:tasks.workunit.client.0.smithi043.stderr: -446> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5c6d60) adding con mode: crc 2024-09-12T00:37:03.187 INFO:tasks.workunit.client.0.smithi043.stderr: -445> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5c6d60) adding con mode: secure 2024-09-12T00:37:03.187 INFO:tasks.workunit.client.0.smithi043.stderr: -444> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5c6d60) adding con mode: crc 2024-09-12T00:37:03.187 INFO:tasks.workunit.client.0.smithi043.stderr: -443> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5c6d60) adding con mode: secure 2024-09-12T00:37:03.187 INFO:tasks.workunit.client.0.smithi043.stderr: -442> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5c6d60) adding con mode: crc 2024-09-12T00:37:03.187 INFO:tasks.workunit.client.0.smithi043.stderr: -441> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5c6d60) adding con mode: crc 2024-09-12T00:37:03.187 INFO:tasks.workunit.client.0.smithi043.stderr: -440> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5c6d60) adding con mode: secure 2024-09-12T00:37:03.188 INFO:tasks.workunit.client.0.smithi043.stderr: -439> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5c6d60) adding con mode: crc 2024-09-12T00:37:03.188 INFO:tasks.workunit.client.0.smithi043.stderr: -438> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5c6d60) adding con mode: secure 2024-09-12T00:37:03.188 INFO:tasks.workunit.client.0.smithi043.stderr: -437> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5c6d60) adding con mode: crc 2024-09-12T00:37:03.188 INFO:tasks.workunit.client.0.smithi043.stderr: -436> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5c6d60) adding con mode: secure 2024-09-12T00:37:03.188 INFO:tasks.workunit.client.0.smithi043.stderr: -435> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.188 INFO:tasks.workunit.client.0.smithi043.stderr: -434> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.188 INFO:tasks.workunit.client.0.smithi043.stderr: -433> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command rotate-key hook 0x559c3a5c6ea8 2024-09-12T00:37:03.188 INFO:tasks.workunit.client.0.smithi043.stderr: -432> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:03.188 INFO:tasks.workunit.client.0.smithi043.stderr: -431> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:37:03.188 INFO:tasks.workunit.client.0.smithi043.stderr: -430> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient(hunting): picked mon.noname-b con 0x559c3a476820 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:37:03.188 INFO:tasks.workunit.client.0.smithi043.stderr: -429> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient(hunting): picked mon.noname-c con 0x559c3a481a80 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:37:03.188 INFO:tasks.workunit.client.0.smithi043.stderr: -428> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient(hunting): picked mon.noname-a con 0x559c3a512170 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:37:03.189 INFO:tasks.workunit.client.0.smithi043.stderr: -427> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.189 INFO:tasks.workunit.client.0.smithi043.stderr: -426> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.189 INFO:tasks.workunit.client.0.smithi043.stderr: -425> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.189 INFO:tasks.workunit.client.0.smithi043.stderr: -424> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:03.189 INFO:tasks.workunit.client.0.smithi043.stderr: -423> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient(hunting): authenticate will time out at 2119.074410s 2024-09-12T00:37:03.189 INFO:tasks.workunit.client.0.smithi043.stderr: -422> 2024-09-12T00:37:03.082+0000 7fad7afee640 10 monclient(hunting): get_auth_request con 0x559c3a512170 auth_method 0 2024-09-12T00:37:03.189 INFO:tasks.workunit.client.0.smithi043.stderr: -421> 2024-09-12T00:37:03.082+0000 7fad7afee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.189 INFO:tasks.workunit.client.0.smithi043.stderr: -420> 2024-09-12T00:37:03.082+0000 7fad7afee640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.189 INFO:tasks.workunit.client.0.smithi043.stderr: -419> 2024-09-12T00:37:03.082+0000 7fad7afee640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.189 INFO:tasks.workunit.client.0.smithi043.stderr: -418> 2024-09-12T00:37:03.082+0000 7fad79fec640 10 monclient(hunting): get_auth_request con 0x559c3a481a80 auth_method 0 2024-09-12T00:37:03.189 INFO:tasks.workunit.client.0.smithi043.stderr: -417> 2024-09-12T00:37:03.082+0000 7fad79fec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.189 INFO:tasks.workunit.client.0.smithi043.stderr: -416> 2024-09-12T00:37:03.082+0000 7fad79fec640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.189 INFO:tasks.workunit.client.0.smithi043.stderr: -415> 2024-09-12T00:37:03.082+0000 7fad79fec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.189 INFO:tasks.workunit.client.0.smithi043.stderr: -414> 2024-09-12T00:37:03.082+0000 7fad7afee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:03.190 INFO:tasks.workunit.client.0.smithi043.stderr: -413> 2024-09-12T00:37:03.082+0000 7fad7afee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:03.190 INFO:tasks.workunit.client.0.smithi043.stderr: -412> 2024-09-12T00:37:03.082+0000 7fad7afee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:03.190 INFO:tasks.workunit.client.0.smithi043.stderr: -411> 2024-09-12T00:37:03.082+0000 7fad79fec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:03.190 INFO:tasks.workunit.client.0.smithi043.stderr: -410> 2024-09-12T00:37:03.082+0000 7fad79fec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:03.190 INFO:tasks.workunit.client.0.smithi043.stderr: -409> 2024-09-12T00:37:03.082+0000 7fad79fec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:03.190 INFO:tasks.workunit.client.0.smithi043.stderr: -408> 2024-09-12T00:37:03.082+0000 7fad7a7ed640 10 monclient(hunting): get_auth_request con 0x559c3a476820 auth_method 0 2024-09-12T00:37:03.190 INFO:tasks.workunit.client.0.smithi043.stderr: -407> 2024-09-12T00:37:03.082+0000 7fad7a7ed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.190 INFO:tasks.workunit.client.0.smithi043.stderr: -406> 2024-09-12T00:37:03.082+0000 7fad7a7ed640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.190 INFO:tasks.workunit.client.0.smithi043.stderr: -405> 2024-09-12T00:37:03.082+0000 7fad7a7ed640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.190 INFO:tasks.workunit.client.0.smithi043.stderr: -404> 2024-09-12T00:37:03.082+0000 7fad7afee640 10 monclient(hunting): handle_auth_done global_id 6552 payload 824 2024-09-12T00:37:03.190 INFO:tasks.workunit.client.0.smithi043.stderr: -403> 2024-09-12T00:37:03.082+0000 7fad7afee640 10 monclient: _finish_hunting 0 2024-09-12T00:37:03.190 INFO:tasks.workunit.client.0.smithi043.stderr: -402> 2024-09-12T00:37:03.082+0000 7fad7afee640 1 monclient: found mon.noname-a 2024-09-12T00:37:03.190 INFO:tasks.workunit.client.0.smithi043.stderr: -401> 2024-09-12T00:37:03.082+0000 7fad7afee640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:37:03.191 INFO:tasks.workunit.client.0.smithi043.stderr: -400> 2024-09-12T00:37:03.082+0000 7fac66e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:03.191 INFO:tasks.workunit.client.0.smithi043.stderr: -399> 2024-09-12T00:37:03.082+0000 7fac66e05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:03.191 INFO:tasks.workunit.client.0.smithi043.stderr: -398> 2024-09-12T00:37:03.082+0000 7fac66e05640 10 monclient: dump: 2024-09-12T00:37:03.191 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:03.191 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:03.191 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.191 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.191 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:03.191 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:03.191 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:03.191 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:03.191 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:03.192 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.192 INFO:tasks.workunit.client.0.smithi043.stderr: -397> 2024-09-12T00:37:03.082+0000 7fac66e05640 10 monclient: _finish_auth 0 2024-09-12T00:37:03.192 INFO:tasks.workunit.client.0.smithi043.stderr: -396> 2024-09-12T00:37:03.082+0000 7fac66e05640 10 monclient: _check_auth_tickets 2024-09-12T00:37:03.192 INFO:tasks.workunit.client.0.smithi043.stderr: -395> 2024-09-12T00:37:03.082+0000 7fac66e05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:03.192 INFO:tasks.workunit.client.0.smithi043.stderr: -394> 2024-09-12T00:37:03.082+0000 7fac66e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:03.192 INFO:tasks.workunit.client.0.smithi043.stderr: -393> 2024-09-12T00:37:03.082+0000 7fac66e05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:03.192 INFO:tasks.workunit.client.0.smithi043.stderr: -392> 2024-09-12T00:37:03.082+0000 7fac66e05640 10 monclient: dump: 2024-09-12T00:37:03.192 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:03.192 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:03.192 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.192 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.192 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:03.193 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:03.193 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:03.193 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:03.193 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:03.193 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.193 INFO:tasks.workunit.client.0.smithi043.stderr: -391> 2024-09-12T00:37:03.082+0000 7fac68608640 4 set_mon_vals no callback set 2024-09-12T00:37:03.193 INFO:tasks.workunit.client.0.smithi043.stderr: -390> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 monclient: authenticate success, global_id 6552 2024-09-12T00:37:03.193 INFO:tasks.workunit.client.0.smithi043.stderr: -389> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient: _renew_subs 2024-09-12T00:37:03.193 INFO:tasks.workunit.client.0.smithi043.stderr: -388> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:37:03.193 INFO:tasks.workunit.client.0.smithi043.stderr: -387> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient: _renew_subs 2024-09-12T00:37:03.193 INFO:tasks.workunit.client.0.smithi043.stderr: -386> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:37:03.193 INFO:tasks.workunit.client.0.smithi043.stderr: -385> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 1 librados: init done 2024-09-12T00:37:03.193 INFO:tasks.workunit.client.0.smithi043.stderr: -384> 2024-09-12T00:37:03.086+0000 7fac66e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:03.194 INFO:tasks.workunit.client.0.smithi043.stderr: -383> 2024-09-12T00:37:03.086+0000 7fac66e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:37:03.194 INFO:tasks.workunit.client.0.smithi043.stderr: -382> 2024-09-12T00:37:03.086+0000 7fac66e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:37:03.194 INFO:tasks.workunit.client.0.smithi043.stderr: -381> 2024-09-12T00:37:03.086+0000 7fad7a7ed640 10 monclient: get_auth_request con 0x7fac60070ae0 auth_method 0 2024-09-12T00:37:03.194 INFO:tasks.workunit.client.0.smithi043.stderr: -380> 2024-09-12T00:37:03.086+0000 7fad79fec640 10 monclient: get_auth_request con 0x559c3a608150 auth_method 0 2024-09-12T00:37:03.194 INFO:tasks.workunit.client.0.smithi043.stderr: -379> 2024-09-12T00:37:03.086+0000 7fad7a7ed640 10 monclient: get_auth_request con 0x559c3a611880 auth_method 0 2024-09-12T00:37:03.194 INFO:tasks.workunit.client.0.smithi043.stderr: -378> 2024-09-12T00:37:03.090+0000 7fad79fec640 10 monclient: get_auth_request con 0x559c3a615be0 auth_method 0 2024-09-12T00:37:03.194 INFO:tasks.workunit.client.0.smithi043.stderr: -377> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 10 monclient: build_initial_monmap 2024-09-12T00:37:03.194 INFO:tasks.workunit.client.0.smithi043.stderr: -376> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:03.194 INFO:tasks.workunit.client.0.smithi043.stderr: -375> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 10 monclient: monmap: 2024-09-12T00:37:03.194 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:37:03.194 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:03.194 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:37:03.194 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:37:03.195 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:03.195 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:03.195 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:37:03.195 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:37:03.195 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:37:03.195 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.195 INFO:tasks.workunit.client.0.smithi043.stderr: -374> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a61aa30) adding auth protocol: cephx 2024-09-12T00:37:03.195 INFO:tasks.workunit.client.0.smithi043.stderr: -373> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a61aa30) adding auth protocol: cephx 2024-09-12T00:37:03.195 INFO:tasks.workunit.client.0.smithi043.stderr: -372> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a61aa30) adding auth protocol: cephx 2024-09-12T00:37:03.195 INFO:tasks.workunit.client.0.smithi043.stderr: -371> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a61aa30) adding con mode: secure 2024-09-12T00:37:03.195 INFO:tasks.workunit.client.0.smithi043.stderr: -370> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a61aa30) adding con mode: crc 2024-09-12T00:37:03.195 INFO:tasks.workunit.client.0.smithi043.stderr: -369> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a61aa30) adding con mode: secure 2024-09-12T00:37:03.195 INFO:tasks.workunit.client.0.smithi043.stderr: -368> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a61aa30) adding con mode: crc 2024-09-12T00:37:03.195 INFO:tasks.workunit.client.0.smithi043.stderr: -367> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a61aa30) adding con mode: secure 2024-09-12T00:37:03.196 INFO:tasks.workunit.client.0.smithi043.stderr: -366> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a61aa30) adding con mode: crc 2024-09-12T00:37:03.196 INFO:tasks.workunit.client.0.smithi043.stderr: -365> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a61aa30) adding con mode: crc 2024-09-12T00:37:03.196 INFO:tasks.workunit.client.0.smithi043.stderr: -364> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a61aa30) adding con mode: secure 2024-09-12T00:37:03.196 INFO:tasks.workunit.client.0.smithi043.stderr: -363> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a61aa30) adding con mode: crc 2024-09-12T00:37:03.196 INFO:tasks.workunit.client.0.smithi043.stderr: -362> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a61aa30) adding con mode: secure 2024-09-12T00:37:03.196 INFO:tasks.workunit.client.0.smithi043.stderr: -361> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a61aa30) adding con mode: crc 2024-09-12T00:37:03.196 INFO:tasks.workunit.client.0.smithi043.stderr: -360> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a61aa30) adding con mode: secure 2024-09-12T00:37:03.196 INFO:tasks.workunit.client.0.smithi043.stderr: -359> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.196 INFO:tasks.workunit.client.0.smithi043.stderr: -358> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command objecter_requests cmddesc objecter_requests hook 0x559c3a61e3e0 EEXIST 2024-09-12T00:37:03.196 INFO:tasks.workunit.client.0.smithi043.stderr: -357> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 10 monclient: init 2024-09-12T00:37:03.196 INFO:tasks.workunit.client.0.smithi043.stderr: -356> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6190e8) adding auth protocol: cephx 2024-09-12T00:37:03.196 INFO:tasks.workunit.client.0.smithi043.stderr: -355> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6190e8) adding auth protocol: cephx 2024-09-12T00:37:03.196 INFO:tasks.workunit.client.0.smithi043.stderr: -354> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6190e8) adding auth protocol: cephx 2024-09-12T00:37:03.197 INFO:tasks.workunit.client.0.smithi043.stderr: -353> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6190e8) adding con mode: secure 2024-09-12T00:37:03.197 INFO:tasks.workunit.client.0.smithi043.stderr: -352> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6190e8) adding con mode: crc 2024-09-12T00:37:03.197 INFO:tasks.workunit.client.0.smithi043.stderr: -351> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6190e8) adding con mode: secure 2024-09-12T00:37:03.197 INFO:tasks.workunit.client.0.smithi043.stderr: -350> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6190e8) adding con mode: crc 2024-09-12T00:37:03.197 INFO:tasks.workunit.client.0.smithi043.stderr: -349> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6190e8) adding con mode: secure 2024-09-12T00:37:03.197 INFO:tasks.workunit.client.0.smithi043.stderr: -348> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6190e8) adding con mode: crc 2024-09-12T00:37:03.197 INFO:tasks.workunit.client.0.smithi043.stderr: -347> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6190e8) adding con mode: crc 2024-09-12T00:37:03.197 INFO:tasks.workunit.client.0.smithi043.stderr: -346> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6190e8) adding con mode: secure 2024-09-12T00:37:03.197 INFO:tasks.workunit.client.0.smithi043.stderr: -345> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6190e8) adding con mode: crc 2024-09-12T00:37:03.197 INFO:tasks.workunit.client.0.smithi043.stderr: -344> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6190e8) adding con mode: secure 2024-09-12T00:37:03.197 INFO:tasks.workunit.client.0.smithi043.stderr: -343> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6190e8) adding con mode: crc 2024-09-12T00:37:03.197 INFO:tasks.workunit.client.0.smithi043.stderr: -342> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6190e8) adding con mode: secure 2024-09-12T00:37:03.197 INFO:tasks.workunit.client.0.smithi043.stderr: -341> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.197 INFO:tasks.workunit.client.0.smithi043.stderr: -340> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.198 INFO:tasks.workunit.client.0.smithi043.stderr: -339> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command rotate-key cmddesc rotate-key hook 0x559c3a619230 EEXIST 2024-09-12T00:37:03.198 INFO:tasks.workunit.client.0.smithi043.stderr: -338> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:03.198 INFO:tasks.workunit.client.0.smithi043.stderr: -337> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:37:03.198 INFO:tasks.workunit.client.0.smithi043.stderr: -336> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 10 monclient(hunting): picked mon.noname-c con 0x559c3a642590 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:37:03.198 INFO:tasks.workunit.client.0.smithi043.stderr: -335> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 10 monclient(hunting): picked mon.noname-b con 0x559c3a641ec0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:37:03.198 INFO:tasks.workunit.client.0.smithi043.stderr: -334> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 10 monclient(hunting): picked mon.noname-a con 0x559c3a6408a0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:37:03.198 INFO:tasks.workunit.client.0.smithi043.stderr: -333> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.198 INFO:tasks.workunit.client.0.smithi043.stderr: -332> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.198 INFO:tasks.workunit.client.0.smithi043.stderr: -331> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.198 INFO:tasks.workunit.client.0.smithi043.stderr: -330> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:03.198 INFO:tasks.workunit.client.0.smithi043.stderr: -329> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 10 monclient(hunting): authenticate will time out at 2119.083992s 2024-09-12T00:37:03.198 INFO:tasks.workunit.client.0.smithi043.stderr: -328> 2024-09-12T00:37:03.094+0000 7fad7a7ed640 10 monclient(hunting): get_auth_request con 0x559c3a642590 auth_method 0 2024-09-12T00:37:03.198 INFO:tasks.workunit.client.0.smithi043.stderr: -327> 2024-09-12T00:37:03.094+0000 7fad7a7ed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.198 INFO:tasks.workunit.client.0.smithi043.stderr: -326> 2024-09-12T00:37:03.094+0000 7fad7a7ed640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.199 INFO:tasks.workunit.client.0.smithi043.stderr: -325> 2024-09-12T00:37:03.094+0000 7fad7a7ed640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.199 INFO:tasks.workunit.client.0.smithi043.stderr: -324> 2024-09-12T00:37:03.094+0000 7fad7afee640 10 monclient(hunting): get_auth_request con 0x559c3a6408a0 auth_method 0 2024-09-12T00:37:03.199 INFO:tasks.workunit.client.0.smithi043.stderr: -323> 2024-09-12T00:37:03.094+0000 7fad7afee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.199 INFO:tasks.workunit.client.0.smithi043.stderr: -322> 2024-09-12T00:37:03.094+0000 7fad7afee640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.199 INFO:tasks.workunit.client.0.smithi043.stderr: -321> 2024-09-12T00:37:03.094+0000 7fad7afee640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.199 INFO:tasks.workunit.client.0.smithi043.stderr: -320> 2024-09-12T00:37:03.094+0000 7fad7a7ed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:03.199 INFO:tasks.workunit.client.0.smithi043.stderr: -319> 2024-09-12T00:37:03.094+0000 7fad7a7ed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:03.199 INFO:tasks.workunit.client.0.smithi043.stderr: -318> 2024-09-12T00:37:03.094+0000 7fad7a7ed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:03.199 INFO:tasks.workunit.client.0.smithi043.stderr: -317> 2024-09-12T00:37:03.094+0000 7fad7afee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:03.199 INFO:tasks.workunit.client.0.smithi043.stderr: -316> 2024-09-12T00:37:03.094+0000 7fad7afee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:03.199 INFO:tasks.workunit.client.0.smithi043.stderr: -315> 2024-09-12T00:37:03.094+0000 7fad7afee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:03.199 INFO:tasks.workunit.client.0.smithi043.stderr: -314> 2024-09-12T00:37:03.094+0000 7fad79fec640 10 monclient(hunting): get_auth_request con 0x559c3a641ec0 auth_method 0 2024-09-12T00:37:03.199 INFO:tasks.workunit.client.0.smithi043.stderr: -313> 2024-09-12T00:37:03.094+0000 7fad79fec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.200 INFO:tasks.workunit.client.0.smithi043.stderr: -312> 2024-09-12T00:37:03.094+0000 7fad79fec640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.200 INFO:tasks.workunit.client.0.smithi043.stderr: -311> 2024-09-12T00:37:03.094+0000 7fad79fec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.200 INFO:tasks.workunit.client.0.smithi043.stderr: -310> 2024-09-12T00:37:03.094+0000 7fad7a7ed640 10 monclient(hunting): handle_auth_done global_id 6284 payload 824 2024-09-12T00:37:03.200 INFO:tasks.workunit.client.0.smithi043.stderr: -309> 2024-09-12T00:37:03.094+0000 7fad7a7ed640 10 monclient: _finish_hunting 0 2024-09-12T00:37:03.200 INFO:tasks.workunit.client.0.smithi043.stderr: -308> 2024-09-12T00:37:03.094+0000 7fad7a7ed640 1 monclient: found mon.noname-c 2024-09-12T00:37:03.200 INFO:tasks.workunit.client.0.smithi043.stderr: -307> 2024-09-12T00:37:03.094+0000 7fad7a7ed640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:37:03.200 INFO:tasks.workunit.client.0.smithi043.stderr: -306> 2024-09-12T00:37:03.094+0000 7fac5ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:03.200 INFO:tasks.workunit.client.0.smithi043.stderr: -305> 2024-09-12T00:37:03.094+0000 7fac5ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:37:03.200 INFO:tasks.workunit.client.0.smithi043.stderr: -304> 2024-09-12T00:37:03.094+0000 7fac5ffff640 10 monclient: dump: 2024-09-12T00:37:03.200 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:03.200 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:03.200 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.200 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.201 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:03.201 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:03.201 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:03.201 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:03.201 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:03.201 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.201 INFO:tasks.workunit.client.0.smithi043.stderr: -303> 2024-09-12T00:37:03.094+0000 7fac5ffff640 10 monclient: _finish_auth 0 2024-09-12T00:37:03.201 INFO:tasks.workunit.client.0.smithi043.stderr: -302> 2024-09-12T00:37:03.094+0000 7fac5ffff640 10 monclient: _check_auth_tickets 2024-09-12T00:37:03.201 INFO:tasks.workunit.client.0.smithi043.stderr: -301> 2024-09-12T00:37:03.094+0000 7fac5ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:03.201 INFO:tasks.workunit.client.0.smithi043.stderr: -300> 2024-09-12T00:37:03.094+0000 7fac5ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:03.201 INFO:tasks.workunit.client.0.smithi043.stderr: -299> 2024-09-12T00:37:03.094+0000 7fac5ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:37:03.201 INFO:tasks.workunit.client.0.smithi043.stderr: -298> 2024-09-12T00:37:03.094+0000 7fac5ffff640 10 monclient: dump: 2024-09-12T00:37:03.201 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:03.202 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:03.202 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.202 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.202 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:03.202 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:03.202 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:03.202 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:03.202 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:03.202 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.202 INFO:tasks.workunit.client.0.smithi043.stderr: -297> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 monclient: authenticate success, global_id 6284 2024-09-12T00:37:03.202 INFO:tasks.workunit.client.0.smithi043.stderr: -296> 2024-09-12T00:37:03.094+0000 7fad7b7ef640 4 set_mon_vals no callback set 2024-09-12T00:37:03.202 INFO:tasks.workunit.client.0.smithi043.stderr: -295> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 10 monclient: _renew_subs 2024-09-12T00:37:03.202 INFO:tasks.workunit.client.0.smithi043.stderr: -294> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:37:03.202 INFO:tasks.workunit.client.0.smithi043.stderr: -293> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 10 monclient: _renew_subs 2024-09-12T00:37:03.203 INFO:tasks.workunit.client.0.smithi043.stderr: -292> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:37:03.203 INFO:tasks.workunit.client.0.smithi043.stderr: -291> 2024-09-12T00:37:03.094+0000 7fac5ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:03.203 INFO:tasks.workunit.client.0.smithi043.stderr: -290> 2024-09-12T00:37:03.094+0000 7fac5ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:37:03.203 INFO:tasks.workunit.client.0.smithi043.stderr: -289> 2024-09-12T00:37:03.094+0000 7fac5ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:37:03.203 INFO:tasks.workunit.client.0.smithi043.stderr: -288> 2024-09-12T00:37:03.094+0000 7fad79fec640 10 monclient: get_auth_request con 0x7fac54070a20 auth_method 0 2024-09-12T00:37:03.203 INFO:tasks.workunit.client.0.smithi043.stderr: -287> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 10 monclient: get_monmap_and_config 2024-09-12T00:37:03.203 INFO:tasks.workunit.client.0.smithi043.stderr: -286> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 10 monclient: build_initial_monmap 2024-09-12T00:37:03.203 INFO:tasks.workunit.client.0.smithi043.stderr: -285> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:03.203 INFO:tasks.workunit.client.0.smithi043.stderr: -284> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 10 monclient: monmap: 2024-09-12T00:37:03.203 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:37:03.203 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:03.203 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:37:03.203 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:37:03.203 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:03.204 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:03.204 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:37:03.204 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:37:03.204 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:37:03.204 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.204 INFO:tasks.workunit.client.0.smithi043.stderr: -283> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661c00) adding auth protocol: cephx 2024-09-12T00:37:03.204 INFO:tasks.workunit.client.0.smithi043.stderr: -282> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661c00) adding auth protocol: cephx 2024-09-12T00:37:03.204 INFO:tasks.workunit.client.0.smithi043.stderr: -281> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661c00) adding auth protocol: cephx 2024-09-12T00:37:03.204 INFO:tasks.workunit.client.0.smithi043.stderr: -280> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661c00) adding con mode: secure 2024-09-12T00:37:03.204 INFO:tasks.workunit.client.0.smithi043.stderr: -279> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661c00) adding con mode: crc 2024-09-12T00:37:03.204 INFO:tasks.workunit.client.0.smithi043.stderr: -278> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661c00) adding con mode: secure 2024-09-12T00:37:03.204 INFO:tasks.workunit.client.0.smithi043.stderr: -277> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661c00) adding con mode: crc 2024-09-12T00:37:03.204 INFO:tasks.workunit.client.0.smithi043.stderr: -276> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661c00) adding con mode: secure 2024-09-12T00:37:03.205 INFO:tasks.workunit.client.0.smithi043.stderr: -275> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661c00) adding con mode: crc 2024-09-12T00:37:03.205 INFO:tasks.workunit.client.0.smithi043.stderr: -274> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661c00) adding con mode: crc 2024-09-12T00:37:03.205 INFO:tasks.workunit.client.0.smithi043.stderr: -273> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661c00) adding con mode: secure 2024-09-12T00:37:03.205 INFO:tasks.workunit.client.0.smithi043.stderr: -272> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661c00) adding con mode: crc 2024-09-12T00:37:03.205 INFO:tasks.workunit.client.0.smithi043.stderr: -271> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661c00) adding con mode: secure 2024-09-12T00:37:03.205 INFO:tasks.workunit.client.0.smithi043.stderr: -270> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661c00) adding con mode: crc 2024-09-12T00:37:03.205 INFO:tasks.workunit.client.0.smithi043.stderr: -269> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661c00) adding con mode: secure 2024-09-12T00:37:03.205 INFO:tasks.workunit.client.0.smithi043.stderr: -268> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.205 INFO:tasks.workunit.client.0.smithi043.stderr: -267> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 10 monclient: init 2024-09-12T00:37:03.205 INFO:tasks.workunit.client.0.smithi043.stderr: -266> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefe780) adding auth protocol: cephx 2024-09-12T00:37:03.205 INFO:tasks.workunit.client.0.smithi043.stderr: -265> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefe780) adding auth protocol: cephx 2024-09-12T00:37:03.205 INFO:tasks.workunit.client.0.smithi043.stderr: -264> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefe780) adding auth protocol: cephx 2024-09-12T00:37:03.205 INFO:tasks.workunit.client.0.smithi043.stderr: -263> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefe780) adding con mode: secure 2024-09-12T00:37:03.205 INFO:tasks.workunit.client.0.smithi043.stderr: -262> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefe780) adding con mode: crc 2024-09-12T00:37:03.206 INFO:tasks.workunit.client.0.smithi043.stderr: -261> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefe780) adding con mode: secure 2024-09-12T00:37:03.206 INFO:tasks.workunit.client.0.smithi043.stderr: -260> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefe780) adding con mode: crc 2024-09-12T00:37:03.206 INFO:tasks.workunit.client.0.smithi043.stderr: -259> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefe780) adding con mode: secure 2024-09-12T00:37:03.206 INFO:tasks.workunit.client.0.smithi043.stderr: -258> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefe780) adding con mode: crc 2024-09-12T00:37:03.206 INFO:tasks.workunit.client.0.smithi043.stderr: -257> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefe780) adding con mode: crc 2024-09-12T00:37:03.206 INFO:tasks.workunit.client.0.smithi043.stderr: -256> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefe780) adding con mode: secure 2024-09-12T00:37:03.206 INFO:tasks.workunit.client.0.smithi043.stderr: -255> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefe780) adding con mode: crc 2024-09-12T00:37:03.206 INFO:tasks.workunit.client.0.smithi043.stderr: -254> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefe780) adding con mode: secure 2024-09-12T00:37:03.206 INFO:tasks.workunit.client.0.smithi043.stderr: -253> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefe780) adding con mode: crc 2024-09-12T00:37:03.206 INFO:tasks.workunit.client.0.smithi043.stderr: -252> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefe780) adding con mode: secure 2024-09-12T00:37:03.206 INFO:tasks.workunit.client.0.smithi043.stderr: -251> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.206 INFO:tasks.workunit.client.0.smithi043.stderr: -250> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.206 INFO:tasks.workunit.client.0.smithi043.stderr: -249> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd0fefe8c8 EEXIST 2024-09-12T00:37:03.206 INFO:tasks.workunit.client.0.smithi043.stderr: -248> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:03.207 INFO:tasks.workunit.client.0.smithi043.stderr: -247> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:37:03.207 INFO:tasks.workunit.client.0.smithi043.stderr: -246> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): picked mon.noname-b con 0x559c3a6901d0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:37:03.207 INFO:tasks.workunit.client.0.smithi043.stderr: -245> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): picked mon.noname-c con 0x559c3a6905b0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:37:03.207 INFO:tasks.workunit.client.0.smithi043.stderr: -244> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): picked mon.noname-a con 0x559c3a691a70 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:37:03.207 INFO:tasks.workunit.client.0.smithi043.stderr: -243> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.207 INFO:tasks.workunit.client.0.smithi043.stderr: -242> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.207 INFO:tasks.workunit.client.0.smithi043.stderr: -241> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.207 INFO:tasks.workunit.client.0.smithi043.stderr: -240> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:03.207 INFO:tasks.workunit.client.0.smithi043.stderr: -239> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): authenticate will time out at 2119.088252s 2024-09-12T00:37:03.207 INFO:tasks.workunit.client.0.smithi043.stderr: -238> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): get_auth_request con 0x559c3a691a70 auth_method 0 2024-09-12T00:37:03.207 INFO:tasks.workunit.client.0.smithi043.stderr: -237> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.207 INFO:tasks.workunit.client.0.smithi043.stderr: -236> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.207 INFO:tasks.workunit.client.0.smithi043.stderr: -235> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.208 INFO:tasks.workunit.client.0.smithi043.stderr: -234> 2024-09-12T00:37:03.098+0000 7fad79fec640 10 monclient(hunting): get_auth_request con 0x559c3a6905b0 auth_method 0 2024-09-12T00:37:03.208 INFO:tasks.workunit.client.0.smithi043.stderr: -233> 2024-09-12T00:37:03.098+0000 7fad79fec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.208 INFO:tasks.workunit.client.0.smithi043.stderr: -232> 2024-09-12T00:37:03.098+0000 7fad79fec640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.208 INFO:tasks.workunit.client.0.smithi043.stderr: -231> 2024-09-12T00:37:03.098+0000 7fad79fec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.208 INFO:tasks.workunit.client.0.smithi043.stderr: -230> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:03.208 INFO:tasks.workunit.client.0.smithi043.stderr: -229> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:03.208 INFO:tasks.workunit.client.0.smithi043.stderr: -228> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:03.208 INFO:tasks.workunit.client.0.smithi043.stderr: -227> 2024-09-12T00:37:03.098+0000 7fad79fec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:03.208 INFO:tasks.workunit.client.0.smithi043.stderr: -226> 2024-09-12T00:37:03.098+0000 7fad79fec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:03.208 INFO:tasks.workunit.client.0.smithi043.stderr: -225> 2024-09-12T00:37:03.098+0000 7fad79fec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:03.208 INFO:tasks.workunit.client.0.smithi043.stderr: -224> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): handle_auth_done global_id 6558 payload 274 2024-09-12T00:37:03.208 INFO:tasks.workunit.client.0.smithi043.stderr: -223> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient: _finish_hunting 0 2024-09-12T00:37:03.208 INFO:tasks.workunit.client.0.smithi043.stderr: -222> 2024-09-12T00:37:03.098+0000 7fad7afee640 1 monclient: found mon.noname-a 2024-09-12T00:37:03.209 INFO:tasks.workunit.client.0.smithi043.stderr: -221> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:37:03.209 INFO:tasks.workunit.client.0.smithi043.stderr: -220> 2024-09-12T00:37:03.098+0000 7fad7a7ed640 10 monclient: get_auth_request con 0x559c3a6901d0 auth_method 0 2024-09-12T00:37:03.209 INFO:tasks.workunit.client.0.smithi043.stderr: -219> 2024-09-12T00:37:03.098+0000 7fac5dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:03.209 INFO:tasks.workunit.client.0.smithi043.stderr: -218> 2024-09-12T00:37:03.098+0000 7fac5dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:03.209 INFO:tasks.workunit.client.0.smithi043.stderr: -217> 2024-09-12T00:37:03.098+0000 7fac5dffb640 10 monclient: dump: 2024-09-12T00:37:03.209 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:03.209 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:03.209 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.209 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.209 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:03.209 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:03.209 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:03.210 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:03.210 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:03.210 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.210 INFO:tasks.workunit.client.0.smithi043.stderr: -216> 2024-09-12T00:37:03.098+0000 7fac5dffb640 10 monclient: _finish_auth 0 2024-09-12T00:37:03.210 INFO:tasks.workunit.client.0.smithi043.stderr: -215> 2024-09-12T00:37:03.098+0000 7fac5dffb640 10 monclient: _check_auth_tickets 2024-09-12T00:37:03.210 INFO:tasks.workunit.client.0.smithi043.stderr: -214> 2024-09-12T00:37:03.098+0000 7fac5dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:03.210 INFO:tasks.workunit.client.0.smithi043.stderr: -213> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 monclient: authenticate success, global_id 6558 2024-09-12T00:37:03.210 INFO:tasks.workunit.client.0.smithi043.stderr: -212> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient: get_monmap_and_config success 2024-09-12T00:37:03.210 INFO:tasks.workunit.client.0.smithi043.stderr: -211> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 4 set_mon_vals no callback set 2024-09-12T00:37:03.210 INFO:tasks.workunit.client.0.smithi043.stderr: -210> 2024-09-12T00:37:03.098+0000 7fac5dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:03.210 INFO:tasks.workunit.client.0.smithi043.stderr: -209> 2024-09-12T00:37:03.098+0000 7fac5dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:03.210 INFO:tasks.workunit.client.0.smithi043.stderr: -208> 2024-09-12T00:37:03.098+0000 7fac5dffb640 10 monclient: dump: 2024-09-12T00:37:03.211 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:03.211 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:03.211 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.211 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.211 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:03.211 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:03.211 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:03.211 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:03.211 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:03.211 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.211 INFO:tasks.workunit.client.0.smithi043.stderr: -207> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient: shutdown 2024-09-12T00:37:03.211 INFO:tasks.workunit.client.0.smithi043.stderr: -206> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient: build_initial_monmap 2024-09-12T00:37:03.211 INFO:tasks.workunit.client.0.smithi043.stderr: -205> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:03.211 INFO:tasks.workunit.client.0.smithi043.stderr: -204> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient: monmap: 2024-09-12T00:37:03.212 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:37:03.212 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:03.212 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:37:03.212 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:37:03.212 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:03.212 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:03.212 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:37:03.212 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:37:03.212 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:37:03.212 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.212 INFO:tasks.workunit.client.0.smithi043.stderr: -203> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661bb0) adding auth protocol: cephx 2024-09-12T00:37:03.212 INFO:tasks.workunit.client.0.smithi043.stderr: -202> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661bb0) adding auth protocol: cephx 2024-09-12T00:37:03.212 INFO:tasks.workunit.client.0.smithi043.stderr: -201> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661bb0) adding auth protocol: cephx 2024-09-12T00:37:03.212 INFO:tasks.workunit.client.0.smithi043.stderr: -200> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661bb0) adding con mode: secure 2024-09-12T00:37:03.213 INFO:tasks.workunit.client.0.smithi043.stderr: -199> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661bb0) adding con mode: crc 2024-09-12T00:37:03.213 INFO:tasks.workunit.client.0.smithi043.stderr: -198> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661bb0) adding con mode: secure 2024-09-12T00:37:03.213 INFO:tasks.workunit.client.0.smithi043.stderr: -197> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661bb0) adding con mode: crc 2024-09-12T00:37:03.213 INFO:tasks.workunit.client.0.smithi043.stderr: -196> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661bb0) adding con mode: secure 2024-09-12T00:37:03.213 INFO:tasks.workunit.client.0.smithi043.stderr: -195> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661bb0) adding con mode: crc 2024-09-12T00:37:03.213 INFO:tasks.workunit.client.0.smithi043.stderr: -194> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661bb0) adding con mode: crc 2024-09-12T00:37:03.213 INFO:tasks.workunit.client.0.smithi043.stderr: -193> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661bb0) adding con mode: secure 2024-09-12T00:37:03.213 INFO:tasks.workunit.client.0.smithi043.stderr: -192> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661bb0) adding con mode: crc 2024-09-12T00:37:03.213 INFO:tasks.workunit.client.0.smithi043.stderr: -191> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661bb0) adding con mode: secure 2024-09-12T00:37:03.213 INFO:tasks.workunit.client.0.smithi043.stderr: -190> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661bb0) adding con mode: crc 2024-09-12T00:37:03.213 INFO:tasks.workunit.client.0.smithi043.stderr: -189> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661bb0) adding con mode: secure 2024-09-12T00:37:03.213 INFO:tasks.workunit.client.0.smithi043.stderr: -188> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.213 INFO:tasks.workunit.client.0.smithi043.stderr: -187> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 1 librados: starting msgr at 2024-09-12T00:37:03.214 INFO:tasks.workunit.client.0.smithi043.stderr: -186> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 1 librados: starting objecter 2024-09-12T00:37:03.214 INFO:tasks.workunit.client.0.smithi043.stderr: -185> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command objecter_requests cmddesc objecter_requests hook 0x559c3a667dd0 EEXIST 2024-09-12T00:37:03.214 INFO:tasks.workunit.client.0.smithi043.stderr: -184> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 1 librados: setting wanted keys 2024-09-12T00:37:03.214 INFO:tasks.workunit.client.0.smithi043.stderr: -183> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 1 librados: calling monclient init 2024-09-12T00:37:03.214 INFO:tasks.workunit.client.0.smithi043.stderr: -182> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient: init 2024-09-12T00:37:03.214 INFO:tasks.workunit.client.0.smithi043.stderr: -181> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6443b0) adding auth protocol: cephx 2024-09-12T00:37:03.214 INFO:tasks.workunit.client.0.smithi043.stderr: -180> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6443b0) adding auth protocol: cephx 2024-09-12T00:37:03.214 INFO:tasks.workunit.client.0.smithi043.stderr: -179> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6443b0) adding auth protocol: cephx 2024-09-12T00:37:03.214 INFO:tasks.workunit.client.0.smithi043.stderr: -178> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6443b0) adding con mode: secure 2024-09-12T00:37:03.214 INFO:tasks.workunit.client.0.smithi043.stderr: -177> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6443b0) adding con mode: crc 2024-09-12T00:37:03.214 INFO:tasks.workunit.client.0.smithi043.stderr: -176> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6443b0) adding con mode: secure 2024-09-12T00:37:03.214 INFO:tasks.workunit.client.0.smithi043.stderr: -175> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6443b0) adding con mode: crc 2024-09-12T00:37:03.214 INFO:tasks.workunit.client.0.smithi043.stderr: -174> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6443b0) adding con mode: secure 2024-09-12T00:37:03.214 INFO:tasks.workunit.client.0.smithi043.stderr: -173> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6443b0) adding con mode: crc 2024-09-12T00:37:03.215 INFO:tasks.workunit.client.0.smithi043.stderr: -172> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6443b0) adding con mode: crc 2024-09-12T00:37:03.215 INFO:tasks.workunit.client.0.smithi043.stderr: -171> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6443b0) adding con mode: secure 2024-09-12T00:37:03.215 INFO:tasks.workunit.client.0.smithi043.stderr: -170> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6443b0) adding con mode: crc 2024-09-12T00:37:03.215 INFO:tasks.workunit.client.0.smithi043.stderr: -169> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6443b0) adding con mode: secure 2024-09-12T00:37:03.215 INFO:tasks.workunit.client.0.smithi043.stderr: -168> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6443b0) adding con mode: crc 2024-09-12T00:37:03.215 INFO:tasks.workunit.client.0.smithi043.stderr: -167> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6443b0) adding con mode: secure 2024-09-12T00:37:03.215 INFO:tasks.workunit.client.0.smithi043.stderr: -166> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.215 INFO:tasks.workunit.client.0.smithi043.stderr: -165> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.215 INFO:tasks.workunit.client.0.smithi043.stderr: -164> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command rotate-key cmddesc rotate-key hook 0x559c3a6444f8 EEXIST 2024-09-12T00:37:03.215 INFO:tasks.workunit.client.0.smithi043.stderr: -163> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:03.215 INFO:tasks.workunit.client.0.smithi043.stderr: -162> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:37:03.215 INFO:tasks.workunit.client.0.smithi043.stderr: -161> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): picked mon.noname-a con 0x559c3a6901d0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:37:03.215 INFO:tasks.workunit.client.0.smithi043.stderr: -160> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): picked mon.noname-b con 0x559c3a691a70 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:37:03.216 INFO:tasks.workunit.client.0.smithi043.stderr: -159> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): picked mon.noname-c con 0x559c3a685580 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:37:03.216 INFO:tasks.workunit.client.0.smithi043.stderr: -158> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.216 INFO:tasks.workunit.client.0.smithi043.stderr: -157> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.216 INFO:tasks.workunit.client.0.smithi043.stderr: -156> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.216 INFO:tasks.workunit.client.0.smithi043.stderr: -155> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:03.216 INFO:tasks.workunit.client.0.smithi043.stderr: -154> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): authenticate will time out at 2119.090888s 2024-09-12T00:37:03.216 INFO:tasks.workunit.client.0.smithi043.stderr: -153> 2024-09-12T00:37:03.098+0000 7fad7a7ed640 10 monclient(hunting): get_auth_request con 0x559c3a6901d0 auth_method 0 2024-09-12T00:37:03.216 INFO:tasks.workunit.client.0.smithi043.stderr: -152> 2024-09-12T00:37:03.098+0000 7fad7a7ed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.216 INFO:tasks.workunit.client.0.smithi043.stderr: -151> 2024-09-12T00:37:03.098+0000 7fad7a7ed640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.216 INFO:tasks.workunit.client.0.smithi043.stderr: -150> 2024-09-12T00:37:03.098+0000 7fad7a7ed640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.216 INFO:tasks.workunit.client.0.smithi043.stderr: -149> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): get_auth_request con 0x559c3a685580 auth_method 0 2024-09-12T00:37:03.216 INFO:tasks.workunit.client.0.smithi043.stderr: -148> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.216 INFO:tasks.workunit.client.0.smithi043.stderr: -147> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.217 INFO:tasks.workunit.client.0.smithi043.stderr: -146> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.217 INFO:tasks.workunit.client.0.smithi043.stderr: -145> 2024-09-12T00:37:03.098+0000 7fad7a7ed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:03.217 INFO:tasks.workunit.client.0.smithi043.stderr: -144> 2024-09-12T00:37:03.098+0000 7fad7a7ed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:03.217 INFO:tasks.workunit.client.0.smithi043.stderr: -143> 2024-09-12T00:37:03.098+0000 7fad7a7ed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:03.217 INFO:tasks.workunit.client.0.smithi043.stderr: -142> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:03.217 INFO:tasks.workunit.client.0.smithi043.stderr: -141> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:03.217 INFO:tasks.workunit.client.0.smithi043.stderr: -140> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:03.217 INFO:tasks.workunit.client.0.smithi043.stderr: -139> 2024-09-12T00:37:03.098+0000 7fad79fec640 10 monclient(hunting): get_auth_request con 0x559c3a691a70 auth_method 0 2024-09-12T00:37:03.217 INFO:tasks.workunit.client.0.smithi043.stderr: -138> 2024-09-12T00:37:03.098+0000 7fad79fec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.217 INFO:tasks.workunit.client.0.smithi043.stderr: -137> 2024-09-12T00:37:03.098+0000 7fad79fec640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.217 INFO:tasks.workunit.client.0.smithi043.stderr: -136> 2024-09-12T00:37:03.098+0000 7fad79fec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.217 INFO:tasks.workunit.client.0.smithi043.stderr: -135> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): handle_auth_done global_id 6290 payload 824 2024-09-12T00:37:03.217 INFO:tasks.workunit.client.0.smithi043.stderr: -134> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient: _finish_hunting 0 2024-09-12T00:37:03.217 INFO:tasks.workunit.client.0.smithi043.stderr: -133> 2024-09-12T00:37:03.098+0000 7fad7afee640 1 monclient: found mon.noname-c 2024-09-12T00:37:03.218 INFO:tasks.workunit.client.0.smithi043.stderr: -132> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:37:03.218 INFO:tasks.workunit.client.0.smithi043.stderr: -131> 2024-09-12T00:37:03.098+0000 7fac4bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:03.218 INFO:tasks.workunit.client.0.smithi043.stderr: -130> 2024-09-12T00:37:03.098+0000 7fac4bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:37:03.218 INFO:tasks.workunit.client.0.smithi043.stderr: -129> 2024-09-12T00:37:03.098+0000 7fac4bfff640 10 monclient: dump: 2024-09-12T00:37:03.218 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:03.218 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:03.218 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.218 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.218 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:03.218 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:03.218 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:03.218 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:03.218 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:03.218 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.219 INFO:tasks.workunit.client.0.smithi043.stderr: -128> 2024-09-12T00:37:03.098+0000 7fac4bfff640 10 monclient: _finish_auth 0 2024-09-12T00:37:03.219 INFO:tasks.workunit.client.0.smithi043.stderr: -127> 2024-09-12T00:37:03.098+0000 7fac4bfff640 10 monclient: _check_auth_tickets 2024-09-12T00:37:03.219 INFO:tasks.workunit.client.0.smithi043.stderr: -126> 2024-09-12T00:37:03.098+0000 7fac4bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:03.219 INFO:tasks.workunit.client.0.smithi043.stderr: -125> 2024-09-12T00:37:03.098+0000 7fac4bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:03.219 INFO:tasks.workunit.client.0.smithi043.stderr: -124> 2024-09-12T00:37:03.098+0000 7fac4bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:37:03.219 INFO:tasks.workunit.client.0.smithi043.stderr: -123> 2024-09-12T00:37:03.098+0000 7fac4bfff640 10 monclient: dump: 2024-09-12T00:37:03.219 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:03.219 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:03.219 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.219 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.219 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:03.219 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:03.219 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:03.219 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:03.220 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:03.220 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.220 INFO:tasks.workunit.client.0.smithi043.stderr: -122> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 monclient: authenticate success, global_id 6290 2024-09-12T00:37:03.220 INFO:tasks.workunit.client.0.smithi043.stderr: -121> 2024-09-12T00:37:03.098+0000 7fac5dffb640 4 set_mon_vals no callback set 2024-09-12T00:37:03.220 INFO:tasks.workunit.client.0.smithi043.stderr: -120> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient: _renew_subs 2024-09-12T00:37:03.220 INFO:tasks.workunit.client.0.smithi043.stderr: -119> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:37:03.220 INFO:tasks.workunit.client.0.smithi043.stderr: -118> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient: _renew_subs 2024-09-12T00:37:03.220 INFO:tasks.workunit.client.0.smithi043.stderr: -117> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:37:03.220 INFO:tasks.workunit.client.0.smithi043.stderr: -116> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 1 librados: init done 2024-09-12T00:37:03.220 INFO:tasks.workunit.client.0.smithi043.stderr: -115> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command cr dump hook 0x559c3a666268 2024-09-12T00:37:03.220 INFO:tasks.workunit.client.0.smithi043.stderr: -114> 2024-09-12T00:37:03.102+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.220 INFO:tasks.workunit.client.0.smithi043.stderr: -113> 2024-09-12T00:37:03.102+0000 7fac4bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:03.220 INFO:tasks.workunit.client.0.smithi043.stderr: -112> 2024-09-12T00:37:03.102+0000 7fac4bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:37:03.221 INFO:tasks.workunit.client.0.smithi043.stderr: -111> 2024-09-12T00:37:03.102+0000 7fac4bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:37:03.221 INFO:tasks.workunit.client.0.smithi043.stderr: -110> 2024-09-12T00:37:03.102+0000 7fad7a7ed640 10 monclient: get_auth_request con 0x7fac44070ad0 auth_method 0 2024-09-12T00:37:03.221 INFO:tasks.workunit.client.0.smithi043.stderr: -109> 2024-09-12T00:37:03.102+0000 7fad79fec640 10 monclient: get_auth_request con 0x559c3a6af940 auth_method 0 2024-09-12T00:37:03.221 INFO:tasks.workunit.client.0.smithi043.stderr: -108> 2024-09-12T00:37:03.102+0000 7fad7cce79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.221 INFO:tasks.workunit.client.0.smithi043.stderr: -107> 2024-09-12T00:37:03.102+0000 7fad7cce79c0 20 realm 2024-09-12T00:37:03.221 INFO:tasks.workunit.client.0.smithi043.stderr: -106> 2024-09-12T00:37:03.102+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.221 INFO:tasks.workunit.client.0.smithi043.stderr: -105> 2024-09-12T00:37:03.102+0000 7fad7cce79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.221 INFO:tasks.workunit.client.0.smithi043.stderr: -104> 2024-09-12T00:37:03.102+0000 7fad7cce79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:03.221 INFO:tasks.workunit.client.0.smithi043.stderr: -103> 2024-09-12T00:37:03.102+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.221 INFO:tasks.workunit.client.0.smithi043.stderr: -102> 2024-09-12T00:37:03.102+0000 7fad7cce79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.221 INFO:tasks.workunit.client.0.smithi043.stderr: -101> 2024-09-12T00:37:03.102+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.221 INFO:tasks.workunit.client.0.smithi043.stderr: -100> 2024-09-12T00:37:03.102+0000 7fad7a7ed640 10 monclient: get_auth_request con 0x559c3a6b3b50 auth_method 0 2024-09-12T00:37:03.221 INFO:tasks.workunit.client.0.smithi043.stderr: -99> 2024-09-12T00:37:03.106+0000 7fad7cce79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:03.222 INFO:tasks.workunit.client.0.smithi043.stderr: -98> 2024-09-12T00:37:03.106+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.222 INFO:tasks.workunit.client.0.smithi043.stderr: -97> 2024-09-12T00:37:03.106+0000 7fad79fec640 10 monclient: get_auth_request con 0x559c3a6b73b0 auth_method 0 2024-09-12T00:37:03.222 INFO:tasks.workunit.client.0.smithi043.stderr: -96> 2024-09-12T00:37:03.106+0000 7fad7cce79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:03.222 INFO:tasks.workunit.client.0.smithi043.stderr: -95> 2024-09-12T00:37:03.106+0000 7fad7cce79c0 20 searching for the correct realm 2024-09-12T00:37:03.222 INFO:tasks.workunit.client.0.smithi043.stderr: -94> 2024-09-12T00:37:03.106+0000 7fad7afee640 10 monclient: get_auth_request con 0x559c3a6bc0b0 auth_method 0 2024-09-12T00:37:03.222 INFO:tasks.workunit.client.0.smithi043.stderr: -93> 2024-09-12T00:37:03.106+0000 7fad7a7ed640 10 monclient: get_auth_request con 0x7fad740ab900 auth_method 0 2024-09-12T00:37:03.222 INFO:tasks.workunit.client.0.smithi043.stderr: -92> 2024-09-12T00:37:03.110+0000 7fad79fec640 10 monclient: get_auth_request con 0x7fad70028040 auth_method 0 2024-09-12T00:37:03.222 INFO:tasks.workunit.client.0.smithi043.stderr: -91> 2024-09-12T00:37:03.110+0000 7fad79fec640 0 -- 172.21.15.43:0/1311472971 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x559c3a6af940 msgr2=0x559c3a6b1dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:03.222 INFO:tasks.workunit.client.0.smithi043.stderr: -90> 2024-09-12T00:37:03.114+0000 7fac4bfff640 1 client.6290.objecter ms_handle_reset 0x559c3a6af940 session 0x559c3a6af2c0 osd.1 2024-09-12T00:37:03.222 INFO:tasks.workunit.client.0.smithi043.stderr: -89> 2024-09-12T00:37:03.114+0000 7fac4bfff640 10 monclient: _renew_subs 2024-09-12T00:37:03.222 INFO:tasks.workunit.client.0.smithi043.stderr: -88> 2024-09-12T00:37:03.114+0000 7fac4bfff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:37:03.222 INFO:tasks.workunit.client.0.smithi043.stderr: -87> 2024-09-12T00:37:03.114+0000 7fad79fec640 10 monclient: get_auth_request con 0x7fac44080b70 auth_method 0 2024-09-12T00:37:03.222 INFO:tasks.workunit.client.0.smithi043.stderr: -86> 2024-09-12T00:37:03.114+0000 7fad7afee640 10 monclient: get_auth_request con 0x7fad70008040 auth_method 0 2024-09-12T00:37:03.223 INFO:tasks.workunit.client.0.smithi043.stderr: -85> 2024-09-12T00:37:03.118+0000 7fad7a7ed640 10 monclient: get_auth_request con 0x7fad70061940 auth_method 0 2024-09-12T00:37:03.223 INFO:tasks.workunit.client.0.smithi043.stderr: -84> 2024-09-12T00:37:03.118+0000 7fad7a7ed640 0 -- 172.21.15.43:0/1311472971 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fad70061940 msgr2=0x7fad70034410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:03.223 INFO:tasks.workunit.client.0.smithi043.stderr: -83> 2024-09-12T00:37:03.118+0000 7fac4bfff640 1 client.6290.objecter ms_handle_reset 0x7fad70061940 session 0x7fad70008e60 osd.0 2024-09-12T00:37:03.223 INFO:tasks.workunit.client.0.smithi043.stderr: -82> 2024-09-12T00:37:03.118+0000 7fad7a7ed640 10 monclient: get_auth_request con 0x559c3a6af940 auth_method 0 2024-09-12T00:37:03.223 INFO:tasks.workunit.client.0.smithi043.stderr: -81> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:37:03.223 INFO:tasks.workunit.client.0.smithi043.stderr: -80> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:03.223 INFO:tasks.workunit.client.0.smithi043.stderr: -79> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:03.223 INFO:tasks.workunit.client.0.smithi043.stderr: -78> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:37:03.223 INFO:tasks.workunit.client.0.smithi043.stderr: -77> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:03.223 INFO:tasks.workunit.client.0.smithi043.stderr: -76> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:03.223 INFO:tasks.workunit.client.0.smithi043.stderr: -75> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.223 INFO:tasks.workunit.client.0.smithi043.stderr: -74> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.223 INFO:tasks.workunit.client.0.smithi043.stderr: -73> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.224 INFO:tasks.workunit.client.0.smithi043.stderr: -72> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:03.224 INFO:tasks.workunit.client.0.smithi043.stderr: -71> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.224 INFO:tasks.workunit.client.0.smithi043.stderr: -70> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:03.224 INFO:tasks.workunit.client.0.smithi043.stderr: -69> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 zone default found 2024-09-12T00:37:03.224 INFO:tasks.workunit.client.0.smithi043.stderr: -68> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 4 Realm: () 2024-09-12T00:37:03.224 INFO:tasks.workunit.client.0.smithi043.stderr: -67> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:37:03.224 INFO:tasks.workunit.client.0.smithi043.stderr: -66> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:37:03.224 INFO:tasks.workunit.client.0.smithi043.stderr: -65> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:03.224 INFO:tasks.workunit.client.0.smithi043.stderr: -64> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 zonegroup default 2024-09-12T00:37:03.224 INFO:tasks.workunit.client.0.smithi043.stderr: -63> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.224 INFO:tasks.workunit.client.0.smithi043.stderr: -62> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.224 INFO:tasks.workunit.client.0.smithi043.stderr: -61> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.224 INFO:tasks.workunit.client.0.smithi043.stderr: -60> 2024-09-12T00:37:03.130+0000 7fad7cce79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.225 INFO:tasks.workunit.client.0.smithi043.stderr: -59> 2024-09-12T00:37:03.130+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.225 INFO:tasks.workunit.client.0.smithi043.stderr: -58> 2024-09-12T00:37:03.130+0000 7fad7cce79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.225 INFO:tasks.workunit.client.0.smithi043.stderr: -57> 2024-09-12T00:37:03.130+0000 7fad7cce79c0 20 started sync module instance, tier type = 2024-09-12T00:37:03.225 INFO:tasks.workunit.client.0.smithi043.stderr: -56> 2024-09-12T00:37:03.130+0000 7fad7cce79c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:37:03.225 INFO:tasks.workunit.client.0.smithi043.stderr: -55> 2024-09-12T00:37:03.146+0000 7fad7cce79c0 20 add_watcher() i=0 2024-09-12T00:37:03.225 INFO:tasks.workunit.client.0.smithi043.stderr: -54> 2024-09-12T00:37:03.146+0000 7fad7cce79c0 20 add_watcher() i=1 2024-09-12T00:37:03.225 INFO:tasks.workunit.client.0.smithi043.stderr: -53> 2024-09-12T00:37:03.146+0000 7fad7cce79c0 20 add_watcher() i=2 2024-09-12T00:37:03.225 INFO:tasks.workunit.client.0.smithi043.stderr: -52> 2024-09-12T00:37:03.146+0000 7fad7cce79c0 20 add_watcher() i=3 2024-09-12T00:37:03.225 INFO:tasks.workunit.client.0.smithi043.stderr: -51> 2024-09-12T00:37:03.146+0000 7fad7cce79c0 20 add_watcher() i=4 2024-09-12T00:37:03.225 INFO:tasks.workunit.client.0.smithi043.stderr: -50> 2024-09-12T00:37:03.146+0000 7fad7cce79c0 20 add_watcher() i=5 2024-09-12T00:37:03.225 INFO:tasks.workunit.client.0.smithi043.stderr: -49> 2024-09-12T00:37:03.146+0000 7fad7cce79c0 20 add_watcher() i=6 2024-09-12T00:37:03.225 INFO:tasks.workunit.client.0.smithi043.stderr: -48> 2024-09-12T00:37:03.146+0000 7fad7cce79c0 20 add_watcher() i=7 2024-09-12T00:37:03.225 INFO:tasks.workunit.client.0.smithi043.stderr: -47> 2024-09-12T00:37:03.146+0000 7fad7cce79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:03.225 INFO:tasks.workunit.client.0.smithi043.stderr: -46> 2024-09-12T00:37:03.146+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefec60) adding auth protocol: cephx 2024-09-12T00:37:03.226 INFO:tasks.workunit.client.0.smithi043.stderr: -45> 2024-09-12T00:37:03.146+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefec60) adding auth protocol: cephx 2024-09-12T00:37:03.226 INFO:tasks.workunit.client.0.smithi043.stderr: -44> 2024-09-12T00:37:03.146+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefec60) adding auth protocol: cephx 2024-09-12T00:37:03.226 INFO:tasks.workunit.client.0.smithi043.stderr: -43> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefec60) adding con mode: secure 2024-09-12T00:37:03.226 INFO:tasks.workunit.client.0.smithi043.stderr: -42> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefec60) adding con mode: crc 2024-09-12T00:37:03.226 INFO:tasks.workunit.client.0.smithi043.stderr: -41> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefec60) adding con mode: secure 2024-09-12T00:37:03.226 INFO:tasks.workunit.client.0.smithi043.stderr: -40> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefec60) adding con mode: crc 2024-09-12T00:37:03.226 INFO:tasks.workunit.client.0.smithi043.stderr: -39> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefec60) adding con mode: secure 2024-09-12T00:37:03.226 INFO:tasks.workunit.client.0.smithi043.stderr: -38> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefec60) adding con mode: crc 2024-09-12T00:37:03.226 INFO:tasks.workunit.client.0.smithi043.stderr: -37> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefec60) adding con mode: crc 2024-09-12T00:37:03.226 INFO:tasks.workunit.client.0.smithi043.stderr: -36> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefec60) adding con mode: secure 2024-09-12T00:37:03.226 INFO:tasks.workunit.client.0.smithi043.stderr: -35> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefec60) adding con mode: crc 2024-09-12T00:37:03.226 INFO:tasks.workunit.client.0.smithi043.stderr: -34> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefec60) adding con mode: secure 2024-09-12T00:37:03.226 INFO:tasks.workunit.client.0.smithi043.stderr: -33> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefec60) adding con mode: crc 2024-09-12T00:37:03.226 INFO:tasks.workunit.client.0.smithi043.stderr: -32> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefec60) adding con mode: secure 2024-09-12T00:37:03.227 INFO:tasks.workunit.client.0.smithi043.stderr: -31> 2024-09-12T00:37:03.146+0000 7fac30fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:03.227 INFO:tasks.workunit.client.0.smithi043.stderr: -30> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.227 INFO:tasks.workunit.client.0.smithi043.stderr: -29> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:03.227 INFO:tasks.workunit.client.0.smithi043.stderr: -28> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:03.227 INFO:tasks.workunit.client.0.smithi043.stderr: -27> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command cache list hook 0x559c3a68c5d0 2024-09-12T00:37:03.227 INFO:tasks.workunit.client.0.smithi043.stderr: -26> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command cache inspect hook 0x559c3a68c5d0 2024-09-12T00:37:03.227 INFO:tasks.workunit.client.0.smithi043.stderr: -25> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command cache erase hook 0x559c3a68c5d0 2024-09-12T00:37:03.227 INFO:tasks.workunit.client.0.smithi043.stderr: -24> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command cache zap hook 0x559c3a68c5d0 2024-09-12T00:37:03.227 INFO:tasks.workunit.client.0.smithi043.stderr: -23> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 note: GC not initialized 2024-09-12T00:37:03.227 INFO:tasks.workunit.client.0.smithi043.stderr: -22> 2024-09-12T00:37:03.150+0000 7fabab7fe640 20 reqs_thread_entry: start 2024-09-12T00:37:03.227 INFO:tasks.workunit.client.0.smithi043.stderr: -21> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command sync trace show hook 0x7fad70004300 2024-09-12T00:37:03.227 INFO:tasks.workunit.client.0.smithi043.stderr: -20> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command sync trace history hook 0x7fad70004300 2024-09-12T00:37:03.227 INFO:tasks.workunit.client.0.smithi043.stderr: -19> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command sync trace active hook 0x7fad70004300 2024-09-12T00:37:03.228 INFO:tasks.workunit.client.0.smithi043.stderr: -18> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command sync trace active_short hook 0x7fad70004300 2024-09-12T00:37:03.228 INFO:tasks.workunit.client.0.smithi043.stderr: -17> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:03.228 INFO:tasks.workunit.client.0.smithi043.stderr: -16> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 20 Filter name: none 2024-09-12T00:37:03.228 INFO:tasks.workunit.client.0.smithi043.stderr: -15> 2024-09-12T00:37:03.150+0000 7faba97fa640 20 reqs_thread_entry: start 2024-09-12T00:37:03.228 INFO:tasks.workunit.client.0.smithi043.stderr: -14> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:37:03.228 INFO:tasks.workunit.client.0.smithi043.stderr: -13> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.228 INFO:tasks.workunit.client.0.smithi043.stderr: -12> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:37:03.228 INFO:tasks.workunit.client.0.smithi043.stderr: -11> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:37:03.228 INFO:tasks.workunit.client.0.smithi043.stderr: -10> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:37:03.228 INFO:tasks.workunit.client.0.smithi043.stderr: -9> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 : miss 2024-09-12T00:37:03.228 INFO:tasks.workunit.client.0.smithi043.stderr: -8> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.229 INFO:tasks.workunit.client.0.smithi043.stderr: -7> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:37:03.229 INFO:tasks.workunit.client.0.smithi043.stderr: -6> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 info.flags=0x17 2024-09-12T00:37:03.229 INFO:tasks.workunit.client.0.smithi043.stderr: -5> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 to cache LRU end 2024-09-12T00:37:03.229 INFO:tasks.workunit.client.0.smithi043.stderr: -4> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:03.229 INFO:tasks.workunit.client.0.smithi043.stderr: -3> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:03.229 INFO:tasks.workunit.client.0.smithi043.stderr: -2> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 2024-09-12T00:37:03.229 INFO:tasks.workunit.client.0.smithi043.stderr: -1> 2024-09-12T00:37:03.158+0000 7fad7cce79c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fad7cce79c0 time 2024-09-12T00:37:03.162508+0000 2024-09-12T00:37:03.229 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:37:03.229 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.229 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:03.229 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fad805c12eb] 2024-09-12T00:37:03.229 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fad805c149f] 2024-09-12T00:37:03.230 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559c38ed2cc1] 2024-09-12T00:37:03.230 INFO:tasks.workunit.client.0.smithi043.stderr: 4: radosgw-admin(+0x1422078) [0x559c39930078] 2024-09-12T00:37:03.230 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559c38ee7ced] 2024-09-12T00:37:03.230 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:37:03.230 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fad7f427d90] 2024-09-12T00:37:03.230 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:37:03.230 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:37:03.230 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.230 INFO:tasks.workunit.client.0.smithi043.stderr: 0> 2024-09-12T00:37:03.162+0000 7fad7cce79c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:37:03.230 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7fad7cce79c0 thread_name:radosgw-admin 2024-09-12T00:37:03.230 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.230 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:03.230 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fad7f440520] 2024-09-12T00:37:03.231 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:37:03.231 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:37:03.231 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:37:03.231 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fad805c1345] 2024-09-12T00:37:03.231 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fad805c149f] 2024-09-12T00:37:03.231 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559c38ed2cc1] 2024-09-12T00:37:03.231 INFO:tasks.workunit.client.0.smithi043.stderr: 8: radosgw-admin(+0x1422078) [0x559c39930078] 2024-09-12T00:37:03.231 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559c38ee7ced] 2024-09-12T00:37:03.231 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:37:03.231 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fad7f427d90] 2024-09-12T00:37:03.231 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:37:03.231 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:37:03.231 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:37:03.231 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.232 INFO:tasks.workunit.client.0.smithi043.stderr:--- logging levels --- 2024-09-12T00:37:03.232 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 none 2024-09-12T00:37:03.232 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 lockdep 2024-09-12T00:37:03.232 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 context 2024-09-12T00:37:03.232 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 crush 2024-09-12T00:37:03.232 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds 2024-09-12T00:37:03.232 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_balancer 2024-09-12T00:37:03.232 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_locker 2024-09-12T00:37:03.232 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log 2024-09-12T00:37:03.232 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log_expire 2024-09-12T00:37:03.232 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_migrator 2024-09-12T00:37:03.232 INFO:tasks.workunit.client.0.smithi043.stderr: 3/ 5 mds_quiesce 2024-09-12T00:37:03.232 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 buffer 2024-09-12T00:37:03.233 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 timer 2024-09-12T00:37:03.233 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 filer 2024-09-12T00:37:03.233 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 striper 2024-09-12T00:37:03.233 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 objecter 2024-09-12T00:37:03.233 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rados 2024-09-12T00:37:03.233 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd 2024-09-12T00:37:03.233 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_mirror 2024-09-12T00:37:03.233 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_replay 2024-09-12T00:37:03.233 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_pwl 2024-09-12T00:37:03.233 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 journaler 2024-09-12T00:37:03.233 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objectcacher 2024-09-12T00:37:03.233 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:37:03.233 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 client 2024-09-12T00:37:03.233 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 osd 2024-09-12T00:37:03.234 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 optracker 2024-09-12T00:37:03.234 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objclass 2024-09-12T00:37:03.234 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 filestore 2024-09-12T00:37:03.234 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 journal 2024-09-12T00:37:03.234 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 ms 2024-09-12T00:37:03.234 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mon 2024-09-12T00:37:03.234 INFO:tasks.workunit.client.0.smithi043.stderr: 0/10 monc 2024-09-12T00:37:03.234 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 paxos 2024-09-12T00:37:03.234 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 tp 2024-09-12T00:37:03.234 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 auth 2024-09-12T00:37:03.234 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 crypto 2024-09-12T00:37:03.234 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 finisher 2024-09-12T00:37:03.234 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 reserver 2024-09-12T00:37:03.234 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 heartbeatmap 2024-09-12T00:37:03.235 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 perfcounter 2024-09-12T00:37:03.235 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw 2024-09-12T00:37:03.235 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_sync 2024-09-12T00:37:03.235 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_datacache 2024-09-12T00:37:03.235 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_access 2024-09-12T00:37:03.235 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:37:03.235 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_flight 2024-09-12T00:37:03.235 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:37:03.235 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw_notification 2024-09-12T00:37:03.235 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 javaclient 2024-09-12T00:37:03.235 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 asok 2024-09-12T00:37:03.235 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 throttle 2024-09-12T00:37:03.235 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 refs 2024-09-12T00:37:03.235 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 compressor 2024-09-12T00:37:03.236 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluestore 2024-09-12T00:37:03.236 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluefs 2024-09-12T00:37:03.236 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 bdev 2024-09-12T00:37:03.236 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 kstore 2024-09-12T00:37:03.236 INFO:tasks.workunit.client.0.smithi043.stderr: 4/ 5 rocksdb 2024-09-12T00:37:03.236 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 fuse 2024-09-12T00:37:03.236 INFO:tasks.workunit.client.0.smithi043.stderr: 2/ 5 mgr 2024-09-12T00:37:03.236 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mgrc 2024-09-12T00:37:03.236 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 dpdk 2024-09-12T00:37:03.236 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 eventtrace 2024-09-12T00:37:03.236 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 prioritycache 2024-09-12T00:37:03.236 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 test 2024-09-12T00:37:03.236 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:37:03.237 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephsqlite 2024-09-12T00:37:03.237 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:37:03.237 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore 2024-09-12T00:37:03.237 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_onode 2024-09-12T00:37:03.237 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_odata 2024-09-12T00:37:03.237 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_omap 2024-09-12T00:37:03.237 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_tm 2024-09-12T00:37:03.237 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_t 2024-09-12T00:37:03.237 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:37:03.237 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_epm 2024-09-12T00:37:03.237 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_lba 2024-09-12T00:37:03.237 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:37:03.237 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cache 2024-09-12T00:37:03.237 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_journal 2024-09-12T00:37:03.238 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_device 2024-09-12T00:37:03.238 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_backref 2024-09-12T00:37:03.238 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 alienstore 2024-09-12T00:37:03.238 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mclock 2024-09-12T00:37:03.238 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cyanstore 2024-09-12T00:37:03.238 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 ceph_exporter 2024-09-12T00:37:03.238 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 memstore 2024-09-12T00:37:03.238 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 trace 2024-09-12T00:37:03.238 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 ceph_dedup 2024-09-12T00:37:03.238 INFO:tasks.workunit.client.0.smithi043.stderr: -2/-2 (syslog threshold) 2024-09-12T00:37:03.238 INFO:tasks.workunit.client.0.smithi043.stderr: 99/99 (stderr threshold) 2024-09-12T00:37:03.238 INFO:tasks.workunit.client.0.smithi043.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:37:03.238 INFO:tasks.workunit.client.0.smithi043.stderr: 7faba97fa640 / http_manager 2024-09-12T00:37:03.239 INFO:tasks.workunit.client.0.smithi043.stderr: 7fabab7fe640 / http_manager 2024-09-12T00:37:03.239 INFO:tasks.workunit.client.0.smithi043.stderr: 7fac30fe1640 / rgw_dt_lg_renew 2024-09-12T00:37:03.239 INFO:tasks.workunit.client.0.smithi043.stderr: 7fac4bfff640 / ms_dispatch 2024-09-12T00:37:03.239 INFO:tasks.workunit.client.0.smithi043.stderr: 7fac5dffb640 / io_context_pool 2024-09-12T00:37:03.239 INFO:tasks.workunit.client.0.smithi043.stderr: 7fac5ffff640 / ms_dispatch 2024-09-12T00:37:03.239 INFO:tasks.workunit.client.0.smithi043.stderr: 7fac66e05640 / ms_dispatch 2024-09-12T00:37:03.239 INFO:tasks.workunit.client.0.smithi043.stderr: 7fac68608640 / io_context_pool 2024-09-12T00:37:03.239 INFO:tasks.workunit.client.0.smithi043.stderr: 7fad79fec640 / msgr-worker-2 2024-09-12T00:37:03.239 INFO:tasks.workunit.client.0.smithi043.stderr: 7fad7a7ed640 / msgr-worker-1 2024-09-12T00:37:03.239 INFO:tasks.workunit.client.0.smithi043.stderr: 7fad7afee640 / msgr-worker-0 2024-09-12T00:37:03.239 INFO:tasks.workunit.client.0.smithi043.stderr: 7fad7b7ef640 / io_context_pool 2024-09-12T00:37:03.239 INFO:tasks.workunit.client.0.smithi043.stderr: 7fad7cce79c0 / radosgw-admin 2024-09-12T00:37:03.239 INFO:tasks.workunit.client.0.smithi043.stderr: max_recent 500 2024-09-12T00:37:03.239 INFO:tasks.workunit.client.0.smithi043.stderr: max_new 1000 2024-09-12T00:37:03.240 INFO:tasks.workunit.client.0.smithi043.stderr: log_file /var/log/ceph/ceph-client.admin.89686.log 2024-09-12T00:37:03.240 INFO:tasks.workunit.client.0.smithi043.stderr:--- end dump of recent events --- 2024-09-12T00:37:03.240 INFO:tasks.workunit.client.0.smithi043.stderr:--- begin dump of recent events --- 2024-09-12T00:37:03.240 INFO:tasks.workunit.client.0.smithi043.stderr: -499> 2024-09-12T00:37:03.078+0000 7fad7a7ed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:03.240 INFO:tasks.workunit.client.0.smithi043.stderr: -498> 2024-09-12T00:37:03.078+0000 7fad7a7ed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:03.240 INFO:tasks.workunit.client.0.smithi043.stderr: -497> 2024-09-12T00:37:03.078+0000 7fad7afee640 10 monclient(hunting): get_auth_request con 0x559c3a512170 auth_method 0 2024-09-12T00:37:03.240 INFO:tasks.workunit.client.0.smithi043.stderr: -496> 2024-09-12T00:37:03.078+0000 7fad7afee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.240 INFO:tasks.workunit.client.0.smithi043.stderr: -495> 2024-09-12T00:37:03.078+0000 7fad7afee640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.240 INFO:tasks.workunit.client.0.smithi043.stderr: -494> 2024-09-12T00:37:03.078+0000 7fad7afee640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.240 INFO:tasks.workunit.client.0.smithi043.stderr: -493> 2024-09-12T00:37:03.078+0000 7fad7a7ed640 10 monclient(hunting): handle_auth_done global_id 6549 payload 274 2024-09-12T00:37:03.240 INFO:tasks.workunit.client.0.smithi043.stderr: -492> 2024-09-12T00:37:03.078+0000 7fad7a7ed640 10 monclient: _finish_hunting 0 2024-09-12T00:37:03.240 INFO:tasks.workunit.client.0.smithi043.stderr: -491> 2024-09-12T00:37:03.078+0000 7fad7a7ed640 1 monclient: found mon.noname-a 2024-09-12T00:37:03.241 INFO:tasks.workunit.client.0.smithi043.stderr: -490> 2024-09-12T00:37:03.078+0000 7fad7a7ed640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:37:03.241 INFO:tasks.workunit.client.0.smithi043.stderr: -489> 2024-09-12T00:37:03.082+0000 7fac68608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:03.241 INFO:tasks.workunit.client.0.smithi043.stderr: -488> 2024-09-12T00:37:03.082+0000 7fac68608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:03.241 INFO:tasks.workunit.client.0.smithi043.stderr: -487> 2024-09-12T00:37:03.082+0000 7fac68608640 10 monclient: dump: 2024-09-12T00:37:03.241 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:03.241 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:03.241 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.241 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.241 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:03.241 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:03.241 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:03.241 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:03.241 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:03.241 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.242 INFO:tasks.workunit.client.0.smithi043.stderr: -486> 2024-09-12T00:37:03.082+0000 7fac68608640 10 monclient: _finish_auth 0 2024-09-12T00:37:03.242 INFO:tasks.workunit.client.0.smithi043.stderr: -485> 2024-09-12T00:37:03.082+0000 7fac68608640 10 monclient: _check_auth_tickets 2024-09-12T00:37:03.242 INFO:tasks.workunit.client.0.smithi043.stderr: -484> 2024-09-12T00:37:03.082+0000 7fac68608640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:03.242 INFO:tasks.workunit.client.0.smithi043.stderr: -483> 2024-09-12T00:37:03.082+0000 7fac68608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:03.242 INFO:tasks.workunit.client.0.smithi043.stderr: -482> 2024-09-12T00:37:03.082+0000 7fac68608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:03.242 INFO:tasks.workunit.client.0.smithi043.stderr: -481> 2024-09-12T00:37:03.082+0000 7fac68608640 10 monclient: dump: 2024-09-12T00:37:03.242 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:03.242 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:03.242 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.242 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.242 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:03.242 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:03.242 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:03.243 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:03.243 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:03.243 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.243 INFO:tasks.workunit.client.0.smithi043.stderr: -480> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 monclient: authenticate success, global_id 6549 2024-09-12T00:37:03.243 INFO:tasks.workunit.client.0.smithi043.stderr: -479> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient: get_monmap_and_config success 2024-09-12T00:37:03.243 INFO:tasks.workunit.client.0.smithi043.stderr: -478> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 4 set_mon_vals no callback set 2024-09-12T00:37:03.243 INFO:tasks.workunit.client.0.smithi043.stderr: -477> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient: shutdown 2024-09-12T00:37:03.243 INFO:tasks.workunit.client.0.smithi043.stderr: -476> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) unregister_commands rotate-key 2024-09-12T00:37:03.243 INFO:tasks.workunit.client.0.smithi043.stderr: -475> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient: build_initial_monmap 2024-09-12T00:37:03.243 INFO:tasks.workunit.client.0.smithi043.stderr: -474> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:03.243 INFO:tasks.workunit.client.0.smithi043.stderr: -473> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient: monmap: 2024-09-12T00:37:03.243 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:37:03.244 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:03.244 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:37:03.244 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:37:03.244 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:03.244 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:03.244 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:37:03.244 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:37:03.244 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:37:03.244 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.244 INFO:tasks.workunit.client.0.smithi043.stderr: -472> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5cc8a0) adding auth protocol: cephx 2024-09-12T00:37:03.244 INFO:tasks.workunit.client.0.smithi043.stderr: -471> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5cc8a0) adding auth protocol: cephx 2024-09-12T00:37:03.244 INFO:tasks.workunit.client.0.smithi043.stderr: -470> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5cc8a0) adding auth protocol: cephx 2024-09-12T00:37:03.244 INFO:tasks.workunit.client.0.smithi043.stderr: -469> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5cc8a0) adding con mode: secure 2024-09-12T00:37:03.244 INFO:tasks.workunit.client.0.smithi043.stderr: -468> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5cc8a0) adding con mode: crc 2024-09-12T00:37:03.245 INFO:tasks.workunit.client.0.smithi043.stderr: -467> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5cc8a0) adding con mode: secure 2024-09-12T00:37:03.245 INFO:tasks.workunit.client.0.smithi043.stderr: -466> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5cc8a0) adding con mode: crc 2024-09-12T00:37:03.245 INFO:tasks.workunit.client.0.smithi043.stderr: -465> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5cc8a0) adding con mode: secure 2024-09-12T00:37:03.245 INFO:tasks.workunit.client.0.smithi043.stderr: -464> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5cc8a0) adding con mode: crc 2024-09-12T00:37:03.245 INFO:tasks.workunit.client.0.smithi043.stderr: -463> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5cc8a0) adding con mode: crc 2024-09-12T00:37:03.245 INFO:tasks.workunit.client.0.smithi043.stderr: -462> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5cc8a0) adding con mode: secure 2024-09-12T00:37:03.245 INFO:tasks.workunit.client.0.smithi043.stderr: -461> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5cc8a0) adding con mode: crc 2024-09-12T00:37:03.245 INFO:tasks.workunit.client.0.smithi043.stderr: -460> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5cc8a0) adding con mode: secure 2024-09-12T00:37:03.245 INFO:tasks.workunit.client.0.smithi043.stderr: -459> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5cc8a0) adding con mode: crc 2024-09-12T00:37:03.245 INFO:tasks.workunit.client.0.smithi043.stderr: -458> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5cc8a0) adding con mode: secure 2024-09-12T00:37:03.245 INFO:tasks.workunit.client.0.smithi043.stderr: -457> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.245 INFO:tasks.workunit.client.0.smithi043.stderr: -456> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 1 librados: starting msgr at 2024-09-12T00:37:03.245 INFO:tasks.workunit.client.0.smithi043.stderr: -455> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 1 librados: starting objecter 2024-09-12T00:37:03.246 INFO:tasks.workunit.client.0.smithi043.stderr: -454> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command objecter_requests hook 0x559c3a395d30 2024-09-12T00:37:03.246 INFO:tasks.workunit.client.0.smithi043.stderr: -453> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 1 librados: setting wanted keys 2024-09-12T00:37:03.246 INFO:tasks.workunit.client.0.smithi043.stderr: -452> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 1 librados: calling monclient init 2024-09-12T00:37:03.246 INFO:tasks.workunit.client.0.smithi043.stderr: -451> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient: init 2024-09-12T00:37:03.246 INFO:tasks.workunit.client.0.smithi043.stderr: -450> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5c6d60) adding auth protocol: cephx 2024-09-12T00:37:03.246 INFO:tasks.workunit.client.0.smithi043.stderr: -449> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5c6d60) adding auth protocol: cephx 2024-09-12T00:37:03.246 INFO:tasks.workunit.client.0.smithi043.stderr: -448> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5c6d60) adding auth protocol: cephx 2024-09-12T00:37:03.246 INFO:tasks.workunit.client.0.smithi043.stderr: -447> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5c6d60) adding con mode: secure 2024-09-12T00:37:03.246 INFO:tasks.workunit.client.0.smithi043.stderr: -446> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5c6d60) adding con mode: crc 2024-09-12T00:37:03.246 INFO:tasks.workunit.client.0.smithi043.stderr: -445> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5c6d60) adding con mode: secure 2024-09-12T00:37:03.246 INFO:tasks.workunit.client.0.smithi043.stderr: -444> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5c6d60) adding con mode: crc 2024-09-12T00:37:03.246 INFO:tasks.workunit.client.0.smithi043.stderr: -443> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5c6d60) adding con mode: secure 2024-09-12T00:37:03.246 INFO:tasks.workunit.client.0.smithi043.stderr: -442> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5c6d60) adding con mode: crc 2024-09-12T00:37:03.246 INFO:tasks.workunit.client.0.smithi043.stderr: -441> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5c6d60) adding con mode: crc 2024-09-12T00:37:03.247 INFO:tasks.workunit.client.0.smithi043.stderr: -440> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5c6d60) adding con mode: secure 2024-09-12T00:37:03.247 INFO:tasks.workunit.client.0.smithi043.stderr: -439> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5c6d60) adding con mode: crc 2024-09-12T00:37:03.247 INFO:tasks.workunit.client.0.smithi043.stderr: -438> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5c6d60) adding con mode: secure 2024-09-12T00:37:03.247 INFO:tasks.workunit.client.0.smithi043.stderr: -437> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5c6d60) adding con mode: crc 2024-09-12T00:37:03.247 INFO:tasks.workunit.client.0.smithi043.stderr: -436> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a5c6d60) adding con mode: secure 2024-09-12T00:37:03.247 INFO:tasks.workunit.client.0.smithi043.stderr: -435> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.247 INFO:tasks.workunit.client.0.smithi043.stderr: -434> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.247 INFO:tasks.workunit.client.0.smithi043.stderr: -433> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command rotate-key hook 0x559c3a5c6ea8 2024-09-12T00:37:03.247 INFO:tasks.workunit.client.0.smithi043.stderr: -432> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:03.247 INFO:tasks.workunit.client.0.smithi043.stderr: -431> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:37:03.247 INFO:tasks.workunit.client.0.smithi043.stderr: -430> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient(hunting): picked mon.noname-b con 0x559c3a476820 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:37:03.247 INFO:tasks.workunit.client.0.smithi043.stderr: -429> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient(hunting): picked mon.noname-c con 0x559c3a481a80 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:37:03.247 INFO:tasks.workunit.client.0.smithi043.stderr: -428> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient(hunting): picked mon.noname-a con 0x559c3a512170 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:37:03.248 INFO:tasks.workunit.client.0.smithi043.stderr: -427> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.248 INFO:tasks.workunit.client.0.smithi043.stderr: -426> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.248 INFO:tasks.workunit.client.0.smithi043.stderr: -425> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.248 INFO:tasks.workunit.client.0.smithi043.stderr: -424> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:03.248 INFO:tasks.workunit.client.0.smithi043.stderr: -423> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient(hunting): authenticate will time out at 2119.074410s 2024-09-12T00:37:03.248 INFO:tasks.workunit.client.0.smithi043.stderr: -422> 2024-09-12T00:37:03.082+0000 7fad7afee640 10 monclient(hunting): get_auth_request con 0x559c3a512170 auth_method 0 2024-09-12T00:37:03.248 INFO:tasks.workunit.client.0.smithi043.stderr: -421> 2024-09-12T00:37:03.082+0000 7fad7afee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.248 INFO:tasks.workunit.client.0.smithi043.stderr: -420> 2024-09-12T00:37:03.082+0000 7fad7afee640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.248 INFO:tasks.workunit.client.0.smithi043.stderr: -419> 2024-09-12T00:37:03.082+0000 7fad7afee640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.248 INFO:tasks.workunit.client.0.smithi043.stderr: -418> 2024-09-12T00:37:03.082+0000 7fad79fec640 10 monclient(hunting): get_auth_request con 0x559c3a481a80 auth_method 0 2024-09-12T00:37:03.248 INFO:tasks.workunit.client.0.smithi043.stderr: -417> 2024-09-12T00:37:03.082+0000 7fad79fec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.248 INFO:tasks.workunit.client.0.smithi043.stderr: -416> 2024-09-12T00:37:03.082+0000 7fad79fec640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.248 INFO:tasks.workunit.client.0.smithi043.stderr: -415> 2024-09-12T00:37:03.082+0000 7fad79fec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.249 INFO:tasks.workunit.client.0.smithi043.stderr: -414> 2024-09-12T00:37:03.082+0000 7fad7afee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:03.249 INFO:tasks.workunit.client.0.smithi043.stderr: -413> 2024-09-12T00:37:03.082+0000 7fad7afee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:03.249 INFO:tasks.workunit.client.0.smithi043.stderr: -412> 2024-09-12T00:37:03.082+0000 7fad7afee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:03.249 INFO:tasks.workunit.client.0.smithi043.stderr: -411> 2024-09-12T00:37:03.082+0000 7fad79fec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:03.249 INFO:tasks.workunit.client.0.smithi043.stderr: -410> 2024-09-12T00:37:03.082+0000 7fad79fec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:03.249 INFO:tasks.workunit.client.0.smithi043.stderr: -409> 2024-09-12T00:37:03.082+0000 7fad79fec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:03.249 INFO:tasks.workunit.client.0.smithi043.stderr: -408> 2024-09-12T00:37:03.082+0000 7fad7a7ed640 10 monclient(hunting): get_auth_request con 0x559c3a476820 auth_method 0 2024-09-12T00:37:03.249 INFO:tasks.workunit.client.0.smithi043.stderr: -407> 2024-09-12T00:37:03.082+0000 7fad7a7ed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.249 INFO:tasks.workunit.client.0.smithi043.stderr: -406> 2024-09-12T00:37:03.082+0000 7fad7a7ed640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.249 INFO:tasks.workunit.client.0.smithi043.stderr: -405> 2024-09-12T00:37:03.082+0000 7fad7a7ed640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.249 INFO:tasks.workunit.client.0.smithi043.stderr: -404> 2024-09-12T00:37:03.082+0000 7fad7afee640 10 monclient(hunting): handle_auth_done global_id 6552 payload 824 2024-09-12T00:37:03.249 INFO:tasks.workunit.client.0.smithi043.stderr: -403> 2024-09-12T00:37:03.082+0000 7fad7afee640 10 monclient: _finish_hunting 0 2024-09-12T00:37:03.249 INFO:tasks.workunit.client.0.smithi043.stderr: -402> 2024-09-12T00:37:03.082+0000 7fad7afee640 1 monclient: found mon.noname-a 2024-09-12T00:37:03.249 INFO:tasks.workunit.client.0.smithi043.stderr: -401> 2024-09-12T00:37:03.082+0000 7fad7afee640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:37:03.250 INFO:tasks.workunit.client.0.smithi043.stderr: -400> 2024-09-12T00:37:03.082+0000 7fac66e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:03.250 INFO:tasks.workunit.client.0.smithi043.stderr: -399> 2024-09-12T00:37:03.082+0000 7fac66e05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:03.250 INFO:tasks.workunit.client.0.smithi043.stderr: -398> 2024-09-12T00:37:03.082+0000 7fac66e05640 10 monclient: dump: 2024-09-12T00:37:03.250 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:03.250 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:03.250 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.250 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.250 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:03.250 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:03.250 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:03.250 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:03.250 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:03.251 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.251 INFO:tasks.workunit.client.0.smithi043.stderr: -397> 2024-09-12T00:37:03.082+0000 7fac66e05640 10 monclient: _finish_auth 0 2024-09-12T00:37:03.251 INFO:tasks.workunit.client.0.smithi043.stderr: -396> 2024-09-12T00:37:03.082+0000 7fac66e05640 10 monclient: _check_auth_tickets 2024-09-12T00:37:03.251 INFO:tasks.workunit.client.0.smithi043.stderr: -395> 2024-09-12T00:37:03.082+0000 7fac66e05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:03.251 INFO:tasks.workunit.client.0.smithi043.stderr: -394> 2024-09-12T00:37:03.082+0000 7fac66e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:03.251 INFO:tasks.workunit.client.0.smithi043.stderr: -393> 2024-09-12T00:37:03.082+0000 7fac66e05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:03.251 INFO:tasks.workunit.client.0.smithi043.stderr: -392> 2024-09-12T00:37:03.082+0000 7fac66e05640 10 monclient: dump: 2024-09-12T00:37:03.251 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:03.251 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:03.251 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.251 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.252 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:03.252 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:03.252 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:03.252 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:03.252 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:03.252 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.252 INFO:tasks.workunit.client.0.smithi043.stderr: -391> 2024-09-12T00:37:03.082+0000 7fac68608640 4 set_mon_vals no callback set 2024-09-12T00:37:03.252 INFO:tasks.workunit.client.0.smithi043.stderr: -390> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 5 monclient: authenticate success, global_id 6552 2024-09-12T00:37:03.252 INFO:tasks.workunit.client.0.smithi043.stderr: -389> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient: _renew_subs 2024-09-12T00:37:03.252 INFO:tasks.workunit.client.0.smithi043.stderr: -388> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:37:03.252 INFO:tasks.workunit.client.0.smithi043.stderr: -387> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient: _renew_subs 2024-09-12T00:37:03.252 INFO:tasks.workunit.client.0.smithi043.stderr: -386> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:37:03.253 INFO:tasks.workunit.client.0.smithi043.stderr: -385> 2024-09-12T00:37:03.082+0000 7fad7cce79c0 1 librados: init done 2024-09-12T00:37:03.253 INFO:tasks.workunit.client.0.smithi043.stderr: -384> 2024-09-12T00:37:03.086+0000 7fac66e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:03.253 INFO:tasks.workunit.client.0.smithi043.stderr: -383> 2024-09-12T00:37:03.086+0000 7fac66e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:37:03.253 INFO:tasks.workunit.client.0.smithi043.stderr: -382> 2024-09-12T00:37:03.086+0000 7fac66e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:37:03.253 INFO:tasks.workunit.client.0.smithi043.stderr: -381> 2024-09-12T00:37:03.086+0000 7fad7a7ed640 10 monclient: get_auth_request con 0x7fac60070ae0 auth_method 0 2024-09-12T00:37:03.253 INFO:tasks.workunit.client.0.smithi043.stderr: -380> 2024-09-12T00:37:03.086+0000 7fad79fec640 10 monclient: get_auth_request con 0x559c3a608150 auth_method 0 2024-09-12T00:37:03.253 INFO:tasks.workunit.client.0.smithi043.stderr: -379> 2024-09-12T00:37:03.086+0000 7fad7a7ed640 10 monclient: get_auth_request con 0x559c3a611880 auth_method 0 2024-09-12T00:37:03.253 INFO:tasks.workunit.client.0.smithi043.stderr: -378> 2024-09-12T00:37:03.090+0000 7fad79fec640 10 monclient: get_auth_request con 0x559c3a615be0 auth_method 0 2024-09-12T00:37:03.253 INFO:tasks.workunit.client.0.smithi043.stderr: -377> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 10 monclient: build_initial_monmap 2024-09-12T00:37:03.253 INFO:tasks.workunit.client.0.smithi043.stderr: -376> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:03.253 INFO:tasks.workunit.client.0.smithi043.stderr: -375> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 10 monclient: monmap: 2024-09-12T00:37:03.253 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:37:03.253 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:03.253 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:37:03.254 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:37:03.254 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:03.254 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:03.254 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:37:03.254 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:37:03.254 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:37:03.254 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.254 INFO:tasks.workunit.client.0.smithi043.stderr: -374> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a61aa30) adding auth protocol: cephx 2024-09-12T00:37:03.254 INFO:tasks.workunit.client.0.smithi043.stderr: -373> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a61aa30) adding auth protocol: cephx 2024-09-12T00:37:03.254 INFO:tasks.workunit.client.0.smithi043.stderr: -372> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a61aa30) adding auth protocol: cephx 2024-09-12T00:37:03.254 INFO:tasks.workunit.client.0.smithi043.stderr: -371> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a61aa30) adding con mode: secure 2024-09-12T00:37:03.254 INFO:tasks.workunit.client.0.smithi043.stderr: -370> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a61aa30) adding con mode: crc 2024-09-12T00:37:03.254 INFO:tasks.workunit.client.0.smithi043.stderr: -369> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a61aa30) adding con mode: secure 2024-09-12T00:37:03.255 INFO:tasks.workunit.client.0.smithi043.stderr: -368> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a61aa30) adding con mode: crc 2024-09-12T00:37:03.255 INFO:tasks.workunit.client.0.smithi043.stderr: -367> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a61aa30) adding con mode: secure 2024-09-12T00:37:03.255 INFO:tasks.workunit.client.0.smithi043.stderr: -366> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a61aa30) adding con mode: crc 2024-09-12T00:37:03.255 INFO:tasks.workunit.client.0.smithi043.stderr: -365> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a61aa30) adding con mode: crc 2024-09-12T00:37:03.255 INFO:tasks.workunit.client.0.smithi043.stderr: -364> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a61aa30) adding con mode: secure 2024-09-12T00:37:03.255 INFO:tasks.workunit.client.0.smithi043.stderr: -363> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a61aa30) adding con mode: crc 2024-09-12T00:37:03.255 INFO:tasks.workunit.client.0.smithi043.stderr: -362> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a61aa30) adding con mode: secure 2024-09-12T00:37:03.255 INFO:tasks.workunit.client.0.smithi043.stderr: -361> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a61aa30) adding con mode: crc 2024-09-12T00:37:03.255 INFO:tasks.workunit.client.0.smithi043.stderr: -360> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a61aa30) adding con mode: secure 2024-09-12T00:37:03.255 INFO:tasks.workunit.client.0.smithi043.stderr: -359> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.255 INFO:tasks.workunit.client.0.smithi043.stderr: -358> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command objecter_requests cmddesc objecter_requests hook 0x559c3a61e3e0 EEXIST 2024-09-12T00:37:03.256 INFO:tasks.workunit.client.0.smithi043.stderr: -357> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 10 monclient: init 2024-09-12T00:37:03.256 INFO:tasks.workunit.client.0.smithi043.stderr: -356> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6190e8) adding auth protocol: cephx 2024-09-12T00:37:03.256 INFO:tasks.workunit.client.0.smithi043.stderr: -355> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6190e8) adding auth protocol: cephx 2024-09-12T00:37:03.256 INFO:tasks.workunit.client.0.smithi043.stderr: -354> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6190e8) adding auth protocol: cephx 2024-09-12T00:37:03.256 INFO:tasks.workunit.client.0.smithi043.stderr: -353> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6190e8) adding con mode: secure 2024-09-12T00:37:03.256 INFO:tasks.workunit.client.0.smithi043.stderr: -352> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6190e8) adding con mode: crc 2024-09-12T00:37:03.256 INFO:tasks.workunit.client.0.smithi043.stderr: -351> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6190e8) adding con mode: secure 2024-09-12T00:37:03.256 INFO:tasks.workunit.client.0.smithi043.stderr: -350> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6190e8) adding con mode: crc 2024-09-12T00:37:03.256 INFO:tasks.workunit.client.0.smithi043.stderr: -349> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6190e8) adding con mode: secure 2024-09-12T00:37:03.256 INFO:tasks.workunit.client.0.smithi043.stderr: -348> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6190e8) adding con mode: crc 2024-09-12T00:37:03.256 INFO:tasks.workunit.client.0.smithi043.stderr: -347> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6190e8) adding con mode: crc 2024-09-12T00:37:03.256 INFO:tasks.workunit.client.0.smithi043.stderr: -346> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6190e8) adding con mode: secure 2024-09-12T00:37:03.256 INFO:tasks.workunit.client.0.smithi043.stderr: -345> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6190e8) adding con mode: crc 2024-09-12T00:37:03.257 INFO:tasks.workunit.client.0.smithi043.stderr: -344> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6190e8) adding con mode: secure 2024-09-12T00:37:03.257 INFO:tasks.workunit.client.0.smithi043.stderr: -343> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6190e8) adding con mode: crc 2024-09-12T00:37:03.257 INFO:tasks.workunit.client.0.smithi043.stderr: -342> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6190e8) adding con mode: secure 2024-09-12T00:37:03.257 INFO:tasks.workunit.client.0.smithi043.stderr: -341> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.257 INFO:tasks.workunit.client.0.smithi043.stderr: -340> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.257 INFO:tasks.workunit.client.0.smithi043.stderr: -339> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command rotate-key cmddesc rotate-key hook 0x559c3a619230 EEXIST 2024-09-12T00:37:03.257 INFO:tasks.workunit.client.0.smithi043.stderr: -338> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:03.257 INFO:tasks.workunit.client.0.smithi043.stderr: -337> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:37:03.257 INFO:tasks.workunit.client.0.smithi043.stderr: -336> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 10 monclient(hunting): picked mon.noname-c con 0x559c3a642590 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:37:03.257 INFO:tasks.workunit.client.0.smithi043.stderr: -335> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 10 monclient(hunting): picked mon.noname-b con 0x559c3a641ec0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:37:03.257 INFO:tasks.workunit.client.0.smithi043.stderr: -334> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 10 monclient(hunting): picked mon.noname-a con 0x559c3a6408a0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:37:03.257 INFO:tasks.workunit.client.0.smithi043.stderr: -333> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.257 INFO:tasks.workunit.client.0.smithi043.stderr: -332> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.257 INFO:tasks.workunit.client.0.smithi043.stderr: -331> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.258 INFO:tasks.workunit.client.0.smithi043.stderr: -330> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:03.258 INFO:tasks.workunit.client.0.smithi043.stderr: -329> 2024-09-12T00:37:03.090+0000 7fad7cce79c0 10 monclient(hunting): authenticate will time out at 2119.083992s 2024-09-12T00:37:03.258 INFO:tasks.workunit.client.0.smithi043.stderr: -328> 2024-09-12T00:37:03.094+0000 7fad7a7ed640 10 monclient(hunting): get_auth_request con 0x559c3a642590 auth_method 0 2024-09-12T00:37:03.258 INFO:tasks.workunit.client.0.smithi043.stderr: -327> 2024-09-12T00:37:03.094+0000 7fad7a7ed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.258 INFO:tasks.workunit.client.0.smithi043.stderr: -326> 2024-09-12T00:37:03.094+0000 7fad7a7ed640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.258 INFO:tasks.workunit.client.0.smithi043.stderr: -325> 2024-09-12T00:37:03.094+0000 7fad7a7ed640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.258 INFO:tasks.workunit.client.0.smithi043.stderr: -324> 2024-09-12T00:37:03.094+0000 7fad7afee640 10 monclient(hunting): get_auth_request con 0x559c3a6408a0 auth_method 0 2024-09-12T00:37:03.258 INFO:tasks.workunit.client.0.smithi043.stderr: -323> 2024-09-12T00:37:03.094+0000 7fad7afee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.258 INFO:tasks.workunit.client.0.smithi043.stderr: -322> 2024-09-12T00:37:03.094+0000 7fad7afee640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.258 INFO:tasks.workunit.client.0.smithi043.stderr: -321> 2024-09-12T00:37:03.094+0000 7fad7afee640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.258 INFO:tasks.workunit.client.0.smithi043.stderr: -320> 2024-09-12T00:37:03.094+0000 7fad7a7ed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:03.258 INFO:tasks.workunit.client.0.smithi043.stderr: -319> 2024-09-12T00:37:03.094+0000 7fad7a7ed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:03.258 INFO:tasks.workunit.client.0.smithi043.stderr: -318> 2024-09-12T00:37:03.094+0000 7fad7a7ed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:03.259 INFO:tasks.workunit.client.0.smithi043.stderr: -317> 2024-09-12T00:37:03.094+0000 7fad7afee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:03.259 INFO:tasks.workunit.client.0.smithi043.stderr: -316> 2024-09-12T00:37:03.094+0000 7fad7afee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:03.259 INFO:tasks.workunit.client.0.smithi043.stderr: -315> 2024-09-12T00:37:03.094+0000 7fad7afee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:03.259 INFO:tasks.workunit.client.0.smithi043.stderr: -314> 2024-09-12T00:37:03.094+0000 7fad79fec640 10 monclient(hunting): get_auth_request con 0x559c3a641ec0 auth_method 0 2024-09-12T00:37:03.259 INFO:tasks.workunit.client.0.smithi043.stderr: -313> 2024-09-12T00:37:03.094+0000 7fad79fec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.259 INFO:tasks.workunit.client.0.smithi043.stderr: -312> 2024-09-12T00:37:03.094+0000 7fad79fec640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.259 INFO:tasks.workunit.client.0.smithi043.stderr: -311> 2024-09-12T00:37:03.094+0000 7fad79fec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.259 INFO:tasks.workunit.client.0.smithi043.stderr: -310> 2024-09-12T00:37:03.094+0000 7fad7a7ed640 10 monclient(hunting): handle_auth_done global_id 6284 payload 824 2024-09-12T00:37:03.259 INFO:tasks.workunit.client.0.smithi043.stderr: -309> 2024-09-12T00:37:03.094+0000 7fad7a7ed640 10 monclient: _finish_hunting 0 2024-09-12T00:37:03.259 INFO:tasks.workunit.client.0.smithi043.stderr: -308> 2024-09-12T00:37:03.094+0000 7fad7a7ed640 1 monclient: found mon.noname-c 2024-09-12T00:37:03.259 INFO:tasks.workunit.client.0.smithi043.stderr: -307> 2024-09-12T00:37:03.094+0000 7fad7a7ed640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:37:03.259 INFO:tasks.workunit.client.0.smithi043.stderr: -306> 2024-09-12T00:37:03.094+0000 7fac5ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:03.259 INFO:tasks.workunit.client.0.smithi043.stderr: -305> 2024-09-12T00:37:03.094+0000 7fac5ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:37:03.259 INFO:tasks.workunit.client.0.smithi043.stderr: -304> 2024-09-12T00:37:03.094+0000 7fac5ffff640 10 monclient: dump: 2024-09-12T00:37:03.260 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:03.260 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:03.260 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.260 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.260 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:03.260 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:03.260 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:03.260 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:03.260 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:03.260 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.260 INFO:tasks.workunit.client.0.smithi043.stderr: -303> 2024-09-12T00:37:03.094+0000 7fac5ffff640 10 monclient: _finish_auth 0 2024-09-12T00:37:03.260 INFO:tasks.workunit.client.0.smithi043.stderr: -302> 2024-09-12T00:37:03.094+0000 7fac5ffff640 10 monclient: _check_auth_tickets 2024-09-12T00:37:03.260 INFO:tasks.workunit.client.0.smithi043.stderr: -301> 2024-09-12T00:37:03.094+0000 7fac5ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:03.261 INFO:tasks.workunit.client.0.smithi043.stderr: -300> 2024-09-12T00:37:03.094+0000 7fac5ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:03.261 INFO:tasks.workunit.client.0.smithi043.stderr: -299> 2024-09-12T00:37:03.094+0000 7fac5ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:37:03.261 INFO:tasks.workunit.client.0.smithi043.stderr: -298> 2024-09-12T00:37:03.094+0000 7fac5ffff640 10 monclient: dump: 2024-09-12T00:37:03.261 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:03.261 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:03.261 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.261 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.261 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:03.261 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:03.261 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:03.261 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:03.261 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:03.261 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.262 INFO:tasks.workunit.client.0.smithi043.stderr: -297> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 monclient: authenticate success, global_id 6284 2024-09-12T00:37:03.262 INFO:tasks.workunit.client.0.smithi043.stderr: -296> 2024-09-12T00:37:03.094+0000 7fad7b7ef640 4 set_mon_vals no callback set 2024-09-12T00:37:03.262 INFO:tasks.workunit.client.0.smithi043.stderr: -295> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 10 monclient: _renew_subs 2024-09-12T00:37:03.262 INFO:tasks.workunit.client.0.smithi043.stderr: -294> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:37:03.262 INFO:tasks.workunit.client.0.smithi043.stderr: -293> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 10 monclient: _renew_subs 2024-09-12T00:37:03.262 INFO:tasks.workunit.client.0.smithi043.stderr: -292> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:37:03.262 INFO:tasks.workunit.client.0.smithi043.stderr: -291> 2024-09-12T00:37:03.094+0000 7fac5ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:03.262 INFO:tasks.workunit.client.0.smithi043.stderr: -290> 2024-09-12T00:37:03.094+0000 7fac5ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:37:03.262 INFO:tasks.workunit.client.0.smithi043.stderr: -289> 2024-09-12T00:37:03.094+0000 7fac5ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:37:03.262 INFO:tasks.workunit.client.0.smithi043.stderr: -288> 2024-09-12T00:37:03.094+0000 7fad79fec640 10 monclient: get_auth_request con 0x7fac54070a20 auth_method 0 2024-09-12T00:37:03.262 INFO:tasks.workunit.client.0.smithi043.stderr: -287> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 10 monclient: get_monmap_and_config 2024-09-12T00:37:03.262 INFO:tasks.workunit.client.0.smithi043.stderr: -286> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 10 monclient: build_initial_monmap 2024-09-12T00:37:03.262 INFO:tasks.workunit.client.0.smithi043.stderr: -285> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:03.262 INFO:tasks.workunit.client.0.smithi043.stderr: -284> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 10 monclient: monmap: 2024-09-12T00:37:03.263 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:37:03.263 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:03.263 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:37:03.263 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:37:03.263 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:03.263 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:03.263 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:37:03.263 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:37:03.263 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:37:03.263 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.263 INFO:tasks.workunit.client.0.smithi043.stderr: -283> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661c00) adding auth protocol: cephx 2024-09-12T00:37:03.263 INFO:tasks.workunit.client.0.smithi043.stderr: -282> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661c00) adding auth protocol: cephx 2024-09-12T00:37:03.263 INFO:tasks.workunit.client.0.smithi043.stderr: -281> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661c00) adding auth protocol: cephx 2024-09-12T00:37:03.263 INFO:tasks.workunit.client.0.smithi043.stderr: -280> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661c00) adding con mode: secure 2024-09-12T00:37:03.264 INFO:tasks.workunit.client.0.smithi043.stderr: -279> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661c00) adding con mode: crc 2024-09-12T00:37:03.264 INFO:tasks.workunit.client.0.smithi043.stderr: -278> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661c00) adding con mode: secure 2024-09-12T00:37:03.264 INFO:tasks.workunit.client.0.smithi043.stderr: -277> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661c00) adding con mode: crc 2024-09-12T00:37:03.264 INFO:tasks.workunit.client.0.smithi043.stderr: -276> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661c00) adding con mode: secure 2024-09-12T00:37:03.264 INFO:tasks.workunit.client.0.smithi043.stderr: -275> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661c00) adding con mode: crc 2024-09-12T00:37:03.264 INFO:tasks.workunit.client.0.smithi043.stderr: -274> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661c00) adding con mode: crc 2024-09-12T00:37:03.264 INFO:tasks.workunit.client.0.smithi043.stderr: -273> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661c00) adding con mode: secure 2024-09-12T00:37:03.264 INFO:tasks.workunit.client.0.smithi043.stderr: -272> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661c00) adding con mode: crc 2024-09-12T00:37:03.264 INFO:tasks.workunit.client.0.smithi043.stderr: -271> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661c00) adding con mode: secure 2024-09-12T00:37:03.264 INFO:tasks.workunit.client.0.smithi043.stderr: -270> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661c00) adding con mode: crc 2024-09-12T00:37:03.264 INFO:tasks.workunit.client.0.smithi043.stderr: -269> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661c00) adding con mode: secure 2024-09-12T00:37:03.264 INFO:tasks.workunit.client.0.smithi043.stderr: -268> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.264 INFO:tasks.workunit.client.0.smithi043.stderr: -267> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 10 monclient: init 2024-09-12T00:37:03.265 INFO:tasks.workunit.client.0.smithi043.stderr: -266> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefe780) adding auth protocol: cephx 2024-09-12T00:37:03.265 INFO:tasks.workunit.client.0.smithi043.stderr: -265> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefe780) adding auth protocol: cephx 2024-09-12T00:37:03.265 INFO:tasks.workunit.client.0.smithi043.stderr: -264> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefe780) adding auth protocol: cephx 2024-09-12T00:37:03.265 INFO:tasks.workunit.client.0.smithi043.stderr: -263> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefe780) adding con mode: secure 2024-09-12T00:37:03.265 INFO:tasks.workunit.client.0.smithi043.stderr: -262> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefe780) adding con mode: crc 2024-09-12T00:37:03.265 INFO:tasks.workunit.client.0.smithi043.stderr: -261> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefe780) adding con mode: secure 2024-09-12T00:37:03.265 INFO:tasks.workunit.client.0.smithi043.stderr: -260> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefe780) adding con mode: crc 2024-09-12T00:37:03.265 INFO:tasks.workunit.client.0.smithi043.stderr: -259> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefe780) adding con mode: secure 2024-09-12T00:37:03.265 INFO:tasks.workunit.client.0.smithi043.stderr: -258> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefe780) adding con mode: crc 2024-09-12T00:37:03.265 INFO:tasks.workunit.client.0.smithi043.stderr: -257> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefe780) adding con mode: crc 2024-09-12T00:37:03.265 INFO:tasks.workunit.client.0.smithi043.stderr: -256> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefe780) adding con mode: secure 2024-09-12T00:37:03.265 INFO:tasks.workunit.client.0.smithi043.stderr: -255> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefe780) adding con mode: crc 2024-09-12T00:37:03.265 INFO:tasks.workunit.client.0.smithi043.stderr: -254> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefe780) adding con mode: secure 2024-09-12T00:37:03.266 INFO:tasks.workunit.client.0.smithi043.stderr: -253> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefe780) adding con mode: crc 2024-09-12T00:37:03.266 INFO:tasks.workunit.client.0.smithi043.stderr: -252> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefe780) adding con mode: secure 2024-09-12T00:37:03.266 INFO:tasks.workunit.client.0.smithi043.stderr: -251> 2024-09-12T00:37:03.094+0000 7fad7cce79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.266 INFO:tasks.workunit.client.0.smithi043.stderr: -250> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.266 INFO:tasks.workunit.client.0.smithi043.stderr: -249> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd0fefe8c8 EEXIST 2024-09-12T00:37:03.266 INFO:tasks.workunit.client.0.smithi043.stderr: -248> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:03.266 INFO:tasks.workunit.client.0.smithi043.stderr: -247> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:37:03.266 INFO:tasks.workunit.client.0.smithi043.stderr: -246> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): picked mon.noname-b con 0x559c3a6901d0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:37:03.266 INFO:tasks.workunit.client.0.smithi043.stderr: -245> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): picked mon.noname-c con 0x559c3a6905b0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:37:03.266 INFO:tasks.workunit.client.0.smithi043.stderr: -244> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): picked mon.noname-a con 0x559c3a691a70 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:37:03.266 INFO:tasks.workunit.client.0.smithi043.stderr: -243> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.266 INFO:tasks.workunit.client.0.smithi043.stderr: -242> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.266 INFO:tasks.workunit.client.0.smithi043.stderr: -241> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.266 INFO:tasks.workunit.client.0.smithi043.stderr: -240> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:03.267 INFO:tasks.workunit.client.0.smithi043.stderr: -239> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): authenticate will time out at 2119.088252s 2024-09-12T00:37:03.267 INFO:tasks.workunit.client.0.smithi043.stderr: -238> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): get_auth_request con 0x559c3a691a70 auth_method 0 2024-09-12T00:37:03.267 INFO:tasks.workunit.client.0.smithi043.stderr: -237> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.267 INFO:tasks.workunit.client.0.smithi043.stderr: -236> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.267 INFO:tasks.workunit.client.0.smithi043.stderr: -235> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.267 INFO:tasks.workunit.client.0.smithi043.stderr: -234> 2024-09-12T00:37:03.098+0000 7fad79fec640 10 monclient(hunting): get_auth_request con 0x559c3a6905b0 auth_method 0 2024-09-12T00:37:03.267 INFO:tasks.workunit.client.0.smithi043.stderr: -233> 2024-09-12T00:37:03.098+0000 7fad79fec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.267 INFO:tasks.workunit.client.0.smithi043.stderr: -232> 2024-09-12T00:37:03.098+0000 7fad79fec640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.267 INFO:tasks.workunit.client.0.smithi043.stderr: -231> 2024-09-12T00:37:03.098+0000 7fad79fec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.267 INFO:tasks.workunit.client.0.smithi043.stderr: -230> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:03.267 INFO:tasks.workunit.client.0.smithi043.stderr: -229> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:03.267 INFO:tasks.workunit.client.0.smithi043.stderr: -228> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:03.267 INFO:tasks.workunit.client.0.smithi043.stderr: -227> 2024-09-12T00:37:03.098+0000 7fad79fec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:03.267 INFO:tasks.workunit.client.0.smithi043.stderr: -226> 2024-09-12T00:37:03.098+0000 7fad79fec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:03.268 INFO:tasks.workunit.client.0.smithi043.stderr: -225> 2024-09-12T00:37:03.098+0000 7fad79fec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:03.268 INFO:tasks.workunit.client.0.smithi043.stderr: -224> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): handle_auth_done global_id 6558 payload 274 2024-09-12T00:37:03.268 INFO:tasks.workunit.client.0.smithi043.stderr: -223> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient: _finish_hunting 0 2024-09-12T00:37:03.268 INFO:tasks.workunit.client.0.smithi043.stderr: -222> 2024-09-12T00:37:03.098+0000 7fad7afee640 1 monclient: found mon.noname-a 2024-09-12T00:37:03.268 INFO:tasks.workunit.client.0.smithi043.stderr: -221> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:37:03.268 INFO:tasks.workunit.client.0.smithi043.stderr: -220> 2024-09-12T00:37:03.098+0000 7fad7a7ed640 10 monclient: get_auth_request con 0x559c3a6901d0 auth_method 0 2024-09-12T00:37:03.268 INFO:tasks.workunit.client.0.smithi043.stderr: -219> 2024-09-12T00:37:03.098+0000 7fac5dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:03.268 INFO:tasks.workunit.client.0.smithi043.stderr: -218> 2024-09-12T00:37:03.098+0000 7fac5dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:03.268 INFO:tasks.workunit.client.0.smithi043.stderr: -217> 2024-09-12T00:37:03.098+0000 7fac5dffb640 10 monclient: dump: 2024-09-12T00:37:03.268 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:03.268 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:03.268 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.268 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.269 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:03.269 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:03.269 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:03.269 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:03.269 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:03.269 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.269 INFO:tasks.workunit.client.0.smithi043.stderr: -216> 2024-09-12T00:37:03.098+0000 7fac5dffb640 10 monclient: _finish_auth 0 2024-09-12T00:37:03.269 INFO:tasks.workunit.client.0.smithi043.stderr: -215> 2024-09-12T00:37:03.098+0000 7fac5dffb640 10 monclient: _check_auth_tickets 2024-09-12T00:37:03.269 INFO:tasks.workunit.client.0.smithi043.stderr: -214> 2024-09-12T00:37:03.098+0000 7fac5dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:03.269 INFO:tasks.workunit.client.0.smithi043.stderr: -213> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 monclient: authenticate success, global_id 6558 2024-09-12T00:37:03.269 INFO:tasks.workunit.client.0.smithi043.stderr: -212> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient: get_monmap_and_config success 2024-09-12T00:37:03.269 INFO:tasks.workunit.client.0.smithi043.stderr: -211> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 4 set_mon_vals no callback set 2024-09-12T00:37:03.269 INFO:tasks.workunit.client.0.smithi043.stderr: -210> 2024-09-12T00:37:03.098+0000 7fac5dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:03.270 INFO:tasks.workunit.client.0.smithi043.stderr: -209> 2024-09-12T00:37:03.098+0000 7fac5dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:03.270 INFO:tasks.workunit.client.0.smithi043.stderr: -208> 2024-09-12T00:37:03.098+0000 7fac5dffb640 10 monclient: dump: 2024-09-12T00:37:03.270 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:03.270 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:03.270 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.270 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.270 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:03.270 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:03.270 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:03.270 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:03.270 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:03.270 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.270 INFO:tasks.workunit.client.0.smithi043.stderr: -207> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient: shutdown 2024-09-12T00:37:03.270 INFO:tasks.workunit.client.0.smithi043.stderr: -206> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient: build_initial_monmap 2024-09-12T00:37:03.271 INFO:tasks.workunit.client.0.smithi043.stderr: -205> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:03.271 INFO:tasks.workunit.client.0.smithi043.stderr: -204> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient: monmap: 2024-09-12T00:37:03.271 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:37:03.271 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:03.271 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:37:03.271 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:37:03.271 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:03.271 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:03.271 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:37:03.271 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:37:03.271 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:37:03.271 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.272 INFO:tasks.workunit.client.0.smithi043.stderr: -203> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661bb0) adding auth protocol: cephx 2024-09-12T00:37:03.272 INFO:tasks.workunit.client.0.smithi043.stderr: -202> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661bb0) adding auth protocol: cephx 2024-09-12T00:37:03.272 INFO:tasks.workunit.client.0.smithi043.stderr: -201> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661bb0) adding auth protocol: cephx 2024-09-12T00:37:03.272 INFO:tasks.workunit.client.0.smithi043.stderr: -200> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661bb0) adding con mode: secure 2024-09-12T00:37:03.272 INFO:tasks.workunit.client.0.smithi043.stderr: -199> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661bb0) adding con mode: crc 2024-09-12T00:37:03.272 INFO:tasks.workunit.client.0.smithi043.stderr: -198> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661bb0) adding con mode: secure 2024-09-12T00:37:03.272 INFO:tasks.workunit.client.0.smithi043.stderr: -197> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661bb0) adding con mode: crc 2024-09-12T00:37:03.272 INFO:tasks.workunit.client.0.smithi043.stderr: -196> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661bb0) adding con mode: secure 2024-09-12T00:37:03.272 INFO:tasks.workunit.client.0.smithi043.stderr: -195> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661bb0) adding con mode: crc 2024-09-12T00:37:03.272 INFO:tasks.workunit.client.0.smithi043.stderr: -194> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661bb0) adding con mode: crc 2024-09-12T00:37:03.272 INFO:tasks.workunit.client.0.smithi043.stderr: -193> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661bb0) adding con mode: secure 2024-09-12T00:37:03.272 INFO:tasks.workunit.client.0.smithi043.stderr: -192> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661bb0) adding con mode: crc 2024-09-12T00:37:03.272 INFO:tasks.workunit.client.0.smithi043.stderr: -191> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661bb0) adding con mode: secure 2024-09-12T00:37:03.273 INFO:tasks.workunit.client.0.smithi043.stderr: -190> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661bb0) adding con mode: crc 2024-09-12T00:37:03.273 INFO:tasks.workunit.client.0.smithi043.stderr: -189> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a661bb0) adding con mode: secure 2024-09-12T00:37:03.273 INFO:tasks.workunit.client.0.smithi043.stderr: -188> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.273 INFO:tasks.workunit.client.0.smithi043.stderr: -187> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 1 librados: starting msgr at 2024-09-12T00:37:03.273 INFO:tasks.workunit.client.0.smithi043.stderr: -186> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 1 librados: starting objecter 2024-09-12T00:37:03.273 INFO:tasks.workunit.client.0.smithi043.stderr: -185> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command objecter_requests cmddesc objecter_requests hook 0x559c3a667dd0 EEXIST 2024-09-12T00:37:03.273 INFO:tasks.workunit.client.0.smithi043.stderr: -184> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 1 librados: setting wanted keys 2024-09-12T00:37:03.273 INFO:tasks.workunit.client.0.smithi043.stderr: -183> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 1 librados: calling monclient init 2024-09-12T00:37:03.273 INFO:tasks.workunit.client.0.smithi043.stderr: -182> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient: init 2024-09-12T00:37:03.273 INFO:tasks.workunit.client.0.smithi043.stderr: -181> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6443b0) adding auth protocol: cephx 2024-09-12T00:37:03.273 INFO:tasks.workunit.client.0.smithi043.stderr: -180> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6443b0) adding auth protocol: cephx 2024-09-12T00:37:03.273 INFO:tasks.workunit.client.0.smithi043.stderr: -179> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6443b0) adding auth protocol: cephx 2024-09-12T00:37:03.273 INFO:tasks.workunit.client.0.smithi043.stderr: -178> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6443b0) adding con mode: secure 2024-09-12T00:37:03.274 INFO:tasks.workunit.client.0.smithi043.stderr: -177> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6443b0) adding con mode: crc 2024-09-12T00:37:03.274 INFO:tasks.workunit.client.0.smithi043.stderr: -176> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6443b0) adding con mode: secure 2024-09-12T00:37:03.274 INFO:tasks.workunit.client.0.smithi043.stderr: -175> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6443b0) adding con mode: crc 2024-09-12T00:37:03.274 INFO:tasks.workunit.client.0.smithi043.stderr: -174> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6443b0) adding con mode: secure 2024-09-12T00:37:03.274 INFO:tasks.workunit.client.0.smithi043.stderr: -173> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6443b0) adding con mode: crc 2024-09-12T00:37:03.274 INFO:tasks.workunit.client.0.smithi043.stderr: -172> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6443b0) adding con mode: crc 2024-09-12T00:37:03.274 INFO:tasks.workunit.client.0.smithi043.stderr: -171> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6443b0) adding con mode: secure 2024-09-12T00:37:03.274 INFO:tasks.workunit.client.0.smithi043.stderr: -170> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6443b0) adding con mode: crc 2024-09-12T00:37:03.274 INFO:tasks.workunit.client.0.smithi043.stderr: -169> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6443b0) adding con mode: secure 2024-09-12T00:37:03.274 INFO:tasks.workunit.client.0.smithi043.stderr: -168> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6443b0) adding con mode: crc 2024-09-12T00:37:03.274 INFO:tasks.workunit.client.0.smithi043.stderr: -167> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 AuthRegistry(0x559c3a6443b0) adding con mode: secure 2024-09-12T00:37:03.274 INFO:tasks.workunit.client.0.smithi043.stderr: -166> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.274 INFO:tasks.workunit.client.0.smithi043.stderr: -165> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.274 INFO:tasks.workunit.client.0.smithi043.stderr: -164> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command rotate-key cmddesc rotate-key hook 0x559c3a6444f8 EEXIST 2024-09-12T00:37:03.275 INFO:tasks.workunit.client.0.smithi043.stderr: -163> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:03.275 INFO:tasks.workunit.client.0.smithi043.stderr: -162> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:37:03.275 INFO:tasks.workunit.client.0.smithi043.stderr: -161> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): picked mon.noname-a con 0x559c3a6901d0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:37:03.275 INFO:tasks.workunit.client.0.smithi043.stderr: -160> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): picked mon.noname-b con 0x559c3a691a70 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:37:03.275 INFO:tasks.workunit.client.0.smithi043.stderr: -159> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): picked mon.noname-c con 0x559c3a685580 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:37:03.275 INFO:tasks.workunit.client.0.smithi043.stderr: -158> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.275 INFO:tasks.workunit.client.0.smithi043.stderr: -157> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.275 INFO:tasks.workunit.client.0.smithi043.stderr: -156> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.275 INFO:tasks.workunit.client.0.smithi043.stderr: -155> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:03.275 INFO:tasks.workunit.client.0.smithi043.stderr: -154> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient(hunting): authenticate will time out at 2119.090888s 2024-09-12T00:37:03.275 INFO:tasks.workunit.client.0.smithi043.stderr: -153> 2024-09-12T00:37:03.098+0000 7fad7a7ed640 10 monclient(hunting): get_auth_request con 0x559c3a6901d0 auth_method 0 2024-09-12T00:37:03.275 INFO:tasks.workunit.client.0.smithi043.stderr: -152> 2024-09-12T00:37:03.098+0000 7fad7a7ed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.275 INFO:tasks.workunit.client.0.smithi043.stderr: -151> 2024-09-12T00:37:03.098+0000 7fad7a7ed640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.276 INFO:tasks.workunit.client.0.smithi043.stderr: -150> 2024-09-12T00:37:03.098+0000 7fad7a7ed640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.276 INFO:tasks.workunit.client.0.smithi043.stderr: -149> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): get_auth_request con 0x559c3a685580 auth_method 0 2024-09-12T00:37:03.276 INFO:tasks.workunit.client.0.smithi043.stderr: -148> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.276 INFO:tasks.workunit.client.0.smithi043.stderr: -147> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.276 INFO:tasks.workunit.client.0.smithi043.stderr: -146> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.276 INFO:tasks.workunit.client.0.smithi043.stderr: -145> 2024-09-12T00:37:03.098+0000 7fad7a7ed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:03.276 INFO:tasks.workunit.client.0.smithi043.stderr: -144> 2024-09-12T00:37:03.098+0000 7fad7a7ed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:03.276 INFO:tasks.workunit.client.0.smithi043.stderr: -143> 2024-09-12T00:37:03.098+0000 7fad7a7ed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:03.276 INFO:tasks.workunit.client.0.smithi043.stderr: -142> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:03.276 INFO:tasks.workunit.client.0.smithi043.stderr: -141> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:03.276 INFO:tasks.workunit.client.0.smithi043.stderr: -140> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:03.276 INFO:tasks.workunit.client.0.smithi043.stderr: -139> 2024-09-12T00:37:03.098+0000 7fad79fec640 10 monclient(hunting): get_auth_request con 0x559c3a691a70 auth_method 0 2024-09-12T00:37:03.276 INFO:tasks.workunit.client.0.smithi043.stderr: -138> 2024-09-12T00:37:03.098+0000 7fad79fec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.277 INFO:tasks.workunit.client.0.smithi043.stderr: -137> 2024-09-12T00:37:03.098+0000 7fad79fec640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.277 INFO:tasks.workunit.client.0.smithi043.stderr: -136> 2024-09-12T00:37:03.098+0000 7fad79fec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.277 INFO:tasks.workunit.client.0.smithi043.stderr: -135> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient(hunting): handle_auth_done global_id 6290 payload 824 2024-09-12T00:37:03.277 INFO:tasks.workunit.client.0.smithi043.stderr: -134> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient: _finish_hunting 0 2024-09-12T00:37:03.277 INFO:tasks.workunit.client.0.smithi043.stderr: -133> 2024-09-12T00:37:03.098+0000 7fad7afee640 1 monclient: found mon.noname-c 2024-09-12T00:37:03.277 INFO:tasks.workunit.client.0.smithi043.stderr: -132> 2024-09-12T00:37:03.098+0000 7fad7afee640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:37:03.277 INFO:tasks.workunit.client.0.smithi043.stderr: -131> 2024-09-12T00:37:03.098+0000 7fac4bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:03.277 INFO:tasks.workunit.client.0.smithi043.stderr: -130> 2024-09-12T00:37:03.098+0000 7fac4bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:37:03.277 INFO:tasks.workunit.client.0.smithi043.stderr: -129> 2024-09-12T00:37:03.098+0000 7fac4bfff640 10 monclient: dump: 2024-09-12T00:37:03.277 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:03.277 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:03.277 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.277 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.277 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:03.278 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:03.278 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:03.278 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:03.278 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:03.278 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.278 INFO:tasks.workunit.client.0.smithi043.stderr: -128> 2024-09-12T00:37:03.098+0000 7fac4bfff640 10 monclient: _finish_auth 0 2024-09-12T00:37:03.278 INFO:tasks.workunit.client.0.smithi043.stderr: -127> 2024-09-12T00:37:03.098+0000 7fac4bfff640 10 monclient: _check_auth_tickets 2024-09-12T00:37:03.278 INFO:tasks.workunit.client.0.smithi043.stderr: -126> 2024-09-12T00:37:03.098+0000 7fac4bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:03.278 INFO:tasks.workunit.client.0.smithi043.stderr: -125> 2024-09-12T00:37:03.098+0000 7fac4bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:03.278 INFO:tasks.workunit.client.0.smithi043.stderr: -124> 2024-09-12T00:37:03.098+0000 7fac4bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:37:03.278 INFO:tasks.workunit.client.0.smithi043.stderr: -123> 2024-09-12T00:37:03.098+0000 7fac4bfff640 10 monclient: dump: 2024-09-12T00:37:03.278 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:03.278 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:03.278 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.279 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:03.279 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:03.279 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:03.279 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:03.279 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:03.279 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:03.279 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.279 INFO:tasks.workunit.client.0.smithi043.stderr: -122> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 monclient: authenticate success, global_id 6290 2024-09-12T00:37:03.279 INFO:tasks.workunit.client.0.smithi043.stderr: -121> 2024-09-12T00:37:03.098+0000 7fac5dffb640 4 set_mon_vals no callback set 2024-09-12T00:37:03.279 INFO:tasks.workunit.client.0.smithi043.stderr: -120> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient: _renew_subs 2024-09-12T00:37:03.279 INFO:tasks.workunit.client.0.smithi043.stderr: -119> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:37:03.279 INFO:tasks.workunit.client.0.smithi043.stderr: -118> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient: _renew_subs 2024-09-12T00:37:03.279 INFO:tasks.workunit.client.0.smithi043.stderr: -117> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:37:03.280 INFO:tasks.workunit.client.0.smithi043.stderr: -116> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 1 librados: init done 2024-09-12T00:37:03.280 INFO:tasks.workunit.client.0.smithi043.stderr: -115> 2024-09-12T00:37:03.098+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command cr dump hook 0x559c3a666268 2024-09-12T00:37:03.280 INFO:tasks.workunit.client.0.smithi043.stderr: -114> 2024-09-12T00:37:03.102+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.280 INFO:tasks.workunit.client.0.smithi043.stderr: -113> 2024-09-12T00:37:03.102+0000 7fac4bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:03.280 INFO:tasks.workunit.client.0.smithi043.stderr: -112> 2024-09-12T00:37:03.102+0000 7fac4bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:37:03.280 INFO:tasks.workunit.client.0.smithi043.stderr: -111> 2024-09-12T00:37:03.102+0000 7fac4bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:37:03.280 INFO:tasks.workunit.client.0.smithi043.stderr: -110> 2024-09-12T00:37:03.102+0000 7fad7a7ed640 10 monclient: get_auth_request con 0x7fac44070ad0 auth_method 0 2024-09-12T00:37:03.280 INFO:tasks.workunit.client.0.smithi043.stderr: -109> 2024-09-12T00:37:03.102+0000 7fad79fec640 10 monclient: get_auth_request con 0x559c3a6af940 auth_method 0 2024-09-12T00:37:03.280 INFO:tasks.workunit.client.0.smithi043.stderr: -108> 2024-09-12T00:37:03.102+0000 7fad7cce79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.280 INFO:tasks.workunit.client.0.smithi043.stderr: -107> 2024-09-12T00:37:03.102+0000 7fad7cce79c0 20 realm 2024-09-12T00:37:03.280 INFO:tasks.workunit.client.0.smithi043.stderr: -106> 2024-09-12T00:37:03.102+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.280 INFO:tasks.workunit.client.0.smithi043.stderr: -105> 2024-09-12T00:37:03.102+0000 7fad7cce79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.280 INFO:tasks.workunit.client.0.smithi043.stderr: -104> 2024-09-12T00:37:03.102+0000 7fad7cce79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:03.280 INFO:tasks.workunit.client.0.smithi043.stderr: -103> 2024-09-12T00:37:03.102+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.281 INFO:tasks.workunit.client.0.smithi043.stderr: -102> 2024-09-12T00:37:03.102+0000 7fad7cce79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.281 INFO:tasks.workunit.client.0.smithi043.stderr: -101> 2024-09-12T00:37:03.102+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.281 INFO:tasks.workunit.client.0.smithi043.stderr: -100> 2024-09-12T00:37:03.102+0000 7fad7a7ed640 10 monclient: get_auth_request con 0x559c3a6b3b50 auth_method 0 2024-09-12T00:37:03.281 INFO:tasks.workunit.client.0.smithi043.stderr: -99> 2024-09-12T00:37:03.106+0000 7fad7cce79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:03.281 INFO:tasks.workunit.client.0.smithi043.stderr: -98> 2024-09-12T00:37:03.106+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.281 INFO:tasks.workunit.client.0.smithi043.stderr: -97> 2024-09-12T00:37:03.106+0000 7fad79fec640 10 monclient: get_auth_request con 0x559c3a6b73b0 auth_method 0 2024-09-12T00:37:03.281 INFO:tasks.workunit.client.0.smithi043.stderr: -96> 2024-09-12T00:37:03.106+0000 7fad7cce79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:03.281 INFO:tasks.workunit.client.0.smithi043.stderr: -95> 2024-09-12T00:37:03.106+0000 7fad7cce79c0 20 searching for the correct realm 2024-09-12T00:37:03.281 INFO:tasks.workunit.client.0.smithi043.stderr: -94> 2024-09-12T00:37:03.106+0000 7fad7afee640 10 monclient: get_auth_request con 0x559c3a6bc0b0 auth_method 0 2024-09-12T00:37:03.281 INFO:tasks.workunit.client.0.smithi043.stderr: -93> 2024-09-12T00:37:03.106+0000 7fad7a7ed640 10 monclient: get_auth_request con 0x7fad740ab900 auth_method 0 2024-09-12T00:37:03.281 INFO:tasks.workunit.client.0.smithi043.stderr: -92> 2024-09-12T00:37:03.110+0000 7fad79fec640 10 monclient: get_auth_request con 0x7fad70028040 auth_method 0 2024-09-12T00:37:03.281 INFO:tasks.workunit.client.0.smithi043.stderr: -91> 2024-09-12T00:37:03.110+0000 7fad79fec640 0 -- 172.21.15.43:0/1311472971 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x559c3a6af940 msgr2=0x559c3a6b1dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:03.281 INFO:tasks.workunit.client.0.smithi043.stderr: -90> 2024-09-12T00:37:03.114+0000 7fac4bfff640 1 client.6290.objecter ms_handle_reset 0x559c3a6af940 session 0x559c3a6af2c0 osd.1 2024-09-12T00:37:03.282 INFO:tasks.workunit.client.0.smithi043.stderr: -89> 2024-09-12T00:37:03.114+0000 7fac4bfff640 10 monclient: _renew_subs 2024-09-12T00:37:03.282 INFO:tasks.workunit.client.0.smithi043.stderr: -88> 2024-09-12T00:37:03.114+0000 7fac4bfff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:37:03.282 INFO:tasks.workunit.client.0.smithi043.stderr: -87> 2024-09-12T00:37:03.114+0000 7fad79fec640 10 monclient: get_auth_request con 0x7fac44080b70 auth_method 0 2024-09-12T00:37:03.282 INFO:tasks.workunit.client.0.smithi043.stderr: -86> 2024-09-12T00:37:03.114+0000 7fad7afee640 10 monclient: get_auth_request con 0x7fad70008040 auth_method 0 2024-09-12T00:37:03.282 INFO:tasks.workunit.client.0.smithi043.stderr: -85> 2024-09-12T00:37:03.118+0000 7fad7a7ed640 10 monclient: get_auth_request con 0x7fad70061940 auth_method 0 2024-09-12T00:37:03.282 INFO:tasks.workunit.client.0.smithi043.stderr: -84> 2024-09-12T00:37:03.118+0000 7fad7a7ed640 0 -- 172.21.15.43:0/1311472971 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fad70061940 msgr2=0x7fad70034410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:03.282 INFO:tasks.workunit.client.0.smithi043.stderr: -83> 2024-09-12T00:37:03.118+0000 7fac4bfff640 1 client.6290.objecter ms_handle_reset 0x7fad70061940 session 0x7fad70008e60 osd.0 2024-09-12T00:37:03.282 INFO:tasks.workunit.client.0.smithi043.stderr: -82> 2024-09-12T00:37:03.118+0000 7fad7a7ed640 10 monclient: get_auth_request con 0x559c3a6af940 auth_method 0 2024-09-12T00:37:03.282 INFO:tasks.workunit.client.0.smithi043.stderr: -81> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:37:03.282 INFO:tasks.workunit.client.0.smithi043.stderr: -80> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:03.282 INFO:tasks.workunit.client.0.smithi043.stderr: -79> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:03.282 INFO:tasks.workunit.client.0.smithi043.stderr: -78> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:37:03.282 INFO:tasks.workunit.client.0.smithi043.stderr: -77> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:03.283 INFO:tasks.workunit.client.0.smithi043.stderr: -76> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:03.283 INFO:tasks.workunit.client.0.smithi043.stderr: -75> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.283 INFO:tasks.workunit.client.0.smithi043.stderr: -74> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.283 INFO:tasks.workunit.client.0.smithi043.stderr: -73> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.283 INFO:tasks.workunit.client.0.smithi043.stderr: -72> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:03.283 INFO:tasks.workunit.client.0.smithi043.stderr: -71> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.283 INFO:tasks.workunit.client.0.smithi043.stderr: -70> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:03.283 INFO:tasks.workunit.client.0.smithi043.stderr: -69> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 zone default found 2024-09-12T00:37:03.283 INFO:tasks.workunit.client.0.smithi043.stderr: -68> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 4 Realm: () 2024-09-12T00:37:03.283 INFO:tasks.workunit.client.0.smithi043.stderr: -67> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:37:03.283 INFO:tasks.workunit.client.0.smithi043.stderr: -66> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:37:03.283 INFO:tasks.workunit.client.0.smithi043.stderr: -65> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:03.283 INFO:tasks.workunit.client.0.smithi043.stderr: -64> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 zonegroup default 2024-09-12T00:37:03.283 INFO:tasks.workunit.client.0.smithi043.stderr: -63> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.284 INFO:tasks.workunit.client.0.smithi043.stderr: -62> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.284 INFO:tasks.workunit.client.0.smithi043.stderr: -61> 2024-09-12T00:37:03.126+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.284 INFO:tasks.workunit.client.0.smithi043.stderr: -60> 2024-09-12T00:37:03.130+0000 7fad7cce79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.284 INFO:tasks.workunit.client.0.smithi043.stderr: -59> 2024-09-12T00:37:03.130+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.284 INFO:tasks.workunit.client.0.smithi043.stderr: -58> 2024-09-12T00:37:03.130+0000 7fad7cce79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.284 INFO:tasks.workunit.client.0.smithi043.stderr: -57> 2024-09-12T00:37:03.130+0000 7fad7cce79c0 20 started sync module instance, tier type = 2024-09-12T00:37:03.284 INFO:tasks.workunit.client.0.smithi043.stderr: -56> 2024-09-12T00:37:03.130+0000 7fad7cce79c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:37:03.284 INFO:tasks.workunit.client.0.smithi043.stderr: -55> 2024-09-12T00:37:03.146+0000 7fad7cce79c0 20 add_watcher() i=0 2024-09-12T00:37:03.284 INFO:tasks.workunit.client.0.smithi043.stderr: -54> 2024-09-12T00:37:03.146+0000 7fad7cce79c0 20 add_watcher() i=1 2024-09-12T00:37:03.284 INFO:tasks.workunit.client.0.smithi043.stderr: -53> 2024-09-12T00:37:03.146+0000 7fad7cce79c0 20 add_watcher() i=2 2024-09-12T00:37:03.284 INFO:tasks.workunit.client.0.smithi043.stderr: -52> 2024-09-12T00:37:03.146+0000 7fad7cce79c0 20 add_watcher() i=3 2024-09-12T00:37:03.284 INFO:tasks.workunit.client.0.smithi043.stderr: -51> 2024-09-12T00:37:03.146+0000 7fad7cce79c0 20 add_watcher() i=4 2024-09-12T00:37:03.284 INFO:tasks.workunit.client.0.smithi043.stderr: -50> 2024-09-12T00:37:03.146+0000 7fad7cce79c0 20 add_watcher() i=5 2024-09-12T00:37:03.285 INFO:tasks.workunit.client.0.smithi043.stderr: -49> 2024-09-12T00:37:03.146+0000 7fad7cce79c0 20 add_watcher() i=6 2024-09-12T00:37:03.285 INFO:tasks.workunit.client.0.smithi043.stderr: -48> 2024-09-12T00:37:03.146+0000 7fad7cce79c0 20 add_watcher() i=7 2024-09-12T00:37:03.285 INFO:tasks.workunit.client.0.smithi043.stderr: -47> 2024-09-12T00:37:03.146+0000 7fad7cce79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:03.285 INFO:tasks.workunit.client.0.smithi043.stderr: -46> 2024-09-12T00:37:03.146+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefec60) adding auth protocol: cephx 2024-09-12T00:37:03.285 INFO:tasks.workunit.client.0.smithi043.stderr: -45> 2024-09-12T00:37:03.146+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefec60) adding auth protocol: cephx 2024-09-12T00:37:03.285 INFO:tasks.workunit.client.0.smithi043.stderr: -44> 2024-09-12T00:37:03.146+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefec60) adding auth protocol: cephx 2024-09-12T00:37:03.285 INFO:tasks.workunit.client.0.smithi043.stderr: -43> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefec60) adding con mode: secure 2024-09-12T00:37:03.285 INFO:tasks.workunit.client.0.smithi043.stderr: -42> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefec60) adding con mode: crc 2024-09-12T00:37:03.285 INFO:tasks.workunit.client.0.smithi043.stderr: -41> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefec60) adding con mode: secure 2024-09-12T00:37:03.285 INFO:tasks.workunit.client.0.smithi043.stderr: -40> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefec60) adding con mode: crc 2024-09-12T00:37:03.285 INFO:tasks.workunit.client.0.smithi043.stderr: -39> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefec60) adding con mode: secure 2024-09-12T00:37:03.285 INFO:tasks.workunit.client.0.smithi043.stderr: -38> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefec60) adding con mode: crc 2024-09-12T00:37:03.285 INFO:tasks.workunit.client.0.smithi043.stderr: -37> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefec60) adding con mode: crc 2024-09-12T00:37:03.285 INFO:tasks.workunit.client.0.smithi043.stderr: -36> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefec60) adding con mode: secure 2024-09-12T00:37:03.286 INFO:tasks.workunit.client.0.smithi043.stderr: -35> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefec60) adding con mode: crc 2024-09-12T00:37:03.286 INFO:tasks.workunit.client.0.smithi043.stderr: -34> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefec60) adding con mode: secure 2024-09-12T00:37:03.286 INFO:tasks.workunit.client.0.smithi043.stderr: -33> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefec60) adding con mode: crc 2024-09-12T00:37:03.286 INFO:tasks.workunit.client.0.smithi043.stderr: -32> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 AuthRegistry(0x7ffd0fefec60) adding con mode: secure 2024-09-12T00:37:03.286 INFO:tasks.workunit.client.0.smithi043.stderr: -31> 2024-09-12T00:37:03.146+0000 7fac30fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:03.286 INFO:tasks.workunit.client.0.smithi043.stderr: -30> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.286 INFO:tasks.workunit.client.0.smithi043.stderr: -29> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:03.286 INFO:tasks.workunit.client.0.smithi043.stderr: -28> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:03.286 INFO:tasks.workunit.client.0.smithi043.stderr: -27> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command cache list hook 0x559c3a68c5d0 2024-09-12T00:37:03.286 INFO:tasks.workunit.client.0.smithi043.stderr: -26> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command cache inspect hook 0x559c3a68c5d0 2024-09-12T00:37:03.286 INFO:tasks.workunit.client.0.smithi043.stderr: -25> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command cache erase hook 0x559c3a68c5d0 2024-09-12T00:37:03.286 INFO:tasks.workunit.client.0.smithi043.stderr: -24> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command cache zap hook 0x559c3a68c5d0 2024-09-12T00:37:03.286 INFO:tasks.workunit.client.0.smithi043.stderr: -23> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 note: GC not initialized 2024-09-12T00:37:03.287 INFO:tasks.workunit.client.0.smithi043.stderr: -22> 2024-09-12T00:37:03.150+0000 7fabab7fe640 20 reqs_thread_entry: start 2024-09-12T00:37:03.287 INFO:tasks.workunit.client.0.smithi043.stderr: -21> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command sync trace show hook 0x7fad70004300 2024-09-12T00:37:03.287 INFO:tasks.workunit.client.0.smithi043.stderr: -20> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command sync trace history hook 0x7fad70004300 2024-09-12T00:37:03.287 INFO:tasks.workunit.client.0.smithi043.stderr: -19> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command sync trace active hook 0x7fad70004300 2024-09-12T00:37:03.287 INFO:tasks.workunit.client.0.smithi043.stderr: -18> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 5 asok(0x559c3a3b92b0) register_command sync trace active_short hook 0x7fad70004300 2024-09-12T00:37:03.287 INFO:tasks.workunit.client.0.smithi043.stderr: -17> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:03.287 INFO:tasks.workunit.client.0.smithi043.stderr: -16> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 20 Filter name: none 2024-09-12T00:37:03.287 INFO:tasks.workunit.client.0.smithi043.stderr: -15> 2024-09-12T00:37:03.150+0000 7faba97fa640 20 reqs_thread_entry: start 2024-09-12T00:37:03.287 INFO:tasks.workunit.client.0.smithi043.stderr: -14> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:37:03.287 INFO:tasks.workunit.client.0.smithi043.stderr: -13> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.287 INFO:tasks.workunit.client.0.smithi043.stderr: -12> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:37:03.287 INFO:tasks.workunit.client.0.smithi043.stderr: -11> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:37:03.287 INFO:tasks.workunit.client.0.smithi043.stderr: -10> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:37:03.287 INFO:tasks.workunit.client.0.smithi043.stderr: -9> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 : miss 2024-09-12T00:37:03.288 INFO:tasks.workunit.client.0.smithi043.stderr: -8> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.288 INFO:tasks.workunit.client.0.smithi043.stderr: -7> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:37:03.288 INFO:tasks.workunit.client.0.smithi043.stderr: -6> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 info.flags=0x17 2024-09-12T00:37:03.288 INFO:tasks.workunit.client.0.smithi043.stderr: -5> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 to cache LRU end 2024-09-12T00:37:03.288 INFO:tasks.workunit.client.0.smithi043.stderr: -4> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:03.288 INFO:tasks.workunit.client.0.smithi043.stderr: -3> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:03.288 INFO:tasks.workunit.client.0.smithi043.stderr: -2> 2024-09-12T00:37:03.150+0000 7fad7cce79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 2024-09-12T00:37:03.288 INFO:tasks.workunit.client.0.smithi043.stderr: -1> 2024-09-12T00:37:03.158+0000 7fad7cce79c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fad7cce79c0 time 2024-09-12T00:37:03.162508+0000 2024-09-12T00:37:03.288 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:37:03.288 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.288 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:03.288 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fad805c12eb] 2024-09-12T00:37:03.288 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fad805c149f] 2024-09-12T00:37:03.289 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559c38ed2cc1] 2024-09-12T00:37:03.289 INFO:tasks.workunit.client.0.smithi043.stderr: 4: radosgw-admin(+0x1422078) [0x559c39930078] 2024-09-12T00:37:03.289 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559c38ee7ced] 2024-09-12T00:37:03.289 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:37:03.289 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fad7f427d90] 2024-09-12T00:37:03.289 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:37:03.289 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:37:03.289 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.289 INFO:tasks.workunit.client.0.smithi043.stderr: 0> 2024-09-12T00:37:03.162+0000 7fad7cce79c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:37:03.289 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7fad7cce79c0 thread_name:radosgw-admin 2024-09-12T00:37:03.289 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.289 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:03.289 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fad7f440520] 2024-09-12T00:37:03.289 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:37:03.290 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:37:03.290 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:37:03.290 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fad805c1345] 2024-09-12T00:37:03.290 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fad805c149f] 2024-09-12T00:37:03.290 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559c38ed2cc1] 2024-09-12T00:37:03.290 INFO:tasks.workunit.client.0.smithi043.stderr: 8: radosgw-admin(+0x1422078) [0x559c39930078] 2024-09-12T00:37:03.290 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559c38ee7ced] 2024-09-12T00:37:03.290 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:37:03.290 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fad7f427d90] 2024-09-12T00:37:03.290 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:37:03.290 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:37:03.290 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:37:03.290 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.291 INFO:tasks.workunit.client.0.smithi043.stderr:--- logging levels --- 2024-09-12T00:37:03.291 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 none 2024-09-12T00:37:03.291 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 lockdep 2024-09-12T00:37:03.291 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 context 2024-09-12T00:37:03.291 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 crush 2024-09-12T00:37:03.291 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds 2024-09-12T00:37:03.291 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_balancer 2024-09-12T00:37:03.291 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_locker 2024-09-12T00:37:03.291 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log 2024-09-12T00:37:03.291 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log_expire 2024-09-12T00:37:03.291 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_migrator 2024-09-12T00:37:03.291 INFO:tasks.workunit.client.0.smithi043.stderr: 3/ 5 mds_quiesce 2024-09-12T00:37:03.292 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 buffer 2024-09-12T00:37:03.292 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 timer 2024-09-12T00:37:03.292 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 filer 2024-09-12T00:37:03.292 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 striper 2024-09-12T00:37:03.292 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 objecter 2024-09-12T00:37:03.292 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rados 2024-09-12T00:37:03.292 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd 2024-09-12T00:37:03.292 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_mirror 2024-09-12T00:37:03.292 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_replay 2024-09-12T00:37:03.292 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_pwl 2024-09-12T00:37:03.292 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 journaler 2024-09-12T00:37:03.292 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objectcacher 2024-09-12T00:37:03.292 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:37:03.293 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 client 2024-09-12T00:37:03.293 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 osd 2024-09-12T00:37:03.293 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 optracker 2024-09-12T00:37:03.293 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objclass 2024-09-12T00:37:03.293 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 filestore 2024-09-12T00:37:03.293 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 journal 2024-09-12T00:37:03.293 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 ms 2024-09-12T00:37:03.293 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mon 2024-09-12T00:37:03.293 INFO:tasks.workunit.client.0.smithi043.stderr: 0/10 monc 2024-09-12T00:37:03.293 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 paxos 2024-09-12T00:37:03.293 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 tp 2024-09-12T00:37:03.293 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 auth 2024-09-12T00:37:03.293 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 crypto 2024-09-12T00:37:03.293 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 finisher 2024-09-12T00:37:03.294 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 reserver 2024-09-12T00:37:03.294 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 heartbeatmap 2024-09-12T00:37:03.294 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 perfcounter 2024-09-12T00:37:03.294 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw 2024-09-12T00:37:03.294 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_sync 2024-09-12T00:37:03.294 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_datacache 2024-09-12T00:37:03.294 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_access 2024-09-12T00:37:03.294 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:37:03.294 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_flight 2024-09-12T00:37:03.294 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:37:03.294 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw_notification 2024-09-12T00:37:03.294 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 javaclient 2024-09-12T00:37:03.294 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 asok 2024-09-12T00:37:03.294 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 throttle 2024-09-12T00:37:03.295 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 refs 2024-09-12T00:37:03.295 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 compressor 2024-09-12T00:37:03.295 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluestore 2024-09-12T00:37:03.296 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluefs 2024-09-12T00:37:03.296 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 bdev 2024-09-12T00:37:03.296 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 kstore 2024-09-12T00:37:03.296 INFO:tasks.workunit.client.0.smithi043.stderr: 4/ 5 rocksdb 2024-09-12T00:37:03.296 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 fuse 2024-09-12T00:37:03.296 INFO:tasks.workunit.client.0.smithi043.stderr: 2/ 5 mgr 2024-09-12T00:37:03.296 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mgrc 2024-09-12T00:37:03.296 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 dpdk 2024-09-12T00:37:03.296 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 eventtrace 2024-09-12T00:37:03.296 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 prioritycache 2024-09-12T00:37:03.296 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 test 2024-09-12T00:37:03.297 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:37:03.297 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephsqlite 2024-09-12T00:37:03.297 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:37:03.297 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore 2024-09-12T00:37:03.297 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_onode 2024-09-12T00:37:03.297 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_odata 2024-09-12T00:37:03.297 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_omap 2024-09-12T00:37:03.297 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_tm 2024-09-12T00:37:03.297 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_t 2024-09-12T00:37:03.297 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:37:03.297 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_epm 2024-09-12T00:37:03.297 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_lba 2024-09-12T00:37:03.297 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:37:03.298 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cache 2024-09-12T00:37:03.298 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_journal 2024-09-12T00:37:03.298 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_device 2024-09-12T00:37:03.298 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_backref 2024-09-12T00:37:03.298 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 alienstore 2024-09-12T00:37:03.298 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mclock 2024-09-12T00:37:03.298 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cyanstore 2024-09-12T00:37:03.298 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 ceph_exporter 2024-09-12T00:37:03.298 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 memstore 2024-09-12T00:37:03.298 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 trace 2024-09-12T00:37:03.298 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 ceph_dedup 2024-09-12T00:37:03.298 INFO:tasks.workunit.client.0.smithi043.stderr: -2/-2 (syslog threshold) 2024-09-12T00:37:03.298 INFO:tasks.workunit.client.0.smithi043.stderr: 99/99 (stderr threshold) 2024-09-12T00:37:03.298 INFO:tasks.workunit.client.0.smithi043.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:37:03.299 INFO:tasks.workunit.client.0.smithi043.stderr: 7faba97fa640 / http_manager 2024-09-12T00:37:03.299 INFO:tasks.workunit.client.0.smithi043.stderr: 7fabab7fe640 / http_manager 2024-09-12T00:37:03.299 INFO:tasks.workunit.client.0.smithi043.stderr: 7fac30fe1640 / rgw_dt_lg_renew 2024-09-12T00:37:03.299 INFO:tasks.workunit.client.0.smithi043.stderr: 7fac4bfff640 / ms_dispatch 2024-09-12T00:37:03.299 INFO:tasks.workunit.client.0.smithi043.stderr: 7fac5dffb640 / io_context_pool 2024-09-12T00:37:03.299 INFO:tasks.workunit.client.0.smithi043.stderr: 7fac5ffff640 / ms_dispatch 2024-09-12T00:37:03.299 INFO:tasks.workunit.client.0.smithi043.stderr: 7fac66e05640 / ms_dispatch 2024-09-12T00:37:03.299 INFO:tasks.workunit.client.0.smithi043.stderr: 7fac68608640 / io_context_pool 2024-09-12T00:37:03.299 INFO:tasks.workunit.client.0.smithi043.stderr: 7fad79fec640 / msgr-worker-2 2024-09-12T00:37:03.299 INFO:tasks.workunit.client.0.smithi043.stderr: 7fad7a7ed640 / msgr-worker-1 2024-09-12T00:37:03.299 INFO:tasks.workunit.client.0.smithi043.stderr: 7fad7afee640 / msgr-worker-0 2024-09-12T00:37:03.299 INFO:tasks.workunit.client.0.smithi043.stderr: 7fad7b7ef640 / io_context_pool 2024-09-12T00:37:03.299 INFO:tasks.workunit.client.0.smithi043.stderr: 7fad7cce79c0 / radosgw-admin 2024-09-12T00:37:03.299 INFO:tasks.workunit.client.0.smithi043.stderr: max_recent 500 2024-09-12T00:37:03.300 INFO:tasks.workunit.client.0.smithi043.stderr: max_new 1000 2024-09-12T00:37:03.300 INFO:tasks.workunit.client.0.smithi043.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:37:03.164984Z_a667096c-5eb9-4470-a158-841d3e1889ee/log 2024-09-12T00:37:03.300 INFO:tasks.workunit.client.0.smithi043.stderr:--- end dump of recent events --- 2024-09-12T00:37:03.300 INFO:tasks.workunit.client.0.smithi043.stderr:Aborted 2024-09-12T00:37:03.300 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:37:03.304 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:03.304 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:03.304 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.238+0000 7f02f6c639c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.304 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.242+0000 7f02f6c639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.304 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.242+0000 7f02f6c639c0 20 realm 2024-09-12T00:37:03.304 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.242+0000 7f02f6c639c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.242+0000 7f02f6c639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.242+0000 7f02f6c639c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:03.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.242+0000 7f02f6c639c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.242+0000 7f02f6c639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.242+0000 7f02f6c639c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.242+0000 7f02f6c639c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:03.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.242+0000 7f02f6c639c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.246+0000 7f02f6c639c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:03.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.246+0000 7f02f6c639c0 20 searching for the correct realm 2024-09-12T00:37:03.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.250+0000 7f02f4f6a640 0 -- 172.21.15.43:0/1052188802 >> [v2:172.21.15.43:6808/2258408181,v1:172.21.15.43:6809/2258408181] conn(0x56322919d420 msgr2=0x56322919f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:03.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.254+0000 7f02f4769640 0 -- 172.21.15.43:0/1052188802 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f02e80e3900 msgr2=0x7f02e80b7400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:37:03.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.266+0000 7f02f6c639c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:37:03.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.266+0000 7f02f6c639c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:03.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.266+0000 7f02f6c639c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:03.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.266+0000 7f02f6c639c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:37:03.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.266+0000 7f02f6c639c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:03.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.266+0000 7f02f6c639c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:03.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.266+0000 7f02f6c639c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.266+0000 7f02f6c639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.266+0000 7f02f6c639c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.266+0000 7f02f6c639c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:03.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.266+0000 7f02f6c639c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.266+0000 7f02f6c639c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:03.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.266+0000 7f02f6c639c0 20 zone default found 2024-09-12T00:37:03.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.266+0000 7f02f6c639c0 4 Realm: () 2024-09-12T00:37:03.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.266+0000 7f02f6c639c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:37:03.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.266+0000 7f02f6c639c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:37:03.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.266+0000 7f02f6c639c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:03.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.266+0000 7f02f6c639c0 20 zonegroup default 2024-09-12T00:37:03.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.266+0000 7f02f6c639c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.266+0000 7f02f6c639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.266+0000 7f02f6c639c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.266+0000 7f02f6c639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.266+0000 7f02f6c639c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.266+0000 7f02f6c639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.266+0000 7f02f6c639c0 20 started sync module instance, tier type = 2024-09-12T00:37:03.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.266+0000 7f02f6c639c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:37:03.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.282+0000 7f02f6c639c0 20 add_watcher() i=0 2024-09-12T00:37:03.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.282+0000 7f02f6c639c0 20 add_watcher() i=1 2024-09-12T00:37:03.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.282+0000 7f02f6c639c0 20 add_watcher() i=2 2024-09-12T00:37:03.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.282+0000 7f02f6c639c0 20 add_watcher() i=3 2024-09-12T00:37:03.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.282+0000 7f02f6c639c0 20 add_watcher() i=4 2024-09-12T00:37:03.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.282+0000 7f02f6c639c0 20 add_watcher() i=5 2024-09-12T00:37:03.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.282+0000 7f02f6c639c0 20 add_watcher() i=6 2024-09-12T00:37:03.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.282+0000 7f02f6c639c0 20 add_watcher() i=7 2024-09-12T00:37:03.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.282+0000 7f02f6c639c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:03.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.286+0000 7f01aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:03.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.286+0000 7f02f6c639c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:03.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.286+0000 7f02f6c639c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:03.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.286+0000 7f02f6c639c0 5 note: GC not initialized 2024-09-12T00:37:03.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.286+0000 7f01a9fdb640 20 reqs_thread_entry: start 2024-09-12T00:37:03.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.286+0000 7f02f6c639c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:03.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.286+0000 7f02f6c639c0 20 Filter name: none 2024-09-12T00:37:03.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.286+0000 7f011b7fe640 20 reqs_thread_entry: start 2024-09-12T00:37:03.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.286+0000 7f02f6c639c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.286+0000 7f02f6c639c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:37:03.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.286+0000 7f02f6c639c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.290+0000 7f02f6c639c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:37:03.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.290+0000 7f02f6c639c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:03.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.290+0000 7f02f6c639c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.290+0000 7f02f6c639c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:37:03.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.290+0000 7f02f6c639c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.290+0000 7f02f6c639c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:37:03.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.290+0000 7f02f6c639c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:03.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.294+0000 7f01aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:03.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.298+0000 7f02f6c639c0 20 remove_watcher() i=0 2024-09-12T00:37:03.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.298+0000 7f02f6c639c0 2 removed watcher, disabling cache 2024-09-12T00:37:03.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.302+0000 7f02f6c639c0 20 remove_watcher() i=1 2024-09-12T00:37:03.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.302+0000 7f02f6c639c0 20 remove_watcher() i=2 2024-09-12T00:37:03.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.306+0000 7f02f6c639c0 20 remove_watcher() i=3 2024-09-12T00:37:03.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.306+0000 7f02f6c639c0 20 remove_watcher() i=4 2024-09-12T00:37:03.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.306+0000 7f02f6c639c0 20 remove_watcher() i=5 2024-09-12T00:37:03.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.310+0000 7f02f6c639c0 20 remove_watcher() i=6 2024-09-12T00:37:03.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.310+0000 7f02f6c639c0 20 remove_watcher() i=7 2024-09-12T00:37:03.324 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.324 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:37:03.324 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: abort-at-set-target-layout id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:37:03.324 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:03.325 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:03.325 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:03.338 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:03.338 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:03.382 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:37:03.419 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:03.419 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:03.464 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.462+0000 7efd694709c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.466+0000 7efd694709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.466+0000 7efd694709c0 20 realm 2024-09-12T00:37:03.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.466+0000 7efd694709c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.466+0000 7efd694709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.466+0000 7efd694709c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:03.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.466+0000 7efd694709c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.466+0000 7efd694709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.466+0000 7efd694709c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.468 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.466+0000 7efd694709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:03.468 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.466+0000 7efd694709c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.469 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.466+0000 7efd694709c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:03.469 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.466+0000 7efd694709c0 20 searching for the correct realm 2024-09-12T00:37:03.471 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.470+0000 7efd66775640 0 -- 172.21.15.43:0/134887276 >> [v2:172.21.15.43:6816/653473197,v1:172.21.15.43:6817/653473197] conn(0x562d832f7930 msgr2=0x562d832f9d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:37:03.478 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.478+0000 7efd66f76640 0 -- 172.21.15.43:0/134887276 >> [v2:172.21.15.97:6816/489545787,v1:172.21.15.97:6817/489545787] conn(0x7efd60027070 msgr2=0x7efd60028970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:03.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.486+0000 7efd694709c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:37:03.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.486+0000 7efd694709c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:03.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.486+0000 7efd694709c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:03.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.486+0000 7efd694709c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:37:03.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.486+0000 7efd694709c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:03.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.486+0000 7efd694709c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:03.490 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.486+0000 7efd694709c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.490 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.490+0000 7efd694709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.490 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.490+0000 7efd694709c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.491 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.490+0000 7efd694709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:03.491 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.490+0000 7efd694709c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.491 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.490+0000 7efd694709c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:03.491 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.490+0000 7efd694709c0 20 zone default found 2024-09-12T00:37:03.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.490+0000 7efd694709c0 4 Realm: () 2024-09-12T00:37:03.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.490+0000 7efd694709c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:37:03.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.490+0000 7efd694709c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:37:03.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.490+0000 7efd694709c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:03.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.490+0000 7efd694709c0 20 zonegroup default 2024-09-12T00:37:03.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.490+0000 7efd694709c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.490+0000 7efd694709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.490+0000 7efd694709c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.493 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.490+0000 7efd694709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.493 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.490+0000 7efd694709c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.493 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.490+0000 7efd694709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.494 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.490+0000 7efd694709c0 20 started sync module instance, tier type = 2024-09-12T00:37:03.494 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.490+0000 7efd694709c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:37:03.508 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.506+0000 7efd694709c0 20 add_watcher() i=0 2024-09-12T00:37:03.508 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.506+0000 7efd694709c0 20 add_watcher() i=1 2024-09-12T00:37:03.508 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.506+0000 7efd694709c0 20 add_watcher() i=2 2024-09-12T00:37:03.508 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.506+0000 7efd694709c0 20 add_watcher() i=3 2024-09-12T00:37:03.508 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.506+0000 7efd694709c0 20 add_watcher() i=4 2024-09-12T00:37:03.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.506+0000 7efd694709c0 20 add_watcher() i=5 2024-09-12T00:37:03.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.506+0000 7efd694709c0 20 add_watcher() i=6 2024-09-12T00:37:03.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.510+0000 7efd694709c0 20 add_watcher() i=7 2024-09-12T00:37:03.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.510+0000 7efd694709c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:03.511 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.510+0000 7efc1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:03.513 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.510+0000 7efd694709c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:03.513 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.510+0000 7efd694709c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:03.513 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.510+0000 7efd694709c0 5 note: GC not initialized 2024-09-12T00:37:03.513 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.510+0000 7efc1cfe1640 20 reqs_thread_entry: start 2024-09-12T00:37:03.513 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.510+0000 7efd694709c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:03.513 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.510+0000 7efd694709c0 20 Filter name: none 2024-09-12T00:37:03.513 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.510+0000 7efc15ffb640 20 reqs_thread_entry: start 2024-09-12T00:37:03.513 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.510+0000 7efd694709c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:37:03.513 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.510+0000 7efd694709c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.514 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.514+0000 7efd694709c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:37:03.514 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.514+0000 7efd694709c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:37:03.514 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.514+0000 7efd694709c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:37:03.515 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.514+0000 7efd694709c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 : miss 2024-09-12T00:37:03.515 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.514+0000 7efd694709c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.516 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.514+0000 7efd694709c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:37:03.516 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.514+0000 7efd694709c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 info.flags=0x17 2024-09-12T00:37:03.516 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.514+0000 7efd694709c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 to cache LRU end 2024-09-12T00:37:03.516 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.514+0000 7efd694709c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:03.516 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.514+0000 7efd694709c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:03.517 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.514+0000 7efd694709c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 2024-09-12T00:37:03.518 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.518+0000 7efd694709c0 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 to be held by another RGW process; skipping for now 2024-09-12T00:37:03.518 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.518+0000 7efc1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:03.522 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.522+0000 7efd694709c0 20 remove_watcher() i=0 2024-09-12T00:37:03.522 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.522+0000 7efd694709c0 2 removed watcher, disabling cache 2024-09-12T00:37:03.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.526+0000 7efd694709c0 20 remove_watcher() i=1 2024-09-12T00:37:03.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.526+0000 7efd694709c0 20 remove_watcher() i=2 2024-09-12T00:37:03.529 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.530+0000 7efd694709c0 20 remove_watcher() i=3 2024-09-12T00:37:03.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.530+0000 7efd694709c0 20 remove_watcher() i=4 2024-09-12T00:37:03.532 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.530+0000 7efd694709c0 20 remove_watcher() i=5 2024-09-12T00:37:03.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.534+0000 7efd694709c0 20 remove_watcher() i=6 2024-09-12T00:37:03.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:03.534+0000 7efd694709c0 20 remove_watcher() i=7 2024-09-12T00:37:03.548 INFO:tasks.workunit.client.0.smithi043.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:37:33.562 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:37:33.601 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:33.601 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:33.647 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.646+0000 7ff61bd999c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.649 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.650+0000 7ff61bd999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:33.649 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.650+0000 7ff61bd999c0 20 realm 2024-09-12T00:37:33.649 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.650+0000 7ff61bd999c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.649 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.650+0000 7ff61bd999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:33.649 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.650+0000 7ff61bd999c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:33.650 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.650+0000 7ff61bd999c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.650 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.650+0000 7ff61bd999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:33.650 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.650+0000 7ff61bd999c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.651 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.650+0000 7ff61bd999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:33.651 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.650+0000 7ff61bd999c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.650+0000 7ff61bd999c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:33.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.650+0000 7ff61bd999c0 20 searching for the correct realm 2024-09-12T00:37:33.658 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.658+0000 7ff61a0a0640 0 -- 172.21.15.43:0/3201293897 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x557944b30f20 msgr2=0x557944b33390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:33.665 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.666+0000 7ff61909e640 0 -- 172.21.15.43:0/3201293897 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7ff604009c20 msgr2=0x7ff604031a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:33.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.670+0000 7ff61bd999c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:37:33.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.670+0000 7ff61bd999c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:33.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.670+0000 7ff61bd999c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:33.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.670+0000 7ff61bd999c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:37:33.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.670+0000 7ff61bd999c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:33.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.670+0000 7ff61bd999c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:33.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.670+0000 7ff61bd999c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.673 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.670+0000 7ff61bd999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:33.673 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.670+0000 7ff61bd999c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.673 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.674+0000 7ff61bd999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:33.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.674+0000 7ff61bd999c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.674+0000 7ff61bd999c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:33.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.674+0000 7ff61bd999c0 20 zone default found 2024-09-12T00:37:33.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.674+0000 7ff61bd999c0 4 Realm: () 2024-09-12T00:37:33.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.674+0000 7ff61bd999c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:37:33.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.674+0000 7ff61bd999c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:37:33.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.674+0000 7ff61bd999c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:33.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.674+0000 7ff61bd999c0 20 zonegroup default 2024-09-12T00:37:33.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.674+0000 7ff61bd999c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.674+0000 7ff61bd999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:33.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.674+0000 7ff61bd999c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.675 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.674+0000 7ff61bd999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:33.675 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.674+0000 7ff61bd999c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.675 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.674+0000 7ff61bd999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:33.675 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.674+0000 7ff61bd999c0 20 started sync module instance, tier type = 2024-09-12T00:37:33.675 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.674+0000 7ff61bd999c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:37:33.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.690+0000 7ff61bd999c0 20 add_watcher() i=0 2024-09-12T00:37:33.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.690+0000 7ff61bd999c0 20 add_watcher() i=1 2024-09-12T00:37:33.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.690+0000 7ff61bd999c0 20 add_watcher() i=2 2024-09-12T00:37:33.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.690+0000 7ff61bd999c0 20 add_watcher() i=3 2024-09-12T00:37:33.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.690+0000 7ff61bd999c0 20 add_watcher() i=4 2024-09-12T00:37:33.691 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.690+0000 7ff61bd999c0 20 add_watcher() i=5 2024-09-12T00:37:33.691 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.690+0000 7ff61bd999c0 20 add_watcher() i=6 2024-09-12T00:37:33.691 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.690+0000 7ff61bd999c0 20 add_watcher() i=7 2024-09-12T00:37:33.691 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.690+0000 7ff61bd999c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:33.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.694+0000 7ff4cb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:33.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.694+0000 7ff61bd999c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:33.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.694+0000 7ff61bd999c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:33.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.694+0000 7ff61bd999c0 5 note: GC not initialized 2024-09-12T00:37:33.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.694+0000 7ff4ca7fc640 20 reqs_thread_entry: start 2024-09-12T00:37:33.696 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.694+0000 7ff61bd999c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:33.696 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.694+0000 7ff61bd999c0 20 Filter name: none 2024-09-12T00:37:33.696 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.694+0000 7ff43bfff640 20 reqs_thread_entry: start 2024-09-12T00:37:33.696 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.694+0000 7ff61bd999c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:37:33.696 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.694+0000 7ff61bd999c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.696 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.694+0000 7ff61bd999c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:37:33.697 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.694+0000 7ff61bd999c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:37:33.697 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.694+0000 7ff61bd999c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:37:33.697 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.694+0000 7ff61bd999c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 : miss 2024-09-12T00:37:33.697 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.694+0000 7ff61bd999c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.697 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.698+0000 7ff61bd999c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:37:33.698 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.698+0000 7ff61bd999c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 info.flags=0x17 2024-09-12T00:37:33.698 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.698+0000 7ff61bd999c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 to cache LRU end 2024-09-12T00:37:33.698 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.698+0000 7ff61bd999c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:33.698 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.698+0000 7ff61bd999c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:33.698 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.698+0000 7ff61bd999c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 2024-09-12T00:37:33.706 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.706+0000 7ff61bd999c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 info.flags=0x17 2024-09-12T00:37:33.706 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.706+0000 7ff61bd999c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 to cache LRU end 2024-09-12T00:37:33.707 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.706+0000 7ff61bd999c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:33.707 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.706+0000 7ff61bd999c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24, ofs0, ns] 2024-09-12T00:37:33.707 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.706+0000 7ff4fcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333514 cookie 93979331998416 notifier 6615 bl.length()=925 2024-09-12T00:37:33.707 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.706+0000 7ff4fcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 info.flags=0x17 2024-09-12T00:37:33.707 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.706+0000 7ff4fcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 to cache LRU end 2024-09-12T00:37:33.707 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.706+0000 7ff4fcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:33.708 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.706+0000 7ff61bd999c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24]): orig_sources= new_sources= 2024-09-12T00:37:33.709 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.706+0000 7ff61bd999c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24]): potential sources added=[] removed=[] 2024-09-12T00:37:33.709 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.706+0000 7ff61bd999c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24]): orig_dests= new_dests= 2024-09-12T00:37:33.709 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.706+0000 7ff61bd999c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24]): potential dests added=[] removed=[] 2024-09-12T00:37:33.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.718+0000 7ff61bd999c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.1.0 2024-09-12T00:37:33.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.718+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.1.0 2024-09-12T00:37:33.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.718+0000 7ff61bd999c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.1.1 2024-09-12T00:37:33.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.718+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.1.1 2024-09-12T00:37:33.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.718+0000 7ff61bd999c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.1.2 2024-09-12T00:37:33.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.718+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.1.2 2024-09-12T00:37:33.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.718+0000 7ff61bd999c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.1.3 2024-09-12T00:37:33.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.718+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.1.3 2024-09-12T00:37:33.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.718+0000 7ff61bd999c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.1.4 2024-09-12T00:37:33.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.718+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.1.4 2024-09-12T00:37:33.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.718+0000 7ff61bd999c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.1.5 2024-09-12T00:37:33.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.718+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.1.5 2024-09-12T00:37:33.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.718+0000 7ff61bd999c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.1.6 2024-09-12T00:37:33.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.718+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.1.6 2024-09-12T00:37:33.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.718+0000 7ff61bd999c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.1.7 2024-09-12T00:37:33.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.718+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.1.7 2024-09-12T00:37:33.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.718+0000 7ff61bd999c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.1.8 2024-09-12T00:37:33.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.718+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.1.8 2024-09-12T00:37:33.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.718+0000 7ff61bd999c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.1.9 2024-09-12T00:37:33.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.718+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.1.9 2024-09-12T00:37:33.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.718+0000 7ff61bd999c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.1.10 2024-09-12T00:37:33.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.718+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.1.10 2024-09-12T00:37:33.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.718+0000 7ff61bd999c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.1.11 2024-09-12T00:37:33.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.718+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.1.11 2024-09-12T00:37:33.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.718+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.0 2024-09-12T00:37:33.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.718+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.1 2024-09-12T00:37:33.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.722+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.2 2024-09-12T00:37:33.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.722+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.3 2024-09-12T00:37:33.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.722+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.4 2024-09-12T00:37:33.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.722+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.5 2024-09-12T00:37:33.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.722+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.6 2024-09-12T00:37:33.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.726+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.7 2024-09-12T00:37:33.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.726+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.8 2024-09-12T00:37:33.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.730+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.9 2024-09-12T00:37:33.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.730+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.10 2024-09-12T00:37:33.735 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.734+0000 7ff61bd999c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 : hit (requested=0x17, cached=0x17) 2024-09-12T00:37:33.735 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.734+0000 7ff61bd999c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 2024-09-12T00:37:33.738 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.738+0000 7ff61bd999c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 info.flags=0x17 2024-09-12T00:37:33.738 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.738+0000 7ff61bd999c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 to cache LRU end 2024-09-12T00:37:33.738 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.738+0000 7ff61bd999c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:33.738 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.738+0000 7ff61bd999c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24, ofs0, ns] 2024-09-12T00:37:33.739 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.738+0000 7ff4fcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333515 cookie 93979331998416 notifier 6615 bl.length()=925 2024-09-12T00:37:33.739 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.738+0000 7ff4fcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 info.flags=0x17 2024-09-12T00:37:33.739 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.738+0000 7ff4fcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 to cache LRU end 2024-09-12T00:37:33.739 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.738+0000 7ff4fcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:33.740 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.738+0000 7ff61bd999c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24]): orig_sources= new_sources= 2024-09-12T00:37:33.740 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.738+0000 7ff61bd999c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24]): potential sources added=[] removed=[] 2024-09-12T00:37:33.740 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.738+0000 7ff61bd999c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24]): orig_dests= new_dests= 2024-09-12T00:37:33.740 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.738+0000 7ff61bd999c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24]): potential dests added=[] removed=[] 2024-09-12T00:37:33.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.746+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.0 2024-09-12T00:37:33.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.746+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.1 2024-09-12T00:37:33.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.746+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.2 2024-09-12T00:37:33.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.746+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.3 2024-09-12T00:37:33.747 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.746+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.4 2024-09-12T00:37:33.748 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.746+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.5 2024-09-12T00:37:33.748 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.746+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.6 2024-09-12T00:37:33.749 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.750+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.7 2024-09-12T00:37:33.750 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.750+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.8 2024-09-12T00:37:33.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.750+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.9 2024-09-12T00:37:33.752 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.750+0000 7ff61bd999c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24.10 2024-09-12T00:37:33.753 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.754+0000 7ff61bd999c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 : hit (requested=0x17, cached=0x17) 2024-09-12T00:37:33.753 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.754+0000 7ff61bd999c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 2024-09-12T00:37:33.756 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.754+0000 7ff61bd999c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 info.flags=0x17 2024-09-12T00:37:33.756 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.754+0000 7ff61bd999c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 to cache LRU end 2024-09-12T00:37:33.757 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.754+0000 7ff61bd999c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:33.757 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.754+0000 7ff61bd999c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24, ofs0, ns] 2024-09-12T00:37:33.757 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.758+0000 7ff4fd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333516 cookie 93979331998416 notifier 6615 bl.length()=893 2024-09-12T00:37:33.757 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.758+0000 7ff4fd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 info.flags=0x17 2024-09-12T00:37:33.757 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.758+0000 7ff4fd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 to cache LRU end 2024-09-12T00:37:33.757 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.758+0000 7ff4fd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:33.758 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.758+0000 7ff61bd999c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24]): orig_sources= new_sources= 2024-09-12T00:37:33.758 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.758+0000 7ff61bd999c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24]): potential sources added=[] removed=[] 2024-09-12T00:37:33.759 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.758+0000 7ff61bd999c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24]): orig_dests= new_dests= 2024-09-12T00:37:33.759 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.758+0000 7ff61bd999c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24]): potential dests added=[] removed=[] 2024-09-12T00:37:33.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.762+0000 7ff61bd999c0 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:37:33.767 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.766+0000 7ff4cb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:33.772 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.770+0000 7ff61bd999c0 20 remove_watcher() i=0 2024-09-12T00:37:33.772 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.770+0000 7ff61bd999c0 2 removed watcher, disabling cache 2024-09-12T00:37:33.774 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.774+0000 7ff61bd999c0 20 remove_watcher() i=1 2024-09-12T00:37:33.777 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.778+0000 7ff61bd999c0 20 remove_watcher() i=2 2024-09-12T00:37:33.779 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.778+0000 7ff61bd999c0 20 remove_watcher() i=3 2024-09-12T00:37:33.781 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.782+0000 7ff61bd999c0 20 remove_watcher() i=4 2024-09-12T00:37:33.783 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.782+0000 7ff61bd999c0 20 remove_watcher() i=5 2024-09-12T00:37:33.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.782+0000 7ff61bd999c0 20 remove_watcher() i=6 2024-09-12T00:37:33.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.786+0000 7ff61bd999c0 20 remove_watcher() i=7 2024-09-12T00:37:33.801 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:37:33.833 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:33.833 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:33.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.874+0000 7f43fd0659c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.879 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.878+0000 7f43fd0659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:33.879 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.878+0000 7f43fd0659c0 20 realm 2024-09-12T00:37:33.879 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.878+0000 7f43fd0659c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.879 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.878+0000 7f43fd0659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:33.879 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.878+0000 7f43fd0659c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:33.879 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.878+0000 7f43fd0659c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.879 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.878+0000 7f43fd0659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:33.879 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.878+0000 7f43fd0659c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.881 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.878+0000 7f43fd0659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:33.881 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.878+0000 7f43fd0659c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.881 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.882+0000 7f43fd0659c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:33.881 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.882+0000 7f43fd0659c0 20 searching for the correct realm 2024-09-12T00:37:33.887 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.886+0000 7f43fb36c640 0 -- 172.21.15.43:0/3211213346 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55b3f51dbee0 msgr2=0x55b3f51de3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:33.893 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.894+0000 7f43fa36a640 0 -- 172.21.15.43:0/3211213346 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f43e40e7040 msgr2=0x7f43e40e8940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:33.900 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.898+0000 7f43fd0659c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:37:33.900 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.898+0000 7f43fd0659c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:33.900 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.898+0000 7f43fd0659c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:33.900 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.898+0000 7f43fd0659c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:37:33.900 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.898+0000 7f43fd0659c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:33.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.898+0000 7f43fd0659c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:33.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.898+0000 7f43fd0659c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.898+0000 7f43fd0659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:33.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.898+0000 7f43fd0659c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.902 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.902+0000 7f43fd0659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:33.902 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.902+0000 7f43fd0659c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.902 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.902+0000 7f43fd0659c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:33.902 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.902+0000 7f43fd0659c0 20 zone default found 2024-09-12T00:37:33.902 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.902+0000 7f43fd0659c0 4 Realm: () 2024-09-12T00:37:33.902 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.902+0000 7f43fd0659c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:37:33.902 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.902+0000 7f43fd0659c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:37:33.902 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.902+0000 7f43fd0659c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:33.902 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.902+0000 7f43fd0659c0 20 zonegroup default 2024-09-12T00:37:33.902 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.902+0000 7f43fd0659c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.902 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.902+0000 7f43fd0659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:33.902 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.902+0000 7f43fd0659c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.903 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.902+0000 7f43fd0659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:33.903 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.902+0000 7f43fd0659c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.903 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.902+0000 7f43fd0659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:33.903 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.902+0000 7f43fd0659c0 20 started sync module instance, tier type = 2024-09-12T00:37:33.904 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.902+0000 7f43fd0659c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:37:33.918 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.918+0000 7f43fd0659c0 20 add_watcher() i=0 2024-09-12T00:37:33.918 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.918+0000 7f43fd0659c0 20 add_watcher() i=1 2024-09-12T00:37:33.918 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.918+0000 7f43fd0659c0 20 add_watcher() i=2 2024-09-12T00:37:33.919 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.918+0000 7f43fd0659c0 20 add_watcher() i=3 2024-09-12T00:37:33.919 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.918+0000 7f43fd0659c0 20 add_watcher() i=4 2024-09-12T00:37:33.919 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.918+0000 7f43fd0659c0 20 add_watcher() i=5 2024-09-12T00:37:33.919 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.918+0000 7f43fd0659c0 20 add_watcher() i=6 2024-09-12T00:37:33.919 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.918+0000 7f43fd0659c0 20 add_watcher() i=7 2024-09-12T00:37:33.919 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.918+0000 7f43fd0659c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:33.922 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.922+0000 7f42b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:33.923 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.922+0000 7f43fd0659c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:33.923 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.922+0000 7f43fd0659c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:33.923 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.922+0000 7f43fd0659c0 5 note: GC not initialized 2024-09-12T00:37:33.923 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.922+0000 7f422bfff640 20 reqs_thread_entry: start 2024-09-12T00:37:33.923 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.922+0000 7f43fd0659c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:33.923 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.922+0000 7f43fd0659c0 20 Filter name: none 2024-09-12T00:37:33.923 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.922+0000 7f4229ffb640 20 reqs_thread_entry: start 2024-09-12T00:37:33.923 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.922+0000 7f43fd0659c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.924 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.922+0000 7f43fd0659c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:37:33.924 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.922+0000 7f43fd0659c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.925 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.926+0000 7f43fd0659c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:37:33.925 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.926+0000 7f43fd0659c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:33.925 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.926+0000 7f43fd0659c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.926 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.926+0000 7f43fd0659c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:37:33.926 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.926+0000 7f43fd0659c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.927 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.926+0000 7f43fd0659c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:37:33.927 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.926+0000 7f43fd0659c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:33.929 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.930+0000 7f42b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:33.934 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.934+0000 7f43fd0659c0 20 remove_watcher() i=0 2024-09-12T00:37:33.934 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.934+0000 7f43fd0659c0 2 removed watcher, disabling cache 2024-09-12T00:37:33.936 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.934+0000 7f43fd0659c0 20 remove_watcher() i=1 2024-09-12T00:37:33.938 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.938+0000 7f43fd0659c0 20 remove_watcher() i=2 2024-09-12T00:37:33.940 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.938+0000 7f43fd0659c0 20 remove_watcher() i=3 2024-09-12T00:37:33.942 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.942+0000 7f43fd0659c0 20 remove_watcher() i=4 2024-09-12T00:37:33.943 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.942+0000 7f43fd0659c0 20 remove_watcher() i=5 2024-09-12T00:37:33.944 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.942+0000 7f43fd0659c0 20 remove_watcher() i=6 2024-09-12T00:37:33.945 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:33.946+0000 7f43fd0659c0 20 remove_watcher() i=7 2024-09-12T00:37:33.959 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:33.959 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:37:33.959 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: abort-at-set-target-layout id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:37:33.959 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:33.961 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:33.961 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:33.964 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:33.964 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:34.011 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.011 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:34.054 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-12T00:37:34.054 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:34.056 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.056 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:34.074 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.075 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:34.121 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.121 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:34.140 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.140 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:34.158 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.159 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:34.178 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.178 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:34.198 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.198 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:34.218 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.220 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:34.238 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.238 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:34.258 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.258 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:34.276 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.277 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:34.295 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.296 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:34.315 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.315 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:34.335 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.335 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:34.356 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.356 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:34.376 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.376 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:34.397 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.397 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:34.470 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.470 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:34.489 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.489 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:34.507 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.507 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:34.525 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.526 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:34.546 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.546 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:34.563 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:37:34.599 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:34.599 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:34.643 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.642+0000 7f123adf99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.644 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.642+0000 7f123adf99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:34.645 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.642+0000 7f123adf99c0 20 realm 2024-09-12T00:37:34.645 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.642+0000 7f123adf99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.645 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.646+0000 7f123adf99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:34.645 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.646+0000 7f123adf99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:34.645 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.646+0000 7f123adf99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.646 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.646+0000 7f123adf99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:34.646 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.646+0000 7f123adf99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.647 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.646+0000 7f123adf99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:34.647 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.646+0000 7f123adf99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.648 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.646+0000 7f123adf99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:34.648 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.646+0000 7f123adf99c0 20 searching for the correct realm 2024-09-12T00:37:34.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.654+0000 7f12380fe640 0 -- 172.21.15.43:0/3579532564 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f12200c3400 msgr2=0x7f12200c3820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:34.660 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.658+0000 7f12380fe640 0 -- 172.21.15.43:0/3579532564 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f1104080b30 msgr2=0x7f1104082f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:34.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.666+0000 7f123adf99c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:37:34.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.666+0000 7f123adf99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:34.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.666+0000 7f123adf99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:34.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.666+0000 7f123adf99c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:37:34.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.666+0000 7f123adf99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:34.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.666+0000 7f123adf99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:34.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.666+0000 7f123adf99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.666+0000 7f123adf99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:34.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.666+0000 7f123adf99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.666+0000 7f123adf99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:34.669 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.666+0000 7f123adf99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.669 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.670+0000 7f123adf99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:34.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.670+0000 7f123adf99c0 20 zone default found 2024-09-12T00:37:34.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.670+0000 7f123adf99c0 4 Realm: () 2024-09-12T00:37:34.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.670+0000 7f123adf99c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:37:34.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.670+0000 7f123adf99c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:37:34.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.670+0000 7f123adf99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:34.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.670+0000 7f123adf99c0 20 zonegroup default 2024-09-12T00:37:34.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.670+0000 7f123adf99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.670+0000 7f123adf99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:34.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.670+0000 7f123adf99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.671 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.670+0000 7f123adf99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:34.671 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.670+0000 7f123adf99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.671 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.670+0000 7f123adf99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:34.671 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.670+0000 7f123adf99c0 20 started sync module instance, tier type = 2024-09-12T00:37:34.671 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.670+0000 7f123adf99c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:37:34.686 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.686+0000 7f123adf99c0 20 add_watcher() i=0 2024-09-12T00:37:34.686 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.686+0000 7f123adf99c0 20 add_watcher() i=1 2024-09-12T00:37:34.686 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.686+0000 7f123adf99c0 20 add_watcher() i=2 2024-09-12T00:37:34.686 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.686+0000 7f123adf99c0 20 add_watcher() i=3 2024-09-12T00:37:34.686 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.686+0000 7f123adf99c0 20 add_watcher() i=4 2024-09-12T00:37:34.686 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.686+0000 7f123adf99c0 20 add_watcher() i=5 2024-09-12T00:37:34.686 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.686+0000 7f123adf99c0 20 add_watcher() i=6 2024-09-12T00:37:34.687 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.686+0000 7f123adf99c0 20 add_watcher() i=7 2024-09-12T00:37:34.687 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.686+0000 7f123adf99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:34.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.690+0000 7f10eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:34.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.690+0000 7f123adf99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:34.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.690+0000 7f123adf99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:34.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.690+0000 7f123adf99c0 5 note: GC not initialized 2024-09-12T00:37:34.691 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.690+0000 7f10edfe3640 20 reqs_thread_entry: start 2024-09-12T00:37:34.691 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.690+0000 7f123adf99c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:34.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.690+0000 7f123adf99c0 20 Filter name: none 2024-09-12T00:37:34.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.690+0000 7f105f7fe640 20 reqs_thread_entry: start 2024-09-12T00:37:34.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.690+0000 7f123adf99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.690+0000 7f123adf99c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:37:34.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.690+0000 7f123adf99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.694+0000 7f123adf99c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:37:34.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.694+0000 7f123adf99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:34.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.694+0000 7f123adf99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.694+0000 7f123adf99c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:37:34.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.694+0000 7f123adf99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.696 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.694+0000 7f123adf99c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:37:34.696 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.694+0000 7f123adf99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:34.699 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.698+0000 7f10eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:34.706 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.706+0000 7f123adf99c0 20 remove_watcher() i=0 2024-09-12T00:37:34.707 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.706+0000 7f123adf99c0 2 removed watcher, disabling cache 2024-09-12T00:37:34.709 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.710+0000 7f123adf99c0 20 remove_watcher() i=1 2024-09-12T00:37:34.711 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.710+0000 7f123adf99c0 20 remove_watcher() i=2 2024-09-12T00:37:34.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.714+0000 7f123adf99c0 20 remove_watcher() i=3 2024-09-12T00:37:34.715 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.714+0000 7f123adf99c0 20 remove_watcher() i=4 2024-09-12T00:37:34.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.718+0000 7f123adf99c0 20 remove_watcher() i=5 2024-09-12T00:37:34.718 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.718+0000 7f123adf99c0 20 remove_watcher() i=6 2024-09-12T00:37:34.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.718+0000 7f123adf99c0 20 remove_watcher() i=7 2024-09-12T00:37:34.734 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:34.734 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:37:34.734 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-trim-reshard-log-entries id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:37:34.734 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:34.734 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-12T00:37:34.766 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:34.766 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:34.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.806+0000 7fc9fc9d09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.810+0000 7fc9fc9d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:34.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.810+0000 7fc9fc9d09c0 20 realm 2024-09-12T00:37:34.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.810+0000 7fc9fc9d09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.810+0000 7fc9fc9d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:34.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.810+0000 7fc9fc9d09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:34.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.810+0000 7fc9fc9d09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.810+0000 7fc9fc9d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:34.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.810+0000 7fc9fc9d09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.812 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.810+0000 7fc9fc9d09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:34.812 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.810+0000 7fc9fc9d09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.814+0000 7fc9fc9d09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:34.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.814+0000 7fc9fc9d09c0 20 searching for the correct realm 2024-09-12T00:37:34.818 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.818+0000 7fc9facd7640 0 -- 172.21.15.43:0/2716837350 >> [v2:172.21.15.43:6808/2258408181,v1:172.21.15.43:6809/2258408181] conn(0x55bbe2e50370 msgr2=0x55bbe2e52830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:34.824 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.822+0000 7fc9fa4d6640 0 -- 172.21.15.43:0/2716837350 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fc9f0033910 msgr2=0x7fc9f0008430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:34.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.830+0000 7fc9fc9d09c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:37:34.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.830+0000 7fc9fc9d09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:34.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.830+0000 7fc9fc9d09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:34.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.830+0000 7fc9fc9d09c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:37:34.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.830+0000 7fc9fc9d09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:34.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.830+0000 7fc9fc9d09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:34.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.830+0000 7fc9fc9d09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.830+0000 7fc9fc9d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:34.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.830+0000 7fc9fc9d09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.830+0000 7fc9fc9d09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:34.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.830+0000 7fc9fc9d09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.834+0000 7fc9fc9d09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:34.834 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.834+0000 7fc9fc9d09c0 20 zone default found 2024-09-12T00:37:34.834 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.834+0000 7fc9fc9d09c0 4 Realm: () 2024-09-12T00:37:34.834 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.834+0000 7fc9fc9d09c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:37:34.834 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.834+0000 7fc9fc9d09c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:37:34.834 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.834+0000 7fc9fc9d09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:34.834 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.834+0000 7fc9fc9d09c0 20 zonegroup default 2024-09-12T00:37:34.834 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.834+0000 7fc9fc9d09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.834 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.834+0000 7fc9fc9d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:34.834 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.834+0000 7fc9fc9d09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.834+0000 7fc9fc9d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:34.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.834+0000 7fc9fc9d09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.834+0000 7fc9fc9d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:34.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.834+0000 7fc9fc9d09c0 20 started sync module instance, tier type = 2024-09-12T00:37:34.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.834+0000 7fc9fc9d09c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:37:34.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.850+0000 7fc9fc9d09c0 20 add_watcher() i=0 2024-09-12T00:37:34.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.850+0000 7fc9fc9d09c0 20 add_watcher() i=1 2024-09-12T00:37:34.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.850+0000 7fc9fc9d09c0 20 add_watcher() i=2 2024-09-12T00:37:34.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.850+0000 7fc9fc9d09c0 20 add_watcher() i=3 2024-09-12T00:37:34.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.850+0000 7fc9fc9d09c0 20 add_watcher() i=4 2024-09-12T00:37:34.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.850+0000 7fc9fc9d09c0 20 add_watcher() i=5 2024-09-12T00:37:34.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.850+0000 7fc9fc9d09c0 20 add_watcher() i=6 2024-09-12T00:37:34.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.850+0000 7fc9fc9d09c0 20 add_watcher() i=7 2024-09-12T00:37:34.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.850+0000 7fc9fc9d09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:34.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.854+0000 7fc8b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:34.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.854+0000 7fc9fc9d09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:34.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.854+0000 7fc9fc9d09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:34.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.854+0000 7fc9fc9d09c0 5 note: GC not initialized 2024-09-12T00:37:34.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.854+0000 7fc82b7fe640 20 reqs_thread_entry: start 2024-09-12T00:37:34.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.854+0000 7fc9fc9d09c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:34.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.854+0000 7fc9fc9d09c0 20 Filter name: none 2024-09-12T00:37:34.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.854+0000 7fc8297fa640 20 reqs_thread_entry: start 2024-09-12T00:37:34.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.854+0000 7fc9fc9d09c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:37:34.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.854+0000 7fc9fc9d09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.854+0000 7fc9fc9d09c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:37:34.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.854+0000 7fc9fc9d09c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:37:34.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.854+0000 7fc9fc9d09c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:37:34.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.854+0000 7fc9fc9d09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 : miss 2024-09-12T00:37:34.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.854+0000 7fc9fc9d09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.858+0000 7fc9fc9d09c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:37:34.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.858+0000 7fc9fc9d09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 info.flags=0x17 2024-09-12T00:37:34.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.858+0000 7fc9fc9d09c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 to cache LRU end 2024-09-12T00:37:34.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.858+0000 7fc9fc9d09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:34.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.858+0000 7fc9fc9d09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:34.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.858+0000 7fc9fc9d09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 2024-09-12T00:37:34.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.870+0000 7fc9fc9d09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 info.flags=0x17 2024-09-12T00:37:34.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.870+0000 7fc9fc9d09c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 to cache LRU end 2024-09-12T00:37:34.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.870+0000 7fc9fc9d09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:34.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.870+0000 7fc9fc9d09c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25, ofs0, ns] 2024-09-12T00:37:34.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.870+0000 7fc8dd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333467 cookie 94265453924080 notifier 6395 bl.length()=939 2024-09-12T00:37:34.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.870+0000 7fc8dd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 info.flags=0x17 2024-09-12T00:37:34.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.870+0000 7fc8dd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 to cache LRU end 2024-09-12T00:37:34.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.870+0000 7fc8dd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:34.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.870+0000 7fc9fc9d09c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25]): orig_sources= new_sources= 2024-09-12T00:37:34.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.870+0000 7fc9fc9d09c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25]): potential sources added=[] removed=[] 2024-09-12T00:37:34.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.870+0000 7fc9fc9d09c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25]): orig_dests= new_dests= 2024-09-12T00:37:34.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.870+0000 7fc9fc9d09c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25]): potential dests added=[] removed=[] 2024-09-12T00:37:34.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.870+0000 7fc9fc9d09c0 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-12T00:37:34.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.870+0000 7fc9fc9d09c0 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-12T00:37:34.874 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.874+0000 7fc8b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:34.878 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.878+0000 7fc9fc9d09c0 20 remove_watcher() i=0 2024-09-12T00:37:34.878 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.878+0000 7fc9fc9d09c0 2 removed watcher, disabling cache 2024-09-12T00:37:34.880 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.878+0000 7fc9fc9d09c0 20 remove_watcher() i=1 2024-09-12T00:37:34.882 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.882+0000 7fc9fc9d09c0 20 remove_watcher() i=2 2024-09-12T00:37:34.884 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.882+0000 7fc9fc9d09c0 20 remove_watcher() i=3 2024-09-12T00:37:34.886 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.886+0000 7fc9fc9d09c0 20 remove_watcher() i=4 2024-09-12T00:37:34.887 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.886+0000 7fc9fc9d09c0 20 remove_watcher() i=5 2024-09-12T00:37:34.888 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.886+0000 7fc9fc9d09c0 20 remove_watcher() i=6 2024-09-12T00:37:34.889 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.890+0000 7fc9fc9d09c0 20 remove_watcher() i=7 2024-09-12T00:37:34.904 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:37:34.931 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:34.931 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:34.974 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.974+0000 7ff4b9c579c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.976 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.974+0000 7ff4b9c579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:34.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.974+0000 7ff4b9c579c0 20 realm 2024-09-12T00:37:34.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.974+0000 7ff4b9c579c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.974+0000 7ff4b9c579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:34.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.974+0000 7ff4b9c579c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:34.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.974+0000 7ff4b9c579c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.978+0000 7ff4b9c579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:34.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.978+0000 7ff4b9c579c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.979 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.978+0000 7ff4b9c579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:34.979 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.978+0000 7ff4b9c579c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.980 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.978+0000 7ff4b9c579c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:34.980 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.978+0000 7ff4b9c579c0 20 searching for the correct realm 2024-09-12T00:37:34.986 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:34.986+0000 7ff4b7f5e640 0 -- 172.21.15.43:0/3845601633 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7ff4ac0cd040 msgr2=0x7ff4ac0fe2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:37:35.204 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.202+0000 7ff4b775d640 0 -- 172.21.15.43:0/3845601633 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x555a105d6480 msgr2=0x555a105d8940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:35.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.210+0000 7ff4b9c579c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:37:35.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.210+0000 7ff4b9c579c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:35.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.210+0000 7ff4b9c579c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:35.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.210+0000 7ff4b9c579c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:37:35.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.210+0000 7ff4b9c579c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:35.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.210+0000 7ff4b9c579c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:35.212 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.210+0000 7ff4b9c579c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.212 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.210+0000 7ff4b9c579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.212 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.210+0000 7ff4b9c579c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.213 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.210+0000 7ff4b9c579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:35.213 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.210+0000 7ff4b9c579c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.214 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.214+0000 7ff4b9c579c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:35.214 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.214+0000 7ff4b9c579c0 20 zone default found 2024-09-12T00:37:35.214 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.214+0000 7ff4b9c579c0 4 Realm: () 2024-09-12T00:37:35.214 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.214+0000 7ff4b9c579c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:37:35.214 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.214+0000 7ff4b9c579c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:37:35.214 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.214+0000 7ff4b9c579c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:35.214 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.214+0000 7ff4b9c579c0 20 zonegroup default 2024-09-12T00:37:35.214 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.214+0000 7ff4b9c579c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.215 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.214+0000 7ff4b9c579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.215 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.214+0000 7ff4b9c579c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.215 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.214+0000 7ff4b9c579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.215 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.214+0000 7ff4b9c579c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.216 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.214+0000 7ff4b9c579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.216 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.214+0000 7ff4b9c579c0 20 started sync module instance, tier type = 2024-09-12T00:37:35.216 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.214+0000 7ff4b9c579c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:37:35.237 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.238+0000 7ff4b9c579c0 20 add_watcher() i=0 2024-09-12T00:37:35.240 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.238+0000 7ff4b9c579c0 20 add_watcher() i=1 2024-09-12T00:37:35.240 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.238+0000 7ff4b9c579c0 20 add_watcher() i=2 2024-09-12T00:37:35.240 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.238+0000 7ff4b9c579c0 20 add_watcher() i=3 2024-09-12T00:37:35.240 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.238+0000 7ff4b9c579c0 20 add_watcher() i=4 2024-09-12T00:37:35.240 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.238+0000 7ff4b9c579c0 20 add_watcher() i=5 2024-09-12T00:37:35.241 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.238+0000 7ff4b9c579c0 20 add_watcher() i=6 2024-09-12T00:37:35.241 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.238+0000 7ff4b9c579c0 20 add_watcher() i=7 2024-09-12T00:37:35.241 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.238+0000 7ff4b9c579c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:35.243 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.242+0000 7ff36dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:35.244 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.242+0000 7ff4b9c579c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:35.244 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.242+0000 7ff4b9c579c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:35.244 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.242+0000 7ff4b9c579c0 5 note: GC not initialized 2024-09-12T00:37:35.245 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.246+0000 7ff36cfe1640 20 reqs_thread_entry: start 2024-09-12T00:37:35.245 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.246+0000 7ff4b9c579c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:35.245 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.246+0000 7ff4b9c579c0 20 Filter name: none 2024-09-12T00:37:35.246 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.246+0000 7ff2e67fc640 20 reqs_thread_entry: start 2024-09-12T00:37:35.246 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.246+0000 7ff4b9c579c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.247 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.246+0000 7ff4b9c579c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:37:35.247 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.246+0000 7ff4b9c579c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.249 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.246+0000 7ff4b9c579c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:37:35.249 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.246+0000 7ff4b9c579c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:35.249 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.246+0000 7ff4b9c579c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.250 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.250+0000 7ff4b9c579c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:37:35.250 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.250+0000 7ff4b9c579c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.250+0000 7ff4b9c579c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:37:35.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.250+0000 7ff4b9c579c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:35.255 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.254+0000 7ff36dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:35.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.258+0000 7ff4b9c579c0 20 remove_watcher() i=0 2024-09-12T00:37:35.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.258+0000 7ff4b9c579c0 2 removed watcher, disabling cache 2024-09-12T00:37:35.262 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.262+0000 7ff4b9c579c0 20 remove_watcher() i=1 2024-09-12T00:37:35.264 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.262+0000 7ff4b9c579c0 20 remove_watcher() i=2 2024-09-12T00:37:35.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.266+0000 7ff4b9c579c0 20 remove_watcher() i=3 2024-09-12T00:37:35.269 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.270+0000 7ff4b9c579c0 20 remove_watcher() i=4 2024-09-12T00:37:35.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.270+0000 7ff4b9c579c0 20 remove_watcher() i=5 2024-09-12T00:37:35.272 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.270+0000 7ff4b9c579c0 20 remove_watcher() i=6 2024-09-12T00:37:35.274 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.274+0000 7ff4b9c579c0 20 remove_watcher() i=7 2024-09-12T00:37:35.289 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:35.289 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:37:35.290 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-trim-reshard-log-entries id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:37:35.290 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:35.291 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:35.291 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:35.304 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:35.304 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:35.350 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:37:35.381 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:35.381 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:35.638 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.638+0000 7f27d41de9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.640 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.638+0000 7f27d41de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.640 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.638+0000 7f27d41de9c0 20 realm 2024-09-12T00:37:35.640 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.638+0000 7f27d41de9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.640 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.638+0000 7f27d41de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.640 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.638+0000 7f27d41de9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:35.640 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.638+0000 7f27d41de9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.641 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.638+0000 7f27d41de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.641 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.638+0000 7f27d41de9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.642 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.642+0000 7f27d41de9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:35.642 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.642+0000 7f27d41de9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.643 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.642+0000 7f27d41de9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:35.643 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.642+0000 7f27d41de9c0 20 searching for the correct realm 2024-09-12T00:37:35.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.650+0000 7f27d24e5640 0 -- 172.21.15.43:0/52957980 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x563892568010 msgr2=0x56389256a4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:35.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.654+0000 7f27d14e3640 0 -- 172.21.15.43:0/52957980 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f27c8042920 msgr2=0x7f27c801a400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:35.664 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.662+0000 7f27d41de9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:37:35.664 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.662+0000 7f27d41de9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:35.664 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.662+0000 7f27d41de9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:35.664 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.662+0000 7f27d41de9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:37:35.665 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.662+0000 7f27d41de9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:35.665 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.662+0000 7f27d41de9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:35.665 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.662+0000 7f27d41de9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.665 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.662+0000 7f27d41de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.665 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.662+0000 7f27d41de9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.665 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.666+0000 7f27d41de9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:35.666 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.666+0000 7f27d41de9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.666 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.666+0000 7f27d41de9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:35.666 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.666+0000 7f27d41de9c0 20 zone default found 2024-09-12T00:37:35.666 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.666+0000 7f27d41de9c0 4 Realm: () 2024-09-12T00:37:35.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.666+0000 7f27d41de9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:37:35.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.666+0000 7f27d41de9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:37:35.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.666+0000 7f27d41de9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:35.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.666+0000 7f27d41de9c0 20 zonegroup default 2024-09-12T00:37:35.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.666+0000 7f27d41de9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.666+0000 7f27d41de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.666+0000 7f27d41de9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.666+0000 7f27d41de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.666+0000 7f27d41de9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.666+0000 7f27d41de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.666+0000 7f27d41de9c0 20 started sync module instance, tier type = 2024-09-12T00:37:35.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.666+0000 7f27d41de9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:37:35.685 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.686+0000 7f27d41de9c0 20 add_watcher() i=0 2024-09-12T00:37:35.685 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.686+0000 7f27d41de9c0 20 add_watcher() i=1 2024-09-12T00:37:35.685 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.686+0000 7f27d41de9c0 20 add_watcher() i=2 2024-09-12T00:37:35.685 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.686+0000 7f27d41de9c0 20 add_watcher() i=3 2024-09-12T00:37:35.685 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.686+0000 7f27d41de9c0 20 add_watcher() i=4 2024-09-12T00:37:35.685 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.686+0000 7f27d41de9c0 20 add_watcher() i=5 2024-09-12T00:37:35.686 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.686+0000 7f27d41de9c0 20 add_watcher() i=6 2024-09-12T00:37:35.686 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.686+0000 7f27d41de9c0 20 add_watcher() i=7 2024-09-12T00:37:35.686 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.686+0000 7f27d41de9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:35.689 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.690+0000 7f26837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:35.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.690+0000 7f27d41de9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:35.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.690+0000 7f27d41de9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:35.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.690+0000 7f27d41de9c0 5 note: GC not initialized 2024-09-12T00:37:35.691 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.690+0000 7f26827fc640 20 reqs_thread_entry: start 2024-09-12T00:37:35.691 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.690+0000 7f27d41de9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:35.691 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.690+0000 7f27d41de9c0 20 Filter name: none 2024-09-12T00:37:35.691 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.690+0000 7f25f3fff640 20 reqs_thread_entry: start 2024-09-12T00:37:35.691 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.690+0000 7f27d41de9c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:37:35.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.690+0000 7f27d41de9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.690+0000 7f27d41de9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:37:35.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.690+0000 7f27d41de9c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:37:35.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.690+0000 7f27d41de9c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:37:35.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.690+0000 7f27d41de9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 : miss 2024-09-12T00:37:35.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.690+0000 7f27d41de9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.694+0000 7f27d41de9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:37:35.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.694+0000 7f27d41de9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 info.flags=0x17 2024-09-12T00:37:35.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.694+0000 7f27d41de9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 to cache LRU end 2024-09-12T00:37:35.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.694+0000 7f27d41de9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:35.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.694+0000 7f27d41de9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:35.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.694+0000 7f27d41de9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 2024-09-12T00:37:35.697 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.698+0000 7f27d41de9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:37:35.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.714+0000 7f27d41de9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 info.flags=0x17 2024-09-12T00:37:35.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.714+0000 7f27d41de9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 to cache LRU end 2024-09-12T00:37:35.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.714+0000 7f27d41de9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:35.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.714+0000 7f27d41de9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25, ofs0, ns] 2024-09-12T00:37:35.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.714+0000 7f26b57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333468 cookie 94800973373056 notifier 6425 bl.length()=939 2024-09-12T00:37:35.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.714+0000 7f26b57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 info.flags=0x17 2024-09-12T00:37:35.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.714+0000 7f26b57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 to cache LRU end 2024-09-12T00:37:35.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.714+0000 7f26b57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:35.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.714+0000 7f27d41de9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25]): orig_sources= new_sources= 2024-09-12T00:37:35.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.714+0000 7f27d41de9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25]): potential sources added=[] removed=[] 2024-09-12T00:37:35.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.714+0000 7f27d41de9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25]): orig_dests= new_dests= 2024-09-12T00:37:35.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.714+0000 7f27d41de9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25]): potential dests added=[] removed=[] 2024-09-12T00:37:35.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.722+0000 7f27d41de9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.2.0 2024-09-12T00:37:35.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.722+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.2.0 2024-09-12T00:37:35.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.722+0000 7f27d41de9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.2.1 2024-09-12T00:37:35.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.722+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.2.1 2024-09-12T00:37:35.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.722+0000 7f27d41de9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.2.2 2024-09-12T00:37:35.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.722+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.2.2 2024-09-12T00:37:35.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.722+0000 7f27d41de9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.2.3 2024-09-12T00:37:35.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.722+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.2.3 2024-09-12T00:37:35.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.722+0000 7f27d41de9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.2.4 2024-09-12T00:37:35.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.722+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.2.4 2024-09-12T00:37:35.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.722+0000 7f27d41de9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.2.5 2024-09-12T00:37:35.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.722+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.2.5 2024-09-12T00:37:35.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.722+0000 7f27d41de9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.2.6 2024-09-12T00:37:35.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.722+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.2.6 2024-09-12T00:37:35.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.722+0000 7f27d41de9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.2.7 2024-09-12T00:37:35.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.722+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.2.7 2024-09-12T00:37:35.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.722+0000 7f27d41de9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.2.8 2024-09-12T00:37:35.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.722+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.2.8 2024-09-12T00:37:35.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.722+0000 7f27d41de9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.2.9 2024-09-12T00:37:35.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.722+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.2.9 2024-09-12T00:37:35.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.722+0000 7f27d41de9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.2.10 2024-09-12T00:37:35.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.722+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.2.10 2024-09-12T00:37:35.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.722+0000 7f27d41de9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.2.11 2024-09-12T00:37:35.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.722+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.2.11 2024-09-12T00:37:35.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.722+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.0 2024-09-12T00:37:35.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.722+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.1 2024-09-12T00:37:35.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.726+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.2 2024-09-12T00:37:35.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.726+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.3 2024-09-12T00:37:35.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.726+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.4 2024-09-12T00:37:35.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.730+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.5 2024-09-12T00:37:35.730 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.730+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.6 2024-09-12T00:37:35.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.730+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.7 2024-09-12T00:37:35.732 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.730+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.8 2024-09-12T00:37:35.733 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.734+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.9 2024-09-12T00:37:35.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.734+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.10 2024-09-12T00:37:35.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.742+0000 7f27d41de9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 : hit (requested=0x17, cached=0x17) 2024-09-12T00:37:35.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.742+0000 7f27d41de9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 2024-09-12T00:37:35.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.742+0000 7f27d41de9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 info.flags=0x17 2024-09-12T00:37:35.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.742+0000 7f27d41de9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 to cache LRU end 2024-09-12T00:37:35.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.742+0000 7f27d41de9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:35.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.742+0000 7f27d41de9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25, ofs0, ns] 2024-09-12T00:37:35.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.746+0000 7f26b57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333469 cookie 94800973373056 notifier 6425 bl.length()=939 2024-09-12T00:37:35.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.746+0000 7f26b57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 info.flags=0x17 2024-09-12T00:37:35.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.746+0000 7f26b57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 to cache LRU end 2024-09-12T00:37:35.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.746+0000 7f26b57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:35.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.746+0000 7f27d41de9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25]): orig_sources= new_sources= 2024-09-12T00:37:35.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.746+0000 7f27d41de9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25]): potential sources added=[] removed=[] 2024-09-12T00:37:35.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.746+0000 7f27d41de9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25]): orig_dests= new_dests= 2024-09-12T00:37:35.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.746+0000 7f27d41de9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25]): potential dests added=[] removed=[] 2024-09-12T00:37:35.750 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.750+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.0 2024-09-12T00:37:35.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.750+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.1 2024-09-12T00:37:35.752 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.750+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.2 2024-09-12T00:37:35.752 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.750+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.3 2024-09-12T00:37:35.753 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.754+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.4 2024-09-12T00:37:35.754 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.754+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.5 2024-09-12T00:37:35.755 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.754+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.6 2024-09-12T00:37:35.755 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.754+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.7 2024-09-12T00:37:35.756 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.754+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.8 2024-09-12T00:37:35.757 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.754+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.9 2024-09-12T00:37:35.757 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.758+0000 7f27d41de9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25.10 2024-09-12T00:37:35.758 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.758+0000 7f27d41de9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 : hit (requested=0x17, cached=0x17) 2024-09-12T00:37:35.758 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.758+0000 7f27d41de9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 2024-09-12T00:37:35.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.758+0000 7f27d41de9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 info.flags=0x17 2024-09-12T00:37:35.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.758+0000 7f27d41de9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 to cache LRU end 2024-09-12T00:37:35.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.758+0000 7f27d41de9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:35.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.758+0000 7f27d41de9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25, ofs0, ns] 2024-09-12T00:37:35.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.762+0000 7f26b57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333470 cookie 94800973373056 notifier 6425 bl.length()=907 2024-09-12T00:37:35.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.762+0000 7f26b57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 info.flags=0x17 2024-09-12T00:37:35.762 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.762+0000 7f26b57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 to cache LRU end 2024-09-12T00:37:35.762 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.762+0000 7f26b57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:35.762 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.762+0000 7f27d41de9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25]): orig_sources= new_sources= 2024-09-12T00:37:35.762 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.762+0000 7f27d41de9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25]): potential sources added=[] removed=[] 2024-09-12T00:37:35.762 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.762+0000 7f27d41de9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25]): orig_dests= new_dests= 2024-09-12T00:37:35.762 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.762+0000 7f27d41de9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25]): potential dests added=[] removed=[] 2024-09-12T00:37:35.767 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.766+0000 7f27d41de9c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T00:37:35.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.770+0000 7f26837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:35.776 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.774+0000 7f27d41de9c0 20 remove_watcher() i=0 2024-09-12T00:37:35.776 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.774+0000 7f27d41de9c0 2 removed watcher, disabling cache 2024-09-12T00:37:35.778 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.778+0000 7f27d41de9c0 20 remove_watcher() i=1 2024-09-12T00:37:35.781 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.778+0000 7f27d41de9c0 20 remove_watcher() i=2 2024-09-12T00:37:35.783 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.782+0000 7f27d41de9c0 20 remove_watcher() i=3 2024-09-12T00:37:35.785 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.786+0000 7f27d41de9c0 20 remove_watcher() i=4 2024-09-12T00:37:35.788 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.786+0000 7f27d41de9c0 20 remove_watcher() i=5 2024-09-12T00:37:35.789 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.790+0000 7f27d41de9c0 20 remove_watcher() i=6 2024-09-12T00:37:35.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.790+0000 7f27d41de9c0 20 remove_watcher() i=7 2024-09-12T00:37:35.807 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:37:35.838 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:35.838 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:35.882 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.882+0000 7efc518479c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.884 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.882+0000 7efc518479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.884 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.882+0000 7efc518479c0 20 realm 2024-09-12T00:37:35.885 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.882+0000 7efc518479c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.885 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.882+0000 7efc518479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.885 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.882+0000 7efc518479c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:35.885 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.882+0000 7efc518479c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.885 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.882+0000 7efc518479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.885 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.882+0000 7efc518479c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.887 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.886+0000 7efc518479c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:35.887 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.886+0000 7efc518479c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.888 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.886+0000 7efc518479c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:35.888 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.886+0000 7efc518479c0 20 searching for the correct realm 2024-09-12T00:37:35.890 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.890+0000 7efc4eb4c640 0 -- 172.21.15.43:0/2197157166 >> [v2:172.21.15.43:6816/653473197,v1:172.21.15.43:6817/653473197] conn(0x56273a85b300 msgr2=0x56273a85d6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:35.897 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.898+0000 7efc4eb4c640 0 -- 172.21.15.43:0/2197157166 >> [v2:172.21.15.43:6816/653473197,v1:172.21.15.43:6817/653473197] conn(0x7efb18080b80 msgr2=0x7efb18082fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:35.907 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.906+0000 7efc518479c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:37:35.908 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.906+0000 7efc518479c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:35.908 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.906+0000 7efc518479c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:35.908 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.906+0000 7efc518479c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:37:35.908 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.906+0000 7efc518479c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:35.908 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.906+0000 7efc518479c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:35.908 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.906+0000 7efc518479c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.908 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.906+0000 7efc518479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.908 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.906+0000 7efc518479c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.909 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.906+0000 7efc518479c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:35.909 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.906+0000 7efc518479c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.909 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.906+0000 7efc518479c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:35.909 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.906+0000 7efc518479c0 20 zone default found 2024-09-12T00:37:35.909 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.906+0000 7efc518479c0 4 Realm: () 2024-09-12T00:37:35.909 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.906+0000 7efc518479c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:37:35.909 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.906+0000 7efc518479c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:37:35.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.906+0000 7efc518479c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:35.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.906+0000 7efc518479c0 20 zonegroup default 2024-09-12T00:37:35.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.906+0000 7efc518479c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.910+0000 7efc518479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.910+0000 7efc518479c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.910+0000 7efc518479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.910+0000 7efc518479c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.910+0000 7efc518479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.910+0000 7efc518479c0 20 started sync module instance, tier type = 2024-09-12T00:37:35.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.910+0000 7efc518479c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:37:35.925 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.926+0000 7efc518479c0 20 add_watcher() i=0 2024-09-12T00:37:35.926 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.926+0000 7efc518479c0 20 add_watcher() i=1 2024-09-12T00:37:35.926 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.926+0000 7efc518479c0 20 add_watcher() i=2 2024-09-12T00:37:35.926 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.926+0000 7efc518479c0 20 add_watcher() i=3 2024-09-12T00:37:35.926 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.926+0000 7efc518479c0 20 add_watcher() i=4 2024-09-12T00:37:35.926 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.926+0000 7efc518479c0 20 add_watcher() i=5 2024-09-12T00:37:35.926 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.926+0000 7efc518479c0 20 add_watcher() i=6 2024-09-12T00:37:35.926 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.926+0000 7efc518479c0 20 add_watcher() i=7 2024-09-12T00:37:35.927 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.926+0000 7efc518479c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:35.929 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.930+0000 7efb05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:35.930 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.930+0000 7efc518479c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:35.930 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.930+0000 7efc518479c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:35.930 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.930+0000 7efc518479c0 5 note: GC not initialized 2024-09-12T00:37:35.931 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.930+0000 7efb04fe1640 20 reqs_thread_entry: start 2024-09-12T00:37:35.931 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.930+0000 7efc518479c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:35.931 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.930+0000 7efc518479c0 20 Filter name: none 2024-09-12T00:37:35.931 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.930+0000 7efa7e7fc640 20 reqs_thread_entry: start 2024-09-12T00:37:35.931 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.930+0000 7efc518479c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.931 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.930+0000 7efc518479c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:37:35.932 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.930+0000 7efc518479c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.933 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.934+0000 7efc518479c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:37:35.933 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.934+0000 7efc518479c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:35.933 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.934+0000 7efc518479c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.934 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.934+0000 7efc518479c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:37:35.934 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.934+0000 7efc518479c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.935 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.934+0000 7efc518479c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:37:35.935 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.934+0000 7efc518479c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:35.938 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.938+0000 7efb05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:35.943 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.942+0000 7efc518479c0 20 remove_watcher() i=0 2024-09-12T00:37:35.943 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.942+0000 7efc518479c0 2 removed watcher, disabling cache 2024-09-12T00:37:35.945 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.946+0000 7efc518479c0 20 remove_watcher() i=1 2024-09-12T00:37:35.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.946+0000 7efc518479c0 20 remove_watcher() i=2 2024-09-12T00:37:35.949 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.950+0000 7efc518479c0 20 remove_watcher() i=3 2024-09-12T00:37:35.951 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.950+0000 7efc518479c0 20 remove_watcher() i=4 2024-09-12T00:37:35.952 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.950+0000 7efc518479c0 20 remove_watcher() i=5 2024-09-12T00:37:35.953 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.954+0000 7efc518479c0 20 remove_watcher() i=6 2024-09-12T00:37:35.955 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:35.954+0000 7efc518479c0 20 remove_watcher() i=7 2024-09-12T00:37:35.969 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:35.969 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:37:35.969 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-trim-reshard-log-entries id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:37:35.969 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:35.970 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:35.970 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:35.973 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:35.974 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:36.019 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:36.019 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:36.069 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-12T00:37:36.069 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:36.070 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:36.070 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:36.087 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:36.087 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:36.131 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:36.131 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:36.148 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:36.148 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:36.166 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:36.167 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:36.185 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:36.185 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:36.203 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:36.203 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:36.221 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:36.221 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:36.240 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:36.240 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:36.257 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:36.258 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:36.278 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:36.278 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:36.297 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:36.297 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:36.315 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:36.315 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:36.334 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:36.334 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:36.352 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:36.352 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:36.370 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:36.370 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:36.388 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:36.388 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:36.406 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:36.406 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:36.423 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:36.424 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:36.442 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:36.442 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:36.461 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:36.461 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:36.479 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:36.479 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:36.495 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:37:36.529 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:36.529 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:36.756 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:36.758+0000 7f745e155640 0 --2- 172.21.15.43:0/3011497860 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555d1e9e99b0 0x555d1eb63810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:37:36.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:36.790+0000 7f7460e509c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:36.794+0000 7f7460e509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:36.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:36.794+0000 7f7460e509c0 20 realm 2024-09-12T00:37:36.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:36.794+0000 7f7460e509c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:36.794+0000 7f7460e509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:36.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:36.794+0000 7f7460e509c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:36.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:36.794+0000 7f7460e509c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:36.794+0000 7f7460e509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:36.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:36.794+0000 7f7460e509c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.796 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:36.794+0000 7f7460e509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:36.796 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:36.794+0000 7f7460e509c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:36.794+0000 7f7460e509c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:36.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:36.798+0000 7f7460e509c0 20 searching for the correct realm 2024-09-12T00:37:36.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:36.798+0000 7f745e155640 0 -- 172.21.15.43:0/2777132270 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f744806e140 msgr2=0x7f74480640c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:37.014 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.014+0000 7f745e956640 0 -- 172.21.15.43:0/2777132270 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f744807abc0 msgr2=0x7f744806e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:37.231 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.230+0000 7f7460e509c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:37:37.231 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.230+0000 7f7460e509c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:37.231 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.230+0000 7f7460e509c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:37.231 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.230+0000 7f7460e509c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:37:37.231 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.230+0000 7f7460e509c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:37.232 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.230+0000 7f7460e509c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:37.232 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.230+0000 7f7460e509c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.232 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.230+0000 7f7460e509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:37.232 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.230+0000 7f7460e509c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.232 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.230+0000 7f7460e509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:37.232 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.230+0000 7f7460e509c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.234+0000 7f7460e509c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:37.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.234+0000 7f7460e509c0 20 zone default found 2024-09-12T00:37:37.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.234+0000 7f7460e509c0 4 Realm: () 2024-09-12T00:37:37.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.234+0000 7f7460e509c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:37:37.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.234+0000 7f7460e509c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:37:37.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.234+0000 7f7460e509c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:37.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.234+0000 7f7460e509c0 20 zonegroup default 2024-09-12T00:37:37.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.234+0000 7f7460e509c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.234+0000 7f7460e509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:37.235 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.234+0000 7f7460e509c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.235 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.234+0000 7f7460e509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:37.235 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.234+0000 7f7460e509c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.234+0000 7f7460e509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:37.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.234+0000 7f7460e509c0 20 started sync module instance, tier type = 2024-09-12T00:37:37.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.234+0000 7f7460e509c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:37:37.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.258+0000 7f7460e509c0 20 add_watcher() i=0 2024-09-12T00:37:37.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.258+0000 7f7460e509c0 20 add_watcher() i=1 2024-09-12T00:37:37.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.258+0000 7f7460e509c0 20 add_watcher() i=2 2024-09-12T00:37:37.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.258+0000 7f7460e509c0 20 add_watcher() i=3 2024-09-12T00:37:37.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.258+0000 7f7460e509c0 20 add_watcher() i=4 2024-09-12T00:37:37.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.258+0000 7f7460e509c0 20 add_watcher() i=5 2024-09-12T00:37:37.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.258+0000 7f7460e509c0 20 add_watcher() i=6 2024-09-12T00:37:37.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.262+0000 7f7460e509c0 20 add_watcher() i=7 2024-09-12T00:37:37.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.262+0000 7f7460e509c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:37.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.266+0000 7f73157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:37.266 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.266+0000 7f7460e509c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:37.266 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.266+0000 7f7460e509c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:37.266 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.266+0000 7f7460e509c0 5 note: GC not initialized 2024-09-12T00:37:37.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.266+0000 7f728ffff640 20 reqs_thread_entry: start 2024-09-12T00:37:37.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.266+0000 7f7460e509c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:37.268 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.266+0000 7f7460e509c0 20 Filter name: none 2024-09-12T00:37:37.268 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.266+0000 7f728dffb640 20 reqs_thread_entry: start 2024-09-12T00:37:37.268 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.266+0000 7f7460e509c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.269 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.270+0000 7f7460e509c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:37:37.269 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.270+0000 7f7460e509c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.270 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.270+0000 7f7460e509c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:37:37.270 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.270+0000 7f7460e509c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:37.270 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.270+0000 7f7460e509c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.270+0000 7f7460e509c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:37:37.272 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.270+0000 7f7460e509c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.272 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.270+0000 7f7460e509c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:37:37.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.270+0000 7f7460e509c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:37.275 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.274+0000 7f73157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:37.280 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.278+0000 7f7460e509c0 20 remove_watcher() i=0 2024-09-12T00:37:37.281 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.278+0000 7f7460e509c0 2 removed watcher, disabling cache 2024-09-12T00:37:37.283 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.282+0000 7f7460e509c0 20 remove_watcher() i=1 2024-09-12T00:37:37.285 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.286+0000 7f7460e509c0 20 remove_watcher() i=2 2024-09-12T00:37:37.289 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.286+0000 7f7460e509c0 20 remove_watcher() i=3 2024-09-12T00:37:37.289 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.290+0000 7f7460e509c0 20 remove_watcher() i=4 2024-09-12T00:37:37.291 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.290+0000 7f7460e509c0 20 remove_watcher() i=5 2024-09-12T00:37:37.292 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.290+0000 7f7460e509c0 20 remove_watcher() i=6 2024-09-12T00:37:37.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.294+0000 7f7460e509c0 20 remove_watcher() i=7 2024-09-12T00:37:37.309 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:37.309 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:37:37.309 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-trim-reshard-log-entries id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:37:37.309 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:37.309 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-12T00:37:37.345 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:37.345 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:37.388 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.386+0000 7f0224a279c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.389 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.390+0000 7f0224a279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:37.390 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.390+0000 7f0224a279c0 20 realm 2024-09-12T00:37:37.390 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.390+0000 7f0224a279c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.390 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.390+0000 7f0224a279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:37.390 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.390+0000 7f0224a279c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:37.390 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.390+0000 7f0224a279c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.390 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.390+0000 7f0224a279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:37.390 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.390+0000 7f0224a279c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.391 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.390+0000 7f0224a279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:37.391 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.390+0000 7f0224a279c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.392 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.390+0000 7f0224a279c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:37.392 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.390+0000 7f0224a279c0 20 searching for the correct realm 2024-09-12T00:37:37.398 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.398+0000 7f0222d2e640 0 -- 172.21.15.43:0/657563820 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x560db5e3af20 msgr2=0x560db5e3d3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:37.404 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.402+0000 7f022252d640 0 -- 172.21.15.43:0/657563820 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f0218038b60 msgr2=0x7f0218064450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:37.412 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.410+0000 7f0224a279c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:37:37.412 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.410+0000 7f0224a279c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:37.412 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.410+0000 7f0224a279c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:37.412 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.410+0000 7f0224a279c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:37:37.412 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.410+0000 7f0224a279c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:37.412 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.410+0000 7f0224a279c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:37.412 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.410+0000 7f0224a279c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.412 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.410+0000 7f0224a279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:37.412 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.410+0000 7f0224a279c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.413 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.414+0000 7f0224a279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:37.414 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.414+0000 7f0224a279c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.414 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.414+0000 7f0224a279c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:37.414 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.414+0000 7f0224a279c0 20 zone default found 2024-09-12T00:37:37.414 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.414+0000 7f0224a279c0 4 Realm: () 2024-09-12T00:37:37.414 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.414+0000 7f0224a279c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:37:37.414 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.414+0000 7f0224a279c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:37:37.414 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.414+0000 7f0224a279c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:37.414 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.414+0000 7f0224a279c0 20 zonegroup default 2024-09-12T00:37:37.414 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.414+0000 7f0224a279c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.414 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.414+0000 7f0224a279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:37.414 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.414+0000 7f0224a279c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.415 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.414+0000 7f0224a279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:37.415 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.414+0000 7f0224a279c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.415 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.414+0000 7f0224a279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:37.415 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.414+0000 7f0224a279c0 20 started sync module instance, tier type = 2024-09-12T00:37:37.415 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.414+0000 7f0224a279c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:37:37.430 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.430+0000 7f0224a279c0 20 add_watcher() i=0 2024-09-12T00:37:37.430 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.430+0000 7f0224a279c0 20 add_watcher() i=1 2024-09-12T00:37:37.430 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.430+0000 7f0224a279c0 20 add_watcher() i=2 2024-09-12T00:37:37.431 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.430+0000 7f0224a279c0 20 add_watcher() i=3 2024-09-12T00:37:37.431 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.430+0000 7f0224a279c0 20 add_watcher() i=4 2024-09-12T00:37:37.431 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.430+0000 7f0224a279c0 20 add_watcher() i=5 2024-09-12T00:37:37.431 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.430+0000 7f0224a279c0 20 add_watcher() i=6 2024-09-12T00:37:37.431 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.430+0000 7f0224a279c0 20 add_watcher() i=7 2024-09-12T00:37:37.431 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.430+0000 7f0224a279c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:37.434 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.434+0000 7f00d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:37.435 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.434+0000 7f0224a279c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:37.435 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.434+0000 7f0224a279c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:37.435 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.434+0000 7f0224a279c0 5 note: GC not initialized 2024-09-12T00:37:37.435 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.434+0000 7f00537fe640 20 reqs_thread_entry: start 2024-09-12T00:37:37.435 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.434+0000 7f0224a279c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:37.435 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.434+0000 7f0224a279c0 20 Filter name: none 2024-09-12T00:37:37.435 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.434+0000 7f00517fa640 20 reqs_thread_entry: start 2024-09-12T00:37:37.435 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.434+0000 7f0224a279c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:37:37.435 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.434+0000 7f0224a279c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.436 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.434+0000 7f0224a279c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:37:37.436 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.434+0000 7f0224a279c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:37:37.436 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.434+0000 7f0224a279c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:37:37.436 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.434+0000 7f0224a279c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26 : miss 2024-09-12T00:37:37.436 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.434+0000 7f0224a279c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.437 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.434+0000 7f0224a279c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:37:37.437 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.434+0000 7f0224a279c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26 info.flags=0x17 2024-09-12T00:37:37.437 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.434+0000 7f0224a279c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26 to cache LRU end 2024-09-12T00:37:37.437 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.434+0000 7f0224a279c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:37.437 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.434+0000 7f0224a279c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:37.437 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.434+0000 7f0224a279c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26 2024-09-12T00:37:37.447 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.446+0000 7f0224a279c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26 info.flags=0x17 2024-09-12T00:37:37.447 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.446+0000 7f0224a279c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26 to cache LRU end 2024-09-12T00:37:37.447 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.446+0000 7f0224a279c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:37.447 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.446+0000 7f0224a279c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26, ofs0, ns] 2024-09-12T00:37:37.448 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.446+0000 7f01057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333475 cookie 94616886231664 notifier 6765 bl.length()=939 2024-09-12T00:37:37.448 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.446+0000 7f01057fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26 info.flags=0x17 2024-09-12T00:37:37.448 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.446+0000 7f01057fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26 to cache LRU end 2024-09-12T00:37:37.448 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.446+0000 7f01057fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:37.448 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.446+0000 7f0224a279c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26]): orig_sources= new_sources= 2024-09-12T00:37:37.448 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.446+0000 7f0224a279c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26]): potential sources added=[] removed=[] 2024-09-12T00:37:37.448 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.446+0000 7f0224a279c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26]): orig_dests= new_dests= 2024-09-12T00:37:37.449 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.446+0000 7f0224a279c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26]): potential dests added=[] removed=[] 2024-09-12T00:37:37.449 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.446+0000 7f0224a279c0 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-12T00:37:37.449 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.446+0000 7f0224a279c0 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-12T00:37:37.452 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.450+0000 7f0224a279c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.1.0 2024-09-12T00:37:37.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.450+0000 7f0224a279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.1.0 2024-09-12T00:37:37.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.450+0000 7f0224a279c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.1.1 2024-09-12T00:37:37.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.450+0000 7f0224a279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.1.1 2024-09-12T00:37:37.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.450+0000 7f0224a279c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.1.2 2024-09-12T00:37:37.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.450+0000 7f0224a279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.1.2 2024-09-12T00:37:37.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.450+0000 7f0224a279c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.1.3 2024-09-12T00:37:37.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.450+0000 7f0224a279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.1.3 2024-09-12T00:37:37.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.450+0000 7f0224a279c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.1.4 2024-09-12T00:37:37.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.450+0000 7f0224a279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.1.4 2024-09-12T00:37:37.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.450+0000 7f0224a279c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.1.5 2024-09-12T00:37:37.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.450+0000 7f0224a279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.1.5 2024-09-12T00:37:37.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.450+0000 7f0224a279c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.1.6 2024-09-12T00:37:37.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.450+0000 7f0224a279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.1.6 2024-09-12T00:37:37.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.450+0000 7f0224a279c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.1.7 2024-09-12T00:37:37.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.450+0000 7f0224a279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.1.7 2024-09-12T00:37:37.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.450+0000 7f0224a279c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.1.8 2024-09-12T00:37:37.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.450+0000 7f0224a279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.1.8 2024-09-12T00:37:37.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.450+0000 7f0224a279c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.1.9 2024-09-12T00:37:37.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.450+0000 7f0224a279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.1.9 2024-09-12T00:37:37.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.450+0000 7f0224a279c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.1.10 2024-09-12T00:37:37.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.450+0000 7f0224a279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.1.10 2024-09-12T00:37:37.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.450+0000 7f0224a279c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.1.11 2024-09-12T00:37:37.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.450+0000 7f0224a279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.1.11 2024-09-12T00:37:37.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.450+0000 7f0224a279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.0 2024-09-12T00:37:37.455 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.454+0000 7f0224a279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.1 2024-09-12T00:37:37.455 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.454+0000 7f0224a279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.2 2024-09-12T00:37:37.455 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.454+0000 7f0224a279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.3 2024-09-12T00:37:37.456 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.454+0000 7f0224a279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.4 2024-09-12T00:37:37.457 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.458+0000 7f0224a279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.5 2024-09-12T00:37:37.458 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.458+0000 7f0224a279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.6 2024-09-12T00:37:37.458 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.458+0000 7f0224a279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.7 2024-09-12T00:37:37.459 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.458+0000 7f0224a279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.8 2024-09-12T00:37:37.461 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.462+0000 7f0224a279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.9 2024-09-12T00:37:37.462 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.462+0000 7f0224a279c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26.10 2024-09-12T00:37:37.468 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.466+0000 7f0224a279c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26 : hit (requested=0x17, cached=0x17) 2024-09-12T00:37:37.468 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.466+0000 7f0224a279c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26 2024-09-12T00:37:37.469 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.470+0000 7f0224a279c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26 info.flags=0x17 2024-09-12T00:37:37.470 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.470+0000 7f0224a279c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26 to cache LRU end 2024-09-12T00:37:37.470 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.470+0000 7f0224a279c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:37.470 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.470+0000 7f0224a279c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26, ofs0, ns] 2024-09-12T00:37:37.470 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.470+0000 7f01057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333476 cookie 94616886231664 notifier 6765 bl.length()=907 2024-09-12T00:37:37.470 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.470+0000 7f01057fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26 info.flags=0x17 2024-09-12T00:37:37.470 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.470+0000 7f01057fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26 to cache LRU end 2024-09-12T00:37:37.471 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.470+0000 7f01057fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:37.471 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.470+0000 7f0224a279c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26]): orig_sources= new_sources= 2024-09-12T00:37:37.471 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.470+0000 7f0224a279c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26]): potential sources added=[] removed=[] 2024-09-12T00:37:37.471 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.470+0000 7f0224a279c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26]): orig_dests= new_dests= 2024-09-12T00:37:37.471 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.470+0000 7f0224a279c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26]): potential dests added=[] removed=[] 2024-09-12T00:37:37.475 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.474+0000 7f0224a279c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T00:37:37.477 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.478+0000 7f00d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:37.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.482+0000 7f0224a279c0 20 remove_watcher() i=0 2024-09-12T00:37:37.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.482+0000 7f0224a279c0 2 removed watcher, disabling cache 2024-09-12T00:37:37.484 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.482+0000 7f0224a279c0 20 remove_watcher() i=1 2024-09-12T00:37:37.486 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.486+0000 7f0224a279c0 20 remove_watcher() i=2 2024-09-12T00:37:37.488 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.486+0000 7f0224a279c0 20 remove_watcher() i=3 2024-09-12T00:37:37.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.490+0000 7f0224a279c0 20 remove_watcher() i=4 2024-09-12T00:37:37.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.490+0000 7f0224a279c0 20 remove_watcher() i=5 2024-09-12T00:37:37.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.490+0000 7f0224a279c0 20 remove_watcher() i=6 2024-09-12T00:37:37.493 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.494+0000 7f0224a279c0 20 remove_watcher() i=7 2024-09-12T00:37:37.507 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:37:37.534 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:37.534 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:37.578 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.578+0000 7f7411fd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.578+0000 7f7411fd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:37.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.578+0000 7f7411fd29c0 20 realm 2024-09-12T00:37:37.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.578+0000 7f7411fd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.578+0000 7f7411fd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:37.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.578+0000 7f7411fd29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:37.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.578+0000 7f7411fd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.581 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.578+0000 7f7411fd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:37.581 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.578+0000 7f7411fd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.582+0000 7f7411fd29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:37.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.582+0000 7f7411fd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.583 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.582+0000 7f7411fd29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:37.583 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.582+0000 7f7411fd29c0 20 searching for the correct realm 2024-09-12T00:37:37.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.586+0000 7f74102d9640 0 -- 172.21.15.43:0/1450780880 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55658548ca40 msgr2=0x55658548eec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:37.594 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.594+0000 7f740fad8640 0 -- 172.21.15.43:0/1450780880 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f7404049070 msgr2=0x7f7404067460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:37.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.602+0000 7f7411fd29c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:37:37.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.602+0000 7f7411fd29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:37.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.602+0000 7f7411fd29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:37.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.602+0000 7f7411fd29c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:37:37.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.602+0000 7f7411fd29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:37.603 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.602+0000 7f7411fd29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:37.603 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.602+0000 7f7411fd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.603 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.602+0000 7f7411fd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:37.603 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.602+0000 7f7411fd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.602+0000 7f7411fd29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:37.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.602+0000 7f7411fd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.602+0000 7f7411fd29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:37.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.602+0000 7f7411fd29c0 20 zone default found 2024-09-12T00:37:37.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.602+0000 7f7411fd29c0 4 Realm: () 2024-09-12T00:37:37.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.602+0000 7f7411fd29c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:37:37.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.602+0000 7f7411fd29c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:37:37.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.602+0000 7f7411fd29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:37.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.602+0000 7f7411fd29c0 20 zonegroup default 2024-09-12T00:37:37.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.602+0000 7f7411fd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.602+0000 7f7411fd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:37.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.602+0000 7f7411fd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.602+0000 7f7411fd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:37.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.602+0000 7f7411fd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.606+0000 7f7411fd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:37.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.606+0000 7f7411fd29c0 20 started sync module instance, tier type = 2024-09-12T00:37:37.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.606+0000 7f7411fd29c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:37:37.621 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.618+0000 7f7411fd29c0 20 add_watcher() i=0 2024-09-12T00:37:37.621 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.618+0000 7f7411fd29c0 20 add_watcher() i=1 2024-09-12T00:37:37.621 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.618+0000 7f7411fd29c0 20 add_watcher() i=2 2024-09-12T00:37:37.621 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.618+0000 7f7411fd29c0 20 add_watcher() i=3 2024-09-12T00:37:37.621 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.618+0000 7f7411fd29c0 20 add_watcher() i=4 2024-09-12T00:37:37.621 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.618+0000 7f7411fd29c0 20 add_watcher() i=5 2024-09-12T00:37:37.621 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.618+0000 7f7411fd29c0 20 add_watcher() i=6 2024-09-12T00:37:37.622 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.622+0000 7f7411fd29c0 20 add_watcher() i=7 2024-09-12T00:37:37.622 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.622+0000 7f7411fd29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:37.624 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.622+0000 7f72c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:37.625 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.626+0000 7f7411fd29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:37.625 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.626+0000 7f7411fd29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:37.625 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.626+0000 7f7411fd29c0 5 note: GC not initialized 2024-09-12T00:37:37.625 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.626+0000 7f72c4fe1640 20 reqs_thread_entry: start 2024-09-12T00:37:37.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.626+0000 7f7411fd29c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:37.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.626+0000 7f7411fd29c0 20 Filter name: none 2024-09-12T00:37:37.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.626+0000 7f723e7fc640 20 reqs_thread_entry: start 2024-09-12T00:37:37.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.626+0000 7f7411fd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.626+0000 7f7411fd29c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:37:37.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.626+0000 7f7411fd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.626+0000 7f7411fd29c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:37:37.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.626+0000 7f7411fd29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:37.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.626+0000 7f7411fd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.626+0000 7f7411fd29c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:37:37.628 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.626+0000 7f7411fd29c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.628 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.626+0000 7f7411fd29c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:37:37.628 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.626+0000 7f7411fd29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:37.631 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.630+0000 7f72c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:37.636 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.634+0000 7f7411fd29c0 20 remove_watcher() i=0 2024-09-12T00:37:37.636 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.634+0000 7f7411fd29c0 2 removed watcher, disabling cache 2024-09-12T00:37:37.637 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.638+0000 7f7411fd29c0 20 remove_watcher() i=1 2024-09-12T00:37:37.640 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.638+0000 7f7411fd29c0 20 remove_watcher() i=2 2024-09-12T00:37:37.642 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.642+0000 7f7411fd29c0 20 remove_watcher() i=3 2024-09-12T00:37:37.644 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.642+0000 7f7411fd29c0 20 remove_watcher() i=4 2024-09-12T00:37:37.645 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.646+0000 7f7411fd29c0 20 remove_watcher() i=5 2024-09-12T00:37:37.646 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.646+0000 7f7411fd29c0 20 remove_watcher() i=6 2024-09-12T00:37:37.647 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:37.646+0000 7f7411fd29c0 20 remove_watcher() i=7 2024-09-12T00:37:37.661 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:37.661 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:37:37.661 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-trim-reshard-log-entries id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T00:37:37.661 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:37.662 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.662 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:37.665 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.665 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:37.711 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.711 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:37.763 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-12T00:37:37.763 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:37.764 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.764 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:37.784 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.784 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:37.833 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.833 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:37.855 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.856 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:37.875 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.875 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:37.895 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.895 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:37.913 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.914 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:37.934 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.934 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:37.953 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.953 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:37.973 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.973 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:37.993 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.993 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:38.013 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:38.013 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:38.032 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:38.032 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:38.051 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:38.051 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:38.072 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:38.073 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:38.092 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:38.093 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:38.112 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:38.112 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:38.132 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:38.132 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:38.151 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:38.151 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:38.172 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:38.172 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:38.192 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:38.192 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:38.211 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:38.211 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:38.228 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:37:38.261 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:38.262 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:38.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.306+0000 7f02cb77f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.306+0000 7f02cb77f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.306+0000 7f02cb77f9c0 20 realm 2024-09-12T00:37:38.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.306+0000 7f02cb77f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.306+0000 7f02cb77f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.306+0000 7f02cb77f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:38.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.306+0000 7f02cb77f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.306+0000 7f02cb77f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.306+0000 7f02cb77f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.511 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.510+0000 7f02cb77f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:38.511 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.510+0000 7f02cb77f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.512 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.510+0000 7f02cb77f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:38.512 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.510+0000 7f02cb77f9c0 20 searching for the correct realm 2024-09-12T00:37:38.520 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.518+0000 7f02c9a86640 0 -- 172.21.15.43:0/924576249 >> [v2:172.21.15.43:6808/2258408181,v1:172.21.15.43:6809/2258408181] conn(0x55ed1d1e6760 msgr2=0x55ed1d1e8c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:38.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.530+0000 7f02c9285640 0 -- 172.21.15.43:0/924576249 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f02c00c1b90 msgr2=0x7f02c01342b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:38.543 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.542+0000 7f02cb77f9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:37:38.543 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.542+0000 7f02cb77f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:38.543 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.542+0000 7f02cb77f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:38.543 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.542+0000 7f02cb77f9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:37:38.543 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.542+0000 7f02cb77f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:38.543 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.542+0000 7f02cb77f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:38.543 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.542+0000 7f02cb77f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.544 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.542+0000 7f02cb77f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.544 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.542+0000 7f02cb77f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.544 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.542+0000 7f02cb77f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:38.544 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.542+0000 7f02cb77f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.542+0000 7f02cb77f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:38.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.542+0000 7f02cb77f9c0 20 zone default found 2024-09-12T00:37:38.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.542+0000 7f02cb77f9c0 4 Realm: () 2024-09-12T00:37:38.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.542+0000 7f02cb77f9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:37:38.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.542+0000 7f02cb77f9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:37:38.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.542+0000 7f02cb77f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:38.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.542+0000 7f02cb77f9c0 20 zonegroup default 2024-09-12T00:37:38.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.542+0000 7f02cb77f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.546 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.546+0000 7f02cb77f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.546 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.546+0000 7f02cb77f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.546 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.546+0000 7f02cb77f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.546 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.546+0000 7f02cb77f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.546+0000 7f02cb77f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.546+0000 7f02cb77f9c0 20 started sync module instance, tier type = 2024-09-12T00:37:38.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.546+0000 7f02cb77f9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:37:38.569 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.566+0000 7f02cb77f9c0 20 add_watcher() i=0 2024-09-12T00:37:38.569 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.566+0000 7f02cb77f9c0 20 add_watcher() i=1 2024-09-12T00:37:38.569 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.566+0000 7f02cb77f9c0 20 add_watcher() i=2 2024-09-12T00:37:38.569 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.566+0000 7f02cb77f9c0 20 add_watcher() i=3 2024-09-12T00:37:38.569 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.566+0000 7f02cb77f9c0 20 add_watcher() i=4 2024-09-12T00:37:38.569 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.566+0000 7f02cb77f9c0 20 add_watcher() i=5 2024-09-12T00:37:38.569 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.566+0000 7f02cb77f9c0 20 add_watcher() i=6 2024-09-12T00:37:38.571 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.570+0000 7f02cb77f9c0 20 add_watcher() i=7 2024-09-12T00:37:38.571 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.570+0000 7f02cb77f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:38.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.574+0000 7f017ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:38.575 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.574+0000 7f02cb77f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:38.575 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.574+0000 7f02cb77f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:38.575 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.574+0000 7f02cb77f9c0 5 note: GC not initialized 2024-09-12T00:37:38.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.574+0000 7f017efe5640 20 reqs_thread_entry: start 2024-09-12T00:37:38.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.574+0000 7f02cb77f9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:38.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.574+0000 7f02cb77f9c0 20 Filter name: none 2024-09-12T00:37:38.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.574+0000 7f017cfe1640 20 reqs_thread_entry: start 2024-09-12T00:37:38.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.574+0000 7f02cb77f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.577 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.578+0000 7f02cb77f9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:37:38.578 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.578+0000 7f02cb77f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.578 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.578+0000 7f02cb77f9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:37:38.579 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.578+0000 7f02cb77f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:38.579 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.578+0000 7f02cb77f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.579 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.578+0000 7f02cb77f9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:37:38.579 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.578+0000 7f02cb77f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.578+0000 7f02cb77f9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:37:38.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.578+0000 7f02cb77f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:38.583 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.582+0000 7f017ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:38.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.586+0000 7f02cb77f9c0 20 remove_watcher() i=0 2024-09-12T00:37:38.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.586+0000 7f02cb77f9c0 2 removed watcher, disabling cache 2024-09-12T00:37:38.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.590+0000 7f02cb77f9c0 20 remove_watcher() i=1 2024-09-12T00:37:38.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.594+0000 7f02cb77f9c0 20 remove_watcher() i=2 2024-09-12T00:37:38.595 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.594+0000 7f02cb77f9c0 20 remove_watcher() i=3 2024-09-12T00:37:38.597 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.598+0000 7f02cb77f9c0 20 remove_watcher() i=4 2024-09-12T00:37:38.598 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.598+0000 7f02cb77f9c0 20 remove_watcher() i=5 2024-09-12T00:37:38.599 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.598+0000 7f02cb77f9c0 20 remove_watcher() i=6 2024-09-12T00:37:38.601 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.602+0000 7f02cb77f9c0 20 remove_watcher() i=7 2024-09-12T00:37:38.616 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.616 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:37:38.616 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: abort-at-trim-reshard-log-entries id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:37:38.616 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.617 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-12T00:37:38.654 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:38.654 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:38.698 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.698+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.698+0000 7f4faecf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.698+0000 7f4faecf79c0 20 realm 2024-09-12T00:37:38.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.698+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.698+0000 7f4faecf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.698+0000 7f4faecf79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:38.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.698+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.698+0000 7f4faecf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.698+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.702+0000 7f4faecf79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:38.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.702+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.702+0000 7f4faecf79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:38.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.702+0000 7f4faecf79c0 20 searching for the correct realm 2024-09-12T00:37:38.709 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.710+0000 7f4fabffc640 0 -- 172.21.15.43:0/1017111121 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f4fa0086c20 msgr2=0x7f4fa008a5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:38.715 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.714+0000 7f4fabffc640 0 -- 172.21.15.43:0/1017111121 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f4e74080b30 msgr2=0x7f4e74082f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:38.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:37:38.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:38.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:38.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:37:38.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:38.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:38.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:38.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:38.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 zone default found 2024-09-12T00:37:38.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.722+0000 7f4faecf79c0 4 Realm: () 2024-09-12T00:37:38.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.722+0000 7f4faecf79c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:37:38.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.722+0000 7f4faecf79c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:37:38.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.722+0000 7f4faecf79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:38.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 zonegroup default 2024-09-12T00:37:38.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 started sync module instance, tier type = 2024-09-12T00:37:38.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:37:38.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.738+0000 7f4faecf79c0 20 add_watcher() i=0 2024-09-12T00:37:38.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.738+0000 7f4faecf79c0 20 add_watcher() i=1 2024-09-12T00:37:38.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.738+0000 7f4faecf79c0 20 add_watcher() i=2 2024-09-12T00:37:38.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.738+0000 7f4faecf79c0 20 add_watcher() i=3 2024-09-12T00:37:38.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.738+0000 7f4faecf79c0 20 add_watcher() i=4 2024-09-12T00:37:38.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.738+0000 7f4faecf79c0 20 add_watcher() i=5 2024-09-12T00:37:38.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.738+0000 7f4faecf79c0 20 add_watcher() i=6 2024-09-12T00:37:38.742 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.742+0000 7f4faecf79c0 20 add_watcher() i=7 2024-09-12T00:37:38.742 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.742+0000 7f4faecf79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:38.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.742+0000 7f4e62fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:38.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.742+0000 7f4faecf79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:38.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.742+0000 7f4faecf79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:38.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 note: GC not initialized 2024-09-12T00:37:38.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.746+0000 7f4e61fdb640 20 reqs_thread_entry: start 2024-09-12T00:37:38.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.746+0000 7f4faecf79c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:38.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.746+0000 7f4faecf79c0 20 Filter name: none 2024-09-12T00:37:38.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.746+0000 7f4dd37fe640 20 reqs_thread_entry: start 2024-09-12T00:37:38.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.746+0000 7f4faecf79c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:37:38.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.746+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.746+0000 7f4faecf79c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:37:38.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.746+0000 7f4faecf79c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:37:38.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.746+0000 7f4faecf79c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:37:38.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.746+0000 7f4faecf79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 : miss 2024-09-12T00:37:38.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.746+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.747 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.746+0000 7f4faecf79c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:37:38.747 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.746+0000 7f4faecf79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 info.flags=0x17 2024-09-12T00:37:38.747 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.746+0000 7f4faecf79c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 to cache LRU end 2024-09-12T00:37:38.747 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.746+0000 7f4faecf79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:38.747 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.746+0000 7f4faecf79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:38.747 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.746+0000 7f4faecf79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 2024-09-12T00:37:38.756 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.754+0000 7f4faecf79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 info.flags=0x17 2024-09-12T00:37:38.756 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.754+0000 7f4faecf79c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 to cache LRU end 2024-09-12T00:37:38.756 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.754+0000 7f4faecf79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:38.756 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.754+0000 7f4faecf79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27, ofs0, ns] 2024-09-12T00:37:38.757 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.758+0000 7f4e82ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333520 cookie 94113386848096 notifier 6819 bl.length()=939 2024-09-12T00:37:38.757 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.758+0000 7f4e82ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 info.flags=0x17 2024-09-12T00:37:38.757 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.758+0000 7f4e82ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 to cache LRU end 2024-09-12T00:37:38.757 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.758+0000 7f4e82ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:38.758 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4faecf79c0 time 2024-09-12T00:37:38.761952+0000 2024-09-12T00:37:38.758 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:37:38.758 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.758+0000 7f4faecf79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27]): orig_sources= new_sources= 2024-09-12T00:37:38.758 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.758+0000 7f4faecf79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27]): potential sources added=[] removed=[] 2024-09-12T00:37:38.758 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.758+0000 7f4faecf79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27]): orig_dests= new_dests= 2024-09-12T00:37:38.758 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.758+0000 7f4faecf79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27]): potential dests added=[] removed=[] 2024-09-12T00:37:38.759 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:38.759 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f4fb25d12eb] 2024-09-12T00:37:38.759 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4fb25d149f] 2024-09-12T00:37:38.759 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5598782cecc1] 2024-09-12T00:37:38.759 INFO:tasks.workunit.client.0.smithi043.stderr: 4: radosgw-admin(+0x1422a3e) [0x559878d2ca3e] 2024-09-12T00:37:38.760 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5598782e3ced] 2024-09-12T00:37:38.760 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:37:38.760 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4fb1437d90] 2024-09-12T00:37:38.760 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:37:38.760 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:37:38.760 INFO:tasks.workunit.client.0.smithi043.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:37:38.760 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7f4faecf79c0 thread_name:radosgw-admin 2024-09-12T00:37:38.760 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.758+0000 7f4faecf79c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4faecf79c0 time 2024-09-12T00:37:38.761952+0000 2024-09-12T00:37:38.760 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:37:38.760 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.760 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:38.760 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f4fb25d12eb] 2024-09-12T00:37:38.761 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4fb25d149f] 2024-09-12T00:37:38.761 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5598782cecc1] 2024-09-12T00:37:38.761 INFO:tasks.workunit.client.0.smithi043.stderr: 4: radosgw-admin(+0x1422a3e) [0x559878d2ca3e] 2024-09-12T00:37:38.761 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5598782e3ced] 2024-09-12T00:37:38.761 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:37:38.761 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4fb1437d90] 2024-09-12T00:37:38.761 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:37:38.761 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:37:38.761 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.779 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:38.779 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4fb1450520] 2024-09-12T00:37:38.779 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:37:38.779 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:37:38.780 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:37:38.780 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f4fb25d1345] 2024-09-12T00:37:38.780 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4fb25d149f] 2024-09-12T00:37:38.780 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5598782cecc1] 2024-09-12T00:37:38.780 INFO:tasks.workunit.client.0.smithi043.stderr: 8: radosgw-admin(+0x1422a3e) [0x559878d2ca3e] 2024-09-12T00:37:38.780 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5598782e3ced] 2024-09-12T00:37:38.780 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:37:38.780 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4fb1437d90] 2024-09-12T00:37:38.780 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:37:38.780 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:37:38.780 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.758+0000 7f4faecf79c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:37:38.781 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7f4faecf79c0 thread_name:radosgw-admin 2024-09-12T00:37:38.781 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.781 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:38.781 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4fb1450520] 2024-09-12T00:37:38.781 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:37:38.781 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:37:38.781 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:37:38.781 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f4fb25d1345] 2024-09-12T00:37:38.781 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4fb25d149f] 2024-09-12T00:37:38.781 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5598782cecc1] 2024-09-12T00:37:38.781 INFO:tasks.workunit.client.0.smithi043.stderr: 8: radosgw-admin(+0x1422a3e) [0x559878d2ca3e] 2024-09-12T00:37:38.781 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5598782e3ced] 2024-09-12T00:37:38.782 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:37:38.782 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4fb1437d90] 2024-09-12T00:37:38.782 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:37:38.782 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:37:38.782 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:37:38.782 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.782 INFO:tasks.workunit.client.0.smithi043.stderr:--- begin dump of recent events --- 2024-09-12T00:37:38.782 INFO:tasks.workunit.client.0.smithi043.stderr: -499> 2024-09-12T00:37:38.674+0000 7f4fabffc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.782 INFO:tasks.workunit.client.0.smithi043.stderr: -498> 2024-09-12T00:37:38.674+0000 7f4fac7fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.782 INFO:tasks.workunit.client.0.smithi043.stderr: -497> 2024-09-12T00:37:38.674+0000 7f4fac7fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.782 INFO:tasks.workunit.client.0.smithi043.stderr: -496> 2024-09-12T00:37:38.674+0000 7f4fac7fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.782 INFO:tasks.workunit.client.0.smithi043.stderr: -495> 2024-09-12T00:37:38.674+0000 7f4fabffc640 10 monclient(hunting): handle_auth_done global_id 6807 payload 274 2024-09-12T00:37:38.783 INFO:tasks.workunit.client.0.smithi043.stderr: -494> 2024-09-12T00:37:38.674+0000 7f4fabffc640 10 monclient: _finish_hunting 0 2024-09-12T00:37:38.783 INFO:tasks.workunit.client.0.smithi043.stderr: -493> 2024-09-12T00:37:38.674+0000 7f4fabffc640 1 monclient: found mon.noname-a 2024-09-12T00:37:38.783 INFO:tasks.workunit.client.0.smithi043.stderr: -492> 2024-09-12T00:37:38.674+0000 7f4fabffc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:37:38.783 INFO:tasks.workunit.client.0.smithi043.stderr: -491> 2024-09-12T00:37:38.674+0000 7f4e9a60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.783 INFO:tasks.workunit.client.0.smithi043.stderr: -490> 2024-09-12T00:37:38.674+0000 7f4e9a60c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:38.783 INFO:tasks.workunit.client.0.smithi043.stderr: -489> 2024-09-12T00:37:38.674+0000 7f4e9a60c640 10 monclient: dump: 2024-09-12T00:37:38.783 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:38.783 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:38.783 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.783 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.783 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.784 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:38.784 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:38.784 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:38.784 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:38.784 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.784 INFO:tasks.workunit.client.0.smithi043.stderr: -488> 2024-09-12T00:37:38.674+0000 7f4e9a60c640 10 monclient: _finish_auth 0 2024-09-12T00:37:38.784 INFO:tasks.workunit.client.0.smithi043.stderr: -487> 2024-09-12T00:37:38.674+0000 7f4e9a60c640 10 monclient: _check_auth_tickets 2024-09-12T00:37:38.784 INFO:tasks.workunit.client.0.smithi043.stderr: -486> 2024-09-12T00:37:38.674+0000 7f4e9a60c640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:38.784 INFO:tasks.workunit.client.0.smithi043.stderr: -485> 2024-09-12T00:37:38.674+0000 7f4e9a60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.784 INFO:tasks.workunit.client.0.smithi043.stderr: -484> 2024-09-12T00:37:38.674+0000 7f4e9a60c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:38.784 INFO:tasks.workunit.client.0.smithi043.stderr: -483> 2024-09-12T00:37:38.674+0000 7f4e9a60c640 10 monclient: dump: 2024-09-12T00:37:38.784 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:38.784 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:38.785 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.785 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.785 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.785 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:38.785 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:38.785 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:38.785 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:38.785 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.788 INFO:tasks.workunit.client.0.smithi043.stderr: -482> 2024-09-12T00:37:38.674+0000 7f4faecf79c0 5 monclient: authenticate success, global_id 6807 2024-09-12T00:37:38.788 INFO:tasks.workunit.client.0.smithi043.stderr: -481> 2024-09-12T00:37:38.674+0000 7f4faecf79c0 10 monclient: get_monmap_and_config success 2024-09-12T00:37:38.788 INFO:tasks.workunit.client.0.smithi043.stderr: -480> 2024-09-12T00:37:38.674+0000 7f4faecf79c0 4 set_mon_vals no callback set 2024-09-12T00:37:38.788 INFO:tasks.workunit.client.0.smithi043.stderr: -479> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient: shutdown 2024-09-12T00:37:38.788 INFO:tasks.workunit.client.0.smithi043.stderr: -478> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 asok(0x55987acd92b0) unregister_commands rotate-key 2024-09-12T00:37:38.788 INFO:tasks.workunit.client.0.smithi043.stderr: -477> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient: build_initial_monmap 2024-09-12T00:37:38.788 INFO:tasks.workunit.client.0.smithi043.stderr: -476> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:38.788 INFO:tasks.workunit.client.0.smithi043.stderr: -475> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient: monmap: 2024-09-12T00:37:38.788 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:37:38.788 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:38.788 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:37:38.789 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:37:38.789 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:38.789 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:38.789 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:37:38.789 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:37:38.789 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:37:38.789 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.789 INFO:tasks.workunit.client.0.smithi043.stderr: -474> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee8810) adding auth protocol: cephx 2024-09-12T00:37:38.789 INFO:tasks.workunit.client.0.smithi043.stderr: -473> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee8810) adding auth protocol: cephx 2024-09-12T00:37:38.789 INFO:tasks.workunit.client.0.smithi043.stderr: -472> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee8810) adding auth protocol: cephx 2024-09-12T00:37:38.789 INFO:tasks.workunit.client.0.smithi043.stderr: -471> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee8810) adding con mode: secure 2024-09-12T00:37:38.790 INFO:tasks.workunit.client.0.smithi043.stderr: -470> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee8810) adding con mode: crc 2024-09-12T00:37:38.790 INFO:tasks.workunit.client.0.smithi043.stderr: -469> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee8810) adding con mode: secure 2024-09-12T00:37:38.790 INFO:tasks.workunit.client.0.smithi043.stderr: -468> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee8810) adding con mode: crc 2024-09-12T00:37:38.790 INFO:tasks.workunit.client.0.smithi043.stderr: -467> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee8810) adding con mode: secure 2024-09-12T00:37:38.790 INFO:tasks.workunit.client.0.smithi043.stderr: -466> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee8810) adding con mode: crc 2024-09-12T00:37:38.790 INFO:tasks.workunit.client.0.smithi043.stderr: -465> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee8810) adding con mode: crc 2024-09-12T00:37:38.790 INFO:tasks.workunit.client.0.smithi043.stderr: -464> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee8810) adding con mode: secure 2024-09-12T00:37:38.790 INFO:tasks.workunit.client.0.smithi043.stderr: -463> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee8810) adding con mode: crc 2024-09-12T00:37:38.790 INFO:tasks.workunit.client.0.smithi043.stderr: -462> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee8810) adding con mode: secure 2024-09-12T00:37:38.790 INFO:tasks.workunit.client.0.smithi043.stderr: -461> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee8810) adding con mode: crc 2024-09-12T00:37:38.790 INFO:tasks.workunit.client.0.smithi043.stderr: -460> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee8810) adding con mode: secure 2024-09-12T00:37:38.791 INFO:tasks.workunit.client.0.smithi043.stderr: -459> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.791 INFO:tasks.workunit.client.0.smithi043.stderr: -458> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 1 librados: starting msgr at 2024-09-12T00:37:38.791 INFO:tasks.workunit.client.0.smithi043.stderr: -457> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 1 librados: starting objecter 2024-09-12T00:37:38.791 INFO:tasks.workunit.client.0.smithi043.stderr: -456> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command objecter_requests hook 0x55987aee52a0 2024-09-12T00:37:38.791 INFO:tasks.workunit.client.0.smithi043.stderr: -455> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 1 librados: setting wanted keys 2024-09-12T00:37:38.791 INFO:tasks.workunit.client.0.smithi043.stderr: -454> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 1 librados: calling monclient init 2024-09-12T00:37:38.791 INFO:tasks.workunit.client.0.smithi043.stderr: -453> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient: init 2024-09-12T00:37:38.791 INFO:tasks.workunit.client.0.smithi043.stderr: -452> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee34c0) adding auth protocol: cephx 2024-09-12T00:37:38.791 INFO:tasks.workunit.client.0.smithi043.stderr: -451> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee34c0) adding auth protocol: cephx 2024-09-12T00:37:38.791 INFO:tasks.workunit.client.0.smithi043.stderr: -450> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee34c0) adding auth protocol: cephx 2024-09-12T00:37:38.791 INFO:tasks.workunit.client.0.smithi043.stderr: -449> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee34c0) adding con mode: secure 2024-09-12T00:37:38.791 INFO:tasks.workunit.client.0.smithi043.stderr: -448> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee34c0) adding con mode: crc 2024-09-12T00:37:38.792 INFO:tasks.workunit.client.0.smithi043.stderr: -447> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee34c0) adding con mode: secure 2024-09-12T00:37:38.792 INFO:tasks.workunit.client.0.smithi043.stderr: -446> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee34c0) adding con mode: crc 2024-09-12T00:37:38.792 INFO:tasks.workunit.client.0.smithi043.stderr: -445> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee34c0) adding con mode: secure 2024-09-12T00:37:38.792 INFO:tasks.workunit.client.0.smithi043.stderr: -444> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee34c0) adding con mode: crc 2024-09-12T00:37:38.792 INFO:tasks.workunit.client.0.smithi043.stderr: -443> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee34c0) adding con mode: crc 2024-09-12T00:37:38.792 INFO:tasks.workunit.client.0.smithi043.stderr: -442> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee34c0) adding con mode: secure 2024-09-12T00:37:38.792 INFO:tasks.workunit.client.0.smithi043.stderr: -441> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee34c0) adding con mode: crc 2024-09-12T00:37:38.792 INFO:tasks.workunit.client.0.smithi043.stderr: -440> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee34c0) adding con mode: secure 2024-09-12T00:37:38.792 INFO:tasks.workunit.client.0.smithi043.stderr: -439> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee34c0) adding con mode: crc 2024-09-12T00:37:38.792 INFO:tasks.workunit.client.0.smithi043.stderr: -438> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee34c0) adding con mode: secure 2024-09-12T00:37:38.792 INFO:tasks.workunit.client.0.smithi043.stderr: -437> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.792 INFO:tasks.workunit.client.0.smithi043.stderr: -436> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.793 INFO:tasks.workunit.client.0.smithi043.stderr: -435> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command rotate-key hook 0x55987aee3608 2024-09-12T00:37:38.793 INFO:tasks.workunit.client.0.smithi043.stderr: -434> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:38.793 INFO:tasks.workunit.client.0.smithi043.stderr: -433> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:37:38.793 INFO:tasks.workunit.client.0.smithi043.stderr: -432> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient(hunting): picked mon.noname-b con 0x55987ad732c0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:37:38.793 INFO:tasks.workunit.client.0.smithi043.stderr: -431> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient(hunting): picked mon.noname-a con 0x55987ad73a70 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:37:38.793 INFO:tasks.workunit.client.0.smithi043.stderr: -430> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient(hunting): picked mon.noname-c con 0x55987ae292d0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:37:38.793 INFO:tasks.workunit.client.0.smithi043.stderr: -429> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.793 INFO:tasks.workunit.client.0.smithi043.stderr: -428> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.793 INFO:tasks.workunit.client.0.smithi043.stderr: -427> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.793 INFO:tasks.workunit.client.0.smithi043.stderr: -426> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:38.793 INFO:tasks.workunit.client.0.smithi043.stderr: -425> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient(hunting): authenticate will time out at 2154.669719s 2024-09-12T00:37:38.794 INFO:tasks.workunit.client.0.smithi043.stderr: -424> 2024-09-12T00:37:38.678+0000 7f4fabffc640 10 monclient(hunting): get_auth_request con 0x55987ad73a70 auth_method 0 2024-09-12T00:37:38.794 INFO:tasks.workunit.client.0.smithi043.stderr: -423> 2024-09-12T00:37:38.678+0000 7f4fabffc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.794 INFO:tasks.workunit.client.0.smithi043.stderr: -422> 2024-09-12T00:37:38.678+0000 7f4fabffc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.794 INFO:tasks.workunit.client.0.smithi043.stderr: -421> 2024-09-12T00:37:38.678+0000 7f4fabffc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.794 INFO:tasks.workunit.client.0.smithi043.stderr: -420> 2024-09-12T00:37:38.678+0000 7f4facffe640 10 monclient(hunting): get_auth_request con 0x55987ae292d0 auth_method 0 2024-09-12T00:37:38.794 INFO:tasks.workunit.client.0.smithi043.stderr: -419> 2024-09-12T00:37:38.678+0000 7f4facffe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.794 INFO:tasks.workunit.client.0.smithi043.stderr: -418> 2024-09-12T00:37:38.678+0000 7f4facffe640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.794 INFO:tasks.workunit.client.0.smithi043.stderr: -417> 2024-09-12T00:37:38.678+0000 7f4facffe640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.794 INFO:tasks.workunit.client.0.smithi043.stderr: -416> 2024-09-12T00:37:38.678+0000 7f4fabffc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.794 INFO:tasks.workunit.client.0.smithi043.stderr: -415> 2024-09-12T00:37:38.678+0000 7f4fabffc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.794 INFO:tasks.workunit.client.0.smithi043.stderr: -414> 2024-09-12T00:37:38.678+0000 7f4fabffc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.794 INFO:tasks.workunit.client.0.smithi043.stderr: -413> 2024-09-12T00:37:38.678+0000 7f4facffe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.794 INFO:tasks.workunit.client.0.smithi043.stderr: -412> 2024-09-12T00:37:38.678+0000 7f4facffe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.795 INFO:tasks.workunit.client.0.smithi043.stderr: -411> 2024-09-12T00:37:38.678+0000 7f4facffe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.795 INFO:tasks.workunit.client.0.smithi043.stderr: -410> 2024-09-12T00:37:38.678+0000 7f4fac7fd640 10 monclient(hunting): get_auth_request con 0x55987ad732c0 auth_method 0 2024-09-12T00:37:38.795 INFO:tasks.workunit.client.0.smithi043.stderr: -409> 2024-09-12T00:37:38.678+0000 7f4fac7fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.795 INFO:tasks.workunit.client.0.smithi043.stderr: -408> 2024-09-12T00:37:38.678+0000 7f4fac7fd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.795 INFO:tasks.workunit.client.0.smithi043.stderr: -407> 2024-09-12T00:37:38.678+0000 7f4fac7fd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.795 INFO:tasks.workunit.client.0.smithi043.stderr: -406> 2024-09-12T00:37:38.678+0000 7f4fabffc640 10 monclient(hunting): handle_auth_done global_id 6810 payload 824 2024-09-12T00:37:38.795 INFO:tasks.workunit.client.0.smithi043.stderr: -405> 2024-09-12T00:37:38.678+0000 7f4fabffc640 10 monclient: _finish_hunting 0 2024-09-12T00:37:38.795 INFO:tasks.workunit.client.0.smithi043.stderr: -404> 2024-09-12T00:37:38.678+0000 7f4fabffc640 1 monclient: found mon.noname-a 2024-09-12T00:37:38.795 INFO:tasks.workunit.client.0.smithi043.stderr: -403> 2024-09-12T00:37:38.678+0000 7f4fabffc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:37:38.795 INFO:tasks.workunit.client.0.smithi043.stderr: -402> 2024-09-12T00:37:38.678+0000 7f4e98e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.795 INFO:tasks.workunit.client.0.smithi043.stderr: -401> 2024-09-12T00:37:38.678+0000 7f4e98e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:38.795 INFO:tasks.workunit.client.0.smithi043.stderr: -400> 2024-09-12T00:37:38.678+0000 7f4e98e09640 10 monclient: dump: 2024-09-12T00:37:38.795 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:38.796 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:38.796 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.796 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.796 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.796 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:38.796 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:38.796 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:38.796 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:38.796 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.796 INFO:tasks.workunit.client.0.smithi043.stderr: -399> 2024-09-12T00:37:38.678+0000 7f4e98e09640 10 monclient: _finish_auth 0 2024-09-12T00:37:38.796 INFO:tasks.workunit.client.0.smithi043.stderr: -398> 2024-09-12T00:37:38.678+0000 7f4e98e09640 10 monclient: _check_auth_tickets 2024-09-12T00:37:38.796 INFO:tasks.workunit.client.0.smithi043.stderr: -397> 2024-09-12T00:37:38.678+0000 7f4e98e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:38.796 INFO:tasks.workunit.client.0.smithi043.stderr: -396> 2024-09-12T00:37:38.678+0000 7f4e98e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.797 INFO:tasks.workunit.client.0.smithi043.stderr: -395> 2024-09-12T00:37:38.678+0000 7f4e98e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:38.797 INFO:tasks.workunit.client.0.smithi043.stderr: -394> 2024-09-12T00:37:38.678+0000 7f4e98e09640 10 monclient: dump: 2024-09-12T00:37:38.797 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:38.797 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:38.797 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.797 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.797 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.797 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:38.797 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:38.797 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:38.797 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:38.797 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.798 INFO:tasks.workunit.client.0.smithi043.stderr: -393> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 monclient: authenticate success, global_id 6810 2024-09-12T00:37:38.798 INFO:tasks.workunit.client.0.smithi043.stderr: -392> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient: _renew_subs 2024-09-12T00:37:38.798 INFO:tasks.workunit.client.0.smithi043.stderr: -391> 2024-09-12T00:37:38.678+0000 7f4e9a60c640 4 set_mon_vals no callback set 2024-09-12T00:37:38.798 INFO:tasks.workunit.client.0.smithi043.stderr: -390> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:37:38.798 INFO:tasks.workunit.client.0.smithi043.stderr: -389> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient: _renew_subs 2024-09-12T00:37:38.798 INFO:tasks.workunit.client.0.smithi043.stderr: -388> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:37:38.798 INFO:tasks.workunit.client.0.smithi043.stderr: -387> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 1 librados: init done 2024-09-12T00:37:38.798 INFO:tasks.workunit.client.0.smithi043.stderr: -386> 2024-09-12T00:37:38.682+0000 7f4e98e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:38.798 INFO:tasks.workunit.client.0.smithi043.stderr: -385> 2024-09-12T00:37:38.682+0000 7f4e98e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:37:38.798 INFO:tasks.workunit.client.0.smithi043.stderr: -384> 2024-09-12T00:37:38.682+0000 7f4e98e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:37:38.798 INFO:tasks.workunit.client.0.smithi043.stderr: -383> 2024-09-12T00:37:38.682+0000 7f4fac7fd640 10 monclient: get_auth_request con 0x7f4e94070ae0 auth_method 0 2024-09-12T00:37:38.798 INFO:tasks.workunit.client.0.smithi043.stderr: -382> 2024-09-12T00:37:38.682+0000 7f4facffe640 10 monclient: get_auth_request con 0x55987af213f0 auth_method 0 2024-09-12T00:37:38.798 INFO:tasks.workunit.client.0.smithi043.stderr: -381> 2024-09-12T00:37:38.682+0000 7f4fac7fd640 10 monclient: get_auth_request con 0x55987af2cfd0 auth_method 0 2024-09-12T00:37:38.799 INFO:tasks.workunit.client.0.smithi043.stderr: -380> 2024-09-12T00:37:38.682+0000 7f4fabffc640 10 monclient: get_auth_request con 0x55987af311c0 auth_method 0 2024-09-12T00:37:38.799 INFO:tasks.workunit.client.0.smithi043.stderr: -379> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient: build_initial_monmap 2024-09-12T00:37:38.799 INFO:tasks.workunit.client.0.smithi043.stderr: -378> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:38.799 INFO:tasks.workunit.client.0.smithi043.stderr: -377> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient: monmap: 2024-09-12T00:37:38.799 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:37:38.799 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:38.799 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:37:38.799 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:37:38.799 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:38.799 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:38.799 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:37:38.799 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:37:38.800 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:37:38.800 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.800 INFO:tasks.workunit.client.0.smithi043.stderr: -376> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af35d70) adding auth protocol: cephx 2024-09-12T00:37:38.800 INFO:tasks.workunit.client.0.smithi043.stderr: -375> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af35d70) adding auth protocol: cephx 2024-09-12T00:37:38.800 INFO:tasks.workunit.client.0.smithi043.stderr: -374> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af35d70) adding auth protocol: cephx 2024-09-12T00:37:38.800 INFO:tasks.workunit.client.0.smithi043.stderr: -373> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af35d70) adding con mode: secure 2024-09-12T00:37:38.800 INFO:tasks.workunit.client.0.smithi043.stderr: -372> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af35d70) adding con mode: crc 2024-09-12T00:37:38.800 INFO:tasks.workunit.client.0.smithi043.stderr: -371> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af35d70) adding con mode: secure 2024-09-12T00:37:38.800 INFO:tasks.workunit.client.0.smithi043.stderr: -370> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af35d70) adding con mode: crc 2024-09-12T00:37:38.801 INFO:tasks.workunit.client.0.smithi043.stderr: -369> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af35d70) adding con mode: secure 2024-09-12T00:37:38.801 INFO:tasks.workunit.client.0.smithi043.stderr: -368> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af35d70) adding con mode: crc 2024-09-12T00:37:38.801 INFO:tasks.workunit.client.0.smithi043.stderr: -367> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af35d70) adding con mode: crc 2024-09-12T00:37:38.801 INFO:tasks.workunit.client.0.smithi043.stderr: -366> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af35d70) adding con mode: secure 2024-09-12T00:37:38.801 INFO:tasks.workunit.client.0.smithi043.stderr: -365> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af35d70) adding con mode: crc 2024-09-12T00:37:38.801 INFO:tasks.workunit.client.0.smithi043.stderr: -364> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af35d70) adding con mode: secure 2024-09-12T00:37:38.801 INFO:tasks.workunit.client.0.smithi043.stderr: -363> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af35d70) adding con mode: crc 2024-09-12T00:37:38.801 INFO:tasks.workunit.client.0.smithi043.stderr: -362> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af35d70) adding con mode: secure 2024-09-12T00:37:38.801 INFO:tasks.workunit.client.0.smithi043.stderr: -361> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.801 INFO:tasks.workunit.client.0.smithi043.stderr: -360> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command objecter_requests cmddesc objecter_requests hook 0x55987af396e0 EEXIST 2024-09-12T00:37:38.801 INFO:tasks.workunit.client.0.smithi043.stderr: -359> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient: init 2024-09-12T00:37:38.801 INFO:tasks.workunit.client.0.smithi043.stderr: -358> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af34448) adding auth protocol: cephx 2024-09-12T00:37:38.802 INFO:tasks.workunit.client.0.smithi043.stderr: -357> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af34448) adding auth protocol: cephx 2024-09-12T00:37:38.802 INFO:tasks.workunit.client.0.smithi043.stderr: -356> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af34448) adding auth protocol: cephx 2024-09-12T00:37:38.802 INFO:tasks.workunit.client.0.smithi043.stderr: -355> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af34448) adding con mode: secure 2024-09-12T00:37:38.802 INFO:tasks.workunit.client.0.smithi043.stderr: -354> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af34448) adding con mode: crc 2024-09-12T00:37:38.802 INFO:tasks.workunit.client.0.smithi043.stderr: -353> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af34448) adding con mode: secure 2024-09-12T00:37:38.802 INFO:tasks.workunit.client.0.smithi043.stderr: -352> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af34448) adding con mode: crc 2024-09-12T00:37:38.802 INFO:tasks.workunit.client.0.smithi043.stderr: -351> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af34448) adding con mode: secure 2024-09-12T00:37:38.802 INFO:tasks.workunit.client.0.smithi043.stderr: -350> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af34448) adding con mode: crc 2024-09-12T00:37:38.802 INFO:tasks.workunit.client.0.smithi043.stderr: -349> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af34448) adding con mode: crc 2024-09-12T00:37:38.802 INFO:tasks.workunit.client.0.smithi043.stderr: -348> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af34448) adding con mode: secure 2024-09-12T00:37:38.802 INFO:tasks.workunit.client.0.smithi043.stderr: -347> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af34448) adding con mode: crc 2024-09-12T00:37:38.802 INFO:tasks.workunit.client.0.smithi043.stderr: -346> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af34448) adding con mode: secure 2024-09-12T00:37:38.802 INFO:tasks.workunit.client.0.smithi043.stderr: -345> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af34448) adding con mode: crc 2024-09-12T00:37:38.803 INFO:tasks.workunit.client.0.smithi043.stderr: -344> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af34448) adding con mode: secure 2024-09-12T00:37:38.803 INFO:tasks.workunit.client.0.smithi043.stderr: -343> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.803 INFO:tasks.workunit.client.0.smithi043.stderr: -342> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.803 INFO:tasks.workunit.client.0.smithi043.stderr: -341> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command rotate-key cmddesc rotate-key hook 0x55987af34590 EEXIST 2024-09-12T00:37:38.803 INFO:tasks.workunit.client.0.smithi043.stderr: -340> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:38.803 INFO:tasks.workunit.client.0.smithi043.stderr: -339> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:37:38.803 INFO:tasks.workunit.client.0.smithi043.stderr: -338> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient(hunting): picked mon.noname-c con 0x55987af5d890 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:37:38.803 INFO:tasks.workunit.client.0.smithi043.stderr: -337> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient(hunting): picked mon.noname-a con 0x55987af5d1c0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:37:38.803 INFO:tasks.workunit.client.0.smithi043.stderr: -336> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient(hunting): picked mon.noname-b con 0x55987af5bba0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:37:38.803 INFO:tasks.workunit.client.0.smithi043.stderr: -335> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.803 INFO:tasks.workunit.client.0.smithi043.stderr: -334> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.803 INFO:tasks.workunit.client.0.smithi043.stderr: -333> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.803 INFO:tasks.workunit.client.0.smithi043.stderr: -332> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:38.804 INFO:tasks.workunit.client.0.smithi043.stderr: -331> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient(hunting): authenticate will time out at 2154.678652s 2024-09-12T00:37:38.804 INFO:tasks.workunit.client.0.smithi043.stderr: -330> 2024-09-12T00:37:38.686+0000 7f4fabffc640 10 monclient(hunting): get_auth_request con 0x55987af5d1c0 auth_method 0 2024-09-12T00:37:38.804 INFO:tasks.workunit.client.0.smithi043.stderr: -329> 2024-09-12T00:37:38.686+0000 7f4fabffc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.804 INFO:tasks.workunit.client.0.smithi043.stderr: -328> 2024-09-12T00:37:38.686+0000 7f4fabffc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.804 INFO:tasks.workunit.client.0.smithi043.stderr: -327> 2024-09-12T00:37:38.686+0000 7f4fabffc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.804 INFO:tasks.workunit.client.0.smithi043.stderr: -326> 2024-09-12T00:37:38.686+0000 7f4fac7fd640 10 monclient(hunting): get_auth_request con 0x55987af5d890 auth_method 0 2024-09-12T00:37:38.804 INFO:tasks.workunit.client.0.smithi043.stderr: -325> 2024-09-12T00:37:38.686+0000 7f4fac7fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.804 INFO:tasks.workunit.client.0.smithi043.stderr: -324> 2024-09-12T00:37:38.686+0000 7f4fac7fd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.804 INFO:tasks.workunit.client.0.smithi043.stderr: -323> 2024-09-12T00:37:38.686+0000 7f4fac7fd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.804 INFO:tasks.workunit.client.0.smithi043.stderr: -322> 2024-09-12T00:37:38.686+0000 7f4fabffc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.804 INFO:tasks.workunit.client.0.smithi043.stderr: -321> 2024-09-12T00:37:38.686+0000 7f4fabffc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.804 INFO:tasks.workunit.client.0.smithi043.stderr: -320> 2024-09-12T00:37:38.686+0000 7f4fabffc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.804 INFO:tasks.workunit.client.0.smithi043.stderr: -319> 2024-09-12T00:37:38.686+0000 7f4fac7fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.805 INFO:tasks.workunit.client.0.smithi043.stderr: -318> 2024-09-12T00:37:38.686+0000 7f4fac7fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.805 INFO:tasks.workunit.client.0.smithi043.stderr: -317> 2024-09-12T00:37:38.686+0000 7f4fac7fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.805 INFO:tasks.workunit.client.0.smithi043.stderr: -316> 2024-09-12T00:37:38.686+0000 7f4fabffc640 10 monclient(hunting): handle_auth_done global_id 6813 payload 824 2024-09-12T00:37:38.805 INFO:tasks.workunit.client.0.smithi043.stderr: -315> 2024-09-12T00:37:38.686+0000 7f4fabffc640 10 monclient: _finish_hunting 0 2024-09-12T00:37:38.805 INFO:tasks.workunit.client.0.smithi043.stderr: -314> 2024-09-12T00:37:38.686+0000 7f4fabffc640 1 monclient: found mon.noname-a 2024-09-12T00:37:38.805 INFO:tasks.workunit.client.0.smithi043.stderr: -313> 2024-09-12T00:37:38.686+0000 7f4fabffc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:37:38.805 INFO:tasks.workunit.client.0.smithi043.stderr: -312> 2024-09-12T00:37:38.686+0000 7f4facffe640 10 monclient: get_auth_request con 0x55987af5bba0 auth_method 0 2024-09-12T00:37:38.805 INFO:tasks.workunit.client.0.smithi043.stderr: -311> 2024-09-12T00:37:38.686+0000 7f4e91ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.805 INFO:tasks.workunit.client.0.smithi043.stderr: -310> 2024-09-12T00:37:38.686+0000 7f4e91ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:38.805 INFO:tasks.workunit.client.0.smithi043.stderr: -309> 2024-09-12T00:37:38.686+0000 7f4e91ffb640 10 monclient: dump: 2024-09-12T00:37:38.805 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:38.805 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:38.805 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.806 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.806 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.806 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:38.806 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:38.806 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:38.806 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:38.806 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.806 INFO:tasks.workunit.client.0.smithi043.stderr: -308> 2024-09-12T00:37:38.686+0000 7f4e91ffb640 10 monclient: _finish_auth 0 2024-09-12T00:37:38.806 INFO:tasks.workunit.client.0.smithi043.stderr: -307> 2024-09-12T00:37:38.686+0000 7f4e91ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:37:38.806 INFO:tasks.workunit.client.0.smithi043.stderr: -306> 2024-09-12T00:37:38.686+0000 7f4e91ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:38.806 INFO:tasks.workunit.client.0.smithi043.stderr: -305> 2024-09-12T00:37:38.686+0000 7f4e91ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.806 INFO:tasks.workunit.client.0.smithi043.stderr: -304> 2024-09-12T00:37:38.686+0000 7f4e91ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:38.806 INFO:tasks.workunit.client.0.smithi043.stderr: -303> 2024-09-12T00:37:38.686+0000 7f4e91ffb640 10 monclient: dump: 2024-09-12T00:37:38.807 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:38.807 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:38.807 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.807 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.807 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.807 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:38.807 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:38.807 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:38.807 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:38.807 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.807 INFO:tasks.workunit.client.0.smithi043.stderr: -302> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 monclient: authenticate success, global_id 6813 2024-09-12T00:37:38.807 INFO:tasks.workunit.client.0.smithi043.stderr: -301> 2024-09-12T00:37:38.686+0000 7f4fad7ff640 4 set_mon_vals no callback set 2024-09-12T00:37:38.807 INFO:tasks.workunit.client.0.smithi043.stderr: -300> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient: _renew_subs 2024-09-12T00:37:38.808 INFO:tasks.workunit.client.0.smithi043.stderr: -299> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:37:38.808 INFO:tasks.workunit.client.0.smithi043.stderr: -298> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient: _renew_subs 2024-09-12T00:37:38.808 INFO:tasks.workunit.client.0.smithi043.stderr: -297> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:37:38.808 INFO:tasks.workunit.client.0.smithi043.stderr: -296> 2024-09-12T00:37:38.690+0000 7f4e91ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:38.808 INFO:tasks.workunit.client.0.smithi043.stderr: -295> 2024-09-12T00:37:38.690+0000 7f4e91ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:37:38.808 INFO:tasks.workunit.client.0.smithi043.stderr: -294> 2024-09-12T00:37:38.690+0000 7f4e91ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:37:38.808 INFO:tasks.workunit.client.0.smithi043.stderr: -293> 2024-09-12T00:37:38.690+0000 7f4fac7fd640 10 monclient: get_auth_request con 0x7f4e84070a20 auth_method 0 2024-09-12T00:37:38.808 INFO:tasks.workunit.client.0.smithi043.stderr: -292> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 10 monclient: get_monmap_and_config 2024-09-12T00:37:38.808 INFO:tasks.workunit.client.0.smithi043.stderr: -291> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 10 monclient: build_initial_monmap 2024-09-12T00:37:38.808 INFO:tasks.workunit.client.0.smithi043.stderr: -290> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:38.808 INFO:tasks.workunit.client.0.smithi043.stderr: -289> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 10 monclient: monmap: 2024-09-12T00:37:38.808 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:37:38.808 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:38.809 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:37:38.809 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:37:38.809 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:38.809 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:38.809 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:37:38.809 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:37:38.809 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:37:38.809 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.809 INFO:tasks.workunit.client.0.smithi043.stderr: -288> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb60) adding auth protocol: cephx 2024-09-12T00:37:38.809 INFO:tasks.workunit.client.0.smithi043.stderr: -287> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb60) adding auth protocol: cephx 2024-09-12T00:37:38.809 INFO:tasks.workunit.client.0.smithi043.stderr: -286> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb60) adding auth protocol: cephx 2024-09-12T00:37:38.809 INFO:tasks.workunit.client.0.smithi043.stderr: -285> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb60) adding con mode: secure 2024-09-12T00:37:38.809 INFO:tasks.workunit.client.0.smithi043.stderr: -284> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb60) adding con mode: crc 2024-09-12T00:37:38.810 INFO:tasks.workunit.client.0.smithi043.stderr: -283> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb60) adding con mode: secure 2024-09-12T00:37:38.810 INFO:tasks.workunit.client.0.smithi043.stderr: -282> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb60) adding con mode: crc 2024-09-12T00:37:38.810 INFO:tasks.workunit.client.0.smithi043.stderr: -281> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb60) adding con mode: secure 2024-09-12T00:37:38.810 INFO:tasks.workunit.client.0.smithi043.stderr: -280> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb60) adding con mode: crc 2024-09-12T00:37:38.810 INFO:tasks.workunit.client.0.smithi043.stderr: -279> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb60) adding con mode: crc 2024-09-12T00:37:38.810 INFO:tasks.workunit.client.0.smithi043.stderr: -278> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb60) adding con mode: secure 2024-09-12T00:37:38.810 INFO:tasks.workunit.client.0.smithi043.stderr: -277> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb60) adding con mode: crc 2024-09-12T00:37:38.810 INFO:tasks.workunit.client.0.smithi043.stderr: -276> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb60) adding con mode: secure 2024-09-12T00:37:38.810 INFO:tasks.workunit.client.0.smithi043.stderr: -275> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb60) adding con mode: crc 2024-09-12T00:37:38.810 INFO:tasks.workunit.client.0.smithi043.stderr: -274> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb60) adding con mode: secure 2024-09-12T00:37:38.810 INFO:tasks.workunit.client.0.smithi043.stderr: -273> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.810 INFO:tasks.workunit.client.0.smithi043.stderr: -272> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 10 monclient: init 2024-09-12T00:37:38.810 INFO:tasks.workunit.client.0.smithi043.stderr: -271> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96420) adding auth protocol: cephx 2024-09-12T00:37:38.811 INFO:tasks.workunit.client.0.smithi043.stderr: -270> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96420) adding auth protocol: cephx 2024-09-12T00:37:38.811 INFO:tasks.workunit.client.0.smithi043.stderr: -269> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96420) adding auth protocol: cephx 2024-09-12T00:37:38.811 INFO:tasks.workunit.client.0.smithi043.stderr: -268> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96420) adding con mode: secure 2024-09-12T00:37:38.811 INFO:tasks.workunit.client.0.smithi043.stderr: -267> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96420) adding con mode: crc 2024-09-12T00:37:38.811 INFO:tasks.workunit.client.0.smithi043.stderr: -266> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96420) adding con mode: secure 2024-09-12T00:37:38.811 INFO:tasks.workunit.client.0.smithi043.stderr: -265> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96420) adding con mode: crc 2024-09-12T00:37:38.811 INFO:tasks.workunit.client.0.smithi043.stderr: -264> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96420) adding con mode: secure 2024-09-12T00:37:38.811 INFO:tasks.workunit.client.0.smithi043.stderr: -263> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96420) adding con mode: crc 2024-09-12T00:37:38.811 INFO:tasks.workunit.client.0.smithi043.stderr: -262> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96420) adding con mode: crc 2024-09-12T00:37:38.811 INFO:tasks.workunit.client.0.smithi043.stderr: -261> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96420) adding con mode: secure 2024-09-12T00:37:38.811 INFO:tasks.workunit.client.0.smithi043.stderr: -260> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96420) adding con mode: crc 2024-09-12T00:37:38.811 INFO:tasks.workunit.client.0.smithi043.stderr: -259> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96420) adding con mode: secure 2024-09-12T00:37:38.812 INFO:tasks.workunit.client.0.smithi043.stderr: -258> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96420) adding con mode: crc 2024-09-12T00:37:38.812 INFO:tasks.workunit.client.0.smithi043.stderr: -257> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96420) adding con mode: secure 2024-09-12T00:37:38.812 INFO:tasks.workunit.client.0.smithi043.stderr: -256> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.812 INFO:tasks.workunit.client.0.smithi043.stderr: -255> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.812 INFO:tasks.workunit.client.0.smithi043.stderr: -254> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe14d96568 EEXIST 2024-09-12T00:37:38.812 INFO:tasks.workunit.client.0.smithi043.stderr: -253> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:38.812 INFO:tasks.workunit.client.0.smithi043.stderr: -252> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:37:38.812 INFO:tasks.workunit.client.0.smithi043.stderr: -251> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 10 monclient(hunting): picked mon.noname-a con 0x55987afab150 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:37:38.812 INFO:tasks.workunit.client.0.smithi043.stderr: -250> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 10 monclient(hunting): picked mon.noname-c con 0x55987afab530 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:37:38.812 INFO:tasks.workunit.client.0.smithi043.stderr: -249> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 10 monclient(hunting): picked mon.noname-b con 0x55987afac9f0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:37:38.812 INFO:tasks.workunit.client.0.smithi043.stderr: -248> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.812 INFO:tasks.workunit.client.0.smithi043.stderr: -247> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.812 INFO:tasks.workunit.client.0.smithi043.stderr: -246> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.813 INFO:tasks.workunit.client.0.smithi043.stderr: -245> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:38.813 INFO:tasks.workunit.client.0.smithi043.stderr: -244> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 10 monclient(hunting): authenticate will time out at 2154.682851s 2024-09-12T00:37:38.813 INFO:tasks.workunit.client.0.smithi043.stderr: -243> 2024-09-12T00:37:38.690+0000 7f4fabffc640 10 monclient(hunting): get_auth_request con 0x55987afab530 auth_method 0 2024-09-12T00:37:38.813 INFO:tasks.workunit.client.0.smithi043.stderr: -242> 2024-09-12T00:37:38.690+0000 7f4fabffc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.813 INFO:tasks.workunit.client.0.smithi043.stderr: -241> 2024-09-12T00:37:38.690+0000 7f4fabffc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.813 INFO:tasks.workunit.client.0.smithi043.stderr: -240> 2024-09-12T00:37:38.690+0000 7f4fabffc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.813 INFO:tasks.workunit.client.0.smithi043.stderr: -239> 2024-09-12T00:37:38.690+0000 7f4fac7fd640 10 monclient(hunting): get_auth_request con 0x55987afab150 auth_method 0 2024-09-12T00:37:38.813 INFO:tasks.workunit.client.0.smithi043.stderr: -238> 2024-09-12T00:37:38.690+0000 7f4fac7fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.813 INFO:tasks.workunit.client.0.smithi043.stderr: -237> 2024-09-12T00:37:38.690+0000 7f4fac7fd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.813 INFO:tasks.workunit.client.0.smithi043.stderr: -236> 2024-09-12T00:37:38.690+0000 7f4fac7fd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.813 INFO:tasks.workunit.client.0.smithi043.stderr: -235> 2024-09-12T00:37:38.690+0000 7f4fabffc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.813 INFO:tasks.workunit.client.0.smithi043.stderr: -234> 2024-09-12T00:37:38.690+0000 7f4fabffc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.814 INFO:tasks.workunit.client.0.smithi043.stderr: -233> 2024-09-12T00:37:38.690+0000 7f4fabffc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.814 INFO:tasks.workunit.client.0.smithi043.stderr: -232> 2024-09-12T00:37:38.690+0000 7f4fac7fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.814 INFO:tasks.workunit.client.0.smithi043.stderr: -231> 2024-09-12T00:37:38.690+0000 7f4fac7fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.814 INFO:tasks.workunit.client.0.smithi043.stderr: -230> 2024-09-12T00:37:38.690+0000 7f4fac7fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.814 INFO:tasks.workunit.client.0.smithi043.stderr: -229> 2024-09-12T00:37:38.690+0000 7f4facffe640 10 monclient(hunting): get_auth_request con 0x55987afac9f0 auth_method 0 2024-09-12T00:37:38.814 INFO:tasks.workunit.client.0.smithi043.stderr: -228> 2024-09-12T00:37:38.690+0000 7f4facffe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.814 INFO:tasks.workunit.client.0.smithi043.stderr: -227> 2024-09-12T00:37:38.690+0000 7f4facffe640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.814 INFO:tasks.workunit.client.0.smithi043.stderr: -226> 2024-09-12T00:37:38.690+0000 7f4facffe640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.814 INFO:tasks.workunit.client.0.smithi043.stderr: -225> 2024-09-12T00:37:38.690+0000 7f4fabffc640 10 monclient(hunting): handle_auth_done global_id 6527 payload 274 2024-09-12T00:37:38.814 INFO:tasks.workunit.client.0.smithi043.stderr: -224> 2024-09-12T00:37:38.690+0000 7f4fabffc640 10 monclient: _finish_hunting 0 2024-09-12T00:37:38.814 INFO:tasks.workunit.client.0.smithi043.stderr: -223> 2024-09-12T00:37:38.690+0000 7f4fabffc640 1 monclient: found mon.noname-c 2024-09-12T00:37:38.814 INFO:tasks.workunit.client.0.smithi043.stderr: -222> 2024-09-12T00:37:38.690+0000 7f4fabffc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:37:38.814 INFO:tasks.workunit.client.0.smithi043.stderr: -221> 2024-09-12T00:37:38.690+0000 7f4e837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.815 INFO:tasks.workunit.client.0.smithi043.stderr: -220> 2024-09-12T00:37:38.690+0000 7f4e837fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:37:38.815 INFO:tasks.workunit.client.0.smithi043.stderr: -219> 2024-09-12T00:37:38.690+0000 7f4e837fe640 10 monclient: dump: 2024-09-12T00:37:38.815 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:38.815 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:38.815 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.815 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.815 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.815 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:38.815 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:38.815 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:38.815 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:38.815 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.815 INFO:tasks.workunit.client.0.smithi043.stderr: -218> 2024-09-12T00:37:38.690+0000 7f4e837fe640 10 monclient: _finish_auth 0 2024-09-12T00:37:38.816 INFO:tasks.workunit.client.0.smithi043.stderr: -217> 2024-09-12T00:37:38.690+0000 7f4e837fe640 10 monclient: _check_auth_tickets 2024-09-12T00:37:38.816 INFO:tasks.workunit.client.0.smithi043.stderr: -216> 2024-09-12T00:37:38.690+0000 7f4e837fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:38.816 INFO:tasks.workunit.client.0.smithi043.stderr: -215> 2024-09-12T00:37:38.690+0000 7f4e837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.816 INFO:tasks.workunit.client.0.smithi043.stderr: -214> 2024-09-12T00:37:38.690+0000 7f4e837fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:37:38.816 INFO:tasks.workunit.client.0.smithi043.stderr: -213> 2024-09-12T00:37:38.690+0000 7f4e837fe640 10 monclient: dump: 2024-09-12T00:37:38.816 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:38.816 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:38.816 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.816 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.816 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.816 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:38.816 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:38.816 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:38.817 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:38.817 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.817 INFO:tasks.workunit.client.0.smithi043.stderr: -212> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 monclient: authenticate success, global_id 6527 2024-09-12T00:37:38.817 INFO:tasks.workunit.client.0.smithi043.stderr: -211> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 10 monclient: get_monmap_and_config success 2024-09-12T00:37:38.817 INFO:tasks.workunit.client.0.smithi043.stderr: -210> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 4 set_mon_vals no callback set 2024-09-12T00:37:38.817 INFO:tasks.workunit.client.0.smithi043.stderr: -209> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient: shutdown 2024-09-12T00:37:38.817 INFO:tasks.workunit.client.0.smithi043.stderr: -208> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient: build_initial_monmap 2024-09-12T00:37:38.817 INFO:tasks.workunit.client.0.smithi043.stderr: -207> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:38.817 INFO:tasks.workunit.client.0.smithi043.stderr: -206> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient: monmap: 2024-09-12T00:37:38.817 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:37:38.817 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:38.817 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:37:38.818 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:37:38.818 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:38.818 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:38.818 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:37:38.818 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:37:38.818 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:37:38.818 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.818 INFO:tasks.workunit.client.0.smithi043.stderr: -205> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb10) adding auth protocol: cephx 2024-09-12T00:37:38.818 INFO:tasks.workunit.client.0.smithi043.stderr: -204> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb10) adding auth protocol: cephx 2024-09-12T00:37:38.818 INFO:tasks.workunit.client.0.smithi043.stderr: -203> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb10) adding auth protocol: cephx 2024-09-12T00:37:38.818 INFO:tasks.workunit.client.0.smithi043.stderr: -202> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb10) adding con mode: secure 2024-09-12T00:37:38.818 INFO:tasks.workunit.client.0.smithi043.stderr: -201> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb10) adding con mode: crc 2024-09-12T00:37:38.818 INFO:tasks.workunit.client.0.smithi043.stderr: -200> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb10) adding con mode: secure 2024-09-12T00:37:38.819 INFO:tasks.workunit.client.0.smithi043.stderr: -199> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb10) adding con mode: crc 2024-09-12T00:37:38.819 INFO:tasks.workunit.client.0.smithi043.stderr: -198> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb10) adding con mode: secure 2024-09-12T00:37:38.819 INFO:tasks.workunit.client.0.smithi043.stderr: -197> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb10) adding con mode: crc 2024-09-12T00:37:38.819 INFO:tasks.workunit.client.0.smithi043.stderr: -196> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb10) adding con mode: crc 2024-09-12T00:37:38.819 INFO:tasks.workunit.client.0.smithi043.stderr: -195> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb10) adding con mode: secure 2024-09-12T00:37:38.819 INFO:tasks.workunit.client.0.smithi043.stderr: -194> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb10) adding con mode: crc 2024-09-12T00:37:38.819 INFO:tasks.workunit.client.0.smithi043.stderr: -193> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb10) adding con mode: secure 2024-09-12T00:37:38.819 INFO:tasks.workunit.client.0.smithi043.stderr: -192> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb10) adding con mode: crc 2024-09-12T00:37:38.819 INFO:tasks.workunit.client.0.smithi043.stderr: -191> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb10) adding con mode: secure 2024-09-12T00:37:38.819 INFO:tasks.workunit.client.0.smithi043.stderr: -190> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.819 INFO:tasks.workunit.client.0.smithi043.stderr: -189> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 1 librados: starting msgr at 2024-09-12T00:37:38.819 INFO:tasks.workunit.client.0.smithi043.stderr: -188> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 1 librados: starting objecter 2024-09-12T00:37:38.820 INFO:tasks.workunit.client.0.smithi043.stderr: -187> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command objecter_requests cmddesc objecter_requests hook 0x55987af5f160 EEXIST 2024-09-12T00:37:38.820 INFO:tasks.workunit.client.0.smithi043.stderr: -186> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 1 librados: setting wanted keys 2024-09-12T00:37:38.820 INFO:tasks.workunit.client.0.smithi043.stderr: -185> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 1 librados: calling monclient init 2024-09-12T00:37:38.820 INFO:tasks.workunit.client.0.smithi043.stderr: -184> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient: init 2024-09-12T00:37:38.820 INFO:tasks.workunit.client.0.smithi043.stderr: -183> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af5f6b0) adding auth protocol: cephx 2024-09-12T00:37:38.820 INFO:tasks.workunit.client.0.smithi043.stderr: -182> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af5f6b0) adding auth protocol: cephx 2024-09-12T00:37:38.820 INFO:tasks.workunit.client.0.smithi043.stderr: -181> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af5f6b0) adding auth protocol: cephx 2024-09-12T00:37:38.820 INFO:tasks.workunit.client.0.smithi043.stderr: -180> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af5f6b0) adding con mode: secure 2024-09-12T00:37:38.820 INFO:tasks.workunit.client.0.smithi043.stderr: -179> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af5f6b0) adding con mode: crc 2024-09-12T00:37:38.820 INFO:tasks.workunit.client.0.smithi043.stderr: -178> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af5f6b0) adding con mode: secure 2024-09-12T00:37:38.820 INFO:tasks.workunit.client.0.smithi043.stderr: -177> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af5f6b0) adding con mode: crc 2024-09-12T00:37:38.820 INFO:tasks.workunit.client.0.smithi043.stderr: -176> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af5f6b0) adding con mode: secure 2024-09-12T00:37:38.821 INFO:tasks.workunit.client.0.smithi043.stderr: -175> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af5f6b0) adding con mode: crc 2024-09-12T00:37:38.821 INFO:tasks.workunit.client.0.smithi043.stderr: -174> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af5f6b0) adding con mode: crc 2024-09-12T00:37:38.821 INFO:tasks.workunit.client.0.smithi043.stderr: -173> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af5f6b0) adding con mode: secure 2024-09-12T00:37:38.821 INFO:tasks.workunit.client.0.smithi043.stderr: -172> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af5f6b0) adding con mode: crc 2024-09-12T00:37:38.821 INFO:tasks.workunit.client.0.smithi043.stderr: -171> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af5f6b0) adding con mode: secure 2024-09-12T00:37:38.821 INFO:tasks.workunit.client.0.smithi043.stderr: -170> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af5f6b0) adding con mode: crc 2024-09-12T00:37:38.821 INFO:tasks.workunit.client.0.smithi043.stderr: -169> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af5f6b0) adding con mode: secure 2024-09-12T00:37:38.821 INFO:tasks.workunit.client.0.smithi043.stderr: -168> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.821 INFO:tasks.workunit.client.0.smithi043.stderr: -167> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.821 INFO:tasks.workunit.client.0.smithi043.stderr: -166> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command rotate-key cmddesc rotate-key hook 0x55987af5f7f8 EEXIST 2024-09-12T00:37:38.821 INFO:tasks.workunit.client.0.smithi043.stderr: -165> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:38.821 INFO:tasks.workunit.client.0.smithi043.stderr: -164> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:37:38.821 INFO:tasks.workunit.client.0.smithi043.stderr: -163> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient(hunting): picked mon.noname-b con 0x55987afab150 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:37:38.822 INFO:tasks.workunit.client.0.smithi043.stderr: -162> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient(hunting): picked mon.noname-c con 0x55987afac9f0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:37:38.822 INFO:tasks.workunit.client.0.smithi043.stderr: -161> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient(hunting): picked mon.noname-a con 0x55987afa4360 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:37:38.822 INFO:tasks.workunit.client.0.smithi043.stderr: -160> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.822 INFO:tasks.workunit.client.0.smithi043.stderr: -159> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.822 INFO:tasks.workunit.client.0.smithi043.stderr: -158> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.822 INFO:tasks.workunit.client.0.smithi043.stderr: -157> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:38.822 INFO:tasks.workunit.client.0.smithi043.stderr: -156> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient(hunting): authenticate will time out at 2154.685741s 2024-09-12T00:37:38.822 INFO:tasks.workunit.client.0.smithi043.stderr: -155> 2024-09-12T00:37:38.694+0000 7f4facffe640 10 monclient(hunting): get_auth_request con 0x55987afa4360 auth_method 0 2024-09-12T00:37:38.822 INFO:tasks.workunit.client.0.smithi043.stderr: -154> 2024-09-12T00:37:38.694+0000 7f4facffe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.822 INFO:tasks.workunit.client.0.smithi043.stderr: -153> 2024-09-12T00:37:38.694+0000 7f4facffe640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.822 INFO:tasks.workunit.client.0.smithi043.stderr: -152> 2024-09-12T00:37:38.694+0000 7f4facffe640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.822 INFO:tasks.workunit.client.0.smithi043.stderr: -151> 2024-09-12T00:37:38.694+0000 7f4facffe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.822 INFO:tasks.workunit.client.0.smithi043.stderr: -150> 2024-09-12T00:37:38.694+0000 7f4facffe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.823 INFO:tasks.workunit.client.0.smithi043.stderr: -149> 2024-09-12T00:37:38.694+0000 7f4facffe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.823 INFO:tasks.workunit.client.0.smithi043.stderr: -148> 2024-09-12T00:37:38.694+0000 7f4facffe640 10 monclient(hunting): handle_auth_done global_id 6819 payload 824 2024-09-12T00:37:38.823 INFO:tasks.workunit.client.0.smithi043.stderr: -147> 2024-09-12T00:37:38.694+0000 7f4facffe640 10 monclient: _finish_hunting 0 2024-09-12T00:37:38.823 INFO:tasks.workunit.client.0.smithi043.stderr: -146> 2024-09-12T00:37:38.694+0000 7f4facffe640 1 monclient: found mon.noname-a 2024-09-12T00:37:38.823 INFO:tasks.workunit.client.0.smithi043.stderr: -145> 2024-09-12T00:37:38.694+0000 7f4facffe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:37:38.823 INFO:tasks.workunit.client.0.smithi043.stderr: -144> 2024-09-12T00:37:38.694+0000 7f4fac7fd640 10 monclient: get_auth_request con 0x55987afab150 auth_method 0 2024-09-12T00:37:38.823 INFO:tasks.workunit.client.0.smithi043.stderr: -143> 2024-09-12T00:37:38.694+0000 7f4e81ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.823 INFO:tasks.workunit.client.0.smithi043.stderr: -142> 2024-09-12T00:37:38.694+0000 7f4e81ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:38.823 INFO:tasks.workunit.client.0.smithi043.stderr: -141> 2024-09-12T00:37:38.694+0000 7f4e81ffb640 10 monclient: dump: 2024-09-12T00:37:38.823 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:38.823 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:38.823 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.823 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.824 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.824 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:38.824 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:38.824 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:38.824 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:38.824 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.824 INFO:tasks.workunit.client.0.smithi043.stderr: -140> 2024-09-12T00:37:38.694+0000 7f4e81ffb640 10 monclient: _finish_auth 0 2024-09-12T00:37:38.824 INFO:tasks.workunit.client.0.smithi043.stderr: -139> 2024-09-12T00:37:38.694+0000 7f4e81ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:37:38.824 INFO:tasks.workunit.client.0.smithi043.stderr: -138> 2024-09-12T00:37:38.694+0000 7f4e81ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:38.824 INFO:tasks.workunit.client.0.smithi043.stderr: -137> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 monclient: authenticate success, global_id 6819 2024-09-12T00:37:38.824 INFO:tasks.workunit.client.0.smithi043.stderr: -136> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient: _renew_subs 2024-09-12T00:37:38.824 INFO:tasks.workunit.client.0.smithi043.stderr: -135> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:37:38.825 INFO:tasks.workunit.client.0.smithi043.stderr: -134> 2024-09-12T00:37:38.694+0000 7f4e81ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.825 INFO:tasks.workunit.client.0.smithi043.stderr: -133> 2024-09-12T00:37:38.694+0000 7f4e837fe640 4 set_mon_vals no callback set 2024-09-12T00:37:38.825 INFO:tasks.workunit.client.0.smithi043.stderr: -132> 2024-09-12T00:37:38.694+0000 7f4e81ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:38.825 INFO:tasks.workunit.client.0.smithi043.stderr: -131> 2024-09-12T00:37:38.694+0000 7f4e81ffb640 10 monclient: dump: 2024-09-12T00:37:38.825 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:38.825 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:38.825 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.825 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.825 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.825 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:38.825 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:38.825 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:38.826 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:38.826 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.826 INFO:tasks.workunit.client.0.smithi043.stderr: -130> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient: _renew_subs 2024-09-12T00:37:38.826 INFO:tasks.workunit.client.0.smithi043.stderr: -129> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:37:38.826 INFO:tasks.workunit.client.0.smithi043.stderr: -128> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 1 librados: init done 2024-09-12T00:37:38.826 INFO:tasks.workunit.client.0.smithi043.stderr: -127> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command cr dump hook 0x55987afa5288 2024-09-12T00:37:38.826 INFO:tasks.workunit.client.0.smithi043.stderr: -126> 2024-09-12T00:37:38.698+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.826 INFO:tasks.workunit.client.0.smithi043.stderr: -125> 2024-09-12T00:37:38.698+0000 7f4e81ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:38.826 INFO:tasks.workunit.client.0.smithi043.stderr: -124> 2024-09-12T00:37:38.698+0000 7f4e81ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:37:38.826 INFO:tasks.workunit.client.0.smithi043.stderr: -123> 2024-09-12T00:37:38.698+0000 7f4e81ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:37:38.826 INFO:tasks.workunit.client.0.smithi043.stderr: -122> 2024-09-12T00:37:38.698+0000 7f4fac7fd640 10 monclient: get_auth_request con 0x7f4e74070b10 auth_method 0 2024-09-12T00:37:38.826 INFO:tasks.workunit.client.0.smithi043.stderr: -121> 2024-09-12T00:37:38.698+0000 7f4fabffc640 10 monclient: get_auth_request con 0x55987afcb130 auth_method 0 2024-09-12T00:37:38.826 INFO:tasks.workunit.client.0.smithi043.stderr: -120> 2024-09-12T00:37:38.698+0000 7f4faecf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.826 INFO:tasks.workunit.client.0.smithi043.stderr: -119> 2024-09-12T00:37:38.698+0000 7f4faecf79c0 20 realm 2024-09-12T00:37:38.827 INFO:tasks.workunit.client.0.smithi043.stderr: -118> 2024-09-12T00:37:38.698+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.827 INFO:tasks.workunit.client.0.smithi043.stderr: -117> 2024-09-12T00:37:38.698+0000 7f4faecf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.827 INFO:tasks.workunit.client.0.smithi043.stderr: -116> 2024-09-12T00:37:38.698+0000 7f4faecf79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:38.827 INFO:tasks.workunit.client.0.smithi043.stderr: -115> 2024-09-12T00:37:38.698+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.827 INFO:tasks.workunit.client.0.smithi043.stderr: -114> 2024-09-12T00:37:38.698+0000 7f4faecf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.827 INFO:tasks.workunit.client.0.smithi043.stderr: -113> 2024-09-12T00:37:38.698+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.827 INFO:tasks.workunit.client.0.smithi043.stderr: -112> 2024-09-12T00:37:38.698+0000 7f4fac7fd640 10 monclient: get_auth_request con 0x55987afcf350 auth_method 0 2024-09-12T00:37:38.827 INFO:tasks.workunit.client.0.smithi043.stderr: -111> 2024-09-12T00:37:38.702+0000 7f4faecf79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:38.827 INFO:tasks.workunit.client.0.smithi043.stderr: -110> 2024-09-12T00:37:38.702+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.827 INFO:tasks.workunit.client.0.smithi043.stderr: -109> 2024-09-12T00:37:38.702+0000 7f4fabffc640 10 monclient: get_auth_request con 0x55987afd2b90 auth_method 0 2024-09-12T00:37:38.827 INFO:tasks.workunit.client.0.smithi043.stderr: -108> 2024-09-12T00:37:38.702+0000 7f4faecf79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:38.827 INFO:tasks.workunit.client.0.smithi043.stderr: -107> 2024-09-12T00:37:38.702+0000 7f4faecf79c0 20 searching for the correct realm 2024-09-12T00:37:38.827 INFO:tasks.workunit.client.0.smithi043.stderr: -106> 2024-09-12T00:37:38.702+0000 7f4facffe640 10 monclient: get_auth_request con 0x55987afd7890 auth_method 0 2024-09-12T00:37:38.828 INFO:tasks.workunit.client.0.smithi043.stderr: -105> 2024-09-12T00:37:38.702+0000 7f4fac7fd640 10 monclient: get_auth_request con 0x7f4fa4027030 auth_method 0 2024-09-12T00:37:38.828 INFO:tasks.workunit.client.0.smithi043.stderr: -104> 2024-09-12T00:37:38.706+0000 7f4fabffc640 10 monclient: get_auth_request con 0x7f4fa0086c20 auth_method 0 2024-09-12T00:37:38.828 INFO:tasks.workunit.client.0.smithi043.stderr: -103> 2024-09-12T00:37:38.710+0000 7f4fabffc640 0 -- 172.21.15.43:0/1017111121 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f4fa0086c20 msgr2=0x7f4fa008a5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:38.828 INFO:tasks.workunit.client.0.smithi043.stderr: -102> 2024-09-12T00:37:38.710+0000 7f4e81ffb640 1 client.6819.objecter ms_handle_reset 0x7f4fa0086c20 session 0x7f4fa0020070 osd.4 2024-09-12T00:37:38.828 INFO:tasks.workunit.client.0.smithi043.stderr: -101> 2024-09-12T00:37:38.710+0000 7f4e81ffb640 10 monclient: _renew_subs 2024-09-12T00:37:38.828 INFO:tasks.workunit.client.0.smithi043.stderr: -100> 2024-09-12T00:37:38.710+0000 7f4e81ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:37:38.828 INFO:tasks.workunit.client.0.smithi043.stderr: -99> 2024-09-12T00:37:38.710+0000 7f4facffe640 10 monclient: get_auth_request con 0x7f4fa0019070 auth_method 0 2024-09-12T00:37:38.828 INFO:tasks.workunit.client.0.smithi043.stderr: -98> 2024-09-12T00:37:38.710+0000 7f4fabffc640 10 monclient: get_auth_request con 0x7f4e74080b30 auth_method 0 2024-09-12T00:37:38.828 INFO:tasks.workunit.client.0.smithi043.stderr: -97> 2024-09-12T00:37:38.714+0000 7f4fac7fd640 10 monclient: get_auth_request con 0x7f4fa007db90 auth_method 0 2024-09-12T00:37:38.828 INFO:tasks.workunit.client.0.smithi043.stderr: -96> 2024-09-12T00:37:38.714+0000 7f4fabffc640 0 -- 172.21.15.43:0/1017111121 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f4e74080b30 msgr2=0x7f4e74082f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:38.828 INFO:tasks.workunit.client.0.smithi043.stderr: -95> 2024-09-12T00:37:38.714+0000 7f4e81ffb640 1 client.6819.objecter ms_handle_reset 0x7f4e74080b30 session 0x7f4fa0020070 osd.4 2024-09-12T00:37:38.828 INFO:tasks.workunit.client.0.smithi043.stderr: -94> 2024-09-12T00:37:38.714+0000 7f4fabffc640 10 monclient: get_auth_request con 0x7f4fa0086c20 auth_method 0 2024-09-12T00:37:38.829 INFO:tasks.workunit.client.0.smithi043.stderr: -93> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:37:38.829 INFO:tasks.workunit.client.0.smithi043.stderr: -92> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:38.829 INFO:tasks.workunit.client.0.smithi043.stderr: -91> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:38.829 INFO:tasks.workunit.client.0.smithi043.stderr: -90> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:37:38.829 INFO:tasks.workunit.client.0.smithi043.stderr: -89> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:38.829 INFO:tasks.workunit.client.0.smithi043.stderr: -88> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:38.829 INFO:tasks.workunit.client.0.smithi043.stderr: -87> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.829 INFO:tasks.workunit.client.0.smithi043.stderr: -86> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.829 INFO:tasks.workunit.client.0.smithi043.stderr: -85> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.829 INFO:tasks.workunit.client.0.smithi043.stderr: -84> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:38.829 INFO:tasks.workunit.client.0.smithi043.stderr: -83> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.829 INFO:tasks.workunit.client.0.smithi043.stderr: -82> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:38.830 INFO:tasks.workunit.client.0.smithi043.stderr: -81> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 zone default found 2024-09-12T00:37:38.830 INFO:tasks.workunit.client.0.smithi043.stderr: -80> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 4 Realm: () 2024-09-12T00:37:38.830 INFO:tasks.workunit.client.0.smithi043.stderr: -79> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:37:38.830 INFO:tasks.workunit.client.0.smithi043.stderr: -78> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:37:38.830 INFO:tasks.workunit.client.0.smithi043.stderr: -77> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:38.830 INFO:tasks.workunit.client.0.smithi043.stderr: -76> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 zonegroup default 2024-09-12T00:37:38.830 INFO:tasks.workunit.client.0.smithi043.stderr: -75> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.830 INFO:tasks.workunit.client.0.smithi043.stderr: -74> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.830 INFO:tasks.workunit.client.0.smithi043.stderr: -73> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.830 INFO:tasks.workunit.client.0.smithi043.stderr: -72> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.830 INFO:tasks.workunit.client.0.smithi043.stderr: -71> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.830 INFO:tasks.workunit.client.0.smithi043.stderr: -70> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.831 INFO:tasks.workunit.client.0.smithi043.stderr: -69> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 started sync module instance, tier type = 2024-09-12T00:37:38.831 INFO:tasks.workunit.client.0.smithi043.stderr: -68> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:37:38.831 INFO:tasks.workunit.client.0.smithi043.stderr: -67> 2024-09-12T00:37:38.738+0000 7f4faecf79c0 20 add_watcher() i=0 2024-09-12T00:37:38.831 INFO:tasks.workunit.client.0.smithi043.stderr: -66> 2024-09-12T00:37:38.738+0000 7f4faecf79c0 20 add_watcher() i=1 2024-09-12T00:37:38.831 INFO:tasks.workunit.client.0.smithi043.stderr: -65> 2024-09-12T00:37:38.738+0000 7f4faecf79c0 20 add_watcher() i=2 2024-09-12T00:37:38.831 INFO:tasks.workunit.client.0.smithi043.stderr: -64> 2024-09-12T00:37:38.738+0000 7f4faecf79c0 20 add_watcher() i=3 2024-09-12T00:37:38.831 INFO:tasks.workunit.client.0.smithi043.stderr: -63> 2024-09-12T00:37:38.738+0000 7f4faecf79c0 20 add_watcher() i=4 2024-09-12T00:37:38.831 INFO:tasks.workunit.client.0.smithi043.stderr: -62> 2024-09-12T00:37:38.738+0000 7f4faecf79c0 20 add_watcher() i=5 2024-09-12T00:37:38.831 INFO:tasks.workunit.client.0.smithi043.stderr: -61> 2024-09-12T00:37:38.738+0000 7f4faecf79c0 20 add_watcher() i=6 2024-09-12T00:37:38.831 INFO:tasks.workunit.client.0.smithi043.stderr: -60> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 20 add_watcher() i=7 2024-09-12T00:37:38.831 INFO:tasks.workunit.client.0.smithi043.stderr: -59> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:38.831 INFO:tasks.workunit.client.0.smithi043.stderr: -58> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96900) adding auth protocol: cephx 2024-09-12T00:37:38.831 INFO:tasks.workunit.client.0.smithi043.stderr: -57> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96900) adding auth protocol: cephx 2024-09-12T00:37:38.832 INFO:tasks.workunit.client.0.smithi043.stderr: -56> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96900) adding auth protocol: cephx 2024-09-12T00:37:38.832 INFO:tasks.workunit.client.0.smithi043.stderr: -55> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96900) adding con mode: secure 2024-09-12T00:37:38.832 INFO:tasks.workunit.client.0.smithi043.stderr: -54> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96900) adding con mode: crc 2024-09-12T00:37:38.832 INFO:tasks.workunit.client.0.smithi043.stderr: -53> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96900) adding con mode: secure 2024-09-12T00:37:38.832 INFO:tasks.workunit.client.0.smithi043.stderr: -52> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96900) adding con mode: crc 2024-09-12T00:37:38.832 INFO:tasks.workunit.client.0.smithi043.stderr: -51> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96900) adding con mode: secure 2024-09-12T00:37:38.832 INFO:tasks.workunit.client.0.smithi043.stderr: -50> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96900) adding con mode: crc 2024-09-12T00:37:38.832 INFO:tasks.workunit.client.0.smithi043.stderr: -49> 2024-09-12T00:37:38.742+0000 7f4e62fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:38.832 INFO:tasks.workunit.client.0.smithi043.stderr: -48> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96900) adding con mode: crc 2024-09-12T00:37:38.832 INFO:tasks.workunit.client.0.smithi043.stderr: -47> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96900) adding con mode: secure 2024-09-12T00:37:38.832 INFO:tasks.workunit.client.0.smithi043.stderr: -46> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96900) adding con mode: crc 2024-09-12T00:37:38.832 INFO:tasks.workunit.client.0.smithi043.stderr: -45> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96900) adding con mode: secure 2024-09-12T00:37:38.833 INFO:tasks.workunit.client.0.smithi043.stderr: -44> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96900) adding con mode: crc 2024-09-12T00:37:38.833 INFO:tasks.workunit.client.0.smithi043.stderr: -43> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96900) adding con mode: secure 2024-09-12T00:37:38.833 INFO:tasks.workunit.client.0.smithi043.stderr: -42> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.833 INFO:tasks.workunit.client.0.smithi043.stderr: -41> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:38.833 INFO:tasks.workunit.client.0.smithi043.stderr: -40> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:38.833 INFO:tasks.workunit.client.0.smithi043.stderr: -39> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command cache list hook 0x55987af9ec40 2024-09-12T00:37:38.833 INFO:tasks.workunit.client.0.smithi043.stderr: -38> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command cache inspect hook 0x55987af9ec40 2024-09-12T00:37:38.833 INFO:tasks.workunit.client.0.smithi043.stderr: -37> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command cache erase hook 0x55987af9ec40 2024-09-12T00:37:38.833 INFO:tasks.workunit.client.0.smithi043.stderr: -36> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command cache zap hook 0x55987af9ec40 2024-09-12T00:37:38.833 INFO:tasks.workunit.client.0.smithi043.stderr: -35> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 note: GC not initialized 2024-09-12T00:37:38.833 INFO:tasks.workunit.client.0.smithi043.stderr: -34> 2024-09-12T00:37:38.746+0000 7f4e61fdb640 20 reqs_thread_entry: start 2024-09-12T00:37:38.833 INFO:tasks.workunit.client.0.smithi043.stderr: -33> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command sync trace show hook 0x7f4f9c0ac4f0 2024-09-12T00:37:38.834 INFO:tasks.workunit.client.0.smithi043.stderr: -32> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command sync trace history hook 0x7f4f9c0ac4f0 2024-09-12T00:37:38.834 INFO:tasks.workunit.client.0.smithi043.stderr: -31> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command sync trace active hook 0x7f4f9c0ac4f0 2024-09-12T00:37:38.834 INFO:tasks.workunit.client.0.smithi043.stderr: -30> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command sync trace active_short hook 0x7f4f9c0ac4f0 2024-09-12T00:37:38.834 INFO:tasks.workunit.client.0.smithi043.stderr: -29> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:38.834 INFO:tasks.workunit.client.0.smithi043.stderr: -28> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 20 Filter name: none 2024-09-12T00:37:38.834 INFO:tasks.workunit.client.0.smithi043.stderr: -27> 2024-09-12T00:37:38.746+0000 7f4dd37fe640 20 reqs_thread_entry: start 2024-09-12T00:37:38.834 INFO:tasks.workunit.client.0.smithi043.stderr: -26> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:37:38.834 INFO:tasks.workunit.client.0.smithi043.stderr: -25> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.834 INFO:tasks.workunit.client.0.smithi043.stderr: -24> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:37:38.834 INFO:tasks.workunit.client.0.smithi043.stderr: -23> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:37:38.834 INFO:tasks.workunit.client.0.smithi043.stderr: -22> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:37:38.834 INFO:tasks.workunit.client.0.smithi043.stderr: -21> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 : miss 2024-09-12T00:37:38.834 INFO:tasks.workunit.client.0.smithi043.stderr: -20> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.835 INFO:tasks.workunit.client.0.smithi043.stderr: -19> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:37:38.835 INFO:tasks.workunit.client.0.smithi043.stderr: -18> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 info.flags=0x17 2024-09-12T00:37:38.835 INFO:tasks.workunit.client.0.smithi043.stderr: -17> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 to cache LRU end 2024-09-12T00:37:38.835 INFO:tasks.workunit.client.0.smithi043.stderr: -16> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:38.835 INFO:tasks.workunit.client.0.smithi043.stderr: -15> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:38.835 INFO:tasks.workunit.client.0.smithi043.stderr: -14> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 2024-09-12T00:37:38.835 INFO:tasks.workunit.client.0.smithi043.stderr: -13> 2024-09-12T00:37:38.754+0000 7f4faecf79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 info.flags=0x17 2024-09-12T00:37:38.835 INFO:tasks.workunit.client.0.smithi043.stderr: -12> 2024-09-12T00:37:38.754+0000 7f4faecf79c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 to cache LRU end 2024-09-12T00:37:38.835 INFO:tasks.workunit.client.0.smithi043.stderr: -11> 2024-09-12T00:37:38.754+0000 7f4faecf79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:38.835 INFO:tasks.workunit.client.0.smithi043.stderr: -10> 2024-09-12T00:37:38.754+0000 7f4faecf79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27, ofs0, ns] 2024-09-12T00:37:38.835 INFO:tasks.workunit.client.0.smithi043.stderr: -9> 2024-09-12T00:37:38.758+0000 7f4e82ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333520 cookie 94113386848096 notifier 6819 bl.length()=939 2024-09-12T00:37:38.835 INFO:tasks.workunit.client.0.smithi043.stderr: -8> 2024-09-12T00:37:38.758+0000 7f4e82ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 info.flags=0x17 2024-09-12T00:37:38.836 INFO:tasks.workunit.client.0.smithi043.stderr: -7> 2024-09-12T00:37:38.758+0000 7f4e82ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 to cache LRU end 2024-09-12T00:37:38.836 INFO:tasks.workunit.client.0.smithi043.stderr: -6> 2024-09-12T00:37:38.758+0000 7f4e82ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:38.836 INFO:tasks.workunit.client.0.smithi043.stderr: -5> 2024-09-12T00:37:38.758+0000 7f4faecf79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27]): orig_sources= new_sources= 2024-09-12T00:37:38.836 INFO:tasks.workunit.client.0.smithi043.stderr: -4> 2024-09-12T00:37:38.758+0000 7f4faecf79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27]): potential sources added=[] removed=[] 2024-09-12T00:37:38.836 INFO:tasks.workunit.client.0.smithi043.stderr: -3> 2024-09-12T00:37:38.758+0000 7f4faecf79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27]): orig_dests= new_dests= 2024-09-12T00:37:38.836 INFO:tasks.workunit.client.0.smithi043.stderr: -2> 2024-09-12T00:37:38.758+0000 7f4faecf79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27]): potential dests added=[] removed=[] 2024-09-12T00:37:38.836 INFO:tasks.workunit.client.0.smithi043.stderr: -1> 2024-09-12T00:37:38.758+0000 7f4faecf79c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4faecf79c0 time 2024-09-12T00:37:38.761952+0000 2024-09-12T00:37:38.836 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:37:38.836 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.836 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:38.836 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f4fb25d12eb] 2024-09-12T00:37:38.836 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4fb25d149f] 2024-09-12T00:37:38.837 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5598782cecc1] 2024-09-12T00:37:38.837 INFO:tasks.workunit.client.0.smithi043.stderr: 4: radosgw-admin(+0x1422a3e) [0x559878d2ca3e] 2024-09-12T00:37:38.837 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5598782e3ced] 2024-09-12T00:37:38.837 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:37:38.837 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4fb1437d90] 2024-09-12T00:37:38.837 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:37:38.837 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:37:38.837 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.837 INFO:tasks.workunit.client.0.smithi043.stderr: 0> 2024-09-12T00:37:38.758+0000 7f4faecf79c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:37:38.837 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7f4faecf79c0 thread_name:radosgw-admin 2024-09-12T00:37:38.837 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.837 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:38.838 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4fb1450520] 2024-09-12T00:37:38.838 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:37:38.838 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:37:38.838 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:37:38.838 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f4fb25d1345] 2024-09-12T00:37:38.838 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4fb25d149f] 2024-09-12T00:37:38.838 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5598782cecc1] 2024-09-12T00:37:38.838 INFO:tasks.workunit.client.0.smithi043.stderr: 8: radosgw-admin(+0x1422a3e) [0x559878d2ca3e] 2024-09-12T00:37:38.838 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5598782e3ced] 2024-09-12T00:37:38.838 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:37:38.838 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4fb1437d90] 2024-09-12T00:37:38.838 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:37:38.838 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:37:38.839 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:37:38.839 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.839 INFO:tasks.workunit.client.0.smithi043.stderr:--- logging levels --- 2024-09-12T00:37:38.839 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 none 2024-09-12T00:37:38.839 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 lockdep 2024-09-12T00:37:38.839 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 context 2024-09-12T00:37:38.839 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 crush 2024-09-12T00:37:38.839 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds 2024-09-12T00:37:38.839 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_balancer 2024-09-12T00:37:38.839 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_locker 2024-09-12T00:37:38.839 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log 2024-09-12T00:37:38.839 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log_expire 2024-09-12T00:37:38.840 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_migrator 2024-09-12T00:37:38.840 INFO:tasks.workunit.client.0.smithi043.stderr: 3/ 5 mds_quiesce 2024-09-12T00:37:38.840 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 buffer 2024-09-12T00:37:38.840 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 timer 2024-09-12T00:37:38.840 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 filer 2024-09-12T00:37:38.840 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 striper 2024-09-12T00:37:38.840 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 objecter 2024-09-12T00:37:38.840 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rados 2024-09-12T00:37:38.840 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd 2024-09-12T00:37:38.840 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_mirror 2024-09-12T00:37:38.840 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_replay 2024-09-12T00:37:38.840 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_pwl 2024-09-12T00:37:38.840 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 journaler 2024-09-12T00:37:38.841 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objectcacher 2024-09-12T00:37:38.841 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:37:38.841 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 client 2024-09-12T00:37:38.841 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 osd 2024-09-12T00:37:38.841 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 optracker 2024-09-12T00:37:38.841 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objclass 2024-09-12T00:37:38.841 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 filestore 2024-09-12T00:37:38.841 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 journal 2024-09-12T00:37:38.841 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 ms 2024-09-12T00:37:38.841 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mon 2024-09-12T00:37:38.841 INFO:tasks.workunit.client.0.smithi043.stderr: 0/10 monc 2024-09-12T00:37:38.841 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 paxos 2024-09-12T00:37:38.841 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 tp 2024-09-12T00:37:38.842 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 auth 2024-09-12T00:37:38.842 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 crypto 2024-09-12T00:37:38.842 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 finisher 2024-09-12T00:37:38.842 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 reserver 2024-09-12T00:37:38.842 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 heartbeatmap 2024-09-12T00:37:38.842 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 perfcounter 2024-09-12T00:37:38.842 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw 2024-09-12T00:37:38.842 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_sync 2024-09-12T00:37:38.842 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_datacache 2024-09-12T00:37:38.842 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_access 2024-09-12T00:37:38.842 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:37:38.842 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_flight 2024-09-12T00:37:38.843 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:37:38.843 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw_notification 2024-09-12T00:37:38.843 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 javaclient 2024-09-12T00:37:38.843 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 asok 2024-09-12T00:37:38.843 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 throttle 2024-09-12T00:37:38.843 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 refs 2024-09-12T00:37:38.843 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 compressor 2024-09-12T00:37:38.843 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluestore 2024-09-12T00:37:38.843 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluefs 2024-09-12T00:37:38.843 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 bdev 2024-09-12T00:37:38.843 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 kstore 2024-09-12T00:37:38.843 INFO:tasks.workunit.client.0.smithi043.stderr: 4/ 5 rocksdb 2024-09-12T00:37:38.843 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 fuse 2024-09-12T00:37:38.844 INFO:tasks.workunit.client.0.smithi043.stderr: 2/ 5 mgr 2024-09-12T00:37:38.844 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mgrc 2024-09-12T00:37:38.844 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 dpdk 2024-09-12T00:37:38.844 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 eventtrace 2024-09-12T00:37:38.844 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 prioritycache 2024-09-12T00:37:38.844 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 test 2024-09-12T00:37:38.844 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:37:38.844 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephsqlite 2024-09-12T00:37:38.844 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:37:38.844 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore 2024-09-12T00:37:38.844 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_onode 2024-09-12T00:37:38.844 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_odata 2024-09-12T00:37:38.845 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_omap 2024-09-12T00:37:38.845 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_tm 2024-09-12T00:37:38.845 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_t 2024-09-12T00:37:38.845 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:37:38.845 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_epm 2024-09-12T00:37:38.845 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_lba 2024-09-12T00:37:38.845 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:37:38.845 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cache 2024-09-12T00:37:38.845 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_journal 2024-09-12T00:37:38.845 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_device 2024-09-12T00:37:38.845 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_backref 2024-09-12T00:37:38.845 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 alienstore 2024-09-12T00:37:38.845 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mclock 2024-09-12T00:37:38.846 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cyanstore 2024-09-12T00:37:38.846 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 ceph_exporter 2024-09-12T00:37:38.846 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 memstore 2024-09-12T00:37:38.846 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 trace 2024-09-12T00:37:38.846 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 ceph_dedup 2024-09-12T00:37:38.846 INFO:tasks.workunit.client.0.smithi043.stderr: -2/-2 (syslog threshold) 2024-09-12T00:37:38.846 INFO:tasks.workunit.client.0.smithi043.stderr: 99/99 (stderr threshold) 2024-09-12T00:37:38.846 INFO:tasks.workunit.client.0.smithi043.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:37:38.846 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4dd37fe640 / http_manager 2024-09-12T00:37:38.846 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4e61fdb640 / http_manager 2024-09-12T00:37:38.846 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4e62fdd640 / rgw_dt_lg_renew 2024-09-12T00:37:38.846 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4e81ffb640 / ms_dispatch 2024-09-12T00:37:38.846 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4e82ffd640 / io_context_pool 2024-09-12T00:37:38.846 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4e837fe640 / io_context_pool 2024-09-12T00:37:38.847 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4e91ffb640 / ms_dispatch 2024-09-12T00:37:38.847 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4e98e09640 / ms_dispatch 2024-09-12T00:37:38.847 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4e9a60c640 / io_context_pool 2024-09-12T00:37:38.847 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4fabffc640 / msgr-worker-2 2024-09-12T00:37:38.847 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4fac7fd640 / msgr-worker-1 2024-09-12T00:37:38.847 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4facffe640 / msgr-worker-0 2024-09-12T00:37:38.847 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4fad7ff640 / io_context_pool 2024-09-12T00:37:38.847 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4faecf79c0 / radosgw-admin 2024-09-12T00:37:38.847 INFO:tasks.workunit.client.0.smithi043.stderr: max_recent 500 2024-09-12T00:37:38.847 INFO:tasks.workunit.client.0.smithi043.stderr: max_new 1000 2024-09-12T00:37:38.847 INFO:tasks.workunit.client.0.smithi043.stderr: log_file /var/log/ceph/ceph-client.admin.97946.log 2024-09-12T00:37:38.847 INFO:tasks.workunit.client.0.smithi043.stderr:--- end dump of recent events --- 2024-09-12T00:37:38.847 INFO:tasks.workunit.client.0.smithi043.stderr:--- begin dump of recent events --- 2024-09-12T00:37:38.848 INFO:tasks.workunit.client.0.smithi043.stderr: -499> 2024-09-12T00:37:38.674+0000 7f4fabffc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.848 INFO:tasks.workunit.client.0.smithi043.stderr: -498> 2024-09-12T00:37:38.674+0000 7f4fac7fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.848 INFO:tasks.workunit.client.0.smithi043.stderr: -497> 2024-09-12T00:37:38.674+0000 7f4fac7fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.848 INFO:tasks.workunit.client.0.smithi043.stderr: -496> 2024-09-12T00:37:38.674+0000 7f4fac7fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.848 INFO:tasks.workunit.client.0.smithi043.stderr: -495> 2024-09-12T00:37:38.674+0000 7f4fabffc640 10 monclient(hunting): handle_auth_done global_id 6807 payload 274 2024-09-12T00:37:38.848 INFO:tasks.workunit.client.0.smithi043.stderr: -494> 2024-09-12T00:37:38.674+0000 7f4fabffc640 10 monclient: _finish_hunting 0 2024-09-12T00:37:38.848 INFO:tasks.workunit.client.0.smithi043.stderr: -493> 2024-09-12T00:37:38.674+0000 7f4fabffc640 1 monclient: found mon.noname-a 2024-09-12T00:37:38.848 INFO:tasks.workunit.client.0.smithi043.stderr: -492> 2024-09-12T00:37:38.674+0000 7f4fabffc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:37:38.848 INFO:tasks.workunit.client.0.smithi043.stderr: -491> 2024-09-12T00:37:38.674+0000 7f4e9a60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.848 INFO:tasks.workunit.client.0.smithi043.stderr: -490> 2024-09-12T00:37:38.674+0000 7f4e9a60c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:38.848 INFO:tasks.workunit.client.0.smithi043.stderr: -489> 2024-09-12T00:37:38.674+0000 7f4e9a60c640 10 monclient: dump: 2024-09-12T00:37:38.848 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:38.848 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:38.849 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.849 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.849 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.849 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:38.849 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:38.849 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:38.849 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:38.849 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.849 INFO:tasks.workunit.client.0.smithi043.stderr: -488> 2024-09-12T00:37:38.674+0000 7f4e9a60c640 10 monclient: _finish_auth 0 2024-09-12T00:37:38.849 INFO:tasks.workunit.client.0.smithi043.stderr: -487> 2024-09-12T00:37:38.674+0000 7f4e9a60c640 10 monclient: _check_auth_tickets 2024-09-12T00:37:38.849 INFO:tasks.workunit.client.0.smithi043.stderr: -486> 2024-09-12T00:37:38.674+0000 7f4e9a60c640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:38.849 INFO:tasks.workunit.client.0.smithi043.stderr: -485> 2024-09-12T00:37:38.674+0000 7f4e9a60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.850 INFO:tasks.workunit.client.0.smithi043.stderr: -484> 2024-09-12T00:37:38.674+0000 7f4e9a60c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:38.850 INFO:tasks.workunit.client.0.smithi043.stderr: -483> 2024-09-12T00:37:38.674+0000 7f4e9a60c640 10 monclient: dump: 2024-09-12T00:37:38.850 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:38.850 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:38.850 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.850 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.850 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.850 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:38.850 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:38.850 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:38.850 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:38.850 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.851 INFO:tasks.workunit.client.0.smithi043.stderr: -482> 2024-09-12T00:37:38.674+0000 7f4faecf79c0 5 monclient: authenticate success, global_id 6807 2024-09-12T00:37:38.851 INFO:tasks.workunit.client.0.smithi043.stderr: -481> 2024-09-12T00:37:38.674+0000 7f4faecf79c0 10 monclient: get_monmap_and_config success 2024-09-12T00:37:38.851 INFO:tasks.workunit.client.0.smithi043.stderr: -480> 2024-09-12T00:37:38.674+0000 7f4faecf79c0 4 set_mon_vals no callback set 2024-09-12T00:37:38.851 INFO:tasks.workunit.client.0.smithi043.stderr: -479> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient: shutdown 2024-09-12T00:37:38.851 INFO:tasks.workunit.client.0.smithi043.stderr: -478> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 asok(0x55987acd92b0) unregister_commands rotate-key 2024-09-12T00:37:38.851 INFO:tasks.workunit.client.0.smithi043.stderr: -477> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient: build_initial_monmap 2024-09-12T00:37:38.851 INFO:tasks.workunit.client.0.smithi043.stderr: -476> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:38.851 INFO:tasks.workunit.client.0.smithi043.stderr: -475> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient: monmap: 2024-09-12T00:37:38.851 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:37:38.851 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:38.851 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:37:38.851 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:37:38.852 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:38.852 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:38.852 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:37:38.852 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:37:38.852 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:37:38.852 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.852 INFO:tasks.workunit.client.0.smithi043.stderr: -474> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee8810) adding auth protocol: cephx 2024-09-12T00:37:38.852 INFO:tasks.workunit.client.0.smithi043.stderr: -473> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee8810) adding auth protocol: cephx 2024-09-12T00:37:38.852 INFO:tasks.workunit.client.0.smithi043.stderr: -472> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee8810) adding auth protocol: cephx 2024-09-12T00:37:38.852 INFO:tasks.workunit.client.0.smithi043.stderr: -471> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee8810) adding con mode: secure 2024-09-12T00:37:38.852 INFO:tasks.workunit.client.0.smithi043.stderr: -470> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee8810) adding con mode: crc 2024-09-12T00:37:38.852 INFO:tasks.workunit.client.0.smithi043.stderr: -469> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee8810) adding con mode: secure 2024-09-12T00:37:38.852 INFO:tasks.workunit.client.0.smithi043.stderr: -468> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee8810) adding con mode: crc 2024-09-12T00:37:38.853 INFO:tasks.workunit.client.0.smithi043.stderr: -467> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee8810) adding con mode: secure 2024-09-12T00:37:38.853 INFO:tasks.workunit.client.0.smithi043.stderr: -466> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee8810) adding con mode: crc 2024-09-12T00:37:38.853 INFO:tasks.workunit.client.0.smithi043.stderr: -465> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee8810) adding con mode: crc 2024-09-12T00:37:38.853 INFO:tasks.workunit.client.0.smithi043.stderr: -464> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee8810) adding con mode: secure 2024-09-12T00:37:38.853 INFO:tasks.workunit.client.0.smithi043.stderr: -463> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee8810) adding con mode: crc 2024-09-12T00:37:38.853 INFO:tasks.workunit.client.0.smithi043.stderr: -462> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee8810) adding con mode: secure 2024-09-12T00:37:38.853 INFO:tasks.workunit.client.0.smithi043.stderr: -461> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee8810) adding con mode: crc 2024-09-12T00:37:38.853 INFO:tasks.workunit.client.0.smithi043.stderr: -460> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee8810) adding con mode: secure 2024-09-12T00:37:38.853 INFO:tasks.workunit.client.0.smithi043.stderr: -459> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.853 INFO:tasks.workunit.client.0.smithi043.stderr: -458> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 1 librados: starting msgr at 2024-09-12T00:37:38.853 INFO:tasks.workunit.client.0.smithi043.stderr: -457> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 1 librados: starting objecter 2024-09-12T00:37:38.854 INFO:tasks.workunit.client.0.smithi043.stderr: -456> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command objecter_requests hook 0x55987aee52a0 2024-09-12T00:37:38.854 INFO:tasks.workunit.client.0.smithi043.stderr: -455> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 1 librados: setting wanted keys 2024-09-12T00:37:38.854 INFO:tasks.workunit.client.0.smithi043.stderr: -454> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 1 librados: calling monclient init 2024-09-12T00:37:38.854 INFO:tasks.workunit.client.0.smithi043.stderr: -453> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient: init 2024-09-12T00:37:38.854 INFO:tasks.workunit.client.0.smithi043.stderr: -452> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee34c0) adding auth protocol: cephx 2024-09-12T00:37:38.854 INFO:tasks.workunit.client.0.smithi043.stderr: -451> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee34c0) adding auth protocol: cephx 2024-09-12T00:37:38.854 INFO:tasks.workunit.client.0.smithi043.stderr: -450> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee34c0) adding auth protocol: cephx 2024-09-12T00:37:38.854 INFO:tasks.workunit.client.0.smithi043.stderr: -449> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee34c0) adding con mode: secure 2024-09-12T00:37:38.854 INFO:tasks.workunit.client.0.smithi043.stderr: -448> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee34c0) adding con mode: crc 2024-09-12T00:37:38.854 INFO:tasks.workunit.client.0.smithi043.stderr: -447> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee34c0) adding con mode: secure 2024-09-12T00:37:38.854 INFO:tasks.workunit.client.0.smithi043.stderr: -446> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee34c0) adding con mode: crc 2024-09-12T00:37:38.854 INFO:tasks.workunit.client.0.smithi043.stderr: -445> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee34c0) adding con mode: secure 2024-09-12T00:37:38.854 INFO:tasks.workunit.client.0.smithi043.stderr: -444> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee34c0) adding con mode: crc 2024-09-12T00:37:38.855 INFO:tasks.workunit.client.0.smithi043.stderr: -443> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee34c0) adding con mode: crc 2024-09-12T00:37:38.855 INFO:tasks.workunit.client.0.smithi043.stderr: -442> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee34c0) adding con mode: secure 2024-09-12T00:37:38.855 INFO:tasks.workunit.client.0.smithi043.stderr: -441> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee34c0) adding con mode: crc 2024-09-12T00:37:38.855 INFO:tasks.workunit.client.0.smithi043.stderr: -440> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee34c0) adding con mode: secure 2024-09-12T00:37:38.855 INFO:tasks.workunit.client.0.smithi043.stderr: -439> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee34c0) adding con mode: crc 2024-09-12T00:37:38.855 INFO:tasks.workunit.client.0.smithi043.stderr: -438> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 AuthRegistry(0x55987aee34c0) adding con mode: secure 2024-09-12T00:37:38.855 INFO:tasks.workunit.client.0.smithi043.stderr: -437> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.855 INFO:tasks.workunit.client.0.smithi043.stderr: -436> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.855 INFO:tasks.workunit.client.0.smithi043.stderr: -435> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command rotate-key hook 0x55987aee3608 2024-09-12T00:37:38.855 INFO:tasks.workunit.client.0.smithi043.stderr: -434> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:38.855 INFO:tasks.workunit.client.0.smithi043.stderr: -433> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:37:38.855 INFO:tasks.workunit.client.0.smithi043.stderr: -432> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient(hunting): picked mon.noname-b con 0x55987ad732c0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:37:38.856 INFO:tasks.workunit.client.0.smithi043.stderr: -431> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient(hunting): picked mon.noname-a con 0x55987ad73a70 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:37:38.856 INFO:tasks.workunit.client.0.smithi043.stderr: -430> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient(hunting): picked mon.noname-c con 0x55987ae292d0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:37:38.856 INFO:tasks.workunit.client.0.smithi043.stderr: -429> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.856 INFO:tasks.workunit.client.0.smithi043.stderr: -428> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.856 INFO:tasks.workunit.client.0.smithi043.stderr: -427> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.856 INFO:tasks.workunit.client.0.smithi043.stderr: -426> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:38.856 INFO:tasks.workunit.client.0.smithi043.stderr: -425> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient(hunting): authenticate will time out at 2154.669719s 2024-09-12T00:37:38.856 INFO:tasks.workunit.client.0.smithi043.stderr: -424> 2024-09-12T00:37:38.678+0000 7f4fabffc640 10 monclient(hunting): get_auth_request con 0x55987ad73a70 auth_method 0 2024-09-12T00:37:38.856 INFO:tasks.workunit.client.0.smithi043.stderr: -423> 2024-09-12T00:37:38.678+0000 7f4fabffc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.856 INFO:tasks.workunit.client.0.smithi043.stderr: -422> 2024-09-12T00:37:38.678+0000 7f4fabffc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.856 INFO:tasks.workunit.client.0.smithi043.stderr: -421> 2024-09-12T00:37:38.678+0000 7f4fabffc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.856 INFO:tasks.workunit.client.0.smithi043.stderr: -420> 2024-09-12T00:37:38.678+0000 7f4facffe640 10 monclient(hunting): get_auth_request con 0x55987ae292d0 auth_method 0 2024-09-12T00:37:38.856 INFO:tasks.workunit.client.0.smithi043.stderr: -419> 2024-09-12T00:37:38.678+0000 7f4facffe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.857 INFO:tasks.workunit.client.0.smithi043.stderr: -418> 2024-09-12T00:37:38.678+0000 7f4facffe640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.857 INFO:tasks.workunit.client.0.smithi043.stderr: -417> 2024-09-12T00:37:38.678+0000 7f4facffe640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.857 INFO:tasks.workunit.client.0.smithi043.stderr: -416> 2024-09-12T00:37:38.678+0000 7f4fabffc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.857 INFO:tasks.workunit.client.0.smithi043.stderr: -415> 2024-09-12T00:37:38.678+0000 7f4fabffc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.857 INFO:tasks.workunit.client.0.smithi043.stderr: -414> 2024-09-12T00:37:38.678+0000 7f4fabffc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.857 INFO:tasks.workunit.client.0.smithi043.stderr: -413> 2024-09-12T00:37:38.678+0000 7f4facffe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.857 INFO:tasks.workunit.client.0.smithi043.stderr: -412> 2024-09-12T00:37:38.678+0000 7f4facffe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.857 INFO:tasks.workunit.client.0.smithi043.stderr: -411> 2024-09-12T00:37:38.678+0000 7f4facffe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.857 INFO:tasks.workunit.client.0.smithi043.stderr: -410> 2024-09-12T00:37:38.678+0000 7f4fac7fd640 10 monclient(hunting): get_auth_request con 0x55987ad732c0 auth_method 0 2024-09-12T00:37:38.857 INFO:tasks.workunit.client.0.smithi043.stderr: -409> 2024-09-12T00:37:38.678+0000 7f4fac7fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.857 INFO:tasks.workunit.client.0.smithi043.stderr: -408> 2024-09-12T00:37:38.678+0000 7f4fac7fd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.857 INFO:tasks.workunit.client.0.smithi043.stderr: -407> 2024-09-12T00:37:38.678+0000 7f4fac7fd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.857 INFO:tasks.workunit.client.0.smithi043.stderr: -406> 2024-09-12T00:37:38.678+0000 7f4fabffc640 10 monclient(hunting): handle_auth_done global_id 6810 payload 824 2024-09-12T00:37:38.858 INFO:tasks.workunit.client.0.smithi043.stderr: -405> 2024-09-12T00:37:38.678+0000 7f4fabffc640 10 monclient: _finish_hunting 0 2024-09-12T00:37:38.858 INFO:tasks.workunit.client.0.smithi043.stderr: -404> 2024-09-12T00:37:38.678+0000 7f4fabffc640 1 monclient: found mon.noname-a 2024-09-12T00:37:38.858 INFO:tasks.workunit.client.0.smithi043.stderr: -403> 2024-09-12T00:37:38.678+0000 7f4fabffc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:37:38.858 INFO:tasks.workunit.client.0.smithi043.stderr: -402> 2024-09-12T00:37:38.678+0000 7f4e98e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.858 INFO:tasks.workunit.client.0.smithi043.stderr: -401> 2024-09-12T00:37:38.678+0000 7f4e98e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:38.858 INFO:tasks.workunit.client.0.smithi043.stderr: -400> 2024-09-12T00:37:38.678+0000 7f4e98e09640 10 monclient: dump: 2024-09-12T00:37:38.858 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:38.858 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:38.858 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.858 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.858 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.858 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:38.858 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:38.858 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:38.858 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:38.859 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.859 INFO:tasks.workunit.client.0.smithi043.stderr: -399> 2024-09-12T00:37:38.678+0000 7f4e98e09640 10 monclient: _finish_auth 0 2024-09-12T00:37:38.859 INFO:tasks.workunit.client.0.smithi043.stderr: -398> 2024-09-12T00:37:38.678+0000 7f4e98e09640 10 monclient: _check_auth_tickets 2024-09-12T00:37:38.859 INFO:tasks.workunit.client.0.smithi043.stderr: -397> 2024-09-12T00:37:38.678+0000 7f4e98e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:38.859 INFO:tasks.workunit.client.0.smithi043.stderr: -396> 2024-09-12T00:37:38.678+0000 7f4e98e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.859 INFO:tasks.workunit.client.0.smithi043.stderr: -395> 2024-09-12T00:37:38.678+0000 7f4e98e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:38.859 INFO:tasks.workunit.client.0.smithi043.stderr: -394> 2024-09-12T00:37:38.678+0000 7f4e98e09640 10 monclient: dump: 2024-09-12T00:37:38.859 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:38.859 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:38.859 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.859 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.859 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.859 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:38.860 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:38.860 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:38.860 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:38.860 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.860 INFO:tasks.workunit.client.0.smithi043.stderr: -393> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 5 monclient: authenticate success, global_id 6810 2024-09-12T00:37:38.860 INFO:tasks.workunit.client.0.smithi043.stderr: -392> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient: _renew_subs 2024-09-12T00:37:38.860 INFO:tasks.workunit.client.0.smithi043.stderr: -391> 2024-09-12T00:37:38.678+0000 7f4e9a60c640 4 set_mon_vals no callback set 2024-09-12T00:37:38.860 INFO:tasks.workunit.client.0.smithi043.stderr: -390> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:37:38.860 INFO:tasks.workunit.client.0.smithi043.stderr: -389> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient: _renew_subs 2024-09-12T00:37:38.860 INFO:tasks.workunit.client.0.smithi043.stderr: -388> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:37:38.860 INFO:tasks.workunit.client.0.smithi043.stderr: -387> 2024-09-12T00:37:38.678+0000 7f4faecf79c0 1 librados: init done 2024-09-12T00:37:38.860 INFO:tasks.workunit.client.0.smithi043.stderr: -386> 2024-09-12T00:37:38.682+0000 7f4e98e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:38.860 INFO:tasks.workunit.client.0.smithi043.stderr: -385> 2024-09-12T00:37:38.682+0000 7f4e98e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:37:38.861 INFO:tasks.workunit.client.0.smithi043.stderr: -384> 2024-09-12T00:37:38.682+0000 7f4e98e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:37:38.861 INFO:tasks.workunit.client.0.smithi043.stderr: -383> 2024-09-12T00:37:38.682+0000 7f4fac7fd640 10 monclient: get_auth_request con 0x7f4e94070ae0 auth_method 0 2024-09-12T00:37:38.861 INFO:tasks.workunit.client.0.smithi043.stderr: -382> 2024-09-12T00:37:38.682+0000 7f4facffe640 10 monclient: get_auth_request con 0x55987af213f0 auth_method 0 2024-09-12T00:37:38.861 INFO:tasks.workunit.client.0.smithi043.stderr: -381> 2024-09-12T00:37:38.682+0000 7f4fac7fd640 10 monclient: get_auth_request con 0x55987af2cfd0 auth_method 0 2024-09-12T00:37:38.861 INFO:tasks.workunit.client.0.smithi043.stderr: -380> 2024-09-12T00:37:38.682+0000 7f4fabffc640 10 monclient: get_auth_request con 0x55987af311c0 auth_method 0 2024-09-12T00:37:38.861 INFO:tasks.workunit.client.0.smithi043.stderr: -379> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient: build_initial_monmap 2024-09-12T00:37:38.861 INFO:tasks.workunit.client.0.smithi043.stderr: -378> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:38.861 INFO:tasks.workunit.client.0.smithi043.stderr: -377> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient: monmap: 2024-09-12T00:37:38.861 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:37:38.861 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:38.861 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:37:38.861 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:37:38.861 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:38.862 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:38.862 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:37:38.862 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:37:38.862 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:37:38.862 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.862 INFO:tasks.workunit.client.0.smithi043.stderr: -376> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af35d70) adding auth protocol: cephx 2024-09-12T00:37:38.862 INFO:tasks.workunit.client.0.smithi043.stderr: -375> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af35d70) adding auth protocol: cephx 2024-09-12T00:37:38.862 INFO:tasks.workunit.client.0.smithi043.stderr: -374> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af35d70) adding auth protocol: cephx 2024-09-12T00:37:38.862 INFO:tasks.workunit.client.0.smithi043.stderr: -373> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af35d70) adding con mode: secure 2024-09-12T00:37:38.862 INFO:tasks.workunit.client.0.smithi043.stderr: -372> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af35d70) adding con mode: crc 2024-09-12T00:37:38.862 INFO:tasks.workunit.client.0.smithi043.stderr: -371> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af35d70) adding con mode: secure 2024-09-12T00:37:38.862 INFO:tasks.workunit.client.0.smithi043.stderr: -370> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af35d70) adding con mode: crc 2024-09-12T00:37:38.863 INFO:tasks.workunit.client.0.smithi043.stderr: -369> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af35d70) adding con mode: secure 2024-09-12T00:37:38.863 INFO:tasks.workunit.client.0.smithi043.stderr: -368> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af35d70) adding con mode: crc 2024-09-12T00:37:38.863 INFO:tasks.workunit.client.0.smithi043.stderr: -367> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af35d70) adding con mode: crc 2024-09-12T00:37:38.863 INFO:tasks.workunit.client.0.smithi043.stderr: -366> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af35d70) adding con mode: secure 2024-09-12T00:37:38.863 INFO:tasks.workunit.client.0.smithi043.stderr: -365> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af35d70) adding con mode: crc 2024-09-12T00:37:38.863 INFO:tasks.workunit.client.0.smithi043.stderr: -364> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af35d70) adding con mode: secure 2024-09-12T00:37:38.863 INFO:tasks.workunit.client.0.smithi043.stderr: -363> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af35d70) adding con mode: crc 2024-09-12T00:37:38.863 INFO:tasks.workunit.client.0.smithi043.stderr: -362> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af35d70) adding con mode: secure 2024-09-12T00:37:38.863 INFO:tasks.workunit.client.0.smithi043.stderr: -361> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.863 INFO:tasks.workunit.client.0.smithi043.stderr: -360> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command objecter_requests cmddesc objecter_requests hook 0x55987af396e0 EEXIST 2024-09-12T00:37:38.863 INFO:tasks.workunit.client.0.smithi043.stderr: -359> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient: init 2024-09-12T00:37:38.863 INFO:tasks.workunit.client.0.smithi043.stderr: -358> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af34448) adding auth protocol: cephx 2024-09-12T00:37:38.863 INFO:tasks.workunit.client.0.smithi043.stderr: -357> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af34448) adding auth protocol: cephx 2024-09-12T00:37:38.863 INFO:tasks.workunit.client.0.smithi043.stderr: -356> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af34448) adding auth protocol: cephx 2024-09-12T00:37:38.863 INFO:tasks.workunit.client.0.smithi043.stderr: -355> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af34448) adding con mode: secure 2024-09-12T00:37:38.864 INFO:tasks.workunit.client.0.smithi043.stderr: -354> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af34448) adding con mode: crc 2024-09-12T00:37:38.864 INFO:tasks.workunit.client.0.smithi043.stderr: -353> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af34448) adding con mode: secure 2024-09-12T00:37:38.864 INFO:tasks.workunit.client.0.smithi043.stderr: -352> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af34448) adding con mode: crc 2024-09-12T00:37:38.864 INFO:tasks.workunit.client.0.smithi043.stderr: -351> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af34448) adding con mode: secure 2024-09-12T00:37:38.864 INFO:tasks.workunit.client.0.smithi043.stderr: -350> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af34448) adding con mode: crc 2024-09-12T00:37:38.864 INFO:tasks.workunit.client.0.smithi043.stderr: -349> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af34448) adding con mode: crc 2024-09-12T00:37:38.864 INFO:tasks.workunit.client.0.smithi043.stderr: -348> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af34448) adding con mode: secure 2024-09-12T00:37:38.864 INFO:tasks.workunit.client.0.smithi043.stderr: -347> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af34448) adding con mode: crc 2024-09-12T00:37:38.864 INFO:tasks.workunit.client.0.smithi043.stderr: -346> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af34448) adding con mode: secure 2024-09-12T00:37:38.864 INFO:tasks.workunit.client.0.smithi043.stderr: -345> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af34448) adding con mode: crc 2024-09-12T00:37:38.864 INFO:tasks.workunit.client.0.smithi043.stderr: -344> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 AuthRegistry(0x55987af34448) adding con mode: secure 2024-09-12T00:37:38.864 INFO:tasks.workunit.client.0.smithi043.stderr: -343> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.864 INFO:tasks.workunit.client.0.smithi043.stderr: -342> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.864 INFO:tasks.workunit.client.0.smithi043.stderr: -341> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command rotate-key cmddesc rotate-key hook 0x55987af34590 EEXIST 2024-09-12T00:37:38.865 INFO:tasks.workunit.client.0.smithi043.stderr: -340> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:38.865 INFO:tasks.workunit.client.0.smithi043.stderr: -339> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:37:38.865 INFO:tasks.workunit.client.0.smithi043.stderr: -338> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient(hunting): picked mon.noname-c con 0x55987af5d890 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:37:38.865 INFO:tasks.workunit.client.0.smithi043.stderr: -337> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient(hunting): picked mon.noname-a con 0x55987af5d1c0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:37:38.865 INFO:tasks.workunit.client.0.smithi043.stderr: -336> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient(hunting): picked mon.noname-b con 0x55987af5bba0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:37:38.865 INFO:tasks.workunit.client.0.smithi043.stderr: -335> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.865 INFO:tasks.workunit.client.0.smithi043.stderr: -334> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.865 INFO:tasks.workunit.client.0.smithi043.stderr: -333> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.865 INFO:tasks.workunit.client.0.smithi043.stderr: -332> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:38.865 INFO:tasks.workunit.client.0.smithi043.stderr: -331> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient(hunting): authenticate will time out at 2154.678652s 2024-09-12T00:37:38.865 INFO:tasks.workunit.client.0.smithi043.stderr: -330> 2024-09-12T00:37:38.686+0000 7f4fabffc640 10 monclient(hunting): get_auth_request con 0x55987af5d1c0 auth_method 0 2024-09-12T00:37:38.865 INFO:tasks.workunit.client.0.smithi043.stderr: -329> 2024-09-12T00:37:38.686+0000 7f4fabffc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.866 INFO:tasks.workunit.client.0.smithi043.stderr: -328> 2024-09-12T00:37:38.686+0000 7f4fabffc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.866 INFO:tasks.workunit.client.0.smithi043.stderr: -327> 2024-09-12T00:37:38.686+0000 7f4fabffc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.866 INFO:tasks.workunit.client.0.smithi043.stderr: -326> 2024-09-12T00:37:38.686+0000 7f4fac7fd640 10 monclient(hunting): get_auth_request con 0x55987af5d890 auth_method 0 2024-09-12T00:37:38.866 INFO:tasks.workunit.client.0.smithi043.stderr: -325> 2024-09-12T00:37:38.686+0000 7f4fac7fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.866 INFO:tasks.workunit.client.0.smithi043.stderr: -324> 2024-09-12T00:37:38.686+0000 7f4fac7fd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.866 INFO:tasks.workunit.client.0.smithi043.stderr: -323> 2024-09-12T00:37:38.686+0000 7f4fac7fd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.866 INFO:tasks.workunit.client.0.smithi043.stderr: -322> 2024-09-12T00:37:38.686+0000 7f4fabffc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.866 INFO:tasks.workunit.client.0.smithi043.stderr: -321> 2024-09-12T00:37:38.686+0000 7f4fabffc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.866 INFO:tasks.workunit.client.0.smithi043.stderr: -320> 2024-09-12T00:37:38.686+0000 7f4fabffc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.866 INFO:tasks.workunit.client.0.smithi043.stderr: -319> 2024-09-12T00:37:38.686+0000 7f4fac7fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.866 INFO:tasks.workunit.client.0.smithi043.stderr: -318> 2024-09-12T00:37:38.686+0000 7f4fac7fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.866 INFO:tasks.workunit.client.0.smithi043.stderr: -317> 2024-09-12T00:37:38.686+0000 7f4fac7fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.866 INFO:tasks.workunit.client.0.smithi043.stderr: -316> 2024-09-12T00:37:38.686+0000 7f4fabffc640 10 monclient(hunting): handle_auth_done global_id 6813 payload 824 2024-09-12T00:37:38.867 INFO:tasks.workunit.client.0.smithi043.stderr: -315> 2024-09-12T00:37:38.686+0000 7f4fabffc640 10 monclient: _finish_hunting 0 2024-09-12T00:37:38.867 INFO:tasks.workunit.client.0.smithi043.stderr: -314> 2024-09-12T00:37:38.686+0000 7f4fabffc640 1 monclient: found mon.noname-a 2024-09-12T00:37:38.867 INFO:tasks.workunit.client.0.smithi043.stderr: -313> 2024-09-12T00:37:38.686+0000 7f4fabffc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:37:38.867 INFO:tasks.workunit.client.0.smithi043.stderr: -312> 2024-09-12T00:37:38.686+0000 7f4facffe640 10 monclient: get_auth_request con 0x55987af5bba0 auth_method 0 2024-09-12T00:37:38.867 INFO:tasks.workunit.client.0.smithi043.stderr: -311> 2024-09-12T00:37:38.686+0000 7f4e91ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.867 INFO:tasks.workunit.client.0.smithi043.stderr: -310> 2024-09-12T00:37:38.686+0000 7f4e91ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:38.867 INFO:tasks.workunit.client.0.smithi043.stderr: -309> 2024-09-12T00:37:38.686+0000 7f4e91ffb640 10 monclient: dump: 2024-09-12T00:37:38.867 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:38.867 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:38.867 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.867 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.867 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.867 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:38.868 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:38.868 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:38.868 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:38.868 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.868 INFO:tasks.workunit.client.0.smithi043.stderr: -308> 2024-09-12T00:37:38.686+0000 7f4e91ffb640 10 monclient: _finish_auth 0 2024-09-12T00:37:38.868 INFO:tasks.workunit.client.0.smithi043.stderr: -307> 2024-09-12T00:37:38.686+0000 7f4e91ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:37:38.868 INFO:tasks.workunit.client.0.smithi043.stderr: -306> 2024-09-12T00:37:38.686+0000 7f4e91ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:38.868 INFO:tasks.workunit.client.0.smithi043.stderr: -305> 2024-09-12T00:37:38.686+0000 7f4e91ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.868 INFO:tasks.workunit.client.0.smithi043.stderr: -304> 2024-09-12T00:37:38.686+0000 7f4e91ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:38.868 INFO:tasks.workunit.client.0.smithi043.stderr: -303> 2024-09-12T00:37:38.686+0000 7f4e91ffb640 10 monclient: dump: 2024-09-12T00:37:38.868 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:38.868 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:38.868 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.868 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.869 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.869 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:38.869 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:38.869 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:38.869 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:38.869 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.869 INFO:tasks.workunit.client.0.smithi043.stderr: -302> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 5 monclient: authenticate success, global_id 6813 2024-09-12T00:37:38.869 INFO:tasks.workunit.client.0.smithi043.stderr: -301> 2024-09-12T00:37:38.686+0000 7f4fad7ff640 4 set_mon_vals no callback set 2024-09-12T00:37:38.869 INFO:tasks.workunit.client.0.smithi043.stderr: -300> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient: _renew_subs 2024-09-12T00:37:38.869 INFO:tasks.workunit.client.0.smithi043.stderr: -299> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:37:38.869 INFO:tasks.workunit.client.0.smithi043.stderr: -298> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient: _renew_subs 2024-09-12T00:37:38.869 INFO:tasks.workunit.client.0.smithi043.stderr: -297> 2024-09-12T00:37:38.686+0000 7f4faecf79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:37:38.869 INFO:tasks.workunit.client.0.smithi043.stderr: -296> 2024-09-12T00:37:38.690+0000 7f4e91ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:38.870 INFO:tasks.workunit.client.0.smithi043.stderr: -295> 2024-09-12T00:37:38.690+0000 7f4e91ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:37:38.870 INFO:tasks.workunit.client.0.smithi043.stderr: -294> 2024-09-12T00:37:38.690+0000 7f4e91ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:37:38.870 INFO:tasks.workunit.client.0.smithi043.stderr: -293> 2024-09-12T00:37:38.690+0000 7f4fac7fd640 10 monclient: get_auth_request con 0x7f4e84070a20 auth_method 0 2024-09-12T00:37:38.870 INFO:tasks.workunit.client.0.smithi043.stderr: -292> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 10 monclient: get_monmap_and_config 2024-09-12T00:37:38.870 INFO:tasks.workunit.client.0.smithi043.stderr: -291> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 10 monclient: build_initial_monmap 2024-09-12T00:37:38.870 INFO:tasks.workunit.client.0.smithi043.stderr: -290> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:38.870 INFO:tasks.workunit.client.0.smithi043.stderr: -289> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 10 monclient: monmap: 2024-09-12T00:37:38.870 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:37:38.870 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:38.870 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:37:38.870 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:37:38.870 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:38.870 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:38.871 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:37:38.871 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:37:38.871 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:37:38.871 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.871 INFO:tasks.workunit.client.0.smithi043.stderr: -288> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb60) adding auth protocol: cephx 2024-09-12T00:37:38.871 INFO:tasks.workunit.client.0.smithi043.stderr: -287> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb60) adding auth protocol: cephx 2024-09-12T00:37:38.871 INFO:tasks.workunit.client.0.smithi043.stderr: -286> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb60) adding auth protocol: cephx 2024-09-12T00:37:38.871 INFO:tasks.workunit.client.0.smithi043.stderr: -285> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb60) adding con mode: secure 2024-09-12T00:37:38.871 INFO:tasks.workunit.client.0.smithi043.stderr: -284> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb60) adding con mode: crc 2024-09-12T00:37:38.871 INFO:tasks.workunit.client.0.smithi043.stderr: -283> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb60) adding con mode: secure 2024-09-12T00:37:38.871 INFO:tasks.workunit.client.0.smithi043.stderr: -282> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb60) adding con mode: crc 2024-09-12T00:37:38.871 INFO:tasks.workunit.client.0.smithi043.stderr: -281> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb60) adding con mode: secure 2024-09-12T00:37:38.871 INFO:tasks.workunit.client.0.smithi043.stderr: -280> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb60) adding con mode: crc 2024-09-12T00:37:38.872 INFO:tasks.workunit.client.0.smithi043.stderr: -279> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb60) adding con mode: crc 2024-09-12T00:37:38.872 INFO:tasks.workunit.client.0.smithi043.stderr: -278> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb60) adding con mode: secure 2024-09-12T00:37:38.872 INFO:tasks.workunit.client.0.smithi043.stderr: -277> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb60) adding con mode: crc 2024-09-12T00:37:38.872 INFO:tasks.workunit.client.0.smithi043.stderr: -276> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb60) adding con mode: secure 2024-09-12T00:37:38.872 INFO:tasks.workunit.client.0.smithi043.stderr: -275> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb60) adding con mode: crc 2024-09-12T00:37:38.872 INFO:tasks.workunit.client.0.smithi043.stderr: -274> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb60) adding con mode: secure 2024-09-12T00:37:38.872 INFO:tasks.workunit.client.0.smithi043.stderr: -273> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.872 INFO:tasks.workunit.client.0.smithi043.stderr: -272> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 10 monclient: init 2024-09-12T00:37:38.872 INFO:tasks.workunit.client.0.smithi043.stderr: -271> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96420) adding auth protocol: cephx 2024-09-12T00:37:38.872 INFO:tasks.workunit.client.0.smithi043.stderr: -270> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96420) adding auth protocol: cephx 2024-09-12T00:37:38.872 INFO:tasks.workunit.client.0.smithi043.stderr: -269> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96420) adding auth protocol: cephx 2024-09-12T00:37:38.872 INFO:tasks.workunit.client.0.smithi043.stderr: -268> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96420) adding con mode: secure 2024-09-12T00:37:38.872 INFO:tasks.workunit.client.0.smithi043.stderr: -267> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96420) adding con mode: crc 2024-09-12T00:37:38.872 INFO:tasks.workunit.client.0.smithi043.stderr: -266> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96420) adding con mode: secure 2024-09-12T00:37:38.873 INFO:tasks.workunit.client.0.smithi043.stderr: -265> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96420) adding con mode: crc 2024-09-12T00:37:38.873 INFO:tasks.workunit.client.0.smithi043.stderr: -264> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96420) adding con mode: secure 2024-09-12T00:37:38.873 INFO:tasks.workunit.client.0.smithi043.stderr: -263> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96420) adding con mode: crc 2024-09-12T00:37:38.873 INFO:tasks.workunit.client.0.smithi043.stderr: -262> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96420) adding con mode: crc 2024-09-12T00:37:38.873 INFO:tasks.workunit.client.0.smithi043.stderr: -261> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96420) adding con mode: secure 2024-09-12T00:37:38.873 INFO:tasks.workunit.client.0.smithi043.stderr: -260> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96420) adding con mode: crc 2024-09-12T00:37:38.873 INFO:tasks.workunit.client.0.smithi043.stderr: -259> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96420) adding con mode: secure 2024-09-12T00:37:38.873 INFO:tasks.workunit.client.0.smithi043.stderr: -258> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96420) adding con mode: crc 2024-09-12T00:37:38.873 INFO:tasks.workunit.client.0.smithi043.stderr: -257> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96420) adding con mode: secure 2024-09-12T00:37:38.873 INFO:tasks.workunit.client.0.smithi043.stderr: -256> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.873 INFO:tasks.workunit.client.0.smithi043.stderr: -255> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.873 INFO:tasks.workunit.client.0.smithi043.stderr: -254> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe14d96568 EEXIST 2024-09-12T00:37:38.873 INFO:tasks.workunit.client.0.smithi043.stderr: -253> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:38.874 INFO:tasks.workunit.client.0.smithi043.stderr: -252> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:37:38.874 INFO:tasks.workunit.client.0.smithi043.stderr: -251> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 10 monclient(hunting): picked mon.noname-a con 0x55987afab150 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:37:38.874 INFO:tasks.workunit.client.0.smithi043.stderr: -250> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 10 monclient(hunting): picked mon.noname-c con 0x55987afab530 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:37:38.874 INFO:tasks.workunit.client.0.smithi043.stderr: -249> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 10 monclient(hunting): picked mon.noname-b con 0x55987afac9f0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:37:38.874 INFO:tasks.workunit.client.0.smithi043.stderr: -248> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.874 INFO:tasks.workunit.client.0.smithi043.stderr: -247> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.874 INFO:tasks.workunit.client.0.smithi043.stderr: -246> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.874 INFO:tasks.workunit.client.0.smithi043.stderr: -245> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:38.874 INFO:tasks.workunit.client.0.smithi043.stderr: -244> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 10 monclient(hunting): authenticate will time out at 2154.682851s 2024-09-12T00:37:38.874 INFO:tasks.workunit.client.0.smithi043.stderr: -243> 2024-09-12T00:37:38.690+0000 7f4fabffc640 10 monclient(hunting): get_auth_request con 0x55987afab530 auth_method 0 2024-09-12T00:37:38.874 INFO:tasks.workunit.client.0.smithi043.stderr: -242> 2024-09-12T00:37:38.690+0000 7f4fabffc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.874 INFO:tasks.workunit.client.0.smithi043.stderr: -241> 2024-09-12T00:37:38.690+0000 7f4fabffc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.874 INFO:tasks.workunit.client.0.smithi043.stderr: -240> 2024-09-12T00:37:38.690+0000 7f4fabffc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.874 INFO:tasks.workunit.client.0.smithi043.stderr: -239> 2024-09-12T00:37:38.690+0000 7f4fac7fd640 10 monclient(hunting): get_auth_request con 0x55987afab150 auth_method 0 2024-09-12T00:37:38.875 INFO:tasks.workunit.client.0.smithi043.stderr: -238> 2024-09-12T00:37:38.690+0000 7f4fac7fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.875 INFO:tasks.workunit.client.0.smithi043.stderr: -237> 2024-09-12T00:37:38.690+0000 7f4fac7fd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.875 INFO:tasks.workunit.client.0.smithi043.stderr: -236> 2024-09-12T00:37:38.690+0000 7f4fac7fd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.875 INFO:tasks.workunit.client.0.smithi043.stderr: -235> 2024-09-12T00:37:38.690+0000 7f4fabffc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.875 INFO:tasks.workunit.client.0.smithi043.stderr: -234> 2024-09-12T00:37:38.690+0000 7f4fabffc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.875 INFO:tasks.workunit.client.0.smithi043.stderr: -233> 2024-09-12T00:37:38.690+0000 7f4fabffc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.875 INFO:tasks.workunit.client.0.smithi043.stderr: -232> 2024-09-12T00:37:38.690+0000 7f4fac7fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.875 INFO:tasks.workunit.client.0.smithi043.stderr: -231> 2024-09-12T00:37:38.690+0000 7f4fac7fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.875 INFO:tasks.workunit.client.0.smithi043.stderr: -230> 2024-09-12T00:37:38.690+0000 7f4fac7fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.875 INFO:tasks.workunit.client.0.smithi043.stderr: -229> 2024-09-12T00:37:38.690+0000 7f4facffe640 10 monclient(hunting): get_auth_request con 0x55987afac9f0 auth_method 0 2024-09-12T00:37:38.875 INFO:tasks.workunit.client.0.smithi043.stderr: -228> 2024-09-12T00:37:38.690+0000 7f4facffe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.875 INFO:tasks.workunit.client.0.smithi043.stderr: -227> 2024-09-12T00:37:38.690+0000 7f4facffe640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.875 INFO:tasks.workunit.client.0.smithi043.stderr: -226> 2024-09-12T00:37:38.690+0000 7f4facffe640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.875 INFO:tasks.workunit.client.0.smithi043.stderr: -225> 2024-09-12T00:37:38.690+0000 7f4fabffc640 10 monclient(hunting): handle_auth_done global_id 6527 payload 274 2024-09-12T00:37:38.876 INFO:tasks.workunit.client.0.smithi043.stderr: -224> 2024-09-12T00:37:38.690+0000 7f4fabffc640 10 monclient: _finish_hunting 0 2024-09-12T00:37:38.876 INFO:tasks.workunit.client.0.smithi043.stderr: -223> 2024-09-12T00:37:38.690+0000 7f4fabffc640 1 monclient: found mon.noname-c 2024-09-12T00:37:38.876 INFO:tasks.workunit.client.0.smithi043.stderr: -222> 2024-09-12T00:37:38.690+0000 7f4fabffc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:37:38.876 INFO:tasks.workunit.client.0.smithi043.stderr: -221> 2024-09-12T00:37:38.690+0000 7f4e837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.876 INFO:tasks.workunit.client.0.smithi043.stderr: -220> 2024-09-12T00:37:38.690+0000 7f4e837fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:37:38.876 INFO:tasks.workunit.client.0.smithi043.stderr: -219> 2024-09-12T00:37:38.690+0000 7f4e837fe640 10 monclient: dump: 2024-09-12T00:37:38.876 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:38.876 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:38.876 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.876 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.876 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.876 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:38.876 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:38.877 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:38.877 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:38.877 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.877 INFO:tasks.workunit.client.0.smithi043.stderr: -218> 2024-09-12T00:37:38.690+0000 7f4e837fe640 10 monclient: _finish_auth 0 2024-09-12T00:37:38.877 INFO:tasks.workunit.client.0.smithi043.stderr: -217> 2024-09-12T00:37:38.690+0000 7f4e837fe640 10 monclient: _check_auth_tickets 2024-09-12T00:37:38.877 INFO:tasks.workunit.client.0.smithi043.stderr: -216> 2024-09-12T00:37:38.690+0000 7f4e837fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:38.877 INFO:tasks.workunit.client.0.smithi043.stderr: -215> 2024-09-12T00:37:38.690+0000 7f4e837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.877 INFO:tasks.workunit.client.0.smithi043.stderr: -214> 2024-09-12T00:37:38.690+0000 7f4e837fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:37:38.877 INFO:tasks.workunit.client.0.smithi043.stderr: -213> 2024-09-12T00:37:38.690+0000 7f4e837fe640 10 monclient: dump: 2024-09-12T00:37:38.877 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:38.877 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:38.877 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.877 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.878 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.878 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:38.878 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:38.878 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:38.878 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:38.878 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.878 INFO:tasks.workunit.client.0.smithi043.stderr: -212> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 5 monclient: authenticate success, global_id 6527 2024-09-12T00:37:38.878 INFO:tasks.workunit.client.0.smithi043.stderr: -211> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 10 monclient: get_monmap_and_config success 2024-09-12T00:37:38.878 INFO:tasks.workunit.client.0.smithi043.stderr: -210> 2024-09-12T00:37:38.690+0000 7f4faecf79c0 4 set_mon_vals no callback set 2024-09-12T00:37:38.878 INFO:tasks.workunit.client.0.smithi043.stderr: -209> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient: shutdown 2024-09-12T00:37:38.878 INFO:tasks.workunit.client.0.smithi043.stderr: -208> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient: build_initial_monmap 2024-09-12T00:37:38.878 INFO:tasks.workunit.client.0.smithi043.stderr: -207> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:38.878 INFO:tasks.workunit.client.0.smithi043.stderr: -206> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient: monmap: 2024-09-12T00:37:38.879 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:37:38.879 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:38.879 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:37:38.879 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:37:38.879 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:38.879 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:38.879 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:37:38.879 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:37:38.879 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:37:38.879 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.879 INFO:tasks.workunit.client.0.smithi043.stderr: -205> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb10) adding auth protocol: cephx 2024-09-12T00:37:38.879 INFO:tasks.workunit.client.0.smithi043.stderr: -204> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb10) adding auth protocol: cephx 2024-09-12T00:37:38.879 INFO:tasks.workunit.client.0.smithi043.stderr: -203> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb10) adding auth protocol: cephx 2024-09-12T00:37:38.879 INFO:tasks.workunit.client.0.smithi043.stderr: -202> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb10) adding con mode: secure 2024-09-12T00:37:38.880 INFO:tasks.workunit.client.0.smithi043.stderr: -201> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb10) adding con mode: crc 2024-09-12T00:37:38.880 INFO:tasks.workunit.client.0.smithi043.stderr: -200> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb10) adding con mode: secure 2024-09-12T00:37:38.880 INFO:tasks.workunit.client.0.smithi043.stderr: -199> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb10) adding con mode: crc 2024-09-12T00:37:38.880 INFO:tasks.workunit.client.0.smithi043.stderr: -198> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb10) adding con mode: secure 2024-09-12T00:37:38.880 INFO:tasks.workunit.client.0.smithi043.stderr: -197> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb10) adding con mode: crc 2024-09-12T00:37:38.880 INFO:tasks.workunit.client.0.smithi043.stderr: -196> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb10) adding con mode: crc 2024-09-12T00:37:38.880 INFO:tasks.workunit.client.0.smithi043.stderr: -195> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb10) adding con mode: secure 2024-09-12T00:37:38.880 INFO:tasks.workunit.client.0.smithi043.stderr: -194> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb10) adding con mode: crc 2024-09-12T00:37:38.880 INFO:tasks.workunit.client.0.smithi043.stderr: -193> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb10) adding con mode: secure 2024-09-12T00:37:38.880 INFO:tasks.workunit.client.0.smithi043.stderr: -192> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb10) adding con mode: crc 2024-09-12T00:37:38.880 INFO:tasks.workunit.client.0.smithi043.stderr: -191> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af7cb10) adding con mode: secure 2024-09-12T00:37:38.880 INFO:tasks.workunit.client.0.smithi043.stderr: -190> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.881 INFO:tasks.workunit.client.0.smithi043.stderr: -189> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 1 librados: starting msgr at 2024-09-12T00:37:38.881 INFO:tasks.workunit.client.0.smithi043.stderr: -188> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 1 librados: starting objecter 2024-09-12T00:37:38.881 INFO:tasks.workunit.client.0.smithi043.stderr: -187> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command objecter_requests cmddesc objecter_requests hook 0x55987af5f160 EEXIST 2024-09-12T00:37:38.881 INFO:tasks.workunit.client.0.smithi043.stderr: -186> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 1 librados: setting wanted keys 2024-09-12T00:37:38.881 INFO:tasks.workunit.client.0.smithi043.stderr: -185> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 1 librados: calling monclient init 2024-09-12T00:37:38.881 INFO:tasks.workunit.client.0.smithi043.stderr: -184> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient: init 2024-09-12T00:37:38.881 INFO:tasks.workunit.client.0.smithi043.stderr: -183> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af5f6b0) adding auth protocol: cephx 2024-09-12T00:37:38.881 INFO:tasks.workunit.client.0.smithi043.stderr: -182> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af5f6b0) adding auth protocol: cephx 2024-09-12T00:37:38.881 INFO:tasks.workunit.client.0.smithi043.stderr: -181> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af5f6b0) adding auth protocol: cephx 2024-09-12T00:37:38.881 INFO:tasks.workunit.client.0.smithi043.stderr: -180> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af5f6b0) adding con mode: secure 2024-09-12T00:37:38.881 INFO:tasks.workunit.client.0.smithi043.stderr: -179> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af5f6b0) adding con mode: crc 2024-09-12T00:37:38.881 INFO:tasks.workunit.client.0.smithi043.stderr: -178> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af5f6b0) adding con mode: secure 2024-09-12T00:37:38.881 INFO:tasks.workunit.client.0.smithi043.stderr: -177> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af5f6b0) adding con mode: crc 2024-09-12T00:37:38.882 INFO:tasks.workunit.client.0.smithi043.stderr: -176> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af5f6b0) adding con mode: secure 2024-09-12T00:37:38.882 INFO:tasks.workunit.client.0.smithi043.stderr: -175> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af5f6b0) adding con mode: crc 2024-09-12T00:37:38.882 INFO:tasks.workunit.client.0.smithi043.stderr: -174> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af5f6b0) adding con mode: crc 2024-09-12T00:37:38.882 INFO:tasks.workunit.client.0.smithi043.stderr: -173> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af5f6b0) adding con mode: secure 2024-09-12T00:37:38.882 INFO:tasks.workunit.client.0.smithi043.stderr: -172> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af5f6b0) adding con mode: crc 2024-09-12T00:37:38.882 INFO:tasks.workunit.client.0.smithi043.stderr: -171> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af5f6b0) adding con mode: secure 2024-09-12T00:37:38.882 INFO:tasks.workunit.client.0.smithi043.stderr: -170> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af5f6b0) adding con mode: crc 2024-09-12T00:37:38.882 INFO:tasks.workunit.client.0.smithi043.stderr: -169> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 AuthRegistry(0x55987af5f6b0) adding con mode: secure 2024-09-12T00:37:38.882 INFO:tasks.workunit.client.0.smithi043.stderr: -168> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.882 INFO:tasks.workunit.client.0.smithi043.stderr: -167> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.882 INFO:tasks.workunit.client.0.smithi043.stderr: -166> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command rotate-key cmddesc rotate-key hook 0x55987af5f7f8 EEXIST 2024-09-12T00:37:38.882 INFO:tasks.workunit.client.0.smithi043.stderr: -165> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:38.882 INFO:tasks.workunit.client.0.smithi043.stderr: -164> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:37:38.883 INFO:tasks.workunit.client.0.smithi043.stderr: -163> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient(hunting): picked mon.noname-b con 0x55987afab150 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:37:38.883 INFO:tasks.workunit.client.0.smithi043.stderr: -162> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient(hunting): picked mon.noname-c con 0x55987afac9f0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:37:38.883 INFO:tasks.workunit.client.0.smithi043.stderr: -161> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient(hunting): picked mon.noname-a con 0x55987afa4360 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:37:38.883 INFO:tasks.workunit.client.0.smithi043.stderr: -160> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.883 INFO:tasks.workunit.client.0.smithi043.stderr: -159> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.883 INFO:tasks.workunit.client.0.smithi043.stderr: -158> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.883 INFO:tasks.workunit.client.0.smithi043.stderr: -157> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:38.883 INFO:tasks.workunit.client.0.smithi043.stderr: -156> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient(hunting): authenticate will time out at 2154.685741s 2024-09-12T00:37:38.883 INFO:tasks.workunit.client.0.smithi043.stderr: -155> 2024-09-12T00:37:38.694+0000 7f4facffe640 10 monclient(hunting): get_auth_request con 0x55987afa4360 auth_method 0 2024-09-12T00:37:38.883 INFO:tasks.workunit.client.0.smithi043.stderr: -154> 2024-09-12T00:37:38.694+0000 7f4facffe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.883 INFO:tasks.workunit.client.0.smithi043.stderr: -153> 2024-09-12T00:37:38.694+0000 7f4facffe640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.883 INFO:tasks.workunit.client.0.smithi043.stderr: -152> 2024-09-12T00:37:38.694+0000 7f4facffe640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.883 INFO:tasks.workunit.client.0.smithi043.stderr: -151> 2024-09-12T00:37:38.694+0000 7f4facffe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.883 INFO:tasks.workunit.client.0.smithi043.stderr: -150> 2024-09-12T00:37:38.694+0000 7f4facffe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.883 INFO:tasks.workunit.client.0.smithi043.stderr: -149> 2024-09-12T00:37:38.694+0000 7f4facffe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.884 INFO:tasks.workunit.client.0.smithi043.stderr: -148> 2024-09-12T00:37:38.694+0000 7f4facffe640 10 monclient(hunting): handle_auth_done global_id 6819 payload 824 2024-09-12T00:37:38.884 INFO:tasks.workunit.client.0.smithi043.stderr: -147> 2024-09-12T00:37:38.694+0000 7f4facffe640 10 monclient: _finish_hunting 0 2024-09-12T00:37:38.884 INFO:tasks.workunit.client.0.smithi043.stderr: -146> 2024-09-12T00:37:38.694+0000 7f4facffe640 1 monclient: found mon.noname-a 2024-09-12T00:37:38.884 INFO:tasks.workunit.client.0.smithi043.stderr: -145> 2024-09-12T00:37:38.694+0000 7f4facffe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:37:38.884 INFO:tasks.workunit.client.0.smithi043.stderr: -144> 2024-09-12T00:37:38.694+0000 7f4fac7fd640 10 monclient: get_auth_request con 0x55987afab150 auth_method 0 2024-09-12T00:37:38.884 INFO:tasks.workunit.client.0.smithi043.stderr: -143> 2024-09-12T00:37:38.694+0000 7f4e81ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.884 INFO:tasks.workunit.client.0.smithi043.stderr: -142> 2024-09-12T00:37:38.694+0000 7f4e81ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:38.884 INFO:tasks.workunit.client.0.smithi043.stderr: -141> 2024-09-12T00:37:38.694+0000 7f4e81ffb640 10 monclient: dump: 2024-09-12T00:37:38.884 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:38.884 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:38.884 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.884 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.884 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.884 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:38.885 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:38.885 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:38.885 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:38.885 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.885 INFO:tasks.workunit.client.0.smithi043.stderr: -140> 2024-09-12T00:37:38.694+0000 7f4e81ffb640 10 monclient: _finish_auth 0 2024-09-12T00:37:38.885 INFO:tasks.workunit.client.0.smithi043.stderr: -139> 2024-09-12T00:37:38.694+0000 7f4e81ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:37:38.885 INFO:tasks.workunit.client.0.smithi043.stderr: -138> 2024-09-12T00:37:38.694+0000 7f4e81ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:38.885 INFO:tasks.workunit.client.0.smithi043.stderr: -137> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 monclient: authenticate success, global_id 6819 2024-09-12T00:37:38.885 INFO:tasks.workunit.client.0.smithi043.stderr: -136> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient: _renew_subs 2024-09-12T00:37:38.885 INFO:tasks.workunit.client.0.smithi043.stderr: -135> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:37:38.885 INFO:tasks.workunit.client.0.smithi043.stderr: -134> 2024-09-12T00:37:38.694+0000 7f4e81ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.885 INFO:tasks.workunit.client.0.smithi043.stderr: -133> 2024-09-12T00:37:38.694+0000 7f4e837fe640 4 set_mon_vals no callback set 2024-09-12T00:37:38.886 INFO:tasks.workunit.client.0.smithi043.stderr: -132> 2024-09-12T00:37:38.694+0000 7f4e81ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:38.886 INFO:tasks.workunit.client.0.smithi043.stderr: -131> 2024-09-12T00:37:38.694+0000 7f4e81ffb640 10 monclient: dump: 2024-09-12T00:37:38.886 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:37:38.886 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:37:38.886 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.886 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:37:38.886 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.886 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:37:38.886 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:37:38.886 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:37:38.886 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:37:38.886 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.886 INFO:tasks.workunit.client.0.smithi043.stderr: -130> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient: _renew_subs 2024-09-12T00:37:38.887 INFO:tasks.workunit.client.0.smithi043.stderr: -129> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:37:38.887 INFO:tasks.workunit.client.0.smithi043.stderr: -128> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 1 librados: init done 2024-09-12T00:37:38.887 INFO:tasks.workunit.client.0.smithi043.stderr: -127> 2024-09-12T00:37:38.694+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command cr dump hook 0x55987afa5288 2024-09-12T00:37:38.887 INFO:tasks.workunit.client.0.smithi043.stderr: -126> 2024-09-12T00:37:38.698+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.887 INFO:tasks.workunit.client.0.smithi043.stderr: -125> 2024-09-12T00:37:38.698+0000 7f4e81ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:38.887 INFO:tasks.workunit.client.0.smithi043.stderr: -124> 2024-09-12T00:37:38.698+0000 7f4e81ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:37:38.887 INFO:tasks.workunit.client.0.smithi043.stderr: -123> 2024-09-12T00:37:38.698+0000 7f4e81ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:37:38.887 INFO:tasks.workunit.client.0.smithi043.stderr: -122> 2024-09-12T00:37:38.698+0000 7f4fac7fd640 10 monclient: get_auth_request con 0x7f4e74070b10 auth_method 0 2024-09-12T00:37:38.887 INFO:tasks.workunit.client.0.smithi043.stderr: -121> 2024-09-12T00:37:38.698+0000 7f4fabffc640 10 monclient: get_auth_request con 0x55987afcb130 auth_method 0 2024-09-12T00:37:38.887 INFO:tasks.workunit.client.0.smithi043.stderr: -120> 2024-09-12T00:37:38.698+0000 7f4faecf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.887 INFO:tasks.workunit.client.0.smithi043.stderr: -119> 2024-09-12T00:37:38.698+0000 7f4faecf79c0 20 realm 2024-09-12T00:37:38.887 INFO:tasks.workunit.client.0.smithi043.stderr: -118> 2024-09-12T00:37:38.698+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.887 INFO:tasks.workunit.client.0.smithi043.stderr: -117> 2024-09-12T00:37:38.698+0000 7f4faecf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.887 INFO:tasks.workunit.client.0.smithi043.stderr: -116> 2024-09-12T00:37:38.698+0000 7f4faecf79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:38.888 INFO:tasks.workunit.client.0.smithi043.stderr: -115> 2024-09-12T00:37:38.698+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.888 INFO:tasks.workunit.client.0.smithi043.stderr: -114> 2024-09-12T00:37:38.698+0000 7f4faecf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.888 INFO:tasks.workunit.client.0.smithi043.stderr: -113> 2024-09-12T00:37:38.698+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.888 INFO:tasks.workunit.client.0.smithi043.stderr: -112> 2024-09-12T00:37:38.698+0000 7f4fac7fd640 10 monclient: get_auth_request con 0x55987afcf350 auth_method 0 2024-09-12T00:37:38.888 INFO:tasks.workunit.client.0.smithi043.stderr: -111> 2024-09-12T00:37:38.702+0000 7f4faecf79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:38.888 INFO:tasks.workunit.client.0.smithi043.stderr: -110> 2024-09-12T00:37:38.702+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.888 INFO:tasks.workunit.client.0.smithi043.stderr: -109> 2024-09-12T00:37:38.702+0000 7f4fabffc640 10 monclient: get_auth_request con 0x55987afd2b90 auth_method 0 2024-09-12T00:37:38.888 INFO:tasks.workunit.client.0.smithi043.stderr: -108> 2024-09-12T00:37:38.702+0000 7f4faecf79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:38.888 INFO:tasks.workunit.client.0.smithi043.stderr: -107> 2024-09-12T00:37:38.702+0000 7f4faecf79c0 20 searching for the correct realm 2024-09-12T00:37:38.888 INFO:tasks.workunit.client.0.smithi043.stderr: -106> 2024-09-12T00:37:38.702+0000 7f4facffe640 10 monclient: get_auth_request con 0x55987afd7890 auth_method 0 2024-09-12T00:37:38.888 INFO:tasks.workunit.client.0.smithi043.stderr: -105> 2024-09-12T00:37:38.702+0000 7f4fac7fd640 10 monclient: get_auth_request con 0x7f4fa4027030 auth_method 0 2024-09-12T00:37:38.888 INFO:tasks.workunit.client.0.smithi043.stderr: -104> 2024-09-12T00:37:38.706+0000 7f4fabffc640 10 monclient: get_auth_request con 0x7f4fa0086c20 auth_method 0 2024-09-12T00:37:38.888 INFO:tasks.workunit.client.0.smithi043.stderr: -103> 2024-09-12T00:37:38.710+0000 7f4fabffc640 0 -- 172.21.15.43:0/1017111121 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f4fa0086c20 msgr2=0x7f4fa008a5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:38.888 INFO:tasks.workunit.client.0.smithi043.stderr: -102> 2024-09-12T00:37:38.710+0000 7f4e81ffb640 1 client.6819.objecter ms_handle_reset 0x7f4fa0086c20 session 0x7f4fa0020070 osd.4 2024-09-12T00:37:38.889 INFO:tasks.workunit.client.0.smithi043.stderr: -101> 2024-09-12T00:37:38.710+0000 7f4e81ffb640 10 monclient: _renew_subs 2024-09-12T00:37:38.889 INFO:tasks.workunit.client.0.smithi043.stderr: -100> 2024-09-12T00:37:38.710+0000 7f4e81ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:37:38.889 INFO:tasks.workunit.client.0.smithi043.stderr: -99> 2024-09-12T00:37:38.710+0000 7f4facffe640 10 monclient: get_auth_request con 0x7f4fa0019070 auth_method 0 2024-09-12T00:37:38.889 INFO:tasks.workunit.client.0.smithi043.stderr: -98> 2024-09-12T00:37:38.710+0000 7f4fabffc640 10 monclient: get_auth_request con 0x7f4e74080b30 auth_method 0 2024-09-12T00:37:38.889 INFO:tasks.workunit.client.0.smithi043.stderr: -97> 2024-09-12T00:37:38.714+0000 7f4fac7fd640 10 monclient: get_auth_request con 0x7f4fa007db90 auth_method 0 2024-09-12T00:37:38.889 INFO:tasks.workunit.client.0.smithi043.stderr: -96> 2024-09-12T00:37:38.714+0000 7f4fabffc640 0 -- 172.21.15.43:0/1017111121 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f4e74080b30 msgr2=0x7f4e74082f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:38.889 INFO:tasks.workunit.client.0.smithi043.stderr: -95> 2024-09-12T00:37:38.714+0000 7f4e81ffb640 1 client.6819.objecter ms_handle_reset 0x7f4e74080b30 session 0x7f4fa0020070 osd.4 2024-09-12T00:37:38.889 INFO:tasks.workunit.client.0.smithi043.stderr: -94> 2024-09-12T00:37:38.714+0000 7f4fabffc640 10 monclient: get_auth_request con 0x7f4fa0086c20 auth_method 0 2024-09-12T00:37:38.889 INFO:tasks.workunit.client.0.smithi043.stderr: -93> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:37:38.889 INFO:tasks.workunit.client.0.smithi043.stderr: -92> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:38.889 INFO:tasks.workunit.client.0.smithi043.stderr: -91> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:38.889 INFO:tasks.workunit.client.0.smithi043.stderr: -90> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:37:38.890 INFO:tasks.workunit.client.0.smithi043.stderr: -89> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:38.890 INFO:tasks.workunit.client.0.smithi043.stderr: -88> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:38.890 INFO:tasks.workunit.client.0.smithi043.stderr: -87> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.890 INFO:tasks.workunit.client.0.smithi043.stderr: -86> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.890 INFO:tasks.workunit.client.0.smithi043.stderr: -85> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.890 INFO:tasks.workunit.client.0.smithi043.stderr: -84> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:38.890 INFO:tasks.workunit.client.0.smithi043.stderr: -83> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.890 INFO:tasks.workunit.client.0.smithi043.stderr: -82> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:38.890 INFO:tasks.workunit.client.0.smithi043.stderr: -81> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 zone default found 2024-09-12T00:37:38.890 INFO:tasks.workunit.client.0.smithi043.stderr: -80> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 4 Realm: () 2024-09-12T00:37:38.890 INFO:tasks.workunit.client.0.smithi043.stderr: -79> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:37:38.890 INFO:tasks.workunit.client.0.smithi043.stderr: -78> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:37:38.891 INFO:tasks.workunit.client.0.smithi043.stderr: -77> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:38.891 INFO:tasks.workunit.client.0.smithi043.stderr: -76> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 zonegroup default 2024-09-12T00:37:38.891 INFO:tasks.workunit.client.0.smithi043.stderr: -75> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.891 INFO:tasks.workunit.client.0.smithi043.stderr: -74> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.891 INFO:tasks.workunit.client.0.smithi043.stderr: -73> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.891 INFO:tasks.workunit.client.0.smithi043.stderr: -72> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.891 INFO:tasks.workunit.client.0.smithi043.stderr: -71> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.891 INFO:tasks.workunit.client.0.smithi043.stderr: -70> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.891 INFO:tasks.workunit.client.0.smithi043.stderr: -69> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 started sync module instance, tier type = 2024-09-12T00:37:38.891 INFO:tasks.workunit.client.0.smithi043.stderr: -68> 2024-09-12T00:37:38.722+0000 7f4faecf79c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:37:38.891 INFO:tasks.workunit.client.0.smithi043.stderr: -67> 2024-09-12T00:37:38.738+0000 7f4faecf79c0 20 add_watcher() i=0 2024-09-12T00:37:38.891 INFO:tasks.workunit.client.0.smithi043.stderr: -66> 2024-09-12T00:37:38.738+0000 7f4faecf79c0 20 add_watcher() i=1 2024-09-12T00:37:38.891 INFO:tasks.workunit.client.0.smithi043.stderr: -65> 2024-09-12T00:37:38.738+0000 7f4faecf79c0 20 add_watcher() i=2 2024-09-12T00:37:38.892 INFO:tasks.workunit.client.0.smithi043.stderr: -64> 2024-09-12T00:37:38.738+0000 7f4faecf79c0 20 add_watcher() i=3 2024-09-12T00:37:38.892 INFO:tasks.workunit.client.0.smithi043.stderr: -63> 2024-09-12T00:37:38.738+0000 7f4faecf79c0 20 add_watcher() i=4 2024-09-12T00:37:38.892 INFO:tasks.workunit.client.0.smithi043.stderr: -62> 2024-09-12T00:37:38.738+0000 7f4faecf79c0 20 add_watcher() i=5 2024-09-12T00:37:38.892 INFO:tasks.workunit.client.0.smithi043.stderr: -61> 2024-09-12T00:37:38.738+0000 7f4faecf79c0 20 add_watcher() i=6 2024-09-12T00:37:38.892 INFO:tasks.workunit.client.0.smithi043.stderr: -60> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 20 add_watcher() i=7 2024-09-12T00:37:38.892 INFO:tasks.workunit.client.0.smithi043.stderr: -59> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:38.892 INFO:tasks.workunit.client.0.smithi043.stderr: -58> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96900) adding auth protocol: cephx 2024-09-12T00:37:38.892 INFO:tasks.workunit.client.0.smithi043.stderr: -57> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96900) adding auth protocol: cephx 2024-09-12T00:37:38.892 INFO:tasks.workunit.client.0.smithi043.stderr: -56> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96900) adding auth protocol: cephx 2024-09-12T00:37:38.892 INFO:tasks.workunit.client.0.smithi043.stderr: -55> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96900) adding con mode: secure 2024-09-12T00:37:38.892 INFO:tasks.workunit.client.0.smithi043.stderr: -54> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96900) adding con mode: crc 2024-09-12T00:37:38.892 INFO:tasks.workunit.client.0.smithi043.stderr: -53> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96900) adding con mode: secure 2024-09-12T00:37:38.893 INFO:tasks.workunit.client.0.smithi043.stderr: -52> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96900) adding con mode: crc 2024-09-12T00:37:38.893 INFO:tasks.workunit.client.0.smithi043.stderr: -51> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96900) adding con mode: secure 2024-09-12T00:37:38.893 INFO:tasks.workunit.client.0.smithi043.stderr: -50> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96900) adding con mode: crc 2024-09-12T00:37:38.893 INFO:tasks.workunit.client.0.smithi043.stderr: -49> 2024-09-12T00:37:38.742+0000 7f4e62fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:38.893 INFO:tasks.workunit.client.0.smithi043.stderr: -48> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96900) adding con mode: crc 2024-09-12T00:37:38.893 INFO:tasks.workunit.client.0.smithi043.stderr: -47> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96900) adding con mode: secure 2024-09-12T00:37:38.893 INFO:tasks.workunit.client.0.smithi043.stderr: -46> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96900) adding con mode: crc 2024-09-12T00:37:38.893 INFO:tasks.workunit.client.0.smithi043.stderr: -45> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96900) adding con mode: secure 2024-09-12T00:37:38.893 INFO:tasks.workunit.client.0.smithi043.stderr: -44> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96900) adding con mode: crc 2024-09-12T00:37:38.893 INFO:tasks.workunit.client.0.smithi043.stderr: -43> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 AuthRegistry(0x7ffe14d96900) adding con mode: secure 2024-09-12T00:37:38.893 INFO:tasks.workunit.client.0.smithi043.stderr: -42> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.893 INFO:tasks.workunit.client.0.smithi043.stderr: -41> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:38.893 INFO:tasks.workunit.client.0.smithi043.stderr: -40> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:38.893 INFO:tasks.workunit.client.0.smithi043.stderr: -39> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command cache list hook 0x55987af9ec40 2024-09-12T00:37:38.894 INFO:tasks.workunit.client.0.smithi043.stderr: -38> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command cache inspect hook 0x55987af9ec40 2024-09-12T00:37:38.894 INFO:tasks.workunit.client.0.smithi043.stderr: -37> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command cache erase hook 0x55987af9ec40 2024-09-12T00:37:38.894 INFO:tasks.workunit.client.0.smithi043.stderr: -36> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command cache zap hook 0x55987af9ec40 2024-09-12T00:37:38.894 INFO:tasks.workunit.client.0.smithi043.stderr: -35> 2024-09-12T00:37:38.742+0000 7f4faecf79c0 5 note: GC not initialized 2024-09-12T00:37:38.894 INFO:tasks.workunit.client.0.smithi043.stderr: -34> 2024-09-12T00:37:38.746+0000 7f4e61fdb640 20 reqs_thread_entry: start 2024-09-12T00:37:38.894 INFO:tasks.workunit.client.0.smithi043.stderr: -33> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command sync trace show hook 0x7f4f9c0ac4f0 2024-09-12T00:37:38.894 INFO:tasks.workunit.client.0.smithi043.stderr: -32> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command sync trace history hook 0x7f4f9c0ac4f0 2024-09-12T00:37:38.894 INFO:tasks.workunit.client.0.smithi043.stderr: -31> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command sync trace active hook 0x7f4f9c0ac4f0 2024-09-12T00:37:38.894 INFO:tasks.workunit.client.0.smithi043.stderr: -30> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 5 asok(0x55987acd92b0) register_command sync trace active_short hook 0x7f4f9c0ac4f0 2024-09-12T00:37:38.894 INFO:tasks.workunit.client.0.smithi043.stderr: -29> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:38.894 INFO:tasks.workunit.client.0.smithi043.stderr: -28> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 20 Filter name: none 2024-09-12T00:37:38.894 INFO:tasks.workunit.client.0.smithi043.stderr: -27> 2024-09-12T00:37:38.746+0000 7f4dd37fe640 20 reqs_thread_entry: start 2024-09-12T00:37:38.894 INFO:tasks.workunit.client.0.smithi043.stderr: -26> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:37:38.895 INFO:tasks.workunit.client.0.smithi043.stderr: -25> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.895 INFO:tasks.workunit.client.0.smithi043.stderr: -24> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:37:38.895 INFO:tasks.workunit.client.0.smithi043.stderr: -23> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:37:38.895 INFO:tasks.workunit.client.0.smithi043.stderr: -22> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:37:38.895 INFO:tasks.workunit.client.0.smithi043.stderr: -21> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 : miss 2024-09-12T00:37:38.895 INFO:tasks.workunit.client.0.smithi043.stderr: -20> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.895 INFO:tasks.workunit.client.0.smithi043.stderr: -19> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:37:38.895 INFO:tasks.workunit.client.0.smithi043.stderr: -18> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 info.flags=0x17 2024-09-12T00:37:38.895 INFO:tasks.workunit.client.0.smithi043.stderr: -17> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 to cache LRU end 2024-09-12T00:37:38.895 INFO:tasks.workunit.client.0.smithi043.stderr: -16> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:38.895 INFO:tasks.workunit.client.0.smithi043.stderr: -15> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:38.895 INFO:tasks.workunit.client.0.smithi043.stderr: -14> 2024-09-12T00:37:38.746+0000 7f4faecf79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 2024-09-12T00:37:38.895 INFO:tasks.workunit.client.0.smithi043.stderr: -13> 2024-09-12T00:37:38.754+0000 7f4faecf79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 info.flags=0x17 2024-09-12T00:37:38.895 INFO:tasks.workunit.client.0.smithi043.stderr: -12> 2024-09-12T00:37:38.754+0000 7f4faecf79c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 to cache LRU end 2024-09-12T00:37:38.896 INFO:tasks.workunit.client.0.smithi043.stderr: -11> 2024-09-12T00:37:38.754+0000 7f4faecf79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:38.896 INFO:tasks.workunit.client.0.smithi043.stderr: -10> 2024-09-12T00:37:38.754+0000 7f4faecf79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27, ofs0, ns] 2024-09-12T00:37:38.896 INFO:tasks.workunit.client.0.smithi043.stderr: -9> 2024-09-12T00:37:38.758+0000 7f4e82ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333520 cookie 94113386848096 notifier 6819 bl.length()=939 2024-09-12T00:37:38.896 INFO:tasks.workunit.client.0.smithi043.stderr: -8> 2024-09-12T00:37:38.758+0000 7f4e82ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 info.flags=0x17 2024-09-12T00:37:38.896 INFO:tasks.workunit.client.0.smithi043.stderr: -7> 2024-09-12T00:37:38.758+0000 7f4e82ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 to cache LRU end 2024-09-12T00:37:38.896 INFO:tasks.workunit.client.0.smithi043.stderr: -6> 2024-09-12T00:37:38.758+0000 7f4e82ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:38.896 INFO:tasks.workunit.client.0.smithi043.stderr: -5> 2024-09-12T00:37:38.758+0000 7f4faecf79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27]): orig_sources= new_sources= 2024-09-12T00:37:38.896 INFO:tasks.workunit.client.0.smithi043.stderr: -4> 2024-09-12T00:37:38.758+0000 7f4faecf79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27]): potential sources added=[] removed=[] 2024-09-12T00:37:38.896 INFO:tasks.workunit.client.0.smithi043.stderr: -3> 2024-09-12T00:37:38.758+0000 7f4faecf79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27]): orig_dests= new_dests= 2024-09-12T00:37:38.896 INFO:tasks.workunit.client.0.smithi043.stderr: -2> 2024-09-12T00:37:38.758+0000 7f4faecf79c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27]): potential dests added=[] removed=[] 2024-09-12T00:37:38.896 INFO:tasks.workunit.client.0.smithi043.stderr: -1> 2024-09-12T00:37:38.758+0000 7f4faecf79c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4faecf79c0 time 2024-09-12T00:37:38.761952+0000 2024-09-12T00:37:38.896 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:37:38.896 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.896 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:38.897 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f4fb25d12eb] 2024-09-12T00:37:38.897 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4fb25d149f] 2024-09-12T00:37:38.897 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5598782cecc1] 2024-09-12T00:37:38.897 INFO:tasks.workunit.client.0.smithi043.stderr: 4: radosgw-admin(+0x1422a3e) [0x559878d2ca3e] 2024-09-12T00:37:38.897 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5598782e3ced] 2024-09-12T00:37:38.897 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:37:38.897 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4fb1437d90] 2024-09-12T00:37:38.897 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:37:38.897 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:37:38.897 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.897 INFO:tasks.workunit.client.0.smithi043.stderr: 0> 2024-09-12T00:37:38.758+0000 7f4faecf79c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:37:38.897 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7f4faecf79c0 thread_name:radosgw-admin 2024-09-12T00:37:38.898 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.898 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:38.898 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4fb1450520] 2024-09-12T00:37:38.898 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:37:38.898 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:37:38.898 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:37:38.898 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f4fb25d1345] 2024-09-12T00:37:38.898 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4fb25d149f] 2024-09-12T00:37:38.898 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5598782cecc1] 2024-09-12T00:37:38.898 INFO:tasks.workunit.client.0.smithi043.stderr: 8: radosgw-admin(+0x1422a3e) [0x559878d2ca3e] 2024-09-12T00:37:38.898 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5598782e3ced] 2024-09-12T00:37:38.898 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:37:38.898 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4fb1437d90] 2024-09-12T00:37:38.899 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:37:38.899 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:37:38.899 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:37:38.899 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:38.899 INFO:tasks.workunit.client.0.smithi043.stderr:--- logging levels --- 2024-09-12T00:37:38.899 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 none 2024-09-12T00:37:38.899 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 lockdep 2024-09-12T00:37:38.899 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 context 2024-09-12T00:37:38.899 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 crush 2024-09-12T00:37:38.899 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds 2024-09-12T00:37:38.899 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_balancer 2024-09-12T00:37:38.899 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_locker 2024-09-12T00:37:38.900 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log 2024-09-12T00:37:38.900 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log_expire 2024-09-12T00:37:38.900 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_migrator 2024-09-12T00:37:38.900 INFO:tasks.workunit.client.0.smithi043.stderr: 3/ 5 mds_quiesce 2024-09-12T00:37:38.900 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 buffer 2024-09-12T00:37:38.900 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 timer 2024-09-12T00:37:38.900 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 filer 2024-09-12T00:37:38.900 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 striper 2024-09-12T00:37:38.900 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 objecter 2024-09-12T00:37:38.901 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rados 2024-09-12T00:37:38.901 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd 2024-09-12T00:37:38.901 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_mirror 2024-09-12T00:37:38.901 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_replay 2024-09-12T00:37:38.901 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_pwl 2024-09-12T00:37:38.901 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 journaler 2024-09-12T00:37:38.901 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objectcacher 2024-09-12T00:37:38.901 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:37:38.901 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 client 2024-09-12T00:37:38.901 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 osd 2024-09-12T00:37:38.901 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 optracker 2024-09-12T00:37:38.901 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objclass 2024-09-12T00:37:38.901 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 filestore 2024-09-12T00:37:38.902 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 journal 2024-09-12T00:37:38.902 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 ms 2024-09-12T00:37:38.902 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mon 2024-09-12T00:37:38.902 INFO:tasks.workunit.client.0.smithi043.stderr: 0/10 monc 2024-09-12T00:37:38.902 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 paxos 2024-09-12T00:37:38.902 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 tp 2024-09-12T00:37:38.902 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 auth 2024-09-12T00:37:38.902 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 crypto 2024-09-12T00:37:38.902 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 finisher 2024-09-12T00:37:38.902 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 reserver 2024-09-12T00:37:38.902 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 heartbeatmap 2024-09-12T00:37:38.902 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 perfcounter 2024-09-12T00:37:38.902 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw 2024-09-12T00:37:38.903 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_sync 2024-09-12T00:37:38.903 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_datacache 2024-09-12T00:37:38.903 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_access 2024-09-12T00:37:38.903 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:37:38.903 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_flight 2024-09-12T00:37:38.903 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:37:38.903 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw_notification 2024-09-12T00:37:38.903 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 javaclient 2024-09-12T00:37:38.903 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 asok 2024-09-12T00:37:38.903 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 throttle 2024-09-12T00:37:38.903 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 refs 2024-09-12T00:37:38.903 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 compressor 2024-09-12T00:37:38.903 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluestore 2024-09-12T00:37:38.904 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluefs 2024-09-12T00:37:38.904 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 bdev 2024-09-12T00:37:38.904 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 kstore 2024-09-12T00:37:38.904 INFO:tasks.workunit.client.0.smithi043.stderr: 4/ 5 rocksdb 2024-09-12T00:37:38.904 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 fuse 2024-09-12T00:37:38.904 INFO:tasks.workunit.client.0.smithi043.stderr: 2/ 5 mgr 2024-09-12T00:37:38.904 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mgrc 2024-09-12T00:37:38.904 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 dpdk 2024-09-12T00:37:38.904 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 eventtrace 2024-09-12T00:37:38.904 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 prioritycache 2024-09-12T00:37:38.904 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 test 2024-09-12T00:37:38.904 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:37:38.904 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephsqlite 2024-09-12T00:37:38.905 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:37:38.905 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore 2024-09-12T00:37:38.905 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_onode 2024-09-12T00:37:38.905 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_odata 2024-09-12T00:37:38.905 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_omap 2024-09-12T00:37:38.905 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_tm 2024-09-12T00:37:38.905 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_t 2024-09-12T00:37:38.905 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:37:38.905 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_epm 2024-09-12T00:37:38.905 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_lba 2024-09-12T00:37:38.905 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:37:38.905 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cache 2024-09-12T00:37:38.905 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_journal 2024-09-12T00:37:38.906 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_device 2024-09-12T00:37:38.906 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_backref 2024-09-12T00:37:38.906 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 alienstore 2024-09-12T00:37:38.906 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mclock 2024-09-12T00:37:38.906 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cyanstore 2024-09-12T00:37:38.906 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 ceph_exporter 2024-09-12T00:37:38.906 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 memstore 2024-09-12T00:37:38.906 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 trace 2024-09-12T00:37:38.906 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 ceph_dedup 2024-09-12T00:37:38.906 INFO:tasks.workunit.client.0.smithi043.stderr: -2/-2 (syslog threshold) 2024-09-12T00:37:38.906 INFO:tasks.workunit.client.0.smithi043.stderr: 99/99 (stderr threshold) 2024-09-12T00:37:38.906 INFO:tasks.workunit.client.0.smithi043.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:37:38.906 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4dd37fe640 / http_manager 2024-09-12T00:37:38.907 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4e61fdb640 / http_manager 2024-09-12T00:37:38.907 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4e62fdd640 / rgw_dt_lg_renew 2024-09-12T00:37:38.907 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4e81ffb640 / ms_dispatch 2024-09-12T00:37:38.907 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4e82ffd640 / io_context_pool 2024-09-12T00:37:38.907 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4e837fe640 / io_context_pool 2024-09-12T00:37:38.907 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4e91ffb640 / ms_dispatch 2024-09-12T00:37:38.907 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4e98e09640 / ms_dispatch 2024-09-12T00:37:38.907 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4e9a60c640 / io_context_pool 2024-09-12T00:37:38.907 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4fabffc640 / msgr-worker-2 2024-09-12T00:37:38.907 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4fac7fd640 / msgr-worker-1 2024-09-12T00:37:38.907 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4facffe640 / msgr-worker-0 2024-09-12T00:37:38.907 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4fad7ff640 / io_context_pool 2024-09-12T00:37:38.907 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4faecf79c0 / radosgw-admin 2024-09-12T00:37:38.908 INFO:tasks.workunit.client.0.smithi043.stderr: max_recent 500 2024-09-12T00:37:38.908 INFO:tasks.workunit.client.0.smithi043.stderr: max_new 1000 2024-09-12T00:37:38.908 INFO:tasks.workunit.client.0.smithi043.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:37:38.764406Z_9ea01dc4-da2f-4e1d-8746-0b349d602d45/log 2024-09-12T00:37:38.908 INFO:tasks.workunit.client.0.smithi043.stderr:--- end dump of recent events --- 2024-09-12T00:37:38.908 INFO:tasks.workunit.client.0.smithi043.stderr:Aborted 2024-09-12T00:37:38.908 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:37:38.909 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:38.909 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:38.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.838+0000 7fa0c21ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.842+0000 7fa0c21ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.842+0000 7fa0c21ce9c0 20 realm 2024-09-12T00:37:38.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.842+0000 7fa0c21ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.842+0000 7fa0c21ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.842+0000 7fa0c21ce9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:38.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.842+0000 7fa0c21ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.842+0000 7fa0c21ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.842+0000 7fa0c21ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.842+0000 7fa0c21ce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:38.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.842+0000 7fa0c21ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.842+0000 7fa0c21ce9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:38.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.842+0000 7fa0c21ce9c0 20 searching for the correct realm 2024-09-12T00:37:38.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.850+0000 7fa0bfcd4640 0 -- 172.21.15.43:0/941553742 >> [v2:172.21.15.97:6816/489545787,v1:172.21.15.97:6817/489545787] conn(0x7fa0b80c7040 msgr2=0x7fa0b8106100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:38.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:38.854+0000 7fa0bfcd4640 0 -- 172.21.15.43:0/941553742 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fa0b4028a80 msgr2=0x7fa0b4035420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:39.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.070+0000 7fa0c21ce9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:37:39.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.070+0000 7fa0c21ce9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:39.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.070+0000 7fa0c21ce9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:39.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.070+0000 7fa0c21ce9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:37:39.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.070+0000 7fa0c21ce9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:39.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.070+0000 7fa0c21ce9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:39.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.070+0000 7fa0c21ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.074+0000 7fa0c21ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:39.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.074+0000 7fa0c21ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.074+0000 7fa0c21ce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:39.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.074+0000 7fa0c21ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.075 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.074+0000 7fa0c21ce9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:39.075 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.074+0000 7fa0c21ce9c0 20 zone default found 2024-09-12T00:37:39.075 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.074+0000 7fa0c21ce9c0 4 Realm: () 2024-09-12T00:37:39.075 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.074+0000 7fa0c21ce9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:37:39.075 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.074+0000 7fa0c21ce9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:37:39.075 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.074+0000 7fa0c21ce9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:39.076 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.074+0000 7fa0c21ce9c0 20 zonegroup default 2024-09-12T00:37:39.076 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.074+0000 7fa0c21ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.076 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.074+0000 7fa0c21ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:39.076 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.074+0000 7fa0c21ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.076 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.074+0000 7fa0c21ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:39.076 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.074+0000 7fa0c21ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.077 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.078+0000 7fa0c21ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:39.077 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.078+0000 7fa0c21ce9c0 20 started sync module instance, tier type = 2024-09-12T00:37:39.077 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.078+0000 7fa0c21ce9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:37:39.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.098+0000 7fa0c21ce9c0 20 add_watcher() i=0 2024-09-12T00:37:39.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.098+0000 7fa0c21ce9c0 20 add_watcher() i=1 2024-09-12T00:37:39.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.098+0000 7fa0c21ce9c0 20 add_watcher() i=2 2024-09-12T00:37:39.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.098+0000 7fa0c21ce9c0 20 add_watcher() i=3 2024-09-12T00:37:39.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.098+0000 7fa0c21ce9c0 20 add_watcher() i=4 2024-09-12T00:37:39.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.098+0000 7fa0c21ce9c0 20 add_watcher() i=5 2024-09-12T00:37:39.099 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.098+0000 7fa0c21ce9c0 20 add_watcher() i=6 2024-09-12T00:37:39.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.102+0000 7fa0c21ce9c0 20 add_watcher() i=7 2024-09-12T00:37:39.105 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.102+0000 7fa0c21ce9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:39.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.106+0000 7f9f75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:39.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.110+0000 7fa0c21ce9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:39.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.110+0000 7fa0c21ce9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:39.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.110+0000 7fa0c21ce9c0 5 note: GC not initialized 2024-09-12T00:37:39.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.110+0000 7f9f74fe1640 20 reqs_thread_entry: start 2024-09-12T00:37:39.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.110+0000 7fa0c21ce9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:39.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.110+0000 7fa0c21ce9c0 20 Filter name: none 2024-09-12T00:37:39.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.110+0000 7f9eee7fc640 20 reqs_thread_entry: start 2024-09-12T00:37:39.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.110+0000 7fa0c21ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.110+0000 7fa0c21ce9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:37:39.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.110+0000 7fa0c21ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.114+0000 7fa0c21ce9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:37:39.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.114+0000 7fa0c21ce9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:39.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.114+0000 7fa0c21ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.114+0000 7fa0c21ce9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:37:39.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.114+0000 7fa0c21ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.114+0000 7fa0c21ce9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:37:39.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.114+0000 7fa0c21ce9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:39.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.118+0000 7f9f75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:39.125 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.122+0000 7fa0c21ce9c0 20 remove_watcher() i=0 2024-09-12T00:37:39.125 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.122+0000 7fa0c21ce9c0 2 removed watcher, disabling cache 2024-09-12T00:37:39.127 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.126+0000 7fa0c21ce9c0 20 remove_watcher() i=1 2024-09-12T00:37:39.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.130+0000 7fa0c21ce9c0 20 remove_watcher() i=2 2024-09-12T00:37:39.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.130+0000 7fa0c21ce9c0 20 remove_watcher() i=3 2024-09-12T00:37:39.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.134+0000 7fa0c21ce9c0 20 remove_watcher() i=4 2024-09-12T00:37:39.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.134+0000 7fa0c21ce9c0 20 remove_watcher() i=5 2024-09-12T00:37:39.138 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.138+0000 7fa0c21ce9c0 20 remove_watcher() i=6 2024-09-12T00:37:39.140 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.138+0000 7fa0c21ce9c0 20 remove_watcher() i=7 2024-09-12T00:37:39.155 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:39.155 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:37:39.155 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: abort-at-trim-reshard-log-entries id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:37:39.155 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:37:39.156 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:39.157 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:39.170 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:39.170 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:37:39.214 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:37:39.247 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:39.247 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:39.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.294+0000 7fb16020a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.499 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.498+0000 7fb16020a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:39.499 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.498+0000 7fb16020a9c0 20 realm 2024-09-12T00:37:39.499 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.498+0000 7fb16020a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.500 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.498+0000 7fb16020a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:39.500 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.498+0000 7fb16020a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:39.500 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.498+0000 7fb16020a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.500 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.498+0000 7fb16020a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:39.500 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.498+0000 7fb16020a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.502+0000 7fb16020a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:39.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.502+0000 7fb16020a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.502+0000 7fb16020a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:39.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.502+0000 7fb16020a9c0 20 searching for the correct realm 2024-09-12T00:37:39.513 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.510+0000 7fb15e511640 0 -- 172.21.15.43:0/1295690044 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x560c329c24c0 msgr2=0x560c329c4980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:39.522 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.522+0000 7fb15dd10640 0 -- 172.21.15.43:0/1295690044 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fb1480f4420 msgr2=0x7fb1480f48a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:39.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.534+0000 7fb16020a9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:37:39.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.534+0000 7fb16020a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:39.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.534+0000 7fb16020a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:39.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.534+0000 7fb16020a9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:37:39.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.534+0000 7fb16020a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:39.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.534+0000 7fb16020a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:39.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.534+0000 7fb16020a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.534+0000 7fb16020a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:39.536 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.534+0000 7fb16020a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.536 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.534+0000 7fb16020a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:39.536 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.534+0000 7fb16020a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.534+0000 7fb16020a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:39.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.534+0000 7fb16020a9c0 20 zone default found 2024-09-12T00:37:39.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.534+0000 7fb16020a9c0 4 Realm: () 2024-09-12T00:37:39.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.534+0000 7fb16020a9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:37:39.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.534+0000 7fb16020a9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:37:39.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.534+0000 7fb16020a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:39.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.534+0000 7fb16020a9c0 20 zonegroup default 2024-09-12T00:37:39.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.534+0000 7fb16020a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.538+0000 7fb16020a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:39.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.538+0000 7fb16020a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.538+0000 7fb16020a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:39.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.538+0000 7fb16020a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.539 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.538+0000 7fb16020a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:39.539 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.538+0000 7fb16020a9c0 20 started sync module instance, tier type = 2024-09-12T00:37:39.539 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.538+0000 7fb16020a9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:37:39.568 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.566+0000 7fb16020a9c0 20 add_watcher() i=0 2024-09-12T00:37:39.568 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.566+0000 7fb16020a9c0 20 add_watcher() i=1 2024-09-12T00:37:39.568 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.566+0000 7fb16020a9c0 20 add_watcher() i=2 2024-09-12T00:37:39.568 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.566+0000 7fb16020a9c0 20 add_watcher() i=3 2024-09-12T00:37:39.568 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.566+0000 7fb16020a9c0 20 add_watcher() i=4 2024-09-12T00:37:39.568 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.566+0000 7fb16020a9c0 20 add_watcher() i=5 2024-09-12T00:37:39.568 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.566+0000 7fb16020a9c0 20 add_watcher() i=6 2024-09-12T00:37:39.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.570+0000 7fb16020a9c0 20 add_watcher() i=7 2024-09-12T00:37:39.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.570+0000 7fb16020a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:39.575 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.574+0000 7fb00f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:39.575 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.574+0000 7fb16020a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:39.575 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.574+0000 7fb16020a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:39.575 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.574+0000 7fb16020a9c0 5 note: GC not initialized 2024-09-12T00:37:39.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.574+0000 7fb00e7fc640 20 reqs_thread_entry: start 2024-09-12T00:37:39.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.574+0000 7fb16020a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:39.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.574+0000 7fb16020a9c0 20 Filter name: none 2024-09-12T00:37:39.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.574+0000 7faf7ffff640 20 reqs_thread_entry: start 2024-09-12T00:37:39.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.574+0000 7fb16020a9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:37:39.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.574+0000 7fb16020a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.577 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.574+0000 7fb16020a9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:37:39.577 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.574+0000 7fb16020a9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:37:39.577 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.574+0000 7fb16020a9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:37:39.577 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.574+0000 7fb16020a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 : miss 2024-09-12T00:37:39.577 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.574+0000 7fb16020a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.578 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.578+0000 7fb16020a9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:37:39.578 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.578+0000 7fb16020a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 info.flags=0x17 2024-09-12T00:37:39.578 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.578+0000 7fb16020a9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 to cache LRU end 2024-09-12T00:37:39.578 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.578+0000 7fb16020a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:39.578 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.578+0000 7fb16020a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:39.578 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.578+0000 7fb16020a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 2024-09-12T00:37:39.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.578+0000 7fb16020a9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 to be held by another RGW process; skipping for now 2024-09-12T00:37:39.581 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.582+0000 7fb00f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:39.589 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.590+0000 7fb16020a9c0 20 remove_watcher() i=0 2024-09-12T00:37:39.589 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.590+0000 7fb16020a9c0 2 removed watcher, disabling cache 2024-09-12T00:37:39.592 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.590+0000 7fb16020a9c0 20 remove_watcher() i=1 2024-09-12T00:37:39.596 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.594+0000 7fb16020a9c0 20 remove_watcher() i=2 2024-09-12T00:37:39.601 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.598+0000 7fb16020a9c0 20 remove_watcher() i=3 2024-09-12T00:37:39.606 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.606+0000 7fb16020a9c0 20 remove_watcher() i=4 2024-09-12T00:37:39.607 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.606+0000 7fb16020a9c0 20 remove_watcher() i=5 2024-09-12T00:37:39.609 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.610+0000 7fb16020a9c0 20 remove_watcher() i=6 2024-09-12T00:37:39.610 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:37:39.610+0000 7fb16020a9c0 20 remove_watcher() i=7 2024-09-12T00:37:39.625 INFO:tasks.workunit.client.0.smithi043.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:38:09.657 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:38:09.695 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:09.696 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:09.742 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.741+0000 7f9762aa99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.743 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.741+0000 7f9762aa99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:09.743 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.741+0000 7f9762aa99c0 20 realm 2024-09-12T00:38:09.743 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.741+0000 7f9762aa99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.741+0000 7f9762aa99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:09.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.741+0000 7f9762aa99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:09.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.741+0000 7f9762aa99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.741+0000 7f9762aa99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:09.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.741+0000 7f9762aa99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.745+0000 7f9762aa99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:09.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.745+0000 7f9762aa99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.745+0000 7f9762aa99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:09.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.745+0000 7f9762aa99c0 20 searching for the correct realm 2024-09-12T00:38:09.752 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.749+0000 7f9760db0640 0 -- 172.21.15.43:0/111861315 >> [v2:172.21.15.43:6808/2258408181,v1:172.21.15.43:6809/2258408181] conn(0x556203dbdc20 msgr2=0x556203dc00e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:09.758 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.757+0000 7f97605af640 0 -- 172.21.15.43:0/111861315 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f975411c060 msgr2=0x7f975412b210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:09.767 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.765+0000 7f9762aa99c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:38:09.767 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.765+0000 7f9762aa99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:09.767 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.765+0000 7f9762aa99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:09.767 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.765+0000 7f9762aa99c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:38:09.767 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.765+0000 7f9762aa99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:09.768 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.765+0000 7f9762aa99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:09.768 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.765+0000 7f9762aa99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.768 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.765+0000 7f9762aa99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:09.768 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.765+0000 7f9762aa99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.765+0000 7f9762aa99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:09.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.765+0000 7f9762aa99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.765+0000 7f9762aa99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:09.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.765+0000 7f9762aa99c0 20 zone default found 2024-09-12T00:38:09.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.765+0000 7f9762aa99c0 4 Realm: () 2024-09-12T00:38:09.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.765+0000 7f9762aa99c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:38:09.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.765+0000 7f9762aa99c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:38:09.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.765+0000 7f9762aa99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:09.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.765+0000 7f9762aa99c0 20 zonegroup default 2024-09-12T00:38:09.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.765+0000 7f9762aa99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.770 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.765+0000 7f9762aa99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:09.770 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.765+0000 7f9762aa99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.770 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.769+0000 7f9762aa99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:09.770 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.769+0000 7f9762aa99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.770 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.769+0000 7f9762aa99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:09.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.769+0000 7f9762aa99c0 20 started sync module instance, tier type = 2024-09-12T00:38:09.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.769+0000 7f9762aa99c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:38:09.789 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.785+0000 7f9762aa99c0 20 add_watcher() i=0 2024-09-12T00:38:09.789 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.785+0000 7f9762aa99c0 20 add_watcher() i=1 2024-09-12T00:38:09.789 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.785+0000 7f9762aa99c0 20 add_watcher() i=2 2024-09-12T00:38:09.789 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.785+0000 7f9762aa99c0 20 add_watcher() i=3 2024-09-12T00:38:09.789 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.785+0000 7f9762aa99c0 20 add_watcher() i=4 2024-09-12T00:38:09.789 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.785+0000 7f9762aa99c0 20 add_watcher() i=5 2024-09-12T00:38:09.789 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.785+0000 7f9762aa99c0 20 add_watcher() i=6 2024-09-12T00:38:09.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.789+0000 7f9762aa99c0 20 add_watcher() i=7 2024-09-12T00:38:09.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.789+0000 7f9762aa99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:09.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.789+0000 7f9616fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:09.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.789+0000 7f9762aa99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:09.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.789+0000 7f9762aa99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:09.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.793+0000 7f9762aa99c0 5 note: GC not initialized 2024-09-12T00:38:09.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.793+0000 7f9615fdb640 20 reqs_thread_entry: start 2024-09-12T00:38:09.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.793+0000 7f9762aa99c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:09.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.793+0000 7f9762aa99c0 20 Filter name: none 2024-09-12T00:38:09.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.793+0000 7f95877fe640 20 reqs_thread_entry: start 2024-09-12T00:38:09.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.793+0000 7f9762aa99c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:38:09.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.793+0000 7f9762aa99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.795 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.793+0000 7f9762aa99c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:38:09.795 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.793+0000 7f9762aa99c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:38:09.795 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.793+0000 7f9762aa99c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:38:09.795 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.793+0000 7f9762aa99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 : miss 2024-09-12T00:38:09.795 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.793+0000 7f9762aa99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.795 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.793+0000 7f9762aa99c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:38:09.796 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.793+0000 7f9762aa99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 info.flags=0x17 2024-09-12T00:38:09.796 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.793+0000 7f9762aa99c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 to cache LRU end 2024-09-12T00:38:09.796 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.793+0000 7f9762aa99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:09.796 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.793+0000 7f9762aa99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:09.796 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.793+0000 7f9762aa99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 2024-09-12T00:38:09.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.797+0000 7f9762aa99c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:38:09.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.809+0000 7f9762aa99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 info.flags=0x17 2024-09-12T00:38:09.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.809+0000 7f9762aa99c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 to cache LRU end 2024-09-12T00:38:09.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.809+0000 7f9762aa99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:09.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.809+0000 7f9762aa99c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27, ofs0, ns] 2024-09-12T00:38:09.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.809+0000 7f96377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333521 cookie 93879459912336 notifier 6873 bl.length()=939 2024-09-12T00:38:09.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.809+0000 7f96377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 info.flags=0x17 2024-09-12T00:38:09.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.809+0000 7f96377fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 to cache LRU end 2024-09-12T00:38:09.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.809+0000 7f96377fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:09.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.809+0000 7f9762aa99c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27]): orig_sources= new_sources= 2024-09-12T00:38:09.812 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.809+0000 7f9762aa99c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27]): potential sources added=[] removed=[] 2024-09-12T00:38:09.812 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.809+0000 7f9762aa99c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27]): orig_dests= new_dests= 2024-09-12T00:38:09.812 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.809+0000 7f9762aa99c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27]): potential dests added=[] removed=[] 2024-09-12T00:38:09.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.821+0000 7f9762aa99c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.2.0 2024-09-12T00:38:09.823 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.821+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.2.0 2024-09-12T00:38:09.823 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.821+0000 7f9762aa99c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.2.1 2024-09-12T00:38:09.823 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.821+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.2.1 2024-09-12T00:38:09.823 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.821+0000 7f9762aa99c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.2.2 2024-09-12T00:38:09.823 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.821+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.2.2 2024-09-12T00:38:09.823 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.821+0000 7f9762aa99c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.2.3 2024-09-12T00:38:09.823 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.821+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.2.3 2024-09-12T00:38:09.823 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.821+0000 7f9762aa99c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.2.4 2024-09-12T00:38:09.823 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.821+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.2.4 2024-09-12T00:38:09.823 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.821+0000 7f9762aa99c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.2.5 2024-09-12T00:38:09.823 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.821+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.2.5 2024-09-12T00:38:09.823 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.821+0000 7f9762aa99c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.2.6 2024-09-12T00:38:09.824 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.821+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.2.6 2024-09-12T00:38:09.824 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.821+0000 7f9762aa99c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.2.7 2024-09-12T00:38:09.824 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.821+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.2.7 2024-09-12T00:38:09.824 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.821+0000 7f9762aa99c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.2.8 2024-09-12T00:38:09.824 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.821+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.2.8 2024-09-12T00:38:09.824 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.821+0000 7f9762aa99c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.2.9 2024-09-12T00:38:09.824 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.821+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.2.9 2024-09-12T00:38:09.824 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.821+0000 7f9762aa99c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.2.10 2024-09-12T00:38:09.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.821+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.2.10 2024-09-12T00:38:09.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.821+0000 7f9762aa99c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.2.11 2024-09-12T00:38:09.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.821+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.2.11 2024-09-12T00:38:09.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.821+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.0 2024-09-12T00:38:09.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.821+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.1 2024-09-12T00:38:09.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.821+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.2 2024-09-12T00:38:09.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.821+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.3 2024-09-12T00:38:09.826 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.825+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.4 2024-09-12T00:38:09.826 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.825+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.5 2024-09-12T00:38:09.826 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.825+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.6 2024-09-12T00:38:09.827 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.825+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.7 2024-09-12T00:38:09.828 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.825+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.8 2024-09-12T00:38:09.829 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.829+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.9 2024-09-12T00:38:09.831 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.829+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.10 2024-09-12T00:38:09.836 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.833+0000 7f9762aa99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:09.836 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.833+0000 7f9762aa99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 2024-09-12T00:38:09.839 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.837+0000 7f9762aa99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 info.flags=0x17 2024-09-12T00:38:09.839 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.837+0000 7f9762aa99c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 to cache LRU end 2024-09-12T00:38:09.839 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.837+0000 7f9762aa99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:09.839 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.837+0000 7f9762aa99c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27, ofs0, ns] 2024-09-12T00:38:09.840 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.837+0000 7f9636ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333522 cookie 93879459912336 notifier 6873 bl.length()=939 2024-09-12T00:38:09.840 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.837+0000 7f9636ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 info.flags=0x17 2024-09-12T00:38:09.840 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.837+0000 7f9636ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 to cache LRU end 2024-09-12T00:38:09.840 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.837+0000 7f9636ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:09.840 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.837+0000 7f9762aa99c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27]): orig_sources= new_sources= 2024-09-12T00:38:09.841 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.837+0000 7f9762aa99c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27]): potential sources added=[] removed=[] 2024-09-12T00:38:09.841 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.837+0000 7f9762aa99c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27]): orig_dests= new_dests= 2024-09-12T00:38:09.841 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.837+0000 7f9762aa99c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27]): potential dests added=[] removed=[] 2024-09-12T00:38:09.846 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.845+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.0 2024-09-12T00:38:09.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.845+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.1 2024-09-12T00:38:09.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.845+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.2 2024-09-12T00:38:09.848 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.845+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.3 2024-09-12T00:38:09.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.845+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.4 2024-09-12T00:38:09.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.849+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.5 2024-09-12T00:38:09.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.849+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.6 2024-09-12T00:38:09.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.849+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.7 2024-09-12T00:38:09.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.849+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.8 2024-09-12T00:38:09.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.849+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.9 2024-09-12T00:38:09.852 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.849+0000 7f9762aa99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27.10 2024-09-12T00:38:09.852 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.849+0000 7f9762aa99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:09.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.849+0000 7f9762aa99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 2024-09-12T00:38:09.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.853+0000 7f9762aa99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 info.flags=0x17 2024-09-12T00:38:09.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.853+0000 7f9762aa99c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 to cache LRU end 2024-09-12T00:38:09.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.853+0000 7f9762aa99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:09.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.853+0000 7f9762aa99c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27, ofs0, ns] 2024-09-12T00:38:09.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.853+0000 7f96377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333523 cookie 93879459912336 notifier 6873 bl.length()=907 2024-09-12T00:38:09.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.853+0000 7f96377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 info.flags=0x17 2024-09-12T00:38:09.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.853+0000 7f96377fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 to cache LRU end 2024-09-12T00:38:09.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.853+0000 7f96377fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:09.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.853+0000 7f9762aa99c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27]): orig_sources= new_sources= 2024-09-12T00:38:09.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.853+0000 7f9762aa99c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27]): potential sources added=[] removed=[] 2024-09-12T00:38:09.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.853+0000 7f9762aa99c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27]): orig_dests= new_dests= 2024-09-12T00:38:09.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.853+0000 7f9762aa99c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27]): potential dests added=[] removed=[] 2024-09-12T00:38:09.862 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.861+0000 7f9762aa99c0 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T00:38:09.865 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.865+0000 7f9616fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:09.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.869+0000 7f9762aa99c0 20 remove_watcher() i=0 2024-09-12T00:38:09.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.869+0000 7f9762aa99c0 2 removed watcher, disabling cache 2024-09-12T00:38:09.872 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.869+0000 7f9762aa99c0 20 remove_watcher() i=1 2024-09-12T00:38:09.874 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.873+0000 7f9762aa99c0 20 remove_watcher() i=2 2024-09-12T00:38:09.876 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.873+0000 7f9762aa99c0 20 remove_watcher() i=3 2024-09-12T00:38:09.880 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.877+0000 7f9762aa99c0 20 remove_watcher() i=4 2024-09-12T00:38:09.881 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.877+0000 7f9762aa99c0 20 remove_watcher() i=5 2024-09-12T00:38:09.881 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.881+0000 7f9762aa99c0 20 remove_watcher() i=6 2024-09-12T00:38:09.882 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.881+0000 7f9762aa99c0 20 remove_watcher() i=7 2024-09-12T00:38:09.896 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:38:09.923 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:09.923 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:09.966 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.965+0000 7fb32a9e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.968 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.965+0000 7fb32a9e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:09.968 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.965+0000 7fb32a9e09c0 20 realm 2024-09-12T00:38:09.968 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.965+0000 7fb32a9e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.968 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.965+0000 7fb32a9e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:09.968 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.965+0000 7fb32a9e09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:09.968 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.965+0000 7fb32a9e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.969 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.965+0000 7fb32a9e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:09.969 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.965+0000 7fb32a9e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.969+0000 7fb32a9e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:09.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.969+0000 7fb32a9e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.971 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.969+0000 7fb32a9e09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:09.971 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.969+0000 7fb32a9e09c0 20 searching for the correct realm 2024-09-12T00:38:09.976 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.973+0000 7fb328ce7640 0 -- 172.21.15.43:0/3124548408 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x558348f842e0 msgr2=0x558348f866d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:09.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.981+0000 7fb327ce5640 0 -- 172.21.15.43:0/3124548408 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fb31c0e3060 msgr2=0x7fb31c1036a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:09.991 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.989+0000 7fb32a9e09c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:38:09.991 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.989+0000 7fb32a9e09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:09.991 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.989+0000 7fb32a9e09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:09.991 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.989+0000 7fb32a9e09c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:38:09.992 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.989+0000 7fb32a9e09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:09.992 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.989+0000 7fb32a9e09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:09.992 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.989+0000 7fb32a9e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.992 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.989+0000 7fb32a9e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:09.992 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.989+0000 7fb32a9e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.992 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.989+0000 7fb32a9e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:09.992 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.989+0000 7fb32a9e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.993 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.989+0000 7fb32a9e09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:09.993 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.989+0000 7fb32a9e09c0 20 zone default found 2024-09-12T00:38:09.993 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.989+0000 7fb32a9e09c0 4 Realm: () 2024-09-12T00:38:09.993 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.989+0000 7fb32a9e09c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:38:09.993 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.989+0000 7fb32a9e09c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:38:09.993 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.989+0000 7fb32a9e09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:09.993 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.989+0000 7fb32a9e09c0 20 zonegroup default 2024-09-12T00:38:09.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.989+0000 7fb32a9e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.993+0000 7fb32a9e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:09.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.993+0000 7fb32a9e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.993+0000 7fb32a9e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:09.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.993+0000 7fb32a9e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.993+0000 7fb32a9e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:09.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.993+0000 7fb32a9e09c0 20 started sync module instance, tier type = 2024-09-12T00:38:09.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:09.993+0000 7fb32a9e09c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:38:10.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.009+0000 7fb32a9e09c0 20 add_watcher() i=0 2024-09-12T00:38:10.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.009+0000 7fb32a9e09c0 20 add_watcher() i=1 2024-09-12T00:38:10.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.009+0000 7fb32a9e09c0 20 add_watcher() i=2 2024-09-12T00:38:10.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.009+0000 7fb32a9e09c0 20 add_watcher() i=3 2024-09-12T00:38:10.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.009+0000 7fb32a9e09c0 20 add_watcher() i=4 2024-09-12T00:38:10.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.009+0000 7fb32a9e09c0 20 add_watcher() i=5 2024-09-12T00:38:10.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.009+0000 7fb32a9e09c0 20 add_watcher() i=6 2024-09-12T00:38:10.011 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.009+0000 7fb32a9e09c0 20 add_watcher() i=7 2024-09-12T00:38:10.011 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.009+0000 7fb32a9e09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:10.013 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.013+0000 7fb1de7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:10.014 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.013+0000 7fb32a9e09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:10.014 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.013+0000 7fb32a9e09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:10.014 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.013+0000 7fb32a9e09c0 5 note: GC not initialized 2024-09-12T00:38:10.014 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.013+0000 7fb1dd7e2640 20 reqs_thread_entry: start 2024-09-12T00:38:10.014 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.013+0000 7fb32a9e09c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:10.014 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.013+0000 7fb32a9e09c0 20 Filter name: none 2024-09-12T00:38:10.014 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.013+0000 7fb14effd640 20 reqs_thread_entry: start 2024-09-12T00:38:10.014 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.013+0000 7fb32a9e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.015 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.013+0000 7fb32a9e09c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:38:10.015 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.013+0000 7fb32a9e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.013+0000 7fb32a9e09c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:38:10.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.013+0000 7fb32a9e09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:10.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.013+0000 7fb32a9e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.013+0000 7fb32a9e09c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:38:10.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.013+0000 7fb32a9e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.017 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.013+0000 7fb32a9e09c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:38:10.017 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.013+0000 7fb32a9e09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:10.019 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.017+0000 7fb1de7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:10.024 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.021+0000 7fb32a9e09c0 20 remove_watcher() i=0 2024-09-12T00:38:10.024 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.021+0000 7fb32a9e09c0 2 removed watcher, disabling cache 2024-09-12T00:38:10.026 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.025+0000 7fb32a9e09c0 20 remove_watcher() i=1 2024-09-12T00:38:10.028 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.025+0000 7fb32a9e09c0 20 remove_watcher() i=2 2024-09-12T00:38:10.030 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.029+0000 7fb32a9e09c0 20 remove_watcher() i=3 2024-09-12T00:38:10.032 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.029+0000 7fb32a9e09c0 20 remove_watcher() i=4 2024-09-12T00:38:10.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.033+0000 7fb32a9e09c0 20 remove_watcher() i=5 2024-09-12T00:38:10.034 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.033+0000 7fb32a9e09c0 20 remove_watcher() i=6 2024-09-12T00:38:10.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.033+0000 7fb32a9e09c0 20 remove_watcher() i=7 2024-09-12T00:38:10.049 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:10.049 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:38:10.049 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: abort-at-trim-reshard-log-entries id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:38:10.049 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:10.050 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.050 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:10.053 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.054 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:10.099 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.099 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:10.164 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-12T00:38:10.164 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:10.167 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.167 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:10.193 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.194 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:10.241 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.241 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:10.260 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.260 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:10.279 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.279 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:10.298 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.298 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:10.318 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.318 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:10.337 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.337 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:10.355 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.356 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:10.375 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.375 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:10.395 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.395 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:10.414 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.415 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:10.437 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.437 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:10.458 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.458 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:10.477 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.477 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:10.496 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.497 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:10.515 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.515 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:10.534 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.534 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:10.555 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.555 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:10.574 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.574 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:10.595 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.595 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:10.615 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.615 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:10.632 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:38:10.667 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:10.667 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:10.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.709+0000 7f5307eee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.713+0000 7f5307eee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:10.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.713+0000 7f5307eee9c0 20 realm 2024-09-12T00:38:10.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.713+0000 7f5307eee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.713+0000 7f5307eee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:10.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.713+0000 7f5307eee9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:10.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.713+0000 7f5307eee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.713+0000 7f5307eee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:10.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.713+0000 7f5307eee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.713+0000 7f5307eee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:10.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.713+0000 7f5307eee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.717+0000 7f5307eee9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:10.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.717+0000 7f5307eee9c0 20 searching for the correct realm 2024-09-12T00:38:10.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.721+0000 7f53061f5640 0 -- 172.21.15.43:0/3829510504 >> [v2:172.21.15.43:6808/2258408181,v1:172.21.15.43:6809/2258408181] conn(0x55f3557b24f0 msgr2=0x55f3557b4960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:10.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.725+0000 7f53059f4640 0 -- 172.21.15.43:0/3829510504 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f52fc008040 msgr2=0x7f52fc023920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:10.738 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.737+0000 7f5307eee9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:38:10.738 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.737+0000 7f5307eee9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:10.738 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.737+0000 7f5307eee9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:10.738 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.737+0000 7f5307eee9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:38:10.738 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.737+0000 7f5307eee9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:10.738 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.737+0000 7f5307eee9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:10.739 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.737+0000 7f5307eee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.739 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.737+0000 7f5307eee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:10.739 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.737+0000 7f5307eee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.740 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.737+0000 7f5307eee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:10.740 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.737+0000 7f5307eee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.740 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.737+0000 7f5307eee9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:10.740 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.737+0000 7f5307eee9c0 20 zone default found 2024-09-12T00:38:10.740 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.737+0000 7f5307eee9c0 4 Realm: () 2024-09-12T00:38:10.740 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.737+0000 7f5307eee9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:38:10.740 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.737+0000 7f5307eee9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:38:10.740 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.737+0000 7f5307eee9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:10.740 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.737+0000 7f5307eee9c0 20 zonegroup default 2024-09-12T00:38:10.740 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.737+0000 7f5307eee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.737+0000 7f5307eee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:10.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.737+0000 7f5307eee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.737+0000 7f5307eee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:10.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.737+0000 7f5307eee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.741+0000 7f5307eee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:10.742 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.741+0000 7f5307eee9c0 20 started sync module instance, tier type = 2024-09-12T00:38:10.742 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.741+0000 7f5307eee9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:38:10.756 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.753+0000 7f5307eee9c0 20 add_watcher() i=0 2024-09-12T00:38:10.757 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.753+0000 7f5307eee9c0 20 add_watcher() i=1 2024-09-12T00:38:10.757 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.753+0000 7f5307eee9c0 20 add_watcher() i=2 2024-09-12T00:38:10.757 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.753+0000 7f5307eee9c0 20 add_watcher() i=3 2024-09-12T00:38:10.757 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.753+0000 7f5307eee9c0 20 add_watcher() i=4 2024-09-12T00:38:10.757 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.753+0000 7f5307eee9c0 20 add_watcher() i=5 2024-09-12T00:38:10.757 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.753+0000 7f5307eee9c0 20 add_watcher() i=6 2024-09-12T00:38:10.757 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.757+0000 7f5307eee9c0 20 add_watcher() i=7 2024-09-12T00:38:10.757 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.757+0000 7f5307eee9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:10.760 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.757+0000 7f51b77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:10.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.757+0000 7f5307eee9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:10.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.757+0000 7f5307eee9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:10.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.757+0000 7f5307eee9c0 5 note: GC not initialized 2024-09-12T00:38:10.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.761+0000 7f51b67fc640 20 reqs_thread_entry: start 2024-09-12T00:38:10.762 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.761+0000 7f5307eee9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:10.762 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.761+0000 7f5307eee9c0 20 Filter name: none 2024-09-12T00:38:10.762 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.761+0000 7f5127fff640 20 reqs_thread_entry: start 2024-09-12T00:38:10.762 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.761+0000 7f5307eee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.762 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.761+0000 7f5307eee9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:38:10.762 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.761+0000 7f5307eee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.763 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.761+0000 7f5307eee9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:38:10.763 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.761+0000 7f5307eee9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:10.763 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.761+0000 7f5307eee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.761+0000 7f5307eee9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:38:10.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.761+0000 7f5307eee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.761+0000 7f5307eee9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:38:10.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.761+0000 7f5307eee9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:10.767 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.765+0000 7f51b77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:10.772 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.769+0000 7f5307eee9c0 20 remove_watcher() i=0 2024-09-12T00:38:10.772 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.769+0000 7f5307eee9c0 2 removed watcher, disabling cache 2024-09-12T00:38:10.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.773+0000 7f5307eee9c0 20 remove_watcher() i=1 2024-09-12T00:38:10.777 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.773+0000 7f5307eee9c0 20 remove_watcher() i=2 2024-09-12T00:38:10.779 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.777+0000 7f5307eee9c0 20 remove_watcher() i=3 2024-09-12T00:38:10.781 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.781+0000 7f5307eee9c0 20 remove_watcher() i=4 2024-09-12T00:38:10.782 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.781+0000 7f5307eee9c0 20 remove_watcher() i=5 2024-09-12T00:38:10.783 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.781+0000 7f5307eee9c0 20 remove_watcher() i=6 2024-09-12T00:38:10.785 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.785+0000 7f5307eee9c0 20 remove_watcher() i=7 2024-09-12T00:38:10.799 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:10.799 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:38:10.799 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-block-writes id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:38:10.799 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:10.799 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-12T00:38:10.831 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:10.831 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:10.874 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.873+0000 7f7f39eba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.876 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.873+0000 7f7f39eba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:10.876 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.873+0000 7f7f39eba9c0 20 realm 2024-09-12T00:38:10.876 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.873+0000 7f7f39eba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.873+0000 7f7f39eba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:10.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.873+0000 7f7f39eba9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:10.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.873+0000 7f7f39eba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.873+0000 7f7f39eba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:10.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.873+0000 7f7f39eba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.878 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.877+0000 7f7f39eba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:10.878 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.877+0000 7f7f39eba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.879 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.877+0000 7f7f39eba9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:10.879 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.877+0000 7f7f39eba9c0 20 searching for the correct realm 2024-09-12T00:38:10.884 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.881+0000 7f7f379c0640 0 -- 172.21.15.43:0/568864242 >> [v2:172.21.15.97:6816/489545787,v1:172.21.15.97:6817/489545787] conn(0x7f7f30018040 msgr2=0x7f7f30027410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:10.890 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:10.889+0000 7f7f379c0640 0 -- 172.21.15.43:0/568864242 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f7f2c0f65d0 msgr2=0x7f7f2c0f9040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:11.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.105+0000 7f7f39eba9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:38:11.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.105+0000 7f7f39eba9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:11.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.105+0000 7f7f39eba9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:11.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.105+0000 7f7f39eba9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:38:11.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.105+0000 7f7f39eba9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:11.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.105+0000 7f7f39eba9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:11.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.105+0000 7f7f39eba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.109+0000 7f7f39eba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.109+0000 7f7f39eba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.109+0000 7f7f39eba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:11.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.109+0000 7f7f39eba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.109+0000 7f7f39eba9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:11.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.109+0000 7f7f39eba9c0 20 zone default found 2024-09-12T00:38:11.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.109+0000 7f7f39eba9c0 4 Realm: () 2024-09-12T00:38:11.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.109+0000 7f7f39eba9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:38:11.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.109+0000 7f7f39eba9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:38:11.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.109+0000 7f7f39eba9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:11.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.109+0000 7f7f39eba9c0 20 zonegroup default 2024-09-12T00:38:11.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.109+0000 7f7f39eba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.109+0000 7f7f39eba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.109+0000 7f7f39eba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.109+0000 7f7f39eba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.109+0000 7f7f39eba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.113+0000 7f7f39eba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.113+0000 7f7f39eba9c0 20 started sync module instance, tier type = 2024-09-12T00:38:11.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.113+0000 7f7f39eba9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:38:11.138 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.137+0000 7f7f39eba9c0 20 add_watcher() i=0 2024-09-12T00:38:11.138 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.137+0000 7f7f39eba9c0 20 add_watcher() i=1 2024-09-12T00:38:11.138 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.137+0000 7f7f39eba9c0 20 add_watcher() i=2 2024-09-12T00:38:11.138 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.137+0000 7f7f39eba9c0 20 add_watcher() i=3 2024-09-12T00:38:11.138 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.137+0000 7f7f39eba9c0 20 add_watcher() i=4 2024-09-12T00:38:11.138 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.137+0000 7f7f39eba9c0 20 add_watcher() i=5 2024-09-12T00:38:11.138 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.137+0000 7f7f39eba9c0 20 add_watcher() i=6 2024-09-12T00:38:11.140 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.137+0000 7f7f39eba9c0 20 add_watcher() i=7 2024-09-12T00:38:11.140 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.137+0000 7f7f39eba9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:11.144 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.141+0000 7f7dee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:11.145 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.145+0000 7f7f39eba9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:11.145 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.145+0000 7f7f39eba9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:11.145 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.145+0000 7f7f39eba9c0 5 note: GC not initialized 2024-09-12T00:38:11.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.145+0000 7f7ded7e2640 20 reqs_thread_entry: start 2024-09-12T00:38:11.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.145+0000 7f7f39eba9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:11.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.145+0000 7f7f39eba9c0 20 Filter name: none 2024-09-12T00:38:11.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.145+0000 7f7de67fc640 20 reqs_thread_entry: start 2024-09-12T00:38:11.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.145+0000 7f7f39eba9c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T00:38:11.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.145+0000 7f7f39eba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.145+0000 7f7f39eba9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:38:11.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.145+0000 7f7f39eba9c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T00:38:11.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.145+0000 7f7f39eba9c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T00:38:11.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.145+0000 7f7f39eba9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 : miss 2024-09-12T00:38:11.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.145+0000 7f7f39eba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.145+0000 7f7f39eba9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:38:11.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.145+0000 7f7f39eba9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 info.flags=0x17 2024-09-12T00:38:11.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.145+0000 7f7f39eba9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 to cache LRU end 2024-09-12T00:38:11.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.145+0000 7f7f39eba9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:11.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.145+0000 7f7f39eba9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:11.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.145+0000 7f7f39eba9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 2024-09-12T00:38:11.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.157+0000 7f7f39eba9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 info.flags=0x17 2024-09-12T00:38:11.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.157+0000 7f7f39eba9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 to cache LRU end 2024-09-12T00:38:11.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.157+0000 7f7f39eba9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:11.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.157+0000 7f7f39eba9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28, ofs0, ns] 2024-09-12T00:38:11.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.157+0000 7f7e167fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333481 cookie 94273836926880 notifier 6635 bl.length()=915 2024-09-12T00:38:11.159 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.157+0000 7f7e167fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 info.flags=0x17 2024-09-12T00:38:11.159 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.157+0000 7f7e167fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 to cache LRU end 2024-09-12T00:38:11.159 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.157+0000 7f7e167fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:11.159 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.157+0000 7f7f39eba9c0 20 handle_bi_update(): bucket=:error-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28]): orig_sources= new_sources= 2024-09-12T00:38:11.159 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.157+0000 7f7f39eba9c0 20 handle_bi_update(): bucket=:error-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28]): potential sources added=[] removed=[] 2024-09-12T00:38:11.159 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.157+0000 7f7f39eba9c0 20 handle_bi_update(): bucket=:error-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28]): orig_dests= new_dests= 2024-09-12T00:38:11.159 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.157+0000 7f7f39eba9c0 20 handle_bi_update(): bucket=:error-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28]): potential dests added=[] removed=[] 2024-09-12T00:38:11.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.169+0000 7f7f39eba9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.0 2024-09-12T00:38:11.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.169+0000 7f7f39eba9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.0 2024-09-12T00:38:11.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.169+0000 7f7f39eba9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.1 2024-09-12T00:38:11.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.169+0000 7f7f39eba9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.1 2024-09-12T00:38:11.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.169+0000 7f7f39eba9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.2 2024-09-12T00:38:11.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.169+0000 7f7f39eba9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.2 2024-09-12T00:38:11.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.169+0000 7f7f39eba9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.3 2024-09-12T00:38:11.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.169+0000 7f7f39eba9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.3 2024-09-12T00:38:11.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.169+0000 7f7f39eba9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.4 2024-09-12T00:38:11.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.169+0000 7f7f39eba9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.4 2024-09-12T00:38:11.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.169+0000 7f7f39eba9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.5 2024-09-12T00:38:11.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.169+0000 7f7f39eba9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.5 2024-09-12T00:38:11.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.169+0000 7f7f39eba9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.6 2024-09-12T00:38:11.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.169+0000 7f7f39eba9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.6 2024-09-12T00:38:11.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.169+0000 7f7f39eba9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.7 2024-09-12T00:38:11.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.169+0000 7f7f39eba9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.7 2024-09-12T00:38:11.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.169+0000 7f7f39eba9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.8 2024-09-12T00:38:11.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.169+0000 7f7f39eba9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.8 2024-09-12T00:38:11.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.169+0000 7f7f39eba9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.9 2024-09-12T00:38:11.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.169+0000 7f7f39eba9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.9 2024-09-12T00:38:11.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.169+0000 7f7f39eba9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.10 2024-09-12T00:38:11.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.169+0000 7f7f39eba9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.10 2024-09-12T00:38:11.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.169+0000 7f7f39eba9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.11 2024-09-12T00:38:11.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.169+0000 7f7f39eba9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.11 2024-09-12T00:38:11.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.169+0000 7f7f39eba9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.0 2024-09-12T00:38:11.173 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.169+0000 7f7f39eba9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1 2024-09-12T00:38:11.173 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.169+0000 7f7f39eba9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.2 2024-09-12T00:38:11.173 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.173+0000 7f7f39eba9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.3 2024-09-12T00:38:11.174 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.173+0000 7f7f39eba9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.4 2024-09-12T00:38:11.175 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.173+0000 7f7f39eba9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.5 2024-09-12T00:38:11.176 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.173+0000 7f7f39eba9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.6 2024-09-12T00:38:11.177 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.177+0000 7f7f39eba9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.7 2024-09-12T00:38:11.178 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.177+0000 7f7f39eba9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.8 2024-09-12T00:38:11.178 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.177+0000 7f7f39eba9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.9 2024-09-12T00:38:11.179 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.177+0000 7f7f39eba9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.10 2024-09-12T00:38:11.186 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.185+0000 7f7f39eba9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:11.186 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.185+0000 7f7f39eba9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 2024-09-12T00:38:11.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.185+0000 7f7f39eba9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 info.flags=0x17 2024-09-12T00:38:11.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.185+0000 7f7f39eba9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 to cache LRU end 2024-09-12T00:38:11.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.185+0000 7f7f39eba9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:11.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.185+0000 7f7f39eba9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28, ofs0, ns] 2024-09-12T00:38:11.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.185+0000 7f7e167fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333482 cookie 94273836926880 notifier 6635 bl.length()=915 2024-09-12T00:38:11.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.185+0000 7f7e167fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 info.flags=0x17 2024-09-12T00:38:11.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.185+0000 7f7e167fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 to cache LRU end 2024-09-12T00:38:11.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.185+0000 7f7e167fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:11.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.189+0000 7f7f39eba9c0 20 handle_bi_update(): bucket=:error-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28]): orig_sources= new_sources= 2024-09-12T00:38:11.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.189+0000 7f7f39eba9c0 20 handle_bi_update(): bucket=:error-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28]): potential sources added=[] removed=[] 2024-09-12T00:38:11.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.189+0000 7f7f39eba9c0 20 handle_bi_update(): bucket=:error-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28]): orig_dests= new_dests= 2024-09-12T00:38:11.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.189+0000 7f7f39eba9c0 20 handle_bi_update(): bucket=:error-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28]): potential dests added=[] removed=[] 2024-09-12T00:38:11.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.189+0000 7f7f39eba9c0 -1 Injecting error=-5 at location=block_writes 2024-09-12T00:38:11.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.189+0000 7f7f39eba9c0 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-12T00:38:11.199 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.197+0000 7f7f39eba9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:11.199 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.197+0000 7f7f39eba9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 2024-09-12T00:38:11.200 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.197+0000 7f7f39eba9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 info.flags=0x17 2024-09-12T00:38:11.201 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.197+0000 7f7f39eba9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 to cache LRU end 2024-09-12T00:38:11.201 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.197+0000 7f7f39eba9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:11.201 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.197+0000 7f7f39eba9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28, ofs0, ns] 2024-09-12T00:38:11.201 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.201+0000 7f7e167fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333483 cookie 94273836926880 notifier 6635 bl.length()=883 2024-09-12T00:38:11.201 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.201+0000 7f7e167fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 info.flags=0x17 2024-09-12T00:38:11.201 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.201+0000 7f7e167fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 to cache LRU end 2024-09-12T00:38:11.201 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.201+0000 7f7e167fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:11.202 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.201+0000 7f7f39eba9c0 20 handle_bi_update(): bucket=:error-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28]): orig_sources= new_sources= 2024-09-12T00:38:11.202 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.201+0000 7f7f39eba9c0 20 handle_bi_update(): bucket=:error-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28]): potential sources added=[] removed=[] 2024-09-12T00:38:11.202 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.201+0000 7f7f39eba9c0 20 handle_bi_update(): bucket=:error-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28]): orig_dests= new_dests= 2024-09-12T00:38:11.202 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.201+0000 7f7f39eba9c0 20 handle_bi_update(): bucket=:error-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28]): potential dests added=[] removed=[] 2024-09-12T00:38:11.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.205+0000 7f7f39eba9c0 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-12T00:38:11.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.209+0000 7f7dee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:11.215 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.213+0000 7f7f39eba9c0 20 remove_watcher() i=0 2024-09-12T00:38:11.215 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.213+0000 7f7f39eba9c0 2 removed watcher, disabling cache 2024-09-12T00:38:11.217 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.213+0000 7f7f39eba9c0 20 remove_watcher() i=1 2024-09-12T00:38:11.219 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.217+0000 7f7f39eba9c0 20 remove_watcher() i=2 2024-09-12T00:38:11.221 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.221+0000 7f7f39eba9c0 20 remove_watcher() i=3 2024-09-12T00:38:11.223 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.221+0000 7f7f39eba9c0 20 remove_watcher() i=4 2024-09-12T00:38:11.224 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.221+0000 7f7f39eba9c0 20 remove_watcher() i=5 2024-09-12T00:38:11.226 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.225+0000 7f7f39eba9c0 20 remove_watcher() i=6 2024-09-12T00:38:11.227 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.225+0000 7f7f39eba9c0 20 remove_watcher() i=7 2024-09-12T00:38:11.244 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:38:11.271 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:11.271 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:11.314 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.313+0000 7fc18fd2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.316 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.313+0000 7fc18fd2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.316 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.313+0000 7fc18fd2c9c0 20 realm 2024-09-12T00:38:11.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.313+0000 7fc18fd2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.313+0000 7fc18fd2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.313+0000 7fc18fd2c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:11.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.313+0000 7fc18fd2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.313+0000 7fc18fd2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.313+0000 7fc18fd2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.317+0000 7fc18fd2c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:11.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.317+0000 7fc18fd2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.317+0000 7fc18fd2c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:11.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.317+0000 7fc18fd2c9c0 20 searching for the correct realm 2024-09-12T00:38:11.325 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.321+0000 7fc18d031640 0 -- 172.21.15.43:0/1339110373 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55cf9673ad50 msgr2=0x55cf9673d190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:11.332 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.329+0000 7fc18d832640 0 -- 172.21.15.43:0/1339110373 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fc184008040 msgr2=0x7fc184030930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:11.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.337+0000 7fc18fd2c9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:38:11.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.337+0000 7fc18fd2c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:11.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.337+0000 7fc18fd2c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:11.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.337+0000 7fc18fd2c9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:38:11.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.337+0000 7fc18fd2c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:11.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.337+0000 7fc18fd2c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:11.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.337+0000 7fc18fd2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.337+0000 7fc18fd2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.337+0000 7fc18fd2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.337+0000 7fc18fd2c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:11.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.337+0000 7fc18fd2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.337+0000 7fc18fd2c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:11.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.337+0000 7fc18fd2c9c0 20 zone default found 2024-09-12T00:38:11.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.337+0000 7fc18fd2c9c0 4 Realm: () 2024-09-12T00:38:11.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.337+0000 7fc18fd2c9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:38:11.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.337+0000 7fc18fd2c9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:38:11.342 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.337+0000 7fc18fd2c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:11.342 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.337+0000 7fc18fd2c9c0 20 zonegroup default 2024-09-12T00:38:11.342 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.337+0000 7fc18fd2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.342 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.341+0000 7fc18fd2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.342 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.341+0000 7fc18fd2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.342 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.341+0000 7fc18fd2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.343 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.341+0000 7fc18fd2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.343 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.341+0000 7fc18fd2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.343 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.341+0000 7fc18fd2c9c0 20 started sync module instance, tier type = 2024-09-12T00:38:11.343 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.341+0000 7fc18fd2c9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:38:11.358 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.357+0000 7fc18fd2c9c0 20 add_watcher() i=0 2024-09-12T00:38:11.358 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.357+0000 7fc18fd2c9c0 20 add_watcher() i=1 2024-09-12T00:38:11.358 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.357+0000 7fc18fd2c9c0 20 add_watcher() i=2 2024-09-12T00:38:11.358 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.357+0000 7fc18fd2c9c0 20 add_watcher() i=3 2024-09-12T00:38:11.358 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.357+0000 7fc18fd2c9c0 20 add_watcher() i=4 2024-09-12T00:38:11.358 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.357+0000 7fc18fd2c9c0 20 add_watcher() i=5 2024-09-12T00:38:11.358 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.357+0000 7fc18fd2c9c0 20 add_watcher() i=6 2024-09-12T00:38:11.359 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.357+0000 7fc18fd2c9c0 20 add_watcher() i=7 2024-09-12T00:38:11.359 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.357+0000 7fc18fd2c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:11.361 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.361+0000 7fc03f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:11.362 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.361+0000 7fc18fd2c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:11.362 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.361+0000 7fc18fd2c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:11.362 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.361+0000 7fc18fd2c9c0 5 note: GC not initialized 2024-09-12T00:38:11.362 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.361+0000 7fc03e7fc640 20 reqs_thread_entry: start 2024-09-12T00:38:11.363 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.361+0000 7fc18fd2c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:11.363 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.361+0000 7fc18fd2c9c0 20 Filter name: none 2024-09-12T00:38:11.363 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.361+0000 7fbfaffff640 20 reqs_thread_entry: start 2024-09-12T00:38:11.363 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.361+0000 7fc18fd2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.363 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.361+0000 7fc18fd2c9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:38:11.363 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.361+0000 7fc18fd2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.361+0000 7fc18fd2c9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:38:11.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.361+0000 7fc18fd2c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:11.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.361+0000 7fc18fd2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.361+0000 7fc18fd2c9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:38:11.365 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.361+0000 7fc18fd2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.365 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.365+0000 7fc18fd2c9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:38:11.365 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.365+0000 7fc18fd2c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:11.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.365+0000 7fc03f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:11.372 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.369+0000 7fc18fd2c9c0 20 remove_watcher() i=0 2024-09-12T00:38:11.372 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.369+0000 7fc18fd2c9c0 2 removed watcher, disabling cache 2024-09-12T00:38:11.374 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.373+0000 7fc18fd2c9c0 20 remove_watcher() i=1 2024-09-12T00:38:11.376 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.373+0000 7fc18fd2c9c0 20 remove_watcher() i=2 2024-09-12T00:38:11.378 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.377+0000 7fc18fd2c9c0 20 remove_watcher() i=3 2024-09-12T00:38:11.380 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.377+0000 7fc18fd2c9c0 20 remove_watcher() i=4 2024-09-12T00:38:11.381 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.381+0000 7fc18fd2c9c0 20 remove_watcher() i=5 2024-09-12T00:38:11.383 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.381+0000 7fc18fd2c9c0 20 remove_watcher() i=6 2024-09-12T00:38:11.384 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.381+0000 7fc18fd2c9c0 20 remove_watcher() i=7 2024-09-12T00:38:11.398 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:11.398 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:38:11.398 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-block-writes id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:38:11.398 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:11.399 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:11.399 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:11.411 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:11.411 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:11.454 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:38:11.485 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:11.485 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:11.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.529+0000 7f4297b1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.529+0000 7f4297b1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.529+0000 7f4297b1b9c0 20 realm 2024-09-12T00:38:11.532 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.529+0000 7f4297b1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.532 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.529+0000 7f4297b1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.532 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.529+0000 7f4297b1b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:11.532 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.529+0000 7f4297b1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.529+0000 7f4297b1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.529+0000 7f4297b1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.533+0000 7f4297b1b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:11.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.533+0000 7f4297b1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.533+0000 7f4297b1b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:11.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.533+0000 7f4297b1b9c0 20 searching for the correct realm 2024-09-12T00:38:11.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.537+0000 7f4295e22640 0 -- 172.21.15.43:0/3587759849 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55b57a6c18c0 msgr2=0x55b57a6c3d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:11.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.545+0000 7f4294e20640 0 -- 172.21.15.43:0/3587759849 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f428c00e070 msgr2=0x7f428c083fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:11.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.553+0000 7f4297b1b9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:38:11.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.553+0000 7f4297b1b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:11.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.553+0000 7f4297b1b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:11.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.553+0000 7f4297b1b9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:38:11.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.553+0000 7f4297b1b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:11.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.553+0000 7f4297b1b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:11.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.553+0000 7f4297b1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.557+0000 7f4297b1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.557+0000 7f4297b1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.557+0000 7f4297b1b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:11.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.557+0000 7f4297b1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.557+0000 7f4297b1b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:11.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.557+0000 7f4297b1b9c0 20 zone default found 2024-09-12T00:38:11.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.557+0000 7f4297b1b9c0 4 Realm: () 2024-09-12T00:38:11.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.557+0000 7f4297b1b9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:38:11.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.557+0000 7f4297b1b9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:38:11.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.557+0000 7f4297b1b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:11.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.557+0000 7f4297b1b9c0 20 zonegroup default 2024-09-12T00:38:11.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.557+0000 7f4297b1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.557+0000 7f4297b1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.557+0000 7f4297b1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.557+0000 7f4297b1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.557+0000 7f4297b1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.557+0000 7f4297b1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.557+0000 7f4297b1b9c0 20 started sync module instance, tier type = 2024-09-12T00:38:11.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.557+0000 7f4297b1b9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:38:11.575 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.573+0000 7f4297b1b9c0 20 add_watcher() i=0 2024-09-12T00:38:11.575 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.573+0000 7f4297b1b9c0 20 add_watcher() i=1 2024-09-12T00:38:11.575 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.573+0000 7f4297b1b9c0 20 add_watcher() i=2 2024-09-12T00:38:11.575 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.573+0000 7f4297b1b9c0 20 add_watcher() i=3 2024-09-12T00:38:11.575 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.573+0000 7f4297b1b9c0 20 add_watcher() i=4 2024-09-12T00:38:11.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.573+0000 7f4297b1b9c0 20 add_watcher() i=5 2024-09-12T00:38:11.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.573+0000 7f4297b1b9c0 20 add_watcher() i=6 2024-09-12T00:38:11.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.573+0000 7f4297b1b9c0 20 add_watcher() i=7 2024-09-12T00:38:11.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.573+0000 7f4297b1b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:11.579 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.577+0000 7f414b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:11.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.577+0000 7f4297b1b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:11.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.577+0000 7f4297b1b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:11.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.577+0000 7f4297b1b9c0 5 note: GC not initialized 2024-09-12T00:38:11.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.577+0000 7f414a7e4640 20 reqs_thread_entry: start 2024-09-12T00:38:11.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.577+0000 7f4297b1b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:11.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.577+0000 7f4297b1b9c0 20 Filter name: none 2024-09-12T00:38:11.581 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.577+0000 7f40bbfff640 20 reqs_thread_entry: start 2024-09-12T00:38:11.581 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.577+0000 7f4297b1b9c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T00:38:11.581 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.577+0000 7f4297b1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.581 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.581+0000 7f4297b1b9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:38:11.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.581+0000 7f4297b1b9c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T00:38:11.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.581+0000 7f4297b1b9c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T00:38:11.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.581+0000 7f4297b1b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 : miss 2024-09-12T00:38:11.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.581+0000 7f4297b1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.581+0000 7f4297b1b9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:38:11.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.581+0000 7f4297b1b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 info.flags=0x17 2024-09-12T00:38:11.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.581+0000 7f4297b1b9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 to cache LRU end 2024-09-12T00:38:11.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.581+0000 7f4297b1b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:11.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.581+0000 7f4297b1b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:11.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.581+0000 7f4297b1b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 2024-09-12T00:38:11.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.589+0000 7f4297b1b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 info.flags=0x17 2024-09-12T00:38:11.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.589+0000 7f4297b1b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 to cache LRU end 2024-09-12T00:38:11.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.589+0000 7f4297b1b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:11.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.589+0000 7f4297b1b9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28, ofs0, ns] 2024-09-12T00:38:11.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.589+0000 7f4178ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333484 cookie 94237931355648 notifier 6671 bl.length()=915 2024-09-12T00:38:11.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.589+0000 7f4178ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 info.flags=0x17 2024-09-12T00:38:11.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.589+0000 7f4178ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 to cache LRU end 2024-09-12T00:38:11.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.589+0000 7f4178ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:11.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.589+0000 7f4297b1b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28]): orig_sources= new_sources= 2024-09-12T00:38:11.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.589+0000 7f4297b1b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28]): potential sources added=[] removed=[] 2024-09-12T00:38:11.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.589+0000 7f4297b1b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28]): orig_dests= new_dests= 2024-09-12T00:38:11.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.589+0000 7f4297b1b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28]): potential dests added=[] removed=[] 2024-09-12T00:38:11.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.601+0000 7f4297b1b9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.0 2024-09-12T00:38:11.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.601+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.0 2024-09-12T00:38:11.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.601+0000 7f4297b1b9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.1 2024-09-12T00:38:11.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.601+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.1 2024-09-12T00:38:11.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.601+0000 7f4297b1b9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.2 2024-09-12T00:38:11.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.601+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.2 2024-09-12T00:38:11.603 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.601+0000 7f4297b1b9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.3 2024-09-12T00:38:11.603 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.601+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.3 2024-09-12T00:38:11.603 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.601+0000 7f4297b1b9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.4 2024-09-12T00:38:11.603 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.601+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.4 2024-09-12T00:38:11.603 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.601+0000 7f4297b1b9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.5 2024-09-12T00:38:11.603 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.601+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.5 2024-09-12T00:38:11.603 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.601+0000 7f4297b1b9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.6 2024-09-12T00:38:11.603 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.601+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.6 2024-09-12T00:38:11.603 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.601+0000 7f4297b1b9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.7 2024-09-12T00:38:11.603 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.601+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.7 2024-09-12T00:38:11.603 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.601+0000 7f4297b1b9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.8 2024-09-12T00:38:11.603 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.601+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.8 2024-09-12T00:38:11.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.601+0000 7f4297b1b9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.9 2024-09-12T00:38:11.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.601+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.9 2024-09-12T00:38:11.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.601+0000 7f4297b1b9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.10 2024-09-12T00:38:11.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.601+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.10 2024-09-12T00:38:11.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.601+0000 7f4297b1b9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.11 2024-09-12T00:38:11.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.601+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1.11 2024-09-12T00:38:11.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.601+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.0 2024-09-12T00:38:11.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.601+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1 2024-09-12T00:38:11.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.601+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.2 2024-09-12T00:38:11.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.605+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.3 2024-09-12T00:38:11.607 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.605+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.4 2024-09-12T00:38:11.608 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.605+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.5 2024-09-12T00:38:11.609 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.609+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.6 2024-09-12T00:38:11.610 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.609+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.7 2024-09-12T00:38:11.610 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.609+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.8 2024-09-12T00:38:11.611 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.609+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.9 2024-09-12T00:38:11.611 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.609+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.10 2024-09-12T00:38:11.618 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.617+0000 7f4297b1b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:11.618 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.617+0000 7f4297b1b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 2024-09-12T00:38:11.619 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.617+0000 7f4297b1b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 info.flags=0x17 2024-09-12T00:38:11.619 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.617+0000 7f4297b1b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 to cache LRU end 2024-09-12T00:38:11.619 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.617+0000 7f4297b1b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:11.619 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.617+0000 7f4297b1b9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28, ofs0, ns] 2024-09-12T00:38:11.620 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.617+0000 7f416bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333485 cookie 94237931355648 notifier 6671 bl.length()=915 2024-09-12T00:38:11.620 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.617+0000 7f416bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 info.flags=0x17 2024-09-12T00:38:11.620 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.617+0000 7f416bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 to cache LRU end 2024-09-12T00:38:11.620 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.617+0000 7f416bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:11.620 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.617+0000 7f4297b1b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28]): orig_sources= new_sources= 2024-09-12T00:38:11.621 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.617+0000 7f4297b1b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28]): potential sources added=[] removed=[] 2024-09-12T00:38:11.621 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.617+0000 7f4297b1b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28]): orig_dests= new_dests= 2024-09-12T00:38:11.621 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.617+0000 7f4297b1b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28]): potential dests added=[] removed=[] 2024-09-12T00:38:11.625 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.625+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.0 2024-09-12T00:38:11.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.625+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.1 2024-09-12T00:38:11.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.625+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.2 2024-09-12T00:38:11.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.625+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.3 2024-09-12T00:38:11.628 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.625+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.4 2024-09-12T00:38:11.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.629+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.5 2024-09-12T00:38:11.630 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.629+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.6 2024-09-12T00:38:11.630 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.629+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.7 2024-09-12T00:38:11.631 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.629+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.8 2024-09-12T00:38:11.631 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.629+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.9 2024-09-12T00:38:11.631 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.629+0000 7f4297b1b9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28.10 2024-09-12T00:38:11.632 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.629+0000 7f4297b1b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:11.632 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.629+0000 7f4297b1b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 2024-09-12T00:38:11.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.633+0000 7f4297b1b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 info.flags=0x17 2024-09-12T00:38:11.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.633+0000 7f4297b1b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 to cache LRU end 2024-09-12T00:38:11.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.633+0000 7f4297b1b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:11.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.633+0000 7f4297b1b9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28, ofs0, ns] 2024-09-12T00:38:11.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.633+0000 7f416bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333486 cookie 94237931355648 notifier 6671 bl.length()=883 2024-09-12T00:38:11.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.633+0000 7f416bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 info.flags=0x17 2024-09-12T00:38:11.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.633+0000 7f416bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 to cache LRU end 2024-09-12T00:38:11.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.633+0000 7f416bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:11.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.633+0000 7f4297b1b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28]): orig_sources= new_sources= 2024-09-12T00:38:11.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.633+0000 7f4297b1b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28]): potential sources added=[] removed=[] 2024-09-12T00:38:11.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.633+0000 7f4297b1b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28]): orig_dests= new_dests= 2024-09-12T00:38:11.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.633+0000 7f4297b1b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28]): potential dests added=[] removed=[] 2024-09-12T00:38:11.639 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.637+0000 7f4297b1b9c0 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-12T00:38:11.642 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.641+0000 7f414b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:11.647 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.645+0000 7f4297b1b9c0 20 remove_watcher() i=0 2024-09-12T00:38:11.647 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.645+0000 7f4297b1b9c0 2 removed watcher, disabling cache 2024-09-12T00:38:11.650 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.649+0000 7f4297b1b9c0 20 remove_watcher() i=1 2024-09-12T00:38:11.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.649+0000 7f4297b1b9c0 20 remove_watcher() i=2 2024-09-12T00:38:11.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.653+0000 7f4297b1b9c0 20 remove_watcher() i=3 2024-09-12T00:38:11.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.653+0000 7f4297b1b9c0 20 remove_watcher() i=4 2024-09-12T00:38:11.657 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.657+0000 7f4297b1b9c0 20 remove_watcher() i=5 2024-09-12T00:38:11.658 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.657+0000 7f4297b1b9c0 20 remove_watcher() i=6 2024-09-12T00:38:11.659 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.657+0000 7f4297b1b9c0 20 remove_watcher() i=7 2024-09-12T00:38:11.674 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:38:11.700 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:11.701 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:11.743 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.741+0000 7f44de3849c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.745+0000 7f44de3849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.745+0000 7f44de3849c0 20 realm 2024-09-12T00:38:11.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.745+0000 7f44de3849c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.745+0000 7f44de3849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.745+0000 7f44de3849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:11.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.745+0000 7f44de3849c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.745+0000 7f44de3849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.745+0000 7f44de3849c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.748 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.745+0000 7f44de3849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:11.748 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.745+0000 7f44de3849c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.748 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.745+0000 7f44de3849c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:11.749 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.745+0000 7f44de3849c0 20 searching for the correct realm 2024-09-12T00:38:11.755 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.753+0000 7f44db689640 0 -- 172.21.15.43:0/680192409 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f44d001a040 msgr2=0x7f44d005d750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:11.762 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.761+0000 7f44dc68b640 0 -- 172.21.15.43:0/680192409 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f44d0010bf0 msgr2=0x7f44d007a9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:11.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.765+0000 7f44de3849c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:38:11.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.765+0000 7f44de3849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:11.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.765+0000 7f44de3849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:11.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.765+0000 7f44de3849c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:38:11.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.765+0000 7f44de3849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:11.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.765+0000 7f44de3849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:11.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.765+0000 7f44de3849c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.769+0000 7f44de3849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.769+0000 7f44de3849c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.770 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.769+0000 7f44de3849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:11.770 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.769+0000 7f44de3849c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.769+0000 7f44de3849c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:11.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.769+0000 7f44de3849c0 20 zone default found 2024-09-12T00:38:11.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.769+0000 7f44de3849c0 4 Realm: () 2024-09-12T00:38:11.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.769+0000 7f44de3849c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:38:11.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.769+0000 7f44de3849c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:38:11.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.769+0000 7f44de3849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:11.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.769+0000 7f44de3849c0 20 zonegroup default 2024-09-12T00:38:11.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.769+0000 7f44de3849c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.769+0000 7f44de3849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.769+0000 7f44de3849c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.772 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.769+0000 7f44de3849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.772 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.769+0000 7f44de3849c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.772 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.769+0000 7f44de3849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.772 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.769+0000 7f44de3849c0 20 started sync module instance, tier type = 2024-09-12T00:38:11.772 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.769+0000 7f44de3849c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:38:11.787 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.785+0000 7f44de3849c0 20 add_watcher() i=0 2024-09-12T00:38:11.787 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.785+0000 7f44de3849c0 20 add_watcher() i=1 2024-09-12T00:38:11.787 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.785+0000 7f44de3849c0 20 add_watcher() i=2 2024-09-12T00:38:11.787 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.785+0000 7f44de3849c0 20 add_watcher() i=3 2024-09-12T00:38:11.787 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.785+0000 7f44de3849c0 20 add_watcher() i=4 2024-09-12T00:38:11.787 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.785+0000 7f44de3849c0 20 add_watcher() i=5 2024-09-12T00:38:11.787 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.785+0000 7f44de3849c0 20 add_watcher() i=6 2024-09-12T00:38:11.788 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.785+0000 7f44de3849c0 20 add_watcher() i=7 2024-09-12T00:38:11.788 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.785+0000 7f44de3849c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:11.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.789+0000 7f4391fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:11.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.789+0000 7f44de3849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:11.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.789+0000 7f44de3849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:11.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.789+0000 7f44de3849c0 5 note: GC not initialized 2024-09-12T00:38:11.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.789+0000 7f4390fe1640 20 reqs_thread_entry: start 2024-09-12T00:38:11.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.789+0000 7f44de3849c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:11.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.789+0000 7f44de3849c0 20 Filter name: none 2024-09-12T00:38:11.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.789+0000 7f430a7fc640 20 reqs_thread_entry: start 2024-09-12T00:38:11.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.789+0000 7f44de3849c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.789+0000 7f44de3849c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:38:11.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.789+0000 7f44de3849c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.793+0000 7f44de3849c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:38:11.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.793+0000 7f44de3849c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:11.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.793+0000 7f44de3849c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.793+0000 7f44de3849c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:38:11.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.793+0000 7f44de3849c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.793+0000 7f44de3849c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:38:11.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.793+0000 7f44de3849c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:11.796 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.793+0000 7f4391fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:11.801 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.797+0000 7f44de3849c0 20 remove_watcher() i=0 2024-09-12T00:38:11.801 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.797+0000 7f44de3849c0 2 removed watcher, disabling cache 2024-09-12T00:38:11.803 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.801+0000 7f44de3849c0 20 remove_watcher() i=1 2024-09-12T00:38:11.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.801+0000 7f44de3849c0 20 remove_watcher() i=2 2024-09-12T00:38:11.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.805+0000 7f44de3849c0 20 remove_watcher() i=3 2024-09-12T00:38:11.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.805+0000 7f44de3849c0 20 remove_watcher() i=4 2024-09-12T00:38:11.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.809+0000 7f44de3849c0 20 remove_watcher() i=5 2024-09-12T00:38:11.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.809+0000 7f44de3849c0 20 remove_watcher() i=6 2024-09-12T00:38:11.812 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:11.809+0000 7f44de3849c0 20 remove_watcher() i=7 2024-09-12T00:38:11.825 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:11.825 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:38:11.825 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-block-writes id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:38:11.825 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:11.827 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:11.827 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:11.830 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:11.830 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:11.875 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:11.875 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:11.919 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: reshard bucket with abort at block_writes 2024-09-12T00:38:11.919 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:11.920 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:11.920 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:11.938 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:11.938 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:11.983 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:11.983 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:12.001 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.002 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:12.019 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.019 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:12.041 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.041 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:12.059 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.059 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:12.078 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.078 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:12.097 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.097 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:12.116 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.116 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:12.137 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.137 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:12.157 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.157 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:12.177 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.177 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:12.197 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.197 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:12.217 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.217 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:12.237 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.237 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:12.257 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.257 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:12.277 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.277 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:12.296 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.296 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:12.315 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.315 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:12.335 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.335 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:12.354 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.354 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:12.370 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:38:12.404 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:12.404 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:12.449 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.449+0000 7fe055e029c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.452 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.449+0000 7fe055e029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:12.452 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.449+0000 7fe055e029c0 20 realm 2024-09-12T00:38:12.452 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.449+0000 7fe055e029c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.452 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.449+0000 7fe055e029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:12.452 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.449+0000 7fe055e029c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:12.452 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.449+0000 7fe055e029c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.452 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.449+0000 7fe055e029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:12.452 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.449+0000 7fe055e029c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.453+0000 7fe055e029c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:12.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.453+0000 7fe055e029c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.455 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.453+0000 7fe055e029c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:12.455 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.453+0000 7fe055e029c0 20 searching for the correct realm 2024-09-12T00:38:12.460 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.457+0000 7fe054109640 0 -- 172.21.15.43:0/307416064 >> [v2:172.21.15.43:6808/2258408181,v1:172.21.15.43:6809/2258408181] conn(0x5564e985a2e0 msgr2=0x5564e985c7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:12.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.465+0000 7fe053908640 0 -- 172.21.15.43:0/307416064 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fe03c07e050 msgr2=0x7fe03c05e890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:12.475 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.473+0000 7fe055e029c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:38:12.476 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.473+0000 7fe055e029c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:12.476 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.473+0000 7fe055e029c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:12.476 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.473+0000 7fe055e029c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:38:12.476 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.473+0000 7fe055e029c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:12.476 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.473+0000 7fe055e029c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:12.476 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.473+0000 7fe055e029c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.476 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.473+0000 7fe055e029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:12.476 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.473+0000 7fe055e029c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.477 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.473+0000 7fe055e029c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:12.477 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.473+0000 7fe055e029c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.477 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.473+0000 7fe055e029c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:12.477 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.477+0000 7fe055e029c0 20 zone default found 2024-09-12T00:38:12.477 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.477+0000 7fe055e029c0 4 Realm: () 2024-09-12T00:38:12.477 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.477+0000 7fe055e029c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:38:12.477 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.477+0000 7fe055e029c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:38:12.478 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.477+0000 7fe055e029c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:12.478 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.477+0000 7fe055e029c0 20 zonegroup default 2024-09-12T00:38:12.478 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.477+0000 7fe055e029c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.478 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.477+0000 7fe055e029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:12.478 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.477+0000 7fe055e029c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.478 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.477+0000 7fe055e029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:12.478 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.477+0000 7fe055e029c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.479 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.477+0000 7fe055e029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:12.479 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.477+0000 7fe055e029c0 20 started sync module instance, tier type = 2024-09-12T00:38:12.479 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.477+0000 7fe055e029c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:38:12.494 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.493+0000 7fe055e029c0 20 add_watcher() i=0 2024-09-12T00:38:12.494 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.493+0000 7fe055e029c0 20 add_watcher() i=1 2024-09-12T00:38:12.494 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.493+0000 7fe055e029c0 20 add_watcher() i=2 2024-09-12T00:38:12.494 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.493+0000 7fe055e029c0 20 add_watcher() i=3 2024-09-12T00:38:12.495 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.493+0000 7fe055e029c0 20 add_watcher() i=4 2024-09-12T00:38:12.495 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.493+0000 7fe055e029c0 20 add_watcher() i=5 2024-09-12T00:38:12.495 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.493+0000 7fe055e029c0 20 add_watcher() i=6 2024-09-12T00:38:12.495 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.493+0000 7fe055e029c0 20 add_watcher() i=7 2024-09-12T00:38:12.495 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.493+0000 7fe055e029c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:12.498 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.497+0000 7fdf09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:12.499 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.497+0000 7fe055e029c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:12.499 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.497+0000 7fe055e029c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:12.499 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.497+0000 7fe055e029c0 5 note: GC not initialized 2024-09-12T00:38:12.500 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.497+0000 7fdf08fe1640 20 reqs_thread_entry: start 2024-09-12T00:38:12.500 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.497+0000 7fe055e029c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:12.500 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.497+0000 7fe055e029c0 20 Filter name: none 2024-09-12T00:38:12.500 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.497+0000 7fde827fc640 20 reqs_thread_entry: start 2024-09-12T00:38:12.500 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.497+0000 7fe055e029c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.501 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.497+0000 7fe055e029c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:38:12.501 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.497+0000 7fe055e029c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.501 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.497+0000 7fe055e029c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:38:12.501 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.497+0000 7fe055e029c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:12.501 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.497+0000 7fe055e029c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.501+0000 7fe055e029c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:38:12.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.501+0000 7fe055e029c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.501+0000 7fe055e029c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:38:12.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.501+0000 7fe055e029c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:12.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.501+0000 7fdf09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:12.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.509+0000 7fe055e029c0 20 remove_watcher() i=0 2024-09-12T00:38:12.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.509+0000 7fe055e029c0 2 removed watcher, disabling cache 2024-09-12T00:38:12.512 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.509+0000 7fe055e029c0 20 remove_watcher() i=1 2024-09-12T00:38:12.514 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.513+0000 7fe055e029c0 20 remove_watcher() i=2 2024-09-12T00:38:12.516 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.513+0000 7fe055e029c0 20 remove_watcher() i=3 2024-09-12T00:38:12.518 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.517+0000 7fe055e029c0 20 remove_watcher() i=4 2024-09-12T00:38:12.519 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.517+0000 7fe055e029c0 20 remove_watcher() i=5 2024-09-12T00:38:12.520 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.517+0000 7fe055e029c0 20 remove_watcher() i=6 2024-09-12T00:38:12.522 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.521+0000 7fe055e029c0 20 remove_watcher() i=7 2024-09-12T00:38:12.536 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:12.536 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:38:12.536 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: abort-at-block-writes id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:38:12.536 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:12.536 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-12T00:38:12.569 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:12.569 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:12.612 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.609+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.613 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:12.613 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 realm 2024-09-12T00:38:12.613 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.614 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:12.614 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.613+0000 7f16f1c979c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:12.614 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.614 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:12.614 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.615 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:12.615 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.616 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:12.616 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 searching for the correct realm 2024-09-12T00:38:12.623 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.621+0000 7f16eff9e640 0 -- 172.21.15.43:0/291986731 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f16e4033b10 msgr2=0x7f16e400b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:12.840 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.837+0000 7f16ef79d640 0 -- 172.21.15.43:0/291986731 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x55b5cb87e9e0 msgr2=0x55b5cb880e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:12.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.845+0000 7f16f1c979c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:38:12.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.845+0000 7f16f1c979c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:12.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.845+0000 7f16f1c979c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:12.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.845+0000 7f16f1c979c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:38:12.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.845+0000 7f16f1c979c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:12.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.845+0000 7f16f1c979c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:12.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.845+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:12.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:12.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:12.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 zone default found 2024-09-12T00:38:12.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.849+0000 7f16f1c979c0 4 Realm: () 2024-09-12T00:38:12.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.849+0000 7f16f1c979c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:38:12.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.849+0000 7f16f1c979c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:38:12.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.849+0000 7f16f1c979c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:12.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 zonegroup default 2024-09-12T00:38:12.852 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.852 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:12.852 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.852 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:12.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.853+0000 7f16f1c979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:12.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.853+0000 7f16f1c979c0 20 started sync module instance, tier type = 2024-09-12T00:38:12.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.853+0000 7f16f1c979c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:38:12.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.877+0000 7f16f1c979c0 20 add_watcher() i=0 2024-09-12T00:38:12.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.877+0000 7f16f1c979c0 20 add_watcher() i=1 2024-09-12T00:38:12.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.877+0000 7f16f1c979c0 20 add_watcher() i=2 2024-09-12T00:38:12.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.877+0000 7f16f1c979c0 20 add_watcher() i=3 2024-09-12T00:38:12.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.877+0000 7f16f1c979c0 20 add_watcher() i=4 2024-09-12T00:38:12.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.877+0000 7f16f1c979c0 20 add_watcher() i=5 2024-09-12T00:38:12.878 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.877+0000 7f16f1c979c0 20 add_watcher() i=6 2024-09-12T00:38:12.879 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.877+0000 7f16f1c979c0 20 add_watcher() i=7 2024-09-12T00:38:12.879 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.877+0000 7f16f1c979c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:12.884 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.881+0000 7f15a67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:12.885 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.881+0000 7f16f1c979c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:12.885 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.881+0000 7f16f1c979c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:12.885 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.885+0000 7f16f1c979c0 5 note: GC not initialized 2024-09-12T00:38:12.886 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.885+0000 7f15a57e2640 20 reqs_thread_entry: start 2024-09-12T00:38:12.886 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.885+0000 7f16f1c979c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:12.886 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.885+0000 7f16f1c979c0 20 Filter name: none 2024-09-12T00:38:12.886 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.885+0000 7f159e7fc640 20 reqs_thread_entry: start 2024-09-12T00:38:12.886 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.885+0000 7f16f1c979c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:38:12.886 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.885+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.887 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.885+0000 7f16f1c979c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:38:12.887 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.885+0000 7f16f1c979c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:38:12.887 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.885+0000 7f16f1c979c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:38:12.887 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.885+0000 7f16f1c979c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 : miss 2024-09-12T00:38:12.887 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.885+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.888 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.885+0000 7f16f1c979c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:38:12.888 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.885+0000 7f16f1c979c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 info.flags=0x17 2024-09-12T00:38:12.888 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.885+0000 7f16f1c979c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 to cache LRU end 2024-09-12T00:38:12.888 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.885+0000 7f16f1c979c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:12.888 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.885+0000 7f16f1c979c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:12.888 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.885+0000 7f16f1c979c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 2024-09-12T00:38:12.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.897+0000 7f16f1c979c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 info.flags=0x17 2024-09-12T00:38:12.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.897+0000 7f16f1c979c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 to cache LRU end 2024-09-12T00:38:12.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.897+0000 7f16f1c979c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:12.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.897+0000 7f16f1c979c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29, ofs0, ns] 2024-09-12T00:38:12.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.897+0000 7f15d2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333526 cookie 94239292174336 notifier 7020 bl.length()=915 2024-09-12T00:38:12.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.897+0000 7f15d2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 info.flags=0x17 2024-09-12T00:38:12.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.897+0000 7f15d2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 to cache LRU end 2024-09-12T00:38:12.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.897+0000 7f15d2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:12.900 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.897+0000 7f16f1c979c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): orig_sources= new_sources= 2024-09-12T00:38:12.900 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.897+0000 7f16f1c979c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): potential sources added=[] removed=[] 2024-09-12T00:38:12.900 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.897+0000 7f16f1c979c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): orig_dests= new_dests= 2024-09-12T00:38:12.900 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.897+0000 7f16f1c979c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): potential dests added=[] removed=[] 2024-09-12T00:38:12.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.0 2024-09-12T00:38:12.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.0 2024-09-12T00:38:12.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.1 2024-09-12T00:38:12.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.1 2024-09-12T00:38:12.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.2 2024-09-12T00:38:12.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.2 2024-09-12T00:38:12.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.3 2024-09-12T00:38:12.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.3 2024-09-12T00:38:12.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.4 2024-09-12T00:38:12.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.4 2024-09-12T00:38:12.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.5 2024-09-12T00:38:12.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.5 2024-09-12T00:38:12.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.6 2024-09-12T00:38:12.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.6 2024-09-12T00:38:12.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.7 2024-09-12T00:38:12.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.7 2024-09-12T00:38:12.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.8 2024-09-12T00:38:12.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.8 2024-09-12T00:38:12.912 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.9 2024-09-12T00:38:12.912 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.9 2024-09-12T00:38:12.912 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.10 2024-09-12T00:38:12.912 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.10 2024-09-12T00:38:12.912 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.11 2024-09-12T00:38:12.912 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.11 2024-09-12T00:38:12.912 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.0 2024-09-12T00:38:12.913 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1 2024-09-12T00:38:12.913 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.2 2024-09-12T00:38:12.913 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.913+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.3 2024-09-12T00:38:12.914 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.913+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.4 2024-09-12T00:38:12.915 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.913+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.5 2024-09-12T00:38:12.916 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.913+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.6 2024-09-12T00:38:12.917 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.917+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.7 2024-09-12T00:38:12.918 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.917+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.8 2024-09-12T00:38:12.919 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.917+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.9 2024-09-12T00:38:12.919 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.917+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.10 2024-09-12T00:38:12.927 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.925+0000 7f16f1c979c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:12.927 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.925+0000 7f16f1c979c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 2024-09-12T00:38:12.929 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.929+0000 7f16f1c979c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 info.flags=0x17 2024-09-12T00:38:12.929 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.929+0000 7f16f1c979c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 to cache LRU end 2024-09-12T00:38:12.930 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.929+0000 7f16f1c979c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:12.930 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.929+0000 7f16f1c979c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29, ofs0, ns] 2024-09-12T00:38:12.930 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.929+0000 7f15d27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333527 cookie 94239292174336 notifier 7020 bl.length()=915 2024-09-12T00:38:12.930 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.929+0000 7f15d27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 info.flags=0x17 2024-09-12T00:38:12.930 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.929+0000 7f15d27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 to cache LRU end 2024-09-12T00:38:12.930 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.929+0000 7f15d27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:12.931 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.929+0000 7f16f1c979c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): orig_sources= new_sources= 2024-09-12T00:38:12.931 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.929+0000 7f16f1c979c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): potential sources added=[] removed=[] 2024-09-12T00:38:12.931 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.929+0000 7f16f1c979c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): orig_dests= new_dests= 2024-09-12T00:38:12.931 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.929+0000 7f16f1c979c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): potential dests added=[] removed=[] 2024-09-12T00:38:12.932 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f16f1c979c0 time 2024-09-12T00:38:12.935243+0000 2024-09-12T00:38:12.932 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:38:12.935 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:12.935 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f16f55712eb] 2024-09-12T00:38:12.935 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f16f557149f] 2024-09-12T00:38:12.935 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5ca2c0cc1] 2024-09-12T00:38:12.935 INFO:tasks.workunit.client.0.smithi043.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55b5ca2d5086] 2024-09-12T00:38:12.935 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55b5ca2d66a4] 2024-09-12T00:38:12.935 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:38:12.935 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f16f43d7d90] 2024-09-12T00:38:12.935 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:38:12.936 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:38:12.936 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.933+0000 7f16f1c979c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f16f1c979c0 time 2024-09-12T00:38:12.935243+0000 2024-09-12T00:38:12.936 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:38:12.936 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:12.936 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:12.936 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f16f55712eb] 2024-09-12T00:38:12.936 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f16f557149f] 2024-09-12T00:38:12.936 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5ca2c0cc1] 2024-09-12T00:38:12.936 INFO:tasks.workunit.client.0.smithi043.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55b5ca2d5086] 2024-09-12T00:38:12.936 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55b5ca2d66a4] 2024-09-12T00:38:12.936 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:38:12.936 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f16f43d7d90] 2024-09-12T00:38:12.936 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:38:12.937 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:38:12.937 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:12.937 INFO:tasks.workunit.client.0.smithi043.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:38:12.937 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7f16f1c979c0 thread_name:radosgw-admin 2024-09-12T00:38:12.938 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:12.938 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f16f43f0520] 2024-09-12T00:38:12.938 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:38:12.938 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:38:12.938 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:38:12.939 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f16f5571345] 2024-09-12T00:38:12.939 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f16f557149f] 2024-09-12T00:38:12.939 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5ca2c0cc1] 2024-09-12T00:38:12.939 INFO:tasks.workunit.client.0.smithi043.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55b5ca2d5086] 2024-09-12T00:38:12.939 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55b5ca2d66a4] 2024-09-12T00:38:12.939 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:38:12.939 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f16f43d7d90] 2024-09-12T00:38:12.939 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:38:12.939 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:38:12.939 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:12.937+0000 7f16f1c979c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:38:12.939 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7f16f1c979c0 thread_name:radosgw-admin 2024-09-12T00:38:12.940 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:12.940 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:12.940 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f16f43f0520] 2024-09-12T00:38:12.940 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:38:12.940 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:38:12.940 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:38:12.940 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f16f5571345] 2024-09-12T00:38:12.940 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f16f557149f] 2024-09-12T00:38:12.940 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5ca2c0cc1] 2024-09-12T00:38:12.940 INFO:tasks.workunit.client.0.smithi043.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55b5ca2d5086] 2024-09-12T00:38:12.940 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55b5ca2d66a4] 2024-09-12T00:38:12.940 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:38:12.941 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f16f43d7d90] 2024-09-12T00:38:12.941 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:38:12.941 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:38:12.941 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:38:12.941 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:12.941 INFO:tasks.workunit.client.0.smithi043.stderr:--- begin dump of recent events --- 2024-09-12T00:38:12.976 INFO:tasks.workunit.client.0.smithi043.stderr: -499> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb792220) adding auth protocol: cephx 2024-09-12T00:38:12.976 INFO:tasks.workunit.client.0.smithi043.stderr: -498> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb792220) adding con mode: secure 2024-09-12T00:38:12.976 INFO:tasks.workunit.client.0.smithi043.stderr: -497> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb792220) adding con mode: crc 2024-09-12T00:38:12.976 INFO:tasks.workunit.client.0.smithi043.stderr: -496> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb792220) adding con mode: secure 2024-09-12T00:38:12.976 INFO:tasks.workunit.client.0.smithi043.stderr: -495> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb792220) adding con mode: crc 2024-09-12T00:38:12.977 INFO:tasks.workunit.client.0.smithi043.stderr: -494> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb792220) adding con mode: secure 2024-09-12T00:38:12.977 INFO:tasks.workunit.client.0.smithi043.stderr: -493> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb792220) adding con mode: crc 2024-09-12T00:38:12.977 INFO:tasks.workunit.client.0.smithi043.stderr: -492> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb792220) adding con mode: crc 2024-09-12T00:38:12.977 INFO:tasks.workunit.client.0.smithi043.stderr: -491> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb792220) adding con mode: secure 2024-09-12T00:38:12.977 INFO:tasks.workunit.client.0.smithi043.stderr: -490> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb792220) adding con mode: crc 2024-09-12T00:38:12.977 INFO:tasks.workunit.client.0.smithi043.stderr: -489> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb792220) adding con mode: secure 2024-09-12T00:38:12.977 INFO:tasks.workunit.client.0.smithi043.stderr: -488> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb792220) adding con mode: crc 2024-09-12T00:38:12.977 INFO:tasks.workunit.client.0.smithi043.stderr: -487> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb792220) adding con mode: secure 2024-09-12T00:38:12.978 INFO:tasks.workunit.client.0.smithi043.stderr: -486> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:12.978 INFO:tasks.workunit.client.0.smithi043.stderr: -485> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:12.978 INFO:tasks.workunit.client.0.smithi043.stderr: -484> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 5 asok(0x55b5cb5872b0) register_command rotate-key hook 0x55b5cb792368 2024-09-12T00:38:12.978 INFO:tasks.workunit.client.0.smithi043.stderr: -483> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:12.978 INFO:tasks.workunit.client.0.smithi043.stderr: -482> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:38:12.978 INFO:tasks.workunit.client.0.smithi043.stderr: -481> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 10 monclient(hunting): picked mon.noname-a con 0x55b5cb623900 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:38:12.978 INFO:tasks.workunit.client.0.smithi043.stderr: -480> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 10 monclient(hunting): picked mon.noname-c con 0x55b5cb6daf60 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:38:12.978 INFO:tasks.workunit.client.0.smithi043.stderr: -479> 2024-09-12T00:38:12.593+0000 7f16f1c979c0 10 monclient(hunting): picked mon.noname-b con 0x55b5cb6db370 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:38:12.978 INFO:tasks.workunit.client.0.smithi043.stderr: -478> 2024-09-12T00:38:12.593+0000 7f16f1c979c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:12.978 INFO:tasks.workunit.client.0.smithi043.stderr: -477> 2024-09-12T00:38:12.593+0000 7f16f1c979c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:12.978 INFO:tasks.workunit.client.0.smithi043.stderr: -476> 2024-09-12T00:38:12.593+0000 7f16f1c979c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:12.979 INFO:tasks.workunit.client.0.smithi043.stderr: -475> 2024-09-12T00:38:12.593+0000 7f16f1c979c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:12.979 INFO:tasks.workunit.client.0.smithi043.stderr: -474> 2024-09-12T00:38:12.593+0000 7f16f1c979c0 10 monclient(hunting): authenticate will time out at 2188.584041s 2024-09-12T00:38:12.979 INFO:tasks.workunit.client.0.smithi043.stderr: -473> 2024-09-12T00:38:12.593+0000 7f16ef79d640 10 monclient(hunting): get_auth_request con 0x55b5cb623900 auth_method 0 2024-09-12T00:38:12.979 INFO:tasks.workunit.client.0.smithi043.stderr: -472> 2024-09-12T00:38:12.593+0000 7f16ef79d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:12.979 INFO:tasks.workunit.client.0.smithi043.stderr: -471> 2024-09-12T00:38:12.593+0000 7f16ef79d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:12.979 INFO:tasks.workunit.client.0.smithi043.stderr: -470> 2024-09-12T00:38:12.593+0000 7f16ef79d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:12.979 INFO:tasks.workunit.client.0.smithi043.stderr: -469> 2024-09-12T00:38:12.593+0000 7f16eef9c640 10 monclient(hunting): get_auth_request con 0x55b5cb6daf60 auth_method 0 2024-09-12T00:38:12.979 INFO:tasks.workunit.client.0.smithi043.stderr: -468> 2024-09-12T00:38:12.593+0000 7f16eef9c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:12.979 INFO:tasks.workunit.client.0.smithi043.stderr: -467> 2024-09-12T00:38:12.593+0000 7f16eef9c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:12.979 INFO:tasks.workunit.client.0.smithi043.stderr: -466> 2024-09-12T00:38:12.593+0000 7f16eef9c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:12.979 INFO:tasks.workunit.client.0.smithi043.stderr: -465> 2024-09-12T00:38:12.593+0000 7f16ef79d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:12.979 INFO:tasks.workunit.client.0.smithi043.stderr: -464> 2024-09-12T00:38:12.593+0000 7f16ef79d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:12.980 INFO:tasks.workunit.client.0.smithi043.stderr: -463> 2024-09-12T00:38:12.593+0000 7f16ef79d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:12.980 INFO:tasks.workunit.client.0.smithi043.stderr: -462> 2024-09-12T00:38:12.593+0000 7f16eef9c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:12.980 INFO:tasks.workunit.client.0.smithi043.stderr: -461> 2024-09-12T00:38:12.593+0000 7f16eef9c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:12.980 INFO:tasks.workunit.client.0.smithi043.stderr: -460> 2024-09-12T00:38:12.593+0000 7f16eef9c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:12.980 INFO:tasks.workunit.client.0.smithi043.stderr: -459> 2024-09-12T00:38:12.593+0000 7f16ef79d640 10 monclient(hunting): handle_auth_done global_id 7011 payload 824 2024-09-12T00:38:12.980 INFO:tasks.workunit.client.0.smithi043.stderr: -458> 2024-09-12T00:38:12.593+0000 7f16ef79d640 10 monclient: _finish_hunting 0 2024-09-12T00:38:12.980 INFO:tasks.workunit.client.0.smithi043.stderr: -457> 2024-09-12T00:38:12.593+0000 7f16ef79d640 1 monclient: found mon.noname-a 2024-09-12T00:38:12.980 INFO:tasks.workunit.client.0.smithi043.stderr: -456> 2024-09-12T00:38:12.593+0000 7f16ef79d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:38:12.980 INFO:tasks.workunit.client.0.smithi043.stderr: -455> 2024-09-12T00:38:12.593+0000 7f15dbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:12.980 INFO:tasks.workunit.client.0.smithi043.stderr: -454> 2024-09-12T00:38:12.593+0000 7f15dbe07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:38:12.980 INFO:tasks.workunit.client.0.smithi043.stderr: -453> 2024-09-12T00:38:12.593+0000 7f15dbe07640 10 monclient: dump: 2024-09-12T00:38:12.980 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:12.980 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:12.981 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:12.981 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:12.981 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:12.981 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:12.981 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:12.981 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:12.981 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:12.981 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:12.981 INFO:tasks.workunit.client.0.smithi043.stderr: -452> 2024-09-12T00:38:12.593+0000 7f15dbe07640 10 monclient: _finish_auth 0 2024-09-12T00:38:12.981 INFO:tasks.workunit.client.0.smithi043.stderr: -451> 2024-09-12T00:38:12.593+0000 7f15dbe07640 10 monclient: _check_auth_tickets 2024-09-12T00:38:12.981 INFO:tasks.workunit.client.0.smithi043.stderr: -450> 2024-09-12T00:38:12.593+0000 7f15dbe07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:12.981 INFO:tasks.workunit.client.0.smithi043.stderr: -449> 2024-09-12T00:38:12.593+0000 7f15dbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:12.981 INFO:tasks.workunit.client.0.smithi043.stderr: -448> 2024-09-12T00:38:12.593+0000 7f15dbe07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:12.982 INFO:tasks.workunit.client.0.smithi043.stderr: -447> 2024-09-12T00:38:12.593+0000 7f15dbe07640 10 monclient: dump: 2024-09-12T00:38:12.982 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:12.982 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:12.982 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:12.982 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:12.982 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:12.982 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:12.982 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:12.982 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:12.982 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:12.982 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:12.982 INFO:tasks.workunit.client.0.smithi043.stderr: -446> 2024-09-12T00:38:12.593+0000 7f16f1c979c0 5 monclient: authenticate success, global_id 7011 2024-09-12T00:38:12.982 INFO:tasks.workunit.client.0.smithi043.stderr: -445> 2024-09-12T00:38:12.593+0000 7f15dd60a640 4 set_mon_vals no callback set 2024-09-12T00:38:12.983 INFO:tasks.workunit.client.0.smithi043.stderr: -444> 2024-09-12T00:38:12.593+0000 7f16f1c979c0 10 monclient: _renew_subs 2024-09-12T00:38:12.983 INFO:tasks.workunit.client.0.smithi043.stderr: -443> 2024-09-12T00:38:12.593+0000 7f16f1c979c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:38:12.983 INFO:tasks.workunit.client.0.smithi043.stderr: -442> 2024-09-12T00:38:12.593+0000 7f16f1c979c0 10 monclient: _renew_subs 2024-09-12T00:38:12.983 INFO:tasks.workunit.client.0.smithi043.stderr: -441> 2024-09-12T00:38:12.593+0000 7f16f1c979c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:38:12.983 INFO:tasks.workunit.client.0.smithi043.stderr: -440> 2024-09-12T00:38:12.593+0000 7f16f1c979c0 1 librados: init done 2024-09-12T00:38:12.983 INFO:tasks.workunit.client.0.smithi043.stderr: -439> 2024-09-12T00:38:12.593+0000 7f15dbe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:38:12.983 INFO:tasks.workunit.client.0.smithi043.stderr: -438> 2024-09-12T00:38:12.593+0000 7f15dbe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:38:12.983 INFO:tasks.workunit.client.0.smithi043.stderr: -437> 2024-09-12T00:38:12.593+0000 7f15dbe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:38:12.983 INFO:tasks.workunit.client.0.smithi043.stderr: -436> 2024-09-12T00:38:12.593+0000 7f16eef9c640 10 monclient: get_auth_request con 0x7f15d4070ae0 auth_method 0 2024-09-12T00:38:12.983 INFO:tasks.workunit.client.0.smithi043.stderr: -435> 2024-09-12T00:38:12.593+0000 7f16eff9e640 10 monclient: get_auth_request con 0x55b5cb7bea00 auth_method 0 2024-09-12T00:38:12.983 INFO:tasks.workunit.client.0.smithi043.stderr: -434> 2024-09-12T00:38:12.597+0000 7f16ef79d640 10 monclient: get_auth_request con 0x55b5cb7dca70 auth_method 0 2024-09-12T00:38:12.983 INFO:tasks.workunit.client.0.smithi043.stderr: -433> 2024-09-12T00:38:12.597+0000 7f16eef9c640 10 monclient: get_auth_request con 0x55b5cb7e0dd0 auth_method 0 2024-09-12T00:38:12.984 INFO:tasks.workunit.client.0.smithi043.stderr: -432> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 10 monclient: build_initial_monmap 2024-09-12T00:38:12.984 INFO:tasks.workunit.client.0.smithi043.stderr: -431> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 1 build_initial for_mkfs: 0 2024-09-12T00:38:12.984 INFO:tasks.workunit.client.0.smithi043.stderr: -430> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 10 monclient: monmap: 2024-09-12T00:38:12.984 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:38:12.984 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:12.984 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:38:12.984 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:38:12.984 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:12.984 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:12.984 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:38:12.984 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:38:12.984 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:38:12.985 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:12.985 INFO:tasks.workunit.client.0.smithi043.stderr: -429> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e5c30) adding auth protocol: cephx 2024-09-12T00:38:12.985 INFO:tasks.workunit.client.0.smithi043.stderr: -428> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e5c30) adding auth protocol: cephx 2024-09-12T00:38:12.985 INFO:tasks.workunit.client.0.smithi043.stderr: -427> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e5c30) adding auth protocol: cephx 2024-09-12T00:38:12.985 INFO:tasks.workunit.client.0.smithi043.stderr: -426> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e5c30) adding con mode: secure 2024-09-12T00:38:12.985 INFO:tasks.workunit.client.0.smithi043.stderr: -425> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e5c30) adding con mode: crc 2024-09-12T00:38:12.985 INFO:tasks.workunit.client.0.smithi043.stderr: -424> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e5c30) adding con mode: secure 2024-09-12T00:38:12.985 INFO:tasks.workunit.client.0.smithi043.stderr: -423> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e5c30) adding con mode: crc 2024-09-12T00:38:12.985 INFO:tasks.workunit.client.0.smithi043.stderr: -422> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e5c30) adding con mode: secure 2024-09-12T00:38:12.985 INFO:tasks.workunit.client.0.smithi043.stderr: -421> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e5c30) adding con mode: crc 2024-09-12T00:38:12.985 INFO:tasks.workunit.client.0.smithi043.stderr: -420> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e5c30) adding con mode: crc 2024-09-12T00:38:12.985 INFO:tasks.workunit.client.0.smithi043.stderr: -419> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e5c30) adding con mode: secure 2024-09-12T00:38:12.986 INFO:tasks.workunit.client.0.smithi043.stderr: -418> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e5c30) adding con mode: crc 2024-09-12T00:38:12.986 INFO:tasks.workunit.client.0.smithi043.stderr: -417> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e5c30) adding con mode: secure 2024-09-12T00:38:12.986 INFO:tasks.workunit.client.0.smithi043.stderr: -416> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e5c30) adding con mode: crc 2024-09-12T00:38:12.986 INFO:tasks.workunit.client.0.smithi043.stderr: -415> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e5c30) adding con mode: secure 2024-09-12T00:38:12.986 INFO:tasks.workunit.client.0.smithi043.stderr: -414> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:12.986 INFO:tasks.workunit.client.0.smithi043.stderr: -413> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 asok(0x55b5cb5872b0) register_command objecter_requests cmddesc objecter_requests hook 0x55b5cb7e9660 EEXIST 2024-09-12T00:38:12.986 INFO:tasks.workunit.client.0.smithi043.stderr: -412> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 10 monclient: init 2024-09-12T00:38:12.986 INFO:tasks.workunit.client.0.smithi043.stderr: -411> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e42b8) adding auth protocol: cephx 2024-09-12T00:38:12.986 INFO:tasks.workunit.client.0.smithi043.stderr: -410> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e42b8) adding auth protocol: cephx 2024-09-12T00:38:12.986 INFO:tasks.workunit.client.0.smithi043.stderr: -409> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e42b8) adding auth protocol: cephx 2024-09-12T00:38:12.986 INFO:tasks.workunit.client.0.smithi043.stderr: -408> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e42b8) adding con mode: secure 2024-09-12T00:38:12.987 INFO:tasks.workunit.client.0.smithi043.stderr: -407> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e42b8) adding con mode: crc 2024-09-12T00:38:12.987 INFO:tasks.workunit.client.0.smithi043.stderr: -406> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e42b8) adding con mode: secure 2024-09-12T00:38:12.987 INFO:tasks.workunit.client.0.smithi043.stderr: -405> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e42b8) adding con mode: crc 2024-09-12T00:38:12.987 INFO:tasks.workunit.client.0.smithi043.stderr: -404> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e42b8) adding con mode: secure 2024-09-12T00:38:12.987 INFO:tasks.workunit.client.0.smithi043.stderr: -403> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e42b8) adding con mode: crc 2024-09-12T00:38:12.987 INFO:tasks.workunit.client.0.smithi043.stderr: -402> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e42b8) adding con mode: crc 2024-09-12T00:38:12.987 INFO:tasks.workunit.client.0.smithi043.stderr: -401> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e42b8) adding con mode: secure 2024-09-12T00:38:12.987 INFO:tasks.workunit.client.0.smithi043.stderr: -400> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e42b8) adding con mode: crc 2024-09-12T00:38:12.987 INFO:tasks.workunit.client.0.smithi043.stderr: -399> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e42b8) adding con mode: secure 2024-09-12T00:38:12.987 INFO:tasks.workunit.client.0.smithi043.stderr: -398> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e42b8) adding con mode: crc 2024-09-12T00:38:12.987 INFO:tasks.workunit.client.0.smithi043.stderr: -397> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e42b8) adding con mode: secure 2024-09-12T00:38:12.987 INFO:tasks.workunit.client.0.smithi043.stderr: -396> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:12.987 INFO:tasks.workunit.client.0.smithi043.stderr: -395> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:12.988 INFO:tasks.workunit.client.0.smithi043.stderr: -394> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 asok(0x55b5cb5872b0) register_command rotate-key cmddesc rotate-key hook 0x55b5cb7e4400 EEXIST 2024-09-12T00:38:12.988 INFO:tasks.workunit.client.0.smithi043.stderr: -393> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:12.988 INFO:tasks.workunit.client.0.smithi043.stderr: -392> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:38:12.988 INFO:tasks.workunit.client.0.smithi043.stderr: -391> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 10 monclient(hunting): picked mon.noname-a con 0x55b5cb80d810 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:38:12.988 INFO:tasks.workunit.client.0.smithi043.stderr: -390> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 10 monclient(hunting): picked mon.noname-b con 0x55b5cb80d140 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:38:12.988 INFO:tasks.workunit.client.0.smithi043.stderr: -389> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 10 monclient(hunting): picked mon.noname-c con 0x55b5cb80bb20 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:38:12.988 INFO:tasks.workunit.client.0.smithi043.stderr: -388> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:12.988 INFO:tasks.workunit.client.0.smithi043.stderr: -387> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:12.988 INFO:tasks.workunit.client.0.smithi043.stderr: -386> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:12.988 INFO:tasks.workunit.client.0.smithi043.stderr: -385> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:12.988 INFO:tasks.workunit.client.0.smithi043.stderr: -384> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 10 monclient(hunting): authenticate will time out at 2188.593059s 2024-09-12T00:38:12.989 INFO:tasks.workunit.client.0.smithi043.stderr: -383> 2024-09-12T00:38:12.601+0000 7f16ef79d640 10 monclient(hunting): get_auth_request con 0x55b5cb80d810 auth_method 0 2024-09-12T00:38:12.989 INFO:tasks.workunit.client.0.smithi043.stderr: -382> 2024-09-12T00:38:12.601+0000 7f16ef79d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:12.989 INFO:tasks.workunit.client.0.smithi043.stderr: -381> 2024-09-12T00:38:12.601+0000 7f16ef79d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:12.989 INFO:tasks.workunit.client.0.smithi043.stderr: -380> 2024-09-12T00:38:12.601+0000 7f16ef79d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:12.989 INFO:tasks.workunit.client.0.smithi043.stderr: -379> 2024-09-12T00:38:12.601+0000 7f16eff9e640 10 monclient(hunting): get_auth_request con 0x55b5cb80bb20 auth_method 0 2024-09-12T00:38:12.989 INFO:tasks.workunit.client.0.smithi043.stderr: -378> 2024-09-12T00:38:12.601+0000 7f16eff9e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:12.989 INFO:tasks.workunit.client.0.smithi043.stderr: -377> 2024-09-12T00:38:12.601+0000 7f16eff9e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:12.989 INFO:tasks.workunit.client.0.smithi043.stderr: -376> 2024-09-12T00:38:12.601+0000 7f16eff9e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:12.989 INFO:tasks.workunit.client.0.smithi043.stderr: -375> 2024-09-12T00:38:12.601+0000 7f16ef79d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:12.989 INFO:tasks.workunit.client.0.smithi043.stderr: -374> 2024-09-12T00:38:12.601+0000 7f16ef79d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:12.989 INFO:tasks.workunit.client.0.smithi043.stderr: -373> 2024-09-12T00:38:12.601+0000 7f16ef79d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:12.989 INFO:tasks.workunit.client.0.smithi043.stderr: -372> 2024-09-12T00:38:12.601+0000 7f16eff9e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:12.989 INFO:tasks.workunit.client.0.smithi043.stderr: -371> 2024-09-12T00:38:12.601+0000 7f16eff9e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:12.990 INFO:tasks.workunit.client.0.smithi043.stderr: -370> 2024-09-12T00:38:12.601+0000 7f16eff9e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:12.990 INFO:tasks.workunit.client.0.smithi043.stderr: -369> 2024-09-12T00:38:12.601+0000 7f16ef79d640 10 monclient(hunting): handle_auth_done global_id 7014 payload 824 2024-09-12T00:38:12.990 INFO:tasks.workunit.client.0.smithi043.stderr: -368> 2024-09-12T00:38:12.601+0000 7f16ef79d640 10 monclient: _finish_hunting 0 2024-09-12T00:38:12.990 INFO:tasks.workunit.client.0.smithi043.stderr: -367> 2024-09-12T00:38:12.601+0000 7f16ef79d640 1 monclient: found mon.noname-a 2024-09-12T00:38:12.990 INFO:tasks.workunit.client.0.smithi043.stderr: -366> 2024-09-12T00:38:12.601+0000 7f16ef79d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:38:12.990 INFO:tasks.workunit.client.0.smithi043.stderr: -365> 2024-09-12T00:38:12.601+0000 7f15d9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:12.990 INFO:tasks.workunit.client.0.smithi043.stderr: -364> 2024-09-12T00:38:12.601+0000 7f15d9602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:38:12.990 INFO:tasks.workunit.client.0.smithi043.stderr: -363> 2024-09-12T00:38:12.601+0000 7f15d9602640 10 monclient: dump: 2024-09-12T00:38:12.990 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:12.990 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:12.990 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:12.990 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:12.990 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:12.991 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:12.991 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:12.991 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:12.991 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:12.991 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:12.991 INFO:tasks.workunit.client.0.smithi043.stderr: -362> 2024-09-12T00:38:12.601+0000 7f15d9602640 10 monclient: _finish_auth 0 2024-09-12T00:38:12.991 INFO:tasks.workunit.client.0.smithi043.stderr: -361> 2024-09-12T00:38:12.601+0000 7f15d9602640 10 monclient: _check_auth_tickets 2024-09-12T00:38:12.991 INFO:tasks.workunit.client.0.smithi043.stderr: -360> 2024-09-12T00:38:12.601+0000 7f15d9602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:12.991 INFO:tasks.workunit.client.0.smithi043.stderr: -359> 2024-09-12T00:38:12.601+0000 7f15d9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:12.992 INFO:tasks.workunit.client.0.smithi043.stderr: -358> 2024-09-12T00:38:12.601+0000 7f15d9602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:12.992 INFO:tasks.workunit.client.0.smithi043.stderr: -357> 2024-09-12T00:38:12.601+0000 7f15d9602640 10 monclient: dump: 2024-09-12T00:38:12.992 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:12.992 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:12.992 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:12.992 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:12.992 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:12.992 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:12.992 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:12.992 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:12.992 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:12.992 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:12.993 INFO:tasks.workunit.client.0.smithi043.stderr: -356> 2024-09-12T00:38:12.601+0000 7f16f079f640 4 set_mon_vals no callback set 2024-09-12T00:38:12.993 INFO:tasks.workunit.client.0.smithi043.stderr: -355> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 monclient: authenticate success, global_id 7014 2024-09-12T00:38:12.993 INFO:tasks.workunit.client.0.smithi043.stderr: -354> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 10 monclient: _renew_subs 2024-09-12T00:38:12.993 INFO:tasks.workunit.client.0.smithi043.stderr: -353> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:38:12.993 INFO:tasks.workunit.client.0.smithi043.stderr: -352> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 10 monclient: _renew_subs 2024-09-12T00:38:12.993 INFO:tasks.workunit.client.0.smithi043.stderr: -351> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:38:12.993 INFO:tasks.workunit.client.0.smithi043.stderr: -350> 2024-09-12T00:38:12.605+0000 7f15d9602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:38:12.993 INFO:tasks.workunit.client.0.smithi043.stderr: -349> 2024-09-12T00:38:12.605+0000 7f15d9602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:38:12.993 INFO:tasks.workunit.client.0.smithi043.stderr: -348> 2024-09-12T00:38:12.605+0000 7f15d9602640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:38:12.993 INFO:tasks.workunit.client.0.smithi043.stderr: -347> 2024-09-12T00:38:12.605+0000 7f16eef9c640 10 monclient: get_auth_request con 0x7f15c8070a20 auth_method 0 2024-09-12T00:38:12.993 INFO:tasks.workunit.client.0.smithi043.stderr: -346> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient: get_monmap_and_config 2024-09-12T00:38:12.993 INFO:tasks.workunit.client.0.smithi043.stderr: -345> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient: build_initial_monmap 2024-09-12T00:38:12.994 INFO:tasks.workunit.client.0.smithi043.stderr: -344> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 1 build_initial for_mkfs: 0 2024-09-12T00:38:12.994 INFO:tasks.workunit.client.0.smithi043.stderr: -343> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient: monmap: 2024-09-12T00:38:12.994 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:38:12.994 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:12.994 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:38:12.994 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:38:12.994 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:12.994 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:12.994 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:38:12.994 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:38:12.994 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:38:12.994 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:12.995 INFO:tasks.workunit.client.0.smithi043.stderr: -342> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82cd90) adding auth protocol: cephx 2024-09-12T00:38:12.995 INFO:tasks.workunit.client.0.smithi043.stderr: -341> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82cd90) adding auth protocol: cephx 2024-09-12T00:38:12.995 INFO:tasks.workunit.client.0.smithi043.stderr: -340> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82cd90) adding auth protocol: cephx 2024-09-12T00:38:12.995 INFO:tasks.workunit.client.0.smithi043.stderr: -339> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82cd90) adding con mode: secure 2024-09-12T00:38:12.995 INFO:tasks.workunit.client.0.smithi043.stderr: -338> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82cd90) adding con mode: crc 2024-09-12T00:38:12.995 INFO:tasks.workunit.client.0.smithi043.stderr: -337> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82cd90) adding con mode: secure 2024-09-12T00:38:12.995 INFO:tasks.workunit.client.0.smithi043.stderr: -336> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82cd90) adding con mode: crc 2024-09-12T00:38:12.995 INFO:tasks.workunit.client.0.smithi043.stderr: -335> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82cd90) adding con mode: secure 2024-09-12T00:38:12.995 INFO:tasks.workunit.client.0.smithi043.stderr: -334> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82cd90) adding con mode: crc 2024-09-12T00:38:12.995 INFO:tasks.workunit.client.0.smithi043.stderr: -333> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82cd90) adding con mode: crc 2024-09-12T00:38:12.995 INFO:tasks.workunit.client.0.smithi043.stderr: -332> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82cd90) adding con mode: secure 2024-09-12T00:38:12.995 INFO:tasks.workunit.client.0.smithi043.stderr: -331> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82cd90) adding con mode: crc 2024-09-12T00:38:12.996 INFO:tasks.workunit.client.0.smithi043.stderr: -330> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82cd90) adding con mode: secure 2024-09-12T00:38:12.996 INFO:tasks.workunit.client.0.smithi043.stderr: -329> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82cd90) adding con mode: crc 2024-09-12T00:38:12.996 INFO:tasks.workunit.client.0.smithi043.stderr: -328> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82cd90) adding con mode: secure 2024-09-12T00:38:12.996 INFO:tasks.workunit.client.0.smithi043.stderr: -327> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:12.996 INFO:tasks.workunit.client.0.smithi043.stderr: -326> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient: init 2024-09-12T00:38:12.996 INFO:tasks.workunit.client.0.smithi043.stderr: -325> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaa10) adding auth protocol: cephx 2024-09-12T00:38:12.996 INFO:tasks.workunit.client.0.smithi043.stderr: -324> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaa10) adding auth protocol: cephx 2024-09-12T00:38:12.996 INFO:tasks.workunit.client.0.smithi043.stderr: -323> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaa10) adding auth protocol: cephx 2024-09-12T00:38:12.996 INFO:tasks.workunit.client.0.smithi043.stderr: -322> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaa10) adding con mode: secure 2024-09-12T00:38:12.996 INFO:tasks.workunit.client.0.smithi043.stderr: -321> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaa10) adding con mode: crc 2024-09-12T00:38:12.996 INFO:tasks.workunit.client.0.smithi043.stderr: -320> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaa10) adding con mode: secure 2024-09-12T00:38:12.996 INFO:tasks.workunit.client.0.smithi043.stderr: -319> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaa10) adding con mode: crc 2024-09-12T00:38:12.996 INFO:tasks.workunit.client.0.smithi043.stderr: -318> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaa10) adding con mode: secure 2024-09-12T00:38:12.997 INFO:tasks.workunit.client.0.smithi043.stderr: -317> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaa10) adding con mode: crc 2024-09-12T00:38:12.997 INFO:tasks.workunit.client.0.smithi043.stderr: -316> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaa10) adding con mode: crc 2024-09-12T00:38:12.997 INFO:tasks.workunit.client.0.smithi043.stderr: -315> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaa10) adding con mode: secure 2024-09-12T00:38:12.997 INFO:tasks.workunit.client.0.smithi043.stderr: -314> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaa10) adding con mode: crc 2024-09-12T00:38:12.997 INFO:tasks.workunit.client.0.smithi043.stderr: -313> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaa10) adding con mode: secure 2024-09-12T00:38:12.997 INFO:tasks.workunit.client.0.smithi043.stderr: -312> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaa10) adding con mode: crc 2024-09-12T00:38:12.997 INFO:tasks.workunit.client.0.smithi043.stderr: -311> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaa10) adding con mode: secure 2024-09-12T00:38:12.997 INFO:tasks.workunit.client.0.smithi043.stderr: -310> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:12.997 INFO:tasks.workunit.client.0.smithi043.stderr: -309> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:12.997 INFO:tasks.workunit.client.0.smithi043.stderr: -308> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 asok(0x55b5cb5872b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe89beab58 EEXIST 2024-09-12T00:38:12.997 INFO:tasks.workunit.client.0.smithi043.stderr: -307> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:12.997 INFO:tasks.workunit.client.0.smithi043.stderr: -306> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:38:12.997 INFO:tasks.workunit.client.0.smithi043.stderr: -305> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient(hunting): picked mon.noname-b con 0x55b5cb861290 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:38:12.998 INFO:tasks.workunit.client.0.smithi043.stderr: -304> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient(hunting): picked mon.noname-a con 0x55b5cb85b4d0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:38:12.998 INFO:tasks.workunit.client.0.smithi043.stderr: -303> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient(hunting): picked mon.noname-c con 0x55b5cb85c6d0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:38:12.998 INFO:tasks.workunit.client.0.smithi043.stderr: -302> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:12.998 INFO:tasks.workunit.client.0.smithi043.stderr: -301> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:12.998 INFO:tasks.workunit.client.0.smithi043.stderr: -300> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:12.998 INFO:tasks.workunit.client.0.smithi043.stderr: -299> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:12.998 INFO:tasks.workunit.client.0.smithi043.stderr: -298> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient(hunting): authenticate will time out at 2188.597747s 2024-09-12T00:38:12.998 INFO:tasks.workunit.client.0.smithi043.stderr: -297> 2024-09-12T00:38:12.605+0000 7f16eef9c640 10 monclient(hunting): get_auth_request con 0x55b5cb85b4d0 auth_method 0 2024-09-12T00:38:12.998 INFO:tasks.workunit.client.0.smithi043.stderr: -296> 2024-09-12T00:38:12.605+0000 7f16eef9c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:12.998 INFO:tasks.workunit.client.0.smithi043.stderr: -295> 2024-09-12T00:38:12.605+0000 7f16eef9c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:12.998 INFO:tasks.workunit.client.0.smithi043.stderr: -294> 2024-09-12T00:38:12.605+0000 7f16eef9c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:12.998 INFO:tasks.workunit.client.0.smithi043.stderr: -293> 2024-09-12T00:38:12.605+0000 7f16eff9e640 10 monclient(hunting): get_auth_request con 0x55b5cb85c6d0 auth_method 0 2024-09-12T00:38:12.999 INFO:tasks.workunit.client.0.smithi043.stderr: -292> 2024-09-12T00:38:12.605+0000 7f16eff9e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:12.999 INFO:tasks.workunit.client.0.smithi043.stderr: -291> 2024-09-12T00:38:12.605+0000 7f16eff9e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:12.999 INFO:tasks.workunit.client.0.smithi043.stderr: -290> 2024-09-12T00:38:12.605+0000 7f16eff9e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:12.999 INFO:tasks.workunit.client.0.smithi043.stderr: -289> 2024-09-12T00:38:12.605+0000 7f16eef9c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:12.999 INFO:tasks.workunit.client.0.smithi043.stderr: -288> 2024-09-12T00:38:12.605+0000 7f16eef9c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:12.999 INFO:tasks.workunit.client.0.smithi043.stderr: -287> 2024-09-12T00:38:12.605+0000 7f16eef9c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:12.999 INFO:tasks.workunit.client.0.smithi043.stderr: -286> 2024-09-12T00:38:12.605+0000 7f16eff9e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:12.999 INFO:tasks.workunit.client.0.smithi043.stderr: -285> 2024-09-12T00:38:12.605+0000 7f16eff9e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:12.999 INFO:tasks.workunit.client.0.smithi043.stderr: -284> 2024-09-12T00:38:12.605+0000 7f16eff9e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:12.999 INFO:tasks.workunit.client.0.smithi043.stderr: -283> 2024-09-12T00:38:12.605+0000 7f16ef79d640 10 monclient(hunting): get_auth_request con 0x55b5cb861290 auth_method 0 2024-09-12T00:38:12.999 INFO:tasks.workunit.client.0.smithi043.stderr: -282> 2024-09-12T00:38:12.605+0000 7f16ef79d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:12.999 INFO:tasks.workunit.client.0.smithi043.stderr: -281> 2024-09-12T00:38:12.605+0000 7f16ef79d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:12.999 INFO:tasks.workunit.client.0.smithi043.stderr: -280> 2024-09-12T00:38:12.605+0000 7f16ef79d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:13.000 INFO:tasks.workunit.client.0.smithi043.stderr: -279> 2024-09-12T00:38:12.605+0000 7f16eef9c640 10 monclient(hunting): handle_auth_done global_id 7017 payload 274 2024-09-12T00:38:13.000 INFO:tasks.workunit.client.0.smithi043.stderr: -278> 2024-09-12T00:38:12.605+0000 7f16eef9c640 10 monclient: _finish_hunting 0 2024-09-12T00:38:13.000 INFO:tasks.workunit.client.0.smithi043.stderr: -277> 2024-09-12T00:38:12.605+0000 7f16eef9c640 1 monclient: found mon.noname-a 2024-09-12T00:38:13.000 INFO:tasks.workunit.client.0.smithi043.stderr: -276> 2024-09-12T00:38:12.605+0000 7f16eef9c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:38:13.000 INFO:tasks.workunit.client.0.smithi043.stderr: -275> 2024-09-12T00:38:12.605+0000 7f15d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:13.000 INFO:tasks.workunit.client.0.smithi043.stderr: -274> 2024-09-12T00:38:12.605+0000 7f15d2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:38:13.000 INFO:tasks.workunit.client.0.smithi043.stderr: -273> 2024-09-12T00:38:12.605+0000 7f15d2ffd640 10 monclient: dump: 2024-09-12T00:38:13.000 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:13.000 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:13.000 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:13.000 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:13.000 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:13.001 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:13.001 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:13.001 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:13.001 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:13.001 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:13.001 INFO:tasks.workunit.client.0.smithi043.stderr: -272> 2024-09-12T00:38:12.605+0000 7f15d2ffd640 10 monclient: _finish_auth 0 2024-09-12T00:38:13.001 INFO:tasks.workunit.client.0.smithi043.stderr: -271> 2024-09-12T00:38:12.605+0000 7f15d2ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:38:13.001 INFO:tasks.workunit.client.0.smithi043.stderr: -270> 2024-09-12T00:38:12.605+0000 7f15d2ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:13.001 INFO:tasks.workunit.client.0.smithi043.stderr: -269> 2024-09-12T00:38:12.605+0000 7f15d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:13.001 INFO:tasks.workunit.client.0.smithi043.stderr: -268> 2024-09-12T00:38:12.605+0000 7f15d2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:13.001 INFO:tasks.workunit.client.0.smithi043.stderr: -267> 2024-09-12T00:38:12.605+0000 7f15d2ffd640 10 monclient: dump: 2024-09-12T00:38:13.002 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:13.002 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:13.002 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:13.002 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:13.002 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:13.002 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:13.002 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:13.002 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:13.002 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:13.002 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:13.002 INFO:tasks.workunit.client.0.smithi043.stderr: -266> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 monclient: authenticate success, global_id 7017 2024-09-12T00:38:13.002 INFO:tasks.workunit.client.0.smithi043.stderr: -265> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient: get_monmap_and_config success 2024-09-12T00:38:13.003 INFO:tasks.workunit.client.0.smithi043.stderr: -264> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 4 set_mon_vals no callback set 2024-09-12T00:38:13.003 INFO:tasks.workunit.client.0.smithi043.stderr: -263> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient: shutdown 2024-09-12T00:38:13.003 INFO:tasks.workunit.client.0.smithi043.stderr: -262> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient: build_initial_monmap 2024-09-12T00:38:13.003 INFO:tasks.workunit.client.0.smithi043.stderr: -261> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 1 build_initial for_mkfs: 0 2024-09-12T00:38:13.003 INFO:tasks.workunit.client.0.smithi043.stderr: -260> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient: monmap: 2024-09-12T00:38:13.003 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:38:13.003 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:13.003 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:38:13.003 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:38:13.003 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:13.003 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:13.003 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:38:13.004 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:38:13.004 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:38:13.004 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:13.004 INFO:tasks.workunit.client.0.smithi043.stderr: -259> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82ea20) adding auth protocol: cephx 2024-09-12T00:38:13.004 INFO:tasks.workunit.client.0.smithi043.stderr: -258> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82ea20) adding auth protocol: cephx 2024-09-12T00:38:13.004 INFO:tasks.workunit.client.0.smithi043.stderr: -257> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82ea20) adding auth protocol: cephx 2024-09-12T00:38:13.004 INFO:tasks.workunit.client.0.smithi043.stderr: -256> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82ea20) adding con mode: secure 2024-09-12T00:38:13.004 INFO:tasks.workunit.client.0.smithi043.stderr: -255> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82ea20) adding con mode: crc 2024-09-12T00:38:13.004 INFO:tasks.workunit.client.0.smithi043.stderr: -254> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82ea20) adding con mode: secure 2024-09-12T00:38:13.004 INFO:tasks.workunit.client.0.smithi043.stderr: -253> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82ea20) adding con mode: crc 2024-09-12T00:38:13.004 INFO:tasks.workunit.client.0.smithi043.stderr: -252> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82ea20) adding con mode: secure 2024-09-12T00:38:13.004 INFO:tasks.workunit.client.0.smithi043.stderr: -251> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82ea20) adding con mode: crc 2024-09-12T00:38:13.004 INFO:tasks.workunit.client.0.smithi043.stderr: -250> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82ea20) adding con mode: crc 2024-09-12T00:38:13.005 INFO:tasks.workunit.client.0.smithi043.stderr: -249> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82ea20) adding con mode: secure 2024-09-12T00:38:13.005 INFO:tasks.workunit.client.0.smithi043.stderr: -248> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82ea20) adding con mode: crc 2024-09-12T00:38:13.005 INFO:tasks.workunit.client.0.smithi043.stderr: -247> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82ea20) adding con mode: secure 2024-09-12T00:38:13.005 INFO:tasks.workunit.client.0.smithi043.stderr: -246> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82ea20) adding con mode: crc 2024-09-12T00:38:13.005 INFO:tasks.workunit.client.0.smithi043.stderr: -245> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82ea20) adding con mode: secure 2024-09-12T00:38:13.005 INFO:tasks.workunit.client.0.smithi043.stderr: -244> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:13.005 INFO:tasks.workunit.client.0.smithi043.stderr: -243> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 1 librados: starting msgr at 2024-09-12T00:38:13.005 INFO:tasks.workunit.client.0.smithi043.stderr: -242> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 1 librados: starting objecter 2024-09-12T00:38:13.005 INFO:tasks.workunit.client.0.smithi043.stderr: -241> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 asok(0x55b5cb5872b0) register_command objecter_requests cmddesc objecter_requests hook 0x55b5cb810640 EEXIST 2024-09-12T00:38:13.005 INFO:tasks.workunit.client.0.smithi043.stderr: -240> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 1 librados: setting wanted keys 2024-09-12T00:38:13.005 INFO:tasks.workunit.client.0.smithi043.stderr: -239> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 1 librados: calling monclient init 2024-09-12T00:38:13.005 INFO:tasks.workunit.client.0.smithi043.stderr: -238> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient: init 2024-09-12T00:38:13.006 INFO:tasks.workunit.client.0.smithi043.stderr: -237> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb80f630) adding auth protocol: cephx 2024-09-12T00:38:13.006 INFO:tasks.workunit.client.0.smithi043.stderr: -236> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb80f630) adding auth protocol: cephx 2024-09-12T00:38:13.006 INFO:tasks.workunit.client.0.smithi043.stderr: -235> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb80f630) adding auth protocol: cephx 2024-09-12T00:38:13.006 INFO:tasks.workunit.client.0.smithi043.stderr: -234> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb80f630) adding con mode: secure 2024-09-12T00:38:13.006 INFO:tasks.workunit.client.0.smithi043.stderr: -233> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb80f630) adding con mode: crc 2024-09-12T00:38:13.006 INFO:tasks.workunit.client.0.smithi043.stderr: -232> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb80f630) adding con mode: secure 2024-09-12T00:38:13.006 INFO:tasks.workunit.client.0.smithi043.stderr: -231> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb80f630) adding con mode: crc 2024-09-12T00:38:13.006 INFO:tasks.workunit.client.0.smithi043.stderr: -230> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb80f630) adding con mode: secure 2024-09-12T00:38:13.006 INFO:tasks.workunit.client.0.smithi043.stderr: -229> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb80f630) adding con mode: crc 2024-09-12T00:38:13.006 INFO:tasks.workunit.client.0.smithi043.stderr: -228> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb80f630) adding con mode: crc 2024-09-12T00:38:13.006 INFO:tasks.workunit.client.0.smithi043.stderr: -227> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb80f630) adding con mode: secure 2024-09-12T00:38:13.006 INFO:tasks.workunit.client.0.smithi043.stderr: -226> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb80f630) adding con mode: crc 2024-09-12T00:38:13.007 INFO:tasks.workunit.client.0.smithi043.stderr: -225> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb80f630) adding con mode: secure 2024-09-12T00:38:13.007 INFO:tasks.workunit.client.0.smithi043.stderr: -224> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb80f630) adding con mode: crc 2024-09-12T00:38:13.007 INFO:tasks.workunit.client.0.smithi043.stderr: -223> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb80f630) adding con mode: secure 2024-09-12T00:38:13.007 INFO:tasks.workunit.client.0.smithi043.stderr: -222> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:13.007 INFO:tasks.workunit.client.0.smithi043.stderr: -221> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:13.007 INFO:tasks.workunit.client.0.smithi043.stderr: -220> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 5 asok(0x55b5cb5872b0) register_command rotate-key cmddesc rotate-key hook 0x55b5cb80f778 EEXIST 2024-09-12T00:38:13.007 INFO:tasks.workunit.client.0.smithi043.stderr: -219> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:13.007 INFO:tasks.workunit.client.0.smithi043.stderr: -218> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:38:13.007 INFO:tasks.workunit.client.0.smithi043.stderr: -217> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 10 monclient(hunting): picked mon.noname-a con 0x55b5cb85b4d0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:38:13.007 INFO:tasks.workunit.client.0.smithi043.stderr: -216> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 10 monclient(hunting): picked mon.noname-c con 0x55b5cb85c6d0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:38:13.007 INFO:tasks.workunit.client.0.smithi043.stderr: -215> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 10 monclient(hunting): picked mon.noname-b con 0x55b5cb861290 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:38:13.007 INFO:tasks.workunit.client.0.smithi043.stderr: -214> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:13.008 INFO:tasks.workunit.client.0.smithi043.stderr: -213> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:13.008 INFO:tasks.workunit.client.0.smithi043.stderr: -212> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:13.008 INFO:tasks.workunit.client.0.smithi043.stderr: -211> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:13.008 INFO:tasks.workunit.client.0.smithi043.stderr: -210> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 10 monclient(hunting): authenticate will time out at 2188.600433s 2024-09-12T00:38:13.008 INFO:tasks.workunit.client.0.smithi043.stderr: -209> 2024-09-12T00:38:12.609+0000 7f16ef79d640 10 monclient(hunting): get_auth_request con 0x55b5cb85b4d0 auth_method 0 2024-09-12T00:38:13.008 INFO:tasks.workunit.client.0.smithi043.stderr: -208> 2024-09-12T00:38:12.609+0000 7f16ef79d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:13.008 INFO:tasks.workunit.client.0.smithi043.stderr: -207> 2024-09-12T00:38:12.609+0000 7f16ef79d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:13.008 INFO:tasks.workunit.client.0.smithi043.stderr: -206> 2024-09-12T00:38:12.609+0000 7f16ef79d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:13.008 INFO:tasks.workunit.client.0.smithi043.stderr: -205> 2024-09-12T00:38:12.609+0000 7f16eef9c640 10 monclient(hunting): get_auth_request con 0x55b5cb85c6d0 auth_method 0 2024-09-12T00:38:13.008 INFO:tasks.workunit.client.0.smithi043.stderr: -204> 2024-09-12T00:38:12.609+0000 7f16eef9c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:13.008 INFO:tasks.workunit.client.0.smithi043.stderr: -203> 2024-09-12T00:38:12.609+0000 7f16eef9c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:13.008 INFO:tasks.workunit.client.0.smithi043.stderr: -202> 2024-09-12T00:38:12.609+0000 7f16eef9c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:13.008 INFO:tasks.workunit.client.0.smithi043.stderr: -201> 2024-09-12T00:38:12.609+0000 7f16ef79d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:13.009 INFO:tasks.workunit.client.0.smithi043.stderr: -200> 2024-09-12T00:38:12.609+0000 7f16ef79d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:13.009 INFO:tasks.workunit.client.0.smithi043.stderr: -199> 2024-09-12T00:38:12.609+0000 7f16ef79d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:13.009 INFO:tasks.workunit.client.0.smithi043.stderr: -198> 2024-09-12T00:38:12.609+0000 7f16eef9c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:13.009 INFO:tasks.workunit.client.0.smithi043.stderr: -197> 2024-09-12T00:38:12.609+0000 7f16eef9c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:13.009 INFO:tasks.workunit.client.0.smithi043.stderr: -196> 2024-09-12T00:38:12.609+0000 7f16eef9c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:13.009 INFO:tasks.workunit.client.0.smithi043.stderr: -195> 2024-09-12T00:38:12.609+0000 7f16ef79d640 10 monclient(hunting): handle_auth_done global_id 7020 payload 824 2024-09-12T00:38:13.009 INFO:tasks.workunit.client.0.smithi043.stderr: -194> 2024-09-12T00:38:12.609+0000 7f16ef79d640 10 monclient: _finish_hunting 0 2024-09-12T00:38:13.009 INFO:tasks.workunit.client.0.smithi043.stderr: -193> 2024-09-12T00:38:12.609+0000 7f16ef79d640 1 monclient: found mon.noname-a 2024-09-12T00:38:13.009 INFO:tasks.workunit.client.0.smithi043.stderr: -192> 2024-09-12T00:38:12.609+0000 7f16ef79d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:38:13.009 INFO:tasks.workunit.client.0.smithi043.stderr: -191> 2024-09-12T00:38:12.609+0000 7f15d17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:13.009 INFO:tasks.workunit.client.0.smithi043.stderr: -190> 2024-09-12T00:38:12.609+0000 7f15d17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:38:13.009 INFO:tasks.workunit.client.0.smithi043.stderr: -189> 2024-09-12T00:38:12.609+0000 7f15d17fa640 10 monclient: dump: 2024-09-12T00:38:13.009 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:13.009 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:13.010 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:13.010 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:13.010 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:13.010 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:13.010 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:13.010 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:13.010 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:13.010 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:13.010 INFO:tasks.workunit.client.0.smithi043.stderr: -188> 2024-09-12T00:38:12.609+0000 7f15d17fa640 10 monclient: _finish_auth 0 2024-09-12T00:38:13.010 INFO:tasks.workunit.client.0.smithi043.stderr: -187> 2024-09-12T00:38:12.609+0000 7f15d17fa640 10 monclient: _check_auth_tickets 2024-09-12T00:38:13.010 INFO:tasks.workunit.client.0.smithi043.stderr: -186> 2024-09-12T00:38:12.609+0000 7f15d17fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:13.010 INFO:tasks.workunit.client.0.smithi043.stderr: -185> 2024-09-12T00:38:12.609+0000 7f15d17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:13.011 INFO:tasks.workunit.client.0.smithi043.stderr: -184> 2024-09-12T00:38:12.609+0000 7f15d17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:13.011 INFO:tasks.workunit.client.0.smithi043.stderr: -183> 2024-09-12T00:38:12.609+0000 7f15d17fa640 10 monclient: dump: 2024-09-12T00:38:13.011 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:13.011 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:13.011 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:13.011 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:13.011 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:13.011 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:13.011 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:13.011 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:13.011 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:13.011 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:13.011 INFO:tasks.workunit.client.0.smithi043.stderr: -182> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 5 monclient: authenticate success, global_id 7020 2024-09-12T00:38:13.011 INFO:tasks.workunit.client.0.smithi043.stderr: -181> 2024-09-12T00:38:12.609+0000 7f15d2ffd640 4 set_mon_vals no callback set 2024-09-12T00:38:13.012 INFO:tasks.workunit.client.0.smithi043.stderr: -180> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 10 monclient: _renew_subs 2024-09-12T00:38:13.012 INFO:tasks.workunit.client.0.smithi043.stderr: -179> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:38:13.012 INFO:tasks.workunit.client.0.smithi043.stderr: -178> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 10 monclient: _renew_subs 2024-09-12T00:38:13.012 INFO:tasks.workunit.client.0.smithi043.stderr: -177> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:38:13.012 INFO:tasks.workunit.client.0.smithi043.stderr: -176> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 1 librados: init done 2024-09-12T00:38:13.012 INFO:tasks.workunit.client.0.smithi043.stderr: -175> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 5 asok(0x55b5cb5872b0) register_command cr dump hook 0x55b5cb8598b8 2024-09-12T00:38:13.012 INFO:tasks.workunit.client.0.smithi043.stderr: -174> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.012 INFO:tasks.workunit.client.0.smithi043.stderr: -173> 2024-09-12T00:38:12.609+0000 7f15d17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:38:13.012 INFO:tasks.workunit.client.0.smithi043.stderr: -172> 2024-09-12T00:38:12.609+0000 7f15d17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:38:13.012 INFO:tasks.workunit.client.0.smithi043.stderr: -171> 2024-09-12T00:38:12.609+0000 7f15d17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:38:13.012 INFO:tasks.workunit.client.0.smithi043.stderr: -170> 2024-09-12T00:38:12.609+0000 7f16eef9c640 10 monclient: get_auth_request con 0x7f15b8070b10 auth_method 0 2024-09-12T00:38:13.013 INFO:tasks.workunit.client.0.smithi043.stderr: -169> 2024-09-12T00:38:12.609+0000 7f16eff9e640 10 monclient: get_auth_request con 0x55b5cb87a770 auth_method 0 2024-09-12T00:38:13.013 INFO:tasks.workunit.client.0.smithi043.stderr: -168> 2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.013 INFO:tasks.workunit.client.0.smithi043.stderr: -167> 2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 realm 2024-09-12T00:38:13.013 INFO:tasks.workunit.client.0.smithi043.stderr: -166> 2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.013 INFO:tasks.workunit.client.0.smithi043.stderr: -165> 2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.013 INFO:tasks.workunit.client.0.smithi043.stderr: -164> 2024-09-12T00:38:12.613+0000 7f16f1c979c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:13.013 INFO:tasks.workunit.client.0.smithi043.stderr: -163> 2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.013 INFO:tasks.workunit.client.0.smithi043.stderr: -162> 2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.014 INFO:tasks.workunit.client.0.smithi043.stderr: -161> 2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.014 INFO:tasks.workunit.client.0.smithi043.stderr: -160> 2024-09-12T00:38:12.613+0000 7f16ef79d640 10 monclient: get_auth_request con 0x55b5cb87e9e0 auth_method 0 2024-09-12T00:38:13.014 INFO:tasks.workunit.client.0.smithi043.stderr: -159> 2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:13.014 INFO:tasks.workunit.client.0.smithi043.stderr: -158> 2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.014 INFO:tasks.workunit.client.0.smithi043.stderr: -157> 2024-09-12T00:38:12.613+0000 7f16eef9c640 10 monclient: get_auth_request con 0x55b5cb882240 auth_method 0 2024-09-12T00:38:13.014 INFO:tasks.workunit.client.0.smithi043.stderr: -156> 2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:13.014 INFO:tasks.workunit.client.0.smithi043.stderr: -155> 2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 searching for the correct realm 2024-09-12T00:38:13.014 INFO:tasks.workunit.client.0.smithi043.stderr: -154> 2024-09-12T00:38:12.613+0000 7f16eff9e640 10 monclient: get_auth_request con 0x55b5cb887020 auth_method 0 2024-09-12T00:38:13.014 INFO:tasks.workunit.client.0.smithi043.stderr: -153> 2024-09-12T00:38:12.617+0000 7f16ef79d640 10 monclient: get_auth_request con 0x7f16e80ab070 auth_method 0 2024-09-12T00:38:13.014 INFO:tasks.workunit.client.0.smithi043.stderr: -152> 2024-09-12T00:38:12.617+0000 7f16eef9c640 10 monclient: get_auth_request con 0x7f16e400a070 auth_method 0 2024-09-12T00:38:13.014 INFO:tasks.workunit.client.0.smithi043.stderr: -151> 2024-09-12T00:38:12.621+0000 7f16eff9e640 10 monclient: get_auth_request con 0x7f16e4033b10 auth_method 0 2024-09-12T00:38:13.014 INFO:tasks.workunit.client.0.smithi043.stderr: -150> 2024-09-12T00:38:12.621+0000 7f16eff9e640 0 -- 172.21.15.43:0/291986731 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f16e4033b10 msgr2=0x7f16e400b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:13.014 INFO:tasks.workunit.client.0.smithi043.stderr: -149> 2024-09-12T00:38:12.825+0000 7f16eff9e640 10 monclient: get_auth_request con 0x7f16e4033b10 auth_method 0 2024-09-12T00:38:13.015 INFO:tasks.workunit.client.0.smithi043.stderr: -148> 2024-09-12T00:38:12.833+0000 7f16ef79d640 10 monclient: get_auth_request con 0x7f16e4060970 auth_method 0 2024-09-12T00:38:13.015 INFO:tasks.workunit.client.0.smithi043.stderr: -147> 2024-09-12T00:38:12.837+0000 7f16ef79d640 0 -- 172.21.15.43:0/291986731 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x55b5cb87e9e0 msgr2=0x55b5cb880e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:13.015 INFO:tasks.workunit.client.0.smithi043.stderr: -146> 2024-09-12T00:38:12.837+0000 7f15d17fa640 1 client.7020.objecter ms_handle_reset 0x55b5cb87e9e0 session 0x55b5cb87e360 osd.5 2024-09-12T00:38:13.015 INFO:tasks.workunit.client.0.smithi043.stderr: -145> 2024-09-12T00:38:12.837+0000 7f15d17fa640 10 monclient: _renew_subs 2024-09-12T00:38:13.015 INFO:tasks.workunit.client.0.smithi043.stderr: -144> 2024-09-12T00:38:12.837+0000 7f15d17fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:38:13.015 INFO:tasks.workunit.client.0.smithi043.stderr: -143> 2024-09-12T00:38:12.841+0000 7f16ef79d640 10 monclient: get_auth_request con 0x7f15b8080b30 auth_method 0 2024-09-12T00:38:13.015 INFO:tasks.workunit.client.0.smithi043.stderr: -142> 2024-09-12T00:38:12.845+0000 7f16f1c979c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:38:13.015 INFO:tasks.workunit.client.0.smithi043.stderr: -141> 2024-09-12T00:38:12.845+0000 7f16f1c979c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:13.015 INFO:tasks.workunit.client.0.smithi043.stderr: -140> 2024-09-12T00:38:12.845+0000 7f16f1c979c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:13.015 INFO:tasks.workunit.client.0.smithi043.stderr: -139> 2024-09-12T00:38:12.845+0000 7f16f1c979c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:38:13.015 INFO:tasks.workunit.client.0.smithi043.stderr: -138> 2024-09-12T00:38:12.845+0000 7f16f1c979c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:13.015 INFO:tasks.workunit.client.0.smithi043.stderr: -137> 2024-09-12T00:38:12.845+0000 7f16f1c979c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:13.015 INFO:tasks.workunit.client.0.smithi043.stderr: -136> 2024-09-12T00:38:12.845+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.016 INFO:tasks.workunit.client.0.smithi043.stderr: -135> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.016 INFO:tasks.workunit.client.0.smithi043.stderr: -134> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.016 INFO:tasks.workunit.client.0.smithi043.stderr: -133> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:13.016 INFO:tasks.workunit.client.0.smithi043.stderr: -132> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.016 INFO:tasks.workunit.client.0.smithi043.stderr: -131> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:13.016 INFO:tasks.workunit.client.0.smithi043.stderr: -130> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 zone default found 2024-09-12T00:38:13.016 INFO:tasks.workunit.client.0.smithi043.stderr: -129> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 4 Realm: () 2024-09-12T00:38:13.016 INFO:tasks.workunit.client.0.smithi043.stderr: -128> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:38:13.016 INFO:tasks.workunit.client.0.smithi043.stderr: -127> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:38:13.016 INFO:tasks.workunit.client.0.smithi043.stderr: -126> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:13.016 INFO:tasks.workunit.client.0.smithi043.stderr: -125> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 zonegroup default 2024-09-12T00:38:13.016 INFO:tasks.workunit.client.0.smithi043.stderr: -124> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.017 INFO:tasks.workunit.client.0.smithi043.stderr: -123> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.017 INFO:tasks.workunit.client.0.smithi043.stderr: -122> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.017 INFO:tasks.workunit.client.0.smithi043.stderr: -121> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.017 INFO:tasks.workunit.client.0.smithi043.stderr: -120> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.017 INFO:tasks.workunit.client.0.smithi043.stderr: -119> 2024-09-12T00:38:12.853+0000 7f16f1c979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.017 INFO:tasks.workunit.client.0.smithi043.stderr: -118> 2024-09-12T00:38:12.853+0000 7f16f1c979c0 20 started sync module instance, tier type = 2024-09-12T00:38:13.017 INFO:tasks.workunit.client.0.smithi043.stderr: -117> 2024-09-12T00:38:12.853+0000 7f16f1c979c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:38:13.017 INFO:tasks.workunit.client.0.smithi043.stderr: -116> 2024-09-12T00:38:12.877+0000 7f16f1c979c0 20 add_watcher() i=0 2024-09-12T00:38:13.017 INFO:tasks.workunit.client.0.smithi043.stderr: -115> 2024-09-12T00:38:12.877+0000 7f16f1c979c0 20 add_watcher() i=1 2024-09-12T00:38:13.017 INFO:tasks.workunit.client.0.smithi043.stderr: -114> 2024-09-12T00:38:12.877+0000 7f16f1c979c0 20 add_watcher() i=2 2024-09-12T00:38:13.017 INFO:tasks.workunit.client.0.smithi043.stderr: -113> 2024-09-12T00:38:12.877+0000 7f16f1c979c0 20 add_watcher() i=3 2024-09-12T00:38:13.017 INFO:tasks.workunit.client.0.smithi043.stderr: -112> 2024-09-12T00:38:12.877+0000 7f16f1c979c0 20 add_watcher() i=4 2024-09-12T00:38:13.018 INFO:tasks.workunit.client.0.smithi043.stderr: -111> 2024-09-12T00:38:12.877+0000 7f16f1c979c0 20 add_watcher() i=5 2024-09-12T00:38:13.018 INFO:tasks.workunit.client.0.smithi043.stderr: -110> 2024-09-12T00:38:12.877+0000 7f16f1c979c0 20 add_watcher() i=6 2024-09-12T00:38:13.018 INFO:tasks.workunit.client.0.smithi043.stderr: -109> 2024-09-12T00:38:12.877+0000 7f16f1c979c0 20 add_watcher() i=7 2024-09-12T00:38:13.018 INFO:tasks.workunit.client.0.smithi043.stderr: -108> 2024-09-12T00:38:12.877+0000 7f16f1c979c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:13.018 INFO:tasks.workunit.client.0.smithi043.stderr: -107> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaef0) adding auth protocol: cephx 2024-09-12T00:38:13.018 INFO:tasks.workunit.client.0.smithi043.stderr: -106> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaef0) adding auth protocol: cephx 2024-09-12T00:38:13.018 INFO:tasks.workunit.client.0.smithi043.stderr: -105> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaef0) adding auth protocol: cephx 2024-09-12T00:38:13.018 INFO:tasks.workunit.client.0.smithi043.stderr: -104> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaef0) adding con mode: secure 2024-09-12T00:38:13.018 INFO:tasks.workunit.client.0.smithi043.stderr: -103> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaef0) adding con mode: crc 2024-09-12T00:38:13.018 INFO:tasks.workunit.client.0.smithi043.stderr: -102> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaef0) adding con mode: secure 2024-09-12T00:38:13.018 INFO:tasks.workunit.client.0.smithi043.stderr: -101> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaef0) adding con mode: crc 2024-09-12T00:38:13.018 INFO:tasks.workunit.client.0.smithi043.stderr: -100> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaef0) adding con mode: secure 2024-09-12T00:38:13.018 INFO:tasks.workunit.client.0.smithi043.stderr: -99> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaef0) adding con mode: crc 2024-09-12T00:38:13.019 INFO:tasks.workunit.client.0.smithi043.stderr: -98> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaef0) adding con mode: crc 2024-09-12T00:38:13.019 INFO:tasks.workunit.client.0.smithi043.stderr: -97> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaef0) adding con mode: secure 2024-09-12T00:38:13.019 INFO:tasks.workunit.client.0.smithi043.stderr: -96> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaef0) adding con mode: crc 2024-09-12T00:38:13.019 INFO:tasks.workunit.client.0.smithi043.stderr: -95> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaef0) adding con mode: secure 2024-09-12T00:38:13.019 INFO:tasks.workunit.client.0.smithi043.stderr: -94> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaef0) adding con mode: crc 2024-09-12T00:38:13.019 INFO:tasks.workunit.client.0.smithi043.stderr: -93> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaef0) adding con mode: secure 2024-09-12T00:38:13.019 INFO:tasks.workunit.client.0.smithi043.stderr: -92> 2024-09-12T00:38:12.881+0000 7f15a67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:13.019 INFO:tasks.workunit.client.0.smithi043.stderr: -91> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:13.019 INFO:tasks.workunit.client.0.smithi043.stderr: -90> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:13.019 INFO:tasks.workunit.client.0.smithi043.stderr: -89> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:13.019 INFO:tasks.workunit.client.0.smithi043.stderr: -88> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 asok(0x55b5cb5872b0) register_command cache list hook 0x55b5cb859220 2024-09-12T00:38:13.019 INFO:tasks.workunit.client.0.smithi043.stderr: -87> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 asok(0x55b5cb5872b0) register_command cache inspect hook 0x55b5cb859220 2024-09-12T00:38:13.019 INFO:tasks.workunit.client.0.smithi043.stderr: -86> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 5 asok(0x55b5cb5872b0) register_command cache erase hook 0x55b5cb859220 2024-09-12T00:38:13.019 INFO:tasks.workunit.client.0.smithi043.stderr: -85> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 5 asok(0x55b5cb5872b0) register_command cache zap hook 0x55b5cb859220 2024-09-12T00:38:13.020 INFO:tasks.workunit.client.0.smithi043.stderr: -84> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 5 note: GC not initialized 2024-09-12T00:38:13.020 INFO:tasks.workunit.client.0.smithi043.stderr: -83> 2024-09-12T00:38:12.885+0000 7f15a57e2640 20 reqs_thread_entry: start 2024-09-12T00:38:13.020 INFO:tasks.workunit.client.0.smithi043.stderr: -82> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 5 asok(0x55b5cb5872b0) register_command sync trace show hook 0x7f16e400c7c0 2024-09-12T00:38:13.020 INFO:tasks.workunit.client.0.smithi043.stderr: -81> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 5 asok(0x55b5cb5872b0) register_command sync trace history hook 0x7f16e400c7c0 2024-09-12T00:38:13.020 INFO:tasks.workunit.client.0.smithi043.stderr: -80> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 5 asok(0x55b5cb5872b0) register_command sync trace active hook 0x7f16e400c7c0 2024-09-12T00:38:13.020 INFO:tasks.workunit.client.0.smithi043.stderr: -79> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 5 asok(0x55b5cb5872b0) register_command sync trace active_short hook 0x7f16e400c7c0 2024-09-12T00:38:13.020 INFO:tasks.workunit.client.0.smithi043.stderr: -78> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:13.020 INFO:tasks.workunit.client.0.smithi043.stderr: -77> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 20 Filter name: none 2024-09-12T00:38:13.020 INFO:tasks.workunit.client.0.smithi043.stderr: -76> 2024-09-12T00:38:12.885+0000 7f159e7fc640 20 reqs_thread_entry: start 2024-09-12T00:38:13.020 INFO:tasks.workunit.client.0.smithi043.stderr: -75> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:38:13.020 INFO:tasks.workunit.client.0.smithi043.stderr: -74> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.020 INFO:tasks.workunit.client.0.smithi043.stderr: -73> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:38:13.020 INFO:tasks.workunit.client.0.smithi043.stderr: -72> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:38:13.021 INFO:tasks.workunit.client.0.smithi043.stderr: -71> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:38:13.021 INFO:tasks.workunit.client.0.smithi043.stderr: -70> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 : miss 2024-09-12T00:38:13.021 INFO:tasks.workunit.client.0.smithi043.stderr: -69> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.021 INFO:tasks.workunit.client.0.smithi043.stderr: -68> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:38:13.021 INFO:tasks.workunit.client.0.smithi043.stderr: -67> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 info.flags=0x17 2024-09-12T00:38:13.021 INFO:tasks.workunit.client.0.smithi043.stderr: -66> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 to cache LRU end 2024-09-12T00:38:13.021 INFO:tasks.workunit.client.0.smithi043.stderr: -65> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:13.021 INFO:tasks.workunit.client.0.smithi043.stderr: -64> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:13.021 INFO:tasks.workunit.client.0.smithi043.stderr: -63> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 2024-09-12T00:38:13.021 INFO:tasks.workunit.client.0.smithi043.stderr: -62> 2024-09-12T00:38:12.897+0000 7f16f1c979c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 info.flags=0x17 2024-09-12T00:38:13.021 INFO:tasks.workunit.client.0.smithi043.stderr: -61> 2024-09-12T00:38:12.897+0000 7f16f1c979c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 to cache LRU end 2024-09-12T00:38:13.021 INFO:tasks.workunit.client.0.smithi043.stderr: -60> 2024-09-12T00:38:12.897+0000 7f16f1c979c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:13.021 INFO:tasks.workunit.client.0.smithi043.stderr: -59> 2024-09-12T00:38:12.897+0000 7f16f1c979c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29, ofs0, ns] 2024-09-12T00:38:13.022 INFO:tasks.workunit.client.0.smithi043.stderr: -58> 2024-09-12T00:38:12.897+0000 7f15d2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333526 cookie 94239292174336 notifier 7020 bl.length()=915 2024-09-12T00:38:13.022 INFO:tasks.workunit.client.0.smithi043.stderr: -57> 2024-09-12T00:38:12.897+0000 7f15d2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 info.flags=0x17 2024-09-12T00:38:13.022 INFO:tasks.workunit.client.0.smithi043.stderr: -56> 2024-09-12T00:38:12.897+0000 7f15d2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 to cache LRU end 2024-09-12T00:38:13.022 INFO:tasks.workunit.client.0.smithi043.stderr: -55> 2024-09-12T00:38:12.897+0000 7f15d2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:13.022 INFO:tasks.workunit.client.0.smithi043.stderr: -54> 2024-09-12T00:38:12.897+0000 7f16f1c979c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): orig_sources= new_sources= 2024-09-12T00:38:13.022 INFO:tasks.workunit.client.0.smithi043.stderr: -53> 2024-09-12T00:38:12.897+0000 7f16f1c979c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): potential sources added=[] removed=[] 2024-09-12T00:38:13.022 INFO:tasks.workunit.client.0.smithi043.stderr: -52> 2024-09-12T00:38:12.897+0000 7f16f1c979c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): orig_dests= new_dests= 2024-09-12T00:38:13.022 INFO:tasks.workunit.client.0.smithi043.stderr: -51> 2024-09-12T00:38:12.897+0000 7f16f1c979c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): potential dests added=[] removed=[] 2024-09-12T00:38:13.022 INFO:tasks.workunit.client.0.smithi043.stderr: -50> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.0 2024-09-12T00:38:13.022 INFO:tasks.workunit.client.0.smithi043.stderr: -49> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.0 2024-09-12T00:38:13.022 INFO:tasks.workunit.client.0.smithi043.stderr: -48> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.1 2024-09-12T00:38:13.022 INFO:tasks.workunit.client.0.smithi043.stderr: -47> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.1 2024-09-12T00:38:13.022 INFO:tasks.workunit.client.0.smithi043.stderr: -46> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.2 2024-09-12T00:38:13.022 INFO:tasks.workunit.client.0.smithi043.stderr: -45> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.2 2024-09-12T00:38:13.023 INFO:tasks.workunit.client.0.smithi043.stderr: -44> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.3 2024-09-12T00:38:13.023 INFO:tasks.workunit.client.0.smithi043.stderr: -43> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.3 2024-09-12T00:38:13.023 INFO:tasks.workunit.client.0.smithi043.stderr: -42> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.4 2024-09-12T00:38:13.023 INFO:tasks.workunit.client.0.smithi043.stderr: -41> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.4 2024-09-12T00:38:13.023 INFO:tasks.workunit.client.0.smithi043.stderr: -40> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.5 2024-09-12T00:38:13.023 INFO:tasks.workunit.client.0.smithi043.stderr: -39> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.5 2024-09-12T00:38:13.023 INFO:tasks.workunit.client.0.smithi043.stderr: -38> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.6 2024-09-12T00:38:13.023 INFO:tasks.workunit.client.0.smithi043.stderr: -37> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.6 2024-09-12T00:38:13.023 INFO:tasks.workunit.client.0.smithi043.stderr: -36> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.7 2024-09-12T00:38:13.023 INFO:tasks.workunit.client.0.smithi043.stderr: -35> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.7 2024-09-12T00:38:13.023 INFO:tasks.workunit.client.0.smithi043.stderr: -34> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.8 2024-09-12T00:38:13.023 INFO:tasks.workunit.client.0.smithi043.stderr: -33> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.8 2024-09-12T00:38:13.023 INFO:tasks.workunit.client.0.smithi043.stderr: -32> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.9 2024-09-12T00:38:13.024 INFO:tasks.workunit.client.0.smithi043.stderr: -31> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.9 2024-09-12T00:38:13.024 INFO:tasks.workunit.client.0.smithi043.stderr: -30> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.10 2024-09-12T00:38:13.024 INFO:tasks.workunit.client.0.smithi043.stderr: -29> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.10 2024-09-12T00:38:13.024 INFO:tasks.workunit.client.0.smithi043.stderr: -28> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.11 2024-09-12T00:38:13.024 INFO:tasks.workunit.client.0.smithi043.stderr: -27> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.11 2024-09-12T00:38:13.024 INFO:tasks.workunit.client.0.smithi043.stderr: -26> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.0 2024-09-12T00:38:13.024 INFO:tasks.workunit.client.0.smithi043.stderr: -25> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1 2024-09-12T00:38:13.024 INFO:tasks.workunit.client.0.smithi043.stderr: -24> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.2 2024-09-12T00:38:13.024 INFO:tasks.workunit.client.0.smithi043.stderr: -23> 2024-09-12T00:38:12.913+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.3 2024-09-12T00:38:13.024 INFO:tasks.workunit.client.0.smithi043.stderr: -22> 2024-09-12T00:38:12.913+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.4 2024-09-12T00:38:13.024 INFO:tasks.workunit.client.0.smithi043.stderr: -21> 2024-09-12T00:38:12.913+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.5 2024-09-12T00:38:13.024 INFO:tasks.workunit.client.0.smithi043.stderr: -20> 2024-09-12T00:38:12.913+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.6 2024-09-12T00:38:13.024 INFO:tasks.workunit.client.0.smithi043.stderr: -19> 2024-09-12T00:38:12.917+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.7 2024-09-12T00:38:13.025 INFO:tasks.workunit.client.0.smithi043.stderr: -18> 2024-09-12T00:38:12.917+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.8 2024-09-12T00:38:13.025 INFO:tasks.workunit.client.0.smithi043.stderr: -17> 2024-09-12T00:38:12.917+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.9 2024-09-12T00:38:13.025 INFO:tasks.workunit.client.0.smithi043.stderr: -16> 2024-09-12T00:38:12.917+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.10 2024-09-12T00:38:13.025 INFO:tasks.workunit.client.0.smithi043.stderr: -15> 2024-09-12T00:38:12.925+0000 7f16f1c979c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:13.025 INFO:tasks.workunit.client.0.smithi043.stderr: -14> 2024-09-12T00:38:12.925+0000 7f16f1c979c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 2024-09-12T00:38:13.025 INFO:tasks.workunit.client.0.smithi043.stderr: -13> 2024-09-12T00:38:12.929+0000 7f16f1c979c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 info.flags=0x17 2024-09-12T00:38:13.025 INFO:tasks.workunit.client.0.smithi043.stderr: -12> 2024-09-12T00:38:12.929+0000 7f16f1c979c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 to cache LRU end 2024-09-12T00:38:13.025 INFO:tasks.workunit.client.0.smithi043.stderr: -11> 2024-09-12T00:38:12.929+0000 7f16f1c979c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:13.025 INFO:tasks.workunit.client.0.smithi043.stderr: -10> 2024-09-12T00:38:12.929+0000 7f16f1c979c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29, ofs0, ns] 2024-09-12T00:38:13.025 INFO:tasks.workunit.client.0.smithi043.stderr: -9> 2024-09-12T00:38:12.929+0000 7f15d27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333527 cookie 94239292174336 notifier 7020 bl.length()=915 2024-09-12T00:38:13.025 INFO:tasks.workunit.client.0.smithi043.stderr: -8> 2024-09-12T00:38:12.929+0000 7f15d27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 info.flags=0x17 2024-09-12T00:38:13.025 INFO:tasks.workunit.client.0.smithi043.stderr: -7> 2024-09-12T00:38:12.929+0000 7f15d27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 to cache LRU end 2024-09-12T00:38:13.026 INFO:tasks.workunit.client.0.smithi043.stderr: -6> 2024-09-12T00:38:12.929+0000 7f15d27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:13.026 INFO:tasks.workunit.client.0.smithi043.stderr: -5> 2024-09-12T00:38:12.929+0000 7f16f1c979c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): orig_sources= new_sources= 2024-09-12T00:38:13.026 INFO:tasks.workunit.client.0.smithi043.stderr: -4> 2024-09-12T00:38:12.929+0000 7f16f1c979c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): potential sources added=[] removed=[] 2024-09-12T00:38:13.026 INFO:tasks.workunit.client.0.smithi043.stderr: -3> 2024-09-12T00:38:12.929+0000 7f16f1c979c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): orig_dests= new_dests= 2024-09-12T00:38:13.026 INFO:tasks.workunit.client.0.smithi043.stderr: -2> 2024-09-12T00:38:12.929+0000 7f16f1c979c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): potential dests added=[] removed=[] 2024-09-12T00:38:13.026 INFO:tasks.workunit.client.0.smithi043.stderr: -1> 2024-09-12T00:38:12.933+0000 7f16f1c979c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f16f1c979c0 time 2024-09-12T00:38:12.935243+0000 2024-09-12T00:38:13.026 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:38:13.026 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:13.026 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:13.026 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f16f55712eb] 2024-09-12T00:38:13.026 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f16f557149f] 2024-09-12T00:38:13.026 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5ca2c0cc1] 2024-09-12T00:38:13.026 INFO:tasks.workunit.client.0.smithi043.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55b5ca2d5086] 2024-09-12T00:38:13.027 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55b5ca2d66a4] 2024-09-12T00:38:13.027 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:38:13.027 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f16f43d7d90] 2024-09-12T00:38:13.027 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:38:13.027 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:38:13.027 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:13.027 INFO:tasks.workunit.client.0.smithi043.stderr: 0> 2024-09-12T00:38:12.937+0000 7f16f1c979c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:38:13.027 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7f16f1c979c0 thread_name:radosgw-admin 2024-09-12T00:38:13.027 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:13.027 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:13.027 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f16f43f0520] 2024-09-12T00:38:13.027 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:38:13.027 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:38:13.028 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:38:13.028 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f16f5571345] 2024-09-12T00:38:13.028 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f16f557149f] 2024-09-12T00:38:13.028 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5ca2c0cc1] 2024-09-12T00:38:13.028 INFO:tasks.workunit.client.0.smithi043.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55b5ca2d5086] 2024-09-12T00:38:13.028 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55b5ca2d66a4] 2024-09-12T00:38:13.028 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:38:13.028 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f16f43d7d90] 2024-09-12T00:38:13.028 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:38:13.028 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:38:13.028 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:38:13.028 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:13.029 INFO:tasks.workunit.client.0.smithi043.stderr:--- logging levels --- 2024-09-12T00:38:13.029 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 none 2024-09-12T00:38:13.029 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 lockdep 2024-09-12T00:38:13.029 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 context 2024-09-12T00:38:13.029 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 crush 2024-09-12T00:38:13.029 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds 2024-09-12T00:38:13.029 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_balancer 2024-09-12T00:38:13.029 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_locker 2024-09-12T00:38:13.029 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log 2024-09-12T00:38:13.029 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log_expire 2024-09-12T00:38:13.029 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_migrator 2024-09-12T00:38:13.029 INFO:tasks.workunit.client.0.smithi043.stderr: 3/ 5 mds_quiesce 2024-09-12T00:38:13.029 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 buffer 2024-09-12T00:38:13.030 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 timer 2024-09-12T00:38:13.030 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 filer 2024-09-12T00:38:13.030 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 striper 2024-09-12T00:38:13.030 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 objecter 2024-09-12T00:38:13.030 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rados 2024-09-12T00:38:13.030 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd 2024-09-12T00:38:13.030 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_mirror 2024-09-12T00:38:13.030 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_replay 2024-09-12T00:38:13.030 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_pwl 2024-09-12T00:38:13.030 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 journaler 2024-09-12T00:38:13.030 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objectcacher 2024-09-12T00:38:13.030 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:38:13.030 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 client 2024-09-12T00:38:13.030 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 osd 2024-09-12T00:38:13.030 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 optracker 2024-09-12T00:38:13.031 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objclass 2024-09-12T00:38:13.031 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 filestore 2024-09-12T00:38:13.031 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 journal 2024-09-12T00:38:13.031 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 ms 2024-09-12T00:38:13.031 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mon 2024-09-12T00:38:13.031 INFO:tasks.workunit.client.0.smithi043.stderr: 0/10 monc 2024-09-12T00:38:13.031 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 paxos 2024-09-12T00:38:13.031 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 tp 2024-09-12T00:38:13.031 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 auth 2024-09-12T00:38:13.031 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 crypto 2024-09-12T00:38:13.031 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 finisher 2024-09-12T00:38:13.031 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 reserver 2024-09-12T00:38:13.031 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 heartbeatmap 2024-09-12T00:38:13.032 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 perfcounter 2024-09-12T00:38:13.032 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw 2024-09-12T00:38:13.032 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_sync 2024-09-12T00:38:13.032 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_datacache 2024-09-12T00:38:13.032 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_access 2024-09-12T00:38:13.032 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:38:13.032 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_flight 2024-09-12T00:38:13.032 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:38:13.032 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw_notification 2024-09-12T00:38:13.032 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 javaclient 2024-09-12T00:38:13.032 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 asok 2024-09-12T00:38:13.032 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 throttle 2024-09-12T00:38:13.032 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 refs 2024-09-12T00:38:13.033 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 compressor 2024-09-12T00:38:13.033 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluestore 2024-09-12T00:38:13.033 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluefs 2024-09-12T00:38:13.033 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 bdev 2024-09-12T00:38:13.033 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 kstore 2024-09-12T00:38:13.033 INFO:tasks.workunit.client.0.smithi043.stderr: 4/ 5 rocksdb 2024-09-12T00:38:13.033 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 fuse 2024-09-12T00:38:13.033 INFO:tasks.workunit.client.0.smithi043.stderr: 2/ 5 mgr 2024-09-12T00:38:13.033 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mgrc 2024-09-12T00:38:13.033 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 dpdk 2024-09-12T00:38:13.033 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 eventtrace 2024-09-12T00:38:13.033 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 prioritycache 2024-09-12T00:38:13.033 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 test 2024-09-12T00:38:13.034 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:38:13.034 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephsqlite 2024-09-12T00:38:13.034 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:38:13.034 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore 2024-09-12T00:38:13.034 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_onode 2024-09-12T00:38:13.034 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_odata 2024-09-12T00:38:13.034 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_omap 2024-09-12T00:38:13.034 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_tm 2024-09-12T00:38:13.034 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_t 2024-09-12T00:38:13.034 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:38:13.034 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_epm 2024-09-12T00:38:13.034 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_lba 2024-09-12T00:38:13.034 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:38:13.035 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cache 2024-09-12T00:38:13.035 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_journal 2024-09-12T00:38:13.035 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_device 2024-09-12T00:38:13.035 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_backref 2024-09-12T00:38:13.035 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 alienstore 2024-09-12T00:38:13.035 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mclock 2024-09-12T00:38:13.035 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cyanstore 2024-09-12T00:38:13.035 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 ceph_exporter 2024-09-12T00:38:13.035 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 memstore 2024-09-12T00:38:13.035 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 trace 2024-09-12T00:38:13.035 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 ceph_dedup 2024-09-12T00:38:13.035 INFO:tasks.workunit.client.0.smithi043.stderr: -2/-2 (syslog threshold) 2024-09-12T00:38:13.035 INFO:tasks.workunit.client.0.smithi043.stderr: 99/99 (stderr threshold) 2024-09-12T00:38:13.036 INFO:tasks.workunit.client.0.smithi043.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:38:13.036 INFO:tasks.workunit.client.0.smithi043.stderr: 7f159e7fc640 / http_manager 2024-09-12T00:38:13.036 INFO:tasks.workunit.client.0.smithi043.stderr: 7f15a57e2640 / http_manager 2024-09-12T00:38:13.036 INFO:tasks.workunit.client.0.smithi043.stderr: 7f15a67e4640 / rgw_dt_lg_renew 2024-09-12T00:38:13.036 INFO:tasks.workunit.client.0.smithi043.stderr: 7f15d17fa640 / ms_dispatch 2024-09-12T00:38:13.036 INFO:tasks.workunit.client.0.smithi043.stderr: 7f15d27fc640 / io_context_pool 2024-09-12T00:38:13.036 INFO:tasks.workunit.client.0.smithi043.stderr: 7f15d2ffd640 / io_context_pool 2024-09-12T00:38:13.036 INFO:tasks.workunit.client.0.smithi043.stderr: 7f15d9602640 / ms_dispatch 2024-09-12T00:38:13.036 INFO:tasks.workunit.client.0.smithi043.stderr: 7f15dbe07640 / ms_dispatch 2024-09-12T00:38:13.036 INFO:tasks.workunit.client.0.smithi043.stderr: 7f15dd60a640 / io_context_pool 2024-09-12T00:38:13.036 INFO:tasks.workunit.client.0.smithi043.stderr: 7f16eef9c640 / msgr-worker-2 2024-09-12T00:38:13.036 INFO:tasks.workunit.client.0.smithi043.stderr: 7f16ef79d640 / msgr-worker-1 2024-09-12T00:38:13.036 INFO:tasks.workunit.client.0.smithi043.stderr: 7f16eff9e640 / msgr-worker-0 2024-09-12T00:38:13.037 INFO:tasks.workunit.client.0.smithi043.stderr: 7f16f079f640 / io_context_pool 2024-09-12T00:38:13.037 INFO:tasks.workunit.client.0.smithi043.stderr: 7f16f1c979c0 / radosgw-admin 2024-09-12T00:38:13.037 INFO:tasks.workunit.client.0.smithi043.stderr: max_recent 500 2024-09-12T00:38:13.037 INFO:tasks.workunit.client.0.smithi043.stderr: max_new 1000 2024-09-12T00:38:13.037 INFO:tasks.workunit.client.0.smithi043.stderr: log_file /var/log/ceph/ceph-client.admin.104438.log 2024-09-12T00:38:13.037 INFO:tasks.workunit.client.0.smithi043.stderr:--- end dump of recent events --- 2024-09-12T00:38:13.037 INFO:tasks.workunit.client.0.smithi043.stderr:--- begin dump of recent events --- 2024-09-12T00:38:13.037 INFO:tasks.workunit.client.0.smithi043.stderr: -499> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb792220) adding auth protocol: cephx 2024-09-12T00:38:13.037 INFO:tasks.workunit.client.0.smithi043.stderr: -498> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb792220) adding con mode: secure 2024-09-12T00:38:13.037 INFO:tasks.workunit.client.0.smithi043.stderr: -497> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb792220) adding con mode: crc 2024-09-12T00:38:13.037 INFO:tasks.workunit.client.0.smithi043.stderr: -496> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb792220) adding con mode: secure 2024-09-12T00:38:13.037 INFO:tasks.workunit.client.0.smithi043.stderr: -495> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb792220) adding con mode: crc 2024-09-12T00:38:13.037 INFO:tasks.workunit.client.0.smithi043.stderr: -494> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb792220) adding con mode: secure 2024-09-12T00:38:13.038 INFO:tasks.workunit.client.0.smithi043.stderr: -493> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb792220) adding con mode: crc 2024-09-12T00:38:13.038 INFO:tasks.workunit.client.0.smithi043.stderr: -492> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb792220) adding con mode: crc 2024-09-12T00:38:13.038 INFO:tasks.workunit.client.0.smithi043.stderr: -491> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb792220) adding con mode: secure 2024-09-12T00:38:13.038 INFO:tasks.workunit.client.0.smithi043.stderr: -490> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb792220) adding con mode: crc 2024-09-12T00:38:13.038 INFO:tasks.workunit.client.0.smithi043.stderr: -489> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb792220) adding con mode: secure 2024-09-12T00:38:13.038 INFO:tasks.workunit.client.0.smithi043.stderr: -488> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb792220) adding con mode: crc 2024-09-12T00:38:13.038 INFO:tasks.workunit.client.0.smithi043.stderr: -487> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb792220) adding con mode: secure 2024-09-12T00:38:13.038 INFO:tasks.workunit.client.0.smithi043.stderr: -486> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:13.038 INFO:tasks.workunit.client.0.smithi043.stderr: -485> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:13.038 INFO:tasks.workunit.client.0.smithi043.stderr: -484> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 5 asok(0x55b5cb5872b0) register_command rotate-key hook 0x55b5cb792368 2024-09-12T00:38:13.038 INFO:tasks.workunit.client.0.smithi043.stderr: -483> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:13.038 INFO:tasks.workunit.client.0.smithi043.stderr: -482> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:38:13.038 INFO:tasks.workunit.client.0.smithi043.stderr: -481> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 10 monclient(hunting): picked mon.noname-a con 0x55b5cb623900 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:38:13.039 INFO:tasks.workunit.client.0.smithi043.stderr: -480> 2024-09-12T00:38:12.589+0000 7f16f1c979c0 10 monclient(hunting): picked mon.noname-c con 0x55b5cb6daf60 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:38:13.039 INFO:tasks.workunit.client.0.smithi043.stderr: -479> 2024-09-12T00:38:12.593+0000 7f16f1c979c0 10 monclient(hunting): picked mon.noname-b con 0x55b5cb6db370 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:38:13.039 INFO:tasks.workunit.client.0.smithi043.stderr: -478> 2024-09-12T00:38:12.593+0000 7f16f1c979c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:13.039 INFO:tasks.workunit.client.0.smithi043.stderr: -477> 2024-09-12T00:38:12.593+0000 7f16f1c979c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:13.039 INFO:tasks.workunit.client.0.smithi043.stderr: -476> 2024-09-12T00:38:12.593+0000 7f16f1c979c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:13.039 INFO:tasks.workunit.client.0.smithi043.stderr: -475> 2024-09-12T00:38:12.593+0000 7f16f1c979c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:13.039 INFO:tasks.workunit.client.0.smithi043.stderr: -474> 2024-09-12T00:38:12.593+0000 7f16f1c979c0 10 monclient(hunting): authenticate will time out at 2188.584041s 2024-09-12T00:38:13.039 INFO:tasks.workunit.client.0.smithi043.stderr: -473> 2024-09-12T00:38:12.593+0000 7f16ef79d640 10 monclient(hunting): get_auth_request con 0x55b5cb623900 auth_method 0 2024-09-12T00:38:13.039 INFO:tasks.workunit.client.0.smithi043.stderr: -472> 2024-09-12T00:38:12.593+0000 7f16ef79d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:13.039 INFO:tasks.workunit.client.0.smithi043.stderr: -471> 2024-09-12T00:38:12.593+0000 7f16ef79d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:13.039 INFO:tasks.workunit.client.0.smithi043.stderr: -470> 2024-09-12T00:38:12.593+0000 7f16ef79d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:13.039 INFO:tasks.workunit.client.0.smithi043.stderr: -469> 2024-09-12T00:38:12.593+0000 7f16eef9c640 10 monclient(hunting): get_auth_request con 0x55b5cb6daf60 auth_method 0 2024-09-12T00:38:13.040 INFO:tasks.workunit.client.0.smithi043.stderr: -468> 2024-09-12T00:38:12.593+0000 7f16eef9c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:13.040 INFO:tasks.workunit.client.0.smithi043.stderr: -467> 2024-09-12T00:38:12.593+0000 7f16eef9c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:13.040 INFO:tasks.workunit.client.0.smithi043.stderr: -466> 2024-09-12T00:38:12.593+0000 7f16eef9c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:13.040 INFO:tasks.workunit.client.0.smithi043.stderr: -465> 2024-09-12T00:38:12.593+0000 7f16ef79d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:13.040 INFO:tasks.workunit.client.0.smithi043.stderr: -464> 2024-09-12T00:38:12.593+0000 7f16ef79d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:13.040 INFO:tasks.workunit.client.0.smithi043.stderr: -463> 2024-09-12T00:38:12.593+0000 7f16ef79d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:13.040 INFO:tasks.workunit.client.0.smithi043.stderr: -462> 2024-09-12T00:38:12.593+0000 7f16eef9c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:13.040 INFO:tasks.workunit.client.0.smithi043.stderr: -461> 2024-09-12T00:38:12.593+0000 7f16eef9c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:13.040 INFO:tasks.workunit.client.0.smithi043.stderr: -460> 2024-09-12T00:38:12.593+0000 7f16eef9c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:13.040 INFO:tasks.workunit.client.0.smithi043.stderr: -459> 2024-09-12T00:38:12.593+0000 7f16ef79d640 10 monclient(hunting): handle_auth_done global_id 7011 payload 824 2024-09-12T00:38:13.040 INFO:tasks.workunit.client.0.smithi043.stderr: -458> 2024-09-12T00:38:12.593+0000 7f16ef79d640 10 monclient: _finish_hunting 0 2024-09-12T00:38:13.040 INFO:tasks.workunit.client.0.smithi043.stderr: -457> 2024-09-12T00:38:12.593+0000 7f16ef79d640 1 monclient: found mon.noname-a 2024-09-12T00:38:13.041 INFO:tasks.workunit.client.0.smithi043.stderr: -456> 2024-09-12T00:38:12.593+0000 7f16ef79d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:38:13.041 INFO:tasks.workunit.client.0.smithi043.stderr: -455> 2024-09-12T00:38:12.593+0000 7f15dbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:13.041 INFO:tasks.workunit.client.0.smithi043.stderr: -454> 2024-09-12T00:38:12.593+0000 7f15dbe07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:38:13.041 INFO:tasks.workunit.client.0.smithi043.stderr: -453> 2024-09-12T00:38:12.593+0000 7f15dbe07640 10 monclient: dump: 2024-09-12T00:38:13.041 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:13.041 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:13.041 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:13.041 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:13.041 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:13.041 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:13.041 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:13.041 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:13.041 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:13.042 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:13.042 INFO:tasks.workunit.client.0.smithi043.stderr: -452> 2024-09-12T00:38:12.593+0000 7f15dbe07640 10 monclient: _finish_auth 0 2024-09-12T00:38:13.042 INFO:tasks.workunit.client.0.smithi043.stderr: -451> 2024-09-12T00:38:12.593+0000 7f15dbe07640 10 monclient: _check_auth_tickets 2024-09-12T00:38:13.042 INFO:tasks.workunit.client.0.smithi043.stderr: -450> 2024-09-12T00:38:12.593+0000 7f15dbe07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:13.042 INFO:tasks.workunit.client.0.smithi043.stderr: -449> 2024-09-12T00:38:12.593+0000 7f15dbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:13.042 INFO:tasks.workunit.client.0.smithi043.stderr: -448> 2024-09-12T00:38:12.593+0000 7f15dbe07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:13.042 INFO:tasks.workunit.client.0.smithi043.stderr: -447> 2024-09-12T00:38:12.593+0000 7f15dbe07640 10 monclient: dump: 2024-09-12T00:38:13.042 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:13.042 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:13.042 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:13.042 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:13.043 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:13.043 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:13.043 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:13.043 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:13.043 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:13.043 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:13.043 INFO:tasks.workunit.client.0.smithi043.stderr: -446> 2024-09-12T00:38:12.593+0000 7f16f1c979c0 5 monclient: authenticate success, global_id 7011 2024-09-12T00:38:13.043 INFO:tasks.workunit.client.0.smithi043.stderr: -445> 2024-09-12T00:38:12.593+0000 7f15dd60a640 4 set_mon_vals no callback set 2024-09-12T00:38:13.043 INFO:tasks.workunit.client.0.smithi043.stderr: -444> 2024-09-12T00:38:12.593+0000 7f16f1c979c0 10 monclient: _renew_subs 2024-09-12T00:38:13.043 INFO:tasks.workunit.client.0.smithi043.stderr: -443> 2024-09-12T00:38:12.593+0000 7f16f1c979c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:38:13.043 INFO:tasks.workunit.client.0.smithi043.stderr: -442> 2024-09-12T00:38:12.593+0000 7f16f1c979c0 10 monclient: _renew_subs 2024-09-12T00:38:13.043 INFO:tasks.workunit.client.0.smithi043.stderr: -441> 2024-09-12T00:38:12.593+0000 7f16f1c979c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:38:13.043 INFO:tasks.workunit.client.0.smithi043.stderr: -440> 2024-09-12T00:38:12.593+0000 7f16f1c979c0 1 librados: init done 2024-09-12T00:38:13.044 INFO:tasks.workunit.client.0.smithi043.stderr: -439> 2024-09-12T00:38:12.593+0000 7f15dbe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:38:13.044 INFO:tasks.workunit.client.0.smithi043.stderr: -438> 2024-09-12T00:38:12.593+0000 7f15dbe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:38:13.044 INFO:tasks.workunit.client.0.smithi043.stderr: -437> 2024-09-12T00:38:12.593+0000 7f15dbe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:38:13.044 INFO:tasks.workunit.client.0.smithi043.stderr: -436> 2024-09-12T00:38:12.593+0000 7f16eef9c640 10 monclient: get_auth_request con 0x7f15d4070ae0 auth_method 0 2024-09-12T00:38:13.044 INFO:tasks.workunit.client.0.smithi043.stderr: -435> 2024-09-12T00:38:12.593+0000 7f16eff9e640 10 monclient: get_auth_request con 0x55b5cb7bea00 auth_method 0 2024-09-12T00:38:13.044 INFO:tasks.workunit.client.0.smithi043.stderr: -434> 2024-09-12T00:38:12.597+0000 7f16ef79d640 10 monclient: get_auth_request con 0x55b5cb7dca70 auth_method 0 2024-09-12T00:38:13.044 INFO:tasks.workunit.client.0.smithi043.stderr: -433> 2024-09-12T00:38:12.597+0000 7f16eef9c640 10 monclient: get_auth_request con 0x55b5cb7e0dd0 auth_method 0 2024-09-12T00:38:13.044 INFO:tasks.workunit.client.0.smithi043.stderr: -432> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 10 monclient: build_initial_monmap 2024-09-12T00:38:13.044 INFO:tasks.workunit.client.0.smithi043.stderr: -431> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 1 build_initial for_mkfs: 0 2024-09-12T00:38:13.044 INFO:tasks.workunit.client.0.smithi043.stderr: -430> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 10 monclient: monmap: 2024-09-12T00:38:13.044 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:38:13.044 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:13.044 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:38:13.045 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:38:13.045 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:13.045 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:13.045 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:38:13.045 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:38:13.045 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:38:13.045 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:13.045 INFO:tasks.workunit.client.0.smithi043.stderr: -429> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e5c30) adding auth protocol: cephx 2024-09-12T00:38:13.045 INFO:tasks.workunit.client.0.smithi043.stderr: -428> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e5c30) adding auth protocol: cephx 2024-09-12T00:38:13.045 INFO:tasks.workunit.client.0.smithi043.stderr: -427> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e5c30) adding auth protocol: cephx 2024-09-12T00:38:13.045 INFO:tasks.workunit.client.0.smithi043.stderr: -426> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e5c30) adding con mode: secure 2024-09-12T00:38:13.046 INFO:tasks.workunit.client.0.smithi043.stderr: -425> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e5c30) adding con mode: crc 2024-09-12T00:38:13.046 INFO:tasks.workunit.client.0.smithi043.stderr: -424> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e5c30) adding con mode: secure 2024-09-12T00:38:13.046 INFO:tasks.workunit.client.0.smithi043.stderr: -423> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e5c30) adding con mode: crc 2024-09-12T00:38:13.046 INFO:tasks.workunit.client.0.smithi043.stderr: -422> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e5c30) adding con mode: secure 2024-09-12T00:38:13.046 INFO:tasks.workunit.client.0.smithi043.stderr: -421> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e5c30) adding con mode: crc 2024-09-12T00:38:13.046 INFO:tasks.workunit.client.0.smithi043.stderr: -420> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e5c30) adding con mode: crc 2024-09-12T00:38:13.046 INFO:tasks.workunit.client.0.smithi043.stderr: -419> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e5c30) adding con mode: secure 2024-09-12T00:38:13.046 INFO:tasks.workunit.client.0.smithi043.stderr: -418> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e5c30) adding con mode: crc 2024-09-12T00:38:13.046 INFO:tasks.workunit.client.0.smithi043.stderr: -417> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e5c30) adding con mode: secure 2024-09-12T00:38:13.046 INFO:tasks.workunit.client.0.smithi043.stderr: -416> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e5c30) adding con mode: crc 2024-09-12T00:38:13.046 INFO:tasks.workunit.client.0.smithi043.stderr: -415> 2024-09-12T00:38:12.597+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e5c30) adding con mode: secure 2024-09-12T00:38:13.046 INFO:tasks.workunit.client.0.smithi043.stderr: -414> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:13.047 INFO:tasks.workunit.client.0.smithi043.stderr: -413> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 asok(0x55b5cb5872b0) register_command objecter_requests cmddesc objecter_requests hook 0x55b5cb7e9660 EEXIST 2024-09-12T00:38:13.047 INFO:tasks.workunit.client.0.smithi043.stderr: -412> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 10 monclient: init 2024-09-12T00:38:13.047 INFO:tasks.workunit.client.0.smithi043.stderr: -411> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e42b8) adding auth protocol: cephx 2024-09-12T00:38:13.047 INFO:tasks.workunit.client.0.smithi043.stderr: -410> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e42b8) adding auth protocol: cephx 2024-09-12T00:38:13.047 INFO:tasks.workunit.client.0.smithi043.stderr: -409> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e42b8) adding auth protocol: cephx 2024-09-12T00:38:13.047 INFO:tasks.workunit.client.0.smithi043.stderr: -408> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e42b8) adding con mode: secure 2024-09-12T00:38:13.047 INFO:tasks.workunit.client.0.smithi043.stderr: -407> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e42b8) adding con mode: crc 2024-09-12T00:38:13.047 INFO:tasks.workunit.client.0.smithi043.stderr: -406> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e42b8) adding con mode: secure 2024-09-12T00:38:13.047 INFO:tasks.workunit.client.0.smithi043.stderr: -405> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e42b8) adding con mode: crc 2024-09-12T00:38:13.047 INFO:tasks.workunit.client.0.smithi043.stderr: -404> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e42b8) adding con mode: secure 2024-09-12T00:38:13.047 INFO:tasks.workunit.client.0.smithi043.stderr: -403> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e42b8) adding con mode: crc 2024-09-12T00:38:13.047 INFO:tasks.workunit.client.0.smithi043.stderr: -402> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e42b8) adding con mode: crc 2024-09-12T00:38:13.048 INFO:tasks.workunit.client.0.smithi043.stderr: -401> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e42b8) adding con mode: secure 2024-09-12T00:38:13.048 INFO:tasks.workunit.client.0.smithi043.stderr: -400> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e42b8) adding con mode: crc 2024-09-12T00:38:13.048 INFO:tasks.workunit.client.0.smithi043.stderr: -399> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e42b8) adding con mode: secure 2024-09-12T00:38:13.048 INFO:tasks.workunit.client.0.smithi043.stderr: -398> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e42b8) adding con mode: crc 2024-09-12T00:38:13.048 INFO:tasks.workunit.client.0.smithi043.stderr: -397> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb7e42b8) adding con mode: secure 2024-09-12T00:38:13.048 INFO:tasks.workunit.client.0.smithi043.stderr: -396> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:13.048 INFO:tasks.workunit.client.0.smithi043.stderr: -395> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:13.048 INFO:tasks.workunit.client.0.smithi043.stderr: -394> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 asok(0x55b5cb5872b0) register_command rotate-key cmddesc rotate-key hook 0x55b5cb7e4400 EEXIST 2024-09-12T00:38:13.048 INFO:tasks.workunit.client.0.smithi043.stderr: -393> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:13.048 INFO:tasks.workunit.client.0.smithi043.stderr: -392> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:38:13.048 INFO:tasks.workunit.client.0.smithi043.stderr: -391> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 10 monclient(hunting): picked mon.noname-a con 0x55b5cb80d810 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:38:13.048 INFO:tasks.workunit.client.0.smithi043.stderr: -390> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 10 monclient(hunting): picked mon.noname-b con 0x55b5cb80d140 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:38:13.049 INFO:tasks.workunit.client.0.smithi043.stderr: -389> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 10 monclient(hunting): picked mon.noname-c con 0x55b5cb80bb20 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:38:13.049 INFO:tasks.workunit.client.0.smithi043.stderr: -388> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:13.049 INFO:tasks.workunit.client.0.smithi043.stderr: -387> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:13.049 INFO:tasks.workunit.client.0.smithi043.stderr: -386> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:13.049 INFO:tasks.workunit.client.0.smithi043.stderr: -385> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:13.049 INFO:tasks.workunit.client.0.smithi043.stderr: -384> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 10 monclient(hunting): authenticate will time out at 2188.593059s 2024-09-12T00:38:13.049 INFO:tasks.workunit.client.0.smithi043.stderr: -383> 2024-09-12T00:38:12.601+0000 7f16ef79d640 10 monclient(hunting): get_auth_request con 0x55b5cb80d810 auth_method 0 2024-09-12T00:38:13.049 INFO:tasks.workunit.client.0.smithi043.stderr: -382> 2024-09-12T00:38:12.601+0000 7f16ef79d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:13.049 INFO:tasks.workunit.client.0.smithi043.stderr: -381> 2024-09-12T00:38:12.601+0000 7f16ef79d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:13.049 INFO:tasks.workunit.client.0.smithi043.stderr: -380> 2024-09-12T00:38:12.601+0000 7f16ef79d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:13.049 INFO:tasks.workunit.client.0.smithi043.stderr: -379> 2024-09-12T00:38:12.601+0000 7f16eff9e640 10 monclient(hunting): get_auth_request con 0x55b5cb80bb20 auth_method 0 2024-09-12T00:38:13.049 INFO:tasks.workunit.client.0.smithi043.stderr: -378> 2024-09-12T00:38:12.601+0000 7f16eff9e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:13.049 INFO:tasks.workunit.client.0.smithi043.stderr: -377> 2024-09-12T00:38:12.601+0000 7f16eff9e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:13.050 INFO:tasks.workunit.client.0.smithi043.stderr: -376> 2024-09-12T00:38:12.601+0000 7f16eff9e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:13.050 INFO:tasks.workunit.client.0.smithi043.stderr: -375> 2024-09-12T00:38:12.601+0000 7f16ef79d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:13.050 INFO:tasks.workunit.client.0.smithi043.stderr: -374> 2024-09-12T00:38:12.601+0000 7f16ef79d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:13.050 INFO:tasks.workunit.client.0.smithi043.stderr: -373> 2024-09-12T00:38:12.601+0000 7f16ef79d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:13.050 INFO:tasks.workunit.client.0.smithi043.stderr: -372> 2024-09-12T00:38:12.601+0000 7f16eff9e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:13.050 INFO:tasks.workunit.client.0.smithi043.stderr: -371> 2024-09-12T00:38:12.601+0000 7f16eff9e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:13.050 INFO:tasks.workunit.client.0.smithi043.stderr: -370> 2024-09-12T00:38:12.601+0000 7f16eff9e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:13.050 INFO:tasks.workunit.client.0.smithi043.stderr: -369> 2024-09-12T00:38:12.601+0000 7f16ef79d640 10 monclient(hunting): handle_auth_done global_id 7014 payload 824 2024-09-12T00:38:13.050 INFO:tasks.workunit.client.0.smithi043.stderr: -368> 2024-09-12T00:38:12.601+0000 7f16ef79d640 10 monclient: _finish_hunting 0 2024-09-12T00:38:13.050 INFO:tasks.workunit.client.0.smithi043.stderr: -367> 2024-09-12T00:38:12.601+0000 7f16ef79d640 1 monclient: found mon.noname-a 2024-09-12T00:38:13.050 INFO:tasks.workunit.client.0.smithi043.stderr: -366> 2024-09-12T00:38:12.601+0000 7f16ef79d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:38:13.050 INFO:tasks.workunit.client.0.smithi043.stderr: -365> 2024-09-12T00:38:12.601+0000 7f15d9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:13.050 INFO:tasks.workunit.client.0.smithi043.stderr: -364> 2024-09-12T00:38:12.601+0000 7f15d9602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:38:13.051 INFO:tasks.workunit.client.0.smithi043.stderr: -363> 2024-09-12T00:38:12.601+0000 7f15d9602640 10 monclient: dump: 2024-09-12T00:38:13.051 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:13.051 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:13.051 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:13.051 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:13.051 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:13.051 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:13.051 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:13.051 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:13.051 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:13.051 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:13.051 INFO:tasks.workunit.client.0.smithi043.stderr: -362> 2024-09-12T00:38:12.601+0000 7f15d9602640 10 monclient: _finish_auth 0 2024-09-12T00:38:13.051 INFO:tasks.workunit.client.0.smithi043.stderr: -361> 2024-09-12T00:38:12.601+0000 7f15d9602640 10 monclient: _check_auth_tickets 2024-09-12T00:38:13.052 INFO:tasks.workunit.client.0.smithi043.stderr: -360> 2024-09-12T00:38:12.601+0000 7f15d9602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:13.052 INFO:tasks.workunit.client.0.smithi043.stderr: -359> 2024-09-12T00:38:12.601+0000 7f15d9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:13.052 INFO:tasks.workunit.client.0.smithi043.stderr: -358> 2024-09-12T00:38:12.601+0000 7f15d9602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:13.052 INFO:tasks.workunit.client.0.smithi043.stderr: -357> 2024-09-12T00:38:12.601+0000 7f15d9602640 10 monclient: dump: 2024-09-12T00:38:13.052 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:13.052 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:13.052 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:13.052 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:13.052 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:13.052 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:13.052 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:13.052 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:13.052 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:13.053 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:13.053 INFO:tasks.workunit.client.0.smithi043.stderr: -356> 2024-09-12T00:38:12.601+0000 7f16f079f640 4 set_mon_vals no callback set 2024-09-12T00:38:13.053 INFO:tasks.workunit.client.0.smithi043.stderr: -355> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 5 monclient: authenticate success, global_id 7014 2024-09-12T00:38:13.053 INFO:tasks.workunit.client.0.smithi043.stderr: -354> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 10 monclient: _renew_subs 2024-09-12T00:38:13.053 INFO:tasks.workunit.client.0.smithi043.stderr: -353> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:38:13.053 INFO:tasks.workunit.client.0.smithi043.stderr: -352> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 10 monclient: _renew_subs 2024-09-12T00:38:13.056 INFO:tasks.workunit.client.0.smithi043.stderr: -351> 2024-09-12T00:38:12.601+0000 7f16f1c979c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:38:13.056 INFO:tasks.workunit.client.0.smithi043.stderr: -350> 2024-09-12T00:38:12.605+0000 7f15d9602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:38:13.056 INFO:tasks.workunit.client.0.smithi043.stderr: -349> 2024-09-12T00:38:12.605+0000 7f15d9602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:38:13.057 INFO:tasks.workunit.client.0.smithi043.stderr: -348> 2024-09-12T00:38:12.605+0000 7f15d9602640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:38:13.057 INFO:tasks.workunit.client.0.smithi043.stderr: -347> 2024-09-12T00:38:12.605+0000 7f16eef9c640 10 monclient: get_auth_request con 0x7f15c8070a20 auth_method 0 2024-09-12T00:38:13.057 INFO:tasks.workunit.client.0.smithi043.stderr: -346> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient: get_monmap_and_config 2024-09-12T00:38:13.057 INFO:tasks.workunit.client.0.smithi043.stderr: -345> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient: build_initial_monmap 2024-09-12T00:38:13.057 INFO:tasks.workunit.client.0.smithi043.stderr: -344> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 1 build_initial for_mkfs: 0 2024-09-12T00:38:13.057 INFO:tasks.workunit.client.0.smithi043.stderr: -343> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient: monmap: 2024-09-12T00:38:13.057 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:38:13.057 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:13.057 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:38:13.057 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:38:13.057 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:13.057 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:13.058 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:38:13.058 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:38:13.058 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:38:13.058 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:13.058 INFO:tasks.workunit.client.0.smithi043.stderr: -342> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82cd90) adding auth protocol: cephx 2024-09-12T00:38:13.058 INFO:tasks.workunit.client.0.smithi043.stderr: -341> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82cd90) adding auth protocol: cephx 2024-09-12T00:38:13.058 INFO:tasks.workunit.client.0.smithi043.stderr: -340> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82cd90) adding auth protocol: cephx 2024-09-12T00:38:13.058 INFO:tasks.workunit.client.0.smithi043.stderr: -339> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82cd90) adding con mode: secure 2024-09-12T00:38:13.058 INFO:tasks.workunit.client.0.smithi043.stderr: -338> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82cd90) adding con mode: crc 2024-09-12T00:38:13.058 INFO:tasks.workunit.client.0.smithi043.stderr: -337> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82cd90) adding con mode: secure 2024-09-12T00:38:13.058 INFO:tasks.workunit.client.0.smithi043.stderr: -336> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82cd90) adding con mode: crc 2024-09-12T00:38:13.058 INFO:tasks.workunit.client.0.smithi043.stderr: -335> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82cd90) adding con mode: secure 2024-09-12T00:38:13.059 INFO:tasks.workunit.client.0.smithi043.stderr: -334> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82cd90) adding con mode: crc 2024-09-12T00:38:13.059 INFO:tasks.workunit.client.0.smithi043.stderr: -333> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82cd90) adding con mode: crc 2024-09-12T00:38:13.059 INFO:tasks.workunit.client.0.smithi043.stderr: -332> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82cd90) adding con mode: secure 2024-09-12T00:38:13.059 INFO:tasks.workunit.client.0.smithi043.stderr: -331> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82cd90) adding con mode: crc 2024-09-12T00:38:13.059 INFO:tasks.workunit.client.0.smithi043.stderr: -330> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82cd90) adding con mode: secure 2024-09-12T00:38:13.059 INFO:tasks.workunit.client.0.smithi043.stderr: -329> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82cd90) adding con mode: crc 2024-09-12T00:38:13.059 INFO:tasks.workunit.client.0.smithi043.stderr: -328> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82cd90) adding con mode: secure 2024-09-12T00:38:13.059 INFO:tasks.workunit.client.0.smithi043.stderr: -327> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:13.059 INFO:tasks.workunit.client.0.smithi043.stderr: -326> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient: init 2024-09-12T00:38:13.059 INFO:tasks.workunit.client.0.smithi043.stderr: -325> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaa10) adding auth protocol: cephx 2024-09-12T00:38:13.059 INFO:tasks.workunit.client.0.smithi043.stderr: -324> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaa10) adding auth protocol: cephx 2024-09-12T00:38:13.059 INFO:tasks.workunit.client.0.smithi043.stderr: -323> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaa10) adding auth protocol: cephx 2024-09-12T00:38:13.059 INFO:tasks.workunit.client.0.smithi043.stderr: -322> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaa10) adding con mode: secure 2024-09-12T00:38:13.059 INFO:tasks.workunit.client.0.smithi043.stderr: -321> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaa10) adding con mode: crc 2024-09-12T00:38:13.060 INFO:tasks.workunit.client.0.smithi043.stderr: -320> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaa10) adding con mode: secure 2024-09-12T00:38:13.060 INFO:tasks.workunit.client.0.smithi043.stderr: -319> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaa10) adding con mode: crc 2024-09-12T00:38:13.060 INFO:tasks.workunit.client.0.smithi043.stderr: -318> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaa10) adding con mode: secure 2024-09-12T00:38:13.060 INFO:tasks.workunit.client.0.smithi043.stderr: -317> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaa10) adding con mode: crc 2024-09-12T00:38:13.060 INFO:tasks.workunit.client.0.smithi043.stderr: -316> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaa10) adding con mode: crc 2024-09-12T00:38:13.060 INFO:tasks.workunit.client.0.smithi043.stderr: -315> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaa10) adding con mode: secure 2024-09-12T00:38:13.060 INFO:tasks.workunit.client.0.smithi043.stderr: -314> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaa10) adding con mode: crc 2024-09-12T00:38:13.060 INFO:tasks.workunit.client.0.smithi043.stderr: -313> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaa10) adding con mode: secure 2024-09-12T00:38:13.060 INFO:tasks.workunit.client.0.smithi043.stderr: -312> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaa10) adding con mode: crc 2024-09-12T00:38:13.060 INFO:tasks.workunit.client.0.smithi043.stderr: -311> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaa10) adding con mode: secure 2024-09-12T00:38:13.060 INFO:tasks.workunit.client.0.smithi043.stderr: -310> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:13.061 INFO:tasks.workunit.client.0.smithi043.stderr: -309> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:13.061 INFO:tasks.workunit.client.0.smithi043.stderr: -308> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 asok(0x55b5cb5872b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe89beab58 EEXIST 2024-09-12T00:38:13.061 INFO:tasks.workunit.client.0.smithi043.stderr: -307> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:13.061 INFO:tasks.workunit.client.0.smithi043.stderr: -306> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:38:13.061 INFO:tasks.workunit.client.0.smithi043.stderr: -305> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient(hunting): picked mon.noname-b con 0x55b5cb861290 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:38:13.061 INFO:tasks.workunit.client.0.smithi043.stderr: -304> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient(hunting): picked mon.noname-a con 0x55b5cb85b4d0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:38:13.061 INFO:tasks.workunit.client.0.smithi043.stderr: -303> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient(hunting): picked mon.noname-c con 0x55b5cb85c6d0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:38:13.061 INFO:tasks.workunit.client.0.smithi043.stderr: -302> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:13.061 INFO:tasks.workunit.client.0.smithi043.stderr: -301> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:13.061 INFO:tasks.workunit.client.0.smithi043.stderr: -300> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:13.061 INFO:tasks.workunit.client.0.smithi043.stderr: -299> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:13.061 INFO:tasks.workunit.client.0.smithi043.stderr: -298> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient(hunting): authenticate will time out at 2188.597747s 2024-09-12T00:38:13.061 INFO:tasks.workunit.client.0.smithi043.stderr: -297> 2024-09-12T00:38:12.605+0000 7f16eef9c640 10 monclient(hunting): get_auth_request con 0x55b5cb85b4d0 auth_method 0 2024-09-12T00:38:13.062 INFO:tasks.workunit.client.0.smithi043.stderr: -296> 2024-09-12T00:38:12.605+0000 7f16eef9c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:13.062 INFO:tasks.workunit.client.0.smithi043.stderr: -295> 2024-09-12T00:38:12.605+0000 7f16eef9c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:13.062 INFO:tasks.workunit.client.0.smithi043.stderr: -294> 2024-09-12T00:38:12.605+0000 7f16eef9c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:13.062 INFO:tasks.workunit.client.0.smithi043.stderr: -293> 2024-09-12T00:38:12.605+0000 7f16eff9e640 10 monclient(hunting): get_auth_request con 0x55b5cb85c6d0 auth_method 0 2024-09-12T00:38:13.062 INFO:tasks.workunit.client.0.smithi043.stderr: -292> 2024-09-12T00:38:12.605+0000 7f16eff9e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:13.062 INFO:tasks.workunit.client.0.smithi043.stderr: -291> 2024-09-12T00:38:12.605+0000 7f16eff9e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:13.062 INFO:tasks.workunit.client.0.smithi043.stderr: -290> 2024-09-12T00:38:12.605+0000 7f16eff9e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:13.062 INFO:tasks.workunit.client.0.smithi043.stderr: -289> 2024-09-12T00:38:12.605+0000 7f16eef9c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:13.062 INFO:tasks.workunit.client.0.smithi043.stderr: -288> 2024-09-12T00:38:12.605+0000 7f16eef9c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:13.062 INFO:tasks.workunit.client.0.smithi043.stderr: -287> 2024-09-12T00:38:12.605+0000 7f16eef9c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:13.062 INFO:tasks.workunit.client.0.smithi043.stderr: -286> 2024-09-12T00:38:12.605+0000 7f16eff9e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:13.062 INFO:tasks.workunit.client.0.smithi043.stderr: -285> 2024-09-12T00:38:12.605+0000 7f16eff9e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:13.063 INFO:tasks.workunit.client.0.smithi043.stderr: -284> 2024-09-12T00:38:12.605+0000 7f16eff9e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:13.063 INFO:tasks.workunit.client.0.smithi043.stderr: -283> 2024-09-12T00:38:12.605+0000 7f16ef79d640 10 monclient(hunting): get_auth_request con 0x55b5cb861290 auth_method 0 2024-09-12T00:38:13.063 INFO:tasks.workunit.client.0.smithi043.stderr: -282> 2024-09-12T00:38:12.605+0000 7f16ef79d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:13.063 INFO:tasks.workunit.client.0.smithi043.stderr: -281> 2024-09-12T00:38:12.605+0000 7f16ef79d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:13.063 INFO:tasks.workunit.client.0.smithi043.stderr: -280> 2024-09-12T00:38:12.605+0000 7f16ef79d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:13.063 INFO:tasks.workunit.client.0.smithi043.stderr: -279> 2024-09-12T00:38:12.605+0000 7f16eef9c640 10 monclient(hunting): handle_auth_done global_id 7017 payload 274 2024-09-12T00:38:13.063 INFO:tasks.workunit.client.0.smithi043.stderr: -278> 2024-09-12T00:38:12.605+0000 7f16eef9c640 10 monclient: _finish_hunting 0 2024-09-12T00:38:13.063 INFO:tasks.workunit.client.0.smithi043.stderr: -277> 2024-09-12T00:38:12.605+0000 7f16eef9c640 1 monclient: found mon.noname-a 2024-09-12T00:38:13.063 INFO:tasks.workunit.client.0.smithi043.stderr: -276> 2024-09-12T00:38:12.605+0000 7f16eef9c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:38:13.063 INFO:tasks.workunit.client.0.smithi043.stderr: -275> 2024-09-12T00:38:12.605+0000 7f15d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:13.063 INFO:tasks.workunit.client.0.smithi043.stderr: -274> 2024-09-12T00:38:12.605+0000 7f15d2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:38:13.063 INFO:tasks.workunit.client.0.smithi043.stderr: -273> 2024-09-12T00:38:12.605+0000 7f15d2ffd640 10 monclient: dump: 2024-09-12T00:38:13.063 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:13.063 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:13.064 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:13.064 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:13.064 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:13.064 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:13.064 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:13.064 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:13.064 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:13.064 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:13.064 INFO:tasks.workunit.client.0.smithi043.stderr: -272> 2024-09-12T00:38:12.605+0000 7f15d2ffd640 10 monclient: _finish_auth 0 2024-09-12T00:38:13.064 INFO:tasks.workunit.client.0.smithi043.stderr: -271> 2024-09-12T00:38:12.605+0000 7f15d2ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:38:13.064 INFO:tasks.workunit.client.0.smithi043.stderr: -270> 2024-09-12T00:38:12.605+0000 7f15d2ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:13.064 INFO:tasks.workunit.client.0.smithi043.stderr: -269> 2024-09-12T00:38:12.605+0000 7f15d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:13.064 INFO:tasks.workunit.client.0.smithi043.stderr: -268> 2024-09-12T00:38:12.605+0000 7f15d2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:13.065 INFO:tasks.workunit.client.0.smithi043.stderr: -267> 2024-09-12T00:38:12.605+0000 7f15d2ffd640 10 monclient: dump: 2024-09-12T00:38:13.065 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:13.065 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:13.065 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:13.065 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:13.065 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:13.065 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:13.065 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:13.065 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:13.065 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:13.065 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:13.065 INFO:tasks.workunit.client.0.smithi043.stderr: -266> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 monclient: authenticate success, global_id 7017 2024-09-12T00:38:13.066 INFO:tasks.workunit.client.0.smithi043.stderr: -265> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient: get_monmap_and_config success 2024-09-12T00:38:13.066 INFO:tasks.workunit.client.0.smithi043.stderr: -264> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 4 set_mon_vals no callback set 2024-09-12T00:38:13.066 INFO:tasks.workunit.client.0.smithi043.stderr: -263> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient: shutdown 2024-09-12T00:38:13.066 INFO:tasks.workunit.client.0.smithi043.stderr: -262> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient: build_initial_monmap 2024-09-12T00:38:13.066 INFO:tasks.workunit.client.0.smithi043.stderr: -261> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 1 build_initial for_mkfs: 0 2024-09-12T00:38:13.066 INFO:tasks.workunit.client.0.smithi043.stderr: -260> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient: monmap: 2024-09-12T00:38:13.066 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:38:13.066 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:13.066 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:38:13.066 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:38:13.066 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:13.066 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:13.066 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:38:13.067 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:38:13.067 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:38:13.067 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:13.067 INFO:tasks.workunit.client.0.smithi043.stderr: -259> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82ea20) adding auth protocol: cephx 2024-09-12T00:38:13.067 INFO:tasks.workunit.client.0.smithi043.stderr: -258> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82ea20) adding auth protocol: cephx 2024-09-12T00:38:13.067 INFO:tasks.workunit.client.0.smithi043.stderr: -257> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82ea20) adding auth protocol: cephx 2024-09-12T00:38:13.067 INFO:tasks.workunit.client.0.smithi043.stderr: -256> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82ea20) adding con mode: secure 2024-09-12T00:38:13.067 INFO:tasks.workunit.client.0.smithi043.stderr: -255> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82ea20) adding con mode: crc 2024-09-12T00:38:13.067 INFO:tasks.workunit.client.0.smithi043.stderr: -254> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82ea20) adding con mode: secure 2024-09-12T00:38:13.067 INFO:tasks.workunit.client.0.smithi043.stderr: -253> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82ea20) adding con mode: crc 2024-09-12T00:38:13.067 INFO:tasks.workunit.client.0.smithi043.stderr: -252> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82ea20) adding con mode: secure 2024-09-12T00:38:13.067 INFO:tasks.workunit.client.0.smithi043.stderr: -251> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82ea20) adding con mode: crc 2024-09-12T00:38:13.067 INFO:tasks.workunit.client.0.smithi043.stderr: -250> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82ea20) adding con mode: crc 2024-09-12T00:38:13.068 INFO:tasks.workunit.client.0.smithi043.stderr: -249> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82ea20) adding con mode: secure 2024-09-12T00:38:13.068 INFO:tasks.workunit.client.0.smithi043.stderr: -248> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82ea20) adding con mode: crc 2024-09-12T00:38:13.068 INFO:tasks.workunit.client.0.smithi043.stderr: -247> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82ea20) adding con mode: secure 2024-09-12T00:38:13.068 INFO:tasks.workunit.client.0.smithi043.stderr: -246> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82ea20) adding con mode: crc 2024-09-12T00:38:13.068 INFO:tasks.workunit.client.0.smithi043.stderr: -245> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb82ea20) adding con mode: secure 2024-09-12T00:38:13.068 INFO:tasks.workunit.client.0.smithi043.stderr: -244> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:13.068 INFO:tasks.workunit.client.0.smithi043.stderr: -243> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 1 librados: starting msgr at 2024-09-12T00:38:13.068 INFO:tasks.workunit.client.0.smithi043.stderr: -242> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 1 librados: starting objecter 2024-09-12T00:38:13.068 INFO:tasks.workunit.client.0.smithi043.stderr: -241> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 asok(0x55b5cb5872b0) register_command objecter_requests cmddesc objecter_requests hook 0x55b5cb810640 EEXIST 2024-09-12T00:38:13.068 INFO:tasks.workunit.client.0.smithi043.stderr: -240> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 1 librados: setting wanted keys 2024-09-12T00:38:13.068 INFO:tasks.workunit.client.0.smithi043.stderr: -239> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 1 librados: calling monclient init 2024-09-12T00:38:13.068 INFO:tasks.workunit.client.0.smithi043.stderr: -238> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 10 monclient: init 2024-09-12T00:38:13.068 INFO:tasks.workunit.client.0.smithi043.stderr: -237> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb80f630) adding auth protocol: cephx 2024-09-12T00:38:13.069 INFO:tasks.workunit.client.0.smithi043.stderr: -236> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb80f630) adding auth protocol: cephx 2024-09-12T00:38:13.069 INFO:tasks.workunit.client.0.smithi043.stderr: -235> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb80f630) adding auth protocol: cephx 2024-09-12T00:38:13.069 INFO:tasks.workunit.client.0.smithi043.stderr: -234> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb80f630) adding con mode: secure 2024-09-12T00:38:13.069 INFO:tasks.workunit.client.0.smithi043.stderr: -233> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb80f630) adding con mode: crc 2024-09-12T00:38:13.069 INFO:tasks.workunit.client.0.smithi043.stderr: -232> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb80f630) adding con mode: secure 2024-09-12T00:38:13.069 INFO:tasks.workunit.client.0.smithi043.stderr: -231> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb80f630) adding con mode: crc 2024-09-12T00:38:13.069 INFO:tasks.workunit.client.0.smithi043.stderr: -230> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb80f630) adding con mode: secure 2024-09-12T00:38:13.069 INFO:tasks.workunit.client.0.smithi043.stderr: -229> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb80f630) adding con mode: crc 2024-09-12T00:38:13.069 INFO:tasks.workunit.client.0.smithi043.stderr: -228> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb80f630) adding con mode: crc 2024-09-12T00:38:13.069 INFO:tasks.workunit.client.0.smithi043.stderr: -227> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb80f630) adding con mode: secure 2024-09-12T00:38:13.069 INFO:tasks.workunit.client.0.smithi043.stderr: -226> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb80f630) adding con mode: crc 2024-09-12T00:38:13.069 INFO:tasks.workunit.client.0.smithi043.stderr: -225> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb80f630) adding con mode: secure 2024-09-12T00:38:13.069 INFO:tasks.workunit.client.0.smithi043.stderr: -224> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb80f630) adding con mode: crc 2024-09-12T00:38:13.070 INFO:tasks.workunit.client.0.smithi043.stderr: -223> 2024-09-12T00:38:12.605+0000 7f16f1c979c0 5 AuthRegistry(0x55b5cb80f630) adding con mode: secure 2024-09-12T00:38:13.070 INFO:tasks.workunit.client.0.smithi043.stderr: -222> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:13.070 INFO:tasks.workunit.client.0.smithi043.stderr: -221> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:13.070 INFO:tasks.workunit.client.0.smithi043.stderr: -220> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 5 asok(0x55b5cb5872b0) register_command rotate-key cmddesc rotate-key hook 0x55b5cb80f778 EEXIST 2024-09-12T00:38:13.070 INFO:tasks.workunit.client.0.smithi043.stderr: -219> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:13.070 INFO:tasks.workunit.client.0.smithi043.stderr: -218> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:38:13.070 INFO:tasks.workunit.client.0.smithi043.stderr: -217> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 10 monclient(hunting): picked mon.noname-a con 0x55b5cb85b4d0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:38:13.070 INFO:tasks.workunit.client.0.smithi043.stderr: -216> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 10 monclient(hunting): picked mon.noname-c con 0x55b5cb85c6d0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:38:13.070 INFO:tasks.workunit.client.0.smithi043.stderr: -215> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 10 monclient(hunting): picked mon.noname-b con 0x55b5cb861290 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:38:13.070 INFO:tasks.workunit.client.0.smithi043.stderr: -214> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:13.070 INFO:tasks.workunit.client.0.smithi043.stderr: -213> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:13.070 INFO:tasks.workunit.client.0.smithi043.stderr: -212> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:13.071 INFO:tasks.workunit.client.0.smithi043.stderr: -211> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:13.071 INFO:tasks.workunit.client.0.smithi043.stderr: -210> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 10 monclient(hunting): authenticate will time out at 2188.600433s 2024-09-12T00:38:13.071 INFO:tasks.workunit.client.0.smithi043.stderr: -209> 2024-09-12T00:38:12.609+0000 7f16ef79d640 10 monclient(hunting): get_auth_request con 0x55b5cb85b4d0 auth_method 0 2024-09-12T00:38:13.071 INFO:tasks.workunit.client.0.smithi043.stderr: -208> 2024-09-12T00:38:12.609+0000 7f16ef79d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:13.071 INFO:tasks.workunit.client.0.smithi043.stderr: -207> 2024-09-12T00:38:12.609+0000 7f16ef79d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:13.071 INFO:tasks.workunit.client.0.smithi043.stderr: -206> 2024-09-12T00:38:12.609+0000 7f16ef79d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:13.071 INFO:tasks.workunit.client.0.smithi043.stderr: -205> 2024-09-12T00:38:12.609+0000 7f16eef9c640 10 monclient(hunting): get_auth_request con 0x55b5cb85c6d0 auth_method 0 2024-09-12T00:38:13.071 INFO:tasks.workunit.client.0.smithi043.stderr: -204> 2024-09-12T00:38:12.609+0000 7f16eef9c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:13.071 INFO:tasks.workunit.client.0.smithi043.stderr: -203> 2024-09-12T00:38:12.609+0000 7f16eef9c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:13.071 INFO:tasks.workunit.client.0.smithi043.stderr: -202> 2024-09-12T00:38:12.609+0000 7f16eef9c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:13.071 INFO:tasks.workunit.client.0.smithi043.stderr: -201> 2024-09-12T00:38:12.609+0000 7f16ef79d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:13.071 INFO:tasks.workunit.client.0.smithi043.stderr: -200> 2024-09-12T00:38:12.609+0000 7f16ef79d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:13.072 INFO:tasks.workunit.client.0.smithi043.stderr: -199> 2024-09-12T00:38:12.609+0000 7f16ef79d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:13.072 INFO:tasks.workunit.client.0.smithi043.stderr: -198> 2024-09-12T00:38:12.609+0000 7f16eef9c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:13.072 INFO:tasks.workunit.client.0.smithi043.stderr: -197> 2024-09-12T00:38:12.609+0000 7f16eef9c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:13.072 INFO:tasks.workunit.client.0.smithi043.stderr: -196> 2024-09-12T00:38:12.609+0000 7f16eef9c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:13.072 INFO:tasks.workunit.client.0.smithi043.stderr: -195> 2024-09-12T00:38:12.609+0000 7f16ef79d640 10 monclient(hunting): handle_auth_done global_id 7020 payload 824 2024-09-12T00:38:13.072 INFO:tasks.workunit.client.0.smithi043.stderr: -194> 2024-09-12T00:38:12.609+0000 7f16ef79d640 10 monclient: _finish_hunting 0 2024-09-12T00:38:13.072 INFO:tasks.workunit.client.0.smithi043.stderr: -193> 2024-09-12T00:38:12.609+0000 7f16ef79d640 1 monclient: found mon.noname-a 2024-09-12T00:38:13.072 INFO:tasks.workunit.client.0.smithi043.stderr: -192> 2024-09-12T00:38:12.609+0000 7f16ef79d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:38:13.072 INFO:tasks.workunit.client.0.smithi043.stderr: -191> 2024-09-12T00:38:12.609+0000 7f15d17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:13.072 INFO:tasks.workunit.client.0.smithi043.stderr: -190> 2024-09-12T00:38:12.609+0000 7f15d17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:38:13.072 INFO:tasks.workunit.client.0.smithi043.stderr: -189> 2024-09-12T00:38:12.609+0000 7f15d17fa640 10 monclient: dump: 2024-09-12T00:38:13.072 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:13.072 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:13.073 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:13.073 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:13.073 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:13.073 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:13.073 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:13.073 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:13.073 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:13.073 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:13.073 INFO:tasks.workunit.client.0.smithi043.stderr: -188> 2024-09-12T00:38:12.609+0000 7f15d17fa640 10 monclient: _finish_auth 0 2024-09-12T00:38:13.073 INFO:tasks.workunit.client.0.smithi043.stderr: -187> 2024-09-12T00:38:12.609+0000 7f15d17fa640 10 monclient: _check_auth_tickets 2024-09-12T00:38:13.073 INFO:tasks.workunit.client.0.smithi043.stderr: -186> 2024-09-12T00:38:12.609+0000 7f15d17fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:13.073 INFO:tasks.workunit.client.0.smithi043.stderr: -185> 2024-09-12T00:38:12.609+0000 7f15d17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:13.073 INFO:tasks.workunit.client.0.smithi043.stderr: -184> 2024-09-12T00:38:12.609+0000 7f15d17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:13.074 INFO:tasks.workunit.client.0.smithi043.stderr: -183> 2024-09-12T00:38:12.609+0000 7f15d17fa640 10 monclient: dump: 2024-09-12T00:38:13.074 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:13.074 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:13.074 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:13.074 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:13.074 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:13.074 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:13.074 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:13.074 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:13.074 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:13.074 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:13.074 INFO:tasks.workunit.client.0.smithi043.stderr: -182> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 5 monclient: authenticate success, global_id 7020 2024-09-12T00:38:13.075 INFO:tasks.workunit.client.0.smithi043.stderr: -181> 2024-09-12T00:38:12.609+0000 7f15d2ffd640 4 set_mon_vals no callback set 2024-09-12T00:38:13.075 INFO:tasks.workunit.client.0.smithi043.stderr: -180> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 10 monclient: _renew_subs 2024-09-12T00:38:13.075 INFO:tasks.workunit.client.0.smithi043.stderr: -179> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:38:13.075 INFO:tasks.workunit.client.0.smithi043.stderr: -178> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 10 monclient: _renew_subs 2024-09-12T00:38:13.075 INFO:tasks.workunit.client.0.smithi043.stderr: -177> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:38:13.075 INFO:tasks.workunit.client.0.smithi043.stderr: -176> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 1 librados: init done 2024-09-12T00:38:13.075 INFO:tasks.workunit.client.0.smithi043.stderr: -175> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 5 asok(0x55b5cb5872b0) register_command cr dump hook 0x55b5cb8598b8 2024-09-12T00:38:13.075 INFO:tasks.workunit.client.0.smithi043.stderr: -174> 2024-09-12T00:38:12.609+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.075 INFO:tasks.workunit.client.0.smithi043.stderr: -173> 2024-09-12T00:38:12.609+0000 7f15d17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:38:13.075 INFO:tasks.workunit.client.0.smithi043.stderr: -172> 2024-09-12T00:38:12.609+0000 7f15d17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:38:13.075 INFO:tasks.workunit.client.0.smithi043.stderr: -171> 2024-09-12T00:38:12.609+0000 7f15d17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:38:13.075 INFO:tasks.workunit.client.0.smithi043.stderr: -170> 2024-09-12T00:38:12.609+0000 7f16eef9c640 10 monclient: get_auth_request con 0x7f15b8070b10 auth_method 0 2024-09-12T00:38:13.075 INFO:tasks.workunit.client.0.smithi043.stderr: -169> 2024-09-12T00:38:12.609+0000 7f16eff9e640 10 monclient: get_auth_request con 0x55b5cb87a770 auth_method 0 2024-09-12T00:38:13.076 INFO:tasks.workunit.client.0.smithi043.stderr: -168> 2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.076 INFO:tasks.workunit.client.0.smithi043.stderr: -167> 2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 realm 2024-09-12T00:38:13.076 INFO:tasks.workunit.client.0.smithi043.stderr: -166> 2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.076 INFO:tasks.workunit.client.0.smithi043.stderr: -165> 2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.076 INFO:tasks.workunit.client.0.smithi043.stderr: -164> 2024-09-12T00:38:12.613+0000 7f16f1c979c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:13.076 INFO:tasks.workunit.client.0.smithi043.stderr: -163> 2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.076 INFO:tasks.workunit.client.0.smithi043.stderr: -162> 2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.076 INFO:tasks.workunit.client.0.smithi043.stderr: -161> 2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.076 INFO:tasks.workunit.client.0.smithi043.stderr: -160> 2024-09-12T00:38:12.613+0000 7f16ef79d640 10 monclient: get_auth_request con 0x55b5cb87e9e0 auth_method 0 2024-09-12T00:38:13.076 INFO:tasks.workunit.client.0.smithi043.stderr: -159> 2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:13.076 INFO:tasks.workunit.client.0.smithi043.stderr: -158> 2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.076 INFO:tasks.workunit.client.0.smithi043.stderr: -157> 2024-09-12T00:38:12.613+0000 7f16eef9c640 10 monclient: get_auth_request con 0x55b5cb882240 auth_method 0 2024-09-12T00:38:13.077 INFO:tasks.workunit.client.0.smithi043.stderr: -156> 2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:13.077 INFO:tasks.workunit.client.0.smithi043.stderr: -155> 2024-09-12T00:38:12.613+0000 7f16f1c979c0 20 searching for the correct realm 2024-09-12T00:38:13.077 INFO:tasks.workunit.client.0.smithi043.stderr: -154> 2024-09-12T00:38:12.613+0000 7f16eff9e640 10 monclient: get_auth_request con 0x55b5cb887020 auth_method 0 2024-09-12T00:38:13.077 INFO:tasks.workunit.client.0.smithi043.stderr: -153> 2024-09-12T00:38:12.617+0000 7f16ef79d640 10 monclient: get_auth_request con 0x7f16e80ab070 auth_method 0 2024-09-12T00:38:13.077 INFO:tasks.workunit.client.0.smithi043.stderr: -152> 2024-09-12T00:38:12.617+0000 7f16eef9c640 10 monclient: get_auth_request con 0x7f16e400a070 auth_method 0 2024-09-12T00:38:13.077 INFO:tasks.workunit.client.0.smithi043.stderr: -151> 2024-09-12T00:38:12.621+0000 7f16eff9e640 10 monclient: get_auth_request con 0x7f16e4033b10 auth_method 0 2024-09-12T00:38:13.077 INFO:tasks.workunit.client.0.smithi043.stderr: -150> 2024-09-12T00:38:12.621+0000 7f16eff9e640 0 -- 172.21.15.43:0/291986731 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f16e4033b10 msgr2=0x7f16e400b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:13.077 INFO:tasks.workunit.client.0.smithi043.stderr: -149> 2024-09-12T00:38:12.825+0000 7f16eff9e640 10 monclient: get_auth_request con 0x7f16e4033b10 auth_method 0 2024-09-12T00:38:13.077 INFO:tasks.workunit.client.0.smithi043.stderr: -148> 2024-09-12T00:38:12.833+0000 7f16ef79d640 10 monclient: get_auth_request con 0x7f16e4060970 auth_method 0 2024-09-12T00:38:13.077 INFO:tasks.workunit.client.0.smithi043.stderr: -147> 2024-09-12T00:38:12.837+0000 7f16ef79d640 0 -- 172.21.15.43:0/291986731 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x55b5cb87e9e0 msgr2=0x55b5cb880e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:13.077 INFO:tasks.workunit.client.0.smithi043.stderr: -146> 2024-09-12T00:38:12.837+0000 7f15d17fa640 1 client.7020.objecter ms_handle_reset 0x55b5cb87e9e0 session 0x55b5cb87e360 osd.5 2024-09-12T00:38:13.077 INFO:tasks.workunit.client.0.smithi043.stderr: -145> 2024-09-12T00:38:12.837+0000 7f15d17fa640 10 monclient: _renew_subs 2024-09-12T00:38:13.078 INFO:tasks.workunit.client.0.smithi043.stderr: -144> 2024-09-12T00:38:12.837+0000 7f15d17fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:38:13.078 INFO:tasks.workunit.client.0.smithi043.stderr: -143> 2024-09-12T00:38:12.841+0000 7f16ef79d640 10 monclient: get_auth_request con 0x7f15b8080b30 auth_method 0 2024-09-12T00:38:13.078 INFO:tasks.workunit.client.0.smithi043.stderr: -142> 2024-09-12T00:38:12.845+0000 7f16f1c979c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:38:13.078 INFO:tasks.workunit.client.0.smithi043.stderr: -141> 2024-09-12T00:38:12.845+0000 7f16f1c979c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:13.078 INFO:tasks.workunit.client.0.smithi043.stderr: -140> 2024-09-12T00:38:12.845+0000 7f16f1c979c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:13.078 INFO:tasks.workunit.client.0.smithi043.stderr: -139> 2024-09-12T00:38:12.845+0000 7f16f1c979c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:38:13.078 INFO:tasks.workunit.client.0.smithi043.stderr: -138> 2024-09-12T00:38:12.845+0000 7f16f1c979c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:13.078 INFO:tasks.workunit.client.0.smithi043.stderr: -137> 2024-09-12T00:38:12.845+0000 7f16f1c979c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:13.078 INFO:tasks.workunit.client.0.smithi043.stderr: -136> 2024-09-12T00:38:12.845+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.078 INFO:tasks.workunit.client.0.smithi043.stderr: -135> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.078 INFO:tasks.workunit.client.0.smithi043.stderr: -134> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.078 INFO:tasks.workunit.client.0.smithi043.stderr: -133> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:13.078 INFO:tasks.workunit.client.0.smithi043.stderr: -132> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.079 INFO:tasks.workunit.client.0.smithi043.stderr: -131> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:13.079 INFO:tasks.workunit.client.0.smithi043.stderr: -130> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 zone default found 2024-09-12T00:38:13.079 INFO:tasks.workunit.client.0.smithi043.stderr: -129> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 4 Realm: () 2024-09-12T00:38:13.079 INFO:tasks.workunit.client.0.smithi043.stderr: -128> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:38:13.079 INFO:tasks.workunit.client.0.smithi043.stderr: -127> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:38:13.079 INFO:tasks.workunit.client.0.smithi043.stderr: -126> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:13.079 INFO:tasks.workunit.client.0.smithi043.stderr: -125> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 zonegroup default 2024-09-12T00:38:13.079 INFO:tasks.workunit.client.0.smithi043.stderr: -124> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.079 INFO:tasks.workunit.client.0.smithi043.stderr: -123> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.079 INFO:tasks.workunit.client.0.smithi043.stderr: -122> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.079 INFO:tasks.workunit.client.0.smithi043.stderr: -121> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.079 INFO:tasks.workunit.client.0.smithi043.stderr: -120> 2024-09-12T00:38:12.849+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.079 INFO:tasks.workunit.client.0.smithi043.stderr: -119> 2024-09-12T00:38:12.853+0000 7f16f1c979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.080 INFO:tasks.workunit.client.0.smithi043.stderr: -118> 2024-09-12T00:38:12.853+0000 7f16f1c979c0 20 started sync module instance, tier type = 2024-09-12T00:38:13.080 INFO:tasks.workunit.client.0.smithi043.stderr: -117> 2024-09-12T00:38:12.853+0000 7f16f1c979c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:38:13.080 INFO:tasks.workunit.client.0.smithi043.stderr: -116> 2024-09-12T00:38:12.877+0000 7f16f1c979c0 20 add_watcher() i=0 2024-09-12T00:38:13.080 INFO:tasks.workunit.client.0.smithi043.stderr: -115> 2024-09-12T00:38:12.877+0000 7f16f1c979c0 20 add_watcher() i=1 2024-09-12T00:38:13.080 INFO:tasks.workunit.client.0.smithi043.stderr: -114> 2024-09-12T00:38:12.877+0000 7f16f1c979c0 20 add_watcher() i=2 2024-09-12T00:38:13.080 INFO:tasks.workunit.client.0.smithi043.stderr: -113> 2024-09-12T00:38:12.877+0000 7f16f1c979c0 20 add_watcher() i=3 2024-09-12T00:38:13.080 INFO:tasks.workunit.client.0.smithi043.stderr: -112> 2024-09-12T00:38:12.877+0000 7f16f1c979c0 20 add_watcher() i=4 2024-09-12T00:38:13.080 INFO:tasks.workunit.client.0.smithi043.stderr: -111> 2024-09-12T00:38:12.877+0000 7f16f1c979c0 20 add_watcher() i=5 2024-09-12T00:38:13.080 INFO:tasks.workunit.client.0.smithi043.stderr: -110> 2024-09-12T00:38:12.877+0000 7f16f1c979c0 20 add_watcher() i=6 2024-09-12T00:38:13.080 INFO:tasks.workunit.client.0.smithi043.stderr: -109> 2024-09-12T00:38:12.877+0000 7f16f1c979c0 20 add_watcher() i=7 2024-09-12T00:38:13.080 INFO:tasks.workunit.client.0.smithi043.stderr: -108> 2024-09-12T00:38:12.877+0000 7f16f1c979c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:13.080 INFO:tasks.workunit.client.0.smithi043.stderr: -107> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaef0) adding auth protocol: cephx 2024-09-12T00:38:13.081 INFO:tasks.workunit.client.0.smithi043.stderr: -106> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaef0) adding auth protocol: cephx 2024-09-12T00:38:13.081 INFO:tasks.workunit.client.0.smithi043.stderr: -105> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaef0) adding auth protocol: cephx 2024-09-12T00:38:13.081 INFO:tasks.workunit.client.0.smithi043.stderr: -104> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaef0) adding con mode: secure 2024-09-12T00:38:13.081 INFO:tasks.workunit.client.0.smithi043.stderr: -103> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaef0) adding con mode: crc 2024-09-12T00:38:13.081 INFO:tasks.workunit.client.0.smithi043.stderr: -102> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaef0) adding con mode: secure 2024-09-12T00:38:13.081 INFO:tasks.workunit.client.0.smithi043.stderr: -101> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaef0) adding con mode: crc 2024-09-12T00:38:13.081 INFO:tasks.workunit.client.0.smithi043.stderr: -100> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaef0) adding con mode: secure 2024-09-12T00:38:13.081 INFO:tasks.workunit.client.0.smithi043.stderr: -99> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaef0) adding con mode: crc 2024-09-12T00:38:13.081 INFO:tasks.workunit.client.0.smithi043.stderr: -98> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaef0) adding con mode: crc 2024-09-12T00:38:13.081 INFO:tasks.workunit.client.0.smithi043.stderr: -97> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaef0) adding con mode: secure 2024-09-12T00:38:13.081 INFO:tasks.workunit.client.0.smithi043.stderr: -96> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaef0) adding con mode: crc 2024-09-12T00:38:13.081 INFO:tasks.workunit.client.0.smithi043.stderr: -95> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaef0) adding con mode: secure 2024-09-12T00:38:13.081 INFO:tasks.workunit.client.0.smithi043.stderr: -94> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaef0) adding con mode: crc 2024-09-12T00:38:13.081 INFO:tasks.workunit.client.0.smithi043.stderr: -93> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 AuthRegistry(0x7ffe89beaef0) adding con mode: secure 2024-09-12T00:38:13.082 INFO:tasks.workunit.client.0.smithi043.stderr: -92> 2024-09-12T00:38:12.881+0000 7f15a67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:13.082 INFO:tasks.workunit.client.0.smithi043.stderr: -91> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:13.082 INFO:tasks.workunit.client.0.smithi043.stderr: -90> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:13.082 INFO:tasks.workunit.client.0.smithi043.stderr: -89> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:13.082 INFO:tasks.workunit.client.0.smithi043.stderr: -88> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 asok(0x55b5cb5872b0) register_command cache list hook 0x55b5cb859220 2024-09-12T00:38:13.082 INFO:tasks.workunit.client.0.smithi043.stderr: -87> 2024-09-12T00:38:12.881+0000 7f16f1c979c0 5 asok(0x55b5cb5872b0) register_command cache inspect hook 0x55b5cb859220 2024-09-12T00:38:13.082 INFO:tasks.workunit.client.0.smithi043.stderr: -86> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 5 asok(0x55b5cb5872b0) register_command cache erase hook 0x55b5cb859220 2024-09-12T00:38:13.082 INFO:tasks.workunit.client.0.smithi043.stderr: -85> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 5 asok(0x55b5cb5872b0) register_command cache zap hook 0x55b5cb859220 2024-09-12T00:38:13.082 INFO:tasks.workunit.client.0.smithi043.stderr: -84> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 5 note: GC not initialized 2024-09-12T00:38:13.082 INFO:tasks.workunit.client.0.smithi043.stderr: -83> 2024-09-12T00:38:12.885+0000 7f15a57e2640 20 reqs_thread_entry: start 2024-09-12T00:38:13.082 INFO:tasks.workunit.client.0.smithi043.stderr: -82> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 5 asok(0x55b5cb5872b0) register_command sync trace show hook 0x7f16e400c7c0 2024-09-12T00:38:13.083 INFO:tasks.workunit.client.0.smithi043.stderr: -81> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 5 asok(0x55b5cb5872b0) register_command sync trace history hook 0x7f16e400c7c0 2024-09-12T00:38:13.083 INFO:tasks.workunit.client.0.smithi043.stderr: -80> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 5 asok(0x55b5cb5872b0) register_command sync trace active hook 0x7f16e400c7c0 2024-09-12T00:38:13.083 INFO:tasks.workunit.client.0.smithi043.stderr: -79> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 5 asok(0x55b5cb5872b0) register_command sync trace active_short hook 0x7f16e400c7c0 2024-09-12T00:38:13.083 INFO:tasks.workunit.client.0.smithi043.stderr: -78> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:13.083 INFO:tasks.workunit.client.0.smithi043.stderr: -77> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 20 Filter name: none 2024-09-12T00:38:13.083 INFO:tasks.workunit.client.0.smithi043.stderr: -76> 2024-09-12T00:38:12.885+0000 7f159e7fc640 20 reqs_thread_entry: start 2024-09-12T00:38:13.083 INFO:tasks.workunit.client.0.smithi043.stderr: -75> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:38:13.083 INFO:tasks.workunit.client.0.smithi043.stderr: -74> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.083 INFO:tasks.workunit.client.0.smithi043.stderr: -73> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:38:13.083 INFO:tasks.workunit.client.0.smithi043.stderr: -72> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:38:13.083 INFO:tasks.workunit.client.0.smithi043.stderr: -71> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:38:13.083 INFO:tasks.workunit.client.0.smithi043.stderr: -70> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 : miss 2024-09-12T00:38:13.083 INFO:tasks.workunit.client.0.smithi043.stderr: -69> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.084 INFO:tasks.workunit.client.0.smithi043.stderr: -68> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:38:13.084 INFO:tasks.workunit.client.0.smithi043.stderr: -67> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 info.flags=0x17 2024-09-12T00:38:13.084 INFO:tasks.workunit.client.0.smithi043.stderr: -66> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 to cache LRU end 2024-09-12T00:38:13.084 INFO:tasks.workunit.client.0.smithi043.stderr: -65> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:13.084 INFO:tasks.workunit.client.0.smithi043.stderr: -64> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:13.084 INFO:tasks.workunit.client.0.smithi043.stderr: -63> 2024-09-12T00:38:12.885+0000 7f16f1c979c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 2024-09-12T00:38:13.084 INFO:tasks.workunit.client.0.smithi043.stderr: -62> 2024-09-12T00:38:12.897+0000 7f16f1c979c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 info.flags=0x17 2024-09-12T00:38:13.084 INFO:tasks.workunit.client.0.smithi043.stderr: -61> 2024-09-12T00:38:12.897+0000 7f16f1c979c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 to cache LRU end 2024-09-12T00:38:13.084 INFO:tasks.workunit.client.0.smithi043.stderr: -60> 2024-09-12T00:38:12.897+0000 7f16f1c979c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:13.084 INFO:tasks.workunit.client.0.smithi043.stderr: -59> 2024-09-12T00:38:12.897+0000 7f16f1c979c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29, ofs0, ns] 2024-09-12T00:38:13.084 INFO:tasks.workunit.client.0.smithi043.stderr: -58> 2024-09-12T00:38:12.897+0000 7f15d2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333526 cookie 94239292174336 notifier 7020 bl.length()=915 2024-09-12T00:38:13.085 INFO:tasks.workunit.client.0.smithi043.stderr: -57> 2024-09-12T00:38:12.897+0000 7f15d2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 info.flags=0x17 2024-09-12T00:38:13.085 INFO:tasks.workunit.client.0.smithi043.stderr: -56> 2024-09-12T00:38:12.897+0000 7f15d2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 to cache LRU end 2024-09-12T00:38:13.085 INFO:tasks.workunit.client.0.smithi043.stderr: -55> 2024-09-12T00:38:12.897+0000 7f15d2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:13.085 INFO:tasks.workunit.client.0.smithi043.stderr: -54> 2024-09-12T00:38:12.897+0000 7f16f1c979c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): orig_sources= new_sources= 2024-09-12T00:38:13.085 INFO:tasks.workunit.client.0.smithi043.stderr: -53> 2024-09-12T00:38:12.897+0000 7f16f1c979c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): potential sources added=[] removed=[] 2024-09-12T00:38:13.085 INFO:tasks.workunit.client.0.smithi043.stderr: -52> 2024-09-12T00:38:12.897+0000 7f16f1c979c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): orig_dests= new_dests= 2024-09-12T00:38:13.085 INFO:tasks.workunit.client.0.smithi043.stderr: -51> 2024-09-12T00:38:12.897+0000 7f16f1c979c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): potential dests added=[] removed=[] 2024-09-12T00:38:13.085 INFO:tasks.workunit.client.0.smithi043.stderr: -50> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.0 2024-09-12T00:38:13.085 INFO:tasks.workunit.client.0.smithi043.stderr: -49> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.0 2024-09-12T00:38:13.085 INFO:tasks.workunit.client.0.smithi043.stderr: -48> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.1 2024-09-12T00:38:13.085 INFO:tasks.workunit.client.0.smithi043.stderr: -47> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.1 2024-09-12T00:38:13.085 INFO:tasks.workunit.client.0.smithi043.stderr: -46> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.2 2024-09-12T00:38:13.086 INFO:tasks.workunit.client.0.smithi043.stderr: -45> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.2 2024-09-12T00:38:13.086 INFO:tasks.workunit.client.0.smithi043.stderr: -44> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.3 2024-09-12T00:38:13.086 INFO:tasks.workunit.client.0.smithi043.stderr: -43> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.3 2024-09-12T00:38:13.086 INFO:tasks.workunit.client.0.smithi043.stderr: -42> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.4 2024-09-12T00:38:13.086 INFO:tasks.workunit.client.0.smithi043.stderr: -41> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.4 2024-09-12T00:38:13.086 INFO:tasks.workunit.client.0.smithi043.stderr: -40> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.5 2024-09-12T00:38:13.086 INFO:tasks.workunit.client.0.smithi043.stderr: -39> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.5 2024-09-12T00:38:13.086 INFO:tasks.workunit.client.0.smithi043.stderr: -38> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.6 2024-09-12T00:38:13.086 INFO:tasks.workunit.client.0.smithi043.stderr: -37> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.6 2024-09-12T00:38:13.086 INFO:tasks.workunit.client.0.smithi043.stderr: -36> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.7 2024-09-12T00:38:13.086 INFO:tasks.workunit.client.0.smithi043.stderr: -35> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.7 2024-09-12T00:38:13.086 INFO:tasks.workunit.client.0.smithi043.stderr: -34> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.8 2024-09-12T00:38:13.086 INFO:tasks.workunit.client.0.smithi043.stderr: -33> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.8 2024-09-12T00:38:13.087 INFO:tasks.workunit.client.0.smithi043.stderr: -32> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.9 2024-09-12T00:38:13.087 INFO:tasks.workunit.client.0.smithi043.stderr: -31> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.9 2024-09-12T00:38:13.087 INFO:tasks.workunit.client.0.smithi043.stderr: -30> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.10 2024-09-12T00:38:13.087 INFO:tasks.workunit.client.0.smithi043.stderr: -29> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.10 2024-09-12T00:38:13.087 INFO:tasks.workunit.client.0.smithi043.stderr: -28> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.11 2024-09-12T00:38:13.087 INFO:tasks.workunit.client.0.smithi043.stderr: -27> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1.11 2024-09-12T00:38:13.087 INFO:tasks.workunit.client.0.smithi043.stderr: -26> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.0 2024-09-12T00:38:13.087 INFO:tasks.workunit.client.0.smithi043.stderr: -25> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1 2024-09-12T00:38:13.087 INFO:tasks.workunit.client.0.smithi043.stderr: -24> 2024-09-12T00:38:12.909+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.2 2024-09-12T00:38:13.087 INFO:tasks.workunit.client.0.smithi043.stderr: -23> 2024-09-12T00:38:12.913+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.3 2024-09-12T00:38:13.087 INFO:tasks.workunit.client.0.smithi043.stderr: -22> 2024-09-12T00:38:12.913+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.4 2024-09-12T00:38:13.087 INFO:tasks.workunit.client.0.smithi043.stderr: -21> 2024-09-12T00:38:12.913+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.5 2024-09-12T00:38:13.087 INFO:tasks.workunit.client.0.smithi043.stderr: -20> 2024-09-12T00:38:12.913+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.6 2024-09-12T00:38:13.088 INFO:tasks.workunit.client.0.smithi043.stderr: -19> 2024-09-12T00:38:12.917+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.7 2024-09-12T00:38:13.088 INFO:tasks.workunit.client.0.smithi043.stderr: -18> 2024-09-12T00:38:12.917+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.8 2024-09-12T00:38:13.088 INFO:tasks.workunit.client.0.smithi043.stderr: -17> 2024-09-12T00:38:12.917+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.9 2024-09-12T00:38:13.088 INFO:tasks.workunit.client.0.smithi043.stderr: -16> 2024-09-12T00:38:12.917+0000 7f16f1c979c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.10 2024-09-12T00:38:13.088 INFO:tasks.workunit.client.0.smithi043.stderr: -15> 2024-09-12T00:38:12.925+0000 7f16f1c979c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:13.088 INFO:tasks.workunit.client.0.smithi043.stderr: -14> 2024-09-12T00:38:12.925+0000 7f16f1c979c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 2024-09-12T00:38:13.088 INFO:tasks.workunit.client.0.smithi043.stderr: -13> 2024-09-12T00:38:12.929+0000 7f16f1c979c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 info.flags=0x17 2024-09-12T00:38:13.088 INFO:tasks.workunit.client.0.smithi043.stderr: -12> 2024-09-12T00:38:12.929+0000 7f16f1c979c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 to cache LRU end 2024-09-12T00:38:13.088 INFO:tasks.workunit.client.0.smithi043.stderr: -11> 2024-09-12T00:38:12.929+0000 7f16f1c979c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:13.088 INFO:tasks.workunit.client.0.smithi043.stderr: -10> 2024-09-12T00:38:12.929+0000 7f16f1c979c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29, ofs0, ns] 2024-09-12T00:38:13.088 INFO:tasks.workunit.client.0.smithi043.stderr: -9> 2024-09-12T00:38:12.929+0000 7f15d27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333527 cookie 94239292174336 notifier 7020 bl.length()=915 2024-09-12T00:38:13.088 INFO:tasks.workunit.client.0.smithi043.stderr: -8> 2024-09-12T00:38:12.929+0000 7f15d27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 info.flags=0x17 2024-09-12T00:38:13.088 INFO:tasks.workunit.client.0.smithi043.stderr: -7> 2024-09-12T00:38:12.929+0000 7f15d27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 to cache LRU end 2024-09-12T00:38:13.089 INFO:tasks.workunit.client.0.smithi043.stderr: -6> 2024-09-12T00:38:12.929+0000 7f15d27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:13.089 INFO:tasks.workunit.client.0.smithi043.stderr: -5> 2024-09-12T00:38:12.929+0000 7f16f1c979c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): orig_sources= new_sources= 2024-09-12T00:38:13.089 INFO:tasks.workunit.client.0.smithi043.stderr: -4> 2024-09-12T00:38:12.929+0000 7f16f1c979c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): potential sources added=[] removed=[] 2024-09-12T00:38:13.089 INFO:tasks.workunit.client.0.smithi043.stderr: -3> 2024-09-12T00:38:12.929+0000 7f16f1c979c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): orig_dests= new_dests= 2024-09-12T00:38:13.089 INFO:tasks.workunit.client.0.smithi043.stderr: -2> 2024-09-12T00:38:12.929+0000 7f16f1c979c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): potential dests added=[] removed=[] 2024-09-12T00:38:13.089 INFO:tasks.workunit.client.0.smithi043.stderr: -1> 2024-09-12T00:38:12.933+0000 7f16f1c979c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f16f1c979c0 time 2024-09-12T00:38:12.935243+0000 2024-09-12T00:38:13.089 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:38:13.089 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:13.089 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:13.089 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f16f55712eb] 2024-09-12T00:38:13.089 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f16f557149f] 2024-09-12T00:38:13.089 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5ca2c0cc1] 2024-09-12T00:38:13.089 INFO:tasks.workunit.client.0.smithi043.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55b5ca2d5086] 2024-09-12T00:38:13.090 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55b5ca2d66a4] 2024-09-12T00:38:13.090 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:38:13.090 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f16f43d7d90] 2024-09-12T00:38:13.090 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:38:13.090 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:38:13.090 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:13.090 INFO:tasks.workunit.client.0.smithi043.stderr: 0> 2024-09-12T00:38:12.937+0000 7f16f1c979c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:38:13.090 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7f16f1c979c0 thread_name:radosgw-admin 2024-09-12T00:38:13.090 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:13.090 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:13.090 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f16f43f0520] 2024-09-12T00:38:13.090 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:38:13.090 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:38:13.091 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:38:13.091 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f16f5571345] 2024-09-12T00:38:13.091 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f16f557149f] 2024-09-12T00:38:13.091 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b5ca2c0cc1] 2024-09-12T00:38:13.091 INFO:tasks.workunit.client.0.smithi043.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55b5ca2d5086] 2024-09-12T00:38:13.091 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55b5ca2d66a4] 2024-09-12T00:38:13.091 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:38:13.091 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f16f43d7d90] 2024-09-12T00:38:13.091 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:38:13.091 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:38:13.091 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:38:13.091 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:13.091 INFO:tasks.workunit.client.0.smithi043.stderr:--- logging levels --- 2024-09-12T00:38:13.092 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 none 2024-09-12T00:38:13.092 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 lockdep 2024-09-12T00:38:13.092 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 context 2024-09-12T00:38:13.092 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 crush 2024-09-12T00:38:13.092 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds 2024-09-12T00:38:13.092 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_balancer 2024-09-12T00:38:13.092 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_locker 2024-09-12T00:38:13.092 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log 2024-09-12T00:38:13.092 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log_expire 2024-09-12T00:38:13.092 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_migrator 2024-09-12T00:38:13.092 INFO:tasks.workunit.client.0.smithi043.stderr: 3/ 5 mds_quiesce 2024-09-12T00:38:13.092 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 buffer 2024-09-12T00:38:13.093 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 timer 2024-09-12T00:38:13.093 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 filer 2024-09-12T00:38:13.093 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 striper 2024-09-12T00:38:13.093 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 objecter 2024-09-12T00:38:13.093 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rados 2024-09-12T00:38:13.093 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd 2024-09-12T00:38:13.093 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_mirror 2024-09-12T00:38:13.093 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_replay 2024-09-12T00:38:13.093 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_pwl 2024-09-12T00:38:13.093 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 journaler 2024-09-12T00:38:13.093 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objectcacher 2024-09-12T00:38:13.093 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:38:13.093 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 client 2024-09-12T00:38:13.094 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 osd 2024-09-12T00:38:13.094 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 optracker 2024-09-12T00:38:13.094 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objclass 2024-09-12T00:38:13.094 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 filestore 2024-09-12T00:38:13.094 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 journal 2024-09-12T00:38:13.094 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 ms 2024-09-12T00:38:13.094 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mon 2024-09-12T00:38:13.094 INFO:tasks.workunit.client.0.smithi043.stderr: 0/10 monc 2024-09-12T00:38:13.094 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 paxos 2024-09-12T00:38:13.094 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 tp 2024-09-12T00:38:13.094 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 auth 2024-09-12T00:38:13.094 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 crypto 2024-09-12T00:38:13.094 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 finisher 2024-09-12T00:38:13.094 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 reserver 2024-09-12T00:38:13.095 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 heartbeatmap 2024-09-12T00:38:13.095 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 perfcounter 2024-09-12T00:38:13.095 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw 2024-09-12T00:38:13.095 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_sync 2024-09-12T00:38:13.095 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_datacache 2024-09-12T00:38:13.095 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_access 2024-09-12T00:38:13.095 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:38:13.095 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_flight 2024-09-12T00:38:13.095 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:38:13.095 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw_notification 2024-09-12T00:38:13.095 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 javaclient 2024-09-12T00:38:13.095 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 asok 2024-09-12T00:38:13.095 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 throttle 2024-09-12T00:38:13.096 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 refs 2024-09-12T00:38:13.096 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 compressor 2024-09-12T00:38:13.096 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluestore 2024-09-12T00:38:13.096 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluefs 2024-09-12T00:38:13.096 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 bdev 2024-09-12T00:38:13.096 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 kstore 2024-09-12T00:38:13.096 INFO:tasks.workunit.client.0.smithi043.stderr: 4/ 5 rocksdb 2024-09-12T00:38:13.096 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 fuse 2024-09-12T00:38:13.096 INFO:tasks.workunit.client.0.smithi043.stderr: 2/ 5 mgr 2024-09-12T00:38:13.096 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mgrc 2024-09-12T00:38:13.096 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 dpdk 2024-09-12T00:38:13.096 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 eventtrace 2024-09-12T00:38:13.097 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 prioritycache 2024-09-12T00:38:13.097 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 test 2024-09-12T00:38:13.097 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:38:13.097 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephsqlite 2024-09-12T00:38:13.097 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:38:13.097 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore 2024-09-12T00:38:13.097 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_onode 2024-09-12T00:38:13.097 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_odata 2024-09-12T00:38:13.097 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_omap 2024-09-12T00:38:13.097 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_tm 2024-09-12T00:38:13.097 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_t 2024-09-12T00:38:13.097 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:38:13.097 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_epm 2024-09-12T00:38:13.097 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_lba 2024-09-12T00:38:13.098 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:38:13.098 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cache 2024-09-12T00:38:13.098 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_journal 2024-09-12T00:38:13.098 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_device 2024-09-12T00:38:13.098 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_backref 2024-09-12T00:38:13.098 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 alienstore 2024-09-12T00:38:13.098 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mclock 2024-09-12T00:38:13.098 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cyanstore 2024-09-12T00:38:13.098 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 ceph_exporter 2024-09-12T00:38:13.098 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 memstore 2024-09-12T00:38:13.098 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 trace 2024-09-12T00:38:13.098 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 ceph_dedup 2024-09-12T00:38:13.098 INFO:tasks.workunit.client.0.smithi043.stderr: -2/-2 (syslog threshold) 2024-09-12T00:38:13.099 INFO:tasks.workunit.client.0.smithi043.stderr: 99/99 (stderr threshold) 2024-09-12T00:38:13.099 INFO:tasks.workunit.client.0.smithi043.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:38:13.099 INFO:tasks.workunit.client.0.smithi043.stderr: 7f159e7fc640 / http_manager 2024-09-12T00:38:13.099 INFO:tasks.workunit.client.0.smithi043.stderr: 7f15a57e2640 / http_manager 2024-09-12T00:38:13.099 INFO:tasks.workunit.client.0.smithi043.stderr: 7f15a67e4640 / rgw_dt_lg_renew 2024-09-12T00:38:13.099 INFO:tasks.workunit.client.0.smithi043.stderr: 7f15d17fa640 / ms_dispatch 2024-09-12T00:38:13.099 INFO:tasks.workunit.client.0.smithi043.stderr: 7f15d27fc640 / io_context_pool 2024-09-12T00:38:13.099 INFO:tasks.workunit.client.0.smithi043.stderr: 7f15d2ffd640 / io_context_pool 2024-09-12T00:38:13.099 INFO:tasks.workunit.client.0.smithi043.stderr: 7f15d9602640 / ms_dispatch 2024-09-12T00:38:13.099 INFO:tasks.workunit.client.0.smithi043.stderr: 7f15dbe07640 / ms_dispatch 2024-09-12T00:38:13.099 INFO:tasks.workunit.client.0.smithi043.stderr: 7f15dd60a640 / io_context_pool 2024-09-12T00:38:13.099 INFO:tasks.workunit.client.0.smithi043.stderr: 7f16eef9c640 / msgr-worker-2 2024-09-12T00:38:13.099 INFO:tasks.workunit.client.0.smithi043.stderr: 7f16ef79d640 / msgr-worker-1 2024-09-12T00:38:13.100 INFO:tasks.workunit.client.0.smithi043.stderr: 7f16eff9e640 / msgr-worker-0 2024-09-12T00:38:13.100 INFO:tasks.workunit.client.0.smithi043.stderr: 7f16f079f640 / io_context_pool 2024-09-12T00:38:13.100 INFO:tasks.workunit.client.0.smithi043.stderr: 7f16f1c979c0 / radosgw-admin 2024-09-12T00:38:13.100 INFO:tasks.workunit.client.0.smithi043.stderr: max_recent 500 2024-09-12T00:38:13.100 INFO:tasks.workunit.client.0.smithi043.stderr: max_new 1000 2024-09-12T00:38:13.100 INFO:tasks.workunit.client.0.smithi043.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:38:12.942005Z_f28e0cdc-658a-474d-b0dd-e36ac4b5bdba/log 2024-09-12T00:38:13.100 INFO:tasks.workunit.client.0.smithi043.stderr:--- end dump of recent events --- 2024-09-12T00:38:13.100 INFO:tasks.workunit.client.0.smithi043.stderr:Aborted 2024-09-12T00:38:13.100 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:38:13.106 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:13.106 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:13.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.033+0000 7f0ccc81d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.033+0000 7f0ccc81d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.033+0000 7f0ccc81d9c0 20 realm 2024-09-12T00:38:13.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.033+0000 7f0ccc81d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.037+0000 7f0ccc81d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.037+0000 7f0ccc81d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:13.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.037+0000 7f0ccc81d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.037+0000 7f0ccc81d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.037+0000 7f0ccc81d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.037+0000 7f0ccc81d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:13.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.037+0000 7f0ccc81d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.037+0000 7f0ccc81d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:13.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.037+0000 7f0ccc81d9c0 20 searching for the correct realm 2024-09-12T00:38:13.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.041+0000 7f0cca323640 0 -- 172.21.15.43:0/2552798662 >> [v2:172.21.15.97:6816/489545787,v1:172.21.15.97:6817/489545787] conn(0x7f0cc40b1040 msgr2=0x7f0cc40fd880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:13.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.045+0000 7f0cca323640 0 -- 172.21.15.43:0/2552798662 >> [v2:172.21.15.97:6816/489545787,v1:172.21.15.97:6817/489545787] conn(0x7f0b94080b80 msgr2=0x7f0b94082fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:13.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.057+0000 7f0ccc81d9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:38:13.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.057+0000 7f0ccc81d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:13.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.057+0000 7f0ccc81d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:13.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.057+0000 7f0ccc81d9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:38:13.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.057+0000 7f0ccc81d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:13.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.057+0000 7f0ccc81d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:13.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.057+0000 7f0ccc81d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.057+0000 7f0ccc81d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.057+0000 7f0ccc81d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.061+0000 7f0ccc81d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:13.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.061+0000 7f0ccc81d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.061+0000 7f0ccc81d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:13.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.061+0000 7f0ccc81d9c0 20 zone default found 2024-09-12T00:38:13.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.061+0000 7f0ccc81d9c0 4 Realm: () 2024-09-12T00:38:13.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.061+0000 7f0ccc81d9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:38:13.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.061+0000 7f0ccc81d9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:38:13.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.061+0000 7f0ccc81d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:13.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.061+0000 7f0ccc81d9c0 20 zonegroup default 2024-09-12T00:38:13.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.061+0000 7f0ccc81d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.061+0000 7f0ccc81d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.061+0000 7f0ccc81d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.061+0000 7f0ccc81d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.061+0000 7f0ccc81d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.061+0000 7f0ccc81d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.061+0000 7f0ccc81d9c0 20 started sync module instance, tier type = 2024-09-12T00:38:13.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.061+0000 7f0ccc81d9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:38:13.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.077+0000 7f0ccc81d9c0 20 add_watcher() i=0 2024-09-12T00:38:13.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.077+0000 7f0ccc81d9c0 20 add_watcher() i=1 2024-09-12T00:38:13.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.077+0000 7f0ccc81d9c0 20 add_watcher() i=2 2024-09-12T00:38:13.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.077+0000 7f0ccc81d9c0 20 add_watcher() i=3 2024-09-12T00:38:13.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.077+0000 7f0ccc81d9c0 20 add_watcher() i=4 2024-09-12T00:38:13.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.077+0000 7f0ccc81d9c0 20 add_watcher() i=5 2024-09-12T00:38:13.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.077+0000 7f0ccc81d9c0 20 add_watcher() i=6 2024-09-12T00:38:13.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.077+0000 7f0ccc81d9c0 20 add_watcher() i=7 2024-09-12T00:38:13.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.077+0000 7f0ccc81d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:13.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.081+0000 7f0b80fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:13.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.081+0000 7f0ccc81d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:13.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.081+0000 7f0ccc81d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:13.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.081+0000 7f0ccc81d9c0 5 note: GC not initialized 2024-09-12T00:38:13.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.081+0000 7f0afb7fe640 20 reqs_thread_entry: start 2024-09-12T00:38:13.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.081+0000 7f0ccc81d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:13.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.081+0000 7f0ccc81d9c0 20 Filter name: none 2024-09-12T00:38:13.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.081+0000 7f0af97fa640 20 reqs_thread_entry: start 2024-09-12T00:38:13.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.081+0000 7f0ccc81d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.081+0000 7f0ccc81d9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:38:13.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.081+0000 7f0ccc81d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.085+0000 7f0ccc81d9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:38:13.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.085+0000 7f0ccc81d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:13.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.085+0000 7f0ccc81d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.085+0000 7f0ccc81d9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:38:13.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.085+0000 7f0ccc81d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.085+0000 7f0ccc81d9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:38:13.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.085+0000 7f0ccc81d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:13.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.089+0000 7f0b80fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:13.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.093+0000 7f0ccc81d9c0 20 remove_watcher() i=0 2024-09-12T00:38:13.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.093+0000 7f0ccc81d9c0 2 removed watcher, disabling cache 2024-09-12T00:38:13.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.093+0000 7f0ccc81d9c0 20 remove_watcher() i=1 2024-09-12T00:38:13.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.097+0000 7f0ccc81d9c0 20 remove_watcher() i=2 2024-09-12T00:38:13.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.097+0000 7f0ccc81d9c0 20 remove_watcher() i=3 2024-09-12T00:38:13.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.101+0000 7f0ccc81d9c0 20 remove_watcher() i=4 2024-09-12T00:38:13.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.101+0000 7f0ccc81d9c0 20 remove_watcher() i=5 2024-09-12T00:38:13.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.105+0000 7f0ccc81d9c0 20 remove_watcher() i=6 2024-09-12T00:38:13.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.105+0000 7f0ccc81d9c0 20 remove_watcher() i=7 2024-09-12T00:38:13.120 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:13.120 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:38:13.120 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: abort-at-block-writes id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:38:13.121 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:13.121 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:13.122 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:13.134 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:13.134 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:13.178 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:38:13.212 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:13.212 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:13.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.253+0000 7ff4753f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.257+0000 7ff4753f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.257+0000 7ff4753f99c0 20 realm 2024-09-12T00:38:13.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.257+0000 7ff4753f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.257+0000 7ff4753f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.257+0000 7ff4753f99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:13.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.257+0000 7ff4753f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.257+0000 7ff4753f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.257+0000 7ff4753f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.257+0000 7ff4753f99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:13.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.257+0000 7ff4753f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.261+0000 7ff4753f99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:13.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.261+0000 7ff4753f99c0 20 searching for the correct realm 2024-09-12T00:38:13.268 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.265+0000 7ff4726fe640 0 -- 172.21.15.43:0/2962754667 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7ff468031070 msgr2=0x7ff46806ebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:13.274 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.273+0000 7ff4726fe640 0 -- 172.21.15.43:0/2962754667 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7ff33c080bb0 msgr2=0x7ff33c082fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:13.281 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.281+0000 7ff4753f99c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:38:13.281 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.281+0000 7ff4753f99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:13.282 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.281+0000 7ff4753f99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:13.282 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.281+0000 7ff4753f99c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:38:13.282 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.281+0000 7ff4753f99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:13.282 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.281+0000 7ff4753f99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:13.282 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.281+0000 7ff4753f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.282 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.281+0000 7ff4753f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.282 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.281+0000 7ff4753f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.283 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.281+0000 7ff4753f99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:13.283 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.281+0000 7ff4753f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.283 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.281+0000 7ff4753f99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:13.283 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.281+0000 7ff4753f99c0 20 zone default found 2024-09-12T00:38:13.283 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.281+0000 7ff4753f99c0 4 Realm: () 2024-09-12T00:38:13.283 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.281+0000 7ff4753f99c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:38:13.283 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.281+0000 7ff4753f99c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:38:13.283 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.281+0000 7ff4753f99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:13.283 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.281+0000 7ff4753f99c0 20 zonegroup default 2024-09-12T00:38:13.283 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.281+0000 7ff4753f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.284 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.281+0000 7ff4753f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.284 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.281+0000 7ff4753f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.284 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.281+0000 7ff4753f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.284 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.281+0000 7ff4753f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.285 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.281+0000 7ff4753f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.285 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.281+0000 7ff4753f99c0 20 started sync module instance, tier type = 2024-09-12T00:38:13.285 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.281+0000 7ff4753f99c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:38:13.300 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.297+0000 7ff4753f99c0 20 add_watcher() i=0 2024-09-12T00:38:13.300 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.297+0000 7ff4753f99c0 20 add_watcher() i=1 2024-09-12T00:38:13.300 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.297+0000 7ff4753f99c0 20 add_watcher() i=2 2024-09-12T00:38:13.300 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.297+0000 7ff4753f99c0 20 add_watcher() i=3 2024-09-12T00:38:13.300 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.297+0000 7ff4753f99c0 20 add_watcher() i=4 2024-09-12T00:38:13.300 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.297+0000 7ff4753f99c0 20 add_watcher() i=5 2024-09-12T00:38:13.300 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.297+0000 7ff4753f99c0 20 add_watcher() i=6 2024-09-12T00:38:13.301 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.301+0000 7ff4753f99c0 20 add_watcher() i=7 2024-09-12T00:38:13.301 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.301+0000 7ff4753f99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:13.304 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.301+0000 7ff329fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:13.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.301+0000 7ff4753f99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:13.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.301+0000 7ff4753f99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:13.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.301+0000 7ff4753f99c0 5 note: GC not initialized 2024-09-12T00:38:13.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.301+0000 7ff328fe1640 20 reqs_thread_entry: start 2024-09-12T00:38:13.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.301+0000 7ff4753f99c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:13.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.301+0000 7ff4753f99c0 20 Filter name: none 2024-09-12T00:38:13.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.301+0000 7ff321ffb640 20 reqs_thread_entry: start 2024-09-12T00:38:13.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.305+0000 7ff4753f99c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:38:13.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.305+0000 7ff4753f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.305+0000 7ff4753f99c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:38:13.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.305+0000 7ff4753f99c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:38:13.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.305+0000 7ff4753f99c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:38:13.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.305+0000 7ff4753f99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 : miss 2024-09-12T00:38:13.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.305+0000 7ff4753f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.305+0000 7ff4753f99c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:38:13.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.305+0000 7ff4753f99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 info.flags=0x17 2024-09-12T00:38:13.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.305+0000 7ff4753f99c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 to cache LRU end 2024-09-12T00:38:13.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.305+0000 7ff4753f99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:13.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.305+0000 7ff4753f99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:13.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.305+0000 7ff4753f99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 2024-09-12T00:38:13.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.305+0000 7ff4753f99c0 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 to be held by another RGW process; skipping for now 2024-09-12T00:38:13.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.309+0000 7ff329fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:13.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.313+0000 7ff4753f99c0 20 remove_watcher() i=0 2024-09-12T00:38:13.314 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.313+0000 7ff4753f99c0 2 removed watcher, disabling cache 2024-09-12T00:38:13.316 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.313+0000 7ff4753f99c0 20 remove_watcher() i=1 2024-09-12T00:38:13.319 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.317+0000 7ff4753f99c0 20 remove_watcher() i=2 2024-09-12T00:38:13.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.321+0000 7ff4753f99c0 20 remove_watcher() i=3 2024-09-12T00:38:13.323 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.321+0000 7ff4753f99c0 20 remove_watcher() i=4 2024-09-12T00:38:13.324 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.321+0000 7ff4753f99c0 20 remove_watcher() i=5 2024-09-12T00:38:13.325 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.325+0000 7ff4753f99c0 20 remove_watcher() i=6 2024-09-12T00:38:13.326 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:13.325+0000 7ff4753f99c0 20 remove_watcher() i=7 2024-09-12T00:38:13.340 INFO:tasks.workunit.client.0.smithi043.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:38:43.372 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:38:43.410 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:43.410 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:43.456 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.453+0000 7fbf812049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:43.458 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.457+0000 7fbf812049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:43.458 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.457+0000 7fbf812049c0 20 realm 2024-09-12T00:38:43.458 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.457+0000 7fbf812049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:43.458 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.457+0000 7fbf812049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:43.458 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.457+0000 7fbf812049c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:43.458 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.457+0000 7fbf812049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:43.458 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.457+0000 7fbf812049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:43.458 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.457+0000 7fbf812049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:43.460 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.457+0000 7fbf812049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:43.460 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.457+0000 7fbf812049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:43.461 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.461+0000 7fbf812049c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:43.461 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.461+0000 7fbf812049c0 20 searching for the correct realm 2024-09-12T00:38:43.467 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.465+0000 7fbf7f50b640 0 -- 172.21.15.43:0/2251948154 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55cfabb41940 msgr2=0x55cfabb43e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:43.473 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.469+0000 7fbf7ed0a640 0 -- 172.21.15.43:0/2251948154 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fbf74049460 msgr2=0x7fbf740498e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:43.481 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.481+0000 7fbf812049c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:38:43.481 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.481+0000 7fbf812049c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:43.481 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.481+0000 7fbf812049c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:43.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.481+0000 7fbf812049c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:38:43.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.481+0000 7fbf812049c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:43.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.481+0000 7fbf812049c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:43.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.481+0000 7fbf812049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:43.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.481+0000 7fbf812049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:43.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.481+0000 7fbf812049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:43.483 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.481+0000 7fbf812049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:43.483 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.481+0000 7fbf812049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:43.483 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.481+0000 7fbf812049c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:43.484 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.481+0000 7fbf812049c0 20 zone default found 2024-09-12T00:38:43.484 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.481+0000 7fbf812049c0 4 Realm: () 2024-09-12T00:38:43.484 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.481+0000 7fbf812049c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:38:43.484 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.481+0000 7fbf812049c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:38:43.484 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.481+0000 7fbf812049c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:43.484 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.481+0000 7fbf812049c0 20 zonegroup default 2024-09-12T00:38:43.484 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.481+0000 7fbf812049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:43.484 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.481+0000 7fbf812049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:43.484 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.481+0000 7fbf812049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:43.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.481+0000 7fbf812049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:43.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.481+0000 7fbf812049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:43.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.481+0000 7fbf812049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:43.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.481+0000 7fbf812049c0 20 started sync module instance, tier type = 2024-09-12T00:38:43.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.481+0000 7fbf812049c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:38:43.499 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.497+0000 7fbf812049c0 20 add_watcher() i=0 2024-09-12T00:38:43.499 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.497+0000 7fbf812049c0 20 add_watcher() i=1 2024-09-12T00:38:43.499 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.497+0000 7fbf812049c0 20 add_watcher() i=2 2024-09-12T00:38:43.499 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.497+0000 7fbf812049c0 20 add_watcher() i=3 2024-09-12T00:38:43.500 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.497+0000 7fbf812049c0 20 add_watcher() i=4 2024-09-12T00:38:43.500 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.497+0000 7fbf812049c0 20 add_watcher() i=5 2024-09-12T00:38:43.500 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.497+0000 7fbf812049c0 20 add_watcher() i=6 2024-09-12T00:38:43.500 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.497+0000 7fbf812049c0 20 add_watcher() i=7 2024-09-12T00:38:43.500 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.497+0000 7fbf812049c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:43.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.501+0000 7fbe35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:43.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.501+0000 7fbf812049c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:43.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.501+0000 7fbf812049c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:43.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.501+0000 7fbf812049c0 5 note: GC not initialized 2024-09-12T00:38:43.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.501+0000 7fbe34fe1640 20 reqs_thread_entry: start 2024-09-12T00:38:43.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.501+0000 7fbf812049c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:43.505 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.501+0000 7fbf812049c0 20 Filter name: none 2024-09-12T00:38:43.505 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.501+0000 7fbe2dffb640 20 reqs_thread_entry: start 2024-09-12T00:38:43.505 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.501+0000 7fbf812049c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:38:43.505 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.501+0000 7fbf812049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:43.505 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.501+0000 7fbf812049c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:38:43.505 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.501+0000 7fbf812049c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:38:43.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.501+0000 7fbf812049c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:38:43.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.501+0000 7fbf812049c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 : miss 2024-09-12T00:38:43.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.501+0000 7fbf812049c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:43.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.505+0000 7fbf812049c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:38:43.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.505+0000 7fbf812049c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 info.flags=0x17 2024-09-12T00:38:43.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.505+0000 7fbf812049c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 to cache LRU end 2024-09-12T00:38:43.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.505+0000 7fbf812049c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:43.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.505+0000 7fbf812049c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:43.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.505+0000 7fbf812049c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 2024-09-12T00:38:43.507 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.505+0000 7fbf812049c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:38:43.520 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.517+0000 7fbf812049c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 info.flags=0x17 2024-09-12T00:38:43.520 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.517+0000 7fbf812049c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 to cache LRU end 2024-09-12T00:38:43.520 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.517+0000 7fbf812049c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:43.520 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.517+0000 7fbf812049c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29, ofs0, ns] 2024-09-12T00:38:43.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.517+0000 7fbe61ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333528 cookie 94350427304048 notifier 6773 bl.length()=915 2024-09-12T00:38:43.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.517+0000 7fbe61ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 info.flags=0x17 2024-09-12T00:38:43.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.517+0000 7fbe61ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 to cache LRU end 2024-09-12T00:38:43.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.517+0000 7fbe61ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:43.522 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.521+0000 7fbf812049c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): orig_sources= new_sources= 2024-09-12T00:38:43.522 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.521+0000 7fbf812049c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): potential sources added=[] removed=[] 2024-09-12T00:38:43.522 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.521+0000 7fbf812049c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): orig_dests= new_dests= 2024-09-12T00:38:43.522 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.521+0000 7fbf812049c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): potential dests added=[] removed=[] 2024-09-12T00:38:43.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.529+0000 7fbf812049c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.2.0 2024-09-12T00:38:43.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.529+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.2.0 2024-09-12T00:38:43.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.529+0000 7fbf812049c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.2.1 2024-09-12T00:38:43.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.529+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.2.1 2024-09-12T00:38:43.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.529+0000 7fbf812049c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.2.2 2024-09-12T00:38:43.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.529+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.2.2 2024-09-12T00:38:43.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.529+0000 7fbf812049c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.2.3 2024-09-12T00:38:43.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.529+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.2.3 2024-09-12T00:38:43.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.529+0000 7fbf812049c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.2.4 2024-09-12T00:38:43.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.529+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.2.4 2024-09-12T00:38:43.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.529+0000 7fbf812049c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.2.5 2024-09-12T00:38:43.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.529+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.2.5 2024-09-12T00:38:43.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.529+0000 7fbf812049c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.2.6 2024-09-12T00:38:43.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.529+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.2.6 2024-09-12T00:38:43.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.529+0000 7fbf812049c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.2.7 2024-09-12T00:38:43.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.529+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.2.7 2024-09-12T00:38:43.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.529+0000 7fbf812049c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.2.8 2024-09-12T00:38:43.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.529+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.2.8 2024-09-12T00:38:43.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.529+0000 7fbf812049c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.2.9 2024-09-12T00:38:43.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.529+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.2.9 2024-09-12T00:38:43.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.529+0000 7fbf812049c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.2.10 2024-09-12T00:38:43.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.529+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.2.10 2024-09-12T00:38:43.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.529+0000 7fbf812049c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.2.11 2024-09-12T00:38:43.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.529+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.2.11 2024-09-12T00:38:43.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.529+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.0 2024-09-12T00:38:43.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.533+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1 2024-09-12T00:38:43.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.533+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.2 2024-09-12T00:38:43.536 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.533+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.3 2024-09-12T00:38:43.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.537+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.4 2024-09-12T00:38:43.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.537+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.5 2024-09-12T00:38:43.539 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.537+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.6 2024-09-12T00:38:43.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.537+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.7 2024-09-12T00:38:43.541 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.541+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.8 2024-09-12T00:38:43.542 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.541+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.9 2024-09-12T00:38:43.542 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.541+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.10 2024-09-12T00:38:43.548 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.545+0000 7fbf812049c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:43.548 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.545+0000 7fbf812049c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 2024-09-12T00:38:43.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.549+0000 7fbf812049c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 info.flags=0x17 2024-09-12T00:38:43.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.549+0000 7fbf812049c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 to cache LRU end 2024-09-12T00:38:43.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.549+0000 7fbf812049c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:43.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.549+0000 7fbf812049c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29, ofs0, ns] 2024-09-12T00:38:43.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.549+0000 7fbe627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333529 cookie 94350427304048 notifier 6773 bl.length()=915 2024-09-12T00:38:43.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.549+0000 7fbe627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 info.flags=0x17 2024-09-12T00:38:43.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.549+0000 7fbe627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 to cache LRU end 2024-09-12T00:38:43.551 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.549+0000 7fbe627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:43.551 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.549+0000 7fbf812049c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): orig_sources= new_sources= 2024-09-12T00:38:43.551 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.549+0000 7fbf812049c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): potential sources added=[] removed=[] 2024-09-12T00:38:43.551 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.549+0000 7fbf812049c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): orig_dests= new_dests= 2024-09-12T00:38:43.552 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.549+0000 7fbf812049c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): potential dests added=[] removed=[] 2024-09-12T00:38:43.556 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.553+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.0 2024-09-12T00:38:43.556 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.553+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.1 2024-09-12T00:38:43.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.557+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.2 2024-09-12T00:38:43.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.557+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.3 2024-09-12T00:38:43.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.557+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.4 2024-09-12T00:38:43.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.557+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.5 2024-09-12T00:38:43.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.557+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.6 2024-09-12T00:38:43.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.557+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.7 2024-09-12T00:38:43.561 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.561+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.8 2024-09-12T00:38:43.562 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.561+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.9 2024-09-12T00:38:43.562 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.561+0000 7fbf812049c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29.10 2024-09-12T00:38:43.562 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.561+0000 7fbf812049c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:43.563 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.561+0000 7fbf812049c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 2024-09-12T00:38:43.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.561+0000 7fbf812049c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 info.flags=0x17 2024-09-12T00:38:43.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.561+0000 7fbf812049c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 to cache LRU end 2024-09-12T00:38:43.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.561+0000 7fbf812049c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:43.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.561+0000 7fbf812049c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29, ofs0, ns] 2024-09-12T00:38:43.565 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.565+0000 7fbe627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333530 cookie 94350427304048 notifier 6773 bl.length()=883 2024-09-12T00:38:43.565 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.565+0000 7fbe627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 info.flags=0x17 2024-09-12T00:38:43.565 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.565+0000 7fbe627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 to cache LRU end 2024-09-12T00:38:43.565 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.565+0000 7fbe627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:43.566 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.565+0000 7fbf812049c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): orig_sources= new_sources= 2024-09-12T00:38:43.566 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.565+0000 7fbf812049c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): potential sources added=[] removed=[] 2024-09-12T00:38:43.566 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.565+0000 7fbf812049c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): orig_dests= new_dests= 2024-09-12T00:38:43.566 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.565+0000 7fbf812049c0 20 handle_bi_update(): bucket=:abort-at-block-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29]): potential dests added=[] removed=[] 2024-09-12T00:38:43.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.569+0000 7fbf812049c0 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-12T00:38:43.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.573+0000 7fbe35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:43.579 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.577+0000 7fbf812049c0 20 remove_watcher() i=0 2024-09-12T00:38:43.579 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.577+0000 7fbf812049c0 2 removed watcher, disabling cache 2024-09-12T00:38:43.581 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.577+0000 7fbf812049c0 20 remove_watcher() i=1 2024-09-12T00:38:43.583 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.581+0000 7fbf812049c0 20 remove_watcher() i=2 2024-09-12T00:38:43.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.585+0000 7fbf812049c0 20 remove_watcher() i=3 2024-09-12T00:38:43.587 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.585+0000 7fbf812049c0 20 remove_watcher() i=4 2024-09-12T00:38:43.589 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.585+0000 7fbf812049c0 20 remove_watcher() i=5 2024-09-12T00:38:43.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.589+0000 7fbf812049c0 20 remove_watcher() i=6 2024-09-12T00:38:43.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.589+0000 7fbf812049c0 20 remove_watcher() i=7 2024-09-12T00:38:43.606 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:38:43.636 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:43.636 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:43.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.677+0000 7f272a3c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:43.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.681+0000 7f272a3c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:43.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.681+0000 7f272a3c49c0 20 realm 2024-09-12T00:38:43.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.681+0000 7f272a3c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:43.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.681+0000 7f272a3c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:43.682 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.681+0000 7f272a3c49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:43.682 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.681+0000 7f272a3c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:43.682 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.681+0000 7f272a3c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:43.682 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.681+0000 7f272a3c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:43.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.681+0000 7f272a3c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:43.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.681+0000 7f272a3c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:43.684 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.681+0000 7f272a3c49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:43.684 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.681+0000 7f272a3c49c0 20 searching for the correct realm 2024-09-12T00:38:43.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.689+0000 7f271ffff640 0 -- 172.21.15.43:0/883782073 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55a441672a50 msgr2=0x55a441674ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:43.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.697+0000 7f271ffff640 0 -- 172.21.15.43:0/883782073 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x7f25f0080b80 msgr2=0x7f25f0082fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:43.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.701+0000 7f272a3c49c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:38:43.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.701+0000 7f272a3c49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:43.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.701+0000 7f272a3c49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:43.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.701+0000 7f272a3c49c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:38:43.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.701+0000 7f272a3c49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:43.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.701+0000 7f272a3c49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:43.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.701+0000 7f272a3c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:43.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.701+0000 7f272a3c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:43.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.701+0000 7f272a3c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:43.706 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.705+0000 7f272a3c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:43.706 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.705+0000 7f272a3c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:43.706 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.705+0000 7f272a3c49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:43.706 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.705+0000 7f272a3c49c0 20 zone default found 2024-09-12T00:38:43.706 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.705+0000 7f272a3c49c0 4 Realm: () 2024-09-12T00:38:43.706 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.705+0000 7f272a3c49c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:38:43.706 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.705+0000 7f272a3c49c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:38:43.706 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.705+0000 7f272a3c49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:43.706 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.705+0000 7f272a3c49c0 20 zonegroup default 2024-09-12T00:38:43.706 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.705+0000 7f272a3c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:43.706 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.705+0000 7f272a3c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:43.706 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.705+0000 7f272a3c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:43.707 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.705+0000 7f272a3c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:43.707 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.705+0000 7f272a3c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:43.707 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.705+0000 7f272a3c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:43.707 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.705+0000 7f272a3c49c0 20 started sync module instance, tier type = 2024-09-12T00:38:43.707 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.705+0000 7f272a3c49c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:38:43.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.721+0000 7f272a3c49c0 20 add_watcher() i=0 2024-09-12T00:38:43.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.721+0000 7f272a3c49c0 20 add_watcher() i=1 2024-09-12T00:38:43.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.721+0000 7f272a3c49c0 20 add_watcher() i=2 2024-09-12T00:38:43.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.721+0000 7f272a3c49c0 20 add_watcher() i=3 2024-09-12T00:38:43.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.721+0000 7f272a3c49c0 20 add_watcher() i=4 2024-09-12T00:38:43.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.721+0000 7f272a3c49c0 20 add_watcher() i=5 2024-09-12T00:38:43.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.721+0000 7f272a3c49c0 20 add_watcher() i=6 2024-09-12T00:38:43.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.721+0000 7f272a3c49c0 20 add_watcher() i=7 2024-09-12T00:38:43.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.721+0000 7f272a3c49c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:43.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.725+0000 7f25ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:43.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.725+0000 7f272a3c49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:43.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.725+0000 7f272a3c49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:43.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.725+0000 7f272a3c49c0 5 note: GC not initialized 2024-09-12T00:38:43.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.725+0000 7f25dcfe1640 20 reqs_thread_entry: start 2024-09-12T00:38:43.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.725+0000 7f272a3c49c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:43.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.725+0000 7f272a3c49c0 20 Filter name: none 2024-09-12T00:38:43.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.725+0000 7f25567fc640 20 reqs_thread_entry: start 2024-09-12T00:38:43.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.725+0000 7f272a3c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:43.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.725+0000 7f272a3c49c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:38:43.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.725+0000 7f272a3c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:43.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.725+0000 7f272a3c49c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:38:43.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.725+0000 7f272a3c49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:43.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.725+0000 7f272a3c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:43.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.725+0000 7f272a3c49c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:38:43.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.725+0000 7f272a3c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:43.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.729+0000 7f272a3c49c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:38:43.730 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.729+0000 7f272a3c49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:43.732 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.729+0000 7f25ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:43.737 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.737+0000 7f272a3c49c0 20 remove_watcher() i=0 2024-09-12T00:38:43.737 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.737+0000 7f272a3c49c0 2 removed watcher, disabling cache 2024-09-12T00:38:43.739 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.737+0000 7f272a3c49c0 20 remove_watcher() i=1 2024-09-12T00:38:43.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.741+0000 7f272a3c49c0 20 remove_watcher() i=2 2024-09-12T00:38:43.743 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.741+0000 7f272a3c49c0 20 remove_watcher() i=3 2024-09-12T00:38:43.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.745+0000 7f272a3c49c0 20 remove_watcher() i=4 2024-09-12T00:38:43.747 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.745+0000 7f272a3c49c0 20 remove_watcher() i=5 2024-09-12T00:38:43.748 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.745+0000 7f272a3c49c0 20 remove_watcher() i=6 2024-09-12T00:38:43.749 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:43.749+0000 7f272a3c49c0 20 remove_watcher() i=7 2024-09-12T00:38:43.763 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:43.763 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:38:43.763 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: abort-at-block-writes id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:38:43.763 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:43.764 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:43.764 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:43.767 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:43.767 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:43.811 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:43.811 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:43.855 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-12T00:38:43.855 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:43.856 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:43.856 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:43.878 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:43.878 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:43.925 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:43.925 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:43.944 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:43.944 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:43.962 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:43.962 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:43.981 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:43.982 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:44.000 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:44.000 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:44.020 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:44.020 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:44.038 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:44.038 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:44.056 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:44.056 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:44.075 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:44.075 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:44.096 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:44.096 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:44.115 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:44.116 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:44.137 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:44.137 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:44.157 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:44.157 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:44.177 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:44.177 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:44.198 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:44.198 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:44.219 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:44.219 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:44.239 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:44.239 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:44.258 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:44.258 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:44.278 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:44.278 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:44.297 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:44.298 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:44.315 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:38:44.349 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:44.349 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:44.395 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.393+0000 7ff48f8ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:44.397 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.393+0000 7ff48f8ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:44.397 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.393+0000 7ff48f8ff9c0 20 realm 2024-09-12T00:38:44.397 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.393+0000 7ff48f8ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:44.397 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.397+0000 7ff48f8ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:44.397 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.397+0000 7ff48f8ff9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:44.397 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.397+0000 7ff48f8ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:44.397 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.397+0000 7ff48f8ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:44.397 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.397+0000 7ff48f8ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:44.399 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.397+0000 7ff48f8ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:44.399 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.397+0000 7ff48f8ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:44.400 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.397+0000 7ff48f8ff9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:44.400 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.397+0000 7ff48f8ff9c0 20 searching for the correct realm 2024-09-12T00:38:44.407 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.405+0000 7ff48dc06640 0 -- 172.21.15.43:0/1585260887 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7ff47810e2c0 msgr2=0x7ff4781189f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:44.624 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.621+0000 7ff48d405640 0 -- 172.21.15.43:0/1585260887 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x561c40e2c8c0 msgr2=0x561c40e2ed80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:44.632 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.629+0000 7ff48f8ff9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:38:44.632 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.629+0000 7ff48f8ff9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:44.632 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.629+0000 7ff48f8ff9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:44.632 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.629+0000 7ff48f8ff9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:38:44.632 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.629+0000 7ff48f8ff9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:44.632 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.629+0000 7ff48f8ff9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:44.632 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.629+0000 7ff48f8ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:44.632 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.629+0000 7ff48f8ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:44.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.629+0000 7ff48f8ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:44.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.633+0000 7ff48f8ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:44.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.633+0000 7ff48f8ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:44.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.633+0000 7ff48f8ff9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:44.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.633+0000 7ff48f8ff9c0 20 zone default found 2024-09-12T00:38:44.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.633+0000 7ff48f8ff9c0 4 Realm: () 2024-09-12T00:38:44.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.633+0000 7ff48f8ff9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:38:44.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.633+0000 7ff48f8ff9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:38:44.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.633+0000 7ff48f8ff9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:44.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.633+0000 7ff48f8ff9c0 20 zonegroup default 2024-09-12T00:38:44.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.633+0000 7ff48f8ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:44.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.633+0000 7ff48f8ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:44.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.633+0000 7ff48f8ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:44.636 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.633+0000 7ff48f8ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:44.636 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.633+0000 7ff48f8ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:44.636 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.633+0000 7ff48f8ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:44.636 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.633+0000 7ff48f8ff9c0 20 started sync module instance, tier type = 2024-09-12T00:38:44.636 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.633+0000 7ff48f8ff9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:38:44.658 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.657+0000 7ff48f8ff9c0 20 add_watcher() i=0 2024-09-12T00:38:44.658 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.657+0000 7ff48f8ff9c0 20 add_watcher() i=1 2024-09-12T00:38:44.659 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.657+0000 7ff48f8ff9c0 20 add_watcher() i=2 2024-09-12T00:38:44.659 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.657+0000 7ff48f8ff9c0 20 add_watcher() i=3 2024-09-12T00:38:44.659 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.657+0000 7ff48f8ff9c0 20 add_watcher() i=4 2024-09-12T00:38:44.659 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.657+0000 7ff48f8ff9c0 20 add_watcher() i=5 2024-09-12T00:38:44.659 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.657+0000 7ff48f8ff9c0 20 add_watcher() i=6 2024-09-12T00:38:44.660 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.657+0000 7ff48f8ff9c0 20 add_watcher() i=7 2024-09-12T00:38:44.661 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.657+0000 7ff48f8ff9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:44.664 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.661+0000 7ff3437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:44.665 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.665+0000 7ff48f8ff9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:44.665 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.665+0000 7ff48f8ff9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:44.665 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.665+0000 7ff48f8ff9c0 5 note: GC not initialized 2024-09-12T00:38:44.666 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.665+0000 7ff3427e4640 20 reqs_thread_entry: start 2024-09-12T00:38:44.666 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.665+0000 7ff48f8ff9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:44.666 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.665+0000 7ff48f8ff9c0 20 Filter name: none 2024-09-12T00:38:44.666 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.665+0000 7ff2b3fff640 20 reqs_thread_entry: start 2024-09-12T00:38:44.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.665+0000 7ff48f8ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:44.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.665+0000 7ff48f8ff9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:44.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.665+0000 7ff48f8ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:44.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.669+0000 7ff48f8ff9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:44.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.669+0000 7ff48f8ff9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:44.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.669+0000 7ff48f8ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:44.671 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.669+0000 7ff48f8ff9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:44.671 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.669+0000 7ff48f8ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:44.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.669+0000 7ff48f8ff9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:44.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.669+0000 7ff48f8ff9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:44.676 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.673+0000 7ff3437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:44.682 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.681+0000 7ff48f8ff9c0 20 remove_watcher() i=0 2024-09-12T00:38:44.682 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.681+0000 7ff48f8ff9c0 2 removed watcher, disabling cache 2024-09-12T00:38:44.685 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.685+0000 7ff48f8ff9c0 20 remove_watcher() i=1 2024-09-12T00:38:44.687 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.685+0000 7ff48f8ff9c0 20 remove_watcher() i=2 2024-09-12T00:38:44.689 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.689+0000 7ff48f8ff9c0 20 remove_watcher() i=3 2024-09-12T00:38:44.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.689+0000 7ff48f8ff9c0 20 remove_watcher() i=4 2024-09-12T00:38:44.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.693+0000 7ff48f8ff9c0 20 remove_watcher() i=5 2024-09-12T00:38:44.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.693+0000 7ff48f8ff9c0 20 remove_watcher() i=6 2024-09-12T00:38:44.696 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.693+0000 7ff48f8ff9c0 20 remove_watcher() i=7 2024-09-12T00:38:44.713 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:44.713 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:38:44.713 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-commit-target-layout id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:38:44.713 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:44.713 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-12T00:38:44.753 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:44.753 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:44.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.797+0000 7f137e6a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:44.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.797+0000 7f137e6a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:44.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.797+0000 7f137e6a99c0 20 realm 2024-09-12T00:38:44.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.797+0000 7f137e6a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:44.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.797+0000 7f137e6a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:44.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.797+0000 7f137e6a99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:44.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.797+0000 7f137e6a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:44.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.797+0000 7f137e6a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:44.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.797+0000 7f137e6a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:44.801 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.801+0000 7f137e6a99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:44.802 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.801+0000 7f137e6a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:44.802 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.801+0000 7f137e6a99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:44.803 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.801+0000 7f137e6a99c0 20 searching for the correct realm 2024-09-12T00:38:44.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.805+0000 7f137c1af640 0 -- 172.21.15.43:0/602012476 >> [v2:172.21.15.97:6816/489545787,v1:172.21.15.97:6817/489545787] conn(0x7f137404a040 msgr2=0x7f137405c5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:44.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:44.813+0000 7f137c1af640 0 -- 172.21.15.43:0/602012476 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f13701311b0 msgr2=0x7f13700ff3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:45.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.033+0000 7f137e6a99c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:38:45.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.033+0000 7f137e6a99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:45.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.033+0000 7f137e6a99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:45.033 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.033+0000 7f137e6a99c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:38:45.034 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.033+0000 7f137e6a99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:45.034 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.033+0000 7f137e6a99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:45.034 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.033+0000 7f137e6a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.034 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.033+0000 7f137e6a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:45.034 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.033+0000 7f137e6a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.035 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.033+0000 7f137e6a99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:45.035 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.033+0000 7f137e6a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.033+0000 7f137e6a99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:45.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.033+0000 7f137e6a99c0 20 zone default found 2024-09-12T00:38:45.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.033+0000 7f137e6a99c0 4 Realm: () 2024-09-12T00:38:45.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.033+0000 7f137e6a99c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:38:45.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.033+0000 7f137e6a99c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:38:45.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.033+0000 7f137e6a99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:45.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.033+0000 7f137e6a99c0 20 zonegroup default 2024-09-12T00:38:45.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.033+0000 7f137e6a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.037 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.033+0000 7f137e6a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:45.037 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.033+0000 7f137e6a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.037 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.037+0000 7f137e6a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:45.038 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.037+0000 7f137e6a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.038 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.037+0000 7f137e6a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:45.038 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.037+0000 7f137e6a99c0 20 started sync module instance, tier type = 2024-09-12T00:38:45.039 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.037+0000 7f137e6a99c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:38:45.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.061+0000 7f137e6a99c0 20 add_watcher() i=0 2024-09-12T00:38:45.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.061+0000 7f137e6a99c0 20 add_watcher() i=1 2024-09-12T00:38:45.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.061+0000 7f137e6a99c0 20 add_watcher() i=2 2024-09-12T00:38:45.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.061+0000 7f137e6a99c0 20 add_watcher() i=3 2024-09-12T00:38:45.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.061+0000 7f137e6a99c0 20 add_watcher() i=4 2024-09-12T00:38:45.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.061+0000 7f137e6a99c0 20 add_watcher() i=5 2024-09-12T00:38:45.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.061+0000 7f137e6a99c0 20 add_watcher() i=6 2024-09-12T00:38:45.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.065+0000 7f137e6a99c0 20 add_watcher() i=7 2024-09-12T00:38:45.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.065+0000 7f137e6a99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:45.071 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.069+0000 7f1232fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:45.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.069+0000 7f137e6a99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:45.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.069+0000 7f137e6a99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:45.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.069+0000 7f137e6a99c0 5 note: GC not initialized 2024-09-12T00:38:45.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.069+0000 7f1231fdb640 20 reqs_thread_entry: start 2024-09-12T00:38:45.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.069+0000 7f137e6a99c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:45.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.069+0000 7f137e6a99c0 20 Filter name: none 2024-09-12T00:38:45.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.073+0000 7f11a37fe640 20 reqs_thread_entry: start 2024-09-12T00:38:45.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.073+0000 7f137e6a99c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:38:45.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.073+0000 7f137e6a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.075 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.073+0000 7f137e6a99c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:45.075 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.073+0000 7f137e6a99c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:38:45.075 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.073+0000 7f137e6a99c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:38:45.075 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.073+0000 7f137e6a99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 : miss 2024-09-12T00:38:45.075 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.073+0000 7f137e6a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.076 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.073+0000 7f137e6a99c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:45.076 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.073+0000 7f137e6a99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 info.flags=0x17 2024-09-12T00:38:45.076 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.073+0000 7f137e6a99c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 to cache LRU end 2024-09-12T00:38:45.076 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.073+0000 7f137e6a99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:45.076 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.073+0000 7f137e6a99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:45.076 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.073+0000 7f137e6a99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 2024-09-12T00:38:45.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.085+0000 7f137e6a99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 info.flags=0x17 2024-09-12T00:38:45.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.085+0000 7f137e6a99c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 to cache LRU end 2024-09-12T00:38:45.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.085+0000 7f137e6a99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:45.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.085+0000 7f137e6a99c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30, ofs0, ns] 2024-09-12T00:38:45.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.085+0000 7f1252ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333482 cookie 94431149229392 notifier 6824 bl.length()=931 2024-09-12T00:38:45.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.085+0000 7f1252ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 info.flags=0x17 2024-09-12T00:38:45.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.085+0000 7f1252ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 to cache LRU end 2024-09-12T00:38:45.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.085+0000 7f1252ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:45.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.089+0000 7f137e6a99c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30]): orig_sources= new_sources= 2024-09-12T00:38:45.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.089+0000 7f137e6a99c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30]): potential sources added=[] removed=[] 2024-09-12T00:38:45.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.089+0000 7f137e6a99c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30]): orig_dests= new_dests= 2024-09-12T00:38:45.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.089+0000 7f137e6a99c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30]): potential dests added=[] removed=[] 2024-09-12T00:38:45.103 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.101+0000 7f137e6a99c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.1.0 2024-09-12T00:38:45.103 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.101+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.1.0 2024-09-12T00:38:45.103 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.101+0000 7f137e6a99c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.1.1 2024-09-12T00:38:45.103 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.101+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.1.1 2024-09-12T00:38:45.103 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.101+0000 7f137e6a99c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.1.2 2024-09-12T00:38:45.103 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.101+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.1.2 2024-09-12T00:38:45.103 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.101+0000 7f137e6a99c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.1.3 2024-09-12T00:38:45.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.101+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.1.3 2024-09-12T00:38:45.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.101+0000 7f137e6a99c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.1.4 2024-09-12T00:38:45.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.101+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.1.4 2024-09-12T00:38:45.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.101+0000 7f137e6a99c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.1.5 2024-09-12T00:38:45.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.101+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.1.5 2024-09-12T00:38:45.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.101+0000 7f137e6a99c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.1.6 2024-09-12T00:38:45.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.101+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.1.6 2024-09-12T00:38:45.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.101+0000 7f137e6a99c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.1.7 2024-09-12T00:38:45.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.101+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.1.7 2024-09-12T00:38:45.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.101+0000 7f137e6a99c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.1.8 2024-09-12T00:38:45.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.101+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.1.8 2024-09-12T00:38:45.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.101+0000 7f137e6a99c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.1.9 2024-09-12T00:38:45.105 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.101+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.1.9 2024-09-12T00:38:45.105 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.101+0000 7f137e6a99c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.1.10 2024-09-12T00:38:45.105 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.101+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.1.10 2024-09-12T00:38:45.105 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.101+0000 7f137e6a99c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.1.11 2024-09-12T00:38:45.105 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.101+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.1.11 2024-09-12T00:38:45.105 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.101+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.0 2024-09-12T00:38:45.105 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.101+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.1 2024-09-12T00:38:45.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.105+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.2 2024-09-12T00:38:45.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.105+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.3 2024-09-12T00:38:45.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.109+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.4 2024-09-12T00:38:45.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.109+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.5 2024-09-12T00:38:45.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.109+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.6 2024-09-12T00:38:45.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.109+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.7 2024-09-12T00:38:45.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.109+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.8 2024-09-12T00:38:45.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.113+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.9 2024-09-12T00:38:45.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.113+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.10 2024-09-12T00:38:45.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.121+0000 7f137e6a99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:45.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.121+0000 7f137e6a99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 2024-09-12T00:38:45.125 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.125+0000 7f137e6a99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 info.flags=0x17 2024-09-12T00:38:45.126 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.125+0000 7f137e6a99c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 to cache LRU end 2024-09-12T00:38:45.126 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.125+0000 7f137e6a99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:45.126 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.125+0000 7f137e6a99c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30, ofs0, ns] 2024-09-12T00:38:45.126 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.125+0000 7f1252ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333483 cookie 94431149229392 notifier 6824 bl.length()=931 2024-09-12T00:38:45.126 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.125+0000 7f1252ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 info.flags=0x17 2024-09-12T00:38:45.127 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.125+0000 7f1252ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 to cache LRU end 2024-09-12T00:38:45.127 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.125+0000 7f1252ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:45.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.125+0000 7f137e6a99c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30]): orig_sources= new_sources= 2024-09-12T00:38:45.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.125+0000 7f137e6a99c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30]): potential sources added=[] removed=[] 2024-09-12T00:38:45.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.125+0000 7f137e6a99c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30]): orig_dests= new_dests= 2024-09-12T00:38:45.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.125+0000 7f137e6a99c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30]): potential dests added=[] removed=[] 2024-09-12T00:38:45.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.133+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.0 2024-09-12T00:38:45.135 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.133+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.1 2024-09-12T00:38:45.135 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.133+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.2 2024-09-12T00:38:45.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.133+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.3 2024-09-12T00:38:45.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.137+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.4 2024-09-12T00:38:45.138 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.137+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.5 2024-09-12T00:38:45.138 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.137+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.6 2024-09-12T00:38:45.139 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.137+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.7 2024-09-12T00:38:45.140 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.137+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.8 2024-09-12T00:38:45.141 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.137+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.9 2024-09-12T00:38:45.142 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.141+0000 7f137e6a99c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.10 2024-09-12T00:38:45.142 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.141+0000 7f137e6a99c0 -1 Injecting error=-5 at location=commit_target_layout 2024-09-12T00:38:45.142 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.141+0000 7f137e6a99c0 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-12T00:38:45.154 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.153+0000 7f1232fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:45.159 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.157+0000 7f137e6a99c0 20 remove_watcher() i=0 2024-09-12T00:38:45.159 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.157+0000 7f137e6a99c0 2 removed watcher, disabling cache 2024-09-12T00:38:45.162 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.161+0000 7f137e6a99c0 20 remove_watcher() i=1 2024-09-12T00:38:45.164 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.161+0000 7f137e6a99c0 20 remove_watcher() i=2 2024-09-12T00:38:45.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.165+0000 7f137e6a99c0 20 remove_watcher() i=3 2024-09-12T00:38:45.168 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.165+0000 7f137e6a99c0 20 remove_watcher() i=4 2024-09-12T00:38:45.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.169+0000 7f137e6a99c0 20 remove_watcher() i=5 2024-09-12T00:38:45.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.169+0000 7f137e6a99c0 20 remove_watcher() i=6 2024-09-12T00:38:45.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.169+0000 7f137e6a99c0 20 remove_watcher() i=7 2024-09-12T00:38:45.191 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:38:45.224 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:45.224 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:45.268 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.265+0000 7fe7b87e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.269+0000 7fe7b87e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:45.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.269+0000 7fe7b87e19c0 20 realm 2024-09-12T00:38:45.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.269+0000 7fe7b87e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.269+0000 7fe7b87e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:45.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.269+0000 7fe7b87e19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:45.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.269+0000 7fe7b87e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.269+0000 7fe7b87e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:45.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.269+0000 7fe7b87e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.269+0000 7fe7b87e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:45.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.269+0000 7fe7b87e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.273+0000 7fe7b87e19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:45.274 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.273+0000 7fe7b87e19c0 20 searching for the correct realm 2024-09-12T00:38:45.279 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.277+0000 7fe7b6ae8640 0 -- 172.21.15.43:0/3145840398 >> [v2:172.21.15.43:6808/2258408181,v1:172.21.15.43:6809/2258408181] conn(0x55a5385f3470 msgr2=0x55a5385f5910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:45.285 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.285+0000 7fe7b62e7640 0 -- 172.21.15.43:0/3145840398 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fe7a002a930 msgr2=0x7fe7a0036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:45.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.289+0000 7fe7b87e19c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:38:45.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.289+0000 7fe7b87e19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:45.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.289+0000 7fe7b87e19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:45.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.289+0000 7fe7b87e19c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:38:45.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.289+0000 7fe7b87e19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:45.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.289+0000 7fe7b87e19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:45.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.289+0000 7fe7b87e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.289+0000 7fe7b87e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:45.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.289+0000 7fe7b87e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.293+0000 7fe7b87e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:45.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.293+0000 7fe7b87e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.293+0000 7fe7b87e19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:45.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.293+0000 7fe7b87e19c0 20 zone default found 2024-09-12T00:38:45.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.293+0000 7fe7b87e19c0 4 Realm: () 2024-09-12T00:38:45.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.293+0000 7fe7b87e19c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:38:45.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.293+0000 7fe7b87e19c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:38:45.295 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.293+0000 7fe7b87e19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:45.295 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.293+0000 7fe7b87e19c0 20 zonegroup default 2024-09-12T00:38:45.295 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.293+0000 7fe7b87e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.295 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.293+0000 7fe7b87e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:45.295 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.293+0000 7fe7b87e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.295 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.293+0000 7fe7b87e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:45.296 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.293+0000 7fe7b87e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.296 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.293+0000 7fe7b87e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:45.296 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.293+0000 7fe7b87e19c0 20 started sync module instance, tier type = 2024-09-12T00:38:45.296 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.293+0000 7fe7b87e19c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:38:45.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.309+0000 7fe7b87e19c0 20 add_watcher() i=0 2024-09-12T00:38:45.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.309+0000 7fe7b87e19c0 20 add_watcher() i=1 2024-09-12T00:38:45.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.309+0000 7fe7b87e19c0 20 add_watcher() i=2 2024-09-12T00:38:45.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.309+0000 7fe7b87e19c0 20 add_watcher() i=3 2024-09-12T00:38:45.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.309+0000 7fe7b87e19c0 20 add_watcher() i=4 2024-09-12T00:38:45.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.309+0000 7fe7b87e19c0 20 add_watcher() i=5 2024-09-12T00:38:45.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.309+0000 7fe7b87e19c0 20 add_watcher() i=6 2024-09-12T00:38:45.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.309+0000 7fe7b87e19c0 20 add_watcher() i=7 2024-09-12T00:38:45.314 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.309+0000 7fe7b87e19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:45.314 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.313+0000 7fe66cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:45.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.313+0000 7fe7b87e19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:45.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.313+0000 7fe7b87e19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:45.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.313+0000 7fe7b87e19c0 5 note: GC not initialized 2024-09-12T00:38:45.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.313+0000 7fe5e77fe640 20 reqs_thread_entry: start 2024-09-12T00:38:45.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.313+0000 7fe7b87e19c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:45.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.313+0000 7fe7b87e19c0 20 Filter name: none 2024-09-12T00:38:45.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.313+0000 7fe7b87e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.313+0000 7fe5e57fa640 20 reqs_thread_entry: start 2024-09-12T00:38:45.316 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.313+0000 7fe7b87e19c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:45.316 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.313+0000 7fe7b87e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.317+0000 7fe7b87e19c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:38:45.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.317+0000 7fe7b87e19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:45.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.317+0000 7fe7b87e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.317+0000 7fe7b87e19c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:45.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.317+0000 7fe7b87e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.319 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.317+0000 7fe7b87e19c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:38:45.319 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.317+0000 7fe7b87e19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:45.322 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.321+0000 7fe66cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:45.327 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.325+0000 7fe7b87e19c0 20 remove_watcher() i=0 2024-09-12T00:38:45.327 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.325+0000 7fe7b87e19c0 2 removed watcher, disabling cache 2024-09-12T00:38:45.329 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.325+0000 7fe7b87e19c0 20 remove_watcher() i=1 2024-09-12T00:38:45.331 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.329+0000 7fe7b87e19c0 20 remove_watcher() i=2 2024-09-12T00:38:45.333 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.329+0000 7fe7b87e19c0 20 remove_watcher() i=3 2024-09-12T00:38:45.335 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.333+0000 7fe7b87e19c0 20 remove_watcher() i=4 2024-09-12T00:38:45.336 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.333+0000 7fe7b87e19c0 20 remove_watcher() i=5 2024-09-12T00:38:45.337 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.337+0000 7fe7b87e19c0 20 remove_watcher() i=6 2024-09-12T00:38:45.338 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.337+0000 7fe7b87e19c0 20 remove_watcher() i=7 2024-09-12T00:38:45.353 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:45.353 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:38:45.353 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-commit-target-layout id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:38:45.353 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:45.354 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:45.354 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:45.366 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:45.367 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:45.410 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:38:45.441 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:45.441 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:45.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.485+0000 7fdd9d8ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.487 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.485+0000 7fdd9d8ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:45.487 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.485+0000 7fdd9d8ff9c0 20 realm 2024-09-12T00:38:45.487 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.485+0000 7fdd9d8ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.487 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.485+0000 7fdd9d8ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:45.488 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.485+0000 7fdd9d8ff9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:45.488 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.485+0000 7fdd9d8ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.488 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.485+0000 7fdd9d8ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:45.488 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.485+0000 7fdd9d8ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.489+0000 7fdd9d8ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:45.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.489+0000 7fdd9d8ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.490 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.489+0000 7fdd9d8ff9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:45.490 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.489+0000 7fdd9d8ff9c0 20 searching for the correct realm 2024-09-12T00:38:45.496 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.493+0000 7fdd9bc06640 0 -- 172.21.15.43:0/1455922209 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55996edab320 msgr2=0x55996edad7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:45.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.501+0000 7fdd9ac04640 0 -- 172.21.15.43:0/1455922209 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fdd9002d070 msgr2=0x7fdd9002e750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:45.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.509+0000 7fdd9d8ff9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:38:45.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.509+0000 7fdd9d8ff9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:45.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.509+0000 7fdd9d8ff9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:45.510 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.509+0000 7fdd9d8ff9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:38:45.510 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.509+0000 7fdd9d8ff9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:45.510 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.509+0000 7fdd9d8ff9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:45.510 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.509+0000 7fdd9d8ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.510 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.509+0000 7fdd9d8ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:45.510 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.509+0000 7fdd9d8ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.511 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.509+0000 7fdd9d8ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:45.511 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.509+0000 7fdd9d8ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.511 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.509+0000 7fdd9d8ff9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:45.511 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.509+0000 7fdd9d8ff9c0 20 zone default found 2024-09-12T00:38:45.512 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.509+0000 7fdd9d8ff9c0 4 Realm: () 2024-09-12T00:38:45.512 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.509+0000 7fdd9d8ff9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:38:45.512 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.509+0000 7fdd9d8ff9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:38:45.512 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.509+0000 7fdd9d8ff9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:45.512 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.509+0000 7fdd9d8ff9c0 20 zonegroup default 2024-09-12T00:38:45.512 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.509+0000 7fdd9d8ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.512 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.509+0000 7fdd9d8ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:45.512 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.509+0000 7fdd9d8ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.513 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.509+0000 7fdd9d8ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:45.513 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.509+0000 7fdd9d8ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.513 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.509+0000 7fdd9d8ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:45.513 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.509+0000 7fdd9d8ff9c0 20 started sync module instance, tier type = 2024-09-12T00:38:45.513 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.509+0000 7fdd9d8ff9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:38:45.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.525+0000 7fdd9d8ff9c0 20 add_watcher() i=0 2024-09-12T00:38:45.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.525+0000 7fdd9d8ff9c0 20 add_watcher() i=1 2024-09-12T00:38:45.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.525+0000 7fdd9d8ff9c0 20 add_watcher() i=2 2024-09-12T00:38:45.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.525+0000 7fdd9d8ff9c0 20 add_watcher() i=3 2024-09-12T00:38:45.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.525+0000 7fdd9d8ff9c0 20 add_watcher() i=4 2024-09-12T00:38:45.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.525+0000 7fdd9d8ff9c0 20 add_watcher() i=5 2024-09-12T00:38:45.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.525+0000 7fdd9d8ff9c0 20 add_watcher() i=6 2024-09-12T00:38:45.529 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.525+0000 7fdd9d8ff9c0 20 add_watcher() i=7 2024-09-12T00:38:45.529 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.529+0000 7fdd9d8ff9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:45.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.529+0000 7fdc51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:45.532 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.529+0000 7fdd9d8ff9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:45.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.529+0000 7fdd9d8ff9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:45.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.529+0000 7fdd9d8ff9c0 5 note: GC not initialized 2024-09-12T00:38:45.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.529+0000 7fdc50fe1640 20 reqs_thread_entry: start 2024-09-12T00:38:45.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.529+0000 7fdd9d8ff9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:45.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.529+0000 7fdd9d8ff9c0 20 Filter name: none 2024-09-12T00:38:45.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.529+0000 7fdbca7fc640 20 reqs_thread_entry: start 2024-09-12T00:38:45.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.529+0000 7fdd9d8ff9c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:38:45.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.529+0000 7fdd9d8ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.533+0000 7fdd9d8ff9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:45.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.533+0000 7fdd9d8ff9c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:38:45.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.533+0000 7fdd9d8ff9c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:38:45.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.533+0000 7fdd9d8ff9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 : miss 2024-09-12T00:38:45.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.533+0000 7fdd9d8ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.533+0000 7fdd9d8ff9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:38:45.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.533+0000 7fdd9d8ff9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 info.flags=0x17 2024-09-12T00:38:45.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.533+0000 7fdd9d8ff9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 to cache LRU end 2024-09-12T00:38:45.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.533+0000 7fdd9d8ff9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:45.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.533+0000 7fdd9d8ff9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:45.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.533+0000 7fdd9d8ff9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 2024-09-12T00:38:45.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.533+0000 7fdd9d8ff9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:38:45.552 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.549+0000 7fdd9d8ff9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 info.flags=0x17 2024-09-12T00:38:45.552 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.549+0000 7fdd9d8ff9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 to cache LRU end 2024-09-12T00:38:45.552 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.549+0000 7fdd9d8ff9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:45.552 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.549+0000 7fdd9d8ff9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30, ofs0, ns] 2024-09-12T00:38:45.553 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.549+0000 7fdc7e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333484 cookie 94117478260704 notifier 6857 bl.length()=931 2024-09-12T00:38:45.553 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.549+0000 7fdc7e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 info.flags=0x17 2024-09-12T00:38:45.553 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.549+0000 7fdc7e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 to cache LRU end 2024-09-12T00:38:45.553 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.549+0000 7fdc7e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:45.553 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.549+0000 7fdd9d8ff9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30]): orig_sources= new_sources= 2024-09-12T00:38:45.553 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.549+0000 7fdd9d8ff9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30]): potential sources added=[] removed=[] 2024-09-12T00:38:45.554 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.549+0000 7fdd9d8ff9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30]): orig_dests= new_dests= 2024-09-12T00:38:45.554 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.549+0000 7fdd9d8ff9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30]): potential dests added=[] removed=[] 2024-09-12T00:38:45.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.561+0000 7fdd9d8ff9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.2.0 2024-09-12T00:38:45.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.561+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.2.0 2024-09-12T00:38:45.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.561+0000 7fdd9d8ff9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.2.1 2024-09-12T00:38:45.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.561+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.2.1 2024-09-12T00:38:45.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.561+0000 7fdd9d8ff9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.2.2 2024-09-12T00:38:45.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.561+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.2.2 2024-09-12T00:38:45.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.561+0000 7fdd9d8ff9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.2.3 2024-09-12T00:38:45.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.561+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.2.3 2024-09-12T00:38:45.565 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.561+0000 7fdd9d8ff9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.2.4 2024-09-12T00:38:45.565 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.561+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.2.4 2024-09-12T00:38:45.565 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.561+0000 7fdd9d8ff9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.2.5 2024-09-12T00:38:45.565 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.561+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.2.5 2024-09-12T00:38:45.565 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.561+0000 7fdd9d8ff9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.2.6 2024-09-12T00:38:45.565 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.561+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.2.6 2024-09-12T00:38:45.565 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.561+0000 7fdd9d8ff9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.2.7 2024-09-12T00:38:45.565 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.561+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.2.7 2024-09-12T00:38:45.565 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.561+0000 7fdd9d8ff9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.2.8 2024-09-12T00:38:45.565 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.561+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.2.8 2024-09-12T00:38:45.565 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.561+0000 7fdd9d8ff9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.2.9 2024-09-12T00:38:45.566 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.561+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.2.9 2024-09-12T00:38:45.566 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.561+0000 7fdd9d8ff9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.2.10 2024-09-12T00:38:45.566 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.561+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.2.10 2024-09-12T00:38:45.566 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.561+0000 7fdd9d8ff9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.2.11 2024-09-12T00:38:45.566 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.561+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.2.11 2024-09-12T00:38:45.566 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.561+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.0 2024-09-12T00:38:45.567 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.561+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.1 2024-09-12T00:38:45.567 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.565+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.2 2024-09-12T00:38:45.568 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.565+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.3 2024-09-12T00:38:45.568 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.565+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.4 2024-09-12T00:38:45.569 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.569+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.5 2024-09-12T00:38:45.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.569+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.6 2024-09-12T00:38:45.571 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.569+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.7 2024-09-12T00:38:45.571 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.569+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.8 2024-09-12T00:38:45.572 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.569+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.9 2024-09-12T00:38:45.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.573+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.10 2024-09-12T00:38:45.581 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.581+0000 7fdd9d8ff9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:45.581 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.581+0000 7fdd9d8ff9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 2024-09-12T00:38:45.583 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.581+0000 7fdd9d8ff9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 info.flags=0x17 2024-09-12T00:38:45.583 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.581+0000 7fdd9d8ff9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 to cache LRU end 2024-09-12T00:38:45.584 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.581+0000 7fdd9d8ff9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:45.584 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.581+0000 7fdd9d8ff9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30, ofs0, ns] 2024-09-12T00:38:45.584 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.581+0000 7fdc7e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333485 cookie 94117478260704 notifier 6857 bl.length()=931 2024-09-12T00:38:45.584 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.581+0000 7fdc7e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 info.flags=0x17 2024-09-12T00:38:45.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.581+0000 7fdc7e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 to cache LRU end 2024-09-12T00:38:45.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.581+0000 7fdc7e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:45.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.581+0000 7fdd9d8ff9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30]): orig_sources= new_sources= 2024-09-12T00:38:45.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.581+0000 7fdd9d8ff9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30]): potential sources added=[] removed=[] 2024-09-12T00:38:45.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.581+0000 7fdd9d8ff9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30]): orig_dests= new_dests= 2024-09-12T00:38:45.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.581+0000 7fdd9d8ff9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30]): potential dests added=[] removed=[] 2024-09-12T00:38:45.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.589+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.0 2024-09-12T00:38:45.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.589+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.1 2024-09-12T00:38:45.592 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.589+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.2 2024-09-12T00:38:45.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.593+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.3 2024-09-12T00:38:45.594 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.593+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.4 2024-09-12T00:38:45.594 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.593+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.5 2024-09-12T00:38:45.595 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.593+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.6 2024-09-12T00:38:45.596 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.593+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.7 2024-09-12T00:38:45.596 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.593+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.8 2024-09-12T00:38:45.597 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.597+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.9 2024-09-12T00:38:45.597 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.597+0000 7fdd9d8ff9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30.10 2024-09-12T00:38:45.598 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.597+0000 7fdd9d8ff9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:45.598 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.597+0000 7fdd9d8ff9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 2024-09-12T00:38:45.601 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.601+0000 7fdd9d8ff9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 info.flags=0x17 2024-09-12T00:38:45.601 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.601+0000 7fdd9d8ff9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 to cache LRU end 2024-09-12T00:38:45.601 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.601+0000 7fdd9d8ff9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:45.601 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.601+0000 7fdd9d8ff9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30, ofs0, ns] 2024-09-12T00:38:45.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.601+0000 7fdc7effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333486 cookie 94117478260704 notifier 6857 bl.length()=899 2024-09-12T00:38:45.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.601+0000 7fdc7effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 info.flags=0x17 2024-09-12T00:38:45.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.601+0000 7fdc7effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 to cache LRU end 2024-09-12T00:38:45.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.601+0000 7fdc7effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:45.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.601+0000 7fdd9d8ff9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30]): orig_sources= new_sources= 2024-09-12T00:38:45.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.601+0000 7fdd9d8ff9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30]): potential sources added=[] removed=[] 2024-09-12T00:38:45.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.601+0000 7fdd9d8ff9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30]): orig_dests= new_dests= 2024-09-12T00:38:45.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.601+0000 7fdd9d8ff9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30]): potential dests added=[] removed=[] 2024-09-12T00:38:45.609 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.609+0000 7fdd9d8ff9c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:38:45.612 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.609+0000 7fdc51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:45.617 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.617+0000 7fdd9d8ff9c0 20 remove_watcher() i=0 2024-09-12T00:38:45.617 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.617+0000 7fdd9d8ff9c0 2 removed watcher, disabling cache 2024-09-12T00:38:45.619 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.617+0000 7fdd9d8ff9c0 20 remove_watcher() i=1 2024-09-12T00:38:45.621 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.617+0000 7fdd9d8ff9c0 20 remove_watcher() i=2 2024-09-12T00:38:45.623 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.621+0000 7fdd9d8ff9c0 20 remove_watcher() i=3 2024-09-12T00:38:45.625 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.625+0000 7fdd9d8ff9c0 20 remove_watcher() i=4 2024-09-12T00:38:45.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.625+0000 7fdd9d8ff9c0 20 remove_watcher() i=5 2024-09-12T00:38:45.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.625+0000 7fdd9d8ff9c0 20 remove_watcher() i=6 2024-09-12T00:38:45.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.629+0000 7fdd9d8ff9c0 20 remove_watcher() i=7 2024-09-12T00:38:45.643 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:38:45.670 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:45.670 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:45.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.713+0000 7f82567849c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.713+0000 7f82567849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:45.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.713+0000 7f82567849c0 20 realm 2024-09-12T00:38:45.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.713+0000 7f82567849c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.713+0000 7f82567849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:45.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.713+0000 7f82567849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:45.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.713+0000 7f82567849c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.713+0000 7f82567849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:45.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.713+0000 7f82567849c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.718 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.717+0000 7f82567849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:45.718 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.717+0000 7f82567849c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.717+0000 7f82567849c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:45.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.717+0000 7f82567849c0 20 searching for the correct realm 2024-09-12T00:38:45.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.725+0000 7f8254a8b640 0 -- 172.21.15.43:0/3840616944 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f8248013030 msgr2=0x7f824805fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:45.944 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.941+0000 7f825428a640 0 -- 172.21.15.43:0/3840616944 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x55f3f25b56d0 msgr2=0x55f3f25b7ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:45.952 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.949+0000 7f82567849c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:38:45.952 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.949+0000 7f82567849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:45.952 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.949+0000 7f82567849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:45.952 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.949+0000 7f82567849c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:38:45.952 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.949+0000 7f82567849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:45.952 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.949+0000 7f82567849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:45.952 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.949+0000 7f82567849c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.953 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.949+0000 7f82567849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:45.953 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.949+0000 7f82567849c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.953 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.953+0000 7f82567849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:45.953 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.953+0000 7f82567849c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.954 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.953+0000 7f82567849c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:45.954 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.953+0000 7f82567849c0 20 zone default found 2024-09-12T00:38:45.955 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.953+0000 7f82567849c0 4 Realm: () 2024-09-12T00:38:45.955 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.953+0000 7f82567849c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:38:45.955 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.953+0000 7f82567849c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:38:45.955 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.953+0000 7f82567849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:45.955 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.953+0000 7f82567849c0 20 zonegroup default 2024-09-12T00:38:45.955 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.953+0000 7f82567849c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.955 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.953+0000 7f82567849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:45.955 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.953+0000 7f82567849c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.956 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.953+0000 7f82567849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:45.956 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.953+0000 7f82567849c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.957 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.953+0000 7f82567849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:45.957 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.953+0000 7f82567849c0 20 started sync module instance, tier type = 2024-09-12T00:38:45.957 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.953+0000 7f82567849c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:38:45.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.981+0000 7f82567849c0 20 add_watcher() i=0 2024-09-12T00:38:45.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.981+0000 7f82567849c0 20 add_watcher() i=1 2024-09-12T00:38:45.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.981+0000 7f82567849c0 20 add_watcher() i=2 2024-09-12T00:38:45.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.981+0000 7f82567849c0 20 add_watcher() i=3 2024-09-12T00:38:45.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.981+0000 7f82567849c0 20 add_watcher() i=4 2024-09-12T00:38:45.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.981+0000 7f82567849c0 20 add_watcher() i=5 2024-09-12T00:38:45.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.981+0000 7f82567849c0 20 add_watcher() i=6 2024-09-12T00:38:45.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.981+0000 7f82567849c0 20 add_watcher() i=7 2024-09-12T00:38:45.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.981+0000 7f82567849c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:45.988 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.985+0000 7f810afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:45.989 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.989+0000 7f82567849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:45.989 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.989+0000 7f82567849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:45.989 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.989+0000 7f82567849c0 5 note: GC not initialized 2024-09-12T00:38:45.990 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.989+0000 7f8109fdb640 20 reqs_thread_entry: start 2024-09-12T00:38:45.990 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.989+0000 7f82567849c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:45.990 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.989+0000 7f82567849c0 20 Filter name: none 2024-09-12T00:38:45.990 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.989+0000 7f807b7fe640 20 reqs_thread_entry: start 2024-09-12T00:38:45.990 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.989+0000 7f82567849c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.991 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.989+0000 7f82567849c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:45.991 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.989+0000 7f82567849c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.993 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.989+0000 7f82567849c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:45.993 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.989+0000 7f82567849c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:45.993 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.989+0000 7f82567849c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.993+0000 7f82567849c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:45.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.993+0000 7f82567849c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:45.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.993+0000 7f82567849c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:45.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.993+0000 7f82567849c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:45.999 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:45.997+0000 7f810afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:46.005 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.005+0000 7f82567849c0 20 remove_watcher() i=0 2024-09-12T00:38:46.005 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.005+0000 7f82567849c0 2 removed watcher, disabling cache 2024-09-12T00:38:46.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.005+0000 7f82567849c0 20 remove_watcher() i=1 2024-09-12T00:38:46.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.009+0000 7f82567849c0 20 remove_watcher() i=2 2024-09-12T00:38:46.012 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.009+0000 7f82567849c0 20 remove_watcher() i=3 2024-09-12T00:38:46.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.013+0000 7f82567849c0 20 remove_watcher() i=4 2024-09-12T00:38:46.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.017+0000 7f82567849c0 20 remove_watcher() i=5 2024-09-12T00:38:46.019 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.017+0000 7f82567849c0 20 remove_watcher() i=6 2024-09-12T00:38:46.021 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.021+0000 7f82567849c0 20 remove_watcher() i=7 2024-09-12T00:38:46.040 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:46.040 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:38:46.040 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-commit-target-layout id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:38:46.040 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:46.042 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:46.042 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:46.046 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:46.046 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:46.095 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:46.096 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:46.153 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-12T00:38:46.153 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:46.155 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:46.155 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:46.179 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:46.179 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:46.228 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:46.229 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:46.248 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:46.248 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:46.267 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:46.267 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:46.285 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:46.285 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:46.303 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:46.303 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:46.324 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:46.324 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:46.342 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:46.342 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:46.360 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:46.361 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:46.377 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:46.378 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:46.395 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:46.395 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:46.412 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:46.413 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:46.432 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:46.432 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:46.451 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:46.451 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:46.468 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:46.469 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:46.487 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:46.487 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:46.504 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:46.504 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:46.522 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:46.522 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:46.539 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:46.539 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:46.557 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:46.560 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:46.575 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:46.575 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:46.595 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:38:46.630 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:46.631 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:46.676 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.673+0000 7f1bb50e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:46.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.677+0000 7f1bb50e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:46.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.677+0000 7f1bb50e39c0 20 realm 2024-09-12T00:38:46.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.677+0000 7f1bb50e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:46.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.677+0000 7f1bb50e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:46.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.677+0000 7f1bb50e39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:46.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.677+0000 7f1bb50e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:46.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.677+0000 7f1bb50e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:46.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.677+0000 7f1bb50e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:46.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.677+0000 7f1bb50e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:46.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.677+0000 7f1bb50e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:46.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.681+0000 7f1bb50e39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:46.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.681+0000 7f1bb50e39c0 20 searching for the correct realm 2024-09-12T00:38:46.687 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.685+0000 7f1bb33ea640 0 -- 172.21.15.43:0/3910160235 >> [v2:172.21.15.43:6808/2258408181,v1:172.21.15.43:6809/2258408181] conn(0x55f2d1be0790 msgr2=0x55f2d1be2c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:46.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.693+0000 7f1bb2be9640 0 -- 172.21.15.43:0/3910160235 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f1ba808f150 msgr2=0x7f1ba806c650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:46.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.701+0000 7f1bb50e39c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:38:46.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.701+0000 7f1bb50e39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:46.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.701+0000 7f1bb50e39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:46.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.701+0000 7f1bb50e39c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:38:46.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.701+0000 7f1bb50e39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:46.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.701+0000 7f1bb50e39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:46.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.701+0000 7f1bb50e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:46.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.701+0000 7f1bb50e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:46.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.701+0000 7f1bb50e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:46.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.701+0000 7f1bb50e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:46.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.701+0000 7f1bb50e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:46.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.701+0000 7f1bb50e39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:46.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.701+0000 7f1bb50e39c0 20 zone default found 2024-09-12T00:38:46.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.701+0000 7f1bb50e39c0 4 Realm: () 2024-09-12T00:38:46.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.701+0000 7f1bb50e39c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:38:46.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.701+0000 7f1bb50e39c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:38:46.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.701+0000 7f1bb50e39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:46.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.701+0000 7f1bb50e39c0 20 zonegroup default 2024-09-12T00:38:46.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.701+0000 7f1bb50e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:46.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.701+0000 7f1bb50e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:46.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.701+0000 7f1bb50e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:46.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.701+0000 7f1bb50e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:46.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.701+0000 7f1bb50e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:46.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.701+0000 7f1bb50e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:46.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.701+0000 7f1bb50e39c0 20 started sync module instance, tier type = 2024-09-12T00:38:46.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.701+0000 7f1bb50e39c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:38:46.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.717+0000 7f1bb50e39c0 20 add_watcher() i=0 2024-09-12T00:38:46.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.717+0000 7f1bb50e39c0 20 add_watcher() i=1 2024-09-12T00:38:46.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.717+0000 7f1bb50e39c0 20 add_watcher() i=2 2024-09-12T00:38:46.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.717+0000 7f1bb50e39c0 20 add_watcher() i=3 2024-09-12T00:38:46.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.717+0000 7f1bb50e39c0 20 add_watcher() i=4 2024-09-12T00:38:46.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.717+0000 7f1bb50e39c0 20 add_watcher() i=5 2024-09-12T00:38:46.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.717+0000 7f1bb50e39c0 20 add_watcher() i=6 2024-09-12T00:38:46.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.721+0000 7f1bb50e39c0 20 add_watcher() i=7 2024-09-12T00:38:46.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.721+0000 7f1bb50e39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:46.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.721+0000 7f1a697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:46.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.721+0000 7f1bb50e39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:46.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.721+0000 7f1bb50e39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:46.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.721+0000 7f1bb50e39c0 5 note: GC not initialized 2024-09-12T00:38:46.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.725+0000 7f19e3fff640 20 reqs_thread_entry: start 2024-09-12T00:38:46.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.725+0000 7f1bb50e39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:46.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.725+0000 7f1bb50e39c0 20 Filter name: none 2024-09-12T00:38:46.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.725+0000 7f19e1ffb640 20 reqs_thread_entry: start 2024-09-12T00:38:46.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.725+0000 7f1bb50e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:46.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.725+0000 7f1bb50e39c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:46.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.725+0000 7f1bb50e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:46.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.725+0000 7f1bb50e39c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:46.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.725+0000 7f1bb50e39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:46.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.725+0000 7f1bb50e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:46.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.725+0000 7f1bb50e39c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:46.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.725+0000 7f1bb50e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:46.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.729+0000 7f1bb50e39c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:46.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.729+0000 7f1bb50e39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:46.732 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.729+0000 7f1a697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:46.738 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.737+0000 7f1bb50e39c0 20 remove_watcher() i=0 2024-09-12T00:38:46.738 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.737+0000 7f1bb50e39c0 2 removed watcher, disabling cache 2024-09-12T00:38:46.740 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.737+0000 7f1bb50e39c0 20 remove_watcher() i=1 2024-09-12T00:38:46.742 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.741+0000 7f1bb50e39c0 20 remove_watcher() i=2 2024-09-12T00:38:46.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.741+0000 7f1bb50e39c0 20 remove_watcher() i=3 2024-09-12T00:38:46.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.745+0000 7f1bb50e39c0 20 remove_watcher() i=4 2024-09-12T00:38:46.747 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.745+0000 7f1bb50e39c0 20 remove_watcher() i=5 2024-09-12T00:38:46.748 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.745+0000 7f1bb50e39c0 20 remove_watcher() i=6 2024-09-12T00:38:46.750 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.749+0000 7f1bb50e39c0 20 remove_watcher() i=7 2024-09-12T00:38:46.765 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:46.765 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:38:46.765 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-commit-target-layout id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:38:46.765 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:46.765 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-12T00:38:46.800 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:46.800 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:46.842 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.841+0000 7f0cf44e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:46.844 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.841+0000 7f0cf44e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:46.844 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.841+0000 7f0cf44e39c0 20 realm 2024-09-12T00:38:46.844 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.841+0000 7f0cf44e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:46.844 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.841+0000 7f0cf44e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:46.844 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.841+0000 7f0cf44e39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:46.844 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.841+0000 7f0cf44e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:46.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.841+0000 7f0cf44e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:46.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.841+0000 7f0cf44e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:46.846 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.845+0000 7f0cf44e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:46.846 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.845+0000 7f0cf44e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:46.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.845+0000 7f0cf44e39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:46.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.845+0000 7f0cf44e39c0 20 searching for the correct realm 2024-09-12T00:38:46.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:46.853+0000 7f0cf27ea640 0 -- 172.21.15.43:0/877295130 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f0cdc10e240 msgr2=0x7f0cdc0c6070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:47.071 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.069+0000 7f0cf1fe9640 0 -- 172.21.15.43:0/877295130 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x560f620ebd40 msgr2=0x560f620ee130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:47.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.077+0000 7f0cf44e39c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:38:47.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.077+0000 7f0cf44e39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:47.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.077+0000 7f0cf44e39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:47.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.077+0000 7f0cf44e39c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:38:47.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.077+0000 7f0cf44e39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:47.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.077+0000 7f0cf44e39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:47.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.077+0000 7f0cf44e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.077+0000 7f0cf44e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:47.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.077+0000 7f0cf44e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.081 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.081+0000 7f0cf44e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:47.081 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.081+0000 7f0cf44e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.082 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.081+0000 7f0cf44e39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:47.082 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.081+0000 7f0cf44e39c0 20 zone default found 2024-09-12T00:38:47.082 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.081+0000 7f0cf44e39c0 4 Realm: () 2024-09-12T00:38:47.082 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.081+0000 7f0cf44e39c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:38:47.083 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.081+0000 7f0cf44e39c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:38:47.083 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.081+0000 7f0cf44e39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:47.083 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.081+0000 7f0cf44e39c0 20 zonegroup default 2024-09-12T00:38:47.083 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.081+0000 7f0cf44e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.083 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.081+0000 7f0cf44e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:47.083 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.081+0000 7f0cf44e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.084 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.081+0000 7f0cf44e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:47.084 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.081+0000 7f0cf44e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.085+0000 7f0cf44e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:47.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.085+0000 7f0cf44e39c0 20 started sync module instance, tier type = 2024-09-12T00:38:47.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.085+0000 7f0cf44e39c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:38:47.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.109+0000 7f0cf44e39c0 20 add_watcher() i=0 2024-09-12T00:38:47.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.109+0000 7f0cf44e39c0 20 add_watcher() i=1 2024-09-12T00:38:47.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.109+0000 7f0cf44e39c0 20 add_watcher() i=2 2024-09-12T00:38:47.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.109+0000 7f0cf44e39c0 20 add_watcher() i=3 2024-09-12T00:38:47.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.109+0000 7f0cf44e39c0 20 add_watcher() i=4 2024-09-12T00:38:47.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.109+0000 7f0cf44e39c0 20 add_watcher() i=5 2024-09-12T00:38:47.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.109+0000 7f0cf44e39c0 20 add_watcher() i=6 2024-09-12T00:38:47.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.109+0000 7f0cf44e39c0 20 add_watcher() i=7 2024-09-12T00:38:47.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.109+0000 7f0cf44e39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:47.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.113+0000 7f0ba37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:47.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.113+0000 7f0cf44e39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:47.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.113+0000 7f0cf44e39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:47.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.117+0000 7f0cf44e39c0 5 note: GC not initialized 2024-09-12T00:38:47.118 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.117+0000 7f0ba27fc640 20 reqs_thread_entry: start 2024-09-12T00:38:47.118 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.117+0000 7f0cf44e39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:47.118 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.117+0000 7f0cf44e39c0 20 Filter name: none 2024-09-12T00:38:47.118 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.117+0000 7f0b13fff640 20 reqs_thread_entry: start 2024-09-12T00:38:47.118 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.117+0000 7f0cf44e39c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:38:47.118 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.117+0000 7f0cf44e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.119 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.117+0000 7f0cf44e39c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:47.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.117+0000 7f0cf44e39c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:38:47.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.117+0000 7f0cf44e39c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:38:47.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.117+0000 7f0cf44e39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31 : miss 2024-09-12T00:38:47.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.117+0000 7f0cf44e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.117+0000 7f0cf44e39c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:47.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.117+0000 7f0cf44e39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31 info.flags=0x17 2024-09-12T00:38:47.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.117+0000 7f0cf44e39c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31 to cache LRU end 2024-09-12T00:38:47.121 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.117+0000 7f0cf44e39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:47.121 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.117+0000 7f0cf44e39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:47.121 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.117+0000 7f0cf44e39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31 2024-09-12T00:38:47.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.129+0000 7f0cf44e39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31 info.flags=0x17 2024-09-12T00:38:47.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.129+0000 7f0cf44e39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31 to cache LRU end 2024-09-12T00:38:47.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.129+0000 7f0cf44e39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:47.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.129+0000 7f0cf44e39c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31, ofs0, ns] 2024-09-12T00:38:47.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.129+0000 7f0bd57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333489 cookie 94624069695312 notifier 6908 bl.length()=931 2024-09-12T00:38:47.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.129+0000 7f0bd57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31 info.flags=0x17 2024-09-12T00:38:47.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.129+0000 7f0bd57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31 to cache LRU end 2024-09-12T00:38:47.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.129+0000 7f0bd57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:47.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.129+0000 7f0cf44e39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31]): orig_sources= new_sources= 2024-09-12T00:38:47.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.129+0000 7f0cf44e39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31]): potential sources added=[] removed=[] 2024-09-12T00:38:47.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.129+0000 7f0cf44e39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31]): orig_dests= new_dests= 2024-09-12T00:38:47.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.129+0000 7f0cf44e39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31]): potential dests added=[] removed=[] 2024-09-12T00:38:47.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.145+0000 7f0cf44e39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.1.0 2024-09-12T00:38:47.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.145+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.1.0 2024-09-12T00:38:47.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.145+0000 7f0cf44e39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.1.1 2024-09-12T00:38:47.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.145+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.1.1 2024-09-12T00:38:47.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.145+0000 7f0cf44e39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.1.2 2024-09-12T00:38:47.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.145+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.1.2 2024-09-12T00:38:47.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.145+0000 7f0cf44e39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.1.3 2024-09-12T00:38:47.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.145+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.1.3 2024-09-12T00:38:47.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.145+0000 7f0cf44e39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.1.4 2024-09-12T00:38:47.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.145+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.1.4 2024-09-12T00:38:47.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.145+0000 7f0cf44e39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.1.5 2024-09-12T00:38:47.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.145+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.1.5 2024-09-12T00:38:47.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.145+0000 7f0cf44e39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.1.6 2024-09-12T00:38:47.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.145+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.1.6 2024-09-12T00:38:47.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.145+0000 7f0cf44e39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.1.7 2024-09-12T00:38:47.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.145+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.1.7 2024-09-12T00:38:47.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.145+0000 7f0cf44e39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.1.8 2024-09-12T00:38:47.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.145+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.1.8 2024-09-12T00:38:47.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.145+0000 7f0cf44e39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.1.9 2024-09-12T00:38:47.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.145+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.1.9 2024-09-12T00:38:47.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.145+0000 7f0cf44e39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.1.10 2024-09-12T00:38:47.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.145+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.1.10 2024-09-12T00:38:47.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.145+0000 7f0cf44e39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.1.11 2024-09-12T00:38:47.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.145+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.1.11 2024-09-12T00:38:47.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.145+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.0 2024-09-12T00:38:47.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.145+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.1 2024-09-12T00:38:47.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.145+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.2 2024-09-12T00:38:47.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.149+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.3 2024-09-12T00:38:47.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.149+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.4 2024-09-12T00:38:47.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.149+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.5 2024-09-12T00:38:47.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.149+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.6 2024-09-12T00:38:47.154 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.153+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.7 2024-09-12T00:38:47.155 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.153+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.8 2024-09-12T00:38:47.156 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.153+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.9 2024-09-12T00:38:47.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.157+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.10 2024-09-12T00:38:47.165 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.165+0000 7f0cf44e39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:47.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.165+0000 7f0cf44e39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31 2024-09-12T00:38:47.169 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.169+0000 7f0cf44e39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31 info.flags=0x17 2024-09-12T00:38:47.169 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.169+0000 7f0cf44e39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31 to cache LRU end 2024-09-12T00:38:47.169 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.169+0000 7f0cf44e39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:47.169 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.169+0000 7f0cf44e39c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31, ofs0, ns] 2024-09-12T00:38:47.169 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.169+0000 7f0bd4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333490 cookie 94624069695312 notifier 6908 bl.length()=931 2024-09-12T00:38:47.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.169+0000 7f0bd4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31 info.flags=0x17 2024-09-12T00:38:47.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.169+0000 7f0bd4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31 to cache LRU end 2024-09-12T00:38:47.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.169+0000 7f0bd4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:47.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.169+0000 7f0cf44e39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31]): orig_sources= new_sources= 2024-09-12T00:38:47.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.169+0000 7f0cf44e39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31]): potential sources added=[] removed=[] 2024-09-12T00:38:47.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.169+0000 7f0cf44e39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31]): orig_dests= new_dests= 2024-09-12T00:38:47.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.169+0000 7f0cf44e39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31]): potential dests added=[] removed=[] 2024-09-12T00:38:47.177 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.177+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.0 2024-09-12T00:38:47.178 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.177+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.1 2024-09-12T00:38:47.179 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.177+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.2 2024-09-12T00:38:47.180 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.177+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.3 2024-09-12T00:38:47.181 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.181+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.4 2024-09-12T00:38:47.182 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.181+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.5 2024-09-12T00:38:47.183 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.181+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.6 2024-09-12T00:38:47.184 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.181+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.7 2024-09-12T00:38:47.185 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.185+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.8 2024-09-12T00:38:47.186 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.185+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.9 2024-09-12T00:38:47.187 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.185+0000 7f0cf44e39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31.10 2024-09-12T00:38:47.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.185+0000 7f0cf44e39c0 -1 Injecting error=-125 at location=commit_target_layout 2024-09-12T00:38:47.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.185+0000 7f0cf44e39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:47.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.185+0000 7f0cf44e39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31 2024-09-12T00:38:47.191 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.189+0000 7f0cf44e39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31 info.flags=0x17 2024-09-12T00:38:47.192 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.189+0000 7f0cf44e39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31 to cache LRU end 2024-09-12T00:38:47.192 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.189+0000 7f0cf44e39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:47.192 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.189+0000 7f0cf44e39c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31, ofs0, ns] 2024-09-12T00:38:47.192 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.189+0000 7f0bd57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333491 cookie 94624069695312 notifier 6908 bl.length()=899 2024-09-12T00:38:47.192 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.189+0000 7f0bd57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31 info.flags=0x17 2024-09-12T00:38:47.193 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.189+0000 7f0bd57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31 to cache LRU end 2024-09-12T00:38:47.193 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.189+0000 7f0bd57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:47.193 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.193+0000 7f0cf44e39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31]): orig_sources= new_sources= 2024-09-12T00:38:47.193 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.193+0000 7f0cf44e39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31]): potential sources added=[] removed=[] 2024-09-12T00:38:47.193 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.193+0000 7f0cf44e39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31]): orig_dests= new_dests= 2024-09-12T00:38:47.193 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.193+0000 7f0cf44e39c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31]): potential dests added=[] removed=[] 2024-09-12T00:38:47.200 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.197+0000 7f0cf44e39c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:38:47.205 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.205+0000 7f0ba37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:47.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.209+0000 7f0cf44e39c0 20 remove_watcher() i=0 2024-09-12T00:38:47.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.209+0000 7f0cf44e39c0 2 removed watcher, disabling cache 2024-09-12T00:38:47.213 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.213+0000 7f0cf44e39c0 20 remove_watcher() i=1 2024-09-12T00:38:47.215 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.213+0000 7f0cf44e39c0 20 remove_watcher() i=2 2024-09-12T00:38:47.218 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.217+0000 7f0cf44e39c0 20 remove_watcher() i=3 2024-09-12T00:38:47.220 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.217+0000 7f0cf44e39c0 20 remove_watcher() i=4 2024-09-12T00:38:47.222 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.221+0000 7f0cf44e39c0 20 remove_watcher() i=5 2024-09-12T00:38:47.223 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.221+0000 7f0cf44e39c0 20 remove_watcher() i=6 2024-09-12T00:38:47.225 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.225+0000 7f0cf44e39c0 20 remove_watcher() i=7 2024-09-12T00:38:47.248 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:38:47.282 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:47.282 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:47.328 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.325+0000 7fca8d2e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.329 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.329+0000 7fca8d2e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:47.329 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.329+0000 7fca8d2e09c0 20 realm 2024-09-12T00:38:47.329 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.329+0000 7fca8d2e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.329 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.329+0000 7fca8d2e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:47.329 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.329+0000 7fca8d2e09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:47.329 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.329+0000 7fca8d2e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.330 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.329+0000 7fca8d2e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:47.330 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.329+0000 7fca8d2e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.331 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.329+0000 7fca8d2e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:47.331 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.329+0000 7fca8d2e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.332 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.329+0000 7fca8d2e09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:47.332 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.329+0000 7fca8d2e09c0 20 searching for the correct realm 2024-09-12T00:38:47.338 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.337+0000 7fca8b5e7640 0 -- 172.21.15.43:0/3680013919 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x5564a98ff7b0 msgr2=0x5564a9901ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:47.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.341+0000 7fca8a5e5640 0 -- 172.21.15.43:0/3680013919 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fca8002cb60 msgr2=0x7fca8003a930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:47.351 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.349+0000 7fca8d2e09c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:38:47.351 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.349+0000 7fca8d2e09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:47.351 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.349+0000 7fca8d2e09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:47.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.349+0000 7fca8d2e09c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:38:47.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.349+0000 7fca8d2e09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:47.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.349+0000 7fca8d2e09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:47.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.349+0000 7fca8d2e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.349+0000 7fca8d2e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:47.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.349+0000 7fca8d2e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.353 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.349+0000 7fca8d2e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:47.353 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.349+0000 7fca8d2e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.353 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.349+0000 7fca8d2e09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:47.353 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.349+0000 7fca8d2e09c0 20 zone default found 2024-09-12T00:38:47.353 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.349+0000 7fca8d2e09c0 4 Realm: () 2024-09-12T00:38:47.353 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.349+0000 7fca8d2e09c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:38:47.353 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.349+0000 7fca8d2e09c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:38:47.353 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.349+0000 7fca8d2e09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:47.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.349+0000 7fca8d2e09c0 20 zonegroup default 2024-09-12T00:38:47.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.349+0000 7fca8d2e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.353+0000 7fca8d2e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:47.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.353+0000 7fca8d2e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.353+0000 7fca8d2e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:47.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.353+0000 7fca8d2e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.353+0000 7fca8d2e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:47.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.353+0000 7fca8d2e09c0 20 started sync module instance, tier type = 2024-09-12T00:38:47.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.353+0000 7fca8d2e09c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:38:47.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.369+0000 7fca8d2e09c0 20 add_watcher() i=0 2024-09-12T00:38:47.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.369+0000 7fca8d2e09c0 20 add_watcher() i=1 2024-09-12T00:38:47.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.369+0000 7fca8d2e09c0 20 add_watcher() i=2 2024-09-12T00:38:47.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.369+0000 7fca8d2e09c0 20 add_watcher() i=3 2024-09-12T00:38:47.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.369+0000 7fca8d2e09c0 20 add_watcher() i=4 2024-09-12T00:38:47.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.369+0000 7fca8d2e09c0 20 add_watcher() i=5 2024-09-12T00:38:47.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.369+0000 7fca8d2e09c0 20 add_watcher() i=6 2024-09-12T00:38:47.371 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.369+0000 7fca8d2e09c0 20 add_watcher() i=7 2024-09-12T00:38:47.371 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.369+0000 7fca8d2e09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:47.373 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.373+0000 7fc9417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:47.374 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.373+0000 7fca8d2e09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:47.374 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.373+0000 7fca8d2e09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:47.375 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.373+0000 7fca8d2e09c0 5 note: GC not initialized 2024-09-12T00:38:47.375 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.373+0000 7fc8bbfff640 20 reqs_thread_entry: start 2024-09-12T00:38:47.375 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.373+0000 7fca8d2e09c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:47.375 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.373+0000 7fca8d2e09c0 20 Filter name: none 2024-09-12T00:38:47.375 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.373+0000 7fc8b9ffb640 20 reqs_thread_entry: start 2024-09-12T00:38:47.375 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.373+0000 7fca8d2e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.375 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.373+0000 7fca8d2e09c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:47.375 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.373+0000 7fca8d2e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.376 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.373+0000 7fca8d2e09c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:47.376 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.373+0000 7fca8d2e09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:47.376 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.373+0000 7fca8d2e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.377 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.377+0000 7fca8d2e09c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:47.377 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.377+0000 7fca8d2e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.377 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.377+0000 7fca8d2e09c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:47.377 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.377+0000 7fca8d2e09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:47.380 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.377+0000 7fc9417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:47.385 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.381+0000 7fca8d2e09c0 20 remove_watcher() i=0 2024-09-12T00:38:47.385 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.381+0000 7fca8d2e09c0 2 removed watcher, disabling cache 2024-09-12T00:38:47.387 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.385+0000 7fca8d2e09c0 20 remove_watcher() i=1 2024-09-12T00:38:47.389 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.385+0000 7fca8d2e09c0 20 remove_watcher() i=2 2024-09-12T00:38:47.391 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.389+0000 7fca8d2e09c0 20 remove_watcher() i=3 2024-09-12T00:38:47.393 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.389+0000 7fca8d2e09c0 20 remove_watcher() i=4 2024-09-12T00:38:47.394 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.393+0000 7fca8d2e09c0 20 remove_watcher() i=5 2024-09-12T00:38:47.395 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.393+0000 7fca8d2e09c0 20 remove_watcher() i=6 2024-09-12T00:38:47.396 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:47.393+0000 7fca8d2e09c0 20 remove_watcher() i=7 2024-09-12T00:38:47.410 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:47.411 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:38:47.411 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-commit-target-layout id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T00:38:47.411 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:47.412 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:47.412 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:47.415 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:47.415 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:47.459 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:47.459 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:47.499 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-12T00:38:47.499 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:47.500 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:47.500 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:47.519 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:47.519 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:47.565 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:47.565 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:47.583 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:47.584 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:47.603 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:47.603 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:47.622 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:47.622 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:47.641 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:47.641 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:47.660 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:47.661 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:47.680 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:47.680 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:47.699 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:47.699 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:47.717 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:47.718 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:47.738 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:47.738 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:47.759 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:47.759 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:47.779 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:47.779 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:47.799 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:47.799 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:47.820 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:47.820 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:47.840 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:47.840 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:47.860 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:47.860 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:47.880 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:47.880 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:47.899 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:47.900 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:47.919 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:47.919 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:47.938 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:47.938 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:38:47.956 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:38:47.989 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:47.990 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:48.034 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.033+0000 7f2d7e8c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.036 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.033+0000 7f2d7e8c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.037 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.033+0000 7f2d7e8c49c0 20 realm 2024-09-12T00:38:48.037 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.033+0000 7f2d7e8c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.037 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.033+0000 7f2d7e8c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.037 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.033+0000 7f2d7e8c49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:48.037 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.033+0000 7f2d7e8c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.037 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.033+0000 7f2d7e8c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.038 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.033+0000 7f2d7e8c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.039 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.037+0000 7f2d7e8c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:48.039 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.037+0000 7f2d7e8c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.039 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.037+0000 7f2d7e8c49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:48.040 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.037+0000 7f2d7e8c49c0 20 searching for the correct realm 2024-09-12T00:38:48.046 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.045+0000 7f2d7bbc9640 0 -- 172.21.15.43:0/2029622628 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f2d64078040 msgr2=0x7f2d6405b470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:48.052 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.049+0000 7f2d7bbc9640 0 -- 172.21.15.43:0/2029622628 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f2c44080bb0 msgr2=0x7f2c44082fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:48.059 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.057+0000 7f2d7e8c49c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:38:48.059 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.057+0000 7f2d7e8c49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:48.059 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.057+0000 7f2d7e8c49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:48.059 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.057+0000 7f2d7e8c49c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:38:48.060 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.057+0000 7f2d7e8c49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:48.060 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.057+0000 7f2d7e8c49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:48.060 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.057+0000 7f2d7e8c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.060 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.057+0000 7f2d7e8c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.060 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.057+0000 7f2d7e8c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.061 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.057+0000 7f2d7e8c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:48.062 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.057+0000 7f2d7e8c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.062 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.057+0000 7f2d7e8c49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:48.062 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.057+0000 7f2d7e8c49c0 20 zone default found 2024-09-12T00:38:48.062 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.057+0000 7f2d7e8c49c0 4 Realm: () 2024-09-12T00:38:48.062 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.057+0000 7f2d7e8c49c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:38:48.062 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.057+0000 7f2d7e8c49c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:38:48.062 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.057+0000 7f2d7e8c49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:48.062 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.057+0000 7f2d7e8c49c0 20 zonegroup default 2024-09-12T00:38:48.062 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.057+0000 7f2d7e8c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.062 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.057+0000 7f2d7e8c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.057+0000 7f2d7e8c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.061+0000 7f2d7e8c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.061+0000 7f2d7e8c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.061+0000 7f2d7e8c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.061+0000 7f2d7e8c49c0 20 started sync module instance, tier type = 2024-09-12T00:38:48.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.061+0000 7f2d7e8c49c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:38:48.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.077+0000 7f2d7e8c49c0 20 add_watcher() i=0 2024-09-12T00:38:48.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.077+0000 7f2d7e8c49c0 20 add_watcher() i=1 2024-09-12T00:38:48.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.077+0000 7f2d7e8c49c0 20 add_watcher() i=2 2024-09-12T00:38:48.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.077+0000 7f2d7e8c49c0 20 add_watcher() i=3 2024-09-12T00:38:48.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.077+0000 7f2d7e8c49c0 20 add_watcher() i=4 2024-09-12T00:38:48.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.077+0000 7f2d7e8c49c0 20 add_watcher() i=5 2024-09-12T00:38:48.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.077+0000 7f2d7e8c49c0 20 add_watcher() i=6 2024-09-12T00:38:48.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.077+0000 7f2d7e8c49c0 20 add_watcher() i=7 2024-09-12T00:38:48.081 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.077+0000 7f2d7e8c49c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:48.084 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.081+0000 7f2c32fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:48.084 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.081+0000 7f2d7e8c49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:48.084 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.081+0000 7f2d7e8c49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:48.084 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.081+0000 7f2d7e8c49c0 5 note: GC not initialized 2024-09-12T00:38:48.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.081+0000 7f2c31fdb640 20 reqs_thread_entry: start 2024-09-12T00:38:48.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.081+0000 7f2d7e8c49c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:48.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.081+0000 7f2d7e8c49c0 20 Filter name: none 2024-09-12T00:38:48.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.081+0000 7f2ba37fe640 20 reqs_thread_entry: start 2024-09-12T00:38:48.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.081+0000 7f2d7e8c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.086 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.081+0000 7f2d7e8c49c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:48.086 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.081+0000 7f2d7e8c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.085+0000 7f2d7e8c49c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:48.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.085+0000 7f2d7e8c49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:48.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.085+0000 7f2d7e8c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.085+0000 7f2d7e8c49c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:48.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.085+0000 7f2d7e8c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.085+0000 7f2d7e8c49c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:48.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.085+0000 7f2d7e8c49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:48.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.089+0000 7f2c32fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:48.094 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.093+0000 7f2d7e8c49c0 20 remove_watcher() i=0 2024-09-12T00:38:48.094 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.093+0000 7f2d7e8c49c0 2 removed watcher, disabling cache 2024-09-12T00:38:48.096 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.093+0000 7f2d7e8c49c0 20 remove_watcher() i=1 2024-09-12T00:38:48.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.097+0000 7f2d7e8c49c0 20 remove_watcher() i=2 2024-09-12T00:38:48.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.097+0000 7f2d7e8c49c0 20 remove_watcher() i=3 2024-09-12T00:38:48.103 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.101+0000 7f2d7e8c49c0 20 remove_watcher() i=4 2024-09-12T00:38:48.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.101+0000 7f2d7e8c49c0 20 remove_watcher() i=5 2024-09-12T00:38:48.105 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.105+0000 7f2d7e8c49c0 20 remove_watcher() i=6 2024-09-12T00:38:48.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.105+0000 7f2d7e8c49c0 20 remove_watcher() i=7 2024-09-12T00:38:48.121 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.121 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:38:48.121 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: abort-at-commit-target-layout id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:38:48.121 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.121 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-12T00:38:48.154 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:48.154 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:48.197 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.197+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.403 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.401+0000 7ff7f4bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.403 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.401+0000 7ff7f4bb39c0 20 realm 2024-09-12T00:38:48.403 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.401+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.404 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.401+0000 7ff7f4bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.404 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.401+0000 7ff7f4bb39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:48.404 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.401+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.405 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.401+0000 7ff7f4bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.405 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.401+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.407 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.405+0000 7ff7f4bb39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:48.407 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.405+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.409 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.409+0000 7ff7f4bb39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:48.409 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.409+0000 7ff7f4bb39c0 20 searching for the correct realm 2024-09-12T00:38:48.416 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.413+0000 7ff7f26b9640 0 -- 172.21.15.43:0/343199721 >> [v2:172.21.15.97:6816/489545787,v1:172.21.15.97:6817/489545787] conn(0x7ff7ec07f070 msgr2=0x7ff7ec079640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:48.426 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.425+0000 7ff7f26b9640 0 -- 172.21.15.43:0/343199721 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7ff7e8108230 msgr2=0x7ff7e812b700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:48.643 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.641+0000 7ff7f4bb39c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:38:48.644 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.641+0000 7ff7f4bb39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:48.644 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.641+0000 7ff7f4bb39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:48.644 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.641+0000 7ff7f4bb39c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:38:48.644 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.641+0000 7ff7f4bb39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:48.644 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.641+0000 7ff7f4bb39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:48.644 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.641+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.644 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.641+0000 7ff7f4bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.644 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.641+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.645 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:48.645 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.646 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:48.646 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 zone default found 2024-09-12T00:38:48.646 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 4 Realm: () 2024-09-12T00:38:48.646 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:38:48.646 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:38:48.646 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:48.646 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 zonegroup default 2024-09-12T00:38:48.647 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.647 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.647 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.648 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.648 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.649 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.649 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.649+0000 7ff7f4bb39c0 20 started sync module instance, tier type = 2024-09-12T00:38:48.649 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.649+0000 7ff7f4bb39c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:38:48.673 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.673+0000 7ff7f4bb39c0 20 add_watcher() i=0 2024-09-12T00:38:48.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.673+0000 7ff7f4bb39c0 20 add_watcher() i=1 2024-09-12T00:38:48.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.673+0000 7ff7f4bb39c0 20 add_watcher() i=2 2024-09-12T00:38:48.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.673+0000 7ff7f4bb39c0 20 add_watcher() i=3 2024-09-12T00:38:48.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.673+0000 7ff7f4bb39c0 20 add_watcher() i=4 2024-09-12T00:38:48.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.673+0000 7ff7f4bb39c0 20 add_watcher() i=5 2024-09-12T00:38:48.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.673+0000 7ff7f4bb39c0 20 add_watcher() i=6 2024-09-12T00:38:48.676 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.673+0000 7ff7f4bb39c0 20 add_watcher() i=7 2024-09-12T00:38:48.676 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.673+0000 7ff7f4bb39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:48.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.677+0000 7ff6a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:48.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:48.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:48.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 5 note: GC not initialized 2024-09-12T00:38:48.682 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.681+0000 7ff6237fe640 20 reqs_thread_entry: start 2024-09-12T00:38:48.682 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:48.682 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 20 Filter name: none 2024-09-12T00:38:48.682 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.681+0000 7ff6217fa640 20 reqs_thread_entry: start 2024-09-12T00:38:48.682 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:38:48.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:48.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:38:48.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:38:48.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 : miss 2024-09-12T00:38:48.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.684 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:48.685 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 info.flags=0x17 2024-09-12T00:38:48.685 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 to cache LRU end 2024-09-12T00:38:48.685 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:48.685 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:48.685 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 2024-09-12T00:38:48.697 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.693+0000 7ff7f4bb39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 info.flags=0x17 2024-09-12T00:38:48.697 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.693+0000 7ff7f4bb39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 to cache LRU end 2024-09-12T00:38:48.697 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.693+0000 7ff7f4bb39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:48.697 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.693+0000 7ff7f4bb39c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32, ofs0, ns] 2024-09-12T00:38:48.698 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.697+0000 7ff6d57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333494 cookie 94785785926288 notifier 6962 bl.length()=931 2024-09-12T00:38:48.698 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.697+0000 7ff6d57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 info.flags=0x17 2024-09-12T00:38:48.698 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.697+0000 7ff6d57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 to cache LRU end 2024-09-12T00:38:48.698 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.697+0000 7ff6d57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:48.698 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.697+0000 7ff7f4bb39c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): orig_sources= new_sources= 2024-09-12T00:38:48.698 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.697+0000 7ff7f4bb39c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): potential sources added=[] removed=[] 2024-09-12T00:38:48.698 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.697+0000 7ff7f4bb39c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): orig_dests= new_dests= 2024-09-12T00:38:48.698 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.697+0000 7ff7f4bb39c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): potential dests added=[] removed=[] 2024-09-12T00:38:48.711 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.0 2024-09-12T00:38:48.711 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.0 2024-09-12T00:38:48.711 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.1 2024-09-12T00:38:48.711 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.1 2024-09-12T00:38:48.711 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.2 2024-09-12T00:38:48.711 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.2 2024-09-12T00:38:48.711 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.3 2024-09-12T00:38:48.711 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.3 2024-09-12T00:38:48.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.4 2024-09-12T00:38:48.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.4 2024-09-12T00:38:48.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.5 2024-09-12T00:38:48.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.5 2024-09-12T00:38:48.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.6 2024-09-12T00:38:48.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.6 2024-09-12T00:38:48.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.7 2024-09-12T00:38:48.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.7 2024-09-12T00:38:48.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.8 2024-09-12T00:38:48.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.8 2024-09-12T00:38:48.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.9 2024-09-12T00:38:48.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.9 2024-09-12T00:38:48.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.10 2024-09-12T00:38:48.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.10 2024-09-12T00:38:48.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.11 2024-09-12T00:38:48.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.11 2024-09-12T00:38:48.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.0 2024-09-12T00:38:48.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1 2024-09-12T00:38:48.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.2 2024-09-12T00:38:48.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.713+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.3 2024-09-12T00:38:48.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.713+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.4 2024-09-12T00:38:48.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.713+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.5 2024-09-12T00:38:48.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.717+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.6 2024-09-12T00:38:48.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.717+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.7 2024-09-12T00:38:48.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.717+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.8 2024-09-12T00:38:48.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.721+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.9 2024-09-12T00:38:48.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.721+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.10 2024-09-12T00:38:48.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.725+0000 7ff7f4bb39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:48.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.725+0000 7ff7f4bb39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 2024-09-12T00:38:48.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.729+0000 7ff7f4bb39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 info.flags=0x17 2024-09-12T00:38:48.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.729+0000 7ff7f4bb39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 to cache LRU end 2024-09-12T00:38:48.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.729+0000 7ff7f4bb39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:48.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.729+0000 7ff7f4bb39c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32, ofs0, ns] 2024-09-12T00:38:48.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.729+0000 7ff6d5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333495 cookie 94785785926288 notifier 6962 bl.length()=931 2024-09-12T00:38:48.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.729+0000 7ff6d5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 info.flags=0x17 2024-09-12T00:38:48.732 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.729+0000 7ff6d5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 to cache LRU end 2024-09-12T00:38:48.732 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.729+0000 7ff6d5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:48.732 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.729+0000 7ff7f4bb39c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): orig_sources= new_sources= 2024-09-12T00:38:48.732 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.729+0000 7ff7f4bb39c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): potential sources added=[] removed=[] 2024-09-12T00:38:48.732 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.729+0000 7ff7f4bb39c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): orig_dests= new_dests= 2024-09-12T00:38:48.732 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.729+0000 7ff7f4bb39c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): potential dests added=[] removed=[] 2024-09-12T00:38:48.737 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.737+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.0 2024-09-12T00:38:48.737 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.737+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1 2024-09-12T00:38:48.738 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.737+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.2 2024-09-12T00:38:48.738 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.737+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.3 2024-09-12T00:38:48.739 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.737+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.4 2024-09-12T00:38:48.740 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.737+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.5 2024-09-12T00:38:48.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.741+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.6 2024-09-12T00:38:48.742 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.741+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.7 2024-09-12T00:38:48.742 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.741+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.8 2024-09-12T00:38:48.743 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.741+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.9 2024-09-12T00:38:48.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.741+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.10 2024-09-12T00:38:48.744 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff7f4bb39c0 time 2024-09-12T00:38:48.748413+0000 2024-09-12T00:38:48.744 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:38:48.746 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:48.746 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff7f848d2eb] 2024-09-12T00:38:48.746 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff7f848d49f] 2024-09-12T00:38:48.746 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56350703ecc1] 2024-09-12T00:38:48.746 INFO:tasks.workunit.client.0.smithi043.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x563507053fc7] 2024-09-12T00:38:48.746 INFO:tasks.workunit.client.0.smithi043.stderr: 5: main() 2024-09-12T00:38:48.746 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff7f72f3d90] 2024-09-12T00:38:48.746 INFO:tasks.workunit.client.0.smithi043.stderr: 7: __libc_start_main() 2024-09-12T00:38:48.746 INFO:tasks.workunit.client.0.smithi043.stderr: 8: _start() 2024-09-12T00:38:48.747 INFO:tasks.workunit.client.0.smithi043.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:38:48.747 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7ff7f4bb39c0 thread_name:radosgw-admin 2024-09-12T00:38:48.747 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.745+0000 7ff7f4bb39c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff7f4bb39c0 time 2024-09-12T00:38:48.748413+0000 2024-09-12T00:38:48.747 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:38:48.747 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.747 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:48.747 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff7f848d2eb] 2024-09-12T00:38:48.747 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff7f848d49f] 2024-09-12T00:38:48.747 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56350703ecc1] 2024-09-12T00:38:48.747 INFO:tasks.workunit.client.0.smithi043.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x563507053fc7] 2024-09-12T00:38:48.747 INFO:tasks.workunit.client.0.smithi043.stderr: 5: main() 2024-09-12T00:38:48.747 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff7f72f3d90] 2024-09-12T00:38:48.748 INFO:tasks.workunit.client.0.smithi043.stderr: 7: __libc_start_main() 2024-09-12T00:38:48.748 INFO:tasks.workunit.client.0.smithi043.stderr: 8: _start() 2024-09-12T00:38:48.748 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.764 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:48.765 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff7f730c520] 2024-09-12T00:38:48.765 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:38:48.765 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:38:48.765 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:38:48.765 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff7f848d345] 2024-09-12T00:38:48.765 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff7f848d49f] 2024-09-12T00:38:48.765 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56350703ecc1] 2024-09-12T00:38:48.765 INFO:tasks.workunit.client.0.smithi043.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x563507053fc7] 2024-09-12T00:38:48.765 INFO:tasks.workunit.client.0.smithi043.stderr: 9: main() 2024-09-12T00:38:48.765 INFO:tasks.workunit.client.0.smithi043.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff7f72f3d90] 2024-09-12T00:38:48.765 INFO:tasks.workunit.client.0.smithi043.stderr: 11: __libc_start_main() 2024-09-12T00:38:48.765 INFO:tasks.workunit.client.0.smithi043.stderr: 12: _start() 2024-09-12T00:38:48.766 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.745+0000 7ff7f4bb39c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:38:48.766 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7ff7f4bb39c0 thread_name:radosgw-admin 2024-09-12T00:38:48.766 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.766 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:48.766 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff7f730c520] 2024-09-12T00:38:48.766 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:38:48.766 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:38:48.766 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:38:48.766 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff7f848d345] 2024-09-12T00:38:48.766 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff7f848d49f] 2024-09-12T00:38:48.766 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56350703ecc1] 2024-09-12T00:38:48.766 INFO:tasks.workunit.client.0.smithi043.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x563507053fc7] 2024-09-12T00:38:48.767 INFO:tasks.workunit.client.0.smithi043.stderr: 9: main() 2024-09-12T00:38:48.767 INFO:tasks.workunit.client.0.smithi043.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff7f72f3d90] 2024-09-12T00:38:48.767 INFO:tasks.workunit.client.0.smithi043.stderr: 11: __libc_start_main() 2024-09-12T00:38:48.767 INFO:tasks.workunit.client.0.smithi043.stderr: 12: _start() 2024-09-12T00:38:48.767 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:38:48.767 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.767 INFO:tasks.workunit.client.0.smithi043.stderr:--- begin dump of recent events --- 2024-09-12T00:38:48.767 INFO:tasks.workunit.client.0.smithi043.stderr: -499> 2024-09-12T00:38:48.177+0000 7ff7f4bb39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:48.767 INFO:tasks.workunit.client.0.smithi043.stderr: -498> 2024-09-12T00:38:48.177+0000 7ff7f4bb39c0 10 monclient(hunting): authenticate will time out at 2224.169675s 2024-09-12T00:38:48.767 INFO:tasks.workunit.client.0.smithi043.stderr: -497> 2024-09-12T00:38:48.177+0000 7ff7f2eba640 10 monclient(hunting): get_auth_request con 0x563508fe5e50 auth_method 0 2024-09-12T00:38:48.767 INFO:tasks.workunit.client.0.smithi043.stderr: -496> 2024-09-12T00:38:48.177+0000 7ff7f2eba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.767 INFO:tasks.workunit.client.0.smithi043.stderr: -495> 2024-09-12T00:38:48.177+0000 7ff7f2eba640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.767 INFO:tasks.workunit.client.0.smithi043.stderr: -494> 2024-09-12T00:38:48.177+0000 7ff7f2eba640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.768 INFO:tasks.workunit.client.0.smithi043.stderr: -493> 2024-09-12T00:38:48.177+0000 7ff7f1eb8640 10 monclient(hunting): get_auth_request con 0x563508fe2f60 auth_method 0 2024-09-12T00:38:48.768 INFO:tasks.workunit.client.0.smithi043.stderr: -492> 2024-09-12T00:38:48.177+0000 7ff7f1eb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.768 INFO:tasks.workunit.client.0.smithi043.stderr: -491> 2024-09-12T00:38:48.177+0000 7ff7f1eb8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.768 INFO:tasks.workunit.client.0.smithi043.stderr: -490> 2024-09-12T00:38:48.177+0000 7ff7f1eb8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.768 INFO:tasks.workunit.client.0.smithi043.stderr: -489> 2024-09-12T00:38:48.177+0000 7ff7f2eba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:48.768 INFO:tasks.workunit.client.0.smithi043.stderr: -488> 2024-09-12T00:38:48.177+0000 7ff7f2eba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:48.768 INFO:tasks.workunit.client.0.smithi043.stderr: -487> 2024-09-12T00:38:48.177+0000 7ff7f2eba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:48.768 INFO:tasks.workunit.client.0.smithi043.stderr: -486> 2024-09-12T00:38:48.177+0000 7ff7f1eb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:48.768 INFO:tasks.workunit.client.0.smithi043.stderr: -485> 2024-09-12T00:38:48.177+0000 7ff7f1eb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:48.768 INFO:tasks.workunit.client.0.smithi043.stderr: -484> 2024-09-12T00:38:48.177+0000 7ff7f1eb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:48.768 INFO:tasks.workunit.client.0.smithi043.stderr: -483> 2024-09-12T00:38:48.177+0000 7ff7f26b9640 10 monclient(hunting): get_auth_request con 0x563508f2b900 auth_method 0 2024-09-12T00:38:48.768 INFO:tasks.workunit.client.0.smithi043.stderr: -482> 2024-09-12T00:38:48.177+0000 7ff7f26b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.768 INFO:tasks.workunit.client.0.smithi043.stderr: -481> 2024-09-12T00:38:48.177+0000 7ff7f26b9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.769 INFO:tasks.workunit.client.0.smithi043.stderr: -480> 2024-09-12T00:38:48.177+0000 7ff7f26b9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.769 INFO:tasks.workunit.client.0.smithi043.stderr: -479> 2024-09-12T00:38:48.177+0000 7ff7f2eba640 10 monclient(hunting): handle_auth_done global_id 6953 payload 824 2024-09-12T00:38:48.769 INFO:tasks.workunit.client.0.smithi043.stderr: -478> 2024-09-12T00:38:48.177+0000 7ff7f2eba640 10 monclient: _finish_hunting 0 2024-09-12T00:38:48.769 INFO:tasks.workunit.client.0.smithi043.stderr: -477> 2024-09-12T00:38:48.177+0000 7ff7f2eba640 1 monclient: found mon.noname-c 2024-09-12T00:38:48.769 INFO:tasks.workunit.client.0.smithi043.stderr: -476> 2024-09-12T00:38:48.177+0000 7ff7f2eba640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:38:48.769 INFO:tasks.workunit.client.0.smithi043.stderr: -475> 2024-09-12T00:38:48.177+0000 7ff6dee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:48.769 INFO:tasks.workunit.client.0.smithi043.stderr: -474> 2024-09-12T00:38:48.177+0000 7ff6dee05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:38:48.769 INFO:tasks.workunit.client.0.smithi043.stderr: -473> 2024-09-12T00:38:48.177+0000 7ff6dee05640 10 monclient: dump: 2024-09-12T00:38:48.769 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:48.769 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:48.769 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.769 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.769 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:48.770 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:48.770 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:48.770 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:48.770 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:48.770 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.770 INFO:tasks.workunit.client.0.smithi043.stderr: -472> 2024-09-12T00:38:48.177+0000 7ff6dee05640 10 monclient: _finish_auth 0 2024-09-12T00:38:48.770 INFO:tasks.workunit.client.0.smithi043.stderr: -471> 2024-09-12T00:38:48.177+0000 7ff6dee05640 10 monclient: _check_auth_tickets 2024-09-12T00:38:48.770 INFO:tasks.workunit.client.0.smithi043.stderr: -470> 2024-09-12T00:38:48.177+0000 7ff7f4bb39c0 5 monclient: authenticate success, global_id 6953 2024-09-12T00:38:48.770 INFO:tasks.workunit.client.0.smithi043.stderr: -469> 2024-09-12T00:38:48.177+0000 7ff7f4bb39c0 10 monclient: _renew_subs 2024-09-12T00:38:48.770 INFO:tasks.workunit.client.0.smithi043.stderr: -468> 2024-09-12T00:38:48.177+0000 7ff7f4bb39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:38:48.770 INFO:tasks.workunit.client.0.smithi043.stderr: -467> 2024-09-12T00:38:48.177+0000 7ff6dee05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:48.770 INFO:tasks.workunit.client.0.smithi043.stderr: -466> 2024-09-12T00:38:48.177+0000 7ff6dee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:48.770 INFO:tasks.workunit.client.0.smithi043.stderr: -465> 2024-09-12T00:38:48.177+0000 7ff6dee05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:38:48.771 INFO:tasks.workunit.client.0.smithi043.stderr: -464> 2024-09-12T00:38:48.177+0000 7ff6dee05640 10 monclient: dump: 2024-09-12T00:38:48.771 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:48.771 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:48.771 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.771 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.771 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:48.771 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:48.771 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:48.771 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:48.771 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:48.771 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.771 INFO:tasks.workunit.client.0.smithi043.stderr: -463> 2024-09-12T00:38:48.177+0000 7ff7f4bb39c0 10 monclient: _renew_subs 2024-09-12T00:38:48.771 INFO:tasks.workunit.client.0.smithi043.stderr: -462> 2024-09-12T00:38:48.177+0000 7ff6e0608640 4 set_mon_vals no callback set 2024-09-12T00:38:48.771 INFO:tasks.workunit.client.0.smithi043.stderr: -461> 2024-09-12T00:38:48.177+0000 7ff7f4bb39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:38:48.772 INFO:tasks.workunit.client.0.smithi043.stderr: -460> 2024-09-12T00:38:48.177+0000 7ff7f4bb39c0 1 librados: init done 2024-09-12T00:38:48.772 INFO:tasks.workunit.client.0.smithi043.stderr: -459> 2024-09-12T00:38:48.181+0000 7ff6dee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:38:48.772 INFO:tasks.workunit.client.0.smithi043.stderr: -458> 2024-09-12T00:38:48.181+0000 7ff6dee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:38:48.772 INFO:tasks.workunit.client.0.smithi043.stderr: -457> 2024-09-12T00:38:48.181+0000 7ff6dee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:38:48.772 INFO:tasks.workunit.client.0.smithi043.stderr: -456> 2024-09-12T00:38:48.181+0000 7ff7f26b9640 10 monclient: get_auth_request con 0x7ff6d8070ae0 auth_method 0 2024-09-12T00:38:48.772 INFO:tasks.workunit.client.0.smithi043.stderr: -455> 2024-09-12T00:38:48.181+0000 7ff7f1eb8640 10 monclient: get_auth_request con 0x5635090e2580 auth_method 0 2024-09-12T00:38:48.772 INFO:tasks.workunit.client.0.smithi043.stderr: -454> 2024-09-12T00:38:48.181+0000 7ff7f26b9640 10 monclient: get_auth_request con 0x5635090e5760 auth_method 0 2024-09-12T00:38:48.772 INFO:tasks.workunit.client.0.smithi043.stderr: -453> 2024-09-12T00:38:48.181+0000 7ff7f1eb8640 10 monclient: get_auth_request con 0x5635090e9950 auth_method 0 2024-09-12T00:38:48.772 INFO:tasks.workunit.client.0.smithi043.stderr: -452> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient: build_initial_monmap 2024-09-12T00:38:48.772 INFO:tasks.workunit.client.0.smithi043.stderr: -451> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 1 build_initial for_mkfs: 0 2024-09-12T00:38:48.772 INFO:tasks.workunit.client.0.smithi043.stderr: -450> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient: monmap: 2024-09-12T00:38:48.772 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:38:48.773 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:48.773 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:38:48.773 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:38:48.773 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:48.773 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:48.773 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:38:48.773 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:38:48.773 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:38:48.773 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.773 INFO:tasks.workunit.client.0.smithi043.stderr: -449> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ee5b0) adding auth protocol: cephx 2024-09-12T00:38:48.773 INFO:tasks.workunit.client.0.smithi043.stderr: -448> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ee5b0) adding auth protocol: cephx 2024-09-12T00:38:48.773 INFO:tasks.workunit.client.0.smithi043.stderr: -447> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ee5b0) adding auth protocol: cephx 2024-09-12T00:38:48.773 INFO:tasks.workunit.client.0.smithi043.stderr: -446> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ee5b0) adding con mode: secure 2024-09-12T00:38:48.774 INFO:tasks.workunit.client.0.smithi043.stderr: -445> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ee5b0) adding con mode: crc 2024-09-12T00:38:48.774 INFO:tasks.workunit.client.0.smithi043.stderr: -444> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ee5b0) adding con mode: secure 2024-09-12T00:38:48.774 INFO:tasks.workunit.client.0.smithi043.stderr: -443> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ee5b0) adding con mode: crc 2024-09-12T00:38:48.774 INFO:tasks.workunit.client.0.smithi043.stderr: -442> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ee5b0) adding con mode: secure 2024-09-12T00:38:48.774 INFO:tasks.workunit.client.0.smithi043.stderr: -441> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ee5b0) adding con mode: crc 2024-09-12T00:38:48.774 INFO:tasks.workunit.client.0.smithi043.stderr: -440> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ee5b0) adding con mode: crc 2024-09-12T00:38:48.774 INFO:tasks.workunit.client.0.smithi043.stderr: -439> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ee5b0) adding con mode: secure 2024-09-12T00:38:48.774 INFO:tasks.workunit.client.0.smithi043.stderr: -438> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ee5b0) adding con mode: crc 2024-09-12T00:38:48.774 INFO:tasks.workunit.client.0.smithi043.stderr: -437> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ee5b0) adding con mode: secure 2024-09-12T00:38:48.774 INFO:tasks.workunit.client.0.smithi043.stderr: -436> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ee5b0) adding con mode: crc 2024-09-12T00:38:48.774 INFO:tasks.workunit.client.0.smithi043.stderr: -435> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ee5b0) adding con mode: secure 2024-09-12T00:38:48.774 INFO:tasks.workunit.client.0.smithi043.stderr: -434> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.775 INFO:tasks.workunit.client.0.smithi043.stderr: -433> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 asok(0x563508e8f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5635090f1fa0 EEXIST 2024-09-12T00:38:48.775 INFO:tasks.workunit.client.0.smithi043.stderr: -432> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient: init 2024-09-12T00:38:48.775 INFO:tasks.workunit.client.0.smithi043.stderr: -431> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ecc88) adding auth protocol: cephx 2024-09-12T00:38:48.775 INFO:tasks.workunit.client.0.smithi043.stderr: -430> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ecc88) adding auth protocol: cephx 2024-09-12T00:38:48.775 INFO:tasks.workunit.client.0.smithi043.stderr: -429> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ecc88) adding auth protocol: cephx 2024-09-12T00:38:48.775 INFO:tasks.workunit.client.0.smithi043.stderr: -428> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ecc88) adding con mode: secure 2024-09-12T00:38:48.775 INFO:tasks.workunit.client.0.smithi043.stderr: -427> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ecc88) adding con mode: crc 2024-09-12T00:38:48.775 INFO:tasks.workunit.client.0.smithi043.stderr: -426> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ecc88) adding con mode: secure 2024-09-12T00:38:48.775 INFO:tasks.workunit.client.0.smithi043.stderr: -425> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ecc88) adding con mode: crc 2024-09-12T00:38:48.775 INFO:tasks.workunit.client.0.smithi043.stderr: -424> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ecc88) adding con mode: secure 2024-09-12T00:38:48.775 INFO:tasks.workunit.client.0.smithi043.stderr: -423> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ecc88) adding con mode: crc 2024-09-12T00:38:48.775 INFO:tasks.workunit.client.0.smithi043.stderr: -422> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ecc88) adding con mode: crc 2024-09-12T00:38:48.775 INFO:tasks.workunit.client.0.smithi043.stderr: -421> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ecc88) adding con mode: secure 2024-09-12T00:38:48.776 INFO:tasks.workunit.client.0.smithi043.stderr: -420> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ecc88) adding con mode: crc 2024-09-12T00:38:48.776 INFO:tasks.workunit.client.0.smithi043.stderr: -419> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ecc88) adding con mode: secure 2024-09-12T00:38:48.776 INFO:tasks.workunit.client.0.smithi043.stderr: -418> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ecc88) adding con mode: crc 2024-09-12T00:38:48.776 INFO:tasks.workunit.client.0.smithi043.stderr: -417> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ecc88) adding con mode: secure 2024-09-12T00:38:48.776 INFO:tasks.workunit.client.0.smithi043.stderr: -416> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.776 INFO:tasks.workunit.client.0.smithi043.stderr: -415> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.776 INFO:tasks.workunit.client.0.smithi043.stderr: -414> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 asok(0x563508e8f2b0) register_command rotate-key cmddesc rotate-key hook 0x5635090ecdd0 EEXIST 2024-09-12T00:38:48.776 INFO:tasks.workunit.client.0.smithi043.stderr: -413> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:48.776 INFO:tasks.workunit.client.0.smithi043.stderr: -412> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:38:48.776 INFO:tasks.workunit.client.0.smithi043.stderr: -411> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient(hunting): picked mon.noname-a con 0x563509116150 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:38:48.776 INFO:tasks.workunit.client.0.smithi043.stderr: -410> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient(hunting): picked mon.noname-b con 0x563509115a80 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:38:48.776 INFO:tasks.workunit.client.0.smithi043.stderr: -409> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient(hunting): picked mon.noname-c con 0x563509114460 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:38:48.776 INFO:tasks.workunit.client.0.smithi043.stderr: -408> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.776 INFO:tasks.workunit.client.0.smithi043.stderr: -407> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.777 INFO:tasks.workunit.client.0.smithi043.stderr: -406> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.777 INFO:tasks.workunit.client.0.smithi043.stderr: -405> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:48.777 INFO:tasks.workunit.client.0.smithi043.stderr: -404> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient(hunting): authenticate will time out at 2224.179029s 2024-09-12T00:38:48.777 INFO:tasks.workunit.client.0.smithi043.stderr: -403> 2024-09-12T00:38:48.185+0000 7ff7f2eba640 10 monclient(hunting): get_auth_request con 0x563509114460 auth_method 0 2024-09-12T00:38:48.777 INFO:tasks.workunit.client.0.smithi043.stderr: -402> 2024-09-12T00:38:48.185+0000 7ff7f2eba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.777 INFO:tasks.workunit.client.0.smithi043.stderr: -401> 2024-09-12T00:38:48.185+0000 7ff7f2eba640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.777 INFO:tasks.workunit.client.0.smithi043.stderr: -400> 2024-09-12T00:38:48.185+0000 7ff7f2eba640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.777 INFO:tasks.workunit.client.0.smithi043.stderr: -399> 2024-09-12T00:38:48.185+0000 7ff7f26b9640 10 monclient(hunting): get_auth_request con 0x563509116150 auth_method 0 2024-09-12T00:38:48.777 INFO:tasks.workunit.client.0.smithi043.stderr: -398> 2024-09-12T00:38:48.185+0000 7ff7f26b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.777 INFO:tasks.workunit.client.0.smithi043.stderr: -397> 2024-09-12T00:38:48.185+0000 7ff7f26b9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.777 INFO:tasks.workunit.client.0.smithi043.stderr: -396> 2024-09-12T00:38:48.185+0000 7ff7f26b9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.777 INFO:tasks.workunit.client.0.smithi043.stderr: -395> 2024-09-12T00:38:48.185+0000 7ff7f2eba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:48.777 INFO:tasks.workunit.client.0.smithi043.stderr: -394> 2024-09-12T00:38:48.185+0000 7ff7f2eba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:48.778 INFO:tasks.workunit.client.0.smithi043.stderr: -393> 2024-09-12T00:38:48.185+0000 7ff7f2eba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:48.778 INFO:tasks.workunit.client.0.smithi043.stderr: -392> 2024-09-12T00:38:48.185+0000 7ff7f26b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:48.778 INFO:tasks.workunit.client.0.smithi043.stderr: -391> 2024-09-12T00:38:48.185+0000 7ff7f26b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:48.778 INFO:tasks.workunit.client.0.smithi043.stderr: -390> 2024-09-12T00:38:48.185+0000 7ff7f26b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:48.778 INFO:tasks.workunit.client.0.smithi043.stderr: -389> 2024-09-12T00:38:48.185+0000 7ff7f1eb8640 10 monclient(hunting): get_auth_request con 0x563509115a80 auth_method 0 2024-09-12T00:38:48.778 INFO:tasks.workunit.client.0.smithi043.stderr: -388> 2024-09-12T00:38:48.185+0000 7ff7f1eb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.778 INFO:tasks.workunit.client.0.smithi043.stderr: -387> 2024-09-12T00:38:48.185+0000 7ff7f1eb8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.778 INFO:tasks.workunit.client.0.smithi043.stderr: -386> 2024-09-12T00:38:48.185+0000 7ff7f1eb8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.778 INFO:tasks.workunit.client.0.smithi043.stderr: -385> 2024-09-12T00:38:48.185+0000 7ff7f2eba640 10 monclient(hunting): handle_auth_done global_id 6956 payload 824 2024-09-12T00:38:48.778 INFO:tasks.workunit.client.0.smithi043.stderr: -384> 2024-09-12T00:38:48.185+0000 7ff7f2eba640 10 monclient: _finish_hunting 0 2024-09-12T00:38:48.778 INFO:tasks.workunit.client.0.smithi043.stderr: -383> 2024-09-12T00:38:48.185+0000 7ff7f2eba640 1 monclient: found mon.noname-c 2024-09-12T00:38:48.778 INFO:tasks.workunit.client.0.smithi043.stderr: -382> 2024-09-12T00:38:48.185+0000 7ff7f2eba640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:38:48.778 INFO:tasks.workunit.client.0.smithi043.stderr: -381> 2024-09-12T00:38:48.185+0000 7ff6d7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:48.779 INFO:tasks.workunit.client.0.smithi043.stderr: -380> 2024-09-12T00:38:48.185+0000 7ff6d7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:38:48.779 INFO:tasks.workunit.client.0.smithi043.stderr: -379> 2024-09-12T00:38:48.185+0000 7ff6d7fff640 10 monclient: dump: 2024-09-12T00:38:48.779 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:48.779 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:48.779 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.779 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.779 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:48.779 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:48.779 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:48.779 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:48.779 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:48.779 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.779 INFO:tasks.workunit.client.0.smithi043.stderr: -378> 2024-09-12T00:38:48.185+0000 7ff6d7fff640 10 monclient: _finish_auth 0 2024-09-12T00:38:48.780 INFO:tasks.workunit.client.0.smithi043.stderr: -377> 2024-09-12T00:38:48.185+0000 7ff6d7fff640 10 monclient: _check_auth_tickets 2024-09-12T00:38:48.780 INFO:tasks.workunit.client.0.smithi043.stderr: -376> 2024-09-12T00:38:48.185+0000 7ff6d7fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:48.780 INFO:tasks.workunit.client.0.smithi043.stderr: -375> 2024-09-12T00:38:48.185+0000 7ff6d7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:48.780 INFO:tasks.workunit.client.0.smithi043.stderr: -374> 2024-09-12T00:38:48.185+0000 7ff6d7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:38:48.780 INFO:tasks.workunit.client.0.smithi043.stderr: -373> 2024-09-12T00:38:48.185+0000 7ff6d7fff640 10 monclient: dump: 2024-09-12T00:38:48.780 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:48.780 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:48.780 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.780 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.780 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:48.780 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:48.780 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:48.780 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:48.781 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:48.781 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.781 INFO:tasks.workunit.client.0.smithi043.stderr: -372> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 monclient: authenticate success, global_id 6956 2024-09-12T00:38:48.781 INFO:tasks.workunit.client.0.smithi043.stderr: -371> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient: _renew_subs 2024-09-12T00:38:48.781 INFO:tasks.workunit.client.0.smithi043.stderr: -370> 2024-09-12T00:38:48.185+0000 7ff7f36bb640 4 set_mon_vals no callback set 2024-09-12T00:38:48.781 INFO:tasks.workunit.client.0.smithi043.stderr: -369> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:38:48.781 INFO:tasks.workunit.client.0.smithi043.stderr: -368> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient: _renew_subs 2024-09-12T00:38:48.781 INFO:tasks.workunit.client.0.smithi043.stderr: -367> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:38:48.781 INFO:tasks.workunit.client.0.smithi043.stderr: -366> 2024-09-12T00:38:48.189+0000 7ff6d7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:38:48.781 INFO:tasks.workunit.client.0.smithi043.stderr: -365> 2024-09-12T00:38:48.189+0000 7ff6d7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:38:48.781 INFO:tasks.workunit.client.0.smithi043.stderr: -364> 2024-09-12T00:38:48.189+0000 7ff6d7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:38:48.781 INFO:tasks.workunit.client.0.smithi043.stderr: -363> 2024-09-12T00:38:48.189+0000 7ff7f26b9640 10 monclient: get_auth_request con 0x7ff6cc070a20 auth_method 0 2024-09-12T00:38:48.781 INFO:tasks.workunit.client.0.smithi043.stderr: -362> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 10 monclient: get_monmap_and_config 2024-09-12T00:38:48.782 INFO:tasks.workunit.client.0.smithi043.stderr: -361> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 10 monclient: build_initial_monmap 2024-09-12T00:38:48.782 INFO:tasks.workunit.client.0.smithi043.stderr: -360> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 1 build_initial for_mkfs: 0 2024-09-12T00:38:48.782 INFO:tasks.workunit.client.0.smithi043.stderr: -359> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 10 monclient: monmap: 2024-09-12T00:38:48.782 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:38:48.782 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:48.782 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:38:48.782 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:38:48.782 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:48.782 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:48.782 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:38:48.782 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:38:48.782 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:38:48.782 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.782 INFO:tasks.workunit.client.0.smithi043.stderr: -358> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509135b20) adding auth protocol: cephx 2024-09-12T00:38:48.783 INFO:tasks.workunit.client.0.smithi043.stderr: -357> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509135b20) adding auth protocol: cephx 2024-09-12T00:38:48.783 INFO:tasks.workunit.client.0.smithi043.stderr: -356> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509135b20) adding auth protocol: cephx 2024-09-12T00:38:48.783 INFO:tasks.workunit.client.0.smithi043.stderr: -355> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509135b20) adding con mode: secure 2024-09-12T00:38:48.783 INFO:tasks.workunit.client.0.smithi043.stderr: -354> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509135b20) adding con mode: crc 2024-09-12T00:38:48.783 INFO:tasks.workunit.client.0.smithi043.stderr: -353> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509135b20) adding con mode: secure 2024-09-12T00:38:48.783 INFO:tasks.workunit.client.0.smithi043.stderr: -352> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509135b20) adding con mode: crc 2024-09-12T00:38:48.783 INFO:tasks.workunit.client.0.smithi043.stderr: -351> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509135b20) adding con mode: secure 2024-09-12T00:38:48.783 INFO:tasks.workunit.client.0.smithi043.stderr: -350> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509135b20) adding con mode: crc 2024-09-12T00:38:48.783 INFO:tasks.workunit.client.0.smithi043.stderr: -349> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509135b20) adding con mode: crc 2024-09-12T00:38:48.783 INFO:tasks.workunit.client.0.smithi043.stderr: -348> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509135b20) adding con mode: secure 2024-09-12T00:38:48.783 INFO:tasks.workunit.client.0.smithi043.stderr: -347> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509135b20) adding con mode: crc 2024-09-12T00:38:48.783 INFO:tasks.workunit.client.0.smithi043.stderr: -346> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509135b20) adding con mode: secure 2024-09-12T00:38:48.783 INFO:tasks.workunit.client.0.smithi043.stderr: -345> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509135b20) adding con mode: crc 2024-09-12T00:38:48.784 INFO:tasks.workunit.client.0.smithi043.stderr: -344> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509135b20) adding con mode: secure 2024-09-12T00:38:48.784 INFO:tasks.workunit.client.0.smithi043.stderr: -343> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.784 INFO:tasks.workunit.client.0.smithi043.stderr: -342> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 10 monclient: init 2024-09-12T00:38:48.784 INFO:tasks.workunit.client.0.smithi043.stderr: -341> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3460) adding auth protocol: cephx 2024-09-12T00:38:48.784 INFO:tasks.workunit.client.0.smithi043.stderr: -340> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3460) adding auth protocol: cephx 2024-09-12T00:38:48.784 INFO:tasks.workunit.client.0.smithi043.stderr: -339> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3460) adding auth protocol: cephx 2024-09-12T00:38:48.784 INFO:tasks.workunit.client.0.smithi043.stderr: -338> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3460) adding con mode: secure 2024-09-12T00:38:48.784 INFO:tasks.workunit.client.0.smithi043.stderr: -337> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3460) adding con mode: crc 2024-09-12T00:38:48.784 INFO:tasks.workunit.client.0.smithi043.stderr: -336> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3460) adding con mode: secure 2024-09-12T00:38:48.784 INFO:tasks.workunit.client.0.smithi043.stderr: -335> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3460) adding con mode: crc 2024-09-12T00:38:48.784 INFO:tasks.workunit.client.0.smithi043.stderr: -334> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3460) adding con mode: secure 2024-09-12T00:38:48.784 INFO:tasks.workunit.client.0.smithi043.stderr: -333> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3460) adding con mode: crc 2024-09-12T00:38:48.784 INFO:tasks.workunit.client.0.smithi043.stderr: -332> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3460) adding con mode: crc 2024-09-12T00:38:48.785 INFO:tasks.workunit.client.0.smithi043.stderr: -331> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3460) adding con mode: secure 2024-09-12T00:38:48.785 INFO:tasks.workunit.client.0.smithi043.stderr: -330> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3460) adding con mode: crc 2024-09-12T00:38:48.785 INFO:tasks.workunit.client.0.smithi043.stderr: -329> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3460) adding con mode: secure 2024-09-12T00:38:48.785 INFO:tasks.workunit.client.0.smithi043.stderr: -328> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3460) adding con mode: crc 2024-09-12T00:38:48.785 INFO:tasks.workunit.client.0.smithi043.stderr: -327> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3460) adding con mode: secure 2024-09-12T00:38:48.785 INFO:tasks.workunit.client.0.smithi043.stderr: -326> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.785 INFO:tasks.workunit.client.0.smithi043.stderr: -325> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.785 INFO:tasks.workunit.client.0.smithi043.stderr: -324> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 asok(0x563508e8f2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffed50f35a8 EEXIST 2024-09-12T00:38:48.785 INFO:tasks.workunit.client.0.smithi043.stderr: -323> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:48.785 INFO:tasks.workunit.client.0.smithi043.stderr: -322> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:38:48.785 INFO:tasks.workunit.client.0.smithi043.stderr: -321> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 10 monclient(hunting): picked mon.noname-a con 0x56350916a010 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:38:48.785 INFO:tasks.workunit.client.0.smithi043.stderr: -320> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 10 monclient(hunting): picked mon.noname-c con 0x563509165400 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:38:48.785 INFO:tasks.workunit.client.0.smithi043.stderr: -319> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 10 monclient(hunting): picked mon.noname-b con 0x563509165d80 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:38:48.786 INFO:tasks.workunit.client.0.smithi043.stderr: -318> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.786 INFO:tasks.workunit.client.0.smithi043.stderr: -317> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.786 INFO:tasks.workunit.client.0.smithi043.stderr: -316> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.786 INFO:tasks.workunit.client.0.smithi043.stderr: -315> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:48.786 INFO:tasks.workunit.client.0.smithi043.stderr: -314> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 10 monclient(hunting): authenticate will time out at 2224.182961s 2024-09-12T00:38:48.786 INFO:tasks.workunit.client.0.smithi043.stderr: -313> 2024-09-12T00:38:48.189+0000 7ff7f1eb8640 10 monclient(hunting): get_auth_request con 0x563509165400 auth_method 0 2024-09-12T00:38:48.786 INFO:tasks.workunit.client.0.smithi043.stderr: -312> 2024-09-12T00:38:48.189+0000 7ff7f1eb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.786 INFO:tasks.workunit.client.0.smithi043.stderr: -311> 2024-09-12T00:38:48.189+0000 7ff7f1eb8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.787 INFO:tasks.workunit.client.0.smithi043.stderr: -310> 2024-09-12T00:38:48.189+0000 7ff7f1eb8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.787 INFO:tasks.workunit.client.0.smithi043.stderr: -309> 2024-09-12T00:38:48.189+0000 7ff7f26b9640 10 monclient(hunting): get_auth_request con 0x56350916a010 auth_method 0 2024-09-12T00:38:48.787 INFO:tasks.workunit.client.0.smithi043.stderr: -308> 2024-09-12T00:38:48.189+0000 7ff7f26b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.787 INFO:tasks.workunit.client.0.smithi043.stderr: -307> 2024-09-12T00:38:48.189+0000 7ff7f26b9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.787 INFO:tasks.workunit.client.0.smithi043.stderr: -306> 2024-09-12T00:38:48.189+0000 7ff7f26b9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.787 INFO:tasks.workunit.client.0.smithi043.stderr: -305> 2024-09-12T00:38:48.189+0000 7ff7f26b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:48.787 INFO:tasks.workunit.client.0.smithi043.stderr: -304> 2024-09-12T00:38:48.189+0000 7ff7f26b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:48.787 INFO:tasks.workunit.client.0.smithi043.stderr: -303> 2024-09-12T00:38:48.189+0000 7ff7f26b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:48.787 INFO:tasks.workunit.client.0.smithi043.stderr: -302> 2024-09-12T00:38:48.189+0000 7ff7f1eb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:48.787 INFO:tasks.workunit.client.0.smithi043.stderr: -301> 2024-09-12T00:38:48.189+0000 7ff7f1eb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:48.787 INFO:tasks.workunit.client.0.smithi043.stderr: -300> 2024-09-12T00:38:48.189+0000 7ff7f1eb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:48.787 INFO:tasks.workunit.client.0.smithi043.stderr: -299> 2024-09-12T00:38:48.189+0000 7ff7f2eba640 10 monclient(hunting): get_auth_request con 0x563509165d80 auth_method 0 2024-09-12T00:38:48.787 INFO:tasks.workunit.client.0.smithi043.stderr: -298> 2024-09-12T00:38:48.189+0000 7ff7f2eba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.787 INFO:tasks.workunit.client.0.smithi043.stderr: -297> 2024-09-12T00:38:48.189+0000 7ff7f2eba640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.788 INFO:tasks.workunit.client.0.smithi043.stderr: -296> 2024-09-12T00:38:48.189+0000 7ff7f2eba640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.788 INFO:tasks.workunit.client.0.smithi043.stderr: -295> 2024-09-12T00:38:48.189+0000 7ff7f26b9640 10 monclient(hunting): handle_auth_done global_id 7257 payload 274 2024-09-12T00:38:48.788 INFO:tasks.workunit.client.0.smithi043.stderr: -294> 2024-09-12T00:38:48.189+0000 7ff7f26b9640 10 monclient: _finish_hunting 0 2024-09-12T00:38:48.788 INFO:tasks.workunit.client.0.smithi043.stderr: -293> 2024-09-12T00:38:48.189+0000 7ff7f26b9640 1 monclient: found mon.noname-a 2024-09-12T00:38:48.788 INFO:tasks.workunit.client.0.smithi043.stderr: -292> 2024-09-12T00:38:48.189+0000 7ff7f26b9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:38:48.788 INFO:tasks.workunit.client.0.smithi043.stderr: -291> 2024-09-12T00:38:48.189+0000 7ff6d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:48.788 INFO:tasks.workunit.client.0.smithi043.stderr: -290> 2024-09-12T00:38:48.189+0000 7ff6d5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:38:48.788 INFO:tasks.workunit.client.0.smithi043.stderr: -289> 2024-09-12T00:38:48.189+0000 7ff6d5ffb640 10 monclient: dump: 2024-09-12T00:38:48.788 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:48.788 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:48.788 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.788 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.789 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:48.789 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:48.789 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:48.789 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:48.789 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:48.789 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.789 INFO:tasks.workunit.client.0.smithi043.stderr: -288> 2024-09-12T00:38:48.189+0000 7ff6d5ffb640 10 monclient: _finish_auth 0 2024-09-12T00:38:48.789 INFO:tasks.workunit.client.0.smithi043.stderr: -287> 2024-09-12T00:38:48.189+0000 7ff6d5ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:38:48.789 INFO:tasks.workunit.client.0.smithi043.stderr: -286> 2024-09-12T00:38:48.189+0000 7ff6d5ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:48.789 INFO:tasks.workunit.client.0.smithi043.stderr: -285> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 monclient: authenticate success, global_id 7257 2024-09-12T00:38:48.789 INFO:tasks.workunit.client.0.smithi043.stderr: -284> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 10 monclient: get_monmap_and_config success 2024-09-12T00:38:48.789 INFO:tasks.workunit.client.0.smithi043.stderr: -283> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 4 set_mon_vals no callback set 2024-09-12T00:38:48.789 INFO:tasks.workunit.client.0.smithi043.stderr: -282> 2024-09-12T00:38:48.189+0000 7ff6d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:48.790 INFO:tasks.workunit.client.0.smithi043.stderr: -281> 2024-09-12T00:38:48.189+0000 7ff6d5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:48.790 INFO:tasks.workunit.client.0.smithi043.stderr: -280> 2024-09-12T00:38:48.189+0000 7ff6d5ffb640 10 monclient: dump: 2024-09-12T00:38:48.790 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:48.790 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:48.790 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.790 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.790 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:48.790 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:48.790 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:48.790 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:48.790 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:48.790 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.790 INFO:tasks.workunit.client.0.smithi043.stderr: -279> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient: shutdown 2024-09-12T00:38:48.790 INFO:tasks.workunit.client.0.smithi043.stderr: -278> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient: build_initial_monmap 2024-09-12T00:38:48.791 INFO:tasks.workunit.client.0.smithi043.stderr: -277> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 1 build_initial for_mkfs: 0 2024-09-12T00:38:48.791 INFO:tasks.workunit.client.0.smithi043.stderr: -276> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient: monmap: 2024-09-12T00:38:48.791 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:38:48.791 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:48.791 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:38:48.791 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:38:48.791 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:48.791 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:48.791 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:38:48.791 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:38:48.791 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:38:48.792 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.792 INFO:tasks.workunit.client.0.smithi043.stderr: -275> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x56350915c3f0) adding auth protocol: cephx 2024-09-12T00:38:48.792 INFO:tasks.workunit.client.0.smithi043.stderr: -274> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x56350915c3f0) adding auth protocol: cephx 2024-09-12T00:38:48.792 INFO:tasks.workunit.client.0.smithi043.stderr: -273> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x56350915c3f0) adding auth protocol: cephx 2024-09-12T00:38:48.792 INFO:tasks.workunit.client.0.smithi043.stderr: -272> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x56350915c3f0) adding con mode: secure 2024-09-12T00:38:48.792 INFO:tasks.workunit.client.0.smithi043.stderr: -271> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x56350915c3f0) adding con mode: crc 2024-09-12T00:38:48.792 INFO:tasks.workunit.client.0.smithi043.stderr: -270> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x56350915c3f0) adding con mode: secure 2024-09-12T00:38:48.792 INFO:tasks.workunit.client.0.smithi043.stderr: -269> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x56350915c3f0) adding con mode: crc 2024-09-12T00:38:48.792 INFO:tasks.workunit.client.0.smithi043.stderr: -268> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x56350915c3f0) adding con mode: secure 2024-09-12T00:38:48.792 INFO:tasks.workunit.client.0.smithi043.stderr: -267> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x56350915c3f0) adding con mode: crc 2024-09-12T00:38:48.793 INFO:tasks.workunit.client.0.smithi043.stderr: -266> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x56350915c3f0) adding con mode: crc 2024-09-12T00:38:48.793 INFO:tasks.workunit.client.0.smithi043.stderr: -265> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x56350915c3f0) adding con mode: secure 2024-09-12T00:38:48.793 INFO:tasks.workunit.client.0.smithi043.stderr: -264> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x56350915c3f0) adding con mode: crc 2024-09-12T00:38:48.793 INFO:tasks.workunit.client.0.smithi043.stderr: -263> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x56350915c3f0) adding con mode: secure 2024-09-12T00:38:48.793 INFO:tasks.workunit.client.0.smithi043.stderr: -262> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x56350915c3f0) adding con mode: crc 2024-09-12T00:38:48.793 INFO:tasks.workunit.client.0.smithi043.stderr: -261> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x56350915c3f0) adding con mode: secure 2024-09-12T00:38:48.793 INFO:tasks.workunit.client.0.smithi043.stderr: -260> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.793 INFO:tasks.workunit.client.0.smithi043.stderr: -259> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 1 librados: starting msgr at 2024-09-12T00:38:48.793 INFO:tasks.workunit.client.0.smithi043.stderr: -258> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 1 librados: starting objecter 2024-09-12T00:38:48.793 INFO:tasks.workunit.client.0.smithi043.stderr: -257> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 asok(0x563508e8f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x563509138670 EEXIST 2024-09-12T00:38:48.793 INFO:tasks.workunit.client.0.smithi043.stderr: -256> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 1 librados: setting wanted keys 2024-09-12T00:38:48.793 INFO:tasks.workunit.client.0.smithi043.stderr: -255> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 1 librados: calling monclient init 2024-09-12T00:38:48.793 INFO:tasks.workunit.client.0.smithi043.stderr: -254> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient: init 2024-09-12T00:38:48.794 INFO:tasks.workunit.client.0.smithi043.stderr: -253> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509117f70) adding auth protocol: cephx 2024-09-12T00:38:48.794 INFO:tasks.workunit.client.0.smithi043.stderr: -252> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509117f70) adding auth protocol: cephx 2024-09-12T00:38:48.794 INFO:tasks.workunit.client.0.smithi043.stderr: -251> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509117f70) adding auth protocol: cephx 2024-09-12T00:38:48.794 INFO:tasks.workunit.client.0.smithi043.stderr: -250> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509117f70) adding con mode: secure 2024-09-12T00:38:48.794 INFO:tasks.workunit.client.0.smithi043.stderr: -249> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509117f70) adding con mode: crc 2024-09-12T00:38:48.794 INFO:tasks.workunit.client.0.smithi043.stderr: -248> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509117f70) adding con mode: secure 2024-09-12T00:38:48.794 INFO:tasks.workunit.client.0.smithi043.stderr: -247> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509117f70) adding con mode: crc 2024-09-12T00:38:48.794 INFO:tasks.workunit.client.0.smithi043.stderr: -246> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509117f70) adding con mode: secure 2024-09-12T00:38:48.794 INFO:tasks.workunit.client.0.smithi043.stderr: -245> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509117f70) adding con mode: crc 2024-09-12T00:38:48.794 INFO:tasks.workunit.client.0.smithi043.stderr: -244> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509117f70) adding con mode: crc 2024-09-12T00:38:48.794 INFO:tasks.workunit.client.0.smithi043.stderr: -243> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509117f70) adding con mode: secure 2024-09-12T00:38:48.794 INFO:tasks.workunit.client.0.smithi043.stderr: -242> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509117f70) adding con mode: crc 2024-09-12T00:38:48.795 INFO:tasks.workunit.client.0.smithi043.stderr: -241> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509117f70) adding con mode: secure 2024-09-12T00:38:48.795 INFO:tasks.workunit.client.0.smithi043.stderr: -240> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509117f70) adding con mode: crc 2024-09-12T00:38:48.795 INFO:tasks.workunit.client.0.smithi043.stderr: -239> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509117f70) adding con mode: secure 2024-09-12T00:38:48.795 INFO:tasks.workunit.client.0.smithi043.stderr: -238> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.795 INFO:tasks.workunit.client.0.smithi043.stderr: -237> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.795 INFO:tasks.workunit.client.0.smithi043.stderr: -236> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 asok(0x563508e8f2b0) register_command rotate-key cmddesc rotate-key hook 0x5635091180b8 EEXIST 2024-09-12T00:38:48.795 INFO:tasks.workunit.client.0.smithi043.stderr: -235> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:48.795 INFO:tasks.workunit.client.0.smithi043.stderr: -234> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:38:48.795 INFO:tasks.workunit.client.0.smithi043.stderr: -233> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient(hunting): picked mon.noname-b con 0x563509165400 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:38:48.795 INFO:tasks.workunit.client.0.smithi043.stderr: -232> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient(hunting): picked mon.noname-c con 0x563509165d80 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:38:48.795 INFO:tasks.workunit.client.0.smithi043.stderr: -231> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient(hunting): picked mon.noname-a con 0x56350916a010 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:38:48.795 INFO:tasks.workunit.client.0.smithi043.stderr: -230> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.795 INFO:tasks.workunit.client.0.smithi043.stderr: -229> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.796 INFO:tasks.workunit.client.0.smithi043.stderr: -228> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.796 INFO:tasks.workunit.client.0.smithi043.stderr: -227> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:48.796 INFO:tasks.workunit.client.0.smithi043.stderr: -226> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient(hunting): authenticate will time out at 2224.185737s 2024-09-12T00:38:48.796 INFO:tasks.workunit.client.0.smithi043.stderr: -225> 2024-09-12T00:38:48.193+0000 7ff7f1eb8640 10 monclient(hunting): get_auth_request con 0x563509165d80 auth_method 0 2024-09-12T00:38:48.796 INFO:tasks.workunit.client.0.smithi043.stderr: -224> 2024-09-12T00:38:48.193+0000 7ff7f1eb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.796 INFO:tasks.workunit.client.0.smithi043.stderr: -223> 2024-09-12T00:38:48.193+0000 7ff7f1eb8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.796 INFO:tasks.workunit.client.0.smithi043.stderr: -222> 2024-09-12T00:38:48.193+0000 7ff7f1eb8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.796 INFO:tasks.workunit.client.0.smithi043.stderr: -221> 2024-09-12T00:38:48.193+0000 7ff7f2eba640 10 monclient(hunting): get_auth_request con 0x56350916a010 auth_method 0 2024-09-12T00:38:48.796 INFO:tasks.workunit.client.0.smithi043.stderr: -220> 2024-09-12T00:38:48.193+0000 7ff7f2eba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.796 INFO:tasks.workunit.client.0.smithi043.stderr: -219> 2024-09-12T00:38:48.193+0000 7ff7f2eba640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.796 INFO:tasks.workunit.client.0.smithi043.stderr: -218> 2024-09-12T00:38:48.193+0000 7ff7f2eba640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.796 INFO:tasks.workunit.client.0.smithi043.stderr: -217> 2024-09-12T00:38:48.193+0000 7ff7f1eb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:48.797 INFO:tasks.workunit.client.0.smithi043.stderr: -216> 2024-09-12T00:38:48.193+0000 7ff7f1eb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:48.797 INFO:tasks.workunit.client.0.smithi043.stderr: -215> 2024-09-12T00:38:48.193+0000 7ff7f1eb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:48.797 INFO:tasks.workunit.client.0.smithi043.stderr: -214> 2024-09-12T00:38:48.193+0000 7ff7f2eba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:48.797 INFO:tasks.workunit.client.0.smithi043.stderr: -213> 2024-09-12T00:38:48.193+0000 7ff7f2eba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:48.797 INFO:tasks.workunit.client.0.smithi043.stderr: -212> 2024-09-12T00:38:48.193+0000 7ff7f2eba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:48.797 INFO:tasks.workunit.client.0.smithi043.stderr: -211> 2024-09-12T00:38:48.193+0000 7ff7f26b9640 10 monclient(hunting): get_auth_request con 0x563509165400 auth_method 0 2024-09-12T00:38:48.797 INFO:tasks.workunit.client.0.smithi043.stderr: -210> 2024-09-12T00:38:48.193+0000 7ff7f26b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.797 INFO:tasks.workunit.client.0.smithi043.stderr: -209> 2024-09-12T00:38:48.193+0000 7ff7f26b9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.797 INFO:tasks.workunit.client.0.smithi043.stderr: -208> 2024-09-12T00:38:48.193+0000 7ff7f26b9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.797 INFO:tasks.workunit.client.0.smithi043.stderr: -207> 2024-09-12T00:38:48.193+0000 7ff7f1eb8640 10 monclient(hunting): handle_auth_done global_id 6962 payload 824 2024-09-12T00:38:48.797 INFO:tasks.workunit.client.0.smithi043.stderr: -206> 2024-09-12T00:38:48.193+0000 7ff7f1eb8640 10 monclient: _finish_hunting 0 2024-09-12T00:38:48.797 INFO:tasks.workunit.client.0.smithi043.stderr: -205> 2024-09-12T00:38:48.193+0000 7ff7f1eb8640 1 monclient: found mon.noname-c 2024-09-12T00:38:48.797 INFO:tasks.workunit.client.0.smithi043.stderr: -204> 2024-09-12T00:38:48.193+0000 7ff7f1eb8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:38:48.798 INFO:tasks.workunit.client.0.smithi043.stderr: -203> 2024-09-12T00:38:48.193+0000 7ff6c3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:48.798 INFO:tasks.workunit.client.0.smithi043.stderr: -202> 2024-09-12T00:38:48.193+0000 7ff6c3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:38:48.798 INFO:tasks.workunit.client.0.smithi043.stderr: -201> 2024-09-12T00:38:48.193+0000 7ff6c3fff640 10 monclient: dump: 2024-09-12T00:38:48.798 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:48.798 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:48.798 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.798 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.798 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:48.798 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:48.798 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:48.798 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:48.798 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:48.798 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.799 INFO:tasks.workunit.client.0.smithi043.stderr: -200> 2024-09-12T00:38:48.193+0000 7ff6c3fff640 10 monclient: _finish_auth 0 2024-09-12T00:38:48.799 INFO:tasks.workunit.client.0.smithi043.stderr: -199> 2024-09-12T00:38:48.193+0000 7ff6c3fff640 10 monclient: _check_auth_tickets 2024-09-12T00:38:48.799 INFO:tasks.workunit.client.0.smithi043.stderr: -198> 2024-09-12T00:38:48.193+0000 7ff6c3fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:48.799 INFO:tasks.workunit.client.0.smithi043.stderr: -197> 2024-09-12T00:38:48.193+0000 7ff6c3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:48.799 INFO:tasks.workunit.client.0.smithi043.stderr: -196> 2024-09-12T00:38:48.193+0000 7ff6c3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:38:48.799 INFO:tasks.workunit.client.0.smithi043.stderr: -195> 2024-09-12T00:38:48.193+0000 7ff6c3fff640 10 monclient: dump: 2024-09-12T00:38:48.799 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:48.799 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:48.799 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.799 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.799 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:48.799 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:48.799 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:48.799 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:48.800 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:48.800 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.800 INFO:tasks.workunit.client.0.smithi043.stderr: -194> 2024-09-12T00:38:48.193+0000 7ff6d5ffb640 4 set_mon_vals no callback set 2024-09-12T00:38:48.800 INFO:tasks.workunit.client.0.smithi043.stderr: -193> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 monclient: authenticate success, global_id 6962 2024-09-12T00:38:48.800 INFO:tasks.workunit.client.0.smithi043.stderr: -192> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient: _renew_subs 2024-09-12T00:38:48.800 INFO:tasks.workunit.client.0.smithi043.stderr: -191> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:38:48.800 INFO:tasks.workunit.client.0.smithi043.stderr: -190> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient: _renew_subs 2024-09-12T00:38:48.800 INFO:tasks.workunit.client.0.smithi043.stderr: -189> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:38:48.800 INFO:tasks.workunit.client.0.smithi043.stderr: -188> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 1 librados: init done 2024-09-12T00:38:48.800 INFO:tasks.workunit.client.0.smithi043.stderr: -187> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 asok(0x563508e8f2b0) register_command cr dump hook 0x56350915b688 2024-09-12T00:38:48.800 INFO:tasks.workunit.client.0.smithi043.stderr: -186> 2024-09-12T00:38:48.197+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.800 INFO:tasks.workunit.client.0.smithi043.stderr: -185> 2024-09-12T00:38:48.197+0000 7ff6c3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:38:48.801 INFO:tasks.workunit.client.0.smithi043.stderr: -184> 2024-09-12T00:38:48.197+0000 7ff6c3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:38:48.801 INFO:tasks.workunit.client.0.smithi043.stderr: -183> 2024-09-12T00:38:48.197+0000 7ff6c3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:38:48.801 INFO:tasks.workunit.client.0.smithi043.stderr: -182> 2024-09-12T00:38:48.197+0000 7ff7f26b9640 10 monclient: get_auth_request con 0x7ff6bc070ae0 auth_method 0 2024-09-12T00:38:48.801 INFO:tasks.workunit.client.0.smithi043.stderr: -181> 2024-09-12T00:38:48.197+0000 7ff7f2eba640 10 monclient: get_auth_request con 0x563509183970 auth_method 0 2024-09-12T00:38:48.801 INFO:tasks.workunit.client.0.smithi043.stderr: -180> 2024-09-12T00:38:48.401+0000 7ff7f2eba640 10 monclient: get_auth_request con 0x563509183970 auth_method 0 2024-09-12T00:38:48.801 INFO:tasks.workunit.client.0.smithi043.stderr: -179> 2024-09-12T00:38:48.401+0000 7ff7f4bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.801 INFO:tasks.workunit.client.0.smithi043.stderr: -178> 2024-09-12T00:38:48.401+0000 7ff7f4bb39c0 20 realm 2024-09-12T00:38:48.801 INFO:tasks.workunit.client.0.smithi043.stderr: -177> 2024-09-12T00:38:48.401+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.801 INFO:tasks.workunit.client.0.smithi043.stderr: -176> 2024-09-12T00:38:48.401+0000 7ff7f4bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.801 INFO:tasks.workunit.client.0.smithi043.stderr: -175> 2024-09-12T00:38:48.401+0000 7ff7f4bb39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:48.801 INFO:tasks.workunit.client.0.smithi043.stderr: -174> 2024-09-12T00:38:48.401+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.801 INFO:tasks.workunit.client.0.smithi043.stderr: -173> 2024-09-12T00:38:48.401+0000 7ff7f4bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.801 INFO:tasks.workunit.client.0.smithi043.stderr: -172> 2024-09-12T00:38:48.401+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.802 INFO:tasks.workunit.client.0.smithi043.stderr: -171> 2024-09-12T00:38:48.405+0000 7ff7f26b9640 10 monclient: get_auth_request con 0x563509187be0 auth_method 0 2024-09-12T00:38:48.802 INFO:tasks.workunit.client.0.smithi043.stderr: -170> 2024-09-12T00:38:48.405+0000 7ff7f4bb39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:48.802 INFO:tasks.workunit.client.0.smithi043.stderr: -169> 2024-09-12T00:38:48.405+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.802 INFO:tasks.workunit.client.0.smithi043.stderr: -168> 2024-09-12T00:38:48.405+0000 7ff7f1eb8640 10 monclient: get_auth_request con 0x56350918b440 auth_method 0 2024-09-12T00:38:48.802 INFO:tasks.workunit.client.0.smithi043.stderr: -167> 2024-09-12T00:38:48.409+0000 7ff7f4bb39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:48.802 INFO:tasks.workunit.client.0.smithi043.stderr: -166> 2024-09-12T00:38:48.409+0000 7ff7f4bb39c0 20 searching for the correct realm 2024-09-12T00:38:48.802 INFO:tasks.workunit.client.0.smithi043.stderr: -165> 2024-09-12T00:38:48.409+0000 7ff7f2eba640 10 monclient: get_auth_request con 0x5635091901e0 auth_method 0 2024-09-12T00:38:48.802 INFO:tasks.workunit.client.0.smithi043.stderr: -164> 2024-09-12T00:38:48.409+0000 7ff7f26b9640 10 monclient: get_auth_request con 0x7ff7ec07f070 auth_method 0 2024-09-12T00:38:48.802 INFO:tasks.workunit.client.0.smithi043.stderr: -163> 2024-09-12T00:38:48.413+0000 7ff7f1eb8640 10 monclient: get_auth_request con 0x7ff7e80cac20 auth_method 0 2024-09-12T00:38:48.802 INFO:tasks.workunit.client.0.smithi043.stderr: -162> 2024-09-12T00:38:48.413+0000 7ff7f26b9640 0 -- 172.21.15.43:0/343199721 >> [v2:172.21.15.97:6816/489545787,v1:172.21.15.97:6817/489545787] conn(0x7ff7ec07f070 msgr2=0x7ff7ec079640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:48.802 INFO:tasks.workunit.client.0.smithi043.stderr: -161> 2024-09-12T00:38:48.413+0000 7ff6c3fff640 1 client.6962.objecter ms_handle_reset 0x7ff7ec07f070 session 0x7ff7ec088fa0 osd.7 2024-09-12T00:38:48.802 INFO:tasks.workunit.client.0.smithi043.stderr: -160> 2024-09-12T00:38:48.413+0000 7ff6c3fff640 10 monclient: _renew_subs 2024-09-12T00:38:48.803 INFO:tasks.workunit.client.0.smithi043.stderr: -159> 2024-09-12T00:38:48.413+0000 7ff6c3fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:38:48.803 INFO:tasks.workunit.client.0.smithi043.stderr: -158> 2024-09-12T00:38:48.417+0000 7ff7f26b9640 10 monclient: get_auth_request con 0x7ff6bc080b00 auth_method 0 2024-09-12T00:38:48.803 INFO:tasks.workunit.client.0.smithi043.stderr: -157> 2024-09-12T00:38:48.417+0000 7ff7f2eba640 10 monclient: get_auth_request con 0x7ff7e80ff690 auth_method 0 2024-09-12T00:38:48.803 INFO:tasks.workunit.client.0.smithi043.stderr: -156> 2024-09-12T00:38:48.425+0000 7ff7f26b9640 10 monclient: get_auth_request con 0x7ff7e8108230 auth_method 0 2024-09-12T00:38:48.803 INFO:tasks.workunit.client.0.smithi043.stderr: -155> 2024-09-12T00:38:48.425+0000 7ff7f26b9640 0 -- 172.21.15.43:0/343199721 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7ff7e8108230 msgr2=0x7ff7e812b700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:48.803 INFO:tasks.workunit.client.0.smithi043.stderr: -154> 2024-09-12T00:38:48.629+0000 7ff7f26b9640 10 monclient: get_auth_request con 0x7ff7e8108230 auth_method 0 2024-09-12T00:38:48.803 INFO:tasks.workunit.client.0.smithi043.stderr: -153> 2024-09-12T00:38:48.641+0000 7ff7f4bb39c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:38:48.803 INFO:tasks.workunit.client.0.smithi043.stderr: -152> 2024-09-12T00:38:48.641+0000 7ff7f4bb39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:48.803 INFO:tasks.workunit.client.0.smithi043.stderr: -151> 2024-09-12T00:38:48.641+0000 7ff7f4bb39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:48.803 INFO:tasks.workunit.client.0.smithi043.stderr: -150> 2024-09-12T00:38:48.641+0000 7ff7f4bb39c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:38:48.803 INFO:tasks.workunit.client.0.smithi043.stderr: -149> 2024-09-12T00:38:48.641+0000 7ff7f4bb39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:48.803 INFO:tasks.workunit.client.0.smithi043.stderr: -148> 2024-09-12T00:38:48.641+0000 7ff7f4bb39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:48.803 INFO:tasks.workunit.client.0.smithi043.stderr: -147> 2024-09-12T00:38:48.641+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.804 INFO:tasks.workunit.client.0.smithi043.stderr: -146> 2024-09-12T00:38:48.641+0000 7ff7f4bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.804 INFO:tasks.workunit.client.0.smithi043.stderr: -145> 2024-09-12T00:38:48.641+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.804 INFO:tasks.workunit.client.0.smithi043.stderr: -144> 2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:48.804 INFO:tasks.workunit.client.0.smithi043.stderr: -143> 2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.804 INFO:tasks.workunit.client.0.smithi043.stderr: -142> 2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:48.804 INFO:tasks.workunit.client.0.smithi043.stderr: -141> 2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 zone default found 2024-09-12T00:38:48.804 INFO:tasks.workunit.client.0.smithi043.stderr: -140> 2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 4 Realm: () 2024-09-12T00:38:48.804 INFO:tasks.workunit.client.0.smithi043.stderr: -139> 2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:38:48.804 INFO:tasks.workunit.client.0.smithi043.stderr: -138> 2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:38:48.804 INFO:tasks.workunit.client.0.smithi043.stderr: -137> 2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:48.804 INFO:tasks.workunit.client.0.smithi043.stderr: -136> 2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 zonegroup default 2024-09-12T00:38:48.804 INFO:tasks.workunit.client.0.smithi043.stderr: -135> 2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.805 INFO:tasks.workunit.client.0.smithi043.stderr: -134> 2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.805 INFO:tasks.workunit.client.0.smithi043.stderr: -133> 2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.805 INFO:tasks.workunit.client.0.smithi043.stderr: -132> 2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.805 INFO:tasks.workunit.client.0.smithi043.stderr: -131> 2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.805 INFO:tasks.workunit.client.0.smithi043.stderr: -130> 2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.805 INFO:tasks.workunit.client.0.smithi043.stderr: -129> 2024-09-12T00:38:48.649+0000 7ff7f4bb39c0 20 started sync module instance, tier type = 2024-09-12T00:38:48.805 INFO:tasks.workunit.client.0.smithi043.stderr: -128> 2024-09-12T00:38:48.649+0000 7ff7f4bb39c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:38:48.805 INFO:tasks.workunit.client.0.smithi043.stderr: -127> 2024-09-12T00:38:48.673+0000 7ff7f4bb39c0 20 add_watcher() i=0 2024-09-12T00:38:48.805 INFO:tasks.workunit.client.0.smithi043.stderr: -126> 2024-09-12T00:38:48.673+0000 7ff7f4bb39c0 20 add_watcher() i=1 2024-09-12T00:38:48.805 INFO:tasks.workunit.client.0.smithi043.stderr: -125> 2024-09-12T00:38:48.673+0000 7ff7f4bb39c0 20 add_watcher() i=2 2024-09-12T00:38:48.805 INFO:tasks.workunit.client.0.smithi043.stderr: -124> 2024-09-12T00:38:48.673+0000 7ff7f4bb39c0 20 add_watcher() i=3 2024-09-12T00:38:48.805 INFO:tasks.workunit.client.0.smithi043.stderr: -123> 2024-09-12T00:38:48.673+0000 7ff7f4bb39c0 20 add_watcher() i=4 2024-09-12T00:38:48.805 INFO:tasks.workunit.client.0.smithi043.stderr: -122> 2024-09-12T00:38:48.673+0000 7ff7f4bb39c0 20 add_watcher() i=5 2024-09-12T00:38:48.806 INFO:tasks.workunit.client.0.smithi043.stderr: -121> 2024-09-12T00:38:48.673+0000 7ff7f4bb39c0 20 add_watcher() i=6 2024-09-12T00:38:48.806 INFO:tasks.workunit.client.0.smithi043.stderr: -120> 2024-09-12T00:38:48.673+0000 7ff7f4bb39c0 20 add_watcher() i=7 2024-09-12T00:38:48.806 INFO:tasks.workunit.client.0.smithi043.stderr: -119> 2024-09-12T00:38:48.673+0000 7ff7f4bb39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:48.806 INFO:tasks.workunit.client.0.smithi043.stderr: -118> 2024-09-12T00:38:48.677+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3940) adding auth protocol: cephx 2024-09-12T00:38:48.806 INFO:tasks.workunit.client.0.smithi043.stderr: -117> 2024-09-12T00:38:48.677+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3940) adding auth protocol: cephx 2024-09-12T00:38:48.806 INFO:tasks.workunit.client.0.smithi043.stderr: -116> 2024-09-12T00:38:48.677+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3940) adding auth protocol: cephx 2024-09-12T00:38:48.806 INFO:tasks.workunit.client.0.smithi043.stderr: -115> 2024-09-12T00:38:48.677+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3940) adding con mode: secure 2024-09-12T00:38:48.806 INFO:tasks.workunit.client.0.smithi043.stderr: -114> 2024-09-12T00:38:48.677+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3940) adding con mode: crc 2024-09-12T00:38:48.806 INFO:tasks.workunit.client.0.smithi043.stderr: -113> 2024-09-12T00:38:48.677+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3940) adding con mode: secure 2024-09-12T00:38:48.806 INFO:tasks.workunit.client.0.smithi043.stderr: -112> 2024-09-12T00:38:48.677+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3940) adding con mode: crc 2024-09-12T00:38:48.806 INFO:tasks.workunit.client.0.smithi043.stderr: -111> 2024-09-12T00:38:48.677+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3940) adding con mode: secure 2024-09-12T00:38:48.806 INFO:tasks.workunit.client.0.smithi043.stderr: -110> 2024-09-12T00:38:48.677+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3940) adding con mode: crc 2024-09-12T00:38:48.806 INFO:tasks.workunit.client.0.smithi043.stderr: -109> 2024-09-12T00:38:48.677+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3940) adding con mode: crc 2024-09-12T00:38:48.807 INFO:tasks.workunit.client.0.smithi043.stderr: -108> 2024-09-12T00:38:48.677+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3940) adding con mode: secure 2024-09-12T00:38:48.807 INFO:tasks.workunit.client.0.smithi043.stderr: -107> 2024-09-12T00:38:48.677+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3940) adding con mode: crc 2024-09-12T00:38:48.807 INFO:tasks.workunit.client.0.smithi043.stderr: -106> 2024-09-12T00:38:48.677+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3940) adding con mode: secure 2024-09-12T00:38:48.807 INFO:tasks.workunit.client.0.smithi043.stderr: -105> 2024-09-12T00:38:48.677+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3940) adding con mode: crc 2024-09-12T00:38:48.807 INFO:tasks.workunit.client.0.smithi043.stderr: -104> 2024-09-12T00:38:48.677+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3940) adding con mode: secure 2024-09-12T00:38:48.807 INFO:tasks.workunit.client.0.smithi043.stderr: -103> 2024-09-12T00:38:48.677+0000 7ff6a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:48.807 INFO:tasks.workunit.client.0.smithi043.stderr: -102> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.807 INFO:tasks.workunit.client.0.smithi043.stderr: -101> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:48.807 INFO:tasks.workunit.client.0.smithi043.stderr: -100> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:48.807 INFO:tasks.workunit.client.0.smithi043.stderr: -99> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 5 asok(0x563508e8f2b0) register_command cache list hook 0x563509163750 2024-09-12T00:38:48.807 INFO:tasks.workunit.client.0.smithi043.stderr: -98> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 5 asok(0x563508e8f2b0) register_command cache inspect hook 0x563509163750 2024-09-12T00:38:48.807 INFO:tasks.workunit.client.0.smithi043.stderr: -97> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 5 asok(0x563508e8f2b0) register_command cache erase hook 0x563509163750 2024-09-12T00:38:48.807 INFO:tasks.workunit.client.0.smithi043.stderr: -96> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 5 asok(0x563508e8f2b0) register_command cache zap hook 0x563509163750 2024-09-12T00:38:48.808 INFO:tasks.workunit.client.0.smithi043.stderr: -95> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 5 note: GC not initialized 2024-09-12T00:38:48.808 INFO:tasks.workunit.client.0.smithi043.stderr: -94> 2024-09-12T00:38:48.681+0000 7ff6237fe640 20 reqs_thread_entry: start 2024-09-12T00:38:48.808 INFO:tasks.workunit.client.0.smithi043.stderr: -93> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 5 asok(0x563508e8f2b0) register_command sync trace show hook 0x7ff7e402e050 2024-09-12T00:38:48.808 INFO:tasks.workunit.client.0.smithi043.stderr: -92> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 5 asok(0x563508e8f2b0) register_command sync trace history hook 0x7ff7e402e050 2024-09-12T00:38:48.808 INFO:tasks.workunit.client.0.smithi043.stderr: -91> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 5 asok(0x563508e8f2b0) register_command sync trace active hook 0x7ff7e402e050 2024-09-12T00:38:48.808 INFO:tasks.workunit.client.0.smithi043.stderr: -90> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 5 asok(0x563508e8f2b0) register_command sync trace active_short hook 0x7ff7e402e050 2024-09-12T00:38:48.808 INFO:tasks.workunit.client.0.smithi043.stderr: -89> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:48.808 INFO:tasks.workunit.client.0.smithi043.stderr: -88> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 20 Filter name: none 2024-09-12T00:38:48.809 INFO:tasks.workunit.client.0.smithi043.stderr: -87> 2024-09-12T00:38:48.681+0000 7ff6217fa640 20 reqs_thread_entry: start 2024-09-12T00:38:48.809 INFO:tasks.workunit.client.0.smithi043.stderr: -86> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:38:48.809 INFO:tasks.workunit.client.0.smithi043.stderr: -85> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.809 INFO:tasks.workunit.client.0.smithi043.stderr: -84> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:48.809 INFO:tasks.workunit.client.0.smithi043.stderr: -83> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:38:48.809 INFO:tasks.workunit.client.0.smithi043.stderr: -82> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:38:48.809 INFO:tasks.workunit.client.0.smithi043.stderr: -81> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 : miss 2024-09-12T00:38:48.809 INFO:tasks.workunit.client.0.smithi043.stderr: -80> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.809 INFO:tasks.workunit.client.0.smithi043.stderr: -79> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:48.809 INFO:tasks.workunit.client.0.smithi043.stderr: -78> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 info.flags=0x17 2024-09-12T00:38:48.809 INFO:tasks.workunit.client.0.smithi043.stderr: -77> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 to cache LRU end 2024-09-12T00:38:48.809 INFO:tasks.workunit.client.0.smithi043.stderr: -76> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:48.809 INFO:tasks.workunit.client.0.smithi043.stderr: -75> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:48.810 INFO:tasks.workunit.client.0.smithi043.stderr: -74> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 2024-09-12T00:38:48.810 INFO:tasks.workunit.client.0.smithi043.stderr: -73> 2024-09-12T00:38:48.693+0000 7ff7f4bb39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 info.flags=0x17 2024-09-12T00:38:48.810 INFO:tasks.workunit.client.0.smithi043.stderr: -72> 2024-09-12T00:38:48.693+0000 7ff7f4bb39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 to cache LRU end 2024-09-12T00:38:48.810 INFO:tasks.workunit.client.0.smithi043.stderr: -71> 2024-09-12T00:38:48.693+0000 7ff7f4bb39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:48.810 INFO:tasks.workunit.client.0.smithi043.stderr: -70> 2024-09-12T00:38:48.693+0000 7ff7f4bb39c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32, ofs0, ns] 2024-09-12T00:38:48.810 INFO:tasks.workunit.client.0.smithi043.stderr: -69> 2024-09-12T00:38:48.697+0000 7ff6d57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333494 cookie 94785785926288 notifier 6962 bl.length()=931 2024-09-12T00:38:48.810 INFO:tasks.workunit.client.0.smithi043.stderr: -68> 2024-09-12T00:38:48.697+0000 7ff6d57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 info.flags=0x17 2024-09-12T00:38:48.810 INFO:tasks.workunit.client.0.smithi043.stderr: -67> 2024-09-12T00:38:48.697+0000 7ff6d57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 to cache LRU end 2024-09-12T00:38:48.810 INFO:tasks.workunit.client.0.smithi043.stderr: -66> 2024-09-12T00:38:48.697+0000 7ff6d57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:48.810 INFO:tasks.workunit.client.0.smithi043.stderr: -65> 2024-09-12T00:38:48.697+0000 7ff7f4bb39c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): orig_sources= new_sources= 2024-09-12T00:38:48.810 INFO:tasks.workunit.client.0.smithi043.stderr: -64> 2024-09-12T00:38:48.697+0000 7ff7f4bb39c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): potential sources added=[] removed=[] 2024-09-12T00:38:48.810 INFO:tasks.workunit.client.0.smithi043.stderr: -63> 2024-09-12T00:38:48.697+0000 7ff7f4bb39c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): orig_dests= new_dests= 2024-09-12T00:38:48.811 INFO:tasks.workunit.client.0.smithi043.stderr: -62> 2024-09-12T00:38:48.697+0000 7ff7f4bb39c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): potential dests added=[] removed=[] 2024-09-12T00:38:48.811 INFO:tasks.workunit.client.0.smithi043.stderr: -61> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.0 2024-09-12T00:38:48.811 INFO:tasks.workunit.client.0.smithi043.stderr: -60> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.0 2024-09-12T00:38:48.811 INFO:tasks.workunit.client.0.smithi043.stderr: -59> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.1 2024-09-12T00:38:48.811 INFO:tasks.workunit.client.0.smithi043.stderr: -58> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.1 2024-09-12T00:38:48.811 INFO:tasks.workunit.client.0.smithi043.stderr: -57> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.2 2024-09-12T00:38:48.811 INFO:tasks.workunit.client.0.smithi043.stderr: -56> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.2 2024-09-12T00:38:48.811 INFO:tasks.workunit.client.0.smithi043.stderr: -55> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.3 2024-09-12T00:38:48.811 INFO:tasks.workunit.client.0.smithi043.stderr: -54> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.3 2024-09-12T00:38:48.811 INFO:tasks.workunit.client.0.smithi043.stderr: -53> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.4 2024-09-12T00:38:48.812 INFO:tasks.workunit.client.0.smithi043.stderr: -52> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.4 2024-09-12T00:38:48.812 INFO:tasks.workunit.client.0.smithi043.stderr: -51> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.5 2024-09-12T00:38:48.812 INFO:tasks.workunit.client.0.smithi043.stderr: -50> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.5 2024-09-12T00:38:48.812 INFO:tasks.workunit.client.0.smithi043.stderr: -49> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.6 2024-09-12T00:38:48.812 INFO:tasks.workunit.client.0.smithi043.stderr: -48> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.6 2024-09-12T00:38:48.812 INFO:tasks.workunit.client.0.smithi043.stderr: -47> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.7 2024-09-12T00:38:48.812 INFO:tasks.workunit.client.0.smithi043.stderr: -46> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.7 2024-09-12T00:38:48.812 INFO:tasks.workunit.client.0.smithi043.stderr: -45> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.8 2024-09-12T00:38:48.812 INFO:tasks.workunit.client.0.smithi043.stderr: -44> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.8 2024-09-12T00:38:48.812 INFO:tasks.workunit.client.0.smithi043.stderr: -43> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.9 2024-09-12T00:38:48.812 INFO:tasks.workunit.client.0.smithi043.stderr: -42> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.9 2024-09-12T00:38:48.812 INFO:tasks.workunit.client.0.smithi043.stderr: -41> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.10 2024-09-12T00:38:48.812 INFO:tasks.workunit.client.0.smithi043.stderr: -40> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.10 2024-09-12T00:38:48.813 INFO:tasks.workunit.client.0.smithi043.stderr: -39> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.11 2024-09-12T00:38:48.813 INFO:tasks.workunit.client.0.smithi043.stderr: -38> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.11 2024-09-12T00:38:48.813 INFO:tasks.workunit.client.0.smithi043.stderr: -37> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.0 2024-09-12T00:38:48.813 INFO:tasks.workunit.client.0.smithi043.stderr: -36> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1 2024-09-12T00:38:48.813 INFO:tasks.workunit.client.0.smithi043.stderr: -35> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.2 2024-09-12T00:38:48.813 INFO:tasks.workunit.client.0.smithi043.stderr: -34> 2024-09-12T00:38:48.713+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.3 2024-09-12T00:38:48.816 INFO:tasks.workunit.client.0.smithi043.stderr: -33> 2024-09-12T00:38:48.713+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.4 2024-09-12T00:38:48.816 INFO:tasks.workunit.client.0.smithi043.stderr: -32> 2024-09-12T00:38:48.713+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.5 2024-09-12T00:38:48.816 INFO:tasks.workunit.client.0.smithi043.stderr: -31> 2024-09-12T00:38:48.717+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.6 2024-09-12T00:38:48.816 INFO:tasks.workunit.client.0.smithi043.stderr: -30> 2024-09-12T00:38:48.717+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.7 2024-09-12T00:38:48.817 INFO:tasks.workunit.client.0.smithi043.stderr: -29> 2024-09-12T00:38:48.717+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.8 2024-09-12T00:38:48.817 INFO:tasks.workunit.client.0.smithi043.stderr: -28> 2024-09-12T00:38:48.721+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.9 2024-09-12T00:38:48.817 INFO:tasks.workunit.client.0.smithi043.stderr: -27> 2024-09-12T00:38:48.721+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.10 2024-09-12T00:38:48.817 INFO:tasks.workunit.client.0.smithi043.stderr: -26> 2024-09-12T00:38:48.725+0000 7ff7f4bb39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:48.817 INFO:tasks.workunit.client.0.smithi043.stderr: -25> 2024-09-12T00:38:48.725+0000 7ff7f4bb39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 2024-09-12T00:38:48.817 INFO:tasks.workunit.client.0.smithi043.stderr: -24> 2024-09-12T00:38:48.729+0000 7ff7f4bb39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 info.flags=0x17 2024-09-12T00:38:48.817 INFO:tasks.workunit.client.0.smithi043.stderr: -23> 2024-09-12T00:38:48.729+0000 7ff7f4bb39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 to cache LRU end 2024-09-12T00:38:48.817 INFO:tasks.workunit.client.0.smithi043.stderr: -22> 2024-09-12T00:38:48.729+0000 7ff7f4bb39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:48.817 INFO:tasks.workunit.client.0.smithi043.stderr: -21> 2024-09-12T00:38:48.729+0000 7ff7f4bb39c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32, ofs0, ns] 2024-09-12T00:38:48.817 INFO:tasks.workunit.client.0.smithi043.stderr: -20> 2024-09-12T00:38:48.729+0000 7ff6d5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333495 cookie 94785785926288 notifier 6962 bl.length()=931 2024-09-12T00:38:48.817 INFO:tasks.workunit.client.0.smithi043.stderr: -19> 2024-09-12T00:38:48.729+0000 7ff6d5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 info.flags=0x17 2024-09-12T00:38:48.817 INFO:tasks.workunit.client.0.smithi043.stderr: -18> 2024-09-12T00:38:48.729+0000 7ff6d5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 to cache LRU end 2024-09-12T00:38:48.817 INFO:tasks.workunit.client.0.smithi043.stderr: -17> 2024-09-12T00:38:48.729+0000 7ff6d5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:48.817 INFO:tasks.workunit.client.0.smithi043.stderr: -16> 2024-09-12T00:38:48.729+0000 7ff7f4bb39c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): orig_sources= new_sources= 2024-09-12T00:38:48.818 INFO:tasks.workunit.client.0.smithi043.stderr: -15> 2024-09-12T00:38:48.729+0000 7ff7f4bb39c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): potential sources added=[] removed=[] 2024-09-12T00:38:48.818 INFO:tasks.workunit.client.0.smithi043.stderr: -14> 2024-09-12T00:38:48.729+0000 7ff7f4bb39c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): orig_dests= new_dests= 2024-09-12T00:38:48.818 INFO:tasks.workunit.client.0.smithi043.stderr: -13> 2024-09-12T00:38:48.729+0000 7ff7f4bb39c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): potential dests added=[] removed=[] 2024-09-12T00:38:48.818 INFO:tasks.workunit.client.0.smithi043.stderr: -12> 2024-09-12T00:38:48.737+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.0 2024-09-12T00:38:48.818 INFO:tasks.workunit.client.0.smithi043.stderr: -11> 2024-09-12T00:38:48.737+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1 2024-09-12T00:38:48.818 INFO:tasks.workunit.client.0.smithi043.stderr: -10> 2024-09-12T00:38:48.737+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.2 2024-09-12T00:38:48.818 INFO:tasks.workunit.client.0.smithi043.stderr: -9> 2024-09-12T00:38:48.737+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.3 2024-09-12T00:38:48.818 INFO:tasks.workunit.client.0.smithi043.stderr: -8> 2024-09-12T00:38:48.737+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.4 2024-09-12T00:38:48.818 INFO:tasks.workunit.client.0.smithi043.stderr: -7> 2024-09-12T00:38:48.737+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.5 2024-09-12T00:38:48.818 INFO:tasks.workunit.client.0.smithi043.stderr: -6> 2024-09-12T00:38:48.741+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.6 2024-09-12T00:38:48.818 INFO:tasks.workunit.client.0.smithi043.stderr: -5> 2024-09-12T00:38:48.741+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.7 2024-09-12T00:38:48.818 INFO:tasks.workunit.client.0.smithi043.stderr: -4> 2024-09-12T00:38:48.741+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.8 2024-09-12T00:38:48.819 INFO:tasks.workunit.client.0.smithi043.stderr: -3> 2024-09-12T00:38:48.741+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.9 2024-09-12T00:38:48.819 INFO:tasks.workunit.client.0.smithi043.stderr: -2> 2024-09-12T00:38:48.741+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.10 2024-09-12T00:38:48.819 INFO:tasks.workunit.client.0.smithi043.stderr: -1> 2024-09-12T00:38:48.745+0000 7ff7f4bb39c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff7f4bb39c0 time 2024-09-12T00:38:48.748413+0000 2024-09-12T00:38:48.819 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:38:48.819 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.819 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:48.819 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff7f848d2eb] 2024-09-12T00:38:48.819 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff7f848d49f] 2024-09-12T00:38:48.819 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56350703ecc1] 2024-09-12T00:38:48.819 INFO:tasks.workunit.client.0.smithi043.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x563507053fc7] 2024-09-12T00:38:48.819 INFO:tasks.workunit.client.0.smithi043.stderr: 5: main() 2024-09-12T00:38:48.819 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff7f72f3d90] 2024-09-12T00:38:48.820 INFO:tasks.workunit.client.0.smithi043.stderr: 7: __libc_start_main() 2024-09-12T00:38:48.820 INFO:tasks.workunit.client.0.smithi043.stderr: 8: _start() 2024-09-12T00:38:48.820 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.820 INFO:tasks.workunit.client.0.smithi043.stderr: 0> 2024-09-12T00:38:48.745+0000 7ff7f4bb39c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:38:48.820 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7ff7f4bb39c0 thread_name:radosgw-admin 2024-09-12T00:38:48.820 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.820 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:48.820 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff7f730c520] 2024-09-12T00:38:48.820 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:38:48.820 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:38:48.820 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:38:48.820 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff7f848d345] 2024-09-12T00:38:48.821 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff7f848d49f] 2024-09-12T00:38:48.821 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56350703ecc1] 2024-09-12T00:38:48.821 INFO:tasks.workunit.client.0.smithi043.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x563507053fc7] 2024-09-12T00:38:48.821 INFO:tasks.workunit.client.0.smithi043.stderr: 9: main() 2024-09-12T00:38:48.821 INFO:tasks.workunit.client.0.smithi043.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff7f72f3d90] 2024-09-12T00:38:48.821 INFO:tasks.workunit.client.0.smithi043.stderr: 11: __libc_start_main() 2024-09-12T00:38:48.821 INFO:tasks.workunit.client.0.smithi043.stderr: 12: _start() 2024-09-12T00:38:48.821 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:38:48.821 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.821 INFO:tasks.workunit.client.0.smithi043.stderr:--- logging levels --- 2024-09-12T00:38:48.821 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 none 2024-09-12T00:38:48.821 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 lockdep 2024-09-12T00:38:48.821 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 context 2024-09-12T00:38:48.822 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 crush 2024-09-12T00:38:48.822 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds 2024-09-12T00:38:48.822 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_balancer 2024-09-12T00:38:48.822 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_locker 2024-09-12T00:38:48.822 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log 2024-09-12T00:38:48.822 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log_expire 2024-09-12T00:38:48.822 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_migrator 2024-09-12T00:38:48.822 INFO:tasks.workunit.client.0.smithi043.stderr: 3/ 5 mds_quiesce 2024-09-12T00:38:48.822 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 buffer 2024-09-12T00:38:48.822 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 timer 2024-09-12T00:38:48.822 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 filer 2024-09-12T00:38:48.822 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 striper 2024-09-12T00:38:48.822 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 objecter 2024-09-12T00:38:48.823 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rados 2024-09-12T00:38:48.823 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd 2024-09-12T00:38:48.823 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_mirror 2024-09-12T00:38:48.823 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_replay 2024-09-12T00:38:48.823 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_pwl 2024-09-12T00:38:48.823 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 journaler 2024-09-12T00:38:48.823 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objectcacher 2024-09-12T00:38:48.823 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:38:48.823 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 client 2024-09-12T00:38:48.823 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 osd 2024-09-12T00:38:48.823 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 optracker 2024-09-12T00:38:48.823 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objclass 2024-09-12T00:38:48.823 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 filestore 2024-09-12T00:38:48.824 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 journal 2024-09-12T00:38:48.824 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 ms 2024-09-12T00:38:48.824 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mon 2024-09-12T00:38:48.824 INFO:tasks.workunit.client.0.smithi043.stderr: 0/10 monc 2024-09-12T00:38:48.824 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 paxos 2024-09-12T00:38:48.824 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 tp 2024-09-12T00:38:48.824 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 auth 2024-09-12T00:38:48.824 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 crypto 2024-09-12T00:38:48.824 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 finisher 2024-09-12T00:38:48.824 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 reserver 2024-09-12T00:38:48.824 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 heartbeatmap 2024-09-12T00:38:48.824 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 perfcounter 2024-09-12T00:38:48.824 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw 2024-09-12T00:38:48.825 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_sync 2024-09-12T00:38:48.825 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_datacache 2024-09-12T00:38:48.825 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_access 2024-09-12T00:38:48.825 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:38:48.825 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_flight 2024-09-12T00:38:48.825 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:38:48.825 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw_notification 2024-09-12T00:38:48.825 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 javaclient 2024-09-12T00:38:48.825 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 asok 2024-09-12T00:38:48.825 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 throttle 2024-09-12T00:38:48.825 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 refs 2024-09-12T00:38:48.825 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 compressor 2024-09-12T00:38:48.826 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluestore 2024-09-12T00:38:48.826 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluefs 2024-09-12T00:38:48.826 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 bdev 2024-09-12T00:38:48.826 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 kstore 2024-09-12T00:38:48.826 INFO:tasks.workunit.client.0.smithi043.stderr: 4/ 5 rocksdb 2024-09-12T00:38:48.826 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 fuse 2024-09-12T00:38:48.826 INFO:tasks.workunit.client.0.smithi043.stderr: 2/ 5 mgr 2024-09-12T00:38:48.826 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mgrc 2024-09-12T00:38:48.826 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 dpdk 2024-09-12T00:38:48.826 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 eventtrace 2024-09-12T00:38:48.826 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 prioritycache 2024-09-12T00:38:48.826 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 test 2024-09-12T00:38:48.826 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:38:48.826 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephsqlite 2024-09-12T00:38:48.827 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:38:48.827 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore 2024-09-12T00:38:48.827 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_onode 2024-09-12T00:38:48.827 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_odata 2024-09-12T00:38:48.827 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_omap 2024-09-12T00:38:48.827 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_tm 2024-09-12T00:38:48.827 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_t 2024-09-12T00:38:48.827 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:38:48.827 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_epm 2024-09-12T00:38:48.827 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_lba 2024-09-12T00:38:48.827 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:38:48.827 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cache 2024-09-12T00:38:48.827 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_journal 2024-09-12T00:38:48.828 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_device 2024-09-12T00:38:48.828 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_backref 2024-09-12T00:38:48.828 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 alienstore 2024-09-12T00:38:48.828 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mclock 2024-09-12T00:38:48.828 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cyanstore 2024-09-12T00:38:48.828 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 ceph_exporter 2024-09-12T00:38:48.828 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 memstore 2024-09-12T00:38:48.828 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 trace 2024-09-12T00:38:48.828 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 ceph_dedup 2024-09-12T00:38:48.828 INFO:tasks.workunit.client.0.smithi043.stderr: -2/-2 (syslog threshold) 2024-09-12T00:38:48.828 INFO:tasks.workunit.client.0.smithi043.stderr: 99/99 (stderr threshold) 2024-09-12T00:38:48.828 INFO:tasks.workunit.client.0.smithi043.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:38:48.828 INFO:tasks.workunit.client.0.smithi043.stderr: 7ff6217fa640 / http_manager 2024-09-12T00:38:48.829 INFO:tasks.workunit.client.0.smithi043.stderr: 7ff6237fe640 / http_manager 2024-09-12T00:38:48.829 INFO:tasks.workunit.client.0.smithi043.stderr: 7ff6a8fe1640 / rgw_dt_lg_renew 2024-09-12T00:38:48.829 INFO:tasks.workunit.client.0.smithi043.stderr: 7ff6c3fff640 / ms_dispatch 2024-09-12T00:38:48.829 INFO:tasks.workunit.client.0.smithi043.stderr: 7ff6d57fa640 / io_context_pool 2024-09-12T00:38:48.829 INFO:tasks.workunit.client.0.smithi043.stderr: 7ff6d5ffb640 / io_context_pool 2024-09-12T00:38:48.829 INFO:tasks.workunit.client.0.smithi043.stderr: 7ff6d7fff640 / ms_dispatch 2024-09-12T00:38:48.829 INFO:tasks.workunit.client.0.smithi043.stderr: 7ff6dee05640 / ms_dispatch 2024-09-12T00:38:48.829 INFO:tasks.workunit.client.0.smithi043.stderr: 7ff6e0608640 / io_context_pool 2024-09-12T00:38:48.829 INFO:tasks.workunit.client.0.smithi043.stderr: 7ff7f1eb8640 / msgr-worker-2 2024-09-12T00:38:48.829 INFO:tasks.workunit.client.0.smithi043.stderr: 7ff7f26b9640 / msgr-worker-1 2024-09-12T00:38:48.829 INFO:tasks.workunit.client.0.smithi043.stderr: 7ff7f2eba640 / msgr-worker-0 2024-09-12T00:38:48.829 INFO:tasks.workunit.client.0.smithi043.stderr: 7ff7f36bb640 / io_context_pool 2024-09-12T00:38:48.829 INFO:tasks.workunit.client.0.smithi043.stderr: 7ff7f4bb39c0 / radosgw-admin 2024-09-12T00:38:48.830 INFO:tasks.workunit.client.0.smithi043.stderr: max_recent 500 2024-09-12T00:38:48.830 INFO:tasks.workunit.client.0.smithi043.stderr: max_new 1000 2024-09-12T00:38:48.830 INFO:tasks.workunit.client.0.smithi043.stderr: log_file /var/log/ceph/ceph-client.admin.112698.log 2024-09-12T00:38:48.830 INFO:tasks.workunit.client.0.smithi043.stderr:--- end dump of recent events --- 2024-09-12T00:38:48.830 INFO:tasks.workunit.client.0.smithi043.stderr:--- begin dump of recent events --- 2024-09-12T00:38:48.830 INFO:tasks.workunit.client.0.smithi043.stderr: -499> 2024-09-12T00:38:48.177+0000 7ff7f4bb39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:48.830 INFO:tasks.workunit.client.0.smithi043.stderr: -498> 2024-09-12T00:38:48.177+0000 7ff7f4bb39c0 10 monclient(hunting): authenticate will time out at 2224.169675s 2024-09-12T00:38:48.830 INFO:tasks.workunit.client.0.smithi043.stderr: -497> 2024-09-12T00:38:48.177+0000 7ff7f2eba640 10 monclient(hunting): get_auth_request con 0x563508fe5e50 auth_method 0 2024-09-12T00:38:48.830 INFO:tasks.workunit.client.0.smithi043.stderr: -496> 2024-09-12T00:38:48.177+0000 7ff7f2eba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.830 INFO:tasks.workunit.client.0.smithi043.stderr: -495> 2024-09-12T00:38:48.177+0000 7ff7f2eba640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.830 INFO:tasks.workunit.client.0.smithi043.stderr: -494> 2024-09-12T00:38:48.177+0000 7ff7f2eba640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.830 INFO:tasks.workunit.client.0.smithi043.stderr: -493> 2024-09-12T00:38:48.177+0000 7ff7f1eb8640 10 monclient(hunting): get_auth_request con 0x563508fe2f60 auth_method 0 2024-09-12T00:38:48.830 INFO:tasks.workunit.client.0.smithi043.stderr: -492> 2024-09-12T00:38:48.177+0000 7ff7f1eb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.830 INFO:tasks.workunit.client.0.smithi043.stderr: -491> 2024-09-12T00:38:48.177+0000 7ff7f1eb8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.831 INFO:tasks.workunit.client.0.smithi043.stderr: -490> 2024-09-12T00:38:48.177+0000 7ff7f1eb8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.831 INFO:tasks.workunit.client.0.smithi043.stderr: -489> 2024-09-12T00:38:48.177+0000 7ff7f2eba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:48.831 INFO:tasks.workunit.client.0.smithi043.stderr: -488> 2024-09-12T00:38:48.177+0000 7ff7f2eba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:48.831 INFO:tasks.workunit.client.0.smithi043.stderr: -487> 2024-09-12T00:38:48.177+0000 7ff7f2eba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:48.831 INFO:tasks.workunit.client.0.smithi043.stderr: -486> 2024-09-12T00:38:48.177+0000 7ff7f1eb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:48.831 INFO:tasks.workunit.client.0.smithi043.stderr: -485> 2024-09-12T00:38:48.177+0000 7ff7f1eb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:48.831 INFO:tasks.workunit.client.0.smithi043.stderr: -484> 2024-09-12T00:38:48.177+0000 7ff7f1eb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:48.831 INFO:tasks.workunit.client.0.smithi043.stderr: -483> 2024-09-12T00:38:48.177+0000 7ff7f26b9640 10 monclient(hunting): get_auth_request con 0x563508f2b900 auth_method 0 2024-09-12T00:38:48.831 INFO:tasks.workunit.client.0.smithi043.stderr: -482> 2024-09-12T00:38:48.177+0000 7ff7f26b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.831 INFO:tasks.workunit.client.0.smithi043.stderr: -481> 2024-09-12T00:38:48.177+0000 7ff7f26b9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.831 INFO:tasks.workunit.client.0.smithi043.stderr: -480> 2024-09-12T00:38:48.177+0000 7ff7f26b9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.831 INFO:tasks.workunit.client.0.smithi043.stderr: -479> 2024-09-12T00:38:48.177+0000 7ff7f2eba640 10 monclient(hunting): handle_auth_done global_id 6953 payload 824 2024-09-12T00:38:48.831 INFO:tasks.workunit.client.0.smithi043.stderr: -478> 2024-09-12T00:38:48.177+0000 7ff7f2eba640 10 monclient: _finish_hunting 0 2024-09-12T00:38:48.832 INFO:tasks.workunit.client.0.smithi043.stderr: -477> 2024-09-12T00:38:48.177+0000 7ff7f2eba640 1 monclient: found mon.noname-c 2024-09-12T00:38:48.832 INFO:tasks.workunit.client.0.smithi043.stderr: -476> 2024-09-12T00:38:48.177+0000 7ff7f2eba640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:38:48.832 INFO:tasks.workunit.client.0.smithi043.stderr: -475> 2024-09-12T00:38:48.177+0000 7ff6dee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:48.832 INFO:tasks.workunit.client.0.smithi043.stderr: -474> 2024-09-12T00:38:48.177+0000 7ff6dee05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:38:48.832 INFO:tasks.workunit.client.0.smithi043.stderr: -473> 2024-09-12T00:38:48.177+0000 7ff6dee05640 10 monclient: dump: 2024-09-12T00:38:48.832 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:48.832 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:48.832 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.832 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.832 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:48.832 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:48.832 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:48.832 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:48.833 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:48.833 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.833 INFO:tasks.workunit.client.0.smithi043.stderr: -472> 2024-09-12T00:38:48.177+0000 7ff6dee05640 10 monclient: _finish_auth 0 2024-09-12T00:38:48.833 INFO:tasks.workunit.client.0.smithi043.stderr: -471> 2024-09-12T00:38:48.177+0000 7ff6dee05640 10 monclient: _check_auth_tickets 2024-09-12T00:38:48.833 INFO:tasks.workunit.client.0.smithi043.stderr: -470> 2024-09-12T00:38:48.177+0000 7ff7f4bb39c0 5 monclient: authenticate success, global_id 6953 2024-09-12T00:38:48.833 INFO:tasks.workunit.client.0.smithi043.stderr: -469> 2024-09-12T00:38:48.177+0000 7ff7f4bb39c0 10 monclient: _renew_subs 2024-09-12T00:38:48.833 INFO:tasks.workunit.client.0.smithi043.stderr: -468> 2024-09-12T00:38:48.177+0000 7ff7f4bb39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:38:48.833 INFO:tasks.workunit.client.0.smithi043.stderr: -467> 2024-09-12T00:38:48.177+0000 7ff6dee05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:48.833 INFO:tasks.workunit.client.0.smithi043.stderr: -466> 2024-09-12T00:38:48.177+0000 7ff6dee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:48.833 INFO:tasks.workunit.client.0.smithi043.stderr: -465> 2024-09-12T00:38:48.177+0000 7ff6dee05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:38:48.833 INFO:tasks.workunit.client.0.smithi043.stderr: -464> 2024-09-12T00:38:48.177+0000 7ff6dee05640 10 monclient: dump: 2024-09-12T00:38:48.833 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:48.833 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:48.834 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.834 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.834 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:48.834 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:48.834 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:48.834 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:48.834 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:48.834 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.834 INFO:tasks.workunit.client.0.smithi043.stderr: -463> 2024-09-12T00:38:48.177+0000 7ff7f4bb39c0 10 monclient: _renew_subs 2024-09-12T00:38:48.834 INFO:tasks.workunit.client.0.smithi043.stderr: -462> 2024-09-12T00:38:48.177+0000 7ff6e0608640 4 set_mon_vals no callback set 2024-09-12T00:38:48.834 INFO:tasks.workunit.client.0.smithi043.stderr: -461> 2024-09-12T00:38:48.177+0000 7ff7f4bb39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:38:48.834 INFO:tasks.workunit.client.0.smithi043.stderr: -460> 2024-09-12T00:38:48.177+0000 7ff7f4bb39c0 1 librados: init done 2024-09-12T00:38:48.834 INFO:tasks.workunit.client.0.smithi043.stderr: -459> 2024-09-12T00:38:48.181+0000 7ff6dee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:38:48.835 INFO:tasks.workunit.client.0.smithi043.stderr: -458> 2024-09-12T00:38:48.181+0000 7ff6dee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:38:48.835 INFO:tasks.workunit.client.0.smithi043.stderr: -457> 2024-09-12T00:38:48.181+0000 7ff6dee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:38:48.835 INFO:tasks.workunit.client.0.smithi043.stderr: -456> 2024-09-12T00:38:48.181+0000 7ff7f26b9640 10 monclient: get_auth_request con 0x7ff6d8070ae0 auth_method 0 2024-09-12T00:38:48.835 INFO:tasks.workunit.client.0.smithi043.stderr: -455> 2024-09-12T00:38:48.181+0000 7ff7f1eb8640 10 monclient: get_auth_request con 0x5635090e2580 auth_method 0 2024-09-12T00:38:48.835 INFO:tasks.workunit.client.0.smithi043.stderr: -454> 2024-09-12T00:38:48.181+0000 7ff7f26b9640 10 monclient: get_auth_request con 0x5635090e5760 auth_method 0 2024-09-12T00:38:48.835 INFO:tasks.workunit.client.0.smithi043.stderr: -453> 2024-09-12T00:38:48.181+0000 7ff7f1eb8640 10 monclient: get_auth_request con 0x5635090e9950 auth_method 0 2024-09-12T00:38:48.835 INFO:tasks.workunit.client.0.smithi043.stderr: -452> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient: build_initial_monmap 2024-09-12T00:38:48.835 INFO:tasks.workunit.client.0.smithi043.stderr: -451> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 1 build_initial for_mkfs: 0 2024-09-12T00:38:48.835 INFO:tasks.workunit.client.0.smithi043.stderr: -450> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient: monmap: 2024-09-12T00:38:48.835 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:38:48.835 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:48.835 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:38:48.836 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:38:48.836 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:48.836 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:48.836 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:38:48.836 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:38:48.836 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:38:48.836 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.836 INFO:tasks.workunit.client.0.smithi043.stderr: -449> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ee5b0) adding auth protocol: cephx 2024-09-12T00:38:48.836 INFO:tasks.workunit.client.0.smithi043.stderr: -448> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ee5b0) adding auth protocol: cephx 2024-09-12T00:38:48.836 INFO:tasks.workunit.client.0.smithi043.stderr: -447> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ee5b0) adding auth protocol: cephx 2024-09-12T00:38:48.836 INFO:tasks.workunit.client.0.smithi043.stderr: -446> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ee5b0) adding con mode: secure 2024-09-12T00:38:48.836 INFO:tasks.workunit.client.0.smithi043.stderr: -445> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ee5b0) adding con mode: crc 2024-09-12T00:38:48.837 INFO:tasks.workunit.client.0.smithi043.stderr: -444> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ee5b0) adding con mode: secure 2024-09-12T00:38:48.837 INFO:tasks.workunit.client.0.smithi043.stderr: -443> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ee5b0) adding con mode: crc 2024-09-12T00:38:48.837 INFO:tasks.workunit.client.0.smithi043.stderr: -442> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ee5b0) adding con mode: secure 2024-09-12T00:38:48.837 INFO:tasks.workunit.client.0.smithi043.stderr: -441> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ee5b0) adding con mode: crc 2024-09-12T00:38:48.837 INFO:tasks.workunit.client.0.smithi043.stderr: -440> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ee5b0) adding con mode: crc 2024-09-12T00:38:48.837 INFO:tasks.workunit.client.0.smithi043.stderr: -439> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ee5b0) adding con mode: secure 2024-09-12T00:38:48.837 INFO:tasks.workunit.client.0.smithi043.stderr: -438> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ee5b0) adding con mode: crc 2024-09-12T00:38:48.837 INFO:tasks.workunit.client.0.smithi043.stderr: -437> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ee5b0) adding con mode: secure 2024-09-12T00:38:48.837 INFO:tasks.workunit.client.0.smithi043.stderr: -436> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ee5b0) adding con mode: crc 2024-09-12T00:38:48.837 INFO:tasks.workunit.client.0.smithi043.stderr: -435> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ee5b0) adding con mode: secure 2024-09-12T00:38:48.837 INFO:tasks.workunit.client.0.smithi043.stderr: -434> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.837 INFO:tasks.workunit.client.0.smithi043.stderr: -433> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 asok(0x563508e8f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5635090f1fa0 EEXIST 2024-09-12T00:38:48.837 INFO:tasks.workunit.client.0.smithi043.stderr: -432> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient: init 2024-09-12T00:38:48.838 INFO:tasks.workunit.client.0.smithi043.stderr: -431> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ecc88) adding auth protocol: cephx 2024-09-12T00:38:48.838 INFO:tasks.workunit.client.0.smithi043.stderr: -430> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ecc88) adding auth protocol: cephx 2024-09-12T00:38:48.838 INFO:tasks.workunit.client.0.smithi043.stderr: -429> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ecc88) adding auth protocol: cephx 2024-09-12T00:38:48.838 INFO:tasks.workunit.client.0.smithi043.stderr: -428> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ecc88) adding con mode: secure 2024-09-12T00:38:48.838 INFO:tasks.workunit.client.0.smithi043.stderr: -427> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ecc88) adding con mode: crc 2024-09-12T00:38:48.838 INFO:tasks.workunit.client.0.smithi043.stderr: -426> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ecc88) adding con mode: secure 2024-09-12T00:38:48.838 INFO:tasks.workunit.client.0.smithi043.stderr: -425> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ecc88) adding con mode: crc 2024-09-12T00:38:48.838 INFO:tasks.workunit.client.0.smithi043.stderr: -424> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ecc88) adding con mode: secure 2024-09-12T00:38:48.838 INFO:tasks.workunit.client.0.smithi043.stderr: -423> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ecc88) adding con mode: crc 2024-09-12T00:38:48.838 INFO:tasks.workunit.client.0.smithi043.stderr: -422> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ecc88) adding con mode: crc 2024-09-12T00:38:48.838 INFO:tasks.workunit.client.0.smithi043.stderr: -421> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ecc88) adding con mode: secure 2024-09-12T00:38:48.838 INFO:tasks.workunit.client.0.smithi043.stderr: -420> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ecc88) adding con mode: crc 2024-09-12T00:38:48.838 INFO:tasks.workunit.client.0.smithi043.stderr: -419> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ecc88) adding con mode: secure 2024-09-12T00:38:48.839 INFO:tasks.workunit.client.0.smithi043.stderr: -418> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ecc88) adding con mode: crc 2024-09-12T00:38:48.839 INFO:tasks.workunit.client.0.smithi043.stderr: -417> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 AuthRegistry(0x5635090ecc88) adding con mode: secure 2024-09-12T00:38:48.839 INFO:tasks.workunit.client.0.smithi043.stderr: -416> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.839 INFO:tasks.workunit.client.0.smithi043.stderr: -415> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.839 INFO:tasks.workunit.client.0.smithi043.stderr: -414> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 asok(0x563508e8f2b0) register_command rotate-key cmddesc rotate-key hook 0x5635090ecdd0 EEXIST 2024-09-12T00:38:48.839 INFO:tasks.workunit.client.0.smithi043.stderr: -413> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:48.839 INFO:tasks.workunit.client.0.smithi043.stderr: -412> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:38:48.839 INFO:tasks.workunit.client.0.smithi043.stderr: -411> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient(hunting): picked mon.noname-a con 0x563509116150 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:38:48.839 INFO:tasks.workunit.client.0.smithi043.stderr: -410> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient(hunting): picked mon.noname-b con 0x563509115a80 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:38:48.839 INFO:tasks.workunit.client.0.smithi043.stderr: -409> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient(hunting): picked mon.noname-c con 0x563509114460 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:38:48.839 INFO:tasks.workunit.client.0.smithi043.stderr: -408> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.839 INFO:tasks.workunit.client.0.smithi043.stderr: -407> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.839 INFO:tasks.workunit.client.0.smithi043.stderr: -406> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.840 INFO:tasks.workunit.client.0.smithi043.stderr: -405> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:48.840 INFO:tasks.workunit.client.0.smithi043.stderr: -404> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient(hunting): authenticate will time out at 2224.179029s 2024-09-12T00:38:48.840 INFO:tasks.workunit.client.0.smithi043.stderr: -403> 2024-09-12T00:38:48.185+0000 7ff7f2eba640 10 monclient(hunting): get_auth_request con 0x563509114460 auth_method 0 2024-09-12T00:38:48.840 INFO:tasks.workunit.client.0.smithi043.stderr: -402> 2024-09-12T00:38:48.185+0000 7ff7f2eba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.840 INFO:tasks.workunit.client.0.smithi043.stderr: -401> 2024-09-12T00:38:48.185+0000 7ff7f2eba640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.840 INFO:tasks.workunit.client.0.smithi043.stderr: -400> 2024-09-12T00:38:48.185+0000 7ff7f2eba640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.840 INFO:tasks.workunit.client.0.smithi043.stderr: -399> 2024-09-12T00:38:48.185+0000 7ff7f26b9640 10 monclient(hunting): get_auth_request con 0x563509116150 auth_method 0 2024-09-12T00:38:48.840 INFO:tasks.workunit.client.0.smithi043.stderr: -398> 2024-09-12T00:38:48.185+0000 7ff7f26b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.840 INFO:tasks.workunit.client.0.smithi043.stderr: -397> 2024-09-12T00:38:48.185+0000 7ff7f26b9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.840 INFO:tasks.workunit.client.0.smithi043.stderr: -396> 2024-09-12T00:38:48.185+0000 7ff7f26b9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.840 INFO:tasks.workunit.client.0.smithi043.stderr: -395> 2024-09-12T00:38:48.185+0000 7ff7f2eba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:48.840 INFO:tasks.workunit.client.0.smithi043.stderr: -394> 2024-09-12T00:38:48.185+0000 7ff7f2eba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:48.840 INFO:tasks.workunit.client.0.smithi043.stderr: -393> 2024-09-12T00:38:48.185+0000 7ff7f2eba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:48.841 INFO:tasks.workunit.client.0.smithi043.stderr: -392> 2024-09-12T00:38:48.185+0000 7ff7f26b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:48.841 INFO:tasks.workunit.client.0.smithi043.stderr: -391> 2024-09-12T00:38:48.185+0000 7ff7f26b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:48.841 INFO:tasks.workunit.client.0.smithi043.stderr: -390> 2024-09-12T00:38:48.185+0000 7ff7f26b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:48.841 INFO:tasks.workunit.client.0.smithi043.stderr: -389> 2024-09-12T00:38:48.185+0000 7ff7f1eb8640 10 monclient(hunting): get_auth_request con 0x563509115a80 auth_method 0 2024-09-12T00:38:48.841 INFO:tasks.workunit.client.0.smithi043.stderr: -388> 2024-09-12T00:38:48.185+0000 7ff7f1eb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.841 INFO:tasks.workunit.client.0.smithi043.stderr: -387> 2024-09-12T00:38:48.185+0000 7ff7f1eb8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.841 INFO:tasks.workunit.client.0.smithi043.stderr: -386> 2024-09-12T00:38:48.185+0000 7ff7f1eb8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.841 INFO:tasks.workunit.client.0.smithi043.stderr: -385> 2024-09-12T00:38:48.185+0000 7ff7f2eba640 10 monclient(hunting): handle_auth_done global_id 6956 payload 824 2024-09-12T00:38:48.841 INFO:tasks.workunit.client.0.smithi043.stderr: -384> 2024-09-12T00:38:48.185+0000 7ff7f2eba640 10 monclient: _finish_hunting 0 2024-09-12T00:38:48.841 INFO:tasks.workunit.client.0.smithi043.stderr: -383> 2024-09-12T00:38:48.185+0000 7ff7f2eba640 1 monclient: found mon.noname-c 2024-09-12T00:38:48.841 INFO:tasks.workunit.client.0.smithi043.stderr: -382> 2024-09-12T00:38:48.185+0000 7ff7f2eba640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:38:48.841 INFO:tasks.workunit.client.0.smithi043.stderr: -381> 2024-09-12T00:38:48.185+0000 7ff6d7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:48.841 INFO:tasks.workunit.client.0.smithi043.stderr: -380> 2024-09-12T00:38:48.185+0000 7ff6d7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:38:48.842 INFO:tasks.workunit.client.0.smithi043.stderr: -379> 2024-09-12T00:38:48.185+0000 7ff6d7fff640 10 monclient: dump: 2024-09-12T00:38:48.842 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:48.842 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:48.842 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.842 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.842 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:48.842 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:48.842 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:48.842 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:48.842 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:48.842 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.842 INFO:tasks.workunit.client.0.smithi043.stderr: -378> 2024-09-12T00:38:48.185+0000 7ff6d7fff640 10 monclient: _finish_auth 0 2024-09-12T00:38:48.843 INFO:tasks.workunit.client.0.smithi043.stderr: -377> 2024-09-12T00:38:48.185+0000 7ff6d7fff640 10 monclient: _check_auth_tickets 2024-09-12T00:38:48.843 INFO:tasks.workunit.client.0.smithi043.stderr: -376> 2024-09-12T00:38:48.185+0000 7ff6d7fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:48.843 INFO:tasks.workunit.client.0.smithi043.stderr: -375> 2024-09-12T00:38:48.185+0000 7ff6d7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:48.843 INFO:tasks.workunit.client.0.smithi043.stderr: -374> 2024-09-12T00:38:48.185+0000 7ff6d7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:38:48.843 INFO:tasks.workunit.client.0.smithi043.stderr: -373> 2024-09-12T00:38:48.185+0000 7ff6d7fff640 10 monclient: dump: 2024-09-12T00:38:48.843 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:48.843 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:48.843 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.843 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.843 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:48.843 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:48.844 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:48.844 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:48.844 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:48.844 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.844 INFO:tasks.workunit.client.0.smithi043.stderr: -372> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 5 monclient: authenticate success, global_id 6956 2024-09-12T00:38:48.844 INFO:tasks.workunit.client.0.smithi043.stderr: -371> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient: _renew_subs 2024-09-12T00:38:48.844 INFO:tasks.workunit.client.0.smithi043.stderr: -370> 2024-09-12T00:38:48.185+0000 7ff7f36bb640 4 set_mon_vals no callback set 2024-09-12T00:38:48.844 INFO:tasks.workunit.client.0.smithi043.stderr: -369> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:38:48.844 INFO:tasks.workunit.client.0.smithi043.stderr: -368> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient: _renew_subs 2024-09-12T00:38:48.844 INFO:tasks.workunit.client.0.smithi043.stderr: -367> 2024-09-12T00:38:48.185+0000 7ff7f4bb39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:38:48.844 INFO:tasks.workunit.client.0.smithi043.stderr: -366> 2024-09-12T00:38:48.189+0000 7ff6d7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:38:48.844 INFO:tasks.workunit.client.0.smithi043.stderr: -365> 2024-09-12T00:38:48.189+0000 7ff6d7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:38:48.845 INFO:tasks.workunit.client.0.smithi043.stderr: -364> 2024-09-12T00:38:48.189+0000 7ff6d7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:38:48.845 INFO:tasks.workunit.client.0.smithi043.stderr: -363> 2024-09-12T00:38:48.189+0000 7ff7f26b9640 10 monclient: get_auth_request con 0x7ff6cc070a20 auth_method 0 2024-09-12T00:38:48.845 INFO:tasks.workunit.client.0.smithi043.stderr: -362> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 10 monclient: get_monmap_and_config 2024-09-12T00:38:48.845 INFO:tasks.workunit.client.0.smithi043.stderr: -361> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 10 monclient: build_initial_monmap 2024-09-12T00:38:48.845 INFO:tasks.workunit.client.0.smithi043.stderr: -360> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 1 build_initial for_mkfs: 0 2024-09-12T00:38:48.845 INFO:tasks.workunit.client.0.smithi043.stderr: -359> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 10 monclient: monmap: 2024-09-12T00:38:48.845 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:38:48.845 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:48.845 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:38:48.845 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:38:48.845 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:48.845 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:48.845 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:38:48.846 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:38:48.846 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:38:48.846 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.846 INFO:tasks.workunit.client.0.smithi043.stderr: -358> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509135b20) adding auth protocol: cephx 2024-09-12T00:38:48.846 INFO:tasks.workunit.client.0.smithi043.stderr: -357> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509135b20) adding auth protocol: cephx 2024-09-12T00:38:48.846 INFO:tasks.workunit.client.0.smithi043.stderr: -356> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509135b20) adding auth protocol: cephx 2024-09-12T00:38:48.846 INFO:tasks.workunit.client.0.smithi043.stderr: -355> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509135b20) adding con mode: secure 2024-09-12T00:38:48.846 INFO:tasks.workunit.client.0.smithi043.stderr: -354> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509135b20) adding con mode: crc 2024-09-12T00:38:48.846 INFO:tasks.workunit.client.0.smithi043.stderr: -353> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509135b20) adding con mode: secure 2024-09-12T00:38:48.847 INFO:tasks.workunit.client.0.smithi043.stderr: -352> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509135b20) adding con mode: crc 2024-09-12T00:38:48.847 INFO:tasks.workunit.client.0.smithi043.stderr: -351> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509135b20) adding con mode: secure 2024-09-12T00:38:48.847 INFO:tasks.workunit.client.0.smithi043.stderr: -350> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509135b20) adding con mode: crc 2024-09-12T00:38:48.847 INFO:tasks.workunit.client.0.smithi043.stderr: -349> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509135b20) adding con mode: crc 2024-09-12T00:38:48.847 INFO:tasks.workunit.client.0.smithi043.stderr: -348> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509135b20) adding con mode: secure 2024-09-12T00:38:48.847 INFO:tasks.workunit.client.0.smithi043.stderr: -347> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509135b20) adding con mode: crc 2024-09-12T00:38:48.847 INFO:tasks.workunit.client.0.smithi043.stderr: -346> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509135b20) adding con mode: secure 2024-09-12T00:38:48.847 INFO:tasks.workunit.client.0.smithi043.stderr: -345> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509135b20) adding con mode: crc 2024-09-12T00:38:48.847 INFO:tasks.workunit.client.0.smithi043.stderr: -344> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509135b20) adding con mode: secure 2024-09-12T00:38:48.847 INFO:tasks.workunit.client.0.smithi043.stderr: -343> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.847 INFO:tasks.workunit.client.0.smithi043.stderr: -342> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 10 monclient: init 2024-09-12T00:38:48.847 INFO:tasks.workunit.client.0.smithi043.stderr: -341> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3460) adding auth protocol: cephx 2024-09-12T00:38:48.847 INFO:tasks.workunit.client.0.smithi043.stderr: -340> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3460) adding auth protocol: cephx 2024-09-12T00:38:48.848 INFO:tasks.workunit.client.0.smithi043.stderr: -339> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3460) adding auth protocol: cephx 2024-09-12T00:38:48.848 INFO:tasks.workunit.client.0.smithi043.stderr: -338> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3460) adding con mode: secure 2024-09-12T00:38:48.848 INFO:tasks.workunit.client.0.smithi043.stderr: -337> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3460) adding con mode: crc 2024-09-12T00:38:48.848 INFO:tasks.workunit.client.0.smithi043.stderr: -336> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3460) adding con mode: secure 2024-09-12T00:38:48.848 INFO:tasks.workunit.client.0.smithi043.stderr: -335> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3460) adding con mode: crc 2024-09-12T00:38:48.848 INFO:tasks.workunit.client.0.smithi043.stderr: -334> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3460) adding con mode: secure 2024-09-12T00:38:48.848 INFO:tasks.workunit.client.0.smithi043.stderr: -333> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3460) adding con mode: crc 2024-09-12T00:38:48.848 INFO:tasks.workunit.client.0.smithi043.stderr: -332> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3460) adding con mode: crc 2024-09-12T00:38:48.848 INFO:tasks.workunit.client.0.smithi043.stderr: -331> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3460) adding con mode: secure 2024-09-12T00:38:48.848 INFO:tasks.workunit.client.0.smithi043.stderr: -330> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3460) adding con mode: crc 2024-09-12T00:38:48.848 INFO:tasks.workunit.client.0.smithi043.stderr: -329> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3460) adding con mode: secure 2024-09-12T00:38:48.848 INFO:tasks.workunit.client.0.smithi043.stderr: -328> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3460) adding con mode: crc 2024-09-12T00:38:48.849 INFO:tasks.workunit.client.0.smithi043.stderr: -327> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3460) adding con mode: secure 2024-09-12T00:38:48.849 INFO:tasks.workunit.client.0.smithi043.stderr: -326> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.849 INFO:tasks.workunit.client.0.smithi043.stderr: -325> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.849 INFO:tasks.workunit.client.0.smithi043.stderr: -324> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 asok(0x563508e8f2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffed50f35a8 EEXIST 2024-09-12T00:38:48.849 INFO:tasks.workunit.client.0.smithi043.stderr: -323> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:48.849 INFO:tasks.workunit.client.0.smithi043.stderr: -322> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:38:48.849 INFO:tasks.workunit.client.0.smithi043.stderr: -321> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 10 monclient(hunting): picked mon.noname-a con 0x56350916a010 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:38:48.849 INFO:tasks.workunit.client.0.smithi043.stderr: -320> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 10 monclient(hunting): picked mon.noname-c con 0x563509165400 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:38:48.849 INFO:tasks.workunit.client.0.smithi043.stderr: -319> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 10 monclient(hunting): picked mon.noname-b con 0x563509165d80 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:38:48.849 INFO:tasks.workunit.client.0.smithi043.stderr: -318> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.849 INFO:tasks.workunit.client.0.smithi043.stderr: -317> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.849 INFO:tasks.workunit.client.0.smithi043.stderr: -316> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.849 INFO:tasks.workunit.client.0.smithi043.stderr: -315> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:48.850 INFO:tasks.workunit.client.0.smithi043.stderr: -314> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 10 monclient(hunting): authenticate will time out at 2224.182961s 2024-09-12T00:38:48.850 INFO:tasks.workunit.client.0.smithi043.stderr: -313> 2024-09-12T00:38:48.189+0000 7ff7f1eb8640 10 monclient(hunting): get_auth_request con 0x563509165400 auth_method 0 2024-09-12T00:38:48.850 INFO:tasks.workunit.client.0.smithi043.stderr: -312> 2024-09-12T00:38:48.189+0000 7ff7f1eb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.850 INFO:tasks.workunit.client.0.smithi043.stderr: -311> 2024-09-12T00:38:48.189+0000 7ff7f1eb8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.850 INFO:tasks.workunit.client.0.smithi043.stderr: -310> 2024-09-12T00:38:48.189+0000 7ff7f1eb8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.850 INFO:tasks.workunit.client.0.smithi043.stderr: -309> 2024-09-12T00:38:48.189+0000 7ff7f26b9640 10 monclient(hunting): get_auth_request con 0x56350916a010 auth_method 0 2024-09-12T00:38:48.850 INFO:tasks.workunit.client.0.smithi043.stderr: -308> 2024-09-12T00:38:48.189+0000 7ff7f26b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.850 INFO:tasks.workunit.client.0.smithi043.stderr: -307> 2024-09-12T00:38:48.189+0000 7ff7f26b9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.850 INFO:tasks.workunit.client.0.smithi043.stderr: -306> 2024-09-12T00:38:48.189+0000 7ff7f26b9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.850 INFO:tasks.workunit.client.0.smithi043.stderr: -305> 2024-09-12T00:38:48.189+0000 7ff7f26b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:48.850 INFO:tasks.workunit.client.0.smithi043.stderr: -304> 2024-09-12T00:38:48.189+0000 7ff7f26b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:48.850 INFO:tasks.workunit.client.0.smithi043.stderr: -303> 2024-09-12T00:38:48.189+0000 7ff7f26b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:48.850 INFO:tasks.workunit.client.0.smithi043.stderr: -302> 2024-09-12T00:38:48.189+0000 7ff7f1eb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:48.851 INFO:tasks.workunit.client.0.smithi043.stderr: -301> 2024-09-12T00:38:48.189+0000 7ff7f1eb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:48.851 INFO:tasks.workunit.client.0.smithi043.stderr: -300> 2024-09-12T00:38:48.189+0000 7ff7f1eb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:48.851 INFO:tasks.workunit.client.0.smithi043.stderr: -299> 2024-09-12T00:38:48.189+0000 7ff7f2eba640 10 monclient(hunting): get_auth_request con 0x563509165d80 auth_method 0 2024-09-12T00:38:48.851 INFO:tasks.workunit.client.0.smithi043.stderr: -298> 2024-09-12T00:38:48.189+0000 7ff7f2eba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.851 INFO:tasks.workunit.client.0.smithi043.stderr: -297> 2024-09-12T00:38:48.189+0000 7ff7f2eba640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.851 INFO:tasks.workunit.client.0.smithi043.stderr: -296> 2024-09-12T00:38:48.189+0000 7ff7f2eba640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.851 INFO:tasks.workunit.client.0.smithi043.stderr: -295> 2024-09-12T00:38:48.189+0000 7ff7f26b9640 10 monclient(hunting): handle_auth_done global_id 7257 payload 274 2024-09-12T00:38:48.851 INFO:tasks.workunit.client.0.smithi043.stderr: -294> 2024-09-12T00:38:48.189+0000 7ff7f26b9640 10 monclient: _finish_hunting 0 2024-09-12T00:38:48.851 INFO:tasks.workunit.client.0.smithi043.stderr: -293> 2024-09-12T00:38:48.189+0000 7ff7f26b9640 1 monclient: found mon.noname-a 2024-09-12T00:38:48.851 INFO:tasks.workunit.client.0.smithi043.stderr: -292> 2024-09-12T00:38:48.189+0000 7ff7f26b9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:38:48.851 INFO:tasks.workunit.client.0.smithi043.stderr: -291> 2024-09-12T00:38:48.189+0000 7ff6d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:48.851 INFO:tasks.workunit.client.0.smithi043.stderr: -290> 2024-09-12T00:38:48.189+0000 7ff6d5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:38:48.852 INFO:tasks.workunit.client.0.smithi043.stderr: -289> 2024-09-12T00:38:48.189+0000 7ff6d5ffb640 10 monclient: dump: 2024-09-12T00:38:48.852 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:48.852 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:48.852 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.852 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.852 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:48.852 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:48.852 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:48.852 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:48.852 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:48.852 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.853 INFO:tasks.workunit.client.0.smithi043.stderr: -288> 2024-09-12T00:38:48.189+0000 7ff6d5ffb640 10 monclient: _finish_auth 0 2024-09-12T00:38:48.853 INFO:tasks.workunit.client.0.smithi043.stderr: -287> 2024-09-12T00:38:48.189+0000 7ff6d5ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:38:48.853 INFO:tasks.workunit.client.0.smithi043.stderr: -286> 2024-09-12T00:38:48.189+0000 7ff6d5ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:48.853 INFO:tasks.workunit.client.0.smithi043.stderr: -285> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 5 monclient: authenticate success, global_id 7257 2024-09-12T00:38:48.853 INFO:tasks.workunit.client.0.smithi043.stderr: -284> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 10 monclient: get_monmap_and_config success 2024-09-12T00:38:48.853 INFO:tasks.workunit.client.0.smithi043.stderr: -283> 2024-09-12T00:38:48.189+0000 7ff7f4bb39c0 4 set_mon_vals no callback set 2024-09-12T00:38:48.853 INFO:tasks.workunit.client.0.smithi043.stderr: -282> 2024-09-12T00:38:48.189+0000 7ff6d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:48.853 INFO:tasks.workunit.client.0.smithi043.stderr: -281> 2024-09-12T00:38:48.189+0000 7ff6d5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:48.853 INFO:tasks.workunit.client.0.smithi043.stderr: -280> 2024-09-12T00:38:48.189+0000 7ff6d5ffb640 10 monclient: dump: 2024-09-12T00:38:48.853 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:48.853 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:48.853 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.854 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.854 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:48.854 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:48.854 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:48.854 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:48.854 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:48.854 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.854 INFO:tasks.workunit.client.0.smithi043.stderr: -279> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient: shutdown 2024-09-12T00:38:48.854 INFO:tasks.workunit.client.0.smithi043.stderr: -278> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient: build_initial_monmap 2024-09-12T00:38:48.854 INFO:tasks.workunit.client.0.smithi043.stderr: -277> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 1 build_initial for_mkfs: 0 2024-09-12T00:38:48.854 INFO:tasks.workunit.client.0.smithi043.stderr: -276> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient: monmap: 2024-09-12T00:38:48.854 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:38:48.855 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:48.855 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:38:48.855 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:38:48.855 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:48.855 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:48.855 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:38:48.855 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:38:48.855 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:38:48.855 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.856 INFO:tasks.workunit.client.0.smithi043.stderr: -275> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x56350915c3f0) adding auth protocol: cephx 2024-09-12T00:38:48.856 INFO:tasks.workunit.client.0.smithi043.stderr: -274> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x56350915c3f0) adding auth protocol: cephx 2024-09-12T00:38:48.856 INFO:tasks.workunit.client.0.smithi043.stderr: -273> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x56350915c3f0) adding auth protocol: cephx 2024-09-12T00:38:48.856 INFO:tasks.workunit.client.0.smithi043.stderr: -272> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x56350915c3f0) adding con mode: secure 2024-09-12T00:38:48.856 INFO:tasks.workunit.client.0.smithi043.stderr: -271> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x56350915c3f0) adding con mode: crc 2024-09-12T00:38:48.856 INFO:tasks.workunit.client.0.smithi043.stderr: -270> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x56350915c3f0) adding con mode: secure 2024-09-12T00:38:48.856 INFO:tasks.workunit.client.0.smithi043.stderr: -269> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x56350915c3f0) adding con mode: crc 2024-09-12T00:38:48.856 INFO:tasks.workunit.client.0.smithi043.stderr: -268> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x56350915c3f0) adding con mode: secure 2024-09-12T00:38:48.856 INFO:tasks.workunit.client.0.smithi043.stderr: -267> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x56350915c3f0) adding con mode: crc 2024-09-12T00:38:48.856 INFO:tasks.workunit.client.0.smithi043.stderr: -266> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x56350915c3f0) adding con mode: crc 2024-09-12T00:38:48.856 INFO:tasks.workunit.client.0.smithi043.stderr: -265> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x56350915c3f0) adding con mode: secure 2024-09-12T00:38:48.856 INFO:tasks.workunit.client.0.smithi043.stderr: -264> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x56350915c3f0) adding con mode: crc 2024-09-12T00:38:48.857 INFO:tasks.workunit.client.0.smithi043.stderr: -263> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x56350915c3f0) adding con mode: secure 2024-09-12T00:38:48.857 INFO:tasks.workunit.client.0.smithi043.stderr: -262> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x56350915c3f0) adding con mode: crc 2024-09-12T00:38:48.857 INFO:tasks.workunit.client.0.smithi043.stderr: -261> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x56350915c3f0) adding con mode: secure 2024-09-12T00:38:48.857 INFO:tasks.workunit.client.0.smithi043.stderr: -260> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.857 INFO:tasks.workunit.client.0.smithi043.stderr: -259> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 1 librados: starting msgr at 2024-09-12T00:38:48.857 INFO:tasks.workunit.client.0.smithi043.stderr: -258> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 1 librados: starting objecter 2024-09-12T00:38:48.857 INFO:tasks.workunit.client.0.smithi043.stderr: -257> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 asok(0x563508e8f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x563509138670 EEXIST 2024-09-12T00:38:48.857 INFO:tasks.workunit.client.0.smithi043.stderr: -256> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 1 librados: setting wanted keys 2024-09-12T00:38:48.857 INFO:tasks.workunit.client.0.smithi043.stderr: -255> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 1 librados: calling monclient init 2024-09-12T00:38:48.857 INFO:tasks.workunit.client.0.smithi043.stderr: -254> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient: init 2024-09-12T00:38:48.857 INFO:tasks.workunit.client.0.smithi043.stderr: -253> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509117f70) adding auth protocol: cephx 2024-09-12T00:38:48.857 INFO:tasks.workunit.client.0.smithi043.stderr: -252> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509117f70) adding auth protocol: cephx 2024-09-12T00:38:48.858 INFO:tasks.workunit.client.0.smithi043.stderr: -251> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509117f70) adding auth protocol: cephx 2024-09-12T00:38:48.858 INFO:tasks.workunit.client.0.smithi043.stderr: -250> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509117f70) adding con mode: secure 2024-09-12T00:38:48.858 INFO:tasks.workunit.client.0.smithi043.stderr: -249> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509117f70) adding con mode: crc 2024-09-12T00:38:48.858 INFO:tasks.workunit.client.0.smithi043.stderr: -248> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509117f70) adding con mode: secure 2024-09-12T00:38:48.858 INFO:tasks.workunit.client.0.smithi043.stderr: -247> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509117f70) adding con mode: crc 2024-09-12T00:38:48.858 INFO:tasks.workunit.client.0.smithi043.stderr: -246> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509117f70) adding con mode: secure 2024-09-12T00:38:48.858 INFO:tasks.workunit.client.0.smithi043.stderr: -245> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509117f70) adding con mode: crc 2024-09-12T00:38:48.858 INFO:tasks.workunit.client.0.smithi043.stderr: -244> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509117f70) adding con mode: crc 2024-09-12T00:38:48.858 INFO:tasks.workunit.client.0.smithi043.stderr: -243> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509117f70) adding con mode: secure 2024-09-12T00:38:48.859 INFO:tasks.workunit.client.0.smithi043.stderr: -242> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509117f70) adding con mode: crc 2024-09-12T00:38:48.859 INFO:tasks.workunit.client.0.smithi043.stderr: -241> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509117f70) adding con mode: secure 2024-09-12T00:38:48.859 INFO:tasks.workunit.client.0.smithi043.stderr: -240> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509117f70) adding con mode: crc 2024-09-12T00:38:48.859 INFO:tasks.workunit.client.0.smithi043.stderr: -239> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 AuthRegistry(0x563509117f70) adding con mode: secure 2024-09-12T00:38:48.859 INFO:tasks.workunit.client.0.smithi043.stderr: -238> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.859 INFO:tasks.workunit.client.0.smithi043.stderr: -237> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.859 INFO:tasks.workunit.client.0.smithi043.stderr: -236> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 asok(0x563508e8f2b0) register_command rotate-key cmddesc rotate-key hook 0x5635091180b8 EEXIST 2024-09-12T00:38:48.860 INFO:tasks.workunit.client.0.smithi043.stderr: -235> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:48.860 INFO:tasks.workunit.client.0.smithi043.stderr: -234> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:38:48.860 INFO:tasks.workunit.client.0.smithi043.stderr: -233> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient(hunting): picked mon.noname-b con 0x563509165400 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:38:48.860 INFO:tasks.workunit.client.0.smithi043.stderr: -232> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient(hunting): picked mon.noname-c con 0x563509165d80 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:38:48.860 INFO:tasks.workunit.client.0.smithi043.stderr: -231> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient(hunting): picked mon.noname-a con 0x56350916a010 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:38:48.860 INFO:tasks.workunit.client.0.smithi043.stderr: -230> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.860 INFO:tasks.workunit.client.0.smithi043.stderr: -229> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.860 INFO:tasks.workunit.client.0.smithi043.stderr: -228> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.860 INFO:tasks.workunit.client.0.smithi043.stderr: -227> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:48.860 INFO:tasks.workunit.client.0.smithi043.stderr: -226> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient(hunting): authenticate will time out at 2224.185737s 2024-09-12T00:38:48.860 INFO:tasks.workunit.client.0.smithi043.stderr: -225> 2024-09-12T00:38:48.193+0000 7ff7f1eb8640 10 monclient(hunting): get_auth_request con 0x563509165d80 auth_method 0 2024-09-12T00:38:48.860 INFO:tasks.workunit.client.0.smithi043.stderr: -224> 2024-09-12T00:38:48.193+0000 7ff7f1eb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.861 INFO:tasks.workunit.client.0.smithi043.stderr: -223> 2024-09-12T00:38:48.193+0000 7ff7f1eb8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.861 INFO:tasks.workunit.client.0.smithi043.stderr: -222> 2024-09-12T00:38:48.193+0000 7ff7f1eb8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.861 INFO:tasks.workunit.client.0.smithi043.stderr: -221> 2024-09-12T00:38:48.193+0000 7ff7f2eba640 10 monclient(hunting): get_auth_request con 0x56350916a010 auth_method 0 2024-09-12T00:38:48.861 INFO:tasks.workunit.client.0.smithi043.stderr: -220> 2024-09-12T00:38:48.193+0000 7ff7f2eba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.861 INFO:tasks.workunit.client.0.smithi043.stderr: -219> 2024-09-12T00:38:48.193+0000 7ff7f2eba640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.861 INFO:tasks.workunit.client.0.smithi043.stderr: -218> 2024-09-12T00:38:48.193+0000 7ff7f2eba640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.861 INFO:tasks.workunit.client.0.smithi043.stderr: -217> 2024-09-12T00:38:48.193+0000 7ff7f1eb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:48.861 INFO:tasks.workunit.client.0.smithi043.stderr: -216> 2024-09-12T00:38:48.193+0000 7ff7f1eb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:48.861 INFO:tasks.workunit.client.0.smithi043.stderr: -215> 2024-09-12T00:38:48.193+0000 7ff7f1eb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:48.861 INFO:tasks.workunit.client.0.smithi043.stderr: -214> 2024-09-12T00:38:48.193+0000 7ff7f2eba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:48.861 INFO:tasks.workunit.client.0.smithi043.stderr: -213> 2024-09-12T00:38:48.193+0000 7ff7f2eba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:48.861 INFO:tasks.workunit.client.0.smithi043.stderr: -212> 2024-09-12T00:38:48.193+0000 7ff7f2eba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:48.861 INFO:tasks.workunit.client.0.smithi043.stderr: -211> 2024-09-12T00:38:48.193+0000 7ff7f26b9640 10 monclient(hunting): get_auth_request con 0x563509165400 auth_method 0 2024-09-12T00:38:48.862 INFO:tasks.workunit.client.0.smithi043.stderr: -210> 2024-09-12T00:38:48.193+0000 7ff7f26b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.862 INFO:tasks.workunit.client.0.smithi043.stderr: -209> 2024-09-12T00:38:48.193+0000 7ff7f26b9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.862 INFO:tasks.workunit.client.0.smithi043.stderr: -208> 2024-09-12T00:38:48.193+0000 7ff7f26b9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.862 INFO:tasks.workunit.client.0.smithi043.stderr: -207> 2024-09-12T00:38:48.193+0000 7ff7f1eb8640 10 monclient(hunting): handle_auth_done global_id 6962 payload 824 2024-09-12T00:38:48.862 INFO:tasks.workunit.client.0.smithi043.stderr: -206> 2024-09-12T00:38:48.193+0000 7ff7f1eb8640 10 monclient: _finish_hunting 0 2024-09-12T00:38:48.862 INFO:tasks.workunit.client.0.smithi043.stderr: -205> 2024-09-12T00:38:48.193+0000 7ff7f1eb8640 1 monclient: found mon.noname-c 2024-09-12T00:38:48.862 INFO:tasks.workunit.client.0.smithi043.stderr: -204> 2024-09-12T00:38:48.193+0000 7ff7f1eb8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:38:48.862 INFO:tasks.workunit.client.0.smithi043.stderr: -203> 2024-09-12T00:38:48.193+0000 7ff6c3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:48.862 INFO:tasks.workunit.client.0.smithi043.stderr: -202> 2024-09-12T00:38:48.193+0000 7ff6c3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:38:48.862 INFO:tasks.workunit.client.0.smithi043.stderr: -201> 2024-09-12T00:38:48.193+0000 7ff6c3fff640 10 monclient: dump: 2024-09-12T00:38:48.862 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:48.862 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:48.862 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.863 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.863 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:48.863 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:48.863 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:48.863 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:48.863 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:48.863 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.863 INFO:tasks.workunit.client.0.smithi043.stderr: -200> 2024-09-12T00:38:48.193+0000 7ff6c3fff640 10 monclient: _finish_auth 0 2024-09-12T00:38:48.863 INFO:tasks.workunit.client.0.smithi043.stderr: -199> 2024-09-12T00:38:48.193+0000 7ff6c3fff640 10 monclient: _check_auth_tickets 2024-09-12T00:38:48.863 INFO:tasks.workunit.client.0.smithi043.stderr: -198> 2024-09-12T00:38:48.193+0000 7ff6c3fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:48.863 INFO:tasks.workunit.client.0.smithi043.stderr: -197> 2024-09-12T00:38:48.193+0000 7ff6c3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:48.863 INFO:tasks.workunit.client.0.smithi043.stderr: -196> 2024-09-12T00:38:48.193+0000 7ff6c3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:38:48.864 INFO:tasks.workunit.client.0.smithi043.stderr: -195> 2024-09-12T00:38:48.193+0000 7ff6c3fff640 10 monclient: dump: 2024-09-12T00:38:48.864 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:38:48.864 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:38:48.864 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.864 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:38:48.864 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:48.864 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:38:48.864 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:38:48.864 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:38:48.864 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:38:48.864 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.864 INFO:tasks.workunit.client.0.smithi043.stderr: -194> 2024-09-12T00:38:48.193+0000 7ff6d5ffb640 4 set_mon_vals no callback set 2024-09-12T00:38:48.864 INFO:tasks.workunit.client.0.smithi043.stderr: -193> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 monclient: authenticate success, global_id 6962 2024-09-12T00:38:48.865 INFO:tasks.workunit.client.0.smithi043.stderr: -192> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient: _renew_subs 2024-09-12T00:38:48.865 INFO:tasks.workunit.client.0.smithi043.stderr: -191> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:38:48.865 INFO:tasks.workunit.client.0.smithi043.stderr: -190> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient: _renew_subs 2024-09-12T00:38:48.865 INFO:tasks.workunit.client.0.smithi043.stderr: -189> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:38:48.865 INFO:tasks.workunit.client.0.smithi043.stderr: -188> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 1 librados: init done 2024-09-12T00:38:48.865 INFO:tasks.workunit.client.0.smithi043.stderr: -187> 2024-09-12T00:38:48.193+0000 7ff7f4bb39c0 5 asok(0x563508e8f2b0) register_command cr dump hook 0x56350915b688 2024-09-12T00:38:48.865 INFO:tasks.workunit.client.0.smithi043.stderr: -186> 2024-09-12T00:38:48.197+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.865 INFO:tasks.workunit.client.0.smithi043.stderr: -185> 2024-09-12T00:38:48.197+0000 7ff6c3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:38:48.865 INFO:tasks.workunit.client.0.smithi043.stderr: -184> 2024-09-12T00:38:48.197+0000 7ff6c3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:38:48.865 INFO:tasks.workunit.client.0.smithi043.stderr: -183> 2024-09-12T00:38:48.197+0000 7ff6c3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:38:48.865 INFO:tasks.workunit.client.0.smithi043.stderr: -182> 2024-09-12T00:38:48.197+0000 7ff7f26b9640 10 monclient: get_auth_request con 0x7ff6bc070ae0 auth_method 0 2024-09-12T00:38:48.865 INFO:tasks.workunit.client.0.smithi043.stderr: -181> 2024-09-12T00:38:48.197+0000 7ff7f2eba640 10 monclient: get_auth_request con 0x563509183970 auth_method 0 2024-09-12T00:38:48.865 INFO:tasks.workunit.client.0.smithi043.stderr: -180> 2024-09-12T00:38:48.401+0000 7ff7f2eba640 10 monclient: get_auth_request con 0x563509183970 auth_method 0 2024-09-12T00:38:48.865 INFO:tasks.workunit.client.0.smithi043.stderr: -179> 2024-09-12T00:38:48.401+0000 7ff7f4bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.866 INFO:tasks.workunit.client.0.smithi043.stderr: -178> 2024-09-12T00:38:48.401+0000 7ff7f4bb39c0 20 realm 2024-09-12T00:38:48.866 INFO:tasks.workunit.client.0.smithi043.stderr: -177> 2024-09-12T00:38:48.401+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.866 INFO:tasks.workunit.client.0.smithi043.stderr: -176> 2024-09-12T00:38:48.401+0000 7ff7f4bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.866 INFO:tasks.workunit.client.0.smithi043.stderr: -175> 2024-09-12T00:38:48.401+0000 7ff7f4bb39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:48.866 INFO:tasks.workunit.client.0.smithi043.stderr: -174> 2024-09-12T00:38:48.401+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.866 INFO:tasks.workunit.client.0.smithi043.stderr: -173> 2024-09-12T00:38:48.401+0000 7ff7f4bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.866 INFO:tasks.workunit.client.0.smithi043.stderr: -172> 2024-09-12T00:38:48.401+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.866 INFO:tasks.workunit.client.0.smithi043.stderr: -171> 2024-09-12T00:38:48.405+0000 7ff7f26b9640 10 monclient: get_auth_request con 0x563509187be0 auth_method 0 2024-09-12T00:38:48.866 INFO:tasks.workunit.client.0.smithi043.stderr: -170> 2024-09-12T00:38:48.405+0000 7ff7f4bb39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:48.866 INFO:tasks.workunit.client.0.smithi043.stderr: -169> 2024-09-12T00:38:48.405+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.866 INFO:tasks.workunit.client.0.smithi043.stderr: -168> 2024-09-12T00:38:48.405+0000 7ff7f1eb8640 10 monclient: get_auth_request con 0x56350918b440 auth_method 0 2024-09-12T00:38:48.866 INFO:tasks.workunit.client.0.smithi043.stderr: -167> 2024-09-12T00:38:48.409+0000 7ff7f4bb39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:48.867 INFO:tasks.workunit.client.0.smithi043.stderr: -166> 2024-09-12T00:38:48.409+0000 7ff7f4bb39c0 20 searching for the correct realm 2024-09-12T00:38:48.867 INFO:tasks.workunit.client.0.smithi043.stderr: -165> 2024-09-12T00:38:48.409+0000 7ff7f2eba640 10 monclient: get_auth_request con 0x5635091901e0 auth_method 0 2024-09-12T00:38:48.867 INFO:tasks.workunit.client.0.smithi043.stderr: -164> 2024-09-12T00:38:48.409+0000 7ff7f26b9640 10 monclient: get_auth_request con 0x7ff7ec07f070 auth_method 0 2024-09-12T00:38:48.867 INFO:tasks.workunit.client.0.smithi043.stderr: -163> 2024-09-12T00:38:48.413+0000 7ff7f1eb8640 10 monclient: get_auth_request con 0x7ff7e80cac20 auth_method 0 2024-09-12T00:38:48.867 INFO:tasks.workunit.client.0.smithi043.stderr: -162> 2024-09-12T00:38:48.413+0000 7ff7f26b9640 0 -- 172.21.15.43:0/343199721 >> [v2:172.21.15.97:6816/489545787,v1:172.21.15.97:6817/489545787] conn(0x7ff7ec07f070 msgr2=0x7ff7ec079640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:48.867 INFO:tasks.workunit.client.0.smithi043.stderr: -161> 2024-09-12T00:38:48.413+0000 7ff6c3fff640 1 client.6962.objecter ms_handle_reset 0x7ff7ec07f070 session 0x7ff7ec088fa0 osd.7 2024-09-12T00:38:48.867 INFO:tasks.workunit.client.0.smithi043.stderr: -160> 2024-09-12T00:38:48.413+0000 7ff6c3fff640 10 monclient: _renew_subs 2024-09-12T00:38:48.867 INFO:tasks.workunit.client.0.smithi043.stderr: -159> 2024-09-12T00:38:48.413+0000 7ff6c3fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:38:48.867 INFO:tasks.workunit.client.0.smithi043.stderr: -158> 2024-09-12T00:38:48.417+0000 7ff7f26b9640 10 monclient: get_auth_request con 0x7ff6bc080b00 auth_method 0 2024-09-12T00:38:48.867 INFO:tasks.workunit.client.0.smithi043.stderr: -157> 2024-09-12T00:38:48.417+0000 7ff7f2eba640 10 monclient: get_auth_request con 0x7ff7e80ff690 auth_method 0 2024-09-12T00:38:48.867 INFO:tasks.workunit.client.0.smithi043.stderr: -156> 2024-09-12T00:38:48.425+0000 7ff7f26b9640 10 monclient: get_auth_request con 0x7ff7e8108230 auth_method 0 2024-09-12T00:38:48.867 INFO:tasks.workunit.client.0.smithi043.stderr: -155> 2024-09-12T00:38:48.425+0000 7ff7f26b9640 0 -- 172.21.15.43:0/343199721 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7ff7e8108230 msgr2=0x7ff7e812b700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:48.867 INFO:tasks.workunit.client.0.smithi043.stderr: -154> 2024-09-12T00:38:48.629+0000 7ff7f26b9640 10 monclient: get_auth_request con 0x7ff7e8108230 auth_method 0 2024-09-12T00:38:48.868 INFO:tasks.workunit.client.0.smithi043.stderr: -153> 2024-09-12T00:38:48.641+0000 7ff7f4bb39c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:38:48.868 INFO:tasks.workunit.client.0.smithi043.stderr: -152> 2024-09-12T00:38:48.641+0000 7ff7f4bb39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:48.868 INFO:tasks.workunit.client.0.smithi043.stderr: -151> 2024-09-12T00:38:48.641+0000 7ff7f4bb39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:48.868 INFO:tasks.workunit.client.0.smithi043.stderr: -150> 2024-09-12T00:38:48.641+0000 7ff7f4bb39c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:38:48.868 INFO:tasks.workunit.client.0.smithi043.stderr: -149> 2024-09-12T00:38:48.641+0000 7ff7f4bb39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:48.868 INFO:tasks.workunit.client.0.smithi043.stderr: -148> 2024-09-12T00:38:48.641+0000 7ff7f4bb39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:48.868 INFO:tasks.workunit.client.0.smithi043.stderr: -147> 2024-09-12T00:38:48.641+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.868 INFO:tasks.workunit.client.0.smithi043.stderr: -146> 2024-09-12T00:38:48.641+0000 7ff7f4bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.868 INFO:tasks.workunit.client.0.smithi043.stderr: -145> 2024-09-12T00:38:48.641+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.868 INFO:tasks.workunit.client.0.smithi043.stderr: -144> 2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:48.868 INFO:tasks.workunit.client.0.smithi043.stderr: -143> 2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.869 INFO:tasks.workunit.client.0.smithi043.stderr: -142> 2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:48.869 INFO:tasks.workunit.client.0.smithi043.stderr: -141> 2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 zone default found 2024-09-12T00:38:48.869 INFO:tasks.workunit.client.0.smithi043.stderr: -140> 2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 4 Realm: () 2024-09-12T00:38:48.869 INFO:tasks.workunit.client.0.smithi043.stderr: -139> 2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:38:48.869 INFO:tasks.workunit.client.0.smithi043.stderr: -138> 2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:38:48.869 INFO:tasks.workunit.client.0.smithi043.stderr: -137> 2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:48.869 INFO:tasks.workunit.client.0.smithi043.stderr: -136> 2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 zonegroup default 2024-09-12T00:38:48.869 INFO:tasks.workunit.client.0.smithi043.stderr: -135> 2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.869 INFO:tasks.workunit.client.0.smithi043.stderr: -134> 2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.869 INFO:tasks.workunit.client.0.smithi043.stderr: -133> 2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.870 INFO:tasks.workunit.client.0.smithi043.stderr: -132> 2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.870 INFO:tasks.workunit.client.0.smithi043.stderr: -131> 2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.870 INFO:tasks.workunit.client.0.smithi043.stderr: -130> 2024-09-12T00:38:48.645+0000 7ff7f4bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.870 INFO:tasks.workunit.client.0.smithi043.stderr: -129> 2024-09-12T00:38:48.649+0000 7ff7f4bb39c0 20 started sync module instance, tier type = 2024-09-12T00:38:48.870 INFO:tasks.workunit.client.0.smithi043.stderr: -128> 2024-09-12T00:38:48.649+0000 7ff7f4bb39c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:38:48.870 INFO:tasks.workunit.client.0.smithi043.stderr: -127> 2024-09-12T00:38:48.673+0000 7ff7f4bb39c0 20 add_watcher() i=0 2024-09-12T00:38:48.870 INFO:tasks.workunit.client.0.smithi043.stderr: -126> 2024-09-12T00:38:48.673+0000 7ff7f4bb39c0 20 add_watcher() i=1 2024-09-12T00:38:48.870 INFO:tasks.workunit.client.0.smithi043.stderr: -125> 2024-09-12T00:38:48.673+0000 7ff7f4bb39c0 20 add_watcher() i=2 2024-09-12T00:38:48.870 INFO:tasks.workunit.client.0.smithi043.stderr: -124> 2024-09-12T00:38:48.673+0000 7ff7f4bb39c0 20 add_watcher() i=3 2024-09-12T00:38:48.870 INFO:tasks.workunit.client.0.smithi043.stderr: -123> 2024-09-12T00:38:48.673+0000 7ff7f4bb39c0 20 add_watcher() i=4 2024-09-12T00:38:48.870 INFO:tasks.workunit.client.0.smithi043.stderr: -122> 2024-09-12T00:38:48.673+0000 7ff7f4bb39c0 20 add_watcher() i=5 2024-09-12T00:38:48.870 INFO:tasks.workunit.client.0.smithi043.stderr: -121> 2024-09-12T00:38:48.673+0000 7ff7f4bb39c0 20 add_watcher() i=6 2024-09-12T00:38:48.871 INFO:tasks.workunit.client.0.smithi043.stderr: -120> 2024-09-12T00:38:48.673+0000 7ff7f4bb39c0 20 add_watcher() i=7 2024-09-12T00:38:48.871 INFO:tasks.workunit.client.0.smithi043.stderr: -119> 2024-09-12T00:38:48.673+0000 7ff7f4bb39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:48.871 INFO:tasks.workunit.client.0.smithi043.stderr: -118> 2024-09-12T00:38:48.677+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3940) adding auth protocol: cephx 2024-09-12T00:38:48.871 INFO:tasks.workunit.client.0.smithi043.stderr: -117> 2024-09-12T00:38:48.677+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3940) adding auth protocol: cephx 2024-09-12T00:38:48.871 INFO:tasks.workunit.client.0.smithi043.stderr: -116> 2024-09-12T00:38:48.677+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3940) adding auth protocol: cephx 2024-09-12T00:38:48.871 INFO:tasks.workunit.client.0.smithi043.stderr: -115> 2024-09-12T00:38:48.677+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3940) adding con mode: secure 2024-09-12T00:38:48.871 INFO:tasks.workunit.client.0.smithi043.stderr: -114> 2024-09-12T00:38:48.677+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3940) adding con mode: crc 2024-09-12T00:38:48.871 INFO:tasks.workunit.client.0.smithi043.stderr: -113> 2024-09-12T00:38:48.677+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3940) adding con mode: secure 2024-09-12T00:38:48.871 INFO:tasks.workunit.client.0.smithi043.stderr: -112> 2024-09-12T00:38:48.677+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3940) adding con mode: crc 2024-09-12T00:38:48.871 INFO:tasks.workunit.client.0.smithi043.stderr: -111> 2024-09-12T00:38:48.677+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3940) adding con mode: secure 2024-09-12T00:38:48.871 INFO:tasks.workunit.client.0.smithi043.stderr: -110> 2024-09-12T00:38:48.677+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3940) adding con mode: crc 2024-09-12T00:38:48.871 INFO:tasks.workunit.client.0.smithi043.stderr: -109> 2024-09-12T00:38:48.677+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3940) adding con mode: crc 2024-09-12T00:38:48.871 INFO:tasks.workunit.client.0.smithi043.stderr: -108> 2024-09-12T00:38:48.677+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3940) adding con mode: secure 2024-09-12T00:38:48.872 INFO:tasks.workunit.client.0.smithi043.stderr: -107> 2024-09-12T00:38:48.677+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3940) adding con mode: crc 2024-09-12T00:38:48.872 INFO:tasks.workunit.client.0.smithi043.stderr: -106> 2024-09-12T00:38:48.677+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3940) adding con mode: secure 2024-09-12T00:38:48.872 INFO:tasks.workunit.client.0.smithi043.stderr: -105> 2024-09-12T00:38:48.677+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3940) adding con mode: crc 2024-09-12T00:38:48.872 INFO:tasks.workunit.client.0.smithi043.stderr: -104> 2024-09-12T00:38:48.677+0000 7ff7f4bb39c0 5 AuthRegistry(0x7ffed50f3940) adding con mode: secure 2024-09-12T00:38:48.872 INFO:tasks.workunit.client.0.smithi043.stderr: -103> 2024-09-12T00:38:48.677+0000 7ff6a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:48.872 INFO:tasks.workunit.client.0.smithi043.stderr: -102> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.872 INFO:tasks.workunit.client.0.smithi043.stderr: -101> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:48.872 INFO:tasks.workunit.client.0.smithi043.stderr: -100> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:48.872 INFO:tasks.workunit.client.0.smithi043.stderr: -99> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 5 asok(0x563508e8f2b0) register_command cache list hook 0x563509163750 2024-09-12T00:38:48.872 INFO:tasks.workunit.client.0.smithi043.stderr: -98> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 5 asok(0x563508e8f2b0) register_command cache inspect hook 0x563509163750 2024-09-12T00:38:48.872 INFO:tasks.workunit.client.0.smithi043.stderr: -97> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 5 asok(0x563508e8f2b0) register_command cache erase hook 0x563509163750 2024-09-12T00:38:48.872 INFO:tasks.workunit.client.0.smithi043.stderr: -96> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 5 asok(0x563508e8f2b0) register_command cache zap hook 0x563509163750 2024-09-12T00:38:48.872 INFO:tasks.workunit.client.0.smithi043.stderr: -95> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 5 note: GC not initialized 2024-09-12T00:38:48.873 INFO:tasks.workunit.client.0.smithi043.stderr: -94> 2024-09-12T00:38:48.681+0000 7ff6237fe640 20 reqs_thread_entry: start 2024-09-12T00:38:48.873 INFO:tasks.workunit.client.0.smithi043.stderr: -93> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 5 asok(0x563508e8f2b0) register_command sync trace show hook 0x7ff7e402e050 2024-09-12T00:38:48.873 INFO:tasks.workunit.client.0.smithi043.stderr: -92> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 5 asok(0x563508e8f2b0) register_command sync trace history hook 0x7ff7e402e050 2024-09-12T00:38:48.873 INFO:tasks.workunit.client.0.smithi043.stderr: -91> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 5 asok(0x563508e8f2b0) register_command sync trace active hook 0x7ff7e402e050 2024-09-12T00:38:48.873 INFO:tasks.workunit.client.0.smithi043.stderr: -90> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 5 asok(0x563508e8f2b0) register_command sync trace active_short hook 0x7ff7e402e050 2024-09-12T00:38:48.873 INFO:tasks.workunit.client.0.smithi043.stderr: -89> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:48.873 INFO:tasks.workunit.client.0.smithi043.stderr: -88> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 20 Filter name: none 2024-09-12T00:38:48.873 INFO:tasks.workunit.client.0.smithi043.stderr: -87> 2024-09-12T00:38:48.681+0000 7ff6217fa640 20 reqs_thread_entry: start 2024-09-12T00:38:48.873 INFO:tasks.workunit.client.0.smithi043.stderr: -86> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:38:48.873 INFO:tasks.workunit.client.0.smithi043.stderr: -85> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.873 INFO:tasks.workunit.client.0.smithi043.stderr: -84> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:48.873 INFO:tasks.workunit.client.0.smithi043.stderr: -83> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:38:48.873 INFO:tasks.workunit.client.0.smithi043.stderr: -82> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:38:48.874 INFO:tasks.workunit.client.0.smithi043.stderr: -81> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 : miss 2024-09-12T00:38:48.874 INFO:tasks.workunit.client.0.smithi043.stderr: -80> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.874 INFO:tasks.workunit.client.0.smithi043.stderr: -79> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:48.874 INFO:tasks.workunit.client.0.smithi043.stderr: -78> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 info.flags=0x17 2024-09-12T00:38:48.874 INFO:tasks.workunit.client.0.smithi043.stderr: -77> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 to cache LRU end 2024-09-12T00:38:48.874 INFO:tasks.workunit.client.0.smithi043.stderr: -76> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:48.874 INFO:tasks.workunit.client.0.smithi043.stderr: -75> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:48.874 INFO:tasks.workunit.client.0.smithi043.stderr: -74> 2024-09-12T00:38:48.681+0000 7ff7f4bb39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 2024-09-12T00:38:48.874 INFO:tasks.workunit.client.0.smithi043.stderr: -73> 2024-09-12T00:38:48.693+0000 7ff7f4bb39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 info.flags=0x17 2024-09-12T00:38:48.874 INFO:tasks.workunit.client.0.smithi043.stderr: -72> 2024-09-12T00:38:48.693+0000 7ff7f4bb39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 to cache LRU end 2024-09-12T00:38:48.874 INFO:tasks.workunit.client.0.smithi043.stderr: -71> 2024-09-12T00:38:48.693+0000 7ff7f4bb39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:48.874 INFO:tasks.workunit.client.0.smithi043.stderr: -70> 2024-09-12T00:38:48.693+0000 7ff7f4bb39c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32, ofs0, ns] 2024-09-12T00:38:48.874 INFO:tasks.workunit.client.0.smithi043.stderr: -69> 2024-09-12T00:38:48.697+0000 7ff6d57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333494 cookie 94785785926288 notifier 6962 bl.length()=931 2024-09-12T00:38:48.875 INFO:tasks.workunit.client.0.smithi043.stderr: -68> 2024-09-12T00:38:48.697+0000 7ff6d57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 info.flags=0x17 2024-09-12T00:38:48.875 INFO:tasks.workunit.client.0.smithi043.stderr: -67> 2024-09-12T00:38:48.697+0000 7ff6d57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 to cache LRU end 2024-09-12T00:38:48.875 INFO:tasks.workunit.client.0.smithi043.stderr: -66> 2024-09-12T00:38:48.697+0000 7ff6d57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:48.875 INFO:tasks.workunit.client.0.smithi043.stderr: -65> 2024-09-12T00:38:48.697+0000 7ff7f4bb39c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): orig_sources= new_sources= 2024-09-12T00:38:48.875 INFO:tasks.workunit.client.0.smithi043.stderr: -64> 2024-09-12T00:38:48.697+0000 7ff7f4bb39c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): potential sources added=[] removed=[] 2024-09-12T00:38:48.875 INFO:tasks.workunit.client.0.smithi043.stderr: -63> 2024-09-12T00:38:48.697+0000 7ff7f4bb39c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): orig_dests= new_dests= 2024-09-12T00:38:48.875 INFO:tasks.workunit.client.0.smithi043.stderr: -62> 2024-09-12T00:38:48.697+0000 7ff7f4bb39c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): potential dests added=[] removed=[] 2024-09-12T00:38:48.875 INFO:tasks.workunit.client.0.smithi043.stderr: -61> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.0 2024-09-12T00:38:48.875 INFO:tasks.workunit.client.0.smithi043.stderr: -60> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.0 2024-09-12T00:38:48.875 INFO:tasks.workunit.client.0.smithi043.stderr: -59> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.1 2024-09-12T00:38:48.875 INFO:tasks.workunit.client.0.smithi043.stderr: -58> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.1 2024-09-12T00:38:48.875 INFO:tasks.workunit.client.0.smithi043.stderr: -57> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.2 2024-09-12T00:38:48.875 INFO:tasks.workunit.client.0.smithi043.stderr: -56> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.2 2024-09-12T00:38:48.875 INFO:tasks.workunit.client.0.smithi043.stderr: -55> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.3 2024-09-12T00:38:48.876 INFO:tasks.workunit.client.0.smithi043.stderr: -54> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.3 2024-09-12T00:38:48.876 INFO:tasks.workunit.client.0.smithi043.stderr: -53> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.4 2024-09-12T00:38:48.876 INFO:tasks.workunit.client.0.smithi043.stderr: -52> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.4 2024-09-12T00:38:48.876 INFO:tasks.workunit.client.0.smithi043.stderr: -51> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.5 2024-09-12T00:38:48.876 INFO:tasks.workunit.client.0.smithi043.stderr: -50> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.5 2024-09-12T00:38:48.876 INFO:tasks.workunit.client.0.smithi043.stderr: -49> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.6 2024-09-12T00:38:48.876 INFO:tasks.workunit.client.0.smithi043.stderr: -48> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.6 2024-09-12T00:38:48.876 INFO:tasks.workunit.client.0.smithi043.stderr: -47> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.7 2024-09-12T00:38:48.876 INFO:tasks.workunit.client.0.smithi043.stderr: -46> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.7 2024-09-12T00:38:48.876 INFO:tasks.workunit.client.0.smithi043.stderr: -45> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.8 2024-09-12T00:38:48.876 INFO:tasks.workunit.client.0.smithi043.stderr: -44> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.8 2024-09-12T00:38:48.876 INFO:tasks.workunit.client.0.smithi043.stderr: -43> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.9 2024-09-12T00:38:48.876 INFO:tasks.workunit.client.0.smithi043.stderr: -42> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.9 2024-09-12T00:38:48.877 INFO:tasks.workunit.client.0.smithi043.stderr: -41> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.10 2024-09-12T00:38:48.877 INFO:tasks.workunit.client.0.smithi043.stderr: -40> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.10 2024-09-12T00:38:48.877 INFO:tasks.workunit.client.0.smithi043.stderr: -39> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.11 2024-09-12T00:38:48.877 INFO:tasks.workunit.client.0.smithi043.stderr: -38> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.11 2024-09-12T00:38:48.877 INFO:tasks.workunit.client.0.smithi043.stderr: -37> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.0 2024-09-12T00:38:48.877 INFO:tasks.workunit.client.0.smithi043.stderr: -36> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1 2024-09-12T00:38:48.877 INFO:tasks.workunit.client.0.smithi043.stderr: -35> 2024-09-12T00:38:48.709+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.2 2024-09-12T00:38:48.877 INFO:tasks.workunit.client.0.smithi043.stderr: -34> 2024-09-12T00:38:48.713+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.3 2024-09-12T00:38:48.877 INFO:tasks.workunit.client.0.smithi043.stderr: -33> 2024-09-12T00:38:48.713+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.4 2024-09-12T00:38:48.877 INFO:tasks.workunit.client.0.smithi043.stderr: -32> 2024-09-12T00:38:48.713+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.5 2024-09-12T00:38:48.877 INFO:tasks.workunit.client.0.smithi043.stderr: -31> 2024-09-12T00:38:48.717+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.6 2024-09-12T00:38:48.877 INFO:tasks.workunit.client.0.smithi043.stderr: -30> 2024-09-12T00:38:48.717+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.7 2024-09-12T00:38:48.877 INFO:tasks.workunit.client.0.smithi043.stderr: -29> 2024-09-12T00:38:48.717+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.8 2024-09-12T00:38:48.878 INFO:tasks.workunit.client.0.smithi043.stderr: -28> 2024-09-12T00:38:48.721+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.9 2024-09-12T00:38:48.878 INFO:tasks.workunit.client.0.smithi043.stderr: -27> 2024-09-12T00:38:48.721+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.10 2024-09-12T00:38:48.878 INFO:tasks.workunit.client.0.smithi043.stderr: -26> 2024-09-12T00:38:48.725+0000 7ff7f4bb39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:48.878 INFO:tasks.workunit.client.0.smithi043.stderr: -25> 2024-09-12T00:38:48.725+0000 7ff7f4bb39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 2024-09-12T00:38:48.878 INFO:tasks.workunit.client.0.smithi043.stderr: -24> 2024-09-12T00:38:48.729+0000 7ff7f4bb39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 info.flags=0x17 2024-09-12T00:38:48.878 INFO:tasks.workunit.client.0.smithi043.stderr: -23> 2024-09-12T00:38:48.729+0000 7ff7f4bb39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 to cache LRU end 2024-09-12T00:38:48.878 INFO:tasks.workunit.client.0.smithi043.stderr: -22> 2024-09-12T00:38:48.729+0000 7ff7f4bb39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:48.878 INFO:tasks.workunit.client.0.smithi043.stderr: -21> 2024-09-12T00:38:48.729+0000 7ff7f4bb39c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32, ofs0, ns] 2024-09-12T00:38:48.878 INFO:tasks.workunit.client.0.smithi043.stderr: -20> 2024-09-12T00:38:48.729+0000 7ff6d5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333495 cookie 94785785926288 notifier 6962 bl.length()=931 2024-09-12T00:38:48.878 INFO:tasks.workunit.client.0.smithi043.stderr: -19> 2024-09-12T00:38:48.729+0000 7ff6d5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 info.flags=0x17 2024-09-12T00:38:48.878 INFO:tasks.workunit.client.0.smithi043.stderr: -18> 2024-09-12T00:38:48.729+0000 7ff6d5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 to cache LRU end 2024-09-12T00:38:48.878 INFO:tasks.workunit.client.0.smithi043.stderr: -17> 2024-09-12T00:38:48.729+0000 7ff6d5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:48.878 INFO:tasks.workunit.client.0.smithi043.stderr: -16> 2024-09-12T00:38:48.729+0000 7ff7f4bb39c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): orig_sources= new_sources= 2024-09-12T00:38:48.879 INFO:tasks.workunit.client.0.smithi043.stderr: -15> 2024-09-12T00:38:48.729+0000 7ff7f4bb39c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): potential sources added=[] removed=[] 2024-09-12T00:38:48.879 INFO:tasks.workunit.client.0.smithi043.stderr: -14> 2024-09-12T00:38:48.729+0000 7ff7f4bb39c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): orig_dests= new_dests= 2024-09-12T00:38:48.879 INFO:tasks.workunit.client.0.smithi043.stderr: -13> 2024-09-12T00:38:48.729+0000 7ff7f4bb39c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): potential dests added=[] removed=[] 2024-09-12T00:38:48.879 INFO:tasks.workunit.client.0.smithi043.stderr: -12> 2024-09-12T00:38:48.737+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.0 2024-09-12T00:38:48.879 INFO:tasks.workunit.client.0.smithi043.stderr: -11> 2024-09-12T00:38:48.737+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1 2024-09-12T00:38:48.879 INFO:tasks.workunit.client.0.smithi043.stderr: -10> 2024-09-12T00:38:48.737+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.2 2024-09-12T00:38:48.879 INFO:tasks.workunit.client.0.smithi043.stderr: -9> 2024-09-12T00:38:48.737+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.3 2024-09-12T00:38:48.879 INFO:tasks.workunit.client.0.smithi043.stderr: -8> 2024-09-12T00:38:48.737+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.4 2024-09-12T00:38:48.879 INFO:tasks.workunit.client.0.smithi043.stderr: -7> 2024-09-12T00:38:48.737+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.5 2024-09-12T00:38:48.879 INFO:tasks.workunit.client.0.smithi043.stderr: -6> 2024-09-12T00:38:48.741+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.6 2024-09-12T00:38:48.879 INFO:tasks.workunit.client.0.smithi043.stderr: -5> 2024-09-12T00:38:48.741+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.7 2024-09-12T00:38:48.879 INFO:tasks.workunit.client.0.smithi043.stderr: -4> 2024-09-12T00:38:48.741+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.8 2024-09-12T00:38:48.879 INFO:tasks.workunit.client.0.smithi043.stderr: -3> 2024-09-12T00:38:48.741+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.9 2024-09-12T00:38:48.880 INFO:tasks.workunit.client.0.smithi043.stderr: -2> 2024-09-12T00:38:48.741+0000 7ff7f4bb39c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.10 2024-09-12T00:38:48.880 INFO:tasks.workunit.client.0.smithi043.stderr: -1> 2024-09-12T00:38:48.745+0000 7ff7f4bb39c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff7f4bb39c0 time 2024-09-12T00:38:48.748413+0000 2024-09-12T00:38:48.880 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:38:48.880 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.880 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:48.880 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff7f848d2eb] 2024-09-12T00:38:48.880 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff7f848d49f] 2024-09-12T00:38:48.880 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56350703ecc1] 2024-09-12T00:38:48.880 INFO:tasks.workunit.client.0.smithi043.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x563507053fc7] 2024-09-12T00:38:48.880 INFO:tasks.workunit.client.0.smithi043.stderr: 5: main() 2024-09-12T00:38:48.880 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff7f72f3d90] 2024-09-12T00:38:48.880 INFO:tasks.workunit.client.0.smithi043.stderr: 7: __libc_start_main() 2024-09-12T00:38:48.880 INFO:tasks.workunit.client.0.smithi043.stderr: 8: _start() 2024-09-12T00:38:48.881 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.881 INFO:tasks.workunit.client.0.smithi043.stderr: 0> 2024-09-12T00:38:48.745+0000 7ff7f4bb39c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:38:48.881 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7ff7f4bb39c0 thread_name:radosgw-admin 2024-09-12T00:38:48.881 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.881 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:48.881 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff7f730c520] 2024-09-12T00:38:48.881 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:38:48.881 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:38:48.881 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:38:48.881 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff7f848d345] 2024-09-12T00:38:48.881 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff7f848d49f] 2024-09-12T00:38:48.881 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56350703ecc1] 2024-09-12T00:38:48.881 INFO:tasks.workunit.client.0.smithi043.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x563507053fc7] 2024-09-12T00:38:48.881 INFO:tasks.workunit.client.0.smithi043.stderr: 9: main() 2024-09-12T00:38:48.882 INFO:tasks.workunit.client.0.smithi043.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff7f72f3d90] 2024-09-12T00:38:48.882 INFO:tasks.workunit.client.0.smithi043.stderr: 11: __libc_start_main() 2024-09-12T00:38:48.882 INFO:tasks.workunit.client.0.smithi043.stderr: 12: _start() 2024-09-12T00:38:48.882 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:38:48.882 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.882 INFO:tasks.workunit.client.0.smithi043.stderr:--- logging levels --- 2024-09-12T00:38:48.882 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 none 2024-09-12T00:38:48.882 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 lockdep 2024-09-12T00:38:48.882 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 context 2024-09-12T00:38:48.882 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 crush 2024-09-12T00:38:48.882 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds 2024-09-12T00:38:48.882 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_balancer 2024-09-12T00:38:48.882 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_locker 2024-09-12T00:38:48.883 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log 2024-09-12T00:38:48.883 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log_expire 2024-09-12T00:38:48.883 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_migrator 2024-09-12T00:38:48.883 INFO:tasks.workunit.client.0.smithi043.stderr: 3/ 5 mds_quiesce 2024-09-12T00:38:48.883 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 buffer 2024-09-12T00:38:48.883 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 timer 2024-09-12T00:38:48.883 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 filer 2024-09-12T00:38:48.883 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 striper 2024-09-12T00:38:48.883 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 objecter 2024-09-12T00:38:48.883 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rados 2024-09-12T00:38:48.883 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd 2024-09-12T00:38:48.883 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_mirror 2024-09-12T00:38:48.883 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_replay 2024-09-12T00:38:48.883 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_pwl 2024-09-12T00:38:48.884 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 journaler 2024-09-12T00:38:48.884 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objectcacher 2024-09-12T00:38:48.884 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:38:48.884 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 client 2024-09-12T00:38:48.884 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 osd 2024-09-12T00:38:48.884 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 optracker 2024-09-12T00:38:48.884 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objclass 2024-09-12T00:38:48.884 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 filestore 2024-09-12T00:38:48.884 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 journal 2024-09-12T00:38:48.884 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 ms 2024-09-12T00:38:48.884 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mon 2024-09-12T00:38:48.884 INFO:tasks.workunit.client.0.smithi043.stderr: 0/10 monc 2024-09-12T00:38:48.884 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 paxos 2024-09-12T00:38:48.885 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 tp 2024-09-12T00:38:48.885 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 auth 2024-09-12T00:38:48.885 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 crypto 2024-09-12T00:38:48.885 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 finisher 2024-09-12T00:38:48.885 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 reserver 2024-09-12T00:38:48.885 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 heartbeatmap 2024-09-12T00:38:48.885 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 perfcounter 2024-09-12T00:38:48.885 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw 2024-09-12T00:38:48.885 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_sync 2024-09-12T00:38:48.885 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_datacache 2024-09-12T00:38:48.885 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_access 2024-09-12T00:38:48.885 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:38:48.885 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_flight 2024-09-12T00:38:48.885 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:38:48.886 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw_notification 2024-09-12T00:38:48.886 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 javaclient 2024-09-12T00:38:48.886 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 asok 2024-09-12T00:38:48.886 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 throttle 2024-09-12T00:38:48.886 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 refs 2024-09-12T00:38:48.886 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 compressor 2024-09-12T00:38:48.886 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluestore 2024-09-12T00:38:48.886 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluefs 2024-09-12T00:38:48.886 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 bdev 2024-09-12T00:38:48.886 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 kstore 2024-09-12T00:38:48.886 INFO:tasks.workunit.client.0.smithi043.stderr: 4/ 5 rocksdb 2024-09-12T00:38:48.886 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 fuse 2024-09-12T00:38:48.886 INFO:tasks.workunit.client.0.smithi043.stderr: 2/ 5 mgr 2024-09-12T00:38:48.886 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mgrc 2024-09-12T00:38:48.887 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 dpdk 2024-09-12T00:38:48.887 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 eventtrace 2024-09-12T00:38:48.887 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 prioritycache 2024-09-12T00:38:48.887 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 test 2024-09-12T00:38:48.887 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:38:48.887 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephsqlite 2024-09-12T00:38:48.887 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:38:48.887 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore 2024-09-12T00:38:48.887 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_onode 2024-09-12T00:38:48.887 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_odata 2024-09-12T00:38:48.887 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_omap 2024-09-12T00:38:48.887 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_tm 2024-09-12T00:38:48.887 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_t 2024-09-12T00:38:48.887 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:38:48.888 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_epm 2024-09-12T00:38:48.888 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_lba 2024-09-12T00:38:48.888 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:38:48.888 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cache 2024-09-12T00:38:48.888 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_journal 2024-09-12T00:38:48.888 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_device 2024-09-12T00:38:48.888 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_backref 2024-09-12T00:38:48.888 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 alienstore 2024-09-12T00:38:48.888 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mclock 2024-09-12T00:38:48.888 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cyanstore 2024-09-12T00:38:48.888 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 ceph_exporter 2024-09-12T00:38:48.888 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 memstore 2024-09-12T00:38:48.888 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 trace 2024-09-12T00:38:48.889 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 ceph_dedup 2024-09-12T00:38:48.889 INFO:tasks.workunit.client.0.smithi043.stderr: -2/-2 (syslog threshold) 2024-09-12T00:38:48.889 INFO:tasks.workunit.client.0.smithi043.stderr: 99/99 (stderr threshold) 2024-09-12T00:38:48.889 INFO:tasks.workunit.client.0.smithi043.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:38:48.889 INFO:tasks.workunit.client.0.smithi043.stderr: 7ff6217fa640 / http_manager 2024-09-12T00:38:48.889 INFO:tasks.workunit.client.0.smithi043.stderr: 7ff6237fe640 / http_manager 2024-09-12T00:38:48.889 INFO:tasks.workunit.client.0.smithi043.stderr: 7ff6a8fe1640 / rgw_dt_lg_renew 2024-09-12T00:38:48.889 INFO:tasks.workunit.client.0.smithi043.stderr: 7ff6c3fff640 / ms_dispatch 2024-09-12T00:38:48.889 INFO:tasks.workunit.client.0.smithi043.stderr: 7ff6d57fa640 / io_context_pool 2024-09-12T00:38:48.889 INFO:tasks.workunit.client.0.smithi043.stderr: 7ff6d5ffb640 / io_context_pool 2024-09-12T00:38:48.889 INFO:tasks.workunit.client.0.smithi043.stderr: 7ff6d7fff640 / ms_dispatch 2024-09-12T00:38:48.889 INFO:tasks.workunit.client.0.smithi043.stderr: 7ff6dee05640 / ms_dispatch 2024-09-12T00:38:48.889 INFO:tasks.workunit.client.0.smithi043.stderr: 7ff6e0608640 / io_context_pool 2024-09-12T00:38:48.890 INFO:tasks.workunit.client.0.smithi043.stderr: 7ff7f1eb8640 / msgr-worker-2 2024-09-12T00:38:48.890 INFO:tasks.workunit.client.0.smithi043.stderr: 7ff7f26b9640 / msgr-worker-1 2024-09-12T00:38:48.890 INFO:tasks.workunit.client.0.smithi043.stderr: 7ff7f2eba640 / msgr-worker-0 2024-09-12T00:38:48.890 INFO:tasks.workunit.client.0.smithi043.stderr: 7ff7f36bb640 / io_context_pool 2024-09-12T00:38:48.890 INFO:tasks.workunit.client.0.smithi043.stderr: 7ff7f4bb39c0 / radosgw-admin 2024-09-12T00:38:48.890 INFO:tasks.workunit.client.0.smithi043.stderr: max_recent 500 2024-09-12T00:38:48.890 INFO:tasks.workunit.client.0.smithi043.stderr: max_new 1000 2024-09-12T00:38:48.890 INFO:tasks.workunit.client.0.smithi043.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:38:48.750477Z_639cb24b-0a11-4fce-9efe-a0386dd3eb3e/log 2024-09-12T00:38:48.890 INFO:tasks.workunit.client.0.smithi043.stderr:--- end dump of recent events --- 2024-09-12T00:38:48.890 INFO:tasks.workunit.client.0.smithi043.stderr:Aborted 2024-09-12T00:38:48.890 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:38:48.895 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:48.896 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:48.896 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.829+0000 7f166af969c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.896 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.829+0000 7f166af969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.896 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.829+0000 7f166af969c0 20 realm 2024-09-12T00:38:48.896 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.829+0000 7f166af969c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.896 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.829+0000 7f166af969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.896 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.829+0000 7f166af969c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:48.896 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.829+0000 7f166af969c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.896 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.829+0000 7f166af969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.896 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.829+0000 7f166af969c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.896 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.833+0000 7f166af969c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:48.896 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.833+0000 7f166af969c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.897 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.833+0000 7f166af969c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:48.897 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.833+0000 7f166af969c0 20 searching for the correct realm 2024-09-12T00:38:48.897 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.837+0000 7f166929d640 0 -- 172.21.15.43:0/1304206273 >> [v2:172.21.15.43:6808/2258408181,v1:172.21.15.43:6809/2258408181] conn(0x55a17dd005a0 msgr2=0x55a17dd02a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:48.897 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.845+0000 7f1668a9c640 0 -- 172.21.15.43:0/1304206273 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f165c0f67c0 msgr2=0x7f165c0f9670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:48.897 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.853+0000 7f166af969c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:38:48.897 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.853+0000 7f166af969c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:48.897 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.853+0000 7f166af969c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:48.897 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.853+0000 7f166af969c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:38:48.897 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.853+0000 7f166af969c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:48.897 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.853+0000 7f166af969c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:48.897 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.853+0000 7f166af969c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.897 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.853+0000 7f166af969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.897 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.853+0000 7f166af969c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.853+0000 7f166af969c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:48.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.853+0000 7f166af969c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.853+0000 7f166af969c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:48.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.853+0000 7f166af969c0 20 zone default found 2024-09-12T00:38:48.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.853+0000 7f166af969c0 4 Realm: () 2024-09-12T00:38:48.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.853+0000 7f166af969c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:38:48.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.853+0000 7f166af969c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:38:48.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.853+0000 7f166af969c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:48.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.853+0000 7f166af969c0 20 zonegroup default 2024-09-12T00:38:48.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.853+0000 7f166af969c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.853+0000 7f166af969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.853+0000 7f166af969c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.853+0000 7f166af969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.853+0000 7f166af969c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.853+0000 7f166af969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.853+0000 7f166af969c0 20 started sync module instance, tier type = 2024-09-12T00:38:48.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.853+0000 7f166af969c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:38:48.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.869+0000 7f166af969c0 20 add_watcher() i=0 2024-09-12T00:38:48.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.869+0000 7f166af969c0 20 add_watcher() i=1 2024-09-12T00:38:48.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.869+0000 7f166af969c0 20 add_watcher() i=2 2024-09-12T00:38:48.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.869+0000 7f166af969c0 20 add_watcher() i=3 2024-09-12T00:38:48.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.869+0000 7f166af969c0 20 add_watcher() i=4 2024-09-12T00:38:48.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.869+0000 7f166af969c0 20 add_watcher() i=5 2024-09-12T00:38:48.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.869+0000 7f166af969c0 20 add_watcher() i=6 2024-09-12T00:38:48.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.873+0000 7f166af969c0 20 add_watcher() i=7 2024-09-12T00:38:48.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.873+0000 7f166af969c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:48.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.873+0000 7f151efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:48.900 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.873+0000 7f166af969c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:48.900 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.873+0000 7f166af969c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:48.900 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.873+0000 7f166af969c0 5 note: GC not initialized 2024-09-12T00:38:48.900 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.877+0000 7f151dfe3640 20 reqs_thread_entry: start 2024-09-12T00:38:48.900 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.877+0000 7f166af969c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:48.900 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.877+0000 7f166af969c0 20 Filter name: none 2024-09-12T00:38:48.900 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.877+0000 7f148f7fe640 20 reqs_thread_entry: start 2024-09-12T00:38:48.900 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.877+0000 7f166af969c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.900 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.877+0000 7f166af969c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:48.900 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.877+0000 7f166af969c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.900 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.877+0000 7f166af969c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:38:48.900 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.877+0000 7f166af969c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:48.900 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.877+0000 7f166af969c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.900 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.877+0000 7f166af969c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:48.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.877+0000 7f166af969c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.877+0000 7f166af969c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:38:48.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.877+0000 7f166af969c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:48.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.881+0000 7f151efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:48.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.885+0000 7f166af969c0 20 remove_watcher() i=0 2024-09-12T00:38:48.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.885+0000 7f166af969c0 2 removed watcher, disabling cache 2024-09-12T00:38:48.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.889+0000 7f166af969c0 20 remove_watcher() i=1 2024-09-12T00:38:48.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.889+0000 7f166af969c0 20 remove_watcher() i=2 2024-09-12T00:38:48.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.893+0000 7f166af969c0 20 remove_watcher() i=3 2024-09-12T00:38:48.902 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.893+0000 7f166af969c0 20 remove_watcher() i=4 2024-09-12T00:38:48.902 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.897+0000 7f166af969c0 20 remove_watcher() i=5 2024-09-12T00:38:48.902 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.897+0000 7f166af969c0 20 remove_watcher() i=6 2024-09-12T00:38:48.902 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:38:48.897+0000 7f166af969c0 20 remove_watcher() i=7 2024-09-12T00:38:48.915 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.915 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:38:48.915 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: abort-at-commit-target-layout id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:38:48.916 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:38:48.917 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:48.917 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:18.992 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:18.993 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:19.039 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:39:19.078 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:19.078 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:19.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.124+0000 7fa8014e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.126 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.128+0000 7fa8014e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.126 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.128+0000 7fa8014e19c0 20 realm 2024-09-12T00:39:19.126 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.128+0000 7fa8014e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.126 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.128+0000 7fa8014e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.126 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.128+0000 7fa8014e19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:19.126 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.128+0000 7fa8014e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.126 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.128+0000 7fa8014e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.126 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.128+0000 7fa8014e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.127 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.128+0000 7fa8014e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:19.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.128+0000 7fa8014e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.128+0000 7fa8014e19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:19.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.128+0000 7fa8014e19c0 20 searching for the correct realm 2024-09-12T00:39:19.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.136+0000 7fa7ff7e8640 0 -- 172.21.15.43:0/560613624 >> [v2:172.21.15.43:6808/2258408181,v1:172.21.15.43:6809/2258408181] conn(0x55a72dc1db70 msgr2=0x55a72dc20030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:19.139 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.140+0000 7fa7fefe7640 0 -- 172.21.15.43:0/560613624 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fa7f40909a0 msgr2=0x7fa7f4090210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:19.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.148+0000 7fa8014e19c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:39:19.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.148+0000 7fa8014e19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:19.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.148+0000 7fa8014e19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:19.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.148+0000 7fa8014e19c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:39:19.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.148+0000 7fa8014e19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:19.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.148+0000 7fa8014e19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:19.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.148+0000 7fa8014e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.148+0000 7fa8014e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.148+0000 7fa8014e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.148+0000 7fa8014e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:19.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.148+0000 7fa8014e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.152+0000 7fa8014e19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:19.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.152+0000 7fa8014e19c0 20 zone default found 2024-09-12T00:39:19.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.152+0000 7fa8014e19c0 4 Realm: () 2024-09-12T00:39:19.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.152+0000 7fa8014e19c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:39:19.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.152+0000 7fa8014e19c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:39:19.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.152+0000 7fa8014e19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:19.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.152+0000 7fa8014e19c0 20 zonegroup default 2024-09-12T00:39:19.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.152+0000 7fa8014e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.152+0000 7fa8014e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.152+0000 7fa8014e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.152+0000 7fa8014e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.152+0000 7fa8014e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.152+0000 7fa8014e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.152+0000 7fa8014e19c0 20 started sync module instance, tier type = 2024-09-12T00:39:19.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.152+0000 7fa8014e19c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:39:19.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.168+0000 7fa8014e19c0 20 add_watcher() i=0 2024-09-12T00:39:19.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.168+0000 7fa8014e19c0 20 add_watcher() i=1 2024-09-12T00:39:19.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.168+0000 7fa8014e19c0 20 add_watcher() i=2 2024-09-12T00:39:19.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.168+0000 7fa8014e19c0 20 add_watcher() i=3 2024-09-12T00:39:19.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.168+0000 7fa8014e19c0 20 add_watcher() i=4 2024-09-12T00:39:19.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.168+0000 7fa8014e19c0 20 add_watcher() i=5 2024-09-12T00:39:19.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.168+0000 7fa8014e19c0 20 add_watcher() i=6 2024-09-12T00:39:19.168 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.168+0000 7fa8014e19c0 20 add_watcher() i=7 2024-09-12T00:39:19.168 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.168+0000 7fa8014e19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:19.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.172+0000 7fa6b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:19.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.172+0000 7fa8014e19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:19.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.172+0000 7fa8014e19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:19.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.172+0000 7fa8014e19c0 5 note: GC not initialized 2024-09-12T00:39:19.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.172+0000 7fa62ffff640 20 reqs_thread_entry: start 2024-09-12T00:39:19.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.172+0000 7fa8014e19c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:19.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.172+0000 7fa8014e19c0 20 Filter name: none 2024-09-12T00:39:19.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.172+0000 7fa62dffb640 20 reqs_thread_entry: start 2024-09-12T00:39:19.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.172+0000 7fa8014e19c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:39:19.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.172+0000 7fa8014e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.172+0000 7fa8014e19c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:39:19.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.172+0000 7fa8014e19c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:39:19.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.172+0000 7fa8014e19c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:39:19.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.172+0000 7fa8014e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 : miss 2024-09-12T00:39:19.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.172+0000 7fa8014e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.173 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.172+0000 7fa8014e19c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:39:19.173 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.172+0000 7fa8014e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 info.flags=0x17 2024-09-12T00:39:19.173 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.172+0000 7fa8014e19c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 to cache LRU end 2024-09-12T00:39:19.173 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.172+0000 7fa8014e19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:19.173 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.172+0000 7fa8014e19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:19.174 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.172+0000 7fa8014e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 2024-09-12T00:39:19.181 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.184+0000 7fa8014e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 info.flags=0x17 2024-09-12T00:39:19.182 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.184+0000 7fa8014e19c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 to cache LRU end 2024-09-12T00:39:19.182 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.184+0000 7fa8014e19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:19.182 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.184+0000 7fa8014e19c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32, ofs0, ns] 2024-09-12T00:39:19.182 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.184+0000 7fa6e1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333497 cookie 94176515603840 notifier 6998 bl.length()=931 2024-09-12T00:39:19.183 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.184+0000 7fa6e1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 info.flags=0x17 2024-09-12T00:39:19.183 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.184+0000 7fa6e1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 to cache LRU end 2024-09-12T00:39:19.183 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.184+0000 7fa6e1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:19.183 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.184+0000 7fa8014e19c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): orig_sources= new_sources= 2024-09-12T00:39:19.183 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.184+0000 7fa8014e19c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): potential sources added=[] removed=[] 2024-09-12T00:39:19.183 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.184+0000 7fa8014e19c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): orig_dests= new_dests= 2024-09-12T00:39:19.183 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.184+0000 7fa8014e19c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): potential dests added=[] removed=[] 2024-09-12T00:39:19.193 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.196+0000 7fa8014e19c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.0 2024-09-12T00:39:19.193 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.196+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.0 2024-09-12T00:39:19.193 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.196+0000 7fa8014e19c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.1 2024-09-12T00:39:19.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.196+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.1 2024-09-12T00:39:19.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.196+0000 7fa8014e19c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.2 2024-09-12T00:39:19.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.196+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.2 2024-09-12T00:39:19.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.196+0000 7fa8014e19c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.3 2024-09-12T00:39:19.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.196+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.3 2024-09-12T00:39:19.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.196+0000 7fa8014e19c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.4 2024-09-12T00:39:19.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.196+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.4 2024-09-12T00:39:19.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.196+0000 7fa8014e19c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.5 2024-09-12T00:39:19.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.196+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.5 2024-09-12T00:39:19.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.196+0000 7fa8014e19c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.6 2024-09-12T00:39:19.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.196+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.6 2024-09-12T00:39:19.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.196+0000 7fa8014e19c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.7 2024-09-12T00:39:19.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.196+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.7 2024-09-12T00:39:19.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.196+0000 7fa8014e19c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.8 2024-09-12T00:39:19.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.196+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.8 2024-09-12T00:39:19.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.196+0000 7fa8014e19c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.9 2024-09-12T00:39:19.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.196+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.9 2024-09-12T00:39:19.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.196+0000 7fa8014e19c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.10 2024-09-12T00:39:19.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.196+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.10 2024-09-12T00:39:19.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.196+0000 7fa8014e19c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.11 2024-09-12T00:39:19.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.196+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1.11 2024-09-12T00:39:19.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.196+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.0 2024-09-12T00:39:19.196 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.196+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1 2024-09-12T00:39:19.196 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.196+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.2 2024-09-12T00:39:19.196 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.196+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.3 2024-09-12T00:39:19.196 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.196+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.4 2024-09-12T00:39:19.197 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.200+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.5 2024-09-12T00:39:19.198 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.200+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.6 2024-09-12T00:39:19.200 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.200+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.7 2024-09-12T00:39:19.200 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.200+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.8 2024-09-12T00:39:19.201 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.204+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.9 2024-09-12T00:39:19.203 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.204+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.10 2024-09-12T00:39:19.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.208+0000 7fa8014e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:19.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.208+0000 7fa8014e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 2024-09-12T00:39:19.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.212+0000 7fa8014e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 info.flags=0x17 2024-09-12T00:39:19.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.212+0000 7fa8014e19c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 to cache LRU end 2024-09-12T00:39:19.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.212+0000 7fa8014e19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:19.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.212+0000 7fa8014e19c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32, ofs0, ns] 2024-09-12T00:39:19.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.212+0000 7fa6e27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333498 cookie 94176515603840 notifier 6998 bl.length()=931 2024-09-12T00:39:19.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.212+0000 7fa6e27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 info.flags=0x17 2024-09-12T00:39:19.212 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.212+0000 7fa6e27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 to cache LRU end 2024-09-12T00:39:19.212 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.212+0000 7fa6e27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:19.212 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.212+0000 7fa8014e19c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): orig_sources= new_sources= 2024-09-12T00:39:19.212 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.212+0000 7fa8014e19c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): potential sources added=[] removed=[] 2024-09-12T00:39:19.212 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.212+0000 7fa8014e19c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): orig_dests= new_dests= 2024-09-12T00:39:19.212 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.212+0000 7fa8014e19c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): potential dests added=[] removed=[] 2024-09-12T00:39:19.216 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.216+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.0 2024-09-12T00:39:19.217 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.220+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.1 2024-09-12T00:39:19.217 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.220+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.2 2024-09-12T00:39:19.217 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.220+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.3 2024-09-12T00:39:19.218 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.220+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.4 2024-09-12T00:39:19.219 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.220+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.5 2024-09-12T00:39:19.220 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.220+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.6 2024-09-12T00:39:19.221 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.224+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.7 2024-09-12T00:39:19.221 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.224+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.8 2024-09-12T00:39:19.222 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.224+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.9 2024-09-12T00:39:19.223 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.224+0000 7fa8014e19c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32.10 2024-09-12T00:39:19.224 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.224+0000 7fa8014e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:19.224 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.224+0000 7fa8014e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 2024-09-12T00:39:19.227 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.228+0000 7fa8014e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 info.flags=0x17 2024-09-12T00:39:19.227 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.228+0000 7fa8014e19c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 to cache LRU end 2024-09-12T00:39:19.228 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.228+0000 7fa8014e19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:19.228 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.228+0000 7fa8014e19c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32, ofs0, ns] 2024-09-12T00:39:19.228 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.228+0000 7fa6e1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333499 cookie 94176515603840 notifier 6998 bl.length()=899 2024-09-12T00:39:19.228 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.228+0000 7fa6e1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 info.flags=0x17 2024-09-12T00:39:19.228 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.228+0000 7fa6e1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 to cache LRU end 2024-09-12T00:39:19.228 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.228+0000 7fa6e1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:19.228 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.228+0000 7fa8014e19c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): orig_sources= new_sources= 2024-09-12T00:39:19.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.228+0000 7fa8014e19c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): potential sources added=[] removed=[] 2024-09-12T00:39:19.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.228+0000 7fa8014e19c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): orig_dests= new_dests= 2024-09-12T00:39:19.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.228+0000 7fa8014e19c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32]): potential dests added=[] removed=[] 2024-09-12T00:39:19.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.236+0000 7fa8014e19c0 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:39:19.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.236+0000 7fa6b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:19.241 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.244+0000 7fa8014e19c0 20 remove_watcher() i=0 2024-09-12T00:39:19.241 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.244+0000 7fa8014e19c0 2 removed watcher, disabling cache 2024-09-12T00:39:19.243 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.244+0000 7fa8014e19c0 20 remove_watcher() i=1 2024-09-12T00:39:19.245 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.248+0000 7fa8014e19c0 20 remove_watcher() i=2 2024-09-12T00:39:19.247 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.248+0000 7fa8014e19c0 20 remove_watcher() i=3 2024-09-12T00:39:19.249 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.252+0000 7fa8014e19c0 20 remove_watcher() i=4 2024-09-12T00:39:19.250 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.252+0000 7fa8014e19c0 20 remove_watcher() i=5 2024-09-12T00:39:19.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.252+0000 7fa8014e19c0 20 remove_watcher() i=6 2024-09-12T00:39:19.253 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.256+0000 7fa8014e19c0 20 remove_watcher() i=7 2024-09-12T00:39:19.268 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:39:19.295 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:19.296 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:19.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.340+0000 7f45bdc379c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.340+0000 7f45bdc379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.340+0000 7f45bdc379c0 20 realm 2024-09-12T00:39:19.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.340+0000 7f45bdc379c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.340+0000 7f45bdc379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.340+0000 7f45bdc379c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:19.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.340+0000 7f45bdc379c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.340+0000 7f45bdc379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.340+0000 7f45bdc379c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.342 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.344+0000 7f45bdc379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:19.342 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.344+0000 7f45bdc379c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.343 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.344+0000 7f45bdc379c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:19.343 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.344+0000 7f45bdc379c0 20 searching for the correct realm 2024-09-12T00:39:19.349 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.352+0000 7f45baf3c640 0 -- 172.21.15.43:0/1221004392 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f45a4008070 msgr2=0x7f45a403e920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:19.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.356+0000 7f45baf3c640 0 -- 172.21.15.43:0/1221004392 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f4484080bb0 msgr2=0x7f4484082fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:19.365 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.364+0000 7f45bdc379c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:39:19.365 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.364+0000 7f45bdc379c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:19.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.364+0000 7f45bdc379c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:19.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.364+0000 7f45bdc379c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:39:19.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.364+0000 7f45bdc379c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:19.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.364+0000 7f45bdc379c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:19.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.364+0000 7f45bdc379c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.364+0000 7f45bdc379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.364+0000 7f45bdc379c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.364+0000 7f45bdc379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:19.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.364+0000 7f45bdc379c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.364+0000 7f45bdc379c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:19.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.364+0000 7f45bdc379c0 20 zone default found 2024-09-12T00:39:19.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.364+0000 7f45bdc379c0 4 Realm: () 2024-09-12T00:39:19.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.364+0000 7f45bdc379c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:39:19.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.364+0000 7f45bdc379c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:39:19.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.364+0000 7f45bdc379c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:19.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.364+0000 7f45bdc379c0 20 zonegroup default 2024-09-12T00:39:19.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.364+0000 7f45bdc379c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.364+0000 7f45bdc379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.364+0000 7f45bdc379c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.368+0000 7f45bdc379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.368+0000 7f45bdc379c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.368+0000 7f45bdc379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.368+0000 7f45bdc379c0 20 started sync module instance, tier type = 2024-09-12T00:39:19.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.368+0000 7f45bdc379c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:39:19.381 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.384+0000 7f45bdc379c0 20 add_watcher() i=0 2024-09-12T00:39:19.381 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.384+0000 7f45bdc379c0 20 add_watcher() i=1 2024-09-12T00:39:19.381 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.384+0000 7f45bdc379c0 20 add_watcher() i=2 2024-09-12T00:39:19.381 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.384+0000 7f45bdc379c0 20 add_watcher() i=3 2024-09-12T00:39:19.381 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.384+0000 7f45bdc379c0 20 add_watcher() i=4 2024-09-12T00:39:19.382 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.384+0000 7f45bdc379c0 20 add_watcher() i=5 2024-09-12T00:39:19.382 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.384+0000 7f45bdc379c0 20 add_watcher() i=6 2024-09-12T00:39:19.382 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.384+0000 7f45bdc379c0 20 add_watcher() i=7 2024-09-12T00:39:19.382 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.384+0000 7f45bdc379c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:19.384 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.384+0000 7f4471fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:19.385 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.388+0000 7f45bdc379c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:19.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.388+0000 7f45bdc379c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:19.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.388+0000 7f45bdc379c0 5 note: GC not initialized 2024-09-12T00:39:19.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.388+0000 7f4470fe1640 20 reqs_thread_entry: start 2024-09-12T00:39:19.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.388+0000 7f45bdc379c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:19.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.388+0000 7f45bdc379c0 20 Filter name: none 2024-09-12T00:39:19.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.388+0000 7f43ea7fc640 20 reqs_thread_entry: start 2024-09-12T00:39:19.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.388+0000 7f45bdc379c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.387 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.388+0000 7f45bdc379c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:39:19.387 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.388+0000 7f45bdc379c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.387 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.388+0000 7f45bdc379c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:39:19.388 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.388+0000 7f45bdc379c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:19.388 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.388+0000 7f45bdc379c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.388 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.388+0000 7f45bdc379c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:39:19.388 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.388+0000 7f45bdc379c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.389 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.388+0000 7f45bdc379c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:39:19.389 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.388+0000 7f45bdc379c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:19.391 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.392+0000 7f4471fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:19.396 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.396+0000 7f45bdc379c0 20 remove_watcher() i=0 2024-09-12T00:39:19.396 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.396+0000 7f45bdc379c0 2 removed watcher, disabling cache 2024-09-12T00:39:19.398 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.400+0000 7f45bdc379c0 20 remove_watcher() i=1 2024-09-12T00:39:19.400 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.400+0000 7f45bdc379c0 20 remove_watcher() i=2 2024-09-12T00:39:19.402 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.404+0000 7f45bdc379c0 20 remove_watcher() i=3 2024-09-12T00:39:19.404 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.404+0000 7f45bdc379c0 20 remove_watcher() i=4 2024-09-12T00:39:19.405 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.408+0000 7f45bdc379c0 20 remove_watcher() i=5 2024-09-12T00:39:19.406 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.408+0000 7f45bdc379c0 20 remove_watcher() i=6 2024-09-12T00:39:19.408 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:19.408+0000 7f45bdc379c0 20 remove_watcher() i=7 2024-09-12T00:39:19.421 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:19.422 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:39:19.422 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: abort-at-commit-target-layout id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:39:19.422 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:19.423 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:19.423 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:19.426 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:19.426 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:19.471 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:19.471 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:19.514 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-12T00:39:19.514 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:19.515 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:19.516 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:19.535 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:19.536 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:19.579 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:19.579 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:19.595 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:19.596 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:19.614 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:19.614 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:19.631 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:19.632 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:19.651 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:19.651 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:19.669 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:19.670 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:19.690 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:19.690 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:19.709 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:19.709 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:19.784 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:19.784 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:19.803 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:19.803 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:19.820 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:19.820 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:19.837 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:19.837 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:19.855 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:19.855 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:19.875 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:19.875 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:19.895 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:19.895 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:19.914 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:19.914 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:19.933 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:19.933 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:19.952 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:19.952 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:19.971 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:19.971 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:19.992 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:19.992 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:20.009 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:39:20.043 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:20.043 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:20.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.088+0000 7fedd76279c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.092+0000 7fedd76279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.092+0000 7fedd76279c0 20 realm 2024-09-12T00:39:20.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.092+0000 7fedd76279c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.092+0000 7fedd76279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.092+0000 7fedd76279c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:20.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.092+0000 7fedd76279c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.092+0000 7fedd76279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.092+0000 7fedd76279c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.092 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.092+0000 7fedd76279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:20.092 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.092+0000 7fedd76279c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.093 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.092+0000 7fedd76279c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:20.093 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.092+0000 7fedd76279c0 20 searching for the correct realm 2024-09-12T00:39:20.099 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.100+0000 7fedd492c640 0 -- 172.21.15.43:0/2387998996 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x5639d6605fb0 msgr2=0x5639d66083a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:20.105 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.108+0000 7fedd492c640 0 -- 172.21.15.43:0/2387998996 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fedcc041040 msgr2=0x7fedcc042940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:20.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.112+0000 7fedd76279c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:39:20.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.112+0000 7fedd76279c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:20.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.112+0000 7fedd76279c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:20.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.112+0000 7fedd76279c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:39:20.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.112+0000 7fedd76279c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:20.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.112+0000 7fedd76279c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:20.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.112+0000 7fedd76279c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.112+0000 7fedd76279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.112+0000 7fedd76279c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.116+0000 7fedd76279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:20.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.116+0000 7fedd76279c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.116+0000 7fedd76279c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:20.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.116+0000 7fedd76279c0 20 zone default found 2024-09-12T00:39:20.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.116+0000 7fedd76279c0 4 Realm: () 2024-09-12T00:39:20.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.116+0000 7fedd76279c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:39:20.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.116+0000 7fedd76279c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:39:20.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.116+0000 7fedd76279c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:20.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.116+0000 7fedd76279c0 20 zonegroup default 2024-09-12T00:39:20.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.116+0000 7fedd76279c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.116+0000 7fedd76279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.116+0000 7fedd76279c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.116+0000 7fedd76279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.116+0000 7fedd76279c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.116+0000 7fedd76279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.116+0000 7fedd76279c0 20 started sync module instance, tier type = 2024-09-12T00:39:20.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.116+0000 7fedd76279c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:39:20.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.132+0000 7fedd76279c0 20 add_watcher() i=0 2024-09-12T00:39:20.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.132+0000 7fedd76279c0 20 add_watcher() i=1 2024-09-12T00:39:20.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.132+0000 7fedd76279c0 20 add_watcher() i=2 2024-09-12T00:39:20.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.132+0000 7fedd76279c0 20 add_watcher() i=3 2024-09-12T00:39:20.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.132+0000 7fedd76279c0 20 add_watcher() i=4 2024-09-12T00:39:20.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.132+0000 7fedd76279c0 20 add_watcher() i=5 2024-09-12T00:39:20.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.132+0000 7fedd76279c0 20 add_watcher() i=6 2024-09-12T00:39:20.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.132+0000 7fedd76279c0 20 add_watcher() i=7 2024-09-12T00:39:20.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.132+0000 7fedd76279c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:20.135 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.136+0000 7fec8bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:20.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.136+0000 7fedd76279c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:20.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.136+0000 7fedd76279c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:20.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.136+0000 7fedd76279c0 5 note: GC not initialized 2024-09-12T00:39:20.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.136+0000 7fec8afe5640 20 reqs_thread_entry: start 2024-09-12T00:39:20.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.136+0000 7fedd76279c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:20.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.136+0000 7fedd76279c0 20 Filter name: none 2024-09-12T00:39:20.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.136+0000 7fec88fe1640 20 reqs_thread_entry: start 2024-09-12T00:39:20.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.136+0000 7fedd76279c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.136+0000 7fedd76279c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:20.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.136+0000 7fedd76279c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.138 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.140+0000 7fedd76279c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:39:20.138 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.140+0000 7fedd76279c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:20.138 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.140+0000 7fedd76279c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.138 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.140+0000 7fedd76279c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:20.139 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.140+0000 7fedd76279c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.139 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.140+0000 7fedd76279c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:39:20.139 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.140+0000 7fedd76279c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:20.142 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.144+0000 7fec8bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:20.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.148+0000 7fedd76279c0 20 remove_watcher() i=0 2024-09-12T00:39:20.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.148+0000 7fedd76279c0 2 removed watcher, disabling cache 2024-09-12T00:39:20.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.152+0000 7fedd76279c0 20 remove_watcher() i=1 2024-09-12T00:39:20.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.152+0000 7fedd76279c0 20 remove_watcher() i=2 2024-09-12T00:39:20.153 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.156+0000 7fedd76279c0 20 remove_watcher() i=3 2024-09-12T00:39:20.155 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.156+0000 7fedd76279c0 20 remove_watcher() i=4 2024-09-12T00:39:20.156 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.156+0000 7fedd76279c0 20 remove_watcher() i=5 2024-09-12T00:39:20.157 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.160+0000 7fedd76279c0 20 remove_watcher() i=6 2024-09-12T00:39:20.159 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.160+0000 7fedd76279c0 20 remove_watcher() i=7 2024-09-12T00:39:20.173 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:20.173 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:39:20.173 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-do-reshard id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:39:20.173 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:20.173 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-12T00:39:20.205 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:20.205 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:20.248 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.248+0000 7f35575229c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.250 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.252+0000 7f35575229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.250 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.252+0000 7f35575229c0 20 realm 2024-09-12T00:39:20.250 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.252+0000 7f35575229c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.252+0000 7f35575229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.252+0000 7f35575229c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:20.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.252+0000 7f35575229c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.252+0000 7f35575229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.252+0000 7f35575229c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.252+0000 7f35575229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:20.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.252+0000 7f35575229c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.253 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.256+0000 7f35575229c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:20.253 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.256+0000 7f35575229c0 20 searching for the correct realm 2024-09-12T00:39:20.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.260+0000 7f3555028640 0 -- 172.21.15.43:0/125382963 >> [v2:172.21.15.97:6816/489545787,v1:172.21.15.97:6817/489545787] conn(0x7f355011f000 msgr2=0x7f35500f6530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:20.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.268+0000 7f3555028640 0 -- 172.21.15.43:0/125382963 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f354c043950 msgr2=0x7f354c0263a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:20.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.484+0000 7f35575229c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:39:20.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.484+0000 7f35575229c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:20.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.484+0000 7f35575229c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:20.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.484+0000 7f35575229c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:39:20.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.484+0000 7f35575229c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:20.486 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.484+0000 7f35575229c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:20.486 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.484+0000 7f35575229c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.486 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.488+0000 7f35575229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.486 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.488+0000 7f35575229c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.487 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.488+0000 7f35575229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:20.487 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.488+0000 7f35575229c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.488 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.488+0000 7f35575229c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:20.488 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.488+0000 7f35575229c0 20 zone default found 2024-09-12T00:39:20.488 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.488+0000 7f35575229c0 4 Realm: () 2024-09-12T00:39:20.488 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.488+0000 7f35575229c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:39:20.488 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.488+0000 7f35575229c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:39:20.488 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.488+0000 7f35575229c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:20.488 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.488+0000 7f35575229c0 20 zonegroup default 2024-09-12T00:39:20.488 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.488+0000 7f35575229c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.488+0000 7f35575229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.488+0000 7f35575229c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.492+0000 7f35575229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.492+0000 7f35575229c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.490 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.492+0000 7f35575229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.490 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.492+0000 7f35575229c0 20 started sync module instance, tier type = 2024-09-12T00:39:20.490 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.492+0000 7f35575229c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:39:20.514 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.516+0000 7f35575229c0 20 add_watcher() i=0 2024-09-12T00:39:20.514 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.516+0000 7f35575229c0 20 add_watcher() i=1 2024-09-12T00:39:20.514 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.516+0000 7f35575229c0 20 add_watcher() i=2 2024-09-12T00:39:20.515 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.516+0000 7f35575229c0 20 add_watcher() i=3 2024-09-12T00:39:20.515 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.516+0000 7f35575229c0 20 add_watcher() i=4 2024-09-12T00:39:20.515 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.516+0000 7f35575229c0 20 add_watcher() i=5 2024-09-12T00:39:20.515 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.516+0000 7f35575229c0 20 add_watcher() i=6 2024-09-12T00:39:20.516 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.516+0000 7f35575229c0 20 add_watcher() i=7 2024-09-12T00:39:20.516 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.516+0000 7f35575229c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:20.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.520+0000 7f340b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:20.522 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.524+0000 7f35575229c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:20.522 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.524+0000 7f35575229c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:20.522 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.524+0000 7f35575229c0 5 note: GC not initialized 2024-09-12T00:39:20.522 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.524+0000 7f340a7e4640 20 reqs_thread_entry: start 2024-09-12T00:39:20.523 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.524+0000 7f35575229c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:20.523 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.524+0000 7f35575229c0 20 Filter name: none 2024-09-12T00:39:20.523 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.524+0000 7f337bfff640 20 reqs_thread_entry: start 2024-09-12T00:39:20.524 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.524+0000 7f35575229c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T00:39:20.524 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.524+0000 7f35575229c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.524 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.524+0000 7f35575229c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:20.524 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.524+0000 7f35575229c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T00:39:20.524 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.524+0000 7f35575229c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T00:39:20.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.524+0000 7f35575229c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 : miss 2024-09-12T00:39:20.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.524+0000 7f35575229c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.528+0000 7f35575229c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:39:20.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.528+0000 7f35575229c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 info.flags=0x17 2024-09-12T00:39:20.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.528+0000 7f35575229c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 to cache LRU end 2024-09-12T00:39:20.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.528+0000 7f35575229c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:20.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.528+0000 7f35575229c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:20.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.528+0000 7f35575229c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 2024-09-12T00:39:20.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.540+0000 7f35575229c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 info.flags=0x17 2024-09-12T00:39:20.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.540+0000 7f35575229c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 to cache LRU end 2024-09-12T00:39:20.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.540+0000 7f35575229c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:20.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.540+0000 7f35575229c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33, ofs0, ns] 2024-09-12T00:39:20.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.540+0000 7f3438ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333533 cookie 93937350702800 notifier 7046 bl.length()=911 2024-09-12T00:39:20.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.540+0000 7f3438ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 info.flags=0x17 2024-09-12T00:39:20.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.540+0000 7f3438ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 to cache LRU end 2024-09-12T00:39:20.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.540+0000 7f3438ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:20.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.540+0000 7f35575229c0 20 handle_bi_update(): bucket=:error-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33]): orig_sources= new_sources= 2024-09-12T00:39:20.539 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.540+0000 7f35575229c0 20 handle_bi_update(): bucket=:error-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33]): potential sources added=[] removed=[] 2024-09-12T00:39:20.539 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.540+0000 7f35575229c0 20 handle_bi_update(): bucket=:error-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33]): orig_dests= new_dests= 2024-09-12T00:39:20.539 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.540+0000 7f35575229c0 20 handle_bi_update(): bucket=:error-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33]): potential dests added=[] removed=[] 2024-09-12T00:39:20.548 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.548+0000 7f35575229c0 -1 Injecting error=-5 at location=do_reshard 2024-09-12T00:39:20.565 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.564+0000 7f35575229c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:20.565 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.564+0000 7f35575229c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 2024-09-12T00:39:20.568 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.568+0000 7f35575229c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 info.flags=0x17 2024-09-12T00:39:20.568 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.568+0000 7f35575229c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 to cache LRU end 2024-09-12T00:39:20.568 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.568+0000 7f35575229c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:20.568 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.568+0000 7f35575229c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33, ofs0, ns] 2024-09-12T00:39:20.569 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.568+0000 7f3438ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333534 cookie 93937350702800 notifier 7046 bl.length()=879 2024-09-12T00:39:20.569 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.568+0000 7f3438ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 info.flags=0x17 2024-09-12T00:39:20.569 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.568+0000 7f3438ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 to cache LRU end 2024-09-12T00:39:20.569 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.568+0000 7f3438ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:20.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.572+0000 7f35575229c0 20 handle_bi_update(): bucket=:error-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33]): orig_sources= new_sources= 2024-09-12T00:39:20.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.572+0000 7f35575229c0 20 handle_bi_update(): bucket=:error-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33]): potential sources added=[] removed=[] 2024-09-12T00:39:20.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.572+0000 7f35575229c0 20 handle_bi_update(): bucket=:error-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33]): orig_dests= new_dests= 2024-09-12T00:39:20.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.572+0000 7f35575229c0 20 handle_bi_update(): bucket=:error-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33]): potential dests added=[] removed=[] 2024-09-12T00:39:20.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.572+0000 7f35575229c0 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-12T00:39:20.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.576+0000 7f340b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:20.579 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.580+0000 7f35575229c0 20 remove_watcher() i=0 2024-09-12T00:39:20.579 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.580+0000 7f35575229c0 2 removed watcher, disabling cache 2024-09-12T00:39:20.581 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.584+0000 7f35575229c0 20 remove_watcher() i=1 2024-09-12T00:39:20.583 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.584+0000 7f35575229c0 20 remove_watcher() i=2 2024-09-12T00:39:20.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.588+0000 7f35575229c0 20 remove_watcher() i=3 2024-09-12T00:39:20.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.588+0000 7f35575229c0 20 remove_watcher() i=4 2024-09-12T00:39:20.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.592+0000 7f35575229c0 20 remove_watcher() i=5 2024-09-12T00:39:20.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.592+0000 7f35575229c0 20 remove_watcher() i=6 2024-09-12T00:39:20.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.596+0000 7f35575229c0 20 remove_watcher() i=7 2024-09-12T00:39:20.611 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:39:20.641 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:20.641 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:20.686 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.688+0000 7f153ef739c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.688 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.688+0000 7f153ef739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.688 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.688+0000 7f153ef739c0 20 realm 2024-09-12T00:39:20.688 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.688+0000 7f153ef739c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.688 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.688+0000 7f153ef739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.689 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.688+0000 7f153ef739c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:20.689 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.688+0000 7f153ef739c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.689 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.688+0000 7f153ef739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.689 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.688+0000 7f153ef739c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.692+0000 7f153ef739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:20.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.692+0000 7f153ef739c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.691 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.692+0000 7f153ef739c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:20.691 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.692+0000 7f153ef739c0 20 searching for the correct realm 2024-09-12T00:39:20.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.696+0000 7f153c278640 0 -- 172.21.15.43:0/1413202561 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f1530008040 msgr2=0x7f1530063430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:20.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:20.912+0000 7f153ca79640 0 -- 172.21.15.43:0/1413202561 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f15300649c0 msgr2=0x7f153002e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:21.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.128+0000 7f153ef739c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:39:21.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.128+0000 7f153ef739c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:21.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.128+0000 7f153ef739c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:21.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.128+0000 7f153ef739c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:39:21.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.128+0000 7f153ef739c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:21.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.128+0000 7f153ef739c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:21.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.128+0000 7f153ef739c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.130 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.132+0000 7f153ef739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.130 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.132+0000 7f153ef739c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.130 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.132+0000 7f153ef739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:21.130 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.132+0000 7f153ef739c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.132+0000 7f153ef739c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:21.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.132+0000 7f153ef739c0 20 zone default found 2024-09-12T00:39:21.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.132+0000 7f153ef739c0 4 Realm: () 2024-09-12T00:39:21.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.132+0000 7f153ef739c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:39:21.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.132+0000 7f153ef739c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:39:21.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.132+0000 7f153ef739c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:21.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.132+0000 7f153ef739c0 20 zonegroup default 2024-09-12T00:39:21.131 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.132+0000 7f153ef739c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.132+0000 7f153ef739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.132+0000 7f153ef739c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.132+0000 7f153ef739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.132+0000 7f153ef739c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.136+0000 7f153ef739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.136+0000 7f153ef739c0 20 started sync module instance, tier type = 2024-09-12T00:39:21.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.136+0000 7f153ef739c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:39:21.157 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.156+0000 7f153ef739c0 20 add_watcher() i=0 2024-09-12T00:39:21.157 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.156+0000 7f153ef739c0 20 add_watcher() i=1 2024-09-12T00:39:21.157 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.156+0000 7f153ef739c0 20 add_watcher() i=2 2024-09-12T00:39:21.157 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.156+0000 7f153ef739c0 20 add_watcher() i=3 2024-09-12T00:39:21.157 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.156+0000 7f153ef739c0 20 add_watcher() i=4 2024-09-12T00:39:21.157 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.156+0000 7f153ef739c0 20 add_watcher() i=5 2024-09-12T00:39:21.157 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.160+0000 7f153ef739c0 20 add_watcher() i=6 2024-09-12T00:39:21.159 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.160+0000 7f153ef739c0 20 add_watcher() i=7 2024-09-12T00:39:21.160 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.160+0000 7f153ef739c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:21.163 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.164+0000 7f13f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:21.165 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.164+0000 7f153ef739c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:21.165 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.164+0000 7f153ef739c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:21.165 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.164+0000 7f153ef739c0 5 note: GC not initialized 2024-09-12T00:39:21.165 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.168+0000 7f13f1fe3640 20 reqs_thread_entry: start 2024-09-12T00:39:21.165 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.168+0000 7f153ef739c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:21.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.168+0000 7f153ef739c0 20 Filter name: none 2024-09-12T00:39:21.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.168+0000 7f13637fe640 20 reqs_thread_entry: start 2024-09-12T00:39:21.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.168+0000 7f153ef739c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.168+0000 7f153ef739c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:21.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.168+0000 7f153ef739c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.168 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.168+0000 7f153ef739c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:39:21.169 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.168+0000 7f153ef739c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:21.169 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.168+0000 7f153ef739c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.169 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.168+0000 7f153ef739c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:21.169 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.168+0000 7f153ef739c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.172+0000 7f153ef739c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:39:21.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.172+0000 7f153ef739c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:21.173 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.176+0000 7f13f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:21.180 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.180+0000 7f153ef739c0 20 remove_watcher() i=0 2024-09-12T00:39:21.180 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.180+0000 7f153ef739c0 2 removed watcher, disabling cache 2024-09-12T00:39:21.183 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.184+0000 7f153ef739c0 20 remove_watcher() i=1 2024-09-12T00:39:21.186 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.188+0000 7f153ef739c0 20 remove_watcher() i=2 2024-09-12T00:39:21.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.188+0000 7f153ef739c0 20 remove_watcher() i=3 2024-09-12T00:39:21.190 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.192+0000 7f153ef739c0 20 remove_watcher() i=4 2024-09-12T00:39:21.192 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.192+0000 7f153ef739c0 20 remove_watcher() i=5 2024-09-12T00:39:21.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.196+0000 7f153ef739c0 20 remove_watcher() i=6 2024-09-12T00:39:21.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.196+0000 7f153ef739c0 20 remove_watcher() i=7 2024-09-12T00:39:21.212 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:21.212 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:39:21.212 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-do-reshard id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:39:21.213 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:21.213 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:21.213 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:21.227 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:21.227 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:21.270 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:39:21.308 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:21.309 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:21.353 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.352+0000 7f1e843aa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.356+0000 7f1e843aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.356+0000 7f1e843aa9c0 20 realm 2024-09-12T00:39:21.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.356+0000 7f1e843aa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.356+0000 7f1e843aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.356+0000 7f1e843aa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:21.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.356+0000 7f1e843aa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.356+0000 7f1e843aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.356+0000 7f1e843aa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.357 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.356+0000 7f1e843aa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:21.357 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.356+0000 7f1e843aa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.357 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.360+0000 7f1e843aa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:21.358 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.360+0000 7f1e843aa9c0 20 searching for the correct realm 2024-09-12T00:39:21.365 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.364+0000 7f1e826b1640 0 -- 172.21.15.43:0/2877544340 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f1e7813c080 msgr2=0x7f1e7810ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:21.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.580+0000 7f1e81eb0640 0 -- 172.21.15.43:0/2877544340 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x56524a356020 msgr2=0x56524a358450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:21.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.588+0000 7f1e843aa9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:39:21.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.588+0000 7f1e843aa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:21.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.588+0000 7f1e843aa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:21.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.588+0000 7f1e843aa9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:39:21.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.588+0000 7f1e843aa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:21.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.588+0000 7f1e843aa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:21.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.588+0000 7f1e843aa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.589 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.588+0000 7f1e843aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.589 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.588+0000 7f1e843aa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.589 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.592+0000 7f1e843aa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:21.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.592+0000 7f1e843aa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.592+0000 7f1e843aa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:21.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.592+0000 7f1e843aa9c0 20 zone default found 2024-09-12T00:39:21.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.592+0000 7f1e843aa9c0 4 Realm: () 2024-09-12T00:39:21.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.592+0000 7f1e843aa9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:39:21.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.592+0000 7f1e843aa9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:39:21.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.592+0000 7f1e843aa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:21.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.592+0000 7f1e843aa9c0 20 zonegroup default 2024-09-12T00:39:21.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.592+0000 7f1e843aa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.592 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.592+0000 7f1e843aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.592 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.592+0000 7f1e843aa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.592 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.592+0000 7f1e843aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.592 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.592+0000 7f1e843aa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.596+0000 7f1e843aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.596+0000 7f1e843aa9c0 20 started sync module instance, tier type = 2024-09-12T00:39:21.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.596+0000 7f1e843aa9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:39:21.618 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.620+0000 7f1e843aa9c0 20 add_watcher() i=0 2024-09-12T00:39:21.618 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.620+0000 7f1e843aa9c0 20 add_watcher() i=1 2024-09-12T00:39:21.618 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.620+0000 7f1e843aa9c0 20 add_watcher() i=2 2024-09-12T00:39:21.618 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.620+0000 7f1e843aa9c0 20 add_watcher() i=3 2024-09-12T00:39:21.618 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.620+0000 7f1e843aa9c0 20 add_watcher() i=4 2024-09-12T00:39:21.618 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.620+0000 7f1e843aa9c0 20 add_watcher() i=5 2024-09-12T00:39:21.618 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.620+0000 7f1e843aa9c0 20 add_watcher() i=6 2024-09-12T00:39:21.620 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.620+0000 7f1e843aa9c0 20 add_watcher() i=7 2024-09-12T00:39:21.621 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.620+0000 7f1e843aa9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:21.624 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.624+0000 7f1d337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:21.625 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.628+0000 7f1e843aa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:21.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.628+0000 7f1e843aa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:21.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.628+0000 7f1e843aa9c0 5 note: GC not initialized 2024-09-12T00:39:21.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.628+0000 7f1d327fc640 20 reqs_thread_entry: start 2024-09-12T00:39:21.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.628+0000 7f1e843aa9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:21.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.628+0000 7f1e843aa9c0 20 Filter name: none 2024-09-12T00:39:21.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.628+0000 7f1ca3fff640 20 reqs_thread_entry: start 2024-09-12T00:39:21.628 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.628+0000 7f1e843aa9c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T00:39:21.628 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.628+0000 7f1e843aa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.628 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.628+0000 7f1e843aa9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:21.628 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.628+0000 7f1e843aa9c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T00:39:21.628 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.628+0000 7f1e843aa9c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T00:39:21.628 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.628+0000 7f1e843aa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 : miss 2024-09-12T00:39:21.628 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.628+0000 7f1e843aa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.628+0000 7f1e843aa9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:39:21.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.628+0000 7f1e843aa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 info.flags=0x17 2024-09-12T00:39:21.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.628+0000 7f1e843aa9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 to cache LRU end 2024-09-12T00:39:21.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.628+0000 7f1e843aa9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:21.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.628+0000 7f1e843aa9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:21.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.628+0000 7f1e843aa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 2024-09-12T00:39:21.640 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.640+0000 7f1e843aa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 info.flags=0x17 2024-09-12T00:39:21.641 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.640+0000 7f1e843aa9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 to cache LRU end 2024-09-12T00:39:21.641 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.640+0000 7f1e843aa9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:21.641 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.640+0000 7f1e843aa9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33, ofs0, ns] 2024-09-12T00:39:21.641 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.644+0000 7f1d657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333535 cookie 94911432372928 notifier 7079 bl.length()=911 2024-09-12T00:39:21.641 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.644+0000 7f1d657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 info.flags=0x17 2024-09-12T00:39:21.642 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.644+0000 7f1d657fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 to cache LRU end 2024-09-12T00:39:21.642 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.644+0000 7f1d657fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:21.642 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.644+0000 7f1e843aa9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33]): orig_sources= new_sources= 2024-09-12T00:39:21.642 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.644+0000 7f1e843aa9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33]): potential sources added=[] removed=[] 2024-09-12T00:39:21.642 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.644+0000 7f1e843aa9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33]): orig_dests= new_dests= 2024-09-12T00:39:21.643 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.644+0000 7f1e843aa9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33]): potential dests added=[] removed=[] 2024-09-12T00:39:21.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.652+0000 7f1e843aa9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.1.0 2024-09-12T00:39:21.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.652+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.1.0 2024-09-12T00:39:21.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.652+0000 7f1e843aa9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.1.1 2024-09-12T00:39:21.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.652+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.1.1 2024-09-12T00:39:21.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.652+0000 7f1e843aa9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.1.2 2024-09-12T00:39:21.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.652+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.1.2 2024-09-12T00:39:21.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.652+0000 7f1e843aa9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.1.3 2024-09-12T00:39:21.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.652+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.1.3 2024-09-12T00:39:21.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.652+0000 7f1e843aa9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.1.4 2024-09-12T00:39:21.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.652+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.1.4 2024-09-12T00:39:21.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.652+0000 7f1e843aa9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.1.5 2024-09-12T00:39:21.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.652+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.1.5 2024-09-12T00:39:21.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.652+0000 7f1e843aa9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.1.6 2024-09-12T00:39:21.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.652+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.1.6 2024-09-12T00:39:21.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.652+0000 7f1e843aa9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.1.7 2024-09-12T00:39:21.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.652+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.1.7 2024-09-12T00:39:21.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.652+0000 7f1e843aa9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.1.8 2024-09-12T00:39:21.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.652+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.1.8 2024-09-12T00:39:21.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.652+0000 7f1e843aa9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.1.9 2024-09-12T00:39:21.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.652+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.1.9 2024-09-12T00:39:21.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.652+0000 7f1e843aa9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.1.10 2024-09-12T00:39:21.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.652+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.1.10 2024-09-12T00:39:21.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.652+0000 7f1e843aa9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.1.11 2024-09-12T00:39:21.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.652+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.1.11 2024-09-12T00:39:21.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.652+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.0 2024-09-12T00:39:21.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.656+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.1 2024-09-12T00:39:21.657 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.656+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.2 2024-09-12T00:39:21.658 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.656+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.3 2024-09-12T00:39:21.658 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.656+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.4 2024-09-12T00:39:21.658 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.660+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.5 2024-09-12T00:39:21.658 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.660+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.6 2024-09-12T00:39:21.659 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.660+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.7 2024-09-12T00:39:21.660 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.660+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.8 2024-09-12T00:39:21.662 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.664+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.9 2024-09-12T00:39:21.663 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.664+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.10 2024-09-12T00:39:21.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.668+0000 7f1e843aa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:21.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.668+0000 7f1e843aa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 2024-09-12T00:39:21.671 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.672+0000 7f1e843aa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 info.flags=0x17 2024-09-12T00:39:21.671 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.672+0000 7f1e843aa9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 to cache LRU end 2024-09-12T00:39:21.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.672+0000 7f1e843aa9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:21.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.672+0000 7f1e843aa9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33, ofs0, ns] 2024-09-12T00:39:21.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.672+0000 7f1d64ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333536 cookie 94911432372928 notifier 7079 bl.length()=911 2024-09-12T00:39:21.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.672+0000 7f1d64ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 info.flags=0x17 2024-09-12T00:39:21.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.672+0000 7f1d64ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 to cache LRU end 2024-09-12T00:39:21.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.672+0000 7f1d64ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:21.673 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.676+0000 7f1e843aa9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33]): orig_sources= new_sources= 2024-09-12T00:39:21.673 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.676+0000 7f1e843aa9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33]): potential sources added=[] removed=[] 2024-09-12T00:39:21.673 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.676+0000 7f1e843aa9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33]): orig_dests= new_dests= 2024-09-12T00:39:21.673 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.676+0000 7f1e843aa9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33]): potential dests added=[] removed=[] 2024-09-12T00:39:21.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.680+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.0 2024-09-12T00:39:21.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.680+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.1 2024-09-12T00:39:21.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.680+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.2 2024-09-12T00:39:21.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.680+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.3 2024-09-12T00:39:21.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.680+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.4 2024-09-12T00:39:21.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.680+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.5 2024-09-12T00:39:21.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.684+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.6 2024-09-12T00:39:21.682 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.684+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.7 2024-09-12T00:39:21.682 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.684+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.8 2024-09-12T00:39:21.684 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.684+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.9 2024-09-12T00:39:21.685 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.684+0000 7f1e843aa9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33.10 2024-09-12T00:39:21.685 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.684+0000 7f1e843aa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:21.685 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.684+0000 7f1e843aa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 2024-09-12T00:39:21.687 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.688+0000 7f1e843aa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 info.flags=0x17 2024-09-12T00:39:21.687 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.688+0000 7f1e843aa9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 to cache LRU end 2024-09-12T00:39:21.688 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.688+0000 7f1e843aa9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:21.688 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.688+0000 7f1e843aa9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33, ofs0, ns] 2024-09-12T00:39:21.689 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.688+0000 7f1d657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333537 cookie 94911432372928 notifier 7079 bl.length()=879 2024-09-12T00:39:21.689 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.688+0000 7f1d657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 info.flags=0x17 2024-09-12T00:39:21.689 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.688+0000 7f1d657fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 to cache LRU end 2024-09-12T00:39:21.689 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.688+0000 7f1d657fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:21.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.692+0000 7f1e843aa9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33]): orig_sources= new_sources= 2024-09-12T00:39:21.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.692+0000 7f1e843aa9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33]): potential sources added=[] removed=[] 2024-09-12T00:39:21.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.692+0000 7f1e843aa9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33]): orig_dests= new_dests= 2024-09-12T00:39:21.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.692+0000 7f1e843aa9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33]): potential dests added=[] removed=[] 2024-09-12T00:39:21.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.696+0000 7f1e843aa9c0 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-12T00:39:21.699 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.700+0000 7f1d337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:21.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.704+0000 7f1e843aa9c0 20 remove_watcher() i=0 2024-09-12T00:39:21.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.704+0000 7f1e843aa9c0 2 removed watcher, disabling cache 2024-09-12T00:39:21.706 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.708+0000 7f1e843aa9c0 20 remove_watcher() i=1 2024-09-12T00:39:21.708 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.708+0000 7f1e843aa9c0 20 remove_watcher() i=2 2024-09-12T00:39:21.711 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.712+0000 7f1e843aa9c0 20 remove_watcher() i=3 2024-09-12T00:39:21.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.712+0000 7f1e843aa9c0 20 remove_watcher() i=4 2024-09-12T00:39:21.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.716+0000 7f1e843aa9c0 20 remove_watcher() i=5 2024-09-12T00:39:21.715 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.716+0000 7f1e843aa9c0 20 remove_watcher() i=6 2024-09-12T00:39:21.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.720+0000 7f1e843aa9c0 20 remove_watcher() i=7 2024-09-12T00:39:21.733 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:39:21.764 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:21.764 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:21.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.812+0000 7f64387069c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.812 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.812+0000 7f64387069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.812 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.812+0000 7f64387069c0 20 realm 2024-09-12T00:39:21.812 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.812+0000 7f64387069c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.812+0000 7f64387069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.812+0000 7f64387069c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:21.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.812+0000 7f64387069c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.812+0000 7f64387069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.812+0000 7f64387069c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.816+0000 7f64387069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:21.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.816+0000 7f64387069c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.816+0000 7f64387069c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:21.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.816+0000 7f64387069c0 20 searching for the correct realm 2024-09-12T00:39:21.821 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.824+0000 7f6436a0d640 0 -- 172.21.15.43:0/3932958350 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x5632a5c9f450 msgr2=0x5632a5ca1840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:21.827 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.828+0000 7f642ffff640 0 -- 172.21.15.43:0/3932958350 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f64200bf020 msgr2=0x7f64200ac3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:21.834 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.836+0000 7f64387069c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:39:21.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.836+0000 7f64387069c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:21.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.836+0000 7f64387069c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:21.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.836+0000 7f64387069c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:39:21.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.836+0000 7f64387069c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:21.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.836+0000 7f64387069c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:21.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.836+0000 7f64387069c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.836+0000 7f64387069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.836+0000 7f64387069c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.836 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.836+0000 7f64387069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:21.836 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.836+0000 7f64387069c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.836 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.836+0000 7f64387069c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:21.836 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.836+0000 7f64387069c0 20 zone default found 2024-09-12T00:39:21.836 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.836+0000 7f64387069c0 4 Realm: () 2024-09-12T00:39:21.836 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.836+0000 7f64387069c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:39:21.836 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.836+0000 7f64387069c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:39:21.837 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.836+0000 7f64387069c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:21.837 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.836+0000 7f64387069c0 20 zonegroup default 2024-09-12T00:39:21.837 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.836+0000 7f64387069c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.837 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.836+0000 7f64387069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.837 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.836+0000 7f64387069c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.838 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.836+0000 7f64387069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.838 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.836+0000 7f64387069c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.838 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.836+0000 7f64387069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.838 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.836+0000 7f64387069c0 20 started sync module instance, tier type = 2024-09-12T00:39:21.838 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.836+0000 7f64387069c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:39:21.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.852+0000 7f64387069c0 20 add_watcher() i=0 2024-09-12T00:39:21.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.852+0000 7f64387069c0 20 add_watcher() i=1 2024-09-12T00:39:21.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.852+0000 7f64387069c0 20 add_watcher() i=2 2024-09-12T00:39:21.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.852+0000 7f64387069c0 20 add_watcher() i=3 2024-09-12T00:39:21.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.852+0000 7f64387069c0 20 add_watcher() i=4 2024-09-12T00:39:21.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.852+0000 7f64387069c0 20 add_watcher() i=5 2024-09-12T00:39:21.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.852+0000 7f64387069c0 20 add_watcher() i=6 2024-09-12T00:39:21.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.856+0000 7f64387069c0 20 add_watcher() i=7 2024-09-12T00:39:21.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.856+0000 7f64387069c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:21.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.856+0000 7f62ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:21.858 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.860+0000 7f64387069c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:21.858 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.860+0000 7f64387069c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:21.858 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.860+0000 7f64387069c0 5 note: GC not initialized 2024-09-12T00:39:21.858 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.860+0000 7f62677fe640 20 reqs_thread_entry: start 2024-09-12T00:39:21.858 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.860+0000 7f64387069c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:21.858 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.860+0000 7f64387069c0 20 Filter name: none 2024-09-12T00:39:21.859 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.860+0000 7f62657fa640 20 reqs_thread_entry: start 2024-09-12T00:39:21.859 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.860+0000 7f64387069c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.860 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.860+0000 7f64387069c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:21.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.860+0000 7f64387069c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.860+0000 7f64387069c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:39:21.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.860+0000 7f64387069c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:21.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.860+0000 7f64387069c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.860+0000 7f64387069c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:21.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.860+0000 7f64387069c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.862 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.864+0000 7f64387069c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:39:21.862 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.864+0000 7f64387069c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:21.864 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.864+0000 7f62ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:21.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.868+0000 7f64387069c0 20 remove_watcher() i=0 2024-09-12T00:39:21.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.868+0000 7f64387069c0 2 removed watcher, disabling cache 2024-09-12T00:39:21.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.872+0000 7f64387069c0 20 remove_watcher() i=1 2024-09-12T00:39:21.872 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.872+0000 7f64387069c0 20 remove_watcher() i=2 2024-09-12T00:39:21.874 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.876+0000 7f64387069c0 20 remove_watcher() i=3 2024-09-12T00:39:21.876 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.876+0000 7f64387069c0 20 remove_watcher() i=4 2024-09-12T00:39:21.878 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.880+0000 7f64387069c0 20 remove_watcher() i=5 2024-09-12T00:39:21.879 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.880+0000 7f64387069c0 20 remove_watcher() i=6 2024-09-12T00:39:21.880 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:21.880+0000 7f64387069c0 20 remove_watcher() i=7 2024-09-12T00:39:21.894 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:21.895 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:39:21.895 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-do-reshard id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:39:21.895 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:21.896 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:21.896 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:21.900 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:21.901 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:21.947 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:21.948 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:21.994 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-12T00:39:21.995 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:21.997 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:21.997 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:22.026 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:22.026 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:22.077 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:22.077 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:22.096 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:22.096 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:22.115 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:22.115 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:22.135 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:22.135 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:22.153 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:22.154 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:22.172 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:22.172 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:22.191 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:22.191 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:22.210 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:22.210 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:22.230 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:22.230 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:22.248 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:22.248 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:22.267 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:22.267 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:22.287 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:22.288 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:22.308 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:22.308 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:22.328 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:22.328 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:22.347 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:22.347 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:22.367 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:22.367 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:22.388 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:22.389 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:22.409 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:22.409 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:22.427 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:22.428 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:22.446 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:22.446 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:22.463 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:39:22.497 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:22.497 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:22.542 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:22.544+0000 7ff887fbd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:22.544+0000 7ff887fbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:22.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:22.544+0000 7ff887fbd9c0 20 realm 2024-09-12T00:39:22.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:22.544+0000 7ff887fbd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:22.544+0000 7ff887fbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:22.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:22.544+0000 7ff887fbd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:22.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:22.544+0000 7ff887fbd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:22.548+0000 7ff887fbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:22.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:22.548+0000 7ff887fbd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:22.752+0000 7ff887fbd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:22.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:22.752+0000 7ff887fbd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.752 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:22.752+0000 7ff887fbd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:22.753 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:22.752+0000 7ff887fbd9c0 20 searching for the correct realm 2024-09-12T00:39:23.368 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.368+0000 7ff8852c2640 0 -- 172.21.15.43:0/2020285765 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7ff87c047060 msgr2=0x7ff87c06e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:23.583 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.584+0000 7ff885ac3640 0 -- 172.21.15.43:0/2020285765 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7ff87c070520 msgr2=0x7ff87c088970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:23.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.800+0000 7ff887fbd9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:39:23.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.800+0000 7ff887fbd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:23.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.800+0000 7ff887fbd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:23.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.800+0000 7ff887fbd9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:39:23.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.800+0000 7ff887fbd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:23.801 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.800+0000 7ff887fbd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:23.801 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.800+0000 7ff887fbd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.801 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.800+0000 7ff887fbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.801 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.800+0000 7ff887fbd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.802 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.804+0000 7ff887fbd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:23.802 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.804+0000 7ff887fbd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.802 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.804+0000 7ff887fbd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:23.803 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.804+0000 7ff887fbd9c0 20 zone default found 2024-09-12T00:39:23.803 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.804+0000 7ff887fbd9c0 4 Realm: () 2024-09-12T00:39:23.803 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.804+0000 7ff887fbd9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:39:23.803 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.804+0000 7ff887fbd9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:39:23.803 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.804+0000 7ff887fbd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:23.803 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.804+0000 7ff887fbd9c0 20 zonegroup default 2024-09-12T00:39:23.803 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.804+0000 7ff887fbd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.804+0000 7ff887fbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.804+0000 7ff887fbd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.804+0000 7ff887fbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.804+0000 7ff887fbd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.808+0000 7ff887fbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.808+0000 7ff887fbd9c0 20 started sync module instance, tier type = 2024-09-12T00:39:23.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.808+0000 7ff887fbd9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:39:23.837 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.840+0000 7ff887fbd9c0 20 add_watcher() i=0 2024-09-12T00:39:23.837 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.840+0000 7ff887fbd9c0 20 add_watcher() i=1 2024-09-12T00:39:23.837 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.840+0000 7ff887fbd9c0 20 add_watcher() i=2 2024-09-12T00:39:23.838 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.840+0000 7ff887fbd9c0 20 add_watcher() i=3 2024-09-12T00:39:23.838 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.840+0000 7ff887fbd9c0 20 add_watcher() i=4 2024-09-12T00:39:23.838 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.840+0000 7ff887fbd9c0 20 add_watcher() i=5 2024-09-12T00:39:23.838 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.840+0000 7ff887fbd9c0 20 add_watcher() i=6 2024-09-12T00:39:23.840 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.840+0000 7ff887fbd9c0 20 add_watcher() i=7 2024-09-12T00:39:23.840 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.840+0000 7ff887fbd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:23.844 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.844+0000 7ff7377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:23.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.844+0000 7ff887fbd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:23.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.844+0000 7ff887fbd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:23.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.848+0000 7ff887fbd9c0 5 note: GC not initialized 2024-09-12T00:39:23.846 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.848+0000 7ff7367fc640 20 reqs_thread_entry: start 2024-09-12T00:39:23.846 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.848+0000 7ff887fbd9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:23.846 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.848+0000 7ff887fbd9c0 20 Filter name: none 2024-09-12T00:39:23.846 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.848+0000 7ff6a7fff640 20 reqs_thread_entry: start 2024-09-12T00:39:23.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.848+0000 7ff887fbd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.848 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.848+0000 7ff887fbd9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:23.848 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.848+0000 7ff887fbd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.852+0000 7ff887fbd9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:39:23.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.852+0000 7ff887fbd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:23.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.852+0000 7ff887fbd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.852+0000 7ff887fbd9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:23.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.852+0000 7ff887fbd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.852+0000 7ff887fbd9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:39:23.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.852+0000 7ff887fbd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:23.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.856+0000 7ff7377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:23.859 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.860+0000 7ff887fbd9c0 20 remove_watcher() i=0 2024-09-12T00:39:23.859 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.860+0000 7ff887fbd9c0 2 removed watcher, disabling cache 2024-09-12T00:39:23.862 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.864+0000 7ff887fbd9c0 20 remove_watcher() i=1 2024-09-12T00:39:23.865 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.864+0000 7ff887fbd9c0 20 remove_watcher() i=2 2024-09-12T00:39:23.868 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.868+0000 7ff887fbd9c0 20 remove_watcher() i=3 2024-09-12T00:39:23.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.872+0000 7ff887fbd9c0 20 remove_watcher() i=4 2024-09-12T00:39:23.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.872+0000 7ff887fbd9c0 20 remove_watcher() i=5 2024-09-12T00:39:23.873 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.876+0000 7ff887fbd9c0 20 remove_watcher() i=6 2024-09-12T00:39:23.875 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.876+0000 7ff887fbd9c0 20 remove_watcher() i=7 2024-09-12T00:39:23.890 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:23.890 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:39:23.890 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: abort-at-do-reshard id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:39:23.891 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:23.891 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:39:23.924 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:23.924 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:23.966 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.968+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.968 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.968+0000 7f507521e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.969 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.968+0000 7f507521e9c0 20 realm 2024-09-12T00:39:23.969 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.968+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.969 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.968+0000 7f507521e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.969 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.968+0000 7f507521e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:23.969 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.968+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.969 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.968+0000 7f507521e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.969 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.968+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.972+0000 7f507521e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:23.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.972+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.971 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.972+0000 7f507521e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:23.971 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.972+0000 7f507521e9c0 20 searching for the correct realm 2024-09-12T00:39:23.978 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:23.980+0000 7f5073525640 0 -- 172.21.15.43:0/1628816383 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f5068013030 msgr2=0x7f50680015f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:24.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.196+0000 7f5072d24640 0 -- 172.21.15.43:0/1628816383 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x55f8e76fb000 msgr2=0x55f8e76fd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:24.203 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.204+0000 7f507521e9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:39:24.204 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.204+0000 7f507521e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:24.204 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.204+0000 7f507521e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:24.204 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.204+0000 7f507521e9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:39:24.204 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.204+0000 7f507521e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:24.204 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.204+0000 7f507521e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:24.204 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.204+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.204 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.204+0000 7f507521e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.204 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.204+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.205 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.204+0000 7f507521e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:24.205 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.204+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.206 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.208+0000 7f507521e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:24.206 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.208+0000 7f507521e9c0 20 zone default found 2024-09-12T00:39:24.206 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.208+0000 7f507521e9c0 4 Realm: () 2024-09-12T00:39:24.206 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.208+0000 7f507521e9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:39:24.206 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.208+0000 7f507521e9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:39:24.206 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.208+0000 7f507521e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:24.206 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.208+0000 7f507521e9c0 20 zonegroup default 2024-09-12T00:39:24.206 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.208+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.208+0000 7f507521e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.208+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.208+0000 7f507521e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.208+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.208+0000 7f507521e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.208+0000 7f507521e9c0 20 started sync module instance, tier type = 2024-09-12T00:39:24.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.208+0000 7f507521e9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:39:24.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.232+0000 7f507521e9c0 20 add_watcher() i=0 2024-09-12T00:39:24.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.232+0000 7f507521e9c0 20 add_watcher() i=1 2024-09-12T00:39:24.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.232+0000 7f507521e9c0 20 add_watcher() i=2 2024-09-12T00:39:24.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.232+0000 7f507521e9c0 20 add_watcher() i=3 2024-09-12T00:39:24.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.232+0000 7f507521e9c0 20 add_watcher() i=4 2024-09-12T00:39:24.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.232+0000 7f507521e9c0 20 add_watcher() i=5 2024-09-12T00:39:24.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.232+0000 7f507521e9c0 20 add_watcher() i=6 2024-09-12T00:39:24.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.236+0000 7f507521e9c0 20 add_watcher() i=7 2024-09-12T00:39:24.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.236+0000 7f507521e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:24.238 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.240+0000 7f4f297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:24.240 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.240+0000 7f507521e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:24.240 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.240+0000 7f507521e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:24.240 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.240+0000 7f507521e9c0 5 note: GC not initialized 2024-09-12T00:39:24.240 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.240+0000 7f4ea3fff640 20 reqs_thread_entry: start 2024-09-12T00:39:24.241 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.240+0000 7f507521e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:24.241 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.240+0000 7f507521e9c0 20 Filter name: none 2024-09-12T00:39:24.241 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.244+0000 7f4ea1ffb640 20 reqs_thread_entry: start 2024-09-12T00:39:24.241 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.244+0000 7f507521e9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:39:24.241 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.244+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.242 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.244+0000 7f507521e9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:24.242 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.244+0000 7f507521e9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:39:24.243 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.244+0000 7f507521e9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:39:24.243 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.244+0000 7f507521e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 : miss 2024-09-12T00:39:24.243 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.244+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.244 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.244+0000 7f507521e9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:39:24.244 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.244+0000 7f507521e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 info.flags=0x17 2024-09-12T00:39:24.244 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.244+0000 7f507521e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 to cache LRU end 2024-09-12T00:39:24.244 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.244+0000 7f507521e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:24.244 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.244+0000 7f507521e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:24.244 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.244+0000 7f507521e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 2024-09-12T00:39:24.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.256+0000 7f507521e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 info.flags=0x17 2024-09-12T00:39:24.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.256+0000 7f507521e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 to cache LRU end 2024-09-12T00:39:24.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.256+0000 7f507521e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:24.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.256+0000 7f507521e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34, ofs0, ns] 2024-09-12T00:39:24.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.256+0000 7f4f567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333500 cookie 94527523153280 notifier 7449 bl.length()=911 2024-09-12T00:39:24.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.256+0000 7f4f567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 info.flags=0x17 2024-09-12T00:39:24.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.256+0000 7f4f567fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 to cache LRU end 2024-09-12T00:39:24.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.256+0000 7f4f567fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:24.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.256+0000 7f507521e9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34]): orig_sources= new_sources= 2024-09-12T00:39:24.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.256+0000 7f507521e9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34]): potential sources added=[] removed=[] 2024-09-12T00:39:24.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.256+0000 7f507521e9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34]): orig_dests= new_dests= 2024-09-12T00:39:24.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.256+0000 7f507521e9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34]): potential dests added=[] removed=[] 2024-09-12T00:39:24.268 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f507521e9c0 time 2024-09-12T00:39:24.272207+0000 2024-09-12T00:39:24.269 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:39:24.269 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:24.269 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f5078af82eb] 2024-09-12T00:39:24.269 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5078af849f] 2024-09-12T00:39:24.270 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f8e570ccc1] 2024-09-12T00:39:24.270 INFO:tasks.workunit.client.0.smithi043.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f8e5721d5a] 2024-09-12T00:39:24.270 INFO:tasks.workunit.client.0.smithi043.stderr: 5: main() 2024-09-12T00:39:24.270 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f507795ed90] 2024-09-12T00:39:24.270 INFO:tasks.workunit.client.0.smithi043.stderr: 7: __libc_start_main() 2024-09-12T00:39:24.270 INFO:tasks.workunit.client.0.smithi043.stderr: 8: _start() 2024-09-12T00:39:24.270 INFO:tasks.workunit.client.0.smithi043.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:39:24.270 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7f507521e9c0 thread_name:radosgw-admin 2024-09-12T00:39:24.270 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.272+0000 7f507521e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f507521e9c0 time 2024-09-12T00:39:24.272207+0000 2024-09-12T00:39:24.270 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:39:24.270 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.270 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:24.270 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f5078af82eb] 2024-09-12T00:39:24.271 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5078af849f] 2024-09-12T00:39:24.271 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f8e570ccc1] 2024-09-12T00:39:24.271 INFO:tasks.workunit.client.0.smithi043.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f8e5721d5a] 2024-09-12T00:39:24.271 INFO:tasks.workunit.client.0.smithi043.stderr: 5: main() 2024-09-12T00:39:24.271 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f507795ed90] 2024-09-12T00:39:24.271 INFO:tasks.workunit.client.0.smithi043.stderr: 7: __libc_start_main() 2024-09-12T00:39:24.271 INFO:tasks.workunit.client.0.smithi043.stderr: 8: _start() 2024-09-12T00:39:24.271 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.281 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:24.281 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5077977520] 2024-09-12T00:39:24.281 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:39:24.281 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:39:24.281 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:39:24.281 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5078af8345] 2024-09-12T00:39:24.281 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5078af849f] 2024-09-12T00:39:24.281 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f8e570ccc1] 2024-09-12T00:39:24.282 INFO:tasks.workunit.client.0.smithi043.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f8e5721d5a] 2024-09-12T00:39:24.282 INFO:tasks.workunit.client.0.smithi043.stderr: 9: main() 2024-09-12T00:39:24.282 INFO:tasks.workunit.client.0.smithi043.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f507795ed90] 2024-09-12T00:39:24.282 INFO:tasks.workunit.client.0.smithi043.stderr: 11: __libc_start_main() 2024-09-12T00:39:24.282 INFO:tasks.workunit.client.0.smithi043.stderr: 12: _start() 2024-09-12T00:39:24.282 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.272+0000 7f507521e9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:39:24.282 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7f507521e9c0 thread_name:radosgw-admin 2024-09-12T00:39:24.282 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.282 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:24.282 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5077977520] 2024-09-12T00:39:24.282 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:39:24.283 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:39:24.283 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:39:24.283 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5078af8345] 2024-09-12T00:39:24.283 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5078af849f] 2024-09-12T00:39:24.283 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f8e570ccc1] 2024-09-12T00:39:24.283 INFO:tasks.workunit.client.0.smithi043.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f8e5721d5a] 2024-09-12T00:39:24.283 INFO:tasks.workunit.client.0.smithi043.stderr: 9: main() 2024-09-12T00:39:24.283 INFO:tasks.workunit.client.0.smithi043.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f507795ed90] 2024-09-12T00:39:24.283 INFO:tasks.workunit.client.0.smithi043.stderr: 11: __libc_start_main() 2024-09-12T00:39:24.283 INFO:tasks.workunit.client.0.smithi043.stderr: 12: _start() 2024-09-12T00:39:24.284 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:39:24.284 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.284 INFO:tasks.workunit.client.0.smithi043.stderr:--- begin dump of recent events --- 2024-09-12T00:39:24.284 INFO:tasks.workunit.client.0.smithi043.stderr: -499> 2024-09-12T00:39:23.948+0000 7f5073525640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:24.284 INFO:tasks.workunit.client.0.smithi043.stderr: -498> 2024-09-12T00:39:23.948+0000 7f5072d24640 10 monclient(hunting): get_auth_request con 0x55f8e74be300 auth_method 0 2024-09-12T00:39:24.285 INFO:tasks.workunit.client.0.smithi043.stderr: -497> 2024-09-12T00:39:23.948+0000 7f5072d24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:24.285 INFO:tasks.workunit.client.0.smithi043.stderr: -496> 2024-09-12T00:39:23.948+0000 7f5072d24640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:24.285 INFO:tasks.workunit.client.0.smithi043.stderr: -495> 2024-09-12T00:39:23.948+0000 7f5072d24640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:24.285 INFO:tasks.workunit.client.0.smithi043.stderr: -494> 2024-09-12T00:39:23.948+0000 7f5072523640 10 monclient(hunting): handle_auth_done global_id 7437 payload 274 2024-09-12T00:39:24.285 INFO:tasks.workunit.client.0.smithi043.stderr: -493> 2024-09-12T00:39:23.948+0000 7f5072523640 10 monclient: _finish_hunting 0 2024-09-12T00:39:24.285 INFO:tasks.workunit.client.0.smithi043.stderr: -492> 2024-09-12T00:39:23.948+0000 7f5072523640 1 monclient: found mon.noname-a 2024-09-12T00:39:24.285 INFO:tasks.workunit.client.0.smithi043.stderr: -491> 2024-09-12T00:39:23.948+0000 7f5072523640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:39:24.285 INFO:tasks.workunit.client.0.smithi043.stderr: -490> 2024-09-12T00:39:23.948+0000 7f4f60e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:24.285 INFO:tasks.workunit.client.0.smithi043.stderr: -489> 2024-09-12T00:39:23.948+0000 7f4f60e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:39:24.285 INFO:tasks.workunit.client.0.smithi043.stderr: -488> 2024-09-12T00:39:23.948+0000 7f4f60e09640 10 monclient: dump: 2024-09-12T00:39:24.285 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:24.285 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:24.285 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.286 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.286 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:24.286 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:24.286 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:24.286 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:24.286 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:24.287 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.287 INFO:tasks.workunit.client.0.smithi043.stderr: -487> 2024-09-12T00:39:23.948+0000 7f4f60e09640 10 monclient: _finish_auth 0 2024-09-12T00:39:24.287 INFO:tasks.workunit.client.0.smithi043.stderr: -486> 2024-09-12T00:39:23.948+0000 7f4f60e09640 10 monclient: _check_auth_tickets 2024-09-12T00:39:24.287 INFO:tasks.workunit.client.0.smithi043.stderr: -485> 2024-09-12T00:39:23.948+0000 7f4f60e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:24.287 INFO:tasks.workunit.client.0.smithi043.stderr: -484> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 monclient: authenticate success, global_id 7437 2024-09-12T00:39:24.287 INFO:tasks.workunit.client.0.smithi043.stderr: -483> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:39:24.287 INFO:tasks.workunit.client.0.smithi043.stderr: -482> 2024-09-12T00:39:23.948+0000 7f507521e9c0 4 set_mon_vals no callback set 2024-09-12T00:39:24.287 INFO:tasks.workunit.client.0.smithi043.stderr: -481> 2024-09-12T00:39:23.948+0000 7f4f60e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:24.287 INFO:tasks.workunit.client.0.smithi043.stderr: -480> 2024-09-12T00:39:23.948+0000 7f4f60e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:24.287 INFO:tasks.workunit.client.0.smithi043.stderr: -479> 2024-09-12T00:39:23.948+0000 7f4f60e09640 10 monclient: dump: 2024-09-12T00:39:24.287 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:24.287 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:24.288 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.288 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.288 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:24.288 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:24.288 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:24.288 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:24.288 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:24.288 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.288 INFO:tasks.workunit.client.0.smithi043.stderr: -478> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient: shutdown 2024-09-12T00:39:24.288 INFO:tasks.workunit.client.0.smithi043.stderr: -477> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 asok(0x55f8e74032b0) unregister_commands rotate-key 2024-09-12T00:39:24.288 INFO:tasks.workunit.client.0.smithi043.stderr: -476> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient: build_initial_monmap 2024-09-12T00:39:24.288 INFO:tasks.workunit.client.0.smithi043.stderr: -475> 2024-09-12T00:39:23.948+0000 7f507521e9c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:24.289 INFO:tasks.workunit.client.0.smithi043.stderr: -474> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient: monmap: 2024-09-12T00:39:24.289 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:39:24.289 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:24.289 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:39:24.289 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:39:24.289 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:24.289 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:24.289 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:39:24.289 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:39:24.289 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:39:24.289 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.289 INFO:tasks.workunit.client.0.smithi043.stderr: -473> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7613730) adding auth protocol: cephx 2024-09-12T00:39:24.289 INFO:tasks.workunit.client.0.smithi043.stderr: -472> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7613730) adding auth protocol: cephx 2024-09-12T00:39:24.290 INFO:tasks.workunit.client.0.smithi043.stderr: -471> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7613730) adding auth protocol: cephx 2024-09-12T00:39:24.290 INFO:tasks.workunit.client.0.smithi043.stderr: -470> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7613730) adding con mode: secure 2024-09-12T00:39:24.290 INFO:tasks.workunit.client.0.smithi043.stderr: -469> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7613730) adding con mode: crc 2024-09-12T00:39:24.290 INFO:tasks.workunit.client.0.smithi043.stderr: -468> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7613730) adding con mode: secure 2024-09-12T00:39:24.290 INFO:tasks.workunit.client.0.smithi043.stderr: -467> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7613730) adding con mode: crc 2024-09-12T00:39:24.290 INFO:tasks.workunit.client.0.smithi043.stderr: -466> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7613730) adding con mode: secure 2024-09-12T00:39:24.290 INFO:tasks.workunit.client.0.smithi043.stderr: -465> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7613730) adding con mode: crc 2024-09-12T00:39:24.290 INFO:tasks.workunit.client.0.smithi043.stderr: -464> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7613730) adding con mode: crc 2024-09-12T00:39:24.290 INFO:tasks.workunit.client.0.smithi043.stderr: -463> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7613730) adding con mode: secure 2024-09-12T00:39:24.290 INFO:tasks.workunit.client.0.smithi043.stderr: -462> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7613730) adding con mode: crc 2024-09-12T00:39:24.290 INFO:tasks.workunit.client.0.smithi043.stderr: -461> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7613730) adding con mode: secure 2024-09-12T00:39:24.290 INFO:tasks.workunit.client.0.smithi043.stderr: -460> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7613730) adding con mode: crc 2024-09-12T00:39:24.291 INFO:tasks.workunit.client.0.smithi043.stderr: -459> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7613730) adding con mode: secure 2024-09-12T00:39:24.291 INFO:tasks.workunit.client.0.smithi043.stderr: -458> 2024-09-12T00:39:23.948+0000 7f507521e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:24.291 INFO:tasks.workunit.client.0.smithi043.stderr: -457> 2024-09-12T00:39:23.948+0000 7f507521e9c0 1 librados: starting msgr at 2024-09-12T00:39:24.291 INFO:tasks.workunit.client.0.smithi043.stderr: -456> 2024-09-12T00:39:23.948+0000 7f507521e9c0 1 librados: starting objecter 2024-09-12T00:39:24.291 INFO:tasks.workunit.client.0.smithi043.stderr: -455> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command objecter_requests hook 0x55f8e73f6df0 2024-09-12T00:39:24.291 INFO:tasks.workunit.client.0.smithi043.stderr: -454> 2024-09-12T00:39:23.948+0000 7f507521e9c0 1 librados: setting wanted keys 2024-09-12T00:39:24.291 INFO:tasks.workunit.client.0.smithi043.stderr: -453> 2024-09-12T00:39:23.948+0000 7f507521e9c0 1 librados: calling monclient init 2024-09-12T00:39:24.291 INFO:tasks.workunit.client.0.smithi043.stderr: -452> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient: init 2024-09-12T00:39:24.291 INFO:tasks.workunit.client.0.smithi043.stderr: -451> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e760e3e0) adding auth protocol: cephx 2024-09-12T00:39:24.291 INFO:tasks.workunit.client.0.smithi043.stderr: -450> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e760e3e0) adding auth protocol: cephx 2024-09-12T00:39:24.291 INFO:tasks.workunit.client.0.smithi043.stderr: -449> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e760e3e0) adding auth protocol: cephx 2024-09-12T00:39:24.291 INFO:tasks.workunit.client.0.smithi043.stderr: -448> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e760e3e0) adding con mode: secure 2024-09-12T00:39:24.292 INFO:tasks.workunit.client.0.smithi043.stderr: -447> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e760e3e0) adding con mode: crc 2024-09-12T00:39:24.292 INFO:tasks.workunit.client.0.smithi043.stderr: -446> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e760e3e0) adding con mode: secure 2024-09-12T00:39:24.292 INFO:tasks.workunit.client.0.smithi043.stderr: -445> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e760e3e0) adding con mode: crc 2024-09-12T00:39:24.292 INFO:tasks.workunit.client.0.smithi043.stderr: -444> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e760e3e0) adding con mode: secure 2024-09-12T00:39:24.292 INFO:tasks.workunit.client.0.smithi043.stderr: -443> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e760e3e0) adding con mode: crc 2024-09-12T00:39:24.292 INFO:tasks.workunit.client.0.smithi043.stderr: -442> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e760e3e0) adding con mode: crc 2024-09-12T00:39:24.292 INFO:tasks.workunit.client.0.smithi043.stderr: -441> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e760e3e0) adding con mode: secure 2024-09-12T00:39:24.292 INFO:tasks.workunit.client.0.smithi043.stderr: -440> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e760e3e0) adding con mode: crc 2024-09-12T00:39:24.292 INFO:tasks.workunit.client.0.smithi043.stderr: -439> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e760e3e0) adding con mode: secure 2024-09-12T00:39:24.293 INFO:tasks.workunit.client.0.smithi043.stderr: -438> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e760e3e0) adding con mode: crc 2024-09-12T00:39:24.293 INFO:tasks.workunit.client.0.smithi043.stderr: -437> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e760e3e0) adding con mode: secure 2024-09-12T00:39:24.293 INFO:tasks.workunit.client.0.smithi043.stderr: -436> 2024-09-12T00:39:23.948+0000 7f507521e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:24.293 INFO:tasks.workunit.client.0.smithi043.stderr: -435> 2024-09-12T00:39:23.948+0000 7f507521e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:24.293 INFO:tasks.workunit.client.0.smithi043.stderr: -434> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command rotate-key hook 0x55f8e760e528 2024-09-12T00:39:24.293 INFO:tasks.workunit.client.0.smithi043.stderr: -433> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:24.294 INFO:tasks.workunit.client.0.smithi043.stderr: -432> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:39:24.294 INFO:tasks.workunit.client.0.smithi043.stderr: -431> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient(hunting): picked mon.noname-b con 0x55f8e74be300 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:39:24.294 INFO:tasks.workunit.client.0.smithi043.stderr: -430> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient(hunting): picked mon.noname-c con 0x55f8e74c7bf0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:39:24.294 INFO:tasks.workunit.client.0.smithi043.stderr: -429> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient(hunting): picked mon.noname-a con 0x55f8e74c9850 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:39:24.294 INFO:tasks.workunit.client.0.smithi043.stderr: -428> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:24.294 INFO:tasks.workunit.client.0.smithi043.stderr: -427> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:24.294 INFO:tasks.workunit.client.0.smithi043.stderr: -426> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:24.294 INFO:tasks.workunit.client.0.smithi043.stderr: -425> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:24.294 INFO:tasks.workunit.client.0.smithi043.stderr: -424> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient(hunting): authenticate will time out at 2259.938968s 2024-09-12T00:39:24.294 INFO:tasks.workunit.client.0.smithi043.stderr: -423> 2024-09-12T00:39:23.948+0000 7f5072523640 10 monclient(hunting): get_auth_request con 0x55f8e74c7bf0 auth_method 0 2024-09-12T00:39:24.294 INFO:tasks.workunit.client.0.smithi043.stderr: -422> 2024-09-12T00:39:23.948+0000 7f5072523640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:24.294 INFO:tasks.workunit.client.0.smithi043.stderr: -421> 2024-09-12T00:39:23.948+0000 7f5072523640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:24.295 INFO:tasks.workunit.client.0.smithi043.stderr: -420> 2024-09-12T00:39:23.948+0000 7f5072523640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:24.295 INFO:tasks.workunit.client.0.smithi043.stderr: -419> 2024-09-12T00:39:23.948+0000 7f5073525640 10 monclient(hunting): get_auth_request con 0x55f8e74c9850 auth_method 0 2024-09-12T00:39:24.295 INFO:tasks.workunit.client.0.smithi043.stderr: -418> 2024-09-12T00:39:23.948+0000 7f5073525640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:24.295 INFO:tasks.workunit.client.0.smithi043.stderr: -417> 2024-09-12T00:39:23.948+0000 7f5073525640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:24.295 INFO:tasks.workunit.client.0.smithi043.stderr: -416> 2024-09-12T00:39:23.948+0000 7f5073525640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:24.295 INFO:tasks.workunit.client.0.smithi043.stderr: -415> 2024-09-12T00:39:23.948+0000 7f5072523640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:24.295 INFO:tasks.workunit.client.0.smithi043.stderr: -414> 2024-09-12T00:39:23.948+0000 7f5072523640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:24.295 INFO:tasks.workunit.client.0.smithi043.stderr: -413> 2024-09-12T00:39:23.948+0000 7f5072523640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:24.295 INFO:tasks.workunit.client.0.smithi043.stderr: -412> 2024-09-12T00:39:23.948+0000 7f5073525640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:24.295 INFO:tasks.workunit.client.0.smithi043.stderr: -411> 2024-09-12T00:39:23.948+0000 7f5073525640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:24.295 INFO:tasks.workunit.client.0.smithi043.stderr: -410> 2024-09-12T00:39:23.948+0000 7f5073525640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:24.295 INFO:tasks.workunit.client.0.smithi043.stderr: -409> 2024-09-12T00:39:23.948+0000 7f5072523640 10 monclient(hunting): handle_auth_done global_id 7118 payload 824 2024-09-12T00:39:24.295 INFO:tasks.workunit.client.0.smithi043.stderr: -408> 2024-09-12T00:39:23.948+0000 7f5072523640 10 monclient: _finish_hunting 0 2024-09-12T00:39:24.296 INFO:tasks.workunit.client.0.smithi043.stderr: -407> 2024-09-12T00:39:23.948+0000 7f5072523640 1 monclient: found mon.noname-c 2024-09-12T00:39:24.296 INFO:tasks.workunit.client.0.smithi043.stderr: -406> 2024-09-12T00:39:23.948+0000 7f5072523640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:39:24.296 INFO:tasks.workunit.client.0.smithi043.stderr: -405> 2024-09-12T00:39:23.948+0000 7f4f5f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:24.296 INFO:tasks.workunit.client.0.smithi043.stderr: -404> 2024-09-12T00:39:23.948+0000 7f4f5f606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:39:24.296 INFO:tasks.workunit.client.0.smithi043.stderr: -403> 2024-09-12T00:39:23.948+0000 7f4f5f606640 10 monclient: dump: 2024-09-12T00:39:24.296 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:24.296 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:24.296 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.296 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.296 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:24.296 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:24.297 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:24.297 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:24.297 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:24.297 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.297 INFO:tasks.workunit.client.0.smithi043.stderr: -402> 2024-09-12T00:39:23.948+0000 7f4f5f606640 10 monclient: _finish_auth 0 2024-09-12T00:39:24.297 INFO:tasks.workunit.client.0.smithi043.stderr: -401> 2024-09-12T00:39:23.948+0000 7f4f5f606640 10 monclient: _check_auth_tickets 2024-09-12T00:39:24.297 INFO:tasks.workunit.client.0.smithi043.stderr: -400> 2024-09-12T00:39:23.948+0000 7f4f5f606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:24.297 INFO:tasks.workunit.client.0.smithi043.stderr: -399> 2024-09-12T00:39:23.948+0000 7f4f5f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:24.297 INFO:tasks.workunit.client.0.smithi043.stderr: -398> 2024-09-12T00:39:23.948+0000 7f4f5f606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:39:24.297 INFO:tasks.workunit.client.0.smithi043.stderr: -397> 2024-09-12T00:39:23.948+0000 7f4f5f606640 10 monclient: dump: 2024-09-12T00:39:24.297 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:24.297 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:24.298 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.298 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.298 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:24.298 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:24.298 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:24.298 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:24.298 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:24.298 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.298 INFO:tasks.workunit.client.0.smithi043.stderr: -396> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 monclient: authenticate success, global_id 7118 2024-09-12T00:39:24.298 INFO:tasks.workunit.client.0.smithi043.stderr: -395> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient: _renew_subs 2024-09-12T00:39:24.298 INFO:tasks.workunit.client.0.smithi043.stderr: -394> 2024-09-12T00:39:23.948+0000 7f4f60e09640 4 set_mon_vals no callback set 2024-09-12T00:39:24.298 INFO:tasks.workunit.client.0.smithi043.stderr: -393> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:39:24.298 INFO:tasks.workunit.client.0.smithi043.stderr: -392> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient: _renew_subs 2024-09-12T00:39:24.299 INFO:tasks.workunit.client.0.smithi043.stderr: -391> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:39:24.299 INFO:tasks.workunit.client.0.smithi043.stderr: -390> 2024-09-12T00:39:23.948+0000 7f507521e9c0 1 librados: init done 2024-09-12T00:39:24.299 INFO:tasks.workunit.client.0.smithi043.stderr: -389> 2024-09-12T00:39:23.952+0000 7f4f5f606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:24.299 INFO:tasks.workunit.client.0.smithi043.stderr: -388> 2024-09-12T00:39:23.952+0000 7f4f5f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:39:24.299 INFO:tasks.workunit.client.0.smithi043.stderr: -387> 2024-09-12T00:39:23.952+0000 7f4f5f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:39:24.299 INFO:tasks.workunit.client.0.smithi043.stderr: -386> 2024-09-12T00:39:23.952+0000 7f5072d24640 10 monclient: get_auth_request con 0x7f4f58070b10 auth_method 0 2024-09-12T00:39:24.299 INFO:tasks.workunit.client.0.smithi043.stderr: -385> 2024-09-12T00:39:23.952+0000 7f5073525640 10 monclient: get_auth_request con 0x55f8e7640940 auth_method 0 2024-09-12T00:39:24.299 INFO:tasks.workunit.client.0.smithi043.stderr: -384> 2024-09-12T00:39:23.952+0000 7f5072d24640 10 monclient: get_auth_request con 0x55f8e7658a70 auth_method 0 2024-09-12T00:39:24.299 INFO:tasks.workunit.client.0.smithi043.stderr: -383> 2024-09-12T00:39:23.956+0000 7f5072523640 10 monclient: get_auth_request con 0x55f8e765cdd0 auth_method 0 2024-09-12T00:39:24.299 INFO:tasks.workunit.client.0.smithi043.stderr: -382> 2024-09-12T00:39:23.956+0000 7f507521e9c0 10 monclient: build_initial_monmap 2024-09-12T00:39:24.299 INFO:tasks.workunit.client.0.smithi043.stderr: -381> 2024-09-12T00:39:23.956+0000 7f507521e9c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:24.299 INFO:tasks.workunit.client.0.smithi043.stderr: -380> 2024-09-12T00:39:23.956+0000 7f507521e9c0 10 monclient: monmap: 2024-09-12T00:39:24.300 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:39:24.300 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:24.300 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:39:24.300 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:39:24.300 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:24.300 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:24.300 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:39:24.300 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:39:24.300 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:39:24.300 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.300 INFO:tasks.workunit.client.0.smithi043.stderr: -379> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7661cb0) adding auth protocol: cephx 2024-09-12T00:39:24.300 INFO:tasks.workunit.client.0.smithi043.stderr: -378> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7661cb0) adding auth protocol: cephx 2024-09-12T00:39:24.301 INFO:tasks.workunit.client.0.smithi043.stderr: -377> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7661cb0) adding auth protocol: cephx 2024-09-12T00:39:24.301 INFO:tasks.workunit.client.0.smithi043.stderr: -376> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7661cb0) adding con mode: secure 2024-09-12T00:39:24.301 INFO:tasks.workunit.client.0.smithi043.stderr: -375> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7661cb0) adding con mode: crc 2024-09-12T00:39:24.301 INFO:tasks.workunit.client.0.smithi043.stderr: -374> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7661cb0) adding con mode: secure 2024-09-12T00:39:24.301 INFO:tasks.workunit.client.0.smithi043.stderr: -373> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7661cb0) adding con mode: crc 2024-09-12T00:39:24.301 INFO:tasks.workunit.client.0.smithi043.stderr: -372> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7661cb0) adding con mode: secure 2024-09-12T00:39:24.301 INFO:tasks.workunit.client.0.smithi043.stderr: -371> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7661cb0) adding con mode: crc 2024-09-12T00:39:24.301 INFO:tasks.workunit.client.0.smithi043.stderr: -370> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7661cb0) adding con mode: crc 2024-09-12T00:39:24.301 INFO:tasks.workunit.client.0.smithi043.stderr: -369> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7661cb0) adding con mode: secure 2024-09-12T00:39:24.301 INFO:tasks.workunit.client.0.smithi043.stderr: -368> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7661cb0) adding con mode: crc 2024-09-12T00:39:24.302 INFO:tasks.workunit.client.0.smithi043.stderr: -367> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7661cb0) adding con mode: secure 2024-09-12T00:39:24.302 INFO:tasks.workunit.client.0.smithi043.stderr: -366> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7661cb0) adding con mode: crc 2024-09-12T00:39:24.302 INFO:tasks.workunit.client.0.smithi043.stderr: -365> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7661cb0) adding con mode: secure 2024-09-12T00:39:24.302 INFO:tasks.workunit.client.0.smithi043.stderr: -364> 2024-09-12T00:39:23.956+0000 7f507521e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:24.302 INFO:tasks.workunit.client.0.smithi043.stderr: -363> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command objecter_requests cmddesc objecter_requests hook 0x55f8e7665600 EEXIST 2024-09-12T00:39:24.302 INFO:tasks.workunit.client.0.smithi043.stderr: -362> 2024-09-12T00:39:23.956+0000 7f507521e9c0 10 monclient: init 2024-09-12T00:39:24.302 INFO:tasks.workunit.client.0.smithi043.stderr: -361> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7660278) adding auth protocol: cephx 2024-09-12T00:39:24.302 INFO:tasks.workunit.client.0.smithi043.stderr: -360> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7660278) adding auth protocol: cephx 2024-09-12T00:39:24.302 INFO:tasks.workunit.client.0.smithi043.stderr: -359> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7660278) adding auth protocol: cephx 2024-09-12T00:39:24.302 INFO:tasks.workunit.client.0.smithi043.stderr: -358> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7660278) adding con mode: secure 2024-09-12T00:39:24.302 INFO:tasks.workunit.client.0.smithi043.stderr: -357> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7660278) adding con mode: crc 2024-09-12T00:39:24.302 INFO:tasks.workunit.client.0.smithi043.stderr: -356> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7660278) adding con mode: secure 2024-09-12T00:39:24.303 INFO:tasks.workunit.client.0.smithi043.stderr: -355> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7660278) adding con mode: crc 2024-09-12T00:39:24.303 INFO:tasks.workunit.client.0.smithi043.stderr: -354> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7660278) adding con mode: secure 2024-09-12T00:39:24.303 INFO:tasks.workunit.client.0.smithi043.stderr: -353> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7660278) adding con mode: crc 2024-09-12T00:39:24.303 INFO:tasks.workunit.client.0.smithi043.stderr: -352> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7660278) adding con mode: crc 2024-09-12T00:39:24.303 INFO:tasks.workunit.client.0.smithi043.stderr: -351> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7660278) adding con mode: secure 2024-09-12T00:39:24.303 INFO:tasks.workunit.client.0.smithi043.stderr: -350> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7660278) adding con mode: crc 2024-09-12T00:39:24.303 INFO:tasks.workunit.client.0.smithi043.stderr: -349> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7660278) adding con mode: secure 2024-09-12T00:39:24.303 INFO:tasks.workunit.client.0.smithi043.stderr: -348> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7660278) adding con mode: crc 2024-09-12T00:39:24.303 INFO:tasks.workunit.client.0.smithi043.stderr: -347> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7660278) adding con mode: secure 2024-09-12T00:39:24.303 INFO:tasks.workunit.client.0.smithi043.stderr: -346> 2024-09-12T00:39:23.956+0000 7f507521e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:24.303 INFO:tasks.workunit.client.0.smithi043.stderr: -345> 2024-09-12T00:39:23.956+0000 7f507521e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:24.303 INFO:tasks.workunit.client.0.smithi043.stderr: -344> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command rotate-key cmddesc rotate-key hook 0x55f8e76603c0 EEXIST 2024-09-12T00:39:24.303 INFO:tasks.workunit.client.0.smithi043.stderr: -343> 2024-09-12T00:39:23.956+0000 7f507521e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:24.304 INFO:tasks.workunit.client.0.smithi043.stderr: -342> 2024-09-12T00:39:23.956+0000 7f507521e9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:39:24.304 INFO:tasks.workunit.client.0.smithi043.stderr: -341> 2024-09-12T00:39:23.956+0000 7f507521e9c0 10 monclient(hunting): picked mon.noname-a con 0x55f8e76897b0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:39:24.304 INFO:tasks.workunit.client.0.smithi043.stderr: -340> 2024-09-12T00:39:23.956+0000 7f507521e9c0 10 monclient(hunting): picked mon.noname-c con 0x55f8e76890e0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:39:24.304 INFO:tasks.workunit.client.0.smithi043.stderr: -339> 2024-09-12T00:39:23.956+0000 7f507521e9c0 10 monclient(hunting): picked mon.noname-b con 0x55f8e7687ac0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:39:24.304 INFO:tasks.workunit.client.0.smithi043.stderr: -338> 2024-09-12T00:39:23.956+0000 7f507521e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:24.304 INFO:tasks.workunit.client.0.smithi043.stderr: -337> 2024-09-12T00:39:23.956+0000 7f507521e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:24.304 INFO:tasks.workunit.client.0.smithi043.stderr: -336> 2024-09-12T00:39:23.956+0000 7f507521e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:24.304 INFO:tasks.workunit.client.0.smithi043.stderr: -335> 2024-09-12T00:39:23.956+0000 7f507521e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:24.304 INFO:tasks.workunit.client.0.smithi043.stderr: -334> 2024-09-12T00:39:23.956+0000 7f507521e9c0 10 monclient(hunting): authenticate will time out at 2259.947654s 2024-09-12T00:39:24.304 INFO:tasks.workunit.client.0.smithi043.stderr: -333> 2024-09-12T00:39:23.956+0000 7f5072523640 10 monclient(hunting): get_auth_request con 0x55f8e76890e0 auth_method 0 2024-09-12T00:39:24.304 INFO:tasks.workunit.client.0.smithi043.stderr: -332> 2024-09-12T00:39:23.956+0000 7f5072523640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:24.304 INFO:tasks.workunit.client.0.smithi043.stderr: -331> 2024-09-12T00:39:23.956+0000 7f5072523640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:24.305 INFO:tasks.workunit.client.0.smithi043.stderr: -330> 2024-09-12T00:39:23.956+0000 7f5072523640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:24.305 INFO:tasks.workunit.client.0.smithi043.stderr: -329> 2024-09-12T00:39:23.956+0000 7f5072d24640 10 monclient(hunting): get_auth_request con 0x55f8e76897b0 auth_method 0 2024-09-12T00:39:24.305 INFO:tasks.workunit.client.0.smithi043.stderr: -328> 2024-09-12T00:39:23.956+0000 7f5072d24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:24.305 INFO:tasks.workunit.client.0.smithi043.stderr: -327> 2024-09-12T00:39:23.956+0000 7f5072d24640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:24.305 INFO:tasks.workunit.client.0.smithi043.stderr: -326> 2024-09-12T00:39:23.956+0000 7f5072d24640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:24.305 INFO:tasks.workunit.client.0.smithi043.stderr: -325> 2024-09-12T00:39:23.956+0000 7f5072523640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:24.305 INFO:tasks.workunit.client.0.smithi043.stderr: -324> 2024-09-12T00:39:23.956+0000 7f5072523640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:24.305 INFO:tasks.workunit.client.0.smithi043.stderr: -323> 2024-09-12T00:39:23.956+0000 7f5072523640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:24.305 INFO:tasks.workunit.client.0.smithi043.stderr: -322> 2024-09-12T00:39:23.956+0000 7f5072d24640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:24.305 INFO:tasks.workunit.client.0.smithi043.stderr: -321> 2024-09-12T00:39:23.956+0000 7f5072d24640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:24.305 INFO:tasks.workunit.client.0.smithi043.stderr: -320> 2024-09-12T00:39:23.956+0000 7f5072d24640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:24.305 INFO:tasks.workunit.client.0.smithi043.stderr: -319> 2024-09-12T00:39:23.960+0000 7f5072523640 10 monclient(hunting): handle_auth_done global_id 7121 payload 824 2024-09-12T00:39:24.305 INFO:tasks.workunit.client.0.smithi043.stderr: -318> 2024-09-12T00:39:23.960+0000 7f5072523640 10 monclient: _finish_hunting 0 2024-09-12T00:39:24.306 INFO:tasks.workunit.client.0.smithi043.stderr: -317> 2024-09-12T00:39:23.960+0000 7f5072523640 1 monclient: found mon.noname-c 2024-09-12T00:39:24.306 INFO:tasks.workunit.client.0.smithi043.stderr: -316> 2024-09-12T00:39:23.960+0000 7f5072523640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:39:24.306 INFO:tasks.workunit.client.0.smithi043.stderr: -315> 2024-09-12T00:39:23.960+0000 7f4f5ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:24.306 INFO:tasks.workunit.client.0.smithi043.stderr: -314> 2024-09-12T00:39:23.960+0000 7f4f5ce01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:39:24.306 INFO:tasks.workunit.client.0.smithi043.stderr: -313> 2024-09-12T00:39:23.960+0000 7f4f5ce01640 10 monclient: dump: 2024-09-12T00:39:24.306 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:24.306 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:24.306 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.306 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.306 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:24.307 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:24.307 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:24.307 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:24.307 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:24.307 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.307 INFO:tasks.workunit.client.0.smithi043.stderr: -312> 2024-09-12T00:39:23.960+0000 7f4f5ce01640 10 monclient: _finish_auth 0 2024-09-12T00:39:24.307 INFO:tasks.workunit.client.0.smithi043.stderr: -311> 2024-09-12T00:39:23.960+0000 7f4f5ce01640 10 monclient: _check_auth_tickets 2024-09-12T00:39:24.307 INFO:tasks.workunit.client.0.smithi043.stderr: -310> 2024-09-12T00:39:23.960+0000 7f4f5ce01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:24.307 INFO:tasks.workunit.client.0.smithi043.stderr: -309> 2024-09-12T00:39:23.960+0000 7f4f5ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:24.307 INFO:tasks.workunit.client.0.smithi043.stderr: -308> 2024-09-12T00:39:23.960+0000 7f4f5ce01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:39:24.308 INFO:tasks.workunit.client.0.smithi043.stderr: -307> 2024-09-12T00:39:23.960+0000 7f4f5ce01640 10 monclient: dump: 2024-09-12T00:39:24.308 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:24.308 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:24.308 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.308 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.308 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:24.308 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:24.308 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:24.308 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:24.308 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:24.308 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.309 INFO:tasks.workunit.client.0.smithi043.stderr: -306> 2024-09-12T00:39:23.960+0000 7f5073d26640 4 set_mon_vals no callback set 2024-09-12T00:39:24.309 INFO:tasks.workunit.client.0.smithi043.stderr: -305> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 monclient: authenticate success, global_id 7121 2024-09-12T00:39:24.309 INFO:tasks.workunit.client.0.smithi043.stderr: -304> 2024-09-12T00:39:23.960+0000 7f507521e9c0 10 monclient: _renew_subs 2024-09-12T00:39:24.309 INFO:tasks.workunit.client.0.smithi043.stderr: -303> 2024-09-12T00:39:23.960+0000 7f507521e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:39:24.309 INFO:tasks.workunit.client.0.smithi043.stderr: -302> 2024-09-12T00:39:23.960+0000 7f507521e9c0 10 monclient: _renew_subs 2024-09-12T00:39:24.309 INFO:tasks.workunit.client.0.smithi043.stderr: -301> 2024-09-12T00:39:23.960+0000 7f507521e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:39:24.309 INFO:tasks.workunit.client.0.smithi043.stderr: -300> 2024-09-12T00:39:23.960+0000 7f4f5ce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:24.309 INFO:tasks.workunit.client.0.smithi043.stderr: -299> 2024-09-12T00:39:23.960+0000 7f4f5ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:39:24.309 INFO:tasks.workunit.client.0.smithi043.stderr: -298> 2024-09-12T00:39:23.960+0000 7f4f5ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:39:24.309 INFO:tasks.workunit.client.0.smithi043.stderr: -297> 2024-09-12T00:39:23.960+0000 7f5072d24640 10 monclient: get_auth_request con 0x7f4f4c070a20 auth_method 0 2024-09-12T00:39:24.309 INFO:tasks.workunit.client.0.smithi043.stderr: -296> 2024-09-12T00:39:23.960+0000 7f507521e9c0 10 monclient: get_monmap_and_config 2024-09-12T00:39:24.309 INFO:tasks.workunit.client.0.smithi043.stderr: -295> 2024-09-12T00:39:23.960+0000 7f507521e9c0 10 monclient: build_initial_monmap 2024-09-12T00:39:24.310 INFO:tasks.workunit.client.0.smithi043.stderr: -294> 2024-09-12T00:39:23.960+0000 7f507521e9c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:24.310 INFO:tasks.workunit.client.0.smithi043.stderr: -293> 2024-09-12T00:39:23.960+0000 7f507521e9c0 10 monclient: monmap: 2024-09-12T00:39:24.310 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:39:24.310 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:24.310 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:39:24.310 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:39:24.310 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:24.310 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:24.310 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:39:24.310 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:39:24.310 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:39:24.310 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.311 INFO:tasks.workunit.client.0.smithi043.stderr: -292> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76a8cc0) adding auth protocol: cephx 2024-09-12T00:39:24.311 INFO:tasks.workunit.client.0.smithi043.stderr: -291> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76a8cc0) adding auth protocol: cephx 2024-09-12T00:39:24.311 INFO:tasks.workunit.client.0.smithi043.stderr: -290> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76a8cc0) adding auth protocol: cephx 2024-09-12T00:39:24.311 INFO:tasks.workunit.client.0.smithi043.stderr: -289> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76a8cc0) adding con mode: secure 2024-09-12T00:39:24.311 INFO:tasks.workunit.client.0.smithi043.stderr: -288> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76a8cc0) adding con mode: crc 2024-09-12T00:39:24.311 INFO:tasks.workunit.client.0.smithi043.stderr: -287> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76a8cc0) adding con mode: secure 2024-09-12T00:39:24.311 INFO:tasks.workunit.client.0.smithi043.stderr: -286> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76a8cc0) adding con mode: crc 2024-09-12T00:39:24.311 INFO:tasks.workunit.client.0.smithi043.stderr: -285> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76a8cc0) adding con mode: secure 2024-09-12T00:39:24.311 INFO:tasks.workunit.client.0.smithi043.stderr: -284> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76a8cc0) adding con mode: crc 2024-09-12T00:39:24.311 INFO:tasks.workunit.client.0.smithi043.stderr: -283> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76a8cc0) adding con mode: crc 2024-09-12T00:39:24.311 INFO:tasks.workunit.client.0.smithi043.stderr: -282> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76a8cc0) adding con mode: secure 2024-09-12T00:39:24.311 INFO:tasks.workunit.client.0.smithi043.stderr: -281> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76a8cc0) adding con mode: crc 2024-09-12T00:39:24.312 INFO:tasks.workunit.client.0.smithi043.stderr: -280> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76a8cc0) adding con mode: secure 2024-09-12T00:39:24.312 INFO:tasks.workunit.client.0.smithi043.stderr: -279> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76a8cc0) adding con mode: crc 2024-09-12T00:39:24.312 INFO:tasks.workunit.client.0.smithi043.stderr: -278> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76a8cc0) adding con mode: secure 2024-09-12T00:39:24.312 INFO:tasks.workunit.client.0.smithi043.stderr: -277> 2024-09-12T00:39:23.960+0000 7f507521e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:24.312 INFO:tasks.workunit.client.0.smithi043.stderr: -276> 2024-09-12T00:39:23.960+0000 7f507521e9c0 10 monclient: init 2024-09-12T00:39:24.312 INFO:tasks.workunit.client.0.smithi043.stderr: -275> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c440) adding auth protocol: cephx 2024-09-12T00:39:24.312 INFO:tasks.workunit.client.0.smithi043.stderr: -274> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c440) adding auth protocol: cephx 2024-09-12T00:39:24.312 INFO:tasks.workunit.client.0.smithi043.stderr: -273> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c440) adding auth protocol: cephx 2024-09-12T00:39:24.312 INFO:tasks.workunit.client.0.smithi043.stderr: -272> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c440) adding con mode: secure 2024-09-12T00:39:24.312 INFO:tasks.workunit.client.0.smithi043.stderr: -271> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c440) adding con mode: crc 2024-09-12T00:39:24.312 INFO:tasks.workunit.client.0.smithi043.stderr: -270> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c440) adding con mode: secure 2024-09-12T00:39:24.312 INFO:tasks.workunit.client.0.smithi043.stderr: -269> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c440) adding con mode: crc 2024-09-12T00:39:24.312 INFO:tasks.workunit.client.0.smithi043.stderr: -268> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c440) adding con mode: secure 2024-09-12T00:39:24.312 INFO:tasks.workunit.client.0.smithi043.stderr: -267> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c440) adding con mode: crc 2024-09-12T00:39:24.313 INFO:tasks.workunit.client.0.smithi043.stderr: -266> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c440) adding con mode: crc 2024-09-12T00:39:24.313 INFO:tasks.workunit.client.0.smithi043.stderr: -265> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c440) adding con mode: secure 2024-09-12T00:39:24.313 INFO:tasks.workunit.client.0.smithi043.stderr: -264> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c440) adding con mode: crc 2024-09-12T00:39:24.313 INFO:tasks.workunit.client.0.smithi043.stderr: -263> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c440) adding con mode: secure 2024-09-12T00:39:24.313 INFO:tasks.workunit.client.0.smithi043.stderr: -262> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c440) adding con mode: crc 2024-09-12T00:39:24.313 INFO:tasks.workunit.client.0.smithi043.stderr: -261> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c440) adding con mode: secure 2024-09-12T00:39:24.313 INFO:tasks.workunit.client.0.smithi043.stderr: -260> 2024-09-12T00:39:23.960+0000 7f507521e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:24.313 INFO:tasks.workunit.client.0.smithi043.stderr: -259> 2024-09-12T00:39:23.964+0000 7f507521e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:24.313 INFO:tasks.workunit.client.0.smithi043.stderr: -258> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe7391c588 EEXIST 2024-09-12T00:39:24.313 INFO:tasks.workunit.client.0.smithi043.stderr: -257> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:24.313 INFO:tasks.workunit.client.0.smithi043.stderr: -256> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:39:24.313 INFO:tasks.workunit.client.0.smithi043.stderr: -255> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): picked mon.noname-c con 0x55f8e76d72d0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:39:24.314 INFO:tasks.workunit.client.0.smithi043.stderr: -254> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): picked mon.noname-a con 0x55f8e76d76b0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:39:24.314 INFO:tasks.workunit.client.0.smithi043.stderr: -253> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): picked mon.noname-b con 0x55f8e76d8b70 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:39:24.314 INFO:tasks.workunit.client.0.smithi043.stderr: -252> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:24.314 INFO:tasks.workunit.client.0.smithi043.stderr: -251> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:24.314 INFO:tasks.workunit.client.0.smithi043.stderr: -250> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:24.314 INFO:tasks.workunit.client.0.smithi043.stderr: -249> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:24.314 INFO:tasks.workunit.client.0.smithi043.stderr: -248> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): authenticate will time out at 2259.952304s 2024-09-12T00:39:24.314 INFO:tasks.workunit.client.0.smithi043.stderr: -247> 2024-09-12T00:39:23.964+0000 7f5072d24640 10 monclient(hunting): get_auth_request con 0x55f8e76d72d0 auth_method 0 2024-09-12T00:39:24.314 INFO:tasks.workunit.client.0.smithi043.stderr: -246> 2024-09-12T00:39:23.964+0000 7f5072d24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:24.314 INFO:tasks.workunit.client.0.smithi043.stderr: -245> 2024-09-12T00:39:23.964+0000 7f5072d24640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:24.314 INFO:tasks.workunit.client.0.smithi043.stderr: -244> 2024-09-12T00:39:23.964+0000 7f5072d24640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:24.314 INFO:tasks.workunit.client.0.smithi043.stderr: -243> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient(hunting): get_auth_request con 0x55f8e76d76b0 auth_method 0 2024-09-12T00:39:24.314 INFO:tasks.workunit.client.0.smithi043.stderr: -242> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:24.315 INFO:tasks.workunit.client.0.smithi043.stderr: -241> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:24.315 INFO:tasks.workunit.client.0.smithi043.stderr: -240> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:24.315 INFO:tasks.workunit.client.0.smithi043.stderr: -239> 2024-09-12T00:39:23.964+0000 7f5072d24640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:24.315 INFO:tasks.workunit.client.0.smithi043.stderr: -238> 2024-09-12T00:39:23.964+0000 7f5072d24640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:24.315 INFO:tasks.workunit.client.0.smithi043.stderr: -237> 2024-09-12T00:39:23.964+0000 7f5072d24640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:24.315 INFO:tasks.workunit.client.0.smithi043.stderr: -236> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:24.315 INFO:tasks.workunit.client.0.smithi043.stderr: -235> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:24.315 INFO:tasks.workunit.client.0.smithi043.stderr: -234> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:24.315 INFO:tasks.workunit.client.0.smithi043.stderr: -233> 2024-09-12T00:39:23.964+0000 7f5072d24640 10 monclient(hunting): handle_auth_done global_id 7124 payload 274 2024-09-12T00:39:24.315 INFO:tasks.workunit.client.0.smithi043.stderr: -232> 2024-09-12T00:39:23.964+0000 7f5072d24640 10 monclient: _finish_hunting 0 2024-09-12T00:39:24.315 INFO:tasks.workunit.client.0.smithi043.stderr: -231> 2024-09-12T00:39:23.964+0000 7f5072d24640 1 monclient: found mon.noname-c 2024-09-12T00:39:24.315 INFO:tasks.workunit.client.0.smithi043.stderr: -230> 2024-09-12T00:39:23.964+0000 7f5072d24640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:39:24.315 INFO:tasks.workunit.client.0.smithi043.stderr: -229> 2024-09-12T00:39:23.964+0000 7f4f567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:24.316 INFO:tasks.workunit.client.0.smithi043.stderr: -228> 2024-09-12T00:39:23.964+0000 7f4f567fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:39:24.316 INFO:tasks.workunit.client.0.smithi043.stderr: -227> 2024-09-12T00:39:23.964+0000 7f4f567fc640 10 monclient: dump: 2024-09-12T00:39:24.316 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:24.316 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:24.316 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.316 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.316 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:24.316 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:24.316 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:24.316 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:24.316 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:24.316 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.317 INFO:tasks.workunit.client.0.smithi043.stderr: -226> 2024-09-12T00:39:23.964+0000 7f4f567fc640 10 monclient: _finish_auth 0 2024-09-12T00:39:24.317 INFO:tasks.workunit.client.0.smithi043.stderr: -225> 2024-09-12T00:39:23.964+0000 7f4f567fc640 10 monclient: _check_auth_tickets 2024-09-12T00:39:24.317 INFO:tasks.workunit.client.0.smithi043.stderr: -224> 2024-09-12T00:39:23.964+0000 7f4f567fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:24.317 INFO:tasks.workunit.client.0.smithi043.stderr: -223> 2024-09-12T00:39:23.964+0000 7f4f567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:24.317 INFO:tasks.workunit.client.0.smithi043.stderr: -222> 2024-09-12T00:39:23.964+0000 7f4f567fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:39:24.317 INFO:tasks.workunit.client.0.smithi043.stderr: -221> 2024-09-12T00:39:23.964+0000 7f4f567fc640 10 monclient: dump: 2024-09-12T00:39:24.317 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:24.317 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:24.317 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.317 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.317 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:24.317 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:24.317 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:24.318 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:24.318 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:24.318 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.318 INFO:tasks.workunit.client.0.smithi043.stderr: -220> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 monclient: authenticate success, global_id 7124 2024-09-12T00:39:24.318 INFO:tasks.workunit.client.0.smithi043.stderr: -219> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:39:24.318 INFO:tasks.workunit.client.0.smithi043.stderr: -218> 2024-09-12T00:39:23.964+0000 7f507521e9c0 4 set_mon_vals no callback set 2024-09-12T00:39:24.318 INFO:tasks.workunit.client.0.smithi043.stderr: -217> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient: shutdown 2024-09-12T00:39:24.318 INFO:tasks.workunit.client.0.smithi043.stderr: -216> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient: build_initial_monmap 2024-09-12T00:39:24.318 INFO:tasks.workunit.client.0.smithi043.stderr: -215> 2024-09-12T00:39:23.964+0000 7f507521e9c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:24.318 INFO:tasks.workunit.client.0.smithi043.stderr: -214> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient: monmap: 2024-09-12T00:39:24.318 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:39:24.318 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:24.319 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:39:24.319 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:39:24.319 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:24.319 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:24.319 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:39:24.319 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:39:24.319 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:39:24.319 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.319 INFO:tasks.workunit.client.0.smithi043.stderr: -213> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76cf7f0) adding auth protocol: cephx 2024-09-12T00:39:24.319 INFO:tasks.workunit.client.0.smithi043.stderr: -212> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76cf7f0) adding auth protocol: cephx 2024-09-12T00:39:24.319 INFO:tasks.workunit.client.0.smithi043.stderr: -211> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76cf7f0) adding auth protocol: cephx 2024-09-12T00:39:24.319 INFO:tasks.workunit.client.0.smithi043.stderr: -210> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76cf7f0) adding con mode: secure 2024-09-12T00:39:24.320 INFO:tasks.workunit.client.0.smithi043.stderr: -209> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76cf7f0) adding con mode: crc 2024-09-12T00:39:24.320 INFO:tasks.workunit.client.0.smithi043.stderr: -208> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76cf7f0) adding con mode: secure 2024-09-12T00:39:24.320 INFO:tasks.workunit.client.0.smithi043.stderr: -207> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76cf7f0) adding con mode: crc 2024-09-12T00:39:24.320 INFO:tasks.workunit.client.0.smithi043.stderr: -206> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76cf7f0) adding con mode: secure 2024-09-12T00:39:24.320 INFO:tasks.workunit.client.0.smithi043.stderr: -205> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76cf7f0) adding con mode: crc 2024-09-12T00:39:24.320 INFO:tasks.workunit.client.0.smithi043.stderr: -204> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76cf7f0) adding con mode: crc 2024-09-12T00:39:24.320 INFO:tasks.workunit.client.0.smithi043.stderr: -203> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76cf7f0) adding con mode: secure 2024-09-12T00:39:24.320 INFO:tasks.workunit.client.0.smithi043.stderr: -202> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76cf7f0) adding con mode: crc 2024-09-12T00:39:24.320 INFO:tasks.workunit.client.0.smithi043.stderr: -201> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76cf7f0) adding con mode: secure 2024-09-12T00:39:24.320 INFO:tasks.workunit.client.0.smithi043.stderr: -200> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76cf7f0) adding con mode: crc 2024-09-12T00:39:24.320 INFO:tasks.workunit.client.0.smithi043.stderr: -199> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76cf7f0) adding con mode: secure 2024-09-12T00:39:24.320 INFO:tasks.workunit.client.0.smithi043.stderr: -198> 2024-09-12T00:39:23.964+0000 7f507521e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:24.320 INFO:tasks.workunit.client.0.smithi043.stderr: -197> 2024-09-12T00:39:23.964+0000 7f507521e9c0 1 librados: starting msgr at 2024-09-12T00:39:24.321 INFO:tasks.workunit.client.0.smithi043.stderr: -196> 2024-09-12T00:39:23.964+0000 7f507521e9c0 1 librados: starting objecter 2024-09-12T00:39:24.321 INFO:tasks.workunit.client.0.smithi043.stderr: -195> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command objecter_requests cmddesc objecter_requests hook 0x55f8e76ce900 EEXIST 2024-09-12T00:39:24.321 INFO:tasks.workunit.client.0.smithi043.stderr: -194> 2024-09-12T00:39:23.964+0000 7f507521e9c0 1 librados: setting wanted keys 2024-09-12T00:39:24.321 INFO:tasks.workunit.client.0.smithi043.stderr: -193> 2024-09-12T00:39:23.964+0000 7f507521e9c0 1 librados: calling monclient init 2024-09-12T00:39:24.321 INFO:tasks.workunit.client.0.smithi043.stderr: -192> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient: init 2024-09-12T00:39:24.321 INFO:tasks.workunit.client.0.smithi043.stderr: -191> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e768b5d0) adding auth protocol: cephx 2024-09-12T00:39:24.321 INFO:tasks.workunit.client.0.smithi043.stderr: -190> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e768b5d0) adding auth protocol: cephx 2024-09-12T00:39:24.321 INFO:tasks.workunit.client.0.smithi043.stderr: -189> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e768b5d0) adding auth protocol: cephx 2024-09-12T00:39:24.321 INFO:tasks.workunit.client.0.smithi043.stderr: -188> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e768b5d0) adding con mode: secure 2024-09-12T00:39:24.321 INFO:tasks.workunit.client.0.smithi043.stderr: -187> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e768b5d0) adding con mode: crc 2024-09-12T00:39:24.321 INFO:tasks.workunit.client.0.smithi043.stderr: -186> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e768b5d0) adding con mode: secure 2024-09-12T00:39:24.321 INFO:tasks.workunit.client.0.smithi043.stderr: -185> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e768b5d0) adding con mode: crc 2024-09-12T00:39:24.321 INFO:tasks.workunit.client.0.smithi043.stderr: -184> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e768b5d0) adding con mode: secure 2024-09-12T00:39:24.322 INFO:tasks.workunit.client.0.smithi043.stderr: -183> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e768b5d0) adding con mode: crc 2024-09-12T00:39:24.322 INFO:tasks.workunit.client.0.smithi043.stderr: -182> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e768b5d0) adding con mode: crc 2024-09-12T00:39:24.322 INFO:tasks.workunit.client.0.smithi043.stderr: -181> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e768b5d0) adding con mode: secure 2024-09-12T00:39:24.322 INFO:tasks.workunit.client.0.smithi043.stderr: -180> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e768b5d0) adding con mode: crc 2024-09-12T00:39:24.322 INFO:tasks.workunit.client.0.smithi043.stderr: -179> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e768b5d0) adding con mode: secure 2024-09-12T00:39:24.322 INFO:tasks.workunit.client.0.smithi043.stderr: -178> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e768b5d0) adding con mode: crc 2024-09-12T00:39:24.322 INFO:tasks.workunit.client.0.smithi043.stderr: -177> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e768b5d0) adding con mode: secure 2024-09-12T00:39:24.322 INFO:tasks.workunit.client.0.smithi043.stderr: -176> 2024-09-12T00:39:23.964+0000 7f507521e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:24.322 INFO:tasks.workunit.client.0.smithi043.stderr: -175> 2024-09-12T00:39:23.964+0000 7f507521e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:24.322 INFO:tasks.workunit.client.0.smithi043.stderr: -174> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command rotate-key cmddesc rotate-key hook 0x55f8e768b718 EEXIST 2024-09-12T00:39:24.322 INFO:tasks.workunit.client.0.smithi043.stderr: -173> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:24.322 INFO:tasks.workunit.client.0.smithi043.stderr: -172> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:39:24.322 INFO:tasks.workunit.client.0.smithi043.stderr: -171> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): picked mon.noname-b con 0x55f8e76d72d0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:39:24.323 INFO:tasks.workunit.client.0.smithi043.stderr: -170> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): picked mon.noname-a con 0x55f8e76d8b70 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:39:24.323 INFO:tasks.workunit.client.0.smithi043.stderr: -169> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): picked mon.noname-c con 0x55f8e76d6600 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:39:24.323 INFO:tasks.workunit.client.0.smithi043.stderr: -168> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:24.323 INFO:tasks.workunit.client.0.smithi043.stderr: -167> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:24.323 INFO:tasks.workunit.client.0.smithi043.stderr: -166> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:24.323 INFO:tasks.workunit.client.0.smithi043.stderr: -165> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:24.323 INFO:tasks.workunit.client.0.smithi043.stderr: -164> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): authenticate will time out at 2259.954992s 2024-09-12T00:39:24.323 INFO:tasks.workunit.client.0.smithi043.stderr: -163> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient(hunting): get_auth_request con 0x55f8e76d8b70 auth_method 0 2024-09-12T00:39:24.323 INFO:tasks.workunit.client.0.smithi043.stderr: -162> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:24.323 INFO:tasks.workunit.client.0.smithi043.stderr: -161> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:24.323 INFO:tasks.workunit.client.0.smithi043.stderr: -160> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:24.323 INFO:tasks.workunit.client.0.smithi043.stderr: -159> 2024-09-12T00:39:23.964+0000 7f5073525640 10 monclient(hunting): get_auth_request con 0x55f8e76d6600 auth_method 0 2024-09-12T00:39:24.323 INFO:tasks.workunit.client.0.smithi043.stderr: -158> 2024-09-12T00:39:23.964+0000 7f5073525640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:24.324 INFO:tasks.workunit.client.0.smithi043.stderr: -157> 2024-09-12T00:39:23.964+0000 7f5073525640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:24.324 INFO:tasks.workunit.client.0.smithi043.stderr: -156> 2024-09-12T00:39:23.964+0000 7f5073525640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:24.324 INFO:tasks.workunit.client.0.smithi043.stderr: -155> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:24.324 INFO:tasks.workunit.client.0.smithi043.stderr: -154> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:24.324 INFO:tasks.workunit.client.0.smithi043.stderr: -153> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:24.324 INFO:tasks.workunit.client.0.smithi043.stderr: -152> 2024-09-12T00:39:23.964+0000 7f5073525640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:24.324 INFO:tasks.workunit.client.0.smithi043.stderr: -151> 2024-09-12T00:39:23.964+0000 7f5073525640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:24.324 INFO:tasks.workunit.client.0.smithi043.stderr: -150> 2024-09-12T00:39:23.964+0000 7f5073525640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:24.324 INFO:tasks.workunit.client.0.smithi043.stderr: -149> 2024-09-12T00:39:23.964+0000 7f5072d24640 10 monclient(hunting): get_auth_request con 0x55f8e76d72d0 auth_method 0 2024-09-12T00:39:24.324 INFO:tasks.workunit.client.0.smithi043.stderr: -148> 2024-09-12T00:39:23.964+0000 7f5072d24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:24.324 INFO:tasks.workunit.client.0.smithi043.stderr: -147> 2024-09-12T00:39:23.964+0000 7f5072d24640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:24.325 INFO:tasks.workunit.client.0.smithi043.stderr: -146> 2024-09-12T00:39:23.964+0000 7f5072d24640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:24.325 INFO:tasks.workunit.client.0.smithi043.stderr: -145> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient(hunting): handle_auth_done global_id 7449 payload 824 2024-09-12T00:39:24.325 INFO:tasks.workunit.client.0.smithi043.stderr: -144> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient: _finish_hunting 0 2024-09-12T00:39:24.325 INFO:tasks.workunit.client.0.smithi043.stderr: -143> 2024-09-12T00:39:23.964+0000 7f5072523640 1 monclient: found mon.noname-a 2024-09-12T00:39:24.325 INFO:tasks.workunit.client.0.smithi043.stderr: -142> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:39:24.325 INFO:tasks.workunit.client.0.smithi043.stderr: -141> 2024-09-12T00:39:23.964+0000 7f4f54ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:24.325 INFO:tasks.workunit.client.0.smithi043.stderr: -140> 2024-09-12T00:39:23.964+0000 7f4f54ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:39:24.325 INFO:tasks.workunit.client.0.smithi043.stderr: -139> 2024-09-12T00:39:23.964+0000 7f4f54ff9640 10 monclient: dump: 2024-09-12T00:39:24.325 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:24.325 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:24.325 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.325 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.326 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:24.326 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:24.326 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:24.326 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:24.326 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:24.326 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.326 INFO:tasks.workunit.client.0.smithi043.stderr: -138> 2024-09-12T00:39:23.964+0000 7f4f54ff9640 10 monclient: _finish_auth 0 2024-09-12T00:39:24.326 INFO:tasks.workunit.client.0.smithi043.stderr: -137> 2024-09-12T00:39:23.964+0000 7f4f54ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:39:24.326 INFO:tasks.workunit.client.0.smithi043.stderr: -136> 2024-09-12T00:39:23.964+0000 7f4f54ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:24.326 INFO:tasks.workunit.client.0.smithi043.stderr: -135> 2024-09-12T00:39:23.964+0000 7f4f54ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:24.326 INFO:tasks.workunit.client.0.smithi043.stderr: -134> 2024-09-12T00:39:23.964+0000 7f4f54ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:24.327 INFO:tasks.workunit.client.0.smithi043.stderr: -133> 2024-09-12T00:39:23.964+0000 7f4f54ff9640 10 monclient: dump: 2024-09-12T00:39:24.327 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:24.327 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:24.327 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.327 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.327 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:24.327 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:24.327 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:24.327 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:24.328 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:24.328 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.328 INFO:tasks.workunit.client.0.smithi043.stderr: -132> 2024-09-12T00:39:23.964+0000 7f4f567fc640 4 set_mon_vals no callback set 2024-09-12T00:39:24.328 INFO:tasks.workunit.client.0.smithi043.stderr: -131> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 monclient: authenticate success, global_id 7449 2024-09-12T00:39:24.328 INFO:tasks.workunit.client.0.smithi043.stderr: -130> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient: _renew_subs 2024-09-12T00:39:24.328 INFO:tasks.workunit.client.0.smithi043.stderr: -129> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:39:24.328 INFO:tasks.workunit.client.0.smithi043.stderr: -128> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient: _renew_subs 2024-09-12T00:39:24.328 INFO:tasks.workunit.client.0.smithi043.stderr: -127> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:39:24.328 INFO:tasks.workunit.client.0.smithi043.stderr: -126> 2024-09-12T00:39:23.964+0000 7f507521e9c0 1 librados: init done 2024-09-12T00:39:24.328 INFO:tasks.workunit.client.0.smithi043.stderr: -125> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command cr dump hook 0x55f8e76cf3b8 2024-09-12T00:39:24.328 INFO:tasks.workunit.client.0.smithi043.stderr: -124> 2024-09-12T00:39:23.968+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.328 INFO:tasks.workunit.client.0.smithi043.stderr: -123> 2024-09-12T00:39:23.968+0000 7f4f54ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:24.329 INFO:tasks.workunit.client.0.smithi043.stderr: -122> 2024-09-12T00:39:23.968+0000 7f4f54ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:39:24.329 INFO:tasks.workunit.client.0.smithi043.stderr: -121> 2024-09-12T00:39:23.968+0000 7f4f54ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:39:24.329 INFO:tasks.workunit.client.0.smithi043.stderr: -120> 2024-09-12T00:39:23.968+0000 7f5072d24640 10 monclient: get_auth_request con 0x7f4f3c070ae0 auth_method 0 2024-09-12T00:39:24.329 INFO:tasks.workunit.client.0.smithi043.stderr: -119> 2024-09-12T00:39:23.968+0000 7f5073525640 10 monclient: get_auth_request con 0x55f8e76f6dd0 auth_method 0 2024-09-12T00:39:24.329 INFO:tasks.workunit.client.0.smithi043.stderr: -118> 2024-09-12T00:39:23.968+0000 7f507521e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.329 INFO:tasks.workunit.client.0.smithi043.stderr: -117> 2024-09-12T00:39:23.968+0000 7f507521e9c0 20 realm 2024-09-12T00:39:24.329 INFO:tasks.workunit.client.0.smithi043.stderr: -116> 2024-09-12T00:39:23.968+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.329 INFO:tasks.workunit.client.0.smithi043.stderr: -115> 2024-09-12T00:39:23.968+0000 7f507521e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.329 INFO:tasks.workunit.client.0.smithi043.stderr: -114> 2024-09-12T00:39:23.968+0000 7f507521e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:24.329 INFO:tasks.workunit.client.0.smithi043.stderr: -113> 2024-09-12T00:39:23.968+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.329 INFO:tasks.workunit.client.0.smithi043.stderr: -112> 2024-09-12T00:39:23.968+0000 7f507521e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.330 INFO:tasks.workunit.client.0.smithi043.stderr: -111> 2024-09-12T00:39:23.968+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.330 INFO:tasks.workunit.client.0.smithi043.stderr: -110> 2024-09-12T00:39:23.972+0000 7f5072d24640 10 monclient: get_auth_request con 0x55f8e76fb000 auth_method 0 2024-09-12T00:39:24.330 INFO:tasks.workunit.client.0.smithi043.stderr: -109> 2024-09-12T00:39:23.972+0000 7f507521e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:24.330 INFO:tasks.workunit.client.0.smithi043.stderr: -108> 2024-09-12T00:39:23.972+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.330 INFO:tasks.workunit.client.0.smithi043.stderr: -107> 2024-09-12T00:39:23.972+0000 7f5072523640 10 monclient: get_auth_request con 0x55f8e76fe860 auth_method 0 2024-09-12T00:39:24.330 INFO:tasks.workunit.client.0.smithi043.stderr: -106> 2024-09-12T00:39:23.972+0000 7f507521e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:24.330 INFO:tasks.workunit.client.0.smithi043.stderr: -105> 2024-09-12T00:39:23.972+0000 7f507521e9c0 20 searching for the correct realm 2024-09-12T00:39:24.330 INFO:tasks.workunit.client.0.smithi043.stderr: -104> 2024-09-12T00:39:23.972+0000 7f5073525640 10 monclient: get_auth_request con 0x55f8e7703600 auth_method 0 2024-09-12T00:39:24.330 INFO:tasks.workunit.client.0.smithi043.stderr: -103> 2024-09-12T00:39:23.972+0000 7f5072d24640 10 monclient: get_auth_request con 0x7f506c0c5910 auth_method 0 2024-09-12T00:39:24.330 INFO:tasks.workunit.client.0.smithi043.stderr: -102> 2024-09-12T00:39:23.976+0000 7f5072523640 10 monclient: get_auth_request con 0x7f5068028070 auth_method 0 2024-09-12T00:39:24.330 INFO:tasks.workunit.client.0.smithi043.stderr: -101> 2024-09-12T00:39:23.980+0000 7f5073525640 0 -- 172.21.15.43:0/1628816383 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f5068013030 msgr2=0x7f50680015f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:24.331 INFO:tasks.workunit.client.0.smithi043.stderr: -100> 2024-09-12T00:39:24.184+0000 7f5073525640 10 monclient: get_auth_request con 0x7f5068013030 auth_method 0 2024-09-12T00:39:24.331 INFO:tasks.workunit.client.0.smithi043.stderr: -99> 2024-09-12T00:39:24.188+0000 7f5072d24640 10 monclient: get_auth_request con 0x7f5068008030 auth_method 0 2024-09-12T00:39:24.331 INFO:tasks.workunit.client.0.smithi043.stderr: -98> 2024-09-12T00:39:24.196+0000 7f5072d24640 0 -- 172.21.15.43:0/1628816383 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x55f8e76fb000 msgr2=0x55f8e76fd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:24.331 INFO:tasks.workunit.client.0.smithi043.stderr: -97> 2024-09-12T00:39:24.196+0000 7f4f54ff9640 1 client.7449.objecter ms_handle_reset 0x55f8e76fb000 session 0x55f8e76fa980 osd.5 2024-09-12T00:39:24.331 INFO:tasks.workunit.client.0.smithi043.stderr: -96> 2024-09-12T00:39:24.196+0000 7f4f54ff9640 10 monclient: _renew_subs 2024-09-12T00:39:24.331 INFO:tasks.workunit.client.0.smithi043.stderr: -95> 2024-09-12T00:39:24.196+0000 7f4f54ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:39:24.331 INFO:tasks.workunit.client.0.smithi043.stderr: -94> 2024-09-12T00:39:24.196+0000 7f5072d24640 10 monclient: get_auth_request con 0x7f4f3c080b80 auth_method 0 2024-09-12T00:39:24.331 INFO:tasks.workunit.client.0.smithi043.stderr: -93> 2024-09-12T00:39:24.204+0000 7f507521e9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:39:24.331 INFO:tasks.workunit.client.0.smithi043.stderr: -92> 2024-09-12T00:39:24.204+0000 7f507521e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:24.331 INFO:tasks.workunit.client.0.smithi043.stderr: -91> 2024-09-12T00:39:24.204+0000 7f507521e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:24.331 INFO:tasks.workunit.client.0.smithi043.stderr: -90> 2024-09-12T00:39:24.204+0000 7f507521e9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:39:24.331 INFO:tasks.workunit.client.0.smithi043.stderr: -89> 2024-09-12T00:39:24.204+0000 7f507521e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:24.332 INFO:tasks.workunit.client.0.smithi043.stderr: -88> 2024-09-12T00:39:24.204+0000 7f507521e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:24.332 INFO:tasks.workunit.client.0.smithi043.stderr: -87> 2024-09-12T00:39:24.204+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.332 INFO:tasks.workunit.client.0.smithi043.stderr: -86> 2024-09-12T00:39:24.204+0000 7f507521e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.332 INFO:tasks.workunit.client.0.smithi043.stderr: -85> 2024-09-12T00:39:24.204+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.332 INFO:tasks.workunit.client.0.smithi043.stderr: -84> 2024-09-12T00:39:24.204+0000 7f507521e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:24.332 INFO:tasks.workunit.client.0.smithi043.stderr: -83> 2024-09-12T00:39:24.204+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.332 INFO:tasks.workunit.client.0.smithi043.stderr: -82> 2024-09-12T00:39:24.208+0000 7f507521e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:24.332 INFO:tasks.workunit.client.0.smithi043.stderr: -81> 2024-09-12T00:39:24.208+0000 7f507521e9c0 20 zone default found 2024-09-12T00:39:24.332 INFO:tasks.workunit.client.0.smithi043.stderr: -80> 2024-09-12T00:39:24.208+0000 7f507521e9c0 4 Realm: () 2024-09-12T00:39:24.332 INFO:tasks.workunit.client.0.smithi043.stderr: -79> 2024-09-12T00:39:24.208+0000 7f507521e9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:39:24.332 INFO:tasks.workunit.client.0.smithi043.stderr: -78> 2024-09-12T00:39:24.208+0000 7f507521e9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:39:24.332 INFO:tasks.workunit.client.0.smithi043.stderr: -77> 2024-09-12T00:39:24.208+0000 7f507521e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:24.333 INFO:tasks.workunit.client.0.smithi043.stderr: -76> 2024-09-12T00:39:24.208+0000 7f507521e9c0 20 zonegroup default 2024-09-12T00:39:24.333 INFO:tasks.workunit.client.0.smithi043.stderr: -75> 2024-09-12T00:39:24.208+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.333 INFO:tasks.workunit.client.0.smithi043.stderr: -74> 2024-09-12T00:39:24.208+0000 7f507521e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.333 INFO:tasks.workunit.client.0.smithi043.stderr: -73> 2024-09-12T00:39:24.208+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.333 INFO:tasks.workunit.client.0.smithi043.stderr: -72> 2024-09-12T00:39:24.208+0000 7f507521e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.333 INFO:tasks.workunit.client.0.smithi043.stderr: -71> 2024-09-12T00:39:24.208+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.333 INFO:tasks.workunit.client.0.smithi043.stderr: -70> 2024-09-12T00:39:24.208+0000 7f507521e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.333 INFO:tasks.workunit.client.0.smithi043.stderr: -69> 2024-09-12T00:39:24.208+0000 7f507521e9c0 20 started sync module instance, tier type = 2024-09-12T00:39:24.333 INFO:tasks.workunit.client.0.smithi043.stderr: -68> 2024-09-12T00:39:24.208+0000 7f507521e9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:39:24.333 INFO:tasks.workunit.client.0.smithi043.stderr: -67> 2024-09-12T00:39:24.232+0000 7f507521e9c0 20 add_watcher() i=0 2024-09-12T00:39:24.333 INFO:tasks.workunit.client.0.smithi043.stderr: -66> 2024-09-12T00:39:24.232+0000 7f507521e9c0 20 add_watcher() i=1 2024-09-12T00:39:24.333 INFO:tasks.workunit.client.0.smithi043.stderr: -65> 2024-09-12T00:39:24.232+0000 7f507521e9c0 20 add_watcher() i=2 2024-09-12T00:39:24.334 INFO:tasks.workunit.client.0.smithi043.stderr: -64> 2024-09-12T00:39:24.232+0000 7f507521e9c0 20 add_watcher() i=3 2024-09-12T00:39:24.334 INFO:tasks.workunit.client.0.smithi043.stderr: -63> 2024-09-12T00:39:24.232+0000 7f507521e9c0 20 add_watcher() i=4 2024-09-12T00:39:24.334 INFO:tasks.workunit.client.0.smithi043.stderr: -62> 2024-09-12T00:39:24.232+0000 7f507521e9c0 20 add_watcher() i=5 2024-09-12T00:39:24.334 INFO:tasks.workunit.client.0.smithi043.stderr: -61> 2024-09-12T00:39:24.232+0000 7f507521e9c0 20 add_watcher() i=6 2024-09-12T00:39:24.334 INFO:tasks.workunit.client.0.smithi043.stderr: -60> 2024-09-12T00:39:24.236+0000 7f507521e9c0 20 add_watcher() i=7 2024-09-12T00:39:24.334 INFO:tasks.workunit.client.0.smithi043.stderr: -59> 2024-09-12T00:39:24.236+0000 7f507521e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:24.334 INFO:tasks.workunit.client.0.smithi043.stderr: -58> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c920) adding auth protocol: cephx 2024-09-12T00:39:24.334 INFO:tasks.workunit.client.0.smithi043.stderr: -57> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c920) adding auth protocol: cephx 2024-09-12T00:39:24.334 INFO:tasks.workunit.client.0.smithi043.stderr: -56> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c920) adding auth protocol: cephx 2024-09-12T00:39:24.334 INFO:tasks.workunit.client.0.smithi043.stderr: -55> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c920) adding con mode: secure 2024-09-12T00:39:24.334 INFO:tasks.workunit.client.0.smithi043.stderr: -54> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c920) adding con mode: crc 2024-09-12T00:39:24.334 INFO:tasks.workunit.client.0.smithi043.stderr: -53> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c920) adding con mode: secure 2024-09-12T00:39:24.335 INFO:tasks.workunit.client.0.smithi043.stderr: -52> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c920) adding con mode: crc 2024-09-12T00:39:24.335 INFO:tasks.workunit.client.0.smithi043.stderr: -51> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c920) adding con mode: secure 2024-09-12T00:39:24.335 INFO:tasks.workunit.client.0.smithi043.stderr: -50> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c920) adding con mode: crc 2024-09-12T00:39:24.335 INFO:tasks.workunit.client.0.smithi043.stderr: -49> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c920) adding con mode: crc 2024-09-12T00:39:24.335 INFO:tasks.workunit.client.0.smithi043.stderr: -48> 2024-09-12T00:39:24.240+0000 7f4f297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:24.335 INFO:tasks.workunit.client.0.smithi043.stderr: -47> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c920) adding con mode: secure 2024-09-12T00:39:24.335 INFO:tasks.workunit.client.0.smithi043.stderr: -46> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c920) adding con mode: crc 2024-09-12T00:39:24.335 INFO:tasks.workunit.client.0.smithi043.stderr: -45> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c920) adding con mode: secure 2024-09-12T00:39:24.335 INFO:tasks.workunit.client.0.smithi043.stderr: -44> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c920) adding con mode: crc 2024-09-12T00:39:24.335 INFO:tasks.workunit.client.0.smithi043.stderr: -43> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c920) adding con mode: secure 2024-09-12T00:39:24.335 INFO:tasks.workunit.client.0.smithi043.stderr: -42> 2024-09-12T00:39:24.240+0000 7f507521e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:24.335 INFO:tasks.workunit.client.0.smithi043.stderr: -41> 2024-09-12T00:39:24.240+0000 7f507521e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:24.335 INFO:tasks.workunit.client.0.smithi043.stderr: -40> 2024-09-12T00:39:24.240+0000 7f507521e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:24.336 INFO:tasks.workunit.client.0.smithi043.stderr: -39> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command cache list hook 0x55f8e76d5580 2024-09-12T00:39:24.336 INFO:tasks.workunit.client.0.smithi043.stderr: -38> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command cache inspect hook 0x55f8e76d5580 2024-09-12T00:39:24.336 INFO:tasks.workunit.client.0.smithi043.stderr: -37> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command cache erase hook 0x55f8e76d5580 2024-09-12T00:39:24.336 INFO:tasks.workunit.client.0.smithi043.stderr: -36> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command cache zap hook 0x55f8e76d5580 2024-09-12T00:39:24.336 INFO:tasks.workunit.client.0.smithi043.stderr: -35> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 note: GC not initialized 2024-09-12T00:39:24.336 INFO:tasks.workunit.client.0.smithi043.stderr: -34> 2024-09-12T00:39:24.240+0000 7f4ea3fff640 20 reqs_thread_entry: start 2024-09-12T00:39:24.336 INFO:tasks.workunit.client.0.smithi043.stderr: -33> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command sync trace show hook 0x7f506400fcc0 2024-09-12T00:39:24.336 INFO:tasks.workunit.client.0.smithi043.stderr: -32> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command sync trace history hook 0x7f506400fcc0 2024-09-12T00:39:24.336 INFO:tasks.workunit.client.0.smithi043.stderr: -31> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command sync trace active hook 0x7f506400fcc0 2024-09-12T00:39:24.336 INFO:tasks.workunit.client.0.smithi043.stderr: -30> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command sync trace active_short hook 0x7f506400fcc0 2024-09-12T00:39:24.336 INFO:tasks.workunit.client.0.smithi043.stderr: -29> 2024-09-12T00:39:24.240+0000 7f507521e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:24.336 INFO:tasks.workunit.client.0.smithi043.stderr: -28> 2024-09-12T00:39:24.240+0000 7f507521e9c0 20 Filter name: none 2024-09-12T00:39:24.337 INFO:tasks.workunit.client.0.smithi043.stderr: -27> 2024-09-12T00:39:24.244+0000 7f4ea1ffb640 20 reqs_thread_entry: start 2024-09-12T00:39:24.337 INFO:tasks.workunit.client.0.smithi043.stderr: -26> 2024-09-12T00:39:24.244+0000 7f507521e9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:39:24.337 INFO:tasks.workunit.client.0.smithi043.stderr: -25> 2024-09-12T00:39:24.244+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.337 INFO:tasks.workunit.client.0.smithi043.stderr: -24> 2024-09-12T00:39:24.244+0000 7f507521e9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:24.337 INFO:tasks.workunit.client.0.smithi043.stderr: -23> 2024-09-12T00:39:24.244+0000 7f507521e9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:39:24.337 INFO:tasks.workunit.client.0.smithi043.stderr: -22> 2024-09-12T00:39:24.244+0000 7f507521e9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:39:24.337 INFO:tasks.workunit.client.0.smithi043.stderr: -21> 2024-09-12T00:39:24.244+0000 7f507521e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 : miss 2024-09-12T00:39:24.337 INFO:tasks.workunit.client.0.smithi043.stderr: -20> 2024-09-12T00:39:24.244+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.337 INFO:tasks.workunit.client.0.smithi043.stderr: -19> 2024-09-12T00:39:24.244+0000 7f507521e9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:39:24.337 INFO:tasks.workunit.client.0.smithi043.stderr: -18> 2024-09-12T00:39:24.244+0000 7f507521e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 info.flags=0x17 2024-09-12T00:39:24.337 INFO:tasks.workunit.client.0.smithi043.stderr: -17> 2024-09-12T00:39:24.244+0000 7f507521e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 to cache LRU end 2024-09-12T00:39:24.337 INFO:tasks.workunit.client.0.smithi043.stderr: -16> 2024-09-12T00:39:24.244+0000 7f507521e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:24.337 INFO:tasks.workunit.client.0.smithi043.stderr: -15> 2024-09-12T00:39:24.244+0000 7f507521e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:24.338 INFO:tasks.workunit.client.0.smithi043.stderr: -14> 2024-09-12T00:39:24.244+0000 7f507521e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 2024-09-12T00:39:24.338 INFO:tasks.workunit.client.0.smithi043.stderr: -13> 2024-09-12T00:39:24.256+0000 7f507521e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 info.flags=0x17 2024-09-12T00:39:24.338 INFO:tasks.workunit.client.0.smithi043.stderr: -12> 2024-09-12T00:39:24.256+0000 7f507521e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 to cache LRU end 2024-09-12T00:39:24.338 INFO:tasks.workunit.client.0.smithi043.stderr: -11> 2024-09-12T00:39:24.256+0000 7f507521e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:24.338 INFO:tasks.workunit.client.0.smithi043.stderr: -10> 2024-09-12T00:39:24.256+0000 7f507521e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34, ofs0, ns] 2024-09-12T00:39:24.338 INFO:tasks.workunit.client.0.smithi043.stderr: -9> 2024-09-12T00:39:24.256+0000 7f4f567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333500 cookie 94527523153280 notifier 7449 bl.length()=911 2024-09-12T00:39:24.338 INFO:tasks.workunit.client.0.smithi043.stderr: -8> 2024-09-12T00:39:24.256+0000 7f4f567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 info.flags=0x17 2024-09-12T00:39:24.338 INFO:tasks.workunit.client.0.smithi043.stderr: -7> 2024-09-12T00:39:24.256+0000 7f4f567fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 to cache LRU end 2024-09-12T00:39:24.338 INFO:tasks.workunit.client.0.smithi043.stderr: -6> 2024-09-12T00:39:24.256+0000 7f4f567fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:24.338 INFO:tasks.workunit.client.0.smithi043.stderr: -5> 2024-09-12T00:39:24.256+0000 7f507521e9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34]): orig_sources= new_sources= 2024-09-12T00:39:24.338 INFO:tasks.workunit.client.0.smithi043.stderr: -4> 2024-09-12T00:39:24.256+0000 7f507521e9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34]): potential sources added=[] removed=[] 2024-09-12T00:39:24.338 INFO:tasks.workunit.client.0.smithi043.stderr: -3> 2024-09-12T00:39:24.256+0000 7f507521e9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34]): orig_dests= new_dests= 2024-09-12T00:39:24.338 INFO:tasks.workunit.client.0.smithi043.stderr: -2> 2024-09-12T00:39:24.256+0000 7f507521e9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34]): potential dests added=[] removed=[] 2024-09-12T00:39:24.339 INFO:tasks.workunit.client.0.smithi043.stderr: -1> 2024-09-12T00:39:24.272+0000 7f507521e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f507521e9c0 time 2024-09-12T00:39:24.272207+0000 2024-09-12T00:39:24.339 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:39:24.339 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.339 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:24.339 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f5078af82eb] 2024-09-12T00:39:24.339 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5078af849f] 2024-09-12T00:39:24.339 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f8e570ccc1] 2024-09-12T00:39:24.339 INFO:tasks.workunit.client.0.smithi043.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f8e5721d5a] 2024-09-12T00:39:24.339 INFO:tasks.workunit.client.0.smithi043.stderr: 5: main() 2024-09-12T00:39:24.339 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f507795ed90] 2024-09-12T00:39:24.339 INFO:tasks.workunit.client.0.smithi043.stderr: 7: __libc_start_main() 2024-09-12T00:39:24.339 INFO:tasks.workunit.client.0.smithi043.stderr: 8: _start() 2024-09-12T00:39:24.339 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.340 INFO:tasks.workunit.client.0.smithi043.stderr: 0> 2024-09-12T00:39:24.272+0000 7f507521e9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:39:24.340 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7f507521e9c0 thread_name:radosgw-admin 2024-09-12T00:39:24.340 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.340 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:24.340 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5077977520] 2024-09-12T00:39:24.340 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:39:24.340 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:39:24.340 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:39:24.340 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5078af8345] 2024-09-12T00:39:24.340 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5078af849f] 2024-09-12T00:39:24.340 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f8e570ccc1] 2024-09-12T00:39:24.340 INFO:tasks.workunit.client.0.smithi043.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f8e5721d5a] 2024-09-12T00:39:24.340 INFO:tasks.workunit.client.0.smithi043.stderr: 9: main() 2024-09-12T00:39:24.341 INFO:tasks.workunit.client.0.smithi043.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f507795ed90] 2024-09-12T00:39:24.341 INFO:tasks.workunit.client.0.smithi043.stderr: 11: __libc_start_main() 2024-09-12T00:39:24.341 INFO:tasks.workunit.client.0.smithi043.stderr: 12: _start() 2024-09-12T00:39:24.341 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:39:24.341 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.341 INFO:tasks.workunit.client.0.smithi043.stderr:--- logging levels --- 2024-09-12T00:39:24.341 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 none 2024-09-12T00:39:24.341 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 lockdep 2024-09-12T00:39:24.341 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 context 2024-09-12T00:39:24.341 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 crush 2024-09-12T00:39:24.341 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds 2024-09-12T00:39:24.341 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_balancer 2024-09-12T00:39:24.341 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_locker 2024-09-12T00:39:24.342 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log 2024-09-12T00:39:24.342 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log_expire 2024-09-12T00:39:24.342 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_migrator 2024-09-12T00:39:24.342 INFO:tasks.workunit.client.0.smithi043.stderr: 3/ 5 mds_quiesce 2024-09-12T00:39:24.342 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 buffer 2024-09-12T00:39:24.342 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 timer 2024-09-12T00:39:24.342 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 filer 2024-09-12T00:39:24.342 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 striper 2024-09-12T00:39:24.342 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 objecter 2024-09-12T00:39:24.342 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rados 2024-09-12T00:39:24.342 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd 2024-09-12T00:39:24.342 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_mirror 2024-09-12T00:39:24.342 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_replay 2024-09-12T00:39:24.343 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_pwl 2024-09-12T00:39:24.343 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 journaler 2024-09-12T00:39:24.343 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objectcacher 2024-09-12T00:39:24.343 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:39:24.343 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 client 2024-09-12T00:39:24.343 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 osd 2024-09-12T00:39:24.343 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 optracker 2024-09-12T00:39:24.343 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objclass 2024-09-12T00:39:24.343 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 filestore 2024-09-12T00:39:24.343 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 journal 2024-09-12T00:39:24.343 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 ms 2024-09-12T00:39:24.343 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mon 2024-09-12T00:39:24.343 INFO:tasks.workunit.client.0.smithi043.stderr: 0/10 monc 2024-09-12T00:39:24.344 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 paxos 2024-09-12T00:39:24.344 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 tp 2024-09-12T00:39:24.344 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 auth 2024-09-12T00:39:24.344 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 crypto 2024-09-12T00:39:24.344 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 finisher 2024-09-12T00:39:24.344 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 reserver 2024-09-12T00:39:24.344 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 heartbeatmap 2024-09-12T00:39:24.344 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 perfcounter 2024-09-12T00:39:24.344 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw 2024-09-12T00:39:24.344 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_sync 2024-09-12T00:39:24.344 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_datacache 2024-09-12T00:39:24.344 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_access 2024-09-12T00:39:24.344 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:39:24.345 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_flight 2024-09-12T00:39:24.345 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:39:24.345 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw_notification 2024-09-12T00:39:24.345 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 javaclient 2024-09-12T00:39:24.345 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 asok 2024-09-12T00:39:24.345 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 throttle 2024-09-12T00:39:24.345 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 refs 2024-09-12T00:39:24.345 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 compressor 2024-09-12T00:39:24.345 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluestore 2024-09-12T00:39:24.345 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluefs 2024-09-12T00:39:24.345 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 bdev 2024-09-12T00:39:24.345 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 kstore 2024-09-12T00:39:24.345 INFO:tasks.workunit.client.0.smithi043.stderr: 4/ 5 rocksdb 2024-09-12T00:39:24.345 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 fuse 2024-09-12T00:39:24.346 INFO:tasks.workunit.client.0.smithi043.stderr: 2/ 5 mgr 2024-09-12T00:39:24.346 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mgrc 2024-09-12T00:39:24.346 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 dpdk 2024-09-12T00:39:24.346 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 eventtrace 2024-09-12T00:39:24.346 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 prioritycache 2024-09-12T00:39:24.346 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 test 2024-09-12T00:39:24.346 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:39:24.346 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephsqlite 2024-09-12T00:39:24.346 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:39:24.346 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore 2024-09-12T00:39:24.346 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_onode 2024-09-12T00:39:24.346 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_odata 2024-09-12T00:39:24.347 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_omap 2024-09-12T00:39:24.347 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_tm 2024-09-12T00:39:24.347 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_t 2024-09-12T00:39:24.347 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:39:24.347 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_epm 2024-09-12T00:39:24.347 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_lba 2024-09-12T00:39:24.347 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:39:24.347 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cache 2024-09-12T00:39:24.347 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_journal 2024-09-12T00:39:24.347 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_device 2024-09-12T00:39:24.347 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_backref 2024-09-12T00:39:24.347 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 alienstore 2024-09-12T00:39:24.347 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mclock 2024-09-12T00:39:24.347 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cyanstore 2024-09-12T00:39:24.348 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 ceph_exporter 2024-09-12T00:39:24.348 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 memstore 2024-09-12T00:39:24.348 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 trace 2024-09-12T00:39:24.348 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 ceph_dedup 2024-09-12T00:39:24.348 INFO:tasks.workunit.client.0.smithi043.stderr: -2/-2 (syslog threshold) 2024-09-12T00:39:24.348 INFO:tasks.workunit.client.0.smithi043.stderr: 99/99 (stderr threshold) 2024-09-12T00:39:24.348 INFO:tasks.workunit.client.0.smithi043.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:39:24.348 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4ea1ffb640 / http_manager 2024-09-12T00:39:24.348 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4ea3fff640 / http_manager 2024-09-12T00:39:24.348 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4f297e2640 / rgw_dt_lg_renew 2024-09-12T00:39:24.348 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4f54ff9640 / ms_dispatch 2024-09-12T00:39:24.348 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4f567fc640 / io_context_pool 2024-09-12T00:39:24.349 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4f5ce01640 / ms_dispatch 2024-09-12T00:39:24.349 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4f5f606640 / ms_dispatch 2024-09-12T00:39:24.349 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4f60e09640 / io_context_pool 2024-09-12T00:39:24.349 INFO:tasks.workunit.client.0.smithi043.stderr: 7f5072523640 / msgr-worker-2 2024-09-12T00:39:24.349 INFO:tasks.workunit.client.0.smithi043.stderr: 7f5072d24640 / msgr-worker-1 2024-09-12T00:39:24.349 INFO:tasks.workunit.client.0.smithi043.stderr: 7f5073525640 / msgr-worker-0 2024-09-12T00:39:24.349 INFO:tasks.workunit.client.0.smithi043.stderr: 7f5073d26640 / io_context_pool 2024-09-12T00:39:24.349 INFO:tasks.workunit.client.0.smithi043.stderr: 7f507521e9c0 / radosgw-admin 2024-09-12T00:39:24.349 INFO:tasks.workunit.client.0.smithi043.stderr: max_recent 500 2024-09-12T00:39:24.349 INFO:tasks.workunit.client.0.smithi043.stderr: max_new 1000 2024-09-12T00:39:24.349 INFO:tasks.workunit.client.0.smithi043.stderr: log_file /var/log/ceph/ceph-client.admin.118598.log 2024-09-12T00:39:24.349 INFO:tasks.workunit.client.0.smithi043.stderr:--- end dump of recent events --- 2024-09-12T00:39:24.349 INFO:tasks.workunit.client.0.smithi043.stderr:--- begin dump of recent events --- 2024-09-12T00:39:24.350 INFO:tasks.workunit.client.0.smithi043.stderr: -499> 2024-09-12T00:39:23.948+0000 7f5073525640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:24.350 INFO:tasks.workunit.client.0.smithi043.stderr: -498> 2024-09-12T00:39:23.948+0000 7f5072d24640 10 monclient(hunting): get_auth_request con 0x55f8e74be300 auth_method 0 2024-09-12T00:39:24.350 INFO:tasks.workunit.client.0.smithi043.stderr: -497> 2024-09-12T00:39:23.948+0000 7f5072d24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:24.350 INFO:tasks.workunit.client.0.smithi043.stderr: -496> 2024-09-12T00:39:23.948+0000 7f5072d24640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:24.350 INFO:tasks.workunit.client.0.smithi043.stderr: -495> 2024-09-12T00:39:23.948+0000 7f5072d24640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:24.350 INFO:tasks.workunit.client.0.smithi043.stderr: -494> 2024-09-12T00:39:23.948+0000 7f5072523640 10 monclient(hunting): handle_auth_done global_id 7437 payload 274 2024-09-12T00:39:24.350 INFO:tasks.workunit.client.0.smithi043.stderr: -493> 2024-09-12T00:39:23.948+0000 7f5072523640 10 monclient: _finish_hunting 0 2024-09-12T00:39:24.350 INFO:tasks.workunit.client.0.smithi043.stderr: -492> 2024-09-12T00:39:23.948+0000 7f5072523640 1 monclient: found mon.noname-a 2024-09-12T00:39:24.351 INFO:tasks.workunit.client.0.smithi043.stderr: -491> 2024-09-12T00:39:23.948+0000 7f5072523640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:39:24.351 INFO:tasks.workunit.client.0.smithi043.stderr: -490> 2024-09-12T00:39:23.948+0000 7f4f60e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:24.351 INFO:tasks.workunit.client.0.smithi043.stderr: -489> 2024-09-12T00:39:23.948+0000 7f4f60e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:39:24.351 INFO:tasks.workunit.client.0.smithi043.stderr: -488> 2024-09-12T00:39:23.948+0000 7f4f60e09640 10 monclient: dump: 2024-09-12T00:39:24.351 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:24.351 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:24.351 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.351 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.351 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:24.351 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:24.351 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:24.351 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:24.352 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:24.352 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.352 INFO:tasks.workunit.client.0.smithi043.stderr: -487> 2024-09-12T00:39:23.948+0000 7f4f60e09640 10 monclient: _finish_auth 0 2024-09-12T00:39:24.352 INFO:tasks.workunit.client.0.smithi043.stderr: -486> 2024-09-12T00:39:23.948+0000 7f4f60e09640 10 monclient: _check_auth_tickets 2024-09-12T00:39:24.352 INFO:tasks.workunit.client.0.smithi043.stderr: -485> 2024-09-12T00:39:23.948+0000 7f4f60e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:24.352 INFO:tasks.workunit.client.0.smithi043.stderr: -484> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 monclient: authenticate success, global_id 7437 2024-09-12T00:39:24.352 INFO:tasks.workunit.client.0.smithi043.stderr: -483> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:39:24.353 INFO:tasks.workunit.client.0.smithi043.stderr: -482> 2024-09-12T00:39:23.948+0000 7f507521e9c0 4 set_mon_vals no callback set 2024-09-12T00:39:24.353 INFO:tasks.workunit.client.0.smithi043.stderr: -481> 2024-09-12T00:39:23.948+0000 7f4f60e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:24.353 INFO:tasks.workunit.client.0.smithi043.stderr: -480> 2024-09-12T00:39:23.948+0000 7f4f60e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:24.353 INFO:tasks.workunit.client.0.smithi043.stderr: -479> 2024-09-12T00:39:23.948+0000 7f4f60e09640 10 monclient: dump: 2024-09-12T00:39:24.353 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:24.353 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:24.353 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.353 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.353 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:24.353 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:24.353 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:24.353 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:24.353 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:24.354 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.354 INFO:tasks.workunit.client.0.smithi043.stderr: -478> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient: shutdown 2024-09-12T00:39:24.354 INFO:tasks.workunit.client.0.smithi043.stderr: -477> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 asok(0x55f8e74032b0) unregister_commands rotate-key 2024-09-12T00:39:24.354 INFO:tasks.workunit.client.0.smithi043.stderr: -476> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient: build_initial_monmap 2024-09-12T00:39:24.354 INFO:tasks.workunit.client.0.smithi043.stderr: -475> 2024-09-12T00:39:23.948+0000 7f507521e9c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:24.354 INFO:tasks.workunit.client.0.smithi043.stderr: -474> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient: monmap: 2024-09-12T00:39:24.354 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:39:24.354 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:24.354 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:39:24.354 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:39:24.354 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:24.354 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:24.355 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:39:24.355 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:39:24.355 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:39:24.355 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.355 INFO:tasks.workunit.client.0.smithi043.stderr: -473> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7613730) adding auth protocol: cephx 2024-09-12T00:39:24.355 INFO:tasks.workunit.client.0.smithi043.stderr: -472> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7613730) adding auth protocol: cephx 2024-09-12T00:39:24.355 INFO:tasks.workunit.client.0.smithi043.stderr: -471> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7613730) adding auth protocol: cephx 2024-09-12T00:39:24.355 INFO:tasks.workunit.client.0.smithi043.stderr: -470> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7613730) adding con mode: secure 2024-09-12T00:39:24.355 INFO:tasks.workunit.client.0.smithi043.stderr: -469> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7613730) adding con mode: crc 2024-09-12T00:39:24.355 INFO:tasks.workunit.client.0.smithi043.stderr: -468> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7613730) adding con mode: secure 2024-09-12T00:39:24.355 INFO:tasks.workunit.client.0.smithi043.stderr: -467> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7613730) adding con mode: crc 2024-09-12T00:39:24.355 INFO:tasks.workunit.client.0.smithi043.stderr: -466> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7613730) adding con mode: secure 2024-09-12T00:39:24.356 INFO:tasks.workunit.client.0.smithi043.stderr: -465> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7613730) adding con mode: crc 2024-09-12T00:39:24.356 INFO:tasks.workunit.client.0.smithi043.stderr: -464> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7613730) adding con mode: crc 2024-09-12T00:39:24.356 INFO:tasks.workunit.client.0.smithi043.stderr: -463> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7613730) adding con mode: secure 2024-09-12T00:39:24.356 INFO:tasks.workunit.client.0.smithi043.stderr: -462> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7613730) adding con mode: crc 2024-09-12T00:39:24.356 INFO:tasks.workunit.client.0.smithi043.stderr: -461> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7613730) adding con mode: secure 2024-09-12T00:39:24.356 INFO:tasks.workunit.client.0.smithi043.stderr: -460> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7613730) adding con mode: crc 2024-09-12T00:39:24.356 INFO:tasks.workunit.client.0.smithi043.stderr: -459> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7613730) adding con mode: secure 2024-09-12T00:39:24.356 INFO:tasks.workunit.client.0.smithi043.stderr: -458> 2024-09-12T00:39:23.948+0000 7f507521e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:24.356 INFO:tasks.workunit.client.0.smithi043.stderr: -457> 2024-09-12T00:39:23.948+0000 7f507521e9c0 1 librados: starting msgr at 2024-09-12T00:39:24.356 INFO:tasks.workunit.client.0.smithi043.stderr: -456> 2024-09-12T00:39:23.948+0000 7f507521e9c0 1 librados: starting objecter 2024-09-12T00:39:24.356 INFO:tasks.workunit.client.0.smithi043.stderr: -455> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command objecter_requests hook 0x55f8e73f6df0 2024-09-12T00:39:24.357 INFO:tasks.workunit.client.0.smithi043.stderr: -454> 2024-09-12T00:39:23.948+0000 7f507521e9c0 1 librados: setting wanted keys 2024-09-12T00:39:24.357 INFO:tasks.workunit.client.0.smithi043.stderr: -453> 2024-09-12T00:39:23.948+0000 7f507521e9c0 1 librados: calling monclient init 2024-09-12T00:39:24.357 INFO:tasks.workunit.client.0.smithi043.stderr: -452> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient: init 2024-09-12T00:39:24.357 INFO:tasks.workunit.client.0.smithi043.stderr: -451> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e760e3e0) adding auth protocol: cephx 2024-09-12T00:39:24.357 INFO:tasks.workunit.client.0.smithi043.stderr: -450> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e760e3e0) adding auth protocol: cephx 2024-09-12T00:39:24.357 INFO:tasks.workunit.client.0.smithi043.stderr: -449> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e760e3e0) adding auth protocol: cephx 2024-09-12T00:39:24.357 INFO:tasks.workunit.client.0.smithi043.stderr: -448> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e760e3e0) adding con mode: secure 2024-09-12T00:39:24.357 INFO:tasks.workunit.client.0.smithi043.stderr: -447> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e760e3e0) adding con mode: crc 2024-09-12T00:39:24.357 INFO:tasks.workunit.client.0.smithi043.stderr: -446> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e760e3e0) adding con mode: secure 2024-09-12T00:39:24.357 INFO:tasks.workunit.client.0.smithi043.stderr: -445> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e760e3e0) adding con mode: crc 2024-09-12T00:39:24.357 INFO:tasks.workunit.client.0.smithi043.stderr: -444> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e760e3e0) adding con mode: secure 2024-09-12T00:39:24.357 INFO:tasks.workunit.client.0.smithi043.stderr: -443> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e760e3e0) adding con mode: crc 2024-09-12T00:39:24.357 INFO:tasks.workunit.client.0.smithi043.stderr: -442> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e760e3e0) adding con mode: crc 2024-09-12T00:39:24.357 INFO:tasks.workunit.client.0.smithi043.stderr: -441> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e760e3e0) adding con mode: secure 2024-09-12T00:39:24.358 INFO:tasks.workunit.client.0.smithi043.stderr: -440> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e760e3e0) adding con mode: crc 2024-09-12T00:39:24.358 INFO:tasks.workunit.client.0.smithi043.stderr: -439> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e760e3e0) adding con mode: secure 2024-09-12T00:39:24.358 INFO:tasks.workunit.client.0.smithi043.stderr: -438> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e760e3e0) adding con mode: crc 2024-09-12T00:39:24.358 INFO:tasks.workunit.client.0.smithi043.stderr: -437> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 AuthRegistry(0x55f8e760e3e0) adding con mode: secure 2024-09-12T00:39:24.358 INFO:tasks.workunit.client.0.smithi043.stderr: -436> 2024-09-12T00:39:23.948+0000 7f507521e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:24.358 INFO:tasks.workunit.client.0.smithi043.stderr: -435> 2024-09-12T00:39:23.948+0000 7f507521e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:24.358 INFO:tasks.workunit.client.0.smithi043.stderr: -434> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command rotate-key hook 0x55f8e760e528 2024-09-12T00:39:24.358 INFO:tasks.workunit.client.0.smithi043.stderr: -433> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:24.358 INFO:tasks.workunit.client.0.smithi043.stderr: -432> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:39:24.358 INFO:tasks.workunit.client.0.smithi043.stderr: -431> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient(hunting): picked mon.noname-b con 0x55f8e74be300 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:39:24.358 INFO:tasks.workunit.client.0.smithi043.stderr: -430> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient(hunting): picked mon.noname-c con 0x55f8e74c7bf0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:39:24.358 INFO:tasks.workunit.client.0.smithi043.stderr: -429> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient(hunting): picked mon.noname-a con 0x55f8e74c9850 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:39:24.359 INFO:tasks.workunit.client.0.smithi043.stderr: -428> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:24.359 INFO:tasks.workunit.client.0.smithi043.stderr: -427> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:24.359 INFO:tasks.workunit.client.0.smithi043.stderr: -426> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:24.359 INFO:tasks.workunit.client.0.smithi043.stderr: -425> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:24.359 INFO:tasks.workunit.client.0.smithi043.stderr: -424> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient(hunting): authenticate will time out at 2259.938968s 2024-09-12T00:39:24.359 INFO:tasks.workunit.client.0.smithi043.stderr: -423> 2024-09-12T00:39:23.948+0000 7f5072523640 10 monclient(hunting): get_auth_request con 0x55f8e74c7bf0 auth_method 0 2024-09-12T00:39:24.359 INFO:tasks.workunit.client.0.smithi043.stderr: -422> 2024-09-12T00:39:23.948+0000 7f5072523640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:24.359 INFO:tasks.workunit.client.0.smithi043.stderr: -421> 2024-09-12T00:39:23.948+0000 7f5072523640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:24.359 INFO:tasks.workunit.client.0.smithi043.stderr: -420> 2024-09-12T00:39:23.948+0000 7f5072523640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:24.359 INFO:tasks.workunit.client.0.smithi043.stderr: -419> 2024-09-12T00:39:23.948+0000 7f5073525640 10 monclient(hunting): get_auth_request con 0x55f8e74c9850 auth_method 0 2024-09-12T00:39:24.359 INFO:tasks.workunit.client.0.smithi043.stderr: -418> 2024-09-12T00:39:23.948+0000 7f5073525640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:24.359 INFO:tasks.workunit.client.0.smithi043.stderr: -417> 2024-09-12T00:39:23.948+0000 7f5073525640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:24.359 INFO:tasks.workunit.client.0.smithi043.stderr: -416> 2024-09-12T00:39:23.948+0000 7f5073525640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:24.360 INFO:tasks.workunit.client.0.smithi043.stderr: -415> 2024-09-12T00:39:23.948+0000 7f5072523640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:24.360 INFO:tasks.workunit.client.0.smithi043.stderr: -414> 2024-09-12T00:39:23.948+0000 7f5072523640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:24.360 INFO:tasks.workunit.client.0.smithi043.stderr: -413> 2024-09-12T00:39:23.948+0000 7f5072523640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:24.360 INFO:tasks.workunit.client.0.smithi043.stderr: -412> 2024-09-12T00:39:23.948+0000 7f5073525640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:24.360 INFO:tasks.workunit.client.0.smithi043.stderr: -411> 2024-09-12T00:39:23.948+0000 7f5073525640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:24.360 INFO:tasks.workunit.client.0.smithi043.stderr: -410> 2024-09-12T00:39:23.948+0000 7f5073525640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:24.360 INFO:tasks.workunit.client.0.smithi043.stderr: -409> 2024-09-12T00:39:23.948+0000 7f5072523640 10 monclient(hunting): handle_auth_done global_id 7118 payload 824 2024-09-12T00:39:24.360 INFO:tasks.workunit.client.0.smithi043.stderr: -408> 2024-09-12T00:39:23.948+0000 7f5072523640 10 monclient: _finish_hunting 0 2024-09-12T00:39:24.360 INFO:tasks.workunit.client.0.smithi043.stderr: -407> 2024-09-12T00:39:23.948+0000 7f5072523640 1 monclient: found mon.noname-c 2024-09-12T00:39:24.360 INFO:tasks.workunit.client.0.smithi043.stderr: -406> 2024-09-12T00:39:23.948+0000 7f5072523640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:39:24.360 INFO:tasks.workunit.client.0.smithi043.stderr: -405> 2024-09-12T00:39:23.948+0000 7f4f5f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:24.360 INFO:tasks.workunit.client.0.smithi043.stderr: -404> 2024-09-12T00:39:23.948+0000 7f4f5f606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:39:24.361 INFO:tasks.workunit.client.0.smithi043.stderr: -403> 2024-09-12T00:39:23.948+0000 7f4f5f606640 10 monclient: dump: 2024-09-12T00:39:24.361 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:24.361 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:24.361 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.361 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.361 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:24.361 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:24.361 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:24.361 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:24.361 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:24.361 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.361 INFO:tasks.workunit.client.0.smithi043.stderr: -402> 2024-09-12T00:39:23.948+0000 7f4f5f606640 10 monclient: _finish_auth 0 2024-09-12T00:39:24.361 INFO:tasks.workunit.client.0.smithi043.stderr: -401> 2024-09-12T00:39:23.948+0000 7f4f5f606640 10 monclient: _check_auth_tickets 2024-09-12T00:39:24.362 INFO:tasks.workunit.client.0.smithi043.stderr: -400> 2024-09-12T00:39:23.948+0000 7f4f5f606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:24.362 INFO:tasks.workunit.client.0.smithi043.stderr: -399> 2024-09-12T00:39:23.948+0000 7f4f5f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:24.362 INFO:tasks.workunit.client.0.smithi043.stderr: -398> 2024-09-12T00:39:23.948+0000 7f4f5f606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:39:24.362 INFO:tasks.workunit.client.0.smithi043.stderr: -397> 2024-09-12T00:39:23.948+0000 7f4f5f606640 10 monclient: dump: 2024-09-12T00:39:24.362 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:24.362 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:24.362 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.362 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.362 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:24.362 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:24.362 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:24.362 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:24.363 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:24.363 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.363 INFO:tasks.workunit.client.0.smithi043.stderr: -396> 2024-09-12T00:39:23.948+0000 7f507521e9c0 5 monclient: authenticate success, global_id 7118 2024-09-12T00:39:24.363 INFO:tasks.workunit.client.0.smithi043.stderr: -395> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient: _renew_subs 2024-09-12T00:39:24.363 INFO:tasks.workunit.client.0.smithi043.stderr: -394> 2024-09-12T00:39:23.948+0000 7f4f60e09640 4 set_mon_vals no callback set 2024-09-12T00:39:24.363 INFO:tasks.workunit.client.0.smithi043.stderr: -393> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:39:24.363 INFO:tasks.workunit.client.0.smithi043.stderr: -392> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient: _renew_subs 2024-09-12T00:39:24.363 INFO:tasks.workunit.client.0.smithi043.stderr: -391> 2024-09-12T00:39:23.948+0000 7f507521e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:39:24.363 INFO:tasks.workunit.client.0.smithi043.stderr: -390> 2024-09-12T00:39:23.948+0000 7f507521e9c0 1 librados: init done 2024-09-12T00:39:24.364 INFO:tasks.workunit.client.0.smithi043.stderr: -389> 2024-09-12T00:39:23.952+0000 7f4f5f606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:24.364 INFO:tasks.workunit.client.0.smithi043.stderr: -388> 2024-09-12T00:39:23.952+0000 7f4f5f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:39:24.364 INFO:tasks.workunit.client.0.smithi043.stderr: -387> 2024-09-12T00:39:23.952+0000 7f4f5f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:39:24.364 INFO:tasks.workunit.client.0.smithi043.stderr: -386> 2024-09-12T00:39:23.952+0000 7f5072d24640 10 monclient: get_auth_request con 0x7f4f58070b10 auth_method 0 2024-09-12T00:39:24.364 INFO:tasks.workunit.client.0.smithi043.stderr: -385> 2024-09-12T00:39:23.952+0000 7f5073525640 10 monclient: get_auth_request con 0x55f8e7640940 auth_method 0 2024-09-12T00:39:24.364 INFO:tasks.workunit.client.0.smithi043.stderr: -384> 2024-09-12T00:39:23.952+0000 7f5072d24640 10 monclient: get_auth_request con 0x55f8e7658a70 auth_method 0 2024-09-12T00:39:24.364 INFO:tasks.workunit.client.0.smithi043.stderr: -383> 2024-09-12T00:39:23.956+0000 7f5072523640 10 monclient: get_auth_request con 0x55f8e765cdd0 auth_method 0 2024-09-12T00:39:24.364 INFO:tasks.workunit.client.0.smithi043.stderr: -382> 2024-09-12T00:39:23.956+0000 7f507521e9c0 10 monclient: build_initial_monmap 2024-09-12T00:39:24.364 INFO:tasks.workunit.client.0.smithi043.stderr: -381> 2024-09-12T00:39:23.956+0000 7f507521e9c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:24.364 INFO:tasks.workunit.client.0.smithi043.stderr: -380> 2024-09-12T00:39:23.956+0000 7f507521e9c0 10 monclient: monmap: 2024-09-12T00:39:24.364 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:39:24.364 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:24.365 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:39:24.365 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:39:24.365 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:24.365 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:24.365 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:39:24.365 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:39:24.365 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:39:24.365 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.365 INFO:tasks.workunit.client.0.smithi043.stderr: -379> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7661cb0) adding auth protocol: cephx 2024-09-12T00:39:24.365 INFO:tasks.workunit.client.0.smithi043.stderr: -378> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7661cb0) adding auth protocol: cephx 2024-09-12T00:39:24.365 INFO:tasks.workunit.client.0.smithi043.stderr: -377> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7661cb0) adding auth protocol: cephx 2024-09-12T00:39:24.365 INFO:tasks.workunit.client.0.smithi043.stderr: -376> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7661cb0) adding con mode: secure 2024-09-12T00:39:24.365 INFO:tasks.workunit.client.0.smithi043.stderr: -375> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7661cb0) adding con mode: crc 2024-09-12T00:39:24.366 INFO:tasks.workunit.client.0.smithi043.stderr: -374> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7661cb0) adding con mode: secure 2024-09-12T00:39:24.366 INFO:tasks.workunit.client.0.smithi043.stderr: -373> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7661cb0) adding con mode: crc 2024-09-12T00:39:24.366 INFO:tasks.workunit.client.0.smithi043.stderr: -372> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7661cb0) adding con mode: secure 2024-09-12T00:39:24.366 INFO:tasks.workunit.client.0.smithi043.stderr: -371> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7661cb0) adding con mode: crc 2024-09-12T00:39:24.366 INFO:tasks.workunit.client.0.smithi043.stderr: -370> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7661cb0) adding con mode: crc 2024-09-12T00:39:24.366 INFO:tasks.workunit.client.0.smithi043.stderr: -369> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7661cb0) adding con mode: secure 2024-09-12T00:39:24.366 INFO:tasks.workunit.client.0.smithi043.stderr: -368> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7661cb0) adding con mode: crc 2024-09-12T00:39:24.366 INFO:tasks.workunit.client.0.smithi043.stderr: -367> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7661cb0) adding con mode: secure 2024-09-12T00:39:24.366 INFO:tasks.workunit.client.0.smithi043.stderr: -366> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7661cb0) adding con mode: crc 2024-09-12T00:39:24.366 INFO:tasks.workunit.client.0.smithi043.stderr: -365> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7661cb0) adding con mode: secure 2024-09-12T00:39:24.366 INFO:tasks.workunit.client.0.smithi043.stderr: -364> 2024-09-12T00:39:23.956+0000 7f507521e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:24.366 INFO:tasks.workunit.client.0.smithi043.stderr: -363> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command objecter_requests cmddesc objecter_requests hook 0x55f8e7665600 EEXIST 2024-09-12T00:39:24.367 INFO:tasks.workunit.client.0.smithi043.stderr: -362> 2024-09-12T00:39:23.956+0000 7f507521e9c0 10 monclient: init 2024-09-12T00:39:24.367 INFO:tasks.workunit.client.0.smithi043.stderr: -361> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7660278) adding auth protocol: cephx 2024-09-12T00:39:24.367 INFO:tasks.workunit.client.0.smithi043.stderr: -360> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7660278) adding auth protocol: cephx 2024-09-12T00:39:24.367 INFO:tasks.workunit.client.0.smithi043.stderr: -359> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7660278) adding auth protocol: cephx 2024-09-12T00:39:24.367 INFO:tasks.workunit.client.0.smithi043.stderr: -358> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7660278) adding con mode: secure 2024-09-12T00:39:24.367 INFO:tasks.workunit.client.0.smithi043.stderr: -357> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7660278) adding con mode: crc 2024-09-12T00:39:24.367 INFO:tasks.workunit.client.0.smithi043.stderr: -356> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7660278) adding con mode: secure 2024-09-12T00:39:24.367 INFO:tasks.workunit.client.0.smithi043.stderr: -355> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7660278) adding con mode: crc 2024-09-12T00:39:24.367 INFO:tasks.workunit.client.0.smithi043.stderr: -354> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7660278) adding con mode: secure 2024-09-12T00:39:24.367 INFO:tasks.workunit.client.0.smithi043.stderr: -353> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7660278) adding con mode: crc 2024-09-12T00:39:24.367 INFO:tasks.workunit.client.0.smithi043.stderr: -352> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7660278) adding con mode: crc 2024-09-12T00:39:24.367 INFO:tasks.workunit.client.0.smithi043.stderr: -351> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7660278) adding con mode: secure 2024-09-12T00:39:24.368 INFO:tasks.workunit.client.0.smithi043.stderr: -350> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7660278) adding con mode: crc 2024-09-12T00:39:24.368 INFO:tasks.workunit.client.0.smithi043.stderr: -349> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7660278) adding con mode: secure 2024-09-12T00:39:24.368 INFO:tasks.workunit.client.0.smithi043.stderr: -348> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7660278) adding con mode: crc 2024-09-12T00:39:24.368 INFO:tasks.workunit.client.0.smithi043.stderr: -347> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 AuthRegistry(0x55f8e7660278) adding con mode: secure 2024-09-12T00:39:24.368 INFO:tasks.workunit.client.0.smithi043.stderr: -346> 2024-09-12T00:39:23.956+0000 7f507521e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:24.368 INFO:tasks.workunit.client.0.smithi043.stderr: -345> 2024-09-12T00:39:23.956+0000 7f507521e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:24.368 INFO:tasks.workunit.client.0.smithi043.stderr: -344> 2024-09-12T00:39:23.956+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command rotate-key cmddesc rotate-key hook 0x55f8e76603c0 EEXIST 2024-09-12T00:39:24.368 INFO:tasks.workunit.client.0.smithi043.stderr: -343> 2024-09-12T00:39:23.956+0000 7f507521e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:24.368 INFO:tasks.workunit.client.0.smithi043.stderr: -342> 2024-09-12T00:39:23.956+0000 7f507521e9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:39:24.368 INFO:tasks.workunit.client.0.smithi043.stderr: -341> 2024-09-12T00:39:23.956+0000 7f507521e9c0 10 monclient(hunting): picked mon.noname-a con 0x55f8e76897b0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:39:24.368 INFO:tasks.workunit.client.0.smithi043.stderr: -340> 2024-09-12T00:39:23.956+0000 7f507521e9c0 10 monclient(hunting): picked mon.noname-c con 0x55f8e76890e0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:39:24.368 INFO:tasks.workunit.client.0.smithi043.stderr: -339> 2024-09-12T00:39:23.956+0000 7f507521e9c0 10 monclient(hunting): picked mon.noname-b con 0x55f8e7687ac0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:39:24.369 INFO:tasks.workunit.client.0.smithi043.stderr: -338> 2024-09-12T00:39:23.956+0000 7f507521e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:24.369 INFO:tasks.workunit.client.0.smithi043.stderr: -337> 2024-09-12T00:39:23.956+0000 7f507521e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:24.369 INFO:tasks.workunit.client.0.smithi043.stderr: -336> 2024-09-12T00:39:23.956+0000 7f507521e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:24.369 INFO:tasks.workunit.client.0.smithi043.stderr: -335> 2024-09-12T00:39:23.956+0000 7f507521e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:24.369 INFO:tasks.workunit.client.0.smithi043.stderr: -334> 2024-09-12T00:39:23.956+0000 7f507521e9c0 10 monclient(hunting): authenticate will time out at 2259.947654s 2024-09-12T00:39:24.369 INFO:tasks.workunit.client.0.smithi043.stderr: -333> 2024-09-12T00:39:23.956+0000 7f5072523640 10 monclient(hunting): get_auth_request con 0x55f8e76890e0 auth_method 0 2024-09-12T00:39:24.369 INFO:tasks.workunit.client.0.smithi043.stderr: -332> 2024-09-12T00:39:23.956+0000 7f5072523640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:24.369 INFO:tasks.workunit.client.0.smithi043.stderr: -331> 2024-09-12T00:39:23.956+0000 7f5072523640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:24.369 INFO:tasks.workunit.client.0.smithi043.stderr: -330> 2024-09-12T00:39:23.956+0000 7f5072523640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:24.369 INFO:tasks.workunit.client.0.smithi043.stderr: -329> 2024-09-12T00:39:23.956+0000 7f5072d24640 10 monclient(hunting): get_auth_request con 0x55f8e76897b0 auth_method 0 2024-09-12T00:39:24.369 INFO:tasks.workunit.client.0.smithi043.stderr: -328> 2024-09-12T00:39:23.956+0000 7f5072d24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:24.369 INFO:tasks.workunit.client.0.smithi043.stderr: -327> 2024-09-12T00:39:23.956+0000 7f5072d24640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:24.370 INFO:tasks.workunit.client.0.smithi043.stderr: -326> 2024-09-12T00:39:23.956+0000 7f5072d24640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:24.370 INFO:tasks.workunit.client.0.smithi043.stderr: -325> 2024-09-12T00:39:23.956+0000 7f5072523640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:24.370 INFO:tasks.workunit.client.0.smithi043.stderr: -324> 2024-09-12T00:39:23.956+0000 7f5072523640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:24.370 INFO:tasks.workunit.client.0.smithi043.stderr: -323> 2024-09-12T00:39:23.956+0000 7f5072523640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:24.370 INFO:tasks.workunit.client.0.smithi043.stderr: -322> 2024-09-12T00:39:23.956+0000 7f5072d24640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:24.370 INFO:tasks.workunit.client.0.smithi043.stderr: -321> 2024-09-12T00:39:23.956+0000 7f5072d24640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:24.370 INFO:tasks.workunit.client.0.smithi043.stderr: -320> 2024-09-12T00:39:23.956+0000 7f5072d24640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:24.370 INFO:tasks.workunit.client.0.smithi043.stderr: -319> 2024-09-12T00:39:23.960+0000 7f5072523640 10 monclient(hunting): handle_auth_done global_id 7121 payload 824 2024-09-12T00:39:24.370 INFO:tasks.workunit.client.0.smithi043.stderr: -318> 2024-09-12T00:39:23.960+0000 7f5072523640 10 monclient: _finish_hunting 0 2024-09-12T00:39:24.370 INFO:tasks.workunit.client.0.smithi043.stderr: -317> 2024-09-12T00:39:23.960+0000 7f5072523640 1 monclient: found mon.noname-c 2024-09-12T00:39:24.370 INFO:tasks.workunit.client.0.smithi043.stderr: -316> 2024-09-12T00:39:23.960+0000 7f5072523640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:39:24.370 INFO:tasks.workunit.client.0.smithi043.stderr: -315> 2024-09-12T00:39:23.960+0000 7f4f5ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:24.370 INFO:tasks.workunit.client.0.smithi043.stderr: -314> 2024-09-12T00:39:23.960+0000 7f4f5ce01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:39:24.371 INFO:tasks.workunit.client.0.smithi043.stderr: -313> 2024-09-12T00:39:23.960+0000 7f4f5ce01640 10 monclient: dump: 2024-09-12T00:39:24.371 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:24.371 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:24.371 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.371 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.371 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:24.371 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:24.371 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:24.371 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:24.371 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:24.371 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.371 INFO:tasks.workunit.client.0.smithi043.stderr: -312> 2024-09-12T00:39:23.960+0000 7f4f5ce01640 10 monclient: _finish_auth 0 2024-09-12T00:39:24.372 INFO:tasks.workunit.client.0.smithi043.stderr: -311> 2024-09-12T00:39:23.960+0000 7f4f5ce01640 10 monclient: _check_auth_tickets 2024-09-12T00:39:24.372 INFO:tasks.workunit.client.0.smithi043.stderr: -310> 2024-09-12T00:39:23.960+0000 7f4f5ce01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:24.372 INFO:tasks.workunit.client.0.smithi043.stderr: -309> 2024-09-12T00:39:23.960+0000 7f4f5ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:24.372 INFO:tasks.workunit.client.0.smithi043.stderr: -308> 2024-09-12T00:39:23.960+0000 7f4f5ce01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:39:24.372 INFO:tasks.workunit.client.0.smithi043.stderr: -307> 2024-09-12T00:39:23.960+0000 7f4f5ce01640 10 monclient: dump: 2024-09-12T00:39:24.372 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:24.372 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:24.372 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.372 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.372 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:24.372 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:24.372 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:24.372 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:24.373 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:24.373 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.373 INFO:tasks.workunit.client.0.smithi043.stderr: -306> 2024-09-12T00:39:23.960+0000 7f5073d26640 4 set_mon_vals no callback set 2024-09-12T00:39:24.373 INFO:tasks.workunit.client.0.smithi043.stderr: -305> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 monclient: authenticate success, global_id 7121 2024-09-12T00:39:24.373 INFO:tasks.workunit.client.0.smithi043.stderr: -304> 2024-09-12T00:39:23.960+0000 7f507521e9c0 10 monclient: _renew_subs 2024-09-12T00:39:24.373 INFO:tasks.workunit.client.0.smithi043.stderr: -303> 2024-09-12T00:39:23.960+0000 7f507521e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:39:24.373 INFO:tasks.workunit.client.0.smithi043.stderr: -302> 2024-09-12T00:39:23.960+0000 7f507521e9c0 10 monclient: _renew_subs 2024-09-12T00:39:24.373 INFO:tasks.workunit.client.0.smithi043.stderr: -301> 2024-09-12T00:39:23.960+0000 7f507521e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:39:24.373 INFO:tasks.workunit.client.0.smithi043.stderr: -300> 2024-09-12T00:39:23.960+0000 7f4f5ce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:24.373 INFO:tasks.workunit.client.0.smithi043.stderr: -299> 2024-09-12T00:39:23.960+0000 7f4f5ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:39:24.373 INFO:tasks.workunit.client.0.smithi043.stderr: -298> 2024-09-12T00:39:23.960+0000 7f4f5ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:39:24.373 INFO:tasks.workunit.client.0.smithi043.stderr: -297> 2024-09-12T00:39:23.960+0000 7f5072d24640 10 monclient: get_auth_request con 0x7f4f4c070a20 auth_method 0 2024-09-12T00:39:24.374 INFO:tasks.workunit.client.0.smithi043.stderr: -296> 2024-09-12T00:39:23.960+0000 7f507521e9c0 10 monclient: get_monmap_and_config 2024-09-12T00:39:24.374 INFO:tasks.workunit.client.0.smithi043.stderr: -295> 2024-09-12T00:39:23.960+0000 7f507521e9c0 10 monclient: build_initial_monmap 2024-09-12T00:39:24.374 INFO:tasks.workunit.client.0.smithi043.stderr: -294> 2024-09-12T00:39:23.960+0000 7f507521e9c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:24.374 INFO:tasks.workunit.client.0.smithi043.stderr: -293> 2024-09-12T00:39:23.960+0000 7f507521e9c0 10 monclient: monmap: 2024-09-12T00:39:24.374 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:39:24.374 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:24.374 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:39:24.374 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:39:24.374 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:24.374 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:24.374 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:39:24.374 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:39:24.374 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:39:24.375 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.375 INFO:tasks.workunit.client.0.smithi043.stderr: -292> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76a8cc0) adding auth protocol: cephx 2024-09-12T00:39:24.375 INFO:tasks.workunit.client.0.smithi043.stderr: -291> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76a8cc0) adding auth protocol: cephx 2024-09-12T00:39:24.375 INFO:tasks.workunit.client.0.smithi043.stderr: -290> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76a8cc0) adding auth protocol: cephx 2024-09-12T00:39:24.375 INFO:tasks.workunit.client.0.smithi043.stderr: -289> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76a8cc0) adding con mode: secure 2024-09-12T00:39:24.375 INFO:tasks.workunit.client.0.smithi043.stderr: -288> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76a8cc0) adding con mode: crc 2024-09-12T00:39:24.375 INFO:tasks.workunit.client.0.smithi043.stderr: -287> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76a8cc0) adding con mode: secure 2024-09-12T00:39:24.375 INFO:tasks.workunit.client.0.smithi043.stderr: -286> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76a8cc0) adding con mode: crc 2024-09-12T00:39:24.375 INFO:tasks.workunit.client.0.smithi043.stderr: -285> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76a8cc0) adding con mode: secure 2024-09-12T00:39:24.375 INFO:tasks.workunit.client.0.smithi043.stderr: -284> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76a8cc0) adding con mode: crc 2024-09-12T00:39:24.375 INFO:tasks.workunit.client.0.smithi043.stderr: -283> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76a8cc0) adding con mode: crc 2024-09-12T00:39:24.375 INFO:tasks.workunit.client.0.smithi043.stderr: -282> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76a8cc0) adding con mode: secure 2024-09-12T00:39:24.375 INFO:tasks.workunit.client.0.smithi043.stderr: -281> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76a8cc0) adding con mode: crc 2024-09-12T00:39:24.376 INFO:tasks.workunit.client.0.smithi043.stderr: -280> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76a8cc0) adding con mode: secure 2024-09-12T00:39:24.376 INFO:tasks.workunit.client.0.smithi043.stderr: -279> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76a8cc0) adding con mode: crc 2024-09-12T00:39:24.376 INFO:tasks.workunit.client.0.smithi043.stderr: -278> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76a8cc0) adding con mode: secure 2024-09-12T00:39:24.376 INFO:tasks.workunit.client.0.smithi043.stderr: -277> 2024-09-12T00:39:23.960+0000 7f507521e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:24.376 INFO:tasks.workunit.client.0.smithi043.stderr: -276> 2024-09-12T00:39:23.960+0000 7f507521e9c0 10 monclient: init 2024-09-12T00:39:24.376 INFO:tasks.workunit.client.0.smithi043.stderr: -275> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c440) adding auth protocol: cephx 2024-09-12T00:39:24.376 INFO:tasks.workunit.client.0.smithi043.stderr: -274> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c440) adding auth protocol: cephx 2024-09-12T00:39:24.376 INFO:tasks.workunit.client.0.smithi043.stderr: -273> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c440) adding auth protocol: cephx 2024-09-12T00:39:24.376 INFO:tasks.workunit.client.0.smithi043.stderr: -272> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c440) adding con mode: secure 2024-09-12T00:39:24.376 INFO:tasks.workunit.client.0.smithi043.stderr: -271> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c440) adding con mode: crc 2024-09-12T00:39:24.377 INFO:tasks.workunit.client.0.smithi043.stderr: -270> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c440) adding con mode: secure 2024-09-12T00:39:24.377 INFO:tasks.workunit.client.0.smithi043.stderr: -269> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c440) adding con mode: crc 2024-09-12T00:39:24.377 INFO:tasks.workunit.client.0.smithi043.stderr: -268> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c440) adding con mode: secure 2024-09-12T00:39:24.377 INFO:tasks.workunit.client.0.smithi043.stderr: -267> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c440) adding con mode: crc 2024-09-12T00:39:24.377 INFO:tasks.workunit.client.0.smithi043.stderr: -266> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c440) adding con mode: crc 2024-09-12T00:39:24.377 INFO:tasks.workunit.client.0.smithi043.stderr: -265> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c440) adding con mode: secure 2024-09-12T00:39:24.377 INFO:tasks.workunit.client.0.smithi043.stderr: -264> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c440) adding con mode: crc 2024-09-12T00:39:24.377 INFO:tasks.workunit.client.0.smithi043.stderr: -263> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c440) adding con mode: secure 2024-09-12T00:39:24.377 INFO:tasks.workunit.client.0.smithi043.stderr: -262> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c440) adding con mode: crc 2024-09-12T00:39:24.377 INFO:tasks.workunit.client.0.smithi043.stderr: -261> 2024-09-12T00:39:23.960+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c440) adding con mode: secure 2024-09-12T00:39:24.378 INFO:tasks.workunit.client.0.smithi043.stderr: -260> 2024-09-12T00:39:23.960+0000 7f507521e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:24.378 INFO:tasks.workunit.client.0.smithi043.stderr: -259> 2024-09-12T00:39:23.964+0000 7f507521e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:24.378 INFO:tasks.workunit.client.0.smithi043.stderr: -258> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe7391c588 EEXIST 2024-09-12T00:39:24.378 INFO:tasks.workunit.client.0.smithi043.stderr: -257> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:24.378 INFO:tasks.workunit.client.0.smithi043.stderr: -256> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:39:24.378 INFO:tasks.workunit.client.0.smithi043.stderr: -255> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): picked mon.noname-c con 0x55f8e76d72d0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:39:24.378 INFO:tasks.workunit.client.0.smithi043.stderr: -254> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): picked mon.noname-a con 0x55f8e76d76b0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:39:24.378 INFO:tasks.workunit.client.0.smithi043.stderr: -253> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): picked mon.noname-b con 0x55f8e76d8b70 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:39:24.378 INFO:tasks.workunit.client.0.smithi043.stderr: -252> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:24.378 INFO:tasks.workunit.client.0.smithi043.stderr: -251> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:24.378 INFO:tasks.workunit.client.0.smithi043.stderr: -250> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:24.378 INFO:tasks.workunit.client.0.smithi043.stderr: -249> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:24.379 INFO:tasks.workunit.client.0.smithi043.stderr: -248> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): authenticate will time out at 2259.952304s 2024-09-12T00:39:24.379 INFO:tasks.workunit.client.0.smithi043.stderr: -247> 2024-09-12T00:39:23.964+0000 7f5072d24640 10 monclient(hunting): get_auth_request con 0x55f8e76d72d0 auth_method 0 2024-09-12T00:39:24.379 INFO:tasks.workunit.client.0.smithi043.stderr: -246> 2024-09-12T00:39:23.964+0000 7f5072d24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:24.379 INFO:tasks.workunit.client.0.smithi043.stderr: -245> 2024-09-12T00:39:23.964+0000 7f5072d24640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:24.379 INFO:tasks.workunit.client.0.smithi043.stderr: -244> 2024-09-12T00:39:23.964+0000 7f5072d24640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:24.379 INFO:tasks.workunit.client.0.smithi043.stderr: -243> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient(hunting): get_auth_request con 0x55f8e76d76b0 auth_method 0 2024-09-12T00:39:24.379 INFO:tasks.workunit.client.0.smithi043.stderr: -242> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:24.379 INFO:tasks.workunit.client.0.smithi043.stderr: -241> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:24.379 INFO:tasks.workunit.client.0.smithi043.stderr: -240> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:24.379 INFO:tasks.workunit.client.0.smithi043.stderr: -239> 2024-09-12T00:39:23.964+0000 7f5072d24640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:24.379 INFO:tasks.workunit.client.0.smithi043.stderr: -238> 2024-09-12T00:39:23.964+0000 7f5072d24640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:24.379 INFO:tasks.workunit.client.0.smithi043.stderr: -237> 2024-09-12T00:39:23.964+0000 7f5072d24640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:24.379 INFO:tasks.workunit.client.0.smithi043.stderr: -236> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:24.380 INFO:tasks.workunit.client.0.smithi043.stderr: -235> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:24.380 INFO:tasks.workunit.client.0.smithi043.stderr: -234> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:24.380 INFO:tasks.workunit.client.0.smithi043.stderr: -233> 2024-09-12T00:39:23.964+0000 7f5072d24640 10 monclient(hunting): handle_auth_done global_id 7124 payload 274 2024-09-12T00:39:24.380 INFO:tasks.workunit.client.0.smithi043.stderr: -232> 2024-09-12T00:39:23.964+0000 7f5072d24640 10 monclient: _finish_hunting 0 2024-09-12T00:39:24.380 INFO:tasks.workunit.client.0.smithi043.stderr: -231> 2024-09-12T00:39:23.964+0000 7f5072d24640 1 monclient: found mon.noname-c 2024-09-12T00:39:24.380 INFO:tasks.workunit.client.0.smithi043.stderr: -230> 2024-09-12T00:39:23.964+0000 7f5072d24640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:39:24.380 INFO:tasks.workunit.client.0.smithi043.stderr: -229> 2024-09-12T00:39:23.964+0000 7f4f567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:24.380 INFO:tasks.workunit.client.0.smithi043.stderr: -228> 2024-09-12T00:39:23.964+0000 7f4f567fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:39:24.380 INFO:tasks.workunit.client.0.smithi043.stderr: -227> 2024-09-12T00:39:23.964+0000 7f4f567fc640 10 monclient: dump: 2024-09-12T00:39:24.380 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:24.380 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:24.381 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.381 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.381 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:24.381 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:24.381 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:24.381 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:24.381 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:24.381 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.381 INFO:tasks.workunit.client.0.smithi043.stderr: -226> 2024-09-12T00:39:23.964+0000 7f4f567fc640 10 monclient: _finish_auth 0 2024-09-12T00:39:24.381 INFO:tasks.workunit.client.0.smithi043.stderr: -225> 2024-09-12T00:39:23.964+0000 7f4f567fc640 10 monclient: _check_auth_tickets 2024-09-12T00:39:24.381 INFO:tasks.workunit.client.0.smithi043.stderr: -224> 2024-09-12T00:39:23.964+0000 7f4f567fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:24.381 INFO:tasks.workunit.client.0.smithi043.stderr: -223> 2024-09-12T00:39:23.964+0000 7f4f567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:24.382 INFO:tasks.workunit.client.0.smithi043.stderr: -222> 2024-09-12T00:39:23.964+0000 7f4f567fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:39:24.382 INFO:tasks.workunit.client.0.smithi043.stderr: -221> 2024-09-12T00:39:23.964+0000 7f4f567fc640 10 monclient: dump: 2024-09-12T00:39:24.382 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:24.382 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:24.382 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.382 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.382 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:24.382 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:24.382 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:24.382 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:24.382 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:24.382 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.382 INFO:tasks.workunit.client.0.smithi043.stderr: -220> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 monclient: authenticate success, global_id 7124 2024-09-12T00:39:24.383 INFO:tasks.workunit.client.0.smithi043.stderr: -219> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:39:24.383 INFO:tasks.workunit.client.0.smithi043.stderr: -218> 2024-09-12T00:39:23.964+0000 7f507521e9c0 4 set_mon_vals no callback set 2024-09-12T00:39:24.383 INFO:tasks.workunit.client.0.smithi043.stderr: -217> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient: shutdown 2024-09-12T00:39:24.383 INFO:tasks.workunit.client.0.smithi043.stderr: -216> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient: build_initial_monmap 2024-09-12T00:39:24.383 INFO:tasks.workunit.client.0.smithi043.stderr: -215> 2024-09-12T00:39:23.964+0000 7f507521e9c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:24.383 INFO:tasks.workunit.client.0.smithi043.stderr: -214> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient: monmap: 2024-09-12T00:39:24.383 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:39:24.383 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:24.383 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:39:24.383 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:39:24.383 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:24.383 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:24.384 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:39:24.384 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:39:24.384 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:39:24.384 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.384 INFO:tasks.workunit.client.0.smithi043.stderr: -213> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76cf7f0) adding auth protocol: cephx 2024-09-12T00:39:24.384 INFO:tasks.workunit.client.0.smithi043.stderr: -212> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76cf7f0) adding auth protocol: cephx 2024-09-12T00:39:24.384 INFO:tasks.workunit.client.0.smithi043.stderr: -211> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76cf7f0) adding auth protocol: cephx 2024-09-12T00:39:24.384 INFO:tasks.workunit.client.0.smithi043.stderr: -210> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76cf7f0) adding con mode: secure 2024-09-12T00:39:24.385 INFO:tasks.workunit.client.0.smithi043.stderr: -209> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76cf7f0) adding con mode: crc 2024-09-12T00:39:24.385 INFO:tasks.workunit.client.0.smithi043.stderr: -208> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76cf7f0) adding con mode: secure 2024-09-12T00:39:24.385 INFO:tasks.workunit.client.0.smithi043.stderr: -207> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76cf7f0) adding con mode: crc 2024-09-12T00:39:24.385 INFO:tasks.workunit.client.0.smithi043.stderr: -206> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76cf7f0) adding con mode: secure 2024-09-12T00:39:24.385 INFO:tasks.workunit.client.0.smithi043.stderr: -205> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76cf7f0) adding con mode: crc 2024-09-12T00:39:24.385 INFO:tasks.workunit.client.0.smithi043.stderr: -204> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76cf7f0) adding con mode: crc 2024-09-12T00:39:24.385 INFO:tasks.workunit.client.0.smithi043.stderr: -203> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76cf7f0) adding con mode: secure 2024-09-12T00:39:24.385 INFO:tasks.workunit.client.0.smithi043.stderr: -202> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76cf7f0) adding con mode: crc 2024-09-12T00:39:24.385 INFO:tasks.workunit.client.0.smithi043.stderr: -201> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76cf7f0) adding con mode: secure 2024-09-12T00:39:24.385 INFO:tasks.workunit.client.0.smithi043.stderr: -200> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76cf7f0) adding con mode: crc 2024-09-12T00:39:24.385 INFO:tasks.workunit.client.0.smithi043.stderr: -199> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e76cf7f0) adding con mode: secure 2024-09-12T00:39:24.386 INFO:tasks.workunit.client.0.smithi043.stderr: -198> 2024-09-12T00:39:23.964+0000 7f507521e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:24.386 INFO:tasks.workunit.client.0.smithi043.stderr: -197> 2024-09-12T00:39:23.964+0000 7f507521e9c0 1 librados: starting msgr at 2024-09-12T00:39:24.386 INFO:tasks.workunit.client.0.smithi043.stderr: -196> 2024-09-12T00:39:23.964+0000 7f507521e9c0 1 librados: starting objecter 2024-09-12T00:39:24.386 INFO:tasks.workunit.client.0.smithi043.stderr: -195> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command objecter_requests cmddesc objecter_requests hook 0x55f8e76ce900 EEXIST 2024-09-12T00:39:24.386 INFO:tasks.workunit.client.0.smithi043.stderr: -194> 2024-09-12T00:39:23.964+0000 7f507521e9c0 1 librados: setting wanted keys 2024-09-12T00:39:24.386 INFO:tasks.workunit.client.0.smithi043.stderr: -193> 2024-09-12T00:39:23.964+0000 7f507521e9c0 1 librados: calling monclient init 2024-09-12T00:39:24.386 INFO:tasks.workunit.client.0.smithi043.stderr: -192> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient: init 2024-09-12T00:39:24.386 INFO:tasks.workunit.client.0.smithi043.stderr: -191> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e768b5d0) adding auth protocol: cephx 2024-09-12T00:39:24.386 INFO:tasks.workunit.client.0.smithi043.stderr: -190> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e768b5d0) adding auth protocol: cephx 2024-09-12T00:39:24.386 INFO:tasks.workunit.client.0.smithi043.stderr: -189> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e768b5d0) adding auth protocol: cephx 2024-09-12T00:39:24.386 INFO:tasks.workunit.client.0.smithi043.stderr: -188> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e768b5d0) adding con mode: secure 2024-09-12T00:39:24.386 INFO:tasks.workunit.client.0.smithi043.stderr: -187> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e768b5d0) adding con mode: crc 2024-09-12T00:39:24.387 INFO:tasks.workunit.client.0.smithi043.stderr: -186> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e768b5d0) adding con mode: secure 2024-09-12T00:39:24.387 INFO:tasks.workunit.client.0.smithi043.stderr: -185> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e768b5d0) adding con mode: crc 2024-09-12T00:39:24.387 INFO:tasks.workunit.client.0.smithi043.stderr: -184> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e768b5d0) adding con mode: secure 2024-09-12T00:39:24.387 INFO:tasks.workunit.client.0.smithi043.stderr: -183> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e768b5d0) adding con mode: crc 2024-09-12T00:39:24.387 INFO:tasks.workunit.client.0.smithi043.stderr: -182> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e768b5d0) adding con mode: crc 2024-09-12T00:39:24.387 INFO:tasks.workunit.client.0.smithi043.stderr: -181> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e768b5d0) adding con mode: secure 2024-09-12T00:39:24.388 INFO:tasks.workunit.client.0.smithi043.stderr: -180> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e768b5d0) adding con mode: crc 2024-09-12T00:39:24.388 INFO:tasks.workunit.client.0.smithi043.stderr: -179> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e768b5d0) adding con mode: secure 2024-09-12T00:39:24.388 INFO:tasks.workunit.client.0.smithi043.stderr: -178> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e768b5d0) adding con mode: crc 2024-09-12T00:39:24.388 INFO:tasks.workunit.client.0.smithi043.stderr: -177> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 AuthRegistry(0x55f8e768b5d0) adding con mode: secure 2024-09-12T00:39:24.388 INFO:tasks.workunit.client.0.smithi043.stderr: -176> 2024-09-12T00:39:23.964+0000 7f507521e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:24.388 INFO:tasks.workunit.client.0.smithi043.stderr: -175> 2024-09-12T00:39:23.964+0000 7f507521e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:24.388 INFO:tasks.workunit.client.0.smithi043.stderr: -174> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command rotate-key cmddesc rotate-key hook 0x55f8e768b718 EEXIST 2024-09-12T00:39:24.388 INFO:tasks.workunit.client.0.smithi043.stderr: -173> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:24.388 INFO:tasks.workunit.client.0.smithi043.stderr: -172> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:39:24.388 INFO:tasks.workunit.client.0.smithi043.stderr: -171> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): picked mon.noname-b con 0x55f8e76d72d0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:39:24.388 INFO:tasks.workunit.client.0.smithi043.stderr: -170> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): picked mon.noname-a con 0x55f8e76d8b70 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:39:24.388 INFO:tasks.workunit.client.0.smithi043.stderr: -169> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): picked mon.noname-c con 0x55f8e76d6600 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:39:24.388 INFO:tasks.workunit.client.0.smithi043.stderr: -168> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:24.389 INFO:tasks.workunit.client.0.smithi043.stderr: -167> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:24.389 INFO:tasks.workunit.client.0.smithi043.stderr: -166> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:24.389 INFO:tasks.workunit.client.0.smithi043.stderr: -165> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:24.389 INFO:tasks.workunit.client.0.smithi043.stderr: -164> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient(hunting): authenticate will time out at 2259.954992s 2024-09-12T00:39:24.389 INFO:tasks.workunit.client.0.smithi043.stderr: -163> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient(hunting): get_auth_request con 0x55f8e76d8b70 auth_method 0 2024-09-12T00:39:24.389 INFO:tasks.workunit.client.0.smithi043.stderr: -162> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:24.389 INFO:tasks.workunit.client.0.smithi043.stderr: -161> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:24.389 INFO:tasks.workunit.client.0.smithi043.stderr: -160> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:24.389 INFO:tasks.workunit.client.0.smithi043.stderr: -159> 2024-09-12T00:39:23.964+0000 7f5073525640 10 monclient(hunting): get_auth_request con 0x55f8e76d6600 auth_method 0 2024-09-12T00:39:24.389 INFO:tasks.workunit.client.0.smithi043.stderr: -158> 2024-09-12T00:39:23.964+0000 7f5073525640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:24.389 INFO:tasks.workunit.client.0.smithi043.stderr: -157> 2024-09-12T00:39:23.964+0000 7f5073525640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:24.389 INFO:tasks.workunit.client.0.smithi043.stderr: -156> 2024-09-12T00:39:23.964+0000 7f5073525640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:24.389 INFO:tasks.workunit.client.0.smithi043.stderr: -155> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:24.390 INFO:tasks.workunit.client.0.smithi043.stderr: -154> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:24.390 INFO:tasks.workunit.client.0.smithi043.stderr: -153> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:24.390 INFO:tasks.workunit.client.0.smithi043.stderr: -152> 2024-09-12T00:39:23.964+0000 7f5073525640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:24.390 INFO:tasks.workunit.client.0.smithi043.stderr: -151> 2024-09-12T00:39:23.964+0000 7f5073525640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:24.390 INFO:tasks.workunit.client.0.smithi043.stderr: -150> 2024-09-12T00:39:23.964+0000 7f5073525640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:24.390 INFO:tasks.workunit.client.0.smithi043.stderr: -149> 2024-09-12T00:39:23.964+0000 7f5072d24640 10 monclient(hunting): get_auth_request con 0x55f8e76d72d0 auth_method 0 2024-09-12T00:39:24.390 INFO:tasks.workunit.client.0.smithi043.stderr: -148> 2024-09-12T00:39:23.964+0000 7f5072d24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:24.390 INFO:tasks.workunit.client.0.smithi043.stderr: -147> 2024-09-12T00:39:23.964+0000 7f5072d24640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:24.390 INFO:tasks.workunit.client.0.smithi043.stderr: -146> 2024-09-12T00:39:23.964+0000 7f5072d24640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:24.390 INFO:tasks.workunit.client.0.smithi043.stderr: -145> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient(hunting): handle_auth_done global_id 7449 payload 824 2024-09-12T00:39:24.390 INFO:tasks.workunit.client.0.smithi043.stderr: -144> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient: _finish_hunting 0 2024-09-12T00:39:24.390 INFO:tasks.workunit.client.0.smithi043.stderr: -143> 2024-09-12T00:39:23.964+0000 7f5072523640 1 monclient: found mon.noname-a 2024-09-12T00:39:24.391 INFO:tasks.workunit.client.0.smithi043.stderr: -142> 2024-09-12T00:39:23.964+0000 7f5072523640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:39:24.391 INFO:tasks.workunit.client.0.smithi043.stderr: -141> 2024-09-12T00:39:23.964+0000 7f4f54ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:24.391 INFO:tasks.workunit.client.0.smithi043.stderr: -140> 2024-09-12T00:39:23.964+0000 7f4f54ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:39:24.391 INFO:tasks.workunit.client.0.smithi043.stderr: -139> 2024-09-12T00:39:23.964+0000 7f4f54ff9640 10 monclient: dump: 2024-09-12T00:39:24.391 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:24.391 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:24.391 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.391 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.391 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:24.391 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:24.391 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:24.391 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:24.391 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:24.392 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.392 INFO:tasks.workunit.client.0.smithi043.stderr: -138> 2024-09-12T00:39:23.964+0000 7f4f54ff9640 10 monclient: _finish_auth 0 2024-09-12T00:39:24.392 INFO:tasks.workunit.client.0.smithi043.stderr: -137> 2024-09-12T00:39:23.964+0000 7f4f54ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:39:24.392 INFO:tasks.workunit.client.0.smithi043.stderr: -136> 2024-09-12T00:39:23.964+0000 7f4f54ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:24.392 INFO:tasks.workunit.client.0.smithi043.stderr: -135> 2024-09-12T00:39:23.964+0000 7f4f54ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:24.392 INFO:tasks.workunit.client.0.smithi043.stderr: -134> 2024-09-12T00:39:23.964+0000 7f4f54ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:24.392 INFO:tasks.workunit.client.0.smithi043.stderr: -133> 2024-09-12T00:39:23.964+0000 7f4f54ff9640 10 monclient: dump: 2024-09-12T00:39:24.392 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:24.392 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:24.392 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.392 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:24.392 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:24.392 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:24.393 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:24.393 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:24.393 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:24.393 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.393 INFO:tasks.workunit.client.0.smithi043.stderr: -132> 2024-09-12T00:39:23.964+0000 7f4f567fc640 4 set_mon_vals no callback set 2024-09-12T00:39:24.393 INFO:tasks.workunit.client.0.smithi043.stderr: -131> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 monclient: authenticate success, global_id 7449 2024-09-12T00:39:24.393 INFO:tasks.workunit.client.0.smithi043.stderr: -130> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient: _renew_subs 2024-09-12T00:39:24.393 INFO:tasks.workunit.client.0.smithi043.stderr: -129> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:39:24.393 INFO:tasks.workunit.client.0.smithi043.stderr: -128> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient: _renew_subs 2024-09-12T00:39:24.393 INFO:tasks.workunit.client.0.smithi043.stderr: -127> 2024-09-12T00:39:23.964+0000 7f507521e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:39:24.393 INFO:tasks.workunit.client.0.smithi043.stderr: -126> 2024-09-12T00:39:23.964+0000 7f507521e9c0 1 librados: init done 2024-09-12T00:39:24.394 INFO:tasks.workunit.client.0.smithi043.stderr: -125> 2024-09-12T00:39:23.964+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command cr dump hook 0x55f8e76cf3b8 2024-09-12T00:39:24.394 INFO:tasks.workunit.client.0.smithi043.stderr: -124> 2024-09-12T00:39:23.968+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.394 INFO:tasks.workunit.client.0.smithi043.stderr: -123> 2024-09-12T00:39:23.968+0000 7f4f54ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:24.394 INFO:tasks.workunit.client.0.smithi043.stderr: -122> 2024-09-12T00:39:23.968+0000 7f4f54ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:39:24.394 INFO:tasks.workunit.client.0.smithi043.stderr: -121> 2024-09-12T00:39:23.968+0000 7f4f54ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:39:24.394 INFO:tasks.workunit.client.0.smithi043.stderr: -120> 2024-09-12T00:39:23.968+0000 7f5072d24640 10 monclient: get_auth_request con 0x7f4f3c070ae0 auth_method 0 2024-09-12T00:39:24.394 INFO:tasks.workunit.client.0.smithi043.stderr: -119> 2024-09-12T00:39:23.968+0000 7f5073525640 10 monclient: get_auth_request con 0x55f8e76f6dd0 auth_method 0 2024-09-12T00:39:24.394 INFO:tasks.workunit.client.0.smithi043.stderr: -118> 2024-09-12T00:39:23.968+0000 7f507521e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.394 INFO:tasks.workunit.client.0.smithi043.stderr: -117> 2024-09-12T00:39:23.968+0000 7f507521e9c0 20 realm 2024-09-12T00:39:24.394 INFO:tasks.workunit.client.0.smithi043.stderr: -116> 2024-09-12T00:39:23.968+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.394 INFO:tasks.workunit.client.0.smithi043.stderr: -115> 2024-09-12T00:39:23.968+0000 7f507521e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.394 INFO:tasks.workunit.client.0.smithi043.stderr: -114> 2024-09-12T00:39:23.968+0000 7f507521e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:24.394 INFO:tasks.workunit.client.0.smithi043.stderr: -113> 2024-09-12T00:39:23.968+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.395 INFO:tasks.workunit.client.0.smithi043.stderr: -112> 2024-09-12T00:39:23.968+0000 7f507521e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.395 INFO:tasks.workunit.client.0.smithi043.stderr: -111> 2024-09-12T00:39:23.968+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.395 INFO:tasks.workunit.client.0.smithi043.stderr: -110> 2024-09-12T00:39:23.972+0000 7f5072d24640 10 monclient: get_auth_request con 0x55f8e76fb000 auth_method 0 2024-09-12T00:39:24.395 INFO:tasks.workunit.client.0.smithi043.stderr: -109> 2024-09-12T00:39:23.972+0000 7f507521e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:24.395 INFO:tasks.workunit.client.0.smithi043.stderr: -108> 2024-09-12T00:39:23.972+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.395 INFO:tasks.workunit.client.0.smithi043.stderr: -107> 2024-09-12T00:39:23.972+0000 7f5072523640 10 monclient: get_auth_request con 0x55f8e76fe860 auth_method 0 2024-09-12T00:39:24.395 INFO:tasks.workunit.client.0.smithi043.stderr: -106> 2024-09-12T00:39:23.972+0000 7f507521e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:24.395 INFO:tasks.workunit.client.0.smithi043.stderr: -105> 2024-09-12T00:39:23.972+0000 7f507521e9c0 20 searching for the correct realm 2024-09-12T00:39:24.395 INFO:tasks.workunit.client.0.smithi043.stderr: -104> 2024-09-12T00:39:23.972+0000 7f5073525640 10 monclient: get_auth_request con 0x55f8e7703600 auth_method 0 2024-09-12T00:39:24.395 INFO:tasks.workunit.client.0.smithi043.stderr: -103> 2024-09-12T00:39:23.972+0000 7f5072d24640 10 monclient: get_auth_request con 0x7f506c0c5910 auth_method 0 2024-09-12T00:39:24.395 INFO:tasks.workunit.client.0.smithi043.stderr: -102> 2024-09-12T00:39:23.976+0000 7f5072523640 10 monclient: get_auth_request con 0x7f5068028070 auth_method 0 2024-09-12T00:39:24.396 INFO:tasks.workunit.client.0.smithi043.stderr: -101> 2024-09-12T00:39:23.980+0000 7f5073525640 0 -- 172.21.15.43:0/1628816383 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f5068013030 msgr2=0x7f50680015f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:24.396 INFO:tasks.workunit.client.0.smithi043.stderr: -100> 2024-09-12T00:39:24.184+0000 7f5073525640 10 monclient: get_auth_request con 0x7f5068013030 auth_method 0 2024-09-12T00:39:24.396 INFO:tasks.workunit.client.0.smithi043.stderr: -99> 2024-09-12T00:39:24.188+0000 7f5072d24640 10 monclient: get_auth_request con 0x7f5068008030 auth_method 0 2024-09-12T00:39:24.396 INFO:tasks.workunit.client.0.smithi043.stderr: -98> 2024-09-12T00:39:24.196+0000 7f5072d24640 0 -- 172.21.15.43:0/1628816383 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x55f8e76fb000 msgr2=0x55f8e76fd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:24.396 INFO:tasks.workunit.client.0.smithi043.stderr: -97> 2024-09-12T00:39:24.196+0000 7f4f54ff9640 1 client.7449.objecter ms_handle_reset 0x55f8e76fb000 session 0x55f8e76fa980 osd.5 2024-09-12T00:39:24.396 INFO:tasks.workunit.client.0.smithi043.stderr: -96> 2024-09-12T00:39:24.196+0000 7f4f54ff9640 10 monclient: _renew_subs 2024-09-12T00:39:24.396 INFO:tasks.workunit.client.0.smithi043.stderr: -95> 2024-09-12T00:39:24.196+0000 7f4f54ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:39:24.396 INFO:tasks.workunit.client.0.smithi043.stderr: -94> 2024-09-12T00:39:24.196+0000 7f5072d24640 10 monclient: get_auth_request con 0x7f4f3c080b80 auth_method 0 2024-09-12T00:39:24.396 INFO:tasks.workunit.client.0.smithi043.stderr: -93> 2024-09-12T00:39:24.204+0000 7f507521e9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:39:24.396 INFO:tasks.workunit.client.0.smithi043.stderr: -92> 2024-09-12T00:39:24.204+0000 7f507521e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:24.396 INFO:tasks.workunit.client.0.smithi043.stderr: -91> 2024-09-12T00:39:24.204+0000 7f507521e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:24.396 INFO:tasks.workunit.client.0.smithi043.stderr: -90> 2024-09-12T00:39:24.204+0000 7f507521e9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:39:24.397 INFO:tasks.workunit.client.0.smithi043.stderr: -89> 2024-09-12T00:39:24.204+0000 7f507521e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:24.397 INFO:tasks.workunit.client.0.smithi043.stderr: -88> 2024-09-12T00:39:24.204+0000 7f507521e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:24.397 INFO:tasks.workunit.client.0.smithi043.stderr: -87> 2024-09-12T00:39:24.204+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.397 INFO:tasks.workunit.client.0.smithi043.stderr: -86> 2024-09-12T00:39:24.204+0000 7f507521e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.397 INFO:tasks.workunit.client.0.smithi043.stderr: -85> 2024-09-12T00:39:24.204+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.397 INFO:tasks.workunit.client.0.smithi043.stderr: -84> 2024-09-12T00:39:24.204+0000 7f507521e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:24.397 INFO:tasks.workunit.client.0.smithi043.stderr: -83> 2024-09-12T00:39:24.204+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.397 INFO:tasks.workunit.client.0.smithi043.stderr: -82> 2024-09-12T00:39:24.208+0000 7f507521e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:24.397 INFO:tasks.workunit.client.0.smithi043.stderr: -81> 2024-09-12T00:39:24.208+0000 7f507521e9c0 20 zone default found 2024-09-12T00:39:24.397 INFO:tasks.workunit.client.0.smithi043.stderr: -80> 2024-09-12T00:39:24.208+0000 7f507521e9c0 4 Realm: () 2024-09-12T00:39:24.397 INFO:tasks.workunit.client.0.smithi043.stderr: -79> 2024-09-12T00:39:24.208+0000 7f507521e9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:39:24.397 INFO:tasks.workunit.client.0.smithi043.stderr: -78> 2024-09-12T00:39:24.208+0000 7f507521e9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:39:24.398 INFO:tasks.workunit.client.0.smithi043.stderr: -77> 2024-09-12T00:39:24.208+0000 7f507521e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:24.398 INFO:tasks.workunit.client.0.smithi043.stderr: -76> 2024-09-12T00:39:24.208+0000 7f507521e9c0 20 zonegroup default 2024-09-12T00:39:24.398 INFO:tasks.workunit.client.0.smithi043.stderr: -75> 2024-09-12T00:39:24.208+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.398 INFO:tasks.workunit.client.0.smithi043.stderr: -74> 2024-09-12T00:39:24.208+0000 7f507521e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.398 INFO:tasks.workunit.client.0.smithi043.stderr: -73> 2024-09-12T00:39:24.208+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.398 INFO:tasks.workunit.client.0.smithi043.stderr: -72> 2024-09-12T00:39:24.208+0000 7f507521e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.398 INFO:tasks.workunit.client.0.smithi043.stderr: -71> 2024-09-12T00:39:24.208+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.398 INFO:tasks.workunit.client.0.smithi043.stderr: -70> 2024-09-12T00:39:24.208+0000 7f507521e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.398 INFO:tasks.workunit.client.0.smithi043.stderr: -69> 2024-09-12T00:39:24.208+0000 7f507521e9c0 20 started sync module instance, tier type = 2024-09-12T00:39:24.398 INFO:tasks.workunit.client.0.smithi043.stderr: -68> 2024-09-12T00:39:24.208+0000 7f507521e9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:39:24.398 INFO:tasks.workunit.client.0.smithi043.stderr: -67> 2024-09-12T00:39:24.232+0000 7f507521e9c0 20 add_watcher() i=0 2024-09-12T00:39:24.398 INFO:tasks.workunit.client.0.smithi043.stderr: -66> 2024-09-12T00:39:24.232+0000 7f507521e9c0 20 add_watcher() i=1 2024-09-12T00:39:24.399 INFO:tasks.workunit.client.0.smithi043.stderr: -65> 2024-09-12T00:39:24.232+0000 7f507521e9c0 20 add_watcher() i=2 2024-09-12T00:39:24.399 INFO:tasks.workunit.client.0.smithi043.stderr: -64> 2024-09-12T00:39:24.232+0000 7f507521e9c0 20 add_watcher() i=3 2024-09-12T00:39:24.399 INFO:tasks.workunit.client.0.smithi043.stderr: -63> 2024-09-12T00:39:24.232+0000 7f507521e9c0 20 add_watcher() i=4 2024-09-12T00:39:24.399 INFO:tasks.workunit.client.0.smithi043.stderr: -62> 2024-09-12T00:39:24.232+0000 7f507521e9c0 20 add_watcher() i=5 2024-09-12T00:39:24.399 INFO:tasks.workunit.client.0.smithi043.stderr: -61> 2024-09-12T00:39:24.232+0000 7f507521e9c0 20 add_watcher() i=6 2024-09-12T00:39:24.399 INFO:tasks.workunit.client.0.smithi043.stderr: -60> 2024-09-12T00:39:24.236+0000 7f507521e9c0 20 add_watcher() i=7 2024-09-12T00:39:24.399 INFO:tasks.workunit.client.0.smithi043.stderr: -59> 2024-09-12T00:39:24.236+0000 7f507521e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:24.399 INFO:tasks.workunit.client.0.smithi043.stderr: -58> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c920) adding auth protocol: cephx 2024-09-12T00:39:24.399 INFO:tasks.workunit.client.0.smithi043.stderr: -57> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c920) adding auth protocol: cephx 2024-09-12T00:39:24.399 INFO:tasks.workunit.client.0.smithi043.stderr: -56> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c920) adding auth protocol: cephx 2024-09-12T00:39:24.399 INFO:tasks.workunit.client.0.smithi043.stderr: -55> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c920) adding con mode: secure 2024-09-12T00:39:24.400 INFO:tasks.workunit.client.0.smithi043.stderr: -54> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c920) adding con mode: crc 2024-09-12T00:39:24.400 INFO:tasks.workunit.client.0.smithi043.stderr: -53> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c920) adding con mode: secure 2024-09-12T00:39:24.400 INFO:tasks.workunit.client.0.smithi043.stderr: -52> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c920) adding con mode: crc 2024-09-12T00:39:24.400 INFO:tasks.workunit.client.0.smithi043.stderr: -51> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c920) adding con mode: secure 2024-09-12T00:39:24.400 INFO:tasks.workunit.client.0.smithi043.stderr: -50> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c920) adding con mode: crc 2024-09-12T00:39:24.400 INFO:tasks.workunit.client.0.smithi043.stderr: -49> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c920) adding con mode: crc 2024-09-12T00:39:24.400 INFO:tasks.workunit.client.0.smithi043.stderr: -48> 2024-09-12T00:39:24.240+0000 7f4f297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:24.400 INFO:tasks.workunit.client.0.smithi043.stderr: -47> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c920) adding con mode: secure 2024-09-12T00:39:24.400 INFO:tasks.workunit.client.0.smithi043.stderr: -46> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c920) adding con mode: crc 2024-09-12T00:39:24.400 INFO:tasks.workunit.client.0.smithi043.stderr: -45> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c920) adding con mode: secure 2024-09-12T00:39:24.400 INFO:tasks.workunit.client.0.smithi043.stderr: -44> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c920) adding con mode: crc 2024-09-12T00:39:24.401 INFO:tasks.workunit.client.0.smithi043.stderr: -43> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 AuthRegistry(0x7ffe7391c920) adding con mode: secure 2024-09-12T00:39:24.401 INFO:tasks.workunit.client.0.smithi043.stderr: -42> 2024-09-12T00:39:24.240+0000 7f507521e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:24.401 INFO:tasks.workunit.client.0.smithi043.stderr: -41> 2024-09-12T00:39:24.240+0000 7f507521e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:24.401 INFO:tasks.workunit.client.0.smithi043.stderr: -40> 2024-09-12T00:39:24.240+0000 7f507521e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:24.401 INFO:tasks.workunit.client.0.smithi043.stderr: -39> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command cache list hook 0x55f8e76d5580 2024-09-12T00:39:24.401 INFO:tasks.workunit.client.0.smithi043.stderr: -38> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command cache inspect hook 0x55f8e76d5580 2024-09-12T00:39:24.401 INFO:tasks.workunit.client.0.smithi043.stderr: -37> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command cache erase hook 0x55f8e76d5580 2024-09-12T00:39:24.401 INFO:tasks.workunit.client.0.smithi043.stderr: -36> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command cache zap hook 0x55f8e76d5580 2024-09-12T00:39:24.401 INFO:tasks.workunit.client.0.smithi043.stderr: -35> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 note: GC not initialized 2024-09-12T00:39:24.401 INFO:tasks.workunit.client.0.smithi043.stderr: -34> 2024-09-12T00:39:24.240+0000 7f4ea3fff640 20 reqs_thread_entry: start 2024-09-12T00:39:24.401 INFO:tasks.workunit.client.0.smithi043.stderr: -33> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command sync trace show hook 0x7f506400fcc0 2024-09-12T00:39:24.401 INFO:tasks.workunit.client.0.smithi043.stderr: -32> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command sync trace history hook 0x7f506400fcc0 2024-09-12T00:39:24.401 INFO:tasks.workunit.client.0.smithi043.stderr: -31> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command sync trace active hook 0x7f506400fcc0 2024-09-12T00:39:24.402 INFO:tasks.workunit.client.0.smithi043.stderr: -30> 2024-09-12T00:39:24.240+0000 7f507521e9c0 5 asok(0x55f8e74032b0) register_command sync trace active_short hook 0x7f506400fcc0 2024-09-12T00:39:24.402 INFO:tasks.workunit.client.0.smithi043.stderr: -29> 2024-09-12T00:39:24.240+0000 7f507521e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:24.402 INFO:tasks.workunit.client.0.smithi043.stderr: -28> 2024-09-12T00:39:24.240+0000 7f507521e9c0 20 Filter name: none 2024-09-12T00:39:24.402 INFO:tasks.workunit.client.0.smithi043.stderr: -27> 2024-09-12T00:39:24.244+0000 7f4ea1ffb640 20 reqs_thread_entry: start 2024-09-12T00:39:24.402 INFO:tasks.workunit.client.0.smithi043.stderr: -26> 2024-09-12T00:39:24.244+0000 7f507521e9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:39:24.402 INFO:tasks.workunit.client.0.smithi043.stderr: -25> 2024-09-12T00:39:24.244+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.402 INFO:tasks.workunit.client.0.smithi043.stderr: -24> 2024-09-12T00:39:24.244+0000 7f507521e9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:24.402 INFO:tasks.workunit.client.0.smithi043.stderr: -23> 2024-09-12T00:39:24.244+0000 7f507521e9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:39:24.402 INFO:tasks.workunit.client.0.smithi043.stderr: -22> 2024-09-12T00:39:24.244+0000 7f507521e9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:39:24.402 INFO:tasks.workunit.client.0.smithi043.stderr: -21> 2024-09-12T00:39:24.244+0000 7f507521e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 : miss 2024-09-12T00:39:24.402 INFO:tasks.workunit.client.0.smithi043.stderr: -20> 2024-09-12T00:39:24.244+0000 7f507521e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.402 INFO:tasks.workunit.client.0.smithi043.stderr: -19> 2024-09-12T00:39:24.244+0000 7f507521e9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:39:24.402 INFO:tasks.workunit.client.0.smithi043.stderr: -18> 2024-09-12T00:39:24.244+0000 7f507521e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 info.flags=0x17 2024-09-12T00:39:24.403 INFO:tasks.workunit.client.0.smithi043.stderr: -17> 2024-09-12T00:39:24.244+0000 7f507521e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 to cache LRU end 2024-09-12T00:39:24.403 INFO:tasks.workunit.client.0.smithi043.stderr: -16> 2024-09-12T00:39:24.244+0000 7f507521e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:24.403 INFO:tasks.workunit.client.0.smithi043.stderr: -15> 2024-09-12T00:39:24.244+0000 7f507521e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:24.403 INFO:tasks.workunit.client.0.smithi043.stderr: -14> 2024-09-12T00:39:24.244+0000 7f507521e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 2024-09-12T00:39:24.403 INFO:tasks.workunit.client.0.smithi043.stderr: -13> 2024-09-12T00:39:24.256+0000 7f507521e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 info.flags=0x17 2024-09-12T00:39:24.403 INFO:tasks.workunit.client.0.smithi043.stderr: -12> 2024-09-12T00:39:24.256+0000 7f507521e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 to cache LRU end 2024-09-12T00:39:24.403 INFO:tasks.workunit.client.0.smithi043.stderr: -11> 2024-09-12T00:39:24.256+0000 7f507521e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:24.403 INFO:tasks.workunit.client.0.smithi043.stderr: -10> 2024-09-12T00:39:24.256+0000 7f507521e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34, ofs0, ns] 2024-09-12T00:39:24.403 INFO:tasks.workunit.client.0.smithi043.stderr: -9> 2024-09-12T00:39:24.256+0000 7f4f567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333500 cookie 94527523153280 notifier 7449 bl.length()=911 2024-09-12T00:39:24.403 INFO:tasks.workunit.client.0.smithi043.stderr: -8> 2024-09-12T00:39:24.256+0000 7f4f567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 info.flags=0x17 2024-09-12T00:39:24.403 INFO:tasks.workunit.client.0.smithi043.stderr: -7> 2024-09-12T00:39:24.256+0000 7f4f567fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 to cache LRU end 2024-09-12T00:39:24.403 INFO:tasks.workunit.client.0.smithi043.stderr: -6> 2024-09-12T00:39:24.256+0000 7f4f567fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:24.404 INFO:tasks.workunit.client.0.smithi043.stderr: -5> 2024-09-12T00:39:24.256+0000 7f507521e9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34]): orig_sources= new_sources= 2024-09-12T00:39:24.404 INFO:tasks.workunit.client.0.smithi043.stderr: -4> 2024-09-12T00:39:24.256+0000 7f507521e9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34]): potential sources added=[] removed=[] 2024-09-12T00:39:24.404 INFO:tasks.workunit.client.0.smithi043.stderr: -3> 2024-09-12T00:39:24.256+0000 7f507521e9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34]): orig_dests= new_dests= 2024-09-12T00:39:24.404 INFO:tasks.workunit.client.0.smithi043.stderr: -2> 2024-09-12T00:39:24.256+0000 7f507521e9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34]): potential dests added=[] removed=[] 2024-09-12T00:39:24.404 INFO:tasks.workunit.client.0.smithi043.stderr: -1> 2024-09-12T00:39:24.272+0000 7f507521e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f507521e9c0 time 2024-09-12T00:39:24.272207+0000 2024-09-12T00:39:24.404 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:39:24.404 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.404 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:24.404 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f5078af82eb] 2024-09-12T00:39:24.404 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5078af849f] 2024-09-12T00:39:24.404 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f8e570ccc1] 2024-09-12T00:39:24.404 INFO:tasks.workunit.client.0.smithi043.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f8e5721d5a] 2024-09-12T00:39:24.405 INFO:tasks.workunit.client.0.smithi043.stderr: 5: main() 2024-09-12T00:39:24.405 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f507795ed90] 2024-09-12T00:39:24.405 INFO:tasks.workunit.client.0.smithi043.stderr: 7: __libc_start_main() 2024-09-12T00:39:24.405 INFO:tasks.workunit.client.0.smithi043.stderr: 8: _start() 2024-09-12T00:39:24.405 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.405 INFO:tasks.workunit.client.0.smithi043.stderr: 0> 2024-09-12T00:39:24.272+0000 7f507521e9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:39:24.405 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7f507521e9c0 thread_name:radosgw-admin 2024-09-12T00:39:24.405 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.405 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:24.405 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5077977520] 2024-09-12T00:39:24.405 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:39:24.405 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:39:24.406 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:39:24.406 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5078af8345] 2024-09-12T00:39:24.406 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5078af849f] 2024-09-12T00:39:24.406 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f8e570ccc1] 2024-09-12T00:39:24.406 INFO:tasks.workunit.client.0.smithi043.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f8e5721d5a] 2024-09-12T00:39:24.406 INFO:tasks.workunit.client.0.smithi043.stderr: 9: main() 2024-09-12T00:39:24.406 INFO:tasks.workunit.client.0.smithi043.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f507795ed90] 2024-09-12T00:39:24.406 INFO:tasks.workunit.client.0.smithi043.stderr: 11: __libc_start_main() 2024-09-12T00:39:24.406 INFO:tasks.workunit.client.0.smithi043.stderr: 12: _start() 2024-09-12T00:39:24.406 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:39:24.406 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.407 INFO:tasks.workunit.client.0.smithi043.stderr:--- logging levels --- 2024-09-12T00:39:24.407 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 none 2024-09-12T00:39:24.407 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 lockdep 2024-09-12T00:39:24.407 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 context 2024-09-12T00:39:24.407 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 crush 2024-09-12T00:39:24.407 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds 2024-09-12T00:39:24.407 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_balancer 2024-09-12T00:39:24.407 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_locker 2024-09-12T00:39:24.407 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log 2024-09-12T00:39:24.407 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log_expire 2024-09-12T00:39:24.408 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_migrator 2024-09-12T00:39:24.408 INFO:tasks.workunit.client.0.smithi043.stderr: 3/ 5 mds_quiesce 2024-09-12T00:39:24.408 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 buffer 2024-09-12T00:39:24.408 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 timer 2024-09-12T00:39:24.408 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 filer 2024-09-12T00:39:24.408 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 striper 2024-09-12T00:39:24.408 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 objecter 2024-09-12T00:39:24.408 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rados 2024-09-12T00:39:24.408 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd 2024-09-12T00:39:24.408 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_mirror 2024-09-12T00:39:24.408 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_replay 2024-09-12T00:39:24.408 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_pwl 2024-09-12T00:39:24.408 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 journaler 2024-09-12T00:39:24.409 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objectcacher 2024-09-12T00:39:24.409 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:39:24.409 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 client 2024-09-12T00:39:24.409 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 osd 2024-09-12T00:39:24.409 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 optracker 2024-09-12T00:39:24.409 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objclass 2024-09-12T00:39:24.409 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 filestore 2024-09-12T00:39:24.409 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 journal 2024-09-12T00:39:24.409 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 ms 2024-09-12T00:39:24.409 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mon 2024-09-12T00:39:24.409 INFO:tasks.workunit.client.0.smithi043.stderr: 0/10 monc 2024-09-12T00:39:24.409 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 paxos 2024-09-12T00:39:24.409 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 tp 2024-09-12T00:39:24.410 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 auth 2024-09-12T00:39:24.410 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 crypto 2024-09-12T00:39:24.410 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 finisher 2024-09-12T00:39:24.410 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 reserver 2024-09-12T00:39:24.410 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 heartbeatmap 2024-09-12T00:39:24.410 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 perfcounter 2024-09-12T00:39:24.410 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw 2024-09-12T00:39:24.410 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_sync 2024-09-12T00:39:24.410 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_datacache 2024-09-12T00:39:24.410 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_access 2024-09-12T00:39:24.410 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:39:24.410 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_flight 2024-09-12T00:39:24.410 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:39:24.411 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw_notification 2024-09-12T00:39:24.411 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 javaclient 2024-09-12T00:39:24.411 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 asok 2024-09-12T00:39:24.411 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 throttle 2024-09-12T00:39:24.411 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 refs 2024-09-12T00:39:24.411 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 compressor 2024-09-12T00:39:24.411 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluestore 2024-09-12T00:39:24.411 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluefs 2024-09-12T00:39:24.411 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 bdev 2024-09-12T00:39:24.411 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 kstore 2024-09-12T00:39:24.411 INFO:tasks.workunit.client.0.smithi043.stderr: 4/ 5 rocksdb 2024-09-12T00:39:24.411 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 fuse 2024-09-12T00:39:24.411 INFO:tasks.workunit.client.0.smithi043.stderr: 2/ 5 mgr 2024-09-12T00:39:24.412 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mgrc 2024-09-12T00:39:24.412 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 dpdk 2024-09-12T00:39:24.412 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 eventtrace 2024-09-12T00:39:24.412 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 prioritycache 2024-09-12T00:39:24.412 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 test 2024-09-12T00:39:24.412 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:39:24.412 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephsqlite 2024-09-12T00:39:24.412 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:39:24.412 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore 2024-09-12T00:39:24.412 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_onode 2024-09-12T00:39:24.412 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_odata 2024-09-12T00:39:24.412 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_omap 2024-09-12T00:39:24.412 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_tm 2024-09-12T00:39:24.413 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_t 2024-09-12T00:39:24.413 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:39:24.413 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_epm 2024-09-12T00:39:24.413 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_lba 2024-09-12T00:39:24.413 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:39:24.413 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cache 2024-09-12T00:39:24.413 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_journal 2024-09-12T00:39:24.413 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_device 2024-09-12T00:39:24.413 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_backref 2024-09-12T00:39:24.413 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 alienstore 2024-09-12T00:39:24.413 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mclock 2024-09-12T00:39:24.413 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cyanstore 2024-09-12T00:39:24.413 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 ceph_exporter 2024-09-12T00:39:24.413 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 memstore 2024-09-12T00:39:24.414 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 trace 2024-09-12T00:39:24.414 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 ceph_dedup 2024-09-12T00:39:24.414 INFO:tasks.workunit.client.0.smithi043.stderr: -2/-2 (syslog threshold) 2024-09-12T00:39:24.414 INFO:tasks.workunit.client.0.smithi043.stderr: 99/99 (stderr threshold) 2024-09-12T00:39:24.414 INFO:tasks.workunit.client.0.smithi043.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:39:24.414 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4ea1ffb640 / http_manager 2024-09-12T00:39:24.414 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4ea3fff640 / http_manager 2024-09-12T00:39:24.414 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4f297e2640 / rgw_dt_lg_renew 2024-09-12T00:39:24.414 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4f54ff9640 / ms_dispatch 2024-09-12T00:39:24.414 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4f567fc640 / io_context_pool 2024-09-12T00:39:24.414 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4f5ce01640 / ms_dispatch 2024-09-12T00:39:24.414 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4f5f606640 / ms_dispatch 2024-09-12T00:39:24.415 INFO:tasks.workunit.client.0.smithi043.stderr: 7f4f60e09640 / io_context_pool 2024-09-12T00:39:24.415 INFO:tasks.workunit.client.0.smithi043.stderr: 7f5072523640 / msgr-worker-2 2024-09-12T00:39:24.415 INFO:tasks.workunit.client.0.smithi043.stderr: 7f5072d24640 / msgr-worker-1 2024-09-12T00:39:24.415 INFO:tasks.workunit.client.0.smithi043.stderr: 7f5073525640 / msgr-worker-0 2024-09-12T00:39:24.415 INFO:tasks.workunit.client.0.smithi043.stderr: 7f5073d26640 / io_context_pool 2024-09-12T00:39:24.415 INFO:tasks.workunit.client.0.smithi043.stderr: 7f507521e9c0 / radosgw-admin 2024-09-12T00:39:24.415 INFO:tasks.workunit.client.0.smithi043.stderr: max_recent 500 2024-09-12T00:39:24.415 INFO:tasks.workunit.client.0.smithi043.stderr: max_new 1000 2024-09-12T00:39:24.415 INFO:tasks.workunit.client.0.smithi043.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:39:24.274288Z_91e080a2-4278-4592-8d2d-3d3e51a20610/log 2024-09-12T00:39:24.415 INFO:tasks.workunit.client.0.smithi043.stderr:--- end dump of recent events --- 2024-09-12T00:39:24.416 INFO:tasks.workunit.client.0.smithi043.stderr:Aborted 2024-09-12T00:39:24.416 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:39:24.416 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:24.416 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:24.578 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.580+0000 7f1a37fee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.579 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.580+0000 7f1a37fee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.580+0000 7f1a37fee9c0 20 realm 2024-09-12T00:39:24.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.580+0000 7f1a37fee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.580+0000 7f1a37fee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.580+0000 7f1a37fee9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:24.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.580+0000 7f1a37fee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.580+0000 7f1a37fee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.581 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.580+0000 7f1a37fee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.584+0000 7f1a37fee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:24.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.584+0000 7f1a37fee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.583 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.584+0000 7f1a37fee9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:24.583 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.584+0000 7f1a37fee9c0 20 searching for the correct realm 2024-09-12T00:39:24.589 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.588+0000 7f1a35af4640 0 -- 172.21.15.43:0/2161570176 >> [v2:172.21.15.97:6816/489545787,v1:172.21.15.97:6817/489545787] conn(0x7f1a300c8070 msgr2=0x7f1a300bb730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:24.596 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.596+0000 7f1a35af4640 0 -- 172.21.15.43:0/2161570176 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f1a2c06f0d0 msgr2=0x7f1a2c092750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:24.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.812+0000 7f1a37fee9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:39:24.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.812+0000 7f1a37fee9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:24.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.812+0000 7f1a37fee9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:24.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.812+0000 7f1a37fee9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:39:24.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.812+0000 7f1a37fee9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:24.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.812+0000 7f1a37fee9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:24.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.812+0000 7f1a37fee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.816+0000 7f1a37fee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.816+0000 7f1a37fee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.816+0000 7f1a37fee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:24.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.816+0000 7f1a37fee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.816+0000 7f1a37fee9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:24.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.816+0000 7f1a37fee9c0 20 zone default found 2024-09-12T00:39:24.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.816+0000 7f1a37fee9c0 4 Realm: () 2024-09-12T00:39:24.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.816+0000 7f1a37fee9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:39:24.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.816+0000 7f1a37fee9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:39:24.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.816+0000 7f1a37fee9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:24.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.816+0000 7f1a37fee9c0 20 zonegroup default 2024-09-12T00:39:24.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.816+0000 7f1a37fee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.816+0000 7f1a37fee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.816+0000 7f1a37fee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.817 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.816+0000 7f1a37fee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.817 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.816+0000 7f1a37fee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.818 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.820+0000 7f1a37fee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.818 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.820+0000 7f1a37fee9c0 20 started sync module instance, tier type = 2024-09-12T00:39:24.818 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.820+0000 7f1a37fee9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:39:24.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.856+0000 7f1a37fee9c0 20 add_watcher() i=0 2024-09-12T00:39:24.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.856+0000 7f1a37fee9c0 20 add_watcher() i=1 2024-09-12T00:39:24.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.856+0000 7f1a37fee9c0 20 add_watcher() i=2 2024-09-12T00:39:24.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.856+0000 7f1a37fee9c0 20 add_watcher() i=3 2024-09-12T00:39:24.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.856+0000 7f1a37fee9c0 20 add_watcher() i=4 2024-09-12T00:39:24.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.856+0000 7f1a37fee9c0 20 add_watcher() i=5 2024-09-12T00:39:24.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.856+0000 7f1a37fee9c0 20 add_watcher() i=6 2024-09-12T00:39:24.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.856+0000 7f1a37fee9c0 20 add_watcher() i=7 2024-09-12T00:39:24.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.856+0000 7f1a37fee9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:24.860 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.860+0000 7f18e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:24.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.860+0000 7f1a37fee9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:24.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.860+0000 7f1a37fee9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:24.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.860+0000 7f1a37fee9c0 5 note: GC not initialized 2024-09-12T00:39:24.862 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.864+0000 7f18e67fc640 20 reqs_thread_entry: start 2024-09-12T00:39:24.862 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.864+0000 7f1a37fee9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:24.862 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.864+0000 7f1a37fee9c0 20 Filter name: none 2024-09-12T00:39:24.862 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.864+0000 7f1857fff640 20 reqs_thread_entry: start 2024-09-12T00:39:24.862 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.864+0000 7f1a37fee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.864+0000 7f1a37fee9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:24.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.864+0000 7f1a37fee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.865 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.868+0000 7f1a37fee9c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:39:24.865 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.868+0000 7f1a37fee9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:24.866 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.868+0000 7f1a37fee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.866 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.868+0000 7f1a37fee9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:24.866 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.868+0000 7f1a37fee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.868 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.868+0000 7f1a37fee9c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:39:24.868 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.868+0000 7f1a37fee9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:24.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.872+0000 7f18e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:24.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.876+0000 7f1a37fee9c0 20 remove_watcher() i=0 2024-09-12T00:39:24.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.876+0000 7f1a37fee9c0 2 removed watcher, disabling cache 2024-09-12T00:39:24.881 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.884+0000 7f1a37fee9c0 20 remove_watcher() i=1 2024-09-12T00:39:24.884 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.884+0000 7f1a37fee9c0 20 remove_watcher() i=2 2024-09-12T00:39:24.888 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.888+0000 7f1a37fee9c0 20 remove_watcher() i=3 2024-09-12T00:39:24.888 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.888+0000 7f1a37fee9c0 20 remove_watcher() i=4 2024-09-12T00:39:24.889 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.892+0000 7f1a37fee9c0 20 remove_watcher() i=5 2024-09-12T00:39:24.891 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.892+0000 7f1a37fee9c0 20 remove_watcher() i=6 2024-09-12T00:39:24.892 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:24.892+0000 7f1a37fee9c0 20 remove_watcher() i=7 2024-09-12T00:39:24.908 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.908 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:39:24.908 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: abort-at-do-reshard id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:39:24.908 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:24.909 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:24.909 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:24.921 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:24.921 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:24.966 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:39:24.999 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:24.999 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:25.046 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.048+0000 7f2a6b0d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.048 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.048+0000 7f2a6b0d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:25.048 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.048+0000 7f2a6b0d39c0 20 realm 2024-09-12T00:39:25.048 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.048+0000 7f2a6b0d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.048 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.048+0000 7f2a6b0d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:25.049 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.048+0000 7f2a6b0d39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:25.049 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.048+0000 7f2a6b0d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.049 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.048+0000 7f2a6b0d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:25.049 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.048+0000 7f2a6b0d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.050 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.052+0000 7f2a6b0d39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:25.050 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.052+0000 7f2a6b0d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.051 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.052+0000 7f2a6b0d39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:25.051 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.052+0000 7f2a6b0d39c0 20 searching for the correct realm 2024-09-12T00:39:25.057 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.060+0000 7f2a683d8640 0 -- 172.21.15.43:0/2185792922 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f2a50083c20 msgr2=0x7f2a5005d7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:25.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.064+0000 7f2a683d8640 0 -- 172.21.15.43:0/2185792922 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f2934080b80 msgr2=0x7f2934082fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:25.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.072+0000 7f2a6b0d39c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:39:25.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.072+0000 7f2a6b0d39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:25.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.072+0000 7f2a6b0d39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:25.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.072+0000 7f2a6b0d39c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:39:25.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.072+0000 7f2a6b0d39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:25.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.072+0000 7f2a6b0d39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:25.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.072+0000 7f2a6b0d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.072+0000 7f2a6b0d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:25.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.072+0000 7f2a6b0d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.072+0000 7f2a6b0d39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:25.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.072+0000 7f2a6b0d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.076+0000 7f2a6b0d39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:25.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.076+0000 7f2a6b0d39c0 20 zone default found 2024-09-12T00:39:25.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.076+0000 7f2a6b0d39c0 4 Realm: () 2024-09-12T00:39:25.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.076+0000 7f2a6b0d39c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:39:25.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.076+0000 7f2a6b0d39c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:39:25.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.076+0000 7f2a6b0d39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:25.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.076+0000 7f2a6b0d39c0 20 zonegroup default 2024-09-12T00:39:25.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.076+0000 7f2a6b0d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.076+0000 7f2a6b0d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:25.075 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.076+0000 7f2a6b0d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.075 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.076+0000 7f2a6b0d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:25.075 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.076+0000 7f2a6b0d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.075 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.076+0000 7f2a6b0d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:25.075 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.076+0000 7f2a6b0d39c0 20 started sync module instance, tier type = 2024-09-12T00:39:25.075 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.076+0000 7f2a6b0d39c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:39:25.092 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.092+0000 7f2a6b0d39c0 20 add_watcher() i=0 2024-09-12T00:39:25.092 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.092+0000 7f2a6b0d39c0 20 add_watcher() i=1 2024-09-12T00:39:25.092 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.092+0000 7f2a6b0d39c0 20 add_watcher() i=2 2024-09-12T00:39:25.093 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.092+0000 7f2a6b0d39c0 20 add_watcher() i=3 2024-09-12T00:39:25.093 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.092+0000 7f2a6b0d39c0 20 add_watcher() i=4 2024-09-12T00:39:25.093 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.092+0000 7f2a6b0d39c0 20 add_watcher() i=5 2024-09-12T00:39:25.093 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.092+0000 7f2a6b0d39c0 20 add_watcher() i=6 2024-09-12T00:39:25.093 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.092+0000 7f2a6b0d39c0 20 add_watcher() i=7 2024-09-12T00:39:25.093 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.092+0000 7f2a6b0d39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:25.094 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.096+0000 7f291f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:25.094 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.096+0000 7f2a6b0d39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:25.095 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.096+0000 7f2a6b0d39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:25.095 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.096+0000 7f2a6b0d39c0 5 note: GC not initialized 2024-09-12T00:39:25.095 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.096+0000 7f291e7e4640 20 reqs_thread_entry: start 2024-09-12T00:39:25.095 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.096+0000 7f2a6b0d39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:25.096 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.096+0000 7f2a6b0d39c0 20 Filter name: none 2024-09-12T00:39:25.096 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.096+0000 7f29177fe640 20 reqs_thread_entry: start 2024-09-12T00:39:25.096 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.096+0000 7f2a6b0d39c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:39:25.096 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.096+0000 7f2a6b0d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.100+0000 7f2a6b0d39c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:25.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.100+0000 7f2a6b0d39c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:39:25.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.100+0000 7f2a6b0d39c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:39:25.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.100+0000 7f2a6b0d39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 : miss 2024-09-12T00:39:25.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.100+0000 7f2a6b0d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.099 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.100+0000 7f2a6b0d39c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:39:25.099 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.100+0000 7f2a6b0d39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 info.flags=0x17 2024-09-12T00:39:25.099 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.100+0000 7f2a6b0d39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 to cache LRU end 2024-09-12T00:39:25.099 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.100+0000 7f2a6b0d39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:25.099 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.100+0000 7f2a6b0d39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:25.099 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.100+0000 7f2a6b0d39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 2024-09-12T00:39:25.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.100+0000 7f2a6b0d39c0 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 to be held by another RGW process; skipping for now 2024-09-12T00:39:25.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.104+0000 7f291f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:25.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.108+0000 7f2a6b0d39c0 20 remove_watcher() i=0 2024-09-12T00:39:25.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.108+0000 7f2a6b0d39c0 2 removed watcher, disabling cache 2024-09-12T00:39:25.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.108+0000 7f2a6b0d39c0 20 remove_watcher() i=1 2024-09-12T00:39:25.110 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.112+0000 7f2a6b0d39c0 20 remove_watcher() i=2 2024-09-12T00:39:25.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.112+0000 7f2a6b0d39c0 20 remove_watcher() i=3 2024-09-12T00:39:25.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.116+0000 7f2a6b0d39c0 20 remove_watcher() i=4 2024-09-12T00:39:25.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.116+0000 7f2a6b0d39c0 20 remove_watcher() i=5 2024-09-12T00:39:25.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.116+0000 7f2a6b0d39c0 20 remove_watcher() i=6 2024-09-12T00:39:25.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:25.120+0000 7f2a6b0d39c0 20 remove_watcher() i=7 2024-09-12T00:39:25.133 INFO:tasks.workunit.client.0.smithi043.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:39:55.138 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:39:55.177 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:55.177 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:55.224 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.224+0000 7f97e60f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.226 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.228+0000 7f97e60f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:55.226 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.228+0000 7f97e60f29c0 20 realm 2024-09-12T00:39:55.226 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.228+0000 7f97e60f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.226 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.228+0000 7f97e60f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:55.226 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.228+0000 7f97e60f29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:55.226 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.228+0000 7f97e60f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.226 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.228+0000 7f97e60f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:55.226 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.228+0000 7f97e60f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.227 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.228+0000 7f97e60f29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:55.227 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.228+0000 7f97e60f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.228 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.228+0000 7f97e60f29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:55.228 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.228+0000 7f97e60f29c0 20 searching for the correct realm 2024-09-12T00:39:55.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.236+0000 7f97e43f9640 0 -- 172.21.15.43:0/3647356478 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x559c9f720070 msgr2=0x559c9f722500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:55.241 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.240+0000 7f97e3bf8640 0 -- 172.21.15.43:0/3647356478 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f97d804f440 msgr2=0x7f97d804f8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:55.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.248+0000 7f97e60f29c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:39:55.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.248+0000 7f97e60f29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:55.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.248+0000 7f97e60f29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:55.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.248+0000 7f97e60f29c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:39:55.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.248+0000 7f97e60f29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:55.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.248+0000 7f97e60f29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:55.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.248+0000 7f97e60f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.248+0000 7f97e60f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:55.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.248+0000 7f97e60f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.252+0000 7f97e60f29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:55.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.252+0000 7f97e60f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.252+0000 7f97e60f29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:55.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.252+0000 7f97e60f29c0 20 zone default found 2024-09-12T00:39:55.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.252+0000 7f97e60f29c0 4 Realm: () 2024-09-12T00:39:55.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.252+0000 7f97e60f29c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:39:55.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.252+0000 7f97e60f29c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:39:55.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.252+0000 7f97e60f29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:55.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.252+0000 7f97e60f29c0 20 zonegroup default 2024-09-12T00:39:55.253 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.252+0000 7f97e60f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.253 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.252+0000 7f97e60f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:55.253 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.252+0000 7f97e60f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.253 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.252+0000 7f97e60f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:55.253 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.252+0000 7f97e60f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.253 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.252+0000 7f97e60f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:55.253 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.252+0000 7f97e60f29c0 20 started sync module instance, tier type = 2024-09-12T00:39:55.253 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.252+0000 7f97e60f29c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:39:55.268 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.268+0000 7f97e60f29c0 20 add_watcher() i=0 2024-09-12T00:39:55.268 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.268+0000 7f97e60f29c0 20 add_watcher() i=1 2024-09-12T00:39:55.268 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.268+0000 7f97e60f29c0 20 add_watcher() i=2 2024-09-12T00:39:55.269 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.268+0000 7f97e60f29c0 20 add_watcher() i=3 2024-09-12T00:39:55.269 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.268+0000 7f97e60f29c0 20 add_watcher() i=4 2024-09-12T00:39:55.269 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.268+0000 7f97e60f29c0 20 add_watcher() i=5 2024-09-12T00:39:55.269 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.268+0000 7f97e60f29c0 20 add_watcher() i=6 2024-09-12T00:39:55.269 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.272+0000 7f97e60f29c0 20 add_watcher() i=7 2024-09-12T00:39:55.269 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.272+0000 7f97e60f29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:55.272 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.272+0000 7f9699fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:55.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.272+0000 7f97e60f29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:55.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.272+0000 7f97e60f29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:55.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.272+0000 7f97e60f29c0 5 note: GC not initialized 2024-09-12T00:39:55.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.272+0000 7f9698fe1640 20 reqs_thread_entry: start 2024-09-12T00:39:55.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.272+0000 7f97e60f29c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:55.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.272+0000 7f97e60f29c0 20 Filter name: none 2024-09-12T00:39:55.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.272+0000 7f96127fc640 20 reqs_thread_entry: start 2024-09-12T00:39:55.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.272+0000 7f97e60f29c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:39:55.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.272+0000 7f97e60f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.274 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.276+0000 7f97e60f29c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:55.274 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.276+0000 7f97e60f29c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:39:55.274 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.276+0000 7f97e60f29c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:39:55.274 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.276+0000 7f97e60f29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 : miss 2024-09-12T00:39:55.274 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.276+0000 7f97e60f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.275 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.276+0000 7f97e60f29c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:39:55.275 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.276+0000 7f97e60f29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 info.flags=0x17 2024-09-12T00:39:55.275 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.276+0000 7f97e60f29c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 to cache LRU end 2024-09-12T00:39:55.275 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.276+0000 7f97e60f29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:55.275 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.276+0000 7f97e60f29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:55.275 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.276+0000 7f97e60f29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 2024-09-12T00:39:55.277 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.280+0000 7f97e60f29c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:39:55.291 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.292+0000 7f97e60f29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 info.flags=0x17 2024-09-12T00:39:55.291 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.292+0000 7f97e60f29c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 to cache LRU end 2024-09-12T00:39:55.291 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.292+0000 7f97e60f29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:55.291 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.292+0000 7f97e60f29c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34, ofs0, ns] 2024-09-12T00:39:55.291 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.292+0000 7f96c2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333501 cookie 94131178372400 notifier 7503 bl.length()=911 2024-09-12T00:39:55.291 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.292+0000 7f96c2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 info.flags=0x17 2024-09-12T00:39:55.291 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.292+0000 7f96c2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 to cache LRU end 2024-09-12T00:39:55.291 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.292+0000 7f96c2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:55.292 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.292+0000 7f97e60f29c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34]): orig_sources= new_sources= 2024-09-12T00:39:55.292 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.292+0000 7f97e60f29c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34]): potential sources added=[] removed=[] 2024-09-12T00:39:55.292 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.292+0000 7f97e60f29c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34]): orig_dests= new_dests= 2024-09-12T00:39:55.292 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.292+0000 7f97e60f29c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34]): potential dests added=[] removed=[] 2024-09-12T00:39:55.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.308+0000 7f97e60f29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.2.0 2024-09-12T00:39:55.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.308+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.2.0 2024-09-12T00:39:55.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.308+0000 7f97e60f29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.2.1 2024-09-12T00:39:55.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.308+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.2.1 2024-09-12T00:39:55.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.308+0000 7f97e60f29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.2.2 2024-09-12T00:39:55.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.308+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.2.2 2024-09-12T00:39:55.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.308+0000 7f97e60f29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.2.3 2024-09-12T00:39:55.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.308+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.2.3 2024-09-12T00:39:55.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.308+0000 7f97e60f29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.2.4 2024-09-12T00:39:55.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.308+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.2.4 2024-09-12T00:39:55.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.308+0000 7f97e60f29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.2.5 2024-09-12T00:39:55.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.308+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.2.5 2024-09-12T00:39:55.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.308+0000 7f97e60f29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.2.6 2024-09-12T00:39:55.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.308+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.2.6 2024-09-12T00:39:55.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.308+0000 7f97e60f29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.2.7 2024-09-12T00:39:55.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.308+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.2.7 2024-09-12T00:39:55.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.308+0000 7f97e60f29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.2.8 2024-09-12T00:39:55.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.308+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.2.8 2024-09-12T00:39:55.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.308+0000 7f97e60f29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.2.9 2024-09-12T00:39:55.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.308+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.2.9 2024-09-12T00:39:55.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.308+0000 7f97e60f29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.2.10 2024-09-12T00:39:55.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.308+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.2.10 2024-09-12T00:39:55.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.308+0000 7f97e60f29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.2.11 2024-09-12T00:39:55.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.308+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.2.11 2024-09-12T00:39:55.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.308+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.0 2024-09-12T00:39:55.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.308+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.1 2024-09-12T00:39:55.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.312+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.2 2024-09-12T00:39:55.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.312+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.3 2024-09-12T00:39:55.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.312+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.4 2024-09-12T00:39:55.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.312+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.5 2024-09-12T00:39:55.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.316+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.6 2024-09-12T00:39:55.314 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.316+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.7 2024-09-12T00:39:55.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.316+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.8 2024-09-12T00:39:55.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.316+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.9 2024-09-12T00:39:55.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.320+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.10 2024-09-12T00:39:55.325 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.324+0000 7f97e60f29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:55.325 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.324+0000 7f97e60f29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 2024-09-12T00:39:55.327 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.328+0000 7f97e60f29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 info.flags=0x17 2024-09-12T00:39:55.327 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.328+0000 7f97e60f29c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 to cache LRU end 2024-09-12T00:39:55.327 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.328+0000 7f97e60f29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:55.327 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.328+0000 7f97e60f29c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34, ofs0, ns] 2024-09-12T00:39:55.328 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.328+0000 7f96c2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333502 cookie 94131178372400 notifier 7503 bl.length()=911 2024-09-12T00:39:55.328 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.328+0000 7f96c2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 info.flags=0x17 2024-09-12T00:39:55.328 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.328+0000 7f96c2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 to cache LRU end 2024-09-12T00:39:55.328 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.328+0000 7f96c2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:55.329 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.328+0000 7f97e60f29c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34]): orig_sources= new_sources= 2024-09-12T00:39:55.329 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.328+0000 7f97e60f29c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34]): potential sources added=[] removed=[] 2024-09-12T00:39:55.329 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.328+0000 7f97e60f29c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34]): orig_dests= new_dests= 2024-09-12T00:39:55.329 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.328+0000 7f97e60f29c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34]): potential dests added=[] removed=[] 2024-09-12T00:39:55.335 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.336+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.0 2024-09-12T00:39:55.335 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.336+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.1 2024-09-12T00:39:55.336 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.336+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.2 2024-09-12T00:39:55.336 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.336+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.3 2024-09-12T00:39:55.337 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.340+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.4 2024-09-12T00:39:55.337 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.340+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.5 2024-09-12T00:39:55.338 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.340+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.6 2024-09-12T00:39:55.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.340+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.7 2024-09-12T00:39:55.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.340+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.8 2024-09-12T00:39:55.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.340+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.9 2024-09-12T00:39:55.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.344+0000 7f97e60f29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34.10 2024-09-12T00:39:55.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.344+0000 7f97e60f29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:55.342 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.344+0000 7f97e60f29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 2024-09-12T00:39:55.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.344+0000 7f97e60f29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 info.flags=0x17 2024-09-12T00:39:55.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.344+0000 7f97e60f29c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 to cache LRU end 2024-09-12T00:39:55.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.344+0000 7f97e60f29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:55.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.344+0000 7f97e60f29c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34, ofs0, ns] 2024-09-12T00:39:55.345 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.348+0000 7f96c27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333503 cookie 94131178372400 notifier 7503 bl.length()=879 2024-09-12T00:39:55.345 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.348+0000 7f96c27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 info.flags=0x17 2024-09-12T00:39:55.345 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.348+0000 7f96c27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 to cache LRU end 2024-09-12T00:39:55.345 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.348+0000 7f96c27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:55.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.348+0000 7f97e60f29c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34]): orig_sources= new_sources= 2024-09-12T00:39:55.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.348+0000 7f97e60f29c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34]): potential sources added=[] removed=[] 2024-09-12T00:39:55.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.348+0000 7f97e60f29c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34]): orig_dests= new_dests= 2024-09-12T00:39:55.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.348+0000 7f97e60f29c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34]): potential dests added=[] removed=[] 2024-09-12T00:39:55.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.352+0000 7f97e60f29c0 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-12T00:39:55.358 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.360+0000 7f9699fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:55.363 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.364+0000 7f97e60f29c0 20 remove_watcher() i=0 2024-09-12T00:39:55.363 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.364+0000 7f97e60f29c0 2 removed watcher, disabling cache 2024-09-12T00:39:55.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.364+0000 7f97e60f29c0 20 remove_watcher() i=1 2024-09-12T00:39:55.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.368+0000 7f97e60f29c0 20 remove_watcher() i=2 2024-09-12T00:39:55.368 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.368+0000 7f97e60f29c0 20 remove_watcher() i=3 2024-09-12T00:39:55.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.372+0000 7f97e60f29c0 20 remove_watcher() i=4 2024-09-12T00:39:55.372 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.372+0000 7f97e60f29c0 20 remove_watcher() i=5 2024-09-12T00:39:55.373 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.372+0000 7f97e60f29c0 20 remove_watcher() i=6 2024-09-12T00:39:55.374 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.376+0000 7f97e60f29c0 20 remove_watcher() i=7 2024-09-12T00:39:55.388 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:39:55.415 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:55.415 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:55.459 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.460+0000 7f000acac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.461 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.460+0000 7f000acac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:55.461 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.460+0000 7f000acac9c0 20 realm 2024-09-12T00:39:55.461 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.460+0000 7f000acac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.461 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.464+0000 7f000acac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:55.462 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.464+0000 7f000acac9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:55.462 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.464+0000 7f000acac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.462 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.464+0000 7f000acac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:55.462 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.464+0000 7f000acac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.463 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.464+0000 7f000acac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:55.463 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.464+0000 7f000acac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.464 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.464+0000 7f000acac9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:55.464 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.464+0000 7f000acac9c0 20 searching for the correct realm 2024-09-12T00:39:55.469 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.472+0000 7f0008fb3640 0 -- 172.21.15.43:0/3274946405 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55b37658b950 msgr2=0x55b37658ddc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:55.475 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.476+0000 7f00087b2640 0 -- 172.21.15.43:0/3274946405 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7efffc003070 msgr2=0x7efffc042030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:55.483 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.484+0000 7f000acac9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:39:55.484 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.484+0000 7f000acac9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:55.484 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.484+0000 7f000acac9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:55.484 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.484+0000 7f000acac9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:39:55.484 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.484+0000 7f000acac9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:55.484 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.484+0000 7f000acac9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:55.484 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.484+0000 7f000acac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.484 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.484+0000 7f000acac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:55.484 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.484+0000 7f000acac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.484+0000 7f000acac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:55.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.484+0000 7f000acac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.484+0000 7f000acac9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:55.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.484+0000 7f000acac9c0 20 zone default found 2024-09-12T00:39:55.486 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.484+0000 7f000acac9c0 4 Realm: () 2024-09-12T00:39:55.486 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.484+0000 7f000acac9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:39:55.486 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.484+0000 7f000acac9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:39:55.486 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.484+0000 7f000acac9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:55.486 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.484+0000 7f000acac9c0 20 zonegroup default 2024-09-12T00:39:55.486 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.484+0000 7f000acac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.486 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.488+0000 7f000acac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:55.486 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.488+0000 7f000acac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.487 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.488+0000 7f000acac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:55.487 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.488+0000 7f000acac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.487 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.488+0000 7f000acac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:55.487 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.488+0000 7f000acac9c0 20 started sync module instance, tier type = 2024-09-12T00:39:55.487 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.488+0000 7f000acac9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:39:55.501 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.504+0000 7f000acac9c0 20 add_watcher() i=0 2024-09-12T00:39:55.501 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.504+0000 7f000acac9c0 20 add_watcher() i=1 2024-09-12T00:39:55.501 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.504+0000 7f000acac9c0 20 add_watcher() i=2 2024-09-12T00:39:55.501 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.504+0000 7f000acac9c0 20 add_watcher() i=3 2024-09-12T00:39:55.501 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.504+0000 7f000acac9c0 20 add_watcher() i=4 2024-09-12T00:39:55.501 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.504+0000 7f000acac9c0 20 add_watcher() i=5 2024-09-12T00:39:55.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.504+0000 7f000acac9c0 20 add_watcher() i=6 2024-09-12T00:39:55.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.504+0000 7f000acac9c0 20 add_watcher() i=7 2024-09-12T00:39:55.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.504+0000 7f000acac9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:55.505 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.504+0000 7efebefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:55.505 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.508+0000 7f000acac9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:55.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.508+0000 7f000acac9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:55.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.508+0000 7f000acac9c0 5 note: GC not initialized 2024-09-12T00:39:55.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.508+0000 7efebdfdb640 20 reqs_thread_entry: start 2024-09-12T00:39:55.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.508+0000 7f000acac9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:55.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.508+0000 7f000acac9c0 20 Filter name: none 2024-09-12T00:39:55.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.508+0000 7efe2f7fe640 20 reqs_thread_entry: start 2024-09-12T00:39:55.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.508+0000 7f000acac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.508+0000 7f000acac9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:55.507 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.508+0000 7f000acac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.508 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.508+0000 7f000acac9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:39:55.508 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.508+0000 7f000acac9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:55.508 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.508+0000 7f000acac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.508+0000 7f000acac9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:39:55.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.508+0000 7f000acac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.510 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.512+0000 7f000acac9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:39:55.510 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.512+0000 7f000acac9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:55.512 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.512+0000 7efebefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:55.517 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.516+0000 7f000acac9c0 20 remove_watcher() i=0 2024-09-12T00:39:55.517 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.516+0000 7f000acac9c0 2 removed watcher, disabling cache 2024-09-12T00:39:55.519 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.520+0000 7f000acac9c0 20 remove_watcher() i=1 2024-09-12T00:39:55.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.520+0000 7f000acac9c0 20 remove_watcher() i=2 2024-09-12T00:39:55.522 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.524+0000 7f000acac9c0 20 remove_watcher() i=3 2024-09-12T00:39:55.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.524+0000 7f000acac9c0 20 remove_watcher() i=4 2024-09-12T00:39:55.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.528+0000 7f000acac9c0 20 remove_watcher() i=5 2024-09-12T00:39:55.527 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.528+0000 7f000acac9c0 20 remove_watcher() i=6 2024-09-12T00:39:55.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:55.528+0000 7f000acac9c0 20 remove_watcher() i=7 2024-09-12T00:39:55.541 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:55.542 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:39:55.542 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: abort-at-do-reshard id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:39:55.542 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:55.543 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:55.543 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:55.546 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:55.546 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:55.595 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:55.595 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:55.641 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-12T00:39:55.641 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:55.642 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:55.642 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:55.660 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:55.660 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:55.705 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:55.705 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:55.721 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:55.721 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:55.737 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:55.737 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:55.754 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:55.754 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:55.767 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:55.767 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:55.781 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:55.781 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:55.797 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:55.798 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:55.816 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:55.816 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:55.836 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:55.836 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:55.856 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:55.856 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:55.876 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:55.876 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:55.896 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:55.896 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:55.914 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:55.914 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:55.934 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:55.934 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:55.953 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:55.953 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:55.973 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:55.973 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:55.992 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:55.993 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:56.012 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:56.013 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:56.031 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:56.032 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:56.051 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:56.051 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:56.068 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:39:56.101 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:56.101 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:56.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.148+0000 7f2b282429c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.148+0000 7f2b282429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:56.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.148+0000 7f2b282429c0 20 realm 2024-09-12T00:39:56.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.148+0000 7f2b282429c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.148+0000 7f2b282429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:56.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.148+0000 7f2b282429c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:56.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.148+0000 7f2b282429c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.148+0000 7f2b282429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:56.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.148+0000 7f2b282429c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.152+0000 7f2b282429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:56.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.152+0000 7f2b282429c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.152+0000 7f2b282429c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:56.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.152+0000 7f2b282429c0 20 searching for the correct realm 2024-09-12T00:39:56.156 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.156+0000 7f2b26549640 0 -- 172.21.15.43:0/2531778143 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x56087394a800 msgr2=0x56087394cbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:56.163 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.164+0000 7f2b25547640 0 -- 172.21.15.43:0/2531778143 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f2b10031070 msgr2=0x7f2b1008aac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:56.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.172+0000 7f2b282429c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:39:56.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.172+0000 7f2b282429c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:56.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.172+0000 7f2b282429c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:56.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.172+0000 7f2b282429c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:39:56.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.172+0000 7f2b282429c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:56.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.172+0000 7f2b282429c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:56.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.172+0000 7f2b282429c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.172+0000 7f2b282429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:56.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.172+0000 7f2b282429c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.173 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.172+0000 7f2b282429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:56.173 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.172+0000 7f2b282429c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.173 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.172+0000 7f2b282429c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:56.174 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.172+0000 7f2b282429c0 20 zone default found 2024-09-12T00:39:56.174 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.172+0000 7f2b282429c0 4 Realm: () 2024-09-12T00:39:56.174 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.172+0000 7f2b282429c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:39:56.174 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.172+0000 7f2b282429c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:39:56.174 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.172+0000 7f2b282429c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:56.174 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.172+0000 7f2b282429c0 20 zonegroup default 2024-09-12T00:39:56.174 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.172+0000 7f2b282429c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.174 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.172+0000 7f2b282429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:56.174 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.172+0000 7f2b282429c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.174 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.176+0000 7f2b282429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:56.174 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.176+0000 7f2b282429c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.174 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.176+0000 7f2b282429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:56.175 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.176+0000 7f2b282429c0 20 started sync module instance, tier type = 2024-09-12T00:39:56.175 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.176+0000 7f2b282429c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:39:56.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.188+0000 7f2b282429c0 20 add_watcher() i=0 2024-09-12T00:39:56.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.188+0000 7f2b282429c0 20 add_watcher() i=1 2024-09-12T00:39:56.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.188+0000 7f2b282429c0 20 add_watcher() i=2 2024-09-12T00:39:56.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.188+0000 7f2b282429c0 20 add_watcher() i=3 2024-09-12T00:39:56.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.188+0000 7f2b282429c0 20 add_watcher() i=4 2024-09-12T00:39:56.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.188+0000 7f2b282429c0 20 add_watcher() i=5 2024-09-12T00:39:56.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.188+0000 7f2b282429c0 20 add_watcher() i=6 2024-09-12T00:39:56.190 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.192+0000 7f2b282429c0 20 add_watcher() i=7 2024-09-12T00:39:56.190 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.192+0000 7f2b282429c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:56.193 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.192+0000 7f29d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:56.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.196+0000 7f2b282429c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:56.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.196+0000 7f2b282429c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:56.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.196+0000 7f2b282429c0 5 note: GC not initialized 2024-09-12T00:39:56.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.196+0000 7f29d67fc640 20 reqs_thread_entry: start 2024-09-12T00:39:56.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.196+0000 7f2b282429c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:56.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.196+0000 7f2b282429c0 20 Filter name: none 2024-09-12T00:39:56.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.196+0000 7f2947fff640 20 reqs_thread_entry: start 2024-09-12T00:39:56.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.196+0000 7f2b282429c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.196+0000 7f2b282429c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:39:56.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.196+0000 7f2b282429c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.196 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.196+0000 7f2b282429c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:39:56.196 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.196+0000 7f2b282429c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:56.197 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.196+0000 7f2b282429c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.197 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.200+0000 7f2b282429c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:39:56.197 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.200+0000 7f2b282429c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.198 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.200+0000 7f2b282429c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:39:56.198 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.200+0000 7f2b282429c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:56.201 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.200+0000 7f29d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:56.206 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.208+0000 7f2b282429c0 20 remove_watcher() i=0 2024-09-12T00:39:56.206 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.208+0000 7f2b282429c0 2 removed watcher, disabling cache 2024-09-12T00:39:56.209 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.208+0000 7f2b282429c0 20 remove_watcher() i=1 2024-09-12T00:39:56.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.212+0000 7f2b282429c0 20 remove_watcher() i=2 2024-09-12T00:39:56.216 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.216+0000 7f2b282429c0 20 remove_watcher() i=3 2024-09-12T00:39:56.216 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.216+0000 7f2b282429c0 20 remove_watcher() i=4 2024-09-12T00:39:56.217 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.216+0000 7f2b282429c0 20 remove_watcher() i=5 2024-09-12T00:39:56.218 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.220+0000 7f2b282429c0 20 remove_watcher() i=6 2024-09-12T00:39:56.219 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.220+0000 7f2b282429c0 20 remove_watcher() i=7 2024-09-12T00:39:56.233 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:56.233 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:39:56.233 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-logrecord-writes id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:39:56.233 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:56.233 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-12T00:39:56.265 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:56.266 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:56.308 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.308+0000 7f183d4909c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.312+0000 7f183d4909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:56.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.312+0000 7f183d4909c0 20 realm 2024-09-12T00:39:56.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.312+0000 7f183d4909c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.312+0000 7f183d4909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:56.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.312+0000 7f183d4909c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:56.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.312+0000 7f183d4909c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.312+0000 7f183d4909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:56.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.312+0000 7f183d4909c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.312+0000 7f183d4909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:56.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.312+0000 7f183d4909c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.312+0000 7f183d4909c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:56.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.312+0000 7f183d4909c0 20 searching for the correct realm 2024-09-12T00:39:56.320 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.320+0000 7f183b797640 0 -- 172.21.15.43:0/1110892003 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f183001a9f0 msgr2=0x7f1830028420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:56.536 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.536+0000 7f183af96640 0 -- 172.21.15.43:0/1110892003 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x55f78cf5d8f0 msgr2=0x55f78cf5fce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:56.544 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.544+0000 7f183d4909c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:39:56.544 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.544+0000 7f183d4909c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:56.544 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.544+0000 7f183d4909c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:56.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.544+0000 7f183d4909c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:39:56.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.544+0000 7f183d4909c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:56.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.544+0000 7f183d4909c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:56.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.544+0000 7f183d4909c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.544+0000 7f183d4909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:56.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.544+0000 7f183d4909c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.546 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.548+0000 7f183d4909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:56.546 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.548+0000 7f183d4909c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.546 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.548+0000 7f183d4909c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:56.546 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.548+0000 7f183d4909c0 20 zone default found 2024-09-12T00:39:56.546 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.548+0000 7f183d4909c0 4 Realm: () 2024-09-12T00:39:56.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.548+0000 7f183d4909c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:39:56.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.548+0000 7f183d4909c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:39:56.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.548+0000 7f183d4909c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:56.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.548+0000 7f183d4909c0 20 zonegroup default 2024-09-12T00:39:56.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.548+0000 7f183d4909c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.548+0000 7f183d4909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:56.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.548+0000 7f183d4909c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.548 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.548+0000 7f183d4909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:56.548 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.548+0000 7f183d4909c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.548+0000 7f183d4909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:56.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.552+0000 7f183d4909c0 20 started sync module instance, tier type = 2024-09-12T00:39:56.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.552+0000 7f183d4909c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:39:56.573 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.576+0000 7f183d4909c0 20 add_watcher() i=0 2024-09-12T00:39:56.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.576+0000 7f183d4909c0 20 add_watcher() i=1 2024-09-12T00:39:56.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.576+0000 7f183d4909c0 20 add_watcher() i=2 2024-09-12T00:39:56.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.576+0000 7f183d4909c0 20 add_watcher() i=3 2024-09-12T00:39:56.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.576+0000 7f183d4909c0 20 add_watcher() i=4 2024-09-12T00:39:56.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.576+0000 7f183d4909c0 20 add_watcher() i=5 2024-09-12T00:39:56.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.576+0000 7f183d4909c0 20 add_watcher() i=6 2024-09-12T00:39:56.575 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.576+0000 7f183d4909c0 20 add_watcher() i=7 2024-09-12T00:39:56.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.576+0000 7f183d4909c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:56.579 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.580+0000 7f16f17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:56.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.580+0000 7f183d4909c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:56.581 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.580+0000 7f183d4909c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:56.581 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.580+0000 7f183d4909c0 5 note: GC not initialized 2024-09-12T00:39:56.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.584+0000 7f166bfff640 20 reqs_thread_entry: start 2024-09-12T00:39:56.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.584+0000 7f183d4909c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:56.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.584+0000 7f183d4909c0 20 Filter name: none 2024-09-12T00:39:56.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.584+0000 7f1669ffb640 20 reqs_thread_entry: start 2024-09-12T00:39:56.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.584+0000 7f183d4909c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T00:39:56.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.584+0000 7f183d4909c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.583 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.584+0000 7f183d4909c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:39:56.583 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.584+0000 7f183d4909c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T00:39:56.584 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.584+0000 7f183d4909c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T00:39:56.584 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.584+0000 7f183d4909c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 : miss 2024-09-12T00:39:56.584 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.584+0000 7f183d4909c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.584+0000 7f183d4909c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:39:56.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.584+0000 7f183d4909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 info.flags=0x17 2024-09-12T00:39:56.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.584+0000 7f183d4909c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 to cache LRU end 2024-09-12T00:39:56.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.584+0000 7f183d4909c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:56.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.584+0000 7f183d4909c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:56.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.584+0000 7f183d4909c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 2024-09-12T00:39:56.596 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.596+0000 7f183d4909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 info.flags=0x17 2024-09-12T00:39:56.596 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.596+0000 7f183d4909c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 to cache LRU end 2024-09-12T00:39:56.596 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.596+0000 7f183d4909c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:56.596 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.596+0000 7f183d4909c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35, ofs0, ns] 2024-09-12T00:39:56.597 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.596+0000 7f171e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333504 cookie 94521710265952 notifier 7557 bl.length()=923 2024-09-12T00:39:56.597 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.596+0000 7f171e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 info.flags=0x17 2024-09-12T00:39:56.597 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.596+0000 7f171e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 to cache LRU end 2024-09-12T00:39:56.597 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.596+0000 7f171e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:56.598 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.600+0000 7f183d4909c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35]): orig_sources= new_sources= 2024-09-12T00:39:56.598 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.600+0000 7f183d4909c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35]): potential sources added=[] removed=[] 2024-09-12T00:39:56.598 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.600+0000 7f183d4909c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35]): orig_dests= new_dests= 2024-09-12T00:39:56.598 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.600+0000 7f183d4909c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35]): potential dests added=[] removed=[] 2024-09-12T00:39:56.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.604+0000 7f183d4909c0 -1 Injecting error=-5 at location=logrecord_writes 2024-09-12T00:39:56.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.604+0000 7f183d4909c0 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-12T00:39:56.616 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.616+0000 7f183d4909c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:56.616 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.616+0000 7f183d4909c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 2024-09-12T00:39:56.619 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.620+0000 7f183d4909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 info.flags=0x17 2024-09-12T00:39:56.619 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.620+0000 7f183d4909c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 to cache LRU end 2024-09-12T00:39:56.619 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.620+0000 7f183d4909c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:56.619 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.620+0000 7f183d4909c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35, ofs0, ns] 2024-09-12T00:39:56.619 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.620+0000 7f171e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333505 cookie 94521710265952 notifier 7557 bl.length()=891 2024-09-12T00:39:56.620 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.620+0000 7f171e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 info.flags=0x17 2024-09-12T00:39:56.620 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.620+0000 7f171e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 to cache LRU end 2024-09-12T00:39:56.620 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.620+0000 7f171e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:56.620 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.620+0000 7f183d4909c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35]): orig_sources= new_sources= 2024-09-12T00:39:56.621 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.620+0000 7f183d4909c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35]): potential sources added=[] removed=[] 2024-09-12T00:39:56.621 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.620+0000 7f183d4909c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35]): orig_dests= new_dests= 2024-09-12T00:39:56.621 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.620+0000 7f183d4909c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35]): potential dests added=[] removed=[] 2024-09-12T00:39:56.624 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.624+0000 7f16f17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:56.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.632+0000 7f183d4909c0 20 remove_watcher() i=0 2024-09-12T00:39:56.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.632+0000 7f183d4909c0 2 removed watcher, disabling cache 2024-09-12T00:39:56.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.632+0000 7f183d4909c0 20 remove_watcher() i=1 2024-09-12T00:39:56.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.636+0000 7f183d4909c0 20 remove_watcher() i=2 2024-09-12T00:39:56.636 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.636+0000 7f183d4909c0 20 remove_watcher() i=3 2024-09-12T00:39:56.638 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.640+0000 7f183d4909c0 20 remove_watcher() i=4 2024-09-12T00:39:56.640 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.640+0000 7f183d4909c0 20 remove_watcher() i=5 2024-09-12T00:39:56.641 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.644+0000 7f183d4909c0 20 remove_watcher() i=6 2024-09-12T00:39:56.643 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.644+0000 7f183d4909c0 20 remove_watcher() i=7 2024-09-12T00:39:56.668 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:39:56.696 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:56.696 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:56.742 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.744+0000 7f4d06d569c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.744+0000 7f4d06d569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:56.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.744+0000 7f4d06d569c0 20 realm 2024-09-12T00:39:56.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.744+0000 7f4d06d569c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.744+0000 7f4d06d569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:56.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.744+0000 7f4d06d569c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:56.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.744+0000 7f4d06d569c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.744+0000 7f4d06d569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:56.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.744+0000 7f4d06d569c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.748+0000 7f4d06d569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:56.746 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.748+0000 7f4d06d569c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.747 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.748+0000 7f4d06d569c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:56.747 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.748+0000 7f4d06d569c0 20 searching for the correct realm 2024-09-12T00:39:56.753 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.756+0000 7f4cfffff640 0 -- 172.21.15.43:0/32642652 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55849a638980 msgr2=0x55849a63ad90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:56.759 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.760+0000 7f4d0485c640 0 -- 172.21.15.43:0/32642652 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f4cf0032420 msgr2=0x7f4cf00328a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:56.768 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.768+0000 7f4d06d569c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:39:56.768 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.768+0000 7f4d06d569c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:56.768 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.768+0000 7f4d06d569c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:56.768 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.768+0000 7f4d06d569c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:39:56.768 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.768+0000 7f4d06d569c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:56.768 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.768+0000 7f4d06d569c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:56.768 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.768+0000 7f4d06d569c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.768 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.768+0000 7f4d06d569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:56.768 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.768+0000 7f4d06d569c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.768+0000 7f4d06d569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:56.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.768+0000 7f4d06d569c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.768+0000 7f4d06d569c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:56.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.768+0000 7f4d06d569c0 20 zone default found 2024-09-12T00:39:56.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.768+0000 7f4d06d569c0 4 Realm: () 2024-09-12T00:39:56.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.768+0000 7f4d06d569c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:39:56.770 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.768+0000 7f4d06d569c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:39:56.770 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.768+0000 7f4d06d569c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:56.770 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.768+0000 7f4d06d569c0 20 zonegroup default 2024-09-12T00:39:56.770 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.768+0000 7f4d06d569c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.770 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.772+0000 7f4d06d569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:56.770 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.772+0000 7f4d06d569c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.770 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.772+0000 7f4d06d569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:56.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.772+0000 7f4d06d569c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.772+0000 7f4d06d569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:56.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.772+0000 7f4d06d569c0 20 started sync module instance, tier type = 2024-09-12T00:39:56.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.772+0000 7f4d06d569c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:39:56.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.788+0000 7f4d06d569c0 20 add_watcher() i=0 2024-09-12T00:39:56.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.788+0000 7f4d06d569c0 20 add_watcher() i=1 2024-09-12T00:39:56.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.788+0000 7f4d06d569c0 20 add_watcher() i=2 2024-09-12T00:39:56.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.788+0000 7f4d06d569c0 20 add_watcher() i=3 2024-09-12T00:39:56.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.788+0000 7f4d06d569c0 20 add_watcher() i=4 2024-09-12T00:39:56.787 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.788+0000 7f4d06d569c0 20 add_watcher() i=5 2024-09-12T00:39:56.787 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.788+0000 7f4d06d569c0 20 add_watcher() i=6 2024-09-12T00:39:56.787 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.788+0000 7f4d06d569c0 20 add_watcher() i=7 2024-09-12T00:39:56.787 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.788+0000 7f4d06d569c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:56.789 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.792+0000 7f4bbafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:56.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.792+0000 7f4d06d569c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:56.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.792+0000 7f4d06d569c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:56.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.792+0000 7f4d06d569c0 5 note: GC not initialized 2024-09-12T00:39:56.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.792+0000 7f4bb9fe3640 20 reqs_thread_entry: start 2024-09-12T00:39:56.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.792+0000 7f4d06d569c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:56.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.792+0000 7f4d06d569c0 20 Filter name: none 2024-09-12T00:39:56.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.792+0000 7f4b2b7fe640 20 reqs_thread_entry: start 2024-09-12T00:39:56.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.792+0000 7f4d06d569c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.792+0000 7f4d06d569c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:39:56.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.792+0000 7f4d06d569c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.796+0000 7f4d06d569c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:39:56.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.796+0000 7f4d06d569c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:56.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.796+0000 7f4d06d569c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.796+0000 7f4d06d569c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:39:56.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.796+0000 7f4d06d569c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.795 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.796+0000 7f4d06d569c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:39:56.795 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.796+0000 7f4d06d569c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:56.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.800+0000 7f4bbafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:56.802 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.804+0000 7f4d06d569c0 20 remove_watcher() i=0 2024-09-12T00:39:56.802 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.804+0000 7f4d06d569c0 2 removed watcher, disabling cache 2024-09-12T00:39:56.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.804+0000 7f4d06d569c0 20 remove_watcher() i=1 2024-09-12T00:39:56.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.808+0000 7f4d06d569c0 20 remove_watcher() i=2 2024-09-12T00:39:56.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.808+0000 7f4d06d569c0 20 remove_watcher() i=3 2024-09-12T00:39:56.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.812+0000 7f4d06d569c0 20 remove_watcher() i=4 2024-09-12T00:39:56.812 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.812+0000 7f4d06d569c0 20 remove_watcher() i=5 2024-09-12T00:39:56.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.816+0000 7f4d06d569c0 20 remove_watcher() i=6 2024-09-12T00:39:56.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.816+0000 7f4d06d569c0 20 remove_watcher() i=7 2024-09-12T00:39:56.829 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:56.829 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:39:56.829 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-logrecord-writes id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:39:56.829 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:56.830 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:56.830 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:56.843 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:56.843 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:56.887 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:39:56.926 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:56.926 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:56.972 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.972+0000 7f660b9779c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.974 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.976+0000 7f660b9779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:56.975 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.976+0000 7f660b9779c0 20 realm 2024-09-12T00:39:56.975 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.976+0000 7f660b9779c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.975 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.976+0000 7f660b9779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:56.975 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.976+0000 7f660b9779c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:56.975 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.976+0000 7f660b9779c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.975 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.976+0000 7f660b9779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:56.975 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.976+0000 7f660b9779c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.976 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.976+0000 7f660b9779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:56.976 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.976+0000 7f660b9779c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:56.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.980+0000 7f660b9779c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:56.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.980+0000 7f660b9779c0 20 searching for the correct realm 2024-09-12T00:39:56.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:56.984+0000 7f6609c7e640 0 -- 172.21.15.43:0/3103816732 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f66001231c0 msgr2=0x7f660010ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:57.200 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.200+0000 7f660947d640 0 -- 172.21.15.43:0/3103816732 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x557d808b4030 msgr2=0x557d808b64f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:57.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.208+0000 7f660b9779c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:39:57.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.208+0000 7f660b9779c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:57.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.208+0000 7f660b9779c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:57.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.208+0000 7f660b9779c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:39:57.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.208+0000 7f660b9779c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:57.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.208+0000 7f660b9779c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:57.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.208+0000 7f660b9779c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:57.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.208+0000 7f660b9779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:57.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.208+0000 7f660b9779c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:57.209 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.212+0000 7f660b9779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:57.209 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.212+0000 7f660b9779c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:57.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.212+0000 7f660b9779c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:57.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.212+0000 7f660b9779c0 20 zone default found 2024-09-12T00:39:57.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.212+0000 7f660b9779c0 4 Realm: () 2024-09-12T00:39:57.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.212+0000 7f660b9779c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:39:57.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.212+0000 7f660b9779c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:39:57.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.212+0000 7f660b9779c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:57.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.212+0000 7f660b9779c0 20 zonegroup default 2024-09-12T00:39:57.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.212+0000 7f660b9779c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:57.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.212+0000 7f660b9779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:57.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.212+0000 7f660b9779c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:57.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.212+0000 7f660b9779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:57.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.212+0000 7f660b9779c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:57.212 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.212+0000 7f660b9779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:57.212 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.212+0000 7f660b9779c0 20 started sync module instance, tier type = 2024-09-12T00:39:57.212 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.212+0000 7f660b9779c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:39:57.237 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.236+0000 7f660b9779c0 20 add_watcher() i=0 2024-09-12T00:39:57.237 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.236+0000 7f660b9779c0 20 add_watcher() i=1 2024-09-12T00:39:57.237 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.236+0000 7f660b9779c0 20 add_watcher() i=2 2024-09-12T00:39:57.237 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.236+0000 7f660b9779c0 20 add_watcher() i=3 2024-09-12T00:39:57.237 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.236+0000 7f660b9779c0 20 add_watcher() i=4 2024-09-12T00:39:57.237 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.236+0000 7f660b9779c0 20 add_watcher() i=5 2024-09-12T00:39:57.237 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.236+0000 7f660b9779c0 20 add_watcher() i=6 2024-09-12T00:39:57.239 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.240+0000 7f660b9779c0 20 add_watcher() i=7 2024-09-12T00:39:57.239 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.240+0000 7f660b9779c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:57.243 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.244+0000 7f64bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:57.244 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.244+0000 7f660b9779c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:57.245 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.244+0000 7f660b9779c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:57.245 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.244+0000 7f660b9779c0 5 note: GC not initialized 2024-09-12T00:39:57.246 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.248+0000 7f64be7e4640 20 reqs_thread_entry: start 2024-09-12T00:39:57.246 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.248+0000 7f660b9779c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:57.246 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.248+0000 7f660b9779c0 20 Filter name: none 2024-09-12T00:39:57.246 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.248+0000 7f642ffff640 20 reqs_thread_entry: start 2024-09-12T00:39:57.246 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.248+0000 7f660b9779c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T00:39:57.246 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.248+0000 7f660b9779c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:57.247 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.248+0000 7f660b9779c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:39:57.247 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.248+0000 7f660b9779c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T00:39:57.247 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.248+0000 7f660b9779c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T00:39:57.247 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.248+0000 7f660b9779c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 : miss 2024-09-12T00:39:57.248 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.248+0000 7f660b9779c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:57.248 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.248+0000 7f660b9779c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:39:57.248 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.248+0000 7f660b9779c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 info.flags=0x17 2024-09-12T00:39:57.248 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.248+0000 7f660b9779c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 to cache LRU end 2024-09-12T00:39:57.249 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.248+0000 7f660b9779c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:57.249 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.248+0000 7f660b9779c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:57.249 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.248+0000 7f660b9779c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 2024-09-12T00:39:57.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.260+0000 7f660b9779c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 info.flags=0x17 2024-09-12T00:39:57.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.260+0000 7f660b9779c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 to cache LRU end 2024-09-12T00:39:57.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.260+0000 7f660b9779c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:57.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.260+0000 7f660b9779c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35, ofs0, ns] 2024-09-12T00:39:57.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.260+0000 7f64ecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333506 cookie 93997515943424 notifier 7265 bl.length()=923 2024-09-12T00:39:57.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.260+0000 7f64ecff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 info.flags=0x17 2024-09-12T00:39:57.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.260+0000 7f64ecff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 to cache LRU end 2024-09-12T00:39:57.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.260+0000 7f64ecff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:57.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.260+0000 7f660b9779c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35]): orig_sources= new_sources= 2024-09-12T00:39:57.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.260+0000 7f660b9779c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35]): potential sources added=[] removed=[] 2024-09-12T00:39:57.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.260+0000 7f660b9779c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35]): orig_dests= new_dests= 2024-09-12T00:39:57.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.260+0000 7f660b9779c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35]): potential dests added=[] removed=[] 2024-09-12T00:39:57.270 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.272+0000 7f660b9779c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.1.0 2024-09-12T00:39:57.270 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.272+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.1.0 2024-09-12T00:39:57.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.272+0000 7f660b9779c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.1.1 2024-09-12T00:39:57.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.272+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.1.1 2024-09-12T00:39:57.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.272+0000 7f660b9779c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.1.2 2024-09-12T00:39:57.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.272+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.1.2 2024-09-12T00:39:57.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.272+0000 7f660b9779c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.1.3 2024-09-12T00:39:57.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.272+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.1.3 2024-09-12T00:39:57.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.272+0000 7f660b9779c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.1.4 2024-09-12T00:39:57.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.272+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.1.4 2024-09-12T00:39:57.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.272+0000 7f660b9779c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.1.5 2024-09-12T00:39:57.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.272+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.1.5 2024-09-12T00:39:57.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.272+0000 7f660b9779c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.1.6 2024-09-12T00:39:57.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.272+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.1.6 2024-09-12T00:39:57.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.272+0000 7f660b9779c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.1.7 2024-09-12T00:39:57.272 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.272+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.1.7 2024-09-12T00:39:57.272 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.272+0000 7f660b9779c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.1.8 2024-09-12T00:39:57.272 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.272+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.1.8 2024-09-12T00:39:57.272 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.272+0000 7f660b9779c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.1.9 2024-09-12T00:39:57.272 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.272+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.1.9 2024-09-12T00:39:57.272 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.272+0000 7f660b9779c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.1.10 2024-09-12T00:39:57.272 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.272+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.1.10 2024-09-12T00:39:57.272 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.272+0000 7f660b9779c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.1.11 2024-09-12T00:39:57.272 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.272+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.1.11 2024-09-12T00:39:57.272 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.272+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.0 2024-09-12T00:39:57.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.272+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.1 2024-09-12T00:39:57.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.272+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.2 2024-09-12T00:39:57.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.272+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.3 2024-09-12T00:39:57.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.276+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.4 2024-09-12T00:39:57.275 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.276+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.5 2024-09-12T00:39:57.276 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.276+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.6 2024-09-12T00:39:57.276 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.276+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.7 2024-09-12T00:39:57.277 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.280+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.8 2024-09-12T00:39:57.279 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.280+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.9 2024-09-12T00:39:57.280 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.280+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.10 2024-09-12T00:39:57.285 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.288+0000 7f660b9779c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:57.286 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.288+0000 7f660b9779c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 2024-09-12T00:39:57.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.288+0000 7f660b9779c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 info.flags=0x17 2024-09-12T00:39:57.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.288+0000 7f660b9779c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 to cache LRU end 2024-09-12T00:39:57.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.288+0000 7f660b9779c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:57.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.288+0000 7f660b9779c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35, ofs0, ns] 2024-09-12T00:39:57.289 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.288+0000 7f64ecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333507 cookie 93997515943424 notifier 7265 bl.length()=923 2024-09-12T00:39:57.289 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.288+0000 7f64ecff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 info.flags=0x17 2024-09-12T00:39:57.289 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.288+0000 7f64ecff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 to cache LRU end 2024-09-12T00:39:57.289 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.288+0000 7f64ecff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:57.290 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.292+0000 7f660b9779c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35]): orig_sources= new_sources= 2024-09-12T00:39:57.290 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.292+0000 7f660b9779c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35]): potential sources added=[] removed=[] 2024-09-12T00:39:57.290 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.292+0000 7f660b9779c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35]): orig_dests= new_dests= 2024-09-12T00:39:57.290 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.292+0000 7f660b9779c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35]): potential dests added=[] removed=[] 2024-09-12T00:39:57.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.296+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.0 2024-09-12T00:39:57.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.296+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.1 2024-09-12T00:39:57.295 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.296+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.2 2024-09-12T00:39:57.296 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.296+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.3 2024-09-12T00:39:57.296 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.296+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.4 2024-09-12T00:39:57.297 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.296+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.5 2024-09-12T00:39:57.297 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.300+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.6 2024-09-12T00:39:57.298 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.300+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.7 2024-09-12T00:39:57.299 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.300+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.8 2024-09-12T00:39:57.300 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.300+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.9 2024-09-12T00:39:57.300 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.300+0000 7f660b9779c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35.10 2024-09-12T00:39:57.301 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.304+0000 7f660b9779c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:57.301 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.304+0000 7f660b9779c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 2024-09-12T00:39:57.304 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.304+0000 7f660b9779c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 info.flags=0x17 2024-09-12T00:39:57.304 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.304+0000 7f660b9779c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 to cache LRU end 2024-09-12T00:39:57.304 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.304+0000 7f660b9779c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:57.304 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.304+0000 7f660b9779c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35, ofs0, ns] 2024-09-12T00:39:57.304 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.304+0000 7f64dbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333508 cookie 93997515943424 notifier 7265 bl.length()=891 2024-09-12T00:39:57.304 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.304+0000 7f64dbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 info.flags=0x17 2024-09-12T00:39:57.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.304+0000 7f64dbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 to cache LRU end 2024-09-12T00:39:57.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.304+0000 7f64dbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:57.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.308+0000 7f660b9779c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35]): orig_sources= new_sources= 2024-09-12T00:39:57.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.308+0000 7f660b9779c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35]): potential sources added=[] removed=[] 2024-09-12T00:39:57.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.308+0000 7f660b9779c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35]): orig_dests= new_dests= 2024-09-12T00:39:57.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.308+0000 7f660b9779c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35]): potential dests added=[] removed=[] 2024-09-12T00:39:57.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.312+0000 7f660b9779c0 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-12T00:39:57.314 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.316+0000 7f64bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:57.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.320+0000 7f660b9779c0 20 remove_watcher() i=0 2024-09-12T00:39:57.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.320+0000 7f660b9779c0 2 removed watcher, disabling cache 2024-09-12T00:39:57.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.320+0000 7f660b9779c0 20 remove_watcher() i=1 2024-09-12T00:39:57.323 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.324+0000 7f660b9779c0 20 remove_watcher() i=2 2024-09-12T00:39:57.325 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.328+0000 7f660b9779c0 20 remove_watcher() i=3 2024-09-12T00:39:57.327 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.328+0000 7f660b9779c0 20 remove_watcher() i=4 2024-09-12T00:39:57.328 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.328+0000 7f660b9779c0 20 remove_watcher() i=5 2024-09-12T00:39:57.330 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.332+0000 7f660b9779c0 20 remove_watcher() i=6 2024-09-12T00:39:57.332 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.332+0000 7f660b9779c0 20 remove_watcher() i=7 2024-09-12T00:39:57.350 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:39:57.382 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:57.382 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:57.426 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.428+0000 7f51bb46b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:57.428 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.428+0000 7f51bb46b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:57.428 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.428+0000 7f51bb46b9c0 20 realm 2024-09-12T00:39:57.428 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.428+0000 7f51bb46b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:57.428 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.428+0000 7f51bb46b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:57.428 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.428+0000 7f51bb46b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:57.428 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.428+0000 7f51bb46b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:57.429 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.428+0000 7f51bb46b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:57.429 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.428+0000 7f51bb46b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:57.430 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.432+0000 7f51bb46b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:57.430 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.432+0000 7f51bb46b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:57.431 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.432+0000 7f51bb46b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:57.431 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.432+0000 7f51bb46b9c0 20 searching for the correct realm 2024-09-12T00:39:57.434 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.436+0000 7f51b8770640 0 -- 172.21.15.43:0/3046465726 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f51ac0bab70 msgr2=0x7f51ac0b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:57.651 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.652+0000 7f51b8f71640 0 -- 172.21.15.43:0/3046465726 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f51ac0b1960 msgr2=0x7f51ac0d5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:57.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.868+0000 7f51bb46b9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:39:57.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.868+0000 7f51bb46b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:57.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.868+0000 7f51bb46b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:57.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.868+0000 7f51bb46b9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:39:57.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.868+0000 7f51bb46b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:57.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.868+0000 7f51bb46b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:57.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.868+0000 7f51bb46b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:57.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.872+0000 7f51bb46b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:57.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.872+0000 7f51bb46b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:57.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.872+0000 7f51bb46b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:57.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.872+0000 7f51bb46b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:57.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.872+0000 7f51bb46b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:57.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.872+0000 7f51bb46b9c0 20 zone default found 2024-09-12T00:39:57.872 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.872+0000 7f51bb46b9c0 4 Realm: () 2024-09-12T00:39:57.872 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.872+0000 7f51bb46b9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:39:57.872 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.872+0000 7f51bb46b9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:39:57.872 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.872+0000 7f51bb46b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:57.872 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.872+0000 7f51bb46b9c0 20 zonegroup default 2024-09-12T00:39:57.872 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.872+0000 7f51bb46b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:57.872 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.872+0000 7f51bb46b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:57.872 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.872+0000 7f51bb46b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:57.873 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.876+0000 7f51bb46b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:57.873 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.876+0000 7f51bb46b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:57.874 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.876+0000 7f51bb46b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:57.874 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.876+0000 7f51bb46b9c0 20 started sync module instance, tier type = 2024-09-12T00:39:57.874 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.876+0000 7f51bb46b9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:39:57.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.900+0000 7f51bb46b9c0 20 add_watcher() i=0 2024-09-12T00:39:57.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.900+0000 7f51bb46b9c0 20 add_watcher() i=1 2024-09-12T00:39:57.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.900+0000 7f51bb46b9c0 20 add_watcher() i=2 2024-09-12T00:39:57.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.900+0000 7f51bb46b9c0 20 add_watcher() i=3 2024-09-12T00:39:57.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.900+0000 7f51bb46b9c0 20 add_watcher() i=4 2024-09-12T00:39:57.899 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.900+0000 7f51bb46b9c0 20 add_watcher() i=5 2024-09-12T00:39:57.900 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.900+0000 7f51bb46b9c0 20 add_watcher() i=6 2024-09-12T00:39:57.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.904+0000 7f51bb46b9c0 20 add_watcher() i=7 2024-09-12T00:39:57.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.904+0000 7f51bb46b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:57.906 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.908+0000 7f506efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:57.907 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.908+0000 7f51bb46b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:57.907 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.908+0000 7f51bb46b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:57.907 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.908+0000 7f51bb46b9c0 5 note: GC not initialized 2024-09-12T00:39:57.908 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.908+0000 7f506dfe3640 20 reqs_thread_entry: start 2024-09-12T00:39:57.908 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.908+0000 7f51bb46b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:57.908 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.908+0000 7f51bb46b9c0 20 Filter name: none 2024-09-12T00:39:57.909 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.908+0000 7f4fdf7fe640 20 reqs_thread_entry: start 2024-09-12T00:39:57.909 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.908+0000 7f51bb46b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:57.909 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.912+0000 7f51bb46b9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:39:57.909 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.912+0000 7f51bb46b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:57.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.912+0000 7f51bb46b9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:39:57.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.912+0000 7f51bb46b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:57.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.912+0000 7f51bb46b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:57.912 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.912+0000 7f51bb46b9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:39:57.912 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.912+0000 7f51bb46b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:57.913 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.912+0000 7f51bb46b9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:39:57.913 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.912+0000 7f51bb46b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:57.917 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.916+0000 7f506efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:57.921 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.924+0000 7f51bb46b9c0 20 remove_watcher() i=0 2024-09-12T00:39:57.922 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.924+0000 7f51bb46b9c0 2 removed watcher, disabling cache 2024-09-12T00:39:57.924 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.924+0000 7f51bb46b9c0 20 remove_watcher() i=1 2024-09-12T00:39:57.926 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.928+0000 7f51bb46b9c0 20 remove_watcher() i=2 2024-09-12T00:39:57.928 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.928+0000 7f51bb46b9c0 20 remove_watcher() i=3 2024-09-12T00:39:57.931 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.932+0000 7f51bb46b9c0 20 remove_watcher() i=4 2024-09-12T00:39:57.933 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.936+0000 7f51bb46b9c0 20 remove_watcher() i=5 2024-09-12T00:39:57.935 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.936+0000 7f51bb46b9c0 20 remove_watcher() i=6 2024-09-12T00:39:57.936 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:57.936+0000 7f51bb46b9c0 20 remove_watcher() i=7 2024-09-12T00:39:57.952 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:57.952 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:39:57.952 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-logrecord-writes id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:39:57.952 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:57.954 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:57.955 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:57.960 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:57.960 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:58.008 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:58.008 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:58.060 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-12T00:39:58.060 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:58.064 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:58.065 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:58.084 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:58.085 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:58.133 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:58.133 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:58.152 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:58.152 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:58.171 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:58.171 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:58.194 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:58.194 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:58.214 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:58.214 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:58.234 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:58.234 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:58.252 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:58.253 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:58.272 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:58.272 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:58.292 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:58.292 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:58.312 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:58.312 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:58.332 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:58.332 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:58.351 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:58.351 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:58.372 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:58.372 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:58.392 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:58.392 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:58.411 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:58.411 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:58.431 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:58.431 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:58.451 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:58.451 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:58.472 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:58.473 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:58.494 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:58.494 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:58.512 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:58.513 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:39:58.530 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:39:58.563 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:58.564 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:58.609 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:58.612+0000 7fbe36e959c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:58.612 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:58.612+0000 7fbe36e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:58.612 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:58.612+0000 7fbe36e959c0 20 realm 2024-09-12T00:39:58.612 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:58.612+0000 7fbe36e959c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:58.612 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:58.612+0000 7fbe36e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:58.612 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:58.612+0000 7fbe36e959c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:58.612 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:58.612+0000 7fbe36e959c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:58.612 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:58.612+0000 7fbe36e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:58.612 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:58.612+0000 7fbe36e959c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:58.614 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:58.616+0000 7fbe36e959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:58.614 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:58.616+0000 7fbe36e959c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:58.615 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:58.616+0000 7fbe36e959c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:58.615 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:58.616+0000 7fbe36e959c0 20 searching for the correct realm 2024-09-12T00:39:58.618 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:58.620+0000 7fbe3419a640 0 -- 172.21.15.43:0/2836049906 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fbe28033040 msgr2=0x7fbe2804b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:58.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:58.836+0000 7fbe3499b640 0 -- 172.21.15.43:0/2836049906 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fbe28021450 msgr2=0x7fbe280218d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:59.052 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.052+0000 7fbe36e959c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:39:59.053 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.052+0000 7fbe36e959c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:59.053 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.052+0000 7fbe36e959c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:59.053 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.052+0000 7fbe36e959c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:39:59.053 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.052+0000 7fbe36e959c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:59.053 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.052+0000 7fbe36e959c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:59.053 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.052+0000 7fbe36e959c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.053 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.056+0000 7fbe36e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.053 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.056+0000 7fbe36e959c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.054 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.056+0000 7fbe36e959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:59.054 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.056+0000 7fbe36e959c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.054 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.056+0000 7fbe36e959c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:59.055 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.056+0000 7fbe36e959c0 20 zone default found 2024-09-12T00:39:59.055 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.056+0000 7fbe36e959c0 4 Realm: () 2024-09-12T00:39:59.055 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.056+0000 7fbe36e959c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:39:59.055 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.056+0000 7fbe36e959c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:39:59.055 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.056+0000 7fbe36e959c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:59.055 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.056+0000 7fbe36e959c0 20 zonegroup default 2024-09-12T00:39:59.055 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.056+0000 7fbe36e959c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.056+0000 7fbe36e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.056+0000 7fbe36e959c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.057 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.056+0000 7fbe36e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.057 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.056+0000 7fbe36e959c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.058 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.060+0000 7fbe36e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.058 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.060+0000 7fbe36e959c0 20 started sync module instance, tier type = 2024-09-12T00:39:59.058 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.060+0000 7fbe36e959c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:39:59.082 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.084+0000 7fbe36e959c0 20 add_watcher() i=0 2024-09-12T00:39:59.082 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.084+0000 7fbe36e959c0 20 add_watcher() i=1 2024-09-12T00:39:59.082 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.084+0000 7fbe36e959c0 20 add_watcher() i=2 2024-09-12T00:39:59.083 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.084+0000 7fbe36e959c0 20 add_watcher() i=3 2024-09-12T00:39:59.083 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.084+0000 7fbe36e959c0 20 add_watcher() i=4 2024-09-12T00:39:59.083 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.084+0000 7fbe36e959c0 20 add_watcher() i=5 2024-09-12T00:39:59.083 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.084+0000 7fbe36e959c0 20 add_watcher() i=6 2024-09-12T00:39:59.084 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.084+0000 7fbe36e959c0 20 add_watcher() i=7 2024-09-12T00:39:59.084 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.084+0000 7fbe36e959c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:59.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.088+0000 7fbceafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:59.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.092+0000 7fbe36e959c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:59.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.092+0000 7fbe36e959c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:59.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.092+0000 7fbe36e959c0 5 note: GC not initialized 2024-09-12T00:39:59.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.092+0000 7fbce9fe3640 20 reqs_thread_entry: start 2024-09-12T00:39:59.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.092+0000 7fbe36e959c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:59.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.092+0000 7fbe36e959c0 20 Filter name: none 2024-09-12T00:39:59.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.092+0000 7fbc5b7fe640 20 reqs_thread_entry: start 2024-09-12T00:39:59.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.092+0000 7fbe36e959c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.092 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.092+0000 7fbe36e959c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:39:59.092 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.092+0000 7fbe36e959c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.094 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.096+0000 7fbe36e959c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:39:59.095 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.096+0000 7fbe36e959c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:59.095 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.096+0000 7fbe36e959c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.095 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.096+0000 7fbe36e959c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:39:59.095 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.096+0000 7fbe36e959c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.096 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.096+0000 7fbe36e959c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:39:59.096 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.096+0000 7fbe36e959c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:59.099 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.100+0000 7fbceafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:59.105 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.104+0000 7fbe36e959c0 20 remove_watcher() i=0 2024-09-12T00:39:59.105 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.104+0000 7fbe36e959c0 2 removed watcher, disabling cache 2024-09-12T00:39:59.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.108+0000 7fbe36e959c0 20 remove_watcher() i=1 2024-09-12T00:39:59.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.112+0000 7fbe36e959c0 20 remove_watcher() i=2 2024-09-12T00:39:59.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.112+0000 7fbe36e959c0 20 remove_watcher() i=3 2024-09-12T00:39:59.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.116+0000 7fbe36e959c0 20 remove_watcher() i=4 2024-09-12T00:39:59.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.116+0000 7fbe36e959c0 20 remove_watcher() i=5 2024-09-12T00:39:59.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.120+0000 7fbe36e959c0 20 remove_watcher() i=6 2024-09-12T00:39:59.118 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.120+0000 7fbe36e959c0 20 remove_watcher() i=7 2024-09-12T00:39:59.134 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.134 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:39:59.134 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: abort-at-logrecord-writes id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:39:59.134 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.135 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T00:39:59.172 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:59.172 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:59.215 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.216+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.217 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.216+0000 7f60de8c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.217 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.216+0000 7f60de8c09c0 20 realm 2024-09-12T00:39:59.217 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.216+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.218 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.220+0000 7f60de8c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.218 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.220+0000 7f60de8c09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:59.218 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.220+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.218 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.220+0000 7f60de8c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.218 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.220+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.219 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.220+0000 7f60de8c09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:59.219 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.220+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.220 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.220+0000 7f60de8c09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:59.220 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.220+0000 7f60de8c09c0 20 searching for the correct realm 2024-09-12T00:39:59.226 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.228+0000 7f60dcbc7640 0 -- 172.21.15.43:0/500109282 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f60d0019920 msgr2=0x7f60d0018400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:59.443 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.444+0000 7f60dc3c6640 0 -- 172.21.15.43:0/500109282 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x562d161ec390 msgr2=0x562d161ee7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:59.450 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:39:59.450 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:59.451 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:59.451 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:39:59.451 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:59.451 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:59.451 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.451 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.451 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.452 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:59.452 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:59.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.456+0000 7f60de8c09c0 20 zone default found 2024-09-12T00:39:59.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.456+0000 7f60de8c09c0 4 Realm: () 2024-09-12T00:39:59.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.456+0000 7f60de8c09c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:39:59.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.456+0000 7f60de8c09c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:39:59.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.456+0000 7f60de8c09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:59.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.456+0000 7f60de8c09c0 20 zonegroup default 2024-09-12T00:39:59.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.456+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.456+0000 7f60de8c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.456+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.455 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.456+0000 7f60de8c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.455 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.456+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.455 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.456+0000 7f60de8c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.456 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.456+0000 7f60de8c09c0 20 started sync module instance, tier type = 2024-09-12T00:39:59.456 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.456+0000 7f60de8c09c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:39:59.480 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.480+0000 7f60de8c09c0 20 add_watcher() i=0 2024-09-12T00:39:59.480 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.480+0000 7f60de8c09c0 20 add_watcher() i=1 2024-09-12T00:39:59.480 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.480+0000 7f60de8c09c0 20 add_watcher() i=2 2024-09-12T00:39:59.480 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.480+0000 7f60de8c09c0 20 add_watcher() i=3 2024-09-12T00:39:59.480 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.480+0000 7f60de8c09c0 20 add_watcher() i=4 2024-09-12T00:39:59.480 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.480+0000 7f60de8c09c0 20 add_watcher() i=5 2024-09-12T00:39:59.480 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.480+0000 7f60de8c09c0 20 add_watcher() i=6 2024-09-12T00:39:59.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.484+0000 7f60de8c09c0 20 add_watcher() i=7 2024-09-12T00:39:59.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.484+0000 7f60de8c09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:59.487 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.488+0000 7f5f92fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:59.488 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.488+0000 7f60de8c09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:59.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.488+0000 7f60de8c09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:59.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 note: GC not initialized 2024-09-12T00:39:59.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.492+0000 7f5f91fdb640 20 reqs_thread_entry: start 2024-09-12T00:39:59.490 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.492+0000 7f60de8c09c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:59.490 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.492+0000 7f60de8c09c0 20 Filter name: none 2024-09-12T00:39:59.490 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.492+0000 7f5f037fe640 20 reqs_thread_entry: start 2024-09-12T00:39:59.490 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.492+0000 7f60de8c09c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:39:59.490 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.492+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.491 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.492+0000 7f60de8c09c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:39:59.491 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.492+0000 7f60de8c09c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:39:59.491 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.492+0000 7f60de8c09c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:39:59.491 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.492+0000 7f60de8c09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 : miss 2024-09-12T00:39:59.491 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.492+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.493 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.492+0000 7f60de8c09c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:39:59.493 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.492+0000 7f60de8c09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 info.flags=0x17 2024-09-12T00:39:59.493 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.492+0000 7f60de8c09c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 to cache LRU end 2024-09-12T00:39:59.493 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.492+0000 7f60de8c09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:59.493 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.492+0000 7f60de8c09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:59.493 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.492+0000 7f60de8c09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 2024-09-12T00:39:59.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.504+0000 7f60de8c09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 info.flags=0x17 2024-09-12T00:39:59.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.504+0000 7f60de8c09c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 to cache LRU end 2024-09-12T00:39:59.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.504+0000 7f60de8c09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:59.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.504+0000 7f60de8c09c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36, ofs0, ns] 2024-09-12T00:39:59.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.504+0000 7f5fb37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333492 cookie 94751644689904 notifier 7650 bl.length()=923 2024-09-12T00:39:59.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.504+0000 7f5fb37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 info.flags=0x17 2024-09-12T00:39:59.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.504+0000 7f5fb37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 to cache LRU end 2024-09-12T00:39:59.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.504+0000 7f5fb37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:59.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.504+0000 7f60de8c09c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36]): orig_sources= new_sources= 2024-09-12T00:39:59.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.504+0000 7f60de8c09c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36]): potential sources added=[] removed=[] 2024-09-12T00:39:59.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.504+0000 7f60de8c09c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36]): orig_dests= new_dests= 2024-09-12T00:39:59.505 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.504+0000 7f60de8c09c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36]): potential dests added=[] removed=[] 2024-09-12T00:39:59.508 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f60de8c09c0 time 2024-09-12T00:39:59.512442+0000 2024-09-12T00:39:59.509 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:39:59.510 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:59.510 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f60e219a2eb] 2024-09-12T00:39:59.510 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f60e219a49f] 2024-09-12T00:39:59.510 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562d13440cc1] 2024-09-12T00:39:59.510 INFO:tasks.workunit.client.0.smithi043.stderr: 4: radosgw-admin(+0x1422aac) [0x562d13e9eaac] 2024-09-12T00:39:59.510 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562d13455ced] 2024-09-12T00:39:59.510 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:39:59.510 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f60e1000d90] 2024-09-12T00:39:59.511 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:39:59.511 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:39:59.511 INFO:tasks.workunit.client.0.smithi043.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:39:59.511 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7f60de8c09c0 thread_name:radosgw-admin 2024-09-12T00:39:59.511 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.512+0000 7f60de8c09c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f60de8c09c0 time 2024-09-12T00:39:59.512442+0000 2024-09-12T00:39:59.511 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:39:59.511 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.511 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:59.511 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f60e219a2eb] 2024-09-12T00:39:59.511 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f60e219a49f] 2024-09-12T00:39:59.511 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562d13440cc1] 2024-09-12T00:39:59.511 INFO:tasks.workunit.client.0.smithi043.stderr: 4: radosgw-admin(+0x1422aac) [0x562d13e9eaac] 2024-09-12T00:39:59.512 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562d13455ced] 2024-09-12T00:39:59.512 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:39:59.512 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f60e1000d90] 2024-09-12T00:39:59.512 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:39:59.512 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:39:59.512 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.529 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:59.529 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f60e1019520] 2024-09-12T00:39:59.529 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:39:59.529 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:39:59.529 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:39:59.529 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f60e219a345] 2024-09-12T00:39:59.529 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f60e219a49f] 2024-09-12T00:39:59.529 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562d13440cc1] 2024-09-12T00:39:59.530 INFO:tasks.workunit.client.0.smithi043.stderr: 8: radosgw-admin(+0x1422aac) [0x562d13e9eaac] 2024-09-12T00:39:59.530 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562d13455ced] 2024-09-12T00:39:59.530 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:39:59.530 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f60e1000d90] 2024-09-12T00:39:59.530 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:39:59.530 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:39:59.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.512+0000 7f60de8c09c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:39:59.530 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7f60de8c09c0 thread_name:radosgw-admin 2024-09-12T00:39:59.530 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.530 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:59.530 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f60e1019520] 2024-09-12T00:39:59.530 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:39:59.530 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:39:59.531 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:39:59.531 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f60e219a345] 2024-09-12T00:39:59.531 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f60e219a49f] 2024-09-12T00:39:59.531 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562d13440cc1] 2024-09-12T00:39:59.531 INFO:tasks.workunit.client.0.smithi043.stderr: 8: radosgw-admin(+0x1422aac) [0x562d13e9eaac] 2024-09-12T00:39:59.531 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562d13455ced] 2024-09-12T00:39:59.531 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:39:59.531 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f60e1000d90] 2024-09-12T00:39:59.531 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:39:59.531 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:39:59.531 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:39:59.531 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.532 INFO:tasks.workunit.client.0.smithi043.stderr:--- begin dump of recent events --- 2024-09-12T00:39:59.532 INFO:tasks.workunit.client.0.smithi043.stderr: -499> 2024-09-12T00:39:59.196+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:59.532 INFO:tasks.workunit.client.0.smithi043.stderr: -498> 2024-09-12T00:39:59.196+0000 7f60dbbc5640 10 monclient(hunting): handle_auth_done global_id 7301 payload 274 2024-09-12T00:39:59.532 INFO:tasks.workunit.client.0.smithi043.stderr: -497> 2024-09-12T00:39:59.196+0000 7f60dbbc5640 10 monclient: _finish_hunting 0 2024-09-12T00:39:59.532 INFO:tasks.workunit.client.0.smithi043.stderr: -496> 2024-09-12T00:39:59.196+0000 7f60dbbc5640 1 monclient: found mon.noname-c 2024-09-12T00:39:59.532 INFO:tasks.workunit.client.0.smithi043.stderr: -495> 2024-09-12T00:39:59.196+0000 7f60dbbc5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:39:59.532 INFO:tasks.workunit.client.0.smithi043.stderr: -494> 2024-09-12T00:39:59.196+0000 7f5fca60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:59.532 INFO:tasks.workunit.client.0.smithi043.stderr: -493> 2024-09-12T00:39:59.196+0000 7f5fca60c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:39:59.532 INFO:tasks.workunit.client.0.smithi043.stderr: -492> 2024-09-12T00:39:59.196+0000 7f5fca60c640 10 monclient: dump: 2024-09-12T00:39:59.532 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:59.533 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:59.533 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.533 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.533 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:59.533 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:59.533 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:59.533 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:59.533 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:59.533 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.533 INFO:tasks.workunit.client.0.smithi043.stderr: -491> 2024-09-12T00:39:59.196+0000 7f5fca60c640 10 monclient: _finish_auth 0 2024-09-12T00:39:59.533 INFO:tasks.workunit.client.0.smithi043.stderr: -490> 2024-09-12T00:39:59.196+0000 7f5fca60c640 10 monclient: _check_auth_tickets 2024-09-12T00:39:59.533 INFO:tasks.workunit.client.0.smithi043.stderr: -489> 2024-09-12T00:39:59.196+0000 7f5fca60c640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:59.534 INFO:tasks.workunit.client.0.smithi043.stderr: -488> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 monclient: authenticate success, global_id 7301 2024-09-12T00:39:59.534 INFO:tasks.workunit.client.0.smithi043.stderr: -487> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 10 monclient: get_monmap_and_config success 2024-09-12T00:39:59.534 INFO:tasks.workunit.client.0.smithi043.stderr: -486> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 4 set_mon_vals no callback set 2024-09-12T00:39:59.534 INFO:tasks.workunit.client.0.smithi043.stderr: -485> 2024-09-12T00:39:59.196+0000 7f5fca60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:59.534 INFO:tasks.workunit.client.0.smithi043.stderr: -484> 2024-09-12T00:39:59.196+0000 7f5fca60c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:39:59.534 INFO:tasks.workunit.client.0.smithi043.stderr: -483> 2024-09-12T00:39:59.196+0000 7f5fca60c640 10 monclient: dump: 2024-09-12T00:39:59.534 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:59.534 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:59.534 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.534 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.534 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:59.534 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:59.534 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:59.535 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:59.535 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:59.535 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.535 INFO:tasks.workunit.client.0.smithi043.stderr: -482> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 10 monclient: shutdown 2024-09-12T00:39:59.535 INFO:tasks.workunit.client.0.smithi043.stderr: -481> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) unregister_commands rotate-key 2024-09-12T00:39:59.535 INFO:tasks.workunit.client.0.smithi043.stderr: -480> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 10 monclient: build_initial_monmap 2024-09-12T00:39:59.535 INFO:tasks.workunit.client.0.smithi043.stderr: -479> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:59.535 INFO:tasks.workunit.client.0.smithi043.stderr: -478> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 10 monclient: monmap: 2024-09-12T00:39:59.535 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:39:59.535 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:59.535 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:39:59.535 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:39:59.535 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:59.536 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:59.536 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:39:59.536 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:39:59.536 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:39:59.536 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.536 INFO:tasks.workunit.client.0.smithi043.stderr: -477> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d161044e0) adding auth protocol: cephx 2024-09-12T00:39:59.536 INFO:tasks.workunit.client.0.smithi043.stderr: -476> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d161044e0) adding auth protocol: cephx 2024-09-12T00:39:59.536 INFO:tasks.workunit.client.0.smithi043.stderr: -475> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d161044e0) adding auth protocol: cephx 2024-09-12T00:39:59.536 INFO:tasks.workunit.client.0.smithi043.stderr: -474> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d161044e0) adding con mode: secure 2024-09-12T00:39:59.536 INFO:tasks.workunit.client.0.smithi043.stderr: -473> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d161044e0) adding con mode: crc 2024-09-12T00:39:59.536 INFO:tasks.workunit.client.0.smithi043.stderr: -472> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d161044e0) adding con mode: secure 2024-09-12T00:39:59.536 INFO:tasks.workunit.client.0.smithi043.stderr: -471> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d161044e0) adding con mode: crc 2024-09-12T00:39:59.536 INFO:tasks.workunit.client.0.smithi043.stderr: -470> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d161044e0) adding con mode: secure 2024-09-12T00:39:59.537 INFO:tasks.workunit.client.0.smithi043.stderr: -469> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d161044e0) adding con mode: crc 2024-09-12T00:39:59.537 INFO:tasks.workunit.client.0.smithi043.stderr: -468> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d161044e0) adding con mode: crc 2024-09-12T00:39:59.537 INFO:tasks.workunit.client.0.smithi043.stderr: -467> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d161044e0) adding con mode: secure 2024-09-12T00:39:59.537 INFO:tasks.workunit.client.0.smithi043.stderr: -466> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d161044e0) adding con mode: crc 2024-09-12T00:39:59.537 INFO:tasks.workunit.client.0.smithi043.stderr: -465> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d161044e0) adding con mode: secure 2024-09-12T00:39:59.537 INFO:tasks.workunit.client.0.smithi043.stderr: -464> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d161044e0) adding con mode: crc 2024-09-12T00:39:59.537 INFO:tasks.workunit.client.0.smithi043.stderr: -463> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d161044e0) adding con mode: secure 2024-09-12T00:39:59.537 INFO:tasks.workunit.client.0.smithi043.stderr: -462> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:59.537 INFO:tasks.workunit.client.0.smithi043.stderr: -461> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 1 librados: starting msgr at 2024-09-12T00:39:59.537 INFO:tasks.workunit.client.0.smithi043.stderr: -460> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 1 librados: starting objecter 2024-09-12T00:39:59.537 INFO:tasks.workunit.client.0.smithi043.stderr: -459> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command objecter_requests hook 0x562d15f1db30 2024-09-12T00:39:59.537 INFO:tasks.workunit.client.0.smithi043.stderr: -458> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 1 librados: setting wanted keys 2024-09-12T00:39:59.537 INFO:tasks.workunit.client.0.smithi043.stderr: -457> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 1 librados: calling monclient init 2024-09-12T00:39:59.538 INFO:tasks.workunit.client.0.smithi043.stderr: -456> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 10 monclient: init 2024-09-12T00:39:59.538 INFO:tasks.workunit.client.0.smithi043.stderr: -455> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d160ff190) adding auth protocol: cephx 2024-09-12T00:39:59.538 INFO:tasks.workunit.client.0.smithi043.stderr: -454> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d160ff190) adding auth protocol: cephx 2024-09-12T00:39:59.538 INFO:tasks.workunit.client.0.smithi043.stderr: -453> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d160ff190) adding auth protocol: cephx 2024-09-12T00:39:59.538 INFO:tasks.workunit.client.0.smithi043.stderr: -452> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d160ff190) adding con mode: secure 2024-09-12T00:39:59.538 INFO:tasks.workunit.client.0.smithi043.stderr: -451> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d160ff190) adding con mode: crc 2024-09-12T00:39:59.538 INFO:tasks.workunit.client.0.smithi043.stderr: -450> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d160ff190) adding con mode: secure 2024-09-12T00:39:59.538 INFO:tasks.workunit.client.0.smithi043.stderr: -449> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d160ff190) adding con mode: crc 2024-09-12T00:39:59.538 INFO:tasks.workunit.client.0.smithi043.stderr: -448> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d160ff190) adding con mode: secure 2024-09-12T00:39:59.538 INFO:tasks.workunit.client.0.smithi043.stderr: -447> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d160ff190) adding con mode: crc 2024-09-12T00:39:59.538 INFO:tasks.workunit.client.0.smithi043.stderr: -446> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d160ff190) adding con mode: crc 2024-09-12T00:39:59.538 INFO:tasks.workunit.client.0.smithi043.stderr: -445> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d160ff190) adding con mode: secure 2024-09-12T00:39:59.539 INFO:tasks.workunit.client.0.smithi043.stderr: -444> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d160ff190) adding con mode: crc 2024-09-12T00:39:59.539 INFO:tasks.workunit.client.0.smithi043.stderr: -443> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d160ff190) adding con mode: secure 2024-09-12T00:39:59.539 INFO:tasks.workunit.client.0.smithi043.stderr: -442> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d160ff190) adding con mode: crc 2024-09-12T00:39:59.539 INFO:tasks.workunit.client.0.smithi043.stderr: -441> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d160ff190) adding con mode: secure 2024-09-12T00:39:59.539 INFO:tasks.workunit.client.0.smithi043.stderr: -440> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:59.539 INFO:tasks.workunit.client.0.smithi043.stderr: -439> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:59.539 INFO:tasks.workunit.client.0.smithi043.stderr: -438> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command rotate-key hook 0x562d160ff2d8 2024-09-12T00:39:59.539 INFO:tasks.workunit.client.0.smithi043.stderr: -437> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:59.539 INFO:tasks.workunit.client.0.smithi043.stderr: -436> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:39:59.539 INFO:tasks.workunit.client.0.smithi043.stderr: -435> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 10 monclient(hunting): picked mon.noname-c con 0x562d15f8e050 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:39:59.539 INFO:tasks.workunit.client.0.smithi043.stderr: -434> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 10 monclient(hunting): picked mon.noname-b con 0x562d15fb7460 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:39:59.539 INFO:tasks.workunit.client.0.smithi043.stderr: -433> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 10 monclient(hunting): picked mon.noname-a con 0x562d16105680 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:39:59.539 INFO:tasks.workunit.client.0.smithi043.stderr: -432> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:59.540 INFO:tasks.workunit.client.0.smithi043.stderr: -431> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:59.540 INFO:tasks.workunit.client.0.smithi043.stderr: -430> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:59.540 INFO:tasks.workunit.client.0.smithi043.stderr: -429> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:59.540 INFO:tasks.workunit.client.0.smithi043.stderr: -428> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 10 monclient(hunting): authenticate will time out at 2295.187104s 2024-09-12T00:39:59.540 INFO:tasks.workunit.client.0.smithi043.stderr: -427> 2024-09-12T00:39:59.196+0000 7f60dc3c6640 10 monclient(hunting): get_auth_request con 0x562d15f8e050 auth_method 0 2024-09-12T00:39:59.540 INFO:tasks.workunit.client.0.smithi043.stderr: -426> 2024-09-12T00:39:59.196+0000 7f60dc3c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:59.540 INFO:tasks.workunit.client.0.smithi043.stderr: -425> 2024-09-12T00:39:59.196+0000 7f60dc3c6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:59.540 INFO:tasks.workunit.client.0.smithi043.stderr: -424> 2024-09-12T00:39:59.196+0000 7f60dc3c6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:59.540 INFO:tasks.workunit.client.0.smithi043.stderr: -423> 2024-09-12T00:39:59.196+0000 7f60dcbc7640 10 monclient(hunting): get_auth_request con 0x562d16105680 auth_method 0 2024-09-12T00:39:59.540 INFO:tasks.workunit.client.0.smithi043.stderr: -422> 2024-09-12T00:39:59.196+0000 7f60dcbc7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:59.540 INFO:tasks.workunit.client.0.smithi043.stderr: -421> 2024-09-12T00:39:59.196+0000 7f60dcbc7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:59.540 INFO:tasks.workunit.client.0.smithi043.stderr: -420> 2024-09-12T00:39:59.196+0000 7f60dcbc7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:59.540 INFO:tasks.workunit.client.0.smithi043.stderr: -419> 2024-09-12T00:39:59.196+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:59.541 INFO:tasks.workunit.client.0.smithi043.stderr: -418> 2024-09-12T00:39:59.196+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:59.541 INFO:tasks.workunit.client.0.smithi043.stderr: -417> 2024-09-12T00:39:59.196+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:59.541 INFO:tasks.workunit.client.0.smithi043.stderr: -416> 2024-09-12T00:39:59.196+0000 7f60dcbc7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:59.541 INFO:tasks.workunit.client.0.smithi043.stderr: -415> 2024-09-12T00:39:59.196+0000 7f60dcbc7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:59.541 INFO:tasks.workunit.client.0.smithi043.stderr: -414> 2024-09-12T00:39:59.196+0000 7f60dcbc7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:59.541 INFO:tasks.workunit.client.0.smithi043.stderr: -413> 2024-09-12T00:39:59.196+0000 7f60dbbc5640 10 monclient(hunting): get_auth_request con 0x562d15fb7460 auth_method 0 2024-09-12T00:39:59.541 INFO:tasks.workunit.client.0.smithi043.stderr: -412> 2024-09-12T00:39:59.196+0000 7f60dbbc5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:59.541 INFO:tasks.workunit.client.0.smithi043.stderr: -411> 2024-09-12T00:39:59.196+0000 7f60dbbc5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:59.541 INFO:tasks.workunit.client.0.smithi043.stderr: -410> 2024-09-12T00:39:59.196+0000 7f60dbbc5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:59.541 INFO:tasks.workunit.client.0.smithi043.stderr: -409> 2024-09-12T00:39:59.196+0000 7f60dcbc7640 10 monclient(hunting): handle_auth_done global_id 7641 payload 824 2024-09-12T00:39:59.541 INFO:tasks.workunit.client.0.smithi043.stderr: -408> 2024-09-12T00:39:59.196+0000 7f60dcbc7640 10 monclient: _finish_hunting 0 2024-09-12T00:39:59.541 INFO:tasks.workunit.client.0.smithi043.stderr: -407> 2024-09-12T00:39:59.196+0000 7f60dcbc7640 1 monclient: found mon.noname-a 2024-09-12T00:39:59.541 INFO:tasks.workunit.client.0.smithi043.stderr: -406> 2024-09-12T00:39:59.196+0000 7f60dcbc7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:39:59.542 INFO:tasks.workunit.client.0.smithi043.stderr: -405> 2024-09-12T00:39:59.196+0000 7f5fc8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:59.542 INFO:tasks.workunit.client.0.smithi043.stderr: -404> 2024-09-12T00:39:59.196+0000 7f5fc8e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:39:59.542 INFO:tasks.workunit.client.0.smithi043.stderr: -403> 2024-09-12T00:39:59.196+0000 7f5fc8e09640 10 monclient: dump: 2024-09-12T00:39:59.542 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:59.542 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:59.542 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.542 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.542 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:59.542 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:59.542 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:59.542 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:59.542 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:59.542 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.543 INFO:tasks.workunit.client.0.smithi043.stderr: -402> 2024-09-12T00:39:59.196+0000 7f5fc8e09640 10 monclient: _finish_auth 0 2024-09-12T00:39:59.543 INFO:tasks.workunit.client.0.smithi043.stderr: -401> 2024-09-12T00:39:59.196+0000 7f5fc8e09640 10 monclient: _check_auth_tickets 2024-09-12T00:39:59.543 INFO:tasks.workunit.client.0.smithi043.stderr: -400> 2024-09-12T00:39:59.196+0000 7f5fc8e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:59.543 INFO:tasks.workunit.client.0.smithi043.stderr: -399> 2024-09-12T00:39:59.196+0000 7f5fc8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:59.543 INFO:tasks.workunit.client.0.smithi043.stderr: -398> 2024-09-12T00:39:59.196+0000 7f5fc8e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:59.543 INFO:tasks.workunit.client.0.smithi043.stderr: -397> 2024-09-12T00:39:59.196+0000 7f5fc8e09640 10 monclient: dump: 2024-09-12T00:39:59.543 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:59.543 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:59.543 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.543 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.543 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:59.543 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:59.543 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:59.544 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:59.544 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:59.544 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.544 INFO:tasks.workunit.client.0.smithi043.stderr: -396> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 monclient: authenticate success, global_id 7641 2024-09-12T00:39:59.544 INFO:tasks.workunit.client.0.smithi043.stderr: -395> 2024-09-12T00:39:59.200+0000 7f60de8c09c0 10 monclient: _renew_subs 2024-09-12T00:39:59.544 INFO:tasks.workunit.client.0.smithi043.stderr: -394> 2024-09-12T00:39:59.200+0000 7f60de8c09c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:39:59.544 INFO:tasks.workunit.client.0.smithi043.stderr: -393> 2024-09-12T00:39:59.196+0000 7f5fca60c640 4 set_mon_vals no callback set 2024-09-12T00:39:59.544 INFO:tasks.workunit.client.0.smithi043.stderr: -392> 2024-09-12T00:39:59.200+0000 7f60de8c09c0 10 monclient: _renew_subs 2024-09-12T00:39:59.544 INFO:tasks.workunit.client.0.smithi043.stderr: -391> 2024-09-12T00:39:59.200+0000 7f60de8c09c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:39:59.544 INFO:tasks.workunit.client.0.smithi043.stderr: -390> 2024-09-12T00:39:59.200+0000 7f60de8c09c0 1 librados: init done 2024-09-12T00:39:59.544 INFO:tasks.workunit.client.0.smithi043.stderr: -389> 2024-09-12T00:39:59.200+0000 7f5fc8e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:59.544 INFO:tasks.workunit.client.0.smithi043.stderr: -388> 2024-09-12T00:39:59.200+0000 7f5fc8e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:39:59.544 INFO:tasks.workunit.client.0.smithi043.stderr: -387> 2024-09-12T00:39:59.200+0000 7f5fc8e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:39:59.545 INFO:tasks.workunit.client.0.smithi043.stderr: -386> 2024-09-12T00:39:59.200+0000 7f60dc3c6640 10 monclient: get_auth_request con 0x7f5fc4070ae0 auth_method 0 2024-09-12T00:39:59.545 INFO:tasks.workunit.client.0.smithi043.stderr: -385> 2024-09-12T00:39:59.200+0000 7f60dbbc5640 10 monclient: get_auth_request con 0x562d16128170 auth_method 0 2024-09-12T00:39:59.545 INFO:tasks.workunit.client.0.smithi043.stderr: -384> 2024-09-12T00:39:59.200+0000 7f60dc3c6640 10 monclient: get_auth_request con 0x562d1614a080 auth_method 0 2024-09-12T00:39:59.545 INFO:tasks.workunit.client.0.smithi043.stderr: -383> 2024-09-12T00:39:59.204+0000 7f60dbbc5640 10 monclient: get_auth_request con 0x562d1614e270 auth_method 0 2024-09-12T00:39:59.545 INFO:tasks.workunit.client.0.smithi043.stderr: -382> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 10 monclient: build_initial_monmap 2024-09-12T00:39:59.545 INFO:tasks.workunit.client.0.smithi043.stderr: -381> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:59.545 INFO:tasks.workunit.client.0.smithi043.stderr: -380> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 10 monclient: monmap: 2024-09-12T00:39:59.545 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:39:59.545 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:59.545 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:39:59.545 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:39:59.545 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:59.545 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:59.546 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:39:59.546 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:39:59.546 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:39:59.546 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.546 INFO:tasks.workunit.client.0.smithi043.stderr: -379> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 AuthRegistry(0x562d16152fc0) adding auth protocol: cephx 2024-09-12T00:39:59.546 INFO:tasks.workunit.client.0.smithi043.stderr: -378> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 AuthRegistry(0x562d16152fc0) adding auth protocol: cephx 2024-09-12T00:39:59.546 INFO:tasks.workunit.client.0.smithi043.stderr: -377> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 AuthRegistry(0x562d16152fc0) adding auth protocol: cephx 2024-09-12T00:39:59.546 INFO:tasks.workunit.client.0.smithi043.stderr: -376> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 AuthRegistry(0x562d16152fc0) adding con mode: secure 2024-09-12T00:39:59.546 INFO:tasks.workunit.client.0.smithi043.stderr: -375> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 AuthRegistry(0x562d16152fc0) adding con mode: crc 2024-09-12T00:39:59.546 INFO:tasks.workunit.client.0.smithi043.stderr: -374> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 AuthRegistry(0x562d16152fc0) adding con mode: secure 2024-09-12T00:39:59.546 INFO:tasks.workunit.client.0.smithi043.stderr: -373> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 AuthRegistry(0x562d16152fc0) adding con mode: crc 2024-09-12T00:39:59.546 INFO:tasks.workunit.client.0.smithi043.stderr: -372> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 AuthRegistry(0x562d16152fc0) adding con mode: secure 2024-09-12T00:39:59.546 INFO:tasks.workunit.client.0.smithi043.stderr: -371> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 AuthRegistry(0x562d16152fc0) adding con mode: crc 2024-09-12T00:39:59.547 INFO:tasks.workunit.client.0.smithi043.stderr: -370> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 AuthRegistry(0x562d16152fc0) adding con mode: crc 2024-09-12T00:39:59.547 INFO:tasks.workunit.client.0.smithi043.stderr: -369> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 AuthRegistry(0x562d16152fc0) adding con mode: secure 2024-09-12T00:39:59.547 INFO:tasks.workunit.client.0.smithi043.stderr: -368> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 AuthRegistry(0x562d16152fc0) adding con mode: crc 2024-09-12T00:39:59.547 INFO:tasks.workunit.client.0.smithi043.stderr: -367> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 AuthRegistry(0x562d16152fc0) adding con mode: secure 2024-09-12T00:39:59.547 INFO:tasks.workunit.client.0.smithi043.stderr: -366> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 AuthRegistry(0x562d16152fc0) adding con mode: crc 2024-09-12T00:39:59.547 INFO:tasks.workunit.client.0.smithi043.stderr: -365> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 AuthRegistry(0x562d16152fc0) adding con mode: secure 2024-09-12T00:39:59.547 INFO:tasks.workunit.client.0.smithi043.stderr: -364> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:59.547 INFO:tasks.workunit.client.0.smithi043.stderr: -363> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command objecter_requests cmddesc objecter_requests hook 0x562d16156970 EEXIST 2024-09-12T00:39:59.547 INFO:tasks.workunit.client.0.smithi043.stderr: -362> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 10 monclient: init 2024-09-12T00:39:59.548 INFO:tasks.workunit.client.0.smithi043.stderr: -361> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 AuthRegistry(0x562d16151698) adding auth protocol: cephx 2024-09-12T00:39:59.548 INFO:tasks.workunit.client.0.smithi043.stderr: -360> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 AuthRegistry(0x562d16151698) adding auth protocol: cephx 2024-09-12T00:39:59.548 INFO:tasks.workunit.client.0.smithi043.stderr: -359> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 AuthRegistry(0x562d16151698) adding auth protocol: cephx 2024-09-12T00:39:59.548 INFO:tasks.workunit.client.0.smithi043.stderr: -358> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 AuthRegistry(0x562d16151698) adding con mode: secure 2024-09-12T00:39:59.548 INFO:tasks.workunit.client.0.smithi043.stderr: -357> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 AuthRegistry(0x562d16151698) adding con mode: crc 2024-09-12T00:39:59.548 INFO:tasks.workunit.client.0.smithi043.stderr: -356> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 AuthRegistry(0x562d16151698) adding con mode: secure 2024-09-12T00:39:59.548 INFO:tasks.workunit.client.0.smithi043.stderr: -355> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 AuthRegistry(0x562d16151698) adding con mode: crc 2024-09-12T00:39:59.548 INFO:tasks.workunit.client.0.smithi043.stderr: -354> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 AuthRegistry(0x562d16151698) adding con mode: secure 2024-09-12T00:39:59.548 INFO:tasks.workunit.client.0.smithi043.stderr: -353> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 AuthRegistry(0x562d16151698) adding con mode: crc 2024-09-12T00:39:59.548 INFO:tasks.workunit.client.0.smithi043.stderr: -352> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 AuthRegistry(0x562d16151698) adding con mode: crc 2024-09-12T00:39:59.548 INFO:tasks.workunit.client.0.smithi043.stderr: -351> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 AuthRegistry(0x562d16151698) adding con mode: secure 2024-09-12T00:39:59.549 INFO:tasks.workunit.client.0.smithi043.stderr: -350> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 AuthRegistry(0x562d16151698) adding con mode: crc 2024-09-12T00:39:59.549 INFO:tasks.workunit.client.0.smithi043.stderr: -349> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 AuthRegistry(0x562d16151698) adding con mode: secure 2024-09-12T00:39:59.549 INFO:tasks.workunit.client.0.smithi043.stderr: -348> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 AuthRegistry(0x562d16151698) adding con mode: crc 2024-09-12T00:39:59.549 INFO:tasks.workunit.client.0.smithi043.stderr: -347> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 AuthRegistry(0x562d16151698) adding con mode: secure 2024-09-12T00:39:59.549 INFO:tasks.workunit.client.0.smithi043.stderr: -346> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:59.549 INFO:tasks.workunit.client.0.smithi043.stderr: -345> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:59.549 INFO:tasks.workunit.client.0.smithi043.stderr: -344> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command rotate-key cmddesc rotate-key hook 0x562d161517e0 EEXIST 2024-09-12T00:39:59.549 INFO:tasks.workunit.client.0.smithi043.stderr: -343> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:59.549 INFO:tasks.workunit.client.0.smithi043.stderr: -342> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:39:59.549 INFO:tasks.workunit.client.0.smithi043.stderr: -341> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 10 monclient(hunting): picked mon.noname-a con 0x562d1617ab20 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:39:59.549 INFO:tasks.workunit.client.0.smithi043.stderr: -340> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 10 monclient(hunting): picked mon.noname-c con 0x562d1617a450 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:39:59.549 INFO:tasks.workunit.client.0.smithi043.stderr: -339> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 10 monclient(hunting): picked mon.noname-b con 0x562d16178e30 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:39:59.549 INFO:tasks.workunit.client.0.smithi043.stderr: -338> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:59.550 INFO:tasks.workunit.client.0.smithi043.stderr: -337> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:59.550 INFO:tasks.workunit.client.0.smithi043.stderr: -336> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:59.550 INFO:tasks.workunit.client.0.smithi043.stderr: -335> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:59.550 INFO:tasks.workunit.client.0.smithi043.stderr: -334> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 10 monclient(hunting): authenticate will time out at 2295.196678s 2024-09-12T00:39:59.550 INFO:tasks.workunit.client.0.smithi043.stderr: -333> 2024-09-12T00:39:59.208+0000 7f60dc3c6640 10 monclient(hunting): get_auth_request con 0x562d1617ab20 auth_method 0 2024-09-12T00:39:59.550 INFO:tasks.workunit.client.0.smithi043.stderr: -332> 2024-09-12T00:39:59.208+0000 7f60dc3c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:59.550 INFO:tasks.workunit.client.0.smithi043.stderr: -331> 2024-09-12T00:39:59.208+0000 7f60dc3c6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:59.550 INFO:tasks.workunit.client.0.smithi043.stderr: -330> 2024-09-12T00:39:59.208+0000 7f60dc3c6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:59.550 INFO:tasks.workunit.client.0.smithi043.stderr: -329> 2024-09-12T00:39:59.208+0000 7f60dbbc5640 10 monclient(hunting): get_auth_request con 0x562d1617a450 auth_method 0 2024-09-12T00:39:59.550 INFO:tasks.workunit.client.0.smithi043.stderr: -328> 2024-09-12T00:39:59.208+0000 7f60dbbc5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:59.550 INFO:tasks.workunit.client.0.smithi043.stderr: -327> 2024-09-12T00:39:59.208+0000 7f60dbbc5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:59.550 INFO:tasks.workunit.client.0.smithi043.stderr: -326> 2024-09-12T00:39:59.208+0000 7f60dbbc5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:59.550 INFO:tasks.workunit.client.0.smithi043.stderr: -325> 2024-09-12T00:39:59.208+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:59.551 INFO:tasks.workunit.client.0.smithi043.stderr: -324> 2024-09-12T00:39:59.208+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:59.551 INFO:tasks.workunit.client.0.smithi043.stderr: -323> 2024-09-12T00:39:59.208+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:59.551 INFO:tasks.workunit.client.0.smithi043.stderr: -322> 2024-09-12T00:39:59.208+0000 7f60dbbc5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:59.551 INFO:tasks.workunit.client.0.smithi043.stderr: -321> 2024-09-12T00:39:59.208+0000 7f60dbbc5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:59.551 INFO:tasks.workunit.client.0.smithi043.stderr: -320> 2024-09-12T00:39:59.208+0000 7f60dbbc5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:59.551 INFO:tasks.workunit.client.0.smithi043.stderr: -319> 2024-09-12T00:39:59.208+0000 7f60dcbc7640 10 monclient(hunting): get_auth_request con 0x562d16178e30 auth_method 0 2024-09-12T00:39:59.551 INFO:tasks.workunit.client.0.smithi043.stderr: -318> 2024-09-12T00:39:59.208+0000 7f60dcbc7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:59.551 INFO:tasks.workunit.client.0.smithi043.stderr: -317> 2024-09-12T00:39:59.208+0000 7f60dcbc7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:59.551 INFO:tasks.workunit.client.0.smithi043.stderr: -316> 2024-09-12T00:39:59.208+0000 7f60dcbc7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:59.551 INFO:tasks.workunit.client.0.smithi043.stderr: -315> 2024-09-12T00:39:59.208+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_done global_id 7644 payload 824 2024-09-12T00:39:59.551 INFO:tasks.workunit.client.0.smithi043.stderr: -314> 2024-09-12T00:39:59.208+0000 7f60dc3c6640 10 monclient: _finish_hunting 0 2024-09-12T00:39:59.551 INFO:tasks.workunit.client.0.smithi043.stderr: -313> 2024-09-12T00:39:59.208+0000 7f60dc3c6640 1 monclient: found mon.noname-a 2024-09-12T00:39:59.551 INFO:tasks.workunit.client.0.smithi043.stderr: -312> 2024-09-12T00:39:59.208+0000 7f60dc3c6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:39:59.552 INFO:tasks.workunit.client.0.smithi043.stderr: -311> 2024-09-12T00:39:59.208+0000 7f5fc1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:59.552 INFO:tasks.workunit.client.0.smithi043.stderr: -310> 2024-09-12T00:39:59.208+0000 7f5fc1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:39:59.552 INFO:tasks.workunit.client.0.smithi043.stderr: -309> 2024-09-12T00:39:59.208+0000 7f5fc1ffb640 10 monclient: dump: 2024-09-12T00:39:59.552 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:59.552 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:59.552 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.552 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.552 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:59.552 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:59.552 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:59.552 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:59.552 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:59.552 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.553 INFO:tasks.workunit.client.0.smithi043.stderr: -308> 2024-09-12T00:39:59.208+0000 7f5fc1ffb640 10 monclient: _finish_auth 0 2024-09-12T00:39:59.553 INFO:tasks.workunit.client.0.smithi043.stderr: -307> 2024-09-12T00:39:59.208+0000 7f5fc1ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:39:59.553 INFO:tasks.workunit.client.0.smithi043.stderr: -306> 2024-09-12T00:39:59.208+0000 7f5fc1ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:59.553 INFO:tasks.workunit.client.0.smithi043.stderr: -305> 2024-09-12T00:39:59.208+0000 7f5fc1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:59.553 INFO:tasks.workunit.client.0.smithi043.stderr: -304> 2024-09-12T00:39:59.208+0000 7f5fc1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:59.553 INFO:tasks.workunit.client.0.smithi043.stderr: -303> 2024-09-12T00:39:59.208+0000 7f5fc1ffb640 10 monclient: dump: 2024-09-12T00:39:59.553 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:59.553 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:59.553 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.553 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.553 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:59.553 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:59.554 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:59.554 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:59.554 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:59.554 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.554 INFO:tasks.workunit.client.0.smithi043.stderr: -302> 2024-09-12T00:39:59.208+0000 7f60dd3c8640 4 set_mon_vals no callback set 2024-09-12T00:39:59.554 INFO:tasks.workunit.client.0.smithi043.stderr: -301> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 monclient: authenticate success, global_id 7644 2024-09-12T00:39:59.554 INFO:tasks.workunit.client.0.smithi043.stderr: -300> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 10 monclient: _renew_subs 2024-09-12T00:39:59.554 INFO:tasks.workunit.client.0.smithi043.stderr: -299> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:39:59.554 INFO:tasks.workunit.client.0.smithi043.stderr: -298> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 10 monclient: _renew_subs 2024-09-12T00:39:59.554 INFO:tasks.workunit.client.0.smithi043.stderr: -297> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:39:59.554 INFO:tasks.workunit.client.0.smithi043.stderr: -296> 2024-09-12T00:39:59.212+0000 7f5fc1ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:59.554 INFO:tasks.workunit.client.0.smithi043.stderr: -295> 2024-09-12T00:39:59.212+0000 7f5fc1ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:39:59.555 INFO:tasks.workunit.client.0.smithi043.stderr: -294> 2024-09-12T00:39:59.212+0000 7f5fc1ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:39:59.555 INFO:tasks.workunit.client.0.smithi043.stderr: -293> 2024-09-12T00:39:59.212+0000 7f60dbbc5640 10 monclient: get_auth_request con 0x7f5fb4070a20 auth_method 0 2024-09-12T00:39:59.555 INFO:tasks.workunit.client.0.smithi043.stderr: -292> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient: get_monmap_and_config 2024-09-12T00:39:59.555 INFO:tasks.workunit.client.0.smithi043.stderr: -291> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient: build_initial_monmap 2024-09-12T00:39:59.555 INFO:tasks.workunit.client.0.smithi043.stderr: -290> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:59.555 INFO:tasks.workunit.client.0.smithi043.stderr: -289> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient: monmap: 2024-09-12T00:39:59.555 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:39:59.555 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:59.555 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:39:59.555 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:39:59.555 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:59.555 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:59.555 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:39:59.556 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:39:59.556 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:39:59.556 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.556 INFO:tasks.workunit.client.0.smithi043.stderr: -288> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1619a4b0) adding auth protocol: cephx 2024-09-12T00:39:59.556 INFO:tasks.workunit.client.0.smithi043.stderr: -287> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1619a4b0) adding auth protocol: cephx 2024-09-12T00:39:59.556 INFO:tasks.workunit.client.0.smithi043.stderr: -286> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1619a4b0) adding auth protocol: cephx 2024-09-12T00:39:59.556 INFO:tasks.workunit.client.0.smithi043.stderr: -285> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1619a4b0) adding con mode: secure 2024-09-12T00:39:59.556 INFO:tasks.workunit.client.0.smithi043.stderr: -284> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1619a4b0) adding con mode: crc 2024-09-12T00:39:59.556 INFO:tasks.workunit.client.0.smithi043.stderr: -283> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1619a4b0) adding con mode: secure 2024-09-12T00:39:59.556 INFO:tasks.workunit.client.0.smithi043.stderr: -282> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1619a4b0) adding con mode: crc 2024-09-12T00:39:59.556 INFO:tasks.workunit.client.0.smithi043.stderr: -281> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1619a4b0) adding con mode: secure 2024-09-12T00:39:59.556 INFO:tasks.workunit.client.0.smithi043.stderr: -280> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1619a4b0) adding con mode: crc 2024-09-12T00:39:59.556 INFO:tasks.workunit.client.0.smithi043.stderr: -279> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1619a4b0) adding con mode: crc 2024-09-12T00:39:59.557 INFO:tasks.workunit.client.0.smithi043.stderr: -278> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1619a4b0) adding con mode: secure 2024-09-12T00:39:59.557 INFO:tasks.workunit.client.0.smithi043.stderr: -277> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1619a4b0) adding con mode: crc 2024-09-12T00:39:59.557 INFO:tasks.workunit.client.0.smithi043.stderr: -276> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1619a4b0) adding con mode: secure 2024-09-12T00:39:59.557 INFO:tasks.workunit.client.0.smithi043.stderr: -275> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1619a4b0) adding con mode: crc 2024-09-12T00:39:59.557 INFO:tasks.workunit.client.0.smithi043.stderr: -274> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1619a4b0) adding con mode: secure 2024-09-12T00:39:59.557 INFO:tasks.workunit.client.0.smithi043.stderr: -273> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:59.557 INFO:tasks.workunit.client.0.smithi043.stderr: -272> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient: init 2024-09-12T00:39:59.557 INFO:tasks.workunit.client.0.smithi043.stderr: -271> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd260096a0) adding auth protocol: cephx 2024-09-12T00:39:59.557 INFO:tasks.workunit.client.0.smithi043.stderr: -270> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd260096a0) adding auth protocol: cephx 2024-09-12T00:39:59.557 INFO:tasks.workunit.client.0.smithi043.stderr: -269> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd260096a0) adding auth protocol: cephx 2024-09-12T00:39:59.557 INFO:tasks.workunit.client.0.smithi043.stderr: -268> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd260096a0) adding con mode: secure 2024-09-12T00:39:59.557 INFO:tasks.workunit.client.0.smithi043.stderr: -267> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd260096a0) adding con mode: crc 2024-09-12T00:39:59.558 INFO:tasks.workunit.client.0.smithi043.stderr: -266> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd260096a0) adding con mode: secure 2024-09-12T00:39:59.558 INFO:tasks.workunit.client.0.smithi043.stderr: -265> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd260096a0) adding con mode: crc 2024-09-12T00:39:59.558 INFO:tasks.workunit.client.0.smithi043.stderr: -264> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd260096a0) adding con mode: secure 2024-09-12T00:39:59.558 INFO:tasks.workunit.client.0.smithi043.stderr: -263> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd260096a0) adding con mode: crc 2024-09-12T00:39:59.558 INFO:tasks.workunit.client.0.smithi043.stderr: -262> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd260096a0) adding con mode: crc 2024-09-12T00:39:59.558 INFO:tasks.workunit.client.0.smithi043.stderr: -261> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd260096a0) adding con mode: secure 2024-09-12T00:39:59.558 INFO:tasks.workunit.client.0.smithi043.stderr: -260> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd260096a0) adding con mode: crc 2024-09-12T00:39:59.558 INFO:tasks.workunit.client.0.smithi043.stderr: -259> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd260096a0) adding con mode: secure 2024-09-12T00:39:59.558 INFO:tasks.workunit.client.0.smithi043.stderr: -258> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd260096a0) adding con mode: crc 2024-09-12T00:39:59.558 INFO:tasks.workunit.client.0.smithi043.stderr: -257> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd260096a0) adding con mode: secure 2024-09-12T00:39:59.558 INFO:tasks.workunit.client.0.smithi043.stderr: -256> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:59.558 INFO:tasks.workunit.client.0.smithi043.stderr: -255> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:59.558 INFO:tasks.workunit.client.0.smithi043.stderr: -254> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd260097e8 EEXIST 2024-09-12T00:39:59.559 INFO:tasks.workunit.client.0.smithi043.stderr: -253> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:59.559 INFO:tasks.workunit.client.0.smithi043.stderr: -252> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:39:59.559 INFO:tasks.workunit.client.0.smithi043.stderr: -251> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient(hunting): picked mon.noname-c con 0x562d161c8aa0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:39:59.559 INFO:tasks.workunit.client.0.smithi043.stderr: -250> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient(hunting): picked mon.noname-b con 0x562d161c8e80 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:39:59.559 INFO:tasks.workunit.client.0.smithi043.stderr: -249> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient(hunting): picked mon.noname-a con 0x562d161ca340 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:39:59.559 INFO:tasks.workunit.client.0.smithi043.stderr: -248> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:59.559 INFO:tasks.workunit.client.0.smithi043.stderr: -247> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:59.559 INFO:tasks.workunit.client.0.smithi043.stderr: -246> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:59.559 INFO:tasks.workunit.client.0.smithi043.stderr: -245> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:59.559 INFO:tasks.workunit.client.0.smithi043.stderr: -244> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient(hunting): authenticate will time out at 2295.201460s 2024-09-12T00:39:59.559 INFO:tasks.workunit.client.0.smithi043.stderr: -243> 2024-09-12T00:39:59.212+0000 7f60dc3c6640 10 monclient(hunting): get_auth_request con 0x562d161c8aa0 auth_method 0 2024-09-12T00:39:59.559 INFO:tasks.workunit.client.0.smithi043.stderr: -242> 2024-09-12T00:39:59.212+0000 7f60dc3c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:59.559 INFO:tasks.workunit.client.0.smithi043.stderr: -241> 2024-09-12T00:39:59.212+0000 7f60dc3c6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:59.560 INFO:tasks.workunit.client.0.smithi043.stderr: -240> 2024-09-12T00:39:59.212+0000 7f60dc3c6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:59.560 INFO:tasks.workunit.client.0.smithi043.stderr: -239> 2024-09-12T00:39:59.212+0000 7f60dcbc7640 10 monclient(hunting): get_auth_request con 0x562d161ca340 auth_method 0 2024-09-12T00:39:59.560 INFO:tasks.workunit.client.0.smithi043.stderr: -238> 2024-09-12T00:39:59.212+0000 7f60dcbc7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:59.560 INFO:tasks.workunit.client.0.smithi043.stderr: -237> 2024-09-12T00:39:59.212+0000 7f60dcbc7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:59.560 INFO:tasks.workunit.client.0.smithi043.stderr: -236> 2024-09-12T00:39:59.212+0000 7f60dcbc7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:59.560 INFO:tasks.workunit.client.0.smithi043.stderr: -235> 2024-09-12T00:39:59.212+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:59.560 INFO:tasks.workunit.client.0.smithi043.stderr: -234> 2024-09-12T00:39:59.212+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:59.560 INFO:tasks.workunit.client.0.smithi043.stderr: -233> 2024-09-12T00:39:59.212+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:59.560 INFO:tasks.workunit.client.0.smithi043.stderr: -232> 2024-09-12T00:39:59.212+0000 7f60dcbc7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:59.560 INFO:tasks.workunit.client.0.smithi043.stderr: -231> 2024-09-12T00:39:59.212+0000 7f60dcbc7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:59.560 INFO:tasks.workunit.client.0.smithi043.stderr: -230> 2024-09-12T00:39:59.212+0000 7f60dcbc7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:59.560 INFO:tasks.workunit.client.0.smithi043.stderr: -229> 2024-09-12T00:39:59.212+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_done global_id 7310 payload 274 2024-09-12T00:39:59.560 INFO:tasks.workunit.client.0.smithi043.stderr: -228> 2024-09-12T00:39:59.212+0000 7f60dc3c6640 10 monclient: _finish_hunting 0 2024-09-12T00:39:59.561 INFO:tasks.workunit.client.0.smithi043.stderr: -227> 2024-09-12T00:39:59.212+0000 7f60dc3c6640 1 monclient: found mon.noname-c 2024-09-12T00:39:59.561 INFO:tasks.workunit.client.0.smithi043.stderr: -226> 2024-09-12T00:39:59.212+0000 7f60dc3c6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:39:59.561 INFO:tasks.workunit.client.0.smithi043.stderr: -225> 2024-09-12T00:39:59.212+0000 7f5fb37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:59.561 INFO:tasks.workunit.client.0.smithi043.stderr: -224> 2024-09-12T00:39:59.212+0000 7f5fb37fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:39:59.561 INFO:tasks.workunit.client.0.smithi043.stderr: -223> 2024-09-12T00:39:59.212+0000 7f5fb37fe640 10 monclient: dump: 2024-09-12T00:39:59.561 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:59.561 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:59.561 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.561 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.561 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:59.561 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:59.561 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:59.562 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:59.562 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:59.562 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.562 INFO:tasks.workunit.client.0.smithi043.stderr: -222> 2024-09-12T00:39:59.212+0000 7f5fb37fe640 10 monclient: _finish_auth 0 2024-09-12T00:39:59.562 INFO:tasks.workunit.client.0.smithi043.stderr: -221> 2024-09-12T00:39:59.212+0000 7f5fb37fe640 10 monclient: _check_auth_tickets 2024-09-12T00:39:59.562 INFO:tasks.workunit.client.0.smithi043.stderr: -220> 2024-09-12T00:39:59.212+0000 7f5fb37fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:59.562 INFO:tasks.workunit.client.0.smithi043.stderr: -219> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 monclient: authenticate success, global_id 7310 2024-09-12T00:39:59.562 INFO:tasks.workunit.client.0.smithi043.stderr: -218> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient: get_monmap_and_config success 2024-09-12T00:39:59.562 INFO:tasks.workunit.client.0.smithi043.stderr: -217> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 4 set_mon_vals no callback set 2024-09-12T00:39:59.562 INFO:tasks.workunit.client.0.smithi043.stderr: -216> 2024-09-12T00:39:59.212+0000 7f5fb37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:59.562 INFO:tasks.workunit.client.0.smithi043.stderr: -215> 2024-09-12T00:39:59.212+0000 7f5fb37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:39:59.562 INFO:tasks.workunit.client.0.smithi043.stderr: -214> 2024-09-12T00:39:59.212+0000 7f5fb37fe640 10 monclient: dump: 2024-09-12T00:39:59.562 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:59.563 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:59.563 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.563 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.563 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:59.563 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:59.563 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:59.563 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:59.563 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:59.563 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.563 INFO:tasks.workunit.client.0.smithi043.stderr: -213> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient: shutdown 2024-09-12T00:39:59.563 INFO:tasks.workunit.client.0.smithi043.stderr: -212> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient: build_initial_monmap 2024-09-12T00:39:59.563 INFO:tasks.workunit.client.0.smithi043.stderr: -211> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:59.563 INFO:tasks.workunit.client.0.smithi043.stderr: -210> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient: monmap: 2024-09-12T00:39:59.563 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:39:59.564 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:59.564 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:39:59.564 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:39:59.564 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:59.564 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:59.564 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:39:59.564 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:39:59.564 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:39:59.564 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.564 INFO:tasks.workunit.client.0.smithi043.stderr: -209> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d161ce180) adding auth protocol: cephx 2024-09-12T00:39:59.564 INFO:tasks.workunit.client.0.smithi043.stderr: -208> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d161ce180) adding auth protocol: cephx 2024-09-12T00:39:59.564 INFO:tasks.workunit.client.0.smithi043.stderr: -207> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d161ce180) adding auth protocol: cephx 2024-09-12T00:39:59.565 INFO:tasks.workunit.client.0.smithi043.stderr: -206> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d161ce180) adding con mode: secure 2024-09-12T00:39:59.565 INFO:tasks.workunit.client.0.smithi043.stderr: -205> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d161ce180) adding con mode: crc 2024-09-12T00:39:59.565 INFO:tasks.workunit.client.0.smithi043.stderr: -204> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d161ce180) adding con mode: secure 2024-09-12T00:39:59.565 INFO:tasks.workunit.client.0.smithi043.stderr: -203> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d161ce180) adding con mode: crc 2024-09-12T00:39:59.565 INFO:tasks.workunit.client.0.smithi043.stderr: -202> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d161ce180) adding con mode: secure 2024-09-12T00:39:59.565 INFO:tasks.workunit.client.0.smithi043.stderr: -201> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d161ce180) adding con mode: crc 2024-09-12T00:39:59.565 INFO:tasks.workunit.client.0.smithi043.stderr: -200> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d161ce180) adding con mode: crc 2024-09-12T00:39:59.565 INFO:tasks.workunit.client.0.smithi043.stderr: -199> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d161ce180) adding con mode: secure 2024-09-12T00:39:59.565 INFO:tasks.workunit.client.0.smithi043.stderr: -198> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d161ce180) adding con mode: crc 2024-09-12T00:39:59.565 INFO:tasks.workunit.client.0.smithi043.stderr: -197> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d161ce180) adding con mode: secure 2024-09-12T00:39:59.565 INFO:tasks.workunit.client.0.smithi043.stderr: -196> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d161ce180) adding con mode: crc 2024-09-12T00:39:59.565 INFO:tasks.workunit.client.0.smithi043.stderr: -195> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d161ce180) adding con mode: secure 2024-09-12T00:39:59.566 INFO:tasks.workunit.client.0.smithi043.stderr: -194> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:59.566 INFO:tasks.workunit.client.0.smithi043.stderr: -193> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 1 librados: starting msgr at 2024-09-12T00:39:59.566 INFO:tasks.workunit.client.0.smithi043.stderr: -192> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 1 librados: starting objecter 2024-09-12T00:39:59.566 INFO:tasks.workunit.client.0.smithi043.stderr: -191> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command objecter_requests cmddesc objecter_requests hook 0x562d161a08e0 EEXIST 2024-09-12T00:39:59.566 INFO:tasks.workunit.client.0.smithi043.stderr: -190> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 1 librados: setting wanted keys 2024-09-12T00:39:59.566 INFO:tasks.workunit.client.0.smithi043.stderr: -189> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 1 librados: calling monclient init 2024-09-12T00:39:59.566 INFO:tasks.workunit.client.0.smithi043.stderr: -188> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient: init 2024-09-12T00:39:59.566 INFO:tasks.workunit.client.0.smithi043.stderr: -187> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1617c940) adding auth protocol: cephx 2024-09-12T00:39:59.566 INFO:tasks.workunit.client.0.smithi043.stderr: -186> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1617c940) adding auth protocol: cephx 2024-09-12T00:39:59.566 INFO:tasks.workunit.client.0.smithi043.stderr: -185> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1617c940) adding auth protocol: cephx 2024-09-12T00:39:59.566 INFO:tasks.workunit.client.0.smithi043.stderr: -184> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1617c940) adding con mode: secure 2024-09-12T00:39:59.566 INFO:tasks.workunit.client.0.smithi043.stderr: -183> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1617c940) adding con mode: crc 2024-09-12T00:39:59.566 INFO:tasks.workunit.client.0.smithi043.stderr: -182> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1617c940) adding con mode: secure 2024-09-12T00:39:59.567 INFO:tasks.workunit.client.0.smithi043.stderr: -181> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1617c940) adding con mode: crc 2024-09-12T00:39:59.567 INFO:tasks.workunit.client.0.smithi043.stderr: -180> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1617c940) adding con mode: secure 2024-09-12T00:39:59.567 INFO:tasks.workunit.client.0.smithi043.stderr: -179> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1617c940) adding con mode: crc 2024-09-12T00:39:59.567 INFO:tasks.workunit.client.0.smithi043.stderr: -178> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1617c940) adding con mode: crc 2024-09-12T00:39:59.567 INFO:tasks.workunit.client.0.smithi043.stderr: -177> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1617c940) adding con mode: secure 2024-09-12T00:39:59.567 INFO:tasks.workunit.client.0.smithi043.stderr: -176> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1617c940) adding con mode: crc 2024-09-12T00:39:59.567 INFO:tasks.workunit.client.0.smithi043.stderr: -175> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1617c940) adding con mode: secure 2024-09-12T00:39:59.567 INFO:tasks.workunit.client.0.smithi043.stderr: -174> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1617c940) adding con mode: crc 2024-09-12T00:39:59.567 INFO:tasks.workunit.client.0.smithi043.stderr: -173> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1617c940) adding con mode: secure 2024-09-12T00:39:59.567 INFO:tasks.workunit.client.0.smithi043.stderr: -172> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:59.567 INFO:tasks.workunit.client.0.smithi043.stderr: -171> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:59.567 INFO:tasks.workunit.client.0.smithi043.stderr: -170> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command rotate-key cmddesc rotate-key hook 0x562d1617ca88 EEXIST 2024-09-12T00:39:59.568 INFO:tasks.workunit.client.0.smithi043.stderr: -169> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:59.568 INFO:tasks.workunit.client.0.smithi043.stderr: -168> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:39:59.568 INFO:tasks.workunit.client.0.smithi043.stderr: -167> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 10 monclient(hunting): picked mon.noname-a con 0x562d161c8aa0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:39:59.568 INFO:tasks.workunit.client.0.smithi043.stderr: -166> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 10 monclient(hunting): picked mon.noname-c con 0x562d161ca340 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:39:59.568 INFO:tasks.workunit.client.0.smithi043.stderr: -165> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 10 monclient(hunting): picked mon.noname-b con 0x562d161bd970 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:39:59.568 INFO:tasks.workunit.client.0.smithi043.stderr: -164> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:59.568 INFO:tasks.workunit.client.0.smithi043.stderr: -163> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:59.568 INFO:tasks.workunit.client.0.smithi043.stderr: -162> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:59.568 INFO:tasks.workunit.client.0.smithi043.stderr: -161> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:59.568 INFO:tasks.workunit.client.0.smithi043.stderr: -160> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 10 monclient(hunting): authenticate will time out at 2295.204073s 2024-09-12T00:39:59.568 INFO:tasks.workunit.client.0.smithi043.stderr: -159> 2024-09-12T00:39:59.216+0000 7f60dc3c6640 10 monclient(hunting): get_auth_request con 0x562d161c8aa0 auth_method 0 2024-09-12T00:39:59.568 INFO:tasks.workunit.client.0.smithi043.stderr: -158> 2024-09-12T00:39:59.216+0000 7f60dc3c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:59.568 INFO:tasks.workunit.client.0.smithi043.stderr: -157> 2024-09-12T00:39:59.216+0000 7f60dc3c6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:59.569 INFO:tasks.workunit.client.0.smithi043.stderr: -156> 2024-09-12T00:39:59.216+0000 7f60dc3c6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:59.569 INFO:tasks.workunit.client.0.smithi043.stderr: -155> 2024-09-12T00:39:59.216+0000 7f60dbbc5640 10 monclient(hunting): get_auth_request con 0x562d161ca340 auth_method 0 2024-09-12T00:39:59.569 INFO:tasks.workunit.client.0.smithi043.stderr: -154> 2024-09-12T00:39:59.216+0000 7f60dbbc5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:59.569 INFO:tasks.workunit.client.0.smithi043.stderr: -153> 2024-09-12T00:39:59.216+0000 7f60dbbc5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:59.569 INFO:tasks.workunit.client.0.smithi043.stderr: -152> 2024-09-12T00:39:59.216+0000 7f60dbbc5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:59.569 INFO:tasks.workunit.client.0.smithi043.stderr: -151> 2024-09-12T00:39:59.216+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:59.569 INFO:tasks.workunit.client.0.smithi043.stderr: -150> 2024-09-12T00:39:59.216+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:59.569 INFO:tasks.workunit.client.0.smithi043.stderr: -149> 2024-09-12T00:39:59.216+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:59.569 INFO:tasks.workunit.client.0.smithi043.stderr: -148> 2024-09-12T00:39:59.216+0000 7f60dbbc5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:59.569 INFO:tasks.workunit.client.0.smithi043.stderr: -147> 2024-09-12T00:39:59.216+0000 7f60dbbc5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:59.570 INFO:tasks.workunit.client.0.smithi043.stderr: -146> 2024-09-12T00:39:59.216+0000 7f60dbbc5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:59.570 INFO:tasks.workunit.client.0.smithi043.stderr: -145> 2024-09-12T00:39:59.216+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_done global_id 7650 payload 824 2024-09-12T00:39:59.570 INFO:tasks.workunit.client.0.smithi043.stderr: -144> 2024-09-12T00:39:59.216+0000 7f60dc3c6640 10 monclient: _finish_hunting 0 2024-09-12T00:39:59.570 INFO:tasks.workunit.client.0.smithi043.stderr: -143> 2024-09-12T00:39:59.216+0000 7f60dc3c6640 1 monclient: found mon.noname-a 2024-09-12T00:39:59.570 INFO:tasks.workunit.client.0.smithi043.stderr: -142> 2024-09-12T00:39:59.216+0000 7f60dc3c6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:39:59.570 INFO:tasks.workunit.client.0.smithi043.stderr: -141> 2024-09-12T00:39:59.216+0000 7f5fb1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:59.570 INFO:tasks.workunit.client.0.smithi043.stderr: -140> 2024-09-12T00:39:59.216+0000 7f5fb1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:39:59.570 INFO:tasks.workunit.client.0.smithi043.stderr: -139> 2024-09-12T00:39:59.216+0000 7f5fb1ffb640 10 monclient: dump: 2024-09-12T00:39:59.570 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:59.570 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:59.570 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.570 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.570 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:59.571 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:59.571 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:59.571 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:59.571 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:59.571 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.571 INFO:tasks.workunit.client.0.smithi043.stderr: -138> 2024-09-12T00:39:59.216+0000 7f5fb1ffb640 10 monclient: _finish_auth 0 2024-09-12T00:39:59.571 INFO:tasks.workunit.client.0.smithi043.stderr: -137> 2024-09-12T00:39:59.216+0000 7f5fb1ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:39:59.571 INFO:tasks.workunit.client.0.smithi043.stderr: -136> 2024-09-12T00:39:59.216+0000 7f5fb1ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:59.571 INFO:tasks.workunit.client.0.smithi043.stderr: -135> 2024-09-12T00:39:59.216+0000 7f5fb1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:59.571 INFO:tasks.workunit.client.0.smithi043.stderr: -134> 2024-09-12T00:39:59.216+0000 7f5fb1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:59.571 INFO:tasks.workunit.client.0.smithi043.stderr: -133> 2024-09-12T00:39:59.216+0000 7f5fb1ffb640 10 monclient: dump: 2024-09-12T00:39:59.571 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:59.571 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:59.572 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.572 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.572 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:59.572 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:59.572 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:59.572 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:59.572 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:59.572 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.572 INFO:tasks.workunit.client.0.smithi043.stderr: -132> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 5 monclient: authenticate success, global_id 7650 2024-09-12T00:39:59.572 INFO:tasks.workunit.client.0.smithi043.stderr: -131> 2024-09-12T00:39:59.216+0000 7f5fb37fe640 4 set_mon_vals no callback set 2024-09-12T00:39:59.572 INFO:tasks.workunit.client.0.smithi043.stderr: -130> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 10 monclient: _renew_subs 2024-09-12T00:39:59.572 INFO:tasks.workunit.client.0.smithi043.stderr: -129> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:39:59.572 INFO:tasks.workunit.client.0.smithi043.stderr: -128> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 10 monclient: _renew_subs 2024-09-12T00:39:59.573 INFO:tasks.workunit.client.0.smithi043.stderr: -127> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:39:59.573 INFO:tasks.workunit.client.0.smithi043.stderr: -126> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 1 librados: init done 2024-09-12T00:39:59.573 INFO:tasks.workunit.client.0.smithi043.stderr: -125> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command cr dump hook 0x562d1619e618 2024-09-12T00:39:59.573 INFO:tasks.workunit.client.0.smithi043.stderr: -124> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.573 INFO:tasks.workunit.client.0.smithi043.stderr: -123> 2024-09-12T00:39:59.216+0000 7f5fb1ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:59.573 INFO:tasks.workunit.client.0.smithi043.stderr: -122> 2024-09-12T00:39:59.216+0000 7f5fb1ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:39:59.573 INFO:tasks.workunit.client.0.smithi043.stderr: -121> 2024-09-12T00:39:59.216+0000 7f5fb1ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:39:59.573 INFO:tasks.workunit.client.0.smithi043.stderr: -120> 2024-09-12T00:39:59.216+0000 7f60dbbc5640 10 monclient: get_auth_request con 0x7f5fa4070ae0 auth_method 0 2024-09-12T00:39:59.573 INFO:tasks.workunit.client.0.smithi043.stderr: -119> 2024-09-12T00:39:59.216+0000 7f60dcbc7640 10 monclient: get_auth_request con 0x562d161e8160 auth_method 0 2024-09-12T00:39:59.573 INFO:tasks.workunit.client.0.smithi043.stderr: -118> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.573 INFO:tasks.workunit.client.0.smithi043.stderr: -117> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 20 realm 2024-09-12T00:39:59.573 INFO:tasks.workunit.client.0.smithi043.stderr: -116> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.573 INFO:tasks.workunit.client.0.smithi043.stderr: -115> 2024-09-12T00:39:59.220+0000 7f60de8c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.574 INFO:tasks.workunit.client.0.smithi043.stderr: -114> 2024-09-12T00:39:59.220+0000 7f60de8c09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:59.574 INFO:tasks.workunit.client.0.smithi043.stderr: -113> 2024-09-12T00:39:59.220+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.574 INFO:tasks.workunit.client.0.smithi043.stderr: -112> 2024-09-12T00:39:59.220+0000 7f60de8c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.574 INFO:tasks.workunit.client.0.smithi043.stderr: -111> 2024-09-12T00:39:59.220+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.574 INFO:tasks.workunit.client.0.smithi043.stderr: -110> 2024-09-12T00:39:59.220+0000 7f60dc3c6640 10 monclient: get_auth_request con 0x562d161ec390 auth_method 0 2024-09-12T00:39:59.574 INFO:tasks.workunit.client.0.smithi043.stderr: -109> 2024-09-12T00:39:59.220+0000 7f60de8c09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:59.574 INFO:tasks.workunit.client.0.smithi043.stderr: -108> 2024-09-12T00:39:59.220+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.574 INFO:tasks.workunit.client.0.smithi043.stderr: -107> 2024-09-12T00:39:59.220+0000 7f60dbbc5640 10 monclient: get_auth_request con 0x562d161efbf0 auth_method 0 2024-09-12T00:39:59.574 INFO:tasks.workunit.client.0.smithi043.stderr: -106> 2024-09-12T00:39:59.220+0000 7f60de8c09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:59.574 INFO:tasks.workunit.client.0.smithi043.stderr: -105> 2024-09-12T00:39:59.220+0000 7f60de8c09c0 20 searching for the correct realm 2024-09-12T00:39:59.574 INFO:tasks.workunit.client.0.smithi043.stderr: -104> 2024-09-12T00:39:59.220+0000 7f60dcbc7640 10 monclient: get_auth_request con 0x562d161f4990 auth_method 0 2024-09-12T00:39:59.574 INFO:tasks.workunit.client.0.smithi043.stderr: -103> 2024-09-12T00:39:59.224+0000 7f60dc3c6640 10 monclient: get_auth_request con 0x7f60d400e040 auth_method 0 2024-09-12T00:39:59.574 INFO:tasks.workunit.client.0.smithi043.stderr: -102> 2024-09-12T00:39:59.224+0000 7f60dbbc5640 10 monclient: get_auth_request con 0x7f60d0031040 auth_method 0 2024-09-12T00:39:59.575 INFO:tasks.workunit.client.0.smithi043.stderr: -101> 2024-09-12T00:39:59.228+0000 7f60dcbc7640 0 -- 172.21.15.43:0/500109282 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f60d0019920 msgr2=0x7f60d0018400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:59.575 INFO:tasks.workunit.client.0.smithi043.stderr: -100> 2024-09-12T00:39:59.432+0000 7f60dcbc7640 10 monclient: get_auth_request con 0x7f60d0019920 auth_method 0 2024-09-12T00:39:59.575 INFO:tasks.workunit.client.0.smithi043.stderr: -99> 2024-09-12T00:39:59.436+0000 7f60dc3c6640 10 monclient: get_auth_request con 0x7f60d0047400 auth_method 0 2024-09-12T00:39:59.575 INFO:tasks.workunit.client.0.smithi043.stderr: -98> 2024-09-12T00:39:59.444+0000 7f60dc3c6640 0 -- 172.21.15.43:0/500109282 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x562d161ec390 msgr2=0x562d161ee7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:59.575 INFO:tasks.workunit.client.0.smithi043.stderr: -97> 2024-09-12T00:39:59.444+0000 7f5fb1ffb640 1 client.7650.objecter ms_handle_reset 0x562d161ec390 session 0x562d161ebd10 osd.5 2024-09-12T00:39:59.575 INFO:tasks.workunit.client.0.smithi043.stderr: -96> 2024-09-12T00:39:59.444+0000 7f5fb1ffb640 10 monclient: _renew_subs 2024-09-12T00:39:59.575 INFO:tasks.workunit.client.0.smithi043.stderr: -95> 2024-09-12T00:39:59.444+0000 7f5fb1ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:39:59.575 INFO:tasks.workunit.client.0.smithi043.stderr: -94> 2024-09-12T00:39:59.444+0000 7f60dc3c6640 10 monclient: get_auth_request con 0x7f5fa4080b80 auth_method 0 2024-09-12T00:39:59.575 INFO:tasks.workunit.client.0.smithi043.stderr: -93> 2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:39:59.575 INFO:tasks.workunit.client.0.smithi043.stderr: -92> 2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:59.575 INFO:tasks.workunit.client.0.smithi043.stderr: -91> 2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:59.575 INFO:tasks.workunit.client.0.smithi043.stderr: -90> 2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:39:59.576 INFO:tasks.workunit.client.0.smithi043.stderr: -89> 2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:59.576 INFO:tasks.workunit.client.0.smithi043.stderr: -88> 2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:59.576 INFO:tasks.workunit.client.0.smithi043.stderr: -87> 2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.576 INFO:tasks.workunit.client.0.smithi043.stderr: -86> 2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.576 INFO:tasks.workunit.client.0.smithi043.stderr: -85> 2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.576 INFO:tasks.workunit.client.0.smithi043.stderr: -84> 2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:59.576 INFO:tasks.workunit.client.0.smithi043.stderr: -83> 2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.576 INFO:tasks.workunit.client.0.smithi043.stderr: -82> 2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:59.576 INFO:tasks.workunit.client.0.smithi043.stderr: -81> 2024-09-12T00:39:59.456+0000 7f60de8c09c0 20 zone default found 2024-09-12T00:39:59.576 INFO:tasks.workunit.client.0.smithi043.stderr: -80> 2024-09-12T00:39:59.456+0000 7f60de8c09c0 4 Realm: () 2024-09-12T00:39:59.576 INFO:tasks.workunit.client.0.smithi043.stderr: -79> 2024-09-12T00:39:59.456+0000 7f60de8c09c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:39:59.576 INFO:tasks.workunit.client.0.smithi043.stderr: -78> 2024-09-12T00:39:59.456+0000 7f60de8c09c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:39:59.576 INFO:tasks.workunit.client.0.smithi043.stderr: -77> 2024-09-12T00:39:59.456+0000 7f60de8c09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:59.577 INFO:tasks.workunit.client.0.smithi043.stderr: -76> 2024-09-12T00:39:59.456+0000 7f60de8c09c0 20 zonegroup default 2024-09-12T00:39:59.577 INFO:tasks.workunit.client.0.smithi043.stderr: -75> 2024-09-12T00:39:59.456+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.577 INFO:tasks.workunit.client.0.smithi043.stderr: -74> 2024-09-12T00:39:59.456+0000 7f60de8c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.577 INFO:tasks.workunit.client.0.smithi043.stderr: -73> 2024-09-12T00:39:59.456+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.577 INFO:tasks.workunit.client.0.smithi043.stderr: -72> 2024-09-12T00:39:59.456+0000 7f60de8c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.577 INFO:tasks.workunit.client.0.smithi043.stderr: -71> 2024-09-12T00:39:59.456+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.577 INFO:tasks.workunit.client.0.smithi043.stderr: -70> 2024-09-12T00:39:59.456+0000 7f60de8c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.577 INFO:tasks.workunit.client.0.smithi043.stderr: -69> 2024-09-12T00:39:59.456+0000 7f60de8c09c0 20 started sync module instance, tier type = 2024-09-12T00:39:59.577 INFO:tasks.workunit.client.0.smithi043.stderr: -68> 2024-09-12T00:39:59.456+0000 7f60de8c09c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:39:59.577 INFO:tasks.workunit.client.0.smithi043.stderr: -67> 2024-09-12T00:39:59.480+0000 7f60de8c09c0 20 add_watcher() i=0 2024-09-12T00:39:59.577 INFO:tasks.workunit.client.0.smithi043.stderr: -66> 2024-09-12T00:39:59.480+0000 7f60de8c09c0 20 add_watcher() i=1 2024-09-12T00:39:59.577 INFO:tasks.workunit.client.0.smithi043.stderr: -65> 2024-09-12T00:39:59.480+0000 7f60de8c09c0 20 add_watcher() i=2 2024-09-12T00:39:59.577 INFO:tasks.workunit.client.0.smithi043.stderr: -64> 2024-09-12T00:39:59.480+0000 7f60de8c09c0 20 add_watcher() i=3 2024-09-12T00:39:59.577 INFO:tasks.workunit.client.0.smithi043.stderr: -63> 2024-09-12T00:39:59.480+0000 7f60de8c09c0 20 add_watcher() i=4 2024-09-12T00:39:59.578 INFO:tasks.workunit.client.0.smithi043.stderr: -62> 2024-09-12T00:39:59.480+0000 7f60de8c09c0 20 add_watcher() i=5 2024-09-12T00:39:59.578 INFO:tasks.workunit.client.0.smithi043.stderr: -61> 2024-09-12T00:39:59.480+0000 7f60de8c09c0 20 add_watcher() i=6 2024-09-12T00:39:59.578 INFO:tasks.workunit.client.0.smithi043.stderr: -60> 2024-09-12T00:39:59.484+0000 7f60de8c09c0 20 add_watcher() i=7 2024-09-12T00:39:59.578 INFO:tasks.workunit.client.0.smithi043.stderr: -59> 2024-09-12T00:39:59.484+0000 7f60de8c09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:59.578 INFO:tasks.workunit.client.0.smithi043.stderr: -58> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd26009b80) adding auth protocol: cephx 2024-09-12T00:39:59.578 INFO:tasks.workunit.client.0.smithi043.stderr: -57> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd26009b80) adding auth protocol: cephx 2024-09-12T00:39:59.578 INFO:tasks.workunit.client.0.smithi043.stderr: -56> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd26009b80) adding auth protocol: cephx 2024-09-12T00:39:59.578 INFO:tasks.workunit.client.0.smithi043.stderr: -55> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd26009b80) adding con mode: secure 2024-09-12T00:39:59.578 INFO:tasks.workunit.client.0.smithi043.stderr: -54> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd26009b80) adding con mode: crc 2024-09-12T00:39:59.578 INFO:tasks.workunit.client.0.smithi043.stderr: -53> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd26009b80) adding con mode: secure 2024-09-12T00:39:59.578 INFO:tasks.workunit.client.0.smithi043.stderr: -52> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd26009b80) adding con mode: crc 2024-09-12T00:39:59.578 INFO:tasks.workunit.client.0.smithi043.stderr: -51> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd26009b80) adding con mode: secure 2024-09-12T00:39:59.578 INFO:tasks.workunit.client.0.smithi043.stderr: -50> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd26009b80) adding con mode: crc 2024-09-12T00:39:59.579 INFO:tasks.workunit.client.0.smithi043.stderr: -49> 2024-09-12T00:39:59.488+0000 7f5f92fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:59.579 INFO:tasks.workunit.client.0.smithi043.stderr: -48> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd26009b80) adding con mode: crc 2024-09-12T00:39:59.579 INFO:tasks.workunit.client.0.smithi043.stderr: -47> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd26009b80) adding con mode: secure 2024-09-12T00:39:59.579 INFO:tasks.workunit.client.0.smithi043.stderr: -46> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd26009b80) adding con mode: crc 2024-09-12T00:39:59.579 INFO:tasks.workunit.client.0.smithi043.stderr: -45> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd26009b80) adding con mode: secure 2024-09-12T00:39:59.579 INFO:tasks.workunit.client.0.smithi043.stderr: -44> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd26009b80) adding con mode: crc 2024-09-12T00:39:59.579 INFO:tasks.workunit.client.0.smithi043.stderr: -43> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd26009b80) adding con mode: secure 2024-09-12T00:39:59.579 INFO:tasks.workunit.client.0.smithi043.stderr: -42> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:59.579 INFO:tasks.workunit.client.0.smithi043.stderr: -41> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:59.579 INFO:tasks.workunit.client.0.smithi043.stderr: -40> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:59.579 INFO:tasks.workunit.client.0.smithi043.stderr: -39> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command cache list hook 0x562d161bddb0 2024-09-12T00:39:59.579 INFO:tasks.workunit.client.0.smithi043.stderr: -38> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command cache inspect hook 0x562d161bddb0 2024-09-12T00:39:59.579 INFO:tasks.workunit.client.0.smithi043.stderr: -37> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command cache erase hook 0x562d161bddb0 2024-09-12T00:39:59.580 INFO:tasks.workunit.client.0.smithi043.stderr: -36> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command cache zap hook 0x562d161bddb0 2024-09-12T00:39:59.580 INFO:tasks.workunit.client.0.smithi043.stderr: -35> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 note: GC not initialized 2024-09-12T00:39:59.580 INFO:tasks.workunit.client.0.smithi043.stderr: -34> 2024-09-12T00:39:59.492+0000 7f5f91fdb640 20 reqs_thread_entry: start 2024-09-12T00:39:59.580 INFO:tasks.workunit.client.0.smithi043.stderr: -33> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command sync trace show hook 0x7f60c4001d40 2024-09-12T00:39:59.580 INFO:tasks.workunit.client.0.smithi043.stderr: -32> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command sync trace history hook 0x7f60c4001d40 2024-09-12T00:39:59.580 INFO:tasks.workunit.client.0.smithi043.stderr: -31> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command sync trace active hook 0x7f60c4001d40 2024-09-12T00:39:59.580 INFO:tasks.workunit.client.0.smithi043.stderr: -30> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command sync trace active_short hook 0x7f60c4001d40 2024-09-12T00:39:59.580 INFO:tasks.workunit.client.0.smithi043.stderr: -29> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:59.580 INFO:tasks.workunit.client.0.smithi043.stderr: -28> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 20 Filter name: none 2024-09-12T00:39:59.580 INFO:tasks.workunit.client.0.smithi043.stderr: -27> 2024-09-12T00:39:59.492+0000 7f5f037fe640 20 reqs_thread_entry: start 2024-09-12T00:39:59.580 INFO:tasks.workunit.client.0.smithi043.stderr: -26> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:39:59.580 INFO:tasks.workunit.client.0.smithi043.stderr: -25> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.580 INFO:tasks.workunit.client.0.smithi043.stderr: -24> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:39:59.581 INFO:tasks.workunit.client.0.smithi043.stderr: -23> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:39:59.581 INFO:tasks.workunit.client.0.smithi043.stderr: -22> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:39:59.581 INFO:tasks.workunit.client.0.smithi043.stderr: -21> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 : miss 2024-09-12T00:39:59.581 INFO:tasks.workunit.client.0.smithi043.stderr: -20> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.581 INFO:tasks.workunit.client.0.smithi043.stderr: -19> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:39:59.581 INFO:tasks.workunit.client.0.smithi043.stderr: -18> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 info.flags=0x17 2024-09-12T00:39:59.581 INFO:tasks.workunit.client.0.smithi043.stderr: -17> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 to cache LRU end 2024-09-12T00:39:59.581 INFO:tasks.workunit.client.0.smithi043.stderr: -16> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:59.581 INFO:tasks.workunit.client.0.smithi043.stderr: -15> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:59.581 INFO:tasks.workunit.client.0.smithi043.stderr: -14> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 2024-09-12T00:39:59.581 INFO:tasks.workunit.client.0.smithi043.stderr: -13> 2024-09-12T00:39:59.504+0000 7f60de8c09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 info.flags=0x17 2024-09-12T00:39:59.581 INFO:tasks.workunit.client.0.smithi043.stderr: -12> 2024-09-12T00:39:59.504+0000 7f60de8c09c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 to cache LRU end 2024-09-12T00:39:59.581 INFO:tasks.workunit.client.0.smithi043.stderr: -11> 2024-09-12T00:39:59.504+0000 7f60de8c09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:59.582 INFO:tasks.workunit.client.0.smithi043.stderr: -10> 2024-09-12T00:39:59.504+0000 7f60de8c09c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36, ofs0, ns] 2024-09-12T00:39:59.582 INFO:tasks.workunit.client.0.smithi043.stderr: -9> 2024-09-12T00:39:59.504+0000 7f5fb37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333492 cookie 94751644689904 notifier 7650 bl.length()=923 2024-09-12T00:39:59.582 INFO:tasks.workunit.client.0.smithi043.stderr: -8> 2024-09-12T00:39:59.504+0000 7f5fb37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 info.flags=0x17 2024-09-12T00:39:59.582 INFO:tasks.workunit.client.0.smithi043.stderr: -7> 2024-09-12T00:39:59.504+0000 7f5fb37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 to cache LRU end 2024-09-12T00:39:59.582 INFO:tasks.workunit.client.0.smithi043.stderr: -6> 2024-09-12T00:39:59.504+0000 7f5fb37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:59.582 INFO:tasks.workunit.client.0.smithi043.stderr: -5> 2024-09-12T00:39:59.504+0000 7f60de8c09c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36]): orig_sources= new_sources= 2024-09-12T00:39:59.582 INFO:tasks.workunit.client.0.smithi043.stderr: -4> 2024-09-12T00:39:59.504+0000 7f60de8c09c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36]): potential sources added=[] removed=[] 2024-09-12T00:39:59.582 INFO:tasks.workunit.client.0.smithi043.stderr: -3> 2024-09-12T00:39:59.504+0000 7f60de8c09c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36]): orig_dests= new_dests= 2024-09-12T00:39:59.582 INFO:tasks.workunit.client.0.smithi043.stderr: -2> 2024-09-12T00:39:59.504+0000 7f60de8c09c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36]): potential dests added=[] removed=[] 2024-09-12T00:39:59.582 INFO:tasks.workunit.client.0.smithi043.stderr: -1> 2024-09-12T00:39:59.512+0000 7f60de8c09c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f60de8c09c0 time 2024-09-12T00:39:59.512442+0000 2024-09-12T00:39:59.582 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:39:59.582 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.582 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:59.583 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f60e219a2eb] 2024-09-12T00:39:59.583 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f60e219a49f] 2024-09-12T00:39:59.583 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562d13440cc1] 2024-09-12T00:39:59.583 INFO:tasks.workunit.client.0.smithi043.stderr: 4: radosgw-admin(+0x1422aac) [0x562d13e9eaac] 2024-09-12T00:39:59.583 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562d13455ced] 2024-09-12T00:39:59.583 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:39:59.583 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f60e1000d90] 2024-09-12T00:39:59.583 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:39:59.583 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:39:59.583 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.583 INFO:tasks.workunit.client.0.smithi043.stderr: 0> 2024-09-12T00:39:59.512+0000 7f60de8c09c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:39:59.583 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7f60de8c09c0 thread_name:radosgw-admin 2024-09-12T00:39:59.583 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.584 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:59.584 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f60e1019520] 2024-09-12T00:39:59.584 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:39:59.584 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:39:59.584 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:39:59.584 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f60e219a345] 2024-09-12T00:39:59.584 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f60e219a49f] 2024-09-12T00:39:59.584 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562d13440cc1] 2024-09-12T00:39:59.584 INFO:tasks.workunit.client.0.smithi043.stderr: 8: radosgw-admin(+0x1422aac) [0x562d13e9eaac] 2024-09-12T00:39:59.585 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562d13455ced] 2024-09-12T00:39:59.585 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:39:59.585 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f60e1000d90] 2024-09-12T00:39:59.585 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:39:59.585 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:39:59.585 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:39:59.585 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.585 INFO:tasks.workunit.client.0.smithi043.stderr:--- logging levels --- 2024-09-12T00:39:59.585 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 none 2024-09-12T00:39:59.585 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 lockdep 2024-09-12T00:39:59.585 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 context 2024-09-12T00:39:59.585 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 crush 2024-09-12T00:39:59.586 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds 2024-09-12T00:39:59.586 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_balancer 2024-09-12T00:39:59.586 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_locker 2024-09-12T00:39:59.586 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log 2024-09-12T00:39:59.586 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log_expire 2024-09-12T00:39:59.586 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_migrator 2024-09-12T00:39:59.586 INFO:tasks.workunit.client.0.smithi043.stderr: 3/ 5 mds_quiesce 2024-09-12T00:39:59.586 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 buffer 2024-09-12T00:39:59.586 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 timer 2024-09-12T00:39:59.586 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 filer 2024-09-12T00:39:59.586 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 striper 2024-09-12T00:39:59.586 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 objecter 2024-09-12T00:39:59.586 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rados 2024-09-12T00:39:59.587 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd 2024-09-12T00:39:59.587 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_mirror 2024-09-12T00:39:59.587 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_replay 2024-09-12T00:39:59.587 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_pwl 2024-09-12T00:39:59.587 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 journaler 2024-09-12T00:39:59.587 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objectcacher 2024-09-12T00:39:59.587 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:39:59.587 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 client 2024-09-12T00:39:59.587 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 osd 2024-09-12T00:39:59.587 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 optracker 2024-09-12T00:39:59.587 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objclass 2024-09-12T00:39:59.587 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 filestore 2024-09-12T00:39:59.587 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 journal 2024-09-12T00:39:59.587 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 ms 2024-09-12T00:39:59.588 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mon 2024-09-12T00:39:59.588 INFO:tasks.workunit.client.0.smithi043.stderr: 0/10 monc 2024-09-12T00:39:59.588 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 paxos 2024-09-12T00:39:59.588 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 tp 2024-09-12T00:39:59.588 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 auth 2024-09-12T00:39:59.588 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 crypto 2024-09-12T00:39:59.588 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 finisher 2024-09-12T00:39:59.588 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 reserver 2024-09-12T00:39:59.588 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 heartbeatmap 2024-09-12T00:39:59.588 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 perfcounter 2024-09-12T00:39:59.588 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw 2024-09-12T00:39:59.588 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_sync 2024-09-12T00:39:59.588 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_datacache 2024-09-12T00:39:59.589 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_access 2024-09-12T00:39:59.589 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:39:59.589 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_flight 2024-09-12T00:39:59.589 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:39:59.589 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw_notification 2024-09-12T00:39:59.589 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 javaclient 2024-09-12T00:39:59.589 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 asok 2024-09-12T00:39:59.589 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 throttle 2024-09-12T00:39:59.589 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 refs 2024-09-12T00:39:59.589 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 compressor 2024-09-12T00:39:59.589 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluestore 2024-09-12T00:39:59.589 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluefs 2024-09-12T00:39:59.590 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 bdev 2024-09-12T00:39:59.590 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 kstore 2024-09-12T00:39:59.590 INFO:tasks.workunit.client.0.smithi043.stderr: 4/ 5 rocksdb 2024-09-12T00:39:59.590 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 fuse 2024-09-12T00:39:59.590 INFO:tasks.workunit.client.0.smithi043.stderr: 2/ 5 mgr 2024-09-12T00:39:59.590 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mgrc 2024-09-12T00:39:59.590 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 dpdk 2024-09-12T00:39:59.590 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 eventtrace 2024-09-12T00:39:59.590 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 prioritycache 2024-09-12T00:39:59.590 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 test 2024-09-12T00:39:59.590 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:39:59.590 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephsqlite 2024-09-12T00:39:59.590 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:39:59.590 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore 2024-09-12T00:39:59.591 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_onode 2024-09-12T00:39:59.591 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_odata 2024-09-12T00:39:59.591 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_omap 2024-09-12T00:39:59.591 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_tm 2024-09-12T00:39:59.591 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_t 2024-09-12T00:39:59.591 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:39:59.591 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_epm 2024-09-12T00:39:59.591 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_lba 2024-09-12T00:39:59.591 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:39:59.591 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cache 2024-09-12T00:39:59.591 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_journal 2024-09-12T00:39:59.591 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_device 2024-09-12T00:39:59.591 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_backref 2024-09-12T00:39:59.592 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 alienstore 2024-09-12T00:39:59.592 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mclock 2024-09-12T00:39:59.592 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cyanstore 2024-09-12T00:39:59.592 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 ceph_exporter 2024-09-12T00:39:59.592 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 memstore 2024-09-12T00:39:59.592 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 trace 2024-09-12T00:39:59.592 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 ceph_dedup 2024-09-12T00:39:59.592 INFO:tasks.workunit.client.0.smithi043.stderr: -2/-2 (syslog threshold) 2024-09-12T00:39:59.592 INFO:tasks.workunit.client.0.smithi043.stderr: 99/99 (stderr threshold) 2024-09-12T00:39:59.592 INFO:tasks.workunit.client.0.smithi043.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:39:59.592 INFO:tasks.workunit.client.0.smithi043.stderr: 7f5f037fe640 / http_manager 2024-09-12T00:39:59.592 INFO:tasks.workunit.client.0.smithi043.stderr: 7f5f91fdb640 / http_manager 2024-09-12T00:39:59.592 INFO:tasks.workunit.client.0.smithi043.stderr: 7f5f92fdd640 / rgw_dt_lg_renew 2024-09-12T00:39:59.593 INFO:tasks.workunit.client.0.smithi043.stderr: 7f5fb1ffb640 / ms_dispatch 2024-09-12T00:39:59.593 INFO:tasks.workunit.client.0.smithi043.stderr: 7f5fb37fe640 / io_context_pool 2024-09-12T00:39:59.593 INFO:tasks.workunit.client.0.smithi043.stderr: 7f5fc1ffb640 / ms_dispatch 2024-09-12T00:39:59.593 INFO:tasks.workunit.client.0.smithi043.stderr: 7f5fc8e09640 / ms_dispatch 2024-09-12T00:39:59.593 INFO:tasks.workunit.client.0.smithi043.stderr: 7f5fca60c640 / io_context_pool 2024-09-12T00:39:59.593 INFO:tasks.workunit.client.0.smithi043.stderr: 7f60dbbc5640 / msgr-worker-2 2024-09-12T00:39:59.593 INFO:tasks.workunit.client.0.smithi043.stderr: 7f60dc3c6640 / msgr-worker-1 2024-09-12T00:39:59.593 INFO:tasks.workunit.client.0.smithi043.stderr: 7f60dcbc7640 / msgr-worker-0 2024-09-12T00:39:59.593 INFO:tasks.workunit.client.0.smithi043.stderr: 7f60dd3c8640 / io_context_pool 2024-09-12T00:39:59.594 INFO:tasks.workunit.client.0.smithi043.stderr: 7f60de8c09c0 / radosgw-admin 2024-09-12T00:39:59.594 INFO:tasks.workunit.client.0.smithi043.stderr: max_recent 500 2024-09-12T00:39:59.594 INFO:tasks.workunit.client.0.smithi043.stderr: max_new 1000 2024-09-12T00:39:59.594 INFO:tasks.workunit.client.0.smithi043.stderr: log_file /var/log/ceph/ceph-client.admin.125088.log 2024-09-12T00:39:59.594 INFO:tasks.workunit.client.0.smithi043.stderr:--- end dump of recent events --- 2024-09-12T00:39:59.594 INFO:tasks.workunit.client.0.smithi043.stderr:--- begin dump of recent events --- 2024-09-12T00:39:59.594 INFO:tasks.workunit.client.0.smithi043.stderr: -499> 2024-09-12T00:39:59.196+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:59.594 INFO:tasks.workunit.client.0.smithi043.stderr: -498> 2024-09-12T00:39:59.196+0000 7f60dbbc5640 10 monclient(hunting): handle_auth_done global_id 7301 payload 274 2024-09-12T00:39:59.594 INFO:tasks.workunit.client.0.smithi043.stderr: -497> 2024-09-12T00:39:59.196+0000 7f60dbbc5640 10 monclient: _finish_hunting 0 2024-09-12T00:39:59.594 INFO:tasks.workunit.client.0.smithi043.stderr: -496> 2024-09-12T00:39:59.196+0000 7f60dbbc5640 1 monclient: found mon.noname-c 2024-09-12T00:39:59.594 INFO:tasks.workunit.client.0.smithi043.stderr: -495> 2024-09-12T00:39:59.196+0000 7f60dbbc5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:39:59.594 INFO:tasks.workunit.client.0.smithi043.stderr: -494> 2024-09-12T00:39:59.196+0000 7f5fca60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:59.594 INFO:tasks.workunit.client.0.smithi043.stderr: -493> 2024-09-12T00:39:59.196+0000 7f5fca60c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:39:59.595 INFO:tasks.workunit.client.0.smithi043.stderr: -492> 2024-09-12T00:39:59.196+0000 7f5fca60c640 10 monclient: dump: 2024-09-12T00:39:59.595 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:59.595 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:59.595 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.595 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.595 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:59.595 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:59.595 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:59.595 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:59.595 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:59.595 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.595 INFO:tasks.workunit.client.0.smithi043.stderr: -491> 2024-09-12T00:39:59.196+0000 7f5fca60c640 10 monclient: _finish_auth 0 2024-09-12T00:39:59.595 INFO:tasks.workunit.client.0.smithi043.stderr: -490> 2024-09-12T00:39:59.196+0000 7f5fca60c640 10 monclient: _check_auth_tickets 2024-09-12T00:39:59.596 INFO:tasks.workunit.client.0.smithi043.stderr: -489> 2024-09-12T00:39:59.196+0000 7f5fca60c640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:59.596 INFO:tasks.workunit.client.0.smithi043.stderr: -488> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 monclient: authenticate success, global_id 7301 2024-09-12T00:39:59.596 INFO:tasks.workunit.client.0.smithi043.stderr: -487> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 10 monclient: get_monmap_and_config success 2024-09-12T00:39:59.596 INFO:tasks.workunit.client.0.smithi043.stderr: -486> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 4 set_mon_vals no callback set 2024-09-12T00:39:59.596 INFO:tasks.workunit.client.0.smithi043.stderr: -485> 2024-09-12T00:39:59.196+0000 7f5fca60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:59.596 INFO:tasks.workunit.client.0.smithi043.stderr: -484> 2024-09-12T00:39:59.196+0000 7f5fca60c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:39:59.596 INFO:tasks.workunit.client.0.smithi043.stderr: -483> 2024-09-12T00:39:59.196+0000 7f5fca60c640 10 monclient: dump: 2024-09-12T00:39:59.596 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:59.596 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:59.596 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.596 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.596 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:59.596 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:59.597 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:59.597 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:59.597 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:59.597 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.597 INFO:tasks.workunit.client.0.smithi043.stderr: -482> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 10 monclient: shutdown 2024-09-12T00:39:59.597 INFO:tasks.workunit.client.0.smithi043.stderr: -481> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) unregister_commands rotate-key 2024-09-12T00:39:59.597 INFO:tasks.workunit.client.0.smithi043.stderr: -480> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 10 monclient: build_initial_monmap 2024-09-12T00:39:59.597 INFO:tasks.workunit.client.0.smithi043.stderr: -479> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:59.597 INFO:tasks.workunit.client.0.smithi043.stderr: -478> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 10 monclient: monmap: 2024-09-12T00:39:59.597 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:39:59.597 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:59.597 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:39:59.597 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:39:59.597 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:59.598 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:59.598 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:39:59.598 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:39:59.598 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:39:59.598 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.598 INFO:tasks.workunit.client.0.smithi043.stderr: -477> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d161044e0) adding auth protocol: cephx 2024-09-12T00:39:59.598 INFO:tasks.workunit.client.0.smithi043.stderr: -476> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d161044e0) adding auth protocol: cephx 2024-09-12T00:39:59.598 INFO:tasks.workunit.client.0.smithi043.stderr: -475> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d161044e0) adding auth protocol: cephx 2024-09-12T00:39:59.598 INFO:tasks.workunit.client.0.smithi043.stderr: -474> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d161044e0) adding con mode: secure 2024-09-12T00:39:59.598 INFO:tasks.workunit.client.0.smithi043.stderr: -473> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d161044e0) adding con mode: crc 2024-09-12T00:39:59.598 INFO:tasks.workunit.client.0.smithi043.stderr: -472> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d161044e0) adding con mode: secure 2024-09-12T00:39:59.598 INFO:tasks.workunit.client.0.smithi043.stderr: -471> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d161044e0) adding con mode: crc 2024-09-12T00:39:59.598 INFO:tasks.workunit.client.0.smithi043.stderr: -470> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d161044e0) adding con mode: secure 2024-09-12T00:39:59.599 INFO:tasks.workunit.client.0.smithi043.stderr: -469> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d161044e0) adding con mode: crc 2024-09-12T00:39:59.599 INFO:tasks.workunit.client.0.smithi043.stderr: -468> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d161044e0) adding con mode: crc 2024-09-12T00:39:59.599 INFO:tasks.workunit.client.0.smithi043.stderr: -467> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d161044e0) adding con mode: secure 2024-09-12T00:39:59.599 INFO:tasks.workunit.client.0.smithi043.stderr: -466> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d161044e0) adding con mode: crc 2024-09-12T00:39:59.599 INFO:tasks.workunit.client.0.smithi043.stderr: -465> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d161044e0) adding con mode: secure 2024-09-12T00:39:59.599 INFO:tasks.workunit.client.0.smithi043.stderr: -464> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d161044e0) adding con mode: crc 2024-09-12T00:39:59.599 INFO:tasks.workunit.client.0.smithi043.stderr: -463> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d161044e0) adding con mode: secure 2024-09-12T00:39:59.599 INFO:tasks.workunit.client.0.smithi043.stderr: -462> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:59.599 INFO:tasks.workunit.client.0.smithi043.stderr: -461> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 1 librados: starting msgr at 2024-09-12T00:39:59.599 INFO:tasks.workunit.client.0.smithi043.stderr: -460> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 1 librados: starting objecter 2024-09-12T00:39:59.599 INFO:tasks.workunit.client.0.smithi043.stderr: -459> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command objecter_requests hook 0x562d15f1db30 2024-09-12T00:39:59.599 INFO:tasks.workunit.client.0.smithi043.stderr: -458> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 1 librados: setting wanted keys 2024-09-12T00:39:59.600 INFO:tasks.workunit.client.0.smithi043.stderr: -457> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 1 librados: calling monclient init 2024-09-12T00:39:59.600 INFO:tasks.workunit.client.0.smithi043.stderr: -456> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 10 monclient: init 2024-09-12T00:39:59.600 INFO:tasks.workunit.client.0.smithi043.stderr: -455> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d160ff190) adding auth protocol: cephx 2024-09-12T00:39:59.600 INFO:tasks.workunit.client.0.smithi043.stderr: -454> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d160ff190) adding auth protocol: cephx 2024-09-12T00:39:59.600 INFO:tasks.workunit.client.0.smithi043.stderr: -453> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d160ff190) adding auth protocol: cephx 2024-09-12T00:39:59.600 INFO:tasks.workunit.client.0.smithi043.stderr: -452> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d160ff190) adding con mode: secure 2024-09-12T00:39:59.600 INFO:tasks.workunit.client.0.smithi043.stderr: -451> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d160ff190) adding con mode: crc 2024-09-12T00:39:59.601 INFO:tasks.workunit.client.0.smithi043.stderr: -450> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d160ff190) adding con mode: secure 2024-09-12T00:39:59.601 INFO:tasks.workunit.client.0.smithi043.stderr: -449> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d160ff190) adding con mode: crc 2024-09-12T00:39:59.601 INFO:tasks.workunit.client.0.smithi043.stderr: -448> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d160ff190) adding con mode: secure 2024-09-12T00:39:59.601 INFO:tasks.workunit.client.0.smithi043.stderr: -447> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d160ff190) adding con mode: crc 2024-09-12T00:39:59.601 INFO:tasks.workunit.client.0.smithi043.stderr: -446> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d160ff190) adding con mode: crc 2024-09-12T00:39:59.601 INFO:tasks.workunit.client.0.smithi043.stderr: -445> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d160ff190) adding con mode: secure 2024-09-12T00:39:59.601 INFO:tasks.workunit.client.0.smithi043.stderr: -444> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d160ff190) adding con mode: crc 2024-09-12T00:39:59.601 INFO:tasks.workunit.client.0.smithi043.stderr: -443> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d160ff190) adding con mode: secure 2024-09-12T00:39:59.601 INFO:tasks.workunit.client.0.smithi043.stderr: -442> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d160ff190) adding con mode: crc 2024-09-12T00:39:59.601 INFO:tasks.workunit.client.0.smithi043.stderr: -441> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 AuthRegistry(0x562d160ff190) adding con mode: secure 2024-09-12T00:39:59.601 INFO:tasks.workunit.client.0.smithi043.stderr: -440> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:59.601 INFO:tasks.workunit.client.0.smithi043.stderr: -439> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:59.601 INFO:tasks.workunit.client.0.smithi043.stderr: -438> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command rotate-key hook 0x562d160ff2d8 2024-09-12T00:39:59.602 INFO:tasks.workunit.client.0.smithi043.stderr: -437> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:59.602 INFO:tasks.workunit.client.0.smithi043.stderr: -436> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:39:59.602 INFO:tasks.workunit.client.0.smithi043.stderr: -435> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 10 monclient(hunting): picked mon.noname-c con 0x562d15f8e050 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:39:59.602 INFO:tasks.workunit.client.0.smithi043.stderr: -434> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 10 monclient(hunting): picked mon.noname-b con 0x562d15fb7460 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:39:59.602 INFO:tasks.workunit.client.0.smithi043.stderr: -433> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 10 monclient(hunting): picked mon.noname-a con 0x562d16105680 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:39:59.602 INFO:tasks.workunit.client.0.smithi043.stderr: -432> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:59.602 INFO:tasks.workunit.client.0.smithi043.stderr: -431> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:59.602 INFO:tasks.workunit.client.0.smithi043.stderr: -430> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:59.602 INFO:tasks.workunit.client.0.smithi043.stderr: -429> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:59.602 INFO:tasks.workunit.client.0.smithi043.stderr: -428> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 10 monclient(hunting): authenticate will time out at 2295.187104s 2024-09-12T00:39:59.602 INFO:tasks.workunit.client.0.smithi043.stderr: -427> 2024-09-12T00:39:59.196+0000 7f60dc3c6640 10 monclient(hunting): get_auth_request con 0x562d15f8e050 auth_method 0 2024-09-12T00:39:59.602 INFO:tasks.workunit.client.0.smithi043.stderr: -426> 2024-09-12T00:39:59.196+0000 7f60dc3c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:59.602 INFO:tasks.workunit.client.0.smithi043.stderr: -425> 2024-09-12T00:39:59.196+0000 7f60dc3c6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:59.603 INFO:tasks.workunit.client.0.smithi043.stderr: -424> 2024-09-12T00:39:59.196+0000 7f60dc3c6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:59.603 INFO:tasks.workunit.client.0.smithi043.stderr: -423> 2024-09-12T00:39:59.196+0000 7f60dcbc7640 10 monclient(hunting): get_auth_request con 0x562d16105680 auth_method 0 2024-09-12T00:39:59.603 INFO:tasks.workunit.client.0.smithi043.stderr: -422> 2024-09-12T00:39:59.196+0000 7f60dcbc7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:59.603 INFO:tasks.workunit.client.0.smithi043.stderr: -421> 2024-09-12T00:39:59.196+0000 7f60dcbc7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:59.603 INFO:tasks.workunit.client.0.smithi043.stderr: -420> 2024-09-12T00:39:59.196+0000 7f60dcbc7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:59.603 INFO:tasks.workunit.client.0.smithi043.stderr: -419> 2024-09-12T00:39:59.196+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:59.603 INFO:tasks.workunit.client.0.smithi043.stderr: -418> 2024-09-12T00:39:59.196+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:59.603 INFO:tasks.workunit.client.0.smithi043.stderr: -417> 2024-09-12T00:39:59.196+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:59.603 INFO:tasks.workunit.client.0.smithi043.stderr: -416> 2024-09-12T00:39:59.196+0000 7f60dcbc7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:59.603 INFO:tasks.workunit.client.0.smithi043.stderr: -415> 2024-09-12T00:39:59.196+0000 7f60dcbc7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:59.603 INFO:tasks.workunit.client.0.smithi043.stderr: -414> 2024-09-12T00:39:59.196+0000 7f60dcbc7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:59.603 INFO:tasks.workunit.client.0.smithi043.stderr: -413> 2024-09-12T00:39:59.196+0000 7f60dbbc5640 10 monclient(hunting): get_auth_request con 0x562d15fb7460 auth_method 0 2024-09-12T00:39:59.603 INFO:tasks.workunit.client.0.smithi043.stderr: -412> 2024-09-12T00:39:59.196+0000 7f60dbbc5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:59.603 INFO:tasks.workunit.client.0.smithi043.stderr: -411> 2024-09-12T00:39:59.196+0000 7f60dbbc5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:59.604 INFO:tasks.workunit.client.0.smithi043.stderr: -410> 2024-09-12T00:39:59.196+0000 7f60dbbc5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:59.604 INFO:tasks.workunit.client.0.smithi043.stderr: -409> 2024-09-12T00:39:59.196+0000 7f60dcbc7640 10 monclient(hunting): handle_auth_done global_id 7641 payload 824 2024-09-12T00:39:59.604 INFO:tasks.workunit.client.0.smithi043.stderr: -408> 2024-09-12T00:39:59.196+0000 7f60dcbc7640 10 monclient: _finish_hunting 0 2024-09-12T00:39:59.604 INFO:tasks.workunit.client.0.smithi043.stderr: -407> 2024-09-12T00:39:59.196+0000 7f60dcbc7640 1 monclient: found mon.noname-a 2024-09-12T00:39:59.604 INFO:tasks.workunit.client.0.smithi043.stderr: -406> 2024-09-12T00:39:59.196+0000 7f60dcbc7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:39:59.604 INFO:tasks.workunit.client.0.smithi043.stderr: -405> 2024-09-12T00:39:59.196+0000 7f5fc8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:59.604 INFO:tasks.workunit.client.0.smithi043.stderr: -404> 2024-09-12T00:39:59.196+0000 7f5fc8e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:39:59.604 INFO:tasks.workunit.client.0.smithi043.stderr: -403> 2024-09-12T00:39:59.196+0000 7f5fc8e09640 10 monclient: dump: 2024-09-12T00:39:59.604 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:59.604 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:59.604 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.604 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.604 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:59.605 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:59.605 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:59.605 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:59.605 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:59.605 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.605 INFO:tasks.workunit.client.0.smithi043.stderr: -402> 2024-09-12T00:39:59.196+0000 7f5fc8e09640 10 monclient: _finish_auth 0 2024-09-12T00:39:59.605 INFO:tasks.workunit.client.0.smithi043.stderr: -401> 2024-09-12T00:39:59.196+0000 7f5fc8e09640 10 monclient: _check_auth_tickets 2024-09-12T00:39:59.605 INFO:tasks.workunit.client.0.smithi043.stderr: -400> 2024-09-12T00:39:59.196+0000 7f5fc8e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:59.605 INFO:tasks.workunit.client.0.smithi043.stderr: -399> 2024-09-12T00:39:59.196+0000 7f5fc8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:59.605 INFO:tasks.workunit.client.0.smithi043.stderr: -398> 2024-09-12T00:39:59.196+0000 7f5fc8e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:59.605 INFO:tasks.workunit.client.0.smithi043.stderr: -397> 2024-09-12T00:39:59.196+0000 7f5fc8e09640 10 monclient: dump: 2024-09-12T00:39:59.605 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:59.605 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:59.606 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.606 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.606 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:59.606 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:59.606 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:59.606 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:59.606 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:59.606 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.606 INFO:tasks.workunit.client.0.smithi043.stderr: -396> 2024-09-12T00:39:59.196+0000 7f60de8c09c0 5 monclient: authenticate success, global_id 7641 2024-09-12T00:39:59.606 INFO:tasks.workunit.client.0.smithi043.stderr: -395> 2024-09-12T00:39:59.200+0000 7f60de8c09c0 10 monclient: _renew_subs 2024-09-12T00:39:59.606 INFO:tasks.workunit.client.0.smithi043.stderr: -394> 2024-09-12T00:39:59.200+0000 7f60de8c09c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:39:59.606 INFO:tasks.workunit.client.0.smithi043.stderr: -393> 2024-09-12T00:39:59.196+0000 7f5fca60c640 4 set_mon_vals no callback set 2024-09-12T00:39:59.606 INFO:tasks.workunit.client.0.smithi043.stderr: -392> 2024-09-12T00:39:59.200+0000 7f60de8c09c0 10 monclient: _renew_subs 2024-09-12T00:39:59.607 INFO:tasks.workunit.client.0.smithi043.stderr: -391> 2024-09-12T00:39:59.200+0000 7f60de8c09c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:39:59.607 INFO:tasks.workunit.client.0.smithi043.stderr: -390> 2024-09-12T00:39:59.200+0000 7f60de8c09c0 1 librados: init done 2024-09-12T00:39:59.607 INFO:tasks.workunit.client.0.smithi043.stderr: -389> 2024-09-12T00:39:59.200+0000 7f5fc8e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:59.607 INFO:tasks.workunit.client.0.smithi043.stderr: -388> 2024-09-12T00:39:59.200+0000 7f5fc8e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:39:59.607 INFO:tasks.workunit.client.0.smithi043.stderr: -387> 2024-09-12T00:39:59.200+0000 7f5fc8e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:39:59.607 INFO:tasks.workunit.client.0.smithi043.stderr: -386> 2024-09-12T00:39:59.200+0000 7f60dc3c6640 10 monclient: get_auth_request con 0x7f5fc4070ae0 auth_method 0 2024-09-12T00:39:59.607 INFO:tasks.workunit.client.0.smithi043.stderr: -385> 2024-09-12T00:39:59.200+0000 7f60dbbc5640 10 monclient: get_auth_request con 0x562d16128170 auth_method 0 2024-09-12T00:39:59.607 INFO:tasks.workunit.client.0.smithi043.stderr: -384> 2024-09-12T00:39:59.200+0000 7f60dc3c6640 10 monclient: get_auth_request con 0x562d1614a080 auth_method 0 2024-09-12T00:39:59.607 INFO:tasks.workunit.client.0.smithi043.stderr: -383> 2024-09-12T00:39:59.204+0000 7f60dbbc5640 10 monclient: get_auth_request con 0x562d1614e270 auth_method 0 2024-09-12T00:39:59.607 INFO:tasks.workunit.client.0.smithi043.stderr: -382> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 10 monclient: build_initial_monmap 2024-09-12T00:39:59.607 INFO:tasks.workunit.client.0.smithi043.stderr: -381> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:59.607 INFO:tasks.workunit.client.0.smithi043.stderr: -380> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 10 monclient: monmap: 2024-09-12T00:39:59.607 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:39:59.607 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:59.608 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:39:59.608 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:39:59.608 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:59.608 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:59.608 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:39:59.608 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:39:59.608 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:39:59.608 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.608 INFO:tasks.workunit.client.0.smithi043.stderr: -379> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 AuthRegistry(0x562d16152fc0) adding auth protocol: cephx 2024-09-12T00:39:59.608 INFO:tasks.workunit.client.0.smithi043.stderr: -378> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 AuthRegistry(0x562d16152fc0) adding auth protocol: cephx 2024-09-12T00:39:59.608 INFO:tasks.workunit.client.0.smithi043.stderr: -377> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 AuthRegistry(0x562d16152fc0) adding auth protocol: cephx 2024-09-12T00:39:59.608 INFO:tasks.workunit.client.0.smithi043.stderr: -376> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 AuthRegistry(0x562d16152fc0) adding con mode: secure 2024-09-12T00:39:59.609 INFO:tasks.workunit.client.0.smithi043.stderr: -375> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 AuthRegistry(0x562d16152fc0) adding con mode: crc 2024-09-12T00:39:59.609 INFO:tasks.workunit.client.0.smithi043.stderr: -374> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 AuthRegistry(0x562d16152fc0) adding con mode: secure 2024-09-12T00:39:59.609 INFO:tasks.workunit.client.0.smithi043.stderr: -373> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 AuthRegistry(0x562d16152fc0) adding con mode: crc 2024-09-12T00:39:59.609 INFO:tasks.workunit.client.0.smithi043.stderr: -372> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 AuthRegistry(0x562d16152fc0) adding con mode: secure 2024-09-12T00:39:59.609 INFO:tasks.workunit.client.0.smithi043.stderr: -371> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 AuthRegistry(0x562d16152fc0) adding con mode: crc 2024-09-12T00:39:59.609 INFO:tasks.workunit.client.0.smithi043.stderr: -370> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 AuthRegistry(0x562d16152fc0) adding con mode: crc 2024-09-12T00:39:59.609 INFO:tasks.workunit.client.0.smithi043.stderr: -369> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 AuthRegistry(0x562d16152fc0) adding con mode: secure 2024-09-12T00:39:59.609 INFO:tasks.workunit.client.0.smithi043.stderr: -368> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 AuthRegistry(0x562d16152fc0) adding con mode: crc 2024-09-12T00:39:59.609 INFO:tasks.workunit.client.0.smithi043.stderr: -367> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 AuthRegistry(0x562d16152fc0) adding con mode: secure 2024-09-12T00:39:59.609 INFO:tasks.workunit.client.0.smithi043.stderr: -366> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 AuthRegistry(0x562d16152fc0) adding con mode: crc 2024-09-12T00:39:59.609 INFO:tasks.workunit.client.0.smithi043.stderr: -365> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 AuthRegistry(0x562d16152fc0) adding con mode: secure 2024-09-12T00:39:59.609 INFO:tasks.workunit.client.0.smithi043.stderr: -364> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:59.609 INFO:tasks.workunit.client.0.smithi043.stderr: -363> 2024-09-12T00:39:59.204+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command objecter_requests cmddesc objecter_requests hook 0x562d16156970 EEXIST 2024-09-12T00:39:59.610 INFO:tasks.workunit.client.0.smithi043.stderr: -362> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 10 monclient: init 2024-09-12T00:39:59.610 INFO:tasks.workunit.client.0.smithi043.stderr: -361> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 AuthRegistry(0x562d16151698) adding auth protocol: cephx 2024-09-12T00:39:59.610 INFO:tasks.workunit.client.0.smithi043.stderr: -360> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 AuthRegistry(0x562d16151698) adding auth protocol: cephx 2024-09-12T00:39:59.610 INFO:tasks.workunit.client.0.smithi043.stderr: -359> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 AuthRegistry(0x562d16151698) adding auth protocol: cephx 2024-09-12T00:39:59.610 INFO:tasks.workunit.client.0.smithi043.stderr: -358> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 AuthRegistry(0x562d16151698) adding con mode: secure 2024-09-12T00:39:59.610 INFO:tasks.workunit.client.0.smithi043.stderr: -357> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 AuthRegistry(0x562d16151698) adding con mode: crc 2024-09-12T00:39:59.610 INFO:tasks.workunit.client.0.smithi043.stderr: -356> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 AuthRegistry(0x562d16151698) adding con mode: secure 2024-09-12T00:39:59.610 INFO:tasks.workunit.client.0.smithi043.stderr: -355> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 AuthRegistry(0x562d16151698) adding con mode: crc 2024-09-12T00:39:59.610 INFO:tasks.workunit.client.0.smithi043.stderr: -354> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 AuthRegistry(0x562d16151698) adding con mode: secure 2024-09-12T00:39:59.610 INFO:tasks.workunit.client.0.smithi043.stderr: -353> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 AuthRegistry(0x562d16151698) adding con mode: crc 2024-09-12T00:39:59.610 INFO:tasks.workunit.client.0.smithi043.stderr: -352> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 AuthRegistry(0x562d16151698) adding con mode: crc 2024-09-12T00:39:59.610 INFO:tasks.workunit.client.0.smithi043.stderr: -351> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 AuthRegistry(0x562d16151698) adding con mode: secure 2024-09-12T00:39:59.611 INFO:tasks.workunit.client.0.smithi043.stderr: -350> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 AuthRegistry(0x562d16151698) adding con mode: crc 2024-09-12T00:39:59.611 INFO:tasks.workunit.client.0.smithi043.stderr: -349> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 AuthRegistry(0x562d16151698) adding con mode: secure 2024-09-12T00:39:59.611 INFO:tasks.workunit.client.0.smithi043.stderr: -348> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 AuthRegistry(0x562d16151698) adding con mode: crc 2024-09-12T00:39:59.611 INFO:tasks.workunit.client.0.smithi043.stderr: -347> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 AuthRegistry(0x562d16151698) adding con mode: secure 2024-09-12T00:39:59.611 INFO:tasks.workunit.client.0.smithi043.stderr: -346> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:59.611 INFO:tasks.workunit.client.0.smithi043.stderr: -345> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:59.611 INFO:tasks.workunit.client.0.smithi043.stderr: -344> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command rotate-key cmddesc rotate-key hook 0x562d161517e0 EEXIST 2024-09-12T00:39:59.611 INFO:tasks.workunit.client.0.smithi043.stderr: -343> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:59.611 INFO:tasks.workunit.client.0.smithi043.stderr: -342> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:39:59.611 INFO:tasks.workunit.client.0.smithi043.stderr: -341> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 10 monclient(hunting): picked mon.noname-a con 0x562d1617ab20 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:39:59.611 INFO:tasks.workunit.client.0.smithi043.stderr: -340> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 10 monclient(hunting): picked mon.noname-c con 0x562d1617a450 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:39:59.611 INFO:tasks.workunit.client.0.smithi043.stderr: -339> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 10 monclient(hunting): picked mon.noname-b con 0x562d16178e30 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:39:59.611 INFO:tasks.workunit.client.0.smithi043.stderr: -338> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:59.612 INFO:tasks.workunit.client.0.smithi043.stderr: -337> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:59.612 INFO:tasks.workunit.client.0.smithi043.stderr: -336> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:59.612 INFO:tasks.workunit.client.0.smithi043.stderr: -335> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:59.612 INFO:tasks.workunit.client.0.smithi043.stderr: -334> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 10 monclient(hunting): authenticate will time out at 2295.196678s 2024-09-12T00:39:59.612 INFO:tasks.workunit.client.0.smithi043.stderr: -333> 2024-09-12T00:39:59.208+0000 7f60dc3c6640 10 monclient(hunting): get_auth_request con 0x562d1617ab20 auth_method 0 2024-09-12T00:39:59.612 INFO:tasks.workunit.client.0.smithi043.stderr: -332> 2024-09-12T00:39:59.208+0000 7f60dc3c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:59.612 INFO:tasks.workunit.client.0.smithi043.stderr: -331> 2024-09-12T00:39:59.208+0000 7f60dc3c6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:59.612 INFO:tasks.workunit.client.0.smithi043.stderr: -330> 2024-09-12T00:39:59.208+0000 7f60dc3c6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:59.612 INFO:tasks.workunit.client.0.smithi043.stderr: -329> 2024-09-12T00:39:59.208+0000 7f60dbbc5640 10 monclient(hunting): get_auth_request con 0x562d1617a450 auth_method 0 2024-09-12T00:39:59.612 INFO:tasks.workunit.client.0.smithi043.stderr: -328> 2024-09-12T00:39:59.208+0000 7f60dbbc5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:59.612 INFO:tasks.workunit.client.0.smithi043.stderr: -327> 2024-09-12T00:39:59.208+0000 7f60dbbc5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:59.612 INFO:tasks.workunit.client.0.smithi043.stderr: -326> 2024-09-12T00:39:59.208+0000 7f60dbbc5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:59.612 INFO:tasks.workunit.client.0.smithi043.stderr: -325> 2024-09-12T00:39:59.208+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:59.613 INFO:tasks.workunit.client.0.smithi043.stderr: -324> 2024-09-12T00:39:59.208+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:59.613 INFO:tasks.workunit.client.0.smithi043.stderr: -323> 2024-09-12T00:39:59.208+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:59.613 INFO:tasks.workunit.client.0.smithi043.stderr: -322> 2024-09-12T00:39:59.208+0000 7f60dbbc5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:59.613 INFO:tasks.workunit.client.0.smithi043.stderr: -321> 2024-09-12T00:39:59.208+0000 7f60dbbc5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:59.613 INFO:tasks.workunit.client.0.smithi043.stderr: -320> 2024-09-12T00:39:59.208+0000 7f60dbbc5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:59.613 INFO:tasks.workunit.client.0.smithi043.stderr: -319> 2024-09-12T00:39:59.208+0000 7f60dcbc7640 10 monclient(hunting): get_auth_request con 0x562d16178e30 auth_method 0 2024-09-12T00:39:59.613 INFO:tasks.workunit.client.0.smithi043.stderr: -318> 2024-09-12T00:39:59.208+0000 7f60dcbc7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:59.613 INFO:tasks.workunit.client.0.smithi043.stderr: -317> 2024-09-12T00:39:59.208+0000 7f60dcbc7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:59.613 INFO:tasks.workunit.client.0.smithi043.stderr: -316> 2024-09-12T00:39:59.208+0000 7f60dcbc7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:59.613 INFO:tasks.workunit.client.0.smithi043.stderr: -315> 2024-09-12T00:39:59.208+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_done global_id 7644 payload 824 2024-09-12T00:39:59.613 INFO:tasks.workunit.client.0.smithi043.stderr: -314> 2024-09-12T00:39:59.208+0000 7f60dc3c6640 10 monclient: _finish_hunting 0 2024-09-12T00:39:59.613 INFO:tasks.workunit.client.0.smithi043.stderr: -313> 2024-09-12T00:39:59.208+0000 7f60dc3c6640 1 monclient: found mon.noname-a 2024-09-12T00:39:59.613 INFO:tasks.workunit.client.0.smithi043.stderr: -312> 2024-09-12T00:39:59.208+0000 7f60dc3c6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:39:59.614 INFO:tasks.workunit.client.0.smithi043.stderr: -311> 2024-09-12T00:39:59.208+0000 7f5fc1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:59.614 INFO:tasks.workunit.client.0.smithi043.stderr: -310> 2024-09-12T00:39:59.208+0000 7f5fc1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:39:59.614 INFO:tasks.workunit.client.0.smithi043.stderr: -309> 2024-09-12T00:39:59.208+0000 7f5fc1ffb640 10 monclient: dump: 2024-09-12T00:39:59.614 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:59.614 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:59.614 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.614 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.614 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:59.614 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:59.614 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:59.614 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:59.615 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:59.615 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.615 INFO:tasks.workunit.client.0.smithi043.stderr: -308> 2024-09-12T00:39:59.208+0000 7f5fc1ffb640 10 monclient: _finish_auth 0 2024-09-12T00:39:59.615 INFO:tasks.workunit.client.0.smithi043.stderr: -307> 2024-09-12T00:39:59.208+0000 7f5fc1ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:39:59.615 INFO:tasks.workunit.client.0.smithi043.stderr: -306> 2024-09-12T00:39:59.208+0000 7f5fc1ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:59.615 INFO:tasks.workunit.client.0.smithi043.stderr: -305> 2024-09-12T00:39:59.208+0000 7f5fc1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:59.615 INFO:tasks.workunit.client.0.smithi043.stderr: -304> 2024-09-12T00:39:59.208+0000 7f5fc1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:59.616 INFO:tasks.workunit.client.0.smithi043.stderr: -303> 2024-09-12T00:39:59.208+0000 7f5fc1ffb640 10 monclient: dump: 2024-09-12T00:39:59.616 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:59.616 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:59.616 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.616 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.616 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:59.616 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:59.616 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:59.616 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:59.616 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:59.617 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.617 INFO:tasks.workunit.client.0.smithi043.stderr: -302> 2024-09-12T00:39:59.208+0000 7f60dd3c8640 4 set_mon_vals no callback set 2024-09-12T00:39:59.617 INFO:tasks.workunit.client.0.smithi043.stderr: -301> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 5 monclient: authenticate success, global_id 7644 2024-09-12T00:39:59.617 INFO:tasks.workunit.client.0.smithi043.stderr: -300> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 10 monclient: _renew_subs 2024-09-12T00:39:59.617 INFO:tasks.workunit.client.0.smithi043.stderr: -299> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:39:59.617 INFO:tasks.workunit.client.0.smithi043.stderr: -298> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 10 monclient: _renew_subs 2024-09-12T00:39:59.617 INFO:tasks.workunit.client.0.smithi043.stderr: -297> 2024-09-12T00:39:59.208+0000 7f60de8c09c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:39:59.617 INFO:tasks.workunit.client.0.smithi043.stderr: -296> 2024-09-12T00:39:59.212+0000 7f5fc1ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:59.617 INFO:tasks.workunit.client.0.smithi043.stderr: -295> 2024-09-12T00:39:59.212+0000 7f5fc1ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:39:59.617 INFO:tasks.workunit.client.0.smithi043.stderr: -294> 2024-09-12T00:39:59.212+0000 7f5fc1ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:39:59.617 INFO:tasks.workunit.client.0.smithi043.stderr: -293> 2024-09-12T00:39:59.212+0000 7f60dbbc5640 10 monclient: get_auth_request con 0x7f5fb4070a20 auth_method 0 2024-09-12T00:39:59.617 INFO:tasks.workunit.client.0.smithi043.stderr: -292> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient: get_monmap_and_config 2024-09-12T00:39:59.618 INFO:tasks.workunit.client.0.smithi043.stderr: -291> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient: build_initial_monmap 2024-09-12T00:39:59.618 INFO:tasks.workunit.client.0.smithi043.stderr: -290> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:59.618 INFO:tasks.workunit.client.0.smithi043.stderr: -289> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient: monmap: 2024-09-12T00:39:59.618 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:39:59.618 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:59.618 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:39:59.618 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:39:59.618 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:59.618 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:59.618 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:39:59.618 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:39:59.618 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:39:59.618 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.619 INFO:tasks.workunit.client.0.smithi043.stderr: -288> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1619a4b0) adding auth protocol: cephx 2024-09-12T00:39:59.619 INFO:tasks.workunit.client.0.smithi043.stderr: -287> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1619a4b0) adding auth protocol: cephx 2024-09-12T00:39:59.619 INFO:tasks.workunit.client.0.smithi043.stderr: -286> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1619a4b0) adding auth protocol: cephx 2024-09-12T00:39:59.619 INFO:tasks.workunit.client.0.smithi043.stderr: -285> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1619a4b0) adding con mode: secure 2024-09-12T00:39:59.619 INFO:tasks.workunit.client.0.smithi043.stderr: -284> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1619a4b0) adding con mode: crc 2024-09-12T00:39:59.619 INFO:tasks.workunit.client.0.smithi043.stderr: -283> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1619a4b0) adding con mode: secure 2024-09-12T00:39:59.619 INFO:tasks.workunit.client.0.smithi043.stderr: -282> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1619a4b0) adding con mode: crc 2024-09-12T00:39:59.619 INFO:tasks.workunit.client.0.smithi043.stderr: -281> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1619a4b0) adding con mode: secure 2024-09-12T00:39:59.619 INFO:tasks.workunit.client.0.smithi043.stderr: -280> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1619a4b0) adding con mode: crc 2024-09-12T00:39:59.619 INFO:tasks.workunit.client.0.smithi043.stderr: -279> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1619a4b0) adding con mode: crc 2024-09-12T00:39:59.619 INFO:tasks.workunit.client.0.smithi043.stderr: -278> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1619a4b0) adding con mode: secure 2024-09-12T00:39:59.619 INFO:tasks.workunit.client.0.smithi043.stderr: -277> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1619a4b0) adding con mode: crc 2024-09-12T00:39:59.620 INFO:tasks.workunit.client.0.smithi043.stderr: -276> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1619a4b0) adding con mode: secure 2024-09-12T00:39:59.620 INFO:tasks.workunit.client.0.smithi043.stderr: -275> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1619a4b0) adding con mode: crc 2024-09-12T00:39:59.620 INFO:tasks.workunit.client.0.smithi043.stderr: -274> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1619a4b0) adding con mode: secure 2024-09-12T00:39:59.620 INFO:tasks.workunit.client.0.smithi043.stderr: -273> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:59.620 INFO:tasks.workunit.client.0.smithi043.stderr: -272> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient: init 2024-09-12T00:39:59.620 INFO:tasks.workunit.client.0.smithi043.stderr: -271> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd260096a0) adding auth protocol: cephx 2024-09-12T00:39:59.620 INFO:tasks.workunit.client.0.smithi043.stderr: -270> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd260096a0) adding auth protocol: cephx 2024-09-12T00:39:59.620 INFO:tasks.workunit.client.0.smithi043.stderr: -269> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd260096a0) adding auth protocol: cephx 2024-09-12T00:39:59.620 INFO:tasks.workunit.client.0.smithi043.stderr: -268> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd260096a0) adding con mode: secure 2024-09-12T00:39:59.621 INFO:tasks.workunit.client.0.smithi043.stderr: -267> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd260096a0) adding con mode: crc 2024-09-12T00:39:59.621 INFO:tasks.workunit.client.0.smithi043.stderr: -266> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd260096a0) adding con mode: secure 2024-09-12T00:39:59.621 INFO:tasks.workunit.client.0.smithi043.stderr: -265> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd260096a0) adding con mode: crc 2024-09-12T00:39:59.621 INFO:tasks.workunit.client.0.smithi043.stderr: -264> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd260096a0) adding con mode: secure 2024-09-12T00:39:59.621 INFO:tasks.workunit.client.0.smithi043.stderr: -263> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd260096a0) adding con mode: crc 2024-09-12T00:39:59.621 INFO:tasks.workunit.client.0.smithi043.stderr: -262> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd260096a0) adding con mode: crc 2024-09-12T00:39:59.621 INFO:tasks.workunit.client.0.smithi043.stderr: -261> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd260096a0) adding con mode: secure 2024-09-12T00:39:59.621 INFO:tasks.workunit.client.0.smithi043.stderr: -260> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd260096a0) adding con mode: crc 2024-09-12T00:39:59.621 INFO:tasks.workunit.client.0.smithi043.stderr: -259> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd260096a0) adding con mode: secure 2024-09-12T00:39:59.621 INFO:tasks.workunit.client.0.smithi043.stderr: -258> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd260096a0) adding con mode: crc 2024-09-12T00:39:59.621 INFO:tasks.workunit.client.0.smithi043.stderr: -257> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd260096a0) adding con mode: secure 2024-09-12T00:39:59.621 INFO:tasks.workunit.client.0.smithi043.stderr: -256> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:59.622 INFO:tasks.workunit.client.0.smithi043.stderr: -255> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:59.622 INFO:tasks.workunit.client.0.smithi043.stderr: -254> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd260097e8 EEXIST 2024-09-12T00:39:59.622 INFO:tasks.workunit.client.0.smithi043.stderr: -253> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:59.622 INFO:tasks.workunit.client.0.smithi043.stderr: -252> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:39:59.622 INFO:tasks.workunit.client.0.smithi043.stderr: -251> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient(hunting): picked mon.noname-c con 0x562d161c8aa0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:39:59.622 INFO:tasks.workunit.client.0.smithi043.stderr: -250> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient(hunting): picked mon.noname-b con 0x562d161c8e80 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:39:59.622 INFO:tasks.workunit.client.0.smithi043.stderr: -249> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient(hunting): picked mon.noname-a con 0x562d161ca340 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:39:59.622 INFO:tasks.workunit.client.0.smithi043.stderr: -248> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:59.622 INFO:tasks.workunit.client.0.smithi043.stderr: -247> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:59.622 INFO:tasks.workunit.client.0.smithi043.stderr: -246> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:59.622 INFO:tasks.workunit.client.0.smithi043.stderr: -245> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:59.622 INFO:tasks.workunit.client.0.smithi043.stderr: -244> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient(hunting): authenticate will time out at 2295.201460s 2024-09-12T00:39:59.622 INFO:tasks.workunit.client.0.smithi043.stderr: -243> 2024-09-12T00:39:59.212+0000 7f60dc3c6640 10 monclient(hunting): get_auth_request con 0x562d161c8aa0 auth_method 0 2024-09-12T00:39:59.623 INFO:tasks.workunit.client.0.smithi043.stderr: -242> 2024-09-12T00:39:59.212+0000 7f60dc3c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:59.623 INFO:tasks.workunit.client.0.smithi043.stderr: -241> 2024-09-12T00:39:59.212+0000 7f60dc3c6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:59.623 INFO:tasks.workunit.client.0.smithi043.stderr: -240> 2024-09-12T00:39:59.212+0000 7f60dc3c6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:59.623 INFO:tasks.workunit.client.0.smithi043.stderr: -239> 2024-09-12T00:39:59.212+0000 7f60dcbc7640 10 monclient(hunting): get_auth_request con 0x562d161ca340 auth_method 0 2024-09-12T00:39:59.623 INFO:tasks.workunit.client.0.smithi043.stderr: -238> 2024-09-12T00:39:59.212+0000 7f60dcbc7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:59.623 INFO:tasks.workunit.client.0.smithi043.stderr: -237> 2024-09-12T00:39:59.212+0000 7f60dcbc7640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:59.623 INFO:tasks.workunit.client.0.smithi043.stderr: -236> 2024-09-12T00:39:59.212+0000 7f60dcbc7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:59.623 INFO:tasks.workunit.client.0.smithi043.stderr: -235> 2024-09-12T00:39:59.212+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:59.623 INFO:tasks.workunit.client.0.smithi043.stderr: -234> 2024-09-12T00:39:59.212+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:59.623 INFO:tasks.workunit.client.0.smithi043.stderr: -233> 2024-09-12T00:39:59.212+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:59.623 INFO:tasks.workunit.client.0.smithi043.stderr: -232> 2024-09-12T00:39:59.212+0000 7f60dcbc7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:59.623 INFO:tasks.workunit.client.0.smithi043.stderr: -231> 2024-09-12T00:39:59.212+0000 7f60dcbc7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:59.624 INFO:tasks.workunit.client.0.smithi043.stderr: -230> 2024-09-12T00:39:59.212+0000 7f60dcbc7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:59.624 INFO:tasks.workunit.client.0.smithi043.stderr: -229> 2024-09-12T00:39:59.212+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_done global_id 7310 payload 274 2024-09-12T00:39:59.624 INFO:tasks.workunit.client.0.smithi043.stderr: -228> 2024-09-12T00:39:59.212+0000 7f60dc3c6640 10 monclient: _finish_hunting 0 2024-09-12T00:39:59.624 INFO:tasks.workunit.client.0.smithi043.stderr: -227> 2024-09-12T00:39:59.212+0000 7f60dc3c6640 1 monclient: found mon.noname-c 2024-09-12T00:39:59.624 INFO:tasks.workunit.client.0.smithi043.stderr: -226> 2024-09-12T00:39:59.212+0000 7f60dc3c6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:39:59.624 INFO:tasks.workunit.client.0.smithi043.stderr: -225> 2024-09-12T00:39:59.212+0000 7f5fb37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:59.624 INFO:tasks.workunit.client.0.smithi043.stderr: -224> 2024-09-12T00:39:59.212+0000 7f5fb37fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:39:59.624 INFO:tasks.workunit.client.0.smithi043.stderr: -223> 2024-09-12T00:39:59.212+0000 7f5fb37fe640 10 monclient: dump: 2024-09-12T00:39:59.624 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:59.624 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:59.624 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.624 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.625 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:59.625 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:59.625 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:59.625 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:59.625 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:59.625 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.625 INFO:tasks.workunit.client.0.smithi043.stderr: -222> 2024-09-12T00:39:59.212+0000 7f5fb37fe640 10 monclient: _finish_auth 0 2024-09-12T00:39:59.625 INFO:tasks.workunit.client.0.smithi043.stderr: -221> 2024-09-12T00:39:59.212+0000 7f5fb37fe640 10 monclient: _check_auth_tickets 2024-09-12T00:39:59.625 INFO:tasks.workunit.client.0.smithi043.stderr: -220> 2024-09-12T00:39:59.212+0000 7f5fb37fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:59.625 INFO:tasks.workunit.client.0.smithi043.stderr: -219> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 monclient: authenticate success, global_id 7310 2024-09-12T00:39:59.625 INFO:tasks.workunit.client.0.smithi043.stderr: -218> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient: get_monmap_and_config success 2024-09-12T00:39:59.625 INFO:tasks.workunit.client.0.smithi043.stderr: -217> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 4 set_mon_vals no callback set 2024-09-12T00:39:59.626 INFO:tasks.workunit.client.0.smithi043.stderr: -216> 2024-09-12T00:39:59.212+0000 7f5fb37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:59.626 INFO:tasks.workunit.client.0.smithi043.stderr: -215> 2024-09-12T00:39:59.212+0000 7f5fb37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:39:59.626 INFO:tasks.workunit.client.0.smithi043.stderr: -214> 2024-09-12T00:39:59.212+0000 7f5fb37fe640 10 monclient: dump: 2024-09-12T00:39:59.626 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:59.626 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:59.626 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.626 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.626 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:59.626 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:59.626 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:59.626 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:59.626 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:59.626 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.627 INFO:tasks.workunit.client.0.smithi043.stderr: -213> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient: shutdown 2024-09-12T00:39:59.627 INFO:tasks.workunit.client.0.smithi043.stderr: -212> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient: build_initial_monmap 2024-09-12T00:39:59.627 INFO:tasks.workunit.client.0.smithi043.stderr: -211> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:59.627 INFO:tasks.workunit.client.0.smithi043.stderr: -210> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient: monmap: 2024-09-12T00:39:59.627 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:39:59.627 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:59.627 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:39:59.627 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:39:59.627 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:59.627 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:59.627 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:39:59.627 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:39:59.627 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:39:59.628 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.628 INFO:tasks.workunit.client.0.smithi043.stderr: -209> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d161ce180) adding auth protocol: cephx 2024-09-12T00:39:59.628 INFO:tasks.workunit.client.0.smithi043.stderr: -208> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d161ce180) adding auth protocol: cephx 2024-09-12T00:39:59.628 INFO:tasks.workunit.client.0.smithi043.stderr: -207> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d161ce180) adding auth protocol: cephx 2024-09-12T00:39:59.628 INFO:tasks.workunit.client.0.smithi043.stderr: -206> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d161ce180) adding con mode: secure 2024-09-12T00:39:59.628 INFO:tasks.workunit.client.0.smithi043.stderr: -205> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d161ce180) adding con mode: crc 2024-09-12T00:39:59.628 INFO:tasks.workunit.client.0.smithi043.stderr: -204> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d161ce180) adding con mode: secure 2024-09-12T00:39:59.628 INFO:tasks.workunit.client.0.smithi043.stderr: -203> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d161ce180) adding con mode: crc 2024-09-12T00:39:59.628 INFO:tasks.workunit.client.0.smithi043.stderr: -202> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d161ce180) adding con mode: secure 2024-09-12T00:39:59.628 INFO:tasks.workunit.client.0.smithi043.stderr: -201> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d161ce180) adding con mode: crc 2024-09-12T00:39:59.628 INFO:tasks.workunit.client.0.smithi043.stderr: -200> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d161ce180) adding con mode: crc 2024-09-12T00:39:59.628 INFO:tasks.workunit.client.0.smithi043.stderr: -199> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d161ce180) adding con mode: secure 2024-09-12T00:39:59.628 INFO:tasks.workunit.client.0.smithi043.stderr: -198> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d161ce180) adding con mode: crc 2024-09-12T00:39:59.629 INFO:tasks.workunit.client.0.smithi043.stderr: -197> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d161ce180) adding con mode: secure 2024-09-12T00:39:59.629 INFO:tasks.workunit.client.0.smithi043.stderr: -196> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d161ce180) adding con mode: crc 2024-09-12T00:39:59.629 INFO:tasks.workunit.client.0.smithi043.stderr: -195> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d161ce180) adding con mode: secure 2024-09-12T00:39:59.629 INFO:tasks.workunit.client.0.smithi043.stderr: -194> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:59.629 INFO:tasks.workunit.client.0.smithi043.stderr: -193> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 1 librados: starting msgr at 2024-09-12T00:39:59.629 INFO:tasks.workunit.client.0.smithi043.stderr: -192> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 1 librados: starting objecter 2024-09-12T00:39:59.629 INFO:tasks.workunit.client.0.smithi043.stderr: -191> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command objecter_requests cmddesc objecter_requests hook 0x562d161a08e0 EEXIST 2024-09-12T00:39:59.629 INFO:tasks.workunit.client.0.smithi043.stderr: -190> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 1 librados: setting wanted keys 2024-09-12T00:39:59.629 INFO:tasks.workunit.client.0.smithi043.stderr: -189> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 1 librados: calling monclient init 2024-09-12T00:39:59.629 INFO:tasks.workunit.client.0.smithi043.stderr: -188> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 10 monclient: init 2024-09-12T00:39:59.629 INFO:tasks.workunit.client.0.smithi043.stderr: -187> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1617c940) adding auth protocol: cephx 2024-09-12T00:39:59.629 INFO:tasks.workunit.client.0.smithi043.stderr: -186> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1617c940) adding auth protocol: cephx 2024-09-12T00:39:59.629 INFO:tasks.workunit.client.0.smithi043.stderr: -185> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1617c940) adding auth protocol: cephx 2024-09-12T00:39:59.630 INFO:tasks.workunit.client.0.smithi043.stderr: -184> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1617c940) adding con mode: secure 2024-09-12T00:39:59.630 INFO:tasks.workunit.client.0.smithi043.stderr: -183> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1617c940) adding con mode: crc 2024-09-12T00:39:59.630 INFO:tasks.workunit.client.0.smithi043.stderr: -182> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1617c940) adding con mode: secure 2024-09-12T00:39:59.630 INFO:tasks.workunit.client.0.smithi043.stderr: -181> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1617c940) adding con mode: crc 2024-09-12T00:39:59.630 INFO:tasks.workunit.client.0.smithi043.stderr: -180> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1617c940) adding con mode: secure 2024-09-12T00:39:59.630 INFO:tasks.workunit.client.0.smithi043.stderr: -179> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1617c940) adding con mode: crc 2024-09-12T00:39:59.630 INFO:tasks.workunit.client.0.smithi043.stderr: -178> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1617c940) adding con mode: crc 2024-09-12T00:39:59.630 INFO:tasks.workunit.client.0.smithi043.stderr: -177> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1617c940) adding con mode: secure 2024-09-12T00:39:59.630 INFO:tasks.workunit.client.0.smithi043.stderr: -176> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1617c940) adding con mode: crc 2024-09-12T00:39:59.630 INFO:tasks.workunit.client.0.smithi043.stderr: -175> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1617c940) adding con mode: secure 2024-09-12T00:39:59.630 INFO:tasks.workunit.client.0.smithi043.stderr: -174> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1617c940) adding con mode: crc 2024-09-12T00:39:59.630 INFO:tasks.workunit.client.0.smithi043.stderr: -173> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 AuthRegistry(0x562d1617c940) adding con mode: secure 2024-09-12T00:39:59.630 INFO:tasks.workunit.client.0.smithi043.stderr: -172> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:59.631 INFO:tasks.workunit.client.0.smithi043.stderr: -171> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:59.631 INFO:tasks.workunit.client.0.smithi043.stderr: -170> 2024-09-12T00:39:59.212+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command rotate-key cmddesc rotate-key hook 0x562d1617ca88 EEXIST 2024-09-12T00:39:59.631 INFO:tasks.workunit.client.0.smithi043.stderr: -169> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:59.631 INFO:tasks.workunit.client.0.smithi043.stderr: -168> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:39:59.631 INFO:tasks.workunit.client.0.smithi043.stderr: -167> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 10 monclient(hunting): picked mon.noname-a con 0x562d161c8aa0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:39:59.631 INFO:tasks.workunit.client.0.smithi043.stderr: -166> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 10 monclient(hunting): picked mon.noname-c con 0x562d161ca340 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:39:59.631 INFO:tasks.workunit.client.0.smithi043.stderr: -165> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 10 monclient(hunting): picked mon.noname-b con 0x562d161bd970 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:39:59.631 INFO:tasks.workunit.client.0.smithi043.stderr: -164> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:59.631 INFO:tasks.workunit.client.0.smithi043.stderr: -163> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:59.631 INFO:tasks.workunit.client.0.smithi043.stderr: -162> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:59.631 INFO:tasks.workunit.client.0.smithi043.stderr: -161> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:59.631 INFO:tasks.workunit.client.0.smithi043.stderr: -160> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 10 monclient(hunting): authenticate will time out at 2295.204073s 2024-09-12T00:39:59.631 INFO:tasks.workunit.client.0.smithi043.stderr: -159> 2024-09-12T00:39:59.216+0000 7f60dc3c6640 10 monclient(hunting): get_auth_request con 0x562d161c8aa0 auth_method 0 2024-09-12T00:39:59.632 INFO:tasks.workunit.client.0.smithi043.stderr: -158> 2024-09-12T00:39:59.216+0000 7f60dc3c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:59.632 INFO:tasks.workunit.client.0.smithi043.stderr: -157> 2024-09-12T00:39:59.216+0000 7f60dc3c6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:59.632 INFO:tasks.workunit.client.0.smithi043.stderr: -156> 2024-09-12T00:39:59.216+0000 7f60dc3c6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:59.632 INFO:tasks.workunit.client.0.smithi043.stderr: -155> 2024-09-12T00:39:59.216+0000 7f60dbbc5640 10 monclient(hunting): get_auth_request con 0x562d161ca340 auth_method 0 2024-09-12T00:39:59.632 INFO:tasks.workunit.client.0.smithi043.stderr: -154> 2024-09-12T00:39:59.216+0000 7f60dbbc5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:59.632 INFO:tasks.workunit.client.0.smithi043.stderr: -153> 2024-09-12T00:39:59.216+0000 7f60dbbc5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:59.632 INFO:tasks.workunit.client.0.smithi043.stderr: -152> 2024-09-12T00:39:59.216+0000 7f60dbbc5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:59.632 INFO:tasks.workunit.client.0.smithi043.stderr: -151> 2024-09-12T00:39:59.216+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:59.632 INFO:tasks.workunit.client.0.smithi043.stderr: -150> 2024-09-12T00:39:59.216+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:59.632 INFO:tasks.workunit.client.0.smithi043.stderr: -149> 2024-09-12T00:39:59.216+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:59.633 INFO:tasks.workunit.client.0.smithi043.stderr: -148> 2024-09-12T00:39:59.216+0000 7f60dbbc5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:59.633 INFO:tasks.workunit.client.0.smithi043.stderr: -147> 2024-09-12T00:39:59.216+0000 7f60dbbc5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:59.633 INFO:tasks.workunit.client.0.smithi043.stderr: -146> 2024-09-12T00:39:59.216+0000 7f60dbbc5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:59.633 INFO:tasks.workunit.client.0.smithi043.stderr: -145> 2024-09-12T00:39:59.216+0000 7f60dc3c6640 10 monclient(hunting): handle_auth_done global_id 7650 payload 824 2024-09-12T00:39:59.633 INFO:tasks.workunit.client.0.smithi043.stderr: -144> 2024-09-12T00:39:59.216+0000 7f60dc3c6640 10 monclient: _finish_hunting 0 2024-09-12T00:39:59.633 INFO:tasks.workunit.client.0.smithi043.stderr: -143> 2024-09-12T00:39:59.216+0000 7f60dc3c6640 1 monclient: found mon.noname-a 2024-09-12T00:39:59.633 INFO:tasks.workunit.client.0.smithi043.stderr: -142> 2024-09-12T00:39:59.216+0000 7f60dc3c6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:39:59.633 INFO:tasks.workunit.client.0.smithi043.stderr: -141> 2024-09-12T00:39:59.216+0000 7f5fb1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:59.633 INFO:tasks.workunit.client.0.smithi043.stderr: -140> 2024-09-12T00:39:59.216+0000 7f5fb1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:39:59.633 INFO:tasks.workunit.client.0.smithi043.stderr: -139> 2024-09-12T00:39:59.216+0000 7f5fb1ffb640 10 monclient: dump: 2024-09-12T00:39:59.633 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:59.634 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:59.634 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.634 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.634 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:59.634 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:59.634 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:59.634 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:59.634 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:59.634 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.634 INFO:tasks.workunit.client.0.smithi043.stderr: -138> 2024-09-12T00:39:59.216+0000 7f5fb1ffb640 10 monclient: _finish_auth 0 2024-09-12T00:39:59.634 INFO:tasks.workunit.client.0.smithi043.stderr: -137> 2024-09-12T00:39:59.216+0000 7f5fb1ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:39:59.634 INFO:tasks.workunit.client.0.smithi043.stderr: -136> 2024-09-12T00:39:59.216+0000 7f5fb1ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:59.634 INFO:tasks.workunit.client.0.smithi043.stderr: -135> 2024-09-12T00:39:59.216+0000 7f5fb1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:59.635 INFO:tasks.workunit.client.0.smithi043.stderr: -134> 2024-09-12T00:39:59.216+0000 7f5fb1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:59.635 INFO:tasks.workunit.client.0.smithi043.stderr: -133> 2024-09-12T00:39:59.216+0000 7f5fb1ffb640 10 monclient: dump: 2024-09-12T00:39:59.635 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:39:59.635 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:39:59.635 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.635 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:39:59.635 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:59.635 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:39:59.635 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:39:59.635 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:39:59.635 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:39:59.635 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.635 INFO:tasks.workunit.client.0.smithi043.stderr: -132> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 5 monclient: authenticate success, global_id 7650 2024-09-12T00:39:59.636 INFO:tasks.workunit.client.0.smithi043.stderr: -131> 2024-09-12T00:39:59.216+0000 7f5fb37fe640 4 set_mon_vals no callback set 2024-09-12T00:39:59.636 INFO:tasks.workunit.client.0.smithi043.stderr: -130> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 10 monclient: _renew_subs 2024-09-12T00:39:59.636 INFO:tasks.workunit.client.0.smithi043.stderr: -129> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:39:59.636 INFO:tasks.workunit.client.0.smithi043.stderr: -128> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 10 monclient: _renew_subs 2024-09-12T00:39:59.636 INFO:tasks.workunit.client.0.smithi043.stderr: -127> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:39:59.636 INFO:tasks.workunit.client.0.smithi043.stderr: -126> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 1 librados: init done 2024-09-12T00:39:59.636 INFO:tasks.workunit.client.0.smithi043.stderr: -125> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command cr dump hook 0x562d1619e618 2024-09-12T00:39:59.636 INFO:tasks.workunit.client.0.smithi043.stderr: -124> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.636 INFO:tasks.workunit.client.0.smithi043.stderr: -123> 2024-09-12T00:39:59.216+0000 7f5fb1ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:59.636 INFO:tasks.workunit.client.0.smithi043.stderr: -122> 2024-09-12T00:39:59.216+0000 7f5fb1ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:39:59.636 INFO:tasks.workunit.client.0.smithi043.stderr: -121> 2024-09-12T00:39:59.216+0000 7f5fb1ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:39:59.637 INFO:tasks.workunit.client.0.smithi043.stderr: -120> 2024-09-12T00:39:59.216+0000 7f60dbbc5640 10 monclient: get_auth_request con 0x7f5fa4070ae0 auth_method 0 2024-09-12T00:39:59.637 INFO:tasks.workunit.client.0.smithi043.stderr: -119> 2024-09-12T00:39:59.216+0000 7f60dcbc7640 10 monclient: get_auth_request con 0x562d161e8160 auth_method 0 2024-09-12T00:39:59.637 INFO:tasks.workunit.client.0.smithi043.stderr: -118> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.637 INFO:tasks.workunit.client.0.smithi043.stderr: -117> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 20 realm 2024-09-12T00:39:59.637 INFO:tasks.workunit.client.0.smithi043.stderr: -116> 2024-09-12T00:39:59.216+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.637 INFO:tasks.workunit.client.0.smithi043.stderr: -115> 2024-09-12T00:39:59.220+0000 7f60de8c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.637 INFO:tasks.workunit.client.0.smithi043.stderr: -114> 2024-09-12T00:39:59.220+0000 7f60de8c09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:59.637 INFO:tasks.workunit.client.0.smithi043.stderr: -113> 2024-09-12T00:39:59.220+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.637 INFO:tasks.workunit.client.0.smithi043.stderr: -112> 2024-09-12T00:39:59.220+0000 7f60de8c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.637 INFO:tasks.workunit.client.0.smithi043.stderr: -111> 2024-09-12T00:39:59.220+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.637 INFO:tasks.workunit.client.0.smithi043.stderr: -110> 2024-09-12T00:39:59.220+0000 7f60dc3c6640 10 monclient: get_auth_request con 0x562d161ec390 auth_method 0 2024-09-12T00:39:59.637 INFO:tasks.workunit.client.0.smithi043.stderr: -109> 2024-09-12T00:39:59.220+0000 7f60de8c09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:59.637 INFO:tasks.workunit.client.0.smithi043.stderr: -108> 2024-09-12T00:39:59.220+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.637 INFO:tasks.workunit.client.0.smithi043.stderr: -107> 2024-09-12T00:39:59.220+0000 7f60dbbc5640 10 monclient: get_auth_request con 0x562d161efbf0 auth_method 0 2024-09-12T00:39:59.638 INFO:tasks.workunit.client.0.smithi043.stderr: -106> 2024-09-12T00:39:59.220+0000 7f60de8c09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:59.638 INFO:tasks.workunit.client.0.smithi043.stderr: -105> 2024-09-12T00:39:59.220+0000 7f60de8c09c0 20 searching for the correct realm 2024-09-12T00:39:59.638 INFO:tasks.workunit.client.0.smithi043.stderr: -104> 2024-09-12T00:39:59.220+0000 7f60dcbc7640 10 monclient: get_auth_request con 0x562d161f4990 auth_method 0 2024-09-12T00:39:59.638 INFO:tasks.workunit.client.0.smithi043.stderr: -103> 2024-09-12T00:39:59.224+0000 7f60dc3c6640 10 monclient: get_auth_request con 0x7f60d400e040 auth_method 0 2024-09-12T00:39:59.638 INFO:tasks.workunit.client.0.smithi043.stderr: -102> 2024-09-12T00:39:59.224+0000 7f60dbbc5640 10 monclient: get_auth_request con 0x7f60d0031040 auth_method 0 2024-09-12T00:39:59.638 INFO:tasks.workunit.client.0.smithi043.stderr: -101> 2024-09-12T00:39:59.228+0000 7f60dcbc7640 0 -- 172.21.15.43:0/500109282 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f60d0019920 msgr2=0x7f60d0018400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:59.638 INFO:tasks.workunit.client.0.smithi043.stderr: -100> 2024-09-12T00:39:59.432+0000 7f60dcbc7640 10 monclient: get_auth_request con 0x7f60d0019920 auth_method 0 2024-09-12T00:39:59.638 INFO:tasks.workunit.client.0.smithi043.stderr: -99> 2024-09-12T00:39:59.436+0000 7f60dc3c6640 10 monclient: get_auth_request con 0x7f60d0047400 auth_method 0 2024-09-12T00:39:59.638 INFO:tasks.workunit.client.0.smithi043.stderr: -98> 2024-09-12T00:39:59.444+0000 7f60dc3c6640 0 -- 172.21.15.43:0/500109282 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x562d161ec390 msgr2=0x562d161ee7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:59.638 INFO:tasks.workunit.client.0.smithi043.stderr: -97> 2024-09-12T00:39:59.444+0000 7f5fb1ffb640 1 client.7650.objecter ms_handle_reset 0x562d161ec390 session 0x562d161ebd10 osd.5 2024-09-12T00:39:59.638 INFO:tasks.workunit.client.0.smithi043.stderr: -96> 2024-09-12T00:39:59.444+0000 7f5fb1ffb640 10 monclient: _renew_subs 2024-09-12T00:39:59.638 INFO:tasks.workunit.client.0.smithi043.stderr: -95> 2024-09-12T00:39:59.444+0000 7f5fb1ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:39:59.639 INFO:tasks.workunit.client.0.smithi043.stderr: -94> 2024-09-12T00:39:59.444+0000 7f60dc3c6640 10 monclient: get_auth_request con 0x7f5fa4080b80 auth_method 0 2024-09-12T00:39:59.639 INFO:tasks.workunit.client.0.smithi043.stderr: -93> 2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:39:59.639 INFO:tasks.workunit.client.0.smithi043.stderr: -92> 2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:59.639 INFO:tasks.workunit.client.0.smithi043.stderr: -91> 2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:59.639 INFO:tasks.workunit.client.0.smithi043.stderr: -90> 2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:39:59.639 INFO:tasks.workunit.client.0.smithi043.stderr: -89> 2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:59.639 INFO:tasks.workunit.client.0.smithi043.stderr: -88> 2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:59.639 INFO:tasks.workunit.client.0.smithi043.stderr: -87> 2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.639 INFO:tasks.workunit.client.0.smithi043.stderr: -86> 2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.639 INFO:tasks.workunit.client.0.smithi043.stderr: -85> 2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.639 INFO:tasks.workunit.client.0.smithi043.stderr: -84> 2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:59.639 INFO:tasks.workunit.client.0.smithi043.stderr: -83> 2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.639 INFO:tasks.workunit.client.0.smithi043.stderr: -82> 2024-09-12T00:39:59.452+0000 7f60de8c09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:59.640 INFO:tasks.workunit.client.0.smithi043.stderr: -81> 2024-09-12T00:39:59.456+0000 7f60de8c09c0 20 zone default found 2024-09-12T00:39:59.640 INFO:tasks.workunit.client.0.smithi043.stderr: -80> 2024-09-12T00:39:59.456+0000 7f60de8c09c0 4 Realm: () 2024-09-12T00:39:59.640 INFO:tasks.workunit.client.0.smithi043.stderr: -79> 2024-09-12T00:39:59.456+0000 7f60de8c09c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:39:59.640 INFO:tasks.workunit.client.0.smithi043.stderr: -78> 2024-09-12T00:39:59.456+0000 7f60de8c09c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:39:59.640 INFO:tasks.workunit.client.0.smithi043.stderr: -77> 2024-09-12T00:39:59.456+0000 7f60de8c09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:59.640 INFO:tasks.workunit.client.0.smithi043.stderr: -76> 2024-09-12T00:39:59.456+0000 7f60de8c09c0 20 zonegroup default 2024-09-12T00:39:59.640 INFO:tasks.workunit.client.0.smithi043.stderr: -75> 2024-09-12T00:39:59.456+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.640 INFO:tasks.workunit.client.0.smithi043.stderr: -74> 2024-09-12T00:39:59.456+0000 7f60de8c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.640 INFO:tasks.workunit.client.0.smithi043.stderr: -73> 2024-09-12T00:39:59.456+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.640 INFO:tasks.workunit.client.0.smithi043.stderr: -72> 2024-09-12T00:39:59.456+0000 7f60de8c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.640 INFO:tasks.workunit.client.0.smithi043.stderr: -71> 2024-09-12T00:39:59.456+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.640 INFO:tasks.workunit.client.0.smithi043.stderr: -70> 2024-09-12T00:39:59.456+0000 7f60de8c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.641 INFO:tasks.workunit.client.0.smithi043.stderr: -69> 2024-09-12T00:39:59.456+0000 7f60de8c09c0 20 started sync module instance, tier type = 2024-09-12T00:39:59.641 INFO:tasks.workunit.client.0.smithi043.stderr: -68> 2024-09-12T00:39:59.456+0000 7f60de8c09c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:39:59.641 INFO:tasks.workunit.client.0.smithi043.stderr: -67> 2024-09-12T00:39:59.480+0000 7f60de8c09c0 20 add_watcher() i=0 2024-09-12T00:39:59.641 INFO:tasks.workunit.client.0.smithi043.stderr: -66> 2024-09-12T00:39:59.480+0000 7f60de8c09c0 20 add_watcher() i=1 2024-09-12T00:39:59.641 INFO:tasks.workunit.client.0.smithi043.stderr: -65> 2024-09-12T00:39:59.480+0000 7f60de8c09c0 20 add_watcher() i=2 2024-09-12T00:39:59.641 INFO:tasks.workunit.client.0.smithi043.stderr: -64> 2024-09-12T00:39:59.480+0000 7f60de8c09c0 20 add_watcher() i=3 2024-09-12T00:39:59.641 INFO:tasks.workunit.client.0.smithi043.stderr: -63> 2024-09-12T00:39:59.480+0000 7f60de8c09c0 20 add_watcher() i=4 2024-09-12T00:39:59.641 INFO:tasks.workunit.client.0.smithi043.stderr: -62> 2024-09-12T00:39:59.480+0000 7f60de8c09c0 20 add_watcher() i=5 2024-09-12T00:39:59.641 INFO:tasks.workunit.client.0.smithi043.stderr: -61> 2024-09-12T00:39:59.480+0000 7f60de8c09c0 20 add_watcher() i=6 2024-09-12T00:39:59.641 INFO:tasks.workunit.client.0.smithi043.stderr: -60> 2024-09-12T00:39:59.484+0000 7f60de8c09c0 20 add_watcher() i=7 2024-09-12T00:39:59.641 INFO:tasks.workunit.client.0.smithi043.stderr: -59> 2024-09-12T00:39:59.484+0000 7f60de8c09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:59.641 INFO:tasks.workunit.client.0.smithi043.stderr: -58> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd26009b80) adding auth protocol: cephx 2024-09-12T00:39:59.642 INFO:tasks.workunit.client.0.smithi043.stderr: -57> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd26009b80) adding auth protocol: cephx 2024-09-12T00:39:59.642 INFO:tasks.workunit.client.0.smithi043.stderr: -56> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd26009b80) adding auth protocol: cephx 2024-09-12T00:39:59.642 INFO:tasks.workunit.client.0.smithi043.stderr: -55> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd26009b80) adding con mode: secure 2024-09-12T00:39:59.642 INFO:tasks.workunit.client.0.smithi043.stderr: -54> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd26009b80) adding con mode: crc 2024-09-12T00:39:59.642 INFO:tasks.workunit.client.0.smithi043.stderr: -53> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd26009b80) adding con mode: secure 2024-09-12T00:39:59.642 INFO:tasks.workunit.client.0.smithi043.stderr: -52> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd26009b80) adding con mode: crc 2024-09-12T00:39:59.642 INFO:tasks.workunit.client.0.smithi043.stderr: -51> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd26009b80) adding con mode: secure 2024-09-12T00:39:59.642 INFO:tasks.workunit.client.0.smithi043.stderr: -50> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd26009b80) adding con mode: crc 2024-09-12T00:39:59.642 INFO:tasks.workunit.client.0.smithi043.stderr: -49> 2024-09-12T00:39:59.488+0000 7f5f92fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:59.642 INFO:tasks.workunit.client.0.smithi043.stderr: -48> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd26009b80) adding con mode: crc 2024-09-12T00:39:59.642 INFO:tasks.workunit.client.0.smithi043.stderr: -47> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd26009b80) adding con mode: secure 2024-09-12T00:39:59.642 INFO:tasks.workunit.client.0.smithi043.stderr: -46> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd26009b80) adding con mode: crc 2024-09-12T00:39:59.642 INFO:tasks.workunit.client.0.smithi043.stderr: -45> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd26009b80) adding con mode: secure 2024-09-12T00:39:59.643 INFO:tasks.workunit.client.0.smithi043.stderr: -44> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd26009b80) adding con mode: crc 2024-09-12T00:39:59.643 INFO:tasks.workunit.client.0.smithi043.stderr: -43> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 AuthRegistry(0x7ffd26009b80) adding con mode: secure 2024-09-12T00:39:59.643 INFO:tasks.workunit.client.0.smithi043.stderr: -42> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:59.643 INFO:tasks.workunit.client.0.smithi043.stderr: -41> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:59.643 INFO:tasks.workunit.client.0.smithi043.stderr: -40> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:59.643 INFO:tasks.workunit.client.0.smithi043.stderr: -39> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command cache list hook 0x562d161bddb0 2024-09-12T00:39:59.643 INFO:tasks.workunit.client.0.smithi043.stderr: -38> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command cache inspect hook 0x562d161bddb0 2024-09-12T00:39:59.643 INFO:tasks.workunit.client.0.smithi043.stderr: -37> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command cache erase hook 0x562d161bddb0 2024-09-12T00:39:59.643 INFO:tasks.workunit.client.0.smithi043.stderr: -36> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command cache zap hook 0x562d161bddb0 2024-09-12T00:39:59.643 INFO:tasks.workunit.client.0.smithi043.stderr: -35> 2024-09-12T00:39:59.488+0000 7f60de8c09c0 5 note: GC not initialized 2024-09-12T00:39:59.643 INFO:tasks.workunit.client.0.smithi043.stderr: -34> 2024-09-12T00:39:59.492+0000 7f5f91fdb640 20 reqs_thread_entry: start 2024-09-12T00:39:59.643 INFO:tasks.workunit.client.0.smithi043.stderr: -33> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command sync trace show hook 0x7f60c4001d40 2024-09-12T00:39:59.643 INFO:tasks.workunit.client.0.smithi043.stderr: -32> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command sync trace history hook 0x7f60c4001d40 2024-09-12T00:39:59.644 INFO:tasks.workunit.client.0.smithi043.stderr: -31> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command sync trace active hook 0x7f60c4001d40 2024-09-12T00:39:59.644 INFO:tasks.workunit.client.0.smithi043.stderr: -30> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 5 asok(0x562d15ef42b0) register_command sync trace active_short hook 0x7f60c4001d40 2024-09-12T00:39:59.644 INFO:tasks.workunit.client.0.smithi043.stderr: -29> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:59.644 INFO:tasks.workunit.client.0.smithi043.stderr: -28> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 20 Filter name: none 2024-09-12T00:39:59.644 INFO:tasks.workunit.client.0.smithi043.stderr: -27> 2024-09-12T00:39:59.492+0000 7f5f037fe640 20 reqs_thread_entry: start 2024-09-12T00:39:59.644 INFO:tasks.workunit.client.0.smithi043.stderr: -26> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:39:59.644 INFO:tasks.workunit.client.0.smithi043.stderr: -25> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.644 INFO:tasks.workunit.client.0.smithi043.stderr: -24> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:39:59.644 INFO:tasks.workunit.client.0.smithi043.stderr: -23> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:39:59.644 INFO:tasks.workunit.client.0.smithi043.stderr: -22> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:39:59.645 INFO:tasks.workunit.client.0.smithi043.stderr: -21> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 : miss 2024-09-12T00:39:59.645 INFO:tasks.workunit.client.0.smithi043.stderr: -20> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.645 INFO:tasks.workunit.client.0.smithi043.stderr: -19> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:39:59.645 INFO:tasks.workunit.client.0.smithi043.stderr: -18> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 info.flags=0x17 2024-09-12T00:39:59.645 INFO:tasks.workunit.client.0.smithi043.stderr: -17> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 to cache LRU end 2024-09-12T00:39:59.645 INFO:tasks.workunit.client.0.smithi043.stderr: -16> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:59.645 INFO:tasks.workunit.client.0.smithi043.stderr: -15> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:59.645 INFO:tasks.workunit.client.0.smithi043.stderr: -14> 2024-09-12T00:39:59.492+0000 7f60de8c09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 2024-09-12T00:39:59.645 INFO:tasks.workunit.client.0.smithi043.stderr: -13> 2024-09-12T00:39:59.504+0000 7f60de8c09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 info.flags=0x17 2024-09-12T00:39:59.645 INFO:tasks.workunit.client.0.smithi043.stderr: -12> 2024-09-12T00:39:59.504+0000 7f60de8c09c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 to cache LRU end 2024-09-12T00:39:59.645 INFO:tasks.workunit.client.0.smithi043.stderr: -11> 2024-09-12T00:39:59.504+0000 7f60de8c09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:59.646 INFO:tasks.workunit.client.0.smithi043.stderr: -10> 2024-09-12T00:39:59.504+0000 7f60de8c09c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36, ofs0, ns] 2024-09-12T00:39:59.646 INFO:tasks.workunit.client.0.smithi043.stderr: -9> 2024-09-12T00:39:59.504+0000 7f5fb37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333492 cookie 94751644689904 notifier 7650 bl.length()=923 2024-09-12T00:39:59.646 INFO:tasks.workunit.client.0.smithi043.stderr: -8> 2024-09-12T00:39:59.504+0000 7f5fb37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 info.flags=0x17 2024-09-12T00:39:59.646 INFO:tasks.workunit.client.0.smithi043.stderr: -7> 2024-09-12T00:39:59.504+0000 7f5fb37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 to cache LRU end 2024-09-12T00:39:59.646 INFO:tasks.workunit.client.0.smithi043.stderr: -6> 2024-09-12T00:39:59.504+0000 7f5fb37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:39:59.646 INFO:tasks.workunit.client.0.smithi043.stderr: -5> 2024-09-12T00:39:59.504+0000 7f60de8c09c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36]): orig_sources= new_sources= 2024-09-12T00:39:59.646 INFO:tasks.workunit.client.0.smithi043.stderr: -4> 2024-09-12T00:39:59.504+0000 7f60de8c09c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36]): potential sources added=[] removed=[] 2024-09-12T00:39:59.646 INFO:tasks.workunit.client.0.smithi043.stderr: -3> 2024-09-12T00:39:59.504+0000 7f60de8c09c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36]): orig_dests= new_dests= 2024-09-12T00:39:59.646 INFO:tasks.workunit.client.0.smithi043.stderr: -2> 2024-09-12T00:39:59.504+0000 7f60de8c09c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36]): potential dests added=[] removed=[] 2024-09-12T00:39:59.646 INFO:tasks.workunit.client.0.smithi043.stderr: -1> 2024-09-12T00:39:59.512+0000 7f60de8c09c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f60de8c09c0 time 2024-09-12T00:39:59.512442+0000 2024-09-12T00:39:59.646 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:39:59.646 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.646 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:59.647 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f60e219a2eb] 2024-09-12T00:39:59.647 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f60e219a49f] 2024-09-12T00:39:59.647 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562d13440cc1] 2024-09-12T00:39:59.647 INFO:tasks.workunit.client.0.smithi043.stderr: 4: radosgw-admin(+0x1422aac) [0x562d13e9eaac] 2024-09-12T00:39:59.647 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562d13455ced] 2024-09-12T00:39:59.647 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:39:59.647 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f60e1000d90] 2024-09-12T00:39:59.647 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:39:59.647 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:39:59.647 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.647 INFO:tasks.workunit.client.0.smithi043.stderr: 0> 2024-09-12T00:39:59.512+0000 7f60de8c09c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:39:59.647 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7f60de8c09c0 thread_name:radosgw-admin 2024-09-12T00:39:59.648 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.648 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:59.648 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f60e1019520] 2024-09-12T00:39:59.648 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:39:59.648 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:39:59.648 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:39:59.648 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f60e219a345] 2024-09-12T00:39:59.648 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f60e219a49f] 2024-09-12T00:39:59.648 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562d13440cc1] 2024-09-12T00:39:59.648 INFO:tasks.workunit.client.0.smithi043.stderr: 8: radosgw-admin(+0x1422aac) [0x562d13e9eaac] 2024-09-12T00:39:59.648 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562d13455ced] 2024-09-12T00:39:59.648 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:39:59.649 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f60e1000d90] 2024-09-12T00:39:59.649 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:39:59.649 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:39:59.649 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:39:59.649 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:39:59.649 INFO:tasks.workunit.client.0.smithi043.stderr:--- logging levels --- 2024-09-12T00:39:59.649 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 none 2024-09-12T00:39:59.649 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 lockdep 2024-09-12T00:39:59.649 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 context 2024-09-12T00:39:59.649 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 crush 2024-09-12T00:39:59.649 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds 2024-09-12T00:39:59.649 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_balancer 2024-09-12T00:39:59.649 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_locker 2024-09-12T00:39:59.650 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log 2024-09-12T00:39:59.650 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log_expire 2024-09-12T00:39:59.650 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_migrator 2024-09-12T00:39:59.650 INFO:tasks.workunit.client.0.smithi043.stderr: 3/ 5 mds_quiesce 2024-09-12T00:39:59.650 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 buffer 2024-09-12T00:39:59.650 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 timer 2024-09-12T00:39:59.650 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 filer 2024-09-12T00:39:59.650 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 striper 2024-09-12T00:39:59.650 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 objecter 2024-09-12T00:39:59.650 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rados 2024-09-12T00:39:59.650 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd 2024-09-12T00:39:59.650 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_mirror 2024-09-12T00:39:59.650 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_replay 2024-09-12T00:39:59.651 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_pwl 2024-09-12T00:39:59.651 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 journaler 2024-09-12T00:39:59.651 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objectcacher 2024-09-12T00:39:59.651 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:39:59.651 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 client 2024-09-12T00:39:59.651 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 osd 2024-09-12T00:39:59.651 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 optracker 2024-09-12T00:39:59.651 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objclass 2024-09-12T00:39:59.651 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 filestore 2024-09-12T00:39:59.651 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 journal 2024-09-12T00:39:59.651 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 ms 2024-09-12T00:39:59.651 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mon 2024-09-12T00:39:59.651 INFO:tasks.workunit.client.0.smithi043.stderr: 0/10 monc 2024-09-12T00:39:59.652 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 paxos 2024-09-12T00:39:59.652 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 tp 2024-09-12T00:39:59.652 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 auth 2024-09-12T00:39:59.652 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 crypto 2024-09-12T00:39:59.652 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 finisher 2024-09-12T00:39:59.652 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 reserver 2024-09-12T00:39:59.652 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 heartbeatmap 2024-09-12T00:39:59.652 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 perfcounter 2024-09-12T00:39:59.652 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw 2024-09-12T00:39:59.652 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_sync 2024-09-12T00:39:59.652 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_datacache 2024-09-12T00:39:59.652 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_access 2024-09-12T00:39:59.652 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:39:59.653 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_flight 2024-09-12T00:39:59.653 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:39:59.653 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw_notification 2024-09-12T00:39:59.653 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 javaclient 2024-09-12T00:39:59.653 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 asok 2024-09-12T00:39:59.653 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 throttle 2024-09-12T00:39:59.653 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 refs 2024-09-12T00:39:59.653 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 compressor 2024-09-12T00:39:59.653 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluestore 2024-09-12T00:39:59.653 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluefs 2024-09-12T00:39:59.653 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 bdev 2024-09-12T00:39:59.653 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 kstore 2024-09-12T00:39:59.653 INFO:tasks.workunit.client.0.smithi043.stderr: 4/ 5 rocksdb 2024-09-12T00:39:59.654 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 fuse 2024-09-12T00:39:59.654 INFO:tasks.workunit.client.0.smithi043.stderr: 2/ 5 mgr 2024-09-12T00:39:59.654 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mgrc 2024-09-12T00:39:59.654 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 dpdk 2024-09-12T00:39:59.654 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 eventtrace 2024-09-12T00:39:59.654 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 prioritycache 2024-09-12T00:39:59.654 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 test 2024-09-12T00:39:59.654 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:39:59.654 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephsqlite 2024-09-12T00:39:59.654 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:39:59.654 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore 2024-09-12T00:39:59.654 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_onode 2024-09-12T00:39:59.654 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_odata 2024-09-12T00:39:59.655 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_omap 2024-09-12T00:39:59.655 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_tm 2024-09-12T00:39:59.655 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_t 2024-09-12T00:39:59.655 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:39:59.655 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_epm 2024-09-12T00:39:59.655 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_lba 2024-09-12T00:39:59.655 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:39:59.655 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cache 2024-09-12T00:39:59.655 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_journal 2024-09-12T00:39:59.655 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_device 2024-09-12T00:39:59.655 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_backref 2024-09-12T00:39:59.655 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 alienstore 2024-09-12T00:39:59.655 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mclock 2024-09-12T00:39:59.656 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cyanstore 2024-09-12T00:39:59.656 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 ceph_exporter 2024-09-12T00:39:59.656 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 memstore 2024-09-12T00:39:59.656 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 trace 2024-09-12T00:39:59.656 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 ceph_dedup 2024-09-12T00:39:59.656 INFO:tasks.workunit.client.0.smithi043.stderr: -2/-2 (syslog threshold) 2024-09-12T00:39:59.656 INFO:tasks.workunit.client.0.smithi043.stderr: 99/99 (stderr threshold) 2024-09-12T00:39:59.656 INFO:tasks.workunit.client.0.smithi043.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:39:59.656 INFO:tasks.workunit.client.0.smithi043.stderr: 7f5f037fe640 / http_manager 2024-09-12T00:39:59.656 INFO:tasks.workunit.client.0.smithi043.stderr: 7f5f91fdb640 / http_manager 2024-09-12T00:39:59.656 INFO:tasks.workunit.client.0.smithi043.stderr: 7f5f92fdd640 / rgw_dt_lg_renew 2024-09-12T00:39:59.656 INFO:tasks.workunit.client.0.smithi043.stderr: 7f5fb1ffb640 / ms_dispatch 2024-09-12T00:39:59.657 INFO:tasks.workunit.client.0.smithi043.stderr: 7f5fb37fe640 / io_context_pool 2024-09-12T00:39:59.657 INFO:tasks.workunit.client.0.smithi043.stderr: 7f5fc1ffb640 / ms_dispatch 2024-09-12T00:39:59.657 INFO:tasks.workunit.client.0.smithi043.stderr: 7f5fc8e09640 / ms_dispatch 2024-09-12T00:39:59.657 INFO:tasks.workunit.client.0.smithi043.stderr: 7f5fca60c640 / io_context_pool 2024-09-12T00:39:59.657 INFO:tasks.workunit.client.0.smithi043.stderr: 7f60dbbc5640 / msgr-worker-2 2024-09-12T00:39:59.657 INFO:tasks.workunit.client.0.smithi043.stderr: 7f60dc3c6640 / msgr-worker-1 2024-09-12T00:39:59.657 INFO:tasks.workunit.client.0.smithi043.stderr: 7f60dcbc7640 / msgr-worker-0 2024-09-12T00:39:59.657 INFO:tasks.workunit.client.0.smithi043.stderr: 7f60dd3c8640 / io_context_pool 2024-09-12T00:39:59.657 INFO:tasks.workunit.client.0.smithi043.stderr: 7f60de8c09c0 / radosgw-admin 2024-09-12T00:39:59.657 INFO:tasks.workunit.client.0.smithi043.stderr: max_recent 500 2024-09-12T00:39:59.657 INFO:tasks.workunit.client.0.smithi043.stderr: max_new 1000 2024-09-12T00:39:59.657 INFO:tasks.workunit.client.0.smithi043.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:39:59.514976Z_4f2c35f0-a1dc-4402-ab54-db4fff88daf9/log 2024-09-12T00:39:59.657 INFO:tasks.workunit.client.0.smithi043.stderr:--- end dump of recent events --- 2024-09-12T00:39:59.657 INFO:tasks.workunit.client.0.smithi043.stderr:Aborted 2024-09-12T00:39:59.658 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:39:59.659 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:59.659 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:59.659 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.596+0000 7f10555ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.659 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.600+0000 7f10555ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.659 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.600+0000 7f10555ac9c0 20 realm 2024-09-12T00:39:59.660 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.600+0000 7f10555ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.660 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.600+0000 7f10555ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.660 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.600+0000 7f10555ac9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:59.660 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.600+0000 7f10555ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.660 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.600+0000 7f10555ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.660 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.600+0000 7f10555ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.660 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.600+0000 7f10555ac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:59.660 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.600+0000 7f10555ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.660 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.604+0000 7f10555ac9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:59.660 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.604+0000 7f10555ac9c0 20 searching for the correct realm 2024-09-12T00:39:59.660 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.608+0000 7f10528b1640 0 -- 172.21.15.43:0/3314938627 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f1040003100 msgr2=0x7f103c053430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:59.824 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:39:59.824+0000 7f10530b2640 0 -- 172.21.15.43:0/3314938627 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f103c067960 msgr2=0x7f103c025400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:00.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.044+0000 7f10555ac9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:40:00.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.044+0000 7f10555ac9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:00.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.044+0000 7f10555ac9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:00.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.044+0000 7f10555ac9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:40:00.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.044+0000 7f10555ac9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:00.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.044+0000 7f10555ac9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:00.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.044+0000 7f10555ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.043 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.044+0000 7f10555ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:00.043 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.044+0000 7f10555ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.043 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.044+0000 7f10555ac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:00.043 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.044+0000 7f10555ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.044+0000 7f10555ac9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:00.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.044+0000 7f10555ac9c0 20 zone default found 2024-09-12T00:40:00.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.044+0000 7f10555ac9c0 4 Realm: () 2024-09-12T00:40:00.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.044+0000 7f10555ac9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:40:00.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.044+0000 7f10555ac9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:40:00.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.044+0000 7f10555ac9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:00.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.044+0000 7f10555ac9c0 20 zonegroup default 2024-09-12T00:40:00.045 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.044+0000 7f10555ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.045 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.044+0000 7f10555ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:00.045 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.044+0000 7f10555ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.045 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.048+0000 7f10555ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:00.045 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.048+0000 7f10555ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.046 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.048+0000 7f10555ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:00.046 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.048+0000 7f10555ac9c0 20 started sync module instance, tier type = 2024-09-12T00:40:00.046 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.048+0000 7f10555ac9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:40:00.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.068+0000 7f10555ac9c0 20 add_watcher() i=0 2024-09-12T00:40:00.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.068+0000 7f10555ac9c0 20 add_watcher() i=1 2024-09-12T00:40:00.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.068+0000 7f10555ac9c0 20 add_watcher() i=2 2024-09-12T00:40:00.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.068+0000 7f10555ac9c0 20 add_watcher() i=3 2024-09-12T00:40:00.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.068+0000 7f10555ac9c0 20 add_watcher() i=4 2024-09-12T00:40:00.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.068+0000 7f10555ac9c0 20 add_watcher() i=5 2024-09-12T00:40:00.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.068+0000 7f10555ac9c0 20 add_watcher() i=6 2024-09-12T00:40:00.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.072+0000 7f10555ac9c0 20 add_watcher() i=7 2024-09-12T00:40:00.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.072+0000 7f10555ac9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:00.076 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.076+0000 7f0f09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:00.077 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.076+0000 7f10555ac9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:00.077 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.076+0000 7f10555ac9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:00.077 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.076+0000 7f10555ac9c0 5 note: GC not initialized 2024-09-12T00:40:00.078 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.080+0000 7f0f08fe1640 20 reqs_thread_entry: start 2024-09-12T00:40:00.078 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.080+0000 7f10555ac9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:00.078 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.080+0000 7f10555ac9c0 20 Filter name: none 2024-09-12T00:40:00.078 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.080+0000 7f0e827fc640 20 reqs_thread_entry: start 2024-09-12T00:40:00.078 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.080+0000 7f10555ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.080+0000 7f10555ac9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:40:00.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.080+0000 7f10555ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.080+0000 7f10555ac9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:40:00.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.080+0000 7f10555ac9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:00.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.080+0000 7f10555ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.081 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.084+0000 7f10555ac9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:40:00.081 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.084+0000 7f10555ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.082 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.084+0000 7f10555ac9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:40:00.082 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.084+0000 7f10555ac9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:00.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.088+0000 7f0f09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:00.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.092+0000 7f10555ac9c0 20 remove_watcher() i=0 2024-09-12T00:40:00.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.092+0000 7f10555ac9c0 2 removed watcher, disabling cache 2024-09-12T00:40:00.092 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.092+0000 7f10555ac9c0 20 remove_watcher() i=1 2024-09-12T00:40:00.094 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.096+0000 7f10555ac9c0 20 remove_watcher() i=2 2024-09-12T00:40:00.097 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.096+0000 7f10555ac9c0 20 remove_watcher() i=3 2024-09-12T00:40:00.099 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.100+0000 7f10555ac9c0 20 remove_watcher() i=4 2024-09-12T00:40:00.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.100+0000 7f10555ac9c0 20 remove_watcher() i=5 2024-09-12T00:40:00.102 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.104+0000 7f10555ac9c0 20 remove_watcher() i=6 2024-09-12T00:40:00.103 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.104+0000 7f10555ac9c0 20 remove_watcher() i=7 2024-09-12T00:40:00.120 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:00.121 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:40:00.121 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: abort-at-logrecord-writes id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:40:00.121 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:00.121 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:00.122 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:00.134 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:00.134 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:00.178 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:40:00.216 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:00.216 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:00.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.260+0000 7f19a67509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.260+0000 7f19a67509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:00.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.260+0000 7f19a67509c0 20 realm 2024-09-12T00:40:00.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.260+0000 7f19a67509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.260+0000 7f19a67509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:00.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.260+0000 7f19a67509c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:00.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.260+0000 7f19a67509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.260+0000 7f19a67509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:00.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.260+0000 7f19a67509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.263 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.264+0000 7f19a67509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:00.263 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.264+0000 7f19a67509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.263 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.264+0000 7f19a67509c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:00.264 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.264+0000 7f19a67509c0 20 searching for the correct realm 2024-09-12T00:40:00.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.272+0000 7f19a4a57640 0 -- 172.21.15.43:0/1273971003 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f19980ce040 msgr2=0x7f19980d7410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:00.280 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.280+0000 7f19a4256640 0 -- 172.21.15.43:0/1273971003 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x55e340706ff0 msgr2=0x55e3407093e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:00.286 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.288+0000 7f19a67509c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:40:00.287 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.288+0000 7f19a67509c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:00.287 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.288+0000 7f19a67509c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:00.287 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.288+0000 7f19a67509c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:40:00.287 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.288+0000 7f19a67509c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:00.287 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.288+0000 7f19a67509c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:00.287 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.288+0000 7f19a67509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.288+0000 7f19a67509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:00.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.288+0000 7f19a67509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.288+0000 7f19a67509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:00.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.288+0000 7f19a67509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.288+0000 7f19a67509c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:00.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.288+0000 7f19a67509c0 20 zone default found 2024-09-12T00:40:00.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.288+0000 7f19a67509c0 4 Realm: () 2024-09-12T00:40:00.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.288+0000 7f19a67509c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:40:00.289 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.288+0000 7f19a67509c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:40:00.289 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.288+0000 7f19a67509c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:00.289 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.288+0000 7f19a67509c0 20 zonegroup default 2024-09-12T00:40:00.289 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.288+0000 7f19a67509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.289 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.288+0000 7f19a67509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:00.289 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.288+0000 7f19a67509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.289 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.288+0000 7f19a67509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:00.290 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.288+0000 7f19a67509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.290 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.292+0000 7f19a67509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:00.290 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.292+0000 7f19a67509c0 20 started sync module instance, tier type = 2024-09-12T00:40:00.290 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.292+0000 7f19a67509c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:40:00.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.308+0000 7f19a67509c0 20 add_watcher() i=0 2024-09-12T00:40:00.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.308+0000 7f19a67509c0 20 add_watcher() i=1 2024-09-12T00:40:00.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.308+0000 7f19a67509c0 20 add_watcher() i=2 2024-09-12T00:40:00.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.308+0000 7f19a67509c0 20 add_watcher() i=3 2024-09-12T00:40:00.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.308+0000 7f19a67509c0 20 add_watcher() i=4 2024-09-12T00:40:00.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.308+0000 7f19a67509c0 20 add_watcher() i=5 2024-09-12T00:40:00.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.308+0000 7f19a67509c0 20 add_watcher() i=6 2024-09-12T00:40:00.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.308+0000 7f19a67509c0 20 add_watcher() i=7 2024-09-12T00:40:00.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.308+0000 7f19a67509c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:00.310 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.312+0000 7f185b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:00.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.312+0000 7f19a67509c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:00.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.312+0000 7f19a67509c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:00.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.312+0000 7f19a67509c0 5 note: GC not initialized 2024-09-12T00:40:00.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.312+0000 7f185a7dc640 20 reqs_thread_entry: start 2024-09-12T00:40:00.311 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.312+0000 7f19a67509c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:00.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.312+0000 7f19a67509c0 20 Filter name: none 2024-09-12T00:40:00.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.312+0000 7f18537fe640 20 reqs_thread_entry: start 2024-09-12T00:40:00.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.312+0000 7f19a67509c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:40:00.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.312+0000 7f19a67509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.312+0000 7f19a67509c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:40:00.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.312+0000 7f19a67509c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:40:00.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.312+0000 7f19a67509c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:40:00.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.312+0000 7f19a67509c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 : miss 2024-09-12T00:40:00.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.312+0000 7f19a67509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.312+0000 7f19a67509c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:40:00.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.312+0000 7f19a67509c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 info.flags=0x17 2024-09-12T00:40:00.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.312+0000 7f19a67509c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 to cache LRU end 2024-09-12T00:40:00.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.312+0000 7f19a67509c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:00.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.312+0000 7f19a67509c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:00.313 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.312+0000 7f19a67509c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 2024-09-12T00:40:00.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.316+0000 7f19a67509c0 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 to be held by another RGW process; skipping for now 2024-09-12T00:40:00.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.316+0000 7f185b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:00.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.320+0000 7f19a67509c0 20 remove_watcher() i=0 2024-09-12T00:40:00.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.320+0000 7f19a67509c0 2 removed watcher, disabling cache 2024-09-12T00:40:00.323 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.324+0000 7f19a67509c0 20 remove_watcher() i=1 2024-09-12T00:40:00.325 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.328+0000 7f19a67509c0 20 remove_watcher() i=2 2024-09-12T00:40:00.328 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.328+0000 7f19a67509c0 20 remove_watcher() i=3 2024-09-12T00:40:00.330 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.332+0000 7f19a67509c0 20 remove_watcher() i=4 2024-09-12T00:40:00.331 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.332+0000 7f19a67509c0 20 remove_watcher() i=5 2024-09-12T00:40:00.332 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.332+0000 7f19a67509c0 20 remove_watcher() i=6 2024-09-12T00:40:00.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:00.336+0000 7f19a67509c0 20 remove_watcher() i=7 2024-09-12T00:40:00.347 INFO:tasks.workunit.client.0.smithi043.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:40:30.379 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:40:30.417 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:30.417 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:30.463 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.463+0000 7efeb21ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:30.465 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.463+0000 7efeb21ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:30.465 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.463+0000 7efeb21ab9c0 20 realm 2024-09-12T00:40:30.465 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.463+0000 7efeb21ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:30.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.467+0000 7efeb21ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:30.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.467+0000 7efeb21ab9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:30.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.467+0000 7efeb21ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:30.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.467+0000 7efeb21ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:30.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.467+0000 7efeb21ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:30.467 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.467+0000 7efeb21ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:30.467 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.467+0000 7efeb21ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:30.468 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.467+0000 7efeb21ab9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:30.468 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.467+0000 7efeb21ab9c0 20 searching for the correct realm 2024-09-12T00:40:30.475 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.475+0000 7efeb04b2640 0 -- 172.21.15.43:0/20898956 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7efe9800e430 msgr2=0x7efe9800e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:30.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.691+0000 7efeafcb1640 0 -- 172.21.15.43:0/20898956 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x562f9386bc90 msgr2=0x562f9386e0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:30.699 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.699+0000 7efeb21ab9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:40:30.699 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.699+0000 7efeb21ab9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:30.699 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.699+0000 7efeb21ab9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:30.699 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.699+0000 7efeb21ab9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:40:30.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.699+0000 7efeb21ab9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:30.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.699+0000 7efeb21ab9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:30.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.699+0000 7efeb21ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:30.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.699+0000 7efeb21ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:30.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.699+0000 7efeb21ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:30.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.699+0000 7efeb21ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:30.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.699+0000 7efeb21ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:30.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.703+0000 7efeb21ab9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:30.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.703+0000 7efeb21ab9c0 20 zone default found 2024-09-12T00:40:30.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.703+0000 7efeb21ab9c0 4 Realm: () 2024-09-12T00:40:30.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.703+0000 7efeb21ab9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:40:30.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.703+0000 7efeb21ab9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:40:30.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.703+0000 7efeb21ab9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:30.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.703+0000 7efeb21ab9c0 20 zonegroup default 2024-09-12T00:40:30.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.703+0000 7efeb21ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:30.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.703+0000 7efeb21ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:30.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.703+0000 7efeb21ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:30.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.703+0000 7efeb21ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:30.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.703+0000 7efeb21ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:30.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.703+0000 7efeb21ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:30.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.703+0000 7efeb21ab9c0 20 started sync module instance, tier type = 2024-09-12T00:40:30.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.703+0000 7efeb21ab9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:40:30.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.727+0000 7efeb21ab9c0 20 add_watcher() i=0 2024-09-12T00:40:30.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.727+0000 7efeb21ab9c0 20 add_watcher() i=1 2024-09-12T00:40:30.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.727+0000 7efeb21ab9c0 20 add_watcher() i=2 2024-09-12T00:40:30.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.727+0000 7efeb21ab9c0 20 add_watcher() i=3 2024-09-12T00:40:30.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.727+0000 7efeb21ab9c0 20 add_watcher() i=4 2024-09-12T00:40:30.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.727+0000 7efeb21ab9c0 20 add_watcher() i=5 2024-09-12T00:40:30.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.727+0000 7efeb21ab9c0 20 add_watcher() i=6 2024-09-12T00:40:30.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.727+0000 7efeb21ab9c0 20 add_watcher() i=7 2024-09-12T00:40:30.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.727+0000 7efeb21ab9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:30.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.731+0000 7efd65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:30.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.731+0000 7efeb21ab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:30.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.731+0000 7efeb21ab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:30.731 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.731+0000 7efeb21ab9c0 5 note: GC not initialized 2024-09-12T00:40:30.732 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.731+0000 7efd64fe1640 20 reqs_thread_entry: start 2024-09-12T00:40:30.732 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.731+0000 7efeb21ab9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:30.732 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.731+0000 7efeb21ab9c0 20 Filter name: none 2024-09-12T00:40:30.732 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.731+0000 7efcde7fc640 20 reqs_thread_entry: start 2024-09-12T00:40:30.732 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.731+0000 7efeb21ab9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:40:30.733 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.731+0000 7efeb21ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:30.733 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.731+0000 7efeb21ab9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:40:30.733 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.731+0000 7efeb21ab9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:40:30.733 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.731+0000 7efeb21ab9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:40:30.733 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.731+0000 7efeb21ab9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 : miss 2024-09-12T00:40:30.733 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.731+0000 7efeb21ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:30.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.735+0000 7efeb21ab9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:40:30.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.735+0000 7efeb21ab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 info.flags=0x17 2024-09-12T00:40:30.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.735+0000 7efeb21ab9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 to cache LRU end 2024-09-12T00:40:30.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.735+0000 7efeb21ab9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:30.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.735+0000 7efeb21ab9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:30.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.735+0000 7efeb21ab9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 2024-09-12T00:40:30.736 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.735+0000 7efeb21ab9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:40:30.749 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.747+0000 7efeb21ab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 info.flags=0x17 2024-09-12T00:40:30.749 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.747+0000 7efeb21ab9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 to cache LRU end 2024-09-12T00:40:30.749 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.747+0000 7efeb21ab9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:30.749 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.747+0000 7efeb21ab9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36, ofs0, ns] 2024-09-12T00:40:30.750 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.751+0000 7efd8effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333493 cookie 94762338540416 notifier 7364 bl.length()=923 2024-09-12T00:40:30.750 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.751+0000 7efd8effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 info.flags=0x17 2024-09-12T00:40:30.750 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.751+0000 7efd8effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 to cache LRU end 2024-09-12T00:40:30.750 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.751+0000 7efd8effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:30.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.751+0000 7efeb21ab9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36]): orig_sources= new_sources= 2024-09-12T00:40:30.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.751+0000 7efeb21ab9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36]): potential sources added=[] removed=[] 2024-09-12T00:40:30.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.751+0000 7efeb21ab9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36]): orig_dests= new_dests= 2024-09-12T00:40:30.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.751+0000 7efeb21ab9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36]): potential dests added=[] removed=[] 2024-09-12T00:40:30.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.763+0000 7efeb21ab9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.2.0 2024-09-12T00:40:30.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.763+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.2.0 2024-09-12T00:40:30.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.763+0000 7efeb21ab9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.2.1 2024-09-12T00:40:30.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.763+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.2.1 2024-09-12T00:40:30.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.763+0000 7efeb21ab9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.2.2 2024-09-12T00:40:30.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.763+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.2.2 2024-09-12T00:40:30.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.763+0000 7efeb21ab9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.2.3 2024-09-12T00:40:30.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.763+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.2.3 2024-09-12T00:40:30.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.763+0000 7efeb21ab9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.2.4 2024-09-12T00:40:30.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.763+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.2.4 2024-09-12T00:40:30.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.763+0000 7efeb21ab9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.2.5 2024-09-12T00:40:30.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.763+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.2.5 2024-09-12T00:40:30.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.763+0000 7efeb21ab9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.2.6 2024-09-12T00:40:30.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.763+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.2.6 2024-09-12T00:40:30.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.763+0000 7efeb21ab9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.2.7 2024-09-12T00:40:30.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.763+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.2.7 2024-09-12T00:40:30.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.763+0000 7efeb21ab9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.2.8 2024-09-12T00:40:30.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.763+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.2.8 2024-09-12T00:40:30.766 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.763+0000 7efeb21ab9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.2.9 2024-09-12T00:40:30.766 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.763+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.2.9 2024-09-12T00:40:30.766 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.763+0000 7efeb21ab9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.2.10 2024-09-12T00:40:30.766 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.763+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.2.10 2024-09-12T00:40:30.766 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.763+0000 7efeb21ab9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.2.11 2024-09-12T00:40:30.766 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.763+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.2.11 2024-09-12T00:40:30.766 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.763+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.0 2024-09-12T00:40:30.767 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.763+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.1 2024-09-12T00:40:30.767 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.767+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.2 2024-09-12T00:40:30.767 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.767+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.3 2024-09-12T00:40:30.767 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.767+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.4 2024-09-12T00:40:30.768 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.767+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.5 2024-09-12T00:40:30.769 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.767+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.6 2024-09-12T00:40:30.770 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.771+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.7 2024-09-12T00:40:30.771 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.771+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.8 2024-09-12T00:40:30.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.775+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.9 2024-09-12T00:40:30.774 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.775+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.10 2024-09-12T00:40:30.780 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.779+0000 7efeb21ab9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:30.780 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.779+0000 7efeb21ab9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 2024-09-12T00:40:30.782 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.783+0000 7efeb21ab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 info.flags=0x17 2024-09-12T00:40:30.782 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.783+0000 7efeb21ab9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 to cache LRU end 2024-09-12T00:40:30.782 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.783+0000 7efeb21ab9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:30.782 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.783+0000 7efeb21ab9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36, ofs0, ns] 2024-09-12T00:40:30.783 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.783+0000 7efd8e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333494 cookie 94762338540416 notifier 7364 bl.length()=923 2024-09-12T00:40:30.783 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.783+0000 7efd8e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 info.flags=0x17 2024-09-12T00:40:30.783 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.783+0000 7efd8e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 to cache LRU end 2024-09-12T00:40:30.783 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.783+0000 7efd8e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:30.783 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.783+0000 7efeb21ab9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36]): orig_sources= new_sources= 2024-09-12T00:40:30.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.783+0000 7efeb21ab9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36]): potential sources added=[] removed=[] 2024-09-12T00:40:30.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.783+0000 7efeb21ab9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36]): orig_dests= new_dests= 2024-09-12T00:40:30.784 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.783+0000 7efeb21ab9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36]): potential dests added=[] removed=[] 2024-09-12T00:40:30.788 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.787+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.0 2024-09-12T00:40:30.788 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.787+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.1 2024-09-12T00:40:30.789 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.787+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.2 2024-09-12T00:40:30.789 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.791+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.3 2024-09-12T00:40:30.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.791+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.4 2024-09-12T00:40:30.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.791+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.5 2024-09-12T00:40:30.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.791+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.6 2024-09-12T00:40:30.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.791+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.7 2024-09-12T00:40:30.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.791+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.8 2024-09-12T00:40:30.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.795+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.9 2024-09-12T00:40:30.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.795+0000 7efeb21ab9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36.10 2024-09-12T00:40:30.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.795+0000 7efeb21ab9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:30.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.795+0000 7efeb21ab9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 2024-09-12T00:40:30.796 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.795+0000 7efeb21ab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 info.flags=0x17 2024-09-12T00:40:30.796 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.795+0000 7efeb21ab9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 to cache LRU end 2024-09-12T00:40:30.796 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.795+0000 7efeb21ab9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:30.796 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.795+0000 7efeb21ab9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36, ofs0, ns] 2024-09-12T00:40:30.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.795+0000 7efd8e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333495 cookie 94762338540416 notifier 7364 bl.length()=891 2024-09-12T00:40:30.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.795+0000 7efd8e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 info.flags=0x17 2024-09-12T00:40:30.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.795+0000 7efd8e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 to cache LRU end 2024-09-12T00:40:30.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.795+0000 7efd8e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:30.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.799+0000 7efeb21ab9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36]): orig_sources= new_sources= 2024-09-12T00:40:30.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.799+0000 7efeb21ab9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36]): potential sources added=[] removed=[] 2024-09-12T00:40:30.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.799+0000 7efeb21ab9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36]): orig_dests= new_dests= 2024-09-12T00:40:30.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.799+0000 7efeb21ab9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36]): potential dests added=[] removed=[] 2024-09-12T00:40:30.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.803+0000 7efeb21ab9c0 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-12T00:40:30.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.807+0000 7efd65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:30.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.811+0000 7efeb21ab9c0 20 remove_watcher() i=0 2024-09-12T00:40:30.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.811+0000 7efeb21ab9c0 2 removed watcher, disabling cache 2024-09-12T00:40:30.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.815+0000 7efeb21ab9c0 20 remove_watcher() i=1 2024-09-12T00:40:30.818 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.819+0000 7efeb21ab9c0 20 remove_watcher() i=2 2024-09-12T00:40:30.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.819+0000 7efeb21ab9c0 20 remove_watcher() i=3 2024-09-12T00:40:30.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.823+0000 7efeb21ab9c0 20 remove_watcher() i=4 2024-09-12T00:40:30.824 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.823+0000 7efeb21ab9c0 20 remove_watcher() i=5 2024-09-12T00:40:30.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.827+0000 7efeb21ab9c0 20 remove_watcher() i=6 2024-09-12T00:40:30.827 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.827+0000 7efeb21ab9c0 20 remove_watcher() i=7 2024-09-12T00:40:30.843 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:40:30.876 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:30.876 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:30.920 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.919+0000 7f542b7ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:30.922 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.923+0000 7f542b7ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:30.922 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.923+0000 7f542b7ba9c0 20 realm 2024-09-12T00:40:30.922 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.923+0000 7f542b7ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:30.923 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.923+0000 7f542b7ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:30.923 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.923+0000 7f542b7ba9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:30.923 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.923+0000 7f542b7ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:30.923 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.923+0000 7f542b7ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:30.923 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.923+0000 7f542b7ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:30.924 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.923+0000 7f542b7ba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:30.925 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.923+0000 7f542b7ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:30.925 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.927+0000 7f542b7ba9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:30.926 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.927+0000 7f542b7ba9c0 20 searching for the correct realm 2024-09-12T00:40:30.932 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:30.931+0000 7f5429ac1640 0 -- 172.21.15.43:0/1377648764 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f542001a040 msgr2=0x7f5420009cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:31.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.147+0000 7f54292c0640 0 -- 172.21.15.43:0/1377648764 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x562d15c67780 msgr2=0x562d15c69b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:31.155 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.155+0000 7f542b7ba9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:40:31.155 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.155+0000 7f542b7ba9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:31.155 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.155+0000 7f542b7ba9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:31.155 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.155+0000 7f542b7ba9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:40:31.155 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.155+0000 7f542b7ba9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:31.155 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.155+0000 7f542b7ba9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:31.155 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.155+0000 7f542b7ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:31.156 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.155+0000 7f542b7ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:31.156 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.155+0000 7f542b7ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:31.156 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.155+0000 7f542b7ba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:31.157 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.155+0000 7f542b7ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:31.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.159+0000 7f542b7ba9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:31.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.159+0000 7f542b7ba9c0 20 zone default found 2024-09-12T00:40:31.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.159+0000 7f542b7ba9c0 4 Realm: () 2024-09-12T00:40:31.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.159+0000 7f542b7ba9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:40:31.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.159+0000 7f542b7ba9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:40:31.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.159+0000 7f542b7ba9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:31.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.159+0000 7f542b7ba9c0 20 zonegroup default 2024-09-12T00:40:31.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.159+0000 7f542b7ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:31.159 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.159+0000 7f542b7ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:31.159 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.159+0000 7f542b7ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:31.159 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.159+0000 7f542b7ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:31.159 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.159+0000 7f542b7ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:31.160 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.159+0000 7f542b7ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:31.160 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.159+0000 7f542b7ba9c0 20 started sync module instance, tier type = 2024-09-12T00:40:31.160 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.159+0000 7f542b7ba9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:40:31.183 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.183+0000 7f542b7ba9c0 20 add_watcher() i=0 2024-09-12T00:40:31.183 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.183+0000 7f542b7ba9c0 20 add_watcher() i=1 2024-09-12T00:40:31.183 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.183+0000 7f542b7ba9c0 20 add_watcher() i=2 2024-09-12T00:40:31.183 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.183+0000 7f542b7ba9c0 20 add_watcher() i=3 2024-09-12T00:40:31.184 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.183+0000 7f542b7ba9c0 20 add_watcher() i=4 2024-09-12T00:40:31.184 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.183+0000 7f542b7ba9c0 20 add_watcher() i=5 2024-09-12T00:40:31.184 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.183+0000 7f542b7ba9c0 20 add_watcher() i=6 2024-09-12T00:40:31.185 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.187+0000 7f542b7ba9c0 20 add_watcher() i=7 2024-09-12T00:40:31.185 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.187+0000 7f542b7ba9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:31.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.191+0000 7f52df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:31.190 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.191+0000 7f542b7ba9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:31.190 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.191+0000 7f542b7ba9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:31.190 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.191+0000 7f542b7ba9c0 5 note: GC not initialized 2024-09-12T00:40:31.191 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.191+0000 7f52de7e4640 20 reqs_thread_entry: start 2024-09-12T00:40:31.191 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.191+0000 7f542b7ba9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:31.192 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.191+0000 7f542b7ba9c0 20 Filter name: none 2024-09-12T00:40:31.192 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.191+0000 7f524ffff640 20 reqs_thread_entry: start 2024-09-12T00:40:31.192 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.191+0000 7f542b7ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:31.193 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.191+0000 7f542b7ba9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:40:31.193 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.191+0000 7f542b7ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:31.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.195+0000 7f542b7ba9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:40:31.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.195+0000 7f542b7ba9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:31.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.195+0000 7f542b7ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:31.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.195+0000 7f542b7ba9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:40:31.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.195+0000 7f542b7ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:31.196 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.195+0000 7f542b7ba9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:40:31.196 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.195+0000 7f542b7ba9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:31.199 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.199+0000 7f52df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:31.204 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.203+0000 7f542b7ba9c0 20 remove_watcher() i=0 2024-09-12T00:40:31.204 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.203+0000 7f542b7ba9c0 2 removed watcher, disabling cache 2024-09-12T00:40:31.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.207+0000 7f542b7ba9c0 20 remove_watcher() i=1 2024-09-12T00:40:31.209 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.207+0000 7f542b7ba9c0 20 remove_watcher() i=2 2024-09-12T00:40:31.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.211+0000 7f542b7ba9c0 20 remove_watcher() i=3 2024-09-12T00:40:31.214 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.215+0000 7f542b7ba9c0 20 remove_watcher() i=4 2024-09-12T00:40:31.216 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.215+0000 7f542b7ba9c0 20 remove_watcher() i=5 2024-09-12T00:40:31.217 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.219+0000 7f542b7ba9c0 20 remove_watcher() i=6 2024-09-12T00:40:31.219 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.219+0000 7f542b7ba9c0 20 remove_watcher() i=7 2024-09-12T00:40:31.237 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:31.237 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:40:31.238 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: abort-at-logrecord-writes id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:40:31.238 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:31.240 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:31.240 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:31.244 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:31.244 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:31.288 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:31.288 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:31.337 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-12T00:40:31.337 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:31.339 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:31.339 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:31.363 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:31.363 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:31.409 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:31.409 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:31.430 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:31.430 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:31.452 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:31.452 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:31.471 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:31.471 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:31.491 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:31.492 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:31.511 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:31.511 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:31.531 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:31.531 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:31.551 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:31.551 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:31.571 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:31.571 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:31.590 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:31.590 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:31.610 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:31.611 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:31.632 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:31.632 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:31.656 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:31.656 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:31.676 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:31.676 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:31.695 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:31.695 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:31.715 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:31.715 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:31.733 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:31.733 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:31.751 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:31.751 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:31.770 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:31.770 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:31.788 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:31.788 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:31.804 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:40:31.837 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:31.837 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:31.884 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.883+0000 7f28574fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:31.886 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.887+0000 7f28574fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:31.886 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.887+0000 7f28574fe9c0 20 realm 2024-09-12T00:40:31.886 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.887+0000 7f28574fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:31.886 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.887+0000 7f28574fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:31.886 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.887+0000 7f28574fe9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:31.886 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.887+0000 7f28574fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:31.886 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.887+0000 7f28574fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:31.886 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.887+0000 7f28574fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:31.888 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.887+0000 7f28574fe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:31.888 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.887+0000 7f28574fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:31.888 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.887+0000 7f28574fe9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:31.889 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.887+0000 7f28574fe9c0 20 searching for the correct realm 2024-09-12T00:40:31.895 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:31.895+0000 7f2855805640 0 -- 172.21.15.43:0/3687909665 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f284405da30 msgr2=0x7f28440810c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:32.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.111+0000 7f2855004640 0 -- 172.21.15.43:0/3687909665 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x55e35fe02810 msgr2=0x55e35fe04ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:32.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.119+0000 7f28574fe9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:40:32.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.119+0000 7f28574fe9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:32.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.119+0000 7f28574fe9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:32.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.119+0000 7f28574fe9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:40:32.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.119+0000 7f28574fe9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:32.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.119+0000 7f28574fe9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:32.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.119+0000 7f28574fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.119+0000 7f28574fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.119+0000 7f28574fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.121 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.119+0000 7f28574fe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:32.121 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.119+0000 7f28574fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.123+0000 7f28574fe9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:32.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.123+0000 7f28574fe9c0 20 zone default found 2024-09-12T00:40:32.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.123+0000 7f28574fe9c0 4 Realm: () 2024-09-12T00:40:32.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.123+0000 7f28574fe9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:40:32.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.123+0000 7f28574fe9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:40:32.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.123+0000 7f28574fe9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:32.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.123+0000 7f28574fe9c0 20 zonegroup default 2024-09-12T00:40:32.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.123+0000 7f28574fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.124 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.123+0000 7f28574fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.125 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.123+0000 7f28574fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.125 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.123+0000 7f28574fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.125 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.123+0000 7f28574fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.125 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.123+0000 7f28574fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.125 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.123+0000 7f28574fe9c0 20 started sync module instance, tier type = 2024-09-12T00:40:32.125 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.123+0000 7f28574fe9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:40:32.145 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.143+0000 7f28574fe9c0 20 add_watcher() i=0 2024-09-12T00:40:32.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.143+0000 7f28574fe9c0 20 add_watcher() i=1 2024-09-12T00:40:32.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.143+0000 7f28574fe9c0 20 add_watcher() i=2 2024-09-12T00:40:32.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.143+0000 7f28574fe9c0 20 add_watcher() i=3 2024-09-12T00:40:32.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.143+0000 7f28574fe9c0 20 add_watcher() i=4 2024-09-12T00:40:32.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.143+0000 7f28574fe9c0 20 add_watcher() i=5 2024-09-12T00:40:32.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.147+0000 7f28574fe9c0 20 add_watcher() i=6 2024-09-12T00:40:32.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.147+0000 7f28574fe9c0 20 add_watcher() i=7 2024-09-12T00:40:32.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.147+0000 7f28574fe9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:32.151 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.151+0000 7f270afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:32.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.151+0000 7f28574fe9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:32.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.151+0000 7f28574fe9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:32.152 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.151+0000 7f28574fe9c0 5 note: GC not initialized 2024-09-12T00:40:32.153 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.151+0000 7f2709fe3640 20 reqs_thread_entry: start 2024-09-12T00:40:32.153 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.151+0000 7f28574fe9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:32.153 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.151+0000 7f28574fe9c0 20 Filter name: none 2024-09-12T00:40:32.153 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.155+0000 7f267b7fe640 20 reqs_thread_entry: start 2024-09-12T00:40:32.153 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.155+0000 7f28574fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.155 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.155+0000 7f28574fe9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:40:32.155 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.155+0000 7f28574fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.156 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.155+0000 7f28574fe9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:40:32.156 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.155+0000 7f28574fe9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:32.157 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.155+0000 7f28574fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.159+0000 7f28574fe9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:40:32.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.159+0000 7f28574fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.159 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.159+0000 7f28574fe9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:40:32.159 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.159+0000 7f28574fe9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:32.163 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.163+0000 7f270afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:32.168 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.167+0000 7f28574fe9c0 20 remove_watcher() i=0 2024-09-12T00:40:32.168 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.167+0000 7f28574fe9c0 2 removed watcher, disabling cache 2024-09-12T00:40:32.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.171+0000 7f28574fe9c0 20 remove_watcher() i=1 2024-09-12T00:40:32.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.171+0000 7f28574fe9c0 20 remove_watcher() i=2 2024-09-12T00:40:32.175 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.175+0000 7f28574fe9c0 20 remove_watcher() i=3 2024-09-12T00:40:32.177 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.175+0000 7f28574fe9c0 20 remove_watcher() i=4 2024-09-12T00:40:32.178 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.179+0000 7f28574fe9c0 20 remove_watcher() i=5 2024-09-12T00:40:32.179 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.179+0000 7f28574fe9c0 20 remove_watcher() i=6 2024-09-12T00:40:32.181 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.183+0000 7f28574fe9c0 20 remove_watcher() i=7 2024-09-12T00:40:32.197 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:32.197 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:40:32.197 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-change-reshard-state id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:40:32.198 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:32.198 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-12T00:40:32.234 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:32.235 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:32.278 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.279+0000 7fdfe0df29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.279 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.279+0000 7fdfe0df29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.280 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.279+0000 7fdfe0df29c0 20 realm 2024-09-12T00:40:32.280 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.279+0000 7fdfe0df29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.280 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.279+0000 7fdfe0df29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.280 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.279+0000 7fdfe0df29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:32.280 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.279+0000 7fdfe0df29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.280 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.279+0000 7fdfe0df29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.280 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.279+0000 7fdfe0df29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.281 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.283+0000 7fdfe0df29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:32.282 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.283+0000 7fdfe0df29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.282 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.283+0000 7fdfe0df29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:32.282 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.283+0000 7fdfe0df29c0 20 searching for the correct realm 2024-09-12T00:40:32.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.287+0000 7fdfde0f7640 0 -- 172.21.15.43:0/4015684900 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fdfc8033040 msgr2=0x7fdfc8032410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:32.295 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.295+0000 7fdfdf0f9640 0 -- 172.21.15.43:0/4015684900 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7fdfc8025920 msgr2=0x7fdfc800d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:32.303 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.303+0000 7fdfe0df29c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:40:32.303 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.303+0000 7fdfe0df29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:32.303 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.303+0000 7fdfe0df29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:32.303 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.303+0000 7fdfe0df29c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:40:32.303 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.303+0000 7fdfe0df29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:32.303 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.303+0000 7fdfe0df29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:32.303 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.303+0000 7fdfe0df29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.303 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.303+0000 7fdfe0df29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.303 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.303+0000 7fdfe0df29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.304 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.303+0000 7fdfe0df29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:32.304 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.303+0000 7fdfe0df29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.303+0000 7fdfe0df29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:32.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.303+0000 7fdfe0df29c0 20 zone default found 2024-09-12T00:40:32.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.303+0000 7fdfe0df29c0 4 Realm: () 2024-09-12T00:40:32.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.303+0000 7fdfe0df29c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:40:32.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.303+0000 7fdfe0df29c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:40:32.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.303+0000 7fdfe0df29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:32.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.303+0000 7fdfe0df29c0 20 zonegroup default 2024-09-12T00:40:32.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.303+0000 7fdfe0df29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.305 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.303+0000 7fdfe0df29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.306 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.303+0000 7fdfe0df29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.307+0000 7fdfe0df29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.307+0000 7fdfe0df29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.307+0000 7fdfe0df29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.307+0000 7fdfe0df29c0 20 started sync module instance, tier type = 2024-09-12T00:40:32.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.307+0000 7fdfe0df29c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:40:32.320 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.319+0000 7fdfe0df29c0 20 add_watcher() i=0 2024-09-12T00:40:32.320 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.319+0000 7fdfe0df29c0 20 add_watcher() i=1 2024-09-12T00:40:32.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.319+0000 7fdfe0df29c0 20 add_watcher() i=2 2024-09-12T00:40:32.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.319+0000 7fdfe0df29c0 20 add_watcher() i=3 2024-09-12T00:40:32.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.319+0000 7fdfe0df29c0 20 add_watcher() i=4 2024-09-12T00:40:32.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.319+0000 7fdfe0df29c0 20 add_watcher() i=5 2024-09-12T00:40:32.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.319+0000 7fdfe0df29c0 20 add_watcher() i=6 2024-09-12T00:40:32.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.323+0000 7fdfe0df29c0 20 add_watcher() i=7 2024-09-12T00:40:32.322 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.323+0000 7fdfe0df29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:32.324 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.323+0000 7fde957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:32.325 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.323+0000 7fdfe0df29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:32.325 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.323+0000 7fdfe0df29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:32.325 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.323+0000 7fdfe0df29c0 5 note: GC not initialized 2024-09-12T00:40:32.325 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.323+0000 7fde0ffff640 20 reqs_thread_entry: start 2024-09-12T00:40:32.325 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.323+0000 7fdfe0df29c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:32.325 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.323+0000 7fdfe0df29c0 20 Filter name: none 2024-09-12T00:40:32.326 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.323+0000 7fde0dffb640 20 reqs_thread_entry: start 2024-09-12T00:40:32.326 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.327+0000 7fdfe0df29c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:40:32.326 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.327+0000 7fdfe0df29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.326 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.327+0000 7fdfe0df29c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:40:32.326 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.327+0000 7fdfe0df29c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:40:32.326 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.327+0000 7fdfe0df29c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:40:32.326 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.327+0000 7fdfe0df29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 : miss 2024-09-12T00:40:32.326 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.327+0000 7fdfe0df29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.327 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.327+0000 7fdfe0df29c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:40:32.327 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.327+0000 7fdfe0df29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 info.flags=0x17 2024-09-12T00:40:32.327 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.327+0000 7fdfe0df29c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 to cache LRU end 2024-09-12T00:40:32.327 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.327+0000 7fdfe0df29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:32.327 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.327+0000 7fdfe0df29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:32.327 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.327+0000 7fdfe0df29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 2024-09-12T00:40:32.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.339+0000 7fdfe0df29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 info.flags=0x17 2024-09-12T00:40:32.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.339+0000 7fdfe0df29c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 to cache LRU end 2024-09-12T00:40:32.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.339+0000 7fdfe0df29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:32.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.339+0000 7fdfe0df29c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37, ofs0, ns] 2024-09-12T00:40:32.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.339+0000 7fdec27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333513 cookie 93888744763056 notifier 7755 bl.length()=931 2024-09-12T00:40:32.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.339+0000 7fdec27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 info.flags=0x17 2024-09-12T00:40:32.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.339+0000 7fdec27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 to cache LRU end 2024-09-12T00:40:32.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.339+0000 7fdec27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:32.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.339+0000 7fdfe0df29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37]): orig_sources= new_sources= 2024-09-12T00:40:32.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.339+0000 7fdfe0df29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37]): potential sources added=[] removed=[] 2024-09-12T00:40:32.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.339+0000 7fdfe0df29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37]): orig_dests= new_dests= 2024-09-12T00:40:32.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.339+0000 7fdfe0df29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37]): potential dests added=[] removed=[] 2024-09-12T00:40:32.353 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.351+0000 7fdfe0df29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.0 2024-09-12T00:40:32.353 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.351+0000 7fdfe0df29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.0 2024-09-12T00:40:32.353 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.351+0000 7fdfe0df29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.1 2024-09-12T00:40:32.353 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.351+0000 7fdfe0df29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.1 2024-09-12T00:40:32.353 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.351+0000 7fdfe0df29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.2 2024-09-12T00:40:32.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.351+0000 7fdfe0df29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.2 2024-09-12T00:40:32.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.351+0000 7fdfe0df29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.3 2024-09-12T00:40:32.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.351+0000 7fdfe0df29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.3 2024-09-12T00:40:32.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.351+0000 7fdfe0df29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.4 2024-09-12T00:40:32.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.351+0000 7fdfe0df29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.4 2024-09-12T00:40:32.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.351+0000 7fdfe0df29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.5 2024-09-12T00:40:32.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.351+0000 7fdfe0df29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.5 2024-09-12T00:40:32.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.351+0000 7fdfe0df29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.6 2024-09-12T00:40:32.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.351+0000 7fdfe0df29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.6 2024-09-12T00:40:32.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.351+0000 7fdfe0df29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.7 2024-09-12T00:40:32.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.351+0000 7fdfe0df29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.7 2024-09-12T00:40:32.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.351+0000 7fdfe0df29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.8 2024-09-12T00:40:32.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.351+0000 7fdfe0df29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.8 2024-09-12T00:40:32.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.351+0000 7fdfe0df29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.9 2024-09-12T00:40:32.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.351+0000 7fdfe0df29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.9 2024-09-12T00:40:32.355 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.351+0000 7fdfe0df29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.10 2024-09-12T00:40:32.356 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.351+0000 7fdfe0df29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.10 2024-09-12T00:40:32.356 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.351+0000 7fdfe0df29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.11 2024-09-12T00:40:32.356 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.351+0000 7fdfe0df29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.11 2024-09-12T00:40:32.356 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.351+0000 7fdfe0df29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.0 2024-09-12T00:40:32.356 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.355+0000 7fdfe0df29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1 2024-09-12T00:40:32.357 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.355+0000 7fdfe0df29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.2 2024-09-12T00:40:32.357 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.355+0000 7fdfe0df29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.3 2024-09-12T00:40:32.357 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.355+0000 7fdfe0df29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.4 2024-09-12T00:40:32.357 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.359+0000 7fdfe0df29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.5 2024-09-12T00:40:32.359 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.359+0000 7fdfe0df29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.6 2024-09-12T00:40:32.360 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.359+0000 7fdfe0df29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.7 2024-09-12T00:40:32.361 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.359+0000 7fdfe0df29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.8 2024-09-12T00:40:32.362 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.363+0000 7fdfe0df29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.9 2024-09-12T00:40:32.363 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.363+0000 7fdfe0df29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.10 2024-09-12T00:40:32.368 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.367+0000 7fdfe0df29c0 -1 Injecting error=-5 at location=change_reshard_state 2024-09-12T00:40:32.368 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.367+0000 7fdfe0df29c0 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-12T00:40:32.391 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.391+0000 7fdfe0df29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:32.391 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.391+0000 7fdfe0df29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 2024-09-12T00:40:32.393 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.395+0000 7fdfe0df29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 info.flags=0x17 2024-09-12T00:40:32.394 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.395+0000 7fdfe0df29c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 to cache LRU end 2024-09-12T00:40:32.394 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.395+0000 7fdfe0df29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:32.394 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.395+0000 7fdfe0df29c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37, ofs0, ns] 2024-09-12T00:40:32.395 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.395+0000 7fdec27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333514 cookie 93888744763056 notifier 7755 bl.length()=899 2024-09-12T00:40:32.395 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.395+0000 7fdec27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 info.flags=0x17 2024-09-12T00:40:32.395 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.395+0000 7fdec27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 to cache LRU end 2024-09-12T00:40:32.395 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.395+0000 7fdec27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:32.396 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.395+0000 7fdfe0df29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37]): orig_sources= new_sources= 2024-09-12T00:40:32.396 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.395+0000 7fdfe0df29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37]): potential sources added=[] removed=[] 2024-09-12T00:40:32.396 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.395+0000 7fdfe0df29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37]): orig_dests= new_dests= 2024-09-12T00:40:32.396 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.395+0000 7fdfe0df29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37]): potential dests added=[] removed=[] 2024-09-12T00:40:32.396 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.395+0000 7fdfe0df29c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-12T00:40:32.398 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.399+0000 7fde957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:32.402 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.403+0000 7fdfe0df29c0 20 remove_watcher() i=0 2024-09-12T00:40:32.403 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.403+0000 7fdfe0df29c0 2 removed watcher, disabling cache 2024-09-12T00:40:32.405 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.403+0000 7fdfe0df29c0 20 remove_watcher() i=1 2024-09-12T00:40:32.406 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.407+0000 7fdfe0df29c0 20 remove_watcher() i=2 2024-09-12T00:40:32.408 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.407+0000 7fdfe0df29c0 20 remove_watcher() i=3 2024-09-12T00:40:32.410 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.411+0000 7fdfe0df29c0 20 remove_watcher() i=4 2024-09-12T00:40:32.412 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.411+0000 7fdfe0df29c0 20 remove_watcher() i=5 2024-09-12T00:40:32.413 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.415+0000 7fdfe0df29c0 20 remove_watcher() i=6 2024-09-12T00:40:32.414 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.415+0000 7fdfe0df29c0 20 remove_watcher() i=7 2024-09-12T00:40:32.431 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:40:32.461 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:32.461 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:32.505 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.503+0000 7f416a4cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.507+0000 7f416a4cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.507+0000 7f416a4cb9c0 20 realm 2024-09-12T00:40:32.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.507+0000 7f416a4cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.507 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.507+0000 7f416a4cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.507 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.507+0000 7f416a4cb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:32.507 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.507+0000 7f416a4cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.507 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.507+0000 7f416a4cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.507 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.507+0000 7f416a4cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.508 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.507+0000 7f416a4cb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:32.508 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.507+0000 7f416a4cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.511+0000 7f416a4cb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:32.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.511+0000 7f416a4cb9c0 20 searching for the correct realm 2024-09-12T00:40:32.515 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.515+0000 7f41677d0640 0 -- 172.21.15.43:0/1085676863 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f415c041040 msgr2=0x7f415c040920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:32.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.523+0000 7f41677d0640 0 -- 172.21.15.43:0/1085676863 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f4030080be0 msgr2=0x7f4030083010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:32.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.527+0000 7f416a4cb9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:40:32.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.527+0000 7f416a4cb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:32.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.527+0000 7f416a4cb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:32.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.527+0000 7f416a4cb9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:40:32.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.527+0000 7f416a4cb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:32.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.527+0000 7f416a4cb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:32.529 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.527+0000 7f416a4cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.529 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.527+0000 7f416a4cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.529 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.527+0000 7f416a4cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.527+0000 7f416a4cb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:32.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.527+0000 7f416a4cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.531+0000 7f416a4cb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:32.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.531+0000 7f416a4cb9c0 20 zone default found 2024-09-12T00:40:32.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.531+0000 7f416a4cb9c0 4 Realm: () 2024-09-12T00:40:32.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.531+0000 7f416a4cb9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:40:32.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.531+0000 7f416a4cb9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:40:32.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.531+0000 7f416a4cb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:32.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.531+0000 7f416a4cb9c0 20 zonegroup default 2024-09-12T00:40:32.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.531+0000 7f416a4cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.531+0000 7f416a4cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.531+0000 7f416a4cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.531+0000 7f416a4cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.531+0000 7f416a4cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.531+0000 7f416a4cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.532 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.531+0000 7f416a4cb9c0 20 started sync module instance, tier type = 2024-09-12T00:40:32.532 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.531+0000 7f416a4cb9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:40:32.546 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.547+0000 7f416a4cb9c0 20 add_watcher() i=0 2024-09-12T00:40:32.546 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.547+0000 7f416a4cb9c0 20 add_watcher() i=1 2024-09-12T00:40:32.546 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.547+0000 7f416a4cb9c0 20 add_watcher() i=2 2024-09-12T00:40:32.546 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.547+0000 7f416a4cb9c0 20 add_watcher() i=3 2024-09-12T00:40:32.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.547+0000 7f416a4cb9c0 20 add_watcher() i=4 2024-09-12T00:40:32.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.547+0000 7f416a4cb9c0 20 add_watcher() i=5 2024-09-12T00:40:32.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.547+0000 7f416a4cb9c0 20 add_watcher() i=6 2024-09-12T00:40:32.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.547+0000 7f416a4cb9c0 20 add_watcher() i=7 2024-09-12T00:40:32.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.547+0000 7f416a4cb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:32.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.551+0000 7f401dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:32.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.551+0000 7f416a4cb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:32.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.551+0000 7f416a4cb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:32.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.551+0000 7f416a4cb9c0 5 note: GC not initialized 2024-09-12T00:40:32.551 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.551+0000 7f401cfe1640 20 reqs_thread_entry: start 2024-09-12T00:40:32.551 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.551+0000 7f416a4cb9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:32.551 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.551+0000 7f416a4cb9c0 20 Filter name: none 2024-09-12T00:40:32.551 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.551+0000 7f3f967fc640 20 reqs_thread_entry: start 2024-09-12T00:40:32.551 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.551+0000 7f416a4cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.551 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.551+0000 7f416a4cb9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:40:32.551 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.551+0000 7f416a4cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.553 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.551+0000 7f416a4cb9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:40:32.553 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.551+0000 7f416a4cb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:32.553 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.551+0000 7f416a4cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.553 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.555+0000 7f416a4cb9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:40:32.553 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.555+0000 7f416a4cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.554 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.555+0000 7f416a4cb9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:40:32.554 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.555+0000 7f416a4cb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:32.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.559+0000 7f401dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:32.562 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.563+0000 7f416a4cb9c0 20 remove_watcher() i=0 2024-09-12T00:40:32.562 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.563+0000 7f416a4cb9c0 2 removed watcher, disabling cache 2024-09-12T00:40:32.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.563+0000 7f416a4cb9c0 20 remove_watcher() i=1 2024-09-12T00:40:32.566 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.567+0000 7f416a4cb9c0 20 remove_watcher() i=2 2024-09-12T00:40:32.568 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.567+0000 7f416a4cb9c0 20 remove_watcher() i=3 2024-09-12T00:40:32.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.571+0000 7f416a4cb9c0 20 remove_watcher() i=4 2024-09-12T00:40:32.571 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.571+0000 7f416a4cb9c0 20 remove_watcher() i=5 2024-09-12T00:40:32.572 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.571+0000 7f416a4cb9c0 20 remove_watcher() i=6 2024-09-12T00:40:32.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.575+0000 7f416a4cb9c0 20 remove_watcher() i=7 2024-09-12T00:40:32.586 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:32.587 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:40:32.587 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-change-reshard-state id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:40:32.587 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:32.589 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:32.589 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:32.600 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:32.600 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:32.643 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:40:32.673 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:32.673 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:32.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.715+0000 7f53b483c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.719+0000 7f53b483c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.719+0000 7f53b483c9c0 20 realm 2024-09-12T00:40:32.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.719+0000 7f53b483c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.719+0000 7f53b483c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.719+0000 7f53b483c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:32.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.719+0000 7f53b483c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.719+0000 7f53b483c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.719+0000 7f53b483c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.723+0000 7f53b483c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:32.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.723+0000 7f53b483c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.723+0000 7f53b483c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:32.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.723+0000 7f53b483c9c0 20 searching for the correct realm 2024-09-12T00:40:32.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.727+0000 7f53b2b43640 0 -- 172.21.15.43:0/2374301225 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x561202f76640 msgr2=0x561202f78ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:32.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.735+0000 7f53b1b41640 0 -- 172.21.15.43:0/2374301225 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f53a803e070 msgr2=0x7f53a808e400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:32.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.739+0000 7f53b483c9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:40:32.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.739+0000 7f53b483c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:32.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.739+0000 7f53b483c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:32.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.739+0000 7f53b483c9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:40:32.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.739+0000 7f53b483c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:32.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.739+0000 7f53b483c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:32.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.739+0000 7f53b483c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.741 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.743+0000 7f53b483c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.742 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.743+0000 7f53b483c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.742 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.743+0000 7f53b483c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:32.743 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.743+0000 7f53b483c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.743 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.743+0000 7f53b483c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:32.743 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.743+0000 7f53b483c9c0 20 zone default found 2024-09-12T00:40:32.743 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.743+0000 7f53b483c9c0 4 Realm: () 2024-09-12T00:40:32.743 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.743+0000 7f53b483c9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:40:32.743 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.743+0000 7f53b483c9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:40:32.743 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.743+0000 7f53b483c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:32.743 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.743+0000 7f53b483c9c0 20 zonegroup default 2024-09-12T00:40:32.743 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.743+0000 7f53b483c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.743 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.743+0000 7f53b483c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.743 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.743+0000 7f53b483c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.743+0000 7f53b483c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.743+0000 7f53b483c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.743+0000 7f53b483c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.743+0000 7f53b483c9c0 20 started sync module instance, tier type = 2024-09-12T00:40:32.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.743+0000 7f53b483c9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:40:32.760 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.759+0000 7f53b483c9c0 20 add_watcher() i=0 2024-09-12T00:40:32.760 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.759+0000 7f53b483c9c0 20 add_watcher() i=1 2024-09-12T00:40:32.760 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.759+0000 7f53b483c9c0 20 add_watcher() i=2 2024-09-12T00:40:32.760 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.759+0000 7f53b483c9c0 20 add_watcher() i=3 2024-09-12T00:40:32.760 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.759+0000 7f53b483c9c0 20 add_watcher() i=4 2024-09-12T00:40:32.760 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.759+0000 7f53b483c9c0 20 add_watcher() i=5 2024-09-12T00:40:32.760 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.759+0000 7f53b483c9c0 20 add_watcher() i=6 2024-09-12T00:40:32.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.759+0000 7f53b483c9c0 20 add_watcher() i=7 2024-09-12T00:40:32.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.759+0000 7f53b483c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:32.763 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.763+0000 7f5268fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:32.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.763+0000 7f53b483c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:32.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.763+0000 7f53b483c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:32.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.763+0000 7f53b483c9c0 5 note: GC not initialized 2024-09-12T00:40:32.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.763+0000 7f51e37fe640 20 reqs_thread_entry: start 2024-09-12T00:40:32.764 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.763+0000 7f53b483c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:32.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.763+0000 7f53b483c9c0 20 Filter name: none 2024-09-12T00:40:32.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.763+0000 7f51e17fa640 20 reqs_thread_entry: start 2024-09-12T00:40:32.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.763+0000 7f53b483c9c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:40:32.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.763+0000 7f53b483c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.763+0000 7f53b483c9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:40:32.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.763+0000 7f53b483c9c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:40:32.766 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.763+0000 7f53b483c9c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:40:32.766 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.763+0000 7f53b483c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 : miss 2024-09-12T00:40:32.766 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.763+0000 7f53b483c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.766 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.767+0000 7f53b483c9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:40:32.766 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.767+0000 7f53b483c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 info.flags=0x17 2024-09-12T00:40:32.766 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.767+0000 7f53b483c9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 to cache LRU end 2024-09-12T00:40:32.767 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.767+0000 7f53b483c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:32.767 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.767+0000 7f53b483c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:32.767 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.767+0000 7f53b483c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 2024-09-12T00:40:32.776 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.775+0000 7f53b483c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 info.flags=0x17 2024-09-12T00:40:32.776 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.775+0000 7f53b483c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 to cache LRU end 2024-09-12T00:40:32.776 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.775+0000 7f53b483c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:32.776 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.775+0000 7f53b483c9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37, ofs0, ns] 2024-09-12T00:40:32.777 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.775+0000 7f5295ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333515 cookie 94635359246624 notifier 7448 bl.length()=931 2024-09-12T00:40:32.777 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.775+0000 7f5295ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 info.flags=0x17 2024-09-12T00:40:32.777 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.775+0000 7f5295ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 to cache LRU end 2024-09-12T00:40:32.777 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.775+0000 7f5295ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:32.777 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.775+0000 7f53b483c9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37]): orig_sources= new_sources= 2024-09-12T00:40:32.778 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.775+0000 7f53b483c9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37]): potential sources added=[] removed=[] 2024-09-12T00:40:32.778 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.775+0000 7f53b483c9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37]): orig_dests= new_dests= 2024-09-12T00:40:32.778 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.775+0000 7f53b483c9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37]): potential dests added=[] removed=[] 2024-09-12T00:40:32.789 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.791+0000 7f53b483c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.0 2024-09-12T00:40:32.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.791+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.0 2024-09-12T00:40:32.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.791+0000 7f53b483c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.1 2024-09-12T00:40:32.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.791+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.1 2024-09-12T00:40:32.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.791+0000 7f53b483c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.2 2024-09-12T00:40:32.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.791+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.2 2024-09-12T00:40:32.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.791+0000 7f53b483c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.3 2024-09-12T00:40:32.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.791+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.3 2024-09-12T00:40:32.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.791+0000 7f53b483c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.4 2024-09-12T00:40:32.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.791+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.4 2024-09-12T00:40:32.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.791+0000 7f53b483c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.5 2024-09-12T00:40:32.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.791+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.5 2024-09-12T00:40:32.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.791+0000 7f53b483c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.6 2024-09-12T00:40:32.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.791+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.6 2024-09-12T00:40:32.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.791+0000 7f53b483c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.7 2024-09-12T00:40:32.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.791+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.7 2024-09-12T00:40:32.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.791+0000 7f53b483c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.8 2024-09-12T00:40:32.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.791+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.8 2024-09-12T00:40:32.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.791+0000 7f53b483c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.9 2024-09-12T00:40:32.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.791+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.9 2024-09-12T00:40:32.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.791+0000 7f53b483c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.10 2024-09-12T00:40:32.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.791+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.10 2024-09-12T00:40:32.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.791+0000 7f53b483c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.11 2024-09-12T00:40:32.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.791+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1.11 2024-09-12T00:40:32.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.791+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.0 2024-09-12T00:40:32.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.791+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1 2024-09-12T00:40:32.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.791+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.2 2024-09-12T00:40:32.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.791+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.3 2024-09-12T00:40:32.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.795+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.4 2024-09-12T00:40:32.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.795+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.5 2024-09-12T00:40:32.796 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.795+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.6 2024-09-12T00:40:32.796 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.795+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.7 2024-09-12T00:40:32.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.799+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.8 2024-09-12T00:40:32.799 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.799+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.9 2024-09-12T00:40:32.801 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.799+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.10 2024-09-12T00:40:32.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.807+0000 7f53b483c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:32.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.807+0000 7f53b483c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 2024-09-12T00:40:32.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.807+0000 7f53b483c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 info.flags=0x17 2024-09-12T00:40:32.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.807+0000 7f53b483c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 to cache LRU end 2024-09-12T00:40:32.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.807+0000 7f53b483c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:32.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.807+0000 7f53b483c9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37, ofs0, ns] 2024-09-12T00:40:32.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.811+0000 7f5295ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333516 cookie 94635359246624 notifier 7448 bl.length()=931 2024-09-12T00:40:32.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.811+0000 7f5295ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 info.flags=0x17 2024-09-12T00:40:32.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.811+0000 7f5295ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 to cache LRU end 2024-09-12T00:40:32.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.811+0000 7f5295ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:32.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.811+0000 7f53b483c9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37]): orig_sources= new_sources= 2024-09-12T00:40:32.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.811+0000 7f53b483c9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37]): potential sources added=[] removed=[] 2024-09-12T00:40:32.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.811+0000 7f53b483c9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37]): orig_dests= new_dests= 2024-09-12T00:40:32.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.811+0000 7f53b483c9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37]): potential dests added=[] removed=[] 2024-09-12T00:40:32.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.819+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.0 2024-09-12T00:40:32.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.819+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.1 2024-09-12T00:40:32.821 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.823+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.2 2024-09-12T00:40:32.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.823+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.3 2024-09-12T00:40:32.823 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.823+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.4 2024-09-12T00:40:32.823 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.823+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.5 2024-09-12T00:40:32.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.823+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.6 2024-09-12T00:40:32.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.827+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.7 2024-09-12T00:40:32.826 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.827+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.8 2024-09-12T00:40:32.827 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.827+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.9 2024-09-12T00:40:32.828 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.827+0000 7f53b483c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37.10 2024-09-12T00:40:32.829 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.827+0000 7f53b483c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:32.829 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.831+0000 7f53b483c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 2024-09-12T00:40:32.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.831+0000 7f53b483c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 info.flags=0x17 2024-09-12T00:40:32.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.831+0000 7f53b483c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 to cache LRU end 2024-09-12T00:40:32.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.831+0000 7f53b483c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:32.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.831+0000 7f53b483c9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37, ofs0, ns] 2024-09-12T00:40:32.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.831+0000 7f5295ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333517 cookie 94635359246624 notifier 7448 bl.length()=899 2024-09-12T00:40:32.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.831+0000 7f5295ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 info.flags=0x17 2024-09-12T00:40:32.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.831+0000 7f5295ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 to cache LRU end 2024-09-12T00:40:32.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.831+0000 7f5295ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:32.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.831+0000 7f53b483c9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37]): orig_sources= new_sources= 2024-09-12T00:40:32.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.831+0000 7f53b483c9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37]): potential sources added=[] removed=[] 2024-09-12T00:40:32.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.831+0000 7f53b483c9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37]): orig_dests= new_dests= 2024-09-12T00:40:32.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.831+0000 7f53b483c9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37]): potential dests added=[] removed=[] 2024-09-12T00:40:32.839 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.839+0000 7f53b483c9c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T00:40:32.844 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.843+0000 7f5268fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:32.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.847+0000 7f53b483c9c0 20 remove_watcher() i=0 2024-09-12T00:40:32.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.847+0000 7f53b483c9c0 2 removed watcher, disabling cache 2024-09-12T00:40:32.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.851+0000 7f53b483c9c0 20 remove_watcher() i=1 2024-09-12T00:40:32.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.855+0000 7f53b483c9c0 20 remove_watcher() i=2 2024-09-12T00:40:32.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.855+0000 7f53b483c9c0 20 remove_watcher() i=3 2024-09-12T00:40:32.858 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.859+0000 7f53b483c9c0 20 remove_watcher() i=4 2024-09-12T00:40:32.859 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.859+0000 7f53b483c9c0 20 remove_watcher() i=5 2024-09-12T00:40:32.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.863+0000 7f53b483c9c0 20 remove_watcher() i=6 2024-09-12T00:40:32.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.863+0000 7f53b483c9c0 20 remove_watcher() i=7 2024-09-12T00:40:32.879 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:40:32.913 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:32.913 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:32.958 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.959+0000 7fe8002e69c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.959 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.959+0000 7fe8002e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.959 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.959+0000 7fe8002e69c0 20 realm 2024-09-12T00:40:32.959 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.959+0000 7fe8002e69c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.960 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.959+0000 7fe8002e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.960 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.959+0000 7fe8002e69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:32.960 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.959+0000 7fe8002e69c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.960 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.959+0000 7fe8002e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.960 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.959+0000 7fe8002e69c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.962 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.963+0000 7fe8002e69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:32.962 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.963+0000 7fe8002e69c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.962 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.963+0000 7fe8002e69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:32.963 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.963+0000 7fe8002e69c0 20 searching for the correct realm 2024-09-12T00:40:32.969 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.967+0000 7fe7fd5eb640 0 -- 172.21.15.43:0/1208379873 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fe7f40d6070 msgr2=0x7fe7f40d7970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:32.975 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.975+0000 7fe7fd5eb640 0 -- 172.21.15.43:0/1208379873 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fe6c8080b80 msgr2=0x7fe6c8082fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:32.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.983+0000 7fe8002e69c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:40:32.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.983+0000 7fe8002e69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:32.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.983+0000 7fe8002e69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:32.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.983+0000 7fe8002e69c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:40:32.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.983+0000 7fe8002e69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:32.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.983+0000 7fe8002e69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:32.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.983+0000 7fe8002e69c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.983 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.983+0000 7fe8002e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.983 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.983+0000 7fe8002e69c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.983+0000 7fe8002e69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:32.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.983+0000 7fe8002e69c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.983+0000 7fe8002e69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:32.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.983+0000 7fe8002e69c0 20 zone default found 2024-09-12T00:40:32.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.983+0000 7fe8002e69c0 4 Realm: () 2024-09-12T00:40:32.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.983+0000 7fe8002e69c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:40:32.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.983+0000 7fe8002e69c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:40:32.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.983+0000 7fe8002e69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:32.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.983+0000 7fe8002e69c0 20 zonegroup default 2024-09-12T00:40:32.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.983+0000 7fe8002e69c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.985 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.983+0000 7fe8002e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.985 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.983+0000 7fe8002e69c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.985 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.983+0000 7fe8002e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.985 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.983+0000 7fe8002e69c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:32.985 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.983+0000 7fe8002e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:32.986 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.983+0000 7fe8002e69c0 20 started sync module instance, tier type = 2024-09-12T00:40:32.986 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:32.983+0000 7fe8002e69c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:40:33.001 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.003+0000 7fe8002e69c0 20 add_watcher() i=0 2024-09-12T00:40:33.002 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.003+0000 7fe8002e69c0 20 add_watcher() i=1 2024-09-12T00:40:33.002 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.003+0000 7fe8002e69c0 20 add_watcher() i=2 2024-09-12T00:40:33.002 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.003+0000 7fe8002e69c0 20 add_watcher() i=3 2024-09-12T00:40:33.002 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.003+0000 7fe8002e69c0 20 add_watcher() i=4 2024-09-12T00:40:33.002 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.003+0000 7fe8002e69c0 20 add_watcher() i=5 2024-09-12T00:40:33.002 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.003+0000 7fe8002e69c0 20 add_watcher() i=6 2024-09-12T00:40:33.003 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.003+0000 7fe8002e69c0 20 add_watcher() i=7 2024-09-12T00:40:33.003 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.003+0000 7fe8002e69c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:33.005 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.007+0000 7fe6a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:33.006 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.007+0000 7fe8002e69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:33.006 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.007+0000 7fe8002e69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:33.006 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.007+0000 7fe8002e69c0 5 note: GC not initialized 2024-09-12T00:40:33.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.007+0000 7fe6a67fc640 20 reqs_thread_entry: start 2024-09-12T00:40:33.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.007+0000 7fe8002e69c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:33.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.007+0000 7fe8002e69c0 20 Filter name: none 2024-09-12T00:40:33.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.007+0000 7fe623fff640 20 reqs_thread_entry: start 2024-09-12T00:40:33.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.007+0000 7fe8002e69c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:33.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.007+0000 7fe8002e69c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:40:33.008 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.007+0000 7fe8002e69c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:33.009 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.007+0000 7fe8002e69c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:40:33.009 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.007+0000 7fe8002e69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:33.009 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.007+0000 7fe8002e69c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:33.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.011+0000 7fe8002e69c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:40:33.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.011+0000 7fe8002e69c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:33.011 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.011+0000 7fe8002e69c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:40:33.011 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.011+0000 7fe8002e69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:33.013 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.011+0000 7fe6a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:33.017 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.019+0000 7fe8002e69c0 20 remove_watcher() i=0 2024-09-12T00:40:33.017 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.019+0000 7fe8002e69c0 2 removed watcher, disabling cache 2024-09-12T00:40:33.019 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.019+0000 7fe8002e69c0 20 remove_watcher() i=1 2024-09-12T00:40:33.021 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.023+0000 7fe8002e69c0 20 remove_watcher() i=2 2024-09-12T00:40:33.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.023+0000 7fe8002e69c0 20 remove_watcher() i=3 2024-09-12T00:40:33.026 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.027+0000 7fe8002e69c0 20 remove_watcher() i=4 2024-09-12T00:40:33.027 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.027+0000 7fe8002e69c0 20 remove_watcher() i=5 2024-09-12T00:40:33.028 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.027+0000 7fe8002e69c0 20 remove_watcher() i=6 2024-09-12T00:40:33.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.031+0000 7fe8002e69c0 20 remove_watcher() i=7 2024-09-12T00:40:33.044 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:33.044 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:40:33.044 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-change-reshard-state id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:40:33.044 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:33.045 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:33.045 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:33.048 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:33.048 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:33.096 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:33.096 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:33.141 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-12T00:40:33.141 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:33.142 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:33.142 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:33.162 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:33.163 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:33.207 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:33.207 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:33.226 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:33.226 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:33.245 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:33.245 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:33.263 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:33.263 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:33.284 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:33.285 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:33.302 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:33.303 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:33.321 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:33.321 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:33.340 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:33.340 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:33.358 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:33.358 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:33.375 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:33.375 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:33.395 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:33.395 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:33.413 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:33.413 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:33.433 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:33.434 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:33.452 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:33.452 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:33.470 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:33.470 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:33.489 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:33.489 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:33.508 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:33.508 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:33.526 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:33.526 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:33.543 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:33.544 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:33.564 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:33.564 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:33.582 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:40:33.616 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:33.616 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:33.663 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.663+0000 7fecb20ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:33.665 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.667+0000 7fecb20ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:33.665 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.667+0000 7fecb20ec9c0 20 realm 2024-09-12T00:40:33.665 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.667+0000 7fecb20ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:33.665 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.667+0000 7fecb20ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:33.666 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.667+0000 7fecb20ec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:33.666 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.667+0000 7fecb20ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:33.666 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.667+0000 7fecb20ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:33.666 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.667+0000 7fecb20ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:33.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.667+0000 7fecb20ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:33.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.667+0000 7fecb20ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:33.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.667+0000 7fecb20ec9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:33.669 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.667+0000 7fecb20ec9c0 20 searching for the correct realm 2024-09-12T00:40:33.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.675+0000 7feca73f1640 0 -- 172.21.15.43:0/573176134 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55e005dfd5f0 msgr2=0x55e005dffa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:33.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.679+0000 7fecafbf2640 0 -- 172.21.15.43:0/573176134 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fec9805f400 msgr2=0x7fec9805f880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:33.689 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.687+0000 7fecb20ec9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:40:33.689 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.687+0000 7fecb20ec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:33.689 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.687+0000 7fecb20ec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:33.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.687+0000 7fecb20ec9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:40:33.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.687+0000 7fecb20ec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:33.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.687+0000 7fecb20ec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:33.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.687+0000 7fecb20ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:33.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.691+0000 7fecb20ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:33.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.691+0000 7fecb20ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:33.691 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.691+0000 7fecb20ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:33.691 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.691+0000 7fecb20ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:33.691 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.691+0000 7fecb20ec9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:33.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.691+0000 7fecb20ec9c0 20 zone default found 2024-09-12T00:40:33.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.691+0000 7fecb20ec9c0 4 Realm: () 2024-09-12T00:40:33.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.691+0000 7fecb20ec9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:40:33.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.691+0000 7fecb20ec9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:40:33.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.691+0000 7fecb20ec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:33.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.691+0000 7fecb20ec9c0 20 zonegroup default 2024-09-12T00:40:33.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.691+0000 7fecb20ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:33.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.691+0000 7fecb20ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:33.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.691+0000 7fecb20ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:33.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.691+0000 7fecb20ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:33.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.691+0000 7fecb20ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:33.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.691+0000 7fecb20ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:33.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.691+0000 7fecb20ec9c0 20 started sync module instance, tier type = 2024-09-12T00:40:33.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.691+0000 7fecb20ec9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:40:33.708 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.707+0000 7fecb20ec9c0 20 add_watcher() i=0 2024-09-12T00:40:33.708 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.707+0000 7fecb20ec9c0 20 add_watcher() i=1 2024-09-12T00:40:33.708 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.707+0000 7fecb20ec9c0 20 add_watcher() i=2 2024-09-12T00:40:33.709 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.707+0000 7fecb20ec9c0 20 add_watcher() i=3 2024-09-12T00:40:33.709 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.707+0000 7fecb20ec9c0 20 add_watcher() i=4 2024-09-12T00:40:33.709 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.707+0000 7fecb20ec9c0 20 add_watcher() i=5 2024-09-12T00:40:33.709 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.707+0000 7fecb20ec9c0 20 add_watcher() i=6 2024-09-12T00:40:33.709 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.711+0000 7fecb20ec9c0 20 add_watcher() i=7 2024-09-12T00:40:33.709 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.711+0000 7fecb20ec9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:33.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.711+0000 7feb65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:33.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.711+0000 7fecb20ec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:33.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.711+0000 7fecb20ec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:33.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.711+0000 7fecb20ec9c0 5 note: GC not initialized 2024-09-12T00:40:33.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.711+0000 7feb64fe1640 20 reqs_thread_entry: start 2024-09-12T00:40:33.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.711+0000 7fecb20ec9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:33.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.711+0000 7fecb20ec9c0 20 Filter name: none 2024-09-12T00:40:33.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.711+0000 7feade7fc640 20 reqs_thread_entry: start 2024-09-12T00:40:33.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.715+0000 7fecb20ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:33.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.715+0000 7fecb20ec9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:40:33.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.715+0000 7fecb20ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:33.715 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.715+0000 7fecb20ec9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:40:33.715 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.715+0000 7fecb20ec9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:33.715 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.715+0000 7fecb20ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:33.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.715+0000 7fecb20ec9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:40:33.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.715+0000 7fecb20ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:33.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.715+0000 7fecb20ec9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:40:33.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.715+0000 7fecb20ec9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:33.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.719+0000 7feb65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:33.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.723+0000 7fecb20ec9c0 20 remove_watcher() i=0 2024-09-12T00:40:33.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.723+0000 7fecb20ec9c0 2 removed watcher, disabling cache 2024-09-12T00:40:33.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.727+0000 7fecb20ec9c0 20 remove_watcher() i=1 2024-09-12T00:40:33.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.727+0000 7fecb20ec9c0 20 remove_watcher() i=2 2024-09-12T00:40:33.730 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.731+0000 7fecb20ec9c0 20 remove_watcher() i=3 2024-09-12T00:40:33.732 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.731+0000 7fecb20ec9c0 20 remove_watcher() i=4 2024-09-12T00:40:33.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.735+0000 7fecb20ec9c0 20 remove_watcher() i=5 2024-09-12T00:40:33.735 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.735+0000 7fecb20ec9c0 20 remove_watcher() i=6 2024-09-12T00:40:33.737 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.735+0000 7fecb20ec9c0 20 remove_watcher() i=7 2024-09-12T00:40:33.750 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:33.751 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:40:33.751 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-change-reshard-state id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:40:33.751 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:33.751 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-12T00:40:33.785 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:33.785 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:33.827 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.827+0000 7fbb445849c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:33.829 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.831+0000 7fbb445849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:33.830 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.831+0000 7fbb445849c0 20 realm 2024-09-12T00:40:33.830 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.831+0000 7fbb445849c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:33.830 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.831+0000 7fbb445849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:33.830 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.831+0000 7fbb445849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:33.830 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.831+0000 7fbb445849c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:33.830 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.831+0000 7fbb445849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:33.830 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.831+0000 7fbb445849c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:33.831 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.831+0000 7fbb445849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:33.831 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.831+0000 7fbb445849c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:33.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.831+0000 7fbb445849c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:33.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.831+0000 7fbb445849c0 20 searching for the correct realm 2024-09-12T00:40:33.839 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:33.839+0000 7fbb4288b640 0 -- 172.21.15.43:0/1900544738 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7fbb38027a20 msgr2=0x7fbb38031430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:34.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.055+0000 7fbb4208a640 0 -- 172.21.15.43:0/1900544738 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x55f035ab5610 msgr2=0x55f035ab7a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:34.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.063+0000 7fbb445849c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:40:34.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.063+0000 7fbb445849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:34.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.063+0000 7fbb445849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:34.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.063+0000 7fbb445849c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:40:34.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.063+0000 7fbb445849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:34.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.063+0000 7fbb445849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:34.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.063+0000 7fbb445849c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:34.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.063+0000 7fbb445849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:34.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.063+0000 7fbb445849c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:34.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.067+0000 7fbb445849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:34.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.067+0000 7fbb445849c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:34.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.067+0000 7fbb445849c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:34.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.067+0000 7fbb445849c0 20 zone default found 2024-09-12T00:40:34.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.067+0000 7fbb445849c0 4 Realm: () 2024-09-12T00:40:34.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.067+0000 7fbb445849c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:40:34.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.067+0000 7fbb445849c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:40:34.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.067+0000 7fbb445849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:34.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.067+0000 7fbb445849c0 20 zonegroup default 2024-09-12T00:40:34.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.067+0000 7fbb445849c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:34.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.067+0000 7fbb445849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:34.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.067+0000 7fbb445849c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:34.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.067+0000 7fbb445849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:34.068 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.067+0000 7fbb445849c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:34.068 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.067+0000 7fbb445849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:34.068 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.067+0000 7fbb445849c0 20 started sync module instance, tier type = 2024-09-12T00:40:34.068 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.067+0000 7fbb445849c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:40:34.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.091+0000 7fbb445849c0 20 add_watcher() i=0 2024-09-12T00:40:34.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.091+0000 7fbb445849c0 20 add_watcher() i=1 2024-09-12T00:40:34.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.091+0000 7fbb445849c0 20 add_watcher() i=2 2024-09-12T00:40:34.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.091+0000 7fbb445849c0 20 add_watcher() i=3 2024-09-12T00:40:34.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.091+0000 7fbb445849c0 20 add_watcher() i=4 2024-09-12T00:40:34.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.091+0000 7fbb445849c0 20 add_watcher() i=5 2024-09-12T00:40:34.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.091+0000 7fbb445849c0 20 add_watcher() i=6 2024-09-12T00:40:34.093 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.095+0000 7fbb445849c0 20 add_watcher() i=7 2024-09-12T00:40:34.093 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.095+0000 7fbb445849c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:34.097 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.099+0000 7fb9f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:34.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.099+0000 7fbb445849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:34.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.099+0000 7fbb445849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:34.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.099+0000 7fbb445849c0 5 note: GC not initialized 2024-09-12T00:40:34.099 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.099+0000 7fb9737fe640 20 reqs_thread_entry: start 2024-09-12T00:40:34.099 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.099+0000 7fbb445849c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:34.099 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.099+0000 7fbb445849c0 20 Filter name: none 2024-09-12T00:40:34.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.099+0000 7fb9717fa640 20 reqs_thread_entry: start 2024-09-12T00:40:34.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.099+0000 7fbb445849c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:40:34.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.099+0000 7fbb445849c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:34.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.099+0000 7fbb445849c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:40:34.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.099+0000 7fbb445849c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:40:34.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.099+0000 7fbb445849c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:40:34.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.099+0000 7fbb445849c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38 : miss 2024-09-12T00:40:34.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.099+0000 7fbb445849c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:34.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.103+0000 7fbb445849c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:40:34.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.103+0000 7fbb445849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38 info.flags=0x17 2024-09-12T00:40:34.102 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.103+0000 7fbb445849c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38 to cache LRU end 2024-09-12T00:40:34.102 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.103+0000 7fbb445849c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:34.102 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.103+0000 7fbb445849c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:34.102 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.103+0000 7fbb445849c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38 2024-09-12T00:40:34.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.115+0000 7fbb445849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38 info.flags=0x17 2024-09-12T00:40:34.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.115+0000 7fbb445849c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38 to cache LRU end 2024-09-12T00:40:34.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.115+0000 7fbb445849c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:34.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.115+0000 7fbb445849c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38, ofs0, ns] 2024-09-12T00:40:34.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.115+0000 7fba25ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333520 cookie 94490180992544 notifier 7854 bl.length()=931 2024-09-12T00:40:34.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.115+0000 7fba25ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38 info.flags=0x17 2024-09-12T00:40:34.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.115+0000 7fba25ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38 to cache LRU end 2024-09-12T00:40:34.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.115+0000 7fba25ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:34.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.115+0000 7fbb445849c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38]): orig_sources= new_sources= 2024-09-12T00:40:34.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.115+0000 7fbb445849c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38]): potential sources added=[] removed=[] 2024-09-12T00:40:34.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.115+0000 7fbb445849c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38]): orig_dests= new_dests= 2024-09-12T00:40:34.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.115+0000 7fbb445849c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38]): potential dests added=[] removed=[] 2024-09-12T00:40:34.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.127+0000 7fbb445849c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.1.0 2024-09-12T00:40:34.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.127+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.1.0 2024-09-12T00:40:34.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.127+0000 7fbb445849c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.1.1 2024-09-12T00:40:34.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.127+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.1.1 2024-09-12T00:40:34.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.127+0000 7fbb445849c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.1.2 2024-09-12T00:40:34.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.127+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.1.2 2024-09-12T00:40:34.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.127+0000 7fbb445849c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.1.3 2024-09-12T00:40:34.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.127+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.1.3 2024-09-12T00:40:34.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.127+0000 7fbb445849c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.1.4 2024-09-12T00:40:34.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.127+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.1.4 2024-09-12T00:40:34.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.127+0000 7fbb445849c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.1.5 2024-09-12T00:40:34.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.127+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.1.5 2024-09-12T00:40:34.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.127+0000 7fbb445849c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.1.6 2024-09-12T00:40:34.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.127+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.1.6 2024-09-12T00:40:34.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.127+0000 7fbb445849c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.1.7 2024-09-12T00:40:34.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.127+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.1.7 2024-09-12T00:40:34.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.127+0000 7fbb445849c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.1.8 2024-09-12T00:40:34.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.127+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.1.8 2024-09-12T00:40:34.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.127+0000 7fbb445849c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.1.9 2024-09-12T00:40:34.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.127+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.1.9 2024-09-12T00:40:34.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.127+0000 7fbb445849c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.1.10 2024-09-12T00:40:34.129 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.127+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.1.10 2024-09-12T00:40:34.130 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.127+0000 7fbb445849c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.1.11 2024-09-12T00:40:34.130 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.127+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.1.11 2024-09-12T00:40:34.130 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.127+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.0 2024-09-12T00:40:34.130 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.127+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.1 2024-09-12T00:40:34.130 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.131+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.2 2024-09-12T00:40:34.130 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.131+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.3 2024-09-12T00:40:34.132 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.131+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.4 2024-09-12T00:40:34.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.131+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.5 2024-09-12T00:40:34.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.135+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.6 2024-09-12T00:40:34.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.135+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.7 2024-09-12T00:40:34.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.135+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.8 2024-09-12T00:40:34.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.139+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.9 2024-09-12T00:40:34.138 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.139+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.10 2024-09-12T00:40:34.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.147+0000 7fbb445849c0 -1 Injecting error=-125 at location=change_reshard_state 2024-09-12T00:40:34.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.147+0000 7fbb445849c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:34.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.147+0000 7fbb445849c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38 2024-09-12T00:40:34.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.147+0000 7fbb445849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38 info.flags=0x17 2024-09-12T00:40:34.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.147+0000 7fbb445849c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38 to cache LRU end 2024-09-12T00:40:34.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.147+0000 7fbb445849c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:34.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.147+0000 7fbb445849c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38, ofs0, ns] 2024-09-12T00:40:34.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.147+0000 7fba257fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333521 cookie 94490180992544 notifier 7854 bl.length()=931 2024-09-12T00:40:34.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.147+0000 7fba257fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38 info.flags=0x17 2024-09-12T00:40:34.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.147+0000 7fba257fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38 to cache LRU end 2024-09-12T00:40:34.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.147+0000 7fba257fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:34.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.151+0000 7fbb445849c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38]): orig_sources= new_sources= 2024-09-12T00:40:34.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.151+0000 7fbb445849c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38]): potential sources added=[] removed=[] 2024-09-12T00:40:34.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.151+0000 7fbb445849c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38]): orig_dests= new_dests= 2024-09-12T00:40:34.150 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.151+0000 7fbb445849c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38]): potential dests added=[] removed=[] 2024-09-12T00:40:34.155 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.155+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.0 2024-09-12T00:40:34.156 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.155+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.1 2024-09-12T00:40:34.157 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.155+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.2 2024-09-12T00:40:34.157 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.159+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.3 2024-09-12T00:40:34.158 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.159+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.4 2024-09-12T00:40:34.159 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.159+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.5 2024-09-12T00:40:34.160 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.159+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.6 2024-09-12T00:40:34.161 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.159+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.7 2024-09-12T00:40:34.162 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.163+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.8 2024-09-12T00:40:34.162 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.163+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.9 2024-09-12T00:40:34.163 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.163+0000 7fbb445849c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38.10 2024-09-12T00:40:34.164 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.163+0000 7fbb445849c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:34.164 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.163+0000 7fbb445849c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38 2024-09-12T00:40:34.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.167+0000 7fbb445849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38 info.flags=0x17 2024-09-12T00:40:34.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.167+0000 7fbb445849c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38 to cache LRU end 2024-09-12T00:40:34.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.167+0000 7fbb445849c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:34.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.167+0000 7fbb445849c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38, ofs0, ns] 2024-09-12T00:40:34.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.167+0000 7fba25ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333522 cookie 94490180992544 notifier 7854 bl.length()=899 2024-09-12T00:40:34.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.167+0000 7fba25ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38 info.flags=0x17 2024-09-12T00:40:34.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.167+0000 7fba25ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38 to cache LRU end 2024-09-12T00:40:34.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.167+0000 7fba25ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:34.168 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.167+0000 7fbb445849c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38]): orig_sources= new_sources= 2024-09-12T00:40:34.168 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.167+0000 7fbb445849c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38]): potential sources added=[] removed=[] 2024-09-12T00:40:34.168 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.167+0000 7fbb445849c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38]): orig_dests= new_dests= 2024-09-12T00:40:34.168 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.167+0000 7fbb445849c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38]): potential dests added=[] removed=[] 2024-09-12T00:40:34.173 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.175+0000 7fbb445849c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T00:40:34.176 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.175+0000 7fb9f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:34.181 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.183+0000 7fbb445849c0 20 remove_watcher() i=0 2024-09-12T00:40:34.182 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.183+0000 7fbb445849c0 2 removed watcher, disabling cache 2024-09-12T00:40:34.184 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.183+0000 7fbb445849c0 20 remove_watcher() i=1 2024-09-12T00:40:34.186 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.187+0000 7fbb445849c0 20 remove_watcher() i=2 2024-09-12T00:40:34.188 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.187+0000 7fbb445849c0 20 remove_watcher() i=3 2024-09-12T00:40:34.190 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.191+0000 7fbb445849c0 20 remove_watcher() i=4 2024-09-12T00:40:34.192 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.191+0000 7fbb445849c0 20 remove_watcher() i=5 2024-09-12T00:40:34.193 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.195+0000 7fbb445849c0 20 remove_watcher() i=6 2024-09-12T00:40:34.195 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.195+0000 7fbb445849c0 20 remove_watcher() i=7 2024-09-12T00:40:34.214 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:40:34.246 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:34.246 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:34.290 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.291+0000 7fc8772ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:34.292 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.291+0000 7fc8772ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:34.292 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.291+0000 7fc8772ae9c0 20 realm 2024-09-12T00:40:34.292 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.291+0000 7fc8772ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:34.292 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.291+0000 7fc8772ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:34.292 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.291+0000 7fc8772ae9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:34.292 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.291+0000 7fc8772ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:34.292 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.291+0000 7fc8772ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:34.292 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.291+0000 7fc8772ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:34.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.295+0000 7fc8772ae9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:34.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.295+0000 7fc8772ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:34.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.295+0000 7fc8772ae9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:34.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.295+0000 7fc8772ae9c0 20 searching for the correct realm 2024-09-12T00:40:34.300 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.299+0000 7fc8745b3640 0 -- 172.21.15.43:0/3110331853 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fc8680cd060 msgr2=0x7fc8680f74b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:34.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.307+0000 7fc8745b3640 0 -- 172.21.15.43:0/3110331853 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fc740080b80 msgr2=0x7fc740082fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:34.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.315+0000 7fc8772ae9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:40:34.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.315+0000 7fc8772ae9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:34.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.315+0000 7fc8772ae9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:34.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.315+0000 7fc8772ae9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:40:34.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.315+0000 7fc8772ae9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:34.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.315+0000 7fc8772ae9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:34.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.315+0000 7fc8772ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:34.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.315+0000 7fc8772ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:34.315 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.315+0000 7fc8772ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:34.316 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.315+0000 7fc8772ae9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:34.316 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.315+0000 7fc8772ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:34.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.315+0000 7fc8772ae9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:34.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.315+0000 7fc8772ae9c0 20 zone default found 2024-09-12T00:40:34.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.315+0000 7fc8772ae9c0 4 Realm: () 2024-09-12T00:40:34.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.315+0000 7fc8772ae9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:40:34.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.315+0000 7fc8772ae9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:40:34.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.315+0000 7fc8772ae9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:34.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.315+0000 7fc8772ae9c0 20 zonegroup default 2024-09-12T00:40:34.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.315+0000 7fc8772ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:34.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.315+0000 7fc8772ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:34.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.315+0000 7fc8772ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:34.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.319+0000 7fc8772ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:34.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.319+0000 7fc8772ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:34.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.319+0000 7fc8772ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:34.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.319+0000 7fc8772ae9c0 20 started sync module instance, tier type = 2024-09-12T00:40:34.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.319+0000 7fc8772ae9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:40:34.333 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.335+0000 7fc8772ae9c0 20 add_watcher() i=0 2024-09-12T00:40:34.333 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.335+0000 7fc8772ae9c0 20 add_watcher() i=1 2024-09-12T00:40:34.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.335+0000 7fc8772ae9c0 20 add_watcher() i=2 2024-09-12T00:40:34.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.335+0000 7fc8772ae9c0 20 add_watcher() i=3 2024-09-12T00:40:34.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.335+0000 7fc8772ae9c0 20 add_watcher() i=4 2024-09-12T00:40:34.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.335+0000 7fc8772ae9c0 20 add_watcher() i=5 2024-09-12T00:40:34.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.335+0000 7fc8772ae9c0 20 add_watcher() i=6 2024-09-12T00:40:34.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.335+0000 7fc8772ae9c0 20 add_watcher() i=7 2024-09-12T00:40:34.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.335+0000 7fc8772ae9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:34.337 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.335+0000 7fc72afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:34.338 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.339+0000 7fc8772ae9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:34.338 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.339+0000 7fc8772ae9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:34.338 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.339+0000 7fc8772ae9c0 5 note: GC not initialized 2024-09-12T00:40:34.338 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.339+0000 7fc729fe3640 20 reqs_thread_entry: start 2024-09-12T00:40:34.338 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.339+0000 7fc8772ae9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:34.338 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.339+0000 7fc8772ae9c0 20 Filter name: none 2024-09-12T00:40:34.338 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.339+0000 7fc69b7fe640 20 reqs_thread_entry: start 2024-09-12T00:40:34.338 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.339+0000 7fc8772ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:34.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.339+0000 7fc8772ae9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:40:34.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.339+0000 7fc8772ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:34.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.339+0000 7fc8772ae9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:40:34.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.339+0000 7fc8772ae9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:34.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.339+0000 7fc8772ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:34.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.339+0000 7fc8772ae9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:40:34.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.339+0000 7fc8772ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:34.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.339+0000 7fc8772ae9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:40:34.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.339+0000 7fc8772ae9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:34.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.343+0000 7fc72afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:34.349 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.351+0000 7fc8772ae9c0 20 remove_watcher() i=0 2024-09-12T00:40:34.350 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.351+0000 7fc8772ae9c0 2 removed watcher, disabling cache 2024-09-12T00:40:34.351 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.351+0000 7fc8772ae9c0 20 remove_watcher() i=1 2024-09-12T00:40:34.353 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.355+0000 7fc8772ae9c0 20 remove_watcher() i=2 2024-09-12T00:40:34.356 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.355+0000 7fc8772ae9c0 20 remove_watcher() i=3 2024-09-12T00:40:34.358 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.359+0000 7fc8772ae9c0 20 remove_watcher() i=4 2024-09-12T00:40:34.359 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.359+0000 7fc8772ae9c0 20 remove_watcher() i=5 2024-09-12T00:40:34.360 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.359+0000 7fc8772ae9c0 20 remove_watcher() i=6 2024-09-12T00:40:34.362 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:34.363+0000 7fc8772ae9c0 20 remove_watcher() i=7 2024-09-12T00:40:34.376 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:34.376 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:40:34.376 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: error-at-change-reshard-state id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T00:40:34.376 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:34.377 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:34.378 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:34.381 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:34.382 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:34.427 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:34.427 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:34.484 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-12T00:40:34.484 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:34.485 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:34.485 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:34.503 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:34.503 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:34.549 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:34.549 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:34.568 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:34.568 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:34.587 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:34.588 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:34.606 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:34.606 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:34.624 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:34.624 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:34.644 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:34.644 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:34.663 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:34.663 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:34.683 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:34.683 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:34.702 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:34.702 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:34.722 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:34.722 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:34.742 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:34.742 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:34.762 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:34.762 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:34.784 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:34.784 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:34.803 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:34.803 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:34.822 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:34.822 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:34.840 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:34.840 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:34.860 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:34.860 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:34.882 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:34.883 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:34.904 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:34.904 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:34.924 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:34.924 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:34.942 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:40:34.976 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:34.976 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:35.020 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.019+0000 7f7dc7ca99c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.023+0000 7f7dc7ca99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.023+0000 7f7dc7ca99c0 20 realm 2024-09-12T00:40:35.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.023+0000 7f7dc7ca99c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.023+0000 7f7dc7ca99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.023+0000 7f7dc7ca99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:35.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.023+0000 7f7dc7ca99c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.023+0000 7f7dc7ca99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.024 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.023+0000 7f7dc7ca99c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.025 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.023+0000 7f7dc7ca99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:35.025 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.023+0000 7f7dc7ca99c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.026 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.027+0000 7f7dc7ca99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:35.026 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.027+0000 7f7dc7ca99c0 20 searching for the correct realm 2024-09-12T00:40:35.031 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.031+0000 7f7dc5fb0640 0 -- 172.21.15.43:0/3721846714 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55fe75d2d3d0 msgr2=0x55fe75d2f7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:35.038 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.039+0000 7f7dc4fae640 0 -- 172.21.15.43:0/3721846714 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f7dbc031040 msgr2=0x7f7dbc08f080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:35.045 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.043+0000 7f7dc7ca99c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:40:35.045 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.043+0000 7f7dc7ca99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:35.045 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.043+0000 7f7dc7ca99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:35.045 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.043+0000 7f7dc7ca99c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:40:35.045 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.043+0000 7f7dc7ca99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:35.045 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.043+0000 7f7dc7ca99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:35.045 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.043+0000 7f7dc7ca99c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.045 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.043+0000 7f7dc7ca99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.045 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.043+0000 7f7dc7ca99c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.046 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.047+0000 7f7dc7ca99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:35.046 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.047+0000 7f7dc7ca99c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.046 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.047+0000 7f7dc7ca99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:35.046 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.047+0000 7f7dc7ca99c0 20 zone default found 2024-09-12T00:40:35.047 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.047+0000 7f7dc7ca99c0 4 Realm: () 2024-09-12T00:40:35.047 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.047+0000 7f7dc7ca99c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:40:35.047 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.047+0000 7f7dc7ca99c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:40:35.047 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.047+0000 7f7dc7ca99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:35.047 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.047+0000 7f7dc7ca99c0 20 zonegroup default 2024-09-12T00:40:35.047 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.047+0000 7f7dc7ca99c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.047 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.047+0000 7f7dc7ca99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.047 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.047+0000 7f7dc7ca99c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.048 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.047+0000 7f7dc7ca99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.048 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.047+0000 7f7dc7ca99c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.048 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.047+0000 7f7dc7ca99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.048 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.047+0000 7f7dc7ca99c0 20 started sync module instance, tier type = 2024-09-12T00:40:35.048 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.047+0000 7f7dc7ca99c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:40:35.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.063+0000 7f7dc7ca99c0 20 add_watcher() i=0 2024-09-12T00:40:35.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.063+0000 7f7dc7ca99c0 20 add_watcher() i=1 2024-09-12T00:40:35.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.063+0000 7f7dc7ca99c0 20 add_watcher() i=2 2024-09-12T00:40:35.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.063+0000 7f7dc7ca99c0 20 add_watcher() i=3 2024-09-12T00:40:35.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.063+0000 7f7dc7ca99c0 20 add_watcher() i=4 2024-09-12T00:40:35.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.063+0000 7f7dc7ca99c0 20 add_watcher() i=5 2024-09-12T00:40:35.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.063+0000 7f7dc7ca99c0 20 add_watcher() i=6 2024-09-12T00:40:35.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.063+0000 7f7dc7ca99c0 20 add_watcher() i=7 2024-09-12T00:40:35.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.063+0000 7f7dc7ca99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:35.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.067+0000 7f7c7b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:35.068 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.067+0000 7f7dc7ca99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:35.068 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.067+0000 7f7dc7ca99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:35.068 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.067+0000 7f7dc7ca99c0 5 note: GC not initialized 2024-09-12T00:40:35.068 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.067+0000 7f7c7a7e4640 20 reqs_thread_entry: start 2024-09-12T00:40:35.068 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.067+0000 7f7dc7ca99c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:35.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.067+0000 7f7dc7ca99c0 20 Filter name: none 2024-09-12T00:40:35.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.067+0000 7f7bebfff640 20 reqs_thread_entry: start 2024-09-12T00:40:35.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.067+0000 7f7dc7ca99c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.067+0000 7f7dc7ca99c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:40:35.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.067+0000 7f7dc7ca99c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.070 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.071+0000 7f7dc7ca99c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:40:35.071 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.071+0000 7f7dc7ca99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:35.071 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.071+0000 7f7dc7ca99c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.071 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.071+0000 7f7dc7ca99c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:40:35.071 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.071+0000 7f7dc7ca99c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.071+0000 7f7dc7ca99c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:40:35.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.071+0000 7f7dc7ca99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:35.075 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.075+0000 7f7c7b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:35.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.079+0000 7f7dc7ca99c0 20 remove_watcher() i=0 2024-09-12T00:40:35.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.079+0000 7f7dc7ca99c0 2 removed watcher, disabling cache 2024-09-12T00:40:35.082 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.083+0000 7f7dc7ca99c0 20 remove_watcher() i=1 2024-09-12T00:40:35.084 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.083+0000 7f7dc7ca99c0 20 remove_watcher() i=2 2024-09-12T00:40:35.086 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.087+0000 7f7dc7ca99c0 20 remove_watcher() i=3 2024-09-12T00:40:35.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.087+0000 7f7dc7ca99c0 20 remove_watcher() i=4 2024-09-12T00:40:35.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.091+0000 7f7dc7ca99c0 20 remove_watcher() i=5 2024-09-12T00:40:35.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.091+0000 7f7dc7ca99c0 20 remove_watcher() i=6 2024-09-12T00:40:35.092 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.091+0000 7f7dc7ca99c0 20 remove_watcher() i=7 2024-09-12T00:40:35.106 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.106 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:40:35.106 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: abort-at-change-reshard-state id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:40:35.106 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.107 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T00:40:35.139 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:35.139 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:35.181 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.183+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.183 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.183+0000 7fe7bd3349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.183 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.183+0000 7fe7bd3349c0 20 realm 2024-09-12T00:40:35.183 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.183+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.184 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.183+0000 7fe7bd3349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.184 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.183+0000 7fe7bd3349c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:35.184 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.183+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.184 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.183+0000 7fe7bd3349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.184 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.183+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.185 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.183+0000 7fe7bd3349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:35.185 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.183+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.186 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.187+0000 7fe7bd3349c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:35.186 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.187+0000 7fe7bd3349c0 20 searching for the correct realm 2024-09-12T00:40:35.192 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.191+0000 7fe7bb63b640 0 -- 172.21.15.43:0/3419709128 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55ee172b34d0 msgr2=0x55ee172b58f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:35.198 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.199+0000 7fe7ba639640 0 -- 172.21.15.43:0/3419709128 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fe7b010c000 msgr2=0x7fe7b0133a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:35.205 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.203+0000 7fe7bd3349c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:40:35.205 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.203+0000 7fe7bd3349c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:35.205 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.203+0000 7fe7bd3349c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:35.205 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.203+0000 7fe7bd3349c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:40:35.205 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.203+0000 7fe7bd3349c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:35.205 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.203+0000 7fe7bd3349c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:35.205 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.203+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.205 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.203+0000 7fe7bd3349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.205 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.203+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:35.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:35.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 zone default found 2024-09-12T00:40:35.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.207+0000 7fe7bd3349c0 4 Realm: () 2024-09-12T00:40:35.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.207+0000 7fe7bd3349c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:40:35.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.207+0000 7fe7bd3349c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:40:35.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.207+0000 7fe7bd3349c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:35.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 zonegroup default 2024-09-12T00:40:35.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 started sync module instance, tier type = 2024-09-12T00:40:35.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:40:35.223 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.223+0000 7fe7bd3349c0 20 add_watcher() i=0 2024-09-12T00:40:35.223 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.223+0000 7fe7bd3349c0 20 add_watcher() i=1 2024-09-12T00:40:35.223 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.223+0000 7fe7bd3349c0 20 add_watcher() i=2 2024-09-12T00:40:35.224 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.223+0000 7fe7bd3349c0 20 add_watcher() i=3 2024-09-12T00:40:35.224 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.223+0000 7fe7bd3349c0 20 add_watcher() i=4 2024-09-12T00:40:35.224 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.223+0000 7fe7bd3349c0 20 add_watcher() i=5 2024-09-12T00:40:35.224 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.223+0000 7fe7bd3349c0 20 add_watcher() i=6 2024-09-12T00:40:35.224 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.223+0000 7fe7bd3349c0 20 add_watcher() i=7 2024-09-12T00:40:35.224 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.223+0000 7fe7bd3349c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:35.227 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.227+0000 7fe671fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:35.228 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.227+0000 7fe7bd3349c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:35.228 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.227+0000 7fe7bd3349c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:35.228 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 note: GC not initialized 2024-09-12T00:40:35.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.227+0000 7fe670fe1640 20 reqs_thread_entry: start 2024-09-12T00:40:35.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.227+0000 7fe7bd3349c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:35.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.227+0000 7fe7bd3349c0 20 Filter name: none 2024-09-12T00:40:35.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.227+0000 7fe669ffb640 20 reqs_thread_entry: start 2024-09-12T00:40:35.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.227+0000 7fe7bd3349c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:40:35.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.227+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.227+0000 7fe7bd3349c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:40:35.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.227+0000 7fe7bd3349c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:40:35.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.227+0000 7fe7bd3349c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:40:35.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.227+0000 7fe7bd3349c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 : miss 2024-09-12T00:40:35.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.227+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.231+0000 7fe7bd3349c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:40:35.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.231+0000 7fe7bd3349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 info.flags=0x17 2024-09-12T00:40:35.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.231+0000 7fe7bd3349c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 to cache LRU end 2024-09-12T00:40:35.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.231+0000 7fe7bd3349c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:35.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.231+0000 7fe7bd3349c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:35.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.231+0000 7fe7bd3349c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 2024-09-12T00:40:35.243 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.243+0000 7fe7bd3349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 info.flags=0x17 2024-09-12T00:40:35.243 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.243+0000 7fe7bd3349c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 to cache LRU end 2024-09-12T00:40:35.243 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.243+0000 7fe7bd3349c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:35.244 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.243+0000 7fe7bd3349c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39, ofs0, ns] 2024-09-12T00:40:35.244 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.243+0000 7fe69e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333498 cookie 94481079348288 notifier 7911 bl.length()=931 2024-09-12T00:40:35.244 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.243+0000 7fe69e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 info.flags=0x17 2024-09-12T00:40:35.245 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.243+0000 7fe69e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 to cache LRU end 2024-09-12T00:40:35.245 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.243+0000 7fe69e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:35.245 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.247+0000 7fe7bd3349c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39]): orig_sources= new_sources= 2024-09-12T00:40:35.245 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.247+0000 7fe7bd3349c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39]): potential sources added=[] removed=[] 2024-09-12T00:40:35.245 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.247+0000 7fe7bd3349c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39]): orig_dests= new_dests= 2024-09-12T00:40:35.245 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.247+0000 7fe7bd3349c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39]): potential dests added=[] removed=[] 2024-09-12T00:40:35.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.0 2024-09-12T00:40:35.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.0 2024-09-12T00:40:35.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.1 2024-09-12T00:40:35.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.1 2024-09-12T00:40:35.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.2 2024-09-12T00:40:35.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.2 2024-09-12T00:40:35.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.3 2024-09-12T00:40:35.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.3 2024-09-12T00:40:35.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.4 2024-09-12T00:40:35.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.4 2024-09-12T00:40:35.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.5 2024-09-12T00:40:35.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.5 2024-09-12T00:40:35.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.6 2024-09-12T00:40:35.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.6 2024-09-12T00:40:35.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.7 2024-09-12T00:40:35.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.7 2024-09-12T00:40:35.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.8 2024-09-12T00:40:35.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.8 2024-09-12T00:40:35.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.9 2024-09-12T00:40:35.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.9 2024-09-12T00:40:35.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.10 2024-09-12T00:40:35.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.10 2024-09-12T00:40:35.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.11 2024-09-12T00:40:35.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.11 2024-09-12T00:40:35.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.0 2024-09-12T00:40:35.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1 2024-09-12T00:40:35.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.2 2024-09-12T00:40:35.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.259+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.3 2024-09-12T00:40:35.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.259+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.4 2024-09-12T00:40:35.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.259+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.5 2024-09-12T00:40:35.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.259+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.6 2024-09-12T00:40:35.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.263+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.7 2024-09-12T00:40:35.262 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.263+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.8 2024-09-12T00:40:35.263 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.263+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.9 2024-09-12T00:40:35.264 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.263+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.10 2024-09-12T00:40:35.271 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe7bd3349c0 time 2024-09-12T00:40:35.274837+0000 2024-09-12T00:40:35.271 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:40:35.272 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:35.272 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe7c0c0e2eb] 2024-09-12T00:40:35.273 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe7c0c0e49f] 2024-09-12T00:40:35.273 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee15eefcc1] 2024-09-12T00:40:35.273 INFO:tasks.workunit.client.0.smithi043.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x55ee15f0401c] 2024-09-12T00:40:35.273 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ee15f056a4] 2024-09-12T00:40:35.273 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:40:35.273 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe7bfa74d90] 2024-09-12T00:40:35.273 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:40:35.273 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:40:35.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.271+0000 7fe7bd3349c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe7bd3349c0 time 2024-09-12T00:40:35.274837+0000 2024-09-12T00:40:35.273 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:40:35.273 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.273 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:35.274 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe7c0c0e2eb] 2024-09-12T00:40:35.274 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe7c0c0e49f] 2024-09-12T00:40:35.274 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee15eefcc1] 2024-09-12T00:40:35.274 INFO:tasks.workunit.client.0.smithi043.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x55ee15f0401c] 2024-09-12T00:40:35.274 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ee15f056a4] 2024-09-12T00:40:35.274 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:40:35.274 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe7bfa74d90] 2024-09-12T00:40:35.274 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:40:35.274 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:40:35.274 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.274 INFO:tasks.workunit.client.0.smithi043.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:40:35.274 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7fe7bd3349c0 thread_name:radosgw-admin 2024-09-12T00:40:35.291 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:35.291 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe7bfa8d520] 2024-09-12T00:40:35.291 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:40:35.291 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:40:35.292 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:40:35.292 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe7c0c0e345] 2024-09-12T00:40:35.292 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe7c0c0e49f] 2024-09-12T00:40:35.292 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee15eefcc1] 2024-09-12T00:40:35.292 INFO:tasks.workunit.client.0.smithi043.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x55ee15f0401c] 2024-09-12T00:40:35.292 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ee15f056a4] 2024-09-12T00:40:35.292 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:40:35.292 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe7bfa74d90] 2024-09-12T00:40:35.292 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:40:35.292 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:40:35.292 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.275+0000 7fe7bd3349c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:40:35.292 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7fe7bd3349c0 thread_name:radosgw-admin 2024-09-12T00:40:35.293 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.293 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:35.293 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe7bfa8d520] 2024-09-12T00:40:35.293 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:40:35.293 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:40:35.293 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:40:35.293 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe7c0c0e345] 2024-09-12T00:40:35.293 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe7c0c0e49f] 2024-09-12T00:40:35.293 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee15eefcc1] 2024-09-12T00:40:35.293 INFO:tasks.workunit.client.0.smithi043.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x55ee15f0401c] 2024-09-12T00:40:35.293 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ee15f056a4] 2024-09-12T00:40:35.293 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:40:35.294 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe7bfa74d90] 2024-09-12T00:40:35.294 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:40:35.294 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:40:35.294 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:40:35.294 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.294 INFO:tasks.workunit.client.0.smithi043.stderr:--- begin dump of recent events --- 2024-09-12T00:40:35.294 INFO:tasks.workunit.client.0.smithi043.stderr: -499> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 1 librados: starting objecter 2024-09-12T00:40:35.294 INFO:tasks.workunit.client.0.smithi043.stderr: -498> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command objecter_requests hook 0x55ee16f9ad30 2024-09-12T00:40:35.294 INFO:tasks.workunit.client.0.smithi043.stderr: -497> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 1 librados: setting wanted keys 2024-09-12T00:40:35.294 INFO:tasks.workunit.client.0.smithi043.stderr: -496> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 1 librados: calling monclient init 2024-09-12T00:40:35.294 INFO:tasks.workunit.client.0.smithi043.stderr: -495> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 10 monclient: init 2024-09-12T00:40:35.294 INFO:tasks.workunit.client.0.smithi043.stderr: -494> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee171cba40) adding auth protocol: cephx 2024-09-12T00:40:35.295 INFO:tasks.workunit.client.0.smithi043.stderr: -493> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee171cba40) adding auth protocol: cephx 2024-09-12T00:40:35.295 INFO:tasks.workunit.client.0.smithi043.stderr: -492> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee171cba40) adding auth protocol: cephx 2024-09-12T00:40:35.295 INFO:tasks.workunit.client.0.smithi043.stderr: -491> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee171cba40) adding con mode: secure 2024-09-12T00:40:35.295 INFO:tasks.workunit.client.0.smithi043.stderr: -490> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee171cba40) adding con mode: crc 2024-09-12T00:40:35.295 INFO:tasks.workunit.client.0.smithi043.stderr: -489> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee171cba40) adding con mode: secure 2024-09-12T00:40:35.295 INFO:tasks.workunit.client.0.smithi043.stderr: -488> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee171cba40) adding con mode: crc 2024-09-12T00:40:35.295 INFO:tasks.workunit.client.0.smithi043.stderr: -487> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee171cba40) adding con mode: secure 2024-09-12T00:40:35.295 INFO:tasks.workunit.client.0.smithi043.stderr: -486> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee171cba40) adding con mode: crc 2024-09-12T00:40:35.295 INFO:tasks.workunit.client.0.smithi043.stderr: -485> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee171cba40) adding con mode: crc 2024-09-12T00:40:35.295 INFO:tasks.workunit.client.0.smithi043.stderr: -484> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee171cba40) adding con mode: secure 2024-09-12T00:40:35.295 INFO:tasks.workunit.client.0.smithi043.stderr: -483> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee171cba40) adding con mode: crc 2024-09-12T00:40:35.295 INFO:tasks.workunit.client.0.smithi043.stderr: -482> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee171cba40) adding con mode: secure 2024-09-12T00:40:35.296 INFO:tasks.workunit.client.0.smithi043.stderr: -481> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee171cba40) adding con mode: crc 2024-09-12T00:40:35.296 INFO:tasks.workunit.client.0.smithi043.stderr: -480> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee171cba40) adding con mode: secure 2024-09-12T00:40:35.296 INFO:tasks.workunit.client.0.smithi043.stderr: -479> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:35.296 INFO:tasks.workunit.client.0.smithi043.stderr: -478> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:35.296 INFO:tasks.workunit.client.0.smithi043.stderr: -477> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command rotate-key hook 0x55ee171cbb88 2024-09-12T00:40:35.296 INFO:tasks.workunit.client.0.smithi043.stderr: -476> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:35.296 INFO:tasks.workunit.client.0.smithi043.stderr: -475> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:40:35.296 INFO:tasks.workunit.client.0.smithi043.stderr: -474> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 10 monclient(hunting): picked mon.noname-b con 0x55ee1707b820 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:40:35.296 INFO:tasks.workunit.client.0.smithi043.stderr: -473> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 10 monclient(hunting): picked mon.noname-a con 0x55ee17086a80 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:40:35.296 INFO:tasks.workunit.client.0.smithi043.stderr: -472> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 10 monclient(hunting): picked mon.noname-c con 0x55ee17117170 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:40:35.296 INFO:tasks.workunit.client.0.smithi043.stderr: -471> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:35.296 INFO:tasks.workunit.client.0.smithi043.stderr: -470> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:35.297 INFO:tasks.workunit.client.0.smithi043.stderr: -469> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:35.297 INFO:tasks.workunit.client.0.smithi043.stderr: -468> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:35.297 INFO:tasks.workunit.client.0.smithi043.stderr: -467> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 10 monclient(hunting): authenticate will time out at 2331.153964s 2024-09-12T00:40:35.297 INFO:tasks.workunit.client.0.smithi043.stderr: -466> 2024-09-12T00:40:35.163+0000 7fe7ba639640 10 monclient(hunting): get_auth_request con 0x55ee17086a80 auth_method 0 2024-09-12T00:40:35.297 INFO:tasks.workunit.client.0.smithi043.stderr: -465> 2024-09-12T00:40:35.163+0000 7fe7ba639640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:35.297 INFO:tasks.workunit.client.0.smithi043.stderr: -464> 2024-09-12T00:40:35.163+0000 7fe7ba639640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:35.297 INFO:tasks.workunit.client.0.smithi043.stderr: -463> 2024-09-12T00:40:35.163+0000 7fe7ba639640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:35.297 INFO:tasks.workunit.client.0.smithi043.stderr: -462> 2024-09-12T00:40:35.163+0000 7fe7bb63b640 10 monclient(hunting): get_auth_request con 0x55ee17117170 auth_method 0 2024-09-12T00:40:35.297 INFO:tasks.workunit.client.0.smithi043.stderr: -461> 2024-09-12T00:40:35.163+0000 7fe7bb63b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:35.297 INFO:tasks.workunit.client.0.smithi043.stderr: -460> 2024-09-12T00:40:35.163+0000 7fe7bb63b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:35.297 INFO:tasks.workunit.client.0.smithi043.stderr: -459> 2024-09-12T00:40:35.163+0000 7fe7bb63b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:35.297 INFO:tasks.workunit.client.0.smithi043.stderr: -458> 2024-09-12T00:40:35.163+0000 7fe7ba639640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:35.298 INFO:tasks.workunit.client.0.smithi043.stderr: -457> 2024-09-12T00:40:35.163+0000 7fe7ba639640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:35.298 INFO:tasks.workunit.client.0.smithi043.stderr: -456> 2024-09-12T00:40:35.163+0000 7fe7ba639640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:35.298 INFO:tasks.workunit.client.0.smithi043.stderr: -455> 2024-09-12T00:40:35.163+0000 7fe7bb63b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:35.298 INFO:tasks.workunit.client.0.smithi043.stderr: -454> 2024-09-12T00:40:35.163+0000 7fe7bb63b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:35.298 INFO:tasks.workunit.client.0.smithi043.stderr: -453> 2024-09-12T00:40:35.163+0000 7fe7bb63b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:35.298 INFO:tasks.workunit.client.0.smithi043.stderr: -452> 2024-09-12T00:40:35.163+0000 7fe7bae3a640 10 monclient(hunting): get_auth_request con 0x55ee1707b820 auth_method 0 2024-09-12T00:40:35.298 INFO:tasks.workunit.client.0.smithi043.stderr: -451> 2024-09-12T00:40:35.163+0000 7fe7bae3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:35.298 INFO:tasks.workunit.client.0.smithi043.stderr: -450> 2024-09-12T00:40:35.163+0000 7fe7bae3a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:35.298 INFO:tasks.workunit.client.0.smithi043.stderr: -449> 2024-09-12T00:40:35.163+0000 7fe7bae3a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:35.298 INFO:tasks.workunit.client.0.smithi043.stderr: -448> 2024-09-12T00:40:35.163+0000 7fe7ba639640 10 monclient(hunting): handle_auth_done global_id 7902 payload 824 2024-09-12T00:40:35.298 INFO:tasks.workunit.client.0.smithi043.stderr: -447> 2024-09-12T00:40:35.163+0000 7fe7ba639640 10 monclient: _finish_hunting 0 2024-09-12T00:40:35.298 INFO:tasks.workunit.client.0.smithi043.stderr: -446> 2024-09-12T00:40:35.163+0000 7fe7ba639640 1 monclient: found mon.noname-a 2024-09-12T00:40:35.299 INFO:tasks.workunit.client.0.smithi043.stderr: -445> 2024-09-12T00:40:35.163+0000 7fe7ba639640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:40:35.299 INFO:tasks.workunit.client.0.smithi043.stderr: -444> 2024-09-12T00:40:35.163+0000 7fe6a7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:35.299 INFO:tasks.workunit.client.0.smithi043.stderr: -443> 2024-09-12T00:40:35.163+0000 7fe6a7606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:40:35.299 INFO:tasks.workunit.client.0.smithi043.stderr: -442> 2024-09-12T00:40:35.163+0000 7fe6a7606640 10 monclient: dump: 2024-09-12T00:40:35.299 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:40:35.299 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:40:35.299 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.299 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.299 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:35.300 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:40:35.300 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:40:35.300 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:40:35.300 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:40:35.300 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.300 INFO:tasks.workunit.client.0.smithi043.stderr: -441> 2024-09-12T00:40:35.163+0000 7fe6a7606640 10 monclient: _finish_auth 0 2024-09-12T00:40:35.300 INFO:tasks.workunit.client.0.smithi043.stderr: -440> 2024-09-12T00:40:35.163+0000 7fe6a7606640 10 monclient: _check_auth_tickets 2024-09-12T00:40:35.300 INFO:tasks.workunit.client.0.smithi043.stderr: -439> 2024-09-12T00:40:35.163+0000 7fe6a7606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:35.300 INFO:tasks.workunit.client.0.smithi043.stderr: -438> 2024-09-12T00:40:35.163+0000 7fe6a7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:35.300 INFO:tasks.workunit.client.0.smithi043.stderr: -437> 2024-09-12T00:40:35.163+0000 7fe6a7606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:40:35.301 INFO:tasks.workunit.client.0.smithi043.stderr: -436> 2024-09-12T00:40:35.163+0000 7fe6a7606640 10 monclient: dump: 2024-09-12T00:40:35.301 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:40:35.301 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:40:35.301 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.301 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.301 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:35.301 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:40:35.301 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:40:35.301 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:40:35.302 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:40:35.302 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.302 INFO:tasks.workunit.client.0.smithi043.stderr: -435> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 monclient: authenticate success, global_id 7902 2024-09-12T00:40:35.302 INFO:tasks.workunit.client.0.smithi043.stderr: -434> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 10 monclient: _renew_subs 2024-09-12T00:40:35.302 INFO:tasks.workunit.client.0.smithi043.stderr: -433> 2024-09-12T00:40:35.163+0000 7fe6a8e09640 4 set_mon_vals no callback set 2024-09-12T00:40:35.302 INFO:tasks.workunit.client.0.smithi043.stderr: -432> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:40:35.302 INFO:tasks.workunit.client.0.smithi043.stderr: -431> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 10 monclient: _renew_subs 2024-09-12T00:40:35.302 INFO:tasks.workunit.client.0.smithi043.stderr: -430> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:40:35.302 INFO:tasks.workunit.client.0.smithi043.stderr: -429> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 1 librados: init done 2024-09-12T00:40:35.302 INFO:tasks.workunit.client.0.smithi043.stderr: -428> 2024-09-12T00:40:35.167+0000 7fe6a7606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:35.302 INFO:tasks.workunit.client.0.smithi043.stderr: -427> 2024-09-12T00:40:35.167+0000 7fe6a7606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:40:35.302 INFO:tasks.workunit.client.0.smithi043.stderr: -426> 2024-09-12T00:40:35.167+0000 7fe6a7606640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:40:35.303 INFO:tasks.workunit.client.0.smithi043.stderr: -425> 2024-09-12T00:40:35.167+0000 7fe7bae3a640 10 monclient: get_auth_request con 0x7fe6a0070b10 auth_method 0 2024-09-12T00:40:35.303 INFO:tasks.workunit.client.0.smithi043.stderr: -424> 2024-09-12T00:40:35.167+0000 7fe7bb63b640 10 monclient: get_auth_request con 0x55ee171f3c50 auth_method 0 2024-09-12T00:40:35.303 INFO:tasks.workunit.client.0.smithi043.stderr: -423> 2024-09-12T00:40:35.167+0000 7fe7bae3a640 10 monclient: get_auth_request con 0x55ee17216390 auth_method 0 2024-09-12T00:40:35.303 INFO:tasks.workunit.client.0.smithi043.stderr: -422> 2024-09-12T00:40:35.167+0000 7fe7ba639640 10 monclient: get_auth_request con 0x55ee1721a580 auth_method 0 2024-09-12T00:40:35.303 INFO:tasks.workunit.client.0.smithi043.stderr: -421> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient: build_initial_monmap 2024-09-12T00:40:35.303 INFO:tasks.workunit.client.0.smithi043.stderr: -420> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:35.303 INFO:tasks.workunit.client.0.smithi043.stderr: -419> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient: monmap: 2024-09-12T00:40:35.303 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:40:35.303 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:35.303 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:40:35.303 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:40:35.303 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:35.303 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:40:35.304 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:40:35.304 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:40:35.304 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:40:35.304 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.304 INFO:tasks.workunit.client.0.smithi043.stderr: -418> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721eec0) adding auth protocol: cephx 2024-09-12T00:40:35.304 INFO:tasks.workunit.client.0.smithi043.stderr: -417> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721eec0) adding auth protocol: cephx 2024-09-12T00:40:35.304 INFO:tasks.workunit.client.0.smithi043.stderr: -416> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721eec0) adding auth protocol: cephx 2024-09-12T00:40:35.304 INFO:tasks.workunit.client.0.smithi043.stderr: -415> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721eec0) adding con mode: secure 2024-09-12T00:40:35.304 INFO:tasks.workunit.client.0.smithi043.stderr: -414> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721eec0) adding con mode: crc 2024-09-12T00:40:35.304 INFO:tasks.workunit.client.0.smithi043.stderr: -413> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721eec0) adding con mode: secure 2024-09-12T00:40:35.304 INFO:tasks.workunit.client.0.smithi043.stderr: -412> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721eec0) adding con mode: crc 2024-09-12T00:40:35.304 INFO:tasks.workunit.client.0.smithi043.stderr: -411> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721eec0) adding con mode: secure 2024-09-12T00:40:35.305 INFO:tasks.workunit.client.0.smithi043.stderr: -410> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721eec0) adding con mode: crc 2024-09-12T00:40:35.305 INFO:tasks.workunit.client.0.smithi043.stderr: -409> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721eec0) adding con mode: crc 2024-09-12T00:40:35.305 INFO:tasks.workunit.client.0.smithi043.stderr: -408> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721eec0) adding con mode: secure 2024-09-12T00:40:35.305 INFO:tasks.workunit.client.0.smithi043.stderr: -407> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721eec0) adding con mode: crc 2024-09-12T00:40:35.305 INFO:tasks.workunit.client.0.smithi043.stderr: -406> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721eec0) adding con mode: secure 2024-09-12T00:40:35.305 INFO:tasks.workunit.client.0.smithi043.stderr: -405> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721eec0) adding con mode: crc 2024-09-12T00:40:35.305 INFO:tasks.workunit.client.0.smithi043.stderr: -404> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721eec0) adding con mode: secure 2024-09-12T00:40:35.305 INFO:tasks.workunit.client.0.smithi043.stderr: -403> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:35.305 INFO:tasks.workunit.client.0.smithi043.stderr: -402> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55ee17222830 EEXIST 2024-09-12T00:40:35.305 INFO:tasks.workunit.client.0.smithi043.stderr: -401> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient: init 2024-09-12T00:40:35.305 INFO:tasks.workunit.client.0.smithi043.stderr: -400> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721d808) adding auth protocol: cephx 2024-09-12T00:40:35.305 INFO:tasks.workunit.client.0.smithi043.stderr: -399> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721d808) adding auth protocol: cephx 2024-09-12T00:40:35.306 INFO:tasks.workunit.client.0.smithi043.stderr: -398> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721d808) adding auth protocol: cephx 2024-09-12T00:40:35.306 INFO:tasks.workunit.client.0.smithi043.stderr: -397> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721d808) adding con mode: secure 2024-09-12T00:40:35.306 INFO:tasks.workunit.client.0.smithi043.stderr: -396> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721d808) adding con mode: crc 2024-09-12T00:40:35.306 INFO:tasks.workunit.client.0.smithi043.stderr: -395> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721d808) adding con mode: secure 2024-09-12T00:40:35.306 INFO:tasks.workunit.client.0.smithi043.stderr: -394> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721d808) adding con mode: crc 2024-09-12T00:40:35.306 INFO:tasks.workunit.client.0.smithi043.stderr: -393> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721d808) adding con mode: secure 2024-09-12T00:40:35.306 INFO:tasks.workunit.client.0.smithi043.stderr: -392> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721d808) adding con mode: crc 2024-09-12T00:40:35.306 INFO:tasks.workunit.client.0.smithi043.stderr: -391> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721d808) adding con mode: crc 2024-09-12T00:40:35.306 INFO:tasks.workunit.client.0.smithi043.stderr: -390> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721d808) adding con mode: secure 2024-09-12T00:40:35.306 INFO:tasks.workunit.client.0.smithi043.stderr: -389> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721d808) adding con mode: crc 2024-09-12T00:40:35.306 INFO:tasks.workunit.client.0.smithi043.stderr: -388> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721d808) adding con mode: secure 2024-09-12T00:40:35.307 INFO:tasks.workunit.client.0.smithi043.stderr: -387> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721d808) adding con mode: crc 2024-09-12T00:40:35.307 INFO:tasks.workunit.client.0.smithi043.stderr: -386> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721d808) adding con mode: secure 2024-09-12T00:40:35.307 INFO:tasks.workunit.client.0.smithi043.stderr: -385> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:35.307 INFO:tasks.workunit.client.0.smithi043.stderr: -384> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:35.307 INFO:tasks.workunit.client.0.smithi043.stderr: -383> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command rotate-key cmddesc rotate-key hook 0x55ee1721d950 EEXIST 2024-09-12T00:40:35.307 INFO:tasks.workunit.client.0.smithi043.stderr: -382> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:35.307 INFO:tasks.workunit.client.0.smithi043.stderr: -381> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:40:35.307 INFO:tasks.workunit.client.0.smithi043.stderr: -380> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient(hunting): picked mon.noname-a con 0x55ee172469e0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:40:35.307 INFO:tasks.workunit.client.0.smithi043.stderr: -379> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient(hunting): picked mon.noname-c con 0x55ee17246310 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:40:35.307 INFO:tasks.workunit.client.0.smithi043.stderr: -378> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient(hunting): picked mon.noname-b con 0x55ee17244cf0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:40:35.307 INFO:tasks.workunit.client.0.smithi043.stderr: -377> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:35.307 INFO:tasks.workunit.client.0.smithi043.stderr: -376> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:35.307 INFO:tasks.workunit.client.0.smithi043.stderr: -375> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:35.308 INFO:tasks.workunit.client.0.smithi043.stderr: -374> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:35.308 INFO:tasks.workunit.client.0.smithi043.stderr: -373> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient(hunting): authenticate will time out at 2331.162963s 2024-09-12T00:40:35.308 INFO:tasks.workunit.client.0.smithi043.stderr: -372> 2024-09-12T00:40:35.171+0000 7fe7ba639640 10 monclient(hunting): get_auth_request con 0x55ee17246310 auth_method 0 2024-09-12T00:40:35.308 INFO:tasks.workunit.client.0.smithi043.stderr: -371> 2024-09-12T00:40:35.171+0000 7fe7ba639640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:35.308 INFO:tasks.workunit.client.0.smithi043.stderr: -370> 2024-09-12T00:40:35.171+0000 7fe7ba639640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:35.308 INFO:tasks.workunit.client.0.smithi043.stderr: -369> 2024-09-12T00:40:35.171+0000 7fe7ba639640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:35.308 INFO:tasks.workunit.client.0.smithi043.stderr: -368> 2024-09-12T00:40:35.171+0000 7fe7bae3a640 10 monclient(hunting): get_auth_request con 0x55ee172469e0 auth_method 0 2024-09-12T00:40:35.308 INFO:tasks.workunit.client.0.smithi043.stderr: -367> 2024-09-12T00:40:35.171+0000 7fe7bae3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:35.308 INFO:tasks.workunit.client.0.smithi043.stderr: -366> 2024-09-12T00:40:35.171+0000 7fe7bae3a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:35.308 INFO:tasks.workunit.client.0.smithi043.stderr: -365> 2024-09-12T00:40:35.171+0000 7fe7bae3a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:35.308 INFO:tasks.workunit.client.0.smithi043.stderr: -364> 2024-09-12T00:40:35.171+0000 7fe7ba639640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:35.308 INFO:tasks.workunit.client.0.smithi043.stderr: -363> 2024-09-12T00:40:35.171+0000 7fe7ba639640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:35.309 INFO:tasks.workunit.client.0.smithi043.stderr: -362> 2024-09-12T00:40:35.171+0000 7fe7ba639640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:35.309 INFO:tasks.workunit.client.0.smithi043.stderr: -361> 2024-09-12T00:40:35.171+0000 7fe7bae3a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:35.309 INFO:tasks.workunit.client.0.smithi043.stderr: -360> 2024-09-12T00:40:35.171+0000 7fe7bae3a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:35.309 INFO:tasks.workunit.client.0.smithi043.stderr: -359> 2024-09-12T00:40:35.171+0000 7fe7bae3a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:35.309 INFO:tasks.workunit.client.0.smithi043.stderr: -358> 2024-09-12T00:40:35.171+0000 7fe7ba639640 10 monclient(hunting): handle_auth_done global_id 7538 payload 824 2024-09-12T00:40:35.309 INFO:tasks.workunit.client.0.smithi043.stderr: -357> 2024-09-12T00:40:35.171+0000 7fe7ba639640 10 monclient: _finish_hunting 0 2024-09-12T00:40:35.309 INFO:tasks.workunit.client.0.smithi043.stderr: -356> 2024-09-12T00:40:35.171+0000 7fe7ba639640 1 monclient: found mon.noname-c 2024-09-12T00:40:35.309 INFO:tasks.workunit.client.0.smithi043.stderr: -355> 2024-09-12T00:40:35.171+0000 7fe7ba639640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:40:35.309 INFO:tasks.workunit.client.0.smithi043.stderr: -354> 2024-09-12T00:40:35.171+0000 7fe7bb63b640 10 monclient: get_auth_request con 0x55ee17244cf0 auth_method 0 2024-09-12T00:40:35.309 INFO:tasks.workunit.client.0.smithi043.stderr: -353> 2024-09-12T00:40:35.171+0000 7fe6a4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:35.309 INFO:tasks.workunit.client.0.smithi043.stderr: -352> 2024-09-12T00:40:35.171+0000 7fe6a4e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:35.309 INFO:tasks.workunit.client.0.smithi043.stderr: -351> 2024-09-12T00:40:35.171+0000 7fe6a4e01640 10 monclient: dump: 2024-09-12T00:40:35.310 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:40:35.310 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:40:35.310 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.310 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.310 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:35.310 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:40:35.310 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:40:35.310 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:40:35.310 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:40:35.310 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.310 INFO:tasks.workunit.client.0.smithi043.stderr: -350> 2024-09-12T00:40:35.171+0000 7fe6a4e01640 10 monclient: _finish_auth 0 2024-09-12T00:40:35.310 INFO:tasks.workunit.client.0.smithi043.stderr: -349> 2024-09-12T00:40:35.171+0000 7fe6a4e01640 10 monclient: _check_auth_tickets 2024-09-12T00:40:35.311 INFO:tasks.workunit.client.0.smithi043.stderr: -348> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 monclient: authenticate success, global_id 7538 2024-09-12T00:40:35.311 INFO:tasks.workunit.client.0.smithi043.stderr: -347> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient: _renew_subs 2024-09-12T00:40:35.311 INFO:tasks.workunit.client.0.smithi043.stderr: -346> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:40:35.311 INFO:tasks.workunit.client.0.smithi043.stderr: -345> 2024-09-12T00:40:35.171+0000 7fe6a4e01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:35.311 INFO:tasks.workunit.client.0.smithi043.stderr: -344> 2024-09-12T00:40:35.171+0000 7fe6a4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:35.311 INFO:tasks.workunit.client.0.smithi043.stderr: -343> 2024-09-12T00:40:35.171+0000 7fe6a4e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:35.311 INFO:tasks.workunit.client.0.smithi043.stderr: -342> 2024-09-12T00:40:35.171+0000 7fe6a4e01640 10 monclient: dump: 2024-09-12T00:40:35.311 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:40:35.311 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:40:35.311 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.311 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.311 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:35.311 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:40:35.312 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:40:35.312 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:40:35.312 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:40:35.312 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.312 INFO:tasks.workunit.client.0.smithi043.stderr: -341> 2024-09-12T00:40:35.171+0000 7fe7bbe3c640 4 set_mon_vals no callback set 2024-09-12T00:40:35.312 INFO:tasks.workunit.client.0.smithi043.stderr: -340> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient: _renew_subs 2024-09-12T00:40:35.312 INFO:tasks.workunit.client.0.smithi043.stderr: -339> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:40:35.312 INFO:tasks.workunit.client.0.smithi043.stderr: -338> 2024-09-12T00:40:35.175+0000 7fe6a4e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:35.312 INFO:tasks.workunit.client.0.smithi043.stderr: -337> 2024-09-12T00:40:35.175+0000 7fe6a4e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:40:35.312 INFO:tasks.workunit.client.0.smithi043.stderr: -336> 2024-09-12T00:40:35.175+0000 7fe6a4e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:40:35.312 INFO:tasks.workunit.client.0.smithi043.stderr: -335> 2024-09-12T00:40:35.175+0000 7fe7bae3a640 10 monclient: get_auth_request con 0x7fe694070a20 auth_method 0 2024-09-12T00:40:35.312 INFO:tasks.workunit.client.0.smithi043.stderr: -334> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 10 monclient: get_monmap_and_config 2024-09-12T00:40:35.313 INFO:tasks.workunit.client.0.smithi043.stderr: -333> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 10 monclient: build_initial_monmap 2024-09-12T00:40:35.313 INFO:tasks.workunit.client.0.smithi043.stderr: -332> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:35.313 INFO:tasks.workunit.client.0.smithi043.stderr: -331> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 10 monclient: monmap: 2024-09-12T00:40:35.313 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:40:35.313 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:35.313 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:40:35.313 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:40:35.313 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:35.313 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:40:35.313 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:40:35.313 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:40:35.313 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:40:35.313 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.314 INFO:tasks.workunit.client.0.smithi043.stderr: -330> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding auth protocol: cephx 2024-09-12T00:40:35.314 INFO:tasks.workunit.client.0.smithi043.stderr: -329> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding auth protocol: cephx 2024-09-12T00:40:35.314 INFO:tasks.workunit.client.0.smithi043.stderr: -328> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding auth protocol: cephx 2024-09-12T00:40:35.314 INFO:tasks.workunit.client.0.smithi043.stderr: -327> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: secure 2024-09-12T00:40:35.314 INFO:tasks.workunit.client.0.smithi043.stderr: -326> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: crc 2024-09-12T00:40:35.314 INFO:tasks.workunit.client.0.smithi043.stderr: -325> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: secure 2024-09-12T00:40:35.314 INFO:tasks.workunit.client.0.smithi043.stderr: -324> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: crc 2024-09-12T00:40:35.314 INFO:tasks.workunit.client.0.smithi043.stderr: -323> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: secure 2024-09-12T00:40:35.314 INFO:tasks.workunit.client.0.smithi043.stderr: -322> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: crc 2024-09-12T00:40:35.314 INFO:tasks.workunit.client.0.smithi043.stderr: -321> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: crc 2024-09-12T00:40:35.315 INFO:tasks.workunit.client.0.smithi043.stderr: -320> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: secure 2024-09-12T00:40:35.315 INFO:tasks.workunit.client.0.smithi043.stderr: -319> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: crc 2024-09-12T00:40:35.315 INFO:tasks.workunit.client.0.smithi043.stderr: -318> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: secure 2024-09-12T00:40:35.315 INFO:tasks.workunit.client.0.smithi043.stderr: -317> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: crc 2024-09-12T00:40:35.315 INFO:tasks.workunit.client.0.smithi043.stderr: -316> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: secure 2024-09-12T00:40:35.315 INFO:tasks.workunit.client.0.smithi043.stderr: -315> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:35.315 INFO:tasks.workunit.client.0.smithi043.stderr: -314> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 10 monclient: init 2024-09-12T00:40:35.315 INFO:tasks.workunit.client.0.smithi043.stderr: -313> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa4c90) adding auth protocol: cephx 2024-09-12T00:40:35.315 INFO:tasks.workunit.client.0.smithi043.stderr: -312> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa4c90) adding auth protocol: cephx 2024-09-12T00:40:35.315 INFO:tasks.workunit.client.0.smithi043.stderr: -311> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa4c90) adding auth protocol: cephx 2024-09-12T00:40:35.315 INFO:tasks.workunit.client.0.smithi043.stderr: -310> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa4c90) adding con mode: secure 2024-09-12T00:40:35.315 INFO:tasks.workunit.client.0.smithi043.stderr: -309> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa4c90) adding con mode: crc 2024-09-12T00:40:35.316 INFO:tasks.workunit.client.0.smithi043.stderr: -308> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa4c90) adding con mode: secure 2024-09-12T00:40:35.316 INFO:tasks.workunit.client.0.smithi043.stderr: -307> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa4c90) adding con mode: crc 2024-09-12T00:40:35.316 INFO:tasks.workunit.client.0.smithi043.stderr: -306> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa4c90) adding con mode: secure 2024-09-12T00:40:35.316 INFO:tasks.workunit.client.0.smithi043.stderr: -305> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa4c90) adding con mode: crc 2024-09-12T00:40:35.316 INFO:tasks.workunit.client.0.smithi043.stderr: -304> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa4c90) adding con mode: crc 2024-09-12T00:40:35.316 INFO:tasks.workunit.client.0.smithi043.stderr: -303> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa4c90) adding con mode: secure 2024-09-12T00:40:35.316 INFO:tasks.workunit.client.0.smithi043.stderr: -302> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa4c90) adding con mode: crc 2024-09-12T00:40:35.316 INFO:tasks.workunit.client.0.smithi043.stderr: -301> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa4c90) adding con mode: secure 2024-09-12T00:40:35.316 INFO:tasks.workunit.client.0.smithi043.stderr: -300> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa4c90) adding con mode: crc 2024-09-12T00:40:35.316 INFO:tasks.workunit.client.0.smithi043.stderr: -299> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa4c90) adding con mode: secure 2024-09-12T00:40:35.316 INFO:tasks.workunit.client.0.smithi043.stderr: -298> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:35.316 INFO:tasks.workunit.client.0.smithi043.stderr: -297> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:35.317 INFO:tasks.workunit.client.0.smithi043.stderr: -296> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command rotate-key cmddesc rotate-key hook 0x7fffdefa4dd8 EEXIST 2024-09-12T00:40:35.317 INFO:tasks.workunit.client.0.smithi043.stderr: -295> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:35.317 INFO:tasks.workunit.client.0.smithi043.stderr: -294> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:40:35.317 INFO:tasks.workunit.client.0.smithi043.stderr: -293> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 10 monclient(hunting): picked mon.noname-b con 0x55ee17294300 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:40:35.317 INFO:tasks.workunit.client.0.smithi043.stderr: -292> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 10 monclient(hunting): picked mon.noname-c con 0x55ee172946e0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:40:35.317 INFO:tasks.workunit.client.0.smithi043.stderr: -291> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 10 monclient(hunting): picked mon.noname-a con 0x55ee17295ba0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:40:35.317 INFO:tasks.workunit.client.0.smithi043.stderr: -290> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:35.317 INFO:tasks.workunit.client.0.smithi043.stderr: -289> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:35.317 INFO:tasks.workunit.client.0.smithi043.stderr: -288> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:35.317 INFO:tasks.workunit.client.0.smithi043.stderr: -287> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:35.317 INFO:tasks.workunit.client.0.smithi043.stderr: -286> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 10 monclient(hunting): authenticate will time out at 2331.166997s 2024-09-12T00:40:35.317 INFO:tasks.workunit.client.0.smithi043.stderr: -285> 2024-09-12T00:40:35.175+0000 7fe7ba639640 10 monclient(hunting): get_auth_request con 0x55ee172946e0 auth_method 0 2024-09-12T00:40:35.318 INFO:tasks.workunit.client.0.smithi043.stderr: -284> 2024-09-12T00:40:35.175+0000 7fe7ba639640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:35.318 INFO:tasks.workunit.client.0.smithi043.stderr: -283> 2024-09-12T00:40:35.175+0000 7fe7ba639640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:35.318 INFO:tasks.workunit.client.0.smithi043.stderr: -282> 2024-09-12T00:40:35.175+0000 7fe7ba639640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:35.318 INFO:tasks.workunit.client.0.smithi043.stderr: -281> 2024-09-12T00:40:35.175+0000 7fe7bb63b640 10 monclient(hunting): get_auth_request con 0x55ee17295ba0 auth_method 0 2024-09-12T00:40:35.318 INFO:tasks.workunit.client.0.smithi043.stderr: -280> 2024-09-12T00:40:35.175+0000 7fe7bb63b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:35.318 INFO:tasks.workunit.client.0.smithi043.stderr: -279> 2024-09-12T00:40:35.175+0000 7fe7bb63b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:35.318 INFO:tasks.workunit.client.0.smithi043.stderr: -278> 2024-09-12T00:40:35.175+0000 7fe7bb63b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:35.318 INFO:tasks.workunit.client.0.smithi043.stderr: -277> 2024-09-12T00:40:35.175+0000 7fe7ba639640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:35.318 INFO:tasks.workunit.client.0.smithi043.stderr: -276> 2024-09-12T00:40:35.175+0000 7fe7ba639640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:35.318 INFO:tasks.workunit.client.0.smithi043.stderr: -275> 2024-09-12T00:40:35.175+0000 7fe7ba639640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:35.318 INFO:tasks.workunit.client.0.smithi043.stderr: -274> 2024-09-12T00:40:35.175+0000 7fe7bb63b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:35.318 INFO:tasks.workunit.client.0.smithi043.stderr: -273> 2024-09-12T00:40:35.175+0000 7fe7bb63b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:35.318 INFO:tasks.workunit.client.0.smithi043.stderr: -272> 2024-09-12T00:40:35.175+0000 7fe7bb63b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:35.319 INFO:tasks.workunit.client.0.smithi043.stderr: -271> 2024-09-12T00:40:35.175+0000 7fe7ba639640 10 monclient(hunting): handle_auth_done global_id 7541 payload 274 2024-09-12T00:40:35.319 INFO:tasks.workunit.client.0.smithi043.stderr: -270> 2024-09-12T00:40:35.175+0000 7fe7ba639640 10 monclient: _finish_hunting 0 2024-09-12T00:40:35.319 INFO:tasks.workunit.client.0.smithi043.stderr: -269> 2024-09-12T00:40:35.175+0000 7fe7ba639640 1 monclient: found mon.noname-c 2024-09-12T00:40:35.319 INFO:tasks.workunit.client.0.smithi043.stderr: -268> 2024-09-12T00:40:35.175+0000 7fe7ba639640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:40:35.319 INFO:tasks.workunit.client.0.smithi043.stderr: -267> 2024-09-12T00:40:35.175+0000 7fe7bae3a640 10 monclient: get_auth_request con 0x55ee17294300 auth_method 0 2024-09-12T00:40:35.319 INFO:tasks.workunit.client.0.smithi043.stderr: -266> 2024-09-12T00:40:35.175+0000 7fe69e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:35.319 INFO:tasks.workunit.client.0.smithi043.stderr: -265> 2024-09-12T00:40:35.175+0000 7fe69e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:35.319 INFO:tasks.workunit.client.0.smithi043.stderr: -264> 2024-09-12T00:40:35.175+0000 7fe69e7fc640 10 monclient: dump: 2024-09-12T00:40:35.319 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:40:35.319 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:40:35.319 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.319 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.320 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:35.320 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:40:35.320 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:40:35.320 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:40:35.320 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:40:35.320 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.320 INFO:tasks.workunit.client.0.smithi043.stderr: -263> 2024-09-12T00:40:35.175+0000 7fe69e7fc640 10 monclient: _finish_auth 0 2024-09-12T00:40:35.320 INFO:tasks.workunit.client.0.smithi043.stderr: -262> 2024-09-12T00:40:35.175+0000 7fe69e7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:40:35.320 INFO:tasks.workunit.client.0.smithi043.stderr: -261> 2024-09-12T00:40:35.175+0000 7fe69e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:35.321 INFO:tasks.workunit.client.0.smithi043.stderr: -260> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 monclient: authenticate success, global_id 7541 2024-09-12T00:40:35.321 INFO:tasks.workunit.client.0.smithi043.stderr: -259> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 10 monclient: get_monmap_and_config success 2024-09-12T00:40:35.321 INFO:tasks.workunit.client.0.smithi043.stderr: -258> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 4 set_mon_vals no callback set 2024-09-12T00:40:35.321 INFO:tasks.workunit.client.0.smithi043.stderr: -257> 2024-09-12T00:40:35.175+0000 7fe69e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:35.321 INFO:tasks.workunit.client.0.smithi043.stderr: -256> 2024-09-12T00:40:35.175+0000 7fe69e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:35.321 INFO:tasks.workunit.client.0.smithi043.stderr: -255> 2024-09-12T00:40:35.175+0000 7fe69e7fc640 10 monclient: dump: 2024-09-12T00:40:35.321 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:40:35.321 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:40:35.322 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.322 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.322 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:35.322 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:40:35.322 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:40:35.322 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:40:35.322 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:40:35.322 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.322 INFO:tasks.workunit.client.0.smithi043.stderr: -254> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient: shutdown 2024-09-12T00:40:35.322 INFO:tasks.workunit.client.0.smithi043.stderr: -253> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient: build_initial_monmap 2024-09-12T00:40:35.322 INFO:tasks.workunit.client.0.smithi043.stderr: -252> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:35.322 INFO:tasks.workunit.client.0.smithi043.stderr: -251> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient: monmap: 2024-09-12T00:40:35.323 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:40:35.323 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:35.323 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:40:35.323 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:40:35.323 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:35.323 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:40:35.323 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:40:35.323 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:40:35.323 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:40:35.323 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.323 INFO:tasks.workunit.client.0.smithi043.stderr: -250> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding auth protocol: cephx 2024-09-12T00:40:35.324 INFO:tasks.workunit.client.0.smithi043.stderr: -249> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding auth protocol: cephx 2024-09-12T00:40:35.324 INFO:tasks.workunit.client.0.smithi043.stderr: -248> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding auth protocol: cephx 2024-09-12T00:40:35.324 INFO:tasks.workunit.client.0.smithi043.stderr: -247> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: secure 2024-09-12T00:40:35.324 INFO:tasks.workunit.client.0.smithi043.stderr: -246> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: crc 2024-09-12T00:40:35.324 INFO:tasks.workunit.client.0.smithi043.stderr: -245> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: secure 2024-09-12T00:40:35.324 INFO:tasks.workunit.client.0.smithi043.stderr: -244> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: crc 2024-09-12T00:40:35.324 INFO:tasks.workunit.client.0.smithi043.stderr: -243> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: secure 2024-09-12T00:40:35.324 INFO:tasks.workunit.client.0.smithi043.stderr: -242> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: crc 2024-09-12T00:40:35.324 INFO:tasks.workunit.client.0.smithi043.stderr: -241> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: crc 2024-09-12T00:40:35.324 INFO:tasks.workunit.client.0.smithi043.stderr: -240> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: secure 2024-09-12T00:40:35.324 INFO:tasks.workunit.client.0.smithi043.stderr: -239> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: crc 2024-09-12T00:40:35.324 INFO:tasks.workunit.client.0.smithi043.stderr: -238> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: secure 2024-09-12T00:40:35.325 INFO:tasks.workunit.client.0.smithi043.stderr: -237> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: crc 2024-09-12T00:40:35.325 INFO:tasks.workunit.client.0.smithi043.stderr: -236> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: secure 2024-09-12T00:40:35.325 INFO:tasks.workunit.client.0.smithi043.stderr: -235> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:35.325 INFO:tasks.workunit.client.0.smithi043.stderr: -234> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 1 librados: starting msgr at 2024-09-12T00:40:35.325 INFO:tasks.workunit.client.0.smithi043.stderr: -233> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 1 librados: starting objecter 2024-09-12T00:40:35.325 INFO:tasks.workunit.client.0.smithi043.stderr: -232> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55ee17299850 EEXIST 2024-09-12T00:40:35.325 INFO:tasks.workunit.client.0.smithi043.stderr: -231> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 1 librados: setting wanted keys 2024-09-12T00:40:35.325 INFO:tasks.workunit.client.0.smithi043.stderr: -230> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 1 librados: calling monclient init 2024-09-12T00:40:35.325 INFO:tasks.workunit.client.0.smithi043.stderr: -229> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient: init 2024-09-12T00:40:35.325 INFO:tasks.workunit.client.0.smithi043.stderr: -228> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17248800) adding auth protocol: cephx 2024-09-12T00:40:35.325 INFO:tasks.workunit.client.0.smithi043.stderr: -227> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17248800) adding auth protocol: cephx 2024-09-12T00:40:35.325 INFO:tasks.workunit.client.0.smithi043.stderr: -226> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17248800) adding auth protocol: cephx 2024-09-12T00:40:35.326 INFO:tasks.workunit.client.0.smithi043.stderr: -225> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17248800) adding con mode: secure 2024-09-12T00:40:35.326 INFO:tasks.workunit.client.0.smithi043.stderr: -224> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17248800) adding con mode: crc 2024-09-12T00:40:35.326 INFO:tasks.workunit.client.0.smithi043.stderr: -223> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17248800) adding con mode: secure 2024-09-12T00:40:35.326 INFO:tasks.workunit.client.0.smithi043.stderr: -222> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17248800) adding con mode: crc 2024-09-12T00:40:35.326 INFO:tasks.workunit.client.0.smithi043.stderr: -221> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17248800) adding con mode: secure 2024-09-12T00:40:35.326 INFO:tasks.workunit.client.0.smithi043.stderr: -220> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17248800) adding con mode: crc 2024-09-12T00:40:35.326 INFO:tasks.workunit.client.0.smithi043.stderr: -219> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17248800) adding con mode: crc 2024-09-12T00:40:35.326 INFO:tasks.workunit.client.0.smithi043.stderr: -218> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17248800) adding con mode: secure 2024-09-12T00:40:35.326 INFO:tasks.workunit.client.0.smithi043.stderr: -217> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17248800) adding con mode: crc 2024-09-12T00:40:35.326 INFO:tasks.workunit.client.0.smithi043.stderr: -216> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17248800) adding con mode: secure 2024-09-12T00:40:35.326 INFO:tasks.workunit.client.0.smithi043.stderr: -215> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17248800) adding con mode: crc 2024-09-12T00:40:35.326 INFO:tasks.workunit.client.0.smithi043.stderr: -214> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17248800) adding con mode: secure 2024-09-12T00:40:35.327 INFO:tasks.workunit.client.0.smithi043.stderr: -213> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:35.327 INFO:tasks.workunit.client.0.smithi043.stderr: -212> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:35.327 INFO:tasks.workunit.client.0.smithi043.stderr: -211> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command rotate-key cmddesc rotate-key hook 0x55ee17248948 EEXIST 2024-09-12T00:40:35.327 INFO:tasks.workunit.client.0.smithi043.stderr: -210> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:35.327 INFO:tasks.workunit.client.0.smithi043.stderr: -209> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:40:35.327 INFO:tasks.workunit.client.0.smithi043.stderr: -208> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient(hunting): picked mon.noname-b con 0x55ee17294300 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:40:35.327 INFO:tasks.workunit.client.0.smithi043.stderr: -207> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient(hunting): picked mon.noname-a con 0x55ee17295ba0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:40:35.327 INFO:tasks.workunit.client.0.smithi043.stderr: -206> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient(hunting): picked mon.noname-c con 0x55ee17286a50 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:40:35.327 INFO:tasks.workunit.client.0.smithi043.stderr: -205> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:35.327 INFO:tasks.workunit.client.0.smithi043.stderr: -204> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:35.327 INFO:tasks.workunit.client.0.smithi043.stderr: -203> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:35.327 INFO:tasks.workunit.client.0.smithi043.stderr: -202> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:35.327 INFO:tasks.workunit.client.0.smithi043.stderr: -201> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient(hunting): authenticate will time out at 2331.169637s 2024-09-12T00:40:35.328 INFO:tasks.workunit.client.0.smithi043.stderr: -200> 2024-09-12T00:40:35.179+0000 7fe7bb63b640 10 monclient(hunting): get_auth_request con 0x55ee17286a50 auth_method 0 2024-09-12T00:40:35.328 INFO:tasks.workunit.client.0.smithi043.stderr: -199> 2024-09-12T00:40:35.179+0000 7fe7bb63b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:35.328 INFO:tasks.workunit.client.0.smithi043.stderr: -198> 2024-09-12T00:40:35.179+0000 7fe7bb63b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:35.328 INFO:tasks.workunit.client.0.smithi043.stderr: -197> 2024-09-12T00:40:35.179+0000 7fe7bb63b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:35.328 INFO:tasks.workunit.client.0.smithi043.stderr: -196> 2024-09-12T00:40:35.179+0000 7fe7ba639640 10 monclient(hunting): get_auth_request con 0x55ee17295ba0 auth_method 0 2024-09-12T00:40:35.328 INFO:tasks.workunit.client.0.smithi043.stderr: -195> 2024-09-12T00:40:35.179+0000 7fe7ba639640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:35.328 INFO:tasks.workunit.client.0.smithi043.stderr: -194> 2024-09-12T00:40:35.179+0000 7fe7ba639640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:35.328 INFO:tasks.workunit.client.0.smithi043.stderr: -193> 2024-09-12T00:40:35.179+0000 7fe7ba639640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:35.328 INFO:tasks.workunit.client.0.smithi043.stderr: -192> 2024-09-12T00:40:35.179+0000 7fe7bb63b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:35.328 INFO:tasks.workunit.client.0.smithi043.stderr: -191> 2024-09-12T00:40:35.179+0000 7fe7bb63b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:35.328 INFO:tasks.workunit.client.0.smithi043.stderr: -190> 2024-09-12T00:40:35.179+0000 7fe7bb63b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:35.328 INFO:tasks.workunit.client.0.smithi043.stderr: -189> 2024-09-12T00:40:35.179+0000 7fe7ba639640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:35.329 INFO:tasks.workunit.client.0.smithi043.stderr: -188> 2024-09-12T00:40:35.179+0000 7fe7ba639640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:35.329 INFO:tasks.workunit.client.0.smithi043.stderr: -187> 2024-09-12T00:40:35.179+0000 7fe7ba639640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:35.329 INFO:tasks.workunit.client.0.smithi043.stderr: -186> 2024-09-12T00:40:35.179+0000 7fe7bae3a640 10 monclient(hunting): get_auth_request con 0x55ee17294300 auth_method 0 2024-09-12T00:40:35.329 INFO:tasks.workunit.client.0.smithi043.stderr: -185> 2024-09-12T00:40:35.179+0000 7fe7bae3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:35.329 INFO:tasks.workunit.client.0.smithi043.stderr: -184> 2024-09-12T00:40:35.179+0000 7fe7bae3a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:35.329 INFO:tasks.workunit.client.0.smithi043.stderr: -183> 2024-09-12T00:40:35.179+0000 7fe7bae3a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:35.329 INFO:tasks.workunit.client.0.smithi043.stderr: -182> 2024-09-12T00:40:35.179+0000 7fe7ba639640 10 monclient(hunting): handle_auth_done global_id 7911 payload 824 2024-09-12T00:40:35.329 INFO:tasks.workunit.client.0.smithi043.stderr: -181> 2024-09-12T00:40:35.179+0000 7fe7ba639640 10 monclient: _finish_hunting 0 2024-09-12T00:40:35.329 INFO:tasks.workunit.client.0.smithi043.stderr: -180> 2024-09-12T00:40:35.179+0000 7fe7ba639640 1 monclient: found mon.noname-a 2024-09-12T00:40:35.329 INFO:tasks.workunit.client.0.smithi043.stderr: -179> 2024-09-12T00:40:35.179+0000 7fe7ba639640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:40:35.329 INFO:tasks.workunit.client.0.smithi043.stderr: -178> 2024-09-12T00:40:35.179+0000 7fe69cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:35.329 INFO:tasks.workunit.client.0.smithi043.stderr: -177> 2024-09-12T00:40:35.179+0000 7fe69cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:40:35.330 INFO:tasks.workunit.client.0.smithi043.stderr: -176> 2024-09-12T00:40:35.179+0000 7fe69cff9640 10 monclient: dump: 2024-09-12T00:40:35.330 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:40:35.330 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:40:35.330 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.330 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.330 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:35.330 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:40:35.330 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:40:35.330 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:40:35.330 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:40:35.330 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.330 INFO:tasks.workunit.client.0.smithi043.stderr: -175> 2024-09-12T00:40:35.179+0000 7fe69cff9640 10 monclient: _finish_auth 0 2024-09-12T00:40:35.331 INFO:tasks.workunit.client.0.smithi043.stderr: -174> 2024-09-12T00:40:35.179+0000 7fe69cff9640 10 monclient: _check_auth_tickets 2024-09-12T00:40:35.331 INFO:tasks.workunit.client.0.smithi043.stderr: -173> 2024-09-12T00:40:35.179+0000 7fe69cff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:35.331 INFO:tasks.workunit.client.0.smithi043.stderr: -172> 2024-09-12T00:40:35.179+0000 7fe69cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:35.331 INFO:tasks.workunit.client.0.smithi043.stderr: -171> 2024-09-12T00:40:35.179+0000 7fe69cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:40:35.331 INFO:tasks.workunit.client.0.smithi043.stderr: -170> 2024-09-12T00:40:35.179+0000 7fe69cff9640 10 monclient: dump: 2024-09-12T00:40:35.331 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:40:35.331 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:40:35.331 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.331 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.331 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:35.331 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:40:35.331 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:40:35.331 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:40:35.332 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:40:35.332 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.332 INFO:tasks.workunit.client.0.smithi043.stderr: -169> 2024-09-12T00:40:35.179+0000 7fe69e7fc640 4 set_mon_vals no callback set 2024-09-12T00:40:35.332 INFO:tasks.workunit.client.0.smithi043.stderr: -168> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 monclient: authenticate success, global_id 7911 2024-09-12T00:40:35.332 INFO:tasks.workunit.client.0.smithi043.stderr: -167> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient: _renew_subs 2024-09-12T00:40:35.332 INFO:tasks.workunit.client.0.smithi043.stderr: -166> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:40:35.332 INFO:tasks.workunit.client.0.smithi043.stderr: -165> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient: _renew_subs 2024-09-12T00:40:35.332 INFO:tasks.workunit.client.0.smithi043.stderr: -164> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:40:35.332 INFO:tasks.workunit.client.0.smithi043.stderr: -163> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 1 librados: init done 2024-09-12T00:40:35.332 INFO:tasks.workunit.client.0.smithi043.stderr: -162> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command cr dump hook 0x55ee1728e2b8 2024-09-12T00:40:35.332 INFO:tasks.workunit.client.0.smithi043.stderr: -161> 2024-09-12T00:40:35.183+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.332 INFO:tasks.workunit.client.0.smithi043.stderr: -160> 2024-09-12T00:40:35.183+0000 7fe69cff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:35.333 INFO:tasks.workunit.client.0.smithi043.stderr: -159> 2024-09-12T00:40:35.183+0000 7fe69cff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:40:35.333 INFO:tasks.workunit.client.0.smithi043.stderr: -158> 2024-09-12T00:40:35.183+0000 7fe69cff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:40:35.333 INFO:tasks.workunit.client.0.smithi043.stderr: -157> 2024-09-12T00:40:35.183+0000 7fe7bae3a640 10 monclient: get_auth_request con 0x7fe684070ba0 auth_method 0 2024-09-12T00:40:35.333 INFO:tasks.workunit.client.0.smithi043.stderr: -156> 2024-09-12T00:40:35.183+0000 7fe7bb63b640 10 monclient: get_auth_request con 0x55ee172b34d0 auth_method 0 2024-09-12T00:40:35.333 INFO:tasks.workunit.client.0.smithi043.stderr: -155> 2024-09-12T00:40:35.183+0000 7fe7bd3349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.333 INFO:tasks.workunit.client.0.smithi043.stderr: -154> 2024-09-12T00:40:35.183+0000 7fe7bd3349c0 20 realm 2024-09-12T00:40:35.333 INFO:tasks.workunit.client.0.smithi043.stderr: -153> 2024-09-12T00:40:35.183+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.333 INFO:tasks.workunit.client.0.smithi043.stderr: -152> 2024-09-12T00:40:35.183+0000 7fe7bd3349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.333 INFO:tasks.workunit.client.0.smithi043.stderr: -151> 2024-09-12T00:40:35.183+0000 7fe7bd3349c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:35.333 INFO:tasks.workunit.client.0.smithi043.stderr: -150> 2024-09-12T00:40:35.183+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.333 INFO:tasks.workunit.client.0.smithi043.stderr: -149> 2024-09-12T00:40:35.183+0000 7fe7bd3349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.333 INFO:tasks.workunit.client.0.smithi043.stderr: -148> 2024-09-12T00:40:35.183+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.334 INFO:tasks.workunit.client.0.smithi043.stderr: -147> 2024-09-12T00:40:35.183+0000 7fe7bae3a640 10 monclient: get_auth_request con 0x55ee172b7830 auth_method 0 2024-09-12T00:40:35.334 INFO:tasks.workunit.client.0.smithi043.stderr: -146> 2024-09-12T00:40:35.183+0000 7fe7bd3349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:35.334 INFO:tasks.workunit.client.0.smithi043.stderr: -145> 2024-09-12T00:40:35.183+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.334 INFO:tasks.workunit.client.0.smithi043.stderr: -144> 2024-09-12T00:40:35.187+0000 7fe7ba639640 10 monclient: get_auth_request con 0x55ee172baf70 auth_method 0 2024-09-12T00:40:35.334 INFO:tasks.workunit.client.0.smithi043.stderr: -143> 2024-09-12T00:40:35.187+0000 7fe7bd3349c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:35.334 INFO:tasks.workunit.client.0.smithi043.stderr: -142> 2024-09-12T00:40:35.187+0000 7fe7bd3349c0 20 searching for the correct realm 2024-09-12T00:40:35.334 INFO:tasks.workunit.client.0.smithi043.stderr: -141> 2024-09-12T00:40:35.187+0000 7fe7bb63b640 10 monclient: get_auth_request con 0x55ee172bfcc0 auth_method 0 2024-09-12T00:40:35.334 INFO:tasks.workunit.client.0.smithi043.stderr: -140> 2024-09-12T00:40:35.187+0000 7fe7bae3a640 10 monclient: get_auth_request con 0x7fe7b401f920 auth_method 0 2024-09-12T00:40:35.334 INFO:tasks.workunit.client.0.smithi043.stderr: -139> 2024-09-12T00:40:35.187+0000 7fe7ba639640 10 monclient: get_auth_request con 0x7fe7b010c000 auth_method 0 2024-09-12T00:40:35.334 INFO:tasks.workunit.client.0.smithi043.stderr: -138> 2024-09-12T00:40:35.191+0000 7fe7bb63b640 0 -- 172.21.15.43:0/3419709128 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55ee172b34d0 msgr2=0x55ee172b58f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:35.334 INFO:tasks.workunit.client.0.smithi043.stderr: -137> 2024-09-12T00:40:35.191+0000 7fe69cff9640 1 client.7911.objecter ms_handle_reset 0x55ee172b34d0 session 0x55ee172b2dc0 osd.1 2024-09-12T00:40:35.334 INFO:tasks.workunit.client.0.smithi043.stderr: -136> 2024-09-12T00:40:35.191+0000 7fe69cff9640 10 monclient: _renew_subs 2024-09-12T00:40:35.334 INFO:tasks.workunit.client.0.smithi043.stderr: -135> 2024-09-12T00:40:35.191+0000 7fe69cff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:40:35.335 INFO:tasks.workunit.client.0.smithi043.stderr: -134> 2024-09-12T00:40:35.191+0000 7fe7bb63b640 10 monclient: get_auth_request con 0x7fe684080bc0 auth_method 0 2024-09-12T00:40:35.335 INFO:tasks.workunit.client.0.smithi043.stderr: -133> 2024-09-12T00:40:35.191+0000 7fe7bb63b640 10 monclient: get_auth_request con 0x7fe7b01209f0 auth_method 0 2024-09-12T00:40:35.335 INFO:tasks.workunit.client.0.smithi043.stderr: -132> 2024-09-12T00:40:35.195+0000 7fe7bae3a640 10 monclient: get_auth_request con 0x7fe7b012a890 auth_method 0 2024-09-12T00:40:35.335 INFO:tasks.workunit.client.0.smithi043.stderr: -131> 2024-09-12T00:40:35.199+0000 7fe7ba639640 0 -- 172.21.15.43:0/3419709128 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fe7b010c000 msgr2=0x7fe7b0133a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:35.335 INFO:tasks.workunit.client.0.smithi043.stderr: -130> 2024-09-12T00:40:35.199+0000 7fe69cff9640 1 client.7911.objecter ms_handle_reset 0x7fe7b010c000 session 0x7fe7b00a6070 osd.4 2024-09-12T00:40:35.335 INFO:tasks.workunit.client.0.smithi043.stderr: -129> 2024-09-12T00:40:35.199+0000 7fe7ba639640 10 monclient: get_auth_request con 0x55ee172b34d0 auth_method 0 2024-09-12T00:40:35.335 INFO:tasks.workunit.client.0.smithi043.stderr: -128> 2024-09-12T00:40:35.203+0000 7fe7bd3349c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:40:35.335 INFO:tasks.workunit.client.0.smithi043.stderr: -127> 2024-09-12T00:40:35.203+0000 7fe7bd3349c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:35.335 INFO:tasks.workunit.client.0.smithi043.stderr: -126> 2024-09-12T00:40:35.203+0000 7fe7bd3349c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:35.335 INFO:tasks.workunit.client.0.smithi043.stderr: -125> 2024-09-12T00:40:35.203+0000 7fe7bd3349c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:40:35.335 INFO:tasks.workunit.client.0.smithi043.stderr: -124> 2024-09-12T00:40:35.203+0000 7fe7bd3349c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:35.335 INFO:tasks.workunit.client.0.smithi043.stderr: -123> 2024-09-12T00:40:35.203+0000 7fe7bd3349c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:35.336 INFO:tasks.workunit.client.0.smithi043.stderr: -122> 2024-09-12T00:40:35.203+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.336 INFO:tasks.workunit.client.0.smithi043.stderr: -121> 2024-09-12T00:40:35.203+0000 7fe7bd3349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.336 INFO:tasks.workunit.client.0.smithi043.stderr: -120> 2024-09-12T00:40:35.203+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.336 INFO:tasks.workunit.client.0.smithi043.stderr: -119> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:35.336 INFO:tasks.workunit.client.0.smithi043.stderr: -118> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.336 INFO:tasks.workunit.client.0.smithi043.stderr: -117> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:35.336 INFO:tasks.workunit.client.0.smithi043.stderr: -116> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 zone default found 2024-09-12T00:40:35.336 INFO:tasks.workunit.client.0.smithi043.stderr: -115> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 4 Realm: () 2024-09-12T00:40:35.336 INFO:tasks.workunit.client.0.smithi043.stderr: -114> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:40:35.336 INFO:tasks.workunit.client.0.smithi043.stderr: -113> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:40:35.336 INFO:tasks.workunit.client.0.smithi043.stderr: -112> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:35.336 INFO:tasks.workunit.client.0.smithi043.stderr: -111> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 zonegroup default 2024-09-12T00:40:35.336 INFO:tasks.workunit.client.0.smithi043.stderr: -110> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.337 INFO:tasks.workunit.client.0.smithi043.stderr: -109> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.337 INFO:tasks.workunit.client.0.smithi043.stderr: -108> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.337 INFO:tasks.workunit.client.0.smithi043.stderr: -107> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.337 INFO:tasks.workunit.client.0.smithi043.stderr: -106> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.337 INFO:tasks.workunit.client.0.smithi043.stderr: -105> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.337 INFO:tasks.workunit.client.0.smithi043.stderr: -104> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 started sync module instance, tier type = 2024-09-12T00:40:35.337 INFO:tasks.workunit.client.0.smithi043.stderr: -103> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:40:35.337 INFO:tasks.workunit.client.0.smithi043.stderr: -102> 2024-09-12T00:40:35.223+0000 7fe7bd3349c0 20 add_watcher() i=0 2024-09-12T00:40:35.337 INFO:tasks.workunit.client.0.smithi043.stderr: -101> 2024-09-12T00:40:35.223+0000 7fe7bd3349c0 20 add_watcher() i=1 2024-09-12T00:40:35.337 INFO:tasks.workunit.client.0.smithi043.stderr: -100> 2024-09-12T00:40:35.223+0000 7fe7bd3349c0 20 add_watcher() i=2 2024-09-12T00:40:35.337 INFO:tasks.workunit.client.0.smithi043.stderr: -99> 2024-09-12T00:40:35.223+0000 7fe7bd3349c0 20 add_watcher() i=3 2024-09-12T00:40:35.338 INFO:tasks.workunit.client.0.smithi043.stderr: -98> 2024-09-12T00:40:35.223+0000 7fe7bd3349c0 20 add_watcher() i=4 2024-09-12T00:40:35.338 INFO:tasks.workunit.client.0.smithi043.stderr: -97> 2024-09-12T00:40:35.223+0000 7fe7bd3349c0 20 add_watcher() i=5 2024-09-12T00:40:35.338 INFO:tasks.workunit.client.0.smithi043.stderr: -96> 2024-09-12T00:40:35.223+0000 7fe7bd3349c0 20 add_watcher() i=6 2024-09-12T00:40:35.338 INFO:tasks.workunit.client.0.smithi043.stderr: -95> 2024-09-12T00:40:35.223+0000 7fe7bd3349c0 20 add_watcher() i=7 2024-09-12T00:40:35.338 INFO:tasks.workunit.client.0.smithi043.stderr: -94> 2024-09-12T00:40:35.223+0000 7fe7bd3349c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:35.338 INFO:tasks.workunit.client.0.smithi043.stderr: -93> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa5170) adding auth protocol: cephx 2024-09-12T00:40:35.338 INFO:tasks.workunit.client.0.smithi043.stderr: -92> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa5170) adding auth protocol: cephx 2024-09-12T00:40:35.338 INFO:tasks.workunit.client.0.smithi043.stderr: -91> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa5170) adding auth protocol: cephx 2024-09-12T00:40:35.338 INFO:tasks.workunit.client.0.smithi043.stderr: -90> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa5170) adding con mode: secure 2024-09-12T00:40:35.338 INFO:tasks.workunit.client.0.smithi043.stderr: -89> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa5170) adding con mode: crc 2024-09-12T00:40:35.338 INFO:tasks.workunit.client.0.smithi043.stderr: -88> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa5170) adding con mode: secure 2024-09-12T00:40:35.338 INFO:tasks.workunit.client.0.smithi043.stderr: -87> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa5170) adding con mode: crc 2024-09-12T00:40:35.338 INFO:tasks.workunit.client.0.smithi043.stderr: -86> 2024-09-12T00:40:35.227+0000 7fe671fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:35.339 INFO:tasks.workunit.client.0.smithi043.stderr: -85> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa5170) adding con mode: secure 2024-09-12T00:40:35.339 INFO:tasks.workunit.client.0.smithi043.stderr: -84> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa5170) adding con mode: crc 2024-09-12T00:40:35.339 INFO:tasks.workunit.client.0.smithi043.stderr: -83> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa5170) adding con mode: crc 2024-09-12T00:40:35.339 INFO:tasks.workunit.client.0.smithi043.stderr: -82> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa5170) adding con mode: secure 2024-09-12T00:40:35.339 INFO:tasks.workunit.client.0.smithi043.stderr: -81> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa5170) adding con mode: crc 2024-09-12T00:40:35.339 INFO:tasks.workunit.client.0.smithi043.stderr: -80> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa5170) adding con mode: secure 2024-09-12T00:40:35.339 INFO:tasks.workunit.client.0.smithi043.stderr: -79> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa5170) adding con mode: crc 2024-09-12T00:40:35.339 INFO:tasks.workunit.client.0.smithi043.stderr: -78> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa5170) adding con mode: secure 2024-09-12T00:40:35.339 INFO:tasks.workunit.client.0.smithi043.stderr: -77> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:35.339 INFO:tasks.workunit.client.0.smithi043.stderr: -76> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:35.339 INFO:tasks.workunit.client.0.smithi043.stderr: -75> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:35.339 INFO:tasks.workunit.client.0.smithi043.stderr: -74> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command cache list hook 0x55ee17286e90 2024-09-12T00:40:35.340 INFO:tasks.workunit.client.0.smithi043.stderr: -73> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command cache inspect hook 0x55ee17286e90 2024-09-12T00:40:35.340 INFO:tasks.workunit.client.0.smithi043.stderr: -72> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command cache erase hook 0x55ee17286e90 2024-09-12T00:40:35.340 INFO:tasks.workunit.client.0.smithi043.stderr: -71> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command cache zap hook 0x55ee17286e90 2024-09-12T00:40:35.340 INFO:tasks.workunit.client.0.smithi043.stderr: -70> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 note: GC not initialized 2024-09-12T00:40:35.340 INFO:tasks.workunit.client.0.smithi043.stderr: -69> 2024-09-12T00:40:35.227+0000 7fe670fe1640 20 reqs_thread_entry: start 2024-09-12T00:40:35.340 INFO:tasks.workunit.client.0.smithi043.stderr: -68> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command sync trace show hook 0x7fe7b011f070 2024-09-12T00:40:35.340 INFO:tasks.workunit.client.0.smithi043.stderr: -67> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command sync trace history hook 0x7fe7b011f070 2024-09-12T00:40:35.340 INFO:tasks.workunit.client.0.smithi043.stderr: -66> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command sync trace active hook 0x7fe7b011f070 2024-09-12T00:40:35.340 INFO:tasks.workunit.client.0.smithi043.stderr: -65> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command sync trace active_short hook 0x7fe7b011f070 2024-09-12T00:40:35.340 INFO:tasks.workunit.client.0.smithi043.stderr: -64> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:35.340 INFO:tasks.workunit.client.0.smithi043.stderr: -63> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 20 Filter name: none 2024-09-12T00:40:35.340 INFO:tasks.workunit.client.0.smithi043.stderr: -62> 2024-09-12T00:40:35.227+0000 7fe669ffb640 20 reqs_thread_entry: start 2024-09-12T00:40:35.341 INFO:tasks.workunit.client.0.smithi043.stderr: -61> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:40:35.341 INFO:tasks.workunit.client.0.smithi043.stderr: -60> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.341 INFO:tasks.workunit.client.0.smithi043.stderr: -59> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:40:35.341 INFO:tasks.workunit.client.0.smithi043.stderr: -58> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:40:35.341 INFO:tasks.workunit.client.0.smithi043.stderr: -57> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:40:35.341 INFO:tasks.workunit.client.0.smithi043.stderr: -56> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 : miss 2024-09-12T00:40:35.341 INFO:tasks.workunit.client.0.smithi043.stderr: -55> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.341 INFO:tasks.workunit.client.0.smithi043.stderr: -54> 2024-09-12T00:40:35.231+0000 7fe7bd3349c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:40:35.341 INFO:tasks.workunit.client.0.smithi043.stderr: -53> 2024-09-12T00:40:35.231+0000 7fe7bd3349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 info.flags=0x17 2024-09-12T00:40:35.341 INFO:tasks.workunit.client.0.smithi043.stderr: -52> 2024-09-12T00:40:35.231+0000 7fe7bd3349c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 to cache LRU end 2024-09-12T00:40:35.341 INFO:tasks.workunit.client.0.smithi043.stderr: -51> 2024-09-12T00:40:35.231+0000 7fe7bd3349c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:35.341 INFO:tasks.workunit.client.0.smithi043.stderr: -50> 2024-09-12T00:40:35.231+0000 7fe7bd3349c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:35.342 INFO:tasks.workunit.client.0.smithi043.stderr: -49> 2024-09-12T00:40:35.231+0000 7fe7bd3349c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 2024-09-12T00:40:35.342 INFO:tasks.workunit.client.0.smithi043.stderr: -48> 2024-09-12T00:40:35.243+0000 7fe7bd3349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 info.flags=0x17 2024-09-12T00:40:35.342 INFO:tasks.workunit.client.0.smithi043.stderr: -47> 2024-09-12T00:40:35.243+0000 7fe7bd3349c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 to cache LRU end 2024-09-12T00:40:35.342 INFO:tasks.workunit.client.0.smithi043.stderr: -46> 2024-09-12T00:40:35.243+0000 7fe7bd3349c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:35.342 INFO:tasks.workunit.client.0.smithi043.stderr: -45> 2024-09-12T00:40:35.243+0000 7fe7bd3349c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39, ofs0, ns] 2024-09-12T00:40:35.342 INFO:tasks.workunit.client.0.smithi043.stderr: -44> 2024-09-12T00:40:35.243+0000 7fe69e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333498 cookie 94481079348288 notifier 7911 bl.length()=931 2024-09-12T00:40:35.342 INFO:tasks.workunit.client.0.smithi043.stderr: -43> 2024-09-12T00:40:35.243+0000 7fe69e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 info.flags=0x17 2024-09-12T00:40:35.342 INFO:tasks.workunit.client.0.smithi043.stderr: -42> 2024-09-12T00:40:35.243+0000 7fe69e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 to cache LRU end 2024-09-12T00:40:35.342 INFO:tasks.workunit.client.0.smithi043.stderr: -41> 2024-09-12T00:40:35.243+0000 7fe69e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:35.342 INFO:tasks.workunit.client.0.smithi043.stderr: -40> 2024-09-12T00:40:35.247+0000 7fe7bd3349c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39]): orig_sources= new_sources= 2024-09-12T00:40:35.342 INFO:tasks.workunit.client.0.smithi043.stderr: -39> 2024-09-12T00:40:35.247+0000 7fe7bd3349c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39]): potential sources added=[] removed=[] 2024-09-12T00:40:35.342 INFO:tasks.workunit.client.0.smithi043.stderr: -38> 2024-09-12T00:40:35.247+0000 7fe7bd3349c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39]): orig_dests= new_dests= 2024-09-12T00:40:35.342 INFO:tasks.workunit.client.0.smithi043.stderr: -37> 2024-09-12T00:40:35.247+0000 7fe7bd3349c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39]): potential dests added=[] removed=[] 2024-09-12T00:40:35.343 INFO:tasks.workunit.client.0.smithi043.stderr: -36> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.0 2024-09-12T00:40:35.343 INFO:tasks.workunit.client.0.smithi043.stderr: -35> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.0 2024-09-12T00:40:35.343 INFO:tasks.workunit.client.0.smithi043.stderr: -34> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.1 2024-09-12T00:40:35.343 INFO:tasks.workunit.client.0.smithi043.stderr: -33> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.1 2024-09-12T00:40:35.343 INFO:tasks.workunit.client.0.smithi043.stderr: -32> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.2 2024-09-12T00:40:35.343 INFO:tasks.workunit.client.0.smithi043.stderr: -31> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.2 2024-09-12T00:40:35.343 INFO:tasks.workunit.client.0.smithi043.stderr: -30> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.3 2024-09-12T00:40:35.343 INFO:tasks.workunit.client.0.smithi043.stderr: -29> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.3 2024-09-12T00:40:35.343 INFO:tasks.workunit.client.0.smithi043.stderr: -28> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.4 2024-09-12T00:40:35.343 INFO:tasks.workunit.client.0.smithi043.stderr: -27> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.4 2024-09-12T00:40:35.343 INFO:tasks.workunit.client.0.smithi043.stderr: -26> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.5 2024-09-12T00:40:35.343 INFO:tasks.workunit.client.0.smithi043.stderr: -25> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.5 2024-09-12T00:40:35.343 INFO:tasks.workunit.client.0.smithi043.stderr: -24> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.6 2024-09-12T00:40:35.344 INFO:tasks.workunit.client.0.smithi043.stderr: -23> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.6 2024-09-12T00:40:35.344 INFO:tasks.workunit.client.0.smithi043.stderr: -22> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.7 2024-09-12T00:40:35.344 INFO:tasks.workunit.client.0.smithi043.stderr: -21> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.7 2024-09-12T00:40:35.344 INFO:tasks.workunit.client.0.smithi043.stderr: -20> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.8 2024-09-12T00:40:35.344 INFO:tasks.workunit.client.0.smithi043.stderr: -19> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.8 2024-09-12T00:40:35.344 INFO:tasks.workunit.client.0.smithi043.stderr: -18> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.9 2024-09-12T00:40:35.344 INFO:tasks.workunit.client.0.smithi043.stderr: -17> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.9 2024-09-12T00:40:35.344 INFO:tasks.workunit.client.0.smithi043.stderr: -16> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.10 2024-09-12T00:40:35.344 INFO:tasks.workunit.client.0.smithi043.stderr: -15> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.10 2024-09-12T00:40:35.344 INFO:tasks.workunit.client.0.smithi043.stderr: -14> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.11 2024-09-12T00:40:35.344 INFO:tasks.workunit.client.0.smithi043.stderr: -13> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.11 2024-09-12T00:40:35.344 INFO:tasks.workunit.client.0.smithi043.stderr: -12> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.0 2024-09-12T00:40:35.345 INFO:tasks.workunit.client.0.smithi043.stderr: -11> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1 2024-09-12T00:40:35.345 INFO:tasks.workunit.client.0.smithi043.stderr: -10> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.2 2024-09-12T00:40:35.345 INFO:tasks.workunit.client.0.smithi043.stderr: -9> 2024-09-12T00:40:35.259+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.3 2024-09-12T00:40:35.345 INFO:tasks.workunit.client.0.smithi043.stderr: -8> 2024-09-12T00:40:35.259+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.4 2024-09-12T00:40:35.345 INFO:tasks.workunit.client.0.smithi043.stderr: -7> 2024-09-12T00:40:35.259+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.5 2024-09-12T00:40:35.345 INFO:tasks.workunit.client.0.smithi043.stderr: -6> 2024-09-12T00:40:35.259+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.6 2024-09-12T00:40:35.345 INFO:tasks.workunit.client.0.smithi043.stderr: -5> 2024-09-12T00:40:35.263+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.7 2024-09-12T00:40:35.345 INFO:tasks.workunit.client.0.smithi043.stderr: -4> 2024-09-12T00:40:35.263+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.8 2024-09-12T00:40:35.345 INFO:tasks.workunit.client.0.smithi043.stderr: -3> 2024-09-12T00:40:35.263+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.9 2024-09-12T00:40:35.345 INFO:tasks.workunit.client.0.smithi043.stderr: -2> 2024-09-12T00:40:35.263+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.10 2024-09-12T00:40:35.345 INFO:tasks.workunit.client.0.smithi043.stderr: -1> 2024-09-12T00:40:35.271+0000 7fe7bd3349c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe7bd3349c0 time 2024-09-12T00:40:35.274837+0000 2024-09-12T00:40:35.346 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:40:35.346 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.346 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:35.346 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe7c0c0e2eb] 2024-09-12T00:40:35.346 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe7c0c0e49f] 2024-09-12T00:40:35.346 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee15eefcc1] 2024-09-12T00:40:35.346 INFO:tasks.workunit.client.0.smithi043.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x55ee15f0401c] 2024-09-12T00:40:35.346 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ee15f056a4] 2024-09-12T00:40:35.346 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:40:35.346 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe7bfa74d90] 2024-09-12T00:40:35.346 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:40:35.346 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:40:35.346 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.347 INFO:tasks.workunit.client.0.smithi043.stderr: 0> 2024-09-12T00:40:35.275+0000 7fe7bd3349c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:40:35.347 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7fe7bd3349c0 thread_name:radosgw-admin 2024-09-12T00:40:35.347 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.347 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:35.347 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe7bfa8d520] 2024-09-12T00:40:35.347 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:40:35.347 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:40:35.347 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:40:35.347 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe7c0c0e345] 2024-09-12T00:40:35.347 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe7c0c0e49f] 2024-09-12T00:40:35.347 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee15eefcc1] 2024-09-12T00:40:35.347 INFO:tasks.workunit.client.0.smithi043.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x55ee15f0401c] 2024-09-12T00:40:35.347 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ee15f056a4] 2024-09-12T00:40:35.348 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:40:35.348 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe7bfa74d90] 2024-09-12T00:40:35.348 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:40:35.348 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:40:35.348 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:40:35.348 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.348 INFO:tasks.workunit.client.0.smithi043.stderr:--- logging levels --- 2024-09-12T00:40:35.348 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 none 2024-09-12T00:40:35.348 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 lockdep 2024-09-12T00:40:35.348 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 context 2024-09-12T00:40:35.348 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 crush 2024-09-12T00:40:35.348 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds 2024-09-12T00:40:35.348 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_balancer 2024-09-12T00:40:35.349 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_locker 2024-09-12T00:40:35.349 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log 2024-09-12T00:40:35.349 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log_expire 2024-09-12T00:40:35.349 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_migrator 2024-09-12T00:40:35.349 INFO:tasks.workunit.client.0.smithi043.stderr: 3/ 5 mds_quiesce 2024-09-12T00:40:35.349 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 buffer 2024-09-12T00:40:35.349 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 timer 2024-09-12T00:40:35.349 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 filer 2024-09-12T00:40:35.349 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 striper 2024-09-12T00:40:35.349 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 objecter 2024-09-12T00:40:35.349 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rados 2024-09-12T00:40:35.349 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd 2024-09-12T00:40:35.349 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_mirror 2024-09-12T00:40:35.350 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_replay 2024-09-12T00:40:35.350 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_pwl 2024-09-12T00:40:35.350 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 journaler 2024-09-12T00:40:35.350 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objectcacher 2024-09-12T00:40:35.350 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:40:35.350 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 client 2024-09-12T00:40:35.350 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 osd 2024-09-12T00:40:35.350 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 optracker 2024-09-12T00:40:35.350 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objclass 2024-09-12T00:40:35.350 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 filestore 2024-09-12T00:40:35.350 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 journal 2024-09-12T00:40:35.350 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 ms 2024-09-12T00:40:35.350 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mon 2024-09-12T00:40:35.350 INFO:tasks.workunit.client.0.smithi043.stderr: 0/10 monc 2024-09-12T00:40:35.351 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 paxos 2024-09-12T00:40:35.351 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 tp 2024-09-12T00:40:35.351 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 auth 2024-09-12T00:40:35.351 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 crypto 2024-09-12T00:40:35.351 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 finisher 2024-09-12T00:40:35.351 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 reserver 2024-09-12T00:40:35.351 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 heartbeatmap 2024-09-12T00:40:35.351 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 perfcounter 2024-09-12T00:40:35.351 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw 2024-09-12T00:40:35.351 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_sync 2024-09-12T00:40:35.351 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_datacache 2024-09-12T00:40:35.351 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_access 2024-09-12T00:40:35.351 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:40:35.352 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_flight 2024-09-12T00:40:35.352 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:40:35.352 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw_notification 2024-09-12T00:40:35.352 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 javaclient 2024-09-12T00:40:35.352 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 asok 2024-09-12T00:40:35.352 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 throttle 2024-09-12T00:40:35.352 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 refs 2024-09-12T00:40:35.352 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 compressor 2024-09-12T00:40:35.352 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluestore 2024-09-12T00:40:35.352 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluefs 2024-09-12T00:40:35.352 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 bdev 2024-09-12T00:40:35.352 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 kstore 2024-09-12T00:40:35.352 INFO:tasks.workunit.client.0.smithi043.stderr: 4/ 5 rocksdb 2024-09-12T00:40:35.353 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 fuse 2024-09-12T00:40:35.353 INFO:tasks.workunit.client.0.smithi043.stderr: 2/ 5 mgr 2024-09-12T00:40:35.353 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mgrc 2024-09-12T00:40:35.353 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 dpdk 2024-09-12T00:40:35.353 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 eventtrace 2024-09-12T00:40:35.353 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 prioritycache 2024-09-12T00:40:35.353 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 test 2024-09-12T00:40:35.353 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:40:35.353 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephsqlite 2024-09-12T00:40:35.353 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:40:35.353 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore 2024-09-12T00:40:35.353 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_onode 2024-09-12T00:40:35.354 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_odata 2024-09-12T00:40:35.354 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_omap 2024-09-12T00:40:35.354 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_tm 2024-09-12T00:40:35.354 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_t 2024-09-12T00:40:35.354 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:40:35.354 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_epm 2024-09-12T00:40:35.354 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_lba 2024-09-12T00:40:35.354 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:40:35.354 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cache 2024-09-12T00:40:35.354 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_journal 2024-09-12T00:40:35.354 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_device 2024-09-12T00:40:35.354 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_backref 2024-09-12T00:40:35.354 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 alienstore 2024-09-12T00:40:35.355 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mclock 2024-09-12T00:40:35.355 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cyanstore 2024-09-12T00:40:35.355 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 ceph_exporter 2024-09-12T00:40:35.355 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 memstore 2024-09-12T00:40:35.355 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 trace 2024-09-12T00:40:35.355 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 ceph_dedup 2024-09-12T00:40:35.355 INFO:tasks.workunit.client.0.smithi043.stderr: -2/-2 (syslog threshold) 2024-09-12T00:40:35.355 INFO:tasks.workunit.client.0.smithi043.stderr: 99/99 (stderr threshold) 2024-09-12T00:40:35.355 INFO:tasks.workunit.client.0.smithi043.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:40:35.355 INFO:tasks.workunit.client.0.smithi043.stderr: 7fe669ffb640 / http_manager 2024-09-12T00:40:35.355 INFO:tasks.workunit.client.0.smithi043.stderr: 7fe670fe1640 / http_manager 2024-09-12T00:40:35.355 INFO:tasks.workunit.client.0.smithi043.stderr: 7fe671fe3640 / rgw_dt_lg_renew 2024-09-12T00:40:35.355 INFO:tasks.workunit.client.0.smithi043.stderr: 7fe69cff9640 / ms_dispatch 2024-09-12T00:40:35.356 INFO:tasks.workunit.client.0.smithi043.stderr: 7fe69e7fc640 / io_context_pool 2024-09-12T00:40:35.356 INFO:tasks.workunit.client.0.smithi043.stderr: 7fe6a4e01640 / ms_dispatch 2024-09-12T00:40:35.356 INFO:tasks.workunit.client.0.smithi043.stderr: 7fe6a7606640 / ms_dispatch 2024-09-12T00:40:35.356 INFO:tasks.workunit.client.0.smithi043.stderr: 7fe6a8e09640 / io_context_pool 2024-09-12T00:40:35.356 INFO:tasks.workunit.client.0.smithi043.stderr: 7fe7ba639640 / msgr-worker-2 2024-09-12T00:40:35.356 INFO:tasks.workunit.client.0.smithi043.stderr: 7fe7bae3a640 / msgr-worker-1 2024-09-12T00:40:35.356 INFO:tasks.workunit.client.0.smithi043.stderr: 7fe7bb63b640 / msgr-worker-0 2024-09-12T00:40:35.356 INFO:tasks.workunit.client.0.smithi043.stderr: 7fe7bbe3c640 / io_context_pool 2024-09-12T00:40:35.356 INFO:tasks.workunit.client.0.smithi043.stderr: 7fe7bd3349c0 / radosgw-admin 2024-09-12T00:40:35.356 INFO:tasks.workunit.client.0.smithi043.stderr: max_recent 500 2024-09-12T00:40:35.356 INFO:tasks.workunit.client.0.smithi043.stderr: max_new 1000 2024-09-12T00:40:35.356 INFO:tasks.workunit.client.0.smithi043.stderr: log_file /var/log/ceph/ceph-client.admin.133349.log 2024-09-12T00:40:35.356 INFO:tasks.workunit.client.0.smithi043.stderr:--- end dump of recent events --- 2024-09-12T00:40:35.357 INFO:tasks.workunit.client.0.smithi043.stderr:--- begin dump of recent events --- 2024-09-12T00:40:35.357 INFO:tasks.workunit.client.0.smithi043.stderr: -499> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 1 librados: starting objecter 2024-09-12T00:40:35.357 INFO:tasks.workunit.client.0.smithi043.stderr: -498> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command objecter_requests hook 0x55ee16f9ad30 2024-09-12T00:40:35.357 INFO:tasks.workunit.client.0.smithi043.stderr: -497> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 1 librados: setting wanted keys 2024-09-12T00:40:35.357 INFO:tasks.workunit.client.0.smithi043.stderr: -496> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 1 librados: calling monclient init 2024-09-12T00:40:35.357 INFO:tasks.workunit.client.0.smithi043.stderr: -495> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 10 monclient: init 2024-09-12T00:40:35.357 INFO:tasks.workunit.client.0.smithi043.stderr: -494> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee171cba40) adding auth protocol: cephx 2024-09-12T00:40:35.357 INFO:tasks.workunit.client.0.smithi043.stderr: -493> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee171cba40) adding auth protocol: cephx 2024-09-12T00:40:35.357 INFO:tasks.workunit.client.0.smithi043.stderr: -492> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee171cba40) adding auth protocol: cephx 2024-09-12T00:40:35.357 INFO:tasks.workunit.client.0.smithi043.stderr: -491> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee171cba40) adding con mode: secure 2024-09-12T00:40:35.357 INFO:tasks.workunit.client.0.smithi043.stderr: -490> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee171cba40) adding con mode: crc 2024-09-12T00:40:35.357 INFO:tasks.workunit.client.0.smithi043.stderr: -489> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee171cba40) adding con mode: secure 2024-09-12T00:40:35.358 INFO:tasks.workunit.client.0.smithi043.stderr: -488> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee171cba40) adding con mode: crc 2024-09-12T00:40:35.358 INFO:tasks.workunit.client.0.smithi043.stderr: -487> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee171cba40) adding con mode: secure 2024-09-12T00:40:35.358 INFO:tasks.workunit.client.0.smithi043.stderr: -486> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee171cba40) adding con mode: crc 2024-09-12T00:40:35.358 INFO:tasks.workunit.client.0.smithi043.stderr: -485> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee171cba40) adding con mode: crc 2024-09-12T00:40:35.358 INFO:tasks.workunit.client.0.smithi043.stderr: -484> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee171cba40) adding con mode: secure 2024-09-12T00:40:35.358 INFO:tasks.workunit.client.0.smithi043.stderr: -483> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee171cba40) adding con mode: crc 2024-09-12T00:40:35.358 INFO:tasks.workunit.client.0.smithi043.stderr: -482> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee171cba40) adding con mode: secure 2024-09-12T00:40:35.358 INFO:tasks.workunit.client.0.smithi043.stderr: -481> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee171cba40) adding con mode: crc 2024-09-12T00:40:35.358 INFO:tasks.workunit.client.0.smithi043.stderr: -480> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee171cba40) adding con mode: secure 2024-09-12T00:40:35.358 INFO:tasks.workunit.client.0.smithi043.stderr: -479> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:35.358 INFO:tasks.workunit.client.0.smithi043.stderr: -478> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:35.358 INFO:tasks.workunit.client.0.smithi043.stderr: -477> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command rotate-key hook 0x55ee171cbb88 2024-09-12T00:40:35.358 INFO:tasks.workunit.client.0.smithi043.stderr: -476> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:35.359 INFO:tasks.workunit.client.0.smithi043.stderr: -475> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:40:35.359 INFO:tasks.workunit.client.0.smithi043.stderr: -474> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 10 monclient(hunting): picked mon.noname-b con 0x55ee1707b820 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:40:35.359 INFO:tasks.workunit.client.0.smithi043.stderr: -473> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 10 monclient(hunting): picked mon.noname-a con 0x55ee17086a80 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:40:35.359 INFO:tasks.workunit.client.0.smithi043.stderr: -472> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 10 monclient(hunting): picked mon.noname-c con 0x55ee17117170 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:40:35.359 INFO:tasks.workunit.client.0.smithi043.stderr: -471> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:35.359 INFO:tasks.workunit.client.0.smithi043.stderr: -470> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:35.359 INFO:tasks.workunit.client.0.smithi043.stderr: -469> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:35.359 INFO:tasks.workunit.client.0.smithi043.stderr: -468> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:35.359 INFO:tasks.workunit.client.0.smithi043.stderr: -467> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 10 monclient(hunting): authenticate will time out at 2331.153964s 2024-09-12T00:40:35.359 INFO:tasks.workunit.client.0.smithi043.stderr: -466> 2024-09-12T00:40:35.163+0000 7fe7ba639640 10 monclient(hunting): get_auth_request con 0x55ee17086a80 auth_method 0 2024-09-12T00:40:35.359 INFO:tasks.workunit.client.0.smithi043.stderr: -465> 2024-09-12T00:40:35.163+0000 7fe7ba639640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:35.359 INFO:tasks.workunit.client.0.smithi043.stderr: -464> 2024-09-12T00:40:35.163+0000 7fe7ba639640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:35.359 INFO:tasks.workunit.client.0.smithi043.stderr: -463> 2024-09-12T00:40:35.163+0000 7fe7ba639640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:35.360 INFO:tasks.workunit.client.0.smithi043.stderr: -462> 2024-09-12T00:40:35.163+0000 7fe7bb63b640 10 monclient(hunting): get_auth_request con 0x55ee17117170 auth_method 0 2024-09-12T00:40:35.360 INFO:tasks.workunit.client.0.smithi043.stderr: -461> 2024-09-12T00:40:35.163+0000 7fe7bb63b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:35.360 INFO:tasks.workunit.client.0.smithi043.stderr: -460> 2024-09-12T00:40:35.163+0000 7fe7bb63b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:35.360 INFO:tasks.workunit.client.0.smithi043.stderr: -459> 2024-09-12T00:40:35.163+0000 7fe7bb63b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:35.360 INFO:tasks.workunit.client.0.smithi043.stderr: -458> 2024-09-12T00:40:35.163+0000 7fe7ba639640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:35.360 INFO:tasks.workunit.client.0.smithi043.stderr: -457> 2024-09-12T00:40:35.163+0000 7fe7ba639640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:35.360 INFO:tasks.workunit.client.0.smithi043.stderr: -456> 2024-09-12T00:40:35.163+0000 7fe7ba639640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:35.360 INFO:tasks.workunit.client.0.smithi043.stderr: -455> 2024-09-12T00:40:35.163+0000 7fe7bb63b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:35.360 INFO:tasks.workunit.client.0.smithi043.stderr: -454> 2024-09-12T00:40:35.163+0000 7fe7bb63b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:35.360 INFO:tasks.workunit.client.0.smithi043.stderr: -453> 2024-09-12T00:40:35.163+0000 7fe7bb63b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:35.360 INFO:tasks.workunit.client.0.smithi043.stderr: -452> 2024-09-12T00:40:35.163+0000 7fe7bae3a640 10 monclient(hunting): get_auth_request con 0x55ee1707b820 auth_method 0 2024-09-12T00:40:35.360 INFO:tasks.workunit.client.0.smithi043.stderr: -451> 2024-09-12T00:40:35.163+0000 7fe7bae3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:35.360 INFO:tasks.workunit.client.0.smithi043.stderr: -450> 2024-09-12T00:40:35.163+0000 7fe7bae3a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:35.361 INFO:tasks.workunit.client.0.smithi043.stderr: -449> 2024-09-12T00:40:35.163+0000 7fe7bae3a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:35.361 INFO:tasks.workunit.client.0.smithi043.stderr: -448> 2024-09-12T00:40:35.163+0000 7fe7ba639640 10 monclient(hunting): handle_auth_done global_id 7902 payload 824 2024-09-12T00:40:35.361 INFO:tasks.workunit.client.0.smithi043.stderr: -447> 2024-09-12T00:40:35.163+0000 7fe7ba639640 10 monclient: _finish_hunting 0 2024-09-12T00:40:35.361 INFO:tasks.workunit.client.0.smithi043.stderr: -446> 2024-09-12T00:40:35.163+0000 7fe7ba639640 1 monclient: found mon.noname-a 2024-09-12T00:40:35.361 INFO:tasks.workunit.client.0.smithi043.stderr: -445> 2024-09-12T00:40:35.163+0000 7fe7ba639640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:40:35.361 INFO:tasks.workunit.client.0.smithi043.stderr: -444> 2024-09-12T00:40:35.163+0000 7fe6a7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:35.361 INFO:tasks.workunit.client.0.smithi043.stderr: -443> 2024-09-12T00:40:35.163+0000 7fe6a7606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:40:35.361 INFO:tasks.workunit.client.0.smithi043.stderr: -442> 2024-09-12T00:40:35.163+0000 7fe6a7606640 10 monclient: dump: 2024-09-12T00:40:35.361 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:40:35.361 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:40:35.361 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.361 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.361 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:35.362 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:40:35.362 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:40:35.362 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:40:35.362 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:40:35.362 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.362 INFO:tasks.workunit.client.0.smithi043.stderr: -441> 2024-09-12T00:40:35.163+0000 7fe6a7606640 10 monclient: _finish_auth 0 2024-09-12T00:40:35.362 INFO:tasks.workunit.client.0.smithi043.stderr: -440> 2024-09-12T00:40:35.163+0000 7fe6a7606640 10 monclient: _check_auth_tickets 2024-09-12T00:40:35.362 INFO:tasks.workunit.client.0.smithi043.stderr: -439> 2024-09-12T00:40:35.163+0000 7fe6a7606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:35.362 INFO:tasks.workunit.client.0.smithi043.stderr: -438> 2024-09-12T00:40:35.163+0000 7fe6a7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:35.362 INFO:tasks.workunit.client.0.smithi043.stderr: -437> 2024-09-12T00:40:35.163+0000 7fe6a7606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:40:35.362 INFO:tasks.workunit.client.0.smithi043.stderr: -436> 2024-09-12T00:40:35.163+0000 7fe6a7606640 10 monclient: dump: 2024-09-12T00:40:35.362 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:40:35.362 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:40:35.363 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.363 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.363 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:35.363 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:40:35.363 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:40:35.363 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:40:35.363 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:40:35.363 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.363 INFO:tasks.workunit.client.0.smithi043.stderr: -435> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 5 monclient: authenticate success, global_id 7902 2024-09-12T00:40:35.363 INFO:tasks.workunit.client.0.smithi043.stderr: -434> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 10 monclient: _renew_subs 2024-09-12T00:40:35.363 INFO:tasks.workunit.client.0.smithi043.stderr: -433> 2024-09-12T00:40:35.163+0000 7fe6a8e09640 4 set_mon_vals no callback set 2024-09-12T00:40:35.363 INFO:tasks.workunit.client.0.smithi043.stderr: -432> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:40:35.363 INFO:tasks.workunit.client.0.smithi043.stderr: -431> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 10 monclient: _renew_subs 2024-09-12T00:40:35.364 INFO:tasks.workunit.client.0.smithi043.stderr: -430> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:40:35.364 INFO:tasks.workunit.client.0.smithi043.stderr: -429> 2024-09-12T00:40:35.163+0000 7fe7bd3349c0 1 librados: init done 2024-09-12T00:40:35.364 INFO:tasks.workunit.client.0.smithi043.stderr: -428> 2024-09-12T00:40:35.167+0000 7fe6a7606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:35.364 INFO:tasks.workunit.client.0.smithi043.stderr: -427> 2024-09-12T00:40:35.167+0000 7fe6a7606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:40:35.364 INFO:tasks.workunit.client.0.smithi043.stderr: -426> 2024-09-12T00:40:35.167+0000 7fe6a7606640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:40:35.364 INFO:tasks.workunit.client.0.smithi043.stderr: -425> 2024-09-12T00:40:35.167+0000 7fe7bae3a640 10 monclient: get_auth_request con 0x7fe6a0070b10 auth_method 0 2024-09-12T00:40:35.364 INFO:tasks.workunit.client.0.smithi043.stderr: -424> 2024-09-12T00:40:35.167+0000 7fe7bb63b640 10 monclient: get_auth_request con 0x55ee171f3c50 auth_method 0 2024-09-12T00:40:35.364 INFO:tasks.workunit.client.0.smithi043.stderr: -423> 2024-09-12T00:40:35.167+0000 7fe7bae3a640 10 monclient: get_auth_request con 0x55ee17216390 auth_method 0 2024-09-12T00:40:35.364 INFO:tasks.workunit.client.0.smithi043.stderr: -422> 2024-09-12T00:40:35.167+0000 7fe7ba639640 10 monclient: get_auth_request con 0x55ee1721a580 auth_method 0 2024-09-12T00:40:35.364 INFO:tasks.workunit.client.0.smithi043.stderr: -421> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient: build_initial_monmap 2024-09-12T00:40:35.364 INFO:tasks.workunit.client.0.smithi043.stderr: -420> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:35.364 INFO:tasks.workunit.client.0.smithi043.stderr: -419> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient: monmap: 2024-09-12T00:40:35.364 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:40:35.365 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:35.365 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:40:35.365 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:40:35.365 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:35.365 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:40:35.365 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:40:35.365 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:40:35.365 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:40:35.365 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.365 INFO:tasks.workunit.client.0.smithi043.stderr: -418> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721eec0) adding auth protocol: cephx 2024-09-12T00:40:35.365 INFO:tasks.workunit.client.0.smithi043.stderr: -417> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721eec0) adding auth protocol: cephx 2024-09-12T00:40:35.365 INFO:tasks.workunit.client.0.smithi043.stderr: -416> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721eec0) adding auth protocol: cephx 2024-09-12T00:40:35.365 INFO:tasks.workunit.client.0.smithi043.stderr: -415> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721eec0) adding con mode: secure 2024-09-12T00:40:35.366 INFO:tasks.workunit.client.0.smithi043.stderr: -414> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721eec0) adding con mode: crc 2024-09-12T00:40:35.366 INFO:tasks.workunit.client.0.smithi043.stderr: -413> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721eec0) adding con mode: secure 2024-09-12T00:40:35.366 INFO:tasks.workunit.client.0.smithi043.stderr: -412> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721eec0) adding con mode: crc 2024-09-12T00:40:35.366 INFO:tasks.workunit.client.0.smithi043.stderr: -411> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721eec0) adding con mode: secure 2024-09-12T00:40:35.366 INFO:tasks.workunit.client.0.smithi043.stderr: -410> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721eec0) adding con mode: crc 2024-09-12T00:40:35.366 INFO:tasks.workunit.client.0.smithi043.stderr: -409> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721eec0) adding con mode: crc 2024-09-12T00:40:35.366 INFO:tasks.workunit.client.0.smithi043.stderr: -408> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721eec0) adding con mode: secure 2024-09-12T00:40:35.366 INFO:tasks.workunit.client.0.smithi043.stderr: -407> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721eec0) adding con mode: crc 2024-09-12T00:40:35.366 INFO:tasks.workunit.client.0.smithi043.stderr: -406> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721eec0) adding con mode: secure 2024-09-12T00:40:35.366 INFO:tasks.workunit.client.0.smithi043.stderr: -405> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721eec0) adding con mode: crc 2024-09-12T00:40:35.366 INFO:tasks.workunit.client.0.smithi043.stderr: -404> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721eec0) adding con mode: secure 2024-09-12T00:40:35.366 INFO:tasks.workunit.client.0.smithi043.stderr: -403> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:35.366 INFO:tasks.workunit.client.0.smithi043.stderr: -402> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55ee17222830 EEXIST 2024-09-12T00:40:35.367 INFO:tasks.workunit.client.0.smithi043.stderr: -401> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient: init 2024-09-12T00:40:35.367 INFO:tasks.workunit.client.0.smithi043.stderr: -400> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721d808) adding auth protocol: cephx 2024-09-12T00:40:35.367 INFO:tasks.workunit.client.0.smithi043.stderr: -399> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721d808) adding auth protocol: cephx 2024-09-12T00:40:35.367 INFO:tasks.workunit.client.0.smithi043.stderr: -398> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721d808) adding auth protocol: cephx 2024-09-12T00:40:35.367 INFO:tasks.workunit.client.0.smithi043.stderr: -397> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721d808) adding con mode: secure 2024-09-12T00:40:35.367 INFO:tasks.workunit.client.0.smithi043.stderr: -396> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721d808) adding con mode: crc 2024-09-12T00:40:35.367 INFO:tasks.workunit.client.0.smithi043.stderr: -395> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721d808) adding con mode: secure 2024-09-12T00:40:35.367 INFO:tasks.workunit.client.0.smithi043.stderr: -394> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721d808) adding con mode: crc 2024-09-12T00:40:35.367 INFO:tasks.workunit.client.0.smithi043.stderr: -393> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721d808) adding con mode: secure 2024-09-12T00:40:35.367 INFO:tasks.workunit.client.0.smithi043.stderr: -392> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721d808) adding con mode: crc 2024-09-12T00:40:35.367 INFO:tasks.workunit.client.0.smithi043.stderr: -391> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721d808) adding con mode: crc 2024-09-12T00:40:35.367 INFO:tasks.workunit.client.0.smithi043.stderr: -390> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721d808) adding con mode: secure 2024-09-12T00:40:35.367 INFO:tasks.workunit.client.0.smithi043.stderr: -389> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721d808) adding con mode: crc 2024-09-12T00:40:35.367 INFO:tasks.workunit.client.0.smithi043.stderr: -388> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721d808) adding con mode: secure 2024-09-12T00:40:35.368 INFO:tasks.workunit.client.0.smithi043.stderr: -387> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721d808) adding con mode: crc 2024-09-12T00:40:35.368 INFO:tasks.workunit.client.0.smithi043.stderr: -386> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee1721d808) adding con mode: secure 2024-09-12T00:40:35.368 INFO:tasks.workunit.client.0.smithi043.stderr: -385> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:35.368 INFO:tasks.workunit.client.0.smithi043.stderr: -384> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:35.368 INFO:tasks.workunit.client.0.smithi043.stderr: -383> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command rotate-key cmddesc rotate-key hook 0x55ee1721d950 EEXIST 2024-09-12T00:40:35.368 INFO:tasks.workunit.client.0.smithi043.stderr: -382> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:35.368 INFO:tasks.workunit.client.0.smithi043.stderr: -381> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:40:35.368 INFO:tasks.workunit.client.0.smithi043.stderr: -380> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient(hunting): picked mon.noname-a con 0x55ee172469e0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:40:35.368 INFO:tasks.workunit.client.0.smithi043.stderr: -379> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient(hunting): picked mon.noname-c con 0x55ee17246310 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:40:35.368 INFO:tasks.workunit.client.0.smithi043.stderr: -378> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient(hunting): picked mon.noname-b con 0x55ee17244cf0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:40:35.368 INFO:tasks.workunit.client.0.smithi043.stderr: -377> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:35.368 INFO:tasks.workunit.client.0.smithi043.stderr: -376> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:35.369 INFO:tasks.workunit.client.0.smithi043.stderr: -375> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:35.369 INFO:tasks.workunit.client.0.smithi043.stderr: -374> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:35.369 INFO:tasks.workunit.client.0.smithi043.stderr: -373> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient(hunting): authenticate will time out at 2331.162963s 2024-09-12T00:40:35.369 INFO:tasks.workunit.client.0.smithi043.stderr: -372> 2024-09-12T00:40:35.171+0000 7fe7ba639640 10 monclient(hunting): get_auth_request con 0x55ee17246310 auth_method 0 2024-09-12T00:40:35.369 INFO:tasks.workunit.client.0.smithi043.stderr: -371> 2024-09-12T00:40:35.171+0000 7fe7ba639640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:35.369 INFO:tasks.workunit.client.0.smithi043.stderr: -370> 2024-09-12T00:40:35.171+0000 7fe7ba639640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:35.369 INFO:tasks.workunit.client.0.smithi043.stderr: -369> 2024-09-12T00:40:35.171+0000 7fe7ba639640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:35.369 INFO:tasks.workunit.client.0.smithi043.stderr: -368> 2024-09-12T00:40:35.171+0000 7fe7bae3a640 10 monclient(hunting): get_auth_request con 0x55ee172469e0 auth_method 0 2024-09-12T00:40:35.369 INFO:tasks.workunit.client.0.smithi043.stderr: -367> 2024-09-12T00:40:35.171+0000 7fe7bae3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:35.369 INFO:tasks.workunit.client.0.smithi043.stderr: -366> 2024-09-12T00:40:35.171+0000 7fe7bae3a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:35.369 INFO:tasks.workunit.client.0.smithi043.stderr: -365> 2024-09-12T00:40:35.171+0000 7fe7bae3a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:35.369 INFO:tasks.workunit.client.0.smithi043.stderr: -364> 2024-09-12T00:40:35.171+0000 7fe7ba639640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:35.369 INFO:tasks.workunit.client.0.smithi043.stderr: -363> 2024-09-12T00:40:35.171+0000 7fe7ba639640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:35.370 INFO:tasks.workunit.client.0.smithi043.stderr: -362> 2024-09-12T00:40:35.171+0000 7fe7ba639640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:35.370 INFO:tasks.workunit.client.0.smithi043.stderr: -361> 2024-09-12T00:40:35.171+0000 7fe7bae3a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:35.370 INFO:tasks.workunit.client.0.smithi043.stderr: -360> 2024-09-12T00:40:35.171+0000 7fe7bae3a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:35.370 INFO:tasks.workunit.client.0.smithi043.stderr: -359> 2024-09-12T00:40:35.171+0000 7fe7bae3a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:35.370 INFO:tasks.workunit.client.0.smithi043.stderr: -358> 2024-09-12T00:40:35.171+0000 7fe7ba639640 10 monclient(hunting): handle_auth_done global_id 7538 payload 824 2024-09-12T00:40:35.370 INFO:tasks.workunit.client.0.smithi043.stderr: -357> 2024-09-12T00:40:35.171+0000 7fe7ba639640 10 monclient: _finish_hunting 0 2024-09-12T00:40:35.370 INFO:tasks.workunit.client.0.smithi043.stderr: -356> 2024-09-12T00:40:35.171+0000 7fe7ba639640 1 monclient: found mon.noname-c 2024-09-12T00:40:35.370 INFO:tasks.workunit.client.0.smithi043.stderr: -355> 2024-09-12T00:40:35.171+0000 7fe7ba639640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:40:35.370 INFO:tasks.workunit.client.0.smithi043.stderr: -354> 2024-09-12T00:40:35.171+0000 7fe7bb63b640 10 monclient: get_auth_request con 0x55ee17244cf0 auth_method 0 2024-09-12T00:40:35.370 INFO:tasks.workunit.client.0.smithi043.stderr: -353> 2024-09-12T00:40:35.171+0000 7fe6a4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:35.370 INFO:tasks.workunit.client.0.smithi043.stderr: -352> 2024-09-12T00:40:35.171+0000 7fe6a4e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:35.370 INFO:tasks.workunit.client.0.smithi043.stderr: -351> 2024-09-12T00:40:35.171+0000 7fe6a4e01640 10 monclient: dump: 2024-09-12T00:40:35.370 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:40:35.371 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:40:35.371 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.371 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.371 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:35.371 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:40:35.371 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:40:35.371 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:40:35.371 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:40:35.371 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.371 INFO:tasks.workunit.client.0.smithi043.stderr: -350> 2024-09-12T00:40:35.171+0000 7fe6a4e01640 10 monclient: _finish_auth 0 2024-09-12T00:40:35.371 INFO:tasks.workunit.client.0.smithi043.stderr: -349> 2024-09-12T00:40:35.171+0000 7fe6a4e01640 10 monclient: _check_auth_tickets 2024-09-12T00:40:35.371 INFO:tasks.workunit.client.0.smithi043.stderr: -348> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 5 monclient: authenticate success, global_id 7538 2024-09-12T00:40:35.371 INFO:tasks.workunit.client.0.smithi043.stderr: -347> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient: _renew_subs 2024-09-12T00:40:35.371 INFO:tasks.workunit.client.0.smithi043.stderr: -346> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:40:35.372 INFO:tasks.workunit.client.0.smithi043.stderr: -345> 2024-09-12T00:40:35.171+0000 7fe6a4e01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:35.372 INFO:tasks.workunit.client.0.smithi043.stderr: -344> 2024-09-12T00:40:35.171+0000 7fe6a4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:35.372 INFO:tasks.workunit.client.0.smithi043.stderr: -343> 2024-09-12T00:40:35.171+0000 7fe6a4e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:35.372 INFO:tasks.workunit.client.0.smithi043.stderr: -342> 2024-09-12T00:40:35.171+0000 7fe6a4e01640 10 monclient: dump: 2024-09-12T00:40:35.372 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:40:35.372 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:40:35.372 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.372 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.372 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:35.372 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:40:35.372 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:40:35.373 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:40:35.373 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:40:35.373 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.373 INFO:tasks.workunit.client.0.smithi043.stderr: -341> 2024-09-12T00:40:35.171+0000 7fe7bbe3c640 4 set_mon_vals no callback set 2024-09-12T00:40:35.373 INFO:tasks.workunit.client.0.smithi043.stderr: -340> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient: _renew_subs 2024-09-12T00:40:35.373 INFO:tasks.workunit.client.0.smithi043.stderr: -339> 2024-09-12T00:40:35.171+0000 7fe7bd3349c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:40:35.373 INFO:tasks.workunit.client.0.smithi043.stderr: -338> 2024-09-12T00:40:35.175+0000 7fe6a4e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:35.373 INFO:tasks.workunit.client.0.smithi043.stderr: -337> 2024-09-12T00:40:35.175+0000 7fe6a4e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:40:35.373 INFO:tasks.workunit.client.0.smithi043.stderr: -336> 2024-09-12T00:40:35.175+0000 7fe6a4e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:40:35.373 INFO:tasks.workunit.client.0.smithi043.stderr: -335> 2024-09-12T00:40:35.175+0000 7fe7bae3a640 10 monclient: get_auth_request con 0x7fe694070a20 auth_method 0 2024-09-12T00:40:35.373 INFO:tasks.workunit.client.0.smithi043.stderr: -334> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 10 monclient: get_monmap_and_config 2024-09-12T00:40:35.374 INFO:tasks.workunit.client.0.smithi043.stderr: -333> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 10 monclient: build_initial_monmap 2024-09-12T00:40:35.374 INFO:tasks.workunit.client.0.smithi043.stderr: -332> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:35.374 INFO:tasks.workunit.client.0.smithi043.stderr: -331> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 10 monclient: monmap: 2024-09-12T00:40:35.374 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:40:35.374 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:35.374 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:40:35.374 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:40:35.374 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:35.374 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:40:35.374 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:40:35.374 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:40:35.374 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:40:35.374 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.374 INFO:tasks.workunit.client.0.smithi043.stderr: -330> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding auth protocol: cephx 2024-09-12T00:40:35.375 INFO:tasks.workunit.client.0.smithi043.stderr: -329> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding auth protocol: cephx 2024-09-12T00:40:35.375 INFO:tasks.workunit.client.0.smithi043.stderr: -328> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding auth protocol: cephx 2024-09-12T00:40:35.375 INFO:tasks.workunit.client.0.smithi043.stderr: -327> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: secure 2024-09-12T00:40:35.375 INFO:tasks.workunit.client.0.smithi043.stderr: -326> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: crc 2024-09-12T00:40:35.375 INFO:tasks.workunit.client.0.smithi043.stderr: -325> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: secure 2024-09-12T00:40:35.375 INFO:tasks.workunit.client.0.smithi043.stderr: -324> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: crc 2024-09-12T00:40:35.375 INFO:tasks.workunit.client.0.smithi043.stderr: -323> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: secure 2024-09-12T00:40:35.375 INFO:tasks.workunit.client.0.smithi043.stderr: -322> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: crc 2024-09-12T00:40:35.375 INFO:tasks.workunit.client.0.smithi043.stderr: -321> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: crc 2024-09-12T00:40:35.376 INFO:tasks.workunit.client.0.smithi043.stderr: -320> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: secure 2024-09-12T00:40:35.376 INFO:tasks.workunit.client.0.smithi043.stderr: -319> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: crc 2024-09-12T00:40:35.376 INFO:tasks.workunit.client.0.smithi043.stderr: -318> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: secure 2024-09-12T00:40:35.376 INFO:tasks.workunit.client.0.smithi043.stderr: -317> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: crc 2024-09-12T00:40:35.376 INFO:tasks.workunit.client.0.smithi043.stderr: -316> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: secure 2024-09-12T00:40:35.376 INFO:tasks.workunit.client.0.smithi043.stderr: -315> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:35.376 INFO:tasks.workunit.client.0.smithi043.stderr: -314> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 10 monclient: init 2024-09-12T00:40:35.376 INFO:tasks.workunit.client.0.smithi043.stderr: -313> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa4c90) adding auth protocol: cephx 2024-09-12T00:40:35.376 INFO:tasks.workunit.client.0.smithi043.stderr: -312> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa4c90) adding auth protocol: cephx 2024-09-12T00:40:35.376 INFO:tasks.workunit.client.0.smithi043.stderr: -311> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa4c90) adding auth protocol: cephx 2024-09-12T00:40:35.376 INFO:tasks.workunit.client.0.smithi043.stderr: -310> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa4c90) adding con mode: secure 2024-09-12T00:40:35.376 INFO:tasks.workunit.client.0.smithi043.stderr: -309> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa4c90) adding con mode: crc 2024-09-12T00:40:35.377 INFO:tasks.workunit.client.0.smithi043.stderr: -308> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa4c90) adding con mode: secure 2024-09-12T00:40:35.377 INFO:tasks.workunit.client.0.smithi043.stderr: -307> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa4c90) adding con mode: crc 2024-09-12T00:40:35.377 INFO:tasks.workunit.client.0.smithi043.stderr: -306> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa4c90) adding con mode: secure 2024-09-12T00:40:35.377 INFO:tasks.workunit.client.0.smithi043.stderr: -305> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa4c90) adding con mode: crc 2024-09-12T00:40:35.377 INFO:tasks.workunit.client.0.smithi043.stderr: -304> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa4c90) adding con mode: crc 2024-09-12T00:40:35.377 INFO:tasks.workunit.client.0.smithi043.stderr: -303> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa4c90) adding con mode: secure 2024-09-12T00:40:35.377 INFO:tasks.workunit.client.0.smithi043.stderr: -302> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa4c90) adding con mode: crc 2024-09-12T00:40:35.377 INFO:tasks.workunit.client.0.smithi043.stderr: -301> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa4c90) adding con mode: secure 2024-09-12T00:40:35.377 INFO:tasks.workunit.client.0.smithi043.stderr: -300> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa4c90) adding con mode: crc 2024-09-12T00:40:35.378 INFO:tasks.workunit.client.0.smithi043.stderr: -299> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa4c90) adding con mode: secure 2024-09-12T00:40:35.378 INFO:tasks.workunit.client.0.smithi043.stderr: -298> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:35.378 INFO:tasks.workunit.client.0.smithi043.stderr: -297> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:35.378 INFO:tasks.workunit.client.0.smithi043.stderr: -296> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command rotate-key cmddesc rotate-key hook 0x7fffdefa4dd8 EEXIST 2024-09-12T00:40:35.378 INFO:tasks.workunit.client.0.smithi043.stderr: -295> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:35.378 INFO:tasks.workunit.client.0.smithi043.stderr: -294> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:40:35.378 INFO:tasks.workunit.client.0.smithi043.stderr: -293> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 10 monclient(hunting): picked mon.noname-b con 0x55ee17294300 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:40:35.378 INFO:tasks.workunit.client.0.smithi043.stderr: -292> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 10 monclient(hunting): picked mon.noname-c con 0x55ee172946e0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:40:35.378 INFO:tasks.workunit.client.0.smithi043.stderr: -291> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 10 monclient(hunting): picked mon.noname-a con 0x55ee17295ba0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:40:35.378 INFO:tasks.workunit.client.0.smithi043.stderr: -290> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:35.378 INFO:tasks.workunit.client.0.smithi043.stderr: -289> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:35.378 INFO:tasks.workunit.client.0.smithi043.stderr: -288> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:35.379 INFO:tasks.workunit.client.0.smithi043.stderr: -287> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:35.379 INFO:tasks.workunit.client.0.smithi043.stderr: -286> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 10 monclient(hunting): authenticate will time out at 2331.166997s 2024-09-12T00:40:35.379 INFO:tasks.workunit.client.0.smithi043.stderr: -285> 2024-09-12T00:40:35.175+0000 7fe7ba639640 10 monclient(hunting): get_auth_request con 0x55ee172946e0 auth_method 0 2024-09-12T00:40:35.379 INFO:tasks.workunit.client.0.smithi043.stderr: -284> 2024-09-12T00:40:35.175+0000 7fe7ba639640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:35.379 INFO:tasks.workunit.client.0.smithi043.stderr: -283> 2024-09-12T00:40:35.175+0000 7fe7ba639640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:35.379 INFO:tasks.workunit.client.0.smithi043.stderr: -282> 2024-09-12T00:40:35.175+0000 7fe7ba639640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:35.379 INFO:tasks.workunit.client.0.smithi043.stderr: -281> 2024-09-12T00:40:35.175+0000 7fe7bb63b640 10 monclient(hunting): get_auth_request con 0x55ee17295ba0 auth_method 0 2024-09-12T00:40:35.379 INFO:tasks.workunit.client.0.smithi043.stderr: -280> 2024-09-12T00:40:35.175+0000 7fe7bb63b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:35.379 INFO:tasks.workunit.client.0.smithi043.stderr: -279> 2024-09-12T00:40:35.175+0000 7fe7bb63b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:35.379 INFO:tasks.workunit.client.0.smithi043.stderr: -278> 2024-09-12T00:40:35.175+0000 7fe7bb63b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:35.379 INFO:tasks.workunit.client.0.smithi043.stderr: -277> 2024-09-12T00:40:35.175+0000 7fe7ba639640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:35.379 INFO:tasks.workunit.client.0.smithi043.stderr: -276> 2024-09-12T00:40:35.175+0000 7fe7ba639640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:35.380 INFO:tasks.workunit.client.0.smithi043.stderr: -275> 2024-09-12T00:40:35.175+0000 7fe7ba639640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:35.380 INFO:tasks.workunit.client.0.smithi043.stderr: -274> 2024-09-12T00:40:35.175+0000 7fe7bb63b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:35.380 INFO:tasks.workunit.client.0.smithi043.stderr: -273> 2024-09-12T00:40:35.175+0000 7fe7bb63b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:35.380 INFO:tasks.workunit.client.0.smithi043.stderr: -272> 2024-09-12T00:40:35.175+0000 7fe7bb63b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:35.380 INFO:tasks.workunit.client.0.smithi043.stderr: -271> 2024-09-12T00:40:35.175+0000 7fe7ba639640 10 monclient(hunting): handle_auth_done global_id 7541 payload 274 2024-09-12T00:40:35.380 INFO:tasks.workunit.client.0.smithi043.stderr: -270> 2024-09-12T00:40:35.175+0000 7fe7ba639640 10 monclient: _finish_hunting 0 2024-09-12T00:40:35.380 INFO:tasks.workunit.client.0.smithi043.stderr: -269> 2024-09-12T00:40:35.175+0000 7fe7ba639640 1 monclient: found mon.noname-c 2024-09-12T00:40:35.380 INFO:tasks.workunit.client.0.smithi043.stderr: -268> 2024-09-12T00:40:35.175+0000 7fe7ba639640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:40:35.380 INFO:tasks.workunit.client.0.smithi043.stderr: -267> 2024-09-12T00:40:35.175+0000 7fe7bae3a640 10 monclient: get_auth_request con 0x55ee17294300 auth_method 0 2024-09-12T00:40:35.380 INFO:tasks.workunit.client.0.smithi043.stderr: -266> 2024-09-12T00:40:35.175+0000 7fe69e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:35.380 INFO:tasks.workunit.client.0.smithi043.stderr: -265> 2024-09-12T00:40:35.175+0000 7fe69e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:35.380 INFO:tasks.workunit.client.0.smithi043.stderr: -264> 2024-09-12T00:40:35.175+0000 7fe69e7fc640 10 monclient: dump: 2024-09-12T00:40:35.380 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:40:35.381 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:40:35.381 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.381 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.381 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:35.381 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:40:35.381 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:40:35.381 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:40:35.381 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:40:35.381 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.381 INFO:tasks.workunit.client.0.smithi043.stderr: -263> 2024-09-12T00:40:35.175+0000 7fe69e7fc640 10 monclient: _finish_auth 0 2024-09-12T00:40:35.381 INFO:tasks.workunit.client.0.smithi043.stderr: -262> 2024-09-12T00:40:35.175+0000 7fe69e7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:40:35.381 INFO:tasks.workunit.client.0.smithi043.stderr: -261> 2024-09-12T00:40:35.175+0000 7fe69e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:35.381 INFO:tasks.workunit.client.0.smithi043.stderr: -260> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 5 monclient: authenticate success, global_id 7541 2024-09-12T00:40:35.382 INFO:tasks.workunit.client.0.smithi043.stderr: -259> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 10 monclient: get_monmap_and_config success 2024-09-12T00:40:35.382 INFO:tasks.workunit.client.0.smithi043.stderr: -258> 2024-09-12T00:40:35.175+0000 7fe7bd3349c0 4 set_mon_vals no callback set 2024-09-12T00:40:35.382 INFO:tasks.workunit.client.0.smithi043.stderr: -257> 2024-09-12T00:40:35.175+0000 7fe69e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:35.382 INFO:tasks.workunit.client.0.smithi043.stderr: -256> 2024-09-12T00:40:35.175+0000 7fe69e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:35.382 INFO:tasks.workunit.client.0.smithi043.stderr: -255> 2024-09-12T00:40:35.175+0000 7fe69e7fc640 10 monclient: dump: 2024-09-12T00:40:35.382 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:40:35.382 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:40:35.382 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.382 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.382 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:35.382 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:40:35.382 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:40:35.382 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:40:35.383 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:40:35.383 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.383 INFO:tasks.workunit.client.0.smithi043.stderr: -254> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient: shutdown 2024-09-12T00:40:35.383 INFO:tasks.workunit.client.0.smithi043.stderr: -253> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient: build_initial_monmap 2024-09-12T00:40:35.383 INFO:tasks.workunit.client.0.smithi043.stderr: -252> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:35.383 INFO:tasks.workunit.client.0.smithi043.stderr: -251> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient: monmap: 2024-09-12T00:40:35.383 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:40:35.383 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:35.383 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:40:35.383 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:40:35.383 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:35.383 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:40:35.383 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:40:35.384 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:40:35.384 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:40:35.384 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.384 INFO:tasks.workunit.client.0.smithi043.stderr: -250> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding auth protocol: cephx 2024-09-12T00:40:35.384 INFO:tasks.workunit.client.0.smithi043.stderr: -249> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding auth protocol: cephx 2024-09-12T00:40:35.384 INFO:tasks.workunit.client.0.smithi043.stderr: -248> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding auth protocol: cephx 2024-09-12T00:40:35.384 INFO:tasks.workunit.client.0.smithi043.stderr: -247> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: secure 2024-09-12T00:40:35.384 INFO:tasks.workunit.client.0.smithi043.stderr: -246> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: crc 2024-09-12T00:40:35.384 INFO:tasks.workunit.client.0.smithi043.stderr: -245> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: secure 2024-09-12T00:40:35.384 INFO:tasks.workunit.client.0.smithi043.stderr: -244> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: crc 2024-09-12T00:40:35.384 INFO:tasks.workunit.client.0.smithi043.stderr: -243> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: secure 2024-09-12T00:40:35.384 INFO:tasks.workunit.client.0.smithi043.stderr: -242> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: crc 2024-09-12T00:40:35.385 INFO:tasks.workunit.client.0.smithi043.stderr: -241> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: crc 2024-09-12T00:40:35.385 INFO:tasks.workunit.client.0.smithi043.stderr: -240> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: secure 2024-09-12T00:40:35.385 INFO:tasks.workunit.client.0.smithi043.stderr: -239> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: crc 2024-09-12T00:40:35.385 INFO:tasks.workunit.client.0.smithi043.stderr: -238> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: secure 2024-09-12T00:40:35.385 INFO:tasks.workunit.client.0.smithi043.stderr: -237> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: crc 2024-09-12T00:40:35.385 INFO:tasks.workunit.client.0.smithi043.stderr: -236> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17265cf0) adding con mode: secure 2024-09-12T00:40:35.385 INFO:tasks.workunit.client.0.smithi043.stderr: -235> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:35.385 INFO:tasks.workunit.client.0.smithi043.stderr: -234> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 1 librados: starting msgr at 2024-09-12T00:40:35.385 INFO:tasks.workunit.client.0.smithi043.stderr: -233> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 1 librados: starting objecter 2024-09-12T00:40:35.385 INFO:tasks.workunit.client.0.smithi043.stderr: -232> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55ee17299850 EEXIST 2024-09-12T00:40:35.385 INFO:tasks.workunit.client.0.smithi043.stderr: -231> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 1 librados: setting wanted keys 2024-09-12T00:40:35.385 INFO:tasks.workunit.client.0.smithi043.stderr: -230> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 1 librados: calling monclient init 2024-09-12T00:40:35.385 INFO:tasks.workunit.client.0.smithi043.stderr: -229> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient: init 2024-09-12T00:40:35.386 INFO:tasks.workunit.client.0.smithi043.stderr: -228> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17248800) adding auth protocol: cephx 2024-09-12T00:40:35.386 INFO:tasks.workunit.client.0.smithi043.stderr: -227> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17248800) adding auth protocol: cephx 2024-09-12T00:40:35.386 INFO:tasks.workunit.client.0.smithi043.stderr: -226> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17248800) adding auth protocol: cephx 2024-09-12T00:40:35.386 INFO:tasks.workunit.client.0.smithi043.stderr: -225> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17248800) adding con mode: secure 2024-09-12T00:40:35.386 INFO:tasks.workunit.client.0.smithi043.stderr: -224> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17248800) adding con mode: crc 2024-09-12T00:40:35.386 INFO:tasks.workunit.client.0.smithi043.stderr: -223> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17248800) adding con mode: secure 2024-09-12T00:40:35.386 INFO:tasks.workunit.client.0.smithi043.stderr: -222> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17248800) adding con mode: crc 2024-09-12T00:40:35.386 INFO:tasks.workunit.client.0.smithi043.stderr: -221> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17248800) adding con mode: secure 2024-09-12T00:40:35.386 INFO:tasks.workunit.client.0.smithi043.stderr: -220> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17248800) adding con mode: crc 2024-09-12T00:40:35.386 INFO:tasks.workunit.client.0.smithi043.stderr: -219> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17248800) adding con mode: crc 2024-09-12T00:40:35.386 INFO:tasks.workunit.client.0.smithi043.stderr: -218> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17248800) adding con mode: secure 2024-09-12T00:40:35.387 INFO:tasks.workunit.client.0.smithi043.stderr: -217> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17248800) adding con mode: crc 2024-09-12T00:40:35.387 INFO:tasks.workunit.client.0.smithi043.stderr: -216> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17248800) adding con mode: secure 2024-09-12T00:40:35.387 INFO:tasks.workunit.client.0.smithi043.stderr: -215> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17248800) adding con mode: crc 2024-09-12T00:40:35.387 INFO:tasks.workunit.client.0.smithi043.stderr: -214> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 AuthRegistry(0x55ee17248800) adding con mode: secure 2024-09-12T00:40:35.387 INFO:tasks.workunit.client.0.smithi043.stderr: -213> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:35.387 INFO:tasks.workunit.client.0.smithi043.stderr: -212> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:35.387 INFO:tasks.workunit.client.0.smithi043.stderr: -211> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command rotate-key cmddesc rotate-key hook 0x55ee17248948 EEXIST 2024-09-12T00:40:35.387 INFO:tasks.workunit.client.0.smithi043.stderr: -210> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:35.387 INFO:tasks.workunit.client.0.smithi043.stderr: -209> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:40:35.387 INFO:tasks.workunit.client.0.smithi043.stderr: -208> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient(hunting): picked mon.noname-b con 0x55ee17294300 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:40:35.387 INFO:tasks.workunit.client.0.smithi043.stderr: -207> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient(hunting): picked mon.noname-a con 0x55ee17295ba0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:40:35.387 INFO:tasks.workunit.client.0.smithi043.stderr: -206> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient(hunting): picked mon.noname-c con 0x55ee17286a50 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:40:35.387 INFO:tasks.workunit.client.0.smithi043.stderr: -205> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:35.387 INFO:tasks.workunit.client.0.smithi043.stderr: -204> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:35.388 INFO:tasks.workunit.client.0.smithi043.stderr: -203> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:35.388 INFO:tasks.workunit.client.0.smithi043.stderr: -202> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:35.388 INFO:tasks.workunit.client.0.smithi043.stderr: -201> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient(hunting): authenticate will time out at 2331.169637s 2024-09-12T00:40:35.388 INFO:tasks.workunit.client.0.smithi043.stderr: -200> 2024-09-12T00:40:35.179+0000 7fe7bb63b640 10 monclient(hunting): get_auth_request con 0x55ee17286a50 auth_method 0 2024-09-12T00:40:35.388 INFO:tasks.workunit.client.0.smithi043.stderr: -199> 2024-09-12T00:40:35.179+0000 7fe7bb63b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:35.388 INFO:tasks.workunit.client.0.smithi043.stderr: -198> 2024-09-12T00:40:35.179+0000 7fe7bb63b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:35.388 INFO:tasks.workunit.client.0.smithi043.stderr: -197> 2024-09-12T00:40:35.179+0000 7fe7bb63b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:35.388 INFO:tasks.workunit.client.0.smithi043.stderr: -196> 2024-09-12T00:40:35.179+0000 7fe7ba639640 10 monclient(hunting): get_auth_request con 0x55ee17295ba0 auth_method 0 2024-09-12T00:40:35.388 INFO:tasks.workunit.client.0.smithi043.stderr: -195> 2024-09-12T00:40:35.179+0000 7fe7ba639640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:35.388 INFO:tasks.workunit.client.0.smithi043.stderr: -194> 2024-09-12T00:40:35.179+0000 7fe7ba639640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:35.388 INFO:tasks.workunit.client.0.smithi043.stderr: -193> 2024-09-12T00:40:35.179+0000 7fe7ba639640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:35.388 INFO:tasks.workunit.client.0.smithi043.stderr: -192> 2024-09-12T00:40:35.179+0000 7fe7bb63b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:35.389 INFO:tasks.workunit.client.0.smithi043.stderr: -191> 2024-09-12T00:40:35.179+0000 7fe7bb63b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:35.389 INFO:tasks.workunit.client.0.smithi043.stderr: -190> 2024-09-12T00:40:35.179+0000 7fe7bb63b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:35.389 INFO:tasks.workunit.client.0.smithi043.stderr: -189> 2024-09-12T00:40:35.179+0000 7fe7ba639640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:35.389 INFO:tasks.workunit.client.0.smithi043.stderr: -188> 2024-09-12T00:40:35.179+0000 7fe7ba639640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:35.389 INFO:tasks.workunit.client.0.smithi043.stderr: -187> 2024-09-12T00:40:35.179+0000 7fe7ba639640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:35.389 INFO:tasks.workunit.client.0.smithi043.stderr: -186> 2024-09-12T00:40:35.179+0000 7fe7bae3a640 10 monclient(hunting): get_auth_request con 0x55ee17294300 auth_method 0 2024-09-12T00:40:35.389 INFO:tasks.workunit.client.0.smithi043.stderr: -185> 2024-09-12T00:40:35.179+0000 7fe7bae3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:35.389 INFO:tasks.workunit.client.0.smithi043.stderr: -184> 2024-09-12T00:40:35.179+0000 7fe7bae3a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:35.389 INFO:tasks.workunit.client.0.smithi043.stderr: -183> 2024-09-12T00:40:35.179+0000 7fe7bae3a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:35.389 INFO:tasks.workunit.client.0.smithi043.stderr: -182> 2024-09-12T00:40:35.179+0000 7fe7ba639640 10 monclient(hunting): handle_auth_done global_id 7911 payload 824 2024-09-12T00:40:35.389 INFO:tasks.workunit.client.0.smithi043.stderr: -181> 2024-09-12T00:40:35.179+0000 7fe7ba639640 10 monclient: _finish_hunting 0 2024-09-12T00:40:35.389 INFO:tasks.workunit.client.0.smithi043.stderr: -180> 2024-09-12T00:40:35.179+0000 7fe7ba639640 1 monclient: found mon.noname-a 2024-09-12T00:40:35.390 INFO:tasks.workunit.client.0.smithi043.stderr: -179> 2024-09-12T00:40:35.179+0000 7fe7ba639640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:40:35.390 INFO:tasks.workunit.client.0.smithi043.stderr: -178> 2024-09-12T00:40:35.179+0000 7fe69cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:35.390 INFO:tasks.workunit.client.0.smithi043.stderr: -177> 2024-09-12T00:40:35.179+0000 7fe69cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:40:35.390 INFO:tasks.workunit.client.0.smithi043.stderr: -176> 2024-09-12T00:40:35.179+0000 7fe69cff9640 10 monclient: dump: 2024-09-12T00:40:35.390 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:40:35.390 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:40:35.390 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.390 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.390 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:35.390 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:40:35.390 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:40:35.390 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:40:35.390 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:40:35.391 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.391 INFO:tasks.workunit.client.0.smithi043.stderr: -175> 2024-09-12T00:40:35.179+0000 7fe69cff9640 10 monclient: _finish_auth 0 2024-09-12T00:40:35.391 INFO:tasks.workunit.client.0.smithi043.stderr: -174> 2024-09-12T00:40:35.179+0000 7fe69cff9640 10 monclient: _check_auth_tickets 2024-09-12T00:40:35.391 INFO:tasks.workunit.client.0.smithi043.stderr: -173> 2024-09-12T00:40:35.179+0000 7fe69cff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:35.391 INFO:tasks.workunit.client.0.smithi043.stderr: -172> 2024-09-12T00:40:35.179+0000 7fe69cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:35.391 INFO:tasks.workunit.client.0.smithi043.stderr: -171> 2024-09-12T00:40:35.179+0000 7fe69cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:40:35.391 INFO:tasks.workunit.client.0.smithi043.stderr: -170> 2024-09-12T00:40:35.179+0000 7fe69cff9640 10 monclient: dump: 2024-09-12T00:40:35.391 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:40:35.391 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:40:35.391 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.391 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:40:35.391 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:35.391 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:40:35.392 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:40:35.392 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:40:35.392 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:40:35.392 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.392 INFO:tasks.workunit.client.0.smithi043.stderr: -169> 2024-09-12T00:40:35.179+0000 7fe69e7fc640 4 set_mon_vals no callback set 2024-09-12T00:40:35.392 INFO:tasks.workunit.client.0.smithi043.stderr: -168> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 monclient: authenticate success, global_id 7911 2024-09-12T00:40:35.392 INFO:tasks.workunit.client.0.smithi043.stderr: -167> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient: _renew_subs 2024-09-12T00:40:35.392 INFO:tasks.workunit.client.0.smithi043.stderr: -166> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:40:35.392 INFO:tasks.workunit.client.0.smithi043.stderr: -165> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient: _renew_subs 2024-09-12T00:40:35.392 INFO:tasks.workunit.client.0.smithi043.stderr: -164> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:40:35.392 INFO:tasks.workunit.client.0.smithi043.stderr: -163> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 1 librados: init done 2024-09-12T00:40:35.392 INFO:tasks.workunit.client.0.smithi043.stderr: -162> 2024-09-12T00:40:35.179+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command cr dump hook 0x55ee1728e2b8 2024-09-12T00:40:35.392 INFO:tasks.workunit.client.0.smithi043.stderr: -161> 2024-09-12T00:40:35.183+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.393 INFO:tasks.workunit.client.0.smithi043.stderr: -160> 2024-09-12T00:40:35.183+0000 7fe69cff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:35.393 INFO:tasks.workunit.client.0.smithi043.stderr: -159> 2024-09-12T00:40:35.183+0000 7fe69cff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:40:35.393 INFO:tasks.workunit.client.0.smithi043.stderr: -158> 2024-09-12T00:40:35.183+0000 7fe69cff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:40:35.393 INFO:tasks.workunit.client.0.smithi043.stderr: -157> 2024-09-12T00:40:35.183+0000 7fe7bae3a640 10 monclient: get_auth_request con 0x7fe684070ba0 auth_method 0 2024-09-12T00:40:35.393 INFO:tasks.workunit.client.0.smithi043.stderr: -156> 2024-09-12T00:40:35.183+0000 7fe7bb63b640 10 monclient: get_auth_request con 0x55ee172b34d0 auth_method 0 2024-09-12T00:40:35.393 INFO:tasks.workunit.client.0.smithi043.stderr: -155> 2024-09-12T00:40:35.183+0000 7fe7bd3349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.393 INFO:tasks.workunit.client.0.smithi043.stderr: -154> 2024-09-12T00:40:35.183+0000 7fe7bd3349c0 20 realm 2024-09-12T00:40:35.393 INFO:tasks.workunit.client.0.smithi043.stderr: -153> 2024-09-12T00:40:35.183+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.393 INFO:tasks.workunit.client.0.smithi043.stderr: -152> 2024-09-12T00:40:35.183+0000 7fe7bd3349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.393 INFO:tasks.workunit.client.0.smithi043.stderr: -151> 2024-09-12T00:40:35.183+0000 7fe7bd3349c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:35.393 INFO:tasks.workunit.client.0.smithi043.stderr: -150> 2024-09-12T00:40:35.183+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.393 INFO:tasks.workunit.client.0.smithi043.stderr: -149> 2024-09-12T00:40:35.183+0000 7fe7bd3349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.393 INFO:tasks.workunit.client.0.smithi043.stderr: -148> 2024-09-12T00:40:35.183+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.394 INFO:tasks.workunit.client.0.smithi043.stderr: -147> 2024-09-12T00:40:35.183+0000 7fe7bae3a640 10 monclient: get_auth_request con 0x55ee172b7830 auth_method 0 2024-09-12T00:40:35.394 INFO:tasks.workunit.client.0.smithi043.stderr: -146> 2024-09-12T00:40:35.183+0000 7fe7bd3349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:35.394 INFO:tasks.workunit.client.0.smithi043.stderr: -145> 2024-09-12T00:40:35.183+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.394 INFO:tasks.workunit.client.0.smithi043.stderr: -144> 2024-09-12T00:40:35.187+0000 7fe7ba639640 10 monclient: get_auth_request con 0x55ee172baf70 auth_method 0 2024-09-12T00:40:35.394 INFO:tasks.workunit.client.0.smithi043.stderr: -143> 2024-09-12T00:40:35.187+0000 7fe7bd3349c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:35.394 INFO:tasks.workunit.client.0.smithi043.stderr: -142> 2024-09-12T00:40:35.187+0000 7fe7bd3349c0 20 searching for the correct realm 2024-09-12T00:40:35.394 INFO:tasks.workunit.client.0.smithi043.stderr: -141> 2024-09-12T00:40:35.187+0000 7fe7bb63b640 10 monclient: get_auth_request con 0x55ee172bfcc0 auth_method 0 2024-09-12T00:40:35.394 INFO:tasks.workunit.client.0.smithi043.stderr: -140> 2024-09-12T00:40:35.187+0000 7fe7bae3a640 10 monclient: get_auth_request con 0x7fe7b401f920 auth_method 0 2024-09-12T00:40:35.394 INFO:tasks.workunit.client.0.smithi043.stderr: -139> 2024-09-12T00:40:35.187+0000 7fe7ba639640 10 monclient: get_auth_request con 0x7fe7b010c000 auth_method 0 2024-09-12T00:40:35.394 INFO:tasks.workunit.client.0.smithi043.stderr: -138> 2024-09-12T00:40:35.191+0000 7fe7bb63b640 0 -- 172.21.15.43:0/3419709128 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55ee172b34d0 msgr2=0x55ee172b58f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:35.394 INFO:tasks.workunit.client.0.smithi043.stderr: -137> 2024-09-12T00:40:35.191+0000 7fe69cff9640 1 client.7911.objecter ms_handle_reset 0x55ee172b34d0 session 0x55ee172b2dc0 osd.1 2024-09-12T00:40:35.395 INFO:tasks.workunit.client.0.smithi043.stderr: -136> 2024-09-12T00:40:35.191+0000 7fe69cff9640 10 monclient: _renew_subs 2024-09-12T00:40:35.395 INFO:tasks.workunit.client.0.smithi043.stderr: -135> 2024-09-12T00:40:35.191+0000 7fe69cff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:40:35.395 INFO:tasks.workunit.client.0.smithi043.stderr: -134> 2024-09-12T00:40:35.191+0000 7fe7bb63b640 10 monclient: get_auth_request con 0x7fe684080bc0 auth_method 0 2024-09-12T00:40:35.395 INFO:tasks.workunit.client.0.smithi043.stderr: -133> 2024-09-12T00:40:35.191+0000 7fe7bb63b640 10 monclient: get_auth_request con 0x7fe7b01209f0 auth_method 0 2024-09-12T00:40:35.395 INFO:tasks.workunit.client.0.smithi043.stderr: -132> 2024-09-12T00:40:35.195+0000 7fe7bae3a640 10 monclient: get_auth_request con 0x7fe7b012a890 auth_method 0 2024-09-12T00:40:35.395 INFO:tasks.workunit.client.0.smithi043.stderr: -131> 2024-09-12T00:40:35.199+0000 7fe7ba639640 0 -- 172.21.15.43:0/3419709128 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fe7b010c000 msgr2=0x7fe7b0133a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:35.395 INFO:tasks.workunit.client.0.smithi043.stderr: -130> 2024-09-12T00:40:35.199+0000 7fe69cff9640 1 client.7911.objecter ms_handle_reset 0x7fe7b010c000 session 0x7fe7b00a6070 osd.4 2024-09-12T00:40:35.396 INFO:tasks.workunit.client.0.smithi043.stderr: -129> 2024-09-12T00:40:35.199+0000 7fe7ba639640 10 monclient: get_auth_request con 0x55ee172b34d0 auth_method 0 2024-09-12T00:40:35.396 INFO:tasks.workunit.client.0.smithi043.stderr: -128> 2024-09-12T00:40:35.203+0000 7fe7bd3349c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:40:35.396 INFO:tasks.workunit.client.0.smithi043.stderr: -127> 2024-09-12T00:40:35.203+0000 7fe7bd3349c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:35.396 INFO:tasks.workunit.client.0.smithi043.stderr: -126> 2024-09-12T00:40:35.203+0000 7fe7bd3349c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:35.396 INFO:tasks.workunit.client.0.smithi043.stderr: -125> 2024-09-12T00:40:35.203+0000 7fe7bd3349c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:40:35.396 INFO:tasks.workunit.client.0.smithi043.stderr: -124> 2024-09-12T00:40:35.203+0000 7fe7bd3349c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:35.396 INFO:tasks.workunit.client.0.smithi043.stderr: -123> 2024-09-12T00:40:35.203+0000 7fe7bd3349c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:35.397 INFO:tasks.workunit.client.0.smithi043.stderr: -122> 2024-09-12T00:40:35.203+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.397 INFO:tasks.workunit.client.0.smithi043.stderr: -121> 2024-09-12T00:40:35.203+0000 7fe7bd3349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.397 INFO:tasks.workunit.client.0.smithi043.stderr: -120> 2024-09-12T00:40:35.203+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.397 INFO:tasks.workunit.client.0.smithi043.stderr: -119> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:35.397 INFO:tasks.workunit.client.0.smithi043.stderr: -118> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.397 INFO:tasks.workunit.client.0.smithi043.stderr: -117> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:35.397 INFO:tasks.workunit.client.0.smithi043.stderr: -116> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 zone default found 2024-09-12T00:40:35.397 INFO:tasks.workunit.client.0.smithi043.stderr: -115> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 4 Realm: () 2024-09-12T00:40:35.397 INFO:tasks.workunit.client.0.smithi043.stderr: -114> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:40:35.398 INFO:tasks.workunit.client.0.smithi043.stderr: -113> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:40:35.398 INFO:tasks.workunit.client.0.smithi043.stderr: -112> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:35.398 INFO:tasks.workunit.client.0.smithi043.stderr: -111> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 zonegroup default 2024-09-12T00:40:35.398 INFO:tasks.workunit.client.0.smithi043.stderr: -110> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.398 INFO:tasks.workunit.client.0.smithi043.stderr: -109> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.398 INFO:tasks.workunit.client.0.smithi043.stderr: -108> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.398 INFO:tasks.workunit.client.0.smithi043.stderr: -107> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.398 INFO:tasks.workunit.client.0.smithi043.stderr: -106> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.398 INFO:tasks.workunit.client.0.smithi043.stderr: -105> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.398 INFO:tasks.workunit.client.0.smithi043.stderr: -104> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 started sync module instance, tier type = 2024-09-12T00:40:35.398 INFO:tasks.workunit.client.0.smithi043.stderr: -103> 2024-09-12T00:40:35.207+0000 7fe7bd3349c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:40:35.398 INFO:tasks.workunit.client.0.smithi043.stderr: -102> 2024-09-12T00:40:35.223+0000 7fe7bd3349c0 20 add_watcher() i=0 2024-09-12T00:40:35.399 INFO:tasks.workunit.client.0.smithi043.stderr: -101> 2024-09-12T00:40:35.223+0000 7fe7bd3349c0 20 add_watcher() i=1 2024-09-12T00:40:35.399 INFO:tasks.workunit.client.0.smithi043.stderr: -100> 2024-09-12T00:40:35.223+0000 7fe7bd3349c0 20 add_watcher() i=2 2024-09-12T00:40:35.399 INFO:tasks.workunit.client.0.smithi043.stderr: -99> 2024-09-12T00:40:35.223+0000 7fe7bd3349c0 20 add_watcher() i=3 2024-09-12T00:40:35.399 INFO:tasks.workunit.client.0.smithi043.stderr: -98> 2024-09-12T00:40:35.223+0000 7fe7bd3349c0 20 add_watcher() i=4 2024-09-12T00:40:35.399 INFO:tasks.workunit.client.0.smithi043.stderr: -97> 2024-09-12T00:40:35.223+0000 7fe7bd3349c0 20 add_watcher() i=5 2024-09-12T00:40:35.399 INFO:tasks.workunit.client.0.smithi043.stderr: -96> 2024-09-12T00:40:35.223+0000 7fe7bd3349c0 20 add_watcher() i=6 2024-09-12T00:40:35.399 INFO:tasks.workunit.client.0.smithi043.stderr: -95> 2024-09-12T00:40:35.223+0000 7fe7bd3349c0 20 add_watcher() i=7 2024-09-12T00:40:35.399 INFO:tasks.workunit.client.0.smithi043.stderr: -94> 2024-09-12T00:40:35.223+0000 7fe7bd3349c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:35.399 INFO:tasks.workunit.client.0.smithi043.stderr: -93> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa5170) adding auth protocol: cephx 2024-09-12T00:40:35.399 INFO:tasks.workunit.client.0.smithi043.stderr: -92> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa5170) adding auth protocol: cephx 2024-09-12T00:40:35.400 INFO:tasks.workunit.client.0.smithi043.stderr: -91> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa5170) adding auth protocol: cephx 2024-09-12T00:40:35.400 INFO:tasks.workunit.client.0.smithi043.stderr: -90> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa5170) adding con mode: secure 2024-09-12T00:40:35.400 INFO:tasks.workunit.client.0.smithi043.stderr: -89> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa5170) adding con mode: crc 2024-09-12T00:40:35.400 INFO:tasks.workunit.client.0.smithi043.stderr: -88> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa5170) adding con mode: secure 2024-09-12T00:40:35.400 INFO:tasks.workunit.client.0.smithi043.stderr: -87> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa5170) adding con mode: crc 2024-09-12T00:40:35.400 INFO:tasks.workunit.client.0.smithi043.stderr: -86> 2024-09-12T00:40:35.227+0000 7fe671fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:35.400 INFO:tasks.workunit.client.0.smithi043.stderr: -85> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa5170) adding con mode: secure 2024-09-12T00:40:35.400 INFO:tasks.workunit.client.0.smithi043.stderr: -84> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa5170) adding con mode: crc 2024-09-12T00:40:35.400 INFO:tasks.workunit.client.0.smithi043.stderr: -83> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa5170) adding con mode: crc 2024-09-12T00:40:35.400 INFO:tasks.workunit.client.0.smithi043.stderr: -82> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa5170) adding con mode: secure 2024-09-12T00:40:35.400 INFO:tasks.workunit.client.0.smithi043.stderr: -81> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa5170) adding con mode: crc 2024-09-12T00:40:35.400 INFO:tasks.workunit.client.0.smithi043.stderr: -80> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa5170) adding con mode: secure 2024-09-12T00:40:35.400 INFO:tasks.workunit.client.0.smithi043.stderr: -79> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa5170) adding con mode: crc 2024-09-12T00:40:35.401 INFO:tasks.workunit.client.0.smithi043.stderr: -78> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 AuthRegistry(0x7fffdefa5170) adding con mode: secure 2024-09-12T00:40:35.401 INFO:tasks.workunit.client.0.smithi043.stderr: -77> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:35.401 INFO:tasks.workunit.client.0.smithi043.stderr: -76> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:35.401 INFO:tasks.workunit.client.0.smithi043.stderr: -75> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:35.401 INFO:tasks.workunit.client.0.smithi043.stderr: -74> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command cache list hook 0x55ee17286e90 2024-09-12T00:40:35.401 INFO:tasks.workunit.client.0.smithi043.stderr: -73> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command cache inspect hook 0x55ee17286e90 2024-09-12T00:40:35.401 INFO:tasks.workunit.client.0.smithi043.stderr: -72> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command cache erase hook 0x55ee17286e90 2024-09-12T00:40:35.401 INFO:tasks.workunit.client.0.smithi043.stderr: -71> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command cache zap hook 0x55ee17286e90 2024-09-12T00:40:35.401 INFO:tasks.workunit.client.0.smithi043.stderr: -70> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 note: GC not initialized 2024-09-12T00:40:35.401 INFO:tasks.workunit.client.0.smithi043.stderr: -69> 2024-09-12T00:40:35.227+0000 7fe670fe1640 20 reqs_thread_entry: start 2024-09-12T00:40:35.401 INFO:tasks.workunit.client.0.smithi043.stderr: -68> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command sync trace show hook 0x7fe7b011f070 2024-09-12T00:40:35.401 INFO:tasks.workunit.client.0.smithi043.stderr: -67> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command sync trace history hook 0x7fe7b011f070 2024-09-12T00:40:35.401 INFO:tasks.workunit.client.0.smithi043.stderr: -66> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command sync trace active hook 0x7fe7b011f070 2024-09-12T00:40:35.402 INFO:tasks.workunit.client.0.smithi043.stderr: -65> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 5 asok(0x55ee16fbe2b0) register_command sync trace active_short hook 0x7fe7b011f070 2024-09-12T00:40:35.402 INFO:tasks.workunit.client.0.smithi043.stderr: -64> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:35.402 INFO:tasks.workunit.client.0.smithi043.stderr: -63> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 20 Filter name: none 2024-09-12T00:40:35.402 INFO:tasks.workunit.client.0.smithi043.stderr: -62> 2024-09-12T00:40:35.227+0000 7fe669ffb640 20 reqs_thread_entry: start 2024-09-12T00:40:35.402 INFO:tasks.workunit.client.0.smithi043.stderr: -61> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:40:35.402 INFO:tasks.workunit.client.0.smithi043.stderr: -60> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.402 INFO:tasks.workunit.client.0.smithi043.stderr: -59> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:40:35.402 INFO:tasks.workunit.client.0.smithi043.stderr: -58> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:40:35.402 INFO:tasks.workunit.client.0.smithi043.stderr: -57> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:40:35.402 INFO:tasks.workunit.client.0.smithi043.stderr: -56> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 : miss 2024-09-12T00:40:35.402 INFO:tasks.workunit.client.0.smithi043.stderr: -55> 2024-09-12T00:40:35.227+0000 7fe7bd3349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.402 INFO:tasks.workunit.client.0.smithi043.stderr: -54> 2024-09-12T00:40:35.231+0000 7fe7bd3349c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:40:35.402 INFO:tasks.workunit.client.0.smithi043.stderr: -53> 2024-09-12T00:40:35.231+0000 7fe7bd3349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 info.flags=0x17 2024-09-12T00:40:35.403 INFO:tasks.workunit.client.0.smithi043.stderr: -52> 2024-09-12T00:40:35.231+0000 7fe7bd3349c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 to cache LRU end 2024-09-12T00:40:35.403 INFO:tasks.workunit.client.0.smithi043.stderr: -51> 2024-09-12T00:40:35.231+0000 7fe7bd3349c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:35.403 INFO:tasks.workunit.client.0.smithi043.stderr: -50> 2024-09-12T00:40:35.231+0000 7fe7bd3349c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:35.403 INFO:tasks.workunit.client.0.smithi043.stderr: -49> 2024-09-12T00:40:35.231+0000 7fe7bd3349c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 2024-09-12T00:40:35.403 INFO:tasks.workunit.client.0.smithi043.stderr: -48> 2024-09-12T00:40:35.243+0000 7fe7bd3349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 info.flags=0x17 2024-09-12T00:40:35.403 INFO:tasks.workunit.client.0.smithi043.stderr: -47> 2024-09-12T00:40:35.243+0000 7fe7bd3349c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 to cache LRU end 2024-09-12T00:40:35.403 INFO:tasks.workunit.client.0.smithi043.stderr: -46> 2024-09-12T00:40:35.243+0000 7fe7bd3349c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:35.403 INFO:tasks.workunit.client.0.smithi043.stderr: -45> 2024-09-12T00:40:35.243+0000 7fe7bd3349c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39, ofs0, ns] 2024-09-12T00:40:35.403 INFO:tasks.workunit.client.0.smithi043.stderr: -44> 2024-09-12T00:40:35.243+0000 7fe69e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333498 cookie 94481079348288 notifier 7911 bl.length()=931 2024-09-12T00:40:35.403 INFO:tasks.workunit.client.0.smithi043.stderr: -43> 2024-09-12T00:40:35.243+0000 7fe69e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 info.flags=0x17 2024-09-12T00:40:35.403 INFO:tasks.workunit.client.0.smithi043.stderr: -42> 2024-09-12T00:40:35.243+0000 7fe69e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 to cache LRU end 2024-09-12T00:40:35.403 INFO:tasks.workunit.client.0.smithi043.stderr: -41> 2024-09-12T00:40:35.243+0000 7fe69e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:35.403 INFO:tasks.workunit.client.0.smithi043.stderr: -40> 2024-09-12T00:40:35.247+0000 7fe7bd3349c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39]): orig_sources= new_sources= 2024-09-12T00:40:35.404 INFO:tasks.workunit.client.0.smithi043.stderr: -39> 2024-09-12T00:40:35.247+0000 7fe7bd3349c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39]): potential sources added=[] removed=[] 2024-09-12T00:40:35.404 INFO:tasks.workunit.client.0.smithi043.stderr: -38> 2024-09-12T00:40:35.247+0000 7fe7bd3349c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39]): orig_dests= new_dests= 2024-09-12T00:40:35.404 INFO:tasks.workunit.client.0.smithi043.stderr: -37> 2024-09-12T00:40:35.247+0000 7fe7bd3349c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39]): potential dests added=[] removed=[] 2024-09-12T00:40:35.404 INFO:tasks.workunit.client.0.smithi043.stderr: -36> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.0 2024-09-12T00:40:35.404 INFO:tasks.workunit.client.0.smithi043.stderr: -35> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.0 2024-09-12T00:40:35.404 INFO:tasks.workunit.client.0.smithi043.stderr: -34> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.1 2024-09-12T00:40:35.404 INFO:tasks.workunit.client.0.smithi043.stderr: -33> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.1 2024-09-12T00:40:35.404 INFO:tasks.workunit.client.0.smithi043.stderr: -32> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.2 2024-09-12T00:40:35.404 INFO:tasks.workunit.client.0.smithi043.stderr: -31> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.2 2024-09-12T00:40:35.404 INFO:tasks.workunit.client.0.smithi043.stderr: -30> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.3 2024-09-12T00:40:35.404 INFO:tasks.workunit.client.0.smithi043.stderr: -29> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.3 2024-09-12T00:40:35.404 INFO:tasks.workunit.client.0.smithi043.stderr: -28> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.4 2024-09-12T00:40:35.405 INFO:tasks.workunit.client.0.smithi043.stderr: -27> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.4 2024-09-12T00:40:35.405 INFO:tasks.workunit.client.0.smithi043.stderr: -26> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.5 2024-09-12T00:40:35.405 INFO:tasks.workunit.client.0.smithi043.stderr: -25> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.5 2024-09-12T00:40:35.405 INFO:tasks.workunit.client.0.smithi043.stderr: -24> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.6 2024-09-12T00:40:35.405 INFO:tasks.workunit.client.0.smithi043.stderr: -23> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.6 2024-09-12T00:40:35.405 INFO:tasks.workunit.client.0.smithi043.stderr: -22> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.7 2024-09-12T00:40:35.405 INFO:tasks.workunit.client.0.smithi043.stderr: -21> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.7 2024-09-12T00:40:35.405 INFO:tasks.workunit.client.0.smithi043.stderr: -20> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.8 2024-09-12T00:40:35.405 INFO:tasks.workunit.client.0.smithi043.stderr: -19> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.8 2024-09-12T00:40:35.405 INFO:tasks.workunit.client.0.smithi043.stderr: -18> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.9 2024-09-12T00:40:35.405 INFO:tasks.workunit.client.0.smithi043.stderr: -17> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.9 2024-09-12T00:40:35.405 INFO:tasks.workunit.client.0.smithi043.stderr: -16> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.10 2024-09-12T00:40:35.405 INFO:tasks.workunit.client.0.smithi043.stderr: -15> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.10 2024-09-12T00:40:35.406 INFO:tasks.workunit.client.0.smithi043.stderr: -14> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.11 2024-09-12T00:40:35.406 INFO:tasks.workunit.client.0.smithi043.stderr: -13> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1.11 2024-09-12T00:40:35.406 INFO:tasks.workunit.client.0.smithi043.stderr: -12> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.0 2024-09-12T00:40:35.406 INFO:tasks.workunit.client.0.smithi043.stderr: -11> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1 2024-09-12T00:40:35.406 INFO:tasks.workunit.client.0.smithi043.stderr: -10> 2024-09-12T00:40:35.255+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.2 2024-09-12T00:40:35.406 INFO:tasks.workunit.client.0.smithi043.stderr: -9> 2024-09-12T00:40:35.259+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.3 2024-09-12T00:40:35.406 INFO:tasks.workunit.client.0.smithi043.stderr: -8> 2024-09-12T00:40:35.259+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.4 2024-09-12T00:40:35.406 INFO:tasks.workunit.client.0.smithi043.stderr: -7> 2024-09-12T00:40:35.259+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.5 2024-09-12T00:40:35.406 INFO:tasks.workunit.client.0.smithi043.stderr: -6> 2024-09-12T00:40:35.259+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.6 2024-09-12T00:40:35.406 INFO:tasks.workunit.client.0.smithi043.stderr: -5> 2024-09-12T00:40:35.263+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.7 2024-09-12T00:40:35.406 INFO:tasks.workunit.client.0.smithi043.stderr: -4> 2024-09-12T00:40:35.263+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.8 2024-09-12T00:40:35.406 INFO:tasks.workunit.client.0.smithi043.stderr: -3> 2024-09-12T00:40:35.263+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.9 2024-09-12T00:40:35.407 INFO:tasks.workunit.client.0.smithi043.stderr: -2> 2024-09-12T00:40:35.263+0000 7fe7bd3349c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.10 2024-09-12T00:40:35.407 INFO:tasks.workunit.client.0.smithi043.stderr: -1> 2024-09-12T00:40:35.271+0000 7fe7bd3349c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe7bd3349c0 time 2024-09-12T00:40:35.274837+0000 2024-09-12T00:40:35.407 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:40:35.407 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.407 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:35.407 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe7c0c0e2eb] 2024-09-12T00:40:35.407 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe7c0c0e49f] 2024-09-12T00:40:35.407 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee15eefcc1] 2024-09-12T00:40:35.407 INFO:tasks.workunit.client.0.smithi043.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x55ee15f0401c] 2024-09-12T00:40:35.407 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ee15f056a4] 2024-09-12T00:40:35.407 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:40:35.407 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe7bfa74d90] 2024-09-12T00:40:35.408 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:40:35.408 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:40:35.408 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.408 INFO:tasks.workunit.client.0.smithi043.stderr: 0> 2024-09-12T00:40:35.275+0000 7fe7bd3349c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:40:35.408 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7fe7bd3349c0 thread_name:radosgw-admin 2024-09-12T00:40:35.408 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.408 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:35.408 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe7bfa8d520] 2024-09-12T00:40:35.408 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:40:35.408 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:40:35.408 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:40:35.408 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe7c0c0e345] 2024-09-12T00:40:35.409 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe7c0c0e49f] 2024-09-12T00:40:35.409 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee15eefcc1] 2024-09-12T00:40:35.409 INFO:tasks.workunit.client.0.smithi043.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x55ee15f0401c] 2024-09-12T00:40:35.409 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ee15f056a4] 2024-09-12T00:40:35.409 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:40:35.409 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe7bfa74d90] 2024-09-12T00:40:35.409 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:40:35.409 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:40:35.409 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:40:35.409 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.409 INFO:tasks.workunit.client.0.smithi043.stderr:--- logging levels --- 2024-09-12T00:40:35.409 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 none 2024-09-12T00:40:35.409 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 lockdep 2024-09-12T00:40:35.410 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 context 2024-09-12T00:40:35.410 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 crush 2024-09-12T00:40:35.410 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds 2024-09-12T00:40:35.410 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_balancer 2024-09-12T00:40:35.410 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_locker 2024-09-12T00:40:35.410 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log 2024-09-12T00:40:35.410 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log_expire 2024-09-12T00:40:35.410 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_migrator 2024-09-12T00:40:35.410 INFO:tasks.workunit.client.0.smithi043.stderr: 3/ 5 mds_quiesce 2024-09-12T00:40:35.410 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 buffer 2024-09-12T00:40:35.410 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 timer 2024-09-12T00:40:35.410 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 filer 2024-09-12T00:40:35.410 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 striper 2024-09-12T00:40:35.411 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 objecter 2024-09-12T00:40:35.411 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rados 2024-09-12T00:40:35.411 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd 2024-09-12T00:40:35.411 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_mirror 2024-09-12T00:40:35.411 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_replay 2024-09-12T00:40:35.411 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_pwl 2024-09-12T00:40:35.411 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 journaler 2024-09-12T00:40:35.411 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objectcacher 2024-09-12T00:40:35.411 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:40:35.411 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 client 2024-09-12T00:40:35.411 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 osd 2024-09-12T00:40:35.411 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 optracker 2024-09-12T00:40:35.411 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objclass 2024-09-12T00:40:35.412 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 filestore 2024-09-12T00:40:35.412 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 journal 2024-09-12T00:40:35.412 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 ms 2024-09-12T00:40:35.412 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mon 2024-09-12T00:40:35.412 INFO:tasks.workunit.client.0.smithi043.stderr: 0/10 monc 2024-09-12T00:40:35.412 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 paxos 2024-09-12T00:40:35.412 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 tp 2024-09-12T00:40:35.412 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 auth 2024-09-12T00:40:35.412 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 crypto 2024-09-12T00:40:35.412 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 finisher 2024-09-12T00:40:35.412 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 reserver 2024-09-12T00:40:35.412 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 heartbeatmap 2024-09-12T00:40:35.412 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 perfcounter 2024-09-12T00:40:35.413 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw 2024-09-12T00:40:35.413 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_sync 2024-09-12T00:40:35.413 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_datacache 2024-09-12T00:40:35.413 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_access 2024-09-12T00:40:35.413 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:40:35.413 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_flight 2024-09-12T00:40:35.413 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:40:35.413 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw_notification 2024-09-12T00:40:35.413 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 javaclient 2024-09-12T00:40:35.413 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 asok 2024-09-12T00:40:35.413 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 throttle 2024-09-12T00:40:35.413 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 refs 2024-09-12T00:40:35.413 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 compressor 2024-09-12T00:40:35.414 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluestore 2024-09-12T00:40:35.414 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluefs 2024-09-12T00:40:35.414 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 bdev 2024-09-12T00:40:35.414 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 kstore 2024-09-12T00:40:35.414 INFO:tasks.workunit.client.0.smithi043.stderr: 4/ 5 rocksdb 2024-09-12T00:40:35.414 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 fuse 2024-09-12T00:40:35.414 INFO:tasks.workunit.client.0.smithi043.stderr: 2/ 5 mgr 2024-09-12T00:40:35.414 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mgrc 2024-09-12T00:40:35.414 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 dpdk 2024-09-12T00:40:35.414 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 eventtrace 2024-09-12T00:40:35.414 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 prioritycache 2024-09-12T00:40:35.414 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 test 2024-09-12T00:40:35.415 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:40:35.415 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephsqlite 2024-09-12T00:40:35.415 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:40:35.415 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore 2024-09-12T00:40:35.415 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_onode 2024-09-12T00:40:35.415 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_odata 2024-09-12T00:40:35.415 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_omap 2024-09-12T00:40:35.415 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_tm 2024-09-12T00:40:35.415 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_t 2024-09-12T00:40:35.415 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:40:35.415 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_epm 2024-09-12T00:40:35.415 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_lba 2024-09-12T00:40:35.415 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:40:35.416 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cache 2024-09-12T00:40:35.416 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_journal 2024-09-12T00:40:35.416 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_device 2024-09-12T00:40:35.416 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_backref 2024-09-12T00:40:35.416 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 alienstore 2024-09-12T00:40:35.416 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mclock 2024-09-12T00:40:35.416 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cyanstore 2024-09-12T00:40:35.416 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 ceph_exporter 2024-09-12T00:40:35.416 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 memstore 2024-09-12T00:40:35.416 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 trace 2024-09-12T00:40:35.416 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 ceph_dedup 2024-09-12T00:40:35.416 INFO:tasks.workunit.client.0.smithi043.stderr: -2/-2 (syslog threshold) 2024-09-12T00:40:35.417 INFO:tasks.workunit.client.0.smithi043.stderr: 99/99 (stderr threshold) 2024-09-12T00:40:35.417 INFO:tasks.workunit.client.0.smithi043.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:40:35.417 INFO:tasks.workunit.client.0.smithi043.stderr: 7fe669ffb640 / http_manager 2024-09-12T00:40:35.417 INFO:tasks.workunit.client.0.smithi043.stderr: 7fe670fe1640 / http_manager 2024-09-12T00:40:35.417 INFO:tasks.workunit.client.0.smithi043.stderr: 7fe671fe3640 / rgw_dt_lg_renew 2024-09-12T00:40:35.417 INFO:tasks.workunit.client.0.smithi043.stderr: 7fe69cff9640 / ms_dispatch 2024-09-12T00:40:35.417 INFO:tasks.workunit.client.0.smithi043.stderr: 7fe69e7fc640 / io_context_pool 2024-09-12T00:40:35.417 INFO:tasks.workunit.client.0.smithi043.stderr: 7fe6a4e01640 / ms_dispatch 2024-09-12T00:40:35.417 INFO:tasks.workunit.client.0.smithi043.stderr: 7fe6a7606640 / ms_dispatch 2024-09-12T00:40:35.417 INFO:tasks.workunit.client.0.smithi043.stderr: 7fe6a8e09640 / io_context_pool 2024-09-12T00:40:35.417 INFO:tasks.workunit.client.0.smithi043.stderr: 7fe7ba639640 / msgr-worker-2 2024-09-12T00:40:35.417 INFO:tasks.workunit.client.0.smithi043.stderr: 7fe7bae3a640 / msgr-worker-1 2024-09-12T00:40:35.418 INFO:tasks.workunit.client.0.smithi043.stderr: 7fe7bb63b640 / msgr-worker-0 2024-09-12T00:40:35.418 INFO:tasks.workunit.client.0.smithi043.stderr: 7fe7bbe3c640 / io_context_pool 2024-09-12T00:40:35.418 INFO:tasks.workunit.client.0.smithi043.stderr: 7fe7bd3349c0 / radosgw-admin 2024-09-12T00:40:35.418 INFO:tasks.workunit.client.0.smithi043.stderr: max_recent 500 2024-09-12T00:40:35.418 INFO:tasks.workunit.client.0.smithi043.stderr: max_new 1000 2024-09-12T00:40:35.418 INFO:tasks.workunit.client.0.smithi043.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:40:35.277282Z_8acb7730-173e-46ef-97c0-8282c6c5dfcd/log 2024-09-12T00:40:35.418 INFO:tasks.workunit.client.0.smithi043.stderr:--- end dump of recent events --- 2024-09-12T00:40:35.418 INFO:tasks.workunit.client.0.smithi043.stderr:Aborted 2024-09-12T00:40:35.418 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:40:35.419 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:35.420 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:35.420 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.351+0000 7fad736299c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.420 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.355+0000 7fad736299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.420 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.355+0000 7fad736299c0 20 realm 2024-09-12T00:40:35.420 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.355+0000 7fad736299c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.420 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.355+0000 7fad736299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.420 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.355+0000 7fad736299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:35.420 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.355+0000 7fad736299c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.420 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.355+0000 7fad736299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.420 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.355+0000 7fad736299c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.420 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.355+0000 7fad736299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:35.421 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.355+0000 7fad736299c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.421 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.359+0000 7fad736299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:35.421 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.359+0000 7fad736299c0 20 searching for the correct realm 2024-09-12T00:40:35.421 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.363+0000 7fad71930640 0 -- 172.21.15.43:0/987624769 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7fad6804c950 msgr2=0x7fad6802b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:35.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.579+0000 7fad7112f640 0 -- 172.21.15.43:0/987624769 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x55fdc3b84b40 msgr2=0x55fdc3b86f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:35.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.587+0000 7fad736299c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:40:35.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.587+0000 7fad736299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:35.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.587+0000 7fad736299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:35.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.587+0000 7fad736299c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:40:35.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.587+0000 7fad736299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:35.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.587+0000 7fad736299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:35.589 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.587+0000 7fad736299c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.589 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.587+0000 7fad736299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.589 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.587+0000 7fad736299c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.589 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.591+0000 7fad736299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:35.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.591+0000 7fad736299c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.591+0000 7fad736299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:35.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.591+0000 7fad736299c0 20 zone default found 2024-09-12T00:40:35.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.591+0000 7fad736299c0 4 Realm: () 2024-09-12T00:40:35.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.591+0000 7fad736299c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:40:35.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.591+0000 7fad736299c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:40:35.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.591+0000 7fad736299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:35.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.591+0000 7fad736299c0 20 zonegroup default 2024-09-12T00:40:35.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.591+0000 7fad736299c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.592 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.591+0000 7fad736299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.592 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.591+0000 7fad736299c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.592 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.591+0000 7fad736299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.592 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.591+0000 7fad736299c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.591+0000 7fad736299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.595+0000 7fad736299c0 20 started sync module instance, tier type = 2024-09-12T00:40:35.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.595+0000 7fad736299c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:40:35.614 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.615+0000 7fad736299c0 20 add_watcher() i=0 2024-09-12T00:40:35.614 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.615+0000 7fad736299c0 20 add_watcher() i=1 2024-09-12T00:40:35.614 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.615+0000 7fad736299c0 20 add_watcher() i=2 2024-09-12T00:40:35.615 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.615+0000 7fad736299c0 20 add_watcher() i=3 2024-09-12T00:40:35.615 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.615+0000 7fad736299c0 20 add_watcher() i=4 2024-09-12T00:40:35.615 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.615+0000 7fad736299c0 20 add_watcher() i=5 2024-09-12T00:40:35.615 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.615+0000 7fad736299c0 20 add_watcher() i=6 2024-09-12T00:40:35.616 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.615+0000 7fad736299c0 20 add_watcher() i=7 2024-09-12T00:40:35.617 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.615+0000 7fad736299c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:35.621 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.619+0000 7fac277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:35.622 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.623+0000 7fad736299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:35.622 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.623+0000 7fad736299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:35.622 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.623+0000 7fad736299c0 5 note: GC not initialized 2024-09-12T00:40:35.623 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.623+0000 7fac267e4640 20 reqs_thread_entry: start 2024-09-12T00:40:35.623 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.623+0000 7fad736299c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:35.623 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.623+0000 7fad736299c0 20 Filter name: none 2024-09-12T00:40:35.623 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.623+0000 7fab97fff640 20 reqs_thread_entry: start 2024-09-12T00:40:35.623 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.623+0000 7fad736299c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.623 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.623+0000 7fad736299c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:40:35.624 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.623+0000 7fad736299c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.625 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.623+0000 7fad736299c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:40:35.625 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.623+0000 7fad736299c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:35.625 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.623+0000 7fad736299c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.625 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.627+0000 7fad736299c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:40:35.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.627+0000 7fad736299c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.627+0000 7fad736299c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:40:35.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.627+0000 7fad736299c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:35.630 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.631+0000 7fac277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:35.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.635+0000 7fad736299c0 20 remove_watcher() i=0 2024-09-12T00:40:35.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.635+0000 7fad736299c0 2 removed watcher, disabling cache 2024-09-12T00:40:35.637 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.635+0000 7fad736299c0 20 remove_watcher() i=1 2024-09-12T00:40:35.639 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.639+0000 7fad736299c0 20 remove_watcher() i=2 2024-09-12T00:40:35.641 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.639+0000 7fad736299c0 20 remove_watcher() i=3 2024-09-12T00:40:35.643 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.643+0000 7fad736299c0 20 remove_watcher() i=4 2024-09-12T00:40:35.645 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.643+0000 7fad736299c0 20 remove_watcher() i=5 2024-09-12T00:40:35.646 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.647+0000 7fad736299c0 20 remove_watcher() i=6 2024-09-12T00:40:35.648 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.647+0000 7fad736299c0 20 remove_watcher() i=7 2024-09-12T00:40:35.663 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.663 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:40:35.663 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: abort-at-change-reshard-state id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:40:35.663 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:40:35.665 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:35.665 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:35.677 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:35.677 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:40:35.723 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:40:35.756 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:35.756 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:35.801 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.803+0000 7fad5c4cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.803 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.803+0000 7fad5c4cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.803 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.803+0000 7fad5c4cc9c0 20 realm 2024-09-12T00:40:35.803 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.803+0000 7fad5c4cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.803+0000 7fad5c4cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.803+0000 7fad5c4cc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:35.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.803+0000 7fad5c4cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.803+0000 7fad5c4cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.803+0000 7fad5c4cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.807+0000 7fad5c4cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:35.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.807+0000 7fad5c4cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.807+0000 7fad5c4cc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:35.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.807+0000 7fad5c4cc9c0 20 searching for the correct realm 2024-09-12T00:40:35.812 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.811+0000 7fad53fff640 0 -- 172.21.15.43:0/3400173048 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x561410e4ee00 msgr2=0x561410e512a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:35.819 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.819+0000 7fad53fff640 0 -- 172.21.15.43:0/3400173048 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fad44008040 msgr2=0x7fad4402a420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:35.826 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.827+0000 7fad5c4cc9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:40:35.826 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.827+0000 7fad5c4cc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:35.826 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.827+0000 7fad5c4cc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:35.826 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.827+0000 7fad5c4cc9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:40:35.826 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.827+0000 7fad5c4cc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:35.826 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.827+0000 7fad5c4cc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:35.826 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.827+0000 7fad5c4cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.826 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.827+0000 7fad5c4cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.826 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.827+0000 7fad5c4cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.827 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.827+0000 7fad5c4cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:35.827 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.827+0000 7fad5c4cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.828 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.827+0000 7fad5c4cc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:35.828 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.827+0000 7fad5c4cc9c0 20 zone default found 2024-09-12T00:40:35.828 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.827+0000 7fad5c4cc9c0 4 Realm: () 2024-09-12T00:40:35.828 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.827+0000 7fad5c4cc9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:40:35.828 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.827+0000 7fad5c4cc9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:40:35.828 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.827+0000 7fad5c4cc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:35.828 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.827+0000 7fad5c4cc9c0 20 zonegroup default 2024-09-12T00:40:35.828 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.827+0000 7fad5c4cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.828 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.827+0000 7fad5c4cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.828 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.827+0000 7fad5c4cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.829 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.827+0000 7fad5c4cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.829 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.827+0000 7fad5c4cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.829 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.827+0000 7fad5c4cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.829 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.827+0000 7fad5c4cc9c0 20 started sync module instance, tier type = 2024-09-12T00:40:35.829 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.827+0000 7fad5c4cc9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:40:35.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.843+0000 7fad5c4cc9c0 20 add_watcher() i=0 2024-09-12T00:40:35.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.843+0000 7fad5c4cc9c0 20 add_watcher() i=1 2024-09-12T00:40:35.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.843+0000 7fad5c4cc9c0 20 add_watcher() i=2 2024-09-12T00:40:35.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.843+0000 7fad5c4cc9c0 20 add_watcher() i=3 2024-09-12T00:40:35.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.843+0000 7fad5c4cc9c0 20 add_watcher() i=4 2024-09-12T00:40:35.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.843+0000 7fad5c4cc9c0 20 add_watcher() i=5 2024-09-12T00:40:35.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.843+0000 7fad5c4cc9c0 20 add_watcher() i=6 2024-09-12T00:40:35.846 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.847+0000 7fad5c4cc9c0 20 add_watcher() i=7 2024-09-12T00:40:35.846 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.847+0000 7fad5c4cc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:35.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.847+0000 7fac0b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:35.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.847+0000 7fad5c4cc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:35.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.847+0000 7fad5c4cc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:35.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.851+0000 7fad5c4cc9c0 5 note: GC not initialized 2024-09-12T00:40:35.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.851+0000 7fac0a7fc640 20 reqs_thread_entry: start 2024-09-12T00:40:35.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.851+0000 7fad5c4cc9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:35.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.851+0000 7fad5c4cc9c0 20 Filter name: none 2024-09-12T00:40:35.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.851+0000 7fab7bfff640 20 reqs_thread_entry: start 2024-09-12T00:40:35.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.851+0000 7fad5c4cc9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:40:35.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.851+0000 7fad5c4cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.851+0000 7fad5c4cc9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:40:35.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.851+0000 7fad5c4cc9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:40:35.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.851+0000 7fad5c4cc9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:40:35.852 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.851+0000 7fad5c4cc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 : miss 2024-09-12T00:40:35.852 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.851+0000 7fad5c4cc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.852 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.851+0000 7fad5c4cc9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:40:35.852 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.851+0000 7fad5c4cc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 info.flags=0x17 2024-09-12T00:40:35.852 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.851+0000 7fad5c4cc9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 to cache LRU end 2024-09-12T00:40:35.852 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.851+0000 7fad5c4cc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:35.852 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.851+0000 7fad5c4cc9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:40:35.852 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.851+0000 7fad5c4cc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 2024-09-12T00:40:35.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.855+0000 7fad5c4cc9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 to be held by another RGW process; skipping for now 2024-09-12T00:40:35.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.855+0000 7fac0b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:35.860 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.859+0000 7fad5c4cc9c0 20 remove_watcher() i=0 2024-09-12T00:40:35.860 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.859+0000 7fad5c4cc9c0 2 removed watcher, disabling cache 2024-09-12T00:40:35.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.863+0000 7fad5c4cc9c0 20 remove_watcher() i=1 2024-09-12T00:40:35.866 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.867+0000 7fad5c4cc9c0 20 remove_watcher() i=2 2024-09-12T00:40:35.868 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.867+0000 7fad5c4cc9c0 20 remove_watcher() i=3 2024-09-12T00:40:35.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.871+0000 7fad5c4cc9c0 20 remove_watcher() i=4 2024-09-12T00:40:35.872 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.871+0000 7fad5c4cc9c0 20 remove_watcher() i=5 2024-09-12T00:40:35.873 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.875+0000 7fad5c4cc9c0 20 remove_watcher() i=6 2024-09-12T00:40:35.875 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:40:35.875+0000 7fad5c4cc9c0 20 remove_watcher() i=7 2024-09-12T00:40:35.889 INFO:tasks.workunit.client.0.smithi043.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:41:05.892 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:41:05.929 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:05.929 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:05.974 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.975+0000 7f55845b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:05.976 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.975+0000 7f55845b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:05.976 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.975+0000 7f55845b29c0 20 realm 2024-09-12T00:41:05.976 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.975+0000 7f55845b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:05.976 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.975+0000 7f55845b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:05.976 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.975+0000 7f55845b29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:05.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.975+0000 7f55845b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:05.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.975+0000 7f55845b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:05.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.975+0000 7f55845b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:05.978 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.979+0000 7f55845b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:05.978 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.979+0000 7f55845b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:05.979 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.979+0000 7f55845b29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:05.979 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.979+0000 7f55845b29c0 20 searching for the correct realm 2024-09-12T00:41:05.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.983+0000 7f55828b9640 0 -- 172.21.15.43:0/3612003707 >> [v2:172.21.15.43:6808/2258408181,v1:172.21.15.43:6809/2258408181] conn(0x564244fd5600 msgr2=0x564244fd7ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:05.991 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.991+0000 7f55820b8640 0 -- 172.21.15.43:0/3612003707 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f556c0cd040 msgr2=0x7f556c114bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:05.999 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.999+0000 7f55845b29c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:41:05.999 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.999+0000 7f55845b29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:05.999 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.999+0000 7f55845b29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:06.000 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.999+0000 7f55845b29c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:41:06.000 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.999+0000 7f55845b29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:06.000 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.999+0000 7f55845b29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:06.000 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.999+0000 7f55845b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.000 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.999+0000 7f55845b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.000 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.999+0000 7f55845b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.001 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.999+0000 7f55845b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:06.001 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.999+0000 7f55845b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.001 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.999+0000 7f55845b29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:06.002 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.999+0000 7f55845b29c0 20 zone default found 2024-09-12T00:41:06.002 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.999+0000 7f55845b29c0 4 Realm: () 2024-09-12T00:41:06.002 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.999+0000 7f55845b29c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:41:06.002 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.999+0000 7f55845b29c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:41:06.002 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.999+0000 7f55845b29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:06.002 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.999+0000 7f55845b29c0 20 zonegroup default 2024-09-12T00:41:06.002 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.999+0000 7f55845b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.002 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.999+0000 7f55845b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.002 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:05.999+0000 7f55845b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.003 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.003+0000 7f55845b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.003 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.003+0000 7f55845b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.003 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.003+0000 7f55845b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.003 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.003+0000 7f55845b29c0 20 started sync module instance, tier type = 2024-09-12T00:41:06.003 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.003+0000 7f55845b29c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:41:06.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.019+0000 7f55845b29c0 20 add_watcher() i=0 2024-09-12T00:41:06.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.019+0000 7f55845b29c0 20 add_watcher() i=1 2024-09-12T00:41:06.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.019+0000 7f55845b29c0 20 add_watcher() i=2 2024-09-12T00:41:06.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.019+0000 7f55845b29c0 20 add_watcher() i=3 2024-09-12T00:41:06.019 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.019+0000 7f55845b29c0 20 add_watcher() i=4 2024-09-12T00:41:06.019 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.019+0000 7f55845b29c0 20 add_watcher() i=5 2024-09-12T00:41:06.019 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.019+0000 7f55845b29c0 20 add_watcher() i=6 2024-09-12T00:41:06.019 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.019+0000 7f55845b29c0 20 add_watcher() i=7 2024-09-12T00:41:06.019 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.019+0000 7f55845b29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:06.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.023+0000 7f5438fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:06.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.023+0000 7f55845b29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:06.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.023+0000 7f55845b29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:06.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.023+0000 7f55845b29c0 5 note: GC not initialized 2024-09-12T00:41:06.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.023+0000 7f53b37fe640 20 reqs_thread_entry: start 2024-09-12T00:41:06.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.023+0000 7f55845b29c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:06.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.023+0000 7f55845b29c0 20 Filter name: none 2024-09-12T00:41:06.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.023+0000 7f53b17fa640 20 reqs_thread_entry: start 2024-09-12T00:41:06.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.023+0000 7f55845b29c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:41:06.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.023+0000 7f55845b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.024 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.023+0000 7f55845b29c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:41:06.024 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.023+0000 7f55845b29c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:41:06.024 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.023+0000 7f55845b29c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:41:06.025 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.023+0000 7f55845b29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 : miss 2024-09-12T00:41:06.025 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.023+0000 7f55845b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.025 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.023+0000 7f55845b29c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:41:06.025 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.023+0000 7f55845b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 info.flags=0x17 2024-09-12T00:41:06.025 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.023+0000 7f55845b29c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 to cache LRU end 2024-09-12T00:41:06.025 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.023+0000 7f55845b29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:41:06.025 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.023+0000 7f55845b29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:06.025 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.023+0000 7f55845b29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 2024-09-12T00:41:06.027 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.027+0000 7f55845b29c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:41:06.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.043+0000 7f55845b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 info.flags=0x17 2024-09-12T00:41:06.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.043+0000 7f55845b29c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 to cache LRU end 2024-09-12T00:41:06.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.043+0000 7f55845b29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:06.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.043+0000 7f55845b29c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39, ofs0, ns] 2024-09-12T00:41:06.043 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.043+0000 7f54657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333499 cookie 94842625306416 notifier 7595 bl.length()=931 2024-09-12T00:41:06.043 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.043+0000 7f54657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 info.flags=0x17 2024-09-12T00:41:06.043 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.043+0000 7f54657fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 to cache LRU end 2024-09-12T00:41:06.043 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.043+0000 7f54657fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:06.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.043+0000 7f55845b29c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39]): orig_sources= new_sources= 2024-09-12T00:41:06.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.043+0000 7f55845b29c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39]): potential sources added=[] removed=[] 2024-09-12T00:41:06.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.043+0000 7f55845b29c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39]): orig_dests= new_dests= 2024-09-12T00:41:06.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.043+0000 7f55845b29c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39]): potential dests added=[] removed=[] 2024-09-12T00:41:06.055 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.055+0000 7f55845b29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.2.0 2024-09-12T00:41:06.055 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.055+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.2.0 2024-09-12T00:41:06.055 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.055+0000 7f55845b29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.2.1 2024-09-12T00:41:06.055 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.055+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.2.1 2024-09-12T00:41:06.055 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.055+0000 7f55845b29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.2.2 2024-09-12T00:41:06.055 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.055+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.2.2 2024-09-12T00:41:06.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.055+0000 7f55845b29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.2.3 2024-09-12T00:41:06.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.055+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.2.3 2024-09-12T00:41:06.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.055+0000 7f55845b29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.2.4 2024-09-12T00:41:06.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.055+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.2.4 2024-09-12T00:41:06.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.055+0000 7f55845b29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.2.5 2024-09-12T00:41:06.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.055+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.2.5 2024-09-12T00:41:06.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.055+0000 7f55845b29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.2.6 2024-09-12T00:41:06.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.055+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.2.6 2024-09-12T00:41:06.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.055+0000 7f55845b29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.2.7 2024-09-12T00:41:06.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.055+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.2.7 2024-09-12T00:41:06.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.055+0000 7f55845b29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.2.8 2024-09-12T00:41:06.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.055+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.2.8 2024-09-12T00:41:06.056 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.055+0000 7f55845b29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.2.9 2024-09-12T00:41:06.057 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.055+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.2.9 2024-09-12T00:41:06.057 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.055+0000 7f55845b29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.2.10 2024-09-12T00:41:06.057 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.055+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.2.10 2024-09-12T00:41:06.057 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.055+0000 7f55845b29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.2.11 2024-09-12T00:41:06.057 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.055+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.2.11 2024-09-12T00:41:06.057 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.055+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.0 2024-09-12T00:41:06.058 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.055+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1 2024-09-12T00:41:06.058 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.055+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.2 2024-09-12T00:41:06.058 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.055+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.3 2024-09-12T00:41:06.058 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.059+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.4 2024-09-12T00:41:06.059 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.059+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.5 2024-09-12T00:41:06.059 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.059+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.6 2024-09-12T00:41:06.060 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.059+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.7 2024-09-12T00:41:06.061 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.059+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.8 2024-09-12T00:41:06.062 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.063+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.9 2024-09-12T00:41:06.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.063+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.10 2024-09-12T00:41:06.070 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.071+0000 7f55845b29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 : hit (requested=0x17, cached=0x17) 2024-09-12T00:41:06.070 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.071+0000 7f55845b29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 2024-09-12T00:41:06.072 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.071+0000 7f55845b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 info.flags=0x17 2024-09-12T00:41:06.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.071+0000 7f55845b29c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 to cache LRU end 2024-09-12T00:41:06.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.071+0000 7f55845b29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:06.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.071+0000 7f55845b29c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39, ofs0, ns] 2024-09-12T00:41:06.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.075+0000 7f54657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333500 cookie 94842625306416 notifier 7595 bl.length()=931 2024-09-12T00:41:06.073 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.075+0000 7f54657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 info.flags=0x17 2024-09-12T00:41:06.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.075+0000 7f54657fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 to cache LRU end 2024-09-12T00:41:06.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.075+0000 7f54657fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:06.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.075+0000 7f55845b29c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39]): orig_sources= new_sources= 2024-09-12T00:41:06.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.075+0000 7f55845b29c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39]): potential sources added=[] removed=[] 2024-09-12T00:41:06.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.075+0000 7f55845b29c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39]): orig_dests= new_dests= 2024-09-12T00:41:06.074 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.075+0000 7f55845b29c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39]): potential dests added=[] removed=[] 2024-09-12T00:41:06.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.079+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.0 2024-09-12T00:41:06.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.079+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.1 2024-09-12T00:41:06.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.079+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.2 2024-09-12T00:41:06.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.079+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.3 2024-09-12T00:41:06.081 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.079+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.4 2024-09-12T00:41:06.081 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.083+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.5 2024-09-12T00:41:06.082 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.083+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.6 2024-09-12T00:41:06.082 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.083+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.7 2024-09-12T00:41:06.083 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.083+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.8 2024-09-12T00:41:06.084 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.083+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.9 2024-09-12T00:41:06.084 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.083+0000 7f55845b29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39.10 2024-09-12T00:41:06.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.087+0000 7f55845b29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 : hit (requested=0x17, cached=0x17) 2024-09-12T00:41:06.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.087+0000 7f55845b29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 2024-09-12T00:41:06.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.087+0000 7f55845b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 info.flags=0x17 2024-09-12T00:41:06.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.087+0000 7f55845b29c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 to cache LRU end 2024-09-12T00:41:06.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.087+0000 7f55845b29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:06.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.087+0000 7f55845b29c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39, ofs0, ns] 2024-09-12T00:41:06.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.087+0000 7f54657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333501 cookie 94842625306416 notifier 7595 bl.length()=899 2024-09-12T00:41:06.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.087+0000 7f54657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 info.flags=0x17 2024-09-12T00:41:06.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.087+0000 7f54657fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 to cache LRU end 2024-09-12T00:41:06.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.087+0000 7f54657fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:41:06.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.091+0000 7f55845b29c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39]): orig_sources= new_sources= 2024-09-12T00:41:06.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.091+0000 7f55845b29c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39]): potential sources added=[] removed=[] 2024-09-12T00:41:06.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.091+0000 7f55845b29c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39]): orig_dests= new_dests= 2024-09-12T00:41:06.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.091+0000 7f55845b29c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39]): potential dests added=[] removed=[] 2024-09-12T00:41:06.096 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.095+0000 7f55845b29c0 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T00:41:06.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.099+0000 7f5438fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:06.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.103+0000 7f55845b29c0 20 remove_watcher() i=0 2024-09-12T00:41:06.105 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.103+0000 7f55845b29c0 2 removed watcher, disabling cache 2024-09-12T00:41:06.106 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.107+0000 7f55845b29c0 20 remove_watcher() i=1 2024-09-12T00:41:06.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.107+0000 7f55845b29c0 20 remove_watcher() i=2 2024-09-12T00:41:06.111 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.111+0000 7f55845b29c0 20 remove_watcher() i=3 2024-09-12T00:41:06.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.111+0000 7f55845b29c0 20 remove_watcher() i=4 2024-09-12T00:41:06.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.115+0000 7f55845b29c0 20 remove_watcher() i=5 2024-09-12T00:41:06.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.115+0000 7f55845b29c0 20 remove_watcher() i=6 2024-09-12T00:41:06.118 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.119+0000 7f55845b29c0 20 remove_watcher() i=7 2024-09-12T00:41:06.134 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:41:06.161 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:06.161 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:06.205 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.207+0000 7fdf137119c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.207+0000 7fdf137119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.207 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.207+0000 7fdf137119c0 20 realm 2024-09-12T00:41:06.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.207+0000 7fdf137119c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.207+0000 7fdf137119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.207+0000 7fdf137119c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:06.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.207+0000 7fdf137119c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.207+0000 7fdf137119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.208 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.207+0000 7fdf137119c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.209 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.211+0000 7fdf137119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:06.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.211+0000 7fdf137119c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.211+0000 7fdf137119c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:06.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.211+0000 7fdf137119c0 20 searching for the correct realm 2024-09-12T00:41:06.216 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.215+0000 7fdf11a18640 0 -- 172.21.15.43:0/2551646367 >> [v2:172.21.15.43:6808/2258408181,v1:172.21.15.43:6809/2258408181] conn(0x561744885be0 msgr2=0x5617448880a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:06.222 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.223+0000 7fdf11217640 0 -- 172.21.15.43:0/2551646367 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fdf080983b0 msgr2=0x7fdf080897e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:06.231 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.231+0000 7fdf137119c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:41:06.231 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.231+0000 7fdf137119c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:06.231 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.231+0000 7fdf137119c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:06.231 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.231+0000 7fdf137119c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:41:06.231 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.231+0000 7fdf137119c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:06.231 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.231+0000 7fdf137119c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:06.231 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.231+0000 7fdf137119c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.231 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.231+0000 7fdf137119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.231 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.231+0000 7fdf137119c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.232 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.231+0000 7fdf137119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:06.232 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.231+0000 7fdf137119c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.232 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.231+0000 7fdf137119c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:06.232 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.231+0000 7fdf137119c0 20 zone default found 2024-09-12T00:41:06.232 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.231+0000 7fdf137119c0 4 Realm: () 2024-09-12T00:41:06.232 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.231+0000 7fdf137119c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:41:06.232 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.231+0000 7fdf137119c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:41:06.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.231+0000 7fdf137119c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:06.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.231+0000 7fdf137119c0 20 zonegroup default 2024-09-12T00:41:06.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.231+0000 7fdf137119c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.231+0000 7fdf137119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.231+0000 7fdf137119c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.235+0000 7fdf137119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.235+0000 7fdf137119c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.235+0000 7fdf137119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.235+0000 7fdf137119c0 20 started sync module instance, tier type = 2024-09-12T00:41:06.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.235+0000 7fdf137119c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:41:06.250 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.251+0000 7fdf137119c0 20 add_watcher() i=0 2024-09-12T00:41:06.250 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.251+0000 7fdf137119c0 20 add_watcher() i=1 2024-09-12T00:41:06.250 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.251+0000 7fdf137119c0 20 add_watcher() i=2 2024-09-12T00:41:06.250 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.251+0000 7fdf137119c0 20 add_watcher() i=3 2024-09-12T00:41:06.250 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.251+0000 7fdf137119c0 20 add_watcher() i=4 2024-09-12T00:41:06.250 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.251+0000 7fdf137119c0 20 add_watcher() i=5 2024-09-12T00:41:06.250 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.251+0000 7fdf137119c0 20 add_watcher() i=6 2024-09-12T00:41:06.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.251+0000 7fdf137119c0 20 add_watcher() i=7 2024-09-12T00:41:06.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.251+0000 7fdf137119c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:06.253 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.255+0000 7fddc77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:06.254 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.255+0000 7fdf137119c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:06.254 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.255+0000 7fdf137119c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:06.254 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.255+0000 7fdf137119c0 5 note: GC not initialized 2024-09-12T00:41:06.255 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.255+0000 7fddc67e4640 20 reqs_thread_entry: start 2024-09-12T00:41:06.255 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.255+0000 7fdf137119c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:06.255 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.255+0000 7fdf137119c0 20 Filter name: none 2024-09-12T00:41:06.255 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.255+0000 7fdd37fff640 20 reqs_thread_entry: start 2024-09-12T00:41:06.255 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.255+0000 7fdf137119c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.255 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.255+0000 7fdf137119c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:41:06.255 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.255+0000 7fdf137119c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.255+0000 7fdf137119c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:41:06.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.255+0000 7fdf137119c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:06.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.255+0000 7fdf137119c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.255+0000 7fdf137119c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:41:06.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.255+0000 7fdf137119c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.259+0000 7fdf137119c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:41:06.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.259+0000 7fdf137119c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:06.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.259+0000 7fddc77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:06.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.263+0000 7fdf137119c0 20 remove_watcher() i=0 2024-09-12T00:41:06.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.263+0000 7fdf137119c0 2 removed watcher, disabling cache 2024-09-12T00:41:06.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.267+0000 7fdf137119c0 20 remove_watcher() i=1 2024-09-12T00:41:06.269 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.267+0000 7fdf137119c0 20 remove_watcher() i=2 2024-09-12T00:41:06.271 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.271+0000 7fdf137119c0 20 remove_watcher() i=3 2024-09-12T00:41:06.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.275+0000 7fdf137119c0 20 remove_watcher() i=4 2024-09-12T00:41:06.274 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.275+0000 7fdf137119c0 20 remove_watcher() i=5 2024-09-12T00:41:06.276 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.275+0000 7fdf137119c0 20 remove_watcher() i=6 2024-09-12T00:41:06.277 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.275+0000 7fdf137119c0 20 remove_watcher() i=7 2024-09-12T00:41:06.291 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:06.291 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:41:06.291 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: abort-at-change-reshard-state id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:41:06.292 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:06.292 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:06.292 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:41:06.296 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:06.296 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:41:06.343 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:06.344 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:41:06.401 INFO:tasks.workunit.client.0.smithi043.stderr: test: logrecord could be stopped after reshard failed 2024-09-12T00:41:06.401 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:41:06.430 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:06.430 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:06.476 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.475+0000 7fd888df09c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.477 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.479+0000 7fd888df09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.477 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.479+0000 7fd888df09c0 20 realm 2024-09-12T00:41:06.478 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.479+0000 7fd888df09c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.478 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.479+0000 7fd888df09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.478 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.479+0000 7fd888df09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:06.478 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.479+0000 7fd888df09c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.478 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.479+0000 7fd888df09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.479 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.479+0000 7fd888df09c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.480 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.479+0000 7fd888df09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:06.480 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.479+0000 7fd888df09c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.481 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.479+0000 7fd888df09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:06.481 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.479+0000 7fd888df09c0 20 searching for the correct realm 2024-09-12T00:41:06.486 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.487+0000 7fd8870f7640 0 -- 172.21.15.43:0/3668669240 >> [v2:172.21.15.43:6808/2258408181,v1:172.21.15.43:6809/2258408181] conn(0x563b944fa6d0 msgr2=0x563b944fcb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:06.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.491+0000 7fd8868f6640 0 -- 172.21.15.43:0/3668669240 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fd870034930 msgr2=0x7fd870028420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:06.501 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.499+0000 7fd888df09c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:41:06.501 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.499+0000 7fd888df09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:06.501 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.499+0000 7fd888df09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:06.501 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.499+0000 7fd888df09c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:41:06.501 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.499+0000 7fd888df09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:06.501 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.499+0000 7fd888df09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:06.501 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.499+0000 7fd888df09c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.501 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.499+0000 7fd888df09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.501 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.499+0000 7fd888df09c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.499+0000 7fd888df09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:06.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.499+0000 7fd888df09c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.503+0000 7fd888df09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:06.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.503+0000 7fd888df09c0 20 zone default found 2024-09-12T00:41:06.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.503+0000 7fd888df09c0 4 Realm: () 2024-09-12T00:41:06.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.503+0000 7fd888df09c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:41:06.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.503+0000 7fd888df09c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:41:06.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.503+0000 7fd888df09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:06.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.503+0000 7fd888df09c0 20 zonegroup default 2024-09-12T00:41:06.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.503+0000 7fd888df09c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.503+0000 7fd888df09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.503+0000 7fd888df09c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.503+0000 7fd888df09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.503+0000 7fd888df09c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.503+0000 7fd888df09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.503+0000 7fd888df09c0 20 started sync module instance, tier type = 2024-09-12T00:41:06.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.503+0000 7fd888df09c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:41:06.519 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.519+0000 7fd888df09c0 20 add_watcher() i=0 2024-09-12T00:41:06.519 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.519+0000 7fd888df09c0 20 add_watcher() i=1 2024-09-12T00:41:06.519 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.519+0000 7fd888df09c0 20 add_watcher() i=2 2024-09-12T00:41:06.519 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.519+0000 7fd888df09c0 20 add_watcher() i=3 2024-09-12T00:41:06.520 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.519+0000 7fd888df09c0 20 add_watcher() i=4 2024-09-12T00:41:06.520 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.519+0000 7fd888df09c0 20 add_watcher() i=5 2024-09-12T00:41:06.520 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.519+0000 7fd888df09c0 20 add_watcher() i=6 2024-09-12T00:41:06.520 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.519+0000 7fd888df09c0 20 add_watcher() i=7 2024-09-12T00:41:06.520 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.519+0000 7fd888df09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:06.523 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.523+0000 7fd73d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:06.524 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.523+0000 7fd888df09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:06.524 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.523+0000 7fd888df09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:06.524 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.523+0000 7fd888df09c0 5 note: GC not initialized 2024-09-12T00:41:06.524 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.523+0000 7fd6b7fff640 20 reqs_thread_entry: start 2024-09-12T00:41:06.524 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.523+0000 7fd888df09c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:06.524 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.523+0000 7fd888df09c0 20 Filter name: none 2024-09-12T00:41:06.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.523+0000 7fd6b5ffb640 20 reqs_thread_entry: start 2024-09-12T00:41:06.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.523+0000 7fd888df09c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.527+0000 7fd888df09c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:41:06.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.527+0000 7fd888df09c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.527+0000 7fd888df09c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:41:06.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.527+0000 7fd888df09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:06.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.527+0000 7fd888df09c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.527 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.527+0000 7fd888df09c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:41:06.527 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.527+0000 7fd888df09c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.527+0000 7fd888df09c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:41:06.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.527+0000 7fd888df09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:06.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.531+0000 7fd73d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:06.536 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.535+0000 7fd888df09c0 20 remove_watcher() i=0 2024-09-12T00:41:06.536 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.535+0000 7fd888df09c0 2 removed watcher, disabling cache 2024-09-12T00:41:06.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.539+0000 7fd888df09c0 20 remove_watcher() i=1 2024-09-12T00:41:06.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.539+0000 7fd888df09c0 20 remove_watcher() i=2 2024-09-12T00:41:06.542 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.543+0000 7fd888df09c0 20 remove_watcher() i=3 2024-09-12T00:41:06.544 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.543+0000 7fd888df09c0 20 remove_watcher() i=4 2024-09-12T00:41:06.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.547+0000 7fd888df09c0 20 remove_watcher() i=5 2024-09-12T00:41:06.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.547+0000 7fd888df09c0 20 remove_watcher() i=6 2024-09-12T00:41:06.548 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.547+0000 7fd888df09c0 20 remove_watcher() i=7 2024-09-12T00:41:06.562 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:06.562 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:41:06.562 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: a-bucket id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-12T00:41:06.562 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:06.562 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:41:06.589 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:06.589 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:06.630 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.631+0000 7f6f1403c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.631+0000 7f6f1403c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.631+0000 7f6f1403c9c0 20 realm 2024-09-12T00:41:06.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.631+0000 7f6f1403c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.631+0000 7f6f1403c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.631+0000 7f6f1403c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:06.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.631+0000 7f6f1403c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.631+0000 7f6f1403c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.631+0000 7f6f1403c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.635+0000 7f6f1403c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:06.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.635+0000 7f6f1403c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.635+0000 7f6f1403c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:06.636 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.635+0000 7f6f1403c9c0 20 searching for the correct realm 2024-09-12T00:41:06.642 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.643+0000 7f6f12343640 0 -- 172.21.15.43:0/987404495 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x56179c1b7d00 msgr2=0x7f6f0805c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:06.860 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.859+0000 7f6f11b42640 0 -- 172.21.15.43:0/987404495 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x56179c35c1d0 msgr2=0x56179c35e5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:06.868 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.867+0000 7f6f1403c9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:41:06.868 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.867+0000 7f6f1403c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:06.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.867+0000 7f6f1403c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:06.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.867+0000 7f6f1403c9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:41:06.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.867+0000 7f6f1403c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:06.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.867+0000 7f6f1403c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:06.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.867+0000 7f6f1403c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.867+0000 7f6f1403c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.867+0000 7f6f1403c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.871+0000 7f6f1403c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:06.870 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.871+0000 7f6f1403c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.871+0000 7f6f1403c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:06.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.871+0000 7f6f1403c9c0 20 zone default found 2024-09-12T00:41:06.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.871+0000 7f6f1403c9c0 4 Realm: () 2024-09-12T00:41:06.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.871+0000 7f6f1403c9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:41:06.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.871+0000 7f6f1403c9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:41:06.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.871+0000 7f6f1403c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:06.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.871+0000 7f6f1403c9c0 20 zonegroup default 2024-09-12T00:41:06.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.871+0000 7f6f1403c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.871+0000 7f6f1403c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.872 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.871+0000 7f6f1403c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.872 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.871+0000 7f6f1403c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.872 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.871+0000 7f6f1403c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.872 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.871+0000 7f6f1403c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.873 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.871+0000 7f6f1403c9c0 20 started sync module instance, tier type = 2024-09-12T00:41:06.873 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.871+0000 7f6f1403c9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:41:06.897 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.899+0000 7f6f1403c9c0 20 add_watcher() i=0 2024-09-12T00:41:06.897 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.899+0000 7f6f1403c9c0 20 add_watcher() i=1 2024-09-12T00:41:06.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.899+0000 7f6f1403c9c0 20 add_watcher() i=2 2024-09-12T00:41:06.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.899+0000 7f6f1403c9c0 20 add_watcher() i=3 2024-09-12T00:41:06.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.899+0000 7f6f1403c9c0 20 add_watcher() i=4 2024-09-12T00:41:06.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.899+0000 7f6f1403c9c0 20 add_watcher() i=5 2024-09-12T00:41:06.898 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.899+0000 7f6f1403c9c0 20 add_watcher() i=6 2024-09-12T00:41:06.902 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.903+0000 7f6f1403c9c0 20 add_watcher() i=7 2024-09-12T00:41:06.902 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.903+0000 7f6f1403c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:06.907 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.907+0000 7f6dc37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:06.907 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.907+0000 7f6f1403c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:06.907 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.907+0000 7f6f1403c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:06.908 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.907+0000 7f6f1403c9c0 5 note: GC not initialized 2024-09-12T00:41:06.908 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.907+0000 7f6dc27fc640 20 reqs_thread_entry: start 2024-09-12T00:41:06.908 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.907+0000 7f6f1403c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:06.909 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.907+0000 7f6f1403c9c0 20 Filter name: none 2024-09-12T00:41:06.909 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.907+0000 7f6d33fff640 20 reqs_thread_entry: start 2024-09-12T00:41:06.909 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.907+0000 7f6f1403c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.911+0000 7f6f1403c9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:41:06.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.911+0000 7f6f1403c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.911+0000 7f6f1403c9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:41:06.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.911+0000 7f6f1403c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:06.912 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.911+0000 7f6f1403c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.912 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.911+0000 7f6f1403c9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:41:06.912 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.911+0000 7f6f1403c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.913 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.915+0000 7f6f1403c9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:41:06.913 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.915+0000 7f6f1403c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:06.917 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.915+0000 7f6dc37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:06.921 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.923+0000 7f6f1403c9c0 20 remove_watcher() i=0 2024-09-12T00:41:06.921 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.923+0000 7f6f1403c9c0 2 removed watcher, disabling cache 2024-09-12T00:41:06.924 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.923+0000 7f6f1403c9c0 20 remove_watcher() i=1 2024-09-12T00:41:06.926 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.927+0000 7f6f1403c9c0 20 remove_watcher() i=2 2024-09-12T00:41:06.928 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.927+0000 7f6f1403c9c0 20 remove_watcher() i=3 2024-09-12T00:41:06.930 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.931+0000 7f6f1403c9c0 20 remove_watcher() i=4 2024-09-12T00:41:06.932 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.931+0000 7f6f1403c9c0 20 remove_watcher() i=5 2024-09-12T00:41:06.934 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.935+0000 7f6f1403c9c0 20 remove_watcher() i=6 2024-09-12T00:41:06.935 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:06.935+0000 7f6f1403c9c0 20 remove_watcher() i=7 2024-09-12T00:41:06.959 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T00:41:06.991 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:06.992 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:07.037 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.038 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.039+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.038 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.039+0000 7f0ef4d8a9c0 20 realm 2024-09-12T00:41:07.039 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.039+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.039 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.039+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.039 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.039+0000 7f0ef4d8a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:07.039 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.039+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.039 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.039+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.039 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.039+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.040 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.039+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:07.041 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.039+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.041 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.043+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:07.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.043+0000 7f0ef4d8a9c0 20 searching for the correct realm 2024-09-12T00:41:07.047 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.047+0000 7f0ef3091640 0 -- 172.21.15.43:0/3869858544 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x563fa5c69400 msgr2=0x563fa5c6b8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:41:07.053 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.055+0000 7f0ef2890640 0 -- 172.21.15.43:0/3869858544 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f0ee80d2910 msgr2=0x7f0ee80f33f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:07.062 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:41:07.062 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:07.062 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:07.062 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:41:07.062 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:07.062 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:07.062 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.062 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.062 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:07.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.063 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:07.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 zone default found 2024-09-12T00:41:07.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 4 Realm: () 2024-09-12T00:41:07.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:41:07.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:41:07.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:07.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 zonegroup default 2024-09-12T00:41:07.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 started sync module instance, tier type = 2024-09-12T00:41:07.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:41:07.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.079+0000 7f0ef4d8a9c0 20 add_watcher() i=0 2024-09-12T00:41:07.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.079+0000 7f0ef4d8a9c0 20 add_watcher() i=1 2024-09-12T00:41:07.081 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.079+0000 7f0ef4d8a9c0 20 add_watcher() i=2 2024-09-12T00:41:07.081 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.079+0000 7f0ef4d8a9c0 20 add_watcher() i=3 2024-09-12T00:41:07.081 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.079+0000 7f0ef4d8a9c0 20 add_watcher() i=4 2024-09-12T00:41:07.081 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.079+0000 7f0ef4d8a9c0 20 add_watcher() i=5 2024-09-12T00:41:07.081 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.083+0000 7f0ef4d8a9c0 20 add_watcher() i=6 2024-09-12T00:41:07.082 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.083+0000 7f0ef4d8a9c0 20 add_watcher() i=7 2024-09-12T00:41:07.083 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.083+0000 7f0ef4d8a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:07.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.087+0000 7f0da97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:07.086 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:07.086 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:07.086 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 note: GC not initialized 2024-09-12T00:41:07.086 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.087+0000 7f0d23fff640 20 reqs_thread_entry: start 2024-09-12T00:41:07.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:07.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 20 Filter name: none 2024-09-12T00:41:07.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.087+0000 7f0d21ffb640 20 reqs_thread_entry: start 2024-09-12T00:41:07.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:41:07.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:41:07.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:41:07.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:41:07.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 : miss 2024-09-12T00:41:07.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:41:07.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:41:07.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:41:07.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:41:07.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:07.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 2024-09-12T00:41:07.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.099+0000 7f0ef4d8a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:41:07.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.099+0000 7f0ef4d8a9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:41:07.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.099+0000 7f0ef4d8a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:07.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.099+0000 7f0ef4d8a9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17, ofs0, ns] 2024-09-12T00:41:07.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.099+0000 7f0dd5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333526 cookie 94831364255232 notifier 7667 bl.length()=827 2024-09-12T00:41:07.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.099+0000 7f0dd5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:41:07.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.099+0000 7f0dd5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:41:07.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.099+0000 7f0dd5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:07.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.099+0000 7f0ef4d8a9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_sources= new_sources= 2024-09-12T00:41:07.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.099+0000 7f0ef4d8a9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential sources added=[] removed=[] 2024-09-12T00:41:07.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.099+0000 7f0ef4d8a9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_dests= new_dests= 2024-09-12T00:41:07.102 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.099+0000 7f0ef4d8a9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential dests added=[] removed=[] 2024-09-12T00:41:07.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.0 2024-09-12T00:41:07.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.0 2024-09-12T00:41:07.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.1 2024-09-12T00:41:07.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.1 2024-09-12T00:41:07.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.2 2024-09-12T00:41:07.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.2 2024-09-12T00:41:07.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.3 2024-09-12T00:41:07.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.3 2024-09-12T00:41:07.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.4 2024-09-12T00:41:07.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.4 2024-09-12T00:41:07.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.5 2024-09-12T00:41:07.113 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.5 2024-09-12T00:41:07.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.6 2024-09-12T00:41:07.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.6 2024-09-12T00:41:07.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.7 2024-09-12T00:41:07.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.7 2024-09-12T00:41:07.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.8 2024-09-12T00:41:07.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.8 2024-09-12T00:41:07.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.9 2024-09-12T00:41:07.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.9 2024-09-12T00:41:07.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.10 2024-09-12T00:41:07.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.10 2024-09-12T00:41:07.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.11 2024-09-12T00:41:07.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.11 2024-09-12T00:41:07.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.12 2024-09-12T00:41:07.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.12 2024-09-12T00:41:07.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.13 2024-09-12T00:41:07.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.13 2024-09-12T00:41:07.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.0 2024-09-12T00:41:07.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.0 2024-09-12T00:41:07.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.1 2024-09-12T00:41:07.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.1 2024-09-12T00:41:07.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.115+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.2 2024-09-12T00:41:07.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.115+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.2 2024-09-12T00:41:07.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.115+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.3 2024-09-12T00:41:07.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.115+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.3 2024-09-12T00:41:07.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.115+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.4 2024-09-12T00:41:07.116 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.115+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.4 2024-09-12T00:41:07.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.115+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.5 2024-09-12T00:41:07.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.115+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.5 2024-09-12T00:41:07.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.115+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.6 2024-09-12T00:41:07.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.115+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.6 2024-09-12T00:41:07.118 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.119+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.7 2024-09-12T00:41:07.118 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.119+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.7 2024-09-12T00:41:07.119 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.119+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.8 2024-09-12T00:41:07.119 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.119+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.8 2024-09-12T00:41:07.119 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.119+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.9 2024-09-12T00:41:07.119 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.119+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.9 2024-09-12T00:41:07.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.119+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.10 2024-09-12T00:41:07.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.119+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.10 2024-09-12T00:41:07.121 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.119+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.11 2024-09-12T00:41:07.121 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.119+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.11 2024-09-12T00:41:07.121 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.123+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.12 2024-09-12T00:41:07.121 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.123+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.12 2024-09-12T00:41:07.126 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0ef4d8a9c0 time 2024-09-12T00:41:07.129497+0000 2024-09-12T00:41:07.126 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:41:07.127 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:07.127 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0ef86642eb] 2024-09-12T00:41:07.127 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0ef866449f] 2024-09-12T00:41:07.127 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563fa2d8acc1] 2024-09-12T00:41:07.127 INFO:tasks.workunit.client.0.smithi043.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x563fa2d9f01c] 2024-09-12T00:41:07.127 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563fa2da06a4] 2024-09-12T00:41:07.128 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:41:07.128 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0ef74cad90] 2024-09-12T00:41:07.128 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:41:07.128 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:41:07.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.127+0000 7f0ef4d8a9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0ef4d8a9c0 time 2024-09-12T00:41:07.129497+0000 2024-09-12T00:41:07.128 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:41:07.128 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.128 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:07.128 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0ef86642eb] 2024-09-12T00:41:07.128 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0ef866449f] 2024-09-12T00:41:07.128 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563fa2d8acc1] 2024-09-12T00:41:07.128 INFO:tasks.workunit.client.0.smithi043.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x563fa2d9f01c] 2024-09-12T00:41:07.129 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563fa2da06a4] 2024-09-12T00:41:07.129 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:41:07.129 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0ef74cad90] 2024-09-12T00:41:07.129 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:41:07.129 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:41:07.129 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.129 INFO:tasks.workunit.client.0.smithi043.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:41:07.129 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7f0ef4d8a9c0 thread_name:radosgw-admin 2024-09-12T00:41:07.148 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:07.148 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0ef74e3520] 2024-09-12T00:41:07.148 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:41:07.149 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:41:07.149 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:41:07.149 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0ef8664345] 2024-09-12T00:41:07.149 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0ef866449f] 2024-09-12T00:41:07.149 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563fa2d8acc1] 2024-09-12T00:41:07.149 INFO:tasks.workunit.client.0.smithi043.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x563fa2d9f01c] 2024-09-12T00:41:07.149 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563fa2da06a4] 2024-09-12T00:41:07.149 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:41:07.149 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0ef74cad90] 2024-09-12T00:41:07.149 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:41:07.149 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:41:07.149 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.127+0000 7f0ef4d8a9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:41:07.150 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7f0ef4d8a9c0 thread_name:radosgw-admin 2024-09-12T00:41:07.150 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.150 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:07.150 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0ef74e3520] 2024-09-12T00:41:07.150 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:41:07.150 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:41:07.150 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:41:07.150 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0ef8664345] 2024-09-12T00:41:07.150 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0ef866449f] 2024-09-12T00:41:07.150 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563fa2d8acc1] 2024-09-12T00:41:07.150 INFO:tasks.workunit.client.0.smithi043.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x563fa2d9f01c] 2024-09-12T00:41:07.150 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563fa2da06a4] 2024-09-12T00:41:07.151 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:41:07.151 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0ef74cad90] 2024-09-12T00:41:07.151 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:41:07.151 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:41:07.151 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:41:07.151 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.151 INFO:tasks.workunit.client.0.smithi043.stderr:--- begin dump of recent events --- 2024-09-12T00:41:07.151 INFO:tasks.workunit.client.0.smithi043.stderr: -499> 2024-09-12T00:41:07.015+0000 7f0ef4d8a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:07.151 INFO:tasks.workunit.client.0.smithi043.stderr: -498> 2024-09-12T00:41:07.015+0000 7f0ef4d8a9c0 5 asok(0x563fa59732b0) register_command rotate-key hook 0x563fa5b80c48 2024-09-12T00:41:07.151 INFO:tasks.workunit.client.0.smithi043.stderr: -497> 2024-09-12T00:41:07.015+0000 7f0ef4d8a9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:07.151 INFO:tasks.workunit.client.0.smithi043.stderr: -496> 2024-09-12T00:41:07.015+0000 7f0ef4d8a9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:41:07.151 INFO:tasks.workunit.client.0.smithi043.stderr: -495> 2024-09-12T00:41:07.015+0000 7f0ef4d8a9c0 10 monclient(hunting): picked mon.noname-a con 0x563fa5a30820 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:41:07.151 INFO:tasks.workunit.client.0.smithi043.stderr: -494> 2024-09-12T00:41:07.015+0000 7f0ef4d8a9c0 10 monclient(hunting): picked mon.noname-b con 0x563fa5a3ba80 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:41:07.152 INFO:tasks.workunit.client.0.smithi043.stderr: -493> 2024-09-12T00:41:07.015+0000 7f0ef4d8a9c0 10 monclient(hunting): picked mon.noname-c con 0x563fa5acc170 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:41:07.152 INFO:tasks.workunit.client.0.smithi043.stderr: -492> 2024-09-12T00:41:07.015+0000 7f0ef4d8a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:07.152 INFO:tasks.workunit.client.0.smithi043.stderr: -491> 2024-09-12T00:41:07.015+0000 7f0ef4d8a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:07.152 INFO:tasks.workunit.client.0.smithi043.stderr: -490> 2024-09-12T00:41:07.015+0000 7f0ef4d8a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:07.152 INFO:tasks.workunit.client.0.smithi043.stderr: -489> 2024-09-12T00:41:07.015+0000 7f0ef4d8a9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:07.152 INFO:tasks.workunit.client.0.smithi043.stderr: -488> 2024-09-12T00:41:07.015+0000 7f0ef4d8a9c0 10 monclient(hunting): authenticate will time out at 2363.007652s 2024-09-12T00:41:07.152 INFO:tasks.workunit.client.0.smithi043.stderr: -487> 2024-09-12T00:41:07.015+0000 7f0ef2890640 10 monclient(hunting): get_auth_request con 0x563fa5a30820 auth_method 0 2024-09-12T00:41:07.152 INFO:tasks.workunit.client.0.smithi043.stderr: -486> 2024-09-12T00:41:07.015+0000 7f0ef2890640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:07.152 INFO:tasks.workunit.client.0.smithi043.stderr: -485> 2024-09-12T00:41:07.015+0000 7f0ef2890640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:07.152 INFO:tasks.workunit.client.0.smithi043.stderr: -484> 2024-09-12T00:41:07.015+0000 7f0ef2890640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:07.152 INFO:tasks.workunit.client.0.smithi043.stderr: -483> 2024-09-12T00:41:07.015+0000 7f0ef3091640 10 monclient(hunting): get_auth_request con 0x563fa5acc170 auth_method 0 2024-09-12T00:41:07.152 INFO:tasks.workunit.client.0.smithi043.stderr: -482> 2024-09-12T00:41:07.015+0000 7f0ef3091640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:07.152 INFO:tasks.workunit.client.0.smithi043.stderr: -481> 2024-09-12T00:41:07.015+0000 7f0ef3091640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:07.153 INFO:tasks.workunit.client.0.smithi043.stderr: -480> 2024-09-12T00:41:07.015+0000 7f0ef3091640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:07.153 INFO:tasks.workunit.client.0.smithi043.stderr: -479> 2024-09-12T00:41:07.015+0000 7f0ef2890640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:07.153 INFO:tasks.workunit.client.0.smithi043.stderr: -478> 2024-09-12T00:41:07.015+0000 7f0ef2890640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:07.153 INFO:tasks.workunit.client.0.smithi043.stderr: -477> 2024-09-12T00:41:07.015+0000 7f0ef2890640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:07.153 INFO:tasks.workunit.client.0.smithi043.stderr: -476> 2024-09-12T00:41:07.015+0000 7f0ef3091640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:07.153 INFO:tasks.workunit.client.0.smithi043.stderr: -475> 2024-09-12T00:41:07.015+0000 7f0ef3091640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:07.153 INFO:tasks.workunit.client.0.smithi043.stderr: -474> 2024-09-12T00:41:07.015+0000 7f0ef3091640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:07.153 INFO:tasks.workunit.client.0.smithi043.stderr: -473> 2024-09-12T00:41:07.019+0000 7f0ef208f640 10 monclient(hunting): get_auth_request con 0x563fa5a3ba80 auth_method 0 2024-09-12T00:41:07.154 INFO:tasks.workunit.client.0.smithi043.stderr: -472> 2024-09-12T00:41:07.019+0000 7f0ef208f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:07.154 INFO:tasks.workunit.client.0.smithi043.stderr: -471> 2024-09-12T00:41:07.019+0000 7f0ef208f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:07.154 INFO:tasks.workunit.client.0.smithi043.stderr: -470> 2024-09-12T00:41:07.019+0000 7f0ef208f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:07.154 INFO:tasks.workunit.client.0.smithi043.stderr: -469> 2024-09-12T00:41:07.019+0000 7f0ef2890640 10 monclient(hunting): handle_auth_done global_id 8028 payload 824 2024-09-12T00:41:07.154 INFO:tasks.workunit.client.0.smithi043.stderr: -468> 2024-09-12T00:41:07.019+0000 7f0ef2890640 10 monclient: _finish_hunting 0 2024-09-12T00:41:07.154 INFO:tasks.workunit.client.0.smithi043.stderr: -467> 2024-09-12T00:41:07.019+0000 7f0ef2890640 1 monclient: found mon.noname-a 2024-09-12T00:41:07.154 INFO:tasks.workunit.client.0.smithi043.stderr: -466> 2024-09-12T00:41:07.019+0000 7f0ef2890640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:41:07.154 INFO:tasks.workunit.client.0.smithi043.stderr: -465> 2024-09-12T00:41:07.019+0000 7f0ddf606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:07.154 INFO:tasks.workunit.client.0.smithi043.stderr: -464> 2024-09-12T00:41:07.019+0000 7f0ddf606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:41:07.154 INFO:tasks.workunit.client.0.smithi043.stderr: -463> 2024-09-12T00:41:07.019+0000 7f0ddf606640 10 monclient: dump: 2024-09-12T00:41:07.154 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:07.154 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:07.154 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.155 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.155 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:07.155 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:07.155 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:07.155 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:07.155 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:07.155 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.155 INFO:tasks.workunit.client.0.smithi043.stderr: -462> 2024-09-12T00:41:07.019+0000 7f0ddf606640 10 monclient: _finish_auth 0 2024-09-12T00:41:07.155 INFO:tasks.workunit.client.0.smithi043.stderr: -461> 2024-09-12T00:41:07.019+0000 7f0ddf606640 10 monclient: _check_auth_tickets 2024-09-12T00:41:07.155 INFO:tasks.workunit.client.0.smithi043.stderr: -460> 2024-09-12T00:41:07.019+0000 7f0ddf606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:07.155 INFO:tasks.workunit.client.0.smithi043.stderr: -459> 2024-09-12T00:41:07.019+0000 7f0ddf606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:07.155 INFO:tasks.workunit.client.0.smithi043.stderr: -458> 2024-09-12T00:41:07.019+0000 7f0ddf606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:41:07.155 INFO:tasks.workunit.client.0.smithi043.stderr: -457> 2024-09-12T00:41:07.019+0000 7f0ddf606640 10 monclient: dump: 2024-09-12T00:41:07.156 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:07.156 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:07.156 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.156 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.156 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:07.156 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:07.156 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:07.156 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:07.156 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:07.156 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.156 INFO:tasks.workunit.client.0.smithi043.stderr: -456> 2024-09-12T00:41:07.019+0000 7f0ef4d8a9c0 5 monclient: authenticate success, global_id 8028 2024-09-12T00:41:07.156 INFO:tasks.workunit.client.0.smithi043.stderr: -455> 2024-09-12T00:41:07.019+0000 7f0de0e09640 4 set_mon_vals no callback set 2024-09-12T00:41:07.157 INFO:tasks.workunit.client.0.smithi043.stderr: -454> 2024-09-12T00:41:07.019+0000 7f0ef4d8a9c0 10 monclient: _renew_subs 2024-09-12T00:41:07.157 INFO:tasks.workunit.client.0.smithi043.stderr: -453> 2024-09-12T00:41:07.019+0000 7f0ef4d8a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:41:07.157 INFO:tasks.workunit.client.0.smithi043.stderr: -452> 2024-09-12T00:41:07.019+0000 7f0ef4d8a9c0 10 monclient: _renew_subs 2024-09-12T00:41:07.157 INFO:tasks.workunit.client.0.smithi043.stderr: -451> 2024-09-12T00:41:07.019+0000 7f0ef4d8a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:41:07.157 INFO:tasks.workunit.client.0.smithi043.stderr: -450> 2024-09-12T00:41:07.019+0000 7f0ef4d8a9c0 1 librados: init done 2024-09-12T00:41:07.157 INFO:tasks.workunit.client.0.smithi043.stderr: -449> 2024-09-12T00:41:07.019+0000 7f0ddf606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:41:07.157 INFO:tasks.workunit.client.0.smithi043.stderr: -448> 2024-09-12T00:41:07.019+0000 7f0ddf606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:41:07.157 INFO:tasks.workunit.client.0.smithi043.stderr: -447> 2024-09-12T00:41:07.019+0000 7f0ddf606640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:41:07.157 INFO:tasks.workunit.client.0.smithi043.stderr: -446> 2024-09-12T00:41:07.019+0000 7f0ef208f640 10 monclient: get_auth_request con 0x7f0dd8070ae0 auth_method 0 2024-09-12T00:41:07.158 INFO:tasks.workunit.client.0.smithi043.stderr: -445> 2024-09-12T00:41:07.023+0000 7f0ef3091640 10 monclient: get_auth_request con 0x563fa5bac280 auth_method 0 2024-09-12T00:41:07.158 INFO:tasks.workunit.client.0.smithi043.stderr: -444> 2024-09-12T00:41:07.023+0000 7f0ef2890640 10 monclient: get_auth_request con 0x563fa5bcb250 auth_method 0 2024-09-12T00:41:07.158 INFO:tasks.workunit.client.0.smithi043.stderr: -443> 2024-09-12T00:41:07.023+0000 7f0ef208f640 10 monclient: get_auth_request con 0x563fa5bcf440 auth_method 0 2024-09-12T00:41:07.158 INFO:tasks.workunit.client.0.smithi043.stderr: -442> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient: build_initial_monmap 2024-09-12T00:41:07.158 INFO:tasks.workunit.client.0.smithi043.stderr: -441> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 1 build_initial for_mkfs: 0 2024-09-12T00:41:07.158 INFO:tasks.workunit.client.0.smithi043.stderr: -440> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient: monmap: 2024-09-12T00:41:07.158 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:41:07.158 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:41:07.158 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:41:07.158 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:41:07.158 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:41:07.158 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:07.158 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:41:07.159 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:41:07.159 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:41:07.159 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.159 INFO:tasks.workunit.client.0.smithi043.stderr: -439> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd3fa0) adding auth protocol: cephx 2024-09-12T00:41:07.159 INFO:tasks.workunit.client.0.smithi043.stderr: -438> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd3fa0) adding auth protocol: cephx 2024-09-12T00:41:07.159 INFO:tasks.workunit.client.0.smithi043.stderr: -437> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd3fa0) adding auth protocol: cephx 2024-09-12T00:41:07.159 INFO:tasks.workunit.client.0.smithi043.stderr: -436> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd3fa0) adding con mode: secure 2024-09-12T00:41:07.159 INFO:tasks.workunit.client.0.smithi043.stderr: -435> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd3fa0) adding con mode: crc 2024-09-12T00:41:07.159 INFO:tasks.workunit.client.0.smithi043.stderr: -434> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd3fa0) adding con mode: secure 2024-09-12T00:41:07.159 INFO:tasks.workunit.client.0.smithi043.stderr: -433> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd3fa0) adding con mode: crc 2024-09-12T00:41:07.159 INFO:tasks.workunit.client.0.smithi043.stderr: -432> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd3fa0) adding con mode: secure 2024-09-12T00:41:07.159 INFO:tasks.workunit.client.0.smithi043.stderr: -431> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd3fa0) adding con mode: crc 2024-09-12T00:41:07.159 INFO:tasks.workunit.client.0.smithi043.stderr: -430> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd3fa0) adding con mode: crc 2024-09-12T00:41:07.160 INFO:tasks.workunit.client.0.smithi043.stderr: -429> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd3fa0) adding con mode: secure 2024-09-12T00:41:07.160 INFO:tasks.workunit.client.0.smithi043.stderr: -428> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd3fa0) adding con mode: crc 2024-09-12T00:41:07.160 INFO:tasks.workunit.client.0.smithi043.stderr: -427> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd3fa0) adding con mode: secure 2024-09-12T00:41:07.160 INFO:tasks.workunit.client.0.smithi043.stderr: -426> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd3fa0) adding con mode: crc 2024-09-12T00:41:07.160 INFO:tasks.workunit.client.0.smithi043.stderr: -425> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd3fa0) adding con mode: secure 2024-09-12T00:41:07.160 INFO:tasks.workunit.client.0.smithi043.stderr: -424> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:07.160 INFO:tasks.workunit.client.0.smithi043.stderr: -423> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 asok(0x563fa59732b0) register_command objecter_requests cmddesc objecter_requests hook 0x563fa5bd7930 EEXIST 2024-09-12T00:41:07.160 INFO:tasks.workunit.client.0.smithi043.stderr: -422> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient: init 2024-09-12T00:41:07.160 INFO:tasks.workunit.client.0.smithi043.stderr: -421> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd26c8) adding auth protocol: cephx 2024-09-12T00:41:07.160 INFO:tasks.workunit.client.0.smithi043.stderr: -420> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd26c8) adding auth protocol: cephx 2024-09-12T00:41:07.160 INFO:tasks.workunit.client.0.smithi043.stderr: -419> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd26c8) adding auth protocol: cephx 2024-09-12T00:41:07.160 INFO:tasks.workunit.client.0.smithi043.stderr: -418> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd26c8) adding con mode: secure 2024-09-12T00:41:07.160 INFO:tasks.workunit.client.0.smithi043.stderr: -417> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd26c8) adding con mode: crc 2024-09-12T00:41:07.161 INFO:tasks.workunit.client.0.smithi043.stderr: -416> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd26c8) adding con mode: secure 2024-09-12T00:41:07.161 INFO:tasks.workunit.client.0.smithi043.stderr: -415> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd26c8) adding con mode: crc 2024-09-12T00:41:07.161 INFO:tasks.workunit.client.0.smithi043.stderr: -414> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd26c8) adding con mode: secure 2024-09-12T00:41:07.161 INFO:tasks.workunit.client.0.smithi043.stderr: -413> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd26c8) adding con mode: crc 2024-09-12T00:41:07.161 INFO:tasks.workunit.client.0.smithi043.stderr: -412> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd26c8) adding con mode: crc 2024-09-12T00:41:07.161 INFO:tasks.workunit.client.0.smithi043.stderr: -411> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd26c8) adding con mode: secure 2024-09-12T00:41:07.161 INFO:tasks.workunit.client.0.smithi043.stderr: -410> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd26c8) adding con mode: crc 2024-09-12T00:41:07.161 INFO:tasks.workunit.client.0.smithi043.stderr: -409> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd26c8) adding con mode: secure 2024-09-12T00:41:07.161 INFO:tasks.workunit.client.0.smithi043.stderr: -408> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd26c8) adding con mode: crc 2024-09-12T00:41:07.161 INFO:tasks.workunit.client.0.smithi043.stderr: -407> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd26c8) adding con mode: secure 2024-09-12T00:41:07.161 INFO:tasks.workunit.client.0.smithi043.stderr: -406> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:07.161 INFO:tasks.workunit.client.0.smithi043.stderr: -405> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:07.161 INFO:tasks.workunit.client.0.smithi043.stderr: -404> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 asok(0x563fa59732b0) register_command rotate-key cmddesc rotate-key hook 0x563fa5bd2810 EEXIST 2024-09-12T00:41:07.162 INFO:tasks.workunit.client.0.smithi043.stderr: -403> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:07.162 INFO:tasks.workunit.client.0.smithi043.stderr: -402> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:41:07.162 INFO:tasks.workunit.client.0.smithi043.stderr: -401> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient(hunting): picked mon.noname-b con 0x563fa5bfbae0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:41:07.162 INFO:tasks.workunit.client.0.smithi043.stderr: -400> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient(hunting): picked mon.noname-a con 0x563fa5bfb410 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:41:07.162 INFO:tasks.workunit.client.0.smithi043.stderr: -399> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient(hunting): picked mon.noname-c con 0x563fa5bf9df0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:41:07.162 INFO:tasks.workunit.client.0.smithi043.stderr: -398> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:07.162 INFO:tasks.workunit.client.0.smithi043.stderr: -397> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:07.162 INFO:tasks.workunit.client.0.smithi043.stderr: -396> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:07.162 INFO:tasks.workunit.client.0.smithi043.stderr: -395> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:07.162 INFO:tasks.workunit.client.0.smithi043.stderr: -394> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient(hunting): authenticate will time out at 2363.018180s 2024-09-12T00:41:07.162 INFO:tasks.workunit.client.0.smithi043.stderr: -393> 2024-09-12T00:41:07.027+0000 7f0ef3091640 10 monclient(hunting): get_auth_request con 0x563fa5bf9df0 auth_method 0 2024-09-12T00:41:07.162 INFO:tasks.workunit.client.0.smithi043.stderr: -392> 2024-09-12T00:41:07.027+0000 7f0ef3091640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:07.162 INFO:tasks.workunit.client.0.smithi043.stderr: -391> 2024-09-12T00:41:07.027+0000 7f0ef3091640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:07.162 INFO:tasks.workunit.client.0.smithi043.stderr: -390> 2024-09-12T00:41:07.027+0000 7f0ef3091640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:07.163 INFO:tasks.workunit.client.0.smithi043.stderr: -389> 2024-09-12T00:41:07.027+0000 7f0ef208f640 10 monclient(hunting): get_auth_request con 0x563fa5bfb410 auth_method 0 2024-09-12T00:41:07.163 INFO:tasks.workunit.client.0.smithi043.stderr: -388> 2024-09-12T00:41:07.027+0000 7f0ef208f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:07.163 INFO:tasks.workunit.client.0.smithi043.stderr: -387> 2024-09-12T00:41:07.027+0000 7f0ef208f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:07.163 INFO:tasks.workunit.client.0.smithi043.stderr: -386> 2024-09-12T00:41:07.027+0000 7f0ef208f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:07.163 INFO:tasks.workunit.client.0.smithi043.stderr: -385> 2024-09-12T00:41:07.027+0000 7f0ef3091640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:07.163 INFO:tasks.workunit.client.0.smithi043.stderr: -384> 2024-09-12T00:41:07.027+0000 7f0ef3091640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:07.163 INFO:tasks.workunit.client.0.smithi043.stderr: -383> 2024-09-12T00:41:07.027+0000 7f0ef3091640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:07.163 INFO:tasks.workunit.client.0.smithi043.stderr: -382> 2024-09-12T00:41:07.027+0000 7f0ef208f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:07.163 INFO:tasks.workunit.client.0.smithi043.stderr: -381> 2024-09-12T00:41:07.027+0000 7f0ef208f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:07.163 INFO:tasks.workunit.client.0.smithi043.stderr: -380> 2024-09-12T00:41:07.027+0000 7f0ef208f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:07.164 INFO:tasks.workunit.client.0.smithi043.stderr: -379> 2024-09-12T00:41:07.027+0000 7f0ef2890640 10 monclient(hunting): get_auth_request con 0x563fa5bfbae0 auth_method 0 2024-09-12T00:41:07.164 INFO:tasks.workunit.client.0.smithi043.stderr: -378> 2024-09-12T00:41:07.027+0000 7f0ef2890640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:07.164 INFO:tasks.workunit.client.0.smithi043.stderr: -377> 2024-09-12T00:41:07.027+0000 7f0ef2890640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:07.164 INFO:tasks.workunit.client.0.smithi043.stderr: -376> 2024-09-12T00:41:07.027+0000 7f0ef2890640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:07.164 INFO:tasks.workunit.client.0.smithi043.stderr: -375> 2024-09-12T00:41:07.027+0000 7f0ef3091640 10 monclient(hunting): handle_auth_done global_id 7661 payload 824 2024-09-12T00:41:07.164 INFO:tasks.workunit.client.0.smithi043.stderr: -374> 2024-09-12T00:41:07.027+0000 7f0ef3091640 10 monclient: _finish_hunting 0 2024-09-12T00:41:07.164 INFO:tasks.workunit.client.0.smithi043.stderr: -373> 2024-09-12T00:41:07.027+0000 7f0ef3091640 1 monclient: found mon.noname-c 2024-09-12T00:41:07.164 INFO:tasks.workunit.client.0.smithi043.stderr: -372> 2024-09-12T00:41:07.027+0000 7f0ef3091640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:41:07.164 INFO:tasks.workunit.client.0.smithi043.stderr: -371> 2024-09-12T00:41:07.027+0000 7f0ddce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:07.164 INFO:tasks.workunit.client.0.smithi043.stderr: -370> 2024-09-12T00:41:07.027+0000 7f0ddce01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:41:07.164 INFO:tasks.workunit.client.0.smithi043.stderr: -369> 2024-09-12T00:41:07.027+0000 7f0ddce01640 10 monclient: dump: 2024-09-12T00:41:07.164 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:07.165 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:07.165 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.165 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.165 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:07.165 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:07.165 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:07.165 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:07.165 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:07.165 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.165 INFO:tasks.workunit.client.0.smithi043.stderr: -368> 2024-09-12T00:41:07.027+0000 7f0ddce01640 10 monclient: _finish_auth 0 2024-09-12T00:41:07.165 INFO:tasks.workunit.client.0.smithi043.stderr: -367> 2024-09-12T00:41:07.027+0000 7f0ddce01640 10 monclient: _check_auth_tickets 2024-09-12T00:41:07.165 INFO:tasks.workunit.client.0.smithi043.stderr: -366> 2024-09-12T00:41:07.027+0000 7f0ddce01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:07.165 INFO:tasks.workunit.client.0.smithi043.stderr: -365> 2024-09-12T00:41:07.027+0000 7f0ddce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:07.166 INFO:tasks.workunit.client.0.smithi043.stderr: -364> 2024-09-12T00:41:07.027+0000 7f0ddce01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:41:07.166 INFO:tasks.workunit.client.0.smithi043.stderr: -363> 2024-09-12T00:41:07.027+0000 7f0ddce01640 10 monclient: dump: 2024-09-12T00:41:07.166 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:07.166 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:07.166 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.166 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.166 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:07.166 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:07.166 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:07.166 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:07.166 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:07.166 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.166 INFO:tasks.workunit.client.0.smithi043.stderr: -362> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 monclient: authenticate success, global_id 7661 2024-09-12T00:41:07.167 INFO:tasks.workunit.client.0.smithi043.stderr: -361> 2024-09-12T00:41:07.027+0000 7f0ef188e640 4 set_mon_vals no callback set 2024-09-12T00:41:07.167 INFO:tasks.workunit.client.0.smithi043.stderr: -360> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient: _renew_subs 2024-09-12T00:41:07.167 INFO:tasks.workunit.client.0.smithi043.stderr: -359> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:41:07.167 INFO:tasks.workunit.client.0.smithi043.stderr: -358> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient: _renew_subs 2024-09-12T00:41:07.167 INFO:tasks.workunit.client.0.smithi043.stderr: -357> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:41:07.167 INFO:tasks.workunit.client.0.smithi043.stderr: -356> 2024-09-12T00:41:07.031+0000 7f0ddce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:41:07.167 INFO:tasks.workunit.client.0.smithi043.stderr: -355> 2024-09-12T00:41:07.031+0000 7f0ddce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:41:07.167 INFO:tasks.workunit.client.0.smithi043.stderr: -354> 2024-09-12T00:41:07.031+0000 7f0ddce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:41:07.167 INFO:tasks.workunit.client.0.smithi043.stderr: -353> 2024-09-12T00:41:07.031+0000 7f0ef2890640 10 monclient: get_auth_request con 0x7f0dcc070a20 auth_method 0 2024-09-12T00:41:07.168 INFO:tasks.workunit.client.0.smithi043.stderr: -352> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient: get_monmap_and_config 2024-09-12T00:41:07.168 INFO:tasks.workunit.client.0.smithi043.stderr: -351> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient: build_initial_monmap 2024-09-12T00:41:07.168 INFO:tasks.workunit.client.0.smithi043.stderr: -350> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 1 build_initial for_mkfs: 0 2024-09-12T00:41:07.168 INFO:tasks.workunit.client.0.smithi043.stderr: -349> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient: monmap: 2024-09-12T00:41:07.168 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:41:07.168 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:41:07.168 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:41:07.168 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:41:07.168 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:41:07.168 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:07.168 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:41:07.168 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:41:07.168 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:41:07.169 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.169 INFO:tasks.workunit.client.0.smithi043.stderr: -348> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b4b0) adding auth protocol: cephx 2024-09-12T00:41:07.169 INFO:tasks.workunit.client.0.smithi043.stderr: -347> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b4b0) adding auth protocol: cephx 2024-09-12T00:41:07.169 INFO:tasks.workunit.client.0.smithi043.stderr: -346> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b4b0) adding auth protocol: cephx 2024-09-12T00:41:07.169 INFO:tasks.workunit.client.0.smithi043.stderr: -345> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b4b0) adding con mode: secure 2024-09-12T00:41:07.169 INFO:tasks.workunit.client.0.smithi043.stderr: -344> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b4b0) adding con mode: crc 2024-09-12T00:41:07.169 INFO:tasks.workunit.client.0.smithi043.stderr: -343> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b4b0) adding con mode: secure 2024-09-12T00:41:07.169 INFO:tasks.workunit.client.0.smithi043.stderr: -342> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b4b0) adding con mode: crc 2024-09-12T00:41:07.169 INFO:tasks.workunit.client.0.smithi043.stderr: -341> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b4b0) adding con mode: secure 2024-09-12T00:41:07.169 INFO:tasks.workunit.client.0.smithi043.stderr: -340> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b4b0) adding con mode: crc 2024-09-12T00:41:07.169 INFO:tasks.workunit.client.0.smithi043.stderr: -339> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b4b0) adding con mode: crc 2024-09-12T00:41:07.169 INFO:tasks.workunit.client.0.smithi043.stderr: -338> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b4b0) adding con mode: secure 2024-09-12T00:41:07.170 INFO:tasks.workunit.client.0.smithi043.stderr: -337> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b4b0) adding con mode: crc 2024-09-12T00:41:07.170 INFO:tasks.workunit.client.0.smithi043.stderr: -336> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b4b0) adding con mode: secure 2024-09-12T00:41:07.170 INFO:tasks.workunit.client.0.smithi043.stderr: -335> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b4b0) adding con mode: crc 2024-09-12T00:41:07.170 INFO:tasks.workunit.client.0.smithi043.stderr: -334> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b4b0) adding con mode: secure 2024-09-12T00:41:07.170 INFO:tasks.workunit.client.0.smithi043.stderr: -333> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:07.170 INFO:tasks.workunit.client.0.smithi043.stderr: -332> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient: init 2024-09-12T00:41:07.170 INFO:tasks.workunit.client.0.smithi043.stderr: -331> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed3c0) adding auth protocol: cephx 2024-09-12T00:41:07.170 INFO:tasks.workunit.client.0.smithi043.stderr: -330> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed3c0) adding auth protocol: cephx 2024-09-12T00:41:07.170 INFO:tasks.workunit.client.0.smithi043.stderr: -329> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed3c0) adding auth protocol: cephx 2024-09-12T00:41:07.170 INFO:tasks.workunit.client.0.smithi043.stderr: -328> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed3c0) adding con mode: secure 2024-09-12T00:41:07.170 INFO:tasks.workunit.client.0.smithi043.stderr: -327> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed3c0) adding con mode: crc 2024-09-12T00:41:07.170 INFO:tasks.workunit.client.0.smithi043.stderr: -326> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed3c0) adding con mode: secure 2024-09-12T00:41:07.170 INFO:tasks.workunit.client.0.smithi043.stderr: -325> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed3c0) adding con mode: crc 2024-09-12T00:41:07.170 INFO:tasks.workunit.client.0.smithi043.stderr: -324> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed3c0) adding con mode: secure 2024-09-12T00:41:07.171 INFO:tasks.workunit.client.0.smithi043.stderr: -323> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed3c0) adding con mode: crc 2024-09-12T00:41:07.171 INFO:tasks.workunit.client.0.smithi043.stderr: -322> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed3c0) adding con mode: crc 2024-09-12T00:41:07.171 INFO:tasks.workunit.client.0.smithi043.stderr: -321> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed3c0) adding con mode: secure 2024-09-12T00:41:07.171 INFO:tasks.workunit.client.0.smithi043.stderr: -320> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed3c0) adding con mode: crc 2024-09-12T00:41:07.171 INFO:tasks.workunit.client.0.smithi043.stderr: -319> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed3c0) adding con mode: secure 2024-09-12T00:41:07.171 INFO:tasks.workunit.client.0.smithi043.stderr: -318> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed3c0) adding con mode: crc 2024-09-12T00:41:07.172 INFO:tasks.workunit.client.0.smithi043.stderr: -317> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed3c0) adding con mode: secure 2024-09-12T00:41:07.172 INFO:tasks.workunit.client.0.smithi043.stderr: -316> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:07.172 INFO:tasks.workunit.client.0.smithi043.stderr: -315> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:07.172 INFO:tasks.workunit.client.0.smithi043.stderr: -314> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 asok(0x563fa59732b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe7f4ed508 EEXIST 2024-09-12T00:41:07.172 INFO:tasks.workunit.client.0.smithi043.stderr: -313> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:07.172 INFO:tasks.workunit.client.0.smithi043.stderr: -312> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:41:07.172 INFO:tasks.workunit.client.0.smithi043.stderr: -311> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient(hunting): picked mon.noname-c con 0x563fa5c1f560 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:41:07.172 INFO:tasks.workunit.client.0.smithi043.stderr: -310> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient(hunting): picked mon.noname-b con 0x563fa5c403c0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:41:07.172 INFO:tasks.workunit.client.0.smithi043.stderr: -309> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient(hunting): picked mon.noname-a con 0x563fa5c4ad40 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:41:07.172 INFO:tasks.workunit.client.0.smithi043.stderr: -308> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:07.173 INFO:tasks.workunit.client.0.smithi043.stderr: -307> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:07.173 INFO:tasks.workunit.client.0.smithi043.stderr: -306> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:07.173 INFO:tasks.workunit.client.0.smithi043.stderr: -305> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:07.173 INFO:tasks.workunit.client.0.smithi043.stderr: -304> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient(hunting): authenticate will time out at 2363.022572s 2024-09-12T00:41:07.173 INFO:tasks.workunit.client.0.smithi043.stderr: -303> 2024-09-12T00:41:07.031+0000 7f0ef2890640 10 monclient(hunting): get_auth_request con 0x563fa5c1f560 auth_method 0 2024-09-12T00:41:07.173 INFO:tasks.workunit.client.0.smithi043.stderr: -302> 2024-09-12T00:41:07.031+0000 7f0ef2890640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:07.173 INFO:tasks.workunit.client.0.smithi043.stderr: -301> 2024-09-12T00:41:07.031+0000 7f0ef2890640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:07.173 INFO:tasks.workunit.client.0.smithi043.stderr: -300> 2024-09-12T00:41:07.031+0000 7f0ef2890640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:07.173 INFO:tasks.workunit.client.0.smithi043.stderr: -299> 2024-09-12T00:41:07.031+0000 7f0ef3091640 10 monclient(hunting): get_auth_request con 0x563fa5c4ad40 auth_method 0 2024-09-12T00:41:07.174 INFO:tasks.workunit.client.0.smithi043.stderr: -298> 2024-09-12T00:41:07.031+0000 7f0ef3091640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:07.174 INFO:tasks.workunit.client.0.smithi043.stderr: -297> 2024-09-12T00:41:07.031+0000 7f0ef3091640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:07.174 INFO:tasks.workunit.client.0.smithi043.stderr: -296> 2024-09-12T00:41:07.031+0000 7f0ef3091640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:07.174 INFO:tasks.workunit.client.0.smithi043.stderr: -295> 2024-09-12T00:41:07.031+0000 7f0ef2890640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:07.175 INFO:tasks.workunit.client.0.smithi043.stderr: -294> 2024-09-12T00:41:07.031+0000 7f0ef2890640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:07.175 INFO:tasks.workunit.client.0.smithi043.stderr: -293> 2024-09-12T00:41:07.031+0000 7f0ef2890640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:07.175 INFO:tasks.workunit.client.0.smithi043.stderr: -292> 2024-09-12T00:41:07.031+0000 7f0ef3091640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:07.175 INFO:tasks.workunit.client.0.smithi043.stderr: -291> 2024-09-12T00:41:07.031+0000 7f0ef3091640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:07.175 INFO:tasks.workunit.client.0.smithi043.stderr: -290> 2024-09-12T00:41:07.031+0000 7f0ef3091640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:07.175 INFO:tasks.workunit.client.0.smithi043.stderr: -289> 2024-09-12T00:41:07.031+0000 7f0ef2890640 10 monclient(hunting): handle_auth_done global_id 7664 payload 274 2024-09-12T00:41:07.175 INFO:tasks.workunit.client.0.smithi043.stderr: -288> 2024-09-12T00:41:07.031+0000 7f0ef2890640 10 monclient: _finish_hunting 0 2024-09-12T00:41:07.175 INFO:tasks.workunit.client.0.smithi043.stderr: -287> 2024-09-12T00:41:07.031+0000 7f0ef2890640 1 monclient: found mon.noname-c 2024-09-12T00:41:07.175 INFO:tasks.workunit.client.0.smithi043.stderr: -286> 2024-09-12T00:41:07.031+0000 7f0ef2890640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:41:07.175 INFO:tasks.workunit.client.0.smithi043.stderr: -285> 2024-09-12T00:41:07.031+0000 7f0dd67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:07.176 INFO:tasks.workunit.client.0.smithi043.stderr: -284> 2024-09-12T00:41:07.031+0000 7f0dd67fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:41:07.176 INFO:tasks.workunit.client.0.smithi043.stderr: -283> 2024-09-12T00:41:07.031+0000 7f0dd67fc640 10 monclient: dump: 2024-09-12T00:41:07.176 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:07.176 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:07.176 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.176 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.176 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:07.176 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:07.176 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:07.176 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:07.176 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:07.177 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.177 INFO:tasks.workunit.client.0.smithi043.stderr: -282> 2024-09-12T00:41:07.031+0000 7f0dd67fc640 10 monclient: _finish_auth 0 2024-09-12T00:41:07.177 INFO:tasks.workunit.client.0.smithi043.stderr: -281> 2024-09-12T00:41:07.031+0000 7f0dd67fc640 10 monclient: _check_auth_tickets 2024-09-12T00:41:07.177 INFO:tasks.workunit.client.0.smithi043.stderr: -280> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 monclient: authenticate success, global_id 7664 2024-09-12T00:41:07.177 INFO:tasks.workunit.client.0.smithi043.stderr: -279> 2024-09-12T00:41:07.031+0000 7f0dd67fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:07.177 INFO:tasks.workunit.client.0.smithi043.stderr: -278> 2024-09-12T00:41:07.031+0000 7f0dd67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:07.177 INFO:tasks.workunit.client.0.smithi043.stderr: -277> 2024-09-12T00:41:07.031+0000 7f0dd67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:41:07.177 INFO:tasks.workunit.client.0.smithi043.stderr: -276> 2024-09-12T00:41:07.031+0000 7f0dd67fc640 10 monclient: dump: 2024-09-12T00:41:07.177 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:07.177 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:07.177 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.178 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.178 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:07.178 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:07.178 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:07.178 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:07.178 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:07.178 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.178 INFO:tasks.workunit.client.0.smithi043.stderr: -275> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:41:07.178 INFO:tasks.workunit.client.0.smithi043.stderr: -274> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 4 set_mon_vals no callback set 2024-09-12T00:41:07.178 INFO:tasks.workunit.client.0.smithi043.stderr: -273> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient: shutdown 2024-09-12T00:41:07.178 INFO:tasks.workunit.client.0.smithi043.stderr: -272> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient: build_initial_monmap 2024-09-12T00:41:07.179 INFO:tasks.workunit.client.0.smithi043.stderr: -271> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 1 build_initial for_mkfs: 0 2024-09-12T00:41:07.179 INFO:tasks.workunit.client.0.smithi043.stderr: -270> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient: monmap: 2024-09-12T00:41:07.179 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:41:07.179 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:41:07.179 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:41:07.179 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:41:07.179 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:41:07.179 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:07.179 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:41:07.179 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:41:07.179 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:41:07.180 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.180 INFO:tasks.workunit.client.0.smithi043.stderr: -269> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b460) adding auth protocol: cephx 2024-09-12T00:41:07.180 INFO:tasks.workunit.client.0.smithi043.stderr: -268> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b460) adding auth protocol: cephx 2024-09-12T00:41:07.180 INFO:tasks.workunit.client.0.smithi043.stderr: -267> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b460) adding auth protocol: cephx 2024-09-12T00:41:07.180 INFO:tasks.workunit.client.0.smithi043.stderr: -266> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b460) adding con mode: secure 2024-09-12T00:41:07.180 INFO:tasks.workunit.client.0.smithi043.stderr: -265> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b460) adding con mode: crc 2024-09-12T00:41:07.180 INFO:tasks.workunit.client.0.smithi043.stderr: -264> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b460) adding con mode: secure 2024-09-12T00:41:07.180 INFO:tasks.workunit.client.0.smithi043.stderr: -263> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b460) adding con mode: crc 2024-09-12T00:41:07.180 INFO:tasks.workunit.client.0.smithi043.stderr: -262> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b460) adding con mode: secure 2024-09-12T00:41:07.180 INFO:tasks.workunit.client.0.smithi043.stderr: -261> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b460) adding con mode: crc 2024-09-12T00:41:07.181 INFO:tasks.workunit.client.0.smithi043.stderr: -260> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b460) adding con mode: crc 2024-09-12T00:41:07.181 INFO:tasks.workunit.client.0.smithi043.stderr: -259> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b460) adding con mode: secure 2024-09-12T00:41:07.181 INFO:tasks.workunit.client.0.smithi043.stderr: -258> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b460) adding con mode: crc 2024-09-12T00:41:07.181 INFO:tasks.workunit.client.0.smithi043.stderr: -257> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b460) adding con mode: secure 2024-09-12T00:41:07.181 INFO:tasks.workunit.client.0.smithi043.stderr: -256> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b460) adding con mode: crc 2024-09-12T00:41:07.181 INFO:tasks.workunit.client.0.smithi043.stderr: -255> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b460) adding con mode: secure 2024-09-12T00:41:07.181 INFO:tasks.workunit.client.0.smithi043.stderr: -254> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:07.181 INFO:tasks.workunit.client.0.smithi043.stderr: -253> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 1 librados: starting msgr at 2024-09-12T00:41:07.181 INFO:tasks.workunit.client.0.smithi043.stderr: -252> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 1 librados: starting objecter 2024-09-12T00:41:07.182 INFO:tasks.workunit.client.0.smithi043.stderr: -251> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 asok(0x563fa59732b0) register_command objecter_requests cmddesc objecter_requests hook 0x563fa5c1d740 EEXIST 2024-09-12T00:41:07.182 INFO:tasks.workunit.client.0.smithi043.stderr: -250> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 1 librados: setting wanted keys 2024-09-12T00:41:07.182 INFO:tasks.workunit.client.0.smithi043.stderr: -249> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 1 librados: calling monclient init 2024-09-12T00:41:07.182 INFO:tasks.workunit.client.0.smithi043.stderr: -248> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient: init 2024-09-12T00:41:07.182 INFO:tasks.workunit.client.0.smithi043.stderr: -247> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bfd900) adding auth protocol: cephx 2024-09-12T00:41:07.182 INFO:tasks.workunit.client.0.smithi043.stderr: -246> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bfd900) adding auth protocol: cephx 2024-09-12T00:41:07.182 INFO:tasks.workunit.client.0.smithi043.stderr: -245> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bfd900) adding auth protocol: cephx 2024-09-12T00:41:07.182 INFO:tasks.workunit.client.0.smithi043.stderr: -244> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bfd900) adding con mode: secure 2024-09-12T00:41:07.182 INFO:tasks.workunit.client.0.smithi043.stderr: -243> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bfd900) adding con mode: crc 2024-09-12T00:41:07.182 INFO:tasks.workunit.client.0.smithi043.stderr: -242> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bfd900) adding con mode: secure 2024-09-12T00:41:07.183 INFO:tasks.workunit.client.0.smithi043.stderr: -241> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bfd900) adding con mode: crc 2024-09-12T00:41:07.183 INFO:tasks.workunit.client.0.smithi043.stderr: -240> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bfd900) adding con mode: secure 2024-09-12T00:41:07.183 INFO:tasks.workunit.client.0.smithi043.stderr: -239> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bfd900) adding con mode: crc 2024-09-12T00:41:07.183 INFO:tasks.workunit.client.0.smithi043.stderr: -238> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bfd900) adding con mode: crc 2024-09-12T00:41:07.183 INFO:tasks.workunit.client.0.smithi043.stderr: -237> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bfd900) adding con mode: secure 2024-09-12T00:41:07.183 INFO:tasks.workunit.client.0.smithi043.stderr: -236> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bfd900) adding con mode: crc 2024-09-12T00:41:07.183 INFO:tasks.workunit.client.0.smithi043.stderr: -235> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bfd900) adding con mode: secure 2024-09-12T00:41:07.183 INFO:tasks.workunit.client.0.smithi043.stderr: -234> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bfd900) adding con mode: crc 2024-09-12T00:41:07.184 INFO:tasks.workunit.client.0.smithi043.stderr: -233> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bfd900) adding con mode: secure 2024-09-12T00:41:07.184 INFO:tasks.workunit.client.0.smithi043.stderr: -232> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:07.184 INFO:tasks.workunit.client.0.smithi043.stderr: -231> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:07.184 INFO:tasks.workunit.client.0.smithi043.stderr: -230> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 asok(0x563fa59732b0) register_command rotate-key cmddesc rotate-key hook 0x563fa5bfda48 EEXIST 2024-09-12T00:41:07.184 INFO:tasks.workunit.client.0.smithi043.stderr: -229> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:07.184 INFO:tasks.workunit.client.0.smithi043.stderr: -228> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:41:07.184 INFO:tasks.workunit.client.0.smithi043.stderr: -227> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient(hunting): picked mon.noname-c con 0x563fa5c1f560 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:41:07.184 INFO:tasks.workunit.client.0.smithi043.stderr: -226> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient(hunting): picked mon.noname-b con 0x563fa5c403c0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:41:07.184 INFO:tasks.workunit.client.0.smithi043.stderr: -225> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient(hunting): picked mon.noname-a con 0x563fa5c4ad40 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:41:07.184 INFO:tasks.workunit.client.0.smithi043.stderr: -224> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:07.184 INFO:tasks.workunit.client.0.smithi043.stderr: -223> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:07.185 INFO:tasks.workunit.client.0.smithi043.stderr: -222> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:07.185 INFO:tasks.workunit.client.0.smithi043.stderr: -221> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:07.185 INFO:tasks.workunit.client.0.smithi043.stderr: -220> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient(hunting): authenticate will time out at 2363.025341s 2024-09-12T00:41:07.185 INFO:tasks.workunit.client.0.smithi043.stderr: -219> 2024-09-12T00:41:07.035+0000 7f0ef2890640 10 monclient(hunting): get_auth_request con 0x563fa5c1f560 auth_method 0 2024-09-12T00:41:07.185 INFO:tasks.workunit.client.0.smithi043.stderr: -218> 2024-09-12T00:41:07.035+0000 7f0ef2890640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:07.185 INFO:tasks.workunit.client.0.smithi043.stderr: -217> 2024-09-12T00:41:07.035+0000 7f0ef2890640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:07.185 INFO:tasks.workunit.client.0.smithi043.stderr: -216> 2024-09-12T00:41:07.035+0000 7f0ef2890640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:07.185 INFO:tasks.workunit.client.0.smithi043.stderr: -215> 2024-09-12T00:41:07.035+0000 7f0ef3091640 10 monclient(hunting): get_auth_request con 0x563fa5c4ad40 auth_method 0 2024-09-12T00:41:07.185 INFO:tasks.workunit.client.0.smithi043.stderr: -214> 2024-09-12T00:41:07.035+0000 7f0ef3091640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:07.185 INFO:tasks.workunit.client.0.smithi043.stderr: -213> 2024-09-12T00:41:07.035+0000 7f0ef3091640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:07.185 INFO:tasks.workunit.client.0.smithi043.stderr: -212> 2024-09-12T00:41:07.035+0000 7f0ef3091640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:07.185 INFO:tasks.workunit.client.0.smithi043.stderr: -211> 2024-09-12T00:41:07.035+0000 7f0ef2890640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:07.186 INFO:tasks.workunit.client.0.smithi043.stderr: -210> 2024-09-12T00:41:07.035+0000 7f0ef2890640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:07.186 INFO:tasks.workunit.client.0.smithi043.stderr: -209> 2024-09-12T00:41:07.035+0000 7f0ef2890640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:07.186 INFO:tasks.workunit.client.0.smithi043.stderr: -208> 2024-09-12T00:41:07.035+0000 7f0ef3091640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:07.186 INFO:tasks.workunit.client.0.smithi043.stderr: -207> 2024-09-12T00:41:07.035+0000 7f0ef3091640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:07.186 INFO:tasks.workunit.client.0.smithi043.stderr: -206> 2024-09-12T00:41:07.035+0000 7f0ef3091640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:07.186 INFO:tasks.workunit.client.0.smithi043.stderr: -205> 2024-09-12T00:41:07.035+0000 7f0ef208f640 10 monclient(hunting): get_auth_request con 0x563fa5c403c0 auth_method 0 2024-09-12T00:41:07.186 INFO:tasks.workunit.client.0.smithi043.stderr: -204> 2024-09-12T00:41:07.035+0000 7f0ef208f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:07.186 INFO:tasks.workunit.client.0.smithi043.stderr: -203> 2024-09-12T00:41:07.035+0000 7f0ef208f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:07.186 INFO:tasks.workunit.client.0.smithi043.stderr: -202> 2024-09-12T00:41:07.035+0000 7f0ef208f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:07.186 INFO:tasks.workunit.client.0.smithi043.stderr: -201> 2024-09-12T00:41:07.035+0000 7f0ef2890640 10 monclient(hunting): handle_auth_done global_id 7667 payload 824 2024-09-12T00:41:07.186 INFO:tasks.workunit.client.0.smithi043.stderr: -200> 2024-09-12T00:41:07.035+0000 7f0ef2890640 10 monclient: _finish_hunting 0 2024-09-12T00:41:07.186 INFO:tasks.workunit.client.0.smithi043.stderr: -199> 2024-09-12T00:41:07.035+0000 7f0ef2890640 1 monclient: found mon.noname-c 2024-09-12T00:41:07.187 INFO:tasks.workunit.client.0.smithi043.stderr: -198> 2024-09-12T00:41:07.035+0000 7f0ef2890640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:41:07.187 INFO:tasks.workunit.client.0.smithi043.stderr: -197> 2024-09-12T00:41:07.035+0000 7f0dd4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:07.187 INFO:tasks.workunit.client.0.smithi043.stderr: -196> 2024-09-12T00:41:07.035+0000 7f0dd4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:41:07.187 INFO:tasks.workunit.client.0.smithi043.stderr: -195> 2024-09-12T00:41:07.035+0000 7f0dd4ff9640 10 monclient: dump: 2024-09-12T00:41:07.187 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:07.187 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:07.187 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.187 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.187 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:07.187 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:07.187 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:07.187 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:07.188 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:07.188 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.188 INFO:tasks.workunit.client.0.smithi043.stderr: -194> 2024-09-12T00:41:07.035+0000 7f0dd4ff9640 10 monclient: _finish_auth 0 2024-09-12T00:41:07.188 INFO:tasks.workunit.client.0.smithi043.stderr: -193> 2024-09-12T00:41:07.035+0000 7f0dd4ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:41:07.188 INFO:tasks.workunit.client.0.smithi043.stderr: -192> 2024-09-12T00:41:07.035+0000 7f0dd4ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:07.188 INFO:tasks.workunit.client.0.smithi043.stderr: -191> 2024-09-12T00:41:07.035+0000 7f0dd4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:07.188 INFO:tasks.workunit.client.0.smithi043.stderr: -190> 2024-09-12T00:41:07.035+0000 7f0dd4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:41:07.188 INFO:tasks.workunit.client.0.smithi043.stderr: -189> 2024-09-12T00:41:07.035+0000 7f0dd4ff9640 10 monclient: dump: 2024-09-12T00:41:07.188 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:07.188 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:07.188 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.189 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.189 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:07.189 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:07.189 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:07.189 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:07.189 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:07.189 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.189 INFO:tasks.workunit.client.0.smithi043.stderr: -188> 2024-09-12T00:41:07.035+0000 7f0dd67fc640 4 set_mon_vals no callback set 2024-09-12T00:41:07.189 INFO:tasks.workunit.client.0.smithi043.stderr: -187> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 monclient: authenticate success, global_id 7667 2024-09-12T00:41:07.189 INFO:tasks.workunit.client.0.smithi043.stderr: -186> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient: _renew_subs 2024-09-12T00:41:07.189 INFO:tasks.workunit.client.0.smithi043.stderr: -185> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:41:07.190 INFO:tasks.workunit.client.0.smithi043.stderr: -184> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient: _renew_subs 2024-09-12T00:41:07.190 INFO:tasks.workunit.client.0.smithi043.stderr: -183> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:41:07.190 INFO:tasks.workunit.client.0.smithi043.stderr: -182> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 1 librados: init done 2024-09-12T00:41:07.190 INFO:tasks.workunit.client.0.smithi043.stderr: -181> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 asok(0x563fa59732b0) register_command cr dump hook 0x563fa5c3e718 2024-09-12T00:41:07.190 INFO:tasks.workunit.client.0.smithi043.stderr: -180> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.190 INFO:tasks.workunit.client.0.smithi043.stderr: -179> 2024-09-12T00:41:07.039+0000 7f0dd4ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:41:07.190 INFO:tasks.workunit.client.0.smithi043.stderr: -178> 2024-09-12T00:41:07.039+0000 7f0dd4ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:41:07.190 INFO:tasks.workunit.client.0.smithi043.stderr: -177> 2024-09-12T00:41:07.039+0000 7f0dd4ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:41:07.190 INFO:tasks.workunit.client.0.smithi043.stderr: -176> 2024-09-12T00:41:07.039+0000 7f0ef208f640 10 monclient: get_auth_request con 0x7f0dbc070ae0 auth_method 0 2024-09-12T00:41:07.190 INFO:tasks.workunit.client.0.smithi043.stderr: -175> 2024-09-12T00:41:07.039+0000 7f0ef3091640 10 monclient: get_auth_request con 0x563fa5c69400 auth_method 0 2024-09-12T00:41:07.190 INFO:tasks.workunit.client.0.smithi043.stderr: -174> 2024-09-12T00:41:07.039+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.191 INFO:tasks.workunit.client.0.smithi043.stderr: -173> 2024-09-12T00:41:07.039+0000 7f0ef4d8a9c0 20 realm 2024-09-12T00:41:07.191 INFO:tasks.workunit.client.0.smithi043.stderr: -172> 2024-09-12T00:41:07.039+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.191 INFO:tasks.workunit.client.0.smithi043.stderr: -171> 2024-09-12T00:41:07.039+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.191 INFO:tasks.workunit.client.0.smithi043.stderr: -170> 2024-09-12T00:41:07.039+0000 7f0ef4d8a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:07.191 INFO:tasks.workunit.client.0.smithi043.stderr: -169> 2024-09-12T00:41:07.039+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.191 INFO:tasks.workunit.client.0.smithi043.stderr: -168> 2024-09-12T00:41:07.039+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.191 INFO:tasks.workunit.client.0.smithi043.stderr: -167> 2024-09-12T00:41:07.039+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.191 INFO:tasks.workunit.client.0.smithi043.stderr: -166> 2024-09-12T00:41:07.039+0000 7f0ef2890640 10 monclient: get_auth_request con 0x563fa5c6d7b0 auth_method 0 2024-09-12T00:41:07.191 INFO:tasks.workunit.client.0.smithi043.stderr: -165> 2024-09-12T00:41:07.039+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:07.191 INFO:tasks.workunit.client.0.smithi043.stderr: -164> 2024-09-12T00:41:07.039+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.191 INFO:tasks.workunit.client.0.smithi043.stderr: -163> 2024-09-12T00:41:07.039+0000 7f0ef208f640 10 monclient: get_auth_request con 0x563fa5c70ed0 auth_method 0 2024-09-12T00:41:07.191 INFO:tasks.workunit.client.0.smithi043.stderr: -162> 2024-09-12T00:41:07.043+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:07.191 INFO:tasks.workunit.client.0.smithi043.stderr: -161> 2024-09-12T00:41:07.043+0000 7f0ef4d8a9c0 20 searching for the correct realm 2024-09-12T00:41:07.192 INFO:tasks.workunit.client.0.smithi043.stderr: -160> 2024-09-12T00:41:07.043+0000 7f0ef3091640 10 monclient: get_auth_request con 0x563fa5c75c90 auth_method 0 2024-09-12T00:41:07.192 INFO:tasks.workunit.client.0.smithi043.stderr: -159> 2024-09-12T00:41:07.043+0000 7f0ef2890640 10 monclient: get_auth_request con 0x7f0eec086120 auth_method 0 2024-09-12T00:41:07.192 INFO:tasks.workunit.client.0.smithi043.stderr: -158> 2024-09-12T00:41:07.043+0000 7f0ef208f640 10 monclient: get_auth_request con 0x7f0ee80e0040 auth_method 0 2024-09-12T00:41:07.192 INFO:tasks.workunit.client.0.smithi043.stderr: -157> 2024-09-12T00:41:07.047+0000 7f0ef3091640 0 -- 172.21.15.43:0/3869858544 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x563fa5c69400 msgr2=0x563fa5c6b8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:41:07.192 INFO:tasks.workunit.client.0.smithi043.stderr: -156> 2024-09-12T00:41:07.047+0000 7f0dd4ff9640 1 client.7667.objecter ms_handle_reset 0x563fa5c69400 session 0x563fa5c68d30 osd.1 2024-09-12T00:41:07.192 INFO:tasks.workunit.client.0.smithi043.stderr: -155> 2024-09-12T00:41:07.047+0000 7f0dd4ff9640 10 monclient: _renew_subs 2024-09-12T00:41:07.192 INFO:tasks.workunit.client.0.smithi043.stderr: -154> 2024-09-12T00:41:07.047+0000 7f0dd4ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:41:07.192 INFO:tasks.workunit.client.0.smithi043.stderr: -153> 2024-09-12T00:41:07.047+0000 7f0ef3091640 10 monclient: get_auth_request con 0x7f0dbc080b00 auth_method 0 2024-09-12T00:41:07.192 INFO:tasks.workunit.client.0.smithi043.stderr: -152> 2024-09-12T00:41:07.047+0000 7f0ef3091640 10 monclient: get_auth_request con 0x7f0ee80e1b90 auth_method 0 2024-09-12T00:41:07.192 INFO:tasks.workunit.client.0.smithi043.stderr: -151> 2024-09-12T00:41:07.051+0000 7f0ef2890640 10 monclient: get_auth_request con 0x7f0ee80d2910 auth_method 0 2024-09-12T00:41:07.192 INFO:tasks.workunit.client.0.smithi043.stderr: -150> 2024-09-12T00:41:07.055+0000 7f0ef2890640 0 -- 172.21.15.43:0/3869858544 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f0ee80d2910 msgr2=0x7f0ee80f33f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:07.193 INFO:tasks.workunit.client.0.smithi043.stderr: -149> 2024-09-12T00:41:07.055+0000 7f0dd4ff9640 1 client.7667.objecter ms_handle_reset 0x7f0ee80d2910 session 0x7f0ee80dfe60 osd.0 2024-09-12T00:41:07.193 INFO:tasks.workunit.client.0.smithi043.stderr: -148> 2024-09-12T00:41:07.055+0000 7f0ef2890640 10 monclient: get_auth_request con 0x563fa5c69400 auth_method 0 2024-09-12T00:41:07.193 INFO:tasks.workunit.client.0.smithi043.stderr: -147> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:41:07.193 INFO:tasks.workunit.client.0.smithi043.stderr: -146> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:07.193 INFO:tasks.workunit.client.0.smithi043.stderr: -145> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:07.193 INFO:tasks.workunit.client.0.smithi043.stderr: -144> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:41:07.193 INFO:tasks.workunit.client.0.smithi043.stderr: -143> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:07.193 INFO:tasks.workunit.client.0.smithi043.stderr: -142> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:07.193 INFO:tasks.workunit.client.0.smithi043.stderr: -141> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.193 INFO:tasks.workunit.client.0.smithi043.stderr: -140> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.193 INFO:tasks.workunit.client.0.smithi043.stderr: -139> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.193 INFO:tasks.workunit.client.0.smithi043.stderr: -138> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:07.193 INFO:tasks.workunit.client.0.smithi043.stderr: -137> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.194 INFO:tasks.workunit.client.0.smithi043.stderr: -136> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:07.194 INFO:tasks.workunit.client.0.smithi043.stderr: -135> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 zone default found 2024-09-12T00:41:07.194 INFO:tasks.workunit.client.0.smithi043.stderr: -134> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 4 Realm: () 2024-09-12T00:41:07.194 INFO:tasks.workunit.client.0.smithi043.stderr: -133> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:41:07.194 INFO:tasks.workunit.client.0.smithi043.stderr: -132> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:41:07.194 INFO:tasks.workunit.client.0.smithi043.stderr: -131> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:07.194 INFO:tasks.workunit.client.0.smithi043.stderr: -130> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 zonegroup default 2024-09-12T00:41:07.194 INFO:tasks.workunit.client.0.smithi043.stderr: -129> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.194 INFO:tasks.workunit.client.0.smithi043.stderr: -128> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.194 INFO:tasks.workunit.client.0.smithi043.stderr: -127> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.194 INFO:tasks.workunit.client.0.smithi043.stderr: -126> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.195 INFO:tasks.workunit.client.0.smithi043.stderr: -125> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.195 INFO:tasks.workunit.client.0.smithi043.stderr: -124> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.195 INFO:tasks.workunit.client.0.smithi043.stderr: -123> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 started sync module instance, tier type = 2024-09-12T00:41:07.195 INFO:tasks.workunit.client.0.smithi043.stderr: -122> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:41:07.195 INFO:tasks.workunit.client.0.smithi043.stderr: -121> 2024-09-12T00:41:07.079+0000 7f0ef4d8a9c0 20 add_watcher() i=0 2024-09-12T00:41:07.195 INFO:tasks.workunit.client.0.smithi043.stderr: -120> 2024-09-12T00:41:07.079+0000 7f0ef4d8a9c0 20 add_watcher() i=1 2024-09-12T00:41:07.195 INFO:tasks.workunit.client.0.smithi043.stderr: -119> 2024-09-12T00:41:07.079+0000 7f0ef4d8a9c0 20 add_watcher() i=2 2024-09-12T00:41:07.195 INFO:tasks.workunit.client.0.smithi043.stderr: -118> 2024-09-12T00:41:07.079+0000 7f0ef4d8a9c0 20 add_watcher() i=3 2024-09-12T00:41:07.195 INFO:tasks.workunit.client.0.smithi043.stderr: -117> 2024-09-12T00:41:07.079+0000 7f0ef4d8a9c0 20 add_watcher() i=4 2024-09-12T00:41:07.195 INFO:tasks.workunit.client.0.smithi043.stderr: -116> 2024-09-12T00:41:07.079+0000 7f0ef4d8a9c0 20 add_watcher() i=5 2024-09-12T00:41:07.195 INFO:tasks.workunit.client.0.smithi043.stderr: -115> 2024-09-12T00:41:07.083+0000 7f0ef4d8a9c0 20 add_watcher() i=6 2024-09-12T00:41:07.195 INFO:tasks.workunit.client.0.smithi043.stderr: -114> 2024-09-12T00:41:07.083+0000 7f0ef4d8a9c0 20 add_watcher() i=7 2024-09-12T00:41:07.196 INFO:tasks.workunit.client.0.smithi043.stderr: -113> 2024-09-12T00:41:07.083+0000 7f0ef4d8a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:07.196 INFO:tasks.workunit.client.0.smithi043.stderr: -112> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed8a0) adding auth protocol: cephx 2024-09-12T00:41:07.196 INFO:tasks.workunit.client.0.smithi043.stderr: -111> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed8a0) adding auth protocol: cephx 2024-09-12T00:41:07.196 INFO:tasks.workunit.client.0.smithi043.stderr: -110> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed8a0) adding auth protocol: cephx 2024-09-12T00:41:07.196 INFO:tasks.workunit.client.0.smithi043.stderr: -109> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed8a0) adding con mode: secure 2024-09-12T00:41:07.196 INFO:tasks.workunit.client.0.smithi043.stderr: -108> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed8a0) adding con mode: crc 2024-09-12T00:41:07.196 INFO:tasks.workunit.client.0.smithi043.stderr: -107> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed8a0) adding con mode: secure 2024-09-12T00:41:07.196 INFO:tasks.workunit.client.0.smithi043.stderr: -106> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed8a0) adding con mode: crc 2024-09-12T00:41:07.196 INFO:tasks.workunit.client.0.smithi043.stderr: -105> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed8a0) adding con mode: secure 2024-09-12T00:41:07.196 INFO:tasks.workunit.client.0.smithi043.stderr: -104> 2024-09-12T00:41:07.087+0000 7f0da97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:07.196 INFO:tasks.workunit.client.0.smithi043.stderr: -103> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed8a0) adding con mode: crc 2024-09-12T00:41:07.197 INFO:tasks.workunit.client.0.smithi043.stderr: -102> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed8a0) adding con mode: crc 2024-09-12T00:41:07.197 INFO:tasks.workunit.client.0.smithi043.stderr: -101> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed8a0) adding con mode: secure 2024-09-12T00:41:07.197 INFO:tasks.workunit.client.0.smithi043.stderr: -100> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed8a0) adding con mode: crc 2024-09-12T00:41:07.197 INFO:tasks.workunit.client.0.smithi043.stderr: -99> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed8a0) adding con mode: secure 2024-09-12T00:41:07.197 INFO:tasks.workunit.client.0.smithi043.stderr: -98> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed8a0) adding con mode: crc 2024-09-12T00:41:07.197 INFO:tasks.workunit.client.0.smithi043.stderr: -97> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed8a0) adding con mode: secure 2024-09-12T00:41:07.197 INFO:tasks.workunit.client.0.smithi043.stderr: -96> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:07.197 INFO:tasks.workunit.client.0.smithi043.stderr: -95> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:07.197 INFO:tasks.workunit.client.0.smithi043.stderr: -94> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:07.197 INFO:tasks.workunit.client.0.smithi043.stderr: -93> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 asok(0x563fa59732b0) register_command cache list hook 0x563fa5c43880 2024-09-12T00:41:07.198 INFO:tasks.workunit.client.0.smithi043.stderr: -92> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 asok(0x563fa59732b0) register_command cache inspect hook 0x563fa5c43880 2024-09-12T00:41:07.198 INFO:tasks.workunit.client.0.smithi043.stderr: -91> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 asok(0x563fa59732b0) register_command cache erase hook 0x563fa5c43880 2024-09-12T00:41:07.198 INFO:tasks.workunit.client.0.smithi043.stderr: -90> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 asok(0x563fa59732b0) register_command cache zap hook 0x563fa5c43880 2024-09-12T00:41:07.198 INFO:tasks.workunit.client.0.smithi043.stderr: -89> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 note: GC not initialized 2024-09-12T00:41:07.198 INFO:tasks.workunit.client.0.smithi043.stderr: -88> 2024-09-12T00:41:07.087+0000 7f0d23fff640 20 reqs_thread_entry: start 2024-09-12T00:41:07.198 INFO:tasks.workunit.client.0.smithi043.stderr: -87> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 asok(0x563fa59732b0) register_command sync trace show hook 0x7f0eec0048d0 2024-09-12T00:41:07.198 INFO:tasks.workunit.client.0.smithi043.stderr: -86> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 asok(0x563fa59732b0) register_command sync trace history hook 0x7f0eec0048d0 2024-09-12T00:41:07.198 INFO:tasks.workunit.client.0.smithi043.stderr: -85> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 asok(0x563fa59732b0) register_command sync trace active hook 0x7f0eec0048d0 2024-09-12T00:41:07.198 INFO:tasks.workunit.client.0.smithi043.stderr: -84> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 asok(0x563fa59732b0) register_command sync trace active_short hook 0x7f0eec0048d0 2024-09-12T00:41:07.198 INFO:tasks.workunit.client.0.smithi043.stderr: -83> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:07.198 INFO:tasks.workunit.client.0.smithi043.stderr: -82> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 20 Filter name: none 2024-09-12T00:41:07.198 INFO:tasks.workunit.client.0.smithi043.stderr: -81> 2024-09-12T00:41:07.087+0000 7f0d21ffb640 20 reqs_thread_entry: start 2024-09-12T00:41:07.199 INFO:tasks.workunit.client.0.smithi043.stderr: -80> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:41:07.199 INFO:tasks.workunit.client.0.smithi043.stderr: -79> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.199 INFO:tasks.workunit.client.0.smithi043.stderr: -78> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:41:07.199 INFO:tasks.workunit.client.0.smithi043.stderr: -77> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:41:07.199 INFO:tasks.workunit.client.0.smithi043.stderr: -76> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:41:07.199 INFO:tasks.workunit.client.0.smithi043.stderr: -75> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 : miss 2024-09-12T00:41:07.199 INFO:tasks.workunit.client.0.smithi043.stderr: -74> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.199 INFO:tasks.workunit.client.0.smithi043.stderr: -73> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:41:07.199 INFO:tasks.workunit.client.0.smithi043.stderr: -72> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:41:07.199 INFO:tasks.workunit.client.0.smithi043.stderr: -71> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:41:07.199 INFO:tasks.workunit.client.0.smithi043.stderr: -70> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:41:07.200 INFO:tasks.workunit.client.0.smithi043.stderr: -69> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:07.200 INFO:tasks.workunit.client.0.smithi043.stderr: -68> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 2024-09-12T00:41:07.200 INFO:tasks.workunit.client.0.smithi043.stderr: -67> 2024-09-12T00:41:07.099+0000 7f0ef4d8a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:41:07.200 INFO:tasks.workunit.client.0.smithi043.stderr: -66> 2024-09-12T00:41:07.099+0000 7f0ef4d8a9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:41:07.200 INFO:tasks.workunit.client.0.smithi043.stderr: -65> 2024-09-12T00:41:07.099+0000 7f0ef4d8a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:07.200 INFO:tasks.workunit.client.0.smithi043.stderr: -64> 2024-09-12T00:41:07.099+0000 7f0ef4d8a9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17, ofs0, ns] 2024-09-12T00:41:07.200 INFO:tasks.workunit.client.0.smithi043.stderr: -63> 2024-09-12T00:41:07.099+0000 7f0dd5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333526 cookie 94831364255232 notifier 7667 bl.length()=827 2024-09-12T00:41:07.200 INFO:tasks.workunit.client.0.smithi043.stderr: -62> 2024-09-12T00:41:07.099+0000 7f0dd5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:41:07.200 INFO:tasks.workunit.client.0.smithi043.stderr: -61> 2024-09-12T00:41:07.099+0000 7f0dd5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:41:07.200 INFO:tasks.workunit.client.0.smithi043.stderr: -60> 2024-09-12T00:41:07.099+0000 7f0dd5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:07.200 INFO:tasks.workunit.client.0.smithi043.stderr: -59> 2024-09-12T00:41:07.099+0000 7f0ef4d8a9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_sources= new_sources= 2024-09-12T00:41:07.201 INFO:tasks.workunit.client.0.smithi043.stderr: -58> 2024-09-12T00:41:07.099+0000 7f0ef4d8a9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential sources added=[] removed=[] 2024-09-12T00:41:07.201 INFO:tasks.workunit.client.0.smithi043.stderr: -57> 2024-09-12T00:41:07.099+0000 7f0ef4d8a9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_dests= new_dests= 2024-09-12T00:41:07.201 INFO:tasks.workunit.client.0.smithi043.stderr: -56> 2024-09-12T00:41:07.099+0000 7f0ef4d8a9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential dests added=[] removed=[] 2024-09-12T00:41:07.201 INFO:tasks.workunit.client.0.smithi043.stderr: -55> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.0 2024-09-12T00:41:07.201 INFO:tasks.workunit.client.0.smithi043.stderr: -54> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.0 2024-09-12T00:41:07.201 INFO:tasks.workunit.client.0.smithi043.stderr: -53> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.1 2024-09-12T00:41:07.201 INFO:tasks.workunit.client.0.smithi043.stderr: -52> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.1 2024-09-12T00:41:07.201 INFO:tasks.workunit.client.0.smithi043.stderr: -51> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.2 2024-09-12T00:41:07.201 INFO:tasks.workunit.client.0.smithi043.stderr: -50> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.2 2024-09-12T00:41:07.201 INFO:tasks.workunit.client.0.smithi043.stderr: -49> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.3 2024-09-12T00:41:07.201 INFO:tasks.workunit.client.0.smithi043.stderr: -48> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.3 2024-09-12T00:41:07.202 INFO:tasks.workunit.client.0.smithi043.stderr: -47> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.4 2024-09-12T00:41:07.202 INFO:tasks.workunit.client.0.smithi043.stderr: -46> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.4 2024-09-12T00:41:07.202 INFO:tasks.workunit.client.0.smithi043.stderr: -45> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.5 2024-09-12T00:41:07.202 INFO:tasks.workunit.client.0.smithi043.stderr: -44> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.5 2024-09-12T00:41:07.202 INFO:tasks.workunit.client.0.smithi043.stderr: -43> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.6 2024-09-12T00:41:07.202 INFO:tasks.workunit.client.0.smithi043.stderr: -42> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.6 2024-09-12T00:41:07.202 INFO:tasks.workunit.client.0.smithi043.stderr: -41> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.7 2024-09-12T00:41:07.202 INFO:tasks.workunit.client.0.smithi043.stderr: -40> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.7 2024-09-12T00:41:07.202 INFO:tasks.workunit.client.0.smithi043.stderr: -39> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.8 2024-09-12T00:41:07.202 INFO:tasks.workunit.client.0.smithi043.stderr: -38> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.8 2024-09-12T00:41:07.202 INFO:tasks.workunit.client.0.smithi043.stderr: -37> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.9 2024-09-12T00:41:07.203 INFO:tasks.workunit.client.0.smithi043.stderr: -36> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.9 2024-09-12T00:41:07.203 INFO:tasks.workunit.client.0.smithi043.stderr: -35> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.10 2024-09-12T00:41:07.203 INFO:tasks.workunit.client.0.smithi043.stderr: -34> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.10 2024-09-12T00:41:07.203 INFO:tasks.workunit.client.0.smithi043.stderr: -33> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.11 2024-09-12T00:41:07.203 INFO:tasks.workunit.client.0.smithi043.stderr: -32> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.11 2024-09-12T00:41:07.203 INFO:tasks.workunit.client.0.smithi043.stderr: -31> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.12 2024-09-12T00:41:07.203 INFO:tasks.workunit.client.0.smithi043.stderr: -30> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.12 2024-09-12T00:41:07.203 INFO:tasks.workunit.client.0.smithi043.stderr: -29> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.13 2024-09-12T00:41:07.203 INFO:tasks.workunit.client.0.smithi043.stderr: -28> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.13 2024-09-12T00:41:07.204 INFO:tasks.workunit.client.0.smithi043.stderr: -27> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.0 2024-09-12T00:41:07.204 INFO:tasks.workunit.client.0.smithi043.stderr: -26> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.0 2024-09-12T00:41:07.204 INFO:tasks.workunit.client.0.smithi043.stderr: -25> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.1 2024-09-12T00:41:07.204 INFO:tasks.workunit.client.0.smithi043.stderr: -24> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.1 2024-09-12T00:41:07.204 INFO:tasks.workunit.client.0.smithi043.stderr: -23> 2024-09-12T00:41:07.115+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.2 2024-09-12T00:41:07.204 INFO:tasks.workunit.client.0.smithi043.stderr: -22> 2024-09-12T00:41:07.115+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.2 2024-09-12T00:41:07.204 INFO:tasks.workunit.client.0.smithi043.stderr: -21> 2024-09-12T00:41:07.115+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.3 2024-09-12T00:41:07.205 INFO:tasks.workunit.client.0.smithi043.stderr: -20> 2024-09-12T00:41:07.115+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.3 2024-09-12T00:41:07.205 INFO:tasks.workunit.client.0.smithi043.stderr: -19> 2024-09-12T00:41:07.115+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.4 2024-09-12T00:41:07.205 INFO:tasks.workunit.client.0.smithi043.stderr: -18> 2024-09-12T00:41:07.115+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.4 2024-09-12T00:41:07.205 INFO:tasks.workunit.client.0.smithi043.stderr: -17> 2024-09-12T00:41:07.115+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.5 2024-09-12T00:41:07.205 INFO:tasks.workunit.client.0.smithi043.stderr: -16> 2024-09-12T00:41:07.115+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.5 2024-09-12T00:41:07.205 INFO:tasks.workunit.client.0.smithi043.stderr: -15> 2024-09-12T00:41:07.115+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.6 2024-09-12T00:41:07.205 INFO:tasks.workunit.client.0.smithi043.stderr: -14> 2024-09-12T00:41:07.115+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.6 2024-09-12T00:41:07.205 INFO:tasks.workunit.client.0.smithi043.stderr: -13> 2024-09-12T00:41:07.119+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.7 2024-09-12T00:41:07.205 INFO:tasks.workunit.client.0.smithi043.stderr: -12> 2024-09-12T00:41:07.119+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.7 2024-09-12T00:41:07.205 INFO:tasks.workunit.client.0.smithi043.stderr: -11> 2024-09-12T00:41:07.119+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.8 2024-09-12T00:41:07.205 INFO:tasks.workunit.client.0.smithi043.stderr: -10> 2024-09-12T00:41:07.119+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.8 2024-09-12T00:41:07.206 INFO:tasks.workunit.client.0.smithi043.stderr: -9> 2024-09-12T00:41:07.119+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.9 2024-09-12T00:41:07.206 INFO:tasks.workunit.client.0.smithi043.stderr: -8> 2024-09-12T00:41:07.119+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.9 2024-09-12T00:41:07.206 INFO:tasks.workunit.client.0.smithi043.stderr: -7> 2024-09-12T00:41:07.119+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.10 2024-09-12T00:41:07.206 INFO:tasks.workunit.client.0.smithi043.stderr: -6> 2024-09-12T00:41:07.119+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.10 2024-09-12T00:41:07.206 INFO:tasks.workunit.client.0.smithi043.stderr: -5> 2024-09-12T00:41:07.119+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.11 2024-09-12T00:41:07.206 INFO:tasks.workunit.client.0.smithi043.stderr: -4> 2024-09-12T00:41:07.119+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.11 2024-09-12T00:41:07.206 INFO:tasks.workunit.client.0.smithi043.stderr: -3> 2024-09-12T00:41:07.123+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.12 2024-09-12T00:41:07.206 INFO:tasks.workunit.client.0.smithi043.stderr: -2> 2024-09-12T00:41:07.123+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.12 2024-09-12T00:41:07.206 INFO:tasks.workunit.client.0.smithi043.stderr: -1> 2024-09-12T00:41:07.127+0000 7f0ef4d8a9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0ef4d8a9c0 time 2024-09-12T00:41:07.129497+0000 2024-09-12T00:41:07.206 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:41:07.206 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.206 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:07.207 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0ef86642eb] 2024-09-12T00:41:07.207 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0ef866449f] 2024-09-12T00:41:07.207 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563fa2d8acc1] 2024-09-12T00:41:07.207 INFO:tasks.workunit.client.0.smithi043.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x563fa2d9f01c] 2024-09-12T00:41:07.207 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563fa2da06a4] 2024-09-12T00:41:07.207 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:41:07.207 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0ef74cad90] 2024-09-12T00:41:07.207 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:41:07.207 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:41:07.207 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.207 INFO:tasks.workunit.client.0.smithi043.stderr: 0> 2024-09-12T00:41:07.127+0000 7f0ef4d8a9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:41:07.207 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7f0ef4d8a9c0 thread_name:radosgw-admin 2024-09-12T00:41:07.208 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.208 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:07.208 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0ef74e3520] 2024-09-12T00:41:07.208 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:41:07.208 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:41:07.208 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:41:07.208 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0ef8664345] 2024-09-12T00:41:07.208 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0ef866449f] 2024-09-12T00:41:07.208 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563fa2d8acc1] 2024-09-12T00:41:07.208 INFO:tasks.workunit.client.0.smithi043.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x563fa2d9f01c] 2024-09-12T00:41:07.209 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563fa2da06a4] 2024-09-12T00:41:07.209 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:41:07.209 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0ef74cad90] 2024-09-12T00:41:07.209 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:41:07.209 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:41:07.209 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:41:07.209 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.209 INFO:tasks.workunit.client.0.smithi043.stderr:--- logging levels --- 2024-09-12T00:41:07.209 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 none 2024-09-12T00:41:07.209 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 lockdep 2024-09-12T00:41:07.209 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 context 2024-09-12T00:41:07.210 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 crush 2024-09-12T00:41:07.210 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds 2024-09-12T00:41:07.210 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_balancer 2024-09-12T00:41:07.210 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_locker 2024-09-12T00:41:07.210 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log 2024-09-12T00:41:07.210 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log_expire 2024-09-12T00:41:07.210 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_migrator 2024-09-12T00:41:07.210 INFO:tasks.workunit.client.0.smithi043.stderr: 3/ 5 mds_quiesce 2024-09-12T00:41:07.210 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 buffer 2024-09-12T00:41:07.210 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 timer 2024-09-12T00:41:07.211 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 filer 2024-09-12T00:41:07.211 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 striper 2024-09-12T00:41:07.211 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 objecter 2024-09-12T00:41:07.211 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rados 2024-09-12T00:41:07.211 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd 2024-09-12T00:41:07.211 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_mirror 2024-09-12T00:41:07.211 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_replay 2024-09-12T00:41:07.211 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_pwl 2024-09-12T00:41:07.211 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 journaler 2024-09-12T00:41:07.211 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objectcacher 2024-09-12T00:41:07.212 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:41:07.212 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 client 2024-09-12T00:41:07.212 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 osd 2024-09-12T00:41:07.212 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 optracker 2024-09-12T00:41:07.212 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objclass 2024-09-12T00:41:07.212 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 filestore 2024-09-12T00:41:07.212 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 journal 2024-09-12T00:41:07.212 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 ms 2024-09-12T00:41:07.212 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mon 2024-09-12T00:41:07.212 INFO:tasks.workunit.client.0.smithi043.stderr: 0/10 monc 2024-09-12T00:41:07.212 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 paxos 2024-09-12T00:41:07.212 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 tp 2024-09-12T00:41:07.213 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 auth 2024-09-12T00:41:07.213 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 crypto 2024-09-12T00:41:07.213 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 finisher 2024-09-12T00:41:07.213 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 reserver 2024-09-12T00:41:07.213 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 heartbeatmap 2024-09-12T00:41:07.213 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 perfcounter 2024-09-12T00:41:07.213 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw 2024-09-12T00:41:07.213 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_sync 2024-09-12T00:41:07.213 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_datacache 2024-09-12T00:41:07.213 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_access 2024-09-12T00:41:07.214 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:41:07.214 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_flight 2024-09-12T00:41:07.214 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:41:07.214 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw_notification 2024-09-12T00:41:07.214 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 javaclient 2024-09-12T00:41:07.214 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 asok 2024-09-12T00:41:07.214 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 throttle 2024-09-12T00:41:07.214 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 refs 2024-09-12T00:41:07.214 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 compressor 2024-09-12T00:41:07.214 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluestore 2024-09-12T00:41:07.214 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluefs 2024-09-12T00:41:07.215 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 bdev 2024-09-12T00:41:07.215 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 kstore 2024-09-12T00:41:07.215 INFO:tasks.workunit.client.0.smithi043.stderr: 4/ 5 rocksdb 2024-09-12T00:41:07.215 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 fuse 2024-09-12T00:41:07.215 INFO:tasks.workunit.client.0.smithi043.stderr: 2/ 5 mgr 2024-09-12T00:41:07.215 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mgrc 2024-09-12T00:41:07.215 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 dpdk 2024-09-12T00:41:07.215 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 eventtrace 2024-09-12T00:41:07.215 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 prioritycache 2024-09-12T00:41:07.215 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 test 2024-09-12T00:41:07.215 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:41:07.215 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephsqlite 2024-09-12T00:41:07.216 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:41:07.216 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore 2024-09-12T00:41:07.216 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_onode 2024-09-12T00:41:07.216 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_odata 2024-09-12T00:41:07.216 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_omap 2024-09-12T00:41:07.216 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_tm 2024-09-12T00:41:07.216 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_t 2024-09-12T00:41:07.216 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:41:07.216 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_epm 2024-09-12T00:41:07.216 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_lba 2024-09-12T00:41:07.216 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:41:07.216 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cache 2024-09-12T00:41:07.217 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_journal 2024-09-12T00:41:07.217 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_device 2024-09-12T00:41:07.217 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_backref 2024-09-12T00:41:07.217 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 alienstore 2024-09-12T00:41:07.217 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mclock 2024-09-12T00:41:07.217 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cyanstore 2024-09-12T00:41:07.217 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 ceph_exporter 2024-09-12T00:41:07.217 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 memstore 2024-09-12T00:41:07.217 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 trace 2024-09-12T00:41:07.217 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 ceph_dedup 2024-09-12T00:41:07.218 INFO:tasks.workunit.client.0.smithi043.stderr: -2/-2 (syslog threshold) 2024-09-12T00:41:07.218 INFO:tasks.workunit.client.0.smithi043.stderr: 99/99 (stderr threshold) 2024-09-12T00:41:07.218 INFO:tasks.workunit.client.0.smithi043.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:41:07.218 INFO:tasks.workunit.client.0.smithi043.stderr: 7f0d21ffb640 / http_manager 2024-09-12T00:41:07.218 INFO:tasks.workunit.client.0.smithi043.stderr: 7f0d23fff640 / http_manager 2024-09-12T00:41:07.218 INFO:tasks.workunit.client.0.smithi043.stderr: 7f0da97e2640 / rgw_dt_lg_renew 2024-09-12T00:41:07.218 INFO:tasks.workunit.client.0.smithi043.stderr: 7f0dd4ff9640 / ms_dispatch 2024-09-12T00:41:07.218 INFO:tasks.workunit.client.0.smithi043.stderr: 7f0dd5ffb640 / io_context_pool 2024-09-12T00:41:07.218 INFO:tasks.workunit.client.0.smithi043.stderr: 7f0dd67fc640 / io_context_pool 2024-09-12T00:41:07.218 INFO:tasks.workunit.client.0.smithi043.stderr: 7f0ddce01640 / ms_dispatch 2024-09-12T00:41:07.218 INFO:tasks.workunit.client.0.smithi043.stderr: 7f0ddf606640 / ms_dispatch 2024-09-12T00:41:07.219 INFO:tasks.workunit.client.0.smithi043.stderr: 7f0de0e09640 / io_context_pool 2024-09-12T00:41:07.219 INFO:tasks.workunit.client.0.smithi043.stderr: 7f0ef188e640 / io_context_pool 2024-09-12T00:41:07.219 INFO:tasks.workunit.client.0.smithi043.stderr: 7f0ef208f640 / msgr-worker-2 2024-09-12T00:41:07.219 INFO:tasks.workunit.client.0.smithi043.stderr: 7f0ef2890640 / msgr-worker-1 2024-09-12T00:41:07.219 INFO:tasks.workunit.client.0.smithi043.stderr: 7f0ef3091640 / msgr-worker-0 2024-09-12T00:41:07.219 INFO:tasks.workunit.client.0.smithi043.stderr: 7f0ef4d8a9c0 / radosgw-admin 2024-09-12T00:41:07.219 INFO:tasks.workunit.client.0.smithi043.stderr: max_recent 500 2024-09-12T00:41:07.219 INFO:tasks.workunit.client.0.smithi043.stderr: max_new 1000 2024-09-12T00:41:07.219 INFO:tasks.workunit.client.0.smithi043.stderr: log_file /var/log/ceph/ceph-client.admin.137480.log 2024-09-12T00:41:07.219 INFO:tasks.workunit.client.0.smithi043.stderr:--- end dump of recent events --- 2024-09-12T00:41:07.219 INFO:tasks.workunit.client.0.smithi043.stderr:--- begin dump of recent events --- 2024-09-12T00:41:07.220 INFO:tasks.workunit.client.0.smithi043.stderr: -499> 2024-09-12T00:41:07.015+0000 7f0ef4d8a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:07.220 INFO:tasks.workunit.client.0.smithi043.stderr: -498> 2024-09-12T00:41:07.015+0000 7f0ef4d8a9c0 5 asok(0x563fa59732b0) register_command rotate-key hook 0x563fa5b80c48 2024-09-12T00:41:07.220 INFO:tasks.workunit.client.0.smithi043.stderr: -497> 2024-09-12T00:41:07.015+0000 7f0ef4d8a9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:07.220 INFO:tasks.workunit.client.0.smithi043.stderr: -496> 2024-09-12T00:41:07.015+0000 7f0ef4d8a9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:41:07.220 INFO:tasks.workunit.client.0.smithi043.stderr: -495> 2024-09-12T00:41:07.015+0000 7f0ef4d8a9c0 10 monclient(hunting): picked mon.noname-a con 0x563fa5a30820 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:41:07.220 INFO:tasks.workunit.client.0.smithi043.stderr: -494> 2024-09-12T00:41:07.015+0000 7f0ef4d8a9c0 10 monclient(hunting): picked mon.noname-b con 0x563fa5a3ba80 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:41:07.220 INFO:tasks.workunit.client.0.smithi043.stderr: -493> 2024-09-12T00:41:07.015+0000 7f0ef4d8a9c0 10 monclient(hunting): picked mon.noname-c con 0x563fa5acc170 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:41:07.220 INFO:tasks.workunit.client.0.smithi043.stderr: -492> 2024-09-12T00:41:07.015+0000 7f0ef4d8a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:07.220 INFO:tasks.workunit.client.0.smithi043.stderr: -491> 2024-09-12T00:41:07.015+0000 7f0ef4d8a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:07.220 INFO:tasks.workunit.client.0.smithi043.stderr: -490> 2024-09-12T00:41:07.015+0000 7f0ef4d8a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:07.220 INFO:tasks.workunit.client.0.smithi043.stderr: -489> 2024-09-12T00:41:07.015+0000 7f0ef4d8a9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:07.221 INFO:tasks.workunit.client.0.smithi043.stderr: -488> 2024-09-12T00:41:07.015+0000 7f0ef4d8a9c0 10 monclient(hunting): authenticate will time out at 2363.007652s 2024-09-12T00:41:07.221 INFO:tasks.workunit.client.0.smithi043.stderr: -487> 2024-09-12T00:41:07.015+0000 7f0ef2890640 10 monclient(hunting): get_auth_request con 0x563fa5a30820 auth_method 0 2024-09-12T00:41:07.221 INFO:tasks.workunit.client.0.smithi043.stderr: -486> 2024-09-12T00:41:07.015+0000 7f0ef2890640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:07.221 INFO:tasks.workunit.client.0.smithi043.stderr: -485> 2024-09-12T00:41:07.015+0000 7f0ef2890640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:07.221 INFO:tasks.workunit.client.0.smithi043.stderr: -484> 2024-09-12T00:41:07.015+0000 7f0ef2890640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:07.221 INFO:tasks.workunit.client.0.smithi043.stderr: -483> 2024-09-12T00:41:07.015+0000 7f0ef3091640 10 monclient(hunting): get_auth_request con 0x563fa5acc170 auth_method 0 2024-09-12T00:41:07.221 INFO:tasks.workunit.client.0.smithi043.stderr: -482> 2024-09-12T00:41:07.015+0000 7f0ef3091640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:07.221 INFO:tasks.workunit.client.0.smithi043.stderr: -481> 2024-09-12T00:41:07.015+0000 7f0ef3091640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:07.221 INFO:tasks.workunit.client.0.smithi043.stderr: -480> 2024-09-12T00:41:07.015+0000 7f0ef3091640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:07.221 INFO:tasks.workunit.client.0.smithi043.stderr: -479> 2024-09-12T00:41:07.015+0000 7f0ef2890640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:07.221 INFO:tasks.workunit.client.0.smithi043.stderr: -478> 2024-09-12T00:41:07.015+0000 7f0ef2890640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:07.222 INFO:tasks.workunit.client.0.smithi043.stderr: -477> 2024-09-12T00:41:07.015+0000 7f0ef2890640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:07.222 INFO:tasks.workunit.client.0.smithi043.stderr: -476> 2024-09-12T00:41:07.015+0000 7f0ef3091640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:07.222 INFO:tasks.workunit.client.0.smithi043.stderr: -475> 2024-09-12T00:41:07.015+0000 7f0ef3091640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:07.222 INFO:tasks.workunit.client.0.smithi043.stderr: -474> 2024-09-12T00:41:07.015+0000 7f0ef3091640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:07.222 INFO:tasks.workunit.client.0.smithi043.stderr: -473> 2024-09-12T00:41:07.019+0000 7f0ef208f640 10 monclient(hunting): get_auth_request con 0x563fa5a3ba80 auth_method 0 2024-09-12T00:41:07.222 INFO:tasks.workunit.client.0.smithi043.stderr: -472> 2024-09-12T00:41:07.019+0000 7f0ef208f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:07.222 INFO:tasks.workunit.client.0.smithi043.stderr: -471> 2024-09-12T00:41:07.019+0000 7f0ef208f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:07.222 INFO:tasks.workunit.client.0.smithi043.stderr: -470> 2024-09-12T00:41:07.019+0000 7f0ef208f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:07.222 INFO:tasks.workunit.client.0.smithi043.stderr: -469> 2024-09-12T00:41:07.019+0000 7f0ef2890640 10 monclient(hunting): handle_auth_done global_id 8028 payload 824 2024-09-12T00:41:07.222 INFO:tasks.workunit.client.0.smithi043.stderr: -468> 2024-09-12T00:41:07.019+0000 7f0ef2890640 10 monclient: _finish_hunting 0 2024-09-12T00:41:07.222 INFO:tasks.workunit.client.0.smithi043.stderr: -467> 2024-09-12T00:41:07.019+0000 7f0ef2890640 1 monclient: found mon.noname-a 2024-09-12T00:41:07.223 INFO:tasks.workunit.client.0.smithi043.stderr: -466> 2024-09-12T00:41:07.019+0000 7f0ef2890640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:41:07.223 INFO:tasks.workunit.client.0.smithi043.stderr: -465> 2024-09-12T00:41:07.019+0000 7f0ddf606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:07.223 INFO:tasks.workunit.client.0.smithi043.stderr: -464> 2024-09-12T00:41:07.019+0000 7f0ddf606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:41:07.223 INFO:tasks.workunit.client.0.smithi043.stderr: -463> 2024-09-12T00:41:07.019+0000 7f0ddf606640 10 monclient: dump: 2024-09-12T00:41:07.223 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:07.223 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:07.223 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.223 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.223 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:07.223 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:07.223 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:07.224 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:07.224 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:07.224 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.224 INFO:tasks.workunit.client.0.smithi043.stderr: -462> 2024-09-12T00:41:07.019+0000 7f0ddf606640 10 monclient: _finish_auth 0 2024-09-12T00:41:07.224 INFO:tasks.workunit.client.0.smithi043.stderr: -461> 2024-09-12T00:41:07.019+0000 7f0ddf606640 10 monclient: _check_auth_tickets 2024-09-12T00:41:07.224 INFO:tasks.workunit.client.0.smithi043.stderr: -460> 2024-09-12T00:41:07.019+0000 7f0ddf606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:07.224 INFO:tasks.workunit.client.0.smithi043.stderr: -459> 2024-09-12T00:41:07.019+0000 7f0ddf606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:07.224 INFO:tasks.workunit.client.0.smithi043.stderr: -458> 2024-09-12T00:41:07.019+0000 7f0ddf606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:41:07.224 INFO:tasks.workunit.client.0.smithi043.stderr: -457> 2024-09-12T00:41:07.019+0000 7f0ddf606640 10 monclient: dump: 2024-09-12T00:41:07.224 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:07.224 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:07.225 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.225 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.225 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:07.225 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:07.225 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:07.225 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:07.225 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:07.225 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.225 INFO:tasks.workunit.client.0.smithi043.stderr: -456> 2024-09-12T00:41:07.019+0000 7f0ef4d8a9c0 5 monclient: authenticate success, global_id 8028 2024-09-12T00:41:07.225 INFO:tasks.workunit.client.0.smithi043.stderr: -455> 2024-09-12T00:41:07.019+0000 7f0de0e09640 4 set_mon_vals no callback set 2024-09-12T00:41:07.225 INFO:tasks.workunit.client.0.smithi043.stderr: -454> 2024-09-12T00:41:07.019+0000 7f0ef4d8a9c0 10 monclient: _renew_subs 2024-09-12T00:41:07.226 INFO:tasks.workunit.client.0.smithi043.stderr: -453> 2024-09-12T00:41:07.019+0000 7f0ef4d8a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:41:07.226 INFO:tasks.workunit.client.0.smithi043.stderr: -452> 2024-09-12T00:41:07.019+0000 7f0ef4d8a9c0 10 monclient: _renew_subs 2024-09-12T00:41:07.226 INFO:tasks.workunit.client.0.smithi043.stderr: -451> 2024-09-12T00:41:07.019+0000 7f0ef4d8a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:41:07.226 INFO:tasks.workunit.client.0.smithi043.stderr: -450> 2024-09-12T00:41:07.019+0000 7f0ef4d8a9c0 1 librados: init done 2024-09-12T00:41:07.226 INFO:tasks.workunit.client.0.smithi043.stderr: -449> 2024-09-12T00:41:07.019+0000 7f0ddf606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:41:07.226 INFO:tasks.workunit.client.0.smithi043.stderr: -448> 2024-09-12T00:41:07.019+0000 7f0ddf606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:41:07.226 INFO:tasks.workunit.client.0.smithi043.stderr: -447> 2024-09-12T00:41:07.019+0000 7f0ddf606640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:41:07.226 INFO:tasks.workunit.client.0.smithi043.stderr: -446> 2024-09-12T00:41:07.019+0000 7f0ef208f640 10 monclient: get_auth_request con 0x7f0dd8070ae0 auth_method 0 2024-09-12T00:41:07.226 INFO:tasks.workunit.client.0.smithi043.stderr: -445> 2024-09-12T00:41:07.023+0000 7f0ef3091640 10 monclient: get_auth_request con 0x563fa5bac280 auth_method 0 2024-09-12T00:41:07.226 INFO:tasks.workunit.client.0.smithi043.stderr: -444> 2024-09-12T00:41:07.023+0000 7f0ef2890640 10 monclient: get_auth_request con 0x563fa5bcb250 auth_method 0 2024-09-12T00:41:07.226 INFO:tasks.workunit.client.0.smithi043.stderr: -443> 2024-09-12T00:41:07.023+0000 7f0ef208f640 10 monclient: get_auth_request con 0x563fa5bcf440 auth_method 0 2024-09-12T00:41:07.227 INFO:tasks.workunit.client.0.smithi043.stderr: -442> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient: build_initial_monmap 2024-09-12T00:41:07.227 INFO:tasks.workunit.client.0.smithi043.stderr: -441> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 1 build_initial for_mkfs: 0 2024-09-12T00:41:07.227 INFO:tasks.workunit.client.0.smithi043.stderr: -440> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient: monmap: 2024-09-12T00:41:07.227 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:41:07.227 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:41:07.227 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:41:07.227 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:41:07.227 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:41:07.227 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:07.227 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:41:07.227 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:41:07.228 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:41:07.228 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.228 INFO:tasks.workunit.client.0.smithi043.stderr: -439> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd3fa0) adding auth protocol: cephx 2024-09-12T00:41:07.228 INFO:tasks.workunit.client.0.smithi043.stderr: -438> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd3fa0) adding auth protocol: cephx 2024-09-12T00:41:07.228 INFO:tasks.workunit.client.0.smithi043.stderr: -437> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd3fa0) adding auth protocol: cephx 2024-09-12T00:41:07.228 INFO:tasks.workunit.client.0.smithi043.stderr: -436> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd3fa0) adding con mode: secure 2024-09-12T00:41:07.229 INFO:tasks.workunit.client.0.smithi043.stderr: -435> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd3fa0) adding con mode: crc 2024-09-12T00:41:07.229 INFO:tasks.workunit.client.0.smithi043.stderr: -434> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd3fa0) adding con mode: secure 2024-09-12T00:41:07.229 INFO:tasks.workunit.client.0.smithi043.stderr: -433> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd3fa0) adding con mode: crc 2024-09-12T00:41:07.229 INFO:tasks.workunit.client.0.smithi043.stderr: -432> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd3fa0) adding con mode: secure 2024-09-12T00:41:07.229 INFO:tasks.workunit.client.0.smithi043.stderr: -431> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd3fa0) adding con mode: crc 2024-09-12T00:41:07.229 INFO:tasks.workunit.client.0.smithi043.stderr: -430> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd3fa0) adding con mode: crc 2024-09-12T00:41:07.229 INFO:tasks.workunit.client.0.smithi043.stderr: -429> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd3fa0) adding con mode: secure 2024-09-12T00:41:07.229 INFO:tasks.workunit.client.0.smithi043.stderr: -428> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd3fa0) adding con mode: crc 2024-09-12T00:41:07.230 INFO:tasks.workunit.client.0.smithi043.stderr: -427> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd3fa0) adding con mode: secure 2024-09-12T00:41:07.230 INFO:tasks.workunit.client.0.smithi043.stderr: -426> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd3fa0) adding con mode: crc 2024-09-12T00:41:07.230 INFO:tasks.workunit.client.0.smithi043.stderr: -425> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd3fa0) adding con mode: secure 2024-09-12T00:41:07.230 INFO:tasks.workunit.client.0.smithi043.stderr: -424> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:07.230 INFO:tasks.workunit.client.0.smithi043.stderr: -423> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 asok(0x563fa59732b0) register_command objecter_requests cmddesc objecter_requests hook 0x563fa5bd7930 EEXIST 2024-09-12T00:41:07.230 INFO:tasks.workunit.client.0.smithi043.stderr: -422> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient: init 2024-09-12T00:41:07.230 INFO:tasks.workunit.client.0.smithi043.stderr: -421> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd26c8) adding auth protocol: cephx 2024-09-12T00:41:07.230 INFO:tasks.workunit.client.0.smithi043.stderr: -420> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd26c8) adding auth protocol: cephx 2024-09-12T00:41:07.230 INFO:tasks.workunit.client.0.smithi043.stderr: -419> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd26c8) adding auth protocol: cephx 2024-09-12T00:41:07.230 INFO:tasks.workunit.client.0.smithi043.stderr: -418> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd26c8) adding con mode: secure 2024-09-12T00:41:07.230 INFO:tasks.workunit.client.0.smithi043.stderr: -417> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd26c8) adding con mode: crc 2024-09-12T00:41:07.231 INFO:tasks.workunit.client.0.smithi043.stderr: -416> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd26c8) adding con mode: secure 2024-09-12T00:41:07.231 INFO:tasks.workunit.client.0.smithi043.stderr: -415> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd26c8) adding con mode: crc 2024-09-12T00:41:07.231 INFO:tasks.workunit.client.0.smithi043.stderr: -414> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd26c8) adding con mode: secure 2024-09-12T00:41:07.231 INFO:tasks.workunit.client.0.smithi043.stderr: -413> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd26c8) adding con mode: crc 2024-09-12T00:41:07.231 INFO:tasks.workunit.client.0.smithi043.stderr: -412> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd26c8) adding con mode: crc 2024-09-12T00:41:07.231 INFO:tasks.workunit.client.0.smithi043.stderr: -411> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd26c8) adding con mode: secure 2024-09-12T00:41:07.231 INFO:tasks.workunit.client.0.smithi043.stderr: -410> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd26c8) adding con mode: crc 2024-09-12T00:41:07.231 INFO:tasks.workunit.client.0.smithi043.stderr: -409> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd26c8) adding con mode: secure 2024-09-12T00:41:07.231 INFO:tasks.workunit.client.0.smithi043.stderr: -408> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd26c8) adding con mode: crc 2024-09-12T00:41:07.231 INFO:tasks.workunit.client.0.smithi043.stderr: -407> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bd26c8) adding con mode: secure 2024-09-12T00:41:07.232 INFO:tasks.workunit.client.0.smithi043.stderr: -406> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:07.232 INFO:tasks.workunit.client.0.smithi043.stderr: -405> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:07.232 INFO:tasks.workunit.client.0.smithi043.stderr: -404> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 asok(0x563fa59732b0) register_command rotate-key cmddesc rotate-key hook 0x563fa5bd2810 EEXIST 2024-09-12T00:41:07.232 INFO:tasks.workunit.client.0.smithi043.stderr: -403> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:07.232 INFO:tasks.workunit.client.0.smithi043.stderr: -402> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:41:07.232 INFO:tasks.workunit.client.0.smithi043.stderr: -401> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient(hunting): picked mon.noname-b con 0x563fa5bfbae0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:41:07.232 INFO:tasks.workunit.client.0.smithi043.stderr: -400> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient(hunting): picked mon.noname-a con 0x563fa5bfb410 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:41:07.232 INFO:tasks.workunit.client.0.smithi043.stderr: -399> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient(hunting): picked mon.noname-c con 0x563fa5bf9df0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:41:07.232 INFO:tasks.workunit.client.0.smithi043.stderr: -398> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:07.233 INFO:tasks.workunit.client.0.smithi043.stderr: -397> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:07.233 INFO:tasks.workunit.client.0.smithi043.stderr: -396> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:07.233 INFO:tasks.workunit.client.0.smithi043.stderr: -395> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:07.233 INFO:tasks.workunit.client.0.smithi043.stderr: -394> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient(hunting): authenticate will time out at 2363.018180s 2024-09-12T00:41:07.233 INFO:tasks.workunit.client.0.smithi043.stderr: -393> 2024-09-12T00:41:07.027+0000 7f0ef3091640 10 monclient(hunting): get_auth_request con 0x563fa5bf9df0 auth_method 0 2024-09-12T00:41:07.233 INFO:tasks.workunit.client.0.smithi043.stderr: -392> 2024-09-12T00:41:07.027+0000 7f0ef3091640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:07.233 INFO:tasks.workunit.client.0.smithi043.stderr: -391> 2024-09-12T00:41:07.027+0000 7f0ef3091640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:07.233 INFO:tasks.workunit.client.0.smithi043.stderr: -390> 2024-09-12T00:41:07.027+0000 7f0ef3091640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:07.233 INFO:tasks.workunit.client.0.smithi043.stderr: -389> 2024-09-12T00:41:07.027+0000 7f0ef208f640 10 monclient(hunting): get_auth_request con 0x563fa5bfb410 auth_method 0 2024-09-12T00:41:07.234 INFO:tasks.workunit.client.0.smithi043.stderr: -388> 2024-09-12T00:41:07.027+0000 7f0ef208f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:07.234 INFO:tasks.workunit.client.0.smithi043.stderr: -387> 2024-09-12T00:41:07.027+0000 7f0ef208f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:07.234 INFO:tasks.workunit.client.0.smithi043.stderr: -386> 2024-09-12T00:41:07.027+0000 7f0ef208f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:07.234 INFO:tasks.workunit.client.0.smithi043.stderr: -385> 2024-09-12T00:41:07.027+0000 7f0ef3091640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:07.234 INFO:tasks.workunit.client.0.smithi043.stderr: -384> 2024-09-12T00:41:07.027+0000 7f0ef3091640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:07.234 INFO:tasks.workunit.client.0.smithi043.stderr: -383> 2024-09-12T00:41:07.027+0000 7f0ef3091640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:07.234 INFO:tasks.workunit.client.0.smithi043.stderr: -382> 2024-09-12T00:41:07.027+0000 7f0ef208f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:07.234 INFO:tasks.workunit.client.0.smithi043.stderr: -381> 2024-09-12T00:41:07.027+0000 7f0ef208f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:07.234 INFO:tasks.workunit.client.0.smithi043.stderr: -380> 2024-09-12T00:41:07.027+0000 7f0ef208f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:07.234 INFO:tasks.workunit.client.0.smithi043.stderr: -379> 2024-09-12T00:41:07.027+0000 7f0ef2890640 10 monclient(hunting): get_auth_request con 0x563fa5bfbae0 auth_method 0 2024-09-12T00:41:07.234 INFO:tasks.workunit.client.0.smithi043.stderr: -378> 2024-09-12T00:41:07.027+0000 7f0ef2890640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:07.235 INFO:tasks.workunit.client.0.smithi043.stderr: -377> 2024-09-12T00:41:07.027+0000 7f0ef2890640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:07.235 INFO:tasks.workunit.client.0.smithi043.stderr: -376> 2024-09-12T00:41:07.027+0000 7f0ef2890640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:07.235 INFO:tasks.workunit.client.0.smithi043.stderr: -375> 2024-09-12T00:41:07.027+0000 7f0ef3091640 10 monclient(hunting): handle_auth_done global_id 7661 payload 824 2024-09-12T00:41:07.235 INFO:tasks.workunit.client.0.smithi043.stderr: -374> 2024-09-12T00:41:07.027+0000 7f0ef3091640 10 monclient: _finish_hunting 0 2024-09-12T00:41:07.235 INFO:tasks.workunit.client.0.smithi043.stderr: -373> 2024-09-12T00:41:07.027+0000 7f0ef3091640 1 monclient: found mon.noname-c 2024-09-12T00:41:07.235 INFO:tasks.workunit.client.0.smithi043.stderr: -372> 2024-09-12T00:41:07.027+0000 7f0ef3091640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:41:07.235 INFO:tasks.workunit.client.0.smithi043.stderr: -371> 2024-09-12T00:41:07.027+0000 7f0ddce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:07.235 INFO:tasks.workunit.client.0.smithi043.stderr: -370> 2024-09-12T00:41:07.027+0000 7f0ddce01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:41:07.235 INFO:tasks.workunit.client.0.smithi043.stderr: -369> 2024-09-12T00:41:07.027+0000 7f0ddce01640 10 monclient: dump: 2024-09-12T00:41:07.235 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:07.236 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:07.236 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.236 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.236 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:07.236 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:07.236 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:07.236 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:07.236 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:07.236 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.236 INFO:tasks.workunit.client.0.smithi043.stderr: -368> 2024-09-12T00:41:07.027+0000 7f0ddce01640 10 monclient: _finish_auth 0 2024-09-12T00:41:07.236 INFO:tasks.workunit.client.0.smithi043.stderr: -367> 2024-09-12T00:41:07.027+0000 7f0ddce01640 10 monclient: _check_auth_tickets 2024-09-12T00:41:07.236 INFO:tasks.workunit.client.0.smithi043.stderr: -366> 2024-09-12T00:41:07.027+0000 7f0ddce01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:07.237 INFO:tasks.workunit.client.0.smithi043.stderr: -365> 2024-09-12T00:41:07.027+0000 7f0ddce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:07.237 INFO:tasks.workunit.client.0.smithi043.stderr: -364> 2024-09-12T00:41:07.027+0000 7f0ddce01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:41:07.237 INFO:tasks.workunit.client.0.smithi043.stderr: -363> 2024-09-12T00:41:07.027+0000 7f0ddce01640 10 monclient: dump: 2024-09-12T00:41:07.237 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:07.237 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:07.237 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.237 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.237 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:07.237 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:07.237 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:07.237 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:07.237 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:07.238 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.238 INFO:tasks.workunit.client.0.smithi043.stderr: -362> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 5 monclient: authenticate success, global_id 7661 2024-09-12T00:41:07.238 INFO:tasks.workunit.client.0.smithi043.stderr: -361> 2024-09-12T00:41:07.027+0000 7f0ef188e640 4 set_mon_vals no callback set 2024-09-12T00:41:07.238 INFO:tasks.workunit.client.0.smithi043.stderr: -360> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient: _renew_subs 2024-09-12T00:41:07.238 INFO:tasks.workunit.client.0.smithi043.stderr: -359> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:41:07.238 INFO:tasks.workunit.client.0.smithi043.stderr: -358> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient: _renew_subs 2024-09-12T00:41:07.238 INFO:tasks.workunit.client.0.smithi043.stderr: -357> 2024-09-12T00:41:07.027+0000 7f0ef4d8a9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:41:07.238 INFO:tasks.workunit.client.0.smithi043.stderr: -356> 2024-09-12T00:41:07.031+0000 7f0ddce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:41:07.238 INFO:tasks.workunit.client.0.smithi043.stderr: -355> 2024-09-12T00:41:07.031+0000 7f0ddce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:41:07.238 INFO:tasks.workunit.client.0.smithi043.stderr: -354> 2024-09-12T00:41:07.031+0000 7f0ddce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:41:07.238 INFO:tasks.workunit.client.0.smithi043.stderr: -353> 2024-09-12T00:41:07.031+0000 7f0ef2890640 10 monclient: get_auth_request con 0x7f0dcc070a20 auth_method 0 2024-09-12T00:41:07.238 INFO:tasks.workunit.client.0.smithi043.stderr: -352> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient: get_monmap_and_config 2024-09-12T00:41:07.238 INFO:tasks.workunit.client.0.smithi043.stderr: -351> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient: build_initial_monmap 2024-09-12T00:41:07.239 INFO:tasks.workunit.client.0.smithi043.stderr: -350> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 1 build_initial for_mkfs: 0 2024-09-12T00:41:07.239 INFO:tasks.workunit.client.0.smithi043.stderr: -349> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient: monmap: 2024-09-12T00:41:07.239 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:41:07.239 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:41:07.239 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:41:07.239 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:41:07.239 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:41:07.239 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:07.239 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:41:07.239 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:41:07.239 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:41:07.239 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.240 INFO:tasks.workunit.client.0.smithi043.stderr: -348> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b4b0) adding auth protocol: cephx 2024-09-12T00:41:07.240 INFO:tasks.workunit.client.0.smithi043.stderr: -347> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b4b0) adding auth protocol: cephx 2024-09-12T00:41:07.240 INFO:tasks.workunit.client.0.smithi043.stderr: -346> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b4b0) adding auth protocol: cephx 2024-09-12T00:41:07.240 INFO:tasks.workunit.client.0.smithi043.stderr: -345> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b4b0) adding con mode: secure 2024-09-12T00:41:07.240 INFO:tasks.workunit.client.0.smithi043.stderr: -344> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b4b0) adding con mode: crc 2024-09-12T00:41:07.240 INFO:tasks.workunit.client.0.smithi043.stderr: -343> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b4b0) adding con mode: secure 2024-09-12T00:41:07.240 INFO:tasks.workunit.client.0.smithi043.stderr: -342> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b4b0) adding con mode: crc 2024-09-12T00:41:07.240 INFO:tasks.workunit.client.0.smithi043.stderr: -341> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b4b0) adding con mode: secure 2024-09-12T00:41:07.240 INFO:tasks.workunit.client.0.smithi043.stderr: -340> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b4b0) adding con mode: crc 2024-09-12T00:41:07.240 INFO:tasks.workunit.client.0.smithi043.stderr: -339> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b4b0) adding con mode: crc 2024-09-12T00:41:07.240 INFO:tasks.workunit.client.0.smithi043.stderr: -338> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b4b0) adding con mode: secure 2024-09-12T00:41:07.241 INFO:tasks.workunit.client.0.smithi043.stderr: -337> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b4b0) adding con mode: crc 2024-09-12T00:41:07.241 INFO:tasks.workunit.client.0.smithi043.stderr: -336> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b4b0) adding con mode: secure 2024-09-12T00:41:07.241 INFO:tasks.workunit.client.0.smithi043.stderr: -335> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b4b0) adding con mode: crc 2024-09-12T00:41:07.241 INFO:tasks.workunit.client.0.smithi043.stderr: -334> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b4b0) adding con mode: secure 2024-09-12T00:41:07.241 INFO:tasks.workunit.client.0.smithi043.stderr: -333> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:07.241 INFO:tasks.workunit.client.0.smithi043.stderr: -332> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient: init 2024-09-12T00:41:07.241 INFO:tasks.workunit.client.0.smithi043.stderr: -331> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed3c0) adding auth protocol: cephx 2024-09-12T00:41:07.241 INFO:tasks.workunit.client.0.smithi043.stderr: -330> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed3c0) adding auth protocol: cephx 2024-09-12T00:41:07.241 INFO:tasks.workunit.client.0.smithi043.stderr: -329> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed3c0) adding auth protocol: cephx 2024-09-12T00:41:07.241 INFO:tasks.workunit.client.0.smithi043.stderr: -328> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed3c0) adding con mode: secure 2024-09-12T00:41:07.241 INFO:tasks.workunit.client.0.smithi043.stderr: -327> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed3c0) adding con mode: crc 2024-09-12T00:41:07.242 INFO:tasks.workunit.client.0.smithi043.stderr: -326> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed3c0) adding con mode: secure 2024-09-12T00:41:07.242 INFO:tasks.workunit.client.0.smithi043.stderr: -325> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed3c0) adding con mode: crc 2024-09-12T00:41:07.242 INFO:tasks.workunit.client.0.smithi043.stderr: -324> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed3c0) adding con mode: secure 2024-09-12T00:41:07.242 INFO:tasks.workunit.client.0.smithi043.stderr: -323> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed3c0) adding con mode: crc 2024-09-12T00:41:07.242 INFO:tasks.workunit.client.0.smithi043.stderr: -322> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed3c0) adding con mode: crc 2024-09-12T00:41:07.242 INFO:tasks.workunit.client.0.smithi043.stderr: -321> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed3c0) adding con mode: secure 2024-09-12T00:41:07.242 INFO:tasks.workunit.client.0.smithi043.stderr: -320> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed3c0) adding con mode: crc 2024-09-12T00:41:07.242 INFO:tasks.workunit.client.0.smithi043.stderr: -319> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed3c0) adding con mode: secure 2024-09-12T00:41:07.242 INFO:tasks.workunit.client.0.smithi043.stderr: -318> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed3c0) adding con mode: crc 2024-09-12T00:41:07.242 INFO:tasks.workunit.client.0.smithi043.stderr: -317> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed3c0) adding con mode: secure 2024-09-12T00:41:07.242 INFO:tasks.workunit.client.0.smithi043.stderr: -316> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:07.242 INFO:tasks.workunit.client.0.smithi043.stderr: -315> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:07.243 INFO:tasks.workunit.client.0.smithi043.stderr: -314> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 asok(0x563fa59732b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe7f4ed508 EEXIST 2024-09-12T00:41:07.243 INFO:tasks.workunit.client.0.smithi043.stderr: -313> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:07.243 INFO:tasks.workunit.client.0.smithi043.stderr: -312> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:41:07.243 INFO:tasks.workunit.client.0.smithi043.stderr: -311> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient(hunting): picked mon.noname-c con 0x563fa5c1f560 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:41:07.243 INFO:tasks.workunit.client.0.smithi043.stderr: -310> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient(hunting): picked mon.noname-b con 0x563fa5c403c0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:41:07.243 INFO:tasks.workunit.client.0.smithi043.stderr: -309> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient(hunting): picked mon.noname-a con 0x563fa5c4ad40 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:41:07.243 INFO:tasks.workunit.client.0.smithi043.stderr: -308> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:07.243 INFO:tasks.workunit.client.0.smithi043.stderr: -307> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:07.243 INFO:tasks.workunit.client.0.smithi043.stderr: -306> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:07.243 INFO:tasks.workunit.client.0.smithi043.stderr: -305> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:07.243 INFO:tasks.workunit.client.0.smithi043.stderr: -304> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient(hunting): authenticate will time out at 2363.022572s 2024-09-12T00:41:07.244 INFO:tasks.workunit.client.0.smithi043.stderr: -303> 2024-09-12T00:41:07.031+0000 7f0ef2890640 10 monclient(hunting): get_auth_request con 0x563fa5c1f560 auth_method 0 2024-09-12T00:41:07.244 INFO:tasks.workunit.client.0.smithi043.stderr: -302> 2024-09-12T00:41:07.031+0000 7f0ef2890640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:07.244 INFO:tasks.workunit.client.0.smithi043.stderr: -301> 2024-09-12T00:41:07.031+0000 7f0ef2890640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:07.244 INFO:tasks.workunit.client.0.smithi043.stderr: -300> 2024-09-12T00:41:07.031+0000 7f0ef2890640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:07.244 INFO:tasks.workunit.client.0.smithi043.stderr: -299> 2024-09-12T00:41:07.031+0000 7f0ef3091640 10 monclient(hunting): get_auth_request con 0x563fa5c4ad40 auth_method 0 2024-09-12T00:41:07.244 INFO:tasks.workunit.client.0.smithi043.stderr: -298> 2024-09-12T00:41:07.031+0000 7f0ef3091640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:07.244 INFO:tasks.workunit.client.0.smithi043.stderr: -297> 2024-09-12T00:41:07.031+0000 7f0ef3091640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:07.244 INFO:tasks.workunit.client.0.smithi043.stderr: -296> 2024-09-12T00:41:07.031+0000 7f0ef3091640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:07.244 INFO:tasks.workunit.client.0.smithi043.stderr: -295> 2024-09-12T00:41:07.031+0000 7f0ef2890640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:07.244 INFO:tasks.workunit.client.0.smithi043.stderr: -294> 2024-09-12T00:41:07.031+0000 7f0ef2890640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:07.244 INFO:tasks.workunit.client.0.smithi043.stderr: -293> 2024-09-12T00:41:07.031+0000 7f0ef2890640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:07.245 INFO:tasks.workunit.client.0.smithi043.stderr: -292> 2024-09-12T00:41:07.031+0000 7f0ef3091640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:07.245 INFO:tasks.workunit.client.0.smithi043.stderr: -291> 2024-09-12T00:41:07.031+0000 7f0ef3091640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:07.245 INFO:tasks.workunit.client.0.smithi043.stderr: -290> 2024-09-12T00:41:07.031+0000 7f0ef3091640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:07.245 INFO:tasks.workunit.client.0.smithi043.stderr: -289> 2024-09-12T00:41:07.031+0000 7f0ef2890640 10 monclient(hunting): handle_auth_done global_id 7664 payload 274 2024-09-12T00:41:07.245 INFO:tasks.workunit.client.0.smithi043.stderr: -288> 2024-09-12T00:41:07.031+0000 7f0ef2890640 10 monclient: _finish_hunting 0 2024-09-12T00:41:07.245 INFO:tasks.workunit.client.0.smithi043.stderr: -287> 2024-09-12T00:41:07.031+0000 7f0ef2890640 1 monclient: found mon.noname-c 2024-09-12T00:41:07.245 INFO:tasks.workunit.client.0.smithi043.stderr: -286> 2024-09-12T00:41:07.031+0000 7f0ef2890640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:41:07.246 INFO:tasks.workunit.client.0.smithi043.stderr: -285> 2024-09-12T00:41:07.031+0000 7f0dd67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:07.246 INFO:tasks.workunit.client.0.smithi043.stderr: -284> 2024-09-12T00:41:07.031+0000 7f0dd67fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:41:07.246 INFO:tasks.workunit.client.0.smithi043.stderr: -283> 2024-09-12T00:41:07.031+0000 7f0dd67fc640 10 monclient: dump: 2024-09-12T00:41:07.246 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:07.246 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:07.246 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.246 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.246 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:07.246 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:07.246 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:07.246 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:07.246 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:07.247 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.247 INFO:tasks.workunit.client.0.smithi043.stderr: -282> 2024-09-12T00:41:07.031+0000 7f0dd67fc640 10 monclient: _finish_auth 0 2024-09-12T00:41:07.247 INFO:tasks.workunit.client.0.smithi043.stderr: -281> 2024-09-12T00:41:07.031+0000 7f0dd67fc640 10 monclient: _check_auth_tickets 2024-09-12T00:41:07.247 INFO:tasks.workunit.client.0.smithi043.stderr: -280> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 5 monclient: authenticate success, global_id 7664 2024-09-12T00:41:07.247 INFO:tasks.workunit.client.0.smithi043.stderr: -279> 2024-09-12T00:41:07.031+0000 7f0dd67fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:07.247 INFO:tasks.workunit.client.0.smithi043.stderr: -278> 2024-09-12T00:41:07.031+0000 7f0dd67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:07.247 INFO:tasks.workunit.client.0.smithi043.stderr: -277> 2024-09-12T00:41:07.031+0000 7f0dd67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:41:07.247 INFO:tasks.workunit.client.0.smithi043.stderr: -276> 2024-09-12T00:41:07.031+0000 7f0dd67fc640 10 monclient: dump: 2024-09-12T00:41:07.247 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:07.247 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:07.247 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.247 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.247 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:07.248 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:07.248 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:07.248 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:07.248 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:07.248 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.248 INFO:tasks.workunit.client.0.smithi043.stderr: -275> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:41:07.248 INFO:tasks.workunit.client.0.smithi043.stderr: -274> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 4 set_mon_vals no callback set 2024-09-12T00:41:07.248 INFO:tasks.workunit.client.0.smithi043.stderr: -273> 2024-09-12T00:41:07.031+0000 7f0ef4d8a9c0 10 monclient: shutdown 2024-09-12T00:41:07.248 INFO:tasks.workunit.client.0.smithi043.stderr: -272> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient: build_initial_monmap 2024-09-12T00:41:07.248 INFO:tasks.workunit.client.0.smithi043.stderr: -271> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 1 build_initial for_mkfs: 0 2024-09-12T00:41:07.248 INFO:tasks.workunit.client.0.smithi043.stderr: -270> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient: monmap: 2024-09-12T00:41:07.249 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:41:07.249 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:41:07.249 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:41:07.249 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:41:07.249 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:41:07.249 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:07.249 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:41:07.249 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:41:07.249 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:41:07.249 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.249 INFO:tasks.workunit.client.0.smithi043.stderr: -269> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b460) adding auth protocol: cephx 2024-09-12T00:41:07.249 INFO:tasks.workunit.client.0.smithi043.stderr: -268> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b460) adding auth protocol: cephx 2024-09-12T00:41:07.250 INFO:tasks.workunit.client.0.smithi043.stderr: -267> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b460) adding auth protocol: cephx 2024-09-12T00:41:07.250 INFO:tasks.workunit.client.0.smithi043.stderr: -266> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b460) adding con mode: secure 2024-09-12T00:41:07.250 INFO:tasks.workunit.client.0.smithi043.stderr: -265> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b460) adding con mode: crc 2024-09-12T00:41:07.250 INFO:tasks.workunit.client.0.smithi043.stderr: -264> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b460) adding con mode: secure 2024-09-12T00:41:07.250 INFO:tasks.workunit.client.0.smithi043.stderr: -263> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b460) adding con mode: crc 2024-09-12T00:41:07.250 INFO:tasks.workunit.client.0.smithi043.stderr: -262> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b460) adding con mode: secure 2024-09-12T00:41:07.250 INFO:tasks.workunit.client.0.smithi043.stderr: -261> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b460) adding con mode: crc 2024-09-12T00:41:07.250 INFO:tasks.workunit.client.0.smithi043.stderr: -260> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b460) adding con mode: crc 2024-09-12T00:41:07.250 INFO:tasks.workunit.client.0.smithi043.stderr: -259> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b460) adding con mode: secure 2024-09-12T00:41:07.250 INFO:tasks.workunit.client.0.smithi043.stderr: -258> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b460) adding con mode: crc 2024-09-12T00:41:07.250 INFO:tasks.workunit.client.0.smithi043.stderr: -257> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b460) adding con mode: secure 2024-09-12T00:41:07.251 INFO:tasks.workunit.client.0.smithi043.stderr: -256> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b460) adding con mode: crc 2024-09-12T00:41:07.251 INFO:tasks.workunit.client.0.smithi043.stderr: -255> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5c1b460) adding con mode: secure 2024-09-12T00:41:07.251 INFO:tasks.workunit.client.0.smithi043.stderr: -254> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:07.251 INFO:tasks.workunit.client.0.smithi043.stderr: -253> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 1 librados: starting msgr at 2024-09-12T00:41:07.251 INFO:tasks.workunit.client.0.smithi043.stderr: -252> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 1 librados: starting objecter 2024-09-12T00:41:07.251 INFO:tasks.workunit.client.0.smithi043.stderr: -251> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 asok(0x563fa59732b0) register_command objecter_requests cmddesc objecter_requests hook 0x563fa5c1d740 EEXIST 2024-09-12T00:41:07.251 INFO:tasks.workunit.client.0.smithi043.stderr: -250> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 1 librados: setting wanted keys 2024-09-12T00:41:07.251 INFO:tasks.workunit.client.0.smithi043.stderr: -249> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 1 librados: calling monclient init 2024-09-12T00:41:07.251 INFO:tasks.workunit.client.0.smithi043.stderr: -248> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient: init 2024-09-12T00:41:07.251 INFO:tasks.workunit.client.0.smithi043.stderr: -247> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bfd900) adding auth protocol: cephx 2024-09-12T00:41:07.251 INFO:tasks.workunit.client.0.smithi043.stderr: -246> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bfd900) adding auth protocol: cephx 2024-09-12T00:41:07.251 INFO:tasks.workunit.client.0.smithi043.stderr: -245> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bfd900) adding auth protocol: cephx 2024-09-12T00:41:07.252 INFO:tasks.workunit.client.0.smithi043.stderr: -244> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bfd900) adding con mode: secure 2024-09-12T00:41:07.252 INFO:tasks.workunit.client.0.smithi043.stderr: -243> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bfd900) adding con mode: crc 2024-09-12T00:41:07.252 INFO:tasks.workunit.client.0.smithi043.stderr: -242> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bfd900) adding con mode: secure 2024-09-12T00:41:07.252 INFO:tasks.workunit.client.0.smithi043.stderr: -241> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bfd900) adding con mode: crc 2024-09-12T00:41:07.252 INFO:tasks.workunit.client.0.smithi043.stderr: -240> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bfd900) adding con mode: secure 2024-09-12T00:41:07.252 INFO:tasks.workunit.client.0.smithi043.stderr: -239> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bfd900) adding con mode: crc 2024-09-12T00:41:07.252 INFO:tasks.workunit.client.0.smithi043.stderr: -238> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bfd900) adding con mode: crc 2024-09-12T00:41:07.252 INFO:tasks.workunit.client.0.smithi043.stderr: -237> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bfd900) adding con mode: secure 2024-09-12T00:41:07.252 INFO:tasks.workunit.client.0.smithi043.stderr: -236> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bfd900) adding con mode: crc 2024-09-12T00:41:07.252 INFO:tasks.workunit.client.0.smithi043.stderr: -235> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bfd900) adding con mode: secure 2024-09-12T00:41:07.253 INFO:tasks.workunit.client.0.smithi043.stderr: -234> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bfd900) adding con mode: crc 2024-09-12T00:41:07.253 INFO:tasks.workunit.client.0.smithi043.stderr: -233> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 AuthRegistry(0x563fa5bfd900) adding con mode: secure 2024-09-12T00:41:07.253 INFO:tasks.workunit.client.0.smithi043.stderr: -232> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:07.253 INFO:tasks.workunit.client.0.smithi043.stderr: -231> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:07.253 INFO:tasks.workunit.client.0.smithi043.stderr: -230> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 asok(0x563fa59732b0) register_command rotate-key cmddesc rotate-key hook 0x563fa5bfda48 EEXIST 2024-09-12T00:41:07.253 INFO:tasks.workunit.client.0.smithi043.stderr: -229> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:07.253 INFO:tasks.workunit.client.0.smithi043.stderr: -228> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:41:07.253 INFO:tasks.workunit.client.0.smithi043.stderr: -227> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient(hunting): picked mon.noname-c con 0x563fa5c1f560 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:41:07.254 INFO:tasks.workunit.client.0.smithi043.stderr: -226> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient(hunting): picked mon.noname-b con 0x563fa5c403c0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:41:07.254 INFO:tasks.workunit.client.0.smithi043.stderr: -225> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient(hunting): picked mon.noname-a con 0x563fa5c4ad40 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:41:07.254 INFO:tasks.workunit.client.0.smithi043.stderr: -224> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:07.254 INFO:tasks.workunit.client.0.smithi043.stderr: -223> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:07.254 INFO:tasks.workunit.client.0.smithi043.stderr: -222> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:07.254 INFO:tasks.workunit.client.0.smithi043.stderr: -221> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:07.254 INFO:tasks.workunit.client.0.smithi043.stderr: -220> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient(hunting): authenticate will time out at 2363.025341s 2024-09-12T00:41:07.255 INFO:tasks.workunit.client.0.smithi043.stderr: -219> 2024-09-12T00:41:07.035+0000 7f0ef2890640 10 monclient(hunting): get_auth_request con 0x563fa5c1f560 auth_method 0 2024-09-12T00:41:07.255 INFO:tasks.workunit.client.0.smithi043.stderr: -218> 2024-09-12T00:41:07.035+0000 7f0ef2890640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:07.255 INFO:tasks.workunit.client.0.smithi043.stderr: -217> 2024-09-12T00:41:07.035+0000 7f0ef2890640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:07.255 INFO:tasks.workunit.client.0.smithi043.stderr: -216> 2024-09-12T00:41:07.035+0000 7f0ef2890640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:07.255 INFO:tasks.workunit.client.0.smithi043.stderr: -215> 2024-09-12T00:41:07.035+0000 7f0ef3091640 10 monclient(hunting): get_auth_request con 0x563fa5c4ad40 auth_method 0 2024-09-12T00:41:07.255 INFO:tasks.workunit.client.0.smithi043.stderr: -214> 2024-09-12T00:41:07.035+0000 7f0ef3091640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:07.255 INFO:tasks.workunit.client.0.smithi043.stderr: -213> 2024-09-12T00:41:07.035+0000 7f0ef3091640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:07.255 INFO:tasks.workunit.client.0.smithi043.stderr: -212> 2024-09-12T00:41:07.035+0000 7f0ef3091640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:07.255 INFO:tasks.workunit.client.0.smithi043.stderr: -211> 2024-09-12T00:41:07.035+0000 7f0ef2890640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:07.255 INFO:tasks.workunit.client.0.smithi043.stderr: -210> 2024-09-12T00:41:07.035+0000 7f0ef2890640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:07.255 INFO:tasks.workunit.client.0.smithi043.stderr: -209> 2024-09-12T00:41:07.035+0000 7f0ef2890640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:07.256 INFO:tasks.workunit.client.0.smithi043.stderr: -208> 2024-09-12T00:41:07.035+0000 7f0ef3091640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:07.256 INFO:tasks.workunit.client.0.smithi043.stderr: -207> 2024-09-12T00:41:07.035+0000 7f0ef3091640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:07.256 INFO:tasks.workunit.client.0.smithi043.stderr: -206> 2024-09-12T00:41:07.035+0000 7f0ef3091640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:07.256 INFO:tasks.workunit.client.0.smithi043.stderr: -205> 2024-09-12T00:41:07.035+0000 7f0ef208f640 10 monclient(hunting): get_auth_request con 0x563fa5c403c0 auth_method 0 2024-09-12T00:41:07.256 INFO:tasks.workunit.client.0.smithi043.stderr: -204> 2024-09-12T00:41:07.035+0000 7f0ef208f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:07.256 INFO:tasks.workunit.client.0.smithi043.stderr: -203> 2024-09-12T00:41:07.035+0000 7f0ef208f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:07.256 INFO:tasks.workunit.client.0.smithi043.stderr: -202> 2024-09-12T00:41:07.035+0000 7f0ef208f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:07.256 INFO:tasks.workunit.client.0.smithi043.stderr: -201> 2024-09-12T00:41:07.035+0000 7f0ef2890640 10 monclient(hunting): handle_auth_done global_id 7667 payload 824 2024-09-12T00:41:07.256 INFO:tasks.workunit.client.0.smithi043.stderr: -200> 2024-09-12T00:41:07.035+0000 7f0ef2890640 10 monclient: _finish_hunting 0 2024-09-12T00:41:07.256 INFO:tasks.workunit.client.0.smithi043.stderr: -199> 2024-09-12T00:41:07.035+0000 7f0ef2890640 1 monclient: found mon.noname-c 2024-09-12T00:41:07.256 INFO:tasks.workunit.client.0.smithi043.stderr: -198> 2024-09-12T00:41:07.035+0000 7f0ef2890640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:41:07.257 INFO:tasks.workunit.client.0.smithi043.stderr: -197> 2024-09-12T00:41:07.035+0000 7f0dd4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:07.257 INFO:tasks.workunit.client.0.smithi043.stderr: -196> 2024-09-12T00:41:07.035+0000 7f0dd4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:41:07.257 INFO:tasks.workunit.client.0.smithi043.stderr: -195> 2024-09-12T00:41:07.035+0000 7f0dd4ff9640 10 monclient: dump: 2024-09-12T00:41:07.257 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:07.257 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:07.257 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.257 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.257 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:07.257 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:07.257 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:07.258 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:07.258 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:07.258 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.258 INFO:tasks.workunit.client.0.smithi043.stderr: -194> 2024-09-12T00:41:07.035+0000 7f0dd4ff9640 10 monclient: _finish_auth 0 2024-09-12T00:41:07.258 INFO:tasks.workunit.client.0.smithi043.stderr: -193> 2024-09-12T00:41:07.035+0000 7f0dd4ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:41:07.258 INFO:tasks.workunit.client.0.smithi043.stderr: -192> 2024-09-12T00:41:07.035+0000 7f0dd4ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:07.258 INFO:tasks.workunit.client.0.smithi043.stderr: -191> 2024-09-12T00:41:07.035+0000 7f0dd4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:07.258 INFO:tasks.workunit.client.0.smithi043.stderr: -190> 2024-09-12T00:41:07.035+0000 7f0dd4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:41:07.258 INFO:tasks.workunit.client.0.smithi043.stderr: -189> 2024-09-12T00:41:07.035+0000 7f0dd4ff9640 10 monclient: dump: 2024-09-12T00:41:07.258 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:07.258 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:07.258 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.259 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:07.259 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:07.259 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:07.259 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:07.259 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:07.259 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:07.259 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.259 INFO:tasks.workunit.client.0.smithi043.stderr: -188> 2024-09-12T00:41:07.035+0000 7f0dd67fc640 4 set_mon_vals no callback set 2024-09-12T00:41:07.259 INFO:tasks.workunit.client.0.smithi043.stderr: -187> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 monclient: authenticate success, global_id 7667 2024-09-12T00:41:07.259 INFO:tasks.workunit.client.0.smithi043.stderr: -186> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient: _renew_subs 2024-09-12T00:41:07.259 INFO:tasks.workunit.client.0.smithi043.stderr: -185> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:41:07.260 INFO:tasks.workunit.client.0.smithi043.stderr: -184> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient: _renew_subs 2024-09-12T00:41:07.260 INFO:tasks.workunit.client.0.smithi043.stderr: -183> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:41:07.260 INFO:tasks.workunit.client.0.smithi043.stderr: -182> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 1 librados: init done 2024-09-12T00:41:07.260 INFO:tasks.workunit.client.0.smithi043.stderr: -181> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 5 asok(0x563fa59732b0) register_command cr dump hook 0x563fa5c3e718 2024-09-12T00:41:07.260 INFO:tasks.workunit.client.0.smithi043.stderr: -180> 2024-09-12T00:41:07.035+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.260 INFO:tasks.workunit.client.0.smithi043.stderr: -179> 2024-09-12T00:41:07.039+0000 7f0dd4ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:41:07.260 INFO:tasks.workunit.client.0.smithi043.stderr: -178> 2024-09-12T00:41:07.039+0000 7f0dd4ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:41:07.260 INFO:tasks.workunit.client.0.smithi043.stderr: -177> 2024-09-12T00:41:07.039+0000 7f0dd4ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:41:07.260 INFO:tasks.workunit.client.0.smithi043.stderr: -176> 2024-09-12T00:41:07.039+0000 7f0ef208f640 10 monclient: get_auth_request con 0x7f0dbc070ae0 auth_method 0 2024-09-12T00:41:07.260 INFO:tasks.workunit.client.0.smithi043.stderr: -175> 2024-09-12T00:41:07.039+0000 7f0ef3091640 10 monclient: get_auth_request con 0x563fa5c69400 auth_method 0 2024-09-12T00:41:07.261 INFO:tasks.workunit.client.0.smithi043.stderr: -174> 2024-09-12T00:41:07.039+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.261 INFO:tasks.workunit.client.0.smithi043.stderr: -173> 2024-09-12T00:41:07.039+0000 7f0ef4d8a9c0 20 realm 2024-09-12T00:41:07.261 INFO:tasks.workunit.client.0.smithi043.stderr: -172> 2024-09-12T00:41:07.039+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.261 INFO:tasks.workunit.client.0.smithi043.stderr: -171> 2024-09-12T00:41:07.039+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.261 INFO:tasks.workunit.client.0.smithi043.stderr: -170> 2024-09-12T00:41:07.039+0000 7f0ef4d8a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:07.261 INFO:tasks.workunit.client.0.smithi043.stderr: -169> 2024-09-12T00:41:07.039+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.261 INFO:tasks.workunit.client.0.smithi043.stderr: -168> 2024-09-12T00:41:07.039+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.261 INFO:tasks.workunit.client.0.smithi043.stderr: -167> 2024-09-12T00:41:07.039+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.261 INFO:tasks.workunit.client.0.smithi043.stderr: -166> 2024-09-12T00:41:07.039+0000 7f0ef2890640 10 monclient: get_auth_request con 0x563fa5c6d7b0 auth_method 0 2024-09-12T00:41:07.261 INFO:tasks.workunit.client.0.smithi043.stderr: -165> 2024-09-12T00:41:07.039+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:07.261 INFO:tasks.workunit.client.0.smithi043.stderr: -164> 2024-09-12T00:41:07.039+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.262 INFO:tasks.workunit.client.0.smithi043.stderr: -163> 2024-09-12T00:41:07.039+0000 7f0ef208f640 10 monclient: get_auth_request con 0x563fa5c70ed0 auth_method 0 2024-09-12T00:41:07.262 INFO:tasks.workunit.client.0.smithi043.stderr: -162> 2024-09-12T00:41:07.043+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:07.262 INFO:tasks.workunit.client.0.smithi043.stderr: -161> 2024-09-12T00:41:07.043+0000 7f0ef4d8a9c0 20 searching for the correct realm 2024-09-12T00:41:07.262 INFO:tasks.workunit.client.0.smithi043.stderr: -160> 2024-09-12T00:41:07.043+0000 7f0ef3091640 10 monclient: get_auth_request con 0x563fa5c75c90 auth_method 0 2024-09-12T00:41:07.262 INFO:tasks.workunit.client.0.smithi043.stderr: -159> 2024-09-12T00:41:07.043+0000 7f0ef2890640 10 monclient: get_auth_request con 0x7f0eec086120 auth_method 0 2024-09-12T00:41:07.262 INFO:tasks.workunit.client.0.smithi043.stderr: -158> 2024-09-12T00:41:07.043+0000 7f0ef208f640 10 monclient: get_auth_request con 0x7f0ee80e0040 auth_method 0 2024-09-12T00:41:07.262 INFO:tasks.workunit.client.0.smithi043.stderr: -157> 2024-09-12T00:41:07.047+0000 7f0ef3091640 0 -- 172.21.15.43:0/3869858544 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x563fa5c69400 msgr2=0x563fa5c6b8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:41:07.262 INFO:tasks.workunit.client.0.smithi043.stderr: -156> 2024-09-12T00:41:07.047+0000 7f0dd4ff9640 1 client.7667.objecter ms_handle_reset 0x563fa5c69400 session 0x563fa5c68d30 osd.1 2024-09-12T00:41:07.262 INFO:tasks.workunit.client.0.smithi043.stderr: -155> 2024-09-12T00:41:07.047+0000 7f0dd4ff9640 10 monclient: _renew_subs 2024-09-12T00:41:07.262 INFO:tasks.workunit.client.0.smithi043.stderr: -154> 2024-09-12T00:41:07.047+0000 7f0dd4ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:41:07.263 INFO:tasks.workunit.client.0.smithi043.stderr: -153> 2024-09-12T00:41:07.047+0000 7f0ef3091640 10 monclient: get_auth_request con 0x7f0dbc080b00 auth_method 0 2024-09-12T00:41:07.263 INFO:tasks.workunit.client.0.smithi043.stderr: -152> 2024-09-12T00:41:07.047+0000 7f0ef3091640 10 monclient: get_auth_request con 0x7f0ee80e1b90 auth_method 0 2024-09-12T00:41:07.263 INFO:tasks.workunit.client.0.smithi043.stderr: -151> 2024-09-12T00:41:07.051+0000 7f0ef2890640 10 monclient: get_auth_request con 0x7f0ee80d2910 auth_method 0 2024-09-12T00:41:07.263 INFO:tasks.workunit.client.0.smithi043.stderr: -150> 2024-09-12T00:41:07.055+0000 7f0ef2890640 0 -- 172.21.15.43:0/3869858544 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f0ee80d2910 msgr2=0x7f0ee80f33f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:07.263 INFO:tasks.workunit.client.0.smithi043.stderr: -149> 2024-09-12T00:41:07.055+0000 7f0dd4ff9640 1 client.7667.objecter ms_handle_reset 0x7f0ee80d2910 session 0x7f0ee80dfe60 osd.0 2024-09-12T00:41:07.263 INFO:tasks.workunit.client.0.smithi043.stderr: -148> 2024-09-12T00:41:07.055+0000 7f0ef2890640 10 monclient: get_auth_request con 0x563fa5c69400 auth_method 0 2024-09-12T00:41:07.263 INFO:tasks.workunit.client.0.smithi043.stderr: -147> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:41:07.263 INFO:tasks.workunit.client.0.smithi043.stderr: -146> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:07.263 INFO:tasks.workunit.client.0.smithi043.stderr: -145> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:07.263 INFO:tasks.workunit.client.0.smithi043.stderr: -144> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:41:07.263 INFO:tasks.workunit.client.0.smithi043.stderr: -143> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:07.264 INFO:tasks.workunit.client.0.smithi043.stderr: -142> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:07.264 INFO:tasks.workunit.client.0.smithi043.stderr: -141> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.264 INFO:tasks.workunit.client.0.smithi043.stderr: -140> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.264 INFO:tasks.workunit.client.0.smithi043.stderr: -139> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.264 INFO:tasks.workunit.client.0.smithi043.stderr: -138> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:07.264 INFO:tasks.workunit.client.0.smithi043.stderr: -137> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.264 INFO:tasks.workunit.client.0.smithi043.stderr: -136> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:07.264 INFO:tasks.workunit.client.0.smithi043.stderr: -135> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 zone default found 2024-09-12T00:41:07.264 INFO:tasks.workunit.client.0.smithi043.stderr: -134> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 4 Realm: () 2024-09-12T00:41:07.264 INFO:tasks.workunit.client.0.smithi043.stderr: -133> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:41:07.264 INFO:tasks.workunit.client.0.smithi043.stderr: -132> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:41:07.265 INFO:tasks.workunit.client.0.smithi043.stderr: -131> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:07.265 INFO:tasks.workunit.client.0.smithi043.stderr: -130> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 zonegroup default 2024-09-12T00:41:07.265 INFO:tasks.workunit.client.0.smithi043.stderr: -129> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.265 INFO:tasks.workunit.client.0.smithi043.stderr: -128> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.265 INFO:tasks.workunit.client.0.smithi043.stderr: -127> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.265 INFO:tasks.workunit.client.0.smithi043.stderr: -126> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.265 INFO:tasks.workunit.client.0.smithi043.stderr: -125> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.265 INFO:tasks.workunit.client.0.smithi043.stderr: -124> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.265 INFO:tasks.workunit.client.0.smithi043.stderr: -123> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 started sync module instance, tier type = 2024-09-12T00:41:07.265 INFO:tasks.workunit.client.0.smithi043.stderr: -122> 2024-09-12T00:41:07.063+0000 7f0ef4d8a9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:41:07.265 INFO:tasks.workunit.client.0.smithi043.stderr: -121> 2024-09-12T00:41:07.079+0000 7f0ef4d8a9c0 20 add_watcher() i=0 2024-09-12T00:41:07.266 INFO:tasks.workunit.client.0.smithi043.stderr: -120> 2024-09-12T00:41:07.079+0000 7f0ef4d8a9c0 20 add_watcher() i=1 2024-09-12T00:41:07.266 INFO:tasks.workunit.client.0.smithi043.stderr: -119> 2024-09-12T00:41:07.079+0000 7f0ef4d8a9c0 20 add_watcher() i=2 2024-09-12T00:41:07.266 INFO:tasks.workunit.client.0.smithi043.stderr: -118> 2024-09-12T00:41:07.079+0000 7f0ef4d8a9c0 20 add_watcher() i=3 2024-09-12T00:41:07.266 INFO:tasks.workunit.client.0.smithi043.stderr: -117> 2024-09-12T00:41:07.079+0000 7f0ef4d8a9c0 20 add_watcher() i=4 2024-09-12T00:41:07.266 INFO:tasks.workunit.client.0.smithi043.stderr: -116> 2024-09-12T00:41:07.079+0000 7f0ef4d8a9c0 20 add_watcher() i=5 2024-09-12T00:41:07.266 INFO:tasks.workunit.client.0.smithi043.stderr: -115> 2024-09-12T00:41:07.083+0000 7f0ef4d8a9c0 20 add_watcher() i=6 2024-09-12T00:41:07.266 INFO:tasks.workunit.client.0.smithi043.stderr: -114> 2024-09-12T00:41:07.083+0000 7f0ef4d8a9c0 20 add_watcher() i=7 2024-09-12T00:41:07.266 INFO:tasks.workunit.client.0.smithi043.stderr: -113> 2024-09-12T00:41:07.083+0000 7f0ef4d8a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:07.266 INFO:tasks.workunit.client.0.smithi043.stderr: -112> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed8a0) adding auth protocol: cephx 2024-09-12T00:41:07.266 INFO:tasks.workunit.client.0.smithi043.stderr: -111> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed8a0) adding auth protocol: cephx 2024-09-12T00:41:07.266 INFO:tasks.workunit.client.0.smithi043.stderr: -110> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed8a0) adding auth protocol: cephx 2024-09-12T00:41:07.266 INFO:tasks.workunit.client.0.smithi043.stderr: -109> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed8a0) adding con mode: secure 2024-09-12T00:41:07.267 INFO:tasks.workunit.client.0.smithi043.stderr: -108> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed8a0) adding con mode: crc 2024-09-12T00:41:07.267 INFO:tasks.workunit.client.0.smithi043.stderr: -107> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed8a0) adding con mode: secure 2024-09-12T00:41:07.267 INFO:tasks.workunit.client.0.smithi043.stderr: -106> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed8a0) adding con mode: crc 2024-09-12T00:41:07.267 INFO:tasks.workunit.client.0.smithi043.stderr: -105> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed8a0) adding con mode: secure 2024-09-12T00:41:07.267 INFO:tasks.workunit.client.0.smithi043.stderr: -104> 2024-09-12T00:41:07.087+0000 7f0da97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:07.267 INFO:tasks.workunit.client.0.smithi043.stderr: -103> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed8a0) adding con mode: crc 2024-09-12T00:41:07.267 INFO:tasks.workunit.client.0.smithi043.stderr: -102> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed8a0) adding con mode: crc 2024-09-12T00:41:07.268 INFO:tasks.workunit.client.0.smithi043.stderr: -101> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed8a0) adding con mode: secure 2024-09-12T00:41:07.268 INFO:tasks.workunit.client.0.smithi043.stderr: -100> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed8a0) adding con mode: crc 2024-09-12T00:41:07.268 INFO:tasks.workunit.client.0.smithi043.stderr: -99> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed8a0) adding con mode: secure 2024-09-12T00:41:07.268 INFO:tasks.workunit.client.0.smithi043.stderr: -98> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed8a0) adding con mode: crc 2024-09-12T00:41:07.268 INFO:tasks.workunit.client.0.smithi043.stderr: -97> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 AuthRegistry(0x7ffe7f4ed8a0) adding con mode: secure 2024-09-12T00:41:07.268 INFO:tasks.workunit.client.0.smithi043.stderr: -96> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:07.268 INFO:tasks.workunit.client.0.smithi043.stderr: -95> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:07.268 INFO:tasks.workunit.client.0.smithi043.stderr: -94> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:07.268 INFO:tasks.workunit.client.0.smithi043.stderr: -93> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 asok(0x563fa59732b0) register_command cache list hook 0x563fa5c43880 2024-09-12T00:41:07.268 INFO:tasks.workunit.client.0.smithi043.stderr: -92> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 asok(0x563fa59732b0) register_command cache inspect hook 0x563fa5c43880 2024-09-12T00:41:07.268 INFO:tasks.workunit.client.0.smithi043.stderr: -91> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 asok(0x563fa59732b0) register_command cache erase hook 0x563fa5c43880 2024-09-12T00:41:07.269 INFO:tasks.workunit.client.0.smithi043.stderr: -90> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 asok(0x563fa59732b0) register_command cache zap hook 0x563fa5c43880 2024-09-12T00:41:07.269 INFO:tasks.workunit.client.0.smithi043.stderr: -89> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 note: GC not initialized 2024-09-12T00:41:07.269 INFO:tasks.workunit.client.0.smithi043.stderr: -88> 2024-09-12T00:41:07.087+0000 7f0d23fff640 20 reqs_thread_entry: start 2024-09-12T00:41:07.269 INFO:tasks.workunit.client.0.smithi043.stderr: -87> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 asok(0x563fa59732b0) register_command sync trace show hook 0x7f0eec0048d0 2024-09-12T00:41:07.269 INFO:tasks.workunit.client.0.smithi043.stderr: -86> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 asok(0x563fa59732b0) register_command sync trace history hook 0x7f0eec0048d0 2024-09-12T00:41:07.269 INFO:tasks.workunit.client.0.smithi043.stderr: -85> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 asok(0x563fa59732b0) register_command sync trace active hook 0x7f0eec0048d0 2024-09-12T00:41:07.269 INFO:tasks.workunit.client.0.smithi043.stderr: -84> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 5 asok(0x563fa59732b0) register_command sync trace active_short hook 0x7f0eec0048d0 2024-09-12T00:41:07.269 INFO:tasks.workunit.client.0.smithi043.stderr: -83> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:07.269 INFO:tasks.workunit.client.0.smithi043.stderr: -82> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 20 Filter name: none 2024-09-12T00:41:07.269 INFO:tasks.workunit.client.0.smithi043.stderr: -81> 2024-09-12T00:41:07.087+0000 7f0d21ffb640 20 reqs_thread_entry: start 2024-09-12T00:41:07.270 INFO:tasks.workunit.client.0.smithi043.stderr: -80> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:41:07.270 INFO:tasks.workunit.client.0.smithi043.stderr: -79> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.270 INFO:tasks.workunit.client.0.smithi043.stderr: -78> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:41:07.270 INFO:tasks.workunit.client.0.smithi043.stderr: -77> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:41:07.270 INFO:tasks.workunit.client.0.smithi043.stderr: -76> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:41:07.270 INFO:tasks.workunit.client.0.smithi043.stderr: -75> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 : miss 2024-09-12T00:41:07.270 INFO:tasks.workunit.client.0.smithi043.stderr: -74> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.270 INFO:tasks.workunit.client.0.smithi043.stderr: -73> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:41:07.270 INFO:tasks.workunit.client.0.smithi043.stderr: -72> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:41:07.270 INFO:tasks.workunit.client.0.smithi043.stderr: -71> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:41:07.270 INFO:tasks.workunit.client.0.smithi043.stderr: -70> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:41:07.271 INFO:tasks.workunit.client.0.smithi043.stderr: -69> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:07.271 INFO:tasks.workunit.client.0.smithi043.stderr: -68> 2024-09-12T00:41:07.087+0000 7f0ef4d8a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 2024-09-12T00:41:07.271 INFO:tasks.workunit.client.0.smithi043.stderr: -67> 2024-09-12T00:41:07.099+0000 7f0ef4d8a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:41:07.271 INFO:tasks.workunit.client.0.smithi043.stderr: -66> 2024-09-12T00:41:07.099+0000 7f0ef4d8a9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:41:07.271 INFO:tasks.workunit.client.0.smithi043.stderr: -65> 2024-09-12T00:41:07.099+0000 7f0ef4d8a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:07.271 INFO:tasks.workunit.client.0.smithi043.stderr: -64> 2024-09-12T00:41:07.099+0000 7f0ef4d8a9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17, ofs0, ns] 2024-09-12T00:41:07.271 INFO:tasks.workunit.client.0.smithi043.stderr: -63> 2024-09-12T00:41:07.099+0000 7f0dd5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333526 cookie 94831364255232 notifier 7667 bl.length()=827 2024-09-12T00:41:07.271 INFO:tasks.workunit.client.0.smithi043.stderr: -62> 2024-09-12T00:41:07.099+0000 7f0dd5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:41:07.271 INFO:tasks.workunit.client.0.smithi043.stderr: -61> 2024-09-12T00:41:07.099+0000 7f0dd5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:41:07.272 INFO:tasks.workunit.client.0.smithi043.stderr: -60> 2024-09-12T00:41:07.099+0000 7f0dd5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:07.272 INFO:tasks.workunit.client.0.smithi043.stderr: -59> 2024-09-12T00:41:07.099+0000 7f0ef4d8a9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_sources= new_sources= 2024-09-12T00:41:07.272 INFO:tasks.workunit.client.0.smithi043.stderr: -58> 2024-09-12T00:41:07.099+0000 7f0ef4d8a9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential sources added=[] removed=[] 2024-09-12T00:41:07.272 INFO:tasks.workunit.client.0.smithi043.stderr: -57> 2024-09-12T00:41:07.099+0000 7f0ef4d8a9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_dests= new_dests= 2024-09-12T00:41:07.272 INFO:tasks.workunit.client.0.smithi043.stderr: -56> 2024-09-12T00:41:07.099+0000 7f0ef4d8a9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential dests added=[] removed=[] 2024-09-12T00:41:07.272 INFO:tasks.workunit.client.0.smithi043.stderr: -55> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.0 2024-09-12T00:41:07.272 INFO:tasks.workunit.client.0.smithi043.stderr: -54> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.0 2024-09-12T00:41:07.272 INFO:tasks.workunit.client.0.smithi043.stderr: -53> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.1 2024-09-12T00:41:07.272 INFO:tasks.workunit.client.0.smithi043.stderr: -52> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.1 2024-09-12T00:41:07.272 INFO:tasks.workunit.client.0.smithi043.stderr: -51> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.2 2024-09-12T00:41:07.272 INFO:tasks.workunit.client.0.smithi043.stderr: -50> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.2 2024-09-12T00:41:07.273 INFO:tasks.workunit.client.0.smithi043.stderr: -49> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.3 2024-09-12T00:41:07.273 INFO:tasks.workunit.client.0.smithi043.stderr: -48> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.3 2024-09-12T00:41:07.273 INFO:tasks.workunit.client.0.smithi043.stderr: -47> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.4 2024-09-12T00:41:07.273 INFO:tasks.workunit.client.0.smithi043.stderr: -46> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.4 2024-09-12T00:41:07.273 INFO:tasks.workunit.client.0.smithi043.stderr: -45> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.5 2024-09-12T00:41:07.273 INFO:tasks.workunit.client.0.smithi043.stderr: -44> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.5 2024-09-12T00:41:07.273 INFO:tasks.workunit.client.0.smithi043.stderr: -43> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.6 2024-09-12T00:41:07.273 INFO:tasks.workunit.client.0.smithi043.stderr: -42> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.6 2024-09-12T00:41:07.273 INFO:tasks.workunit.client.0.smithi043.stderr: -41> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.7 2024-09-12T00:41:07.273 INFO:tasks.workunit.client.0.smithi043.stderr: -40> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.7 2024-09-12T00:41:07.274 INFO:tasks.workunit.client.0.smithi043.stderr: -39> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.8 2024-09-12T00:41:07.274 INFO:tasks.workunit.client.0.smithi043.stderr: -38> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.8 2024-09-12T00:41:07.274 INFO:tasks.workunit.client.0.smithi043.stderr: -37> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.9 2024-09-12T00:41:07.274 INFO:tasks.workunit.client.0.smithi043.stderr: -36> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.9 2024-09-12T00:41:07.274 INFO:tasks.workunit.client.0.smithi043.stderr: -35> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.10 2024-09-12T00:41:07.274 INFO:tasks.workunit.client.0.smithi043.stderr: -34> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.10 2024-09-12T00:41:07.274 INFO:tasks.workunit.client.0.smithi043.stderr: -33> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.11 2024-09-12T00:41:07.274 INFO:tasks.workunit.client.0.smithi043.stderr: -32> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.11 2024-09-12T00:41:07.274 INFO:tasks.workunit.client.0.smithi043.stderr: -31> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.12 2024-09-12T00:41:07.274 INFO:tasks.workunit.client.0.smithi043.stderr: -30> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.12 2024-09-12T00:41:07.274 INFO:tasks.workunit.client.0.smithi043.stderr: -29> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.13 2024-09-12T00:41:07.275 INFO:tasks.workunit.client.0.smithi043.stderr: -28> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.13 2024-09-12T00:41:07.275 INFO:tasks.workunit.client.0.smithi043.stderr: -27> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.0 2024-09-12T00:41:07.275 INFO:tasks.workunit.client.0.smithi043.stderr: -26> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.0 2024-09-12T00:41:07.275 INFO:tasks.workunit.client.0.smithi043.stderr: -25> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.1 2024-09-12T00:41:07.275 INFO:tasks.workunit.client.0.smithi043.stderr: -24> 2024-09-12T00:41:07.111+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.1 2024-09-12T00:41:07.275 INFO:tasks.workunit.client.0.smithi043.stderr: -23> 2024-09-12T00:41:07.115+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.2 2024-09-12T00:41:07.275 INFO:tasks.workunit.client.0.smithi043.stderr: -22> 2024-09-12T00:41:07.115+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.2 2024-09-12T00:41:07.275 INFO:tasks.workunit.client.0.smithi043.stderr: -21> 2024-09-12T00:41:07.115+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.3 2024-09-12T00:41:07.275 INFO:tasks.workunit.client.0.smithi043.stderr: -20> 2024-09-12T00:41:07.115+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.3 2024-09-12T00:41:07.275 INFO:tasks.workunit.client.0.smithi043.stderr: -19> 2024-09-12T00:41:07.115+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.4 2024-09-12T00:41:07.275 INFO:tasks.workunit.client.0.smithi043.stderr: -18> 2024-09-12T00:41:07.115+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.4 2024-09-12T00:41:07.275 INFO:tasks.workunit.client.0.smithi043.stderr: -17> 2024-09-12T00:41:07.115+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.5 2024-09-12T00:41:07.275 INFO:tasks.workunit.client.0.smithi043.stderr: -16> 2024-09-12T00:41:07.115+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.5 2024-09-12T00:41:07.276 INFO:tasks.workunit.client.0.smithi043.stderr: -15> 2024-09-12T00:41:07.115+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.6 2024-09-12T00:41:07.276 INFO:tasks.workunit.client.0.smithi043.stderr: -14> 2024-09-12T00:41:07.115+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.6 2024-09-12T00:41:07.276 INFO:tasks.workunit.client.0.smithi043.stderr: -13> 2024-09-12T00:41:07.119+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.7 2024-09-12T00:41:07.276 INFO:tasks.workunit.client.0.smithi043.stderr: -12> 2024-09-12T00:41:07.119+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.7 2024-09-12T00:41:07.276 INFO:tasks.workunit.client.0.smithi043.stderr: -11> 2024-09-12T00:41:07.119+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.8 2024-09-12T00:41:07.276 INFO:tasks.workunit.client.0.smithi043.stderr: -10> 2024-09-12T00:41:07.119+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.8 2024-09-12T00:41:07.276 INFO:tasks.workunit.client.0.smithi043.stderr: -9> 2024-09-12T00:41:07.119+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.9 2024-09-12T00:41:07.276 INFO:tasks.workunit.client.0.smithi043.stderr: -8> 2024-09-12T00:41:07.119+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.9 2024-09-12T00:41:07.276 INFO:tasks.workunit.client.0.smithi043.stderr: -7> 2024-09-12T00:41:07.119+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.10 2024-09-12T00:41:07.276 INFO:tasks.workunit.client.0.smithi043.stderr: -6> 2024-09-12T00:41:07.119+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.10 2024-09-12T00:41:07.276 INFO:tasks.workunit.client.0.smithi043.stderr: -5> 2024-09-12T00:41:07.119+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.11 2024-09-12T00:41:07.277 INFO:tasks.workunit.client.0.smithi043.stderr: -4> 2024-09-12T00:41:07.119+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.11 2024-09-12T00:41:07.277 INFO:tasks.workunit.client.0.smithi043.stderr: -3> 2024-09-12T00:41:07.123+0000 7f0ef4d8a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.12 2024-09-12T00:41:07.277 INFO:tasks.workunit.client.0.smithi043.stderr: -2> 2024-09-12T00:41:07.123+0000 7f0ef4d8a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.12 2024-09-12T00:41:07.277 INFO:tasks.workunit.client.0.smithi043.stderr: -1> 2024-09-12T00:41:07.127+0000 7f0ef4d8a9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0ef4d8a9c0 time 2024-09-12T00:41:07.129497+0000 2024-09-12T00:41:07.277 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:41:07.277 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.277 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:07.277 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0ef86642eb] 2024-09-12T00:41:07.277 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0ef866449f] 2024-09-12T00:41:07.277 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563fa2d8acc1] 2024-09-12T00:41:07.277 INFO:tasks.workunit.client.0.smithi043.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x563fa2d9f01c] 2024-09-12T00:41:07.277 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563fa2da06a4] 2024-09-12T00:41:07.278 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:41:07.278 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0ef74cad90] 2024-09-12T00:41:07.278 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:41:07.278 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:41:07.278 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.278 INFO:tasks.workunit.client.0.smithi043.stderr: 0> 2024-09-12T00:41:07.127+0000 7f0ef4d8a9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:41:07.278 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7f0ef4d8a9c0 thread_name:radosgw-admin 2024-09-12T00:41:07.279 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.279 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:07.279 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0ef74e3520] 2024-09-12T00:41:07.279 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:41:07.279 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:41:07.279 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:41:07.280 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0ef8664345] 2024-09-12T00:41:07.280 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0ef866449f] 2024-09-12T00:41:07.280 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563fa2d8acc1] 2024-09-12T00:41:07.280 INFO:tasks.workunit.client.0.smithi043.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x563fa2d9f01c] 2024-09-12T00:41:07.280 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563fa2da06a4] 2024-09-12T00:41:07.280 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:41:07.280 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0ef74cad90] 2024-09-12T00:41:07.280 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:41:07.280 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:41:07.280 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:41:07.281 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:07.281 INFO:tasks.workunit.client.0.smithi043.stderr:--- logging levels --- 2024-09-12T00:41:07.281 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 none 2024-09-12T00:41:07.281 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 lockdep 2024-09-12T00:41:07.281 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 context 2024-09-12T00:41:07.281 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 crush 2024-09-12T00:41:07.281 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds 2024-09-12T00:41:07.281 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_balancer 2024-09-12T00:41:07.281 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_locker 2024-09-12T00:41:07.281 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log 2024-09-12T00:41:07.281 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log_expire 2024-09-12T00:41:07.282 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_migrator 2024-09-12T00:41:07.282 INFO:tasks.workunit.client.0.smithi043.stderr: 3/ 5 mds_quiesce 2024-09-12T00:41:07.282 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 buffer 2024-09-12T00:41:07.282 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 timer 2024-09-12T00:41:07.282 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 filer 2024-09-12T00:41:07.282 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 striper 2024-09-12T00:41:07.282 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 objecter 2024-09-12T00:41:07.282 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rados 2024-09-12T00:41:07.282 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd 2024-09-12T00:41:07.282 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_mirror 2024-09-12T00:41:07.282 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_replay 2024-09-12T00:41:07.282 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_pwl 2024-09-12T00:41:07.282 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 journaler 2024-09-12T00:41:07.283 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objectcacher 2024-09-12T00:41:07.283 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:41:07.283 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 client 2024-09-12T00:41:07.283 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 osd 2024-09-12T00:41:07.283 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 optracker 2024-09-12T00:41:07.283 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objclass 2024-09-12T00:41:07.283 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 filestore 2024-09-12T00:41:07.284 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 journal 2024-09-12T00:41:07.284 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 ms 2024-09-12T00:41:07.284 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mon 2024-09-12T00:41:07.284 INFO:tasks.workunit.client.0.smithi043.stderr: 0/10 monc 2024-09-12T00:41:07.284 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 paxos 2024-09-12T00:41:07.284 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 tp 2024-09-12T00:41:07.284 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 auth 2024-09-12T00:41:07.284 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 crypto 2024-09-12T00:41:07.284 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 finisher 2024-09-12T00:41:07.284 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 reserver 2024-09-12T00:41:07.284 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 heartbeatmap 2024-09-12T00:41:07.284 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 perfcounter 2024-09-12T00:41:07.285 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw 2024-09-12T00:41:07.285 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_sync 2024-09-12T00:41:07.285 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_datacache 2024-09-12T00:41:07.285 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_access 2024-09-12T00:41:07.285 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:41:07.285 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_flight 2024-09-12T00:41:07.285 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:41:07.285 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw_notification 2024-09-12T00:41:07.285 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 javaclient 2024-09-12T00:41:07.285 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 asok 2024-09-12T00:41:07.285 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 throttle 2024-09-12T00:41:07.286 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 refs 2024-09-12T00:41:07.286 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 compressor 2024-09-12T00:41:07.286 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluestore 2024-09-12T00:41:07.286 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluefs 2024-09-12T00:41:07.286 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 bdev 2024-09-12T00:41:07.286 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 kstore 2024-09-12T00:41:07.286 INFO:tasks.workunit.client.0.smithi043.stderr: 4/ 5 rocksdb 2024-09-12T00:41:07.286 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 fuse 2024-09-12T00:41:07.286 INFO:tasks.workunit.client.0.smithi043.stderr: 2/ 5 mgr 2024-09-12T00:41:07.286 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mgrc 2024-09-12T00:41:07.286 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 dpdk 2024-09-12T00:41:07.286 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 eventtrace 2024-09-12T00:41:07.287 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 prioritycache 2024-09-12T00:41:07.287 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 test 2024-09-12T00:41:07.287 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:41:07.287 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephsqlite 2024-09-12T00:41:07.287 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:41:07.287 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore 2024-09-12T00:41:07.287 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_onode 2024-09-12T00:41:07.287 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_odata 2024-09-12T00:41:07.287 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_omap 2024-09-12T00:41:07.287 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_tm 2024-09-12T00:41:07.287 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_t 2024-09-12T00:41:07.287 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:41:07.287 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_epm 2024-09-12T00:41:07.288 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_lba 2024-09-12T00:41:07.288 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:41:07.288 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cache 2024-09-12T00:41:07.288 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_journal 2024-09-12T00:41:07.288 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_device 2024-09-12T00:41:07.288 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_backref 2024-09-12T00:41:07.288 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 alienstore 2024-09-12T00:41:07.288 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mclock 2024-09-12T00:41:07.288 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cyanstore 2024-09-12T00:41:07.288 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 ceph_exporter 2024-09-12T00:41:07.288 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 memstore 2024-09-12T00:41:07.288 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 trace 2024-09-12T00:41:07.289 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 ceph_dedup 2024-09-12T00:41:07.289 INFO:tasks.workunit.client.0.smithi043.stderr: -2/-2 (syslog threshold) 2024-09-12T00:41:07.289 INFO:tasks.workunit.client.0.smithi043.stderr: 99/99 (stderr threshold) 2024-09-12T00:41:07.289 INFO:tasks.workunit.client.0.smithi043.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:41:07.289 INFO:tasks.workunit.client.0.smithi043.stderr: 7f0d21ffb640 / http_manager 2024-09-12T00:41:07.289 INFO:tasks.workunit.client.0.smithi043.stderr: 7f0d23fff640 / http_manager 2024-09-12T00:41:07.289 INFO:tasks.workunit.client.0.smithi043.stderr: 7f0da97e2640 / rgw_dt_lg_renew 2024-09-12T00:41:07.289 INFO:tasks.workunit.client.0.smithi043.stderr: 7f0dd4ff9640 / ms_dispatch 2024-09-12T00:41:07.289 INFO:tasks.workunit.client.0.smithi043.stderr: 7f0dd5ffb640 / io_context_pool 2024-09-12T00:41:07.289 INFO:tasks.workunit.client.0.smithi043.stderr: 7f0dd67fc640 / io_context_pool 2024-09-12T00:41:07.289 INFO:tasks.workunit.client.0.smithi043.stderr: 7f0ddce01640 / ms_dispatch 2024-09-12T00:41:07.290 INFO:tasks.workunit.client.0.smithi043.stderr: 7f0ddf606640 / ms_dispatch 2024-09-12T00:41:07.290 INFO:tasks.workunit.client.0.smithi043.stderr: 7f0de0e09640 / io_context_pool 2024-09-12T00:41:07.290 INFO:tasks.workunit.client.0.smithi043.stderr: 7f0ef188e640 / io_context_pool 2024-09-12T00:41:07.290 INFO:tasks.workunit.client.0.smithi043.stderr: 7f0ef208f640 / msgr-worker-2 2024-09-12T00:41:07.290 INFO:tasks.workunit.client.0.smithi043.stderr: 7f0ef2890640 / msgr-worker-1 2024-09-12T00:41:07.290 INFO:tasks.workunit.client.0.smithi043.stderr: 7f0ef3091640 / msgr-worker-0 2024-09-12T00:41:07.290 INFO:tasks.workunit.client.0.smithi043.stderr: 7f0ef4d8a9c0 / radosgw-admin 2024-09-12T00:41:07.290 INFO:tasks.workunit.client.0.smithi043.stderr: max_recent 500 2024-09-12T00:41:07.290 INFO:tasks.workunit.client.0.smithi043.stderr: max_new 1000 2024-09-12T00:41:07.290 INFO:tasks.workunit.client.0.smithi043.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:41:07.131898Z_96638de3-a021-4ad4-8a16-dbe572d168b3/log 2024-09-12T00:41:07.290 INFO:tasks.workunit.client.0.smithi043.stderr:--- end dump of recent events --- 2024-09-12T00:41:07.291 INFO:tasks.workunit.client.0.smithi043.stderr:Aborted 2024-09-12T00:41:07.291 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:41:07.292 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:07.292 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:07.292 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.207+0000 7f813c60d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.292 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.211+0000 7f813c60d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.292 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.211+0000 7f813c60d9c0 20 realm 2024-09-12T00:41:07.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.211+0000 7f813c60d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.211+0000 7f813c60d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.211+0000 7f813c60d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:07.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.211+0000 7f813c60d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.211+0000 7f813c60d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.211+0000 7f813c60d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.211+0000 7f813c60d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:07.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.211+0000 7f813c60d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.215+0000 7f813c60d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:07.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.215+0000 7f813c60d9c0 20 searching for the correct realm 2024-09-12T00:41:07.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.215+0000 7f813a914640 0 -- 172.21.15.43:0/137028602 >> [v2:172.21.15.43:6808/2258408181,v1:172.21.15.43:6809/2258408181] conn(0x562997b67910 msgr2=0x562997b69dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:07.428 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.427+0000 7f813a914640 0 -- 172.21.15.43:0/137028602 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f81300d6460 msgr2=0x7f81300d68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:07.651 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.651+0000 7f813c60d9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:41:07.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.651+0000 7f813c60d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:07.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.651+0000 7f813c60d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:07.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.651+0000 7f813c60d9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:41:07.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.651+0000 7f813c60d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:07.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.651+0000 7f813c60d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:07.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.651+0000 7f813c60d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.653 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.651+0000 7f813c60d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.653 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.651+0000 7f813c60d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.653 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.651+0000 7f813c60d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:07.653 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.651+0000 7f813c60d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.655+0000 7f813c60d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:07.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.655+0000 7f813c60d9c0 20 zone default found 2024-09-12T00:41:07.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.655+0000 7f813c60d9c0 4 Realm: () 2024-09-12T00:41:07.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.655+0000 7f813c60d9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:41:07.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.655+0000 7f813c60d9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:41:07.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.655+0000 7f813c60d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:07.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.655+0000 7f813c60d9c0 20 zonegroup default 2024-09-12T00:41:07.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.655+0000 7f813c60d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.655+0000 7f813c60d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.655+0000 7f813c60d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.655+0000 7f813c60d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.655+0000 7f813c60d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.655+0000 7f813c60d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.655+0000 7f813c60d9c0 20 started sync module instance, tier type = 2024-09-12T00:41:07.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.655+0000 7f813c60d9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:41:07.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.683+0000 7f813c60d9c0 20 add_watcher() i=0 2024-09-12T00:41:07.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.683+0000 7f813c60d9c0 20 add_watcher() i=1 2024-09-12T00:41:07.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.683+0000 7f813c60d9c0 20 add_watcher() i=2 2024-09-12T00:41:07.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.683+0000 7f813c60d9c0 20 add_watcher() i=3 2024-09-12T00:41:07.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.683+0000 7f813c60d9c0 20 add_watcher() i=4 2024-09-12T00:41:07.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.683+0000 7f813c60d9c0 20 add_watcher() i=5 2024-09-12T00:41:07.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.683+0000 7f813c60d9c0 20 add_watcher() i=6 2024-09-12T00:41:07.685 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.687+0000 7f813c60d9c0 20 add_watcher() i=7 2024-09-12T00:41:07.685 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.687+0000 7f813c60d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:07.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.691+0000 7f7ff0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:07.691 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.691+0000 7f813c60d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:07.691 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.691+0000 7f813c60d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:07.691 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.691+0000 7f813c60d9c0 5 note: GC not initialized 2024-09-12T00:41:07.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.691+0000 7f7f6b7fe640 20 reqs_thread_entry: start 2024-09-12T00:41:07.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.691+0000 7f813c60d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:07.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.691+0000 7f813c60d9c0 20 Filter name: none 2024-09-12T00:41:07.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.691+0000 7f7f697fa640 20 reqs_thread_entry: start 2024-09-12T00:41:07.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.691+0000 7f813c60d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.695+0000 7f813c60d9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:41:07.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.695+0000 7f813c60d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.695+0000 7f813c60d9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:41:07.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.695+0000 7f813c60d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:07.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.695+0000 7f813c60d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.696 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.695+0000 7f813c60d9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:41:07.696 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.695+0000 7f813c60d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.697 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.695+0000 7f813c60d9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:41:07.697 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.695+0000 7f813c60d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:07.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.699+0000 7f7ff0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:07.709 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.711+0000 7f813c60d9c0 20 remove_watcher() i=0 2024-09-12T00:41:07.709 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.711+0000 7f813c60d9c0 2 removed watcher, disabling cache 2024-09-12T00:41:07.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.711+0000 7f813c60d9c0 20 remove_watcher() i=1 2024-09-12T00:41:07.715 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.715+0000 7f813c60d9c0 20 remove_watcher() i=2 2024-09-12T00:41:07.718 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.719+0000 7f813c60d9c0 20 remove_watcher() i=3 2024-09-12T00:41:07.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.719+0000 7f813c60d9c0 20 remove_watcher() i=4 2024-09-12T00:41:07.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.723+0000 7f813c60d9c0 20 remove_watcher() i=5 2024-09-12T00:41:07.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.723+0000 7f813c60d9c0 20 remove_watcher() i=6 2024-09-12T00:41:07.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.723+0000 7f813c60d9c0 20 remove_watcher() i=7 2024-09-12T00:41:07.742 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:07.742 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:41:07.755 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:41:07.783 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:07.783 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:07.828 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.827+0000 7f492dc3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.830 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.831+0000 7f492dc3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.830 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.831+0000 7f492dc3a9c0 20 realm 2024-09-12T00:41:07.831 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.831+0000 7f492dc3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.831 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.831+0000 7f492dc3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.831 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.831+0000 7f492dc3a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:07.831 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.831+0000 7f492dc3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.831 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.831+0000 7f492dc3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.831 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.831+0000 7f492dc3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.831+0000 7f492dc3a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:07.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.831+0000 7f492dc3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.831+0000 7f492dc3a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:07.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.831+0000 7f492dc3a9c0 20 searching for the correct realm 2024-09-12T00:41:07.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.835+0000 7f492b740640 0 -- 172.21.15.43:0/2127247439 >> [v2:172.21.15.97:6816/489545787,v1:172.21.15.97:6817/489545787] conn(0x7f492401e040 msgr2=0x7f49240601c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:07.841 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.843+0000 7f492b740640 0 -- 172.21.15.43:0/2127247439 >> [v2:172.21.15.97:6816/489545787,v1:172.21.15.97:6817/489545787] conn(0x7f47f4080bb0 msgr2=0x7f47f4082fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:41:07.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.851+0000 7f492dc3a9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:41:07.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.851+0000 7f492dc3a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:07.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.851+0000 7f492dc3a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:07.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.851+0000 7f492dc3a9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:41:07.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.851+0000 7f492dc3a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:07.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.851+0000 7f492dc3a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:07.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.851+0000 7f492dc3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.851+0000 7f492dc3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.851+0000 7f492dc3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.855+0000 7f492dc3a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:07.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.855+0000 7f492dc3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.855+0000 7f492dc3a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:07.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.855+0000 7f492dc3a9c0 20 zone default found 2024-09-12T00:41:07.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.855+0000 7f492dc3a9c0 4 Realm: () 2024-09-12T00:41:07.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.855+0000 7f492dc3a9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:41:07.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.855+0000 7f492dc3a9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:41:07.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.855+0000 7f492dc3a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:07.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.855+0000 7f492dc3a9c0 20 zonegroup default 2024-09-12T00:41:07.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.855+0000 7f492dc3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.855+0000 7f492dc3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.855+0000 7f492dc3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.855+0000 7f492dc3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.855+0000 7f492dc3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.855+0000 7f492dc3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.855+0000 7f492dc3a9c0 20 started sync module instance, tier type = 2024-09-12T00:41:07.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.855+0000 7f492dc3a9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:41:07.876 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.875+0000 7f492dc3a9c0 20 add_watcher() i=0 2024-09-12T00:41:07.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.875+0000 7f492dc3a9c0 20 add_watcher() i=1 2024-09-12T00:41:07.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.875+0000 7f492dc3a9c0 20 add_watcher() i=2 2024-09-12T00:41:07.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.875+0000 7f492dc3a9c0 20 add_watcher() i=3 2024-09-12T00:41:07.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.875+0000 7f492dc3a9c0 20 add_watcher() i=4 2024-09-12T00:41:07.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.875+0000 7f492dc3a9c0 20 add_watcher() i=5 2024-09-12T00:41:07.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.875+0000 7f492dc3a9c0 20 add_watcher() i=6 2024-09-12T00:41:07.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.879+0000 7f492dc3a9c0 20 add_watcher() i=7 2024-09-12T00:41:07.878 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.879+0000 7f492dc3a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:07.880 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.879+0000 7f47e27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:07.881 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.879+0000 7f492dc3a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:07.881 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.879+0000 7f492dc3a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:07.881 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.879+0000 7f492dc3a9c0 5 note: GC not initialized 2024-09-12T00:41:07.881 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.879+0000 7f47e17e2640 20 reqs_thread_entry: start 2024-09-12T00:41:07.882 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.879+0000 7f492dc3a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:07.882 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.879+0000 7f492dc3a9c0 20 Filter name: none 2024-09-12T00:41:07.882 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.879+0000 7f47da7fc640 20 reqs_thread_entry: start 2024-09-12T00:41:07.882 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.883+0000 7f492dc3a9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:41:07.882 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.883+0000 7f492dc3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.882 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.883+0000 7f492dc3a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:41:07.882 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.883+0000 7f492dc3a9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:41:07.883 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.883+0000 7f492dc3a9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:41:07.883 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.883+0000 7f492dc3a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 : miss 2024-09-12T00:41:07.883 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.883+0000 7f492dc3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.884 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.883+0000 7f492dc3a9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:41:07.884 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.883+0000 7f492dc3a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:41:07.884 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.883+0000 7f492dc3a9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:41:07.884 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.883+0000 7f492dc3a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:41:07.884 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.883+0000 7f492dc3a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:07.884 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.883+0000 7f492dc3a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 2024-09-12T00:41:07.884 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.883+0000 7f492dc3a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.0 2024-09-12T00:41:07.884 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.883+0000 7f492dc3a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.0 2024-09-12T00:41:07.885 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.883+0000 7f492dc3a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.1 2024-09-12T00:41:07.885 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.883+0000 7f492dc3a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.1 2024-09-12T00:41:07.886 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.887+0000 7f492dc3a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.2 2024-09-12T00:41:07.886 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.887+0000 7f492dc3a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.2 2024-09-12T00:41:07.886 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.887+0000 7f492dc3a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.3 2024-09-12T00:41:07.887 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.887+0000 7f492dc3a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.3 2024-09-12T00:41:07.888 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.887+0000 7f492dc3a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.4 2024-09-12T00:41:07.888 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.887+0000 7f492dc3a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.4 2024-09-12T00:41:07.888 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.887+0000 7f492dc3a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.5 2024-09-12T00:41:07.889 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.887+0000 7f492dc3a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.5 2024-09-12T00:41:07.889 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.891+0000 7f492dc3a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.6 2024-09-12T00:41:07.889 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.891+0000 7f492dc3a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.6 2024-09-12T00:41:07.890 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.891+0000 7f492dc3a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.7 2024-09-12T00:41:07.890 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.891+0000 7f492dc3a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.7 2024-09-12T00:41:07.891 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.891+0000 7f492dc3a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.8 2024-09-12T00:41:07.891 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.891+0000 7f492dc3a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.8 2024-09-12T00:41:07.892 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.891+0000 7f492dc3a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.9 2024-09-12T00:41:07.892 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.891+0000 7f492dc3a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.9 2024-09-12T00:41:07.892 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.891+0000 7f492dc3a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.10 2024-09-12T00:41:07.892 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.891+0000 7f492dc3a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.10 2024-09-12T00:41:07.893 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.895+0000 7f492dc3a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.11 2024-09-12T00:41:07.893 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.895+0000 7f492dc3a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.11 2024-09-12T00:41:07.894 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.895+0000 7f492dc3a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.12 2024-09-12T00:41:07.894 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.895+0000 7f492dc3a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.12 2024-09-12T00:41:07.896 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.895+0000 7f47e27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:07.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.899+0000 7f492dc3a9c0 20 remove_watcher() i=0 2024-09-12T00:41:07.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.899+0000 7f492dc3a9c0 2 removed watcher, disabling cache 2024-09-12T00:41:07.903 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.903+0000 7f492dc3a9c0 20 remove_watcher() i=1 2024-09-12T00:41:07.905 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.903+0000 7f492dc3a9c0 20 remove_watcher() i=2 2024-09-12T00:41:07.907 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.907+0000 7f492dc3a9c0 20 remove_watcher() i=3 2024-09-12T00:41:07.909 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.911+0000 7f492dc3a9c0 20 remove_watcher() i=4 2024-09-12T00:41:07.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.911+0000 7f492dc3a9c0 20 remove_watcher() i=5 2024-09-12T00:41:07.912 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.911+0000 7f492dc3a9c0 20 remove_watcher() i=6 2024-09-12T00:41:07.913 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:07.915+0000 7f492dc3a9c0 20 remove_watcher() i=7 2024-09-12T00:41:37.930 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:41:37.964 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:37.964 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:38.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.010+0000 7fc15d7b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.012 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.010+0000 7fc15d7b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:38.012 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.010+0000 7fc15d7b19c0 20 realm 2024-09-12T00:41:38.012 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.010+0000 7fc15d7b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.013 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.010+0000 7fc15d7b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:38.013 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.010+0000 7fc15d7b19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:38.013 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.010+0000 7fc15d7b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.013 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.010+0000 7fc15d7b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:38.013 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.010+0000 7fc15d7b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.014 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.014+0000 7fc15d7b19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:38.014 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.014+0000 7fc15d7b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.015 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.014+0000 7fc15d7b19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:38.015 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.014+0000 7fc15d7b19c0 20 searching for the correct realm 2024-09-12T00:41:38.224 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.222+0000 7fc15aab6640 0 -- 172.21.15.43:0/3469556231 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fc150008040 msgr2=0x7fc150067990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:38.235 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.234+0000 7fc15b2b7640 0 -- 172.21.15.43:0/3469556231 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fc1500723c0 msgr2=0x7fc150067990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:41:38.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.450+0000 7fc15d7b19c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:41:38.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.450+0000 7fc15d7b19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:38.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.450+0000 7fc15d7b19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:38.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.450+0000 7fc15d7b19c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:41:38.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.450+0000 7fc15d7b19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:38.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.450+0000 7fc15d7b19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:38.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.450+0000 7fc15d7b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.454+0000 7fc15d7b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:38.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.454+0000 7fc15d7b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.454+0000 7fc15d7b19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:38.455 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.454+0000 7fc15d7b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.455 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.454+0000 7fc15d7b19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:38.455 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.454+0000 7fc15d7b19c0 20 zone default found 2024-09-12T00:41:38.456 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.454+0000 7fc15d7b19c0 4 Realm: () 2024-09-12T00:41:38.456 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.454+0000 7fc15d7b19c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:41:38.456 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.454+0000 7fc15d7b19c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:41:38.456 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.454+0000 7fc15d7b19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:38.456 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.454+0000 7fc15d7b19c0 20 zonegroup default 2024-09-12T00:41:38.456 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.454+0000 7fc15d7b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.457 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.454+0000 7fc15d7b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:38.457 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.454+0000 7fc15d7b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.457 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.454+0000 7fc15d7b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:38.457 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.454+0000 7fc15d7b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.457 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.454+0000 7fc15d7b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:38.458 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.454+0000 7fc15d7b19c0 20 started sync module instance, tier type = 2024-09-12T00:41:38.458 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.454+0000 7fc15d7b19c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:41:38.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.482+0000 7fc15d7b19c0 20 add_watcher() i=0 2024-09-12T00:41:38.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.482+0000 7fc15d7b19c0 20 add_watcher() i=1 2024-09-12T00:41:38.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.482+0000 7fc15d7b19c0 20 add_watcher() i=2 2024-09-12T00:41:38.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.482+0000 7fc15d7b19c0 20 add_watcher() i=3 2024-09-12T00:41:38.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.482+0000 7fc15d7b19c0 20 add_watcher() i=4 2024-09-12T00:41:38.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.482+0000 7fc15d7b19c0 20 add_watcher() i=5 2024-09-12T00:41:38.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.482+0000 7fc15d7b19c0 20 add_watcher() i=6 2024-09-12T00:41:38.484 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.482+0000 7fc15d7b19c0 20 add_watcher() i=7 2024-09-12T00:41:38.484 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.482+0000 7fc15d7b19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:38.491 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.490+0000 7fc011fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:38.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.490+0000 7fc15d7b19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:38.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.490+0000 7fc15d7b19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:38.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.490+0000 7fc15d7b19c0 5 note: GC not initialized 2024-09-12T00:41:38.497 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.490+0000 7fc010fe1640 20 reqs_thread_entry: start 2024-09-12T00:41:38.497 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.490+0000 7fc15d7b19c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:38.497 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.490+0000 7fc15d7b19c0 20 Filter name: none 2024-09-12T00:41:38.497 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.494+0000 7fbf8a7fc640 20 reqs_thread_entry: start 2024-09-12T00:41:38.497 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.494+0000 7fc15d7b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.497 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.494+0000 7fc15d7b19c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:41:38.497 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.494+0000 7fc15d7b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.498 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.494+0000 7fc15d7b19c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:41:38.498 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.494+0000 7fc15d7b19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:38.498 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.494+0000 7fc15d7b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.499 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.498+0000 7fc15d7b19c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:41:38.499 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.498+0000 7fc15d7b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.499 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.498+0000 7fc15d7b19c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:41:38.499 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.498+0000 7fc15d7b19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:38.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.502+0000 7fc011fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:38.506 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.506+0000 7fc15d7b19c0 20 remove_watcher() i=0 2024-09-12T00:41:38.507 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.506+0000 7fc15d7b19c0 2 removed watcher, disabling cache 2024-09-12T00:41:38.509 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.510+0000 7fc15d7b19c0 20 remove_watcher() i=1 2024-09-12T00:41:38.512 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.510+0000 7fc15d7b19c0 20 remove_watcher() i=2 2024-09-12T00:41:38.515 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.514+0000 7fc15d7b19c0 20 remove_watcher() i=3 2024-09-12T00:41:38.516 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.514+0000 7fc15d7b19c0 20 remove_watcher() i=4 2024-09-12T00:41:38.518 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.518+0000 7fc15d7b19c0 20 remove_watcher() i=5 2024-09-12T00:41:38.519 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.518+0000 7fc15d7b19c0 20 remove_watcher() i=6 2024-09-12T00:41:38.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.518+0000 7fc15d7b19c0 20 remove_watcher() i=7 2024-09-12T00:41:38.539 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:38.539 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:41:38.582 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:41:38.609 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:38.610 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:38.653 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.650+0000 7fa08298c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.654+0000 7fa08298c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:38.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.654+0000 7fa08298c9c0 20 realm 2024-09-12T00:41:38.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.654+0000 7fa08298c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.654+0000 7fa08298c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:38.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.654+0000 7fa08298c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:38.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.654+0000 7fa08298c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.654+0000 7fa08298c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:38.655 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.654+0000 7fa08298c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.654+0000 7fa08298c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:38.656 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.654+0000 7fa08298c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.657 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.658+0000 7fa08298c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:38.657 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.658+0000 7fa08298c9c0 20 searching for the correct realm 2024-09-12T00:41:38.664 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.662+0000 7fa07fc91640 0 -- 172.21.15.43:0/3242928126 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fa0680ea040 msgr2=0x7fa0680eb430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:38.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.670+0000 7fa07fc91640 0 -- 172.21.15.43:0/3242928126 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f9f50080b80 msgr2=0x7f9f50082fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:38.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.678+0000 7fa08298c9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:41:38.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.678+0000 7fa08298c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:38.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.678+0000 7fa08298c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:38.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.678+0000 7fa08298c9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:41:38.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.678+0000 7fa08298c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:38.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.678+0000 7fa08298c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:38.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.678+0000 7fa08298c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.678+0000 7fa08298c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:38.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.678+0000 7fa08298c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.678+0000 7fa08298c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:38.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.678+0000 7fa08298c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.678+0000 7fa08298c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:38.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.678+0000 7fa08298c9c0 20 zone default found 2024-09-12T00:41:38.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.678+0000 7fa08298c9c0 4 Realm: () 2024-09-12T00:41:38.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.678+0000 7fa08298c9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:41:38.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.678+0000 7fa08298c9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:41:38.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.678+0000 7fa08298c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:38.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.678+0000 7fa08298c9c0 20 zonegroup default 2024-09-12T00:41:38.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.678+0000 7fa08298c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.678+0000 7fa08298c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:38.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.678+0000 7fa08298c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.682 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.678+0000 7fa08298c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:38.682 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.678+0000 7fa08298c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.678+0000 7fa08298c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:38.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.678+0000 7fa08298c9c0 20 started sync module instance, tier type = 2024-09-12T00:41:38.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.678+0000 7fa08298c9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:41:38.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.694+0000 7fa08298c9c0 20 add_watcher() i=0 2024-09-12T00:41:38.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.694+0000 7fa08298c9c0 20 add_watcher() i=1 2024-09-12T00:41:38.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.694+0000 7fa08298c9c0 20 add_watcher() i=2 2024-09-12T00:41:38.695 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.694+0000 7fa08298c9c0 20 add_watcher() i=3 2024-09-12T00:41:38.696 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.694+0000 7fa08298c9c0 20 add_watcher() i=4 2024-09-12T00:41:38.696 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.694+0000 7fa08298c9c0 20 add_watcher() i=5 2024-09-12T00:41:38.696 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.694+0000 7fa08298c9c0 20 add_watcher() i=6 2024-09-12T00:41:38.696 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.694+0000 7fa08298c9c0 20 add_watcher() i=7 2024-09-12T00:41:38.696 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.694+0000 7fa08298c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:38.698 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.698+0000 7f9f36fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:38.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.698+0000 7fa08298c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:38.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.698+0000 7fa08298c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:38.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.698+0000 7fa08298c9c0 5 note: GC not initialized 2024-09-12T00:41:38.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.698+0000 7f9f35fe3640 20 reqs_thread_entry: start 2024-09-12T00:41:38.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.698+0000 7fa08298c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:38.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.698+0000 7fa08298c9c0 20 Filter name: none 2024-09-12T00:41:38.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.698+0000 7f9f2effd640 20 reqs_thread_entry: start 2024-09-12T00:41:38.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.698+0000 7fa08298c9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:41:38.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.698+0000 7fa08298c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.698+0000 7fa08298c9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:41:38.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.698+0000 7fa08298c9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:41:38.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.698+0000 7fa08298c9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:41:38.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.698+0000 7fa08298c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 : miss 2024-09-12T00:41:38.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.698+0000 7fa08298c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.702+0000 7fa08298c9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:41:38.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.702+0000 7fa08298c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:41:38.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.702+0000 7fa08298c9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:41:38.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.702+0000 7fa08298c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:41:38.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.702+0000 7fa08298c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:38.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.702+0000 7fa08298c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 2024-09-12T00:41:38.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.702+0000 7fa08298c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.0 2024-09-12T00:41:38.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.702+0000 7fa08298c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.0 2024-09-12T00:41:38.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.702+0000 7fa08298c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.1 2024-09-12T00:41:38.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.702+0000 7fa08298c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.1 2024-09-12T00:41:38.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.702+0000 7fa08298c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.2 2024-09-12T00:41:38.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.702+0000 7fa08298c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.2 2024-09-12T00:41:38.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.702+0000 7fa08298c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.3 2024-09-12T00:41:38.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.702+0000 7fa08298c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.3 2024-09-12T00:41:38.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.702+0000 7fa08298c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.4 2024-09-12T00:41:38.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.706+0000 7fa08298c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.4 2024-09-12T00:41:38.706 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.706+0000 7fa08298c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.5 2024-09-12T00:41:38.706 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.706+0000 7fa08298c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.5 2024-09-12T00:41:38.707 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.706+0000 7fa08298c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.6 2024-09-12T00:41:38.707 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.706+0000 7fa08298c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.6 2024-09-12T00:41:38.708 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.706+0000 7fa08298c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.7 2024-09-12T00:41:38.708 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.706+0000 7fa08298c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.7 2024-09-12T00:41:38.709 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.710+0000 7fa08298c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.8 2024-09-12T00:41:38.709 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.710+0000 7fa08298c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.8 2024-09-12T00:41:38.710 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.710+0000 7fa08298c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.9 2024-09-12T00:41:38.710 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.710+0000 7fa08298c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.9 2024-09-12T00:41:38.710 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.710+0000 7fa08298c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.10 2024-09-12T00:41:38.710 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.710+0000 7fa08298c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.10 2024-09-12T00:41:38.711 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.710+0000 7fa08298c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.11 2024-09-12T00:41:38.711 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.710+0000 7fa08298c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.11 2024-09-12T00:41:38.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.710+0000 7fa08298c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.12 2024-09-12T00:41:38.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.710+0000 7fa08298c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.12 2024-09-12T00:41:38.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.714+0000 7f9f36fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:38.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.718+0000 7fa08298c9c0 20 remove_watcher() i=0 2024-09-12T00:41:38.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.718+0000 7fa08298c9c0 2 removed watcher, disabling cache 2024-09-12T00:41:38.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.718+0000 7fa08298c9c0 20 remove_watcher() i=1 2024-09-12T00:41:38.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.722+0000 7fa08298c9c0 20 remove_watcher() i=2 2024-09-12T00:41:38.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.726+0000 7fa08298c9c0 20 remove_watcher() i=3 2024-09-12T00:41:38.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.726+0000 7fa08298c9c0 20 remove_watcher() i=4 2024-09-12T00:41:38.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.730+0000 7fa08298c9c0 20 remove_watcher() i=5 2024-09-12T00:41:38.730 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.730+0000 7fa08298c9c0 20 remove_watcher() i=6 2024-09-12T00:41:38.732 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.730+0000 7fa08298c9c0 20 remove_watcher() i=7 2024-09-12T00:41:38.746 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:41:38.773 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:38.773 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:38.818 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.818+0000 7f2d757b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.818+0000 7f2d757b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:38.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.818+0000 7f2d757b89c0 20 realm 2024-09-12T00:41:38.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.818+0000 7f2d757b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.818+0000 7f2d757b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:38.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.818+0000 7f2d757b89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:38.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.818+0000 7f2d757b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.818+0000 7f2d757b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:38.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.818+0000 7f2d757b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.822+0000 7f2d757b89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:38.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.822+0000 7f2d757b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:38.823 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.822+0000 7f2d757b89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:38.823 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.822+0000 7f2d757b89c0 20 searching for the correct realm 2024-09-12T00:41:38.830 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:38.830+0000 7f2d73abf640 0 -- 172.21.15.43:0/3151824404 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f2d68067c20 msgr2=0x7f2d6805fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:41:39.048 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.046+0000 7f2d732be640 0 -- 172.21.15.43:0/3151824404 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x55cf977fbb70 msgr2=0x55cf977fdf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:39.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.258+0000 7f2d757b89c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:41:39.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.258+0000 7f2d757b89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:39.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.258+0000 7f2d757b89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:39.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.258+0000 7f2d757b89c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:41:39.260 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.258+0000 7f2d757b89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:39.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.258+0000 7f2d757b89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:39.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.258+0000 7f2d757b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.258+0000 7f2d757b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.258+0000 7f2d757b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.262 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.262+0000 7f2d757b89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:39.262 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.262+0000 7f2d757b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.262 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.262+0000 7f2d757b89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:39.262 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.262+0000 7f2d757b89c0 20 zone default found 2024-09-12T00:41:39.263 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.262+0000 7f2d757b89c0 4 Realm: () 2024-09-12T00:41:39.263 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.262+0000 7f2d757b89c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:41:39.263 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.262+0000 7f2d757b89c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:41:39.263 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.262+0000 7f2d757b89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:39.263 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.262+0000 7f2d757b89c0 20 zonegroup default 2024-09-12T00:41:39.263 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.262+0000 7f2d757b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.263 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.262+0000 7f2d757b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.263 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.262+0000 7f2d757b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.264 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.262+0000 7f2d757b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.264 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.262+0000 7f2d757b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.262+0000 7f2d757b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.262+0000 7f2d757b89c0 20 started sync module instance, tier type = 2024-09-12T00:41:39.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.262+0000 7f2d757b89c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:41:39.286 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.286+0000 7f2d757b89c0 20 add_watcher() i=0 2024-09-12T00:41:39.287 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.286+0000 7f2d757b89c0 20 add_watcher() i=1 2024-09-12T00:41:39.287 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.286+0000 7f2d757b89c0 20 add_watcher() i=2 2024-09-12T00:41:39.287 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.286+0000 7f2d757b89c0 20 add_watcher() i=3 2024-09-12T00:41:39.287 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.286+0000 7f2d757b89c0 20 add_watcher() i=4 2024-09-12T00:41:39.287 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.286+0000 7f2d757b89c0 20 add_watcher() i=5 2024-09-12T00:41:39.287 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.286+0000 7f2d757b89c0 20 add_watcher() i=6 2024-09-12T00:41:39.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.286+0000 7f2d757b89c0 20 add_watcher() i=7 2024-09-12T00:41:39.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.286+0000 7f2d757b89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:39.292 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.290+0000 7f2c29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:39.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.290+0000 7f2d757b89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:39.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.290+0000 7f2d757b89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:39.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.290+0000 7f2d757b89c0 5 note: GC not initialized 2024-09-12T00:41:39.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.294+0000 7f2c28fe1640 20 reqs_thread_entry: start 2024-09-12T00:41:39.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.294+0000 7f2d757b89c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:39.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.294+0000 7f2d757b89c0 20 Filter name: none 2024-09-12T00:41:39.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.294+0000 7f2ba27fc640 20 reqs_thread_entry: start 2024-09-12T00:41:39.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.294+0000 7f2d757b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.295 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.294+0000 7f2d757b89c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:41:39.295 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.294+0000 7f2d757b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.297 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.294+0000 7f2d757b89c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:41:39.297 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.294+0000 7f2d757b89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:39.297 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.294+0000 7f2d757b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.297 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.298+0000 7f2d757b89c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:41:39.297 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.298+0000 7f2d757b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.298 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.298+0000 7f2d757b89c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:41:39.298 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.298+0000 7f2d757b89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:39.302 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.302+0000 7f2c29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:39.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.306+0000 7f2d757b89c0 20 remove_watcher() i=0 2024-09-12T00:41:39.307 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.306+0000 7f2d757b89c0 2 removed watcher, disabling cache 2024-09-12T00:41:39.309 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.310+0000 7f2d757b89c0 20 remove_watcher() i=1 2024-09-12T00:41:39.312 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.310+0000 7f2d757b89c0 20 remove_watcher() i=2 2024-09-12T00:41:39.316 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.314+0000 7f2d757b89c0 20 remove_watcher() i=3 2024-09-12T00:41:39.316 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.314+0000 7f2d757b89c0 20 remove_watcher() i=4 2024-09-12T00:41:39.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.318+0000 7f2d757b89c0 20 remove_watcher() i=5 2024-09-12T00:41:39.320 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.318+0000 7f2d757b89c0 20 remove_watcher() i=6 2024-09-12T00:41:39.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.318+0000 7f2d757b89c0 20 remove_watcher() i=7 2024-09-12T00:41:39.342 INFO:tasks.workunit.client.0.smithi043.stderr: test: duplicated entries should be purged before reshard 2024-09-12T00:41:39.342 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:41:39.372 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:39.372 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:39.415 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.414+0000 7fa0200a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.417 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.418+0000 7fa0200a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.417 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.418+0000 7fa0200a19c0 20 realm 2024-09-12T00:41:39.418 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.418+0000 7fa0200a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.418 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.418+0000 7fa0200a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.418 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.418+0000 7fa0200a19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:39.418 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.418+0000 7fa0200a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.418 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.418+0000 7fa0200a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.418 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.418+0000 7fa0200a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.419 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.418+0000 7fa0200a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:39.419 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.418+0000 7fa0200a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.420 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.418+0000 7fa0200a19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:39.420 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.418+0000 7fa0200a19c0 20 searching for the correct realm 2024-09-12T00:41:39.426 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.426+0000 7fa01e3a8640 0 -- 172.21.15.43:0/301381922 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x5623e9949b70 msgr2=0x5623e994c030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:39.432 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.430+0000 7fa01d3a6640 0 -- 172.21.15.43:0/301381922 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fa0140f6ae0 msgr2=0x7fa0140d5460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:41:39.441 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.438+0000 7fa0200a19c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:41:39.441 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.438+0000 7fa0200a19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:39.441 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.438+0000 7fa0200a19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:39.441 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.438+0000 7fa0200a19c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:41:39.441 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.438+0000 7fa0200a19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:39.442 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.438+0000 7fa0200a19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:39.442 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.438+0000 7fa0200a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.442 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.442+0000 7fa0200a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.442 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.442+0000 7fa0200a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.443 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.442+0000 7fa0200a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:39.443 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.442+0000 7fa0200a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.443 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.442+0000 7fa0200a19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:39.443 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.442+0000 7fa0200a19c0 20 zone default found 2024-09-12T00:41:39.443 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.442+0000 7fa0200a19c0 4 Realm: () 2024-09-12T00:41:39.443 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.442+0000 7fa0200a19c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:41:39.443 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.442+0000 7fa0200a19c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:41:39.443 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.442+0000 7fa0200a19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:39.443 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.442+0000 7fa0200a19c0 20 zonegroup default 2024-09-12T00:41:39.443 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.442+0000 7fa0200a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.443 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.442+0000 7fa0200a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.444 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.442+0000 7fa0200a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.444 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.442+0000 7fa0200a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.444 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.442+0000 7fa0200a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.444 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.442+0000 7fa0200a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.444 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.442+0000 7fa0200a19c0 20 started sync module instance, tier type = 2024-09-12T00:41:39.444 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.442+0000 7fa0200a19c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:41:39.459 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.458+0000 7fa0200a19c0 20 add_watcher() i=0 2024-09-12T00:41:39.460 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.458+0000 7fa0200a19c0 20 add_watcher() i=1 2024-09-12T00:41:39.460 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.458+0000 7fa0200a19c0 20 add_watcher() i=2 2024-09-12T00:41:39.460 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.458+0000 7fa0200a19c0 20 add_watcher() i=3 2024-09-12T00:41:39.460 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.458+0000 7fa0200a19c0 20 add_watcher() i=4 2024-09-12T00:41:39.460 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.458+0000 7fa0200a19c0 20 add_watcher() i=5 2024-09-12T00:41:39.460 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.458+0000 7fa0200a19c0 20 add_watcher() i=6 2024-09-12T00:41:39.460 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.458+0000 7fa0200a19c0 20 add_watcher() i=7 2024-09-12T00:41:39.460 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.458+0000 7fa0200a19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:39.463 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.462+0000 7f9ecf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:39.463 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.462+0000 7fa0200a19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:39.463 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.462+0000 7fa0200a19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:39.463 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.462+0000 7fa0200a19c0 5 note: GC not initialized 2024-09-12T00:41:39.464 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.462+0000 7f9ece7fc640 20 reqs_thread_entry: start 2024-09-12T00:41:39.465 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.462+0000 7fa0200a19c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:39.465 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.462+0000 7fa0200a19c0 20 Filter name: none 2024-09-12T00:41:39.465 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.462+0000 7f9e3ffff640 20 reqs_thread_entry: start 2024-09-12T00:41:39.465 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.462+0000 7fa0200a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.465 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.462+0000 7fa0200a19c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:41:39.465 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.462+0000 7fa0200a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.466+0000 7fa0200a19c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:41:39.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.466+0000 7fa0200a19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:39.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.466+0000 7fa0200a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.467 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.466+0000 7fa0200a19c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:41:39.467 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.466+0000 7fa0200a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.468 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.466+0000 7fa0200a19c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:41:39.468 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.466+0000 7fa0200a19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:39.471 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.470+0000 7f9ecf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:39.475 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.474+0000 7fa0200a19c0 20 remove_watcher() i=0 2024-09-12T00:41:39.476 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.474+0000 7fa0200a19c0 2 removed watcher, disabling cache 2024-09-12T00:41:39.478 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.478+0000 7fa0200a19c0 20 remove_watcher() i=1 2024-09-12T00:41:39.480 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.478+0000 7fa0200a19c0 20 remove_watcher() i=2 2024-09-12T00:41:39.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.482+0000 7fa0200a19c0 20 remove_watcher() i=3 2024-09-12T00:41:39.485 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.482+0000 7fa0200a19c0 20 remove_watcher() i=4 2024-09-12T00:41:39.486 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.486+0000 7fa0200a19c0 20 remove_watcher() i=5 2024-09-12T00:41:39.487 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.486+0000 7fa0200a19c0 20 remove_watcher() i=6 2024-09-12T00:41:39.489 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.486+0000 7fa0200a19c0 20 remove_watcher() i=7 2024-09-12T00:41:39.503 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.503 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:41:39.503 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: a-bucket id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 num_objects: 10 size_kb: 1 num_shards: 13 2024-09-12T00:41:39.503 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.504 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:41:39.536 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:39.536 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:39.579 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.578+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.581 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.578+0000 7fab8ca9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.581 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.578+0000 7fab8ca9c9c0 20 realm 2024-09-12T00:41:39.581 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.578+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.582+0000 7fab8ca9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.582+0000 7fab8ca9c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:39.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.582+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.582+0000 7fab8ca9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.582+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.583 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.582+0000 7fab8ca9c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:39.583 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.582+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.584 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.582+0000 7fab8ca9c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:39.584 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.582+0000 7fab8ca9c9c0 20 searching for the correct realm 2024-09-12T00:41:39.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.590+0000 7fab89da1640 0 -- 172.21.15.43:0/2667863561 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fab80061a30 msgr2=0x7fab80092a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:39.596 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.594+0000 7fab89da1640 0 -- 172.21.15.43:0/2667863561 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7faa54080b80 msgr2=0x7faa54082fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:39.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:41:39.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:39.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:39.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:41:39.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:39.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:39.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:39.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.606 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:39.606 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 zone default found 2024-09-12T00:41:39.606 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 4 Realm: () 2024-09-12T00:41:39.606 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:41:39.606 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:41:39.606 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:39.606 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 zonegroup default 2024-09-12T00:41:39.606 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.606 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.606+0000 7fab8ca9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.606 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.606+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.607 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.606+0000 7fab8ca9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.607 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.606+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.607 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.606+0000 7fab8ca9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.607 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.606+0000 7fab8ca9c9c0 20 started sync module instance, tier type = 2024-09-12T00:41:39.607 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.606+0000 7fab8ca9c9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:41:39.622 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.622+0000 7fab8ca9c9c0 20 add_watcher() i=0 2024-09-12T00:41:39.622 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.622+0000 7fab8ca9c9c0 20 add_watcher() i=1 2024-09-12T00:41:39.622 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.622+0000 7fab8ca9c9c0 20 add_watcher() i=2 2024-09-12T00:41:39.622 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.622+0000 7fab8ca9c9c0 20 add_watcher() i=3 2024-09-12T00:41:39.622 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.622+0000 7fab8ca9c9c0 20 add_watcher() i=4 2024-09-12T00:41:39.622 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.622+0000 7fab8ca9c9c0 20 add_watcher() i=5 2024-09-12T00:41:39.622 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.622+0000 7fab8ca9c9c0 20 add_watcher() i=6 2024-09-12T00:41:39.623 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.622+0000 7fab8ca9c9c0 20 add_watcher() i=7 2024-09-12T00:41:39.623 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.622+0000 7fab8ca9c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:39.625 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.626+0000 7faa40fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:39.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:39.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:39.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 note: GC not initialized 2024-09-12T00:41:39.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.626+0000 7fa9bb7fe640 20 reqs_thread_entry: start 2024-09-12T00:41:39.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:39.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 20 Filter name: none 2024-09-12T00:41:39.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.626+0000 7fa9b97fa640 20 reqs_thread_entry: start 2024-09-12T00:41:39.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:41:39.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:41:39.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:41:39.628 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:41:39.628 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 : miss 2024-09-12T00:41:39.628 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.628 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:41:39.628 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:41:39.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:41:39.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:41:39.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:39.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 2024-09-12T00:41:39.642 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.642+0000 7fab8ca9c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:41:39.643 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.642+0000 7fab8ca9c9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:41:39.643 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.642+0000 7fab8ca9c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:39.643 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.642+0000 7fab8ca9c9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17, ofs0, ns] 2024-09-12T00:41:39.643 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.642+0000 7faa6d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333528 cookie 94186088864928 notifier 7781 bl.length()=827 2024-09-12T00:41:39.643 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.642+0000 7faa6d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:41:39.643 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.642+0000 7faa6d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:41:39.643 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.642+0000 7faa6d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:39.643 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.642+0000 7fab8ca9c9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_sources= new_sources= 2024-09-12T00:41:39.644 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.642+0000 7fab8ca9c9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential sources added=[] removed=[] 2024-09-12T00:41:39.644 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.642+0000 7fab8ca9c9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_dests= new_dests= 2024-09-12T00:41:39.644 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.642+0000 7fab8ca9c9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential dests added=[] removed=[] 2024-09-12T00:41:39.656 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fab8ca9c9c0 time 2024-09-12T00:41:39.660058+0000 2024-09-12T00:41:39.657 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:41:39.657 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:39.658 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fab903762eb] 2024-09-12T00:41:39.658 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fab9037649f] 2024-09-12T00:41:39.658 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a966900cc1] 2024-09-12T00:41:39.658 INFO:tasks.workunit.client.0.smithi043.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a966915d5a] 2024-09-12T00:41:39.658 INFO:tasks.workunit.client.0.smithi043.stderr: 5: main() 2024-09-12T00:41:39.658 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fab8f1dcd90] 2024-09-12T00:41:39.658 INFO:tasks.workunit.client.0.smithi043.stderr: 7: __libc_start_main() 2024-09-12T00:41:39.658 INFO:tasks.workunit.client.0.smithi043.stderr: 8: _start() 2024-09-12T00:41:39.658 INFO:tasks.workunit.client.0.smithi043.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:41:39.658 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7fab8ca9c9c0 thread_name:radosgw-admin 2024-09-12T00:41:39.658 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.658+0000 7fab8ca9c9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fab8ca9c9c0 time 2024-09-12T00:41:39.660058+0000 2024-09-12T00:41:39.658 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:41:39.658 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.659 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:39.659 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fab903762eb] 2024-09-12T00:41:39.659 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fab9037649f] 2024-09-12T00:41:39.659 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a966900cc1] 2024-09-12T00:41:39.659 INFO:tasks.workunit.client.0.smithi043.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a966915d5a] 2024-09-12T00:41:39.659 INFO:tasks.workunit.client.0.smithi043.stderr: 5: main() 2024-09-12T00:41:39.659 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fab8f1dcd90] 2024-09-12T00:41:39.659 INFO:tasks.workunit.client.0.smithi043.stderr: 7: __libc_start_main() 2024-09-12T00:41:39.659 INFO:tasks.workunit.client.0.smithi043.stderr: 8: _start() 2024-09-12T00:41:39.659 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.676 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:39.676 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fab8f1f5520] 2024-09-12T00:41:39.676 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:41:39.676 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:41:39.676 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:41:39.676 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fab90376345] 2024-09-12T00:41:39.677 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fab9037649f] 2024-09-12T00:41:39.677 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a966900cc1] 2024-09-12T00:41:39.677 INFO:tasks.workunit.client.0.smithi043.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a966915d5a] 2024-09-12T00:41:39.677 INFO:tasks.workunit.client.0.smithi043.stderr: 9: main() 2024-09-12T00:41:39.677 INFO:tasks.workunit.client.0.smithi043.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fab8f1dcd90] 2024-09-12T00:41:39.677 INFO:tasks.workunit.client.0.smithi043.stderr: 11: __libc_start_main() 2024-09-12T00:41:39.677 INFO:tasks.workunit.client.0.smithi043.stderr: 12: _start() 2024-09-12T00:41:39.677 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.658+0000 7fab8ca9c9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:41:39.677 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7fab8ca9c9c0 thread_name:radosgw-admin 2024-09-12T00:41:39.677 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.677 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:39.677 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fab8f1f5520] 2024-09-12T00:41:39.678 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:41:39.678 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:41:39.678 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:41:39.678 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fab90376345] 2024-09-12T00:41:39.678 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fab9037649f] 2024-09-12T00:41:39.678 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a966900cc1] 2024-09-12T00:41:39.678 INFO:tasks.workunit.client.0.smithi043.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a966915d5a] 2024-09-12T00:41:39.678 INFO:tasks.workunit.client.0.smithi043.stderr: 9: main() 2024-09-12T00:41:39.678 INFO:tasks.workunit.client.0.smithi043.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fab8f1dcd90] 2024-09-12T00:41:39.678 INFO:tasks.workunit.client.0.smithi043.stderr: 11: __libc_start_main() 2024-09-12T00:41:39.678 INFO:tasks.workunit.client.0.smithi043.stderr: 12: _start() 2024-09-12T00:41:39.678 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:41:39.679 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.679 INFO:tasks.workunit.client.0.smithi043.stderr:--- begin dump of recent events --- 2024-09-12T00:41:39.679 INFO:tasks.workunit.client.0.smithi043.stderr: -499> 2024-09-12T00:41:39.558+0000 7fab8a5a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:39.679 INFO:tasks.workunit.client.0.smithi043.stderr: -498> 2024-09-12T00:41:39.558+0000 7fab8a5a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:39.679 INFO:tasks.workunit.client.0.smithi043.stderr: -497> 2024-09-12T00:41:39.558+0000 7fab8ada3640 10 monclient(hunting): get_auth_request con 0x55a96843b170 auth_method 0 2024-09-12T00:41:39.679 INFO:tasks.workunit.client.0.smithi043.stderr: -496> 2024-09-12T00:41:39.558+0000 7fab8ada3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:39.679 INFO:tasks.workunit.client.0.smithi043.stderr: -495> 2024-09-12T00:41:39.558+0000 7fab8ada3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:39.679 INFO:tasks.workunit.client.0.smithi043.stderr: -494> 2024-09-12T00:41:39.558+0000 7fab8ada3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:39.679 INFO:tasks.workunit.client.0.smithi043.stderr: -493> 2024-09-12T00:41:39.558+0000 7fab89da1640 10 monclient(hunting): handle_auth_done global_id 7769 payload 274 2024-09-12T00:41:39.679 INFO:tasks.workunit.client.0.smithi043.stderr: -492> 2024-09-12T00:41:39.558+0000 7fab89da1640 10 monclient: _finish_hunting 0 2024-09-12T00:41:39.679 INFO:tasks.workunit.client.0.smithi043.stderr: -491> 2024-09-12T00:41:39.558+0000 7fab89da1640 1 monclient: found mon.noname-c 2024-09-12T00:41:39.679 INFO:tasks.workunit.client.0.smithi043.stderr: -490> 2024-09-12T00:41:39.558+0000 7fab89da1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:41:39.679 INFO:tasks.workunit.client.0.smithi043.stderr: -489> 2024-09-12T00:41:39.558+0000 7faa78608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:39.680 INFO:tasks.workunit.client.0.smithi043.stderr: -488> 2024-09-12T00:41:39.558+0000 7faa78608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:41:39.680 INFO:tasks.workunit.client.0.smithi043.stderr: -487> 2024-09-12T00:41:39.558+0000 7faa78608640 10 monclient: dump: 2024-09-12T00:41:39.680 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:39.680 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:39.680 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.680 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.680 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:39.680 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:39.680 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:39.680 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:39.680 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:39.680 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.680 INFO:tasks.workunit.client.0.smithi043.stderr: -486> 2024-09-12T00:41:39.558+0000 7faa78608640 10 monclient: _finish_auth 0 2024-09-12T00:41:39.681 INFO:tasks.workunit.client.0.smithi043.stderr: -485> 2024-09-12T00:41:39.558+0000 7faa78608640 10 monclient: _check_auth_tickets 2024-09-12T00:41:39.681 INFO:tasks.workunit.client.0.smithi043.stderr: -484> 2024-09-12T00:41:39.558+0000 7faa78608640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:39.681 INFO:tasks.workunit.client.0.smithi043.stderr: -483> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 monclient: authenticate success, global_id 7769 2024-09-12T00:41:39.681 INFO:tasks.workunit.client.0.smithi043.stderr: -482> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:41:39.681 INFO:tasks.workunit.client.0.smithi043.stderr: -481> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 4 set_mon_vals no callback set 2024-09-12T00:41:39.681 INFO:tasks.workunit.client.0.smithi043.stderr: -480> 2024-09-12T00:41:39.558+0000 7faa78608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:39.681 INFO:tasks.workunit.client.0.smithi043.stderr: -479> 2024-09-12T00:41:39.558+0000 7faa78608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:41:39.681 INFO:tasks.workunit.client.0.smithi043.stderr: -478> 2024-09-12T00:41:39.558+0000 7faa78608640 10 monclient: dump: 2024-09-12T00:41:39.681 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:39.681 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:39.681 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.681 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.681 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:39.682 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:39.682 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:39.682 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:39.682 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:39.682 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.682 INFO:tasks.workunit.client.0.smithi043.stderr: -477> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 10 monclient: shutdown 2024-09-12T00:41:39.682 INFO:tasks.workunit.client.0.smithi043.stderr: -476> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) unregister_commands rotate-key 2024-09-12T00:41:39.682 INFO:tasks.workunit.client.0.smithi043.stderr: -475> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 10 monclient: build_initial_monmap 2024-09-12T00:41:39.682 INFO:tasks.workunit.client.0.smithi043.stderr: -474> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 1 build_initial for_mkfs: 0 2024-09-12T00:41:39.682 INFO:tasks.workunit.client.0.smithi043.stderr: -473> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 10 monclient: monmap: 2024-09-12T00:41:39.682 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:41:39.682 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:41:39.682 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:41:39.683 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:41:39.683 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:41:39.683 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:39.683 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:41:39.683 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:41:39.683 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:41:39.683 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.683 INFO:tasks.workunit.client.0.smithi043.stderr: -472> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968518ce0) adding auth protocol: cephx 2024-09-12T00:41:39.683 INFO:tasks.workunit.client.0.smithi043.stderr: -471> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968518ce0) adding auth protocol: cephx 2024-09-12T00:41:39.683 INFO:tasks.workunit.client.0.smithi043.stderr: -470> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968518ce0) adding auth protocol: cephx 2024-09-12T00:41:39.683 INFO:tasks.workunit.client.0.smithi043.stderr: -469> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968518ce0) adding con mode: secure 2024-09-12T00:41:39.683 INFO:tasks.workunit.client.0.smithi043.stderr: -468> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968518ce0) adding con mode: crc 2024-09-12T00:41:39.684 INFO:tasks.workunit.client.0.smithi043.stderr: -467> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968518ce0) adding con mode: secure 2024-09-12T00:41:39.684 INFO:tasks.workunit.client.0.smithi043.stderr: -466> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968518ce0) adding con mode: crc 2024-09-12T00:41:39.684 INFO:tasks.workunit.client.0.smithi043.stderr: -465> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968518ce0) adding con mode: secure 2024-09-12T00:41:39.684 INFO:tasks.workunit.client.0.smithi043.stderr: -464> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968518ce0) adding con mode: crc 2024-09-12T00:41:39.684 INFO:tasks.workunit.client.0.smithi043.stderr: -463> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968518ce0) adding con mode: crc 2024-09-12T00:41:39.684 INFO:tasks.workunit.client.0.smithi043.stderr: -462> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968518ce0) adding con mode: secure 2024-09-12T00:41:39.684 INFO:tasks.workunit.client.0.smithi043.stderr: -461> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968518ce0) adding con mode: crc 2024-09-12T00:41:39.684 INFO:tasks.workunit.client.0.smithi043.stderr: -460> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968518ce0) adding con mode: secure 2024-09-12T00:41:39.684 INFO:tasks.workunit.client.0.smithi043.stderr: -459> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968518ce0) adding con mode: crc 2024-09-12T00:41:39.684 INFO:tasks.workunit.client.0.smithi043.stderr: -458> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968518ce0) adding con mode: secure 2024-09-12T00:41:39.684 INFO:tasks.workunit.client.0.smithi043.stderr: -457> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:39.684 INFO:tasks.workunit.client.0.smithi043.stderr: -456> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 1 librados: starting msgr at 2024-09-12T00:41:39.684 INFO:tasks.workunit.client.0.smithi043.stderr: -455> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 1 librados: starting objecter 2024-09-12T00:41:39.685 INFO:tasks.workunit.client.0.smithi043.stderr: -454> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command objecter_requests hook 0x55a9682c5670 2024-09-12T00:41:39.685 INFO:tasks.workunit.client.0.smithi043.stderr: -453> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 1 librados: setting wanted keys 2024-09-12T00:41:39.685 INFO:tasks.workunit.client.0.smithi043.stderr: -452> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 1 librados: calling monclient init 2024-09-12T00:41:39.685 INFO:tasks.workunit.client.0.smithi043.stderr: -451> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 10 monclient: init 2024-09-12T00:41:39.685 INFO:tasks.workunit.client.0.smithi043.stderr: -450> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9684ebf20) adding auth protocol: cephx 2024-09-12T00:41:39.685 INFO:tasks.workunit.client.0.smithi043.stderr: -449> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9684ebf20) adding auth protocol: cephx 2024-09-12T00:41:39.685 INFO:tasks.workunit.client.0.smithi043.stderr: -448> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9684ebf20) adding auth protocol: cephx 2024-09-12T00:41:39.685 INFO:tasks.workunit.client.0.smithi043.stderr: -447> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9684ebf20) adding con mode: secure 2024-09-12T00:41:39.685 INFO:tasks.workunit.client.0.smithi043.stderr: -446> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9684ebf20) adding con mode: crc 2024-09-12T00:41:39.685 INFO:tasks.workunit.client.0.smithi043.stderr: -445> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9684ebf20) adding con mode: secure 2024-09-12T00:41:39.685 INFO:tasks.workunit.client.0.smithi043.stderr: -444> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9684ebf20) adding con mode: crc 2024-09-12T00:41:39.685 INFO:tasks.workunit.client.0.smithi043.stderr: -443> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9684ebf20) adding con mode: secure 2024-09-12T00:41:39.685 INFO:tasks.workunit.client.0.smithi043.stderr: -442> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9684ebf20) adding con mode: crc 2024-09-12T00:41:39.686 INFO:tasks.workunit.client.0.smithi043.stderr: -441> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9684ebf20) adding con mode: crc 2024-09-12T00:41:39.686 INFO:tasks.workunit.client.0.smithi043.stderr: -440> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9684ebf20) adding con mode: secure 2024-09-12T00:41:39.686 INFO:tasks.workunit.client.0.smithi043.stderr: -439> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9684ebf20) adding con mode: crc 2024-09-12T00:41:39.686 INFO:tasks.workunit.client.0.smithi043.stderr: -438> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9684ebf20) adding con mode: secure 2024-09-12T00:41:39.686 INFO:tasks.workunit.client.0.smithi043.stderr: -437> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9684ebf20) adding con mode: crc 2024-09-12T00:41:39.686 INFO:tasks.workunit.client.0.smithi043.stderr: -436> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9684ebf20) adding con mode: secure 2024-09-12T00:41:39.686 INFO:tasks.workunit.client.0.smithi043.stderr: -435> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:39.686 INFO:tasks.workunit.client.0.smithi043.stderr: -434> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:39.686 INFO:tasks.workunit.client.0.smithi043.stderr: -433> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command rotate-key hook 0x55a9684ec068 2024-09-12T00:41:39.686 INFO:tasks.workunit.client.0.smithi043.stderr: -432> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:39.686 INFO:tasks.workunit.client.0.smithi043.stderr: -431> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:41:39.686 INFO:tasks.workunit.client.0.smithi043.stderr: -430> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 10 monclient(hunting): picked mon.noname-a con 0x55a96839f820 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:41:39.687 INFO:tasks.workunit.client.0.smithi043.stderr: -429> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 10 monclient(hunting): picked mon.noname-c con 0x55a9683aaa80 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:41:39.687 INFO:tasks.workunit.client.0.smithi043.stderr: -428> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 10 monclient(hunting): picked mon.noname-b con 0x55a96843b170 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:41:39.687 INFO:tasks.workunit.client.0.smithi043.stderr: -427> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:39.687 INFO:tasks.workunit.client.0.smithi043.stderr: -426> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:39.687 INFO:tasks.workunit.client.0.smithi043.stderr: -425> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:39.687 INFO:tasks.workunit.client.0.smithi043.stderr: -424> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:39.687 INFO:tasks.workunit.client.0.smithi043.stderr: -423> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 10 monclient(hunting): authenticate will time out at 2395.551513s 2024-09-12T00:41:39.687 INFO:tasks.workunit.client.0.smithi043.stderr: -422> 2024-09-12T00:41:39.558+0000 7fab89da1640 10 monclient(hunting): get_auth_request con 0x55a9683aaa80 auth_method 0 2024-09-12T00:41:39.687 INFO:tasks.workunit.client.0.smithi043.stderr: -421> 2024-09-12T00:41:39.558+0000 7fab89da1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:39.687 INFO:tasks.workunit.client.0.smithi043.stderr: -420> 2024-09-12T00:41:39.558+0000 7fab89da1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:39.687 INFO:tasks.workunit.client.0.smithi043.stderr: -419> 2024-09-12T00:41:39.558+0000 7fab89da1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:39.687 INFO:tasks.workunit.client.0.smithi043.stderr: -418> 2024-09-12T00:41:39.558+0000 7fab8a5a2640 10 monclient(hunting): get_auth_request con 0x55a96839f820 auth_method 0 2024-09-12T00:41:39.687 INFO:tasks.workunit.client.0.smithi043.stderr: -417> 2024-09-12T00:41:39.558+0000 7fab8a5a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:39.687 INFO:tasks.workunit.client.0.smithi043.stderr: -416> 2024-09-12T00:41:39.558+0000 7fab8a5a2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:39.688 INFO:tasks.workunit.client.0.smithi043.stderr: -415> 2024-09-12T00:41:39.558+0000 7fab8a5a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:39.688 INFO:tasks.workunit.client.0.smithi043.stderr: -414> 2024-09-12T00:41:39.558+0000 7fab89da1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:39.688 INFO:tasks.workunit.client.0.smithi043.stderr: -413> 2024-09-12T00:41:39.558+0000 7fab89da1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:39.688 INFO:tasks.workunit.client.0.smithi043.stderr: -412> 2024-09-12T00:41:39.558+0000 7fab89da1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:39.688 INFO:tasks.workunit.client.0.smithi043.stderr: -411> 2024-09-12T00:41:39.558+0000 7fab8a5a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:39.688 INFO:tasks.workunit.client.0.smithi043.stderr: -410> 2024-09-12T00:41:39.558+0000 7fab8a5a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:39.688 INFO:tasks.workunit.client.0.smithi043.stderr: -409> 2024-09-12T00:41:39.558+0000 7fab8a5a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:39.688 INFO:tasks.workunit.client.0.smithi043.stderr: -408> 2024-09-12T00:41:39.558+0000 7fab89da1640 10 monclient(hunting): handle_auth_done global_id 7772 payload 824 2024-09-12T00:41:39.688 INFO:tasks.workunit.client.0.smithi043.stderr: -407> 2024-09-12T00:41:39.558+0000 7fab89da1640 10 monclient: _finish_hunting 0 2024-09-12T00:41:39.688 INFO:tasks.workunit.client.0.smithi043.stderr: -406> 2024-09-12T00:41:39.558+0000 7fab89da1640 1 monclient: found mon.noname-c 2024-09-12T00:41:39.688 INFO:tasks.workunit.client.0.smithi043.stderr: -405> 2024-09-12T00:41:39.558+0000 7fab89da1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:41:39.688 INFO:tasks.workunit.client.0.smithi043.stderr: -404> 2024-09-12T00:41:39.562+0000 7faa76e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:39.688 INFO:tasks.workunit.client.0.smithi043.stderr: -403> 2024-09-12T00:41:39.562+0000 7faa76e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:41:39.689 INFO:tasks.workunit.client.0.smithi043.stderr: -402> 2024-09-12T00:41:39.562+0000 7faa76e05640 10 monclient: dump: 2024-09-12T00:41:39.689 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:39.689 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:39.689 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.689 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.689 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:39.689 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:39.689 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:39.689 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:39.689 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:39.689 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.689 INFO:tasks.workunit.client.0.smithi043.stderr: -401> 2024-09-12T00:41:39.562+0000 7faa76e05640 10 monclient: _finish_auth 0 2024-09-12T00:41:39.689 INFO:tasks.workunit.client.0.smithi043.stderr: -400> 2024-09-12T00:41:39.562+0000 7faa76e05640 10 monclient: _check_auth_tickets 2024-09-12T00:41:39.690 INFO:tasks.workunit.client.0.smithi043.stderr: -399> 2024-09-12T00:41:39.562+0000 7faa76e05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:39.690 INFO:tasks.workunit.client.0.smithi043.stderr: -398> 2024-09-12T00:41:39.562+0000 7faa76e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:39.690 INFO:tasks.workunit.client.0.smithi043.stderr: -397> 2024-09-12T00:41:39.562+0000 7faa76e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:41:39.690 INFO:tasks.workunit.client.0.smithi043.stderr: -396> 2024-09-12T00:41:39.562+0000 7faa76e05640 10 monclient: dump: 2024-09-12T00:41:39.690 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:39.690 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:39.690 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.690 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.690 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:39.690 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:39.690 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:39.690 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:39.690 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:39.690 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.691 INFO:tasks.workunit.client.0.smithi043.stderr: -395> 2024-09-12T00:41:39.562+0000 7faa78608640 4 set_mon_vals no callback set 2024-09-12T00:41:39.691 INFO:tasks.workunit.client.0.smithi043.stderr: -394> 2024-09-12T00:41:39.562+0000 7fab8ca9c9c0 5 monclient: authenticate success, global_id 7772 2024-09-12T00:41:39.691 INFO:tasks.workunit.client.0.smithi043.stderr: -393> 2024-09-12T00:41:39.562+0000 7fab8ca9c9c0 10 monclient: _renew_subs 2024-09-12T00:41:39.691 INFO:tasks.workunit.client.0.smithi043.stderr: -392> 2024-09-12T00:41:39.562+0000 7fab8ca9c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:41:39.691 INFO:tasks.workunit.client.0.smithi043.stderr: -391> 2024-09-12T00:41:39.562+0000 7fab8ca9c9c0 10 monclient: _renew_subs 2024-09-12T00:41:39.691 INFO:tasks.workunit.client.0.smithi043.stderr: -390> 2024-09-12T00:41:39.562+0000 7fab8ca9c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:41:39.691 INFO:tasks.workunit.client.0.smithi043.stderr: -389> 2024-09-12T00:41:39.562+0000 7fab8ca9c9c0 1 librados: init done 2024-09-12T00:41:39.691 INFO:tasks.workunit.client.0.smithi043.stderr: -388> 2024-09-12T00:41:39.562+0000 7faa76e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:41:39.691 INFO:tasks.workunit.client.0.smithi043.stderr: -387> 2024-09-12T00:41:39.562+0000 7faa76e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:41:39.691 INFO:tasks.workunit.client.0.smithi043.stderr: -386> 2024-09-12T00:41:39.562+0000 7faa76e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:41:39.691 INFO:tasks.workunit.client.0.smithi043.stderr: -385> 2024-09-12T00:41:39.562+0000 7fab8a5a2640 10 monclient: get_auth_request con 0x7faa70070b10 auth_method 0 2024-09-12T00:41:39.691 INFO:tasks.workunit.client.0.smithi043.stderr: -384> 2024-09-12T00:41:39.562+0000 7fab8ada3640 10 monclient: get_auth_request con 0x55a968517210 auth_method 0 2024-09-12T00:41:39.691 INFO:tasks.workunit.client.0.smithi043.stderr: -383> 2024-09-12T00:41:39.566+0000 7fab8a5a2640 10 monclient: get_auth_request con 0x55a968536740 auth_method 0 2024-09-12T00:41:39.692 INFO:tasks.workunit.client.0.smithi043.stderr: -382> 2024-09-12T00:41:39.566+0000 7fab89da1640 10 monclient: get_auth_request con 0x55a96853ab30 auth_method 0 2024-09-12T00:41:39.692 INFO:tasks.workunit.client.0.smithi043.stderr: -381> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 10 monclient: build_initial_monmap 2024-09-12T00:41:39.692 INFO:tasks.workunit.client.0.smithi043.stderr: -380> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 1 build_initial for_mkfs: 0 2024-09-12T00:41:39.692 INFO:tasks.workunit.client.0.smithi043.stderr: -379> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 10 monclient: monmap: 2024-09-12T00:41:39.692 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:41:39.692 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:41:39.692 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:41:39.692 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:41:39.692 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:41:39.692 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:39.692 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:41:39.692 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:41:39.693 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:41:39.693 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.693 INFO:tasks.workunit.client.0.smithi043.stderr: -378> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853fbc0) adding auth protocol: cephx 2024-09-12T00:41:39.693 INFO:tasks.workunit.client.0.smithi043.stderr: -377> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853fbc0) adding auth protocol: cephx 2024-09-12T00:41:39.693 INFO:tasks.workunit.client.0.smithi043.stderr: -376> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853fbc0) adding auth protocol: cephx 2024-09-12T00:41:39.693 INFO:tasks.workunit.client.0.smithi043.stderr: -375> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853fbc0) adding con mode: secure 2024-09-12T00:41:39.693 INFO:tasks.workunit.client.0.smithi043.stderr: -374> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853fbc0) adding con mode: crc 2024-09-12T00:41:39.693 INFO:tasks.workunit.client.0.smithi043.stderr: -373> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853fbc0) adding con mode: secure 2024-09-12T00:41:39.693 INFO:tasks.workunit.client.0.smithi043.stderr: -372> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853fbc0) adding con mode: crc 2024-09-12T00:41:39.693 INFO:tasks.workunit.client.0.smithi043.stderr: -371> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853fbc0) adding con mode: secure 2024-09-12T00:41:39.694 INFO:tasks.workunit.client.0.smithi043.stderr: -370> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853fbc0) adding con mode: crc 2024-09-12T00:41:39.694 INFO:tasks.workunit.client.0.smithi043.stderr: -369> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853fbc0) adding con mode: crc 2024-09-12T00:41:39.694 INFO:tasks.workunit.client.0.smithi043.stderr: -368> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853fbc0) adding con mode: secure 2024-09-12T00:41:39.694 INFO:tasks.workunit.client.0.smithi043.stderr: -367> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853fbc0) adding con mode: crc 2024-09-12T00:41:39.694 INFO:tasks.workunit.client.0.smithi043.stderr: -366> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853fbc0) adding con mode: secure 2024-09-12T00:41:39.694 INFO:tasks.workunit.client.0.smithi043.stderr: -365> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853fbc0) adding con mode: crc 2024-09-12T00:41:39.694 INFO:tasks.workunit.client.0.smithi043.stderr: -364> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853fbc0) adding con mode: secure 2024-09-12T00:41:39.694 INFO:tasks.workunit.client.0.smithi043.stderr: -363> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:39.694 INFO:tasks.workunit.client.0.smithi043.stderr: -362> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a9685434e0 EEXIST 2024-09-12T00:41:39.694 INFO:tasks.workunit.client.0.smithi043.stderr: -361> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient: init 2024-09-12T00:41:39.694 INFO:tasks.workunit.client.0.smithi043.stderr: -360> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853e0c8) adding auth protocol: cephx 2024-09-12T00:41:39.694 INFO:tasks.workunit.client.0.smithi043.stderr: -359> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853e0c8) adding auth protocol: cephx 2024-09-12T00:41:39.694 INFO:tasks.workunit.client.0.smithi043.stderr: -358> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853e0c8) adding auth protocol: cephx 2024-09-12T00:41:39.695 INFO:tasks.workunit.client.0.smithi043.stderr: -357> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853e0c8) adding con mode: secure 2024-09-12T00:41:39.695 INFO:tasks.workunit.client.0.smithi043.stderr: -356> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853e0c8) adding con mode: crc 2024-09-12T00:41:39.695 INFO:tasks.workunit.client.0.smithi043.stderr: -355> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853e0c8) adding con mode: secure 2024-09-12T00:41:39.695 INFO:tasks.workunit.client.0.smithi043.stderr: -354> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853e0c8) adding con mode: crc 2024-09-12T00:41:39.695 INFO:tasks.workunit.client.0.smithi043.stderr: -353> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853e0c8) adding con mode: secure 2024-09-12T00:41:39.695 INFO:tasks.workunit.client.0.smithi043.stderr: -352> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853e0c8) adding con mode: crc 2024-09-12T00:41:39.695 INFO:tasks.workunit.client.0.smithi043.stderr: -351> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853e0c8) adding con mode: crc 2024-09-12T00:41:39.695 INFO:tasks.workunit.client.0.smithi043.stderr: -350> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853e0c8) adding con mode: secure 2024-09-12T00:41:39.695 INFO:tasks.workunit.client.0.smithi043.stderr: -349> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853e0c8) adding con mode: crc 2024-09-12T00:41:39.695 INFO:tasks.workunit.client.0.smithi043.stderr: -348> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853e0c8) adding con mode: secure 2024-09-12T00:41:39.695 INFO:tasks.workunit.client.0.smithi043.stderr: -347> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853e0c8) adding con mode: crc 2024-09-12T00:41:39.695 INFO:tasks.workunit.client.0.smithi043.stderr: -346> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853e0c8) adding con mode: secure 2024-09-12T00:41:39.695 INFO:tasks.workunit.client.0.smithi043.stderr: -345> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:39.696 INFO:tasks.workunit.client.0.smithi043.stderr: -344> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:39.696 INFO:tasks.workunit.client.0.smithi043.stderr: -343> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command rotate-key cmddesc rotate-key hook 0x55a96853e210 EEXIST 2024-09-12T00:41:39.696 INFO:tasks.workunit.client.0.smithi043.stderr: -342> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:39.696 INFO:tasks.workunit.client.0.smithi043.stderr: -341> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:41:39.696 INFO:tasks.workunit.client.0.smithi043.stderr: -340> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient(hunting): picked mon.noname-c con 0x55a968567690 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:41:39.696 INFO:tasks.workunit.client.0.smithi043.stderr: -339> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient(hunting): picked mon.noname-a con 0x55a968566fc0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:41:39.696 INFO:tasks.workunit.client.0.smithi043.stderr: -338> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient(hunting): picked mon.noname-b con 0x55a9685659a0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:41:39.696 INFO:tasks.workunit.client.0.smithi043.stderr: -337> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:39.696 INFO:tasks.workunit.client.0.smithi043.stderr: -336> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:39.696 INFO:tasks.workunit.client.0.smithi043.stderr: -335> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:39.696 INFO:tasks.workunit.client.0.smithi043.stderr: -334> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:39.696 INFO:tasks.workunit.client.0.smithi043.stderr: -333> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient(hunting): authenticate will time out at 2395.560758s 2024-09-12T00:41:39.696 INFO:tasks.workunit.client.0.smithi043.stderr: -332> 2024-09-12T00:41:39.570+0000 7fab8a5a2640 10 monclient(hunting): get_auth_request con 0x55a968567690 auth_method 0 2024-09-12T00:41:39.697 INFO:tasks.workunit.client.0.smithi043.stderr: -331> 2024-09-12T00:41:39.570+0000 7fab8a5a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:39.697 INFO:tasks.workunit.client.0.smithi043.stderr: -330> 2024-09-12T00:41:39.570+0000 7fab8a5a2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:39.697 INFO:tasks.workunit.client.0.smithi043.stderr: -329> 2024-09-12T00:41:39.570+0000 7fab8a5a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:39.697 INFO:tasks.workunit.client.0.smithi043.stderr: -328> 2024-09-12T00:41:39.570+0000 7fab89da1640 10 monclient(hunting): get_auth_request con 0x55a968566fc0 auth_method 0 2024-09-12T00:41:39.697 INFO:tasks.workunit.client.0.smithi043.stderr: -327> 2024-09-12T00:41:39.570+0000 7fab89da1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:39.697 INFO:tasks.workunit.client.0.smithi043.stderr: -326> 2024-09-12T00:41:39.570+0000 7fab89da1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:39.697 INFO:tasks.workunit.client.0.smithi043.stderr: -325> 2024-09-12T00:41:39.570+0000 7fab89da1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:39.697 INFO:tasks.workunit.client.0.smithi043.stderr: -324> 2024-09-12T00:41:39.570+0000 7fab8a5a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:39.697 INFO:tasks.workunit.client.0.smithi043.stderr: -323> 2024-09-12T00:41:39.570+0000 7fab8a5a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:39.697 INFO:tasks.workunit.client.0.smithi043.stderr: -322> 2024-09-12T00:41:39.570+0000 7fab8a5a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:39.697 INFO:tasks.workunit.client.0.smithi043.stderr: -321> 2024-09-12T00:41:39.570+0000 7fab89da1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:39.697 INFO:tasks.workunit.client.0.smithi043.stderr: -320> 2024-09-12T00:41:39.570+0000 7fab89da1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:39.697 INFO:tasks.workunit.client.0.smithi043.stderr: -319> 2024-09-12T00:41:39.570+0000 7fab89da1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:39.697 INFO:tasks.workunit.client.0.smithi043.stderr: -318> 2024-09-12T00:41:39.570+0000 7fab89da1640 10 monclient(hunting): handle_auth_done global_id 8163 payload 824 2024-09-12T00:41:39.698 INFO:tasks.workunit.client.0.smithi043.stderr: -317> 2024-09-12T00:41:39.570+0000 7fab89da1640 10 monclient: _finish_hunting 0 2024-09-12T00:41:39.698 INFO:tasks.workunit.client.0.smithi043.stderr: -316> 2024-09-12T00:41:39.570+0000 7fab89da1640 1 monclient: found mon.noname-a 2024-09-12T00:41:39.698 INFO:tasks.workunit.client.0.smithi043.stderr: -315> 2024-09-12T00:41:39.570+0000 7fab89da1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:41:39.698 INFO:tasks.workunit.client.0.smithi043.stderr: -314> 2024-09-12T00:41:39.570+0000 7fab8ada3640 10 monclient: get_auth_request con 0x55a9685659a0 auth_method 0 2024-09-12T00:41:39.698 INFO:tasks.workunit.client.0.smithi043.stderr: -313> 2024-09-12T00:41:39.570+0000 7faa6ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:39.698 INFO:tasks.workunit.client.0.smithi043.stderr: -312> 2024-09-12T00:41:39.570+0000 7faa6ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:41:39.698 INFO:tasks.workunit.client.0.smithi043.stderr: -311> 2024-09-12T00:41:39.570+0000 7faa6ffff640 10 monclient: dump: 2024-09-12T00:41:39.698 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:39.698 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:39.698 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.698 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.698 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:39.699 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:39.699 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:39.699 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:39.699 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:39.699 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.699 INFO:tasks.workunit.client.0.smithi043.stderr: -310> 2024-09-12T00:41:39.570+0000 7faa6ffff640 10 monclient: _finish_auth 0 2024-09-12T00:41:39.699 INFO:tasks.workunit.client.0.smithi043.stderr: -309> 2024-09-12T00:41:39.570+0000 7faa6ffff640 10 monclient: _check_auth_tickets 2024-09-12T00:41:39.699 INFO:tasks.workunit.client.0.smithi043.stderr: -308> 2024-09-12T00:41:39.570+0000 7faa6ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:39.699 INFO:tasks.workunit.client.0.smithi043.stderr: -307> 2024-09-12T00:41:39.570+0000 7faa6ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:39.699 INFO:tasks.workunit.client.0.smithi043.stderr: -306> 2024-09-12T00:41:39.570+0000 7faa6ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:41:39.699 INFO:tasks.workunit.client.0.smithi043.stderr: -305> 2024-09-12T00:41:39.570+0000 7faa6ffff640 10 monclient: dump: 2024-09-12T00:41:39.699 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:39.699 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:39.699 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.700 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.700 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:39.700 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:39.700 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:39.700 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:39.700 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:39.700 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.700 INFO:tasks.workunit.client.0.smithi043.stderr: -304> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 monclient: authenticate success, global_id 8163 2024-09-12T00:41:39.700 INFO:tasks.workunit.client.0.smithi043.stderr: -303> 2024-09-12T00:41:39.570+0000 7fab8b5a4640 4 set_mon_vals no callback set 2024-09-12T00:41:39.700 INFO:tasks.workunit.client.0.smithi043.stderr: -302> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient: _renew_subs 2024-09-12T00:41:39.700 INFO:tasks.workunit.client.0.smithi043.stderr: -301> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:41:39.700 INFO:tasks.workunit.client.0.smithi043.stderr: -300> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient: _renew_subs 2024-09-12T00:41:39.701 INFO:tasks.workunit.client.0.smithi043.stderr: -299> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:41:39.701 INFO:tasks.workunit.client.0.smithi043.stderr: -298> 2024-09-12T00:41:39.570+0000 7faa6ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:41:39.701 INFO:tasks.workunit.client.0.smithi043.stderr: -297> 2024-09-12T00:41:39.570+0000 7faa6ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:41:39.701 INFO:tasks.workunit.client.0.smithi043.stderr: -296> 2024-09-12T00:41:39.570+0000 7faa6ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:41:39.701 INFO:tasks.workunit.client.0.smithi043.stderr: -295> 2024-09-12T00:41:39.570+0000 7fab8a5a2640 10 monclient: get_auth_request con 0x7faa64070a20 auth_method 0 2024-09-12T00:41:39.701 INFO:tasks.workunit.client.0.smithi043.stderr: -294> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient: get_monmap_and_config 2024-09-12T00:41:39.701 INFO:tasks.workunit.client.0.smithi043.stderr: -293> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient: build_initial_monmap 2024-09-12T00:41:39.701 INFO:tasks.workunit.client.0.smithi043.stderr: -292> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 1 build_initial for_mkfs: 0 2024-09-12T00:41:39.701 INFO:tasks.workunit.client.0.smithi043.stderr: -291> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient: monmap: 2024-09-12T00:41:39.701 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:41:39.701 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:41:39.701 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:41:39.701 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:41:39.702 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:41:39.702 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:39.702 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:41:39.702 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:41:39.702 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:41:39.702 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.702 INFO:tasks.workunit.client.0.smithi043.stderr: -290> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968586d70) adding auth protocol: cephx 2024-09-12T00:41:39.702 INFO:tasks.workunit.client.0.smithi043.stderr: -289> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968586d70) adding auth protocol: cephx 2024-09-12T00:41:39.702 INFO:tasks.workunit.client.0.smithi043.stderr: -288> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968586d70) adding auth protocol: cephx 2024-09-12T00:41:39.702 INFO:tasks.workunit.client.0.smithi043.stderr: -287> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968586d70) adding con mode: secure 2024-09-12T00:41:39.702 INFO:tasks.workunit.client.0.smithi043.stderr: -286> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968586d70) adding con mode: crc 2024-09-12T00:41:39.702 INFO:tasks.workunit.client.0.smithi043.stderr: -285> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968586d70) adding con mode: secure 2024-09-12T00:41:39.702 INFO:tasks.workunit.client.0.smithi043.stderr: -284> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968586d70) adding con mode: crc 2024-09-12T00:41:39.702 INFO:tasks.workunit.client.0.smithi043.stderr: -283> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968586d70) adding con mode: secure 2024-09-12T00:41:39.703 INFO:tasks.workunit.client.0.smithi043.stderr: -282> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968586d70) adding con mode: crc 2024-09-12T00:41:39.703 INFO:tasks.workunit.client.0.smithi043.stderr: -281> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968586d70) adding con mode: crc 2024-09-12T00:41:39.703 INFO:tasks.workunit.client.0.smithi043.stderr: -280> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968586d70) adding con mode: secure 2024-09-12T00:41:39.703 INFO:tasks.workunit.client.0.smithi043.stderr: -279> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968586d70) adding con mode: crc 2024-09-12T00:41:39.703 INFO:tasks.workunit.client.0.smithi043.stderr: -278> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968586d70) adding con mode: secure 2024-09-12T00:41:39.703 INFO:tasks.workunit.client.0.smithi043.stderr: -277> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968586d70) adding con mode: crc 2024-09-12T00:41:39.703 INFO:tasks.workunit.client.0.smithi043.stderr: -276> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968586d70) adding con mode: secure 2024-09-12T00:41:39.703 INFO:tasks.workunit.client.0.smithi043.stderr: -275> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:39.703 INFO:tasks.workunit.client.0.smithi043.stderr: -274> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient: init 2024-09-12T00:41:39.703 INFO:tasks.workunit.client.0.smithi043.stderr: -273> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a134d0) adding auth protocol: cephx 2024-09-12T00:41:39.703 INFO:tasks.workunit.client.0.smithi043.stderr: -272> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a134d0) adding auth protocol: cephx 2024-09-12T00:41:39.703 INFO:tasks.workunit.client.0.smithi043.stderr: -271> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a134d0) adding auth protocol: cephx 2024-09-12T00:41:39.704 INFO:tasks.workunit.client.0.smithi043.stderr: -270> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a134d0) adding con mode: secure 2024-09-12T00:41:39.704 INFO:tasks.workunit.client.0.smithi043.stderr: -269> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a134d0) adding con mode: crc 2024-09-12T00:41:39.704 INFO:tasks.workunit.client.0.smithi043.stderr: -268> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a134d0) adding con mode: secure 2024-09-12T00:41:39.704 INFO:tasks.workunit.client.0.smithi043.stderr: -267> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a134d0) adding con mode: crc 2024-09-12T00:41:39.704 INFO:tasks.workunit.client.0.smithi043.stderr: -266> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a134d0) adding con mode: secure 2024-09-12T00:41:39.704 INFO:tasks.workunit.client.0.smithi043.stderr: -265> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a134d0) adding con mode: crc 2024-09-12T00:41:39.704 INFO:tasks.workunit.client.0.smithi043.stderr: -264> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a134d0) adding con mode: crc 2024-09-12T00:41:39.704 INFO:tasks.workunit.client.0.smithi043.stderr: -263> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a134d0) adding con mode: secure 2024-09-12T00:41:39.704 INFO:tasks.workunit.client.0.smithi043.stderr: -262> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a134d0) adding con mode: crc 2024-09-12T00:41:39.704 INFO:tasks.workunit.client.0.smithi043.stderr: -261> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a134d0) adding con mode: secure 2024-09-12T00:41:39.704 INFO:tasks.workunit.client.0.smithi043.stderr: -260> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a134d0) adding con mode: crc 2024-09-12T00:41:39.704 INFO:tasks.workunit.client.0.smithi043.stderr: -259> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a134d0) adding con mode: secure 2024-09-12T00:41:39.704 INFO:tasks.workunit.client.0.smithi043.stderr: -258> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:39.705 INFO:tasks.workunit.client.0.smithi043.stderr: -257> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:39.705 INFO:tasks.workunit.client.0.smithi043.stderr: -256> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command rotate-key cmddesc rotate-key hook 0x7fff10a13618 EEXIST 2024-09-12T00:41:39.705 INFO:tasks.workunit.client.0.smithi043.stderr: -255> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:39.705 INFO:tasks.workunit.client.0.smithi043.stderr: -254> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:41:39.705 INFO:tasks.workunit.client.0.smithi043.stderr: -253> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): picked mon.noname-b con 0x55a9685bb270 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:41:39.705 INFO:tasks.workunit.client.0.smithi043.stderr: -252> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): picked mon.noname-c con 0x55a9685b6660 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:41:39.705 INFO:tasks.workunit.client.0.smithi043.stderr: -251> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): picked mon.noname-a con 0x55a9685b6fe0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:41:39.705 INFO:tasks.workunit.client.0.smithi043.stderr: -250> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:39.705 INFO:tasks.workunit.client.0.smithi043.stderr: -249> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:39.705 INFO:tasks.workunit.client.0.smithi043.stderr: -248> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:39.705 INFO:tasks.workunit.client.0.smithi043.stderr: -247> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:39.705 INFO:tasks.workunit.client.0.smithi043.stderr: -246> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): authenticate will time out at 2395.564902s 2024-09-12T00:41:39.705 INFO:tasks.workunit.client.0.smithi043.stderr: -245> 2024-09-12T00:41:39.574+0000 7fab89da1640 10 monclient(hunting): get_auth_request con 0x55a9685b6660 auth_method 0 2024-09-12T00:41:39.706 INFO:tasks.workunit.client.0.smithi043.stderr: -244> 2024-09-12T00:41:39.574+0000 7fab89da1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:39.706 INFO:tasks.workunit.client.0.smithi043.stderr: -243> 2024-09-12T00:41:39.574+0000 7fab89da1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:39.706 INFO:tasks.workunit.client.0.smithi043.stderr: -242> 2024-09-12T00:41:39.574+0000 7fab89da1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:39.706 INFO:tasks.workunit.client.0.smithi043.stderr: -241> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient(hunting): get_auth_request con 0x55a9685b6fe0 auth_method 0 2024-09-12T00:41:39.706 INFO:tasks.workunit.client.0.smithi043.stderr: -240> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:39.706 INFO:tasks.workunit.client.0.smithi043.stderr: -239> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:39.706 INFO:tasks.workunit.client.0.smithi043.stderr: -238> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:39.706 INFO:tasks.workunit.client.0.smithi043.stderr: -237> 2024-09-12T00:41:39.574+0000 7fab89da1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:39.706 INFO:tasks.workunit.client.0.smithi043.stderr: -236> 2024-09-12T00:41:39.574+0000 7fab89da1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:39.706 INFO:tasks.workunit.client.0.smithi043.stderr: -235> 2024-09-12T00:41:39.574+0000 7fab89da1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:39.706 INFO:tasks.workunit.client.0.smithi043.stderr: -234> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:39.706 INFO:tasks.workunit.client.0.smithi043.stderr: -233> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:39.706 INFO:tasks.workunit.client.0.smithi043.stderr: -232> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:39.707 INFO:tasks.workunit.client.0.smithi043.stderr: -231> 2024-09-12T00:41:39.574+0000 7fab89da1640 10 monclient(hunting): handle_auth_done global_id 7778 payload 274 2024-09-12T00:41:39.707 INFO:tasks.workunit.client.0.smithi043.stderr: -230> 2024-09-12T00:41:39.574+0000 7fab89da1640 10 monclient: _finish_hunting 0 2024-09-12T00:41:39.707 INFO:tasks.workunit.client.0.smithi043.stderr: -229> 2024-09-12T00:41:39.574+0000 7fab89da1640 1 monclient: found mon.noname-c 2024-09-12T00:41:39.707 INFO:tasks.workunit.client.0.smithi043.stderr: -228> 2024-09-12T00:41:39.574+0000 7fab89da1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:41:39.707 INFO:tasks.workunit.client.0.smithi043.stderr: -227> 2024-09-12T00:41:39.574+0000 7faa6dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:39.707 INFO:tasks.workunit.client.0.smithi043.stderr: -226> 2024-09-12T00:41:39.574+0000 7faa6dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:41:39.707 INFO:tasks.workunit.client.0.smithi043.stderr: -225> 2024-09-12T00:41:39.574+0000 7faa6dffb640 10 monclient: dump: 2024-09-12T00:41:39.707 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:39.707 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:39.707 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.707 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.707 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:39.707 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:39.707 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:39.708 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:39.708 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:39.708 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.708 INFO:tasks.workunit.client.0.smithi043.stderr: -224> 2024-09-12T00:41:39.574+0000 7faa6dffb640 10 monclient: _finish_auth 0 2024-09-12T00:41:39.708 INFO:tasks.workunit.client.0.smithi043.stderr: -223> 2024-09-12T00:41:39.574+0000 7faa6dffb640 10 monclient: _check_auth_tickets 2024-09-12T00:41:39.708 INFO:tasks.workunit.client.0.smithi043.stderr: -222> 2024-09-12T00:41:39.574+0000 7faa6dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:39.708 INFO:tasks.workunit.client.0.smithi043.stderr: -221> 2024-09-12T00:41:39.574+0000 7faa6dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:39.708 INFO:tasks.workunit.client.0.smithi043.stderr: -220> 2024-09-12T00:41:39.574+0000 7faa6dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:41:39.708 INFO:tasks.workunit.client.0.smithi043.stderr: -219> 2024-09-12T00:41:39.574+0000 7faa6dffb640 10 monclient: dump: 2024-09-12T00:41:39.708 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:39.708 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:39.708 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.708 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.709 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:39.709 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:39.709 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:39.709 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:39.709 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:39.709 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.709 INFO:tasks.workunit.client.0.smithi043.stderr: -218> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 monclient: authenticate success, global_id 7778 2024-09-12T00:41:39.709 INFO:tasks.workunit.client.0.smithi043.stderr: -217> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:41:39.709 INFO:tasks.workunit.client.0.smithi043.stderr: -216> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 4 set_mon_vals no callback set 2024-09-12T00:41:39.709 INFO:tasks.workunit.client.0.smithi043.stderr: -215> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient: shutdown 2024-09-12T00:41:39.709 INFO:tasks.workunit.client.0.smithi043.stderr: -214> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient: build_initial_monmap 2024-09-12T00:41:39.709 INFO:tasks.workunit.client.0.smithi043.stderr: -213> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 1 build_initial for_mkfs: 0 2024-09-12T00:41:39.709 INFO:tasks.workunit.client.0.smithi043.stderr: -212> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient: monmap: 2024-09-12T00:41:39.710 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:41:39.710 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:41:39.710 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:41:39.710 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:41:39.710 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:41:39.710 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:39.710 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:41:39.710 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:41:39.710 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:41:39.710 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.710 INFO:tasks.workunit.client.0.smithi043.stderr: -211> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685b74d0) adding auth protocol: cephx 2024-09-12T00:41:39.710 INFO:tasks.workunit.client.0.smithi043.stderr: -210> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685b74d0) adding auth protocol: cephx 2024-09-12T00:41:39.710 INFO:tasks.workunit.client.0.smithi043.stderr: -209> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685b74d0) adding auth protocol: cephx 2024-09-12T00:41:39.711 INFO:tasks.workunit.client.0.smithi043.stderr: -208> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685b74d0) adding con mode: secure 2024-09-12T00:41:39.711 INFO:tasks.workunit.client.0.smithi043.stderr: -207> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685b74d0) adding con mode: crc 2024-09-12T00:41:39.711 INFO:tasks.workunit.client.0.smithi043.stderr: -206> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685b74d0) adding con mode: secure 2024-09-12T00:41:39.711 INFO:tasks.workunit.client.0.smithi043.stderr: -205> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685b74d0) adding con mode: crc 2024-09-12T00:41:39.711 INFO:tasks.workunit.client.0.smithi043.stderr: -204> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685b74d0) adding con mode: secure 2024-09-12T00:41:39.711 INFO:tasks.workunit.client.0.smithi043.stderr: -203> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685b74d0) adding con mode: crc 2024-09-12T00:41:39.711 INFO:tasks.workunit.client.0.smithi043.stderr: -202> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685b74d0) adding con mode: crc 2024-09-12T00:41:39.711 INFO:tasks.workunit.client.0.smithi043.stderr: -201> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685b74d0) adding con mode: secure 2024-09-12T00:41:39.711 INFO:tasks.workunit.client.0.smithi043.stderr: -200> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685b74d0) adding con mode: crc 2024-09-12T00:41:39.711 INFO:tasks.workunit.client.0.smithi043.stderr: -199> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685b74d0) adding con mode: secure 2024-09-12T00:41:39.711 INFO:tasks.workunit.client.0.smithi043.stderr: -198> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685b74d0) adding con mode: crc 2024-09-12T00:41:39.711 INFO:tasks.workunit.client.0.smithi043.stderr: -197> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685b74d0) adding con mode: secure 2024-09-12T00:41:39.712 INFO:tasks.workunit.client.0.smithi043.stderr: -196> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:39.712 INFO:tasks.workunit.client.0.smithi043.stderr: -195> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 1 librados: starting msgr at 2024-09-12T00:41:39.712 INFO:tasks.workunit.client.0.smithi043.stderr: -194> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 1 librados: starting objecter 2024-09-12T00:41:39.712 INFO:tasks.workunit.client.0.smithi043.stderr: -193> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a968586a60 EEXIST 2024-09-12T00:41:39.712 INFO:tasks.workunit.client.0.smithi043.stderr: -192> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 1 librados: setting wanted keys 2024-09-12T00:41:39.712 INFO:tasks.workunit.client.0.smithi043.stderr: -191> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 1 librados: calling monclient init 2024-09-12T00:41:39.712 INFO:tasks.workunit.client.0.smithi043.stderr: -190> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient: init 2024-09-12T00:41:39.712 INFO:tasks.workunit.client.0.smithi043.stderr: -189> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685694b0) adding auth protocol: cephx 2024-09-12T00:41:39.712 INFO:tasks.workunit.client.0.smithi043.stderr: -188> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685694b0) adding auth protocol: cephx 2024-09-12T00:41:39.712 INFO:tasks.workunit.client.0.smithi043.stderr: -187> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685694b0) adding auth protocol: cephx 2024-09-12T00:41:39.712 INFO:tasks.workunit.client.0.smithi043.stderr: -186> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685694b0) adding con mode: secure 2024-09-12T00:41:39.712 INFO:tasks.workunit.client.0.smithi043.stderr: -185> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685694b0) adding con mode: crc 2024-09-12T00:41:39.712 INFO:tasks.workunit.client.0.smithi043.stderr: -184> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685694b0) adding con mode: secure 2024-09-12T00:41:39.713 INFO:tasks.workunit.client.0.smithi043.stderr: -183> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685694b0) adding con mode: crc 2024-09-12T00:41:39.713 INFO:tasks.workunit.client.0.smithi043.stderr: -182> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685694b0) adding con mode: secure 2024-09-12T00:41:39.713 INFO:tasks.workunit.client.0.smithi043.stderr: -181> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685694b0) adding con mode: crc 2024-09-12T00:41:39.713 INFO:tasks.workunit.client.0.smithi043.stderr: -180> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685694b0) adding con mode: crc 2024-09-12T00:41:39.713 INFO:tasks.workunit.client.0.smithi043.stderr: -179> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685694b0) adding con mode: secure 2024-09-12T00:41:39.713 INFO:tasks.workunit.client.0.smithi043.stderr: -178> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685694b0) adding con mode: crc 2024-09-12T00:41:39.713 INFO:tasks.workunit.client.0.smithi043.stderr: -177> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685694b0) adding con mode: secure 2024-09-12T00:41:39.713 INFO:tasks.workunit.client.0.smithi043.stderr: -176> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685694b0) adding con mode: crc 2024-09-12T00:41:39.713 INFO:tasks.workunit.client.0.smithi043.stderr: -175> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685694b0) adding con mode: secure 2024-09-12T00:41:39.714 INFO:tasks.workunit.client.0.smithi043.stderr: -174> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:39.714 INFO:tasks.workunit.client.0.smithi043.stderr: -173> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:39.714 INFO:tasks.workunit.client.0.smithi043.stderr: -172> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command rotate-key cmddesc rotate-key hook 0x55a9685695f8 EEXIST 2024-09-12T00:41:39.714 INFO:tasks.workunit.client.0.smithi043.stderr: -171> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:39.714 INFO:tasks.workunit.client.0.smithi043.stderr: -170> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:41:39.714 INFO:tasks.workunit.client.0.smithi043.stderr: -169> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): picked mon.noname-a con 0x55a9685b6660 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:41:39.714 INFO:tasks.workunit.client.0.smithi043.stderr: -168> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): picked mon.noname-b con 0x55a9685b6fe0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:41:39.714 INFO:tasks.workunit.client.0.smithi043.stderr: -167> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): picked mon.noname-c con 0x55a9685bb270 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:41:39.714 INFO:tasks.workunit.client.0.smithi043.stderr: -166> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:39.714 INFO:tasks.workunit.client.0.smithi043.stderr: -165> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:39.714 INFO:tasks.workunit.client.0.smithi043.stderr: -164> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:39.714 INFO:tasks.workunit.client.0.smithi043.stderr: -163> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:39.714 INFO:tasks.workunit.client.0.smithi043.stderr: -162> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): authenticate will time out at 2395.567542s 2024-09-12T00:41:39.715 INFO:tasks.workunit.client.0.smithi043.stderr: -161> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient(hunting): get_auth_request con 0x55a9685bb270 auth_method 0 2024-09-12T00:41:39.715 INFO:tasks.workunit.client.0.smithi043.stderr: -160> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:39.715 INFO:tasks.workunit.client.0.smithi043.stderr: -159> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:39.715 INFO:tasks.workunit.client.0.smithi043.stderr: -158> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:39.715 INFO:tasks.workunit.client.0.smithi043.stderr: -157> 2024-09-12T00:41:39.574+0000 7fab8a5a2640 10 monclient(hunting): get_auth_request con 0x55a9685b6660 auth_method 0 2024-09-12T00:41:39.715 INFO:tasks.workunit.client.0.smithi043.stderr: -156> 2024-09-12T00:41:39.574+0000 7fab8a5a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:39.715 INFO:tasks.workunit.client.0.smithi043.stderr: -155> 2024-09-12T00:41:39.574+0000 7fab8a5a2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:39.715 INFO:tasks.workunit.client.0.smithi043.stderr: -154> 2024-09-12T00:41:39.574+0000 7fab8a5a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:39.715 INFO:tasks.workunit.client.0.smithi043.stderr: -153> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:39.715 INFO:tasks.workunit.client.0.smithi043.stderr: -152> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:39.715 INFO:tasks.workunit.client.0.smithi043.stderr: -151> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:39.715 INFO:tasks.workunit.client.0.smithi043.stderr: -150> 2024-09-12T00:41:39.574+0000 7fab8a5a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:39.715 INFO:tasks.workunit.client.0.smithi043.stderr: -149> 2024-09-12T00:41:39.574+0000 7fab8a5a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:39.716 INFO:tasks.workunit.client.0.smithi043.stderr: -148> 2024-09-12T00:41:39.574+0000 7fab8a5a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:39.716 INFO:tasks.workunit.client.0.smithi043.stderr: -147> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient(hunting): handle_auth_done global_id 7781 payload 824 2024-09-12T00:41:39.716 INFO:tasks.workunit.client.0.smithi043.stderr: -146> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient: _finish_hunting 0 2024-09-12T00:41:39.716 INFO:tasks.workunit.client.0.smithi043.stderr: -145> 2024-09-12T00:41:39.578+0000 7fab8ada3640 1 monclient: found mon.noname-c 2024-09-12T00:41:39.716 INFO:tasks.workunit.client.0.smithi043.stderr: -144> 2024-09-12T00:41:39.578+0000 7fab8ada3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:41:39.716 INFO:tasks.workunit.client.0.smithi043.stderr: -143> 2024-09-12T00:41:39.578+0000 7faa5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:39.716 INFO:tasks.workunit.client.0.smithi043.stderr: -142> 2024-09-12T00:41:39.578+0000 7faa5bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:41:39.716 INFO:tasks.workunit.client.0.smithi043.stderr: -141> 2024-09-12T00:41:39.578+0000 7faa5bfff640 10 monclient: dump: 2024-09-12T00:41:39.716 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:39.716 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:39.716 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.716 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.716 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:39.717 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:39.717 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:39.717 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:39.717 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:39.717 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.717 INFO:tasks.workunit.client.0.smithi043.stderr: -140> 2024-09-12T00:41:39.578+0000 7faa5bfff640 10 monclient: _finish_auth 0 2024-09-12T00:41:39.717 INFO:tasks.workunit.client.0.smithi043.stderr: -139> 2024-09-12T00:41:39.578+0000 7faa5bfff640 10 monclient: _check_auth_tickets 2024-09-12T00:41:39.717 INFO:tasks.workunit.client.0.smithi043.stderr: -138> 2024-09-12T00:41:39.578+0000 7faa5bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:39.717 INFO:tasks.workunit.client.0.smithi043.stderr: -137> 2024-09-12T00:41:39.578+0000 7faa5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:39.717 INFO:tasks.workunit.client.0.smithi043.stderr: -136> 2024-09-12T00:41:39.578+0000 7faa5bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:41:39.717 INFO:tasks.workunit.client.0.smithi043.stderr: -135> 2024-09-12T00:41:39.578+0000 7faa5bfff640 10 monclient: dump: 2024-09-12T00:41:39.717 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:39.718 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:39.718 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.718 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.718 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:39.718 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:39.718 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:39.718 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:39.718 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:39.718 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.718 INFO:tasks.workunit.client.0.smithi043.stderr: -134> 2024-09-12T00:41:39.578+0000 7faa6dffb640 4 set_mon_vals no callback set 2024-09-12T00:41:39.718 INFO:tasks.workunit.client.0.smithi043.stderr: -133> 2024-09-12T00:41:39.578+0000 7fab8ca9c9c0 5 monclient: authenticate success, global_id 7781 2024-09-12T00:41:39.718 INFO:tasks.workunit.client.0.smithi043.stderr: -132> 2024-09-12T00:41:39.578+0000 7fab8ca9c9c0 10 monclient: _renew_subs 2024-09-12T00:41:39.718 INFO:tasks.workunit.client.0.smithi043.stderr: -131> 2024-09-12T00:41:39.578+0000 7fab8ca9c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:41:39.719 INFO:tasks.workunit.client.0.smithi043.stderr: -130> 2024-09-12T00:41:39.578+0000 7fab8ca9c9c0 10 monclient: _renew_subs 2024-09-12T00:41:39.719 INFO:tasks.workunit.client.0.smithi043.stderr: -129> 2024-09-12T00:41:39.578+0000 7fab8ca9c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:41:39.719 INFO:tasks.workunit.client.0.smithi043.stderr: -128> 2024-09-12T00:41:39.578+0000 7fab8ca9c9c0 1 librados: init done 2024-09-12T00:41:39.719 INFO:tasks.workunit.client.0.smithi043.stderr: -127> 2024-09-12T00:41:39.578+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command cr dump hook 0x55a9685b35e8 2024-09-12T00:41:39.719 INFO:tasks.workunit.client.0.smithi043.stderr: -126> 2024-09-12T00:41:39.578+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.719 INFO:tasks.workunit.client.0.smithi043.stderr: -125> 2024-09-12T00:41:39.578+0000 7faa5bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:41:39.719 INFO:tasks.workunit.client.0.smithi043.stderr: -124> 2024-09-12T00:41:39.578+0000 7faa5bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:41:39.719 INFO:tasks.workunit.client.0.smithi043.stderr: -123> 2024-09-12T00:41:39.578+0000 7faa5bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:41:39.719 INFO:tasks.workunit.client.0.smithi043.stderr: -122> 2024-09-12T00:41:39.578+0000 7fab8a5a2640 10 monclient: get_auth_request con 0x7faa54070ae0 auth_method 0 2024-09-12T00:41:39.719 INFO:tasks.workunit.client.0.smithi043.stderr: -121> 2024-09-12T00:41:39.578+0000 7fab89da1640 10 monclient: get_auth_request con 0x55a9685d4aa0 auth_method 0 2024-09-12T00:41:39.719 INFO:tasks.workunit.client.0.smithi043.stderr: -120> 2024-09-12T00:41:39.578+0000 7fab8ca9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.719 INFO:tasks.workunit.client.0.smithi043.stderr: -119> 2024-09-12T00:41:39.578+0000 7fab8ca9c9c0 20 realm 2024-09-12T00:41:39.719 INFO:tasks.workunit.client.0.smithi043.stderr: -118> 2024-09-12T00:41:39.578+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.720 INFO:tasks.workunit.client.0.smithi043.stderr: -117> 2024-09-12T00:41:39.582+0000 7fab8ca9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.720 INFO:tasks.workunit.client.0.smithi043.stderr: -116> 2024-09-12T00:41:39.582+0000 7fab8ca9c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:39.720 INFO:tasks.workunit.client.0.smithi043.stderr: -115> 2024-09-12T00:41:39.582+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.720 INFO:tasks.workunit.client.0.smithi043.stderr: -114> 2024-09-12T00:41:39.582+0000 7fab8ca9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.720 INFO:tasks.workunit.client.0.smithi043.stderr: -113> 2024-09-12T00:41:39.582+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.720 INFO:tasks.workunit.client.0.smithi043.stderr: -112> 2024-09-12T00:41:39.582+0000 7fab8a5a2640 10 monclient: get_auth_request con 0x55a9685d8c90 auth_method 0 2024-09-12T00:41:39.720 INFO:tasks.workunit.client.0.smithi043.stderr: -111> 2024-09-12T00:41:39.582+0000 7fab8ca9c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:39.720 INFO:tasks.workunit.client.0.smithi043.stderr: -110> 2024-09-12T00:41:39.582+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.720 INFO:tasks.workunit.client.0.smithi043.stderr: -109> 2024-09-12T00:41:39.582+0000 7fab89da1640 10 monclient: get_auth_request con 0x55a9685dc520 auth_method 0 2024-09-12T00:41:39.720 INFO:tasks.workunit.client.0.smithi043.stderr: -108> 2024-09-12T00:41:39.582+0000 7fab8ca9c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:39.720 INFO:tasks.workunit.client.0.smithi043.stderr: -107> 2024-09-12T00:41:39.582+0000 7fab8ca9c9c0 20 searching for the correct realm 2024-09-12T00:41:39.720 INFO:tasks.workunit.client.0.smithi043.stderr: -106> 2024-09-12T00:41:39.582+0000 7fab8ada3640 10 monclient: get_auth_request con 0x55a9685e1250 auth_method 0 2024-09-12T00:41:39.720 INFO:tasks.workunit.client.0.smithi043.stderr: -105> 2024-09-12T00:41:39.586+0000 7fab8a5a2640 10 monclient: get_auth_request con 0x7fab840d2060 auth_method 0 2024-09-12T00:41:39.721 INFO:tasks.workunit.client.0.smithi043.stderr: -104> 2024-09-12T00:41:39.586+0000 7fab89da1640 10 monclient: get_auth_request con 0x7fab80061a30 auth_method 0 2024-09-12T00:41:39.721 INFO:tasks.workunit.client.0.smithi043.stderr: -103> 2024-09-12T00:41:39.590+0000 7fab89da1640 0 -- 172.21.15.43:0/2667863561 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fab80061a30 msgr2=0x7fab80092a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:39.721 INFO:tasks.workunit.client.0.smithi043.stderr: -102> 2024-09-12T00:41:39.590+0000 7faa5bfff640 1 client.7781.objecter ms_handle_reset 0x7fab80061a30 session 0x7fab80062be0 osd.4 2024-09-12T00:41:39.721 INFO:tasks.workunit.client.0.smithi043.stderr: -101> 2024-09-12T00:41:39.590+0000 7faa5bfff640 10 monclient: _renew_subs 2024-09-12T00:41:39.721 INFO:tasks.workunit.client.0.smithi043.stderr: -100> 2024-09-12T00:41:39.590+0000 7faa5bfff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:41:39.721 INFO:tasks.workunit.client.0.smithi043.stderr: -99> 2024-09-12T00:41:39.590+0000 7fab8ada3640 10 monclient: get_auth_request con 0x7fab80099140 auth_method 0 2024-09-12T00:41:39.721 INFO:tasks.workunit.client.0.smithi043.stderr: -98> 2024-09-12T00:41:39.590+0000 7fab89da1640 10 monclient: get_auth_request con 0x7faa54080b80 auth_method 0 2024-09-12T00:41:39.721 INFO:tasks.workunit.client.0.smithi043.stderr: -97> 2024-09-12T00:41:39.594+0000 7fab8a5a2640 10 monclient: get_auth_request con 0x7fab80092a10 auth_method 0 2024-09-12T00:41:39.721 INFO:tasks.workunit.client.0.smithi043.stderr: -96> 2024-09-12T00:41:39.594+0000 7fab89da1640 0 -- 172.21.15.43:0/2667863561 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7faa54080b80 msgr2=0x7faa54082fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:39.721 INFO:tasks.workunit.client.0.smithi043.stderr: -95> 2024-09-12T00:41:39.594+0000 7faa5bfff640 1 client.7781.objecter ms_handle_reset 0x7faa54080b80 session 0x7fab80062be0 osd.4 2024-09-12T00:41:39.721 INFO:tasks.workunit.client.0.smithi043.stderr: -94> 2024-09-12T00:41:39.594+0000 7fab89da1640 10 monclient: get_auth_request con 0x7fab80061a30 auth_method 0 2024-09-12T00:41:39.721 INFO:tasks.workunit.client.0.smithi043.stderr: -93> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:41:39.721 INFO:tasks.workunit.client.0.smithi043.stderr: -92> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:39.722 INFO:tasks.workunit.client.0.smithi043.stderr: -91> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:39.722 INFO:tasks.workunit.client.0.smithi043.stderr: -90> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:41:39.722 INFO:tasks.workunit.client.0.smithi043.stderr: -89> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:39.722 INFO:tasks.workunit.client.0.smithi043.stderr: -88> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:39.722 INFO:tasks.workunit.client.0.smithi043.stderr: -87> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.722 INFO:tasks.workunit.client.0.smithi043.stderr: -86> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.722 INFO:tasks.workunit.client.0.smithi043.stderr: -85> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.722 INFO:tasks.workunit.client.0.smithi043.stderr: -84> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:39.722 INFO:tasks.workunit.client.0.smithi043.stderr: -83> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.722 INFO:tasks.workunit.client.0.smithi043.stderr: -82> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:39.722 INFO:tasks.workunit.client.0.smithi043.stderr: -81> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 zone default found 2024-09-12T00:41:39.722 INFO:tasks.workunit.client.0.smithi043.stderr: -80> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 4 Realm: () 2024-09-12T00:41:39.723 INFO:tasks.workunit.client.0.smithi043.stderr: -79> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:41:39.723 INFO:tasks.workunit.client.0.smithi043.stderr: -78> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:41:39.723 INFO:tasks.workunit.client.0.smithi043.stderr: -77> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:39.723 INFO:tasks.workunit.client.0.smithi043.stderr: -76> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 zonegroup default 2024-09-12T00:41:39.723 INFO:tasks.workunit.client.0.smithi043.stderr: -75> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.723 INFO:tasks.workunit.client.0.smithi043.stderr: -74> 2024-09-12T00:41:39.606+0000 7fab8ca9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.723 INFO:tasks.workunit.client.0.smithi043.stderr: -73> 2024-09-12T00:41:39.606+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.723 INFO:tasks.workunit.client.0.smithi043.stderr: -72> 2024-09-12T00:41:39.606+0000 7fab8ca9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.723 INFO:tasks.workunit.client.0.smithi043.stderr: -71> 2024-09-12T00:41:39.606+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.723 INFO:tasks.workunit.client.0.smithi043.stderr: -70> 2024-09-12T00:41:39.606+0000 7fab8ca9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.723 INFO:tasks.workunit.client.0.smithi043.stderr: -69> 2024-09-12T00:41:39.606+0000 7fab8ca9c9c0 20 started sync module instance, tier type = 2024-09-12T00:41:39.723 INFO:tasks.workunit.client.0.smithi043.stderr: -68> 2024-09-12T00:41:39.606+0000 7fab8ca9c9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:41:39.723 INFO:tasks.workunit.client.0.smithi043.stderr: -67> 2024-09-12T00:41:39.622+0000 7fab8ca9c9c0 20 add_watcher() i=0 2024-09-12T00:41:39.723 INFO:tasks.workunit.client.0.smithi043.stderr: -66> 2024-09-12T00:41:39.622+0000 7fab8ca9c9c0 20 add_watcher() i=1 2024-09-12T00:41:39.724 INFO:tasks.workunit.client.0.smithi043.stderr: -65> 2024-09-12T00:41:39.622+0000 7fab8ca9c9c0 20 add_watcher() i=2 2024-09-12T00:41:39.724 INFO:tasks.workunit.client.0.smithi043.stderr: -64> 2024-09-12T00:41:39.622+0000 7fab8ca9c9c0 20 add_watcher() i=3 2024-09-12T00:41:39.724 INFO:tasks.workunit.client.0.smithi043.stderr: -63> 2024-09-12T00:41:39.622+0000 7fab8ca9c9c0 20 add_watcher() i=4 2024-09-12T00:41:39.724 INFO:tasks.workunit.client.0.smithi043.stderr: -62> 2024-09-12T00:41:39.622+0000 7fab8ca9c9c0 20 add_watcher() i=5 2024-09-12T00:41:39.724 INFO:tasks.workunit.client.0.smithi043.stderr: -61> 2024-09-12T00:41:39.622+0000 7fab8ca9c9c0 20 add_watcher() i=6 2024-09-12T00:41:39.724 INFO:tasks.workunit.client.0.smithi043.stderr: -60> 2024-09-12T00:41:39.622+0000 7fab8ca9c9c0 20 add_watcher() i=7 2024-09-12T00:41:39.724 INFO:tasks.workunit.client.0.smithi043.stderr: -59> 2024-09-12T00:41:39.622+0000 7fab8ca9c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:39.724 INFO:tasks.workunit.client.0.smithi043.stderr: -58> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a139b0) adding auth protocol: cephx 2024-09-12T00:41:39.724 INFO:tasks.workunit.client.0.smithi043.stderr: -57> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a139b0) adding auth protocol: cephx 2024-09-12T00:41:39.724 INFO:tasks.workunit.client.0.smithi043.stderr: -56> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a139b0) adding auth protocol: cephx 2024-09-12T00:41:39.724 INFO:tasks.workunit.client.0.smithi043.stderr: -55> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a139b0) adding con mode: secure 2024-09-12T00:41:39.724 INFO:tasks.workunit.client.0.smithi043.stderr: -54> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a139b0) adding con mode: crc 2024-09-12T00:41:39.724 INFO:tasks.workunit.client.0.smithi043.stderr: -53> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a139b0) adding con mode: secure 2024-09-12T00:41:39.725 INFO:tasks.workunit.client.0.smithi043.stderr: -52> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a139b0) adding con mode: crc 2024-09-12T00:41:39.725 INFO:tasks.workunit.client.0.smithi043.stderr: -51> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a139b0) adding con mode: secure 2024-09-12T00:41:39.725 INFO:tasks.workunit.client.0.smithi043.stderr: -50> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a139b0) adding con mode: crc 2024-09-12T00:41:39.725 INFO:tasks.workunit.client.0.smithi043.stderr: -49> 2024-09-12T00:41:39.626+0000 7faa40fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:39.725 INFO:tasks.workunit.client.0.smithi043.stderr: -48> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a139b0) adding con mode: crc 2024-09-12T00:41:39.725 INFO:tasks.workunit.client.0.smithi043.stderr: -47> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a139b0) adding con mode: secure 2024-09-12T00:41:39.725 INFO:tasks.workunit.client.0.smithi043.stderr: -46> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a139b0) adding con mode: crc 2024-09-12T00:41:39.725 INFO:tasks.workunit.client.0.smithi043.stderr: -45> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a139b0) adding con mode: secure 2024-09-12T00:41:39.725 INFO:tasks.workunit.client.0.smithi043.stderr: -44> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a139b0) adding con mode: crc 2024-09-12T00:41:39.725 INFO:tasks.workunit.client.0.smithi043.stderr: -43> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a139b0) adding con mode: secure 2024-09-12T00:41:39.725 INFO:tasks.workunit.client.0.smithi043.stderr: -42> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:39.725 INFO:tasks.workunit.client.0.smithi043.stderr: -41> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:39.725 INFO:tasks.workunit.client.0.smithi043.stderr: -40> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:39.726 INFO:tasks.workunit.client.0.smithi043.stderr: -39> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command cache list hook 0x55a9685b2dd0 2024-09-12T00:41:39.726 INFO:tasks.workunit.client.0.smithi043.stderr: -38> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command cache inspect hook 0x55a9685b2dd0 2024-09-12T00:41:39.726 INFO:tasks.workunit.client.0.smithi043.stderr: -37> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command cache erase hook 0x55a9685b2dd0 2024-09-12T00:41:39.726 INFO:tasks.workunit.client.0.smithi043.stderr: -36> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command cache zap hook 0x55a9685b2dd0 2024-09-12T00:41:39.726 INFO:tasks.workunit.client.0.smithi043.stderr: -35> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 note: GC not initialized 2024-09-12T00:41:39.726 INFO:tasks.workunit.client.0.smithi043.stderr: -34> 2024-09-12T00:41:39.626+0000 7fa9bb7fe640 20 reqs_thread_entry: start 2024-09-12T00:41:39.726 INFO:tasks.workunit.client.0.smithi043.stderr: -33> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command sync trace show hook 0x7fab80083070 2024-09-12T00:41:39.726 INFO:tasks.workunit.client.0.smithi043.stderr: -32> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command sync trace history hook 0x7fab80083070 2024-09-12T00:41:39.726 INFO:tasks.workunit.client.0.smithi043.stderr: -31> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command sync trace active hook 0x7fab80083070 2024-09-12T00:41:39.726 INFO:tasks.workunit.client.0.smithi043.stderr: -30> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command sync trace active_short hook 0x7fab80083070 2024-09-12T00:41:39.726 INFO:tasks.workunit.client.0.smithi043.stderr: -29> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:39.726 INFO:tasks.workunit.client.0.smithi043.stderr: -28> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 20 Filter name: none 2024-09-12T00:41:39.726 INFO:tasks.workunit.client.0.smithi043.stderr: -27> 2024-09-12T00:41:39.626+0000 7fa9b97fa640 20 reqs_thread_entry: start 2024-09-12T00:41:39.727 INFO:tasks.workunit.client.0.smithi043.stderr: -26> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:41:39.727 INFO:tasks.workunit.client.0.smithi043.stderr: -25> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.727 INFO:tasks.workunit.client.0.smithi043.stderr: -24> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:41:39.727 INFO:tasks.workunit.client.0.smithi043.stderr: -23> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:41:39.727 INFO:tasks.workunit.client.0.smithi043.stderr: -22> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:41:39.727 INFO:tasks.workunit.client.0.smithi043.stderr: -21> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 : miss 2024-09-12T00:41:39.727 INFO:tasks.workunit.client.0.smithi043.stderr: -20> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.727 INFO:tasks.workunit.client.0.smithi043.stderr: -19> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:41:39.727 INFO:tasks.workunit.client.0.smithi043.stderr: -18> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:41:39.727 INFO:tasks.workunit.client.0.smithi043.stderr: -17> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:41:39.727 INFO:tasks.workunit.client.0.smithi043.stderr: -16> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:41:39.727 INFO:tasks.workunit.client.0.smithi043.stderr: -15> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:39.727 INFO:tasks.workunit.client.0.smithi043.stderr: -14> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 2024-09-12T00:41:39.728 INFO:tasks.workunit.client.0.smithi043.stderr: -13> 2024-09-12T00:41:39.642+0000 7fab8ca9c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:41:39.728 INFO:tasks.workunit.client.0.smithi043.stderr: -12> 2024-09-12T00:41:39.642+0000 7fab8ca9c9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:41:39.728 INFO:tasks.workunit.client.0.smithi043.stderr: -11> 2024-09-12T00:41:39.642+0000 7fab8ca9c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:39.728 INFO:tasks.workunit.client.0.smithi043.stderr: -10> 2024-09-12T00:41:39.642+0000 7fab8ca9c9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17, ofs0, ns] 2024-09-12T00:41:39.728 INFO:tasks.workunit.client.0.smithi043.stderr: -9> 2024-09-12T00:41:39.642+0000 7faa6d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333528 cookie 94186088864928 notifier 7781 bl.length()=827 2024-09-12T00:41:39.728 INFO:tasks.workunit.client.0.smithi043.stderr: -8> 2024-09-12T00:41:39.642+0000 7faa6d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:41:39.728 INFO:tasks.workunit.client.0.smithi043.stderr: -7> 2024-09-12T00:41:39.642+0000 7faa6d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:41:39.728 INFO:tasks.workunit.client.0.smithi043.stderr: -6> 2024-09-12T00:41:39.642+0000 7faa6d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:39.728 INFO:tasks.workunit.client.0.smithi043.stderr: -5> 2024-09-12T00:41:39.642+0000 7fab8ca9c9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_sources= new_sources= 2024-09-12T00:41:39.728 INFO:tasks.workunit.client.0.smithi043.stderr: -4> 2024-09-12T00:41:39.642+0000 7fab8ca9c9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential sources added=[] removed=[] 2024-09-12T00:41:39.728 INFO:tasks.workunit.client.0.smithi043.stderr: -3> 2024-09-12T00:41:39.642+0000 7fab8ca9c9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_dests= new_dests= 2024-09-12T00:41:39.728 INFO:tasks.workunit.client.0.smithi043.stderr: -2> 2024-09-12T00:41:39.642+0000 7fab8ca9c9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential dests added=[] removed=[] 2024-09-12T00:41:39.728 INFO:tasks.workunit.client.0.smithi043.stderr: -1> 2024-09-12T00:41:39.658+0000 7fab8ca9c9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fab8ca9c9c0 time 2024-09-12T00:41:39.660058+0000 2024-09-12T00:41:39.729 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:41:39.729 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.729 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:39.729 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fab903762eb] 2024-09-12T00:41:39.729 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fab9037649f] 2024-09-12T00:41:39.729 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a966900cc1] 2024-09-12T00:41:39.729 INFO:tasks.workunit.client.0.smithi043.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a966915d5a] 2024-09-12T00:41:39.729 INFO:tasks.workunit.client.0.smithi043.stderr: 5: main() 2024-09-12T00:41:39.729 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fab8f1dcd90] 2024-09-12T00:41:39.729 INFO:tasks.workunit.client.0.smithi043.stderr: 7: __libc_start_main() 2024-09-12T00:41:39.729 INFO:tasks.workunit.client.0.smithi043.stderr: 8: _start() 2024-09-12T00:41:39.729 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.729 INFO:tasks.workunit.client.0.smithi043.stderr: 0> 2024-09-12T00:41:39.658+0000 7fab8ca9c9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:41:39.730 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7fab8ca9c9c0 thread_name:radosgw-admin 2024-09-12T00:41:39.730 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.730 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:39.730 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fab8f1f5520] 2024-09-12T00:41:39.730 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:41:39.730 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:41:39.730 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:41:39.730 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fab90376345] 2024-09-12T00:41:39.730 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fab9037649f] 2024-09-12T00:41:39.730 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a966900cc1] 2024-09-12T00:41:39.730 INFO:tasks.workunit.client.0.smithi043.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a966915d5a] 2024-09-12T00:41:39.730 INFO:tasks.workunit.client.0.smithi043.stderr: 9: main() 2024-09-12T00:41:39.730 INFO:tasks.workunit.client.0.smithi043.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fab8f1dcd90] 2024-09-12T00:41:39.730 INFO:tasks.workunit.client.0.smithi043.stderr: 11: __libc_start_main() 2024-09-12T00:41:39.731 INFO:tasks.workunit.client.0.smithi043.stderr: 12: _start() 2024-09-12T00:41:39.731 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:41:39.731 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.731 INFO:tasks.workunit.client.0.smithi043.stderr:--- logging levels --- 2024-09-12T00:41:39.731 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 none 2024-09-12T00:41:39.731 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 lockdep 2024-09-12T00:41:39.731 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 context 2024-09-12T00:41:39.731 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 crush 2024-09-12T00:41:39.731 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds 2024-09-12T00:41:39.731 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_balancer 2024-09-12T00:41:39.731 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_locker 2024-09-12T00:41:39.731 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log 2024-09-12T00:41:39.731 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log_expire 2024-09-12T00:41:39.731 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_migrator 2024-09-12T00:41:39.732 INFO:tasks.workunit.client.0.smithi043.stderr: 3/ 5 mds_quiesce 2024-09-12T00:41:39.732 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 buffer 2024-09-12T00:41:39.732 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 timer 2024-09-12T00:41:39.732 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 filer 2024-09-12T00:41:39.732 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 striper 2024-09-12T00:41:39.732 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 objecter 2024-09-12T00:41:39.732 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rados 2024-09-12T00:41:39.732 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd 2024-09-12T00:41:39.732 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_mirror 2024-09-12T00:41:39.732 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_replay 2024-09-12T00:41:39.732 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_pwl 2024-09-12T00:41:39.732 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 journaler 2024-09-12T00:41:39.732 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objectcacher 2024-09-12T00:41:39.733 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:41:39.733 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 client 2024-09-12T00:41:39.733 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 osd 2024-09-12T00:41:39.733 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 optracker 2024-09-12T00:41:39.733 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objclass 2024-09-12T00:41:39.733 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 filestore 2024-09-12T00:41:39.733 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 journal 2024-09-12T00:41:39.733 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 ms 2024-09-12T00:41:39.733 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mon 2024-09-12T00:41:39.733 INFO:tasks.workunit.client.0.smithi043.stderr: 0/10 monc 2024-09-12T00:41:39.733 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 paxos 2024-09-12T00:41:39.733 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 tp 2024-09-12T00:41:39.733 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 auth 2024-09-12T00:41:39.734 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 crypto 2024-09-12T00:41:39.734 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 finisher 2024-09-12T00:41:39.734 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 reserver 2024-09-12T00:41:39.734 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 heartbeatmap 2024-09-12T00:41:39.734 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 perfcounter 2024-09-12T00:41:39.734 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw 2024-09-12T00:41:39.734 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_sync 2024-09-12T00:41:39.734 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_datacache 2024-09-12T00:41:39.734 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_access 2024-09-12T00:41:39.734 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:41:39.734 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_flight 2024-09-12T00:41:39.734 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:41:39.734 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw_notification 2024-09-12T00:41:39.734 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 javaclient 2024-09-12T00:41:39.735 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 asok 2024-09-12T00:41:39.735 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 throttle 2024-09-12T00:41:39.735 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 refs 2024-09-12T00:41:39.735 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 compressor 2024-09-12T00:41:39.735 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluestore 2024-09-12T00:41:39.735 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluefs 2024-09-12T00:41:39.735 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 bdev 2024-09-12T00:41:39.735 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 kstore 2024-09-12T00:41:39.735 INFO:tasks.workunit.client.0.smithi043.stderr: 4/ 5 rocksdb 2024-09-12T00:41:39.735 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 fuse 2024-09-12T00:41:39.735 INFO:tasks.workunit.client.0.smithi043.stderr: 2/ 5 mgr 2024-09-12T00:41:39.735 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mgrc 2024-09-12T00:41:39.735 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 dpdk 2024-09-12T00:41:39.735 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 eventtrace 2024-09-12T00:41:39.736 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 prioritycache 2024-09-12T00:41:39.736 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 test 2024-09-12T00:41:39.736 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:41:39.736 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephsqlite 2024-09-12T00:41:39.736 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:41:39.736 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore 2024-09-12T00:41:39.736 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_onode 2024-09-12T00:41:39.736 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_odata 2024-09-12T00:41:39.736 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_omap 2024-09-12T00:41:39.736 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_tm 2024-09-12T00:41:39.736 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_t 2024-09-12T00:41:39.736 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:41:39.737 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_epm 2024-09-12T00:41:39.737 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_lba 2024-09-12T00:41:39.737 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:41:39.737 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cache 2024-09-12T00:41:39.737 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_journal 2024-09-12T00:41:39.737 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_device 2024-09-12T00:41:39.737 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_backref 2024-09-12T00:41:39.737 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 alienstore 2024-09-12T00:41:39.737 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mclock 2024-09-12T00:41:39.737 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cyanstore 2024-09-12T00:41:39.737 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 ceph_exporter 2024-09-12T00:41:39.737 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 memstore 2024-09-12T00:41:39.737 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 trace 2024-09-12T00:41:39.738 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 ceph_dedup 2024-09-12T00:41:39.738 INFO:tasks.workunit.client.0.smithi043.stderr: -2/-2 (syslog threshold) 2024-09-12T00:41:39.738 INFO:tasks.workunit.client.0.smithi043.stderr: 99/99 (stderr threshold) 2024-09-12T00:41:39.738 INFO:tasks.workunit.client.0.smithi043.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:41:39.738 INFO:tasks.workunit.client.0.smithi043.stderr: 7fa9b97fa640 / http_manager 2024-09-12T00:41:39.738 INFO:tasks.workunit.client.0.smithi043.stderr: 7fa9bb7fe640 / http_manager 2024-09-12T00:41:39.738 INFO:tasks.workunit.client.0.smithi043.stderr: 7faa40fe1640 / rgw_dt_lg_renew 2024-09-12T00:41:39.738 INFO:tasks.workunit.client.0.smithi043.stderr: 7faa5bfff640 / ms_dispatch 2024-09-12T00:41:39.738 INFO:tasks.workunit.client.0.smithi043.stderr: 7faa6d7fa640 / io_context_pool 2024-09-12T00:41:39.738 INFO:tasks.workunit.client.0.smithi043.stderr: 7faa6dffb640 / io_context_pool 2024-09-12T00:41:39.738 INFO:tasks.workunit.client.0.smithi043.stderr: 7faa6ffff640 / ms_dispatch 2024-09-12T00:41:39.738 INFO:tasks.workunit.client.0.smithi043.stderr: 7faa76e05640 / ms_dispatch 2024-09-12T00:41:39.738 INFO:tasks.workunit.client.0.smithi043.stderr: 7faa78608640 / io_context_pool 2024-09-12T00:41:39.738 INFO:tasks.workunit.client.0.smithi043.stderr: 7fab89da1640 / msgr-worker-2 2024-09-12T00:41:39.739 INFO:tasks.workunit.client.0.smithi043.stderr: 7fab8a5a2640 / msgr-worker-1 2024-09-12T00:41:39.739 INFO:tasks.workunit.client.0.smithi043.stderr: 7fab8ada3640 / msgr-worker-0 2024-09-12T00:41:39.739 INFO:tasks.workunit.client.0.smithi043.stderr: 7fab8b5a4640 / io_context_pool 2024-09-12T00:41:39.739 INFO:tasks.workunit.client.0.smithi043.stderr: 7fab8ca9c9c0 / radosgw-admin 2024-09-12T00:41:39.739 INFO:tasks.workunit.client.0.smithi043.stderr: max_recent 500 2024-09-12T00:41:39.739 INFO:tasks.workunit.client.0.smithi043.stderr: max_new 1000 2024-09-12T00:41:39.739 INFO:tasks.workunit.client.0.smithi043.stderr: log_file /var/log/ceph/ceph-client.admin.141610.log 2024-09-12T00:41:39.739 INFO:tasks.workunit.client.0.smithi043.stderr:--- end dump of recent events --- 2024-09-12T00:41:39.739 INFO:tasks.workunit.client.0.smithi043.stderr:--- begin dump of recent events --- 2024-09-12T00:41:39.739 INFO:tasks.workunit.client.0.smithi043.stderr: -499> 2024-09-12T00:41:39.558+0000 7fab8a5a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:39.739 INFO:tasks.workunit.client.0.smithi043.stderr: -498> 2024-09-12T00:41:39.558+0000 7fab8a5a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:39.739 INFO:tasks.workunit.client.0.smithi043.stderr: -497> 2024-09-12T00:41:39.558+0000 7fab8ada3640 10 monclient(hunting): get_auth_request con 0x55a96843b170 auth_method 0 2024-09-12T00:41:39.739 INFO:tasks.workunit.client.0.smithi043.stderr: -496> 2024-09-12T00:41:39.558+0000 7fab8ada3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:39.740 INFO:tasks.workunit.client.0.smithi043.stderr: -495> 2024-09-12T00:41:39.558+0000 7fab8ada3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:39.740 INFO:tasks.workunit.client.0.smithi043.stderr: -494> 2024-09-12T00:41:39.558+0000 7fab8ada3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:39.740 INFO:tasks.workunit.client.0.smithi043.stderr: -493> 2024-09-12T00:41:39.558+0000 7fab89da1640 10 monclient(hunting): handle_auth_done global_id 7769 payload 274 2024-09-12T00:41:39.740 INFO:tasks.workunit.client.0.smithi043.stderr: -492> 2024-09-12T00:41:39.558+0000 7fab89da1640 10 monclient: _finish_hunting 0 2024-09-12T00:41:39.740 INFO:tasks.workunit.client.0.smithi043.stderr: -491> 2024-09-12T00:41:39.558+0000 7fab89da1640 1 monclient: found mon.noname-c 2024-09-12T00:41:39.740 INFO:tasks.workunit.client.0.smithi043.stderr: -490> 2024-09-12T00:41:39.558+0000 7fab89da1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:41:39.740 INFO:tasks.workunit.client.0.smithi043.stderr: -489> 2024-09-12T00:41:39.558+0000 7faa78608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:39.740 INFO:tasks.workunit.client.0.smithi043.stderr: -488> 2024-09-12T00:41:39.558+0000 7faa78608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:41:39.740 INFO:tasks.workunit.client.0.smithi043.stderr: -487> 2024-09-12T00:41:39.558+0000 7faa78608640 10 monclient: dump: 2024-09-12T00:41:39.740 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:39.740 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:39.740 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.740 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.741 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:39.741 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:39.741 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:39.741 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:39.741 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:39.741 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.741 INFO:tasks.workunit.client.0.smithi043.stderr: -486> 2024-09-12T00:41:39.558+0000 7faa78608640 10 monclient: _finish_auth 0 2024-09-12T00:41:39.741 INFO:tasks.workunit.client.0.smithi043.stderr: -485> 2024-09-12T00:41:39.558+0000 7faa78608640 10 monclient: _check_auth_tickets 2024-09-12T00:41:39.741 INFO:tasks.workunit.client.0.smithi043.stderr: -484> 2024-09-12T00:41:39.558+0000 7faa78608640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:39.741 INFO:tasks.workunit.client.0.smithi043.stderr: -483> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 monclient: authenticate success, global_id 7769 2024-09-12T00:41:39.741 INFO:tasks.workunit.client.0.smithi043.stderr: -482> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:41:39.741 INFO:tasks.workunit.client.0.smithi043.stderr: -481> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 4 set_mon_vals no callback set 2024-09-12T00:41:39.741 INFO:tasks.workunit.client.0.smithi043.stderr: -480> 2024-09-12T00:41:39.558+0000 7faa78608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:39.742 INFO:tasks.workunit.client.0.smithi043.stderr: -479> 2024-09-12T00:41:39.558+0000 7faa78608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:41:39.742 INFO:tasks.workunit.client.0.smithi043.stderr: -478> 2024-09-12T00:41:39.558+0000 7faa78608640 10 monclient: dump: 2024-09-12T00:41:39.742 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:39.742 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:39.742 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.742 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.742 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:39.742 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:39.742 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:39.742 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:39.742 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:39.742 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.742 INFO:tasks.workunit.client.0.smithi043.stderr: -477> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 10 monclient: shutdown 2024-09-12T00:41:39.743 INFO:tasks.workunit.client.0.smithi043.stderr: -476> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) unregister_commands rotate-key 2024-09-12T00:41:39.743 INFO:tasks.workunit.client.0.smithi043.stderr: -475> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 10 monclient: build_initial_monmap 2024-09-12T00:41:39.743 INFO:tasks.workunit.client.0.smithi043.stderr: -474> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 1 build_initial for_mkfs: 0 2024-09-12T00:41:39.743 INFO:tasks.workunit.client.0.smithi043.stderr: -473> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 10 monclient: monmap: 2024-09-12T00:41:39.743 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:41:39.743 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:41:39.743 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:41:39.743 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:41:39.743 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:41:39.743 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:39.743 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:41:39.743 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:41:39.743 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:41:39.743 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.744 INFO:tasks.workunit.client.0.smithi043.stderr: -472> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968518ce0) adding auth protocol: cephx 2024-09-12T00:41:39.744 INFO:tasks.workunit.client.0.smithi043.stderr: -471> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968518ce0) adding auth protocol: cephx 2024-09-12T00:41:39.744 INFO:tasks.workunit.client.0.smithi043.stderr: -470> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968518ce0) adding auth protocol: cephx 2024-09-12T00:41:39.744 INFO:tasks.workunit.client.0.smithi043.stderr: -469> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968518ce0) adding con mode: secure 2024-09-12T00:41:39.744 INFO:tasks.workunit.client.0.smithi043.stderr: -468> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968518ce0) adding con mode: crc 2024-09-12T00:41:39.744 INFO:tasks.workunit.client.0.smithi043.stderr: -467> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968518ce0) adding con mode: secure 2024-09-12T00:41:39.744 INFO:tasks.workunit.client.0.smithi043.stderr: -466> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968518ce0) adding con mode: crc 2024-09-12T00:41:39.744 INFO:tasks.workunit.client.0.smithi043.stderr: -465> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968518ce0) adding con mode: secure 2024-09-12T00:41:39.744 INFO:tasks.workunit.client.0.smithi043.stderr: -464> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968518ce0) adding con mode: crc 2024-09-12T00:41:39.744 INFO:tasks.workunit.client.0.smithi043.stderr: -463> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968518ce0) adding con mode: crc 2024-09-12T00:41:39.744 INFO:tasks.workunit.client.0.smithi043.stderr: -462> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968518ce0) adding con mode: secure 2024-09-12T00:41:39.744 INFO:tasks.workunit.client.0.smithi043.stderr: -461> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968518ce0) adding con mode: crc 2024-09-12T00:41:39.744 INFO:tasks.workunit.client.0.smithi043.stderr: -460> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968518ce0) adding con mode: secure 2024-09-12T00:41:39.745 INFO:tasks.workunit.client.0.smithi043.stderr: -459> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968518ce0) adding con mode: crc 2024-09-12T00:41:39.745 INFO:tasks.workunit.client.0.smithi043.stderr: -458> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968518ce0) adding con mode: secure 2024-09-12T00:41:39.745 INFO:tasks.workunit.client.0.smithi043.stderr: -457> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:39.745 INFO:tasks.workunit.client.0.smithi043.stderr: -456> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 1 librados: starting msgr at 2024-09-12T00:41:39.745 INFO:tasks.workunit.client.0.smithi043.stderr: -455> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 1 librados: starting objecter 2024-09-12T00:41:39.745 INFO:tasks.workunit.client.0.smithi043.stderr: -454> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command objecter_requests hook 0x55a9682c5670 2024-09-12T00:41:39.745 INFO:tasks.workunit.client.0.smithi043.stderr: -453> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 1 librados: setting wanted keys 2024-09-12T00:41:39.745 INFO:tasks.workunit.client.0.smithi043.stderr: -452> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 1 librados: calling monclient init 2024-09-12T00:41:39.745 INFO:tasks.workunit.client.0.smithi043.stderr: -451> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 10 monclient: init 2024-09-12T00:41:39.745 INFO:tasks.workunit.client.0.smithi043.stderr: -450> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9684ebf20) adding auth protocol: cephx 2024-09-12T00:41:39.745 INFO:tasks.workunit.client.0.smithi043.stderr: -449> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9684ebf20) adding auth protocol: cephx 2024-09-12T00:41:39.745 INFO:tasks.workunit.client.0.smithi043.stderr: -448> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9684ebf20) adding auth protocol: cephx 2024-09-12T00:41:39.745 INFO:tasks.workunit.client.0.smithi043.stderr: -447> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9684ebf20) adding con mode: secure 2024-09-12T00:41:39.746 INFO:tasks.workunit.client.0.smithi043.stderr: -446> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9684ebf20) adding con mode: crc 2024-09-12T00:41:39.746 INFO:tasks.workunit.client.0.smithi043.stderr: -445> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9684ebf20) adding con mode: secure 2024-09-12T00:41:39.746 INFO:tasks.workunit.client.0.smithi043.stderr: -444> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9684ebf20) adding con mode: crc 2024-09-12T00:41:39.746 INFO:tasks.workunit.client.0.smithi043.stderr: -443> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9684ebf20) adding con mode: secure 2024-09-12T00:41:39.746 INFO:tasks.workunit.client.0.smithi043.stderr: -442> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9684ebf20) adding con mode: crc 2024-09-12T00:41:39.746 INFO:tasks.workunit.client.0.smithi043.stderr: -441> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9684ebf20) adding con mode: crc 2024-09-12T00:41:39.746 INFO:tasks.workunit.client.0.smithi043.stderr: -440> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9684ebf20) adding con mode: secure 2024-09-12T00:41:39.746 INFO:tasks.workunit.client.0.smithi043.stderr: -439> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9684ebf20) adding con mode: crc 2024-09-12T00:41:39.746 INFO:tasks.workunit.client.0.smithi043.stderr: -438> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9684ebf20) adding con mode: secure 2024-09-12T00:41:39.746 INFO:tasks.workunit.client.0.smithi043.stderr: -437> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9684ebf20) adding con mode: crc 2024-09-12T00:41:39.746 INFO:tasks.workunit.client.0.smithi043.stderr: -436> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9684ebf20) adding con mode: secure 2024-09-12T00:41:39.746 INFO:tasks.workunit.client.0.smithi043.stderr: -435> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:39.746 INFO:tasks.workunit.client.0.smithi043.stderr: -434> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:39.747 INFO:tasks.workunit.client.0.smithi043.stderr: -433> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command rotate-key hook 0x55a9684ec068 2024-09-12T00:41:39.747 INFO:tasks.workunit.client.0.smithi043.stderr: -432> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:39.747 INFO:tasks.workunit.client.0.smithi043.stderr: -431> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:41:39.747 INFO:tasks.workunit.client.0.smithi043.stderr: -430> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 10 monclient(hunting): picked mon.noname-a con 0x55a96839f820 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:41:39.747 INFO:tasks.workunit.client.0.smithi043.stderr: -429> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 10 monclient(hunting): picked mon.noname-c con 0x55a9683aaa80 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:41:39.747 INFO:tasks.workunit.client.0.smithi043.stderr: -428> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 10 monclient(hunting): picked mon.noname-b con 0x55a96843b170 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:41:39.747 INFO:tasks.workunit.client.0.smithi043.stderr: -427> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:39.747 INFO:tasks.workunit.client.0.smithi043.stderr: -426> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:39.747 INFO:tasks.workunit.client.0.smithi043.stderr: -425> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:39.747 INFO:tasks.workunit.client.0.smithi043.stderr: -424> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:39.747 INFO:tasks.workunit.client.0.smithi043.stderr: -423> 2024-09-12T00:41:39.558+0000 7fab8ca9c9c0 10 monclient(hunting): authenticate will time out at 2395.551513s 2024-09-12T00:41:39.747 INFO:tasks.workunit.client.0.smithi043.stderr: -422> 2024-09-12T00:41:39.558+0000 7fab89da1640 10 monclient(hunting): get_auth_request con 0x55a9683aaa80 auth_method 0 2024-09-12T00:41:39.747 INFO:tasks.workunit.client.0.smithi043.stderr: -421> 2024-09-12T00:41:39.558+0000 7fab89da1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:39.748 INFO:tasks.workunit.client.0.smithi043.stderr: -420> 2024-09-12T00:41:39.558+0000 7fab89da1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:39.748 INFO:tasks.workunit.client.0.smithi043.stderr: -419> 2024-09-12T00:41:39.558+0000 7fab89da1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:39.748 INFO:tasks.workunit.client.0.smithi043.stderr: -418> 2024-09-12T00:41:39.558+0000 7fab8a5a2640 10 monclient(hunting): get_auth_request con 0x55a96839f820 auth_method 0 2024-09-12T00:41:39.748 INFO:tasks.workunit.client.0.smithi043.stderr: -417> 2024-09-12T00:41:39.558+0000 7fab8a5a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:39.748 INFO:tasks.workunit.client.0.smithi043.stderr: -416> 2024-09-12T00:41:39.558+0000 7fab8a5a2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:39.748 INFO:tasks.workunit.client.0.smithi043.stderr: -415> 2024-09-12T00:41:39.558+0000 7fab8a5a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:39.748 INFO:tasks.workunit.client.0.smithi043.stderr: -414> 2024-09-12T00:41:39.558+0000 7fab89da1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:39.748 INFO:tasks.workunit.client.0.smithi043.stderr: -413> 2024-09-12T00:41:39.558+0000 7fab89da1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:39.748 INFO:tasks.workunit.client.0.smithi043.stderr: -412> 2024-09-12T00:41:39.558+0000 7fab89da1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:39.748 INFO:tasks.workunit.client.0.smithi043.stderr: -411> 2024-09-12T00:41:39.558+0000 7fab8a5a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:39.748 INFO:tasks.workunit.client.0.smithi043.stderr: -410> 2024-09-12T00:41:39.558+0000 7fab8a5a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:39.748 INFO:tasks.workunit.client.0.smithi043.stderr: -409> 2024-09-12T00:41:39.558+0000 7fab8a5a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:39.748 INFO:tasks.workunit.client.0.smithi043.stderr: -408> 2024-09-12T00:41:39.558+0000 7fab89da1640 10 monclient(hunting): handle_auth_done global_id 7772 payload 824 2024-09-12T00:41:39.749 INFO:tasks.workunit.client.0.smithi043.stderr: -407> 2024-09-12T00:41:39.558+0000 7fab89da1640 10 monclient: _finish_hunting 0 2024-09-12T00:41:39.749 INFO:tasks.workunit.client.0.smithi043.stderr: -406> 2024-09-12T00:41:39.558+0000 7fab89da1640 1 monclient: found mon.noname-c 2024-09-12T00:41:39.749 INFO:tasks.workunit.client.0.smithi043.stderr: -405> 2024-09-12T00:41:39.558+0000 7fab89da1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:41:39.749 INFO:tasks.workunit.client.0.smithi043.stderr: -404> 2024-09-12T00:41:39.562+0000 7faa76e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:39.749 INFO:tasks.workunit.client.0.smithi043.stderr: -403> 2024-09-12T00:41:39.562+0000 7faa76e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:41:39.749 INFO:tasks.workunit.client.0.smithi043.stderr: -402> 2024-09-12T00:41:39.562+0000 7faa76e05640 10 monclient: dump: 2024-09-12T00:41:39.749 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:39.749 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:39.749 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.749 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.749 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:39.749 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:39.749 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:39.749 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:39.750 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:39.750 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.750 INFO:tasks.workunit.client.0.smithi043.stderr: -401> 2024-09-12T00:41:39.562+0000 7faa76e05640 10 monclient: _finish_auth 0 2024-09-12T00:41:39.750 INFO:tasks.workunit.client.0.smithi043.stderr: -400> 2024-09-12T00:41:39.562+0000 7faa76e05640 10 monclient: _check_auth_tickets 2024-09-12T00:41:39.750 INFO:tasks.workunit.client.0.smithi043.stderr: -399> 2024-09-12T00:41:39.562+0000 7faa76e05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:39.750 INFO:tasks.workunit.client.0.smithi043.stderr: -398> 2024-09-12T00:41:39.562+0000 7faa76e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:39.750 INFO:tasks.workunit.client.0.smithi043.stderr: -397> 2024-09-12T00:41:39.562+0000 7faa76e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:41:39.750 INFO:tasks.workunit.client.0.smithi043.stderr: -396> 2024-09-12T00:41:39.562+0000 7faa76e05640 10 monclient: dump: 2024-09-12T00:41:39.750 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:39.750 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:39.750 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.750 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.750 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:39.751 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:39.751 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:39.751 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:39.751 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:39.751 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.751 INFO:tasks.workunit.client.0.smithi043.stderr: -395> 2024-09-12T00:41:39.562+0000 7faa78608640 4 set_mon_vals no callback set 2024-09-12T00:41:39.751 INFO:tasks.workunit.client.0.smithi043.stderr: -394> 2024-09-12T00:41:39.562+0000 7fab8ca9c9c0 5 monclient: authenticate success, global_id 7772 2024-09-12T00:41:39.751 INFO:tasks.workunit.client.0.smithi043.stderr: -393> 2024-09-12T00:41:39.562+0000 7fab8ca9c9c0 10 monclient: _renew_subs 2024-09-12T00:41:39.751 INFO:tasks.workunit.client.0.smithi043.stderr: -392> 2024-09-12T00:41:39.562+0000 7fab8ca9c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:41:39.751 INFO:tasks.workunit.client.0.smithi043.stderr: -391> 2024-09-12T00:41:39.562+0000 7fab8ca9c9c0 10 monclient: _renew_subs 2024-09-12T00:41:39.751 INFO:tasks.workunit.client.0.smithi043.stderr: -390> 2024-09-12T00:41:39.562+0000 7fab8ca9c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:41:39.751 INFO:tasks.workunit.client.0.smithi043.stderr: -389> 2024-09-12T00:41:39.562+0000 7fab8ca9c9c0 1 librados: init done 2024-09-12T00:41:39.751 INFO:tasks.workunit.client.0.smithi043.stderr: -388> 2024-09-12T00:41:39.562+0000 7faa76e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:41:39.752 INFO:tasks.workunit.client.0.smithi043.stderr: -387> 2024-09-12T00:41:39.562+0000 7faa76e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:41:39.752 INFO:tasks.workunit.client.0.smithi043.stderr: -386> 2024-09-12T00:41:39.562+0000 7faa76e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:41:39.752 INFO:tasks.workunit.client.0.smithi043.stderr: -385> 2024-09-12T00:41:39.562+0000 7fab8a5a2640 10 monclient: get_auth_request con 0x7faa70070b10 auth_method 0 2024-09-12T00:41:39.752 INFO:tasks.workunit.client.0.smithi043.stderr: -384> 2024-09-12T00:41:39.562+0000 7fab8ada3640 10 monclient: get_auth_request con 0x55a968517210 auth_method 0 2024-09-12T00:41:39.752 INFO:tasks.workunit.client.0.smithi043.stderr: -383> 2024-09-12T00:41:39.566+0000 7fab8a5a2640 10 monclient: get_auth_request con 0x55a968536740 auth_method 0 2024-09-12T00:41:39.752 INFO:tasks.workunit.client.0.smithi043.stderr: -382> 2024-09-12T00:41:39.566+0000 7fab89da1640 10 monclient: get_auth_request con 0x55a96853ab30 auth_method 0 2024-09-12T00:41:39.752 INFO:tasks.workunit.client.0.smithi043.stderr: -381> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 10 monclient: build_initial_monmap 2024-09-12T00:41:39.752 INFO:tasks.workunit.client.0.smithi043.stderr: -380> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 1 build_initial for_mkfs: 0 2024-09-12T00:41:39.752 INFO:tasks.workunit.client.0.smithi043.stderr: -379> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 10 monclient: monmap: 2024-09-12T00:41:39.752 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:41:39.752 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:41:39.752 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:41:39.752 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:41:39.753 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:41:39.753 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:39.753 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:41:39.753 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:41:39.753 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:41:39.753 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.753 INFO:tasks.workunit.client.0.smithi043.stderr: -378> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853fbc0) adding auth protocol: cephx 2024-09-12T00:41:39.753 INFO:tasks.workunit.client.0.smithi043.stderr: -377> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853fbc0) adding auth protocol: cephx 2024-09-12T00:41:39.753 INFO:tasks.workunit.client.0.smithi043.stderr: -376> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853fbc0) adding auth protocol: cephx 2024-09-12T00:41:39.753 INFO:tasks.workunit.client.0.smithi043.stderr: -375> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853fbc0) adding con mode: secure 2024-09-12T00:41:39.753 INFO:tasks.workunit.client.0.smithi043.stderr: -374> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853fbc0) adding con mode: crc 2024-09-12T00:41:39.753 INFO:tasks.workunit.client.0.smithi043.stderr: -373> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853fbc0) adding con mode: secure 2024-09-12T00:41:39.753 INFO:tasks.workunit.client.0.smithi043.stderr: -372> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853fbc0) adding con mode: crc 2024-09-12T00:41:39.754 INFO:tasks.workunit.client.0.smithi043.stderr: -371> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853fbc0) adding con mode: secure 2024-09-12T00:41:39.754 INFO:tasks.workunit.client.0.smithi043.stderr: -370> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853fbc0) adding con mode: crc 2024-09-12T00:41:39.754 INFO:tasks.workunit.client.0.smithi043.stderr: -369> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853fbc0) adding con mode: crc 2024-09-12T00:41:39.754 INFO:tasks.workunit.client.0.smithi043.stderr: -368> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853fbc0) adding con mode: secure 2024-09-12T00:41:39.754 INFO:tasks.workunit.client.0.smithi043.stderr: -367> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853fbc0) adding con mode: crc 2024-09-12T00:41:39.754 INFO:tasks.workunit.client.0.smithi043.stderr: -366> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853fbc0) adding con mode: secure 2024-09-12T00:41:39.754 INFO:tasks.workunit.client.0.smithi043.stderr: -365> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853fbc0) adding con mode: crc 2024-09-12T00:41:39.754 INFO:tasks.workunit.client.0.smithi043.stderr: -364> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853fbc0) adding con mode: secure 2024-09-12T00:41:39.754 INFO:tasks.workunit.client.0.smithi043.stderr: -363> 2024-09-12T00:41:39.566+0000 7fab8ca9c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:39.754 INFO:tasks.workunit.client.0.smithi043.stderr: -362> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a9685434e0 EEXIST 2024-09-12T00:41:39.754 INFO:tasks.workunit.client.0.smithi043.stderr: -361> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient: init 2024-09-12T00:41:39.754 INFO:tasks.workunit.client.0.smithi043.stderr: -360> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853e0c8) adding auth protocol: cephx 2024-09-12T00:41:39.754 INFO:tasks.workunit.client.0.smithi043.stderr: -359> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853e0c8) adding auth protocol: cephx 2024-09-12T00:41:39.754 INFO:tasks.workunit.client.0.smithi043.stderr: -358> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853e0c8) adding auth protocol: cephx 2024-09-12T00:41:39.755 INFO:tasks.workunit.client.0.smithi043.stderr: -357> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853e0c8) adding con mode: secure 2024-09-12T00:41:39.755 INFO:tasks.workunit.client.0.smithi043.stderr: -356> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853e0c8) adding con mode: crc 2024-09-12T00:41:39.755 INFO:tasks.workunit.client.0.smithi043.stderr: -355> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853e0c8) adding con mode: secure 2024-09-12T00:41:39.755 INFO:tasks.workunit.client.0.smithi043.stderr: -354> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853e0c8) adding con mode: crc 2024-09-12T00:41:39.755 INFO:tasks.workunit.client.0.smithi043.stderr: -353> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853e0c8) adding con mode: secure 2024-09-12T00:41:39.755 INFO:tasks.workunit.client.0.smithi043.stderr: -352> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853e0c8) adding con mode: crc 2024-09-12T00:41:39.755 INFO:tasks.workunit.client.0.smithi043.stderr: -351> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853e0c8) adding con mode: crc 2024-09-12T00:41:39.755 INFO:tasks.workunit.client.0.smithi043.stderr: -350> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853e0c8) adding con mode: secure 2024-09-12T00:41:39.755 INFO:tasks.workunit.client.0.smithi043.stderr: -349> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853e0c8) adding con mode: crc 2024-09-12T00:41:39.755 INFO:tasks.workunit.client.0.smithi043.stderr: -348> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853e0c8) adding con mode: secure 2024-09-12T00:41:39.755 INFO:tasks.workunit.client.0.smithi043.stderr: -347> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853e0c8) adding con mode: crc 2024-09-12T00:41:39.755 INFO:tasks.workunit.client.0.smithi043.stderr: -346> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a96853e0c8) adding con mode: secure 2024-09-12T00:41:39.755 INFO:tasks.workunit.client.0.smithi043.stderr: -345> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:39.756 INFO:tasks.workunit.client.0.smithi043.stderr: -344> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:39.756 INFO:tasks.workunit.client.0.smithi043.stderr: -343> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command rotate-key cmddesc rotate-key hook 0x55a96853e210 EEXIST 2024-09-12T00:41:39.756 INFO:tasks.workunit.client.0.smithi043.stderr: -342> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:39.756 INFO:tasks.workunit.client.0.smithi043.stderr: -341> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:41:39.756 INFO:tasks.workunit.client.0.smithi043.stderr: -340> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient(hunting): picked mon.noname-c con 0x55a968567690 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:41:39.756 INFO:tasks.workunit.client.0.smithi043.stderr: -339> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient(hunting): picked mon.noname-a con 0x55a968566fc0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:41:39.756 INFO:tasks.workunit.client.0.smithi043.stderr: -338> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient(hunting): picked mon.noname-b con 0x55a9685659a0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:41:39.756 INFO:tasks.workunit.client.0.smithi043.stderr: -337> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:39.756 INFO:tasks.workunit.client.0.smithi043.stderr: -336> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:39.756 INFO:tasks.workunit.client.0.smithi043.stderr: -335> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:39.756 INFO:tasks.workunit.client.0.smithi043.stderr: -334> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:39.756 INFO:tasks.workunit.client.0.smithi043.stderr: -333> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient(hunting): authenticate will time out at 2395.560758s 2024-09-12T00:41:39.756 INFO:tasks.workunit.client.0.smithi043.stderr: -332> 2024-09-12T00:41:39.570+0000 7fab8a5a2640 10 monclient(hunting): get_auth_request con 0x55a968567690 auth_method 0 2024-09-12T00:41:39.757 INFO:tasks.workunit.client.0.smithi043.stderr: -331> 2024-09-12T00:41:39.570+0000 7fab8a5a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:39.757 INFO:tasks.workunit.client.0.smithi043.stderr: -330> 2024-09-12T00:41:39.570+0000 7fab8a5a2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:39.757 INFO:tasks.workunit.client.0.smithi043.stderr: -329> 2024-09-12T00:41:39.570+0000 7fab8a5a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:39.757 INFO:tasks.workunit.client.0.smithi043.stderr: -328> 2024-09-12T00:41:39.570+0000 7fab89da1640 10 monclient(hunting): get_auth_request con 0x55a968566fc0 auth_method 0 2024-09-12T00:41:39.757 INFO:tasks.workunit.client.0.smithi043.stderr: -327> 2024-09-12T00:41:39.570+0000 7fab89da1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:39.757 INFO:tasks.workunit.client.0.smithi043.stderr: -326> 2024-09-12T00:41:39.570+0000 7fab89da1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:39.757 INFO:tasks.workunit.client.0.smithi043.stderr: -325> 2024-09-12T00:41:39.570+0000 7fab89da1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:39.757 INFO:tasks.workunit.client.0.smithi043.stderr: -324> 2024-09-12T00:41:39.570+0000 7fab8a5a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:39.757 INFO:tasks.workunit.client.0.smithi043.stderr: -323> 2024-09-12T00:41:39.570+0000 7fab8a5a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:39.757 INFO:tasks.workunit.client.0.smithi043.stderr: -322> 2024-09-12T00:41:39.570+0000 7fab8a5a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:39.757 INFO:tasks.workunit.client.0.smithi043.stderr: -321> 2024-09-12T00:41:39.570+0000 7fab89da1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:39.757 INFO:tasks.workunit.client.0.smithi043.stderr: -320> 2024-09-12T00:41:39.570+0000 7fab89da1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:39.757 INFO:tasks.workunit.client.0.smithi043.stderr: -319> 2024-09-12T00:41:39.570+0000 7fab89da1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:39.757 INFO:tasks.workunit.client.0.smithi043.stderr: -318> 2024-09-12T00:41:39.570+0000 7fab89da1640 10 monclient(hunting): handle_auth_done global_id 8163 payload 824 2024-09-12T00:41:39.758 INFO:tasks.workunit.client.0.smithi043.stderr: -317> 2024-09-12T00:41:39.570+0000 7fab89da1640 10 monclient: _finish_hunting 0 2024-09-12T00:41:39.758 INFO:tasks.workunit.client.0.smithi043.stderr: -316> 2024-09-12T00:41:39.570+0000 7fab89da1640 1 monclient: found mon.noname-a 2024-09-12T00:41:39.758 INFO:tasks.workunit.client.0.smithi043.stderr: -315> 2024-09-12T00:41:39.570+0000 7fab89da1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:41:39.758 INFO:tasks.workunit.client.0.smithi043.stderr: -314> 2024-09-12T00:41:39.570+0000 7fab8ada3640 10 monclient: get_auth_request con 0x55a9685659a0 auth_method 0 2024-09-12T00:41:39.758 INFO:tasks.workunit.client.0.smithi043.stderr: -313> 2024-09-12T00:41:39.570+0000 7faa6ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:39.758 INFO:tasks.workunit.client.0.smithi043.stderr: -312> 2024-09-12T00:41:39.570+0000 7faa6ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:41:39.758 INFO:tasks.workunit.client.0.smithi043.stderr: -311> 2024-09-12T00:41:39.570+0000 7faa6ffff640 10 monclient: dump: 2024-09-12T00:41:39.758 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:39.758 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:39.758 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.758 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.758 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:39.759 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:39.759 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:39.759 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:39.759 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:39.759 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.759 INFO:tasks.workunit.client.0.smithi043.stderr: -310> 2024-09-12T00:41:39.570+0000 7faa6ffff640 10 monclient: _finish_auth 0 2024-09-12T00:41:39.759 INFO:tasks.workunit.client.0.smithi043.stderr: -309> 2024-09-12T00:41:39.570+0000 7faa6ffff640 10 monclient: _check_auth_tickets 2024-09-12T00:41:39.759 INFO:tasks.workunit.client.0.smithi043.stderr: -308> 2024-09-12T00:41:39.570+0000 7faa6ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:39.759 INFO:tasks.workunit.client.0.smithi043.stderr: -307> 2024-09-12T00:41:39.570+0000 7faa6ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:39.759 INFO:tasks.workunit.client.0.smithi043.stderr: -306> 2024-09-12T00:41:39.570+0000 7faa6ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:41:39.759 INFO:tasks.workunit.client.0.smithi043.stderr: -305> 2024-09-12T00:41:39.570+0000 7faa6ffff640 10 monclient: dump: 2024-09-12T00:41:39.759 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:39.759 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:39.759 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.760 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.760 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:39.760 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:39.760 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:39.760 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:39.760 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:39.760 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.760 INFO:tasks.workunit.client.0.smithi043.stderr: -304> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 monclient: authenticate success, global_id 8163 2024-09-12T00:41:39.760 INFO:tasks.workunit.client.0.smithi043.stderr: -303> 2024-09-12T00:41:39.570+0000 7fab8b5a4640 4 set_mon_vals no callback set 2024-09-12T00:41:39.760 INFO:tasks.workunit.client.0.smithi043.stderr: -302> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient: _renew_subs 2024-09-12T00:41:39.760 INFO:tasks.workunit.client.0.smithi043.stderr: -301> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:41:39.760 INFO:tasks.workunit.client.0.smithi043.stderr: -300> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient: _renew_subs 2024-09-12T00:41:39.761 INFO:tasks.workunit.client.0.smithi043.stderr: -299> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:41:39.761 INFO:tasks.workunit.client.0.smithi043.stderr: -298> 2024-09-12T00:41:39.570+0000 7faa6ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:41:39.761 INFO:tasks.workunit.client.0.smithi043.stderr: -297> 2024-09-12T00:41:39.570+0000 7faa6ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:41:39.761 INFO:tasks.workunit.client.0.smithi043.stderr: -296> 2024-09-12T00:41:39.570+0000 7faa6ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:41:39.761 INFO:tasks.workunit.client.0.smithi043.stderr: -295> 2024-09-12T00:41:39.570+0000 7fab8a5a2640 10 monclient: get_auth_request con 0x7faa64070a20 auth_method 0 2024-09-12T00:41:39.761 INFO:tasks.workunit.client.0.smithi043.stderr: -294> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient: get_monmap_and_config 2024-09-12T00:41:39.761 INFO:tasks.workunit.client.0.smithi043.stderr: -293> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient: build_initial_monmap 2024-09-12T00:41:39.761 INFO:tasks.workunit.client.0.smithi043.stderr: -292> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 1 build_initial for_mkfs: 0 2024-09-12T00:41:39.761 INFO:tasks.workunit.client.0.smithi043.stderr: -291> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 10 monclient: monmap: 2024-09-12T00:41:39.761 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:41:39.761 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:41:39.761 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:41:39.761 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:41:39.762 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:41:39.762 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:39.762 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:41:39.762 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:41:39.762 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:41:39.762 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.762 INFO:tasks.workunit.client.0.smithi043.stderr: -290> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968586d70) adding auth protocol: cephx 2024-09-12T00:41:39.762 INFO:tasks.workunit.client.0.smithi043.stderr: -289> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968586d70) adding auth protocol: cephx 2024-09-12T00:41:39.762 INFO:tasks.workunit.client.0.smithi043.stderr: -288> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968586d70) adding auth protocol: cephx 2024-09-12T00:41:39.762 INFO:tasks.workunit.client.0.smithi043.stderr: -287> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968586d70) adding con mode: secure 2024-09-12T00:41:39.762 INFO:tasks.workunit.client.0.smithi043.stderr: -286> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968586d70) adding con mode: crc 2024-09-12T00:41:39.762 INFO:tasks.workunit.client.0.smithi043.stderr: -285> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968586d70) adding con mode: secure 2024-09-12T00:41:39.762 INFO:tasks.workunit.client.0.smithi043.stderr: -284> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968586d70) adding con mode: crc 2024-09-12T00:41:39.762 INFO:tasks.workunit.client.0.smithi043.stderr: -283> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968586d70) adding con mode: secure 2024-09-12T00:41:39.763 INFO:tasks.workunit.client.0.smithi043.stderr: -282> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968586d70) adding con mode: crc 2024-09-12T00:41:39.763 INFO:tasks.workunit.client.0.smithi043.stderr: -281> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968586d70) adding con mode: crc 2024-09-12T00:41:39.763 INFO:tasks.workunit.client.0.smithi043.stderr: -280> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968586d70) adding con mode: secure 2024-09-12T00:41:39.763 INFO:tasks.workunit.client.0.smithi043.stderr: -279> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968586d70) adding con mode: crc 2024-09-12T00:41:39.763 INFO:tasks.workunit.client.0.smithi043.stderr: -278> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968586d70) adding con mode: secure 2024-09-12T00:41:39.763 INFO:tasks.workunit.client.0.smithi043.stderr: -277> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968586d70) adding con mode: crc 2024-09-12T00:41:39.763 INFO:tasks.workunit.client.0.smithi043.stderr: -276> 2024-09-12T00:41:39.570+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a968586d70) adding con mode: secure 2024-09-12T00:41:39.763 INFO:tasks.workunit.client.0.smithi043.stderr: -275> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:39.763 INFO:tasks.workunit.client.0.smithi043.stderr: -274> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient: init 2024-09-12T00:41:39.763 INFO:tasks.workunit.client.0.smithi043.stderr: -273> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a134d0) adding auth protocol: cephx 2024-09-12T00:41:39.763 INFO:tasks.workunit.client.0.smithi043.stderr: -272> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a134d0) adding auth protocol: cephx 2024-09-12T00:41:39.763 INFO:tasks.workunit.client.0.smithi043.stderr: -271> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a134d0) adding auth protocol: cephx 2024-09-12T00:41:39.763 INFO:tasks.workunit.client.0.smithi043.stderr: -270> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a134d0) adding con mode: secure 2024-09-12T00:41:39.764 INFO:tasks.workunit.client.0.smithi043.stderr: -269> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a134d0) adding con mode: crc 2024-09-12T00:41:39.764 INFO:tasks.workunit.client.0.smithi043.stderr: -268> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a134d0) adding con mode: secure 2024-09-12T00:41:39.764 INFO:tasks.workunit.client.0.smithi043.stderr: -267> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a134d0) adding con mode: crc 2024-09-12T00:41:39.764 INFO:tasks.workunit.client.0.smithi043.stderr: -266> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a134d0) adding con mode: secure 2024-09-12T00:41:39.764 INFO:tasks.workunit.client.0.smithi043.stderr: -265> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a134d0) adding con mode: crc 2024-09-12T00:41:39.764 INFO:tasks.workunit.client.0.smithi043.stderr: -264> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a134d0) adding con mode: crc 2024-09-12T00:41:39.764 INFO:tasks.workunit.client.0.smithi043.stderr: -263> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a134d0) adding con mode: secure 2024-09-12T00:41:39.764 INFO:tasks.workunit.client.0.smithi043.stderr: -262> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a134d0) adding con mode: crc 2024-09-12T00:41:39.764 INFO:tasks.workunit.client.0.smithi043.stderr: -261> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a134d0) adding con mode: secure 2024-09-12T00:41:39.764 INFO:tasks.workunit.client.0.smithi043.stderr: -260> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a134d0) adding con mode: crc 2024-09-12T00:41:39.764 INFO:tasks.workunit.client.0.smithi043.stderr: -259> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a134d0) adding con mode: secure 2024-09-12T00:41:39.764 INFO:tasks.workunit.client.0.smithi043.stderr: -258> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:39.764 INFO:tasks.workunit.client.0.smithi043.stderr: -257> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:39.765 INFO:tasks.workunit.client.0.smithi043.stderr: -256> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command rotate-key cmddesc rotate-key hook 0x7fff10a13618 EEXIST 2024-09-12T00:41:39.765 INFO:tasks.workunit.client.0.smithi043.stderr: -255> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:39.765 INFO:tasks.workunit.client.0.smithi043.stderr: -254> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:41:39.765 INFO:tasks.workunit.client.0.smithi043.stderr: -253> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): picked mon.noname-b con 0x55a9685bb270 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:41:39.765 INFO:tasks.workunit.client.0.smithi043.stderr: -252> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): picked mon.noname-c con 0x55a9685b6660 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:41:39.765 INFO:tasks.workunit.client.0.smithi043.stderr: -251> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): picked mon.noname-a con 0x55a9685b6fe0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:41:39.765 INFO:tasks.workunit.client.0.smithi043.stderr: -250> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:39.765 INFO:tasks.workunit.client.0.smithi043.stderr: -249> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:39.765 INFO:tasks.workunit.client.0.smithi043.stderr: -248> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:39.765 INFO:tasks.workunit.client.0.smithi043.stderr: -247> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:39.765 INFO:tasks.workunit.client.0.smithi043.stderr: -246> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): authenticate will time out at 2395.564902s 2024-09-12T00:41:39.765 INFO:tasks.workunit.client.0.smithi043.stderr: -245> 2024-09-12T00:41:39.574+0000 7fab89da1640 10 monclient(hunting): get_auth_request con 0x55a9685b6660 auth_method 0 2024-09-12T00:41:39.765 INFO:tasks.workunit.client.0.smithi043.stderr: -244> 2024-09-12T00:41:39.574+0000 7fab89da1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:39.766 INFO:tasks.workunit.client.0.smithi043.stderr: -243> 2024-09-12T00:41:39.574+0000 7fab89da1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:39.766 INFO:tasks.workunit.client.0.smithi043.stderr: -242> 2024-09-12T00:41:39.574+0000 7fab89da1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:39.766 INFO:tasks.workunit.client.0.smithi043.stderr: -241> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient(hunting): get_auth_request con 0x55a9685b6fe0 auth_method 0 2024-09-12T00:41:39.766 INFO:tasks.workunit.client.0.smithi043.stderr: -240> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:39.766 INFO:tasks.workunit.client.0.smithi043.stderr: -239> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:39.766 INFO:tasks.workunit.client.0.smithi043.stderr: -238> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:39.766 INFO:tasks.workunit.client.0.smithi043.stderr: -237> 2024-09-12T00:41:39.574+0000 7fab89da1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:39.766 INFO:tasks.workunit.client.0.smithi043.stderr: -236> 2024-09-12T00:41:39.574+0000 7fab89da1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:39.766 INFO:tasks.workunit.client.0.smithi043.stderr: -235> 2024-09-12T00:41:39.574+0000 7fab89da1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:39.766 INFO:tasks.workunit.client.0.smithi043.stderr: -234> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:39.766 INFO:tasks.workunit.client.0.smithi043.stderr: -233> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:39.766 INFO:tasks.workunit.client.0.smithi043.stderr: -232> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:39.766 INFO:tasks.workunit.client.0.smithi043.stderr: -231> 2024-09-12T00:41:39.574+0000 7fab89da1640 10 monclient(hunting): handle_auth_done global_id 7778 payload 274 2024-09-12T00:41:39.767 INFO:tasks.workunit.client.0.smithi043.stderr: -230> 2024-09-12T00:41:39.574+0000 7fab89da1640 10 monclient: _finish_hunting 0 2024-09-12T00:41:39.767 INFO:tasks.workunit.client.0.smithi043.stderr: -229> 2024-09-12T00:41:39.574+0000 7fab89da1640 1 monclient: found mon.noname-c 2024-09-12T00:41:39.767 INFO:tasks.workunit.client.0.smithi043.stderr: -228> 2024-09-12T00:41:39.574+0000 7fab89da1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:41:39.767 INFO:tasks.workunit.client.0.smithi043.stderr: -227> 2024-09-12T00:41:39.574+0000 7faa6dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:39.767 INFO:tasks.workunit.client.0.smithi043.stderr: -226> 2024-09-12T00:41:39.574+0000 7faa6dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:41:39.767 INFO:tasks.workunit.client.0.smithi043.stderr: -225> 2024-09-12T00:41:39.574+0000 7faa6dffb640 10 monclient: dump: 2024-09-12T00:41:39.767 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:39.767 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:39.767 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.767 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.767 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:39.767 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:39.767 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:39.768 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:39.768 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:39.768 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.768 INFO:tasks.workunit.client.0.smithi043.stderr: -224> 2024-09-12T00:41:39.574+0000 7faa6dffb640 10 monclient: _finish_auth 0 2024-09-12T00:41:39.768 INFO:tasks.workunit.client.0.smithi043.stderr: -223> 2024-09-12T00:41:39.574+0000 7faa6dffb640 10 monclient: _check_auth_tickets 2024-09-12T00:41:39.768 INFO:tasks.workunit.client.0.smithi043.stderr: -222> 2024-09-12T00:41:39.574+0000 7faa6dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:39.768 INFO:tasks.workunit.client.0.smithi043.stderr: -221> 2024-09-12T00:41:39.574+0000 7faa6dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:39.768 INFO:tasks.workunit.client.0.smithi043.stderr: -220> 2024-09-12T00:41:39.574+0000 7faa6dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:41:39.768 INFO:tasks.workunit.client.0.smithi043.stderr: -219> 2024-09-12T00:41:39.574+0000 7faa6dffb640 10 monclient: dump: 2024-09-12T00:41:39.768 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:39.768 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:39.769 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.769 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.769 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:39.769 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:39.769 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:39.769 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:39.769 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:39.769 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.769 INFO:tasks.workunit.client.0.smithi043.stderr: -218> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 monclient: authenticate success, global_id 7778 2024-09-12T00:41:39.769 INFO:tasks.workunit.client.0.smithi043.stderr: -217> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:41:39.769 INFO:tasks.workunit.client.0.smithi043.stderr: -216> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 4 set_mon_vals no callback set 2024-09-12T00:41:39.769 INFO:tasks.workunit.client.0.smithi043.stderr: -215> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient: shutdown 2024-09-12T00:41:39.769 INFO:tasks.workunit.client.0.smithi043.stderr: -214> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient: build_initial_monmap 2024-09-12T00:41:39.770 INFO:tasks.workunit.client.0.smithi043.stderr: -213> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 1 build_initial for_mkfs: 0 2024-09-12T00:41:39.770 INFO:tasks.workunit.client.0.smithi043.stderr: -212> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient: monmap: 2024-09-12T00:41:39.770 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:41:39.770 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:41:39.770 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:41:39.770 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:41:39.770 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:41:39.770 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:39.770 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:41:39.770 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:41:39.770 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:41:39.770 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.771 INFO:tasks.workunit.client.0.smithi043.stderr: -211> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685b74d0) adding auth protocol: cephx 2024-09-12T00:41:39.771 INFO:tasks.workunit.client.0.smithi043.stderr: -210> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685b74d0) adding auth protocol: cephx 2024-09-12T00:41:39.771 INFO:tasks.workunit.client.0.smithi043.stderr: -209> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685b74d0) adding auth protocol: cephx 2024-09-12T00:41:39.771 INFO:tasks.workunit.client.0.smithi043.stderr: -208> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685b74d0) adding con mode: secure 2024-09-12T00:41:39.771 INFO:tasks.workunit.client.0.smithi043.stderr: -207> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685b74d0) adding con mode: crc 2024-09-12T00:41:39.771 INFO:tasks.workunit.client.0.smithi043.stderr: -206> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685b74d0) adding con mode: secure 2024-09-12T00:41:39.771 INFO:tasks.workunit.client.0.smithi043.stderr: -205> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685b74d0) adding con mode: crc 2024-09-12T00:41:39.771 INFO:tasks.workunit.client.0.smithi043.stderr: -204> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685b74d0) adding con mode: secure 2024-09-12T00:41:39.771 INFO:tasks.workunit.client.0.smithi043.stderr: -203> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685b74d0) adding con mode: crc 2024-09-12T00:41:39.771 INFO:tasks.workunit.client.0.smithi043.stderr: -202> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685b74d0) adding con mode: crc 2024-09-12T00:41:39.771 INFO:tasks.workunit.client.0.smithi043.stderr: -201> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685b74d0) adding con mode: secure 2024-09-12T00:41:39.771 INFO:tasks.workunit.client.0.smithi043.stderr: -200> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685b74d0) adding con mode: crc 2024-09-12T00:41:39.771 INFO:tasks.workunit.client.0.smithi043.stderr: -199> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685b74d0) adding con mode: secure 2024-09-12T00:41:39.771 INFO:tasks.workunit.client.0.smithi043.stderr: -198> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685b74d0) adding con mode: crc 2024-09-12T00:41:39.772 INFO:tasks.workunit.client.0.smithi043.stderr: -197> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685b74d0) adding con mode: secure 2024-09-12T00:41:39.772 INFO:tasks.workunit.client.0.smithi043.stderr: -196> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:39.772 INFO:tasks.workunit.client.0.smithi043.stderr: -195> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 1 librados: starting msgr at 2024-09-12T00:41:39.772 INFO:tasks.workunit.client.0.smithi043.stderr: -194> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 1 librados: starting objecter 2024-09-12T00:41:39.772 INFO:tasks.workunit.client.0.smithi043.stderr: -193> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a968586a60 EEXIST 2024-09-12T00:41:39.772 INFO:tasks.workunit.client.0.smithi043.stderr: -192> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 1 librados: setting wanted keys 2024-09-12T00:41:39.772 INFO:tasks.workunit.client.0.smithi043.stderr: -191> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 1 librados: calling monclient init 2024-09-12T00:41:39.772 INFO:tasks.workunit.client.0.smithi043.stderr: -190> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient: init 2024-09-12T00:41:39.772 INFO:tasks.workunit.client.0.smithi043.stderr: -189> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685694b0) adding auth protocol: cephx 2024-09-12T00:41:39.772 INFO:tasks.workunit.client.0.smithi043.stderr: -188> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685694b0) adding auth protocol: cephx 2024-09-12T00:41:39.772 INFO:tasks.workunit.client.0.smithi043.stderr: -187> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685694b0) adding auth protocol: cephx 2024-09-12T00:41:39.772 INFO:tasks.workunit.client.0.smithi043.stderr: -186> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685694b0) adding con mode: secure 2024-09-12T00:41:39.772 INFO:tasks.workunit.client.0.smithi043.stderr: -185> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685694b0) adding con mode: crc 2024-09-12T00:41:39.773 INFO:tasks.workunit.client.0.smithi043.stderr: -184> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685694b0) adding con mode: secure 2024-09-12T00:41:39.773 INFO:tasks.workunit.client.0.smithi043.stderr: -183> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685694b0) adding con mode: crc 2024-09-12T00:41:39.773 INFO:tasks.workunit.client.0.smithi043.stderr: -182> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685694b0) adding con mode: secure 2024-09-12T00:41:39.773 INFO:tasks.workunit.client.0.smithi043.stderr: -181> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685694b0) adding con mode: crc 2024-09-12T00:41:39.773 INFO:tasks.workunit.client.0.smithi043.stderr: -180> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685694b0) adding con mode: crc 2024-09-12T00:41:39.773 INFO:tasks.workunit.client.0.smithi043.stderr: -179> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685694b0) adding con mode: secure 2024-09-12T00:41:39.773 INFO:tasks.workunit.client.0.smithi043.stderr: -178> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685694b0) adding con mode: crc 2024-09-12T00:41:39.773 INFO:tasks.workunit.client.0.smithi043.stderr: -177> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685694b0) adding con mode: secure 2024-09-12T00:41:39.773 INFO:tasks.workunit.client.0.smithi043.stderr: -176> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685694b0) adding con mode: crc 2024-09-12T00:41:39.773 INFO:tasks.workunit.client.0.smithi043.stderr: -175> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 AuthRegistry(0x55a9685694b0) adding con mode: secure 2024-09-12T00:41:39.773 INFO:tasks.workunit.client.0.smithi043.stderr: -174> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:39.773 INFO:tasks.workunit.client.0.smithi043.stderr: -173> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:39.773 INFO:tasks.workunit.client.0.smithi043.stderr: -172> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command rotate-key cmddesc rotate-key hook 0x55a9685695f8 EEXIST 2024-09-12T00:41:39.774 INFO:tasks.workunit.client.0.smithi043.stderr: -171> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:39.774 INFO:tasks.workunit.client.0.smithi043.stderr: -170> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:41:39.774 INFO:tasks.workunit.client.0.smithi043.stderr: -169> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): picked mon.noname-a con 0x55a9685b6660 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:41:39.774 INFO:tasks.workunit.client.0.smithi043.stderr: -168> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): picked mon.noname-b con 0x55a9685b6fe0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:41:39.774 INFO:tasks.workunit.client.0.smithi043.stderr: -167> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): picked mon.noname-c con 0x55a9685bb270 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:41:39.774 INFO:tasks.workunit.client.0.smithi043.stderr: -166> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:39.774 INFO:tasks.workunit.client.0.smithi043.stderr: -165> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:39.774 INFO:tasks.workunit.client.0.smithi043.stderr: -164> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:39.774 INFO:tasks.workunit.client.0.smithi043.stderr: -163> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:39.774 INFO:tasks.workunit.client.0.smithi043.stderr: -162> 2024-09-12T00:41:39.574+0000 7fab8ca9c9c0 10 monclient(hunting): authenticate will time out at 2395.567542s 2024-09-12T00:41:39.774 INFO:tasks.workunit.client.0.smithi043.stderr: -161> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient(hunting): get_auth_request con 0x55a9685bb270 auth_method 0 2024-09-12T00:41:39.774 INFO:tasks.workunit.client.0.smithi043.stderr: -160> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:39.774 INFO:tasks.workunit.client.0.smithi043.stderr: -159> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:39.774 INFO:tasks.workunit.client.0.smithi043.stderr: -158> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:39.775 INFO:tasks.workunit.client.0.smithi043.stderr: -157> 2024-09-12T00:41:39.574+0000 7fab8a5a2640 10 monclient(hunting): get_auth_request con 0x55a9685b6660 auth_method 0 2024-09-12T00:41:39.775 INFO:tasks.workunit.client.0.smithi043.stderr: -156> 2024-09-12T00:41:39.574+0000 7fab8a5a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:39.775 INFO:tasks.workunit.client.0.smithi043.stderr: -155> 2024-09-12T00:41:39.574+0000 7fab8a5a2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:39.775 INFO:tasks.workunit.client.0.smithi043.stderr: -154> 2024-09-12T00:41:39.574+0000 7fab8a5a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:39.775 INFO:tasks.workunit.client.0.smithi043.stderr: -153> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:39.775 INFO:tasks.workunit.client.0.smithi043.stderr: -152> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:39.775 INFO:tasks.workunit.client.0.smithi043.stderr: -151> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:39.775 INFO:tasks.workunit.client.0.smithi043.stderr: -150> 2024-09-12T00:41:39.574+0000 7fab8a5a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:39.775 INFO:tasks.workunit.client.0.smithi043.stderr: -149> 2024-09-12T00:41:39.574+0000 7fab8a5a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:39.775 INFO:tasks.workunit.client.0.smithi043.stderr: -148> 2024-09-12T00:41:39.574+0000 7fab8a5a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:39.775 INFO:tasks.workunit.client.0.smithi043.stderr: -147> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient(hunting): handle_auth_done global_id 7781 payload 824 2024-09-12T00:41:39.775 INFO:tasks.workunit.client.0.smithi043.stderr: -146> 2024-09-12T00:41:39.574+0000 7fab8ada3640 10 monclient: _finish_hunting 0 2024-09-12T00:41:39.775 INFO:tasks.workunit.client.0.smithi043.stderr: -145> 2024-09-12T00:41:39.578+0000 7fab8ada3640 1 monclient: found mon.noname-c 2024-09-12T00:41:39.776 INFO:tasks.workunit.client.0.smithi043.stderr: -144> 2024-09-12T00:41:39.578+0000 7fab8ada3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:41:39.776 INFO:tasks.workunit.client.0.smithi043.stderr: -143> 2024-09-12T00:41:39.578+0000 7faa5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:39.776 INFO:tasks.workunit.client.0.smithi043.stderr: -142> 2024-09-12T00:41:39.578+0000 7faa5bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:41:39.776 INFO:tasks.workunit.client.0.smithi043.stderr: -141> 2024-09-12T00:41:39.578+0000 7faa5bfff640 10 monclient: dump: 2024-09-12T00:41:39.776 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:39.776 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:39.776 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.776 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.776 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:39.776 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:39.776 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:39.776 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:39.776 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:39.777 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.777 INFO:tasks.workunit.client.0.smithi043.stderr: -140> 2024-09-12T00:41:39.578+0000 7faa5bfff640 10 monclient: _finish_auth 0 2024-09-12T00:41:39.777 INFO:tasks.workunit.client.0.smithi043.stderr: -139> 2024-09-12T00:41:39.578+0000 7faa5bfff640 10 monclient: _check_auth_tickets 2024-09-12T00:41:39.777 INFO:tasks.workunit.client.0.smithi043.stderr: -138> 2024-09-12T00:41:39.578+0000 7faa5bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:39.777 INFO:tasks.workunit.client.0.smithi043.stderr: -137> 2024-09-12T00:41:39.578+0000 7faa5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:39.777 INFO:tasks.workunit.client.0.smithi043.stderr: -136> 2024-09-12T00:41:39.578+0000 7faa5bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:41:39.777 INFO:tasks.workunit.client.0.smithi043.stderr: -135> 2024-09-12T00:41:39.578+0000 7faa5bfff640 10 monclient: dump: 2024-09-12T00:41:39.777 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:41:39.777 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:41:39.777 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.777 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:41:39.777 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:39.778 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:41:39.778 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:41:39.778 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:41:39.778 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:41:39.778 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.778 INFO:tasks.workunit.client.0.smithi043.stderr: -134> 2024-09-12T00:41:39.578+0000 7faa6dffb640 4 set_mon_vals no callback set 2024-09-12T00:41:39.778 INFO:tasks.workunit.client.0.smithi043.stderr: -133> 2024-09-12T00:41:39.578+0000 7fab8ca9c9c0 5 monclient: authenticate success, global_id 7781 2024-09-12T00:41:39.778 INFO:tasks.workunit.client.0.smithi043.stderr: -132> 2024-09-12T00:41:39.578+0000 7fab8ca9c9c0 10 monclient: _renew_subs 2024-09-12T00:41:39.778 INFO:tasks.workunit.client.0.smithi043.stderr: -131> 2024-09-12T00:41:39.578+0000 7fab8ca9c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:41:39.778 INFO:tasks.workunit.client.0.smithi043.stderr: -130> 2024-09-12T00:41:39.578+0000 7fab8ca9c9c0 10 monclient: _renew_subs 2024-09-12T00:41:39.778 INFO:tasks.workunit.client.0.smithi043.stderr: -129> 2024-09-12T00:41:39.578+0000 7fab8ca9c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:41:39.778 INFO:tasks.workunit.client.0.smithi043.stderr: -128> 2024-09-12T00:41:39.578+0000 7fab8ca9c9c0 1 librados: init done 2024-09-12T00:41:39.778 INFO:tasks.workunit.client.0.smithi043.stderr: -127> 2024-09-12T00:41:39.578+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command cr dump hook 0x55a9685b35e8 2024-09-12T00:41:39.779 INFO:tasks.workunit.client.0.smithi043.stderr: -126> 2024-09-12T00:41:39.578+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.779 INFO:tasks.workunit.client.0.smithi043.stderr: -125> 2024-09-12T00:41:39.578+0000 7faa5bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:41:39.779 INFO:tasks.workunit.client.0.smithi043.stderr: -124> 2024-09-12T00:41:39.578+0000 7faa5bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:41:39.779 INFO:tasks.workunit.client.0.smithi043.stderr: -123> 2024-09-12T00:41:39.578+0000 7faa5bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:41:39.779 INFO:tasks.workunit.client.0.smithi043.stderr: -122> 2024-09-12T00:41:39.578+0000 7fab8a5a2640 10 monclient: get_auth_request con 0x7faa54070ae0 auth_method 0 2024-09-12T00:41:39.779 INFO:tasks.workunit.client.0.smithi043.stderr: -121> 2024-09-12T00:41:39.578+0000 7fab89da1640 10 monclient: get_auth_request con 0x55a9685d4aa0 auth_method 0 2024-09-12T00:41:39.779 INFO:tasks.workunit.client.0.smithi043.stderr: -120> 2024-09-12T00:41:39.578+0000 7fab8ca9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.779 INFO:tasks.workunit.client.0.smithi043.stderr: -119> 2024-09-12T00:41:39.578+0000 7fab8ca9c9c0 20 realm 2024-09-12T00:41:39.779 INFO:tasks.workunit.client.0.smithi043.stderr: -118> 2024-09-12T00:41:39.578+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.779 INFO:tasks.workunit.client.0.smithi043.stderr: -117> 2024-09-12T00:41:39.582+0000 7fab8ca9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.779 INFO:tasks.workunit.client.0.smithi043.stderr: -116> 2024-09-12T00:41:39.582+0000 7fab8ca9c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:39.779 INFO:tasks.workunit.client.0.smithi043.stderr: -115> 2024-09-12T00:41:39.582+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.780 INFO:tasks.workunit.client.0.smithi043.stderr: -114> 2024-09-12T00:41:39.582+0000 7fab8ca9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.780 INFO:tasks.workunit.client.0.smithi043.stderr: -113> 2024-09-12T00:41:39.582+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.780 INFO:tasks.workunit.client.0.smithi043.stderr: -112> 2024-09-12T00:41:39.582+0000 7fab8a5a2640 10 monclient: get_auth_request con 0x55a9685d8c90 auth_method 0 2024-09-12T00:41:39.780 INFO:tasks.workunit.client.0.smithi043.stderr: -111> 2024-09-12T00:41:39.582+0000 7fab8ca9c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:39.780 INFO:tasks.workunit.client.0.smithi043.stderr: -110> 2024-09-12T00:41:39.582+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.780 INFO:tasks.workunit.client.0.smithi043.stderr: -109> 2024-09-12T00:41:39.582+0000 7fab89da1640 10 monclient: get_auth_request con 0x55a9685dc520 auth_method 0 2024-09-12T00:41:39.780 INFO:tasks.workunit.client.0.smithi043.stderr: -108> 2024-09-12T00:41:39.582+0000 7fab8ca9c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:39.780 INFO:tasks.workunit.client.0.smithi043.stderr: -107> 2024-09-12T00:41:39.582+0000 7fab8ca9c9c0 20 searching for the correct realm 2024-09-12T00:41:39.780 INFO:tasks.workunit.client.0.smithi043.stderr: -106> 2024-09-12T00:41:39.582+0000 7fab8ada3640 10 monclient: get_auth_request con 0x55a9685e1250 auth_method 0 2024-09-12T00:41:39.780 INFO:tasks.workunit.client.0.smithi043.stderr: -105> 2024-09-12T00:41:39.586+0000 7fab8a5a2640 10 monclient: get_auth_request con 0x7fab840d2060 auth_method 0 2024-09-12T00:41:39.780 INFO:tasks.workunit.client.0.smithi043.stderr: -104> 2024-09-12T00:41:39.586+0000 7fab89da1640 10 monclient: get_auth_request con 0x7fab80061a30 auth_method 0 2024-09-12T00:41:39.780 INFO:tasks.workunit.client.0.smithi043.stderr: -103> 2024-09-12T00:41:39.590+0000 7fab89da1640 0 -- 172.21.15.43:0/2667863561 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fab80061a30 msgr2=0x7fab80092a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:39.780 INFO:tasks.workunit.client.0.smithi043.stderr: -102> 2024-09-12T00:41:39.590+0000 7faa5bfff640 1 client.7781.objecter ms_handle_reset 0x7fab80061a30 session 0x7fab80062be0 osd.4 2024-09-12T00:41:39.781 INFO:tasks.workunit.client.0.smithi043.stderr: -101> 2024-09-12T00:41:39.590+0000 7faa5bfff640 10 monclient: _renew_subs 2024-09-12T00:41:39.781 INFO:tasks.workunit.client.0.smithi043.stderr: -100> 2024-09-12T00:41:39.590+0000 7faa5bfff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:41:39.781 INFO:tasks.workunit.client.0.smithi043.stderr: -99> 2024-09-12T00:41:39.590+0000 7fab8ada3640 10 monclient: get_auth_request con 0x7fab80099140 auth_method 0 2024-09-12T00:41:39.781 INFO:tasks.workunit.client.0.smithi043.stderr: -98> 2024-09-12T00:41:39.590+0000 7fab89da1640 10 monclient: get_auth_request con 0x7faa54080b80 auth_method 0 2024-09-12T00:41:39.781 INFO:tasks.workunit.client.0.smithi043.stderr: -97> 2024-09-12T00:41:39.594+0000 7fab8a5a2640 10 monclient: get_auth_request con 0x7fab80092a10 auth_method 0 2024-09-12T00:41:39.781 INFO:tasks.workunit.client.0.smithi043.stderr: -96> 2024-09-12T00:41:39.594+0000 7fab89da1640 0 -- 172.21.15.43:0/2667863561 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7faa54080b80 msgr2=0x7faa54082fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:39.781 INFO:tasks.workunit.client.0.smithi043.stderr: -95> 2024-09-12T00:41:39.594+0000 7faa5bfff640 1 client.7781.objecter ms_handle_reset 0x7faa54080b80 session 0x7fab80062be0 osd.4 2024-09-12T00:41:39.781 INFO:tasks.workunit.client.0.smithi043.stderr: -94> 2024-09-12T00:41:39.594+0000 7fab89da1640 10 monclient: get_auth_request con 0x7fab80061a30 auth_method 0 2024-09-12T00:41:39.781 INFO:tasks.workunit.client.0.smithi043.stderr: -93> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:41:39.781 INFO:tasks.workunit.client.0.smithi043.stderr: -92> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:39.781 INFO:tasks.workunit.client.0.smithi043.stderr: -91> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:39.781 INFO:tasks.workunit.client.0.smithi043.stderr: -90> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:41:39.782 INFO:tasks.workunit.client.0.smithi043.stderr: -89> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:39.782 INFO:tasks.workunit.client.0.smithi043.stderr: -88> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:39.782 INFO:tasks.workunit.client.0.smithi043.stderr: -87> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.782 INFO:tasks.workunit.client.0.smithi043.stderr: -86> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.782 INFO:tasks.workunit.client.0.smithi043.stderr: -85> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.782 INFO:tasks.workunit.client.0.smithi043.stderr: -84> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:39.782 INFO:tasks.workunit.client.0.smithi043.stderr: -83> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.782 INFO:tasks.workunit.client.0.smithi043.stderr: -82> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:39.782 INFO:tasks.workunit.client.0.smithi043.stderr: -81> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 zone default found 2024-09-12T00:41:39.782 INFO:tasks.workunit.client.0.smithi043.stderr: -80> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 4 Realm: () 2024-09-12T00:41:39.782 INFO:tasks.workunit.client.0.smithi043.stderr: -79> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:41:39.782 INFO:tasks.workunit.client.0.smithi043.stderr: -78> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:41:39.782 INFO:tasks.workunit.client.0.smithi043.stderr: -77> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:39.783 INFO:tasks.workunit.client.0.smithi043.stderr: -76> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 zonegroup default 2024-09-12T00:41:39.783 INFO:tasks.workunit.client.0.smithi043.stderr: -75> 2024-09-12T00:41:39.602+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.783 INFO:tasks.workunit.client.0.smithi043.stderr: -74> 2024-09-12T00:41:39.606+0000 7fab8ca9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.783 INFO:tasks.workunit.client.0.smithi043.stderr: -73> 2024-09-12T00:41:39.606+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.783 INFO:tasks.workunit.client.0.smithi043.stderr: -72> 2024-09-12T00:41:39.606+0000 7fab8ca9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.783 INFO:tasks.workunit.client.0.smithi043.stderr: -71> 2024-09-12T00:41:39.606+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.783 INFO:tasks.workunit.client.0.smithi043.stderr: -70> 2024-09-12T00:41:39.606+0000 7fab8ca9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.783 INFO:tasks.workunit.client.0.smithi043.stderr: -69> 2024-09-12T00:41:39.606+0000 7fab8ca9c9c0 20 started sync module instance, tier type = 2024-09-12T00:41:39.783 INFO:tasks.workunit.client.0.smithi043.stderr: -68> 2024-09-12T00:41:39.606+0000 7fab8ca9c9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:41:39.783 INFO:tasks.workunit.client.0.smithi043.stderr: -67> 2024-09-12T00:41:39.622+0000 7fab8ca9c9c0 20 add_watcher() i=0 2024-09-12T00:41:39.783 INFO:tasks.workunit.client.0.smithi043.stderr: -66> 2024-09-12T00:41:39.622+0000 7fab8ca9c9c0 20 add_watcher() i=1 2024-09-12T00:41:39.783 INFO:tasks.workunit.client.0.smithi043.stderr: -65> 2024-09-12T00:41:39.622+0000 7fab8ca9c9c0 20 add_watcher() i=2 2024-09-12T00:41:39.783 INFO:tasks.workunit.client.0.smithi043.stderr: -64> 2024-09-12T00:41:39.622+0000 7fab8ca9c9c0 20 add_watcher() i=3 2024-09-12T00:41:39.784 INFO:tasks.workunit.client.0.smithi043.stderr: -63> 2024-09-12T00:41:39.622+0000 7fab8ca9c9c0 20 add_watcher() i=4 2024-09-12T00:41:39.784 INFO:tasks.workunit.client.0.smithi043.stderr: -62> 2024-09-12T00:41:39.622+0000 7fab8ca9c9c0 20 add_watcher() i=5 2024-09-12T00:41:39.784 INFO:tasks.workunit.client.0.smithi043.stderr: -61> 2024-09-12T00:41:39.622+0000 7fab8ca9c9c0 20 add_watcher() i=6 2024-09-12T00:41:39.784 INFO:tasks.workunit.client.0.smithi043.stderr: -60> 2024-09-12T00:41:39.622+0000 7fab8ca9c9c0 20 add_watcher() i=7 2024-09-12T00:41:39.784 INFO:tasks.workunit.client.0.smithi043.stderr: -59> 2024-09-12T00:41:39.622+0000 7fab8ca9c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:39.784 INFO:tasks.workunit.client.0.smithi043.stderr: -58> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a139b0) adding auth protocol: cephx 2024-09-12T00:41:39.784 INFO:tasks.workunit.client.0.smithi043.stderr: -57> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a139b0) adding auth protocol: cephx 2024-09-12T00:41:39.784 INFO:tasks.workunit.client.0.smithi043.stderr: -56> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a139b0) adding auth protocol: cephx 2024-09-12T00:41:39.784 INFO:tasks.workunit.client.0.smithi043.stderr: -55> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a139b0) adding con mode: secure 2024-09-12T00:41:39.784 INFO:tasks.workunit.client.0.smithi043.stderr: -54> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a139b0) adding con mode: crc 2024-09-12T00:41:39.784 INFO:tasks.workunit.client.0.smithi043.stderr: -53> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a139b0) adding con mode: secure 2024-09-12T00:41:39.784 INFO:tasks.workunit.client.0.smithi043.stderr: -52> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a139b0) adding con mode: crc 2024-09-12T00:41:39.785 INFO:tasks.workunit.client.0.smithi043.stderr: -51> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a139b0) adding con mode: secure 2024-09-12T00:41:39.785 INFO:tasks.workunit.client.0.smithi043.stderr: -50> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a139b0) adding con mode: crc 2024-09-12T00:41:39.785 INFO:tasks.workunit.client.0.smithi043.stderr: -49> 2024-09-12T00:41:39.626+0000 7faa40fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:39.785 INFO:tasks.workunit.client.0.smithi043.stderr: -48> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a139b0) adding con mode: crc 2024-09-12T00:41:39.785 INFO:tasks.workunit.client.0.smithi043.stderr: -47> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a139b0) adding con mode: secure 2024-09-12T00:41:39.785 INFO:tasks.workunit.client.0.smithi043.stderr: -46> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a139b0) adding con mode: crc 2024-09-12T00:41:39.785 INFO:tasks.workunit.client.0.smithi043.stderr: -45> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a139b0) adding con mode: secure 2024-09-12T00:41:39.785 INFO:tasks.workunit.client.0.smithi043.stderr: -44> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a139b0) adding con mode: crc 2024-09-12T00:41:39.785 INFO:tasks.workunit.client.0.smithi043.stderr: -43> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 AuthRegistry(0x7fff10a139b0) adding con mode: secure 2024-09-12T00:41:39.785 INFO:tasks.workunit.client.0.smithi043.stderr: -42> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:39.785 INFO:tasks.workunit.client.0.smithi043.stderr: -41> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:39.785 INFO:tasks.workunit.client.0.smithi043.stderr: -40> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:39.785 INFO:tasks.workunit.client.0.smithi043.stderr: -39> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command cache list hook 0x55a9685b2dd0 2024-09-12T00:41:39.786 INFO:tasks.workunit.client.0.smithi043.stderr: -38> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command cache inspect hook 0x55a9685b2dd0 2024-09-12T00:41:39.786 INFO:tasks.workunit.client.0.smithi043.stderr: -37> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command cache erase hook 0x55a9685b2dd0 2024-09-12T00:41:39.786 INFO:tasks.workunit.client.0.smithi043.stderr: -36> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command cache zap hook 0x55a9685b2dd0 2024-09-12T00:41:39.786 INFO:tasks.workunit.client.0.smithi043.stderr: -35> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 note: GC not initialized 2024-09-12T00:41:39.786 INFO:tasks.workunit.client.0.smithi043.stderr: -34> 2024-09-12T00:41:39.626+0000 7fa9bb7fe640 20 reqs_thread_entry: start 2024-09-12T00:41:39.786 INFO:tasks.workunit.client.0.smithi043.stderr: -33> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command sync trace show hook 0x7fab80083070 2024-09-12T00:41:39.786 INFO:tasks.workunit.client.0.smithi043.stderr: -32> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command sync trace history hook 0x7fab80083070 2024-09-12T00:41:39.786 INFO:tasks.workunit.client.0.smithi043.stderr: -31> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command sync trace active hook 0x7fab80083070 2024-09-12T00:41:39.786 INFO:tasks.workunit.client.0.smithi043.stderr: -30> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 5 asok(0x55a9682e22b0) register_command sync trace active_short hook 0x7fab80083070 2024-09-12T00:41:39.786 INFO:tasks.workunit.client.0.smithi043.stderr: -29> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:39.786 INFO:tasks.workunit.client.0.smithi043.stderr: -28> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 20 Filter name: none 2024-09-12T00:41:39.786 INFO:tasks.workunit.client.0.smithi043.stderr: -27> 2024-09-12T00:41:39.626+0000 7fa9b97fa640 20 reqs_thread_entry: start 2024-09-12T00:41:39.786 INFO:tasks.workunit.client.0.smithi043.stderr: -26> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:41:39.787 INFO:tasks.workunit.client.0.smithi043.stderr: -25> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.787 INFO:tasks.workunit.client.0.smithi043.stderr: -24> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:41:39.787 INFO:tasks.workunit.client.0.smithi043.stderr: -23> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:41:39.787 INFO:tasks.workunit.client.0.smithi043.stderr: -22> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:41:39.787 INFO:tasks.workunit.client.0.smithi043.stderr: -21> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 : miss 2024-09-12T00:41:39.787 INFO:tasks.workunit.client.0.smithi043.stderr: -20> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.787 INFO:tasks.workunit.client.0.smithi043.stderr: -19> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:41:39.787 INFO:tasks.workunit.client.0.smithi043.stderr: -18> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:41:39.787 INFO:tasks.workunit.client.0.smithi043.stderr: -17> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:41:39.787 INFO:tasks.workunit.client.0.smithi043.stderr: -16> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:41:39.787 INFO:tasks.workunit.client.0.smithi043.stderr: -15> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:39.787 INFO:tasks.workunit.client.0.smithi043.stderr: -14> 2024-09-12T00:41:39.626+0000 7fab8ca9c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 2024-09-12T00:41:39.787 INFO:tasks.workunit.client.0.smithi043.stderr: -13> 2024-09-12T00:41:39.642+0000 7fab8ca9c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:41:39.788 INFO:tasks.workunit.client.0.smithi043.stderr: -12> 2024-09-12T00:41:39.642+0000 7fab8ca9c9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:41:39.788 INFO:tasks.workunit.client.0.smithi043.stderr: -11> 2024-09-12T00:41:39.642+0000 7fab8ca9c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:39.788 INFO:tasks.workunit.client.0.smithi043.stderr: -10> 2024-09-12T00:41:39.642+0000 7fab8ca9c9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17, ofs0, ns] 2024-09-12T00:41:39.788 INFO:tasks.workunit.client.0.smithi043.stderr: -9> 2024-09-12T00:41:39.642+0000 7faa6d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333528 cookie 94186088864928 notifier 7781 bl.length()=827 2024-09-12T00:41:39.788 INFO:tasks.workunit.client.0.smithi043.stderr: -8> 2024-09-12T00:41:39.642+0000 7faa6d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:41:39.788 INFO:tasks.workunit.client.0.smithi043.stderr: -7> 2024-09-12T00:41:39.642+0000 7faa6d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:41:39.788 INFO:tasks.workunit.client.0.smithi043.stderr: -6> 2024-09-12T00:41:39.642+0000 7faa6d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:39.788 INFO:tasks.workunit.client.0.smithi043.stderr: -5> 2024-09-12T00:41:39.642+0000 7fab8ca9c9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_sources= new_sources= 2024-09-12T00:41:39.788 INFO:tasks.workunit.client.0.smithi043.stderr: -4> 2024-09-12T00:41:39.642+0000 7fab8ca9c9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential sources added=[] removed=[] 2024-09-12T00:41:39.788 INFO:tasks.workunit.client.0.smithi043.stderr: -3> 2024-09-12T00:41:39.642+0000 7fab8ca9c9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_dests= new_dests= 2024-09-12T00:41:39.788 INFO:tasks.workunit.client.0.smithi043.stderr: -2> 2024-09-12T00:41:39.642+0000 7fab8ca9c9c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential dests added=[] removed=[] 2024-09-12T00:41:39.788 INFO:tasks.workunit.client.0.smithi043.stderr: -1> 2024-09-12T00:41:39.658+0000 7fab8ca9c9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fab8ca9c9c0 time 2024-09-12T00:41:39.660058+0000 2024-09-12T00:41:39.789 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:41:39.789 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.789 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:39.789 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fab903762eb] 2024-09-12T00:41:39.789 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fab9037649f] 2024-09-12T00:41:39.789 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a966900cc1] 2024-09-12T00:41:39.789 INFO:tasks.workunit.client.0.smithi043.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a966915d5a] 2024-09-12T00:41:39.789 INFO:tasks.workunit.client.0.smithi043.stderr: 5: main() 2024-09-12T00:41:39.789 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fab8f1dcd90] 2024-09-12T00:41:39.789 INFO:tasks.workunit.client.0.smithi043.stderr: 7: __libc_start_main() 2024-09-12T00:41:39.789 INFO:tasks.workunit.client.0.smithi043.stderr: 8: _start() 2024-09-12T00:41:39.789 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.789 INFO:tasks.workunit.client.0.smithi043.stderr: 0> 2024-09-12T00:41:39.658+0000 7fab8ca9c9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:41:39.790 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7fab8ca9c9c0 thread_name:radosgw-admin 2024-09-12T00:41:39.790 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.790 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:39.790 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fab8f1f5520] 2024-09-12T00:41:39.790 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:41:39.790 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:41:39.790 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:41:39.790 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fab90376345] 2024-09-12T00:41:39.790 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fab9037649f] 2024-09-12T00:41:39.790 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a966900cc1] 2024-09-12T00:41:39.790 INFO:tasks.workunit.client.0.smithi043.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a966915d5a] 2024-09-12T00:41:39.790 INFO:tasks.workunit.client.0.smithi043.stderr: 9: main() 2024-09-12T00:41:39.790 INFO:tasks.workunit.client.0.smithi043.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fab8f1dcd90] 2024-09-12T00:41:39.790 INFO:tasks.workunit.client.0.smithi043.stderr: 11: __libc_start_main() 2024-09-12T00:41:39.791 INFO:tasks.workunit.client.0.smithi043.stderr: 12: _start() 2024-09-12T00:41:39.791 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:41:39.791 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:41:39.791 INFO:tasks.workunit.client.0.smithi043.stderr:--- logging levels --- 2024-09-12T00:41:39.791 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 none 2024-09-12T00:41:39.791 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 lockdep 2024-09-12T00:41:39.791 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 context 2024-09-12T00:41:39.791 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 crush 2024-09-12T00:41:39.791 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds 2024-09-12T00:41:39.791 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_balancer 2024-09-12T00:41:39.791 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_locker 2024-09-12T00:41:39.791 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log 2024-09-12T00:41:39.792 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log_expire 2024-09-12T00:41:39.792 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_migrator 2024-09-12T00:41:39.792 INFO:tasks.workunit.client.0.smithi043.stderr: 3/ 5 mds_quiesce 2024-09-12T00:41:39.792 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 buffer 2024-09-12T00:41:39.792 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 timer 2024-09-12T00:41:39.792 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 filer 2024-09-12T00:41:39.792 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 striper 2024-09-12T00:41:39.792 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 objecter 2024-09-12T00:41:39.792 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rados 2024-09-12T00:41:39.792 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd 2024-09-12T00:41:39.792 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_mirror 2024-09-12T00:41:39.792 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_replay 2024-09-12T00:41:39.792 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_pwl 2024-09-12T00:41:39.792 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 journaler 2024-09-12T00:41:39.793 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objectcacher 2024-09-12T00:41:39.793 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:41:39.793 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 client 2024-09-12T00:41:39.793 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 osd 2024-09-12T00:41:39.793 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 optracker 2024-09-12T00:41:39.793 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objclass 2024-09-12T00:41:39.793 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 filestore 2024-09-12T00:41:39.793 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 journal 2024-09-12T00:41:39.793 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 ms 2024-09-12T00:41:39.794 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mon 2024-09-12T00:41:39.794 INFO:tasks.workunit.client.0.smithi043.stderr: 0/10 monc 2024-09-12T00:41:39.794 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 paxos 2024-09-12T00:41:39.794 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 tp 2024-09-12T00:41:39.794 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 auth 2024-09-12T00:41:39.794 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 crypto 2024-09-12T00:41:39.794 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 finisher 2024-09-12T00:41:39.794 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 reserver 2024-09-12T00:41:39.794 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 heartbeatmap 2024-09-12T00:41:39.794 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 perfcounter 2024-09-12T00:41:39.794 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw 2024-09-12T00:41:39.794 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_sync 2024-09-12T00:41:39.794 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_datacache 2024-09-12T00:41:39.794 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_access 2024-09-12T00:41:39.795 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:41:39.795 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_flight 2024-09-12T00:41:39.795 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:41:39.795 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw_notification 2024-09-12T00:41:39.795 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 javaclient 2024-09-12T00:41:39.795 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 asok 2024-09-12T00:41:39.795 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 throttle 2024-09-12T00:41:39.795 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 refs 2024-09-12T00:41:39.795 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 compressor 2024-09-12T00:41:39.795 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluestore 2024-09-12T00:41:39.795 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluefs 2024-09-12T00:41:39.795 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 bdev 2024-09-12T00:41:39.795 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 kstore 2024-09-12T00:41:39.796 INFO:tasks.workunit.client.0.smithi043.stderr: 4/ 5 rocksdb 2024-09-12T00:41:39.796 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 fuse 2024-09-12T00:41:39.796 INFO:tasks.workunit.client.0.smithi043.stderr: 2/ 5 mgr 2024-09-12T00:41:39.796 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mgrc 2024-09-12T00:41:39.796 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 dpdk 2024-09-12T00:41:39.796 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 eventtrace 2024-09-12T00:41:39.796 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 prioritycache 2024-09-12T00:41:39.796 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 test 2024-09-12T00:41:39.796 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:41:39.796 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephsqlite 2024-09-12T00:41:39.796 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:41:39.796 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore 2024-09-12T00:41:39.796 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_onode 2024-09-12T00:41:39.797 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_odata 2024-09-12T00:41:39.797 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_omap 2024-09-12T00:41:39.797 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_tm 2024-09-12T00:41:39.797 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_t 2024-09-12T00:41:39.797 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:41:39.797 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_epm 2024-09-12T00:41:39.797 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_lba 2024-09-12T00:41:39.797 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:41:39.797 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cache 2024-09-12T00:41:39.797 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_journal 2024-09-12T00:41:39.797 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_device 2024-09-12T00:41:39.797 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_backref 2024-09-12T00:41:39.797 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 alienstore 2024-09-12T00:41:39.798 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mclock 2024-09-12T00:41:39.798 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cyanstore 2024-09-12T00:41:39.798 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 ceph_exporter 2024-09-12T00:41:39.798 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 memstore 2024-09-12T00:41:39.798 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 trace 2024-09-12T00:41:39.798 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 ceph_dedup 2024-09-12T00:41:39.798 INFO:tasks.workunit.client.0.smithi043.stderr: -2/-2 (syslog threshold) 2024-09-12T00:41:39.798 INFO:tasks.workunit.client.0.smithi043.stderr: 99/99 (stderr threshold) 2024-09-12T00:41:39.798 INFO:tasks.workunit.client.0.smithi043.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:41:39.798 INFO:tasks.workunit.client.0.smithi043.stderr: 7fa9b97fa640 / http_manager 2024-09-12T00:41:39.798 INFO:tasks.workunit.client.0.smithi043.stderr: 7fa9bb7fe640 / http_manager 2024-09-12T00:41:39.798 INFO:tasks.workunit.client.0.smithi043.stderr: 7faa40fe1640 / rgw_dt_lg_renew 2024-09-12T00:41:39.798 INFO:tasks.workunit.client.0.smithi043.stderr: 7faa5bfff640 / ms_dispatch 2024-09-12T00:41:39.799 INFO:tasks.workunit.client.0.smithi043.stderr: 7faa6d7fa640 / io_context_pool 2024-09-12T00:41:39.799 INFO:tasks.workunit.client.0.smithi043.stderr: 7faa6dffb640 / io_context_pool 2024-09-12T00:41:39.799 INFO:tasks.workunit.client.0.smithi043.stderr: 7faa6ffff640 / ms_dispatch 2024-09-12T00:41:39.799 INFO:tasks.workunit.client.0.smithi043.stderr: 7faa76e05640 / ms_dispatch 2024-09-12T00:41:39.799 INFO:tasks.workunit.client.0.smithi043.stderr: 7faa78608640 / io_context_pool 2024-09-12T00:41:39.799 INFO:tasks.workunit.client.0.smithi043.stderr: 7fab89da1640 / msgr-worker-2 2024-09-12T00:41:39.799 INFO:tasks.workunit.client.0.smithi043.stderr: 7fab8a5a2640 / msgr-worker-1 2024-09-12T00:41:39.799 INFO:tasks.workunit.client.0.smithi043.stderr: 7fab8ada3640 / msgr-worker-0 2024-09-12T00:41:39.799 INFO:tasks.workunit.client.0.smithi043.stderr: 7fab8b5a4640 / io_context_pool 2024-09-12T00:41:39.799 INFO:tasks.workunit.client.0.smithi043.stderr: 7fab8ca9c9c0 / radosgw-admin 2024-09-12T00:41:39.799 INFO:tasks.workunit.client.0.smithi043.stderr: max_recent 500 2024-09-12T00:41:39.799 INFO:tasks.workunit.client.0.smithi043.stderr: max_new 1000 2024-09-12T00:41:39.799 INFO:tasks.workunit.client.0.smithi043.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:41:39.662113Z_54238610-b2a2-4284-8042-27cef0cae222/log 2024-09-12T00:41:39.799 INFO:tasks.workunit.client.0.smithi043.stderr:--- end dump of recent events --- 2024-09-12T00:41:39.800 INFO:tasks.workunit.client.0.smithi043.stderr:Aborted 2024-09-12T00:41:39.800 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:41:39.804 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:39.804 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:39.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.738+0000 7f560cc7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.738+0000 7f560cc7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.738+0000 7f560cc7a9c0 20 realm 2024-09-12T00:41:39.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.738+0000 7f560cc7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.738+0000 7f560cc7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.738+0000 7f560cc7a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:39.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.738+0000 7f560cc7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.738+0000 7f560cc7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.738+0000 7f560cc7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.742+0000 7f560cc7a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:39.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.742+0000 7f560cc7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.742+0000 7f560cc7a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:39.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.742+0000 7f560cc7a9c0 20 searching for the correct realm 2024-09-12T00:41:39.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.746+0000 7f560af81640 0 -- 172.21.15.43:0/1578627359 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55edbddd2400 msgr2=0x55edbddd4850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:39.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.754+0000 7f5609f7f640 0 -- 172.21.15.43:0/1578627359 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f56000c0070 msgr2=0x7f56001340b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:39.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.758+0000 7f560cc7a9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:41:39.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.758+0000 7f560cc7a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:39.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.758+0000 7f560cc7a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:39.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.758+0000 7f560cc7a9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:41:39.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.758+0000 7f560cc7a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:39.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.758+0000 7f560cc7a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:39.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.758+0000 7f560cc7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.758+0000 7f560cc7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.758+0000 7f560cc7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.762+0000 7f560cc7a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:39.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.762+0000 7f560cc7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.762+0000 7f560cc7a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:39.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.762+0000 7f560cc7a9c0 20 zone default found 2024-09-12T00:41:39.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.762+0000 7f560cc7a9c0 4 Realm: () 2024-09-12T00:41:39.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.762+0000 7f560cc7a9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:41:39.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.762+0000 7f560cc7a9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:41:39.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.762+0000 7f560cc7a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:39.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.762+0000 7f560cc7a9c0 20 zonegroup default 2024-09-12T00:41:39.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.762+0000 7f560cc7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.762+0000 7f560cc7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.762+0000 7f560cc7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.762+0000 7f560cc7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.762+0000 7f560cc7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.762+0000 7f560cc7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.762+0000 7f560cc7a9c0 20 started sync module instance, tier type = 2024-09-12T00:41:39.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.762+0000 7f560cc7a9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:41:39.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.778+0000 7f560cc7a9c0 20 add_watcher() i=0 2024-09-12T00:41:39.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.778+0000 7f560cc7a9c0 20 add_watcher() i=1 2024-09-12T00:41:39.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.778+0000 7f560cc7a9c0 20 add_watcher() i=2 2024-09-12T00:41:39.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.778+0000 7f560cc7a9c0 20 add_watcher() i=3 2024-09-12T00:41:39.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.778+0000 7f560cc7a9c0 20 add_watcher() i=4 2024-09-12T00:41:39.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.778+0000 7f560cc7a9c0 20 add_watcher() i=5 2024-09-12T00:41:39.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.778+0000 7f560cc7a9c0 20 add_watcher() i=6 2024-09-12T00:41:39.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.778+0000 7f560cc7a9c0 20 add_watcher() i=7 2024-09-12T00:41:39.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.778+0000 7f560cc7a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:39.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.782+0000 7f54c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:39.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.782+0000 7f560cc7a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:39.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.782+0000 7f560cc7a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:39.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.782+0000 7f560cc7a9c0 5 note: GC not initialized 2024-09-12T00:41:39.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.782+0000 7f543b7fe640 20 reqs_thread_entry: start 2024-09-12T00:41:39.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.782+0000 7f560cc7a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:39.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.782+0000 7f560cc7a9c0 20 Filter name: none 2024-09-12T00:41:39.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.782+0000 7f54397fa640 20 reqs_thread_entry: start 2024-09-12T00:41:39.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.782+0000 7f560cc7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.782+0000 7f560cc7a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:41:39.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.782+0000 7f560cc7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.786+0000 7f560cc7a9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:41:39.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.786+0000 7f560cc7a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:39.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.786+0000 7f560cc7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.786+0000 7f560cc7a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:41:39.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.786+0000 7f560cc7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.786+0000 7f560cc7a9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:41:39.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.786+0000 7f560cc7a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:39.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.790+0000 7f54c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:39.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.794+0000 7f560cc7a9c0 20 remove_watcher() i=0 2024-09-12T00:41:39.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.794+0000 7f560cc7a9c0 2 removed watcher, disabling cache 2024-09-12T00:41:39.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.794+0000 7f560cc7a9c0 20 remove_watcher() i=1 2024-09-12T00:41:39.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.798+0000 7f560cc7a9c0 20 remove_watcher() i=2 2024-09-12T00:41:39.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.798+0000 7f560cc7a9c0 20 remove_watcher() i=3 2024-09-12T00:41:39.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.802+0000 7f560cc7a9c0 20 remove_watcher() i=4 2024-09-12T00:41:39.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.802+0000 7f560cc7a9c0 20 remove_watcher() i=5 2024-09-12T00:41:39.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.806+0000 7f560cc7a9c0 20 remove_watcher() i=6 2024-09-12T00:41:39.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.806+0000 7f560cc7a9c0 20 remove_watcher() i=7 2024-09-12T00:41:39.822 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:39.822 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:41:39.832 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:41:39.858 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:39.858 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:39.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.902+0000 7f2d0e86c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.903 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.902+0000 7f2d0e86c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.904 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.902+0000 7f2d0e86c9c0 20 realm 2024-09-12T00:41:39.904 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.902+0000 7f2d0e86c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.904 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.902+0000 7f2d0e86c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.904 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.902+0000 7f2d0e86c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:39.904 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.902+0000 7f2d0e86c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.904 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.902+0000 7f2d0e86c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:39.904 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.902+0000 7f2d0e86c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.905 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.906+0000 7f2d0e86c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:39.906 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.906+0000 7f2d0e86c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:39.906 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.906+0000 7f2d0e86c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:39.906 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.906+0000 7f2d0e86c9c0 20 searching for the correct realm 2024-09-12T00:41:39.913 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:39.910+0000 7f2d0cb73640 0 -- 172.21.15.43:0/622969632 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f2d00027b30 msgr2=0x7f2d0003a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:40.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.126+0000 7f2d0c372640 0 -- 172.21.15.43:0/622969632 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x5646314ceb10 msgr2=0x5646314d0f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:40.135 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.134+0000 7f2d0e86c9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:41:40.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.134+0000 7f2d0e86c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:40.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.134+0000 7f2d0e86c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:40.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.134+0000 7f2d0e86c9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:41:40.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.134+0000 7f2d0e86c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:40.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.134+0000 7f2d0e86c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:40.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.134+0000 7f2d0e86c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:40.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.134+0000 7f2d0e86c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:40.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.134+0000 7f2d0e86c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:40.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.134+0000 7f2d0e86c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:40.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.134+0000 7f2d0e86c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:40.141 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.138+0000 7f2d0e86c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:40.141 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.138+0000 7f2d0e86c9c0 20 zone default found 2024-09-12T00:41:40.141 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.138+0000 7f2d0e86c9c0 4 Realm: () 2024-09-12T00:41:40.141 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.138+0000 7f2d0e86c9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:41:40.141 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.138+0000 7f2d0e86c9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:41:40.141 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.138+0000 7f2d0e86c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:40.141 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.138+0000 7f2d0e86c9c0 20 zonegroup default 2024-09-12T00:41:40.141 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.138+0000 7f2d0e86c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:40.141 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.138+0000 7f2d0e86c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:40.141 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.138+0000 7f2d0e86c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:40.142 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.138+0000 7f2d0e86c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:40.142 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.138+0000 7f2d0e86c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:40.142 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.138+0000 7f2d0e86c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:40.142 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.138+0000 7f2d0e86c9c0 20 started sync module instance, tier type = 2024-09-12T00:41:40.142 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.138+0000 7f2d0e86c9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:41:40.160 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.158+0000 7f2d0e86c9c0 20 add_watcher() i=0 2024-09-12T00:41:40.160 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.158+0000 7f2d0e86c9c0 20 add_watcher() i=1 2024-09-12T00:41:40.160 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.158+0000 7f2d0e86c9c0 20 add_watcher() i=2 2024-09-12T00:41:40.160 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.158+0000 7f2d0e86c9c0 20 add_watcher() i=3 2024-09-12T00:41:40.160 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.158+0000 7f2d0e86c9c0 20 add_watcher() i=4 2024-09-12T00:41:40.160 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.158+0000 7f2d0e86c9c0 20 add_watcher() i=5 2024-09-12T00:41:40.161 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.158+0000 7f2d0e86c9c0 20 add_watcher() i=6 2024-09-12T00:41:40.162 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.162+0000 7f2d0e86c9c0 20 add_watcher() i=7 2024-09-12T00:41:40.162 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.162+0000 7f2d0e86c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:40.165 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.162+0000 7f2bc2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:40.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.166+0000 7f2d0e86c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:40.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.166+0000 7f2d0e86c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:40.166 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.166+0000 7f2d0e86c9c0 5 note: GC not initialized 2024-09-12T00:41:40.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.166+0000 7f2bc1fdb640 20 reqs_thread_entry: start 2024-09-12T00:41:40.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.166+0000 7f2d0e86c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:40.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.166+0000 7f2d0e86c9c0 20 Filter name: none 2024-09-12T00:41:40.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.166+0000 7f2b337fe640 20 reqs_thread_entry: start 2024-09-12T00:41:40.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.166+0000 7f2d0e86c9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:41:40.167 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.166+0000 7f2d0e86c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:40.168 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.166+0000 7f2d0e86c9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:41:40.168 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.166+0000 7f2d0e86c9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:41:40.168 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.166+0000 7f2d0e86c9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:41:40.168 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.166+0000 7f2d0e86c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 : miss 2024-09-12T00:41:40.168 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.166+0000 7f2d0e86c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:40.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.170+0000 7f2d0e86c9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:41:40.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.170+0000 7f2d0e86c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:41:40.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.170+0000 7f2d0e86c9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:41:40.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.170+0000 7f2d0e86c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:41:40.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.170+0000 7f2d0e86c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:40.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.170+0000 7f2d0e86c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 2024-09-12T00:41:40.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.170+0000 7f2d0e86c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.0 2024-09-12T00:41:40.170 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.170+0000 7f2d0e86c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.0 2024-09-12T00:41:40.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.170+0000 7f2d0e86c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.1 2024-09-12T00:41:40.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.170+0000 7f2d0e86c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.1 2024-09-12T00:41:40.171 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.170+0000 7f2d0e86c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.2 2024-09-12T00:41:40.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.170+0000 7f2d0e86c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.2 2024-09-12T00:41:40.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.170+0000 7f2d0e86c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.3 2024-09-12T00:41:40.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.170+0000 7f2d0e86c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.3 2024-09-12T00:41:40.172 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.170+0000 7f2d0e86c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.4 2024-09-12T00:41:40.173 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.170+0000 7f2d0e86c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.4 2024-09-12T00:41:40.173 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.174+0000 7f2d0e86c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.5 2024-09-12T00:41:40.174 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.174+0000 7f2d0e86c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.5 2024-09-12T00:41:40.175 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.174+0000 7f2d0e86c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.6 2024-09-12T00:41:40.175 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.174+0000 7f2d0e86c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.6 2024-09-12T00:41:40.176 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.174+0000 7f2d0e86c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.7 2024-09-12T00:41:40.176 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.174+0000 7f2d0e86c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.7 2024-09-12T00:41:40.177 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.174+0000 7f2d0e86c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.8 2024-09-12T00:41:40.177 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.174+0000 7f2d0e86c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.8 2024-09-12T00:41:40.178 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.178+0000 7f2d0e86c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.9 2024-09-12T00:41:40.178 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.178+0000 7f2d0e86c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.9 2024-09-12T00:41:40.179 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.178+0000 7f2d0e86c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.10 2024-09-12T00:41:40.179 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.178+0000 7f2d0e86c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.10 2024-09-12T00:41:40.180 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.178+0000 7f2d0e86c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.11 2024-09-12T00:41:40.180 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.178+0000 7f2d0e86c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.11 2024-09-12T00:41:40.180 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.178+0000 7f2d0e86c9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.12 2024-09-12T00:41:40.180 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.178+0000 7f2d0e86c9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.12 2024-09-12T00:41:40.183 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.182+0000 7f2bc2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:40.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.190+0000 7f2d0e86c9c0 20 remove_watcher() i=0 2024-09-12T00:41:40.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.190+0000 7f2d0e86c9c0 2 removed watcher, disabling cache 2024-09-12T00:41:40.192 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.190+0000 7f2d0e86c9c0 20 remove_watcher() i=1 2024-09-12T00:41:40.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.194+0000 7f2d0e86c9c0 20 remove_watcher() i=2 2024-09-12T00:41:40.196 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.194+0000 7f2d0e86c9c0 20 remove_watcher() i=3 2024-09-12T00:41:40.199 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.198+0000 7f2d0e86c9c0 20 remove_watcher() i=4 2024-09-12T00:41:40.200 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.198+0000 7f2d0e86c9c0 20 remove_watcher() i=5 2024-09-12T00:41:40.202 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.202+0000 7f2d0e86c9c0 20 remove_watcher() i=6 2024-09-12T00:41:40.203 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:41:40.202+0000 7f2d0e86c9c0 20 remove_watcher() i=7 2024-09-12T00:42:10.251 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T00:42:10.291 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:10.291 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:10.336 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.334+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.338 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.338+0000 7fba92e189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:10.338 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.338+0000 7fba92e189c0 20 realm 2024-09-12T00:42:10.338 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.338+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.338+0000 7fba92e189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:10.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.338+0000 7fba92e189c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:10.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.338+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.338+0000 7fba92e189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:10.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.338+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.338+0000 7fba92e189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:10.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.338+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.342+0000 7fba92e189c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:10.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.342+0000 7fba92e189c0 20 searching for the correct realm 2024-09-12T00:42:10.347 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.346+0000 7fba9011d640 0 -- 172.21.15.43:0/1345457052 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fba780db040 msgr2=0x7fba780e7910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:10.354 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.354+0000 7fba9011d640 0 -- 172.21.15.43:0/1345457052 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fb95c080c40 msgr2=0x7fb95c083070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:10.361 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.358+0000 7fba92e189c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:42:10.362 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.358+0000 7fba92e189c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:10.362 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.358+0000 7fba92e189c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:10.362 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.358+0000 7fba92e189c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:42:10.362 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.358+0000 7fba92e189c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:10.362 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.358+0000 7fba92e189c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:10.362 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.358+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.362 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:10.362 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.363 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:10.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:10.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.362+0000 7fba92e189c0 20 zone default found 2024-09-12T00:42:10.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.362+0000 7fba92e189c0 4 Realm: () 2024-09-12T00:42:10.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.362+0000 7fba92e189c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:42:10.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.362+0000 7fba92e189c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:42:10.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.362+0000 7fba92e189c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:10.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.362+0000 7fba92e189c0 20 zonegroup default 2024-09-12T00:42:10.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:10.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.365 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:10.365 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.365 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:10.365 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.362+0000 7fba92e189c0 20 started sync module instance, tier type = 2024-09-12T00:42:10.365 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.362+0000 7fba92e189c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:42:10.380 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.378+0000 7fba92e189c0 20 add_watcher() i=0 2024-09-12T00:42:10.380 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.378+0000 7fba92e189c0 20 add_watcher() i=1 2024-09-12T00:42:10.380 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.378+0000 7fba92e189c0 20 add_watcher() i=2 2024-09-12T00:42:10.380 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.378+0000 7fba92e189c0 20 add_watcher() i=3 2024-09-12T00:42:10.381 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.378+0000 7fba92e189c0 20 add_watcher() i=4 2024-09-12T00:42:10.381 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.378+0000 7fba92e189c0 20 add_watcher() i=5 2024-09-12T00:42:10.381 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.378+0000 7fba92e189c0 20 add_watcher() i=6 2024-09-12T00:42:10.381 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.382+0000 7fba92e189c0 20 add_watcher() i=7 2024-09-12T00:42:10.381 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.382+0000 7fba92e189c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:10.384 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.382+0000 7fb9477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:10.385 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.382+0000 7fba92e189c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:10.385 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.382+0000 7fba92e189c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:10.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.382+0000 7fba92e189c0 5 note: GC not initialized 2024-09-12T00:42:10.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.382+0000 7fb9467e4640 20 reqs_thread_entry: start 2024-09-12T00:42:10.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.382+0000 7fba92e189c0 20 init_complete bucket index max shards: 11 2024-09-12T00:42:10.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.386+0000 7fba92e189c0 20 Filter name: none 2024-09-12T00:42:10.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.386+0000 7fb93f7fe640 20 reqs_thread_entry: start 2024-09-12T00:42:10.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.386+0000 7fba92e189c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:42:10.386 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.386+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.387 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.386+0000 7fba92e189c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:42:10.387 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.386+0000 7fba92e189c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:42:10.387 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.386+0000 7fba92e189c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:42:10.387 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.386+0000 7fba92e189c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 : miss 2024-09-12T00:42:10.387 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.386+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.388 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.386+0000 7fba92e189c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:42:10.388 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.386+0000 7fba92e189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:42:10.388 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.386+0000 7fba92e189c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:42:10.388 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.386+0000 7fba92e189c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:42:10.388 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.386+0000 7fba92e189c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:42:10.388 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.386+0000 7fba92e189c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 2024-09-12T00:42:10.390 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.390+0000 7fba92e189c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:42:10.407 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.406+0000 7fba92e189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:42:10.407 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.406+0000 7fba92e189c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:42:10.407 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.406+0000 7fba92e189c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:42:10.407 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.406+0000 7fba92e189c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17, ofs0, ns] 2024-09-12T00:42:10.408 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.406+0000 7fb9677fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333529 cookie 94208851659280 notifier 7826 bl.length()=827 2024-09-12T00:42:10.408 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.406+0000 7fb9677fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:42:10.408 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.406+0000 7fb9677fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:42:10.408 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.406+0000 7fb9677fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:42:10.409 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.406+0000 7fba92e189c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_sources= new_sources= 2024-09-12T00:42:10.409 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.406+0000 7fba92e189c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential sources added=[] removed=[] 2024-09-12T00:42:10.409 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.406+0000 7fba92e189c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_dests= new_dests= 2024-09-12T00:42:10.409 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.406+0000 7fba92e189c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential dests added=[] removed=[] 2024-09-12T00:42:10.415 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fba92e189c0 time 2024-09-12T00:42:10.418728+0000 2024-09-12T00:42:10.415 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:42:10.417 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:10.417 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fba966f22eb] 2024-09-12T00:42:10.417 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fba966f249f] 2024-09-12T00:42:10.417 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aeb2444cc1] 2024-09-12T00:42:10.417 INFO:tasks.workunit.client.0.smithi043.stderr: 4: radosgw-admin(+0x1422aac) [0x55aeb2ea2aac] 2024-09-12T00:42:10.417 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55aeb2459ced] 2024-09-12T00:42:10.417 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:42:10.417 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fba95558d90] 2024-09-12T00:42:10.417 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:42:10.417 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:42:10.418 INFO:tasks.workunit.client.0.smithi043.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:42:10.418 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7fba92e189c0 thread_name:radosgw-admin 2024-09-12T00:42:10.418 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.414+0000 7fba92e189c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fba92e189c0 time 2024-09-12T00:42:10.418728+0000 2024-09-12T00:42:10.418 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:42:10.418 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.418 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:10.418 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fba966f22eb] 2024-09-12T00:42:10.419 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fba966f249f] 2024-09-12T00:42:10.419 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aeb2444cc1] 2024-09-12T00:42:10.419 INFO:tasks.workunit.client.0.smithi043.stderr: 4: radosgw-admin(+0x1422aac) [0x55aeb2ea2aac] 2024-09-12T00:42:10.419 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55aeb2459ced] 2024-09-12T00:42:10.419 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:42:10.419 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fba95558d90] 2024-09-12T00:42:10.419 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:42:10.419 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:42:10.419 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.441 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:10.441 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fba95571520] 2024-09-12T00:42:10.441 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:42:10.441 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:42:10.441 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:42:10.441 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fba966f2345] 2024-09-12T00:42:10.441 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fba966f249f] 2024-09-12T00:42:10.441 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aeb2444cc1] 2024-09-12T00:42:10.442 INFO:tasks.workunit.client.0.smithi043.stderr: 8: radosgw-admin(+0x1422aac) [0x55aeb2ea2aac] 2024-09-12T00:42:10.442 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55aeb2459ced] 2024-09-12T00:42:10.442 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:42:10.442 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fba95558d90] 2024-09-12T00:42:10.442 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:42:10.442 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:42:10.442 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.418+0000 7fba92e189c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:42:10.442 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7fba92e189c0 thread_name:radosgw-admin 2024-09-12T00:42:10.442 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.442 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:10.443 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fba95571520] 2024-09-12T00:42:10.443 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:42:10.443 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:42:10.443 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:42:10.443 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fba966f2345] 2024-09-12T00:42:10.443 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fba966f249f] 2024-09-12T00:42:10.443 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aeb2444cc1] 2024-09-12T00:42:10.443 INFO:tasks.workunit.client.0.smithi043.stderr: 8: radosgw-admin(+0x1422aac) [0x55aeb2ea2aac] 2024-09-12T00:42:10.443 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55aeb2459ced] 2024-09-12T00:42:10.443 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:42:10.444 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fba95558d90] 2024-09-12T00:42:10.444 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:42:10.444 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:42:10.444 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:42:10.444 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.444 INFO:tasks.workunit.client.0.smithi043.stderr:--- begin dump of recent events --- 2024-09-12T00:42:10.444 INFO:tasks.workunit.client.0.smithi043.stderr: -499> 2024-09-12T00:42:10.314+0000 7fb97ee0d640 10 monclient: _finish_auth 0 2024-09-12T00:42:10.444 INFO:tasks.workunit.client.0.smithi043.stderr: -498> 2024-09-12T00:42:10.314+0000 7fb97ee0d640 10 monclient: _check_auth_tickets 2024-09-12T00:42:10.444 INFO:tasks.workunit.client.0.smithi043.stderr: -497> 2024-09-12T00:42:10.314+0000 7fb97ee0d640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:10.444 INFO:tasks.workunit.client.0.smithi043.stderr: -496> 2024-09-12T00:42:10.314+0000 7fb97ee0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:10.444 INFO:tasks.workunit.client.0.smithi043.stderr: -495> 2024-09-12T00:42:10.314+0000 7fb97ee0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:42:10.445 INFO:tasks.workunit.client.0.smithi043.stderr: -494> 2024-09-12T00:42:10.314+0000 7fb97ee0d640 10 monclient: dump: 2024-09-12T00:42:10.445 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:10.445 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:10.445 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.445 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.445 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:10.445 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:10.445 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:10.445 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:10.445 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:10.445 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.446 INFO:tasks.workunit.client.0.smithi043.stderr: -493> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 monclient: authenticate success, global_id 7814 2024-09-12T00:42:10.446 INFO:tasks.workunit.client.0.smithi043.stderr: -492> 2024-09-12T00:42:10.314+0000 7fba92e189c0 10 monclient: get_monmap_and_config success 2024-09-12T00:42:10.446 INFO:tasks.workunit.client.0.smithi043.stderr: -491> 2024-09-12T00:42:10.314+0000 7fba92e189c0 4 set_mon_vals no callback set 2024-09-12T00:42:10.446 INFO:tasks.workunit.client.0.smithi043.stderr: -490> 2024-09-12T00:42:10.314+0000 7fba92e189c0 10 monclient: shutdown 2024-09-12T00:42:10.446 INFO:tasks.workunit.client.0.smithi043.stderr: -489> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) unregister_commands rotate-key 2024-09-12T00:42:10.446 INFO:tasks.workunit.client.0.smithi043.stderr: -488> 2024-09-12T00:42:10.314+0000 7fba92e189c0 10 monclient: build_initial_monmap 2024-09-12T00:42:10.446 INFO:tasks.workunit.client.0.smithi043.stderr: -487> 2024-09-12T00:42:10.314+0000 7fba92e189c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:10.446 INFO:tasks.workunit.client.0.smithi043.stderr: -486> 2024-09-12T00:42:10.314+0000 7fba92e189c0 10 monclient: monmap: 2024-09-12T00:42:10.446 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:42:10.446 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:10.447 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:42:10.447 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:42:10.447 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:10.447 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:10.447 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:42:10.447 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:42:10.447 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:42:10.447 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.447 INFO:tasks.workunit.client.0.smithi043.stderr: -485> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb513a530) adding auth protocol: cephx 2024-09-12T00:42:10.447 INFO:tasks.workunit.client.0.smithi043.stderr: -484> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb513a530) adding auth protocol: cephx 2024-09-12T00:42:10.447 INFO:tasks.workunit.client.0.smithi043.stderr: -483> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb513a530) adding auth protocol: cephx 2024-09-12T00:42:10.448 INFO:tasks.workunit.client.0.smithi043.stderr: -482> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb513a530) adding con mode: secure 2024-09-12T00:42:10.448 INFO:tasks.workunit.client.0.smithi043.stderr: -481> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb513a530) adding con mode: crc 2024-09-12T00:42:10.448 INFO:tasks.workunit.client.0.smithi043.stderr: -480> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb513a530) adding con mode: secure 2024-09-12T00:42:10.448 INFO:tasks.workunit.client.0.smithi043.stderr: -479> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb513a530) adding con mode: crc 2024-09-12T00:42:10.448 INFO:tasks.workunit.client.0.smithi043.stderr: -478> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb513a530) adding con mode: secure 2024-09-12T00:42:10.448 INFO:tasks.workunit.client.0.smithi043.stderr: -477> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb513a530) adding con mode: crc 2024-09-12T00:42:10.448 INFO:tasks.workunit.client.0.smithi043.stderr: -476> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb513a530) adding con mode: crc 2024-09-12T00:42:10.448 INFO:tasks.workunit.client.0.smithi043.stderr: -475> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb513a530) adding con mode: secure 2024-09-12T00:42:10.448 INFO:tasks.workunit.client.0.smithi043.stderr: -474> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb513a530) adding con mode: crc 2024-09-12T00:42:10.448 INFO:tasks.workunit.client.0.smithi043.stderr: -473> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb513a530) adding con mode: secure 2024-09-12T00:42:10.448 INFO:tasks.workunit.client.0.smithi043.stderr: -472> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb513a530) adding con mode: crc 2024-09-12T00:42:10.449 INFO:tasks.workunit.client.0.smithi043.stderr: -471> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb513a530) adding con mode: secure 2024-09-12T00:42:10.449 INFO:tasks.workunit.client.0.smithi043.stderr: -470> 2024-09-12T00:42:10.314+0000 7fba92e189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:10.449 INFO:tasks.workunit.client.0.smithi043.stderr: -469> 2024-09-12T00:42:10.314+0000 7fba92e189c0 1 librados: starting msgr at 2024-09-12T00:42:10.449 INFO:tasks.workunit.client.0.smithi043.stderr: -468> 2024-09-12T00:42:10.314+0000 7fba92e189c0 1 librados: starting objecter 2024-09-12T00:42:10.449 INFO:tasks.workunit.client.0.smithi043.stderr: -467> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command objecter_requests hook 0x55aeb513c050 2024-09-12T00:42:10.449 INFO:tasks.workunit.client.0.smithi043.stderr: -466> 2024-09-12T00:42:10.314+0000 7fba92e189c0 1 librados: setting wanted keys 2024-09-12T00:42:10.449 INFO:tasks.workunit.client.0.smithi043.stderr: -465> 2024-09-12T00:42:10.314+0000 7fba92e189c0 1 librados: calling monclient init 2024-09-12T00:42:10.449 INFO:tasks.workunit.client.0.smithi043.stderr: -464> 2024-09-12T00:42:10.314+0000 7fba92e189c0 10 monclient: init 2024-09-12T00:42:10.449 INFO:tasks.workunit.client.0.smithi043.stderr: -463> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb5137450) adding auth protocol: cephx 2024-09-12T00:42:10.449 INFO:tasks.workunit.client.0.smithi043.stderr: -462> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb5137450) adding auth protocol: cephx 2024-09-12T00:42:10.449 INFO:tasks.workunit.client.0.smithi043.stderr: -461> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb5137450) adding auth protocol: cephx 2024-09-12T00:42:10.450 INFO:tasks.workunit.client.0.smithi043.stderr: -460> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb5137450) adding con mode: secure 2024-09-12T00:42:10.450 INFO:tasks.workunit.client.0.smithi043.stderr: -459> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb5137450) adding con mode: crc 2024-09-12T00:42:10.450 INFO:tasks.workunit.client.0.smithi043.stderr: -458> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb5137450) adding con mode: secure 2024-09-12T00:42:10.450 INFO:tasks.workunit.client.0.smithi043.stderr: -457> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb5137450) adding con mode: crc 2024-09-12T00:42:10.450 INFO:tasks.workunit.client.0.smithi043.stderr: -456> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb5137450) adding con mode: secure 2024-09-12T00:42:10.450 INFO:tasks.workunit.client.0.smithi043.stderr: -455> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb5137450) adding con mode: crc 2024-09-12T00:42:10.450 INFO:tasks.workunit.client.0.smithi043.stderr: -454> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb5137450) adding con mode: crc 2024-09-12T00:42:10.450 INFO:tasks.workunit.client.0.smithi043.stderr: -453> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb5137450) adding con mode: secure 2024-09-12T00:42:10.450 INFO:tasks.workunit.client.0.smithi043.stderr: -452> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb5137450) adding con mode: crc 2024-09-12T00:42:10.450 INFO:tasks.workunit.client.0.smithi043.stderr: -451> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb5137450) adding con mode: secure 2024-09-12T00:42:10.450 INFO:tasks.workunit.client.0.smithi043.stderr: -450> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb5137450) adding con mode: crc 2024-09-12T00:42:10.451 INFO:tasks.workunit.client.0.smithi043.stderr: -449> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb5137450) adding con mode: secure 2024-09-12T00:42:10.451 INFO:tasks.workunit.client.0.smithi043.stderr: -448> 2024-09-12T00:42:10.314+0000 7fba92e189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:10.451 INFO:tasks.workunit.client.0.smithi043.stderr: -447> 2024-09-12T00:42:10.314+0000 7fba92e189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:10.451 INFO:tasks.workunit.client.0.smithi043.stderr: -446> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command rotate-key hook 0x55aeb5137598 2024-09-12T00:42:10.451 INFO:tasks.workunit.client.0.smithi043.stderr: -445> 2024-09-12T00:42:10.314+0000 7fba92e189c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:10.451 INFO:tasks.workunit.client.0.smithi043.stderr: -444> 2024-09-12T00:42:10.314+0000 7fba92e189c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:42:10.451 INFO:tasks.workunit.client.0.smithi043.stderr: -443> 2024-09-12T00:42:10.314+0000 7fba92e189c0 10 monclient(hunting): picked mon.noname-c con 0x55aeb4fc2ad0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:42:10.451 INFO:tasks.workunit.client.0.smithi043.stderr: -442> 2024-09-12T00:42:10.314+0000 7fba92e189c0 10 monclient(hunting): picked mon.noname-a con 0x55aeb4fc3520 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:42:10.451 INFO:tasks.workunit.client.0.smithi043.stderr: -441> 2024-09-12T00:42:10.314+0000 7fba92e189c0 10 monclient(hunting): picked mon.noname-b con 0x55aeb4fc42c0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:42:10.451 INFO:tasks.workunit.client.0.smithi043.stderr: -440> 2024-09-12T00:42:10.314+0000 7fba92e189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:10.451 INFO:tasks.workunit.client.0.smithi043.stderr: -439> 2024-09-12T00:42:10.314+0000 7fba92e189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:10.452 INFO:tasks.workunit.client.0.smithi043.stderr: -438> 2024-09-12T00:42:10.314+0000 7fba92e189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:10.452 INFO:tasks.workunit.client.0.smithi043.stderr: -437> 2024-09-12T00:42:10.314+0000 7fba92e189c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:10.452 INFO:tasks.workunit.client.0.smithi043.stderr: -436> 2024-09-12T00:42:10.314+0000 7fba92e189c0 10 monclient(hunting): authenticate will time out at 2426.307953s 2024-09-12T00:42:10.452 INFO:tasks.workunit.client.0.smithi043.stderr: -435> 2024-09-12T00:42:10.318+0000 7fba9091e640 10 monclient(hunting): get_auth_request con 0x55aeb4fc2ad0 auth_method 0 2024-09-12T00:42:10.452 INFO:tasks.workunit.client.0.smithi043.stderr: -434> 2024-09-12T00:42:10.318+0000 7fba9091e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:10.452 INFO:tasks.workunit.client.0.smithi043.stderr: -433> 2024-09-12T00:42:10.318+0000 7fba9091e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:10.452 INFO:tasks.workunit.client.0.smithi043.stderr: -432> 2024-09-12T00:42:10.318+0000 7fba9091e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:10.452 INFO:tasks.workunit.client.0.smithi043.stderr: -431> 2024-09-12T00:42:10.318+0000 7fba9011d640 10 monclient(hunting): get_auth_request con 0x55aeb4fc3520 auth_method 0 2024-09-12T00:42:10.452 INFO:tasks.workunit.client.0.smithi043.stderr: -430> 2024-09-12T00:42:10.318+0000 7fba9011d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:10.452 INFO:tasks.workunit.client.0.smithi043.stderr: -429> 2024-09-12T00:42:10.318+0000 7fba9011d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:10.453 INFO:tasks.workunit.client.0.smithi043.stderr: -428> 2024-09-12T00:42:10.318+0000 7fba9011d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:10.453 INFO:tasks.workunit.client.0.smithi043.stderr: -427> 2024-09-12T00:42:10.318+0000 7fba9091e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:10.453 INFO:tasks.workunit.client.0.smithi043.stderr: -426> 2024-09-12T00:42:10.318+0000 7fba9091e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:10.453 INFO:tasks.workunit.client.0.smithi043.stderr: -425> 2024-09-12T00:42:10.318+0000 7fba9091e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:10.453 INFO:tasks.workunit.client.0.smithi043.stderr: -424> 2024-09-12T00:42:10.318+0000 7fba9011d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:10.453 INFO:tasks.workunit.client.0.smithi043.stderr: -423> 2024-09-12T00:42:10.318+0000 7fba9011d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:10.453 INFO:tasks.workunit.client.0.smithi043.stderr: -422> 2024-09-12T00:42:10.318+0000 7fba9011d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:10.453 INFO:tasks.workunit.client.0.smithi043.stderr: -421> 2024-09-12T00:42:10.318+0000 7fba9111f640 10 monclient(hunting): get_auth_request con 0x55aeb4fc42c0 auth_method 0 2024-09-12T00:42:10.453 INFO:tasks.workunit.client.0.smithi043.stderr: -420> 2024-09-12T00:42:10.318+0000 7fba9111f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:10.453 INFO:tasks.workunit.client.0.smithi043.stderr: -419> 2024-09-12T00:42:10.318+0000 7fba9111f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:10.453 INFO:tasks.workunit.client.0.smithi043.stderr: -418> 2024-09-12T00:42:10.318+0000 7fba9111f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:10.454 INFO:tasks.workunit.client.0.smithi043.stderr: -417> 2024-09-12T00:42:10.318+0000 7fba9091e640 10 monclient(hunting): handle_auth_done global_id 7817 payload 824 2024-09-12T00:42:10.454 INFO:tasks.workunit.client.0.smithi043.stderr: -416> 2024-09-12T00:42:10.318+0000 7fba9091e640 10 monclient: _finish_hunting 0 2024-09-12T00:42:10.454 INFO:tasks.workunit.client.0.smithi043.stderr: -415> 2024-09-12T00:42:10.318+0000 7fba9091e640 1 monclient: found mon.noname-c 2024-09-12T00:42:10.454 INFO:tasks.workunit.client.0.smithi043.stderr: -414> 2024-09-12T00:42:10.318+0000 7fba9091e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:42:10.454 INFO:tasks.workunit.client.0.smithi043.stderr: -413> 2024-09-12T00:42:10.318+0000 7fb97d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:10.454 INFO:tasks.workunit.client.0.smithi043.stderr: -412> 2024-09-12T00:42:10.318+0000 7fb97d60a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:42:10.454 INFO:tasks.workunit.client.0.smithi043.stderr: -411> 2024-09-12T00:42:10.318+0000 7fb97d60a640 10 monclient: dump: 2024-09-12T00:42:10.454 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:10.454 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:10.454 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.455 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.455 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:10.455 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:10.455 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:10.455 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:10.455 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:10.455 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.455 INFO:tasks.workunit.client.0.smithi043.stderr: -410> 2024-09-12T00:42:10.318+0000 7fb97d60a640 10 monclient: _finish_auth 0 2024-09-12T00:42:10.455 INFO:tasks.workunit.client.0.smithi043.stderr: -409> 2024-09-12T00:42:10.318+0000 7fb97d60a640 10 monclient: _check_auth_tickets 2024-09-12T00:42:10.455 INFO:tasks.workunit.client.0.smithi043.stderr: -408> 2024-09-12T00:42:10.318+0000 7fb97d60a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:10.455 INFO:tasks.workunit.client.0.smithi043.stderr: -407> 2024-09-12T00:42:10.318+0000 7fb97d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:10.455 INFO:tasks.workunit.client.0.smithi043.stderr: -406> 2024-09-12T00:42:10.318+0000 7fb97d60a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:42:10.456 INFO:tasks.workunit.client.0.smithi043.stderr: -405> 2024-09-12T00:42:10.318+0000 7fb97d60a640 10 monclient: dump: 2024-09-12T00:42:10.456 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:10.456 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:10.456 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.456 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.456 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:10.456 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:10.456 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:10.456 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:10.456 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:10.456 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.457 INFO:tasks.workunit.client.0.smithi043.stderr: -404> 2024-09-12T00:42:10.318+0000 7fba92e189c0 5 monclient: authenticate success, global_id 7817 2024-09-12T00:42:10.457 INFO:tasks.workunit.client.0.smithi043.stderr: -403> 2024-09-12T00:42:10.318+0000 7fba92e189c0 10 monclient: _renew_subs 2024-09-12T00:42:10.457 INFO:tasks.workunit.client.0.smithi043.stderr: -402> 2024-09-12T00:42:10.318+0000 7fba92e189c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:42:10.457 INFO:tasks.workunit.client.0.smithi043.stderr: -401> 2024-09-12T00:42:10.318+0000 7fb97ee0d640 4 set_mon_vals no callback set 2024-09-12T00:42:10.457 INFO:tasks.workunit.client.0.smithi043.stderr: -400> 2024-09-12T00:42:10.318+0000 7fba92e189c0 10 monclient: _renew_subs 2024-09-12T00:42:10.457 INFO:tasks.workunit.client.0.smithi043.stderr: -399> 2024-09-12T00:42:10.318+0000 7fba92e189c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:42:10.457 INFO:tasks.workunit.client.0.smithi043.stderr: -398> 2024-09-12T00:42:10.318+0000 7fba92e189c0 1 librados: init done 2024-09-12T00:42:10.457 INFO:tasks.workunit.client.0.smithi043.stderr: -397> 2024-09-12T00:42:10.318+0000 7fb97d60a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:10.457 INFO:tasks.workunit.client.0.smithi043.stderr: -396> 2024-09-12T00:42:10.318+0000 7fb97d60a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:42:10.457 INFO:tasks.workunit.client.0.smithi043.stderr: -395> 2024-09-12T00:42:10.318+0000 7fb97d60a640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:42:10.457 INFO:tasks.workunit.client.0.smithi043.stderr: -394> 2024-09-12T00:42:10.318+0000 7fba9011d640 10 monclient: get_auth_request con 0x7fb978070ae0 auth_method 0 2024-09-12T00:42:10.458 INFO:tasks.workunit.client.0.smithi043.stderr: -393> 2024-09-12T00:42:10.318+0000 7fba9111f640 10 monclient: get_auth_request con 0x55aeb5169e80 auth_method 0 2024-09-12T00:42:10.458 INFO:tasks.workunit.client.0.smithi043.stderr: -392> 2024-09-12T00:42:10.322+0000 7fba9091e640 10 monclient: get_auth_request con 0x55aeb5181d10 auth_method 0 2024-09-12T00:42:10.458 INFO:tasks.workunit.client.0.smithi043.stderr: -391> 2024-09-12T00:42:10.322+0000 7fba9011d640 10 monclient: get_auth_request con 0x55aeb5186070 auth_method 0 2024-09-12T00:42:10.458 INFO:tasks.workunit.client.0.smithi043.stderr: -390> 2024-09-12T00:42:10.322+0000 7fba92e189c0 10 monclient: build_initial_monmap 2024-09-12T00:42:10.458 INFO:tasks.workunit.client.0.smithi043.stderr: -389> 2024-09-12T00:42:10.322+0000 7fba92e189c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:10.458 INFO:tasks.workunit.client.0.smithi043.stderr: -388> 2024-09-12T00:42:10.322+0000 7fba92e189c0 10 monclient: monmap: 2024-09-12T00:42:10.458 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:42:10.458 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:10.458 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:42:10.458 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:42:10.458 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:10.459 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:10.459 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:42:10.459 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:42:10.459 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:42:10.459 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.459 INFO:tasks.workunit.client.0.smithi043.stderr: -387> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb518aea0) adding auth protocol: cephx 2024-09-12T00:42:10.459 INFO:tasks.workunit.client.0.smithi043.stderr: -386> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb518aea0) adding auth protocol: cephx 2024-09-12T00:42:10.459 INFO:tasks.workunit.client.0.smithi043.stderr: -385> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb518aea0) adding auth protocol: cephx 2024-09-12T00:42:10.459 INFO:tasks.workunit.client.0.smithi043.stderr: -384> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb518aea0) adding con mode: secure 2024-09-12T00:42:10.459 INFO:tasks.workunit.client.0.smithi043.stderr: -383> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb518aea0) adding con mode: crc 2024-09-12T00:42:10.459 INFO:tasks.workunit.client.0.smithi043.stderr: -382> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb518aea0) adding con mode: secure 2024-09-12T00:42:10.460 INFO:tasks.workunit.client.0.smithi043.stderr: -381> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb518aea0) adding con mode: crc 2024-09-12T00:42:10.460 INFO:tasks.workunit.client.0.smithi043.stderr: -380> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb518aea0) adding con mode: secure 2024-09-12T00:42:10.460 INFO:tasks.workunit.client.0.smithi043.stderr: -379> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb518aea0) adding con mode: crc 2024-09-12T00:42:10.460 INFO:tasks.workunit.client.0.smithi043.stderr: -378> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb518aea0) adding con mode: crc 2024-09-12T00:42:10.460 INFO:tasks.workunit.client.0.smithi043.stderr: -377> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb518aea0) adding con mode: secure 2024-09-12T00:42:10.460 INFO:tasks.workunit.client.0.smithi043.stderr: -376> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb518aea0) adding con mode: crc 2024-09-12T00:42:10.460 INFO:tasks.workunit.client.0.smithi043.stderr: -375> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb518aea0) adding con mode: secure 2024-09-12T00:42:10.460 INFO:tasks.workunit.client.0.smithi043.stderr: -374> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb518aea0) adding con mode: crc 2024-09-12T00:42:10.460 INFO:tasks.workunit.client.0.smithi043.stderr: -373> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb518aea0) adding con mode: secure 2024-09-12T00:42:10.460 INFO:tasks.workunit.client.0.smithi043.stderr: -372> 2024-09-12T00:42:10.326+0000 7fba92e189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:10.460 INFO:tasks.workunit.client.0.smithi043.stderr: -371> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55aeb518e7c0 EEXIST 2024-09-12T00:42:10.461 INFO:tasks.workunit.client.0.smithi043.stderr: -370> 2024-09-12T00:42:10.326+0000 7fba92e189c0 10 monclient: init 2024-09-12T00:42:10.461 INFO:tasks.workunit.client.0.smithi043.stderr: -369> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51894c8) adding auth protocol: cephx 2024-09-12T00:42:10.461 INFO:tasks.workunit.client.0.smithi043.stderr: -368> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51894c8) adding auth protocol: cephx 2024-09-12T00:42:10.461 INFO:tasks.workunit.client.0.smithi043.stderr: -367> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51894c8) adding auth protocol: cephx 2024-09-12T00:42:10.461 INFO:tasks.workunit.client.0.smithi043.stderr: -366> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51894c8) adding con mode: secure 2024-09-12T00:42:10.461 INFO:tasks.workunit.client.0.smithi043.stderr: -365> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51894c8) adding con mode: crc 2024-09-12T00:42:10.461 INFO:tasks.workunit.client.0.smithi043.stderr: -364> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51894c8) adding con mode: secure 2024-09-12T00:42:10.461 INFO:tasks.workunit.client.0.smithi043.stderr: -363> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51894c8) adding con mode: crc 2024-09-12T00:42:10.461 INFO:tasks.workunit.client.0.smithi043.stderr: -362> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51894c8) adding con mode: secure 2024-09-12T00:42:10.461 INFO:tasks.workunit.client.0.smithi043.stderr: -361> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51894c8) adding con mode: crc 2024-09-12T00:42:10.461 INFO:tasks.workunit.client.0.smithi043.stderr: -360> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51894c8) adding con mode: crc 2024-09-12T00:42:10.461 INFO:tasks.workunit.client.0.smithi043.stderr: -359> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51894c8) adding con mode: secure 2024-09-12T00:42:10.462 INFO:tasks.workunit.client.0.smithi043.stderr: -358> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51894c8) adding con mode: crc 2024-09-12T00:42:10.462 INFO:tasks.workunit.client.0.smithi043.stderr: -357> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51894c8) adding con mode: secure 2024-09-12T00:42:10.462 INFO:tasks.workunit.client.0.smithi043.stderr: -356> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51894c8) adding con mode: crc 2024-09-12T00:42:10.462 INFO:tasks.workunit.client.0.smithi043.stderr: -355> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51894c8) adding con mode: secure 2024-09-12T00:42:10.462 INFO:tasks.workunit.client.0.smithi043.stderr: -354> 2024-09-12T00:42:10.326+0000 7fba92e189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:10.462 INFO:tasks.workunit.client.0.smithi043.stderr: -353> 2024-09-12T00:42:10.326+0000 7fba92e189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:10.462 INFO:tasks.workunit.client.0.smithi043.stderr: -352> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command rotate-key cmddesc rotate-key hook 0x55aeb5189610 EEXIST 2024-09-12T00:42:10.462 INFO:tasks.workunit.client.0.smithi043.stderr: -351> 2024-09-12T00:42:10.326+0000 7fba92e189c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:10.462 INFO:tasks.workunit.client.0.smithi043.stderr: -350> 2024-09-12T00:42:10.326+0000 7fba92e189c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:42:10.464 INFO:tasks.workunit.client.0.smithi043.stderr: -349> 2024-09-12T00:42:10.326+0000 7fba92e189c0 10 monclient(hunting): picked mon.noname-c con 0x55aeb51b2970 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:42:10.464 INFO:tasks.workunit.client.0.smithi043.stderr: -348> 2024-09-12T00:42:10.326+0000 7fba92e189c0 10 monclient(hunting): picked mon.noname-b con 0x55aeb51b22a0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:42:10.464 INFO:tasks.workunit.client.0.smithi043.stderr: -347> 2024-09-12T00:42:10.326+0000 7fba92e189c0 10 monclient(hunting): picked mon.noname-a con 0x55aeb51b0c80 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:42:10.464 INFO:tasks.workunit.client.0.smithi043.stderr: -346> 2024-09-12T00:42:10.326+0000 7fba92e189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:10.464 INFO:tasks.workunit.client.0.smithi043.stderr: -345> 2024-09-12T00:42:10.326+0000 7fba92e189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:10.464 INFO:tasks.workunit.client.0.smithi043.stderr: -344> 2024-09-12T00:42:10.326+0000 7fba92e189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:10.464 INFO:tasks.workunit.client.0.smithi043.stderr: -343> 2024-09-12T00:42:10.326+0000 7fba92e189c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:10.464 INFO:tasks.workunit.client.0.smithi043.stderr: -342> 2024-09-12T00:42:10.326+0000 7fba92e189c0 10 monclient(hunting): authenticate will time out at 2426.317190s 2024-09-12T00:42:10.465 INFO:tasks.workunit.client.0.smithi043.stderr: -341> 2024-09-12T00:42:10.326+0000 7fba9091e640 10 monclient(hunting): get_auth_request con 0x55aeb51b2970 auth_method 0 2024-09-12T00:42:10.465 INFO:tasks.workunit.client.0.smithi043.stderr: -340> 2024-09-12T00:42:10.326+0000 7fba9091e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:10.465 INFO:tasks.workunit.client.0.smithi043.stderr: -339> 2024-09-12T00:42:10.326+0000 7fba9091e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:10.465 INFO:tasks.workunit.client.0.smithi043.stderr: -338> 2024-09-12T00:42:10.326+0000 7fba9091e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:10.465 INFO:tasks.workunit.client.0.smithi043.stderr: -337> 2024-09-12T00:42:10.326+0000 7fba9111f640 10 monclient(hunting): get_auth_request con 0x55aeb51b0c80 auth_method 0 2024-09-12T00:42:10.465 INFO:tasks.workunit.client.0.smithi043.stderr: -336> 2024-09-12T00:42:10.326+0000 7fba9111f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:10.465 INFO:tasks.workunit.client.0.smithi043.stderr: -335> 2024-09-12T00:42:10.326+0000 7fba9111f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:10.465 INFO:tasks.workunit.client.0.smithi043.stderr: -334> 2024-09-12T00:42:10.326+0000 7fba9111f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:10.465 INFO:tasks.workunit.client.0.smithi043.stderr: -333> 2024-09-12T00:42:10.326+0000 7fba9091e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:10.465 INFO:tasks.workunit.client.0.smithi043.stderr: -332> 2024-09-12T00:42:10.326+0000 7fba9091e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:10.465 INFO:tasks.workunit.client.0.smithi043.stderr: -331> 2024-09-12T00:42:10.326+0000 7fba9091e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:10.465 INFO:tasks.workunit.client.0.smithi043.stderr: -330> 2024-09-12T00:42:10.326+0000 7fba9111f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:10.465 INFO:tasks.workunit.client.0.smithi043.stderr: -329> 2024-09-12T00:42:10.326+0000 7fba9111f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:10.466 INFO:tasks.workunit.client.0.smithi043.stderr: -328> 2024-09-12T00:42:10.326+0000 7fba9111f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:10.466 INFO:tasks.workunit.client.0.smithi043.stderr: -327> 2024-09-12T00:42:10.326+0000 7fba9011d640 10 monclient(hunting): get_auth_request con 0x55aeb51b22a0 auth_method 0 2024-09-12T00:42:10.466 INFO:tasks.workunit.client.0.smithi043.stderr: -326> 2024-09-12T00:42:10.326+0000 7fba9011d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:10.466 INFO:tasks.workunit.client.0.smithi043.stderr: -325> 2024-09-12T00:42:10.326+0000 7fba9011d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:10.466 INFO:tasks.workunit.client.0.smithi043.stderr: -324> 2024-09-12T00:42:10.326+0000 7fba9011d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:10.466 INFO:tasks.workunit.client.0.smithi043.stderr: -323> 2024-09-12T00:42:10.326+0000 7fba9091e640 10 monclient(hunting): handle_auth_done global_id 7820 payload 824 2024-09-12T00:42:10.466 INFO:tasks.workunit.client.0.smithi043.stderr: -322> 2024-09-12T00:42:10.326+0000 7fba9091e640 10 monclient: _finish_hunting 0 2024-09-12T00:42:10.466 INFO:tasks.workunit.client.0.smithi043.stderr: -321> 2024-09-12T00:42:10.326+0000 7fba9091e640 1 monclient: found mon.noname-c 2024-09-12T00:42:10.466 INFO:tasks.workunit.client.0.smithi043.stderr: -320> 2024-09-12T00:42:10.326+0000 7fba9091e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:42:10.466 INFO:tasks.workunit.client.0.smithi043.stderr: -319> 2024-09-12T00:42:10.326+0000 7fb9767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:10.466 INFO:tasks.workunit.client.0.smithi043.stderr: -318> 2024-09-12T00:42:10.326+0000 7fb9767fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:42:10.466 INFO:tasks.workunit.client.0.smithi043.stderr: -317> 2024-09-12T00:42:10.326+0000 7fb9767fc640 10 monclient: dump: 2024-09-12T00:42:10.466 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:10.467 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:10.467 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.467 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.467 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:10.467 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:10.467 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:10.467 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:10.467 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:10.467 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.467 INFO:tasks.workunit.client.0.smithi043.stderr: -316> 2024-09-12T00:42:10.326+0000 7fb9767fc640 10 monclient: _finish_auth 0 2024-09-12T00:42:10.468 INFO:tasks.workunit.client.0.smithi043.stderr: -315> 2024-09-12T00:42:10.326+0000 7fb9767fc640 10 monclient: _check_auth_tickets 2024-09-12T00:42:10.468 INFO:tasks.workunit.client.0.smithi043.stderr: -314> 2024-09-12T00:42:10.326+0000 7fb9767fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:10.468 INFO:tasks.workunit.client.0.smithi043.stderr: -313> 2024-09-12T00:42:10.326+0000 7fb9767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:10.468 INFO:tasks.workunit.client.0.smithi043.stderr: -312> 2024-09-12T00:42:10.326+0000 7fb9767fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:42:10.468 INFO:tasks.workunit.client.0.smithi043.stderr: -311> 2024-09-12T00:42:10.326+0000 7fb9767fc640 10 monclient: dump: 2024-09-12T00:42:10.468 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:10.468 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:10.468 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.468 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.468 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:10.468 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:10.468 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:10.469 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:10.469 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:10.469 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.469 INFO:tasks.workunit.client.0.smithi043.stderr: -310> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 monclient: authenticate success, global_id 7820 2024-09-12T00:42:10.469 INFO:tasks.workunit.client.0.smithi043.stderr: -309> 2024-09-12T00:42:10.326+0000 7fba91920640 4 set_mon_vals no callback set 2024-09-12T00:42:10.469 INFO:tasks.workunit.client.0.smithi043.stderr: -308> 2024-09-12T00:42:10.326+0000 7fba92e189c0 10 monclient: _renew_subs 2024-09-12T00:42:10.469 INFO:tasks.workunit.client.0.smithi043.stderr: -307> 2024-09-12T00:42:10.326+0000 7fba92e189c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:42:10.469 INFO:tasks.workunit.client.0.smithi043.stderr: -306> 2024-09-12T00:42:10.326+0000 7fba92e189c0 10 monclient: _renew_subs 2024-09-12T00:42:10.469 INFO:tasks.workunit.client.0.smithi043.stderr: -305> 2024-09-12T00:42:10.326+0000 7fba92e189c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:42:10.469 INFO:tasks.workunit.client.0.smithi043.stderr: -304> 2024-09-12T00:42:10.330+0000 7fb9767fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:10.469 INFO:tasks.workunit.client.0.smithi043.stderr: -303> 2024-09-12T00:42:10.330+0000 7fb9767fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:42:10.469 INFO:tasks.workunit.client.0.smithi043.stderr: -302> 2024-09-12T00:42:10.330+0000 7fb9767fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:42:10.469 INFO:tasks.workunit.client.0.smithi043.stderr: -301> 2024-09-12T00:42:10.330+0000 7fba9011d640 10 monclient: get_auth_request con 0x7fb968070a20 auth_method 0 2024-09-12T00:42:10.469 INFO:tasks.workunit.client.0.smithi043.stderr: -300> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient: get_monmap_and_config 2024-09-12T00:42:10.470 INFO:tasks.workunit.client.0.smithi043.stderr: -299> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient: build_initial_monmap 2024-09-12T00:42:10.470 INFO:tasks.workunit.client.0.smithi043.stderr: -298> 2024-09-12T00:42:10.330+0000 7fba92e189c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:10.470 INFO:tasks.workunit.client.0.smithi043.stderr: -297> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient: monmap: 2024-09-12T00:42:10.470 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:42:10.470 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:10.470 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:42:10.470 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:42:10.470 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:10.470 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:10.470 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:42:10.470 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:42:10.470 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:42:10.471 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.471 INFO:tasks.workunit.client.0.smithi043.stderr: -296> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51d1e80) adding auth protocol: cephx 2024-09-12T00:42:10.471 INFO:tasks.workunit.client.0.smithi043.stderr: -295> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51d1e80) adding auth protocol: cephx 2024-09-12T00:42:10.471 INFO:tasks.workunit.client.0.smithi043.stderr: -294> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51d1e80) adding auth protocol: cephx 2024-09-12T00:42:10.471 INFO:tasks.workunit.client.0.smithi043.stderr: -293> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51d1e80) adding con mode: secure 2024-09-12T00:42:10.471 INFO:tasks.workunit.client.0.smithi043.stderr: -292> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51d1e80) adding con mode: crc 2024-09-12T00:42:10.471 INFO:tasks.workunit.client.0.smithi043.stderr: -291> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51d1e80) adding con mode: secure 2024-09-12T00:42:10.471 INFO:tasks.workunit.client.0.smithi043.stderr: -290> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51d1e80) adding con mode: crc 2024-09-12T00:42:10.471 INFO:tasks.workunit.client.0.smithi043.stderr: -289> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51d1e80) adding con mode: secure 2024-09-12T00:42:10.471 INFO:tasks.workunit.client.0.smithi043.stderr: -288> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51d1e80) adding con mode: crc 2024-09-12T00:42:10.471 INFO:tasks.workunit.client.0.smithi043.stderr: -287> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51d1e80) adding con mode: crc 2024-09-12T00:42:10.471 INFO:tasks.workunit.client.0.smithi043.stderr: -286> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51d1e80) adding con mode: secure 2024-09-12T00:42:10.471 INFO:tasks.workunit.client.0.smithi043.stderr: -285> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51d1e80) adding con mode: crc 2024-09-12T00:42:10.472 INFO:tasks.workunit.client.0.smithi043.stderr: -284> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51d1e80) adding con mode: secure 2024-09-12T00:42:10.472 INFO:tasks.workunit.client.0.smithi043.stderr: -283> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51d1e80) adding con mode: crc 2024-09-12T00:42:10.472 INFO:tasks.workunit.client.0.smithi043.stderr: -282> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51d1e80) adding con mode: secure 2024-09-12T00:42:10.472 INFO:tasks.workunit.client.0.smithi043.stderr: -281> 2024-09-12T00:42:10.330+0000 7fba92e189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:10.472 INFO:tasks.workunit.client.0.smithi043.stderr: -280> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient: init 2024-09-12T00:42:10.472 INFO:tasks.workunit.client.0.smithi043.stderr: -279> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a200) adding auth protocol: cephx 2024-09-12T00:42:10.472 INFO:tasks.workunit.client.0.smithi043.stderr: -278> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a200) adding auth protocol: cephx 2024-09-12T00:42:10.472 INFO:tasks.workunit.client.0.smithi043.stderr: -277> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a200) adding auth protocol: cephx 2024-09-12T00:42:10.472 INFO:tasks.workunit.client.0.smithi043.stderr: -276> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a200) adding con mode: secure 2024-09-12T00:42:10.472 INFO:tasks.workunit.client.0.smithi043.stderr: -275> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a200) adding con mode: crc 2024-09-12T00:42:10.472 INFO:tasks.workunit.client.0.smithi043.stderr: -274> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a200) adding con mode: secure 2024-09-12T00:42:10.472 INFO:tasks.workunit.client.0.smithi043.stderr: -273> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a200) adding con mode: crc 2024-09-12T00:42:10.473 INFO:tasks.workunit.client.0.smithi043.stderr: -272> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a200) adding con mode: secure 2024-09-12T00:42:10.473 INFO:tasks.workunit.client.0.smithi043.stderr: -271> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a200) adding con mode: crc 2024-09-12T00:42:10.473 INFO:tasks.workunit.client.0.smithi043.stderr: -270> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a200) adding con mode: crc 2024-09-12T00:42:10.473 INFO:tasks.workunit.client.0.smithi043.stderr: -269> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a200) adding con mode: secure 2024-09-12T00:42:10.473 INFO:tasks.workunit.client.0.smithi043.stderr: -268> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a200) adding con mode: crc 2024-09-12T00:42:10.473 INFO:tasks.workunit.client.0.smithi043.stderr: -267> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a200) adding con mode: secure 2024-09-12T00:42:10.473 INFO:tasks.workunit.client.0.smithi043.stderr: -266> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a200) adding con mode: crc 2024-09-12T00:42:10.473 INFO:tasks.workunit.client.0.smithi043.stderr: -265> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a200) adding con mode: secure 2024-09-12T00:42:10.473 INFO:tasks.workunit.client.0.smithi043.stderr: -264> 2024-09-12T00:42:10.330+0000 7fba92e189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:10.473 INFO:tasks.workunit.client.0.smithi043.stderr: -263> 2024-09-12T00:42:10.330+0000 7fba92e189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:10.473 INFO:tasks.workunit.client.0.smithi043.stderr: -262> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe2a49a348 EEXIST 2024-09-12T00:42:10.473 INFO:tasks.workunit.client.0.smithi043.stderr: -261> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:10.473 INFO:tasks.workunit.client.0.smithi043.stderr: -260> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:42:10.473 INFO:tasks.workunit.client.0.smithi043.stderr: -259> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient(hunting): picked mon.noname-c con 0x55aeb5206360 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:42:10.474 INFO:tasks.workunit.client.0.smithi043.stderr: -258> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient(hunting): picked mon.noname-b con 0x55aeb51d5ed0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:42:10.474 INFO:tasks.workunit.client.0.smithi043.stderr: -257> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient(hunting): picked mon.noname-a con 0x55aeb51f6de0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:42:10.474 INFO:tasks.workunit.client.0.smithi043.stderr: -256> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:10.474 INFO:tasks.workunit.client.0.smithi043.stderr: -255> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:10.474 INFO:tasks.workunit.client.0.smithi043.stderr: -254> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:10.474 INFO:tasks.workunit.client.0.smithi043.stderr: -253> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:10.474 INFO:tasks.workunit.client.0.smithi043.stderr: -252> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient(hunting): authenticate will time out at 2426.321638s 2024-09-12T00:42:10.474 INFO:tasks.workunit.client.0.smithi043.stderr: -251> 2024-09-12T00:42:10.330+0000 7fba9111f640 10 monclient(hunting): get_auth_request con 0x55aeb51f6de0 auth_method 0 2024-09-12T00:42:10.474 INFO:tasks.workunit.client.0.smithi043.stderr: -250> 2024-09-12T00:42:10.330+0000 7fba9111f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:10.474 INFO:tasks.workunit.client.0.smithi043.stderr: -249> 2024-09-12T00:42:10.330+0000 7fba9111f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:10.474 INFO:tasks.workunit.client.0.smithi043.stderr: -248> 2024-09-12T00:42:10.330+0000 7fba9111f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:10.474 INFO:tasks.workunit.client.0.smithi043.stderr: -247> 2024-09-12T00:42:10.330+0000 7fba9091e640 10 monclient(hunting): get_auth_request con 0x55aeb5206360 auth_method 0 2024-09-12T00:42:10.475 INFO:tasks.workunit.client.0.smithi043.stderr: -246> 2024-09-12T00:42:10.330+0000 7fba9091e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:10.475 INFO:tasks.workunit.client.0.smithi043.stderr: -245> 2024-09-12T00:42:10.330+0000 7fba9091e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:10.475 INFO:tasks.workunit.client.0.smithi043.stderr: -244> 2024-09-12T00:42:10.330+0000 7fba9091e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:10.475 INFO:tasks.workunit.client.0.smithi043.stderr: -243> 2024-09-12T00:42:10.330+0000 7fba9111f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:10.475 INFO:tasks.workunit.client.0.smithi043.stderr: -242> 2024-09-12T00:42:10.330+0000 7fba9111f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:10.475 INFO:tasks.workunit.client.0.smithi043.stderr: -241> 2024-09-12T00:42:10.330+0000 7fba9111f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:10.475 INFO:tasks.workunit.client.0.smithi043.stderr: -240> 2024-09-12T00:42:10.330+0000 7fba9091e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:10.475 INFO:tasks.workunit.client.0.smithi043.stderr: -239> 2024-09-12T00:42:10.330+0000 7fba9091e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:10.475 INFO:tasks.workunit.client.0.smithi043.stderr: -238> 2024-09-12T00:42:10.330+0000 7fba9091e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:10.475 INFO:tasks.workunit.client.0.smithi043.stderr: -237> 2024-09-12T00:42:10.330+0000 7fba9011d640 10 monclient(hunting): get_auth_request con 0x55aeb51d5ed0 auth_method 0 2024-09-12T00:42:10.475 INFO:tasks.workunit.client.0.smithi043.stderr: -236> 2024-09-12T00:42:10.330+0000 7fba9011d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:10.475 INFO:tasks.workunit.client.0.smithi043.stderr: -235> 2024-09-12T00:42:10.330+0000 7fba9011d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:10.475 INFO:tasks.workunit.client.0.smithi043.stderr: -234> 2024-09-12T00:42:10.330+0000 7fba9011d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:10.476 INFO:tasks.workunit.client.0.smithi043.stderr: -233> 2024-09-12T00:42:10.330+0000 7fba9111f640 10 monclient(hunting): handle_auth_done global_id 8223 payload 274 2024-09-12T00:42:10.476 INFO:tasks.workunit.client.0.smithi043.stderr: -232> 2024-09-12T00:42:10.330+0000 7fba9111f640 10 monclient: _finish_hunting 0 2024-09-12T00:42:10.476 INFO:tasks.workunit.client.0.smithi043.stderr: -231> 2024-09-12T00:42:10.330+0000 7fba9111f640 1 monclient: found mon.noname-a 2024-09-12T00:42:10.476 INFO:tasks.workunit.client.0.smithi043.stderr: -230> 2024-09-12T00:42:10.330+0000 7fba9111f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:42:10.476 INFO:tasks.workunit.client.0.smithi043.stderr: -229> 2024-09-12T00:42:10.330+0000 7fb967fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:10.476 INFO:tasks.workunit.client.0.smithi043.stderr: -228> 2024-09-12T00:42:10.330+0000 7fb967fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:10.476 INFO:tasks.workunit.client.0.smithi043.stderr: -227> 2024-09-12T00:42:10.330+0000 7fb967fff640 10 monclient: dump: 2024-09-12T00:42:10.476 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:10.476 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:10.476 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.476 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.476 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:10.476 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:10.477 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:10.477 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:10.477 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:10.477 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.477 INFO:tasks.workunit.client.0.smithi043.stderr: -226> 2024-09-12T00:42:10.330+0000 7fb967fff640 10 monclient: _finish_auth 0 2024-09-12T00:42:10.477 INFO:tasks.workunit.client.0.smithi043.stderr: -225> 2024-09-12T00:42:10.330+0000 7fb967fff640 10 monclient: _check_auth_tickets 2024-09-12T00:42:10.477 INFO:tasks.workunit.client.0.smithi043.stderr: -224> 2024-09-12T00:42:10.330+0000 7fb967fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:10.477 INFO:tasks.workunit.client.0.smithi043.stderr: -223> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 monclient: authenticate success, global_id 8223 2024-09-12T00:42:10.477 INFO:tasks.workunit.client.0.smithi043.stderr: -222> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient: get_monmap_and_config success 2024-09-12T00:42:10.477 INFO:tasks.workunit.client.0.smithi043.stderr: -221> 2024-09-12T00:42:10.330+0000 7fba92e189c0 4 set_mon_vals no callback set 2024-09-12T00:42:10.477 INFO:tasks.workunit.client.0.smithi043.stderr: -220> 2024-09-12T00:42:10.330+0000 7fb967fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:10.477 INFO:tasks.workunit.client.0.smithi043.stderr: -219> 2024-09-12T00:42:10.330+0000 7fb967fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:10.477 INFO:tasks.workunit.client.0.smithi043.stderr: -218> 2024-09-12T00:42:10.330+0000 7fb967fff640 10 monclient: dump: 2024-09-12T00:42:10.478 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:10.478 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:10.478 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.478 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.478 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:10.478 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:10.478 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:10.478 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:10.478 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:10.478 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.478 INFO:tasks.workunit.client.0.smithi043.stderr: -217> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient: shutdown 2024-09-12T00:42:10.478 INFO:tasks.workunit.client.0.smithi043.stderr: -216> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient: build_initial_monmap 2024-09-12T00:42:10.479 INFO:tasks.workunit.client.0.smithi043.stderr: -215> 2024-09-12T00:42:10.330+0000 7fba92e189c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:10.479 INFO:tasks.workunit.client.0.smithi043.stderr: -214> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient: monmap: 2024-09-12T00:42:10.479 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:42:10.479 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:10.479 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:42:10.479 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:42:10.479 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:10.479 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:10.479 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:42:10.479 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:42:10.479 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:42:10.479 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.479 INFO:tasks.workunit.client.0.smithi043.stderr: -213> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb52025c0) adding auth protocol: cephx 2024-09-12T00:42:10.480 INFO:tasks.workunit.client.0.smithi043.stderr: -212> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb52025c0) adding auth protocol: cephx 2024-09-12T00:42:10.480 INFO:tasks.workunit.client.0.smithi043.stderr: -211> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb52025c0) adding auth protocol: cephx 2024-09-12T00:42:10.480 INFO:tasks.workunit.client.0.smithi043.stderr: -210> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb52025c0) adding con mode: secure 2024-09-12T00:42:10.480 INFO:tasks.workunit.client.0.smithi043.stderr: -209> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb52025c0) adding con mode: crc 2024-09-12T00:42:10.480 INFO:tasks.workunit.client.0.smithi043.stderr: -208> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb52025c0) adding con mode: secure 2024-09-12T00:42:10.480 INFO:tasks.workunit.client.0.smithi043.stderr: -207> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb52025c0) adding con mode: crc 2024-09-12T00:42:10.480 INFO:tasks.workunit.client.0.smithi043.stderr: -206> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb52025c0) adding con mode: secure 2024-09-12T00:42:10.480 INFO:tasks.workunit.client.0.smithi043.stderr: -205> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb52025c0) adding con mode: crc 2024-09-12T00:42:10.480 INFO:tasks.workunit.client.0.smithi043.stderr: -204> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb52025c0) adding con mode: crc 2024-09-12T00:42:10.480 INFO:tasks.workunit.client.0.smithi043.stderr: -203> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb52025c0) adding con mode: secure 2024-09-12T00:42:10.480 INFO:tasks.workunit.client.0.smithi043.stderr: -202> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb52025c0) adding con mode: crc 2024-09-12T00:42:10.480 INFO:tasks.workunit.client.0.smithi043.stderr: -201> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb52025c0) adding con mode: secure 2024-09-12T00:42:10.480 INFO:tasks.workunit.client.0.smithi043.stderr: -200> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb52025c0) adding con mode: crc 2024-09-12T00:42:10.481 INFO:tasks.workunit.client.0.smithi043.stderr: -199> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb52025c0) adding con mode: secure 2024-09-12T00:42:10.481 INFO:tasks.workunit.client.0.smithi043.stderr: -198> 2024-09-12T00:42:10.330+0000 7fba92e189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:10.481 INFO:tasks.workunit.client.0.smithi043.stderr: -197> 2024-09-12T00:42:10.330+0000 7fba92e189c0 1 librados: starting msgr at 2024-09-12T00:42:10.481 INFO:tasks.workunit.client.0.smithi043.stderr: -196> 2024-09-12T00:42:10.330+0000 7fba92e189c0 1 librados: starting objecter 2024-09-12T00:42:10.481 INFO:tasks.workunit.client.0.smithi043.stderr: -195> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55aeb5200180 EEXIST 2024-09-12T00:42:10.481 INFO:tasks.workunit.client.0.smithi043.stderr: -194> 2024-09-12T00:42:10.330+0000 7fba92e189c0 1 librados: setting wanted keys 2024-09-12T00:42:10.481 INFO:tasks.workunit.client.0.smithi043.stderr: -193> 2024-09-12T00:42:10.330+0000 7fba92e189c0 1 librados: calling monclient init 2024-09-12T00:42:10.481 INFO:tasks.workunit.client.0.smithi043.stderr: -192> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient: init 2024-09-12T00:42:10.481 INFO:tasks.workunit.client.0.smithi043.stderr: -191> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51b4790) adding auth protocol: cephx 2024-09-12T00:42:10.481 INFO:tasks.workunit.client.0.smithi043.stderr: -190> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51b4790) adding auth protocol: cephx 2024-09-12T00:42:10.481 INFO:tasks.workunit.client.0.smithi043.stderr: -189> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51b4790) adding auth protocol: cephx 2024-09-12T00:42:10.481 INFO:tasks.workunit.client.0.smithi043.stderr: -188> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51b4790) adding con mode: secure 2024-09-12T00:42:10.482 INFO:tasks.workunit.client.0.smithi043.stderr: -187> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51b4790) adding con mode: crc 2024-09-12T00:42:10.482 INFO:tasks.workunit.client.0.smithi043.stderr: -186> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51b4790) adding con mode: secure 2024-09-12T00:42:10.482 INFO:tasks.workunit.client.0.smithi043.stderr: -185> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51b4790) adding con mode: crc 2024-09-12T00:42:10.482 INFO:tasks.workunit.client.0.smithi043.stderr: -184> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51b4790) adding con mode: secure 2024-09-12T00:42:10.482 INFO:tasks.workunit.client.0.smithi043.stderr: -183> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51b4790) adding con mode: crc 2024-09-12T00:42:10.482 INFO:tasks.workunit.client.0.smithi043.stderr: -182> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51b4790) adding con mode: crc 2024-09-12T00:42:10.482 INFO:tasks.workunit.client.0.smithi043.stderr: -181> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51b4790) adding con mode: secure 2024-09-12T00:42:10.482 INFO:tasks.workunit.client.0.smithi043.stderr: -180> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51b4790) adding con mode: crc 2024-09-12T00:42:10.482 INFO:tasks.workunit.client.0.smithi043.stderr: -179> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51b4790) adding con mode: secure 2024-09-12T00:42:10.482 INFO:tasks.workunit.client.0.smithi043.stderr: -178> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51b4790) adding con mode: crc 2024-09-12T00:42:10.482 INFO:tasks.workunit.client.0.smithi043.stderr: -177> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51b4790) adding con mode: secure 2024-09-12T00:42:10.482 INFO:tasks.workunit.client.0.smithi043.stderr: -176> 2024-09-12T00:42:10.330+0000 7fba92e189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:10.483 INFO:tasks.workunit.client.0.smithi043.stderr: -175> 2024-09-12T00:42:10.334+0000 7fba92e189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:10.483 INFO:tasks.workunit.client.0.smithi043.stderr: -174> 2024-09-12T00:42:10.334+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command rotate-key cmddesc rotate-key hook 0x55aeb51b48d8 EEXIST 2024-09-12T00:42:10.483 INFO:tasks.workunit.client.0.smithi043.stderr: -173> 2024-09-12T00:42:10.334+0000 7fba92e189c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:10.483 INFO:tasks.workunit.client.0.smithi043.stderr: -172> 2024-09-12T00:42:10.334+0000 7fba92e189c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:42:10.483 INFO:tasks.workunit.client.0.smithi043.stderr: -171> 2024-09-12T00:42:10.334+0000 7fba92e189c0 10 monclient(hunting): picked mon.noname-c con 0x55aeb51d5ed0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:42:10.483 INFO:tasks.workunit.client.0.smithi043.stderr: -170> 2024-09-12T00:42:10.334+0000 7fba92e189c0 10 monclient(hunting): picked mon.noname-a con 0x55aeb51f6de0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:42:10.483 INFO:tasks.workunit.client.0.smithi043.stderr: -169> 2024-09-12T00:42:10.334+0000 7fba92e189c0 10 monclient(hunting): picked mon.noname-b con 0x55aeb5206360 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:42:10.483 INFO:tasks.workunit.client.0.smithi043.stderr: -168> 2024-09-12T00:42:10.334+0000 7fba92e189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:10.483 INFO:tasks.workunit.client.0.smithi043.stderr: -167> 2024-09-12T00:42:10.334+0000 7fba92e189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:10.483 INFO:tasks.workunit.client.0.smithi043.stderr: -166> 2024-09-12T00:42:10.334+0000 7fba92e189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:10.483 INFO:tasks.workunit.client.0.smithi043.stderr: -165> 2024-09-12T00:42:10.334+0000 7fba92e189c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:10.483 INFO:tasks.workunit.client.0.smithi043.stderr: -164> 2024-09-12T00:42:10.334+0000 7fba92e189c0 10 monclient(hunting): authenticate will time out at 2426.324349s 2024-09-12T00:42:10.483 INFO:tasks.workunit.client.0.smithi043.stderr: -163> 2024-09-12T00:42:10.334+0000 7fba9091e640 10 monclient(hunting): get_auth_request con 0x55aeb51d5ed0 auth_method 0 2024-09-12T00:42:10.484 INFO:tasks.workunit.client.0.smithi043.stderr: -162> 2024-09-12T00:42:10.334+0000 7fba9091e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:10.484 INFO:tasks.workunit.client.0.smithi043.stderr: -161> 2024-09-12T00:42:10.334+0000 7fba9091e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:10.484 INFO:tasks.workunit.client.0.smithi043.stderr: -160> 2024-09-12T00:42:10.334+0000 7fba9091e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:10.484 INFO:tasks.workunit.client.0.smithi043.stderr: -159> 2024-09-12T00:42:10.334+0000 7fba9011d640 10 monclient(hunting): get_auth_request con 0x55aeb51f6de0 auth_method 0 2024-09-12T00:42:10.484 INFO:tasks.workunit.client.0.smithi043.stderr: -158> 2024-09-12T00:42:10.334+0000 7fba9011d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:10.484 INFO:tasks.workunit.client.0.smithi043.stderr: -157> 2024-09-12T00:42:10.334+0000 7fba9011d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:10.484 INFO:tasks.workunit.client.0.smithi043.stderr: -156> 2024-09-12T00:42:10.334+0000 7fba9011d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:10.484 INFO:tasks.workunit.client.0.smithi043.stderr: -155> 2024-09-12T00:42:10.334+0000 7fba9091e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:10.484 INFO:tasks.workunit.client.0.smithi043.stderr: -154> 2024-09-12T00:42:10.334+0000 7fba9091e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:10.484 INFO:tasks.workunit.client.0.smithi043.stderr: -153> 2024-09-12T00:42:10.334+0000 7fba9091e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:10.484 INFO:tasks.workunit.client.0.smithi043.stderr: -152> 2024-09-12T00:42:10.334+0000 7fba9011d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:10.484 INFO:tasks.workunit.client.0.smithi043.stderr: -151> 2024-09-12T00:42:10.334+0000 7fba9011d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:10.484 INFO:tasks.workunit.client.0.smithi043.stderr: -150> 2024-09-12T00:42:10.334+0000 7fba9011d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:10.485 INFO:tasks.workunit.client.0.smithi043.stderr: -149> 2024-09-12T00:42:10.334+0000 7fba9091e640 10 monclient(hunting): handle_auth_done global_id 7826 payload 824 2024-09-12T00:42:10.485 INFO:tasks.workunit.client.0.smithi043.stderr: -148> 2024-09-12T00:42:10.334+0000 7fba9091e640 10 monclient: _finish_hunting 0 2024-09-12T00:42:10.485 INFO:tasks.workunit.client.0.smithi043.stderr: -147> 2024-09-12T00:42:10.334+0000 7fba9091e640 1 monclient: found mon.noname-c 2024-09-12T00:42:10.485 INFO:tasks.workunit.client.0.smithi043.stderr: -146> 2024-09-12T00:42:10.334+0000 7fba9091e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:42:10.485 INFO:tasks.workunit.client.0.smithi043.stderr: -145> 2024-09-12T00:42:10.334+0000 7fba9111f640 10 monclient: get_auth_request con 0x55aeb5206360 auth_method 0 2024-09-12T00:42:10.485 INFO:tasks.workunit.client.0.smithi043.stderr: -144> 2024-09-12T00:42:10.334+0000 7fb9667fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:10.485 INFO:tasks.workunit.client.0.smithi043.stderr: -143> 2024-09-12T00:42:10.334+0000 7fb9667fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:42:10.485 INFO:tasks.workunit.client.0.smithi043.stderr: -142> 2024-09-12T00:42:10.334+0000 7fb9667fc640 10 monclient: dump: 2024-09-12T00:42:10.485 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:10.485 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:10.485 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.485 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.485 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:10.486 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:10.486 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:10.486 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:10.486 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:10.486 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.486 INFO:tasks.workunit.client.0.smithi043.stderr: -141> 2024-09-12T00:42:10.334+0000 7fb9667fc640 10 monclient: _finish_auth 0 2024-09-12T00:42:10.486 INFO:tasks.workunit.client.0.smithi043.stderr: -140> 2024-09-12T00:42:10.334+0000 7fb9667fc640 10 monclient: _check_auth_tickets 2024-09-12T00:42:10.486 INFO:tasks.workunit.client.0.smithi043.stderr: -139> 2024-09-12T00:42:10.334+0000 7fb9667fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:10.486 INFO:tasks.workunit.client.0.smithi043.stderr: -138> 2024-09-12T00:42:10.334+0000 7fb9667fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:10.486 INFO:tasks.workunit.client.0.smithi043.stderr: -137> 2024-09-12T00:42:10.334+0000 7fb9667fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:42:10.486 INFO:tasks.workunit.client.0.smithi043.stderr: -136> 2024-09-12T00:42:10.334+0000 7fb9667fc640 10 monclient: dump: 2024-09-12T00:42:10.486 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:10.486 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:10.487 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.487 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.487 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:10.487 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:10.487 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:10.487 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:10.487 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:10.487 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.487 INFO:tasks.workunit.client.0.smithi043.stderr: -135> 2024-09-12T00:42:10.334+0000 7fb967fff640 4 set_mon_vals no callback set 2024-09-12T00:42:10.487 INFO:tasks.workunit.client.0.smithi043.stderr: -134> 2024-09-12T00:42:10.334+0000 7fba92e189c0 5 monclient: authenticate success, global_id 7826 2024-09-12T00:42:10.487 INFO:tasks.workunit.client.0.smithi043.stderr: -133> 2024-09-12T00:42:10.334+0000 7fba92e189c0 10 monclient: _renew_subs 2024-09-12T00:42:10.487 INFO:tasks.workunit.client.0.smithi043.stderr: -132> 2024-09-12T00:42:10.334+0000 7fba92e189c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:42:10.487 INFO:tasks.workunit.client.0.smithi043.stderr: -131> 2024-09-12T00:42:10.334+0000 7fba92e189c0 10 monclient: _renew_subs 2024-09-12T00:42:10.488 INFO:tasks.workunit.client.0.smithi043.stderr: -130> 2024-09-12T00:42:10.334+0000 7fba92e189c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:42:10.488 INFO:tasks.workunit.client.0.smithi043.stderr: -129> 2024-09-12T00:42:10.334+0000 7fba92e189c0 1 librados: init done 2024-09-12T00:42:10.488 INFO:tasks.workunit.client.0.smithi043.stderr: -128> 2024-09-12T00:42:10.334+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command cr dump hook 0x55aeb51f7998 2024-09-12T00:42:10.488 INFO:tasks.workunit.client.0.smithi043.stderr: -127> 2024-09-12T00:42:10.334+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.488 INFO:tasks.workunit.client.0.smithi043.stderr: -126> 2024-09-12T00:42:10.334+0000 7fb9667fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:10.488 INFO:tasks.workunit.client.0.smithi043.stderr: -125> 2024-09-12T00:42:10.334+0000 7fb9667fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:42:10.488 INFO:tasks.workunit.client.0.smithi043.stderr: -124> 2024-09-12T00:42:10.334+0000 7fb9667fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:42:10.488 INFO:tasks.workunit.client.0.smithi043.stderr: -123> 2024-09-12T00:42:10.338+0000 7fba9011d640 10 monclient: get_auth_request con 0x7fb95c070ba0 auth_method 0 2024-09-12T00:42:10.488 INFO:tasks.workunit.client.0.smithi043.stderr: -122> 2024-09-12T00:42:10.338+0000 7fba9111f640 10 monclient: get_auth_request con 0x55aeb521fc20 auth_method 0 2024-09-12T00:42:10.488 INFO:tasks.workunit.client.0.smithi043.stderr: -121> 2024-09-12T00:42:10.338+0000 7fba92e189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:10.488 INFO:tasks.workunit.client.0.smithi043.stderr: -120> 2024-09-12T00:42:10.338+0000 7fba92e189c0 20 realm 2024-09-12T00:42:10.488 INFO:tasks.workunit.client.0.smithi043.stderr: -119> 2024-09-12T00:42:10.338+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.489 INFO:tasks.workunit.client.0.smithi043.stderr: -118> 2024-09-12T00:42:10.338+0000 7fba92e189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:10.489 INFO:tasks.workunit.client.0.smithi043.stderr: -117> 2024-09-12T00:42:10.338+0000 7fba92e189c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:10.489 INFO:tasks.workunit.client.0.smithi043.stderr: -116> 2024-09-12T00:42:10.338+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.489 INFO:tasks.workunit.client.0.smithi043.stderr: -115> 2024-09-12T00:42:10.338+0000 7fba92e189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:10.489 INFO:tasks.workunit.client.0.smithi043.stderr: -114> 2024-09-12T00:42:10.338+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.489 INFO:tasks.workunit.client.0.smithi043.stderr: -113> 2024-09-12T00:42:10.338+0000 7fba9091e640 10 monclient: get_auth_request con 0x55aeb5223ee0 auth_method 0 2024-09-12T00:42:10.489 INFO:tasks.workunit.client.0.smithi043.stderr: -112> 2024-09-12T00:42:10.338+0000 7fba92e189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:10.489 INFO:tasks.workunit.client.0.smithi043.stderr: -111> 2024-09-12T00:42:10.338+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.489 INFO:tasks.workunit.client.0.smithi043.stderr: -110> 2024-09-12T00:42:10.338+0000 7fba9011d640 10 monclient: get_auth_request con 0x55aeb5227740 auth_method 0 2024-09-12T00:42:10.489 INFO:tasks.workunit.client.0.smithi043.stderr: -109> 2024-09-12T00:42:10.342+0000 7fba92e189c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:10.489 INFO:tasks.workunit.client.0.smithi043.stderr: -108> 2024-09-12T00:42:10.342+0000 7fba92e189c0 20 searching for the correct realm 2024-09-12T00:42:10.489 INFO:tasks.workunit.client.0.smithi043.stderr: -107> 2024-09-12T00:42:10.342+0000 7fba9111f640 10 monclient: get_auth_request con 0x55aeb522c520 auth_method 0 2024-09-12T00:42:10.489 INFO:tasks.workunit.client.0.smithi043.stderr: -106> 2024-09-12T00:42:10.342+0000 7fba9091e640 10 monclient: get_auth_request con 0x7fba8801e460 auth_method 0 2024-09-12T00:42:10.490 INFO:tasks.workunit.client.0.smithi043.stderr: -105> 2024-09-12T00:42:10.342+0000 7fba9011d640 10 monclient: get_auth_request con 0x7fba780db040 auth_method 0 2024-09-12T00:42:10.490 INFO:tasks.workunit.client.0.smithi043.stderr: -104> 2024-09-12T00:42:10.346+0000 7fba9011d640 0 -- 172.21.15.43:0/1345457052 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fba780db040 msgr2=0x7fba780e7910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:10.490 INFO:tasks.workunit.client.0.smithi043.stderr: -103> 2024-09-12T00:42:10.346+0000 7fb9667fc640 1 client.7826.objecter ms_handle_reset 0x7fba780db040 session 0x7fba780d2070 osd.4 2024-09-12T00:42:10.490 INFO:tasks.workunit.client.0.smithi043.stderr: -102> 2024-09-12T00:42:10.346+0000 7fb9667fc640 10 monclient: _renew_subs 2024-09-12T00:42:10.490 INFO:tasks.workunit.client.0.smithi043.stderr: -101> 2024-09-12T00:42:10.346+0000 7fb9667fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:42:10.490 INFO:tasks.workunit.client.0.smithi043.stderr: -100> 2024-09-12T00:42:10.346+0000 7fba9111f640 10 monclient: get_auth_request con 0x7fba780e53e0 auth_method 0 2024-09-12T00:42:10.490 INFO:tasks.workunit.client.0.smithi043.stderr: -99> 2024-09-12T00:42:10.346+0000 7fba9011d640 10 monclient: get_auth_request con 0x7fb95c080c40 auth_method 0 2024-09-12T00:42:10.490 INFO:tasks.workunit.client.0.smithi043.stderr: -98> 2024-09-12T00:42:10.350+0000 7fba9091e640 10 monclient: get_auth_request con 0x7fba780fa430 auth_method 0 2024-09-12T00:42:10.490 INFO:tasks.workunit.client.0.smithi043.stderr: -97> 2024-09-12T00:42:10.354+0000 7fba9011d640 0 -- 172.21.15.43:0/1345457052 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fb95c080c40 msgr2=0x7fb95c083070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:10.490 INFO:tasks.workunit.client.0.smithi043.stderr: -96> 2024-09-12T00:42:10.354+0000 7fb9667fc640 1 client.7826.objecter ms_handle_reset 0x7fb95c080c40 session 0x7fba780d2070 osd.4 2024-09-12T00:42:10.490 INFO:tasks.workunit.client.0.smithi043.stderr: -95> 2024-09-12T00:42:10.354+0000 7fba9011d640 10 monclient: get_auth_request con 0x7fba780db040 auth_method 0 2024-09-12T00:42:10.490 INFO:tasks.workunit.client.0.smithi043.stderr: -94> 2024-09-12T00:42:10.358+0000 7fba92e189c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:42:10.491 INFO:tasks.workunit.client.0.smithi043.stderr: -93> 2024-09-12T00:42:10.358+0000 7fba92e189c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:10.491 INFO:tasks.workunit.client.0.smithi043.stderr: -92> 2024-09-12T00:42:10.358+0000 7fba92e189c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:10.491 INFO:tasks.workunit.client.0.smithi043.stderr: -91> 2024-09-12T00:42:10.358+0000 7fba92e189c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:42:10.491 INFO:tasks.workunit.client.0.smithi043.stderr: -90> 2024-09-12T00:42:10.358+0000 7fba92e189c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:10.491 INFO:tasks.workunit.client.0.smithi043.stderr: -89> 2024-09-12T00:42:10.358+0000 7fba92e189c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:10.491 INFO:tasks.workunit.client.0.smithi043.stderr: -88> 2024-09-12T00:42:10.358+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.491 INFO:tasks.workunit.client.0.smithi043.stderr: -87> 2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:10.491 INFO:tasks.workunit.client.0.smithi043.stderr: -86> 2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.491 INFO:tasks.workunit.client.0.smithi043.stderr: -85> 2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:10.491 INFO:tasks.workunit.client.0.smithi043.stderr: -84> 2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.491 INFO:tasks.workunit.client.0.smithi043.stderr: -83> 2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:10.492 INFO:tasks.workunit.client.0.smithi043.stderr: -82> 2024-09-12T00:42:10.362+0000 7fba92e189c0 20 zone default found 2024-09-12T00:42:10.492 INFO:tasks.workunit.client.0.smithi043.stderr: -81> 2024-09-12T00:42:10.362+0000 7fba92e189c0 4 Realm: () 2024-09-12T00:42:10.492 INFO:tasks.workunit.client.0.smithi043.stderr: -80> 2024-09-12T00:42:10.362+0000 7fba92e189c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:42:10.492 INFO:tasks.workunit.client.0.smithi043.stderr: -79> 2024-09-12T00:42:10.362+0000 7fba92e189c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:42:10.492 INFO:tasks.workunit.client.0.smithi043.stderr: -78> 2024-09-12T00:42:10.362+0000 7fba92e189c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:10.492 INFO:tasks.workunit.client.0.smithi043.stderr: -77> 2024-09-12T00:42:10.362+0000 7fba92e189c0 20 zonegroup default 2024-09-12T00:42:10.492 INFO:tasks.workunit.client.0.smithi043.stderr: -76> 2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.492 INFO:tasks.workunit.client.0.smithi043.stderr: -75> 2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:10.492 INFO:tasks.workunit.client.0.smithi043.stderr: -74> 2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.492 INFO:tasks.workunit.client.0.smithi043.stderr: -73> 2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:10.492 INFO:tasks.workunit.client.0.smithi043.stderr: -72> 2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.492 INFO:tasks.workunit.client.0.smithi043.stderr: -71> 2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:10.493 INFO:tasks.workunit.client.0.smithi043.stderr: -70> 2024-09-12T00:42:10.362+0000 7fba92e189c0 20 started sync module instance, tier type = 2024-09-12T00:42:10.493 INFO:tasks.workunit.client.0.smithi043.stderr: -69> 2024-09-12T00:42:10.362+0000 7fba92e189c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:42:10.493 INFO:tasks.workunit.client.0.smithi043.stderr: -68> 2024-09-12T00:42:10.378+0000 7fba92e189c0 20 add_watcher() i=0 2024-09-12T00:42:10.493 INFO:tasks.workunit.client.0.smithi043.stderr: -67> 2024-09-12T00:42:10.378+0000 7fba92e189c0 20 add_watcher() i=1 2024-09-12T00:42:10.493 INFO:tasks.workunit.client.0.smithi043.stderr: -66> 2024-09-12T00:42:10.378+0000 7fba92e189c0 20 add_watcher() i=2 2024-09-12T00:42:10.493 INFO:tasks.workunit.client.0.smithi043.stderr: -65> 2024-09-12T00:42:10.378+0000 7fba92e189c0 20 add_watcher() i=3 2024-09-12T00:42:10.493 INFO:tasks.workunit.client.0.smithi043.stderr: -64> 2024-09-12T00:42:10.378+0000 7fba92e189c0 20 add_watcher() i=4 2024-09-12T00:42:10.493 INFO:tasks.workunit.client.0.smithi043.stderr: -63> 2024-09-12T00:42:10.378+0000 7fba92e189c0 20 add_watcher() i=5 2024-09-12T00:42:10.493 INFO:tasks.workunit.client.0.smithi043.stderr: -62> 2024-09-12T00:42:10.378+0000 7fba92e189c0 20 add_watcher() i=6 2024-09-12T00:42:10.493 INFO:tasks.workunit.client.0.smithi043.stderr: -61> 2024-09-12T00:42:10.382+0000 7fba92e189c0 20 add_watcher() i=7 2024-09-12T00:42:10.493 INFO:tasks.workunit.client.0.smithi043.stderr: -60> 2024-09-12T00:42:10.382+0000 7fba92e189c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:10.493 INFO:tasks.workunit.client.0.smithi043.stderr: -59> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a6e0) adding auth protocol: cephx 2024-09-12T00:42:10.493 INFO:tasks.workunit.client.0.smithi043.stderr: -58> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a6e0) adding auth protocol: cephx 2024-09-12T00:42:10.494 INFO:tasks.workunit.client.0.smithi043.stderr: -57> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a6e0) adding auth protocol: cephx 2024-09-12T00:42:10.494 INFO:tasks.workunit.client.0.smithi043.stderr: -56> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a6e0) adding con mode: secure 2024-09-12T00:42:10.494 INFO:tasks.workunit.client.0.smithi043.stderr: -55> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a6e0) adding con mode: crc 2024-09-12T00:42:10.494 INFO:tasks.workunit.client.0.smithi043.stderr: -54> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a6e0) adding con mode: secure 2024-09-12T00:42:10.494 INFO:tasks.workunit.client.0.smithi043.stderr: -53> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a6e0) adding con mode: crc 2024-09-12T00:42:10.494 INFO:tasks.workunit.client.0.smithi043.stderr: -52> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a6e0) adding con mode: secure 2024-09-12T00:42:10.494 INFO:tasks.workunit.client.0.smithi043.stderr: -51> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a6e0) adding con mode: crc 2024-09-12T00:42:10.494 INFO:tasks.workunit.client.0.smithi043.stderr: -50> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a6e0) adding con mode: crc 2024-09-12T00:42:10.494 INFO:tasks.workunit.client.0.smithi043.stderr: -49> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a6e0) adding con mode: secure 2024-09-12T00:42:10.494 INFO:tasks.workunit.client.0.smithi043.stderr: -48> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a6e0) adding con mode: crc 2024-09-12T00:42:10.494 INFO:tasks.workunit.client.0.smithi043.stderr: -47> 2024-09-12T00:42:10.382+0000 7fb9477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:10.494 INFO:tasks.workunit.client.0.smithi043.stderr: -46> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a6e0) adding con mode: secure 2024-09-12T00:42:10.494 INFO:tasks.workunit.client.0.smithi043.stderr: -45> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a6e0) adding con mode: crc 2024-09-12T00:42:10.495 INFO:tasks.workunit.client.0.smithi043.stderr: -44> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a6e0) adding con mode: secure 2024-09-12T00:42:10.495 INFO:tasks.workunit.client.0.smithi043.stderr: -43> 2024-09-12T00:42:10.382+0000 7fba92e189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:10.495 INFO:tasks.workunit.client.0.smithi043.stderr: -42> 2024-09-12T00:42:10.382+0000 7fba92e189c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:10.495 INFO:tasks.workunit.client.0.smithi043.stderr: -41> 2024-09-12T00:42:10.382+0000 7fba92e189c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:10.495 INFO:tasks.workunit.client.0.smithi043.stderr: -40> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command cache list hook 0x55aeb51fca90 2024-09-12T00:42:10.495 INFO:tasks.workunit.client.0.smithi043.stderr: -39> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command cache inspect hook 0x55aeb51fca90 2024-09-12T00:42:10.495 INFO:tasks.workunit.client.0.smithi043.stderr: -38> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command cache erase hook 0x55aeb51fca90 2024-09-12T00:42:10.495 INFO:tasks.workunit.client.0.smithi043.stderr: -37> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command cache zap hook 0x55aeb51fca90 2024-09-12T00:42:10.495 INFO:tasks.workunit.client.0.smithi043.stderr: -36> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 note: GC not initialized 2024-09-12T00:42:10.495 INFO:tasks.workunit.client.0.smithi043.stderr: -35> 2024-09-12T00:42:10.382+0000 7fb9467e4640 20 reqs_thread_entry: start 2024-09-12T00:42:10.495 INFO:tasks.workunit.client.0.smithi043.stderr: -34> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command sync trace show hook 0x7fba88004da0 2024-09-12T00:42:10.495 INFO:tasks.workunit.client.0.smithi043.stderr: -33> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command sync trace history hook 0x7fba88004da0 2024-09-12T00:42:10.495 INFO:tasks.workunit.client.0.smithi043.stderr: -32> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command sync trace active hook 0x7fba88004da0 2024-09-12T00:42:10.495 INFO:tasks.workunit.client.0.smithi043.stderr: -31> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command sync trace active_short hook 0x7fba88004da0 2024-09-12T00:42:10.496 INFO:tasks.workunit.client.0.smithi043.stderr: -30> 2024-09-12T00:42:10.382+0000 7fba92e189c0 20 init_complete bucket index max shards: 11 2024-09-12T00:42:10.496 INFO:tasks.workunit.client.0.smithi043.stderr: -29> 2024-09-12T00:42:10.386+0000 7fba92e189c0 20 Filter name: none 2024-09-12T00:42:10.496 INFO:tasks.workunit.client.0.smithi043.stderr: -28> 2024-09-12T00:42:10.386+0000 7fb93f7fe640 20 reqs_thread_entry: start 2024-09-12T00:42:10.496 INFO:tasks.workunit.client.0.smithi043.stderr: -27> 2024-09-12T00:42:10.386+0000 7fba92e189c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:42:10.496 INFO:tasks.workunit.client.0.smithi043.stderr: -26> 2024-09-12T00:42:10.386+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.496 INFO:tasks.workunit.client.0.smithi043.stderr: -25> 2024-09-12T00:42:10.386+0000 7fba92e189c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:42:10.496 INFO:tasks.workunit.client.0.smithi043.stderr: -24> 2024-09-12T00:42:10.386+0000 7fba92e189c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:42:10.496 INFO:tasks.workunit.client.0.smithi043.stderr: -23> 2024-09-12T00:42:10.386+0000 7fba92e189c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:42:10.496 INFO:tasks.workunit.client.0.smithi043.stderr: -22> 2024-09-12T00:42:10.386+0000 7fba92e189c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 : miss 2024-09-12T00:42:10.496 INFO:tasks.workunit.client.0.smithi043.stderr: -21> 2024-09-12T00:42:10.386+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.496 INFO:tasks.workunit.client.0.smithi043.stderr: -20> 2024-09-12T00:42:10.386+0000 7fba92e189c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:42:10.496 INFO:tasks.workunit.client.0.smithi043.stderr: -19> 2024-09-12T00:42:10.386+0000 7fba92e189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:42:10.496 INFO:tasks.workunit.client.0.smithi043.stderr: -18> 2024-09-12T00:42:10.386+0000 7fba92e189c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:42:10.497 INFO:tasks.workunit.client.0.smithi043.stderr: -17> 2024-09-12T00:42:10.386+0000 7fba92e189c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:42:10.497 INFO:tasks.workunit.client.0.smithi043.stderr: -16> 2024-09-12T00:42:10.386+0000 7fba92e189c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:42:10.497 INFO:tasks.workunit.client.0.smithi043.stderr: -15> 2024-09-12T00:42:10.386+0000 7fba92e189c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 2024-09-12T00:42:10.497 INFO:tasks.workunit.client.0.smithi043.stderr: -14> 2024-09-12T00:42:10.390+0000 7fba92e189c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:42:10.497 INFO:tasks.workunit.client.0.smithi043.stderr: -13> 2024-09-12T00:42:10.406+0000 7fba92e189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:42:10.497 INFO:tasks.workunit.client.0.smithi043.stderr: -12> 2024-09-12T00:42:10.406+0000 7fba92e189c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:42:10.497 INFO:tasks.workunit.client.0.smithi043.stderr: -11> 2024-09-12T00:42:10.406+0000 7fba92e189c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:42:10.497 INFO:tasks.workunit.client.0.smithi043.stderr: -10> 2024-09-12T00:42:10.406+0000 7fba92e189c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17, ofs0, ns] 2024-09-12T00:42:10.497 INFO:tasks.workunit.client.0.smithi043.stderr: -9> 2024-09-12T00:42:10.406+0000 7fb9677fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333529 cookie 94208851659280 notifier 7826 bl.length()=827 2024-09-12T00:42:10.497 INFO:tasks.workunit.client.0.smithi043.stderr: -8> 2024-09-12T00:42:10.406+0000 7fb9677fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:42:10.497 INFO:tasks.workunit.client.0.smithi043.stderr: -7> 2024-09-12T00:42:10.406+0000 7fb9677fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:42:10.497 INFO:tasks.workunit.client.0.smithi043.stderr: -6> 2024-09-12T00:42:10.406+0000 7fb9677fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:42:10.497 INFO:tasks.workunit.client.0.smithi043.stderr: -5> 2024-09-12T00:42:10.406+0000 7fba92e189c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_sources= new_sources= 2024-09-12T00:42:10.498 INFO:tasks.workunit.client.0.smithi043.stderr: -4> 2024-09-12T00:42:10.406+0000 7fba92e189c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential sources added=[] removed=[] 2024-09-12T00:42:10.498 INFO:tasks.workunit.client.0.smithi043.stderr: -3> 2024-09-12T00:42:10.406+0000 7fba92e189c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_dests= new_dests= 2024-09-12T00:42:10.498 INFO:tasks.workunit.client.0.smithi043.stderr: -2> 2024-09-12T00:42:10.406+0000 7fba92e189c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential dests added=[] removed=[] 2024-09-12T00:42:10.498 INFO:tasks.workunit.client.0.smithi043.stderr: -1> 2024-09-12T00:42:10.414+0000 7fba92e189c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fba92e189c0 time 2024-09-12T00:42:10.418728+0000 2024-09-12T00:42:10.498 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:42:10.498 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.498 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:10.498 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fba966f22eb] 2024-09-12T00:42:10.498 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fba966f249f] 2024-09-12T00:42:10.498 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aeb2444cc1] 2024-09-12T00:42:10.498 INFO:tasks.workunit.client.0.smithi043.stderr: 4: radosgw-admin(+0x1422aac) [0x55aeb2ea2aac] 2024-09-12T00:42:10.498 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55aeb2459ced] 2024-09-12T00:42:10.498 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:42:10.499 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fba95558d90] 2024-09-12T00:42:10.499 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:42:10.499 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:42:10.499 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.499 INFO:tasks.workunit.client.0.smithi043.stderr: 0> 2024-09-12T00:42:10.418+0000 7fba92e189c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:42:10.499 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7fba92e189c0 thread_name:radosgw-admin 2024-09-12T00:42:10.499 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.499 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:10.499 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fba95571520] 2024-09-12T00:42:10.499 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:42:10.499 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:42:10.499 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:42:10.499 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fba966f2345] 2024-09-12T00:42:10.500 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fba966f249f] 2024-09-12T00:42:10.500 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aeb2444cc1] 2024-09-12T00:42:10.500 INFO:tasks.workunit.client.0.smithi043.stderr: 8: radosgw-admin(+0x1422aac) [0x55aeb2ea2aac] 2024-09-12T00:42:10.500 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55aeb2459ced] 2024-09-12T00:42:10.500 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:42:10.500 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fba95558d90] 2024-09-12T00:42:10.500 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:42:10.500 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:42:10.500 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:42:10.500 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.500 INFO:tasks.workunit.client.0.smithi043.stderr:--- logging levels --- 2024-09-12T00:42:10.500 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 none 2024-09-12T00:42:10.500 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 lockdep 2024-09-12T00:42:10.501 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 context 2024-09-12T00:42:10.501 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 crush 2024-09-12T00:42:10.501 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds 2024-09-12T00:42:10.501 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_balancer 2024-09-12T00:42:10.501 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_locker 2024-09-12T00:42:10.501 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log 2024-09-12T00:42:10.501 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log_expire 2024-09-12T00:42:10.501 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_migrator 2024-09-12T00:42:10.501 INFO:tasks.workunit.client.0.smithi043.stderr: 3/ 5 mds_quiesce 2024-09-12T00:42:10.501 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 buffer 2024-09-12T00:42:10.501 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 timer 2024-09-12T00:42:10.501 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 filer 2024-09-12T00:42:10.501 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 striper 2024-09-12T00:42:10.501 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 objecter 2024-09-12T00:42:10.502 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rados 2024-09-12T00:42:10.502 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd 2024-09-12T00:42:10.502 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_mirror 2024-09-12T00:42:10.502 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_replay 2024-09-12T00:42:10.502 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_pwl 2024-09-12T00:42:10.502 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 journaler 2024-09-12T00:42:10.502 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objectcacher 2024-09-12T00:42:10.502 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:42:10.502 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 client 2024-09-12T00:42:10.502 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 osd 2024-09-12T00:42:10.502 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 optracker 2024-09-12T00:42:10.502 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objclass 2024-09-12T00:42:10.502 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 filestore 2024-09-12T00:42:10.502 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 journal 2024-09-12T00:42:10.503 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 ms 2024-09-12T00:42:10.503 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mon 2024-09-12T00:42:10.503 INFO:tasks.workunit.client.0.smithi043.stderr: 0/10 monc 2024-09-12T00:42:10.503 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 paxos 2024-09-12T00:42:10.503 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 tp 2024-09-12T00:42:10.503 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 auth 2024-09-12T00:42:10.503 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 crypto 2024-09-12T00:42:10.503 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 finisher 2024-09-12T00:42:10.503 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 reserver 2024-09-12T00:42:10.503 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 heartbeatmap 2024-09-12T00:42:10.503 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 perfcounter 2024-09-12T00:42:10.503 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw 2024-09-12T00:42:10.503 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_sync 2024-09-12T00:42:10.503 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_datacache 2024-09-12T00:42:10.504 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_access 2024-09-12T00:42:10.504 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:42:10.504 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_flight 2024-09-12T00:42:10.504 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:42:10.504 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw_notification 2024-09-12T00:42:10.504 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 javaclient 2024-09-12T00:42:10.504 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 asok 2024-09-12T00:42:10.504 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 throttle 2024-09-12T00:42:10.504 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 refs 2024-09-12T00:42:10.505 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 compressor 2024-09-12T00:42:10.505 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluestore 2024-09-12T00:42:10.505 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluefs 2024-09-12T00:42:10.505 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 bdev 2024-09-12T00:42:10.505 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 kstore 2024-09-12T00:42:10.505 INFO:tasks.workunit.client.0.smithi043.stderr: 4/ 5 rocksdb 2024-09-12T00:42:10.505 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 fuse 2024-09-12T00:42:10.505 INFO:tasks.workunit.client.0.smithi043.stderr: 2/ 5 mgr 2024-09-12T00:42:10.505 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mgrc 2024-09-12T00:42:10.505 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 dpdk 2024-09-12T00:42:10.505 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 eventtrace 2024-09-12T00:42:10.505 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 prioritycache 2024-09-12T00:42:10.505 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 test 2024-09-12T00:42:10.505 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:42:10.506 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephsqlite 2024-09-12T00:42:10.506 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:42:10.506 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore 2024-09-12T00:42:10.506 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_onode 2024-09-12T00:42:10.506 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_odata 2024-09-12T00:42:10.506 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_omap 2024-09-12T00:42:10.506 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_tm 2024-09-12T00:42:10.506 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_t 2024-09-12T00:42:10.506 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:42:10.506 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_epm 2024-09-12T00:42:10.506 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_lba 2024-09-12T00:42:10.506 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:42:10.506 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cache 2024-09-12T00:42:10.507 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_journal 2024-09-12T00:42:10.507 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_device 2024-09-12T00:42:10.507 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_backref 2024-09-12T00:42:10.507 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 alienstore 2024-09-12T00:42:10.507 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mclock 2024-09-12T00:42:10.507 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cyanstore 2024-09-12T00:42:10.507 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 ceph_exporter 2024-09-12T00:42:10.507 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 memstore 2024-09-12T00:42:10.507 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 trace 2024-09-12T00:42:10.507 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 ceph_dedup 2024-09-12T00:42:10.507 INFO:tasks.workunit.client.0.smithi043.stderr: -2/-2 (syslog threshold) 2024-09-12T00:42:10.507 INFO:tasks.workunit.client.0.smithi043.stderr: 99/99 (stderr threshold) 2024-09-12T00:42:10.507 INFO:tasks.workunit.client.0.smithi043.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:42:10.508 INFO:tasks.workunit.client.0.smithi043.stderr: 7fb93f7fe640 / http_manager 2024-09-12T00:42:10.508 INFO:tasks.workunit.client.0.smithi043.stderr: 7fb9467e4640 / http_manager 2024-09-12T00:42:10.508 INFO:tasks.workunit.client.0.smithi043.stderr: 7fb9477e6640 / rgw_dt_lg_renew 2024-09-12T00:42:10.508 INFO:tasks.workunit.client.0.smithi043.stderr: 7fb9667fc640 / ms_dispatch 2024-09-12T00:42:10.508 INFO:tasks.workunit.client.0.smithi043.stderr: 7fb9677fe640 / io_context_pool 2024-09-12T00:42:10.508 INFO:tasks.workunit.client.0.smithi043.stderr: 7fb967fff640 / io_context_pool 2024-09-12T00:42:10.508 INFO:tasks.workunit.client.0.smithi043.stderr: 7fb9767fc640 / ms_dispatch 2024-09-12T00:42:10.508 INFO:tasks.workunit.client.0.smithi043.stderr: 7fb97d60a640 / ms_dispatch 2024-09-12T00:42:10.508 INFO:tasks.workunit.client.0.smithi043.stderr: 7fb97ee0d640 / io_context_pool 2024-09-12T00:42:10.508 INFO:tasks.workunit.client.0.smithi043.stderr: 7fba9011d640 / msgr-worker-2 2024-09-12T00:42:10.508 INFO:tasks.workunit.client.0.smithi043.stderr: 7fba9091e640 / msgr-worker-1 2024-09-12T00:42:10.508 INFO:tasks.workunit.client.0.smithi043.stderr: 7fba9111f640 / msgr-worker-0 2024-09-12T00:42:10.508 INFO:tasks.workunit.client.0.smithi043.stderr: 7fba91920640 / io_context_pool 2024-09-12T00:42:10.509 INFO:tasks.workunit.client.0.smithi043.stderr: 7fba92e189c0 / radosgw-admin 2024-09-12T00:42:10.509 INFO:tasks.workunit.client.0.smithi043.stderr: max_recent 500 2024-09-12T00:42:10.509 INFO:tasks.workunit.client.0.smithi043.stderr: max_new 1000 2024-09-12T00:42:10.509 INFO:tasks.workunit.client.0.smithi043.stderr: log_file /var/log/ceph/ceph-client.admin.143380.log 2024-09-12T00:42:10.509 INFO:tasks.workunit.client.0.smithi043.stderr:--- end dump of recent events --- 2024-09-12T00:42:10.509 INFO:tasks.workunit.client.0.smithi043.stderr:--- begin dump of recent events --- 2024-09-12T00:42:10.509 INFO:tasks.workunit.client.0.smithi043.stderr: -499> 2024-09-12T00:42:10.314+0000 7fb97ee0d640 10 monclient: _finish_auth 0 2024-09-12T00:42:10.509 INFO:tasks.workunit.client.0.smithi043.stderr: -498> 2024-09-12T00:42:10.314+0000 7fb97ee0d640 10 monclient: _check_auth_tickets 2024-09-12T00:42:10.509 INFO:tasks.workunit.client.0.smithi043.stderr: -497> 2024-09-12T00:42:10.314+0000 7fb97ee0d640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:10.509 INFO:tasks.workunit.client.0.smithi043.stderr: -496> 2024-09-12T00:42:10.314+0000 7fb97ee0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:10.509 INFO:tasks.workunit.client.0.smithi043.stderr: -495> 2024-09-12T00:42:10.314+0000 7fb97ee0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:42:10.509 INFO:tasks.workunit.client.0.smithi043.stderr: -494> 2024-09-12T00:42:10.314+0000 7fb97ee0d640 10 monclient: dump: 2024-09-12T00:42:10.509 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:10.510 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:10.510 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.510 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.510 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:10.510 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:10.510 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:10.510 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:10.510 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:10.510 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.510 INFO:tasks.workunit.client.0.smithi043.stderr: -493> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 monclient: authenticate success, global_id 7814 2024-09-12T00:42:10.511 INFO:tasks.workunit.client.0.smithi043.stderr: -492> 2024-09-12T00:42:10.314+0000 7fba92e189c0 10 monclient: get_monmap_and_config success 2024-09-12T00:42:10.511 INFO:tasks.workunit.client.0.smithi043.stderr: -491> 2024-09-12T00:42:10.314+0000 7fba92e189c0 4 set_mon_vals no callback set 2024-09-12T00:42:10.511 INFO:tasks.workunit.client.0.smithi043.stderr: -490> 2024-09-12T00:42:10.314+0000 7fba92e189c0 10 monclient: shutdown 2024-09-12T00:42:10.511 INFO:tasks.workunit.client.0.smithi043.stderr: -489> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) unregister_commands rotate-key 2024-09-12T00:42:10.511 INFO:tasks.workunit.client.0.smithi043.stderr: -488> 2024-09-12T00:42:10.314+0000 7fba92e189c0 10 monclient: build_initial_monmap 2024-09-12T00:42:10.511 INFO:tasks.workunit.client.0.smithi043.stderr: -487> 2024-09-12T00:42:10.314+0000 7fba92e189c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:10.511 INFO:tasks.workunit.client.0.smithi043.stderr: -486> 2024-09-12T00:42:10.314+0000 7fba92e189c0 10 monclient: monmap: 2024-09-12T00:42:10.511 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:42:10.511 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:10.511 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:42:10.511 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:42:10.511 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:10.512 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:10.512 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:42:10.512 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:42:10.512 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:42:10.512 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.512 INFO:tasks.workunit.client.0.smithi043.stderr: -485> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb513a530) adding auth protocol: cephx 2024-09-12T00:42:10.512 INFO:tasks.workunit.client.0.smithi043.stderr: -484> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb513a530) adding auth protocol: cephx 2024-09-12T00:42:10.512 INFO:tasks.workunit.client.0.smithi043.stderr: -483> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb513a530) adding auth protocol: cephx 2024-09-12T00:42:10.512 INFO:tasks.workunit.client.0.smithi043.stderr: -482> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb513a530) adding con mode: secure 2024-09-12T00:42:10.512 INFO:tasks.workunit.client.0.smithi043.stderr: -481> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb513a530) adding con mode: crc 2024-09-12T00:42:10.512 INFO:tasks.workunit.client.0.smithi043.stderr: -480> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb513a530) adding con mode: secure 2024-09-12T00:42:10.512 INFO:tasks.workunit.client.0.smithi043.stderr: -479> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb513a530) adding con mode: crc 2024-09-12T00:42:10.512 INFO:tasks.workunit.client.0.smithi043.stderr: -478> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb513a530) adding con mode: secure 2024-09-12T00:42:10.513 INFO:tasks.workunit.client.0.smithi043.stderr: -477> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb513a530) adding con mode: crc 2024-09-12T00:42:10.513 INFO:tasks.workunit.client.0.smithi043.stderr: -476> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb513a530) adding con mode: crc 2024-09-12T00:42:10.513 INFO:tasks.workunit.client.0.smithi043.stderr: -475> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb513a530) adding con mode: secure 2024-09-12T00:42:10.513 INFO:tasks.workunit.client.0.smithi043.stderr: -474> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb513a530) adding con mode: crc 2024-09-12T00:42:10.513 INFO:tasks.workunit.client.0.smithi043.stderr: -473> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb513a530) adding con mode: secure 2024-09-12T00:42:10.513 INFO:tasks.workunit.client.0.smithi043.stderr: -472> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb513a530) adding con mode: crc 2024-09-12T00:42:10.513 INFO:tasks.workunit.client.0.smithi043.stderr: -471> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb513a530) adding con mode: secure 2024-09-12T00:42:10.513 INFO:tasks.workunit.client.0.smithi043.stderr: -470> 2024-09-12T00:42:10.314+0000 7fba92e189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:10.513 INFO:tasks.workunit.client.0.smithi043.stderr: -469> 2024-09-12T00:42:10.314+0000 7fba92e189c0 1 librados: starting msgr at 2024-09-12T00:42:10.513 INFO:tasks.workunit.client.0.smithi043.stderr: -468> 2024-09-12T00:42:10.314+0000 7fba92e189c0 1 librados: starting objecter 2024-09-12T00:42:10.513 INFO:tasks.workunit.client.0.smithi043.stderr: -467> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command objecter_requests hook 0x55aeb513c050 2024-09-12T00:42:10.513 INFO:tasks.workunit.client.0.smithi043.stderr: -466> 2024-09-12T00:42:10.314+0000 7fba92e189c0 1 librados: setting wanted keys 2024-09-12T00:42:10.513 INFO:tasks.workunit.client.0.smithi043.stderr: -465> 2024-09-12T00:42:10.314+0000 7fba92e189c0 1 librados: calling monclient init 2024-09-12T00:42:10.514 INFO:tasks.workunit.client.0.smithi043.stderr: -464> 2024-09-12T00:42:10.314+0000 7fba92e189c0 10 monclient: init 2024-09-12T00:42:10.514 INFO:tasks.workunit.client.0.smithi043.stderr: -463> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb5137450) adding auth protocol: cephx 2024-09-12T00:42:10.514 INFO:tasks.workunit.client.0.smithi043.stderr: -462> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb5137450) adding auth protocol: cephx 2024-09-12T00:42:10.514 INFO:tasks.workunit.client.0.smithi043.stderr: -461> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb5137450) adding auth protocol: cephx 2024-09-12T00:42:10.514 INFO:tasks.workunit.client.0.smithi043.stderr: -460> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb5137450) adding con mode: secure 2024-09-12T00:42:10.514 INFO:tasks.workunit.client.0.smithi043.stderr: -459> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb5137450) adding con mode: crc 2024-09-12T00:42:10.514 INFO:tasks.workunit.client.0.smithi043.stderr: -458> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb5137450) adding con mode: secure 2024-09-12T00:42:10.514 INFO:tasks.workunit.client.0.smithi043.stderr: -457> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb5137450) adding con mode: crc 2024-09-12T00:42:10.514 INFO:tasks.workunit.client.0.smithi043.stderr: -456> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb5137450) adding con mode: secure 2024-09-12T00:42:10.514 INFO:tasks.workunit.client.0.smithi043.stderr: -455> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb5137450) adding con mode: crc 2024-09-12T00:42:10.514 INFO:tasks.workunit.client.0.smithi043.stderr: -454> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb5137450) adding con mode: crc 2024-09-12T00:42:10.514 INFO:tasks.workunit.client.0.smithi043.stderr: -453> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb5137450) adding con mode: secure 2024-09-12T00:42:10.515 INFO:tasks.workunit.client.0.smithi043.stderr: -452> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb5137450) adding con mode: crc 2024-09-12T00:42:10.515 INFO:tasks.workunit.client.0.smithi043.stderr: -451> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb5137450) adding con mode: secure 2024-09-12T00:42:10.515 INFO:tasks.workunit.client.0.smithi043.stderr: -450> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb5137450) adding con mode: crc 2024-09-12T00:42:10.515 INFO:tasks.workunit.client.0.smithi043.stderr: -449> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 AuthRegistry(0x55aeb5137450) adding con mode: secure 2024-09-12T00:42:10.515 INFO:tasks.workunit.client.0.smithi043.stderr: -448> 2024-09-12T00:42:10.314+0000 7fba92e189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:10.515 INFO:tasks.workunit.client.0.smithi043.stderr: -447> 2024-09-12T00:42:10.314+0000 7fba92e189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:10.515 INFO:tasks.workunit.client.0.smithi043.stderr: -446> 2024-09-12T00:42:10.314+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command rotate-key hook 0x55aeb5137598 2024-09-12T00:42:10.515 INFO:tasks.workunit.client.0.smithi043.stderr: -445> 2024-09-12T00:42:10.314+0000 7fba92e189c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:10.515 INFO:tasks.workunit.client.0.smithi043.stderr: -444> 2024-09-12T00:42:10.314+0000 7fba92e189c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:42:10.515 INFO:tasks.workunit.client.0.smithi043.stderr: -443> 2024-09-12T00:42:10.314+0000 7fba92e189c0 10 monclient(hunting): picked mon.noname-c con 0x55aeb4fc2ad0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:42:10.515 INFO:tasks.workunit.client.0.smithi043.stderr: -442> 2024-09-12T00:42:10.314+0000 7fba92e189c0 10 monclient(hunting): picked mon.noname-a con 0x55aeb4fc3520 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:42:10.515 INFO:tasks.workunit.client.0.smithi043.stderr: -441> 2024-09-12T00:42:10.314+0000 7fba92e189c0 10 monclient(hunting): picked mon.noname-b con 0x55aeb4fc42c0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:42:10.515 INFO:tasks.workunit.client.0.smithi043.stderr: -440> 2024-09-12T00:42:10.314+0000 7fba92e189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:10.516 INFO:tasks.workunit.client.0.smithi043.stderr: -439> 2024-09-12T00:42:10.314+0000 7fba92e189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:10.516 INFO:tasks.workunit.client.0.smithi043.stderr: -438> 2024-09-12T00:42:10.314+0000 7fba92e189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:10.516 INFO:tasks.workunit.client.0.smithi043.stderr: -437> 2024-09-12T00:42:10.314+0000 7fba92e189c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:10.516 INFO:tasks.workunit.client.0.smithi043.stderr: -436> 2024-09-12T00:42:10.314+0000 7fba92e189c0 10 monclient(hunting): authenticate will time out at 2426.307953s 2024-09-12T00:42:10.516 INFO:tasks.workunit.client.0.smithi043.stderr: -435> 2024-09-12T00:42:10.318+0000 7fba9091e640 10 monclient(hunting): get_auth_request con 0x55aeb4fc2ad0 auth_method 0 2024-09-12T00:42:10.516 INFO:tasks.workunit.client.0.smithi043.stderr: -434> 2024-09-12T00:42:10.318+0000 7fba9091e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:10.516 INFO:tasks.workunit.client.0.smithi043.stderr: -433> 2024-09-12T00:42:10.318+0000 7fba9091e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:10.516 INFO:tasks.workunit.client.0.smithi043.stderr: -432> 2024-09-12T00:42:10.318+0000 7fba9091e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:10.516 INFO:tasks.workunit.client.0.smithi043.stderr: -431> 2024-09-12T00:42:10.318+0000 7fba9011d640 10 monclient(hunting): get_auth_request con 0x55aeb4fc3520 auth_method 0 2024-09-12T00:42:10.516 INFO:tasks.workunit.client.0.smithi043.stderr: -430> 2024-09-12T00:42:10.318+0000 7fba9011d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:10.516 INFO:tasks.workunit.client.0.smithi043.stderr: -429> 2024-09-12T00:42:10.318+0000 7fba9011d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:10.516 INFO:tasks.workunit.client.0.smithi043.stderr: -428> 2024-09-12T00:42:10.318+0000 7fba9011d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:10.517 INFO:tasks.workunit.client.0.smithi043.stderr: -427> 2024-09-12T00:42:10.318+0000 7fba9091e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:10.517 INFO:tasks.workunit.client.0.smithi043.stderr: -426> 2024-09-12T00:42:10.318+0000 7fba9091e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:10.517 INFO:tasks.workunit.client.0.smithi043.stderr: -425> 2024-09-12T00:42:10.318+0000 7fba9091e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:10.517 INFO:tasks.workunit.client.0.smithi043.stderr: -424> 2024-09-12T00:42:10.318+0000 7fba9011d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:10.517 INFO:tasks.workunit.client.0.smithi043.stderr: -423> 2024-09-12T00:42:10.318+0000 7fba9011d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:10.517 INFO:tasks.workunit.client.0.smithi043.stderr: -422> 2024-09-12T00:42:10.318+0000 7fba9011d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:10.517 INFO:tasks.workunit.client.0.smithi043.stderr: -421> 2024-09-12T00:42:10.318+0000 7fba9111f640 10 monclient(hunting): get_auth_request con 0x55aeb4fc42c0 auth_method 0 2024-09-12T00:42:10.517 INFO:tasks.workunit.client.0.smithi043.stderr: -420> 2024-09-12T00:42:10.318+0000 7fba9111f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:10.517 INFO:tasks.workunit.client.0.smithi043.stderr: -419> 2024-09-12T00:42:10.318+0000 7fba9111f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:10.517 INFO:tasks.workunit.client.0.smithi043.stderr: -418> 2024-09-12T00:42:10.318+0000 7fba9111f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:10.517 INFO:tasks.workunit.client.0.smithi043.stderr: -417> 2024-09-12T00:42:10.318+0000 7fba9091e640 10 monclient(hunting): handle_auth_done global_id 7817 payload 824 2024-09-12T00:42:10.517 INFO:tasks.workunit.client.0.smithi043.stderr: -416> 2024-09-12T00:42:10.318+0000 7fba9091e640 10 monclient: _finish_hunting 0 2024-09-12T00:42:10.517 INFO:tasks.workunit.client.0.smithi043.stderr: -415> 2024-09-12T00:42:10.318+0000 7fba9091e640 1 monclient: found mon.noname-c 2024-09-12T00:42:10.518 INFO:tasks.workunit.client.0.smithi043.stderr: -414> 2024-09-12T00:42:10.318+0000 7fba9091e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:42:10.518 INFO:tasks.workunit.client.0.smithi043.stderr: -413> 2024-09-12T00:42:10.318+0000 7fb97d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:10.518 INFO:tasks.workunit.client.0.smithi043.stderr: -412> 2024-09-12T00:42:10.318+0000 7fb97d60a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:42:10.518 INFO:tasks.workunit.client.0.smithi043.stderr: -411> 2024-09-12T00:42:10.318+0000 7fb97d60a640 10 monclient: dump: 2024-09-12T00:42:10.518 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:10.518 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:10.518 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.518 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.518 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:10.518 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:10.519 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:10.519 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:10.519 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:10.519 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.519 INFO:tasks.workunit.client.0.smithi043.stderr: -410> 2024-09-12T00:42:10.318+0000 7fb97d60a640 10 monclient: _finish_auth 0 2024-09-12T00:42:10.519 INFO:tasks.workunit.client.0.smithi043.stderr: -409> 2024-09-12T00:42:10.318+0000 7fb97d60a640 10 monclient: _check_auth_tickets 2024-09-12T00:42:10.519 INFO:tasks.workunit.client.0.smithi043.stderr: -408> 2024-09-12T00:42:10.318+0000 7fb97d60a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:10.519 INFO:tasks.workunit.client.0.smithi043.stderr: -407> 2024-09-12T00:42:10.318+0000 7fb97d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:10.519 INFO:tasks.workunit.client.0.smithi043.stderr: -406> 2024-09-12T00:42:10.318+0000 7fb97d60a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:42:10.519 INFO:tasks.workunit.client.0.smithi043.stderr: -405> 2024-09-12T00:42:10.318+0000 7fb97d60a640 10 monclient: dump: 2024-09-12T00:42:10.519 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:10.519 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:10.520 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.520 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.520 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:10.520 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:10.520 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:10.520 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:10.520 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:10.520 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.520 INFO:tasks.workunit.client.0.smithi043.stderr: -404> 2024-09-12T00:42:10.318+0000 7fba92e189c0 5 monclient: authenticate success, global_id 7817 2024-09-12T00:42:10.520 INFO:tasks.workunit.client.0.smithi043.stderr: -403> 2024-09-12T00:42:10.318+0000 7fba92e189c0 10 monclient: _renew_subs 2024-09-12T00:42:10.520 INFO:tasks.workunit.client.0.smithi043.stderr: -402> 2024-09-12T00:42:10.318+0000 7fba92e189c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:42:10.520 INFO:tasks.workunit.client.0.smithi043.stderr: -401> 2024-09-12T00:42:10.318+0000 7fb97ee0d640 4 set_mon_vals no callback set 2024-09-12T00:42:10.520 INFO:tasks.workunit.client.0.smithi043.stderr: -400> 2024-09-12T00:42:10.318+0000 7fba92e189c0 10 monclient: _renew_subs 2024-09-12T00:42:10.521 INFO:tasks.workunit.client.0.smithi043.stderr: -399> 2024-09-12T00:42:10.318+0000 7fba92e189c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:42:10.521 INFO:tasks.workunit.client.0.smithi043.stderr: -398> 2024-09-12T00:42:10.318+0000 7fba92e189c0 1 librados: init done 2024-09-12T00:42:10.521 INFO:tasks.workunit.client.0.smithi043.stderr: -397> 2024-09-12T00:42:10.318+0000 7fb97d60a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:10.521 INFO:tasks.workunit.client.0.smithi043.stderr: -396> 2024-09-12T00:42:10.318+0000 7fb97d60a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:42:10.521 INFO:tasks.workunit.client.0.smithi043.stderr: -395> 2024-09-12T00:42:10.318+0000 7fb97d60a640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:42:10.521 INFO:tasks.workunit.client.0.smithi043.stderr: -394> 2024-09-12T00:42:10.318+0000 7fba9011d640 10 monclient: get_auth_request con 0x7fb978070ae0 auth_method 0 2024-09-12T00:42:10.521 INFO:tasks.workunit.client.0.smithi043.stderr: -393> 2024-09-12T00:42:10.318+0000 7fba9111f640 10 monclient: get_auth_request con 0x55aeb5169e80 auth_method 0 2024-09-12T00:42:10.521 INFO:tasks.workunit.client.0.smithi043.stderr: -392> 2024-09-12T00:42:10.322+0000 7fba9091e640 10 monclient: get_auth_request con 0x55aeb5181d10 auth_method 0 2024-09-12T00:42:10.521 INFO:tasks.workunit.client.0.smithi043.stderr: -391> 2024-09-12T00:42:10.322+0000 7fba9011d640 10 monclient: get_auth_request con 0x55aeb5186070 auth_method 0 2024-09-12T00:42:10.521 INFO:tasks.workunit.client.0.smithi043.stderr: -390> 2024-09-12T00:42:10.322+0000 7fba92e189c0 10 monclient: build_initial_monmap 2024-09-12T00:42:10.521 INFO:tasks.workunit.client.0.smithi043.stderr: -389> 2024-09-12T00:42:10.322+0000 7fba92e189c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:10.521 INFO:tasks.workunit.client.0.smithi043.stderr: -388> 2024-09-12T00:42:10.322+0000 7fba92e189c0 10 monclient: monmap: 2024-09-12T00:42:10.521 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:42:10.521 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:10.522 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:42:10.522 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:42:10.522 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:10.522 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:10.522 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:42:10.522 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:42:10.522 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:42:10.522 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.522 INFO:tasks.workunit.client.0.smithi043.stderr: -387> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb518aea0) adding auth protocol: cephx 2024-09-12T00:42:10.522 INFO:tasks.workunit.client.0.smithi043.stderr: -386> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb518aea0) adding auth protocol: cephx 2024-09-12T00:42:10.522 INFO:tasks.workunit.client.0.smithi043.stderr: -385> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb518aea0) adding auth protocol: cephx 2024-09-12T00:42:10.522 INFO:tasks.workunit.client.0.smithi043.stderr: -384> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb518aea0) adding con mode: secure 2024-09-12T00:42:10.522 INFO:tasks.workunit.client.0.smithi043.stderr: -383> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb518aea0) adding con mode: crc 2024-09-12T00:42:10.523 INFO:tasks.workunit.client.0.smithi043.stderr: -382> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb518aea0) adding con mode: secure 2024-09-12T00:42:10.523 INFO:tasks.workunit.client.0.smithi043.stderr: -381> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb518aea0) adding con mode: crc 2024-09-12T00:42:10.523 INFO:tasks.workunit.client.0.smithi043.stderr: -380> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb518aea0) adding con mode: secure 2024-09-12T00:42:10.523 INFO:tasks.workunit.client.0.smithi043.stderr: -379> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb518aea0) adding con mode: crc 2024-09-12T00:42:10.523 INFO:tasks.workunit.client.0.smithi043.stderr: -378> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb518aea0) adding con mode: crc 2024-09-12T00:42:10.523 INFO:tasks.workunit.client.0.smithi043.stderr: -377> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb518aea0) adding con mode: secure 2024-09-12T00:42:10.523 INFO:tasks.workunit.client.0.smithi043.stderr: -376> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb518aea0) adding con mode: crc 2024-09-12T00:42:10.523 INFO:tasks.workunit.client.0.smithi043.stderr: -375> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb518aea0) adding con mode: secure 2024-09-12T00:42:10.523 INFO:tasks.workunit.client.0.smithi043.stderr: -374> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb518aea0) adding con mode: crc 2024-09-12T00:42:10.523 INFO:tasks.workunit.client.0.smithi043.stderr: -373> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb518aea0) adding con mode: secure 2024-09-12T00:42:10.523 INFO:tasks.workunit.client.0.smithi043.stderr: -372> 2024-09-12T00:42:10.326+0000 7fba92e189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:10.523 INFO:tasks.workunit.client.0.smithi043.stderr: -371> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55aeb518e7c0 EEXIST 2024-09-12T00:42:10.523 INFO:tasks.workunit.client.0.smithi043.stderr: -370> 2024-09-12T00:42:10.326+0000 7fba92e189c0 10 monclient: init 2024-09-12T00:42:10.523 INFO:tasks.workunit.client.0.smithi043.stderr: -369> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51894c8) adding auth protocol: cephx 2024-09-12T00:42:10.524 INFO:tasks.workunit.client.0.smithi043.stderr: -368> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51894c8) adding auth protocol: cephx 2024-09-12T00:42:10.524 INFO:tasks.workunit.client.0.smithi043.stderr: -367> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51894c8) adding auth protocol: cephx 2024-09-12T00:42:10.524 INFO:tasks.workunit.client.0.smithi043.stderr: -366> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51894c8) adding con mode: secure 2024-09-12T00:42:10.524 INFO:tasks.workunit.client.0.smithi043.stderr: -365> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51894c8) adding con mode: crc 2024-09-12T00:42:10.524 INFO:tasks.workunit.client.0.smithi043.stderr: -364> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51894c8) adding con mode: secure 2024-09-12T00:42:10.524 INFO:tasks.workunit.client.0.smithi043.stderr: -363> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51894c8) adding con mode: crc 2024-09-12T00:42:10.524 INFO:tasks.workunit.client.0.smithi043.stderr: -362> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51894c8) adding con mode: secure 2024-09-12T00:42:10.524 INFO:tasks.workunit.client.0.smithi043.stderr: -361> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51894c8) adding con mode: crc 2024-09-12T00:42:10.524 INFO:tasks.workunit.client.0.smithi043.stderr: -360> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51894c8) adding con mode: crc 2024-09-12T00:42:10.524 INFO:tasks.workunit.client.0.smithi043.stderr: -359> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51894c8) adding con mode: secure 2024-09-12T00:42:10.524 INFO:tasks.workunit.client.0.smithi043.stderr: -358> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51894c8) adding con mode: crc 2024-09-12T00:42:10.524 INFO:tasks.workunit.client.0.smithi043.stderr: -357> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51894c8) adding con mode: secure 2024-09-12T00:42:10.525 INFO:tasks.workunit.client.0.smithi043.stderr: -356> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51894c8) adding con mode: crc 2024-09-12T00:42:10.525 INFO:tasks.workunit.client.0.smithi043.stderr: -355> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51894c8) adding con mode: secure 2024-09-12T00:42:10.525 INFO:tasks.workunit.client.0.smithi043.stderr: -354> 2024-09-12T00:42:10.326+0000 7fba92e189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:10.525 INFO:tasks.workunit.client.0.smithi043.stderr: -353> 2024-09-12T00:42:10.326+0000 7fba92e189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:10.525 INFO:tasks.workunit.client.0.smithi043.stderr: -352> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command rotate-key cmddesc rotate-key hook 0x55aeb5189610 EEXIST 2024-09-12T00:42:10.525 INFO:tasks.workunit.client.0.smithi043.stderr: -351> 2024-09-12T00:42:10.326+0000 7fba92e189c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:10.525 INFO:tasks.workunit.client.0.smithi043.stderr: -350> 2024-09-12T00:42:10.326+0000 7fba92e189c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:42:10.525 INFO:tasks.workunit.client.0.smithi043.stderr: -349> 2024-09-12T00:42:10.326+0000 7fba92e189c0 10 monclient(hunting): picked mon.noname-c con 0x55aeb51b2970 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:42:10.525 INFO:tasks.workunit.client.0.smithi043.stderr: -348> 2024-09-12T00:42:10.326+0000 7fba92e189c0 10 monclient(hunting): picked mon.noname-b con 0x55aeb51b22a0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:42:10.525 INFO:tasks.workunit.client.0.smithi043.stderr: -347> 2024-09-12T00:42:10.326+0000 7fba92e189c0 10 monclient(hunting): picked mon.noname-a con 0x55aeb51b0c80 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:42:10.525 INFO:tasks.workunit.client.0.smithi043.stderr: -346> 2024-09-12T00:42:10.326+0000 7fba92e189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:10.525 INFO:tasks.workunit.client.0.smithi043.stderr: -345> 2024-09-12T00:42:10.326+0000 7fba92e189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:10.525 INFO:tasks.workunit.client.0.smithi043.stderr: -344> 2024-09-12T00:42:10.326+0000 7fba92e189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:10.525 INFO:tasks.workunit.client.0.smithi043.stderr: -343> 2024-09-12T00:42:10.326+0000 7fba92e189c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:10.526 INFO:tasks.workunit.client.0.smithi043.stderr: -342> 2024-09-12T00:42:10.326+0000 7fba92e189c0 10 monclient(hunting): authenticate will time out at 2426.317190s 2024-09-12T00:42:10.526 INFO:tasks.workunit.client.0.smithi043.stderr: -341> 2024-09-12T00:42:10.326+0000 7fba9091e640 10 monclient(hunting): get_auth_request con 0x55aeb51b2970 auth_method 0 2024-09-12T00:42:10.526 INFO:tasks.workunit.client.0.smithi043.stderr: -340> 2024-09-12T00:42:10.326+0000 7fba9091e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:10.526 INFO:tasks.workunit.client.0.smithi043.stderr: -339> 2024-09-12T00:42:10.326+0000 7fba9091e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:10.526 INFO:tasks.workunit.client.0.smithi043.stderr: -338> 2024-09-12T00:42:10.326+0000 7fba9091e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:10.526 INFO:tasks.workunit.client.0.smithi043.stderr: -337> 2024-09-12T00:42:10.326+0000 7fba9111f640 10 monclient(hunting): get_auth_request con 0x55aeb51b0c80 auth_method 0 2024-09-12T00:42:10.526 INFO:tasks.workunit.client.0.smithi043.stderr: -336> 2024-09-12T00:42:10.326+0000 7fba9111f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:10.526 INFO:tasks.workunit.client.0.smithi043.stderr: -335> 2024-09-12T00:42:10.326+0000 7fba9111f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:10.526 INFO:tasks.workunit.client.0.smithi043.stderr: -334> 2024-09-12T00:42:10.326+0000 7fba9111f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:10.526 INFO:tasks.workunit.client.0.smithi043.stderr: -333> 2024-09-12T00:42:10.326+0000 7fba9091e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:10.526 INFO:tasks.workunit.client.0.smithi043.stderr: -332> 2024-09-12T00:42:10.326+0000 7fba9091e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:10.526 INFO:tasks.workunit.client.0.smithi043.stderr: -331> 2024-09-12T00:42:10.326+0000 7fba9091e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:10.526 INFO:tasks.workunit.client.0.smithi043.stderr: -330> 2024-09-12T00:42:10.326+0000 7fba9111f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:10.527 INFO:tasks.workunit.client.0.smithi043.stderr: -329> 2024-09-12T00:42:10.326+0000 7fba9111f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:10.527 INFO:tasks.workunit.client.0.smithi043.stderr: -328> 2024-09-12T00:42:10.326+0000 7fba9111f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:10.527 INFO:tasks.workunit.client.0.smithi043.stderr: -327> 2024-09-12T00:42:10.326+0000 7fba9011d640 10 monclient(hunting): get_auth_request con 0x55aeb51b22a0 auth_method 0 2024-09-12T00:42:10.527 INFO:tasks.workunit.client.0.smithi043.stderr: -326> 2024-09-12T00:42:10.326+0000 7fba9011d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:10.527 INFO:tasks.workunit.client.0.smithi043.stderr: -325> 2024-09-12T00:42:10.326+0000 7fba9011d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:10.527 INFO:tasks.workunit.client.0.smithi043.stderr: -324> 2024-09-12T00:42:10.326+0000 7fba9011d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:10.527 INFO:tasks.workunit.client.0.smithi043.stderr: -323> 2024-09-12T00:42:10.326+0000 7fba9091e640 10 monclient(hunting): handle_auth_done global_id 7820 payload 824 2024-09-12T00:42:10.527 INFO:tasks.workunit.client.0.smithi043.stderr: -322> 2024-09-12T00:42:10.326+0000 7fba9091e640 10 monclient: _finish_hunting 0 2024-09-12T00:42:10.527 INFO:tasks.workunit.client.0.smithi043.stderr: -321> 2024-09-12T00:42:10.326+0000 7fba9091e640 1 monclient: found mon.noname-c 2024-09-12T00:42:10.527 INFO:tasks.workunit.client.0.smithi043.stderr: -320> 2024-09-12T00:42:10.326+0000 7fba9091e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:42:10.527 INFO:tasks.workunit.client.0.smithi043.stderr: -319> 2024-09-12T00:42:10.326+0000 7fb9767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:10.527 INFO:tasks.workunit.client.0.smithi043.stderr: -318> 2024-09-12T00:42:10.326+0000 7fb9767fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:42:10.527 INFO:tasks.workunit.client.0.smithi043.stderr: -317> 2024-09-12T00:42:10.326+0000 7fb9767fc640 10 monclient: dump: 2024-09-12T00:42:10.528 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:10.528 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:10.528 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.528 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.528 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:10.528 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:10.528 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:10.528 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:10.528 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:10.528 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.528 INFO:tasks.workunit.client.0.smithi043.stderr: -316> 2024-09-12T00:42:10.326+0000 7fb9767fc640 10 monclient: _finish_auth 0 2024-09-12T00:42:10.528 INFO:tasks.workunit.client.0.smithi043.stderr: -315> 2024-09-12T00:42:10.326+0000 7fb9767fc640 10 monclient: _check_auth_tickets 2024-09-12T00:42:10.528 INFO:tasks.workunit.client.0.smithi043.stderr: -314> 2024-09-12T00:42:10.326+0000 7fb9767fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:10.529 INFO:tasks.workunit.client.0.smithi043.stderr: -313> 2024-09-12T00:42:10.326+0000 7fb9767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:10.529 INFO:tasks.workunit.client.0.smithi043.stderr: -312> 2024-09-12T00:42:10.326+0000 7fb9767fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:42:10.529 INFO:tasks.workunit.client.0.smithi043.stderr: -311> 2024-09-12T00:42:10.326+0000 7fb9767fc640 10 monclient: dump: 2024-09-12T00:42:10.529 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:10.529 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:10.529 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.529 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.529 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:10.529 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:10.529 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:10.529 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:10.529 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:10.529 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.529 INFO:tasks.workunit.client.0.smithi043.stderr: -310> 2024-09-12T00:42:10.326+0000 7fba92e189c0 5 monclient: authenticate success, global_id 7820 2024-09-12T00:42:10.530 INFO:tasks.workunit.client.0.smithi043.stderr: -309> 2024-09-12T00:42:10.326+0000 7fba91920640 4 set_mon_vals no callback set 2024-09-12T00:42:10.530 INFO:tasks.workunit.client.0.smithi043.stderr: -308> 2024-09-12T00:42:10.326+0000 7fba92e189c0 10 monclient: _renew_subs 2024-09-12T00:42:10.530 INFO:tasks.workunit.client.0.smithi043.stderr: -307> 2024-09-12T00:42:10.326+0000 7fba92e189c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:42:10.530 INFO:tasks.workunit.client.0.smithi043.stderr: -306> 2024-09-12T00:42:10.326+0000 7fba92e189c0 10 monclient: _renew_subs 2024-09-12T00:42:10.530 INFO:tasks.workunit.client.0.smithi043.stderr: -305> 2024-09-12T00:42:10.326+0000 7fba92e189c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:42:10.530 INFO:tasks.workunit.client.0.smithi043.stderr: -304> 2024-09-12T00:42:10.330+0000 7fb9767fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:10.530 INFO:tasks.workunit.client.0.smithi043.stderr: -303> 2024-09-12T00:42:10.330+0000 7fb9767fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:42:10.530 INFO:tasks.workunit.client.0.smithi043.stderr: -302> 2024-09-12T00:42:10.330+0000 7fb9767fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:42:10.530 INFO:tasks.workunit.client.0.smithi043.stderr: -301> 2024-09-12T00:42:10.330+0000 7fba9011d640 10 monclient: get_auth_request con 0x7fb968070a20 auth_method 0 2024-09-12T00:42:10.530 INFO:tasks.workunit.client.0.smithi043.stderr: -300> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient: get_monmap_and_config 2024-09-12T00:42:10.530 INFO:tasks.workunit.client.0.smithi043.stderr: -299> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient: build_initial_monmap 2024-09-12T00:42:10.530 INFO:tasks.workunit.client.0.smithi043.stderr: -298> 2024-09-12T00:42:10.330+0000 7fba92e189c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:10.530 INFO:tasks.workunit.client.0.smithi043.stderr: -297> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient: monmap: 2024-09-12T00:42:10.531 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:42:10.531 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:10.531 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:42:10.531 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:42:10.531 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:10.531 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:10.531 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:42:10.531 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:42:10.531 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:42:10.531 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.531 INFO:tasks.workunit.client.0.smithi043.stderr: -296> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51d1e80) adding auth protocol: cephx 2024-09-12T00:42:10.531 INFO:tasks.workunit.client.0.smithi043.stderr: -295> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51d1e80) adding auth protocol: cephx 2024-09-12T00:42:10.531 INFO:tasks.workunit.client.0.smithi043.stderr: -294> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51d1e80) adding auth protocol: cephx 2024-09-12T00:42:10.531 INFO:tasks.workunit.client.0.smithi043.stderr: -293> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51d1e80) adding con mode: secure 2024-09-12T00:42:10.532 INFO:tasks.workunit.client.0.smithi043.stderr: -292> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51d1e80) adding con mode: crc 2024-09-12T00:42:10.532 INFO:tasks.workunit.client.0.smithi043.stderr: -291> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51d1e80) adding con mode: secure 2024-09-12T00:42:10.532 INFO:tasks.workunit.client.0.smithi043.stderr: -290> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51d1e80) adding con mode: crc 2024-09-12T00:42:10.532 INFO:tasks.workunit.client.0.smithi043.stderr: -289> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51d1e80) adding con mode: secure 2024-09-12T00:42:10.532 INFO:tasks.workunit.client.0.smithi043.stderr: -288> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51d1e80) adding con mode: crc 2024-09-12T00:42:10.532 INFO:tasks.workunit.client.0.smithi043.stderr: -287> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51d1e80) adding con mode: crc 2024-09-12T00:42:10.532 INFO:tasks.workunit.client.0.smithi043.stderr: -286> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51d1e80) adding con mode: secure 2024-09-12T00:42:10.532 INFO:tasks.workunit.client.0.smithi043.stderr: -285> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51d1e80) adding con mode: crc 2024-09-12T00:42:10.532 INFO:tasks.workunit.client.0.smithi043.stderr: -284> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51d1e80) adding con mode: secure 2024-09-12T00:42:10.532 INFO:tasks.workunit.client.0.smithi043.stderr: -283> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51d1e80) adding con mode: crc 2024-09-12T00:42:10.532 INFO:tasks.workunit.client.0.smithi043.stderr: -282> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51d1e80) adding con mode: secure 2024-09-12T00:42:10.532 INFO:tasks.workunit.client.0.smithi043.stderr: -281> 2024-09-12T00:42:10.330+0000 7fba92e189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:10.532 INFO:tasks.workunit.client.0.smithi043.stderr: -280> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient: init 2024-09-12T00:42:10.533 INFO:tasks.workunit.client.0.smithi043.stderr: -279> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a200) adding auth protocol: cephx 2024-09-12T00:42:10.533 INFO:tasks.workunit.client.0.smithi043.stderr: -278> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a200) adding auth protocol: cephx 2024-09-12T00:42:10.533 INFO:tasks.workunit.client.0.smithi043.stderr: -277> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a200) adding auth protocol: cephx 2024-09-12T00:42:10.533 INFO:tasks.workunit.client.0.smithi043.stderr: -276> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a200) adding con mode: secure 2024-09-12T00:42:10.533 INFO:tasks.workunit.client.0.smithi043.stderr: -275> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a200) adding con mode: crc 2024-09-12T00:42:10.533 INFO:tasks.workunit.client.0.smithi043.stderr: -274> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a200) adding con mode: secure 2024-09-12T00:42:10.533 INFO:tasks.workunit.client.0.smithi043.stderr: -273> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a200) adding con mode: crc 2024-09-12T00:42:10.533 INFO:tasks.workunit.client.0.smithi043.stderr: -272> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a200) adding con mode: secure 2024-09-12T00:42:10.533 INFO:tasks.workunit.client.0.smithi043.stderr: -271> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a200) adding con mode: crc 2024-09-12T00:42:10.533 INFO:tasks.workunit.client.0.smithi043.stderr: -270> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a200) adding con mode: crc 2024-09-12T00:42:10.533 INFO:tasks.workunit.client.0.smithi043.stderr: -269> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a200) adding con mode: secure 2024-09-12T00:42:10.533 INFO:tasks.workunit.client.0.smithi043.stderr: -268> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a200) adding con mode: crc 2024-09-12T00:42:10.533 INFO:tasks.workunit.client.0.smithi043.stderr: -267> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a200) adding con mode: secure 2024-09-12T00:42:10.534 INFO:tasks.workunit.client.0.smithi043.stderr: -266> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a200) adding con mode: crc 2024-09-12T00:42:10.534 INFO:tasks.workunit.client.0.smithi043.stderr: -265> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a200) adding con mode: secure 2024-09-12T00:42:10.534 INFO:tasks.workunit.client.0.smithi043.stderr: -264> 2024-09-12T00:42:10.330+0000 7fba92e189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:10.534 INFO:tasks.workunit.client.0.smithi043.stderr: -263> 2024-09-12T00:42:10.330+0000 7fba92e189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:10.534 INFO:tasks.workunit.client.0.smithi043.stderr: -262> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe2a49a348 EEXIST 2024-09-12T00:42:10.534 INFO:tasks.workunit.client.0.smithi043.stderr: -261> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:10.534 INFO:tasks.workunit.client.0.smithi043.stderr: -260> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:42:10.534 INFO:tasks.workunit.client.0.smithi043.stderr: -259> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient(hunting): picked mon.noname-c con 0x55aeb5206360 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:42:10.534 INFO:tasks.workunit.client.0.smithi043.stderr: -258> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient(hunting): picked mon.noname-b con 0x55aeb51d5ed0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:42:10.534 INFO:tasks.workunit.client.0.smithi043.stderr: -257> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient(hunting): picked mon.noname-a con 0x55aeb51f6de0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:42:10.534 INFO:tasks.workunit.client.0.smithi043.stderr: -256> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:10.534 INFO:tasks.workunit.client.0.smithi043.stderr: -255> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:10.534 INFO:tasks.workunit.client.0.smithi043.stderr: -254> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:10.534 INFO:tasks.workunit.client.0.smithi043.stderr: -253> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:10.535 INFO:tasks.workunit.client.0.smithi043.stderr: -252> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient(hunting): authenticate will time out at 2426.321638s 2024-09-12T00:42:10.535 INFO:tasks.workunit.client.0.smithi043.stderr: -251> 2024-09-12T00:42:10.330+0000 7fba9111f640 10 monclient(hunting): get_auth_request con 0x55aeb51f6de0 auth_method 0 2024-09-12T00:42:10.535 INFO:tasks.workunit.client.0.smithi043.stderr: -250> 2024-09-12T00:42:10.330+0000 7fba9111f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:10.535 INFO:tasks.workunit.client.0.smithi043.stderr: -249> 2024-09-12T00:42:10.330+0000 7fba9111f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:10.535 INFO:tasks.workunit.client.0.smithi043.stderr: -248> 2024-09-12T00:42:10.330+0000 7fba9111f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:10.535 INFO:tasks.workunit.client.0.smithi043.stderr: -247> 2024-09-12T00:42:10.330+0000 7fba9091e640 10 monclient(hunting): get_auth_request con 0x55aeb5206360 auth_method 0 2024-09-12T00:42:10.535 INFO:tasks.workunit.client.0.smithi043.stderr: -246> 2024-09-12T00:42:10.330+0000 7fba9091e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:10.535 INFO:tasks.workunit.client.0.smithi043.stderr: -245> 2024-09-12T00:42:10.330+0000 7fba9091e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:10.535 INFO:tasks.workunit.client.0.smithi043.stderr: -244> 2024-09-12T00:42:10.330+0000 7fba9091e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:10.535 INFO:tasks.workunit.client.0.smithi043.stderr: -243> 2024-09-12T00:42:10.330+0000 7fba9111f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:10.535 INFO:tasks.workunit.client.0.smithi043.stderr: -242> 2024-09-12T00:42:10.330+0000 7fba9111f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:10.535 INFO:tasks.workunit.client.0.smithi043.stderr: -241> 2024-09-12T00:42:10.330+0000 7fba9111f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:10.535 INFO:tasks.workunit.client.0.smithi043.stderr: -240> 2024-09-12T00:42:10.330+0000 7fba9091e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:10.536 INFO:tasks.workunit.client.0.smithi043.stderr: -239> 2024-09-12T00:42:10.330+0000 7fba9091e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:10.536 INFO:tasks.workunit.client.0.smithi043.stderr: -238> 2024-09-12T00:42:10.330+0000 7fba9091e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:10.536 INFO:tasks.workunit.client.0.smithi043.stderr: -237> 2024-09-12T00:42:10.330+0000 7fba9011d640 10 monclient(hunting): get_auth_request con 0x55aeb51d5ed0 auth_method 0 2024-09-12T00:42:10.536 INFO:tasks.workunit.client.0.smithi043.stderr: -236> 2024-09-12T00:42:10.330+0000 7fba9011d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:10.536 INFO:tasks.workunit.client.0.smithi043.stderr: -235> 2024-09-12T00:42:10.330+0000 7fba9011d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:10.536 INFO:tasks.workunit.client.0.smithi043.stderr: -234> 2024-09-12T00:42:10.330+0000 7fba9011d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:10.536 INFO:tasks.workunit.client.0.smithi043.stderr: -233> 2024-09-12T00:42:10.330+0000 7fba9111f640 10 monclient(hunting): handle_auth_done global_id 8223 payload 274 2024-09-12T00:42:10.536 INFO:tasks.workunit.client.0.smithi043.stderr: -232> 2024-09-12T00:42:10.330+0000 7fba9111f640 10 monclient: _finish_hunting 0 2024-09-12T00:42:10.536 INFO:tasks.workunit.client.0.smithi043.stderr: -231> 2024-09-12T00:42:10.330+0000 7fba9111f640 1 monclient: found mon.noname-a 2024-09-12T00:42:10.536 INFO:tasks.workunit.client.0.smithi043.stderr: -230> 2024-09-12T00:42:10.330+0000 7fba9111f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:42:10.536 INFO:tasks.workunit.client.0.smithi043.stderr: -229> 2024-09-12T00:42:10.330+0000 7fb967fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:10.536 INFO:tasks.workunit.client.0.smithi043.stderr: -228> 2024-09-12T00:42:10.330+0000 7fb967fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:10.536 INFO:tasks.workunit.client.0.smithi043.stderr: -227> 2024-09-12T00:42:10.330+0000 7fb967fff640 10 monclient: dump: 2024-09-12T00:42:10.536 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:10.537 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:10.537 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.537 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.537 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:10.537 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:10.537 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:10.537 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:10.537 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:10.537 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.537 INFO:tasks.workunit.client.0.smithi043.stderr: -226> 2024-09-12T00:42:10.330+0000 7fb967fff640 10 monclient: _finish_auth 0 2024-09-12T00:42:10.538 INFO:tasks.workunit.client.0.smithi043.stderr: -225> 2024-09-12T00:42:10.330+0000 7fb967fff640 10 monclient: _check_auth_tickets 2024-09-12T00:42:10.538 INFO:tasks.workunit.client.0.smithi043.stderr: -224> 2024-09-12T00:42:10.330+0000 7fb967fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:10.538 INFO:tasks.workunit.client.0.smithi043.stderr: -223> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 monclient: authenticate success, global_id 8223 2024-09-12T00:42:10.538 INFO:tasks.workunit.client.0.smithi043.stderr: -222> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient: get_monmap_and_config success 2024-09-12T00:42:10.538 INFO:tasks.workunit.client.0.smithi043.stderr: -221> 2024-09-12T00:42:10.330+0000 7fba92e189c0 4 set_mon_vals no callback set 2024-09-12T00:42:10.538 INFO:tasks.workunit.client.0.smithi043.stderr: -220> 2024-09-12T00:42:10.330+0000 7fb967fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:10.538 INFO:tasks.workunit.client.0.smithi043.stderr: -219> 2024-09-12T00:42:10.330+0000 7fb967fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:10.538 INFO:tasks.workunit.client.0.smithi043.stderr: -218> 2024-09-12T00:42:10.330+0000 7fb967fff640 10 monclient: dump: 2024-09-12T00:42:10.538 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:10.538 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:10.538 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.538 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.538 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:10.539 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:10.539 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:10.539 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:10.539 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:10.539 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.539 INFO:tasks.workunit.client.0.smithi043.stderr: -217> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient: shutdown 2024-09-12T00:42:10.539 INFO:tasks.workunit.client.0.smithi043.stderr: -216> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient: build_initial_monmap 2024-09-12T00:42:10.539 INFO:tasks.workunit.client.0.smithi043.stderr: -215> 2024-09-12T00:42:10.330+0000 7fba92e189c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:10.539 INFO:tasks.workunit.client.0.smithi043.stderr: -214> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient: monmap: 2024-09-12T00:42:10.539 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:42:10.539 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:10.539 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:42:10.539 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:42:10.539 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:10.540 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:10.540 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:42:10.540 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:42:10.540 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:42:10.540 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.540 INFO:tasks.workunit.client.0.smithi043.stderr: -213> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb52025c0) adding auth protocol: cephx 2024-09-12T00:42:10.540 INFO:tasks.workunit.client.0.smithi043.stderr: -212> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb52025c0) adding auth protocol: cephx 2024-09-12T00:42:10.540 INFO:tasks.workunit.client.0.smithi043.stderr: -211> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb52025c0) adding auth protocol: cephx 2024-09-12T00:42:10.540 INFO:tasks.workunit.client.0.smithi043.stderr: -210> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb52025c0) adding con mode: secure 2024-09-12T00:42:10.540 INFO:tasks.workunit.client.0.smithi043.stderr: -209> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb52025c0) adding con mode: crc 2024-09-12T00:42:10.540 INFO:tasks.workunit.client.0.smithi043.stderr: -208> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb52025c0) adding con mode: secure 2024-09-12T00:42:10.540 INFO:tasks.workunit.client.0.smithi043.stderr: -207> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb52025c0) adding con mode: crc 2024-09-12T00:42:10.540 INFO:tasks.workunit.client.0.smithi043.stderr: -206> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb52025c0) adding con mode: secure 2024-09-12T00:42:10.541 INFO:tasks.workunit.client.0.smithi043.stderr: -205> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb52025c0) adding con mode: crc 2024-09-12T00:42:10.541 INFO:tasks.workunit.client.0.smithi043.stderr: -204> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb52025c0) adding con mode: crc 2024-09-12T00:42:10.541 INFO:tasks.workunit.client.0.smithi043.stderr: -203> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb52025c0) adding con mode: secure 2024-09-12T00:42:10.541 INFO:tasks.workunit.client.0.smithi043.stderr: -202> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb52025c0) adding con mode: crc 2024-09-12T00:42:10.541 INFO:tasks.workunit.client.0.smithi043.stderr: -201> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb52025c0) adding con mode: secure 2024-09-12T00:42:10.541 INFO:tasks.workunit.client.0.smithi043.stderr: -200> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb52025c0) adding con mode: crc 2024-09-12T00:42:10.541 INFO:tasks.workunit.client.0.smithi043.stderr: -199> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb52025c0) adding con mode: secure 2024-09-12T00:42:10.541 INFO:tasks.workunit.client.0.smithi043.stderr: -198> 2024-09-12T00:42:10.330+0000 7fba92e189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:10.541 INFO:tasks.workunit.client.0.smithi043.stderr: -197> 2024-09-12T00:42:10.330+0000 7fba92e189c0 1 librados: starting msgr at 2024-09-12T00:42:10.541 INFO:tasks.workunit.client.0.smithi043.stderr: -196> 2024-09-12T00:42:10.330+0000 7fba92e189c0 1 librados: starting objecter 2024-09-12T00:42:10.541 INFO:tasks.workunit.client.0.smithi043.stderr: -195> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55aeb5200180 EEXIST 2024-09-12T00:42:10.541 INFO:tasks.workunit.client.0.smithi043.stderr: -194> 2024-09-12T00:42:10.330+0000 7fba92e189c0 1 librados: setting wanted keys 2024-09-12T00:42:10.541 INFO:tasks.workunit.client.0.smithi043.stderr: -193> 2024-09-12T00:42:10.330+0000 7fba92e189c0 1 librados: calling monclient init 2024-09-12T00:42:10.542 INFO:tasks.workunit.client.0.smithi043.stderr: -192> 2024-09-12T00:42:10.330+0000 7fba92e189c0 10 monclient: init 2024-09-12T00:42:10.542 INFO:tasks.workunit.client.0.smithi043.stderr: -191> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51b4790) adding auth protocol: cephx 2024-09-12T00:42:10.542 INFO:tasks.workunit.client.0.smithi043.stderr: -190> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51b4790) adding auth protocol: cephx 2024-09-12T00:42:10.542 INFO:tasks.workunit.client.0.smithi043.stderr: -189> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51b4790) adding auth protocol: cephx 2024-09-12T00:42:10.542 INFO:tasks.workunit.client.0.smithi043.stderr: -188> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51b4790) adding con mode: secure 2024-09-12T00:42:10.542 INFO:tasks.workunit.client.0.smithi043.stderr: -187> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51b4790) adding con mode: crc 2024-09-12T00:42:10.542 INFO:tasks.workunit.client.0.smithi043.stderr: -186> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51b4790) adding con mode: secure 2024-09-12T00:42:10.542 INFO:tasks.workunit.client.0.smithi043.stderr: -185> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51b4790) adding con mode: crc 2024-09-12T00:42:10.542 INFO:tasks.workunit.client.0.smithi043.stderr: -184> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51b4790) adding con mode: secure 2024-09-12T00:42:10.542 INFO:tasks.workunit.client.0.smithi043.stderr: -183> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51b4790) adding con mode: crc 2024-09-12T00:42:10.542 INFO:tasks.workunit.client.0.smithi043.stderr: -182> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51b4790) adding con mode: crc 2024-09-12T00:42:10.542 INFO:tasks.workunit.client.0.smithi043.stderr: -181> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51b4790) adding con mode: secure 2024-09-12T00:42:10.542 INFO:tasks.workunit.client.0.smithi043.stderr: -180> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51b4790) adding con mode: crc 2024-09-12T00:42:10.543 INFO:tasks.workunit.client.0.smithi043.stderr: -179> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51b4790) adding con mode: secure 2024-09-12T00:42:10.543 INFO:tasks.workunit.client.0.smithi043.stderr: -178> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51b4790) adding con mode: crc 2024-09-12T00:42:10.543 INFO:tasks.workunit.client.0.smithi043.stderr: -177> 2024-09-12T00:42:10.330+0000 7fba92e189c0 5 AuthRegistry(0x55aeb51b4790) adding con mode: secure 2024-09-12T00:42:10.543 INFO:tasks.workunit.client.0.smithi043.stderr: -176> 2024-09-12T00:42:10.330+0000 7fba92e189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:10.543 INFO:tasks.workunit.client.0.smithi043.stderr: -175> 2024-09-12T00:42:10.334+0000 7fba92e189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:10.543 INFO:tasks.workunit.client.0.smithi043.stderr: -174> 2024-09-12T00:42:10.334+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command rotate-key cmddesc rotate-key hook 0x55aeb51b48d8 EEXIST 2024-09-12T00:42:10.543 INFO:tasks.workunit.client.0.smithi043.stderr: -173> 2024-09-12T00:42:10.334+0000 7fba92e189c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:10.543 INFO:tasks.workunit.client.0.smithi043.stderr: -172> 2024-09-12T00:42:10.334+0000 7fba92e189c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:42:10.543 INFO:tasks.workunit.client.0.smithi043.stderr: -171> 2024-09-12T00:42:10.334+0000 7fba92e189c0 10 monclient(hunting): picked mon.noname-c con 0x55aeb51d5ed0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:42:10.543 INFO:tasks.workunit.client.0.smithi043.stderr: -170> 2024-09-12T00:42:10.334+0000 7fba92e189c0 10 monclient(hunting): picked mon.noname-a con 0x55aeb51f6de0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:42:10.543 INFO:tasks.workunit.client.0.smithi043.stderr: -169> 2024-09-12T00:42:10.334+0000 7fba92e189c0 10 monclient(hunting): picked mon.noname-b con 0x55aeb5206360 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:42:10.543 INFO:tasks.workunit.client.0.smithi043.stderr: -168> 2024-09-12T00:42:10.334+0000 7fba92e189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:10.543 INFO:tasks.workunit.client.0.smithi043.stderr: -167> 2024-09-12T00:42:10.334+0000 7fba92e189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:10.543 INFO:tasks.workunit.client.0.smithi043.stderr: -166> 2024-09-12T00:42:10.334+0000 7fba92e189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:10.544 INFO:tasks.workunit.client.0.smithi043.stderr: -165> 2024-09-12T00:42:10.334+0000 7fba92e189c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:10.544 INFO:tasks.workunit.client.0.smithi043.stderr: -164> 2024-09-12T00:42:10.334+0000 7fba92e189c0 10 monclient(hunting): authenticate will time out at 2426.324349s 2024-09-12T00:42:10.544 INFO:tasks.workunit.client.0.smithi043.stderr: -163> 2024-09-12T00:42:10.334+0000 7fba9091e640 10 monclient(hunting): get_auth_request con 0x55aeb51d5ed0 auth_method 0 2024-09-12T00:42:10.544 INFO:tasks.workunit.client.0.smithi043.stderr: -162> 2024-09-12T00:42:10.334+0000 7fba9091e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:10.544 INFO:tasks.workunit.client.0.smithi043.stderr: -161> 2024-09-12T00:42:10.334+0000 7fba9091e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:10.544 INFO:tasks.workunit.client.0.smithi043.stderr: -160> 2024-09-12T00:42:10.334+0000 7fba9091e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:10.544 INFO:tasks.workunit.client.0.smithi043.stderr: -159> 2024-09-12T00:42:10.334+0000 7fba9011d640 10 monclient(hunting): get_auth_request con 0x55aeb51f6de0 auth_method 0 2024-09-12T00:42:10.544 INFO:tasks.workunit.client.0.smithi043.stderr: -158> 2024-09-12T00:42:10.334+0000 7fba9011d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:10.544 INFO:tasks.workunit.client.0.smithi043.stderr: -157> 2024-09-12T00:42:10.334+0000 7fba9011d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:10.544 INFO:tasks.workunit.client.0.smithi043.stderr: -156> 2024-09-12T00:42:10.334+0000 7fba9011d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:10.544 INFO:tasks.workunit.client.0.smithi043.stderr: -155> 2024-09-12T00:42:10.334+0000 7fba9091e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:10.544 INFO:tasks.workunit.client.0.smithi043.stderr: -154> 2024-09-12T00:42:10.334+0000 7fba9091e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:10.545 INFO:tasks.workunit.client.0.smithi043.stderr: -153> 2024-09-12T00:42:10.334+0000 7fba9091e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:10.545 INFO:tasks.workunit.client.0.smithi043.stderr: -152> 2024-09-12T00:42:10.334+0000 7fba9011d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:10.545 INFO:tasks.workunit.client.0.smithi043.stderr: -151> 2024-09-12T00:42:10.334+0000 7fba9011d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:10.545 INFO:tasks.workunit.client.0.smithi043.stderr: -150> 2024-09-12T00:42:10.334+0000 7fba9011d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:10.545 INFO:tasks.workunit.client.0.smithi043.stderr: -149> 2024-09-12T00:42:10.334+0000 7fba9091e640 10 monclient(hunting): handle_auth_done global_id 7826 payload 824 2024-09-12T00:42:10.545 INFO:tasks.workunit.client.0.smithi043.stderr: -148> 2024-09-12T00:42:10.334+0000 7fba9091e640 10 monclient: _finish_hunting 0 2024-09-12T00:42:10.545 INFO:tasks.workunit.client.0.smithi043.stderr: -147> 2024-09-12T00:42:10.334+0000 7fba9091e640 1 monclient: found mon.noname-c 2024-09-12T00:42:10.545 INFO:tasks.workunit.client.0.smithi043.stderr: -146> 2024-09-12T00:42:10.334+0000 7fba9091e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:42:10.545 INFO:tasks.workunit.client.0.smithi043.stderr: -145> 2024-09-12T00:42:10.334+0000 7fba9111f640 10 monclient: get_auth_request con 0x55aeb5206360 auth_method 0 2024-09-12T00:42:10.545 INFO:tasks.workunit.client.0.smithi043.stderr: -144> 2024-09-12T00:42:10.334+0000 7fb9667fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:10.545 INFO:tasks.workunit.client.0.smithi043.stderr: -143> 2024-09-12T00:42:10.334+0000 7fb9667fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:42:10.545 INFO:tasks.workunit.client.0.smithi043.stderr: -142> 2024-09-12T00:42:10.334+0000 7fb9667fc640 10 monclient: dump: 2024-09-12T00:42:10.545 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:10.546 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:10.546 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.546 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.546 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:10.546 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:10.546 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:10.546 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:10.546 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:10.546 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.546 INFO:tasks.workunit.client.0.smithi043.stderr: -141> 2024-09-12T00:42:10.334+0000 7fb9667fc640 10 monclient: _finish_auth 0 2024-09-12T00:42:10.546 INFO:tasks.workunit.client.0.smithi043.stderr: -140> 2024-09-12T00:42:10.334+0000 7fb9667fc640 10 monclient: _check_auth_tickets 2024-09-12T00:42:10.546 INFO:tasks.workunit.client.0.smithi043.stderr: -139> 2024-09-12T00:42:10.334+0000 7fb9667fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:10.546 INFO:tasks.workunit.client.0.smithi043.stderr: -138> 2024-09-12T00:42:10.334+0000 7fb9667fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:10.546 INFO:tasks.workunit.client.0.smithi043.stderr: -137> 2024-09-12T00:42:10.334+0000 7fb9667fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:42:10.547 INFO:tasks.workunit.client.0.smithi043.stderr: -136> 2024-09-12T00:42:10.334+0000 7fb9667fc640 10 monclient: dump: 2024-09-12T00:42:10.547 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:10.547 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:10.547 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.547 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:10.547 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:10.547 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:10.547 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:10.547 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:10.547 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:10.547 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.547 INFO:tasks.workunit.client.0.smithi043.stderr: -135> 2024-09-12T00:42:10.334+0000 7fb967fff640 4 set_mon_vals no callback set 2024-09-12T00:42:10.547 INFO:tasks.workunit.client.0.smithi043.stderr: -134> 2024-09-12T00:42:10.334+0000 7fba92e189c0 5 monclient: authenticate success, global_id 7826 2024-09-12T00:42:10.548 INFO:tasks.workunit.client.0.smithi043.stderr: -133> 2024-09-12T00:42:10.334+0000 7fba92e189c0 10 monclient: _renew_subs 2024-09-12T00:42:10.548 INFO:tasks.workunit.client.0.smithi043.stderr: -132> 2024-09-12T00:42:10.334+0000 7fba92e189c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:42:10.548 INFO:tasks.workunit.client.0.smithi043.stderr: -131> 2024-09-12T00:42:10.334+0000 7fba92e189c0 10 monclient: _renew_subs 2024-09-12T00:42:10.548 INFO:tasks.workunit.client.0.smithi043.stderr: -130> 2024-09-12T00:42:10.334+0000 7fba92e189c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:42:10.548 INFO:tasks.workunit.client.0.smithi043.stderr: -129> 2024-09-12T00:42:10.334+0000 7fba92e189c0 1 librados: init done 2024-09-12T00:42:10.548 INFO:tasks.workunit.client.0.smithi043.stderr: -128> 2024-09-12T00:42:10.334+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command cr dump hook 0x55aeb51f7998 2024-09-12T00:42:10.548 INFO:tasks.workunit.client.0.smithi043.stderr: -127> 2024-09-12T00:42:10.334+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.548 INFO:tasks.workunit.client.0.smithi043.stderr: -126> 2024-09-12T00:42:10.334+0000 7fb9667fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:10.548 INFO:tasks.workunit.client.0.smithi043.stderr: -125> 2024-09-12T00:42:10.334+0000 7fb9667fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:42:10.548 INFO:tasks.workunit.client.0.smithi043.stderr: -124> 2024-09-12T00:42:10.334+0000 7fb9667fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:42:10.548 INFO:tasks.workunit.client.0.smithi043.stderr: -123> 2024-09-12T00:42:10.338+0000 7fba9011d640 10 monclient: get_auth_request con 0x7fb95c070ba0 auth_method 0 2024-09-12T00:42:10.548 INFO:tasks.workunit.client.0.smithi043.stderr: -122> 2024-09-12T00:42:10.338+0000 7fba9111f640 10 monclient: get_auth_request con 0x55aeb521fc20 auth_method 0 2024-09-12T00:42:10.549 INFO:tasks.workunit.client.0.smithi043.stderr: -121> 2024-09-12T00:42:10.338+0000 7fba92e189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:10.549 INFO:tasks.workunit.client.0.smithi043.stderr: -120> 2024-09-12T00:42:10.338+0000 7fba92e189c0 20 realm 2024-09-12T00:42:10.549 INFO:tasks.workunit.client.0.smithi043.stderr: -119> 2024-09-12T00:42:10.338+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.549 INFO:tasks.workunit.client.0.smithi043.stderr: -118> 2024-09-12T00:42:10.338+0000 7fba92e189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:10.549 INFO:tasks.workunit.client.0.smithi043.stderr: -117> 2024-09-12T00:42:10.338+0000 7fba92e189c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:10.549 INFO:tasks.workunit.client.0.smithi043.stderr: -116> 2024-09-12T00:42:10.338+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.549 INFO:tasks.workunit.client.0.smithi043.stderr: -115> 2024-09-12T00:42:10.338+0000 7fba92e189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:10.549 INFO:tasks.workunit.client.0.smithi043.stderr: -114> 2024-09-12T00:42:10.338+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.549 INFO:tasks.workunit.client.0.smithi043.stderr: -113> 2024-09-12T00:42:10.338+0000 7fba9091e640 10 monclient: get_auth_request con 0x55aeb5223ee0 auth_method 0 2024-09-12T00:42:10.549 INFO:tasks.workunit.client.0.smithi043.stderr: -112> 2024-09-12T00:42:10.338+0000 7fba92e189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:10.549 INFO:tasks.workunit.client.0.smithi043.stderr: -111> 2024-09-12T00:42:10.338+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.549 INFO:tasks.workunit.client.0.smithi043.stderr: -110> 2024-09-12T00:42:10.338+0000 7fba9011d640 10 monclient: get_auth_request con 0x55aeb5227740 auth_method 0 2024-09-12T00:42:10.549 INFO:tasks.workunit.client.0.smithi043.stderr: -109> 2024-09-12T00:42:10.342+0000 7fba92e189c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:10.550 INFO:tasks.workunit.client.0.smithi043.stderr: -108> 2024-09-12T00:42:10.342+0000 7fba92e189c0 20 searching for the correct realm 2024-09-12T00:42:10.550 INFO:tasks.workunit.client.0.smithi043.stderr: -107> 2024-09-12T00:42:10.342+0000 7fba9111f640 10 monclient: get_auth_request con 0x55aeb522c520 auth_method 0 2024-09-12T00:42:10.550 INFO:tasks.workunit.client.0.smithi043.stderr: -106> 2024-09-12T00:42:10.342+0000 7fba9091e640 10 monclient: get_auth_request con 0x7fba8801e460 auth_method 0 2024-09-12T00:42:10.550 INFO:tasks.workunit.client.0.smithi043.stderr: -105> 2024-09-12T00:42:10.342+0000 7fba9011d640 10 monclient: get_auth_request con 0x7fba780db040 auth_method 0 2024-09-12T00:42:10.550 INFO:tasks.workunit.client.0.smithi043.stderr: -104> 2024-09-12T00:42:10.346+0000 7fba9011d640 0 -- 172.21.15.43:0/1345457052 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fba780db040 msgr2=0x7fba780e7910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:10.550 INFO:tasks.workunit.client.0.smithi043.stderr: -103> 2024-09-12T00:42:10.346+0000 7fb9667fc640 1 client.7826.objecter ms_handle_reset 0x7fba780db040 session 0x7fba780d2070 osd.4 2024-09-12T00:42:10.550 INFO:tasks.workunit.client.0.smithi043.stderr: -102> 2024-09-12T00:42:10.346+0000 7fb9667fc640 10 monclient: _renew_subs 2024-09-12T00:42:10.550 INFO:tasks.workunit.client.0.smithi043.stderr: -101> 2024-09-12T00:42:10.346+0000 7fb9667fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:42:10.550 INFO:tasks.workunit.client.0.smithi043.stderr: -100> 2024-09-12T00:42:10.346+0000 7fba9111f640 10 monclient: get_auth_request con 0x7fba780e53e0 auth_method 0 2024-09-12T00:42:10.550 INFO:tasks.workunit.client.0.smithi043.stderr: -99> 2024-09-12T00:42:10.346+0000 7fba9011d640 10 monclient: get_auth_request con 0x7fb95c080c40 auth_method 0 2024-09-12T00:42:10.550 INFO:tasks.workunit.client.0.smithi043.stderr: -98> 2024-09-12T00:42:10.350+0000 7fba9091e640 10 monclient: get_auth_request con 0x7fba780fa430 auth_method 0 2024-09-12T00:42:10.550 INFO:tasks.workunit.client.0.smithi043.stderr: -97> 2024-09-12T00:42:10.354+0000 7fba9011d640 0 -- 172.21.15.43:0/1345457052 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fb95c080c40 msgr2=0x7fb95c083070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:10.550 INFO:tasks.workunit.client.0.smithi043.stderr: -96> 2024-09-12T00:42:10.354+0000 7fb9667fc640 1 client.7826.objecter ms_handle_reset 0x7fb95c080c40 session 0x7fba780d2070 osd.4 2024-09-12T00:42:10.551 INFO:tasks.workunit.client.0.smithi043.stderr: -95> 2024-09-12T00:42:10.354+0000 7fba9011d640 10 monclient: get_auth_request con 0x7fba780db040 auth_method 0 2024-09-12T00:42:10.551 INFO:tasks.workunit.client.0.smithi043.stderr: -94> 2024-09-12T00:42:10.358+0000 7fba92e189c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:42:10.551 INFO:tasks.workunit.client.0.smithi043.stderr: -93> 2024-09-12T00:42:10.358+0000 7fba92e189c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:10.551 INFO:tasks.workunit.client.0.smithi043.stderr: -92> 2024-09-12T00:42:10.358+0000 7fba92e189c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:10.551 INFO:tasks.workunit.client.0.smithi043.stderr: -91> 2024-09-12T00:42:10.358+0000 7fba92e189c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:42:10.551 INFO:tasks.workunit.client.0.smithi043.stderr: -90> 2024-09-12T00:42:10.358+0000 7fba92e189c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:10.551 INFO:tasks.workunit.client.0.smithi043.stderr: -89> 2024-09-12T00:42:10.358+0000 7fba92e189c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:10.551 INFO:tasks.workunit.client.0.smithi043.stderr: -88> 2024-09-12T00:42:10.358+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.551 INFO:tasks.workunit.client.0.smithi043.stderr: -87> 2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:10.551 INFO:tasks.workunit.client.0.smithi043.stderr: -86> 2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.551 INFO:tasks.workunit.client.0.smithi043.stderr: -85> 2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:10.551 INFO:tasks.workunit.client.0.smithi043.stderr: -84> 2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.551 INFO:tasks.workunit.client.0.smithi043.stderr: -83> 2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:10.552 INFO:tasks.workunit.client.0.smithi043.stderr: -82> 2024-09-12T00:42:10.362+0000 7fba92e189c0 20 zone default found 2024-09-12T00:42:10.552 INFO:tasks.workunit.client.0.smithi043.stderr: -81> 2024-09-12T00:42:10.362+0000 7fba92e189c0 4 Realm: () 2024-09-12T00:42:10.552 INFO:tasks.workunit.client.0.smithi043.stderr: -80> 2024-09-12T00:42:10.362+0000 7fba92e189c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:42:10.552 INFO:tasks.workunit.client.0.smithi043.stderr: -79> 2024-09-12T00:42:10.362+0000 7fba92e189c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:42:10.552 INFO:tasks.workunit.client.0.smithi043.stderr: -78> 2024-09-12T00:42:10.362+0000 7fba92e189c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:10.552 INFO:tasks.workunit.client.0.smithi043.stderr: -77> 2024-09-12T00:42:10.362+0000 7fba92e189c0 20 zonegroup default 2024-09-12T00:42:10.552 INFO:tasks.workunit.client.0.smithi043.stderr: -76> 2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.552 INFO:tasks.workunit.client.0.smithi043.stderr: -75> 2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:10.552 INFO:tasks.workunit.client.0.smithi043.stderr: -74> 2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.552 INFO:tasks.workunit.client.0.smithi043.stderr: -73> 2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:10.552 INFO:tasks.workunit.client.0.smithi043.stderr: -72> 2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.552 INFO:tasks.workunit.client.0.smithi043.stderr: -71> 2024-09-12T00:42:10.362+0000 7fba92e189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:10.553 INFO:tasks.workunit.client.0.smithi043.stderr: -70> 2024-09-12T00:42:10.362+0000 7fba92e189c0 20 started sync module instance, tier type = 2024-09-12T00:42:10.553 INFO:tasks.workunit.client.0.smithi043.stderr: -69> 2024-09-12T00:42:10.362+0000 7fba92e189c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:42:10.553 INFO:tasks.workunit.client.0.smithi043.stderr: -68> 2024-09-12T00:42:10.378+0000 7fba92e189c0 20 add_watcher() i=0 2024-09-12T00:42:10.553 INFO:tasks.workunit.client.0.smithi043.stderr: -67> 2024-09-12T00:42:10.378+0000 7fba92e189c0 20 add_watcher() i=1 2024-09-12T00:42:10.553 INFO:tasks.workunit.client.0.smithi043.stderr: -66> 2024-09-12T00:42:10.378+0000 7fba92e189c0 20 add_watcher() i=2 2024-09-12T00:42:10.553 INFO:tasks.workunit.client.0.smithi043.stderr: -65> 2024-09-12T00:42:10.378+0000 7fba92e189c0 20 add_watcher() i=3 2024-09-12T00:42:10.553 INFO:tasks.workunit.client.0.smithi043.stderr: -64> 2024-09-12T00:42:10.378+0000 7fba92e189c0 20 add_watcher() i=4 2024-09-12T00:42:10.553 INFO:tasks.workunit.client.0.smithi043.stderr: -63> 2024-09-12T00:42:10.378+0000 7fba92e189c0 20 add_watcher() i=5 2024-09-12T00:42:10.553 INFO:tasks.workunit.client.0.smithi043.stderr: -62> 2024-09-12T00:42:10.378+0000 7fba92e189c0 20 add_watcher() i=6 2024-09-12T00:42:10.553 INFO:tasks.workunit.client.0.smithi043.stderr: -61> 2024-09-12T00:42:10.382+0000 7fba92e189c0 20 add_watcher() i=7 2024-09-12T00:42:10.553 INFO:tasks.workunit.client.0.smithi043.stderr: -60> 2024-09-12T00:42:10.382+0000 7fba92e189c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:10.553 INFO:tasks.workunit.client.0.smithi043.stderr: -59> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a6e0) adding auth protocol: cephx 2024-09-12T00:42:10.553 INFO:tasks.workunit.client.0.smithi043.stderr: -58> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a6e0) adding auth protocol: cephx 2024-09-12T00:42:10.554 INFO:tasks.workunit.client.0.smithi043.stderr: -57> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a6e0) adding auth protocol: cephx 2024-09-12T00:42:10.554 INFO:tasks.workunit.client.0.smithi043.stderr: -56> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a6e0) adding con mode: secure 2024-09-12T00:42:10.554 INFO:tasks.workunit.client.0.smithi043.stderr: -55> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a6e0) adding con mode: crc 2024-09-12T00:42:10.554 INFO:tasks.workunit.client.0.smithi043.stderr: -54> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a6e0) adding con mode: secure 2024-09-12T00:42:10.554 INFO:tasks.workunit.client.0.smithi043.stderr: -53> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a6e0) adding con mode: crc 2024-09-12T00:42:10.554 INFO:tasks.workunit.client.0.smithi043.stderr: -52> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a6e0) adding con mode: secure 2024-09-12T00:42:10.554 INFO:tasks.workunit.client.0.smithi043.stderr: -51> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a6e0) adding con mode: crc 2024-09-12T00:42:10.554 INFO:tasks.workunit.client.0.smithi043.stderr: -50> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a6e0) adding con mode: crc 2024-09-12T00:42:10.554 INFO:tasks.workunit.client.0.smithi043.stderr: -49> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a6e0) adding con mode: secure 2024-09-12T00:42:10.554 INFO:tasks.workunit.client.0.smithi043.stderr: -48> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a6e0) adding con mode: crc 2024-09-12T00:42:10.554 INFO:tasks.workunit.client.0.smithi043.stderr: -47> 2024-09-12T00:42:10.382+0000 7fb9477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:10.554 INFO:tasks.workunit.client.0.smithi043.stderr: -46> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a6e0) adding con mode: secure 2024-09-12T00:42:10.554 INFO:tasks.workunit.client.0.smithi043.stderr: -45> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a6e0) adding con mode: crc 2024-09-12T00:42:10.554 INFO:tasks.workunit.client.0.smithi043.stderr: -44> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 AuthRegistry(0x7ffe2a49a6e0) adding con mode: secure 2024-09-12T00:42:10.554 INFO:tasks.workunit.client.0.smithi043.stderr: -43> 2024-09-12T00:42:10.382+0000 7fba92e189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:10.555 INFO:tasks.workunit.client.0.smithi043.stderr: -42> 2024-09-12T00:42:10.382+0000 7fba92e189c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:10.555 INFO:tasks.workunit.client.0.smithi043.stderr: -41> 2024-09-12T00:42:10.382+0000 7fba92e189c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:10.555 INFO:tasks.workunit.client.0.smithi043.stderr: -40> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command cache list hook 0x55aeb51fca90 2024-09-12T00:42:10.555 INFO:tasks.workunit.client.0.smithi043.stderr: -39> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command cache inspect hook 0x55aeb51fca90 2024-09-12T00:42:10.555 INFO:tasks.workunit.client.0.smithi043.stderr: -38> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command cache erase hook 0x55aeb51fca90 2024-09-12T00:42:10.555 INFO:tasks.workunit.client.0.smithi043.stderr: -37> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command cache zap hook 0x55aeb51fca90 2024-09-12T00:42:10.555 INFO:tasks.workunit.client.0.smithi043.stderr: -36> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 note: GC not initialized 2024-09-12T00:42:10.555 INFO:tasks.workunit.client.0.smithi043.stderr: -35> 2024-09-12T00:42:10.382+0000 7fb9467e4640 20 reqs_thread_entry: start 2024-09-12T00:42:10.555 INFO:tasks.workunit.client.0.smithi043.stderr: -34> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command sync trace show hook 0x7fba88004da0 2024-09-12T00:42:10.555 INFO:tasks.workunit.client.0.smithi043.stderr: -33> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command sync trace history hook 0x7fba88004da0 2024-09-12T00:42:10.555 INFO:tasks.workunit.client.0.smithi043.stderr: -32> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command sync trace active hook 0x7fba88004da0 2024-09-12T00:42:10.555 INFO:tasks.workunit.client.0.smithi043.stderr: -31> 2024-09-12T00:42:10.382+0000 7fba92e189c0 5 asok(0x55aeb4f2a2b0) register_command sync trace active_short hook 0x7fba88004da0 2024-09-12T00:42:10.555 INFO:tasks.workunit.client.0.smithi043.stderr: -30> 2024-09-12T00:42:10.382+0000 7fba92e189c0 20 init_complete bucket index max shards: 11 2024-09-12T00:42:10.556 INFO:tasks.workunit.client.0.smithi043.stderr: -29> 2024-09-12T00:42:10.386+0000 7fba92e189c0 20 Filter name: none 2024-09-12T00:42:10.556 INFO:tasks.workunit.client.0.smithi043.stderr: -28> 2024-09-12T00:42:10.386+0000 7fb93f7fe640 20 reqs_thread_entry: start 2024-09-12T00:42:10.556 INFO:tasks.workunit.client.0.smithi043.stderr: -27> 2024-09-12T00:42:10.386+0000 7fba92e189c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:42:10.556 INFO:tasks.workunit.client.0.smithi043.stderr: -26> 2024-09-12T00:42:10.386+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.556 INFO:tasks.workunit.client.0.smithi043.stderr: -25> 2024-09-12T00:42:10.386+0000 7fba92e189c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:42:10.556 INFO:tasks.workunit.client.0.smithi043.stderr: -24> 2024-09-12T00:42:10.386+0000 7fba92e189c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:42:10.556 INFO:tasks.workunit.client.0.smithi043.stderr: -23> 2024-09-12T00:42:10.386+0000 7fba92e189c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:42:10.556 INFO:tasks.workunit.client.0.smithi043.stderr: -22> 2024-09-12T00:42:10.386+0000 7fba92e189c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 : miss 2024-09-12T00:42:10.556 INFO:tasks.workunit.client.0.smithi043.stderr: -21> 2024-09-12T00:42:10.386+0000 7fba92e189c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.556 INFO:tasks.workunit.client.0.smithi043.stderr: -20> 2024-09-12T00:42:10.386+0000 7fba92e189c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:42:10.556 INFO:tasks.workunit.client.0.smithi043.stderr: -19> 2024-09-12T00:42:10.386+0000 7fba92e189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:42:10.556 INFO:tasks.workunit.client.0.smithi043.stderr: -18> 2024-09-12T00:42:10.386+0000 7fba92e189c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:42:10.557 INFO:tasks.workunit.client.0.smithi043.stderr: -17> 2024-09-12T00:42:10.386+0000 7fba92e189c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:42:10.557 INFO:tasks.workunit.client.0.smithi043.stderr: -16> 2024-09-12T00:42:10.386+0000 7fba92e189c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:42:10.557 INFO:tasks.workunit.client.0.smithi043.stderr: -15> 2024-09-12T00:42:10.386+0000 7fba92e189c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 2024-09-12T00:42:10.557 INFO:tasks.workunit.client.0.smithi043.stderr: -14> 2024-09-12T00:42:10.390+0000 7fba92e189c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:42:10.557 INFO:tasks.workunit.client.0.smithi043.stderr: -13> 2024-09-12T00:42:10.406+0000 7fba92e189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:42:10.557 INFO:tasks.workunit.client.0.smithi043.stderr: -12> 2024-09-12T00:42:10.406+0000 7fba92e189c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:42:10.557 INFO:tasks.workunit.client.0.smithi043.stderr: -11> 2024-09-12T00:42:10.406+0000 7fba92e189c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:42:10.557 INFO:tasks.workunit.client.0.smithi043.stderr: -10> 2024-09-12T00:42:10.406+0000 7fba92e189c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17, ofs0, ns] 2024-09-12T00:42:10.557 INFO:tasks.workunit.client.0.smithi043.stderr: -9> 2024-09-12T00:42:10.406+0000 7fb9677fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333529 cookie 94208851659280 notifier 7826 bl.length()=827 2024-09-12T00:42:10.557 INFO:tasks.workunit.client.0.smithi043.stderr: -8> 2024-09-12T00:42:10.406+0000 7fb9677fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:42:10.557 INFO:tasks.workunit.client.0.smithi043.stderr: -7> 2024-09-12T00:42:10.406+0000 7fb9677fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:42:10.557 INFO:tasks.workunit.client.0.smithi043.stderr: -6> 2024-09-12T00:42:10.406+0000 7fb9677fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:42:10.557 INFO:tasks.workunit.client.0.smithi043.stderr: -5> 2024-09-12T00:42:10.406+0000 7fba92e189c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_sources= new_sources= 2024-09-12T00:42:10.558 INFO:tasks.workunit.client.0.smithi043.stderr: -4> 2024-09-12T00:42:10.406+0000 7fba92e189c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential sources added=[] removed=[] 2024-09-12T00:42:10.558 INFO:tasks.workunit.client.0.smithi043.stderr: -3> 2024-09-12T00:42:10.406+0000 7fba92e189c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_dests= new_dests= 2024-09-12T00:42:10.558 INFO:tasks.workunit.client.0.smithi043.stderr: -2> 2024-09-12T00:42:10.406+0000 7fba92e189c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential dests added=[] removed=[] 2024-09-12T00:42:10.558 INFO:tasks.workunit.client.0.smithi043.stderr: -1> 2024-09-12T00:42:10.414+0000 7fba92e189c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fba92e189c0 time 2024-09-12T00:42:10.418728+0000 2024-09-12T00:42:10.558 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:42:10.558 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.558 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:10.558 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fba966f22eb] 2024-09-12T00:42:10.558 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fba966f249f] 2024-09-12T00:42:10.558 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aeb2444cc1] 2024-09-12T00:42:10.558 INFO:tasks.workunit.client.0.smithi043.stderr: 4: radosgw-admin(+0x1422aac) [0x55aeb2ea2aac] 2024-09-12T00:42:10.558 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55aeb2459ced] 2024-09-12T00:42:10.558 INFO:tasks.workunit.client.0.smithi043.stderr: 6: main() 2024-09-12T00:42:10.559 INFO:tasks.workunit.client.0.smithi043.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fba95558d90] 2024-09-12T00:42:10.559 INFO:tasks.workunit.client.0.smithi043.stderr: 8: __libc_start_main() 2024-09-12T00:42:10.559 INFO:tasks.workunit.client.0.smithi043.stderr: 9: _start() 2024-09-12T00:42:10.559 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.559 INFO:tasks.workunit.client.0.smithi043.stderr: 0> 2024-09-12T00:42:10.418+0000 7fba92e189c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:42:10.559 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7fba92e189c0 thread_name:radosgw-admin 2024-09-12T00:42:10.559 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.559 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:10.559 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fba95571520] 2024-09-12T00:42:10.559 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:42:10.559 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:42:10.559 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:42:10.559 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fba966f2345] 2024-09-12T00:42:10.559 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fba966f249f] 2024-09-12T00:42:10.560 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aeb2444cc1] 2024-09-12T00:42:10.560 INFO:tasks.workunit.client.0.smithi043.stderr: 8: radosgw-admin(+0x1422aac) [0x55aeb2ea2aac] 2024-09-12T00:42:10.560 INFO:tasks.workunit.client.0.smithi043.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55aeb2459ced] 2024-09-12T00:42:10.560 INFO:tasks.workunit.client.0.smithi043.stderr: 10: main() 2024-09-12T00:42:10.560 INFO:tasks.workunit.client.0.smithi043.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fba95558d90] 2024-09-12T00:42:10.560 INFO:tasks.workunit.client.0.smithi043.stderr: 12: __libc_start_main() 2024-09-12T00:42:10.560 INFO:tasks.workunit.client.0.smithi043.stderr: 13: _start() 2024-09-12T00:42:10.560 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:42:10.560 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:10.560 INFO:tasks.workunit.client.0.smithi043.stderr:--- logging levels --- 2024-09-12T00:42:10.560 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 none 2024-09-12T00:42:10.560 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 lockdep 2024-09-12T00:42:10.560 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 context 2024-09-12T00:42:10.561 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 crush 2024-09-12T00:42:10.561 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds 2024-09-12T00:42:10.561 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_balancer 2024-09-12T00:42:10.561 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_locker 2024-09-12T00:42:10.561 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log 2024-09-12T00:42:10.561 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log_expire 2024-09-12T00:42:10.561 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_migrator 2024-09-12T00:42:10.561 INFO:tasks.workunit.client.0.smithi043.stderr: 3/ 5 mds_quiesce 2024-09-12T00:42:10.561 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 buffer 2024-09-12T00:42:10.561 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 timer 2024-09-12T00:42:10.561 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 filer 2024-09-12T00:42:10.561 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 striper 2024-09-12T00:42:10.561 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 objecter 2024-09-12T00:42:10.561 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rados 2024-09-12T00:42:10.562 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd 2024-09-12T00:42:10.562 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_mirror 2024-09-12T00:42:10.562 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_replay 2024-09-12T00:42:10.562 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_pwl 2024-09-12T00:42:10.562 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 journaler 2024-09-12T00:42:10.562 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objectcacher 2024-09-12T00:42:10.562 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:42:10.562 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 client 2024-09-12T00:42:10.562 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 osd 2024-09-12T00:42:10.562 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 optracker 2024-09-12T00:42:10.562 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objclass 2024-09-12T00:42:10.562 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 filestore 2024-09-12T00:42:10.562 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 journal 2024-09-12T00:42:10.562 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 ms 2024-09-12T00:42:10.563 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mon 2024-09-12T00:42:10.563 INFO:tasks.workunit.client.0.smithi043.stderr: 0/10 monc 2024-09-12T00:42:10.563 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 paxos 2024-09-12T00:42:10.563 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 tp 2024-09-12T00:42:10.563 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 auth 2024-09-12T00:42:10.563 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 crypto 2024-09-12T00:42:10.563 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 finisher 2024-09-12T00:42:10.563 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 reserver 2024-09-12T00:42:10.563 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 heartbeatmap 2024-09-12T00:42:10.563 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 perfcounter 2024-09-12T00:42:10.563 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw 2024-09-12T00:42:10.563 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_sync 2024-09-12T00:42:10.563 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_datacache 2024-09-12T00:42:10.564 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_access 2024-09-12T00:42:10.564 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:42:10.564 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_flight 2024-09-12T00:42:10.564 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:42:10.564 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw_notification 2024-09-12T00:42:10.564 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 javaclient 2024-09-12T00:42:10.564 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 asok 2024-09-12T00:42:10.564 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 throttle 2024-09-12T00:42:10.564 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 refs 2024-09-12T00:42:10.564 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 compressor 2024-09-12T00:42:10.564 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluestore 2024-09-12T00:42:10.564 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluefs 2024-09-12T00:42:10.564 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 bdev 2024-09-12T00:42:10.564 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 kstore 2024-09-12T00:42:10.565 INFO:tasks.workunit.client.0.smithi043.stderr: 4/ 5 rocksdb 2024-09-12T00:42:10.565 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 fuse 2024-09-12T00:42:10.565 INFO:tasks.workunit.client.0.smithi043.stderr: 2/ 5 mgr 2024-09-12T00:42:10.565 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mgrc 2024-09-12T00:42:10.565 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 dpdk 2024-09-12T00:42:10.565 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 eventtrace 2024-09-12T00:42:10.565 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 prioritycache 2024-09-12T00:42:10.565 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 test 2024-09-12T00:42:10.565 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:42:10.565 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephsqlite 2024-09-12T00:42:10.565 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:42:10.565 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore 2024-09-12T00:42:10.565 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_onode 2024-09-12T00:42:10.566 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_odata 2024-09-12T00:42:10.566 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_omap 2024-09-12T00:42:10.566 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_tm 2024-09-12T00:42:10.566 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_t 2024-09-12T00:42:10.566 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:42:10.566 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_epm 2024-09-12T00:42:10.566 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_lba 2024-09-12T00:42:10.566 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:42:10.566 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cache 2024-09-12T00:42:10.566 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_journal 2024-09-12T00:42:10.566 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_device 2024-09-12T00:42:10.566 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_backref 2024-09-12T00:42:10.566 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 alienstore 2024-09-12T00:42:10.566 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mclock 2024-09-12T00:42:10.567 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cyanstore 2024-09-12T00:42:10.567 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 ceph_exporter 2024-09-12T00:42:10.567 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 memstore 2024-09-12T00:42:10.567 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 trace 2024-09-12T00:42:10.567 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 ceph_dedup 2024-09-12T00:42:10.567 INFO:tasks.workunit.client.0.smithi043.stderr: -2/-2 (syslog threshold) 2024-09-12T00:42:10.567 INFO:tasks.workunit.client.0.smithi043.stderr: 99/99 (stderr threshold) 2024-09-12T00:42:10.567 INFO:tasks.workunit.client.0.smithi043.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:42:10.567 INFO:tasks.workunit.client.0.smithi043.stderr: 7fb93f7fe640 / http_manager 2024-09-12T00:42:10.567 INFO:tasks.workunit.client.0.smithi043.stderr: 7fb9467e4640 / http_manager 2024-09-12T00:42:10.567 INFO:tasks.workunit.client.0.smithi043.stderr: 7fb9477e6640 / rgw_dt_lg_renew 2024-09-12T00:42:10.567 INFO:tasks.workunit.client.0.smithi043.stderr: 7fb9667fc640 / ms_dispatch 2024-09-12T00:42:10.567 INFO:tasks.workunit.client.0.smithi043.stderr: 7fb9677fe640 / io_context_pool 2024-09-12T00:42:10.568 INFO:tasks.workunit.client.0.smithi043.stderr: 7fb967fff640 / io_context_pool 2024-09-12T00:42:10.568 INFO:tasks.workunit.client.0.smithi043.stderr: 7fb9767fc640 / ms_dispatch 2024-09-12T00:42:10.568 INFO:tasks.workunit.client.0.smithi043.stderr: 7fb97d60a640 / ms_dispatch 2024-09-12T00:42:10.568 INFO:tasks.workunit.client.0.smithi043.stderr: 7fb97ee0d640 / io_context_pool 2024-09-12T00:42:10.568 INFO:tasks.workunit.client.0.smithi043.stderr: 7fba9011d640 / msgr-worker-2 2024-09-12T00:42:10.568 INFO:tasks.workunit.client.0.smithi043.stderr: 7fba9091e640 / msgr-worker-1 2024-09-12T00:42:10.568 INFO:tasks.workunit.client.0.smithi043.stderr: 7fba9111f640 / msgr-worker-0 2024-09-12T00:42:10.568 INFO:tasks.workunit.client.0.smithi043.stderr: 7fba91920640 / io_context_pool 2024-09-12T00:42:10.568 INFO:tasks.workunit.client.0.smithi043.stderr: 7fba92e189c0 / radosgw-admin 2024-09-12T00:42:10.568 INFO:tasks.workunit.client.0.smithi043.stderr: max_recent 500 2024-09-12T00:42:10.568 INFO:tasks.workunit.client.0.smithi043.stderr: max_new 1000 2024-09-12T00:42:10.568 INFO:tasks.workunit.client.0.smithi043.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:42:10.421236Z_1bb7ff38-51b9-4cc5-a770-4238c1d793b8/log 2024-09-12T00:42:10.568 INFO:tasks.workunit.client.0.smithi043.stderr:--- end dump of recent events --- 2024-09-12T00:42:10.568 INFO:tasks.workunit.client.0.smithi043.stderr:Aborted 2024-09-12T00:42:10.569 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:42:10.570 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:10.570 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:10.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.498+0000 7efecc2a29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.498+0000 7efecc2a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:10.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.498+0000 7efecc2a29c0 20 realm 2024-09-12T00:42:10.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.498+0000 7efecc2a29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.498+0000 7efecc2a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:10.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.498+0000 7efecc2a29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:10.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.498+0000 7efecc2a29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.498+0000 7efecc2a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:10.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.498+0000 7efecc2a29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.502+0000 7efecc2a29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:10.571 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.502+0000 7efecc2a29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.708 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.706+0000 7efecc2a29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:10.709 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.706+0000 7efecc2a29c0 20 searching for the correct realm 2024-09-12T00:42:10.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.714+0000 7efec95a7640 0 -- 172.21.15.43:0/119420940 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7efec0008050 msgr2=0x7efec0078d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:10.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.726+0000 7efec9da8640 0 -- 172.21.15.43:0/119420940 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7efec0047b40 msgr2=0x7efec005c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:10.946 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.946+0000 7efecc2a29c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:42:10.946 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.946+0000 7efecc2a29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:10.946 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.946+0000 7efecc2a29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:10.946 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.946+0000 7efecc2a29c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:42:10.946 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.946+0000 7efecc2a29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:10.946 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.946+0000 7efecc2a29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:10.946 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.946+0000 7efecc2a29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.946+0000 7efecc2a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:10.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.946+0000 7efecc2a29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.946+0000 7efecc2a29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:10.947 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.946+0000 7efecc2a29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.946+0000 7efecc2a29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:10.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.946+0000 7efecc2a29c0 20 zone default found 2024-09-12T00:42:10.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.946+0000 7efecc2a29c0 4 Realm: () 2024-09-12T00:42:10.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.946+0000 7efecc2a29c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:42:10.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.946+0000 7efecc2a29c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:42:10.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.946+0000 7efecc2a29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:10.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.946+0000 7efecc2a29c0 20 zonegroup default 2024-09-12T00:42:10.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.946+0000 7efecc2a29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.949 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.946+0000 7efecc2a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:10.949 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.946+0000 7efecc2a29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.949 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.950+0000 7efecc2a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:10.950 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.950+0000 7efecc2a29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.950 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.950+0000 7efecc2a29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:10.950 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.950+0000 7efecc2a29c0 20 started sync module instance, tier type = 2024-09-12T00:42:10.951 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.950+0000 7efecc2a29c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:42:10.974 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.974+0000 7efecc2a29c0 20 add_watcher() i=0 2024-09-12T00:42:10.974 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.974+0000 7efecc2a29c0 20 add_watcher() i=1 2024-09-12T00:42:10.974 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.974+0000 7efecc2a29c0 20 add_watcher() i=2 2024-09-12T00:42:10.974 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.974+0000 7efecc2a29c0 20 add_watcher() i=3 2024-09-12T00:42:10.974 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.974+0000 7efecc2a29c0 20 add_watcher() i=4 2024-09-12T00:42:10.974 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.974+0000 7efecc2a29c0 20 add_watcher() i=5 2024-09-12T00:42:10.974 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.974+0000 7efecc2a29c0 20 add_watcher() i=6 2024-09-12T00:42:10.976 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.974+0000 7efecc2a29c0 20 add_watcher() i=7 2024-09-12T00:42:10.976 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.974+0000 7efecc2a29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:10.980 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.978+0000 7efd7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:10.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.978+0000 7efecc2a29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:10.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.978+0000 7efecc2a29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:10.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.982+0000 7efecc2a29c0 5 note: GC not initialized 2024-09-12T00:42:10.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.982+0000 7efd7a7fc640 20 reqs_thread_entry: start 2024-09-12T00:42:10.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.982+0000 7efecc2a29c0 20 init_complete bucket index max shards: 11 2024-09-12T00:42:10.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.982+0000 7efecc2a29c0 20 Filter name: none 2024-09-12T00:42:10.983 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.982+0000 7efcebfff640 20 reqs_thread_entry: start 2024-09-12T00:42:10.983 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.982+0000 7efecc2a29c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:42:10.983 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.982+0000 7efecc2a29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.982+0000 7efecc2a29c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:42:10.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.982+0000 7efecc2a29c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:42:10.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.982+0000 7efecc2a29c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:42:10.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.982+0000 7efecc2a29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 : miss 2024-09-12T00:42:10.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.982+0000 7efecc2a29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:10.985 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.986+0000 7efecc2a29c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:42:10.986 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.986+0000 7efecc2a29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:42:10.986 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.986+0000 7efecc2a29c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:42:10.986 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.986+0000 7efecc2a29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:42:10.986 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.986+0000 7efecc2a29c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:42:10.986 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.986+0000 7efecc2a29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 2024-09-12T00:42:10.986 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.986+0000 7efecc2a29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.0 2024-09-12T00:42:10.986 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.986+0000 7efecc2a29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.0 2024-09-12T00:42:10.986 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.986+0000 7efecc2a29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.1 2024-09-12T00:42:10.986 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.986+0000 7efecc2a29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.1 2024-09-12T00:42:10.987 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.986+0000 7efecc2a29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.2 2024-09-12T00:42:10.988 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.986+0000 7efecc2a29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.2 2024-09-12T00:42:10.988 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.986+0000 7efecc2a29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.3 2024-09-12T00:42:10.988 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.986+0000 7efecc2a29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.3 2024-09-12T00:42:10.988 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.986+0000 7efecc2a29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.4 2024-09-12T00:42:10.989 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.986+0000 7efecc2a29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.4 2024-09-12T00:42:10.990 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.990+0000 7efecc2a29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.5 2024-09-12T00:42:10.990 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.990+0000 7efecc2a29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.5 2024-09-12T00:42:10.991 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.990+0000 7efecc2a29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.6 2024-09-12T00:42:10.991 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.990+0000 7efecc2a29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.6 2024-09-12T00:42:10.992 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.990+0000 7efecc2a29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.7 2024-09-12T00:42:10.992 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.990+0000 7efecc2a29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.7 2024-09-12T00:42:10.993 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.990+0000 7efecc2a29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.8 2024-09-12T00:42:10.993 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.990+0000 7efecc2a29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.8 2024-09-12T00:42:10.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.994+0000 7efecc2a29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.9 2024-09-12T00:42:10.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.994+0000 7efecc2a29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.9 2024-09-12T00:42:10.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.994+0000 7efecc2a29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.10 2024-09-12T00:42:10.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.994+0000 7efecc2a29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.10 2024-09-12T00:42:10.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.994+0000 7efecc2a29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.11 2024-09-12T00:42:10.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.994+0000 7efecc2a29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.11 2024-09-12T00:42:10.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.994+0000 7efecc2a29c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.12 2024-09-12T00:42:10.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.994+0000 7efecc2a29c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.12 2024-09-12T00:42:10.998 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:10.998+0000 7efd7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:11.003 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:11.002+0000 7efecc2a29c0 20 remove_watcher() i=0 2024-09-12T00:42:11.003 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:11.002+0000 7efecc2a29c0 2 removed watcher, disabling cache 2024-09-12T00:42:11.005 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:11.006+0000 7efecc2a29c0 20 remove_watcher() i=1 2024-09-12T00:42:11.008 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:11.006+0000 7efecc2a29c0 20 remove_watcher() i=2 2024-09-12T00:42:11.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:11.010+0000 7efecc2a29c0 20 remove_watcher() i=3 2024-09-12T00:42:11.012 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:11.010+0000 7efecc2a29c0 20 remove_watcher() i=4 2024-09-12T00:42:11.014 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:11.014+0000 7efecc2a29c0 20 remove_watcher() i=5 2024-09-12T00:42:11.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:11.014+0000 7efecc2a29c0 20 remove_watcher() i=6 2024-09-12T00:42:11.017 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:11.018+0000 7efecc2a29c0 20 remove_watcher() i=7 2024-09-12T00:42:11.033 INFO:tasks.workunit.client.0.smithi043.stderr: test: duplicated entries can be purged manually 2024-09-12T00:42:41.064 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:42:41.098 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:41.098 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:41.143 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.141+0000 7f0c2825f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.145 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.141+0000 7f0c2825f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.145 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.141+0000 7f0c2825f9c0 20 realm 2024-09-12T00:42:41.145 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.141+0000 7f0c2825f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.145+0000 7f0c2825f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.145+0000 7f0c2825f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:41.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.145+0000 7f0c2825f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.145+0000 7f0c2825f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.146 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.145+0000 7f0c2825f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.145+0000 7f0c2825f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:41.147 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.145+0000 7f0c2825f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.145+0000 7f0c2825f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:41.148 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.145+0000 7f0c2825f9c0 20 searching for the correct realm 2024-09-12T00:42:41.153 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.153+0000 7f0c25d65640 0 -- 172.21.15.43:0/1741099714 >> [v2:172.21.15.97:6816/489545787,v1:172.21.15.97:6817/489545787] conn(0x7f0c200b9690 msgr2=0x7f0c200b9ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:41.160 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.157+0000 7f0c25d65640 0 -- 172.21.15.43:0/1741099714 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f0c1c094b60 msgr2=0x7f0c1c066bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:42:41.377 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.373+0000 7f0c2825f9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:42:41.377 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.373+0000 7f0c2825f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:41.377 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.373+0000 7f0c2825f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:41.377 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.373+0000 7f0c2825f9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:42:41.377 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.373+0000 7f0c2825f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:41.378 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.373+0000 7f0c2825f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:41.378 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.373+0000 7f0c2825f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.378 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.377+0000 7f0c2825f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.379 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.377+0000 7f0c2825f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.379 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.377+0000 7f0c2825f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:41.379 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.377+0000 7f0c2825f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.380 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.377+0000 7f0c2825f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:41.380 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.377+0000 7f0c2825f9c0 20 zone default found 2024-09-12T00:42:41.380 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.377+0000 7f0c2825f9c0 4 Realm: () 2024-09-12T00:42:41.380 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.377+0000 7f0c2825f9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:42:41.380 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.377+0000 7f0c2825f9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:42:41.380 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.377+0000 7f0c2825f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:41.380 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.377+0000 7f0c2825f9c0 20 zonegroup default 2024-09-12T00:42:41.381 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.377+0000 7f0c2825f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.381 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.377+0000 7f0c2825f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.382 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.377+0000 7f0c2825f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.382 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.381+0000 7f0c2825f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.382 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.381+0000 7f0c2825f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.382 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.381+0000 7f0c2825f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.382 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.381+0000 7f0c2825f9c0 20 started sync module instance, tier type = 2024-09-12T00:42:41.382 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.381+0000 7f0c2825f9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:42:41.407 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.405+0000 7f0c2825f9c0 20 add_watcher() i=0 2024-09-12T00:42:41.407 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.405+0000 7f0c2825f9c0 20 add_watcher() i=1 2024-09-12T00:42:41.407 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.405+0000 7f0c2825f9c0 20 add_watcher() i=2 2024-09-12T00:42:41.407 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.405+0000 7f0c2825f9c0 20 add_watcher() i=3 2024-09-12T00:42:41.408 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.405+0000 7f0c2825f9c0 20 add_watcher() i=4 2024-09-12T00:42:41.408 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.405+0000 7f0c2825f9c0 20 add_watcher() i=5 2024-09-12T00:42:41.408 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.405+0000 7f0c2825f9c0 20 add_watcher() i=6 2024-09-12T00:42:41.409 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.405+0000 7f0c2825f9c0 20 add_watcher() i=7 2024-09-12T00:42:41.409 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.409+0000 7f0c2825f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:41.413 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.413+0000 7f0ad7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:41.415 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.413+0000 7f0c2825f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:41.415 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.413+0000 7f0c2825f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:41.415 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.413+0000 7f0c2825f9c0 5 note: GC not initialized 2024-09-12T00:42:41.417 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.413+0000 7f0ad6ffd640 20 reqs_thread_entry: start 2024-09-12T00:42:41.417 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.413+0000 7f0c2825f9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:42:41.418 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.413+0000 7f0c2825f9c0 20 Filter name: none 2024-09-12T00:42:41.418 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.413+0000 7f0ad4ff9640 20 reqs_thread_entry: start 2024-09-12T00:42:41.418 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.413+0000 7f0c2825f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.418 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.413+0000 7f0c2825f9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:42:41.418 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.413+0000 7f0c2825f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.419 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.417+0000 7f0c2825f9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:42:41.419 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.417+0000 7f0c2825f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:41.419 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.417+0000 7f0c2825f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.419 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.417+0000 7f0c2825f9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:42:41.419 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.417+0000 7f0c2825f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.420 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.417+0000 7f0c2825f9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:42:41.420 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.417+0000 7f0c2825f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:41.424 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.421+0000 7f0ad7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:41.429 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.429+0000 7f0c2825f9c0 20 remove_watcher() i=0 2024-09-12T00:42:41.429 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.429+0000 7f0c2825f9c0 2 removed watcher, disabling cache 2024-09-12T00:42:41.432 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.429+0000 7f0c2825f9c0 20 remove_watcher() i=1 2024-09-12T00:42:41.434 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.433+0000 7f0c2825f9c0 20 remove_watcher() i=2 2024-09-12T00:42:41.437 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.433+0000 7f0c2825f9c0 20 remove_watcher() i=3 2024-09-12T00:42:41.439 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.437+0000 7f0c2825f9c0 20 remove_watcher() i=4 2024-09-12T00:42:41.441 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.441+0000 7f0c2825f9c0 20 remove_watcher() i=5 2024-09-12T00:42:41.444 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.441+0000 7f0c2825f9c0 20 remove_watcher() i=6 2024-09-12T00:42:41.445 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.445+0000 7f0c2825f9c0 20 remove_watcher() i=7 2024-09-12T00:42:41.467 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.467 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:42:41.467 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: a-bucket id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 num_objects: 11 size_kb: 1 num_shards: 13 2024-09-12T00:42:41.467 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.468 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:42:41.503 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:41.503 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:41.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.545+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.545+0000 7f791d0549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.545+0000 7f791d0549c0 20 realm 2024-09-12T00:42:41.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.545+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.545+0000 7f791d0549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.545+0000 7f791d0549c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:41.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.545+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.549+0000 7f791d0549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.549+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.551 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.549+0000 7f791d0549c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:41.551 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.549+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.552 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.549+0000 7f791d0549c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:41.552 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.549+0000 7f791d0549c0 20 searching for the correct realm 2024-09-12T00:42:41.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.557+0000 7f791b35b640 0 -- 172.21.15.43:0/3115068998 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f79100d7c10 msgr2=0x7f79100e5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:41.777 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.773+0000 7f791ab5a640 0 -- 172.21.15.43:0/3115068998 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x55f303a25360 msgr2=0x55f303a27770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:41.785 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.781+0000 7f791d0549c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:42:41.785 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.781+0000 7f791d0549c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:41.785 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.781+0000 7f791d0549c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:41.785 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.781+0000 7f791d0549c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:42:41.785 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.781+0000 7f791d0549c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:41.785 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.781+0000 7f791d0549c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:41.785 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.781+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.785+0000 7f791d0549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.785+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.785+0000 7f791d0549c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:41.786 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.785+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.787 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.785+0000 7f791d0549c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:41.788 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.785+0000 7f791d0549c0 20 zone default found 2024-09-12T00:42:41.788 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.785+0000 7f791d0549c0 4 Realm: () 2024-09-12T00:42:41.788 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.785+0000 7f791d0549c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:42:41.788 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.785+0000 7f791d0549c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:42:41.788 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.785+0000 7f791d0549c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:41.788 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.785+0000 7f791d0549c0 20 zonegroup default 2024-09-12T00:42:41.788 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.785+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.788 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.785+0000 7f791d0549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.789 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.785+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.789 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.785+0000 7f791d0549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.789 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.785+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.789+0000 7f791d0549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.789+0000 7f791d0549c0 20 started sync module instance, tier type = 2024-09-12T00:42:41.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.789+0000 7f791d0549c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:42:41.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.809+0000 7f791d0549c0 20 add_watcher() i=0 2024-09-12T00:42:41.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.809+0000 7f791d0549c0 20 add_watcher() i=1 2024-09-12T00:42:41.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.809+0000 7f791d0549c0 20 add_watcher() i=2 2024-09-12T00:42:41.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.809+0000 7f791d0549c0 20 add_watcher() i=3 2024-09-12T00:42:41.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.809+0000 7f791d0549c0 20 add_watcher() i=4 2024-09-12T00:42:41.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.809+0000 7f791d0549c0 20 add_watcher() i=5 2024-09-12T00:42:41.813 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.809+0000 7f791d0549c0 20 add_watcher() i=6 2024-09-12T00:42:41.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.813+0000 7f791d0549c0 20 add_watcher() i=7 2024-09-12T00:42:41.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.813+0000 7f791d0549c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:41.819 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.817+0000 7f77d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:41.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.817+0000 7f791d0549c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:41.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.817+0000 7f791d0549c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:41.821 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.817+0000 7f791d0549c0 5 note: GC not initialized 2024-09-12T00:42:41.821 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.817+0000 7f774bfff640 20 reqs_thread_entry: start 2024-09-12T00:42:41.821 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.821+0000 7f791d0549c0 20 init_complete bucket index max shards: 11 2024-09-12T00:42:41.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.821+0000 7f791d0549c0 20 Filter name: none 2024-09-12T00:42:41.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.821+0000 7f7749ffb640 20 reqs_thread_entry: start 2024-09-12T00:42:41.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.821+0000 7f791d0549c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:42:41.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.821+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.823 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.821+0000 7f791d0549c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:42:41.823 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.821+0000 7f791d0549c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:42:41.824 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.821+0000 7f791d0549c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:42:41.824 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.821+0000 7f791d0549c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 : miss 2024-09-12T00:42:41.824 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.821+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.824 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.821+0000 7f791d0549c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:42:41.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.821+0000 7f791d0549c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:42:41.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.821+0000 7f791d0549c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:42:41.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.821+0000 7f791d0549c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:42:41.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.821+0000 7f791d0549c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:42:41.825 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.821+0000 7f791d0549c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 2024-09-12T00:42:41.828 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.825+0000 7f791d0549c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:42:41.843 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.841+0000 7f791d0549c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:42:41.843 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.841+0000 7f791d0549c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:42:41.843 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.841+0000 7f791d0549c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:42:41.843 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.841+0000 7f791d0549c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17, ofs0, ns] 2024-09-12T00:42:41.843 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.841+0000 7f77fe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333530 cookie 94502226444560 notifier 8283 bl.length()=827 2024-09-12T00:42:41.843 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.841+0000 7f77fe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:42:41.844 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.841+0000 7f77fe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:42:41.844 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.841+0000 7f77fe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:42:41.844 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.841+0000 7f791d0549c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_sources= new_sources= 2024-09-12T00:42:41.844 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.841+0000 7f791d0549c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential sources added=[] removed=[] 2024-09-12T00:42:41.844 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.841+0000 7f791d0549c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_dests= new_dests= 2024-09-12T00:42:41.844 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.841+0000 7f791d0549c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential dests added=[] removed=[] 2024-09-12T00:42:41.858 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f791d0549c0 time 2024-09-12T00:42:41.861524+0000 2024-09-12T00:42:41.858 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:42:41.860 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:41.860 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f792092e2eb] 2024-09-12T00:42:41.860 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f792092e49f] 2024-09-12T00:42:41.860 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3013bdcc1] 2024-09-12T00:42:41.860 INFO:tasks.workunit.client.0.smithi043.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f3013d2d5a] 2024-09-12T00:42:41.860 INFO:tasks.workunit.client.0.smithi043.stderr: 5: main() 2024-09-12T00:42:41.861 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f791f794d90] 2024-09-12T00:42:41.861 INFO:tasks.workunit.client.0.smithi043.stderr: 7: __libc_start_main() 2024-09-12T00:42:41.861 INFO:tasks.workunit.client.0.smithi043.stderr: 8: _start() 2024-09-12T00:42:41.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.857+0000 7f791d0549c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f791d0549c0 time 2024-09-12T00:42:41.861524+0000 2024-09-12T00:42:41.861 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:42:41.861 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.861 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:41.861 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f792092e2eb] 2024-09-12T00:42:41.861 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f792092e49f] 2024-09-12T00:42:41.861 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3013bdcc1] 2024-09-12T00:42:41.861 INFO:tasks.workunit.client.0.smithi043.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f3013d2d5a] 2024-09-12T00:42:41.861 INFO:tasks.workunit.client.0.smithi043.stderr: 5: main() 2024-09-12T00:42:41.861 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f791f794d90] 2024-09-12T00:42:41.862 INFO:tasks.workunit.client.0.smithi043.stderr: 7: __libc_start_main() 2024-09-12T00:42:41.862 INFO:tasks.workunit.client.0.smithi043.stderr: 8: _start() 2024-09-12T00:42:41.862 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.862 INFO:tasks.workunit.client.0.smithi043.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:42:41.862 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7f791d0549c0 thread_name:radosgw-admin 2024-09-12T00:42:41.867 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:41.867 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f791f7ad520] 2024-09-12T00:42:41.867 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:42:41.867 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:42:41.867 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:42:41.868 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f792092e345] 2024-09-12T00:42:41.868 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f792092e49f] 2024-09-12T00:42:41.868 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3013bdcc1] 2024-09-12T00:42:41.868 INFO:tasks.workunit.client.0.smithi043.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f3013d2d5a] 2024-09-12T00:42:41.868 INFO:tasks.workunit.client.0.smithi043.stderr: 9: main() 2024-09-12T00:42:41.868 INFO:tasks.workunit.client.0.smithi043.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f791f794d90] 2024-09-12T00:42:41.868 INFO:tasks.workunit.client.0.smithi043.stderr: 11: __libc_start_main() 2024-09-12T00:42:41.868 INFO:tasks.workunit.client.0.smithi043.stderr: 12: _start() 2024-09-12T00:42:41.868 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.861+0000 7f791d0549c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:42:41.868 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7f791d0549c0 thread_name:radosgw-admin 2024-09-12T00:42:41.868 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.868 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:41.869 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f791f7ad520] 2024-09-12T00:42:41.869 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:42:41.869 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:42:41.869 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:42:41.869 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f792092e345] 2024-09-12T00:42:41.869 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f792092e49f] 2024-09-12T00:42:41.869 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3013bdcc1] 2024-09-12T00:42:41.869 INFO:tasks.workunit.client.0.smithi043.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f3013d2d5a] 2024-09-12T00:42:41.869 INFO:tasks.workunit.client.0.smithi043.stderr: 9: main() 2024-09-12T00:42:41.869 INFO:tasks.workunit.client.0.smithi043.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f791f794d90] 2024-09-12T00:42:41.869 INFO:tasks.workunit.client.0.smithi043.stderr: 11: __libc_start_main() 2024-09-12T00:42:41.869 INFO:tasks.workunit.client.0.smithi043.stderr: 12: _start() 2024-09-12T00:42:41.869 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:42:41.870 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.870 INFO:tasks.workunit.client.0.smithi043.stderr:--- begin dump of recent events --- 2024-09-12T00:42:41.870 INFO:tasks.workunit.client.0.smithi043.stderr: -499> 2024-09-12T00:42:41.525+0000 7f791a359640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.870 INFO:tasks.workunit.client.0.smithi043.stderr: -498> 2024-09-12T00:42:41.525+0000 7f791a359640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.870 INFO:tasks.workunit.client.0.smithi043.stderr: -497> 2024-09-12T00:42:41.525+0000 7f791ab5a640 10 monclient(hunting): handle_auth_done global_id 8271 payload 274 2024-09-12T00:42:41.870 INFO:tasks.workunit.client.0.smithi043.stderr: -496> 2024-09-12T00:42:41.525+0000 7f791ab5a640 10 monclient: _finish_hunting 0 2024-09-12T00:42:41.870 INFO:tasks.workunit.client.0.smithi043.stderr: -495> 2024-09-12T00:42:41.525+0000 7f791ab5a640 1 monclient: found mon.noname-a 2024-09-12T00:42:41.870 INFO:tasks.workunit.client.0.smithi043.stderr: -494> 2024-09-12T00:42:41.525+0000 7f791ab5a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:42:41.870 INFO:tasks.workunit.client.0.smithi043.stderr: -493> 2024-09-12T00:42:41.525+0000 7f7808e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.871 INFO:tasks.workunit.client.0.smithi043.stderr: -492> 2024-09-12T00:42:41.525+0000 7f7808e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:41.871 INFO:tasks.workunit.client.0.smithi043.stderr: -491> 2024-09-12T00:42:41.525+0000 7f7808e09640 10 monclient: dump: 2024-09-12T00:42:41.871 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:41.871 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:41.871 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.871 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.871 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.871 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:41.871 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:41.871 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:41.871 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:41.871 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.871 INFO:tasks.workunit.client.0.smithi043.stderr: -490> 2024-09-12T00:42:41.525+0000 7f7808e09640 10 monclient: _finish_auth 0 2024-09-12T00:42:41.872 INFO:tasks.workunit.client.0.smithi043.stderr: -489> 2024-09-12T00:42:41.525+0000 7f7808e09640 10 monclient: _check_auth_tickets 2024-09-12T00:42:41.872 INFO:tasks.workunit.client.0.smithi043.stderr: -488> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 monclient: authenticate success, global_id 8271 2024-09-12T00:42:41.872 INFO:tasks.workunit.client.0.smithi043.stderr: -487> 2024-09-12T00:42:41.525+0000 7f7808e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:41.872 INFO:tasks.workunit.client.0.smithi043.stderr: -486> 2024-09-12T00:42:41.525+0000 7f7808e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.872 INFO:tasks.workunit.client.0.smithi043.stderr: -485> 2024-09-12T00:42:41.525+0000 7f7808e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:41.872 INFO:tasks.workunit.client.0.smithi043.stderr: -484> 2024-09-12T00:42:41.525+0000 7f7808e09640 10 monclient: dump: 2024-09-12T00:42:41.872 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:41.872 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:41.872 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.872 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.872 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.872 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:41.872 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:41.873 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:41.873 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:41.873 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.873 INFO:tasks.workunit.client.0.smithi043.stderr: -483> 2024-09-12T00:42:41.525+0000 7f791d0549c0 10 monclient: get_monmap_and_config success 2024-09-12T00:42:41.873 INFO:tasks.workunit.client.0.smithi043.stderr: -482> 2024-09-12T00:42:41.525+0000 7f791d0549c0 4 set_mon_vals no callback set 2024-09-12T00:42:41.873 INFO:tasks.workunit.client.0.smithi043.stderr: -481> 2024-09-12T00:42:41.525+0000 7f791d0549c0 10 monclient: shutdown 2024-09-12T00:42:41.873 INFO:tasks.workunit.client.0.smithi043.stderr: -480> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 asok(0x55f30372b2b0) unregister_commands rotate-key 2024-09-12T00:42:41.873 INFO:tasks.workunit.client.0.smithi043.stderr: -479> 2024-09-12T00:42:41.525+0000 7f791d0549c0 10 monclient: build_initial_monmap 2024-09-12T00:42:41.873 INFO:tasks.workunit.client.0.smithi043.stderr: -478> 2024-09-12T00:42:41.525+0000 7f791d0549c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:41.873 INFO:tasks.workunit.client.0.smithi043.stderr: -477> 2024-09-12T00:42:41.525+0000 7f791d0549c0 10 monclient: monmap: 2024-09-12T00:42:41.873 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:42:41.873 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:41.873 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:42:41.874 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:42:41.874 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:41.874 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:41.874 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:42:41.874 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:42:41.874 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:42:41.874 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.874 INFO:tasks.workunit.client.0.smithi043.stderr: -476> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f30393e9e0) adding auth protocol: cephx 2024-09-12T00:42:41.874 INFO:tasks.workunit.client.0.smithi043.stderr: -475> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f30393e9e0) adding auth protocol: cephx 2024-09-12T00:42:41.874 INFO:tasks.workunit.client.0.smithi043.stderr: -474> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f30393e9e0) adding auth protocol: cephx 2024-09-12T00:42:41.874 INFO:tasks.workunit.client.0.smithi043.stderr: -473> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f30393e9e0) adding con mode: secure 2024-09-12T00:42:41.874 INFO:tasks.workunit.client.0.smithi043.stderr: -472> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f30393e9e0) adding con mode: crc 2024-09-12T00:42:41.874 INFO:tasks.workunit.client.0.smithi043.stderr: -471> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f30393e9e0) adding con mode: secure 2024-09-12T00:42:41.875 INFO:tasks.workunit.client.0.smithi043.stderr: -470> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f30393e9e0) adding con mode: crc 2024-09-12T00:42:41.875 INFO:tasks.workunit.client.0.smithi043.stderr: -469> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f30393e9e0) adding con mode: secure 2024-09-12T00:42:41.875 INFO:tasks.workunit.client.0.smithi043.stderr: -468> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f30393e9e0) adding con mode: crc 2024-09-12T00:42:41.875 INFO:tasks.workunit.client.0.smithi043.stderr: -467> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f30393e9e0) adding con mode: crc 2024-09-12T00:42:41.875 INFO:tasks.workunit.client.0.smithi043.stderr: -466> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f30393e9e0) adding con mode: secure 2024-09-12T00:42:41.875 INFO:tasks.workunit.client.0.smithi043.stderr: -465> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f30393e9e0) adding con mode: crc 2024-09-12T00:42:41.875 INFO:tasks.workunit.client.0.smithi043.stderr: -464> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f30393e9e0) adding con mode: secure 2024-09-12T00:42:41.875 INFO:tasks.workunit.client.0.smithi043.stderr: -463> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f30393e9e0) adding con mode: crc 2024-09-12T00:42:41.875 INFO:tasks.workunit.client.0.smithi043.stderr: -462> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f30393e9e0) adding con mode: secure 2024-09-12T00:42:41.875 INFO:tasks.workunit.client.0.smithi043.stderr: -461> 2024-09-12T00:42:41.525+0000 7f791d0549c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.875 INFO:tasks.workunit.client.0.smithi043.stderr: -460> 2024-09-12T00:42:41.525+0000 7f791d0549c0 1 librados: starting msgr at 2024-09-12T00:42:41.875 INFO:tasks.workunit.client.0.smithi043.stderr: -459> 2024-09-12T00:42:41.525+0000 7f791d0549c0 1 librados: starting objecter 2024-09-12T00:42:41.876 INFO:tasks.workunit.client.0.smithi043.stderr: -458> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command objecter_requests hook 0x55f3037625b0 2024-09-12T00:42:41.876 INFO:tasks.workunit.client.0.smithi043.stderr: -457> 2024-09-12T00:42:41.525+0000 7f791d0549c0 1 librados: setting wanted keys 2024-09-12T00:42:41.876 INFO:tasks.workunit.client.0.smithi043.stderr: -456> 2024-09-12T00:42:41.525+0000 7f791d0549c0 1 librados: calling monclient init 2024-09-12T00:42:41.876 INFO:tasks.workunit.client.0.smithi043.stderr: -455> 2024-09-12T00:42:41.525+0000 7f791d0549c0 10 monclient: init 2024-09-12T00:42:41.876 INFO:tasks.workunit.client.0.smithi043.stderr: -454> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f303938a70) adding auth protocol: cephx 2024-09-12T00:42:41.876 INFO:tasks.workunit.client.0.smithi043.stderr: -453> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f303938a70) adding auth protocol: cephx 2024-09-12T00:42:41.876 INFO:tasks.workunit.client.0.smithi043.stderr: -452> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f303938a70) adding auth protocol: cephx 2024-09-12T00:42:41.876 INFO:tasks.workunit.client.0.smithi043.stderr: -451> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f303938a70) adding con mode: secure 2024-09-12T00:42:41.876 INFO:tasks.workunit.client.0.smithi043.stderr: -450> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f303938a70) adding con mode: crc 2024-09-12T00:42:41.876 INFO:tasks.workunit.client.0.smithi043.stderr: -449> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f303938a70) adding con mode: secure 2024-09-12T00:42:41.876 INFO:tasks.workunit.client.0.smithi043.stderr: -448> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f303938a70) adding con mode: crc 2024-09-12T00:42:41.876 INFO:tasks.workunit.client.0.smithi043.stderr: -447> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f303938a70) adding con mode: secure 2024-09-12T00:42:41.876 INFO:tasks.workunit.client.0.smithi043.stderr: -446> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f303938a70) adding con mode: crc 2024-09-12T00:42:41.877 INFO:tasks.workunit.client.0.smithi043.stderr: -445> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f303938a70) adding con mode: crc 2024-09-12T00:42:41.877 INFO:tasks.workunit.client.0.smithi043.stderr: -444> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f303938a70) adding con mode: secure 2024-09-12T00:42:41.877 INFO:tasks.workunit.client.0.smithi043.stderr: -443> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f303938a70) adding con mode: crc 2024-09-12T00:42:41.877 INFO:tasks.workunit.client.0.smithi043.stderr: -442> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f303938a70) adding con mode: secure 2024-09-12T00:42:41.877 INFO:tasks.workunit.client.0.smithi043.stderr: -441> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f303938a70) adding con mode: crc 2024-09-12T00:42:41.877 INFO:tasks.workunit.client.0.smithi043.stderr: -440> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f303938a70) adding con mode: secure 2024-09-12T00:42:41.877 INFO:tasks.workunit.client.0.smithi043.stderr: -439> 2024-09-12T00:42:41.525+0000 7f791d0549c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.877 INFO:tasks.workunit.client.0.smithi043.stderr: -438> 2024-09-12T00:42:41.525+0000 7f791d0549c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.877 INFO:tasks.workunit.client.0.smithi043.stderr: -437> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command rotate-key hook 0x55f303938bb8 2024-09-12T00:42:41.877 INFO:tasks.workunit.client.0.smithi043.stderr: -436> 2024-09-12T00:42:41.525+0000 7f791d0549c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:41.877 INFO:tasks.workunit.client.0.smithi043.stderr: -435> 2024-09-12T00:42:41.525+0000 7f791d0549c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:42:41.877 INFO:tasks.workunit.client.0.smithi043.stderr: -434> 2024-09-12T00:42:41.525+0000 7f791d0549c0 10 monclient(hunting): picked mon.noname-b con 0x55f3037e8820 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:42:41.877 INFO:tasks.workunit.client.0.smithi043.stderr: -433> 2024-09-12T00:42:41.525+0000 7f791d0549c0 10 monclient(hunting): picked mon.noname-c con 0x55f3037f3a80 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:42:41.878 INFO:tasks.workunit.client.0.smithi043.stderr: -432> 2024-09-12T00:42:41.525+0000 7f791d0549c0 10 monclient(hunting): picked mon.noname-a con 0x55f303884170 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:42:41.878 INFO:tasks.workunit.client.0.smithi043.stderr: -431> 2024-09-12T00:42:41.525+0000 7f791d0549c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.878 INFO:tasks.workunit.client.0.smithi043.stderr: -430> 2024-09-12T00:42:41.525+0000 7f791d0549c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.878 INFO:tasks.workunit.client.0.smithi043.stderr: -429> 2024-09-12T00:42:41.525+0000 7f791d0549c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.878 INFO:tasks.workunit.client.0.smithi043.stderr: -428> 2024-09-12T00:42:41.525+0000 7f791d0549c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:41.878 INFO:tasks.workunit.client.0.smithi043.stderr: -427> 2024-09-12T00:42:41.525+0000 7f791d0549c0 10 monclient(hunting): authenticate will time out at 2457.518840s 2024-09-12T00:42:41.878 INFO:tasks.workunit.client.0.smithi043.stderr: -426> 2024-09-12T00:42:41.525+0000 7f791b35b640 10 monclient(hunting): get_auth_request con 0x55f303884170 auth_method 0 2024-09-12T00:42:41.878 INFO:tasks.workunit.client.0.smithi043.stderr: -425> 2024-09-12T00:42:41.525+0000 7f791b35b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.878 INFO:tasks.workunit.client.0.smithi043.stderr: -424> 2024-09-12T00:42:41.525+0000 7f791b35b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.878 INFO:tasks.workunit.client.0.smithi043.stderr: -423> 2024-09-12T00:42:41.525+0000 7f791b35b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.878 INFO:tasks.workunit.client.0.smithi043.stderr: -422> 2024-09-12T00:42:41.525+0000 7f791a359640 10 monclient(hunting): get_auth_request con 0x55f3037f3a80 auth_method 0 2024-09-12T00:42:41.878 INFO:tasks.workunit.client.0.smithi043.stderr: -421> 2024-09-12T00:42:41.525+0000 7f791a359640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.878 INFO:tasks.workunit.client.0.smithi043.stderr: -420> 2024-09-12T00:42:41.525+0000 7f791a359640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.879 INFO:tasks.workunit.client.0.smithi043.stderr: -419> 2024-09-12T00:42:41.525+0000 7f791a359640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.879 INFO:tasks.workunit.client.0.smithi043.stderr: -418> 2024-09-12T00:42:41.525+0000 7f791b35b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.879 INFO:tasks.workunit.client.0.smithi043.stderr: -417> 2024-09-12T00:42:41.525+0000 7f791b35b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.879 INFO:tasks.workunit.client.0.smithi043.stderr: -416> 2024-09-12T00:42:41.525+0000 7f791b35b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.879 INFO:tasks.workunit.client.0.smithi043.stderr: -415> 2024-09-12T00:42:41.525+0000 7f791a359640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.879 INFO:tasks.workunit.client.0.smithi043.stderr: -414> 2024-09-12T00:42:41.525+0000 7f791a359640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.879 INFO:tasks.workunit.client.0.smithi043.stderr: -413> 2024-09-12T00:42:41.525+0000 7f791a359640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.879 INFO:tasks.workunit.client.0.smithi043.stderr: -412> 2024-09-12T00:42:41.525+0000 7f791ab5a640 10 monclient(hunting): get_auth_request con 0x55f3037e8820 auth_method 0 2024-09-12T00:42:41.879 INFO:tasks.workunit.client.0.smithi043.stderr: -411> 2024-09-12T00:42:41.525+0000 7f791ab5a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.879 INFO:tasks.workunit.client.0.smithi043.stderr: -410> 2024-09-12T00:42:41.525+0000 7f791ab5a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.879 INFO:tasks.workunit.client.0.smithi043.stderr: -409> 2024-09-12T00:42:41.525+0000 7f791ab5a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.879 INFO:tasks.workunit.client.0.smithi043.stderr: -408> 2024-09-12T00:42:41.525+0000 7f791b35b640 10 monclient(hunting): handle_auth_done global_id 8274 payload 824 2024-09-12T00:42:41.879 INFO:tasks.workunit.client.0.smithi043.stderr: -407> 2024-09-12T00:42:41.525+0000 7f791b35b640 10 monclient: _finish_hunting 0 2024-09-12T00:42:41.880 INFO:tasks.workunit.client.0.smithi043.stderr: -406> 2024-09-12T00:42:41.525+0000 7f791b35b640 1 monclient: found mon.noname-a 2024-09-12T00:42:41.880 INFO:tasks.workunit.client.0.smithi043.stderr: -405> 2024-09-12T00:42:41.525+0000 7f791b35b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:42:41.880 INFO:tasks.workunit.client.0.smithi043.stderr: -404> 2024-09-12T00:42:41.525+0000 7f7807606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.880 INFO:tasks.workunit.client.0.smithi043.stderr: -403> 2024-09-12T00:42:41.525+0000 7f7807606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:41.880 INFO:tasks.workunit.client.0.smithi043.stderr: -402> 2024-09-12T00:42:41.525+0000 7f7807606640 10 monclient: dump: 2024-09-12T00:42:41.880 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:41.880 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:41.880 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.880 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.880 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.880 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:41.880 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:41.880 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:41.881 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:41.881 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.881 INFO:tasks.workunit.client.0.smithi043.stderr: -401> 2024-09-12T00:42:41.525+0000 7f7807606640 10 monclient: _finish_auth 0 2024-09-12T00:42:41.881 INFO:tasks.workunit.client.0.smithi043.stderr: -400> 2024-09-12T00:42:41.525+0000 7f7807606640 10 monclient: _check_auth_tickets 2024-09-12T00:42:41.881 INFO:tasks.workunit.client.0.smithi043.stderr: -399> 2024-09-12T00:42:41.525+0000 7f7807606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:41.881 INFO:tasks.workunit.client.0.smithi043.stderr: -398> 2024-09-12T00:42:41.525+0000 7f7807606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.881 INFO:tasks.workunit.client.0.smithi043.stderr: -397> 2024-09-12T00:42:41.525+0000 7f7807606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:41.881 INFO:tasks.workunit.client.0.smithi043.stderr: -396> 2024-09-12T00:42:41.525+0000 7f7807606640 10 monclient: dump: 2024-09-12T00:42:41.881 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:41.881 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:41.881 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.881 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.881 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.881 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:41.882 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:41.882 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:41.882 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:41.882 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.882 INFO:tasks.workunit.client.0.smithi043.stderr: -395> 2024-09-12T00:42:41.525+0000 7f7808e09640 4 set_mon_vals no callback set 2024-09-12T00:42:41.882 INFO:tasks.workunit.client.0.smithi043.stderr: -394> 2024-09-12T00:42:41.529+0000 7f791d0549c0 5 monclient: authenticate success, global_id 8274 2024-09-12T00:42:41.882 INFO:tasks.workunit.client.0.smithi043.stderr: -393> 2024-09-12T00:42:41.529+0000 7f791d0549c0 10 monclient: _renew_subs 2024-09-12T00:42:41.882 INFO:tasks.workunit.client.0.smithi043.stderr: -392> 2024-09-12T00:42:41.529+0000 7f791d0549c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:42:41.882 INFO:tasks.workunit.client.0.smithi043.stderr: -391> 2024-09-12T00:42:41.529+0000 7f791d0549c0 10 monclient: _renew_subs 2024-09-12T00:42:41.882 INFO:tasks.workunit.client.0.smithi043.stderr: -390> 2024-09-12T00:42:41.529+0000 7f791d0549c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:42:41.882 INFO:tasks.workunit.client.0.smithi043.stderr: -389> 2024-09-12T00:42:41.529+0000 7f791d0549c0 1 librados: init done 2024-09-12T00:42:41.882 INFO:tasks.workunit.client.0.smithi043.stderr: -388> 2024-09-12T00:42:41.529+0000 7f7807606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:41.883 INFO:tasks.workunit.client.0.smithi043.stderr: -387> 2024-09-12T00:42:41.529+0000 7f7807606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:42:41.883 INFO:tasks.workunit.client.0.smithi043.stderr: -386> 2024-09-12T00:42:41.529+0000 7f7807606640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:42:41.883 INFO:tasks.workunit.client.0.smithi043.stderr: -385> 2024-09-12T00:42:41.529+0000 7f791ab5a640 10 monclient: get_auth_request con 0x7f7800070b10 auth_method 0 2024-09-12T00:42:41.883 INFO:tasks.workunit.client.0.smithi043.stderr: -384> 2024-09-12T00:42:41.529+0000 7f791a359640 10 monclient: get_auth_request con 0x55f3039609e0 auth_method 0 2024-09-12T00:42:41.883 INFO:tasks.workunit.client.0.smithi043.stderr: -383> 2024-09-12T00:42:41.529+0000 7f791ab5a640 10 monclient: get_auth_request con 0x55f303982fe0 auth_method 0 2024-09-12T00:42:41.883 INFO:tasks.workunit.client.0.smithi043.stderr: -382> 2024-09-12T00:42:41.533+0000 7f791a359640 10 monclient: get_auth_request con 0x55f3039873d0 auth_method 0 2024-09-12T00:42:41.883 INFO:tasks.workunit.client.0.smithi043.stderr: -381> 2024-09-12T00:42:41.533+0000 7f791d0549c0 10 monclient: build_initial_monmap 2024-09-12T00:42:41.883 INFO:tasks.workunit.client.0.smithi043.stderr: -380> 2024-09-12T00:42:41.533+0000 7f791d0549c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:41.883 INFO:tasks.workunit.client.0.smithi043.stderr: -379> 2024-09-12T00:42:41.533+0000 7f791d0549c0 10 monclient: monmap: 2024-09-12T00:42:41.883 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:42:41.883 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:41.883 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:42:41.883 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:42:41.884 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:41.884 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:41.884 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:42:41.884 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:42:41.884 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:42:41.884 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.884 INFO:tasks.workunit.client.0.smithi043.stderr: -378> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398c290) adding auth protocol: cephx 2024-09-12T00:42:41.884 INFO:tasks.workunit.client.0.smithi043.stderr: -377> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398c290) adding auth protocol: cephx 2024-09-12T00:42:41.884 INFO:tasks.workunit.client.0.smithi043.stderr: -376> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398c290) adding auth protocol: cephx 2024-09-12T00:42:41.884 INFO:tasks.workunit.client.0.smithi043.stderr: -375> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398c290) adding con mode: secure 2024-09-12T00:42:41.884 INFO:tasks.workunit.client.0.smithi043.stderr: -374> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398c290) adding con mode: crc 2024-09-12T00:42:41.884 INFO:tasks.workunit.client.0.smithi043.stderr: -373> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398c290) adding con mode: secure 2024-09-12T00:42:41.884 INFO:tasks.workunit.client.0.smithi043.stderr: -372> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398c290) adding con mode: crc 2024-09-12T00:42:41.885 INFO:tasks.workunit.client.0.smithi043.stderr: -371> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398c290) adding con mode: secure 2024-09-12T00:42:41.885 INFO:tasks.workunit.client.0.smithi043.stderr: -370> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398c290) adding con mode: crc 2024-09-12T00:42:41.885 INFO:tasks.workunit.client.0.smithi043.stderr: -369> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398c290) adding con mode: crc 2024-09-12T00:42:41.885 INFO:tasks.workunit.client.0.smithi043.stderr: -368> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398c290) adding con mode: secure 2024-09-12T00:42:41.885 INFO:tasks.workunit.client.0.smithi043.stderr: -367> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398c290) adding con mode: crc 2024-09-12T00:42:41.885 INFO:tasks.workunit.client.0.smithi043.stderr: -366> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398c290) adding con mode: secure 2024-09-12T00:42:41.885 INFO:tasks.workunit.client.0.smithi043.stderr: -365> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398c290) adding con mode: crc 2024-09-12T00:42:41.885 INFO:tasks.workunit.client.0.smithi043.stderr: -364> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398c290) adding con mode: secure 2024-09-12T00:42:41.885 INFO:tasks.workunit.client.0.smithi043.stderr: -363> 2024-09-12T00:42:41.533+0000 7f791d0549c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.885 INFO:tasks.workunit.client.0.smithi043.stderr: -362> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55f30398fc20 EEXIST 2024-09-12T00:42:41.885 INFO:tasks.workunit.client.0.smithi043.stderr: -361> 2024-09-12T00:42:41.533+0000 7f791d0549c0 10 monclient: init 2024-09-12T00:42:41.885 INFO:tasks.workunit.client.0.smithi043.stderr: -360> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398a968) adding auth protocol: cephx 2024-09-12T00:42:41.886 INFO:tasks.workunit.client.0.smithi043.stderr: -359> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398a968) adding auth protocol: cephx 2024-09-12T00:42:41.886 INFO:tasks.workunit.client.0.smithi043.stderr: -358> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398a968) adding auth protocol: cephx 2024-09-12T00:42:41.886 INFO:tasks.workunit.client.0.smithi043.stderr: -357> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398a968) adding con mode: secure 2024-09-12T00:42:41.886 INFO:tasks.workunit.client.0.smithi043.stderr: -356> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398a968) adding con mode: crc 2024-09-12T00:42:41.886 INFO:tasks.workunit.client.0.smithi043.stderr: -355> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398a968) adding con mode: secure 2024-09-12T00:42:41.886 INFO:tasks.workunit.client.0.smithi043.stderr: -354> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398a968) adding con mode: crc 2024-09-12T00:42:41.886 INFO:tasks.workunit.client.0.smithi043.stderr: -353> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398a968) adding con mode: secure 2024-09-12T00:42:41.886 INFO:tasks.workunit.client.0.smithi043.stderr: -352> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398a968) adding con mode: crc 2024-09-12T00:42:41.886 INFO:tasks.workunit.client.0.smithi043.stderr: -351> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398a968) adding con mode: crc 2024-09-12T00:42:41.886 INFO:tasks.workunit.client.0.smithi043.stderr: -350> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398a968) adding con mode: secure 2024-09-12T00:42:41.886 INFO:tasks.workunit.client.0.smithi043.stderr: -349> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398a968) adding con mode: crc 2024-09-12T00:42:41.886 INFO:tasks.workunit.client.0.smithi043.stderr: -348> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398a968) adding con mode: secure 2024-09-12T00:42:41.886 INFO:tasks.workunit.client.0.smithi043.stderr: -347> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398a968) adding con mode: crc 2024-09-12T00:42:41.887 INFO:tasks.workunit.client.0.smithi043.stderr: -346> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398a968) adding con mode: secure 2024-09-12T00:42:41.887 INFO:tasks.workunit.client.0.smithi043.stderr: -345> 2024-09-12T00:42:41.533+0000 7f791d0549c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.887 INFO:tasks.workunit.client.0.smithi043.stderr: -344> 2024-09-12T00:42:41.533+0000 7f791d0549c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.887 INFO:tasks.workunit.client.0.smithi043.stderr: -343> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command rotate-key cmddesc rotate-key hook 0x55f30398aab0 EEXIST 2024-09-12T00:42:41.887 INFO:tasks.workunit.client.0.smithi043.stderr: -342> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:41.887 INFO:tasks.workunit.client.0.smithi043.stderr: -341> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:42:41.887 INFO:tasks.workunit.client.0.smithi043.stderr: -340> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient(hunting): picked mon.noname-b con 0x55f3039b3dd0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:42:41.887 INFO:tasks.workunit.client.0.smithi043.stderr: -339> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient(hunting): picked mon.noname-a con 0x55f3039b3700 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:42:41.887 INFO:tasks.workunit.client.0.smithi043.stderr: -338> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient(hunting): picked mon.noname-c con 0x55f3039b20e0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:42:41.887 INFO:tasks.workunit.client.0.smithi043.stderr: -337> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.887 INFO:tasks.workunit.client.0.smithi043.stderr: -336> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.887 INFO:tasks.workunit.client.0.smithi043.stderr: -335> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.887 INFO:tasks.workunit.client.0.smithi043.stderr: -334> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:41.888 INFO:tasks.workunit.client.0.smithi043.stderr: -333> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient(hunting): authenticate will time out at 2457.528130s 2024-09-12T00:42:41.888 INFO:tasks.workunit.client.0.smithi043.stderr: -332> 2024-09-12T00:42:41.537+0000 7f791b35b640 10 monclient(hunting): get_auth_request con 0x55f3039b20e0 auth_method 0 2024-09-12T00:42:41.888 INFO:tasks.workunit.client.0.smithi043.stderr: -331> 2024-09-12T00:42:41.537+0000 7f791b35b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.888 INFO:tasks.workunit.client.0.smithi043.stderr: -330> 2024-09-12T00:42:41.537+0000 7f791b35b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.888 INFO:tasks.workunit.client.0.smithi043.stderr: -329> 2024-09-12T00:42:41.537+0000 7f791b35b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.888 INFO:tasks.workunit.client.0.smithi043.stderr: -328> 2024-09-12T00:42:41.537+0000 7f791a359640 10 monclient(hunting): get_auth_request con 0x55f3039b3700 auth_method 0 2024-09-12T00:42:41.888 INFO:tasks.workunit.client.0.smithi043.stderr: -327> 2024-09-12T00:42:41.537+0000 7f791a359640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.888 INFO:tasks.workunit.client.0.smithi043.stderr: -326> 2024-09-12T00:42:41.537+0000 7f791a359640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.888 INFO:tasks.workunit.client.0.smithi043.stderr: -325> 2024-09-12T00:42:41.537+0000 7f791a359640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.888 INFO:tasks.workunit.client.0.smithi043.stderr: -324> 2024-09-12T00:42:41.537+0000 7f791b35b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.888 INFO:tasks.workunit.client.0.smithi043.stderr: -323> 2024-09-12T00:42:41.537+0000 7f791b35b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.888 INFO:tasks.workunit.client.0.smithi043.stderr: -322> 2024-09-12T00:42:41.537+0000 7f791b35b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.888 INFO:tasks.workunit.client.0.smithi043.stderr: -321> 2024-09-12T00:42:41.537+0000 7f791a359640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.889 INFO:tasks.workunit.client.0.smithi043.stderr: -320> 2024-09-12T00:42:41.537+0000 7f791a359640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.889 INFO:tasks.workunit.client.0.smithi043.stderr: -319> 2024-09-12T00:42:41.537+0000 7f791a359640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.889 INFO:tasks.workunit.client.0.smithi043.stderr: -318> 2024-09-12T00:42:41.537+0000 7f791ab5a640 10 monclient(hunting): get_auth_request con 0x55f3039b3dd0 auth_method 0 2024-09-12T00:42:41.889 INFO:tasks.workunit.client.0.smithi043.stderr: -317> 2024-09-12T00:42:41.537+0000 7f791ab5a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.889 INFO:tasks.workunit.client.0.smithi043.stderr: -316> 2024-09-12T00:42:41.537+0000 7f791ab5a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.889 INFO:tasks.workunit.client.0.smithi043.stderr: -315> 2024-09-12T00:42:41.537+0000 7f791ab5a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.889 INFO:tasks.workunit.client.0.smithi043.stderr: -314> 2024-09-12T00:42:41.537+0000 7f791b35b640 10 monclient(hunting): handle_auth_done global_id 7871 payload 824 2024-09-12T00:42:41.889 INFO:tasks.workunit.client.0.smithi043.stderr: -313> 2024-09-12T00:42:41.537+0000 7f791b35b640 10 monclient: _finish_hunting 0 2024-09-12T00:42:41.889 INFO:tasks.workunit.client.0.smithi043.stderr: -312> 2024-09-12T00:42:41.537+0000 7f791b35b640 1 monclient: found mon.noname-c 2024-09-12T00:42:41.889 INFO:tasks.workunit.client.0.smithi043.stderr: -311> 2024-09-12T00:42:41.537+0000 7f791b35b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:42:41.889 INFO:tasks.workunit.client.0.smithi043.stderr: -310> 2024-09-12T00:42:41.537+0000 7f7804e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.889 INFO:tasks.workunit.client.0.smithi043.stderr: -309> 2024-09-12T00:42:41.537+0000 7f7804e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:42:41.890 INFO:tasks.workunit.client.0.smithi043.stderr: -308> 2024-09-12T00:42:41.537+0000 7f7804e01640 10 monclient: dump: 2024-09-12T00:42:41.890 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:41.890 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:41.890 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.890 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.890 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.890 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:41.890 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:41.890 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:41.890 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:41.890 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.890 INFO:tasks.workunit.client.0.smithi043.stderr: -307> 2024-09-12T00:42:41.537+0000 7f7804e01640 10 monclient: _finish_auth 0 2024-09-12T00:42:41.890 INFO:tasks.workunit.client.0.smithi043.stderr: -306> 2024-09-12T00:42:41.537+0000 7f7804e01640 10 monclient: _check_auth_tickets 2024-09-12T00:42:41.891 INFO:tasks.workunit.client.0.smithi043.stderr: -305> 2024-09-12T00:42:41.537+0000 7f7804e01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:41.891 INFO:tasks.workunit.client.0.smithi043.stderr: -304> 2024-09-12T00:42:41.537+0000 7f7804e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.891 INFO:tasks.workunit.client.0.smithi043.stderr: -303> 2024-09-12T00:42:41.537+0000 7f7804e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:42:41.891 INFO:tasks.workunit.client.0.smithi043.stderr: -302> 2024-09-12T00:42:41.537+0000 7f7804e01640 10 monclient: dump: 2024-09-12T00:42:41.891 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:41.891 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:41.891 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.891 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.891 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.891 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:41.891 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:41.891 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:41.891 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:41.892 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.892 INFO:tasks.workunit.client.0.smithi043.stderr: -301> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 monclient: authenticate success, global_id 7871 2024-09-12T00:42:41.892 INFO:tasks.workunit.client.0.smithi043.stderr: -300> 2024-09-12T00:42:41.537+0000 7f791bb5c640 4 set_mon_vals no callback set 2024-09-12T00:42:41.892 INFO:tasks.workunit.client.0.smithi043.stderr: -299> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient: _renew_subs 2024-09-12T00:42:41.892 INFO:tasks.workunit.client.0.smithi043.stderr: -298> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:42:41.892 INFO:tasks.workunit.client.0.smithi043.stderr: -297> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient: _renew_subs 2024-09-12T00:42:41.892 INFO:tasks.workunit.client.0.smithi043.stderr: -296> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:42:41.892 INFO:tasks.workunit.client.0.smithi043.stderr: -295> 2024-09-12T00:42:41.537+0000 7f7804e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:41.892 INFO:tasks.workunit.client.0.smithi043.stderr: -294> 2024-09-12T00:42:41.537+0000 7f7804e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:42:41.892 INFO:tasks.workunit.client.0.smithi043.stderr: -293> 2024-09-12T00:42:41.537+0000 7f7804e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:42:41.892 INFO:tasks.workunit.client.0.smithi043.stderr: -292> 2024-09-12T00:42:41.537+0000 7f791ab5a640 10 monclient: get_auth_request con 0x7f77f4070a20 auth_method 0 2024-09-12T00:42:41.892 INFO:tasks.workunit.client.0.smithi043.stderr: -291> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient: get_monmap_and_config 2024-09-12T00:42:41.892 INFO:tasks.workunit.client.0.smithi043.stderr: -290> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient: build_initial_monmap 2024-09-12T00:42:41.893 INFO:tasks.workunit.client.0.smithi043.stderr: -289> 2024-09-12T00:42:41.537+0000 7f791d0549c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:41.893 INFO:tasks.workunit.client.0.smithi043.stderr: -288> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient: monmap: 2024-09-12T00:42:41.893 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:42:41.893 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:41.893 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:42:41.893 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:42:41.893 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:41.893 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:41.893 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:42:41.893 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:42:41.893 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:42:41.893 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.894 INFO:tasks.workunit.client.0.smithi043.stderr: -287> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x55f3039d3590) adding auth protocol: cephx 2024-09-12T00:42:41.894 INFO:tasks.workunit.client.0.smithi043.stderr: -286> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x55f3039d3590) adding auth protocol: cephx 2024-09-12T00:42:41.894 INFO:tasks.workunit.client.0.smithi043.stderr: -285> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x55f3039d3590) adding auth protocol: cephx 2024-09-12T00:42:41.894 INFO:tasks.workunit.client.0.smithi043.stderr: -284> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x55f3039d3590) adding con mode: secure 2024-09-12T00:42:41.894 INFO:tasks.workunit.client.0.smithi043.stderr: -283> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x55f3039d3590) adding con mode: crc 2024-09-12T00:42:41.894 INFO:tasks.workunit.client.0.smithi043.stderr: -282> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x55f3039d3590) adding con mode: secure 2024-09-12T00:42:41.894 INFO:tasks.workunit.client.0.smithi043.stderr: -281> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x55f3039d3590) adding con mode: crc 2024-09-12T00:42:41.894 INFO:tasks.workunit.client.0.smithi043.stderr: -280> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x55f3039d3590) adding con mode: secure 2024-09-12T00:42:41.894 INFO:tasks.workunit.client.0.smithi043.stderr: -279> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x55f3039d3590) adding con mode: crc 2024-09-12T00:42:41.894 INFO:tasks.workunit.client.0.smithi043.stderr: -278> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x55f3039d3590) adding con mode: crc 2024-09-12T00:42:41.894 INFO:tasks.workunit.client.0.smithi043.stderr: -277> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x55f3039d3590) adding con mode: secure 2024-09-12T00:42:41.894 INFO:tasks.workunit.client.0.smithi043.stderr: -276> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x55f3039d3590) adding con mode: crc 2024-09-12T00:42:41.894 INFO:tasks.workunit.client.0.smithi043.stderr: -275> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x55f3039d3590) adding con mode: secure 2024-09-12T00:42:41.895 INFO:tasks.workunit.client.0.smithi043.stderr: -274> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x55f3039d3590) adding con mode: crc 2024-09-12T00:42:41.895 INFO:tasks.workunit.client.0.smithi043.stderr: -273> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x55f3039d3590) adding con mode: secure 2024-09-12T00:42:41.895 INFO:tasks.workunit.client.0.smithi043.stderr: -272> 2024-09-12T00:42:41.537+0000 7f791d0549c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.895 INFO:tasks.workunit.client.0.smithi043.stderr: -271> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient: init 2024-09-12T00:42:41.895 INFO:tasks.workunit.client.0.smithi043.stderr: -270> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c7dd0) adding auth protocol: cephx 2024-09-12T00:42:41.895 INFO:tasks.workunit.client.0.smithi043.stderr: -269> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c7dd0) adding auth protocol: cephx 2024-09-12T00:42:41.895 INFO:tasks.workunit.client.0.smithi043.stderr: -268> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c7dd0) adding auth protocol: cephx 2024-09-12T00:42:41.895 INFO:tasks.workunit.client.0.smithi043.stderr: -267> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c7dd0) adding con mode: secure 2024-09-12T00:42:41.895 INFO:tasks.workunit.client.0.smithi043.stderr: -266> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c7dd0) adding con mode: crc 2024-09-12T00:42:41.895 INFO:tasks.workunit.client.0.smithi043.stderr: -265> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c7dd0) adding con mode: secure 2024-09-12T00:42:41.895 INFO:tasks.workunit.client.0.smithi043.stderr: -264> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c7dd0) adding con mode: crc 2024-09-12T00:42:41.895 INFO:tasks.workunit.client.0.smithi043.stderr: -263> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c7dd0) adding con mode: secure 2024-09-12T00:42:41.895 INFO:tasks.workunit.client.0.smithi043.stderr: -262> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c7dd0) adding con mode: crc 2024-09-12T00:42:41.896 INFO:tasks.workunit.client.0.smithi043.stderr: -261> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c7dd0) adding con mode: crc 2024-09-12T00:42:41.896 INFO:tasks.workunit.client.0.smithi043.stderr: -260> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c7dd0) adding con mode: secure 2024-09-12T00:42:41.896 INFO:tasks.workunit.client.0.smithi043.stderr: -259> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c7dd0) adding con mode: crc 2024-09-12T00:42:41.896 INFO:tasks.workunit.client.0.smithi043.stderr: -258> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c7dd0) adding con mode: secure 2024-09-12T00:42:41.896 INFO:tasks.workunit.client.0.smithi043.stderr: -257> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c7dd0) adding con mode: crc 2024-09-12T00:42:41.896 INFO:tasks.workunit.client.0.smithi043.stderr: -256> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c7dd0) adding con mode: secure 2024-09-12T00:42:41.896 INFO:tasks.workunit.client.0.smithi043.stderr: -255> 2024-09-12T00:42:41.537+0000 7f791d0549c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.896 INFO:tasks.workunit.client.0.smithi043.stderr: -254> 2024-09-12T00:42:41.541+0000 7f791d0549c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.896 INFO:tasks.workunit.client.0.smithi043.stderr: -253> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command rotate-key cmddesc rotate-key hook 0x7fffc01c7f18 EEXIST 2024-09-12T00:42:41.896 INFO:tasks.workunit.client.0.smithi043.stderr: -252> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:41.896 INFO:tasks.workunit.client.0.smithi043.stderr: -251> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:42:41.896 INFO:tasks.workunit.client.0.smithi043.stderr: -250> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): picked mon.noname-c con 0x55f303a07ab0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:42:41.896 INFO:tasks.workunit.client.0.smithi043.stderr: -249> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): picked mon.noname-a con 0x55f303a02ea0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:42:41.897 INFO:tasks.workunit.client.0.smithi043.stderr: -248> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): picked mon.noname-b con 0x55f303a03820 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:42:41.897 INFO:tasks.workunit.client.0.smithi043.stderr: -247> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.897 INFO:tasks.workunit.client.0.smithi043.stderr: -246> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.897 INFO:tasks.workunit.client.0.smithi043.stderr: -245> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.897 INFO:tasks.workunit.client.0.smithi043.stderr: -244> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:41.897 INFO:tasks.workunit.client.0.smithi043.stderr: -243> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): authenticate will time out at 2457.532332s 2024-09-12T00:42:41.897 INFO:tasks.workunit.client.0.smithi043.stderr: -242> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient(hunting): get_auth_request con 0x55f303a07ab0 auth_method 0 2024-09-12T00:42:41.897 INFO:tasks.workunit.client.0.smithi043.stderr: -241> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.897 INFO:tasks.workunit.client.0.smithi043.stderr: -240> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.897 INFO:tasks.workunit.client.0.smithi043.stderr: -239> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.897 INFO:tasks.workunit.client.0.smithi043.stderr: -238> 2024-09-12T00:42:41.541+0000 7f791a359640 10 monclient(hunting): get_auth_request con 0x55f303a02ea0 auth_method 0 2024-09-12T00:42:41.897 INFO:tasks.workunit.client.0.smithi043.stderr: -237> 2024-09-12T00:42:41.541+0000 7f791a359640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.898 INFO:tasks.workunit.client.0.smithi043.stderr: -236> 2024-09-12T00:42:41.541+0000 7f791a359640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.898 INFO:tasks.workunit.client.0.smithi043.stderr: -235> 2024-09-12T00:42:41.541+0000 7f791a359640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.898 INFO:tasks.workunit.client.0.smithi043.stderr: -234> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.898 INFO:tasks.workunit.client.0.smithi043.stderr: -233> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.898 INFO:tasks.workunit.client.0.smithi043.stderr: -232> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.898 INFO:tasks.workunit.client.0.smithi043.stderr: -231> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient(hunting): handle_auth_done global_id 7874 payload 274 2024-09-12T00:42:41.898 INFO:tasks.workunit.client.0.smithi043.stderr: -230> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient: _finish_hunting 0 2024-09-12T00:42:41.898 INFO:tasks.workunit.client.0.smithi043.stderr: -229> 2024-09-12T00:42:41.541+0000 7f791ab5a640 1 monclient: found mon.noname-c 2024-09-12T00:42:41.898 INFO:tasks.workunit.client.0.smithi043.stderr: -228> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:42:41.898 INFO:tasks.workunit.client.0.smithi043.stderr: -227> 2024-09-12T00:42:41.541+0000 7f77fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.898 INFO:tasks.workunit.client.0.smithi043.stderr: -226> 2024-09-12T00:42:41.541+0000 7f77fe7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:42:41.898 INFO:tasks.workunit.client.0.smithi043.stderr: -225> 2024-09-12T00:42:41.541+0000 7f77fe7fc640 10 monclient: dump: 2024-09-12T00:42:41.898 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:41.899 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:41.899 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.899 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.899 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.899 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:41.899 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:41.899 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:41.899 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:41.899 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.899 INFO:tasks.workunit.client.0.smithi043.stderr: -224> 2024-09-12T00:42:41.541+0000 7f77fe7fc640 10 monclient: _finish_auth 0 2024-09-12T00:42:41.899 INFO:tasks.workunit.client.0.smithi043.stderr: -223> 2024-09-12T00:42:41.541+0000 7f77fe7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:42:41.899 INFO:tasks.workunit.client.0.smithi043.stderr: -222> 2024-09-12T00:42:41.541+0000 7f77fe7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:41.899 INFO:tasks.workunit.client.0.smithi043.stderr: -221> 2024-09-12T00:42:41.541+0000 7f77fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.899 INFO:tasks.workunit.client.0.smithi043.stderr: -220> 2024-09-12T00:42:41.541+0000 7f77fe7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:42:41.900 INFO:tasks.workunit.client.0.smithi043.stderr: -219> 2024-09-12T00:42:41.541+0000 7f77fe7fc640 10 monclient: dump: 2024-09-12T00:42:41.900 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:41.900 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:41.900 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.900 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.900 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.900 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:41.900 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:41.900 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:41.900 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:41.900 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.900 INFO:tasks.workunit.client.0.smithi043.stderr: -218> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 monclient: authenticate success, global_id 7874 2024-09-12T00:42:41.901 INFO:tasks.workunit.client.0.smithi043.stderr: -217> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient: get_monmap_and_config success 2024-09-12T00:42:41.901 INFO:tasks.workunit.client.0.smithi043.stderr: -216> 2024-09-12T00:42:41.541+0000 7f791d0549c0 4 set_mon_vals no callback set 2024-09-12T00:42:41.901 INFO:tasks.workunit.client.0.smithi043.stderr: -215> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient: shutdown 2024-09-12T00:42:41.901 INFO:tasks.workunit.client.0.smithi043.stderr: -214> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient: build_initial_monmap 2024-09-12T00:42:41.901 INFO:tasks.workunit.client.0.smithi043.stderr: -213> 2024-09-12T00:42:41.541+0000 7f791d0549c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:41.901 INFO:tasks.workunit.client.0.smithi043.stderr: -212> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient: monmap: 2024-09-12T00:42:41.901 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:42:41.901 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:41.901 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:42:41.901 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:42:41.901 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:41.901 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:41.901 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:42:41.902 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:42:41.902 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:42:41.902 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.902 INFO:tasks.workunit.client.0.smithi043.stderr: -211> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039fa0a0) adding auth protocol: cephx 2024-09-12T00:42:41.902 INFO:tasks.workunit.client.0.smithi043.stderr: -210> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039fa0a0) adding auth protocol: cephx 2024-09-12T00:42:41.902 INFO:tasks.workunit.client.0.smithi043.stderr: -209> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039fa0a0) adding auth protocol: cephx 2024-09-12T00:42:41.902 INFO:tasks.workunit.client.0.smithi043.stderr: -208> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039fa0a0) adding con mode: secure 2024-09-12T00:42:41.902 INFO:tasks.workunit.client.0.smithi043.stderr: -207> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039fa0a0) adding con mode: crc 2024-09-12T00:42:41.902 INFO:tasks.workunit.client.0.smithi043.stderr: -206> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039fa0a0) adding con mode: secure 2024-09-12T00:42:41.902 INFO:tasks.workunit.client.0.smithi043.stderr: -205> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039fa0a0) adding con mode: crc 2024-09-12T00:42:41.902 INFO:tasks.workunit.client.0.smithi043.stderr: -204> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039fa0a0) adding con mode: secure 2024-09-12T00:42:41.902 INFO:tasks.workunit.client.0.smithi043.stderr: -203> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039fa0a0) adding con mode: crc 2024-09-12T00:42:41.902 INFO:tasks.workunit.client.0.smithi043.stderr: -202> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039fa0a0) adding con mode: crc 2024-09-12T00:42:41.903 INFO:tasks.workunit.client.0.smithi043.stderr: -201> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039fa0a0) adding con mode: secure 2024-09-12T00:42:41.903 INFO:tasks.workunit.client.0.smithi043.stderr: -200> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039fa0a0) adding con mode: crc 2024-09-12T00:42:41.903 INFO:tasks.workunit.client.0.smithi043.stderr: -199> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039fa0a0) adding con mode: secure 2024-09-12T00:42:41.903 INFO:tasks.workunit.client.0.smithi043.stderr: -198> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039fa0a0) adding con mode: crc 2024-09-12T00:42:41.903 INFO:tasks.workunit.client.0.smithi043.stderr: -197> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039fa0a0) adding con mode: secure 2024-09-12T00:42:41.903 INFO:tasks.workunit.client.0.smithi043.stderr: -196> 2024-09-12T00:42:41.541+0000 7f791d0549c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.903 INFO:tasks.workunit.client.0.smithi043.stderr: -195> 2024-09-12T00:42:41.541+0000 7f791d0549c0 1 librados: starting msgr at 2024-09-12T00:42:41.903 INFO:tasks.workunit.client.0.smithi043.stderr: -194> 2024-09-12T00:42:41.541+0000 7f791d0549c0 1 librados: starting objecter 2024-09-12T00:42:41.903 INFO:tasks.workunit.client.0.smithi043.stderr: -193> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55f3039d7b00 EEXIST 2024-09-12T00:42:41.903 INFO:tasks.workunit.client.0.smithi043.stderr: -192> 2024-09-12T00:42:41.541+0000 7f791d0549c0 1 librados: setting wanted keys 2024-09-12T00:42:41.903 INFO:tasks.workunit.client.0.smithi043.stderr: -191> 2024-09-12T00:42:41.541+0000 7f791d0549c0 1 librados: calling monclient init 2024-09-12T00:42:41.903 INFO:tasks.workunit.client.0.smithi043.stderr: -190> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient: init 2024-09-12T00:42:41.903 INFO:tasks.workunit.client.0.smithi043.stderr: -189> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039b5bf0) adding auth protocol: cephx 2024-09-12T00:42:41.904 INFO:tasks.workunit.client.0.smithi043.stderr: -188> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039b5bf0) adding auth protocol: cephx 2024-09-12T00:42:41.904 INFO:tasks.workunit.client.0.smithi043.stderr: -187> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039b5bf0) adding auth protocol: cephx 2024-09-12T00:42:41.904 INFO:tasks.workunit.client.0.smithi043.stderr: -186> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039b5bf0) adding con mode: secure 2024-09-12T00:42:41.904 INFO:tasks.workunit.client.0.smithi043.stderr: -185> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039b5bf0) adding con mode: crc 2024-09-12T00:42:41.904 INFO:tasks.workunit.client.0.smithi043.stderr: -184> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039b5bf0) adding con mode: secure 2024-09-12T00:42:41.904 INFO:tasks.workunit.client.0.smithi043.stderr: -183> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039b5bf0) adding con mode: crc 2024-09-12T00:42:41.904 INFO:tasks.workunit.client.0.smithi043.stderr: -182> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039b5bf0) adding con mode: secure 2024-09-12T00:42:41.904 INFO:tasks.workunit.client.0.smithi043.stderr: -181> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039b5bf0) adding con mode: crc 2024-09-12T00:42:41.904 INFO:tasks.workunit.client.0.smithi043.stderr: -180> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039b5bf0) adding con mode: crc 2024-09-12T00:42:41.904 INFO:tasks.workunit.client.0.smithi043.stderr: -179> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039b5bf0) adding con mode: secure 2024-09-12T00:42:41.904 INFO:tasks.workunit.client.0.smithi043.stderr: -178> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039b5bf0) adding con mode: crc 2024-09-12T00:42:41.904 INFO:tasks.workunit.client.0.smithi043.stderr: -177> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039b5bf0) adding con mode: secure 2024-09-12T00:42:41.904 INFO:tasks.workunit.client.0.smithi043.stderr: -176> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039b5bf0) adding con mode: crc 2024-09-12T00:42:41.905 INFO:tasks.workunit.client.0.smithi043.stderr: -175> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039b5bf0) adding con mode: secure 2024-09-12T00:42:41.905 INFO:tasks.workunit.client.0.smithi043.stderr: -174> 2024-09-12T00:42:41.541+0000 7f791d0549c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.905 INFO:tasks.workunit.client.0.smithi043.stderr: -173> 2024-09-12T00:42:41.541+0000 7f791d0549c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.905 INFO:tasks.workunit.client.0.smithi043.stderr: -172> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command rotate-key cmddesc rotate-key hook 0x55f3039b5d38 EEXIST 2024-09-12T00:42:41.905 INFO:tasks.workunit.client.0.smithi043.stderr: -171> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:41.905 INFO:tasks.workunit.client.0.smithi043.stderr: -170> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:42:41.905 INFO:tasks.workunit.client.0.smithi043.stderr: -169> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): picked mon.noname-c con 0x55f303a02ea0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:42:41.905 INFO:tasks.workunit.client.0.smithi043.stderr: -168> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): picked mon.noname-b con 0x55f303a03820 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:42:41.905 INFO:tasks.workunit.client.0.smithi043.stderr: -167> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): picked mon.noname-a con 0x55f303a07ab0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:42:41.905 INFO:tasks.workunit.client.0.smithi043.stderr: -166> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.905 INFO:tasks.workunit.client.0.smithi043.stderr: -165> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.905 INFO:tasks.workunit.client.0.smithi043.stderr: -164> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.905 INFO:tasks.workunit.client.0.smithi043.stderr: -163> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:41.906 INFO:tasks.workunit.client.0.smithi043.stderr: -162> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): authenticate will time out at 2457.535154s 2024-09-12T00:42:41.906 INFO:tasks.workunit.client.0.smithi043.stderr: -161> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient(hunting): get_auth_request con 0x55f303a02ea0 auth_method 0 2024-09-12T00:42:41.906 INFO:tasks.workunit.client.0.smithi043.stderr: -160> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.906 INFO:tasks.workunit.client.0.smithi043.stderr: -159> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.906 INFO:tasks.workunit.client.0.smithi043.stderr: -158> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.906 INFO:tasks.workunit.client.0.smithi043.stderr: -157> 2024-09-12T00:42:41.541+0000 7f791b35b640 10 monclient(hunting): get_auth_request con 0x55f303a07ab0 auth_method 0 2024-09-12T00:42:41.906 INFO:tasks.workunit.client.0.smithi043.stderr: -156> 2024-09-12T00:42:41.541+0000 7f791b35b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.906 INFO:tasks.workunit.client.0.smithi043.stderr: -155> 2024-09-12T00:42:41.541+0000 7f791b35b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.906 INFO:tasks.workunit.client.0.smithi043.stderr: -154> 2024-09-12T00:42:41.541+0000 7f791b35b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.906 INFO:tasks.workunit.client.0.smithi043.stderr: -153> 2024-09-12T00:42:41.541+0000 7f791b35b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.906 INFO:tasks.workunit.client.0.smithi043.stderr: -152> 2024-09-12T00:42:41.541+0000 7f791b35b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.906 INFO:tasks.workunit.client.0.smithi043.stderr: -151> 2024-09-12T00:42:41.541+0000 7f791b35b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.906 INFO:tasks.workunit.client.0.smithi043.stderr: -150> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.907 INFO:tasks.workunit.client.0.smithi043.stderr: -149> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.907 INFO:tasks.workunit.client.0.smithi043.stderr: -148> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.907 INFO:tasks.workunit.client.0.smithi043.stderr: -147> 2024-09-12T00:42:41.541+0000 7f791b35b640 10 monclient(hunting): handle_auth_done global_id 8283 payload 824 2024-09-12T00:42:41.907 INFO:tasks.workunit.client.0.smithi043.stderr: -146> 2024-09-12T00:42:41.541+0000 7f791b35b640 10 monclient: _finish_hunting 0 2024-09-12T00:42:41.907 INFO:tasks.workunit.client.0.smithi043.stderr: -145> 2024-09-12T00:42:41.541+0000 7f791b35b640 1 monclient: found mon.noname-a 2024-09-12T00:42:41.907 INFO:tasks.workunit.client.0.smithi043.stderr: -144> 2024-09-12T00:42:41.541+0000 7f791b35b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:42:41.907 INFO:tasks.workunit.client.0.smithi043.stderr: -143> 2024-09-12T00:42:41.541+0000 7f77fcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.907 INFO:tasks.workunit.client.0.smithi043.stderr: -142> 2024-09-12T00:42:41.545+0000 7f77fcff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:41.907 INFO:tasks.workunit.client.0.smithi043.stderr: -141> 2024-09-12T00:42:41.545+0000 7f77fcff9640 10 monclient: dump: 2024-09-12T00:42:41.907 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:41.907 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:41.907 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.907 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.907 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.908 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:41.908 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:41.908 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:41.908 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:41.908 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.908 INFO:tasks.workunit.client.0.smithi043.stderr: -140> 2024-09-12T00:42:41.545+0000 7f77fcff9640 10 monclient: _finish_auth 0 2024-09-12T00:42:41.908 INFO:tasks.workunit.client.0.smithi043.stderr: -139> 2024-09-12T00:42:41.545+0000 7f77fcff9640 10 monclient: _check_auth_tickets 2024-09-12T00:42:41.908 INFO:tasks.workunit.client.0.smithi043.stderr: -138> 2024-09-12T00:42:41.545+0000 7f791d0549c0 5 monclient: authenticate success, global_id 8283 2024-09-12T00:42:41.908 INFO:tasks.workunit.client.0.smithi043.stderr: -137> 2024-09-12T00:42:41.545+0000 7f791d0549c0 10 monclient: _renew_subs 2024-09-12T00:42:41.908 INFO:tasks.workunit.client.0.smithi043.stderr: -136> 2024-09-12T00:42:41.545+0000 7f791d0549c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:42:41.908 INFO:tasks.workunit.client.0.smithi043.stderr: -135> 2024-09-12T00:42:41.545+0000 7f77fcff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:41.908 INFO:tasks.workunit.client.0.smithi043.stderr: -134> 2024-09-12T00:42:41.545+0000 7f77fcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.908 INFO:tasks.workunit.client.0.smithi043.stderr: -133> 2024-09-12T00:42:41.545+0000 7f77fcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:41.909 INFO:tasks.workunit.client.0.smithi043.stderr: -132> 2024-09-12T00:42:41.545+0000 7f77fcff9640 10 monclient: dump: 2024-09-12T00:42:41.909 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:41.909 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:41.909 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.909 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.909 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.909 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:41.909 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:41.909 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:41.909 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:41.909 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.909 INFO:tasks.workunit.client.0.smithi043.stderr: -131> 2024-09-12T00:42:41.545+0000 7f77fe7fc640 4 set_mon_vals no callback set 2024-09-12T00:42:41.909 INFO:tasks.workunit.client.0.smithi043.stderr: -130> 2024-09-12T00:42:41.545+0000 7f791d0549c0 10 monclient: _renew_subs 2024-09-12T00:42:41.910 INFO:tasks.workunit.client.0.smithi043.stderr: -129> 2024-09-12T00:42:41.545+0000 7f791d0549c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:42:41.910 INFO:tasks.workunit.client.0.smithi043.stderr: -128> 2024-09-12T00:42:41.545+0000 7f791d0549c0 1 librados: init done 2024-09-12T00:42:41.910 INFO:tasks.workunit.client.0.smithi043.stderr: -127> 2024-09-12T00:42:41.545+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command cr dump hook 0x55f3039f8a88 2024-09-12T00:42:41.910 INFO:tasks.workunit.client.0.smithi043.stderr: -126> 2024-09-12T00:42:41.545+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.910 INFO:tasks.workunit.client.0.smithi043.stderr: -125> 2024-09-12T00:42:41.545+0000 7f77fcff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:41.910 INFO:tasks.workunit.client.0.smithi043.stderr: -124> 2024-09-12T00:42:41.545+0000 7f77fcff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:42:41.910 INFO:tasks.workunit.client.0.smithi043.stderr: -123> 2024-09-12T00:42:41.545+0000 7f77fcff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:42:41.910 INFO:tasks.workunit.client.0.smithi043.stderr: -122> 2024-09-12T00:42:41.545+0000 7f791ab5a640 10 monclient: get_auth_request con 0x7f77e4070b10 auth_method 0 2024-09-12T00:42:41.910 INFO:tasks.workunit.client.0.smithi043.stderr: -121> 2024-09-12T00:42:41.545+0000 7f791a359640 10 monclient: get_auth_request con 0x55f303a211c0 auth_method 0 2024-09-12T00:42:41.910 INFO:tasks.workunit.client.0.smithi043.stderr: -120> 2024-09-12T00:42:41.545+0000 7f791d0549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.910 INFO:tasks.workunit.client.0.smithi043.stderr: -119> 2024-09-12T00:42:41.545+0000 7f791d0549c0 20 realm 2024-09-12T00:42:41.910 INFO:tasks.workunit.client.0.smithi043.stderr: -118> 2024-09-12T00:42:41.545+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.911 INFO:tasks.workunit.client.0.smithi043.stderr: -117> 2024-09-12T00:42:41.545+0000 7f791d0549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.911 INFO:tasks.workunit.client.0.smithi043.stderr: -116> 2024-09-12T00:42:41.545+0000 7f791d0549c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:41.911 INFO:tasks.workunit.client.0.smithi043.stderr: -115> 2024-09-12T00:42:41.545+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.911 INFO:tasks.workunit.client.0.smithi043.stderr: -114> 2024-09-12T00:42:41.549+0000 7f791d0549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.911 INFO:tasks.workunit.client.0.smithi043.stderr: -113> 2024-09-12T00:42:41.549+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.911 INFO:tasks.workunit.client.0.smithi043.stderr: -112> 2024-09-12T00:42:41.549+0000 7f791ab5a640 10 monclient: get_auth_request con 0x55f303a25360 auth_method 0 2024-09-12T00:42:41.911 INFO:tasks.workunit.client.0.smithi043.stderr: -111> 2024-09-12T00:42:41.549+0000 7f791d0549c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:41.911 INFO:tasks.workunit.client.0.smithi043.stderr: -110> 2024-09-12T00:42:41.549+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.911 INFO:tasks.workunit.client.0.smithi043.stderr: -109> 2024-09-12T00:42:41.549+0000 7f791a359640 10 monclient: get_auth_request con 0x55f303a28ba0 auth_method 0 2024-09-12T00:42:41.911 INFO:tasks.workunit.client.0.smithi043.stderr: -108> 2024-09-12T00:42:41.549+0000 7f791d0549c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:41.911 INFO:tasks.workunit.client.0.smithi043.stderr: -107> 2024-09-12T00:42:41.549+0000 7f791d0549c0 20 searching for the correct realm 2024-09-12T00:42:41.911 INFO:tasks.workunit.client.0.smithi043.stderr: -106> 2024-09-12T00:42:41.549+0000 7f791b35b640 10 monclient: get_auth_request con 0x55f303a2d920 auth_method 0 2024-09-12T00:42:41.911 INFO:tasks.workunit.client.0.smithi043.stderr: -105> 2024-09-12T00:42:41.553+0000 7f791ab5a640 10 monclient: get_auth_request con 0x7f790c00e920 auth_method 0 2024-09-12T00:42:41.912 INFO:tasks.workunit.client.0.smithi043.stderr: -104> 2024-09-12T00:42:41.553+0000 7f791a359640 10 monclient: get_auth_request con 0x7f79100c0bc0 auth_method 0 2024-09-12T00:42:41.912 INFO:tasks.workunit.client.0.smithi043.stderr: -103> 2024-09-12T00:42:41.557+0000 7f791b35b640 0 -- 172.21.15.43:0/3115068998 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f79100d7c10 msgr2=0x7f79100e5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:41.912 INFO:tasks.workunit.client.0.smithi043.stderr: -102> 2024-09-12T00:42:41.557+0000 7f791b35b640 10 monclient: get_auth_request con 0x7f79100d7c10 auth_method 0 2024-09-12T00:42:41.912 INFO:tasks.workunit.client.0.smithi043.stderr: -101> 2024-09-12T00:42:41.761+0000 7f791b35b640 10 monclient: get_auth_request con 0x7f79100d7c10 auth_method 0 2024-09-12T00:42:41.912 INFO:tasks.workunit.client.0.smithi043.stderr: -100> 2024-09-12T00:42:41.769+0000 7f791ab5a640 10 monclient: get_auth_request con 0x7f79100b7430 auth_method 0 2024-09-12T00:42:41.912 INFO:tasks.workunit.client.0.smithi043.stderr: -99> 2024-09-12T00:42:41.773+0000 7f791ab5a640 0 -- 172.21.15.43:0/3115068998 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x55f303a25360 msgr2=0x55f303a27770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:41.912 INFO:tasks.workunit.client.0.smithi043.stderr: -98> 2024-09-12T00:42:41.773+0000 7f77fcff9640 1 client.8283.objecter ms_handle_reset 0x55f303a25360 session 0x55f303a24ce0 osd.5 2024-09-12T00:42:41.912 INFO:tasks.workunit.client.0.smithi043.stderr: -97> 2024-09-12T00:42:41.773+0000 7f77fcff9640 10 monclient: _renew_subs 2024-09-12T00:42:41.912 INFO:tasks.workunit.client.0.smithi043.stderr: -96> 2024-09-12T00:42:41.773+0000 7f77fcff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:42:41.912 INFO:tasks.workunit.client.0.smithi043.stderr: -95> 2024-09-12T00:42:41.777+0000 7f791ab5a640 10 monclient: get_auth_request con 0x7f77e4080b30 auth_method 0 2024-09-12T00:42:41.912 INFO:tasks.workunit.client.0.smithi043.stderr: -94> 2024-09-12T00:42:41.781+0000 7f791d0549c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:42:41.912 INFO:tasks.workunit.client.0.smithi043.stderr: -93> 2024-09-12T00:42:41.781+0000 7f791d0549c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:41.912 INFO:tasks.workunit.client.0.smithi043.stderr: -92> 2024-09-12T00:42:41.781+0000 7f791d0549c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:41.913 INFO:tasks.workunit.client.0.smithi043.stderr: -91> 2024-09-12T00:42:41.781+0000 7f791d0549c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:42:41.913 INFO:tasks.workunit.client.0.smithi043.stderr: -90> 2024-09-12T00:42:41.781+0000 7f791d0549c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:41.913 INFO:tasks.workunit.client.0.smithi043.stderr: -89> 2024-09-12T00:42:41.781+0000 7f791d0549c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:41.913 INFO:tasks.workunit.client.0.smithi043.stderr: -88> 2024-09-12T00:42:41.781+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.913 INFO:tasks.workunit.client.0.smithi043.stderr: -87> 2024-09-12T00:42:41.785+0000 7f791d0549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.913 INFO:tasks.workunit.client.0.smithi043.stderr: -86> 2024-09-12T00:42:41.785+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.913 INFO:tasks.workunit.client.0.smithi043.stderr: -85> 2024-09-12T00:42:41.785+0000 7f791d0549c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:41.913 INFO:tasks.workunit.client.0.smithi043.stderr: -84> 2024-09-12T00:42:41.785+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.913 INFO:tasks.workunit.client.0.smithi043.stderr: -83> 2024-09-12T00:42:41.785+0000 7f791d0549c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:41.913 INFO:tasks.workunit.client.0.smithi043.stderr: -82> 2024-09-12T00:42:41.785+0000 7f791d0549c0 20 zone default found 2024-09-12T00:42:41.913 INFO:tasks.workunit.client.0.smithi043.stderr: -81> 2024-09-12T00:42:41.785+0000 7f791d0549c0 4 Realm: () 2024-09-12T00:42:41.913 INFO:tasks.workunit.client.0.smithi043.stderr: -80> 2024-09-12T00:42:41.785+0000 7f791d0549c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:42:41.914 INFO:tasks.workunit.client.0.smithi043.stderr: -79> 2024-09-12T00:42:41.785+0000 7f791d0549c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:42:41.914 INFO:tasks.workunit.client.0.smithi043.stderr: -78> 2024-09-12T00:42:41.785+0000 7f791d0549c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:41.914 INFO:tasks.workunit.client.0.smithi043.stderr: -77> 2024-09-12T00:42:41.785+0000 7f791d0549c0 20 zonegroup default 2024-09-12T00:42:41.914 INFO:tasks.workunit.client.0.smithi043.stderr: -76> 2024-09-12T00:42:41.785+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.914 INFO:tasks.workunit.client.0.smithi043.stderr: -75> 2024-09-12T00:42:41.785+0000 7f791d0549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.914 INFO:tasks.workunit.client.0.smithi043.stderr: -74> 2024-09-12T00:42:41.785+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.914 INFO:tasks.workunit.client.0.smithi043.stderr: -73> 2024-09-12T00:42:41.785+0000 7f791d0549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.914 INFO:tasks.workunit.client.0.smithi043.stderr: -72> 2024-09-12T00:42:41.785+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.914 INFO:tasks.workunit.client.0.smithi043.stderr: -71> 2024-09-12T00:42:41.789+0000 7f791d0549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.914 INFO:tasks.workunit.client.0.smithi043.stderr: -70> 2024-09-12T00:42:41.789+0000 7f791d0549c0 20 started sync module instance, tier type = 2024-09-12T00:42:41.914 INFO:tasks.workunit.client.0.smithi043.stderr: -69> 2024-09-12T00:42:41.789+0000 7f791d0549c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:42:41.914 INFO:tasks.workunit.client.0.smithi043.stderr: -68> 2024-09-12T00:42:41.809+0000 7f791d0549c0 20 add_watcher() i=0 2024-09-12T00:42:41.914 INFO:tasks.workunit.client.0.smithi043.stderr: -67> 2024-09-12T00:42:41.809+0000 7f791d0549c0 20 add_watcher() i=1 2024-09-12T00:42:41.915 INFO:tasks.workunit.client.0.smithi043.stderr: -66> 2024-09-12T00:42:41.809+0000 7f791d0549c0 20 add_watcher() i=2 2024-09-12T00:42:41.915 INFO:tasks.workunit.client.0.smithi043.stderr: -65> 2024-09-12T00:42:41.809+0000 7f791d0549c0 20 add_watcher() i=3 2024-09-12T00:42:41.915 INFO:tasks.workunit.client.0.smithi043.stderr: -64> 2024-09-12T00:42:41.809+0000 7f791d0549c0 20 add_watcher() i=4 2024-09-12T00:42:41.915 INFO:tasks.workunit.client.0.smithi043.stderr: -63> 2024-09-12T00:42:41.809+0000 7f791d0549c0 20 add_watcher() i=5 2024-09-12T00:42:41.915 INFO:tasks.workunit.client.0.smithi043.stderr: -62> 2024-09-12T00:42:41.809+0000 7f791d0549c0 20 add_watcher() i=6 2024-09-12T00:42:41.915 INFO:tasks.workunit.client.0.smithi043.stderr: -61> 2024-09-12T00:42:41.813+0000 7f791d0549c0 20 add_watcher() i=7 2024-09-12T00:42:41.915 INFO:tasks.workunit.client.0.smithi043.stderr: -60> 2024-09-12T00:42:41.813+0000 7f791d0549c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:41.915 INFO:tasks.workunit.client.0.smithi043.stderr: -59> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c82b0) adding auth protocol: cephx 2024-09-12T00:42:41.915 INFO:tasks.workunit.client.0.smithi043.stderr: -58> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c82b0) adding auth protocol: cephx 2024-09-12T00:42:41.915 INFO:tasks.workunit.client.0.smithi043.stderr: -57> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c82b0) adding auth protocol: cephx 2024-09-12T00:42:41.915 INFO:tasks.workunit.client.0.smithi043.stderr: -56> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c82b0) adding con mode: secure 2024-09-12T00:42:41.915 INFO:tasks.workunit.client.0.smithi043.stderr: -55> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c82b0) adding con mode: crc 2024-09-12T00:42:41.915 INFO:tasks.workunit.client.0.smithi043.stderr: -54> 2024-09-12T00:42:41.817+0000 7f77d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:41.916 INFO:tasks.workunit.client.0.smithi043.stderr: -53> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c82b0) adding con mode: secure 2024-09-12T00:42:41.916 INFO:tasks.workunit.client.0.smithi043.stderr: -52> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c82b0) adding con mode: crc 2024-09-12T00:42:41.916 INFO:tasks.workunit.client.0.smithi043.stderr: -51> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c82b0) adding con mode: secure 2024-09-12T00:42:41.916 INFO:tasks.workunit.client.0.smithi043.stderr: -50> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c82b0) adding con mode: crc 2024-09-12T00:42:41.916 INFO:tasks.workunit.client.0.smithi043.stderr: -49> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c82b0) adding con mode: crc 2024-09-12T00:42:41.916 INFO:tasks.workunit.client.0.smithi043.stderr: -48> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c82b0) adding con mode: secure 2024-09-12T00:42:41.916 INFO:tasks.workunit.client.0.smithi043.stderr: -47> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c82b0) adding con mode: crc 2024-09-12T00:42:41.916 INFO:tasks.workunit.client.0.smithi043.stderr: -46> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c82b0) adding con mode: secure 2024-09-12T00:42:41.916 INFO:tasks.workunit.client.0.smithi043.stderr: -45> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c82b0) adding con mode: crc 2024-09-12T00:42:41.917 INFO:tasks.workunit.client.0.smithi043.stderr: -44> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c82b0) adding con mode: secure 2024-09-12T00:42:41.917 INFO:tasks.workunit.client.0.smithi043.stderr: -43> 2024-09-12T00:42:41.817+0000 7f791d0549c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.917 INFO:tasks.workunit.client.0.smithi043.stderr: -42> 2024-09-12T00:42:41.817+0000 7f791d0549c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:41.917 INFO:tasks.workunit.client.0.smithi043.stderr: -41> 2024-09-12T00:42:41.817+0000 7f791d0549c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:41.917 INFO:tasks.workunit.client.0.smithi043.stderr: -40> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command cache list hook 0x55f3039f8ea0 2024-09-12T00:42:41.917 INFO:tasks.workunit.client.0.smithi043.stderr: -39> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command cache inspect hook 0x55f3039f8ea0 2024-09-12T00:42:41.917 INFO:tasks.workunit.client.0.smithi043.stderr: -38> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command cache erase hook 0x55f3039f8ea0 2024-09-12T00:42:41.917 INFO:tasks.workunit.client.0.smithi043.stderr: -37> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command cache zap hook 0x55f3039f8ea0 2024-09-12T00:42:41.917 INFO:tasks.workunit.client.0.smithi043.stderr: -36> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 note: GC not initialized 2024-09-12T00:42:41.917 INFO:tasks.workunit.client.0.smithi043.stderr: -35> 2024-09-12T00:42:41.817+0000 7f774bfff640 20 reqs_thread_entry: start 2024-09-12T00:42:41.917 INFO:tasks.workunit.client.0.smithi043.stderr: -34> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command sync trace show hook 0x7f791400f480 2024-09-12T00:42:41.917 INFO:tasks.workunit.client.0.smithi043.stderr: -33> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command sync trace history hook 0x7f791400f480 2024-09-12T00:42:41.917 INFO:tasks.workunit.client.0.smithi043.stderr: -32> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command sync trace active hook 0x7f791400f480 2024-09-12T00:42:41.918 INFO:tasks.workunit.client.0.smithi043.stderr: -31> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command sync trace active_short hook 0x7f791400f480 2024-09-12T00:42:41.918 INFO:tasks.workunit.client.0.smithi043.stderr: -30> 2024-09-12T00:42:41.821+0000 7f791d0549c0 20 init_complete bucket index max shards: 11 2024-09-12T00:42:41.918 INFO:tasks.workunit.client.0.smithi043.stderr: -29> 2024-09-12T00:42:41.821+0000 7f791d0549c0 20 Filter name: none 2024-09-12T00:42:41.918 INFO:tasks.workunit.client.0.smithi043.stderr: -28> 2024-09-12T00:42:41.821+0000 7f7749ffb640 20 reqs_thread_entry: start 2024-09-12T00:42:41.918 INFO:tasks.workunit.client.0.smithi043.stderr: -27> 2024-09-12T00:42:41.821+0000 7f791d0549c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:42:41.918 INFO:tasks.workunit.client.0.smithi043.stderr: -26> 2024-09-12T00:42:41.821+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.918 INFO:tasks.workunit.client.0.smithi043.stderr: -25> 2024-09-12T00:42:41.821+0000 7f791d0549c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:42:41.918 INFO:tasks.workunit.client.0.smithi043.stderr: -24> 2024-09-12T00:42:41.821+0000 7f791d0549c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:42:41.918 INFO:tasks.workunit.client.0.smithi043.stderr: -23> 2024-09-12T00:42:41.821+0000 7f791d0549c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:42:41.918 INFO:tasks.workunit.client.0.smithi043.stderr: -22> 2024-09-12T00:42:41.821+0000 7f791d0549c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 : miss 2024-09-12T00:42:41.918 INFO:tasks.workunit.client.0.smithi043.stderr: -21> 2024-09-12T00:42:41.821+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.918 INFO:tasks.workunit.client.0.smithi043.stderr: -20> 2024-09-12T00:42:41.821+0000 7f791d0549c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:42:41.918 INFO:tasks.workunit.client.0.smithi043.stderr: -19> 2024-09-12T00:42:41.821+0000 7f791d0549c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:42:41.919 INFO:tasks.workunit.client.0.smithi043.stderr: -18> 2024-09-12T00:42:41.821+0000 7f791d0549c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:42:41.919 INFO:tasks.workunit.client.0.smithi043.stderr: -17> 2024-09-12T00:42:41.821+0000 7f791d0549c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:42:41.919 INFO:tasks.workunit.client.0.smithi043.stderr: -16> 2024-09-12T00:42:41.821+0000 7f791d0549c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:42:41.919 INFO:tasks.workunit.client.0.smithi043.stderr: -15> 2024-09-12T00:42:41.821+0000 7f791d0549c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 2024-09-12T00:42:41.919 INFO:tasks.workunit.client.0.smithi043.stderr: -14> 2024-09-12T00:42:41.825+0000 7f791d0549c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:42:41.919 INFO:tasks.workunit.client.0.smithi043.stderr: -13> 2024-09-12T00:42:41.841+0000 7f791d0549c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:42:41.919 INFO:tasks.workunit.client.0.smithi043.stderr: -12> 2024-09-12T00:42:41.841+0000 7f791d0549c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:42:41.919 INFO:tasks.workunit.client.0.smithi043.stderr: -11> 2024-09-12T00:42:41.841+0000 7f791d0549c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:42:41.919 INFO:tasks.workunit.client.0.smithi043.stderr: -10> 2024-09-12T00:42:41.841+0000 7f791d0549c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17, ofs0, ns] 2024-09-12T00:42:41.919 INFO:tasks.workunit.client.0.smithi043.stderr: -9> 2024-09-12T00:42:41.841+0000 7f77fe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333530 cookie 94502226444560 notifier 8283 bl.length()=827 2024-09-12T00:42:41.919 INFO:tasks.workunit.client.0.smithi043.stderr: -8> 2024-09-12T00:42:41.841+0000 7f77fe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:42:41.919 INFO:tasks.workunit.client.0.smithi043.stderr: -7> 2024-09-12T00:42:41.841+0000 7f77fe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:42:41.920 INFO:tasks.workunit.client.0.smithi043.stderr: -6> 2024-09-12T00:42:41.841+0000 7f77fe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:42:41.920 INFO:tasks.workunit.client.0.smithi043.stderr: -5> 2024-09-12T00:42:41.841+0000 7f791d0549c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_sources= new_sources= 2024-09-12T00:42:41.920 INFO:tasks.workunit.client.0.smithi043.stderr: -4> 2024-09-12T00:42:41.841+0000 7f791d0549c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential sources added=[] removed=[] 2024-09-12T00:42:41.920 INFO:tasks.workunit.client.0.smithi043.stderr: -3> 2024-09-12T00:42:41.841+0000 7f791d0549c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_dests= new_dests= 2024-09-12T00:42:41.920 INFO:tasks.workunit.client.0.smithi043.stderr: -2> 2024-09-12T00:42:41.841+0000 7f791d0549c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential dests added=[] removed=[] 2024-09-12T00:42:41.920 INFO:tasks.workunit.client.0.smithi043.stderr: -1> 2024-09-12T00:42:41.857+0000 7f791d0549c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f791d0549c0 time 2024-09-12T00:42:41.861524+0000 2024-09-12T00:42:41.920 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:42:41.920 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.920 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:41.920 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f792092e2eb] 2024-09-12T00:42:41.920 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f792092e49f] 2024-09-12T00:42:41.920 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3013bdcc1] 2024-09-12T00:42:41.920 INFO:tasks.workunit.client.0.smithi043.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f3013d2d5a] 2024-09-12T00:42:41.921 INFO:tasks.workunit.client.0.smithi043.stderr: 5: main() 2024-09-12T00:42:41.921 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f791f794d90] 2024-09-12T00:42:41.921 INFO:tasks.workunit.client.0.smithi043.stderr: 7: __libc_start_main() 2024-09-12T00:42:41.921 INFO:tasks.workunit.client.0.smithi043.stderr: 8: _start() 2024-09-12T00:42:41.921 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.921 INFO:tasks.workunit.client.0.smithi043.stderr: 0> 2024-09-12T00:42:41.861+0000 7f791d0549c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:42:41.921 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7f791d0549c0 thread_name:radosgw-admin 2024-09-12T00:42:41.921 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.921 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:41.921 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f791f7ad520] 2024-09-12T00:42:41.921 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:42:41.921 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:42:41.921 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:42:41.922 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f792092e345] 2024-09-12T00:42:41.922 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f792092e49f] 2024-09-12T00:42:41.922 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3013bdcc1] 2024-09-12T00:42:41.922 INFO:tasks.workunit.client.0.smithi043.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f3013d2d5a] 2024-09-12T00:42:41.922 INFO:tasks.workunit.client.0.smithi043.stderr: 9: main() 2024-09-12T00:42:41.922 INFO:tasks.workunit.client.0.smithi043.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f791f794d90] 2024-09-12T00:42:41.922 INFO:tasks.workunit.client.0.smithi043.stderr: 11: __libc_start_main() 2024-09-12T00:42:41.922 INFO:tasks.workunit.client.0.smithi043.stderr: 12: _start() 2024-09-12T00:42:41.922 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:42:41.922 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.922 INFO:tasks.workunit.client.0.smithi043.stderr:--- logging levels --- 2024-09-12T00:42:41.922 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 none 2024-09-12T00:42:41.922 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 lockdep 2024-09-12T00:42:41.923 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 context 2024-09-12T00:42:41.923 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 crush 2024-09-12T00:42:41.923 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds 2024-09-12T00:42:41.923 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_balancer 2024-09-12T00:42:41.923 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_locker 2024-09-12T00:42:41.923 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log 2024-09-12T00:42:41.923 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log_expire 2024-09-12T00:42:41.923 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_migrator 2024-09-12T00:42:41.923 INFO:tasks.workunit.client.0.smithi043.stderr: 3/ 5 mds_quiesce 2024-09-12T00:42:41.923 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 buffer 2024-09-12T00:42:41.923 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 timer 2024-09-12T00:42:41.923 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 filer 2024-09-12T00:42:41.923 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 striper 2024-09-12T00:42:41.923 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 objecter 2024-09-12T00:42:41.924 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rados 2024-09-12T00:42:41.924 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd 2024-09-12T00:42:41.924 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_mirror 2024-09-12T00:42:41.924 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_replay 2024-09-12T00:42:41.924 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_pwl 2024-09-12T00:42:41.924 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 journaler 2024-09-12T00:42:41.924 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objectcacher 2024-09-12T00:42:41.924 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:42:41.924 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 client 2024-09-12T00:42:41.924 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 osd 2024-09-12T00:42:41.924 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 optracker 2024-09-12T00:42:41.924 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objclass 2024-09-12T00:42:41.924 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 filestore 2024-09-12T00:42:41.925 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 journal 2024-09-12T00:42:41.925 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 ms 2024-09-12T00:42:41.925 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mon 2024-09-12T00:42:41.925 INFO:tasks.workunit.client.0.smithi043.stderr: 0/10 monc 2024-09-12T00:42:41.925 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 paxos 2024-09-12T00:42:41.925 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 tp 2024-09-12T00:42:41.925 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 auth 2024-09-12T00:42:41.925 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 crypto 2024-09-12T00:42:41.925 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 finisher 2024-09-12T00:42:41.925 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 reserver 2024-09-12T00:42:41.925 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 heartbeatmap 2024-09-12T00:42:41.925 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 perfcounter 2024-09-12T00:42:41.925 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw 2024-09-12T00:42:41.926 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_sync 2024-09-12T00:42:41.926 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_datacache 2024-09-12T00:42:41.926 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_access 2024-09-12T00:42:41.926 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:42:41.926 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_flight 2024-09-12T00:42:41.926 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:42:41.926 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw_notification 2024-09-12T00:42:41.926 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 javaclient 2024-09-12T00:42:41.926 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 asok 2024-09-12T00:42:41.926 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 throttle 2024-09-12T00:42:41.926 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 refs 2024-09-12T00:42:41.926 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 compressor 2024-09-12T00:42:41.926 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluestore 2024-09-12T00:42:41.926 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluefs 2024-09-12T00:42:41.927 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 bdev 2024-09-12T00:42:41.927 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 kstore 2024-09-12T00:42:41.927 INFO:tasks.workunit.client.0.smithi043.stderr: 4/ 5 rocksdb 2024-09-12T00:42:41.927 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 fuse 2024-09-12T00:42:41.927 INFO:tasks.workunit.client.0.smithi043.stderr: 2/ 5 mgr 2024-09-12T00:42:41.927 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mgrc 2024-09-12T00:42:41.927 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 dpdk 2024-09-12T00:42:41.927 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 eventtrace 2024-09-12T00:42:41.927 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 prioritycache 2024-09-12T00:42:41.927 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 test 2024-09-12T00:42:41.927 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:42:41.927 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephsqlite 2024-09-12T00:42:41.927 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:42:41.928 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore 2024-09-12T00:42:41.928 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_onode 2024-09-12T00:42:41.928 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_odata 2024-09-12T00:42:41.928 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_omap 2024-09-12T00:42:41.928 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_tm 2024-09-12T00:42:41.928 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_t 2024-09-12T00:42:41.928 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:42:41.928 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_epm 2024-09-12T00:42:41.928 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_lba 2024-09-12T00:42:41.928 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:42:41.928 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cache 2024-09-12T00:42:41.928 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_journal 2024-09-12T00:42:41.928 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_device 2024-09-12T00:42:41.929 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_backref 2024-09-12T00:42:41.929 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 alienstore 2024-09-12T00:42:41.929 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mclock 2024-09-12T00:42:41.929 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cyanstore 2024-09-12T00:42:41.929 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 ceph_exporter 2024-09-12T00:42:41.929 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 memstore 2024-09-12T00:42:41.929 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 trace 2024-09-12T00:42:41.929 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 ceph_dedup 2024-09-12T00:42:41.929 INFO:tasks.workunit.client.0.smithi043.stderr: -2/-2 (syslog threshold) 2024-09-12T00:42:41.929 INFO:tasks.workunit.client.0.smithi043.stderr: 99/99 (stderr threshold) 2024-09-12T00:42:41.929 INFO:tasks.workunit.client.0.smithi043.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:42:41.929 INFO:tasks.workunit.client.0.smithi043.stderr: 7f7749ffb640 / http_manager 2024-09-12T00:42:41.929 INFO:tasks.workunit.client.0.smithi043.stderr: 7f774bfff640 / http_manager 2024-09-12T00:42:41.930 INFO:tasks.workunit.client.0.smithi043.stderr: 7f77d17e2640 / rgw_dt_lg_renew 2024-09-12T00:42:41.930 INFO:tasks.workunit.client.0.smithi043.stderr: 7f77fcff9640 / ms_dispatch 2024-09-12T00:42:41.930 INFO:tasks.workunit.client.0.smithi043.stderr: 7f77fe7fc640 / io_context_pool 2024-09-12T00:42:41.930 INFO:tasks.workunit.client.0.smithi043.stderr: 7f7804e01640 / ms_dispatch 2024-09-12T00:42:41.930 INFO:tasks.workunit.client.0.smithi043.stderr: 7f7807606640 / ms_dispatch 2024-09-12T00:42:41.930 INFO:tasks.workunit.client.0.smithi043.stderr: 7f7808e09640 / io_context_pool 2024-09-12T00:42:41.930 INFO:tasks.workunit.client.0.smithi043.stderr: 7f791a359640 / msgr-worker-2 2024-09-12T00:42:41.930 INFO:tasks.workunit.client.0.smithi043.stderr: 7f791ab5a640 / msgr-worker-1 2024-09-12T00:42:41.930 INFO:tasks.workunit.client.0.smithi043.stderr: 7f791b35b640 / msgr-worker-0 2024-09-12T00:42:41.930 INFO:tasks.workunit.client.0.smithi043.stderr: 7f791bb5c640 / io_context_pool 2024-09-12T00:42:41.930 INFO:tasks.workunit.client.0.smithi043.stderr: 7f791d0549c0 / radosgw-admin 2024-09-12T00:42:41.930 INFO:tasks.workunit.client.0.smithi043.stderr: max_recent 500 2024-09-12T00:42:41.930 INFO:tasks.workunit.client.0.smithi043.stderr: max_new 1000 2024-09-12T00:42:41.931 INFO:tasks.workunit.client.0.smithi043.stderr: log_file /var/log/ceph/ceph-client.admin.145150.log 2024-09-12T00:42:41.931 INFO:tasks.workunit.client.0.smithi043.stderr:--- end dump of recent events --- 2024-09-12T00:42:41.931 INFO:tasks.workunit.client.0.smithi043.stderr:--- begin dump of recent events --- 2024-09-12T00:42:41.931 INFO:tasks.workunit.client.0.smithi043.stderr: -499> 2024-09-12T00:42:41.525+0000 7f791a359640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.931 INFO:tasks.workunit.client.0.smithi043.stderr: -498> 2024-09-12T00:42:41.525+0000 7f791a359640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.931 INFO:tasks.workunit.client.0.smithi043.stderr: -497> 2024-09-12T00:42:41.525+0000 7f791ab5a640 10 monclient(hunting): handle_auth_done global_id 8271 payload 274 2024-09-12T00:42:41.931 INFO:tasks.workunit.client.0.smithi043.stderr: -496> 2024-09-12T00:42:41.525+0000 7f791ab5a640 10 monclient: _finish_hunting 0 2024-09-12T00:42:41.931 INFO:tasks.workunit.client.0.smithi043.stderr: -495> 2024-09-12T00:42:41.525+0000 7f791ab5a640 1 monclient: found mon.noname-a 2024-09-12T00:42:41.931 INFO:tasks.workunit.client.0.smithi043.stderr: -494> 2024-09-12T00:42:41.525+0000 7f791ab5a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:42:41.931 INFO:tasks.workunit.client.0.smithi043.stderr: -493> 2024-09-12T00:42:41.525+0000 7f7808e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.931 INFO:tasks.workunit.client.0.smithi043.stderr: -492> 2024-09-12T00:42:41.525+0000 7f7808e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:41.931 INFO:tasks.workunit.client.0.smithi043.stderr: -491> 2024-09-12T00:42:41.525+0000 7f7808e09640 10 monclient: dump: 2024-09-12T00:42:41.931 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:41.932 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:41.932 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.932 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.932 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.932 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:41.932 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:41.932 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:41.932 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:41.932 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.932 INFO:tasks.workunit.client.0.smithi043.stderr: -490> 2024-09-12T00:42:41.525+0000 7f7808e09640 10 monclient: _finish_auth 0 2024-09-12T00:42:41.932 INFO:tasks.workunit.client.0.smithi043.stderr: -489> 2024-09-12T00:42:41.525+0000 7f7808e09640 10 monclient: _check_auth_tickets 2024-09-12T00:42:41.932 INFO:tasks.workunit.client.0.smithi043.stderr: -488> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 monclient: authenticate success, global_id 8271 2024-09-12T00:42:41.932 INFO:tasks.workunit.client.0.smithi043.stderr: -487> 2024-09-12T00:42:41.525+0000 7f7808e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:41.933 INFO:tasks.workunit.client.0.smithi043.stderr: -486> 2024-09-12T00:42:41.525+0000 7f7808e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.933 INFO:tasks.workunit.client.0.smithi043.stderr: -485> 2024-09-12T00:42:41.525+0000 7f7808e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:41.933 INFO:tasks.workunit.client.0.smithi043.stderr: -484> 2024-09-12T00:42:41.525+0000 7f7808e09640 10 monclient: dump: 2024-09-12T00:42:41.933 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:41.933 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:41.933 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.933 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.933 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.933 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:41.933 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:41.933 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:41.933 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:41.933 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.934 INFO:tasks.workunit.client.0.smithi043.stderr: -483> 2024-09-12T00:42:41.525+0000 7f791d0549c0 10 monclient: get_monmap_and_config success 2024-09-12T00:42:41.934 INFO:tasks.workunit.client.0.smithi043.stderr: -482> 2024-09-12T00:42:41.525+0000 7f791d0549c0 4 set_mon_vals no callback set 2024-09-12T00:42:41.934 INFO:tasks.workunit.client.0.smithi043.stderr: -481> 2024-09-12T00:42:41.525+0000 7f791d0549c0 10 monclient: shutdown 2024-09-12T00:42:41.934 INFO:tasks.workunit.client.0.smithi043.stderr: -480> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 asok(0x55f30372b2b0) unregister_commands rotate-key 2024-09-12T00:42:41.934 INFO:tasks.workunit.client.0.smithi043.stderr: -479> 2024-09-12T00:42:41.525+0000 7f791d0549c0 10 monclient: build_initial_monmap 2024-09-12T00:42:41.934 INFO:tasks.workunit.client.0.smithi043.stderr: -478> 2024-09-12T00:42:41.525+0000 7f791d0549c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:41.934 INFO:tasks.workunit.client.0.smithi043.stderr: -477> 2024-09-12T00:42:41.525+0000 7f791d0549c0 10 monclient: monmap: 2024-09-12T00:42:41.934 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:42:41.934 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:41.934 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:42:41.934 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:42:41.934 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:41.934 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:41.935 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:42:41.935 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:42:41.935 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:42:41.935 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.935 INFO:tasks.workunit.client.0.smithi043.stderr: -476> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f30393e9e0) adding auth protocol: cephx 2024-09-12T00:42:41.935 INFO:tasks.workunit.client.0.smithi043.stderr: -475> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f30393e9e0) adding auth protocol: cephx 2024-09-12T00:42:41.935 INFO:tasks.workunit.client.0.smithi043.stderr: -474> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f30393e9e0) adding auth protocol: cephx 2024-09-12T00:42:41.935 INFO:tasks.workunit.client.0.smithi043.stderr: -473> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f30393e9e0) adding con mode: secure 2024-09-12T00:42:41.935 INFO:tasks.workunit.client.0.smithi043.stderr: -472> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f30393e9e0) adding con mode: crc 2024-09-12T00:42:41.935 INFO:tasks.workunit.client.0.smithi043.stderr: -471> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f30393e9e0) adding con mode: secure 2024-09-12T00:42:41.935 INFO:tasks.workunit.client.0.smithi043.stderr: -470> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f30393e9e0) adding con mode: crc 2024-09-12T00:42:41.935 INFO:tasks.workunit.client.0.smithi043.stderr: -469> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f30393e9e0) adding con mode: secure 2024-09-12T00:42:41.935 INFO:tasks.workunit.client.0.smithi043.stderr: -468> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f30393e9e0) adding con mode: crc 2024-09-12T00:42:41.936 INFO:tasks.workunit.client.0.smithi043.stderr: -467> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f30393e9e0) adding con mode: crc 2024-09-12T00:42:41.936 INFO:tasks.workunit.client.0.smithi043.stderr: -466> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f30393e9e0) adding con mode: secure 2024-09-12T00:42:41.936 INFO:tasks.workunit.client.0.smithi043.stderr: -465> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f30393e9e0) adding con mode: crc 2024-09-12T00:42:41.936 INFO:tasks.workunit.client.0.smithi043.stderr: -464> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f30393e9e0) adding con mode: secure 2024-09-12T00:42:41.936 INFO:tasks.workunit.client.0.smithi043.stderr: -463> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f30393e9e0) adding con mode: crc 2024-09-12T00:42:41.936 INFO:tasks.workunit.client.0.smithi043.stderr: -462> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f30393e9e0) adding con mode: secure 2024-09-12T00:42:41.936 INFO:tasks.workunit.client.0.smithi043.stderr: -461> 2024-09-12T00:42:41.525+0000 7f791d0549c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.936 INFO:tasks.workunit.client.0.smithi043.stderr: -460> 2024-09-12T00:42:41.525+0000 7f791d0549c0 1 librados: starting msgr at 2024-09-12T00:42:41.936 INFO:tasks.workunit.client.0.smithi043.stderr: -459> 2024-09-12T00:42:41.525+0000 7f791d0549c0 1 librados: starting objecter 2024-09-12T00:42:41.936 INFO:tasks.workunit.client.0.smithi043.stderr: -458> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command objecter_requests hook 0x55f3037625b0 2024-09-12T00:42:41.936 INFO:tasks.workunit.client.0.smithi043.stderr: -457> 2024-09-12T00:42:41.525+0000 7f791d0549c0 1 librados: setting wanted keys 2024-09-12T00:42:41.936 INFO:tasks.workunit.client.0.smithi043.stderr: -456> 2024-09-12T00:42:41.525+0000 7f791d0549c0 1 librados: calling monclient init 2024-09-12T00:42:41.936 INFO:tasks.workunit.client.0.smithi043.stderr: -455> 2024-09-12T00:42:41.525+0000 7f791d0549c0 10 monclient: init 2024-09-12T00:42:41.937 INFO:tasks.workunit.client.0.smithi043.stderr: -454> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f303938a70) adding auth protocol: cephx 2024-09-12T00:42:41.937 INFO:tasks.workunit.client.0.smithi043.stderr: -453> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f303938a70) adding auth protocol: cephx 2024-09-12T00:42:41.937 INFO:tasks.workunit.client.0.smithi043.stderr: -452> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f303938a70) adding auth protocol: cephx 2024-09-12T00:42:41.937 INFO:tasks.workunit.client.0.smithi043.stderr: -451> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f303938a70) adding con mode: secure 2024-09-12T00:42:41.937 INFO:tasks.workunit.client.0.smithi043.stderr: -450> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f303938a70) adding con mode: crc 2024-09-12T00:42:41.937 INFO:tasks.workunit.client.0.smithi043.stderr: -449> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f303938a70) adding con mode: secure 2024-09-12T00:42:41.937 INFO:tasks.workunit.client.0.smithi043.stderr: -448> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f303938a70) adding con mode: crc 2024-09-12T00:42:41.937 INFO:tasks.workunit.client.0.smithi043.stderr: -447> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f303938a70) adding con mode: secure 2024-09-12T00:42:41.937 INFO:tasks.workunit.client.0.smithi043.stderr: -446> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f303938a70) adding con mode: crc 2024-09-12T00:42:41.937 INFO:tasks.workunit.client.0.smithi043.stderr: -445> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f303938a70) adding con mode: crc 2024-09-12T00:42:41.937 INFO:tasks.workunit.client.0.smithi043.stderr: -444> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f303938a70) adding con mode: secure 2024-09-12T00:42:41.937 INFO:tasks.workunit.client.0.smithi043.stderr: -443> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f303938a70) adding con mode: crc 2024-09-12T00:42:41.937 INFO:tasks.workunit.client.0.smithi043.stderr: -442> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f303938a70) adding con mode: secure 2024-09-12T00:42:41.937 INFO:tasks.workunit.client.0.smithi043.stderr: -441> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f303938a70) adding con mode: crc 2024-09-12T00:42:41.938 INFO:tasks.workunit.client.0.smithi043.stderr: -440> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 AuthRegistry(0x55f303938a70) adding con mode: secure 2024-09-12T00:42:41.938 INFO:tasks.workunit.client.0.smithi043.stderr: -439> 2024-09-12T00:42:41.525+0000 7f791d0549c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.938 INFO:tasks.workunit.client.0.smithi043.stderr: -438> 2024-09-12T00:42:41.525+0000 7f791d0549c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.938 INFO:tasks.workunit.client.0.smithi043.stderr: -437> 2024-09-12T00:42:41.525+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command rotate-key hook 0x55f303938bb8 2024-09-12T00:42:41.938 INFO:tasks.workunit.client.0.smithi043.stderr: -436> 2024-09-12T00:42:41.525+0000 7f791d0549c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:41.938 INFO:tasks.workunit.client.0.smithi043.stderr: -435> 2024-09-12T00:42:41.525+0000 7f791d0549c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:42:41.938 INFO:tasks.workunit.client.0.smithi043.stderr: -434> 2024-09-12T00:42:41.525+0000 7f791d0549c0 10 monclient(hunting): picked mon.noname-b con 0x55f3037e8820 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:42:41.938 INFO:tasks.workunit.client.0.smithi043.stderr: -433> 2024-09-12T00:42:41.525+0000 7f791d0549c0 10 monclient(hunting): picked mon.noname-c con 0x55f3037f3a80 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:42:41.938 INFO:tasks.workunit.client.0.smithi043.stderr: -432> 2024-09-12T00:42:41.525+0000 7f791d0549c0 10 monclient(hunting): picked mon.noname-a con 0x55f303884170 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:42:41.938 INFO:tasks.workunit.client.0.smithi043.stderr: -431> 2024-09-12T00:42:41.525+0000 7f791d0549c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.938 INFO:tasks.workunit.client.0.smithi043.stderr: -430> 2024-09-12T00:42:41.525+0000 7f791d0549c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.938 INFO:tasks.workunit.client.0.smithi043.stderr: -429> 2024-09-12T00:42:41.525+0000 7f791d0549c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.939 INFO:tasks.workunit.client.0.smithi043.stderr: -428> 2024-09-12T00:42:41.525+0000 7f791d0549c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:41.939 INFO:tasks.workunit.client.0.smithi043.stderr: -427> 2024-09-12T00:42:41.525+0000 7f791d0549c0 10 monclient(hunting): authenticate will time out at 2457.518840s 2024-09-12T00:42:41.939 INFO:tasks.workunit.client.0.smithi043.stderr: -426> 2024-09-12T00:42:41.525+0000 7f791b35b640 10 monclient(hunting): get_auth_request con 0x55f303884170 auth_method 0 2024-09-12T00:42:41.939 INFO:tasks.workunit.client.0.smithi043.stderr: -425> 2024-09-12T00:42:41.525+0000 7f791b35b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.939 INFO:tasks.workunit.client.0.smithi043.stderr: -424> 2024-09-12T00:42:41.525+0000 7f791b35b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.939 INFO:tasks.workunit.client.0.smithi043.stderr: -423> 2024-09-12T00:42:41.525+0000 7f791b35b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.939 INFO:tasks.workunit.client.0.smithi043.stderr: -422> 2024-09-12T00:42:41.525+0000 7f791a359640 10 monclient(hunting): get_auth_request con 0x55f3037f3a80 auth_method 0 2024-09-12T00:42:41.939 INFO:tasks.workunit.client.0.smithi043.stderr: -421> 2024-09-12T00:42:41.525+0000 7f791a359640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.939 INFO:tasks.workunit.client.0.smithi043.stderr: -420> 2024-09-12T00:42:41.525+0000 7f791a359640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.939 INFO:tasks.workunit.client.0.smithi043.stderr: -419> 2024-09-12T00:42:41.525+0000 7f791a359640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.939 INFO:tasks.workunit.client.0.smithi043.stderr: -418> 2024-09-12T00:42:41.525+0000 7f791b35b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.939 INFO:tasks.workunit.client.0.smithi043.stderr: -417> 2024-09-12T00:42:41.525+0000 7f791b35b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.939 INFO:tasks.workunit.client.0.smithi043.stderr: -416> 2024-09-12T00:42:41.525+0000 7f791b35b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.940 INFO:tasks.workunit.client.0.smithi043.stderr: -415> 2024-09-12T00:42:41.525+0000 7f791a359640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.940 INFO:tasks.workunit.client.0.smithi043.stderr: -414> 2024-09-12T00:42:41.525+0000 7f791a359640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.940 INFO:tasks.workunit.client.0.smithi043.stderr: -413> 2024-09-12T00:42:41.525+0000 7f791a359640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.940 INFO:tasks.workunit.client.0.smithi043.stderr: -412> 2024-09-12T00:42:41.525+0000 7f791ab5a640 10 monclient(hunting): get_auth_request con 0x55f3037e8820 auth_method 0 2024-09-12T00:42:41.940 INFO:tasks.workunit.client.0.smithi043.stderr: -411> 2024-09-12T00:42:41.525+0000 7f791ab5a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.940 INFO:tasks.workunit.client.0.smithi043.stderr: -410> 2024-09-12T00:42:41.525+0000 7f791ab5a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.940 INFO:tasks.workunit.client.0.smithi043.stderr: -409> 2024-09-12T00:42:41.525+0000 7f791ab5a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.940 INFO:tasks.workunit.client.0.smithi043.stderr: -408> 2024-09-12T00:42:41.525+0000 7f791b35b640 10 monclient(hunting): handle_auth_done global_id 8274 payload 824 2024-09-12T00:42:41.940 INFO:tasks.workunit.client.0.smithi043.stderr: -407> 2024-09-12T00:42:41.525+0000 7f791b35b640 10 monclient: _finish_hunting 0 2024-09-12T00:42:41.940 INFO:tasks.workunit.client.0.smithi043.stderr: -406> 2024-09-12T00:42:41.525+0000 7f791b35b640 1 monclient: found mon.noname-a 2024-09-12T00:42:41.940 INFO:tasks.workunit.client.0.smithi043.stderr: -405> 2024-09-12T00:42:41.525+0000 7f791b35b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:42:41.940 INFO:tasks.workunit.client.0.smithi043.stderr: -404> 2024-09-12T00:42:41.525+0000 7f7807606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.940 INFO:tasks.workunit.client.0.smithi043.stderr: -403> 2024-09-12T00:42:41.525+0000 7f7807606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:41.941 INFO:tasks.workunit.client.0.smithi043.stderr: -402> 2024-09-12T00:42:41.525+0000 7f7807606640 10 monclient: dump: 2024-09-12T00:42:41.941 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:41.941 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:41.941 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.941 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.941 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.941 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:41.941 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:41.941 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:41.941 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:41.941 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.941 INFO:tasks.workunit.client.0.smithi043.stderr: -401> 2024-09-12T00:42:41.525+0000 7f7807606640 10 monclient: _finish_auth 0 2024-09-12T00:42:41.941 INFO:tasks.workunit.client.0.smithi043.stderr: -400> 2024-09-12T00:42:41.525+0000 7f7807606640 10 monclient: _check_auth_tickets 2024-09-12T00:42:41.942 INFO:tasks.workunit.client.0.smithi043.stderr: -399> 2024-09-12T00:42:41.525+0000 7f7807606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:41.942 INFO:tasks.workunit.client.0.smithi043.stderr: -398> 2024-09-12T00:42:41.525+0000 7f7807606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.942 INFO:tasks.workunit.client.0.smithi043.stderr: -397> 2024-09-12T00:42:41.525+0000 7f7807606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:41.942 INFO:tasks.workunit.client.0.smithi043.stderr: -396> 2024-09-12T00:42:41.525+0000 7f7807606640 10 monclient: dump: 2024-09-12T00:42:41.942 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:41.942 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:41.942 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.942 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.942 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.942 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:41.942 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:41.942 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:41.942 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:41.943 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.943 INFO:tasks.workunit.client.0.smithi043.stderr: -395> 2024-09-12T00:42:41.525+0000 7f7808e09640 4 set_mon_vals no callback set 2024-09-12T00:42:41.943 INFO:tasks.workunit.client.0.smithi043.stderr: -394> 2024-09-12T00:42:41.529+0000 7f791d0549c0 5 monclient: authenticate success, global_id 8274 2024-09-12T00:42:41.943 INFO:tasks.workunit.client.0.smithi043.stderr: -393> 2024-09-12T00:42:41.529+0000 7f791d0549c0 10 monclient: _renew_subs 2024-09-12T00:42:41.943 INFO:tasks.workunit.client.0.smithi043.stderr: -392> 2024-09-12T00:42:41.529+0000 7f791d0549c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:42:41.943 INFO:tasks.workunit.client.0.smithi043.stderr: -391> 2024-09-12T00:42:41.529+0000 7f791d0549c0 10 monclient: _renew_subs 2024-09-12T00:42:41.943 INFO:tasks.workunit.client.0.smithi043.stderr: -390> 2024-09-12T00:42:41.529+0000 7f791d0549c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:42:41.943 INFO:tasks.workunit.client.0.smithi043.stderr: -389> 2024-09-12T00:42:41.529+0000 7f791d0549c0 1 librados: init done 2024-09-12T00:42:41.943 INFO:tasks.workunit.client.0.smithi043.stderr: -388> 2024-09-12T00:42:41.529+0000 7f7807606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:41.943 INFO:tasks.workunit.client.0.smithi043.stderr: -387> 2024-09-12T00:42:41.529+0000 7f7807606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:42:41.943 INFO:tasks.workunit.client.0.smithi043.stderr: -386> 2024-09-12T00:42:41.529+0000 7f7807606640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:42:41.943 INFO:tasks.workunit.client.0.smithi043.stderr: -385> 2024-09-12T00:42:41.529+0000 7f791ab5a640 10 monclient: get_auth_request con 0x7f7800070b10 auth_method 0 2024-09-12T00:42:41.943 INFO:tasks.workunit.client.0.smithi043.stderr: -384> 2024-09-12T00:42:41.529+0000 7f791a359640 10 monclient: get_auth_request con 0x55f3039609e0 auth_method 0 2024-09-12T00:42:41.943 INFO:tasks.workunit.client.0.smithi043.stderr: -383> 2024-09-12T00:42:41.529+0000 7f791ab5a640 10 monclient: get_auth_request con 0x55f303982fe0 auth_method 0 2024-09-12T00:42:41.944 INFO:tasks.workunit.client.0.smithi043.stderr: -382> 2024-09-12T00:42:41.533+0000 7f791a359640 10 monclient: get_auth_request con 0x55f3039873d0 auth_method 0 2024-09-12T00:42:41.944 INFO:tasks.workunit.client.0.smithi043.stderr: -381> 2024-09-12T00:42:41.533+0000 7f791d0549c0 10 monclient: build_initial_monmap 2024-09-12T00:42:41.944 INFO:tasks.workunit.client.0.smithi043.stderr: -380> 2024-09-12T00:42:41.533+0000 7f791d0549c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:41.944 INFO:tasks.workunit.client.0.smithi043.stderr: -379> 2024-09-12T00:42:41.533+0000 7f791d0549c0 10 monclient: monmap: 2024-09-12T00:42:41.944 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:42:41.944 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:41.944 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:42:41.944 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:42:41.944 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:41.944 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:41.944 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:42:41.944 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:42:41.944 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:42:41.945 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.945 INFO:tasks.workunit.client.0.smithi043.stderr: -378> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398c290) adding auth protocol: cephx 2024-09-12T00:42:41.945 INFO:tasks.workunit.client.0.smithi043.stderr: -377> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398c290) adding auth protocol: cephx 2024-09-12T00:42:41.945 INFO:tasks.workunit.client.0.smithi043.stderr: -376> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398c290) adding auth protocol: cephx 2024-09-12T00:42:41.945 INFO:tasks.workunit.client.0.smithi043.stderr: -375> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398c290) adding con mode: secure 2024-09-12T00:42:41.945 INFO:tasks.workunit.client.0.smithi043.stderr: -374> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398c290) adding con mode: crc 2024-09-12T00:42:41.945 INFO:tasks.workunit.client.0.smithi043.stderr: -373> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398c290) adding con mode: secure 2024-09-12T00:42:41.945 INFO:tasks.workunit.client.0.smithi043.stderr: -372> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398c290) adding con mode: crc 2024-09-12T00:42:41.945 INFO:tasks.workunit.client.0.smithi043.stderr: -371> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398c290) adding con mode: secure 2024-09-12T00:42:41.945 INFO:tasks.workunit.client.0.smithi043.stderr: -370> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398c290) adding con mode: crc 2024-09-12T00:42:41.945 INFO:tasks.workunit.client.0.smithi043.stderr: -369> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398c290) adding con mode: crc 2024-09-12T00:42:41.945 INFO:tasks.workunit.client.0.smithi043.stderr: -368> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398c290) adding con mode: secure 2024-09-12T00:42:41.946 INFO:tasks.workunit.client.0.smithi043.stderr: -367> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398c290) adding con mode: crc 2024-09-12T00:42:41.946 INFO:tasks.workunit.client.0.smithi043.stderr: -366> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398c290) adding con mode: secure 2024-09-12T00:42:41.946 INFO:tasks.workunit.client.0.smithi043.stderr: -365> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398c290) adding con mode: crc 2024-09-12T00:42:41.946 INFO:tasks.workunit.client.0.smithi043.stderr: -364> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398c290) adding con mode: secure 2024-09-12T00:42:41.946 INFO:tasks.workunit.client.0.smithi043.stderr: -363> 2024-09-12T00:42:41.533+0000 7f791d0549c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.946 INFO:tasks.workunit.client.0.smithi043.stderr: -362> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55f30398fc20 EEXIST 2024-09-12T00:42:41.946 INFO:tasks.workunit.client.0.smithi043.stderr: -361> 2024-09-12T00:42:41.533+0000 7f791d0549c0 10 monclient: init 2024-09-12T00:42:41.946 INFO:tasks.workunit.client.0.smithi043.stderr: -360> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398a968) adding auth protocol: cephx 2024-09-12T00:42:41.946 INFO:tasks.workunit.client.0.smithi043.stderr: -359> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398a968) adding auth protocol: cephx 2024-09-12T00:42:41.946 INFO:tasks.workunit.client.0.smithi043.stderr: -358> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398a968) adding auth protocol: cephx 2024-09-12T00:42:41.946 INFO:tasks.workunit.client.0.smithi043.stderr: -357> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398a968) adding con mode: secure 2024-09-12T00:42:41.946 INFO:tasks.workunit.client.0.smithi043.stderr: -356> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398a968) adding con mode: crc 2024-09-12T00:42:41.946 INFO:tasks.workunit.client.0.smithi043.stderr: -355> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398a968) adding con mode: secure 2024-09-12T00:42:41.947 INFO:tasks.workunit.client.0.smithi043.stderr: -354> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398a968) adding con mode: crc 2024-09-12T00:42:41.947 INFO:tasks.workunit.client.0.smithi043.stderr: -353> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398a968) adding con mode: secure 2024-09-12T00:42:41.947 INFO:tasks.workunit.client.0.smithi043.stderr: -352> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398a968) adding con mode: crc 2024-09-12T00:42:41.947 INFO:tasks.workunit.client.0.smithi043.stderr: -351> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398a968) adding con mode: crc 2024-09-12T00:42:41.947 INFO:tasks.workunit.client.0.smithi043.stderr: -350> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398a968) adding con mode: secure 2024-09-12T00:42:41.947 INFO:tasks.workunit.client.0.smithi043.stderr: -349> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398a968) adding con mode: crc 2024-09-12T00:42:41.947 INFO:tasks.workunit.client.0.smithi043.stderr: -348> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398a968) adding con mode: secure 2024-09-12T00:42:41.947 INFO:tasks.workunit.client.0.smithi043.stderr: -347> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398a968) adding con mode: crc 2024-09-12T00:42:41.947 INFO:tasks.workunit.client.0.smithi043.stderr: -346> 2024-09-12T00:42:41.533+0000 7f791d0549c0 5 AuthRegistry(0x55f30398a968) adding con mode: secure 2024-09-12T00:42:41.947 INFO:tasks.workunit.client.0.smithi043.stderr: -345> 2024-09-12T00:42:41.533+0000 7f791d0549c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.947 INFO:tasks.workunit.client.0.smithi043.stderr: -344> 2024-09-12T00:42:41.533+0000 7f791d0549c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.947 INFO:tasks.workunit.client.0.smithi043.stderr: -343> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command rotate-key cmddesc rotate-key hook 0x55f30398aab0 EEXIST 2024-09-12T00:42:41.947 INFO:tasks.workunit.client.0.smithi043.stderr: -342> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:41.947 INFO:tasks.workunit.client.0.smithi043.stderr: -341> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:42:41.948 INFO:tasks.workunit.client.0.smithi043.stderr: -340> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient(hunting): picked mon.noname-b con 0x55f3039b3dd0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:42:41.948 INFO:tasks.workunit.client.0.smithi043.stderr: -339> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient(hunting): picked mon.noname-a con 0x55f3039b3700 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:42:41.948 INFO:tasks.workunit.client.0.smithi043.stderr: -338> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient(hunting): picked mon.noname-c con 0x55f3039b20e0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:42:41.948 INFO:tasks.workunit.client.0.smithi043.stderr: -337> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.948 INFO:tasks.workunit.client.0.smithi043.stderr: -336> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.948 INFO:tasks.workunit.client.0.smithi043.stderr: -335> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.948 INFO:tasks.workunit.client.0.smithi043.stderr: -334> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:41.948 INFO:tasks.workunit.client.0.smithi043.stderr: -333> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient(hunting): authenticate will time out at 2457.528130s 2024-09-12T00:42:41.948 INFO:tasks.workunit.client.0.smithi043.stderr: -332> 2024-09-12T00:42:41.537+0000 7f791b35b640 10 monclient(hunting): get_auth_request con 0x55f3039b20e0 auth_method 0 2024-09-12T00:42:41.948 INFO:tasks.workunit.client.0.smithi043.stderr: -331> 2024-09-12T00:42:41.537+0000 7f791b35b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.948 INFO:tasks.workunit.client.0.smithi043.stderr: -330> 2024-09-12T00:42:41.537+0000 7f791b35b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.948 INFO:tasks.workunit.client.0.smithi043.stderr: -329> 2024-09-12T00:42:41.537+0000 7f791b35b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.949 INFO:tasks.workunit.client.0.smithi043.stderr: -328> 2024-09-12T00:42:41.537+0000 7f791a359640 10 monclient(hunting): get_auth_request con 0x55f3039b3700 auth_method 0 2024-09-12T00:42:41.949 INFO:tasks.workunit.client.0.smithi043.stderr: -327> 2024-09-12T00:42:41.537+0000 7f791a359640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.949 INFO:tasks.workunit.client.0.smithi043.stderr: -326> 2024-09-12T00:42:41.537+0000 7f791a359640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.949 INFO:tasks.workunit.client.0.smithi043.stderr: -325> 2024-09-12T00:42:41.537+0000 7f791a359640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.949 INFO:tasks.workunit.client.0.smithi043.stderr: -324> 2024-09-12T00:42:41.537+0000 7f791b35b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.949 INFO:tasks.workunit.client.0.smithi043.stderr: -323> 2024-09-12T00:42:41.537+0000 7f791b35b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.949 INFO:tasks.workunit.client.0.smithi043.stderr: -322> 2024-09-12T00:42:41.537+0000 7f791b35b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.949 INFO:tasks.workunit.client.0.smithi043.stderr: -321> 2024-09-12T00:42:41.537+0000 7f791a359640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.949 INFO:tasks.workunit.client.0.smithi043.stderr: -320> 2024-09-12T00:42:41.537+0000 7f791a359640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.949 INFO:tasks.workunit.client.0.smithi043.stderr: -319> 2024-09-12T00:42:41.537+0000 7f791a359640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.949 INFO:tasks.workunit.client.0.smithi043.stderr: -318> 2024-09-12T00:42:41.537+0000 7f791ab5a640 10 monclient(hunting): get_auth_request con 0x55f3039b3dd0 auth_method 0 2024-09-12T00:42:41.949 INFO:tasks.workunit.client.0.smithi043.stderr: -317> 2024-09-12T00:42:41.537+0000 7f791ab5a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.949 INFO:tasks.workunit.client.0.smithi043.stderr: -316> 2024-09-12T00:42:41.537+0000 7f791ab5a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.949 INFO:tasks.workunit.client.0.smithi043.stderr: -315> 2024-09-12T00:42:41.537+0000 7f791ab5a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.950 INFO:tasks.workunit.client.0.smithi043.stderr: -314> 2024-09-12T00:42:41.537+0000 7f791b35b640 10 monclient(hunting): handle_auth_done global_id 7871 payload 824 2024-09-12T00:42:41.950 INFO:tasks.workunit.client.0.smithi043.stderr: -313> 2024-09-12T00:42:41.537+0000 7f791b35b640 10 monclient: _finish_hunting 0 2024-09-12T00:42:41.950 INFO:tasks.workunit.client.0.smithi043.stderr: -312> 2024-09-12T00:42:41.537+0000 7f791b35b640 1 monclient: found mon.noname-c 2024-09-12T00:42:41.950 INFO:tasks.workunit.client.0.smithi043.stderr: -311> 2024-09-12T00:42:41.537+0000 7f791b35b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:42:41.950 INFO:tasks.workunit.client.0.smithi043.stderr: -310> 2024-09-12T00:42:41.537+0000 7f7804e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.950 INFO:tasks.workunit.client.0.smithi043.stderr: -309> 2024-09-12T00:42:41.537+0000 7f7804e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:42:41.950 INFO:tasks.workunit.client.0.smithi043.stderr: -308> 2024-09-12T00:42:41.537+0000 7f7804e01640 10 monclient: dump: 2024-09-12T00:42:41.950 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:41.950 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:41.950 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.950 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.950 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.950 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:41.951 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:41.951 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:41.951 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:41.951 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.951 INFO:tasks.workunit.client.0.smithi043.stderr: -307> 2024-09-12T00:42:41.537+0000 7f7804e01640 10 monclient: _finish_auth 0 2024-09-12T00:42:41.951 INFO:tasks.workunit.client.0.smithi043.stderr: -306> 2024-09-12T00:42:41.537+0000 7f7804e01640 10 monclient: _check_auth_tickets 2024-09-12T00:42:41.951 INFO:tasks.workunit.client.0.smithi043.stderr: -305> 2024-09-12T00:42:41.537+0000 7f7804e01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:41.951 INFO:tasks.workunit.client.0.smithi043.stderr: -304> 2024-09-12T00:42:41.537+0000 7f7804e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.951 INFO:tasks.workunit.client.0.smithi043.stderr: -303> 2024-09-12T00:42:41.537+0000 7f7804e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:42:41.951 INFO:tasks.workunit.client.0.smithi043.stderr: -302> 2024-09-12T00:42:41.537+0000 7f7804e01640 10 monclient: dump: 2024-09-12T00:42:41.951 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:41.951 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:41.951 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.951 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.952 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.952 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:41.952 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:41.952 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:41.952 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:41.952 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.952 INFO:tasks.workunit.client.0.smithi043.stderr: -301> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 monclient: authenticate success, global_id 7871 2024-09-12T00:42:41.952 INFO:tasks.workunit.client.0.smithi043.stderr: -300> 2024-09-12T00:42:41.537+0000 7f791bb5c640 4 set_mon_vals no callback set 2024-09-12T00:42:41.952 INFO:tasks.workunit.client.0.smithi043.stderr: -299> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient: _renew_subs 2024-09-12T00:42:41.952 INFO:tasks.workunit.client.0.smithi043.stderr: -298> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:42:41.952 INFO:tasks.workunit.client.0.smithi043.stderr: -297> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient: _renew_subs 2024-09-12T00:42:41.952 INFO:tasks.workunit.client.0.smithi043.stderr: -296> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.43:3301/0 2024-09-12T00:42:41.953 INFO:tasks.workunit.client.0.smithi043.stderr: -295> 2024-09-12T00:42:41.537+0000 7f7804e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:41.953 INFO:tasks.workunit.client.0.smithi043.stderr: -294> 2024-09-12T00:42:41.537+0000 7f7804e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:42:41.953 INFO:tasks.workunit.client.0.smithi043.stderr: -293> 2024-09-12T00:42:41.537+0000 7f7804e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:42:41.953 INFO:tasks.workunit.client.0.smithi043.stderr: -292> 2024-09-12T00:42:41.537+0000 7f791ab5a640 10 monclient: get_auth_request con 0x7f77f4070a20 auth_method 0 2024-09-12T00:42:41.953 INFO:tasks.workunit.client.0.smithi043.stderr: -291> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient: get_monmap_and_config 2024-09-12T00:42:41.953 INFO:tasks.workunit.client.0.smithi043.stderr: -290> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient: build_initial_monmap 2024-09-12T00:42:41.953 INFO:tasks.workunit.client.0.smithi043.stderr: -289> 2024-09-12T00:42:41.537+0000 7f791d0549c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:41.953 INFO:tasks.workunit.client.0.smithi043.stderr: -288> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient: monmap: 2024-09-12T00:42:41.953 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:42:41.953 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:41.953 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:42:41.953 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:42:41.953 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:41.954 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:41.954 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:42:41.954 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:42:41.954 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:42:41.954 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.954 INFO:tasks.workunit.client.0.smithi043.stderr: -287> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x55f3039d3590) adding auth protocol: cephx 2024-09-12T00:42:41.954 INFO:tasks.workunit.client.0.smithi043.stderr: -286> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x55f3039d3590) adding auth protocol: cephx 2024-09-12T00:42:41.954 INFO:tasks.workunit.client.0.smithi043.stderr: -285> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x55f3039d3590) adding auth protocol: cephx 2024-09-12T00:42:41.954 INFO:tasks.workunit.client.0.smithi043.stderr: -284> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x55f3039d3590) adding con mode: secure 2024-09-12T00:42:41.954 INFO:tasks.workunit.client.0.smithi043.stderr: -283> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x55f3039d3590) adding con mode: crc 2024-09-12T00:42:41.954 INFO:tasks.workunit.client.0.smithi043.stderr: -282> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x55f3039d3590) adding con mode: secure 2024-09-12T00:42:41.954 INFO:tasks.workunit.client.0.smithi043.stderr: -281> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x55f3039d3590) adding con mode: crc 2024-09-12T00:42:41.954 INFO:tasks.workunit.client.0.smithi043.stderr: -280> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x55f3039d3590) adding con mode: secure 2024-09-12T00:42:41.955 INFO:tasks.workunit.client.0.smithi043.stderr: -279> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x55f3039d3590) adding con mode: crc 2024-09-12T00:42:41.955 INFO:tasks.workunit.client.0.smithi043.stderr: -278> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x55f3039d3590) adding con mode: crc 2024-09-12T00:42:41.955 INFO:tasks.workunit.client.0.smithi043.stderr: -277> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x55f3039d3590) adding con mode: secure 2024-09-12T00:42:41.955 INFO:tasks.workunit.client.0.smithi043.stderr: -276> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x55f3039d3590) adding con mode: crc 2024-09-12T00:42:41.955 INFO:tasks.workunit.client.0.smithi043.stderr: -275> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x55f3039d3590) adding con mode: secure 2024-09-12T00:42:41.955 INFO:tasks.workunit.client.0.smithi043.stderr: -274> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x55f3039d3590) adding con mode: crc 2024-09-12T00:42:41.955 INFO:tasks.workunit.client.0.smithi043.stderr: -273> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x55f3039d3590) adding con mode: secure 2024-09-12T00:42:41.955 INFO:tasks.workunit.client.0.smithi043.stderr: -272> 2024-09-12T00:42:41.537+0000 7f791d0549c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.955 INFO:tasks.workunit.client.0.smithi043.stderr: -271> 2024-09-12T00:42:41.537+0000 7f791d0549c0 10 monclient: init 2024-09-12T00:42:41.955 INFO:tasks.workunit.client.0.smithi043.stderr: -270> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c7dd0) adding auth protocol: cephx 2024-09-12T00:42:41.955 INFO:tasks.workunit.client.0.smithi043.stderr: -269> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c7dd0) adding auth protocol: cephx 2024-09-12T00:42:41.955 INFO:tasks.workunit.client.0.smithi043.stderr: -268> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c7dd0) adding auth protocol: cephx 2024-09-12T00:42:41.955 INFO:tasks.workunit.client.0.smithi043.stderr: -267> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c7dd0) adding con mode: secure 2024-09-12T00:42:41.956 INFO:tasks.workunit.client.0.smithi043.stderr: -266> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c7dd0) adding con mode: crc 2024-09-12T00:42:41.956 INFO:tasks.workunit.client.0.smithi043.stderr: -265> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c7dd0) adding con mode: secure 2024-09-12T00:42:41.956 INFO:tasks.workunit.client.0.smithi043.stderr: -264> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c7dd0) adding con mode: crc 2024-09-12T00:42:41.956 INFO:tasks.workunit.client.0.smithi043.stderr: -263> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c7dd0) adding con mode: secure 2024-09-12T00:42:41.956 INFO:tasks.workunit.client.0.smithi043.stderr: -262> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c7dd0) adding con mode: crc 2024-09-12T00:42:41.956 INFO:tasks.workunit.client.0.smithi043.stderr: -261> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c7dd0) adding con mode: crc 2024-09-12T00:42:41.956 INFO:tasks.workunit.client.0.smithi043.stderr: -260> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c7dd0) adding con mode: secure 2024-09-12T00:42:41.956 INFO:tasks.workunit.client.0.smithi043.stderr: -259> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c7dd0) adding con mode: crc 2024-09-12T00:42:41.956 INFO:tasks.workunit.client.0.smithi043.stderr: -258> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c7dd0) adding con mode: secure 2024-09-12T00:42:41.956 INFO:tasks.workunit.client.0.smithi043.stderr: -257> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c7dd0) adding con mode: crc 2024-09-12T00:42:41.956 INFO:tasks.workunit.client.0.smithi043.stderr: -256> 2024-09-12T00:42:41.537+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c7dd0) adding con mode: secure 2024-09-12T00:42:41.956 INFO:tasks.workunit.client.0.smithi043.stderr: -255> 2024-09-12T00:42:41.537+0000 7f791d0549c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.956 INFO:tasks.workunit.client.0.smithi043.stderr: -254> 2024-09-12T00:42:41.541+0000 7f791d0549c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.957 INFO:tasks.workunit.client.0.smithi043.stderr: -253> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command rotate-key cmddesc rotate-key hook 0x7fffc01c7f18 EEXIST 2024-09-12T00:42:41.957 INFO:tasks.workunit.client.0.smithi043.stderr: -252> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:41.957 INFO:tasks.workunit.client.0.smithi043.stderr: -251> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:42:41.957 INFO:tasks.workunit.client.0.smithi043.stderr: -250> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): picked mon.noname-c con 0x55f303a07ab0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:42:41.957 INFO:tasks.workunit.client.0.smithi043.stderr: -249> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): picked mon.noname-a con 0x55f303a02ea0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:42:41.957 INFO:tasks.workunit.client.0.smithi043.stderr: -248> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): picked mon.noname-b con 0x55f303a03820 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:42:41.957 INFO:tasks.workunit.client.0.smithi043.stderr: -247> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.957 INFO:tasks.workunit.client.0.smithi043.stderr: -246> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.957 INFO:tasks.workunit.client.0.smithi043.stderr: -245> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.957 INFO:tasks.workunit.client.0.smithi043.stderr: -244> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:41.957 INFO:tasks.workunit.client.0.smithi043.stderr: -243> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): authenticate will time out at 2457.532332s 2024-09-12T00:42:41.957 INFO:tasks.workunit.client.0.smithi043.stderr: -242> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient(hunting): get_auth_request con 0x55f303a07ab0 auth_method 0 2024-09-12T00:42:41.957 INFO:tasks.workunit.client.0.smithi043.stderr: -241> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.958 INFO:tasks.workunit.client.0.smithi043.stderr: -240> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.958 INFO:tasks.workunit.client.0.smithi043.stderr: -239> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.958 INFO:tasks.workunit.client.0.smithi043.stderr: -238> 2024-09-12T00:42:41.541+0000 7f791a359640 10 monclient(hunting): get_auth_request con 0x55f303a02ea0 auth_method 0 2024-09-12T00:42:41.958 INFO:tasks.workunit.client.0.smithi043.stderr: -237> 2024-09-12T00:42:41.541+0000 7f791a359640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.958 INFO:tasks.workunit.client.0.smithi043.stderr: -236> 2024-09-12T00:42:41.541+0000 7f791a359640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.958 INFO:tasks.workunit.client.0.smithi043.stderr: -235> 2024-09-12T00:42:41.541+0000 7f791a359640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.958 INFO:tasks.workunit.client.0.smithi043.stderr: -234> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.958 INFO:tasks.workunit.client.0.smithi043.stderr: -233> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.958 INFO:tasks.workunit.client.0.smithi043.stderr: -232> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.958 INFO:tasks.workunit.client.0.smithi043.stderr: -231> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient(hunting): handle_auth_done global_id 7874 payload 274 2024-09-12T00:42:41.958 INFO:tasks.workunit.client.0.smithi043.stderr: -230> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient: _finish_hunting 0 2024-09-12T00:42:41.958 INFO:tasks.workunit.client.0.smithi043.stderr: -229> 2024-09-12T00:42:41.541+0000 7f791ab5a640 1 monclient: found mon.noname-c 2024-09-12T00:42:41.958 INFO:tasks.workunit.client.0.smithi043.stderr: -228> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.43:3301/0 2024-09-12T00:42:41.959 INFO:tasks.workunit.client.0.smithi043.stderr: -227> 2024-09-12T00:42:41.541+0000 7f77fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.959 INFO:tasks.workunit.client.0.smithi043.stderr: -226> 2024-09-12T00:42:41.541+0000 7f77fe7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:42:41.959 INFO:tasks.workunit.client.0.smithi043.stderr: -225> 2024-09-12T00:42:41.541+0000 7f77fe7fc640 10 monclient: dump: 2024-09-12T00:42:41.959 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:41.959 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:41.959 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.959 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.959 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.959 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:41.959 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:41.959 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:41.959 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:41.959 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.960 INFO:tasks.workunit.client.0.smithi043.stderr: -224> 2024-09-12T00:42:41.541+0000 7f77fe7fc640 10 monclient: _finish_auth 0 2024-09-12T00:42:41.960 INFO:tasks.workunit.client.0.smithi043.stderr: -223> 2024-09-12T00:42:41.541+0000 7f77fe7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:42:41.960 INFO:tasks.workunit.client.0.smithi043.stderr: -222> 2024-09-12T00:42:41.541+0000 7f77fe7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:41.960 INFO:tasks.workunit.client.0.smithi043.stderr: -221> 2024-09-12T00:42:41.541+0000 7f77fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.960 INFO:tasks.workunit.client.0.smithi043.stderr: -220> 2024-09-12T00:42:41.541+0000 7f77fe7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:42:41.960 INFO:tasks.workunit.client.0.smithi043.stderr: -219> 2024-09-12T00:42:41.541+0000 7f77fe7fc640 10 monclient: dump: 2024-09-12T00:42:41.960 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:41.960 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:41.960 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.960 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.960 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.960 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:41.960 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:41.961 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:41.961 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:41.961 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.961 INFO:tasks.workunit.client.0.smithi043.stderr: -218> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 monclient: authenticate success, global_id 7874 2024-09-12T00:42:41.961 INFO:tasks.workunit.client.0.smithi043.stderr: -217> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient: get_monmap_and_config success 2024-09-12T00:42:41.961 INFO:tasks.workunit.client.0.smithi043.stderr: -216> 2024-09-12T00:42:41.541+0000 7f791d0549c0 4 set_mon_vals no callback set 2024-09-12T00:42:41.961 INFO:tasks.workunit.client.0.smithi043.stderr: -215> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient: shutdown 2024-09-12T00:42:41.961 INFO:tasks.workunit.client.0.smithi043.stderr: -214> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient: build_initial_monmap 2024-09-12T00:42:41.961 INFO:tasks.workunit.client.0.smithi043.stderr: -213> 2024-09-12T00:42:41.541+0000 7f791d0549c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:41.961 INFO:tasks.workunit.client.0.smithi043.stderr: -212> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient: monmap: 2024-09-12T00:42:41.961 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 0 2024-09-12T00:42:41.961 INFO:tasks.workunit.client.0.smithi043.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:41.962 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 0.000000 2024-09-12T00:42:41.962 INFO:tasks.workunit.client.0.smithi043.stderr:created 0.000000 2024-09-12T00:42:41.962 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:41.962 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:41.962 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.noname-a 2024-09-12T00:42:41.962 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-b 2024-09-12T00:42:41.962 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.noname-c 2024-09-12T00:42:41.962 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.962 INFO:tasks.workunit.client.0.smithi043.stderr: -211> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039fa0a0) adding auth protocol: cephx 2024-09-12T00:42:41.962 INFO:tasks.workunit.client.0.smithi043.stderr: -210> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039fa0a0) adding auth protocol: cephx 2024-09-12T00:42:41.962 INFO:tasks.workunit.client.0.smithi043.stderr: -209> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039fa0a0) adding auth protocol: cephx 2024-09-12T00:42:41.962 INFO:tasks.workunit.client.0.smithi043.stderr: -208> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039fa0a0) adding con mode: secure 2024-09-12T00:42:41.962 INFO:tasks.workunit.client.0.smithi043.stderr: -207> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039fa0a0) adding con mode: crc 2024-09-12T00:42:41.963 INFO:tasks.workunit.client.0.smithi043.stderr: -206> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039fa0a0) adding con mode: secure 2024-09-12T00:42:41.963 INFO:tasks.workunit.client.0.smithi043.stderr: -205> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039fa0a0) adding con mode: crc 2024-09-12T00:42:41.963 INFO:tasks.workunit.client.0.smithi043.stderr: -204> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039fa0a0) adding con mode: secure 2024-09-12T00:42:41.963 INFO:tasks.workunit.client.0.smithi043.stderr: -203> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039fa0a0) adding con mode: crc 2024-09-12T00:42:41.963 INFO:tasks.workunit.client.0.smithi043.stderr: -202> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039fa0a0) adding con mode: crc 2024-09-12T00:42:41.963 INFO:tasks.workunit.client.0.smithi043.stderr: -201> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039fa0a0) adding con mode: secure 2024-09-12T00:42:41.963 INFO:tasks.workunit.client.0.smithi043.stderr: -200> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039fa0a0) adding con mode: crc 2024-09-12T00:42:41.963 INFO:tasks.workunit.client.0.smithi043.stderr: -199> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039fa0a0) adding con mode: secure 2024-09-12T00:42:41.963 INFO:tasks.workunit.client.0.smithi043.stderr: -198> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039fa0a0) adding con mode: crc 2024-09-12T00:42:41.963 INFO:tasks.workunit.client.0.smithi043.stderr: -197> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039fa0a0) adding con mode: secure 2024-09-12T00:42:41.963 INFO:tasks.workunit.client.0.smithi043.stderr: -196> 2024-09-12T00:42:41.541+0000 7f791d0549c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.963 INFO:tasks.workunit.client.0.smithi043.stderr: -195> 2024-09-12T00:42:41.541+0000 7f791d0549c0 1 librados: starting msgr at 2024-09-12T00:42:41.963 INFO:tasks.workunit.client.0.smithi043.stderr: -194> 2024-09-12T00:42:41.541+0000 7f791d0549c0 1 librados: starting objecter 2024-09-12T00:42:41.964 INFO:tasks.workunit.client.0.smithi043.stderr: -193> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55f3039d7b00 EEXIST 2024-09-12T00:42:41.964 INFO:tasks.workunit.client.0.smithi043.stderr: -192> 2024-09-12T00:42:41.541+0000 7f791d0549c0 1 librados: setting wanted keys 2024-09-12T00:42:41.964 INFO:tasks.workunit.client.0.smithi043.stderr: -191> 2024-09-12T00:42:41.541+0000 7f791d0549c0 1 librados: calling monclient init 2024-09-12T00:42:41.964 INFO:tasks.workunit.client.0.smithi043.stderr: -190> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient: init 2024-09-12T00:42:41.964 INFO:tasks.workunit.client.0.smithi043.stderr: -189> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039b5bf0) adding auth protocol: cephx 2024-09-12T00:42:41.964 INFO:tasks.workunit.client.0.smithi043.stderr: -188> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039b5bf0) adding auth protocol: cephx 2024-09-12T00:42:41.964 INFO:tasks.workunit.client.0.smithi043.stderr: -187> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039b5bf0) adding auth protocol: cephx 2024-09-12T00:42:41.964 INFO:tasks.workunit.client.0.smithi043.stderr: -186> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039b5bf0) adding con mode: secure 2024-09-12T00:42:41.964 INFO:tasks.workunit.client.0.smithi043.stderr: -185> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039b5bf0) adding con mode: crc 2024-09-12T00:42:41.964 INFO:tasks.workunit.client.0.smithi043.stderr: -184> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039b5bf0) adding con mode: secure 2024-09-12T00:42:41.964 INFO:tasks.workunit.client.0.smithi043.stderr: -183> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039b5bf0) adding con mode: crc 2024-09-12T00:42:41.964 INFO:tasks.workunit.client.0.smithi043.stderr: -182> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039b5bf0) adding con mode: secure 2024-09-12T00:42:41.964 INFO:tasks.workunit.client.0.smithi043.stderr: -181> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039b5bf0) adding con mode: crc 2024-09-12T00:42:41.965 INFO:tasks.workunit.client.0.smithi043.stderr: -180> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039b5bf0) adding con mode: crc 2024-09-12T00:42:41.965 INFO:tasks.workunit.client.0.smithi043.stderr: -179> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039b5bf0) adding con mode: secure 2024-09-12T00:42:41.965 INFO:tasks.workunit.client.0.smithi043.stderr: -178> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039b5bf0) adding con mode: crc 2024-09-12T00:42:41.965 INFO:tasks.workunit.client.0.smithi043.stderr: -177> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039b5bf0) adding con mode: secure 2024-09-12T00:42:41.965 INFO:tasks.workunit.client.0.smithi043.stderr: -176> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039b5bf0) adding con mode: crc 2024-09-12T00:42:41.965 INFO:tasks.workunit.client.0.smithi043.stderr: -175> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 AuthRegistry(0x55f3039b5bf0) adding con mode: secure 2024-09-12T00:42:41.965 INFO:tasks.workunit.client.0.smithi043.stderr: -174> 2024-09-12T00:42:41.541+0000 7f791d0549c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.965 INFO:tasks.workunit.client.0.smithi043.stderr: -173> 2024-09-12T00:42:41.541+0000 7f791d0549c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.965 INFO:tasks.workunit.client.0.smithi043.stderr: -172> 2024-09-12T00:42:41.541+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command rotate-key cmddesc rotate-key hook 0x55f3039b5d38 EEXIST 2024-09-12T00:42:41.965 INFO:tasks.workunit.client.0.smithi043.stderr: -171> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:41.965 INFO:tasks.workunit.client.0.smithi043.stderr: -170> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:42:41.965 INFO:tasks.workunit.client.0.smithi043.stderr: -169> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): picked mon.noname-c con 0x55f303a02ea0 addr [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] 2024-09-12T00:42:41.965 INFO:tasks.workunit.client.0.smithi043.stderr: -168> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): picked mon.noname-b con 0x55f303a03820 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-12T00:42:41.966 INFO:tasks.workunit.client.0.smithi043.stderr: -167> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): picked mon.noname-a con 0x55f303a07ab0 addr [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] 2024-09-12T00:42:41.966 INFO:tasks.workunit.client.0.smithi043.stderr: -166> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.966 INFO:tasks.workunit.client.0.smithi043.stderr: -165> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.966 INFO:tasks.workunit.client.0.smithi043.stderr: -164> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:41.966 INFO:tasks.workunit.client.0.smithi043.stderr: -163> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:41.966 INFO:tasks.workunit.client.0.smithi043.stderr: -162> 2024-09-12T00:42:41.541+0000 7f791d0549c0 10 monclient(hunting): authenticate will time out at 2457.535154s 2024-09-12T00:42:41.966 INFO:tasks.workunit.client.0.smithi043.stderr: -161> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient(hunting): get_auth_request con 0x55f303a02ea0 auth_method 0 2024-09-12T00:42:41.966 INFO:tasks.workunit.client.0.smithi043.stderr: -160> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.966 INFO:tasks.workunit.client.0.smithi043.stderr: -159> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.966 INFO:tasks.workunit.client.0.smithi043.stderr: -158> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.966 INFO:tasks.workunit.client.0.smithi043.stderr: -157> 2024-09-12T00:42:41.541+0000 7f791b35b640 10 monclient(hunting): get_auth_request con 0x55f303a07ab0 auth_method 0 2024-09-12T00:42:41.966 INFO:tasks.workunit.client.0.smithi043.stderr: -156> 2024-09-12T00:42:41.541+0000 7f791b35b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:41.966 INFO:tasks.workunit.client.0.smithi043.stderr: -155> 2024-09-12T00:42:41.541+0000 7f791b35b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:41.967 INFO:tasks.workunit.client.0.smithi043.stderr: -154> 2024-09-12T00:42:41.541+0000 7f791b35b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:41.967 INFO:tasks.workunit.client.0.smithi043.stderr: -153> 2024-09-12T00:42:41.541+0000 7f791b35b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.967 INFO:tasks.workunit.client.0.smithi043.stderr: -152> 2024-09-12T00:42:41.541+0000 7f791b35b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.967 INFO:tasks.workunit.client.0.smithi043.stderr: -151> 2024-09-12T00:42:41.541+0000 7f791b35b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.967 INFO:tasks.workunit.client.0.smithi043.stderr: -150> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:41.967 INFO:tasks.workunit.client.0.smithi043.stderr: -149> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:41.967 INFO:tasks.workunit.client.0.smithi043.stderr: -148> 2024-09-12T00:42:41.541+0000 7f791ab5a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:41.967 INFO:tasks.workunit.client.0.smithi043.stderr: -147> 2024-09-12T00:42:41.541+0000 7f791b35b640 10 monclient(hunting): handle_auth_done global_id 8283 payload 824 2024-09-12T00:42:41.967 INFO:tasks.workunit.client.0.smithi043.stderr: -146> 2024-09-12T00:42:41.541+0000 7f791b35b640 10 monclient: _finish_hunting 0 2024-09-12T00:42:41.967 INFO:tasks.workunit.client.0.smithi043.stderr: -145> 2024-09-12T00:42:41.541+0000 7f791b35b640 1 monclient: found mon.noname-a 2024-09-12T00:42:41.967 INFO:tasks.workunit.client.0.smithi043.stderr: -144> 2024-09-12T00:42:41.541+0000 7f791b35b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.43:3300/0 2024-09-12T00:42:41.967 INFO:tasks.workunit.client.0.smithi043.stderr: -143> 2024-09-12T00:42:41.541+0000 7f77fcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.967 INFO:tasks.workunit.client.0.smithi043.stderr: -142> 2024-09-12T00:42:41.545+0000 7f77fcff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:41.968 INFO:tasks.workunit.client.0.smithi043.stderr: -141> 2024-09-12T00:42:41.545+0000 7f77fcff9640 10 monclient: dump: 2024-09-12T00:42:41.968 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:41.968 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:41.968 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.968 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.968 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.968 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:41.968 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:41.968 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:41.968 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:41.968 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.968 INFO:tasks.workunit.client.0.smithi043.stderr: -140> 2024-09-12T00:42:41.545+0000 7f77fcff9640 10 monclient: _finish_auth 0 2024-09-12T00:42:41.968 INFO:tasks.workunit.client.0.smithi043.stderr: -139> 2024-09-12T00:42:41.545+0000 7f77fcff9640 10 monclient: _check_auth_tickets 2024-09-12T00:42:41.969 INFO:tasks.workunit.client.0.smithi043.stderr: -138> 2024-09-12T00:42:41.545+0000 7f791d0549c0 5 monclient: authenticate success, global_id 8283 2024-09-12T00:42:41.969 INFO:tasks.workunit.client.0.smithi043.stderr: -137> 2024-09-12T00:42:41.545+0000 7f791d0549c0 10 monclient: _renew_subs 2024-09-12T00:42:41.969 INFO:tasks.workunit.client.0.smithi043.stderr: -136> 2024-09-12T00:42:41.545+0000 7f791d0549c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:42:41.969 INFO:tasks.workunit.client.0.smithi043.stderr: -135> 2024-09-12T00:42:41.545+0000 7f77fcff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:41.969 INFO:tasks.workunit.client.0.smithi043.stderr: -134> 2024-09-12T00:42:41.545+0000 7f77fcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:41.969 INFO:tasks.workunit.client.0.smithi043.stderr: -133> 2024-09-12T00:42:41.545+0000 7f77fcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:41.969 INFO:tasks.workunit.client.0.smithi043.stderr: -132> 2024-09-12T00:42:41.545+0000 7f77fcff9640 10 monclient: dump: 2024-09-12T00:42:41.969 INFO:tasks.workunit.client.0.smithi043.stderr:epoch 1 2024-09-12T00:42:41.969 INFO:tasks.workunit.client.0.smithi043.stderr:fsid e3ab48df-9588-4a92-9a12-d24598e1ef6f 2024-09-12T00:42:41.969 INFO:tasks.workunit.client.0.smithi043.stderr:last_changed 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.969 INFO:tasks.workunit.client.0.smithi043.stderr:created 2024-09-12T00:17:11.110661+0000 2024-09-12T00:42:41.969 INFO:tasks.workunit.client.0.smithi043.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:41.969 INFO:tasks.workunit.client.0.smithi043.stderr:election_strategy: 1 2024-09-12T00:42:41.970 INFO:tasks.workunit.client.0.smithi043.stderr:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-12T00:42:41.970 INFO:tasks.workunit.client.0.smithi043.stderr:1: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-12T00:42:41.970 INFO:tasks.workunit.client.0.smithi043.stderr:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-12T00:42:41.970 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.970 INFO:tasks.workunit.client.0.smithi043.stderr: -131> 2024-09-12T00:42:41.545+0000 7f77fe7fc640 4 set_mon_vals no callback set 2024-09-12T00:42:41.970 INFO:tasks.workunit.client.0.smithi043.stderr: -130> 2024-09-12T00:42:41.545+0000 7f791d0549c0 10 monclient: _renew_subs 2024-09-12T00:42:41.970 INFO:tasks.workunit.client.0.smithi043.stderr: -129> 2024-09-12T00:42:41.545+0000 7f791d0549c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:42:41.970 INFO:tasks.workunit.client.0.smithi043.stderr: -128> 2024-09-12T00:42:41.545+0000 7f791d0549c0 1 librados: init done 2024-09-12T00:42:41.970 INFO:tasks.workunit.client.0.smithi043.stderr: -127> 2024-09-12T00:42:41.545+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command cr dump hook 0x55f3039f8a88 2024-09-12T00:42:41.970 INFO:tasks.workunit.client.0.smithi043.stderr: -126> 2024-09-12T00:42:41.545+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.970 INFO:tasks.workunit.client.0.smithi043.stderr: -125> 2024-09-12T00:42:41.545+0000 7f77fcff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:41.970 INFO:tasks.workunit.client.0.smithi043.stderr: -124> 2024-09-12T00:42:41.545+0000 7f77fcff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:42:41.970 INFO:tasks.workunit.client.0.smithi043.stderr: -123> 2024-09-12T00:42:41.545+0000 7f77fcff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.43:6832/1982306818,v1:172.21.15.43:6833/1982306818] 2024-09-12T00:42:41.971 INFO:tasks.workunit.client.0.smithi043.stderr: -122> 2024-09-12T00:42:41.545+0000 7f791ab5a640 10 monclient: get_auth_request con 0x7f77e4070b10 auth_method 0 2024-09-12T00:42:41.971 INFO:tasks.workunit.client.0.smithi043.stderr: -121> 2024-09-12T00:42:41.545+0000 7f791a359640 10 monclient: get_auth_request con 0x55f303a211c0 auth_method 0 2024-09-12T00:42:41.971 INFO:tasks.workunit.client.0.smithi043.stderr: -120> 2024-09-12T00:42:41.545+0000 7f791d0549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.971 INFO:tasks.workunit.client.0.smithi043.stderr: -119> 2024-09-12T00:42:41.545+0000 7f791d0549c0 20 realm 2024-09-12T00:42:41.971 INFO:tasks.workunit.client.0.smithi043.stderr: -118> 2024-09-12T00:42:41.545+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.971 INFO:tasks.workunit.client.0.smithi043.stderr: -117> 2024-09-12T00:42:41.545+0000 7f791d0549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.971 INFO:tasks.workunit.client.0.smithi043.stderr: -116> 2024-09-12T00:42:41.545+0000 7f791d0549c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:41.971 INFO:tasks.workunit.client.0.smithi043.stderr: -115> 2024-09-12T00:42:41.545+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.971 INFO:tasks.workunit.client.0.smithi043.stderr: -114> 2024-09-12T00:42:41.549+0000 7f791d0549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.971 INFO:tasks.workunit.client.0.smithi043.stderr: -113> 2024-09-12T00:42:41.549+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.971 INFO:tasks.workunit.client.0.smithi043.stderr: -112> 2024-09-12T00:42:41.549+0000 7f791ab5a640 10 monclient: get_auth_request con 0x55f303a25360 auth_method 0 2024-09-12T00:42:41.971 INFO:tasks.workunit.client.0.smithi043.stderr: -111> 2024-09-12T00:42:41.549+0000 7f791d0549c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:41.971 INFO:tasks.workunit.client.0.smithi043.stderr: -110> 2024-09-12T00:42:41.549+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.971 INFO:tasks.workunit.client.0.smithi043.stderr: -109> 2024-09-12T00:42:41.549+0000 7f791a359640 10 monclient: get_auth_request con 0x55f303a28ba0 auth_method 0 2024-09-12T00:42:41.972 INFO:tasks.workunit.client.0.smithi043.stderr: -108> 2024-09-12T00:42:41.549+0000 7f791d0549c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:41.972 INFO:tasks.workunit.client.0.smithi043.stderr: -107> 2024-09-12T00:42:41.549+0000 7f791d0549c0 20 searching for the correct realm 2024-09-12T00:42:41.972 INFO:tasks.workunit.client.0.smithi043.stderr: -106> 2024-09-12T00:42:41.549+0000 7f791b35b640 10 monclient: get_auth_request con 0x55f303a2d920 auth_method 0 2024-09-12T00:42:41.972 INFO:tasks.workunit.client.0.smithi043.stderr: -105> 2024-09-12T00:42:41.553+0000 7f791ab5a640 10 monclient: get_auth_request con 0x7f790c00e920 auth_method 0 2024-09-12T00:42:41.972 INFO:tasks.workunit.client.0.smithi043.stderr: -104> 2024-09-12T00:42:41.553+0000 7f791a359640 10 monclient: get_auth_request con 0x7f79100c0bc0 auth_method 0 2024-09-12T00:42:41.972 INFO:tasks.workunit.client.0.smithi043.stderr: -103> 2024-09-12T00:42:41.557+0000 7f791b35b640 0 -- 172.21.15.43:0/3115068998 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f79100d7c10 msgr2=0x7f79100e5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:41.972 INFO:tasks.workunit.client.0.smithi043.stderr: -102> 2024-09-12T00:42:41.557+0000 7f791b35b640 10 monclient: get_auth_request con 0x7f79100d7c10 auth_method 0 2024-09-12T00:42:41.972 INFO:tasks.workunit.client.0.smithi043.stderr: -101> 2024-09-12T00:42:41.761+0000 7f791b35b640 10 monclient: get_auth_request con 0x7f79100d7c10 auth_method 0 2024-09-12T00:42:41.972 INFO:tasks.workunit.client.0.smithi043.stderr: -100> 2024-09-12T00:42:41.769+0000 7f791ab5a640 10 monclient: get_auth_request con 0x7f79100b7430 auth_method 0 2024-09-12T00:42:41.972 INFO:tasks.workunit.client.0.smithi043.stderr: -99> 2024-09-12T00:42:41.773+0000 7f791ab5a640 0 -- 172.21.15.43:0/3115068998 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x55f303a25360 msgr2=0x55f303a27770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:41.972 INFO:tasks.workunit.client.0.smithi043.stderr: -98> 2024-09-12T00:42:41.773+0000 7f77fcff9640 1 client.8283.objecter ms_handle_reset 0x55f303a25360 session 0x55f303a24ce0 osd.5 2024-09-12T00:42:41.972 INFO:tasks.workunit.client.0.smithi043.stderr: -97> 2024-09-12T00:42:41.773+0000 7f77fcff9640 10 monclient: _renew_subs 2024-09-12T00:42:41.972 INFO:tasks.workunit.client.0.smithi043.stderr: -96> 2024-09-12T00:42:41.773+0000 7f77fcff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.43:3300/0 2024-09-12T00:42:41.973 INFO:tasks.workunit.client.0.smithi043.stderr: -95> 2024-09-12T00:42:41.777+0000 7f791ab5a640 10 monclient: get_auth_request con 0x7f77e4080b30 auth_method 0 2024-09-12T00:42:41.973 INFO:tasks.workunit.client.0.smithi043.stderr: -94> 2024-09-12T00:42:41.781+0000 7f791d0549c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:42:41.973 INFO:tasks.workunit.client.0.smithi043.stderr: -93> 2024-09-12T00:42:41.781+0000 7f791d0549c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:41.973 INFO:tasks.workunit.client.0.smithi043.stderr: -92> 2024-09-12T00:42:41.781+0000 7f791d0549c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:41.973 INFO:tasks.workunit.client.0.smithi043.stderr: -91> 2024-09-12T00:42:41.781+0000 7f791d0549c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:42:41.973 INFO:tasks.workunit.client.0.smithi043.stderr: -90> 2024-09-12T00:42:41.781+0000 7f791d0549c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:41.973 INFO:tasks.workunit.client.0.smithi043.stderr: -89> 2024-09-12T00:42:41.781+0000 7f791d0549c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:41.973 INFO:tasks.workunit.client.0.smithi043.stderr: -88> 2024-09-12T00:42:41.781+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.973 INFO:tasks.workunit.client.0.smithi043.stderr: -87> 2024-09-12T00:42:41.785+0000 7f791d0549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.973 INFO:tasks.workunit.client.0.smithi043.stderr: -86> 2024-09-12T00:42:41.785+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.973 INFO:tasks.workunit.client.0.smithi043.stderr: -85> 2024-09-12T00:42:41.785+0000 7f791d0549c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:41.973 INFO:tasks.workunit.client.0.smithi043.stderr: -84> 2024-09-12T00:42:41.785+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.974 INFO:tasks.workunit.client.0.smithi043.stderr: -83> 2024-09-12T00:42:41.785+0000 7f791d0549c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:41.974 INFO:tasks.workunit.client.0.smithi043.stderr: -82> 2024-09-12T00:42:41.785+0000 7f791d0549c0 20 zone default found 2024-09-12T00:42:41.974 INFO:tasks.workunit.client.0.smithi043.stderr: -81> 2024-09-12T00:42:41.785+0000 7f791d0549c0 4 Realm: () 2024-09-12T00:42:41.974 INFO:tasks.workunit.client.0.smithi043.stderr: -80> 2024-09-12T00:42:41.785+0000 7f791d0549c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:42:41.974 INFO:tasks.workunit.client.0.smithi043.stderr: -79> 2024-09-12T00:42:41.785+0000 7f791d0549c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:42:41.974 INFO:tasks.workunit.client.0.smithi043.stderr: -78> 2024-09-12T00:42:41.785+0000 7f791d0549c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:41.974 INFO:tasks.workunit.client.0.smithi043.stderr: -77> 2024-09-12T00:42:41.785+0000 7f791d0549c0 20 zonegroup default 2024-09-12T00:42:41.974 INFO:tasks.workunit.client.0.smithi043.stderr: -76> 2024-09-12T00:42:41.785+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.974 INFO:tasks.workunit.client.0.smithi043.stderr: -75> 2024-09-12T00:42:41.785+0000 7f791d0549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.974 INFO:tasks.workunit.client.0.smithi043.stderr: -74> 2024-09-12T00:42:41.785+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.974 INFO:tasks.workunit.client.0.smithi043.stderr: -73> 2024-09-12T00:42:41.785+0000 7f791d0549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.974 INFO:tasks.workunit.client.0.smithi043.stderr: -72> 2024-09-12T00:42:41.785+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.974 INFO:tasks.workunit.client.0.smithi043.stderr: -71> 2024-09-12T00:42:41.789+0000 7f791d0549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.975 INFO:tasks.workunit.client.0.smithi043.stderr: -70> 2024-09-12T00:42:41.789+0000 7f791d0549c0 20 started sync module instance, tier type = 2024-09-12T00:42:41.975 INFO:tasks.workunit.client.0.smithi043.stderr: -69> 2024-09-12T00:42:41.789+0000 7f791d0549c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:42:41.975 INFO:tasks.workunit.client.0.smithi043.stderr: -68> 2024-09-12T00:42:41.809+0000 7f791d0549c0 20 add_watcher() i=0 2024-09-12T00:42:41.975 INFO:tasks.workunit.client.0.smithi043.stderr: -67> 2024-09-12T00:42:41.809+0000 7f791d0549c0 20 add_watcher() i=1 2024-09-12T00:42:41.975 INFO:tasks.workunit.client.0.smithi043.stderr: -66> 2024-09-12T00:42:41.809+0000 7f791d0549c0 20 add_watcher() i=2 2024-09-12T00:42:41.975 INFO:tasks.workunit.client.0.smithi043.stderr: -65> 2024-09-12T00:42:41.809+0000 7f791d0549c0 20 add_watcher() i=3 2024-09-12T00:42:41.975 INFO:tasks.workunit.client.0.smithi043.stderr: -64> 2024-09-12T00:42:41.809+0000 7f791d0549c0 20 add_watcher() i=4 2024-09-12T00:42:41.975 INFO:tasks.workunit.client.0.smithi043.stderr: -63> 2024-09-12T00:42:41.809+0000 7f791d0549c0 20 add_watcher() i=5 2024-09-12T00:42:41.975 INFO:tasks.workunit.client.0.smithi043.stderr: -62> 2024-09-12T00:42:41.809+0000 7f791d0549c0 20 add_watcher() i=6 2024-09-12T00:42:41.975 INFO:tasks.workunit.client.0.smithi043.stderr: -61> 2024-09-12T00:42:41.813+0000 7f791d0549c0 20 add_watcher() i=7 2024-09-12T00:42:41.975 INFO:tasks.workunit.client.0.smithi043.stderr: -60> 2024-09-12T00:42:41.813+0000 7f791d0549c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:41.975 INFO:tasks.workunit.client.0.smithi043.stderr: -59> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c82b0) adding auth protocol: cephx 2024-09-12T00:42:41.975 INFO:tasks.workunit.client.0.smithi043.stderr: -58> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c82b0) adding auth protocol: cephx 2024-09-12T00:42:41.976 INFO:tasks.workunit.client.0.smithi043.stderr: -57> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c82b0) adding auth protocol: cephx 2024-09-12T00:42:41.976 INFO:tasks.workunit.client.0.smithi043.stderr: -56> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c82b0) adding con mode: secure 2024-09-12T00:42:41.976 INFO:tasks.workunit.client.0.smithi043.stderr: -55> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c82b0) adding con mode: crc 2024-09-12T00:42:41.976 INFO:tasks.workunit.client.0.smithi043.stderr: -54> 2024-09-12T00:42:41.817+0000 7f77d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:41.976 INFO:tasks.workunit.client.0.smithi043.stderr: -53> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c82b0) adding con mode: secure 2024-09-12T00:42:41.976 INFO:tasks.workunit.client.0.smithi043.stderr: -52> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c82b0) adding con mode: crc 2024-09-12T00:42:41.976 INFO:tasks.workunit.client.0.smithi043.stderr: -51> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c82b0) adding con mode: secure 2024-09-12T00:42:41.976 INFO:tasks.workunit.client.0.smithi043.stderr: -50> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c82b0) adding con mode: crc 2024-09-12T00:42:41.976 INFO:tasks.workunit.client.0.smithi043.stderr: -49> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c82b0) adding con mode: crc 2024-09-12T00:42:41.976 INFO:tasks.workunit.client.0.smithi043.stderr: -48> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c82b0) adding con mode: secure 2024-09-12T00:42:41.976 INFO:tasks.workunit.client.0.smithi043.stderr: -47> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c82b0) adding con mode: crc 2024-09-12T00:42:41.976 INFO:tasks.workunit.client.0.smithi043.stderr: -46> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c82b0) adding con mode: secure 2024-09-12T00:42:41.976 INFO:tasks.workunit.client.0.smithi043.stderr: -45> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c82b0) adding con mode: crc 2024-09-12T00:42:41.977 INFO:tasks.workunit.client.0.smithi043.stderr: -44> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 AuthRegistry(0x7fffc01c82b0) adding con mode: secure 2024-09-12T00:42:41.977 INFO:tasks.workunit.client.0.smithi043.stderr: -43> 2024-09-12T00:42:41.817+0000 7f791d0549c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:41.977 INFO:tasks.workunit.client.0.smithi043.stderr: -42> 2024-09-12T00:42:41.817+0000 7f791d0549c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:41.977 INFO:tasks.workunit.client.0.smithi043.stderr: -41> 2024-09-12T00:42:41.817+0000 7f791d0549c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:41.977 INFO:tasks.workunit.client.0.smithi043.stderr: -40> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command cache list hook 0x55f3039f8ea0 2024-09-12T00:42:41.977 INFO:tasks.workunit.client.0.smithi043.stderr: -39> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command cache inspect hook 0x55f3039f8ea0 2024-09-12T00:42:41.977 INFO:tasks.workunit.client.0.smithi043.stderr: -38> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command cache erase hook 0x55f3039f8ea0 2024-09-12T00:42:41.977 INFO:tasks.workunit.client.0.smithi043.stderr: -37> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command cache zap hook 0x55f3039f8ea0 2024-09-12T00:42:41.977 INFO:tasks.workunit.client.0.smithi043.stderr: -36> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 note: GC not initialized 2024-09-12T00:42:41.977 INFO:tasks.workunit.client.0.smithi043.stderr: -35> 2024-09-12T00:42:41.817+0000 7f774bfff640 20 reqs_thread_entry: start 2024-09-12T00:42:41.977 INFO:tasks.workunit.client.0.smithi043.stderr: -34> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command sync trace show hook 0x7f791400f480 2024-09-12T00:42:41.977 INFO:tasks.workunit.client.0.smithi043.stderr: -33> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command sync trace history hook 0x7f791400f480 2024-09-12T00:42:41.978 INFO:tasks.workunit.client.0.smithi043.stderr: -32> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command sync trace active hook 0x7f791400f480 2024-09-12T00:42:41.978 INFO:tasks.workunit.client.0.smithi043.stderr: -31> 2024-09-12T00:42:41.817+0000 7f791d0549c0 5 asok(0x55f30372b2b0) register_command sync trace active_short hook 0x7f791400f480 2024-09-12T00:42:41.978 INFO:tasks.workunit.client.0.smithi043.stderr: -30> 2024-09-12T00:42:41.821+0000 7f791d0549c0 20 init_complete bucket index max shards: 11 2024-09-12T00:42:41.978 INFO:tasks.workunit.client.0.smithi043.stderr: -29> 2024-09-12T00:42:41.821+0000 7f791d0549c0 20 Filter name: none 2024-09-12T00:42:41.978 INFO:tasks.workunit.client.0.smithi043.stderr: -28> 2024-09-12T00:42:41.821+0000 7f7749ffb640 20 reqs_thread_entry: start 2024-09-12T00:42:41.978 INFO:tasks.workunit.client.0.smithi043.stderr: -27> 2024-09-12T00:42:41.821+0000 7f791d0549c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:42:41.978 INFO:tasks.workunit.client.0.smithi043.stderr: -26> 2024-09-12T00:42:41.821+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.978 INFO:tasks.workunit.client.0.smithi043.stderr: -25> 2024-09-12T00:42:41.821+0000 7f791d0549c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:42:41.978 INFO:tasks.workunit.client.0.smithi043.stderr: -24> 2024-09-12T00:42:41.821+0000 7f791d0549c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:42:41.978 INFO:tasks.workunit.client.0.smithi043.stderr: -23> 2024-09-12T00:42:41.821+0000 7f791d0549c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:42:41.978 INFO:tasks.workunit.client.0.smithi043.stderr: -22> 2024-09-12T00:42:41.821+0000 7f791d0549c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 : miss 2024-09-12T00:42:41.978 INFO:tasks.workunit.client.0.smithi043.stderr: -21> 2024-09-12T00:42:41.821+0000 7f791d0549c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.978 INFO:tasks.workunit.client.0.smithi043.stderr: -20> 2024-09-12T00:42:41.821+0000 7f791d0549c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:42:41.978 INFO:tasks.workunit.client.0.smithi043.stderr: -19> 2024-09-12T00:42:41.821+0000 7f791d0549c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:42:41.979 INFO:tasks.workunit.client.0.smithi043.stderr: -18> 2024-09-12T00:42:41.821+0000 7f791d0549c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:42:41.979 INFO:tasks.workunit.client.0.smithi043.stderr: -17> 2024-09-12T00:42:41.821+0000 7f791d0549c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:42:41.979 INFO:tasks.workunit.client.0.smithi043.stderr: -16> 2024-09-12T00:42:41.821+0000 7f791d0549c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:42:41.979 INFO:tasks.workunit.client.0.smithi043.stderr: -15> 2024-09-12T00:42:41.821+0000 7f791d0549c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 2024-09-12T00:42:41.979 INFO:tasks.workunit.client.0.smithi043.stderr: -14> 2024-09-12T00:42:41.825+0000 7f791d0549c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:42:41.979 INFO:tasks.workunit.client.0.smithi043.stderr: -13> 2024-09-12T00:42:41.841+0000 7f791d0549c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:42:41.979 INFO:tasks.workunit.client.0.smithi043.stderr: -12> 2024-09-12T00:42:41.841+0000 7f791d0549c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:42:41.979 INFO:tasks.workunit.client.0.smithi043.stderr: -11> 2024-09-12T00:42:41.841+0000 7f791d0549c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:42:41.979 INFO:tasks.workunit.client.0.smithi043.stderr: -10> 2024-09-12T00:42:41.841+0000 7f791d0549c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17, ofs0, ns] 2024-09-12T00:42:41.979 INFO:tasks.workunit.client.0.smithi043.stderr: -9> 2024-09-12T00:42:41.841+0000 7f77fe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333530 cookie 94502226444560 notifier 8283 bl.length()=827 2024-09-12T00:42:41.979 INFO:tasks.workunit.client.0.smithi043.stderr: -8> 2024-09-12T00:42:41.841+0000 7f77fe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:42:41.979 INFO:tasks.workunit.client.0.smithi043.stderr: -7> 2024-09-12T00:42:41.841+0000 7f77fe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:42:41.980 INFO:tasks.workunit.client.0.smithi043.stderr: -6> 2024-09-12T00:42:41.841+0000 7f77fe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:42:41.980 INFO:tasks.workunit.client.0.smithi043.stderr: -5> 2024-09-12T00:42:41.841+0000 7f791d0549c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_sources= new_sources= 2024-09-12T00:42:41.980 INFO:tasks.workunit.client.0.smithi043.stderr: -4> 2024-09-12T00:42:41.841+0000 7f791d0549c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential sources added=[] removed=[] 2024-09-12T00:42:41.980 INFO:tasks.workunit.client.0.smithi043.stderr: -3> 2024-09-12T00:42:41.841+0000 7f791d0549c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_dests= new_dests= 2024-09-12T00:42:41.980 INFO:tasks.workunit.client.0.smithi043.stderr: -2> 2024-09-12T00:42:41.841+0000 7f791d0549c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential dests added=[] removed=[] 2024-09-12T00:42:41.980 INFO:tasks.workunit.client.0.smithi043.stderr: -1> 2024-09-12T00:42:41.857+0000 7f791d0549c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f791d0549c0 time 2024-09-12T00:42:41.861524+0000 2024-09-12T00:42:41.980 INFO:tasks.workunit.client.0.smithi043.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:42:41.980 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.980 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:41.980 INFO:tasks.workunit.client.0.smithi043.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f792092e2eb] 2024-09-12T00:42:41.980 INFO:tasks.workunit.client.0.smithi043.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f792092e49f] 2024-09-12T00:42:41.980 INFO:tasks.workunit.client.0.smithi043.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3013bdcc1] 2024-09-12T00:42:41.980 INFO:tasks.workunit.client.0.smithi043.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f3013d2d5a] 2024-09-12T00:42:41.981 INFO:tasks.workunit.client.0.smithi043.stderr: 5: main() 2024-09-12T00:42:41.981 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f791f794d90] 2024-09-12T00:42:41.981 INFO:tasks.workunit.client.0.smithi043.stderr: 7: __libc_start_main() 2024-09-12T00:42:41.981 INFO:tasks.workunit.client.0.smithi043.stderr: 8: _start() 2024-09-12T00:42:41.981 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.981 INFO:tasks.workunit.client.0.smithi043.stderr: 0> 2024-09-12T00:42:41.861+0000 7f791d0549c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:42:41.981 INFO:tasks.workunit.client.0.smithi043.stderr: in thread 7f791d0549c0 thread_name:radosgw-admin 2024-09-12T00:42:41.981 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.981 INFO:tasks.workunit.client.0.smithi043.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:41.981 INFO:tasks.workunit.client.0.smithi043.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f791f7ad520] 2024-09-12T00:42:41.981 INFO:tasks.workunit.client.0.smithi043.stderr: 2: pthread_kill() 2024-09-12T00:42:41.981 INFO:tasks.workunit.client.0.smithi043.stderr: 3: raise() 2024-09-12T00:42:41.981 INFO:tasks.workunit.client.0.smithi043.stderr: 4: abort() 2024-09-12T00:42:41.982 INFO:tasks.workunit.client.0.smithi043.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f792092e345] 2024-09-12T00:42:41.982 INFO:tasks.workunit.client.0.smithi043.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f792092e49f] 2024-09-12T00:42:41.982 INFO:tasks.workunit.client.0.smithi043.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3013bdcc1] 2024-09-12T00:42:41.982 INFO:tasks.workunit.client.0.smithi043.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f3013d2d5a] 2024-09-12T00:42:41.982 INFO:tasks.workunit.client.0.smithi043.stderr: 9: main() 2024-09-12T00:42:41.982 INFO:tasks.workunit.client.0.smithi043.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f791f794d90] 2024-09-12T00:42:41.982 INFO:tasks.workunit.client.0.smithi043.stderr: 11: __libc_start_main() 2024-09-12T00:42:41.982 INFO:tasks.workunit.client.0.smithi043.stderr: 12: _start() 2024-09-12T00:42:41.982 INFO:tasks.workunit.client.0.smithi043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:42:41.982 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:42:41.982 INFO:tasks.workunit.client.0.smithi043.stderr:--- logging levels --- 2024-09-12T00:42:41.982 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 none 2024-09-12T00:42:41.983 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 lockdep 2024-09-12T00:42:41.983 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 context 2024-09-12T00:42:41.983 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 crush 2024-09-12T00:42:41.983 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds 2024-09-12T00:42:41.983 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_balancer 2024-09-12T00:42:41.983 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_locker 2024-09-12T00:42:41.983 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log 2024-09-12T00:42:41.983 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_log_expire 2024-09-12T00:42:41.983 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mds_migrator 2024-09-12T00:42:41.983 INFO:tasks.workunit.client.0.smithi043.stderr: 3/ 5 mds_quiesce 2024-09-12T00:42:41.983 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 buffer 2024-09-12T00:42:41.983 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 timer 2024-09-12T00:42:41.983 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 filer 2024-09-12T00:42:41.984 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 striper 2024-09-12T00:42:41.984 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 1 objecter 2024-09-12T00:42:41.984 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rados 2024-09-12T00:42:41.984 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd 2024-09-12T00:42:41.984 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_mirror 2024-09-12T00:42:41.984 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_replay 2024-09-12T00:42:41.984 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 rbd_pwl 2024-09-12T00:42:41.984 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 journaler 2024-09-12T00:42:41.984 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objectcacher 2024-09-12T00:42:41.984 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:42:41.984 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 client 2024-09-12T00:42:41.984 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 osd 2024-09-12T00:42:41.984 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 optracker 2024-09-12T00:42:41.985 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 objclass 2024-09-12T00:42:41.985 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 filestore 2024-09-12T00:42:41.985 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 journal 2024-09-12T00:42:41.985 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 ms 2024-09-12T00:42:41.985 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mon 2024-09-12T00:42:41.985 INFO:tasks.workunit.client.0.smithi043.stderr: 0/10 monc 2024-09-12T00:42:41.985 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 paxos 2024-09-12T00:42:41.985 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 tp 2024-09-12T00:42:41.985 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 auth 2024-09-12T00:42:41.985 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 crypto 2024-09-12T00:42:41.985 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 finisher 2024-09-12T00:42:41.985 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 reserver 2024-09-12T00:42:41.985 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 heartbeatmap 2024-09-12T00:42:41.986 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 perfcounter 2024-09-12T00:42:41.986 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw 2024-09-12T00:42:41.986 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_sync 2024-09-12T00:42:41.986 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_datacache 2024-09-12T00:42:41.986 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_access 2024-09-12T00:42:41.986 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:42:41.986 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_flight 2024-09-12T00:42:41.986 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:42:41.986 INFO:tasks.workunit.client.0.smithi043.stderr: 20/20 rgw_notification 2024-09-12T00:42:41.986 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 javaclient 2024-09-12T00:42:41.986 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 asok 2024-09-12T00:42:41.986 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 1 throttle 2024-09-12T00:42:41.986 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 0 refs 2024-09-12T00:42:41.987 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 compressor 2024-09-12T00:42:41.987 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluestore 2024-09-12T00:42:41.987 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 bluefs 2024-09-12T00:42:41.987 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 3 bdev 2024-09-12T00:42:41.987 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 kstore 2024-09-12T00:42:41.987 INFO:tasks.workunit.client.0.smithi043.stderr: 4/ 5 rocksdb 2024-09-12T00:42:41.987 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 fuse 2024-09-12T00:42:41.987 INFO:tasks.workunit.client.0.smithi043.stderr: 2/ 5 mgr 2024-09-12T00:42:41.987 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mgrc 2024-09-12T00:42:41.987 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 dpdk 2024-09-12T00:42:41.987 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 eventtrace 2024-09-12T00:42:41.987 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 prioritycache 2024-09-12T00:42:41.987 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 test 2024-09-12T00:42:41.987 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:42:41.988 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cephsqlite 2024-09-12T00:42:41.988 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:42:41.988 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore 2024-09-12T00:42:41.988 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_onode 2024-09-12T00:42:41.988 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_odata 2024-09-12T00:42:41.988 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_omap 2024-09-12T00:42:41.988 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_tm 2024-09-12T00:42:41.988 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_t 2024-09-12T00:42:41.988 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:42:41.988 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_epm 2024-09-12T00:42:41.988 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_lba 2024-09-12T00:42:41.988 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:42:41.988 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_cache 2024-09-12T00:42:41.989 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_journal 2024-09-12T00:42:41.989 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_device 2024-09-12T00:42:41.989 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 seastore_backref 2024-09-12T00:42:41.989 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 alienstore 2024-09-12T00:42:41.989 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 mclock 2024-09-12T00:42:41.989 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 cyanstore 2024-09-12T00:42:41.989 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 ceph_exporter 2024-09-12T00:42:41.989 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 memstore 2024-09-12T00:42:41.989 INFO:tasks.workunit.client.0.smithi043.stderr: 1/ 5 trace 2024-09-12T00:42:41.989 INFO:tasks.workunit.client.0.smithi043.stderr: 0/ 5 ceph_dedup 2024-09-12T00:42:41.989 INFO:tasks.workunit.client.0.smithi043.stderr: -2/-2 (syslog threshold) 2024-09-12T00:42:41.989 INFO:tasks.workunit.client.0.smithi043.stderr: 99/99 (stderr threshold) 2024-09-12T00:42:41.989 INFO:tasks.workunit.client.0.smithi043.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:42:41.989 INFO:tasks.workunit.client.0.smithi043.stderr: 7f7749ffb640 / http_manager 2024-09-12T00:42:41.990 INFO:tasks.workunit.client.0.smithi043.stderr: 7f774bfff640 / http_manager 2024-09-12T00:42:41.990 INFO:tasks.workunit.client.0.smithi043.stderr: 7f77d17e2640 / rgw_dt_lg_renew 2024-09-12T00:42:41.990 INFO:tasks.workunit.client.0.smithi043.stderr: 7f77fcff9640 / ms_dispatch 2024-09-12T00:42:41.990 INFO:tasks.workunit.client.0.smithi043.stderr: 7f77fe7fc640 / io_context_pool 2024-09-12T00:42:41.990 INFO:tasks.workunit.client.0.smithi043.stderr: 7f7804e01640 / ms_dispatch 2024-09-12T00:42:41.990 INFO:tasks.workunit.client.0.smithi043.stderr: 7f7807606640 / ms_dispatch 2024-09-12T00:42:41.990 INFO:tasks.workunit.client.0.smithi043.stderr: 7f7808e09640 / io_context_pool 2024-09-12T00:42:41.990 INFO:tasks.workunit.client.0.smithi043.stderr: 7f791a359640 / msgr-worker-2 2024-09-12T00:42:41.990 INFO:tasks.workunit.client.0.smithi043.stderr: 7f791ab5a640 / msgr-worker-1 2024-09-12T00:42:41.990 INFO:tasks.workunit.client.0.smithi043.stderr: 7f791b35b640 / msgr-worker-0 2024-09-12T00:42:41.990 INFO:tasks.workunit.client.0.smithi043.stderr: 7f791bb5c640 / io_context_pool 2024-09-12T00:42:41.990 INFO:tasks.workunit.client.0.smithi043.stderr: 7f791d0549c0 / radosgw-admin 2024-09-12T00:42:41.990 INFO:tasks.workunit.client.0.smithi043.stderr: max_recent 500 2024-09-12T00:42:41.991 INFO:tasks.workunit.client.0.smithi043.stderr: max_new 1000 2024-09-12T00:42:41.991 INFO:tasks.workunit.client.0.smithi043.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:42:41.865806Z_e29a7ad8-4bce-4855-86ce-7d1191702e16/log 2024-09-12T00:42:41.991 INFO:tasks.workunit.client.0.smithi043.stderr:--- end dump of recent events --- 2024-09-12T00:42:41.993 INFO:tasks.workunit.client.0.smithi043.stderr:Aborted 2024-09-12T00:42:41.993 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:42:41.994 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:41.994 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:41.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.945+0000 7f7b801be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.945+0000 7f7b801be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.945+0000 7f7b801be9c0 20 realm 2024-09-12T00:42:41.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.945+0000 7f7b801be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.945+0000 7f7b801be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.945+0000 7f7b801be9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:41.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.945+0000 7f7b801be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.945+0000 7f7b801be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.945+0000 7f7b801be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.949+0000 7f7b801be9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:41.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.949+0000 7f7b801be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.949+0000 7f7b801be9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:41.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.949+0000 7f7b801be9c0 20 searching for the correct realm 2024-09-12T00:42:41.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.957+0000 7f7b7d4c3640 0 -- 172.21.15.43:0/3375625544 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f7b74048070 msgr2=0x7f7b7407da60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:42:41.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.961+0000 7f7b7d4c3640 0 -- 172.21.15.43:0/3375625544 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f7a48080b80 msgr2=0x7f7a48082fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:41.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.969+0000 7f7b801be9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:42:41.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.969+0000 7f7b801be9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:41.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.969+0000 7f7b801be9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:41.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.969+0000 7f7b801be9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:42:41.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.969+0000 7f7b801be9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:41.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.969+0000 7f7b801be9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:41.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.969+0000 7f7b801be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.969+0000 7f7b801be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.969+0000 7f7b801be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.969+0000 7f7b801be9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:41.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.969+0000 7f7b801be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.973+0000 7f7b801be9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:41.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.973+0000 7f7b801be9c0 20 zone default found 2024-09-12T00:42:41.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.973+0000 7f7b801be9c0 4 Realm: () 2024-09-12T00:42:41.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.973+0000 7f7b801be9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:42:41.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.973+0000 7f7b801be9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:42:41.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.973+0000 7f7b801be9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:41.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.973+0000 7f7b801be9c0 20 zonegroup default 2024-09-12T00:42:41.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.973+0000 7f7b801be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.973+0000 7f7b801be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.973+0000 7f7b801be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.973+0000 7f7b801be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.973+0000 7f7b801be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:41.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.973+0000 7f7b801be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:41.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.973+0000 7f7b801be9c0 20 started sync module instance, tier type = 2024-09-12T00:42:41.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.973+0000 7f7b801be9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:42:41.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.989+0000 7f7b801be9c0 20 add_watcher() i=0 2024-09-12T00:42:41.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.989+0000 7f7b801be9c0 20 add_watcher() i=1 2024-09-12T00:42:41.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.989+0000 7f7b801be9c0 20 add_watcher() i=2 2024-09-12T00:42:41.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.989+0000 7f7b801be9c0 20 add_watcher() i=3 2024-09-12T00:42:41.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.989+0000 7f7b801be9c0 20 add_watcher() i=4 2024-09-12T00:42:41.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.989+0000 7f7b801be9c0 20 add_watcher() i=5 2024-09-12T00:42:41.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.989+0000 7f7b801be9c0 20 add_watcher() i=6 2024-09-12T00:42:41.997 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.989+0000 7f7b801be9c0 20 add_watcher() i=7 2024-09-12T00:42:41.998 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.989+0000 7f7b801be9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:41.999 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.993+0000 7f7a2f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:41.999 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.993+0000 7f7b801be9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:41.999 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.993+0000 7f7b801be9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:41.999 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.993+0000 7f7b801be9c0 5 note: GC not initialized 2024-09-12T00:42:41.999 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.993+0000 7f7a2e7fc640 20 reqs_thread_entry: start 2024-09-12T00:42:42.000 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.993+0000 7f7b801be9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:42:42.000 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.993+0000 7f7b801be9c0 20 Filter name: none 2024-09-12T00:42:42.000 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.993+0000 7f799ffff640 20 reqs_thread_entry: start 2024-09-12T00:42:42.000 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.993+0000 7f7b801be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:42.000 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.993+0000 7f7b801be9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:42:42.000 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.993+0000 7f7b801be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:42.000 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.993+0000 7f7b801be9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:42:42.000 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.997+0000 7f7b801be9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:42.000 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.997+0000 7f7b801be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:42.000 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.997+0000 7f7b801be9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:42:42.000 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.997+0000 7f7b801be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:42.000 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.997+0000 7f7b801be9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:42:42.001 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:41.997+0000 7f7b801be9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:42.002 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.001+0000 7f7a2f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:42.006 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.005+0000 7f7b801be9c0 20 remove_watcher() i=0 2024-09-12T00:42:42.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.005+0000 7f7b801be9c0 2 removed watcher, disabling cache 2024-09-12T00:42:42.008 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.005+0000 7f7b801be9c0 20 remove_watcher() i=1 2024-09-12T00:42:42.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.009+0000 7f7b801be9c0 20 remove_watcher() i=2 2024-09-12T00:42:42.013 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.009+0000 7f7b801be9c0 20 remove_watcher() i=3 2024-09-12T00:42:42.014 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.013+0000 7f7b801be9c0 20 remove_watcher() i=4 2024-09-12T00:42:42.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.013+0000 7f7b801be9c0 20 remove_watcher() i=5 2024-09-12T00:42:42.017 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.013+0000 7f7b801be9c0 20 remove_watcher() i=6 2024-09-12T00:42:42.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.017+0000 7f7b801be9c0 20 remove_watcher() i=7 2024-09-12T00:42:42.034 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:42.034 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:42:42.043 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:42:42.070 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:42.071 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:42.115 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.113+0000 7fa41017a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:42.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.113+0000 7fa41017a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:42.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.113+0000 7fa41017a9c0 20 realm 2024-09-12T00:42:42.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.113+0000 7fa41017a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:42.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.113+0000 7fa41017a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:42.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.113+0000 7fa41017a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:42.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.113+0000 7fa41017a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:42.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.113+0000 7fa41017a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:42.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.113+0000 7fa41017a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:42.119 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.117+0000 7fa41017a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:42.119 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.117+0000 7fa41017a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:42.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.117+0000 7fa41017a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:42.120 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.117+0000 7fa41017a9c0 20 searching for the correct realm 2024-09-12T00:42:42.124 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.121+0000 7fa40d47f640 0 -- 172.21.15.43:0/151994707 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fa4040d3410 msgr2=0x7fa4040d3870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:42.338 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.337+0000 7fa40dc80640 0 -- 172.21.15.43:0/151994707 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fa4040aa370 msgr2=0x7fa4040aa7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:42:42.556 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.553+0000 7fa41017a9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:42:42.556 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.553+0000 7fa41017a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:42.556 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.553+0000 7fa41017a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:42.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.553+0000 7fa41017a9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:42:42.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.553+0000 7fa41017a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:42.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.553+0000 7fa41017a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:42.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.553+0000 7fa41017a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:42.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.553+0000 7fa41017a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:42.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.553+0000 7fa41017a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:42.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.557+0000 7fa41017a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:42.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.557+0000 7fa41017a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:42.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.557+0000 7fa41017a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:42.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.557+0000 7fa41017a9c0 20 zone default found 2024-09-12T00:42:42.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.557+0000 7fa41017a9c0 4 Realm: () 2024-09-12T00:42:42.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.557+0000 7fa41017a9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:42:42.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.557+0000 7fa41017a9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:42:42.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.557+0000 7fa41017a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:42.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.557+0000 7fa41017a9c0 20 zonegroup default 2024-09-12T00:42:42.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.557+0000 7fa41017a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:42.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.557+0000 7fa41017a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:42.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.557+0000 7fa41017a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:42.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.557+0000 7fa41017a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:42.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.557+0000 7fa41017a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:42.561 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.557+0000 7fa41017a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:42.561 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.557+0000 7fa41017a9c0 20 started sync module instance, tier type = 2024-09-12T00:42:42.561 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.557+0000 7fa41017a9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:42:42.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.585+0000 7fa41017a9c0 20 add_watcher() i=0 2024-09-12T00:42:42.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.585+0000 7fa41017a9c0 20 add_watcher() i=1 2024-09-12T00:42:42.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.585+0000 7fa41017a9c0 20 add_watcher() i=2 2024-09-12T00:42:42.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.585+0000 7fa41017a9c0 20 add_watcher() i=3 2024-09-12T00:42:42.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.585+0000 7fa41017a9c0 20 add_watcher() i=4 2024-09-12T00:42:42.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.585+0000 7fa41017a9c0 20 add_watcher() i=5 2024-09-12T00:42:42.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.585+0000 7fa41017a9c0 20 add_watcher() i=6 2024-09-12T00:42:42.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.585+0000 7fa41017a9c0 20 add_watcher() i=7 2024-09-12T00:42:42.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.585+0000 7fa41017a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:42.592 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.589+0000 7fa2bffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:42.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.593+0000 7fa41017a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:42.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.593+0000 7fa41017a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:42.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.593+0000 7fa41017a9c0 5 note: GC not initialized 2024-09-12T00:42:42.595 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.593+0000 7fa2beffd640 20 reqs_thread_entry: start 2024-09-12T00:42:42.595 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.593+0000 7fa41017a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:42:42.595 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.593+0000 7fa41017a9c0 20 Filter name: none 2024-09-12T00:42:42.595 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.593+0000 7fa2bcff9640 20 reqs_thread_entry: start 2024-09-12T00:42:42.595 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.593+0000 7fa41017a9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:42:42.595 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.593+0000 7fa41017a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:42.596 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.593+0000 7fa41017a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:42:42.596 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.593+0000 7fa41017a9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:42:42.597 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.593+0000 7fa41017a9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:42:42.597 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.593+0000 7fa41017a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 : miss 2024-09-12T00:42:42.597 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.593+0000 7fa41017a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:42.597 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.597+0000 7fa41017a9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:42:42.598 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.597+0000 7fa41017a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:42:42.598 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.597+0000 7fa41017a9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:42:42.598 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.597+0000 7fa41017a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:42:42.598 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.597+0000 7fa41017a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:42:42.598 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.597+0000 7fa41017a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 2024-09-12T00:42:42.598 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.597+0000 7fa41017a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.0 2024-09-12T00:42:42.598 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.597+0000 7fa41017a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.0 2024-09-12T00:42:42.599 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.597+0000 7fa41017a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.1 2024-09-12T00:42:42.599 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.597+0000 7fa41017a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.1 2024-09-12T00:42:42.599 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.597+0000 7fa41017a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.2 2024-09-12T00:42:42.599 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.597+0000 7fa41017a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.2 2024-09-12T00:42:42.600 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.597+0000 7fa41017a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.3 2024-09-12T00:42:42.600 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.597+0000 7fa41017a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.3 2024-09-12T00:42:42.601 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.597+0000 7fa41017a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.4 2024-09-12T00:42:42.601 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.597+0000 7fa41017a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.4 2024-09-12T00:42:42.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.601+0000 7fa41017a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.5 2024-09-12T00:42:42.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.601+0000 7fa41017a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.5 2024-09-12T00:42:42.603 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.601+0000 7fa41017a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.6 2024-09-12T00:42:42.603 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.601+0000 7fa41017a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.6 2024-09-12T00:42:42.603 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.601+0000 7fa41017a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.7 2024-09-12T00:42:42.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.601+0000 7fa41017a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.7 2024-09-12T00:42:42.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.601+0000 7fa41017a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.8 2024-09-12T00:42:42.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.601+0000 7fa41017a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.8 2024-09-12T00:42:42.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.605+0000 7fa41017a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.9 2024-09-12T00:42:42.606 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.605+0000 7fa41017a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.9 2024-09-12T00:42:42.606 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.605+0000 7fa41017a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.10 2024-09-12T00:42:42.606 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.605+0000 7fa41017a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.10 2024-09-12T00:42:42.607 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.605+0000 7fa41017a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.11 2024-09-12T00:42:42.607 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.605+0000 7fa41017a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.11 2024-09-12T00:42:42.608 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.605+0000 7fa41017a9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.12 2024-09-12T00:42:42.608 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.605+0000 7fa41017a9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.12 2024-09-12T00:42:42.610 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.609+0000 7fa2bffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:42.616 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.613+0000 7fa41017a9c0 20 remove_watcher() i=0 2024-09-12T00:42:42.616 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.613+0000 7fa41017a9c0 2 removed watcher, disabling cache 2024-09-12T00:42:42.618 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.617+0000 7fa41017a9c0 20 remove_watcher() i=1 2024-09-12T00:42:42.620 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.617+0000 7fa41017a9c0 20 remove_watcher() i=2 2024-09-12T00:42:42.623 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.621+0000 7fa41017a9c0 20 remove_watcher() i=3 2024-09-12T00:42:42.625 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.621+0000 7fa41017a9c0 20 remove_watcher() i=4 2024-09-12T00:42:42.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.625+0000 7fa41017a9c0 20 remove_watcher() i=5 2024-09-12T00:42:42.628 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.625+0000 7fa41017a9c0 20 remove_watcher() i=6 2024-09-12T00:42:42.630 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:42:42.629+0000 7fa41017a9c0 20 remove_watcher() i=7 2024-09-12T00:43:12.675 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-12T00:43:12.709 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:12.709 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:12.757 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:12.753+0000 7fd8d4c209c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:12.758 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:12.757+0000 7fd8d4c209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:12.758 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:12.757+0000 7fd8d4c209c0 20 realm 2024-09-12T00:43:12.758 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:12.757+0000 7fd8d4c209c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:12.759 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:12.757+0000 7fd8d4c209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:12.759 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:12.757+0000 7fd8d4c209c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:12.759 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:12.757+0000 7fd8d4c209c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:12.759 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:12.757+0000 7fd8d4c209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:12.759 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:12.757+0000 7fd8d4c209c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:12.760 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:12.757+0000 7fd8d4c209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:12.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:12.757+0000 7fd8d4c209c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:12.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:12.761+0000 7fd8d4c209c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:12.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:12.761+0000 7fd8d4c209c0 20 searching for the correct realm 2024-09-12T00:43:12.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:12.761+0000 7fd8d1f25640 0 -- 172.21.15.43:0/1157199975 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fd8c8022040 msgr2=0x7fd8c8034430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:12.978 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:12.977+0000 7fd8d2726640 0 -- 172.21.15.43:0/1157199975 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fd8c8040410 msgr2=0x7fd8c8040890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:13.198 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.197+0000 7fd8d4c209c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:43:13.198 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.197+0000 7fd8d4c209c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:13.198 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.197+0000 7fd8d4c209c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:13.198 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.197+0000 7fd8d4c209c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:43:13.198 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.197+0000 7fd8d4c209c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:13.198 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.197+0000 7fd8d4c209c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:13.198 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.197+0000 7fd8d4c209c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.199 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.197+0000 7fd8d4c209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.199 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.197+0000 7fd8d4c209c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.199 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.197+0000 7fd8d4c209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:13.199 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.197+0000 7fd8d4c209c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.200 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.197+0000 7fd8d4c209c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:13.200 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.197+0000 7fd8d4c209c0 20 zone default found 2024-09-12T00:43:13.201 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.197+0000 7fd8d4c209c0 4 Realm: () 2024-09-12T00:43:13.201 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.197+0000 7fd8d4c209c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:43:13.201 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.197+0000 7fd8d4c209c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:43:13.201 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.197+0000 7fd8d4c209c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:13.201 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.197+0000 7fd8d4c209c0 20 zonegroup default 2024-09-12T00:43:13.201 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.197+0000 7fd8d4c209c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.201 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.197+0000 7fd8d4c209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.202 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.197+0000 7fd8d4c209c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.202 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.201+0000 7fd8d4c209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.202 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.201+0000 7fd8d4c209c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.202 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.201+0000 7fd8d4c209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.203 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.201+0000 7fd8d4c209c0 20 started sync module instance, tier type = 2024-09-12T00:43:13.203 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.201+0000 7fd8d4c209c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:43:13.226 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.225+0000 7fd8d4c209c0 20 add_watcher() i=0 2024-09-12T00:43:13.227 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.225+0000 7fd8d4c209c0 20 add_watcher() i=1 2024-09-12T00:43:13.227 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.225+0000 7fd8d4c209c0 20 add_watcher() i=2 2024-09-12T00:43:13.227 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.225+0000 7fd8d4c209c0 20 add_watcher() i=3 2024-09-12T00:43:13.227 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.225+0000 7fd8d4c209c0 20 add_watcher() i=4 2024-09-12T00:43:13.227 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.225+0000 7fd8d4c209c0 20 add_watcher() i=5 2024-09-12T00:43:13.227 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.225+0000 7fd8d4c209c0 20 add_watcher() i=6 2024-09-12T00:43:13.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.225+0000 7fd8d4c209c0 20 add_watcher() i=7 2024-09-12T00:43:13.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.225+0000 7fd8d4c209c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:13.235 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.233+0000 7fd788fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:13.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.233+0000 7fd8d4c209c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:13.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.233+0000 7fd8d4c209c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:13.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.233+0000 7fd8d4c209c0 5 note: GC not initialized 2024-09-12T00:43:13.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.233+0000 7fd7037fe640 20 reqs_thread_entry: start 2024-09-12T00:43:13.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.233+0000 7fd8d4c209c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:13.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.233+0000 7fd8d4c209c0 20 Filter name: none 2024-09-12T00:43:13.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.233+0000 7fd7017fa640 20 reqs_thread_entry: start 2024-09-12T00:43:13.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.233+0000 7fd8d4c209c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:43:13.237 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.233+0000 7fd8d4c209c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.238 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.233+0000 7fd8d4c209c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:43:13.238 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.233+0000 7fd8d4c209c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:43:13.238 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.233+0000 7fd8d4c209c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:43:13.238 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.233+0000 7fd8d4c209c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 : miss 2024-09-12T00:43:13.239 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.233+0000 7fd8d4c209c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.239 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.237+0000 7fd8d4c209c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:43:13.239 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.237+0000 7fd8d4c209c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:43:13.239 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.237+0000 7fd8d4c209c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:43:13.239 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.237+0000 7fd8d4c209c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:13.239 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.237+0000 7fd8d4c209c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:13.239 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.237+0000 7fd8d4c209c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 2024-09-12T00:43:13.247 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.245+0000 7fd788fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:13.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.249+0000 7fd8d4c209c0 20 remove_watcher() i=0 2024-09-12T00:43:13.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.249+0000 7fd8d4c209c0 2 removed watcher, disabling cache 2024-09-12T00:43:13.254 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.253+0000 7fd8d4c209c0 20 remove_watcher() i=1 2024-09-12T00:43:13.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.253+0000 7fd8d4c209c0 20 remove_watcher() i=2 2024-09-12T00:43:13.259 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.257+0000 7fd8d4c209c0 20 remove_watcher() i=3 2024-09-12T00:43:13.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.261+0000 7fd8d4c209c0 20 remove_watcher() i=4 2024-09-12T00:43:13.263 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.261+0000 7fd8d4c209c0 20 remove_watcher() i=5 2024-09-12T00:43:13.265 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.261+0000 7fd8d4c209c0 20 remove_watcher() i=6 2024-09-12T00:43:13.267 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.265+0000 7fd8d4c209c0 20 remove_watcher() i=7 2024-09-12T00:43:13.284 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:43:13.315 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:13.316 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:13.361 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.357+0000 7f3fbea2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.363 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.361+0000 7f3fbea2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.363 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.361+0000 7f3fbea2d9c0 20 realm 2024-09-12T00:43:13.363 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.361+0000 7f3fbea2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.363 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.361+0000 7f3fbea2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.363 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.361+0000 7f3fbea2d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:13.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.361+0000 7f3fbea2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.361+0000 7f3fbea2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.364 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.361+0000 7f3fbea2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.365 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.365+0000 7f3fbea2d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:13.365 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.365+0000 7f3fbea2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.365+0000 7f3fbea2d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:13.366 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.365+0000 7f3fbea2d9c0 20 searching for the correct realm 2024-09-12T00:43:13.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.369+0000 7f3fbbd32640 0 -- 172.21.15.43:0/1822866640 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f3fb005cee0 msgr2=0x7f3fb005c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:13.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.585+0000 7f3fbc533640 0 -- 172.21.15.43:0/1822866640 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f3fb005c050 msgr2=0x7f3fb0066040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:13.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.805+0000 7f3fbea2d9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:43:13.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.805+0000 7f3fbea2d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:13.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.805+0000 7f3fbea2d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:13.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.805+0000 7f3fbea2d9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:43:13.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.805+0000 7f3fbea2d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:13.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.805+0000 7f3fbea2d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:13.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.805+0000 7f3fbea2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.805+0000 7f3fbea2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.805+0000 7f3fbea2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.805+0000 7f3fbea2d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:13.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.805+0000 7f3fbea2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.805+0000 7f3fbea2d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:13.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.805+0000 7f3fbea2d9c0 20 zone default found 2024-09-12T00:43:13.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.805+0000 7f3fbea2d9c0 4 Realm: () 2024-09-12T00:43:13.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.805+0000 7f3fbea2d9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:43:13.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.805+0000 7f3fbea2d9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:43:13.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.805+0000 7f3fbea2d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:13.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.805+0000 7f3fbea2d9c0 20 zonegroup default 2024-09-12T00:43:13.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.805+0000 7f3fbea2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.805+0000 7f3fbea2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.805+0000 7f3fbea2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.809+0000 7f3fbea2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.809+0000 7f3fbea2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.809+0000 7f3fbea2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.809+0000 7f3fbea2d9c0 20 started sync module instance, tier type = 2024-09-12T00:43:13.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.809+0000 7f3fbea2d9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:43:13.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.833+0000 7f3fbea2d9c0 20 add_watcher() i=0 2024-09-12T00:43:13.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.833+0000 7f3fbea2d9c0 20 add_watcher() i=1 2024-09-12T00:43:13.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.833+0000 7f3fbea2d9c0 20 add_watcher() i=2 2024-09-12T00:43:13.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.833+0000 7f3fbea2d9c0 20 add_watcher() i=3 2024-09-12T00:43:13.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.833+0000 7f3fbea2d9c0 20 add_watcher() i=4 2024-09-12T00:43:13.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.833+0000 7f3fbea2d9c0 20 add_watcher() i=5 2024-09-12T00:43:13.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.833+0000 7f3fbea2d9c0 20 add_watcher() i=6 2024-09-12T00:43:13.837 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.833+0000 7f3fbea2d9c0 20 add_watcher() i=7 2024-09-12T00:43:13.837 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.833+0000 7f3fbea2d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:13.841 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.837+0000 7f3e72fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:13.842 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.841+0000 7f3fbea2d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:13.842 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.841+0000 7f3fbea2d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:13.842 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.841+0000 7f3fbea2d9c0 5 note: GC not initialized 2024-09-12T00:43:13.843 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.841+0000 7f3e71fdb640 20 reqs_thread_entry: start 2024-09-12T00:43:13.843 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.841+0000 7f3fbea2d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:13.843 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.841+0000 7f3fbea2d9c0 20 Filter name: none 2024-09-12T00:43:13.844 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.841+0000 7f3de37fe640 20 reqs_thread_entry: start 2024-09-12T00:43:13.844 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.841+0000 7f3fbea2d9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:43:13.844 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.841+0000 7f3fbea2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.841+0000 7f3fbea2d9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:43:13.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.841+0000 7f3fbea2d9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:43:13.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.841+0000 7f3fbea2d9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:43:13.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.845+0000 7f3fbea2d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 : miss 2024-09-12T00:43:13.846 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.845+0000 7f3fbea2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.845+0000 7f3fbea2d9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:43:13.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.845+0000 7f3fbea2d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:43:13.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.845+0000 7f3fbea2d9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:43:13.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.845+0000 7f3fbea2d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:13.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.845+0000 7f3fbea2d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:13.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.845+0000 7f3fbea2d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 2024-09-12T00:43:13.848 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.845+0000 7f3fbea2d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.0 2024-09-12T00:43:13.848 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.845+0000 7f3fbea2d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.0 2024-09-12T00:43:13.848 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.845+0000 7f3fbea2d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.1 2024-09-12T00:43:13.848 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.845+0000 7f3fbea2d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.1 2024-09-12T00:43:13.848 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.845+0000 7f3fbea2d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.2 2024-09-12T00:43:13.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.845+0000 7f3fbea2d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.2 2024-09-12T00:43:13.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.849+0000 7f3fbea2d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.3 2024-09-12T00:43:13.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.849+0000 7f3fbea2d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.3 2024-09-12T00:43:13.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.849+0000 7f3fbea2d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.4 2024-09-12T00:43:13.850 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.849+0000 7f3fbea2d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.4 2024-09-12T00:43:13.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.849+0000 7f3fbea2d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.5 2024-09-12T00:43:13.852 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.849+0000 7f3fbea2d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.5 2024-09-12T00:43:13.852 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.849+0000 7f3fbea2d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.6 2024-09-12T00:43:13.852 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.849+0000 7f3fbea2d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.6 2024-09-12T00:43:13.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.849+0000 7f3fbea2d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.7 2024-09-12T00:43:13.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.849+0000 7f3fbea2d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.7 2024-09-12T00:43:13.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.853+0000 7f3fbea2d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.8 2024-09-12T00:43:13.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.853+0000 7f3fbea2d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.8 2024-09-12T00:43:13.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.853+0000 7f3fbea2d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.9 2024-09-12T00:43:13.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.853+0000 7f3fbea2d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.9 2024-09-12T00:43:13.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.853+0000 7f3fbea2d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.10 2024-09-12T00:43:13.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.853+0000 7f3fbea2d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.10 2024-09-12T00:43:13.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.853+0000 7f3fbea2d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.11 2024-09-12T00:43:13.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.853+0000 7f3fbea2d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.11 2024-09-12T00:43:13.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.857+0000 7f3fbea2d9c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.12 2024-09-12T00:43:13.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.857+0000 7f3fbea2d9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.12 2024-09-12T00:43:13.860 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.857+0000 7f3e72fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:13.865 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.861+0000 7f3fbea2d9c0 20 remove_watcher() i=0 2024-09-12T00:43:13.865 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.861+0000 7f3fbea2d9c0 2 removed watcher, disabling cache 2024-09-12T00:43:13.867 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.865+0000 7f3fbea2d9c0 20 remove_watcher() i=1 2024-09-12T00:43:13.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.869+0000 7f3fbea2d9c0 20 remove_watcher() i=2 2024-09-12T00:43:13.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.869+0000 7f3fbea2d9c0 20 remove_watcher() i=3 2024-09-12T00:43:13.874 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.873+0000 7f3fbea2d9c0 20 remove_watcher() i=4 2024-09-12T00:43:13.876 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.873+0000 7f3fbea2d9c0 20 remove_watcher() i=5 2024-09-12T00:43:13.877 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.877+0000 7f3fbea2d9c0 20 remove_watcher() i=6 2024-09-12T00:43:13.879 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.877+0000 7f3fbea2d9c0 20 remove_watcher() i=7 2024-09-12T00:43:13.896 INFO:tasks.workunit.client.0.smithi043.stderr:check reshard logrecord successfully 2024-09-12T00:43:13.896 INFO:tasks.workunit.client.0.smithi043.stderr: test: reshard versioned bucket 2024-09-12T00:43:13.896 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:43:13.923 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:13.924 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:13.967 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.965+0000 7fe42fef39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.969 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.965+0000 7fe42fef39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.969 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.965+0000 7fe42fef39c0 20 realm 2024-09-12T00:43:13.969 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.965+0000 7fe42fef39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.969+0000 7fe42fef39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.969+0000 7fe42fef39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:13.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.969+0000 7fe42fef39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.969+0000 7fe42fef39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:13.970 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.969+0000 7fe42fef39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.971 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.969+0000 7fe42fef39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:13.971 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.969+0000 7fe42fef39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:13.972 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.969+0000 7fe42fef39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:13.973 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.969+0000 7fe42fef39c0 20 searching for the correct realm 2024-09-12T00:43:13.976 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:13.973+0000 7fe42d1f8640 0 -- 172.21.15.43:0/2962020221 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fe4240eb040 msgr2=0x7fe4240ec940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:14.192 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.189+0000 7fe42d9f9640 0 -- 172.21.15.43:0/2962020221 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fe4240dd3f0 msgr2=0x7fe4240dd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:14.410 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.409+0000 7fe42fef39c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:43:14.410 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.409+0000 7fe42fef39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:14.410 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.409+0000 7fe42fef39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:14.410 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.409+0000 7fe42fef39c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:43:14.410 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.409+0000 7fe42fef39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:14.410 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.409+0000 7fe42fef39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:14.410 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.409+0000 7fe42fef39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.411 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.409+0000 7fe42fef39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:14.411 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.409+0000 7fe42fef39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.411 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.409+0000 7fe42fef39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:14.411 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.409+0000 7fe42fef39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.412 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.409+0000 7fe42fef39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:14.412 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.409+0000 7fe42fef39c0 20 zone default found 2024-09-12T00:43:14.412 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.409+0000 7fe42fef39c0 4 Realm: () 2024-09-12T00:43:14.412 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.409+0000 7fe42fef39c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:43:14.413 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.409+0000 7fe42fef39c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:43:14.413 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.409+0000 7fe42fef39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:14.413 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.409+0000 7fe42fef39c0 20 zonegroup default 2024-09-12T00:43:14.413 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.409+0000 7fe42fef39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.413 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.409+0000 7fe42fef39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:14.413 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.409+0000 7fe42fef39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.414 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.413+0000 7fe42fef39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:14.414 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.413+0000 7fe42fef39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.415 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.413+0000 7fe42fef39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:14.415 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.413+0000 7fe42fef39c0 20 started sync module instance, tier type = 2024-09-12T00:43:14.415 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.413+0000 7fe42fef39c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:43:14.438 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.437+0000 7fe42fef39c0 20 add_watcher() i=0 2024-09-12T00:43:14.438 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.437+0000 7fe42fef39c0 20 add_watcher() i=1 2024-09-12T00:43:14.438 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.437+0000 7fe42fef39c0 20 add_watcher() i=2 2024-09-12T00:43:14.438 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.437+0000 7fe42fef39c0 20 add_watcher() i=3 2024-09-12T00:43:14.438 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.437+0000 7fe42fef39c0 20 add_watcher() i=4 2024-09-12T00:43:14.438 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.437+0000 7fe42fef39c0 20 add_watcher() i=5 2024-09-12T00:43:14.438 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.437+0000 7fe42fef39c0 20 add_watcher() i=6 2024-09-12T00:43:14.440 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.437+0000 7fe42fef39c0 20 add_watcher() i=7 2024-09-12T00:43:14.440 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.437+0000 7fe42fef39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:14.444 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.441+0000 7fe2df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:14.445 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.445+0000 7fe42fef39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:14.446 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.445+0000 7fe42fef39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:14.446 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.445+0000 7fe42fef39c0 5 note: GC not initialized 2024-09-12T00:43:14.446 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.445+0000 7fe2de7fc640 20 reqs_thread_entry: start 2024-09-12T00:43:14.446 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.445+0000 7fe42fef39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:14.446 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.445+0000 7fe42fef39c0 20 Filter name: none 2024-09-12T00:43:14.447 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.445+0000 7fe24ffff640 20 reqs_thread_entry: start 2024-09-12T00:43:14.447 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.445+0000 7fe42fef39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.448 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.445+0000 7fe42fef39c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:43:14.448 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.445+0000 7fe42fef39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.449 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.449+0000 7fe42fef39c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:43:14.450 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.449+0000 7fe42fef39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:14.450 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.449+0000 7fe42fef39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.450 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.449+0000 7fe42fef39c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:43:14.450 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.449+0000 7fe42fef39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.451 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.449+0000 7fe42fef39c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:43:14.451 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.449+0000 7fe42fef39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:14.455 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.453+0000 7fe2df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:14.460 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.457+0000 7fe42fef39c0 20 remove_watcher() i=0 2024-09-12T00:43:14.460 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.457+0000 7fe42fef39c0 2 removed watcher, disabling cache 2024-09-12T00:43:14.463 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.461+0000 7fe42fef39c0 20 remove_watcher() i=1 2024-09-12T00:43:14.465 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.461+0000 7fe42fef39c0 20 remove_watcher() i=2 2024-09-12T00:43:14.467 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.465+0000 7fe42fef39c0 20 remove_watcher() i=3 2024-09-12T00:43:14.469 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.469+0000 7fe42fef39c0 20 remove_watcher() i=4 2024-09-12T00:43:14.471 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.469+0000 7fe42fef39c0 20 remove_watcher() i=5 2024-09-12T00:43:14.472 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.469+0000 7fe42fef39c0 20 remove_watcher() i=6 2024-09-12T00:43:14.474 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.473+0000 7fe42fef39c0 20 remove_watcher() i=7 2024-09-12T00:43:14.490 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:43:14.490 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:43:14.490 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: myver id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-12T00:43:14.490 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:43:14.491 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-09-12T00:43:14.525 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:14.525 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:14.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.569+0000 7fa8059929c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.572 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.569+0000 7fa8059929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:14.572 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.569+0000 7fa8059929c0 20 realm 2024-09-12T00:43:14.572 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.569+0000 7fa8059929c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.573 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.569+0000 7fa8059929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:14.573 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.569+0000 7fa8059929c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:14.573 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.569+0000 7fa8059929c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.573 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.569+0000 7fa8059929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:14.573 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.569+0000 7fa8059929c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.577 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.573+0000 7fa8059929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:14.577 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.573+0000 7fa8059929c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:14.577 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.573+0000 7fa8059929c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:14.577 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.573+0000 7fa8059929c0 20 searching for the correct realm 2024-09-12T00:43:14.578 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.577+0000 7fa7fbfff640 0 -- 172.21.15.43:0/983150376 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fa7ec01a050 msgr2=0x7fa7ec07e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:14.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:14.793+0000 7fa803498640 0 -- 172.21.15.43:0/983150376 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fa7ec045bd0 msgr2=0x7fa7ec078170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:15.013 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.009+0000 7fa8059929c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:43:15.013 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.009+0000 7fa8059929c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:15.013 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.009+0000 7fa8059929c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:15.013 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.009+0000 7fa8059929c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:43:15.013 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.009+0000 7fa8059929c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:15.013 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.009+0000 7fa8059929c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:15.013 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.009+0000 7fa8059929c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.014 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.013+0000 7fa8059929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.014 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.013+0000 7fa8059929c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.014 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.013+0000 7fa8059929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:15.014 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.013+0000 7fa8059929c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.015 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.013+0000 7fa8059929c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:15.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.013+0000 7fa8059929c0 20 zone default found 2024-09-12T00:43:15.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.013+0000 7fa8059929c0 4 Realm: () 2024-09-12T00:43:15.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.013+0000 7fa8059929c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:43:15.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.013+0000 7fa8059929c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:43:15.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.013+0000 7fa8059929c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:15.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.013+0000 7fa8059929c0 20 zonegroup default 2024-09-12T00:43:15.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.013+0000 7fa8059929c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.016 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.013+0000 7fa8059929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.017 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.013+0000 7fa8059929c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.017 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.013+0000 7fa8059929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.017 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.013+0000 7fa8059929c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.017+0000 7fa8059929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.017+0000 7fa8059929c0 20 started sync module instance, tier type = 2024-09-12T00:43:15.018 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.017+0000 7fa8059929c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:43:15.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.041+0000 7fa8059929c0 20 add_watcher() i=0 2024-09-12T00:43:15.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.041+0000 7fa8059929c0 20 add_watcher() i=1 2024-09-12T00:43:15.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.041+0000 7fa8059929c0 20 add_watcher() i=2 2024-09-12T00:43:15.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.041+0000 7fa8059929c0 20 add_watcher() i=3 2024-09-12T00:43:15.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.041+0000 7fa8059929c0 20 add_watcher() i=4 2024-09-12T00:43:15.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.041+0000 7fa8059929c0 20 add_watcher() i=5 2024-09-12T00:43:15.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.041+0000 7fa8059929c0 20 add_watcher() i=6 2024-09-12T00:43:15.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.041+0000 7fa8059929c0 20 add_watcher() i=7 2024-09-12T00:43:15.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.041+0000 7fa8059929c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:15.049 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.049+0000 7fa6ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:15.050 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.049+0000 7fa8059929c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:15.050 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.049+0000 7fa8059929c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:15.050 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.049+0000 7fa8059929c0 5 note: GC not initialized 2024-09-12T00:43:15.051 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.049+0000 7fa6b97e2640 20 reqs_thread_entry: start 2024-09-12T00:43:15.051 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.049+0000 7fa8059929c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:15.052 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.049+0000 7fa8059929c0 20 Filter name: none 2024-09-12T00:43:15.052 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.049+0000 7fa6b27fc640 20 reqs_thread_entry: start 2024-09-12T00:43:15.052 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.049+0000 7fa8059929c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:43:15.052 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.049+0000 7fa8059929c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.053 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.049+0000 7fa8059929c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:43:15.053 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.049+0000 7fa8059929c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:43:15.053 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.049+0000 7fa8059929c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:43:15.053 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.049+0000 7fa8059929c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 : miss 2024-09-12T00:43:15.053 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.049+0000 7fa8059929c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.054 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.053+0000 7fa8059929c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:43:15.054 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.053+0000 7fa8059929c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 info.flags=0x17 2024-09-12T00:43:15.054 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.053+0000 7fa8059929c0 10 adding default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 to cache LRU end 2024-09-12T00:43:15.054 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.053+0000 7fa8059929c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:15.054 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.053+0000 7fa8059929c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:15.054 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.053+0000 7fa8059929c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 2024-09-12T00:43:15.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.061+0000 7fa8059929c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 info.flags=0x17 2024-09-12T00:43:15.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.061+0000 7fa8059929c0 10 moving default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 to cache LRU end 2024-09-12T00:43:15.064 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.061+0000 7fa8059929c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:15.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.061+0000 7fa8059929c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18, ofs0, ns] 2024-09-12T00:43:15.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.061+0000 7fa6e6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333531 cookie 94108337301408 notifier 8394 bl.length()=821 2024-09-12T00:43:15.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.061+0000 7fa6e6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 info.flags=0x17 2024-09-12T00:43:15.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.061+0000 7fa6e6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 to cache LRU end 2024-09-12T00:43:15.065 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.061+0000 7fa6e6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:15.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.065+0000 7fa8059929c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): orig_sources= new_sources= 2024-09-12T00:43:15.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.065+0000 7fa8059929c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): potential sources added=[] removed=[] 2024-09-12T00:43:15.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.065+0000 7fa8059929c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): orig_dests= new_dests= 2024-09-12T00:43:15.066 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.065+0000 7fa8059929c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): potential dests added=[] removed=[] 2024-09-12T00:43:15.078 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.073+0000 7fa8059929c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.0 2024-09-12T00:43:15.078 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.073+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.0 2024-09-12T00:43:15.078 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.073+0000 7fa8059929c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.1 2024-09-12T00:43:15.078 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.073+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.1 2024-09-12T00:43:15.078 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.073+0000 7fa8059929c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.2 2024-09-12T00:43:15.078 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.073+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.2 2024-09-12T00:43:15.078 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.073+0000 7fa8059929c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.3 2024-09-12T00:43:15.078 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.073+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.3 2024-09-12T00:43:15.078 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.073+0000 7fa8059929c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.4 2024-09-12T00:43:15.078 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.073+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.4 2024-09-12T00:43:15.078 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.073+0000 7fa8059929c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.5 2024-09-12T00:43:15.078 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.073+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.5 2024-09-12T00:43:15.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.073+0000 7fa8059929c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.6 2024-09-12T00:43:15.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.073+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.6 2024-09-12T00:43:15.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.073+0000 7fa8059929c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.7 2024-09-12T00:43:15.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.073+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.7 2024-09-12T00:43:15.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.073+0000 7fa8059929c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.8 2024-09-12T00:43:15.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.073+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.8 2024-09-12T00:43:15.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.073+0000 7fa8059929c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.9 2024-09-12T00:43:15.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.073+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.9 2024-09-12T00:43:15.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.073+0000 7fa8059929c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.10 2024-09-12T00:43:15.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.073+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.10 2024-09-12T00:43:15.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.073+0000 7fa8059929c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.11 2024-09-12T00:43:15.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.073+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.11 2024-09-12T00:43:15.079 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.077+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.0 2024-09-12T00:43:15.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.077+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1 2024-09-12T00:43:15.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.077+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2 2024-09-12T00:43:15.080 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.077+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3 2024-09-12T00:43:15.081 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.077+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.4 2024-09-12T00:43:15.082 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.081+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.5 2024-09-12T00:43:15.083 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.081+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.6 2024-09-12T00:43:15.083 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.081+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.7 2024-09-12T00:43:15.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.081+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.8 2024-09-12T00:43:15.086 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.085+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.9 2024-09-12T00:43:15.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.085+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.10 2024-09-12T00:43:15.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.085+0000 7fa8059929c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:43:15.087 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.085+0000 7fa8059929c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 2024-09-12T00:43:15.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.089+0000 7fa8059929c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 info.flags=0x17 2024-09-12T00:43:15.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.089+0000 7fa8059929c0 10 moving default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 to cache LRU end 2024-09-12T00:43:15.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.089+0000 7fa8059929c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:15.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.089+0000 7fa8059929c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18, ofs0, ns] 2024-09-12T00:43:15.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.089+0000 7fa6e6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333532 cookie 94108337301408 notifier 8394 bl.length()=821 2024-09-12T00:43:15.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.089+0000 7fa6e6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 info.flags=0x17 2024-09-12T00:43:15.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.089+0000 7fa6e6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 to cache LRU end 2024-09-12T00:43:15.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.089+0000 7fa6e6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:15.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.089+0000 7fa8059929c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): orig_sources= new_sources= 2024-09-12T00:43:15.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.089+0000 7fa8059929c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): potential sources added=[] removed=[] 2024-09-12T00:43:15.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.089+0000 7fa8059929c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): orig_dests= new_dests= 2024-09-12T00:43:15.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.089+0000 7fa8059929c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): potential dests added=[] removed=[] 2024-09-12T00:43:15.096 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.093+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.0 2024-09-12T00:43:15.097 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.093+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1 2024-09-12T00:43:15.097 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.097+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2 2024-09-12T00:43:15.098 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.097+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3 2024-09-12T00:43:15.099 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.097+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.4 2024-09-12T00:43:15.100 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.097+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.5 2024-09-12T00:43:15.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.097+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.6 2024-09-12T00:43:15.101 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.097+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.7 2024-09-12T00:43:15.102 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.101+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.8 2024-09-12T00:43:15.103 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.101+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.9 2024-09-12T00:43:15.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.101+0000 7fa8059929c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.10 2024-09-12T00:43:15.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.101+0000 7fa8059929c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:43:15.104 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.101+0000 7fa8059929c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 2024-09-12T00:43:15.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.105+0000 7fa8059929c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 info.flags=0x17 2024-09-12T00:43:15.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.105+0000 7fa8059929c0 10 moving default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 to cache LRU end 2024-09-12T00:43:15.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.105+0000 7fa8059929c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:15.107 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.105+0000 7fa8059929c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18, ofs0, ns] 2024-09-12T00:43:15.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.105+0000 7fa6e67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333533 cookie 94108337301408 notifier 8394 bl.length()=789 2024-09-12T00:43:15.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.105+0000 7fa6e67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 info.flags=0x17 2024-09-12T00:43:15.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.105+0000 7fa6e67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 to cache LRU end 2024-09-12T00:43:15.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.105+0000 7fa6e67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:15.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.105+0000 7fa8059929c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): orig_sources= new_sources= 2024-09-12T00:43:15.108 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.105+0000 7fa8059929c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): potential sources added=[] removed=[] 2024-09-12T00:43:15.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.105+0000 7fa8059929c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): orig_dests= new_dests= 2024-09-12T00:43:15.109 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.105+0000 7fa8059929c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): potential dests added=[] removed=[] 2024-09-12T00:43:15.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.113+0000 7fa8059929c0 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-09-12T00:43:15.118 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.117+0000 7fa6ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:15.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.121+0000 7fa8059929c0 20 remove_watcher() i=0 2024-09-12T00:43:15.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.121+0000 7fa8059929c0 2 removed watcher, disabling cache 2024-09-12T00:43:15.125 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.125+0000 7fa8059929c0 20 remove_watcher() i=1 2024-09-12T00:43:15.128 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.125+0000 7fa8059929c0 20 remove_watcher() i=2 2024-09-12T00:43:15.130 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.129+0000 7fa8059929c0 20 remove_watcher() i=3 2024-09-12T00:43:15.133 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.129+0000 7fa8059929c0 20 remove_watcher() i=4 2024-09-12T00:43:15.134 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.133+0000 7fa8059929c0 20 remove_watcher() i=5 2024-09-12T00:43:15.136 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.133+0000 7fa8059929c0 20 remove_watcher() i=6 2024-09-12T00:43:15.137 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.137+0000 7fa8059929c0 20 remove_watcher() i=7 2024-09-12T00:43:15.155 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:43:15.183 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:15.183 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:15.227 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.225+0000 7f821a3689c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.229+0000 7f821a3689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.229+0000 7f821a3689c0 20 realm 2024-09-12T00:43:15.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.229+0000 7f821a3689c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.229 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.229+0000 7f821a3689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.229+0000 7f821a3689c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:15.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.229+0000 7f821a3689c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.229+0000 7f821a3689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.230 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.229+0000 7f821a3689c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.231 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.229+0000 7f821a3689c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:15.231 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.229+0000 7f821a3689c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.232 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.229+0000 7f821a3689c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:15.232 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.229+0000 7f821a3689c0 20 searching for the correct realm 2024-09-12T00:43:15.239 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.237+0000 7f821866f640 0 -- 172.21.15.43:0/4116299553 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x5581b63b1340 msgr2=0x5581b63b3770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:15.244 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.241+0000 7f821766d640 0 -- 172.21.15.43:0/4116299553 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f820c0da040 msgr2=0x7f820c1319d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:15.254 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.253+0000 7f821a3689c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:43:15.254 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.253+0000 7f821a3689c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:15.254 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.253+0000 7f821a3689c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:15.254 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.253+0000 7f821a3689c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:43:15.254 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.253+0000 7f821a3689c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:15.254 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.253+0000 7f821a3689c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:15.254 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.253+0000 7f821a3689c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.254 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.253+0000 7f821a3689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.254 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.253+0000 7f821a3689c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.255 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.253+0000 7f821a3689c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:15.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.253+0000 7f821a3689c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.253+0000 7f821a3689c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:15.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.253+0000 7f821a3689c0 20 zone default found 2024-09-12T00:43:15.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.253+0000 7f821a3689c0 4 Realm: () 2024-09-12T00:43:15.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.253+0000 7f821a3689c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:43:15.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.253+0000 7f821a3689c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:43:15.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.253+0000 7f821a3689c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:15.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.253+0000 7f821a3689c0 20 zonegroup default 2024-09-12T00:43:15.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.253+0000 7f821a3689c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.253+0000 7f821a3689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.253+0000 7f821a3689c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.253+0000 7f821a3689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.253+0000 7f821a3689c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.253+0000 7f821a3689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.253+0000 7f821a3689c0 20 started sync module instance, tier type = 2024-09-12T00:43:15.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.253+0000 7f821a3689c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:43:15.272 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.269+0000 7f821a3689c0 20 add_watcher() i=0 2024-09-12T00:43:15.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.269+0000 7f821a3689c0 20 add_watcher() i=1 2024-09-12T00:43:15.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.269+0000 7f821a3689c0 20 add_watcher() i=2 2024-09-12T00:43:15.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.269+0000 7f821a3689c0 20 add_watcher() i=3 2024-09-12T00:43:15.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.269+0000 7f821a3689c0 20 add_watcher() i=4 2024-09-12T00:43:15.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.269+0000 7f821a3689c0 20 add_watcher() i=5 2024-09-12T00:43:15.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.269+0000 7f821a3689c0 20 add_watcher() i=6 2024-09-12T00:43:15.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.273+0000 7f821a3689c0 20 add_watcher() i=7 2024-09-12T00:43:15.274 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.273+0000 7f821a3689c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:15.277 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.273+0000 7f80cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:15.277 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.273+0000 7f821a3689c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:15.277 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.273+0000 7f821a3689c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:15.277 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.273+0000 7f821a3689c0 5 note: GC not initialized 2024-09-12T00:43:15.277 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.273+0000 7f80ccfe1640 20 reqs_thread_entry: start 2024-09-12T00:43:15.277 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.273+0000 7f821a3689c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:15.278 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.273+0000 7f821a3689c0 20 Filter name: none 2024-09-12T00:43:15.278 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.277+0000 7f80467fc640 20 reqs_thread_entry: start 2024-09-12T00:43:15.278 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.277+0000 7f821a3689c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.278 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.277+0000 7f821a3689c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:43:15.278 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.277+0000 7f821a3689c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.279 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.277+0000 7f821a3689c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:43:15.279 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.277+0000 7f821a3689c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:15.279 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.277+0000 7f821a3689c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.280 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.277+0000 7f821a3689c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:43:15.280 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.277+0000 7f821a3689c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.281 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.277+0000 7f821a3689c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:43:15.281 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.277+0000 7f821a3689c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:15.283 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.281+0000 7f80cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:15.287 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.285+0000 7f821a3689c0 20 remove_watcher() i=0 2024-09-12T00:43:15.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.285+0000 7f821a3689c0 2 removed watcher, disabling cache 2024-09-12T00:43:15.290 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.289+0000 7f821a3689c0 20 remove_watcher() i=1 2024-09-12T00:43:15.293 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.289+0000 7f821a3689c0 20 remove_watcher() i=2 2024-09-12T00:43:15.294 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.293+0000 7f821a3689c0 20 remove_watcher() i=3 2024-09-12T00:43:15.296 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.293+0000 7f821a3689c0 20 remove_watcher() i=4 2024-09-12T00:43:15.298 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.297+0000 7f821a3689c0 20 remove_watcher() i=5 2024-09-12T00:43:15.299 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.297+0000 7f821a3689c0 20 remove_watcher() i=6 2024-09-12T00:43:15.301 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.297+0000 7f821a3689c0 20 remove_watcher() i=7 2024-09-12T00:43:15.314 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:43:15.315 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:43:15.315 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: myver id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T00:43:15.315 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:43:15.316 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:15.316 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:43:15.319 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:15.319 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:43:15.362 INFO:tasks.workunit.client.0.smithi043.stderr: test: reshard removes olh entries with empty name 2024-09-12T00:43:15.364 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:15.364 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:43:15.421 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:15.421 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:43:15.520 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:43:15.552 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:15.552 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:15.597 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.593+0000 7fe9a2dcb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.601 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.597+0000 7fe9a2dcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.601 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.597+0000 7fe9a2dcb9c0 20 realm 2024-09-12T00:43:15.601 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.597+0000 7fe9a2dcb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.601 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.597+0000 7fe9a2dcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.601 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.597+0000 7fe9a2dcb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:15.601 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.597+0000 7fe9a2dcb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.601 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.597+0000 7fe9a2dcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.601 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.597+0000 7fe9a2dcb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.601+0000 7fe9a2dcb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:15.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.601+0000 7fe9a2dcb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.601+0000 7fe9a2dcb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:15.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.601+0000 7fe9a2dcb9c0 20 searching for the correct realm 2024-09-12T00:43:15.608 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.605+0000 7fe9a00d0640 0 -- 172.21.15.43:0/3916022868 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fe99406f050 msgr2=0x7fe994067420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:15.614 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.613+0000 7fe9a00d0640 0 -- 172.21.15.43:0/3916022868 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fe86c080be0 msgr2=0x7fe86c083010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:15.623 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.621+0000 7fe9a2dcb9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:43:15.623 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.621+0000 7fe9a2dcb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:15.624 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.621+0000 7fe9a2dcb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:15.624 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.621+0000 7fe9a2dcb9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:43:15.624 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.621+0000 7fe9a2dcb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:15.624 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.621+0000 7fe9a2dcb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:15.624 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.621+0000 7fe9a2dcb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.624 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.621+0000 7fe9a2dcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.625 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.621+0000 7fe9a2dcb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.621+0000 7fe9a2dcb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:15.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.621+0000 7fe9a2dcb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.621+0000 7fe9a2dcb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:15.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.621+0000 7fe9a2dcb9c0 20 zone default found 2024-09-12T00:43:15.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.621+0000 7fe9a2dcb9c0 4 Realm: () 2024-09-12T00:43:15.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.621+0000 7fe9a2dcb9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:43:15.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.621+0000 7fe9a2dcb9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:43:15.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.621+0000 7fe9a2dcb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:15.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.621+0000 7fe9a2dcb9c0 20 zonegroup default 2024-09-12T00:43:15.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.621+0000 7fe9a2dcb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.626 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.621+0000 7fe9a2dcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.621+0000 7fe9a2dcb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.625+0000 7fe9a2dcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.625+0000 7fe9a2dcb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.625+0000 7fe9a2dcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.625+0000 7fe9a2dcb9c0 20 started sync module instance, tier type = 2024-09-12T00:43:15.627 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.625+0000 7fe9a2dcb9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:43:15.642 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.641+0000 7fe9a2dcb9c0 20 add_watcher() i=0 2024-09-12T00:43:15.642 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.641+0000 7fe9a2dcb9c0 20 add_watcher() i=1 2024-09-12T00:43:15.642 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.641+0000 7fe9a2dcb9c0 20 add_watcher() i=2 2024-09-12T00:43:15.642 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.641+0000 7fe9a2dcb9c0 20 add_watcher() i=3 2024-09-12T00:43:15.643 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.641+0000 7fe9a2dcb9c0 20 add_watcher() i=4 2024-09-12T00:43:15.643 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.641+0000 7fe9a2dcb9c0 20 add_watcher() i=5 2024-09-12T00:43:15.643 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.641+0000 7fe9a2dcb9c0 20 add_watcher() i=6 2024-09-12T00:43:15.643 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.641+0000 7fe9a2dcb9c0 20 add_watcher() i=7 2024-09-12T00:43:15.643 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.641+0000 7fe9a2dcb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:15.646 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.645+0000 7fe856fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:15.647 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.645+0000 7fe9a2dcb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:15.647 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.645+0000 7fe9a2dcb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:15.647 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.645+0000 7fe9a2dcb9c0 5 note: GC not initialized 2024-09-12T00:43:15.647 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.645+0000 7fe855fe3640 20 reqs_thread_entry: start 2024-09-12T00:43:15.647 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.645+0000 7fe9a2dcb9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:15.647 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.645+0000 7fe9a2dcb9c0 20 Filter name: none 2024-09-12T00:43:15.647 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.645+0000 7fe7c77fe640 20 reqs_thread_entry: start 2024-09-12T00:43:15.647 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.645+0000 7fe9a2dcb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.648 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.645+0000 7fe9a2dcb9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:43:15.648 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.645+0000 7fe9a2dcb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.649 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.645+0000 7fe9a2dcb9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:43:15.649 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.645+0000 7fe9a2dcb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:15.649 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.645+0000 7fe9a2dcb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.650 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.649+0000 7fe9a2dcb9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:43:15.650 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.649+0000 7fe9a2dcb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.651 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.649+0000 7fe9a2dcb9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:43:15.651 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.649+0000 7fe9a2dcb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:15.654 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.653+0000 7fe856fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:15.659 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.657+0000 7fe9a2dcb9c0 20 remove_watcher() i=0 2024-09-12T00:43:15.659 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.657+0000 7fe9a2dcb9c0 2 removed watcher, disabling cache 2024-09-12T00:43:15.661 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.657+0000 7fe9a2dcb9c0 20 remove_watcher() i=1 2024-09-12T00:43:15.663 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.661+0000 7fe9a2dcb9c0 20 remove_watcher() i=2 2024-09-12T00:43:15.665 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.661+0000 7fe9a2dcb9c0 20 remove_watcher() i=3 2024-09-12T00:43:15.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.665+0000 7fe9a2dcb9c0 20 remove_watcher() i=4 2024-09-12T00:43:15.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.665+0000 7fe9a2dcb9c0 20 remove_watcher() i=5 2024-09-12T00:43:15.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.669+0000 7fe9a2dcb9c0 20 remove_watcher() i=6 2024-09-12T00:43:15.671 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.669+0000 7fe9a2dcb9c0 20 remove_watcher() i=7 2024-09-12T00:43:15.685 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:43:15.685 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:43:15.685 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: a-bucket id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 num_objects: 0 size_kb: 0 num_shards: 13 2024-09-12T00:43:15.686 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:43:15.686 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-12T00:43:15.712 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:15.712 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:15.755 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.753+0000 7f25adcc79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.758 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.757+0000 7f25adcc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.758 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.757+0000 7f25adcc79c0 20 realm 2024-09-12T00:43:15.758 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.757+0000 7f25adcc79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.758 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.757+0000 7f25adcc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.758 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.757+0000 7f25adcc79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:15.758 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.757+0000 7f25adcc79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.759 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.757+0000 7f25adcc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.759 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.757+0000 7f25adcc79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.759 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.757+0000 7f25adcc79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:15.759 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.757+0000 7f25adcc79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.757+0000 7f25adcc79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:15.761 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.757+0000 7f25adcc79c0 20 searching for the correct realm 2024-09-12T00:43:15.767 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.765+0000 7f25abfce640 0 -- 172.21.15.43:0/180415568 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f25a00810d0 msgr2=0x7f25a005d9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:15.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.981+0000 7f25ab7cd640 0 -- 172.21.15.43:0/180415568 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x56394b779a90 msgr2=0x56394b77be80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:15.991 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.989+0000 7f25adcc79c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:43:15.991 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.989+0000 7f25adcc79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:15.991 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.989+0000 7f25adcc79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:15.992 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.989+0000 7f25adcc79c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:43:15.992 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.989+0000 7f25adcc79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:15.992 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.989+0000 7f25adcc79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:15.992 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.989+0000 7f25adcc79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.992 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.989+0000 7f25adcc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.992 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.989+0000 7f25adcc79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.993 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.989+0000 7f25adcc79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:15.993 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.989+0000 7f25adcc79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.993 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.993+0000 7f25adcc79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:15.993 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.993+0000 7f25adcc79c0 20 zone default found 2024-09-12T00:43:15.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.993+0000 7f25adcc79c0 4 Realm: () 2024-09-12T00:43:15.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.993+0000 7f25adcc79c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:43:15.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.993+0000 7f25adcc79c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:43:15.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.993+0000 7f25adcc79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:15.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.993+0000 7f25adcc79c0 20 zonegroup default 2024-09-12T00:43:15.994 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.993+0000 7f25adcc79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.993+0000 7f25adcc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.993+0000 7f25adcc79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.993+0000 7f25adcc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.995 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.993+0000 7f25adcc79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:15.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.993+0000 7f25adcc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:15.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.993+0000 7f25adcc79c0 20 started sync module instance, tier type = 2024-09-12T00:43:15.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:15.993+0000 7f25adcc79c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:43:16.021 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.017+0000 7f25adcc79c0 20 add_watcher() i=0 2024-09-12T00:43:16.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.017+0000 7f25adcc79c0 20 add_watcher() i=1 2024-09-12T00:43:16.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.017+0000 7f25adcc79c0 20 add_watcher() i=2 2024-09-12T00:43:16.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.017+0000 7f25adcc79c0 20 add_watcher() i=3 2024-09-12T00:43:16.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.017+0000 7f25adcc79c0 20 add_watcher() i=4 2024-09-12T00:43:16.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.017+0000 7f25adcc79c0 20 add_watcher() i=5 2024-09-12T00:43:16.022 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.017+0000 7f25adcc79c0 20 add_watcher() i=6 2024-09-12T00:43:16.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.021+0000 7f25adcc79c0 20 add_watcher() i=7 2024-09-12T00:43:16.023 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.021+0000 7f25adcc79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:16.027 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.025+0000 7f2461fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:16.028 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.025+0000 7f25adcc79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:16.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.025+0000 7f25adcc79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:16.029 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.025+0000 7f25adcc79c0 5 note: GC not initialized 2024-09-12T00:43:16.030 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.025+0000 7f2460fe1640 20 reqs_thread_entry: start 2024-09-12T00:43:16.031 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.025+0000 7f25adcc79c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:16.031 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.025+0000 7f25adcc79c0 20 Filter name: none 2024-09-12T00:43:16.031 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.029+0000 7f23da7fc640 20 reqs_thread_entry: start 2024-09-12T00:43:16.031 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.029+0000 7f25adcc79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:16.031 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.029+0000 7f25adcc79c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:43:16.031 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.029+0000 7f25adcc79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:16.032 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.029+0000 7f25adcc79c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:43:16.032 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.029+0000 7f25adcc79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:16.034 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.033+0000 7f2461fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:16.038 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.037+0000 7f25adcc79c0 20 remove_watcher() i=0 2024-09-12T00:43:16.039 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.037+0000 7f25adcc79c0 2 removed watcher, disabling cache 2024-09-12T00:43:16.041 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.037+0000 7f25adcc79c0 20 remove_watcher() i=1 2024-09-12T00:43:16.045 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.041+0000 7f25adcc79c0 20 remove_watcher() i=2 2024-09-12T00:43:16.046 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.045+0000 7f25adcc79c0 20 remove_watcher() i=3 2024-09-12T00:43:16.048 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.045+0000 7f25adcc79c0 20 remove_watcher() i=4 2024-09-12T00:43:16.050 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.049+0000 7f25adcc79c0 20 remove_watcher() i=5 2024-09-12T00:43:16.052 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.049+0000 7f25adcc79c0 20 remove_watcher() i=6 2024-09-12T00:43:16.053 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.053+0000 7f25adcc79c0 20 remove_watcher() i=7 2024-09-12T00:43:16.072 INFO:tasks.workunit.client.0.smithi043.stderr:rados -p default.rgw.buckets.index setomapval .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-12T00:43:16.099 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:16.099 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:16.119 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T00:43:16.145 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:16.146 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:16.189 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.185+0000 7ff40f1679c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:16.191 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.189+0000 7ff40f1679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:16.191 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.189+0000 7ff40f1679c0 20 realm 2024-09-12T00:43:16.191 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.189+0000 7ff40f1679c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:16.191 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.189+0000 7ff40f1679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:16.191 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.189+0000 7ff40f1679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:16.191 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.189+0000 7ff40f1679c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:16.191 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.189+0000 7ff40f1679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:16.191 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.189+0000 7ff40f1679c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:16.193 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.189+0000 7ff40f1679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:16.193 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.189+0000 7ff40f1679c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:16.193 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.193+0000 7ff40f1679c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:16.193 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.193+0000 7ff40f1679c0 20 searching for the correct realm 2024-09-12T00:43:16.197 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.193+0000 7ff40c46c640 0 -- 172.21.15.43:0/405350216 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7ff4000b6040 msgr2=0x7ff4000d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:16.412 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.409+0000 7ff40cc6d640 0 -- 172.21.15.43:0/405350216 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7ff4000e63f0 msgr2=0x7ff4000e6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:16.630 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.629+0000 7ff40f1679c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:43:16.630 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.629+0000 7ff40f1679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:16.630 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.629+0000 7ff40f1679c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:16.630 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.629+0000 7ff40f1679c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:43:16.630 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.629+0000 7ff40f1679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:16.630 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.629+0000 7ff40f1679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:16.630 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.629+0000 7ff40f1679c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:16.631 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.629+0000 7ff40f1679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:16.631 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.629+0000 7ff40f1679c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:16.631 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.629+0000 7ff40f1679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:16.631 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.629+0000 7ff40f1679c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:16.632 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.629+0000 7ff40f1679c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:16.632 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.629+0000 7ff40f1679c0 20 zone default found 2024-09-12T00:43:16.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.629+0000 7ff40f1679c0 4 Realm: () 2024-09-12T00:43:16.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.629+0000 7ff40f1679c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:43:16.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.629+0000 7ff40f1679c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:43:16.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.629+0000 7ff40f1679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:16.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.629+0000 7ff40f1679c0 20 zonegroup default 2024-09-12T00:43:16.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.629+0000 7ff40f1679c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:16.633 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.629+0000 7ff40f1679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:16.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.629+0000 7ff40f1679c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:16.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.633+0000 7ff40f1679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:16.634 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.633+0000 7ff40f1679c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:16.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.633+0000 7ff40f1679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:16.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.633+0000 7ff40f1679c0 20 started sync module instance, tier type = 2024-09-12T00:43:16.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.633+0000 7ff40f1679c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:43:16.659 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.657+0000 7ff40f1679c0 20 add_watcher() i=0 2024-09-12T00:43:16.660 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.657+0000 7ff40f1679c0 20 add_watcher() i=1 2024-09-12T00:43:16.660 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.657+0000 7ff40f1679c0 20 add_watcher() i=2 2024-09-12T00:43:16.660 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.657+0000 7ff40f1679c0 20 add_watcher() i=3 2024-09-12T00:43:16.660 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.657+0000 7ff40f1679c0 20 add_watcher() i=4 2024-09-12T00:43:16.660 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.657+0000 7ff40f1679c0 20 add_watcher() i=5 2024-09-12T00:43:16.660 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.657+0000 7ff40f1679c0 20 add_watcher() i=6 2024-09-12T00:43:16.662 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.661+0000 7ff40f1679c0 20 add_watcher() i=7 2024-09-12T00:43:16.662 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.661+0000 7ff40f1679c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:16.666 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.665+0000 7ff2c2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:16.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.665+0000 7ff40f1679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:16.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.665+0000 7ff40f1679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:16.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.665+0000 7ff40f1679c0 5 note: GC not initialized 2024-09-12T00:43:16.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.665+0000 7ff2c1fe3640 20 reqs_thread_entry: start 2024-09-12T00:43:16.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.665+0000 7ff40f1679c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:16.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.665+0000 7ff40f1679c0 20 Filter name: none 2024-09-12T00:43:16.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.665+0000 7ff2337fe640 20 reqs_thread_entry: start 2024-09-12T00:43:16.669 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.665+0000 7ff40f1679c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:16.669 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.669+0000 7ff40f1679c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:43:16.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.669+0000 7ff40f1679c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:16.671 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.669+0000 7ff40f1679c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:43:16.671 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.669+0000 7ff40f1679c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:16.671 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.669+0000 7ff40f1679c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T00:43:16.671 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.669+0000 7ff40f1679c0 20 INFO: main: starting shard=0 2024-09-12T00:43:16.671 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.669+0000 7ff40f1679c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.0 2024-09-12T00:43:16.671 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.669+0000 7ff40f1679c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.0 2024-09-12T00:43:16.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.669+0000 7ff40f1679c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:43:16.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.669+0000 7ff40f1679c0 20 INFO: main: starting shard=1 2024-09-12T00:43:16.673 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.669+0000 7ff40f1679c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.1 2024-09-12T00:43:16.673 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.669+0000 7ff40f1679c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.1 2024-09-12T00:43:16.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.673+0000 7ff40f1679c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:16.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.673+0000 7ff40f1679c0 20 INFO: main: starting shard=2 2024-09-12T00:43:16.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.673+0000 7ff40f1679c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.2 2024-09-12T00:43:16.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.673+0000 7ff40f1679c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.2 2024-09-12T00:43:16.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.673+0000 7ff40f1679c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:16.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.673+0000 7ff40f1679c0 20 INFO: main: starting shard=3 2024-09-12T00:43:16.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.673+0000 7ff40f1679c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.3 2024-09-12T00:43:16.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.673+0000 7ff40f1679c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.3 2024-09-12T00:43:16.675 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.673+0000 7ff40f1679c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:16.675 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.673+0000 7ff40f1679c0 20 INFO: main: starting shard=4 2024-09-12T00:43:16.675 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.673+0000 7ff40f1679c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.4 2024-09-12T00:43:16.675 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.673+0000 7ff40f1679c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.4 2024-09-12T00:43:16.676 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.673+0000 7ff40f1679c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:16.676 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.673+0000 7ff40f1679c0 20 INFO: main: starting shard=5 2024-09-12T00:43:16.677 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.673+0000 7ff40f1679c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.5 2024-09-12T00:43:16.677 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.673+0000 7ff40f1679c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.5 2024-09-12T00:43:16.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.677+0000 7ff40f1679c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:16.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.677+0000 7ff40f1679c0 20 INFO: main: starting shard=6 2024-09-12T00:43:16.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.677+0000 7ff40f1679c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.6 2024-09-12T00:43:16.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.677+0000 7ff40f1679c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.6 2024-09-12T00:43:16.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.677+0000 7ff40f1679c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:16.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.677+0000 7ff40f1679c0 20 INFO: main: starting shard=7 2024-09-12T00:43:16.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.677+0000 7ff40f1679c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.7 2024-09-12T00:43:16.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.677+0000 7ff40f1679c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.7 2024-09-12T00:43:16.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.677+0000 7ff40f1679c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:16.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.677+0000 7ff40f1679c0 20 INFO: main: starting shard=8 2024-09-12T00:43:16.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.677+0000 7ff40f1679c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.8 2024-09-12T00:43:16.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.677+0000 7ff40f1679c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.8 2024-09-12T00:43:16.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.681+0000 7ff40f1679c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:16.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.681+0000 7ff40f1679c0 20 INFO: main: starting shard=9 2024-09-12T00:43:16.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.681+0000 7ff40f1679c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.9 2024-09-12T00:43:16.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.681+0000 7ff40f1679c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.9 2024-09-12T00:43:16.683 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.681+0000 7ff40f1679c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:16.684 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.681+0000 7ff40f1679c0 20 INFO: main: starting shard=10 2024-09-12T00:43:16.684 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.681+0000 7ff40f1679c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.10 2024-09-12T00:43:16.684 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.681+0000 7ff40f1679c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.10 2024-09-12T00:43:16.685 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.681+0000 7ff40f1679c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:16.685 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.681+0000 7ff40f1679c0 20 INFO: main: starting shard=11 2024-09-12T00:43:16.685 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.681+0000 7ff40f1679c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.11 2024-09-12T00:43:16.685 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.681+0000 7ff40f1679c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.11 2024-09-12T00:43:16.686 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.685+0000 7ff40f1679c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:16.686 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.685+0000 7ff40f1679c0 20 INFO: main: starting shard=12 2024-09-12T00:43:16.686 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.685+0000 7ff40f1679c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.12 2024-09-12T00:43:16.686 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.685+0000 7ff40f1679c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.12 2024-09-12T00:43:16.687 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.685+0000 7ff40f1679c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:16.687 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.685+0000 7ff40f1679c0 20 INFO: main: done 2024-09-12T00:43:16.689 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.685+0000 7ff2c2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:16.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.693+0000 7ff40f1679c0 20 remove_watcher() i=0 2024-09-12T00:43:16.694 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.693+0000 7ff40f1679c0 2 removed watcher, disabling cache 2024-09-12T00:43:16.696 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.693+0000 7ff40f1679c0 20 remove_watcher() i=1 2024-09-12T00:43:16.698 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.697+0000 7ff40f1679c0 20 remove_watcher() i=2 2024-09-12T00:43:16.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.697+0000 7ff40f1679c0 20 remove_watcher() i=3 2024-09-12T00:43:16.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.701+0000 7ff40f1679c0 20 remove_watcher() i=4 2024-09-12T00:43:16.706 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.705+0000 7ff40f1679c0 20 remove_watcher() i=5 2024-09-12T00:43:16.707 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.705+0000 7ff40f1679c0 20 remove_watcher() i=6 2024-09-12T00:43:16.709 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.705+0000 7ff40f1679c0 20 remove_watcher() i=7 2024-09-12T00:43:16.726 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-12T00:43:16.762 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:16.762 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:16.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.805+0000 7fe2db6319c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:16.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.805+0000 7fe2db6319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:16.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.805+0000 7fe2db6319c0 20 realm 2024-09-12T00:43:16.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.805+0000 7fe2db6319c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:16.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.805+0000 7fe2db6319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:16.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.805+0000 7fe2db6319c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:16.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.805+0000 7fe2db6319c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:16.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.805+0000 7fe2db6319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:16.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.805+0000 7fe2db6319c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:16.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.805+0000 7fe2db6319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:16.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.805+0000 7fe2db6319c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:16.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.809+0000 7fe2db6319c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:16.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.809+0000 7fe2db6319c0 20 searching for the correct realm 2024-09-12T00:43:16.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.813+0000 7fe2d9938640 0 -- 172.21.15.43:0/1500676097 >> [v2:172.21.15.43:6808/2258408181,v1:172.21.15.43:6809/2258408181] conn(0x55fab6344150 msgr2=0x55fab6346610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:16.824 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.821+0000 7fe2d9137640 0 -- 172.21.15.43:0/1500676097 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fe2d0072420 msgr2=0x7fe2d008e650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:16.830 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.829+0000 7fe2db6319c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:43:16.830 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.829+0000 7fe2db6319c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:16.830 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.829+0000 7fe2db6319c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:16.830 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.829+0000 7fe2db6319c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:43:16.830 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.829+0000 7fe2db6319c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:16.830 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.829+0000 7fe2db6319c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:16.830 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.829+0000 7fe2db6319c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:16.831 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.829+0000 7fe2db6319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:16.831 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.829+0000 7fe2db6319c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:16.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.829+0000 7fe2db6319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:16.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.829+0000 7fe2db6319c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:16.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.829+0000 7fe2db6319c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:16.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.829+0000 7fe2db6319c0 20 zone default found 2024-09-12T00:43:16.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.829+0000 7fe2db6319c0 4 Realm: () 2024-09-12T00:43:16.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.829+0000 7fe2db6319c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:43:16.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.829+0000 7fe2db6319c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:43:16.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.829+0000 7fe2db6319c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:16.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.829+0000 7fe2db6319c0 20 zonegroup default 2024-09-12T00:43:16.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.829+0000 7fe2db6319c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:16.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.829+0000 7fe2db6319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:16.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.829+0000 7fe2db6319c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:16.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.829+0000 7fe2db6319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:16.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.829+0000 7fe2db6319c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:16.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.829+0000 7fe2db6319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:16.833 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.829+0000 7fe2db6319c0 20 started sync module instance, tier type = 2024-09-12T00:43:16.834 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.829+0000 7fe2db6319c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:43:16.848 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.845+0000 7fe2db6319c0 20 add_watcher() i=0 2024-09-12T00:43:16.848 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.845+0000 7fe2db6319c0 20 add_watcher() i=1 2024-09-12T00:43:16.848 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.845+0000 7fe2db6319c0 20 add_watcher() i=2 2024-09-12T00:43:16.848 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.845+0000 7fe2db6319c0 20 add_watcher() i=3 2024-09-12T00:43:16.848 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.845+0000 7fe2db6319c0 20 add_watcher() i=4 2024-09-12T00:43:16.848 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.845+0000 7fe2db6319c0 20 add_watcher() i=5 2024-09-12T00:43:16.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.845+0000 7fe2db6319c0 20 add_watcher() i=6 2024-09-12T00:43:16.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.845+0000 7fe2db6319c0 20 add_watcher() i=7 2024-09-12T00:43:16.849 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.845+0000 7fe2db6319c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:16.851 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.849+0000 7fe18ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:16.852 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.849+0000 7fe2db6319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:16.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.849+0000 7fe2db6319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:16.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.849+0000 7fe2db6319c0 5 note: GC not initialized 2024-09-12T00:43:16.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.849+0000 7fe18efe5640 20 reqs_thread_entry: start 2024-09-12T00:43:16.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.849+0000 7fe2db6319c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:16.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.849+0000 7fe2db6319c0 20 Filter name: none 2024-09-12T00:43:16.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.849+0000 7fe18cfe1640 20 reqs_thread_entry: start 2024-09-12T00:43:16.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.849+0000 7fe2db6319c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:43:16.853 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.849+0000 7fe2db6319c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:16.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.853+0000 7fe2db6319c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:43:16.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.853+0000 7fe2db6319c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:43:16.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.853+0000 7fe2db6319c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:43:16.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.853+0000 7fe2db6319c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 : miss 2024-09-12T00:43:16.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.853+0000 7fe2db6319c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:16.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.853+0000 7fe2db6319c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:43:16.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.853+0000 7fe2db6319c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:43:16.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.853+0000 7fe2db6319c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:43:16.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.853+0000 7fe2db6319c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:16.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.853+0000 7fe2db6319c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:16.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.853+0000 7fe2db6319c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 2024-09-12T00:43:16.862 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.861+0000 7fe2db6319c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:43:16.862 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.861+0000 7fe2db6319c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:43:16.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.861+0000 7fe2db6319c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:16.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.861+0000 7fe2db6319c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17, ofs0, ns] 2024-09-12T00:43:16.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.861+0000 7fe1abfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333535 cookie 94535287089760 notifier 8066 bl.length()=827 2024-09-12T00:43:16.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.861+0000 7fe1abfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:43:16.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.861+0000 7fe1abfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:43:16.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.861+0000 7fe1abfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:16.864 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.861+0000 7fe2db6319c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_sources= new_sources= 2024-09-12T00:43:16.864 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.861+0000 7fe2db6319c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential sources added=[] removed=[] 2024-09-12T00:43:16.864 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.861+0000 7fe2db6319c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_dests= new_dests= 2024-09-12T00:43:16.864 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.861+0000 7fe2db6319c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential dests added=[] removed=[] 2024-09-12T00:43:16.876 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.873+0000 7fe2db6319c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.0 2024-09-12T00:43:16.876 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.873+0000 7fe2db6319c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.0 2024-09-12T00:43:16.876 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.873+0000 7fe2db6319c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.0 2024-09-12T00:43:16.876 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.873+0000 7fe2db6319c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.0 2024-09-12T00:43:16.878 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.877+0000 7fe2db6319c0 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-12T00:43:16.878 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.877+0000 7fe2db6319c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.1 2024-09-12T00:43:16.878 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.877+0000 7fe2db6319c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.1 2024-09-12T00:43:16.879 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.877+0000 7fe2db6319c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.2 2024-09-12T00:43:16.879 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.877+0000 7fe2db6319c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.2 2024-09-12T00:43:16.879 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.877+0000 7fe2db6319c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.3 2024-09-12T00:43:16.879 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.877+0000 7fe2db6319c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.3 2024-09-12T00:43:16.880 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.877+0000 7fe2db6319c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.4 2024-09-12T00:43:16.880 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.877+0000 7fe2db6319c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.4 2024-09-12T00:43:16.881 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.877+0000 7fe2db6319c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.5 2024-09-12T00:43:16.881 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.877+0000 7fe2db6319c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.5 2024-09-12T00:43:16.882 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.881+0000 7fe2db6319c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.6 2024-09-12T00:43:16.882 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.881+0000 7fe2db6319c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.6 2024-09-12T00:43:16.883 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.881+0000 7fe2db6319c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.7 2024-09-12T00:43:16.883 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.881+0000 7fe2db6319c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.7 2024-09-12T00:43:16.885 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.881+0000 7fe2db6319c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.8 2024-09-12T00:43:16.885 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.881+0000 7fe2db6319c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.8 2024-09-12T00:43:16.886 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.885+0000 7fe2db6319c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.9 2024-09-12T00:43:16.886 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.885+0000 7fe2db6319c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.9 2024-09-12T00:43:16.886 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.885+0000 7fe2db6319c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.10 2024-09-12T00:43:16.886 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.885+0000 7fe2db6319c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.10 2024-09-12T00:43:16.887 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.885+0000 7fe2db6319c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.11 2024-09-12T00:43:16.887 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.885+0000 7fe2db6319c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.11 2024-09-12T00:43:16.888 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.885+0000 7fe2db6319c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.12 2024-09-12T00:43:16.888 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.885+0000 7fe2db6319c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.12 2024-09-12T00:43:16.889 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.889+0000 7fe2db6319c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:43:16.889 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.889+0000 7fe2db6319c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 2024-09-12T00:43:16.892 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.889+0000 7fe2db6319c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:43:16.892 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.889+0000 7fe2db6319c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:43:16.892 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.889+0000 7fe2db6319c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:16.892 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.889+0000 7fe2db6319c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17, ofs0, ns] 2024-09-12T00:43:16.893 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.889+0000 7fe1abfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333536 cookie 94535287089760 notifier 8066 bl.length()=827 2024-09-12T00:43:16.893 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.889+0000 7fe1abfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:43:16.893 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.889+0000 7fe1abfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:43:16.893 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.889+0000 7fe1abfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:16.893 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.893+0000 7fe2db6319c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_sources= new_sources= 2024-09-12T00:43:16.893 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.893+0000 7fe2db6319c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential sources added=[] removed=[] 2024-09-12T00:43:16.894 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.893+0000 7fe2db6319c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_dests= new_dests= 2024-09-12T00:43:16.894 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.893+0000 7fe2db6319c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential dests added=[] removed=[] 2024-09-12T00:43:16.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.897+0000 7fe2db6319c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.0 2024-09-12T00:43:16.901 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.897+0000 7fe2db6319c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.0 2024-09-12T00:43:16.902 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.901+0000 7fe2db6319c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.1 2024-09-12T00:43:16.902 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.901+0000 7fe2db6319c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.1 2024-09-12T00:43:16.903 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.901+0000 7fe2db6319c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.2 2024-09-12T00:43:16.903 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.901+0000 7fe2db6319c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.2 2024-09-12T00:43:16.904 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.901+0000 7fe2db6319c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.3 2024-09-12T00:43:16.904 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.901+0000 7fe2db6319c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.3 2024-09-12T00:43:16.904 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.901+0000 7fe2db6319c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.4 2024-09-12T00:43:16.904 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.901+0000 7fe2db6319c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.4 2024-09-12T00:43:16.905 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.901+0000 7fe2db6319c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.5 2024-09-12T00:43:16.905 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.901+0000 7fe2db6319c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.5 2024-09-12T00:43:16.906 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.905+0000 7fe2db6319c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.6 2024-09-12T00:43:16.906 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.905+0000 7fe2db6319c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.6 2024-09-12T00:43:16.907 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.905+0000 7fe2db6319c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.7 2024-09-12T00:43:16.907 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.905+0000 7fe2db6319c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.7 2024-09-12T00:43:16.908 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.905+0000 7fe2db6319c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.8 2024-09-12T00:43:16.908 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.905+0000 7fe2db6319c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.8 2024-09-12T00:43:16.909 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.905+0000 7fe2db6319c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.9 2024-09-12T00:43:16.909 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.905+0000 7fe2db6319c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.9 2024-09-12T00:43:16.909 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.909+0000 7fe2db6319c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.10 2024-09-12T00:43:16.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.909+0000 7fe2db6319c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.10 2024-09-12T00:43:16.910 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.909+0000 7fe2db6319c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.11 2024-09-12T00:43:16.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.909+0000 7fe2db6319c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.11 2024-09-12T00:43:16.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.909+0000 7fe2db6319c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.12 2024-09-12T00:43:16.911 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.909+0000 7fe2db6319c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.2.12 2024-09-12T00:43:16.912 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.909+0000 7fe2db6319c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:43:16.912 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.909+0000 7fe2db6319c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 2024-09-12T00:43:16.915 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.913+0000 7fe2db6319c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:43:16.915 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.913+0000 7fe2db6319c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:43:16.915 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.913+0000 7fe2db6319c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:16.915 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.913+0000 7fe2db6319c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17, ofs0, ns] 2024-09-12T00:43:16.916 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.913+0000 7fe1abfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333537 cookie 94535287089760 notifier 8066 bl.length()=795 2024-09-12T00:43:16.916 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.913+0000 7fe1abfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 info.flags=0x17 2024-09-12T00:43:16.916 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.913+0000 7fe1abfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17 to cache LRU end 2024-09-12T00:43:16.916 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.913+0000 7fe1abfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:16.916 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.913+0000 7fe2db6319c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_sources= new_sources= 2024-09-12T00:43:16.916 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.913+0000 7fe2db6319c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential sources added=[] removed=[] 2024-09-12T00:43:16.916 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.913+0000 7fe2db6319c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): orig_dests= new_dests= 2024-09-12T00:43:16.917 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.913+0000 7fe2db6319c0 20 handle_bi_update(): bucket=:a-bucket[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17]): potential dests added=[] removed=[] 2024-09-12T00:43:16.923 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.921+0000 7fe2db6319c0 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-09-12T00:43:16.928 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.925+0000 7fe18ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:16.932 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.929+0000 7fe2db6319c0 20 remove_watcher() i=0 2024-09-12T00:43:16.932 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.929+0000 7fe2db6319c0 2 removed watcher, disabling cache 2024-09-12T00:43:16.934 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.933+0000 7fe2db6319c0 20 remove_watcher() i=1 2024-09-12T00:43:16.937 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.933+0000 7fe2db6319c0 20 remove_watcher() i=2 2024-09-12T00:43:16.940 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.937+0000 7fe2db6319c0 20 remove_watcher() i=3 2024-09-12T00:43:16.943 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.941+0000 7fe2db6319c0 20 remove_watcher() i=4 2024-09-12T00:43:16.945 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.941+0000 7fe2db6319c0 20 remove_watcher() i=5 2024-09-12T00:43:16.946 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.945+0000 7fe2db6319c0 20 remove_watcher() i=6 2024-09-12T00:43:16.948 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:16.945+0000 7fe2db6319c0 20 remove_watcher() i=7 2024-09-12T00:43:16.965 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T00:43:16.997 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:16.997 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:17.042 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.041+0000 7f766eac79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.041+0000 7f766eac79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:17.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.041+0000 7f766eac79c0 20 realm 2024-09-12T00:43:17.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.041+0000 7f766eac79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.044 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.041+0000 7f766eac79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:17.045 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.041+0000 7f766eac79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:17.045 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.041+0000 7f766eac79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.045 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.041+0000 7f766eac79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:17.045 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.041+0000 7f766eac79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.046 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.045+0000 7f766eac79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:17.046 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.045+0000 7f766eac79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.047 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.045+0000 7f766eac79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:17.047 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.045+0000 7f766eac79c0 20 searching for the correct realm 2024-09-12T00:43:17.052 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.049+0000 7f766cdce640 0 -- 172.21.15.43:0/1965866448 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55924ec81d00 msgr2=0x55924ec84130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:17.059 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.057+0000 7f766bdcc640 0 -- 172.21.15.43:0/1965866448 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f7660083c20 msgr2=0x7f766009dac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:17.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.065+0000 7f766eac79c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:43:17.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.065+0000 7f766eac79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:17.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.065+0000 7f766eac79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:17.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.065+0000 7f766eac79c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:43:17.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.065+0000 7f766eac79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:17.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.065+0000 7f766eac79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:17.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.065+0000 7f766eac79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.065+0000 7f766eac79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:17.067 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.065+0000 7f766eac79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.068 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.065+0000 7f766eac79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:17.068 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.065+0000 7f766eac79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.065+0000 7f766eac79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:17.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.065+0000 7f766eac79c0 20 zone default found 2024-09-12T00:43:17.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.065+0000 7f766eac79c0 4 Realm: () 2024-09-12T00:43:17.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.065+0000 7f766eac79c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:43:17.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.065+0000 7f766eac79c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:43:17.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.065+0000 7f766eac79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:17.069 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.065+0000 7f766eac79c0 20 zonegroup default 2024-09-12T00:43:17.070 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.065+0000 7f766eac79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.070 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.065+0000 7f766eac79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:17.070 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.065+0000 7f766eac79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.070 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.069+0000 7f766eac79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:17.070 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.069+0000 7f766eac79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.070 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.069+0000 7f766eac79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:17.070 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.069+0000 7f766eac79c0 20 started sync module instance, tier type = 2024-09-12T00:43:17.071 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.069+0000 7f766eac79c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:43:17.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.081+0000 7f766eac79c0 20 add_watcher() i=0 2024-09-12T00:43:17.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.081+0000 7f766eac79c0 20 add_watcher() i=1 2024-09-12T00:43:17.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.081+0000 7f766eac79c0 20 add_watcher() i=2 2024-09-12T00:43:17.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.081+0000 7f766eac79c0 20 add_watcher() i=3 2024-09-12T00:43:17.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.081+0000 7f766eac79c0 20 add_watcher() i=4 2024-09-12T00:43:17.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.081+0000 7f766eac79c0 20 add_watcher() i=5 2024-09-12T00:43:17.085 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.081+0000 7f766eac79c0 20 add_watcher() i=6 2024-09-12T00:43:17.086 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.085+0000 7f766eac79c0 20 add_watcher() i=7 2024-09-12T00:43:17.086 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.085+0000 7f766eac79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:17.088 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.085+0000 7f7522fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:17.089 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.085+0000 7f766eac79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:17.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.085+0000 7f766eac79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:17.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.085+0000 7f766eac79c0 5 note: GC not initialized 2024-09-12T00:43:17.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.089+0000 7f7521fdb640 20 reqs_thread_entry: start 2024-09-12T00:43:17.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.089+0000 7f766eac79c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:17.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.089+0000 7f766eac79c0 20 Filter name: none 2024-09-12T00:43:17.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.089+0000 7f74937fe640 20 reqs_thread_entry: start 2024-09-12T00:43:17.090 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.089+0000 7f766eac79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.089+0000 7f766eac79c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:43:17.091 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.089+0000 7f766eac79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.092 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.089+0000 7f766eac79c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:43:17.092 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.089+0000 7f766eac79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:17.092 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.089+0000 7f766eac79c0 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-12T00:43:17.092 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.089+0000 7f766eac79c0 20 INFO: main: starting shard=0 2024-09-12T00:43:17.092 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.089+0000 7f766eac79c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.0 2024-09-12T00:43:17.092 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.089+0000 7f766eac79c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17.3.0 2024-09-12T00:43:17.093 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.093+0000 7f766eac79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:17.093 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.093+0000 7f766eac79c0 20 INFO: main: done 2024-09-12T00:43:17.094 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.093+0000 7f7522fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:17.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.109+0000 7f766eac79c0 20 remove_watcher() i=0 2024-09-12T00:43:17.112 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.109+0000 7f766eac79c0 2 removed watcher, disabling cache 2024-09-12T00:43:17.114 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.113+0000 7f766eac79c0 20 remove_watcher() i=1 2024-09-12T00:43:17.117 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.113+0000 7f766eac79c0 20 remove_watcher() i=2 2024-09-12T00:43:17.119 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.117+0000 7f766eac79c0 20 remove_watcher() i=3 2024-09-12T00:43:17.121 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.117+0000 7f766eac79c0 20 remove_watcher() i=4 2024-09-12T00:43:17.122 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.121+0000 7f766eac79c0 20 remove_watcher() i=5 2024-09-12T00:43:17.123 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.121+0000 7f766eac79c0 20 remove_watcher() i=6 2024-09-12T00:43:17.125 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.121+0000 7f766eac79c0 20 remove_watcher() i=7 2024-09-12T00:43:17.139 INFO:tasks.workunit.client.0.smithi043.stderr: test: PUT succeeds during reshard 2024-09-12T00:43:17.140 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:43:17.166 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:17.166 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:17.209 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.205+0000 7efc6bec19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.209+0000 7efc6bec19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:17.210 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.209+0000 7efc6bec19c0 20 realm 2024-09-12T00:43:17.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.209+0000 7efc6bec19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.209+0000 7efc6bec19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:17.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.209+0000 7efc6bec19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:17.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.209+0000 7efc6bec19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.209+0000 7efc6bec19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:17.211 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.209+0000 7efc6bec19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.212 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.209+0000 7efc6bec19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:17.213 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.209+0000 7efc6bec19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.213 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.213+0000 7efc6bec19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:17.213 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.213+0000 7efc6bec19c0 20 searching for the correct realm 2024-09-12T00:43:17.219 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.217+0000 7efc6a1c8640 0 -- 172.21.15.43:0/941777021 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x5643aeb02250 msgr2=0x5643aeb046b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:17.225 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.221+0000 7efc699c7640 0 -- 172.21.15.43:0/941777021 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7efc6008a930 msgr2=0x7efc60045f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:17.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.229+0000 7efc6bec19c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:43:17.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.229+0000 7efc6bec19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:17.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.229+0000 7efc6bec19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:17.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.229+0000 7efc6bec19c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:43:17.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.229+0000 7efc6bec19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:17.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.229+0000 7efc6bec19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:17.233 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.229+0000 7efc6bec19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.233+0000 7efc6bec19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:17.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.233+0000 7efc6bec19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.233+0000 7efc6bec19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:17.234 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.233+0000 7efc6bec19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.235 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.233+0000 7efc6bec19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:17.235 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.233+0000 7efc6bec19c0 20 zone default found 2024-09-12T00:43:17.235 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.233+0000 7efc6bec19c0 4 Realm: () 2024-09-12T00:43:17.235 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.233+0000 7efc6bec19c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:43:17.235 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.233+0000 7efc6bec19c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:43:17.235 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.233+0000 7efc6bec19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:17.235 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.233+0000 7efc6bec19c0 20 zonegroup default 2024-09-12T00:43:17.235 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.233+0000 7efc6bec19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.235 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.233+0000 7efc6bec19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:17.235 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.233+0000 7efc6bec19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.233+0000 7efc6bec19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:17.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.233+0000 7efc6bec19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.233+0000 7efc6bec19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:17.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.233+0000 7efc6bec19c0 20 started sync module instance, tier type = 2024-09-12T00:43:17.236 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.233+0000 7efc6bec19c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:43:17.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.249+0000 7efc6bec19c0 20 add_watcher() i=0 2024-09-12T00:43:17.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.249+0000 7efc6bec19c0 20 add_watcher() i=1 2024-09-12T00:43:17.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.249+0000 7efc6bec19c0 20 add_watcher() i=2 2024-09-12T00:43:17.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.249+0000 7efc6bec19c0 20 add_watcher() i=3 2024-09-12T00:43:17.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.249+0000 7efc6bec19c0 20 add_watcher() i=4 2024-09-12T00:43:17.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.249+0000 7efc6bec19c0 20 add_watcher() i=5 2024-09-12T00:43:17.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.249+0000 7efc6bec19c0 20 add_watcher() i=6 2024-09-12T00:43:17.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.249+0000 7efc6bec19c0 20 add_watcher() i=7 2024-09-12T00:43:17.253 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.249+0000 7efc6bec19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:17.255 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.253+0000 7efb1b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:17.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.253+0000 7efc6bec19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:17.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.253+0000 7efc6bec19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:17.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.253+0000 7efc6bec19c0 5 note: GC not initialized 2024-09-12T00:43:17.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.253+0000 7efb1a7fc640 20 reqs_thread_entry: start 2024-09-12T00:43:17.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.253+0000 7efc6bec19c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:17.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.253+0000 7efc6bec19c0 20 Filter name: none 2024-09-12T00:43:17.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.253+0000 7efa8bfff640 20 reqs_thread_entry: start 2024-09-12T00:43:17.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.253+0000 7efc6bec19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.256 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.253+0000 7efc6bec19c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:43:17.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.253+0000 7efc6bec19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.257+0000 7efc6bec19c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:43:17.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.257+0000 7efc6bec19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:17.257 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.257+0000 7efc6bec19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.257+0000 7efc6bec19c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:43:17.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.257+0000 7efc6bec19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.257+0000 7efc6bec19c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:43:17.258 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.257+0000 7efc6bec19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:17.261 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.257+0000 7efb1b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:17.266 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.265+0000 7efc6bec19c0 20 remove_watcher() i=0 2024-09-12T00:43:17.266 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.265+0000 7efc6bec19c0 2 removed watcher, disabling cache 2024-09-12T00:43:17.268 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.265+0000 7efc6bec19c0 20 remove_watcher() i=1 2024-09-12T00:43:17.270 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.269+0000 7efc6bec19c0 20 remove_watcher() i=2 2024-09-12T00:43:17.272 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.269+0000 7efc6bec19c0 20 remove_watcher() i=3 2024-09-12T00:43:17.274 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.273+0000 7efc6bec19c0 20 remove_watcher() i=4 2024-09-12T00:43:17.275 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.273+0000 7efc6bec19c0 20 remove_watcher() i=5 2024-09-12T00:43:17.277 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.273+0000 7efc6bec19c0 20 remove_watcher() i=6 2024-09-12T00:43:17.278 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.277+0000 7efc6bec19c0 20 remove_watcher() i=7 2024-09-12T00:43:17.292 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:43:17.292 INFO:tasks.workunit.client.0.smithi043.stderr:BUCKET_STATS: 2024-09-12T00:43:17.292 INFO:tasks.workunit.client.0.smithi043.stderr:bucket: myver id: af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T00:43:17.292 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:43:17.292 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-09-12T00:43:17.323 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:17.323 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:17.365 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.361+0000 7f8b2c1439c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.365+0000 7f8b2c1439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:17.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.365+0000 7f8b2c1439c0 20 realm 2024-09-12T00:43:17.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.365+0000 7f8b2c1439c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.365+0000 7f8b2c1439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:17.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.365+0000 7f8b2c1439c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:17.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.365+0000 7f8b2c1439c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.365+0000 7f8b2c1439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:17.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.365+0000 7f8b2c1439c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.369 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.365+0000 7f8b2c1439c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:17.369 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.365+0000 7f8b2c1439c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.369+0000 7f8b2c1439c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:17.370 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.369+0000 7f8b2c1439c0 20 searching for the correct realm 2024-09-12T00:43:17.376 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.373+0000 7f8b2a44a640 0 -- 172.21.15.43:0/1594871293 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f8b200da920 msgr2=0x7f8b200e93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:17.592 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.589+0000 7f8b29c49640 0 -- 172.21.15.43:0/1594871293 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x55f918824ff0 msgr2=0x55f9188273e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:17.600 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.597+0000 7f8b2c1439c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:43:17.600 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.597+0000 7f8b2c1439c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:17.600 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.597+0000 7f8b2c1439c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:17.600 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.597+0000 7f8b2c1439c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:43:17.600 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.597+0000 7f8b2c1439c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:17.600 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.597+0000 7f8b2c1439c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:17.600 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.597+0000 7f8b2c1439c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.601 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.597+0000 7f8b2c1439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:17.601 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.597+0000 7f8b2c1439c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.601 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.601+0000 7f8b2c1439c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:17.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.601+0000 7f8b2c1439c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.601+0000 7f8b2c1439c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:17.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.601+0000 7f8b2c1439c0 20 zone default found 2024-09-12T00:43:17.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.601+0000 7f8b2c1439c0 4 Realm: () 2024-09-12T00:43:17.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.601+0000 7f8b2c1439c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:43:17.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.601+0000 7f8b2c1439c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:43:17.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.601+0000 7f8b2c1439c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:17.603 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.601+0000 7f8b2c1439c0 20 zonegroup default 2024-09-12T00:43:17.603 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.601+0000 7f8b2c1439c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.603 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.601+0000 7f8b2c1439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:17.603 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.601+0000 7f8b2c1439c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.601+0000 7f8b2c1439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:17.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.601+0000 7f8b2c1439c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.601+0000 7f8b2c1439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:17.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.601+0000 7f8b2c1439c0 20 started sync module instance, tier type = 2024-09-12T00:43:17.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.601+0000 7f8b2c1439c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:43:17.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.625+0000 7f8b2c1439c0 20 add_watcher() i=0 2024-09-12T00:43:17.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.625+0000 7f8b2c1439c0 20 add_watcher() i=1 2024-09-12T00:43:17.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.625+0000 7f8b2c1439c0 20 add_watcher() i=2 2024-09-12T00:43:17.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.625+0000 7f8b2c1439c0 20 add_watcher() i=3 2024-09-12T00:43:17.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.625+0000 7f8b2c1439c0 20 add_watcher() i=4 2024-09-12T00:43:17.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.625+0000 7f8b2c1439c0 20 add_watcher() i=5 2024-09-12T00:43:17.629 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.625+0000 7f8b2c1439c0 20 add_watcher() i=6 2024-09-12T00:43:17.631 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.629+0000 7f8b2c1439c0 20 add_watcher() i=7 2024-09-12T00:43:17.631 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.629+0000 7f8b2c1439c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:17.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.633+0000 7f89db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:17.635 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.633+0000 7f8b2c1439c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:17.636 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.633+0000 7f8b2c1439c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:17.636 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.633+0000 7f8b2c1439c0 5 note: GC not initialized 2024-09-12T00:43:17.636 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.633+0000 7f89da7fc640 20 reqs_thread_entry: start 2024-09-12T00:43:17.636 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.633+0000 7f8b2c1439c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:17.637 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.633+0000 7f8b2c1439c0 20 Filter name: none 2024-09-12T00:43:17.637 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.633+0000 7f894bfff640 20 reqs_thread_entry: start 2024-09-12T00:43:17.637 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.633+0000 7f8b2c1439c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:43:17.637 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.633+0000 7f8b2c1439c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.637 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.633+0000 7f8b2c1439c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:43:17.637 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.633+0000 7f8b2c1439c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:43:17.637 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.633+0000 7f8b2c1439c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:43:17.637 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.633+0000 7f8b2c1439c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 : miss 2024-09-12T00:43:17.638 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.633+0000 7f8b2c1439c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:17.640 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.637+0000 7f8b2c1439c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:43:17.640 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.637+0000 7f8b2c1439c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 info.flags=0x17 2024-09-12T00:43:17.640 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.637+0000 7f8b2c1439c0 10 adding default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 to cache LRU end 2024-09-12T00:43:17.640 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.637+0000 7f8b2c1439c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:17.640 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.637+0000 7f8b2c1439c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:17.641 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.637+0000 7f8b2c1439c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 2024-09-12T00:43:17.651 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.649+0000 7f8b2c1439c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 info.flags=0x17 2024-09-12T00:43:17.651 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.649+0000 7f8b2c1439c0 10 moving default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 to cache LRU end 2024-09-12T00:43:17.651 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.649+0000 7f8b2c1439c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:17.651 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.649+0000 7f8b2c1439c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18, ofs0, ns] 2024-09-12T00:43:17.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.649+0000 7f8a0d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333538 cookie 94528346462352 notifier 8120 bl.length()=821 2024-09-12T00:43:17.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.649+0000 7f8a0d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 info.flags=0x17 2024-09-12T00:43:17.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.649+0000 7f8a0d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 to cache LRU end 2024-09-12T00:43:17.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.649+0000 7f8a0d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:17.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.649+0000 7f8b2c1439c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): orig_sources= new_sources= 2024-09-12T00:43:17.652 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.649+0000 7f8b2c1439c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): potential sources added=[] removed=[] 2024-09-12T00:43:17.653 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.649+0000 7f8b2c1439c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): orig_dests= new_dests= 2024-09-12T00:43:17.653 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.649+0000 7f8b2c1439c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): potential dests added=[] removed=[] 2024-09-12T00:43:17.666 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:17.665+0000 7f8b2c1439c0 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-12T00:43:18.297 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:18.297 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:43:18.331 INFO:tasks.workunit.client.0.smithi043.stderr:put object successful 2024-09-12T00:43:22.666 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.0 2024-09-12T00:43:22.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.0 2024-09-12T00:43:22.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.1 2024-09-12T00:43:22.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.1 2024-09-12T00:43:22.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.2 2024-09-12T00:43:22.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.2 2024-09-12T00:43:22.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.3 2024-09-12T00:43:22.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.3 2024-09-12T00:43:22.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.4 2024-09-12T00:43:22.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.4 2024-09-12T00:43:22.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.5 2024-09-12T00:43:22.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.5 2024-09-12T00:43:22.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.6 2024-09-12T00:43:22.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.6 2024-09-12T00:43:22.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.7 2024-09-12T00:43:22.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.7 2024-09-12T00:43:22.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.8 2024-09-12T00:43:22.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.8 2024-09-12T00:43:22.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.9 2024-09-12T00:43:22.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.9 2024-09-12T00:43:22.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.10 2024-09-12T00:43:22.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.10 2024-09-12T00:43:22.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.11 2024-09-12T00:43:22.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.11 2024-09-12T00:43:22.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.12 2024-09-12T00:43:22.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.12 2024-09-12T00:43:22.668 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.0 2024-09-12T00:43:22.669 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.0 2024-09-12T00:43:22.669 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.1 2024-09-12T00:43:22.669 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.1 2024-09-12T00:43:22.669 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.2 2024-09-12T00:43:22.669 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.665+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.2 2024-09-12T00:43:22.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.669+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.3 2024-09-12T00:43:22.670 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.669+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.3 2024-09-12T00:43:22.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.669+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.4 2024-09-12T00:43:22.672 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.669+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.4 2024-09-12T00:43:22.673 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.673+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.5 2024-09-12T00:43:22.673 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.673+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.5 2024-09-12T00:43:22.675 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.673+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.6 2024-09-12T00:43:22.675 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.673+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.6 2024-09-12T00:43:22.676 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.673+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.7 2024-09-12T00:43:22.676 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.673+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.7 2024-09-12T00:43:22.677 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.677+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.8 2024-09-12T00:43:22.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.677+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.8 2024-09-12T00:43:22.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.677+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.9 2024-09-12T00:43:22.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.677+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.9 2024-09-12T00:43:22.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.677+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.10 2024-09-12T00:43:22.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.677+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.10 2024-09-12T00:43:22.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.681+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.11 2024-09-12T00:43:22.681 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.681+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.11 2024-09-12T00:43:22.686 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.685+0000 7f8b2c1439c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:43:22.686 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.685+0000 7f8b2c1439c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 2024-09-12T00:43:22.690 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.689+0000 7f8b2c1439c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 info.flags=0x17 2024-09-12T00:43:22.691 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.689+0000 7f8b2c1439c0 10 moving default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 to cache LRU end 2024-09-12T00:43:22.691 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.689+0000 7f8b2c1439c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:22.691 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.689+0000 7f8b2c1439c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18, ofs0, ns] 2024-09-12T00:43:22.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.689+0000 7f8a0d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333539 cookie 94528346462352 notifier 8120 bl.length()=821 2024-09-12T00:43:22.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.689+0000 7f8a0d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 info.flags=0x17 2024-09-12T00:43:22.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.689+0000 7f8a0d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 to cache LRU end 2024-09-12T00:43:22.692 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.689+0000 7f8a0d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:22.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.689+0000 7f8b2c1439c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): orig_sources= new_sources= 2024-09-12T00:43:22.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.689+0000 7f8b2c1439c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): potential sources added=[] removed=[] 2024-09-12T00:43:22.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.689+0000 7f8b2c1439c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): orig_dests= new_dests= 2024-09-12T00:43:22.693 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.689+0000 7f8b2c1439c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): potential dests added=[] removed=[] 2024-09-12T00:43:22.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.697+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.0 2024-09-12T00:43:22.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.697+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.0 2024-09-12T00:43:22.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.697+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.1 2024-09-12T00:43:22.700 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.697+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.1 2024-09-12T00:43:22.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.701+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.2 2024-09-12T00:43:22.701 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.701+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.2 2024-09-12T00:43:22.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.701+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.3 2024-09-12T00:43:22.702 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.701+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.3 2024-09-12T00:43:22.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.701+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.4 2024-09-12T00:43:22.703 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.701+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.4 2024-09-12T00:43:22.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.701+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.5 2024-09-12T00:43:22.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.701+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.5 2024-09-12T00:43:22.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.705+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.6 2024-09-12T00:43:22.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.705+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.6 2024-09-12T00:43:22.706 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.705+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.7 2024-09-12T00:43:22.706 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.705+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.7 2024-09-12T00:43:22.707 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.705+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.8 2024-09-12T00:43:22.707 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.705+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.8 2024-09-12T00:43:22.708 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.705+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.9 2024-09-12T00:43:22.708 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.705+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.9 2024-09-12T00:43:22.709 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.709+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.10 2024-09-12T00:43:22.709 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.709+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.10 2024-09-12T00:43:22.710 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.709+0000 7f8b2c1439c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.11 2024-09-12T00:43:22.710 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.709+0000 7f8b2c1439c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.1.11 2024-09-12T00:43:22.715 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.713+0000 7f8b2c1439c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:43:22.715 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.713+0000 7f8b2c1439c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 2024-09-12T00:43:22.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.717+0000 7f8b2c1439c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 info.flags=0x17 2024-09-12T00:43:22.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.717+0000 7f8b2c1439c0 10 moving default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 to cache LRU end 2024-09-12T00:43:22.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.717+0000 7f8b2c1439c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:22.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.717+0000 7f8b2c1439c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18, ofs0, ns] 2024-09-12T00:43:22.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.717+0000 7f8a0cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333540 cookie 94528346462352 notifier 8120 bl.length()=789 2024-09-12T00:43:22.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.717+0000 7f8a0cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 info.flags=0x17 2024-09-12T00:43:22.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.717+0000 7f8a0cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 to cache LRU end 2024-09-12T00:43:22.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.717+0000 7f8a0cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:22.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.717+0000 7f8b2c1439c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): orig_sources= new_sources= 2024-09-12T00:43:22.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.717+0000 7f8b2c1439c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): potential sources added=[] removed=[] 2024-09-12T00:43:22.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.717+0000 7f8b2c1439c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): orig_dests= new_dests= 2024-09-12T00:43:22.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.717+0000 7f8b2c1439c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): potential dests added=[] removed=[] 2024-09-12T00:43:22.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.725+0000 7f8b2c1439c0 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-09-12T00:43:22.732 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.729+0000 7f89db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:22.738 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.737+0000 7f8b2c1439c0 20 remove_watcher() i=0 2024-09-12T00:43:22.738 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.737+0000 7f8b2c1439c0 2 removed watcher, disabling cache 2024-09-12T00:43:22.740 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.737+0000 7f8b2c1439c0 20 remove_watcher() i=1 2024-09-12T00:43:22.743 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.741+0000 7f8b2c1439c0 20 remove_watcher() i=2 2024-09-12T00:43:22.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.745+0000 7f8b2c1439c0 20 remove_watcher() i=3 2024-09-12T00:43:22.748 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.745+0000 7f8b2c1439c0 20 remove_watcher() i=4 2024-09-12T00:43:22.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.749+0000 7f8b2c1439c0 20 remove_watcher() i=5 2024-09-12T00:43:22.753 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.749+0000 7f8b2c1439c0 20 remove_watcher() i=6 2024-09-12T00:43:22.755 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:22.753+0000 7f8b2c1439c0 20 remove_watcher() i=7 2024-09-12T00:43:23.337 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-12T00:43:23.337 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T00:43:23.342 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:23.342 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:43:23.353 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:23.353 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:43:23.402 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:23.402 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:43:23.441 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:23.441 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:43:23.451 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:23.451 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:43:23.483 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:23.483 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:43:23.492 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:23.493 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:43:23.527 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:23.527 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:43:23.533 INFO:tasks.workunit.client.0.smithi043.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:43:23.979 INFO:tasks.workunit.client.0.smithi043.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:43:25.429 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:25.430 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:43:25.498 INFO:tasks.workunit.client.0.smithi043.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:43:25.499 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-12T00:43:25.536 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:25.536 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:25.583 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.581+0000 7f9d880b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:25.584 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.581+0000 7f9d880b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:25.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.581+0000 7f9d880b79c0 20 realm 2024-09-12T00:43:25.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.581+0000 7f9d880b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:25.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.581+0000 7f9d880b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:25.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.581+0000 7f9d880b79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:25.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.581+0000 7f9d880b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:25.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.581+0000 7f9d880b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:25.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.581+0000 7f9d880b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:25.586 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.585+0000 7f9d880b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:25.587 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.585+0000 7f9d880b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:25.587 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.585+0000 7f9d880b79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:25.587 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.585+0000 7f9d880b79c0 20 searching for the correct realm 2024-09-12T00:43:25.592 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.589+0000 7f9d853bc640 0 -- 172.21.15.43:0/4056934980 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f9d7c0c0020 msgr2=0x7f9d7c009ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:25.599 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.597+0000 7f9d85bbd640 0 -- 172.21.15.43:0/4056934980 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f9d7c10bb40 msgr2=0x7f9d7c11d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:25.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.813+0000 7f9d880b79c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:43:25.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.813+0000 7f9d880b79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:25.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.813+0000 7f9d880b79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:25.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.813+0000 7f9d880b79c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:43:25.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.813+0000 7f9d880b79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:25.817 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.813+0000 7f9d880b79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:25.817 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.813+0000 7f9d880b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:25.817 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.813+0000 7f9d880b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:25.817 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.813+0000 7f9d880b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:25.817 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.817+0000 7f9d880b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:25.817 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.817+0000 7f9d880b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:25.818 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.817+0000 7f9d880b79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:25.818 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.817+0000 7f9d880b79c0 20 zone default found 2024-09-12T00:43:25.818 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.817+0000 7f9d880b79c0 4 Realm: () 2024-09-12T00:43:25.818 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.817+0000 7f9d880b79c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:43:25.819 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.817+0000 7f9d880b79c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:43:25.819 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.817+0000 7f9d880b79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:25.819 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.817+0000 7f9d880b79c0 20 zonegroup default 2024-09-12T00:43:25.819 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.817+0000 7f9d880b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:25.819 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.817+0000 7f9d880b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:25.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.817+0000 7f9d880b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:25.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.817+0000 7f9d880b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:25.820 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.817+0000 7f9d880b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:25.821 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.817+0000 7f9d880b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:25.821 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.817+0000 7f9d880b79c0 20 started sync module instance, tier type = 2024-09-12T00:43:25.821 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.817+0000 7f9d880b79c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:43:25.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.841+0000 7f9d880b79c0 20 add_watcher() i=0 2024-09-12T00:43:25.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.841+0000 7f9d880b79c0 20 add_watcher() i=1 2024-09-12T00:43:25.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.841+0000 7f9d880b79c0 20 add_watcher() i=2 2024-09-12T00:43:25.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.841+0000 7f9d880b79c0 20 add_watcher() i=3 2024-09-12T00:43:25.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.841+0000 7f9d880b79c0 20 add_watcher() i=4 2024-09-12T00:43:25.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.841+0000 7f9d880b79c0 20 add_watcher() i=5 2024-09-12T00:43:25.845 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.841+0000 7f9d880b79c0 20 add_watcher() i=6 2024-09-12T00:43:25.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.845+0000 7f9d880b79c0 20 add_watcher() i=7 2024-09-12T00:43:25.847 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.845+0000 7f9d880b79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:25.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.849+0000 7f9c377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:25.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.849+0000 7f9d880b79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:25.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.849+0000 7f9d880b79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:25.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.849+0000 7f9d880b79c0 5 note: GC not initialized 2024-09-12T00:43:25.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.849+0000 7f9c367fc640 20 reqs_thread_entry: start 2024-09-12T00:43:25.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.849+0000 7f9d880b79c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:25.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.849+0000 7f9d880b79c0 20 Filter name: none 2024-09-12T00:43:25.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.849+0000 7f9ba7fff640 20 reqs_thread_entry: start 2024-09-12T00:43:25.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.849+0000 7f9d880b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:25.854 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.853+0000 7f9d880b79c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:43:25.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.853+0000 7f9d880b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:25.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.853+0000 7f9d880b79c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:43:25.855 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.853+0000 7f9d880b79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:25.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.853+0000 7f9d880b79c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T00:43:25.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.853+0000 7f9d880b79c0 20 INFO: main: starting shard=0 2024-09-12T00:43:25.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.853+0000 7f9d880b79c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.0 2024-09-12T00:43:25.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.853+0000 7f9d880b79c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.0 2024-09-12T00:43:25.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.853+0000 7f9d880b79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:25.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.853+0000 7f9d880b79c0 20 INFO: main: starting shard=1 2024-09-12T00:43:25.856 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.853+0000 7f9d880b79c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.1 2024-09-12T00:43:25.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.853+0000 7f9d880b79c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.1 2024-09-12T00:43:25.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.853+0000 7f9d880b79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:25.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.853+0000 7f9d880b79c0 20 INFO: main: starting shard=2 2024-09-12T00:43:25.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.853+0000 7f9d880b79c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.2 2024-09-12T00:43:25.857 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.853+0000 7f9d880b79c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.2 2024-09-12T00:43:25.859 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.857+0000 7f9d880b79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:25.859 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.857+0000 7f9d880b79c0 20 INFO: main: starting shard=3 2024-09-12T00:43:25.859 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.857+0000 7f9d880b79c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.3 2024-09-12T00:43:25.859 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.857+0000 7f9d880b79c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.3 2024-09-12T00:43:25.860 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.857+0000 7f9d880b79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:25.860 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.857+0000 7f9d880b79c0 20 INFO: main: starting shard=4 2024-09-12T00:43:25.860 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.857+0000 7f9d880b79c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.4 2024-09-12T00:43:25.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.857+0000 7f9d880b79c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.4 2024-09-12T00:43:25.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.861+0000 7f9d880b79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:25.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.861+0000 7f9d880b79c0 20 INFO: main: starting shard=5 2024-09-12T00:43:25.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.861+0000 7f9d880b79c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.5 2024-09-12T00:43:25.861 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.861+0000 7f9d880b79c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.5 2024-09-12T00:43:25.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.861+0000 7f9d880b79c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:43:25.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.861+0000 7f9d880b79c0 20 INFO: main: starting shard=6 2024-09-12T00:43:25.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.861+0000 7f9d880b79c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.6 2024-09-12T00:43:25.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.861+0000 7f9d880b79c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.6 2024-09-12T00:43:25.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.861+0000 7f9d880b79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:25.863 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.861+0000 7f9d880b79c0 20 INFO: main: starting shard=7 2024-09-12T00:43:25.864 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.861+0000 7f9d880b79c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.7 2024-09-12T00:43:25.864 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.861+0000 7f9d880b79c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.7 2024-09-12T00:43:25.864 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.861+0000 7f9d880b79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:25.864 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.861+0000 7f9d880b79c0 20 INFO: main: starting shard=8 2024-09-12T00:43:25.864 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.861+0000 7f9d880b79c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.8 2024-09-12T00:43:25.864 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.861+0000 7f9d880b79c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.8 2024-09-12T00:43:25.865 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.865+0000 7f9d880b79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:25.865 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.865+0000 7f9d880b79c0 20 INFO: main: starting shard=9 2024-09-12T00:43:25.866 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.865+0000 7f9d880b79c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.9 2024-09-12T00:43:25.866 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.865+0000 7f9d880b79c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.9 2024-09-12T00:43:25.866 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.865+0000 7f9d880b79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:25.866 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.865+0000 7f9d880b79c0 20 INFO: main: starting shard=10 2024-09-12T00:43:25.866 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.865+0000 7f9d880b79c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.10 2024-09-12T00:43:25.866 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.865+0000 7f9d880b79c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.10 2024-09-12T00:43:25.867 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.865+0000 7f9d880b79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:25.867 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.865+0000 7f9d880b79c0 20 INFO: main: starting shard=11 2024-09-12T00:43:25.867 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.865+0000 7f9d880b79c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.11 2024-09-12T00:43:25.867 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.865+0000 7f9d880b79c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.11 2024-09-12T00:43:25.868 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.865+0000 7f9d880b79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:25.868 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.865+0000 7f9d880b79c0 20 INFO: main: starting shard=12 2024-09-12T00:43:25.868 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.865+0000 7f9d880b79c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.12 2024-09-12T00:43:25.868 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.865+0000 7f9d880b79c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.12 2024-09-12T00:43:25.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.865+0000 7f9d880b79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:25.869 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.865+0000 7f9d880b79c0 20 INFO: main: done 2024-09-12T00:43:25.871 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.869+0000 7f9c377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:25.876 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.873+0000 7f9d880b79c0 20 remove_watcher() i=0 2024-09-12T00:43:25.876 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.873+0000 7f9d880b79c0 2 removed watcher, disabling cache 2024-09-12T00:43:25.878 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.877+0000 7f9d880b79c0 20 remove_watcher() i=1 2024-09-12T00:43:25.880 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.877+0000 7f9d880b79c0 20 remove_watcher() i=2 2024-09-12T00:43:25.883 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.881+0000 7f9d880b79c0 20 remove_watcher() i=3 2024-09-12T00:43:25.885 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.885+0000 7f9d880b79c0 20 remove_watcher() i=4 2024-09-12T00:43:25.887 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.885+0000 7f9d880b79c0 20 remove_watcher() i=5 2024-09-12T00:43:25.889 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.885+0000 7f9d880b79c0 20 remove_watcher() i=6 2024-09-12T00:43:25.891 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:25.889+0000 7f9d880b79c0 20 remove_watcher() i=7 2024-09-12T00:43:25.910 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:25.910 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:43:25.915 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:25.915 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:43:25.974 INFO:tasks.workunit.client.0.smithi043.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:43:25.975 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-12T00:43:26.013 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:26.013 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:26.270 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.269+0000 7f1d3b4669c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:26.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.269+0000 7f1d3b4669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:26.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.269+0000 7f1d3b4669c0 20 realm 2024-09-12T00:43:26.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.269+0000 7f1d3b4669c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:26.273 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.269+0000 7f1d3b4669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:26.274 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.269+0000 7f1d3b4669c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:26.274 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.269+0000 7f1d3b4669c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:26.274 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.273+0000 7f1d3b4669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:26.274 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.273+0000 7f1d3b4669c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:26.275 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.273+0000 7f1d3b4669c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:26.275 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.273+0000 7f1d3b4669c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:26.276 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.273+0000 7f1d3b4669c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:26.276 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.273+0000 7f1d3b4669c0 20 searching for the correct realm 2024-09-12T00:43:26.283 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.281+0000 7f1d3976d640 0 -- 172.21.15.43:0/969666237 >> [v2:172.21.15.43:6808/2258408181,v1:172.21.15.43:6809/2258408181] conn(0x55adb79b58a0 msgr2=0x55adb79b7d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:26.290 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.289+0000 7f1d38f6c640 0 -- 172.21.15.43:0/969666237 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f1d20062460 msgr2=0x7f1d200628c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:26.510 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.509+0000 7f1d3b4669c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:43:26.510 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.509+0000 7f1d3b4669c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:26.510 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.509+0000 7f1d3b4669c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:26.510 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.509+0000 7f1d3b4669c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:43:26.511 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.509+0000 7f1d3b4669c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:26.511 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.509+0000 7f1d3b4669c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:26.511 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.509+0000 7f1d3b4669c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:26.511 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.509+0000 7f1d3b4669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:26.511 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.509+0000 7f1d3b4669c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:26.511 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.509+0000 7f1d3b4669c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:26.512 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.509+0000 7f1d3b4669c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:26.512 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.509+0000 7f1d3b4669c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:26.512 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.509+0000 7f1d3b4669c0 20 zone default found 2024-09-12T00:43:26.512 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.509+0000 7f1d3b4669c0 4 Realm: () 2024-09-12T00:43:26.513 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.509+0000 7f1d3b4669c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:43:26.513 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.509+0000 7f1d3b4669c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:43:26.513 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.509+0000 7f1d3b4669c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:26.513 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.509+0000 7f1d3b4669c0 20 zonegroup default 2024-09-12T00:43:26.513 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.509+0000 7f1d3b4669c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:26.513 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.509+0000 7f1d3b4669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:26.513 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.509+0000 7f1d3b4669c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:26.514 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.513+0000 7f1d3b4669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:26.514 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.513+0000 7f1d3b4669c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:26.515 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.513+0000 7f1d3b4669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:26.515 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.513+0000 7f1d3b4669c0 20 started sync module instance, tier type = 2024-09-12T00:43:26.515 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.513+0000 7f1d3b4669c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:43:26.539 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.537+0000 7f1d3b4669c0 20 add_watcher() i=0 2024-09-12T00:43:26.539 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.537+0000 7f1d3b4669c0 20 add_watcher() i=1 2024-09-12T00:43:26.539 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.537+0000 7f1d3b4669c0 20 add_watcher() i=2 2024-09-12T00:43:26.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.537+0000 7f1d3b4669c0 20 add_watcher() i=3 2024-09-12T00:43:26.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.537+0000 7f1d3b4669c0 20 add_watcher() i=4 2024-09-12T00:43:26.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.537+0000 7f1d3b4669c0 20 add_watcher() i=5 2024-09-12T00:43:26.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.537+0000 7f1d3b4669c0 20 add_watcher() i=6 2024-09-12T00:43:26.542 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.541+0000 7f1d3b4669c0 20 add_watcher() i=7 2024-09-12T00:43:26.542 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.541+0000 7f1d3b4669c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:26.546 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.545+0000 7f1beefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:26.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.545+0000 7f1d3b4669c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:26.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.545+0000 7f1d3b4669c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:26.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.545+0000 7f1d3b4669c0 5 note: GC not initialized 2024-09-12T00:43:26.548 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.545+0000 7f1bedfe3640 20 reqs_thread_entry: start 2024-09-12T00:43:26.548 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.545+0000 7f1d3b4669c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:26.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.545+0000 7f1d3b4669c0 20 Filter name: none 2024-09-12T00:43:26.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.545+0000 7f1b5f7fe640 20 reqs_thread_entry: start 2024-09-12T00:43:26.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.545+0000 7f1d3b4669c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:26.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.545+0000 7f1d3b4669c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:43:26.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.545+0000 7f1d3b4669c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:26.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.549+0000 7f1d3b4669c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:43:26.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.549+0000 7f1d3b4669c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:26.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.549+0000 7f1d3b4669c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T00:43:26.550 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.549+0000 7f1d3b4669c0 20 INFO: main: starting shard=0 2024-09-12T00:43:26.551 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.549+0000 7f1d3b4669c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.0 2024-09-12T00:43:26.551 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.549+0000 7f1d3b4669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.0 2024-09-12T00:43:26.551 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.549+0000 7f1d3b4669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:26.551 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.549+0000 7f1d3b4669c0 20 INFO: main: starting shard=1 2024-09-12T00:43:26.551 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.549+0000 7f1d3b4669c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.1 2024-09-12T00:43:26.551 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.549+0000 7f1d3b4669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.1 2024-09-12T00:43:26.552 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.549+0000 7f1d3b4669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:26.552 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.549+0000 7f1d3b4669c0 20 INFO: main: starting shard=2 2024-09-12T00:43:26.552 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.549+0000 7f1d3b4669c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.2 2024-09-12T00:43:26.552 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.549+0000 7f1d3b4669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.2 2024-09-12T00:43:26.553 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.549+0000 7f1d3b4669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:26.553 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.549+0000 7f1d3b4669c0 20 INFO: main: starting shard=3 2024-09-12T00:43:26.553 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.549+0000 7f1d3b4669c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.3 2024-09-12T00:43:26.553 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.549+0000 7f1d3b4669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.3 2024-09-12T00:43:26.554 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.553+0000 7f1d3b4669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:26.554 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.553+0000 7f1d3b4669c0 20 INFO: main: starting shard=4 2024-09-12T00:43:26.554 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.553+0000 7f1d3b4669c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.4 2024-09-12T00:43:26.554 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.553+0000 7f1d3b4669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.4 2024-09-12T00:43:26.555 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.553+0000 7f1d3b4669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:26.555 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.553+0000 7f1d3b4669c0 20 INFO: main: starting shard=5 2024-09-12T00:43:26.555 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.553+0000 7f1d3b4669c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.5 2024-09-12T00:43:26.555 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.553+0000 7f1d3b4669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.5 2024-09-12T00:43:26.556 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.553+0000 7f1d3b4669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:26.556 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.553+0000 7f1d3b4669c0 20 INFO: main: starting shard=6 2024-09-12T00:43:26.556 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.553+0000 7f1d3b4669c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.6 2024-09-12T00:43:26.556 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.553+0000 7f1d3b4669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.6 2024-09-12T00:43:26.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.557+0000 7f1d3b4669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:26.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.557+0000 7f1d3b4669c0 20 INFO: main: starting shard=7 2024-09-12T00:43:26.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.557+0000 7f1d3b4669c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.7 2024-09-12T00:43:26.557 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.557+0000 7f1d3b4669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.7 2024-09-12T00:43:26.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.557+0000 7f1d3b4669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:26.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.557+0000 7f1d3b4669c0 20 INFO: main: starting shard=8 2024-09-12T00:43:26.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.557+0000 7f1d3b4669c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.8 2024-09-12T00:43:26.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.557+0000 7f1d3b4669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.8 2024-09-12T00:43:26.559 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.557+0000 7f1d3b4669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:26.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.557+0000 7f1d3b4669c0 20 INFO: main: starting shard=9 2024-09-12T00:43:26.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.557+0000 7f1d3b4669c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.9 2024-09-12T00:43:26.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.557+0000 7f1d3b4669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.9 2024-09-12T00:43:26.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.557+0000 7f1d3b4669c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:43:26.560 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.557+0000 7f1d3b4669c0 20 INFO: main: starting shard=10 2024-09-12T00:43:26.561 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.557+0000 7f1d3b4669c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.10 2024-09-12T00:43:26.561 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.557+0000 7f1d3b4669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.10 2024-09-12T00:43:26.561 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.557+0000 7f1d3b4669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:26.561 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.557+0000 7f1d3b4669c0 20 INFO: main: starting shard=11 2024-09-12T00:43:26.561 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.557+0000 7f1d3b4669c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.11 2024-09-12T00:43:26.561 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.557+0000 7f1d3b4669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.11 2024-09-12T00:43:26.562 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.561+0000 7f1d3b4669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:26.562 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.561+0000 7f1d3b4669c0 20 INFO: main: starting shard=12 2024-09-12T00:43:26.562 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.561+0000 7f1d3b4669c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.12 2024-09-12T00:43:26.563 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.561+0000 7f1d3b4669c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.12 2024-09-12T00:43:26.563 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.561+0000 7f1d3b4669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:26.563 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.561+0000 7f1d3b4669c0 20 INFO: main: done 2024-09-12T00:43:26.564 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.561+0000 7f1beefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:26.569 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.569+0000 7f1d3b4669c0 20 remove_watcher() i=0 2024-09-12T00:43:26.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.569+0000 7f1d3b4669c0 2 removed watcher, disabling cache 2024-09-12T00:43:26.572 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.569+0000 7f1d3b4669c0 20 remove_watcher() i=1 2024-09-12T00:43:26.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.573+0000 7f1d3b4669c0 20 remove_watcher() i=2 2024-09-12T00:43:26.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.573+0000 7f1d3b4669c0 20 remove_watcher() i=3 2024-09-12T00:43:26.578 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.577+0000 7f1d3b4669c0 20 remove_watcher() i=4 2024-09-12T00:43:26.580 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.577+0000 7f1d3b4669c0 20 remove_watcher() i=5 2024-09-12T00:43:26.581 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.581+0000 7f1d3b4669c0 20 remove_watcher() i=6 2024-09-12T00:43:26.583 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.581+0000 7f1d3b4669c0 20 remove_watcher() i=7 2024-09-12T00:43:26.601 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:26.601 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:43:26.607 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:26.607 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:43:26.666 INFO:tasks.workunit.client.0.smithi043.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:43:26.667 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-12T00:43:26.703 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:26.703 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:26.749 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.745+0000 7fb9079719c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:26.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.749+0000 7fb9079719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:26.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.749+0000 7fb9079719c0 20 realm 2024-09-12T00:43:26.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.749+0000 7fb9079719c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:26.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.749+0000 7fb9079719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:26.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.749+0000 7fb9079719c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:26.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.749+0000 7fb9079719c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:26.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.749+0000 7fb9079719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:26.751 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.749+0000 7fb9079719c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:26.752 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.749+0000 7fb9079719c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:26.753 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.749+0000 7fb9079719c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:26.753 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.753+0000 7fb9079719c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:26.754 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.753+0000 7fb9079719c0 20 searching for the correct realm 2024-09-12T00:43:26.760 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.757+0000 7fb904c76640 0 -- 172.21.15.43:0/452287296 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x555b117951e0 msgr2=0x555b11797610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:26.766 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.765+0000 7fb904c76640 0 -- 172.21.15.43:0/452287296 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fb8fc02a040 msgr2=0x7fb8fc041960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:26.774 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.773+0000 7fb9079719c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:43:26.774 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.773+0000 7fb9079719c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:26.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.773+0000 7fb9079719c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:26.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.773+0000 7fb9079719c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:43:26.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.773+0000 7fb9079719c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:26.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.773+0000 7fb9079719c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:26.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.773+0000 7fb9079719c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:26.775 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.773+0000 7fb9079719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:26.776 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.773+0000 7fb9079719c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:26.778 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.773+0000 7fb9079719c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:26.779 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.773+0000 7fb9079719c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:26.779 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.773+0000 7fb9079719c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:26.779 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.773+0000 7fb9079719c0 20 zone default found 2024-09-12T00:43:26.779 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.773+0000 7fb9079719c0 4 Realm: () 2024-09-12T00:43:26.779 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.773+0000 7fb9079719c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:43:26.779 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.773+0000 7fb9079719c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:43:26.780 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.773+0000 7fb9079719c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:26.780 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.773+0000 7fb9079719c0 20 zonegroup default 2024-09-12T00:43:26.780 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.773+0000 7fb9079719c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:26.780 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.773+0000 7fb9079719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:26.780 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.773+0000 7fb9079719c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:26.780 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.773+0000 7fb9079719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:26.781 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.773+0000 7fb9079719c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:26.781 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.773+0000 7fb9079719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:26.781 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.773+0000 7fb9079719c0 20 started sync module instance, tier type = 2024-09-12T00:43:26.781 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.773+0000 7fb9079719c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:43:26.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.789+0000 7fb9079719c0 20 add_watcher() i=0 2024-09-12T00:43:26.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.789+0000 7fb9079719c0 20 add_watcher() i=1 2024-09-12T00:43:26.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.789+0000 7fb9079719c0 20 add_watcher() i=2 2024-09-12T00:43:26.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.789+0000 7fb9079719c0 20 add_watcher() i=3 2024-09-12T00:43:26.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.789+0000 7fb9079719c0 20 add_watcher() i=4 2024-09-12T00:43:26.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.789+0000 7fb9079719c0 20 add_watcher() i=5 2024-09-12T00:43:26.793 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.789+0000 7fb9079719c0 20 add_watcher() i=6 2024-09-12T00:43:26.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.793+0000 7fb9079719c0 20 add_watcher() i=7 2024-09-12T00:43:26.794 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.793+0000 7fb9079719c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:26.796 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.793+0000 7fb7bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:26.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.793+0000 7fb9079719c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:26.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.793+0000 7fb9079719c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:26.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.793+0000 7fb9079719c0 5 note: GC not initialized 2024-09-12T00:43:26.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.793+0000 7fb7ba7e4640 20 reqs_thread_entry: start 2024-09-12T00:43:26.797 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.793+0000 7fb9079719c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:26.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.793+0000 7fb9079719c0 20 Filter name: none 2024-09-12T00:43:26.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.797+0000 7fb72bfff640 20 reqs_thread_entry: start 2024-09-12T00:43:26.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.797+0000 7fb9079719c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:26.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.797+0000 7fb9079719c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:43:26.798 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.797+0000 7fb9079719c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:26.799 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.797+0000 7fb9079719c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:43:26.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.797+0000 7fb9079719c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:26.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.797+0000 7fb9079719c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T00:43:26.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.797+0000 7fb9079719c0 20 INFO: main: starting shard=0 2024-09-12T00:43:26.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.797+0000 7fb9079719c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.0 2024-09-12T00:43:26.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.797+0000 7fb9079719c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.0 2024-09-12T00:43:26.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.797+0000 7fb9079719c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:43:26.800 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.797+0000 7fb9079719c0 20 INFO: main: starting shard=1 2024-09-12T00:43:26.801 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.797+0000 7fb9079719c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.1 2024-09-12T00:43:26.801 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.797+0000 7fb9079719c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.1 2024-09-12T00:43:26.801 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.797+0000 7fb9079719c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:26.801 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.797+0000 7fb9079719c0 20 INFO: main: starting shard=2 2024-09-12T00:43:26.802 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.797+0000 7fb9079719c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.2 2024-09-12T00:43:26.802 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.797+0000 7fb9079719c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.2 2024-09-12T00:43:26.802 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.801+0000 7fb9079719c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:26.802 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.801+0000 7fb9079719c0 20 INFO: main: starting shard=3 2024-09-12T00:43:26.802 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.801+0000 7fb9079719c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.3 2024-09-12T00:43:26.802 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.801+0000 7fb9079719c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.3 2024-09-12T00:43:26.802 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.801+0000 7fb9079719c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:26.802 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.801+0000 7fb9079719c0 20 INFO: main: starting shard=4 2024-09-12T00:43:26.803 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.801+0000 7fb9079719c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.4 2024-09-12T00:43:26.803 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.801+0000 7fb9079719c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.4 2024-09-12T00:43:26.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.801+0000 7fb9079719c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:26.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.801+0000 7fb9079719c0 20 INFO: main: starting shard=5 2024-09-12T00:43:26.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.801+0000 7fb9079719c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.5 2024-09-12T00:43:26.804 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.801+0000 7fb9079719c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.5 2024-09-12T00:43:26.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.801+0000 7fb9079719c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:26.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.801+0000 7fb9079719c0 20 INFO: main: starting shard=6 2024-09-12T00:43:26.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.801+0000 7fb9079719c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.6 2024-09-12T00:43:26.805 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.801+0000 7fb9079719c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.6 2024-09-12T00:43:26.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.805+0000 7fb9079719c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:26.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.805+0000 7fb9079719c0 20 INFO: main: starting shard=7 2024-09-12T00:43:26.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.805+0000 7fb9079719c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.7 2024-09-12T00:43:26.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.805+0000 7fb9079719c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.7 2024-09-12T00:43:26.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.805+0000 7fb9079719c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:26.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.805+0000 7fb9079719c0 20 INFO: main: starting shard=8 2024-09-12T00:43:26.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.805+0000 7fb9079719c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.8 2024-09-12T00:43:26.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.805+0000 7fb9079719c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.8 2024-09-12T00:43:26.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.805+0000 7fb9079719c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:26.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.805+0000 7fb9079719c0 20 INFO: main: starting shard=9 2024-09-12T00:43:26.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.805+0000 7fb9079719c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.9 2024-09-12T00:43:26.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.805+0000 7fb9079719c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.9 2024-09-12T00:43:26.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.805+0000 7fb9079719c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:26.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.805+0000 7fb9079719c0 20 INFO: main: starting shard=10 2024-09-12T00:43:26.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.805+0000 7fb9079719c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.10 2024-09-12T00:43:26.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.805+0000 7fb9079719c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.10 2024-09-12T00:43:26.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.805+0000 7fb9079719c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:26.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.805+0000 7fb9079719c0 20 INFO: main: starting shard=11 2024-09-12T00:43:26.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.805+0000 7fb9079719c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.11 2024-09-12T00:43:26.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.805+0000 7fb9079719c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.11 2024-09-12T00:43:26.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.809+0000 7fb9079719c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:26.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.809+0000 7fb9079719c0 20 INFO: main: starting shard=12 2024-09-12T00:43:26.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.809+0000 7fb9079719c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.12 2024-09-12T00:43:26.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.809+0000 7fb9079719c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.12 2024-09-12T00:43:26.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.809+0000 7fb9079719c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:26.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.809+0000 7fb9079719c0 20 INFO: main: done 2024-09-12T00:43:26.812 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.809+0000 7fb7bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:26.817 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.813+0000 7fb9079719c0 20 remove_watcher() i=0 2024-09-12T00:43:26.817 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.813+0000 7fb9079719c0 2 removed watcher, disabling cache 2024-09-12T00:43:26.819 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.817+0000 7fb9079719c0 20 remove_watcher() i=1 2024-09-12T00:43:26.822 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.821+0000 7fb9079719c0 20 remove_watcher() i=2 2024-09-12T00:43:26.824 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.821+0000 7fb9079719c0 20 remove_watcher() i=3 2024-09-12T00:43:26.826 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.825+0000 7fb9079719c0 20 remove_watcher() i=4 2024-09-12T00:43:26.827 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.825+0000 7fb9079719c0 20 remove_watcher() i=5 2024-09-12T00:43:26.829 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.825+0000 7fb9079719c0 20 remove_watcher() i=6 2024-09-12T00:43:26.830 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:26.829+0000 7fb9079719c0 20 remove_watcher() i=7 2024-09-12T00:43:26.849 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:26.849 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:43:26.853 INFO:tasks.workunit.client.0.smithi043.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:43:27.294 INFO:tasks.workunit.client.0.smithi043.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:43:27.729 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-12T00:43:27.763 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:27.764 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:27.806 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:27.805+0000 7efdcd3919c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:27.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:27.805+0000 7efdcd3919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:27.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:27.805+0000 7efdcd3919c0 20 realm 2024-09-12T00:43:27.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:27.805+0000 7efdcd3919c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:27.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:27.805+0000 7efdcd3919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:27.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:27.805+0000 7efdcd3919c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:27.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:27.805+0000 7efdcd3919c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:27.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:27.805+0000 7efdcd3919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:27.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:27.805+0000 7efdcd3919c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:27.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:27.809+0000 7efdcd3919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:27.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:27.809+0000 7efdcd3919c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:27.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:27.809+0000 7efdcd3919c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:27.811 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:27.809+0000 7efdcd3919c0 20 searching for the correct realm 2024-09-12T00:43:27.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:27.813+0000 7efdca696640 0 -- 172.21.15.43:0/2065647058 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7efdb4010040 msgr2=0x7efdb4043400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:28.031 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.029+0000 7efdcae97640 0 -- 172.21.15.43:0/2065647058 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7efdb401c910 msgr2=0x7efdb40413e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:28.249 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.245+0000 7efdcd3919c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:43:28.249 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.245+0000 7efdcd3919c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:28.249 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.245+0000 7efdcd3919c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:28.249 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.245+0000 7efdcd3919c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:43:28.249 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.245+0000 7efdcd3919c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:28.249 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.245+0000 7efdcd3919c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:28.249 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.245+0000 7efdcd3919c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.250 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.249+0000 7efdcd3919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:28.250 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.249+0000 7efdcd3919c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.250 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.249+0000 7efdcd3919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:28.250 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.249+0000 7efdcd3919c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.249+0000 7efdcd3919c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:28.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.249+0000 7efdcd3919c0 20 zone default found 2024-09-12T00:43:28.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.249+0000 7efdcd3919c0 4 Realm: () 2024-09-12T00:43:28.251 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.249+0000 7efdcd3919c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:43:28.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.249+0000 7efdcd3919c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:43:28.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.249+0000 7efdcd3919c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:28.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.249+0000 7efdcd3919c0 20 zonegroup default 2024-09-12T00:43:28.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.249+0000 7efdcd3919c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.249+0000 7efdcd3919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:28.252 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.249+0000 7efdcd3919c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.253 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.249+0000 7efdcd3919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:28.253 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.249+0000 7efdcd3919c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.254 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.253+0000 7efdcd3919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:28.254 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.253+0000 7efdcd3919c0 20 started sync module instance, tier type = 2024-09-12T00:43:28.254 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.253+0000 7efdcd3919c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:43:28.278 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.277+0000 7efdcd3919c0 20 add_watcher() i=0 2024-09-12T00:43:28.278 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.277+0000 7efdcd3919c0 20 add_watcher() i=1 2024-09-12T00:43:28.279 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.277+0000 7efdcd3919c0 20 add_watcher() i=2 2024-09-12T00:43:28.279 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.277+0000 7efdcd3919c0 20 add_watcher() i=3 2024-09-12T00:43:28.279 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.277+0000 7efdcd3919c0 20 add_watcher() i=4 2024-09-12T00:43:28.279 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.277+0000 7efdcd3919c0 20 add_watcher() i=5 2024-09-12T00:43:28.279 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.277+0000 7efdcd3919c0 20 add_watcher() i=6 2024-09-12T00:43:28.281 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.277+0000 7efdcd3919c0 20 add_watcher() i=7 2024-09-12T00:43:28.281 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.277+0000 7efdcd3919c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:28.285 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.281+0000 7efc817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:28.286 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.285+0000 7efdcd3919c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:28.286 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.285+0000 7efdcd3919c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:28.286 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.285+0000 7efdcd3919c0 5 note: GC not initialized 2024-09-12T00:43:28.287 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.285+0000 7efbfbfff640 20 reqs_thread_entry: start 2024-09-12T00:43:28.287 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.285+0000 7efdcd3919c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:28.287 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.285+0000 7efdcd3919c0 20 Filter name: none 2024-09-12T00:43:28.287 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.285+0000 7efbf9ffb640 20 reqs_thread_entry: start 2024-09-12T00:43:28.287 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.285+0000 7efdcd3919c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:43:28.287 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.285+0000 7efdcd3919c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.285+0000 7efdcd3919c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:43:28.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.285+0000 7efdcd3919c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:43:28.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.285+0000 7efdcd3919c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:43:28.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.285+0000 7efdcd3919c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 : miss 2024-09-12T00:43:28.288 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.285+0000 7efdcd3919c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.289 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.285+0000 7efdcd3919c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:43:28.289 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.285+0000 7efdcd3919c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 info.flags=0x17 2024-09-12T00:43:28.289 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.285+0000 7efdcd3919c0 10 adding default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 to cache LRU end 2024-09-12T00:43:28.289 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.285+0000 7efdcd3919c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:28.289 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.285+0000 7efdcd3919c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:28.289 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.285+0000 7efdcd3919c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 2024-09-12T00:43:28.303 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.301+0000 7efdcd3919c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 info.flags=0x17 2024-09-12T00:43:28.303 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.301+0000 7efdcd3919c0 10 moving default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 to cache LRU end 2024-09-12T00:43:28.303 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.301+0000 7efdcd3919c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:28.303 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.301+0000 7efdcd3919c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18, ofs0, ns] 2024-09-12T00:43:28.304 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.301+0000 7efcadffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333541 cookie 94862020587824 notifier 8201 bl.length()=821 2024-09-12T00:43:28.304 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.301+0000 7efcadffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 info.flags=0x17 2024-09-12T00:43:28.304 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.301+0000 7efcadffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 to cache LRU end 2024-09-12T00:43:28.304 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.301+0000 7efcadffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:28.304 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.301+0000 7efdcd3919c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): orig_sources= new_sources= 2024-09-12T00:43:28.304 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.301+0000 7efdcd3919c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): potential sources added=[] removed=[] 2024-09-12T00:43:28.304 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.301+0000 7efdcd3919c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): orig_dests= new_dests= 2024-09-12T00:43:28.304 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.301+0000 7efdcd3919c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): potential dests added=[] removed=[] 2024-09-12T00:43:28.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.0 2024-09-12T00:43:28.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.0 2024-09-12T00:43:28.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.1 2024-09-12T00:43:28.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.1 2024-09-12T00:43:28.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.2 2024-09-12T00:43:28.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.2 2024-09-12T00:43:28.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.3 2024-09-12T00:43:28.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.3 2024-09-12T00:43:28.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.4 2024-09-12T00:43:28.317 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.4 2024-09-12T00:43:28.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.5 2024-09-12T00:43:28.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.5 2024-09-12T00:43:28.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.6 2024-09-12T00:43:28.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.6 2024-09-12T00:43:28.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.7 2024-09-12T00:43:28.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.7 2024-09-12T00:43:28.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.8 2024-09-12T00:43:28.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.8 2024-09-12T00:43:28.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.9 2024-09-12T00:43:28.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.9 2024-09-12T00:43:28.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.10 2024-09-12T00:43:28.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.10 2024-09-12T00:43:28.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.11 2024-09-12T00:43:28.318 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.11 2024-09-12T00:43:28.319 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.12 2024-09-12T00:43:28.319 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.12 2024-09-12T00:43:28.319 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.13 2024-09-12T00:43:28.319 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.13 2024-09-12T00:43:28.319 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.14 2024-09-12T00:43:28.319 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.14 2024-09-12T00:43:28.319 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.15 2024-09-12T00:43:28.319 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.15 2024-09-12T00:43:28.319 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.16 2024-09-12T00:43:28.319 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.16 2024-09-12T00:43:28.319 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.0 2024-09-12T00:43:28.319 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.0 2024-09-12T00:43:28.319 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.1 2024-09-12T00:43:28.320 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.313+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.1 2024-09-12T00:43:28.320 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.317+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.2 2024-09-12T00:43:28.320 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.317+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.2 2024-09-12T00:43:28.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.317+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.3 2024-09-12T00:43:28.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.317+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.3 2024-09-12T00:43:28.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.317+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.4 2024-09-12T00:43:28.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.317+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.4 2024-09-12T00:43:28.321 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.317+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.5 2024-09-12T00:43:28.322 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.317+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.5 2024-09-12T00:43:28.322 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.321+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.6 2024-09-12T00:43:28.322 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.321+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.6 2024-09-12T00:43:28.323 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.321+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.7 2024-09-12T00:43:28.323 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.321+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.7 2024-09-12T00:43:28.323 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.321+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.8 2024-09-12T00:43:28.324 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.321+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.8 2024-09-12T00:43:28.325 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.321+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.9 2024-09-12T00:43:28.325 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.321+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.9 2024-09-12T00:43:28.325 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.325+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.10 2024-09-12T00:43:28.325 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.325+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.10 2024-09-12T00:43:28.326 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.325+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.11 2024-09-12T00:43:28.326 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.325+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.11 2024-09-12T00:43:28.327 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.325+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.12 2024-09-12T00:43:28.327 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.325+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.12 2024-09-12T00:43:28.330 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.329+0000 7efdcd3919c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:43:28.330 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.329+0000 7efdcd3919c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 2024-09-12T00:43:28.333 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.329+0000 7efdcd3919c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 info.flags=0x17 2024-09-12T00:43:28.333 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.329+0000 7efdcd3919c0 10 moving default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 to cache LRU end 2024-09-12T00:43:28.333 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.329+0000 7efdcd3919c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:28.333 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.329+0000 7efdcd3919c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18, ofs0, ns] 2024-09-12T00:43:28.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.333+0000 7efcadffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333542 cookie 94862020587824 notifier 8201 bl.length()=821 2024-09-12T00:43:28.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.333+0000 7efcadffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 info.flags=0x17 2024-09-12T00:43:28.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.333+0000 7efcadffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 to cache LRU end 2024-09-12T00:43:28.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.333+0000 7efcadffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:28.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.333+0000 7efdcd3919c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): orig_sources= new_sources= 2024-09-12T00:43:28.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.333+0000 7efdcd3919c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): potential sources added=[] removed=[] 2024-09-12T00:43:28.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.333+0000 7efdcd3919c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): orig_dests= new_dests= 2024-09-12T00:43:28.334 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.333+0000 7efdcd3919c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): potential dests added=[] removed=[] 2024-09-12T00:43:28.339 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.337+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.0 2024-09-12T00:43:28.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.337+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.0 2024-09-12T00:43:28.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.337+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.1 2024-09-12T00:43:28.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.337+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.1 2024-09-12T00:43:28.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.337+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.2 2024-09-12T00:43:28.340 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.337+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.2 2024-09-12T00:43:28.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.341+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.3 2024-09-12T00:43:28.341 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.341+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.3 2024-09-12T00:43:28.342 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.341+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.4 2024-09-12T00:43:28.342 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.341+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.4 2024-09-12T00:43:28.343 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.341+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.5 2024-09-12T00:43:28.343 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.341+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.5 2024-09-12T00:43:28.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.341+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.6 2024-09-12T00:43:28.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.341+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.6 2024-09-12T00:43:28.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.341+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.7 2024-09-12T00:43:28.344 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.341+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.7 2024-09-12T00:43:28.345 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.341+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.8 2024-09-12T00:43:28.345 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.341+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.8 2024-09-12T00:43:28.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.345+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.9 2024-09-12T00:43:28.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.345+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.9 2024-09-12T00:43:28.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.345+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.10 2024-09-12T00:43:28.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.345+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.10 2024-09-12T00:43:28.346 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.345+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.11 2024-09-12T00:43:28.347 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.345+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.11 2024-09-12T00:43:28.348 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.345+0000 7efdcd3919c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.12 2024-09-12T00:43:28.348 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.345+0000 7efdcd3919c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.2.12 2024-09-12T00:43:28.348 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.345+0000 7efdcd3919c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:43:28.348 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.345+0000 7efdcd3919c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 2024-09-12T00:43:28.351 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.349+0000 7efdcd3919c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 info.flags=0x17 2024-09-12T00:43:28.351 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.349+0000 7efdcd3919c0 10 moving default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 to cache LRU end 2024-09-12T00:43:28.351 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.349+0000 7efdcd3919c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:28.351 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.349+0000 7efdcd3919c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18, ofs0, ns] 2024-09-12T00:43:28.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.349+0000 7efcadffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333543 cookie 94862020587824 notifier 8201 bl.length()=789 2024-09-12T00:43:28.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.349+0000 7efcadffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 info.flags=0x17 2024-09-12T00:43:28.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.349+0000 7efcadffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 to cache LRU end 2024-09-12T00:43:28.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.349+0000 7efcadffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:28.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.349+0000 7efdcd3919c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): orig_sources= new_sources= 2024-09-12T00:43:28.352 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.349+0000 7efdcd3919c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): potential sources added=[] removed=[] 2024-09-12T00:43:28.353 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.349+0000 7efdcd3919c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): orig_dests= new_dests= 2024-09-12T00:43:28.353 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.349+0000 7efdcd3919c0 20 handle_bi_update(): bucket=:myver[af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18]): potential dests added=[] removed=[] 2024-09-12T00:43:28.358 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.357+0000 7efdcd3919c0 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-09-12T00:43:28.361 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.361+0000 7efc817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:28.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.365+0000 7efdcd3919c0 20 remove_watcher() i=0 2024-09-12T00:43:28.367 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.365+0000 7efdcd3919c0 2 removed watcher, disabling cache 2024-09-12T00:43:28.369 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.369+0000 7efdcd3919c0 20 remove_watcher() i=1 2024-09-12T00:43:28.372 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.369+0000 7efdcd3919c0 20 remove_watcher() i=2 2024-09-12T00:43:28.374 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.373+0000 7efdcd3919c0 20 remove_watcher() i=3 2024-09-12T00:43:28.377 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.373+0000 7efdcd3919c0 20 remove_watcher() i=4 2024-09-12T00:43:28.378 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.377+0000 7efdcd3919c0 20 remove_watcher() i=5 2024-09-12T00:43:28.380 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.377+0000 7efdcd3919c0 20 remove_watcher() i=6 2024-09-12T00:43:28.382 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.381+0000 7efdcd3919c0 20 remove_watcher() i=7 2024-09-12T00:43:28.398 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:43:28.433 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:28.434 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:28.478 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.477+0000 7fae794169c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.479 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.477+0000 7fae794169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:28.479 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.477+0000 7fae794169c0 20 realm 2024-09-12T00:43:28.480 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.477+0000 7fae794169c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.480 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.477+0000 7fae794169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:28.480 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.477+0000 7fae794169c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:28.480 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.477+0000 7fae794169c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.480 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.477+0000 7fae794169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:28.480 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.477+0000 7fae794169c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.481+0000 7fae794169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:28.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.481+0000 7fae794169c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.483 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.481+0000 7fae794169c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:28.483 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.481+0000 7fae794169c0 20 searching for the correct realm 2024-09-12T00:43:28.488 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.485+0000 7fae7671b640 0 -- 172.21.15.43:0/66013948 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x5638e5e71210 msgr2=0x5638e5e73600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:28.495 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.493+0000 7fae7671b640 0 -- 172.21.15.43:0/66013948 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fae6c039b00 msgr2=0x7fae6c00aaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:28.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.501+0000 7fae794169c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:43:28.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.501+0000 7fae794169c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:28.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.501+0000 7fae794169c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:28.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.501+0000 7fae794169c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:43:28.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.501+0000 7fae794169c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:28.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.501+0000 7fae794169c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:28.502 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.501+0000 7fae794169c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.501+0000 7fae794169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:28.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.501+0000 7fae794169c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.501+0000 7fae794169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:28.503 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.501+0000 7fae794169c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.501+0000 7fae794169c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:28.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.501+0000 7fae794169c0 20 zone default found 2024-09-12T00:43:28.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.501+0000 7fae794169c0 4 Realm: () 2024-09-12T00:43:28.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.501+0000 7fae794169c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:43:28.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.501+0000 7fae794169c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:43:28.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.501+0000 7fae794169c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:28.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.501+0000 7fae794169c0 20 zonegroup default 2024-09-12T00:43:28.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.501+0000 7fae794169c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.501+0000 7fae794169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:28.504 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.501+0000 7fae794169c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.505 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.501+0000 7fae794169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:28.505 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.501+0000 7fae794169c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.505 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.501+0000 7fae794169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:28.505 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.501+0000 7fae794169c0 20 started sync module instance, tier type = 2024-09-12T00:43:28.505 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.501+0000 7fae794169c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:43:28.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.517+0000 7fae794169c0 20 add_watcher() i=0 2024-09-12T00:43:28.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.517+0000 7fae794169c0 20 add_watcher() i=1 2024-09-12T00:43:28.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.517+0000 7fae794169c0 20 add_watcher() i=2 2024-09-12T00:43:28.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.517+0000 7fae794169c0 20 add_watcher() i=3 2024-09-12T00:43:28.521 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.517+0000 7fae794169c0 20 add_watcher() i=4 2024-09-12T00:43:28.522 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.517+0000 7fae794169c0 20 add_watcher() i=5 2024-09-12T00:43:28.522 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.517+0000 7fae794169c0 20 add_watcher() i=6 2024-09-12T00:43:28.522 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.521+0000 7fae794169c0 20 add_watcher() i=7 2024-09-12T00:43:28.522 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.521+0000 7fae794169c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:28.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.521+0000 7fad2d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:28.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.521+0000 7fae794169c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:28.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.521+0000 7fae794169c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:28.525 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.521+0000 7fae794169c0 5 note: GC not initialized 2024-09-12T00:43:28.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.521+0000 7faca7fff640 20 reqs_thread_entry: start 2024-09-12T00:43:28.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.521+0000 7fae794169c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:28.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.521+0000 7fae794169c0 20 Filter name: none 2024-09-12T00:43:28.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.525+0000 7faca5ffb640 20 reqs_thread_entry: start 2024-09-12T00:43:28.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.525+0000 7fae794169c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:43:28.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.525+0000 7fae794169c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.525+0000 7fae794169c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:43:28.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.525+0000 7fae794169c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:43:28.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.525+0000 7fae794169c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:43:28.526 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.525+0000 7fae794169c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 : miss 2024-09-12T00:43:28.527 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.525+0000 7fae794169c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.527 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.525+0000 7fae794169c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:43:28.527 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.525+0000 7fae794169c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 info.flags=0x17 2024-09-12T00:43:28.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.525+0000 7fae794169c0 10 adding default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 to cache LRU end 2024-09-12T00:43:28.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.525+0000 7fae794169c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:28.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.525+0000 7fae794169c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:43:28.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.525+0000 7fae794169c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18 2024-09-12T00:43:28.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.525+0000 7fae794169c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.0 2024-09-12T00:43:28.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.525+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.0 2024-09-12T00:43:28.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.525+0000 7fae794169c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T00:43:28.528 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.525+0000 7fae794169c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.1 2024-09-12T00:43:28.529 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.525+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.1 2024-09-12T00:43:28.529 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.525+0000 7fae794169c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T00:43:28.529 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.525+0000 7fae794169c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.2 2024-09-12T00:43:28.529 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.525+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.2 2024-09-12T00:43:28.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.529+0000 7fae794169c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T00:43:28.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.529+0000 7fae794169c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.3 2024-09-12T00:43:28.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.529+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.3 2024-09-12T00:43:28.530 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.529+0000 7fae794169c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T00:43:28.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.529+0000 7fae794169c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.4 2024-09-12T00:43:28.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.529+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.4 2024-09-12T00:43:28.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.529+0000 7fae794169c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T00:43:28.531 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.529+0000 7fae794169c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.5 2024-09-12T00:43:28.532 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.529+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.5 2024-09-12T00:43:28.532 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.529+0000 7fae794169c0 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-12T00:43:28.532 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.529+0000 7fae794169c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.6 2024-09-12T00:43:28.532 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.529+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.6 2024-09-12T00:43:28.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.533+0000 7fae794169c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T00:43:28.533 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.533+0000 7fae794169c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.7 2024-09-12T00:43:28.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.533+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.7 2024-09-12T00:43:28.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.533+0000 7fae794169c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T00:43:28.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.533+0000 7fae794169c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.8 2024-09-12T00:43:28.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.533+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.8 2024-09-12T00:43:28.534 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.533+0000 7fae794169c0 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-12T00:43:28.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.533+0000 7fae794169c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.9 2024-09-12T00:43:28.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.533+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.9 2024-09-12T00:43:28.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.533+0000 7fae794169c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.10 2024-09-12T00:43:28.535 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.533+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.10 2024-09-12T00:43:28.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.533+0000 7fae794169c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T00:43:28.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.533+0000 7fae794169c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.11 2024-09-12T00:43:28.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.533+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.11 2024-09-12T00:43:28.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.537+0000 7fae794169c0 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-12T00:43:28.537 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.537+0000 7fae794169c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.12 2024-09-12T00:43:28.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.537+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.12 2024-09-12T00:43:28.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.537+0000 7fae794169c0 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-12T00:43:28.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.537+0000 7fae794169c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.13 2024-09-12T00:43:28.538 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.537+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.13 2024-09-12T00:43:28.539 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.537+0000 7fae794169c0 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-12T00:43:28.539 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.537+0000 7fae794169c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.14 2024-09-12T00:43:28.539 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.537+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.14 2024-09-12T00:43:28.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.537+0000 7fae794169c0 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-12T00:43:28.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.537+0000 7fae794169c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.15 2024-09-12T00:43:28.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.537+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.15 2024-09-12T00:43:28.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.537+0000 7fae794169c0 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-12T00:43:28.540 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.537+0000 7fae794169c0 10 bucket_obj is .dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.16 2024-09-12T00:43:28.541 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.537+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.16 2024-09-12T00:43:28.541 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.541+0000 7fae794169c0 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-12T00:43:28.541 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.541+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.9 2024-09-12T00:43:28.542 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.541+0000 7fae794169c0 20 get_obj_state: octx=0x5638e5b537e0 obj=myver:x state=0x5638e5eaf3f8 s->prefetch_data=0 2024-09-12T00:43:28.543 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.541+0000 7fae794169c0 20 get_obj_state: setting s->obj_tag to 5hfsm1cc8m9fc73cgbldxycpghvaaon5 2024-09-12T00:43:28.543 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.541+0000 7fae794169c0 20 get_obj_state_impl: setting s->olh_tag to 1ihfostqi35ssuyejx68myv6y51d40xb 2024-09-12T00:43:28.543 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.541+0000 7fae794169c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=1ihfostqi35ssuyejx68myv6y51d40xb 2024-09-12T00:43:28.545 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.545+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.9 2024-09-12T00:43:28.547 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.545+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.9 2024-09-12T00:43:28.548 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.545+0000 7fae794169c0 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-12T00:43:28.548 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.545+0000 7fae794169c0 20 olh_log_entry: epoch=2 op=3 key=x[EM5tpDHh..HQb--wcnjq8p-7MidOVHb] 2024-09-12T00:43:28.548 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.545+0000 7fae794169c0 20 get_obj_state: octx=0x5638e5b537e0 obj=myver:_:EM5tpDHh..HQb--wcnjq8p-7MidOVHb_x state=0x5638e5eddcb8 s->prefetch_data=0 2024-09-12T00:43:28.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.545+0000 7fae794169c0 10 manifest: total_size = 22 2024-09-12T00:43:28.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.545+0000 7fae794169c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11168407414290475260 2024-09-12T00:43:28.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.545+0000 7fae794169c0 20 get_obj_state: octx=0x5638e5b537e0 obj=myver:_:EM5tpDHh..HQb--wcnjq8p-7MidOVHb_x state=0x5638e5eddcb8 s->prefetch_data=0 2024-09-12T00:43:28.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.545+0000 7fae794169c0 20 prepare_atomic_modification: state is not atomic. state=0x5638e5eddcb8 2024-09-12T00:43:28.549 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.545+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.9 2024-09-12T00:43:28.553 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.549+0000 7fae794169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:43:28.553 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.549+0000 7fae794169c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:43:28.553 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.549+0000 7fae794169c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:43:28.553 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.549+0000 7fae794169c0 5 delete_objs_inline: removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18__shadow:EM5tpDHh..HQb--wcnjq8p-7MidOVHb_.nj8qN2WJmBQkd8O8jhOC8x8TrrtYe4m_0 2024-09-12T00:43:28.554 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.553+0000 7fad5a7fc640 20 handle_completion(): completion ok for obj=x[EM5tpDHh..HQb--wcnjq8p-7MidOVHb] 2024-09-12T00:43:28.555 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.553+0000 7fae794169c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:43:28.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.557+0000 7fae794169c0 20 get_obj_state: octx=0x5638e5b537e0 obj=myver:x state=0x5638e5eaf3f8 s->prefetch_data=0 2024-09-12T00:43:28.558 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.557+0000 7fae794169c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=1ihfostqi35ssuyejx68myv6y51d40xb 2024-09-12T00:43:28.563 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.561+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.9 2024-09-12T00:43:28.565 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.561+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.9 2024-09-12T00:43:28.565 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.565+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.9 2024-09-12T00:43:28.566 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.565+0000 7fae794169c0 20 get_obj_state: octx=0x5638e5b537e0 obj=myver:y state=0x5638e5eb41f8 s->prefetch_data=0 2024-09-12T00:43:28.566 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.565+0000 7fae794169c0 20 get_obj_state: setting s->obj_tag to cd8apm72u8iytzuw1fo6arry433hlfzh 2024-09-12T00:43:28.566 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.565+0000 7fae794169c0 20 get_obj_state_impl: setting s->olh_tag to um5k4wk4qbahu8mqnzdphktgpr3s690b 2024-09-12T00:43:28.566 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.565+0000 7fae794169c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=um5k4wk4qbahu8mqnzdphktgpr3s690b 2024-09-12T00:43:28.568 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.565+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.9 2024-09-12T00:43:28.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.569+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.9 2024-09-12T00:43:28.570 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.569+0000 7fae794169c0 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-12T00:43:28.571 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.569+0000 7fae794169c0 20 olh_log_entry: epoch=2 op=3 key=y[4DRKuzqK5fGmyg-Xe8btn-uGW3UQdYp] 2024-09-12T00:43:28.571 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.569+0000 7fae794169c0 20 get_obj_state: octx=0x5638e5b537e0 obj=myver:_:4DRKuzqK5fGmyg-Xe8btn-uGW3UQdYp_y state=0x5638e5eddcb8 s->prefetch_data=0 2024-09-12T00:43:28.571 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.569+0000 7fae794169c0 10 manifest: total_size = 22 2024-09-12T00:43:28.571 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.569+0000 7fae794169c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9083477219414018972 2024-09-12T00:43:28.571 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.569+0000 7fae794169c0 20 get_obj_state: octx=0x5638e5b537e0 obj=myver:_:4DRKuzqK5fGmyg-Xe8btn-uGW3UQdYp_y state=0x5638e5eddcb8 s->prefetch_data=0 2024-09-12T00:43:28.571 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.569+0000 7fae794169c0 20 prepare_atomic_modification: state is not atomic. state=0x5638e5eddcb8 2024-09-12T00:43:28.572 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.569+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.9 2024-09-12T00:43:28.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.573+0000 7fae794169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:43:28.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.573+0000 7fae794169c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:43:28.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.573+0000 7fae794169c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:43:28.574 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.573+0000 7fae794169c0 5 delete_objs_inline: removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18__shadow:4DRKuzqK5fGmyg-Xe8btn-uGW3UQdYp_.7P0Ilz_S_KyHLGQMM7nlO3X5DvBR-gg_0 2024-09-12T00:43:28.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.573+0000 7fad5a7fc640 20 handle_completion(): completion ok for obj=y[4DRKuzqK5fGmyg-Xe8btn-uGW3UQdYp] 2024-09-12T00:43:28.576 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.573+0000 7fae794169c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:43:28.578 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.577+0000 7fae794169c0 20 get_obj_state: octx=0x5638e5b537e0 obj=myver:y state=0x5638e5eb41f8 s->prefetch_data=0 2024-09-12T00:43:28.578 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.577+0000 7fae794169c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=um5k4wk4qbahu8mqnzdphktgpr3s690b 2024-09-12T00:43:28.582 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.581+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.9 2024-09-12T00:43:28.583 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.581+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.9 2024-09-12T00:43:28.584 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.581+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.9 2024-09-12T00:43:28.584 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.581+0000 7fae794169c0 20 get_obj_state: octx=0x5638e5b537e0 obj=myver:z state=0x5638e5eb41f8 s->prefetch_data=0 2024-09-12T00:43:28.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.585+0000 7fae794169c0 20 get_obj_state: setting s->obj_tag to ferlng5gfcjze70n3ub1xue2g2eqmpzb 2024-09-12T00:43:28.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.585+0000 7fae794169c0 20 get_obj_state_impl: setting s->olh_tag to 4cid0789fw2ieua5v3mgz80a436869fb 2024-09-12T00:43:28.585 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.585+0000 7fae794169c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4cid0789fw2ieua5v3mgz80a436869fb 2024-09-12T00:43:28.588 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.585+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.9 2024-09-12T00:43:28.589 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.589+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.9 2024-09-12T00:43:28.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.589+0000 7fae794169c0 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-12T00:43:28.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.589+0000 7fae794169c0 20 olh_log_entry: epoch=2 op=3 key=z[4su32EO22CAhhHmDI2ThgAv8V6NPa-2] 2024-09-12T00:43:28.590 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.589+0000 7fae794169c0 20 get_obj_state: octx=0x5638e5b537e0 obj=myver:_:4su32EO22CAhhHmDI2ThgAv8V6NPa-2_z state=0x5638e5eddcb8 s->prefetch_data=0 2024-09-12T00:43:28.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.589+0000 7fae794169c0 10 manifest: total_size = 22 2024-09-12T00:43:28.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.589+0000 7fae794169c0 20 get_obj_state: setting s->obj_tag to af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10372123124036176950 2024-09-12T00:43:28.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.589+0000 7fae794169c0 20 get_obj_state: octx=0x5638e5b537e0 obj=myver:_:4su32EO22CAhhHmDI2ThgAv8V6NPa-2_z state=0x5638e5eddcb8 s->prefetch_data=0 2024-09-12T00:43:28.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.589+0000 7fae794169c0 20 prepare_atomic_modification: state is not atomic. state=0x5638e5eddcb8 2024-09-12T00:43:28.591 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.589+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.9 2024-09-12T00:43:28.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.589+0000 7fae794169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:43:28.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.589+0000 7fae794169c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:43:28.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.589+0000 7fae794169c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:43:28.593 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.589+0000 7fae794169c0 5 delete_objs_inline: removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18__shadow:4su32EO22CAhhHmDI2ThgAv8V6NPa-2_.4f8hLBkN7ITDUWwCNAw4QOxI-g8HXEn_0 2024-09-12T00:43:28.594 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.593+0000 7fad59ffb640 20 handle_completion(): completion ok for obj=z[4su32EO22CAhhHmDI2ThgAv8V6NPa-2] 2024-09-12T00:43:28.596 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.593+0000 7fae794169c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:43:28.598 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.597+0000 7fae794169c0 20 get_obj_state: octx=0x5638e5b537e0 obj=myver:z state=0x5638e5eb41f8 s->prefetch_data=0 2024-09-12T00:43:28.598 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.597+0000 7fae794169c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4cid0789fw2ieua5v3mgz80a436869fb 2024-09-12T00:43:28.602 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.601+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.9 2024-09-12T00:43:28.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.601+0000 7fae794169c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18.3.9 2024-09-12T00:43:28.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.601+0000 7fae794169c0 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-12T00:43:28.604 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.601+0000 7fae794169c0 1 NOTICE: finished all shards (3 entries removed) 2024-09-12T00:43:28.605 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.601+0000 7fad2d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:28.610 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.609+0000 7fae794169c0 20 remove_watcher() i=0 2024-09-12T00:43:28.610 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.609+0000 7fae794169c0 2 removed watcher, disabling cache 2024-09-12T00:43:28.612 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.609+0000 7fae794169c0 20 remove_watcher() i=1 2024-09-12T00:43:28.615 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.613+0000 7fae794169c0 20 remove_watcher() i=2 2024-09-12T00:43:28.617 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.617+0000 7fae794169c0 20 remove_watcher() i=3 2024-09-12T00:43:28.619 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.617+0000 7fae794169c0 20 remove_watcher() i=4 2024-09-12T00:43:28.621 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.617+0000 7fae794169c0 20 remove_watcher() i=5 2024-09-12T00:43:28.622 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.621+0000 7fae794169c0 20 remove_watcher() i=6 2024-09-12T00:43:28.624 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.621+0000 7fae794169c0 20 remove_watcher() i=7 2024-09-12T00:43:28.641 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:28.641 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:43:28.647 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:28.647 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:43:28.691 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:43:28.719 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:28.719 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:28.763 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.761+0000 7feda7bb59c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.761+0000 7feda7bb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:28.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.761+0000 7feda7bb59c0 20 realm 2024-09-12T00:43:28.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.761+0000 7feda7bb59c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.761+0000 7feda7bb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:28.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.761+0000 7feda7bb59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:28.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.761+0000 7feda7bb59c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.761+0000 7feda7bb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:28.765 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.761+0000 7feda7bb59c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.767 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.765+0000 7feda7bb59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:28.767 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.765+0000 7feda7bb59c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.768 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.765+0000 7feda7bb59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:28.768 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.765+0000 7feda7bb59c0 20 searching for the correct realm 2024-09-12T00:43:28.773 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.773+0000 7feda4eba640 0 -- 172.21.15.43:0/883651502 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x56543ea62e20 msgr2=0x56543ea65270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:28.780 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.777+0000 7feda56bb640 0 -- 172.21.15.43:0/883651502 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fed900ff390 msgr2=0x7fed90119190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:28.788 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.785+0000 7feda7bb59c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:43:28.788 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.785+0000 7feda7bb59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:28.789 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.785+0000 7feda7bb59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:28.789 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.785+0000 7feda7bb59c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:43:28.789 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.785+0000 7feda7bb59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:28.789 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.785+0000 7feda7bb59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:28.789 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.785+0000 7feda7bb59c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.789 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.785+0000 7feda7bb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:28.789 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.785+0000 7feda7bb59c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.789+0000 7feda7bb59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:28.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.789+0000 7feda7bb59c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.790 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.789+0000 7feda7bb59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:28.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.789+0000 7feda7bb59c0 20 zone default found 2024-09-12T00:43:28.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.789+0000 7feda7bb59c0 4 Realm: () 2024-09-12T00:43:28.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.789+0000 7feda7bb59c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:43:28.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.789+0000 7feda7bb59c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:43:28.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.789+0000 7feda7bb59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:28.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.789+0000 7feda7bb59c0 20 zonegroup default 2024-09-12T00:43:28.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.789+0000 7feda7bb59c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.791 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.789+0000 7feda7bb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:28.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.789+0000 7feda7bb59c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.789+0000 7feda7bb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:28.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.789+0000 7feda7bb59c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.789+0000 7feda7bb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:28.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.789+0000 7feda7bb59c0 20 started sync module instance, tier type = 2024-09-12T00:43:28.792 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.789+0000 7feda7bb59c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:43:28.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.805+0000 7feda7bb59c0 20 add_watcher() i=0 2024-09-12T00:43:28.807 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.805+0000 7feda7bb59c0 20 add_watcher() i=1 2024-09-12T00:43:28.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.805+0000 7feda7bb59c0 20 add_watcher() i=2 2024-09-12T00:43:28.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.805+0000 7feda7bb59c0 20 add_watcher() i=3 2024-09-12T00:43:28.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.805+0000 7feda7bb59c0 20 add_watcher() i=4 2024-09-12T00:43:28.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.805+0000 7feda7bb59c0 20 add_watcher() i=5 2024-09-12T00:43:28.808 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.805+0000 7feda7bb59c0 20 add_watcher() i=6 2024-09-12T00:43:28.809 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.809+0000 7feda7bb59c0 20 add_watcher() i=7 2024-09-12T00:43:28.810 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.809+0000 7feda7bb59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:28.812 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.809+0000 7fec5b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:28.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.809+0000 7feda7bb59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:28.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.809+0000 7feda7bb59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:28.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.809+0000 7feda7bb59c0 5 note: GC not initialized 2024-09-12T00:43:28.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.813+0000 7fec5a7e4640 20 reqs_thread_entry: start 2024-09-12T00:43:28.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.813+0000 7feda7bb59c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:28.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.813+0000 7feda7bb59c0 20 Filter name: none 2024-09-12T00:43:28.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.813+0000 7febcbfff640 20 reqs_thread_entry: start 2024-09-12T00:43:28.814 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.813+0000 7feda7bb59c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.813+0000 7feda7bb59c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:43:28.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.813+0000 7feda7bb59c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.815 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.813+0000 7feda7bb59c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:43:28.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.813+0000 7feda7bb59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:28.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.813+0000 7feda7bb59c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.813+0000 7feda7bb59c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:43:28.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.813+0000 7feda7bb59c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:28.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.813+0000 7feda7bb59c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:43:28.816 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.813+0000 7feda7bb59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:28.819 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.817+0000 7fec5b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:28.824 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.821+0000 7feda7bb59c0 20 remove_watcher() i=0 2024-09-12T00:43:28.824 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.821+0000 7feda7bb59c0 2 removed watcher, disabling cache 2024-09-12T00:43:28.826 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.825+0000 7feda7bb59c0 20 remove_watcher() i=1 2024-09-12T00:43:28.828 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.825+0000 7feda7bb59c0 20 remove_watcher() i=2 2024-09-12T00:43:28.830 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.829+0000 7feda7bb59c0 20 remove_watcher() i=3 2024-09-12T00:43:28.832 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.829+0000 7feda7bb59c0 20 remove_watcher() i=4 2024-09-12T00:43:28.835 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.833+0000 7feda7bb59c0 20 remove_watcher() i=5 2024-09-12T00:43:28.837 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.837+0000 7feda7bb59c0 20 remove_watcher() i=6 2024-09-12T00:43:28.839 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T00:43:28.837+0000 7feda7bb59c0 20 remove_watcher() i=7 2024-09-12T00:43:28.853 INFO:tasks.workunit.client.0.smithi043.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T00:43:28.854 INFO:tasks.workunit.client.0.smithi043.stderr:Deleting bucket a-bucket 2024-09-12T00:43:28.855 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:28.855 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:43:28.859 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:28.859 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:43:28.882 INFO:tasks.workunit.client.0.smithi043.stderr:Deleting bucket myver 2024-09-12T00:43:28.883 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:28.883 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:43:28.935 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:28.936 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T00:43:29.019 INFO:tasks.workunit.client.0.smithi043.stderr:Completed resharding tests 2024-09-12T00:43:29.020 INFO:tasks.workunit.client.0.smithi043.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T00:43:29.020 INFO:tasks.workunit.client.0.smithi043.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T00:43:29.020 INFO:tasks.workunit.client.0.smithi043.stdout:connected to https://localhost:443 2024-09-12T00:43:29.140 INFO:tasks.workunit.client.0.smithi043.stderr:+ deactivate 2024-09-12T00:43:29.140 INFO:tasks.workunit.client.0.smithi043.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T00:43:29.140 INFO:tasks.workunit.client.0.smithi043.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:43:29.140 INFO:tasks.workunit.client.0.smithi043.stderr:+ export PATH 2024-09-12T00:43:29.140 INFO:tasks.workunit.client.0.smithi043.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:43:29.141 INFO:tasks.workunit.client.0.smithi043.stderr:+ '[' -n '' ']' 2024-09-12T00:43:29.141 INFO:tasks.workunit.client.0.smithi043.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:43:29.141 INFO:tasks.workunit.client.0.smithi043.stderr:+ hash -r 2024-09-12T00:43:29.141 INFO:tasks.workunit.client.0.smithi043.stderr:+ '[' -n '' ']' 2024-09-12T00:43:29.141 INFO:tasks.workunit.client.0.smithi043.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:43:29.141 INFO:tasks.workunit.client.0.smithi043.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T00:43:29.141 INFO:tasks.workunit.client.0.smithi043.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:43:29.141 INFO:tasks.workunit.client.0.smithi043.stderr:+ unset -f deactivate 2024-09-12T00:43:29.141 INFO:tasks.workunit.client.0.smithi043.stderr:+ echo OK. 2024-09-12T00:43:29.142 INFO:tasks.workunit.client.0.smithi043.stdout:OK. 2024-09-12T00:43:29.143 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:43:29.143 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:43:29.196 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-12T00:43:29.196 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:43:29.652 DEBUG:teuthology.parallel:result is None 2024-09-12T00:43:29.652 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:43:29.665 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:43:29.666 DEBUG:teuthology.orchestra.run.smithi043:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:43:29.714 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:43:29.714 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-12T00:43:29.730 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-12T00:43:29.731 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-12T00:43:29.731 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-12T00:43:29.731 DEBUG:teuthology.orchestra.run.smithi043:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-12T00:43:29.762 INFO:teuthology.orchestra.run.smithi043.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-12T00:43:38.649 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-12T00:43:38.650 DEBUG:teuthology.orchestra.run.smithi043:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-12T00:43:38.748 INFO:teuthology.orchestra.run.smithi043.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required DEB packages. Installing via sudo. 2024-09-12T00:43:38.810 INFO:teuthology.orchestra.run.smithi043.stdout:Reading package lists... 2024-09-12T00:43:39.030 INFO:teuthology.orchestra.run.smithi043.stdout:Building dependency tree... 2024-09-12T00:43:39.030 INFO:teuthology.orchestra.run.smithi043.stdout:Reading state information... 2024-09-12T00:43:39.246 INFO:teuthology.orchestra.run.smithi043.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:43:39.246 INFO:teuthology.orchestra.run.smithi043.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:43:39.246 INFO:teuthology.orchestra.run.smithi043.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:43:39.247 INFO:teuthology.orchestra.run.smithi043.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:43:39.247 INFO:teuthology.orchestra.run.smithi043.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:43:39.247 INFO:teuthology.orchestra.run.smithi043.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:43:39.247 INFO:teuthology.orchestra.run.smithi043.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:43:39.248 INFO:teuthology.orchestra.run.smithi043.stdout:The following additional packages will be installed: 2024-09-12T00:43:39.249 INFO:teuthology.orchestra.run.smithi043.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-12T00:43:39.249 INFO:teuthology.orchestra.run.smithi043.stdout: openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-12T00:43:39.251 INFO:teuthology.orchestra.run.smithi043.stdout:Suggested packages: 2024-09-12T00:43:39.251 INFO:teuthology.orchestra.run.smithi043.stdout: gvfs openjdk-8-demo openjdk-8-source visualvm libnss-mdns fonts-nanum 2024-09-12T00:43:39.251 INFO:teuthology.orchestra.run.smithi043.stdout: fonts-ipafont-gothic fonts-ipafont-mincho fonts-wqy-microhei 2024-09-12T00:43:39.251 INFO:teuthology.orchestra.run.smithi043.stdout: fonts-wqy-zenhei fonts-indic 2024-09-12T00:43:39.288 INFO:teuthology.orchestra.run.smithi043.stdout:The following NEW packages will be installed: 2024-09-12T00:43:39.289 INFO:teuthology.orchestra.run.smithi043.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-12T00:43:39.289 INFO:teuthology.orchestra.run.smithi043.stdout: openjdk-8-jdk openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-12T00:43:39.363 INFO:teuthology.orchestra.run.smithi043.stdout:0 upgraded, 9 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:43:39.363 INFO:teuthology.orchestra.run.smithi043.stdout:Need to get 46.0 MB of archives. 2024-09-12T00:43:39.363 INFO:teuthology.orchestra.run.smithi043.stdout:After this operation, 155 MB of additional disk space will be used. 2024-09-12T00:43:39.363 INFO:teuthology.orchestra.run.smithi043.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-common all 2.24.33-2ubuntu2.1 [125 kB] 2024-09-12T00:43:39.442 INFO:teuthology.orchestra.run.smithi043.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-0 amd64 2.24.33-2ubuntu2.1 [2,038 kB] 2024-09-12T00:43:39.529 INFO:teuthology.orchestra.run.smithi043.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail18 amd64 2.24.33-2ubuntu2.1 [15.9 kB] 2024-09-12T00:43:39.530 INFO:teuthology.orchestra.run.smithi043.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail-common amd64 2.24.33-2ubuntu2.1 [132 kB] 2024-09-12T00:43:39.534 INFO:teuthology.orchestra.run.smithi043.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-bin amd64 2.24.33-2ubuntu2.1 [7,936 B] 2024-09-12T00:43:39.534 INFO:teuthology.orchestra.run.smithi043.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre-headless amd64 8u422-b05-1~22.04 [30.8 MB] 2024-09-12T00:43:39.988 INFO:teuthology.orchestra.run.smithi043.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre amd64 8u422-b05-1~22.04 [75.5 kB] 2024-09-12T00:43:39.989 INFO:teuthology.orchestra.run.smithi043.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk-headless amd64 8u422-b05-1~22.04 [8,843 kB] 2024-09-12T00:43:40.078 INFO:teuthology.orchestra.run.smithi043.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk amd64 8u422-b05-1~22.04 [4,012 kB] 2024-09-12T00:43:40.423 INFO:teuthology.orchestra.run.smithi043.stderr:debconf: unable to initialize frontend: Dialog 2024-09-12T00:43:40.423 INFO:teuthology.orchestra.run.smithi043.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-09-12T00:43:40.424 INFO:teuthology.orchestra.run.smithi043.stderr:debconf: falling back to frontend: Readline 2024-09-12T00:43:40.439 INFO:teuthology.orchestra.run.smithi043.stderr:debconf: unable to initialize frontend: Readline 2024-09-12T00:43:40.439 INFO:teuthology.orchestra.run.smithi043.stderr:debconf: (This frontend requires a controlling tty.) 2024-09-12T00:43:40.439 INFO:teuthology.orchestra.run.smithi043.stderr:debconf: falling back to frontend: Teletype 2024-09-12T00:43:40.442 INFO:teuthology.orchestra.run.smithi043.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-09-12T00:43:40.478 INFO:teuthology.orchestra.run.smithi043.stdout:Fetched 46.0 MB in 1s (56.9 MB/s) 2024-09-12T00:43:40.589 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libgtk2.0-common. 2024-09-12T00:43:40.662 INFO:teuthology.orchestra.run.smithi043.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 177243 files and directories currently installed.) 2024-09-12T00:43:40.668 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../0-libgtk2.0-common_2.24.33-2ubuntu2.1_all.deb ... 2024-09-12T00:43:40.713 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-12T00:43:41.175 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libgtk2.0-0:amd64. 2024-09-12T00:43:41.205 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../1-libgtk2.0-0_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T00:43:41.283 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T00:43:41.688 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libgail18:amd64. 2024-09-12T00:43:41.705 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../2-libgail18_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T00:43:41.746 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T00:43:41.957 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libgail-common:amd64. 2024-09-12T00:43:41.974 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../3-libgail-common_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T00:43:42.015 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T00:43:42.276 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package libgtk2.0-bin. 2024-09-12T00:43:42.293 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../4-libgtk2.0-bin_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T00:43:42.334 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-12T00:43:42.697 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package openjdk-8-jre-headless:amd64. 2024-09-12T00:43:42.725 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../5-openjdk-8-jre-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T00:43:42.758 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:43:44.376 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package openjdk-8-jre:amd64. 2024-09-12T00:43:44.390 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../6-openjdk-8-jre_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T00:43:44.438 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:43:44.856 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package openjdk-8-jdk-headless:amd64. 2024-09-12T00:43:44.885 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../7-openjdk-8-jdk-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T00:43:44.926 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:43:45.644 INFO:teuthology.orchestra.run.smithi043.stdout:Selecting previously unselected package openjdk-8-jdk:amd64. 2024-09-12T00:43:45.673 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing to unpack .../8-openjdk-8-jdk_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T00:43:45.714 INFO:teuthology.orchestra.run.smithi043.stdout:Unpacking openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:43:46.039 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:43:47.152 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/orbd to provide /usr/bin/orbd (orbd) in auto mode 2024-09-12T00:43:47.179 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/servertool to provide /usr/bin/servertool (servertool) in auto mode 2024-09-12T00:43:47.203 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/tnameserv to provide /usr/bin/tnameserv (tnameserv) in auto mode 2024-09-12T00:43:47.569 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-12T00:43:47.703 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T00:43:48.340 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:43:48.430 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/policytool to provide /usr/bin/policytool (policytool) in auto mode 2024-09-12T00:43:48.499 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:43:48.591 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/clhsdb to provide /usr/bin/clhsdb (clhsdb) in auto mode 2024-09-12T00:43:48.620 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/extcheck to provide /usr/bin/extcheck (extcheck) in auto mode 2024-09-12T00:43:48.644 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/hsdb to provide /usr/bin/hsdb (hsdb) in auto mode 2024-09-12T00:43:48.670 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/idlj to provide /usr/bin/idlj (idlj) in auto mode 2024-09-12T00:43:48.799 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/javah to provide /usr/bin/javah (javah) in auto mode 2024-09-12T00:43:48.943 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jhat to provide /usr/bin/jhat (jhat) in auto mode 2024-09-12T00:43:49.059 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jsadebugd to provide /usr/bin/jsadebugd (jsadebugd) in auto mode 2024-09-12T00:43:49.154 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/native2ascii to provide /usr/bin/native2ascii (native2ascii) in auto mode 2024-09-12T00:43:49.204 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/schemagen to provide /usr/bin/schemagen (schemagen) in auto mode 2024-09-12T00:43:49.255 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsgen to provide /usr/bin/wsgen (wsgen) in auto mode 2024-09-12T00:43:49.280 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsimport to provide /usr/bin/wsimport (wsimport) in auto mode 2024-09-12T00:43:49.306 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/xjc to provide /usr/bin/xjc (xjc) in auto mode 2024-09-12T00:43:49.362 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T00:43:49.488 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-12T00:43:49.614 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:43:49.707 INFO:teuthology.orchestra.run.smithi043.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/appletviewer to provide /usr/bin/appletviewer (appletviewer) in auto mode 2024-09-12T00:43:49.791 INFO:teuthology.orchestra.run.smithi043.stdout:Setting up libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T00:43:49.918 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:43:51.028 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T00:43:51.129 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-12T00:43:51.406 INFO:teuthology.orchestra.run.smithi043.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T00:43:51.846 INFO:teuthology.orchestra.run.smithi043.stdout: Gradle will be installed under /opt/gradle 2024-09-12T00:43:51.882 INFO:teuthology.orchestra.run.smithi043.stderr:--2024-09-12 00:43:51-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-12T00:43:51.901 INFO:teuthology.orchestra.run.smithi043.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.73.101, 104.16.72.101, 2606:4700::6810:4865, ... 2024-09-12T00:43:51.914 INFO:teuthology.orchestra.run.smithi043.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.73.101|:443... connected. 2024-09-12T00:43:51.968 INFO:teuthology.orchestra.run.smithi043.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-12T00:43:51.968 INFO:teuthology.orchestra.run.smithi043.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-12T00:43:51.968 INFO:teuthology.orchestra.run.smithi043.stderr:--2024-09-12 00:43:51-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-12T00:43:51.969 INFO:teuthology.orchestra.run.smithi043.stderr:Resolving github.com (github.com)... 140.82.113.3 2024-09-12T00:43:51.978 INFO:teuthology.orchestra.run.smithi043.stderr:Connecting to github.com (github.com)|140.82.113.3|:443... connected. 2024-09-12T00:43:52.056 INFO:teuthology.orchestra.run.smithi043.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-12T00:43:52.056 INFO:teuthology.orchestra.run.smithi043.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T004352Z&X-Amz-Expires=300&X-Amz-Signature=d062dc89c5e7771ca3a2d2116eb4e1565727e7430bf3df31e0cbfbf47886f05e&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-12T00:43:52.057 INFO:teuthology.orchestra.run.smithi043.stderr:--2024-09-12 00:43:52-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T004352Z&X-Amz-Expires=300&X-Amz-Signature=d062dc89c5e7771ca3a2d2116eb4e1565727e7430bf3df31e0cbfbf47886f05e&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-12T00:43:52.072 INFO:teuthology.orchestra.run.smithi043.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.111.133, 185.199.109.133, 185.199.110.133, ... 2024-09-12T00:43:52.085 INFO:teuthology.orchestra.run.smithi043.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.111.133|:443... connected. 2024-09-12T00:43:52.165 INFO:teuthology.orchestra.run.smithi043.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T00:43:52.165 INFO:teuthology.orchestra.run.smithi043.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-12T00:43:52.165 INFO:teuthology.orchestra.run.smithi043.stderr:Saving to: 'gradle-6.0.1-bin.zip' 2024-09-12T00:43:52.165 INFO:teuthology.orchestra.run.smithi043.stderr: 2024-09-12T00:43:52.178 INFO:teuthology.orchestra.run.smithi043.stderr: 0K .......... .......... .......... .......... .......... 0% 3.57M 25s 2024-09-12T00:43:52.188 INFO:teuthology.orchestra.run.smithi043.stderr: 50K .......... .......... .......... .......... .......... 0% 4.99M 22s 2024-09-12T00:43:52.190 INFO:teuthology.orchestra.run.smithi043.stderr: 100K .......... .......... .......... .......... .......... 0% 20.0M 16s 2024-09-12T00:43:52.193 INFO:teuthology.orchestra.run.smithi043.stderr: 150K .......... .......... .......... .......... .......... 0% 15.5M 13s 2024-09-12T00:43:52.200 INFO:teuthology.orchestra.run.smithi043.stderr: 200K .......... .......... .......... .......... .......... 0% 7.62M 13s 2024-09-12T00:43:52.202 INFO:teuthology.orchestra.run.smithi043.stderr: 250K .......... .......... .......... .......... .......... 0% 41.1M 11s 2024-09-12T00:43:52.204 INFO:teuthology.orchestra.run.smithi043.stderr: 300K .......... .......... .......... .......... .......... 0% 19.4M 10s 2024-09-12T00:43:52.204 INFO:teuthology.orchestra.run.smithi043.stderr: 350K .......... .......... .......... .......... .......... 0% 69.7M 9s 2024-09-12T00:43:52.206 INFO:teuthology.orchestra.run.smithi043.stderr: 400K .......... .......... .......... .......... .......... 0% 41.0M 8s 2024-09-12T00:43:52.212 INFO:teuthology.orchestra.run.smithi043.stderr: 450K .......... .......... .......... .......... .......... 0% 9.03M 9s 2024-09-12T00:43:52.213 INFO:teuthology.orchestra.run.smithi043.stderr: 500K .......... .......... .......... .......... .......... 0% 38.8M 8s 2024-09-12T00:43:52.213 INFO:teuthology.orchestra.run.smithi043.stderr: 550K .......... .......... .......... .......... .......... 0% 86.9M 7s 2024-09-12T00:43:52.219 INFO:teuthology.orchestra.run.smithi043.stderr: 600K .......... .......... .......... .......... .......... 0% 43.8M 7s 2024-09-12T00:43:52.219 INFO:teuthology.orchestra.run.smithi043.stderr: 650K .......... .......... .......... .......... .......... 0% 141M 7s 2024-09-12T00:43:52.219 INFO:teuthology.orchestra.run.smithi043.stderr: 700K .......... .......... .......... .......... .......... 0% 33.0M 6s 2024-09-12T00:43:52.219 INFO:teuthology.orchestra.run.smithi043.stderr: 750K .......... .......... .......... .......... .......... 0% 77.2M 6s 2024-09-12T00:43:52.220 INFO:teuthology.orchestra.run.smithi043.stderr: 800K .......... .......... .......... .......... .......... 0% 104M 6s 2024-09-12T00:43:52.220 INFO:teuthology.orchestra.run.smithi043.stderr: 850K .......... .......... .......... .......... .......... 0% 123M 5s 2024-09-12T00:43:52.220 INFO:teuthology.orchestra.run.smithi043.stderr: 900K .......... .......... .......... .......... .......... 1% 110M 5s 2024-09-12T00:43:53.465 INFO:teuthology.orchestra.run.smithi043.stderr: 950K .......... .......... .......... .......... .......... 1% 10.1M 5s 2024-09-12T00:43:53.465 INFO:teuthology.orchestra.run.smithi043.stderr: 1000K .......... .......... .......... .......... .......... 1% 129M 5s 2024-09-12T00:43:53.465 INFO:teuthology.orchestra.run.smithi043.stderr: 1050K .......... .......... .......... .......... .......... 1% 88.2M 5s 2024-09-12T00:43:53.465 INFO:teuthology.orchestra.run.smithi043.stderr: 1100K .......... .......... .......... .......... .......... 1% 88.2M 5s 2024-09-12T00:43:53.465 INFO:teuthology.orchestra.run.smithi043.stderr: 1150K .......... .......... .......... .......... .......... 1% 109M 5s 2024-09-12T00:43:53.465 INFO:teuthology.orchestra.run.smithi043.stderr: 1200K .......... .......... .......... .......... .......... 1% 56.2M 4s 2024-09-12T00:43:53.466 INFO:teuthology.orchestra.run.smithi043.stderr: 1250K .......... .......... .......... .......... .......... 1% 116M 4s 2024-09-12T00:43:53.466 INFO:teuthology.orchestra.run.smithi043.stderr: 1300K .......... .......... .......... .......... .......... 1% 118M 4s 2024-09-12T00:43:53.466 INFO:teuthology.orchestra.run.smithi043.stderr: 1350K .......... .......... .......... .......... .......... 1% 146M 4s 2024-09-12T00:43:53.466 INFO:teuthology.orchestra.run.smithi043.stderr: 1400K .......... .......... .......... .......... .......... 1% 143M 4s 2024-09-12T00:43:53.466 INFO:teuthology.orchestra.run.smithi043.stderr: 1450K .......... .......... .......... .......... .......... 1% 134M 4s 2024-09-12T00:43:53.466 INFO:teuthology.orchestra.run.smithi043.stderr: 1500K .......... .......... .......... .......... .......... 1% 106M 4s 2024-09-12T00:43:53.466 INFO:teuthology.orchestra.run.smithi043.stderr: 1550K .......... .......... .......... .......... .......... 1% 139M 4s 2024-09-12T00:43:53.466 INFO:teuthology.orchestra.run.smithi043.stderr: 1600K .......... .......... .......... .......... .......... 1% 127M 4s 2024-09-12T00:43:53.466 INFO:teuthology.orchestra.run.smithi043.stderr: 1650K .......... .......... .......... .......... .......... 1% 118M 3s 2024-09-12T00:43:53.466 INFO:teuthology.orchestra.run.smithi043.stderr: 1700K .......... .......... .......... .......... .......... 1% 100M 3s 2024-09-12T00:43:53.466 INFO:teuthology.orchestra.run.smithi043.stderr: 1750K .......... .......... .......... .......... .......... 1% 102M 3s 2024-09-12T00:43:53.466 INFO:teuthology.orchestra.run.smithi043.stderr: 1800K .......... .......... .......... .......... .......... 1% 115M 3s 2024-09-12T00:43:53.466 INFO:teuthology.orchestra.run.smithi043.stderr: 1850K .......... .......... .......... .......... .......... 2% 144M 3s 2024-09-12T00:43:53.467 INFO:teuthology.orchestra.run.smithi043.stderr: 1900K .......... .......... .......... .......... .......... 2% 119M 3s 2024-09-12T00:43:53.467 INFO:teuthology.orchestra.run.smithi043.stderr: 1950K .......... .......... .......... .......... .......... 2% 148M 3s 2024-09-12T00:43:53.467 INFO:teuthology.orchestra.run.smithi043.stderr: 2000K .......... .......... .......... .......... .......... 2% 16.7M 3s 2024-09-12T00:43:53.467 INFO:teuthology.orchestra.run.smithi043.stderr: 2050K .......... .......... .......... .......... .......... 2% 121M 3s 2024-09-12T00:43:53.467 INFO:teuthology.orchestra.run.smithi043.stderr: 2100K .......... .......... .......... .......... .......... 2% 96.2M 3s 2024-09-12T00:43:53.467 INFO:teuthology.orchestra.run.smithi043.stderr: 2150K .......... .......... .......... .......... .......... 2% 116M 3s 2024-09-12T00:43:53.467 INFO:teuthology.orchestra.run.smithi043.stderr: 2200K .......... .......... .......... .......... .......... 2% 108M 3s 2024-09-12T00:43:53.467 INFO:teuthology.orchestra.run.smithi043.stderr: 2250K .......... .......... .......... .......... .......... 2% 105M 3s 2024-09-12T00:43:53.467 INFO:teuthology.orchestra.run.smithi043.stderr: 2300K .......... .......... .......... .......... .......... 2% 119M 3s 2024-09-12T00:43:53.467 INFO:teuthology.orchestra.run.smithi043.stderr: 2350K .......... .......... .......... .......... .......... 2% 120M 3s 2024-09-12T00:43:53.467 INFO:teuthology.orchestra.run.smithi043.stderr: 2400K .......... .......... .......... .......... .......... 2% 132M 3s 2024-09-12T00:43:53.467 INFO:teuthology.orchestra.run.smithi043.stderr: 2450K .......... .......... .......... .......... .......... 2% 142M 3s 2024-09-12T00:43:53.468 INFO:teuthology.orchestra.run.smithi043.stderr: 2500K .......... .......... .......... .......... .......... 2% 121M 3s 2024-09-12T00:43:53.468 INFO:teuthology.orchestra.run.smithi043.stderr: 2550K .......... .......... .......... .......... .......... 2% 135M 3s 2024-09-12T00:43:53.468 INFO:teuthology.orchestra.run.smithi043.stderr: 2600K .......... .......... .......... .......... .......... 2% 129M 3s 2024-09-12T00:43:53.468 INFO:teuthology.orchestra.run.smithi043.stderr: 2650K .......... .......... .......... .......... .......... 2% 130M 3s 2024-09-12T00:43:53.468 INFO:teuthology.orchestra.run.smithi043.stderr: 2700K .......... .......... .......... .......... .......... 2% 112M 2s 2024-09-12T00:43:53.468 INFO:teuthology.orchestra.run.smithi043.stderr: 2750K .......... .......... .......... .......... .......... 3% 137M 2s 2024-09-12T00:43:53.468 INFO:teuthology.orchestra.run.smithi043.stderr: 2800K .......... .......... .......... .......... .......... 3% 130M 2s 2024-09-12T00:43:53.468 INFO:teuthology.orchestra.run.smithi043.stderr: 2850K .......... .......... .......... .......... .......... 3% 125M 2s 2024-09-12T00:43:53.468 INFO:teuthology.orchestra.run.smithi043.stderr: 2900K .......... .......... .......... .......... .......... 3% 113M 2s 2024-09-12T00:43:53.468 INFO:teuthology.orchestra.run.smithi043.stderr: 2950K .......... .......... .......... .......... .......... 3% 130M 2s 2024-09-12T00:43:53.468 INFO:teuthology.orchestra.run.smithi043.stderr: 3000K .......... .......... .......... .......... .......... 3% 127M 2s 2024-09-12T00:43:53.468 INFO:teuthology.orchestra.run.smithi043.stderr: 3050K .......... .......... .......... .......... .......... 3% 143M 2s 2024-09-12T00:43:53.468 INFO:teuthology.orchestra.run.smithi043.stderr: 3100K .......... .......... .......... .......... .......... 3% 119M 2s 2024-09-12T00:43:53.469 INFO:teuthology.orchestra.run.smithi043.stderr: 3150K .......... .......... .......... .......... .......... 3% 141M 2s 2024-09-12T00:43:53.469 INFO:teuthology.orchestra.run.smithi043.stderr: 3200K .......... .......... .......... .......... .......... 3% 148M 2s 2024-09-12T00:43:53.469 INFO:teuthology.orchestra.run.smithi043.stderr: 3250K .......... .......... .......... .......... .......... 3% 145M 2s 2024-09-12T00:43:53.469 INFO:teuthology.orchestra.run.smithi043.stderr: 3300K .......... .......... .......... .......... .......... 3% 130M 2s 2024-09-12T00:43:53.469 INFO:teuthology.orchestra.run.smithi043.stderr: 3350K .......... .......... .......... .......... .......... 3% 147M 2s 2024-09-12T00:43:53.469 INFO:teuthology.orchestra.run.smithi043.stderr: 3400K .......... .......... .......... .......... .......... 3% 142M 2s 2024-09-12T00:43:53.469 INFO:teuthology.orchestra.run.smithi043.stderr: 3450K .......... .......... .......... .......... .......... 3% 139M 2s 2024-09-12T00:43:53.469 INFO:teuthology.orchestra.run.smithi043.stderr: 3500K .......... .......... .......... .......... .......... 3% 109M 2s 2024-09-12T00:43:53.469 INFO:teuthology.orchestra.run.smithi043.stderr: 3550K .......... .......... .......... .......... .......... 3% 131M 2s 2024-09-12T00:43:53.469 INFO:teuthology.orchestra.run.smithi043.stderr: 3600K .......... .......... .......... .......... .......... 3% 132M 2s 2024-09-12T00:43:53.469 INFO:teuthology.orchestra.run.smithi043.stderr: 3650K .......... .......... .......... .......... .......... 3% 128M 2s 2024-09-12T00:43:53.469 INFO:teuthology.orchestra.run.smithi043.stderr: 3700K .......... .......... .......... .......... .......... 4% 126M 2s 2024-09-12T00:43:53.470 INFO:teuthology.orchestra.run.smithi043.stderr: 3750K .......... .......... .......... .......... .......... 4% 128M 2s 2024-09-12T00:43:53.470 INFO:teuthology.orchestra.run.smithi043.stderr: 3800K .......... .......... .......... .......... .......... 4% 134M 2s 2024-09-12T00:43:53.470 INFO:teuthology.orchestra.run.smithi043.stderr: 3850K .......... .......... .......... .......... .......... 4% 133M 2s 2024-09-12T00:43:53.470 INFO:teuthology.orchestra.run.smithi043.stderr: 3900K .......... .......... .......... .......... .......... 4% 109M 2s 2024-09-12T00:43:53.470 INFO:teuthology.orchestra.run.smithi043.stderr: 3950K .......... .......... .......... .......... .......... 4% 126M 2s 2024-09-12T00:43:53.470 INFO:teuthology.orchestra.run.smithi043.stderr: 4000K .......... .......... .......... .......... .......... 4% 121M 2s 2024-09-12T00:43:53.470 INFO:teuthology.orchestra.run.smithi043.stderr: 4050K .......... .......... .......... .......... .......... 4% 139M 2s 2024-09-12T00:43:53.470 INFO:teuthology.orchestra.run.smithi043.stderr: 4100K .......... .......... .......... .......... .......... 4% 125M 2s 2024-09-12T00:43:53.470 INFO:teuthology.orchestra.run.smithi043.stderr: 4150K .......... .......... .......... .......... .......... 4% 129M 2s 2024-09-12T00:43:53.470 INFO:teuthology.orchestra.run.smithi043.stderr: 4200K .......... .......... .......... .......... .......... 4% 107M 2s 2024-09-12T00:43:53.470 INFO:teuthology.orchestra.run.smithi043.stderr: 4250K .......... .......... .......... .......... .......... 4% 131M 2s 2024-09-12T00:43:53.470 INFO:teuthology.orchestra.run.smithi043.stderr: 4300K .......... .......... .......... .......... .......... 4% 107M 2s 2024-09-12T00:43:53.470 INFO:teuthology.orchestra.run.smithi043.stderr: 4350K .......... .......... .......... .......... .......... 4% 100M 2s 2024-09-12T00:43:53.471 INFO:teuthology.orchestra.run.smithi043.stderr: 4400K .......... .......... .......... .......... .......... 4% 120M 2s 2024-09-12T00:43:53.471 INFO:teuthology.orchestra.run.smithi043.stderr: 4450K .......... .......... .......... .......... .......... 4% 92.5M 2s 2024-09-12T00:43:53.471 INFO:teuthology.orchestra.run.smithi043.stderr: 4500K .......... .......... .......... .......... .......... 4% 86.4M 2s 2024-09-12T00:43:53.471 INFO:teuthology.orchestra.run.smithi043.stderr: 4550K .......... .......... .......... .......... .......... 4% 125M 2s 2024-09-12T00:43:53.471 INFO:teuthology.orchestra.run.smithi043.stderr: 4600K .......... .......... .......... .......... .......... 5% 140M 2s 2024-09-12T00:43:53.471 INFO:teuthology.orchestra.run.smithi043.stderr: 4650K .......... .......... .......... .......... .......... 5% 144M 2s 2024-09-12T00:43:53.471 INFO:teuthology.orchestra.run.smithi043.stderr: 4700K .......... .......... .......... .......... .......... 5% 112M 2s 2024-09-12T00:43:53.471 INFO:teuthology.orchestra.run.smithi043.stderr: 4750K .......... .......... .......... .......... .......... 5% 147M 2s 2024-09-12T00:43:53.471 INFO:teuthology.orchestra.run.smithi043.stderr: 4800K .......... .......... .......... .......... .......... 5% 145M 2s 2024-09-12T00:43:53.471 INFO:teuthology.orchestra.run.smithi043.stderr: 4850K .......... .......... .......... .......... .......... 5% 142M 2s 2024-09-12T00:43:53.471 INFO:teuthology.orchestra.run.smithi043.stderr: 4900K .......... .......... .......... .......... .......... 5% 127M 2s 2024-09-12T00:43:53.471 INFO:teuthology.orchestra.run.smithi043.stderr: 4950K .......... .......... .......... .......... .......... 5% 122M 2s 2024-09-12T00:43:53.471 INFO:teuthology.orchestra.run.smithi043.stderr: 5000K .......... .......... .......... .......... .......... 5% 126M 2s 2024-09-12T00:43:53.471 INFO:teuthology.orchestra.run.smithi043.stderr: 5050K .......... .......... .......... .......... .......... 5% 121M 2s 2024-09-12T00:43:53.472 INFO:teuthology.orchestra.run.smithi043.stderr: 5100K .......... .......... .......... .......... .......... 5% 108M 2s 2024-09-12T00:43:53.472 INFO:teuthology.orchestra.run.smithi043.stderr: 5150K .......... .......... .......... .......... .......... 5% 125M 2s 2024-09-12T00:43:53.472 INFO:teuthology.orchestra.run.smithi043.stderr: 5200K .......... .......... .......... .......... .......... 5% 135M 2s 2024-09-12T00:43:53.472 INFO:teuthology.orchestra.run.smithi043.stderr: 5250K .......... .......... .......... .......... .......... 5% 141M 2s 2024-09-12T00:43:53.472 INFO:teuthology.orchestra.run.smithi043.stderr: 5300K .......... .......... .......... .......... .......... 5% 129M 2s 2024-09-12T00:43:53.472 INFO:teuthology.orchestra.run.smithi043.stderr: 5350K .......... .......... .......... .......... .......... 5% 135M 2s 2024-09-12T00:43:53.472 INFO:teuthology.orchestra.run.smithi043.stderr: 5400K .......... .......... .......... .......... .......... 5% 113M 2s 2024-09-12T00:43:53.472 INFO:teuthology.orchestra.run.smithi043.stderr: 5450K .......... .......... .......... .......... .......... 5% 130M 2s 2024-09-12T00:43:53.472 INFO:teuthology.orchestra.run.smithi043.stderr: 5500K .......... .......... .......... .......... .......... 5% 110M 2s 2024-09-12T00:43:53.472 INFO:teuthology.orchestra.run.smithi043.stderr: 5550K .......... .......... .......... .......... .......... 6% 137M 2s 2024-09-12T00:43:53.472 INFO:teuthology.orchestra.run.smithi043.stderr: 5600K .......... .......... .......... .......... .......... 6% 136M 2s 2024-09-12T00:43:53.472 INFO:teuthology.orchestra.run.smithi043.stderr: 5650K .......... .......... .......... .......... .......... 6% 139M 2s 2024-09-12T00:43:53.472 INFO:teuthology.orchestra.run.smithi043.stderr: 5700K .......... .......... .......... .......... .......... 6% 126M 1s 2024-09-12T00:43:53.473 INFO:teuthology.orchestra.run.smithi043.stderr: 5750K .......... .......... .......... .......... .......... 6% 136M 1s 2024-09-12T00:43:53.473 INFO:teuthology.orchestra.run.smithi043.stderr: 5800K .......... .......... .......... .......... .......... 6% 128M 1s 2024-09-12T00:43:53.473 INFO:teuthology.orchestra.run.smithi043.stderr: 5850K .......... .......... .......... .......... .......... 6% 128M 1s 2024-09-12T00:43:53.473 INFO:teuthology.orchestra.run.smithi043.stderr: 5900K .......... .......... .......... .......... .......... 6% 105M 1s 2024-09-12T00:43:53.473 INFO:teuthology.orchestra.run.smithi043.stderr: 5950K .......... .......... .......... .......... .......... 6% 104M 1s 2024-09-12T00:43:53.473 INFO:teuthology.orchestra.run.smithi043.stderr: 6000K .......... .......... .......... .......... .......... 6% 133M 1s 2024-09-12T00:43:53.473 INFO:teuthology.orchestra.run.smithi043.stderr: 6050K .......... .......... .......... .......... .......... 6% 142M 1s 2024-09-12T00:43:53.473 INFO:teuthology.orchestra.run.smithi043.stderr: 6100K .......... .......... .......... .......... .......... 6% 109M 1s 2024-09-12T00:43:53.473 INFO:teuthology.orchestra.run.smithi043.stderr: 6150K .......... .......... .......... .......... .......... 6% 155M 1s 2024-09-12T00:43:53.473 INFO:teuthology.orchestra.run.smithi043.stderr: 6200K .......... .......... .......... .......... .......... 6% 127M 1s 2024-09-12T00:43:53.473 INFO:teuthology.orchestra.run.smithi043.stderr: 6250K .......... .......... .......... .......... .......... 6% 139M 1s 2024-09-12T00:43:53.473 INFO:teuthology.orchestra.run.smithi043.stderr: 6300K .......... .......... .......... .......... .......... 6% 128M 1s 2024-09-12T00:43:53.473 INFO:teuthology.orchestra.run.smithi043.stderr: 6350K .......... .......... .......... .......... .......... 6% 144M 1s 2024-09-12T00:43:53.474 INFO:teuthology.orchestra.run.smithi043.stderr: 6400K .......... .......... .......... .......... .......... 6% 130M 1s 2024-09-12T00:43:53.474 INFO:teuthology.orchestra.run.smithi043.stderr: 6450K .......... .......... .......... .......... .......... 6% 115M 1s 2024-09-12T00:43:53.474 INFO:teuthology.orchestra.run.smithi043.stderr: 6500K .......... .......... .......... .......... .......... 7% 90.5M 1s 2024-09-12T00:43:53.474 INFO:teuthology.orchestra.run.smithi043.stderr: 6550K .......... .......... .......... .......... .......... 7% 120M 1s 2024-09-12T00:43:53.474 INFO:teuthology.orchestra.run.smithi043.stderr: 6600K .......... .......... .......... .......... .......... 7% 159M 1s 2024-09-12T00:43:53.474 INFO:teuthology.orchestra.run.smithi043.stderr: 6650K .......... .......... .......... .......... .......... 7% 165M 1s 2024-09-12T00:43:53.474 INFO:teuthology.orchestra.run.smithi043.stderr: 6700K .......... .......... .......... .......... .......... 7% 123M 1s 2024-09-12T00:43:53.474 INFO:teuthology.orchestra.run.smithi043.stderr: 6750K .......... .......... .......... .......... .......... 7% 150M 1s 2024-09-12T00:43:53.474 INFO:teuthology.orchestra.run.smithi043.stderr: 6800K .......... .......... .......... .......... .......... 7% 164M 1s 2024-09-12T00:43:53.474 INFO:teuthology.orchestra.run.smithi043.stderr: 6850K .......... .......... .......... .......... .......... 7% 166M 1s 2024-09-12T00:43:53.474 INFO:teuthology.orchestra.run.smithi043.stderr: 6900K .......... .......... .......... .......... .......... 7% 123M 1s 2024-09-12T00:43:53.474 INFO:teuthology.orchestra.run.smithi043.stderr: 6950K .......... .......... .......... .......... .......... 7% 163M 1s 2024-09-12T00:43:53.474 INFO:teuthology.orchestra.run.smithi043.stderr: 7000K .......... .......... .......... .......... .......... 7% 148M 1s 2024-09-12T00:43:53.475 INFO:teuthology.orchestra.run.smithi043.stderr: 7050K .......... .......... .......... .......... .......... 7% 165M 1s 2024-09-12T00:43:53.475 INFO:teuthology.orchestra.run.smithi043.stderr: 7100K .......... .......... .......... .......... .......... 7% 127M 1s 2024-09-12T00:43:53.475 INFO:teuthology.orchestra.run.smithi043.stderr: 7150K .......... .......... .......... .......... .......... 7% 128M 1s 2024-09-12T00:43:53.475 INFO:teuthology.orchestra.run.smithi043.stderr: 7200K .......... .......... .......... .......... .......... 7% 155M 1s 2024-09-12T00:43:53.475 INFO:teuthology.orchestra.run.smithi043.stderr: 7250K .......... .......... .......... .......... .......... 7% 137M 1s 2024-09-12T00:43:53.475 INFO:teuthology.orchestra.run.smithi043.stderr: 7300K .......... .......... .......... .......... .......... 7% 143M 1s 2024-09-12T00:43:53.475 INFO:teuthology.orchestra.run.smithi043.stderr: 7350K .......... .......... .......... .......... .......... 7% 167M 1s 2024-09-12T00:43:53.475 INFO:teuthology.orchestra.run.smithi043.stderr: 7400K .......... .......... .......... .......... .......... 8% 165M 1s 2024-09-12T00:43:53.475 INFO:teuthology.orchestra.run.smithi043.stderr: 7450K .......... .......... .......... .......... .......... 8% 163M 1s 2024-09-12T00:43:53.475 INFO:teuthology.orchestra.run.smithi043.stderr: 7500K .......... .......... .......... .......... .......... 8% 143M 1s 2024-09-12T00:43:53.475 INFO:teuthology.orchestra.run.smithi043.stderr: 7550K .......... .......... .......... .......... .......... 8% 169M 1s 2024-09-12T00:43:53.475 INFO:teuthology.orchestra.run.smithi043.stderr: 7600K .......... .......... .......... .......... .......... 8% 170M 1s 2024-09-12T00:43:53.475 INFO:teuthology.orchestra.run.smithi043.stderr: 7650K .......... .......... .......... .......... .......... 8% 163M 1s 2024-09-12T00:43:53.476 INFO:teuthology.orchestra.run.smithi043.stderr: 7700K .......... .......... .......... .......... .......... 8% 155M 1s 2024-09-12T00:43:53.476 INFO:teuthology.orchestra.run.smithi043.stderr: 7750K .......... .......... .......... .......... .......... 8% 137M 1s 2024-09-12T00:43:53.476 INFO:teuthology.orchestra.run.smithi043.stderr: 7800K .......... .......... .......... .......... .......... 8% 176M 1s 2024-09-12T00:43:53.476 INFO:teuthology.orchestra.run.smithi043.stderr: 7850K .......... .......... .......... .......... .......... 8% 184M 1s 2024-09-12T00:43:53.476 INFO:teuthology.orchestra.run.smithi043.stderr: 7900K .......... .......... .......... .......... .......... 8% 154M 1s 2024-09-12T00:43:53.476 INFO:teuthology.orchestra.run.smithi043.stderr: 7950K .......... .......... .......... .......... .......... 8% 160M 1s 2024-09-12T00:43:53.476 INFO:teuthology.orchestra.run.smithi043.stderr: 8000K .......... .......... .......... .......... .......... 8% 185M 1s 2024-09-12T00:43:53.476 INFO:teuthology.orchestra.run.smithi043.stderr: 8050K .......... .......... .......... .......... .......... 8% 187M 1s 2024-09-12T00:43:53.476 INFO:teuthology.orchestra.run.smithi043.stderr: 8100K .......... .......... .......... .......... .......... 8% 166M 1s 2024-09-12T00:43:53.476 INFO:teuthology.orchestra.run.smithi043.stderr: 8150K .......... .......... .......... .......... .......... 8% 171M 1s 2024-09-12T00:43:53.476 INFO:teuthology.orchestra.run.smithi043.stderr: 8200K .......... .......... .......... .......... .......... 8% 179M 1s 2024-09-12T00:43:53.476 INFO:teuthology.orchestra.run.smithi043.stderr: 8250K .......... .......... .......... .......... .......... 8% 190M 1s 2024-09-12T00:43:53.476 INFO:teuthology.orchestra.run.smithi043.stderr: 8300K .......... .......... .......... .......... .......... 8% 117M 1s 2024-09-12T00:43:53.477 INFO:teuthology.orchestra.run.smithi043.stderr: 8350K .......... .......... .......... .......... .......... 9% 185M 1s 2024-09-12T00:43:53.477 INFO:teuthology.orchestra.run.smithi043.stderr: 8400K .......... .......... .......... .......... .......... 9% 164M 1s 2024-09-12T00:43:53.477 INFO:teuthology.orchestra.run.smithi043.stderr: 8450K .......... .......... .......... .......... .......... 9% 176M 1s 2024-09-12T00:43:53.477 INFO:teuthology.orchestra.run.smithi043.stderr: 8500K .......... .......... .......... .......... .......... 9% 161M 1s 2024-09-12T00:43:53.477 INFO:teuthology.orchestra.run.smithi043.stderr: 8550K .......... .......... .......... .......... .......... 9% 179M 1s 2024-09-12T00:43:53.477 INFO:teuthology.orchestra.run.smithi043.stderr: 8600K .......... .......... .......... .......... .......... 9% 182M 1s 2024-09-12T00:43:53.477 INFO:teuthology.orchestra.run.smithi043.stderr: 8650K .......... .......... .......... .......... .......... 9% 195M 1s 2024-09-12T00:43:53.477 INFO:teuthology.orchestra.run.smithi043.stderr: 8700K .......... .......... .......... .......... .......... 9% 154M 1s 2024-09-12T00:43:53.477 INFO:teuthology.orchestra.run.smithi043.stderr: 8750K .......... .......... .......... .......... .......... 9% 174M 1s 2024-09-12T00:43:53.477 INFO:teuthology.orchestra.run.smithi043.stderr: 8800K .......... .......... .......... .......... .......... 9% 186M 1s 2024-09-12T00:43:53.477 INFO:teuthology.orchestra.run.smithi043.stderr: 8850K .......... .......... .......... .......... .......... 9% 183M 1s 2024-09-12T00:43:53.477 INFO:teuthology.orchestra.run.smithi043.stderr: 8900K .......... .......... .......... .......... .......... 9% 175M 1s 2024-09-12T00:43:53.477 INFO:teuthology.orchestra.run.smithi043.stderr: 8950K .......... .......... .......... .......... .......... 9% 184M 1s 2024-09-12T00:43:53.478 INFO:teuthology.orchestra.run.smithi043.stderr: 9000K .......... .......... .......... .......... .......... 9% 197M 1s 2024-09-12T00:43:53.478 INFO:teuthology.orchestra.run.smithi043.stderr: 9050K .......... .......... .......... .......... .......... 9% 188M 1s 2024-09-12T00:43:53.478 INFO:teuthology.orchestra.run.smithi043.stderr: 9100K .......... .......... .......... .......... .......... 9% 159M 1s 2024-09-12T00:43:53.478 INFO:teuthology.orchestra.run.smithi043.stderr: 9150K .......... .......... .......... .......... .......... 9% 185M 1s 2024-09-12T00:43:53.478 INFO:teuthology.orchestra.run.smithi043.stderr: 9200K .......... .......... .......... .......... .......... 9% 175M 1s 2024-09-12T00:43:53.478 INFO:teuthology.orchestra.run.smithi043.stderr: 9250K .......... .......... .......... .......... .......... 10% 207M 1s 2024-09-12T00:43:53.478 INFO:teuthology.orchestra.run.smithi043.stderr: 9300K .......... .......... .......... .......... .......... 10% 176M 1s 2024-09-12T00:43:53.478 INFO:teuthology.orchestra.run.smithi043.stderr: 9350K .......... .......... .......... .......... .......... 10% 200M 1s 2024-09-12T00:43:53.478 INFO:teuthology.orchestra.run.smithi043.stderr: 9400K .......... .......... .......... .......... .......... 10% 198M 1s 2024-09-12T00:43:53.478 INFO:teuthology.orchestra.run.smithi043.stderr: 9450K .......... .......... .......... .......... .......... 10% 189M 1s 2024-09-12T00:43:53.478 INFO:teuthology.orchestra.run.smithi043.stderr: 9500K .......... .......... .......... .......... .......... 10% 167M 1s 2024-09-12T00:43:53.478 INFO:teuthology.orchestra.run.smithi043.stderr: 9550K .......... .......... .......... .......... .......... 10% 209M 1s 2024-09-12T00:43:53.478 INFO:teuthology.orchestra.run.smithi043.stderr: 9600K .......... .......... .......... .......... .......... 10% 209M 1s 2024-09-12T00:43:53.478 INFO:teuthology.orchestra.run.smithi043.stderr: 9650K .......... .......... .......... .......... .......... 10% 195M 1s 2024-09-12T00:43:53.479 INFO:teuthology.orchestra.run.smithi043.stderr: 9700K .......... .......... .......... .......... .......... 10% 170M 1s 2024-09-12T00:43:53.479 INFO:teuthology.orchestra.run.smithi043.stderr: 9750K .......... .......... .......... .......... .......... 10% 205M 1s 2024-09-12T00:43:53.479 INFO:teuthology.orchestra.run.smithi043.stderr: 9800K .......... .......... .......... .......... .......... 10% 213M 1s 2024-09-12T00:43:53.479 INFO:teuthology.orchestra.run.smithi043.stderr: 9850K .......... .......... .......... .......... .......... 10% 207M 1s 2024-09-12T00:43:53.479 INFO:teuthology.orchestra.run.smithi043.stderr: 9900K .......... .......... .......... .......... .......... 10% 152M 1s 2024-09-12T00:43:53.479 INFO:teuthology.orchestra.run.smithi043.stderr: 9950K .......... .......... .......... .......... .......... 10% 176M 1s 2024-09-12T00:43:53.479 INFO:teuthology.orchestra.run.smithi043.stderr: 10000K .......... .......... .......... .......... .......... 10% 214M 1s 2024-09-12T00:43:53.479 INFO:teuthology.orchestra.run.smithi043.stderr: 10050K .......... .......... .......... .......... .......... 10% 221M 1s 2024-09-12T00:43:53.479 INFO:teuthology.orchestra.run.smithi043.stderr: 10100K .......... .......... .......... .......... .......... 10% 177M 1s 2024-09-12T00:43:53.479 INFO:teuthology.orchestra.run.smithi043.stderr: 10150K .......... .......... .......... .......... .......... 10% 208M 1s 2024-09-12T00:43:53.479 INFO:teuthology.orchestra.run.smithi043.stderr: 10200K .......... .......... .......... .......... .......... 11% 194M 1s 2024-09-12T00:43:53.479 INFO:teuthology.orchestra.run.smithi043.stderr: 10250K .......... .......... .......... .......... .......... 11% 244M 1s 2024-09-12T00:43:53.479 INFO:teuthology.orchestra.run.smithi043.stderr: 10300K .......... .......... .......... .......... .......... 11% 225M 1s 2024-09-12T00:43:53.480 INFO:teuthology.orchestra.run.smithi043.stderr: 10350K .......... .......... .......... .......... .......... 11% 172M 1s 2024-09-12T00:43:53.480 INFO:teuthology.orchestra.run.smithi043.stderr: 10400K .......... .......... .......... .......... .......... 11% 203M 1s 2024-09-12T00:43:53.480 INFO:teuthology.orchestra.run.smithi043.stderr: 10450K .......... .......... .......... .......... .......... 11% 211M 1s 2024-09-12T00:43:53.480 INFO:teuthology.orchestra.run.smithi043.stderr: 10500K .......... .......... .......... .......... .......... 11% 210M 1s 2024-09-12T00:43:53.480 INFO:teuthology.orchestra.run.smithi043.stderr: 10550K .......... .......... .......... .......... .......... 11% 199M 1s 2024-09-12T00:43:53.480 INFO:teuthology.orchestra.run.smithi043.stderr: 10600K .......... .......... .......... .......... .......... 11% 218M 1s 2024-09-12T00:43:53.480 INFO:teuthology.orchestra.run.smithi043.stderr: 10650K .......... .......... .......... .......... .......... 11% 212M 1s 2024-09-12T00:43:53.480 INFO:teuthology.orchestra.run.smithi043.stderr: 10700K .......... .......... .......... .......... .......... 11% 203M 1s 2024-09-12T00:43:53.480 INFO:teuthology.orchestra.run.smithi043.stderr: 10750K .......... .......... .......... .......... .......... 11% 164M 1s 2024-09-12T00:43:53.480 INFO:teuthology.orchestra.run.smithi043.stderr: 10800K .......... .......... .......... .......... .......... 11% 199M 1s 2024-09-12T00:43:53.480 INFO:teuthology.orchestra.run.smithi043.stderr: 10850K .......... .......... .......... .......... .......... 11% 226M 1s 2024-09-12T00:43:53.480 INFO:teuthology.orchestra.run.smithi043.stderr: 10900K .......... .......... .......... .......... .......... 11% 197M 1s 2024-09-12T00:43:53.480 INFO:teuthology.orchestra.run.smithi043.stderr: 10950K .......... .......... .......... .......... .......... 11% 179M 1s 2024-09-12T00:43:53.481 INFO:teuthology.orchestra.run.smithi043.stderr: 11000K .......... .......... .......... .......... .......... 11% 226M 1s 2024-09-12T00:43:53.481 INFO:teuthology.orchestra.run.smithi043.stderr: 11050K .......... .......... .......... .......... .......... 11% 193M 1s 2024-09-12T00:43:53.481 INFO:teuthology.orchestra.run.smithi043.stderr: 11100K .......... .......... .......... .......... .......... 12% 187M 1s 2024-09-12T00:43:53.481 INFO:teuthology.orchestra.run.smithi043.stderr: 11150K .......... .......... .......... .......... .......... 12% 179M 1s 2024-09-12T00:43:53.481 INFO:teuthology.orchestra.run.smithi043.stderr: 11200K .......... .......... .......... .......... .......... 12% 219M 1s 2024-09-12T00:43:53.481 INFO:teuthology.orchestra.run.smithi043.stderr: 11250K .......... .......... .......... .......... .......... 12% 186M 1s 2024-09-12T00:43:53.481 INFO:teuthology.orchestra.run.smithi043.stderr: 11300K .......... .......... .......... .......... .......... 12% 200M 1s 2024-09-12T00:43:53.481 INFO:teuthology.orchestra.run.smithi043.stderr: 11350K .......... .......... .......... .......... .......... 12% 166M 1s 2024-09-12T00:43:53.481 INFO:teuthology.orchestra.run.smithi043.stderr: 11400K .......... .......... .......... .......... .......... 12% 220M 1s 2024-09-12T00:43:53.481 INFO:teuthology.orchestra.run.smithi043.stderr: 11450K .......... .......... .......... .......... .......... 12% 212M 1s 2024-09-12T00:43:53.481 INFO:teuthology.orchestra.run.smithi043.stderr: 11500K .......... .......... .......... .......... .......... 12% 218M 1s 2024-09-12T00:43:53.481 INFO:teuthology.orchestra.run.smithi043.stderr: 11550K .......... .......... .......... .......... .......... 12% 156M 1s 2024-09-12T00:43:53.481 INFO:teuthology.orchestra.run.smithi043.stderr: 11600K .......... .......... .......... .......... .......... 12% 240M 1s 2024-09-12T00:43:53.481 INFO:teuthology.orchestra.run.smithi043.stderr: 11650K .......... .......... .......... .......... .......... 12% 197M 1s 2024-09-12T00:43:53.482 INFO:teuthology.orchestra.run.smithi043.stderr: 11700K .......... .......... .......... .......... .......... 12% 203M 1s 2024-09-12T00:43:53.482 INFO:teuthology.orchestra.run.smithi043.stderr: 11750K .......... .......... .......... .......... .......... 12% 203M 1s 2024-09-12T00:43:53.482 INFO:teuthology.orchestra.run.smithi043.stderr: 11800K .......... .......... .......... .......... .......... 12% 234M 1s 2024-09-12T00:43:53.482 INFO:teuthology.orchestra.run.smithi043.stderr: 11850K .......... .......... .......... .......... .......... 12% 213M 1s 2024-09-12T00:43:53.482 INFO:teuthology.orchestra.run.smithi043.stderr: 11900K .......... .......... .......... .......... .......... 12% 224M 1s 2024-09-12T00:43:53.482 INFO:teuthology.orchestra.run.smithi043.stderr: 11950K .......... .......... .......... .......... .......... 12% 192M 1s 2024-09-12T00:43:53.482 INFO:teuthology.orchestra.run.smithi043.stderr: 12000K .......... .......... .......... .......... .......... 12% 212M 1s 2024-09-12T00:43:53.482 INFO:teuthology.orchestra.run.smithi043.stderr: 12050K .......... .......... .......... .......... .......... 13% 232M 1s 2024-09-12T00:43:53.482 INFO:teuthology.orchestra.run.smithi043.stderr: 12100K .......... .......... .......... .......... .......... 13% 237M 1s 2024-09-12T00:43:53.482 INFO:teuthology.orchestra.run.smithi043.stderr: 12150K .......... .......... .......... .......... .......... 13% 210M 1s 2024-09-12T00:43:53.482 INFO:teuthology.orchestra.run.smithi043.stderr: 12200K .......... .......... .......... .......... .......... 13% 229M 1s 2024-09-12T00:43:53.482 INFO:teuthology.orchestra.run.smithi043.stderr: 12250K .......... .......... .......... .......... .......... 13% 236M 1s 2024-09-12T00:43:53.483 INFO:teuthology.orchestra.run.smithi043.stderr: 12300K .......... .......... .......... .......... .......... 13% 238M 1s 2024-09-12T00:43:53.483 INFO:teuthology.orchestra.run.smithi043.stderr: 12350K .......... .......... .......... .......... .......... 13% 172M 1s 2024-09-12T00:43:53.483 INFO:teuthology.orchestra.run.smithi043.stderr: 12400K .......... .......... .......... .......... .......... 13% 161M 1s 2024-09-12T00:43:53.483 INFO:teuthology.orchestra.run.smithi043.stderr: 12450K .......... .......... .......... .......... .......... 13% 216M 1s 2024-09-12T00:43:53.483 INFO:teuthology.orchestra.run.smithi043.stderr: 12500K .......... .......... .......... .......... .......... 13% 243M 1s 2024-09-12T00:43:53.483 INFO:teuthology.orchestra.run.smithi043.stderr: 12550K .......... .......... .......... .......... .......... 13% 212M 1s 2024-09-12T00:43:53.483 INFO:teuthology.orchestra.run.smithi043.stderr: 12600K .......... .......... .......... .......... .......... 13% 230M 1s 2024-09-12T00:43:53.483 INFO:teuthology.orchestra.run.smithi043.stderr: 12650K .......... .......... .......... .......... .......... 13% 245M 1s 2024-09-12T00:43:53.483 INFO:teuthology.orchestra.run.smithi043.stderr: 12700K .......... .......... .......... .......... .......... 13% 241M 1s 2024-09-12T00:43:53.483 INFO:teuthology.orchestra.run.smithi043.stderr: 12750K .......... .......... .......... .......... .......... 13% 207M 1s 2024-09-12T00:43:53.483 INFO:teuthology.orchestra.run.smithi043.stderr: 12800K .......... .......... .......... .......... .......... 13% 248M 1s 2024-09-12T00:43:53.483 INFO:teuthology.orchestra.run.smithi043.stderr: 12850K .......... .......... .......... .......... .......... 13% 236M 1s 2024-09-12T00:43:53.483 INFO:teuthology.orchestra.run.smithi043.stderr: 12900K .......... .......... .......... .......... .......... 13% 223M 1s 2024-09-12T00:43:53.484 INFO:teuthology.orchestra.run.smithi043.stderr: 12950K .......... .......... .......... .......... .......... 13% 202M 1s 2024-09-12T00:43:53.484 INFO:teuthology.orchestra.run.smithi043.stderr: 13000K .......... .......... .......... .......... .......... 14% 246M 1s 2024-09-12T00:43:53.484 INFO:teuthology.orchestra.run.smithi043.stderr: 13050K .......... .......... .......... .......... .......... 14% 208M 1s 2024-09-12T00:43:53.484 INFO:teuthology.orchestra.run.smithi043.stderr: 13100K .......... .......... .......... .......... .......... 14% 233M 1s 2024-09-12T00:43:53.484 INFO:teuthology.orchestra.run.smithi043.stderr: 13150K .......... .......... .......... .......... .......... 14% 250M 1s 2024-09-12T00:43:53.484 INFO:teuthology.orchestra.run.smithi043.stderr: 13200K .......... .......... .......... .......... .......... 14% 219M 1s 2024-09-12T00:43:53.484 INFO:teuthology.orchestra.run.smithi043.stderr: 13250K .......... .......... .......... .......... .......... 14% 182M 1s 2024-09-12T00:43:53.484 INFO:teuthology.orchestra.run.smithi043.stderr: 13300K .......... .......... .......... .......... .......... 14% 180M 1s 2024-09-12T00:43:53.484 INFO:teuthology.orchestra.run.smithi043.stderr: 13350K .......... .......... .......... .......... .......... 14% 206M 1s 2024-09-12T00:43:53.484 INFO:teuthology.orchestra.run.smithi043.stderr: 13400K .......... .......... .......... .......... .......... 14% 239M 1s 2024-09-12T00:43:53.484 INFO:teuthology.orchestra.run.smithi043.stderr: 13450K .......... .......... .......... .......... .......... 14% 206M 1s 2024-09-12T00:43:53.484 INFO:teuthology.orchestra.run.smithi043.stderr: 13500K .......... .......... .......... .......... .......... 14% 258M 1s 2024-09-12T00:43:53.484 INFO:teuthology.orchestra.run.smithi043.stderr: 13550K .......... .......... .......... .......... .......... 14% 198M 1s 2024-09-12T00:43:53.485 INFO:teuthology.orchestra.run.smithi043.stderr: 13600K .......... .......... .......... .......... .......... 14% 217M 1s 2024-09-12T00:43:53.485 INFO:teuthology.orchestra.run.smithi043.stderr: 13650K .......... .......... .......... .......... .......... 14% 260M 1s 2024-09-12T00:43:53.485 INFO:teuthology.orchestra.run.smithi043.stderr: 13700K .......... .......... .......... .......... .......... 14% 252M 1s 2024-09-12T00:43:53.485 INFO:teuthology.orchestra.run.smithi043.stderr: 13750K .......... .......... .......... .......... .......... 14% 231M 1s 2024-09-12T00:43:53.485 INFO:teuthology.orchestra.run.smithi043.stderr: 13800K .......... .......... .......... .......... .......... 14% 239M 1s 2024-09-12T00:43:53.485 INFO:teuthology.orchestra.run.smithi043.stderr: 13850K .......... .......... .......... .......... .......... 14% 211M 1s 2024-09-12T00:43:53.485 INFO:teuthology.orchestra.run.smithi043.stderr: 13900K .......... .......... .......... .......... .......... 15% 229M 1s 2024-09-12T00:43:53.485 INFO:teuthology.orchestra.run.smithi043.stderr: 13950K .......... .......... .......... .......... .......... 15% 217M 1s 2024-09-12T00:43:53.485 INFO:teuthology.orchestra.run.smithi043.stderr: 14000K .......... .......... .......... .......... .......... 15% 264M 1s 2024-09-12T00:43:53.485 INFO:teuthology.orchestra.run.smithi043.stderr: 14050K .......... .......... .......... .......... .......... 15% 230M 1s 2024-09-12T00:43:53.485 INFO:teuthology.orchestra.run.smithi043.stderr: 14100K .......... .......... .......... .......... .......... 15% 238M 1s 2024-09-12T00:43:53.485 INFO:teuthology.orchestra.run.smithi043.stderr: 14150K .......... .......... .......... .......... .......... 15% 226M 1s 2024-09-12T00:43:53.486 INFO:teuthology.orchestra.run.smithi043.stderr: 14200K .......... .......... .......... .......... .......... 15% 242M 1s 2024-09-12T00:43:53.486 INFO:teuthology.orchestra.run.smithi043.stderr: 14250K .......... .......... .......... .......... .......... 15% 211M 1s 2024-09-12T00:43:53.486 INFO:teuthology.orchestra.run.smithi043.stderr: 14300K .......... .......... .......... .......... .......... 15% 260M 1s 2024-09-12T00:43:53.486 INFO:teuthology.orchestra.run.smithi043.stderr: 14350K .......... .......... .......... .......... .......... 15% 205M 1s 2024-09-12T00:43:53.486 INFO:teuthology.orchestra.run.smithi043.stderr: 14400K .......... .......... .......... .......... .......... 15% 268M 1s 2024-09-12T00:43:53.486 INFO:teuthology.orchestra.run.smithi043.stderr: 14450K .......... .......... .......... .......... .......... 15% 264M 1s 2024-09-12T00:43:53.486 INFO:teuthology.orchestra.run.smithi043.stderr: 14500K .......... .......... .......... .......... .......... 15% 215M 1s 2024-09-12T00:43:53.486 INFO:teuthology.orchestra.run.smithi043.stderr: 14550K .......... .......... .......... .......... .......... 15% 224M 1s 2024-09-12T00:43:53.486 INFO:teuthology.orchestra.run.smithi043.stderr: 14600K .......... .......... .......... .......... .......... 15% 256M 1s 2024-09-12T00:43:53.486 INFO:teuthology.orchestra.run.smithi043.stderr: 14650K .......... .......... .......... .......... .......... 15% 246M 1s 2024-09-12T00:43:53.486 INFO:teuthology.orchestra.run.smithi043.stderr: 14700K .......... .......... .......... .......... .......... 15% 257M 1s 2024-09-12T00:43:53.486 INFO:teuthology.orchestra.run.smithi043.stderr: 14750K .......... .......... .......... .......... .......... 15% 225M 1s 2024-09-12T00:43:53.486 INFO:teuthology.orchestra.run.smithi043.stderr: 14800K .......... .......... .......... .......... .......... 15% 272M 1s 2024-09-12T00:43:53.486 INFO:teuthology.orchestra.run.smithi043.stderr: 14850K .......... .......... .......... .......... .......... 16% 271M 1s 2024-09-12T00:43:53.487 INFO:teuthology.orchestra.run.smithi043.stderr: 14900K .......... .......... .......... .......... .......... 16% 278M 1s 2024-09-12T00:43:53.487 INFO:teuthology.orchestra.run.smithi043.stderr: 14950K .......... .......... .......... .......... .......... 16% 249M 1s 2024-09-12T00:43:53.487 INFO:teuthology.orchestra.run.smithi043.stderr: 15000K .......... .......... .......... .......... .......... 16% 256M 1s 2024-09-12T00:43:53.487 INFO:teuthology.orchestra.run.smithi043.stderr: 15050K .......... .......... .......... .......... .......... 16% 244M 1s 2024-09-12T00:43:53.487 INFO:teuthology.orchestra.run.smithi043.stderr: 15100K .......... .......... .......... .......... .......... 16% 246M 1s 2024-09-12T00:43:53.487 INFO:teuthology.orchestra.run.smithi043.stderr: 15150K .......... .......... .......... .......... .......... 16% 210M 1s 2024-09-12T00:43:53.487 INFO:teuthology.orchestra.run.smithi043.stderr: 15200K .......... .......... .......... .......... .......... 16% 281M 1s 2024-09-12T00:43:53.487 INFO:teuthology.orchestra.run.smithi043.stderr: 15250K .......... .......... .......... .......... .......... 16% 264M 1s 2024-09-12T00:43:53.487 INFO:teuthology.orchestra.run.smithi043.stderr: 15300K .......... .......... .......... .......... .......... 16% 233M 1s 2024-09-12T00:43:53.487 INFO:teuthology.orchestra.run.smithi043.stderr: 15350K .......... .......... .......... .......... .......... 16% 207M 1s 2024-09-12T00:43:53.487 INFO:teuthology.orchestra.run.smithi043.stderr: 15400K .......... .......... .......... .......... .......... 16% 285M 1s 2024-09-12T00:43:53.487 INFO:teuthology.orchestra.run.smithi043.stderr: 15450K .......... .......... .......... .......... .......... 16% 292M 1s 2024-09-12T00:43:53.487 INFO:teuthology.orchestra.run.smithi043.stderr: 15500K .......... .......... .......... .......... .......... 16% 298M 1s 2024-09-12T00:43:53.488 INFO:teuthology.orchestra.run.smithi043.stderr: 15550K .......... .......... .......... .......... .......... 16% 235M 1s 2024-09-12T00:43:53.488 INFO:teuthology.orchestra.run.smithi043.stderr: 15600K .......... .......... .......... .......... .......... 16% 286M 1s 2024-09-12T00:43:53.488 INFO:teuthology.orchestra.run.smithi043.stderr: 15650K .......... .......... .......... .......... .......... 16% 243M 1s 2024-09-12T00:43:53.488 INFO:teuthology.orchestra.run.smithi043.stderr: 15700K .......... .......... .......... .......... .......... 16% 263M 1s 2024-09-12T00:43:53.488 INFO:teuthology.orchestra.run.smithi043.stderr: 15750K .......... .......... .......... .......... .......... 17% 228M 1s 2024-09-12T00:43:53.488 INFO:teuthology.orchestra.run.smithi043.stderr: 15800K .......... .......... .......... .......... .......... 17% 286M 1s 2024-09-12T00:43:53.488 INFO:teuthology.orchestra.run.smithi043.stderr: 15850K .......... .......... .......... .......... .......... 17% 294M 1s 2024-09-12T00:43:53.488 INFO:teuthology.orchestra.run.smithi043.stderr: 15900K .......... .......... .......... .......... .......... 17% 294M 1s 2024-09-12T00:43:53.488 INFO:teuthology.orchestra.run.smithi043.stderr: 15950K .......... .......... .......... .......... .......... 17% 223M 1s 2024-09-12T00:43:53.488 INFO:teuthology.orchestra.run.smithi043.stderr: 16000K .......... .......... .......... .......... .......... 17% 321M 1s 2024-09-12T00:43:53.488 INFO:teuthology.orchestra.run.smithi043.stderr: 16050K .......... .......... .......... .......... .......... 17% 205M 1s 2024-09-12T00:43:53.488 INFO:teuthology.orchestra.run.smithi043.stderr: 16100K .......... .......... .......... .......... .......... 17% 262M 1s 2024-09-12T00:43:53.488 INFO:teuthology.orchestra.run.smithi043.stderr: 16150K .......... .......... .......... .......... .......... 17% 211M 1s 2024-09-12T00:43:53.489 INFO:teuthology.orchestra.run.smithi043.stderr: 16200K .......... .......... .......... .......... .......... 17% 248M 1s 2024-09-12T00:43:53.489 INFO:teuthology.orchestra.run.smithi043.stderr: 16250K .......... .......... .......... .......... .......... 17% 268M 1s 2024-09-12T00:43:53.489 INFO:teuthology.orchestra.run.smithi043.stderr: 16300K .......... .......... .......... .......... .......... 17% 246M 1s 2024-09-12T00:43:53.489 INFO:teuthology.orchestra.run.smithi043.stderr: 16350K .......... .......... .......... .......... .......... 17% 209M 1s 2024-09-12T00:43:53.489 INFO:teuthology.orchestra.run.smithi043.stderr: 16400K .......... .......... .......... .......... .......... 17% 293M 1s 2024-09-12T00:43:53.489 INFO:teuthology.orchestra.run.smithi043.stderr: 16450K .......... .......... .......... .......... .......... 17% 262M 1s 2024-09-12T00:43:53.489 INFO:teuthology.orchestra.run.smithi043.stderr: 16500K .......... .......... .......... .......... .......... 17% 234M 1s 2024-09-12T00:43:53.489 INFO:teuthology.orchestra.run.smithi043.stderr: 16550K .......... .......... .......... .......... .......... 17% 259M 1s 2024-09-12T00:43:53.489 INFO:teuthology.orchestra.run.smithi043.stderr: 16600K .......... .......... .......... .......... .......... 17% 300M 1s 2024-09-12T00:43:53.489 INFO:teuthology.orchestra.run.smithi043.stderr: 16650K .......... .......... .......... .......... .......... 17% 311M 1s 2024-09-12T00:43:53.489 INFO:teuthology.orchestra.run.smithi043.stderr: 16700K .......... .......... .......... .......... .......... 18% 286M 1s 2024-09-12T00:43:53.489 INFO:teuthology.orchestra.run.smithi043.stderr: 16750K .......... .......... .......... .......... .......... 18% 243M 1s 2024-09-12T00:43:53.489 INFO:teuthology.orchestra.run.smithi043.stderr: 16800K .......... .......... .......... .......... .......... 18% 259M 1s 2024-09-12T00:43:53.490 INFO:teuthology.orchestra.run.smithi043.stderr: 16850K .......... .......... .......... .......... .......... 18% 260M 1s 2024-09-12T00:43:53.490 INFO:teuthology.orchestra.run.smithi043.stderr: 16900K .......... .......... .......... .......... .......... 18% 289M 1s 2024-09-12T00:43:53.490 INFO:teuthology.orchestra.run.smithi043.stderr: 16950K .......... .......... .......... .......... .......... 18% 260M 1s 2024-09-12T00:43:53.490 INFO:teuthology.orchestra.run.smithi043.stderr: 17000K .......... .......... .......... .......... .......... 18% 303M 1s 2024-09-12T00:43:53.490 INFO:teuthology.orchestra.run.smithi043.stderr: 17050K .......... .......... .......... .......... .......... 18% 252M 1s 2024-09-12T00:43:53.490 INFO:teuthology.orchestra.run.smithi043.stderr: 17100K .......... .......... .......... .......... .......... 18% 240M 1s 2024-09-12T00:43:53.490 INFO:teuthology.orchestra.run.smithi043.stderr: 17150K .......... .......... .......... .......... .......... 18% 225M 1s 2024-09-12T00:43:53.490 INFO:teuthology.orchestra.run.smithi043.stderr: 17200K .......... .......... .......... .......... .......... 18% 298M 1s 2024-09-12T00:43:53.490 INFO:teuthology.orchestra.run.smithi043.stderr: 17250K .......... .......... .......... .......... .......... 18% 259M 1s 2024-09-12T00:43:53.490 INFO:teuthology.orchestra.run.smithi043.stderr: 17300K .......... .......... .......... .......... .......... 18% 261M 1s 2024-09-12T00:43:53.490 INFO:teuthology.orchestra.run.smithi043.stderr: 17350K .......... .......... .......... .......... .......... 18% 248M 1s 2024-09-12T00:43:53.490 INFO:teuthology.orchestra.run.smithi043.stderr: 17400K .......... .......... .......... .......... .......... 18% 267M 1s 2024-09-12T00:43:53.490 INFO:teuthology.orchestra.run.smithi043.stderr: 17450K .......... .......... .......... .......... .......... 18% 308M 1s 2024-09-12T00:43:53.491 INFO:teuthology.orchestra.run.smithi043.stderr: 17500K .......... .......... .......... .......... .......... 18% 309M 1s 2024-09-12T00:43:53.491 INFO:teuthology.orchestra.run.smithi043.stderr: 17550K .......... .......... .......... .......... .......... 18% 243M 1s 2024-09-12T00:43:53.491 INFO:teuthology.orchestra.run.smithi043.stderr: 17600K .......... .......... .......... .......... .......... 18% 185M 1s 2024-09-12T00:43:53.491 INFO:teuthology.orchestra.run.smithi043.stderr: 17650K .......... .......... .......... .......... .......... 19% 290M 1s 2024-09-12T00:43:53.491 INFO:teuthology.orchestra.run.smithi043.stderr: 17700K .......... .......... .......... .......... .......... 19% 256M 1s 2024-09-12T00:43:53.491 INFO:teuthology.orchestra.run.smithi043.stderr: 17750K .......... .......... .......... .......... .......... 19% 226M 1s 2024-09-12T00:43:53.491 INFO:teuthology.orchestra.run.smithi043.stderr: 17800K .......... .......... .......... .......... .......... 19% 239M 1s 2024-09-12T00:43:53.491 INFO:teuthology.orchestra.run.smithi043.stderr: 17850K .......... .......... .......... .......... .......... 19% 289M 1s 2024-09-12T00:43:53.491 INFO:teuthology.orchestra.run.smithi043.stderr: 17900K .......... .......... .......... .......... .......... 19% 294M 1s 2024-09-12T00:43:53.491 INFO:teuthology.orchestra.run.smithi043.stderr: 17950K .......... .......... .......... .......... .......... 19% 68.1M 1s 2024-09-12T00:43:53.491 INFO:teuthology.orchestra.run.smithi043.stderr: 18000K .......... .......... .......... .......... .......... 19% 246M 1s 2024-09-12T00:43:53.491 INFO:teuthology.orchestra.run.smithi043.stderr: 18050K .......... .......... .......... .......... .......... 19% 265M 1s 2024-09-12T00:43:53.491 INFO:teuthology.orchestra.run.smithi043.stderr: 18100K .......... .......... .......... .......... .......... 19% 286M 1s 2024-09-12T00:43:53.492 INFO:teuthology.orchestra.run.smithi043.stderr: 18150K .......... .......... .......... .......... .......... 19% 262M 1s 2024-09-12T00:43:53.492 INFO:teuthology.orchestra.run.smithi043.stderr: 18200K .......... .......... .......... .......... .......... 19% 312M 1s 2024-09-12T00:43:53.492 INFO:teuthology.orchestra.run.smithi043.stderr: 18250K .......... .......... .......... .......... .......... 19% 292M 1s 2024-09-12T00:43:53.492 INFO:teuthology.orchestra.run.smithi043.stderr: 18300K .......... .......... .......... .......... .......... 19% 258M 1s 2024-09-12T00:43:53.492 INFO:teuthology.orchestra.run.smithi043.stderr: 18350K .......... .......... .......... .......... .......... 19% 248M 1s 2024-09-12T00:43:53.492 INFO:teuthology.orchestra.run.smithi043.stderr: 18400K .......... .......... .......... .......... .......... 19% 303M 1s 2024-09-12T00:43:53.492 INFO:teuthology.orchestra.run.smithi043.stderr: 18450K .......... .......... .......... .......... .......... 19% 311M 1s 2024-09-12T00:43:53.492 INFO:teuthology.orchestra.run.smithi043.stderr: 18500K .......... .......... .......... .......... .......... 19% 111M 1s 2024-09-12T00:43:53.492 INFO:teuthology.orchestra.run.smithi043.stderr: 18550K .......... .......... .......... .......... .......... 20% 225M 1s 2024-09-12T00:43:53.492 INFO:teuthology.orchestra.run.smithi043.stderr: 18600K .......... .......... .......... .......... .......... 20% 267M 1s 2024-09-12T00:43:53.492 INFO:teuthology.orchestra.run.smithi043.stderr: 18650K .......... .......... .......... .......... .......... 20% 270M 1s 2024-09-12T00:43:53.492 INFO:teuthology.orchestra.run.smithi043.stderr: 18700K .......... .......... .......... .......... .......... 20% 271M 1s 2024-09-12T00:43:53.492 INFO:teuthology.orchestra.run.smithi043.stderr: 18750K .......... .......... .......... .......... .......... 20% 256M 1s 2024-09-12T00:43:53.493 INFO:teuthology.orchestra.run.smithi043.stderr: 18800K .......... .......... .......... .......... .......... 20% 322M 1s 2024-09-12T00:43:53.493 INFO:teuthology.orchestra.run.smithi043.stderr: 18850K .......... .......... .......... .......... .......... 20% 269M 1s 2024-09-12T00:43:53.493 INFO:teuthology.orchestra.run.smithi043.stderr: 18900K .......... .......... .......... .......... .......... 20% 259M 1s 2024-09-12T00:43:53.493 INFO:teuthology.orchestra.run.smithi043.stderr: 18950K .......... .......... .......... .......... .......... 20% 258M 1s 2024-09-12T00:43:53.493 INFO:teuthology.orchestra.run.smithi043.stderr: 19000K .......... .......... .......... .......... .......... 20% 312M 1s 2024-09-12T00:43:53.493 INFO:teuthology.orchestra.run.smithi043.stderr: 19050K .......... .......... .......... .......... .......... 20% 266M 1s 2024-09-12T00:43:53.493 INFO:teuthology.orchestra.run.smithi043.stderr: 19100K .......... .......... .......... .......... .......... 20% 266M 1s 2024-09-12T00:43:53.493 INFO:teuthology.orchestra.run.smithi043.stderr: 19150K .......... .......... .......... .......... .......... 20% 248M 1s 2024-09-12T00:43:53.493 INFO:teuthology.orchestra.run.smithi043.stderr: 19200K .......... .......... .......... .......... .......... 20% 273M 1s 2024-09-12T00:43:53.493 INFO:teuthology.orchestra.run.smithi043.stderr: 19250K .......... .......... .......... .......... .......... 20% 276M 1s 2024-09-12T00:43:53.493 INFO:teuthology.orchestra.run.smithi043.stderr: 19300K .......... .......... .......... .......... .......... 20% 247M 1s 2024-09-12T00:43:53.493 INFO:teuthology.orchestra.run.smithi043.stderr: 19350K .......... .......... .......... .......... .......... 20% 244M 1s 2024-09-12T00:43:53.493 INFO:teuthology.orchestra.run.smithi043.stderr: 19400K .......... .......... .......... .......... .......... 20% 301M 1s 2024-09-12T00:43:53.494 INFO:teuthology.orchestra.run.smithi043.stderr: 19450K .......... .......... .......... .......... .......... 20% 290M 1s 2024-09-12T00:43:53.494 INFO:teuthology.orchestra.run.smithi043.stderr: 19500K .......... .......... .......... .......... .......... 21% 299M 1s 2024-09-12T00:43:53.494 INFO:teuthology.orchestra.run.smithi043.stderr: 19550K .......... .......... .......... .......... .......... 21% 262M 1s 2024-09-12T00:43:53.494 INFO:teuthology.orchestra.run.smithi043.stderr: 19600K .......... .......... .......... .......... .......... 21% 85.3M 1s 2024-09-12T00:43:53.494 INFO:teuthology.orchestra.run.smithi043.stderr: 19650K .......... .......... .......... .......... .......... 21% 259M 1s 2024-09-12T00:43:53.494 INFO:teuthology.orchestra.run.smithi043.stderr: 19700K .......... .......... .......... .......... .......... 21% 295M 1s 2024-09-12T00:43:53.494 INFO:teuthology.orchestra.run.smithi043.stderr: 19750K .......... .......... .......... .......... .......... 21% 272M 1s 2024-09-12T00:43:53.494 INFO:teuthology.orchestra.run.smithi043.stderr: 19800K .......... .......... .......... .......... .......... 21% 298M 1s 2024-09-12T00:43:53.494 INFO:teuthology.orchestra.run.smithi043.stderr: 19850K .......... .......... .......... .......... .......... 21% 300M 1s 2024-09-12T00:43:53.494 INFO:teuthology.orchestra.run.smithi043.stderr: 19900K .......... .......... .......... .......... .......... 21% 320M 1s 2024-09-12T00:43:53.494 INFO:teuthology.orchestra.run.smithi043.stderr: 19950K .......... .......... .......... .......... .......... 21% 243M 1s 2024-09-12T00:43:53.494 INFO:teuthology.orchestra.run.smithi043.stderr: 20000K .......... .......... .......... .......... .......... 21% 294M 1s 2024-09-12T00:43:53.494 INFO:teuthology.orchestra.run.smithi043.stderr: 20050K .......... .......... .......... .......... .......... 21% 296M 1s 2024-09-12T00:43:53.495 INFO:teuthology.orchestra.run.smithi043.stderr: 20100K .......... .......... .......... .......... .......... 21% 246M 1s 2024-09-12T00:43:53.495 INFO:teuthology.orchestra.run.smithi043.stderr: 20150K .......... .......... .......... .......... .......... 21% 195M 1s 2024-09-12T00:43:53.495 INFO:teuthology.orchestra.run.smithi043.stderr: 20200K .......... .......... .......... .......... .......... 21% 296M 1s 2024-09-12T00:43:53.495 INFO:teuthology.orchestra.run.smithi043.stderr: 20250K .......... .......... .......... .......... .......... 21% 261M 1s 2024-09-12T00:43:53.495 INFO:teuthology.orchestra.run.smithi043.stderr: 20300K .......... .......... .......... .......... .......... 21% 208M 1s 2024-09-12T00:43:53.495 INFO:teuthology.orchestra.run.smithi043.stderr: 20350K .......... .......... .......... .......... .......... 21% 232M 1s 2024-09-12T00:43:53.495 INFO:teuthology.orchestra.run.smithi043.stderr: 20400K .......... .......... .......... .......... .......... 22% 261M 1s 2024-09-12T00:43:53.495 INFO:teuthology.orchestra.run.smithi043.stderr: 20450K .......... .......... .......... .......... .......... 22% 278M 1s 2024-09-12T00:43:53.495 INFO:teuthology.orchestra.run.smithi043.stderr: 20500K .......... .......... .......... .......... .......... 22% 311M 1s 2024-09-12T00:43:53.495 INFO:teuthology.orchestra.run.smithi043.stderr: 20550K .......... .......... .......... .......... .......... 22% 346M 1s 2024-09-12T00:43:53.495 INFO:teuthology.orchestra.run.smithi043.stderr: 20600K .......... .......... .......... .......... .......... 22% 228M 1s 2024-09-12T00:43:53.495 INFO:teuthology.orchestra.run.smithi043.stderr: 20650K .......... .......... .......... .......... .......... 22% 313M 1s 2024-09-12T00:43:53.495 INFO:teuthology.orchestra.run.smithi043.stderr: 20700K .......... .......... .......... .......... .......... 22% 264M 1s 2024-09-12T00:43:53.496 INFO:teuthology.orchestra.run.smithi043.stderr: 20750K .......... .......... .......... .......... .......... 22% 313M 1s 2024-09-12T00:43:53.496 INFO:teuthology.orchestra.run.smithi043.stderr: 20800K .......... .......... .......... .......... .......... 22% 301M 1s 2024-09-12T00:43:53.496 INFO:teuthology.orchestra.run.smithi043.stderr: 20850K .......... .......... .......... .......... .......... 22% 304M 1s 2024-09-12T00:43:53.496 INFO:teuthology.orchestra.run.smithi043.stderr: 20900K .......... .......... .......... .......... .......... 22% 80.9M 1s 2024-09-12T00:43:53.496 INFO:teuthology.orchestra.run.smithi043.stderr: 20950K .......... .......... .......... .......... .......... 22% 311M 1s 2024-09-12T00:43:53.496 INFO:teuthology.orchestra.run.smithi043.stderr: 21000K .......... .......... .......... .......... .......... 22% 298M 1s 2024-09-12T00:43:53.496 INFO:teuthology.orchestra.run.smithi043.stderr: 21050K .......... .......... .......... .......... .......... 22% 280M 1s 2024-09-12T00:43:53.496 INFO:teuthology.orchestra.run.smithi043.stderr: 21100K .......... .......... .......... .......... .......... 22% 250M 1s 2024-09-12T00:43:53.496 INFO:teuthology.orchestra.run.smithi043.stderr: 21150K .......... .......... .......... .......... .......... 22% 316M 1s 2024-09-12T00:43:53.496 INFO:teuthology.orchestra.run.smithi043.stderr: 21200K .......... .......... .......... .......... .......... 22% 292M 1s 2024-09-12T00:43:53.496 INFO:teuthology.orchestra.run.smithi043.stderr: 21250K .......... .......... .......... .......... .......... 22% 295M 1s 2024-09-12T00:43:53.496 INFO:teuthology.orchestra.run.smithi043.stderr: 21300K .......... .......... .......... .......... .......... 22% 268M 1s 2024-09-12T00:43:53.497 INFO:teuthology.orchestra.run.smithi043.stderr: 21350K .......... .......... .......... .......... .......... 23% 266M 1s 2024-09-12T00:43:53.497 INFO:teuthology.orchestra.run.smithi043.stderr: 21400K .......... .......... .......... .......... .......... 23% 64.5M 1s 2024-09-12T00:43:53.497 INFO:teuthology.orchestra.run.smithi043.stderr: 21450K .......... .......... .......... .......... .......... 23% 187M 1s 2024-09-12T00:43:53.497 INFO:teuthology.orchestra.run.smithi043.stderr: 21500K .......... .......... .......... .......... .......... 23% 151M 1s 2024-09-12T00:43:53.497 INFO:teuthology.orchestra.run.smithi043.stderr: 21550K .......... .......... .......... .......... .......... 23% 185M 1s 2024-09-12T00:43:53.497 INFO:teuthology.orchestra.run.smithi043.stderr: 21600K .......... .......... .......... .......... .......... 23% 189M 1s 2024-09-12T00:43:53.497 INFO:teuthology.orchestra.run.smithi043.stderr: 21650K .......... .......... .......... .......... .......... 23% 188M 1s 2024-09-12T00:43:53.497 INFO:teuthology.orchestra.run.smithi043.stderr: 21700K .......... .......... .......... .......... .......... 23% 176M 1s 2024-09-12T00:43:53.497 INFO:teuthology.orchestra.run.smithi043.stderr: 21750K .......... .......... .......... .......... .......... 23% 184M 1s 2024-09-12T00:43:53.497 INFO:teuthology.orchestra.run.smithi043.stderr: 21800K .......... .......... .......... .......... .......... 23% 186M 1s 2024-09-12T00:43:53.497 INFO:teuthology.orchestra.run.smithi043.stderr: 21850K .......... .......... .......... .......... .......... 23% 188M 1s 2024-09-12T00:43:53.497 INFO:teuthology.orchestra.run.smithi043.stderr: 21900K .......... .......... .......... .......... .......... 23% 153M 1s 2024-09-12T00:43:53.497 INFO:teuthology.orchestra.run.smithi043.stderr: 21950K .......... .......... .......... .......... .......... 23% 195M 1s 2024-09-12T00:43:53.497 INFO:teuthology.orchestra.run.smithi043.stderr: 22000K .......... .......... .......... .......... .......... 23% 166M 1s 2024-09-12T00:43:53.498 INFO:teuthology.orchestra.run.smithi043.stderr: 22050K .......... .......... .......... .......... .......... 23% 197M 1s 2024-09-12T00:43:53.498 INFO:teuthology.orchestra.run.smithi043.stderr: 22100K .......... .......... .......... .......... .......... 23% 178M 1s 2024-09-12T00:43:53.498 INFO:teuthology.orchestra.run.smithi043.stderr: 22150K .......... .......... .......... .......... .......... 23% 204M 1s 2024-09-12T00:43:53.498 INFO:teuthology.orchestra.run.smithi043.stderr: 22200K .......... .......... .......... .......... .......... 23% 191M 1s 2024-09-12T00:43:53.498 INFO:teuthology.orchestra.run.smithi043.stderr: 22250K .......... .......... .......... .......... .......... 24% 185M 1s 2024-09-12T00:43:53.498 INFO:teuthology.orchestra.run.smithi043.stderr: 22300K .......... .......... .......... .......... .......... 24% 164M 1s 2024-09-12T00:43:53.498 INFO:teuthology.orchestra.run.smithi043.stderr: 22350K .......... .......... .......... .......... .......... 24% 191M 1s 2024-09-12T00:43:53.498 INFO:teuthology.orchestra.run.smithi043.stderr: 22400K .......... .......... .......... .......... .......... 24% 201M 1s 2024-09-12T00:43:53.498 INFO:teuthology.orchestra.run.smithi043.stderr: 22450K .......... .......... .......... .......... .......... 24% 177M 1s 2024-09-12T00:43:53.498 INFO:teuthology.orchestra.run.smithi043.stderr: 22500K .......... .......... .......... .......... .......... 24% 159M 1s 2024-09-12T00:43:53.498 INFO:teuthology.orchestra.run.smithi043.stderr: 22550K .......... .......... .......... .......... .......... 24% 178M 1s 2024-09-12T00:43:53.498 INFO:teuthology.orchestra.run.smithi043.stderr: 22600K .......... .......... .......... .......... .......... 24% 182M 1s 2024-09-12T00:43:53.499 INFO:teuthology.orchestra.run.smithi043.stderr: 22650K .......... .......... .......... .......... .......... 24% 170M 1s 2024-09-12T00:43:53.499 INFO:teuthology.orchestra.run.smithi043.stderr: 22700K .......... .......... .......... .......... .......... 24% 152M 1s 2024-09-12T00:43:53.499 INFO:teuthology.orchestra.run.smithi043.stderr: 22750K .......... .......... .......... .......... .......... 24% 170M 1s 2024-09-12T00:43:53.499 INFO:teuthology.orchestra.run.smithi043.stderr: 22800K .......... .......... .......... .......... .......... 24% 190M 1s 2024-09-12T00:43:53.499 INFO:teuthology.orchestra.run.smithi043.stderr: 22850K .......... .......... .......... .......... .......... 24% 180M 1s 2024-09-12T00:43:53.499 INFO:teuthology.orchestra.run.smithi043.stderr: 22900K .......... .......... .......... .......... .......... 24% 183M 1s 2024-09-12T00:43:53.499 INFO:teuthology.orchestra.run.smithi043.stderr: 22950K .......... .......... .......... .......... .......... 24% 201M 1s 2024-09-12T00:43:53.499 INFO:teuthology.orchestra.run.smithi043.stderr: 23000K .......... .......... .......... .......... .......... 24% 209M 1s 2024-09-12T00:43:53.499 INFO:teuthology.orchestra.run.smithi043.stderr: 23050K .......... .......... .......... .......... .......... 24% 219M 1s 2024-09-12T00:43:53.499 INFO:teuthology.orchestra.run.smithi043.stderr: 23100K .......... .......... .......... .......... .......... 24% 179M 1s 2024-09-12T00:43:53.499 INFO:teuthology.orchestra.run.smithi043.stderr: 23150K .......... .......... .......... .......... .......... 24% 205M 1s 2024-09-12T00:43:53.499 INFO:teuthology.orchestra.run.smithi043.stderr: 23200K .......... .......... .......... .......... .......... 25% 200M 1s 2024-09-12T00:43:53.499 INFO:teuthology.orchestra.run.smithi043.stderr: 23250K .......... .......... .......... .......... .......... 25% 212M 1s 2024-09-12T00:43:53.499 INFO:teuthology.orchestra.run.smithi043.stderr: 23300K .......... .......... .......... .......... .......... 25% 175M 1s 2024-09-12T00:43:53.500 INFO:teuthology.orchestra.run.smithi043.stderr: 23350K .......... .......... .......... .......... .......... 25% 211M 1s 2024-09-12T00:43:53.500 INFO:teuthology.orchestra.run.smithi043.stderr: 23400K .......... .......... .......... .......... .......... 25% 222M 1s 2024-09-12T00:43:53.500 INFO:teuthology.orchestra.run.smithi043.stderr: 23450K .......... .......... .......... .......... .......... 25% 211M 1s 2024-09-12T00:43:53.500 INFO:teuthology.orchestra.run.smithi043.stderr: 23500K .......... .......... .......... .......... .......... 25% 165M 1s 2024-09-12T00:43:53.500 INFO:teuthology.orchestra.run.smithi043.stderr: 23550K .......... .......... .......... .......... .......... 25% 217M 1s 2024-09-12T00:43:53.500 INFO:teuthology.orchestra.run.smithi043.stderr: 23600K .......... .......... .......... .......... .......... 25% 226M 1s 2024-09-12T00:43:53.500 INFO:teuthology.orchestra.run.smithi043.stderr: 23650K .......... .......... .......... .......... .......... 25% 195M 1s 2024-09-12T00:43:53.500 INFO:teuthology.orchestra.run.smithi043.stderr: 23700K .......... .......... .......... .......... .......... 25% 200M 1s 2024-09-12T00:43:53.500 INFO:teuthology.orchestra.run.smithi043.stderr: 23750K .......... .......... .......... .......... .......... 25% 213M 1s 2024-09-12T00:43:53.500 INFO:teuthology.orchestra.run.smithi043.stderr: 23800K .......... .......... .......... .......... .......... 25% 225M 1s 2024-09-12T00:43:53.500 INFO:teuthology.orchestra.run.smithi043.stderr: 23850K .......... .......... .......... .......... .......... 25% 222M 1s 2024-09-12T00:43:53.500 INFO:teuthology.orchestra.run.smithi043.stderr: 23900K .......... .......... .......... .......... .......... 25% 190M 1s 2024-09-12T00:43:53.500 INFO:teuthology.orchestra.run.smithi043.stderr: 23950K .......... .......... .......... .......... .......... 25% 236M 1s 2024-09-12T00:43:53.501 INFO:teuthology.orchestra.run.smithi043.stderr: 24000K .......... .......... .......... .......... .......... 25% 224M 1s 2024-09-12T00:43:53.501 INFO:teuthology.orchestra.run.smithi043.stderr: 24050K .......... .......... .......... .......... .......... 25% 204M 1s 2024-09-12T00:43:53.501 INFO:teuthology.orchestra.run.smithi043.stderr: 24100K .......... .......... .......... .......... .......... 25% 190M 1s 2024-09-12T00:43:53.501 INFO:teuthology.orchestra.run.smithi043.stderr: 24150K .......... .......... .......... .......... .......... 26% 193M 1s 2024-09-12T00:43:53.501 INFO:teuthology.orchestra.run.smithi043.stderr: 24200K .......... .......... .......... .......... .......... 26% 208M 1s 2024-09-12T00:43:53.501 INFO:teuthology.orchestra.run.smithi043.stderr: 24250K .......... .......... .......... .......... .......... 26% 177M 1s 2024-09-12T00:43:53.501 INFO:teuthology.orchestra.run.smithi043.stderr: 24300K .......... .......... .......... .......... .......... 26% 162M 1s 2024-09-12T00:43:53.501 INFO:teuthology.orchestra.run.smithi043.stderr: 24350K .......... .......... .......... .......... .......... 26% 184M 1s 2024-09-12T00:43:53.501 INFO:teuthology.orchestra.run.smithi043.stderr: 24400K .......... .......... .......... .......... .......... 26% 218M 1s 2024-09-12T00:43:53.501 INFO:teuthology.orchestra.run.smithi043.stderr: 24450K .......... .......... .......... .......... .......... 26% 223M 1s 2024-09-12T00:43:53.501 INFO:teuthology.orchestra.run.smithi043.stderr: 24500K .......... .......... .......... .......... .......... 26% 193M 1s 2024-09-12T00:43:53.501 INFO:teuthology.orchestra.run.smithi043.stderr: 24550K .......... .......... .......... .......... .......... 26% 207M 1s 2024-09-12T00:43:53.501 INFO:teuthology.orchestra.run.smithi043.stderr: 24600K .......... .......... .......... .......... .......... 26% 232M 1s 2024-09-12T00:43:53.502 INFO:teuthology.orchestra.run.smithi043.stderr: 24650K .......... .......... .......... .......... .......... 26% 225M 1s 2024-09-12T00:43:53.502 INFO:teuthology.orchestra.run.smithi043.stderr: 24700K .......... .......... .......... .......... .......... 26% 162M 1s 2024-09-12T00:43:53.502 INFO:teuthology.orchestra.run.smithi043.stderr: 24750K .......... .......... .......... .......... .......... 26% 207M 1s 2024-09-12T00:43:53.502 INFO:teuthology.orchestra.run.smithi043.stderr: 24800K .......... .......... .......... .......... .......... 26% 217M 1s 2024-09-12T00:43:53.502 INFO:teuthology.orchestra.run.smithi043.stderr: 24850K .......... .......... .......... .......... .......... 26% 230M 1s 2024-09-12T00:43:53.502 INFO:teuthology.orchestra.run.smithi043.stderr: 24900K .......... .......... .......... .......... .......... 26% 210M 1s 2024-09-12T00:43:53.502 INFO:teuthology.orchestra.run.smithi043.stderr: 24950K .......... .......... .......... .......... .......... 26% 227M 1s 2024-09-12T00:43:53.502 INFO:teuthology.orchestra.run.smithi043.stderr: 25000K .......... .......... .......... .......... .......... 26% 238M 1s 2024-09-12T00:43:53.502 INFO:teuthology.orchestra.run.smithi043.stderr: 25050K .......... .......... .......... .......... .......... 27% 233M 1s 2024-09-12T00:43:53.502 INFO:teuthology.orchestra.run.smithi043.stderr: 25100K .......... .......... .......... .......... .......... 27% 196M 1s 2024-09-12T00:43:53.502 INFO:teuthology.orchestra.run.smithi043.stderr: 25150K .......... .......... .......... .......... .......... 27% 234M 1s 2024-09-12T00:43:53.502 INFO:teuthology.orchestra.run.smithi043.stderr: 25200K .......... .......... .......... .......... .......... 27% 243M 1s 2024-09-12T00:43:53.502 INFO:teuthology.orchestra.run.smithi043.stderr: 25250K .......... .......... .......... .......... .......... 27% 202M 1s 2024-09-12T00:43:53.503 INFO:teuthology.orchestra.run.smithi043.stderr: 25300K .......... .......... .......... .......... .......... 27% 208M 1s 2024-09-12T00:43:53.503 INFO:teuthology.orchestra.run.smithi043.stderr: 25350K .......... .......... .......... .......... .......... 27% 256M 1s 2024-09-12T00:43:53.503 INFO:teuthology.orchestra.run.smithi043.stderr: 25400K .......... .......... .......... .......... .......... 27% 237M 1s 2024-09-12T00:43:53.503 INFO:teuthology.orchestra.run.smithi043.stderr: 25450K .......... .......... .......... .......... .......... 27% 234M 1s 2024-09-12T00:43:53.503 INFO:teuthology.orchestra.run.smithi043.stderr: 25500K .......... .......... .......... .......... .......... 27% 206M 1s 2024-09-12T00:43:53.503 INFO:teuthology.orchestra.run.smithi043.stderr: 25550K .......... .......... .......... .......... .......... 27% 235M 1s 2024-09-12T00:43:53.503 INFO:teuthology.orchestra.run.smithi043.stderr: 25600K .......... .......... .......... .......... .......... 27% 238M 1s 2024-09-12T00:43:53.503 INFO:teuthology.orchestra.run.smithi043.stderr: 25650K .......... .......... .......... .......... .......... 27% 226M 1s 2024-09-12T00:43:53.503 INFO:teuthology.orchestra.run.smithi043.stderr: 25700K .......... .......... .......... .......... .......... 27% 219M 1s 2024-09-12T00:43:53.503 INFO:teuthology.orchestra.run.smithi043.stderr: 25750K .......... .......... .......... .......... .......... 27% 237M 1s 2024-09-12T00:43:53.503 INFO:teuthology.orchestra.run.smithi043.stderr: 25800K .......... .......... .......... .......... .......... 27% 243M 1s 2024-09-12T00:43:53.503 INFO:teuthology.orchestra.run.smithi043.stderr: 25850K .......... .......... .......... .......... .......... 27% 252M 1s 2024-09-12T00:43:53.503 INFO:teuthology.orchestra.run.smithi043.stderr: 25900K .......... .......... .......... .......... .......... 27% 210M 1s 2024-09-12T00:43:53.504 INFO:teuthology.orchestra.run.smithi043.stderr: 25950K .......... .......... .......... .......... .......... 27% 230M 1s 2024-09-12T00:43:53.504 INFO:teuthology.orchestra.run.smithi043.stderr: 26000K .......... .......... .......... .......... .......... 28% 234M 1s 2024-09-12T00:43:53.504 INFO:teuthology.orchestra.run.smithi043.stderr: 26050K .......... .......... .......... .......... .......... 28% 229M 1s 2024-09-12T00:43:53.504 INFO:teuthology.orchestra.run.smithi043.stderr: 26100K .......... .......... .......... .......... .......... 28% 216M 1s 2024-09-12T00:43:53.504 INFO:teuthology.orchestra.run.smithi043.stderr: 26150K .......... .......... .......... .......... .......... 28% 215M 1s 2024-09-12T00:43:53.504 INFO:teuthology.orchestra.run.smithi043.stderr: 26200K .......... .......... .......... .......... .......... 28% 188M 1s 2024-09-12T00:43:53.504 INFO:teuthology.orchestra.run.smithi043.stderr: 26250K .......... .......... .......... .......... .......... 28% 210M 1s 2024-09-12T00:43:53.504 INFO:teuthology.orchestra.run.smithi043.stderr: 26300K .......... .......... .......... .......... .......... 28% 209M 0s 2024-09-12T00:43:53.504 INFO:teuthology.orchestra.run.smithi043.stderr: 26350K .......... .......... .......... .......... .......... 28% 234M 0s 2024-09-12T00:43:53.504 INFO:teuthology.orchestra.run.smithi043.stderr: 26400K .......... .......... .......... .......... .......... 28% 225M 0s 2024-09-12T00:43:53.504 INFO:teuthology.orchestra.run.smithi043.stderr: 26450K .......... .......... .......... .......... .......... 28% 248M 0s 2024-09-12T00:43:53.504 INFO:teuthology.orchestra.run.smithi043.stderr: 26500K .......... .......... .......... .......... .......... 28% 223M 0s 2024-09-12T00:43:53.504 INFO:teuthology.orchestra.run.smithi043.stderr: 26550K .......... .......... .......... .......... .......... 28% 253M 0s 2024-09-12T00:43:53.505 INFO:teuthology.orchestra.run.smithi043.stderr: 26600K .......... .......... .......... .......... .......... 28% 258M 0s 2024-09-12T00:43:53.505 INFO:teuthology.orchestra.run.smithi043.stderr: 26650K .......... .......... .......... .......... .......... 28% 237M 0s 2024-09-12T00:43:53.505 INFO:teuthology.orchestra.run.smithi043.stderr: 26700K .......... .......... .......... .......... .......... 28% 229M 0s 2024-09-12T00:43:53.505 INFO:teuthology.orchestra.run.smithi043.stderr: 26750K .......... .......... .......... .......... .......... 28% 230M 0s 2024-09-12T00:43:53.505 INFO:teuthology.orchestra.run.smithi043.stderr: 26800K .......... .......... .......... .......... .......... 28% 196M 0s 2024-09-12T00:43:53.505 INFO:teuthology.orchestra.run.smithi043.stderr: 26850K .......... .......... .......... .......... .......... 28% 250M 0s 2024-09-12T00:43:53.505 INFO:teuthology.orchestra.run.smithi043.stderr: 26900K .......... .......... .......... .......... .......... 29% 249M 0s 2024-09-12T00:43:53.505 INFO:teuthology.orchestra.run.smithi043.stderr: 26950K .......... .......... .......... .......... .......... 29% 264M 0s 2024-09-12T00:43:53.505 INFO:teuthology.orchestra.run.smithi043.stderr: 27000K .......... .......... .......... .......... .......... 29% 225M 0s 2024-09-12T00:43:53.505 INFO:teuthology.orchestra.run.smithi043.stderr: 27050K .......... .......... .......... .......... .......... 29% 243M 0s 2024-09-12T00:43:53.505 INFO:teuthology.orchestra.run.smithi043.stderr: 27100K .......... .......... .......... .......... .......... 29% 216M 0s 2024-09-12T00:43:53.505 INFO:teuthology.orchestra.run.smithi043.stderr: 27150K .......... .......... .......... .......... .......... 29% 223M 0s 2024-09-12T00:43:53.505 INFO:teuthology.orchestra.run.smithi043.stderr: 27200K .......... .......... .......... .......... .......... 29% 233M 0s 2024-09-12T00:43:53.506 INFO:teuthology.orchestra.run.smithi043.stderr: 27250K .......... .......... .......... .......... .......... 29% 239M 0s 2024-09-12T00:43:53.506 INFO:teuthology.orchestra.run.smithi043.stderr: 27300K .......... .......... .......... .......... .......... 29% 253M 0s 2024-09-12T00:43:53.506 INFO:teuthology.orchestra.run.smithi043.stderr: 27350K .......... .......... .......... .......... .......... 29% 266M 0s 2024-09-12T00:43:53.506 INFO:teuthology.orchestra.run.smithi043.stderr: 27400K .......... .......... .......... .......... .......... 29% 204M 0s 2024-09-12T00:43:53.506 INFO:teuthology.orchestra.run.smithi043.stderr: 27450K .......... .......... .......... .......... .......... 29% 263M 0s 2024-09-12T00:43:53.506 INFO:teuthology.orchestra.run.smithi043.stderr: 27500K .......... .......... .......... .......... .......... 29% 247M 0s 2024-09-12T00:43:53.506 INFO:teuthology.orchestra.run.smithi043.stderr: 27550K .......... .......... .......... .......... .......... 29% 214M 0s 2024-09-12T00:43:53.506 INFO:teuthology.orchestra.run.smithi043.stderr: 27600K .......... .......... .......... .......... .......... 29% 216M 0s 2024-09-12T00:43:53.506 INFO:teuthology.orchestra.run.smithi043.stderr: 27650K .......... .......... .......... .......... .......... 29% 230M 0s 2024-09-12T00:43:53.506 INFO:teuthology.orchestra.run.smithi043.stderr: 27700K .......... .......... .......... .......... .......... 29% 242M 0s 2024-09-12T00:43:53.506 INFO:teuthology.orchestra.run.smithi043.stderr: 27750K .......... .......... .......... .......... .......... 29% 255M 0s 2024-09-12T00:43:53.506 INFO:teuthology.orchestra.run.smithi043.stderr: 27800K .......... .......... .......... .......... .......... 29% 220M 0s 2024-09-12T00:43:53.506 INFO:teuthology.orchestra.run.smithi043.stderr: 27850K .......... .......... .......... .......... .......... 30% 269M 0s 2024-09-12T00:43:53.507 INFO:teuthology.orchestra.run.smithi043.stderr: 27900K .......... .......... .......... .......... .......... 30% 220M 0s 2024-09-12T00:43:53.507 INFO:teuthology.orchestra.run.smithi043.stderr: 27950K .......... .......... .......... .......... .......... 30% 246M 0s 2024-09-12T00:43:53.507 INFO:teuthology.orchestra.run.smithi043.stderr: 28000K .......... .......... .......... .......... .......... 30% 252M 0s 2024-09-12T00:43:53.507 INFO:teuthology.orchestra.run.smithi043.stderr: 28050K .......... .......... .......... .......... .......... 30% 245M 0s 2024-09-12T00:43:53.507 INFO:teuthology.orchestra.run.smithi043.stderr: 28100K .......... .......... .......... .......... .......... 30% 220M 0s 2024-09-12T00:43:53.507 INFO:teuthology.orchestra.run.smithi043.stderr: 28150K .......... .......... .......... .......... .......... 30% 255M 0s 2024-09-12T00:43:53.507 INFO:teuthology.orchestra.run.smithi043.stderr: 28200K .......... .......... .......... .......... .......... 30% 252M 0s 2024-09-12T00:43:53.507 INFO:teuthology.orchestra.run.smithi043.stderr: 28250K .......... .......... .......... .......... .......... 30% 259M 0s 2024-09-12T00:43:53.507 INFO:teuthology.orchestra.run.smithi043.stderr: 28300K .......... .......... .......... .......... .......... 30% 279M 0s 2024-09-12T00:43:53.507 INFO:teuthology.orchestra.run.smithi043.stderr: 28350K .......... .......... .......... .......... .......... 30% 274M 0s 2024-09-12T00:43:53.507 INFO:teuthology.orchestra.run.smithi043.stderr: 28400K .......... .......... .......... .......... .......... 30% 203M 0s 2024-09-12T00:43:53.507 INFO:teuthology.orchestra.run.smithi043.stderr: 28450K .......... .......... .......... .......... .......... 30% 256M 0s 2024-09-12T00:43:53.507 INFO:teuthology.orchestra.run.smithi043.stderr: 28500K .......... .......... .......... .......... .......... 30% 231M 0s 2024-09-12T00:43:53.508 INFO:teuthology.orchestra.run.smithi043.stderr: 28550K .......... .......... .......... .......... .......... 30% 265M 0s 2024-09-12T00:43:53.508 INFO:teuthology.orchestra.run.smithi043.stderr: 28600K .......... .......... .......... .......... .......... 30% 256M 0s 2024-09-12T00:43:53.508 INFO:teuthology.orchestra.run.smithi043.stderr: 28650K .......... .......... .......... .......... .......... 30% 267M 0s 2024-09-12T00:43:53.508 INFO:teuthology.orchestra.run.smithi043.stderr: 28700K .......... .......... .......... .......... .......... 30% 229M 0s 2024-09-12T00:43:53.508 INFO:teuthology.orchestra.run.smithi043.stderr: 28750K .......... .......... .......... .......... .......... 31% 224M 0s 2024-09-12T00:43:53.508 INFO:teuthology.orchestra.run.smithi043.stderr: 28800K .......... .......... .......... .......... .......... 31% 277M 0s 2024-09-12T00:43:53.508 INFO:teuthology.orchestra.run.smithi043.stderr: 28850K .......... .......... .......... .......... .......... 31% 259M 0s 2024-09-12T00:43:53.508 INFO:teuthology.orchestra.run.smithi043.stderr: 28900K .......... .......... .......... .......... .......... 31% 256M 0s 2024-09-12T00:43:53.508 INFO:teuthology.orchestra.run.smithi043.stderr: 28950K .......... .......... .......... .......... .......... 31% 285M 0s 2024-09-12T00:43:53.508 INFO:teuthology.orchestra.run.smithi043.stderr: 29000K .......... .......... .......... .......... .......... 31% 248M 0s 2024-09-12T00:43:53.508 INFO:teuthology.orchestra.run.smithi043.stderr: 29050K .......... .......... .......... .......... .......... 31% 265M 0s 2024-09-12T00:43:53.508 INFO:teuthology.orchestra.run.smithi043.stderr: 29100K .......... .......... .......... .......... .......... 31% 194M 0s 2024-09-12T00:43:53.508 INFO:teuthology.orchestra.run.smithi043.stderr: 29150K .......... .......... .......... .......... .......... 31% 293M 0s 2024-09-12T00:43:53.509 INFO:teuthology.orchestra.run.smithi043.stderr: 29200K .......... .......... .......... .......... .......... 31% 253M 0s 2024-09-12T00:43:53.509 INFO:teuthology.orchestra.run.smithi043.stderr: 29250K .......... .......... .......... .......... .......... 31% 284M 0s 2024-09-12T00:43:53.509 INFO:teuthology.orchestra.run.smithi043.stderr: 29300K .......... .......... .......... .......... .......... 31% 263M 0s 2024-09-12T00:43:53.509 INFO:teuthology.orchestra.run.smithi043.stderr: 29350K .......... .......... .......... .......... .......... 31% 280M 0s 2024-09-12T00:43:53.509 INFO:teuthology.orchestra.run.smithi043.stderr: 29400K .......... .......... .......... .......... .......... 31% 276M 0s 2024-09-12T00:43:53.509 INFO:teuthology.orchestra.run.smithi043.stderr: 29450K .......... .......... .......... .......... .......... 31% 284M 0s 2024-09-12T00:43:53.509 INFO:teuthology.orchestra.run.smithi043.stderr: 29500K .......... .......... .......... .......... .......... 31% 241M 0s 2024-09-12T00:43:53.509 INFO:teuthology.orchestra.run.smithi043.stderr: 29550K .......... .......... .......... .......... .......... 31% 300M 0s 2024-09-12T00:43:53.509 INFO:teuthology.orchestra.run.smithi043.stderr: 29600K .......... .......... .......... .......... .......... 31% 307M 0s 2024-09-12T00:43:53.509 INFO:teuthology.orchestra.run.smithi043.stderr: 29650K .......... .......... .......... .......... .......... 31% 279M 0s 2024-09-12T00:43:53.509 INFO:teuthology.orchestra.run.smithi043.stderr: 29700K .......... .......... .......... .......... .......... 32% 257M 0s 2024-09-12T00:43:53.509 INFO:teuthology.orchestra.run.smithi043.stderr: 29750K .......... .......... .......... .......... .......... 32% 286M 0s 2024-09-12T00:43:53.509 INFO:teuthology.orchestra.run.smithi043.stderr: 29800K .......... .......... .......... .......... .......... 32% 276M 0s 2024-09-12T00:43:53.510 INFO:teuthology.orchestra.run.smithi043.stderr: 29850K .......... .......... .......... .......... .......... 32% 303M 0s 2024-09-12T00:43:53.510 INFO:teuthology.orchestra.run.smithi043.stderr: 29900K .......... .......... .......... .......... .......... 32% 223M 0s 2024-09-12T00:43:53.510 INFO:teuthology.orchestra.run.smithi043.stderr: 29950K .......... .......... .......... .......... .......... 32% 296M 0s 2024-09-12T00:43:53.510 INFO:teuthology.orchestra.run.smithi043.stderr: 30000K .......... .......... .......... .......... .......... 32% 306M 0s 2024-09-12T00:43:53.510 INFO:teuthology.orchestra.run.smithi043.stderr: 30050K .......... .......... .......... .......... .......... 32% 257M 0s 2024-09-12T00:43:53.510 INFO:teuthology.orchestra.run.smithi043.stderr: 30100K .......... .......... .......... .......... .......... 32% 246M 0s 2024-09-12T00:43:53.510 INFO:teuthology.orchestra.run.smithi043.stderr: 30150K .......... .......... .......... .......... .......... 32% 308M 0s 2024-09-12T00:43:53.510 INFO:teuthology.orchestra.run.smithi043.stderr: 30200K .......... .......... .......... .......... .......... 32% 206M 0s 2024-09-12T00:43:53.510 INFO:teuthology.orchestra.run.smithi043.stderr: 30250K .......... .......... .......... .......... .......... 32% 226M 0s 2024-09-12T00:43:53.510 INFO:teuthology.orchestra.run.smithi043.stderr: 30300K .......... .......... .......... .......... .......... 32% 212M 0s 2024-09-12T00:43:53.510 INFO:teuthology.orchestra.run.smithi043.stderr: 30350K .......... .......... .......... .......... .......... 32% 250M 0s 2024-09-12T00:43:53.510 INFO:teuthology.orchestra.run.smithi043.stderr: 30400K .......... .......... .......... .......... .......... 32% 248M 0s 2024-09-12T00:43:53.510 INFO:teuthology.orchestra.run.smithi043.stderr: 30450K .......... .......... .......... .......... .......... 32% 241M 0s 2024-09-12T00:43:53.510 INFO:teuthology.orchestra.run.smithi043.stderr: 30500K .......... .......... .......... .......... .......... 32% 253M 0s 2024-09-12T00:43:53.511 INFO:teuthology.orchestra.run.smithi043.stderr: 30550K .......... .......... .......... .......... .......... 32% 201M 0s 2024-09-12T00:43:53.511 INFO:teuthology.orchestra.run.smithi043.stderr: 30600K .......... .......... .......... .......... .......... 32% 266M 0s 2024-09-12T00:43:53.511 INFO:teuthology.orchestra.run.smithi043.stderr: 30650K .......... .......... .......... .......... .......... 33% 277M 0s 2024-09-12T00:43:53.511 INFO:teuthology.orchestra.run.smithi043.stderr: 30700K .......... .......... .......... .......... .......... 33% 296M 0s 2024-09-12T00:43:53.511 INFO:teuthology.orchestra.run.smithi043.stderr: 30750K .......... .......... .......... .......... .......... 33% 218M 0s 2024-09-12T00:43:53.511 INFO:teuthology.orchestra.run.smithi043.stderr: 30800K .......... .......... .......... .......... .......... 33% 284M 0s 2024-09-12T00:43:53.511 INFO:teuthology.orchestra.run.smithi043.stderr: 30850K .......... .......... .......... .......... .......... 33% 302M 0s 2024-09-12T00:43:53.511 INFO:teuthology.orchestra.run.smithi043.stderr: 30900K .......... .......... .......... .......... .......... 33% 237M 0s 2024-09-12T00:43:53.511 INFO:teuthology.orchestra.run.smithi043.stderr: 30950K .......... .......... .......... .......... .......... 33% 281M 0s 2024-09-12T00:43:53.511 INFO:teuthology.orchestra.run.smithi043.stderr: 31000K .......... .......... .......... .......... .......... 33% 291M 0s 2024-09-12T00:43:53.511 INFO:teuthology.orchestra.run.smithi043.stderr: 31050K .......... .......... .......... .......... .......... 33% 306M 0s 2024-09-12T00:43:53.511 INFO:teuthology.orchestra.run.smithi043.stderr: 31100K .......... .......... .......... .......... .......... 33% 290M 0s 2024-09-12T00:43:53.511 INFO:teuthology.orchestra.run.smithi043.stderr: 31150K .......... .......... .......... .......... .......... 33% 215M 0s 2024-09-12T00:43:53.512 INFO:teuthology.orchestra.run.smithi043.stderr: 31200K .......... .......... .......... .......... .......... 33% 301M 0s 2024-09-12T00:43:53.512 INFO:teuthology.orchestra.run.smithi043.stderr: 31250K .......... .......... .......... .......... .......... 33% 82.4M 0s 2024-09-12T00:43:53.512 INFO:teuthology.orchestra.run.smithi043.stderr: 31300K .......... .......... .......... .......... .......... 33% 293M 0s 2024-09-12T00:43:53.512 INFO:teuthology.orchestra.run.smithi043.stderr: 31350K .......... .......... .......... .......... .......... 33% 192M 0s 2024-09-12T00:43:53.512 INFO:teuthology.orchestra.run.smithi043.stderr: 31400K .......... .......... .......... .......... .......... 33% 225M 0s 2024-09-12T00:43:53.512 INFO:teuthology.orchestra.run.smithi043.stderr: 31450K .......... .......... .......... .......... .......... 33% 243M 0s 2024-09-12T00:43:53.512 INFO:teuthology.orchestra.run.smithi043.stderr: 31500K .......... .......... .......... .......... .......... 33% 218M 0s 2024-09-12T00:43:53.512 INFO:teuthology.orchestra.run.smithi043.stderr: 31550K .......... .......... .......... .......... .......... 34% 193M 0s 2024-09-12T00:43:53.512 INFO:teuthology.orchestra.run.smithi043.stderr: 31600K .......... .......... .......... .......... .......... 34% 247M 0s 2024-09-12T00:43:53.512 INFO:teuthology.orchestra.run.smithi043.stderr: 31650K .......... .......... .......... .......... .......... 34% 246M 0s 2024-09-12T00:43:53.512 INFO:teuthology.orchestra.run.smithi043.stderr: 31700K .......... .......... .......... .......... .......... 34% 220M 0s 2024-09-12T00:43:53.512 INFO:teuthology.orchestra.run.smithi043.stderr: 31750K .......... .......... .......... .......... .......... 34% 199M 0s 2024-09-12T00:43:53.512 INFO:teuthology.orchestra.run.smithi043.stderr: 31800K .......... .......... .......... .......... .......... 34% 246M 0s 2024-09-12T00:43:53.513 INFO:teuthology.orchestra.run.smithi043.stderr: 31850K .......... .......... .......... .......... .......... 34% 217M 0s 2024-09-12T00:43:53.513 INFO:teuthology.orchestra.run.smithi043.stderr: 31900K .......... .......... .......... .......... .......... 34% 243M 0s 2024-09-12T00:43:53.513 INFO:teuthology.orchestra.run.smithi043.stderr: 31950K .......... .......... .......... .......... .......... 34% 228M 0s 2024-09-12T00:43:53.513 INFO:teuthology.orchestra.run.smithi043.stderr: 32000K .......... .......... .......... .......... .......... 34% 226M 0s 2024-09-12T00:43:53.513 INFO:teuthology.orchestra.run.smithi043.stderr: 32050K .......... .......... .......... .......... .......... 34% 186M 0s 2024-09-12T00:43:53.513 INFO:teuthology.orchestra.run.smithi043.stderr: 32100K .......... .......... .......... .......... .......... 34% 243M 0s 2024-09-12T00:43:53.513 INFO:teuthology.orchestra.run.smithi043.stderr: 32150K .......... .......... .......... .......... .......... 34% 233M 0s 2024-09-12T00:43:53.513 INFO:teuthology.orchestra.run.smithi043.stderr: 32200K .......... .......... .......... .......... .......... 34% 272M 0s 2024-09-12T00:43:53.513 INFO:teuthology.orchestra.run.smithi043.stderr: 32250K .......... .......... .......... .......... .......... 34% 267M 0s 2024-09-12T00:43:53.513 INFO:teuthology.orchestra.run.smithi043.stderr: 32300K .......... .......... .......... .......... .......... 34% 235M 0s 2024-09-12T00:43:53.513 INFO:teuthology.orchestra.run.smithi043.stderr: 32350K .......... .......... .......... .......... .......... 34% 198M 0s 2024-09-12T00:43:53.513 INFO:teuthology.orchestra.run.smithi043.stderr: 32400K .......... .......... .......... .......... .......... 34% 243M 0s 2024-09-12T00:43:53.513 INFO:teuthology.orchestra.run.smithi043.stderr: 32450K .......... .......... .......... .......... .......... 34% 262M 0s 2024-09-12T00:43:53.514 INFO:teuthology.orchestra.run.smithi043.stderr: 32500K .......... .......... .......... .......... .......... 35% 260M 0s 2024-09-12T00:43:53.514 INFO:teuthology.orchestra.run.smithi043.stderr: 32550K .......... .......... .......... .......... .......... 35% 236M 0s 2024-09-12T00:43:53.514 INFO:teuthology.orchestra.run.smithi043.stderr: 32600K .......... .......... .......... .......... .......... 35% 281M 0s 2024-09-12T00:43:53.514 INFO:teuthology.orchestra.run.smithi043.stderr: 32650K .......... .......... .......... .......... .......... 35% 249M 0s 2024-09-12T00:43:53.514 INFO:teuthology.orchestra.run.smithi043.stderr: 32700K .......... .......... .......... .......... .......... 35% 266M 0s 2024-09-12T00:43:53.514 INFO:teuthology.orchestra.run.smithi043.stderr: 32750K .......... .......... .......... .......... .......... 35% 235M 0s 2024-09-12T00:43:53.514 INFO:teuthology.orchestra.run.smithi043.stderr: 32800K .......... .......... .......... .......... .......... 35% 288M 0s 2024-09-12T00:43:53.514 INFO:teuthology.orchestra.run.smithi043.stderr: 32850K .......... .......... .......... .......... .......... 35% 217M 0s 2024-09-12T00:43:53.514 INFO:teuthology.orchestra.run.smithi043.stderr: 32900K .......... .......... .......... .......... .......... 35% 266M 0s 2024-09-12T00:43:53.514 INFO:teuthology.orchestra.run.smithi043.stderr: 32950K .......... .......... .......... .......... .......... 35% 256M 0s 2024-09-12T00:43:53.514 INFO:teuthology.orchestra.run.smithi043.stderr: 33000K .......... .......... .......... .......... .......... 35% 277M 0s 2024-09-12T00:43:53.514 INFO:teuthology.orchestra.run.smithi043.stderr: 33050K .......... .......... .......... .......... .......... 35% 263M 0s 2024-09-12T00:43:53.514 INFO:teuthology.orchestra.run.smithi043.stderr: 33100K .......... .......... .......... .......... .......... 35% 267M 0s 2024-09-12T00:43:53.514 INFO:teuthology.orchestra.run.smithi043.stderr: 33150K .......... .......... .......... .......... .......... 35% 223M 0s 2024-09-12T00:43:53.515 INFO:teuthology.orchestra.run.smithi043.stderr: 33200K .......... .......... .......... .......... .......... 35% 288M 0s 2024-09-12T00:43:53.515 INFO:teuthology.orchestra.run.smithi043.stderr: 33250K .......... .......... .......... .......... .......... 35% 284M 0s 2024-09-12T00:43:53.515 INFO:teuthology.orchestra.run.smithi043.stderr: 33300K .......... .......... .......... .......... .......... 35% 291M 0s 2024-09-12T00:43:53.515 INFO:teuthology.orchestra.run.smithi043.stderr: 33350K .......... .......... .......... .......... .......... 35% 186M 0s 2024-09-12T00:43:53.515 INFO:teuthology.orchestra.run.smithi043.stderr: 33400K .......... .......... .......... .......... .......... 36% 240M 0s 2024-09-12T00:43:53.515 INFO:teuthology.orchestra.run.smithi043.stderr: 33450K .......... .......... .......... .......... .......... 36% 288M 0s 2024-09-12T00:43:53.515 INFO:teuthology.orchestra.run.smithi043.stderr: 33500K .......... .......... .......... .......... .......... 36% 272M 0s 2024-09-12T00:43:53.515 INFO:teuthology.orchestra.run.smithi043.stderr: 33550K .......... .......... .......... .......... .......... 36% 223M 0s 2024-09-12T00:43:53.515 INFO:teuthology.orchestra.run.smithi043.stderr: 33600K .......... .......... .......... .......... .......... 36% 261M 0s 2024-09-12T00:43:53.515 INFO:teuthology.orchestra.run.smithi043.stderr: 33650K .......... .......... .......... .......... .......... 36% 248M 0s 2024-09-12T00:43:53.515 INFO:teuthology.orchestra.run.smithi043.stderr: 33700K .......... .......... .......... .......... .......... 36% 254M 0s 2024-09-12T00:43:53.515 INFO:teuthology.orchestra.run.smithi043.stderr: 33750K .......... .......... .......... .......... .......... 36% 223M 0s 2024-09-12T00:43:53.515 INFO:teuthology.orchestra.run.smithi043.stderr: 33800K .......... .......... .......... .......... .......... 36% 264M 0s 2024-09-12T00:43:53.516 INFO:teuthology.orchestra.run.smithi043.stderr: 33850K .......... .......... .......... .......... .......... 36% 276M 0s 2024-09-12T00:43:53.516 INFO:teuthology.orchestra.run.smithi043.stderr: 33900K .......... .......... .......... .......... .......... 36% 239M 0s 2024-09-12T00:43:53.516 INFO:teuthology.orchestra.run.smithi043.stderr: 33950K .......... .......... .......... .......... .......... 36% 229M 0s 2024-09-12T00:43:53.516 INFO:teuthology.orchestra.run.smithi043.stderr: 34000K .......... .......... .......... .......... .......... 36% 248M 0s 2024-09-12T00:43:53.516 INFO:teuthology.orchestra.run.smithi043.stderr: 34050K .......... .......... .......... .......... .......... 36% 265M 0s 2024-09-12T00:43:53.516 INFO:teuthology.orchestra.run.smithi043.stderr: 34100K .......... .......... .......... .......... .......... 36% 249M 0s 2024-09-12T00:43:53.516 INFO:teuthology.orchestra.run.smithi043.stderr: 34150K .......... .......... .......... .......... .......... 36% 228M 0s 2024-09-12T00:43:53.516 INFO:teuthology.orchestra.run.smithi043.stderr: 34200K .......... .......... .......... .......... .......... 36% 278M 0s 2024-09-12T00:43:53.516 INFO:teuthology.orchestra.run.smithi043.stderr: 34250K .......... .......... .......... .......... .......... 36% 251M 0s 2024-09-12T00:43:53.516 INFO:teuthology.orchestra.run.smithi043.stderr: 34300K .......... .......... .......... .......... .......... 36% 262M 0s 2024-09-12T00:43:53.516 INFO:teuthology.orchestra.run.smithi043.stderr: 34350K .......... .......... .......... .......... .......... 37% 221M 0s 2024-09-12T00:43:53.516 INFO:teuthology.orchestra.run.smithi043.stderr: 34400K .......... .......... .......... .......... .......... 37% 243M 0s 2024-09-12T00:43:53.516 INFO:teuthology.orchestra.run.smithi043.stderr: 34450K .......... .......... .......... .......... .......... 37% 249M 0s 2024-09-12T00:43:53.517 INFO:teuthology.orchestra.run.smithi043.stderr: 34500K .......... .......... .......... .......... .......... 37% 244M 0s 2024-09-12T00:43:53.517 INFO:teuthology.orchestra.run.smithi043.stderr: 34550K .......... .......... .......... .......... .......... 37% 244M 0s 2024-09-12T00:43:53.517 INFO:teuthology.orchestra.run.smithi043.stderr: 34600K .......... .......... .......... .......... .......... 37% 279M 0s 2024-09-12T00:43:53.517 INFO:teuthology.orchestra.run.smithi043.stderr: 34650K .......... .......... .......... .......... .......... 37% 267M 0s 2024-09-12T00:43:53.517 INFO:teuthology.orchestra.run.smithi043.stderr: 34700K .......... .......... .......... .......... .......... 37% 280M 0s 2024-09-12T00:43:53.517 INFO:teuthology.orchestra.run.smithi043.stderr: 34750K .......... .......... .......... .......... .......... 37% 242M 0s 2024-09-12T00:43:53.517 INFO:teuthology.orchestra.run.smithi043.stderr: 34800K .......... .......... .......... .......... .......... 37% 100M 0s 2024-09-12T00:43:53.517 INFO:teuthology.orchestra.run.smithi043.stderr: 34850K .......... .......... .......... .......... .......... 37% 227M 0s 2024-09-12T00:43:53.517 INFO:teuthology.orchestra.run.smithi043.stderr: 34900K .......... .......... .......... .......... .......... 37% 236M 0s 2024-09-12T00:43:53.517 INFO:teuthology.orchestra.run.smithi043.stderr: 34950K .......... .......... .......... .......... .......... 37% 219M 0s 2024-09-12T00:43:53.517 INFO:teuthology.orchestra.run.smithi043.stderr: 35000K .......... .......... .......... .......... .......... 37% 267M 0s 2024-09-12T00:43:53.517 INFO:teuthology.orchestra.run.smithi043.stderr: 35050K .......... .......... .......... .......... .......... 37% 245M 0s 2024-09-12T00:43:53.517 INFO:teuthology.orchestra.run.smithi043.stderr: 35100K .......... .......... .......... .......... .......... 37% 261M 0s 2024-09-12T00:43:53.518 INFO:teuthology.orchestra.run.smithi043.stderr: 35150K .......... .......... .......... .......... .......... 37% 222M 0s 2024-09-12T00:43:53.518 INFO:teuthology.orchestra.run.smithi043.stderr: 35200K .......... .......... .......... .......... .......... 37% 267M 0s 2024-09-12T00:43:53.518 INFO:teuthology.orchestra.run.smithi043.stderr: 35250K .......... .......... .......... .......... .......... 37% 262M 0s 2024-09-12T00:43:53.518 INFO:teuthology.orchestra.run.smithi043.stderr: 35300K .......... .......... .......... .......... .......... 38% 265M 0s 2024-09-12T00:43:53.518 INFO:teuthology.orchestra.run.smithi043.stderr: 35350K .......... .......... .......... .......... .......... 38% 236M 0s 2024-09-12T00:43:53.518 INFO:teuthology.orchestra.run.smithi043.stderr: 35400K .......... .......... .......... .......... .......... 38% 270M 0s 2024-09-12T00:43:53.518 INFO:teuthology.orchestra.run.smithi043.stderr: 35450K .......... .......... .......... .......... .......... 38% 270M 0s 2024-09-12T00:43:53.518 INFO:teuthology.orchestra.run.smithi043.stderr: 35500K .......... .......... .......... .......... .......... 38% 265M 0s 2024-09-12T00:43:53.518 INFO:teuthology.orchestra.run.smithi043.stderr: 35550K .......... .......... .......... .......... .......... 38% 201M 0s 2024-09-12T00:43:53.518 INFO:teuthology.orchestra.run.smithi043.stderr: 35600K .......... .......... .......... .......... .......... 38% 240M 0s 2024-09-12T00:43:53.518 INFO:teuthology.orchestra.run.smithi043.stderr: 35650K .......... .......... .......... .......... .......... 38% 249M 0s 2024-09-12T00:43:53.518 INFO:teuthology.orchestra.run.smithi043.stderr: 35700K .......... .......... .......... .......... .......... 38% 269M 0s 2024-09-12T00:43:53.518 INFO:teuthology.orchestra.run.smithi043.stderr: 35750K .......... .......... .......... .......... .......... 38% 226M 0s 2024-09-12T00:43:53.518 INFO:teuthology.orchestra.run.smithi043.stderr: 35800K .......... .......... .......... .......... .......... 38% 255M 0s 2024-09-12T00:43:53.519 INFO:teuthology.orchestra.run.smithi043.stderr: 35850K .......... .......... .......... .......... .......... 38% 245M 0s 2024-09-12T00:43:53.519 INFO:teuthology.orchestra.run.smithi043.stderr: 35900K .......... .......... .......... .......... .......... 38% 228M 0s 2024-09-12T00:43:53.519 INFO:teuthology.orchestra.run.smithi043.stderr: 35950K .......... .......... .......... .......... .......... 38% 205M 0s 2024-09-12T00:43:53.519 INFO:teuthology.orchestra.run.smithi043.stderr: 36000K .......... .......... .......... .......... .......... 38% 233M 0s 2024-09-12T00:43:53.519 INFO:teuthology.orchestra.run.smithi043.stderr: 36050K .......... .......... .......... .......... .......... 38% 248M 0s 2024-09-12T00:43:53.519 INFO:teuthology.orchestra.run.smithi043.stderr: 36100K .......... .......... .......... .......... .......... 38% 277M 0s 2024-09-12T00:43:53.519 INFO:teuthology.orchestra.run.smithi043.stderr: 36150K .......... .......... .......... .......... .......... 38% 238M 0s 2024-09-12T00:43:53.519 INFO:teuthology.orchestra.run.smithi043.stderr: 36200K .......... .......... .......... .......... .......... 39% 219M 0s 2024-09-12T00:43:53.519 INFO:teuthology.orchestra.run.smithi043.stderr: 36250K .......... .......... .......... .......... .......... 39% 198M 0s 2024-09-12T00:43:53.519 INFO:teuthology.orchestra.run.smithi043.stderr: 36300K .......... .......... .......... .......... .......... 39% 251M 0s 2024-09-12T00:43:53.519 INFO:teuthology.orchestra.run.smithi043.stderr: 36350K .......... .......... .......... .......... .......... 39% 225M 0s 2024-09-12T00:43:53.519 INFO:teuthology.orchestra.run.smithi043.stderr: 36400K .......... .......... .......... .......... .......... 39% 277M 0s 2024-09-12T00:43:53.519 INFO:teuthology.orchestra.run.smithi043.stderr: 36450K .......... .......... .......... .......... .......... 39% 240M 0s 2024-09-12T00:43:53.520 INFO:teuthology.orchestra.run.smithi043.stderr: 36500K .......... .......... .......... .......... .......... 39% 243M 0s 2024-09-12T00:43:53.520 INFO:teuthology.orchestra.run.smithi043.stderr: 36550K .......... .......... .......... .......... .......... 39% 239M 0s 2024-09-12T00:43:53.520 INFO:teuthology.orchestra.run.smithi043.stderr: 36600K .......... .......... .......... .......... .......... 39% 258M 0s 2024-09-12T00:43:53.520 INFO:teuthology.orchestra.run.smithi043.stderr: 36650K .......... .......... .......... .......... .......... 39% 240M 0s 2024-09-12T00:43:53.520 INFO:teuthology.orchestra.run.smithi043.stderr: 36700K .......... .......... .......... .......... .......... 39% 260M 0s 2024-09-12T00:43:53.520 INFO:teuthology.orchestra.run.smithi043.stderr: 36750K .......... .......... .......... .......... .......... 39% 241M 0s 2024-09-12T00:43:53.520 INFO:teuthology.orchestra.run.smithi043.stderr: 36800K .......... .......... .......... .......... .......... 39% 276M 0s 2024-09-12T00:43:53.520 INFO:teuthology.orchestra.run.smithi043.stderr: 36850K .......... .......... .......... .......... .......... 39% 248M 0s 2024-09-12T00:43:53.520 INFO:teuthology.orchestra.run.smithi043.stderr: 36900K .......... .......... .......... .......... .......... 39% 259M 0s 2024-09-12T00:43:53.520 INFO:teuthology.orchestra.run.smithi043.stderr: 36950K .......... .......... .......... .......... .......... 39% 190M 0s 2024-09-12T00:43:53.520 INFO:teuthology.orchestra.run.smithi043.stderr: 37000K .......... .......... .......... .......... .......... 39% 267M 0s 2024-09-12T00:43:53.520 INFO:teuthology.orchestra.run.smithi043.stderr: 37050K .......... .......... .......... .......... .......... 39% 240M 0s 2024-09-12T00:43:53.520 INFO:teuthology.orchestra.run.smithi043.stderr: 37100K .......... .......... .......... .......... .......... 39% 271M 0s 2024-09-12T00:43:53.521 INFO:teuthology.orchestra.run.smithi043.stderr: 37150K .......... .......... .......... .......... .......... 40% 222M 0s 2024-09-12T00:43:53.521 INFO:teuthology.orchestra.run.smithi043.stderr: 37200K .......... .......... .......... .......... .......... 40% 259M 0s 2024-09-12T00:43:53.521 INFO:teuthology.orchestra.run.smithi043.stderr: 37250K .......... .......... .......... .......... .......... 40% 266M 0s 2024-09-12T00:43:53.521 INFO:teuthology.orchestra.run.smithi043.stderr: 37300K .......... .......... .......... .......... .......... 40% 248M 0s 2024-09-12T00:43:53.521 INFO:teuthology.orchestra.run.smithi043.stderr: 37350K .......... .......... .......... .......... .......... 40% 239M 0s 2024-09-12T00:43:53.521 INFO:teuthology.orchestra.run.smithi043.stderr: 37400K .......... .......... .......... .......... .......... 40% 262M 0s 2024-09-12T00:43:53.521 INFO:teuthology.orchestra.run.smithi043.stderr: 37450K .......... .......... .......... .......... .......... 40% 269M 0s 2024-09-12T00:43:53.521 INFO:teuthology.orchestra.run.smithi043.stderr: 37500K .......... .......... .......... .......... .......... 40% 273M 0s 2024-09-12T00:43:53.521 INFO:teuthology.orchestra.run.smithi043.stderr: 37550K .......... .......... .......... .......... .......... 40% 231M 0s 2024-09-12T00:43:53.521 INFO:teuthology.orchestra.run.smithi043.stderr: 37600K .......... .......... .......... .......... .......... 40% 274M 0s 2024-09-12T00:43:53.521 INFO:teuthology.orchestra.run.smithi043.stderr: 37650K .......... .......... .......... .......... .......... 40% 261M 0s 2024-09-12T00:43:53.521 INFO:teuthology.orchestra.run.smithi043.stderr: 37700K .......... .......... .......... .......... .......... 40% 276M 0s 2024-09-12T00:43:53.521 INFO:teuthology.orchestra.run.smithi043.stderr: 37750K .......... .......... .......... .......... .......... 40% 238M 0s 2024-09-12T00:43:53.521 INFO:teuthology.orchestra.run.smithi043.stderr: 37800K .......... .......... .......... .......... .......... 40% 289M 0s 2024-09-12T00:43:53.522 INFO:teuthology.orchestra.run.smithi043.stderr: 37850K .......... .......... .......... .......... .......... 40% 255M 0s 2024-09-12T00:43:53.522 INFO:teuthology.orchestra.run.smithi043.stderr: 37900K .......... .......... .......... .......... .......... 40% 264M 0s 2024-09-12T00:43:53.522 INFO:teuthology.orchestra.run.smithi043.stderr: 37950K .......... .......... .......... .......... .......... 40% 227M 0s 2024-09-12T00:43:53.522 INFO:teuthology.orchestra.run.smithi043.stderr: 38000K .......... .......... .......... .......... .......... 40% 283M 0s 2024-09-12T00:43:53.522 INFO:teuthology.orchestra.run.smithi043.stderr: 38050K .......... .......... .......... .......... .......... 41% 269M 0s 2024-09-12T00:43:53.522 INFO:teuthology.orchestra.run.smithi043.stderr: 38100K .......... .......... .......... .......... .......... 41% 253M 0s 2024-09-12T00:43:53.522 INFO:teuthology.orchestra.run.smithi043.stderr: 38150K .......... .......... .......... .......... .......... 41% 247M 0s 2024-09-12T00:43:53.522 INFO:teuthology.orchestra.run.smithi043.stderr: 38200K .......... .......... .......... .......... .......... 41% 202M 0s 2024-09-12T00:43:53.522 INFO:teuthology.orchestra.run.smithi043.stderr: 38250K .......... .......... .......... .......... .......... 41% 273M 0s 2024-09-12T00:43:53.522 INFO:teuthology.orchestra.run.smithi043.stderr: 38300K .......... .......... .......... .......... .......... 41% 296M 0s 2024-09-12T00:43:53.522 INFO:teuthology.orchestra.run.smithi043.stderr: 38350K .......... .......... .......... .......... .......... 41% 228M 0s 2024-09-12T00:43:53.522 INFO:teuthology.orchestra.run.smithi043.stderr: 38400K .......... .......... .......... .......... .......... 41% 288M 0s 2024-09-12T00:43:53.522 INFO:teuthology.orchestra.run.smithi043.stderr: 38450K .......... .......... .......... .......... .......... 41% 296M 0s 2024-09-12T00:43:53.523 INFO:teuthology.orchestra.run.smithi043.stderr: 38500K .......... .......... .......... .......... .......... 41% 307M 0s 2024-09-12T00:43:53.523 INFO:teuthology.orchestra.run.smithi043.stderr: 38550K .......... .......... .......... .......... .......... 41% 263M 0s 2024-09-12T00:43:53.523 INFO:teuthology.orchestra.run.smithi043.stderr: 38600K .......... .......... .......... .......... .......... 41% 270M 0s 2024-09-12T00:43:53.523 INFO:teuthology.orchestra.run.smithi043.stderr: 38650K .......... .......... .......... .......... .......... 41% 302M 0s 2024-09-12T00:43:53.523 INFO:teuthology.orchestra.run.smithi043.stderr: 38700K .......... .......... .......... .......... .......... 41% 225M 0s 2024-09-12T00:43:53.523 INFO:teuthology.orchestra.run.smithi043.stderr: 38750K .......... .......... .......... .......... .......... 41% 136M 0s 2024-09-12T00:43:53.523 INFO:teuthology.orchestra.run.smithi043.stderr: 38800K .......... .......... .......... .......... .......... 41% 160M 0s 2024-09-12T00:43:53.523 INFO:teuthology.orchestra.run.smithi043.stderr: 38850K .......... .......... .......... .......... .......... 41% 199M 0s 2024-09-12T00:43:53.523 INFO:teuthology.orchestra.run.smithi043.stderr: 38900K .......... .......... .......... .......... .......... 41% 274M 0s 2024-09-12T00:43:53.523 INFO:teuthology.orchestra.run.smithi043.stderr: 38950K .......... .......... .......... .......... .......... 41% 256M 0s 2024-09-12T00:43:53.523 INFO:teuthology.orchestra.run.smithi043.stderr: 39000K .......... .......... .......... .......... .......... 42% 298M 0s 2024-09-12T00:43:53.523 INFO:teuthology.orchestra.run.smithi043.stderr: 39050K .......... .......... .......... .......... .......... 42% 67.8M 0s 2024-09-12T00:43:53.523 INFO:teuthology.orchestra.run.smithi043.stderr: 39100K .......... .......... .......... .......... .......... 42% 125M 0s 2024-09-12T00:43:53.524 INFO:teuthology.orchestra.run.smithi043.stderr: 39150K .......... .......... .......... .......... .......... 42% 233M 0s 2024-09-12T00:43:53.524 INFO:teuthology.orchestra.run.smithi043.stderr: 39200K .......... .......... .......... .......... .......... 42% 256M 0s 2024-09-12T00:43:53.524 INFO:teuthology.orchestra.run.smithi043.stderr: 39250K .......... .......... .......... .......... .......... 42% 197M 0s 2024-09-12T00:43:53.524 INFO:teuthology.orchestra.run.smithi043.stderr: 39300K .......... .......... .......... .......... .......... 42% 255M 0s 2024-09-12T00:43:53.524 INFO:teuthology.orchestra.run.smithi043.stderr: 39350K .......... .......... .......... .......... .......... 42% 236M 0s 2024-09-12T00:43:53.524 INFO:teuthology.orchestra.run.smithi043.stderr: 39400K .......... .......... .......... .......... .......... 42% 251M 0s 2024-09-12T00:43:53.524 INFO:teuthology.orchestra.run.smithi043.stderr: 39450K .......... .......... .......... .......... .......... 42% 229M 0s 2024-09-12T00:43:53.524 INFO:teuthology.orchestra.run.smithi043.stderr: 39500K .......... .......... .......... .......... .......... 42% 253M 0s 2024-09-12T00:43:53.524 INFO:teuthology.orchestra.run.smithi043.stderr: 39550K .......... .......... .......... .......... .......... 42% 277M 0s 2024-09-12T00:43:53.524 INFO:teuthology.orchestra.run.smithi043.stderr: 39600K .......... .......... .......... .......... .......... 42% 244M 0s 2024-09-12T00:43:53.524 INFO:teuthology.orchestra.run.smithi043.stderr: 39650K .......... .......... .......... .......... .......... 42% 226M 0s 2024-09-12T00:43:53.524 INFO:teuthology.orchestra.run.smithi043.stderr: 39700K .......... .......... .......... .......... .......... 42% 250M 0s 2024-09-12T00:43:53.524 INFO:teuthology.orchestra.run.smithi043.stderr: 39750K .......... .......... .......... .......... .......... 42% 264M 0s 2024-09-12T00:43:53.525 INFO:teuthology.orchestra.run.smithi043.stderr: 39800K .......... .......... .......... .......... .......... 42% 271M 0s 2024-09-12T00:43:53.525 INFO:teuthology.orchestra.run.smithi043.stderr: 39850K .......... .......... .......... .......... .......... 42% 250M 0s 2024-09-12T00:43:53.525 INFO:teuthology.orchestra.run.smithi043.stderr: 39900K .......... .......... .......... .......... .......... 43% 224M 0s 2024-09-12T00:43:53.525 INFO:teuthology.orchestra.run.smithi043.stderr: 39950K .......... .......... .......... .......... .......... 43% 217M 0s 2024-09-12T00:43:53.525 INFO:teuthology.orchestra.run.smithi043.stderr: 40000K .......... .......... .......... .......... .......... 43% 262M 0s 2024-09-12T00:43:53.525 INFO:teuthology.orchestra.run.smithi043.stderr: 40050K .......... .......... .......... .......... .......... 43% 204M 0s 2024-09-12T00:43:53.525 INFO:teuthology.orchestra.run.smithi043.stderr: 40100K .......... .......... .......... .......... .......... 43% 251M 0s 2024-09-12T00:43:53.525 INFO:teuthology.orchestra.run.smithi043.stderr: 40150K .......... .......... .......... .......... .......... 43% 266M 0s 2024-09-12T00:43:53.525 INFO:teuthology.orchestra.run.smithi043.stderr: 40200K .......... .......... .......... .......... .......... 43% 200M 0s 2024-09-12T00:43:53.525 INFO:teuthology.orchestra.run.smithi043.stderr: 40250K .......... .......... .......... .......... .......... 43% 237M 0s 2024-09-12T00:43:53.525 INFO:teuthology.orchestra.run.smithi043.stderr: 40300K .......... .......... .......... .......... .......... 43% 269M 0s 2024-09-12T00:43:53.525 INFO:teuthology.orchestra.run.smithi043.stderr: 40350K .......... .......... .......... .......... .......... 43% 243M 0s 2024-09-12T00:43:53.525 INFO:teuthology.orchestra.run.smithi043.stderr: 40400K .......... .......... .......... .......... .......... 43% 292M 0s 2024-09-12T00:43:53.526 INFO:teuthology.orchestra.run.smithi043.stderr: 40450K .......... .......... .......... .......... .......... 43% 262M 0s 2024-09-12T00:43:53.526 INFO:teuthology.orchestra.run.smithi043.stderr: 40500K .......... .......... .......... .......... .......... 43% 277M 0s 2024-09-12T00:43:53.526 INFO:teuthology.orchestra.run.smithi043.stderr: 40550K .......... .......... .......... .......... .......... 43% 222M 0s 2024-09-12T00:43:53.526 INFO:teuthology.orchestra.run.smithi043.stderr: 40600K .......... .......... .......... .......... .......... 43% 249M 0s 2024-09-12T00:43:53.526 INFO:teuthology.orchestra.run.smithi043.stderr: 40650K .......... .......... .......... .......... .......... 43% 218M 0s 2024-09-12T00:43:53.526 INFO:teuthology.orchestra.run.smithi043.stderr: 40700K .......... .......... .......... .......... .......... 43% 239M 0s 2024-09-12T00:43:53.526 INFO:teuthology.orchestra.run.smithi043.stderr: 40750K .......... .......... .......... .......... .......... 43% 213M 0s 2024-09-12T00:43:53.526 INFO:teuthology.orchestra.run.smithi043.stderr: 40800K .......... .......... .......... .......... .......... 43% 249M 0s 2024-09-12T00:43:53.526 INFO:teuthology.orchestra.run.smithi043.stderr: 40850K .......... .......... .......... .......... .......... 44% 216M 0s 2024-09-12T00:43:53.526 INFO:teuthology.orchestra.run.smithi043.stderr: 40900K .......... .......... .......... .......... .......... 44% 214M 0s 2024-09-12T00:43:53.526 INFO:teuthology.orchestra.run.smithi043.stderr: 40950K .......... .......... .......... .......... .......... 44% 226M 0s 2024-09-12T00:43:53.526 INFO:teuthology.orchestra.run.smithi043.stderr: 41000K .......... .......... .......... .......... .......... 44% 232M 0s 2024-09-12T00:43:53.526 INFO:teuthology.orchestra.run.smithi043.stderr: 41050K .......... .......... .......... .......... .......... 44% 219M 0s 2024-09-12T00:43:53.527 INFO:teuthology.orchestra.run.smithi043.stderr: 41100K .......... .......... .......... .......... .......... 44% 225M 0s 2024-09-12T00:43:53.527 INFO:teuthology.orchestra.run.smithi043.stderr: 41150K .......... .......... .......... .......... .......... 44% 245M 0s 2024-09-12T00:43:53.527 INFO:teuthology.orchestra.run.smithi043.stderr: 41200K .......... .......... .......... .......... .......... 44% 286M 0s 2024-09-12T00:43:53.527 INFO:teuthology.orchestra.run.smithi043.stderr: 41250K .......... .......... .......... .......... .......... 44% 290M 0s 2024-09-12T00:43:53.527 INFO:teuthology.orchestra.run.smithi043.stderr: 41300K .......... .......... .......... .......... .......... 44% 224M 0s 2024-09-12T00:43:53.527 INFO:teuthology.orchestra.run.smithi043.stderr: 41350K .......... .......... .......... .......... .......... 44% 266M 0s 2024-09-12T00:43:53.527 INFO:teuthology.orchestra.run.smithi043.stderr: 41400K .......... .......... .......... .......... .......... 44% 265M 0s 2024-09-12T00:43:53.527 INFO:teuthology.orchestra.run.smithi043.stderr: 41450K .......... .......... .......... .......... .......... 44% 267M 0s 2024-09-12T00:43:53.527 INFO:teuthology.orchestra.run.smithi043.stderr: 41500K .......... .......... .......... .......... .......... 44% 210M 0s 2024-09-12T00:43:53.527 INFO:teuthology.orchestra.run.smithi043.stderr: 41550K .......... .......... .......... .......... .......... 44% 254M 0s 2024-09-12T00:43:53.527 INFO:teuthology.orchestra.run.smithi043.stderr: 41600K .......... .......... .......... .......... .......... 44% 280M 0s 2024-09-12T00:43:53.527 INFO:teuthology.orchestra.run.smithi043.stderr: 41650K .......... .......... .......... .......... .......... 44% 295M 0s 2024-09-12T00:43:53.527 INFO:teuthology.orchestra.run.smithi043.stderr: 41700K .......... .......... .......... .......... .......... 44% 240M 0s 2024-09-12T00:43:53.527 INFO:teuthology.orchestra.run.smithi043.stderr: 41750K .......... .......... .......... .......... .......... 44% 295M 0s 2024-09-12T00:43:53.528 INFO:teuthology.orchestra.run.smithi043.stderr: 41800K .......... .......... .......... .......... .......... 45% 284M 0s 2024-09-12T00:43:53.528 INFO:teuthology.orchestra.run.smithi043.stderr: 41850K .......... .......... .......... .......... .......... 45% 309M 0s 2024-09-12T00:43:53.528 INFO:teuthology.orchestra.run.smithi043.stderr: 41900K .......... .......... .......... .......... .......... 45% 229M 0s 2024-09-12T00:43:53.528 INFO:teuthology.orchestra.run.smithi043.stderr: 41950K .......... .......... .......... .......... .......... 45% 168M 0s 2024-09-12T00:43:53.528 INFO:teuthology.orchestra.run.smithi043.stderr: 42000K .......... .......... .......... .......... .......... 45% 214M 0s 2024-09-12T00:43:53.528 INFO:teuthology.orchestra.run.smithi043.stderr: 42050K .......... .......... .......... .......... .......... 45% 296M 0s 2024-09-12T00:43:53.528 INFO:teuthology.orchestra.run.smithi043.stderr: 42100K .......... .......... .......... .......... .......... 45% 265M 0s 2024-09-12T00:43:53.528 INFO:teuthology.orchestra.run.smithi043.stderr: 42150K .......... .......... .......... .......... .......... 45% 323M 0s 2024-09-12T00:43:53.528 INFO:teuthology.orchestra.run.smithi043.stderr: 42200K .......... .......... .......... .......... .......... 45% 275M 0s 2024-09-12T00:43:53.528 INFO:teuthology.orchestra.run.smithi043.stderr: 42250K .......... .......... .......... .......... .......... 45% 300M 0s 2024-09-12T00:43:53.528 INFO:teuthology.orchestra.run.smithi043.stderr: 42300K .......... .......... .......... .......... .......... 45% 261M 0s 2024-09-12T00:43:53.528 INFO:teuthology.orchestra.run.smithi043.stderr: 42350K .......... .......... .......... .......... .......... 45% 309M 0s 2024-09-12T00:43:53.528 INFO:teuthology.orchestra.run.smithi043.stderr: 42400K .......... .......... .......... .......... .......... 45% 300M 0s 2024-09-12T00:43:53.529 INFO:teuthology.orchestra.run.smithi043.stderr: 42450K .......... .......... .......... .......... .......... 45% 313M 0s 2024-09-12T00:43:53.529 INFO:teuthology.orchestra.run.smithi043.stderr: 42500K .......... .......... .......... .......... .......... 45% 258M 0s 2024-09-12T00:43:53.529 INFO:teuthology.orchestra.run.smithi043.stderr: 42550K .......... .......... .......... .......... .......... 45% 275M 0s 2024-09-12T00:43:53.529 INFO:teuthology.orchestra.run.smithi043.stderr: 42600K .......... .......... .......... .......... .......... 45% 315M 0s 2024-09-12T00:43:53.529 INFO:teuthology.orchestra.run.smithi043.stderr: 42650K .......... .......... .......... .......... .......... 45% 319M 0s 2024-09-12T00:43:53.529 INFO:teuthology.orchestra.run.smithi043.stderr: 42700K .......... .......... .......... .......... .......... 46% 242M 0s 2024-09-12T00:43:53.529 INFO:teuthology.orchestra.run.smithi043.stderr: 42750K .......... .......... .......... .......... .......... 46% 293M 0s 2024-09-12T00:43:53.529 INFO:teuthology.orchestra.run.smithi043.stderr: 42800K .......... .......... .......... .......... .......... 46% 176M 0s 2024-09-12T00:43:53.529 INFO:teuthology.orchestra.run.smithi043.stderr: 42850K .......... .......... .......... .......... .......... 46% 265M 0s 2024-09-12T00:43:53.529 INFO:teuthology.orchestra.run.smithi043.stderr: 42900K .......... .......... .......... .......... .......... 46% 269M 0s 2024-09-12T00:43:53.529 INFO:teuthology.orchestra.run.smithi043.stderr: 42950K .......... .......... .......... .......... .......... 46% 272M 0s 2024-09-12T00:43:53.529 INFO:teuthology.orchestra.run.smithi043.stderr: 43000K .......... .......... .......... .......... .......... 46% 242M 0s 2024-09-12T00:43:53.529 INFO:teuthology.orchestra.run.smithi043.stderr: 43050K .......... .......... .......... .......... .......... 46% 311M 0s 2024-09-12T00:43:53.530 INFO:teuthology.orchestra.run.smithi043.stderr: 43100K .......... .......... .......... .......... .......... 46% 254M 0s 2024-09-12T00:43:53.530 INFO:teuthology.orchestra.run.smithi043.stderr: 43150K .......... .......... .......... .......... .......... 46% 316M 0s 2024-09-12T00:43:53.530 INFO:teuthology.orchestra.run.smithi043.stderr: 43200K .......... .......... .......... .......... .......... 46% 214M 0s 2024-09-12T00:43:53.530 INFO:teuthology.orchestra.run.smithi043.stderr: 43250K .......... .......... .......... .......... .......... 46% 293M 0s 2024-09-12T00:43:53.530 INFO:teuthology.orchestra.run.smithi043.stderr: 43300K .......... .......... .......... .......... .......... 46% 227M 0s 2024-09-12T00:43:53.530 INFO:teuthology.orchestra.run.smithi043.stderr: 43350K .......... .......... .......... .......... .......... 46% 316M 0s 2024-09-12T00:43:53.530 INFO:teuthology.orchestra.run.smithi043.stderr: 43400K .......... .......... .......... .......... .......... 46% 91.5M 0s 2024-09-12T00:43:53.530 INFO:teuthology.orchestra.run.smithi043.stderr: 43450K .......... .......... .......... .......... .......... 46% 277M 0s 2024-09-12T00:43:53.530 INFO:teuthology.orchestra.run.smithi043.stderr: 43500K .......... .......... .......... .......... .......... 46% 230M 0s 2024-09-12T00:43:53.530 INFO:teuthology.orchestra.run.smithi043.stderr: 43550K .......... .......... .......... .......... .......... 46% 287M 0s 2024-09-12T00:43:53.530 INFO:teuthology.orchestra.run.smithi043.stderr: 43600K .......... .......... .......... .......... .......... 46% 266M 0s 2024-09-12T00:43:53.530 INFO:teuthology.orchestra.run.smithi043.stderr: 43650K .......... .......... .......... .......... .......... 47% 303M 0s 2024-09-12T00:43:53.530 INFO:teuthology.orchestra.run.smithi043.stderr: 43700K .......... .......... .......... .......... .......... 47% 247M 0s 2024-09-12T00:43:53.531 INFO:teuthology.orchestra.run.smithi043.stderr: 43750K .......... .......... .......... .......... .......... 47% 273M 0s 2024-09-12T00:43:53.531 INFO:teuthology.orchestra.run.smithi043.stderr: 43800K .......... .......... .......... .......... .......... 47% 278M 0s 2024-09-12T00:43:53.531 INFO:teuthology.orchestra.run.smithi043.stderr: 43850K .......... .......... .......... .......... .......... 47% 250M 0s 2024-09-12T00:43:53.531 INFO:teuthology.orchestra.run.smithi043.stderr: 43900K .......... .......... .......... .......... .......... 47% 218M 0s 2024-09-12T00:43:53.531 INFO:teuthology.orchestra.run.smithi043.stderr: 43950K .......... .......... .......... .......... .......... 47% 268M 0s 2024-09-12T00:43:53.531 INFO:teuthology.orchestra.run.smithi043.stderr: 44000K .......... .......... .......... .......... .......... 47% 281M 0s 2024-09-12T00:43:53.531 INFO:teuthology.orchestra.run.smithi043.stderr: 44050K .......... .......... .......... .......... .......... 47% 217M 0s 2024-09-12T00:43:53.531 INFO:teuthology.orchestra.run.smithi043.stderr: 44100K .......... .......... .......... .......... .......... 47% 246M 0s 2024-09-12T00:43:53.531 INFO:teuthology.orchestra.run.smithi043.stderr: 44150K .......... .......... .......... .......... .......... 47% 290M 0s 2024-09-12T00:43:53.531 INFO:teuthology.orchestra.run.smithi043.stderr: 44200K .......... .......... .......... .......... .......... 47% 297M 0s 2024-09-12T00:43:53.531 INFO:teuthology.orchestra.run.smithi043.stderr: 44250K .......... .......... .......... .......... .......... 47% 281M 0s 2024-09-12T00:43:53.531 INFO:teuthology.orchestra.run.smithi043.stderr: 44300K .......... .......... .......... .......... .......... 47% 173M 0s 2024-09-12T00:43:53.531 INFO:teuthology.orchestra.run.smithi043.stderr: 44350K .......... .......... .......... .......... .......... 47% 290M 0s 2024-09-12T00:43:53.532 INFO:teuthology.orchestra.run.smithi043.stderr: 44400K .......... .......... .......... .......... .......... 47% 278M 0s 2024-09-12T00:43:53.532 INFO:teuthology.orchestra.run.smithi043.stderr: 44450K .......... .......... .......... .......... .......... 47% 299M 0s 2024-09-12T00:43:53.532 INFO:teuthology.orchestra.run.smithi043.stderr: 44500K .......... .......... .......... .......... .......... 47% 262M 0s 2024-09-12T00:43:53.532 INFO:teuthology.orchestra.run.smithi043.stderr: 44550K .......... .......... .......... .......... .......... 48% 287M 0s 2024-09-12T00:43:53.532 INFO:teuthology.orchestra.run.smithi043.stderr: 44600K .......... .......... .......... .......... .......... 48% 293M 0s 2024-09-12T00:43:53.532 INFO:teuthology.orchestra.run.smithi043.stderr: 44650K .......... .......... .......... .......... .......... 48% 301M 0s 2024-09-12T00:43:53.532 INFO:teuthology.orchestra.run.smithi043.stderr: 44700K .......... .......... .......... .......... .......... 48% 37.3M 0s 2024-09-12T00:43:53.532 INFO:teuthology.orchestra.run.smithi043.stderr: 44750K .......... .......... .......... .......... .......... 48% 259M 0s 2024-09-12T00:43:53.532 INFO:teuthology.orchestra.run.smithi043.stderr: 44800K .......... .......... .......... .......... .......... 48% 291M 0s 2024-09-12T00:43:53.532 INFO:teuthology.orchestra.run.smithi043.stderr: 44850K .......... .......... .......... .......... .......... 48% 272M 0s 2024-09-12T00:43:53.532 INFO:teuthology.orchestra.run.smithi043.stderr: 44900K .......... .......... .......... .......... .......... 48% 234M 0s 2024-09-12T00:43:53.532 INFO:teuthology.orchestra.run.smithi043.stderr: 44950K .......... .......... .......... .......... .......... 48% 239M 0s 2024-09-12T00:43:53.533 INFO:teuthology.orchestra.run.smithi043.stderr: 45000K .......... .......... .......... .......... .......... 48% 236M 0s 2024-09-12T00:43:53.533 INFO:teuthology.orchestra.run.smithi043.stderr: 45050K .......... .......... .......... .......... .......... 48% 230M 0s 2024-09-12T00:43:53.533 INFO:teuthology.orchestra.run.smithi043.stderr: 45100K .......... .......... .......... .......... .......... 48% 212M 0s 2024-09-12T00:43:53.533 INFO:teuthology.orchestra.run.smithi043.stderr: 45150K .......... .......... .......... .......... .......... 48% 226M 0s 2024-09-12T00:43:53.533 INFO:teuthology.orchestra.run.smithi043.stderr: 45200K .......... .......... .......... .......... .......... 48% 284M 0s 2024-09-12T00:43:53.533 INFO:teuthology.orchestra.run.smithi043.stderr: 45250K .......... .......... .......... .......... .......... 48% 297M 0s 2024-09-12T00:43:53.533 INFO:teuthology.orchestra.run.smithi043.stderr: 45300K .......... .......... .......... .......... .......... 48% 255M 0s 2024-09-12T00:43:53.533 INFO:teuthology.orchestra.run.smithi043.stderr: 45350K .......... .......... .......... .......... .......... 48% 263M 0s 2024-09-12T00:43:53.533 INFO:teuthology.orchestra.run.smithi043.stderr: 45400K .......... .......... .......... .......... .......... 48% 296M 0s 2024-09-12T00:43:53.533 INFO:teuthology.orchestra.run.smithi043.stderr: 45450K .......... .......... .......... .......... .......... 48% 324M 0s 2024-09-12T00:43:53.533 INFO:teuthology.orchestra.run.smithi043.stderr: 45500K .......... .......... .......... .......... .......... 49% 256M 0s 2024-09-12T00:43:53.533 INFO:teuthology.orchestra.run.smithi043.stderr: 45550K .......... .......... .......... .......... .......... 49% 277M 0s 2024-09-12T00:43:53.533 INFO:teuthology.orchestra.run.smithi043.stderr: 45600K .......... .......... .......... .......... .......... 49% 261M 0s 2024-09-12T00:43:53.534 INFO:teuthology.orchestra.run.smithi043.stderr: 45650K .......... .......... .......... .......... .......... 49% 283M 0s 2024-09-12T00:43:53.534 INFO:teuthology.orchestra.run.smithi043.stderr: 45700K .......... .......... .......... .......... .......... 49% 286M 0s 2024-09-12T00:43:53.534 INFO:teuthology.orchestra.run.smithi043.stderr: 45750K .......... .......... .......... .......... .......... 49% 285M 0s 2024-09-12T00:43:53.534 INFO:teuthology.orchestra.run.smithi043.stderr: 45800K .......... .......... .......... .......... .......... 49% 237M 0s 2024-09-12T00:43:53.534 INFO:teuthology.orchestra.run.smithi043.stderr: 45850K .......... .......... .......... .......... .......... 49% 298M 0s 2024-09-12T00:43:53.534 INFO:teuthology.orchestra.run.smithi043.stderr: 45900K .......... .......... .......... .......... .......... 49% 300M 0s 2024-09-12T00:43:53.534 INFO:teuthology.orchestra.run.smithi043.stderr: 45950K .......... .......... .......... .......... .......... 49% 285M 0s 2024-09-12T00:43:53.534 INFO:teuthology.orchestra.run.smithi043.stderr: 46000K .......... .......... .......... .......... .......... 49% 225M 0s 2024-09-12T00:43:53.534 INFO:teuthology.orchestra.run.smithi043.stderr: 46050K .......... .......... .......... .......... .......... 49% 285M 0s 2024-09-12T00:43:53.534 INFO:teuthology.orchestra.run.smithi043.stderr: 46100K .......... .......... .......... .......... .......... 49% 285M 0s 2024-09-12T00:43:53.534 INFO:teuthology.orchestra.run.smithi043.stderr: 46150K .......... .......... .......... .......... .......... 49% 315M 0s 2024-09-12T00:43:53.534 INFO:teuthology.orchestra.run.smithi043.stderr: 46200K .......... .......... .......... .......... .......... 49% 251M 0s 2024-09-12T00:43:53.534 INFO:teuthology.orchestra.run.smithi043.stderr: 46250K .......... .......... .......... .......... .......... 49% 267M 0s 2024-09-12T00:43:53.535 INFO:teuthology.orchestra.run.smithi043.stderr: 46300K .......... .......... .......... .......... .......... 49% 223M 0s 2024-09-12T00:43:53.535 INFO:teuthology.orchestra.run.smithi043.stderr: 46350K .......... .......... .......... .......... .......... 49% 271M 0s 2024-09-12T00:43:53.535 INFO:teuthology.orchestra.run.smithi043.stderr: 46400K .......... .......... .......... .......... .......... 49% 271M 0s 2024-09-12T00:43:53.535 INFO:teuthology.orchestra.run.smithi043.stderr: 46450K .......... .......... .......... .......... .......... 50% 252M 0s 2024-09-12T00:43:53.535 INFO:teuthology.orchestra.run.smithi043.stderr: 46500K .......... .......... .......... .......... .......... 50% 254M 0s 2024-09-12T00:43:53.535 INFO:teuthology.orchestra.run.smithi043.stderr: 46550K .......... .......... .......... .......... .......... 50% 283M 0s 2024-09-12T00:43:53.535 INFO:teuthology.orchestra.run.smithi043.stderr: 46600K .......... .......... .......... .......... .......... 50% 268M 0s 2024-09-12T00:43:53.535 INFO:teuthology.orchestra.run.smithi043.stderr: 46650K .......... .......... .......... .......... .......... 50% 299M 0s 2024-09-12T00:43:53.535 INFO:teuthology.orchestra.run.smithi043.stderr: 46700K .......... .......... .......... .......... .......... 50% 265M 0s 2024-09-12T00:43:53.535 INFO:teuthology.orchestra.run.smithi043.stderr: 46750K .......... .......... .......... .......... .......... 50% 299M 0s 2024-09-12T00:43:53.535 INFO:teuthology.orchestra.run.smithi043.stderr: 46800K .......... .......... .......... .......... .......... 50% 290M 0s 2024-09-12T00:43:53.535 INFO:teuthology.orchestra.run.smithi043.stderr: 46850K .......... .......... .......... .......... .......... 50% 269M 0s 2024-09-12T00:43:53.535 INFO:teuthology.orchestra.run.smithi043.stderr: 46900K .......... .......... .......... .......... .......... 50% 196M 0s 2024-09-12T00:43:53.536 INFO:teuthology.orchestra.run.smithi043.stderr: 46950K .......... .......... .......... .......... .......... 50% 198M 0s 2024-09-12T00:43:53.536 INFO:teuthology.orchestra.run.smithi043.stderr: 47000K .......... .......... .......... .......... .......... 50% 253M 0s 2024-09-12T00:43:53.536 INFO:teuthology.orchestra.run.smithi043.stderr: 47050K .......... .......... .......... .......... .......... 50% 209M 0s 2024-09-12T00:43:53.536 INFO:teuthology.orchestra.run.smithi043.stderr: 47100K .......... .......... .......... .......... .......... 50% 184M 0s 2024-09-12T00:43:53.536 INFO:teuthology.orchestra.run.smithi043.stderr: 47150K .......... .......... .......... .......... .......... 50% 294M 0s 2024-09-12T00:43:53.536 INFO:teuthology.orchestra.run.smithi043.stderr: 47200K .......... .......... .......... .......... .......... 50% 324M 0s 2024-09-12T00:43:53.536 INFO:teuthology.orchestra.run.smithi043.stderr: 47250K .......... .......... .......... .......... .......... 50% 295M 0s 2024-09-12T00:43:53.536 INFO:teuthology.orchestra.run.smithi043.stderr: 47300K .......... .......... .......... .......... .......... 50% 280M 0s 2024-09-12T00:43:53.536 INFO:teuthology.orchestra.run.smithi043.stderr: 47350K .......... .......... .......... .......... .......... 51% 311M 0s 2024-09-12T00:43:53.536 INFO:teuthology.orchestra.run.smithi043.stderr: 47400K .......... .......... .......... .......... .......... 51% 313M 0s 2024-09-12T00:43:53.536 INFO:teuthology.orchestra.run.smithi043.stderr: 47450K .......... .......... .......... .......... .......... 51% 294M 0s 2024-09-12T00:43:53.536 INFO:teuthology.orchestra.run.smithi043.stderr: 47500K .......... .......... .......... .......... .......... 51% 259M 0s 2024-09-12T00:43:53.536 INFO:teuthology.orchestra.run.smithi043.stderr: 47550K .......... .......... .......... .......... .......... 51% 303M 0s 2024-09-12T00:43:53.537 INFO:teuthology.orchestra.run.smithi043.stderr: 47600K .......... .......... .......... .......... .......... 51% 291M 0s 2024-09-12T00:43:53.537 INFO:teuthology.orchestra.run.smithi043.stderr: 47650K .......... .......... .......... .......... .......... 51% 112M 0s 2024-09-12T00:43:53.537 INFO:teuthology.orchestra.run.smithi043.stderr: 47700K .......... .......... .......... .......... .......... 51% 83.6M 0s 2024-09-12T00:43:53.537 INFO:teuthology.orchestra.run.smithi043.stderr: 47750K .......... .......... .......... .......... .......... 51% 230M 0s 2024-09-12T00:43:53.537 INFO:teuthology.orchestra.run.smithi043.stderr: 47800K .......... .......... .......... .......... .......... 51% 255M 0s 2024-09-12T00:43:53.537 INFO:teuthology.orchestra.run.smithi043.stderr: 47850K .......... .......... .......... .......... .......... 51% 277M 0s 2024-09-12T00:43:53.537 INFO:teuthology.orchestra.run.smithi043.stderr: 47900K .......... .......... .......... .......... .......... 51% 255M 0s 2024-09-12T00:43:53.537 INFO:teuthology.orchestra.run.smithi043.stderr: 47950K .......... .......... .......... .......... .......... 51% 337M 0s 2024-09-12T00:43:53.537 INFO:teuthology.orchestra.run.smithi043.stderr: 48000K .......... .......... .......... .......... .......... 51% 337M 0s 2024-09-12T00:43:53.537 INFO:teuthology.orchestra.run.smithi043.stderr: 48050K .......... .......... .......... .......... .......... 51% 256M 0s 2024-09-12T00:43:53.537 INFO:teuthology.orchestra.run.smithi043.stderr: 48100K .......... .......... .......... .......... .......... 51% 277M 0s 2024-09-12T00:43:53.537 INFO:teuthology.orchestra.run.smithi043.stderr: 48150K .......... .......... .......... .......... .......... 51% 317M 0s 2024-09-12T00:43:53.537 INFO:teuthology.orchestra.run.smithi043.stderr: 48200K .......... .......... .......... .......... .......... 51% 292M 0s 2024-09-12T00:43:53.538 INFO:teuthology.orchestra.run.smithi043.stderr: 48250K .......... .......... .......... .......... .......... 51% 336M 0s 2024-09-12T00:43:53.538 INFO:teuthology.orchestra.run.smithi043.stderr: 48300K .......... .......... .......... .......... .......... 52% 76.2M 0s 2024-09-12T00:43:53.538 INFO:teuthology.orchestra.run.smithi043.stderr: 48350K .......... .......... .......... .......... .......... 52% 278M 0s 2024-09-12T00:43:53.538 INFO:teuthology.orchestra.run.smithi043.stderr: 48400K .......... .......... .......... .......... .......... 52% 292M 0s 2024-09-12T00:43:53.538 INFO:teuthology.orchestra.run.smithi043.stderr: 48450K .......... .......... .......... .......... .......... 52% 315M 0s 2024-09-12T00:43:53.538 INFO:teuthology.orchestra.run.smithi043.stderr: 48500K .......... .......... .......... .......... .......... 52% 281M 0s 2024-09-12T00:43:53.538 INFO:teuthology.orchestra.run.smithi043.stderr: 48550K .......... .......... .......... .......... .......... 52% 319M 0s 2024-09-12T00:43:53.538 INFO:teuthology.orchestra.run.smithi043.stderr: 48600K .......... .......... .......... .......... .......... 52% 294M 0s 2024-09-12T00:43:53.538 INFO:teuthology.orchestra.run.smithi043.stderr: 48650K .......... .......... .......... .......... .......... 52% 306M 0s 2024-09-12T00:43:53.538 INFO:teuthology.orchestra.run.smithi043.stderr: 48700K .......... .......... .......... .......... .......... 52% 228M 0s 2024-09-12T00:43:53.538 INFO:teuthology.orchestra.run.smithi043.stderr: 48750K .......... .......... .......... .......... .......... 52% 294M 0s 2024-09-12T00:43:53.538 INFO:teuthology.orchestra.run.smithi043.stderr: 48800K .......... .......... .......... .......... .......... 52% 277M 0s 2024-09-12T00:43:53.538 INFO:teuthology.orchestra.run.smithi043.stderr: 48850K .......... .......... .......... .......... .......... 52% 266M 0s 2024-09-12T00:43:53.539 INFO:teuthology.orchestra.run.smithi043.stderr: 48900K .......... .......... .......... .......... .......... 52% 235M 0s 2024-09-12T00:43:53.539 INFO:teuthology.orchestra.run.smithi043.stderr: 48950K .......... .......... .......... .......... .......... 52% 255M 0s 2024-09-12T00:43:53.539 INFO:teuthology.orchestra.run.smithi043.stderr: 49000K .......... .......... .......... .......... .......... 52% 280M 0s 2024-09-12T00:43:53.539 INFO:teuthology.orchestra.run.smithi043.stderr: 49050K .......... .......... .......... .......... .......... 52% 305M 0s 2024-09-12T00:43:53.539 INFO:teuthology.orchestra.run.smithi043.stderr: 49100K .......... .......... .......... .......... .......... 52% 154M 0s 2024-09-12T00:43:53.539 INFO:teuthology.orchestra.run.smithi043.stderr: 49150K .......... .......... .......... .......... .......... 52% 297M 0s 2024-09-12T00:43:53.539 INFO:teuthology.orchestra.run.smithi043.stderr: 49200K .......... .......... .......... .......... .......... 53% 298M 0s 2024-09-12T00:43:53.539 INFO:teuthology.orchestra.run.smithi043.stderr: 49250K .......... .......... .......... .......... .......... 53% 255M 0s 2024-09-12T00:43:53.539 INFO:teuthology.orchestra.run.smithi043.stderr: 49300K .......... .......... .......... .......... .......... 53% 287M 0s 2024-09-12T00:43:53.539 INFO:teuthology.orchestra.run.smithi043.stderr: 49350K .......... .......... .......... .......... .......... 53% 337M 0s 2024-09-12T00:43:53.539 INFO:teuthology.orchestra.run.smithi043.stderr: 49400K .......... .......... .......... .......... .......... 53% 316M 0s 2024-09-12T00:43:53.539 INFO:teuthology.orchestra.run.smithi043.stderr: 49450K .......... .......... .......... .......... .......... 53% 296M 0s 2024-09-12T00:43:53.539 INFO:teuthology.orchestra.run.smithi043.stderr: 49500K .......... .......... .......... .......... .......... 53% 258M 0s 2024-09-12T00:43:53.540 INFO:teuthology.orchestra.run.smithi043.stderr: 49550K .......... .......... .......... .......... .......... 53% 313M 0s 2024-09-12T00:43:53.540 INFO:teuthology.orchestra.run.smithi043.stderr: 49600K .......... .......... .......... .......... .......... 53% 335M 0s 2024-09-12T00:43:53.540 INFO:teuthology.orchestra.run.smithi043.stderr: 49650K .......... .......... .......... .......... .......... 53% 313M 0s 2024-09-12T00:43:53.540 INFO:teuthology.orchestra.run.smithi043.stderr: 49700K .......... .......... .......... .......... .......... 53% 215M 0s 2024-09-12T00:43:53.540 INFO:teuthology.orchestra.run.smithi043.stderr: 49750K .......... .......... .......... .......... .......... 53% 310M 0s 2024-09-12T00:43:53.540 INFO:teuthology.orchestra.run.smithi043.stderr: 49800K .......... .......... .......... .......... .......... 53% 323M 0s 2024-09-12T00:43:53.540 INFO:teuthology.orchestra.run.smithi043.stderr: 49850K .......... .......... .......... .......... .......... 53% 309M 0s 2024-09-12T00:43:53.540 INFO:teuthology.orchestra.run.smithi043.stderr: 49900K .......... .......... .......... .......... .......... 53% 268M 0s 2024-09-12T00:43:53.540 INFO:teuthology.orchestra.run.smithi043.stderr: 49950K .......... .......... .......... .......... .......... 53% 342M 0s 2024-09-12T00:43:53.540 INFO:teuthology.orchestra.run.smithi043.stderr: 50000K .......... .......... .......... .......... .......... 53% 198M 0s 2024-09-12T00:43:53.540 INFO:teuthology.orchestra.run.smithi043.stderr: 50050K .......... .......... .......... .......... .......... 53% 284M 0s 2024-09-12T00:43:53.540 INFO:teuthology.orchestra.run.smithi043.stderr: 50100K .......... .......... .......... .......... .......... 53% 262M 0s 2024-09-12T00:43:53.541 INFO:teuthology.orchestra.run.smithi043.stderr: 50150K .......... .......... .......... .......... .......... 54% 297M 0s 2024-09-12T00:43:53.541 INFO:teuthology.orchestra.run.smithi043.stderr: 50200K .......... .......... .......... .......... .......... 54% 220M 0s 2024-09-12T00:43:53.541 INFO:teuthology.orchestra.run.smithi043.stderr: 50250K .......... .......... .......... .......... .......... 54% 252M 0s 2024-09-12T00:43:53.541 INFO:teuthology.orchestra.run.smithi043.stderr: 50300K .......... .......... .......... .......... .......... 54% 210M 0s 2024-09-12T00:43:53.541 INFO:teuthology.orchestra.run.smithi043.stderr: 50350K .......... .......... .......... .......... .......... 54% 251M 0s 2024-09-12T00:43:53.541 INFO:teuthology.orchestra.run.smithi043.stderr: 50400K .......... .......... .......... .......... .......... 54% 306M 0s 2024-09-12T00:43:53.541 INFO:teuthology.orchestra.run.smithi043.stderr: 50450K .......... .......... .......... .......... .......... 54% 330M 0s 2024-09-12T00:43:53.541 INFO:teuthology.orchestra.run.smithi043.stderr: 50500K .......... .......... .......... .......... .......... 54% 71.7M 0s 2024-09-12T00:43:53.541 INFO:teuthology.orchestra.run.smithi043.stderr: 50550K .......... .......... .......... .......... .......... 54% 298M 0s 2024-09-12T00:43:53.541 INFO:teuthology.orchestra.run.smithi043.stderr: 50600K .......... .......... .......... .......... .......... 54% 303M 0s 2024-09-12T00:43:53.541 INFO:teuthology.orchestra.run.smithi043.stderr: 50650K .......... .......... .......... .......... .......... 54% 328M 0s 2024-09-12T00:43:53.541 INFO:teuthology.orchestra.run.smithi043.stderr: 50700K .......... .......... .......... .......... .......... 54% 207M 0s 2024-09-12T00:43:53.541 INFO:teuthology.orchestra.run.smithi043.stderr: 50750K .......... .......... .......... .......... .......... 54% 170M 0s 2024-09-12T00:43:53.542 INFO:teuthology.orchestra.run.smithi043.stderr: 50800K .......... .......... .......... .......... .......... 54% 272M 0s 2024-09-12T00:43:53.542 INFO:teuthology.orchestra.run.smithi043.stderr: 50850K .......... .......... .......... .......... .......... 54% 245M 0s 2024-09-12T00:43:53.542 INFO:teuthology.orchestra.run.smithi043.stderr: 50900K .......... .......... .......... .......... .......... 54% 15.0M 0s 2024-09-12T00:43:53.542 INFO:teuthology.orchestra.run.smithi043.stderr: 50950K .......... .......... .......... .......... .......... 54% 52.8M 0s 2024-09-12T00:43:53.542 INFO:teuthology.orchestra.run.smithi043.stderr: 51000K .......... .......... .......... .......... .......... 54% 212M 0s 2024-09-12T00:43:53.542 INFO:teuthology.orchestra.run.smithi043.stderr: 51050K .......... .......... .......... .......... .......... 55% 207M 0s 2024-09-12T00:43:53.542 INFO:teuthology.orchestra.run.smithi043.stderr: 51100K .......... .......... .......... .......... .......... 55% 184M 0s 2024-09-12T00:43:53.542 INFO:teuthology.orchestra.run.smithi043.stderr: 51150K .......... .......... .......... .......... .......... 55% 228M 0s 2024-09-12T00:43:53.542 INFO:teuthology.orchestra.run.smithi043.stderr: 51200K .......... .......... .......... .......... .......... 55% 244M 0s 2024-09-12T00:43:53.542 INFO:teuthology.orchestra.run.smithi043.stderr: 51250K .......... .......... .......... .......... .......... 55% 296M 0s 2024-09-12T00:43:53.542 INFO:teuthology.orchestra.run.smithi043.stderr: 51300K .......... .......... .......... .......... .......... 55% 215M 0s 2024-09-12T00:43:53.542 INFO:teuthology.orchestra.run.smithi043.stderr: 51350K .......... .......... .......... .......... .......... 55% 211M 0s 2024-09-12T00:43:53.542 INFO:teuthology.orchestra.run.smithi043.stderr: 51400K .......... .......... .......... .......... .......... 55% 243M 0s 2024-09-12T00:43:53.543 INFO:teuthology.orchestra.run.smithi043.stderr: 51450K .......... .......... .......... .......... .......... 55% 313M 0s 2024-09-12T00:43:53.543 INFO:teuthology.orchestra.run.smithi043.stderr: 51500K .......... .......... .......... .......... .......... 55% 275M 0s 2024-09-12T00:43:53.543 INFO:teuthology.orchestra.run.smithi043.stderr: 51550K .......... .......... .......... .......... .......... 55% 306M 0s 2024-09-12T00:43:53.543 INFO:teuthology.orchestra.run.smithi043.stderr: 51600K .......... .......... .......... .......... .......... 55% 319M 0s 2024-09-12T00:43:53.543 INFO:teuthology.orchestra.run.smithi043.stderr: 51650K .......... .......... .......... .......... .......... 55% 330M 0s 2024-09-12T00:43:53.543 INFO:teuthology.orchestra.run.smithi043.stderr: 51700K .......... .......... .......... .......... .......... 55% 252M 0s 2024-09-12T00:43:53.543 INFO:teuthology.orchestra.run.smithi043.stderr: 51750K .......... .......... .......... .......... .......... 55% 302M 0s 2024-09-12T00:43:53.543 INFO:teuthology.orchestra.run.smithi043.stderr: 51800K .......... .......... .......... .......... .......... 55% 304M 0s 2024-09-12T00:43:53.543 INFO:teuthology.orchestra.run.smithi043.stderr: 51850K .......... .......... .......... .......... .......... 55% 293M 0s 2024-09-12T00:43:53.543 INFO:teuthology.orchestra.run.smithi043.stderr: 51900K .......... .......... .......... .......... .......... 55% 254M 0s 2024-09-12T00:43:53.543 INFO:teuthology.orchestra.run.smithi043.stderr: 51950K .......... .......... .......... .......... .......... 55% 313M 0s 2024-09-12T00:43:53.543 INFO:teuthology.orchestra.run.smithi043.stderr: 52000K .......... .......... .......... .......... .......... 56% 271M 0s 2024-09-12T00:43:53.543 INFO:teuthology.orchestra.run.smithi043.stderr: 52050K .......... .......... .......... .......... .......... 56% 311M 0s 2024-09-12T00:43:53.543 INFO:teuthology.orchestra.run.smithi043.stderr: 52100K .......... .......... .......... .......... .......... 56% 252M 0s 2024-09-12T00:43:53.544 INFO:teuthology.orchestra.run.smithi043.stderr: 52150K .......... .......... .......... .......... .......... 56% 295M 0s 2024-09-12T00:43:53.544 INFO:teuthology.orchestra.run.smithi043.stderr: 52200K .......... .......... .......... .......... .......... 56% 289M 0s 2024-09-12T00:43:53.544 INFO:teuthology.orchestra.run.smithi043.stderr: 52250K .......... .......... .......... .......... .......... 56% 286M 0s 2024-09-12T00:43:53.544 INFO:teuthology.orchestra.run.smithi043.stderr: 52300K .......... .......... .......... .......... .......... 56% 230M 0s 2024-09-12T00:43:53.544 INFO:teuthology.orchestra.run.smithi043.stderr: 52350K .......... .......... .......... .......... .......... 56% 272M 0s 2024-09-12T00:43:53.544 INFO:teuthology.orchestra.run.smithi043.stderr: 52400K .......... .......... .......... .......... .......... 56% 317M 0s 2024-09-12T00:43:53.544 INFO:teuthology.orchestra.run.smithi043.stderr: 52450K .......... .......... .......... .......... .......... 56% 287M 0s 2024-09-12T00:43:53.544 INFO:teuthology.orchestra.run.smithi043.stderr: 52500K .......... .......... .......... .......... .......... 56% 254M 0s 2024-09-12T00:43:53.544 INFO:teuthology.orchestra.run.smithi043.stderr: 52550K .......... .......... .......... .......... .......... 56% 305M 0s 2024-09-12T00:43:53.544 INFO:teuthology.orchestra.run.smithi043.stderr: 52600K .......... .......... .......... .......... .......... 56% 275M 0s 2024-09-12T00:43:53.544 INFO:teuthology.orchestra.run.smithi043.stderr: 52650K .......... .......... .......... .......... .......... 56% 246M 0s 2024-09-12T00:43:53.544 INFO:teuthology.orchestra.run.smithi043.stderr: 52700K .......... .......... .......... .......... .......... 56% 199M 0s 2024-09-12T00:43:53.545 INFO:teuthology.orchestra.run.smithi043.stderr: 52750K .......... .......... .......... .......... .......... 56% 244M 0s 2024-09-12T00:43:53.545 INFO:teuthology.orchestra.run.smithi043.stderr: 52800K .......... .......... .......... .......... .......... 56% 214M 0s 2024-09-12T00:43:53.545 INFO:teuthology.orchestra.run.smithi043.stderr: 52850K .......... .......... .......... .......... .......... 56% 214M 0s 2024-09-12T00:43:53.545 INFO:teuthology.orchestra.run.smithi043.stderr: 52900K .......... .......... .......... .......... .......... 56% 222M 0s 2024-09-12T00:43:53.545 INFO:teuthology.orchestra.run.smithi043.stderr: 52950K .......... .......... .......... .......... .......... 57% 213M 0s 2024-09-12T00:43:53.545 INFO:teuthology.orchestra.run.smithi043.stderr: 53000K .......... .......... .......... .......... .......... 57% 255M 0s 2024-09-12T00:43:53.545 INFO:teuthology.orchestra.run.smithi043.stderr: 53050K .......... .......... .......... .......... .......... 57% 283M 0s 2024-09-12T00:43:53.545 INFO:teuthology.orchestra.run.smithi043.stderr: 53100K .......... .......... .......... .......... .......... 57% 275M 0s 2024-09-12T00:43:53.545 INFO:teuthology.orchestra.run.smithi043.stderr: 53150K .......... .......... .......... .......... .......... 57% 316M 0s 2024-09-12T00:43:53.545 INFO:teuthology.orchestra.run.smithi043.stderr: 53200K .......... .......... .......... .......... .......... 57% 313M 0s 2024-09-12T00:43:53.545 INFO:teuthology.orchestra.run.smithi043.stderr: 53250K .......... .......... .......... .......... .......... 57% 334M 0s 2024-09-12T00:43:53.545 INFO:teuthology.orchestra.run.smithi043.stderr: 53300K .......... .......... .......... .......... .......... 57% 285M 0s 2024-09-12T00:43:53.545 INFO:teuthology.orchestra.run.smithi043.stderr: 53350K .......... .......... .......... .......... .......... 57% 239M 0s 2024-09-12T00:43:53.546 INFO:teuthology.orchestra.run.smithi043.stderr: 53400K .......... .......... .......... .......... .......... 57% 320M 0s 2024-09-12T00:43:53.546 INFO:teuthology.orchestra.run.smithi043.stderr: 53450K .......... .......... .......... .......... .......... 57% 319M 0s 2024-09-12T00:43:53.546 INFO:teuthology.orchestra.run.smithi043.stderr: 53500K .......... .......... .......... .......... .......... 57% 267M 0s 2024-09-12T00:43:53.546 INFO:teuthology.orchestra.run.smithi043.stderr: 53550K .......... .......... .......... .......... .......... 57% 330M 0s 2024-09-12T00:43:53.546 INFO:teuthology.orchestra.run.smithi043.stderr: 53600K .......... .......... .......... .......... .......... 57% 331M 0s 2024-09-12T00:43:53.546 INFO:teuthology.orchestra.run.smithi043.stderr: 53650K .......... .......... .......... .......... .......... 57% 283M 0s 2024-09-12T00:43:53.546 INFO:teuthology.orchestra.run.smithi043.stderr: 53700K .......... .......... .......... .......... .......... 57% 218M 0s 2024-09-12T00:43:53.546 INFO:teuthology.orchestra.run.smithi043.stderr: 53750K .......... .......... .......... .......... .......... 57% 282M 0s 2024-09-12T00:43:53.546 INFO:teuthology.orchestra.run.smithi043.stderr: 53800K .......... .......... .......... .......... .......... 57% 333M 0s 2024-09-12T00:43:53.546 INFO:teuthology.orchestra.run.smithi043.stderr: 53850K .......... .......... .......... .......... .......... 58% 284M 0s 2024-09-12T00:43:53.546 INFO:teuthology.orchestra.run.smithi043.stderr: 53900K .......... .......... .......... .......... .......... 58% 268M 0s 2024-09-12T00:43:53.546 INFO:teuthology.orchestra.run.smithi043.stderr: 53950K .......... .......... .......... .......... .......... 58% 15.2M 0s 2024-09-12T00:43:53.546 INFO:teuthology.orchestra.run.smithi043.stderr: 54000K .......... .......... .......... .......... .......... 58% 278M 0s 2024-09-12T00:43:53.546 INFO:teuthology.orchestra.run.smithi043.stderr: 54050K .......... .......... .......... .......... .......... 58% 252M 0s 2024-09-12T00:43:53.547 INFO:teuthology.orchestra.run.smithi043.stderr: 54100K .......... .......... .......... .......... .......... 58% 257M 0s 2024-09-12T00:43:53.547 INFO:teuthology.orchestra.run.smithi043.stderr: 54150K .......... .......... .......... .......... .......... 58% 280M 0s 2024-09-12T00:43:53.547 INFO:teuthology.orchestra.run.smithi043.stderr: 54200K .......... .......... .......... .......... .......... 58% 299M 0s 2024-09-12T00:43:53.547 INFO:teuthology.orchestra.run.smithi043.stderr: 54250K .......... .......... .......... .......... .......... 58% 294M 0s 2024-09-12T00:43:53.547 INFO:teuthology.orchestra.run.smithi043.stderr: 54300K .......... .......... .......... .......... .......... 58% 228M 0s 2024-09-12T00:43:53.547 INFO:teuthology.orchestra.run.smithi043.stderr: 54350K .......... .......... .......... .......... .......... 58% 312M 0s 2024-09-12T00:43:53.547 INFO:teuthology.orchestra.run.smithi043.stderr: 54400K .......... .......... .......... .......... .......... 58% 292M 0s 2024-09-12T00:43:53.547 INFO:teuthology.orchestra.run.smithi043.stderr: 54450K .......... .......... .......... .......... .......... 58% 259M 0s 2024-09-12T00:43:53.547 INFO:teuthology.orchestra.run.smithi043.stderr: 54500K .......... .......... .......... .......... .......... 58% 217M 0s 2024-09-12T00:43:53.547 INFO:teuthology.orchestra.run.smithi043.stderr: 54550K .......... .......... .......... .......... .......... 58% 298M 0s 2024-09-12T00:43:53.547 INFO:teuthology.orchestra.run.smithi043.stderr: 54600K .......... .......... .......... .......... .......... 58% 325M 0s 2024-09-12T00:43:53.547 INFO:teuthology.orchestra.run.smithi043.stderr: 54650K .......... .......... .......... .......... .......... 58% 309M 0s 2024-09-12T00:43:53.547 INFO:teuthology.orchestra.run.smithi043.stderr: 54700K .......... .......... .......... .......... .......... 58% 267M 0s 2024-09-12T00:43:53.548 INFO:teuthology.orchestra.run.smithi043.stderr: 54750K .......... .......... .......... .......... .......... 58% 296M 0s 2024-09-12T00:43:53.548 INFO:teuthology.orchestra.run.smithi043.stderr: 54800K .......... .......... .......... .......... .......... 59% 335M 0s 2024-09-12T00:43:53.548 INFO:teuthology.orchestra.run.smithi043.stderr: 54850K .......... .......... .......... .......... .......... 59% 312M 0s 2024-09-12T00:43:53.548 INFO:teuthology.orchestra.run.smithi043.stderr: 54900K .......... .......... .......... .......... .......... 59% 274M 0s 2024-09-12T00:43:53.548 INFO:teuthology.orchestra.run.smithi043.stderr: 54950K .......... .......... .......... .......... .......... 59% 312M 0s 2024-09-12T00:43:53.548 INFO:teuthology.orchestra.run.smithi043.stderr: 55000K .......... .......... .......... .......... .......... 59% 263M 0s 2024-09-12T00:43:53.548 INFO:teuthology.orchestra.run.smithi043.stderr: 55050K .......... .......... .......... .......... .......... 59% 327M 0s 2024-09-12T00:43:53.548 INFO:teuthology.orchestra.run.smithi043.stderr: 55100K .......... .......... .......... .......... .......... 59% 267M 0s 2024-09-12T00:43:53.548 INFO:teuthology.orchestra.run.smithi043.stderr: 55150K .......... .......... .......... .......... .......... 59% 298M 0s 2024-09-12T00:43:53.548 INFO:teuthology.orchestra.run.smithi043.stderr: 55200K .......... .......... .......... .......... .......... 59% 307M 0s 2024-09-12T00:43:53.548 INFO:teuthology.orchestra.run.smithi043.stderr: 55250K .......... .......... .......... .......... .......... 59% 310M 0s 2024-09-12T00:43:53.548 INFO:teuthology.orchestra.run.smithi043.stderr: 55300K .......... .......... .......... .......... .......... 59% 272M 0s 2024-09-12T00:43:53.549 INFO:teuthology.orchestra.run.smithi043.stderr: 55350K .......... .......... .......... .......... .......... 59% 322M 0s 2024-09-12T00:43:53.549 INFO:teuthology.orchestra.run.smithi043.stderr: 55400K .......... .......... .......... .......... .......... 59% 308M 0s 2024-09-12T00:43:53.549 INFO:teuthology.orchestra.run.smithi043.stderr: 55450K .......... .......... .......... .......... .......... 59% 295M 0s 2024-09-12T00:43:53.549 INFO:teuthology.orchestra.run.smithi043.stderr: 55500K .......... .......... .......... .......... .......... 59% 245M 0s 2024-09-12T00:43:53.549 INFO:teuthology.orchestra.run.smithi043.stderr: 55550K .......... .......... .......... .......... .......... 59% 290M 0s 2024-09-12T00:43:53.549 INFO:teuthology.orchestra.run.smithi043.stderr: 55600K .......... .......... .......... .......... .......... 59% 328M 0s 2024-09-12T00:43:53.549 INFO:teuthology.orchestra.run.smithi043.stderr: 55650K .......... .......... .......... .......... .......... 59% 284M 0s 2024-09-12T00:43:53.549 INFO:teuthology.orchestra.run.smithi043.stderr: 55700K .......... .......... .......... .......... .......... 60% 263M 0s 2024-09-12T00:43:53.549 INFO:teuthology.orchestra.run.smithi043.stderr: 55750K .......... .......... .......... .......... .......... 60% 305M 0s 2024-09-12T00:43:53.549 INFO:teuthology.orchestra.run.smithi043.stderr: 55800K .......... .......... .......... .......... .......... 60% 286M 0s 2024-09-12T00:43:53.549 INFO:teuthology.orchestra.run.smithi043.stderr: 55850K .......... .......... .......... .......... .......... 60% 362M 0s 2024-09-12T00:43:53.549 INFO:teuthology.orchestra.run.smithi043.stderr: 55900K .......... .......... .......... .......... .......... 60% 254M 0s 2024-09-12T00:43:53.549 INFO:teuthology.orchestra.run.smithi043.stderr: 55950K .......... .......... .......... .......... .......... 60% 303M 0s 2024-09-12T00:43:53.550 INFO:teuthology.orchestra.run.smithi043.stderr: 56000K .......... .......... .......... .......... .......... 60% 307M 0s 2024-09-12T00:43:53.550 INFO:teuthology.orchestra.run.smithi043.stderr: 56050K .......... .......... .......... .......... .......... 60% 248M 0s 2024-09-12T00:43:53.550 INFO:teuthology.orchestra.run.smithi043.stderr: 56100K .......... .......... .......... .......... .......... 60% 265M 0s 2024-09-12T00:43:53.550 INFO:teuthology.orchestra.run.smithi043.stderr: 56150K .......... .......... .......... .......... .......... 60% 322M 0s 2024-09-12T00:43:53.550 INFO:teuthology.orchestra.run.smithi043.stderr: 56200K .......... .......... .......... .......... .......... 60% 339M 0s 2024-09-12T00:43:53.550 INFO:teuthology.orchestra.run.smithi043.stderr: 56250K .......... .......... .......... .......... .......... 60% 339M 0s 2024-09-12T00:43:53.550 INFO:teuthology.orchestra.run.smithi043.stderr: 56300K .......... .......... .......... .......... .......... 60% 255M 0s 2024-09-12T00:43:53.550 INFO:teuthology.orchestra.run.smithi043.stderr: 56350K .......... .......... .......... .......... .......... 60% 305M 0s 2024-09-12T00:43:53.550 INFO:teuthology.orchestra.run.smithi043.stderr: 56400K .......... .......... .......... .......... .......... 60% 318M 0s 2024-09-12T00:43:53.550 INFO:teuthology.orchestra.run.smithi043.stderr: 56450K .......... .......... .......... .......... .......... 60% 19.7M 0s 2024-09-12T00:43:53.550 INFO:teuthology.orchestra.run.smithi043.stderr: 56500K .......... .......... .......... .......... .......... 60% 153M 0s 2024-09-12T00:43:53.550 INFO:teuthology.orchestra.run.smithi043.stderr: 56550K .......... .......... .......... .......... .......... 60% 274M 0s 2024-09-12T00:43:53.550 INFO:teuthology.orchestra.run.smithi043.stderr: 56600K .......... .......... .......... .......... .......... 60% 308M 0s 2024-09-12T00:43:53.551 INFO:teuthology.orchestra.run.smithi043.stderr: 56650K .......... .......... .......... .......... .......... 61% 285M 0s 2024-09-12T00:43:53.551 INFO:teuthology.orchestra.run.smithi043.stderr: 56700K .......... .......... .......... .......... .......... 61% 268M 0s 2024-09-12T00:43:53.551 INFO:teuthology.orchestra.run.smithi043.stderr: 56750K .......... .......... .......... .......... .......... 61% 343M 0s 2024-09-12T00:43:53.551 INFO:teuthology.orchestra.run.smithi043.stderr: 56800K .......... .......... .......... .......... .......... 61% 305M 0s 2024-09-12T00:43:53.551 INFO:teuthology.orchestra.run.smithi043.stderr: 56850K .......... .......... .......... .......... .......... 61% 308M 0s 2024-09-12T00:43:53.551 INFO:teuthology.orchestra.run.smithi043.stderr: 56900K .......... .......... .......... .......... .......... 61% 277M 0s 2024-09-12T00:43:53.551 INFO:teuthology.orchestra.run.smithi043.stderr: 56950K .......... .......... .......... .......... .......... 61% 330M 0s 2024-09-12T00:43:53.551 INFO:teuthology.orchestra.run.smithi043.stderr: 57000K .......... .......... .......... .......... .......... 61% 339M 0s 2024-09-12T00:43:53.551 INFO:teuthology.orchestra.run.smithi043.stderr: 57050K .......... .......... .......... .......... .......... 61% 263M 0s 2024-09-12T00:43:53.551 INFO:teuthology.orchestra.run.smithi043.stderr: 57100K .......... .......... .......... .......... .......... 61% 230M 0s 2024-09-12T00:43:53.551 INFO:teuthology.orchestra.run.smithi043.stderr: 57150K .......... .......... .......... .......... .......... 61% 266M 0s 2024-09-12T00:43:53.551 INFO:teuthology.orchestra.run.smithi043.stderr: 57200K .......... .......... .......... .......... .......... 61% 280M 0s 2024-09-12T00:43:53.551 INFO:teuthology.orchestra.run.smithi043.stderr: 57250K .......... .......... .......... .......... .......... 61% 291M 0s 2024-09-12T00:43:53.552 INFO:teuthology.orchestra.run.smithi043.stderr: 57300K .......... .......... .......... .......... .......... 61% 236M 0s 2024-09-12T00:43:53.552 INFO:teuthology.orchestra.run.smithi043.stderr: 57350K .......... .......... .......... .......... .......... 61% 241M 0s 2024-09-12T00:43:53.552 INFO:teuthology.orchestra.run.smithi043.stderr: 57400K .......... .......... .......... .......... .......... 61% 273M 0s 2024-09-12T00:43:53.552 INFO:teuthology.orchestra.run.smithi043.stderr: 57450K .......... .......... .......... .......... .......... 61% 238M 0s 2024-09-12T00:43:53.552 INFO:teuthology.orchestra.run.smithi043.stderr: 57500K .......... .......... .......... .......... .......... 61% 269M 0s 2024-09-12T00:43:53.552 INFO:teuthology.orchestra.run.smithi043.stderr: 57550K .......... .......... .......... .......... .......... 62% 179M 0s 2024-09-12T00:43:53.552 INFO:teuthology.orchestra.run.smithi043.stderr: 57600K .......... .......... .......... .......... .......... 62% 294M 0s 2024-09-12T00:43:53.552 INFO:teuthology.orchestra.run.smithi043.stderr: 57650K .......... .......... .......... .......... .......... 62% 284M 0s 2024-09-12T00:43:53.552 INFO:teuthology.orchestra.run.smithi043.stderr: 57700K .......... .......... .......... .......... .......... 62% 278M 0s 2024-09-12T00:43:53.552 INFO:teuthology.orchestra.run.smithi043.stderr: 57750K .......... .......... .......... .......... .......... 62% 279M 0s 2024-09-12T00:43:53.552 INFO:teuthology.orchestra.run.smithi043.stderr: 57800K .......... .......... .......... .......... .......... 62% 335M 0s 2024-09-12T00:43:53.552 INFO:teuthology.orchestra.run.smithi043.stderr: 57850K .......... .......... .......... .......... .......... 62% 342M 0s 2024-09-12T00:43:53.552 INFO:teuthology.orchestra.run.smithi043.stderr: 57900K .......... .......... .......... .......... .......... 62% 250M 0s 2024-09-12T00:43:53.553 INFO:teuthology.orchestra.run.smithi043.stderr: 57950K .......... .......... .......... .......... .......... 62% 324M 0s 2024-09-12T00:43:53.553 INFO:teuthology.orchestra.run.smithi043.stderr: 58000K .......... .......... .......... .......... .......... 62% 336M 0s 2024-09-12T00:43:53.553 INFO:teuthology.orchestra.run.smithi043.stderr: 58050K .......... .......... .......... .......... .......... 62% 309M 0s 2024-09-12T00:43:53.553 INFO:teuthology.orchestra.run.smithi043.stderr: 58100K .......... .......... .......... .......... .......... 62% 292M 0s 2024-09-12T00:43:53.553 INFO:teuthology.orchestra.run.smithi043.stderr: 58150K .......... .......... .......... .......... .......... 62% 252M 0s 2024-09-12T00:43:53.553 INFO:teuthology.orchestra.run.smithi043.stderr: 58200K .......... .......... .......... .......... .......... 62% 298M 0s 2024-09-12T00:43:53.553 INFO:teuthology.orchestra.run.smithi043.stderr: 58250K .......... .......... .......... .......... .......... 62% 328M 0s 2024-09-12T00:43:53.553 INFO:teuthology.orchestra.run.smithi043.stderr: 58300K .......... .......... .......... .......... .......... 62% 261M 0s 2024-09-12T00:43:53.553 INFO:teuthology.orchestra.run.smithi043.stderr: 58350K .......... .......... .......... .......... .......... 62% 328M 0s 2024-09-12T00:43:53.553 INFO:teuthology.orchestra.run.smithi043.stderr: 58400K .......... .......... .......... .......... .......... 62% 335M 0s 2024-09-12T00:43:53.553 INFO:teuthology.orchestra.run.smithi043.stderr: 58450K .......... .......... .......... .......... .......... 62% 278M 0s 2024-09-12T00:43:53.553 INFO:teuthology.orchestra.run.smithi043.stderr: 58500K .......... .......... .......... .......... .......... 63% 274M 0s 2024-09-12T00:43:53.553 INFO:teuthology.orchestra.run.smithi043.stderr: 58550K .......... .......... .......... .......... .......... 63% 306M 0s 2024-09-12T00:43:53.553 INFO:teuthology.orchestra.run.smithi043.stderr: 58600K .......... .......... .......... .......... .......... 63% 329M 0s 2024-09-12T00:43:53.554 INFO:teuthology.orchestra.run.smithi043.stderr: 58650K .......... .......... .......... .......... .......... 63% 335M 0s 2024-09-12T00:43:53.554 INFO:teuthology.orchestra.run.smithi043.stderr: 58700K .......... .......... .......... .......... .......... 63% 281M 0s 2024-09-12T00:43:53.554 INFO:teuthology.orchestra.run.smithi043.stderr: 58750K .......... .......... .......... .......... .......... 63% 344M 0s 2024-09-12T00:43:53.554 INFO:teuthology.orchestra.run.smithi043.stderr: 58800K .......... .......... .......... .......... .......... 63% 277M 0s 2024-09-12T00:43:53.554 INFO:teuthology.orchestra.run.smithi043.stderr: 58850K .......... .......... .......... .......... .......... 63% 303M 0s 2024-09-12T00:43:53.554 INFO:teuthology.orchestra.run.smithi043.stderr: 58900K .......... .......... .......... .......... .......... 63% 316M 0s 2024-09-12T00:43:53.554 INFO:teuthology.orchestra.run.smithi043.stderr: 58950K .......... .......... .......... .......... .......... 63% 346M 0s 2024-09-12T00:43:53.554 INFO:teuthology.orchestra.run.smithi043.stderr: 59000K .......... .......... .......... .......... .......... 63% 310M 0s 2024-09-12T00:43:53.554 INFO:teuthology.orchestra.run.smithi043.stderr: 59050K .......... .......... .......... .......... .......... 63% 311M 0s 2024-09-12T00:43:53.554 INFO:teuthology.orchestra.run.smithi043.stderr: 59100K .......... .......... .......... .......... .......... 63% 333M 0s 2024-09-12T00:43:53.554 INFO:teuthology.orchestra.run.smithi043.stderr: 59150K .......... .......... .......... .......... .......... 63% 21.3M 0s 2024-09-12T00:43:53.554 INFO:teuthology.orchestra.run.smithi043.stderr: 59200K .......... .......... .......... .......... .......... 63% 255M 0s 2024-09-12T00:43:53.554 INFO:teuthology.orchestra.run.smithi043.stderr: 59250K .......... .......... .......... .......... .......... 63% 299M 0s 2024-09-12T00:43:53.555 INFO:teuthology.orchestra.run.smithi043.stderr: 59300K .......... .......... .......... .......... .......... 63% 290M 0s 2024-09-12T00:43:53.555 INFO:teuthology.orchestra.run.smithi043.stderr: 59350K .......... .......... .......... .......... .......... 63% 304M 0s 2024-09-12T00:43:53.555 INFO:teuthology.orchestra.run.smithi043.stderr: 59400K .......... .......... .......... .......... .......... 63% 323M 0s 2024-09-12T00:43:53.555 INFO:teuthology.orchestra.run.smithi043.stderr: 59450K .......... .......... .......... .......... .......... 64% 345M 0s 2024-09-12T00:43:53.555 INFO:teuthology.orchestra.run.smithi043.stderr: 59500K .......... .......... .......... .......... .......... 64% 276M 0s 2024-09-12T00:43:53.555 INFO:teuthology.orchestra.run.smithi043.stderr: 59550K .......... .......... .......... .......... .......... 64% 347M 0s 2024-09-12T00:43:53.555 INFO:teuthology.orchestra.run.smithi043.stderr: 59600K .......... .......... .......... .......... .......... 64% 309M 0s 2024-09-12T00:43:53.555 INFO:teuthology.orchestra.run.smithi043.stderr: 59650K .......... .......... .......... .......... .......... 64% 326M 0s 2024-09-12T00:43:53.555 INFO:teuthology.orchestra.run.smithi043.stderr: 59700K .......... .......... .......... .......... .......... 64% 285M 0s 2024-09-12T00:43:53.555 INFO:teuthology.orchestra.run.smithi043.stderr: 59750K .......... .......... .......... .......... .......... 64% 334M 0s 2024-09-12T00:43:53.555 INFO:teuthology.orchestra.run.smithi043.stderr: 59800K .......... .......... .......... .......... .......... 64% 354M 0s 2024-09-12T00:43:53.555 INFO:teuthology.orchestra.run.smithi043.stderr: 59850K .......... .......... .......... .......... .......... 64% 340M 0s 2024-09-12T00:43:53.555 INFO:teuthology.orchestra.run.smithi043.stderr: 59900K .......... .......... .......... .......... .......... 64% 277M 0s 2024-09-12T00:43:53.555 INFO:teuthology.orchestra.run.smithi043.stderr: 59950K .......... .......... .......... .......... .......... 64% 341M 0s 2024-09-12T00:43:53.556 INFO:teuthology.orchestra.run.smithi043.stderr: 60000K .......... .......... .......... .......... .......... 64% 334M 0s 2024-09-12T00:43:53.556 INFO:teuthology.orchestra.run.smithi043.stderr: 60050K .......... .......... .......... .......... .......... 64% 348M 0s 2024-09-12T00:43:53.556 INFO:teuthology.orchestra.run.smithi043.stderr: 60100K .......... .......... .......... .......... .......... 64% 322M 0s 2024-09-12T00:43:53.556 INFO:teuthology.orchestra.run.smithi043.stderr: 60150K .......... .......... .......... .......... .......... 64% 340M 0s 2024-09-12T00:43:53.556 INFO:teuthology.orchestra.run.smithi043.stderr: 60200K .......... .......... .......... .......... .......... 64% 300M 0s 2024-09-12T00:43:53.556 INFO:teuthology.orchestra.run.smithi043.stderr: 60250K .......... .......... .......... .......... .......... 64% 283M 0s 2024-09-12T00:43:53.556 INFO:teuthology.orchestra.run.smithi043.stderr: 60300K .......... .......... .......... .......... .......... 64% 331M 0s 2024-09-12T00:43:53.556 INFO:teuthology.orchestra.run.smithi043.stderr: 60350K .......... .......... .......... .......... .......... 65% 297M 0s 2024-09-12T00:43:53.556 INFO:teuthology.orchestra.run.smithi043.stderr: 60400K .......... .......... .......... .......... .......... 65% 296M 0s 2024-09-12T00:43:53.556 INFO:teuthology.orchestra.run.smithi043.stderr: 60450K .......... .......... .......... .......... .......... 65% 329M 0s 2024-09-12T00:43:53.556 INFO:teuthology.orchestra.run.smithi043.stderr: 60500K .......... .......... .......... .......... .......... 65% 308M 0s 2024-09-12T00:43:53.556 INFO:teuthology.orchestra.run.smithi043.stderr: 60550K .......... .......... .......... .......... .......... 65% 319M 0s 2024-09-12T00:43:53.557 INFO:teuthology.orchestra.run.smithi043.stderr: 60600K .......... .......... .......... .......... .......... 65% 253M 0s 2024-09-12T00:43:53.557 INFO:teuthology.orchestra.run.smithi043.stderr: 60650K .......... .......... .......... .......... .......... 65% 308M 0s 2024-09-12T00:43:53.557 INFO:teuthology.orchestra.run.smithi043.stderr: 60700K .......... .......... .......... .......... .......... 65% 308M 0s 2024-09-12T00:43:53.557 INFO:teuthology.orchestra.run.smithi043.stderr: 60750K .......... .......... .......... .......... .......... 65% 355M 0s 2024-09-12T00:43:53.557 INFO:teuthology.orchestra.run.smithi043.stderr: 60800K .......... .......... .......... .......... .......... 65% 282M 0s 2024-09-12T00:43:53.557 INFO:teuthology.orchestra.run.smithi043.stderr: 60850K .......... .......... .......... .......... .......... 65% 119M 0s 2024-09-12T00:43:53.557 INFO:teuthology.orchestra.run.smithi043.stderr: 60900K .......... .......... .......... .......... .......... 65% 307M 0s 2024-09-12T00:43:53.557 INFO:teuthology.orchestra.run.smithi043.stderr: 60950K .......... .......... .......... .......... .......... 65% 303M 0s 2024-09-12T00:43:53.557 INFO:teuthology.orchestra.run.smithi043.stderr: 61000K .......... .......... .......... .......... .......... 65% 264M 0s 2024-09-12T00:43:53.557 INFO:teuthology.orchestra.run.smithi043.stderr: 61050K .......... .......... .......... .......... .......... 65% 355M 0s 2024-09-12T00:43:53.557 INFO:teuthology.orchestra.run.smithi043.stderr: 61100K .......... .......... .......... .......... .......... 65% 335M 0s 2024-09-12T00:43:53.557 INFO:teuthology.orchestra.run.smithi043.stderr: 61150K .......... .......... .......... .......... .......... 65% 321M 0s 2024-09-12T00:43:53.557 INFO:teuthology.orchestra.run.smithi043.stderr: 61200K .......... .......... .......... .......... .......... 65% 229M 0s 2024-09-12T00:43:53.557 INFO:teuthology.orchestra.run.smithi043.stderr: 61250K .......... .......... .......... .......... .......... 65% 299M 0s 2024-09-12T00:43:53.558 INFO:teuthology.orchestra.run.smithi043.stderr: 61300K .......... .......... .......... .......... .......... 66% 327M 0s 2024-09-12T00:43:53.558 INFO:teuthology.orchestra.run.smithi043.stderr: 61350K .......... .......... .......... .......... .......... 66% 331M 0s 2024-09-12T00:43:53.558 INFO:teuthology.orchestra.run.smithi043.stderr: 61400K .......... .......... .......... .......... .......... 66% 291M 0s 2024-09-12T00:43:53.558 INFO:teuthology.orchestra.run.smithi043.stderr: 61450K .......... .......... .......... .......... .......... 66% 328M 0s 2024-09-12T00:43:53.558 INFO:teuthology.orchestra.run.smithi043.stderr: 61500K .......... .......... .......... .......... .......... 66% 317M 0s 2024-09-12T00:43:53.558 INFO:teuthology.orchestra.run.smithi043.stderr: 61550K .......... .......... .......... .......... .......... 66% 229M 0s 2024-09-12T00:43:53.558 INFO:teuthology.orchestra.run.smithi043.stderr: 61600K .......... .......... .......... .......... .......... 66% 89.2M 0s 2024-09-12T00:43:53.558 INFO:teuthology.orchestra.run.smithi043.stderr: 61650K .......... .......... .......... .......... .......... 66% 279M 0s 2024-09-12T00:43:53.558 INFO:teuthology.orchestra.run.smithi043.stderr: 61700K .......... .......... .......... .......... .......... 66% 293M 0s 2024-09-12T00:43:53.558 INFO:teuthology.orchestra.run.smithi043.stderr: 61750K .......... .......... .......... .......... .......... 66% 325M 0s 2024-09-12T00:43:53.558 INFO:teuthology.orchestra.run.smithi043.stderr: 61800K .......... .......... .......... .......... .......... 66% 351M 0s 2024-09-12T00:43:53.558 INFO:teuthology.orchestra.run.smithi043.stderr: 61850K .......... .......... .......... .......... .......... 66% 302M 0s 2024-09-12T00:43:53.558 INFO:teuthology.orchestra.run.smithi043.stderr: 61900K .......... .......... .......... .......... .......... 66% 18.6M 0s 2024-09-12T00:43:53.559 INFO:teuthology.orchestra.run.smithi043.stderr: 61950K .......... .......... .......... .......... .......... 66% 315M 0s 2024-09-12T00:43:53.559 INFO:teuthology.orchestra.run.smithi043.stderr: 62000K .......... .......... .......... .......... .......... 66% 332M 0s 2024-09-12T00:43:53.559 INFO:teuthology.orchestra.run.smithi043.stderr: 62050K .......... .......... .......... .......... .......... 66% 248M 0s 2024-09-12T00:43:53.559 INFO:teuthology.orchestra.run.smithi043.stderr: 62100K .......... .......... .......... .......... .......... 66% 297M 0s 2024-09-12T00:43:53.559 INFO:teuthology.orchestra.run.smithi043.stderr: 62150K .......... .......... .......... .......... .......... 66% 312M 0s 2024-09-12T00:43:53.559 INFO:teuthology.orchestra.run.smithi043.stderr: 62200K .......... .......... .......... .......... .......... 67% 301M 0s 2024-09-12T00:43:53.559 INFO:teuthology.orchestra.run.smithi043.stderr: 62250K .......... .......... .......... .......... .......... 67% 304M 0s 2024-09-12T00:43:53.559 INFO:teuthology.orchestra.run.smithi043.stderr: 62300K .......... .......... .......... .......... .......... 67% 295M 0s 2024-09-12T00:43:53.559 INFO:teuthology.orchestra.run.smithi043.stderr: 62350K .......... .......... .......... .......... .......... 67% 255M 0s 2024-09-12T00:43:53.559 INFO:teuthology.orchestra.run.smithi043.stderr: 62400K .......... .......... .......... .......... .......... 67% 329M 0s 2024-09-12T00:43:53.559 INFO:teuthology.orchestra.run.smithi043.stderr: 62450K .......... .......... .......... .......... .......... 67% 319M 0s 2024-09-12T00:43:53.559 INFO:teuthology.orchestra.run.smithi043.stderr: 62500K .......... .......... .......... .......... .......... 67% 310M 0s 2024-09-12T00:43:53.559 INFO:teuthology.orchestra.run.smithi043.stderr: 62550K .......... .......... .......... .......... .......... 67% 309M 0s 2024-09-12T00:43:53.560 INFO:teuthology.orchestra.run.smithi043.stderr: 62600K .......... .......... .......... .......... .......... 67% 327M 0s 2024-09-12T00:43:53.560 INFO:teuthology.orchestra.run.smithi043.stderr: 62650K .......... .......... .......... .......... .......... 67% 324M 0s 2024-09-12T00:43:53.560 INFO:teuthology.orchestra.run.smithi043.stderr: 62700K .......... .......... .......... .......... .......... 67% 338M 0s 2024-09-12T00:43:53.560 INFO:teuthology.orchestra.run.smithi043.stderr: 62750K .......... .......... .......... .......... .......... 67% 290M 0s 2024-09-12T00:43:53.560 INFO:teuthology.orchestra.run.smithi043.stderr: 62800K .......... .......... .......... .......... .......... 67% 331M 0s 2024-09-12T00:43:53.560 INFO:teuthology.orchestra.run.smithi043.stderr: 62850K .......... .......... .......... .......... .......... 67% 353M 0s 2024-09-12T00:43:53.560 INFO:teuthology.orchestra.run.smithi043.stderr: 62900K .......... .......... .......... .......... .......... 67% 364M 0s 2024-09-12T00:43:53.560 INFO:teuthology.orchestra.run.smithi043.stderr: 62950K .......... .......... .......... .......... .......... 67% 297M 0s 2024-09-12T00:43:53.560 INFO:teuthology.orchestra.run.smithi043.stderr: 63000K .......... .......... .......... .......... .......... 67% 305M 0s 2024-09-12T00:43:53.560 INFO:teuthology.orchestra.run.smithi043.stderr: 63050K .......... .......... .......... .......... .......... 67% 326M 0s 2024-09-12T00:43:53.560 INFO:teuthology.orchestra.run.smithi043.stderr: 63100K .......... .......... .......... .......... .......... 67% 324M 0s 2024-09-12T00:43:53.560 INFO:teuthology.orchestra.run.smithi043.stderr: 63150K .......... .......... .......... .......... .......... 68% 249M 0s 2024-09-12T00:43:53.560 INFO:teuthology.orchestra.run.smithi043.stderr: 63200K .......... .......... .......... .......... .......... 68% 321M 0s 2024-09-12T00:43:53.561 INFO:teuthology.orchestra.run.smithi043.stderr: 63250K .......... .......... .......... .......... .......... 68% 319M 0s 2024-09-12T00:43:53.561 INFO:teuthology.orchestra.run.smithi043.stderr: 63300K .......... .......... .......... .......... .......... 68% 313M 0s 2024-09-12T00:43:53.561 INFO:teuthology.orchestra.run.smithi043.stderr: 63350K .......... .......... .......... .......... .......... 68% 307M 0s 2024-09-12T00:43:53.561 INFO:teuthology.orchestra.run.smithi043.stderr: 63400K .......... .......... .......... .......... .......... 68% 332M 0s 2024-09-12T00:43:53.561 INFO:teuthology.orchestra.run.smithi043.stderr: 63450K .......... .......... .......... .......... .......... 68% 345M 0s 2024-09-12T00:43:53.561 INFO:teuthology.orchestra.run.smithi043.stderr: 63500K .......... .......... .......... .......... .......... 68% 358M 0s 2024-09-12T00:43:53.561 INFO:teuthology.orchestra.run.smithi043.stderr: 63550K .......... .......... .......... .......... .......... 68% 299M 0s 2024-09-12T00:43:53.561 INFO:teuthology.orchestra.run.smithi043.stderr: 63600K .......... .......... .......... .......... .......... 68% 324M 0s 2024-09-12T00:43:53.561 INFO:teuthology.orchestra.run.smithi043.stderr: 63650K .......... .......... .......... .......... .......... 68% 321M 0s 2024-09-12T00:43:53.561 INFO:teuthology.orchestra.run.smithi043.stderr: 63700K .......... .......... .......... .......... .......... 68% 332M 0s 2024-09-12T00:43:53.561 INFO:teuthology.orchestra.run.smithi043.stderr: 63750K .......... .......... .......... .......... .......... 68% 280M 0s 2024-09-12T00:43:53.561 INFO:teuthology.orchestra.run.smithi043.stderr: 63800K .......... .......... .......... .......... .......... 68% 353M 0s 2024-09-12T00:43:53.561 INFO:teuthology.orchestra.run.smithi043.stderr: 63850K .......... .......... .......... .......... .......... 68% 332M 0s 2024-09-12T00:43:53.561 INFO:teuthology.orchestra.run.smithi043.stderr: 63900K .......... .......... .......... .......... .......... 68% 301M 0s 2024-09-12T00:43:53.562 INFO:teuthology.orchestra.run.smithi043.stderr: 63950K .......... .......... .......... .......... .......... 68% 260M 0s 2024-09-12T00:43:53.562 INFO:teuthology.orchestra.run.smithi043.stderr: 64000K .......... .......... .......... .......... .......... 68% 329M 0s 2024-09-12T00:43:53.562 INFO:teuthology.orchestra.run.smithi043.stderr: 64050K .......... .......... .......... .......... .......... 68% 339M 0s 2024-09-12T00:43:53.562 INFO:teuthology.orchestra.run.smithi043.stderr: 64100K .......... .......... .......... .......... .......... 69% 327M 0s 2024-09-12T00:43:53.562 INFO:teuthology.orchestra.run.smithi043.stderr: 64150K .......... .......... .......... .......... .......... 69% 306M 0s 2024-09-12T00:43:53.562 INFO:teuthology.orchestra.run.smithi043.stderr: 64200K .......... .......... .......... .......... .......... 69% 318M 0s 2024-09-12T00:43:53.562 INFO:teuthology.orchestra.run.smithi043.stderr: 64250K .......... .......... .......... .......... .......... 69% 346M 0s 2024-09-12T00:43:53.562 INFO:teuthology.orchestra.run.smithi043.stderr: 64300K .......... .......... .......... .......... .......... 69% 333M 0s 2024-09-12T00:43:53.562 INFO:teuthology.orchestra.run.smithi043.stderr: 64350K .......... .......... .......... .......... .......... 69% 247M 0s 2024-09-12T00:43:53.562 INFO:teuthology.orchestra.run.smithi043.stderr: 64400K .......... .......... .......... .......... .......... 69% 239M 0s 2024-09-12T00:43:53.562 INFO:teuthology.orchestra.run.smithi043.stderr: 64450K .......... .......... .......... .......... .......... 69% 81.8M 0s 2024-09-12T00:43:53.562 INFO:teuthology.orchestra.run.smithi043.stderr: 64500K .......... .......... .......... .......... .......... 69% 311M 0s 2024-09-12T00:43:53.562 INFO:teuthology.orchestra.run.smithi043.stderr: 64550K .......... .......... .......... .......... .......... 69% 293M 0s 2024-09-12T00:43:53.563 INFO:teuthology.orchestra.run.smithi043.stderr: 64600K .......... .......... .......... .......... .......... 69% 339M 0s 2024-09-12T00:43:53.563 INFO:teuthology.orchestra.run.smithi043.stderr: 64650K .......... .......... .......... .......... .......... 69% 338M 0s 2024-09-12T00:43:53.563 INFO:teuthology.orchestra.run.smithi043.stderr: 64700K .......... .......... .......... .......... .......... 69% 335M 0s 2024-09-12T00:43:53.563 INFO:teuthology.orchestra.run.smithi043.stderr: 64750K .......... .......... .......... .......... .......... 69% 277M 0s 2024-09-12T00:43:53.563 INFO:teuthology.orchestra.run.smithi043.stderr: 64800K .......... .......... .......... .......... .......... 69% 358M 0s 2024-09-12T00:43:53.563 INFO:teuthology.orchestra.run.smithi043.stderr: 64850K .......... .......... .......... .......... .......... 69% 351M 0s 2024-09-12T00:43:53.563 INFO:teuthology.orchestra.run.smithi043.stderr: 64900K .......... .......... .......... .......... .......... 69% 25.0M 0s 2024-09-12T00:43:53.563 INFO:teuthology.orchestra.run.smithi043.stderr: 64950K .......... .......... .......... .......... .......... 69% 100M 0s 2024-09-12T00:43:53.563 INFO:teuthology.orchestra.run.smithi043.stderr: 65000K .......... .......... .......... .......... .......... 70% 287M 0s 2024-09-12T00:43:53.563 INFO:teuthology.orchestra.run.smithi043.stderr: 65050K .......... .......... .......... .......... .......... 70% 340M 0s 2024-09-12T00:43:53.563 INFO:teuthology.orchestra.run.smithi043.stderr: 65100K .......... .......... .......... .......... .......... 70% 340M 0s 2024-09-12T00:43:53.563 INFO:teuthology.orchestra.run.smithi043.stderr: 65150K .......... .......... .......... .......... .......... 70% 267M 0s 2024-09-12T00:43:53.563 INFO:teuthology.orchestra.run.smithi043.stderr: 65200K .......... .......... .......... .......... .......... 70% 331M 0s 2024-09-12T00:43:53.564 INFO:teuthology.orchestra.run.smithi043.stderr: 65250K .......... .......... .......... .......... .......... 70% 355M 0s 2024-09-12T00:43:53.564 INFO:teuthology.orchestra.run.smithi043.stderr: 65300K .......... .......... .......... .......... .......... 70% 345M 0s 2024-09-12T00:43:53.564 INFO:teuthology.orchestra.run.smithi043.stderr: 65350K .......... .......... .......... .......... .......... 70% 303M 0s 2024-09-12T00:43:53.564 INFO:teuthology.orchestra.run.smithi043.stderr: 65400K .......... .......... .......... .......... .......... 70% 315M 0s 2024-09-12T00:43:53.564 INFO:teuthology.orchestra.run.smithi043.stderr: 65450K .......... .......... .......... .......... .......... 70% 339M 0s 2024-09-12T00:43:53.564 INFO:teuthology.orchestra.run.smithi043.stderr: 65500K .......... .......... .......... .......... .......... 70% 325M 0s 2024-09-12T00:43:53.564 INFO:teuthology.orchestra.run.smithi043.stderr: 65550K .......... .......... .......... .......... .......... 70% 289M 0s 2024-09-12T00:43:53.564 INFO:teuthology.orchestra.run.smithi043.stderr: 65600K .......... .......... .......... .......... .......... 70% 317M 0s 2024-09-12T00:43:53.564 INFO:teuthology.orchestra.run.smithi043.stderr: 65650K .......... .......... .......... .......... .......... 70% 264M 0s 2024-09-12T00:43:53.565 INFO:teuthology.orchestra.run.smithi043.stderr: 65700K .......... .......... .......... .......... .......... 70% 322M 0s 2024-09-12T00:43:53.565 INFO:teuthology.orchestra.run.smithi043.stderr: 65750K .......... .......... .......... .......... .......... 70% 288M 0s 2024-09-12T00:43:53.565 INFO:teuthology.orchestra.run.smithi043.stderr: 65800K .......... .......... .......... .......... .......... 70% 276M 0s 2024-09-12T00:43:53.565 INFO:teuthology.orchestra.run.smithi043.stderr: 65850K .......... .......... .......... .......... .......... 70% 88.2M 0s 2024-09-12T00:43:53.565 INFO:teuthology.orchestra.run.smithi043.stderr: 65900K .......... .......... .......... .......... .......... 70% 304M 0s 2024-09-12T00:43:53.565 INFO:teuthology.orchestra.run.smithi043.stderr: 65950K .......... .......... .......... .......... .......... 71% 260M 0s 2024-09-12T00:43:53.565 INFO:teuthology.orchestra.run.smithi043.stderr: 66000K .......... .......... .......... .......... .......... 71% 258M 0s 2024-09-12T00:43:53.565 INFO:teuthology.orchestra.run.smithi043.stderr: 66050K .......... .......... .......... .......... .......... 71% 320M 0s 2024-09-12T00:43:53.565 INFO:teuthology.orchestra.run.smithi043.stderr: 66100K .......... .......... .......... .......... .......... 71% 322M 0s 2024-09-12T00:43:53.565 INFO:teuthology.orchestra.run.smithi043.stderr: 66150K .......... .......... .......... .......... .......... 71% 276M 0s 2024-09-12T00:43:53.566 INFO:teuthology.orchestra.run.smithi043.stderr: 66200K .......... .......... .......... .......... .......... 71% 338M 0s 2024-09-12T00:43:53.566 INFO:teuthology.orchestra.run.smithi043.stderr: 66250K .......... .......... .......... .......... .......... 71% 278M 0s 2024-09-12T00:43:53.566 INFO:teuthology.orchestra.run.smithi043.stderr: 66300K .......... .......... .......... .......... .......... 71% 300M 0s 2024-09-12T00:43:53.566 INFO:teuthology.orchestra.run.smithi043.stderr: 66350K .......... .......... .......... .......... .......... 71% 266M 0s 2024-09-12T00:43:53.566 INFO:teuthology.orchestra.run.smithi043.stderr: 66400K .......... .......... .......... .......... .......... 71% 304M 0s 2024-09-12T00:43:53.566 INFO:teuthology.orchestra.run.smithi043.stderr: 66450K .......... .......... .......... .......... .......... 71% 271M 0s 2024-09-12T00:43:53.566 INFO:teuthology.orchestra.run.smithi043.stderr: 66500K .......... .......... .......... .......... .......... 71% 326M 0s 2024-09-12T00:43:53.566 INFO:teuthology.orchestra.run.smithi043.stderr: 66550K .......... .......... .......... .......... .......... 71% 301M 0s 2024-09-12T00:43:53.566 INFO:teuthology.orchestra.run.smithi043.stderr: 66600K .......... .......... .......... .......... .......... 71% 351M 0s 2024-09-12T00:43:53.566 INFO:teuthology.orchestra.run.smithi043.stderr: 66650K .......... .......... .......... .......... .......... 71% 328M 0s 2024-09-12T00:43:53.566 INFO:teuthology.orchestra.run.smithi043.stderr: 66700K .......... .......... .......... .......... .......... 71% 349M 0s 2024-09-12T00:43:53.566 INFO:teuthology.orchestra.run.smithi043.stderr: 66750K .......... .......... .......... .......... .......... 71% 283M 0s 2024-09-12T00:43:53.567 INFO:teuthology.orchestra.run.smithi043.stderr: 66800K .......... .......... .......... .......... .......... 71% 339M 0s 2024-09-12T00:43:53.567 INFO:teuthology.orchestra.run.smithi043.stderr: 66850K .......... .......... .......... .......... .......... 72% 310M 0s 2024-09-12T00:43:53.567 INFO:teuthology.orchestra.run.smithi043.stderr: 66900K .......... .......... .......... .......... .......... 72% 345M 0s 2024-09-12T00:43:53.567 INFO:teuthology.orchestra.run.smithi043.stderr: 66950K .......... .......... .......... .......... .......... 72% 299M 0s 2024-09-12T00:43:53.567 INFO:teuthology.orchestra.run.smithi043.stderr: 67000K .......... .......... .......... .......... .......... 72% 346M 0s 2024-09-12T00:43:53.567 INFO:teuthology.orchestra.run.smithi043.stderr: 67050K .......... .......... .......... .......... .......... 72% 359M 0s 2024-09-12T00:43:53.567 INFO:teuthology.orchestra.run.smithi043.stderr: 67100K .......... .......... .......... .......... .......... 72% 241M 0s 2024-09-12T00:43:53.567 INFO:teuthology.orchestra.run.smithi043.stderr: 67150K .......... .......... .......... .......... .......... 72% 271M 0s 2024-09-12T00:43:53.567 INFO:teuthology.orchestra.run.smithi043.stderr: 67200K .......... .......... .......... .......... .......... 72% 365M 0s 2024-09-12T00:43:53.567 INFO:teuthology.orchestra.run.smithi043.stderr: 67250K .......... .......... .......... .......... .......... 72% 182M 0s 2024-09-12T00:43:53.567 INFO:teuthology.orchestra.run.smithi043.stderr: 67300K .......... .......... .......... .......... .......... 72% 316M 0s 2024-09-12T00:43:53.568 INFO:teuthology.orchestra.run.smithi043.stderr: 67350K .......... .......... .......... .......... .......... 72% 266M 0s 2024-09-12T00:43:53.568 INFO:teuthology.orchestra.run.smithi043.stderr: 67400K .......... .......... .......... .......... .......... 72% 307M 0s 2024-09-12T00:43:53.568 INFO:teuthology.orchestra.run.smithi043.stderr: 67450K .......... .......... .......... .......... .......... 72% 360M 0s 2024-09-12T00:43:53.568 INFO:teuthology.orchestra.run.smithi043.stderr: 67500K .......... .......... .......... .......... .......... 72% 317M 0s 2024-09-12T00:43:53.568 INFO:teuthology.orchestra.run.smithi043.stderr: 67550K .......... .......... .......... .......... .......... 72% 270M 0s 2024-09-12T00:43:53.568 INFO:teuthology.orchestra.run.smithi043.stderr: 67600K .......... .......... .......... .......... .......... 72% 318M 0s 2024-09-12T00:43:53.568 INFO:teuthology.orchestra.run.smithi043.stderr: 67650K .......... .......... .......... .......... .......... 72% 313M 0s 2024-09-12T00:43:53.568 INFO:teuthology.orchestra.run.smithi043.stderr: 67700K .......... .......... .......... .......... .......... 72% 352M 0s 2024-09-12T00:43:53.568 INFO:teuthology.orchestra.run.smithi043.stderr: 67750K .......... .......... .......... .......... .......... 72% 308M 0s 2024-09-12T00:43:53.568 INFO:teuthology.orchestra.run.smithi043.stderr: 67800K .......... .......... .......... .......... .......... 73% 317M 0s 2024-09-12T00:43:53.568 INFO:teuthology.orchestra.run.smithi043.stderr: 67850K .......... .......... .......... .......... .......... 73% 32.1M 0s 2024-09-12T00:43:53.569 INFO:teuthology.orchestra.run.smithi043.stderr: 67900K .......... .......... .......... .......... .......... 73% 323M 0s 2024-09-12T00:43:53.569 INFO:teuthology.orchestra.run.smithi043.stderr: 67950K .......... .......... .......... .......... .......... 73% 134M 0s 2024-09-12T00:43:53.569 INFO:teuthology.orchestra.run.smithi043.stderr: 68000K .......... .......... .......... .......... .......... 73% 215M 0s 2024-09-12T00:43:53.569 INFO:teuthology.orchestra.run.smithi043.stderr: 68050K .......... .......... .......... .......... .......... 73% 305M 0s 2024-09-12T00:43:53.569 INFO:teuthology.orchestra.run.smithi043.stderr: 68100K .......... .......... .......... .......... .......... 73% 148M 0s 2024-09-12T00:43:53.569 INFO:teuthology.orchestra.run.smithi043.stderr: 68150K .......... .......... .......... .......... .......... 73% 283M 0s 2024-09-12T00:43:53.569 INFO:teuthology.orchestra.run.smithi043.stderr: 68200K .......... .......... .......... .......... .......... 73% 309M 0s 2024-09-12T00:43:53.569 INFO:teuthology.orchestra.run.smithi043.stderr: 68250K .......... .......... .......... .......... .......... 73% 307M 0s 2024-09-12T00:43:53.569 INFO:teuthology.orchestra.run.smithi043.stderr: 68300K .......... .......... .......... .......... .......... 73% 297M 0s 2024-09-12T00:43:53.569 INFO:teuthology.orchestra.run.smithi043.stderr: 68350K .......... .......... .......... .......... .......... 73% 266M 0s 2024-09-12T00:43:53.569 INFO:teuthology.orchestra.run.smithi043.stderr: 68400K .......... .......... .......... .......... .......... 73% 300M 0s 2024-09-12T00:43:53.569 INFO:teuthology.orchestra.run.smithi043.stderr: 68450K .......... .......... .......... .......... .......... 73% 318M 0s 2024-09-12T00:43:53.570 INFO:teuthology.orchestra.run.smithi043.stderr: 68500K .......... .......... .......... .......... .......... 73% 335M 0s 2024-09-12T00:43:53.570 INFO:teuthology.orchestra.run.smithi043.stderr: 68550K .......... .......... .......... .......... .......... 73% 315M 0s 2024-09-12T00:43:53.570 INFO:teuthology.orchestra.run.smithi043.stderr: 68600K .......... .......... .......... .......... .......... 73% 325M 0s 2024-09-12T00:43:53.570 INFO:teuthology.orchestra.run.smithi043.stderr: 68650K .......... .......... .......... .......... .......... 73% 315M 0s 2024-09-12T00:43:53.570 INFO:teuthology.orchestra.run.smithi043.stderr: 68700K .......... .......... .......... .......... .......... 74% 289M 0s 2024-09-12T00:43:53.570 INFO:teuthology.orchestra.run.smithi043.stderr: 68750K .......... .......... .......... .......... .......... 74% 258M 0s 2024-09-12T00:43:53.570 INFO:teuthology.orchestra.run.smithi043.stderr: 68800K .......... .......... .......... .......... .......... 74% 283M 0s 2024-09-12T00:43:53.570 INFO:teuthology.orchestra.run.smithi043.stderr: 68850K .......... .......... .......... .......... .......... 74% 115M 0s 2024-09-12T00:43:53.570 INFO:teuthology.orchestra.run.smithi043.stderr: 68900K .......... .......... .......... .......... .......... 74% 223M 0s 2024-09-12T00:43:53.570 INFO:teuthology.orchestra.run.smithi043.stderr: 68950K .......... .......... .......... .......... .......... 74% 252M 0s 2024-09-12T00:43:53.570 INFO:teuthology.orchestra.run.smithi043.stderr: 69000K .......... .......... .......... .......... .......... 74% 279M 0s 2024-09-12T00:43:53.571 INFO:teuthology.orchestra.run.smithi043.stderr: 69050K .......... .......... .......... .......... .......... 74% 221M 0s 2024-09-12T00:43:53.571 INFO:teuthology.orchestra.run.smithi043.stderr: 69100K .......... .......... .......... .......... .......... 74% 327M 0s 2024-09-12T00:43:53.571 INFO:teuthology.orchestra.run.smithi043.stderr: 69150K .......... .......... .......... .......... .......... 74% 205M 0s 2024-09-12T00:43:53.571 INFO:teuthology.orchestra.run.smithi043.stderr: 69200K .......... .......... .......... .......... .......... 74% 234M 0s 2024-09-12T00:43:53.571 INFO:teuthology.orchestra.run.smithi043.stderr: 69250K .......... .......... .......... .......... .......... 74% 293M 0s 2024-09-12T00:43:53.571 INFO:teuthology.orchestra.run.smithi043.stderr: 69300K .......... .......... .......... .......... .......... 74% 311M 0s 2024-09-12T00:43:53.571 INFO:teuthology.orchestra.run.smithi043.stderr: 69350K .......... .......... .......... .......... .......... 74% 299M 0s 2024-09-12T00:43:53.571 INFO:teuthology.orchestra.run.smithi043.stderr: 69400K .......... .......... .......... .......... .......... 74% 300M 0s 2024-09-12T00:43:53.571 INFO:teuthology.orchestra.run.smithi043.stderr: 69450K .......... .......... .......... .......... .......... 74% 348M 0s 2024-09-12T00:43:53.571 INFO:teuthology.orchestra.run.smithi043.stderr: 69500K .......... .......... .......... .......... .......... 74% 188M 0s 2024-09-12T00:43:53.572 INFO:teuthology.orchestra.run.smithi043.stderr: 69550K .......... .......... .......... .......... .......... 74% 277M 0s 2024-09-12T00:43:53.572 INFO:teuthology.orchestra.run.smithi043.stderr: 69600K .......... .......... .......... .......... .......... 74% 167M 0s 2024-09-12T00:43:53.572 INFO:teuthology.orchestra.run.smithi043.stderr: 69650K .......... .......... .......... .......... .......... 75% 312M 0s 2024-09-12T00:43:53.572 INFO:teuthology.orchestra.run.smithi043.stderr: 69700K .......... .......... .......... .......... .......... 75% 349M 0s 2024-09-12T00:43:53.572 INFO:teuthology.orchestra.run.smithi043.stderr: 69750K .......... .......... .......... .......... .......... 75% 246M 0s 2024-09-12T00:43:53.572 INFO:teuthology.orchestra.run.smithi043.stderr: 69800K .......... .......... .......... .......... .......... 75% 201M 0s 2024-09-12T00:43:53.572 INFO:teuthology.orchestra.run.smithi043.stderr: 69850K .......... .......... .......... .......... .......... 75% 316M 0s 2024-09-12T00:43:53.572 INFO:teuthology.orchestra.run.smithi043.stderr: 69900K .......... .......... .......... .......... .......... 75% 335M 0s 2024-09-12T00:43:53.573 INFO:teuthology.orchestra.run.smithi043.stderr: 69950K .......... .......... .......... .......... .......... 75% 205M 0s 2024-09-12T00:43:53.573 INFO:teuthology.orchestra.run.smithi043.stderr: 70000K .......... .......... .......... .......... .......... 75% 292M 0s 2024-09-12T00:43:53.573 INFO:teuthology.orchestra.run.smithi043.stderr: 70050K .......... .......... .......... .......... .......... 75% 318M 0s 2024-09-12T00:43:53.573 INFO:teuthology.orchestra.run.smithi043.stderr: 70100K .......... .......... .......... .......... .......... 75% 304M 0s 2024-09-12T00:43:53.573 INFO:teuthology.orchestra.run.smithi043.stderr: 70150K .......... .......... .......... .......... .......... 75% 278M 0s 2024-09-12T00:43:53.573 INFO:teuthology.orchestra.run.smithi043.stderr: 70200K .......... .......... .......... .......... .......... 75% 308M 0s 2024-09-12T00:43:53.573 INFO:teuthology.orchestra.run.smithi043.stderr: 70250K .......... .......... .......... .......... .......... 75% 313M 0s 2024-09-12T00:43:53.573 INFO:teuthology.orchestra.run.smithi043.stderr: 70300K .......... .......... .......... .......... .......... 75% 296M 0s 2024-09-12T00:43:53.573 INFO:teuthology.orchestra.run.smithi043.stderr: 70350K .......... .......... .......... .......... .......... 75% 260M 0s 2024-09-12T00:43:53.573 INFO:teuthology.orchestra.run.smithi043.stderr: 70400K .......... .......... .......... .......... .......... 75% 332M 0s 2024-09-12T00:43:53.574 INFO:teuthology.orchestra.run.smithi043.stderr: 70450K .......... .......... .......... .......... .......... 75% 249M 0s 2024-09-12T00:43:53.574 INFO:teuthology.orchestra.run.smithi043.stderr: 70500K .......... .......... .......... .......... .......... 75% 275M 0s 2024-09-12T00:43:53.574 INFO:teuthology.orchestra.run.smithi043.stderr: 70550K .......... .......... .......... .......... .......... 75% 290M 0s 2024-09-12T00:43:53.574 INFO:teuthology.orchestra.run.smithi043.stderr: 70600K .......... .......... .......... .......... .......... 76% 342M 0s 2024-09-12T00:43:53.574 INFO:teuthology.orchestra.run.smithi043.stderr: 70650K .......... .......... .......... .......... .......... 76% 319M 0s 2024-09-12T00:43:53.574 INFO:teuthology.orchestra.run.smithi043.stderr: 70700K .......... .......... .......... .......... .......... 76% 309M 0s 2024-09-12T00:43:53.574 INFO:teuthology.orchestra.run.smithi043.stderr: 70750K .......... .......... .......... .......... .......... 76% 308M 0s 2024-09-12T00:43:53.574 INFO:teuthology.orchestra.run.smithi043.stderr: 70800K .......... .......... .......... .......... .......... 76% 339M 0s 2024-09-12T00:43:53.574 INFO:teuthology.orchestra.run.smithi043.stderr: 70850K .......... .......... .......... .......... .......... 76% 354M 0s 2024-09-12T00:43:53.574 INFO:teuthology.orchestra.run.smithi043.stderr: 70900K .......... .......... .......... .......... .......... 76% 58.5M 0s 2024-09-12T00:43:53.574 INFO:teuthology.orchestra.run.smithi043.stderr: 70950K .......... .......... .......... .......... .......... 76% 281M 0s 2024-09-12T00:43:53.575 INFO:teuthology.orchestra.run.smithi043.stderr: 71000K .......... .......... .......... .......... .......... 76% 140M 0s 2024-09-12T00:43:53.575 INFO:teuthology.orchestra.run.smithi043.stderr: 71050K .......... .......... .......... .......... .......... 76% 285M 0s 2024-09-12T00:43:53.575 INFO:teuthology.orchestra.run.smithi043.stderr: 71100K .......... .......... .......... .......... .......... 76% 154M 0s 2024-09-12T00:43:53.575 INFO:teuthology.orchestra.run.smithi043.stderr: 71150K .......... .......... .......... .......... .......... 76% 246M 0s 2024-09-12T00:43:53.575 INFO:teuthology.orchestra.run.smithi043.stderr: 71200K .......... .......... .......... .......... .......... 76% 126M 0s 2024-09-12T00:43:53.575 INFO:teuthology.orchestra.run.smithi043.stderr: 71250K .......... .......... .......... .......... .......... 76% 331M 0s 2024-09-12T00:43:53.575 INFO:teuthology.orchestra.run.smithi043.stderr: 71300K .......... .......... .......... .......... .......... 76% 339M 0s 2024-09-12T00:43:53.575 INFO:teuthology.orchestra.run.smithi043.stderr: 71350K .......... .......... .......... .......... .......... 76% 243M 0s 2024-09-12T00:43:53.575 INFO:teuthology.orchestra.run.smithi043.stderr: 71400K .......... .......... .......... .......... .......... 76% 296M 0s 2024-09-12T00:43:53.575 INFO:teuthology.orchestra.run.smithi043.stderr: 71450K .......... .......... .......... .......... .......... 76% 293M 0s 2024-09-12T00:43:53.575 INFO:teuthology.orchestra.run.smithi043.stderr: 71500K .......... .......... .......... .......... .......... 77% 328M 0s 2024-09-12T00:43:53.576 INFO:teuthology.orchestra.run.smithi043.stderr: 71550K .......... .......... .......... .......... .......... 77% 276M 0s 2024-09-12T00:43:53.576 INFO:teuthology.orchestra.run.smithi043.stderr: 71600K .......... .......... .......... .......... .......... 77% 330M 0s 2024-09-12T00:43:53.576 INFO:teuthology.orchestra.run.smithi043.stderr: 71650K .......... .......... .......... .......... .......... 77% 297M 0s 2024-09-12T00:43:53.576 INFO:teuthology.orchestra.run.smithi043.stderr: 71700K .......... .......... .......... .......... .......... 77% 304M 0s 2024-09-12T00:43:53.576 INFO:teuthology.orchestra.run.smithi043.stderr: 71750K .......... .......... .......... .......... .......... 77% 355M 0s 2024-09-12T00:43:53.576 INFO:teuthology.orchestra.run.smithi043.stderr: 71800K .......... .......... .......... .......... .......... 77% 137M 0s 2024-09-12T00:43:53.576 INFO:teuthology.orchestra.run.smithi043.stderr: 71850K .......... .......... .......... .......... .......... 77% 317M 0s 2024-09-12T00:43:53.576 INFO:teuthology.orchestra.run.smithi043.stderr: 71900K .......... .......... .......... .......... .......... 77% 278M 0s 2024-09-12T00:43:53.576 INFO:teuthology.orchestra.run.smithi043.stderr: 71950K .......... .......... .......... .......... .......... 77% 232M 0s 2024-09-12T00:43:53.576 INFO:teuthology.orchestra.run.smithi043.stderr: 72000K .......... .......... .......... .......... .......... 77% 303M 0s 2024-09-12T00:43:53.576 INFO:teuthology.orchestra.run.smithi043.stderr: 72050K .......... .......... .......... .......... .......... 77% 325M 0s 2024-09-12T00:43:53.577 INFO:teuthology.orchestra.run.smithi043.stderr: 72100K .......... .......... .......... .......... .......... 77% 234M 0s 2024-09-12T00:43:53.577 INFO:teuthology.orchestra.run.smithi043.stderr: 72150K .......... .......... .......... .......... .......... 77% 328M 0s 2024-09-12T00:43:53.577 INFO:teuthology.orchestra.run.smithi043.stderr: 72200K .......... .......... .......... .......... .......... 77% 134M 0s 2024-09-12T00:43:53.577 INFO:teuthology.orchestra.run.smithi043.stderr: 72250K .......... .......... .......... .......... .......... 77% 222M 0s 2024-09-12T00:43:53.577 INFO:teuthology.orchestra.run.smithi043.stderr: 72300K .......... .......... .......... .......... .......... 77% 261M 0s 2024-09-12T00:43:53.577 INFO:teuthology.orchestra.run.smithi043.stderr: 72350K .......... .......... .......... .......... .......... 77% 307M 0s 2024-09-12T00:43:53.577 INFO:teuthology.orchestra.run.smithi043.stderr: 72400K .......... .......... .......... .......... .......... 77% 247M 0s 2024-09-12T00:43:53.577 INFO:teuthology.orchestra.run.smithi043.stderr: 72450K .......... .......... .......... .......... .......... 78% 326M 0s 2024-09-12T00:43:53.577 INFO:teuthology.orchestra.run.smithi043.stderr: 72500K .......... .......... .......... .......... .......... 78% 315M 0s 2024-09-12T00:43:53.577 INFO:teuthology.orchestra.run.smithi043.stderr: 72550K .......... .......... .......... .......... .......... 78% 138M 0s 2024-09-12T00:43:53.577 INFO:teuthology.orchestra.run.smithi043.stderr: 72600K .......... .......... .......... .......... .......... 78% 332M 0s 2024-09-12T00:43:53.578 INFO:teuthology.orchestra.run.smithi043.stderr: 72650K .......... .......... .......... .......... .......... 78% 337M 0s 2024-09-12T00:43:53.578 INFO:teuthology.orchestra.run.smithi043.stderr: 72700K .......... .......... .......... .......... .......... 78% 210M 0s 2024-09-12T00:43:53.578 INFO:teuthology.orchestra.run.smithi043.stderr: 72750K .......... .......... .......... .......... .......... 78% 316M 0s 2024-09-12T00:43:53.578 INFO:teuthology.orchestra.run.smithi043.stderr: 72800K .......... .......... .......... .......... .......... 78% 292M 0s 2024-09-12T00:43:53.578 INFO:teuthology.orchestra.run.smithi043.stderr: 72850K .......... .......... .......... .......... .......... 78% 329M 0s 2024-09-12T00:43:53.578 INFO:teuthology.orchestra.run.smithi043.stderr: 72900K .......... .......... .......... .......... .......... 78% 318M 0s 2024-09-12T00:43:53.578 INFO:teuthology.orchestra.run.smithi043.stderr: 72950K .......... .......... .......... .......... .......... 78% 326M 0s 2024-09-12T00:43:53.578 INFO:teuthology.orchestra.run.smithi043.stderr: 73000K .......... .......... .......... .......... .......... 78% 161M 0s 2024-09-12T00:43:53.579 INFO:teuthology.orchestra.run.smithi043.stderr: 73050K .......... .......... .......... .......... .......... 78% 331M 0s 2024-09-12T00:43:53.579 INFO:teuthology.orchestra.run.smithi043.stderr: 73100K .......... .......... .......... .......... .......... 78% 239M 0s 2024-09-12T00:43:53.579 INFO:teuthology.orchestra.run.smithi043.stderr: 73150K .......... .......... .......... .......... .......... 78% 315M 0s 2024-09-12T00:43:53.579 INFO:teuthology.orchestra.run.smithi043.stderr: 73200K .......... .......... .......... .......... .......... 78% 338M 0s 2024-09-12T00:43:53.579 INFO:teuthology.orchestra.run.smithi043.stderr: 73250K .......... .......... .......... .......... .......... 78% 205M 0s 2024-09-12T00:43:53.579 INFO:teuthology.orchestra.run.smithi043.stderr: 73300K .......... .......... .......... .......... .......... 78% 226M 0s 2024-09-12T00:43:53.579 INFO:teuthology.orchestra.run.smithi043.stderr: 73350K .......... .......... .......... .......... .......... 79% 234M 0s 2024-09-12T00:43:53.579 INFO:teuthology.orchestra.run.smithi043.stderr: 73400K .......... .......... .......... .......... .......... 79% 254M 0s 2024-09-12T00:43:53.579 INFO:teuthology.orchestra.run.smithi043.stderr: 73450K .......... .......... .......... .......... .......... 79% 307M 0s 2024-09-12T00:43:53.580 INFO:teuthology.orchestra.run.smithi043.stderr: 73500K .......... .......... .......... .......... .......... 79% 260M 0s 2024-09-12T00:43:53.580 INFO:teuthology.orchestra.run.smithi043.stderr: 73550K .......... .......... .......... .......... .......... 79% 335M 0s 2024-09-12T00:43:53.580 INFO:teuthology.orchestra.run.smithi043.stderr: 73600K .......... .......... .......... .......... .......... 79% 356M 0s 2024-09-12T00:43:53.580 INFO:teuthology.orchestra.run.smithi043.stderr: 73650K .......... .......... .......... .......... .......... 79% 338M 0s 2024-09-12T00:43:53.580 INFO:teuthology.orchestra.run.smithi043.stderr: 73700K .......... .......... .......... .......... .......... 79% 312M 0s 2024-09-12T00:43:53.580 INFO:teuthology.orchestra.run.smithi043.stderr: 73750K .......... .......... .......... .......... .......... 79% 130M 0s 2024-09-12T00:43:53.580 INFO:teuthology.orchestra.run.smithi043.stderr: 73800K .......... .......... .......... .......... .......... 79% 297M 0s 2024-09-12T00:43:53.580 INFO:teuthology.orchestra.run.smithi043.stderr: 73850K .......... .......... .......... .......... .......... 79% 262M 0s 2024-09-12T00:43:53.580 INFO:teuthology.orchestra.run.smithi043.stderr: 73900K .......... .......... .......... .......... .......... 79% 294M 0s 2024-09-12T00:43:53.580 INFO:teuthology.orchestra.run.smithi043.stderr: 73950K .......... .......... .......... .......... .......... 79% 103M 0s 2024-09-12T00:43:53.580 INFO:teuthology.orchestra.run.smithi043.stderr: 74000K .......... .......... .......... .......... .......... 79% 162M 0s 2024-09-12T00:43:53.581 INFO:teuthology.orchestra.run.smithi043.stderr: 74050K .......... .......... .......... .......... .......... 79% 332M 0s 2024-09-12T00:43:53.581 INFO:teuthology.orchestra.run.smithi043.stderr: 74100K .......... .......... .......... .......... .......... 79% 239M 0s 2024-09-12T00:43:53.581 INFO:teuthology.orchestra.run.smithi043.stderr: 74150K .......... .......... .......... .......... .......... 79% 174M 0s 2024-09-12T00:43:53.581 INFO:teuthology.orchestra.run.smithi043.stderr: 74200K .......... .......... .......... .......... .......... 79% 176M 0s 2024-09-12T00:43:53.581 INFO:teuthology.orchestra.run.smithi043.stderr: 74250K .......... .......... .......... .......... .......... 79% 353M 0s 2024-09-12T00:43:53.581 INFO:teuthology.orchestra.run.smithi043.stderr: 74300K .......... .......... .......... .......... .......... 80% 229M 0s 2024-09-12T00:43:53.581 INFO:teuthology.orchestra.run.smithi043.stderr: 74350K .......... .......... .......... .......... .......... 80% 342M 0s 2024-09-12T00:43:53.581 INFO:teuthology.orchestra.run.smithi043.stderr: 74400K .......... .......... .......... .......... .......... 80% 310M 0s 2024-09-12T00:43:53.582 INFO:teuthology.orchestra.run.smithi043.stderr: 74450K .......... .......... .......... .......... .......... 80% 248M 0s 2024-09-12T00:43:53.582 INFO:teuthology.orchestra.run.smithi043.stderr: 74500K .......... .......... .......... .......... .......... 80% 253M 0s 2024-09-12T00:43:53.582 INFO:teuthology.orchestra.run.smithi043.stderr: 74550K .......... .......... .......... .......... .......... 80% 256M 0s 2024-09-12T00:43:53.582 INFO:teuthology.orchestra.run.smithi043.stderr: 74600K .......... .......... .......... .......... .......... 80% 323M 0s 2024-09-12T00:43:53.582 INFO:teuthology.orchestra.run.smithi043.stderr: 74650K .......... .......... .......... .......... .......... 80% 347M 0s 2024-09-12T00:43:53.582 INFO:teuthology.orchestra.run.smithi043.stderr: 74700K .......... .......... .......... .......... .......... 80% 150M 0s 2024-09-12T00:43:53.582 INFO:teuthology.orchestra.run.smithi043.stderr: 74750K .......... .......... .......... .......... .......... 80% 327M 0s 2024-09-12T00:43:53.582 INFO:teuthology.orchestra.run.smithi043.stderr: 74800K .......... .......... .......... .......... .......... 80% 296M 0s 2024-09-12T00:43:53.582 INFO:teuthology.orchestra.run.smithi043.stderr: 74850K .......... .......... .......... .......... .......... 80% 344M 0s 2024-09-12T00:43:53.582 INFO:teuthology.orchestra.run.smithi043.stderr: 74900K .......... .......... .......... .......... .......... 80% 233M 0s 2024-09-12T00:43:53.583 INFO:teuthology.orchestra.run.smithi043.stderr: 74950K .......... .......... .......... .......... .......... 80% 224M 0s 2024-09-12T00:43:53.583 INFO:teuthology.orchestra.run.smithi043.stderr: 75000K .......... .......... .......... .......... .......... 80% 285M 0s 2024-09-12T00:43:53.583 INFO:teuthology.orchestra.run.smithi043.stderr: 75050K .......... .......... .......... .......... .......... 80% 319M 0s 2024-09-12T00:43:53.583 INFO:teuthology.orchestra.run.smithi043.stderr: 75100K .......... .......... .......... .......... .......... 80% 258M 0s 2024-09-12T00:43:53.583 INFO:teuthology.orchestra.run.smithi043.stderr: 75150K .......... .......... .......... .......... .......... 80% 275M 0s 2024-09-12T00:43:53.583 INFO:teuthology.orchestra.run.smithi043.stderr: 75200K .......... .......... .......... .......... .......... 81% 129M 0s 2024-09-12T00:43:53.583 INFO:teuthology.orchestra.run.smithi043.stderr: 75250K .......... .......... .......... .......... .......... 81% 297M 0s 2024-09-12T00:43:53.583 INFO:teuthology.orchestra.run.smithi043.stderr: 75300K .......... .......... .......... .......... .......... 81% 230M 0s 2024-09-12T00:43:53.583 INFO:teuthology.orchestra.run.smithi043.stderr: 75350K .......... .......... .......... .......... .......... 81% 329M 0s 2024-09-12T00:43:53.583 INFO:teuthology.orchestra.run.smithi043.stderr: 75400K .......... .......... .......... .......... .......... 81% 324M 0s 2024-09-12T00:43:53.583 INFO:teuthology.orchestra.run.smithi043.stderr: 75450K .......... .......... .......... .......... .......... 81% 242M 0s 2024-09-12T00:43:53.583 INFO:teuthology.orchestra.run.smithi043.stderr: 75500K .......... .......... .......... .......... .......... 81% 189M 0s 2024-09-12T00:43:53.584 INFO:teuthology.orchestra.run.smithi043.stderr: 75550K .......... .......... .......... .......... .......... 81% 305M 0s 2024-09-12T00:43:53.584 INFO:teuthology.orchestra.run.smithi043.stderr: 75600K .......... .......... .......... .......... .......... 81% 335M 0s 2024-09-12T00:43:53.584 INFO:teuthology.orchestra.run.smithi043.stderr: 75650K .......... .......... .......... .......... .......... 81% 115M 0s 2024-09-12T00:43:53.584 INFO:teuthology.orchestra.run.smithi043.stderr: 75700K .......... .......... .......... .......... .......... 81% 271M 0s 2024-09-12T00:43:53.584 INFO:teuthology.orchestra.run.smithi043.stderr: 75750K .......... .......... .......... .......... .......... 81% 339M 0s 2024-09-12T00:43:53.584 INFO:teuthology.orchestra.run.smithi043.stderr: 75800K .......... .......... .......... .......... .......... 81% 347M 0s 2024-09-12T00:43:53.584 INFO:teuthology.orchestra.run.smithi043.stderr: 75850K .......... .......... .......... .......... .......... 81% 183M 0s 2024-09-12T00:43:53.584 INFO:teuthology.orchestra.run.smithi043.stderr: 75900K .......... .......... .......... .......... .......... 81% 256M 0s 2024-09-12T00:43:53.584 INFO:teuthology.orchestra.run.smithi043.stderr: 75950K .......... .......... .......... .......... .......... 81% 315M 0s 2024-09-12T00:43:53.584 INFO:teuthology.orchestra.run.smithi043.stderr: 76000K .......... .......... .......... .......... .......... 81% 344M 0s 2024-09-12T00:43:53.584 INFO:teuthology.orchestra.run.smithi043.stderr: 76050K .......... .......... .......... .......... .......... 81% 327M 0s 2024-09-12T00:43:53.585 INFO:teuthology.orchestra.run.smithi043.stderr: 76100K .......... .......... .......... .......... .......... 81% 322M 0s 2024-09-12T00:43:53.585 INFO:teuthology.orchestra.run.smithi043.stderr: 76150K .......... .......... .......... .......... .......... 82% 216M 0s 2024-09-12T00:43:53.585 INFO:teuthology.orchestra.run.smithi043.stderr: 76200K .......... .......... .......... .......... .......... 82% 305M 0s 2024-09-12T00:43:53.585 INFO:teuthology.orchestra.run.smithi043.stderr: 76250K .......... .......... .......... .......... .......... 82% 324M 0s 2024-09-12T00:43:53.585 INFO:teuthology.orchestra.run.smithi043.stderr: 76300K .......... .......... .......... .......... .......... 82% 252M 0s 2024-09-12T00:43:53.585 INFO:teuthology.orchestra.run.smithi043.stderr: 76350K .......... .......... .......... .......... .......... 82% 333M 0s 2024-09-12T00:43:53.585 INFO:teuthology.orchestra.run.smithi043.stderr: 76400K .......... .......... .......... .......... .......... 82% 332M 0s 2024-09-12T00:43:53.585 INFO:teuthology.orchestra.run.smithi043.stderr: 76450K .......... .......... .......... .......... .......... 82% 322M 0s 2024-09-12T00:43:53.585 INFO:teuthology.orchestra.run.smithi043.stderr: 76500K .......... .......... .......... .......... .......... 82% 302M 0s 2024-09-12T00:43:53.585 INFO:teuthology.orchestra.run.smithi043.stderr: 76550K .......... .......... .......... .......... .......... 82% 320M 0s 2024-09-12T00:43:53.585 INFO:teuthology.orchestra.run.smithi043.stderr: 76600K .......... .......... .......... .......... .......... 82% 72.1M 0s 2024-09-12T00:43:53.585 INFO:teuthology.orchestra.run.smithi043.stderr: 76650K .......... .......... .......... .......... .......... 82% 333M 0s 2024-09-12T00:43:53.586 INFO:teuthology.orchestra.run.smithi043.stderr: 76700K .......... .......... .......... .......... .......... 82% 264M 0s 2024-09-12T00:43:53.586 INFO:teuthology.orchestra.run.smithi043.stderr: 76750K .......... .......... .......... .......... .......... 82% 280M 0s 2024-09-12T00:43:53.586 INFO:teuthology.orchestra.run.smithi043.stderr: 76800K .......... .......... .......... .......... .......... 82% 332M 0s 2024-09-12T00:43:53.586 INFO:teuthology.orchestra.run.smithi043.stderr: 76850K .......... .......... .......... .......... .......... 82% 265M 0s 2024-09-12T00:43:53.586 INFO:teuthology.orchestra.run.smithi043.stderr: 76900K .......... .......... .......... .......... .......... 82% 236M 0s 2024-09-12T00:43:53.586 INFO:teuthology.orchestra.run.smithi043.stderr: 76950K .......... .......... .......... .......... .......... 82% 364M 0s 2024-09-12T00:43:53.586 INFO:teuthology.orchestra.run.smithi043.stderr: 77000K .......... .......... .......... .......... .......... 82% 254M 0s 2024-09-12T00:43:53.586 INFO:teuthology.orchestra.run.smithi043.stderr: 77050K .......... .......... .......... .......... .......... 82% 276M 0s 2024-09-12T00:43:53.586 INFO:teuthology.orchestra.run.smithi043.stderr: 77100K .......... .......... .......... .......... .......... 83% 253M 0s 2024-09-12T00:43:53.586 INFO:teuthology.orchestra.run.smithi043.stderr: 77150K .......... .......... .......... .......... .......... 83% 303M 0s 2024-09-12T00:43:53.586 INFO:teuthology.orchestra.run.smithi043.stderr: 77200K .......... .......... .......... .......... .......... 83% 177M 0s 2024-09-12T00:43:53.587 INFO:teuthology.orchestra.run.smithi043.stderr: 77250K .......... .......... .......... .......... .......... 83% 181M 0s 2024-09-12T00:43:53.587 INFO:teuthology.orchestra.run.smithi043.stderr: 77300K .......... .......... .......... .......... .......... 83% 253M 0s 2024-09-12T00:43:53.587 INFO:teuthology.orchestra.run.smithi043.stderr: 77350K .......... .......... .......... .......... .......... 83% 332M 0s 2024-09-12T00:43:53.587 INFO:teuthology.orchestra.run.smithi043.stderr: 77400K .......... .......... .......... .......... .......... 83% 286M 0s 2024-09-12T00:43:53.587 INFO:teuthology.orchestra.run.smithi043.stderr: 77450K .......... .......... .......... .......... .......... 83% 193M 0s 2024-09-12T00:43:53.587 INFO:teuthology.orchestra.run.smithi043.stderr: 77500K .......... .......... .......... .......... .......... 83% 125M 0s 2024-09-12T00:43:53.587 INFO:teuthology.orchestra.run.smithi043.stderr: 77550K .......... .......... .......... .......... .......... 83% 194M 0s 2024-09-12T00:43:53.587 INFO:teuthology.orchestra.run.smithi043.stderr: 77600K .......... .......... .......... .......... .......... 83% 106M 0s 2024-09-12T00:43:53.587 INFO:teuthology.orchestra.run.smithi043.stderr: 77650K .......... .......... .......... .......... .......... 83% 315M 0s 2024-09-12T00:43:53.587 INFO:teuthology.orchestra.run.smithi043.stderr: 77700K .......... .......... .......... .......... .......... 83% 348M 0s 2024-09-12T00:43:53.587 INFO:teuthology.orchestra.run.smithi043.stderr: 77750K .......... .......... .......... .......... .......... 83% 341M 0s 2024-09-12T00:43:53.588 INFO:teuthology.orchestra.run.smithi043.stderr: 77800K .......... .......... .......... .......... .......... 83% 234M 0s 2024-09-12T00:43:53.588 INFO:teuthology.orchestra.run.smithi043.stderr: 77850K .......... .......... .......... .......... .......... 83% 297M 0s 2024-09-12T00:43:53.588 INFO:teuthology.orchestra.run.smithi043.stderr: 77900K .......... .......... .......... .......... .......... 83% 357M 0s 2024-09-12T00:43:53.588 INFO:teuthology.orchestra.run.smithi043.stderr: 77950K .......... .......... .......... .......... .......... 83% 272M 0s 2024-09-12T00:43:53.588 INFO:teuthology.orchestra.run.smithi043.stderr: 78000K .......... .......... .......... .......... .......... 84% 310M 0s 2024-09-12T00:43:53.588 INFO:teuthology.orchestra.run.smithi043.stderr: 78050K .......... .......... .......... .......... .......... 84% 333M 0s 2024-09-12T00:43:53.588 INFO:teuthology.orchestra.run.smithi043.stderr: 78100K .......... .......... .......... .......... .......... 84% 318M 0s 2024-09-12T00:43:53.588 INFO:teuthology.orchestra.run.smithi043.stderr: 78150K .......... .......... .......... .......... .......... 84% 319M 0s 2024-09-12T00:43:53.588 INFO:teuthology.orchestra.run.smithi043.stderr: 78200K .......... .......... .......... .......... .......... 84% 256M 0s 2024-09-12T00:43:53.588 INFO:teuthology.orchestra.run.smithi043.stderr: 78250K .......... .......... .......... .......... .......... 84% 205M 0s 2024-09-12T00:43:53.588 INFO:teuthology.orchestra.run.smithi043.stderr: 78300K .......... .......... .......... .......... .......... 84% 251M 0s 2024-09-12T00:43:53.589 INFO:teuthology.orchestra.run.smithi043.stderr: 78350K .......... .......... .......... .......... .......... 84% 223M 0s 2024-09-12T00:43:53.589 INFO:teuthology.orchestra.run.smithi043.stderr: 78400K .......... .......... .......... .......... .......... 84% 325M 0s 2024-09-12T00:43:53.589 INFO:teuthology.orchestra.run.smithi043.stderr: 78450K .......... .......... .......... .......... .......... 84% 328M 0s 2024-09-12T00:43:53.589 INFO:teuthology.orchestra.run.smithi043.stderr: 78500K .......... .......... .......... .......... .......... 84% 309M 0s 2024-09-12T00:43:53.589 INFO:teuthology.orchestra.run.smithi043.stderr: 78550K .......... .......... .......... .......... .......... 84% 248M 0s 2024-09-12T00:43:53.589 INFO:teuthology.orchestra.run.smithi043.stderr: 78600K .......... .......... .......... .......... .......... 84% 355M 0s 2024-09-12T00:43:53.589 INFO:teuthology.orchestra.run.smithi043.stderr: 78650K .......... .......... .......... .......... .......... 84% 257M 0s 2024-09-12T00:43:53.589 INFO:teuthology.orchestra.run.smithi043.stderr: 78700K .......... .......... .......... .......... .......... 84% 153M 0s 2024-09-12T00:43:53.589 INFO:teuthology.orchestra.run.smithi043.stderr: 78750K .......... .......... .......... .......... .......... 84% 145M 0s 2024-09-12T00:43:53.589 INFO:teuthology.orchestra.run.smithi043.stderr: 78800K .......... .......... .......... .......... .......... 84% 313M 0s 2024-09-12T00:43:53.589 INFO:teuthology.orchestra.run.smithi043.stderr: 78850K .......... .......... .......... .......... .......... 84% 323M 0s 2024-09-12T00:43:53.590 INFO:teuthology.orchestra.run.smithi043.stderr: 78900K .......... .......... .......... .......... .......... 84% 288M 0s 2024-09-12T00:43:53.590 INFO:teuthology.orchestra.run.smithi043.stderr: 78950K .......... .......... .......... .......... .......... 85% 314M 0s 2024-09-12T00:43:53.590 INFO:teuthology.orchestra.run.smithi043.stderr: 79000K .......... .......... .......... .......... .......... 85% 357M 0s 2024-09-12T00:43:53.590 INFO:teuthology.orchestra.run.smithi043.stderr: 79050K .......... .......... .......... .......... .......... 85% 331M 0s 2024-09-12T00:43:53.590 INFO:teuthology.orchestra.run.smithi043.stderr: 79100K .......... .......... .......... .......... .......... 85% 294M 0s 2024-09-12T00:43:53.590 INFO:teuthology.orchestra.run.smithi043.stderr: 79150K .......... .......... .......... .......... .......... 85% 310M 0s 2024-09-12T00:43:53.590 INFO:teuthology.orchestra.run.smithi043.stderr: 79200K .......... .......... .......... .......... .......... 85% 330M 0s 2024-09-12T00:43:53.590 INFO:teuthology.orchestra.run.smithi043.stderr: 79250K .......... .......... .......... .......... .......... 85% 313M 0s 2024-09-12T00:43:53.590 INFO:teuthology.orchestra.run.smithi043.stderr: 79300K .......... .......... .......... .......... .......... 85% 276M 0s 2024-09-12T00:43:53.590 INFO:teuthology.orchestra.run.smithi043.stderr: 79350K .......... .......... .......... .......... .......... 85% 306M 0s 2024-09-12T00:43:53.590 INFO:teuthology.orchestra.run.smithi043.stderr: 79400K .......... .......... .......... .......... .......... 85% 313M 0s 2024-09-12T00:43:53.591 INFO:teuthology.orchestra.run.smithi043.stderr: 79450K .......... .......... .......... .......... .......... 85% 301M 0s 2024-09-12T00:43:53.591 INFO:teuthology.orchestra.run.smithi043.stderr: 79500K .......... .......... .......... .......... .......... 85% 270M 0s 2024-09-12T00:43:53.591 INFO:teuthology.orchestra.run.smithi043.stderr: 79550K .......... .......... .......... .......... .......... 85% 363M 0s 2024-09-12T00:43:53.591 INFO:teuthology.orchestra.run.smithi043.stderr: 79600K .......... .......... .......... .......... .......... 85% 94.4M 0s 2024-09-12T00:43:53.591 INFO:teuthology.orchestra.run.smithi043.stderr: 79650K .......... .......... .......... .......... .......... 85% 140M 0s 2024-09-12T00:43:53.591 INFO:teuthology.orchestra.run.smithi043.stderr: 79700K .......... .......... .......... .......... .......... 85% 297M 0s 2024-09-12T00:43:53.591 INFO:teuthology.orchestra.run.smithi043.stderr: 79750K .......... .......... .......... .......... .......... 85% 72.7M 0s 2024-09-12T00:43:53.591 INFO:teuthology.orchestra.run.smithi043.stderr: 79800K .......... .......... .......... .......... .......... 85% 327M 0s 2024-09-12T00:43:53.591 INFO:teuthology.orchestra.run.smithi043.stderr: 79850K .......... .......... .......... .......... .......... 86% 314M 0s 2024-09-12T00:43:53.591 INFO:teuthology.orchestra.run.smithi043.stderr: 79900K .......... .......... .......... .......... .......... 86% 262M 0s 2024-09-12T00:43:53.591 INFO:teuthology.orchestra.run.smithi043.stderr: 79950K .......... .......... .......... .......... .......... 86% 336M 0s 2024-09-12T00:43:53.591 INFO:teuthology.orchestra.run.smithi043.stderr: 80000K .......... .......... .......... .......... .......... 86% 360M 0s 2024-09-12T00:43:53.592 INFO:teuthology.orchestra.run.smithi043.stderr: 80050K .......... .......... .......... .......... .......... 86% 368M 0s 2024-09-12T00:43:53.592 INFO:teuthology.orchestra.run.smithi043.stderr: 80100K .......... .......... .......... .......... .......... 86% 289M 0s 2024-09-12T00:43:53.592 INFO:teuthology.orchestra.run.smithi043.stderr: 80150K .......... .......... .......... .......... .......... 86% 326M 0s 2024-09-12T00:43:53.592 INFO:teuthology.orchestra.run.smithi043.stderr: 80200K .......... .......... .......... .......... .......... 86% 349M 0s 2024-09-12T00:43:53.592 INFO:teuthology.orchestra.run.smithi043.stderr: 80250K .......... .......... .......... .......... .......... 86% 370M 0s 2024-09-12T00:43:53.592 INFO:teuthology.orchestra.run.smithi043.stderr: 80300K .......... .......... .......... .......... .......... 86% 275M 0s 2024-09-12T00:43:53.592 INFO:teuthology.orchestra.run.smithi043.stderr: 80350K .......... .......... .......... .......... .......... 86% 359M 0s 2024-09-12T00:43:53.592 INFO:teuthology.orchestra.run.smithi043.stderr: 80400K .......... .......... .......... .......... .......... 86% 106M 0s 2024-09-12T00:43:53.592 INFO:teuthology.orchestra.run.smithi043.stderr: 80450K .......... .......... .......... .......... .......... 86% 340M 0s 2024-09-12T00:43:53.592 INFO:teuthology.orchestra.run.smithi043.stderr: 80500K .......... .......... .......... .......... .......... 86% 68.5M 0s 2024-09-12T00:43:53.592 INFO:teuthology.orchestra.run.smithi043.stderr: 80550K .......... .......... .......... .......... .......... 86% 322M 0s 2024-09-12T00:43:53.593 INFO:teuthology.orchestra.run.smithi043.stderr: 80600K .......... .......... .......... .......... .......... 86% 208M 0s 2024-09-12T00:43:53.593 INFO:teuthology.orchestra.run.smithi043.stderr: 80650K .......... .......... .......... .......... .......... 86% 241M 0s 2024-09-12T00:43:53.593 INFO:teuthology.orchestra.run.smithi043.stderr: 80700K .......... .......... .......... .......... .......... 86% 272M 0s 2024-09-12T00:43:53.593 INFO:teuthology.orchestra.run.smithi043.stderr: 80750K .......... .......... .......... .......... .......... 86% 240M 0s 2024-09-12T00:43:53.593 INFO:teuthology.orchestra.run.smithi043.stderr: 80800K .......... .......... .......... .......... .......... 87% 263M 0s 2024-09-12T00:43:53.593 INFO:teuthology.orchestra.run.smithi043.stderr: 80850K .......... .......... .......... .......... .......... 87% 317M 0s 2024-09-12T00:43:53.593 INFO:teuthology.orchestra.run.smithi043.stderr: 80900K .......... .......... .......... .......... .......... 87% 278M 0s 2024-09-12T00:43:53.593 INFO:teuthology.orchestra.run.smithi043.stderr: 80950K .......... .......... .......... .......... .......... 87% 354M 0s 2024-09-12T00:43:53.593 INFO:teuthology.orchestra.run.smithi043.stderr: 81000K .......... .......... .......... .......... .......... 87% 331M 0s 2024-09-12T00:43:53.593 INFO:teuthology.orchestra.run.smithi043.stderr: 81050K .......... .......... .......... .......... .......... 87% 163M 0s 2024-09-12T00:43:53.593 INFO:teuthology.orchestra.run.smithi043.stderr: 81100K .......... .......... .......... .......... .......... 87% 237M 0s 2024-09-12T00:43:53.593 INFO:teuthology.orchestra.run.smithi043.stderr: 81150K .......... .......... .......... .......... .......... 87% 327M 0s 2024-09-12T00:43:53.594 INFO:teuthology.orchestra.run.smithi043.stderr: 81200K .......... .......... .......... .......... .......... 87% 315M 0s 2024-09-12T00:43:53.594 INFO:teuthology.orchestra.run.smithi043.stderr: 81250K .......... .......... .......... .......... .......... 87% 337M 0s 2024-09-12T00:43:53.594 INFO:teuthology.orchestra.run.smithi043.stderr: 81300K .......... .......... .......... .......... .......... 87% 306M 0s 2024-09-12T00:43:53.594 INFO:teuthology.orchestra.run.smithi043.stderr: 81350K .......... .......... .......... .......... .......... 87% 344M 0s 2024-09-12T00:43:53.594 INFO:teuthology.orchestra.run.smithi043.stderr: 81400K .......... .......... .......... .......... .......... 87% 307M 0s 2024-09-12T00:43:53.594 INFO:teuthology.orchestra.run.smithi043.stderr: 81450K .......... .......... .......... .......... .......... 87% 347M 0s 2024-09-12T00:43:53.594 INFO:teuthology.orchestra.run.smithi043.stderr: 81500K .......... .......... .......... .......... .......... 87% 260M 0s 2024-09-12T00:43:53.594 INFO:teuthology.orchestra.run.smithi043.stderr: 81550K .......... .......... .......... .......... .......... 87% 313M 0s 2024-09-12T00:43:53.594 INFO:teuthology.orchestra.run.smithi043.stderr: 81600K .......... .......... .......... .......... .......... 87% 329M 0s 2024-09-12T00:43:53.594 INFO:teuthology.orchestra.run.smithi043.stderr: 81650K .......... .......... .......... .......... .......... 87% 333M 0s 2024-09-12T00:43:53.594 INFO:teuthology.orchestra.run.smithi043.stderr: 81700K .......... .......... .......... .......... .......... 87% 305M 0s 2024-09-12T00:43:53.595 INFO:teuthology.orchestra.run.smithi043.stderr: 81750K .......... .......... .......... .......... .......... 88% 314M 0s 2024-09-12T00:43:53.595 INFO:teuthology.orchestra.run.smithi043.stderr: 81800K .......... .......... .......... .......... .......... 88% 256M 0s 2024-09-12T00:43:53.595 INFO:teuthology.orchestra.run.smithi043.stderr: 81850K .......... .......... .......... .......... .......... 88% 327M 0s 2024-09-12T00:43:53.595 INFO:teuthology.orchestra.run.smithi043.stderr: 81900K .......... .......... .......... .......... .......... 88% 301M 0s 2024-09-12T00:43:53.595 INFO:teuthology.orchestra.run.smithi043.stderr: 81950K .......... .......... .......... .......... .......... 88% 144M 0s 2024-09-12T00:43:53.595 INFO:teuthology.orchestra.run.smithi043.stderr: 82000K .......... .......... .......... .......... .......... 88% 257M 0s 2024-09-12T00:43:53.595 INFO:teuthology.orchestra.run.smithi043.stderr: 82050K .......... .......... .......... .......... .......... 88% 325M 0s 2024-09-12T00:43:53.595 INFO:teuthology.orchestra.run.smithi043.stderr: 82100K .......... .......... .......... .......... .......... 88% 262M 0s 2024-09-12T00:43:53.595 INFO:teuthology.orchestra.run.smithi043.stderr: 82150K .......... .......... .......... .......... .......... 88% 340M 0s 2024-09-12T00:43:53.595 INFO:teuthology.orchestra.run.smithi043.stderr: 82200K .......... .......... .......... .......... .......... 88% 355M 0s 2024-09-12T00:43:53.595 INFO:teuthology.orchestra.run.smithi043.stderr: 82250K .......... .......... .......... .......... .......... 88% 308M 0s 2024-09-12T00:43:53.596 INFO:teuthology.orchestra.run.smithi043.stderr: 82300K .......... .......... .......... .......... .......... 88% 219M 0s 2024-09-12T00:43:53.596 INFO:teuthology.orchestra.run.smithi043.stderr: 82350K .......... .......... .......... .......... .......... 88% 254M 0s 2024-09-12T00:43:53.596 INFO:teuthology.orchestra.run.smithi043.stderr: 82400K .......... .......... .......... .......... .......... 88% 319M 0s 2024-09-12T00:43:53.596 INFO:teuthology.orchestra.run.smithi043.stderr: 82450K .......... .......... .......... .......... .......... 88% 332M 0s 2024-09-12T00:43:53.596 INFO:teuthology.orchestra.run.smithi043.stderr: 82500K .......... .......... .......... .......... .......... 88% 326M 0s 2024-09-12T00:43:53.596 INFO:teuthology.orchestra.run.smithi043.stderr: 82550K .......... .......... .......... .......... .......... 88% 327M 0s 2024-09-12T00:43:53.596 INFO:teuthology.orchestra.run.smithi043.stderr: 82600K .......... .......... .......... .......... .......... 88% 212M 0s 2024-09-12T00:43:53.596 INFO:teuthology.orchestra.run.smithi043.stderr: 82650K .......... .......... .......... .......... .......... 89% 151M 0s 2024-09-12T00:43:53.596 INFO:teuthology.orchestra.run.smithi043.stderr: 82700K .......... .......... .......... .......... .......... 89% 74.7M 0s 2024-09-12T00:43:53.596 INFO:teuthology.orchestra.run.smithi043.stderr: 82750K .......... .......... .......... .......... .......... 89% 94.5M 0s 2024-09-12T00:43:53.596 INFO:teuthology.orchestra.run.smithi043.stderr: 82800K .......... .......... .......... .......... .......... 89% 282M 0s 2024-09-12T00:43:53.597 INFO:teuthology.orchestra.run.smithi043.stderr: 82850K .......... .......... .......... .......... .......... 89% 333M 0s 2024-09-12T00:43:53.597 INFO:teuthology.orchestra.run.smithi043.stderr: 82900K .......... .......... .......... .......... .......... 89% 266M 0s 2024-09-12T00:43:53.597 INFO:teuthology.orchestra.run.smithi043.stderr: 82950K .......... .......... .......... .......... .......... 89% 343M 0s 2024-09-12T00:43:53.597 INFO:teuthology.orchestra.run.smithi043.stderr: 83000K .......... .......... .......... .......... .......... 89% 375M 0s 2024-09-12T00:43:53.597 INFO:teuthology.orchestra.run.smithi043.stderr: 83050K .......... .......... .......... .......... .......... 89% 324M 0s 2024-09-12T00:43:53.597 INFO:teuthology.orchestra.run.smithi043.stderr: 83100K .......... .......... .......... .......... .......... 89% 295M 0s 2024-09-12T00:43:53.597 INFO:teuthology.orchestra.run.smithi043.stderr: 83150K .......... .......... .......... .......... .......... 89% 335M 0s 2024-09-12T00:43:53.597 INFO:teuthology.orchestra.run.smithi043.stderr: 83200K .......... .......... .......... .......... .......... 89% 295M 0s 2024-09-12T00:43:53.597 INFO:teuthology.orchestra.run.smithi043.stderr: 83250K .......... .......... .......... .......... .......... 89% 356M 0s 2024-09-12T00:43:53.597 INFO:teuthology.orchestra.run.smithi043.stderr: 83300K .......... .......... .......... .......... .......... 89% 322M 0s 2024-09-12T00:43:53.597 INFO:teuthology.orchestra.run.smithi043.stderr: 83350K .......... .......... .......... .......... .......... 89% 371M 0s 2024-09-12T00:43:53.598 INFO:teuthology.orchestra.run.smithi043.stderr: 83400K .......... .......... .......... .......... .......... 89% 344M 0s 2024-09-12T00:43:53.598 INFO:teuthology.orchestra.run.smithi043.stderr: 83450K .......... .......... .......... .......... .......... 89% 337M 0s 2024-09-12T00:43:53.598 INFO:teuthology.orchestra.run.smithi043.stderr: 83500K .......... .......... .......... .......... .......... 89% 68.6M 0s 2024-09-12T00:43:53.598 INFO:teuthology.orchestra.run.smithi043.stderr: 83550K .......... .......... .......... .......... .......... 89% 103M 0s 2024-09-12T00:43:53.598 INFO:teuthology.orchestra.run.smithi043.stderr: 83600K .......... .......... .......... .......... .......... 90% 327M 0s 2024-09-12T00:43:53.598 INFO:teuthology.orchestra.run.smithi043.stderr: 83650K .......... .......... .......... .......... .......... 90% 298M 0s 2024-09-12T00:43:53.598 INFO:teuthology.orchestra.run.smithi043.stderr: 83700K .......... .......... .......... .......... .......... 90% 274M 0s 2024-09-12T00:43:53.598 INFO:teuthology.orchestra.run.smithi043.stderr: 83750K .......... .......... .......... .......... .......... 90% 361M 0s 2024-09-12T00:43:53.598 INFO:teuthology.orchestra.run.smithi043.stderr: 83800K .......... .......... .......... .......... .......... 90% 318M 0s 2024-09-12T00:43:53.598 INFO:teuthology.orchestra.run.smithi043.stderr: 83850K .......... .......... .......... .......... .......... 90% 298M 0s 2024-09-12T00:43:53.598 INFO:teuthology.orchestra.run.smithi043.stderr: 83900K .......... .......... .......... .......... .......... 90% 220M 0s 2024-09-12T00:43:53.599 INFO:teuthology.orchestra.run.smithi043.stderr: 83950K .......... .......... .......... .......... .......... 90% 359M 0s 2024-09-12T00:43:53.599 INFO:teuthology.orchestra.run.smithi043.stderr: 84000K .......... .......... .......... .......... .......... 90% 118M 0s 2024-09-12T00:43:53.599 INFO:teuthology.orchestra.run.smithi043.stderr: 84050K .......... .......... .......... .......... .......... 90% 321M 0s 2024-09-12T00:43:53.599 INFO:teuthology.orchestra.run.smithi043.stderr: 84100K .......... .......... .......... .......... .......... 90% 244M 0s 2024-09-12T00:43:53.599 INFO:teuthology.orchestra.run.smithi043.stderr: 84150K .......... .......... .......... .......... .......... 90% 319M 0s 2024-09-12T00:43:53.599 INFO:teuthology.orchestra.run.smithi043.stderr: 84200K .......... .......... .......... .......... .......... 90% 352M 0s 2024-09-12T00:43:53.599 INFO:teuthology.orchestra.run.smithi043.stderr: 84250K .......... .......... .......... .......... .......... 90% 361M 0s 2024-09-12T00:43:53.599 INFO:teuthology.orchestra.run.smithi043.stderr: 84300K .......... .......... .......... .......... .......... 90% 279M 0s 2024-09-12T00:43:53.599 INFO:teuthology.orchestra.run.smithi043.stderr: 84350K .......... .......... .......... .......... .......... 90% 313M 0s 2024-09-12T00:43:53.599 INFO:teuthology.orchestra.run.smithi043.stderr: 84400K .......... .......... .......... .......... .......... 90% 343M 0s 2024-09-12T00:43:53.599 INFO:teuthology.orchestra.run.smithi043.stderr: 84450K .......... .......... .......... .......... .......... 90% 313M 0s 2024-09-12T00:43:53.600 INFO:teuthology.orchestra.run.smithi043.stderr: 84500K .......... .......... .......... .......... .......... 91% 312M 0s 2024-09-12T00:43:53.600 INFO:teuthology.orchestra.run.smithi043.stderr: 84550K .......... .......... .......... .......... .......... 91% 320M 0s 2024-09-12T00:43:53.600 INFO:teuthology.orchestra.run.smithi043.stderr: 84600K .......... .......... .......... .......... .......... 91% 344M 0s 2024-09-12T00:43:53.600 INFO:teuthology.orchestra.run.smithi043.stderr: 84650K .......... .......... .......... .......... .......... 91% 279M 0s 2024-09-12T00:43:53.600 INFO:teuthology.orchestra.run.smithi043.stderr: 84700K .......... .......... .......... .......... .......... 91% 310M 0s 2024-09-12T00:43:53.600 INFO:teuthology.orchestra.run.smithi043.stderr: 84750K .......... .......... .......... .......... .......... 91% 354M 0s 2024-09-12T00:43:53.600 INFO:teuthology.orchestra.run.smithi043.stderr: 84800K .......... .......... .......... .......... .......... 91% 341M 0s 2024-09-12T00:43:53.600 INFO:teuthology.orchestra.run.smithi043.stderr: 84850K .......... .......... .......... .......... .......... 91% 362M 0s 2024-09-12T00:43:53.600 INFO:teuthology.orchestra.run.smithi043.stderr: 84900K .......... .......... .......... .......... .......... 91% 166M 0s 2024-09-12T00:43:53.600 INFO:teuthology.orchestra.run.smithi043.stderr: 84950K .......... .......... .......... .......... .......... 91% 351M 0s 2024-09-12T00:43:53.601 INFO:teuthology.orchestra.run.smithi043.stderr: 85000K .......... .......... .......... .......... .......... 91% 256M 0s 2024-09-12T00:43:53.601 INFO:teuthology.orchestra.run.smithi043.stderr: 85050K .......... .......... .......... .......... .......... 91% 352M 0s 2024-09-12T00:43:53.601 INFO:teuthology.orchestra.run.smithi043.stderr: 85100K .......... .......... .......... .......... .......... 91% 278M 0s 2024-09-12T00:43:53.601 INFO:teuthology.orchestra.run.smithi043.stderr: 85150K .......... .......... .......... .......... .......... 91% 360M 0s 2024-09-12T00:43:53.601 INFO:teuthology.orchestra.run.smithi043.stderr: 85200K .......... .......... .......... .......... .......... 91% 110M 0s 2024-09-12T00:43:53.601 INFO:teuthology.orchestra.run.smithi043.stderr: 85250K .......... .......... .......... .......... .......... 91% 300M 0s 2024-09-12T00:43:53.601 INFO:teuthology.orchestra.run.smithi043.stderr: 85300K .......... .......... .......... .......... .......... 91% 301M 0s 2024-09-12T00:43:53.601 INFO:teuthology.orchestra.run.smithi043.stderr: 85350K .......... .......... .......... .......... .......... 91% 322M 0s 2024-09-12T00:43:53.601 INFO:teuthology.orchestra.run.smithi043.stderr: 85400K .......... .......... .......... .......... .......... 91% 328M 0s 2024-09-12T00:43:53.601 INFO:teuthology.orchestra.run.smithi043.stderr: 85450K .......... .......... .......... .......... .......... 92% 360M 0s 2024-09-12T00:43:53.601 INFO:teuthology.orchestra.run.smithi043.stderr: 85500K .......... .......... .......... .......... .......... 92% 242M 0s 2024-09-12T00:43:53.601 INFO:teuthology.orchestra.run.smithi043.stderr: 85550K .......... .......... .......... .......... .......... 92% 318M 0s 2024-09-12T00:43:53.602 INFO:teuthology.orchestra.run.smithi043.stderr: 85600K .......... .......... .......... .......... .......... 92% 341M 0s 2024-09-12T00:43:53.602 INFO:teuthology.orchestra.run.smithi043.stderr: 85650K .......... .......... .......... .......... .......... 92% 366M 0s 2024-09-12T00:43:53.602 INFO:teuthology.orchestra.run.smithi043.stderr: 85700K .......... .......... .......... .......... .......... 92% 92.3M 0s 2024-09-12T00:43:53.602 INFO:teuthology.orchestra.run.smithi043.stderr: 85750K .......... .......... .......... .......... .......... 92% 70.1M 0s 2024-09-12T00:43:53.602 INFO:teuthology.orchestra.run.smithi043.stderr: 85800K .......... .......... .......... .......... .......... 92% 226M 0s 2024-09-12T00:43:53.602 INFO:teuthology.orchestra.run.smithi043.stderr: 85850K .......... .......... .......... .......... .......... 92% 345M 0s 2024-09-12T00:43:53.602 INFO:teuthology.orchestra.run.smithi043.stderr: 85900K .......... .......... .......... .......... .......... 92% 290M 0s 2024-09-12T00:43:53.602 INFO:teuthology.orchestra.run.smithi043.stderr: 85950K .......... .......... .......... .......... .......... 92% 360M 0s 2024-09-12T00:43:53.602 INFO:teuthology.orchestra.run.smithi043.stderr: 86000K .......... .......... .......... .......... .......... 92% 317M 0s 2024-09-12T00:43:53.602 INFO:teuthology.orchestra.run.smithi043.stderr: 86050K .......... .......... .......... .......... .......... 92% 354M 0s 2024-09-12T00:43:53.602 INFO:teuthology.orchestra.run.smithi043.stderr: 86100K .......... .......... .......... .......... .......... 92% 199M 0s 2024-09-12T00:43:53.603 INFO:teuthology.orchestra.run.smithi043.stderr: 86150K .......... .......... .......... .......... .......... 92% 317M 0s 2024-09-12T00:43:53.603 INFO:teuthology.orchestra.run.smithi043.stderr: 86200K .......... .......... .......... .......... .......... 92% 368M 0s 2024-09-12T00:43:53.603 INFO:teuthology.orchestra.run.smithi043.stderr: 86250K .......... .......... .......... .......... .......... 92% 314M 0s 2024-09-12T00:43:53.603 INFO:teuthology.orchestra.run.smithi043.stderr: 86300K .......... .......... .......... .......... .......... 92% 300M 0s 2024-09-12T00:43:53.603 INFO:teuthology.orchestra.run.smithi043.stderr: 86350K .......... .......... .......... .......... .......... 93% 372M 0s 2024-09-12T00:43:53.603 INFO:teuthology.orchestra.run.smithi043.stderr: 86400K .......... .......... .......... .......... .......... 93% 82.6M 0s 2024-09-12T00:43:53.603 INFO:teuthology.orchestra.run.smithi043.stderr: 86450K .......... .......... .......... .......... .......... 93% 322M 0s 2024-09-12T00:43:53.603 INFO:teuthology.orchestra.run.smithi043.stderr: 86500K .......... .......... .......... .......... .......... 93% 321M 0s 2024-09-12T00:43:53.603 INFO:teuthology.orchestra.run.smithi043.stderr: 86550K .......... .......... .......... .......... .......... 93% 172M 0s 2024-09-12T00:43:53.603 INFO:teuthology.orchestra.run.smithi043.stderr: 86600K .......... .......... .......... .......... .......... 93% 195M 0s 2024-09-12T00:43:53.603 INFO:teuthology.orchestra.run.smithi043.stderr: 86650K .......... .......... .......... .......... .......... 93% 145M 0s 2024-09-12T00:43:53.604 INFO:teuthology.orchestra.run.smithi043.stderr: 86700K .......... .......... .......... .......... .......... 93% 238M 0s 2024-09-12T00:43:53.604 INFO:teuthology.orchestra.run.smithi043.stderr: 86750K .......... .......... .......... .......... .......... 93% 323M 0s 2024-09-12T00:43:53.604 INFO:teuthology.orchestra.run.smithi043.stderr: 86800K .......... .......... .......... .......... .......... 93% 348M 0s 2024-09-12T00:43:53.604 INFO:teuthology.orchestra.run.smithi043.stderr: 86850K .......... .......... .......... .......... .......... 93% 184M 0s 2024-09-12T00:43:53.604 INFO:teuthology.orchestra.run.smithi043.stderr: 86900K .......... .......... .......... .......... .......... 93% 269M 0s 2024-09-12T00:43:53.604 INFO:teuthology.orchestra.run.smithi043.stderr: 86950K .......... .......... .......... .......... .......... 93% 349M 0s 2024-09-12T00:43:53.604 INFO:teuthology.orchestra.run.smithi043.stderr: 87000K .......... .......... .......... .......... .......... 93% 335M 0s 2024-09-12T00:43:53.604 INFO:teuthology.orchestra.run.smithi043.stderr: 87050K .......... .......... .......... .......... .......... 93% 75.9M 0s 2024-09-12T00:43:53.604 INFO:teuthology.orchestra.run.smithi043.stderr: 87100K .......... .......... .......... .......... .......... 93% 271M 0s 2024-09-12T00:43:53.604 INFO:teuthology.orchestra.run.smithi043.stderr: 87150K .......... .......... .......... .......... .......... 93% 309M 0s 2024-09-12T00:43:53.605 INFO:teuthology.orchestra.run.smithi043.stderr: 87200K .......... .......... .......... .......... .......... 93% 304M 0s 2024-09-12T00:43:53.605 INFO:teuthology.orchestra.run.smithi043.stderr: 87250K .......... .......... .......... .......... .......... 93% 346M 0s 2024-09-12T00:43:53.605 INFO:teuthology.orchestra.run.smithi043.stderr: 87300K .......... .......... .......... .......... .......... 94% 303M 0s 2024-09-12T00:43:53.605 INFO:teuthology.orchestra.run.smithi043.stderr: 87350K .......... .......... .......... .......... .......... 94% 364M 0s 2024-09-12T00:43:53.605 INFO:teuthology.orchestra.run.smithi043.stderr: 87400K .......... .......... .......... .......... .......... 94% 326M 0s 2024-09-12T00:43:53.605 INFO:teuthology.orchestra.run.smithi043.stderr: 87450K .......... .......... .......... .......... .......... 94% 364M 0s 2024-09-12T00:43:53.605 INFO:teuthology.orchestra.run.smithi043.stderr: 87500K .......... .......... .......... .......... .......... 94% 308M 0s 2024-09-12T00:43:53.605 INFO:teuthology.orchestra.run.smithi043.stderr: 87550K .......... .......... .......... .......... .......... 94% 341M 0s 2024-09-12T00:43:53.605 INFO:teuthology.orchestra.run.smithi043.stderr: 87600K .......... .......... .......... .......... .......... 94% 348M 0s 2024-09-12T00:43:53.605 INFO:teuthology.orchestra.run.smithi043.stderr: 87650K .......... .......... .......... .......... .......... 94% 323M 0s 2024-09-12T00:43:53.605 INFO:teuthology.orchestra.run.smithi043.stderr: 87700K .......... .......... .......... .......... .......... 94% 332M 0s 2024-09-12T00:43:53.605 INFO:teuthology.orchestra.run.smithi043.stderr: 87750K .......... .......... .......... .......... .......... 94% 375M 0s 2024-09-12T00:43:53.606 INFO:teuthology.orchestra.run.smithi043.stderr: 87800K .......... .......... .......... .......... .......... 94% 354M 0s 2024-09-12T00:43:53.606 INFO:teuthology.orchestra.run.smithi043.stderr: 87850K .......... .......... .......... .......... .......... 94% 326M 0s 2024-09-12T00:43:53.606 INFO:teuthology.orchestra.run.smithi043.stderr: 87900K .......... .......... .......... .......... .......... 94% 274M 0s 2024-09-12T00:43:53.606 INFO:teuthology.orchestra.run.smithi043.stderr: 87950K .......... .......... .......... .......... .......... 94% 365M 0s 2024-09-12T00:43:53.606 INFO:teuthology.orchestra.run.smithi043.stderr: 88000K .......... .......... .......... .......... .......... 94% 370M 0s 2024-09-12T00:43:53.606 INFO:teuthology.orchestra.run.smithi043.stderr: 88050K .......... .......... .......... .......... .......... 94% 354M 0s 2024-09-12T00:43:53.606 INFO:teuthology.orchestra.run.smithi043.stderr: 88100K .......... .......... .......... .......... .......... 94% 305M 0s 2024-09-12T00:43:53.606 INFO:teuthology.orchestra.run.smithi043.stderr: 88150K .......... .......... .......... .......... .......... 94% 371M 0s 2024-09-12T00:43:53.606 INFO:teuthology.orchestra.run.smithi043.stderr: 88200K .......... .......... .......... .......... .......... 94% 278M 0s 2024-09-12T00:43:53.606 INFO:teuthology.orchestra.run.smithi043.stderr: 88250K .......... .......... .......... .......... .......... 95% 121M 0s 2024-09-12T00:43:53.606 INFO:teuthology.orchestra.run.smithi043.stderr: 88300K .......... .......... .......... .......... .......... 95% 253M 0s 2024-09-12T00:43:53.607 INFO:teuthology.orchestra.run.smithi043.stderr: 88350K .......... .......... .......... .......... .......... 95% 336M 0s 2024-09-12T00:43:53.607 INFO:teuthology.orchestra.run.smithi043.stderr: 88400K .......... .......... .......... .......... .......... 95% 338M 0s 2024-09-12T00:43:53.607 INFO:teuthology.orchestra.run.smithi043.stderr: 88450K .......... .......... .......... .......... .......... 95% 266M 0s 2024-09-12T00:43:53.607 INFO:teuthology.orchestra.run.smithi043.stderr: 88500K .......... .......... .......... .......... .......... 95% 317M 0s 2024-09-12T00:43:53.607 INFO:teuthology.orchestra.run.smithi043.stderr: 88550K .......... .......... .......... .......... .......... 95% 357M 0s 2024-09-12T00:43:53.607 INFO:teuthology.orchestra.run.smithi043.stderr: 88600K .......... .......... .......... .......... .......... 95% 371M 0s 2024-09-12T00:43:53.607 INFO:teuthology.orchestra.run.smithi043.stderr: 88650K .......... .......... .......... .......... .......... 95% 81.6M 0s 2024-09-12T00:43:53.607 INFO:teuthology.orchestra.run.smithi043.stderr: 88700K .......... .......... .......... .......... .......... 95% 299M 0s 2024-09-12T00:43:53.607 INFO:teuthology.orchestra.run.smithi043.stderr: 88750K .......... .......... .......... .......... .......... 95% 106M 0s 2024-09-12T00:43:53.607 INFO:teuthology.orchestra.run.smithi043.stderr: 88800K .......... .......... .......... .......... .......... 95% 248M 0s 2024-09-12T00:43:53.607 INFO:teuthology.orchestra.run.smithi043.stderr: 88850K .......... .......... .......... .......... .......... 95% 337M 0s 2024-09-12T00:43:53.607 INFO:teuthology.orchestra.run.smithi043.stderr: 88900K .......... .......... .......... .......... .......... 95% 313M 0s 2024-09-12T00:43:53.608 INFO:teuthology.orchestra.run.smithi043.stderr: 88950K .......... .......... .......... .......... .......... 95% 186M 0s 2024-09-12T00:43:53.608 INFO:teuthology.orchestra.run.smithi043.stderr: 89000K .......... .......... .......... .......... .......... 95% 316M 0s 2024-09-12T00:43:53.608 INFO:teuthology.orchestra.run.smithi043.stderr: 89050K .......... .......... .......... .......... .......... 95% 309M 0s 2024-09-12T00:43:53.608 INFO:teuthology.orchestra.run.smithi043.stderr: 89100K .......... .......... .......... .......... .......... 95% 296M 0s 2024-09-12T00:43:53.608 INFO:teuthology.orchestra.run.smithi043.stderr: 89150K .......... .......... .......... .......... .......... 96% 337M 0s 2024-09-12T00:43:53.608 INFO:teuthology.orchestra.run.smithi043.stderr: 89200K .......... .......... .......... .......... .......... 96% 362M 0s 2024-09-12T00:43:53.608 INFO:teuthology.orchestra.run.smithi043.stderr: 89250K .......... .......... .......... .......... .......... 96% 361M 0s 2024-09-12T00:43:53.608 INFO:teuthology.orchestra.run.smithi043.stderr: 89300K .......... .......... .......... .......... .......... 96% 233M 0s 2024-09-12T00:43:53.608 INFO:teuthology.orchestra.run.smithi043.stderr: 89350K .......... .......... .......... .......... .......... 96% 66.4M 0s 2024-09-12T00:43:53.608 INFO:teuthology.orchestra.run.smithi043.stderr: 89400K .......... .......... .......... .......... .......... 96% 352M 0s 2024-09-12T00:43:53.608 INFO:teuthology.orchestra.run.smithi043.stderr: 89450K .......... .......... .......... .......... .......... 96% 342M 0s 2024-09-12T00:43:53.609 INFO:teuthology.orchestra.run.smithi043.stderr: 89500K .......... .......... .......... .......... .......... 96% 290M 0s 2024-09-12T00:43:53.609 INFO:teuthology.orchestra.run.smithi043.stderr: 89550K .......... .......... .......... .......... .......... 96% 325M 0s 2024-09-12T00:43:53.609 INFO:teuthology.orchestra.run.smithi043.stderr: 89600K .......... .......... .......... .......... .......... 96% 338M 0s 2024-09-12T00:43:53.609 INFO:teuthology.orchestra.run.smithi043.stderr: 89650K .......... .......... .......... .......... .......... 96% 161M 0s 2024-09-12T00:43:53.609 INFO:teuthology.orchestra.run.smithi043.stderr: 89700K .......... .......... .......... .......... .......... 96% 241M 0s 2024-09-12T00:43:53.609 INFO:teuthology.orchestra.run.smithi043.stderr: 89750K .......... .......... .......... .......... .......... 96% 334M 0s 2024-09-12T00:43:53.609 INFO:teuthology.orchestra.run.smithi043.stderr: 89800K .......... .......... .......... .......... .......... 96% 141M 0s 2024-09-12T00:43:53.609 INFO:teuthology.orchestra.run.smithi043.stderr: 89850K .......... .......... .......... .......... .......... 96% 331M 0s 2024-09-12T00:43:53.609 INFO:teuthology.orchestra.run.smithi043.stderr: 89900K .......... .......... .......... .......... .......... 96% 269M 0s 2024-09-12T00:43:53.609 INFO:teuthology.orchestra.run.smithi043.stderr: 89950K .......... .......... .......... .......... .......... 96% 325M 0s 2024-09-12T00:43:53.609 INFO:teuthology.orchestra.run.smithi043.stderr: 90000K .......... .......... .......... .......... .......... 96% 366M 0s 2024-09-12T00:43:53.610 INFO:teuthology.orchestra.run.smithi043.stderr: 90050K .......... .......... .......... .......... .......... 96% 142M 0s 2024-09-12T00:43:53.610 INFO:teuthology.orchestra.run.smithi043.stderr: 90100K .......... .......... .......... .......... .......... 97% 134M 0s 2024-09-12T00:43:53.610 INFO:teuthology.orchestra.run.smithi043.stderr: 90150K .......... .......... .......... .......... .......... 97% 291M 0s 2024-09-12T00:43:53.610 INFO:teuthology.orchestra.run.smithi043.stderr: 90200K .......... .......... .......... .......... .......... 97% 295M 0s 2024-09-12T00:43:53.610 INFO:teuthology.orchestra.run.smithi043.stderr: 90250K .......... .......... .......... .......... .......... 97% 318M 0s 2024-09-12T00:43:53.610 INFO:teuthology.orchestra.run.smithi043.stderr: 90300K .......... .......... .......... .......... .......... 97% 278M 0s 2024-09-12T00:43:53.610 INFO:teuthology.orchestra.run.smithi043.stderr: 90350K .......... .......... .......... .......... .......... 97% 327M 0s 2024-09-12T00:43:53.610 INFO:teuthology.orchestra.run.smithi043.stderr: 90400K .......... .......... .......... .......... .......... 97% 351M 0s 2024-09-12T00:43:53.610 INFO:teuthology.orchestra.run.smithi043.stderr: 90450K .......... .......... .......... .......... .......... 97% 373M 0s 2024-09-12T00:43:53.610 INFO:teuthology.orchestra.run.smithi043.stderr: 90500K .......... .......... .......... .......... .......... 97% 171M 0s 2024-09-12T00:43:53.610 INFO:teuthology.orchestra.run.smithi043.stderr: 90550K .......... .......... .......... .......... .......... 97% 302M 0s 2024-09-12T00:43:53.610 INFO:teuthology.orchestra.run.smithi043.stderr: 90600K .......... .......... .......... .......... .......... 97% 323M 0s 2024-09-12T00:43:53.611 INFO:teuthology.orchestra.run.smithi043.stderr: 90650K .......... .......... .......... .......... .......... 97% 326M 0s 2024-09-12T00:43:53.611 INFO:teuthology.orchestra.run.smithi043.stderr: 90700K .......... .......... .......... .......... .......... 97% 280M 0s 2024-09-12T00:43:53.611 INFO:teuthology.orchestra.run.smithi043.stderr: 90750K .......... .......... .......... .......... .......... 97% 344M 0s 2024-09-12T00:43:53.611 INFO:teuthology.orchestra.run.smithi043.stderr: 90800K .......... .......... .......... .......... .......... 97% 348M 0s 2024-09-12T00:43:53.611 INFO:teuthology.orchestra.run.smithi043.stderr: 90850K .......... .......... .......... .......... .......... 97% 355M 0s 2024-09-12T00:43:53.611 INFO:teuthology.orchestra.run.smithi043.stderr: 90900K .......... .......... .......... .......... .......... 97% 267M 0s 2024-09-12T00:43:53.611 INFO:teuthology.orchestra.run.smithi043.stderr: 90950K .......... .......... .......... .......... .......... 97% 346M 0s 2024-09-12T00:43:53.611 INFO:teuthology.orchestra.run.smithi043.stderr: 91000K .......... .......... .......... .......... .......... 98% 307M 0s 2024-09-12T00:43:53.611 INFO:teuthology.orchestra.run.smithi043.stderr: 91050K .......... .......... .......... .......... .......... 98% 341M 0s 2024-09-12T00:43:53.611 INFO:teuthology.orchestra.run.smithi043.stderr: 91100K .......... .......... .......... .......... .......... 98% 292M 0s 2024-09-12T00:43:53.611 INFO:teuthology.orchestra.run.smithi043.stderr: 91150K .......... .......... .......... .......... .......... 98% 314M 0s 2024-09-12T00:43:53.611 INFO:teuthology.orchestra.run.smithi043.stderr: 91200K .......... .......... .......... .......... .......... 98% 364M 0s 2024-09-12T00:43:53.612 INFO:teuthology.orchestra.run.smithi043.stderr: 91250K .......... .......... .......... .......... .......... 98% 358M 0s 2024-09-12T00:43:53.612 INFO:teuthology.orchestra.run.smithi043.stderr: 91300K .......... .......... .......... .......... .......... 98% 178M 0s 2024-09-12T00:43:53.612 INFO:teuthology.orchestra.run.smithi043.stderr: 91350K .......... .......... .......... .......... .......... 98% 170M 0s 2024-09-12T00:43:53.612 INFO:teuthology.orchestra.run.smithi043.stderr: 91400K .......... .......... .......... .......... .......... 98% 338M 0s 2024-09-12T00:43:53.612 INFO:teuthology.orchestra.run.smithi043.stderr: 91450K .......... .......... .......... .......... .......... 98% 356M 0s 2024-09-12T00:43:53.612 INFO:teuthology.orchestra.run.smithi043.stderr: 91500K .......... .......... .......... .......... .......... 98% 263M 0s 2024-09-12T00:43:53.612 INFO:teuthology.orchestra.run.smithi043.stderr: 91550K .......... .......... .......... .......... .......... 98% 91.8M 0s 2024-09-12T00:43:53.612 INFO:teuthology.orchestra.run.smithi043.stderr: 91600K .......... .......... .......... .......... .......... 98% 342M 0s 2024-09-12T00:43:53.612 INFO:teuthology.orchestra.run.smithi043.stderr: 91650K .......... .......... .......... .......... .......... 98% 333M 0s 2024-09-12T00:43:53.612 INFO:teuthology.orchestra.run.smithi043.stderr: 91700K .......... .......... .......... .......... .......... 98% 90.6M 0s 2024-09-12T00:43:53.612 INFO:teuthology.orchestra.run.smithi043.stderr: 91750K .......... .......... .......... .......... .......... 98% 345M 0s 2024-09-12T00:43:53.613 INFO:teuthology.orchestra.run.smithi043.stderr: 91800K .......... .......... .......... .......... .......... 98% 349M 0s 2024-09-12T00:43:53.613 INFO:teuthology.orchestra.run.smithi043.stderr: 91850K .......... .......... .......... .......... .......... 98% 368M 0s 2024-09-12T00:43:53.613 INFO:teuthology.orchestra.run.smithi043.stderr: 91900K .......... .......... .......... .......... .......... 98% 128M 0s 2024-09-12T00:43:53.613 INFO:teuthology.orchestra.run.smithi043.stderr: 91950K .......... .......... .......... .......... .......... 99% 331M 0s 2024-09-12T00:43:53.613 INFO:teuthology.orchestra.run.smithi043.stderr: 92000K .......... .......... .......... .......... .......... 99% 305M 0s 2024-09-12T00:43:53.613 INFO:teuthology.orchestra.run.smithi043.stderr: 92050K .......... .......... .......... .......... .......... 99% 364M 0s 2024-09-12T00:43:53.613 INFO:teuthology.orchestra.run.smithi043.stderr: 92100K .......... .......... .......... .......... .......... 99% 322M 0s 2024-09-12T00:43:53.613 INFO:teuthology.orchestra.run.smithi043.stderr: 92150K .......... .......... .......... .......... .......... 99% 340M 0s 2024-09-12T00:43:53.613 INFO:teuthology.orchestra.run.smithi043.stderr: 92200K .......... .......... .......... .......... .......... 99% 323M 0s 2024-09-12T00:43:53.613 INFO:teuthology.orchestra.run.smithi043.stderr: 92250K .......... .......... .......... .......... .......... 99% 360M 0s 2024-09-12T00:43:53.613 INFO:teuthology.orchestra.run.smithi043.stderr: 92300K .......... .......... .......... .......... .......... 99% 372M 0s 2024-09-12T00:43:53.614 INFO:teuthology.orchestra.run.smithi043.stderr: 92350K .......... .......... .......... .......... .......... 99% 99.4M 0s 2024-09-12T00:43:53.614 INFO:teuthology.orchestra.run.smithi043.stderr: 92400K .......... .......... .......... .......... .......... 99% 325M 0s 2024-09-12T00:43:53.614 INFO:teuthology.orchestra.run.smithi043.stderr: 92450K .......... .......... .......... .......... .......... 99% 193M 0s 2024-09-12T00:43:53.614 INFO:teuthology.orchestra.run.smithi043.stderr: 92500K .......... .......... .......... .......... .......... 99% 310M 0s 2024-09-12T00:43:53.614 INFO:teuthology.orchestra.run.smithi043.stderr: 92550K .......... .......... .......... .......... .......... 99% 313M 0s 2024-09-12T00:43:53.614 INFO:teuthology.orchestra.run.smithi043.stderr: 92600K .......... .......... .......... .......... .......... 99% 91.9M 0s 2024-09-12T00:43:53.614 INFO:teuthology.orchestra.run.smithi043.stderr: 92650K .......... .......... .......... .......... .......... 99% 241M 0s 2024-09-12T00:43:53.614 INFO:teuthology.orchestra.run.smithi043.stderr: 92700K .......... .......... .......... .......... .......... 99% 358M 0s 2024-09-12T00:43:53.614 INFO:teuthology.orchestra.run.smithi043.stderr: 92750K .......... .......... .......... .......... .......... 99% 234M 0s 2024-09-12T00:43:53.614 INFO:teuthology.orchestra.run.smithi043.stderr: 92800K .......... .......... .......... .......... .......... 99% 302M 0s 2024-09-12T00:43:53.614 INFO:teuthology.orchestra.run.smithi043.stderr: 92850K .......... .......... .......... .......... .......... 99% 319M 0s 2024-09-12T00:43:53.614 INFO:teuthology.orchestra.run.smithi043.stderr: 92900K 100% 134G=0.5s 2024-09-12T00:43:53.615 INFO:teuthology.orchestra.run.smithi043.stderr: 2024-09-12T00:43:53.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12 00:43:52 (192 MB/s) - 'gradle-6.0.1-bin.zip' saved [95129672/95129672] 2024-09-12T00:43:53.615 INFO:teuthology.orchestra.run.smithi043.stderr: 2024-09-12T00:43:53.647 INFO:teuthology.orchestra.run.smithi043.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-12T00:43:53.647 INFO:teuthology.orchestra.run.smithi043.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-12T00:43:53.647 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-12T00:43:53.647 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-12T00:43:53.647 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-12T00:43:53.647 INFO:teuthology.orchestra.run.smithi043.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-12T00:43:53.647 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-12T00:43:53.647 INFO:teuthology.orchestra.run.smithi043.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-12T00:43:53.647 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-12T00:43:53.647 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-12T00:43:53.648 INFO:teuthology.orchestra.run.smithi043.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-12T00:43:53.648 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-12T00:43:53.648 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-12T00:43:53.648 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-12T00:43:53.648 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-12T00:43:53.648 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-12T00:43:53.648 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-12T00:43:53.648 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-12T00:43:53.648 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-12T00:43:53.649 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-12T00:43:53.649 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-12T00:43:53.649 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-12T00:43:53.649 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-12T00:43:53.649 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-12T00:43:53.649 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-12T00:43:53.649 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-12T00:43:53.649 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-12T00:43:53.649 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-12T00:43:53.649 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-12T00:43:53.650 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-12T00:43:53.650 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-12T00:43:53.650 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-12T00:43:53.650 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-12T00:43:53.650 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-12T00:43:53.650 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-12T00:43:53.650 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-12T00:43:53.650 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-12T00:43:53.650 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-12T00:43:53.650 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-12T00:43:53.650 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-12T00:43:53.651 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-12T00:43:53.651 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-12T00:43:53.651 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-12T00:43:53.651 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-12T00:43:53.651 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-12T00:43:53.651 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-12T00:43:53.651 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-12T00:43:53.651 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-12T00:43:53.651 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-12T00:43:53.652 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-12T00:43:53.652 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-12T00:43:53.652 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-12T00:43:53.652 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-12T00:43:53.652 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-12T00:43:53.652 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-12T00:43:53.652 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-12T00:43:53.652 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-12T00:43:53.652 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-12T00:43:53.653 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-12T00:43:53.653 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-12T00:43:53.653 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-12T00:43:53.653 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-12T00:43:53.653 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-12T00:43:53.653 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-12T00:43:53.653 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-12T00:43:53.653 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-12T00:43:53.654 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-12T00:43:53.654 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-12T00:43:53.654 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-12T00:43:53.654 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-12T00:43:53.654 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-12T00:43:53.654 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-12T00:43:53.654 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-12T00:43:53.654 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-12T00:43:53.654 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-12T00:43:53.654 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-12T00:43:53.654 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-12T00:43:53.655 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-12T00:43:53.655 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-12T00:43:53.655 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-12T00:43:53.655 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-12T00:43:53.655 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-12T00:43:53.655 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-12T00:43:53.655 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-12T00:43:53.655 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-12T00:43:53.655 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-12T00:43:53.655 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-12T00:43:53.656 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-12T00:43:53.656 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-12T00:43:53.656 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-12T00:43:53.656 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-12T00:43:53.656 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-12T00:43:53.656 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-12T00:43:53.656 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-12T00:43:53.656 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-12T00:43:53.656 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-12T00:43:53.656 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-12T00:43:53.657 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-12T00:43:53.657 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-12T00:43:53.657 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-12T00:43:53.657 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-12T00:43:53.657 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-12T00:43:53.657 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-12T00:43:53.657 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-12T00:43:53.657 INFO:teuthology.orchestra.run.smithi043.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-12T00:43:53.657 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-12T00:43:53.657 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-12T00:43:53.657 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-12T00:43:53.658 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-12T00:43:53.658 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-12T00:43:53.658 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-12T00:43:53.658 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-12T00:43:53.658 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-12T00:43:53.658 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-12T00:43:53.658 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-12T00:43:53.658 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-12T00:43:53.658 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-12T00:43:53.658 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-12T00:43:53.658 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-12T00:43:53.659 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-12T00:43:53.659 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-12T00:43:53.659 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-12T00:43:53.659 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-12T00:43:53.659 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-12T00:43:53.659 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-12T00:43:53.659 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-12T00:43:53.659 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-12T00:43:53.659 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-12T00:43:53.659 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-12T00:43:53.659 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-12T00:43:53.659 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-12T00:43:53.660 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-12T00:43:53.660 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-12T00:43:53.660 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-12T00:43:53.660 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-12T00:43:53.660 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-12T00:43:53.660 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-12T00:43:53.660 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-12T00:43:53.660 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-12T00:43:53.660 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-12T00:43:53.660 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-12T00:43:53.661 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-12T00:43:53.661 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-12T00:43:53.661 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-12T00:43:53.661 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-12T00:43:53.661 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-12T00:43:53.661 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-12T00:43:53.661 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-12T00:43:53.661 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-12T00:43:53.661 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-12T00:43:53.661 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-12T00:43:53.661 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-12T00:43:53.661 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-12T00:43:53.662 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-12T00:43:53.662 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-12T00:43:53.662 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-12T00:43:53.662 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-12T00:43:53.662 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-12T00:43:53.662 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-12T00:43:53.662 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-12T00:43:53.662 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-12T00:43:53.662 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-12T00:43:53.662 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-12T00:43:53.662 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-12T00:43:53.663 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-12T00:43:53.663 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-12T00:43:53.663 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-12T00:43:53.663 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-12T00:43:53.663 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-12T00:43:53.663 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-12T00:43:53.663 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-12T00:43:53.663 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-12T00:43:53.663 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-12T00:43:53.663 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-12T00:43:53.663 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-12T00:43:53.664 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-12T00:43:53.664 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-12T00:43:53.664 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-12T00:43:53.664 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-12T00:43:53.664 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-12T00:43:53.664 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-12T00:43:53.664 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-12T00:43:53.664 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-12T00:43:53.664 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-12T00:43:53.664 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-12T00:43:53.665 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-12T00:43:53.665 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-12T00:43:53.665 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-12T00:43:53.665 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-12T00:43:53.665 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-12T00:43:53.665 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-12T00:43:53.665 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-12T00:43:53.665 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-12T00:43:53.665 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-12T00:43:53.666 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-12T00:43:53.666 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-12T00:43:53.666 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-12T00:43:53.666 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-12T00:43:53.666 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-12T00:43:53.666 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-12T00:43:53.666 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-12T00:43:53.666 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-12T00:43:53.666 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-12T00:43:53.667 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-12T00:43:53.667 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-12T00:43:53.667 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-12T00:43:53.667 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-12T00:43:53.667 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-12T00:43:53.667 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-12T00:43:53.667 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-12T00:43:53.667 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-12T00:43:53.667 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-12T00:43:53.667 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-12T00:43:53.668 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-12T00:43:53.668 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-12T00:43:53.668 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-12T00:43:53.668 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-12T00:43:53.668 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-12T00:43:53.668 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-12T00:43:53.668 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-12T00:43:53.668 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-12T00:43:53.668 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-12T00:43:53.668 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-12T00:43:53.668 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-12T00:43:53.669 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-12T00:43:53.669 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-12T00:43:53.669 INFO:teuthology.orchestra.run.smithi043.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-12T00:43:53.669 INFO:teuthology.orchestra.run.smithi043.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2024-09-12T00:43:53.832 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:43:53.833 INFO:teuthology.orchestra.run.smithi043.stdout:Welcome to Gradle 6.0.1! 2024-09-12T00:43:53.833 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:43:53.833 INFO:teuthology.orchestra.run.smithi043.stdout:Here are the highlights of this release: 2024-09-12T00:43:53.833 INFO:teuthology.orchestra.run.smithi043.stdout: - Substantial improvements in dependency management, including 2024-09-12T00:43:53.833 INFO:teuthology.orchestra.run.smithi043.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-12T00:43:53.833 INFO:teuthology.orchestra.run.smithi043.stdout: - Advanced control of transitive versions 2024-09-12T00:43:53.833 INFO:teuthology.orchestra.run.smithi043.stdout: - Support for optional features and dependencies 2024-09-12T00:43:53.833 INFO:teuthology.orchestra.run.smithi043.stdout: - Rules to tweak published metadata 2024-09-12T00:43:53.833 INFO:teuthology.orchestra.run.smithi043.stdout: - Support for Java 13 2024-09-12T00:43:53.833 INFO:teuthology.orchestra.run.smithi043.stdout: - Faster incremental Java and Groovy compilation 2024-09-12T00:43:53.834 INFO:teuthology.orchestra.run.smithi043.stdout: - New Zinc compiler for Scala 2024-09-12T00:43:53.834 INFO:teuthology.orchestra.run.smithi043.stdout: - VS2019 support 2024-09-12T00:43:53.834 INFO:teuthology.orchestra.run.smithi043.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-12T00:43:53.834 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:43:53.834 INFO:teuthology.orchestra.run.smithi043.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-12T00:43:53.834 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:43:53.834 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:43:53.834 INFO:teuthology.orchestra.run.smithi043.stdout:------------------------------------------------------------ 2024-09-12T00:43:53.834 INFO:teuthology.orchestra.run.smithi043.stdout:Gradle 6.0.1 2024-09-12T00:43:53.834 INFO:teuthology.orchestra.run.smithi043.stdout:------------------------------------------------------------ 2024-09-12T00:43:53.834 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:43:53.834 INFO:teuthology.orchestra.run.smithi043.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-12T00:43:53.834 INFO:teuthology.orchestra.run.smithi043.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-12T00:43:53.835 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:43:53.835 INFO:teuthology.orchestra.run.smithi043.stdout:Kotlin: 1.3.50 2024-09-12T00:43:53.835 INFO:teuthology.orchestra.run.smithi043.stdout:Groovy: 2.5.8 2024-09-12T00:43:53.835 INFO:teuthology.orchestra.run.smithi043.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-12T00:43:53.835 INFO:teuthology.orchestra.run.smithi043.stdout:JVM: 11.0.17 (Ubuntu 11.0.17+8-post-Ubuntu-1ubuntu222.04) 2024-09-12T00:43:53.835 INFO:teuthology.orchestra.run.smithi043.stdout:OS: Linux 5.15.0-119-generic amd64 2024-09-12T00:43:53.835 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:43:53.850 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-12T00:43:53.850 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T00:43:53.851 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi043.front.sepia.ceph.com 2024-09-12T00:43:53.851 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T00:43:53.851 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi097.front.sepia.ceph.com 2024-09-12T00:43:53.851 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-12T00:43:54.124 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-12T00:43:54.124 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-12T00:43:54.125 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'OCCDEZPMMJGJMBDHHFCX', 'access_secret': '8r/oLgOdkg7CvEzkx+LyH8FQGfTOUofRwIlpaGkiHABJ6zvexQ/97Q==', 'region': 'mexico', 'endpoint': 'smithi043.front.sepia.ceph.com:443', 'port': 443, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': True, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi043.front.sepia.ceph.com'} 2024-09-12T00:43:54.125 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-12T00:43:54.125 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'OCCDEZPMMJGJMBDHHFCX', '--secret', '8r/oLgOdkg7CvEzkx+LyH8FQGfTOUofRwIlpaGkiHABJ6zvexQ/97Q==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-12T00:43:54.125 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key OCCDEZPMMJGJMBDHHFCX --secret 8r/oLgOdkg7CvEzkx+LyH8FQGfTOUofRwIlpaGkiHABJ6zvexQ/97Q== --email tester.client.0_test@test.test --cluster ceph 2024-09-12T00:43:54.173 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:54.174 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:54.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.212+0000 7f80ce9509c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.212+0000 7f80ce9509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:54.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.212+0000 7f80ce9509c0 20 realm 2024-09-12T00:43:54.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.212+0000 7f80ce9509c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.212+0000 7f80ce9509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:54.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.212+0000 7f80ce9509c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:54.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.212+0000 7f80ce9509c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.212+0000 7f80ce9509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:54.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.212+0000 7f80ce9509c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.216+0000 7f80ce9509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:54.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.216+0000 7f80ce9509c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.216+0000 7f80ce9509c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:54.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.216+0000 7f80ce9509c0 20 searching for the correct realm 2024-09-12T00:43:54.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.224+0000 7f80ccc57640 0 -- 172.21.15.43:0/852663595 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f80c01311a0 msgr2=0x7f80c00db750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:54.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.440+0000 7f80cc456640 0 -- 172.21.15.43:0/852663595 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x56207a0b78f0 msgr2=0x56207a0b9d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:54.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.448+0000 7f80ce9509c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:43:54.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.448+0000 7f80ce9509c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:54.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.448+0000 7f80ce9509c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:54.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.448+0000 7f80ce9509c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:43:54.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.448+0000 7f80ce9509c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:54.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.448+0000 7f80ce9509c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:54.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.448+0000 7f80ce9509c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.448+0000 7f80ce9509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:54.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.448+0000 7f80ce9509c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.448+0000 7f80ce9509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:54.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.448+0000 7f80ce9509c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.452+0000 7f80ce9509c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:54.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.452+0000 7f80ce9509c0 20 zone default found 2024-09-12T00:43:54.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.452+0000 7f80ce9509c0 4 Realm: () 2024-09-12T00:43:54.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.452+0000 7f80ce9509c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:43:54.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.452+0000 7f80ce9509c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:43:54.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.452+0000 7f80ce9509c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:54.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.452+0000 7f80ce9509c0 20 zonegroup default 2024-09-12T00:43:54.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.452+0000 7f80ce9509c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.452+0000 7f80ce9509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:54.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.452+0000 7f80ce9509c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.452+0000 7f80ce9509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:54.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.452+0000 7f80ce9509c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.452+0000 7f80ce9509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:54.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.452+0000 7f80ce9509c0 20 started sync module instance, tier type = 2024-09-12T00:43:54.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.452+0000 7f80ce9509c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:43:54.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.472+0000 7f80ce9509c0 20 add_watcher() i=0 2024-09-12T00:43:54.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.472+0000 7f80ce9509c0 20 add_watcher() i=1 2024-09-12T00:43:54.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.472+0000 7f80ce9509c0 20 add_watcher() i=2 2024-09-12T00:43:54.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.472+0000 7f80ce9509c0 20 add_watcher() i=3 2024-09-12T00:43:54.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.472+0000 7f80ce9509c0 20 add_watcher() i=4 2024-09-12T00:43:54.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.472+0000 7f80ce9509c0 20 add_watcher() i=5 2024-09-12T00:43:54.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.472+0000 7f80ce9509c0 20 add_watcher() i=6 2024-09-12T00:43:54.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.476+0000 7f80ce9509c0 20 add_watcher() i=7 2024-09-12T00:43:54.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.476+0000 7f80ce9509c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:54.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.480+0000 7f7f82fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:54.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.480+0000 7f80ce9509c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:54.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.480+0000 7f80ce9509c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:54.483 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.480+0000 7f80ce9509c0 5 note: GC not initialized 2024-09-12T00:43:54.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.480+0000 7f7f81fdb640 20 reqs_thread_entry: start 2024-09-12T00:43:54.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.480+0000 7f80ce9509c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:54.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.480+0000 7f80ce9509c0 20 Filter name: none 2024-09-12T00:43:54.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.480+0000 7f7ef37fe640 20 reqs_thread_entry: start 2024-09-12T00:43:54.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.480+0000 7f80ce9509c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T00:43:54.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.480+0000 7f80ce9509c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.484+0000 7f80ce9509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:54.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.484+0000 7f80ce9509c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-12T00:43:54.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.484+0000 7f80ce9509c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:43:54.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.484+0000 7f80ce9509c0 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-12T00:43:54.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.484+0000 7f80ce9509c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.484+0000 7f80ce9509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:54.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.484+0000 7f80ce9509c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-12T00:43:54.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.484+0000 7f80ce9509c0 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:43:54.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.484+0000 7f80ce9509c0 10 cache get: name=default.rgw.meta+users.keys+OCCDEZPMMJGJMBDHHFCX : miss 2024-09-12T00:43:54.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.484+0000 7f80ce9509c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.484+0000 7f80ce9509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:54.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.484+0000 7f80ce9509c0 10 cache put: name=default.rgw.meta+users.keys+OCCDEZPMMJGJMBDHHFCX info.flags=0x0 2024-09-12T00:43:54.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.484+0000 7f80ce9509c0 10 adding default.rgw.meta+users.keys+OCCDEZPMMJGJMBDHHFCX to cache LRU end 2024-09-12T00:43:54.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.484+0000 7f80ce9509c0 10 cache get: name=default.rgw.meta+users.keys+OCCDEZPMMJGJMBDHHFCX : hit (negative entry) 2024-09-12T00:43:54.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.484+0000 7f80ce9509c0 10 cache get: name=default.rgw.meta+users.keys+OCCDEZPMMJGJMBDHHFCX : hit (negative entry) 2024-09-12T00:43:54.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.488+0000 7f80ce9509c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T00:43:54.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.488+0000 7f80ce9509c0 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:43:54.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.488+0000 7f80ce9509c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T00:43:54.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.488+0000 7f7fa37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333546 cookie 94697486570672 notifier 8694 bl.length()=670 2024-09-12T00:43:54.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.488+0000 7f7fa37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T00:43:54.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.488+0000 7f7fa37fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:43:54.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.492+0000 7f80ce9509c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T00:43:54.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.492+0000 7f80ce9509c0 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:43:54.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.492+0000 7f80ce9509c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T00:43:54.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.492+0000 7f7fa37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333490 cookie 94697486565024 notifier 8694 bl.length()=200 2024-09-12T00:43:54.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.492+0000 7f7fa37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T00:43:54.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.492+0000 7f7fa37fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:43:54.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.496+0000 7f80ce9509c0 10 cache put: name=default.rgw.meta+users.keys+OCCDEZPMMJGJMBDHHFCX info.flags=0x7 2024-09-12T00:43:54.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.496+0000 7f80ce9509c0 10 moving default.rgw.meta+users.keys+OCCDEZPMMJGJMBDHHFCX to cache LRU end 2024-09-12T00:43:54.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.496+0000 7f80ce9509c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:OCCDEZPMMJGJMBDHHFCX, ofs0, ns] 2024-09-12T00:43:54.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.496+0000 7f7fa37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333504 cookie 94697486573168 notifier 8694 bl.length()=189 2024-09-12T00:43:54.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.496+0000 7f7fa37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OCCDEZPMMJGJMBDHHFCX info.flags=0x7 2024-09-12T00:43:54.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.496+0000 7f7fa37fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OCCDEZPMMJGJMBDHHFCX to cache LRU end 2024-09-12T00:43:54.499 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T00:43:54.499 INFO:teuthology.orchestra.run.smithi043.stdout: "user_id": "tester.client.0", 2024-09-12T00:43:54.499 INFO:teuthology.orchestra.run.smithi043.stdout: "display_name": "Ms. tester.client.0", 2024-09-12T00:43:54.499 INFO:teuthology.orchestra.run.smithi043.stdout: "email": "tester.client.0_test@test.test", 2024-09-12T00:43:54.499 INFO:teuthology.orchestra.run.smithi043.stdout: "suspended": 0, 2024-09-12T00:43:54.499 INFO:teuthology.orchestra.run.smithi043.stdout: "max_buckets": 1000, 2024-09-12T00:43:54.499 INFO:teuthology.orchestra.run.smithi043.stdout: "subusers": [], 2024-09-12T00:43:54.500 INFO:teuthology.orchestra.run.smithi043.stdout: "keys": [ 2024-09-12T00:43:54.500 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T00:43:54.500 INFO:teuthology.orchestra.run.smithi043.stdout: "user": "tester.client.0", 2024-09-12T00:43:54.500 INFO:teuthology.orchestra.run.smithi043.stdout: "access_key": "OCCDEZPMMJGJMBDHHFCX", 2024-09-12T00:43:54.500 INFO:teuthology.orchestra.run.smithi043.stdout: "secret_key": "8r/oLgOdkg7CvEzkx+LyH8FQGfTOUofRwIlpaGkiHABJ6zvexQ/97Q==", 2024-09-12T00:43:54.500 INFO:teuthology.orchestra.run.smithi043.stdout: "active": true, 2024-09-12T00:43:54.500 INFO:teuthology.orchestra.run.smithi043.stdout: "create_date": "2024-09-12T00:43:54.490387Z" 2024-09-12T00:43:54.500 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T00:43:54.500 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-12T00:43:54.500 INFO:teuthology.orchestra.run.smithi043.stdout: "swift_keys": [], 2024-09-12T00:43:54.500 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": [], 2024-09-12T00:43:54.500 INFO:teuthology.orchestra.run.smithi043.stdout: "op_mask": "read, write, delete", 2024-09-12T00:43:54.500 INFO:teuthology.orchestra.run.smithi043.stdout: "default_placement": "", 2024-09-12T00:43:54.501 INFO:teuthology.orchestra.run.smithi043.stdout: "default_storage_class": "", 2024-09-12T00:43:54.501 INFO:teuthology.orchestra.run.smithi043.stdout: "placement_tags": [], 2024-09-12T00:43:54.501 INFO:teuthology.orchestra.run.smithi043.stdout: "bucket_quota": { 2024-09-12T00:43:54.501 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": false, 2024-09-12T00:43:54.501 INFO:teuthology.orchestra.run.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:43:54.501 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size": -1, 2024-09-12T00:43:54.501 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:43:54.501 INFO:teuthology.orchestra.run.smithi043.stdout: "max_objects": -1 2024-09-12T00:43:54.501 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T00:43:54.501 INFO:teuthology.orchestra.run.smithi043.stdout: "user_quota": { 2024-09-12T00:43:54.501 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": false, 2024-09-12T00:43:54.501 INFO:teuthology.orchestra.run.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:43:54.501 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size": -1, 2024-09-12T00:43:54.502 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:43:54.502 INFO:teuthology.orchestra.run.smithi043.stdout: "max_objects": -1 2024-09-12T00:43:54.502 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T00:43:54.502 INFO:teuthology.orchestra.run.smithi043.stdout: "temp_url_keys": [], 2024-09-12T00:43:54.502 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "rgw", 2024-09-12T00:43:54.502 INFO:teuthology.orchestra.run.smithi043.stdout: "mfa_ids": [], 2024-09-12T00:43:54.502 INFO:teuthology.orchestra.run.smithi043.stdout: "account_id": "", 2024-09-12T00:43:54.502 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-09-12T00:43:54.502 INFO:teuthology.orchestra.run.smithi043.stdout: "create_date": "2024-09-12T00:43:54.490337Z", 2024-09-12T00:43:54.502 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-09-12T00:43:54.502 INFO:teuthology.orchestra.run.smithi043.stdout: "group_ids": [] 2024-09-12T00:43:54.502 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T00:43:54.502 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:43:54.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.496+0000 7f7f82fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:54.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.508+0000 7f80ce9509c0 20 remove_watcher() i=0 2024-09-12T00:43:54.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.508+0000 7f80ce9509c0 2 removed watcher, disabling cache 2024-09-12T00:43:54.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.508+0000 7f80ce9509c0 20 remove_watcher() i=1 2024-09-12T00:43:54.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.512+0000 7f80ce9509c0 20 remove_watcher() i=2 2024-09-12T00:43:54.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.512+0000 7f80ce9509c0 20 remove_watcher() i=3 2024-09-12T00:43:54.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.516+0000 7f80ce9509c0 20 remove_watcher() i=4 2024-09-12T00:43:54.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.516+0000 7f80ce9509c0 20 remove_watcher() i=5 2024-09-12T00:43:54.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.520+0000 7f80ce9509c0 20 remove_watcher() i=6 2024-09-12T00:43:54.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.520+0000 7f80ce9509c0 20 remove_watcher() i=7 2024-09-12T00:43:54.544 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:43:54.544 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-12T00:43:54.551 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-12T00:43:54.552 DEBUG:teuthology.orchestra.run.smithi043:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-12T00:43:54.598 DEBUG:teuthology.orchestra.run.smithi043:> radosgw-admin gc process --include-all 2024-09-12T00:43:54.672 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:54.673 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:54.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.716+0000 7f08184c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.716+0000 7f08184c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:54.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.716+0000 7f08184c29c0 20 realm 2024-09-12T00:43:54.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.716+0000 7f08184c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.716+0000 7f08184c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:54.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.716+0000 7f08184c29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:54.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.716+0000 7f08184c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.716+0000 7f08184c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:54.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.716+0000 7f08184c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.720+0000 7f08184c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:54.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.720+0000 7f08184c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.720+0000 7f08184c29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:54.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.720+0000 7f08184c29c0 20 searching for the correct realm 2024-09-12T00:43:54.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.724+0000 7f08167c9640 0 -- 172.21.15.43:0/1694212349 >> [v2:172.21.15.43:6808/2258408181,v1:172.21.15.43:6809/2258408181] conn(0x556b8c784680 msgr2=0x556b8c786b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:54.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.732+0000 7f0815fc8640 0 -- 172.21.15.43:0/1694212349 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f080c06fb20 msgr2=0x7f080c07d1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:54.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.736+0000 7f08184c29c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:43:54.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.736+0000 7f08184c29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:54.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.736+0000 7f08184c29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:54.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.736+0000 7f08184c29c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:43:54.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.736+0000 7f08184c29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:54.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.736+0000 7f08184c29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:54.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.736+0000 7f08184c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.736+0000 7f08184c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:54.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.736+0000 7f08184c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.740+0000 7f08184c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:54.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.740+0000 7f08184c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.740+0000 7f08184c29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:54.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.740+0000 7f08184c29c0 20 zone default found 2024-09-12T00:43:54.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.740+0000 7f08184c29c0 4 Realm: () 2024-09-12T00:43:54.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.740+0000 7f08184c29c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:43:54.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.740+0000 7f08184c29c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:43:54.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.740+0000 7f08184c29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:54.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.740+0000 7f08184c29c0 20 zonegroup default 2024-09-12T00:43:54.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.740+0000 7f08184c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.740+0000 7f08184c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:54.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.740+0000 7f08184c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.740+0000 7f08184c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:54.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.740+0000 7f08184c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.740+0000 7f08184c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:54.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.740+0000 7f08184c29c0 20 started sync module instance, tier type = 2024-09-12T00:43:54.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.740+0000 7f08184c29c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:43:54.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.760+0000 7f08184c29c0 20 add_watcher() i=0 2024-09-12T00:43:54.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.760+0000 7f08184c29c0 20 add_watcher() i=1 2024-09-12T00:43:54.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.760+0000 7f08184c29c0 20 add_watcher() i=2 2024-09-12T00:43:54.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.760+0000 7f08184c29c0 20 add_watcher() i=3 2024-09-12T00:43:54.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.760+0000 7f08184c29c0 20 add_watcher() i=4 2024-09-12T00:43:54.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.760+0000 7f08184c29c0 20 add_watcher() i=5 2024-09-12T00:43:54.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.760+0000 7f08184c29c0 20 add_watcher() i=6 2024-09-12T00:43:54.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.764+0000 7f08184c29c0 20 add_watcher() i=7 2024-09-12T00:43:54.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.764+0000 7f08184c29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:54.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.764+0000 7f06c77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:54.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.764+0000 7f08184c29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:54.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.764+0000 7f08184c29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:54.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.840+0000 7f06c67fc640 20 reqs_thread_entry: start 2024-09-12T00:43:54.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.840+0000 7f08184c29c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:54.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.840+0000 7f08184c29c0 20 Filter name: none 2024-09-12T00:43:54.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.840+0000 7f0637fff640 20 reqs_thread_entry: start 2024-09-12T00:43:54.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.840+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:43:54.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.844+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:54.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.844+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:54.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.844+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T00:43:54.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.844+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14954424204415789423', time=2024-09-12T02:35:08.431718+0000, chain.objs.size()=7 2024-09-12T00:43:54.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.844+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9__multipart_foo.2~Aw7ggfrv6dSKY2rz2U8_4LhEUs0CHjl.1 2024-09-12T00:43:54.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.844+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9__shadow_foo.2~Aw7ggfrv6dSKY2rz2U8_4LhEUs0CHjl.1_1 2024-09-12T00:43:54.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.844+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9__multipart_foo.2~Aw7ggfrv6dSKY2rz2U8_4LhEUs0CHjl.2 2024-09-12T00:43:54.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.844+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9__shadow_foo.2~Aw7ggfrv6dSKY2rz2U8_4LhEUs0CHjl.2_1 2024-09-12T00:43:54.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.844+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9__multipart_foo.2~Aw7ggfrv6dSKY2rz2U8_4LhEUs0CHjl.3 2024-09-12T00:43:54.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.844+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9__shadow_foo.2~Aw7ggfrv6dSKY2rz2U8_4LhEUs0CHjl.3_1 2024-09-12T00:43:54.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.844+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9__multipart_foo.2~Aw7ggfrv6dSKY2rz2U8_4LhEUs0CHjl.4 2024-09-12T00:43:54.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.844+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18115602907625153674', time=2024-09-12T02:35:08.814815+0000, chain.objs.size()=5 2024-09-12T00:43:54.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.844+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14__multipart_foo-LUKEWARM.2~uJz645vOnV6b5lZgZr77No03RPpqHQh.1 2024-09-12T00:43:54.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.844+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14__shadow_foo-LUKEWARM.2~uJz645vOnV6b5lZgZr77No03RPpqHQh.1_1 2024-09-12T00:43:54.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.844+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14__multipart_foo-LUKEWARM.2~uJz645vOnV6b5lZgZr77No03RPpqHQh.2 2024-09-12T00:43:54.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.844+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14__shadow_foo-LUKEWARM.2~uJz645vOnV6b5lZgZr77No03RPpqHQh.2_1 2024-09-12T00:43:54.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.844+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14__multipart_foo-LUKEWARM.2~uJz645vOnV6b5lZgZr77No03RPpqHQh.3 2024-09-12T00:43:54.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.852+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15369329602787553205', time=2024-09-12T02:36:25.879677+0000, chain.objs.size()=1 2024-09-12T00:43:54.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.852+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19__shadow_.eZDjEFNmpIXTjLV1UxGWTpDugc5ys2d_0 2024-09-12T00:43:54.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.852+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11468235487570451220', time=2024-09-12T02:36:59.304461+0000, chain.objs.size()=1 2024-09-12T00:43:54.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.852+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21__shadow_._SGYOblFlSq8xgzzJLfz2GDXizXifsz_0 2024-09-12T00:43:54.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.856+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5216683090956856841', time=2024-09-12T02:37:33.984749+0000, chain.objs.size()=1 2024-09-12T00:43:54.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.856+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24__shadow_.CmC-P5fmIAz92n21NEZw0g2eMsXhNqw_0 2024-09-12T00:43:54.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.856+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8980029964348717845', time=2024-09-12T02:38:11.842862+0000, chain.objs.size()=1 2024-09-12T00:43:54.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.856+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28__shadow_.ZPL2oOSIeK6xGQbxRLJVtTB4EDo3qZs_0 2024-09-12T00:43:54.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.856+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11442529932916466892', time=2024-09-12T02:38:46.074022+0000, chain.objs.size()=1 2024-09-12T00:43:54.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.856+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30__shadow_.JReHLeg8JP4tEddwWEMc5_kWzGyx8ET_0 2024-09-12T00:43:54.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.856+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13586788794244014966', time=2024-09-12T02:39:55.557635+0000, chain.objs.size()=1 2024-09-12T00:43:54.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.856+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34__shadow_.KoQusxP_goO-SUlFOZoPYkZl13AZiei_0 2024-09-12T00:43:54.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.856+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17912289025932578089', time=2024-09-12T02:39:55.568316+0000, chain.objs.size()=1 2024-09-12T00:43:54.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.856+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34__shadow_.me7X9Sk9E_bYwjcHoFuuNqahAxammzU_0 2024-09-12T00:43:54.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.856+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.794490635598338737', time=2024-09-12T02:39:55.575775+0000, chain.objs.size()=1 2024-09-12T00:43:54.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.856+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34__shadow_.GsH_kRLT0HT128a13Co1arJuEgvaNcJ_0 2024-09-12T00:43:54.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.856+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2900106003666946151', time=2024-09-12T02:40:00.133974+0000, chain.objs.size()=1 2024-09-12T00:43:54.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.856+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36__shadow_.4HVbV36SdoLTOonolA3G54ByRqBgu8f_0 2024-09-12T00:43:54.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.856+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.222966293999322705', time=2024-09-12T02:41:06.324877+0000, chain.objs.size()=1 2024-09-12T00:43:54.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.856+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39__shadow_.3y2uIY5A6P-uDKY4IiH4Jw2uwAuBvTH_0 2024-09-12T00:43:54.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.860+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:54.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.864+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:43:54.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.864+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:54.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.864+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:54.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.864+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:43:54.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.864+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15967492463432406209', time=2024-09-12T02:35:08.218366+0000, chain.objs.size()=1 2024-09-12T00:43:54.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.868+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4__shadow_.BjYh_e6yPM7arlmrhLiygPByYLgCmlS_0 2024-09-12T00:43:54.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.868+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6583974935416124933', time=2024-09-12T02:36:27.221476+0000, chain.objs.size()=1 2024-09-12T00:43:54.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.868+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20__shadow_.SioUSJN_Mz1gPhwtNDHDyVpcgzdnYGT_0 2024-09-12T00:43:54.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.868+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10897226561112691971', time=2024-09-12T02:37:02.113913+0000, chain.objs.size()=1 2024-09-12T00:43:54.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.868+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23__shadow_.9mnM0pDQHwW6yQRrCQIIah0fk2ackiE_0 2024-09-12T00:43:54.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.868+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10097233855405894421', time=2024-09-12T02:37:33.979451+0000, chain.objs.size()=1 2024-09-12T00:43:54.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.868+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24__shadow_.pKJxbYSbSB5s19-WWpY1IzrpqrOdLWC_0 2024-09-12T00:43:54.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.868+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15165468282426965701', time=2024-09-12T02:37:33.991672+0000, chain.objs.size()=1 2024-09-12T00:43:54.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.868+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24__shadow_.gPQVmp6ouFYFbOgIK_1LrOiqSS8f8rb_0 2024-09-12T00:43:54.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.868+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11502862068346800572', time=2024-09-12T02:39:19.447993+0000, chain.objs.size()=1 2024-09-12T00:43:54.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.868+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32__shadow_.sOUOeBiyN7uyWe1kNxfMtRsYwTfV_HS_0 2024-09-12T00:43:54.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.868+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11068255341902971236', time=2024-09-12T02:39:55.562429+0000, chain.objs.size()=1 2024-09-12T00:43:54.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.868+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34__shadow_.APhtis9darNT4tRIQ5lz02jPIcAgPYC_0 2024-09-12T00:43:54.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.868+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4237589371448995504', time=2024-09-12T02:39:55.565364+0000, chain.objs.size()=1 2024-09-12T00:43:54.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.868+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34__shadow_.R2CiCzHvKLLTq7q76vTXWFVbodgmPM9_0 2024-09-12T00:43:54.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.868+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4132100101152828095', time=2024-09-12T02:39:55.575500+0000, chain.objs.size()=1 2024-09-12T00:43:54.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.868+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34__shadow_.QdejZOxjMAKqrd25HXpYbQuK7tu2Q7l_0 2024-09-12T00:43:54.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.868+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14767833424151858724', time=2024-09-12T02:40:31.263777+0000, chain.objs.size()=1 2024-09-12T00:43:54.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.868+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36__shadow_.RCsgxbuHpwYb1IcUa3ig5kF2W52PjYd_0 2024-09-12T00:43:54.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.868+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5987896260468550578', time=2024-09-12T02:40:31.273949+0000, chain.objs.size()=1 2024-09-12T00:43:54.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.868+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36__shadow_.5Ykxw5h4cL3bxe53Le0l1U9RLoUdhzW_0 2024-09-12T00:43:54.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.868+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2677576068874703940', time=2024-09-12T02:40:33.074595+0000, chain.objs.size()=1 2024-09-12T00:43:54.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.868+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37__shadow_.4e9pCRlwueKsyDKXyXPyCo8h1J1jlHt_0 2024-09-12T00:43:54.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.868+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4524413517730078542', time=2024-09-12T02:40:34.410233+0000, chain.objs.size()=1 2024-09-12T00:43:54.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.868+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38__shadow_.AuzcOvtqSEXJU4mGvhmAAY81N1CUf4Z_0 2024-09-12T00:43:54.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.868+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.806802017323593724', time=2024-09-12T02:41:06.312530+0000, chain.objs.size()=1 2024-09-12T00:43:54.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.868+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39__shadow_.8DcZcP-RevAnM52k-Oe1B7ADyqvqdD9_0 2024-09-12T00:43:54.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.872+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10229620637597565120', time=2024-09-12T02:43:15.509627+0000, chain.objs.size()=1 2024-09-12T00:43:54.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.872+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17__shadow_.RBd3rMzoDa1TJ-NaQCU-z6cKMlAhyRO_0 2024-09-12T00:43:54.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.876+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:54.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.880+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:43:54.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.884+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:54.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.884+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:54.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.884+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T00:43:54.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.884+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='_RZndSblRE-V1Y6v4HpJwZAiNceZoZYI', time=2024-09-12T02:35:08.582121+0000, chain.objs.size()=1 2024-09-12T00:43:54.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.884+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.1A45EF1K_FVEZwcoCOGm40QTisr6gb1_0 2024-09-12T00:43:54.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.884+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15206786092360202569', time=2024-09-12T02:36:59.312955+0000, chain.objs.size()=1 2024-09-12T00:43:54.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.884+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21__shadow_.A4G2v2ZnLiiJauFciQX8svZjmCEGOhf_0 2024-09-12T00:43:54.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.884+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7227716858930848000', time=2024-09-12T02:37:01.025848+0000, chain.objs.size()=1 2024-09-12T00:43:54.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.884+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22__shadow_.Xa5-p0XArOZSUvQb7sgJ4KThnAsJZH7_0 2024-09-12T00:43:54.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.884+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13340188007912718299', time=2024-09-12T02:37:02.101901+0000, chain.objs.size()=1 2024-09-12T00:43:54.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.884+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23__shadow_.IGs0Y6ZVnecq3ZDmLX05tMbPMtYs4J5_0 2024-09-12T00:43:54.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.884+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2442226797632523681', time=2024-09-12T02:37:33.996018+0000, chain.objs.size()=1 2024-09-12T00:43:54.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.884+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24__shadow_.RkPdb_nylZGyWnc3-xdWsgULEvGu7-V_0 2024-09-12T00:43:54.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.884+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4019655508536547783', time=2024-09-12T02:37:37.682611+0000, chain.objs.size()=1 2024-09-12T00:43:54.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.884+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26__shadow_.W6wL3TWZz168x-maNOfHYJCxi6-yCfs_0 2024-09-12T00:43:54.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.884+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7747124124070442997', time=2024-09-12T02:37:37.685949+0000, chain.objs.size()=1 2024-09-12T00:43:54.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.884+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26__shadow_.CHsH0koO_LU9kQa9Z9rC65qzcNkM7hF_0 2024-09-12T00:43:54.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.884+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15015567753564835494', time=2024-09-12T02:37:37.696946+0000, chain.objs.size()=1 2024-09-12T00:43:54.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.884+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26__shadow_.94-Q1yGtJ4wZMpzPV9-n8iBhfQT9ZlD_0 2024-09-12T00:43:54.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.884+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1282020640236702068', time=2024-09-12T02:38:46.071034+0000, chain.objs.size()=1 2024-09-12T00:43:54.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.884+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30__shadow_.L_90RLl69V8ihnYilQ0V-IkIQZYd3n6_0 2024-09-12T00:43:54.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.884+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17659334062788026321', time=2024-09-12T02:38:47.437750+0000, chain.objs.size()=1 2024-09-12T00:43:54.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.884+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31__shadow_.5W5YIohHOBrlobPYTB1rjRzhRmpu_iA_0 2024-09-12T00:43:54.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.884+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2148740641085716645', time=2024-09-12T02:39:55.584509+0000, chain.objs.size()=1 2024-09-12T00:43:54.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.884+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34__shadow_.MMP_tCYkwEqWwV5TLpnfctBlVthHhoT_0 2024-09-12T00:43:54.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.884+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15457675273886357898', time=2024-09-12T02:39:57.980865+0000, chain.objs.size()=1 2024-09-12T00:43:54.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.884+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35__shadow_.KiRktwuTQLhYjdHZ2eWXMdpnJ9_1xBU_0 2024-09-12T00:43:54.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.888+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11450632999738755587', time=2024-09-12T02:40:33.070957+0000, chain.objs.size()=1 2024-09-12T00:43:54.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.888+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37__shadow_.gqTotdAL-WG8H7RL50hPOieEQTaC0wD_0 2024-09-12T00:43:54.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.888+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12999628665055782420', time=2024-09-12T02:40:33.072661+0000, chain.objs.size()=1 2024-09-12T00:43:54.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.888+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37__shadow_.CrqB3RLBbHUnQ7W6eoo9EiJibZOU2f9_0 2024-09-12T00:43:54.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.892+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:54.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.896+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:43:54.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.900+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:54.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.900+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:54.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.900+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T00:43:54.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.900+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9790285720751071828', time=2024-09-12T02:36:27.205204+0000, chain.objs.size()=1 2024-09-12T00:43:54.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.900+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20__shadow_.qrCEkcnQlJ1w1q1zJVkjRYNlsVqSIzg_0 2024-09-12T00:43:54.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.904+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5452286289095117985', time=2024-09-12T02:37:03.337925+0000, chain.objs.size()=1 2024-09-12T00:43:54.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.904+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24__shadow_.PcmhU-tQ2hTujaNtgI7CbMkxhdXSdO__0 2024-09-12T00:43:54.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.904+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13833257983895035440', time=2024-09-12T02:37:37.706095+0000, chain.objs.size()=1 2024-09-12T00:43:54.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.904+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26__shadow_.FYmvWbBu6g0t_rzh_3tYbFEDxr5CuzD_0 2024-09-12T00:43:54.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.904+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1684755238705365602', time=2024-09-12T02:38:10.068418+0000, chain.objs.size()=1 2024-09-12T00:43:54.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.904+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27__shadow_.P2zVw2BE2_XgPZdtWlZ598nh93-L6U9_0 2024-09-12T00:43:54.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.904+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11120195314000016555', time=2024-09-12T02:38:10.070277+0000, chain.objs.size()=1 2024-09-12T00:43:54.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.904+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27__shadow_.V2KzrjqzdfuvpCms2vb-c-SIN7VwPEk_0 2024-09-12T00:43:54.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.904+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2781889082305181076', time=2024-09-12T02:38:10.074921+0000, chain.objs.size()=1 2024-09-12T00:43:54.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.904+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27__shadow_.dGXWLCbFOzJxaOk7eqIkBq494vhPgBx_0 2024-09-12T00:43:54.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.904+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8959384036727328487', time=2024-09-12T02:38:43.785806+0000, chain.objs.size()=1 2024-09-12T00:43:54.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.904+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29__shadow_.ISwdXsGdk36S-G1HA6c4SAvj-ay9vtZ_0 2024-09-12T00:43:54.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.904+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13671802622684789393', time=2024-09-12T02:39:21.920197+0000, chain.objs.size()=1 2024-09-12T00:43:54.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.904+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33__shadow_.zgDsAD5v6RXyA4diy8FAglJnrHjEgKS_0 2024-09-12T00:43:54.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.904+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4367121921525901302', time=2024-09-12T02:39:55.568584+0000, chain.objs.size()=1 2024-09-12T00:43:54.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.904+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34__shadow_.M0WwjaprM4yboMjmLN6UdJ-2m2TD-8T_0 2024-09-12T00:43:54.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.904+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4334630042099986518', time=2024-09-12T02:40:34.411736+0000, chain.objs.size()=1 2024-09-12T00:43:54.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.904+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38__shadow_.NlSZFY-TaMXITOodk_m-qF86r8XiHn3_0 2024-09-12T00:43:54.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.904+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17834629198976031915', time=2024-09-12T02:43:28.667998+0000, chain.objs.size()=1 2024-09-12T00:43:54.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.904+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18__shadow:FEtQz68NpftTUbbqtlMLQjnT.nehha6_.uNWeV2qMrbLqKC_g0mcuFwla3GxUwuz_0 2024-09-12T00:43:54.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.908+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:54.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.912+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:43:54.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.916+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:54.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.916+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:54.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.916+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T00:43:54.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.916+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15160258414115161592', time=2024-09-12T02:35:08.178348+0000, chain.objs.size()=1 2024-09-12T00:43:54.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.916+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4__shadow_.Ykfalf48tfMKxDOqzf1X0P8onhHSSje_0 2024-09-12T00:43:54.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.916+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7705214658434883746', time=2024-09-12T02:35:08.561597+0000, chain.objs.size()=1 2024-09-12T00:43:54.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.916+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.RUgoiCCOpjQyf-xh9hXB5YFtkU8KlGO_0 2024-09-12T00:43:54.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.916+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10616644943096295758', time=2024-09-12T02:35:08.589668+0000, chain.objs.size()=2 2024-09-12T00:43:54.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.916+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.tCBhBNlpepoDcbgZ3JBaCS2QGmzUilW_0 2024-09-12T00:43:54.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.916+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.tCBhBNlpepoDcbgZ3JBaCS2QGmzUilW_1 2024-09-12T00:43:54.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.916+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='_d7xCprjA_tQPtuEP90fv8OZUjE4eNvs', time=2024-09-12T02:35:08.676212+0000, chain.objs.size()=3 2024-09-12T00:43:54.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.916+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_.7kgpzEcNKXJD0h9k5wMXYNkXLpknbdS_0 2024-09-12T00:43:54.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.916+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_.7kgpzEcNKXJD0h9k5wMXYNkXLpknbdS_1 2024-09-12T00:43:54.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.916+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_.7kgpzEcNKXJD0h9k5wMXYNkXLpknbdS_2 2024-09-12T00:43:54.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.916+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3401684707159640040', time=2024-09-12T02:35:09.144198+0000, chain.objs.size()=1 2024-09-12T00:43:54.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.916+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8__shadow_.af8Dw25W6IGdj_IxTUg1z66_Xyxt7d-_0 2024-09-12T00:43:54.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.916+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8701766590251490010', time=2024-09-12T02:35:09.153991+0000, chain.objs.size()=1 2024-09-12T00:43:54.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.916+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8__shadow_.i7UJRciKOHV8B6iLW9rGGeC1xWJquJY_0 2024-09-12T00:43:54.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.916+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6736316946805936635', time=2024-09-12T02:36:25.887091+0000, chain.objs.size()=1 2024-09-12T00:43:54.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.916+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19__shadow_.3IiFTOOkSWqxeSWICdEf7x6EDKFeVmf_0 2024-09-12T00:43:54.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.916+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14613774400249754566', time=2024-09-12T02:36:27.218057+0000, chain.objs.size()=1 2024-09-12T00:43:54.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.916+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20__shadow_.1jARbmlqNjn1PfdflSlg-RrLUzo5FFO_0 2024-09-12T00:43:54.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.916+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1683369063670377773', time=2024-09-12T02:36:59.301299+0000, chain.objs.size()=1 2024-09-12T00:43:54.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.916+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21__shadow_.qLKSrAUj-kwiHY0XO35E4XOzI2WVpTt_0 2024-09-12T00:43:54.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.920+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14880766433533700703', time=2024-09-12T02:37:00.574057+0000, chain.objs.size()=1 2024-09-12T00:43:54.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.920+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22__shadow_.jn_rLQdgXHS_XpIVlztRBvlEvleKUdG_0 2024-09-12T00:43:54.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.924+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7080262938679963793', time=2024-09-12T02:37:01.026982+0000, chain.objs.size()=1 2024-09-12T00:43:54.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.924+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22__shadow_.vTwSud4GHo4XOPn1RhE5ptClHBtuu15_0 2024-09-12T00:43:54.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.924+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11078977577587906293', time=2024-09-12T02:37:01.048098+0000, chain.objs.size()=1 2024-09-12T00:43:54.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.924+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22__shadow_.2CmcYPn8Th0mmT-khwRmyxBVwVOZV9B_0 2024-09-12T00:43:54.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.924+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17095810369419677702', time=2024-09-12T02:37:35.992682+0000, chain.objs.size()=1 2024-09-12T00:43:54.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.924+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25__shadow_.oFV0exuZe16gPo8sFQnnoXphgSD6HqI_0 2024-09-12T00:43:54.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.924+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1829498865206881298', time=2024-09-12T02:38:10.070457+0000, chain.objs.size()=1 2024-09-12T00:43:54.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.924+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27__shadow_.wetUwIarjPM6HChV8qlBGMZgm_CIsxJ_0 2024-09-12T00:43:54.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.924+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10154134523484682712', time=2024-09-12T02:38:11.844087+0000, chain.objs.size()=1 2024-09-12T00:43:54.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.924+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28__shadow_.LaEPgSYQFU8hKb1dSpIiar740lIh1n1_0 2024-09-12T00:43:54.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.924+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16903037442161297179', time=2024-09-12T02:38:13.133334+0000, chain.objs.size()=1 2024-09-12T00:43:54.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.924+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29__shadow_.nqBC_g1aAcqqxj_o_8_OXUN2pKaoDlZ_0 2024-09-12T00:43:54.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.924+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13702006514325434922', time=2024-09-12T02:38:43.790283+0000, chain.objs.size()=1 2024-09-12T00:43:54.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.924+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29__shadow_.YoszkA8aRwfYMu7AM928IsUZaQ149AR_0 2024-09-12T00:43:54.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.924+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2093694702575804859', time=2024-09-12T02:38:46.076625+0000, chain.objs.size()=1 2024-09-12T00:43:54.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.924+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30__shadow_.g6bhNQ6Q-HEapWgaoMNyXnw98BTjDHL_0 2024-09-12T00:43:54.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.924+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7866908886120533789', time=2024-09-12T02:39:57.986000+0000, chain.objs.size()=1 2024-09-12T00:43:54.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.924+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35__shadow_.K4miGRlgomhHDblRxZ7nVVRN9Gpt6er_0 2024-09-12T00:43:54.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.924+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5760686597916367262', time=2024-09-12T02:40:31.273536+0000, chain.objs.size()=1 2024-09-12T00:43:54.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.924+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36__shadow_.1eBHwKEg3cF79qfyMEMIiGyfsp8DNNI_0 2024-09-12T00:43:54.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.928+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17076866627967470094', time=2024-09-12T02:40:33.059750+0000, chain.objs.size()=1 2024-09-12T00:43:54.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.928+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37__shadow_.9qZr32cqDCO8CKRy3fkNIeF_rOa148U_0 2024-09-12T00:43:54.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.928+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6563636890639714891', time=2024-09-12T02:41:06.325346+0000, chain.objs.size()=1 2024-09-12T00:43:54.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.928+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39__shadow_.w6_uLfdLNxvQbFJrRtJSyYqFIf1ZSNq_0 2024-09-12T00:43:54.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.932+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:54.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.936+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:43:54.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.936+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:54.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.940+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:54.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.940+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-12T00:43:54.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.940+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.582393608049982993', time=2024-09-12T02:36:25.898521+0000, chain.objs.size()=1 2024-09-12T00:43:54.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.940+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19__shadow_.dJUOU_IfUV8f7CUylo2f6h5K8zgUJ7o_0 2024-09-12T00:43:54.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.940+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16348188965570945039', time=2024-09-12T02:36:27.208706+0000, chain.objs.size()=1 2024-09-12T00:43:54.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.940+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20__shadow_.q1Y7WPxp5JnJN6QcGyvElax2Stj6n3f_0 2024-09-12T00:43:54.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.940+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17872109945294615319', time=2024-09-12T02:36:59.304782+0000, chain.objs.size()=1 2024-09-12T00:43:54.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.940+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21__shadow_.yEz8IcMCeJorzvVXYudCQFt6MoTQU9p_0 2024-09-12T00:43:54.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.940+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15542183653735477915', time=2024-09-12T02:37:02.099309+0000, chain.objs.size()=1 2024-09-12T00:43:54.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.940+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23__shadow_.qWHYLLENxz1d-xu3K7y56Y3JpeARzu4_0 2024-09-12T00:43:54.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.940+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2480397950314293832', time=2024-09-12T02:37:33.996599+0000, chain.objs.size()=1 2024-09-12T00:43:54.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.940+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24__shadow_.q71Z_JXRQgnLlngOvG2yc9i74_gck1v_0 2024-09-12T00:43:54.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.940+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3998976801468260639', time=2024-09-12T02:37:37.683592+0000, chain.objs.size()=1 2024-09-12T00:43:54.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.940+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26__shadow_.oGhzk3uQWWHHKYtmQwsr56HUkDjOXBe_0 2024-09-12T00:43:54.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.940+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2235832470422465081', time=2024-09-12T02:38:10.085934+0000, chain.objs.size()=1 2024-09-12T00:43:54.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.940+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27__shadow_.RXb7qRVfKcO0pDXdc870RdulaaMJzap_0 2024-09-12T00:43:54.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.940+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6615660224409361570', time=2024-09-12T02:38:11.855549+0000, chain.objs.size()=1 2024-09-12T00:43:54.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.940+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28__shadow_.pce2KSfEBVtCtC92yZmEzWvgrsm_VFD_0 2024-09-12T00:43:54.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.940+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8481195751402622845', time=2024-09-12T02:38:11.857571+0000, chain.objs.size()=1 2024-09-12T00:43:54.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.940+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28__shadow_.DGgoc_tb1d-5Ulswq1_o3V0VSvkdyGq_0 2024-09-12T00:43:54.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.940+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5691194810408315298', time=2024-09-12T02:38:11.863642+0000, chain.objs.size()=1 2024-09-12T00:43:54.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.940+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28__shadow_.CjSPxY3kKyphr9cdcmzFLPn0qIJxLwq_0 2024-09-12T00:43:54.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.940+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16172441945895101020', time=2024-09-12T02:38:47.440695+0000, chain.objs.size()=1 2024-09-12T00:43:54.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.940+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31__shadow_.e0S7ndJ-dPyapAuOSQ8ZQwK7qoyNWdn_0 2024-09-12T00:43:54.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.940+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7424743492809303488', time=2024-09-12T02:39:19.461365+0000, chain.objs.size()=1 2024-09-12T00:43:54.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.940+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32__shadow_.z1W4OgFdSAkLKRpbdEHzRhtPp_cyiVD_0 2024-09-12T00:43:54.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.944+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18183218838454889325', time=2024-09-12T02:39:21.916458+0000, chain.objs.size()=1 2024-09-12T00:43:54.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.944+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33__shadow_.X9DCD4KJoK_62mJfQCv7r9iCO3SREor_0 2024-09-12T00:43:54.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.944+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13620605483879473104', time=2024-09-12T02:39:21.926805+0000, chain.objs.size()=1 2024-09-12T00:43:54.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.944+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33__shadow_.wUg79Z-zDxFMW4gyL6rucd96v2VDPnh_0 2024-09-12T00:43:54.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.944+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3890018596380110738', time=2024-09-12T02:39:56.843942+0000, chain.objs.size()=1 2024-09-12T00:43:54.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.944+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35__shadow_.dGCipi4qMBW2_Orm859WljT0YcWG-1q_0 2024-09-12T00:43:54.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.944+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4539583944118613603', time=2024-09-12T02:39:57.989395+0000, chain.objs.size()=1 2024-09-12T00:43:54.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.944+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35__shadow_.78n0MaFWpQzQ9jLsFmZoMGuJ1BN4GOI_0 2024-09-12T00:43:54.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.944+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12316484461209507520', time=2024-09-12T02:39:57.991365+0000, chain.objs.size()=1 2024-09-12T00:43:54.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.944+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35__shadow_.vTR5okpuzlTXGADHXoNrfGOip9n77fZ_0 2024-09-12T00:43:54.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.944+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11990262870767892805', time=2024-09-12T02:40:31.274353+0000, chain.objs.size()=1 2024-09-12T00:43:54.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.944+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36__shadow_.FYAhq3wNxXrTFuBOcX7ZbQaLfU9ETmB_0 2024-09-12T00:43:54.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.944+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15283805109476524031', time=2024-09-12T02:40:33.083310+0000, chain.objs.size()=1 2024-09-12T00:43:54.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.944+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37__shadow_.gK10sMgMa1qkC71XQyDsxLZR2geOzhJ_0 2024-09-12T00:43:54.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.944+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.360912377186524667', time=2024-09-12T02:43:15.510669+0000, chain.objs.size()=1 2024-09-12T00:43:54.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.944+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17__shadow_.nIV88xPE_q5EgV4xAXMwbLMUrM2fbdU_0 2024-09-12T00:43:54.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.944+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16541357168205239713', time=2024-09-12T02:43:15.513784+0000, chain.objs.size()=1 2024-09-12T00:43:54.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.944+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17__shadow_.2OvVoOfkF9ZngXlChbNzRScUqpz5Ocl_0 2024-09-12T00:43:54.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.952+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:54.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.956+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:43:54.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.956+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:54.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.956+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:54.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.956+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T00:43:54.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.956+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2352214303254513595', time=2024-09-12T02:35:08.706860+0000, chain.objs.size()=5 2024-09-12T00:43:54.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.956+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-LUKEWARM.2~I6VWkIEcOnMRv2E23H5sn0xUFVOs3rD.1 2024-09-12T00:43:54.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.956+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_foo-LUKEWARM.2~I6VWkIEcOnMRv2E23H5sn0xUFVOs3rD.1_1 2024-09-12T00:43:54.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.956+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-LUKEWARM.2~I6VWkIEcOnMRv2E23H5sn0xUFVOs3rD.2 2024-09-12T00:43:54.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.956+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_foo-LUKEWARM.2~I6VWkIEcOnMRv2E23H5sn0xUFVOs3rD.2_1 2024-09-12T00:43:54.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.956+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-LUKEWARM.2~I6VWkIEcOnMRv2E23H5sn0xUFVOs3rD.3 2024-09-12T00:43:54.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.956+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17914431900669736775', time=2024-09-12T02:35:08.716738+0000, chain.objs.size()=3 2024-09-12T00:43:54.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.956+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-STANDARD.2~pkEBWl0mZWzQQaTpir-Pl3XhXNx1pS9.1 2024-09-12T00:43:54.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.956+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-STANDARD.2~pkEBWl0mZWzQQaTpir-Pl3XhXNx1pS9.2 2024-09-12T00:43:54.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.956+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-STANDARD.2~pkEBWl0mZWzQQaTpir-Pl3XhXNx1pS9.3 2024-09-12T00:43:54.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.956+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8535306507152714038', time=2024-09-12T02:36:25.895646+0000, chain.objs.size()=1 2024-09-12T00:43:54.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.956+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19__shadow_.g5bZxQx-R7US6ogwaiDRIW6ks7sSTGA_0 2024-09-12T00:43:54.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.956+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2856881236953832624', time=2024-09-12T02:37:01.034889+0000, chain.objs.size()=1 2024-09-12T00:43:54.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.956+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22__shadow_.SimNxT7hsaY3FeOTEQuh673hoVCmoyp_0 2024-09-12T00:43:54.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.956+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4038578698409420181', time=2024-09-12T02:37:02.104215+0000, chain.objs.size()=1 2024-09-12T00:43:54.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.956+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23__shadow_.g0oN-rJSTNU3zXty2eHDU3HexVXT3bx_0 2024-09-12T00:43:54.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.956+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17341720676372772220', time=2024-09-12T02:37:33.988898+0000, chain.objs.size()=1 2024-09-12T00:43:54.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.956+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24__shadow_.p6l-2r1e7vA_3VRHcHPrCCAzrVJbHu3_0 2024-09-12T00:43:54.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.964+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10201324482279460689', time=2024-09-12T02:37:33.989917+0000, chain.objs.size()=1 2024-09-12T00:43:54.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.964+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24__shadow_.BPrLZgCCUXxTqn-29ojiBbDzkNA8Xxq_0 2024-09-12T00:43:54.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.964+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17083289986507818590', time=2024-09-12T02:37:35.989496+0000, chain.objs.size()=1 2024-09-12T00:43:54.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.964+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25__shadow_.HyfAk9UvEkPC6RNjldfwYgEmeuLnoU3_0 2024-09-12T00:43:54.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.964+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12451920949597176992', time=2024-09-12T02:37:36.000761+0000, chain.objs.size()=1 2024-09-12T00:43:54.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.964+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25__shadow_.Wfv9YSuyGxqDBbaCugEuXQUtnUaYBnT_0 2024-09-12T00:43:54.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.964+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8859539922347319634', time=2024-09-12T02:37:36.010973+0000, chain.objs.size()=1 2024-09-12T00:43:54.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.964+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25__shadow_.bM1qtP1zQpZT3HCcmd66wMxgK8sfbnN_0 2024-09-12T00:43:54.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.964+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7924869055760366843', time=2024-09-12T02:37:37.681172+0000, chain.objs.size()=1 2024-09-12T00:43:54.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.964+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26__shadow_.uWJ6qhlMtFaSnx4qfpFGU70mZf6AHqo_0 2024-09-12T00:43:54.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.964+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5810214619911977548', time=2024-09-12T02:38:43.787819+0000, chain.objs.size()=1 2024-09-12T00:43:54.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.964+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29__shadow_.bvdHD3Yf0Rb1Dy7JJ7kK7ANPjcdOBEt_0 2024-09-12T00:43:54.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.964+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4088764519121338862', time=2024-09-12T02:38:47.439053+0000, chain.objs.size()=1 2024-09-12T00:43:54.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.964+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31__shadow_.EI12buzsWIIIRxMHl4A241M2iB1N4Fr_0 2024-09-12T00:43:54.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.964+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11835521598856839653', time=2024-09-12T02:39:21.916638+0000, chain.objs.size()=1 2024-09-12T00:43:54.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.964+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33__shadow_.bBfFhSux8ZpHHJYg3pX6nW5pR0IDEH-_0 2024-09-12T00:43:54.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.964+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14165229309229885712', time=2024-09-12T02:39:21.917534+0000, chain.objs.size()=1 2024-09-12T00:43:54.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.964+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33__shadow_.bpV9fGX_qHEqZQDLtBpeoQvh3w1q51I_0 2024-09-12T00:43:54.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.964+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14607266494616571460', time=2024-09-12T02:39:21.921400+0000, chain.objs.size()=1 2024-09-12T00:43:54.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.964+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33__shadow_.qxL4pUgzUYh6OTFQqq-il7jaRohYeBD_0 2024-09-12T00:43:54.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.964+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11480577739614718082', time=2024-09-12T02:39:57.986695+0000, chain.objs.size()=1 2024-09-12T00:43:54.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.964+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35__shadow_.7kbXGLygCrj-xuc2k3t8BpeVeUQIUy3_0 2024-09-12T00:43:54.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.968+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2769590186147559831', time=2024-09-12T02:40:31.262854+0000, chain.objs.size()=1 2024-09-12T00:43:54.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.968+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36__shadow_.MPxFD5_NwjrrNSjW7ofkvgWoIdsvLjG_0 2024-09-12T00:43:54.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.968+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15535768367649332246', time=2024-09-12T02:40:31.275993+0000, chain.objs.size()=1 2024-09-12T00:43:54.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.968+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36__shadow_.Y_8k_UxCrxB-v15Vdf_UuaxhoYBNXTJ_0 2024-09-12T00:43:54.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.968+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1565798950117602639', time=2024-09-12T02:40:31.277071+0000, chain.objs.size()=1 2024-09-12T00:43:54.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.968+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36__shadow_.ZklzIlwCL3IkrYzDgIVRS2W9Hvde5Gb_0 2024-09-12T00:43:54.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.968+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10617045982363425761', time=2024-09-12T02:40:34.398181+0000, chain.objs.size()=1 2024-09-12T00:43:54.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.968+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38__shadow_.aL7gSe_dn5j-57Kk5YLUySbX8aLOmDn_0 2024-09-12T00:43:54.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.968+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7981789184488260220', time=2024-09-12T02:40:34.403459+0000, chain.objs.size()=1 2024-09-12T00:43:54.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.968+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38__shadow_.aBlbCOsV5b2BF9YE0pf-mxwkcV5I1LZ_0 2024-09-12T00:43:54.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.972+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:54.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.976+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:43:54.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.976+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:54.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.980+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:54.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.980+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:43:54.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.980+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10397692948071513060', time=2024-09-12T02:37:02.106277+0000, chain.objs.size()=1 2024-09-12T00:43:54.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.980+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23__shadow_.V0KsPNGrRCT2c6BZC-JUWTMcaKjj1DW_0 2024-09-12T00:43:54.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.980+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17505716940791671850', time=2024-09-12T02:37:33.982775+0000, chain.objs.size()=1 2024-09-12T00:43:54.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.980+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24__shadow_.oRJQipIcW_saD9QukJojQB3glGTPqVy_0 2024-09-12T00:43:54.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.980+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3871645731415859091', time=2024-09-12T02:37:37.691851+0000, chain.objs.size()=1 2024-09-12T00:43:54.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.980+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26__shadow_.-bscQMnJ809Z07XsLwVGJx5ehzH_P6S_0 2024-09-12T00:43:54.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.980+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3449356545728583946', time=2024-09-12T02:38:43.800140+0000, chain.objs.size()=1 2024-09-12T00:43:54.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.980+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29__shadow_.DnLckQj-1A6nh1LP4QyiLOkH-NqgsaX_0 2024-09-12T00:43:54.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.980+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12948765718123478344', time=2024-09-12T02:38:47.444472+0000, chain.objs.size()=1 2024-09-12T00:43:54.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.980+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31__shadow_.O4huSBq3DII8rwK4ecdUs_t4jhOWZyY_0 2024-09-12T00:43:54.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.980+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13410166429760955940', time=2024-09-12T02:38:47.449522+0000, chain.objs.size()=1 2024-09-12T00:43:54.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.980+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31__shadow_.bAW3JdXGFksSnCdYODWximYy5st9TXR_0 2024-09-12T00:43:54.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.980+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5519009922749079453', time=2024-09-12T02:39:19.454365+0000, chain.objs.size()=1 2024-09-12T00:43:54.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.980+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32__shadow_.MrC-2oERuNvM1oX19HI9jktGRiHlrgV_0 2024-09-12T00:43:54.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.980+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11987778554196192578', time=2024-09-12T02:39:21.917582+0000, chain.objs.size()=1 2024-09-12T00:43:54.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.980+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33__shadow_.eKfc9Em2L0cVBDMurTdoqQe42mJdz8H_0 2024-09-12T00:43:54.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.980+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.445081827776633153', time=2024-09-12T02:39:55.566579+0000, chain.objs.size()=1 2024-09-12T00:43:54.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.980+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34__shadow_.xVg8Vrs56XepI9SSI311lihPCrp-dv-_0 2024-09-12T00:43:54.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.980+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5815498031524311901', time=2024-09-12T02:39:55.576179+0000, chain.objs.size()=1 2024-09-12T00:43:54.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.980+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34__shadow_.dZT_J2iXoHuun8fZomKhf0-2t0C2xO7_0 2024-09-12T00:43:54.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.980+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15760204106013707855', time=2024-09-12T02:40:34.400128+0000, chain.objs.size()=1 2024-09-12T00:43:54.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.980+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38__shadow_.VgdGGKbpURkYh6YdE0MyQwmDlEsAoHA_0 2024-09-12T00:43:54.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.980+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15582377839891610281', time=2024-09-12T02:40:34.417611+0000, chain.objs.size()=1 2024-09-12T00:43:54.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.980+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38__shadow_.OzpZP5ROVaPl6QNZEBnHtzJ4UZvbpzF_0 2024-09-12T00:43:54.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.984+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7159493260635395592', time=2024-09-12T02:40:34.420540+0000, chain.objs.size()=1 2024-09-12T00:43:54.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.984+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38__shadow_.tT8B6g4fRJmKMmnVxnvWhS5xSsNWJ1R_0 2024-09-12T00:43:54.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.984+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9229515264698667167', time=2024-09-12T02:41:06.327349+0000, chain.objs.size()=1 2024-09-12T00:43:54.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.984+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39__shadow_.zBWCRSW6Z_LqFj5iq9CoKjgAu3GPexy_0 2024-09-12T00:43:54.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.984+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14243548163272982591', time=2024-09-12T02:43:15.516453+0000, chain.objs.size()=1 2024-09-12T00:43:54.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.984+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17__shadow_.Zbs1-uvpPQ5MSGYlE438-fIWt63MM9r_0 2024-09-12T00:43:54.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.988+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:54.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.992+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:43:54.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.992+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:54.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.996+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:54.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.996+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T00:43:55.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.996+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2449635637688319742', time=2024-09-12T02:35:08.501483+0000, chain.objs.size()=2 2024-09-12T00:43:55.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.996+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.tCBhBNlpepoDcbgZ3JBaCS2QGmzUilW_0 2024-09-12T00:43:55.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.996+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.tCBhBNlpepoDcbgZ3JBaCS2QGmzUilW_1 2024-09-12T00:43:55.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.996+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6261725679642698152', time=2024-09-12T02:35:08.796989+0000, chain.objs.size()=5 2024-09-12T00:43:55.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.996+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14__multipart_foo-FROZEN.2~8Tb0d0HLK7VKitWIJzK_NYkX2YK_X6y.1 2024-09-12T00:43:55.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.996+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14__shadow_foo-FROZEN.2~8Tb0d0HLK7VKitWIJzK_NYkX2YK_X6y.1_1 2024-09-12T00:43:55.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.996+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14__multipart_foo-FROZEN.2~8Tb0d0HLK7VKitWIJzK_NYkX2YK_X6y.2 2024-09-12T00:43:55.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.996+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14__shadow_foo-FROZEN.2~8Tb0d0HLK7VKitWIJzK_NYkX2YK_X6y.2_1 2024-09-12T00:43:55.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.996+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14__multipart_foo-FROZEN.2~8Tb0d0HLK7VKitWIJzK_NYkX2YK_X6y.3 2024-09-12T00:43:55.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.996+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3506515354099341908', time=2024-09-12T02:36:25.894974+0000, chain.objs.size()=1 2024-09-12T00:43:55.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.996+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19__shadow_.CZeo6I3Ywti-e_lKebbTkAOq4mVdpYe_0 2024-09-12T00:43:55.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.996+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5854984186781056555', time=2024-09-12T02:36:59.297918+0000, chain.objs.size()=1 2024-09-12T00:43:55.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.996+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21__shadow_.xqkBvNFKQMENVuFyQWzs-7PYagZHVV3_0 2024-09-12T00:43:55.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.996+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9854908751066791462', time=2024-09-12T02:36:59.303753+0000, chain.objs.size()=1 2024-09-12T00:43:55.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.996+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21__shadow_.bb5Rex3XBhQPOTuKt_UgyZnTwBzftD0_0 2024-09-12T00:43:55.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.996+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8425092615599618753', time=2024-09-12T02:37:01.027942+0000, chain.objs.size()=1 2024-09-12T00:43:55.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.996+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22__shadow_.8CtT20xilR1kztb50a4ZGPY5CD0lzfG_0 2024-09-12T00:43:55.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.996+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3741036626476794451', time=2024-09-12T02:37:02.109548+0000, chain.objs.size()=1 2024-09-12T00:43:55.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:54.996+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23__shadow_.JOGjNsTIfOABK7-k3y_thaG8KCGrB0N_0 2024-09-12T00:43:55.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.000+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7482882463336853322', time=2024-09-12T02:37:37.683635+0000, chain.objs.size()=1 2024-09-12T00:43:55.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.000+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26__shadow_.j2rcajwINcW1dJ4Eh0emIEOl-fsmMXr_0 2024-09-12T00:43:55.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.000+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1641637501267345948', time=2024-09-12T02:38:10.080069+0000, chain.objs.size()=1 2024-09-12T00:43:55.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.000+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27__shadow_.xIIDEkXhz2I8p9Xsp7pmzta-dYtZgdz_0 2024-09-12T00:43:55.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.000+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13294512803595067879', time=2024-09-12T02:38:11.856940+0000, chain.objs.size()=1 2024-09-12T00:43:55.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.000+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28__shadow_.zgnxoX9rkEOWggkfiK3dZIl4Z9nM5q5_0 2024-09-12T00:43:55.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.000+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6969722023610368409', time=2024-09-12T02:38:46.074727+0000, chain.objs.size()=1 2024-09-12T00:43:55.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.000+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30__shadow_.XpMR4HW-IFlRLdNjdBDdWkXE5IowjJU_0 2024-09-12T00:43:55.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.000+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7743234659297252686', time=2024-09-12T02:38:46.085074+0000, chain.objs.size()=1 2024-09-12T00:43:55.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.000+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30__shadow_.6EiFQXQiS3zPQGB2v_hUnPNCmCbj5O5_0 2024-09-12T00:43:55.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.000+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7894530528726320932', time=2024-09-12T02:39:19.452059+0000, chain.objs.size()=1 2024-09-12T00:43:55.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.000+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32__shadow_.1AaQ8bUqupSeGBOzuCwQxCegmJG8x0R_0 2024-09-12T00:43:55.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.000+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4730000771319873877', time=2024-09-12T02:39:57.996139+0000, chain.objs.size()=1 2024-09-12T00:43:55.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.000+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35__shadow_.JkTVoXpS3f6H9MX6RWQlE7Z84WHITBy_0 2024-09-12T00:43:55.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.004+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11821693832701630088', time=2024-09-12T02:40:31.266992+0000, chain.objs.size()=1 2024-09-12T00:43:55.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.004+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36__shadow_.38ldJHVBbFcCwloG8c19SplLt3An0z__0 2024-09-12T00:43:55.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.004+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2959367064656277045', time=2024-09-12T02:40:33.067815+0000, chain.objs.size()=1 2024-09-12T00:43:55.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.004+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37__shadow_.gcjR2rZl1aL39NSzP1OVLb8mltxBI6g_0 2024-09-12T00:43:55.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.004+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13520489304814540522', time=2024-09-12T02:40:34.424860+0000, chain.objs.size()=1 2024-09-12T00:43:55.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.004+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38__shadow_.6FLgNC-d9_kG8TkSx_P5LPslxjpi7sx_0 2024-09-12T00:43:55.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.008+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:55.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.012+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:43:55.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.012+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.012+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.016+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T00:43:55.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.016+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='_BB-e0JI5HEA3gJifIqJAtZaZcxalluC', time=2024-09-12T02:35:08.520739+0000, chain.objs.size()=2 2024-09-12T00:43:55.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.016+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.CSIv5sukHA_iZVx7P4MTuQArB23AeMK_0 2024-09-12T00:43:55.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.016+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.CSIv5sukHA_iZVx7P4MTuQArB23AeMK_1 2024-09-12T00:43:55.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.016+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14108297691374568785', time=2024-09-12T02:36:25.893113+0000, chain.objs.size()=1 2024-09-12T00:43:55.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.016+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19__shadow_.AZxgwoJpj9sV2A03JXkhnxRNzUu3OtA_0 2024-09-12T00:43:55.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.016+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.690958446890121460', time=2024-09-12T02:37:37.692168+0000, chain.objs.size()=1 2024-09-12T00:43:55.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.016+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26__shadow_.NOjEKT9X75NdjakY9xvFEm5HY0NZYUo_0 2024-09-12T00:43:55.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.016+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3969936500735633589', time=2024-09-12T02:37:37.695041+0000, chain.objs.size()=1 2024-09-12T00:43:55.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.016+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26__shadow_.hbCQy1lKxYTdJ-1CkWK6-qtFeMLYmqA_0 2024-09-12T00:43:55.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.016+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7091010413937722959', time=2024-09-12T02:37:37.700383+0000, chain.objs.size()=1 2024-09-12T00:43:55.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.016+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26__shadow_.MCP2AAkH-XQjcU9jibnkudq7eLeUMtG_0 2024-09-12T00:43:55.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.016+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15410932875661023263', time=2024-09-12T02:38:10.065857+0000, chain.objs.size()=1 2024-09-12T00:43:55.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.016+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27__shadow_.K6_d7tDul1lIvdDsFkl-bcJgLmZHD9u_0 2024-09-12T00:43:55.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.016+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13909638746696704873', time=2024-09-12T02:38:10.074162+0000, chain.objs.size()=1 2024-09-12T00:43:55.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.016+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27__shadow_.0MmYST6HfnqF2SQ9JkWRufVyBoyHC7C_0 2024-09-12T00:43:55.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.016+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7887042660653837665', time=2024-09-12T02:38:10.086063+0000, chain.objs.size()=1 2024-09-12T00:43:55.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.016+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27__shadow_.ppnJPfRKb7sHul_rdUtyJMZ_rWcA4Ee_0 2024-09-12T00:43:55.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.016+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1459028730161143948', time=2024-09-12T02:38:11.849873+0000, chain.objs.size()=1 2024-09-12T00:43:55.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.016+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28__shadow_.DH3wmAOyLw3eq7cV79YYKnGv0vtvfUz_0 2024-09-12T00:43:55.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.016+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8960782849802499027', time=2024-09-12T02:38:47.435893+0000, chain.objs.size()=1 2024-09-12T00:43:55.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.016+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31__shadow_.cwiuu88DCD5in4yBuq9usgStKOrr6d0_0 2024-09-12T00:43:55.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.016+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3116722611276444172', time=2024-09-12T02:38:47.447779+0000, chain.objs.size()=1 2024-09-12T00:43:55.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.016+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31__shadow_.BkhSmgO3Xk4BpCotYp1seGEluoMMj62_0 2024-09-12T00:43:55.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.020+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12350443263834960192', time=2024-09-12T02:39:19.439871+0000, chain.objs.size()=1 2024-09-12T00:43:55.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.020+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32__shadow_.I1kd05XGZiRg2BhmdMEHGwXAtsOSa9R_0 2024-09-12T00:43:55.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.020+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15132875756097303360', time=2024-09-12T02:39:57.975171+0000, chain.objs.size()=1 2024-09-12T00:43:55.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.020+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35__shadow_.6kJ6RXcwVplc-POVw4IsahhXvoQ7Vog_0 2024-09-12T00:43:55.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.020+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17560250073373394054', time=2024-09-12T02:39:57.987001+0000, chain.objs.size()=1 2024-09-12T00:43:55.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.020+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35__shadow_.gOTp7bOWJ2LWCcEmeHkv34A1AErL4_s_0 2024-09-12T00:43:55.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.020+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.255422473377706817', time=2024-09-12T02:40:33.071504+0000, chain.objs.size()=1 2024-09-12T00:43:55.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.020+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37__shadow_.F5Jp__JaXXq9DvG0GA64AOMnK9l8Cw9_0 2024-09-12T00:43:55.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.020+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17863362632631393918', time=2024-09-12T02:41:06.313034+0000, chain.objs.size()=1 2024-09-12T00:43:55.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.020+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39__shadow_.ZFAJTMdhMt6XK3iazXbmfQK5ItOgy-K_0 2024-09-12T00:43:55.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.020+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8075811137374772445', time=2024-09-12T02:43:15.509906+0000, chain.objs.size()=1 2024-09-12T00:43:55.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.020+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17__shadow_.eupM1_W8pDbHu4p3aUNzmNs2YSRpBKD_0 2024-09-12T00:43:55.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.024+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:55.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.028+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:43:55.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.028+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.032+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.032+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T00:43:55.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.032+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='_jO0hTDk_eV72cU_S7JCPJseFID8bWNd', time=2024-09-12T02:35:08.638843+0000, chain.objs.size()=1 2024-09-12T00:43:55.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.032+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_.RnThhTntAdhJhwn9cqlZEa4dqYfuoyT_0 2024-09-12T00:43:55.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.032+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='_HaYlq00XhTSIDzkmRbxQWhP10ut6PY1', time=2024-09-12T02:35:08.699048+0000, chain.objs.size()=3 2024-09-12T00:43:55.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.032+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_.1Hzx4rgWbOUsSchanZ3HZZJbIz_hiKU_0 2024-09-12T00:43:55.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.032+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_.1Hzx4rgWbOUsSchanZ3HZZJbIz_hiKU_1 2024-09-12T00:43:55.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.032+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_.1Hzx4rgWbOUsSchanZ3HZZJbIz_hiKU_2 2024-09-12T00:43:55.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.032+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11656947150019401432', time=2024-09-12T02:36:27.204940+0000, chain.objs.size()=1 2024-09-12T00:43:55.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.032+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20__shadow_.EExh3XIdajxOjqi6NhO0-8ggXtjY44n_0 2024-09-12T00:43:55.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.032+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10118633594341328545', time=2024-09-12T02:36:59.299479+0000, chain.objs.size()=1 2024-09-12T00:43:55.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.032+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21__shadow_.eT8H-ppbfoMMzmFrO4ieWkOC1AW2Iju_0 2024-09-12T00:43:55.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.032+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14120274864046807935', time=2024-09-12T02:36:59.310104+0000, chain.objs.size()=1 2024-09-12T00:43:55.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.032+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21__shadow_.l3QVFUSoq0TKV2YpZ_E08XA0Q2jlI-k_0 2024-09-12T00:43:55.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.032+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11440507502889731970', time=2024-09-12T02:37:33.986769+0000, chain.objs.size()=1 2024-09-12T00:43:55.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.032+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24__shadow_.bFKm6I6EPpnT3yelqpuBnKInTd2Hhhj_0 2024-09-12T00:43:55.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.032+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5047141488590371354', time=2024-09-12T02:37:33.996269+0000, chain.objs.size()=1 2024-09-12T00:43:55.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.032+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24__shadow_.Cn3kSZBFzcgKv-T99jFc7k2KDMw1Z6u_0 2024-09-12T00:43:55.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.032+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.42601862731682735', time=2024-09-12T02:38:11.850645+0000, chain.objs.size()=1 2024-09-12T00:43:55.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.032+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28__shadow_.ay6Yog3kzrMBKcbd7exv90xGqAq4G9u_0 2024-09-12T00:43:55.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.032+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11730701317901824416', time=2024-09-12T02:38:11.864385+0000, chain.objs.size()=1 2024-09-12T00:43:55.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.032+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28__shadow_.b9VU0d8QVPbi07bn-sraIzWiZYC6l81_0 2024-09-12T00:43:55.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.032+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9174046640117042331', time=2024-09-12T02:38:43.794697+0000, chain.objs.size()=1 2024-09-12T00:43:55.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.032+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29__shadow_.O1iM2QViwvn3Sc9-j0L4TZiWybxH-1K_0 2024-09-12T00:43:55.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.036+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12848033786253623460', time=2024-09-12T02:38:46.075802+0000, chain.objs.size()=1 2024-09-12T00:43:55.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.036+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30__shadow_.aV7ou4NcNRLfQXtIw2MLuzHMTj3W3UF_0 2024-09-12T00:43:55.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.040+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10431671679501169572', time=2024-09-12T02:39:19.449411+0000, chain.objs.size()=1 2024-09-12T00:43:55.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.040+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32__shadow_.u__hjpJpEUdSOwc1BLVdNuKIq7J0LGk_0 2024-09-12T00:43:55.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.040+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11472529285876449630', time=2024-09-12T02:39:21.931714+0000, chain.objs.size()=1 2024-09-12T00:43:55.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.040+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33__shadow_.VVDY9LBFUjzeBrXdgDmbQnt_Wsdd_6S_0 2024-09-12T00:43:55.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.040+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:55.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.044+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:43:55.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.048+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.048+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.048+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T00:43:55.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.048+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9504251852489225949', time=2024-09-12T02:36:25.878879+0000, chain.objs.size()=1 2024-09-12T00:43:55.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.048+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19__shadow_.FJqg4S8aa7VnRi5jFF13AN9SnDyysvb_0 2024-09-12T00:43:55.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.048+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18376165951622529937', time=2024-09-12T02:36:25.889023+0000, chain.objs.size()=1 2024-09-12T00:43:55.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.048+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19__shadow_.Tn51m7Fn8Satr6D8bQzR6lxmQpXfxsP_0 2024-09-12T00:43:55.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.048+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2089928296021072807', time=2024-09-12T02:36:27.202908+0000, chain.objs.size()=1 2024-09-12T00:43:55.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.048+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20__shadow_.3wLWTXKygpxAftfyx_RPtLFjBgA8vFD_0 2024-09-12T00:43:55.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.048+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15528462970542856742', time=2024-09-12T02:37:01.030893+0000, chain.objs.size()=1 2024-09-12T00:43:55.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.048+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22__shadow_.1ZZz2RMkrQWEaw6zO9YTqiwd5hHZwrg_0 2024-09-12T00:43:55.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.048+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12825438173035860908', time=2024-09-12T02:38:10.072359+0000, chain.objs.size()=1 2024-09-12T00:43:55.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.048+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27__shadow_.s1_guctTwt8fq96MDjXQKuJIQMnZAI6_0 2024-09-12T00:43:55.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.048+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8519654087172489039', time=2024-09-12T02:38:43.783386+0000, chain.objs.size()=1 2024-09-12T00:43:55.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.048+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29__shadow_.U1ITPXDqAO0sqRgbH1DecSGCWaa-UMR_0 2024-09-12T00:43:55.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.048+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6255795951998994401', time=2024-09-12T02:38:43.800930+0000, chain.objs.size()=1 2024-09-12T00:43:55.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.048+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29__shadow_.kMdkVgVJeKdZKlVRVpIvdLh78fpn0WH_0 2024-09-12T00:43:55.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.048+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7135142830307349166', time=2024-09-12T02:39:21.921872+0000, chain.objs.size()=1 2024-09-12T00:43:55.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.048+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33__shadow_.cPHEsqr7DDgCw6jdNtTGoNtqWKRMSUB_0 2024-09-12T00:43:55.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.048+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16330374656884567298', time=2024-09-12T02:39:21.922880+0000, chain.objs.size()=1 2024-09-12T00:43:55.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.048+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33__shadow_.LB3BF1WrwZ6cCV9ALg9qkN1hAazaKAm_0 2024-09-12T00:43:55.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.052+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:55.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.056+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:43:55.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.056+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.060+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.060+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T00:43:55.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.060+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7144907186300175873', time=2024-09-12T02:36:25.884170+0000, chain.objs.size()=1 2024-09-12T00:43:55.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.060+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19__shadow_.qO4GGA8-02D65jTiYiruNyl34f20nfX_0 2024-09-12T00:43:55.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.060+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14202201757223730381', time=2024-09-12T02:37:01.032072+0000, chain.objs.size()=1 2024-09-12T00:43:55.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.060+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22__shadow_.uK0wV80Wnz1OdKrVsrgzMtOREtz7MO-_0 2024-09-12T00:43:55.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.060+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10463662553513884009', time=2024-09-12T02:37:02.115084+0000, chain.objs.size()=1 2024-09-12T00:43:55.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.060+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23__shadow_.K-kilTYFDxHQ3FR1VtdFinYw1IJwXUp_0 2024-09-12T00:43:55.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.060+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13273188392533023636', time=2024-09-12T02:37:33.977776+0000, chain.objs.size()=1 2024-09-12T00:43:55.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.060+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24__shadow_.SrDVWR8gQQD50esDIK6I46wbEZ_jxFb_0 2024-09-12T00:43:55.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.060+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17622432821614202226', time=2024-09-12T02:37:33.981650+0000, chain.objs.size()=1 2024-09-12T00:43:55.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.060+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24__shadow_.3NmXcZeUN2CoJeqUilqUMabPzeVIWC3_0 2024-09-12T00:43:55.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.060+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3307199235627801424', time=2024-09-12T02:37:37.684999+0000, chain.objs.size()=1 2024-09-12T00:43:55.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.060+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26__shadow_.yTvYPlvx5mKCUpQ17AB8AWT9fOtO__t_0 2024-09-12T00:43:55.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.060+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17776154318575090662', time=2024-09-12T02:38:10.076298+0000, chain.objs.size()=1 2024-09-12T00:43:55.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.060+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27__shadow_.v67iwm2TgtqIRCALWyhKsMg2OFvhpq-_0 2024-09-12T00:43:55.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.060+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8688953874545448561', time=2024-09-12T02:38:11.850857+0000, chain.objs.size()=1 2024-09-12T00:43:55.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.060+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28__shadow_.dZSO2xP0oG0r2Soc-tvzRx_eTPrMutH_0 2024-09-12T00:43:55.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.060+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7300859167426686777', time=2024-09-12T02:39:24.920207+0000, chain.objs.size()=1 2024-09-12T00:43:55.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.060+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34__shadow_.DlT-kSQPzKfQ7wyTueTy0OBpKfcn2ZX_0 2024-09-12T00:43:55.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.060+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14644163266841936056', time=2024-09-12T02:39:57.980976+0000, chain.objs.size()=1 2024-09-12T00:43:55.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.060+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35__shadow_.Z2RutjRGn5W-1mYYYd45KPk9UuhZOFb_0 2024-09-12T00:43:55.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.060+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14906162739532417607', time=2024-09-12T02:40:31.267534+0000, chain.objs.size()=1 2024-09-12T00:43:55.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.060+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36__shadow_.PlBt1sa_WJgXHUriB-qegzjq8YM4Zji_0 2024-09-12T00:43:55.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.060+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11702966557857175951', time=2024-09-12T02:40:34.419384+0000, chain.objs.size()=1 2024-09-12T00:43:55.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.060+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38__shadow_.QrSIg_OXpdsdzo-QtrJ9tP2HkBZRIW1_0 2024-09-12T00:43:55.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.064+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:55.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.068+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:43:55.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.068+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.068+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.068+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T00:43:55.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.068+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='_y3du6iPZhLpkNFiZh2qPAxcM8ZlOXtc', time=2024-09-12T02:35:08.540443+0000, chain.objs.size()=2 2024-09-12T00:43:55.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.068+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.Ra60X8l2cUmq55W7c_gWxF5KZTDeaDt_0 2024-09-12T00:43:55.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.068+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.Ra60X8l2cUmq55W7c_gWxF5KZTDeaDt_1 2024-09-12T00:43:55.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.068+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18073498457538430223', time=2024-09-12T02:35:08.726225+0000, chain.objs.size()=5 2024-09-12T00:43:55.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.068+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-LUKEWARM.2~I6VWkIEcOnMRv2E23H5sn0xUFVOs3rD.1 2024-09-12T00:43:55.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.068+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_foo-LUKEWARM.2~I6VWkIEcOnMRv2E23H5sn0xUFVOs3rD.1_1 2024-09-12T00:43:55.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.068+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-LUKEWARM.2~I6VWkIEcOnMRv2E23H5sn0xUFVOs3rD.2 2024-09-12T00:43:55.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.068+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_foo-LUKEWARM.2~I6VWkIEcOnMRv2E23H5sn0xUFVOs3rD.2_1 2024-09-12T00:43:55.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.068+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-LUKEWARM.2~I6VWkIEcOnMRv2E23H5sn0xUFVOs3rD.3 2024-09-12T00:43:55.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.068+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12556509869590871468', time=2024-09-12T02:35:09.174722+0000, chain.objs.size()=1 2024-09-12T00:43:55.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.068+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8__shadow_.3zK5jbOhvnANFWhyI1KFCxQqSDBrBOD_0 2024-09-12T00:43:55.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.068+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11333486149935281747', time=2024-09-12T02:37:01.031974+0000, chain.objs.size()=1 2024-09-12T00:43:55.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.068+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22__shadow_.RH93wimjOs4NTkwCIriY8lNv-eF7Ma2_0 2024-09-12T00:43:55.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.068+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12390579488953866088', time=2024-09-12T02:37:37.684699+0000, chain.objs.size()=1 2024-09-12T00:43:55.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.068+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26__shadow_.Dg_kF_r8fOCwUWOrAg5h1d32-VCWYXN_0 2024-09-12T00:43:55.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.068+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3029178767454329678', time=2024-09-12T02:38:10.078029+0000, chain.objs.size()=1 2024-09-12T00:43:55.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.068+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27__shadow_.gkmF10wjAa2CW-6MV6AH75MQ5eYiJCt_0 2024-09-12T00:43:55.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.068+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17056604546724584021', time=2024-09-12T02:38:11.410990+0000, chain.objs.size()=1 2024-09-12T00:43:55.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.068+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28__shadow_.HAQnmuksvzH1uIR9FQXE0sCHNpxakoJ_0 2024-09-12T00:43:55.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.080+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17923052409873693079', time=2024-09-12T02:38:43.785343+0000, chain.objs.size()=1 2024-09-12T00:43:55.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.080+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29__shadow_.j1SBiZjLYXC9HUy2qGvSovnVk0T92ox_0 2024-09-12T00:43:55.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.080+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5840756927559043147', time=2024-09-12T02:38:45.366229+0000, chain.objs.size()=1 2024-09-12T00:43:55.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.080+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30__shadow_.yJrPUnbHEvh1LhiQwa_Z7oO2D9E8fAE_0 2024-09-12T00:43:55.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.080+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9457535705309428786', time=2024-09-12T02:38:46.064807+0000, chain.objs.size()=1 2024-09-12T00:43:55.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.080+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30__shadow_.KHJFkBkuPsrbCJGwGqwkxZXKfZQ3p4c_0 2024-09-12T00:43:55.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.080+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16615327254373242741', time=2024-09-12T02:38:46.069292+0000, chain.objs.size()=1 2024-09-12T00:43:55.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.080+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30__shadow_.h0fSlFpkNc6OShJfAjys8XUIoBBPQow_0 2024-09-12T00:43:55.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.080+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17158458558318700894', time=2024-09-12T02:40:31.262924+0000, chain.objs.size()=1 2024-09-12T00:43:55.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.080+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36__shadow_.sgZ7vohfTgg09yyShvZ_haEkGKwnvW4_0 2024-09-12T00:43:55.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.080+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14801932851549475195', time=2024-09-12T02:40:31.265837+0000, chain.objs.size()=1 2024-09-12T00:43:55.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.080+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36__shadow_.M-toj5-NKoNvoZ4P3sy73zL8asqXAL4_0 2024-09-12T00:43:55.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.080+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2591771492112076341', time=2024-09-12T02:41:06.330823+0000, chain.objs.size()=1 2024-09-12T00:43:55.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.080+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39__shadow_.ilg72ZSgo-ULs437YT3mZs18K2k46z-_0 2024-09-12T00:43:55.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.080+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:55.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.084+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:43:55.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.088+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.088+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.088+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T00:43:55.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.088+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16937067913319367820', time=2024-09-12T02:36:27.217789+0000, chain.objs.size()=1 2024-09-12T00:43:55.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.088+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20__shadow_.fFlYfeYuL4IXpMyCxB8UwlexqW9QiJ-_0 2024-09-12T00:43:55.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.088+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.89027459542673551', time=2024-09-12T02:36:59.297213+0000, chain.objs.size()=1 2024-09-12T00:43:55.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.088+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21__shadow_.gJm2-UCxjzPFP31MPra6RCFqdn1qgz6_0 2024-09-12T00:43:55.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.088+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15580796963875551660', time=2024-09-12T02:37:01.036920+0000, chain.objs.size()=1 2024-09-12T00:43:55.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.088+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22__shadow_.pvPoAIp03EynaBROfQE2trXRtaTKeiK_0 2024-09-12T00:43:55.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.088+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10209895734265526532', time=2024-09-12T02:37:02.102984+0000, chain.objs.size()=1 2024-09-12T00:43:55.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.088+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23__shadow_.Ov_YqqBbX5-NSffKkqoSq-lpFQ89yFl_0 2024-09-12T00:43:55.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.092+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16605062099127259175', time=2024-09-12T02:37:02.113788+0000, chain.objs.size()=1 2024-09-12T00:43:55.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.092+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23__shadow_.vmJRgn90d5C4ZM03YMYEfO_9BT33s7e_0 2024-09-12T00:43:55.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.092+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.687878963452824583', time=2024-09-12T02:37:02.124424+0000, chain.objs.size()=1 2024-09-12T00:43:55.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.092+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23__shadow_.zvMw1xRr1Erin1Q9Ra-2kj1zm-Ts4u7_0 2024-09-12T00:43:55.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.092+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13153749440333412593', time=2024-09-12T02:37:35.986465+0000, chain.objs.size()=1 2024-09-12T00:43:55.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.092+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25__shadow_.FiaI9yMH8ywPjCvmLkzOhH1lZ1_Aa7C_0 2024-09-12T00:43:55.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.092+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4455262113338844790', time=2024-09-12T02:38:10.069572+0000, chain.objs.size()=1 2024-09-12T00:43:55.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.092+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27__shadow_.UFCI9JQn5SJlCcqWcjw0901K9Jq5ad6_0 2024-09-12T00:43:55.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.092+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7758150877467147519', time=2024-09-12T02:38:10.075457+0000, chain.objs.size()=1 2024-09-12T00:43:55.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.092+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27__shadow_.88CcUou1YvwUH2t-FZx0OaX7EayJE1z_0 2024-09-12T00:43:55.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.092+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.487407350149990236', time=2024-09-12T02:38:11.857941+0000, chain.objs.size()=1 2024-09-12T00:43:55.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.092+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28__shadow_.-GDzby4Ba82ZmepbLAtXS6yNQKM7ZkJ_0 2024-09-12T00:43:55.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.092+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17863440788762897206', time=2024-09-12T02:38:46.074104+0000, chain.objs.size()=1 2024-09-12T00:43:55.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.092+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30__shadow_.W_Lqjl7qyQAHJcG8AmHWBiJOxK9yFAt_0 2024-09-12T00:43:55.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.092+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1379901232674902242', time=2024-09-12T02:39:19.444169+0000, chain.objs.size()=1 2024-09-12T00:43:55.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.092+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32__shadow_.N5Mcj2xbFnreB82MzoIcCBQ_UQ-5hQS_0 2024-09-12T00:43:55.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.092+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1100762737110523318', time=2024-09-12T02:39:19.448043+0000, chain.objs.size()=1 2024-09-12T00:43:55.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.092+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32__shadow_.hZarTQAavcjKL_sa_p4MsZOzRoPCCyC_0 2024-09-12T00:43:55.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.092+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18018731629662411653', time=2024-09-12T02:39:19.453362+0000, chain.objs.size()=1 2024-09-12T00:43:55.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.092+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32__shadow_.4o0wJwVEhdRpXxu5OlMBl9jjrvtEu9F_0 2024-09-12T00:43:55.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.092+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5592203167808162937', time=2024-09-12T02:39:19.459247+0000, chain.objs.size()=1 2024-09-12T00:43:55.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.092+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32__shadow_.LmPnoYlrE5X6uaPPqHxzq7AhCLLCDBB_0 2024-09-12T00:43:55.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.092+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1241381210664115147', time=2024-09-12T02:39:57.984861+0000, chain.objs.size()=1 2024-09-12T00:43:55.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.092+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35__shadow_.B7L37EoEGKMZ5ZRsoLvkaaCt5LiM7Ei_0 2024-09-12T00:43:55.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.092+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7697012508089194084', time=2024-09-12T02:40:31.262154+0000, chain.objs.size()=1 2024-09-12T00:43:55.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.092+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36__shadow_.LADqZoyfJf9RXyk7ol7mjBwASg4pyag_0 2024-09-12T00:43:55.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.096+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1429699824695120969', time=2024-09-12T02:41:06.312808+0000, chain.objs.size()=1 2024-09-12T00:43:55.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.096+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39__shadow_.QimU727jaLuf365T0CZ5MearLm0xSkm_0 2024-09-12T00:43:55.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.096+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.878871307890502944', time=2024-09-12T02:43:15.509064+0000, chain.objs.size()=1 2024-09-12T00:43:55.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.096+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17__shadow_.9BT3OfsjhJ74Gtsdsz8DohtXnwS4Zhe_0 2024-09-12T00:43:55.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.096+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14371913993533709889', time=2024-09-12T02:43:15.518838+0000, chain.objs.size()=1 2024-09-12T00:43:55.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.096+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17__shadow_.g1Ws9dz2HC4Z21TYHkMACxyZL3_Nmdi_0 2024-09-12T00:43:55.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.100+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:55.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.104+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:43:55.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.104+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.108+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.108+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T00:43:55.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.108+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='_s5OTykFVhm4tdM9vUG9sCbw_xicEQPp', time=2024-09-12T02:35:08.478957+0000, chain.objs.size()=1 2024-09-12T00:43:55.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.108+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.D8Y3JDJobKId1bdFTzSW4XXRYqaqEeU_0 2024-09-12T00:43:55.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.108+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='_VAwJIkTR1j6gp-slQW3US3DEiRYtKE2', time=2024-09-12T02:35:08.510383+0000, chain.objs.size()=2 2024-09-12T00:43:55.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.108+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.G2LxGz2j8OZF8DMwodCfmzEWeJ8o-gg_0 2024-09-12T00:43:55.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.108+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.G2LxGz2j8OZF8DMwodCfmzEWeJ8o-gg_1 2024-09-12T00:43:55.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.108+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8042236088785303579', time=2024-09-12T02:35:08.924785+0000, chain.objs.size()=3 2024-09-12T00:43:55.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.108+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13__shadow_.aq7oKlUzCTOhGFn7xgqvSoEhj8S94NP_0 2024-09-12T00:43:55.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.108+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13__shadow_.aq7oKlUzCTOhGFn7xgqvSoEhj8S94NP_1 2024-09-12T00:43:55.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.108+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13__shadow_.aq7oKlUzCTOhGFn7xgqvSoEhj8S94NP_2 2024-09-12T00:43:55.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.108+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11446025400076529393', time=2024-09-12T02:36:25.888602+0000, chain.objs.size()=1 2024-09-12T00:43:55.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.108+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19__shadow_.sK0LvRXIDXf2f7QKKwpdsUwdIkIxWlJ_0 2024-09-12T00:43:55.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.108+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12762256734004318768', time=2024-09-12T02:36:27.207736+0000, chain.objs.size()=1 2024-09-12T00:43:55.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.108+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20__shadow_.gSk63-B1OSit9hJJKV37RhQ_GWkzhzi_0 2024-09-12T00:43:55.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.108+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9187277235788749403', time=2024-09-12T02:37:02.101761+0000, chain.objs.size()=1 2024-09-12T00:43:55.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.108+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23__shadow_.6_gS7ff087W6YebgDUJfPQA7GVD2MCo_0 2024-09-12T00:43:55.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.108+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10193600309699613855', time=2024-09-12T02:37:33.986208+0000, chain.objs.size()=1 2024-09-12T00:43:55.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.108+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24__shadow_.9MGFaoI0MVA2ic1vlzIl_3Lwo5EVfHG_0 2024-09-12T00:43:55.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.108+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4210997405917978666', time=2024-09-12T02:37:35.989433+0000, chain.objs.size()=1 2024-09-12T00:43:55.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.108+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25__shadow_.S4h56ZP0xHi8qBeOE2WOMc4-Ro1RgbY_0 2024-09-12T00:43:55.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.108+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12539788301477550024', time=2024-09-12T02:37:36.000722+0000, chain.objs.size()=1 2024-09-12T00:43:55.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.108+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25__shadow_.rOweTCjEy6-KCkiAY7G128_rIdEcMKs_0 2024-09-12T00:43:55.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.108+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8028357819861924007', time=2024-09-12T02:38:43.801645+0000, chain.objs.size()=1 2024-09-12T00:43:55.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.112+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29__shadow_._REkvAsvC-sPWy0X5HXpqjUCj6FlWYl_0 2024-09-12T00:43:55.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.112+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12548035403302721882', time=2024-09-12T02:38:46.066989+0000, chain.objs.size()=1 2024-09-12T00:43:55.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.112+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30__shadow_.6fhYt3R-Vr-Xc2hHY67FA0MlFwQSK-N_0 2024-09-12T00:43:55.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.112+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17888534868432844802', time=2024-09-12T02:38:47.439998+0000, chain.objs.size()=1 2024-09-12T00:43:55.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.112+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31__shadow_.3JUtbfBkjfGUHg5a7qQF8xi3Ho_hZG0_0 2024-09-12T00:43:55.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.112+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5534072415764829928', time=2024-09-12T02:41:06.326038+0000, chain.objs.size()=1 2024-09-12T00:43:55.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.112+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39__shadow_.QsJUz_OM7bStKeC3QrVx3e7fbln0-pQ_0 2024-09-12T00:43:55.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.116+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:55.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.116+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:43:55.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.120+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.124+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.124+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T00:43:55.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.124+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6626871108789907218', time=2024-09-12T02:35:08.201525+0000, chain.objs.size()=1 2024-09-12T00:43:55.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.124+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4__shadow_.zpQPw-g60cUo44-bW66Xe7ep-vbnEag_0 2024-09-12T00:43:55.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.124+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13875580690895315447', time=2024-09-12T02:35:08.375869+0000, chain.objs.size()=4 2024-09-12T00:43:55.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.124+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10__multipart_foo.2~MIb35QPzzWMm1zQkwffj8r32MA0MyoB.1 2024-09-12T00:43:55.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.124+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10__multipart_foo.2~MIb35QPzzWMm1zQkwffj8r32MA0MyoB.2 2024-09-12T00:43:55.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.124+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10__multipart_foo.2~MIb35QPzzWMm1zQkwffj8r32MA0MyoB.3 2024-09-12T00:43:55.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.124+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10__multipart_foo.2~MIb35QPzzWMm1zQkwffj8r32MA0MyoB.4 2024-09-12T00:43:55.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.124+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3820802973135330474', time=2024-09-12T02:36:25.883156+0000, chain.objs.size()=1 2024-09-12T00:43:55.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.124+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19__shadow_.sG3_9MZf7rYuQn3Rv8wyS_aaA9Awxkg_0 2024-09-12T00:43:55.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.124+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5494182985693000504', time=2024-09-12T02:36:27.217772+0000, chain.objs.size()=1 2024-09-12T00:43:55.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.124+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20__shadow_.Uc7OR0TkHV9bHHgdTafOzkn5c56t6qc_0 2024-09-12T00:43:55.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.124+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5162965914057321929', time=2024-09-12T02:37:01.044518+0000, chain.objs.size()=1 2024-09-12T00:43:55.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.124+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22__shadow_.ChPh0d3WfGlQUykMyGxJEAc12cHGqO5_0 2024-09-12T00:43:55.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.124+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.968800191485875928', time=2024-09-12T02:37:02.114157+0000, chain.objs.size()=1 2024-09-12T00:43:55.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.124+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23__shadow_.29BUdhN9Fa0gNO2hAeH3VfST6Gz471Y_0 2024-09-12T00:43:55.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.124+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18369149350377007485', time=2024-09-12T02:37:35.997490+0000, chain.objs.size()=1 2024-09-12T00:43:55.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.124+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25__shadow_.WvGXWCa4KmasP6IzZ9OVkz2sWu_8iXi_0 2024-09-12T00:43:55.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.124+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10843809044278868226', time=2024-09-12T02:38:11.852362+0000, chain.objs.size()=1 2024-09-12T00:43:55.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.124+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28__shadow_.l9J0bpOCImjxiFJ1wFdoz-eQlOBMEDe_0 2024-09-12T00:43:55.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.124+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17801597276873648538', time=2024-09-12T02:38:43.794248+0000, chain.objs.size()=1 2024-09-12T00:43:55.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.124+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29__shadow_.SGVi3Y2HBTwoBAVxZbiZ46FZEgAsERd_0 2024-09-12T00:43:55.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.124+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10229954704915551059', time=2024-09-12T02:38:46.068943+0000, chain.objs.size()=1 2024-09-12T00:43:55.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.124+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30__shadow_.v4MW73tH_4S6gwNzImNoFmEgmVDwrM4_0 2024-09-12T00:43:55.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.124+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10018818881390004909', time=2024-09-12T02:38:47.433562+0000, chain.objs.size()=1 2024-09-12T00:43:55.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.124+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31__shadow_.-V4Vcy8BceEC3kNOLMnvuhgUDJyTuBx_0 2024-09-12T00:43:55.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.128+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14195375295668316549', time=2024-09-12T02:39:19.457310+0000, chain.objs.size()=1 2024-09-12T00:43:55.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.128+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32__shadow_.QJNxqQRACer-vI6h3TGYLtTeU5UifRM_0 2024-09-12T00:43:55.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.128+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6303186646251132906', time=2024-09-12T02:40:33.077172+0000, chain.objs.size()=1 2024-09-12T00:43:55.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.128+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37__shadow_.BZTzP4qzjdpb1p9SV8chDjTw_T-fxiZ_0 2024-09-12T00:43:55.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.128+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1949499648622540266', time=2024-09-12T02:40:34.396512+0000, chain.objs.size()=1 2024-09-12T00:43:55.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.128+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38__shadow_.U-333wv7PFbIYETUMmC0wrmIFT_ZEP0_0 2024-09-12T00:43:55.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.128+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16692525106737305037', time=2024-09-12T02:41:06.311901+0000, chain.objs.size()=1 2024-09-12T00:43:55.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.128+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39__shadow_.9VDSZEj5ywKOdXkxWxMvamnq1bSuFwa_0 2024-09-12T00:43:55.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.128+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8290773428747720151', time=2024-09-12T02:43:15.509207+0000, chain.objs.size()=1 2024-09-12T00:43:55.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.128+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17__shadow_.rqxs1tWxvVGouN9C8taYmtUiI7y7Lyw_0 2024-09-12T00:43:55.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.128+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7955921257325007756', time=2024-09-12T02:43:28.667044+0000, chain.objs.size()=1 2024-09-12T00:43:55.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.128+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18__shadow:T1Fospy6PXoKm-Tly275.M1whU5l6mL_.s7RFCa7y2CCdrC-m435Mw4ghEScI1oU_0 2024-09-12T00:43:55.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.132+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:55.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.136+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:43:55.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.136+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.136+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.140+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T00:43:55.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.140+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13360977697804433289', time=2024-09-12T02:35:08.271872+0000, chain.objs.size()=7 2024-09-12T00:43:55.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.140+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11__multipart_foo.2~zofgijrsM6nj1nx9r6w9ismHFDpTYuk.1 2024-09-12T00:43:55.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.140+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11__shadow_foo.2~zofgijrsM6nj1nx9r6w9ismHFDpTYuk.1_1 2024-09-12T00:43:55.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.140+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11__multipart_foo.2~zofgijrsM6nj1nx9r6w9ismHFDpTYuk.2 2024-09-12T00:43:55.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.140+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11__shadow_foo.2~zofgijrsM6nj1nx9r6w9ismHFDpTYuk.2_1 2024-09-12T00:43:55.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.140+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11__multipart_foo.2~zofgijrsM6nj1nx9r6w9ismHFDpTYuk.3 2024-09-12T00:43:55.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.140+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11__shadow_foo.2~zofgijrsM6nj1nx9r6w9ismHFDpTYuk.3_1 2024-09-12T00:43:55.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.140+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11__multipart_foo.2~zofgijrsM6nj1nx9r6w9ismHFDpTYuk.4 2024-09-12T00:43:55.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.140+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11472087830650810973', time=2024-09-12T02:37:02.113561+0000, chain.objs.size()=1 2024-09-12T00:43:55.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.140+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23__shadow_.zsYtA79y9I2tYFO69R0wnfJFpGoZDnR_0 2024-09-12T00:43:55.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.140+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16400678749324019648', time=2024-09-12T02:37:35.994101+0000, chain.objs.size()=1 2024-09-12T00:43:55.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.140+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25__shadow_.oKZC5TAxGtyWjGwm2UdGY36rtrroX-B_0 2024-09-12T00:43:55.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.140+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4704525705742026392', time=2024-09-12T02:37:36.005092+0000, chain.objs.size()=1 2024-09-12T00:43:55.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.140+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25__shadow_.-ohOjeA066k1UKQLNg7fk9RZba7JXNr_0 2024-09-12T00:43:55.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.140+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15026973023243885343', time=2024-09-12T02:38:11.846118+0000, chain.objs.size()=1 2024-09-12T00:43:55.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.140+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28__shadow_.IM-r6iEpVEU4dUeWFzOfmuwvy8jFWT0_0 2024-09-12T00:43:55.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.140+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6796317312743752280', time=2024-09-12T02:38:43.786450+0000, chain.objs.size()=1 2024-09-12T00:43:55.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.140+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29__shadow_.7tnzYgSAiZoKpahmhL3Ofc6QtOJFNg3_0 2024-09-12T00:43:55.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.144+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7870574184058920889', time=2024-09-12T02:39:21.914396+0000, chain.objs.size()=1 2024-09-12T00:43:55.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.144+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33__shadow_.8u3KRVyrUXubz7oivQsqLRbFhmJaENK_0 2024-09-12T00:43:55.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.144+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7997833463171161841', time=2024-09-12T02:40:31.258789+0000, chain.objs.size()=1 2024-09-12T00:43:55.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.144+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36__shadow_.O5elOtSrrRKN8KzJeRAf4fMYfibRtgY_0 2024-09-12T00:43:55.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.144+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18266405332990082974', time=2024-09-12T02:40:34.415926+0000, chain.objs.size()=1 2024-09-12T00:43:55.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.144+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38__shadow_.QD1Jv-rCkkH91RMDVCfUoFXIi6O9gzY_0 2024-09-12T00:43:55.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.144+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:55.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.148+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:43:55.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.152+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.152+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.152+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:43:55.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.152+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6150661601250211561', time=2024-09-12T02:35:08.656491+0000, chain.objs.size()=5 2024-09-12T00:43:55.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.152+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-FROZEN.2~P942SXcFkTD-6dFquWC0zIBymeiN8WY.1 2024-09-12T00:43:55.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.152+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_foo-FROZEN.2~P942SXcFkTD-6dFquWC0zIBymeiN8WY.1_1 2024-09-12T00:43:55.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.152+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-FROZEN.2~P942SXcFkTD-6dFquWC0zIBymeiN8WY.2 2024-09-12T00:43:55.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.152+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_foo-FROZEN.2~P942SXcFkTD-6dFquWC0zIBymeiN8WY.2_1 2024-09-12T00:43:55.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.152+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-FROZEN.2~P942SXcFkTD-6dFquWC0zIBymeiN8WY.3 2024-09-12T00:43:55.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.152+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6953081409821640512', time=2024-09-12T02:35:09.067055+0000, chain.objs.size()=1 2024-09-12T00:43:55.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.152+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7__shadow_.KHvl5_zTS_qvk_0_AliMwNV-lM8wtyz_0 2024-09-12T00:43:55.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.152+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18419079105282394093', time=2024-09-12T02:36:27.201153+0000, chain.objs.size()=1 2024-09-12T00:43:55.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.152+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20__shadow_.6DQ883m8ZZjThCSRupjkuaJ4kxpHAf3_0 2024-09-12T00:43:55.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.152+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12801782729689467478', time=2024-09-12T02:36:27.205198+0000, chain.objs.size()=1 2024-09-12T00:43:55.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.152+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20__shadow_.U0D6U_6FupJmLF-oa5qRJx-lrAU7ay5_0 2024-09-12T00:43:55.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.152+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2440046895692554369', time=2024-09-12T02:36:27.207706+0000, chain.objs.size()=1 2024-09-12T00:43:55.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.152+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20__shadow_.ElNWulDHIPYV0pDd6D7mS1-4LhgMyS-_0 2024-09-12T00:43:55.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.152+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3518061665165660244', time=2024-09-12T02:36:27.208648+0000, chain.objs.size()=1 2024-09-12T00:43:55.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.152+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20__shadow_.PQNOHIKXPSKlwMzeBwl_ghmRS8lqUou_0 2024-09-12T00:43:55.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.152+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1517652683601031102', time=2024-09-12T02:36:59.300754+0000, chain.objs.size()=1 2024-09-12T00:43:55.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.152+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21__shadow_.cXqtjherWbY1Y6WkpNWBE_ggAsGGHnj_0 2024-09-12T00:43:55.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.152+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3609660245395844735', time=2024-09-12T02:37:33.977953+0000, chain.objs.size()=1 2024-09-12T00:43:55.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.152+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24__shadow_.T29DS61SOw_pSGA253ndG8jt5UwqYE-_0 2024-09-12T00:43:55.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.156+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11186934568572289951', time=2024-09-12T02:37:33.982353+0000, chain.objs.size()=1 2024-09-12T00:43:55.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.156+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24__shadow_.4LOmQS1w2KLsaZmnh8jQWavAVLLShT9_0 2024-09-12T00:43:55.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.156+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5363917560283949431', time=2024-09-12T02:37:37.697442+0000, chain.objs.size()=1 2024-09-12T00:43:55.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.156+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26__shadow_.ORSHKN_gdDakFS1OOsHvlFgOC-s1yJU_0 2024-09-12T00:43:55.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.156+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10890604157197839458', time=2024-09-12T02:38:46.065577+0000, chain.objs.size()=1 2024-09-12T00:43:55.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.156+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30__shadow_.nOMUY-AXrtZjQLIszAkSmFUSuQfyL7U_0 2024-09-12T00:43:55.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.156+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7440433251379904798', time=2024-09-12T02:38:47.449807+0000, chain.objs.size()=1 2024-09-12T00:43:55.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.156+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31__shadow_.TkYSyEm0EwTD421XAUf1YAvUJ93Zjio_0 2024-09-12T00:43:55.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.156+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9998973885537633655', time=2024-09-12T02:39:19.444323+0000, chain.objs.size()=1 2024-09-12T00:43:55.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.156+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32__shadow_.bUXHzqveb5jQ9Az1bYOZznkjFaB-Ubs_0 2024-09-12T00:43:55.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.156+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10204711262294079601', time=2024-09-12T02:39:19.450070+0000, chain.objs.size()=1 2024-09-12T00:43:55.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.156+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32__shadow_.FoW1IzCaFIxHp7n4-w-1YVSeKxDTHEX_0 2024-09-12T00:43:55.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.156+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18398058765252008285', time=2024-09-12T02:39:21.920945+0000, chain.objs.size()=1 2024-09-12T00:43:55.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.156+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33__shadow_.TEnminEESWThwrOkp4SB_kWutbsH3Mt_0 2024-09-12T00:43:55.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.160+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:55.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.164+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:43:55.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.164+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.164+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.168+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T00:43:55.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.168+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15982157754764336192', time=2024-09-12T02:35:09.079337+0000, chain.objs.size()=1 2024-09-12T00:43:55.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.168+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7__shadow_.5E5v4SvwsPEdnsTP_f9zUOxXC22_Jkt_0 2024-09-12T00:43:55.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.168+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.177113506426695550', time=2024-09-12T02:36:28.442315+0000, chain.objs.size()=1 2024-09-12T00:43:55.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.168+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21__shadow_.l__hRU1mp-EWO-CtInLG3TfT_Otw1PZ_0 2024-09-12T00:43:55.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.168+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1768690429208541777', time=2024-09-12T02:37:01.034849+0000, chain.objs.size()=1 2024-09-12T00:43:55.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.168+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22__shadow_.8NoTdS7Dh_vnqpmnsUb9wAoo1nSBv7Q_0 2024-09-12T00:43:55.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.168+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10280031761172009843', time=2024-09-12T02:37:35.993493+0000, chain.objs.size()=1 2024-09-12T00:43:55.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.168+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25__shadow_.DhkK2zjZXuDe7rWyzx23ewq7ahPesap_0 2024-09-12T00:43:55.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.168+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10314448597726615138', time=2024-09-12T02:37:36.011283+0000, chain.objs.size()=1 2024-09-12T00:43:55.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.168+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25__shadow_.Bf9y5XK_IuLDOK1u-34LEDK6TIZZ2I2_0 2024-09-12T00:43:55.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.168+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9926288169998143538', time=2024-09-12T02:38:43.782255+0000, chain.objs.size()=1 2024-09-12T00:43:55.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.168+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29__shadow_.nGkrRIXBs3HQrsAJKqJ-byhEEd0iVyg_0 2024-09-12T00:43:55.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.168+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15713760309136361058', time=2024-09-12T02:38:43.805238+0000, chain.objs.size()=1 2024-09-12T00:43:55.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.168+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29__shadow_.JjcErHUnR642217wo_3UjA9D7hXcdW3_0 2024-09-12T00:43:55.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.168+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1158697336462462501', time=2024-09-12T02:38:46.081343+0000, chain.objs.size()=1 2024-09-12T00:43:55.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.168+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30__shadow_.ce4_FRlGoEGkGr5kjxFDo-I7sw-plxX_0 2024-09-12T00:43:55.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.168+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9381487117877863006', time=2024-09-12T02:39:19.443318+0000, chain.objs.size()=1 2024-09-12T00:43:55.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.168+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32__shadow_.5XK-M7G_LrEpzVT118BP4bzczZxEE8o_0 2024-09-12T00:43:55.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.168+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14825057881611448090', time=2024-09-12T02:39:55.577645+0000, chain.objs.size()=1 2024-09-12T00:43:55.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.168+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34__shadow_.kij93ll0FBGFyDdRUWjPq7yv09VscAf_0 2024-09-12T00:43:55.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.168+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13169704471044987987', time=2024-09-12T02:40:33.087024+0000, chain.objs.size()=1 2024-09-12T00:43:55.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.168+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37__shadow_.b4Fw5yY6BtIRn0FQVyZZpW7lUM5hkS5_0 2024-09-12T00:43:55.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.168+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3125406241961232311', time=2024-09-12T02:41:06.321707+0000, chain.objs.size()=1 2024-09-12T00:43:55.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.168+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39__shadow_.9XE1Um_K5ZNzHsMAWEcQIRATOZcuUax_0 2024-09-12T00:43:55.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.172+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:55.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.176+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:43:55.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.180+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.180+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.180+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T00:43:55.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.180+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.648351297012323439', time=2024-09-12T02:36:59.295039+0000, chain.objs.size()=1 2024-09-12T00:43:55.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.180+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21__shadow_.A8vWJJ7EKEZqXfg9dB5WZ-kPxotHSLd_0 2024-09-12T00:43:55.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.180+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8722603602463170502', time=2024-09-12T02:36:59.312964+0000, chain.objs.size()=1 2024-09-12T00:43:55.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.180+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21__shadow_.9dDMs70gPEXEfpKys4rADwWnLOyIHwg_0 2024-09-12T00:43:55.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.180+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15666681681060084313', time=2024-09-12T02:37:02.122314+0000, chain.objs.size()=1 2024-09-12T00:43:55.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.180+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23__shadow_.ENoM5fv9g2PUkkQWT5w3EOPLmfr3PwO_0 2024-09-12T00:43:55.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.180+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18390143280446805493', time=2024-09-12T02:37:35.996648+0000, chain.objs.size()=1 2024-09-12T00:43:55.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.180+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25__shadow_.r1Vsqt9TVnCt74L7B-Dt9rxQ-bdNXqd_0 2024-09-12T00:43:55.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.180+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3797888428182774727', time=2024-09-12T02:38:10.073307+0000, chain.objs.size()=1 2024-09-12T00:43:55.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.180+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27__shadow_.mJdHnCxYlq9Mk7y7dAzK7hd8K1qp2gp_0 2024-09-12T00:43:55.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.180+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6911418586760608764', time=2024-09-12T02:38:11.847242+0000, chain.objs.size()=1 2024-09-12T00:43:55.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.180+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28__shadow_.Qy57gEegaEa-8-nl_V1dxVMsNB-OALo_0 2024-09-12T00:43:55.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.180+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9536709034750321612', time=2024-09-12T02:38:11.853127+0000, chain.objs.size()=1 2024-09-12T00:43:55.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.180+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28__shadow_.iPykHX8H7zy9JostvW-VNNDBmoA7v0V_0 2024-09-12T00:43:55.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.180+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1632013943994236539', time=2024-09-12T02:39:57.980282+0000, chain.objs.size()=1 2024-09-12T00:43:55.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.180+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35__shadow_.4Tkf3KS38G-xkI9dKNFl90fvry8zI5Q_0 2024-09-12T00:43:55.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.180+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.380873597910929540', time=2024-09-12T02:40:33.077791+0000, chain.objs.size()=1 2024-09-12T00:43:55.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.180+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37__shadow_.r9tRG8mLbqiEZV__143dud6Q19OmQ3F_0 2024-09-12T00:43:55.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.180+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11879739958194594920', time=2024-09-12T02:40:34.391873+0000, chain.objs.size()=1 2024-09-12T00:43:55.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.180+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38__shadow_.EJ9gDxanbXTn1iml9czdEoRHfz4CvNy_0 2024-09-12T00:43:55.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.180+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14045632709022003133', time=2024-09-12T02:40:34.414556+0000, chain.objs.size()=1 2024-09-12T00:43:55.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.180+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38__shadow_.zISa3evQXATdOqOmlfmFRmcXU799zk7_0 2024-09-12T00:43:55.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.180+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5869976609004509287', time=2024-09-12T02:41:06.326557+0000, chain.objs.size()=1 2024-09-12T00:43:55.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.180+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39__shadow_.mYoh_JzEOG1I4Nq8nKZf41Ijdj-SY9n_0 2024-09-12T00:43:55.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.184+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12336195008501017803', time=2024-09-12T02:43:28.666324+0000, chain.objs.size()=1 2024-09-12T00:43:55.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.184+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18__shadow:1Mfr0bbveOdwmBAt6SqcRb.FykpHme7_.fahnNm5L1FWWxm8QUi5jp-ydJypHGHu_0 2024-09-12T00:43:55.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.184+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:55.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.188+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:43:55.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.192+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.192+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.192+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T00:43:55.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.192+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4234664961166927016', time=2024-09-12T02:35:08.863442+0000, chain.objs.size()=3 2024-09-12T00:43:55.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.192+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13__shadow_.YzC_ZWEAy9Okmq3mSFpjO_dWedrnDhn_0 2024-09-12T00:43:55.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.192+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13__shadow_.YzC_ZWEAy9Okmq3mSFpjO_dWedrnDhn_1 2024-09-12T00:43:55.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.192+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13__shadow_.YzC_ZWEAy9Okmq3mSFpjO_dWedrnDhn_2 2024-09-12T00:43:55.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.192+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13899939530835135821', time=2024-09-12T02:36:59.294863+0000, chain.objs.size()=1 2024-09-12T00:43:55.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.192+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21__shadow_.ts789-Bff0DjuXtX4hs4Gc7KNz-Lidi_0 2024-09-12T00:43:55.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.192+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.257030919004597858', time=2024-09-12T02:36:59.295604+0000, chain.objs.size()=1 2024-09-12T00:43:55.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.192+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21__shadow_.Qz0gkr2XyhT40d2Q7Flw7qTryh_jTuR_0 2024-09-12T00:43:55.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.192+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15464234710940427998', time=2024-09-12T02:37:36.005272+0000, chain.objs.size()=1 2024-09-12T00:43:55.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.192+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25__shadow_.Srduegcwmb87tZfelLKtzZSt7DrtZIQ_0 2024-09-12T00:43:55.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.192+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.375113466968017817', time=2024-09-12T02:38:46.066627+0000, chain.objs.size()=1 2024-09-12T00:43:55.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.192+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30__shadow_.wJ_YF7FDAmxesv8pjbuUA5pc3As6Bdg_0 2024-09-12T00:43:55.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.192+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4094644179939464565', time=2024-09-12T02:38:46.086594+0000, chain.objs.size()=1 2024-09-12T00:43:55.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.192+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30__shadow_.BI16sTvkC1JSCnH_TdEfYMN09jhF8pU_0 2024-09-12T00:43:55.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.192+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17263126164876510549', time=2024-09-12T02:39:57.983278+0000, chain.objs.size()=1 2024-09-12T00:43:55.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.192+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35__shadow_.k-FT3KSLj6Qf9SPu_ZCIC79SjayotSN_0 2024-09-12T00:43:55.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.192+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15988403304562177194', time=2024-09-12T02:39:57.993907+0000, chain.objs.size()=1 2024-09-12T00:43:55.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.192+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35__shadow_.D43XUJLWKGITvnS3aqRxrcyU5JpFzCS_0 2024-09-12T00:43:55.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.192+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11987155158437158049', time=2024-09-12T02:40:33.066099+0000, chain.objs.size()=1 2024-09-12T00:43:55.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.192+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37__shadow_.9h2uQkonZ5GIy_BqzSmRhTaqc6bxCIY_0 2024-09-12T00:43:55.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.196+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:55.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.200+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:43:55.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.204+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.204+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.204+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:43:55.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.204+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13249047012784091754', time=2024-09-12T02:35:08.190069+0000, chain.objs.size()=1 2024-09-12T00:43:55.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.204+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4__shadow_.fNABO4F-DcNOJ8UbEwB7b0yZ2jXCNOS_0 2024-09-12T00:43:55.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.204+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5335102579593868853', time=2024-09-12T02:35:08.229141+0000, chain.objs.size()=1 2024-09-12T00:43:55.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.204+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4__shadow_.mfwRm_oWd6uHzAEgx8dxMBZIIUUFPl__0 2024-09-12T00:43:55.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.204+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13172032505418704786', time=2024-09-12T02:36:25.203804+0000, chain.objs.size()=1 2024-09-12T00:43:55.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.204+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19__shadow_.mTWE1GLM3M_s-Drj8p8rWXOoArZVJes_0 2024-09-12T00:43:55.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.204+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12173135820937355118', time=2024-09-12T02:36:25.876437+0000, chain.objs.size()=1 2024-09-12T00:43:55.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.204+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19__shadow_.pxvluxUQ3-2iLyWMpdxRFiNb6sXw3PT_0 2024-09-12T00:43:55.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.204+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10896697313921017415', time=2024-09-12T02:36:25.882697+0000, chain.objs.size()=1 2024-09-12T00:43:55.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.204+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19__shadow_.6C4_B6FklWoslYtEgGb_rncpG6smKOI_0 2024-09-12T00:43:55.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.204+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15342423213125194019', time=2024-09-12T02:36:59.298644+0000, chain.objs.size()=1 2024-09-12T00:43:55.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.204+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21__shadow_.utS7g3SOCMUBDO1XaEU2SWxEb15PRox_0 2024-09-12T00:43:55.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.204+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10589222201982482281', time=2024-09-12T02:37:01.032215+0000, chain.objs.size()=1 2024-09-12T00:43:55.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.204+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22__shadow_.u2AJ6ERznGcjYdJ5kCP2G4FpxHALXdD_0 2024-09-12T00:43:55.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.204+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3268217773042551724', time=2024-09-12T02:37:01.045271+0000, chain.objs.size()=1 2024-09-12T00:43:55.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.204+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22__shadow_.0Qmrfq2TAbRJJ3vBJ2ESwsM05wBDRvw_0 2024-09-12T00:43:55.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.204+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9175348323894190522', time=2024-09-12T02:37:02.113168+0000, chain.objs.size()=1 2024-09-12T00:43:55.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.204+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23__shadow_.doEVtj3LgYqc2pzY5OLpZtdSuEvUfdI_0 2024-09-12T00:43:55.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.204+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16476171127695723457', time=2024-09-12T02:39:57.980089+0000, chain.objs.size()=1 2024-09-12T00:43:55.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.204+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35__shadow_._14BZPIUOh8g8CHH7gdrsh5tbG4KkDT_0 2024-09-12T00:43:55.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.204+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17858955351811440370', time=2024-09-12T02:39:57.985897+0000, chain.objs.size()=1 2024-09-12T00:43:55.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.204+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35__shadow_.ATtjvVwzm6LQ7GYgpvz9zcyLU8dD3rP_0 2024-09-12T00:43:55.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.204+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14296366235420324116', time=2024-09-12T02:40:31.281171+0000, chain.objs.size()=1 2024-09-12T00:43:55.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.204+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36__shadow_.2BQBDzCqCGclcb20Fe3T1YAyemVaE80_0 2024-09-12T00:43:55.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.208+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18241905374352994611', time=2024-09-12T02:40:33.075362+0000, chain.objs.size()=1 2024-09-12T00:43:55.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.208+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37__shadow_.OwLaVGG0WhwgURYbG-Vje3H5lkhJsst_0 2024-09-12T00:43:55.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.208+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6812518977439870171', time=2024-09-12T02:41:06.325012+0000, chain.objs.size()=1 2024-09-12T00:43:55.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.208+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39__shadow_.LIDuCq9_Bg59pLLkKketiqaEnwso_-X_0 2024-09-12T00:43:55.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.208+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16584232519414629710', time=2024-09-12T02:43:15.507591+0000, chain.objs.size()=1 2024-09-12T00:43:55.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.208+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17__shadow_._mbQxx4KiU7zqyB8TII-bUnl5UKLGhw_0 2024-09-12T00:43:55.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.208+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:55.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.212+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:43:55.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.216+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.216+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.216+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T00:43:55.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.216+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7623603643247110329', time=2024-09-12T02:35:08.153245+0000, chain.objs.size()=1 2024-09-12T00:43:55.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.216+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4__shadow_.2mkaUfsjbDWY8SoTsM_H2kGaZOeH9gu_0 2024-09-12T00:43:55.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.216+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2861853666878033982', time=2024-09-12T02:35:08.552329+0000, chain.objs.size()=2 2024-09-12T00:43:55.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.216+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.Bs27V-xphV2lwNEmPIweEYK_Evf4vCe_0 2024-09-12T00:43:55.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.216+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.Bs27V-xphV2lwNEmPIweEYK_Evf4vCe_1 2024-09-12T00:43:55.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.216+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.848313501732684850', time=2024-09-12T02:36:25.885240+0000, chain.objs.size()=1 2024-09-12T00:43:55.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.216+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19__shadow_.4KF-C67LNyQdphAo6AI92lv_9yQDx50_0 2024-09-12T00:43:55.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.216+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2064173894321784541', time=2024-09-12T02:36:27.207122+0000, chain.objs.size()=1 2024-09-12T00:43:55.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.216+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20__shadow_.2HHDBd0tO5iAUc1JhNNAMfo8Sztv7X1_0 2024-09-12T00:43:55.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.216+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11094137135476631915', time=2024-09-12T02:37:35.997041+0000, chain.objs.size()=1 2024-09-12T00:43:55.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.216+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25__shadow_.kL71O1ZqDzGf6B3Gvi4VjwokDRGNadC_0 2024-09-12T00:43:55.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.216+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4455329727390624301', time=2024-09-12T02:38:11.858408+0000, chain.objs.size()=1 2024-09-12T00:43:55.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.216+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28__shadow_.RGLqxKZiPYlx7MnkW_Vyt80m-hn--ll_0 2024-09-12T00:43:55.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.216+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14260593351114586129', time=2024-09-12T02:38:47.446326+0000, chain.objs.size()=1 2024-09-12T00:43:55.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.216+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31__shadow_.9JacwdIibrmDEnuhgFQnf5CCRicKw5M_0 2024-09-12T00:43:55.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.216+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2488130659208424535', time=2024-09-12T02:39:55.573553+0000, chain.objs.size()=1 2024-09-12T00:43:55.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.216+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34__shadow_.o3jn1ogtj2QP83MRY2p2o-SMx5bU6C3_0 2024-09-12T00:43:55.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.216+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4952799362713804100', time=2024-09-12T02:40:31.269488+0000, chain.objs.size()=1 2024-09-12T00:43:55.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.216+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36__shadow_.Q-pKWuodvO6reoqvWl52wGlElgbN7Fs_0 2024-09-12T00:43:55.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.216+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3032592200097087579', time=2024-09-12T02:40:33.068239+0000, chain.objs.size()=1 2024-09-12T00:43:55.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.216+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37__shadow_.fdal_p1Wu-k8DfCdcIv6TlZy1sdZ_LE_0 2024-09-12T00:43:55.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.216+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2270276681165327961', time=2024-09-12T02:40:34.414329+0000, chain.objs.size()=1 2024-09-12T00:43:55.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.216+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38__shadow_.PXUQuco68l4GJykCQX_eEQbs6fdFbpw_0 2024-09-12T00:43:55.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.220+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3224526423200998987', time=2024-09-12T02:41:06.332430+0000, chain.objs.size()=1 2024-09-12T00:43:55.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.220+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39__shadow_.AscPYx8BCiNVZNkMAKHvjCc2Z_rfI8Y_0 2024-09-12T00:43:55.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.224+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:55.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.228+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:43:55.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.228+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.228+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.232+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T00:43:55.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.232+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='_8M3QapkVCvt4cF1dY0jRAqVEl3yl1iS', time=2024-09-12T02:35:08.647490+0000, chain.objs.size()=3 2024-09-12T00:43:55.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.232+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_.S1qcVQOZ1VV5eoIcU7MP_y1W_NItoMJ_0 2024-09-12T00:43:55.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.232+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_.S1qcVQOZ1VV5eoIcU7MP_y1W_NItoMJ_1 2024-09-12T00:43:55.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.232+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_.S1qcVQOZ1VV5eoIcU7MP_y1W_NItoMJ_2 2024-09-12T00:43:55.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.232+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10899536655267624408', time=2024-09-12T02:35:09.164011+0000, chain.objs.size()=1 2024-09-12T00:43:55.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.232+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8__shadow_.wIjhIrdGmj7UjqUec5gOuR2-VfWJFL3_0 2024-09-12T00:43:55.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.232+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8122886265025327606', time=2024-09-12T02:36:25.877482+0000, chain.objs.size()=1 2024-09-12T00:43:55.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.232+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19__shadow_.Z1P1t_ARDMILysjSZaZlyclydvwAL2Z_0 2024-09-12T00:43:55.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.232+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.69424091851288851', time=2024-09-12T02:36:25.879807+0000, chain.objs.size()=1 2024-09-12T00:43:55.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.232+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19__shadow_.Jss0ui4TDUcHOBwD6G2y4cMGGMvSfuy_0 2024-09-12T00:43:55.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.232+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14211517268441826046', time=2024-09-12T02:36:25.882317+0000, chain.objs.size()=1 2024-09-12T00:43:55.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.232+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19__shadow_.qnEbMD6yhbtJn4haNrVM4rfBGXpYby3_0 2024-09-12T00:43:55.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.232+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7290051300161188345', time=2024-09-12T02:36:59.296594+0000, chain.objs.size()=1 2024-09-12T00:43:55.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.232+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21__shadow_.5FNYnXX7piTRJu43M8Yf10n4MczrWBk_0 2024-09-12T00:43:55.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.232+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6255238825956438999', time=2024-09-12T02:37:01.029254+0000, chain.objs.size()=1 2024-09-12T00:43:55.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.232+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22__shadow_.50NWyUMOteBX5vS5wxor_Id6dqkuzkM_0 2024-09-12T00:43:55.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.232+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18100798718111407298', time=2024-09-12T02:38:47.448030+0000, chain.objs.size()=1 2024-09-12T00:43:55.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.232+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31__shadow_.TAqUxz8fF7yOM0hsKSdvqMGX8pzLX75_0 2024-09-12T00:43:55.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.232+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10273860534217363524', time=2024-09-12T02:39:21.918901+0000, chain.objs.size()=1 2024-09-12T00:43:55.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.232+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33__shadow_.fR6mZZn3Q-SiuSJgyiS1EJAK8GZZrLG_0 2024-09-12T00:43:55.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.232+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9504760161551483755', time=2024-09-12T02:39:21.931225+0000, chain.objs.size()=1 2024-09-12T00:43:55.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.232+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33__shadow_.9NEPJMSVcp_JB-dKB3w5rkWxPIX1hbb_0 2024-09-12T00:43:55.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.236+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10840199312914702501', time=2024-09-12T02:39:55.560070+0000, chain.objs.size()=1 2024-09-12T00:43:55.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.236+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34__shadow_.KbnHX1ZX8jjwZY39NFvLHZsgrcm2uLn_0 2024-09-12T00:43:55.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.236+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8659754461209241029', time=2024-09-12T02:39:57.978929+0000, chain.objs.size()=1 2024-09-12T00:43:55.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.236+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35__shadow_.knNSNyVVcufxQ9gDQLzXw3eH0mViS68_0 2024-09-12T00:43:55.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.236+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4230539365833909831', time=2024-09-12T02:40:33.072540+0000, chain.objs.size()=1 2024-09-12T00:43:55.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.236+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37__shadow_.GztewJ9gLOkzazFZCwI0ToywRJw5F0W_0 2024-09-12T00:43:55.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.236+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3525218577648297163', time=2024-09-12T02:40:35.675600+0000, chain.objs.size()=1 2024-09-12T00:43:55.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.236+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39__shadow_.GEvV-Qn2_RkU8xsJoL-bO03Rl2G0tkW_0 2024-09-12T00:43:55.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.236+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:55.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.240+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:43:55.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.244+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.244+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.244+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:43:55.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.244+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10642165982363841067', time=2024-09-12T02:35:08.688267+0000, chain.objs.size()=3 2024-09-12T00:43:55.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.244+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-STANDARD.2~pkEBWl0mZWzQQaTpir-Pl3XhXNx1pS9.1 2024-09-12T00:43:55.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.244+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-STANDARD.2~pkEBWl0mZWzQQaTpir-Pl3XhXNx1pS9.2 2024-09-12T00:43:55.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.244+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-STANDARD.2~pkEBWl0mZWzQQaTpir-Pl3XhXNx1pS9.3 2024-09-12T00:43:55.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.244+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8405398835991645494', time=2024-09-12T02:35:09.058176+0000, chain.objs.size()=1 2024-09-12T00:43:55.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.244+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7__shadow_.tFeP0R_VrxpZvsefGLxxgpEToyMBDLf_0 2024-09-12T00:43:55.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.244+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12540353972424407913', time=2024-09-12T02:36:25.887581+0000, chain.objs.size()=1 2024-09-12T00:43:55.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.244+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19__shadow_.SCsR6sx5qEuBDARExMO0HH2mIMInAOS_0 2024-09-12T00:43:55.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.244+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16906565040223120660', time=2024-09-12T02:37:01.028129+0000, chain.objs.size()=1 2024-09-12T00:43:55.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.244+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22__shadow_.aXSUrjS2DX2uxGdakfqHlUuCwIwidXX_0 2024-09-12T00:43:55.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.244+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1714057558115780441', time=2024-09-12T02:37:02.107034+0000, chain.objs.size()=1 2024-09-12T00:43:55.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.244+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23__shadow_.Z0jL9h4DWD1DEshY5f_K8t5TjpTYHWJ_0 2024-09-12T00:43:55.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.244+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12757937073350348073', time=2024-09-12T02:37:37.688026+0000, chain.objs.size()=1 2024-09-12T00:43:55.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.244+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26__shadow_.vAXiSD_JMwmOqcU2tl_qo5P6vxnSayS_0 2024-09-12T00:43:55.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.244+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.401953352836331693', time=2024-09-12T02:37:37.704757+0000, chain.objs.size()=1 2024-09-12T00:43:55.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.244+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26__shadow_.aINvJgx4ijh69TWBJ-3nkFBMBy7S128_0 2024-09-12T00:43:55.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.244+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16373943131045183475', time=2024-09-12T02:38:10.072933+0000, chain.objs.size()=1 2024-09-12T00:43:55.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.244+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27__shadow_.6OpFZMbln2LHQUFtRda2_P7S9-F3YQN_0 2024-09-12T00:43:55.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.244+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7511516753338818480', time=2024-09-12T02:38:46.067986+0000, chain.objs.size()=1 2024-09-12T00:43:55.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.244+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30__shadow_.IvikfF3HwpynSO1NShb645gRT44yutl_0 2024-09-12T00:43:55.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.244+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2174098712986385143', time=2024-09-12T02:38:47.432527+0000, chain.objs.size()=1 2024-09-12T00:43:55.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.244+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31__shadow_._vEEn-P7ilcgEOQcucv_nCVUXJSWpsP_0 2024-09-12T00:43:55.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.248+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12649140581488827237', time=2024-09-12T02:39:19.453715+0000, chain.objs.size()=1 2024-09-12T00:43:55.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.248+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32__shadow_.CpYhZZhwoJSiJoJZi6azZ2kIYFW8MiN_0 2024-09-12T00:43:55.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.248+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17362349451908026661', time=2024-09-12T02:39:21.926769+0000, chain.objs.size()=1 2024-09-12T00:43:55.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.248+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33__shadow_.8P75wsfxn3GsdxFfN_iD7ODk_JKglv9_0 2024-09-12T00:43:55.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.248+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18041612256992812718', time=2024-09-12T02:39:55.571990+0000, chain.objs.size()=1 2024-09-12T00:43:55.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.248+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34__shadow_.mNErfMeHCsy6D5LsAwMSKmQrp_HSG_-_0 2024-09-12T00:43:55.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.248+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12902833163794024957', time=2024-09-12T02:40:34.402687+0000, chain.objs.size()=1 2024-09-12T00:43:55.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.248+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38__shadow_.ywoJKz2LJge6tt2iV_hRiQYLKvQ7W3e_0 2024-09-12T00:43:55.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.248+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12215056348347764578', time=2024-09-12T02:41:06.316830+0000, chain.objs.size()=1 2024-09-12T00:43:55.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.248+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39__shadow_.TmYUOB5j9Edtj4bCyQezRjwHIFLQl3I_0 2024-09-12T00:43:55.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.252+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:55.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.256+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:43:55.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.256+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.260 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.256+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.256+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T00:43:55.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.256+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5459513624560110133', time=2024-09-12T02:35:08.319783+0000, chain.objs.size()=4 2024-09-12T00:43:55.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.256+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12__multipart_foo.2~9Dew88ClR_Fpi6L72VzjdXDDAFHFR5Y.1 2024-09-12T00:43:55.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.256+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12__multipart_foo.2~9Dew88ClR_Fpi6L72VzjdXDDAFHFR5Y.2 2024-09-12T00:43:55.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.260+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12__multipart_foo.2~9Dew88ClR_Fpi6L72VzjdXDDAFHFR5Y.3 2024-09-12T00:43:55.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.260+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12__multipart_foo.2~9Dew88ClR_Fpi6L72VzjdXDDAFHFR5Y.4 2024-09-12T00:43:55.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.260+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17238642701190401679', time=2024-09-12T02:35:08.531055+0000, chain.objs.size()=1 2024-09-12T00:43:55.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.260+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.RUgoiCCOpjQyf-xh9hXB5YFtkU8KlGO_0 2024-09-12T00:43:55.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.260+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11206897429987024110', time=2024-09-12T02:35:08.570105+0000, chain.objs.size()=2 2024-09-12T00:43:55.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.260+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.Bs27V-xphV2lwNEmPIweEYK_Evf4vCe_0 2024-09-12T00:43:55.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.260+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.Bs27V-xphV2lwNEmPIweEYK_Evf4vCe_1 2024-09-12T00:43:55.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.260+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8906399868304950130', time=2024-09-12T02:36:27.206377+0000, chain.objs.size()=1 2024-09-12T00:43:55.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.260+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20__shadow_.hwMQhDK_bfwhXHGJS8CPTCAAYwykqnI_0 2024-09-12T00:43:55.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.260+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13743281488067118993', time=2024-09-12T02:37:01.036138+0000, chain.objs.size()=1 2024-09-12T00:43:55.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.260+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22__shadow_.fNrAwpC2eJfnLLuo2HTeIikfbsKQerF_0 2024-09-12T00:43:55.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.260+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4823221932024914249', time=2024-09-12T02:37:02.100826+0000, chain.objs.size()=1 2024-09-12T00:43:55.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.260+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23__shadow_.CjRbhv0pSsq9osBTDL1JDcZgUvzeylv_0 2024-09-12T00:43:55.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.260+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1204505840428248343', time=2024-09-12T02:37:35.303044+0000, chain.objs.size()=1 2024-09-12T00:43:55.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.260+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25__shadow_.xPZdSGkQYNqyt1n_YRbq24mY1kDahvJ_0 2024-09-12T00:43:55.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.260+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10015468518688067971', time=2024-09-12T02:38:10.070090+0000, chain.objs.size()=1 2024-09-12T00:43:55.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.260+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27__shadow_.rQ7Z6f7zOMPMc0XIvJrFWgbD7TeoivV_0 2024-09-12T00:43:55.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.260+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9643780568347873892', time=2024-09-12T02:38:11.854331+0000, chain.objs.size()=1 2024-09-12T00:43:55.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.260+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28__shadow_.hsK21jl9a1145bWkj8WIzpubWcQTMNg_0 2024-09-12T00:43:55.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.260+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3970095379261647888', time=2024-09-12T02:38:43.784730+0000, chain.objs.size()=1 2024-09-12T00:43:55.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.260+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29__shadow_.BP97xedpbxYNj2MjYjoHYXqLvbbYInZ_0 2024-09-12T00:43:55.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.260+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.697278830636248153', time=2024-09-12T02:38:43.792614+0000, chain.objs.size()=1 2024-09-12T00:43:55.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.260+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29__shadow_.LAAfE0fz90axN7Fo5e1wrBKCa7PN0oR_0 2024-09-12T00:43:55.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.264+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3101241778729931132', time=2024-09-12T02:38:46.063499+0000, chain.objs.size()=1 2024-09-12T00:43:55.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.264+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30__shadow_.azB1axlviKxzHi45KpLTkRjgLPGDHwa_0 2024-09-12T00:43:55.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.264+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10797517601821176320', time=2024-09-12T02:38:46.068432+0000, chain.objs.size()=1 2024-09-12T00:43:55.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.264+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30__shadow_.aCi9eVkkJGMfnFHLgnu7n42aqrHCcnR_0 2024-09-12T00:43:55.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.264+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6610649869627160232', time=2024-09-12T02:38:47.431170+0000, chain.objs.size()=1 2024-09-12T00:43:55.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.264+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31__shadow_.16zYOiDRGAJjvSPanclTxEJ-nItubYH_0 2024-09-12T00:43:55.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.264+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15304573317921207662', time=2024-09-12T02:38:47.431884+0000, chain.objs.size()=1 2024-09-12T00:43:55.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.264+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31__shadow_.wvTzgI0i-ynBRjTrBBtp3J4DQrf6uVW_0 2024-09-12T00:43:55.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.264+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11723799397475493070', time=2024-09-12T02:39:19.445048+0000, chain.objs.size()=1 2024-09-12T00:43:55.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.264+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32__shadow_.LxOxvaV_B991QKI_dL9qOcQWMuaNd2L_0 2024-09-12T00:43:55.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.264+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17311440877033614500', time=2024-09-12T02:39:21.912394+0000, chain.objs.size()=1 2024-09-12T00:43:55.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.264+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33__shadow_.K8wlzAzB6Y36nd5MRHJgQVvXZFErfau_0 2024-09-12T00:43:55.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.264+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15276114397101252196', time=2024-09-12T02:39:21.919340+0000, chain.objs.size()=1 2024-09-12T00:43:55.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.264+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33__shadow_.IaFa1TFAznXdN_poC3IIBLHVmcpTmo-_0 2024-09-12T00:43:55.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.264+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13703131991395413557', time=2024-09-12T02:39:57.978122+0000, chain.objs.size()=1 2024-09-12T00:43:55.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.264+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35__shadow_.ARVOhlz_4WuLpOuzG3uUFS0fFg-nvtE_0 2024-09-12T00:43:55.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.264+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8264079171327608758', time=2024-09-12T02:40:34.408414+0000, chain.objs.size()=1 2024-09-12T00:43:55.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.264+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38__shadow_.yoO8h1H5D1b8-FsbEAFkJyurzkWI1p9_0 2024-09-12T00:43:55.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.264+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3372210252702897727', time=2024-09-12T02:40:34.423490+0000, chain.objs.size()=1 2024-09-12T00:43:55.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.264+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38__shadow_.zTYsZukcEvZVVub-gyKusBNMaROjEnK_0 2024-09-12T00:43:55.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.264+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14077811772794414866', time=2024-09-12T02:41:06.309436+0000, chain.objs.size()=1 2024-09-12T00:43:55.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.268+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39__shadow_.9GEP4exvixXw_3YGyW91huz7nRQj-qs_0 2024-09-12T00:43:55.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.268+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:55.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.272+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:43:55.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.276+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.276+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.276+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T00:43:55.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.276+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='_qS40cf-7sizjH3FLdbNDoa7__HZv6JP', time=2024-09-12T02:35:08.490384+0000, chain.objs.size()=2 2024-09-12T00:43:55.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.276+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.AMSzQMEUvh_fIqHhN5Gy0TdTNmV5XwB_0 2024-09-12T00:43:55.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.276+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15__shadow_.AMSzQMEUvh_fIqHhN5Gy0TdTNmV5XwB_1 2024-09-12T00:43:55.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.276+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6936544339914737657', time=2024-09-12T02:36:59.301102+0000, chain.objs.size()=1 2024-09-12T00:43:55.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.276+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21__shadow_.PrxH1eOF6WJtm_lIwt42-r8r5eoS81__0 2024-09-12T00:43:55.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.276+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17636801135108486839', time=2024-09-12T02:36:59.307790+0000, chain.objs.size()=1 2024-09-12T00:43:55.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.276+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21__shadow_.kpl76gy3C23muW3WDBZyczJOUnwcO2p_0 2024-09-12T00:43:55.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.276+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1613508805887082810', time=2024-09-12T02:37:02.119568+0000, chain.objs.size()=1 2024-09-12T00:43:55.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.276+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23__shadow_.EVCP_O_tnynZ7QMkDDEbiFTiW79LUSq_0 2024-09-12T00:43:55.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.276+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4044682813827409797', time=2024-09-12T02:38:43.785750+0000, chain.objs.size()=1 2024-09-12T00:43:55.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.276+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29__shadow_.nBsz88THEiIhrCZ625kdSdYOp4WDde4_0 2024-09-12T00:43:55.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.276+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15161158564700092396', time=2024-09-12T02:38:46.063071+0000, chain.objs.size()=1 2024-09-12T00:43:55.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.276+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.30__shadow_.IGzoDadd5WoAWiY7_ScmKfN2pCQ2VbT_0 2024-09-12T00:43:55.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.276+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16641318583355025944', time=2024-09-12T02:38:47.431384+0000, chain.objs.size()=1 2024-09-12T00:43:55.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.276+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31__shadow_.Ghf8CEM9SQSKQMfr-TWSyo04xU7eTm-_0 2024-09-12T00:43:55.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.276+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12003187344545008827', time=2024-09-12T02:38:47.439667+0000, chain.objs.size()=1 2024-09-12T00:43:55.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.276+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31__shadow_.KZ9PCLr1u2hkvhTMypl9DilQr99lsCJ_0 2024-09-12T00:43:55.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.276+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17582211007864742015', time=2024-09-12T02:39:57.991126+0000, chain.objs.size()=1 2024-09-12T00:43:55.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.276+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35__shadow_.ZaPrpi3TK0lRxEW84NftMGUvHXSPH8u_0 2024-09-12T00:43:55.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.276+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1139956011960470120', time=2024-09-12T02:40:31.271857+0000, chain.objs.size()=1 2024-09-12T00:43:55.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.276+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36__shadow_._UhHnFHK_p0GZKS2_pBn7iNaaNawYPQ_0 2024-09-12T00:43:55.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.276+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12872510240498270544', time=2024-09-12T02:40:31.278066+0000, chain.objs.size()=1 2024-09-12T00:43:55.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.276+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36__shadow_.2z8XU6wa593nVdnr0Zx1UnxlMmKu9cv_0 2024-09-12T00:43:55.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.280+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15897838601917649076', time=2024-09-12T02:40:31.280838+0000, chain.objs.size()=1 2024-09-12T00:43:55.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.280+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36__shadow_.NvLQsEorECcNK8f8UFYW-MaT6M0PlhO_0 2024-09-12T00:43:55.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.280+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4641307196557647760', time=2024-09-12T02:40:33.064019+0000, chain.objs.size()=1 2024-09-12T00:43:55.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.280+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37__shadow_.-5SykD0XmY5Vw9G9YJklnduRUUrJbCi_0 2024-09-12T00:43:55.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.280+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15344897423559762428', time=2024-09-12T02:40:33.083212+0000, chain.objs.size()=1 2024-09-12T00:43:55.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.284+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37__shadow_.YIKeImRHWwIA4t6eQQVP79mwbAsLo16_0 2024-09-12T00:43:55.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.284+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:55.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.288+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:43:55.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.288+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.292+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.292+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T00:43:55.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.292+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14772207261947257703', time=2024-09-12T02:35:08.210574+0000, chain.objs.size()=1 2024-09-12T00:43:55.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.292+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4__shadow_._Li8sdIe3PxXOZQentqAnQQAkInlisS_0 2024-09-12T00:43:55.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.292+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1351026596569737777', time=2024-09-12T02:36:27.209895+0000, chain.objs.size()=1 2024-09-12T00:43:55.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.292+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20__shadow_.GVTRfB5pu4YsypqNSQNzOgrH3fElqiy_0 2024-09-12T00:43:55.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.292+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11305229497888010251', time=2024-09-12T02:36:59.305999+0000, chain.objs.size()=1 2024-09-12T00:43:55.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.292+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.21__shadow_.SdQ5pbg8rXPl0Ayn438BUBJuHOFJB06_0 2024-09-12T00:43:55.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.292+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4412550390926504740', time=2024-09-12T02:37:33.983247+0000, chain.objs.size()=1 2024-09-12T00:43:55.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.292+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24__shadow_.92oqsQTfgwuIuAxP74L7CVmkwsLmZAJ_0 2024-09-12T00:43:55.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.292+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4193226193270674923', time=2024-09-12T02:37:36.007104+0000, chain.objs.size()=1 2024-09-12T00:43:55.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.292+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25__shadow_.i-KNmDFK3GKSAUbPnVzBqH3bLzLgAQt_0 2024-09-12T00:43:55.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.292+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2703601010533577499', time=2024-09-12T02:37:37.679902+0000, chain.objs.size()=1 2024-09-12T00:43:55.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.292+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26__shadow_.Dxf-tsKxTnTJmUNz_F2TGwqIQyvWolN_0 2024-09-12T00:43:55.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.292+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2790116766431256908', time=2024-09-12T02:37:37.693407+0000, chain.objs.size()=1 2024-09-12T00:43:55.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.292+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26__shadow_.WucXcWyEg-x0Hb1shPUzTwGC4LzPJhs_0 2024-09-12T00:43:55.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.292+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4988669052044945615', time=2024-09-12T02:37:39.170309+0000, chain.objs.size()=1 2024-09-12T00:43:55.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.292+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27__shadow_.jwVoS_3EvTBPIifoalo5AHwL022ktgp_0 2024-09-12T00:43:55.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.292+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.531684168745077069', time=2024-09-12T02:38:10.074338+0000, chain.objs.size()=1 2024-09-12T00:43:55.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.292+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27__shadow_.NCITYP5_PTFv3HS4kp0RD1UOLcWGdKa_0 2024-09-12T00:43:55.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.292+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2590810189304245909', time=2024-09-12T02:38:43.791081+0000, chain.objs.size()=1 2024-09-12T00:43:55.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.292+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29__shadow_.JdJHfrxsBqzZAlENKtLyFAfPOoQrXeN_0 2024-09-12T00:43:55.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.292+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16355941053509180420', time=2024-09-12T02:38:43.793142+0000, chain.objs.size()=1 2024-09-12T00:43:55.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.292+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29__shadow_.ZSQpDdtcwD_k-QADxfFzQ2cnsr7mlYd_0 2024-09-12T00:43:55.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.292+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3267514075799078166', time=2024-09-12T02:38:47.431282+0000, chain.objs.size()=1 2024-09-12T00:43:55.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.292+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31__shadow_.L-_XJMjmodJOnfJLxxNKBmDTSlbN-OY_0 2024-09-12T00:43:55.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.296+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7586560853875927645', time=2024-09-12T02:38:47.442137+0000, chain.objs.size()=1 2024-09-12T00:43:55.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.296+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31__shadow_.Ba5h6yXBmJtDWGywLI4_E7cR7Nvnwp1_0 2024-09-12T00:43:55.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.296+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7721014268096157365', time=2024-09-12T02:39:19.451277+0000, chain.objs.size()=1 2024-09-12T00:43:55.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.296+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32__shadow_.3Uo-QNxpjTVoMAOGPDSd9KLgi0Xa-3k_0 2024-09-12T00:43:55.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.296+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5141975370595721496', time=2024-09-12T02:39:21.226767+0000, chain.objs.size()=1 2024-09-12T00:43:55.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.296+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33__shadow_.KmWW1g0RbZUwagNXHiphmaXWH140906_0 2024-09-12T00:43:55.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.296+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4647843706896881632', time=2024-09-12T02:39:55.563295+0000, chain.objs.size()=1 2024-09-12T00:43:55.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.296+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34__shadow_.ZkIyOaZ7FilCbSzzLNFoK7r-uImSyt8_0 2024-09-12T00:43:55.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.296+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17974460291488464070', time=2024-09-12T02:39:55.565115+0000, chain.objs.size()=1 2024-09-12T00:43:55.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.296+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34__shadow_.g0TFzpFowR0Y64-h5MSDkNTNHenE2kK_0 2024-09-12T00:43:55.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.296+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1292533301352412049', time=2024-09-12T02:40:33.068574+0000, chain.objs.size()=1 2024-09-12T00:43:55.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.296+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37__shadow_.4hx5uNvoXAqbLrU4PvItlai7ZMeBfk6_0 2024-09-12T00:43:55.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.296+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5540786496474037817', time=2024-09-12T02:40:33.073945+0000, chain.objs.size()=1 2024-09-12T00:43:55.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.296+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37__shadow_._RZTBkMuAVSbvIhlbTxW17hZDhThKxp_0 2024-09-12T00:43:55.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.300+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:55.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.304+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:43:55.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.304+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.308+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.308+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T00:43:55.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.308+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14372164355579038794', time=2024-09-12T02:35:08.171160+0000, chain.objs.size()=1 2024-09-12T00:43:55.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.308+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4__shadow_.AtXnAxgcNNNCgL15Taqdiq6qW520Edf_0 2024-09-12T00:43:55.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.308+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='_n240v2xxlm35e7Lk09bzDvFASMqNG2A', time=2024-09-12T02:35:08.737966+0000, chain.objs.size()=1 2024-09-12T00:43:55.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.308+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_.WJ_sUtdtGu3s5Y8-eF8_JZYh40VouDg_0 2024-09-12T00:43:55.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.308+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17534021336069014442', time=2024-09-12T02:35:08.874239+0000, chain.objs.size()=3 2024-09-12T00:43:55.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.308+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13__shadow_.gczsEnIPgY29ydNRw4obXtKfciyEE_O_0 2024-09-12T00:43:55.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.308+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13__shadow_.gczsEnIPgY29ydNRw4obXtKfciyEE_O_1 2024-09-12T00:43:55.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.308+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13__shadow_.gczsEnIPgY29ydNRw4obXtKfciyEE_O_2 2024-09-12T00:43:55.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.308+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9997276496884480713', time=2024-09-12T02:36:25.887563+0000, chain.objs.size()=1 2024-09-12T00:43:55.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.308+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.19__shadow_.KLF4uEGOJakuX3zt_uoSCrVrVdH7ErC_0 2024-09-12T00:43:55.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.308+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9685406291191062806', time=2024-09-12T02:37:01.034057+0000, chain.objs.size()=1 2024-09-12T00:43:55.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.308+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22__shadow_.3XPed_bQ7gN7HV8Q-t9Sjv8uNcbOqI__0 2024-09-12T00:43:55.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.308+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1445294713138210098', time=2024-09-12T02:37:01.051033+0000, chain.objs.size()=1 2024-09-12T00:43:55.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.308+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22__shadow_.oFNEzuyXY3-WsHkPCpQrvk4UbLNMqNJ_0 2024-09-12T00:43:55.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.308+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11952728391840458082', time=2024-09-12T02:37:02.112444+0000, chain.objs.size()=1 2024-09-12T00:43:55.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.308+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23__shadow_.NuloTUC97JxZKbkYvX7V08H2RKuBE0T_0 2024-09-12T00:43:55.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.308+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2665249201523682370', time=2024-09-12T02:37:33.990064+0000, chain.objs.size()=1 2024-09-12T00:43:55.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.308+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24__shadow_.8pJkNvjppSq0FG5Beu3kCaajMPrsfk8_0 2024-09-12T00:43:55.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.308+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16821911987563482939', time=2024-09-12T02:37:36.014861+0000, chain.objs.size()=1 2024-09-12T00:43:55.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.308+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25__shadow_.y-Y66WQXJoYiRTL3we4SJ1MYYtCKwjV_0 2024-09-12T00:43:55.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.308+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6429144336076228793', time=2024-09-12T02:38:10.089400+0000, chain.objs.size()=1 2024-09-12T00:43:55.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.308+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.27__shadow_.K0VjfUb647WkefdDra_8AkOnP6Wbhkk_0 2024-09-12T00:43:55.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.312+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12733104509843065458', time=2024-09-12T02:38:11.844059+0000, chain.objs.size()=1 2024-09-12T00:43:55.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.312+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28__shadow_.Sns0Y94Z7MtBjE1oO4rU86JMDqqbpIn_0 2024-09-12T00:43:55.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.312+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11885237082609527280', time=2024-09-12T02:38:47.432509+0000, chain.objs.size()=1 2024-09-12T00:43:55.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.312+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.31__shadow_.7a3I6LOJ-4KcyBtHd1G_XhXg4MOnnoB_0 2024-09-12T00:43:55.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.312+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18294657932703999659', time=2024-09-12T02:39:18.989802+0000, chain.objs.size()=1 2024-09-12T00:43:55.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.312+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32__shadow_.sksCTfHkIc6_CsaZZSEuggMZEF3I75t_0 2024-09-12T00:43:55.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.312+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18059195402287928180', time=2024-09-12T02:39:55.575409+0000, chain.objs.size()=1 2024-09-12T00:43:55.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.312+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34__shadow_.EYFpUNFEJ4y6fPqXw8utzy9IPcbLX0N_0 2024-09-12T00:43:55.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.312+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7977320547432847203', time=2024-09-12T02:39:55.577455+0000, chain.objs.size()=1 2024-09-12T00:43:55.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.312+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34__shadow_.VxXo8vahpcVGXjBvipoXjcjWq5wnOxQ_0 2024-09-12T00:43:55.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.312+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11018684919658400112', time=2024-09-12T02:40:32.600343+0000, chain.objs.size()=1 2024-09-12T00:43:55.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.312+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37__shadow_.JosK9I74rE_GLpyXtlIoEggNv829JFd_0 2024-09-12T00:43:55.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.312+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.897558128831014991', time=2024-09-12T02:40:33.063460+0000, chain.objs.size()=1 2024-09-12T00:43:55.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.312+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.37__shadow_.53EZdMNk3InrK3BztqKSoGOfG_2LtJs_0 2024-09-12T00:43:55.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.312+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.680579897177701329', time=2024-09-12T02:40:34.409855+0000, chain.objs.size()=1 2024-09-12T00:43:55.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.312+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38__shadow_.FOnTWdS5B0rr29kIXqiRjc0pAv1cl6O_0 2024-09-12T00:43:55.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.312+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15864646729686525353', time=2024-09-12T02:40:34.419208+0000, chain.objs.size()=1 2024-09-12T00:43:55.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.312+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38__shadow_.8jnEiDiHZfhdR5jmXcItwGCxL0iH1Z0_0 2024-09-12T00:43:55.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.312+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17142940685684374510', time=2024-09-12T02:41:06.329234+0000, chain.objs.size()=1 2024-09-12T00:43:55.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.312+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39__shadow_.FgGBz9vg9OqtbbRpOKYTtFLpmvDU4Zv_0 2024-09-12T00:43:55.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.312+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8022952226211333025', time=2024-09-12T02:43:15.508593+0000, chain.objs.size()=1 2024-09-12T00:43:55.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.312+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17__shadow_.aYOv0o9YYUCrQKMPKNATjpQB4cZ-Qag_0 2024-09-12T00:43:55.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.316+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9789212425794600640', time=2024-09-12T02:43:23.380190+0000, chain.objs.size()=1 2024-09-12T00:43:55.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.316+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18__shadow:jSjUb3f3J-v-WIizgm76GYZxhS93b-p_.GLhGf9ndyOh5mE2Z4bnBa5ppwBa751L_0 2024-09-12T00:43:55.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.316+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:55.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.320+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:43:55.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.324+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.324+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.324+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T00:43:55.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.324+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12444483010910242781', time=2024-09-12T02:35:08.161649+0000, chain.objs.size()=1 2024-09-12T00:43:55.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.324+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4__shadow_.f7zIRSQb3Jhvb8R_YaE7Dge7pqpatgZ_0 2024-09-12T00:43:55.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.324+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6579173781538069849', time=2024-09-12T02:35:08.746352+0000, chain.objs.size()=5 2024-09-12T00:43:55.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.324+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-FROZEN.2~P942SXcFkTD-6dFquWC0zIBymeiN8WY.1 2024-09-12T00:43:55.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.324+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_foo-FROZEN.2~P942SXcFkTD-6dFquWC0zIBymeiN8WY.1_1 2024-09-12T00:43:55.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.324+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-FROZEN.2~P942SXcFkTD-6dFquWC0zIBymeiN8WY.2 2024-09-12T00:43:55.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.324+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_foo-FROZEN.2~P942SXcFkTD-6dFquWC0zIBymeiN8WY.2_1 2024-09-12T00:43:55.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.324+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__multipart_foo-FROZEN.2~P942SXcFkTD-6dFquWC0zIBymeiN8WY.3 2024-09-12T00:43:55.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.324+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15539763064239720463', time=2024-09-12T02:35:08.805273+0000, chain.objs.size()=3 2024-09-12T00:43:55.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.324+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14__multipart_foo-STANDARD.2~Gw86xeAuK-qODsh5PSJvZ8Ce9zud5CN.1 2024-09-12T00:43:55.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.324+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14__multipart_foo-STANDARD.2~Gw86xeAuK-qODsh5PSJvZ8Ce9zud5CN.2 2024-09-12T00:43:55.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.324+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14__multipart_foo-STANDARD.2~Gw86xeAuK-qODsh5PSJvZ8Ce9zud5CN.3 2024-09-12T00:43:55.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.324+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7994217959325778452', time=2024-09-12T02:35:09.088480+0000, chain.objs.size()=1 2024-09-12T00:43:55.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.324+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7__shadow_.9eZP4pB8ahN7gyXXmYaXOOhoBh6z-ib_0 2024-09-12T00:43:55.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.324+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17280219969980869554', time=2024-09-12T02:36:27.203784+0000, chain.objs.size()=1 2024-09-12T00:43:55.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.324+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20__shadow_.Gl1MtruQ9q-R_HT2yJV1Grvhnw9qH-W_0 2024-09-12T00:43:55.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.324+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12030857578643546001', time=2024-09-12T02:36:27.206809+0000, chain.objs.size()=1 2024-09-12T00:43:55.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.324+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20__shadow_.vJxlF8o7Eo-Tqxee6EsTDp2k6fLpNon_0 2024-09-12T00:43:55.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.328+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7038196473581269812', time=2024-09-12T02:36:27.207748+0000, chain.objs.size()=1 2024-09-12T00:43:55.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.328+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20__shadow_.N1sDL1biaL5Xf634N8jzYpyU0u1kUa3_0 2024-09-12T00:43:55.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.328+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17318727848586203264', time=2024-09-12T02:37:02.099257+0000, chain.objs.size()=1 2024-09-12T00:43:55.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.328+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.23__shadow_.jg-SzlagmJvsoOVFl5Pa8lFNpvHYoDD_0 2024-09-12T00:43:55.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.328+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16420061066203758440', time=2024-09-12T02:37:33.984246+0000, chain.objs.size()=1 2024-09-12T00:43:55.333 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.328+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24__shadow_.tNig5OnK_XbzvJFg6x5vnwqD11Y5iZi_0 2024-09-12T00:43:55.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.332+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10090327191151062398', time=2024-09-12T02:37:35.996781+0000, chain.objs.size()=1 2024-09-12T00:43:55.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.332+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25__shadow_.zKpoflpbvypu3lZmEh-3wMKLcD1Txri_0 2024-09-12T00:43:55.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.332+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1623143684782580435', time=2024-09-12T02:37:37.700911+0000, chain.objs.size()=1 2024-09-12T00:43:55.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.332+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26__shadow_.0AdXvkcQv-0fv2wA-lUZwECYSNy7wSL_0 2024-09-12T00:43:55.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.332+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4383411623003106734', time=2024-09-12T02:38:11.843427+0000, chain.objs.size()=1 2024-09-12T00:43:55.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.332+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.28__shadow_.iIEdJ20UXgIRS-D-gwoBifAG1MOG4z3_0 2024-09-12T00:43:55.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.332+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9417498838593981841', time=2024-09-12T02:39:19.451713+0000, chain.objs.size()=1 2024-09-12T00:43:55.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.332+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32__shadow_.SlcDvZYyYv93MRT7z8v6Jek9AZr_NoZ_0 2024-09-12T00:43:55.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.332+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14959872801762968536', time=2024-09-12T02:39:19.456800+0000, chain.objs.size()=1 2024-09-12T00:43:55.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.332+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.32__shadow_.OWU07ZKwmYwI9JXDkl7x0sAINVdoP1O_0 2024-09-12T00:43:55.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.332+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5009903517198016406', time=2024-09-12T02:39:21.916471+0000, chain.objs.size()=1 2024-09-12T00:43:55.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.332+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33__shadow_.9TYXeF69l-3y2Ps2_hNzUbcpJAhnli-_0 2024-09-12T00:43:55.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.332+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12995591744311470511', time=2024-09-12T02:40:31.260564+0000, chain.objs.size()=1 2024-09-12T00:43:55.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.332+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36__shadow_.kV1TXdyqRvmnzrnuQKRNUmW6OYXTc0j_0 2024-09-12T00:43:55.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.332+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2688600406333382031', time=2024-09-12T02:40:34.408517+0000, chain.objs.size()=1 2024-09-12T00:43:55.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.332+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.38__shadow_.ZG1wXLV9pU5Voy1kYNw-o01T110lvBi_0 2024-09-12T00:43:55.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.332+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17370251570670409981', time=2024-09-12T02:41:06.316291+0000, chain.objs.size()=1 2024-09-12T00:43:55.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.332+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39__shadow_.s7W9FpEsMKWlvbCGGxCur2wlgNKBjew_0 2024-09-12T00:43:55.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.332+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6112334911553131979', time=2024-09-12T02:43:15.509739+0000, chain.objs.size()=1 2024-09-12T00:43:55.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.332+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17__shadow_.o2xtDMTgtsimQqyf96eU0lQikCwwuL2_0 2024-09-12T00:43:55.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.336+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:55.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.340+0000 7f08184c29c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:43:55.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.340+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.344+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.344+0000 7f08184c29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T00:43:55.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.344+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='_QXCBjskwr6zeSMRth9uycTWo8UcTQqM', time=2024-09-12T02:35:08.667018+0000, chain.objs.size()=3 2024-09-12T00:43:55.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.344+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_.pheGyNTOXoufeFeT1Jlo7SQdcXVvzRO_0 2024-09-12T00:43:55.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.344+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_.pheGyNTOXoufeFeT1Jlo7SQdcXVvzRO_1 2024-09-12T00:43:55.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.344+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16__shadow_.pheGyNTOXoufeFeT1Jlo7SQdcXVvzRO_2 2024-09-12T00:43:55.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.344+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2743274120737258974', time=2024-09-12T02:36:27.201577+0000, chain.objs.size()=1 2024-09-12T00:43:55.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.344+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.20__shadow_.9bjE9XaXCbfJ3uJ4Lfn-darnecwSbgM_0 2024-09-12T00:43:55.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.344+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1250012747282897606', time=2024-09-12T02:37:01.044503+0000, chain.objs.size()=1 2024-09-12T00:43:55.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.344+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.22__shadow_.mwiN6v0K7mVdUcPHqwWAugMdJCqLdfE_0 2024-09-12T00:43:55.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.344+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8920931890053767839', time=2024-09-12T02:37:33.988483+0000, chain.objs.size()=1 2024-09-12T00:43:55.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.344+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24__shadow_.Seyae0Djb6lbGpHrbOOUhB1vVK5uAVJ_0 2024-09-12T00:43:55.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.344+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18209445430406316390', time=2024-09-12T02:37:36.009678+0000, chain.objs.size()=1 2024-09-12T00:43:55.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.344+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.25__shadow_.NI_12dBUoUsTZr_rwNdy_gcQeNMmb7X_0 2024-09-12T00:43:55.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.344+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15166646029657970356', time=2024-09-12T02:37:37.677959+0000, chain.objs.size()=1 2024-09-12T00:43:55.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.344+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.26__shadow_.9tj7VIip9cC5H0ZI_CVGKXXLOipbSLG_0 2024-09-12T00:43:55.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.344+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8080574082924784559', time=2024-09-12T02:38:43.786975+0000, chain.objs.size()=1 2024-09-12T00:43:55.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.344+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29__shadow_.hACxShQE_GhGQsKDl0AkxzPFvxTRdHx_0 2024-09-12T00:43:55.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.344+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18440953218477910911', time=2024-09-12T02:39:21.931211+0000, chain.objs.size()=1 2024-09-12T00:43:55.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.344+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.33__shadow_.BGEZiOifdFLjtBaB4bxPesLbAjWZpZO_0 2024-09-12T00:43:55.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.344+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7487953817869438931', time=2024-09-12T02:39:55.570712+0000, chain.objs.size()=1 2024-09-12T00:43:55.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.344+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.34__shadow_.ZLfZ9qkssThRttMBfNFJq3_54AHIB36_0 2024-09-12T00:43:55.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.344+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8067537155286430386', time=2024-09-12T02:39:57.979740+0000, chain.objs.size()=1 2024-09-12T00:43:55.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.344+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.35__shadow_.NJ3wNBKfMFQ8wul0SHTy6Vo6SgbEc5W_0 2024-09-12T00:43:55.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.348+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14859748281806276502', time=2024-09-12T02:41:06.315665+0000, chain.objs.size()=1 2024-09-12T00:43:55.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.348+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39__shadow_.0aOQVlexxXNp39jw1KGhXGWxmC6fdI1_0 2024-09-12T00:43:55.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.348+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12760926114806050049', time=2024-09-12T02:41:06.320355+0000, chain.objs.size()=1 2024-09-12T00:43:55.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.348+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.39__shadow_.nNWD_ebe0AlMRyP52d-znKa16W2UU9n_0 2024-09-12T00:43:55.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.348+0000 7f08184c29c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16977021860747306723', time=2024-09-12T02:43:15.510396+0000, chain.objs.size()=1 2024-09-12T00:43:55.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.348+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17__shadow_.Na4uwnRLIx8d5-VEEPeUB7l-NowxMWT_0 2024-09-12T00:43:55.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.352+0000 7f08184c29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:55.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.356+0000 7f06c77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:55.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.360+0000 7f08184c29c0 20 remove_watcher() i=0 2024-09-12T00:43:55.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.360+0000 7f08184c29c0 2 removed watcher, disabling cache 2024-09-12T00:43:55.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.360+0000 7f08184c29c0 20 remove_watcher() i=1 2024-09-12T00:43:55.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.364+0000 7f08184c29c0 20 remove_watcher() i=2 2024-09-12T00:43:55.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.364+0000 7f08184c29c0 20 remove_watcher() i=3 2024-09-12T00:43:55.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.368+0000 7f08184c29c0 20 remove_watcher() i=4 2024-09-12T00:43:55.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.368+0000 7f08184c29c0 20 remove_watcher() i=5 2024-09-12T00:43:55.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.368+0000 7f08184c29c0 20 remove_watcher() i=6 2024-09-12T00:43:55.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.372+0000 7f08184c29c0 20 remove_watcher() i=7 2024-09-12T00:43:55.391 DEBUG:teuthology.orchestra.run.smithi043:> radosgw-admin gc process --include-all 2024-09-12T00:43:55.465 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:55.465 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:55.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.512+0000 7fbddf2e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:55.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.512+0000 7fbddf2e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:55.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.512+0000 7fbddf2e39c0 20 realm 2024-09-12T00:43:55.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.512+0000 7fbddf2e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:55.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.512+0000 7fbddf2e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:55.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.512+0000 7fbddf2e39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:55.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.512+0000 7fbddf2e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:55.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.512+0000 7fbddf2e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:55.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.512+0000 7fbddf2e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:55.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.720+0000 7fbddf2e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:55.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.720+0000 7fbddf2e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:55.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.724+0000 7fbddf2e39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:55.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.724+0000 7fbddf2e39c0 20 searching for the correct realm 2024-09-12T00:43:55.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.732+0000 7fbddcde9640 0 -- 172.21.15.43:0/4112611951 >> [v2:172.21.15.97:6816/489545787,v1:172.21.15.97:6817/489545787] conn(0x7fbdcc061040 msgr2=0x7fbdcc05fab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:55.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.740+0000 7fbddcde9640 0 -- 172.21.15.43:0/4112611951 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fbdd0066dc0 msgr2=0x7fbdd006e6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:55.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.756+0000 7fbddf2e39c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:43:55.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.756+0000 7fbddf2e39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:55.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.756+0000 7fbddf2e39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:55.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.756+0000 7fbddf2e39c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:43:55.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.756+0000 7fbddf2e39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:55.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.756+0000 7fbddf2e39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:55.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.756+0000 7fbddf2e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:55.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.756+0000 7fbddf2e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:55.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.756+0000 7fbddf2e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:55.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.756+0000 7fbddf2e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:55.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.756+0000 7fbddf2e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:55.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.756+0000 7fbddf2e39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:55.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.756+0000 7fbddf2e39c0 20 zone default found 2024-09-12T00:43:55.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.756+0000 7fbddf2e39c0 4 Realm: () 2024-09-12T00:43:55.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.756+0000 7fbddf2e39c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:43:55.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.756+0000 7fbddf2e39c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:43:55.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.756+0000 7fbddf2e39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:55.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.756+0000 7fbddf2e39c0 20 zonegroup default 2024-09-12T00:43:55.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.756+0000 7fbddf2e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:55.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.760+0000 7fbddf2e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:55.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.760+0000 7fbddf2e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:55.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.760+0000 7fbddf2e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:55.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.760+0000 7fbddf2e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:55.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.760+0000 7fbddf2e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:55.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.760+0000 7fbddf2e39c0 20 started sync module instance, tier type = 2024-09-12T00:43:55.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.760+0000 7fbddf2e39c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:43:55.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.784+0000 7fbddf2e39c0 20 add_watcher() i=0 2024-09-12T00:43:55.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.784+0000 7fbddf2e39c0 20 add_watcher() i=1 2024-09-12T00:43:55.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.784+0000 7fbddf2e39c0 20 add_watcher() i=2 2024-09-12T00:43:55.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.784+0000 7fbddf2e39c0 20 add_watcher() i=3 2024-09-12T00:43:55.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.784+0000 7fbddf2e39c0 20 add_watcher() i=4 2024-09-12T00:43:55.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.784+0000 7fbddf2e39c0 20 add_watcher() i=5 2024-09-12T00:43:55.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.784+0000 7fbddf2e39c0 20 add_watcher() i=6 2024-09-12T00:43:55.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.788+0000 7fbddf2e39c0 20 add_watcher() i=7 2024-09-12T00:43:55.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.788+0000 7fbddf2e39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:55.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.792+0000 7fbc937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:55.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.792+0000 7fbddf2e39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:55.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.792+0000 7fbddf2e39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:55.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.896+0000 7fbc927e4640 20 reqs_thread_entry: start 2024-09-12T00:43:55.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.896+0000 7fbddf2e39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:55.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.896+0000 7fbddf2e39c0 20 Filter name: none 2024-09-12T00:43:55.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.896+0000 7fbc8b7fe640 20 reqs_thread_entry: start 2024-09-12T00:43:55.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.896+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:43:55.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.900+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.900+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.900+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.904+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:43:55.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.904+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.904+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.908+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.908+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:43:55.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.912+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.912+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.916+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.916+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:43:55.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.920+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.920+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.924+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.924+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:43:55.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.928+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.928+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.932+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.932+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:43:55.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.936+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.936+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.936+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.940+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:43:55.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.944+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.944+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.944+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.948+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:43:55.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.952+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.952+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.952+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.956+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:43:55.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.960+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.964+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.964+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.968+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:43:55.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.968+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.968+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.968+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.972+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:43:55.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.976+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.976+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.976+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.980+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:43:55.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.984+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.984+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.984+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.988+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:43:55.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.992+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.992+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:55.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.992+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:55.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:55.996+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:43:56.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.000+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.000+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:56.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.004+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.004+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:43:56.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.008+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.012+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:56.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.012+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.016+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:43:56.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.020+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.020+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:56.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.020+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.024+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:43:56.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.028+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.028+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:56.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.032+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.032+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:43:56.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.036+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.036+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:56.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.036+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.040+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:43:56.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.044+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.044+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:56.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.048+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.052+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:43:56.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.056+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.056+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:56.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.056+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.060+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:43:56.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.064+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.064+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:56.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.068+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.068+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:43:56.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.072+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.072+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:56.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.076+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.076+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:43:56.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.080+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.084+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:56.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.084+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.084+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:43:56.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.088+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.088+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:56.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.088+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.092+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:43:56.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.096+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.096+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:56.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.096+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.100+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:43:56.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.104+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.108+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:56.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.108+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.112+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:43:56.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.116+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.116+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:56.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.116+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.120+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:43:56.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.124+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.124+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:56.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.128+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.128+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:43:56.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.132+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.136+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:56.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.136+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.136+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:43:56.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.140+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.144+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:56.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.144+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.148+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:43:56.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.152+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.152+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:56.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.152+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.156+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:43:56.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.160+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.160+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:56.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.160+0000 7fbddf2e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:56.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.168+0000 7fbc937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:56.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.172+0000 7fbddf2e39c0 20 remove_watcher() i=0 2024-09-12T00:43:56.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.172+0000 7fbddf2e39c0 2 removed watcher, disabling cache 2024-09-12T00:43:56.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.176+0000 7fbddf2e39c0 20 remove_watcher() i=1 2024-09-12T00:43:56.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.180+0000 7fbddf2e39c0 20 remove_watcher() i=2 2024-09-12T00:43:56.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.180+0000 7fbddf2e39c0 20 remove_watcher() i=3 2024-09-12T00:43:56.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.184+0000 7fbddf2e39c0 20 remove_watcher() i=4 2024-09-12T00:43:56.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.188+0000 7fbddf2e39c0 20 remove_watcher() i=5 2024-09-12T00:43:56.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.188+0000 7fbddf2e39c0 20 remove_watcher() i=6 2024-09-12T00:43:56.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:43:56.192+0000 7fbddf2e39c0 20 remove_watcher() i=7 2024-09-12T00:43:56.216 DEBUG:teuthology.orchestra.run.smithi043:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-12T00:43:56.872 INFO:teuthology.orchestra.run.smithi043.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-12T00:44:01.674 INFO:teuthology.orchestra.run.smithi043.stdout:> Task :clean UP-TO-DATE 2024-09-12T00:44:21.072 INFO:teuthology.orchestra.run.smithi043.stdout:> Task :compileJava 2024-09-12T00:44:21.072 INFO:teuthology.orchestra.run.smithi043.stdout:> Task :processResources 2024-09-12T00:44:21.072 INFO:teuthology.orchestra.run.smithi043.stdout:> Task :classes 2024-09-12T00:44:22.074 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:22.074 INFO:teuthology.orchestra.run.smithi043.stdout:> Task :compileTestJava 2024-09-12T00:44:22.075 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:22.075 INFO:teuthology.orchestra.run.smithi043.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:44:22.075 INFO:teuthology.orchestra.run.smithi043.stdout:> Task :testClasses 2024-09-12T00:44:22.075 INFO:teuthology.orchestra.run.smithi043.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:44:22.075 INFO:teuthology.orchestra.run.smithi043.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:44:28.571 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:28.572 INFO:teuthology.orchestra.run.smithi043.stdout:> Task :test 2024-09-12T00:44:28.572 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:28.572 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-12T00:44:29.471 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:29.472 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-12T00:44:29.771 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:30.035 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-12T00:44:30.036 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:30.036 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-12T00:44:30.171 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:30.172 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-12T00:44:31.072 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:31.073 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-12T00:44:31.372 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:31.372 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T00:44:31.372 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:31.372 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T00:44:31.471 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:31.472 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-12T00:44:31.472 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:31.472 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-12T00:44:31.771 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:31.771 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-12T00:44:32.571 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:32.572 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-12T00:44:33.071 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:33.072 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-12T00:44:33.371 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:33.372 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-12T00:44:33.372 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12 00:44:33,342 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:44:38.371 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:38.372 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-12T00:44:38.871 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:38.871 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-12T00:44:38.872 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:38.872 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-12T00:44:39.171 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:39.171 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-12T00:44:39.171 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:39.172 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-12T00:44:39.672 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:39.672 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-12T00:44:40.171 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:40.171 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-12T00:44:40.471 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:40.472 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T00:44:40.472 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:40.472 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T00:44:40.571 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:40.571 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-12T00:44:42.971 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:42.971 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-12T00:44:43.371 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:43.371 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T00:44:43.871 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:43.872 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T00:44:44.171 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:44.171 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-12T00:44:44.671 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:44.671 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-12T00:44:44.971 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:44.971 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-12T00:44:53.271 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:53.271 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-12T00:44:53.571 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:53.572 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-12T00:44:54.971 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:54.971 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-12T00:44:55.271 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:55.271 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-12T00:44:56.971 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:56.971 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-12T00:44:57.271 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:57.271 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-12T00:44:57.771 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:57.771 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-12T00:44:58.071 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:58.072 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-12T00:44:58.072 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:58.072 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-12T00:44:58.372 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:58.372 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-12T00:44:58.372 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:58.372 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-12T00:44:58.671 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:58.671 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-12T00:44:58.771 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:58.771 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-12T00:44:58.971 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:58.971 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-12T00:44:59.071 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:59.071 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-12T00:44:59.371 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:59.371 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-12T00:44:59.372 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:59.372 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-12T00:44:59.671 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:59.671 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-12T00:44:59.671 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:59.672 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-12T00:44:59.971 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:44:59.971 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-12T00:45:00.071 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:00.071 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-12T00:45:00.371 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:00.371 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-12T00:45:01.371 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:01.371 INFO:teuthology.orchestra.run.smithi043.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-12T00:45:01.671 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:01.671 INFO:teuthology.orchestra.run.smithi043.stdout:---------------------------------------------------------------------- 2024-09-12T00:45:01.672 INFO:teuthology.orchestra.run.smithi043.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-12T00:45:01.672 INFO:teuthology.orchestra.run.smithi043.stdout:---------------------------------------------------------------------- 2024-09-12T00:45:01.748 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:01.748 INFO:teuthology.orchestra.run.smithi043.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T00:45:01.748 INFO:teuthology.orchestra.run.smithi043.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T00:45:01.749 INFO:teuthology.orchestra.run.smithi043.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T00:45:01.749 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:01.749 INFO:teuthology.orchestra.run.smithi043.stdout:BUILD SUCCESSFUL in 1m 5s 2024-09-12T00:45:01.749 INFO:teuthology.orchestra.run.smithi043.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-12T00:45:02.070 DEBUG:teuthology.orchestra.run.smithi043:> radosgw-admin gc process --include-all 2024-09-12T00:45:02.101 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:45:02.101 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:45:02.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.144+0000 7f643e2749c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:02.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.148+0000 7f643e2749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:02.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.148+0000 7f643e2749c0 20 realm 2024-09-12T00:45:02.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.148+0000 7f643e2749c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:02.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.148+0000 7f643e2749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:02.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.148+0000 7f643e2749c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:45:02.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.148+0000 7f643e2749c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:02.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.148+0000 7f643e2749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:02.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.148+0000 7f643e2749c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:02.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.148+0000 7f643e2749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:02.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.148+0000 7f643e2749c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:02.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.148+0000 7f643e2749c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:45:02.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.148+0000 7f643e2749c0 20 searching for the correct realm 2024-09-12T00:45:02.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.156+0000 7f643c57b640 0 -- 172.21.15.43:0/1298256772 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f6430065b00 msgr2=0x7f643008a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:45:02.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.372+0000 7f643bd7a640 0 -- 172.21.15.43:0/1298256772 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x56420cafe120 msgr2=0x56420cb00530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:02.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.380+0000 7f643e2749c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:45:02.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.380+0000 7f643e2749c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:45:02.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.380+0000 7f643e2749c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:45:02.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.380+0000 7f643e2749c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:45:02.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.380+0000 7f643e2749c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:45:02.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.380+0000 7f643e2749c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:45:02.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.380+0000 7f643e2749c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:02.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.380+0000 7f643e2749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:02.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.380+0000 7f643e2749c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:02.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.384+0000 7f643e2749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:02.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.384+0000 7f643e2749c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:02.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.384+0000 7f643e2749c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:45:02.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.384+0000 7f643e2749c0 20 zone default found 2024-09-12T00:45:02.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.384+0000 7f643e2749c0 4 Realm: () 2024-09-12T00:45:02.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.384+0000 7f643e2749c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:45:02.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.384+0000 7f643e2749c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:45:02.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.384+0000 7f643e2749c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:45:02.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.384+0000 7f643e2749c0 20 zonegroup default 2024-09-12T00:45:02.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.384+0000 7f643e2749c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:02.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.384+0000 7f643e2749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:02.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.384+0000 7f643e2749c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:02.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.384+0000 7f643e2749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:02.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.384+0000 7f643e2749c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:02.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.384+0000 7f643e2749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:02.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.384+0000 7f643e2749c0 20 started sync module instance, tier type = 2024-09-12T00:45:02.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.384+0000 7f643e2749c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:45:02.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.408+0000 7f643e2749c0 20 add_watcher() i=0 2024-09-12T00:45:02.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.408+0000 7f643e2749c0 20 add_watcher() i=1 2024-09-12T00:45:02.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.408+0000 7f643e2749c0 20 add_watcher() i=2 2024-09-12T00:45:02.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.408+0000 7f643e2749c0 20 add_watcher() i=3 2024-09-12T00:45:02.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.408+0000 7f643e2749c0 20 add_watcher() i=4 2024-09-12T00:45:02.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.408+0000 7f643e2749c0 20 add_watcher() i=5 2024-09-12T00:45:02.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.408+0000 7f643e2749c0 20 add_watcher() i=6 2024-09-12T00:45:02.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.412+0000 7f643e2749c0 20 add_watcher() i=7 2024-09-12T00:45:02.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.412+0000 7f643e2749c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:45:02.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.416+0000 7f62f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:02.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.416+0000 7f643e2749c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:45:02.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.416+0000 7f643e2749c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:45:02.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.504+0000 7f62f0fe1640 20 reqs_thread_entry: start 2024-09-12T00:45:02.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.504+0000 7f643e2749c0 20 init_complete bucket index max shards: 11 2024-09-12T00:45:02.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.504+0000 7f643e2749c0 20 Filter name: none 2024-09-12T00:45:02.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.504+0000 7f626a7fc640 20 reqs_thread_entry: start 2024-09-12T00:45:02.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.504+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:45:02.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.508+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:02.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.512+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:02.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.512+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:45:02.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.512+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15426369811150776530', time=2024-09-12T02:44:32.876120+0000, chain.objs.size()=9 2024-09-12T00:45:02.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.512+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.44__multipart_key1.2~yRvWyoMm93HUpQFBQiyWud0L4tR31Ct.1 2024-09-12T00:45:02.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.512+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.44__shadow_key1.2~yRvWyoMm93HUpQFBQiyWud0L4tR31Ct.1_1 2024-09-12T00:45:02.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.512+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.44__multipart_key1.2~yRvWyoMm93HUpQFBQiyWud0L4tR31Ct.2 2024-09-12T00:45:02.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.512+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.44__shadow_key1.2~yRvWyoMm93HUpQFBQiyWud0L4tR31Ct.2_1 2024-09-12T00:45:02.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.512+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.44__multipart_key1.2~yRvWyoMm93HUpQFBQiyWud0L4tR31Ct.3 2024-09-12T00:45:02.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.512+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.44__shadow_key1.2~yRvWyoMm93HUpQFBQiyWud0L4tR31Ct.3_1 2024-09-12T00:45:02.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.512+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.44__multipart_key1.2~yRvWyoMm93HUpQFBQiyWud0L4tR31Ct.4 2024-09-12T00:45:02.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.512+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.44__shadow_key1.2~yRvWyoMm93HUpQFBQiyWud0L4tR31Ct.4_1 2024-09-12T00:45:02.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.512+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.44__multipart_key1.2~yRvWyoMm93HUpQFBQiyWud0L4tR31Ct.5 2024-09-12T00:45:02.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.516+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:45:02.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.520+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:45:02.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.524+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:02.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.528+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:02.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.528+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:45:02.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.528+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='2~x-oW2AfY0ryOM2IcmUtYkprxp2D8jFK', time=2024-09-12T02:44:29.424492+0000, chain.objs.size()=9 2024-09-12T00:45:02.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.528+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.40__multipart_key1.2~x-oW2AfY0ryOM2IcmUtYkprxp2D8jFK.1 2024-09-12T00:45:02.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.528+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.40__shadow_key1.2~x-oW2AfY0ryOM2IcmUtYkprxp2D8jFK.1_1 2024-09-12T00:45:02.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.528+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.40__multipart_key1.2~x-oW2AfY0ryOM2IcmUtYkprxp2D8jFK.2 2024-09-12T00:45:02.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.528+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.40__shadow_key1.2~x-oW2AfY0ryOM2IcmUtYkprxp2D8jFK.2_1 2024-09-12T00:45:02.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.528+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.40__multipart_key1.2~x-oW2AfY0ryOM2IcmUtYkprxp2D8jFK.3 2024-09-12T00:45:02.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.528+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.40__shadow_key1.2~x-oW2AfY0ryOM2IcmUtYkprxp2D8jFK.3_1 2024-09-12T00:45:02.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.528+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.40__multipart_key1.2~x-oW2AfY0ryOM2IcmUtYkprxp2D8jFK.4 2024-09-12T00:45:02.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.528+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.40__shadow_key1.2~x-oW2AfY0ryOM2IcmUtYkprxp2D8jFK.4_1 2024-09-12T00:45:02.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.528+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.40__multipart_key1.2~x-oW2AfY0ryOM2IcmUtYkprxp2D8jFK.5 2024-09-12T00:45:02.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.528+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2571784095504649851', time=2024-09-12T02:44:43.914636+0000, chain.objs.size()=9 2024-09-12T00:45:02.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.528+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.53__multipart_file.mpg.2~B-ADM__BUB_wwWkvwnWIxVEJKTDC-11.1 2024-09-12T00:45:02.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.528+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.53__shadow_file.mpg.2~B-ADM__BUB_wwWkvwnWIxVEJKTDC-11.1_1 2024-09-12T00:45:02.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.528+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.53__multipart_file.mpg.2~B-ADM__BUB_wwWkvwnWIxVEJKTDC-11.2 2024-09-12T00:45:02.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.532+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.53__shadow_file.mpg.2~B-ADM__BUB_wwWkvwnWIxVEJKTDC-11.2_1 2024-09-12T00:45:02.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.532+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.53__multipart_file.mpg.2~B-ADM__BUB_wwWkvwnWIxVEJKTDC-11.3 2024-09-12T00:45:02.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.536+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.53__shadow_file.mpg.2~B-ADM__BUB_wwWkvwnWIxVEJKTDC-11.3_1 2024-09-12T00:45:02.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.536+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.53__multipart_file.mpg.2~B-ADM__BUB_wwWkvwnWIxVEJKTDC-11.4 2024-09-12T00:45:02.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.536+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.53__shadow_file.mpg.2~B-ADM__BUB_wwWkvwnWIxVEJKTDC-11.4_1 2024-09-12T00:45:02.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.536+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.53__multipart_file.mpg.2~B-ADM__BUB_wwWkvwnWIxVEJKTDC-11.5 2024-09-12T00:45:02.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.540+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:45:02.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.548+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:45:02.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.548+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:02.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.548+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:02.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.548+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:02.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.552+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:45:02.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.552+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:02.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.556+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:02.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.556+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:02.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.556+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:45:02.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.560+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:02.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.560+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:02.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.560+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:45:02.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.560+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3954814227749772953', time=2024-09-12T02:44:38.403983+0000, chain.objs.size()=6 2024-09-12T00:45:02.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.560+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.46__shadow_.76zs6Vlsg9k0eNAmTUDi2_GfYRpNDkL_0 2024-09-12T00:45:02.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.560+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.46__shadow_.76zs6Vlsg9k0eNAmTUDi2_GfYRpNDkL_1 2024-09-12T00:45:02.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.560+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.46__shadow_.76zs6Vlsg9k0eNAmTUDi2_GfYRpNDkL_2 2024-09-12T00:45:02.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.560+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.46__shadow_.76zs6Vlsg9k0eNAmTUDi2_GfYRpNDkL_3 2024-09-12T00:45:02.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.560+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.46__shadow_.76zs6Vlsg9k0eNAmTUDi2_GfYRpNDkL_4 2024-09-12T00:45:02.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.560+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.46__shadow_.76zs6Vlsg9k0eNAmTUDi2_GfYRpNDkL_5 2024-09-12T00:45:02.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.560+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1585676566501854963', time=2024-09-12T02:44:43.943715+0000, chain.objs.size()=9 2024-09-12T00:45:02.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.560+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.53__multipart_file2.mpg.2~Mq1dPOqshvY2GveH11YBh8JJAspctQR.1 2024-09-12T00:45:02.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.560+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.53__shadow_file2.mpg.2~Mq1dPOqshvY2GveH11YBh8JJAspctQR.1_1 2024-09-12T00:45:02.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.560+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.53__multipart_file2.mpg.2~Mq1dPOqshvY2GveH11YBh8JJAspctQR.2 2024-09-12T00:45:02.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.560+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.53__shadow_file2.mpg.2~Mq1dPOqshvY2GveH11YBh8JJAspctQR.2_1 2024-09-12T00:45:02.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.560+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.53__multipart_file2.mpg.2~Mq1dPOqshvY2GveH11YBh8JJAspctQR.3 2024-09-12T00:45:02.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.560+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.53__shadow_file2.mpg.2~Mq1dPOqshvY2GveH11YBh8JJAspctQR.3_1 2024-09-12T00:45:02.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.568+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.53__multipart_file2.mpg.2~Mq1dPOqshvY2GveH11YBh8JJAspctQR.4 2024-09-12T00:45:02.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.568+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.53__shadow_file2.mpg.2~Mq1dPOqshvY2GveH11YBh8JJAspctQR.4_1 2024-09-12T00:45:02.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.568+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.53__multipart_file2.mpg.2~Mq1dPOqshvY2GveH11YBh8JJAspctQR.5 2024-09-12T00:45:02.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.568+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5945938218372727661', time=2024-09-12T02:44:53.195878+0000, chain.objs.size()=16 2024-09-12T00:45:02.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.568+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~W9myCe0vL3HW5hekEC1Sa1Do9BjN0RP.1 2024-09-12T00:45:02.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.568+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~W9myCe0vL3HW5hekEC1Sa1Do9BjN0RP.1_1 2024-09-12T00:45:02.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.568+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~W9myCe0vL3HW5hekEC1Sa1Do9BjN0RP.1_2 2024-09-12T00:45:02.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.572+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~W9myCe0vL3HW5hekEC1Sa1Do9BjN0RP.2 2024-09-12T00:45:02.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.572+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~W9myCe0vL3HW5hekEC1Sa1Do9BjN0RP.2_1 2024-09-12T00:45:02.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.572+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~W9myCe0vL3HW5hekEC1Sa1Do9BjN0RP.2_2 2024-09-12T00:45:02.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.572+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~W9myCe0vL3HW5hekEC1Sa1Do9BjN0RP.3 2024-09-12T00:45:02.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.572+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~W9myCe0vL3HW5hekEC1Sa1Do9BjN0RP.3_1 2024-09-12T00:45:02.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.576+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~W9myCe0vL3HW5hekEC1Sa1Do9BjN0RP.3_2 2024-09-12T00:45:02.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.576+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~W9myCe0vL3HW5hekEC1Sa1Do9BjN0RP.4 2024-09-12T00:45:02.577 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.576+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~W9myCe0vL3HW5hekEC1Sa1Do9BjN0RP.4_1 2024-09-12T00:45:02.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.580+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~W9myCe0vL3HW5hekEC1Sa1Do9BjN0RP.4_2 2024-09-12T00:45:02.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.580+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~W9myCe0vL3HW5hekEC1Sa1Do9BjN0RP.5 2024-09-12T00:45:02.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.580+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~W9myCe0vL3HW5hekEC1Sa1Do9BjN0RP.5_1 2024-09-12T00:45:02.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.580+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~W9myCe0vL3HW5hekEC1Sa1Do9BjN0RP.5_2 2024-09-12T00:45:02.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.580+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~W9myCe0vL3HW5hekEC1Sa1Do9BjN0RP.6 2024-09-12T00:45:02.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.588+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:45:02.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.588+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:45:02.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.592+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:02.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.592+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:02.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.592+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:45:02.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.592+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12764396280115775304', time=2024-09-12T02:44:36.183091+0000, chain.objs.size()=9 2024-09-12T00:45:02.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.592+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__multipart_key1.2~UJdteYVowPc4oo5-PL0ygR7uNbHRQ2s.1 2024-09-12T00:45:02.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.592+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__shadow_key1.2~UJdteYVowPc4oo5-PL0ygR7uNbHRQ2s.1_1 2024-09-12T00:45:02.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.592+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__multipart_key1.2~UJdteYVowPc4oo5-PL0ygR7uNbHRQ2s.2 2024-09-12T00:45:02.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.592+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__shadow_key1.2~UJdteYVowPc4oo5-PL0ygR7uNbHRQ2s.2_1 2024-09-12T00:45:02.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.592+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__multipart_key1.2~UJdteYVowPc4oo5-PL0ygR7uNbHRQ2s.3 2024-09-12T00:45:02.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.592+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__shadow_key1.2~UJdteYVowPc4oo5-PL0ygR7uNbHRQ2s.3_1 2024-09-12T00:45:02.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.592+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__multipart_key1.2~UJdteYVowPc4oo5-PL0ygR7uNbHRQ2s.4 2024-09-12T00:45:02.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.592+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__shadow_key1.2~UJdteYVowPc4oo5-PL0ygR7uNbHRQ2s.4_1 2024-09-12T00:45:02.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.592+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__multipart_key1.2~UJdteYVowPc4oo5-PL0ygR7uNbHRQ2s.5 2024-09-12T00:45:02.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.592+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2261232528104473376', time=2024-09-12T02:44:58.796058+0000, chain.objs.size()=1 2024-09-12T00:45:02.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.592+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.61__shadow_.CpdmFPyHZJEDc7Dw15h4DFVBBXtH3C0_0 2024-09-12T00:45:02.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.600+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:45:02.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.604+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:45:02.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.608+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:02.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.608+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:02.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.608+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:45:02.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.608+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8703038060844764944', time=2024-09-12T02:44:43.928771+0000, chain.objs.size()=1 2024-09-12T00:45:02.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.608+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.53__shadow_.nfia8wU1zFhWM0VUibQupWNrNSyDsu3_0 2024-09-12T00:45:02.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.612+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:45:02.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.616+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:45:02.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.616+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:02.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.620+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:02.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.620+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:45:02.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.620+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2431088449374779014', time=2024-09-12T02:44:35.255223+0000, chain.objs.size()=9 2024-09-12T00:45:02.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.620+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__multipart_key1.2~tllEh6FcBzPUEQagSX63fxVIYLlRzCb.1 2024-09-12T00:45:02.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.620+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__shadow_key1.2~tllEh6FcBzPUEQagSX63fxVIYLlRzCb.1_1 2024-09-12T00:45:02.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.620+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__multipart_key1.2~tllEh6FcBzPUEQagSX63fxVIYLlRzCb.2 2024-09-12T00:45:02.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.620+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__shadow_key1.2~tllEh6FcBzPUEQagSX63fxVIYLlRzCb.2_1 2024-09-12T00:45:02.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.620+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__multipart_key1.2~tllEh6FcBzPUEQagSX63fxVIYLlRzCb.3 2024-09-12T00:45:02.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.620+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__shadow_key1.2~tllEh6FcBzPUEQagSX63fxVIYLlRzCb.3_1 2024-09-12T00:45:02.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.620+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__multipart_key1.2~tllEh6FcBzPUEQagSX63fxVIYLlRzCb.4 2024-09-12T00:45:02.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.620+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__shadow_key1.2~tllEh6FcBzPUEQagSX63fxVIYLlRzCb.4_1 2024-09-12T00:45:02.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.620+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__multipart_key1.2~tllEh6FcBzPUEQagSX63fxVIYLlRzCb.5 2024-09-12T00:45:02.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.620+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7906613343388344511', time=2024-09-12T02:44:55.004962+0000, chain.objs.size()=9 2024-09-12T00:45:02.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.620+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.56__multipart_key1.2~j5PruoQ72M6yn1r-79eLEjH0xKjTRsv.1 2024-09-12T00:45:02.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.620+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.56__shadow_key1.2~j5PruoQ72M6yn1r-79eLEjH0xKjTRsv.1_1 2024-09-12T00:45:02.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.620+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.56__multipart_key1.2~j5PruoQ72M6yn1r-79eLEjH0xKjTRsv.2 2024-09-12T00:45:02.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.624+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.56__shadow_key1.2~j5PruoQ72M6yn1r-79eLEjH0xKjTRsv.2_1 2024-09-12T00:45:02.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.624+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.56__multipart_key1.2~j5PruoQ72M6yn1r-79eLEjH0xKjTRsv.3 2024-09-12T00:45:02.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.624+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.56__shadow_key1.2~j5PruoQ72M6yn1r-79eLEjH0xKjTRsv.3_1 2024-09-12T00:45:02.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.624+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.56__multipart_key1.2~j5PruoQ72M6yn1r-79eLEjH0xKjTRsv.4 2024-09-12T00:45:02.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.628+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.56__shadow_key1.2~j5PruoQ72M6yn1r-79eLEjH0xKjTRsv.4_1 2024-09-12T00:45:02.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.628+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.56__multipart_key1.2~j5PruoQ72M6yn1r-79eLEjH0xKjTRsv.5 2024-09-12T00:45:02.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.632+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:45:02.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.640+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:45:02.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.644+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:02.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.644+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:02.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.648+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:45:02.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.648+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5891585018411477774', time=2024-09-12T02:44:38.232482+0000, chain.objs.size()=7 2024-09-12T00:45:02.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.648+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__multipart_key1.2~rvWzEcIPtjRvxAChxWB2wimIoC-eVFd.1 2024-09-12T00:45:02.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.648+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__shadow_key1.2~rvWzEcIPtjRvxAChxWB2wimIoC-eVFd.1_1 2024-09-12T00:45:02.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.648+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__shadow_key1.2~rvWzEcIPtjRvxAChxWB2wimIoC-eVFd.1_2 2024-09-12T00:45:02.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.648+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__multipart_key1.2~rvWzEcIPtjRvxAChxWB2wimIoC-eVFd.2 2024-09-12T00:45:02.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.648+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__shadow_key1.2~rvWzEcIPtjRvxAChxWB2wimIoC-eVFd.2_1 2024-09-12T00:45:02.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.648+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__shadow_key1.2~rvWzEcIPtjRvxAChxWB2wimIoC-eVFd.2_2 2024-09-12T00:45:02.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.648+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__multipart_key1.2~rvWzEcIPtjRvxAChxWB2wimIoC-eVFd.3 2024-09-12T00:45:02.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.648+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3883506576136059684', time=2024-09-12T02:44:38.599913+0000, chain.objs.size()=7 2024-09-12T00:45:02.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.648+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__multipart_key1.2~dhlE5TPNfD-5px3kZiiaryD5bPqqHUx.1 2024-09-12T00:45:02.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.648+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__shadow_key1.2~dhlE5TPNfD-5px3kZiiaryD5bPqqHUx.1_1 2024-09-12T00:45:02.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.648+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__shadow_key1.2~dhlE5TPNfD-5px3kZiiaryD5bPqqHUx.1_2 2024-09-12T00:45:02.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.648+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__multipart_key1.2~dhlE5TPNfD-5px3kZiiaryD5bPqqHUx.2 2024-09-12T00:45:02.647 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.648+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__shadow_key1.2~dhlE5TPNfD-5px3kZiiaryD5bPqqHUx.2_1 2024-09-12T00:45:02.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.652+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__shadow_key1.2~dhlE5TPNfD-5px3kZiiaryD5bPqqHUx.2_2 2024-09-12T00:45:02.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.656+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__multipart_key1.2~dhlE5TPNfD-5px3kZiiaryD5bPqqHUx.3 2024-09-12T00:45:02.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.660+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:45:02.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.664+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:45:02.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.668+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:02.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.672+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:02.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.672+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:45:02.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.672+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7352762548263513429', time=2024-09-12T02:44:43.958885+0000, chain.objs.size()=1 2024-09-12T00:45:02.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.672+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.53__shadow_.iwdibSgG7WgszGS7j7FOEMFLZwLecYg_0 2024-09-12T00:45:02.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.672+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:45:02.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.676+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:45:02.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.680+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:02.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.680+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:02.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.680+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:02.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.684+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:45:02.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.684+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:02.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.688+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:02.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.688+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:02.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.688+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:45:02.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.692+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:02.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.692+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:02.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.696+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:45:02.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.696+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7987920184464420943', time=2024-09-12T02:44:49.471945+0000, chain.objs.size()=21 2024-09-12T00:45:02.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.696+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~b4GGCLLvSxSTbHPgKoKExeXP4kr9OB4.1 2024-09-12T00:45:02.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.696+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~b4GGCLLvSxSTbHPgKoKExeXP4kr9OB4.1_1 2024-09-12T00:45:02.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.696+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~b4GGCLLvSxSTbHPgKoKExeXP4kr9OB4.2 2024-09-12T00:45:02.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.696+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~b4GGCLLvSxSTbHPgKoKExeXP4kr9OB4.2_1 2024-09-12T00:45:02.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.696+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~b4GGCLLvSxSTbHPgKoKExeXP4kr9OB4.3 2024-09-12T00:45:02.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.696+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~b4GGCLLvSxSTbHPgKoKExeXP4kr9OB4.3_1 2024-09-12T00:45:02.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.696+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~b4GGCLLvSxSTbHPgKoKExeXP4kr9OB4.4 2024-09-12T00:45:02.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.696+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~b4GGCLLvSxSTbHPgKoKExeXP4kr9OB4.4_1 2024-09-12T00:45:02.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.696+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~b4GGCLLvSxSTbHPgKoKExeXP4kr9OB4.5 2024-09-12T00:45:02.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.696+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~b4GGCLLvSxSTbHPgKoKExeXP4kr9OB4.5_1 2024-09-12T00:45:02.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.696+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~b4GGCLLvSxSTbHPgKoKExeXP4kr9OB4.6 2024-09-12T00:45:02.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.696+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~b4GGCLLvSxSTbHPgKoKExeXP4kr9OB4.6_1 2024-09-12T00:45:02.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.700+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~b4GGCLLvSxSTbHPgKoKExeXP4kr9OB4.7 2024-09-12T00:45:02.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.700+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~b4GGCLLvSxSTbHPgKoKExeXP4kr9OB4.7_1 2024-09-12T00:45:02.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.700+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~b4GGCLLvSxSTbHPgKoKExeXP4kr9OB4.8 2024-09-12T00:45:02.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.700+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~b4GGCLLvSxSTbHPgKoKExeXP4kr9OB4.8_1 2024-09-12T00:45:02.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.700+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~b4GGCLLvSxSTbHPgKoKExeXP4kr9OB4.9 2024-09-12T00:45:02.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.700+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~b4GGCLLvSxSTbHPgKoKExeXP4kr9OB4.9_1 2024-09-12T00:45:02.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.700+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~b4GGCLLvSxSTbHPgKoKExeXP4kr9OB4.10 2024-09-12T00:45:02.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.700+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~b4GGCLLvSxSTbHPgKoKExeXP4kr9OB4.10_1 2024-09-12T00:45:02.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.708+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~b4GGCLLvSxSTbHPgKoKExeXP4kr9OB4.11 2024-09-12T00:45:02.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.712+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:45:02.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.716+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:45:02.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.720+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:02.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.720+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:02.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.720+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:45:02.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.720+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12624808069904577449', time=2024-09-12T02:44:53.367516+0000, chain.objs.size()=16 2024-09-12T00:45:02.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.720+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~SLeR6zRVMFnP6j0GQBFZuQI-E36qi7h.1 2024-09-12T00:45:02.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.720+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~SLeR6zRVMFnP6j0GQBFZuQI-E36qi7h.1_1 2024-09-12T00:45:02.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.720+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~SLeR6zRVMFnP6j0GQBFZuQI-E36qi7h.1_2 2024-09-12T00:45:02.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.720+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~SLeR6zRVMFnP6j0GQBFZuQI-E36qi7h.2 2024-09-12T00:45:02.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.720+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~SLeR6zRVMFnP6j0GQBFZuQI-E36qi7h.2_1 2024-09-12T00:45:02.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.720+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~SLeR6zRVMFnP6j0GQBFZuQI-E36qi7h.2_2 2024-09-12T00:45:02.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.720+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~SLeR6zRVMFnP6j0GQBFZuQI-E36qi7h.3 2024-09-12T00:45:02.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.720+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~SLeR6zRVMFnP6j0GQBFZuQI-E36qi7h.3_1 2024-09-12T00:45:02.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.720+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~SLeR6zRVMFnP6j0GQBFZuQI-E36qi7h.3_2 2024-09-12T00:45:02.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.720+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~SLeR6zRVMFnP6j0GQBFZuQI-E36qi7h.4 2024-09-12T00:45:02.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.720+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~SLeR6zRVMFnP6j0GQBFZuQI-E36qi7h.4_1 2024-09-12T00:45:02.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.720+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~SLeR6zRVMFnP6j0GQBFZuQI-E36qi7h.4_2 2024-09-12T00:45:02.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.728+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~SLeR6zRVMFnP6j0GQBFZuQI-E36qi7h.5 2024-09-12T00:45:02.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.728+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~SLeR6zRVMFnP6j0GQBFZuQI-E36qi7h.5_1 2024-09-12T00:45:02.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.732+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~SLeR6zRVMFnP6j0GQBFZuQI-E36qi7h.5_2 2024-09-12T00:45:02.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.732+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~SLeR6zRVMFnP6j0GQBFZuQI-E36qi7h.6 2024-09-12T00:45:02.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.732+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12701750468499736777', time=2024-09-12T02:44:54.367535+0000, chain.objs.size()=1 2024-09-12T00:45:02.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.732+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.56__shadow_.sJF5EBv8F_SIusN10QauW1KOkPV9Og__0 2024-09-12T00:45:02.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.732+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1915856945178800088', time=2024-09-12T02:44:59.422755+0000, chain.objs.size()=1 2024-09-12T00:45:02.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.732+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.63__shadow_.9Rx1htCOb5WOMSHc6ihJ60WPxTjO41d_0 2024-09-12T00:45:02.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.736+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:45:02.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.740+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:45:02.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.744+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:02.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.744+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:02.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.744+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:45:02.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.744+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13531916650798264017', time=2024-09-12T02:44:59.763853+0000, chain.objs.size()=1 2024-09-12T00:45:02.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.744+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.64__shadow_.L2wGyaR19H6D0_REWWz_lcxQsvCKobB_0 2024-09-12T00:45:02.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.748+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:45:02.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.752+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:45:02.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.756+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:02.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.756+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:02.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.756+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:02.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.760+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:45:02.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.764+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:02.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.768+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:02.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.768+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:45:02.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.768+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11966519794370513804', time=2024-09-12T02:44:50.644609+0000, chain.objs.size()=19 2024-09-12T00:45:02.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.768+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~q0Au7QADBTp-R7xVslROC9XPKxy4cpL.1 2024-09-12T00:45:02.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.768+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~q0Au7QADBTp-R7xVslROC9XPKxy4cpL.1_1 2024-09-12T00:45:02.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.768+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~q0Au7QADBTp-R7xVslROC9XPKxy4cpL.2 2024-09-12T00:45:02.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.768+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~q0Au7QADBTp-R7xVslROC9XPKxy4cpL.2_1 2024-09-12T00:45:02.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.768+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~q0Au7QADBTp-R7xVslROC9XPKxy4cpL.3 2024-09-12T00:45:02.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.768+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~q0Au7QADBTp-R7xVslROC9XPKxy4cpL.3_1 2024-09-12T00:45:02.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.768+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~q0Au7QADBTp-R7xVslROC9XPKxy4cpL.4 2024-09-12T00:45:02.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.768+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~q0Au7QADBTp-R7xVslROC9XPKxy4cpL.4_1 2024-09-12T00:45:02.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.768+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~q0Au7QADBTp-R7xVslROC9XPKxy4cpL.5 2024-09-12T00:45:02.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.768+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~q0Au7QADBTp-R7xVslROC9XPKxy4cpL.5_1 2024-09-12T00:45:02.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.768+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~q0Au7QADBTp-R7xVslROC9XPKxy4cpL.6 2024-09-12T00:45:02.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.768+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~q0Au7QADBTp-R7xVslROC9XPKxy4cpL.6_1 2024-09-12T00:45:02.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.776+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~q0Au7QADBTp-R7xVslROC9XPKxy4cpL.7 2024-09-12T00:45:02.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.776+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~q0Au7QADBTp-R7xVslROC9XPKxy4cpL.7_1 2024-09-12T00:45:02.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.776+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~q0Au7QADBTp-R7xVslROC9XPKxy4cpL.8 2024-09-12T00:45:02.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.776+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~q0Au7QADBTp-R7xVslROC9XPKxy4cpL.8_1 2024-09-12T00:45:02.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.776+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~q0Au7QADBTp-R7xVslROC9XPKxy4cpL.9 2024-09-12T00:45:02.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.776+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~q0Au7QADBTp-R7xVslROC9XPKxy4cpL.9_1 2024-09-12T00:45:02.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.776+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~q0Au7QADBTp-R7xVslROC9XPKxy4cpL.10 2024-09-12T00:45:02.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.784+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:45:02.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.788+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:45:02.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.792+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:02.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.792+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:02.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.792+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:45:02.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.792+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13287185113286389782', time=2024-09-12T02:44:58.469992+0000, chain.objs.size()=1 2024-09-12T00:45:02.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.792+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.60__shadow_.3F70eKH-qxikS239nP6KuIriVpT2d9l_0 2024-09-12T00:45:02.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.796+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:45:02.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.800+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:45:02.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.804+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:02.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.804+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:02.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.808+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:45:02.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.808+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6216238325779673454', time=2024-09-12T02:44:31.131751+0000, chain.objs.size()=9 2024-09-12T00:45:02.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.808+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.42__multipart_key1.2~II8bsbOto9jPBqXmRFWD78zPGfTqHoT.1 2024-09-12T00:45:02.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.808+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.42__shadow_key1.2~II8bsbOto9jPBqXmRFWD78zPGfTqHoT.1_1 2024-09-12T00:45:02.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.808+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.42__multipart_key1.2~II8bsbOto9jPBqXmRFWD78zPGfTqHoT.2 2024-09-12T00:45:02.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.808+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.42__shadow_key1.2~II8bsbOto9jPBqXmRFWD78zPGfTqHoT.2_1 2024-09-12T00:45:02.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.808+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.42__multipart_key1.2~II8bsbOto9jPBqXmRFWD78zPGfTqHoT.3 2024-09-12T00:45:02.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.808+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.42__shadow_key1.2~II8bsbOto9jPBqXmRFWD78zPGfTqHoT.3_1 2024-09-12T00:45:02.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.808+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.42__multipart_key1.2~II8bsbOto9jPBqXmRFWD78zPGfTqHoT.4 2024-09-12T00:45:02.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.808+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.42__shadow_key1.2~II8bsbOto9jPBqXmRFWD78zPGfTqHoT.4_1 2024-09-12T00:45:02.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.808+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.42__multipart_key1.2~II8bsbOto9jPBqXmRFWD78zPGfTqHoT.5 2024-09-12T00:45:02.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.816+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:45:02.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.820+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:45:02.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.824+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:02.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.824+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:02.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.828+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:02.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.828+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:45:02.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.832+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:02.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.832+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:02.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.836+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:45:02.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.836+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11730060175199046295', time=2024-09-12T02:44:48.088920+0000, chain.objs.size()=21 2024-09-12T00:45:02.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.836+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~fISnI9ktCvJSyZKN-dQQch2ZIws5vm3.1 2024-09-12T00:45:02.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.836+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~fISnI9ktCvJSyZKN-dQQch2ZIws5vm3.1_1 2024-09-12T00:45:02.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.836+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~fISnI9ktCvJSyZKN-dQQch2ZIws5vm3.2 2024-09-12T00:45:02.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.836+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~fISnI9ktCvJSyZKN-dQQch2ZIws5vm3.2_1 2024-09-12T00:45:02.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.836+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~fISnI9ktCvJSyZKN-dQQch2ZIws5vm3.3 2024-09-12T00:45:02.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.836+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~fISnI9ktCvJSyZKN-dQQch2ZIws5vm3.3_1 2024-09-12T00:45:02.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.836+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~fISnI9ktCvJSyZKN-dQQch2ZIws5vm3.4 2024-09-12T00:45:02.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.836+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~fISnI9ktCvJSyZKN-dQQch2ZIws5vm3.4_1 2024-09-12T00:45:02.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.836+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~fISnI9ktCvJSyZKN-dQQch2ZIws5vm3.5 2024-09-12T00:45:02.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.836+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~fISnI9ktCvJSyZKN-dQQch2ZIws5vm3.5_1 2024-09-12T00:45:02.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.836+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~fISnI9ktCvJSyZKN-dQQch2ZIws5vm3.6 2024-09-12T00:45:02.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.836+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~fISnI9ktCvJSyZKN-dQQch2ZIws5vm3.6_1 2024-09-12T00:45:02.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.844+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~fISnI9ktCvJSyZKN-dQQch2ZIws5vm3.7 2024-09-12T00:45:02.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.844+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~fISnI9ktCvJSyZKN-dQQch2ZIws5vm3.7_1 2024-09-12T00:45:02.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.844+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~fISnI9ktCvJSyZKN-dQQch2ZIws5vm3.8 2024-09-12T00:45:02.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.844+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~fISnI9ktCvJSyZKN-dQQch2ZIws5vm3.8_1 2024-09-12T00:45:02.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.844+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~fISnI9ktCvJSyZKN-dQQch2ZIws5vm3.9 2024-09-12T00:45:02.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.844+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~fISnI9ktCvJSyZKN-dQQch2ZIws5vm3.9_1 2024-09-12T00:45:02.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.844+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~fISnI9ktCvJSyZKN-dQQch2ZIws5vm3.10 2024-09-12T00:45:02.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.844+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~fISnI9ktCvJSyZKN-dQQch2ZIws5vm3.10_1 2024-09-12T00:45:02.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.844+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~fISnI9ktCvJSyZKN-dQQch2ZIws5vm3.11 2024-09-12T00:45:02.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.856+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:45:02.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.860+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:45:03.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.864+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.864+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.864+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:45:03.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.864+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='2~-eDricKKI1VMq2JzYhBfa2fUgyRhk-1', time=2024-09-12T02:44:44.814965+0000, chain.objs.size()=5 2024-09-12T00:45:03.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.864+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.54__multipart_key1.2~-eDricKKI1VMq2JzYhBfa2fUgyRhk-1.7 2024-09-12T00:45:03.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.864+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.54__shadow_key1.2~-eDricKKI1VMq2JzYhBfa2fUgyRhk-1.7_1 2024-09-12T00:45:03.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.864+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.54__multipart_key1.2~-eDricKKI1VMq2JzYhBfa2fUgyRhk-1.10 2024-09-12T00:45:03.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.864+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.54__shadow_key1.2~-eDricKKI1VMq2JzYhBfa2fUgyRhk-1.10_1 2024-09-12T00:45:03.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.864+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.54__multipart_key1.2~-eDricKKI1VMq2JzYhBfa2fUgyRhk-1.13 2024-09-12T00:45:03.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.864+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16587491969832389346', time=2024-09-12T02:45:01.412623+0000, chain.objs.size()=21 2024-09-12T00:45:03.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.864+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.66__multipart_key1.2~hLWSgCQDg_MZ5OqwFdQ9NXT9iQGOfAd.1 2024-09-12T00:45:03.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.864+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.66__shadow_key1.2~hLWSgCQDg_MZ5OqwFdQ9NXT9iQGOfAd.1_1 2024-09-12T00:45:03.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.864+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.66__multipart_key1.2~hLWSgCQDg_MZ5OqwFdQ9NXT9iQGOfAd.2 2024-09-12T00:45:03.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.864+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.66__shadow_key1.2~hLWSgCQDg_MZ5OqwFdQ9NXT9iQGOfAd.2_1 2024-09-12T00:45:03.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.864+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.66__multipart_key1.2~hLWSgCQDg_MZ5OqwFdQ9NXT9iQGOfAd.3 2024-09-12T00:45:03.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.864+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.66__shadow_key1.2~hLWSgCQDg_MZ5OqwFdQ9NXT9iQGOfAd.3_1 2024-09-12T00:45:03.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.864+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.66__multipart_key1.2~hLWSgCQDg_MZ5OqwFdQ9NXT9iQGOfAd.4 2024-09-12T00:45:03.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.872+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.66__shadow_key1.2~hLWSgCQDg_MZ5OqwFdQ9NXT9iQGOfAd.4_1 2024-09-12T00:45:03.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.872+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.66__multipart_key1.2~hLWSgCQDg_MZ5OqwFdQ9NXT9iQGOfAd.5 2024-09-12T00:45:03.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.872+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.66__shadow_key1.2~hLWSgCQDg_MZ5OqwFdQ9NXT9iQGOfAd.5_1 2024-09-12T00:45:03.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.872+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.66__multipart_key1.2~hLWSgCQDg_MZ5OqwFdQ9NXT9iQGOfAd.6 2024-09-12T00:45:03.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.876+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.66__shadow_key1.2~hLWSgCQDg_MZ5OqwFdQ9NXT9iQGOfAd.6_1 2024-09-12T00:45:03.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.876+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.66__multipart_key1.2~hLWSgCQDg_MZ5OqwFdQ9NXT9iQGOfAd.7 2024-09-12T00:45:03.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.876+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.66__shadow_key1.2~hLWSgCQDg_MZ5OqwFdQ9NXT9iQGOfAd.7_1 2024-09-12T00:45:03.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.876+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.66__multipart_key1.2~hLWSgCQDg_MZ5OqwFdQ9NXT9iQGOfAd.8 2024-09-12T00:45:03.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.876+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.66__shadow_key1.2~hLWSgCQDg_MZ5OqwFdQ9NXT9iQGOfAd.8_1 2024-09-12T00:45:03.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.876+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.66__multipart_key1.2~hLWSgCQDg_MZ5OqwFdQ9NXT9iQGOfAd.9 2024-09-12T00:45:03.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.876+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.66__shadow_key1.2~hLWSgCQDg_MZ5OqwFdQ9NXT9iQGOfAd.9_1 2024-09-12T00:45:03.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.884+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.66__multipart_key1.2~hLWSgCQDg_MZ5OqwFdQ9NXT9iQGOfAd.10 2024-09-12T00:45:03.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.884+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.66__shadow_key1.2~hLWSgCQDg_MZ5OqwFdQ9NXT9iQGOfAd.10_1 2024-09-12T00:45:03.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.884+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.66__multipart_key1.2~hLWSgCQDg_MZ5OqwFdQ9NXT9iQGOfAd.11 2024-09-12T00:45:03.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.888+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:45:03.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.892+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:45:03.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.896+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.896+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.896+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:45:03.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.896+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12411558176065465508', time=2024-09-12T02:44:32.672143+0000, chain.objs.size()=9 2024-09-12T00:45:03.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.896+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.44__multipart_key1.2~yRvWyoMm93HUpQFBQiyWud0L4tR31Ct.1 2024-09-12T00:45:03.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.896+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.44__shadow_key1.2~yRvWyoMm93HUpQFBQiyWud0L4tR31Ct.1_1 2024-09-12T00:45:03.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.896+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.44__multipart_key1.2~yRvWyoMm93HUpQFBQiyWud0L4tR31Ct.2 2024-09-12T00:45:03.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.896+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.44__shadow_key1.2~yRvWyoMm93HUpQFBQiyWud0L4tR31Ct.2_1 2024-09-12T00:45:03.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.896+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.44__multipart_key1.2~yRvWyoMm93HUpQFBQiyWud0L4tR31Ct.3 2024-09-12T00:45:03.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.896+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.44__shadow_key1.2~yRvWyoMm93HUpQFBQiyWud0L4tR31Ct.3_1 2024-09-12T00:45:03.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.896+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.44__multipart_key1.2~yRvWyoMm93HUpQFBQiyWud0L4tR31Ct.4 2024-09-12T00:45:03.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.896+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.44__shadow_key1.2~yRvWyoMm93HUpQFBQiyWud0L4tR31Ct.4_1 2024-09-12T00:45:03.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.896+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.44__multipart_key1.2~yRvWyoMm93HUpQFBQiyWud0L4tR31Ct.5 2024-09-12T00:45:03.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.904+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:45:03.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.908+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:45:03.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.912+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.912+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.912+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:45:03.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.912+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17336012115505755645', time=2024-09-12T02:44:43.085320+0000, chain.objs.size()=9 2024-09-12T00:45:03.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.912+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.52__multipart_key1.2~E8s3GvVoDTCFKvC8J115zldAIjsJ7ti.1 2024-09-12T00:45:03.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.912+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.52__shadow_key1.2~E8s3GvVoDTCFKvC8J115zldAIjsJ7ti.1_1 2024-09-12T00:45:03.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.912+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.52__multipart_key1.2~E8s3GvVoDTCFKvC8J115zldAIjsJ7ti.2 2024-09-12T00:45:03.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.912+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.52__shadow_key1.2~E8s3GvVoDTCFKvC8J115zldAIjsJ7ti.2_1 2024-09-12T00:45:03.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.912+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.52__multipart_key1.2~E8s3GvVoDTCFKvC8J115zldAIjsJ7ti.3 2024-09-12T00:45:03.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.912+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.52__shadow_key1.2~E8s3GvVoDTCFKvC8J115zldAIjsJ7ti.3_1 2024-09-12T00:45:03.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.912+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.52__multipart_key1.2~E8s3GvVoDTCFKvC8J115zldAIjsJ7ti.4 2024-09-12T00:45:03.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.912+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.52__shadow_key1.2~E8s3GvVoDTCFKvC8J115zldAIjsJ7ti.4_1 2024-09-12T00:45:03.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.912+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.52__multipart_key1.2~E8s3GvVoDTCFKvC8J115zldAIjsJ7ti.5 2024-09-12T00:45:03.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.912+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11550749928281329460', time=2024-09-12T02:44:57.078889+0000, chain.objs.size()=9 2024-09-12T00:45:03.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.912+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.57__multipart_key1.2~3KBbDa92Drua8PFAWKDlvu142RYJs6E.1 2024-09-12T00:45:03.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.912+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.57__shadow_key1.2~3KBbDa92Drua8PFAWKDlvu142RYJs6E.1_1 2024-09-12T00:45:03.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.912+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.57__multipart_key1.2~3KBbDa92Drua8PFAWKDlvu142RYJs6E.2 2024-09-12T00:45:03.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.924+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.57__shadow_key1.2~3KBbDa92Drua8PFAWKDlvu142RYJs6E.2_1 2024-09-12T00:45:03.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.924+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.57__multipart_key1.2~3KBbDa92Drua8PFAWKDlvu142RYJs6E.3 2024-09-12T00:45:03.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.924+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.57__shadow_key1.2~3KBbDa92Drua8PFAWKDlvu142RYJs6E.3_1 2024-09-12T00:45:03.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.924+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.57__multipart_key1.2~3KBbDa92Drua8PFAWKDlvu142RYJs6E.4 2024-09-12T00:45:03.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.924+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.57__shadow_key1.2~3KBbDa92Drua8PFAWKDlvu142RYJs6E.4_1 2024-09-12T00:45:03.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.924+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.57__multipart_key1.2~3KBbDa92Drua8PFAWKDlvu142RYJs6E.5 2024-09-12T00:45:03.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.932+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:45:03.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.936+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:45:03.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.940+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.940+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.940+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:45:03.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.940+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17108666572009892401', time=2024-09-12T02:44:36.863294+0000, chain.objs.size()=9 2024-09-12T00:45:03.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.940+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__multipart_key1.2~lafXRtgUVnsBaW3ZUl-W9AG-l8sWcYe.1 2024-09-12T00:45:03.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.940+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__shadow_key1.2~lafXRtgUVnsBaW3ZUl-W9AG-l8sWcYe.1_1 2024-09-12T00:45:03.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.940+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__multipart_key1.2~lafXRtgUVnsBaW3ZUl-W9AG-l8sWcYe.2 2024-09-12T00:45:03.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.940+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__shadow_key1.2~lafXRtgUVnsBaW3ZUl-W9AG-l8sWcYe.2_1 2024-09-12T00:45:03.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.940+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__multipart_key1.2~lafXRtgUVnsBaW3ZUl-W9AG-l8sWcYe.3 2024-09-12T00:45:03.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.940+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__shadow_key1.2~lafXRtgUVnsBaW3ZUl-W9AG-l8sWcYe.3_1 2024-09-12T00:45:03.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.940+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__multipart_key1.2~lafXRtgUVnsBaW3ZUl-W9AG-l8sWcYe.4 2024-09-12T00:45:03.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.940+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__shadow_key1.2~lafXRtgUVnsBaW3ZUl-W9AG-l8sWcYe.4_1 2024-09-12T00:45:03.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.940+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__multipart_key1.2~lafXRtgUVnsBaW3ZUl-W9AG-l8sWcYe.5 2024-09-12T00:45:03.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.940+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.934953256454037738', time=2024-09-12T02:44:43.973423+0000, chain.objs.size()=1 2024-09-12T00:45:03.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.940+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.53__shadow_.LhZMq8JqeuwKf7_r9X7nFTr6_kNP_Pb_0 2024-09-12T00:45:03.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.948+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:45:03.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.952+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:45:03.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.956+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.956+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.956+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:45:03.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.956+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17963496558640070092', time=2024-09-12T02:44:51.909940+0000, chain.objs.size()=16 2024-09-12T00:45:03.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.956+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~EFCWn-lncKJuQTwSl7RDyv6QojjfRbi.1 2024-09-12T00:45:03.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.956+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~EFCWn-lncKJuQTwSl7RDyv6QojjfRbi.1_1 2024-09-12T00:45:03.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.956+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~EFCWn-lncKJuQTwSl7RDyv6QojjfRbi.1_2 2024-09-12T00:45:03.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.956+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~EFCWn-lncKJuQTwSl7RDyv6QojjfRbi.2 2024-09-12T00:45:03.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.956+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~EFCWn-lncKJuQTwSl7RDyv6QojjfRbi.2_1 2024-09-12T00:45:03.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.956+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~EFCWn-lncKJuQTwSl7RDyv6QojjfRbi.2_2 2024-09-12T00:45:03.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.956+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~EFCWn-lncKJuQTwSl7RDyv6QojjfRbi.3 2024-09-12T00:45:03.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.956+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~EFCWn-lncKJuQTwSl7RDyv6QojjfRbi.3_1 2024-09-12T00:45:03.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.956+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~EFCWn-lncKJuQTwSl7RDyv6QojjfRbi.3_2 2024-09-12T00:45:03.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.956+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~EFCWn-lncKJuQTwSl7RDyv6QojjfRbi.4 2024-09-12T00:45:03.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.956+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~EFCWn-lncKJuQTwSl7RDyv6QojjfRbi.4_1 2024-09-12T00:45:03.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.956+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~EFCWn-lncKJuQTwSl7RDyv6QojjfRbi.4_2 2024-09-12T00:45:03.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.960+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~EFCWn-lncKJuQTwSl7RDyv6QojjfRbi.5 2024-09-12T00:45:03.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.960+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~EFCWn-lncKJuQTwSl7RDyv6QojjfRbi.5_1 2024-09-12T00:45:03.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.960+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__shadow_key1.2~EFCWn-lncKJuQTwSl7RDyv6QojjfRbi.5_2 2024-09-12T00:45:03.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.964+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.55__multipart_key1.2~EFCWn-lncKJuQTwSl7RDyv6QojjfRbi.6 2024-09-12T00:45:03.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.968+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:45:03.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.972+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:45:03.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.972+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.976+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.976+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.980+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:45:03.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.984+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.984+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.984+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:45:03.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.984+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13841115653693059373', time=2024-09-12T02:44:37.553971+0000, chain.objs.size()=7 2024-09-12T00:45:03.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.984+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__multipart_key1.2~OUqBr-4b5EvhSr0dovwJlbwq-R4Uq_P.1 2024-09-12T00:45:03.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.984+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__shadow_key1.2~OUqBr-4b5EvhSr0dovwJlbwq-R4Uq_P.1_1 2024-09-12T00:45:03.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.984+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__shadow_key1.2~OUqBr-4b5EvhSr0dovwJlbwq-R4Uq_P.1_2 2024-09-12T00:45:03.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.984+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__multipart_key1.2~OUqBr-4b5EvhSr0dovwJlbwq-R4Uq_P.2 2024-09-12T00:45:03.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.984+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__shadow_key1.2~OUqBr-4b5EvhSr0dovwJlbwq-R4Uq_P.2_1 2024-09-12T00:45:03.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.984+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__shadow_key1.2~OUqBr-4b5EvhSr0dovwJlbwq-R4Uq_P.2_2 2024-09-12T00:45:03.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.984+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.47__multipart_key1.2~OUqBr-4b5EvhSr0dovwJlbwq-R4Uq_P.3 2024-09-12T00:45:03.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.984+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H', time=2024-09-12T02:44:57.916494+0000, chain.objs.size()=83 2024-09-12T00:45:03.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.984+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.1 2024-09-12T00:45:03.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.984+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.2 2024-09-12T00:45:03.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.984+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.3 2024-09-12T00:45:03.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.984+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.4 2024-09-12T00:45:03.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.984+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.5 2024-09-12T00:45:03.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.992+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.6 2024-09-12T00:45:03.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.992+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.7 2024-09-12T00:45:03.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.992+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.8 2024-09-12T00:45:03.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.992+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.9 2024-09-12T00:45:03.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.992+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.10 2024-09-12T00:45:03.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.992+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.11 2024-09-12T00:45:03.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.992+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.12 2024-09-12T00:45:03.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.992+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.13 2024-09-12T00:45:03.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.992+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.14 2024-09-12T00:45:03.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.992+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.15 2024-09-12T00:45:03.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.992+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.16 2024-09-12T00:45:03.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.992+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.17 2024-09-12T00:45:03.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.996+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.18 2024-09-12T00:45:03.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.996+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.19 2024-09-12T00:45:03.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.996+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.20 2024-09-12T00:45:03.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.996+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.21 2024-09-12T00:45:03.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.996+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.22 2024-09-12T00:45:03.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.996+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.23 2024-09-12T00:45:03.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.996+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.24 2024-09-12T00:45:03.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.996+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.25 2024-09-12T00:45:03.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.996+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.26 2024-09-12T00:45:03.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.996+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.27 2024-09-12T00:45:03.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.996+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.28 2024-09-12T00:45:03.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:02.996+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.29 2024-09-12T00:45:03.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.000+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.30 2024-09-12T00:45:03.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.000+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.31 2024-09-12T00:45:03.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.000+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.32 2024-09-12T00:45:03.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.000+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.33 2024-09-12T00:45:03.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.000+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.34 2024-09-12T00:45:03.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.004+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.35 2024-09-12T00:45:03.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.004+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.36 2024-09-12T00:45:03.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.004+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.37 2024-09-12T00:45:03.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.004+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.38 2024-09-12T00:45:03.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.004+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.39 2024-09-12T00:45:03.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.004+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.40 2024-09-12T00:45:03.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.004+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.41 2024-09-12T00:45:03.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.004+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.42 2024-09-12T00:45:03.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.004+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.43 2024-09-12T00:45:03.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.004+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.44 2024-09-12T00:45:03.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.004+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.45 2024-09-12T00:45:03.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.008+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.46 2024-09-12T00:45:03.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.008+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.47 2024-09-12T00:45:03.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.008+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.48 2024-09-12T00:45:03.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.008+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.49 2024-09-12T00:45:03.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.008+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.50 2024-09-12T00:45:03.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.008+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.51 2024-09-12T00:45:03.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.008+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.52 2024-09-12T00:45:03.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.008+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.53 2024-09-12T00:45:03.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.008+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.54 2024-09-12T00:45:03.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.008+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.55 2024-09-12T00:45:03.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.008+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.56 2024-09-12T00:45:03.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.012+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.57 2024-09-12T00:45:03.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.012+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.58 2024-09-12T00:45:03.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.012+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.59 2024-09-12T00:45:03.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.012+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.60 2024-09-12T00:45:03.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.012+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.61 2024-09-12T00:45:03.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.012+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.62 2024-09-12T00:45:03.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.012+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.63 2024-09-12T00:45:03.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.012+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.64 2024-09-12T00:45:03.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.012+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.65 2024-09-12T00:45:03.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.012+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.66 2024-09-12T00:45:03.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.012+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.67 2024-09-12T00:45:03.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.012+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.68 2024-09-12T00:45:03.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.016+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.69 2024-09-12T00:45:03.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.016+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.70 2024-09-12T00:45:03.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.016+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.71 2024-09-12T00:45:03.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.016+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.72 2024-09-12T00:45:03.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.016+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.73 2024-09-12T00:45:03.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.020+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.74 2024-09-12T00:45:03.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.020+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.75 2024-09-12T00:45:03.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.020+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.76 2024-09-12T00:45:03.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.020+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.77 2024-09-12T00:45:03.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.020+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.78 2024-09-12T00:45:03.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.020+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.79 2024-09-12T00:45:03.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.020+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.80 2024-09-12T00:45:03.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.020+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.81 2024-09-12T00:45:03.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.020+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.83 2024-09-12T00:45:03.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.020+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.58__multipart_key1.2~owbUOlIAZ6yw_uC7fcQq6SQtdj7dT8H.84 2024-09-12T00:45:03.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.224+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:45:03.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.232+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:45:03.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.236+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.240+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.240+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:45:03.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.240+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6238235903071250954', time=2024-09-12T02:44:58.136667+0000, chain.objs.size()=1 2024-09-12T00:45:03.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.240+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.59__shadow_.2LSo8ZiIZ39K-41_LPkhv_u8ypLFUMu_0 2024-09-12T00:45:03.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.240+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5293330517479793901', time=2024-09-12T02:44:59.107796+0000, chain.objs.size()=1 2024-09-12T00:45:03.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.240+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.62__shadow_.yBgUMuOnApENi-BGG7FdrZiu1fhQMnd_0 2024-09-12T00:45:03.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.244+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:45:03.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.248+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:45:03.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.252+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.256+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.256+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:45:03.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.256+0000 7f643e2749c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17111703644460726175', time=2024-09-12T02:44:40.197369+0000, chain.objs.size()=9 2024-09-12T00:45:03.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.256+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.51__multipart_key1.2~EvTYv257e2OkXCm8sVxMxkZvWrP-c7Q.1 2024-09-12T00:45:03.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.256+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.51__shadow_key1.2~EvTYv257e2OkXCm8sVxMxkZvWrP-c7Q.1_1 2024-09-12T00:45:03.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.256+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.51__multipart_key1.2~EvTYv257e2OkXCm8sVxMxkZvWrP-c7Q.2 2024-09-12T00:45:03.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.256+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.51__shadow_key1.2~EvTYv257e2OkXCm8sVxMxkZvWrP-c7Q.2_1 2024-09-12T00:45:03.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.256+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.51__multipart_key1.2~EvTYv257e2OkXCm8sVxMxkZvWrP-c7Q.3 2024-09-12T00:45:03.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.256+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.51__shadow_key1.2~EvTYv257e2OkXCm8sVxMxkZvWrP-c7Q.3_1 2024-09-12T00:45:03.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.256+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.51__multipart_key1.2~EvTYv257e2OkXCm8sVxMxkZvWrP-c7Q.4 2024-09-12T00:45:03.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.256+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.51__shadow_key1.2~EvTYv257e2OkXCm8sVxMxkZvWrP-c7Q.4_1 2024-09-12T00:45:03.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.256+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.51__multipart_key1.2~EvTYv257e2OkXCm8sVxMxkZvWrP-c7Q.5 2024-09-12T00:45:03.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.264+0000 7f643e2749c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:45:03.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.272+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:45:03.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.276+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.276+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.280+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.280+0000 7f643e2749c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:45:03.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.284+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.288+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.288+0000 7f643e2749c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.292+0000 7f62f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:03.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.296+0000 7f643e2749c0 20 remove_watcher() i=0 2024-09-12T00:45:03.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.296+0000 7f643e2749c0 2 removed watcher, disabling cache 2024-09-12T00:45:03.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.300+0000 7f643e2749c0 20 remove_watcher() i=1 2024-09-12T00:45:03.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.304+0000 7f643e2749c0 20 remove_watcher() i=2 2024-09-12T00:45:03.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.304+0000 7f643e2749c0 20 remove_watcher() i=3 2024-09-12T00:45:03.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.308+0000 7f643e2749c0 20 remove_watcher() i=4 2024-09-12T00:45:03.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.312+0000 7f643e2749c0 20 remove_watcher() i=5 2024-09-12T00:45:03.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.312+0000 7f643e2749c0 20 remove_watcher() i=6 2024-09-12T00:45:03.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.316+0000 7f643e2749c0 20 remove_watcher() i=7 2024-09-12T00:45:03.342 DEBUG:teuthology.orchestra.run.smithi043:> radosgw-admin gc process --include-all 2024-09-12T00:45:03.424 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:45:03.424 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:45:03.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.468+0000 7f5926a949c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:03.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.472+0000 7f5926a949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:03.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.472+0000 7f5926a949c0 20 realm 2024-09-12T00:45:03.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.472+0000 7f5926a949c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:03.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.472+0000 7f5926a949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:03.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.472+0000 7f5926a949c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:45:03.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.472+0000 7f5926a949c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:03.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.472+0000 7f5926a949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:03.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.472+0000 7f5926a949c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:03.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.472+0000 7f5926a949c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:03.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.472+0000 7f5926a949c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:03.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.476+0000 7f5926a949c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:45:03.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.476+0000 7f5926a949c0 20 searching for the correct realm 2024-09-12T00:45:03.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.480+0000 7f591bfff640 0 -- 172.21.15.43:0/1891545861 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f590c0d2070 msgr2=0x7f590c0dd940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:03.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.488+0000 7f5924d9b640 0 -- 172.21.15.43:0/1891545861 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f590c0c3910 msgr2=0x7f590c0aa3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:45:03.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.496+0000 7f5926a949c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:45:03.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.496+0000 7f5926a949c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:45:03.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.496+0000 7f5926a949c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:45:03.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.496+0000 7f5926a949c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:45:03.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.496+0000 7f5926a949c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:45:03.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.496+0000 7f5926a949c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:45:03.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.496+0000 7f5926a949c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:03.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.496+0000 7f5926a949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:03.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.496+0000 7f5926a949c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:03.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.496+0000 7f5926a949c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:03.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.496+0000 7f5926a949c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:03.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.496+0000 7f5926a949c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:45:03.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.496+0000 7f5926a949c0 20 zone default found 2024-09-12T00:45:03.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.496+0000 7f5926a949c0 4 Realm: () 2024-09-12T00:45:03.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.496+0000 7f5926a949c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:45:03.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.496+0000 7f5926a949c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:45:03.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.500+0000 7f5926a949c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:45:03.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.500+0000 7f5926a949c0 20 zonegroup default 2024-09-12T00:45:03.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.500+0000 7f5926a949c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:03.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.500+0000 7f5926a949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:03.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.500+0000 7f5926a949c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:03.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.500+0000 7f5926a949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:03.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.500+0000 7f5926a949c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:03.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.500+0000 7f5926a949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:03.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.500+0000 7f5926a949c0 20 started sync module instance, tier type = 2024-09-12T00:45:03.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.500+0000 7f5926a949c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:45:03.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.512+0000 7f5926a949c0 20 add_watcher() i=0 2024-09-12T00:45:03.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.512+0000 7f5926a949c0 20 add_watcher() i=1 2024-09-12T00:45:03.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.512+0000 7f5926a949c0 20 add_watcher() i=2 2024-09-12T00:45:03.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.512+0000 7f5926a949c0 20 add_watcher() i=3 2024-09-12T00:45:03.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.512+0000 7f5926a949c0 20 add_watcher() i=4 2024-09-12T00:45:03.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.512+0000 7f5926a949c0 20 add_watcher() i=5 2024-09-12T00:45:03.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.516+0000 7f5926a949c0 20 add_watcher() i=6 2024-09-12T00:45:03.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.516+0000 7f5926a949c0 20 add_watcher() i=7 2024-09-12T00:45:03.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.516+0000 7f5926a949c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:45:03.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.516+0000 7f57dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:03.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.516+0000 7f5926a949c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:45:03.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.516+0000 7f5926a949c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:45:03.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.592+0000 7f57d9fdb640 20 reqs_thread_entry: start 2024-09-12T00:45:03.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.592+0000 7f5926a949c0 20 init_complete bucket index max shards: 11 2024-09-12T00:45:03.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.592+0000 7f5926a949c0 20 Filter name: none 2024-09-12T00:45:03.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.592+0000 7f574b7fe640 20 reqs_thread_entry: start 2024-09-12T00:45:03.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.592+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:45:03.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.596+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.600+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.600+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.604+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:45:03.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.604+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.608+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.608+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.608+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:45:03.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.612+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.612+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.612+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.616+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:45:03.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.620+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.620+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.620+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.624+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:45:03.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.628+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.628+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.628+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.632+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:45:03.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.636+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.636 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.636+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.636+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.640+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:45:03.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.644+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.644+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.644+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.648+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:45:03.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.648+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.652+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.652+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.652+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:45:03.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.656+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.656+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.656+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.660+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:45:03.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.660+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.664+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.664+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.668+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:45:03.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.672+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.672+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.672+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.672+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:45:03.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.676+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.676+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.676+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.680+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:45:03.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.680+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.680+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.684+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.684+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:45:03.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.688+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.688+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.688+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.692+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:45:03.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.696+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.696+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.696+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.700+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:45:03.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.700+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.704+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.704+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.708+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:45:03.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.708+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.708+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.712+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.712+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:45:03.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.716+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.716+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.720+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.720+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:45:03.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.724+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.724+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.724+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.728+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:45:03.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.732+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.732+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.736+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.736+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:45:03.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.740+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.740+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.740+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.744+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:45:03.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.744+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.748+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.748+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.752+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:45:03.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.752+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.756+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.756+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.756+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:45:03.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.760+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.764+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.764+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.768+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:45:03.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.772+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.772+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.772+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.776+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:45:03.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.780+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.784+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.784+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.784+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:45:03.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.788+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.792+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.792+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.792+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:45:03.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.796+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.800+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.800+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.804+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:45:03.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.808+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.808+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.812+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.812+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:45:03.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.816+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.820+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.820+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.824+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:45:03.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.828+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.828+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.828+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.832+0000 7f5926a949c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:45:03.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.836+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.836+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:03.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.836+0000 7f5926a949c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:03.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.840+0000 7f57dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:03.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.848+0000 7f5926a949c0 20 remove_watcher() i=0 2024-09-12T00:45:03.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.848+0000 7f5926a949c0 2 removed watcher, disabling cache 2024-09-12T00:45:03.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.848+0000 7f5926a949c0 20 remove_watcher() i=1 2024-09-12T00:45:03.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.852+0000 7f5926a949c0 20 remove_watcher() i=2 2024-09-12T00:45:03.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.856+0000 7f5926a949c0 20 remove_watcher() i=3 2024-09-12T00:45:03.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.856+0000 7f5926a949c0 20 remove_watcher() i=4 2024-09-12T00:45:03.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.860+0000 7f5926a949c0 20 remove_watcher() i=5 2024-09-12T00:45:03.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.860+0000 7f5926a949c0 20 remove_watcher() i=6 2024-09-12T00:45:03.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:03.864+0000 7f5926a949c0 20 remove_watcher() i=7 2024-09-12T00:45:03.879 DEBUG:teuthology.orchestra.run.smithi043:> radosgw-admin gc process --include-all 2024-09-12T00:45:03.955 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:45:03.955 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:45:04.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.000+0000 7f9c1d57a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:04.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.004+0000 7f9c1d57a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:04.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.004+0000 7f9c1d57a9c0 20 realm 2024-09-12T00:45:04.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.004+0000 7f9c1d57a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:04.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.004+0000 7f9c1d57a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:04.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.004+0000 7f9c1d57a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:45:04.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.004+0000 7f9c1d57a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:04.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.004+0000 7f9c1d57a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:04.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.004+0000 7f9c1d57a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:04.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.004+0000 7f9c1d57a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:04.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.004+0000 7f9c1d57a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:04.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.004+0000 7f9c1d57a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:45:04.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.004+0000 7f9c1d57a9c0 20 searching for the correct realm 2024-09-12T00:45:04.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.012+0000 7f9c1b881640 0 -- 172.21.15.43:0/278497113 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55b32afe96d0 msgr2=0x55b32afebae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:04.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.020+0000 7f9c1a87f640 0 -- 172.21.15.43:0/278497113 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f9c04034040 msgr2=0x7f9c04085040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:04.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.028+0000 7f9c1d57a9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:45:04.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.028+0000 7f9c1d57a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:45:04.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.028+0000 7f9c1d57a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:45:04.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.028+0000 7f9c1d57a9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:45:04.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.028+0000 7f9c1d57a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:45:04.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.028+0000 7f9c1d57a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:45:04.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.028+0000 7f9c1d57a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:04.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.028+0000 7f9c1d57a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:04.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.028+0000 7f9c1d57a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:04.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.028+0000 7f9c1d57a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:04.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.028+0000 7f9c1d57a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:04.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.028+0000 7f9c1d57a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:45:04.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.028+0000 7f9c1d57a9c0 20 zone default found 2024-09-12T00:45:04.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.028+0000 7f9c1d57a9c0 4 Realm: () 2024-09-12T00:45:04.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.028+0000 7f9c1d57a9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:45:04.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.028+0000 7f9c1d57a9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:45:04.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.028+0000 7f9c1d57a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:45:04.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.028+0000 7f9c1d57a9c0 20 zonegroup default 2024-09-12T00:45:04.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.028+0000 7f9c1d57a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:04.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.028+0000 7f9c1d57a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:04.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.028+0000 7f9c1d57a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:04.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.028+0000 7f9c1d57a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:04.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.028+0000 7f9c1d57a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:04.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.028+0000 7f9c1d57a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:04.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.028+0000 7f9c1d57a9c0 20 started sync module instance, tier type = 2024-09-12T00:45:04.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.028+0000 7f9c1d57a9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:45:04.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.044+0000 7f9c1d57a9c0 20 add_watcher() i=0 2024-09-12T00:45:04.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.044+0000 7f9c1d57a9c0 20 add_watcher() i=1 2024-09-12T00:45:04.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.044+0000 7f9c1d57a9c0 20 add_watcher() i=2 2024-09-12T00:45:04.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.044+0000 7f9c1d57a9c0 20 add_watcher() i=3 2024-09-12T00:45:04.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.044+0000 7f9c1d57a9c0 20 add_watcher() i=4 2024-09-12T00:45:04.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.044+0000 7f9c1d57a9c0 20 add_watcher() i=5 2024-09-12T00:45:04.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.044+0000 7f9c1d57a9c0 20 add_watcher() i=6 2024-09-12T00:45:04.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.044+0000 7f9c1d57a9c0 20 add_watcher() i=7 2024-09-12T00:45:04.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.044+0000 7f9c1d57a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:45:04.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.048+0000 7f9ad27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:04.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.048+0000 7f9c1d57a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:45:04.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.048+0000 7f9c1d57a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:45:04.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.124+0000 7f9ad17e2640 20 reqs_thread_entry: start 2024-09-12T00:45:04.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.124+0000 7f9c1d57a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:45:04.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.124+0000 7f9c1d57a9c0 20 Filter name: none 2024-09-12T00:45:04.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.128+0000 7f9aca7fc640 20 reqs_thread_entry: start 2024-09-12T00:45:04.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.128+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:45:04.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.128+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.132+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.132+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.136+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:45:04.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.136+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.140+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.140+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.140+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:45:04.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.144+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.144+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.148+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.148+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:45:04.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.152+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.152+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.152+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.156+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:45:04.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.160+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.160+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.160+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.160+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:45:04.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.164+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.166 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.168+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.168+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.172+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:45:04.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.176+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.176+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.176+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.180+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:45:04.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.184+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.184+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.184+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.188+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:45:04.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.192+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.192+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.192+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.196+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:45:04.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.200+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.200+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.200+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.204+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:45:04.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.208+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.208+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.212+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.212+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:45:04.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.216+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.220+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.220+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.220+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:45:04.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.224+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.228+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.228+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.228+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:45:04.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.232+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.236+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.236+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.240+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:45:04.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.244+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.244+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.244+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.248+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:45:04.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.252+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.252+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.252+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.256+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:45:04.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.260+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.260+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.260+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.264+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:45:04.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.268+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.268+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.268+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.272+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:45:04.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.276+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.276+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.276+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.280+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:45:04.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.284+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.285 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.288+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.288+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.288+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:45:04.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.292+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.292+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.296+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.296+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:45:04.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.300+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.304+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.304+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.308+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:45:04.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.312+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.312+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.312+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.316+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:45:04.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.320+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.320+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.324+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.324+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:45:04.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.328+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.328+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.332+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.332+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:45:04.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.336+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.340+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.340+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.340+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:45:04.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.344+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.348+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.347 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.348+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.352+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:45:04.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.356+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.356+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.356+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.360+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:45:04.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.364+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.364+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.364+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.368+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:45:04.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.372+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.372+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.372+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.376+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:45:04.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.380+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.380+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.380+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.384+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:45:04.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.388+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.392+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:04.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.392+0000 7f9c1d57a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:04.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.396+0000 7f9ad27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:04.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.404+0000 7f9c1d57a9c0 20 remove_watcher() i=0 2024-09-12T00:45:04.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.404+0000 7f9c1d57a9c0 2 removed watcher, disabling cache 2024-09-12T00:45:04.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.404+0000 7f9c1d57a9c0 20 remove_watcher() i=1 2024-09-12T00:45:04.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.408+0000 7f9c1d57a9c0 20 remove_watcher() i=2 2024-09-12T00:45:04.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.412+0000 7f9c1d57a9c0 20 remove_watcher() i=3 2024-09-12T00:45:04.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.412+0000 7f9c1d57a9c0 20 remove_watcher() i=4 2024-09-12T00:45:04.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.416+0000 7f9c1d57a9c0 20 remove_watcher() i=5 2024-09-12T00:45:04.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.416+0000 7f9c1d57a9c0 20 remove_watcher() i=6 2024-09-12T00:45:04.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.420+0000 7f9c1d57a9c0 20 remove_watcher() i=7 2024-09-12T00:45:04.441 DEBUG:teuthology.orchestra.run.smithi043:> radosgw-admin gc process --include-all 2024-09-12T00:45:04.518 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:45:04.518 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:45:04.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.564+0000 7f99b7a369c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:04.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.568+0000 7f99b7a369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:04.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.568+0000 7f99b7a369c0 20 realm 2024-09-12T00:45:04.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.568+0000 7f99b7a369c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:04.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.568+0000 7f99b7a369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:04.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.568+0000 7f99b7a369c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:45:04.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.568+0000 7f99b7a369c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:04.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.568+0000 7f99b7a369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:04.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.568+0000 7f99b7a369c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:04.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.568+0000 7f99b7a369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:04.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.568+0000 7f99b7a369c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:04.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.572+0000 7f99b7a369c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:45:04.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.572+0000 7f99b7a369c0 20 searching for the correct realm 2024-09-12T00:45:04.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.572+0000 7f99b4d3b640 0 -- 172.21.15.43:0/956237650 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f99ac087060 msgr2=0x7f99ac066930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:04.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:04.788+0000 7f99b553c640 0 -- 172.21.15.43:0/956237650 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f99ac037160 msgr2=0x7f99ac00c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:05.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.004+0000 7f99b7a369c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:45:05.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.004+0000 7f99b7a369c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:45:05.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.004+0000 7f99b7a369c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:45:05.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.004+0000 7f99b7a369c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:45:05.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.004+0000 7f99b7a369c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:45:05.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.004+0000 7f99b7a369c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:45:05.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.004+0000 7f99b7a369c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:05.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.008+0000 7f99b7a369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:05.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.008+0000 7f99b7a369c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:05.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.008+0000 7f99b7a369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:05.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.008+0000 7f99b7a369c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:05.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.008+0000 7f99b7a369c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:45:05.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.008+0000 7f99b7a369c0 20 zone default found 2024-09-12T00:45:05.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.008+0000 7f99b7a369c0 4 Realm: () 2024-09-12T00:45:05.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.008+0000 7f99b7a369c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:45:05.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.008+0000 7f99b7a369c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:45:05.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.008+0000 7f99b7a369c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:45:05.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.008+0000 7f99b7a369c0 20 zonegroup default 2024-09-12T00:45:05.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.008+0000 7f99b7a369c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:05.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.008+0000 7f99b7a369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:05.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.008+0000 7f99b7a369c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:05.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.012+0000 7f99b7a369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:05.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.012+0000 7f99b7a369c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:05.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.012+0000 7f99b7a369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:05.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.012+0000 7f99b7a369c0 20 started sync module instance, tier type = 2024-09-12T00:45:05.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.012+0000 7f99b7a369c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:45:05.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.036+0000 7f99b7a369c0 20 add_watcher() i=0 2024-09-12T00:45:05.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.036+0000 7f99b7a369c0 20 add_watcher() i=1 2024-09-12T00:45:05.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.036+0000 7f99b7a369c0 20 add_watcher() i=2 2024-09-12T00:45:05.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.036+0000 7f99b7a369c0 20 add_watcher() i=3 2024-09-12T00:45:05.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.036+0000 7f99b7a369c0 20 add_watcher() i=4 2024-09-12T00:45:05.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.036+0000 7f99b7a369c0 20 add_watcher() i=5 2024-09-12T00:45:05.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.036+0000 7f99b7a369c0 20 add_watcher() i=6 2024-09-12T00:45:05.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.036+0000 7f99b7a369c0 20 add_watcher() i=7 2024-09-12T00:45:05.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.036+0000 7f99b7a369c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:45:05.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.040+0000 7f986b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:05.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.044+0000 7f99b7a369c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:45:05.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.044+0000 7f99b7a369c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:45:05.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.140+0000 7f986a7e4640 20 reqs_thread_entry: start 2024-09-12T00:45:05.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.140+0000 7f99b7a369c0 20 init_complete bucket index max shards: 11 2024-09-12T00:45:05.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.140+0000 7f99b7a369c0 20 Filter name: none 2024-09-12T00:45:05.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.140+0000 7f97dbfff640 20 reqs_thread_entry: start 2024-09-12T00:45:05.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.140+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:45:05.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.144+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.144+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.144+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.148+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:45:05.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.148+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.152+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.152+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.156+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:45:05.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.156+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.156+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.160+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.160+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:45:05.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.164+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.164+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.164+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.164+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:45:05.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.168+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.172+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.172+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.172+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:45:05.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.176+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.176+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.176+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.180+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:45:05.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.180+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.184+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.184+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.184+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:45:05.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.188+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.188+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.188+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.192+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:45:05.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.196+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.196+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.196+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.200+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:45:05.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.204+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.204+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.204+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.207 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.208+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:45:05.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.208+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.212+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.212+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.212+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:45:05.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.216+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.216+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.220+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.220+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:45:05.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.224+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.224+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.224+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.228+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:45:05.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.232+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.232+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.236+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.236+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:45:05.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.240+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.244+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.244+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.246 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.248+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:45:05.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.252+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.252+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.252+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.252+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:45:05.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.256+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.260+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.260+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.264+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:45:05.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.264+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.264+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.268+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.268+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:45:05.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.272+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.272+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.272+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.276+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:45:05.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.280+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.280+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.284+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.284+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:45:05.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.288+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.292+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.292+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.296+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:45:05.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.296+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.300+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.300+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.304+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:45:05.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.308+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.308+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.308+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.312+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:45:05.315 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.316+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.316+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.320+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.320+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:45:05.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.324+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.328+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.328+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.332+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:45:05.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.336+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.336 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.336+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.337 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.336+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.340+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:45:05.344 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.344+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.348+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.348+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.348+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:45:05.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.352+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.354 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.356+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.356+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.360+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:45:05.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.364+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.368+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.368+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.368+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:45:05.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.372+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.376+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.376+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.380+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:45:05.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.380+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.384+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.384+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.388+0000 7f99b7a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:45:05.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.392+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.392+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:05.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.392+0000 7f99b7a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:05.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.400+0000 7f986b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:05.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.404+0000 7f99b7a369c0 20 remove_watcher() i=0 2024-09-12T00:45:05.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.404+0000 7f99b7a369c0 2 removed watcher, disabling cache 2024-09-12T00:45:05.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.408+0000 7f99b7a369c0 20 remove_watcher() i=1 2024-09-12T00:45:05.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.408+0000 7f99b7a369c0 20 remove_watcher() i=2 2024-09-12T00:45:05.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.412+0000 7f99b7a369c0 20 remove_watcher() i=3 2024-09-12T00:45:05.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.416+0000 7f99b7a369c0 20 remove_watcher() i=4 2024-09-12T00:45:05.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.416+0000 7f99b7a369c0 20 remove_watcher() i=5 2024-09-12T00:45:05.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.420+0000 7f99b7a369c0 20 remove_watcher() i=6 2024-09-12T00:45:05.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:05.420+0000 7f99b7a369c0 20 remove_watcher() i=7 2024-09-12T00:45:05.441 DEBUG:teuthology.orchestra.run.smithi043:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-12T00:45:06.153 INFO:teuthology.orchestra.run.smithi043.stdout:> Task :clean 2024-09-12T00:45:06.950 INFO:teuthology.orchestra.run.smithi043.stdout:> Task :compileJava 2024-09-12T00:45:06.951 INFO:teuthology.orchestra.run.smithi043.stdout:> Task :processResources 2024-09-12T00:45:06.951 INFO:teuthology.orchestra.run.smithi043.stdout:> Task :classes 2024-09-12T00:45:07.561 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:07.561 INFO:teuthology.orchestra.run.smithi043.stdout:> Task :compileTestJava 2024-09-12T00:45:07.561 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:07.562 INFO:teuthology.orchestra.run.smithi043.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:45:07.562 INFO:teuthology.orchestra.run.smithi043.stdout:> Task :testClasses 2024-09-12T00:45:07.562 INFO:teuthology.orchestra.run.smithi043.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:45:07.562 INFO:teuthology.orchestra.run.smithi043.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:45:09.552 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:09.552 INFO:teuthology.orchestra.run.smithi043.stdout:> Task :test 2024-09-12T00:45:09.552 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:09.552 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Bucket tests STANDARD_OUT 2024-09-12T00:45:09.552 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12 00:45:08,859 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:45:09.552 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:09.552 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-12T00:45:09.553 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:09.553 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-12T00:45:09.553 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:09.553 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-12T00:45:09.553 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:09.553 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-12T00:45:09.751 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:09.751 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-12T00:45:09.751 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:09.751 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-12T00:45:10.050 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:10.051 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-12T00:45:10.251 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:10.251 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-12T00:45:10.350 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:10.350 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-12T00:45:10.450 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:10.450 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-12T00:45:10.750 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:10.751 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-12T00:45:10.751 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:10.751 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-12T00:45:10.950 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:10.951 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-12T00:45:11.050 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:11.051 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-12T00:45:11.550 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:11.551 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-12T00:45:11.650 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:11.651 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-12T00:45:11.850 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:11.850 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-12T00:45:11.950 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:11.950 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-12T00:45:12.151 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:12.151 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------- 2024-09-12T00:45:12.151 INFO:teuthology.orchestra.run.smithi043.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-12T00:45:12.151 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------- 2024-09-12T00:45:12.151 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:12.151 INFO:teuthology.orchestra.run.smithi043.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T00:45:12.152 INFO:teuthology.orchestra.run.smithi043.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T00:45:12.152 INFO:teuthology.orchestra.run.smithi043.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T00:45:12.152 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:12.152 INFO:teuthology.orchestra.run.smithi043.stdout:BUILD SUCCESSFUL in 6s 2024-09-12T00:45:12.152 INFO:teuthology.orchestra.run.smithi043.stdout:5 actionable tasks: 5 executed 2024-09-12T00:45:12.183 DEBUG:teuthology.orchestra.run.smithi043:> radosgw-admin gc process --include-all 2024-09-12T00:45:12.209 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:45:12.209 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:45:12.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.256+0000 7fd69b6e99c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:12.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.256+0000 7fd69b6e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:12.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.256+0000 7fd69b6e99c0 20 realm 2024-09-12T00:45:12.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.256+0000 7fd69b6e99c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:12.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.256+0000 7fd69b6e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:12.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.256+0000 7fd69b6e99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:45:12.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.256+0000 7fd69b6e99c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:12.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.256+0000 7fd69b6e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:12.257 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.256+0000 7fd69b6e99c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:12.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.260+0000 7fd69b6e99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:12.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.260+0000 7fd69b6e99c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:12.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.260+0000 7fd69b6e99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:45:12.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.260+0000 7fd69b6e99c0 20 searching for the correct realm 2024-09-12T00:45:12.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.264+0000 7fd6999f0640 0 -- 172.21.15.43:0/2307306321 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x563f46551380 msgr2=0x563f46553820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:12.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.272+0000 7fd6989ee640 0 -- 172.21.15.43:0/2307306321 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fd6900d1000 msgr2=0x7fd6900fe630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:12.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.280+0000 7fd69b6e99c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:45:12.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.280+0000 7fd69b6e99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:45:12.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.280+0000 7fd69b6e99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:45:12.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.280+0000 7fd69b6e99c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:45:12.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.280+0000 7fd69b6e99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:45:12.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.280+0000 7fd69b6e99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:45:12.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.280+0000 7fd69b6e99c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:12.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.280+0000 7fd69b6e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:12.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.280+0000 7fd69b6e99c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:12.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.280+0000 7fd69b6e99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:12.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.280+0000 7fd69b6e99c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:12.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.280+0000 7fd69b6e99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:45:12.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.280+0000 7fd69b6e99c0 20 zone default found 2024-09-12T00:45:12.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.280+0000 7fd69b6e99c0 4 Realm: () 2024-09-12T00:45:12.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.280+0000 7fd69b6e99c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:45:12.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.280+0000 7fd69b6e99c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:45:12.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.280+0000 7fd69b6e99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:45:12.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.280+0000 7fd69b6e99c0 20 zonegroup default 2024-09-12T00:45:12.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.280+0000 7fd69b6e99c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:12.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.280+0000 7fd69b6e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:12.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.280+0000 7fd69b6e99c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:12.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.280+0000 7fd69b6e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:12.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.280+0000 7fd69b6e99c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:12.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.280+0000 7fd69b6e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:12.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.280+0000 7fd69b6e99c0 20 started sync module instance, tier type = 2024-09-12T00:45:12.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.280+0000 7fd69b6e99c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:45:12.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.296+0000 7fd69b6e99c0 20 add_watcher() i=0 2024-09-12T00:45:12.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.296+0000 7fd69b6e99c0 20 add_watcher() i=1 2024-09-12T00:45:12.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.296+0000 7fd69b6e99c0 20 add_watcher() i=2 2024-09-12T00:45:12.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.296+0000 7fd69b6e99c0 20 add_watcher() i=3 2024-09-12T00:45:12.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.296+0000 7fd69b6e99c0 20 add_watcher() i=4 2024-09-12T00:45:12.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.296+0000 7fd69b6e99c0 20 add_watcher() i=5 2024-09-12T00:45:12.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.296+0000 7fd69b6e99c0 20 add_watcher() i=6 2024-09-12T00:45:12.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.296+0000 7fd69b6e99c0 20 add_watcher() i=7 2024-09-12T00:45:12.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.296+0000 7fd69b6e99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:45:12.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.300+0000 7fd54f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:12.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.300+0000 7fd69b6e99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:45:12.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.300+0000 7fd69b6e99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:45:12.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.368+0000 7fd54e7e4640 20 reqs_thread_entry: start 2024-09-12T00:45:12.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.368+0000 7fd69b6e99c0 20 init_complete bucket index max shards: 11 2024-09-12T00:45:12.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.368+0000 7fd69b6e99c0 20 Filter name: none 2024-09-12T00:45:12.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.368+0000 7fd4bffff640 20 reqs_thread_entry: start 2024-09-12T00:45:12.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.368+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:45:12.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.372+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.372+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.372+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.372+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:45:12.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.376+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.376+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.376+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.380+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:45:12.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.384+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.384+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.384+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.388+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:45:12.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.388+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.392+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.392+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.392+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:45:12.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.396+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.396+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.396+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.400+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:45:12.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.400+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.400+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.400+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.404+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:45:12.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.404+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.404+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.404+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.408+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:45:12.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.408+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.412+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.412+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.412+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:45:12.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.416+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.416+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.416+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.416+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:45:12.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.420+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.420+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.420+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.424+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:45:12.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.424+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.424+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.424+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:45:12.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.424+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2914377185715724768', time=2024-09-12T02:45:10.513267+0000, chain.objs.size()=1 2024-09-12T00:45:12.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.424+0000 7fd69b6e99c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.71__shadow_.ICCKyp0b96F4Kj5D9DlPAs8oVHBePbv_0 2024-09-12T00:45:12.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.428+0000 7fd69b6e99c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:45:12.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.432+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:45:12.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.436+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.436+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.436+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.440+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:45:12.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.444+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.444+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.444+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.444+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:45:12.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.448+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.448+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.452+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:45:12.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.452+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2012726696268720026', time=2024-09-12T02:45:11.106393+0000, chain.objs.size()=1 2024-09-12T00:45:12.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.452+0000 7fd69b6e99c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.72__shadow_.zgg7l323Tu6bALMszSDuwLw3IT-CVFH_0 2024-09-12T00:45:12.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.452+0000 7fd69b6e99c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:45:12.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.460+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:45:12.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.464+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.464+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.464+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.468+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:45:12.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.468+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.472+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.472+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.476+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:45:12.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.480+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.480+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.480+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.484+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:45:12.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.488+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.488+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.492+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.492+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:45:12.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.496+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.496+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.496+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.500+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:45:12.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.500+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.504+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.504+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.508+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:45:12.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.508+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.512+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.512+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.512+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:45:12.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.516+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.520+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.520+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.520+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:45:12.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.524+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.528+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.528+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.528+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:45:12.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.532+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.536+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.536+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.540+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:45:12.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.540+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.544+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.544+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.544+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:45:12.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.548+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.548+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.552+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.552+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:45:12.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.556+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.556+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.556+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.560+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:45:12.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.564+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.564+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.568+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.568+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:45:12.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.572+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.572+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.576+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.576+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:45:12.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.580+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.580+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.580+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.584+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:45:12.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.588+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.588 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.588+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.592+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.592+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:45:12.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.596+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.596+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.600+0000 7fd69b6e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.604+0000 7fd54f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:12.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.608+0000 7fd69b6e99c0 20 remove_watcher() i=0 2024-09-12T00:45:12.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.608+0000 7fd69b6e99c0 2 removed watcher, disabling cache 2024-09-12T00:45:12.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.612+0000 7fd69b6e99c0 20 remove_watcher() i=1 2024-09-12T00:45:12.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.612+0000 7fd69b6e99c0 20 remove_watcher() i=2 2024-09-12T00:45:12.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.616+0000 7fd69b6e99c0 20 remove_watcher() i=3 2024-09-12T00:45:12.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.616+0000 7fd69b6e99c0 20 remove_watcher() i=4 2024-09-12T00:45:12.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.620+0000 7fd69b6e99c0 20 remove_watcher() i=5 2024-09-12T00:45:12.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.620+0000 7fd69b6e99c0 20 remove_watcher() i=6 2024-09-12T00:45:12.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.624+0000 7fd69b6e99c0 20 remove_watcher() i=7 2024-09-12T00:45:12.640 DEBUG:teuthology.orchestra.run.smithi043:> radosgw-admin gc process --include-all 2024-09-12T00:45:12.714 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:45:12.714 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:45:12.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.760+0000 7f1a17fc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:12.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.764+0000 7f1a17fc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:12.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.764+0000 7f1a17fc59c0 20 realm 2024-09-12T00:45:12.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.764+0000 7f1a17fc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:12.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.764+0000 7f1a17fc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:12.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.764+0000 7f1a17fc59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:45:12.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.764+0000 7f1a17fc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:12.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.764+0000 7f1a17fc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:12.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.764+0000 7f1a17fc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:12.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.764+0000 7f1a17fc59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:12.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.764+0000 7f1a17fc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:12.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.764+0000 7f1a17fc59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:45:12.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.764+0000 7f1a17fc59c0 20 searching for the correct realm 2024-09-12T00:45:12.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.772+0000 7f1a152ca640 0 -- 172.21.15.43:0/1957939344 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55fe0dacfcd0 msgr2=0x55fe0dad2160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:12.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.776+0000 7f1a152ca640 0 -- 172.21.15.43:0/1957939344 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f1a0c12ccc0 msgr2=0x7f1a0c0e1a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:12.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.784+0000 7f1a17fc59c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:45:12.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.784+0000 7f1a17fc59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:45:12.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.784+0000 7f1a17fc59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:45:12.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.784+0000 7f1a17fc59c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:45:12.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.784+0000 7f1a17fc59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:45:12.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.784+0000 7f1a17fc59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:45:12.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.784+0000 7f1a17fc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:12.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.784+0000 7f1a17fc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:12.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.784+0000 7f1a17fc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:12.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.784+0000 7f1a17fc59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:12.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.784+0000 7f1a17fc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:12.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.784+0000 7f1a17fc59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:45:12.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.784+0000 7f1a17fc59c0 20 zone default found 2024-09-12T00:45:12.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.784+0000 7f1a17fc59c0 4 Realm: () 2024-09-12T00:45:12.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.784+0000 7f1a17fc59c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:45:12.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.784+0000 7f1a17fc59c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:45:12.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.784+0000 7f1a17fc59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:45:12.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.784+0000 7f1a17fc59c0 20 zonegroup default 2024-09-12T00:45:12.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.788+0000 7f1a17fc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:12.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.788+0000 7f1a17fc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:12.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.788+0000 7f1a17fc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:12.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.788+0000 7f1a17fc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:12.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.788+0000 7f1a17fc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:12.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.788+0000 7f1a17fc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:12.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.788+0000 7f1a17fc59c0 20 started sync module instance, tier type = 2024-09-12T00:45:12.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.788+0000 7f1a17fc59c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:45:12.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.804+0000 7f1a17fc59c0 20 add_watcher() i=0 2024-09-12T00:45:12.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.804+0000 7f1a17fc59c0 20 add_watcher() i=1 2024-09-12T00:45:12.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.804+0000 7f1a17fc59c0 20 add_watcher() i=2 2024-09-12T00:45:12.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.804+0000 7f1a17fc59c0 20 add_watcher() i=3 2024-09-12T00:45:12.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.804+0000 7f1a17fc59c0 20 add_watcher() i=4 2024-09-12T00:45:12.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.804+0000 7f1a17fc59c0 20 add_watcher() i=5 2024-09-12T00:45:12.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.804+0000 7f1a17fc59c0 20 add_watcher() i=6 2024-09-12T00:45:12.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.804+0000 7f1a17fc59c0 20 add_watcher() i=7 2024-09-12T00:45:12.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.804+0000 7f1a17fc59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:45:12.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.804+0000 7f18c77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:12.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.808+0000 7f1a17fc59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:45:12.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.808+0000 7f1a17fc59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:45:12.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.876+0000 7f18c67fc640 20 reqs_thread_entry: start 2024-09-12T00:45:12.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.876+0000 7f1a17fc59c0 20 init_complete bucket index max shards: 11 2024-09-12T00:45:12.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.876+0000 7f1a17fc59c0 20 Filter name: none 2024-09-12T00:45:12.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.876+0000 7f1837fff640 20 reqs_thread_entry: start 2024-09-12T00:45:12.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.876+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:45:12.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.880+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.880+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.880+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.880+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:45:12.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.884+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.884+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.884+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.888+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:45:12.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.888+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.888+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.892+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.892+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:45:12.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.896+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.896+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.900+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.900+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:45:12.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.904+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.904+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.904+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.908+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:45:12.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.912+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.912+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.912+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.916+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:45:12.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.916+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.916+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.920+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.920+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:45:12.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.924+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.924+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.928+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.928+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:45:12.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.936+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.936+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.940+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.940+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:45:12.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.944+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.948+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.948+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.952+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:45:12.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.952+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.952+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.952+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.956+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:45:12.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.960+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.960+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.960+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.964+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:45:12.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.964+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.968+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.968+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.968+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:45:12.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.972+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.972+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.972+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.976+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:45:12.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.980+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.980+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.980+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.984+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:45:12.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.988+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.988+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.988+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.992+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:45:12.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.996+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.996+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:12.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:12.996+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:12.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.000+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:45:13.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.004+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.004+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.004+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.008+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:45:13.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.012+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.012+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.012+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.012+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:45:13.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.016+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.016+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.020+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.020+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:45:13.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.024+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.024+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.028+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.028+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:45:13.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.032+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.032+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.032+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.036+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:45:13.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.040+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.040+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.040+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.044+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:45:13.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.048+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.048+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.048+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.052+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:45:13.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.052+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.056+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.056+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.056+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:45:13.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.060+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.060+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.060+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.064+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:45:13.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.068+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.068+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.072+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.072+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:45:13.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.076+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.080+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.080+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.080+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:45:13.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.084+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.084+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.088+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.088+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:45:13.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.092+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.092+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.092+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.096+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:45:13.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.096+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.096+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.096+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.100+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:45:13.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.104+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.104+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.104+0000 7f1a17fc59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.108+0000 7f18c77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:13.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.116+0000 7f1a17fc59c0 20 remove_watcher() i=0 2024-09-12T00:45:13.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.116+0000 7f1a17fc59c0 2 removed watcher, disabling cache 2024-09-12T00:45:13.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.116+0000 7f1a17fc59c0 20 remove_watcher() i=1 2024-09-12T00:45:13.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.120+0000 7f1a17fc59c0 20 remove_watcher() i=2 2024-09-12T00:45:13.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.124+0000 7f1a17fc59c0 20 remove_watcher() i=3 2024-09-12T00:45:13.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.124+0000 7f1a17fc59c0 20 remove_watcher() i=4 2024-09-12T00:45:13.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.128+0000 7f1a17fc59c0 20 remove_watcher() i=5 2024-09-12T00:45:13.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.128+0000 7f1a17fc59c0 20 remove_watcher() i=6 2024-09-12T00:45:13.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.132+0000 7f1a17fc59c0 20 remove_watcher() i=7 2024-09-12T00:45:13.151 DEBUG:teuthology.orchestra.run.smithi043:> radosgw-admin gc process --include-all 2024-09-12T00:45:13.225 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:45:13.225 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:45:13.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.272+0000 7fa0f49549c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:13.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.272+0000 7fa0f49549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:13.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.272+0000 7fa0f49549c0 20 realm 2024-09-12T00:45:13.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.272+0000 7fa0f49549c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:13.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.272+0000 7fa0f49549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:13.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.272+0000 7fa0f49549c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:45:13.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.272+0000 7fa0f49549c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:13.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.272+0000 7fa0f49549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:13.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.272+0000 7fa0f49549c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:13.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.276+0000 7fa0f49549c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:13.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.276+0000 7fa0f49549c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:13.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.276+0000 7fa0f49549c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:45:13.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.276+0000 7fa0f49549c0 20 searching for the correct realm 2024-09-12T00:45:13.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.280+0000 7fa0f1c59640 0 -- 172.21.15.43:0/3427743512 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fa0dc0e8040 msgr2=0x7fa0dc0da410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:13.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.288+0000 7fa0f1c59640 0 -- 172.21.15.43:0/3427743512 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f9fbc080b00 msgr2=0x7f9fbc082f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:13.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.296+0000 7fa0f49549c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:45:13.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.296+0000 7fa0f49549c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:45:13.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.296+0000 7fa0f49549c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:45:13.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.296+0000 7fa0f49549c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:45:13.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.296+0000 7fa0f49549c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:45:13.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.296+0000 7fa0f49549c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:45:13.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.296+0000 7fa0f49549c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:13.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.296+0000 7fa0f49549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:13.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.296+0000 7fa0f49549c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:13.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.296+0000 7fa0f49549c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:13.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.296+0000 7fa0f49549c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:13.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.296+0000 7fa0f49549c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:45:13.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.296+0000 7fa0f49549c0 20 zone default found 2024-09-12T00:45:13.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.296+0000 7fa0f49549c0 4 Realm: () 2024-09-12T00:45:13.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.296+0000 7fa0f49549c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:45:13.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.296+0000 7fa0f49549c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:45:13.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.296+0000 7fa0f49549c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:45:13.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.296+0000 7fa0f49549c0 20 zonegroup default 2024-09-12T00:45:13.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.296+0000 7fa0f49549c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:13.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.296+0000 7fa0f49549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:13.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.296+0000 7fa0f49549c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:13.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.296+0000 7fa0f49549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:13.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.296+0000 7fa0f49549c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:13.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.300+0000 7fa0f49549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:13.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.300+0000 7fa0f49549c0 20 started sync module instance, tier type = 2024-09-12T00:45:13.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.300+0000 7fa0f49549c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:45:13.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.312+0000 7fa0f49549c0 20 add_watcher() i=0 2024-09-12T00:45:13.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.312+0000 7fa0f49549c0 20 add_watcher() i=1 2024-09-12T00:45:13.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.312+0000 7fa0f49549c0 20 add_watcher() i=2 2024-09-12T00:45:13.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.312+0000 7fa0f49549c0 20 add_watcher() i=3 2024-09-12T00:45:13.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.312+0000 7fa0f49549c0 20 add_watcher() i=4 2024-09-12T00:45:13.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.312+0000 7fa0f49549c0 20 add_watcher() i=5 2024-09-12T00:45:13.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.316+0000 7fa0f49549c0 20 add_watcher() i=6 2024-09-12T00:45:13.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.316+0000 7fa0f49549c0 20 add_watcher() i=7 2024-09-12T00:45:13.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.316+0000 7fa0f49549c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:45:13.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.316+0000 7f9fa8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:13.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.316+0000 7fa0f49549c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:45:13.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.316+0000 7fa0f49549c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:45:13.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.388+0000 7f9f237fe640 20 reqs_thread_entry: start 2024-09-12T00:45:13.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.388+0000 7fa0f49549c0 20 init_complete bucket index max shards: 11 2024-09-12T00:45:13.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.388+0000 7fa0f49549c0 20 Filter name: none 2024-09-12T00:45:13.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.388+0000 7f9f217fa640 20 reqs_thread_entry: start 2024-09-12T00:45:13.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.388+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:45:13.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.388+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.388+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.392+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.392+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:45:13.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.392+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.396+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.396+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.396+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:45:13.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.400+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.400+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.400+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.400+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:45:13.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.404+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.408+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.408+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.412+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:45:13.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.412+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.412+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.412+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.416+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:45:13.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.420+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.420+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.420+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.424+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:45:13.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.428+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.428+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.428+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.428+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:45:13.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.432+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.433 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.432+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.436+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.436+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:45:13.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.440+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.444+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.444+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.448+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:45:13.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.448+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.452+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.452+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.456+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:45:13.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.456+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.456+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.456+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.460+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:45:13.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.464+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.464+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.468+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.468+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:45:13.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.472+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.472+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.472+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.476+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:45:13.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.480+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.480+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.480+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.484+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:45:13.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.488+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.488+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.488+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.492+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:45:13.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.496+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.496+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.500+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.500+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:45:13.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.504+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.504+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.504+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.508+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:45:13.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.512+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.512+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.516+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.516+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:45:13.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.520+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.520+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.524+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.524+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:45:13.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.528+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.532+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.532+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.536+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:45:13.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.540+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.540+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.540+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.544+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:45:13.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.548+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.548+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.548+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.552+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:45:13.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.556+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.556+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.556+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.560+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:45:13.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.564+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.564+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.568+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.568+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:45:13.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.572+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.572+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.572+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.576+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:45:13.579 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.580+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.580 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.580+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.580+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.584+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:45:13.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.588+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.588+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.592+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.592+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:45:13.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.596+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.596+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.600+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.600+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:45:13.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.604+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.608+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.608+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.608+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:45:13.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.612+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.612+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.616+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.616+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:45:13.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.620+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.620+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.620+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.624+0000 7fa0f49549c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:45:13.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.628+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.628+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.632+0000 7fa0f49549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.636+0000 7f9fa8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:13.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.640+0000 7fa0f49549c0 20 remove_watcher() i=0 2024-09-12T00:45:13.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.640+0000 7fa0f49549c0 2 removed watcher, disabling cache 2024-09-12T00:45:13.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.644+0000 7fa0f49549c0 20 remove_watcher() i=1 2024-09-12T00:45:13.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.648+0000 7fa0f49549c0 20 remove_watcher() i=2 2024-09-12T00:45:13.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.652+0000 7fa0f49549c0 20 remove_watcher() i=3 2024-09-12T00:45:13.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.652+0000 7fa0f49549c0 20 remove_watcher() i=4 2024-09-12T00:45:13.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.656+0000 7fa0f49549c0 20 remove_watcher() i=5 2024-09-12T00:45:13.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.656+0000 7fa0f49549c0 20 remove_watcher() i=6 2024-09-12T00:45:13.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.660+0000 7fa0f49549c0 20 remove_watcher() i=7 2024-09-12T00:45:13.680 DEBUG:teuthology.orchestra.run.smithi043:> radosgw-admin gc process --include-all 2024-09-12T00:45:13.753 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:45:13.753 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:45:13.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.800+0000 7fb0ce9659c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:13.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.800+0000 7fb0ce9659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:13.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.800+0000 7fb0ce9659c0 20 realm 2024-09-12T00:45:13.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.800+0000 7fb0ce9659c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:13.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.800+0000 7fb0ce9659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:13.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.800+0000 7fb0ce9659c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:45:13.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.800+0000 7fb0ce9659c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:13.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.800+0000 7fb0ce9659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:13.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.800+0000 7fb0ce9659c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:13.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.804+0000 7fb0ce9659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:13.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.804+0000 7fb0ce9659c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:13.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.804+0000 7fb0ce9659c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:45:13.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.804+0000 7fb0ce9659c0 20 searching for the correct realm 2024-09-12T00:45:13.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.812+0000 7fb0cbc6a640 0 -- 172.21.15.43:0/3508634333 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x564b17384520 msgr2=0x564b17386910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:13.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.816+0000 7fb0cbc6a640 0 -- 172.21.15.43:0/3508634333 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fb0c00668f0 msgr2=0x7fb0c0067910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:13.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.824+0000 7fb0ce9659c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:45:13.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.824+0000 7fb0ce9659c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:45:13.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.824+0000 7fb0ce9659c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:45:13.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.824+0000 7fb0ce9659c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:45:13.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.824+0000 7fb0ce9659c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:45:13.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.824+0000 7fb0ce9659c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:45:13.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.824+0000 7fb0ce9659c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:13.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.824+0000 7fb0ce9659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:13.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.824+0000 7fb0ce9659c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:13.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.824+0000 7fb0ce9659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:13.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.824+0000 7fb0ce9659c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:13.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.824+0000 7fb0ce9659c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:45:13.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.824+0000 7fb0ce9659c0 20 zone default found 2024-09-12T00:45:13.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.824+0000 7fb0ce9659c0 4 Realm: () 2024-09-12T00:45:13.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.824+0000 7fb0ce9659c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:45:13.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.824+0000 7fb0ce9659c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:45:13.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.824+0000 7fb0ce9659c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:45:13.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.824+0000 7fb0ce9659c0 20 zonegroup default 2024-09-12T00:45:13.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.824+0000 7fb0ce9659c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:13.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.824+0000 7fb0ce9659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:13.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.824+0000 7fb0ce9659c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:13.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.828+0000 7fb0ce9659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:13.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.828+0000 7fb0ce9659c0 20 rados->read ofs=0 len=0 2024-09-12T00:45:13.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.828+0000 7fb0ce9659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:13.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.828+0000 7fb0ce9659c0 20 started sync module instance, tier type = 2024-09-12T00:45:13.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.828+0000 7fb0ce9659c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:45:13.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.844+0000 7fb0ce9659c0 20 add_watcher() i=0 2024-09-12T00:45:13.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.844+0000 7fb0ce9659c0 20 add_watcher() i=1 2024-09-12T00:45:13.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.844+0000 7fb0ce9659c0 20 add_watcher() i=2 2024-09-12T00:45:13.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.844+0000 7fb0ce9659c0 20 add_watcher() i=3 2024-09-12T00:45:13.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.844+0000 7fb0ce9659c0 20 add_watcher() i=4 2024-09-12T00:45:13.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.844+0000 7fb0ce9659c0 20 add_watcher() i=5 2024-09-12T00:45:13.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.844+0000 7fb0ce9659c0 20 add_watcher() i=6 2024-09-12T00:45:13.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.844+0000 7fb0ce9659c0 20 add_watcher() i=7 2024-09-12T00:45:13.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.844+0000 7fb0ce9659c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:45:13.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.844+0000 7faf82fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:13.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.848+0000 7fb0ce9659c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:45:13.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.848+0000 7fb0ce9659c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:45:13.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.920+0000 7faf81fdb640 20 reqs_thread_entry: start 2024-09-12T00:45:13.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.920+0000 7fb0ce9659c0 20 init_complete bucket index max shards: 11 2024-09-12T00:45:13.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.920+0000 7fb0ce9659c0 20 Filter name: none 2024-09-12T00:45:13.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.920+0000 7faef37fe640 20 reqs_thread_entry: start 2024-09-12T00:45:13.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.920+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:45:13.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.924+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.924+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.924+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.924+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:45:13.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.928+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.928+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.928+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.932+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:45:13.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.936+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.936+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.940+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.940+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:45:13.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.944+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.944+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.944+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.948+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:45:13.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.952+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.952+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.952+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.956+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:45:13.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.956+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.960+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.960+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.960+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:45:13.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.964+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.968+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.968+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.968+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:45:13.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.972+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.976+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.976+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.980+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:45:13.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.980+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.980+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.984+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.984+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:45:13.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.988+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.988+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.988+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.992+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:45:13.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.996+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.996+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:13.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:13.996+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:13.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.000+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:45:14.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.000+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.000+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:14.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.000+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.004+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:45:14.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.008+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.008+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:14.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.008+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.012+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:45:14.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.016+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.016+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:14.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.016+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.020+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:45:14.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.024+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.024+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:14.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.024+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.024+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:45:14.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.028+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.032+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:14.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.032+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.032+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:45:14.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.036+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.036+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:14.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.036+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.040+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:45:14.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.040+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.044+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:14.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.044+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.044+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:45:14.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.048+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.048+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:14.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.048+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.052+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:45:14.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.056+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.056+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:14.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.056+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.060+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:45:14.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.060+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.064+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:14.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.064+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.064+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:45:14.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.068+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.072+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:14.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.072+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.072+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:45:14.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.076+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.080+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:14.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.080+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.084+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:45:14.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.088+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.088+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:14.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.088+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.092+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:45:14.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.096+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.096+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:14.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.100+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.104+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:45:14.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.104+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.108+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:14.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.108+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.112+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:45:14.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.116+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.116+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:14.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.116+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.120+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:45:14.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.124+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.124+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:14.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.124+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.128+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:45:14.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.132+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.136+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:14.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.136+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.140+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:45:14.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.144+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.144+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:14.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.144+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.148+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:45:14.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.152+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.152+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:14.153 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.156+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.156+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:45:14.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.164+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.164+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:45:14.165 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.168+0000 7fb0ce9659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:45:14.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.172+0000 7faf82fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:14.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.176+0000 7fb0ce9659c0 20 remove_watcher() i=0 2024-09-12T00:45:14.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.176+0000 7fb0ce9659c0 2 removed watcher, disabling cache 2024-09-12T00:45:14.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.180+0000 7fb0ce9659c0 20 remove_watcher() i=1 2024-09-12T00:45:14.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.184+0000 7fb0ce9659c0 20 remove_watcher() i=2 2024-09-12T00:45:14.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.184+0000 7fb0ce9659c0 20 remove_watcher() i=3 2024-09-12T00:45:14.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.188+0000 7fb0ce9659c0 20 remove_watcher() i=4 2024-09-12T00:45:14.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.192+0000 7fb0ce9659c0 20 remove_watcher() i=5 2024-09-12T00:45:14.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.192+0000 7fb0ce9659c0 20 remove_watcher() i=6 2024-09-12T00:45:14.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:45:14.196+0000 7fb0ce9659c0 20 remove_watcher() i=7 2024-09-12T00:45:14.218 DEBUG:teuthology.orchestra.run.smithi043:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-12T00:45:14.929 INFO:teuthology.orchestra.run.smithi043.stdout:> Task :clean 2024-09-12T00:45:15.627 INFO:teuthology.orchestra.run.smithi043.stdout:> Task :compileJava 2024-09-12T00:45:15.627 INFO:teuthology.orchestra.run.smithi043.stdout:> Task :processResources 2024-09-12T00:45:15.627 INFO:teuthology.orchestra.run.smithi043.stdout:> Task :classes 2024-09-12T00:45:16.127 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:16.127 INFO:teuthology.orchestra.run.smithi043.stdout:> Task :compileTestJava 2024-09-12T00:45:16.127 INFO:teuthology.orchestra.run.smithi043.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:45:16.127 INFO:teuthology.orchestra.run.smithi043.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:45:16.226 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:16.226 INFO:teuthology.orchestra.run.smithi043.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:45:16.227 INFO:teuthology.orchestra.run.smithi043.stdout:> Task :testClasses 2024-09-12T00:45:18.128 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:18.128 INFO:teuthology.orchestra.run.smithi043.stdout:> Task :test 2024-09-12T00:45:18.129 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:18.129 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests STANDARD_OUT 2024-09-12T00:45:18.129 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12 00:45:17,589 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:45:18.129 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:18.129 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-12T00:45:18.129 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:18.129 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-12T00:45:18.527 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:18.527 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-12T00:45:18.527 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:18.527 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-12T00:45:18.826 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:18.827 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-12T00:45:18.927 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:18.927 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-12T00:45:19.126 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:19.127 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-12T00:45:21.026 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:21.027 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-12T00:45:21.326 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:21.327 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-12T00:45:21.426 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:21.427 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-12T00:45:21.726 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:21.727 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-12T00:45:21.826 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:21.827 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-12T00:45:22.127 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:22.127 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-12T00:45:22.127 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:22.127 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-12T00:45:22.226 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:22.227 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-12T00:45:22.326 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:22.327 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-12T00:45:22.526 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:22.527 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-12T00:45:23.026 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:23.027 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-12T00:45:23.327 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:23.327 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-12T00:45:23.327 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:23.327 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-12T00:45:23.626 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:23.627 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-12T00:45:23.726 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:23.727 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-12T00:45:24.026 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:24.026 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-12T00:45:24.126 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:24.127 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-12T00:45:24.427 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:24.427 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-12T00:45:24.427 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:24.427 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-12T00:45:24.726 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:24.726 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-12T00:45:24.826 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:24.827 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-12T00:45:25.127 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:25.127 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-12T00:45:25.127 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:25.127 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-12T00:45:25.426 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:25.426 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-12T00:45:25.626 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:25.627 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-12T00:45:25.826 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:25.826 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-12T00:45:26.526 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:26.527 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-12T00:45:27.027 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:27.027 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-12T00:45:34.027 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:34.027 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-12T00:45:34.527 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:34.527 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-12T00:45:34.527 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:34.528 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-12T00:45:34.827 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:34.827 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-12T00:45:34.827 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:34.827 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-12T00:45:35.326 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:35.327 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-12T00:45:35.726 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:35.727 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-12T00:45:36.026 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:36.027 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-12T00:45:36.127 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:36.127 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-12T00:45:36.226 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:36.226 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-12T00:45:37.226 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:37.226 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-12T00:45:37.526 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:37.526 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T00:45:38.226 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:38.226 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T00:45:38.526 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:38.526 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-12T00:45:39.326 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:39.327 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-12T00:45:39.626 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:39.626 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-12T00:45:44.526 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:44.527 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-12T00:45:44.831 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:44.832 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-12T00:45:46.326 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:46.327 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-12T00:45:46.626 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:46.626 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-12T00:45:47.426 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:47.427 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-12T00:45:47.726 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:47.726 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-12T00:45:48.326 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:48.326 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-12T00:45:48.626 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:48.626 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-12T00:45:48.726 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:48.726 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-12T00:45:48.826 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:48.826 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-12T00:45:48.827 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:48.827 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-12T00:45:49.126 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:49.127 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-12T00:45:49.127 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:49.127 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-12T00:45:49.426 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:49.426 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-12T00:45:49.526 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:49.526 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-12T00:45:49.726 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:49.726 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-12T00:45:49.826 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:49.826 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-12T00:45:50.126 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:50.126 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-12T00:45:50.226 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:50.227 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-12T00:45:50.426 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:50.426 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-12T00:45:50.526 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:50.526 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-12T00:45:50.726 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:50.726 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-12T00:45:50.926 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:50.926 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-12T00:45:51.226 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:51.226 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-12T00:45:51.326 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:51.327 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-12T00:45:51.626 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:51.626 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-12T00:45:51.826 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:51.826 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-12T00:45:52.126 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:52.126 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-12T00:45:52.226 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:52.226 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-12T00:45:52.526 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:52.527 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-12T00:45:52.726 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:52.726 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-12T00:45:53.026 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:53.026 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-12T00:45:53.126 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:53.126 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-12T00:45:53.426 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:53.426 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-12T00:45:53.626 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:53.626 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-12T00:45:53.926 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:53.926 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-12T00:45:54.026 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:54.026 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-12T00:45:54.326 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:54.326 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-12T00:45:54.526 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:54.527 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-12T00:45:54.826 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:54.826 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-12T00:45:54.926 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:54.926 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-12T00:45:55.226 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:55.226 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-12T00:45:55.426 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:55.426 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-12T00:45:55.726 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:55.726 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-12T00:45:55.826 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:55.826 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-12T00:45:56.126 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:56.126 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-12T00:45:56.226 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:56.226 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-12T00:45:56.626 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:56.626 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-12T00:45:56.726 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:56.726 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-12T00:45:57.026 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:57.026 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-12T00:45:57.126 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:57.126 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-12T00:45:57.526 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:57.526 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-12T00:45:57.626 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:57.626 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-12T00:45:57.926 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:57.926 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-12T00:45:58.026 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:58.026 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-12T00:45:58.426 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:58.426 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-12T00:45:58.526 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:58.526 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-12T00:45:58.826 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:58.826 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-12T00:45:58.926 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:58.926 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-12T00:45:59.226 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:59.226 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-12T00:45:59.326 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:59.326 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-12T00:45:59.626 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:59.626 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-12T00:45:59.726 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:45:59.727 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-12T00:46:00.026 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:00.026 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-12T00:46:00.226 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:00.226 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-12T00:46:00.527 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:00.528 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-12T00:46:00.528 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:00.528 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-12T00:46:00.826 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:00.827 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-12T00:46:00.927 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:00.927 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-12T00:46:01.226 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:01.227 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-12T00:46:01.227 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:01.227 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-12T00:46:01.526 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:01.526 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-12T00:46:01.526 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:01.527 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-12T00:46:01.826 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:01.826 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-12T00:46:02.126 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:02.126 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-12T00:46:02.326 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:02.326 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-12T00:46:02.426 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:02.426 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-12T00:46:02.526 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:02.526 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-12T00:46:02.626 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:02.626 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-12T00:46:02.926 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:02.927 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-12T00:46:02.927 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:02.927 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-12T00:46:03.226 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:03.226 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-12T00:46:03.326 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:03.326 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-12T00:46:03.626 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:03.626 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-12T00:46:03.627 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:03.627 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-12T00:46:03.926 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:03.926 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-12T00:46:04.326 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:04.326 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-12T00:46:04.626 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:04.626 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-12T00:46:05.126 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:05.126 INFO:teuthology.orchestra.run.smithi043.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-12T00:46:05.422 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:05.422 INFO:teuthology.orchestra.run.smithi043.stdout:---------------------------------------------------------------------- 2024-09-12T00:46:05.422 INFO:teuthology.orchestra.run.smithi043.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-12T00:46:05.422 INFO:teuthology.orchestra.run.smithi043.stdout:---------------------------------------------------------------------- 2024-09-12T00:46:05.422 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:05.422 INFO:teuthology.orchestra.run.smithi043.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T00:46:05.422 INFO:teuthology.orchestra.run.smithi043.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T00:46:05.422 INFO:teuthology.orchestra.run.smithi043.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T00:46:05.423 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:05.423 INFO:teuthology.orchestra.run.smithi043.stdout:BUILD SUCCESSFUL in 51s 2024-09-12T00:46:05.423 INFO:teuthology.orchestra.run.smithi043.stdout:5 actionable tasks: 5 executed 2024-09-12T00:46:05.441 DEBUG:teuthology.orchestra.run.smithi043:> radosgw-admin gc process --include-all 2024-09-12T00:46:05.467 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:05.467 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:05.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.511+0000 7f3c0e5b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:05.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.511+0000 7f3c0e5b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:05.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.511+0000 7f3c0e5b59c0 20 realm 2024-09-12T00:46:05.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.511+0000 7f3c0e5b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:05.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.511+0000 7f3c0e5b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:05.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.511+0000 7f3c0e5b59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:05.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.511+0000 7f3c0e5b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:05.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.511+0000 7f3c0e5b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:05.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.511+0000 7f3c0e5b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:05.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.515+0000 7f3c0e5b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:05.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.515+0000 7f3c0e5b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:05.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.515+0000 7f3c0e5b59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:05.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.515+0000 7f3c0e5b59c0 20 searching for the correct realm 2024-09-12T00:46:05.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.523+0000 7f3c0c8bc640 0 -- 172.21.15.43:0/594729905 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55be2da877a0 msgr2=0x55be2da89c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:05.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.527+0000 7f3c0c0bb640 0 -- 172.21.15.43:0/594729905 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f3bf40cf930 msgr2=0x7f3bf40d8400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:05.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.535+0000 7f3c0e5b59c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:46:05.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.535+0000 7f3c0e5b59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:05.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.535+0000 7f3c0e5b59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:05.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.535+0000 7f3c0e5b59c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:46:05.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.535+0000 7f3c0e5b59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:05.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.535+0000 7f3c0e5b59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:05.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.535+0000 7f3c0e5b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:05.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.535+0000 7f3c0e5b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:05.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.535+0000 7f3c0e5b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:05.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.535+0000 7f3c0e5b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:05.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.535+0000 7f3c0e5b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:05.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.535+0000 7f3c0e5b59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:05.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.535+0000 7f3c0e5b59c0 20 zone default found 2024-09-12T00:46:05.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.535+0000 7f3c0e5b59c0 4 Realm: () 2024-09-12T00:46:05.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.535+0000 7f3c0e5b59c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:46:05.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.535+0000 7f3c0e5b59c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:46:05.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.535+0000 7f3c0e5b59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:05.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.535+0000 7f3c0e5b59c0 20 zonegroup default 2024-09-12T00:46:05.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.535+0000 7f3c0e5b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:05.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.535+0000 7f3c0e5b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:05.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.535+0000 7f3c0e5b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:05.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.539+0000 7f3c0e5b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:05.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.539+0000 7f3c0e5b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:05.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.539+0000 7f3c0e5b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:05.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.539+0000 7f3c0e5b59c0 20 started sync module instance, tier type = 2024-09-12T00:46:05.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.539+0000 7f3c0e5b59c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:46:05.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.555+0000 7f3c0e5b59c0 20 add_watcher() i=0 2024-09-12T00:46:05.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.555+0000 7f3c0e5b59c0 20 add_watcher() i=1 2024-09-12T00:46:05.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.555+0000 7f3c0e5b59c0 20 add_watcher() i=2 2024-09-12T00:46:05.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.555+0000 7f3c0e5b59c0 20 add_watcher() i=3 2024-09-12T00:46:05.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.555+0000 7f3c0e5b59c0 20 add_watcher() i=4 2024-09-12T00:46:05.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.555+0000 7f3c0e5b59c0 20 add_watcher() i=5 2024-09-12T00:46:05.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.555+0000 7f3c0e5b59c0 20 add_watcher() i=6 2024-09-12T00:46:05.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.555+0000 7f3c0e5b59c0 20 add_watcher() i=7 2024-09-12T00:46:05.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.555+0000 7f3c0e5b59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:05.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.555+0000 7f3ac27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:05.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.559+0000 7f3c0e5b59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:05.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.559+0000 7f3c0e5b59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:05.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.643+0000 7f3ac17e2640 20 reqs_thread_entry: start 2024-09-12T00:46:05.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.643+0000 7f3c0e5b59c0 20 init_complete bucket index max shards: 11 2024-09-12T00:46:05.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.643+0000 7f3c0e5b59c0 20 Filter name: none 2024-09-12T00:46:05.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.643+0000 7f3a32ffd640 20 reqs_thread_entry: start 2024-09-12T00:46:05.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.643+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:46:05.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.647+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:05.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.647+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:05.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.647+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T00:46:05.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.647+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.424768917345525023', time=2024-09-12T02:45:38.290370+0000, chain.objs.size()=9 2024-09-12T00:46:05.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.647+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.100__multipart_file2.mpg.2~IEQAHEeOJBsfgFO2bhfnVwFPtyM-Ovj.1 2024-09-12T00:46:05.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.647+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.100__shadow_file2.mpg.2~IEQAHEeOJBsfgFO2bhfnVwFPtyM-Ovj.1_1 2024-09-12T00:46:05.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.647+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.100__multipart_file2.mpg.2~IEQAHEeOJBsfgFO2bhfnVwFPtyM-Ovj.2 2024-09-12T00:46:05.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.647+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.100__shadow_file2.mpg.2~IEQAHEeOJBsfgFO2bhfnVwFPtyM-Ovj.2_1 2024-09-12T00:46:05.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.647+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.100__multipart_file2.mpg.2~IEQAHEeOJBsfgFO2bhfnVwFPtyM-Ovj.3 2024-09-12T00:46:05.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.647+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.100__shadow_file2.mpg.2~IEQAHEeOJBsfgFO2bhfnVwFPtyM-Ovj.3_1 2024-09-12T00:46:05.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.647+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.100__multipart_file2.mpg.2~IEQAHEeOJBsfgFO2bhfnVwFPtyM-Ovj.4 2024-09-12T00:46:05.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.647+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.100__shadow_file2.mpg.2~IEQAHEeOJBsfgFO2bhfnVwFPtyM-Ovj.4_1 2024-09-12T00:46:05.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.647+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.100__multipart_file2.mpg.2~IEQAHEeOJBsfgFO2bhfnVwFPtyM-Ovj.5 2024-09-12T00:46:05.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.647+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15174688279267430091', time=2024-09-12T02:45:50.942394+0000, chain.objs.size()=1 2024-09-12T00:46:05.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.647+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.112__shadow_.y3LN8r8CPgWKhg60GV2nzIDSJ0BUijx_0 2024-09-12T00:46:05.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.647+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5999322914957128207', time=2024-09-12T02:45:51.427367+0000, chain.objs.size()=1 2024-09-12T00:46:05.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.647+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.113__shadow_.X3xZOy7f6b2VJ3FtCgzTGpW-ruTY36B_0 2024-09-12T00:46:05.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.647+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7942797841253426267', time=2024-09-12T02:45:51.834686+0000, chain.objs.size()=1 2024-09-12T00:46:05.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.647+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.114__shadow_.WBSJaFFndCM1dbmZNINPuSakwPfHBFY_0 2024-09-12T00:46:05.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.651+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8969817697743873957', time=2024-09-12T02:45:56.352719+0000, chain.objs.size()=1 2024-09-12T00:46:05.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.651+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.124__shadow_.TK5NGlAuxRwgOzI9lICwzSTNUXaN-w6_0 2024-09-12T00:46:05.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.651+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12765997235261069475', time=2024-09-12T02:45:56.777121+0000, chain.objs.size()=1 2024-09-12T00:46:05.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.651+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.125__shadow_.yD3bVLaOyPyCajjOFtD0QvHCw36BiRF_0 2024-09-12T00:46:05.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.655+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9420212140991501811', time=2024-09-12T02:45:58.117934+0000, chain.objs.size()=1 2024-09-12T00:46:05.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.655+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.128__shadow_.zDoH_b7JanfhewnyBhQ9d5wAgfS9vKZ_0 2024-09-12T00:46:05.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.659+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:05.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.663+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:46:05.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.667+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:05.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.667+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:05.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.667+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:46:05.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.667+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='2~XuTH9e7tJCYgbsBR4d3A_RnBLm3PITQ', time=2024-09-12T02:45:39.465738+0000, chain.objs.size()=9 2024-09-12T00:46:05.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.667+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.101__multipart_key1.2~XuTH9e7tJCYgbsBR4d3A_RnBLm3PITQ.7 2024-09-12T00:46:05.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.667+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.101__shadow_key1.2~XuTH9e7tJCYgbsBR4d3A_RnBLm3PITQ.7_1 2024-09-12T00:46:05.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.667+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.101__multipart_key1.2~XuTH9e7tJCYgbsBR4d3A_RnBLm3PITQ.8 2024-09-12T00:46:05.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.667+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.101__shadow_key1.2~XuTH9e7tJCYgbsBR4d3A_RnBLm3PITQ.8_1 2024-09-12T00:46:05.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.667+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.101__multipart_key1.2~XuTH9e7tJCYgbsBR4d3A_RnBLm3PITQ.9 2024-09-12T00:46:05.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.667+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.101__shadow_key1.2~XuTH9e7tJCYgbsBR4d3A_RnBLm3PITQ.9_1 2024-09-12T00:46:05.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.667+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.101__multipart_key1.2~XuTH9e7tJCYgbsBR4d3A_RnBLm3PITQ.10 2024-09-12T00:46:05.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.667+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.101__shadow_key1.2~XuTH9e7tJCYgbsBR4d3A_RnBLm3PITQ.10_1 2024-09-12T00:46:05.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.667+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.101__multipart_key1.2~XuTH9e7tJCYgbsBR4d3A_RnBLm3PITQ.11 2024-09-12T00:46:05.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.667+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6410303779873287382', time=2024-09-12T02:45:43.324576+0000, chain.objs.size()=9 2024-09-12T00:46:05.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.667+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__multipart_key1.2~MjXooRGd4U-NC6Cv707jDuMUjLEC2ns.1 2024-09-12T00:46:05.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.667+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__shadow_key1.2~MjXooRGd4U-NC6Cv707jDuMUjLEC2ns.1_1 2024-09-12T00:46:05.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.667+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__multipart_key1.2~MjXooRGd4U-NC6Cv707jDuMUjLEC2ns.2 2024-09-12T00:46:05.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.675+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__shadow_key1.2~MjXooRGd4U-NC6Cv707jDuMUjLEC2ns.2_1 2024-09-12T00:46:05.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.675+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__multipart_key1.2~MjXooRGd4U-NC6Cv707jDuMUjLEC2ns.3 2024-09-12T00:46:05.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.675+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__shadow_key1.2~MjXooRGd4U-NC6Cv707jDuMUjLEC2ns.3_1 2024-09-12T00:46:05.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.675+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__multipart_key1.2~MjXooRGd4U-NC6Cv707jDuMUjLEC2ns.4 2024-09-12T00:46:05.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.675+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__shadow_key1.2~MjXooRGd4U-NC6Cv707jDuMUjLEC2ns.4_1 2024-09-12T00:46:05.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.675+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__multipart_key1.2~MjXooRGd4U-NC6Cv707jDuMUjLEC2ns.5 2024-09-12T00:46:05.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.675+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4059459637742883594', time=2024-09-12T02:45:51.875628+0000, chain.objs.size()=1 2024-09-12T00:46:05.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.675+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.114__shadow_.bS_YqZJd0xmC8HZPlavkwezFT_st8uW_0 2024-09-12T00:46:05.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.675+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18120132125668329015', time=2024-09-12T02:45:52.752992+0000, chain.objs.size()=1 2024-09-12T00:46:05.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.675+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.116__shadow_.rYoGToR-ZwyG6fiF4p5OZWEf2sVKbWT_0 2024-09-12T00:46:05.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.683+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:05.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.687+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:46:05.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.691+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:05.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.691+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:05.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.691+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:46:05.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.691+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14732399043900059380', time=2024-09-12T02:45:44.445818+0000, chain.objs.size()=7 2024-09-12T00:46:05.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.691+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__multipart_key1.2~AQqnKxI0b8yjvMQ3YH2_kNZ1B9UXMYr.1 2024-09-12T00:46:05.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.691+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__shadow_key1.2~AQqnKxI0b8yjvMQ3YH2_kNZ1B9UXMYr.1_1 2024-09-12T00:46:05.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.691+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__shadow_key1.2~AQqnKxI0b8yjvMQ3YH2_kNZ1B9UXMYr.1_2 2024-09-12T00:46:05.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.691+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__multipart_key1.2~AQqnKxI0b8yjvMQ3YH2_kNZ1B9UXMYr.2 2024-09-12T00:46:05.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.691+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__shadow_key1.2~AQqnKxI0b8yjvMQ3YH2_kNZ1B9UXMYr.2_1 2024-09-12T00:46:05.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.691+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__shadow_key1.2~AQqnKxI0b8yjvMQ3YH2_kNZ1B9UXMYr.2_2 2024-09-12T00:46:05.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.691+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__multipart_key1.2~AQqnKxI0b8yjvMQ3YH2_kNZ1B9UXMYr.3 2024-09-12T00:46:05.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.691+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11672025813713546191', time=2024-09-12T02:45:52.780945+0000, chain.objs.size()=1 2024-09-12T00:46:05.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.691+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.116__shadow_.AI0roGZFzOd561TX9ibgw6f8PoUTWoj_0 2024-09-12T00:46:05.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.691+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4694017687522295797', time=2024-09-12T02:45:54.145184+0000, chain.objs.size()=1 2024-09-12T00:46:05.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.691+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.119__shadow_.O5MfFWLIhgbwMFM4AaMMZit611j2mC9_0 2024-09-12T00:46:05.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.691+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12761805501209100796', time=2024-09-12T02:45:57.209560+0000, chain.objs.size()=1 2024-09-12T00:46:05.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.691+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.126__shadow_.FIo2W30DMPPHlnBiX0RuJFdIJyBw6hB_0 2024-09-12T00:46:05.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.699+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:05.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.703+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:46:05.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.707+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:05.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.711+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:05.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.711+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T00:46:05.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.711+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3571481999520078325', time=2024-09-12T02:45:26.749239+0000, chain.objs.size()=9 2024-09-12T00:46:05.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.711+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.91__multipart_key1.2~xX2ht5aRjbkegHFDV0g6W6FPqAqSFhH.1 2024-09-12T00:46:05.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.711+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.91__shadow_key1.2~xX2ht5aRjbkegHFDV0g6W6FPqAqSFhH.1_1 2024-09-12T00:46:05.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.711+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.91__multipart_key1.2~xX2ht5aRjbkegHFDV0g6W6FPqAqSFhH.2 2024-09-12T00:46:05.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.711+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.91__shadow_key1.2~xX2ht5aRjbkegHFDV0g6W6FPqAqSFhH.2_1 2024-09-12T00:46:05.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.711+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.91__multipart_key1.2~xX2ht5aRjbkegHFDV0g6W6FPqAqSFhH.3 2024-09-12T00:46:05.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.711+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.91__shadow_key1.2~xX2ht5aRjbkegHFDV0g6W6FPqAqSFhH.3_1 2024-09-12T00:46:05.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.711+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.91__multipart_key1.2~xX2ht5aRjbkegHFDV0g6W6FPqAqSFhH.4 2024-09-12T00:46:05.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.711+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.91__shadow_key1.2~xX2ht5aRjbkegHFDV0g6W6FPqAqSFhH.4_1 2024-09-12T00:46:05.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.711+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.91__multipart_key1.2~xX2ht5aRjbkegHFDV0g6W6FPqAqSFhH.5 2024-09-12T00:46:05.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.711+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17044404931660422225', time=2024-09-12T02:45:52.739998+0000, chain.objs.size()=1 2024-09-12T00:46:05.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.711+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.116__shadow_.c4-c2XFP9GjjaUQwlZu5dcnti9F2Vyx_0 2024-09-12T00:46:05.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.711+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2815119553709447021', time=2024-09-12T02:45:53.213601+0000, chain.objs.size()=1 2024-09-12T00:46:05.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.711+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.117__shadow_.OM6ceEocJ1jcdyl99-Lm0bHzcMfyxD7_0 2024-09-12T00:46:05.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.711+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16468241886002618747', time=2024-09-12T02:45:54.106896+0000, chain.objs.size()=1 2024-09-12T00:46:05.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.711+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.119__shadow_.Qh8JxxGZNaM1yJ7tMbp4nsyxk248vYw_0 2024-09-12T00:46:05.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.719+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11613607882877134851', time=2024-09-12T02:45:54.582602+0000, chain.objs.size()=1 2024-09-12T00:46:05.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.719+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.120__shadow_.gPHEfYVVSiSxHGs99pOEKpgYNSVCYob_0 2024-09-12T00:46:05.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.719+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16442679417156334162', time=2024-09-12T02:45:55.042850+0000, chain.objs.size()=1 2024-09-12T00:46:05.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.719+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.121__shadow_.bf9Lgc51TaRwjRoExpsgEYosILmIrUt_0 2024-09-12T00:46:05.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.719+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.771504847318237909', time=2024-09-12T02:45:55.489669+0000, chain.objs.size()=1 2024-09-12T00:46:05.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.719+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.122__shadow_.cZaPzc-7lEVbfCVa5IMvr9qTVGtzLgf_0 2024-09-12T00:46:05.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.719+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:05.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.727+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:46:05.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.727+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:05.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.727+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:05.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.731+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:46:05.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.731+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12015196650266526216', time=2024-09-12T02:45:57.241515+0000, chain.objs.size()=1 2024-09-12T00:46:05.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.731+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.126__shadow_.VuznrPozcmvPxR-9rgHg-ttO5K7ZmYQ_0 2024-09-12T00:46:05.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.731+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13317397277098780267', time=2024-09-12T02:45:58.596635+0000, chain.objs.size()=1 2024-09-12T00:46:05.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.731+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.129__shadow_.bINeIUpk0dtcj-hVCCrAcuezqlnUrE5_0 2024-09-12T00:46:05.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.731+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:05.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.735+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:46:05.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.739+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:05.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.743+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:05.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.743+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T00:46:05.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.743+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18431262873940713202', time=2024-09-12T02:45:21.903121+0000, chain.objs.size()=1 2024-09-12T00:46:05.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.743+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.81__shadow_.YxCkAtIClR-APOw2p2unaaqhQnXEo_O_0 2024-09-12T00:46:05.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.743+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.383436620374232217', time=2024-09-12T02:45:29.210787+0000, chain.objs.size()=9 2024-09-12T00:46:05.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.743+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__multipart_key1.2~nUf1a-4w8OUUVSKec7u_RcyCICD2WKi.1 2024-09-12T00:46:05.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.743+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__shadow_key1.2~nUf1a-4w8OUUVSKec7u_RcyCICD2WKi.1_1 2024-09-12T00:46:05.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.743+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__multipart_key1.2~nUf1a-4w8OUUVSKec7u_RcyCICD2WKi.2 2024-09-12T00:46:05.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.743+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__shadow_key1.2~nUf1a-4w8OUUVSKec7u_RcyCICD2WKi.2_1 2024-09-12T00:46:05.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.743+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__multipart_key1.2~nUf1a-4w8OUUVSKec7u_RcyCICD2WKi.3 2024-09-12T00:46:05.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.743+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__shadow_key1.2~nUf1a-4w8OUUVSKec7u_RcyCICD2WKi.3_1 2024-09-12T00:46:05.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.743+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__multipart_key1.2~nUf1a-4w8OUUVSKec7u_RcyCICD2WKi.4 2024-09-12T00:46:05.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.743+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__shadow_key1.2~nUf1a-4w8OUUVSKec7u_RcyCICD2WKi.4_1 2024-09-12T00:46:05.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.743+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__multipart_key1.2~nUf1a-4w8OUUVSKec7u_RcyCICD2WKi.5 2024-09-12T00:46:05.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.743+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16910203917463451307', time=2024-09-12T02:45:37.284399+0000, chain.objs.size()=9 2024-09-12T00:46:05.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.743+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.99__multipart_key1.2~bC8HOzw1VRUJZhwKtb4QxMhnMEkRPCB.1 2024-09-12T00:46:05.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.743+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.99__shadow_key1.2~bC8HOzw1VRUJZhwKtb4QxMhnMEkRPCB.1_1 2024-09-12T00:46:05.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.747+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.99__multipart_key1.2~bC8HOzw1VRUJZhwKtb4QxMhnMEkRPCB.2 2024-09-12T00:46:05.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.751+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.99__shadow_key1.2~bC8HOzw1VRUJZhwKtb4QxMhnMEkRPCB.2_1 2024-09-12T00:46:05.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.751+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.99__multipart_key1.2~bC8HOzw1VRUJZhwKtb4QxMhnMEkRPCB.3 2024-09-12T00:46:05.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.751+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.99__shadow_key1.2~bC8HOzw1VRUJZhwKtb4QxMhnMEkRPCB.3_1 2024-09-12T00:46:05.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.751+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.99__multipart_key1.2~bC8HOzw1VRUJZhwKtb4QxMhnMEkRPCB.4 2024-09-12T00:46:05.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.751+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.99__shadow_key1.2~bC8HOzw1VRUJZhwKtb4QxMhnMEkRPCB.4_1 2024-09-12T00:46:05.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.751+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.99__multipart_key1.2~bC8HOzw1VRUJZhwKtb4QxMhnMEkRPCB.5 2024-09-12T00:46:05.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.751+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5366504420002280408', time=2024-09-12T02:45:38.304209+0000, chain.objs.size()=1 2024-09-12T00:46:05.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.751+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.100__shadow_.GD_lENSM6Io4RJgfeZKUO3vHwC20Kio_0 2024-09-12T00:46:05.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.751+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17079625304902061501', time=2024-09-12T02:45:42.773351+0000, chain.objs.size()=9 2024-09-12T00:46:05.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.751+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__multipart_key1.2~_L-Yn3db2F5RUoi0-aT2JmlF9g4ze4J.1 2024-09-12T00:46:05.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.751+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__shadow_key1.2~_L-Yn3db2F5RUoi0-aT2JmlF9g4ze4J.1_1 2024-09-12T00:46:05.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.755+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__multipart_key1.2~_L-Yn3db2F5RUoi0-aT2JmlF9g4ze4J.2 2024-09-12T00:46:05.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.755+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__shadow_key1.2~_L-Yn3db2F5RUoi0-aT2JmlF9g4ze4J.2_1 2024-09-12T00:46:05.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.755+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__multipart_key1.2~_L-Yn3db2F5RUoi0-aT2JmlF9g4ze4J.3 2024-09-12T00:46:05.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.755+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__shadow_key1.2~_L-Yn3db2F5RUoi0-aT2JmlF9g4ze4J.3_1 2024-09-12T00:46:05.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.759+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__multipart_key1.2~_L-Yn3db2F5RUoi0-aT2JmlF9g4ze4J.4 2024-09-12T00:46:05.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.759+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__shadow_key1.2~_L-Yn3db2F5RUoi0-aT2JmlF9g4ze4J.4_1 2024-09-12T00:46:05.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.759+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__multipart_key1.2~_L-Yn3db2F5RUoi0-aT2JmlF9g4ze4J.5 2024-09-12T00:46:05.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.759+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1204582038039338495', time=2024-09-12T02:45:44.612201+0000, chain.objs.size()=7 2024-09-12T00:46:05.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.759+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__multipart_key1.2~Jll8mto-Y_hn4YhTwSY3GG5HsJLSNLo.1 2024-09-12T00:46:05.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.759+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__shadow_key1.2~Jll8mto-Y_hn4YhTwSY3GG5HsJLSNLo.1_1 2024-09-12T00:46:05.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.759+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__shadow_key1.2~Jll8mto-Y_hn4YhTwSY3GG5HsJLSNLo.1_2 2024-09-12T00:46:05.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.759+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__multipart_key1.2~Jll8mto-Y_hn4YhTwSY3GG5HsJLSNLo.2 2024-09-12T00:46:05.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.759+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__shadow_key1.2~Jll8mto-Y_hn4YhTwSY3GG5HsJLSNLo.2_1 2024-09-12T00:46:05.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.759+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__shadow_key1.2~Jll8mto-Y_hn4YhTwSY3GG5HsJLSNLo.2_2 2024-09-12T00:46:05.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.759+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__multipart_key1.2~Jll8mto-Y_hn4YhTwSY3GG5HsJLSNLo.3 2024-09-12T00:46:05.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.759+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13007312900569688007', time=2024-09-12T02:45:53.669451+0000, chain.objs.size()=1 2024-09-12T00:46:05.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.759+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.118__shadow_.xBIPeAD2RlS75UwplqF2NCJXeJ8S6Iw_0 2024-09-12T00:46:05.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.767+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14239132541561269591', time=2024-09-12T02:45:55.463261+0000, chain.objs.size()=1 2024-09-12T00:46:05.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.767+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.122__shadow_.IykFWMDXrA1JlmDuIqrWANsOX0e8R-m_0 2024-09-12T00:46:05.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.767+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11560987696454052723', time=2024-09-12T02:46:01.987776+0000, chain.objs.size()=1 2024-09-12T00:46:05.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.767+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.138__shadow_.VuyBHP4cr8CLlmpsaLl3vHta6lPpqau_0 2024-09-12T00:46:05.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.767+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:05.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.771+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:46:05.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.775+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:05.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.779+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:05.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.779+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:46:05.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.779+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.813602154818454682', time=2024-09-12T02:45:23.043194+0000, chain.objs.size()=3 2024-09-12T00:46:05.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.779+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.83__shadow_.7I12bqZzZb2RDzbsbzsX2NBPedQvKMh_0 2024-09-12T00:46:05.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.779+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.83__shadow_.7I12bqZzZb2RDzbsbzsX2NBPedQvKMh_1 2024-09-12T00:46:05.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.779+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.83__shadow_.7I12bqZzZb2RDzbsbzsX2NBPedQvKMh_2 2024-09-12T00:46:05.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.779+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10540488070101887906', time=2024-09-12T02:45:31.691016+0000, chain.objs.size()=9 2024-09-12T00:46:05.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.779+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__multipart_key1.2~0OSo7oDFYaSUFMBGRM5eHgaBAbh9ibh.1 2024-09-12T00:46:05.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.779+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__shadow_key1.2~0OSo7oDFYaSUFMBGRM5eHgaBAbh9ibh.1_1 2024-09-12T00:46:05.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.779+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__multipart_key1.2~0OSo7oDFYaSUFMBGRM5eHgaBAbh9ibh.2 2024-09-12T00:46:05.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.779+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__shadow_key1.2~0OSo7oDFYaSUFMBGRM5eHgaBAbh9ibh.2_1 2024-09-12T00:46:05.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.779+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__multipart_key1.2~0OSo7oDFYaSUFMBGRM5eHgaBAbh9ibh.3 2024-09-12T00:46:05.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.779+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__shadow_key1.2~0OSo7oDFYaSUFMBGRM5eHgaBAbh9ibh.3_1 2024-09-12T00:46:05.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.779+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__multipart_key1.2~0OSo7oDFYaSUFMBGRM5eHgaBAbh9ibh.4 2024-09-12T00:46:05.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.779+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__shadow_key1.2~0OSo7oDFYaSUFMBGRM5eHgaBAbh9ibh.4_1 2024-09-12T00:46:05.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.779+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__multipart_key1.2~0OSo7oDFYaSUFMBGRM5eHgaBAbh9ibh.5 2024-09-12T00:46:05.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.783+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13636567446722510782', time=2024-09-12T02:45:53.198418+0000, chain.objs.size()=1 2024-09-12T00:46:05.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.783+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.117__shadow_.JU3Hr-8PZWA8_z3L0tsJhhV_FjeZk3A_0 2024-09-12T00:46:05.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.783+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1339186425836415021', time=2024-09-12T02:45:58.158198+0000, chain.objs.size()=1 2024-09-12T00:46:05.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.783+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.128__shadow_.QFULZ2TJ5WlejFRUO18S7dWrRNi9-M2_0 2024-09-12T00:46:05.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.787+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:05.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.791+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:46:05.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.795+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:05.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.795+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:05.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.795+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:46:05.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.795+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.756183453795357401', time=2024-09-12T02:45:23.799594+0000, chain.objs.size()=1 2024-09-12T00:46:05.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.795+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.85__shadow_._Kaev4rwx3IT5yq3OeNAzFNaG5NXw_4_0 2024-09-12T00:46:05.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.795+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1838257136564914358', time=2024-09-12T02:45:53.654778+0000, chain.objs.size()=1 2024-09-12T00:46:05.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.795+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.118__shadow_.hIdvBDdGyKAq-_ElQL9LmvKdmUmNbDI_0 2024-09-12T00:46:05.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.795+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12805356099575963007', time=2024-09-12T02:45:55.015353+0000, chain.objs.size()=1 2024-09-12T00:46:05.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.795+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.121__shadow_.nmtdk6ZHH5NgaJkLj38v5SinnaE7VMU_0 2024-09-12T00:46:05.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.795+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12736857202459904652', time=2024-09-12T02:46:02.643145+0000, chain.objs.size()=1 2024-09-12T00:46:05.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.795+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.139__shadow_.M8gRL8OJMPJpOMEsFIigZcs_i6PXdna_0 2024-09-12T00:46:05.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.799+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:05.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.803+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:46:05.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.807+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:05.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.807+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:05.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.807+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:46:05.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.807+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='2~kjslUD3csYmSBUPn7T2l84oU5iSogrv', time=2024-09-12T02:45:20.987297+0000, chain.objs.size()=9 2024-09-12T00:46:05.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.807+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.79__multipart_key1.2~kjslUD3csYmSBUPn7T2l84oU5iSogrv.1 2024-09-12T00:46:05.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.807+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.79__shadow_key1.2~kjslUD3csYmSBUPn7T2l84oU5iSogrv.1_1 2024-09-12T00:46:05.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.807+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.79__multipart_key1.2~kjslUD3csYmSBUPn7T2l84oU5iSogrv.2 2024-09-12T00:46:05.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.807+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.79__shadow_key1.2~kjslUD3csYmSBUPn7T2l84oU5iSogrv.2_1 2024-09-12T00:46:05.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.807+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.79__multipart_key1.2~kjslUD3csYmSBUPn7T2l84oU5iSogrv.3 2024-09-12T00:46:05.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.807+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.79__shadow_key1.2~kjslUD3csYmSBUPn7T2l84oU5iSogrv.3_1 2024-09-12T00:46:05.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.807+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.79__multipart_key1.2~kjslUD3csYmSBUPn7T2l84oU5iSogrv.4 2024-09-12T00:46:05.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.807+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.79__shadow_key1.2~kjslUD3csYmSBUPn7T2l84oU5iSogrv.4_1 2024-09-12T00:46:05.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.807+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.79__multipart_key1.2~kjslUD3csYmSBUPn7T2l84oU5iSogrv.5 2024-09-12T00:46:05.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.807+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8167516152022408522', time=2024-09-12T02:45:51.863748+0000, chain.objs.size()=1 2024-09-12T00:46:05.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.807+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.114__shadow_.y2JeOohmEznPSqe2q0nMD0MOOxmsnGX_0 2024-09-12T00:46:05.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.807+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8265710837876898088', time=2024-09-12T02:45:52.327508+0000, chain.objs.size()=1 2024-09-12T00:46:05.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.807+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.115__shadow_.iY5a2k-bxeDiPROBeSrwOZxII1bKwpW_0 2024-09-12T00:46:05.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.815+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:05.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.819+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:46:05.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.823+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:05.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.823+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:05.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.827+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:05.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.827+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:46:05.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.831+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:05.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.831+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:05.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.831+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:46:05.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.831+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3578533697365504156', time=2024-09-12T02:45:50.956277+0000, chain.objs.size()=1 2024-09-12T00:46:05.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.831+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.112__shadow_.kC1GSOkgqY8U-dZEwyEnuQsfPnYE-0A_0 2024-09-12T00:46:05.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.831+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1197148789493376830', time=2024-09-12T02:45:52.286726+0000, chain.objs.size()=1 2024-09-12T00:46:05.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.831+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.115__shadow_.-iMPnXd1wwjuV4cEI7lDVTow_aIGK0V_0 2024-09-12T00:46:05.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.831+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.824327407741526204', time=2024-09-12T02:45:58.131079+0000, chain.objs.size()=1 2024-09-12T00:46:05.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.831+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.128__shadow_.Zpsep0rOb0fXAL2_gEGxdYPMbnBwR9f_0 2024-09-12T00:46:05.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.831+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16611647250351753497', time=2024-09-12T02:46:01.638951+0000, chain.objs.size()=1 2024-09-12T00:46:05.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.831+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.137__shadow_._gg-Iqtbu1iOfoq8420xfeLZS47_bt7_0 2024-09-12T00:46:05.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.835+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:05.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.839+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:46:05.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.839+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:05.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.843+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:05.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.843+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:46:05.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.843+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3851877167252110560', time=2024-09-12T02:45:41.091805+0000, chain.objs.size()=9 2024-09-12T00:46:05.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.843+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__multipart_key1.2~X_N5Ffn2fOEJG0JcIUhVIfzE_bJyzs1.1 2024-09-12T00:46:05.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.843+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__shadow_key1.2~X_N5Ffn2fOEJG0JcIUhVIfzE_bJyzs1.1_1 2024-09-12T00:46:05.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.843+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__multipart_key1.2~X_N5Ffn2fOEJG0JcIUhVIfzE_bJyzs1.2 2024-09-12T00:46:05.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.843+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__shadow_key1.2~X_N5Ffn2fOEJG0JcIUhVIfzE_bJyzs1.2_1 2024-09-12T00:46:05.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.843+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__multipart_key1.2~X_N5Ffn2fOEJG0JcIUhVIfzE_bJyzs1.3 2024-09-12T00:46:05.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.843+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__shadow_key1.2~X_N5Ffn2fOEJG0JcIUhVIfzE_bJyzs1.3_1 2024-09-12T00:46:05.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.843+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__multipart_key1.2~X_N5Ffn2fOEJG0JcIUhVIfzE_bJyzs1.4 2024-09-12T00:46:05.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.843+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__shadow_key1.2~X_N5Ffn2fOEJG0JcIUhVIfzE_bJyzs1.4_1 2024-09-12T00:46:05.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.843+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__multipart_key1.2~X_N5Ffn2fOEJG0JcIUhVIfzE_bJyzs1.5 2024-09-12T00:46:05.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.843+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3927241986244406622', time=2024-09-12T02:45:56.325800+0000, chain.objs.size()=1 2024-09-12T00:46:05.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.843+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.124__shadow_.O17q3AOCC41ZSMKXQby6DgO5PqKqi09_0 2024-09-12T00:46:05.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.843+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11788919690111140278', time=2024-09-12T02:45:59.412587+0000, chain.objs.size()=1 2024-09-12T00:46:05.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.843+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.131__shadow_.OpSPhHVciU7tOJdqlO2VpxlZgxxt19g_0 2024-09-12T00:46:05.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.843+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1338459335870490128', time=2024-09-12T02:46:01.301688+0000, chain.objs.size()=1 2024-09-12T00:46:05.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.843+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.136__shadow_.-TZ1rJBXz3w48FzHi4dUCSv_GU47_GJ_0 2024-09-12T00:46:05.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.851+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:05.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.855+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:46:05.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.859+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:05.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.859+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:05.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.863+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:46:05.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.863+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10090812367338440488', time=2024-09-12T02:45:50.968156+0000, chain.objs.size()=1 2024-09-12T00:46:05.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.863+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.112__shadow_.p_rb86buyoq0BjW8M9O8IlG-882_M1n_0 2024-09-12T00:46:05.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.863+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3640106581247648958', time=2024-09-12T02:46:05.173118+0000, chain.objs.size()=1 2024-09-12T00:46:05.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.863+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.144__shadow_.CpH8tdt0TlqSdEoQQUfnZ03h2ofQhzY_0 2024-09-12T00:46:05.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.863+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:05.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.871+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:46:05.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.871+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:05.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.871+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:05.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.875+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T00:46:05.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.875+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12691071431933914268', time=2024-09-12T02:45:25.450446+0000, chain.objs.size()=1 2024-09-12T00:46:05.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.875+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.90__shadow_.BVpiY0bITEYh1e9ZYAjmSm_VmQsd_dn_0 2024-09-12T00:46:05.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.875+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.873968139150928548', time=2024-09-12T02:45:38.275250+0000, chain.objs.size()=1 2024-09-12T00:46:05.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.875+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.100__shadow_.uuzrOdpkm4nGllTe0DUHBe411gdndHx_0 2024-09-12T00:46:05.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.875+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10374620293398088382', time=2024-09-12T02:45:52.300259+0000, chain.objs.size()=1 2024-09-12T00:46:05.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.875+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.115__shadow_.HjXDGoi3MLZ__5v2kr2XInmvmfPk3wH_0 2024-09-12T00:46:05.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.875+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7052210531105793027', time=2024-09-12T02:45:52.313255+0000, chain.objs.size()=1 2024-09-12T00:46:05.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.875+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.115__shadow_.65DgcQZC47VqzUC8F1Uhyyk0h77mD_l_0 2024-09-12T00:46:05.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.875+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18239426843147514766', time=2024-09-12T02:45:53.681661+0000, chain.objs.size()=1 2024-09-12T00:46:05.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.875+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.118__shadow_.Do4td6Z5brEOHCl3uRakSE11-ximvCv_0 2024-09-12T00:46:05.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.875+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.786133882400036699', time=2024-09-12T02:45:55.476052+0000, chain.objs.size()=1 2024-09-12T00:46:05.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.875+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.122__shadow_.cfEDImPwqAU0xHLymjN-GRfRWiMBQEC_0 2024-09-12T00:46:05.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.875+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7153002655265845048', time=2024-09-12T02:45:58.570716+0000, chain.objs.size()=1 2024-09-12T00:46:05.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.875+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.129__shadow_.VJktqmCFB-t9cFXKhF3k9jO7zMsYPv8_0 2024-09-12T00:46:05.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.875+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13821105165013244967', time=2024-09-12T02:45:59.805741+0000, chain.objs.size()=1 2024-09-12T00:46:05.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.875+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.132__shadow_.XHTfIzyXZq7eBC4Ling5Ng6-OZGg4v-_0 2024-09-12T00:46:05.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.875+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10742829849206838116', time=2024-09-12T02:46:00.243749+0000, chain.objs.size()=1 2024-09-12T00:46:05.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.875+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.133__shadow_.mK2YcqePrqeo92dVUrr2zEPywyqNGGh_0 2024-09-12T00:46:05.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.879+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:05.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.883+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:46:05.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.887+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:05.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.887+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:05.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.887+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:46:05.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.887+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11244806806658557661', time=2024-09-12T02:45:59.015921+0000, chain.objs.size()=1 2024-09-12T00:46:05.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.887+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.130__shadow_.Kw_ezSdH910-9mfiDyCowjt0HAFGAAO_0 2024-09-12T00:46:05.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.891+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:05.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.895+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:46:05.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.899+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:05.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.899+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:05.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.899+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:46:05.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.899+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13705941435240713884', time=2024-09-12T02:45:53.241144+0000, chain.objs.size()=1 2024-09-12T00:46:05.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.899+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.117__shadow_.GCxUaXaC5_eUaxINrTfIORl5YXpnPAF_0 2024-09-12T00:46:05.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.899+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17726634807123758809', time=2024-09-12T02:45:54.554685+0000, chain.objs.size()=1 2024-09-12T00:46:05.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.899+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.120__shadow_.Z5lp-9dAbZjG2Ws8yG1Y2jNsgMPJSts_0 2024-09-12T00:46:05.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.899+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11672093479305336574', time=2024-09-12T02:45:58.989187+0000, chain.objs.size()=1 2024-09-12T00:46:05.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.899+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.130__shadow_.hpEiNQCUqsn6gXJfEJ_e57MMCTKD76q_0 2024-09-12T00:46:05.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.903+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:05.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.907+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:46:05.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.911+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:05.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.915+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:05.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.915+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T00:46:05.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.915+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11061158134227928623', time=2024-09-12T02:45:23.433644+0000, chain.objs.size()=1 2024-09-12T00:46:05.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.915+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.84__shadow_.K365nPiNlfADdPzlM7e3hpnJdPzFg_u_0 2024-09-12T00:46:05.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.915+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4051647308121940657', time=2024-09-12T02:45:33.906613+0000, chain.objs.size()=7 2024-09-12T00:46:05.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.915+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__multipart_key1.2~Z9uTlgMUAaH3G5QiydH8hrb5SJtdbni.1 2024-09-12T00:46:05.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.915+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__shadow_key1.2~Z9uTlgMUAaH3G5QiydH8hrb5SJtdbni.1_1 2024-09-12T00:46:05.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.915+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__shadow_key1.2~Z9uTlgMUAaH3G5QiydH8hrb5SJtdbni.1_2 2024-09-12T00:46:05.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.915+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__multipart_key1.2~Z9uTlgMUAaH3G5QiydH8hrb5SJtdbni.2 2024-09-12T00:46:05.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.915+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__shadow_key1.2~Z9uTlgMUAaH3G5QiydH8hrb5SJtdbni.2_1 2024-09-12T00:46:05.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.915+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__shadow_key1.2~Z9uTlgMUAaH3G5QiydH8hrb5SJtdbni.2_2 2024-09-12T00:46:05.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.915+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__multipart_key1.2~Z9uTlgMUAaH3G5QiydH8hrb5SJtdbni.3 2024-09-12T00:46:05.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.915+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10797641918474916843', time=2024-09-12T02:45:34.256505+0000, chain.objs.size()=6 2024-09-12T00:46:05.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.915+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.93__shadow_.CgLtM-gXiNGBPCRkm142NUoLUs7gvui_0 2024-09-12T00:46:05.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.915+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.93__shadow_.CgLtM-gXiNGBPCRkm142NUoLUs7gvui_1 2024-09-12T00:46:05.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.915+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.93__shadow_.CgLtM-gXiNGBPCRkm142NUoLUs7gvui_2 2024-09-12T00:46:05.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.915+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.93__shadow_.CgLtM-gXiNGBPCRkm142NUoLUs7gvui_3 2024-09-12T00:46:05.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.919+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.93__shadow_.CgLtM-gXiNGBPCRkm142NUoLUs7gvui_4 2024-09-12T00:46:05.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.927+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.93__shadow_.CgLtM-gXiNGBPCRkm142NUoLUs7gvui_5 2024-09-12T00:46:05.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.927+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5345888112854656085', time=2024-09-12T02:45:38.317486+0000, chain.objs.size()=1 2024-09-12T00:46:05.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.927+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.100__shadow_.2AA7oE0engQQGb_FumTlPm5ZWdPf7s9_0 2024-09-12T00:46:05.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.927+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6249207626768830545', time=2024-09-12T02:45:54.132416+0000, chain.objs.size()=1 2024-09-12T00:46:05.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.927+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.119__shadow_.N2Lnwm3OT31AzsehVJsVsEwTcpLFtlT_0 2024-09-12T00:46:05.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.927+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1708632901103668178', time=2024-09-12T02:45:54.568719+0000, chain.objs.size()=1 2024-09-12T00:46:05.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.927+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.120__shadow_.0R-SnN5d-mVryI4dDGgrtk1Zyciougs_0 2024-09-12T00:46:05.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.927+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6687554547376862615', time=2024-09-12T02:45:58.584821+0000, chain.objs.size()=1 2024-09-12T00:46:05.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.927+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.129__shadow_.j3HlN4IMTjPE-UyovO3g4ztl1ViYsNJ_0 2024-09-12T00:46:05.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.931+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:05.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.935+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:46:05.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.939+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:05.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.939+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:05.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.943+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:46:05.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.943+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6557818545254523244', time=2024-09-12T02:45:43.943108+0000, chain.objs.size()=7 2024-09-12T00:46:05.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.943+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__multipart_key1.2~vhQ3xaloGSck1eclzHJyzQugLnzU9p_.1 2024-09-12T00:46:05.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.943+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__shadow_key1.2~vhQ3xaloGSck1eclzHJyzQugLnzU9p_.1_1 2024-09-12T00:46:05.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.943+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__shadow_key1.2~vhQ3xaloGSck1eclzHJyzQugLnzU9p_.1_2 2024-09-12T00:46:05.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.943+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__multipart_key1.2~vhQ3xaloGSck1eclzHJyzQugLnzU9p_.2 2024-09-12T00:46:05.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.943+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__shadow_key1.2~vhQ3xaloGSck1eclzHJyzQugLnzU9p_.2_1 2024-09-12T00:46:05.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.943+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__shadow_key1.2~vhQ3xaloGSck1eclzHJyzQugLnzU9p_.2_2 2024-09-12T00:46:05.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.943+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.102__multipart_key1.2~vhQ3xaloGSck1eclzHJyzQugLnzU9p_.3 2024-09-12T00:46:05.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.943+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14076887260964345230', time=2024-09-12T02:45:55.029921+0000, chain.objs.size()=1 2024-09-12T00:46:05.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.943+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.121__shadow_.hic2Ab9hwxprVy52OwWTR9hh95XrNEh_0 2024-09-12T00:46:05.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.943+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.948536675712687251', time=2024-09-12T02:45:56.805554+0000, chain.objs.size()=1 2024-09-12T00:46:05.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.943+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.125__shadow_._JAfcQs1bT78uFraWXD-1to5a45dgAa_0 2024-09-12T00:46:05.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.943+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13261924565823810179', time=2024-09-12T02:45:57.711798+0000, chain.objs.size()=1 2024-09-12T00:46:05.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.943+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.127__shadow_.dJhB1VrgL6BMyv6G35iTqLmBXCvluPO_0 2024-09-12T00:46:05.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.947+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:05.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.951+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:46:05.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.955+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:05.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.959+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:05.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.959+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:46:05.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.959+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2163552709778625078', time=2024-09-12T02:45:51.849147+0000, chain.objs.size()=1 2024-09-12T00:46:05.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.959+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.114__shadow_.7BIzl6QUKBJQJ6Vsv50IIRcHkispINH_0 2024-09-12T00:46:05.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.959+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:05.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.967+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:46:05.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.967+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:05.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.967+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:05.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.971+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:46:05.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.971+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13141538806444409648', time=2024-09-12T02:45:34.071075+0000, chain.objs.size()=7 2024-09-12T00:46:05.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.971+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__multipart_key1.2~ZUcV-AbloSJNMB1sRNXBJgNfjXeZeMy.1 2024-09-12T00:46:05.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.971+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__shadow_key1.2~ZUcV-AbloSJNMB1sRNXBJgNfjXeZeMy.1_1 2024-09-12T00:46:05.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.971+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__shadow_key1.2~ZUcV-AbloSJNMB1sRNXBJgNfjXeZeMy.1_2 2024-09-12T00:46:05.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.971+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__multipart_key1.2~ZUcV-AbloSJNMB1sRNXBJgNfjXeZeMy.2 2024-09-12T00:46:05.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.971+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__shadow_key1.2~ZUcV-AbloSJNMB1sRNXBJgNfjXeZeMy.2_1 2024-09-12T00:46:05.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.971+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__shadow_key1.2~ZUcV-AbloSJNMB1sRNXBJgNfjXeZeMy.2_2 2024-09-12T00:46:05.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.971+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__multipart_key1.2~ZUcV-AbloSJNMB1sRNXBJgNfjXeZeMy.3 2024-09-12T00:46:05.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.971+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13744111945819848588', time=2024-09-12T02:45:51.413269+0000, chain.objs.size()=1 2024-09-12T00:46:05.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.971+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.113__shadow_.ftn3l2yrVRVQBi0cbIWQY1CV6nHeZAG_0 2024-09-12T00:46:05.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.971+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5595085770551395615', time=2024-09-12T02:46:00.257449+0000, chain.objs.size()=1 2024-09-12T00:46:05.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.971+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.133__shadow_.v5xkNacLO1LjUTh7HK9lDZBBiJJAOmL_0 2024-09-12T00:46:05.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.975+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:05.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.979+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:46:05.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.983+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:05.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.983+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:05.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.987+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:46:05.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.987+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9562552177610846003', time=2024-09-12T02:45:53.228293+0000, chain.objs.size()=1 2024-09-12T00:46:05.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.987+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.117__shadow_.C4iKEOClSJTsQD8uTKtpn0lfJhUJZXb_0 2024-09-12T00:46:05.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.987+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12639156033684552628', time=2024-09-12T02:46:03.014200+0000, chain.objs.size()=1 2024-09-12T00:46:05.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.987+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.140__shadow_.q4vkLfRuEaNB1sppPExWUNZjiqftLFz_0 2024-09-12T00:46:05.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.987+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1707482448603404347', time=2024-09-12T02:46:05.159671+0000, chain.objs.size()=9 2024-09-12T00:46:05.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.987+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.144__multipart_key1/data/file.mpg.2~qA65gnOy2o0QszwZan0nuyzxFj-S56i.1 2024-09-12T00:46:05.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.987+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.144__shadow_key1/data/file.mpg.2~qA65gnOy2o0QszwZan0nuyzxFj-S56i.1_1 2024-09-12T00:46:05.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.987+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.144__multipart_key1/data/file.mpg.2~qA65gnOy2o0QszwZan0nuyzxFj-S56i.2 2024-09-12T00:46:05.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.987+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.144__shadow_key1/data/file.mpg.2~qA65gnOy2o0QszwZan0nuyzxFj-S56i.2_1 2024-09-12T00:46:05.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.987+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.144__multipart_key1/data/file.mpg.2~qA65gnOy2o0QszwZan0nuyzxFj-S56i.3 2024-09-12T00:46:05.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.987+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.144__shadow_key1/data/file.mpg.2~qA65gnOy2o0QszwZan0nuyzxFj-S56i.3_1 2024-09-12T00:46:05.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.987+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.144__multipart_key1/data/file.mpg.2~qA65gnOy2o0QszwZan0nuyzxFj-S56i.4 2024-09-12T00:46:05.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.987+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.144__shadow_key1/data/file.mpg.2~qA65gnOy2o0QszwZan0nuyzxFj-S56i.4_1 2024-09-12T00:46:05.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.987+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.144__multipart_key1/data/file.mpg.2~qA65gnOy2o0QszwZan0nuyzxFj-S56i.5 2024-09-12T00:46:05.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.995+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:05.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:05.999+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:46:06.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.003+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.003+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.003+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:46:06.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.003+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17440938880270732887', time=2024-09-12T02:45:32.378589+0000, chain.objs.size()=7 2024-09-12T00:46:06.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.003+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__multipart_key1.2~QB84LufSOmhL_dzgri5RHLYGx9SV9hq.1 2024-09-12T00:46:06.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.003+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__shadow_key1.2~QB84LufSOmhL_dzgri5RHLYGx9SV9hq.1_1 2024-09-12T00:46:06.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.003+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__shadow_key1.2~QB84LufSOmhL_dzgri5RHLYGx9SV9hq.1_2 2024-09-12T00:46:06.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.003+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__multipart_key1.2~QB84LufSOmhL_dzgri5RHLYGx9SV9hq.2 2024-09-12T00:46:06.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.003+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__shadow_key1.2~QB84LufSOmhL_dzgri5RHLYGx9SV9hq.2_1 2024-09-12T00:46:06.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.003+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__shadow_key1.2~QB84LufSOmhL_dzgri5RHLYGx9SV9hq.2_2 2024-09-12T00:46:06.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.003+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__multipart_key1.2~QB84LufSOmhL_dzgri5RHLYGx9SV9hq.3 2024-09-12T00:46:06.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.003+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10006689755880712385', time=2024-09-12T02:45:58.144400+0000, chain.objs.size()=1 2024-09-12T00:46:06.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.003+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.128__shadow_.x8klRz_CnfAWwSmHBZ4-Pan3H_y4xDi_0 2024-09-12T00:46:06.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.011+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:06.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.019+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:46:06.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.019+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.023+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.023+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:46:06.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.023+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14611933281538782787', time=2024-09-12T02:45:52.766926+0000, chain.objs.size()=1 2024-09-12T00:46:06.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.023+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.116__shadow_.X7gj5UE4orE4UPq4kEFWF8IoJIHLg4K_0 2024-09-12T00:46:06.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.023+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8456444567425006665', time=2024-09-12T02:45:57.226510+0000, chain.objs.size()=1 2024-09-12T00:46:06.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.023+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.126__shadow_.TbkKlpRanj9-QmBlvspVu8bkH2EhSKd_0 2024-09-12T00:46:06.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.023+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12028527856334473144', time=2024-09-12T02:45:57.254252+0000, chain.objs.size()=1 2024-09-12T00:46:06.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.023+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.126__shadow_.J-zUSN0j4GKQvmx3_gojigManIUEjSh_0 2024-09-12T00:46:06.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.023+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7276319252396169896', time=2024-09-12T02:45:59.819197+0000, chain.objs.size()=1 2024-09-12T00:46:06.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.023+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.132__shadow_.6X6FvfnJAm8dtHVj2cgobisZLUGdRS0_0 2024-09-12T00:46:06.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.027+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:06.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.031+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:46:06.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.035+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.035+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.035+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:46:06.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.035+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A', time=2024-09-12T02:45:48.492586+0000, chain.objs.size()=80 2024-09-12T00:46:06.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.035+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.1 2024-09-12T00:46:06.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.035+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.2 2024-09-12T00:46:06.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.035+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.3 2024-09-12T00:46:06.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.035+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.4 2024-09-12T00:46:06.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.035+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.5 2024-09-12T00:46:06.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.035+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.6 2024-09-12T00:46:06.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.035+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.7 2024-09-12T00:46:06.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.035+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.8 2024-09-12T00:46:06.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.035+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.9 2024-09-12T00:46:06.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.035+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.10 2024-09-12T00:46:06.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.035+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.11 2024-09-12T00:46:06.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.035+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.12 2024-09-12T00:46:06.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.043+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.13 2024-09-12T00:46:06.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.043+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.14 2024-09-12T00:46:06.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.043+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.15 2024-09-12T00:46:06.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.043+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.16 2024-09-12T00:46:06.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.043+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.17 2024-09-12T00:46:06.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.043+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.18 2024-09-12T00:46:06.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.043+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.19 2024-09-12T00:46:06.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.043+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.20 2024-09-12T00:46:06.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.043+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.21 2024-09-12T00:46:06.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.043+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.22 2024-09-12T00:46:06.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.043+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.23 2024-09-12T00:46:06.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.047+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.24 2024-09-12T00:46:06.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.047+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.25 2024-09-12T00:46:06.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.047+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.26 2024-09-12T00:46:06.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.047+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.27 2024-09-12T00:46:06.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.047+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.28 2024-09-12T00:46:06.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.047+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.29 2024-09-12T00:46:06.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.047+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.30 2024-09-12T00:46:06.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.047+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.31 2024-09-12T00:46:06.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.051+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.32 2024-09-12T00:46:06.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.051+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.33 2024-09-12T00:46:06.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.051+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.34 2024-09-12T00:46:06.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.051+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.35 2024-09-12T00:46:06.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.051+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.36 2024-09-12T00:46:06.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.051+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.37 2024-09-12T00:46:06.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.051+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.38 2024-09-12T00:46:06.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.055+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.39 2024-09-12T00:46:06.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.055+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.40 2024-09-12T00:46:06.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.055+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.41 2024-09-12T00:46:06.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.055+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.42 2024-09-12T00:46:06.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.055+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.43 2024-09-12T00:46:06.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.055+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.44 2024-09-12T00:46:06.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.055+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.45 2024-09-12T00:46:06.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.055+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.46 2024-09-12T00:46:06.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.059+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.47 2024-09-12T00:46:06.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.059+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.48 2024-09-12T00:46:06.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.059+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.49 2024-09-12T00:46:06.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.059+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.50 2024-09-12T00:46:06.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.059+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.51 2024-09-12T00:46:06.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.059+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.52 2024-09-12T00:46:06.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.059+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.53 2024-09-12T00:46:06.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.059+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.54 2024-09-12T00:46:06.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.059+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.55 2024-09-12T00:46:06.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.063+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.56 2024-09-12T00:46:06.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.063+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.57 2024-09-12T00:46:06.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.063+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.58 2024-09-12T00:46:06.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.063+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.59 2024-09-12T00:46:06.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.063+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.60 2024-09-12T00:46:06.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.063+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.61 2024-09-12T00:46:06.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.063+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.62 2024-09-12T00:46:06.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.063+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.63 2024-09-12T00:46:06.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.063+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.64 2024-09-12T00:46:06.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.063+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.65 2024-09-12T00:46:06.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.063+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.66 2024-09-12T00:46:06.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.067+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.67 2024-09-12T00:46:06.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.067+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.68 2024-09-12T00:46:06.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.071+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.69 2024-09-12T00:46:06.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.071+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.70 2024-09-12T00:46:06.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.071+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.71 2024-09-12T00:46:06.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.071+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.72 2024-09-12T00:46:06.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.071+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.73 2024-09-12T00:46:06.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.071+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.74 2024-09-12T00:46:06.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.071+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.75 2024-09-12T00:46:06.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.071+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.76 2024-09-12T00:46:06.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.071+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.77 2024-09-12T00:46:06.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.071+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.78 2024-09-12T00:46:06.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.075+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.79 2024-09-12T00:46:06.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.075+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.105__multipart_key1.2~FaOrs5583vVW8mWnbXJeMgMRzCs8j6A.80 2024-09-12T00:46:06.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.075+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:06.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.079+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:46:06.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.083+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.087+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.087+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T00:46:06.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.087+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17887132692371981670', time=2024-09-12T02:45:46.358670+0000, chain.objs.size()=9 2024-09-12T00:46:06.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.087+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.103__multipart_key1.2~gAjhU3vFch-KXCrUjOc4ip2N4GV9n3T.1 2024-09-12T00:46:06.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.087+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.103__shadow_key1.2~gAjhU3vFch-KXCrUjOc4ip2N4GV9n3T.1_1 2024-09-12T00:46:06.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.087+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.103__multipart_key1.2~gAjhU3vFch-KXCrUjOc4ip2N4GV9n3T.2 2024-09-12T00:46:06.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.087+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.103__shadow_key1.2~gAjhU3vFch-KXCrUjOc4ip2N4GV9n3T.2_1 2024-09-12T00:46:06.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.087+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.103__multipart_key1.2~gAjhU3vFch-KXCrUjOc4ip2N4GV9n3T.3 2024-09-12T00:46:06.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.087+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.103__shadow_key1.2~gAjhU3vFch-KXCrUjOc4ip2N4GV9n3T.3_1 2024-09-12T00:46:06.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.087+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.103__multipart_key1.2~gAjhU3vFch-KXCrUjOc4ip2N4GV9n3T.4 2024-09-12T00:46:06.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.087+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.103__shadow_key1.2~gAjhU3vFch-KXCrUjOc4ip2N4GV9n3T.4_1 2024-09-12T00:46:06.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.087+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.103__multipart_key1.2~gAjhU3vFch-KXCrUjOc4ip2N4GV9n3T.5 2024-09-12T00:46:06.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.087+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2361033939437991130', time=2024-09-12T02:45:48.870643+0000, chain.objs.size()=1 2024-09-12T00:46:06.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.087+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.106__shadow_.GXarqyRM5g3m2G0_1kRV5bB3pmw1GKB_0 2024-09-12T00:46:06.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.087+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6277362246774579105', time=2024-09-12T02:45:54.119625+0000, chain.objs.size()=1 2024-09-12T00:46:06.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.087+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.119__shadow_.JKJtMnJDcwXEKzc_lAPJkg2koV67gmM_0 2024-09-12T00:46:06.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.087+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15896560873508054100', time=2024-09-12T02:45:55.934152+0000, chain.objs.size()=1 2024-09-12T00:46:06.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.087+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.123__shadow_.W8sLVPcEnrbcOyej44L0zIYhX8Pa4xZ_0 2024-09-12T00:46:06.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.095+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9200334964116491334', time=2024-09-12T02:45:56.340326+0000, chain.objs.size()=1 2024-09-12T00:46:06.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.095+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.124__shadow_.cmnM4Y1sOwoXxrevbdzSIUp-iXczXtK_0 2024-09-12T00:46:06.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.095+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16513695882741106996', time=2024-09-12T02:45:56.764549+0000, chain.objs.size()=1 2024-09-12T00:46:06.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.095+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.125__shadow_.yYmXN4d1KlmN0vJeOifj1YlpAxjSDYp_0 2024-09-12T00:46:06.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.095+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4290381778818423226', time=2024-09-12T02:45:56.791943+0000, chain.objs.size()=1 2024-09-12T00:46:06.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.095+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.125__shadow_.s0YK11HsNVbss6VJoBUWFhrZLBWAShK_0 2024-09-12T00:46:06.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.095+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11279340986932915782', time=2024-09-12T02:46:00.230998+0000, chain.objs.size()=1 2024-09-12T00:46:06.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.095+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.133__shadow_.EIytJb-SLQspYbjexPs1uXeUSq3xWFZ_0 2024-09-12T00:46:06.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.095+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5442982597719498826', time=2024-09-12T02:46:04.427905+0000, chain.objs.size()=9 2024-09-12T00:46:06.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.095+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.143__multipart_key1.2~7BH6KKEKkx8uPJyEGm_F6UOMq8-MMry.1 2024-09-12T00:46:06.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.095+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.143__shadow_key1.2~7BH6KKEKkx8uPJyEGm_F6UOMq8-MMry.1_1 2024-09-12T00:46:06.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.095+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.143__multipart_key1.2~7BH6KKEKkx8uPJyEGm_F6UOMq8-MMry.2 2024-09-12T00:46:06.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.095+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.143__shadow_key1.2~7BH6KKEKkx8uPJyEGm_F6UOMq8-MMry.2_1 2024-09-12T00:46:06.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.095+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.143__multipart_key1.2~7BH6KKEKkx8uPJyEGm_F6UOMq8-MMry.3 2024-09-12T00:46:06.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.095+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.143__shadow_key1.2~7BH6KKEKkx8uPJyEGm_F6UOMq8-MMry.3_1 2024-09-12T00:46:06.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.095+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.143__multipart_key1.2~7BH6KKEKkx8uPJyEGm_F6UOMq8-MMry.4 2024-09-12T00:46:06.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.099+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.143__shadow_key1.2~7BH6KKEKkx8uPJyEGm_F6UOMq8-MMry.4_1 2024-09-12T00:46:06.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.099+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.143__multipart_key1.2~7BH6KKEKkx8uPJyEGm_F6UOMq8-MMry.5 2024-09-12T00:46:06.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.103+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:06.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.111+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:46:06.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.111+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.115+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.115+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:46:06.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.115+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11508636175222660419', time=2024-09-12T02:45:26.552320+0000, chain.objs.size()=9 2024-09-12T00:46:06.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.115+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.91__multipart_key1.2~xX2ht5aRjbkegHFDV0g6W6FPqAqSFhH.1 2024-09-12T00:46:06.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.115+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.91__shadow_key1.2~xX2ht5aRjbkegHFDV0g6W6FPqAqSFhH.1_1 2024-09-12T00:46:06.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.115+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.91__multipart_key1.2~xX2ht5aRjbkegHFDV0g6W6FPqAqSFhH.2 2024-09-12T00:46:06.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.115+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.91__shadow_key1.2~xX2ht5aRjbkegHFDV0g6W6FPqAqSFhH.2_1 2024-09-12T00:46:06.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.115+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.91__multipart_key1.2~xX2ht5aRjbkegHFDV0g6W6FPqAqSFhH.3 2024-09-12T00:46:06.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.115+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.91__shadow_key1.2~xX2ht5aRjbkegHFDV0g6W6FPqAqSFhH.3_1 2024-09-12T00:46:06.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.115+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.91__multipart_key1.2~xX2ht5aRjbkegHFDV0g6W6FPqAqSFhH.4 2024-09-12T00:46:06.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.115+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.91__shadow_key1.2~xX2ht5aRjbkegHFDV0g6W6FPqAqSFhH.4_1 2024-09-12T00:46:06.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.115+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.91__multipart_key1.2~xX2ht5aRjbkegHFDV0g6W6FPqAqSFhH.5 2024-09-12T00:46:06.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.115+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.121565772223399907', time=2024-09-12T02:45:55.001620+0000, chain.objs.size()=1 2024-09-12T00:46:06.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.115+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.121__shadow_.K1aeieb2v4rNTxEOTO__43N_2Cg6bTg_0 2024-09-12T00:46:06.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.115+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12315711970936505754', time=2024-09-12T02:45:55.906099+0000, chain.objs.size()=1 2024-09-12T00:46:06.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.115+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.123__shadow_.OmIo2UOxYlPt4O36DpDO3MfKa0hPGsw_0 2024-09-12T00:46:06.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.115+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10647305466348298101', time=2024-09-12T02:45:59.832004+0000, chain.objs.size()=1 2024-09-12T00:46:06.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.115+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.132__shadow_.xTBi9zwIl3lwrHubiMPJIB3MNyVlSNH_0 2024-09-12T00:46:06.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.123+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11166012158857561849', time=2024-09-12T02:46:01.924974+0000, chain.objs.size()=1 2024-09-12T00:46:06.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.123+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.138__shadow_.rFi2S5OiGcT62T62eQPtTNiRNYgc_EB_0 2024-09-12T00:46:06.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.127+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:06.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.131+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:46:06.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.131+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.135+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.135+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:46:06.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.135+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1263568240445656307', time=2024-09-12T02:45:55.920573+0000, chain.objs.size()=1 2024-09-12T00:46:06.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.135+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.123__shadow_.eov9I2ISkR-Z8MXbsEJpLTIBc0SEVQU_0 2024-09-12T00:46:06.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.135+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:06.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.143+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:46:06.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.143+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.147+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.147+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:46:06.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.147+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13484780781097395751', time=2024-09-12T02:45:45.663625+0000, chain.objs.size()=1 2024-09-12T00:46:06.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.147+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.103__shadow_.BTf3Aob7mYOa6hUM1eik_X5vfNwq-Wk_0 2024-09-12T00:46:06.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.147+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1645374641685904516', time=2024-09-12T02:45:51.400088+0000, chain.objs.size()=1 2024-09-12T00:46:06.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.147+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.113__shadow_.Z4a0_dM5aAkkx_PoUnAaulf2MCcOHOB_0 2024-09-12T00:46:06.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.147+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:06.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.155+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:46:06.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.155+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.159+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.159+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T00:46:06.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.159+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15508328508809407906', time=2024-09-12T02:45:30.103670+0000, chain.objs.size()=9 2024-09-12T00:46:06.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.159+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__multipart_key1.2~CQQmwHmmUK6uAKgYykj5n0zhXXIyZpK.1 2024-09-12T00:46:06.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.159+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__shadow_key1.2~CQQmwHmmUK6uAKgYykj5n0zhXXIyZpK.1_1 2024-09-12T00:46:06.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.159+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__multipart_key1.2~CQQmwHmmUK6uAKgYykj5n0zhXXIyZpK.2 2024-09-12T00:46:06.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.159+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__shadow_key1.2~CQQmwHmmUK6uAKgYykj5n0zhXXIyZpK.2_1 2024-09-12T00:46:06.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.159+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__multipart_key1.2~CQQmwHmmUK6uAKgYykj5n0zhXXIyZpK.3 2024-09-12T00:46:06.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.159+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__shadow_key1.2~CQQmwHmmUK6uAKgYykj5n0zhXXIyZpK.3_1 2024-09-12T00:46:06.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.159+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__multipart_key1.2~CQQmwHmmUK6uAKgYykj5n0zhXXIyZpK.4 2024-09-12T00:46:06.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.159+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__shadow_key1.2~CQQmwHmmUK6uAKgYykj5n0zhXXIyZpK.4_1 2024-09-12T00:46:06.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.159+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.94__multipart_key1.2~CQQmwHmmUK6uAKgYykj5n0zhXXIyZpK.5 2024-09-12T00:46:06.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.159+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11438672577570049837', time=2024-09-12T02:45:38.260407+0000, chain.objs.size()=9 2024-09-12T00:46:06.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.159+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.100__multipart_file.mpg.2~Lg4XoWhoA-_ueBN8X1YcIZ2HUaNqfJ2.1 2024-09-12T00:46:06.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.159+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.100__shadow_file.mpg.2~Lg4XoWhoA-_ueBN8X1YcIZ2HUaNqfJ2.1_1 2024-09-12T00:46:06.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.159+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.100__multipart_file.mpg.2~Lg4XoWhoA-_ueBN8X1YcIZ2HUaNqfJ2.2 2024-09-12T00:46:06.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.167+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.100__shadow_file.mpg.2~Lg4XoWhoA-_ueBN8X1YcIZ2HUaNqfJ2.2_1 2024-09-12T00:46:06.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.167+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.100__multipart_file.mpg.2~Lg4XoWhoA-_ueBN8X1YcIZ2HUaNqfJ2.3 2024-09-12T00:46:06.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.167+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.100__shadow_file.mpg.2~Lg4XoWhoA-_ueBN8X1YcIZ2HUaNqfJ2.3_1 2024-09-12T00:46:06.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.167+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.100__multipart_file.mpg.2~Lg4XoWhoA-_ueBN8X1YcIZ2HUaNqfJ2.4 2024-09-12T00:46:06.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.167+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.100__shadow_file.mpg.2~Lg4XoWhoA-_ueBN8X1YcIZ2HUaNqfJ2.4_1 2024-09-12T00:46:06.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.167+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.100__multipart_file.mpg.2~Lg4XoWhoA-_ueBN8X1YcIZ2HUaNqfJ2.5 2024-09-12T00:46:06.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.167+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17219858772426905425', time=2024-09-12T02:45:50.980346+0000, chain.objs.size()=1 2024-09-12T00:46:06.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.167+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.112__shadow_.4QvTrRFAo4IxpIAMtYT2bPNgtYpt3Q8_0 2024-09-12T00:46:06.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.167+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12930429622661999769', time=2024-09-12T02:45:53.697207+0000, chain.objs.size()=1 2024-09-12T00:46:06.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.167+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.118__shadow_.rsj1KBZJrS_1AvDOlAc4oGGByOxnLqo_0 2024-09-12T00:46:06.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.167+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2092862711507751822', time=2024-09-12T02:45:55.503357+0000, chain.objs.size()=1 2024-09-12T00:46:06.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.167+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.122__shadow_.SxFkkZm45R8hH6KLAP7prWlrV5djAxY_0 2024-09-12T00:46:06.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.167+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10226557696356274508', time=2024-09-12T02:45:57.698024+0000, chain.objs.size()=1 2024-09-12T00:46:06.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.167+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.127__shadow_.Si07KGvqRZV1_R-7aNQoqiwKfCjRo3i_0 2024-09-12T00:46:06.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.175+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:06.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.179+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:46:06.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.183+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.183+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.187+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:46:06.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.187+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15092339348563965014', time=2024-09-12T02:45:35.832321+0000, chain.objs.size()=9 2024-09-12T00:46:06.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.187+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.98__multipart_key1.2~2dZ35BddgAwZzybXLQbGh1MvE4319gC.1 2024-09-12T00:46:06.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.187+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.98__shadow_key1.2~2dZ35BddgAwZzybXLQbGh1MvE4319gC.1_1 2024-09-12T00:46:06.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.187+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.98__multipart_key1.2~2dZ35BddgAwZzybXLQbGh1MvE4319gC.2 2024-09-12T00:46:06.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.187+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.98__shadow_key1.2~2dZ35BddgAwZzybXLQbGh1MvE4319gC.2_1 2024-09-12T00:46:06.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.187+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.98__multipart_key1.2~2dZ35BddgAwZzybXLQbGh1MvE4319gC.3 2024-09-12T00:46:06.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.187+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.98__shadow_key1.2~2dZ35BddgAwZzybXLQbGh1MvE4319gC.3_1 2024-09-12T00:46:06.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.187+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.98__multipart_key1.2~2dZ35BddgAwZzybXLQbGh1MvE4319gC.4 2024-09-12T00:46:06.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.187+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.98__shadow_key1.2~2dZ35BddgAwZzybXLQbGh1MvE4319gC.4_1 2024-09-12T00:46:06.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.187+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.98__multipart_key1.2~2dZ35BddgAwZzybXLQbGh1MvE4319gC.5 2024-09-12T00:46:06.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.187+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2796341182677139937', time=2024-09-12T02:45:57.671022+0000, chain.objs.size()=1 2024-09-12T00:46:06.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.187+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.127__shadow_.yXzKEhnQUMw_facZPj-87yoIsPqOMt8_0 2024-09-12T00:46:06.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.187+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14577675158152673716', time=2024-09-12T02:45:59.002426+0000, chain.objs.size()=1 2024-09-12T00:46:06.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.187+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.130__shadow_.XygH1zTA5YJdoaMewof_NEFqXsQwaOp_0 2024-09-12T00:46:06.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.187+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4827617070877306535', time=2024-09-12T02:45:59.400653+0000, chain.objs.size()=1 2024-09-12T00:46:06.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.187+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.131__shadow_.Y2DhinuLtzFlhioNDIeGFS7teAwEbq__0 2024-09-12T00:46:06.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.191+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:06.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.199+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:46:06.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.199+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.203+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.203+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:46:06.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.203+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10034159430616926177', time=2024-09-12T02:45:54.595205+0000, chain.objs.size()=1 2024-09-12T00:46:06.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.203+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.120__shadow_.DTCgAeu-2A4JyEiHH9ZJ944ud8mNoJa_0 2024-09-12T00:46:06.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.203+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14541677426254505723', time=2024-09-12T02:45:57.683651+0000, chain.objs.size()=1 2024-09-12T00:46:06.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.203+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.127__shadow_.AOlCLnx8FISk_XUwuSaTtzQPZebWdWp_0 2024-09-12T00:46:06.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.203+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11112832477698941466', time=2024-09-12T02:45:58.557752+0000, chain.objs.size()=1 2024-09-12T00:46:06.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.203+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.129__shadow_.dFmgZ3QeHuZ3xmVegwCv80527W3hhnq_0 2024-09-12T00:46:06.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.207+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:06.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.211+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:46:06.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.215+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.215+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.215+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:46:06.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.215+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6039569227391756242', time=2024-09-12T02:45:18.617238+0000, chain.objs.size()=1 2024-09-12T00:46:06.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.215+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.77__shadow_.HqVBjuaw-VCP2pp41wePUCi8IaIU6JO_0 2024-09-12T00:46:06.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.215+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.349162407914729270', time=2024-09-12T02:45:47.496001+0000, chain.objs.size()=9 2024-09-12T00:46:06.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.215+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.104__multipart_key1.2~NUrLG1NNiHRblvKfKyFcEupeAeQKkx_.1 2024-09-12T00:46:06.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.215+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.104__shadow_key1.2~NUrLG1NNiHRblvKfKyFcEupeAeQKkx_.1_1 2024-09-12T00:46:06.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.215+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.104__multipart_key1.2~NUrLG1NNiHRblvKfKyFcEupeAeQKkx_.2 2024-09-12T00:46:06.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.215+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.104__shadow_key1.2~NUrLG1NNiHRblvKfKyFcEupeAeQKkx_.2_1 2024-09-12T00:46:06.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.215+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.104__multipart_key1.2~NUrLG1NNiHRblvKfKyFcEupeAeQKkx_.3 2024-09-12T00:46:06.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.215+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.104__shadow_key1.2~NUrLG1NNiHRblvKfKyFcEupeAeQKkx_.3_1 2024-09-12T00:46:06.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.215+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.104__multipart_key1.2~NUrLG1NNiHRblvKfKyFcEupeAeQKkx_.4 2024-09-12T00:46:06.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.215+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.104__shadow_key1.2~NUrLG1NNiHRblvKfKyFcEupeAeQKkx_.4_1 2024-09-12T00:46:06.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.215+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.104__multipart_key1.2~NUrLG1NNiHRblvKfKyFcEupeAeQKkx_.5 2024-09-12T00:46:06.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.215+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8226301204503811989', time=2024-09-12T02:45:51.387104+0000, chain.objs.size()=1 2024-09-12T00:46:06.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.215+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.113__shadow_.RKNkU2quJCJgxv5BNzMdiQqesf97OIX_0 2024-09-12T00:46:06.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.215+0000 7f3c0e5b59c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11439621749147821272', time=2024-09-12T02:45:59.386591+0000, chain.objs.size()=1 2024-09-12T00:46:06.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.215+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.131__shadow_.OxfTsRcTWgGMpyvSHTaHl8SYRj7-Q1J_0 2024-09-12T00:46:06.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.223+0000 7f3c0e5b59c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:06.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.231+0000 7f3ac27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:06.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.235+0000 7f3c0e5b59c0 20 remove_watcher() i=0 2024-09-12T00:46:06.237 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.235+0000 7f3c0e5b59c0 2 removed watcher, disabling cache 2024-09-12T00:46:06.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.239+0000 7f3c0e5b59c0 20 remove_watcher() i=1 2024-09-12T00:46:06.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.243+0000 7f3c0e5b59c0 20 remove_watcher() i=2 2024-09-12T00:46:06.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.243+0000 7f3c0e5b59c0 20 remove_watcher() i=3 2024-09-12T00:46:06.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.247+0000 7f3c0e5b59c0 20 remove_watcher() i=4 2024-09-12T00:46:06.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.247+0000 7f3c0e5b59c0 20 remove_watcher() i=5 2024-09-12T00:46:06.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.251+0000 7f3c0e5b59c0 20 remove_watcher() i=6 2024-09-12T00:46:06.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.251+0000 7f3c0e5b59c0 20 remove_watcher() i=7 2024-09-12T00:46:06.272 DEBUG:teuthology.orchestra.run.smithi043:> radosgw-admin gc process --include-all 2024-09-12T00:46:06.344 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:06.344 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:06.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.391+0000 7f092b9729c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:06.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.395+0000 7f092b9729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:06.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.395+0000 7f092b9729c0 20 realm 2024-09-12T00:46:06.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.395+0000 7f092b9729c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:06.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.395+0000 7f092b9729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:06.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.395+0000 7f092b9729c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:06.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.395+0000 7f092b9729c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:06.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.395+0000 7f092b9729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:06.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.395+0000 7f092b9729c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:06.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.395+0000 7f092b9729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:06.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.395+0000 7f092b9729c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:06.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.395+0000 7f092b9729c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:06.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.395+0000 7f092b9729c0 20 searching for the correct realm 2024-09-12T00:46:06.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.403+0000 7f0929c79640 0 -- 172.21.15.43:0/1359451829 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55d9142fc8c0 msgr2=0x55d9142fecf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:06.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.407+0000 7f0928c77640 0 -- 172.21.15.43:0/1359451829 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f0920103c00 msgr2=0x7f09200f6d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:46:06.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.419+0000 7f092b9729c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:46:06.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.419+0000 7f092b9729c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:06.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.419+0000 7f092b9729c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:06.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.419+0000 7f092b9729c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:46:06.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.419+0000 7f092b9729c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:06.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.419+0000 7f092b9729c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:06.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.419+0000 7f092b9729c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:06.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.419+0000 7f092b9729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:06.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.419+0000 7f092b9729c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:06.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.419+0000 7f092b9729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:06.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.419+0000 7f092b9729c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:06.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.419+0000 7f092b9729c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:06.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.419+0000 7f092b9729c0 20 zone default found 2024-09-12T00:46:06.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.419+0000 7f092b9729c0 4 Realm: () 2024-09-12T00:46:06.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.419+0000 7f092b9729c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:46:06.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.419+0000 7f092b9729c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:46:06.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.419+0000 7f092b9729c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:06.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.419+0000 7f092b9729c0 20 zonegroup default 2024-09-12T00:46:06.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.419+0000 7f092b9729c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:06.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.419+0000 7f092b9729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:06.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.419+0000 7f092b9729c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:06.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.419+0000 7f092b9729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:06.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.419+0000 7f092b9729c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:06.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.419+0000 7f092b9729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:06.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.419+0000 7f092b9729c0 20 started sync module instance, tier type = 2024-09-12T00:46:06.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.419+0000 7f092b9729c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:46:06.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.435+0000 7f092b9729c0 20 add_watcher() i=0 2024-09-12T00:46:06.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.435+0000 7f092b9729c0 20 add_watcher() i=1 2024-09-12T00:46:06.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.435+0000 7f092b9729c0 20 add_watcher() i=2 2024-09-12T00:46:06.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.435+0000 7f092b9729c0 20 add_watcher() i=3 2024-09-12T00:46:06.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.435+0000 7f092b9729c0 20 add_watcher() i=4 2024-09-12T00:46:06.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.435+0000 7f092b9729c0 20 add_watcher() i=5 2024-09-12T00:46:06.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.435+0000 7f092b9729c0 20 add_watcher() i=6 2024-09-12T00:46:06.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.435+0000 7f092b9729c0 20 add_watcher() i=7 2024-09-12T00:46:06.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.435+0000 7f092b9729c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:06.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.439+0000 7f07df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:06.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.439+0000 7f092b9729c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:06.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.439+0000 7f092b9729c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:06.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.511+0000 7f07de7e4640 20 reqs_thread_entry: start 2024-09-12T00:46:06.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.511+0000 7f092b9729c0 20 init_complete bucket index max shards: 11 2024-09-12T00:46:06.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.511+0000 7f092b9729c0 20 Filter name: none 2024-09-12T00:46:06.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.511+0000 7f074ffff640 20 reqs_thread_entry: start 2024-09-12T00:46:06.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.511+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:46:06.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.515+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.515+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.515+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.519+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:46:06.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.519+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.519+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.523+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.523+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:46:06.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.523+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.523+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.527+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.527+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:46:06.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.531+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.531+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.531+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.535+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:46:06.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.535+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.535+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.535+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.539+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:46:06.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.539+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.543+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.543+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.543+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:46:06.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.547+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.547+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.547+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.551+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:46:06.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.555+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.555+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.555+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.559+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:46:06.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.563+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.563+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.563+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.563+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:46:06.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.567+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.571+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.571+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.571+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:46:06.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.575+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.575+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.575+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.579+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:46:06.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.583+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.583+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.583+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.587+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:46:06.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.591+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.591+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.595+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.595+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:46:06.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.599+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.603+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.603+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.603+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:46:06.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.607+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.607+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.607+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.611+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:46:06.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.615+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.615+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.615+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.623+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:46:06.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.627+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.627+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.627+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.631+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:46:06.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.631+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.635+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.635+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.639+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:46:06.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.643+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.643+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.644 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.643+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.647+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:46:06.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.651+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.651+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.651+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.655+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:46:06.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.659+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.659+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.663+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.663+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:46:06.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.667+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.671+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.671+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.675+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:46:06.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.679+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.679+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.679+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.683+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:46:06.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.683+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.687+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.687+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.691+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:46:06.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.695+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.695+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.699+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.699+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:46:06.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.703+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.707+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.707+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.707+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:46:06.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.711+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.715+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.715+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.719+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:46:06.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.723+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.723+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.723+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.727+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:46:06.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.731+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.731+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.735+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.735+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:46:06.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.739+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.743+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.743+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.747+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:46:06.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.751+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.751+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.751+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.755+0000 7f092b9729c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:46:06.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.759+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.759+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:06.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.759+0000 7f092b9729c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:06.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.767+0000 7f07df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:06.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.771+0000 7f092b9729c0 20 remove_watcher() i=0 2024-09-12T00:46:06.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.771+0000 7f092b9729c0 2 removed watcher, disabling cache 2024-09-12T00:46:06.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.775+0000 7f092b9729c0 20 remove_watcher() i=1 2024-09-12T00:46:06.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.775+0000 7f092b9729c0 20 remove_watcher() i=2 2024-09-12T00:46:06.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.779+0000 7f092b9729c0 20 remove_watcher() i=3 2024-09-12T00:46:06.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.779+0000 7f092b9729c0 20 remove_watcher() i=4 2024-09-12T00:46:06.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.783+0000 7f092b9729c0 20 remove_watcher() i=5 2024-09-12T00:46:06.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.783+0000 7f092b9729c0 20 remove_watcher() i=6 2024-09-12T00:46:06.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:06.787+0000 7f092b9729c0 20 remove_watcher() i=7 2024-09-12T00:46:06.808 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-12T00:46:06.825 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-12T00:46:06.825 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-12T00:46:06.825 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-12T00:46:06.825 DEBUG:teuthology.orchestra.run.smithi043:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T00:46:06.854 INFO:teuthology.orchestra.run.smithi043.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-12T00:46:07.804 INFO:tasks.s3tests:Creating rgw users... 2024-09-12T00:46:07.804 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2024-09-12T00:46:07.804 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.foo.client.0 --email foo+test@test.test --access-key HNBOGSEMPEFVKSFAZBWH --secret h1UwHaC1I7dLyk9ZwFaIQBSCSWB2Oan+uVAL4jqtyYlbcRmh41bVrA== --cluster ceph 2024-09-12T00:46:07.891 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:07.892 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:07.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.931+0000 7f8d0a5ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:07.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.935+0000 7f8d0a5ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:07.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.935+0000 7f8d0a5ff9c0 20 realm 2024-09-12T00:46:07.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.935+0000 7f8d0a5ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:07.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.935+0000 7f8d0a5ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:07.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.935+0000 7f8d0a5ff9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:07.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.935+0000 7f8d0a5ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:07.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.935+0000 7f8d0a5ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:07.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.935+0000 7f8d0a5ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:07.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.935+0000 7f8d0a5ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:07.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.935+0000 7f8d0a5ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:07.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.939+0000 7f8d0a5ff9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:07.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.939+0000 7f8d0a5ff9c0 20 searching for the correct realm 2024-09-12T00:46:07.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.943+0000 7f8d07904640 0 -- 172.21.15.43:0/1754731078 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f8cf001a040 msgr2=0x7f8cf001a420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:46:07.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.951+0000 7f8d07904640 0 -- 172.21.15.43:0/1754731078 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f8bd0080b80 msgr2=0x7f8bd0082fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:07.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.959+0000 7f8d0a5ff9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:46:07.960 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.959+0000 7f8d0a5ff9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:07.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.959+0000 7f8d0a5ff9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:07.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.959+0000 7f8d0a5ff9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:46:07.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.959+0000 7f8d0a5ff9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:07.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.959+0000 7f8d0a5ff9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:07.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.959+0000 7f8d0a5ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:07.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.959+0000 7f8d0a5ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:07.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.959+0000 7f8d0a5ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:07.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.963+0000 7f8d0a5ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:07.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.963+0000 7f8d0a5ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:07.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.963+0000 7f8d0a5ff9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:07.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.963+0000 7f8d0a5ff9c0 20 zone default found 2024-09-12T00:46:07.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.963+0000 7f8d0a5ff9c0 4 Realm: () 2024-09-12T00:46:07.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.963+0000 7f8d0a5ff9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:46:07.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.963+0000 7f8d0a5ff9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:46:07.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.963+0000 7f8d0a5ff9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:07.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.963+0000 7f8d0a5ff9c0 20 zonegroup default 2024-09-12T00:46:07.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.963+0000 7f8d0a5ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:07.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.963+0000 7f8d0a5ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:07.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.963+0000 7f8d0a5ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:07.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.963+0000 7f8d0a5ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:07.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.963+0000 7f8d0a5ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:07.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.963+0000 7f8d0a5ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:07.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.963+0000 7f8d0a5ff9c0 20 started sync module instance, tier type = 2024-09-12T00:46:07.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.963+0000 7f8d0a5ff9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:46:07.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.979+0000 7f8d0a5ff9c0 20 add_watcher() i=0 2024-09-12T00:46:07.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.979+0000 7f8d0a5ff9c0 20 add_watcher() i=1 2024-09-12T00:46:07.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.979+0000 7f8d0a5ff9c0 20 add_watcher() i=2 2024-09-12T00:46:07.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.979+0000 7f8d0a5ff9c0 20 add_watcher() i=3 2024-09-12T00:46:07.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.979+0000 7f8d0a5ff9c0 20 add_watcher() i=4 2024-09-12T00:46:07.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.979+0000 7f8d0a5ff9c0 20 add_watcher() i=5 2024-09-12T00:46:07.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.979+0000 7f8d0a5ff9c0 20 add_watcher() i=6 2024-09-12T00:46:07.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.979+0000 7f8d0a5ff9c0 20 add_watcher() i=7 2024-09-12T00:46:07.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.979+0000 7f8d0a5ff9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:07.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.983+0000 7f8bbefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:07.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.983+0000 7f8d0a5ff9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:07.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.983+0000 7f8d0a5ff9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:07.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.983+0000 7f8d0a5ff9c0 5 note: GC not initialized 2024-09-12T00:46:07.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.983+0000 7f8bbdfdb640 20 reqs_thread_entry: start 2024-09-12T00:46:07.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.983+0000 7f8d0a5ff9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:46:07.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.983+0000 7f8d0a5ff9c0 20 Filter name: none 2024-09-12T00:46:07.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.983+0000 7f8b2f7fe640 20 reqs_thread_entry: start 2024-09-12T00:46:07.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.983+0000 7f8d0a5ff9c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T00:46:07.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.983+0000 7f8d0a5ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:07.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.983+0000 7f8d0a5ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:07.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.983+0000 7f8d0a5ff9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-12T00:46:07.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.983+0000 7f8d0a5ff9c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:46:07.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.983+0000 7f8d0a5ff9c0 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-12T00:46:07.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.983+0000 7f8d0a5ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:07.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.983+0000 7f8d0a5ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:07.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.983+0000 7f8d0a5ff9c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-12T00:46:07.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.983+0000 7f8d0a5ff9c0 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T00:46:07.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.983+0000 7f8d0a5ff9c0 10 cache get: name=default.rgw.meta+users.keys+HNBOGSEMPEFVKSFAZBWH : miss 2024-09-12T00:46:07.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.983+0000 7f8d0a5ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:07.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.983+0000 7f8d0a5ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:07.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.983+0000 7f8d0a5ff9c0 10 cache put: name=default.rgw.meta+users.keys+HNBOGSEMPEFVKSFAZBWH info.flags=0x0 2024-09-12T00:46:07.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.983+0000 7f8d0a5ff9c0 10 adding default.rgw.meta+users.keys+HNBOGSEMPEFVKSFAZBWH to cache LRU end 2024-09-12T00:46:07.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.983+0000 7f8d0a5ff9c0 10 cache get: name=default.rgw.meta+users.keys+HNBOGSEMPEFVKSFAZBWH : hit (negative entry) 2024-09-12T00:46:07.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.983+0000 7f8d0a5ff9c0 10 cache get: name=default.rgw.meta+users.keys+HNBOGSEMPEFVKSFAZBWH : hit (negative entry) 2024-09-12T00:46:07.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.987+0000 7f8d0a5ff9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:46:07.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.987+0000 7f8d0a5ff9c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:46:07.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.987+0000 7f8d0a5ff9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T00:46:07.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.987+0000 7f8bdf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333597 cookie 94434451212256 notifier 8474 bl.length()=645 2024-09-12T00:46:07.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.987+0000 7f8bdf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:46:07.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.987+0000 7f8bdf7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:46:07.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.991+0000 7f8d0a5ff9c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T00:46:07.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.991+0000 7f8d0a5ff9c0 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T00:46:07.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.991+0000 7f8d0a5ff9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-12T00:46:07.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.991+0000 7f8bdeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333598 cookie 94434451227888 notifier 8474 bl.length()=185 2024-09-12T00:46:07.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.991+0000 7f8bdeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T00:46:07.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.991+0000 7f8bdeffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T00:46:07.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.995+0000 7f8d0a5ff9c0 10 cache put: name=default.rgw.meta+users.keys+HNBOGSEMPEFVKSFAZBWH info.flags=0x7 2024-09-12T00:46:07.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.995+0000 7f8d0a5ff9c0 10 moving default.rgw.meta+users.keys+HNBOGSEMPEFVKSFAZBWH to cache LRU end 2024-09-12T00:46:07.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.995+0000 7f8d0a5ff9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:HNBOGSEMPEFVKSFAZBWH, ofs0, ns] 2024-09-12T00:46:07.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.995+0000 7f8bdf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333580 cookie 94434451218720 notifier 8474 bl.length()=186 2024-09-12T00:46:07.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.995+0000 7f8bdf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+HNBOGSEMPEFVKSFAZBWH info.flags=0x7 2024-09-12T00:46:07.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.995+0000 7f8bdf7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+HNBOGSEMPEFVKSFAZBWH to cache LRU end 2024-09-12T00:46:07.997 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T00:46:07.997 INFO:teuthology.orchestra.run.smithi043.stdout: "user_id": "foo.client.0", 2024-09-12T00:46:07.997 INFO:teuthology.orchestra.run.smithi043.stdout: "display_name": "Mr.foo.client.0", 2024-09-12T00:46:07.997 INFO:teuthology.orchestra.run.smithi043.stdout: "email": "foo+test@test.test", 2024-09-12T00:46:07.997 INFO:teuthology.orchestra.run.smithi043.stdout: "suspended": 0, 2024-09-12T00:46:07.997 INFO:teuthology.orchestra.run.smithi043.stdout: "max_buckets": 1000, 2024-09-12T00:46:07.997 INFO:teuthology.orchestra.run.smithi043.stdout: "subusers": [], 2024-09-12T00:46:07.997 INFO:teuthology.orchestra.run.smithi043.stdout: "keys": [ 2024-09-12T00:46:07.997 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T00:46:07.997 INFO:teuthology.orchestra.run.smithi043.stdout: "user": "foo.client.0", 2024-09-12T00:46:07.997 INFO:teuthology.orchestra.run.smithi043.stdout: "access_key": "HNBOGSEMPEFVKSFAZBWH", 2024-09-12T00:46:07.998 INFO:teuthology.orchestra.run.smithi043.stdout: "secret_key": "h1UwHaC1I7dLyk9ZwFaIQBSCSWB2Oan+uVAL4jqtyYlbcRmh41bVrA==", 2024-09-12T00:46:07.998 INFO:teuthology.orchestra.run.smithi043.stdout: "active": true, 2024-09-12T00:46:07.998 INFO:teuthology.orchestra.run.smithi043.stdout: "create_date": "2024-09-12T00:46:07.988754Z" 2024-09-12T00:46:07.998 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T00:46:07.998 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-12T00:46:07.998 INFO:teuthology.orchestra.run.smithi043.stdout: "swift_keys": [], 2024-09-12T00:46:07.998 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": [], 2024-09-12T00:46:07.998 INFO:teuthology.orchestra.run.smithi043.stdout: "op_mask": "read, write, delete", 2024-09-12T00:46:07.998 INFO:teuthology.orchestra.run.smithi043.stdout: "default_placement": "", 2024-09-12T00:46:07.998 INFO:teuthology.orchestra.run.smithi043.stdout: "default_storage_class": "", 2024-09-12T00:46:07.998 INFO:teuthology.orchestra.run.smithi043.stdout: "placement_tags": [], 2024-09-12T00:46:07.998 INFO:teuthology.orchestra.run.smithi043.stdout: "bucket_quota": { 2024-09-12T00:46:07.998 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": false, 2024-09-12T00:46:07.999 INFO:teuthology.orchestra.run.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:46:07.999 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size": -1, 2024-09-12T00:46:07.999 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:46:07.999 INFO:teuthology.orchestra.run.smithi043.stdout: "max_objects": -1 2024-09-12T00:46:07.999 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T00:46:07.999 INFO:teuthology.orchestra.run.smithi043.stdout: "user_quota": { 2024-09-12T00:46:07.999 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": false, 2024-09-12T00:46:07.999 INFO:teuthology.orchestra.run.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:46:07.999 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size": -1, 2024-09-12T00:46:07.999 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:46:07.999 INFO:teuthology.orchestra.run.smithi043.stdout: "max_objects": -1 2024-09-12T00:46:07.999 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T00:46:07.999 INFO:teuthology.orchestra.run.smithi043.stdout: "temp_url_keys": [], 2024-09-12T00:46:08.000 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "rgw", 2024-09-12T00:46:08.000 INFO:teuthology.orchestra.run.smithi043.stdout: "mfa_ids": [], 2024-09-12T00:46:08.000 INFO:teuthology.orchestra.run.smithi043.stdout: "account_id": "", 2024-09-12T00:46:08.000 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-09-12T00:46:08.000 INFO:teuthology.orchestra.run.smithi043.stdout: "create_date": "2024-09-12T00:46:07.988736Z", 2024-09-12T00:46:08.000 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-09-12T00:46:08.000 INFO:teuthology.orchestra.run.smithi043.stdout: "group_ids": [] 2024-09-12T00:46:08.000 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T00:46:08.000 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:08.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:07.999+0000 7f8bbefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:08.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.003+0000 7f8d0a5ff9c0 20 remove_watcher() i=0 2024-09-12T00:46:08.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.003+0000 7f8d0a5ff9c0 2 removed watcher, disabling cache 2024-09-12T00:46:08.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.003+0000 7f8d0a5ff9c0 20 remove_watcher() i=1 2024-09-12T00:46:08.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.007+0000 7f8d0a5ff9c0 20 remove_watcher() i=2 2024-09-12T00:46:08.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.011+0000 7f8d0a5ff9c0 20 remove_watcher() i=3 2024-09-12T00:46:08.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.011+0000 7f8d0a5ff9c0 20 remove_watcher() i=4 2024-09-12T00:46:08.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.011+0000 7f8d0a5ff9c0 20 remove_watcher() i=5 2024-09-12T00:46:08.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.015+0000 7f8d0a5ff9c0 20 remove_watcher() i=6 2024-09-12T00:46:08.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.015+0000 7f8d0a5ff9c0 20 remove_watcher() i=7 2024-09-12T00:46:08.031 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 9298623539 --totp-seed 3GIUO25HIPBSYAW443PJV4AXT6VGTO2ANLMVYH4COBUZ366HA4OVIS3OXSMLE6IW --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:46:08.073 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:08.073 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:08.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.111+0000 7f039bcb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:08.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.115+0000 7f039bcb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:08.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.115+0000 7f039bcb39c0 20 realm 2024-09-12T00:46:08.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.115+0000 7f039bcb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:08.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.115+0000 7f039bcb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:08.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.115+0000 7f039bcb39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:08.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.115+0000 7f039bcb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:08.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.115+0000 7f039bcb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:08.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.115+0000 7f039bcb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:08.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.115+0000 7f039bcb39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:08.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.115+0000 7f039bcb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:08.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.115+0000 7f039bcb39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:08.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.115+0000 7f039bcb39c0 20 searching for the correct realm 2024-09-12T00:46:08.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.123+0000 7f0399fba640 0 -- 172.21.15.43:0/3950200819 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f0384038960 msgr2=0x7f038402a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:46:08.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.339+0000 7f03997b9640 0 -- 172.21.15.43:0/3950200819 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x557bf85eff20 msgr2=0x557bf85f2370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:08.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.347+0000 7f039bcb39c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:46:08.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.347+0000 7f039bcb39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:08.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.347+0000 7f039bcb39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:08.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.347+0000 7f039bcb39c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:46:08.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.347+0000 7f039bcb39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:08.348 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.347+0000 7f039bcb39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:08.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.347+0000 7f039bcb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:08.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.347+0000 7f039bcb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:08.349 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.347+0000 7f039bcb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:08.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.347+0000 7f039bcb39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:08.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.347+0000 7f039bcb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:08.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.351+0000 7f039bcb39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:08.351 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.351+0000 7f039bcb39c0 20 zone default found 2024-09-12T00:46:08.351 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.351+0000 7f039bcb39c0 4 Realm: () 2024-09-12T00:46:08.351 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.351+0000 7f039bcb39c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:46:08.351 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.351+0000 7f039bcb39c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:46:08.351 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.351+0000 7f039bcb39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:08.351 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.351+0000 7f039bcb39c0 20 zonegroup default 2024-09-12T00:46:08.351 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.351+0000 7f039bcb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:08.351 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.351+0000 7f039bcb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:08.351 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.351+0000 7f039bcb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:08.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.351+0000 7f039bcb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:08.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.351+0000 7f039bcb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:08.352 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.351+0000 7f039bcb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:08.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.351+0000 7f039bcb39c0 20 started sync module instance, tier type = 2024-09-12T00:46:08.353 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.351+0000 7f039bcb39c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:46:08.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.371+0000 7f039bcb39c0 20 add_watcher() i=0 2024-09-12T00:46:08.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.371+0000 7f039bcb39c0 20 add_watcher() i=1 2024-09-12T00:46:08.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.371+0000 7f039bcb39c0 20 add_watcher() i=2 2024-09-12T00:46:08.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.371+0000 7f039bcb39c0 20 add_watcher() i=3 2024-09-12T00:46:08.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.371+0000 7f039bcb39c0 20 add_watcher() i=4 2024-09-12T00:46:08.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.371+0000 7f039bcb39c0 20 add_watcher() i=5 2024-09-12T00:46:08.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.375+0000 7f039bcb39c0 20 add_watcher() i=6 2024-09-12T00:46:08.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.375+0000 7f039bcb39c0 20 add_watcher() i=7 2024-09-12T00:46:08.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.375+0000 7f039bcb39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:08.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.379+0000 7f024ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:08.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.379+0000 7f039bcb39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:08.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.379+0000 7f039bcb39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:08.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.379+0000 7f039bcb39c0 5 note: GC not initialized 2024-09-12T00:46:08.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.379+0000 7f024efe5640 20 reqs_thread_entry: start 2024-09-12T00:46:08.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.379+0000 7f039bcb39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:46:08.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.379+0000 7f039bcb39c0 20 Filter name: none 2024-09-12T00:46:08.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.379+0000 7f024cfe1640 20 reqs_thread_entry: start 2024-09-12T00:46:08.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.379+0000 7f039bcb39c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T00:46:08.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.379+0000 7f039bcb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:08.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.379+0000 7f039bcb39c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T00:46:08.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.379+0000 7f039bcb39c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-12T00:46:08.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.379+0000 7f039bcb39c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:46:08.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:08.379+0000 7f039bcb39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:09.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.527+0000 7f039bcb39c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:46:09.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.527+0000 7f039bcb39c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:46:09.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.527+0000 7f039bcb39c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T00:46:09.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.527+0000 7f026bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268191 cookie 93990936320896 notifier 8489 bl.length()=659 2024-09-12T00:46:09.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.527+0000 7f026bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:46:09.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.527+0000 7f026bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:46:09.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.531+0000 7f024ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:09.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.535+0000 7f039bcb39c0 20 remove_watcher() i=0 2024-09-12T00:46:09.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.535+0000 7f039bcb39c0 2 removed watcher, disabling cache 2024-09-12T00:46:09.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.535+0000 7f039bcb39c0 20 remove_watcher() i=1 2024-09-12T00:46:09.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.539+0000 7f039bcb39c0 20 remove_watcher() i=2 2024-09-12T00:46:09.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.543+0000 7f039bcb39c0 20 remove_watcher() i=3 2024-09-12T00:46:09.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.543+0000 7f039bcb39c0 20 remove_watcher() i=4 2024-09-12T00:46:09.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.547+0000 7f039bcb39c0 20 remove_watcher() i=5 2024-09-12T00:46:09.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.547+0000 7f039bcb39c0 20 remove_watcher() i=6 2024-09-12T00:46:09.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.547+0000 7f039bcb39c0 20 remove_watcher() i=7 2024-09-12T00:46:09.571 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-12T00:46:09.572 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key ZBLCTWHOXHWATIKGPQEG --secret aB0Y/gpGZFvUwhfN831CLyiU852XV361S6UDOWgtmPz/MMhDoI+mIg== --cluster ceph 2024-09-12T00:46:09.665 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:09.665 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:09.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.707+0000 7f22f125e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:09.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.711+0000 7f22f125e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:09.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.711+0000 7f22f125e9c0 20 realm 2024-09-12T00:46:09.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.711+0000 7f22f125e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:09.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.711+0000 7f22f125e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:09.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.711+0000 7f22f125e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:09.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.711+0000 7f22f125e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:09.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.711+0000 7f22f125e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:09.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.711+0000 7f22f125e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:09.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.711+0000 7f22f125e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:09.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.711+0000 7f22f125e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:09.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.711+0000 7f22f125e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:09.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.711+0000 7f22f125e9c0 20 searching for the correct realm 2024-09-12T00:46:09.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.719+0000 7f22ef565640 0 -- 172.21.15.43:0/1858168047 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55c82a56e470 msgr2=0x55c82a570900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:09.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.723+0000 7f22ee563640 0 -- 172.21.15.43:0/1858168047 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f22d8086110 msgr2=0x7f22d8064030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:09.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.731+0000 7f22f125e9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:46:09.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.731+0000 7f22f125e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:09.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.731+0000 7f22f125e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:09.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.731+0000 7f22f125e9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:46:09.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.731+0000 7f22f125e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:09.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.731+0000 7f22f125e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:09.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.731+0000 7f22f125e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:09.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.731+0000 7f22f125e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:09.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.731+0000 7f22f125e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:09.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.731+0000 7f22f125e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:09.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.731+0000 7f22f125e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:09.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.735+0000 7f22f125e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:09.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.735+0000 7f22f125e9c0 20 zone default found 2024-09-12T00:46:09.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.735+0000 7f22f125e9c0 4 Realm: () 2024-09-12T00:46:09.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.735+0000 7f22f125e9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:46:09.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.735+0000 7f22f125e9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:46:09.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.735+0000 7f22f125e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:09.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.735+0000 7f22f125e9c0 20 zonegroup default 2024-09-12T00:46:09.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.735+0000 7f22f125e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:09.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.735+0000 7f22f125e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:09.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.735+0000 7f22f125e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:09.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.735+0000 7f22f125e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:09.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.735+0000 7f22f125e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:09.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.735+0000 7f22f125e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:09.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.735+0000 7f22f125e9c0 20 started sync module instance, tier type = 2024-09-12T00:46:09.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.735+0000 7f22f125e9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:46:09.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.751+0000 7f22f125e9c0 20 add_watcher() i=0 2024-09-12T00:46:09.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.751+0000 7f22f125e9c0 20 add_watcher() i=1 2024-09-12T00:46:09.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.751+0000 7f22f125e9c0 20 add_watcher() i=2 2024-09-12T00:46:09.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.751+0000 7f22f125e9c0 20 add_watcher() i=3 2024-09-12T00:46:09.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.751+0000 7f22f125e9c0 20 add_watcher() i=4 2024-09-12T00:46:09.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.751+0000 7f22f125e9c0 20 add_watcher() i=5 2024-09-12T00:46:09.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.751+0000 7f22f125e9c0 20 add_watcher() i=6 2024-09-12T00:46:09.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.751+0000 7f22f125e9c0 20 add_watcher() i=7 2024-09-12T00:46:09.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.751+0000 7f22f125e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:09.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.755+0000 7f21a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:09.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.755+0000 7f22f125e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:09.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.755+0000 7f22f125e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:09.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.755+0000 7f22f125e9c0 5 note: GC not initialized 2024-09-12T00:46:09.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.755+0000 7f211ffff640 20 reqs_thread_entry: start 2024-09-12T00:46:09.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.755+0000 7f22f125e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:46:09.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.755+0000 7f22f125e9c0 20 Filter name: none 2024-09-12T00:46:09.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.755+0000 7f211dffb640 20 reqs_thread_entry: start 2024-09-12T00:46:09.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.755+0000 7f22f125e9c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T00:46:09.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.755+0000 7f22f125e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:09.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.755+0000 7f22f125e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:09.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.755+0000 7f22f125e9c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-12T00:46:09.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.755+0000 7f22f125e9c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:46:09.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.755+0000 7f22f125e9c0 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-12T00:46:09.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.755+0000 7f22f125e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:09.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.755+0000 7f22f125e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:09.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.755+0000 7f22f125e9c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-12T00:46:09.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.755+0000 7f22f125e9c0 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T00:46:09.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.755+0000 7f22f125e9c0 10 cache get: name=default.rgw.meta+users.keys+ZBLCTWHOXHWATIKGPQEG : miss 2024-09-12T00:46:09.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.755+0000 7f22f125e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:09.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.755+0000 7f22f125e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:09.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.755+0000 7f22f125e9c0 10 cache put: name=default.rgw.meta+users.keys+ZBLCTWHOXHWATIKGPQEG info.flags=0x0 2024-09-12T00:46:09.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.755+0000 7f22f125e9c0 10 adding default.rgw.meta+users.keys+ZBLCTWHOXHWATIKGPQEG to cache LRU end 2024-09-12T00:46:09.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.755+0000 7f22f125e9c0 10 cache get: name=default.rgw.meta+users.keys+ZBLCTWHOXHWATIKGPQEG : hit (negative entry) 2024-09-12T00:46:09.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.755+0000 7f22f125e9c0 10 cache get: name=default.rgw.meta+users.keys+ZBLCTWHOXHWATIKGPQEG : hit (negative entry) 2024-09-12T00:46:09.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.759+0000 7f22f125e9c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:46:09.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.759+0000 7f22f125e9c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:46:09.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.759+0000 7f22f125e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T00:46:09.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.759+0000 7f21d27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268173 cookie 94318192223952 notifier 8976 bl.length()=645 2024-09-12T00:46:09.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.759+0000 7f21d27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:46:09.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.759+0000 7f21d27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:46:09.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.763+0000 7f22f125e9c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T00:46:09.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.763+0000 7f22f125e9c0 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T00:46:09.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.763+0000 7f22f125e9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-12T00:46:09.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.763+0000 7f21d27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268247 cookie 94318192236128 notifier 8976 bl.length()=185 2024-09-12T00:46:09.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.763+0000 7f21d27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T00:46:09.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.763+0000 7f21d27fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T00:46:09.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.767+0000 7f22f125e9c0 10 cache put: name=default.rgw.meta+users.keys+ZBLCTWHOXHWATIKGPQEG info.flags=0x7 2024-09-12T00:46:09.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.767+0000 7f22f125e9c0 10 moving default.rgw.meta+users.keys+ZBLCTWHOXHWATIKGPQEG to cache LRU end 2024-09-12T00:46:09.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.767+0000 7f22f125e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:ZBLCTWHOXHWATIKGPQEG, ofs0, ns] 2024-09-12T00:46:09.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.767+0000 7f21d1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268174 cookie 94318192223952 notifier 8976 bl.length()=186 2024-09-12T00:46:09.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.767+0000 7f21d1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ZBLCTWHOXHWATIKGPQEG info.flags=0x7 2024-09-12T00:46:09.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.767+0000 7f21d1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ZBLCTWHOXHWATIKGPQEG to cache LRU end 2024-09-12T00:46:09.769 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T00:46:09.769 INFO:teuthology.orchestra.run.smithi043.stdout: "user_id": "bar.client.0", 2024-09-12T00:46:09.769 INFO:teuthology.orchestra.run.smithi043.stdout: "display_name": "Mr.bar.client.0", 2024-09-12T00:46:09.769 INFO:teuthology.orchestra.run.smithi043.stdout: "email": "bar+test@test.test", 2024-09-12T00:46:09.769 INFO:teuthology.orchestra.run.smithi043.stdout: "suspended": 0, 2024-09-12T00:46:09.769 INFO:teuthology.orchestra.run.smithi043.stdout: "max_buckets": 1000, 2024-09-12T00:46:09.770 INFO:teuthology.orchestra.run.smithi043.stdout: "subusers": [], 2024-09-12T00:46:09.770 INFO:teuthology.orchestra.run.smithi043.stdout: "keys": [ 2024-09-12T00:46:09.770 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T00:46:09.770 INFO:teuthology.orchestra.run.smithi043.stdout: "user": "bar.client.0", 2024-09-12T00:46:09.770 INFO:teuthology.orchestra.run.smithi043.stdout: "access_key": "ZBLCTWHOXHWATIKGPQEG", 2024-09-12T00:46:09.770 INFO:teuthology.orchestra.run.smithi043.stdout: "secret_key": "aB0Y/gpGZFvUwhfN831CLyiU852XV361S6UDOWgtmPz/MMhDoI+mIg==", 2024-09-12T00:46:09.770 INFO:teuthology.orchestra.run.smithi043.stdout: "active": true, 2024-09-12T00:46:09.770 INFO:teuthology.orchestra.run.smithi043.stdout: "create_date": "2024-09-12T00:46:09.760270Z" 2024-09-12T00:46:09.770 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T00:46:09.770 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-12T00:46:09.770 INFO:teuthology.orchestra.run.smithi043.stdout: "swift_keys": [], 2024-09-12T00:46:09.770 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": [], 2024-09-12T00:46:09.770 INFO:teuthology.orchestra.run.smithi043.stdout: "op_mask": "read, write, delete", 2024-09-12T00:46:09.771 INFO:teuthology.orchestra.run.smithi043.stdout: "default_placement": "", 2024-09-12T00:46:09.771 INFO:teuthology.orchestra.run.smithi043.stdout: "default_storage_class": "", 2024-09-12T00:46:09.771 INFO:teuthology.orchestra.run.smithi043.stdout: "placement_tags": [], 2024-09-12T00:46:09.771 INFO:teuthology.orchestra.run.smithi043.stdout: "bucket_quota": { 2024-09-12T00:46:09.771 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": false, 2024-09-12T00:46:09.771 INFO:teuthology.orchestra.run.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:46:09.771 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size": -1, 2024-09-12T00:46:09.771 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:46:09.771 INFO:teuthology.orchestra.run.smithi043.stdout: "max_objects": -1 2024-09-12T00:46:09.771 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T00:46:09.771 INFO:teuthology.orchestra.run.smithi043.stdout: "user_quota": { 2024-09-12T00:46:09.771 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": false, 2024-09-12T00:46:09.771 INFO:teuthology.orchestra.run.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:46:09.771 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size": -1, 2024-09-12T00:46:09.772 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:46:09.772 INFO:teuthology.orchestra.run.smithi043.stdout: "max_objects": -1 2024-09-12T00:46:09.772 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T00:46:09.772 INFO:teuthology.orchestra.run.smithi043.stdout: "temp_url_keys": [], 2024-09-12T00:46:09.772 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "rgw", 2024-09-12T00:46:09.772 INFO:teuthology.orchestra.run.smithi043.stdout: "mfa_ids": [], 2024-09-12T00:46:09.772 INFO:teuthology.orchestra.run.smithi043.stdout: "account_id": "", 2024-09-12T00:46:09.772 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-09-12T00:46:09.772 INFO:teuthology.orchestra.run.smithi043.stdout: "create_date": "2024-09-12T00:46:09.760255Z", 2024-09-12T00:46:09.772 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-09-12T00:46:09.772 INFO:teuthology.orchestra.run.smithi043.stdout: "group_ids": [] 2024-09-12T00:46:09.772 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T00:46:09.772 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:09.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.771+0000 7f21a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:09.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.775+0000 7f22f125e9c0 20 remove_watcher() i=0 2024-09-12T00:46:09.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.775+0000 7f22f125e9c0 2 removed watcher, disabling cache 2024-09-12T00:46:09.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.779+0000 7f22f125e9c0 20 remove_watcher() i=1 2024-09-12T00:46:09.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.779+0000 7f22f125e9c0 20 remove_watcher() i=2 2024-09-12T00:46:09.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.783+0000 7f22f125e9c0 20 remove_watcher() i=3 2024-09-12T00:46:09.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.783+0000 7f22f125e9c0 20 remove_watcher() i=4 2024-09-12T00:46:09.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.787+0000 7f22f125e9c0 20 remove_watcher() i=5 2024-09-12T00:46:09.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.787+0000 7f22f125e9c0 20 remove_watcher() i=6 2024-09-12T00:46:09.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.787+0000 7f22f125e9c0 20 remove_watcher() i=7 2024-09-12T00:46:09.803 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 1649027623 --totp-seed QUOLPU2QCB6KWN3E7Q75PQWOWZHV73VWLDOLYAHU3PGCFBHJJ4CRGB3VQNHO6VZF --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:46:09.844 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:09.844 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:09.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.883+0000 7fa53ec549c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:09.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.887+0000 7fa53ec549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:09.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.887+0000 7fa53ec549c0 20 realm 2024-09-12T00:46:09.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.887+0000 7fa53ec549c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:09.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.887+0000 7fa53ec549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:09.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.887+0000 7fa53ec549c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:09.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.887+0000 7fa53ec549c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:09.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.887+0000 7fa53ec549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:09.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.887+0000 7fa53ec549c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:09.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.887+0000 7fa53ec549c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:09.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.887+0000 7fa53ec549c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:09.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.891+0000 7fa53ec549c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:09.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.891+0000 7fa53ec549c0 20 searching for the correct realm 2024-09-12T00:46:09.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.895+0000 7fa53cf5b640 0 -- 172.21.15.43:0/2800166422 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55f4d29d5e40 msgr2=0x55f4d29d8300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:09.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.903+0000 7fa53bf59640 0 -- 172.21.15.43:0/2800166422 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fa53002b070 msgr2=0x7fa530094540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:09.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.911+0000 7fa53ec549c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:46:09.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.911+0000 7fa53ec549c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:09.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.911+0000 7fa53ec549c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:09.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.911+0000 7fa53ec549c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:46:09.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.911+0000 7fa53ec549c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:09.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.911+0000 7fa53ec549c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:09.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.911+0000 7fa53ec549c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:09.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.911+0000 7fa53ec549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:09.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.911+0000 7fa53ec549c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:09.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.911+0000 7fa53ec549c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:09.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.911+0000 7fa53ec549c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:09.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.911+0000 7fa53ec549c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:09.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.911+0000 7fa53ec549c0 20 zone default found 2024-09-12T00:46:09.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.911+0000 7fa53ec549c0 4 Realm: () 2024-09-12T00:46:09.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.911+0000 7fa53ec549c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:46:09.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.911+0000 7fa53ec549c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:46:09.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.911+0000 7fa53ec549c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:09.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.911+0000 7fa53ec549c0 20 zonegroup default 2024-09-12T00:46:09.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.911+0000 7fa53ec549c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:09.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.911+0000 7fa53ec549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:09.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.911+0000 7fa53ec549c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:09.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.911+0000 7fa53ec549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:09.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.911+0000 7fa53ec549c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:09.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.911+0000 7fa53ec549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:09.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.911+0000 7fa53ec549c0 20 started sync module instance, tier type = 2024-09-12T00:46:09.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.911+0000 7fa53ec549c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:46:09.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.927+0000 7fa53ec549c0 20 add_watcher() i=0 2024-09-12T00:46:09.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.927+0000 7fa53ec549c0 20 add_watcher() i=1 2024-09-12T00:46:09.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.927+0000 7fa53ec549c0 20 add_watcher() i=2 2024-09-12T00:46:09.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.927+0000 7fa53ec549c0 20 add_watcher() i=3 2024-09-12T00:46:09.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.927+0000 7fa53ec549c0 20 add_watcher() i=4 2024-09-12T00:46:09.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.927+0000 7fa53ec549c0 20 add_watcher() i=5 2024-09-12T00:46:09.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.927+0000 7fa53ec549c0 20 add_watcher() i=6 2024-09-12T00:46:09.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.927+0000 7fa53ec549c0 20 add_watcher() i=7 2024-09-12T00:46:09.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.927+0000 7fa53ec549c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:09.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.931+0000 7fa3f2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:09.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.931+0000 7fa53ec549c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:09.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.931+0000 7fa53ec549c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:09.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.931+0000 7fa53ec549c0 5 note: GC not initialized 2024-09-12T00:46:09.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.931+0000 7fa3f1fdb640 20 reqs_thread_entry: start 2024-09-12T00:46:09.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.931+0000 7fa53ec549c0 20 init_complete bucket index max shards: 11 2024-09-12T00:46:09.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.931+0000 7fa53ec549c0 20 Filter name: none 2024-09-12T00:46:09.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.931+0000 7fa3637fe640 20 reqs_thread_entry: start 2024-09-12T00:46:09.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.931+0000 7fa53ec549c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T00:46:09.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.931+0000 7fa53ec549c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:09.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.935+0000 7fa53ec549c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T00:46:09.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.935+0000 7fa53ec549c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-12T00:46:09.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.935+0000 7fa53ec549c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:46:09.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.935+0000 7fa53ec549c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:09.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.939+0000 7fa53ec549c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:46:09.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.939+0000 7fa53ec549c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:46:09.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.939+0000 7fa53ec549c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T00:46:09.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.939+0000 7fa4137fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268175 cookie 94509993976704 notifier 8519 bl.length()=659 2024-09-12T00:46:09.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.939+0000 7fa4137fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:46:09.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.939+0000 7fa4137fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:46:09.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.943+0000 7fa3f2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:09.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.947+0000 7fa53ec549c0 20 remove_watcher() i=0 2024-09-12T00:46:09.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.947+0000 7fa53ec549c0 2 removed watcher, disabling cache 2024-09-12T00:46:09.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.947+0000 7fa53ec549c0 20 remove_watcher() i=1 2024-09-12T00:46:09.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.951+0000 7fa53ec549c0 20 remove_watcher() i=2 2024-09-12T00:46:09.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.951+0000 7fa53ec549c0 20 remove_watcher() i=3 2024-09-12T00:46:09.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.955+0000 7fa53ec549c0 20 remove_watcher() i=4 2024-09-12T00:46:09.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.955+0000 7fa53ec549c0 20 remove_watcher() i=5 2024-09-12T00:46:09.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.959+0000 7fa53ec549c0 20 remove_watcher() i=6 2024-09-12T00:46:09.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:09.959+0000 7fa53ec549c0 20 remove_watcher() i=7 2024-09-12T00:46:09.973 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW33333333333333333 --account-name Mr.RGW33333333333333333 --email RGW33333333333333333+test@test.test --tenant testx 2024-09-12T00:46:10.055 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:10.055 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:10.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.095+0000 7fd7174189c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:10.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.099+0000 7fd7174189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:10.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.099+0000 7fd7174189c0 20 realm 2024-09-12T00:46:10.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.099+0000 7fd7174189c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:10.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.099+0000 7fd7174189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:10.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.099+0000 7fd7174189c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:10.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.099+0000 7fd7174189c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:10.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.099+0000 7fd7174189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:10.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.099+0000 7fd7174189c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:10.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.099+0000 7fd7174189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:10.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.099+0000 7fd7174189c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:10.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.103+0000 7fd7174189c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:10.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.103+0000 7fd7174189c0 20 searching for the correct realm 2024-09-12T00:46:10.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.107+0000 7fd71471d640 0 -- 172.21.15.43:0/998326519 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x5593ec899d90 msgr2=0x5593ec89c220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:10.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.115+0000 7fd71471d640 0 -- 172.21.15.43:0/998326519 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fd708010c20 msgr2=0x7fd708038920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:10.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.123+0000 7fd7174189c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:46:10.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.123+0000 7fd7174189c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:10.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.123+0000 7fd7174189c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:10.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.123+0000 7fd7174189c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:46:10.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.123+0000 7fd7174189c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:10.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.123+0000 7fd7174189c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:10.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.123+0000 7fd7174189c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:10.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.123+0000 7fd7174189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:10.124 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.123+0000 7fd7174189c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:10.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.123+0000 7fd7174189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:10.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.123+0000 7fd7174189c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:10.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.123+0000 7fd7174189c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:10.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.123+0000 7fd7174189c0 20 zone default found 2024-09-12T00:46:10.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.123+0000 7fd7174189c0 4 Realm: () 2024-09-12T00:46:10.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.123+0000 7fd7174189c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:46:10.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.123+0000 7fd7174189c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:46:10.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.123+0000 7fd7174189c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:10.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.123+0000 7fd7174189c0 20 zonegroup default 2024-09-12T00:46:10.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.123+0000 7fd7174189c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:10.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.123+0000 7fd7174189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:10.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.123+0000 7fd7174189c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:10.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.127+0000 7fd7174189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:10.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.127+0000 7fd7174189c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:10.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.127+0000 7fd7174189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:10.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.127+0000 7fd7174189c0 20 started sync module instance, tier type = 2024-09-12T00:46:10.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.127+0000 7fd7174189c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:46:10.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.143+0000 7fd7174189c0 20 add_watcher() i=0 2024-09-12T00:46:10.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.143+0000 7fd7174189c0 20 add_watcher() i=1 2024-09-12T00:46:10.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.143+0000 7fd7174189c0 20 add_watcher() i=2 2024-09-12T00:46:10.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.143+0000 7fd7174189c0 20 add_watcher() i=3 2024-09-12T00:46:10.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.143+0000 7fd7174189c0 20 add_watcher() i=4 2024-09-12T00:46:10.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.143+0000 7fd7174189c0 20 add_watcher() i=5 2024-09-12T00:46:10.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.143+0000 7fd7174189c0 20 add_watcher() i=6 2024-09-12T00:46:10.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.143+0000 7fd7174189c0 20 add_watcher() i=7 2024-09-12T00:46:10.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.143+0000 7fd7174189c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:10.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.147+0000 7fd5cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:10.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.147+0000 7fd7174189c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:10.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.147+0000 7fd7174189c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:10.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.147+0000 7fd7174189c0 5 note: GC not initialized 2024-09-12T00:46:10.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.147+0000 7fd5ca7e4640 20 reqs_thread_entry: start 2024-09-12T00:46:10.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.147+0000 7fd7174189c0 20 init_complete bucket index max shards: 11 2024-09-12T00:46:10.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.147+0000 7fd7174189c0 20 Filter name: none 2024-09-12T00:46:10.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.147+0000 7fd5c37fe640 20 reqs_thread_entry: start 2024-09-12T00:46:10.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.147+0000 7fd7174189c0 10 cache get: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 : miss 2024-09-12T00:46:10.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.147+0000 7fd7174189c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:10.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.147+0000 7fd7174189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:10.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.147+0000 7fd7174189c0 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x0 2024-09-12T00:46:10.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.147+0000 7fd7174189c0 10 adding default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T00:46:10.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.147+0000 7fd7174189c0 20 failed to read name.testx$Mr.RGW33333333333333333 with: (2) No such file or directory 2024-09-12T00:46:10.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.147+0000 7fd7174189c0 10 cache get: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test : miss 2024-09-12T00:46:10.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.147+0000 7fd7174189c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:10.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.147+0000 7fd7174189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:10.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.147+0000 7fd7174189c0 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x0 2024-09-12T00:46:10.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.147+0000 7fd7174189c0 10 adding default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T00:46:10.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.147+0000 7fd7174189c0 20 failed to read rgw33333333333333333+test@test.test with: (2) No such file or directory 2024-09-12T00:46:10.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.151+0000 7fd7174189c0 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T00:46:10.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.151+0000 7fd7174189c0 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T00:46:10.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.151+0000 7fd7174189c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW33333333333333333, ofs0, ns] 2024-09-12T00:46:10.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.151+0000 7fd5ebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268176 cookie 94093817062688 notifier 8534 bl.length()=389 2024-09-12T00:46:10.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.151+0000 7fd5ebfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T00:46:10.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.151+0000 7fd5ebfff640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T00:46:10.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.155+0000 7fd7174189c0 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-12T00:46:10.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.155+0000 7fd7174189c0 10 moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T00:46:10.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.155+0000 7fd7174189c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.testx$Mr.RGW33333333333333333, ofs0, ns] 2024-09-12T00:46:10.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.155+0000 7fd5ebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268192 cookie 94093817067568 notifier 8534 bl.length()=230 2024-09-12T00:46:10.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.155+0000 7fd5ebfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-12T00:46:10.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.155+0000 7fd5ebfff640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T00:46:10.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.159+0000 7fd7174189c0 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-12T00:46:10.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.159+0000 7fd7174189c0 10 moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T00:46:10.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.159+0000 7fd7174189c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw33333333333333333+test@test.test, ofs0, ns] 2024-09-12T00:46:10.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.163+0000 7fd5eb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268131 cookie 94093817066240 notifier 8534 bl.length()=234 2024-09-12T00:46:10.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.163+0000 7fd5eb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-12T00:46:10.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.163+0000 7fd5eb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T00:46:10.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.163+0000 7fd5cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:10.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.167+0000 7fd7174189c0 20 remove_watcher() i=0 2024-09-12T00:46:10.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.167+0000 7fd7174189c0 2 removed watcher, disabling cache 2024-09-12T00:46:10.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.171+0000 7fd7174189c0 20 remove_watcher() i=1 2024-09-12T00:46:10.172 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.171+0000 7fd7174189c0 20 remove_watcher() i=2 2024-09-12T00:46:10.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.175+0000 7fd7174189c0 20 remove_watcher() i=3 2024-09-12T00:46:10.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.175+0000 7fd7174189c0 20 remove_watcher() i=4 2024-09-12T00:46:10.178 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.179+0000 7fd7174189c0 20 remove_watcher() i=5 2024-09-12T00:46:10.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.179+0000 7fd7174189c0 20 remove_watcher() i=6 2024-09-12T00:46:10.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.179+0000 7fd7174189c0 20 remove_watcher() i=7 2024-09-12T00:46:10.195 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T00:46:10.195 INFO:teuthology.orchestra.run.smithi043.stdout: "id": "RGW33333333333333333", 2024-09-12T00:46:10.195 INFO:teuthology.orchestra.run.smithi043.stdout: "tenant": "testx", 2024-09-12T00:46:10.195 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "Mr.RGW33333333333333333", 2024-09-12T00:46:10.195 INFO:teuthology.orchestra.run.smithi043.stdout: "email": "RGW33333333333333333+test@test.test", 2024-09-12T00:46:10.195 INFO:teuthology.orchestra.run.smithi043.stdout: "quota": { 2024-09-12T00:46:10.195 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": false, 2024-09-12T00:46:10.195 INFO:teuthology.orchestra.run.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:46:10.195 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size": -1, 2024-09-12T00:46:10.195 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:46:10.195 INFO:teuthology.orchestra.run.smithi043.stdout: "max_objects": -1 2024-09-12T00:46:10.195 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T00:46:10.196 INFO:teuthology.orchestra.run.smithi043.stdout: "bucket_quota": { 2024-09-12T00:46:10.196 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": false, 2024-09-12T00:46:10.196 INFO:teuthology.orchestra.run.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:46:10.196 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size": -1, 2024-09-12T00:46:10.196 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:46:10.196 INFO:teuthology.orchestra.run.smithi043.stdout: "max_objects": -1 2024-09-12T00:46:10.196 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T00:46:10.196 INFO:teuthology.orchestra.run.smithi043.stdout: "max_users": 1000, 2024-09-12T00:46:10.196 INFO:teuthology.orchestra.run.smithi043.stdout: "max_roles": 1000, 2024-09-12T00:46:10.196 INFO:teuthology.orchestra.run.smithi043.stdout: "max_groups": 1000, 2024-09-12T00:46:10.196 INFO:teuthology.orchestra.run.smithi043.stdout: "max_buckets": 1000, 2024-09-12T00:46:10.196 INFO:teuthology.orchestra.run.smithi043.stdout: "max_access_keys": 4 2024-09-12T00:46:10.196 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T00:46:10.198 DEBUG:tasks.s3tests:Creating user RGW33333333333333333 on client.0 2024-09-12T00:46:10.198 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name Mr.RGW33333333333333333 --email 'testx$tenanteduser+test@test.test' --access-key VLRGQXHIZSTYVXMNLGAY --secret 08N2revpoB2BhzRyTcUbW6NZputXgnmtCKHZeyci9ISCBPxOJOWelw== --cluster ceph --account-id RGW33333333333333333 --account-root 2024-09-12T00:46:10.290 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:10.290 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:10.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.539+0000 7f97da0099c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:10.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.547+0000 7f97da0099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:10.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.547+0000 7f97da0099c0 20 realm 2024-09-12T00:46:10.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.547+0000 7f97da0099c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:10.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.547+0000 7f97da0099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:10.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.547+0000 7f97da0099c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:10.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.547+0000 7f97da0099c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:10.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.547+0000 7f97da0099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:10.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.547+0000 7f97da0099c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:10.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.559+0000 7f97da0099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:10.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.559+0000 7f97da0099c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:10.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.559+0000 7f97da0099c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:10.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.559+0000 7f97da0099c0 20 searching for the correct realm 2024-09-12T00:46:10.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.571+0000 7f97d730e640 0 -- 172.21.15.43:0/3960311054 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f97c0041020 msgr2=0x7f97c0068910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:46:10.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:10.787+0000 7f97d7b0f640 0 -- 172.21.15.43:0/3960311054 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f97c0069ea0 msgr2=0x7f97c0068010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:46:11.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.003+0000 7f97da0099c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:46:11.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.003+0000 7f97da0099c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:11.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.003+0000 7f97da0099c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:11.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.003+0000 7f97da0099c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:46:11.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.003+0000 7f97da0099c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:11.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.003+0000 7f97da0099c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:11.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.003+0000 7f97da0099c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.003+0000 7f97da0099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.007+0000 7f97da0099c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.007+0000 7f97da0099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:11.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.007+0000 7f97da0099c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.007+0000 7f97da0099c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:11.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.007+0000 7f97da0099c0 20 zone default found 2024-09-12T00:46:11.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.007+0000 7f97da0099c0 4 Realm: () 2024-09-12T00:46:11.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.007+0000 7f97da0099c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:46:11.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.007+0000 7f97da0099c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:46:11.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.007+0000 7f97da0099c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:11.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.007+0000 7f97da0099c0 20 zonegroup default 2024-09-12T00:46:11.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.007+0000 7f97da0099c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.007+0000 7f97da0099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.007+0000 7f97da0099c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.007+0000 7f97da0099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.007+0000 7f97da0099c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.011+0000 7f97da0099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.011+0000 7f97da0099c0 20 started sync module instance, tier type = 2024-09-12T00:46:11.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.011+0000 7f97da0099c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:46:11.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.035+0000 7f97da0099c0 20 add_watcher() i=0 2024-09-12T00:46:11.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.035+0000 7f97da0099c0 20 add_watcher() i=1 2024-09-12T00:46:11.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.035+0000 7f97da0099c0 20 add_watcher() i=2 2024-09-12T00:46:11.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.035+0000 7f97da0099c0 20 add_watcher() i=3 2024-09-12T00:46:11.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.035+0000 7f97da0099c0 20 add_watcher() i=4 2024-09-12T00:46:11.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.035+0000 7f97da0099c0 20 add_watcher() i=5 2024-09-12T00:46:11.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.035+0000 7f97da0099c0 20 add_watcher() i=6 2024-09-12T00:46:11.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.035+0000 7f97da0099c0 20 add_watcher() i=7 2024-09-12T00:46:11.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.035+0000 7f97da0099c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:11.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.039+0000 7f968dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:11.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.039+0000 7f97da0099c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:11.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.039+0000 7f97da0099c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:11.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.039+0000 7f97da0099c0 5 note: GC not initialized 2024-09-12T00:46:11.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.039+0000 7f968cfe1640 20 reqs_thread_entry: start 2024-09-12T00:46:11.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.043+0000 7f97da0099c0 20 init_complete bucket index max shards: 11 2024-09-12T00:46:11.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.043+0000 7f97da0099c0 20 Filter name: none 2024-09-12T00:46:11.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.043+0000 7f96067fc640 20 reqs_thread_entry: start 2024-09-12T00:46:11.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.043+0000 7f97da0099c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T00:46:11.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.043+0000 7f97da0099c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.043+0000 7f97da0099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.043+0000 7f97da0099c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-12T00:46:11.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.043+0000 7f97da0099c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:46:11.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.043+0000 7f97da0099c0 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-12T00:46:11.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.043+0000 7f97da0099c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.043+0000 7f97da0099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.043+0000 7f97da0099c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-12T00:46:11.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.043+0000 7f97da0099c0 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T00:46:11.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.043+0000 7f97da0099c0 10 cache get: name=default.rgw.meta+users.keys+VLRGQXHIZSTYVXMNLGAY : miss 2024-09-12T00:46:11.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.043+0000 7f97da0099c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.043+0000 7f97da0099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.043+0000 7f97da0099c0 10 cache put: name=default.rgw.meta+users.keys+VLRGQXHIZSTYVXMNLGAY info.flags=0x0 2024-09-12T00:46:11.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.043+0000 7f97da0099c0 10 adding default.rgw.meta+users.keys+VLRGQXHIZSTYVXMNLGAY to cache LRU end 2024-09-12T00:46:11.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.043+0000 7f97da0099c0 10 cache get: name=default.rgw.meta+accounts+account.RGW33333333333333333 : miss 2024-09-12T00:46:11.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.043+0000 7f97da0099c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.047+0000 7f97da0099c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:46:11.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.047+0000 7f97da0099c0 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T00:46:11.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.047+0000 7f97da0099c0 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T00:46:11.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.047+0000 7f97da0099c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:11.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.047+0000 7f97da0099c0 10 cache get: name=default.rgw.meta+users.keys+VLRGQXHIZSTYVXMNLGAY : hit (negative entry) 2024-09-12T00:46:11.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.047+0000 7f97da0099c0 10 cache get: name=default.rgw.meta+users.keys+VLRGQXHIZSTYVXMNLGAY : hit (negative entry) 2024-09-12T00:46:11.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.047+0000 7f97da0099c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:46:11.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.047+0000 7f97da0099c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:46:11.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.047+0000 7f97da0099c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T00:46:11.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.047+0000 7f96b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235544 cookie 94769199238880 notifier 8552 bl.length()=732 2024-09-12T00:46:11.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.047+0000 7f96b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:46:11.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.047+0000 7f96b6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:46:11.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.051+0000 7f97da0099c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T00:46:11.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.051+0000 7f97da0099c0 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T00:46:11.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.051+0000 7f97da0099c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-12T00:46:11.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.051+0000 7f96b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235421 cookie 94769199245072 notifier 8552 bl.length()=215 2024-09-12T00:46:11.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.051+0000 7f96b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T00:46:11.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.051+0000 7f96b6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T00:46:11.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.055+0000 7f97da0099c0 10 cache put: name=default.rgw.meta+users.keys+VLRGQXHIZSTYVXMNLGAY info.flags=0x7 2024-09-12T00:46:11.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.055+0000 7f97da0099c0 10 moving default.rgw.meta+users.keys+VLRGQXHIZSTYVXMNLGAY to cache LRU end 2024-09-12T00:46:11.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.055+0000 7f97da0099c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:VLRGQXHIZSTYVXMNLGAY, ofs0, ns] 2024-09-12T00:46:11.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.059+0000 7f96b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235475 cookie 94769199220832 notifier 8552 bl.length()=201 2024-09-12T00:46:11.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.059+0000 7f96b67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+VLRGQXHIZSTYVXMNLGAY info.flags=0x7 2024-09-12T00:46:11.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.059+0000 7f96b67fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+VLRGQXHIZSTYVXMNLGAY to cache LRU end 2024-09-12T00:46:11.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.059+0000 7f97da0099c0 20 linked user testx$tenanteduser.client.0 to account RGW33333333333333333 2024-09-12T00:46:11.061 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T00:46:11.061 INFO:teuthology.orchestra.run.smithi043.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-12T00:46:11.061 INFO:teuthology.orchestra.run.smithi043.stdout: "display_name": "Mr.RGW33333333333333333", 2024-09-12T00:46:11.061 INFO:teuthology.orchestra.run.smithi043.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-12T00:46:11.061 INFO:teuthology.orchestra.run.smithi043.stdout: "suspended": 0, 2024-09-12T00:46:11.061 INFO:teuthology.orchestra.run.smithi043.stdout: "max_buckets": 1000, 2024-09-12T00:46:11.061 INFO:teuthology.orchestra.run.smithi043.stdout: "subusers": [], 2024-09-12T00:46:11.061 INFO:teuthology.orchestra.run.smithi043.stdout: "keys": [ 2024-09-12T00:46:11.061 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T00:46:11.062 INFO:teuthology.orchestra.run.smithi043.stdout: "user": "testx$tenanteduser.client.0", 2024-09-12T00:46:11.062 INFO:teuthology.orchestra.run.smithi043.stdout: "access_key": "VLRGQXHIZSTYVXMNLGAY", 2024-09-12T00:46:11.062 INFO:teuthology.orchestra.run.smithi043.stdout: "secret_key": "08N2revpoB2BhzRyTcUbW6NZputXgnmtCKHZeyci9ISCBPxOJOWelw==", 2024-09-12T00:46:11.062 INFO:teuthology.orchestra.run.smithi043.stdout: "active": true, 2024-09-12T00:46:11.062 INFO:teuthology.orchestra.run.smithi043.stdout: "create_date": "2024-09-12T00:46:11.049658Z" 2024-09-12T00:46:11.062 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T00:46:11.062 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-12T00:46:11.062 INFO:teuthology.orchestra.run.smithi043.stdout: "swift_keys": [], 2024-09-12T00:46:11.062 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": [], 2024-09-12T00:46:11.062 INFO:teuthology.orchestra.run.smithi043.stdout: "op_mask": "read, write, delete", 2024-09-12T00:46:11.062 INFO:teuthology.orchestra.run.smithi043.stdout: "default_placement": "", 2024-09-12T00:46:11.062 INFO:teuthology.orchestra.run.smithi043.stdout: "default_storage_class": "", 2024-09-12T00:46:11.062 INFO:teuthology.orchestra.run.smithi043.stdout: "placement_tags": [], 2024-09-12T00:46:11.062 INFO:teuthology.orchestra.run.smithi043.stdout: "bucket_quota": { 2024-09-12T00:46:11.063 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": false, 2024-09-12T00:46:11.063 INFO:teuthology.orchestra.run.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:46:11.063 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size": -1, 2024-09-12T00:46:11.063 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:46:11.063 INFO:teuthology.orchestra.run.smithi043.stdout: "max_objects": -1 2024-09-12T00:46:11.063 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T00:46:11.063 INFO:teuthology.orchestra.run.smithi043.stdout: "user_quota": { 2024-09-12T00:46:11.063 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": false, 2024-09-12T00:46:11.063 INFO:teuthology.orchestra.run.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:46:11.063 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size": -1, 2024-09-12T00:46:11.063 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:46:11.063 INFO:teuthology.orchestra.run.smithi043.stdout: "max_objects": -1 2024-09-12T00:46:11.063 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T00:46:11.063 INFO:teuthology.orchestra.run.smithi043.stdout: "temp_url_keys": [], 2024-09-12T00:46:11.064 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "root", 2024-09-12T00:46:11.064 INFO:teuthology.orchestra.run.smithi043.stdout: "mfa_ids": [], 2024-09-12T00:46:11.064 INFO:teuthology.orchestra.run.smithi043.stdout: "account_id": "RGW33333333333333333", 2024-09-12T00:46:11.064 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-09-12T00:46:11.064 INFO:teuthology.orchestra.run.smithi043.stdout: "create_date": "2024-09-12T00:46:11.049619Z", 2024-09-12T00:46:11.064 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-09-12T00:46:11.064 INFO:teuthology.orchestra.run.smithi043.stdout: "group_ids": [] 2024-09-12T00:46:11.064 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T00:46:11.064 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:11.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.063+0000 7f968dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:11.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.067+0000 7f97da0099c0 20 remove_watcher() i=0 2024-09-12T00:46:11.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.067+0000 7f97da0099c0 2 removed watcher, disabling cache 2024-09-12T00:46:11.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.071+0000 7f97da0099c0 20 remove_watcher() i=1 2024-09-12T00:46:11.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.071+0000 7f97da0099c0 20 remove_watcher() i=2 2024-09-12T00:46:11.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.075+0000 7f97da0099c0 20 remove_watcher() i=3 2024-09-12T00:46:11.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.075+0000 7f97da0099c0 20 remove_watcher() i=4 2024-09-12T00:46:11.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.079+0000 7f97da0099c0 20 remove_watcher() i=5 2024-09-12T00:46:11.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.079+0000 7f97da0099c0 20 remove_watcher() i=6 2024-09-12T00:46:11.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.083+0000 7f97da0099c0 20 remove_watcher() i=7 2024-09-12T00:46:11.098 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 6020967809 --totp-seed R5UCP5KRG3JJEHBG2RAZBN3B2PPWOBEC52GTMADA357ERMCBIXRBJDRNUCJ5FEPW --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:46:11.145 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:11.146 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:11.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.187+0000 7f6050af19c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.187+0000 7f6050af19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.187+0000 7f6050af19c0 20 realm 2024-09-12T00:46:11.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.187+0000 7f6050af19c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.187+0000 7f6050af19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.187+0000 7f6050af19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:11.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.187+0000 7f6050af19c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.187+0000 7f6050af19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.187+0000 7f6050af19c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.191+0000 7f6050af19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:11.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.191+0000 7f6050af19c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.191+0000 7f6050af19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:11.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.191+0000 7f6050af19c0 20 searching for the correct realm 2024-09-12T00:46:11.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.195+0000 7f604ddf6640 0 -- 172.21.15.43:0/3689565808 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f604405dc00 msgr2=0x7f6044082af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:11.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.411+0000 7f604e5f7640 0 -- 172.21.15.43:0/3689565808 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f6044090320 msgr2=0x7f604407e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:11.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.627+0000 7f6050af19c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:46:11.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.631+0000 7f6050af19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:11.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.631+0000 7f6050af19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:11.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.631+0000 7f6050af19c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:46:11.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.631+0000 7f6050af19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:11.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.631+0000 7f6050af19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:11.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.631+0000 7f6050af19c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.631+0000 7f6050af19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.631+0000 7f6050af19c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.631+0000 7f6050af19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:11.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.631+0000 7f6050af19c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.631+0000 7f6050af19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:11.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.631+0000 7f6050af19c0 20 zone default found 2024-09-12T00:46:11.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.631+0000 7f6050af19c0 4 Realm: () 2024-09-12T00:46:11.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.631+0000 7f6050af19c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:46:11.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.631+0000 7f6050af19c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:46:11.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.631+0000 7f6050af19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:11.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.631+0000 7f6050af19c0 20 zonegroup default 2024-09-12T00:46:11.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.631+0000 7f6050af19c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.631+0000 7f6050af19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.631+0000 7f6050af19c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.635+0000 7f6050af19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.635+0000 7f6050af19c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.635+0000 7f6050af19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.635+0000 7f6050af19c0 20 started sync module instance, tier type = 2024-09-12T00:46:11.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.635+0000 7f6050af19c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:46:11.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.655+0000 7f6050af19c0 20 add_watcher() i=0 2024-09-12T00:46:11.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.655+0000 7f6050af19c0 20 add_watcher() i=1 2024-09-12T00:46:11.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.655+0000 7f6050af19c0 20 add_watcher() i=2 2024-09-12T00:46:11.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.655+0000 7f6050af19c0 20 add_watcher() i=3 2024-09-12T00:46:11.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.655+0000 7f6050af19c0 20 add_watcher() i=4 2024-09-12T00:46:11.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.655+0000 7f6050af19c0 20 add_watcher() i=5 2024-09-12T00:46:11.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.655+0000 7f6050af19c0 20 add_watcher() i=6 2024-09-12T00:46:11.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.659+0000 7f6050af19c0 20 add_watcher() i=7 2024-09-12T00:46:11.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.659+0000 7f6050af19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:11.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.663+0000 7f5f057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:11.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.663+0000 7f6050af19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:11.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.663+0000 7f6050af19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:11.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.663+0000 7f6050af19c0 5 note: GC not initialized 2024-09-12T00:46:11.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.663+0000 7f5eff7fe640 20 reqs_thread_entry: start 2024-09-12T00:46:11.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.663+0000 7f6050af19c0 20 init_complete bucket index max shards: 11 2024-09-12T00:46:11.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.663+0000 7f6050af19c0 20 Filter name: none 2024-09-12T00:46:11.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.663+0000 7f5efd7fa640 20 reqs_thread_entry: start 2024-09-12T00:46:11.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.663+0000 7f6050af19c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T00:46:11.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.667+0000 7f6050af19c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.667+0000 7f6050af19c0 20 rados_obj.operate() r=0 bl.length=532 2024-09-12T00:46:11.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.667+0000 7f6050af19c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-12T00:46:11.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.667+0000 7f6050af19c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:46:11.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.667+0000 7f6050af19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:11.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.671+0000 7f6050af19c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:46:11.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.671+0000 7f6050af19c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:46:11.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.671+0000 7f6050af19c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T00:46:11.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.671+0000 7f5f31ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235545 cookie 94080144286976 notifier 9048 bl.length()=746 2024-09-12T00:46:11.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.671+0000 7f5f31ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:46:11.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.671+0000 7f5f31ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:46:11.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.675+0000 7f5f057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:11.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.679+0000 7f6050af19c0 20 remove_watcher() i=0 2024-09-12T00:46:11.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.679+0000 7f6050af19c0 2 removed watcher, disabling cache 2024-09-12T00:46:11.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.683+0000 7f6050af19c0 20 remove_watcher() i=1 2024-09-12T00:46:11.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.683+0000 7f6050af19c0 20 remove_watcher() i=2 2024-09-12T00:46:11.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.687+0000 7f6050af19c0 20 remove_watcher() i=3 2024-09-12T00:46:11.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.691+0000 7f6050af19c0 20 remove_watcher() i=4 2024-09-12T00:46:11.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.691+0000 7f6050af19c0 20 remove_watcher() i=5 2024-09-12T00:46:11.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.691+0000 7f6050af19c0 20 remove_watcher() i=6 2024-09-12T00:46:11.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.695+0000 7f6050af19c0 20 remove_watcher() i=7 2024-09-12T00:46:11.712 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-12T00:46:11.712 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key JNWPQKVNSJENZGMDHZCC --secret uMSZpCDEPu4XevsuXq4cxLdeJF6jLwMvE0CJmPHVM/l7HqS8UNg4IQ== --cluster ceph 2024-09-12T00:46:11.753 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:11.753 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:11.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.795+0000 7fbd20d739c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.795+0000 7fbd20d739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.795+0000 7fbd20d739c0 20 realm 2024-09-12T00:46:11.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.795+0000 7fbd20d739c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.795+0000 7fbd20d739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.795+0000 7fbd20d739c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:11.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.795+0000 7fbd20d739c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.795+0000 7fbd20d739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.795+0000 7fbd20d739c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.799+0000 7fbd20d739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:11.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.799+0000 7fbd20d739c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.799+0000 7fbd20d739c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:11.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.799+0000 7fbd20d739c0 20 searching for the correct realm 2024-09-12T00:46:11.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.803+0000 7fbd1e078640 0 -- 172.21.15.43:0/2754368136 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fbd081382b0 msgr2=0x7fbd0810a7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:11.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.811+0000 7fbd1e078640 0 -- 172.21.15.43:0/2754368136 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fbbe80818e0 msgr2=0x7fbbe8083d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:11.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.819+0000 7fbd20d739c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:46:11.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.819+0000 7fbd20d739c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:11.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.819+0000 7fbd20d739c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:11.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.819+0000 7fbd20d739c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:46:11.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.819+0000 7fbd20d739c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:11.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.819+0000 7fbd20d739c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:11.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.819+0000 7fbd20d739c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.819+0000 7fbd20d739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.819+0000 7fbd20d739c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.819+0000 7fbd20d739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:11.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.819+0000 7fbd20d739c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.819+0000 7fbd20d739c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:11.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.819+0000 7fbd20d739c0 20 zone default found 2024-09-12T00:46:11.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.819+0000 7fbd20d739c0 4 Realm: () 2024-09-12T00:46:11.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.819+0000 7fbd20d739c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:46:11.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.819+0000 7fbd20d739c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:46:11.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.819+0000 7fbd20d739c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:11.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.819+0000 7fbd20d739c0 20 zonegroup default 2024-09-12T00:46:11.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.819+0000 7fbd20d739c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.819+0000 7fbd20d739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.819+0000 7fbd20d739c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.819+0000 7fbd20d739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.819+0000 7fbd20d739c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.819+0000 7fbd20d739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.819+0000 7fbd20d739c0 20 started sync module instance, tier type = 2024-09-12T00:46:11.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.819+0000 7fbd20d739c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:46:11.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.835+0000 7fbd20d739c0 20 add_watcher() i=0 2024-09-12T00:46:11.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.835+0000 7fbd20d739c0 20 add_watcher() i=1 2024-09-12T00:46:11.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.835+0000 7fbd20d739c0 20 add_watcher() i=2 2024-09-12T00:46:11.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.835+0000 7fbd20d739c0 20 add_watcher() i=3 2024-09-12T00:46:11.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.835+0000 7fbd20d739c0 20 add_watcher() i=4 2024-09-12T00:46:11.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.835+0000 7fbd20d739c0 20 add_watcher() i=5 2024-09-12T00:46:11.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.835+0000 7fbd20d739c0 20 add_watcher() i=6 2024-09-12T00:46:11.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.839+0000 7fbd20d739c0 20 add_watcher() i=7 2024-09-12T00:46:11.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.839+0000 7fbd20d739c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:11.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.839+0000 7fbbd57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:11.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.839+0000 7fbd20d739c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:11.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.839+0000 7fbd20d739c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:11.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.839+0000 7fbd20d739c0 5 note: GC not initialized 2024-09-12T00:46:11.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.839+0000 7fbb4ffff640 20 reqs_thread_entry: start 2024-09-12T00:46:11.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.839+0000 7fbd20d739c0 20 init_complete bucket index max shards: 11 2024-09-12T00:46:11.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.839+0000 7fbd20d739c0 20 Filter name: none 2024-09-12T00:46:11.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.839+0000 7fbb4dffb640 20 reqs_thread_entry: start 2024-09-12T00:46:11.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.839+0000 7fbd20d739c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T00:46:11.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.839+0000 7fbd20d739c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.839+0000 7fbd20d739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.839+0000 7fbd20d739c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-12T00:46:11.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.839+0000 7fbd20d739c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:46:11.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.839+0000 7fbd20d739c0 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-12T00:46:11.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.839+0000 7fbd20d739c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.843+0000 7fbd20d739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.843+0000 7fbd20d739c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-12T00:46:11.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.843+0000 7fbd20d739c0 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T00:46:11.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.843+0000 7fbd20d739c0 10 cache get: name=default.rgw.meta+users.keys+JNWPQKVNSJENZGMDHZCC : miss 2024-09-12T00:46:11.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.843+0000 7fbd20d739c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.843+0000 7fbd20d739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.843+0000 7fbd20d739c0 10 cache put: name=default.rgw.meta+users.keys+JNWPQKVNSJENZGMDHZCC info.flags=0x0 2024-09-12T00:46:11.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.843+0000 7fbd20d739c0 10 adding default.rgw.meta+users.keys+JNWPQKVNSJENZGMDHZCC to cache LRU end 2024-09-12T00:46:11.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.843+0000 7fbd20d739c0 10 cache get: name=default.rgw.meta+users.keys+JNWPQKVNSJENZGMDHZCC : hit (negative entry) 2024-09-12T00:46:11.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.843+0000 7fbd20d739c0 10 cache get: name=default.rgw.meta+users.keys+JNWPQKVNSJENZGMDHZCC : hit (negative entry) 2024-09-12T00:46:11.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.843+0000 7fbd20d739c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:46:11.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.843+0000 7fbd20d739c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:46:11.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.843+0000 7fbd20d739c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T00:46:11.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.843+0000 7fbc027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235422 cookie 94583011722224 notifier 8585 bl.length()=660 2024-09-12T00:46:11.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.843+0000 7fbc027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:46:11.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.843+0000 7fbc027fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:46:11.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.847+0000 7fbd20d739c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T00:46:11.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.847+0000 7fbd20d739c0 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T00:46:11.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.847+0000 7fbd20d739c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-12T00:46:11.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.847+0000 7fbc01ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235473 cookie 94583011707488 notifier 8585 bl.length()=191 2024-09-12T00:46:11.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.847+0000 7fbc01ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T00:46:11.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.847+0000 7fbc01ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T00:46:11.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.851+0000 7fbd20d739c0 10 cache put: name=default.rgw.meta+users.keys+JNWPQKVNSJENZGMDHZCC info.flags=0x7 2024-09-12T00:46:11.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.851+0000 7fbd20d739c0 10 moving default.rgw.meta+users.keys+JNWPQKVNSJENZGMDHZCC to cache LRU end 2024-09-12T00:46:11.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.851+0000 7fbd20d739c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:JNWPQKVNSJENZGMDHZCC, ofs0, ns] 2024-09-12T00:46:11.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.851+0000 7fbc01ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235489 cookie 94583011700128 notifier 8585 bl.length()=189 2024-09-12T00:46:11.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.851+0000 7fbc01ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+JNWPQKVNSJENZGMDHZCC info.flags=0x7 2024-09-12T00:46:11.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.851+0000 7fbc01ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+JNWPQKVNSJENZGMDHZCC to cache LRU end 2024-09-12T00:46:11.852 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T00:46:11.853 INFO:teuthology.orchestra.run.smithi043.stdout: "user_id": "foobar.client.0", 2024-09-12T00:46:11.853 INFO:teuthology.orchestra.run.smithi043.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T00:46:11.853 INFO:teuthology.orchestra.run.smithi043.stdout: "email": "foobar+test@test.test", 2024-09-12T00:46:11.853 INFO:teuthology.orchestra.run.smithi043.stdout: "suspended": 0, 2024-09-12T00:46:11.853 INFO:teuthology.orchestra.run.smithi043.stdout: "max_buckets": 1000, 2024-09-12T00:46:11.853 INFO:teuthology.orchestra.run.smithi043.stdout: "subusers": [], 2024-09-12T00:46:11.853 INFO:teuthology.orchestra.run.smithi043.stdout: "keys": [ 2024-09-12T00:46:11.853 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T00:46:11.853 INFO:teuthology.orchestra.run.smithi043.stdout: "user": "foobar.client.0", 2024-09-12T00:46:11.853 INFO:teuthology.orchestra.run.smithi043.stdout: "access_key": "JNWPQKVNSJENZGMDHZCC", 2024-09-12T00:46:11.853 INFO:teuthology.orchestra.run.smithi043.stdout: "secret_key": "uMSZpCDEPu4XevsuXq4cxLdeJF6jLwMvE0CJmPHVM/l7HqS8UNg4IQ==", 2024-09-12T00:46:11.853 INFO:teuthology.orchestra.run.smithi043.stdout: "active": true, 2024-09-12T00:46:11.853 INFO:teuthology.orchestra.run.smithi043.stdout: "create_date": "2024-09-12T00:46:11.845871Z" 2024-09-12T00:46:11.854 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T00:46:11.854 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-12T00:46:11.854 INFO:teuthology.orchestra.run.smithi043.stdout: "swift_keys": [], 2024-09-12T00:46:11.854 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": [], 2024-09-12T00:46:11.854 INFO:teuthology.orchestra.run.smithi043.stdout: "op_mask": "read, write, delete", 2024-09-12T00:46:11.854 INFO:teuthology.orchestra.run.smithi043.stdout: "default_placement": "", 2024-09-12T00:46:11.854 INFO:teuthology.orchestra.run.smithi043.stdout: "default_storage_class": "", 2024-09-12T00:46:11.854 INFO:teuthology.orchestra.run.smithi043.stdout: "placement_tags": [], 2024-09-12T00:46:11.854 INFO:teuthology.orchestra.run.smithi043.stdout: "bucket_quota": { 2024-09-12T00:46:11.854 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": false, 2024-09-12T00:46:11.854 INFO:teuthology.orchestra.run.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:46:11.854 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size": -1, 2024-09-12T00:46:11.854 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:46:11.855 INFO:teuthology.orchestra.run.smithi043.stdout: "max_objects": -1 2024-09-12T00:46:11.855 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T00:46:11.855 INFO:teuthology.orchestra.run.smithi043.stdout: "user_quota": { 2024-09-12T00:46:11.855 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": false, 2024-09-12T00:46:11.855 INFO:teuthology.orchestra.run.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:46:11.855 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size": -1, 2024-09-12T00:46:11.855 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:46:11.855 INFO:teuthology.orchestra.run.smithi043.stdout: "max_objects": -1 2024-09-12T00:46:11.855 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T00:46:11.855 INFO:teuthology.orchestra.run.smithi043.stdout: "temp_url_keys": [], 2024-09-12T00:46:11.855 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "rgw", 2024-09-12T00:46:11.855 INFO:teuthology.orchestra.run.smithi043.stdout: "mfa_ids": [], 2024-09-12T00:46:11.855 INFO:teuthology.orchestra.run.smithi043.stdout: "account_id": "", 2024-09-12T00:46:11.855 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-09-12T00:46:11.855 INFO:teuthology.orchestra.run.smithi043.stdout: "create_date": "2024-09-12T00:46:11.845853Z", 2024-09-12T00:46:11.855 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-09-12T00:46:11.856 INFO:teuthology.orchestra.run.smithi043.stdout: "group_ids": [] 2024-09-12T00:46:11.856 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T00:46:11.856 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:11.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.855+0000 7fbbd57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:11.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.859+0000 7fbd20d739c0 20 remove_watcher() i=0 2024-09-12T00:46:11.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.859+0000 7fbd20d739c0 2 removed watcher, disabling cache 2024-09-12T00:46:11.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.859+0000 7fbd20d739c0 20 remove_watcher() i=1 2024-09-12T00:46:11.862 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.863+0000 7fbd20d739c0 20 remove_watcher() i=2 2024-09-12T00:46:11.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.863+0000 7fbd20d739c0 20 remove_watcher() i=3 2024-09-12T00:46:11.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.867+0000 7fbd20d739c0 20 remove_watcher() i=4 2024-09-12T00:46:11.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.867+0000 7fbd20d739c0 20 remove_watcher() i=5 2024-09-12T00:46:11.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.871+0000 7fbd20d739c0 20 remove_watcher() i=6 2024-09-12T00:46:11.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:11.871+0000 7fbd20d739c0 20 remove_watcher() i=7 2024-09-12T00:46:11.885 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 6196395724 --totp-seed VJ44LIDCXJGJCO4DO245FYQE55ATHHM24TMLU36DC7EQ5MG5MA7FV6GRFJVVXCP5 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:46:11.970 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:11.970 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:12.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.015+0000 7fdc6c6e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.015+0000 7fdc6c6e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.015+0000 7fdc6c6e89c0 20 realm 2024-09-12T00:46:12.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.015+0000 7fdc6c6e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.015+0000 7fdc6c6e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.015+0000 7fdc6c6e89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:12.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.015+0000 7fdc6c6e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.015+0000 7fdc6c6e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.015+0000 7fdc6c6e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.019+0000 7fdc6c6e89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:12.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.019+0000 7fdc6c6e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.019+0000 7fdc6c6e89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:12.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.019+0000 7fdc6c6e89c0 20 searching for the correct realm 2024-09-12T00:46:12.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.023+0000 7fdc6a9ef640 0 -- 172.21.15.43:0/1680165254 >> [v2:172.21.15.43:6808/2258408181,v1:172.21.15.43:6809/2258408181] conn(0x56059081a100 msgr2=0x56059081c5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:12.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.031+0000 7fdc6a1ee640 0 -- 172.21.15.43:0/1680165254 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fdc6003c910 msgr2=0x7fdc600533f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:46:12.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.039+0000 7fdc6c6e89c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:46:12.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.039+0000 7fdc6c6e89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:12.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.039+0000 7fdc6c6e89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:12.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.039+0000 7fdc6c6e89c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:46:12.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.039+0000 7fdc6c6e89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:12.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.039+0000 7fdc6c6e89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:12.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.039+0000 7fdc6c6e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.039+0000 7fdc6c6e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.039+0000 7fdc6c6e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.039+0000 7fdc6c6e89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:12.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.039+0000 7fdc6c6e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.039+0000 7fdc6c6e89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:12.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.039+0000 7fdc6c6e89c0 20 zone default found 2024-09-12T00:46:12.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.039+0000 7fdc6c6e89c0 4 Realm: () 2024-09-12T00:46:12.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.039+0000 7fdc6c6e89c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:46:12.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.039+0000 7fdc6c6e89c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:46:12.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.039+0000 7fdc6c6e89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:12.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.039+0000 7fdc6c6e89c0 20 zonegroup default 2024-09-12T00:46:12.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.039+0000 7fdc6c6e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.043+0000 7fdc6c6e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.043+0000 7fdc6c6e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.043+0000 7fdc6c6e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.043+0000 7fdc6c6e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.043+0000 7fdc6c6e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.043+0000 7fdc6c6e89c0 20 started sync module instance, tier type = 2024-09-12T00:46:12.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.043+0000 7fdc6c6e89c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:46:12.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.059+0000 7fdc6c6e89c0 20 add_watcher() i=0 2024-09-12T00:46:12.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.059+0000 7fdc6c6e89c0 20 add_watcher() i=1 2024-09-12T00:46:12.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.059+0000 7fdc6c6e89c0 20 add_watcher() i=2 2024-09-12T00:46:12.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.059+0000 7fdc6c6e89c0 20 add_watcher() i=3 2024-09-12T00:46:12.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.059+0000 7fdc6c6e89c0 20 add_watcher() i=4 2024-09-12T00:46:12.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.059+0000 7fdc6c6e89c0 20 add_watcher() i=5 2024-09-12T00:46:12.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.059+0000 7fdc6c6e89c0 20 add_watcher() i=6 2024-09-12T00:46:12.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.059+0000 7fdc6c6e89c0 20 add_watcher() i=7 2024-09-12T00:46:12.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.059+0000 7fdc6c6e89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:12.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.063+0000 7fdb20fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:12.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.063+0000 7fdc6c6e89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:12.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.063+0000 7fdc6c6e89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:12.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.063+0000 7fdc6c6e89c0 5 note: GC not initialized 2024-09-12T00:46:12.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.063+0000 7fda9b7fe640 20 reqs_thread_entry: start 2024-09-12T00:46:12.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.063+0000 7fdc6c6e89c0 20 init_complete bucket index max shards: 11 2024-09-12T00:46:12.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.063+0000 7fdc6c6e89c0 20 Filter name: none 2024-09-12T00:46:12.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.063+0000 7fda997fa640 20 reqs_thread_entry: start 2024-09-12T00:46:12.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.063+0000 7fdc6c6e89c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T00:46:12.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.063+0000 7fdc6c6e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.063+0000 7fdc6c6e89c0 20 rados_obj.operate() r=0 bl.length=472 2024-09-12T00:46:12.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.063+0000 7fdc6c6e89c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T00:46:12.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.063+0000 7fdc6c6e89c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:46:12.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.063+0000 7fdc6c6e89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:12.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.067+0000 7fdc6c6e89c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:46:12.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.067+0000 7fdc6c6e89c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:46:12.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.067+0000 7fdc6c6e89c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T00:46:12.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.067+0000 7fdb4dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235423 cookie 94581899268912 notifier 9087 bl.length()=674 2024-09-12T00:46:12.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.067+0000 7fdb4dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:46:12.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.067+0000 7fdb4dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:46:12.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.071+0000 7fdb20fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:12.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.075+0000 7fdc6c6e89c0 20 remove_watcher() i=0 2024-09-12T00:46:12.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.075+0000 7fdc6c6e89c0 2 removed watcher, disabling cache 2024-09-12T00:46:12.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.079+0000 7fdc6c6e89c0 20 remove_watcher() i=1 2024-09-12T00:46:12.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.079+0000 7fdc6c6e89c0 20 remove_watcher() i=2 2024-09-12T00:46:12.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.083+0000 7fdc6c6e89c0 20 remove_watcher() i=3 2024-09-12T00:46:12.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.083+0000 7fdc6c6e89c0 20 remove_watcher() i=4 2024-09-12T00:46:12.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.083+0000 7fdc6c6e89c0 20 remove_watcher() i=5 2024-09-12T00:46:12.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.087+0000 7fdc6c6e89c0 20 remove_watcher() i=6 2024-09-12T00:46:12.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.087+0000 7fdc6c6e89c0 20 remove_watcher() i=7 2024-09-12T00:46:12.102 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-12T00:46:12.181 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:12.182 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:12.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.223+0000 7fc338d129c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.227+0000 7fc338d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.227+0000 7fc338d129c0 20 realm 2024-09-12T00:46:12.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.227+0000 7fc338d129c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.227+0000 7fc338d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.227+0000 7fc338d129c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:12.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.227+0000 7fc338d129c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.227+0000 7fc338d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.227+0000 7fc338d129c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.227+0000 7fc338d129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:12.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.227+0000 7fc338d129c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.227+0000 7fc338d129c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:12.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.227+0000 7fc338d129c0 20 searching for the correct realm 2024-09-12T00:46:12.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.235+0000 7fc336818640 0 -- 172.21.15.43:0/3982885612 >> [v2:172.21.15.97:6816/489545787,v1:172.21.15.97:6817/489545787] conn(0x7fc330094c20 msgr2=0x7fc330088440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:12.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.239+0000 7fc336818640 0 -- 172.21.15.43:0/3982885612 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fc328048460 msgr2=0x7fc3280488e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:12.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.455+0000 7fc338d129c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:46:12.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.455+0000 7fc338d129c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:12.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.455+0000 7fc338d129c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:12.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.455+0000 7fc338d129c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:46:12.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.455+0000 7fc338d129c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:12.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.455+0000 7fc338d129c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:12.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.455+0000 7fc338d129c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.459+0000 7fc338d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.459+0000 7fc338d129c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.459+0000 7fc338d129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:12.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.459+0000 7fc338d129c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.459+0000 7fc338d129c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:12.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.459+0000 7fc338d129c0 20 zone default found 2024-09-12T00:46:12.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.459+0000 7fc338d129c0 4 Realm: () 2024-09-12T00:46:12.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.459+0000 7fc338d129c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:46:12.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.459+0000 7fc338d129c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:46:12.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.459+0000 7fc338d129c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:12.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.459+0000 7fc338d129c0 20 zonegroup default 2024-09-12T00:46:12.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.459+0000 7fc338d129c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.459+0000 7fc338d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.459+0000 7fc338d129c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.459+0000 7fc338d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.459+0000 7fc338d129c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.463+0000 7fc338d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.463+0000 7fc338d129c0 20 started sync module instance, tier type = 2024-09-12T00:46:12.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.463+0000 7fc338d129c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:46:12.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.483+0000 7fc338d129c0 20 add_watcher() i=0 2024-09-12T00:46:12.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.483+0000 7fc338d129c0 20 add_watcher() i=1 2024-09-12T00:46:12.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.483+0000 7fc338d129c0 20 add_watcher() i=2 2024-09-12T00:46:12.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.483+0000 7fc338d129c0 20 add_watcher() i=3 2024-09-12T00:46:12.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.483+0000 7fc338d129c0 20 add_watcher() i=4 2024-09-12T00:46:12.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.483+0000 7fc338d129c0 20 add_watcher() i=5 2024-09-12T00:46:12.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.483+0000 7fc338d129c0 20 add_watcher() i=6 2024-09-12T00:46:12.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.487+0000 7fc338d129c0 20 add_watcher() i=7 2024-09-12T00:46:12.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.487+0000 7fc338d129c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:12.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.491+0000 7fc1ed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:12.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.491+0000 7fc338d129c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:12.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.491+0000 7fc338d129c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:12.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.491+0000 7fc338d129c0 5 note: GC not initialized 2024-09-12T00:46:12.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.491+0000 7fc167fff640 20 reqs_thread_entry: start 2024-09-12T00:46:12.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.491+0000 7fc338d129c0 20 init_complete bucket index max shards: 11 2024-09-12T00:46:12.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.491+0000 7fc338d129c0 20 Filter name: none 2024-09-12T00:46:12.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.495+0000 7fc165ffb640 20 reqs_thread_entry: start 2024-09-12T00:46:12.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.495+0000 7fc338d129c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T00:46:12.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.495+0000 7fc338d129c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.495+0000 7fc338d129c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:46:12.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.495+0000 7fc338d129c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T00:46:12.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.495+0000 7fc338d129c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:46:12.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.495+0000 7fc338d129c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:12.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.495+0000 7fc338d129c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:46:12.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.495+0000 7fc338d129c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:46:12.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.495+0000 7fc338d129c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T00:46:12.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.495+0000 7fc21a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235424 cookie 94350406298384 notifier 9105 bl.length()=727 2024-09-12T00:46:12.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.495+0000 7fc21a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:46:12.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.495+0000 7fc21a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:46:12.497 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T00:46:12.497 INFO:teuthology.orchestra.run.smithi043.stdout: "user_id": "foobar.client.0", 2024-09-12T00:46:12.497 INFO:teuthology.orchestra.run.smithi043.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T00:46:12.498 INFO:teuthology.orchestra.run.smithi043.stdout: "email": "foobar+test@test.test", 2024-09-12T00:46:12.498 INFO:teuthology.orchestra.run.smithi043.stdout: "suspended": 0, 2024-09-12T00:46:12.498 INFO:teuthology.orchestra.run.smithi043.stdout: "max_buckets": 1000, 2024-09-12T00:46:12.498 INFO:teuthology.orchestra.run.smithi043.stdout: "subusers": [], 2024-09-12T00:46:12.498 INFO:teuthology.orchestra.run.smithi043.stdout: "keys": [ 2024-09-12T00:46:12.498 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T00:46:12.498 INFO:teuthology.orchestra.run.smithi043.stdout: "user": "foobar.client.0", 2024-09-12T00:46:12.498 INFO:teuthology.orchestra.run.smithi043.stdout: "access_key": "JNWPQKVNSJENZGMDHZCC", 2024-09-12T00:46:12.498 INFO:teuthology.orchestra.run.smithi043.stdout: "secret_key": "uMSZpCDEPu4XevsuXq4cxLdeJF6jLwMvE0CJmPHVM/l7HqS8UNg4IQ==", 2024-09-12T00:46:12.498 INFO:teuthology.orchestra.run.smithi043.stdout: "active": true, 2024-09-12T00:46:12.498 INFO:teuthology.orchestra.run.smithi043.stdout: "create_date": "2024-09-12T00:46:11.845871Z" 2024-09-12T00:46:12.498 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T00:46:12.498 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-12T00:46:12.498 INFO:teuthology.orchestra.run.smithi043.stdout: "swift_keys": [], 2024-09-12T00:46:12.499 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": [ 2024-09-12T00:46:12.499 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T00:46:12.499 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "oidc-provider", 2024-09-12T00:46:12.499 INFO:teuthology.orchestra.run.smithi043.stdout: "perm": "*" 2024-09-12T00:46:12.499 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T00:46:12.499 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T00:46:12.499 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "roles", 2024-09-12T00:46:12.499 INFO:teuthology.orchestra.run.smithi043.stdout: "perm": "*" 2024-09-12T00:46:12.499 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T00:46:12.499 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T00:46:12.499 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "user-policy", 2024-09-12T00:46:12.499 INFO:teuthology.orchestra.run.smithi043.stdout: "perm": "*" 2024-09-12T00:46:12.499 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T00:46:12.499 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-12T00:46:12.500 INFO:teuthology.orchestra.run.smithi043.stdout: "op_mask": "read, write, delete", 2024-09-12T00:46:12.500 INFO:teuthology.orchestra.run.smithi043.stdout: "default_placement": "", 2024-09-12T00:46:12.500 INFO:teuthology.orchestra.run.smithi043.stdout: "default_storage_class": "", 2024-09-12T00:46:12.500 INFO:teuthology.orchestra.run.smithi043.stdout: "placement_tags": [], 2024-09-12T00:46:12.500 INFO:teuthology.orchestra.run.smithi043.stdout: "bucket_quota": { 2024-09-12T00:46:12.500 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": false, 2024-09-12T00:46:12.500 INFO:teuthology.orchestra.run.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:46:12.500 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size": -1, 2024-09-12T00:46:12.500 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:46:12.500 INFO:teuthology.orchestra.run.smithi043.stdout: "max_objects": -1 2024-09-12T00:46:12.500 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T00:46:12.500 INFO:teuthology.orchestra.run.smithi043.stdout: "user_quota": { 2024-09-12T00:46:12.500 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": false, 2024-09-12T00:46:12.500 INFO:teuthology.orchestra.run.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:46:12.501 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size": -1, 2024-09-12T00:46:12.501 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:46:12.501 INFO:teuthology.orchestra.run.smithi043.stdout: "max_objects": -1 2024-09-12T00:46:12.501 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T00:46:12.501 INFO:teuthology.orchestra.run.smithi043.stdout: "temp_url_keys": [], 2024-09-12T00:46:12.501 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "rgw", 2024-09-12T00:46:12.501 INFO:teuthology.orchestra.run.smithi043.stdout: "mfa_ids": [ 2024-09-12T00:46:12.501 INFO:teuthology.orchestra.run.smithi043.stdout: "6196395724" 2024-09-12T00:46:12.501 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-12T00:46:12.501 INFO:teuthology.orchestra.run.smithi043.stdout: "account_id": "", 2024-09-12T00:46:12.501 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-09-12T00:46:12.501 INFO:teuthology.orchestra.run.smithi043.stdout: "create_date": "2024-09-12T00:46:11.845853Z", 2024-09-12T00:46:12.501 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-09-12T00:46:12.502 INFO:teuthology.orchestra.run.smithi043.stdout: "group_ids": [] 2024-09-12T00:46:12.502 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T00:46:12.502 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:12.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.499+0000 7fc1ed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:12.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.503+0000 7fc338d129c0 20 remove_watcher() i=0 2024-09-12T00:46:12.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.503+0000 7fc338d129c0 2 removed watcher, disabling cache 2024-09-12T00:46:12.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.507+0000 7fc338d129c0 20 remove_watcher() i=1 2024-09-12T00:46:12.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.511+0000 7fc338d129c0 20 remove_watcher() i=2 2024-09-12T00:46:12.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.511+0000 7fc338d129c0 20 remove_watcher() i=3 2024-09-12T00:46:12.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.515+0000 7fc338d129c0 20 remove_watcher() i=4 2024-09-12T00:46:12.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.515+0000 7fc338d129c0 20 remove_watcher() i=5 2024-09-12T00:46:12.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.515+0000 7fc338d129c0 20 remove_watcher() i=6 2024-09-12T00:46:12.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.519+0000 7fc338d129c0 20 remove_watcher() i=7 2024-09-12T00:46:12.535 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-12T00:46:12.618 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:12.618 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:12.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.659+0000 7f245b7209c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.659+0000 7f245b7209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.659+0000 7f245b7209c0 20 realm 2024-09-12T00:46:12.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.659+0000 7f245b7209c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.659+0000 7f245b7209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.659+0000 7f245b7209c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:12.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.659+0000 7f245b7209c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.663+0000 7f245b7209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.663+0000 7f245b7209c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.663+0000 7f245b7209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:12.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.663+0000 7f245b7209c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.663+0000 7f245b7209c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:12.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.663+0000 7f245b7209c0 20 searching for the correct realm 2024-09-12T00:46:12.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.671+0000 7f2459a27640 0 -- 172.21.15.43:0/1670505509 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x55e4579c2110 msgr2=0x55e4579c4520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:12.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.679+0000 7f2458a25640 0 -- 172.21.15.43:0/1670505509 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f24500fa070 msgr2=0x7f24500b8a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:12.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.683+0000 7f245b7209c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:46:12.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.683+0000 7f245b7209c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:12.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.683+0000 7f245b7209c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:12.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.683+0000 7f245b7209c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:46:12.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.683+0000 7f245b7209c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:12.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.683+0000 7f245b7209c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:12.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.683+0000 7f245b7209c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.683+0000 7f245b7209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.683+0000 7f245b7209c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.687+0000 7f245b7209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:12.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.687+0000 7f245b7209c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.687+0000 7f245b7209c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:12.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.687+0000 7f245b7209c0 20 zone default found 2024-09-12T00:46:12.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.687+0000 7f245b7209c0 4 Realm: () 2024-09-12T00:46:12.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.687+0000 7f245b7209c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:46:12.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.687+0000 7f245b7209c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:46:12.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.687+0000 7f245b7209c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:12.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.687+0000 7f245b7209c0 20 zonegroup default 2024-09-12T00:46:12.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.687+0000 7f245b7209c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.687+0000 7f245b7209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.687+0000 7f245b7209c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.687+0000 7f245b7209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.687+0000 7f245b7209c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.687+0000 7f245b7209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.687+0000 7f245b7209c0 20 started sync module instance, tier type = 2024-09-12T00:46:12.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.687+0000 7f245b7209c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:46:12.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.703+0000 7f245b7209c0 20 add_watcher() i=0 2024-09-12T00:46:12.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.703+0000 7f245b7209c0 20 add_watcher() i=1 2024-09-12T00:46:12.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.703+0000 7f245b7209c0 20 add_watcher() i=2 2024-09-12T00:46:12.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.703+0000 7f245b7209c0 20 add_watcher() i=3 2024-09-12T00:46:12.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.703+0000 7f245b7209c0 20 add_watcher() i=4 2024-09-12T00:46:12.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.703+0000 7f245b7209c0 20 add_watcher() i=5 2024-09-12T00:46:12.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.703+0000 7f245b7209c0 20 add_watcher() i=6 2024-09-12T00:46:12.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.703+0000 7f245b7209c0 20 add_watcher() i=7 2024-09-12T00:46:12.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.703+0000 7f245b7209c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:12.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.707+0000 7f230ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:12.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.707+0000 7f245b7209c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:12.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.707+0000 7f245b7209c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:12.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.707+0000 7f245b7209c0 5 note: GC not initialized 2024-09-12T00:46:12.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.707+0000 7f230efe5640 20 reqs_thread_entry: start 2024-09-12T00:46:12.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.707+0000 7f245b7209c0 20 init_complete bucket index max shards: 11 2024-09-12T00:46:12.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.707+0000 7f245b7209c0 20 Filter name: none 2024-09-12T00:46:12.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.707+0000 7f230cfe1640 20 reqs_thread_entry: start 2024-09-12T00:46:12.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.707+0000 7f245b7209c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-12T00:46:12.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.707+0000 7f245b7209c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.707+0000 7f245b7209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.707+0000 7f245b7209c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-12T00:46:12.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.707+0000 7f245b7209c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T00:46:12.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.707+0000 7f245b7209c0 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-12T00:46:12.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.707+0000 7f245b7209c0 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-12T00:46:12.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.707+0000 7f245b7209c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.707+0000 7f245b7209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.707+0000 7f245b7209c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-12T00:46:12.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.707+0000 7f245b7209c0 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T00:46:12.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.707+0000 7f245b7209c0 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-12T00:46:12.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.711+0000 7f245b7209c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T00:46:12.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.711+0000 7f245b7209c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T00:46:12.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.711+0000 7f245b7209c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-12T00:46:12.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.711+0000 7f233cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235474 cookie 94439210821072 notifier 8636 bl.length()=384 2024-09-12T00:46:12.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.711+0000 7f233cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T00:46:12.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.711+0000 7f233cff9640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T00:46:12.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.715+0000 7f245b7209c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T00:46:12.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.715+0000 7f245b7209c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T00:46:12.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.715+0000 7f245b7209c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-12T00:46:12.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.715+0000 7f233cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235490 cookie 94439210831600 notifier 8636 bl.length()=225 2024-09-12T00:46:12.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.715+0000 7f233cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T00:46:12.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.715+0000 7f233cff9640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T00:46:12.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.719+0000 7f245b7209c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T00:46:12.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.719+0000 7f245b7209c0 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T00:46:12.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.719+0000 7f245b7209c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-12T00:46:12.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.719+0000 7f233cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235428 cookie 94439210818128 notifier 8636 bl.length()=234 2024-09-12T00:46:12.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.719+0000 7f233cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T00:46:12.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.719+0000 7f233cff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T00:46:12.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.719+0000 7f230ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:12.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.723+0000 7f245b7209c0 20 remove_watcher() i=0 2024-09-12T00:46:12.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.723+0000 7f245b7209c0 2 removed watcher, disabling cache 2024-09-12T00:46:12.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.727+0000 7f245b7209c0 20 remove_watcher() i=1 2024-09-12T00:46:12.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.727+0000 7f245b7209c0 20 remove_watcher() i=2 2024-09-12T00:46:12.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.731+0000 7f245b7209c0 20 remove_watcher() i=3 2024-09-12T00:46:12.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.731+0000 7f245b7209c0 20 remove_watcher() i=4 2024-09-12T00:46:12.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.735+0000 7f245b7209c0 20 remove_watcher() i=5 2024-09-12T00:46:12.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.735+0000 7f245b7209c0 20 remove_watcher() i=6 2024-09-12T00:46:12.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.735+0000 7f245b7209c0 20 remove_watcher() i=7 2024-09-12T00:46:12.749 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T00:46:12.749 INFO:teuthology.orchestra.run.smithi043.stdout: "id": "RGW88888888888888888", 2024-09-12T00:46:12.750 INFO:teuthology.orchestra.run.smithi043.stdout: "tenant": "", 2024-09-12T00:46:12.750 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "Mr.RGW88888888888888888", 2024-09-12T00:46:12.750 INFO:teuthology.orchestra.run.smithi043.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-12T00:46:12.750 INFO:teuthology.orchestra.run.smithi043.stdout: "quota": { 2024-09-12T00:46:12.750 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": false, 2024-09-12T00:46:12.750 INFO:teuthology.orchestra.run.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:46:12.750 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size": -1, 2024-09-12T00:46:12.750 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:46:12.750 INFO:teuthology.orchestra.run.smithi043.stdout: "max_objects": -1 2024-09-12T00:46:12.750 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T00:46:12.750 INFO:teuthology.orchestra.run.smithi043.stdout: "bucket_quota": { 2024-09-12T00:46:12.751 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": false, 2024-09-12T00:46:12.751 INFO:teuthology.orchestra.run.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:46:12.751 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size": -1, 2024-09-12T00:46:12.751 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:46:12.751 INFO:teuthology.orchestra.run.smithi043.stdout: "max_objects": -1 2024-09-12T00:46:12.751 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T00:46:12.751 INFO:teuthology.orchestra.run.smithi043.stdout: "max_users": 1000, 2024-09-12T00:46:12.751 INFO:teuthology.orchestra.run.smithi043.stdout: "max_roles": 1000, 2024-09-12T00:46:12.751 INFO:teuthology.orchestra.run.smithi043.stdout: "max_groups": 1000, 2024-09-12T00:46:12.751 INFO:teuthology.orchestra.run.smithi043.stdout: "max_buckets": 1000, 2024-09-12T00:46:12.752 INFO:teuthology.orchestra.run.smithi043.stdout: "max_access_keys": 4 2024-09-12T00:46:12.752 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T00:46:12.753 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-12T00:46:12.753 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key DLPCGIWVJFTBMIIFMGVM --secret 7OtKk4S9fE+l5NM09FXfD9oirajrKUsH0SqR3zTZ9QwaB2UxxfT4Rw== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-12T00:46:12.837 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:12.837 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:12.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.879+0000 7f43a8b0c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.879+0000 7f43a8b0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.879+0000 7f43a8b0c9c0 20 realm 2024-09-12T00:46:12.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.879+0000 7f43a8b0c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.879+0000 7f43a8b0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.879+0000 7f43a8b0c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:12.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.879+0000 7f43a8b0c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.879+0000 7f43a8b0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.879+0000 7f43a8b0c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.883+0000 7f43a8b0c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:12.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.883+0000 7f43a8b0c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.883+0000 7f43a8b0c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:12.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.883+0000 7f43a8b0c9c0 20 searching for the correct realm 2024-09-12T00:46:12.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.887+0000 7f43a6e13640 0 -- 172.21.15.43:0/266722446 >> [v2:172.21.15.43:6808/2258408181,v1:172.21.15.43:6809/2258408181] conn(0x55c537aa60b0 msgr2=0x55c537aa84a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:12.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.895+0000 7f43a6612640 0 -- 172.21.15.43:0/266722446 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f4390047b00 msgr2=0x7f4390035920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:12.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.903+0000 7f43a8b0c9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:46:12.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.903+0000 7f43a8b0c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:12.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.903+0000 7f43a8b0c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:12.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.903+0000 7f43a8b0c9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:46:12.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.903+0000 7f43a8b0c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:12.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.903+0000 7f43a8b0c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:12.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.903+0000 7f43a8b0c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.903+0000 7f43a8b0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.903+0000 7f43a8b0c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.903+0000 7f43a8b0c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:12.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.903+0000 7f43a8b0c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.903+0000 7f43a8b0c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:12.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.903+0000 7f43a8b0c9c0 20 zone default found 2024-09-12T00:46:12.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.903+0000 7f43a8b0c9c0 4 Realm: () 2024-09-12T00:46:12.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.903+0000 7f43a8b0c9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:46:12.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.903+0000 7f43a8b0c9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:46:12.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.903+0000 7f43a8b0c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:12.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.903+0000 7f43a8b0c9c0 20 zonegroup default 2024-09-12T00:46:12.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.903+0000 7f43a8b0c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.903+0000 7f43a8b0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.903+0000 7f43a8b0c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.907+0000 7f43a8b0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.907+0000 7f43a8b0c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.907+0000 7f43a8b0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.907+0000 7f43a8b0c9c0 20 started sync module instance, tier type = 2024-09-12T00:46:12.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.907+0000 7f43a8b0c9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:46:12.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.919+0000 7f43a8b0c9c0 20 add_watcher() i=0 2024-09-12T00:46:12.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.919+0000 7f43a8b0c9c0 20 add_watcher() i=1 2024-09-12T00:46:12.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.919+0000 7f43a8b0c9c0 20 add_watcher() i=2 2024-09-12T00:46:12.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.919+0000 7f43a8b0c9c0 20 add_watcher() i=3 2024-09-12T00:46:12.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.919+0000 7f43a8b0c9c0 20 add_watcher() i=4 2024-09-12T00:46:12.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.919+0000 7f43a8b0c9c0 20 add_watcher() i=5 2024-09-12T00:46:12.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.919+0000 7f43a8b0c9c0 20 add_watcher() i=6 2024-09-12T00:46:12.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.923+0000 7f43a8b0c9c0 20 add_watcher() i=7 2024-09-12T00:46:12.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.923+0000 7f43a8b0c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:12.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.923+0000 7f425cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:12.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.923+0000 7f43a8b0c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:12.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.923+0000 7f43a8b0c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:12.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.923+0000 7f43a8b0c9c0 5 note: GC not initialized 2024-09-12T00:46:12.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.927+0000 7f41d77fe640 20 reqs_thread_entry: start 2024-09-12T00:46:12.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.927+0000 7f43a8b0c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:46:12.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.927+0000 7f43a8b0c9c0 20 Filter name: none 2024-09-12T00:46:12.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.927+0000 7f41d57fa640 20 reqs_thread_entry: start 2024-09-12T00:46:12.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.927+0000 7f43a8b0c9c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T00:46:12.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.927+0000 7f43a8b0c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.927+0000 7f43a8b0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.927+0000 7f43a8b0c9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-12T00:46:12.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.927+0000 7f43a8b0c9c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:46:12.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.927+0000 7f43a8b0c9c0 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-12T00:46:12.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.927+0000 7f43a8b0c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.927+0000 7f43a8b0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.927+0000 7f43a8b0c9c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-12T00:46:12.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.927+0000 7f43a8b0c9c0 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T00:46:12.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.927+0000 7f43a8b0c9c0 10 cache get: name=default.rgw.meta+users.keys+DLPCGIWVJFTBMIIFMGVM : miss 2024-09-12T00:46:12.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.927+0000 7f43a8b0c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.927+0000 7f43a8b0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.927+0000 7f43a8b0c9c0 10 cache put: name=default.rgw.meta+users.keys+DLPCGIWVJFTBMIIFMGVM info.flags=0x0 2024-09-12T00:46:12.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.927+0000 7f43a8b0c9c0 10 adding default.rgw.meta+users.keys+DLPCGIWVJFTBMIIFMGVM to cache LRU end 2024-09-12T00:46:12.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.927+0000 7f43a8b0c9c0 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-12T00:46:12.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.927+0000 7f43a8b0c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.927+0000 7f43a8b0c9c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T00:46:12.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.927+0000 7f43a8b0c9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T00:46:12.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.927+0000 7f43a8b0c9c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T00:46:12.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.927+0000 7f43a8b0c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:12.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.927+0000 7f43a8b0c9c0 10 cache get: name=default.rgw.meta+users.keys+DLPCGIWVJFTBMIIFMGVM : hit (negative entry) 2024-09-12T00:46:12.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.927+0000 7f43a8b0c9c0 10 cache get: name=default.rgw.meta+users.keys+DLPCGIWVJFTBMIIFMGVM : hit (negative entry) 2024-09-12T00:46:12.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.931+0000 7f43a8b0c9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:46:12.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.931+0000 7f43a8b0c9c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:46:12.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.931+0000 7f43a8b0c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T00:46:12.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.931+0000 7f4289ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235475 cookie 94305530843792 notifier 8654 bl.length()=681 2024-09-12T00:46:12.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.931+0000 7f4289ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:46:12.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.931+0000 7f4289ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:46:12.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.935+0000 7f43a8b0c9c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T00:46:12.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.935+0000 7f43a8b0c9c0 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T00:46:12.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.935+0000 7f43a8b0c9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-12T00:46:12.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.935+0000 7f4289ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235546 cookie 94305530856928 notifier 8654 bl.length()=189 2024-09-12T00:46:12.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.935+0000 7f4289ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T00:46:12.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.935+0000 7f4289ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T00:46:12.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.939+0000 7f43a8b0c9c0 10 cache put: name=default.rgw.meta+users.keys+DLPCGIWVJFTBMIIFMGVM info.flags=0x7 2024-09-12T00:46:12.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.939+0000 7f43a8b0c9c0 10 moving default.rgw.meta+users.keys+DLPCGIWVJFTBMIIFMGVM to cache LRU end 2024-09-12T00:46:12.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.939+0000 7f43a8b0c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:DLPCGIWVJFTBMIIFMGVM, ofs0, ns] 2024-09-12T00:46:12.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.939+0000 7f4289ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235491 cookie 94305530853152 notifier 8654 bl.length()=188 2024-09-12T00:46:12.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.939+0000 7f4289ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+DLPCGIWVJFTBMIIFMGVM info.flags=0x7 2024-09-12T00:46:12.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.939+0000 7f4289ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+DLPCGIWVJFTBMIIFMGVM to cache LRU end 2024-09-12T00:46:12.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.943+0000 7f43a8b0c9c0 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-12T00:46:12.943 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T00:46:12.943 INFO:teuthology.orchestra.run.smithi043.stdout: "user_id": "root1.client.0", 2024-09-12T00:46:12.943 INFO:teuthology.orchestra.run.smithi043.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-12T00:46:12.943 INFO:teuthology.orchestra.run.smithi043.stdout: "email": "root1+test@test.test", 2024-09-12T00:46:12.943 INFO:teuthology.orchestra.run.smithi043.stdout: "suspended": 0, 2024-09-12T00:46:12.943 INFO:teuthology.orchestra.run.smithi043.stdout: "max_buckets": 1000, 2024-09-12T00:46:12.943 INFO:teuthology.orchestra.run.smithi043.stdout: "subusers": [], 2024-09-12T00:46:12.944 INFO:teuthology.orchestra.run.smithi043.stdout: "keys": [ 2024-09-12T00:46:12.944 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T00:46:12.944 INFO:teuthology.orchestra.run.smithi043.stdout: "user": "root1.client.0", 2024-09-12T00:46:12.944 INFO:teuthology.orchestra.run.smithi043.stdout: "access_key": "DLPCGIWVJFTBMIIFMGVM", 2024-09-12T00:46:12.944 INFO:teuthology.orchestra.run.smithi043.stdout: "secret_key": "7OtKk4S9fE+l5NM09FXfD9oirajrKUsH0SqR3zTZ9QwaB2UxxfT4Rw==", 2024-09-12T00:46:12.944 INFO:teuthology.orchestra.run.smithi043.stdout: "active": true, 2024-09-12T00:46:12.944 INFO:teuthology.orchestra.run.smithi043.stdout: "create_date": "2024-09-12T00:46:12.932329Z" 2024-09-12T00:46:12.944 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T00:46:12.944 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-12T00:46:12.944 INFO:teuthology.orchestra.run.smithi043.stdout: "swift_keys": [], 2024-09-12T00:46:12.944 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": [], 2024-09-12T00:46:12.944 INFO:teuthology.orchestra.run.smithi043.stdout: "op_mask": "read, write, delete", 2024-09-12T00:46:12.944 INFO:teuthology.orchestra.run.smithi043.stdout: "default_placement": "", 2024-09-12T00:46:12.945 INFO:teuthology.orchestra.run.smithi043.stdout: "default_storage_class": "", 2024-09-12T00:46:12.945 INFO:teuthology.orchestra.run.smithi043.stdout: "placement_tags": [], 2024-09-12T00:46:12.945 INFO:teuthology.orchestra.run.smithi043.stdout: "bucket_quota": { 2024-09-12T00:46:12.945 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": false, 2024-09-12T00:46:12.945 INFO:teuthology.orchestra.run.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:46:12.945 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size": -1, 2024-09-12T00:46:12.945 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:46:12.945 INFO:teuthology.orchestra.run.smithi043.stdout: "max_objects": -1 2024-09-12T00:46:12.945 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T00:46:12.945 INFO:teuthology.orchestra.run.smithi043.stdout: "user_quota": { 2024-09-12T00:46:12.945 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": false, 2024-09-12T00:46:12.945 INFO:teuthology.orchestra.run.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:46:12.945 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size": -1, 2024-09-12T00:46:12.946 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:46:12.946 INFO:teuthology.orchestra.run.smithi043.stdout: "max_objects": -1 2024-09-12T00:46:12.946 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T00:46:12.946 INFO:teuthology.orchestra.run.smithi043.stdout: "temp_url_keys": [], 2024-09-12T00:46:12.946 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "root", 2024-09-12T00:46:12.946 INFO:teuthology.orchestra.run.smithi043.stdout: "mfa_ids": [], 2024-09-12T00:46:12.946 INFO:teuthology.orchestra.run.smithi043.stdout: "account_id": "RGW88888888888888888", 2024-09-12T00:46:12.946 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-09-12T00:46:12.946 INFO:teuthology.orchestra.run.smithi043.stdout: "create_date": "2024-09-12T00:46:12.932314Z", 2024-09-12T00:46:12.947 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-09-12T00:46:12.947 INFO:teuthology.orchestra.run.smithi043.stdout: "group_ids": [] 2024-09-12T00:46:12.947 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T00:46:12.947 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:12.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.943+0000 7f425cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:12.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.951+0000 7f43a8b0c9c0 20 remove_watcher() i=0 2024-09-12T00:46:12.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.951+0000 7f43a8b0c9c0 2 removed watcher, disabling cache 2024-09-12T00:46:12.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.951+0000 7f43a8b0c9c0 20 remove_watcher() i=1 2024-09-12T00:46:12.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.955+0000 7f43a8b0c9c0 20 remove_watcher() i=2 2024-09-12T00:46:12.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.955+0000 7f43a8b0c9c0 20 remove_watcher() i=3 2024-09-12T00:46:12.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.959+0000 7f43a8b0c9c0 20 remove_watcher() i=4 2024-09-12T00:46:12.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.959+0000 7f43a8b0c9c0 20 remove_watcher() i=5 2024-09-12T00:46:12.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.963+0000 7f43a8b0c9c0 20 remove_watcher() i=6 2024-09-12T00:46:12.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:12.963+0000 7f43a8b0c9c0 20 remove_watcher() i=7 2024-09-12T00:46:12.977 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 8327573427 --totp-seed D3JDKJKXDID3ZC2DEVIW5BOIXP3ILO7AAC4S6KMOCTEN5MTHHVSRFX2WVGMFIOIJ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:46:13.017 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:13.017 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:13.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.059+0000 7fce847b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:13.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.059+0000 7fce847b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:13.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.059+0000 7fce847b49c0 20 realm 2024-09-12T00:46:13.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.059+0000 7fce847b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:13.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.059+0000 7fce847b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:13.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.059+0000 7fce847b49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:13.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.059+0000 7fce847b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:13.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.059+0000 7fce847b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:13.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.059+0000 7fce847b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:13.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.063+0000 7fce847b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:13.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.063+0000 7fce847b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:13.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.063+0000 7fce847b49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:13.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.063+0000 7fce847b49c0 20 searching for the correct realm 2024-09-12T00:46:13.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.067+0000 7fce81ab9640 0 -- 172.21.15.43:0/3041925672 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7fce780ff1e0 msgr2=0x7fce78119370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:13.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.283+0000 7fce822ba640 0 -- 172.21.15.43:0/3041925672 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fce780f6ba0 msgr2=0x7fce780f9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:13.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.499+0000 7fce847b49c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:46:13.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.499+0000 7fce847b49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:13.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.499+0000 7fce847b49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:13.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.499+0000 7fce847b49c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:46:13.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.499+0000 7fce847b49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:13.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.499+0000 7fce847b49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:13.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.499+0000 7fce847b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:13.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.503+0000 7fce847b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:13.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.503+0000 7fce847b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:13.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.503+0000 7fce847b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:13.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.503+0000 7fce847b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:13.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.503+0000 7fce847b49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:13.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.503+0000 7fce847b49c0 20 zone default found 2024-09-12T00:46:13.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.503+0000 7fce847b49c0 4 Realm: () 2024-09-12T00:46:13.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.503+0000 7fce847b49c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:46:13.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.503+0000 7fce847b49c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:46:13.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.503+0000 7fce847b49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:13.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.503+0000 7fce847b49c0 20 zonegroup default 2024-09-12T00:46:13.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.503+0000 7fce847b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:13.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.503+0000 7fce847b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:13.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.503+0000 7fce847b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:13.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.507+0000 7fce847b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:13.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.507+0000 7fce847b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:13.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.507+0000 7fce847b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:13.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.507+0000 7fce847b49c0 20 started sync module instance, tier type = 2024-09-12T00:46:13.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.507+0000 7fce847b49c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:46:13.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.527+0000 7fce847b49c0 20 add_watcher() i=0 2024-09-12T00:46:13.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.527+0000 7fce847b49c0 20 add_watcher() i=1 2024-09-12T00:46:13.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.527+0000 7fce847b49c0 20 add_watcher() i=2 2024-09-12T00:46:13.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.527+0000 7fce847b49c0 20 add_watcher() i=3 2024-09-12T00:46:13.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.527+0000 7fce847b49c0 20 add_watcher() i=4 2024-09-12T00:46:13.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.527+0000 7fce847b49c0 20 add_watcher() i=5 2024-09-12T00:46:13.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.527+0000 7fce847b49c0 20 add_watcher() i=6 2024-09-12T00:46:13.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.531+0000 7fce847b49c0 20 add_watcher() i=7 2024-09-12T00:46:13.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.531+0000 7fce847b49c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:13.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.535+0000 7fcd38fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:13.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.535+0000 7fce847b49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:13.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.535+0000 7fce847b49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:13.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.535+0000 7fce847b49c0 5 note: GC not initialized 2024-09-12T00:46:13.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.535+0000 7fccb37fe640 20 reqs_thread_entry: start 2024-09-12T00:46:13.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.535+0000 7fce847b49c0 20 init_complete bucket index max shards: 11 2024-09-12T00:46:13.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.535+0000 7fce847b49c0 20 Filter name: none 2024-09-12T00:46:13.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.535+0000 7fccb17fa640 20 reqs_thread_entry: start 2024-09-12T00:46:13.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.535+0000 7fce847b49c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T00:46:13.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.535+0000 7fce847b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:13.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.535+0000 7fce847b49c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T00:46:13.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.535+0000 7fce847b49c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-12T00:46:13.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.535+0000 7fce847b49c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:46:13.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.535+0000 7fce847b49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:13.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.539+0000 7fce847b49c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:46:13.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.539+0000 7fce847b49c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:46:13.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.539+0000 7fce847b49c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T00:46:13.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.539+0000 7fcd65ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235476 cookie 93850059370400 notifier 9162 bl.length()=695 2024-09-12T00:46:13.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.539+0000 7fcd65ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:46:13.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.539+0000 7fcd65ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:46:13.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.543+0000 7fcd38fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:13.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.547+0000 7fce847b49c0 20 remove_watcher() i=0 2024-09-12T00:46:13.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.547+0000 7fce847b49c0 2 removed watcher, disabling cache 2024-09-12T00:46:13.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.551+0000 7fce847b49c0 20 remove_watcher() i=1 2024-09-12T00:46:13.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.555+0000 7fce847b49c0 20 remove_watcher() i=2 2024-09-12T00:46:13.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.555+0000 7fce847b49c0 20 remove_watcher() i=3 2024-09-12T00:46:13.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.559+0000 7fce847b49c0 20 remove_watcher() i=4 2024-09-12T00:46:13.559 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.559+0000 7fce847b49c0 20 remove_watcher() i=5 2024-09-12T00:46:13.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.559+0000 7fce847b49c0 20 remove_watcher() i=6 2024-09-12T00:46:13.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.563+0000 7fce847b49c0 20 remove_watcher() i=7 2024-09-12T00:46:13.578 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-12T00:46:13.663 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:13.663 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:13.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.707+0000 7f6479b1f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:13.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.707+0000 7f6479b1f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:13.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.707+0000 7f6479b1f9c0 20 realm 2024-09-12T00:46:13.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.707+0000 7f6479b1f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:13.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.707+0000 7f6479b1f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:13.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.707+0000 7f6479b1f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:13.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.707+0000 7f6479b1f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:13.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.707+0000 7f6479b1f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:13.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.707+0000 7f6479b1f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:13.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.711+0000 7f6479b1f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:13.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.711+0000 7f6479b1f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:13.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.711+0000 7f6479b1f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:13.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.711+0000 7f6479b1f9c0 20 searching for the correct realm 2024-09-12T00:46:13.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.715+0000 7f6476e24640 0 -- 172.21.15.43:0/3730707570 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x560b55fa2360 msgr2=0x560b55fa47f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:13.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.723+0000 7f6476e24640 0 -- 172.21.15.43:0/3730707570 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f64600dc410 msgr2=0x7f64600dc890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:13.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.731+0000 7f6479b1f9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:46:13.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.731+0000 7f6479b1f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:13.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.731+0000 7f6479b1f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:13.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.731+0000 7f6479b1f9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:46:13.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.731+0000 7f6479b1f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:13.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.731+0000 7f6479b1f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:13.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.731+0000 7f6479b1f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:13.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.731+0000 7f6479b1f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:13.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.731+0000 7f6479b1f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:13.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.731+0000 7f6479b1f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:13.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.731+0000 7f6479b1f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:13.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.731+0000 7f6479b1f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:13.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.731+0000 7f6479b1f9c0 20 zone default found 2024-09-12T00:46:13.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.731+0000 7f6479b1f9c0 4 Realm: () 2024-09-12T00:46:13.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.731+0000 7f6479b1f9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:46:13.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.731+0000 7f6479b1f9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:46:13.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.731+0000 7f6479b1f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:13.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.731+0000 7f6479b1f9c0 20 zonegroup default 2024-09-12T00:46:13.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.731+0000 7f6479b1f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:13.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.731+0000 7f6479b1f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:13.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.731+0000 7f6479b1f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:13.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.735+0000 7f6479b1f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:13.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.735+0000 7f6479b1f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:13.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.735+0000 7f6479b1f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:13.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.735+0000 7f6479b1f9c0 20 started sync module instance, tier type = 2024-09-12T00:46:13.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.735+0000 7f6479b1f9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:46:13.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.747+0000 7f6479b1f9c0 20 add_watcher() i=0 2024-09-12T00:46:13.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.747+0000 7f6479b1f9c0 20 add_watcher() i=1 2024-09-12T00:46:13.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.747+0000 7f6479b1f9c0 20 add_watcher() i=2 2024-09-12T00:46:13.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.747+0000 7f6479b1f9c0 20 add_watcher() i=3 2024-09-12T00:46:13.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.747+0000 7f6479b1f9c0 20 add_watcher() i=4 2024-09-12T00:46:13.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.747+0000 7f6479b1f9c0 20 add_watcher() i=5 2024-09-12T00:46:13.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.747+0000 7f6479b1f9c0 20 add_watcher() i=6 2024-09-12T00:46:13.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.751+0000 7f6479b1f9c0 20 add_watcher() i=7 2024-09-12T00:46:13.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.751+0000 7f6479b1f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:13.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.751+0000 7f632dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:13.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.751+0000 7f6479b1f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:13.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.751+0000 7f6479b1f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:13.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.751+0000 7f6479b1f9c0 5 note: GC not initialized 2024-09-12T00:46:13.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.751+0000 7f632cfe1640 20 reqs_thread_entry: start 2024-09-12T00:46:13.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.755+0000 7f6479b1f9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:46:13.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.755+0000 7f6479b1f9c0 20 Filter name: none 2024-09-12T00:46:13.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.755+0000 7f62a67fc640 20 reqs_thread_entry: start 2024-09-12T00:46:13.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.755+0000 7f6479b1f9c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-12T00:46:13.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.755+0000 7f6479b1f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:13.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.755+0000 7f6479b1f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:13.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.755+0000 7f6479b1f9c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-12T00:46:13.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.755+0000 7f6479b1f9c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T00:46:13.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.755+0000 7f6479b1f9c0 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-12T00:46:13.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.755+0000 7f6479b1f9c0 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-12T00:46:13.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.755+0000 7f6479b1f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:13.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.755+0000 7f6479b1f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:13.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.755+0000 7f6479b1f9c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-12T00:46:13.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.755+0000 7f6479b1f9c0 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T00:46:13.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.755+0000 7f6479b1f9c0 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-12T00:46:13.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.759+0000 7f6479b1f9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T00:46:13.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.759+0000 7f6479b1f9c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T00:46:13.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.759+0000 7f6479b1f9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-12T00:46:13.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.759+0000 7f635affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235477 cookie 94606687152528 notifier 9180 bl.length()=384 2024-09-12T00:46:13.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.759+0000 7f635affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T00:46:13.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.759+0000 7f635affd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T00:46:13.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.763+0000 7f6479b1f9c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T00:46:13.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.763+0000 7f6479b1f9c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T00:46:13.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.763+0000 7f6479b1f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-12T00:46:13.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.763+0000 7f635affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235492 cookie 94606687161536 notifier 9180 bl.length()=225 2024-09-12T00:46:13.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.763+0000 7f635affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T00:46:13.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.763+0000 7f635affd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T00:46:13.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.767+0000 7f6479b1f9c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T00:46:13.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.767+0000 7f6479b1f9c0 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T00:46:13.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.767+0000 7f6479b1f9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-12T00:46:13.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.767+0000 7f635a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235429 cookie 94606687153584 notifier 9180 bl.length()=234 2024-09-12T00:46:13.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.767+0000 7f635a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T00:46:13.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.767+0000 7f635a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T00:46:13.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.767+0000 7f632dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:13.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.775+0000 7f6479b1f9c0 20 remove_watcher() i=0 2024-09-12T00:46:13.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.775+0000 7f6479b1f9c0 2 removed watcher, disabling cache 2024-09-12T00:46:13.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.775+0000 7f6479b1f9c0 20 remove_watcher() i=1 2024-09-12T00:46:13.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.779+0000 7f6479b1f9c0 20 remove_watcher() i=2 2024-09-12T00:46:13.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.779+0000 7f6479b1f9c0 20 remove_watcher() i=3 2024-09-12T00:46:13.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.783+0000 7f6479b1f9c0 20 remove_watcher() i=4 2024-09-12T00:46:13.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.783+0000 7f6479b1f9c0 20 remove_watcher() i=5 2024-09-12T00:46:13.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.783+0000 7f6479b1f9c0 20 remove_watcher() i=6 2024-09-12T00:46:13.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.787+0000 7f6479b1f9c0 20 remove_watcher() i=7 2024-09-12T00:46:13.798 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T00:46:13.798 INFO:teuthology.orchestra.run.smithi043.stdout: "id": "RGW99999999999999999", 2024-09-12T00:46:13.798 INFO:teuthology.orchestra.run.smithi043.stdout: "tenant": "", 2024-09-12T00:46:13.799 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "Mr.RGW99999999999999999", 2024-09-12T00:46:13.799 INFO:teuthology.orchestra.run.smithi043.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-12T00:46:13.799 INFO:teuthology.orchestra.run.smithi043.stdout: "quota": { 2024-09-12T00:46:13.799 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": false, 2024-09-12T00:46:13.799 INFO:teuthology.orchestra.run.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:46:13.799 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size": -1, 2024-09-12T00:46:13.799 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:46:13.799 INFO:teuthology.orchestra.run.smithi043.stdout: "max_objects": -1 2024-09-12T00:46:13.799 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T00:46:13.799 INFO:teuthology.orchestra.run.smithi043.stdout: "bucket_quota": { 2024-09-12T00:46:13.799 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": false, 2024-09-12T00:46:13.799 INFO:teuthology.orchestra.run.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:46:13.799 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size": -1, 2024-09-12T00:46:13.800 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:46:13.800 INFO:teuthology.orchestra.run.smithi043.stdout: "max_objects": -1 2024-09-12T00:46:13.800 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T00:46:13.800 INFO:teuthology.orchestra.run.smithi043.stdout: "max_users": 1000, 2024-09-12T00:46:13.800 INFO:teuthology.orchestra.run.smithi043.stdout: "max_roles": 1000, 2024-09-12T00:46:13.800 INFO:teuthology.orchestra.run.smithi043.stdout: "max_groups": 1000, 2024-09-12T00:46:13.800 INFO:teuthology.orchestra.run.smithi043.stdout: "max_buckets": 1000, 2024-09-12T00:46:13.800 INFO:teuthology.orchestra.run.smithi043.stdout: "max_access_keys": 4 2024-09-12T00:46:13.800 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T00:46:13.801 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-12T00:46:13.802 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key EIWEDQLORMVYLBZVVFBG --secret xT3XWMPh6RS0Y4LBF+xlQgK8cwWq/bPPQndLvNOh1ICoDOBRttQApg== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-12T00:46:13.887 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:13.887 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:13.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.927+0000 7f130c2ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:13.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.931+0000 7f130c2ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:13.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.931+0000 7f130c2ac9c0 20 realm 2024-09-12T00:46:13.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.931+0000 7f130c2ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:13.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.931+0000 7f130c2ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:13.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.931+0000 7f130c2ac9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:13.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.931+0000 7f130c2ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:13.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.931+0000 7f130c2ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:13.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.931+0000 7f130c2ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:13.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.931+0000 7f130c2ac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:13.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.931+0000 7f130c2ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:13.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.935+0000 7f130c2ac9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:13.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.935+0000 7f130c2ac9c0 20 searching for the correct realm 2024-09-12T00:46:13.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:13.935+0000 7f13095b1640 0 -- 172.21.15.43:0/792999135 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f130003c040 msgr2=0x7f130000e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:46:14.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.151+0000 7f1309db2640 0 -- 172.21.15.43:0/792999135 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7f1300049420 msgr2=0x7f13000498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:14.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.367+0000 7f130c2ac9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:46:14.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.367+0000 7f130c2ac9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:14.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.367+0000 7f130c2ac9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:14.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.367+0000 7f130c2ac9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:46:14.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.367+0000 7f130c2ac9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:14.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.367+0000 7f130c2ac9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:14.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.367+0000 7f130c2ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:14.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.367+0000 7f130c2ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:14.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.371+0000 7f130c2ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:14.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.371+0000 7f130c2ac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:14.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.371+0000 7f130c2ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:14.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.371+0000 7f130c2ac9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:14.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.371+0000 7f130c2ac9c0 20 zone default found 2024-09-12T00:46:14.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.371+0000 7f130c2ac9c0 4 Realm: () 2024-09-12T00:46:14.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.371+0000 7f130c2ac9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:46:14.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.371+0000 7f130c2ac9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:46:14.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.371+0000 7f130c2ac9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:14.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.371+0000 7f130c2ac9c0 20 zonegroup default 2024-09-12T00:46:14.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.371+0000 7f130c2ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:14.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.371+0000 7f130c2ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:14.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.371+0000 7f130c2ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:14.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.371+0000 7f130c2ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:14.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.371+0000 7f130c2ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:14.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.375+0000 7f130c2ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:14.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.375+0000 7f130c2ac9c0 20 started sync module instance, tier type = 2024-09-12T00:46:14.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.375+0000 7f130c2ac9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:46:14.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.399+0000 7f130c2ac9c0 20 add_watcher() i=0 2024-09-12T00:46:14.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.399+0000 7f130c2ac9c0 20 add_watcher() i=1 2024-09-12T00:46:14.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.399+0000 7f130c2ac9c0 20 add_watcher() i=2 2024-09-12T00:46:14.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.399+0000 7f130c2ac9c0 20 add_watcher() i=3 2024-09-12T00:46:14.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.399+0000 7f130c2ac9c0 20 add_watcher() i=4 2024-09-12T00:46:14.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.399+0000 7f130c2ac9c0 20 add_watcher() i=5 2024-09-12T00:46:14.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.399+0000 7f130c2ac9c0 20 add_watcher() i=6 2024-09-12T00:46:14.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.403+0000 7f130c2ac9c0 20 add_watcher() i=7 2024-09-12T00:46:14.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.403+0000 7f130c2ac9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:14.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.407+0000 7f11bbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:14.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.407+0000 7f130c2ac9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:14.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.407+0000 7f130c2ac9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:14.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.407+0000 7f130c2ac9c0 5 note: GC not initialized 2024-09-12T00:46:14.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.407+0000 7f11baffd640 20 reqs_thread_entry: start 2024-09-12T00:46:14.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.407+0000 7f130c2ac9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:46:14.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.407+0000 7f130c2ac9c0 20 Filter name: none 2024-09-12T00:46:14.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.407+0000 7f11b8ff9640 20 reqs_thread_entry: start 2024-09-12T00:46:14.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.407+0000 7f130c2ac9c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T00:46:14.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.407+0000 7f130c2ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:14.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.411+0000 7f130c2ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:14.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.411+0000 7f130c2ac9c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-12T00:46:14.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.411+0000 7f130c2ac9c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:46:14.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.411+0000 7f130c2ac9c0 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-12T00:46:14.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.411+0000 7f130c2ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:14.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.411+0000 7f130c2ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:14.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.411+0000 7f130c2ac9c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-12T00:46:14.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.411+0000 7f130c2ac9c0 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T00:46:14.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.411+0000 7f130c2ac9c0 10 cache get: name=default.rgw.meta+users.keys+EIWEDQLORMVYLBZVVFBG : miss 2024-09-12T00:46:14.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.411+0000 7f130c2ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:14.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.411+0000 7f130c2ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:14.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.411+0000 7f130c2ac9c0 10 cache put: name=default.rgw.meta+users.keys+EIWEDQLORMVYLBZVVFBG info.flags=0x0 2024-09-12T00:46:14.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.411+0000 7f130c2ac9c0 10 adding default.rgw.meta+users.keys+EIWEDQLORMVYLBZVVFBG to cache LRU end 2024-09-12T00:46:14.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.411+0000 7f130c2ac9c0 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-12T00:46:14.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.411+0000 7f130c2ac9c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:14.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.411+0000 7f130c2ac9c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T00:46:14.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.411+0000 7f130c2ac9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T00:46:14.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.411+0000 7f130c2ac9c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T00:46:14.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.411+0000 7f130c2ac9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:14.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.411+0000 7f130c2ac9c0 10 cache get: name=default.rgw.meta+users.keys+EIWEDQLORMVYLBZVVFBG : hit (negative entry) 2024-09-12T00:46:14.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.411+0000 7f130c2ac9c0 10 cache get: name=default.rgw.meta+users.keys+EIWEDQLORMVYLBZVVFBG : hit (negative entry) 2024-09-12T00:46:14.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.415+0000 7f130c2ac9c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:46:14.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.415+0000 7f130c2ac9c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:46:14.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.415+0000 7f130c2ac9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T00:46:14.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.415+0000 7f11ed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235478 cookie 94428772692368 notifier 8702 bl.length()=681 2024-09-12T00:46:14.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.415+0000 7f11ed7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:46:14.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.415+0000 7f11ed7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:46:14.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.419+0000 7f130c2ac9c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T00:46:14.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.419+0000 7f130c2ac9c0 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T00:46:14.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.419+0000 7f130c2ac9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-12T00:46:14.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.423+0000 7f11ed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235547 cookie 94428772703600 notifier 8702 bl.length()=189 2024-09-12T00:46:14.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.423+0000 7f11ed7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T00:46:14.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.423+0000 7f11ed7fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T00:46:14.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.423+0000 7f130c2ac9c0 10 cache put: name=default.rgw.meta+users.keys+EIWEDQLORMVYLBZVVFBG info.flags=0x7 2024-09-12T00:46:14.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.423+0000 7f130c2ac9c0 10 moving default.rgw.meta+users.keys+EIWEDQLORMVYLBZVVFBG to cache LRU end 2024-09-12T00:46:14.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.423+0000 7f130c2ac9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:EIWEDQLORMVYLBZVVFBG, ofs0, ns] 2024-09-12T00:46:14.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.427+0000 7f11ecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235430 cookie 94428772697216 notifier 8702 bl.length()=188 2024-09-12T00:46:14.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.427+0000 7f11ecff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+EIWEDQLORMVYLBZVVFBG info.flags=0x7 2024-09-12T00:46:14.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.427+0000 7f11ecff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+EIWEDQLORMVYLBZVVFBG to cache LRU end 2024-09-12T00:46:14.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.431+0000 7f130c2ac9c0 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-12T00:46:14.430 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T00:46:14.430 INFO:teuthology.orchestra.run.smithi043.stdout: "user_id": "root2.client.0", 2024-09-12T00:46:14.430 INFO:teuthology.orchestra.run.smithi043.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-12T00:46:14.430 INFO:teuthology.orchestra.run.smithi043.stdout: "email": "root2+test@test.test", 2024-09-12T00:46:14.430 INFO:teuthology.orchestra.run.smithi043.stdout: "suspended": 0, 2024-09-12T00:46:14.430 INFO:teuthology.orchestra.run.smithi043.stdout: "max_buckets": 1000, 2024-09-12T00:46:14.430 INFO:teuthology.orchestra.run.smithi043.stdout: "subusers": [], 2024-09-12T00:46:14.430 INFO:teuthology.orchestra.run.smithi043.stdout: "keys": [ 2024-09-12T00:46:14.430 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-09-12T00:46:14.431 INFO:teuthology.orchestra.run.smithi043.stdout: "user": "root2.client.0", 2024-09-12T00:46:14.431 INFO:teuthology.orchestra.run.smithi043.stdout: "access_key": "EIWEDQLORMVYLBZVVFBG", 2024-09-12T00:46:14.431 INFO:teuthology.orchestra.run.smithi043.stdout: "secret_key": "xT3XWMPh6RS0Y4LBF+xlQgK8cwWq/bPPQndLvNOh1ICoDOBRttQApg==", 2024-09-12T00:46:14.431 INFO:teuthology.orchestra.run.smithi043.stdout: "active": true, 2024-09-12T00:46:14.431 INFO:teuthology.orchestra.run.smithi043.stdout: "create_date": "2024-09-12T00:46:14.416105Z" 2024-09-12T00:46:14.431 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-09-12T00:46:14.431 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-09-12T00:46:14.431 INFO:teuthology.orchestra.run.smithi043.stdout: "swift_keys": [], 2024-09-12T00:46:14.431 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": [], 2024-09-12T00:46:14.431 INFO:teuthology.orchestra.run.smithi043.stdout: "op_mask": "read, write, delete", 2024-09-12T00:46:14.431 INFO:teuthology.orchestra.run.smithi043.stdout: "default_placement": "", 2024-09-12T00:46:14.431 INFO:teuthology.orchestra.run.smithi043.stdout: "default_storage_class": "", 2024-09-12T00:46:14.431 INFO:teuthology.orchestra.run.smithi043.stdout: "placement_tags": [], 2024-09-12T00:46:14.432 INFO:teuthology.orchestra.run.smithi043.stdout: "bucket_quota": { 2024-09-12T00:46:14.432 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": false, 2024-09-12T00:46:14.432 INFO:teuthology.orchestra.run.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:46:14.432 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size": -1, 2024-09-12T00:46:14.432 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:46:14.432 INFO:teuthology.orchestra.run.smithi043.stdout: "max_objects": -1 2024-09-12T00:46:14.432 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T00:46:14.432 INFO:teuthology.orchestra.run.smithi043.stdout: "user_quota": { 2024-09-12T00:46:14.432 INFO:teuthology.orchestra.run.smithi043.stdout: "enabled": false, 2024-09-12T00:46:14.432 INFO:teuthology.orchestra.run.smithi043.stdout: "check_on_raw": false, 2024-09-12T00:46:14.432 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size": -1, 2024-09-12T00:46:14.433 INFO:teuthology.orchestra.run.smithi043.stdout: "max_size_kb": 0, 2024-09-12T00:46:14.433 INFO:teuthology.orchestra.run.smithi043.stdout: "max_objects": -1 2024-09-12T00:46:14.433 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-09-12T00:46:14.433 INFO:teuthology.orchestra.run.smithi043.stdout: "temp_url_keys": [], 2024-09-12T00:46:14.433 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "root", 2024-09-12T00:46:14.433 INFO:teuthology.orchestra.run.smithi043.stdout: "mfa_ids": [], 2024-09-12T00:46:14.433 INFO:teuthology.orchestra.run.smithi043.stdout: "account_id": "RGW99999999999999999", 2024-09-12T00:46:14.433 INFO:teuthology.orchestra.run.smithi043.stdout: "path": "/", 2024-09-12T00:46:14.433 INFO:teuthology.orchestra.run.smithi043.stdout: "create_date": "2024-09-12T00:46:14.416075Z", 2024-09-12T00:46:14.433 INFO:teuthology.orchestra.run.smithi043.stdout: "tags": [], 2024-09-12T00:46:14.433 INFO:teuthology.orchestra.run.smithi043.stdout: "group_ids": [] 2024-09-12T00:46:14.433 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T00:46:14.434 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:46:14.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.431+0000 7f11bbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:14.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.435+0000 7f130c2ac9c0 20 remove_watcher() i=0 2024-09-12T00:46:14.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.435+0000 7f130c2ac9c0 2 removed watcher, disabling cache 2024-09-12T00:46:14.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.439+0000 7f130c2ac9c0 20 remove_watcher() i=1 2024-09-12T00:46:14.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.439+0000 7f130c2ac9c0 20 remove_watcher() i=2 2024-09-12T00:46:14.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.443+0000 7f130c2ac9c0 20 remove_watcher() i=3 2024-09-12T00:46:14.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.447+0000 7f130c2ac9c0 20 remove_watcher() i=4 2024-09-12T00:46:14.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.447+0000 7f130c2ac9c0 20 remove_watcher() i=5 2024-09-12T00:46:14.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.455+0000 7f130c2ac9c0 20 remove_watcher() i=6 2024-09-12T00:46:14.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.455+0000 7f130c2ac9c0 20 remove_watcher() i=7 2024-09-12T00:46:14.474 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 4045035836 --totp-seed LBNWDFTF7DDPHEFV7KH4PMYYF2FVS5OKJD2DSRGP3T6CHVWAALIQC2MDZ2A2X5JW --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:46:14.566 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:14.566 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:14.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.607+0000 7f21363b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:14.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.611+0000 7f21363b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:14.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.611+0000 7f21363b09c0 20 realm 2024-09-12T00:46:14.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.611+0000 7f21363b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:14.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.611+0000 7f21363b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:14.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.611+0000 7f21363b09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:14.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.611+0000 7f21363b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:14.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.611+0000 7f21363b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:14.611 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.611+0000 7f21363b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:14.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.611+0000 7f21363b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:14.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.611+0000 7f21363b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:14.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.611+0000 7f21363b09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:14.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.611+0000 7f21363b09c0 20 searching for the correct realm 2024-09-12T00:46:14.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.619+0000 7f21336b5640 0 -- 172.21.15.43:0/2296764025 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f2124027040 msgr2=0x7f2124019410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:14.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.627+0000 7f21346b7640 0 -- 172.21.15.43:0/2296764025 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f2124033410 msgr2=0x7f2124033870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:14.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.631+0000 7f21363b09c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T00:46:14.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.631+0000 7f21363b09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:14.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.631+0000 7f21363b09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:14.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.631+0000 7f21363b09c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T00:46:14.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.631+0000 7f21363b09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:14.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.631+0000 7f21363b09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:14.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.631+0000 7f21363b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:14.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.631+0000 7f21363b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:14.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.631+0000 7f21363b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:14.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.635+0000 7f21363b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:14.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.635+0000 7f21363b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:14.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.635+0000 7f21363b09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:14.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.635+0000 7f21363b09c0 20 zone default found 2024-09-12T00:46:14.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.635+0000 7f21363b09c0 4 Realm: () 2024-09-12T00:46:14.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.635+0000 7f21363b09c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T00:46:14.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.635+0000 7f21363b09c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T00:46:14.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.635+0000 7f21363b09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:14.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.635+0000 7f21363b09c0 20 zonegroup default 2024-09-12T00:46:14.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.635+0000 7f21363b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:14.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.635+0000 7f21363b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:14.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.635+0000 7f21363b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:14.636 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.635+0000 7f21363b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:14.636 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.635+0000 7f21363b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:14.636 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.635+0000 7f21363b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:14.636 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.635+0000 7f21363b09c0 20 started sync module instance, tier type = 2024-09-12T00:46:14.636 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.635+0000 7f21363b09c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T00:46:14.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.651+0000 7f21363b09c0 20 add_watcher() i=0 2024-09-12T00:46:14.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.651+0000 7f21363b09c0 20 add_watcher() i=1 2024-09-12T00:46:14.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.651+0000 7f21363b09c0 20 add_watcher() i=2 2024-09-12T00:46:14.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.651+0000 7f21363b09c0 20 add_watcher() i=3 2024-09-12T00:46:14.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.651+0000 7f21363b09c0 20 add_watcher() i=4 2024-09-12T00:46:14.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.651+0000 7f21363b09c0 20 add_watcher() i=5 2024-09-12T00:46:14.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.651+0000 7f21363b09c0 20 add_watcher() i=6 2024-09-12T00:46:14.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.651+0000 7f21363b09c0 20 add_watcher() i=7 2024-09-12T00:46:14.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.651+0000 7f21363b09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:14.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.655+0000 7f1fea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:14.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.655+0000 7f21363b09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:14.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.655+0000 7f21363b09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:14.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.655+0000 7f21363b09c0 5 note: GC not initialized 2024-09-12T00:46:14.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.655+0000 7f1fe97e2640 20 reqs_thread_entry: start 2024-09-12T00:46:14.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.655+0000 7f21363b09c0 20 init_complete bucket index max shards: 11 2024-09-12T00:46:14.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.655+0000 7f21363b09c0 20 Filter name: none 2024-09-12T00:46:14.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.655+0000 7f1fe27fc640 20 reqs_thread_entry: start 2024-09-12T00:46:14.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.655+0000 7f21363b09c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T00:46:14.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.655+0000 7f21363b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:46:14.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.655+0000 7f21363b09c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T00:46:14.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.655+0000 7f21363b09c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-12T00:46:14.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.655+0000 7f21363b09c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:46:14.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.655+0000 7f21363b09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:14.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.659+0000 7f21363b09c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:46:14.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.659+0000 7f21363b09c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:46:14.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.659+0000 7f21363b09c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T00:46:14.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.663+0000 7f2012ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235479 cookie 94649978732768 notifier 9216 bl.length()=695 2024-09-12T00:46:14.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.663+0000 7f2012ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:46:14.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.663+0000 7f2012ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:46:14.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.663+0000 7f1fea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:14.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.667+0000 7f21363b09c0 20 remove_watcher() i=0 2024-09-12T00:46:14.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.667+0000 7f21363b09c0 2 removed watcher, disabling cache 2024-09-12T00:46:14.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.671+0000 7f21363b09c0 20 remove_watcher() i=1 2024-09-12T00:46:14.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.671+0000 7f21363b09c0 20 remove_watcher() i=2 2024-09-12T00:46:14.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.675+0000 7f21363b09c0 20 remove_watcher() i=3 2024-09-12T00:46:14.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.675+0000 7f21363b09c0 20 remove_watcher() i=4 2024-09-12T00:46:14.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.679+0000 7f21363b09c0 20 remove_watcher() i=5 2024-09-12T00:46:14.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.679+0000 7f21363b09c0 20 remove_watcher() i=6 2024-09-12T00:46:14.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T00:46:14.679+0000 7f21363b09c0 20 remove_watcher() i=7 2024-09-12T00:46:14.695 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-12T00:46:14.695 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:46:14.695 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-12T00:46:14.700 INFO:tasks.s3tests:Configuring boto... 2024-09-12T00:46:14.700 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T00:46:14.700 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T00:46:14.750 DEBUG:teuthology.orchestra.run.smithi043:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T00:46:14.935 INFO:teuthology.orchestra.run.smithi043.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-12T00:46:15.136 INFO:teuthology.orchestra.run.smithi043.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-12T00:46:15.468 INFO:teuthology.orchestra.run.smithi043.stdout:py installdeps: -rrequirements.txt 2024-09-12T00:48:17.916 INFO:teuthology.orchestra.run.smithi043.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-12T00:48:19.970 INFO:teuthology.orchestra.run.smithi043.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.8,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.2,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=a442ead8150711fb9e05ff1c4b78940e4a48519ad58d38919538ad0be2126e3c,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-12T00:48:19.971 INFO:teuthology.orchestra.run.smithi043.stdout:py run-test-pre: PYTHONHASHSEED='2562954327' 2024-09-12T00:48:19.971 INFO:teuthology.orchestra.run.smithi043.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T00:48:20.162 INFO:teuthology.orchestra.run.smithi043.stdout:============================= test session starts ============================== 2024-09-12T00:48:20.162 INFO:teuthology.orchestra.run.smithi043.stdout:platform linux -- Python 3.10.6, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-12T00:48:20.162 INFO:teuthology.orchestra.run.smithi043.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T00:48:20.162 INFO:teuthology.orchestra.run.smithi043.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T00:48:20.162 INFO:teuthology.orchestra.run.smithi043.stdout:configfile: pytest.ini 2024-09-12T00:48:22.053 INFO:teuthology.orchestra.run.smithi043.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-12T00:48:22.053 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T00:48:22.468 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-12T00:48:22.724 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-12T00:48:22.990 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-12T00:48:23.253 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-12T00:48:23.507 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-12T00:48:23.709 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-12T00:48:23.988 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-12T00:48:24.193 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-12T00:48:24.289 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-12T00:48:24.390 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-12T00:48:24.652 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-12T00:48:24.915 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-12T00:48:25.179 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-12T00:48:25.434 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-12T00:48:25.534 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-12T00:48:25.634 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-12T00:48:25.689 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-12T00:48:25.745 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-12T00:48:25.803 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-12T00:48:25.858 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-12T00:48:25.914 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-12T00:48:25.970 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-12T00:48:26.026 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T00:48:26.082 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T00:48:26.138 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T00:48:26.194 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T00:48:26.249 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-12T00:48:26.306 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-12T00:48:26.361 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-12T00:48:26.418 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-12T00:48:26.474 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T00:48:26.530 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T00:48:26.586 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T00:48:26.641 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T00:48:26.698 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T00:48:26.753 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T00:48:26.809 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-12T00:48:26.865 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-12T00:48:26.922 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-12T00:48:26.977 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-12T00:48:27.033 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-12T00:48:27.090 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T00:48:27.146 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T00:48:27.201 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-12T00:48:27.257 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-12T00:48:27.313 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-12T00:48:27.369 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-12T00:48:27.429 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T00:48:27.486 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T00:48:27.541 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T00:48:27.597 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T00:48:27.653 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-12T00:48:27.710 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-12T00:48:28.253 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-12T00:48:29.238 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-12T00:48:31.061 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-12T00:48:32.871 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-12T00:48:35.785 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-12T00:48:36.904 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-12T00:48:38.259 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-12T00:48:38.727 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-12T00:48:38.950 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-12T00:48:39.303 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-12T00:48:39.667 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-12T00:48:40.140 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-12T00:48:40.446 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-12T00:48:40.759 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-12T00:48:40.761 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T00:48:40.763 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T00:48:40.766 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-12T00:48:40.773 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-12T00:48:40.775 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T00:48:40.777 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T00:48:40.780 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-12T00:48:40.782 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-12T00:48:40.784 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T00:48:40.786 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T00:48:40.789 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:48:40.791 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-12T00:48:40.794 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:48:40.796 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:48:40.798 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:48:40.800 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:48:40.802 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:48:40.804 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:48:40.807 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:48:40.809 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-12T00:48:40.811 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-12T00:48:40.812 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-12T00:48:40.814 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-12T00:48:40.816 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-12T00:48:40.818 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-12T00:48:40.820 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-12T00:48:40.821 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-12T00:48:40.930 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-12T00:48:40.939 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-12T00:48:41.809 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-12T00:48:47.489 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-12T00:48:48.065 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-12T00:48:48.733 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-12T00:48:49.413 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-12T00:48:50.096 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-12T00:48:50.777 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-12T00:48:51.389 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-12T00:48:52.093 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-12T00:48:52.700 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-12T00:48:53.345 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-12T00:48:53.953 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-12T00:48:54.513 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-12T00:48:55.032 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-12T00:48:55.413 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-12T00:48:55.980 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-12T00:48:56.613 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-12T00:48:57.304 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-12T00:48:57.904 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-12T00:48:58.529 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-12T00:48:59.160 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-12T00:48:59.761 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-12T00:49:00.385 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-12T00:49:00.917 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-12T00:49:01.481 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-12T00:49:01.908 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-12T00:49:02.352 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-12T00:49:02.764 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-12T00:49:03.172 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-12T00:49:03.569 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-12T00:49:04.232 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-12T00:49:04.665 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-12T00:49:05.113 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-12T00:49:05.653 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-12T00:49:06.173 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-12T00:49:06.652 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-12T00:49:07.165 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-12T00:49:07.692 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-12T00:49:08.337 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T00:49:08.816 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-12T00:49:09.372 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-12T00:49:09.933 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-12T00:49:10.729 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T00:49:11.428 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T00:49:12.100 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T00:49:12.796 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:49:13.601 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:49:14.413 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:49:15.265 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:49:16.060 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:49:16.796 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:49:17.452 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-12T00:49:18.237 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-12T00:49:18.852 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-12T00:49:20.093 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-12T00:49:20.997 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-12T00:49:22.049 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-12T00:49:24.029 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-12T00:49:26.685 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-12T00:49:28.269 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-12T00:49:29.673 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-12T00:49:30.761 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-12T00:49:31.513 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-12T00:49:32.793 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-12T00:49:33.761 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-12T00:49:34.993 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-12T00:49:35.869 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-12T00:49:37.465 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-12T00:49:38.737 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-12T00:49:40.389 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-12T00:49:42.021 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-12T00:49:43.185 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-12T00:49:44.245 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-12T00:49:45.169 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-12T00:49:47.201 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-12T00:49:48.733 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-12T00:49:50.437 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-12T00:49:52.009 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-12T00:49:53.520 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-12T00:49:55.025 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-12T00:49:56.241 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-12T00:49:57.165 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-12T00:49:58.185 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-12T00:50:00.093 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-12T00:50:02.470 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-12T00:50:03.561 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-12T00:50:05.113 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-12T00:50:06.665 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-12T00:50:08.097 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-12T00:50:09.667 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-12T00:50:11.345 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-12T00:50:12.901 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-12T00:50:14.409 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-12T00:50:15.429 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-12T00:50:16.301 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-12T00:50:17.213 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-12T00:50:18.121 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-12T00:50:19.585 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-12T00:50:21.070 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-12T00:50:22.550 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-12T00:50:24.038 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-12T00:50:25.542 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-12T00:50:27.053 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-12T00:50:28.521 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-12T00:50:30.005 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-12T00:50:31.437 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-12T00:50:32.894 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T00:50:34.425 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-12T00:50:35.909 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-12T00:50:36.933 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-12T00:50:37.925 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-12T00:50:38.886 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T00:50:39.853 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-12T00:50:40.716 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-12T00:50:41.573 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-12T00:50:42.336 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-12T00:50:43.084 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-12T00:50:43.780 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-12T00:50:44.549 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-12T00:50:45.264 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-12T00:50:46.056 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-12T00:50:46.776 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-12T00:50:48.040 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-12T00:50:49.260 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-12T00:50:49.944 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T00:50:50.688 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T00:50:51.428 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-12T00:50:52.156 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-12T00:50:53.384 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T00:50:54.589 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T00:50:55.328 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-12T00:50:56.336 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-12T00:50:57.092 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-12T00:50:57.804 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-12T00:50:58.525 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-12T00:50:59.248 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-12T00:50:59.989 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-12T00:51:00.756 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-12T00:51:01.504 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-12T00:51:02.212 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-12T00:51:02.968 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-12T00:51:03.692 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-12T00:51:04.408 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-12T00:51:05.140 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-12T00:51:05.933 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-12T00:51:06.644 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-12T00:51:07.376 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-12T00:51:29.017 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-12T00:51:29.756 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-12T00:51:30.456 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-12T00:51:31.152 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-12T00:51:31.860 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-12T00:51:32.568 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-12T00:51:33.256 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-12T00:51:34.020 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-12T00:51:34.728 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-12T00:51:35.480 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-12T00:51:36.188 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-12T00:51:36.912 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-12T00:51:37.640 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-12T00:51:38.344 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T00:51:39.136 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T00:51:39.852 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T00:51:40.584 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T00:51:41.308 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-12T00:51:42.036 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-12T00:51:42.792 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T00:51:43.612 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T00:51:44.348 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T00:51:45.068 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T00:51:45.852 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-12T00:51:46.624 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-12T00:51:47.376 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-12T00:51:48.104 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-12T00:51:48.912 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-12T00:51:49.616 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-12T00:51:50.016 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-12T00:51:50.640 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-12T00:51:52.080 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-12T00:51:53.545 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-12T00:51:54.272 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-12T00:51:55.008 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-12T00:51:55.732 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-12T00:51:56.492 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-12T00:51:57.268 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-12T00:51:58.036 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-12T00:51:58.832 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-12T00:51:59.584 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-12T00:52:00.336 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-12T00:52:01.048 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-12T00:52:01.780 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-12T00:52:02.480 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-12T00:52:03.448 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-12T00:52:04.573 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-12T00:52:05.240 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-12T00:52:05.896 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-12T00:52:06.500 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-12T00:52:07.112 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-12T00:52:07.544 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-12T00:52:07.944 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-12T00:52:08.420 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-12T00:52:09.120 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-12T00:52:09.780 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-12T00:52:10.180 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-12T00:52:10.804 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-12T00:52:11.332 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-12T00:52:11.908 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-12T00:52:12.488 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-12T00:52:13.512 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-12T00:52:14.420 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-12T00:52:15.304 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-12T00:52:37.396 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-12T00:52:58.968 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-12T00:52:59.648 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-12T00:53:00.237 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-12T00:53:00.924 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-12T00:53:01.544 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-12T00:53:02.232 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-12T00:53:02.852 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-12T00:53:03.480 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-12T00:53:04.272 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-12T00:53:04.953 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-12T00:53:05.660 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-12T00:53:06.316 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-12T00:53:06.992 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-12T00:53:07.628 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-12T00:53:08.204 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-12T00:53:08.824 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-12T00:53:09.456 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-12T00:53:10.224 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-12T00:53:11.012 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-12T00:53:11.669 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-12T00:53:12.268 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-12T00:53:12.968 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-12T00:53:13.642 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-12T00:53:14.252 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-12T00:53:14.852 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-12T00:53:15.436 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-12T00:53:16.032 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-12T00:53:16.704 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-12T00:53:17.276 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-12T00:53:17.948 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-12T00:53:18.520 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-12T00:53:19.100 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-12T00:53:19.692 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-12T00:53:20.284 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-12T00:53:21.068 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-12T00:53:21.648 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-12T00:53:22.304 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-12T00:53:22.880 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-12T00:53:23.480 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-12T00:53:24.112 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-12T00:53:24.700 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-12T00:53:25.288 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-12T00:53:25.964 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-12T00:53:26.568 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-12T00:53:27.272 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-12T00:53:27.945 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-12T00:53:28.636 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-12T00:53:29.336 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-12T00:53:30.040 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-12T00:53:31.740 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-12T00:53:32.448 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-12T00:53:33.100 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-12T00:53:33.840 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-12T00:53:34.636 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-12T00:53:35.352 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-12T00:53:36.088 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-12T00:53:37.040 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-12T00:53:37.868 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-12T00:53:38.604 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-12T00:53:39.424 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-12T00:53:40.092 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-12T00:53:40.712 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-12T00:53:41.364 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-12T00:53:42.120 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-12T00:53:42.656 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-12T00:53:43.056 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-12T00:53:43.832 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-12T00:53:44.496 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-12T00:53:45.172 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-12T00:53:48.156 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-12T00:53:48.840 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-12T00:53:49.492 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-12T00:53:50.092 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-12T00:53:50.788 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-12T00:53:51.404 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-12T00:53:52.044 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-12T00:53:52.740 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-12T00:53:53.444 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-12T00:53:54.140 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-12T00:53:54.796 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-12T00:53:55.488 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-12T00:53:56.252 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-12T00:53:56.880 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-12T00:53:57.560 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-12T00:53:58.276 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-12T00:53:59.012 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-12T00:53:59.704 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-12T00:54:00.108 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-12T00:54:00.516 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-12T00:54:00.912 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-12T00:54:01.524 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-12T00:54:02.032 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-12T00:54:02.576 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-12T00:54:03.100 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-12T00:54:03.696 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-12T00:54:04.092 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-12T00:54:04.520 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-12T00:54:05.044 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-12T00:54:05.440 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-12T00:54:05.840 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-12T00:54:06.268 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-12T00:54:06.664 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-12T00:54:07.220 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-12T00:54:07.804 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-12T00:54:08.436 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-12T00:54:09.020 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-12T00:54:09.676 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-12T00:54:10.252 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-12T00:54:10.840 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-12T00:54:11.476 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-12T00:54:12.052 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T00:54:12.628 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T00:54:13.328 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-12T00:54:14.016 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-12T00:54:14.788 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-12T00:54:15.480 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T00:54:16.232 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T00:54:16.965 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-12T00:54:17.744 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-12T00:54:18.468 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-12T00:54:19.220 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-12T00:54:19.796 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-12T00:54:20.572 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-12T00:54:21.340 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-12T00:54:22.196 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-12T00:54:22.932 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-12T00:54:23.700 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-12T00:54:24.732 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-12T00:54:25.704 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-12T00:54:26.632 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-12T00:54:27.612 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-12T00:54:28.580 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-12T00:54:29.244 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-12T00:54:29.968 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-12T00:54:30.696 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-12T00:54:31.392 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-12T00:54:32.036 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-12T00:54:32.808 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-12T00:54:33.916 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-12T00:54:34.956 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-12T00:54:35.996 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-12T00:54:36.988 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-12T00:54:38.016 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-12T00:54:39.116 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-12T00:54:40.192 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-12T00:54:41.244 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-12T00:54:42.244 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-12T00:54:43.124 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-12T00:54:44.140 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-12T00:54:45.060 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-12T00:54:46.304 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-12T00:54:47.508 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-12T00:54:47.904 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-12T00:54:48.308 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-12T00:54:48.712 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-12T00:54:49.412 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-12T00:54:50.044 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-12T00:54:50.596 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-12T00:54:51.108 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-12T00:54:52.012 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-12T00:54:53.660 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-12T00:54:54.500 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-12T00:54:55.268 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-12T00:54:56.172 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-12T00:54:56.937 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-12T00:54:57.732 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-12T00:54:58.524 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-12T00:54:59.224 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-12T00:55:00.216 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-12T00:55:01.056 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-12T00:55:01.988 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-12T00:55:02.836 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-12T00:55:03.980 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-12T00:55:05.012 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-12T00:55:05.624 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-12T00:55:06.180 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-12T00:55:07.968 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-12T00:55:08.792 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-12T00:55:11.916 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-12T00:55:12.596 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-12T00:55:13.400 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-12T00:55:14.872 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-12T00:55:15.616 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-12T00:55:16.848 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-12T00:55:19.996 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-12T00:55:23.520 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-12T00:55:27.784 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-12T00:55:45.144 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-12T00:55:47.680 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-12T00:55:52.312 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-12T00:55:53.316 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-12T00:55:54.700 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-12T00:55:55.904 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-12T00:55:56.856 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-12T00:55:57.536 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-12T00:55:58.832 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-12T00:55:59.632 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-12T00:56:00.424 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-12T00:56:01.132 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-12T00:56:16.380 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-12T00:56:18.904 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-12T00:56:19.664 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-12T00:56:20.221 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-12T00:56:20.928 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-12T00:56:26.384 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-12T00:56:30.204 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-12T00:56:33.888 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-12T00:56:34.612 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-12T00:56:35.296 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-12T00:56:36.024 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-12T00:56:36.740 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-12T00:56:37.468 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-12T00:56:38.196 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-12T00:56:38.896 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-12T00:56:39.860 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-12T00:56:40.892 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-12T00:56:42.016 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-12T00:56:43.040 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-12T00:56:44.172 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-12T00:56:45.616 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-12T00:56:46.500 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-12T00:56:47.576 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-12T00:56:48.796 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-12T00:56:49.788 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-12T00:56:50.624 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-12T00:56:51.768 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-12T00:56:52.468 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-12T00:56:57.372 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-12T00:56:58.052 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-12T00:56:58.788 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-12T00:56:59.432 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-12T00:57:00.115 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-12T00:57:01.240 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-12T00:57:09.869 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-12T00:57:10.852 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-12T00:57:11.772 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-12T00:57:12.816 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-12T00:57:13.892 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-12T00:57:17.676 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-12T00:57:18.776 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-12T00:57:23.240 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-12T00:57:39.060 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-12T00:57:43.332 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-12T00:57:45.032 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-12T00:57:46.860 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-12T00:57:47.772 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-12T00:57:48.860 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-12T00:57:49.647 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-12T00:57:50.728 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-12T00:57:51.756 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-12T00:57:52.808 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-12T00:57:53.432 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-12T00:57:54.084 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-12T00:57:54.808 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-12T00:57:55.428 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-12T00:57:56.008 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-12T00:57:56.688 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-12T00:57:57.276 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-12T00:57:57.856 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-12T00:57:58.552 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-12T00:57:59.108 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-12T00:57:59.688 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-12T00:58:00.268 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-12T00:58:00.900 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-12T00:58:01.508 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-12T00:58:02.184 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-12T00:58:02.896 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-12T00:58:03.628 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-12T00:58:04.321 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-12T00:58:04.992 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-12T00:58:05.688 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-12T00:58:06.440 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-12T00:58:07.068 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-12T00:58:07.696 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-12T00:58:08.320 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-12T00:58:08.912 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-12T00:58:14.232 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-12T00:58:19.721 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-12T00:58:21.652 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-12T00:58:22.396 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-12T00:59:24.040 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-12T01:00:24.852 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-12T01:00:25.553 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-12T01:00:26.224 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-12T01:00:26.800 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-12T01:00:27.388 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-12T01:00:31.484 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-12T01:00:33.144 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-12T01:00:34.780 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-12T01:00:35.440 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-12T01:00:36.156 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-12T01:00:36.868 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-12T01:00:37.608 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-12T01:00:38.308 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-12T01:00:39.032 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-12T01:00:39.809 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-12T01:00:40.568 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-12T01:00:41.324 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-12T01:00:42.124 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-12T01:00:42.868 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-12T01:00:43.540 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-12T01:00:44.604 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-12T01:00:45.780 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-12T01:00:46.684 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-12T01:00:47.576 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-12T01:00:48.472 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-12T01:00:49.380 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-12T01:00:50.276 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-12T01:00:51.268 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-12T01:00:52.168 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-12T01:00:53.080 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-12T01:00:54.068 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-12T01:00:54.760 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-12T01:00:55.484 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-12T01:00:56.216 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-12T01:00:57.156 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-12T01:00:58.088 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-12T01:00:59.044 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-12T01:01:00.432 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-12T01:01:04.950 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-12T01:01:05.836 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-12T01:01:06.816 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T01:01:07.776 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T01:01:08.960 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-12T01:01:10.068 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-12T01:01:10.780 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-12T01:01:11.880 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-12T01:01:12.480 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-12T01:01:13.164 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-12T01:01:13.749 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-12T01:01:14.324 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-12T01:01:15.040 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-12T01:01:15.668 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-12T01:01:16.636 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-12T01:01:17.228 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-12T01:01:17.800 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-12T01:01:18.360 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-12T01:01:18.968 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-12T01:01:19.552 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-12T01:01:20.256 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-12T01:01:20.816 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-12T01:01:21.380 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-12T01:01:21.968 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-12T01:01:22.560 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-12T01:01:23.204 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-12T01:01:23.868 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-12T01:01:24.576 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-12T01:01:25.260 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-12T01:01:25.972 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-12T01:01:26.600 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-12T01:01:27.356 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-12T01:01:28.040 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-12T01:01:28.744 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-12T01:01:29.468 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-12T01:01:30.148 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-12T01:01:30.852 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-12T01:01:31.660 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-12T01:01:32.448 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-12T01:01:33.140 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-12T01:01:33.812 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-12T01:01:34.536 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-12T01:01:35.188 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-12T01:01:35.920 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-12T01:01:36.560 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-12T01:01:37.252 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T01:01:38.064 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T01:01:38.669 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-12T01:01:39.340 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-12T01:01:39.948 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-12T01:01:50.428 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-12T01:01:51.116 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-12T01:02:01.392 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-12T01:02:02.148 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-12T01:02:02.896 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-12T01:02:03.492 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-12T01:02:04.128 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T01:02:04.776 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T01:02:05.436 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T01:02:06.144 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-12T01:02:06.742 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-12T01:02:07.320 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-12T01:02:07.972 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-12T01:02:08.644 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-12T01:02:09.288 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-12T01:02:10.116 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-12T01:02:10.872 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-12T01:02:11.512 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-12T01:02:12.161 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-12T01:02:13.024 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-12T01:02:15.464 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-12T01:02:16.092 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:02:16.776 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:02:17.472 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:02:18.240 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-12T01:02:19.088 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-12T01:02:19.776 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-12T01:02:20.888 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-12T01:02:22.156 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-12T01:02:22.928 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-12T01:02:30.336 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-12T01:02:37.549 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-12T01:02:38.128 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-12T01:02:38.960 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-12T01:02:41.044 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-12T01:02:43.044 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-12T01:02:44.660 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-12T01:02:45.676 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-12T01:02:46.724 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-12T01:02:47.624 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-12T01:02:48.272 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-12T01:02:49.996 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-12T01:02:51.464 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-12T01:02:54.120 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-12T01:02:55.580 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-12T01:02:56.601 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-12T01:02:57.348 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-12T01:02:58.028 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-12T01:02:59.104 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-12T01:03:00.057 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-12T01:03:01.024 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-12T01:03:01.960 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-12T01:03:02.993 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-12T01:03:03.912 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-12T01:03:05.084 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-12T01:03:06.204 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-12T01:03:06.536 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-12T01:03:07.996 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-12T01:03:09.236 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-12T01:03:10.168 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-12T01:03:11.012 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-12T01:03:11.788 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-12T01:03:22.668 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-12T01:03:23.076 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-12T01:03:23.979 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-12T01:03:24.729 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-12T01:03:25.376 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-12T01:03:26.196 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-12T01:03:26.240 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-12T01:03:26.241 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:03:26.241 INFO:teuthology.orchestra.run.smithi043.stdout:=============================== warnings summary =============================== 2024-09-12T01:03:26.241 INFO:teuthology.orchestra.run.smithi043.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-12T01:03:26.241 INFO:teuthology.orchestra.run.smithi043.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-12T01:03:26.241 INFO:teuthology.orchestra.run.smithi043.stdout: import imp 2024-09-12T01:03:26.241 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:03:26.241 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py:120 2024-09-12T01:03:26.241 INFO:teuthology.orchestra.run.smithi043.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T01:03:26.241 INFO:teuthology.orchestra.run.smithi043.stdout: if boto_type is 'S3Connection': 2024-09-12T01:03:26.241 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:03:26.242 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_headers.py:124 2024-09-12T01:03:26.242 INFO:teuthology.orchestra.run.smithi043.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T01:03:26.242 INFO:teuthology.orchestra.run.smithi043.stdout: elif boto_type is 'HTTPRequest': 2024-09-12T01:03:26.242 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:03:26.242 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3.py:359 2024-09-12T01:03:26.242 INFO:teuthology.orchestra.run.smithi043.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence '\W' 2024-09-12T01:03:26.242 INFO:teuthology.orchestra.run.smithi043.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-12T01:03:26.242 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:03:26.242 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py:176 2024-09-12T01:03:26.242 INFO:teuthology.orchestra.run.smithi043.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T01:03:26.242 INFO:teuthology.orchestra.run.smithi043.stdout: if k is 'BucketName': 2024-09-12T01:03:26.242 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:03:26.243 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py:253 2024-09-12T01:03:26.243 INFO:teuthology.orchestra.run.smithi043.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-12T01:03:26.243 INFO:teuthology.orchestra.run.smithi043.stdout: @pytest.mark.timeout(10) 2024-09-12T01:03:26.243 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:03:26.243 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-12T01:03:26.243 INFO:teuthology.orchestra.run.smithi043.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-12T01:03:26.243 INFO:teuthology.orchestra.run.smithi043.stdout: @pytest.mark.s3website_routing_rules 2024-09-12T01:03:26.243 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:03:26.243 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-12T01:03:26.243 INFO:teuthology.orchestra.run.smithi043.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:03:26.243 INFO:teuthology.orchestra.run.smithi043.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:03:26.243 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:03:26.244 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-12T01:03:26.244 INFO:teuthology.orchestra.run.smithi043.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:03:26.244 INFO:teuthology.orchestra.run.smithi043.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T01:03:26.244 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:03:26.244 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-12T01:03:26.244 INFO:teuthology.orchestra.run.smithi043.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:03:26.244 INFO:teuthology.orchestra.run.smithi043.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-12T01:03:26.244 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:03:26.244 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-12T01:03:26.244 INFO:teuthology.orchestra.run.smithi043.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:03:26.244 INFO:teuthology.orchestra.run.smithi043.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:03:26.244 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:03:26.245 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-12T01:03:26.245 INFO:teuthology.orchestra.run.smithi043.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:03:26.245 INFO:teuthology.orchestra.run.smithi043.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T01:03:26.245 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:03:26.245 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-12T01:03:26.245 INFO:teuthology.orchestra.run.smithi043.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:03:26.245 INFO:teuthology.orchestra.run.smithi043.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:03:26.245 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:03:26.245 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-12T01:03:26.246 INFO:teuthology.orchestra.run.smithi043.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:03:26.246 INFO:teuthology.orchestra.run.smithi043.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-12T01:03:26.246 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:03:26.246 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-12T01:03:26.246 INFO:teuthology.orchestra.run.smithi043.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:03:26.246 INFO:teuthology.orchestra.run.smithi043.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:03:26.246 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:03:26.246 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-12T01:03:26.246 INFO:teuthology.orchestra.run.smithi043.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:03:26.246 INFO:teuthology.orchestra.run.smithi043.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T01:03:26.247 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:03:26.247 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-12T01:03:26.247 INFO:teuthology.orchestra.run.smithi043.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:03:26.247 INFO:teuthology.orchestra.run.smithi043.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:03:26.247 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:03:26.247 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-12T01:03:26.247 INFO:teuthology.orchestra.run.smithi043.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:03:26.247 INFO:teuthology.orchestra.run.smithi043.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:03:26.247 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:03:26.247 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_headers.py: 29 warnings 2024-09-12T01:03:26.247 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_iam.py: 82 warnings 2024-09-12T01:03:26.247 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py: 497 warnings 2024-09-12T01:03:26.248 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3select.py: 33 warnings 2024-09-12T01:03:26.248 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_sns.py: 3 warnings 2024-09-12T01:03:26.248 INFO:teuthology.orchestra.run.smithi043.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi043.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:03:26.248 INFO:teuthology.orchestra.run.smithi043.stdout: warnings.warn( 2024-09-12T01:03:26.248 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:03:26.248 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T01:03:26.248 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T01:03:26.248 INFO:teuthology.orchestra.run.smithi043.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:6540: DeprecationWarning: ssl.wrap_socket() is deprecated, use SSLContext.wrap_socket() 2024-09-12T01:03:26.248 INFO:teuthology.orchestra.run.smithi043.stdout: s = ssl.wrap_socket(s); 2024-09-12T01:03:26.248 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:03:26.248 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T01:03:26.248 INFO:teuthology.orchestra.run.smithi043.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T01:03:26.248 INFO:teuthology.orchestra.run.smithi043.stdout: /usr/lib/python3.10/ssl.py:1434: DeprecationWarning: ssl.PROTOCOL_TLS is deprecated 2024-09-12T01:03:26.249 INFO:teuthology.orchestra.run.smithi043.stdout: context = SSLContext(ssl_version) 2024-09-12T01:03:26.249 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:03:26.249 INFO:teuthology.orchestra.run.smithi043.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T01:03:26.249 INFO:teuthology.orchestra.run.smithi043.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 666 warnings in 906.08s (0:15:06) = 2024-09-12T01:03:26.426 INFO:teuthology.orchestra.run.smithi043.stdout:___________________________________ summary ____________________________________ 2024-09-12T01:03:26.426 INFO:teuthology.orchestra.run.smithi043.stdout: py: commands succeeded 2024-09-12T01:03:26.427 INFO:teuthology.orchestra.run.smithi043.stdout: congratulations :) 2024-09-12T01:03:26.465 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-12T01:03:26.466 DEBUG:teuthology.orchestra.run.smithi043:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T01:03:26.568 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:03:26.569 INFO:tasks.s3tests:Cleaning up boto... 2024-09-12T01:03:26.569 DEBUG:teuthology.orchestra.run.smithi043:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T01:03:26.575 INFO:tasks.s3tests:Removing s3-tests... 2024-09-12T01:03:26.575 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T01:03:26.773 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T01:03:26.785 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T01:03:26.785 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T01:03:26.785 DEBUG:teuthology.orchestra.run.smithi043:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:03:26.791 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:03:26.791 INFO:teuthology.orchestra.run.smithi043.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T01:03:26.792 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:03:26.837 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T01:03:26.837 DEBUG:teuthology.orchestra.run.smithi043:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T01:03:26.885 INFO:tasks.workunit:timeout=3h 2024-09-12T01:03:26.885 INFO:tasks.workunit:cleanup=True 2024-09-12T01:03:26.886 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T01:03:26.936 INFO:tasks.workunit.client.0.smithi043.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T01:04:11.351 INFO:tasks.workunit.client.0.smithi043.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T01:04:11.351 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T01:04:11.351 INFO:tasks.workunit.client.0.smithi043.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T01:04:11.351 INFO:tasks.workunit.client.0.smithi043.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T01:04:11.351 INFO:tasks.workunit.client.0.smithi043.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T01:04:11.351 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T01:04:11.351 INFO:tasks.workunit.client.0.smithi043.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T01:04:11.352 INFO:tasks.workunit.client.0.smithi043.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T01:04:11.352 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T01:04:11.352 INFO:tasks.workunit.client.0.smithi043.stderr: git switch -c 2024-09-12T01:04:11.352 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T01:04:11.352 INFO:tasks.workunit.client.0.smithi043.stderr:Or undo this operation with: 2024-09-12T01:04:11.352 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T01:04:11.352 INFO:tasks.workunit.client.0.smithi043.stderr: git switch - 2024-09-12T01:04:11.352 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T01:04:11.352 INFO:tasks.workunit.client.0.smithi043.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T01:04:11.352 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T01:04:11.352 INFO:tasks.workunit.client.0.smithi043.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T01:04:11.357 DEBUG:teuthology.orchestra.run.smithi043:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T01:04:11.407 INFO:tasks.workunit.client.0.smithi043.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T01:04:11.409 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T01:04:11.409 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T01:04:11.467 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T01:04:11.523 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T01:04:11.565 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T01:04:11.566 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T01:04:11.566 INFO:tasks.workunit.client.0.smithi043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T01:04:11.615 INFO:tasks.workunit.client.0.smithi043.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T01:04:11.619 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-12T01:04:11.619 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T01:04:11.666 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-12T01:04:11.667 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-12T01:04:11.667 DEBUG:teuthology.orchestra.run.smithi043:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T01:04:11.719 INFO:tasks.workunit.client.0.smithi043.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T01:04:11.720 INFO:tasks.workunit.client.0.smithi043.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T01:04:11.720 INFO:tasks.workunit.client.0.smithi043.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T01:04:14.796 INFO:tasks.workunit.client.0.smithi043.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T01:04:14.796 INFO:tasks.workunit.client.0.smithi043.stderr:++ deactivate nondestructive 2024-09-12T01:04:14.796 INFO:tasks.workunit.client.0.smithi043.stderr:++ '[' -n '' ']' 2024-09-12T01:04:14.796 INFO:tasks.workunit.client.0.smithi043.stderr:++ '[' -n '' ']' 2024-09-12T01:04:14.796 INFO:tasks.workunit.client.0.smithi043.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:04:14.796 INFO:tasks.workunit.client.0.smithi043.stderr:++ hash -r 2024-09-12T01:04:14.796 INFO:tasks.workunit.client.0.smithi043.stderr:++ '[' -n '' ']' 2024-09-12T01:04:14.796 INFO:tasks.workunit.client.0.smithi043.stderr:++ unset VIRTUAL_ENV 2024-09-12T01:04:14.796 INFO:tasks.workunit.client.0.smithi043.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T01:04:14.797 INFO:tasks.workunit.client.0.smithi043.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T01:04:14.797 INFO:tasks.workunit.client.0.smithi043.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T01:04:14.798 INFO:tasks.workunit.client.0.smithi043.stderr:++ export VIRTUAL_ENV 2024-09-12T01:04:14.798 INFO:tasks.workunit.client.0.smithi043.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T01:04:14.798 INFO:tasks.workunit.client.0.smithi043.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T01:04:14.798 INFO:tasks.workunit.client.0.smithi043.stderr:++ export PATH 2024-09-12T01:04:14.798 INFO:tasks.workunit.client.0.smithi043.stderr:++ '[' -n '' ']' 2024-09-12T01:04:14.798 INFO:tasks.workunit.client.0.smithi043.stderr:++ '[' -z '' ']' 2024-09-12T01:04:14.798 INFO:tasks.workunit.client.0.smithi043.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T01:04:14.798 INFO:tasks.workunit.client.0.smithi043.stderr:++ PS1='(rgw) ' 2024-09-12T01:04:14.799 INFO:tasks.workunit.client.0.smithi043.stderr:++ export PS1 2024-09-12T01:04:14.799 INFO:tasks.workunit.client.0.smithi043.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T01:04:14.799 INFO:tasks.workunit.client.0.smithi043.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T01:04:14.799 INFO:tasks.workunit.client.0.smithi043.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:04:14.799 INFO:tasks.workunit.client.0.smithi043.stderr:++ hash -r 2024-09-12T01:04:14.799 INFO:tasks.workunit.client.0.smithi043.stderr:+ pip install pip --upgrade 2024-09-12T01:04:15.176 INFO:tasks.workunit.client.0.smithi043.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T01:04:15.385 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting pip 2024-09-12T01:04:15.391 INFO:tasks.workunit.client.0.smithi043.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T01:04:15.427 INFO:tasks.workunit.client.0.smithi043.stdout:Installing collected packages: pip 2024-09-12T01:04:15.427 INFO:tasks.workunit.client.0.smithi043.stdout: Attempting uninstall: pip 2024-09-12T01:04:15.427 INFO:tasks.workunit.client.0.smithi043.stdout: Found existing installation: pip 22.0.2 2024-09-12T01:04:15.697 INFO:tasks.workunit.client.0.smithi043.stdout: Uninstalling pip-22.0.2: 2024-09-12T01:04:15.703 INFO:tasks.workunit.client.0.smithi043.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T01:04:16.473 INFO:tasks.workunit.client.0.smithi043.stdout:Successfully installed pip-24.2 2024-09-12T01:04:16.532 INFO:tasks.workunit.client.0.smithi043.stderr:+ pip install boto3 2024-09-12T01:04:17.573 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting boto3 2024-09-12T01:04:17.574 INFO:tasks.workunit.client.0.smithi043.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T01:04:18.165 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T01:04:18.167 INFO:tasks.workunit.client.0.smithi043.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T01:04:18.214 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T01:04:18.215 INFO:tasks.workunit.client.0.smithi043.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T01:04:18.269 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T01:04:18.270 INFO:tasks.workunit.client.0.smithi043.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T01:04:18.335 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T01:04:18.337 INFO:tasks.workunit.client.0.smithi043.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T01:04:18.447 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T01:04:18.449 INFO:tasks.workunit.client.0.smithi043.stdout: Using cached urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-09-12T01:04:18.700 INFO:tasks.workunit.client.0.smithi043.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T01:04:18.701 INFO:tasks.workunit.client.0.smithi043.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T01:04:18.705 INFO:tasks.workunit.client.0.smithi043.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T01:04:18.706 INFO:tasks.workunit.client.0.smithi043.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T01:04:18.715 INFO:tasks.workunit.client.0.smithi043.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T01:04:18.717 INFO:tasks.workunit.client.0.smithi043.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T01:04:18.718 INFO:tasks.workunit.client.0.smithi043.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T01:04:18.720 INFO:tasks.workunit.client.0.smithi043.stdout:Using cached urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-09-12T01:04:18.721 INFO:tasks.workunit.client.0.smithi043.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T01:04:18.792 INFO:tasks.workunit.client.0.smithi043.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T01:04:19.982 INFO:tasks.workunit.client.0.smithi043.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-09-12T01:04:20.210 INFO:tasks.workunit.client.0.smithi043.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-12T01:04:20.354 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-12T01:04:20.394 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:20.394 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:20.437 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.438+0000 7fa20c2679c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:20.438 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.438+0000 7fa20c2679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:20.438 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.438+0000 7fa20c2679c0 20 realm 2024-09-12T01:04:20.439 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.438+0000 7fa20c2679c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:20.439 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.438+0000 7fa20c2679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:20.439 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.438+0000 7fa20c2679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:20.439 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.438+0000 7fa20c2679c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:20.439 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.438+0000 7fa20c2679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:20.440 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.438+0000 7fa20c2679c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:20.441 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.442+0000 7fa20c2679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:20.441 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.442+0000 7fa20c2679c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:20.442 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.442+0000 7fa20c2679c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:20.442 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.442+0000 7fa20c2679c0 20 searching for the correct realm 2024-09-12T01:04:20.448 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.450+0000 7fa20a56e640 0 -- 172.21.15.43:0/719789568 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7fa200008040 msgr2=0x7fa200018920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:20.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.666+0000 7fa209d6d640 0 -- 172.21.15.43:0/719789568 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x55e1b3609550 msgr2=0x55e1b360b960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:20.675 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.674+0000 7fa20c2679c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T01:04:20.675 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.674+0000 7fa20c2679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:20.676 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.674+0000 7fa20c2679c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:20.676 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.674+0000 7fa20c2679c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T01:04:20.676 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.674+0000 7fa20c2679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:20.676 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.674+0000 7fa20c2679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:20.676 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.674+0000 7fa20c2679c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:20.676 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.674+0000 7fa20c2679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:20.676 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.674+0000 7fa20c2679c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:20.677 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.678+0000 7fa20c2679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:20.677 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.678+0000 7fa20c2679c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:20.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.678+0000 7fa20c2679c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:20.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.678+0000 7fa20c2679c0 20 zone default found 2024-09-12T01:04:20.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.678+0000 7fa20c2679c0 4 Realm: () 2024-09-12T01:04:20.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.678+0000 7fa20c2679c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T01:04:20.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.678+0000 7fa20c2679c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T01:04:20.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.678+0000 7fa20c2679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:20.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.678+0000 7fa20c2679c0 20 zonegroup default 2024-09-12T01:04:20.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.678+0000 7fa20c2679c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:20.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.678+0000 7fa20c2679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:20.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.678+0000 7fa20c2679c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:20.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.678+0000 7fa20c2679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:20.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.678+0000 7fa20c2679c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:20.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.682+0000 7fa20c2679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:20.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.682+0000 7fa20c2679c0 20 started sync module instance, tier type = 2024-09-12T01:04:20.680 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.682+0000 7fa20c2679c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T01:04:20.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.702+0000 7fa20c2679c0 20 add_watcher() i=0 2024-09-12T01:04:20.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.702+0000 7fa20c2679c0 20 add_watcher() i=1 2024-09-12T01:04:20.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.702+0000 7fa20c2679c0 20 add_watcher() i=2 2024-09-12T01:04:20.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.702+0000 7fa20c2679c0 20 add_watcher() i=3 2024-09-12T01:04:20.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.702+0000 7fa20c2679c0 20 add_watcher() i=4 2024-09-12T01:04:20.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.702+0000 7fa20c2679c0 20 add_watcher() i=5 2024-09-12T01:04:20.705 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.702+0000 7fa20c2679c0 20 add_watcher() i=6 2024-09-12T01:04:20.707 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.706+0000 7fa20c2679c0 20 add_watcher() i=7 2024-09-12T01:04:20.707 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.706+0000 7fa20c2679c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:20.711 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.710+0000 7fa0bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:20.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.710+0000 7fa20c2679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:20.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.710+0000 7fa20c2679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:20.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.710+0000 7fa20c2679c0 5 note: GC not initialized 2024-09-12T01:04:20.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.714+0000 7fa0ba7fc640 20 reqs_thread_entry: start 2024-09-12T01:04:20.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.714+0000 7fa20c2679c0 20 init_complete bucket index max shards: 11 2024-09-12T01:04:20.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.714+0000 7fa20c2679c0 20 Filter name: none 2024-09-12T01:04:20.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.714+0000 7fa02bfff640 20 reqs_thread_entry: start 2024-09-12T01:04:20.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.714+0000 7fa20c2679c0 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-12T01:04:20.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.714+0000 7fa20c2679c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:20.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.714+0000 7fa20c2679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:20.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.714+0000 7fa20c2679c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-12T01:04:20.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.714+0000 7fa20c2679c0 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T01:04:20.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.714+0000 7fa20c2679c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-12T01:04:20.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.714+0000 7fa20c2679c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:20.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.714+0000 7fa20c2679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:20.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.714+0000 7fa20c2679c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-12T01:04:20.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.714+0000 7fa20c2679c0 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T01:04:20.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.714+0000 7fa20c2679c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T01:04:20.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.714+0000 7fa20c2679c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T01:04:20.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.718+0000 7fa20c2679c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T01:04:20.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.718+0000 7fa20c2679c0 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T01:04:20.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.718+0000 7fa20c2679c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-12T01:04:20.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.718+0000 7fa0ed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235590 cookie 94427865514928 notifier 9234 bl.length()=613 2024-09-12T01:04:20.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.718+0000 7fa0ed7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T01:04:20.719 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.718+0000 7fa0ed7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T01:04:20.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.722+0000 7fa20c2679c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T01:04:20.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.722+0000 7fa20c2679c0 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T01:04:20.722 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.722+0000 7fa20c2679c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-12T01:04:20.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.722+0000 7fa0ed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235876 cookie 94427865510544 notifier 9234 bl.length()=191 2024-09-12T01:04:20.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.722+0000 7fa0ed7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T01:04:20.723 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.722+0000 7fa0ed7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T01:04:20.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.726+0000 7fa0bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:20.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.730+0000 7fa20c2679c0 20 remove_watcher() i=0 2024-09-12T01:04:20.730 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.730+0000 7fa20c2679c0 2 removed watcher, disabling cache 2024-09-12T01:04:20.732 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.730+0000 7fa20c2679c0 20 remove_watcher() i=1 2024-09-12T01:04:20.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.734+0000 7fa20c2679c0 20 remove_watcher() i=2 2024-09-12T01:04:20.736 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.738+0000 7fa20c2679c0 20 remove_watcher() i=3 2024-09-12T01:04:20.739 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.738+0000 7fa20c2679c0 20 remove_watcher() i=4 2024-09-12T01:04:20.740 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.738+0000 7fa20c2679c0 20 remove_watcher() i=5 2024-09-12T01:04:20.742 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.742+0000 7fa20c2679c0 20 remove_watcher() i=6 2024-09-12T01:04:20.743 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:20.742+0000 7fa20c2679c0 20 remove_watcher() i=7 2024-09-12T01:04:20.899 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:04:20.899 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T01:04:20.947 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:04:20.947 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T01:04:20.999 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:04:20.999 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T01:04:21.027 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:04:21.027 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T01:04:21.034 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-12T01:04:21.034 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T01:04:21.038 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:04:21.038 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T01:04:21.058 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:04:21.058 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T01:04:21.078 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:04:21.079 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T01:04:21.104 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T01:04:21.137 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:21.137 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:21.181 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.182+0000 7fec2579e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:21.184 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.182+0000 7fec2579e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:21.184 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.182+0000 7fec2579e9c0 20 realm 2024-09-12T01:04:21.184 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.182+0000 7fec2579e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:21.184 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.182+0000 7fec2579e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:21.184 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.182+0000 7fec2579e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:21.184 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.182+0000 7fec2579e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:21.184 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.182+0000 7fec2579e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:21.184 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.182+0000 7fec2579e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:21.186 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.186+0000 7fec2579e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:21.186 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.186+0000 7fec2579e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:21.187 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.186+0000 7fec2579e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:21.187 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.186+0000 7fec2579e9c0 20 searching for the correct realm 2024-09-12T01:04:21.194 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.194+0000 7fec23aa5640 0 -- 172.21.15.43:0/1218021359 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7fec1809b080 msgr2=0x7fec18057000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:04:21.411 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.410+0000 7fec232a4640 0 -- 172.21.15.43:0/1218021359 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x559b4ccb7fe0 msgr2=0x559b4ccba4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:21.419 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.418+0000 7fec2579e9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T01:04:21.419 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.418+0000 7fec2579e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:21.419 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.418+0000 7fec2579e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:21.419 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.418+0000 7fec2579e9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T01:04:21.419 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.418+0000 7fec2579e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:21.419 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.418+0000 7fec2579e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:21.419 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.418+0000 7fec2579e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:21.419 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.418+0000 7fec2579e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:21.420 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.418+0000 7fec2579e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:21.420 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.418+0000 7fec2579e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:21.420 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.418+0000 7fec2579e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:21.421 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.422+0000 7fec2579e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:21.421 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.422+0000 7fec2579e9c0 20 zone default found 2024-09-12T01:04:21.421 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.422+0000 7fec2579e9c0 4 Realm: () 2024-09-12T01:04:21.421 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.422+0000 7fec2579e9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T01:04:21.421 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.422+0000 7fec2579e9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T01:04:21.422 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.422+0000 7fec2579e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:21.422 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.422+0000 7fec2579e9c0 20 zonegroup default 2024-09-12T01:04:21.422 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.422+0000 7fec2579e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:21.422 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.422+0000 7fec2579e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:21.422 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.422+0000 7fec2579e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:21.423 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.422+0000 7fec2579e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:21.423 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.422+0000 7fec2579e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:21.423 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.422+0000 7fec2579e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:21.423 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.422+0000 7fec2579e9c0 20 started sync module instance, tier type = 2024-09-12T01:04:21.423 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.422+0000 7fec2579e9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T01:04:21.446 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.446+0000 7fec2579e9c0 20 add_watcher() i=0 2024-09-12T01:04:21.446 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.446+0000 7fec2579e9c0 20 add_watcher() i=1 2024-09-12T01:04:21.447 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.446+0000 7fec2579e9c0 20 add_watcher() i=2 2024-09-12T01:04:21.447 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.446+0000 7fec2579e9c0 20 add_watcher() i=3 2024-09-12T01:04:21.447 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.446+0000 7fec2579e9c0 20 add_watcher() i=4 2024-09-12T01:04:21.447 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.446+0000 7fec2579e9c0 20 add_watcher() i=5 2024-09-12T01:04:21.447 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.446+0000 7fec2579e9c0 20 add_watcher() i=6 2024-09-12T01:04:21.449 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.450+0000 7fec2579e9c0 20 add_watcher() i=7 2024-09-12T01:04:21.449 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.450+0000 7fec2579e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:21.453 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.454+0000 7fead9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:21.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.454+0000 7fec2579e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:21.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.454+0000 7fec2579e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:21.454 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.454+0000 7fec2579e9c0 5 note: GC not initialized 2024-09-12T01:04:21.455 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.454+0000 7fead8fe1640 20 reqs_thread_entry: start 2024-09-12T01:04:21.455 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.454+0000 7fec2579e9c0 20 init_complete bucket index max shards: 11 2024-09-12T01:04:21.455 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.454+0000 7fec2579e9c0 20 Filter name: none 2024-09-12T01:04:21.455 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.454+0000 7fea527fc640 20 reqs_thread_entry: start 2024-09-12T01:04:21.455 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.454+0000 7fec2579e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:21.456 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.454+0000 7fec2579e9c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T01:04:21.456 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.454+0000 7fec2579e9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:21.457 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.458+0000 7fec2579e9c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T01:04:21.457 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.458+0000 7fec2579e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:04:21.457 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.458+0000 7fec2579e9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T01:04:21.457 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.458+0000 7fec2579e9c0 20 INFO: main: starting shard=0 2024-09-12T01:04:21.457 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.458+0000 7fec2579e9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.0 2024-09-12T01:04:21.458 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.458+0000 7fec2579e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:04:21.458 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.458+0000 7fec2579e9c0 20 INFO: main: starting shard=1 2024-09-12T01:04:21.458 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.458+0000 7fec2579e9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.1 2024-09-12T01:04:21.458 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.458+0000 7fec2579e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:04:21.459 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.458+0000 7fec2579e9c0 20 INFO: main: starting shard=2 2024-09-12T01:04:21.459 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.458+0000 7fec2579e9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.2 2024-09-12T01:04:21.459 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.458+0000 7fec2579e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:04:21.459 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.458+0000 7fec2579e9c0 20 INFO: main: starting shard=3 2024-09-12T01:04:21.459 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.458+0000 7fec2579e9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.3 2024-09-12T01:04:21.460 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.462+0000 7fec2579e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:04:21.460 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.462+0000 7fec2579e9c0 20 INFO: main: starting shard=4 2024-09-12T01:04:21.461 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.462+0000 7fec2579e9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.4 2024-09-12T01:04:21.462 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.462+0000 7fec2579e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:04:21.462 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.462+0000 7fec2579e9c0 20 INFO: main: starting shard=5 2024-09-12T01:04:21.462 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.462+0000 7fec2579e9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.5 2024-09-12T01:04:21.464 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.462+0000 7fec2579e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:04:21.464 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.462+0000 7fec2579e9c0 20 INFO: main: starting shard=6 2024-09-12T01:04:21.464 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.462+0000 7fec2579e9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.6 2024-09-12T01:04:21.465 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.466+0000 7fec2579e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:04:21.465 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.466+0000 7fec2579e9c0 20 INFO: main: starting shard=7 2024-09-12T01:04:21.465 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.466+0000 7fec2579e9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.7 2024-09-12T01:04:21.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.466+0000 7fec2579e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:04:21.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.466+0000 7fec2579e9c0 20 INFO: main: starting shard=8 2024-09-12T01:04:21.466 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.466+0000 7fec2579e9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.8 2024-09-12T01:04:21.467 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.466+0000 7fec2579e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:04:21.467 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.466+0000 7fec2579e9c0 20 INFO: main: starting shard=9 2024-09-12T01:04:21.467 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.466+0000 7fec2579e9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.9 2024-09-12T01:04:21.468 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.470+0000 7fec2579e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:04:21.469 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.470+0000 7fec2579e9c0 20 INFO: main: starting shard=10 2024-09-12T01:04:21.469 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.470+0000 7fec2579e9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.10 2024-09-12T01:04:21.470 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.470+0000 7fec2579e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:04:21.470 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.470+0000 7fec2579e9c0 20 INFO: main: done 2024-09-12T01:04:21.472 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.470+0000 7fead9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:21.476 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.478+0000 7fec2579e9c0 20 remove_watcher() i=0 2024-09-12T01:04:21.477 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.478+0000 7fec2579e9c0 2 removed watcher, disabling cache 2024-09-12T01:04:21.479 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.478+0000 7fec2579e9c0 20 remove_watcher() i=1 2024-09-12T01:04:21.482 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.482+0000 7fec2579e9c0 20 remove_watcher() i=2 2024-09-12T01:04:21.484 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.486+0000 7fec2579e9c0 20 remove_watcher() i=3 2024-09-12T01:04:21.487 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.486+0000 7fec2579e9c0 20 remove_watcher() i=4 2024-09-12T01:04:21.488 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.490+0000 7fec2579e9c0 20 remove_watcher() i=5 2024-09-12T01:04:21.490 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.490+0000 7fec2579e9c0 20 remove_watcher() i=6 2024-09-12T01:04:21.492 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.490+0000 7fec2579e9c0 20 remove_watcher() i=7 2024-09-12T01:04:21.509 INFO:tasks.workunit.client.0.smithi043.stderr:rados -p default.rgw.buckets.data ls | grep 16077573-b844-41f1-a326-4115e7605a0c 2024-09-12T01:04:21.532 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:21.532 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:21.685 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:21.682+0000 7fc0fdf34640 0 -- 172.21.15.43:0/1031210811 >> [v2:172.21.15.43:6824/1864725413,v1:172.21.15.43:6825/1864725413] conn(0x7fc0f402ab10 msgr2=0x7fc0f4002050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:21.720 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-12T01:04:21.721 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T01:04:21.721 INFO:tasks.workunit.client.0.smithi043.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T01:04:23.177 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:04:23.178 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T01:04:23.194 INFO:tasks.workunit.client.0.smithi043.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T01:04:23.636 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T01:04:23.668 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:23.669 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:23.708 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.706+0000 7f4f0faee9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:23.710 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.710+0000 7f4f0faee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:23.710 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.710+0000 7f4f0faee9c0 20 realm 2024-09-12T01:04:23.710 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.710+0000 7f4f0faee9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:23.710 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.710+0000 7f4f0faee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:23.710 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.710+0000 7f4f0faee9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:23.710 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.710+0000 7f4f0faee9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:23.710 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.710+0000 7f4f0faee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:23.711 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.710+0000 7f4f0faee9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:23.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.710+0000 7f4f0faee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:23.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.710+0000 7f4f0faee9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:23.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.714+0000 7f4f0faee9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:23.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.714+0000 7f4f0faee9c0 20 searching for the correct realm 2024-09-12T01:04:23.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.718+0000 7f4f0ddf5640 0 -- 172.21.15.43:0/1831003629 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f4f040c8070 msgr2=0x7f4f040c2040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:04:23.934 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.934+0000 7f4f0d5f4640 0 -- 172.21.15.43:0/1831003629 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x56439b7b4080 msgr2=0x56439b7b6540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:23.942 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.942+0000 7f4f0faee9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T01:04:23.942 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.942+0000 7f4f0faee9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:23.942 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.942+0000 7f4f0faee9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:23.942 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.942+0000 7f4f0faee9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T01:04:23.942 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.942+0000 7f4f0faee9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:23.942 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.942+0000 7f4f0faee9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:23.942 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.942+0000 7f4f0faee9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:23.943 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.942+0000 7f4f0faee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:23.943 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.942+0000 7f4f0faee9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:23.943 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.942+0000 7f4f0faee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:23.943 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.942+0000 7f4f0faee9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:23.944 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.942+0000 7f4f0faee9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:23.944 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.942+0000 7f4f0faee9c0 20 zone default found 2024-09-12T01:04:23.944 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.942+0000 7f4f0faee9c0 4 Realm: () 2024-09-12T01:04:23.944 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.942+0000 7f4f0faee9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T01:04:23.944 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.942+0000 7f4f0faee9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T01:04:23.944 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.942+0000 7f4f0faee9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:23.945 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.942+0000 7f4f0faee9c0 20 zonegroup default 2024-09-12T01:04:23.945 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.942+0000 7f4f0faee9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:23.945 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.946+0000 7f4f0faee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:23.945 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.946+0000 7f4f0faee9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:23.945 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.946+0000 7f4f0faee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:23.946 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.946+0000 7f4f0faee9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:23.946 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.946+0000 7f4f0faee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:23.946 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.946+0000 7f4f0faee9c0 20 started sync module instance, tier type = 2024-09-12T01:04:23.946 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.946+0000 7f4f0faee9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T01:04:23.967 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.966+0000 7f4f0faee9c0 20 add_watcher() i=0 2024-09-12T01:04:23.967 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.966+0000 7f4f0faee9c0 20 add_watcher() i=1 2024-09-12T01:04:23.967 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.966+0000 7f4f0faee9c0 20 add_watcher() i=2 2024-09-12T01:04:23.968 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.966+0000 7f4f0faee9c0 20 add_watcher() i=3 2024-09-12T01:04:23.968 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.966+0000 7f4f0faee9c0 20 add_watcher() i=4 2024-09-12T01:04:23.968 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.966+0000 7f4f0faee9c0 20 add_watcher() i=5 2024-09-12T01:04:23.968 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.966+0000 7f4f0faee9c0 20 add_watcher() i=6 2024-09-12T01:04:23.969 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.970+0000 7f4f0faee9c0 20 add_watcher() i=7 2024-09-12T01:04:23.969 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.970+0000 7f4f0faee9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:23.973 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.974+0000 7f4dc37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:23.974 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.974+0000 7f4f0faee9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:23.974 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.974+0000 7f4f0faee9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:23.974 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.974+0000 7f4f0faee9c0 5 note: GC not initialized 2024-09-12T01:04:23.975 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.974+0000 7f4dc27e4640 20 reqs_thread_entry: start 2024-09-12T01:04:23.975 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.974+0000 7f4f0faee9c0 20 init_complete bucket index max shards: 11 2024-09-12T01:04:23.975 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.974+0000 7f4f0faee9c0 20 Filter name: none 2024-09-12T01:04:23.975 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.974+0000 7f4d33fff640 20 reqs_thread_entry: start 2024-09-12T01:04:23.975 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.974+0000 7f4f0faee9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:23.976 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.974+0000 7f4f0faee9c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T01:04:23.976 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.974+0000 7f4f0faee9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:23.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.978+0000 7f4f0faee9c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T01:04:23.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.978+0000 7f4f0faee9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:04:23.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.978+0000 7f4f0faee9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T01:04:23.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.978+0000 7f4f0faee9c0 20 INFO: main: starting shard=0 2024-09-12T01:04:23.977 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.978+0000 7f4f0faee9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.0 2024-09-12T01:04:23.978 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.978+0000 7f4f0faee9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:04:23.978 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.978+0000 7f4f0faee9c0 20 INFO: main: starting shard=1 2024-09-12T01:04:23.978 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.978+0000 7f4f0faee9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.1 2024-09-12T01:04:23.979 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.978+0000 7f4f0faee9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:04:23.979 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.978+0000 7f4f0faee9c0 20 INFO: main: starting shard=2 2024-09-12T01:04:23.979 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.978+0000 7f4f0faee9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.2 2024-09-12T01:04:23.979 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.978+0000 7f4f0faee9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:04:23.979 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.978+0000 7f4f0faee9c0 20 INFO: main: starting shard=3 2024-09-12T01:04:23.979 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.978+0000 7f4f0faee9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.3 2024-09-12T01:04:23.980 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.982+0000 7f4f0faee9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:04:23.980 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.982+0000 7f4f0faee9c0 20 INFO: main: starting shard=4 2024-09-12T01:04:23.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.982+0000 7f4f0faee9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.4 2024-09-12T01:04:23.981 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.982+0000 7f4f0faee9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:04:23.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.982+0000 7f4f0faee9c0 20 INFO: main: starting shard=5 2024-09-12T01:04:23.982 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.982+0000 7f4f0faee9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.5 2024-09-12T01:04:23.983 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.982+0000 7f4f0faee9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:04:23.983 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.982+0000 7f4f0faee9c0 20 INFO: main: starting shard=6 2024-09-12T01:04:23.983 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.982+0000 7f4f0faee9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.6 2024-09-12T01:04:23.983 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.982+0000 7f4f0faee9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:04:23.983 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.982+0000 7f4f0faee9c0 20 INFO: main: starting shard=7 2024-09-12T01:04:23.984 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.982+0000 7f4f0faee9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.7 2024-09-12T01:04:23.985 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.986+0000 7f4f0faee9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:04:23.985 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.986+0000 7f4f0faee9c0 20 INFO: main: starting shard=8 2024-09-12T01:04:23.985 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.986+0000 7f4f0faee9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.8 2024-09-12T01:04:23.986 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.986+0000 7f4f0faee9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:04:23.986 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.986+0000 7f4f0faee9c0 20 INFO: main: starting shard=9 2024-09-12T01:04:23.986 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.986+0000 7f4f0faee9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.9 2024-09-12T01:04:23.988 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.986+0000 7f4f0faee9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:04:23.988 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.986+0000 7f4f0faee9c0 20 INFO: main: starting shard=10 2024-09-12T01:04:23.988 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.986+0000 7f4f0faee9c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.10 2024-09-12T01:04:23.989 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.990+0000 7f4f0faee9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:04:23.989 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.990+0000 7f4f0faee9c0 20 INFO: main: done 2024-09-12T01:04:23.991 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.990+0000 7f4dc37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:23.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.994+0000 7f4f0faee9c0 20 remove_watcher() i=0 2024-09-12T01:04:23.996 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.994+0000 7f4f0faee9c0 2 removed watcher, disabling cache 2024-09-12T01:04:23.998 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:23.998+0000 7f4f0faee9c0 20 remove_watcher() i=1 2024-09-12T01:04:24.001 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:24.002+0000 7f4f0faee9c0 20 remove_watcher() i=2 2024-09-12T01:04:24.003 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:24.002+0000 7f4f0faee9c0 20 remove_watcher() i=3 2024-09-12T01:04:24.005 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:24.006+0000 7f4f0faee9c0 20 remove_watcher() i=4 2024-09-12T01:04:24.007 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:24.006+0000 7f4f0faee9c0 20 remove_watcher() i=5 2024-09-12T01:04:24.008 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:24.010+0000 7f4f0faee9c0 20 remove_watcher() i=6 2024-09-12T01:04:24.010 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:24.010+0000 7f4f0faee9c0 20 remove_watcher() i=7 2024-09-12T01:04:24.025 INFO:tasks.workunit.client.0.smithi043.stderr:rados -p default.rgw.buckets.data ls | grep a2b58410-c271-401c-896b-842adfd115aa 2024-09-12T01:04:24.052 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:24.052 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:24.206 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:24.206+0000 7fabb3453640 0 -- 172.21.15.43:0/3512622243 >> [v2:172.21.15.43:6808/2258408181,v1:172.21.15.43:6809/2258408181] conn(0x7fab9c0c8020 msgr2=0x7fab9c0f90f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:24.236 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-12T01:04:24.236 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T01:04:24.239 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:04:24.239 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T01:04:24.250 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:04:24.250 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T01:04:24.267 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:04:24.268 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T01:04:24.274 INFO:tasks.workunit.client.0.smithi043.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T01:04:25.737 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:04:25.737 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T01:04:25.809 INFO:tasks.workunit.client.0.smithi043.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T01:04:25.810 INFO:tasks.workunit.client.0.smithi043.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T01:04:26.259 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:04:26.259 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T01:04:26.269 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:04:26.269 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T01:04:26.319 INFO:tasks.workunit.client.0.smithi043.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-12T01:04:26.319 INFO:tasks.workunit.client.0.smithi043.stderr: 2024-09-12T01:04:26.322 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:04:26.323 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T01:04:26.376 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:04:26.376 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T01:04:26.431 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:04:26.431 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T01:04:26.449 INFO:tasks.workunit.client.0.smithi043.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-12T01:04:27.891 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:04:27.891 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T01:04:27.900 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:04:27.900 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T01:04:29.924 INFO:tasks.workunit.client.0.smithi043.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-12T01:04:30.369 INFO:tasks.workunit.client.0.smithi043.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-12T01:04:30.395 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:30.395 INFO:tasks.workunit.client.0.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:30.437 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.438+0000 7fcae76a49c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:30.438 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.438+0000 7fcae76a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:30.439 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.438+0000 7fcae76a49c0 20 realm 2024-09-12T01:04:30.439 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.438+0000 7fcae76a49c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:30.439 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.438+0000 7fcae76a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:30.439 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.438+0000 7fcae76a49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:30.439 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.438+0000 7fcae76a49c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:30.439 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.438+0000 7fcae76a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:30.439 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.438+0000 7fcae76a49c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:30.440 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.442+0000 7fcae76a49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:30.441 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.442+0000 7fcae76a49c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:30.441 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.442+0000 7fcae76a49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:30.441 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.442+0000 7fcae76a49c0 20 searching for the correct realm 2024-09-12T01:04:30.449 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.450+0000 7fcae59ab640 0 -- 172.21.15.43:0/3936633895 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7fcad80f6960 msgr2=0x7fcad80db420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:04:30.667 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.666+0000 7fcae51aa640 0 -- 172.21.15.43:0/3936633895 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x55f0e2ef6920 msgr2=0x55f0e2ef8d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:30.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.674+0000 7fcae76a49c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T01:04:30.674 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.674+0000 7fcae76a49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:30.675 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.674+0000 7fcae76a49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:30.675 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.674+0000 7fcae76a49c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T01:04:30.675 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.674+0000 7fcae76a49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:30.675 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.674+0000 7fcae76a49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:30.675 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.674+0000 7fcae76a49c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:30.675 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.674+0000 7fcae76a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:30.675 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.674+0000 7fcae76a49c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:30.676 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.674+0000 7fcae76a49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:30.676 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.674+0000 7fcae76a49c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:30.677 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.678+0000 7fcae76a49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:30.677 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.678+0000 7fcae76a49c0 20 zone default found 2024-09-12T01:04:30.677 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.678+0000 7fcae76a49c0 4 Realm: () 2024-09-12T01:04:30.677 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.678+0000 7fcae76a49c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T01:04:30.677 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.678+0000 7fcae76a49c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T01:04:30.677 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.678+0000 7fcae76a49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:30.677 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.678+0000 7fcae76a49c0 20 zonegroup default 2024-09-12T01:04:30.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.678+0000 7fcae76a49c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:30.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.678+0000 7fcae76a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:30.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.678+0000 7fcae76a49c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:30.678 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.678+0000 7fcae76a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:30.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.678+0000 7fcae76a49c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:30.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.678+0000 7fcae76a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:30.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.678+0000 7fcae76a49c0 20 started sync module instance, tier type = 2024-09-12T01:04:30.679 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.678+0000 7fcae76a49c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T01:04:30.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.702+0000 7fcae76a49c0 20 add_watcher() i=0 2024-09-12T01:04:30.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.702+0000 7fcae76a49c0 20 add_watcher() i=1 2024-09-12T01:04:30.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.702+0000 7fcae76a49c0 20 add_watcher() i=2 2024-09-12T01:04:30.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.702+0000 7fcae76a49c0 20 add_watcher() i=3 2024-09-12T01:04:30.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.702+0000 7fcae76a49c0 20 add_watcher() i=4 2024-09-12T01:04:30.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.702+0000 7fcae76a49c0 20 add_watcher() i=5 2024-09-12T01:04:30.704 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.702+0000 7fcae76a49c0 20 add_watcher() i=6 2024-09-12T01:04:30.706 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.706+0000 7fcae76a49c0 20 add_watcher() i=7 2024-09-12T01:04:30.706 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.706+0000 7fcae76a49c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:30.710 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.710+0000 7fc99afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:30.711 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.710+0000 7fcae76a49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:30.711 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.710+0000 7fcae76a49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:30.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.710+0000 7fcae76a49c0 5 note: GC not initialized 2024-09-12T01:04:30.712 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.710+0000 7fc999fdb640 20 reqs_thread_entry: start 2024-09-12T01:04:30.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.710+0000 7fcae76a49c0 20 init_complete bucket index max shards: 11 2024-09-12T01:04:30.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.714+0000 7fcae76a49c0 20 Filter name: none 2024-09-12T01:04:30.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.714+0000 7fc90b7fe640 20 reqs_thread_entry: start 2024-09-12T01:04:30.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.714+0000 7fcae76a49c0 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-12T01:04:30.713 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.714+0000 7fcae76a49c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:30.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.714+0000 7fcae76a49c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T01:04:30.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.714+0000 7fcae76a49c0 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-12T01:04:30.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.714+0000 7fcae76a49c0 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-12T01:04:30.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.714+0000 7fcae76a49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782 : miss 2024-09-12T01:04:30.714 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.714+0000 7fcae76a49c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:30.715 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.714+0000 7fcae76a49c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T01:04:30.715 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.714+0000 7fcae76a49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782 info.flags=0x17 2024-09-12T01:04:30.715 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.714+0000 7fcae76a49c0 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782 to cache LRU end 2024-09-12T01:04:30.715 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.714+0000 7fcae76a49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:04:30.715 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.714+0000 7fcae76a49c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T01:04:30.715 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.714+0000 7fcae76a49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782 2024-09-12T01:04:30.716 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.714+0000 7fcae76a49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.0 2024-09-12T01:04:30.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.718+0000 7fcae76a49c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T01:04:30.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.718+0000 7fcae76a49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.1 2024-09-12T01:04:30.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.718+0000 7fcae76a49c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T01:04:30.717 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.718+0000 7fcae76a49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.2 2024-09-12T01:04:30.718 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.718+0000 7fcae76a49c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T01:04:30.718 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.718+0000 7fcae76a49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.3 2024-09-12T01:04:30.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.718+0000 7fcae76a49c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T01:04:30.720 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.718+0000 7fcae76a49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.4 2024-09-12T01:04:30.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.722+0000 7fcae76a49c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T01:04:30.721 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.722+0000 7fcae76a49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.5 2024-09-12T01:04:30.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.722+0000 7fcae76a49c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T01:04:30.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.722+0000 7fcae76a49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.6 2024-09-12T01:04:30.724 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.722+0000 7fcae76a49c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T01:04:30.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.722+0000 7fcae76a49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.7 2024-09-12T01:04:30.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.726+0000 7fcae76a49c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T01:04:30.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.726+0000 7fcae76a49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.8 2024-09-12T01:04:30.725 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.726+0000 7fcae76a49c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T01:04:30.726 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.726+0000 7fcae76a49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.9 2024-09-12T01:04:30.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.726+0000 7fcae76a49c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T01:04:30.727 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.726+0000 7fcae76a49c0 20 bucket index object: :.dir.af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782.10 2024-09-12T01:04:30.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.726+0000 7fcae76a49c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T01:04:30.728 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.726+0000 7fcae76a49c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T01:04:30.729 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.730+0000 7fc99afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:30.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.734+0000 7fcae76a49c0 20 remove_watcher() i=0 2024-09-12T01:04:30.734 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.734+0000 7fcae76a49c0 2 removed watcher, disabling cache 2024-09-12T01:04:30.737 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.738+0000 7fcae76a49c0 20 remove_watcher() i=1 2024-09-12T01:04:30.739 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.738+0000 7fcae76a49c0 20 remove_watcher() i=2 2024-09-12T01:04:30.742 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.742+0000 7fcae76a49c0 20 remove_watcher() i=3 2024-09-12T01:04:30.744 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.742+0000 7fcae76a49c0 20 remove_watcher() i=4 2024-09-12T01:04:30.745 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.746+0000 7fcae76a49c0 20 remove_watcher() i=5 2024-09-12T01:04:30.747 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.746+0000 7fcae76a49c0 20 remove_watcher() i=6 2024-09-12T01:04:30.749 INFO:tasks.workunit.client.0.smithi043.stderr:2024-09-12T01:04:30.750+0000 7fcae76a49c0 20 remove_watcher() i=7 2024-09-12T01:04:30.769 INFO:tasks.workunit.client.0.smithi043.stderr:Deleting bucket versioning-bucket 2024-09-12T01:04:30.771 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:04:30.771 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T01:04:30.780 INFO:tasks.workunit.client.0.smithi043.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:04:30.780 INFO:tasks.workunit.client.0.smithi043.stderr: warnings.warn( 2024-09-12T01:04:30.848 INFO:tasks.workunit.client.0.smithi043.stderr:Completed bucket versioning tests 2024-09-12T01:04:30.849 INFO:tasks.workunit.client.0.smithi043.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T01:04:30.849 INFO:tasks.workunit.client.0.smithi043.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T01:04:30.849 INFO:tasks.workunit.client.0.smithi043.stdout:connected to https://localhost:443 2024-09-12T01:04:30.947 INFO:tasks.workunit.client.0.smithi043.stderr:+ deactivate 2024-09-12T01:04:30.948 INFO:tasks.workunit.client.0.smithi043.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T01:04:30.948 INFO:tasks.workunit.client.0.smithi043.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T01:04:30.948 INFO:tasks.workunit.client.0.smithi043.stderr:+ export PATH 2024-09-12T01:04:30.948 INFO:tasks.workunit.client.0.smithi043.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T01:04:30.948 INFO:tasks.workunit.client.0.smithi043.stderr:+ '[' -n '' ']' 2024-09-12T01:04:30.948 INFO:tasks.workunit.client.0.smithi043.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:04:30.948 INFO:tasks.workunit.client.0.smithi043.stderr:+ hash -r 2024-09-12T01:04:30.948 INFO:tasks.workunit.client.0.smithi043.stderr:+ '[' -n '' ']' 2024-09-12T01:04:30.949 INFO:tasks.workunit.client.0.smithi043.stderr:+ unset VIRTUAL_ENV 2024-09-12T01:04:30.949 INFO:tasks.workunit.client.0.smithi043.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T01:04:30.949 INFO:tasks.workunit.client.0.smithi043.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T01:04:30.949 INFO:tasks.workunit.client.0.smithi043.stderr:+ unset -f deactivate 2024-09-12T01:04:30.949 INFO:tasks.workunit.client.0.smithi043.stderr:+ echo OK. 2024-09-12T01:04:30.950 INFO:tasks.workunit.client.0.smithi043.stdout:OK. 2024-09-12T01:04:30.950 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T01:04:30.950 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T01:04:31.006 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-12T01:04:31.006 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T01:04:31.429 DEBUG:teuthology.parallel:result is None 2024-09-12T01:04:31.429 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:04:31.441 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:04:31.442 DEBUG:teuthology.orchestra.run.smithi043:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:04:31.489 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:04:31.489 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-12T01:04:31.501 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-12T01:04:31.512 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-12T01:04:31.512 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-12T01:04:31.512 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-12T01:04:31.585 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-12T01:04:31.586 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-12T01:04:31.624 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:31.624 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:31.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.666+0000 7f919aa7a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:31.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.666+0000 7f919aa7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:31.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.666+0000 7f919aa7a9c0 20 realm 2024-09-12T01:04:31.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.666+0000 7f919aa7a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:31.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.666+0000 7f919aa7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:31.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.666+0000 7f919aa7a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:31.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.666+0000 7f919aa7a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:31.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.666+0000 7f919aa7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:31.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.666+0000 7f919aa7a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:31.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.670+0000 7f919aa7a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:31.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.670+0000 7f919aa7a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:31.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.670+0000 7f919aa7a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:31.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.670+0000 7f919aa7a9c0 20 searching for the correct realm 2024-09-12T01:04:31.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.678+0000 7f9197d7f640 0 -- 172.21.15.43:0/2559050308 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f918c0d0040 msgr2=0x7f918c0de920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:31.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.682+0000 7f9197d7f640 0 -- 172.21.15.43:0/2559050308 >> [v2:172.21.15.97:6824/1948010415,v1:172.21.15.97:6825/1948010415] conn(0x7f90600818e0 msgr2=0x7f9060083d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:31.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.690+0000 7f919aa7a9c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T01:04:31.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.690+0000 7f919aa7a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:31.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.690+0000 7f919aa7a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:31.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.690+0000 7f919aa7a9c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T01:04:31.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.690+0000 7f919aa7a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:31.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.690+0000 7f919aa7a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:31.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.690+0000 7f919aa7a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:31.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.690+0000 7f919aa7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:31.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.690+0000 7f919aa7a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:31.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.690+0000 7f919aa7a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:31.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.690+0000 7f919aa7a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:31.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.690+0000 7f919aa7a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:31.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.690+0000 7f919aa7a9c0 20 zone default found 2024-09-12T01:04:31.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.690+0000 7f919aa7a9c0 4 Realm: () 2024-09-12T01:04:31.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.690+0000 7f919aa7a9c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T01:04:31.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.690+0000 7f919aa7a9c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T01:04:31.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.690+0000 7f919aa7a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:31.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.690+0000 7f919aa7a9c0 20 zonegroup default 2024-09-12T01:04:31.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.690+0000 7f919aa7a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:31.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.690+0000 7f919aa7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:31.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.690+0000 7f919aa7a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:31.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.694+0000 7f919aa7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:31.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.694+0000 7f919aa7a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:31.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.694+0000 7f919aa7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:31.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.694+0000 7f919aa7a9c0 20 started sync module instance, tier type = 2024-09-12T01:04:31.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.694+0000 7f919aa7a9c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T01:04:31.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.710+0000 7f919aa7a9c0 20 add_watcher() i=0 2024-09-12T01:04:31.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.710+0000 7f919aa7a9c0 20 add_watcher() i=1 2024-09-12T01:04:31.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.710+0000 7f919aa7a9c0 20 add_watcher() i=2 2024-09-12T01:04:31.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.710+0000 7f919aa7a9c0 20 add_watcher() i=3 2024-09-12T01:04:31.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.710+0000 7f919aa7a9c0 20 add_watcher() i=4 2024-09-12T01:04:31.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.710+0000 7f919aa7a9c0 20 add_watcher() i=5 2024-09-12T01:04:31.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.710+0000 7f919aa7a9c0 20 add_watcher() i=6 2024-09-12T01:04:31.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.710+0000 7f919aa7a9c0 20 add_watcher() i=7 2024-09-12T01:04:31.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.710+0000 7f919aa7a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:31.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.714+0000 7f904efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:31.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.714+0000 7f919aa7a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:31.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.714+0000 7f919aa7a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:31.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.794+0000 7f904dfdb640 20 reqs_thread_entry: start 2024-09-12T01:04:31.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.794+0000 7f919aa7a9c0 20 init_complete bucket index max shards: 11 2024-09-12T01:04:31.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.794+0000 7f919aa7a9c0 20 Filter name: none 2024-09-12T01:04:31.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.794+0000 7f8fbf7fe640 20 reqs_thread_entry: start 2024-09-12T01:04:31.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.794+0000 7f919aa7a9c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T01:04:31.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.794+0000 7f919aa7a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:31.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.794+0000 7f919aa7a9c0 20 rados_obj.operate() r=0 bl.length=482 2024-09-12T01:04:31.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.794+0000 7f919aa7a9c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-12T01:04:31.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.794+0000 7f919aa7a9c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T01:04:31.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.794+0000 7f919aa7a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:04:31.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.798+0000 7f919aa7a9c0 10 removing key index: OCCDEZPMMJGJMBDHHFCX 2024-09-12T01:04:31.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.798+0000 7f919aa7a9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.keys:OCCDEZPMMJGJMBDHHFCX, ofs0, ns] 2024-09-12T01:04:31.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.802+0000 7f906f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235650 cookie 94766883476880 notifier 8858 bl.length()=170 2024-09-12T01:04:31.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.802+0000 7f919aa7a9c0 10 removing email index: tester.client.0_test@test.test 2024-09-12T01:04:31.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.802+0000 7f919aa7a9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T01:04:31.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.802+0000 7f906effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051236572 cookie 94766883475824 notifier 8858 bl.length()=181 2024-09-12T01:04:31.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.806+0000 7f919aa7a9c0 10 removing user buckets index 2024-09-12T01:04:31.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.806+0000 7f919aa7a9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-12T01:04:31.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.806+0000 7f906effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235591 cookie 94766883488032 notifier 8858 bl.length()=172 2024-09-12T01:04:31.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.810+0000 7f919aa7a9c0 10 removing user index: tester.client.0 2024-09-12T01:04:31.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.810+0000 7f919aa7a9c0 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-12T01:04:31.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.810+0000 7f919aa7a9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T01:04:31.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.810+0000 7f906f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235884 cookie 94766883486400 notifier 8858 bl.length()=164 2024-09-12T01:04:31.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.814+0000 7f904efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:31.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.818+0000 7f919aa7a9c0 20 remove_watcher() i=0 2024-09-12T01:04:31.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.818+0000 7f919aa7a9c0 2 removed watcher, disabling cache 2024-09-12T01:04:31.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.822+0000 7f919aa7a9c0 20 remove_watcher() i=1 2024-09-12T01:04:31.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.826+0000 7f919aa7a9c0 20 remove_watcher() i=2 2024-09-12T01:04:31.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.826+0000 7f919aa7a9c0 20 remove_watcher() i=3 2024-09-12T01:04:31.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.830+0000 7f919aa7a9c0 20 remove_watcher() i=4 2024-09-12T01:04:31.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.830+0000 7f919aa7a9c0 20 remove_watcher() i=5 2024-09-12T01:04:31.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.834+0000 7f919aa7a9c0 20 remove_watcher() i=6 2024-09-12T01:04:31.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:31.834+0000 7f919aa7a9c0 20 remove_watcher() i=7 2024-09-12T01:04:31.852 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-12T01:04:31.862 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-12T01:04:31.871 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-12T01:04:31.942 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T01:04:31.954 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T01:04:31.954 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:04:31.955 INFO:tasks.rgw.client.0.smithi043.stdout:2024-09-12T01:04:31.954+0000 7f9914084640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 37947) UID: 0 2024-09-12T01:04:31.955 INFO:tasks.rgw.client.0.smithi043.stdout:2024-09-12T01:04:31.954+0000 7f99178cca40 -1 shutting down 2024-09-12T01:04:38.056 INFO:tasks.rgw.client.0:Stopped 2024-09-12T01:04:38.056 DEBUG:teuthology.orchestra.run.smithi043:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T01:04:38.062 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T01:04:38.118 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T01:04:38.172 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T01:04:38.173 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T01:04:38.173 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T01:04:38.257 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:38.257 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:38.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.298+0000 7f8b0d7919c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:38.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.302+0000 7f8b0d7919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:38.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.302+0000 7f8b0d7919c0 20 realm 2024-09-12T01:04:38.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.302+0000 7f8b0d7919c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:38.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.302+0000 7f8b0d7919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:38.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.302+0000 7f8b0d7919c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:38.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.302+0000 7f8b0d7919c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:38.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.302+0000 7f8b0d7919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:38.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.302+0000 7f8b0d7919c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:38.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.302+0000 7f8b0d7919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:38.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.302+0000 7f8b0d7919c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:38.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.302+0000 7f8b0d7919c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:38.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.302+0000 7f8b0d7919c0 20 searching for the correct realm 2024-09-12T01:04:38.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.310+0000 7f8b0ba98640 0 -- 172.21.15.43:0/1860143151 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x7f8b000e9960 msgr2=0x7f8b000cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:38.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.526+0000 7f8b0b297640 0 -- 172.21.15.43:0/1860143151 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x558657710100 msgr2=0x5586577124f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:38.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.534+0000 7f8b0d7919c0 20 RGWRados::pool_iterate: got zonegroup_info.6818f3e2-c8be-49cb-9ae0-b9f540ccc386 2024-09-12T01:04:38.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.534+0000 7f8b0d7919c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:38.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.534+0000 7f8b0d7919c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:38.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.534+0000 7f8b0d7919c0 20 RGWRados::pool_iterate: got zone_info.af15766d-a760-4e2f-9cfc-808f2566cb70 2024-09-12T01:04:38.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.534+0000 7f8b0d7919c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:38.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.534+0000 7f8b0d7919c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:38.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.534+0000 7f8b0d7919c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:38.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.534+0000 7f8b0d7919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:38.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.534+0000 7f8b0d7919c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:38.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.538+0000 7f8b0d7919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:38.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.538+0000 7f8b0d7919c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:38.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.538+0000 7f8b0d7919c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:38.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.538+0000 7f8b0d7919c0 20 zone default found 2024-09-12T01:04:38.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.538+0000 7f8b0d7919c0 4 Realm: () 2024-09-12T01:04:38.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.538+0000 7f8b0d7919c0 4 ZoneGroup: default (6818f3e2-c8be-49cb-9ae0-b9f540ccc386) 2024-09-12T01:04:38.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.538+0000 7f8b0d7919c0 4 Zone: default (af15766d-a760-4e2f-9cfc-808f2566cb70) 2024-09-12T01:04:38.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.538+0000 7f8b0d7919c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:38.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.538+0000 7f8b0d7919c0 20 zonegroup default 2024-09-12T01:04:38.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.538+0000 7f8b0d7919c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:38.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.538+0000 7f8b0d7919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:38.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.538+0000 7f8b0d7919c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:38.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.538+0000 7f8b0d7919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:38.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.538+0000 7f8b0d7919c0 20 rados->read ofs=0 len=0 2024-09-12T01:04:38.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.538+0000 7f8b0d7919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:38.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.538+0000 7f8b0d7919c0 20 started sync module instance, tier type = 2024-09-12T01:04:38.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.538+0000 7f8b0d7919c0 20 started zone id=af15766d-a760-4e2f-9cfc-808f2566cb70 (name=default) with tier type = 2024-09-12T01:04:38.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.562+0000 7f8b0d7919c0 20 add_watcher() i=0 2024-09-12T01:04:38.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.562+0000 7f8b0d7919c0 20 add_watcher() i=1 2024-09-12T01:04:38.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.562+0000 7f8b0d7919c0 20 add_watcher() i=2 2024-09-12T01:04:38.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.562+0000 7f8b0d7919c0 20 add_watcher() i=3 2024-09-12T01:04:38.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.562+0000 7f8b0d7919c0 20 add_watcher() i=4 2024-09-12T01:04:38.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.562+0000 7f8b0d7919c0 20 add_watcher() i=5 2024-09-12T01:04:38.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.562+0000 7f8b0d7919c0 20 add_watcher() i=6 2024-09-12T01:04:38.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.566+0000 7f8b0d7919c0 20 add_watcher() i=7 2024-09-12T01:04:38.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.566+0000 7f8b0d7919c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:38.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.570+0000 7f89c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:38.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.570+0000 7f8b0d7919c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:38.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.570+0000 7f8b0d7919c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:38.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.662+0000 7f89c0fe1640 20 reqs_thread_entry: start 2024-09-12T01:04:38.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.662+0000 7f8b0d7919c0 20 init_complete bucket index max shards: 11 2024-09-12T01:04:38.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.666+0000 7f8b0d7919c0 20 Filter name: none 2024-09-12T01:04:38.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.666+0000 7f893a7fc640 20 reqs_thread_entry: start 2024-09-12T01:04:38.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.666+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:04:38.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.666+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:38.668 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:38.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48561' 2024-09-12T01:04:38.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='_a8nJpQi7pZORieNb9O5p40xrUPD8lWO', time=2024-09-12T02:48:35.671412+0000, chain.objs.size()=3 2024-09-12T01:04:38.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.161__shadow_.SfFkN92ze7GHl0QYc8Mgp2QTfkk20gh_0 2024-09-12T01:04:38.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.161__shadow_.SfFkN92ze7GHl0QYc8Mgp2QTfkk20gh_1 2024-09-12T01:04:38.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.161__shadow_.SfFkN92ze7GHl0QYc8Mgp2QTfkk20gh_2 2024-09-12T01:04:38.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3319939541913568619', time=2024-09-12T02:48:40.057135+0000, chain.objs.size()=1 2024-09-12T01:04:38.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.170__shadow_.AU86AyvRFt2D6S-ZzuA3KvjlduUDedi_0 2024-09-12T01:04:38.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1762894754985632451', time=2024-09-12T02:48:49.058453+0000, chain.objs.size()=1 2024-09-12T01:04:38.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.177__shadow_.btktMvy-JIyQsIrXLTNBtvywi-T1ZnS_0 2024-09-12T01:04:38.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13479662879492491367', time=2024-09-12T02:50:48.897476+0000, chain.objs.size()=1 2024-09-12T01:04:38.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.238__shadow_.-Pas2nAuvgw-e83aY73FWgwwik2M90d_0 2024-09-12T01:04:38.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10498118695769263757', time=2024-09-12T02:51:26.792683+0000, chain.objs.size()=1 2024-09-12T01:04:38.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Gk7LsGiRY8o8WvsNCcrxlJ5aKFPhLzt_0 2024-09-12T01:04:38.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4113130183817598870', time=2024-09-12T02:51:26.810796+0000, chain.objs.size()=1 2024-09-12T01:04:38.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.6VJ6IQJ8VfmBs4QmrPsGkRG9ZEUhWYy_0 2024-09-12T01:04:38.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7406504090703204885', time=2024-09-12T02:51:26.987721+0000, chain.objs.size()=1 2024-09-12T01:04:38.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.4e3Mkt6c-prBH0mV2kSvxCw8ZQInaXs_0 2024-09-12T01:04:38.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1620566192461225444', time=2024-09-12T02:51:27.040608+0000, chain.objs.size()=1 2024-09-12T01:04:38.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.brmLuidg4FIrZfdECQxHLRd1yfqXh8L_0 2024-09-12T01:04:38.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17795487545741974327', time=2024-09-12T02:51:27.067698+0000, chain.objs.size()=1 2024-09-12T01:04:38.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.qC8nTNVkSiU2vsrxo0XNFExxKjgxJU7_0 2024-09-12T01:04:38.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5495727034223790628', time=2024-09-12T02:51:27.070676+0000, chain.objs.size()=1 2024-09-12T01:04:38.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.2k5aOVRCa6mifUeCh3ciue4CBVWXdNY_0 2024-09-12T01:04:38.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.674+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12275109401061694125', time=2024-09-12T02:51:27.235176+0000, chain.objs.size()=1 2024-09-12T01:04:38.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.674+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.MckPYdALAwJMlWbjHDGD64zye0c4o4s_0 2024-09-12T01:04:38.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.674+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8587236261442603983', time=2024-09-12T02:51:27.240797+0000, chain.objs.size()=1 2024-09-12T01:04:38.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.674+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.fGjbE2QiIYcZPohQDI-z8Fo6BRokMZh_0 2024-09-12T01:04:38.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.674+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13380061106243602658', time=2024-09-12T02:51:27.244908+0000, chain.objs.size()=1 2024-09-12T01:04:38.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.674+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.mGpdzFPyx_rpFXOvcnyAFJAV8pz0sZe_0 2024-09-12T01:04:38.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.674+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9979497559678047529', time=2024-09-12T02:51:27.316235+0000, chain.objs.size()=1 2024-09-12T01:04:38.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.674+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Dga2yK6k3T1nPfMX1fTNDeTyQylqYHR_0 2024-09-12T01:04:38.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.674+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15279857183298501701', time=2024-09-12T02:51:27.422562+0000, chain.objs.size()=1 2024-09-12T01:04:38.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.674+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.PkEG9GdiWee4SFgHCMMtvBS27u_bCwV_0 2024-09-12T01:04:38.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.678+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12176983445959219630', time=2024-09-12T02:51:27.430455+0000, chain.objs.size()=1 2024-09-12T01:04:38.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.678+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.oj9UjXlPS24tfZE9GUtSnXpVEgGtACW_0 2024-09-12T01:04:38.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.678+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17071027161915323192', time=2024-09-12T02:51:27.667652+0000, chain.objs.size()=1 2024-09-12T01:04:38.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.678+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.miifwqr-GtUG76URMXqNmGBEqm1rbRV_0 2024-09-12T01:04:38.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.678+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1523094112591698101', time=2024-09-12T02:51:27.702753+0000, chain.objs.size()=1 2024-09-12T01:04:38.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.678+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.z4ruJY87xTvNA-QK3Jf4Is-RosGCTP1_0 2024-09-12T01:04:38.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.678+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8361062130051425850', time=2024-09-12T02:51:27.724310+0000, chain.objs.size()=1 2024-09-12T01:04:38.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.678+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.RfdMxQ7SVKYmQLCfPgqXX7rRcMByU0k_0 2024-09-12T01:04:38.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.678+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2127374886344968052', time=2024-09-12T02:51:27.885379+0000, chain.objs.size()=1 2024-09-12T01:04:38.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.678+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.K7TtIip-8sJA7uTjNH6ioNdtunLqfZT_0 2024-09-12T01:04:38.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.678+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4437936161287999226', time=2024-09-12T02:51:27.889250+0000, chain.objs.size()=1 2024-09-12T01:04:38.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.678+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.RJhubucXlF8ROpQNIDSAyfUyQsMPNM4_0 2024-09-12T01:04:38.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.682+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2723541325341055611', time=2024-09-12T02:51:27.923532+0000, chain.objs.size()=1 2024-09-12T01:04:38.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.682+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.UH90gWv_2NxYZx9fMkegRnyVMbGvyWZ_0 2024-09-12T01:04:38.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.682+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12809156348590333886', time=2024-09-12T02:51:27.924424+0000, chain.objs.size()=1 2024-09-12T01:04:38.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.682+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.21YjTjxzhwqKjOfwusBh0KiaDnTL799_0 2024-09-12T01:04:38.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.682+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16014263335366247171', time=2024-09-12T02:51:27.970221+0000, chain.objs.size()=1 2024-09-12T01:04:38.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.682+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.q4CW_a8FzEcaPiv710DlFpH-rcgAzSb_0 2024-09-12T01:04:38.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.682+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7325223399740144634', time=2024-09-12T02:51:28.220560+0000, chain.objs.size()=1 2024-09-12T01:04:38.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.682+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.LDXoYMYPbQYgixwEOvxHne9su30Ofso_0 2024-09-12T01:04:38.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.682+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1550800053180267306', time=2024-09-12T02:51:28.232559+0000, chain.objs.size()=1 2024-09-12T01:04:38.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.682+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.EkfPRUugTWbRi5qKyhfm11x94OT5b3R_0 2024-09-12T01:04:38.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.682+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17455425615529997732', time=2024-09-12T02:51:28.338451+0000, chain.objs.size()=1 2024-09-12T01:04:38.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.682+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.cleYueCzTIFwnznxBf5NRs-V6Ffawmc_0 2024-09-12T01:04:38.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.682+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3063618002438659763', time=2024-09-12T02:51:28.374879+0000, chain.objs.size()=1 2024-09-12T01:04:38.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.682+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ArOnR5bg0cxbx7XYV-xgDJErMPcIUtk_0 2024-09-12T01:04:38.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.686+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8687521197535651470', time=2024-09-12T02:51:32.900035+0000, chain.objs.size()=1 2024-09-12T01:04:38.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.686+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.268__shadow_.aowMusQ1Rak-42OgMCDQ1cQGnVydi9s_0 2024-09-12T01:04:38.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.686+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10128184067879021458', time=2024-09-12T02:51:34.365085+0000, chain.objs.size()=1 2024-09-12T01:04:38.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.686+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.270__shadow_.lo0cXjP0xwRrQjWrdp4txjPcGfljRcS_0 2024-09-12T01:04:38.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.686+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5389908646598181445', time=2024-09-12T02:51:40.952153+0000, chain.objs.size()=1 2024-09-12T01:04:38.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.686+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.279__shadow_.p5aQk-SbcTjeeVYUu54NYEFQDPXSPis_0 2024-09-12T01:04:38.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.686+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10736568921158253181', time=2024-09-12T02:51:40.954649+0000, chain.objs.size()=1 2024-09-12T01:04:38.686 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.686+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.279__shadow_.MH71hekDCNEgYROtoFHq6bBQqiCehNo_0 2024-09-12T01:04:38.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.686+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5289716297839681406', time=2024-09-12T02:51:53.192286+0000, chain.objs.size()=1 2024-09-12T01:04:38.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.686+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.293__shadow_.Xx_m01lGfvj9Mo6qKDig3MnI4A6GuFD_0 2024-09-12T01:04:38.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.686+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7647304046663004573', time=2024-09-12T02:52:12.942904+0000, chain.objs.size()=1 2024-09-12T01:04:38.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.686+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.319__shadow:cogEiYwFcJum.n1pu7Q6tlzozZVIf.b_.BSNIV3-EA4qr21JfP5M_D1_Kz9ynxY-_0 2024-09-12T01:04:38.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.686+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1205893172965980339', time=2024-09-12T02:52:13.712631+0000, chain.objs.size()=1 2024-09-12T01:04:38.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.686+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.321__shadow_.8Rv_TurYADxr_GKst7xfPlnv444diQO_0 2024-09-12T01:04:38.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.686+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5494241638225372840', time=2024-09-12T02:52:35.062285+0000, chain.objs.size()=1 2024-09-12T01:04:38.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.686+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.cQQzHXbD2mjEn9_y4QY0pJpDwK737fu_0 2024-09-12T01:04:38.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.686+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9097985708852872707', time=2024-09-12T02:52:35.074572+0000, chain.objs.size()=1 2024-09-12T01:04:38.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.686+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Nl5N_c6-0bUIk4LM0rrW00eOIe2v4Vc_0 2024-09-12T01:04:38.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.686+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7039518391107702975', time=2024-09-12T02:52:35.111988+0000, chain.objs.size()=1 2024-09-12T01:04:38.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.686+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.WmfzwZHFe2LqQRLZxwaAZgahbnDUJWd_0 2024-09-12T01:04:38.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.686+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13434816947507320486', time=2024-09-12T02:52:35.160803+0000, chain.objs.size()=1 2024-09-12T01:04:38.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.686+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.mKvwWuOAbBZpDp5PtlOpkcbafVnAclA_0 2024-09-12T01:04:38.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.686+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14182891035861577350', time=2024-09-12T02:52:35.295051+0000, chain.objs.size()=1 2024-09-12T01:04:38.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.686+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.xi8Cg7FwePRliF56CeM0RgeBzUxmEjf_0 2024-09-12T01:04:38.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.686+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10607522320368888553', time=2024-09-12T02:52:35.349436+0000, chain.objs.size()=1 2024-09-12T01:04:38.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.686+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.-RdyS4P3KrfrKP6jqHikuSee3G0BcLo_0 2024-09-12T01:04:38.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.686+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12846017659140718093', time=2024-09-12T02:52:35.372350+0000, chain.objs.size()=1 2024-09-12T01:04:38.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.686+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.3mYBB1mq_qWDQQdY70C4ZLe5f5TZBwN_0 2024-09-12T01:04:38.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.690+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6483521311014993843', time=2024-09-12T02:52:35.394934+0000, chain.objs.size()=1 2024-09-12T01:04:38.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.690+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.8R46sHDb_QVxpTH1lkChyy6JrqoTv21_0 2024-09-12T01:04:38.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.690+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9286470964624047230', time=2024-09-12T02:52:35.549739+0000, chain.objs.size()=1 2024-09-12T01:04:38.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.690+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.J5u7YVM_n5dZ3uaVSIuyUvydQ926-RM_0 2024-09-12T01:04:38.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.690+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9127656904416116162', time=2024-09-12T02:52:35.767183+0000, chain.objs.size()=1 2024-09-12T01:04:38.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.690+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.joMDFhD3S8duA2yH3k1gjYF79hI3wr3_0 2024-09-12T01:04:38.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.690+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4760678083730400968', time=2024-09-12T02:52:35.768583+0000, chain.objs.size()=1 2024-09-12T01:04:38.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.690+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.V9wbvy72casqSvpCQVxdAcBsg1myyur_0 2024-09-12T01:04:38.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.690+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.909995457162837522', time=2024-09-12T02:52:35.791412+0000, chain.objs.size()=1 2024-09-12T01:04:38.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.690+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.tX3vMEuVix0Lv6fTLT690-NxPDq07tt_0 2024-09-12T01:04:38.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.690+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11748028777497987986', time=2024-09-12T02:52:35.813840+0000, chain.objs.size()=1 2024-09-12T01:04:38.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.690+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.kZfse6dUIo9ykksRzB0dhhnw21TXqHd_0 2024-09-12T01:04:38.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.694+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12059424061318690878', time=2024-09-12T02:52:35.827630+0000, chain.objs.size()=1 2024-09-12T01:04:38.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.694+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.50VLoJktgkWcxdI-H52KCdAMukmPTUg_0 2024-09-12T01:04:38.693 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.694+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14513540241804935070', time=2024-09-12T02:52:35.874775+0000, chain.objs.size()=1 2024-09-12T01:04:38.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.694+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.8zvg6MFMTWfJcPc0iGDQR_Q6UkEAtIF_0 2024-09-12T01:04:38.694 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.694+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14470395501696219394', time=2024-09-12T02:52:35.876039+0000, chain.objs.size()=1 2024-09-12T01:04:38.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.694+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.RwcX2GnSsRLOSijQVU5-eno6MH4Xs15_0 2024-09-12T01:04:38.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.694+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10352730840606818979', time=2024-09-12T02:52:35.889407+0000, chain.objs.size()=1 2024-09-12T01:04:38.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.694+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.1BWfUKMwnS-PciZ8Nw02CBztndOTmoS_0 2024-09-12T01:04:38.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.694+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2844225832098491590', time=2024-09-12T02:52:36.287094+0000, chain.objs.size()=1 2024-09-12T01:04:38.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.694+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.bJiwRC-wI3wMqW4aMjxVJ-mn9xmRkVW_0 2024-09-12T01:04:38.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.694+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17605955181634852499', time=2024-09-12T02:52:36.304742+0000, chain.objs.size()=1 2024-09-12T01:04:38.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.694+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.s4ZjLxnG1DwrJ_YwWqZ6LP_6TNcrJFc_0 2024-09-12T01:04:38.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.698+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7136357540316167663', time=2024-09-12T02:52:36.384823+0000, chain.objs.size()=1 2024-09-12T01:04:38.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.GseDaIQTxC0wmygn5H286AdvLx-XveO_0 2024-09-12T01:04:38.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.698+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3267568227170501014', time=2024-09-12T02:52:36.386342+0000, chain.objs.size()=1 2024-09-12T01:04:38.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.aPF4tH2eWsBkw0XKVkz8OlKC6AVY3HI_0 2024-09-12T01:04:38.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.698+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15259351111644130774', time=2024-09-12T02:52:36.515543+0000, chain.objs.size()=1 2024-09-12T01:04:38.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.-g7hONVemqx6B0GTmHg_XufmaMvoqJN_0 2024-09-12T01:04:38.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.698+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1037051277787143542', time=2024-09-12T02:52:36.564838+0000, chain.objs.size()=1 2024-09-12T01:04:38.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.UbGOIf_fAnV391nmSkjqtQUinybAtIH_0 2024-09-12T01:04:38.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.698+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15064674238401508698', time=2024-09-12T02:52:36.579640+0000, chain.objs.size()=1 2024-09-12T01:04:38.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.20XntTNYSw3VCQza_zPWd5EgWoChvdl_0 2024-09-12T01:04:38.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.698+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13881660831618247771', time=2024-09-12T02:52:36.587562+0000, chain.objs.size()=1 2024-09-12T01:04:38.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.EW00uGtY_hwLnCJSDcX-zgxttUOmfcp_0 2024-09-12T01:04:38.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.698+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1853862852705287513', time=2024-09-12T02:52:36.596412+0000, chain.objs.size()=1 2024-09-12T01:04:38.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.jObI71O8bzf0R8w7BoMv5K1wGO5eu35_0 2024-09-12T01:04:38.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.698+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14217871711545154125', time=2024-09-12T02:52:36.611871+0000, chain.objs.size()=1 2024-09-12T01:04:38.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.d0J014iaDSeGQumjQnHm9RNVzrzzfaJ_0 2024-09-12T01:04:38.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.698+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4096961289978393759', time=2024-09-12T02:52:36.641706+0000, chain.objs.size()=1 2024-09-12T01:04:38.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.GW3g8xJMo-W-TzamvKL4nsixHnT2dRv_0 2024-09-12T01:04:38.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.698+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15702445041201296439', time=2024-09-12T02:52:36.779562+0000, chain.objs.size()=1 2024-09-12T01:04:38.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.OVJod0h7xyrFM_upOJMcvWG4iPyIqU6_0 2024-09-12T01:04:38.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.698+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15092078633418952196', time=2024-09-12T02:52:36.782589+0000, chain.objs.size()=1 2024-09-12T01:04:38.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.XDJYokwMyiB1nWFODRMlQHYNJz30X6G_0 2024-09-12T01:04:38.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.702+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8736619322153061145', time=2024-09-12T02:52:36.805903+0000, chain.objs.size()=1 2024-09-12T01:04:38.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.702+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.D2oG6zI58_fbmusMZ3Fj-hw_AYBj4Gr_0 2024-09-12T01:04:38.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.702+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5663292566803320557', time=2024-09-12T02:52:36.807047+0000, chain.objs.size()=1 2024-09-12T01:04:38.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.702+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Qb9m-raag_xAbE1OwjYKdqEEqgcOPJa_0 2024-09-12T01:04:38.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.702+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8192692626989753628', time=2024-09-12T02:52:36.807894+0000, chain.objs.size()=1 2024-09-12T01:04:38.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.702+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.3pJFhXz30WZXXnChSBlW4k3vnWeKVBs_0 2024-09-12T01:04:38.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.702+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10158614969645069970', time=2024-09-12T02:52:36.853082+0000, chain.objs.size()=1 2024-09-12T01:04:38.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.702+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.5vdd7O3ReAjgiikX4UVIhf_Iuuqxi1W_0 2024-09-12T01:04:38.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.702+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10348150960880456915', time=2024-09-12T02:52:37.058796+0000, chain.objs.size()=1 2024-09-12T01:04:38.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.702+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.E6bLtuiROPB1DAGKvWum0Za2rRcoJyj_0 2024-09-12T01:04:38.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.702+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12379547802748637831', time=2024-09-12T02:52:56.911156+0000, chain.objs.size()=1 2024-09-12T01:04:38.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.702+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.F5bf3hZ8OiI3fSlmaA-nIxBppi1rpUz_0 2024-09-12T01:04:38.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.702+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7059894373627115715', time=2024-09-12T02:52:56.979400+0000, chain.objs.size()=1 2024-09-12T01:04:38.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.702+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.MvN-5GHqCj-hlHEbakUr8Uw1C6xyvfc_0 2024-09-12T01:04:38.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.706+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16813422267579615694', time=2024-09-12T02:52:57.036113+0000, chain.objs.size()=1 2024-09-12T01:04:38.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.706+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.PimcPJui359e5XtYI8HPbqCTkfU02LM_0 2024-09-12T01:04:38.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.706+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4160747896785125364', time=2024-09-12T02:52:57.039859+0000, chain.objs.size()=1 2024-09-12T01:04:38.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.706+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.uykpu6qFas-xkzIxemIpf9b2ryQ0mJT_0 2024-09-12T01:04:38.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.706+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6230558586803804933', time=2024-09-12T02:52:57.157574+0000, chain.objs.size()=1 2024-09-12T01:04:38.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.706+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.VnQ5bBkPzbGVXHNKC4yiviF3wWZr9F__0 2024-09-12T01:04:38.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.706+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7179197792778137022', time=2024-09-12T02:52:57.166732+0000, chain.objs.size()=1 2024-09-12T01:04:38.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.706+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.TzrFkRN9qtxTdyIGVJZeDrfGbE098X2_0 2024-09-12T01:04:38.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.706+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17496407358822310112', time=2024-09-12T02:52:57.190117+0000, chain.objs.size()=1 2024-09-12T01:04:38.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.706+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.3T61ZSP-3-N9mpf8ShpGJiwB3asX7kM_0 2024-09-12T01:04:38.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.706+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12401656648481203426', time=2024-09-12T02:52:57.196435+0000, chain.objs.size()=1 2024-09-12T01:04:38.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.706+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Ll89_TRZcpumg6GNx6zmPVIxsFuOg0E_0 2024-09-12T01:04:38.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.706+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7643127388064199148', time=2024-09-12T02:52:57.254406+0000, chain.objs.size()=1 2024-09-12T01:04:38.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.706+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.AwlGkiUrS9QcQ77_goTZNMCS5Db-l5c_0 2024-09-12T01:04:38.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.706+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14637758454115499668', time=2024-09-12T02:52:57.402899+0000, chain.objs.size()=1 2024-09-12T01:04:38.707 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.706+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.zqDuGeRr5vkGAYdVUTb70J1mu9QLP9F_0 2024-09-12T01:04:38.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.706+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3344279954152001800', time=2024-09-12T02:52:57.412952+0000, chain.objs.size()=1 2024-09-12T01:04:38.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.706+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.tkTq_W8pajhzW7nVZi62xWxxmqdTWxo_0 2024-09-12T01:04:38.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.706+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17528704747722198498', time=2024-09-12T02:52:57.462524+0000, chain.objs.size()=1 2024-09-12T01:04:38.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.706+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.PB6nbs7ih1heDkagbzA16dvoyBFvTy0_0 2024-09-12T01:04:38.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.706+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.414935267955581365', time=2024-09-12T02:52:57.501753+0000, chain.objs.size()=1 2024-09-12T01:04:38.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.706+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.gstgN8EGvdpHBC_9C2Uxb6uhKpVmGKh_0 2024-09-12T01:04:38.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.706+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17505899323710161040', time=2024-09-12T02:52:57.652284+0000, chain.objs.size()=1 2024-09-12T01:04:38.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.706+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.6lfJCqMg-mGwqXfuxi7UPlhvaMqx7Yv_0 2024-09-12T01:04:38.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.706+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5988240532708689173', time=2024-09-12T02:52:57.670246+0000, chain.objs.size()=1 2024-09-12T01:04:38.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.706+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.pq1OzpMMxbb-jqNX-X-kisUCSZJxcen_0 2024-09-12T01:04:38.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.706+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8838729841938803409', time=2024-09-12T02:52:57.688221+0000, chain.objs.size()=1 2024-09-12T01:04:38.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.706+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.OpRYdoBtYvPmrRYfzpNwIpUeByWG-b3_0 2024-09-12T01:04:38.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.710+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9757304597771904166', time=2024-09-12T02:52:57.690058+0000, chain.objs.size()=1 2024-09-12T01:04:38.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.710+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.3w8XojQYfGxSSTGJAGZ0aPsHwUN5od2_0 2024-09-12T01:04:38.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.710+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10625814310466080220', time=2024-09-12T02:52:57.709470+0000, chain.objs.size()=1 2024-09-12T01:04:38.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.710+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.0VvD0ga2n-h9fkkllNubmrsxoI6rff5_0 2024-09-12T01:04:38.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.710+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17267781924383895721', time=2024-09-12T02:52:57.723786+0000, chain.objs.size()=1 2024-09-12T01:04:38.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.710+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.K2yS5_iI5s81C4zQrk7xTPbarHPp5WR_0 2024-09-12T01:04:38.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.710+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2637452168260897811', time=2024-09-12T02:52:57.732432+0000, chain.objs.size()=1 2024-09-12T01:04:38.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.710+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.VbYyhITCWK0cKKFUAi7EqYGIFAz_W-D_0 2024-09-12T01:04:38.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.710+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3927172430852234405', time=2024-09-12T02:52:57.733579+0000, chain.objs.size()=1 2024-09-12T01:04:38.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.710+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.U-6S4KTOna7uZ483uGojZnkN46NYxW-_0 2024-09-12T01:04:38.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.710+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4071531199502533453', time=2024-09-12T02:52:57.880729+0000, chain.objs.size()=1 2024-09-12T01:04:38.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.710+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.u8pz0jzpQJjb0FTzTIVaykgJncmf5IU_0 2024-09-12T01:04:38.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.714+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18183792221075873937', time=2024-09-12T02:52:57.957748+0000, chain.objs.size()=1 2024-09-12T01:04:38.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.714+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.cgCIORjp1P4mtrfbFGpA4Ek9tuROp_F_0 2024-09-12T01:04:38.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.714+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7973121200491772639', time=2024-09-12T02:52:58.134815+0000, chain.objs.size()=1 2024-09-12T01:04:38.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.714+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.XTZvdxRqL1KkkgWir7TIA8BVvHC63h6_0 2024-09-12T01:04:38.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.714+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10257287886670472624', time=2024-09-12T02:52:58.145261+0000, chain.objs.size()=1 2024-09-12T01:04:38.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.714+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.iDXBIGnT09EADLjVGACznXV7yu5Hd1K_0 2024-09-12T01:04:38.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.714+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11376516211372289964', time=2024-09-12T02:52:58.169272+0000, chain.objs.size()=1 2024-09-12T01:04:38.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.714+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.utJCyqY0soVTz5Sf5xl8P8fYVUWRAQK_0 2024-09-12T01:04:38.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.714+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12794666834465482859', time=2024-09-12T02:52:58.206167+0000, chain.objs.size()=1 2024-09-12T01:04:38.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.714+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.igCeI3wtV3o1kO9o4NMDJXMhitROI7I_0 2024-09-12T01:04:38.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.714+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10649170469559324952', time=2024-09-12T02:52:58.220597+0000, chain.objs.size()=1 2024-09-12T01:04:38.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.714+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.tOoS0CtTvcGj2fJzt8Oxv8WkOz1Mi-8_0 2024-09-12T01:04:38.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.718+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4085623720251107929', time=2024-09-12T02:52:58.424208+0000, chain.objs.size()=1 2024-09-12T01:04:38.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.718+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.8GW-qeEu7WhsknmVwu2OTvytsebsh8Z_0 2024-09-12T01:04:38.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.718+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11956644391129262467', time=2024-09-12T02:52:58.448047+0000, chain.objs.size()=1 2024-09-12T01:04:38.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.718+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.d16MKqY_-_Nkwvao1gZuTqZgF6YpUbI_0 2024-09-12T01:04:38.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.718+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48561 2024-09-12T01:04:38.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-09-12T01:04:38.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11318955953561849088', time=2024-09-12T02:52:58.457202+0000, chain.objs.size()=1 2024-09-12T01:04:38.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.3Z4DJsK6-1_4dOgsxM5Sws3uG7A21ek_0 2024-09-12T01:04:38.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1920243363031852741', time=2024-09-12T02:52:58.490047+0000, chain.objs.size()=1 2024-09-12T01:04:38.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.BeIMs77CxbhY_MUF_GbDXLCeVGZRu-A_0 2024-09-12T01:04:38.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6871286295862515958', time=2024-09-12T02:52:58.590779+0000, chain.objs.size()=1 2024-09-12T01:04:38.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.zV0EKCmoPOzV0e4KDS-l7bhP2O-DoYn_0 2024-09-12T01:04:38.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12489431636367076122', time=2024-09-12T02:52:58.593727+0000, chain.objs.size()=1 2024-09-12T01:04:38.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.G30O15XeHiWhib3MeKphLRg7v1Klo49_0 2024-09-12T01:04:38.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16875453318535924399', time=2024-09-12T02:52:58.614140+0000, chain.objs.size()=1 2024-09-12T01:04:38.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.l282-TdqXYwFCAGJDkyURR_NF4qGnm-_0 2024-09-12T01:04:38.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5867177144593814051', time=2024-09-12T02:52:58.668685+0000, chain.objs.size()=1 2024-09-12T01:04:38.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.-d8q6qYdXTVjqjeA-H55_ILXES4-t_r_0 2024-09-12T01:04:38.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10269551969698233480', time=2024-09-12T02:52:58.692788+0000, chain.objs.size()=1 2024-09-12T01:04:38.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.SXStxhNYSEqzrN1rUmiTygpOjdBccbo_0 2024-09-12T01:04:38.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15340075438927296438', time=2024-09-12T02:53:43.473869+0000, chain.objs.size()=1 2024-09-12T01:04:38.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.390__shadow_.J0sQqmKktUiHNn1VyQMdg3Ix1QcZQXJ_0 2024-09-12T01:04:38.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12336057377344468680', time=2024-09-12T02:54:51.622524+0000, chain.objs.size()=1 2024-09-12T01:04:38.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.481__shadow_.9nMqWFQNz02qWx9MXvTIM1n7U92uKk5_0 2024-09-12T01:04:38.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17328221467049386196', time=2024-09-12T02:55:55.521566+0000, chain.objs.size()=2 2024-09-12T01:04:38.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.528__multipart_mymultipart.2~ewbN-gKToJt2NBvGXElM9pktaUjheva.1 2024-09-12T01:04:38.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.528__multipart_mymultipart.2~ewbN-gKToJt2NBvGXElM9pktaUjheva.2 2024-09-12T01:04:38.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~TbNV-LYpv5flIXC2jM8ieq2PCmHexWb', time=2024-09-12T02:55:58.314980+0000, chain.objs.size()=1 2024-09-12T01:04:38.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.531__multipart_mymultipart.2~TbNV-LYpv5flIXC2jM8ieq2PCmHexWb.1 2024-09-12T01:04:38.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.726+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12899213551780274979', time=2024-09-12T02:57:05.219273+0000, chain.objs.size()=1 2024-09-12T01:04:38.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.726+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.569__shadow:F6pA0pxRCq2gnURBp9czXKAa6D9yDmb_.IKDndq8dz01LgbJLgHd98ZzoOqqdBeX_0 2024-09-12T01:04:38.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.726+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10189152398171089547', time=2024-09-12T02:57:08.630741+0000, chain.objs.size()=1 2024-09-12T01:04:38.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.726+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.569__shadow:CFFXMASwP8xOgMVXrrJAvFQHmGNXQ-8_.fo8ucmdJglofPzZ_9fdE6DYarAPsXcx_0 2024-09-12T01:04:38.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.726+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.317313908887064633', time=2024-09-12T02:57:10.148939+0000, chain.objs.size()=1 2024-09-12T01:04:38.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.726+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.570__shadow:tKHvcdobrUUBdLB0za72JbNpa-wpFsk_.YRgvC8j6XrYZCcJUAt-lQWWNQkBKVHS_0 2024-09-12T01:04:38.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.730+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5625604539445995881', time=2024-09-12T02:57:26.199186+0000, chain.objs.size()=1 2024-09-12T01:04:38.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.730+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:Kc0PmuVSqAK.fkvlp484em5kCcyxzAm_.zVfBSZccRFILsrQrMP_AH4peLrjqkMi_0 2024-09-12T01:04:38.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.730+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9627361548688389706', time=2024-09-12T02:57:29.589043+0000, chain.objs.size()=1 2024-09-12T01:04:38.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.730+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:tcv9.X-EBVMXlTELMkohCtff5-B.guw_.SdvefBHS3F7oDpu-SSmr8r0jP59u475_0 2024-09-12T01:04:38.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.730+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2108127436788661760', time=2024-09-12T02:57:34.756015+0000, chain.objs.size()=1 2024-09-12T01:04:38.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.730+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:P92TVE7-Ph2tNdn2QIrUoear3ItW6yL_.XAmU0zSxqg2azp5v0dQZBeRz-XhWuHI_0 2024-09-12T01:04:38.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.730+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1763831202623236667', time=2024-09-12T02:57:35.742646+0000, chain.objs.size()=1 2024-09-12T01:04:38.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.730+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:JpFqimwHiaPsj5WLR6MT7eaEiJIKmW2_.8-7z0ZHAIWzrex4arKlqFUPTo3C8CcF_0 2024-09-12T01:04:38.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.730+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14315181017322811815', time=2024-09-12T02:57:36.263282+0000, chain.objs.size()=1 2024-09-12T01:04:38.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.730+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:jRdtDn8plGObLcF0XePOlmoYDaGfdaA_.5LdwaQhiwy2bhSqDBx9QPYqLeMp-3F8_0 2024-09-12T01:04:38.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.730+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8545366000575314700', time=2024-09-12T02:57:44.614987+0000, chain.objs.size()=1 2024-09-12T01:04:38.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.730+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.579__shadow:dtTP9jtJWNiWtNX6OpQt73VPxn1QQd7_.xNWSQU8zUa3dLzIntuQevIuAQCsNcHe_0 2024-09-12T01:04:38.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.730+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4307864159097266216', time=2024-09-12T02:57:44.672649+0000, chain.objs.size()=1 2024-09-12T01:04:38.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.730+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.579__shadow:LWdMGgXvii00.eqZQN0VE5zl7WoFqsI_.SjospmD2BXRRdoVfamTnbvAms2km717_0 2024-09-12T01:04:38.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.730+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16231961956784072366', time=2024-09-12T02:57:50.374955+0000, chain.objs.size()=1 2024-09-12T01:04:38.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.730+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.585__shadow:X5ZQXYRXNiNibK2cquCsubOsymo-ht8_.yIU_jioxlg6MJib7PMk_GmAL_WqkOQj_0 2024-09-12T01:04:38.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.730+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12402053506564934632', time=2024-09-12T02:57:52.256890+0000, chain.objs.size()=1 2024-09-12T01:04:38.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.730+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.587__shadow:gUDg.UejKhxof4SR-ar3hoQJYfM3o6O_.IcgqMZB4WdOB-nj_sPGz4Ra_nHWgvhj_0 2024-09-12T01:04:38.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.730+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11650608920544493503', time=2024-09-12T02:59:23.481803+0000, chain.objs.size()=1 2024-09-12T01:04:38.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.730+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.617__shadow_.MZtRN0DlG1VrpS9nH1QwAQfFkyzbx6J_0 2024-09-12T01:04:38.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.730+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6021249807271295212', time=2024-09-12T03:00:40.965564+0000, chain.objs.size()=1 2024-09-12T01:04:38.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.730+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.634__shadow_.A70p94O1rDMQxLSJH5H70nTiNoHCZJw_0 2024-09-12T01:04:38.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.730+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10797869446147928999', time=2024-09-12T03:00:48.112703+0000, chain.objs.size()=1 2024-09-12T01:04:38.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.730+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.644__shadow_.9jZg0HRZh5ortRrh1InIJCgsIyYOTaR_0 2024-09-12T01:04:38.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.734+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10387080335842219100', time=2024-09-12T03:01:06.454839+0000, chain.objs.size()=1 2024-09-12T01:04:38.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.734+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.664__shadow_.vBpu5zJPggbS0W7eZijqKK21ZHK6CsM_0 2024-09-12T01:04:38.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.734+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4603406905960514045', time=2024-09-12T03:01:11.309741+0000, chain.objs.size()=1 2024-09-12T01:04:38.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.734+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.671__shadow_.6nSsxoUvhgdNAfHZvFZEBfrqzGBOara_0 2024-09-12T01:04:38.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.734+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17861087641518866219', time=2024-09-12T03:01:11.484713+0000, chain.objs.size()=1 2024-09-12T01:04:38.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.734+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.672__shadow_.gygHbCWbuE2DrKoBjRcbtBMBnqLaxc7_0 2024-09-12T01:04:38.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.734+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14151753943604029347', time=2024-09-12T03:01:33.435389+0000, chain.objs.size()=1 2024-09-12T01:04:38.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.734+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.705__shadow:sihwyX4bQmauXuy-qa5NNot0u9THAJQ_.ddeBHJ7L7VkOpL414EVexMzQ3wEI1u9_0 2024-09-12T01:04:38.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.734+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18169402585049608293', time=2024-09-12T03:02:02.539527+0000, chain.objs.size()=1 2024-09-12T01:04:38.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.734+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.719__shadow_.sLuraPT0dMPG61PhPr6gS20MSmaDzpl_0 2024-09-12T01:04:38.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.734+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1129691954087218037', time=2024-09-12T03:02:15.072019+0000, chain.objs.size()=10 2024-09-12T01:04:38.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.734+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.735__multipart_foo.2~wwm_iTHMWPk1BYZrkWek5FGSlVe3mPM.1 2024-09-12T01:04:38.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.734+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.735__multipart_foo.2~wwm_iTHMWPk1BYZrkWek5FGSlVe3mPM.2 2024-09-12T01:04:38.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.734+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.735__multipart_foo.2~wwm_iTHMWPk1BYZrkWek5FGSlVe3mPM.3 2024-09-12T01:04:38.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.734+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.735__multipart_foo.2~wwm_iTHMWPk1BYZrkWek5FGSlVe3mPM.4 2024-09-12T01:04:38.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.734+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.735__multipart_foo.2~wwm_iTHMWPk1BYZrkWek5FGSlVe3mPM.5 2024-09-12T01:04:38.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.734+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.735__multipart_foo.2~wwm_iTHMWPk1BYZrkWek5FGSlVe3mPM.6 2024-09-12T01:04:38.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.738+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.735__multipart_foo.2~wwm_iTHMWPk1BYZrkWek5FGSlVe3mPM.7 2024-09-12T01:04:38.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.738+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.735__multipart_foo.2~wwm_iTHMWPk1BYZrkWek5FGSlVe3mPM.8 2024-09-12T01:04:38.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.738+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.735__multipart_foo.2~wwm_iTHMWPk1BYZrkWek5FGSlVe3mPM.9 2024-09-12T01:04:38.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.738+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.735__multipart_foo.2~wwm_iTHMWPk1BYZrkWek5FGSlVe3mPM.10 2024-09-12T01:04:38.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.742+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:38.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.746+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:04:38.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.750+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:38.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.750+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:38.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.750+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47852' 2024-09-12T01:04:38.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.750+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8019908627506622584', time=2024-09-12T02:48:36.676897+0000, chain.objs.size()=3 2024-09-12T01:04:38.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.750+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.162__shadow_.l1cWiNYbWoKdcZre7AoieZ_k5w1DJC6_0 2024-09-12T01:04:38.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.750+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.162__shadow_.l1cWiNYbWoKdcZre7AoieZ_k5w1DJC6_1 2024-09-12T01:04:38.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.750+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.162__shadow_.l1cWiNYbWoKdcZre7AoieZ_k5w1DJC6_2 2024-09-12T01:04:38.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.750+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7114990690350171234', time=2024-09-12T02:48:51.741849+0000, chain.objs.size()=1 2024-09-12T01:04:38.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.750+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.181__shadow_.wQxGn2J0cpqXvoU1p4xrhoAW6AQsiT-_0 2024-09-12T01:04:38.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.750+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1005984445301916340', time=2024-09-12T02:50:44.148959+0000, chain.objs.size()=1 2024-09-12T01:04:38.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.750+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.233__shadow_.SUbfm8f4dNVPiYymhaSIO-PSdR-5vAs_0 2024-09-12T01:04:38.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.750+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.66286666704269581', time=2024-09-12T02:50:45.703857+0000, chain.objs.size()=1 2024-09-12T01:04:38.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.750+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.235__shadow_.2YVusHbl1bAkiLN-EOFYMQdqFhvrY8t_0 2024-09-12T01:04:38.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.754+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8372323575182636930', time=2024-09-12T02:50:47.634860+0000, chain.objs.size()=1 2024-09-12T01:04:38.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.754+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.237__shadow_.ShwYOb3V2cykOpBm_-5AeJ2mzOnOsWj_0 2024-09-12T01:04:38.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.754+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.774530830076732391', time=2024-09-12T02:50:51.058626+0000, chain.objs.size()=1 2024-09-12T01:04:38.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.754+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.241__shadow_.yVqlhNn67_H12wxDjkCLY-6OCRk-VQm_0 2024-09-12T01:04:38.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.754+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1422410284731990417', time=2024-09-12T02:50:54.231823+0000, chain.objs.size()=1 2024-09-12T01:04:38.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.754+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.244__shadow_.N9RfwBjsLKbVquBWf5CZdSsuF_1M3oQ_0 2024-09-12T01:04:38.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.754+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5985544017322210304', time=2024-09-12T02:50:59.604947+0000, chain.objs.size()=1 2024-09-12T01:04:38.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.754+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.251__shadow_.pquLRTkmjGq9LJcqJ5D8wihceQz_xKF_0 2024-09-12T01:04:38.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.754+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9345810922632537697', time=2024-09-12T02:51:05.545485+0000, chain.objs.size()=1 2024-09-12T01:04:38.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.754+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.259__shadow_.CZ4a6Cp7U8565G0h_TR0Z7RbKiGgFoJ_0 2024-09-12T01:04:38.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.754+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10936433805453085538', time=2024-09-12T02:51:26.776750+0000, chain.objs.size()=1 2024-09-12T01:04:38.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.754+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.7BTSAhK4iccuOykPYlnyvkk2d4dU63m_0 2024-09-12T01:04:38.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.758+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8493563137792191619', time=2024-09-12T02:51:26.792594+0000, chain.objs.size()=1 2024-09-12T01:04:38.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.758+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.fpHrOYdrG47B7hFvCZkabQMvMxRpUO__0 2024-09-12T01:04:38.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.758+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.929648773567275355', time=2024-09-12T02:51:26.846443+0000, chain.objs.size()=1 2024-09-12T01:04:38.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.758+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.8BN52x428g8UP2sSXgtEn5-GauU9jh1_0 2024-09-12T01:04:38.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.758+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6175928245466577231', time=2024-09-12T02:51:26.851496+0000, chain.objs.size()=1 2024-09-12T01:04:38.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.758+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.k082CKibQDLi9Lv9OnBp8bYa8FT34re_0 2024-09-12T01:04:38.757 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.758+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10175227625125400260', time=2024-09-12T02:51:27.075209+0000, chain.objs.size()=1 2024-09-12T01:04:38.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.758+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.eUzVxFg3FQe8vnp4De4oM0DqWrQJK7e_0 2024-09-12T01:04:38.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.758+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11775592566441571309', time=2024-09-12T02:51:27.084744+0000, chain.objs.size()=1 2024-09-12T01:04:38.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.758+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.tldmHcj30SeQ-_txXTIyZD8oKJkIbnc_0 2024-09-12T01:04:38.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.758+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6041008261002911019', time=2024-09-12T02:51:27.201797+0000, chain.objs.size()=1 2024-09-12T01:04:38.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.758+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.JtvwUJdlSzGaXa_1P_MLLhZY5iNbrgz_0 2024-09-12T01:04:38.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.758+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10997041430831548676', time=2024-09-12T02:51:27.286649+0000, chain.objs.size()=1 2024-09-12T01:04:38.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.758+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.PZfZtSAF0Ie3abX6VMBZQwpcADKh40i_0 2024-09-12T01:04:38.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.758+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12674431647080361229', time=2024-09-12T02:51:27.297093+0000, chain.objs.size()=1 2024-09-12T01:04:38.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.758+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.tubSW65r20nsN5Sh03lKU3w-FQYsuF4_0 2024-09-12T01:04:38.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.758+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6178971189183649507', time=2024-09-12T02:51:27.311312+0000, chain.objs.size()=1 2024-09-12T01:04:38.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.758+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.3PdLbX9yxcVz-XhbGN7slHgfZEPVgVa_0 2024-09-12T01:04:38.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.758+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7426035583701928128', time=2024-09-12T02:51:27.472507+0000, chain.objs.size()=1 2024-09-12T01:04:38.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.758+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.QUQrvyN4TmtYyOoyEaGfpN7wYSIBqjU_0 2024-09-12T01:04:38.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.758+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11701766526013970515', time=2024-09-12T02:51:27.502968+0000, chain.objs.size()=1 2024-09-12T01:04:38.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.758+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.6XFIbUdOtFHGlQ_5b2zIo4vVTkm50Pv_0 2024-09-12T01:04:38.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.758+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7947694539574135774', time=2024-09-12T02:51:27.512629+0000, chain.objs.size()=1 2024-09-12T01:04:38.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.758+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.k0wOEyTU9taRSYE4BlFXTnCMae8-FLF_0 2024-09-12T01:04:38.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.758+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6345242444715076836', time=2024-09-12T02:51:27.519780+0000, chain.objs.size()=1 2024-09-12T01:04:38.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.758+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.oecOUFdBao8ZxcqHJHvwbscVVxANfvZ_0 2024-09-12T01:04:38.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.758+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3560955570778947355', time=2024-09-12T02:51:27.536071+0000, chain.objs.size()=1 2024-09-12T01:04:38.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.758+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Ccx6iPD3we8r3xLkZbQHHNkPzkYCbdH_0 2024-09-12T01:04:38.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7164847314275114574', time=2024-09-12T02:51:27.625434+0000, chain.objs.size()=1 2024-09-12T01:04:38.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.V2U32_yxngAg25buw-ZG0BXPjiHPiEr_0 2024-09-12T01:04:38.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9532561397472654835', time=2024-09-12T02:51:27.699122+0000, chain.objs.size()=1 2024-09-12T01:04:38.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_._OZmAqaswug5AIY-p9MBm-TdLc8jKs-_0 2024-09-12T01:04:38.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11084577221526964420', time=2024-09-12T02:51:27.737864+0000, chain.objs.size()=1 2024-09-12T01:04:38.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.5RCCkmmqFUoMWxOf0Cbzh3_GNmRSJVM_0 2024-09-12T01:04:38.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1612016711834735309', time=2024-09-12T02:51:27.839972+0000, chain.objs.size()=1 2024-09-12T01:04:38.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.s3L5OH4fDArDXNLm8wjxfGWnv1ikzxM_0 2024-09-12T01:04:38.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1611580131435124962', time=2024-09-12T02:51:27.844518+0000, chain.objs.size()=1 2024-09-12T01:04:38.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.b4cx16xQP265ikHCdFX9Enf5_PGkw0E_0 2024-09-12T01:04:38.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8693562215095331040', time=2024-09-12T02:51:27.895206+0000, chain.objs.size()=1 2024-09-12T01:04:38.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.j0Z8gZ_UuvG2hUJD4JhGg-RpE192nBc_0 2024-09-12T01:04:38.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1581579558694868114', time=2024-09-12T02:51:27.902775+0000, chain.objs.size()=1 2024-09-12T01:04:38.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Bu3gOah6qEkL_F5F0gDUcfC-20KHdFn_0 2024-09-12T01:04:38.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13352550014813652308', time=2024-09-12T02:51:27.918808+0000, chain.objs.size()=1 2024-09-12T01:04:38.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.PpfgxkcWMMirktwwHRYt3AvAcYJBco4_0 2024-09-12T01:04:38.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9118303582157527720', time=2024-09-12T02:51:27.962329+0000, chain.objs.size()=1 2024-09-12T01:04:38.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.16IZM-f3Rs-G_ubvO9tBjvzT_7RGBh8_0 2024-09-12T01:04:38.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3115767274224872174', time=2024-09-12T02:51:28.164223+0000, chain.objs.size()=1 2024-09-12T01:04:38.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.3-793ZdC5ibFmqY8L3-MML3FAhO7VRP_0 2024-09-12T01:04:38.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5607225496122940953', time=2024-09-12T02:51:28.169238+0000, chain.objs.size()=1 2024-09-12T01:04:38.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.amlpC_M-xRS44XRg2kHkBAUOWfr71vc_0 2024-09-12T01:04:38.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.766+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17404772099284388381', time=2024-09-12T02:51:28.383713+0000, chain.objs.size()=1 2024-09-12T01:04:38.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.766+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.vqkcc3mMdmnAIA_QdcF3kOR_8IfB2mK_0 2024-09-12T01:04:38.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.766+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11996361774202282990', time=2024-09-12T02:51:28.396076+0000, chain.objs.size()=1 2024-09-12T01:04:38.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.766+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.jO8fc7dK4UoSdjxQuGFeRqIQgIiN3Wq_0 2024-09-12T01:04:38.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.766+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13267254307610900748', time=2024-09-12T02:51:37.251077+0000, chain.objs.size()=1 2024-09-12T01:04:38.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.766+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.274__shadow_.i8ZSojRDRodCCSLpGbXGBj0QFVZUp8X_0 2024-09-12T01:04:38.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.766+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15973861327001259377', time=2024-09-12T02:51:38.782353+0000, chain.objs.size()=1 2024-09-12T01:04:38.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.766+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.276__shadow_.-uPkUvN6uoi95cUSsmYDHyvySxjEe8O_0 2024-09-12T01:04:38.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.766+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8995090593334075116', time=2024-09-12T02:51:51.710572+0000, chain.objs.size()=1 2024-09-12T01:04:38.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.766+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.292__shadow_.WhB2c13JEE78uwPSIiXsS8nK2A92JNo_0 2024-09-12T01:04:38.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.766+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6797498498122998994', time=2024-09-12T02:51:51.714645+0000, chain.objs.size()=1 2024-09-12T01:04:38.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.766+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.292__shadow_.Eh4PAVECQcIFa7-uceryaFDb-EzCdts_0 2024-09-12T01:04:38.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.766+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13402589650874717567', time=2024-09-12T02:51:53.160991+0000, chain.objs.size()=1 2024-09-12T01:04:38.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.766+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.293__shadow_.uSUdNveqzZSykYWxMHPEcgXz-S83_Iu_0 2024-09-12T01:04:38.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.766+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2135354727443746348', time=2024-09-12T02:51:56.108334+0000, chain.objs.size()=1 2024-09-12T01:04:38.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.766+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.297__shadow_.rCtPY44S9jjd0hADYE3lfhH_XaqRddY_0 2024-09-12T01:04:38.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.766+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3744663572204608230', time=2024-09-12T02:51:57.670262+0000, chain.objs.size()=1 2024-09-12T01:04:38.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.766+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.299__shadow_.FQ61i6koH7Dp_IiuEGXG5HHjjaLxYZP_0 2024-09-12T01:04:38.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.766+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6180088095579320219', time=2024-09-12T02:52:02.123839+0000, chain.objs.size()=1 2024-09-12T01:04:38.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.766+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.305__shadow_.EBv3gI-3L1sb6kZ1L2wqYQl5w_wiXoA_0 2024-09-12T01:04:38.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.766+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13796995570418517938', time=2024-09-12T02:52:12.950209+0000, chain.objs.size()=1 2024-09-12T01:04:38.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.766+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.319__shadow:cEbSeaIW.xJvkSDCy82HZSWUeVIAlZD_.KkKmz_DRM2BL1H8dD6ruPJp2BZzVxhX_0 2024-09-12T01:04:38.771 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.770+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9368351965716289066', time=2024-09-12T02:52:14.638962+0000, chain.objs.size()=1 2024-09-12T01:04:38.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.770+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.322__shadow_.1HZsT0yO7WWcl5O5ln3Pkh6qzg30l75_0 2024-09-12T01:04:38.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.770+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17072021789635183278', time=2024-09-12T02:52:35.133290+0000, chain.objs.size()=1 2024-09-12T01:04:38.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.770+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.O3MzRgIO8b-fSkWugTqyHJf-P3-Gc7l_0 2024-09-12T01:04:38.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.770+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5905299748732843231', time=2024-09-12T02:52:35.157196+0000, chain.objs.size()=1 2024-09-12T01:04:38.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.770+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.fWTQNLMYgmsgzkyeb8rTQPzgWbGMZJL_0 2024-09-12T01:04:38.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.770+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15982789731935197715', time=2024-09-12T02:52:35.303459+0000, chain.objs.size()=1 2024-09-12T01:04:38.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.770+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.rjyS98qY7bDDJOVmvzOdJfSYhyG0BJK_0 2024-09-12T01:04:38.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.770+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15037707931328993553', time=2024-09-12T02:52:35.361711+0000, chain.objs.size()=1 2024-09-12T01:04:38.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.770+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.k9mJsHAzgcAbRhF9iCG3F0uZCLesSJ1_0 2024-09-12T01:04:38.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.770+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.317702801891615662', time=2024-09-12T02:52:35.400781+0000, chain.objs.size()=1 2024-09-12T01:04:38.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.770+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.n7_NkvpF6cM40j6mLbCinb4HiibkrwL_0 2024-09-12T01:04:38.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.770+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3596358307611571744', time=2024-09-12T02:52:35.546770+0000, chain.objs.size()=1 2024-09-12T01:04:38.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.770+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.qvb3sC7dIKK0yN7tGCpiIeSdGucc1dw_0 2024-09-12T01:04:38.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.770+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10283685662325509678', time=2024-09-12T02:52:35.558839+0000, chain.objs.size()=1 2024-09-12T01:04:38.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.770+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.n8A5RNnJAFEVdu_g5nYV2z7fQGKq3hn_0 2024-09-12T01:04:38.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.770+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17821545144440236657', time=2024-09-12T02:52:35.642779+0000, chain.objs.size()=1 2024-09-12T01:04:38.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.774+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.fufoQ1QVfDdgPZuGEp4FKEKuNOzRg6h_0 2024-09-12T01:04:38.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.774+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13366531307923764102', time=2024-09-12T02:52:35.645434+0000, chain.objs.size()=1 2024-09-12T01:04:38.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.774+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.XEoQvEyQaQnunqyPTm2amUUDSa7UCrA_0 2024-09-12T01:04:38.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.774+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14168208351923478520', time=2024-09-12T02:52:35.654855+0000, chain.objs.size()=1 2024-09-12T01:04:38.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.774+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.N7jMjplqJFjsm-4Ps-yMzZpspmKOz7n_0 2024-09-12T01:04:38.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.774+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3456202712748154506', time=2024-09-12T02:52:35.777260+0000, chain.objs.size()=1 2024-09-12T01:04:38.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.774+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.-z5eUG1kNRb03qJLILC4ZRHcKg_vid1_0 2024-09-12T01:04:38.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.778+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5490396070508942302', time=2024-09-12T02:52:35.833461+0000, chain.objs.size()=1 2024-09-12T01:04:38.777 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.778+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.IklHsnMOeeTdxnLvnNcPm70gyEGLt0Z_0 2024-09-12T01:04:38.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.778+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9108844830511682890', time=2024-09-12T02:52:36.242541+0000, chain.objs.size()=1 2024-09-12T01:04:38.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.778+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.a_ZSjFVKf4b3c-rwDlb_TDiFyneY1xK_0 2024-09-12T01:04:38.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.778+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4173191875925850836', time=2024-09-12T02:52:36.268948+0000, chain.objs.size()=1 2024-09-12T01:04:38.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.778+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.yn16gVQESl53JavB8eQ0aDMqxzwNvFb_0 2024-09-12T01:04:38.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.778+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13490959631678650220', time=2024-09-12T02:52:36.524378+0000, chain.objs.size()=1 2024-09-12T01:04:38.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.778+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.NRKLabVEWHSgmhDzMnn___2AMqqTz25_0 2024-09-12T01:04:38.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.778+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6328699351069420122', time=2024-09-12T02:52:36.531369+0000, chain.objs.size()=1 2024-09-12T01:04:38.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.778+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ctxohibIEXVdyR7D0rOkSJr2HHn3I_H_0 2024-09-12T01:04:38.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.778+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8421438469631084082', time=2024-09-12T02:52:36.533627+0000, chain.objs.size()=1 2024-09-12T01:04:38.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.778+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.hy6lDKu-N4XSuyKBZt47QXAzMcIOJmO_0 2024-09-12T01:04:38.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.778+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8219585652756793795', time=2024-09-12T02:52:36.550519+0000, chain.objs.size()=1 2024-09-12T01:04:38.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.778+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.BWHzWQ4Y7eOPkp3zzLe9eU2ofIrDHJP_0 2024-09-12T01:04:38.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.778+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1690314979938506536', time=2024-09-12T02:52:36.557600+0000, chain.objs.size()=1 2024-09-12T01:04:38.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.778+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.zUR-dlqJw1r4tePHLGtgPKnevqyv9Iw_0 2024-09-12T01:04:38.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.778+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14105169378071988400', time=2024-09-12T02:52:36.573308+0000, chain.objs.size()=1 2024-09-12T01:04:38.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.778+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.RWHnnG1zhzKT_8rBFCWjpBFMYKldIf4_0 2024-09-12T01:04:38.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.778+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11709391460450366960', time=2024-09-12T02:52:36.575145+0000, chain.objs.size()=1 2024-09-12T01:04:38.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.778+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ycB2Q6Mukl3bLtgv7DZR_wvxv0rl8ga_0 2024-09-12T01:04:38.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.778+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13058528744103933120', time=2024-09-12T02:52:36.582537+0000, chain.objs.size()=1 2024-09-12T01:04:38.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.778+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ECyNmy2GRyBeu2DvBfrfVOR5x7JKzEx_0 2024-09-12T01:04:38.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.778+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2309795096173877581', time=2024-09-12T02:52:36.620921+0000, chain.objs.size()=1 2024-09-12T01:04:38.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.778+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.YOU14mn3zEeFJbVCt1DWrAkzmWbOr7I_0 2024-09-12T01:04:38.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.782+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3368968237841315998', time=2024-09-12T02:52:36.637226+0000, chain.objs.size()=1 2024-09-12T01:04:38.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.782+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Hi0Ce-Y8hfeav_N8uvvY7OJ-xX_-Eht_0 2024-09-12T01:04:38.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.782+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6987133087546684528', time=2024-09-12T02:52:36.808954+0000, chain.objs.size()=1 2024-09-12T01:04:38.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.782+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.V5YJNhot-ERIepEdPJ7ljzq39gHv-Eu_0 2024-09-12T01:04:38.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.782+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13051943360949389874', time=2024-09-12T02:52:36.836291+0000, chain.objs.size()=1 2024-09-12T01:04:38.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.782+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Z0-33sMzdgUTUxPvCvsp63XLTCYA6Zn_0 2024-09-12T01:04:38.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.782+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10117445032298042582', time=2024-09-12T02:52:36.984195+0000, chain.objs.size()=1 2024-09-12T01:04:38.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.782+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.WZyjzHywUfoSL5MVLPbaH7Md77fvWRg_0 2024-09-12T01:04:38.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.782+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8587060415515510531', time=2024-09-12T02:52:37.000829+0000, chain.objs.size()=1 2024-09-12T01:04:38.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.782+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.YjldI_DLKC_rHdPYEW2CeoR_N7PU-yw_0 2024-09-12T01:04:38.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.782+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11253856564695594576', time=2024-09-12T02:52:37.041395+0000, chain.objs.size()=1 2024-09-12T01:04:38.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.782+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.c1Q0Uv1JgYtL3vjpmK0mR84pgjQcWZ1_0 2024-09-12T01:04:38.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.782+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4751307798365734279', time=2024-09-12T02:52:37.043535+0000, chain.objs.size()=1 2024-09-12T01:04:38.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.782+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.b8NsAWz9jWw3XoooqKnPNGUy_UBHphX_0 2024-09-12T01:04:38.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.782+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3255622629197422323', time=2024-09-12T02:52:37.044988+0000, chain.objs.size()=1 2024-09-12T01:04:38.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.782+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.I0yqnLoAl7KjAWY96gmLQoYHcPReyjt_0 2024-09-12T01:04:38.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.786+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12603197704124696279', time=2024-09-12T02:52:37.065434+0000, chain.objs.size()=1 2024-09-12T01:04:38.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.786+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ZwVBJfV3hxoSpwE8-Lw4080YCdhyQDW_0 2024-09-12T01:04:38.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.786+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16272504059488628874', time=2024-09-12T02:52:56.963863+0000, chain.objs.size()=1 2024-09-12T01:04:38.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.786+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.IoXMS7GTU134OSL28ZB91dAkNzAL2-A_0 2024-09-12T01:04:38.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.786+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1824376243395981220', time=2024-09-12T02:52:57.005648+0000, chain.objs.size()=1 2024-09-12T01:04:38.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.786+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.jtxtm2O79emK45hsA5yEwsXf9tnpZNf_0 2024-09-12T01:04:38.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.786+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4932019222756603601', time=2024-09-12T02:52:57.015775+0000, chain.objs.size()=1 2024-09-12T01:04:38.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.786+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.yzTwtouCzkqVYCn11oPouJKdAy4pQzc_0 2024-09-12T01:04:38.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.786+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.482510791416793368', time=2024-09-12T02:52:57.021068+0000, chain.objs.size()=1 2024-09-12T01:04:38.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.786+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.KpnsTb9ZEdPRe_Vcy9pGQxUgKkSUNWz_0 2024-09-12T01:04:38.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.786+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2850124085975556173', time=2024-09-12T02:52:57.178234+0000, chain.objs.size()=1 2024-09-12T01:04:38.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.786+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.bt5CIZ4R7_DQkFK5OdyWJTQvFbM0ZHy_0 2024-09-12T01:04:38.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.786+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8571609063855199469', time=2024-09-12T02:52:57.224578+0000, chain.objs.size()=1 2024-09-12T01:04:38.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.786+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.wUEg7lYoNH5MGEVsaLAydK4XSlgp0Nv_0 2024-09-12T01:04:38.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.786+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.258646466415486970', time=2024-09-12T02:52:57.247548+0000, chain.objs.size()=1 2024-09-12T01:04:38.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.786+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.irM8Sau1t6RSRK629SCaVEwbeOktwv8_0 2024-09-12T01:04:38.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.786+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8861036002160491097', time=2024-09-12T02:52:57.406277+0000, chain.objs.size()=1 2024-09-12T01:04:38.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.786+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.MafYD8rxYPnXrAUpvF6GRYZzPm26wMF_0 2024-09-12T01:04:38.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.786+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1768834307443908677', time=2024-09-12T02:52:57.425487+0000, chain.objs.size()=1 2024-09-12T01:04:38.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.786+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.nfai8m2Wo02U_6H32LP8UcCIw4soFmj_0 2024-09-12T01:04:38.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.786+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9106985780171911755', time=2024-09-12T02:52:57.502652+0000, chain.objs.size()=1 2024-09-12T01:04:38.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.786+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.mWFffqdsNo3iZJvnEgIB2uCubNYjC9C_0 2024-09-12T01:04:38.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.790+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8194160746347043837', time=2024-09-12T02:52:57.506318+0000, chain.objs.size()=1 2024-09-12T01:04:38.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.790+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.q3XUyfIIhTowOrgSij8ZQzGdooNC6X9_0 2024-09-12T01:04:38.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.790+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9371152452337199930', time=2024-09-12T02:52:57.527129+0000, chain.objs.size()=1 2024-09-12T01:04:38.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.790+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.dIjJB6rZiC9-7UmRTm7OO9I_WX9-TBD_0 2024-09-12T01:04:38.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.790+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1660646982003437598', time=2024-09-12T02:52:57.671957+0000, chain.objs.size()=1 2024-09-12T01:04:38.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.790+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.0Dela2nSmsP2Y7RbnrPkMHBJgEfdPYe_0 2024-09-12T01:04:38.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.790+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12657157142697868186', time=2024-09-12T02:52:57.721241+0000, chain.objs.size()=1 2024-09-12T01:04:38.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.790+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.oVDttwx9p7UWEwxssXq1Mp255Qy5lsd_0 2024-09-12T01:04:38.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.790+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3994688047640809520', time=2024-09-12T02:52:57.746726+0000, chain.objs.size()=1 2024-09-12T01:04:38.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.790+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.EhbAM607ClYzxI4ultocQtg6kvEpopz_0 2024-09-12T01:04:38.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.790+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17449302526945489055', time=2024-09-12T02:52:57.866195+0000, chain.objs.size()=1 2024-09-12T01:04:38.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.790+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.KizNccz-k6VeCdc-wmGGJt_IKnnPGNb_0 2024-09-12T01:04:38.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.790+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16018409712061164843', time=2024-09-12T02:52:57.941543+0000, chain.objs.size()=1 2024-09-12T01:04:38.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.790+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.b7wpToNCenA99DSdoSrDujCLc9XYjhs_0 2024-09-12T01:04:38.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.790+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15120607440346149641', time=2024-09-12T02:52:57.960750+0000, chain.objs.size()=1 2024-09-12T01:04:38.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.790+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.0du6I2FJDsP_gEKAnzUBWdoHhs9Eh0O_0 2024-09-12T01:04:38.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.790+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17274331463608377944', time=2024-09-12T02:52:57.968760+0000, chain.objs.size()=1 2024-09-12T01:04:38.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.790+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.mcfmaPjYTkYTzG_C_QEEv65dn5NwB0P_0 2024-09-12T01:04:38.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.790+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13789791543923442652', time=2024-09-12T02:52:57.981758+0000, chain.objs.size()=1 2024-09-12T01:04:38.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.790+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.3HzHMju261vA4EFnRJudms11ZfTTMSc_0 2024-09-12T01:04:38.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.790+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10267963240273001432', time=2024-09-12T02:52:57.989814+0000, chain.objs.size()=1 2024-09-12T01:04:38.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.790+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.pVcnaIJ6jWF2cAVTK_x9LsAvF8gkwIH_0 2024-09-12T01:04:38.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.794+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47852 2024-09-12T01:04:38.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.798+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-09-12T01:04:38.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.798+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6098596320354216433', time=2024-09-12T02:52:58.183242+0000, chain.objs.size()=1 2024-09-12T01:04:38.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.798+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.mbDh2Lou8DVvvmXsir2SniSmb0atn36_0 2024-09-12T01:04:38.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.798+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14505164670060163393', time=2024-09-12T02:52:58.395537+0000, chain.objs.size()=1 2024-09-12T01:04:38.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.798+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.490zq3mJ1fhClSHcRSa6rGWxdw51b4q_0 2024-09-12T01:04:38.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.798+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6335989743590230515', time=2024-09-12T02:52:58.398660+0000, chain.objs.size()=1 2024-09-12T01:04:38.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.798+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.VpT4-j_dbVNe2vtnUG_GrGt65N8MYBY_0 2024-09-12T01:04:38.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.798+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10021243216126552393', time=2024-09-12T02:52:58.419314+0000, chain.objs.size()=1 2024-09-12T01:04:38.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.798+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.rnMefQ19AWXmc6tKCxV08UF-N1eh-mU_0 2024-09-12T01:04:38.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.798+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12302700274280990684', time=2024-09-12T02:52:58.472714+0000, chain.objs.size()=1 2024-09-12T01:04:38.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.798+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.c_tg4IOED3mOOWBRXRRp_K_Hm1oIcQB_0 2024-09-12T01:04:38.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.798+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14428770983600767807', time=2024-09-12T02:52:58.487065+0000, chain.objs.size()=1 2024-09-12T01:04:38.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.798+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.AIFyRp9rJXVJY2Ab9WWH36Rb9G1GEY9_0 2024-09-12T01:04:38.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.798+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5995127137161789723', time=2024-09-12T02:52:58.504189+0000, chain.objs.size()=1 2024-09-12T01:04:38.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.798+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.kkraZFylp_slrO46uvfxHyhrNdf6YDV_0 2024-09-12T01:04:38.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.798+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12989266790684379834', time=2024-09-12T02:52:58.653792+0000, chain.objs.size()=1 2024-09-12T01:04:38.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.798+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.xSnXXkLCBGwqbIHzyspVMQ2HNWwp_J9_0 2024-09-12T01:04:38.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.798+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11980858019235934628', time=2024-09-12T02:53:34.250097+0000, chain.objs.size()=1 2024-09-12T01:04:38.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.798+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.378__shadow_.1v6dLPM6sJJdw6FrA8XwgMVy1ysKsk7_0 2024-09-12T01:04:38.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.798+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6109493353986040684', time=2024-09-12T02:53:34.794205+0000, chain.objs.size()=1 2024-09-12T01:04:38.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.798+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.379__shadow_.muygmEpAORfv734ME2vW2SfIbo3IlrN_0 2024-09-12T01:04:38.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.798+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11076043935201390358', time=2024-09-12T02:54:53.300536+0000, chain.objs.size()=1 2024-09-12T01:04:38.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.798+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.483__shadow_.wlJ63qcTQlxmBfmYsJ7_RP9ME-MmzOP_0 2024-09-12T01:04:38.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.798+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5479816529786607736', time=2024-09-12T02:55:13.042413+0000, chain.objs.size()=1 2024-09-12T01:04:38.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.798+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.511__multipart_mymultipart.2~21J2HWJahDhbfsTBMT2Q4EalBkEb51B.1 2024-09-12T01:04:38.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.798+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~ltIsMnTm7gpW5umi99LwGtyfm5hqgBp', time=2024-09-12T02:55:42.137479+0000, chain.objs.size()=1 2024-09-12T01:04:38.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.798+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.2~ltIsMnTm7gpW5umi99LwGtyfm5hqgBp.1 2024-09-12T01:04:38.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.802+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~ltIsMnTm7gpW5umi99LwGtyfm5hqgBp', time=2024-09-12T02:55:42.140985+0000, chain.objs.size()=1 2024-09-12T01:04:38.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.2~ltIsMnTm7gpW5umi99LwGtyfm5hqgBp.2 2024-09-12T01:04:38.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.802+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~ltIsMnTm7gpW5umi99LwGtyfm5hqgBp', time=2024-09-12T02:55:42.144633+0000, chain.objs.size()=1 2024-09-12T01:04:38.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.2~ltIsMnTm7gpW5umi99LwGtyfm5hqgBp.3 2024-09-12T01:04:38.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.802+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~ltIsMnTm7gpW5umi99LwGtyfm5hqgBp', time=2024-09-12T02:55:42.148280+0000, chain.objs.size()=1 2024-09-12T01:04:38.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.2~ltIsMnTm7gpW5umi99LwGtyfm5hqgBp.4 2024-09-12T01:04:38.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.802+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~ltIsMnTm7gpW5umi99LwGtyfm5hqgBp', time=2024-09-12T02:55:42.151963+0000, chain.objs.size()=1 2024-09-12T01:04:38.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.2~ltIsMnTm7gpW5umi99LwGtyfm5hqgBp.5 2024-09-12T01:04:38.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.802+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~ltIsMnTm7gpW5umi99LwGtyfm5hqgBp', time=2024-09-12T02:55:42.155887+0000, chain.objs.size()=1 2024-09-12T01:04:38.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.2~ltIsMnTm7gpW5umi99LwGtyfm5hqgBp.6 2024-09-12T01:04:38.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.802+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17493683117057482560', time=2024-09-12T02:55:42.170176+0000, chain.objs.size()=6 2024-09-12T01:04:38.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.2~XjaTTqcCRPhzht3XsRsI753kgTbBRjx.1 2024-09-12T01:04:38.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.y8VILutvjuIPLrj0eN_3IShxPc7CdSDF.2 2024-09-12T01:04:38.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.HRuH3r1AXATTTqpWAGXm7FQqxihWxJ3O.3 2024-09-12T01:04:38.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.2~XjaTTqcCRPhzht3XsRsI753kgTbBRjx.4 2024-09-12T01:04:38.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.2~XjaTTqcCRPhzht3XsRsI753kgTbBRjx.5 2024-09-12T01:04:38.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.2~XjaTTqcCRPhzht3XsRsI753kgTbBRjx.6 2024-09-12T01:04:38.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.806+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16961692257330194396', time=2024-09-12T02:55:55.238666+0000, chain.objs.size()=1 2024-09-12T01:04:38.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.806+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.528__shadow_.gQp4q0QxcLQetz-RpqQPkGUTvYJr3bo_0 2024-09-12T01:04:38.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.806+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2384289786637575779', time=2024-09-12T02:56:58.401818+0000, chain.objs.size()=1 2024-09-12T01:04:38.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.806+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.565__shadow_.ZdxKYlsrvbIst7CRVWIvYRY-XszV2vp_0 2024-09-12T01:04:38.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.806+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5969561532964843758', time=2024-09-12T02:57:19.376197+0000, chain.objs.size()=1 2024-09-12T01:04:38.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.806+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.576__shadow:.QOc7X1-U0BXumHmaLyX1pOYrlKcYFx_.i97ivDByisDhPO5LLYA6Ahrgjp0WW10_0 2024-09-12T01:04:38.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.806+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9461914909708459812', time=2024-09-12T02:57:24.929312+0000, chain.objs.size()=1 2024-09-12T01:04:38.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.806+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:c73JUOMbObnjUGjrZ8dGqZ9f9X0t9XD_.ur7TTmSyxrIvFeCfvsLkU5pkMvPtrj4_0 2024-09-12T01:04:38.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.806+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12650777739196774888', time=2024-09-12T02:57:29.975002+0000, chain.objs.size()=1 2024-09-12T01:04:38.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.806+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:13.UJlA70Vw3H7yQwZ-LuRRPVxA5cno_.-f2mwFnIYJYoVjK1xxt3x5I1ayvG2q-_0 2024-09-12T01:04:38.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.806+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.151613343011053854', time=2024-09-12T02:57:30.807279+0000, chain.objs.size()=1 2024-09-12T01:04:38.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.806+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:7YgbujMCGipqtSmuWVIcZiPXJKjzmbY_.6VOEGmGk3P11At75XL9C4NMFMhUNnsR_0 2024-09-12T01:04:38.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.806+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11276661531290052351', time=2024-09-12T02:57:44.684476+0000, chain.objs.size()=1 2024-09-12T01:04:38.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.806+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.579__shadow:P0hGRZJytrZxmdvJP5CtM6V8znl8fHV_.IEJFmwlx3KaostugaxqiDilER4HlI1f_0 2024-09-12T01:04:38.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.806+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5208242514373372854', time=2024-09-12T02:57:46.507356+0000, chain.objs.size()=1 2024-09-12T01:04:38.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.806+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.580__shadow:zRIZKMp0kS3eLjGXIXHWR8x5alkErB2_.tAFjdM4_W4FjfMT3CrCSpCD7k5Ewdpj_0 2024-09-12T01:04:38.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.806+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17775889213939151912', time=2024-09-12T02:57:47.107863+0000, chain.objs.size()=1 2024-09-12T01:04:38.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.806+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.582__shadow:QSLQV4xKQBS4iwVAXqsf6ZNsW7ubkvW_.9A_Z-gI1g4XBIYXUjivT8CJJg2DVmc1_0 2024-09-12T01:04:38.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.806+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13902977026343558836', time=2024-09-12T03:01:08.428817+0000, chain.objs.size()=1 2024-09-12T01:04:38.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.806+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.666__shadow_.03upu-TmYEVltW7m_d8mCalkCnhYG1w_0 2024-09-12T01:04:38.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.806+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4333764176359787859', time=2024-09-12T03:01:26.245527+0000, chain.objs.size()=1 2024-09-12T01:04:38.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.806+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.695__shadow_.5td-UCg3DkDPJkgoAj9lXQM2Ceythe0_0 2024-09-12T01:04:38.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.806+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6731776965490474052', time=2024-09-12T03:02:01.789803+0000, chain.objs.size()=1 2024-09-12T01:04:38.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.810+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.718__shadow_.Y80vibwP9orv5rAW1QoAyqU2pVb4tsc_0 2024-09-12T01:04:38.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.810+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~AwFz1LzgCinmVI8LGhVwyC3cEQGWy2c', time=2024-09-12T03:02:20.572373+0000, chain.objs.size()=1 2024-09-12T01:04:38.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.810+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.742__multipart_mymultipart.2~AwFz1LzgCinmVI8LGhVwyC3cEQGWy2c.1 2024-09-12T01:04:38.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.810+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:38.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.814+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:04:38.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:38.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:38.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46307' 2024-09-12T01:04:38.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='_5kaZFkfubVOuaWiWqOozpFMeNE1Nn0X', time=2024-09-12T02:48:31.477718+0000, chain.objs.size()=1 2024-09-12T01:04:38.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.160__shadow_.Zuu5gCoXs9hiU0r6wN5x2mFl7w_ggMI_0 2024-09-12T01:04:38.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9197112068451442664', time=2024-09-12T02:48:49.737217+0000, chain.objs.size()=1 2024-09-12T01:04:38.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.178__shadow_.s0l0aw_Gci5tTGiuYWVAcZgH_qbXTz2_0 2024-09-12T01:04:38.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4004973387243550833', time=2024-09-12T02:50:41.974242+0000, chain.objs.size()=1 2024-09-12T01:04:38.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.230__shadow_.zWDbl-Qb3uE2gZkUuUJCdp7p-_tqjyA_0 2024-09-12T01:04:38.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10787578123608908822', time=2024-09-12T02:50:55.740469+0000, chain.objs.size()=1 2024-09-12T01:04:38.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.246__shadow_.ehOxTcrVCB_zTYBFDWGIDy9OskFrtCk_0 2024-09-12T01:04:38.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2596471354836264774', time=2024-09-12T02:51:26.746142+0000, chain.objs.size()=1 2024-09-12T01:04:38.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Wpx3bgL6hRpUv77Oa7c2kitlfQ6dsEW_0 2024-09-12T01:04:38.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16212650881084344590', time=2024-09-12T02:51:26.768590+0000, chain.objs.size()=1 2024-09-12T01:04:38.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Ly7FsetxoK2HPerz7LCS2l_Vx1bzJxv_0 2024-09-12T01:04:38.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8821414917302784000', time=2024-09-12T02:51:26.797429+0000, chain.objs.size()=1 2024-09-12T01:04:38.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.qLDUmYaz9owJ270XMI-6HbJqRp6tgg-_0 2024-09-12T01:04:38.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1084683069767656710', time=2024-09-12T02:51:26.827930+0000, chain.objs.size()=1 2024-09-12T01:04:38.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Jdzg0fbvZQ00ZoRXUCKD0ohe8fgHzUz_0 2024-09-12T01:04:38.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11834420545309512987', time=2024-09-12T02:51:26.831042+0000, chain.objs.size()=1 2024-09-12T01:04:38.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.tlD8agfhW8KJbGoK_XfH6NkyRKNlfih_0 2024-09-12T01:04:38.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8749611450784448479', time=2024-09-12T02:51:27.011570+0000, chain.objs.size()=1 2024-09-12T01:04:38.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.7FdEsrfLUDy2ctNTt_UFJ4njBm4ezB2_0 2024-09-12T01:04:38.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3281979099828746375', time=2024-09-12T02:51:27.012917+0000, chain.objs.size()=1 2024-09-12T01:04:38.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.u0V9_CLarZbnh-Fjt5gri36-u_9MJKl_0 2024-09-12T01:04:38.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11780586301717766880', time=2024-09-12T02:51:27.036124+0000, chain.objs.size()=1 2024-09-12T01:04:38.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.hEgcwYgg7NhzJW8Qmr1jWJHLKdmIyVE_0 2024-09-12T01:04:38.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.822+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6480850445373942412', time=2024-09-12T02:51:27.050136+0000, chain.objs.size()=1 2024-09-12T01:04:38.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.822+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.7npKDQF3V14bSUBf-eG2uH8y1ahHDc4_0 2024-09-12T01:04:38.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.822+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7352404244255414932', time=2024-09-12T02:51:27.054870+0000, chain.objs.size()=1 2024-09-12T01:04:38.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.822+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.jcI5uj3j9Zdh8zwEEVmroCsARk_z0Z3_0 2024-09-12T01:04:38.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.822+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11356222847490321846', time=2024-09-12T02:51:27.291705+0000, chain.objs.size()=1 2024-09-12T01:04:38.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.822+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.p-zRd8Y7sSsNP9kUW3AsjaH8alBIkYg_0 2024-09-12T01:04:38.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.822+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12174299036032794322', time=2024-09-12T02:51:27.450729+0000, chain.objs.size()=1 2024-09-12T01:04:38.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.822+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.lB5aHKLukJYHhYHcaIBCiYbkCIntlWS_0 2024-09-12T01:04:38.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.822+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7989786199148161157', time=2024-09-12T02:51:27.458036+0000, chain.objs.size()=1 2024-09-12T01:04:38.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.822+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.PZWwgUkZdZRR90VHIZKUkgGb79omUUr_0 2024-09-12T01:04:38.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.822+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17156636440691737259', time=2024-09-12T02:51:27.497193+0000, chain.objs.size()=1 2024-09-12T01:04:38.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.822+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.-QQ2DN3s4dHGIDWe7ofrmBMZXwTnrnh_0 2024-09-12T01:04:38.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.822+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10945508160960311115', time=2024-09-12T02:51:27.510651+0000, chain.objs.size()=1 2024-09-12T01:04:38.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.822+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.YC57pLNf-SY94KiJ-V6x1pg-t3vjpRa_0 2024-09-12T01:04:38.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.822+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8867176627233682166', time=2024-09-12T02:51:27.536913+0000, chain.objs.size()=1 2024-09-12T01:04:38.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.822+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.S-9OmdCO2XesShGfPpznFfjeeAaMi-N_0 2024-09-12T01:04:38.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.822+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11393378384930287936', time=2024-09-12T02:51:27.625694+0000, chain.objs.size()=1 2024-09-12T01:04:38.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.822+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.qH6t8O6nh65KHd_NTDB1UVSLnCZQvCX_0 2024-09-12T01:04:38.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.822+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1759015069929505102', time=2024-09-12T02:51:27.653945+0000, chain.objs.size()=1 2024-09-12T01:04:38.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.822+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.F0xVSo6CdtOel9utYBTRH8MgUQno1EO_0 2024-09-12T01:04:38.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.822+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16971496290541390731', time=2024-09-12T02:51:27.723261+0000, chain.objs.size()=1 2024-09-12T01:04:38.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.822+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.zRC5nrDT4gSnwEiz3ZXub5zK2pLMCfO_0 2024-09-12T01:04:38.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.826+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14115644799382342908', time=2024-09-12T02:51:27.730728+0000, chain.objs.size()=1 2024-09-12T01:04:38.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.826+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.cZUCu2g2PUJ8dH_o2Fut6GGlSQLvXjL_0 2024-09-12T01:04:38.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.826+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14777510117028676712', time=2024-09-12T02:51:27.869219+0000, chain.objs.size()=1 2024-09-12T01:04:38.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.826+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.S9omuvTllHQYCxSb7LN5jIQqBXbCG8V_0 2024-09-12T01:04:38.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.826+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9112951188535642101', time=2024-09-12T02:51:27.891320+0000, chain.objs.size()=1 2024-09-12T01:04:38.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.826+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.THPrD_fTo5YPSCwapCa1oCJIFY7c9ey_0 2024-09-12T01:04:38.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.826+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9140834869146721110', time=2024-09-12T02:51:27.926944+0000, chain.objs.size()=1 2024-09-12T01:04:38.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.826+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ytEru7LOXw8_L5_SzA38DKEn-KVhDXc_0 2024-09-12T01:04:38.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.826+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15300618118159151021', time=2024-09-12T02:51:27.935443+0000, chain.objs.size()=1 2024-09-12T01:04:38.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.826+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.0EBuL5plu2VPCeiWRfJrjIVWXwgbSwZ_0 2024-09-12T01:04:38.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.826+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17565187262815161682', time=2024-09-12T02:51:28.128108+0000, chain.objs.size()=1 2024-09-12T01:04:38.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.826+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.PWBwQJP7v67zhUvfYE3w7YU3bljE1jV_0 2024-09-12T01:04:38.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.826+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17460496755312521235', time=2024-09-12T02:51:28.380228+0000, chain.objs.size()=1 2024-09-12T01:04:38.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.826+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.CyGmfshG4spJdPjt3evEzzPWRPWx3R1_0 2024-09-12T01:04:38.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.826+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9579899778613758260', time=2024-09-12T02:51:28.390808+0000, chain.objs.size()=1 2024-09-12T01:04:38.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.826+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.MHde7UjI2L5t1aQNJy_PWN7lxDSKE2Z_0 2024-09-12T01:04:38.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.826+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1289181025227571488', time=2024-09-12T02:51:28.658667+0000, chain.objs.size()=1 2024-09-12T01:04:38.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.826+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.d9Dp1enClyIyKjsIruWWMYSryBRlH0R_0 2024-09-12T01:04:38.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.826+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2359539373612639032', time=2024-09-12T02:51:28.675281+0000, chain.objs.size()=1 2024-09-12T01:04:38.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.826+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.c0hBaOkjmeqysH-Zf1IqM-yyj5qPHtU_0 2024-09-12T01:04:38.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.826+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17064245364074330854', time=2024-09-12T02:51:29.366758+0000, chain.objs.size()=1 2024-09-12T01:04:38.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.826+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.263__shadow_.T80sGVR5kwIy2OqC9B87iBmVHO-5tJ6_0 2024-09-12T01:04:38.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.826+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.644930251480476459', time=2024-09-12T02:51:31.498558+0000, chain.objs.size()=1 2024-09-12T01:04:38.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.826+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.266__shadow_.CCMLVbVPKMI_expleeA717ZO3W1iHVW_0 2024-09-12T01:04:38.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.830+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4022835413390011040', time=2024-09-12T02:51:32.213178+0000, chain.objs.size()=1 2024-09-12T01:04:38.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.830+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.267__shadow_.UCBEvvRkmNLMCykXnTBc-11Qm3GZl_e_0 2024-09-12T01:04:38.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.830+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6126828699203867670', time=2024-09-12T02:51:32.898474+0000, chain.objs.size()=1 2024-09-12T01:04:38.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.830+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.268__shadow_.mtIKyznCzJ13FYzkwmB19o96jm1mcjz_0 2024-09-12T01:04:38.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.830+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8348201495020276159', time=2024-09-12T02:51:35.831737+0000, chain.objs.size()=1 2024-09-12T01:04:38.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.830+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.272__shadow_.AJdlZipIxKz1HYLv0qOLMAj7sEPOcm4_0 2024-09-12T01:04:38.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.830+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.867065280266882435', time=2024-09-12T02:51:40.221594+0000, chain.objs.size()=1 2024-09-12T01:04:38.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.830+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.278__shadow_.B-HHP3wQIv6siYG6-fpyP4AYjjzX-mv_0 2024-09-12T01:04:38.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.830+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12003833396433839312', time=2024-09-12T02:51:51.742701+0000, chain.objs.size()=1 2024-09-12T01:04:38.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.830+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.292__shadow_.F_Vn4HCgVOG70BX96IQO8rpOOFaxVUr_0 2024-09-12T01:04:38.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.830+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4926374865710613561', time=2024-09-12T02:51:53.161557+0000, chain.objs.size()=1 2024-09-12T01:04:38.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.830+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.293__shadow_.gIPSgoLhmWgUqM71i3qmO-YlP83R3Ei_0 2024-09-12T01:04:38.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.830+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2080122199061941139', time=2024-09-12T02:51:54.643782+0000, chain.objs.size()=1 2024-09-12T01:04:38.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.830+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.295__shadow_.ahEdycSpLRqhZlSaMchn2I6xS7SLvTU_0 2024-09-12T01:04:38.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.830+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3024273120499215714', time=2024-09-12T02:52:35.145817+0000, chain.objs.size()=1 2024-09-12T01:04:38.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.830+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.7bkhp4QI9UvQXY_xY2QEYH6TP-_p1Kh_0 2024-09-12T01:04:38.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.830+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14835533998711966176', time=2024-09-12T02:52:35.324125+0000, chain.objs.size()=1 2024-09-12T01:04:38.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.830+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.qW9lmO4sWW9h3hA8GzWxk2vJ0X7LdiU_0 2024-09-12T01:04:38.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.830+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5174868862671387234', time=2024-09-12T02:52:35.370007+0000, chain.objs.size()=1 2024-09-12T01:04:38.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.830+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.d_gHNX9d437EcUWDUjNeCKqfPJ-iXB-_0 2024-09-12T01:04:38.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.830+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10305594614420892321', time=2024-09-12T02:52:35.400556+0000, chain.objs.size()=1 2024-09-12T01:04:38.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.830+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.m5wTxPjZMMd36RfQZGBGNruFFgcBe9L_0 2024-09-12T01:04:38.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.830+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16727406917942510245', time=2024-09-12T02:52:35.412102+0000, chain.objs.size()=1 2024-09-12T01:04:38.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.830+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.BUnQpe2hApa2ZjK24txwJgRMJvmvGoP_0 2024-09-12T01:04:38.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.830+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13591018012916390760', time=2024-09-12T02:52:35.425589+0000, chain.objs.size()=1 2024-09-12T01:04:38.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.830+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.XSSVP1dm3Krajd1-LoCgPAuPsjG852d_0 2024-09-12T01:04:38.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.830+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1895347950776312628', time=2024-09-12T02:52:35.427172+0000, chain.objs.size()=1 2024-09-12T01:04:38.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.830+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.FPiDj2CP8ixoRSra1y1baTxbTzPzS1G_0 2024-09-12T01:04:38.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3844186841426920265', time=2024-09-12T02:52:35.590212+0000, chain.objs.size()=1 2024-09-12T01:04:38.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.TEqjr9GL2kO5BXai3o2-KdyV765NFk4_0 2024-09-12T01:04:38.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1619652611408444772', time=2024-09-12T02:52:35.656925+0000, chain.objs.size()=1 2024-09-12T01:04:38.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.UcKagLx9tHVE29l0zGviUbrsRW9z94r_0 2024-09-12T01:04:38.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15595352760601884532', time=2024-09-12T02:52:35.668873+0000, chain.objs.size()=1 2024-09-12T01:04:38.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.5YsAAbaRX1XxpS1odHj6n8mUQ-Uaju-_0 2024-09-12T01:04:38.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10812389031721623385', time=2024-09-12T02:52:35.823163+0000, chain.objs.size()=1 2024-09-12T01:04:38.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.OkZ9uOubVh6yVoyfPDIhE-8mWLpZjff_0 2024-09-12T01:04:38.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14413231423359366576', time=2024-09-12T02:52:35.823893+0000, chain.objs.size()=1 2024-09-12T01:04:38.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.3bcjMWPBrxhyGqitqTumhk0-wXaGSV7_0 2024-09-12T01:04:38.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11487700953520246525', time=2024-09-12T02:52:35.844565+0000, chain.objs.size()=1 2024-09-12T01:04:38.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.DYoyd10viqEtO4KounULvZW6-zEG4hC_0 2024-09-12T01:04:38.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1594778852399989064', time=2024-09-12T02:52:36.277653+0000, chain.objs.size()=1 2024-09-12T01:04:38.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.pdfZXDPFT9cIA8_AjxDeWliOetnqlo9_0 2024-09-12T01:04:38.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14832753516057775007', time=2024-09-12T02:52:36.321199+0000, chain.objs.size()=1 2024-09-12T01:04:38.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.qkzEhKpsAiAIFMz5_M_Med8Nqf9ywz3_0 2024-09-12T01:04:38.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6037502707033220777', time=2024-09-12T02:52:36.322375+0000, chain.objs.size()=1 2024-09-12T01:04:38.836 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.wNoCSXfAF4c4GnNU4PeJ2_O60nZNcyk_0 2024-09-12T01:04:38.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16450442259776821361', time=2024-09-12T02:52:36.372334+0000, chain.objs.size()=1 2024-09-12T01:04:38.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.BYHB_BxgeQKOQNYs35xXDpqWojmc2WQ_0 2024-09-12T01:04:38.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11489550026572896216', time=2024-09-12T02:52:36.521018+0000, chain.objs.size()=1 2024-09-12T01:04:38.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ecJO9037hOUXmsPr01LAnNLG1hy6LrA_0 2024-09-12T01:04:38.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5583041409032500260', time=2024-09-12T02:52:36.537193+0000, chain.objs.size()=1 2024-09-12T01:04:38.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.SNt0PoCxYVHYj3az-bejgF3_LdJPVSx_0 2024-09-12T01:04:38.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6148053676699937107', time=2024-09-12T02:52:36.587374+0000, chain.objs.size()=1 2024-09-12T01:04:38.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.iQK1FonRoB_bE889b_2-Nh9FXtFTR0r_0 2024-09-12T01:04:38.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12209020598606696217', time=2024-09-12T02:52:36.752630+0000, chain.objs.size()=1 2024-09-12T01:04:38.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.2VBE5Ix0HYuZZFIHtIoG5WyYI59M6db_0 2024-09-12T01:04:38.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16564550012036534248', time=2024-09-12T02:52:36.867899+0000, chain.objs.size()=1 2024-09-12T01:04:38.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.TErxtLFJLJ1t9Tom-V4CPmSNS3fLfLG_0 2024-09-12T01:04:38.837 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5572049054298051892', time=2024-09-12T02:52:36.989649+0000, chain.objs.size()=1 2024-09-12T01:04:38.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ZaHaUyfBrXvMpvBeBHcdBmNLMGewRyQ_0 2024-09-12T01:04:38.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9820750520811770945', time=2024-09-12T02:52:37.072572+0000, chain.objs.size()=1 2024-09-12T01:04:38.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.w8WV9A85LhFNQ567jqGSrydHkXiiXgA_0 2024-09-12T01:04:38.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8706637069739168840', time=2024-09-12T02:52:37.086880+0000, chain.objs.size()=1 2024-09-12T01:04:38.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.eyHVErx7lI3p3C7lNPIbqDq-8tSMpGs_0 2024-09-12T01:04:38.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4121031157962223935', time=2024-09-12T02:52:56.905283+0000, chain.objs.size()=1 2024-09-12T01:04:38.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.834+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.RMtMeJi1QQbi1L3IIeABNWBcIfo4QA1_0 2024-09-12T01:04:38.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.838+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14331922078297745140', time=2024-09-12T02:52:56.913000+0000, chain.objs.size()=1 2024-09-12T01:04:38.838 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.838+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.aElu9Y1n6kfIH7_M_eLITJ00SH5oaIK_0 2024-09-12T01:04:38.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9215954153674689805', time=2024-09-12T02:52:56.960000+0000, chain.objs.size()=1 2024-09-12T01:04:38.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.R7CN82XvDENZjw6INB4Od7daYeJa9pV_0 2024-09-12T01:04:38.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13097623139443021990', time=2024-09-12T02:52:56.972893+0000, chain.objs.size()=1 2024-09-12T01:04:38.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.wY28ma-jVoIszDz6JL5IOcpRHfHhE8n_0 2024-09-12T01:04:38.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2142362807407471296', time=2024-09-12T02:52:57.008979+0000, chain.objs.size()=1 2024-09-12T01:04:38.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.NhuILriY8pjCtcoHIx1x_AiBQ16yEDZ_0 2024-09-12T01:04:38.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8817633538374893632', time=2024-09-12T02:52:57.154709+0000, chain.objs.size()=1 2024-09-12T01:04:38.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.nUQEUcM9bDzxiXMtTBoYjt9ke_DOoMX_0 2024-09-12T01:04:38.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7996643305535039299', time=2024-09-12T02:52:57.192462+0000, chain.objs.size()=1 2024-09-12T01:04:38.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.YPmWoofyeUEHKl-qyK-k6w_ocJEk1Ql_0 2024-09-12T01:04:38.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5248343980049946492', time=2024-09-12T02:52:57.232537+0000, chain.objs.size()=1 2024-09-12T01:04:38.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.SsSiLrCtk8wepPVPDapfA6IhaUG_BIi_0 2024-09-12T01:04:38.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8916058275215427629', time=2024-09-12T02:52:57.236286+0000, chain.objs.size()=1 2024-09-12T01:04:38.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.gZhgqDF3RDaUhXIeaRlb3GJl17DvJSD_0 2024-09-12T01:04:38.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2788998650992831157', time=2024-09-12T02:52:57.268477+0000, chain.objs.size()=1 2024-09-12T01:04:38.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_._jJEBh7QXs606s9H_8ZpbfWjeiLTAPq_0 2024-09-12T01:04:38.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.284122741036089494', time=2024-09-12T02:52:57.272741+0000, chain.objs.size()=1 2024-09-12T01:04:38.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.hS1GxSOsSiEHASeW4_a4sp52CyYclzZ_0 2024-09-12T01:04:38.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3666822416752295289', time=2024-09-12T02:52:57.479970+0000, chain.objs.size()=1 2024-09-12T01:04:38.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.hHF8VRWWroUDzYejuywXOLgjiBJXkBC_0 2024-09-12T01:04:38.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3359882680971727573', time=2024-09-12T02:52:57.491081+0000, chain.objs.size()=1 2024-09-12T01:04:38.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.I1VkMd2v1sJbYBxmbkCPW2LcJuGT6RO_0 2024-09-12T01:04:38.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6442591200076072942', time=2024-09-12T02:52:57.625952+0000, chain.objs.size()=1 2024-09-12T01:04:38.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.yjZJUOM1VJRBO5QbihPDFq2C8fMPCT5_0 2024-09-12T01:04:38.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2161733265789725428', time=2024-09-12T02:52:57.649736+0000, chain.objs.size()=1 2024-09-12T01:04:38.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.5CJgvJR-msTAnAlXodwkTw69hTgD0dY_0 2024-09-12T01:04:38.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8119096532320675068', time=2024-09-12T02:52:57.673463+0000, chain.objs.size()=1 2024-09-12T01:04:38.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.mKVjvX2kGFNgogznRBe5TWwd6mi0d3I_0 2024-09-12T01:04:38.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9954735608133176813', time=2024-09-12T02:52:57.687467+0000, chain.objs.size()=1 2024-09-12T01:04:38.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.K1UQTJrHVjeysSEynw9qIFpVYYCrkjU_0 2024-09-12T01:04:38.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1005774851405187187', time=2024-09-12T02:52:57.698934+0000, chain.objs.size()=1 2024-09-12T01:04:38.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.8MxmR0xkjkaDMoekqkQydiyenP4oOjE_0 2024-09-12T01:04:38.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8578056794378205868', time=2024-09-12T02:52:57.721932+0000, chain.objs.size()=1 2024-09-12T01:04:38.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.LDn2psGcYBjaWd_hU23IbfAgKuhlGQe_0 2024-09-12T01:04:38.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14432916602228008764', time=2024-09-12T02:52:57.957726+0000, chain.objs.size()=1 2024-09-12T01:04:38.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.dfozCTViqF0VNo2HkpJJf40dQAa1Guw_0 2024-09-12T01:04:38.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.846+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1691685744510243637', time=2024-09-12T02:52:57.975308+0000, chain.objs.size()=1 2024-09-12T01:04:38.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.846+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.XPUYt3VprtNbe1OotosCo0sYgMwLnMF_0 2024-09-12T01:04:38.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.846+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3436333037820577376', time=2024-09-12T02:52:58.166789+0000, chain.objs.size()=1 2024-09-12T01:04:38.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.846+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.IkogIb2gKeuiERFOdTDas_mG7q-1M58_0 2024-09-12T01:04:38.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.846+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1103165828772589726', time=2024-09-12T02:52:58.476966+0000, chain.objs.size()=1 2024-09-12T01:04:38.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.846+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.vPctKrpOozsCof1QwtLAU9hqYx7B9tI_0 2024-09-12T01:04:38.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.846+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16454993206229596962', time=2024-09-12T02:52:58.614424+0000, chain.objs.size()=1 2024-09-12T01:04:38.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.846+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.CGsxs_L6muTHLHTh9tROET4vSpCXZnt_0 2024-09-12T01:04:38.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.846+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13944160291078397542', time=2024-09-12T02:52:58.643149+0000, chain.objs.size()=1 2024-09-12T01:04:38.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.846+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.KxBpft4ojiIxMYN1xUf7AI1rm1fHCeD_0 2024-09-12T01:04:38.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.846+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11808113744216166372', time=2024-09-12T02:53:08.469894+0000, chain.objs.size()=1 2024-09-12T01:04:38.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.846+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.339__shadow_.gBHXjRX6P7GessfCSMTUIk-lbidUCax_0 2024-09-12T01:04:38.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.846+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8878863786412228219', time=2024-09-12T02:53:17.598434+0000, chain.objs.size()=1 2024-09-12T01:04:38.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.846+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.353__shadow_.ns8ILj2V242Q81ahqRvoSMTDGKmMnDg_0 2024-09-12T01:04:38.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.846+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1816638341845755163', time=2024-09-12T02:53:28.970640+0000, chain.objs.size()=1 2024-09-12T01:04:38.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.846+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.372__shadow_.eMU9QQbAC5EsLpzF8lGGvOu7u4XWHJq_0 2024-09-12T01:04:38.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.846+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2175240541124812920', time=2024-09-12T02:54:13.666862+0000, chain.objs.size()=1 2024-09-12T01:04:38.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.846+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.430__shadow_.UPi2n9yZDIySg3fknGB1Ss6_rJ-04JT_0 2024-09-12T01:04:38.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.846+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14183139134441428793', time=2024-09-12T02:54:32.446200+0000, chain.objs.size()=1 2024-09-12T01:04:38.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.846+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.454__shadow_.LA_9WYkPLXJ5n7Zipo9wMchEp2rW535_0 2024-09-12T01:04:38.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.846+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3718303049239929367', time=2024-09-12T02:54:35.637692+0000, chain.objs.size()=1 2024-09-12T01:04:38.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.846+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.457__shadow_._QzJFePZLbUihDT4BwswP_Epd6z5HGX_0 2024-09-12T01:04:38.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.846+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7841168771741759332', time=2024-09-12T02:54:42.763617+0000, chain.objs.size()=1 2024-09-12T01:04:38.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.846+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.464__shadow_.Anh30s1w3861HjCQQMgfQzCeWn5zTbW_0 2024-09-12T01:04:38.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.846+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14924616200188670344', time=2024-09-12T02:54:56.571382+0000, chain.objs.size()=1 2024-09-12T01:04:38.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.846+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.487__shadow_.bHuG0nBY4FrDUPswqJnB29YL6BHA3Uc_0 2024-09-12T01:04:38.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.850+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46307 2024-09-12T01:04:38.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.850+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T01:04:38.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.850+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~G_RLNixbtc1458O4r8UcMnsIAPTMRrx', time=2024-09-12T02:55:56.298686+0000, chain.objs.size()=2 2024-09-12T01:04:38.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.850+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.529__multipart_mymultipart.2~G_RLNixbtc1458O4r8UcMnsIAPTMRrx.1 2024-09-12T01:04:38.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.850+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.529__multipart_mymultipart.2~G_RLNixbtc1458O4r8UcMnsIAPTMRrx.2 2024-09-12T01:04:38.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.850+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~DKoeq8XMIOZ8dvF2pvzhUmLOjzRD5PD', time=2024-09-12T02:56:00.098577+0000, chain.objs.size()=1 2024-09-12T01:04:38.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.850+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.533__multipart_mymultipart.2~DKoeq8XMIOZ8dvF2pvzhUmLOjzRD5PD.1 2024-09-12T01:04:38.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.850+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~pjicL7PMfJX7UAa9XjtHHIiIjxv8I-N', time=2024-09-12T02:56:51.089194+0000, chain.objs.size()=1 2024-09-12T01:04:38.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.850+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.561__multipart_mymultipart.2~pjicL7PMfJX7UAa9XjtHHIiIjxv8I-N.1 2024-09-12T01:04:38.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.850+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18038906142279308939', time=2024-09-12T02:56:57.665459+0000, chain.objs.size()=1 2024-09-12T01:04:38.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.850+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.564__shadow_.oKHqUxLZbgf2tK1CQrBaGlvky-e46vK_0 2024-09-12T01:04:38.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.850+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1439385818396400900', time=2024-09-12T02:57:27.608040+0000, chain.objs.size()=1 2024-09-12T01:04:38.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.850+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:w1TSNOmsFTQyd39leBUNXGqwgoVLVV4_.OVypc8DFMh1d0YQ_xd6jalJom8v31M4_0 2024-09-12T01:04:38.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.850+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7911086932579785340', time=2024-09-12T02:57:33.744891+0000, chain.objs.size()=1 2024-09-12T01:04:38.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.850+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:MukpmVxufXA-mLfGktDQItN34vQA.J1_.hkwFvgSlHFRbTYxojM7PDG-sxWvnNX6_0 2024-09-12T01:04:38.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.850+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16012742114765272437', time=2024-09-12T02:57:52.097004+0000, chain.objs.size()=1 2024-09-12T01:04:38.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.850+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.587__shadow:EvBqIFev1SHxm3EyrcfNT1TQf3kiSLL_._5VtDzwNZEkQSaFcSObAwub71yA2Ywo_0 2024-09-12T01:04:38.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.850+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17554422334821204179', time=2024-09-12T02:59:23.325716+0000, chain.objs.size()=1 2024-09-12T01:04:38.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.850+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.617__shadow_.cYTxKQy3ZkkP9Ny_zM4ii9eKQosjOom_0 2024-09-12T01:04:38.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.850+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18184731591461594686', time=2024-09-12T03:00:35.077882+0000, chain.objs.size()=1 2024-09-12T01:04:38.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.850+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.626__shadow_.VFXBTWjSPRH80PbwPSQZpd4IItDhqqs_0 2024-09-12T01:04:38.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.850+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17442240413722866174', time=2024-09-12T03:00:37.954773+0000, chain.objs.size()=1 2024-09-12T01:04:38.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.854+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.630__shadow_.188ytU_o0ZxM1_JRe4lAL62Lx4FEsus_0 2024-09-12T01:04:38.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.854+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18400644409485082864', time=2024-09-12T03:00:45.244882+0000, chain.objs.size()=1 2024-09-12T01:04:38.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.854+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.640__shadow_.KJ_JN6Mfq3Bv3a0VacL5h67bL1saH1C_0 2024-09-12T01:04:38.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.854+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8748915883977673173', time=2024-09-12T03:01:26.806295+0000, chain.objs.size()=1 2024-09-12T01:04:38.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.854+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.696__shadow:u2AWBk1TO4vuwUyv.91GAExsnYg9qpn_.aZ2pKAXrROHi6TKEJIMyPWIuSVsQAme_0 2024-09-12T01:04:38.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.854+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.601624433805265806', time=2024-09-12T03:01:39.475906+0000, chain.objs.size()=1 2024-09-12T01:04:38.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.854+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.714__shadow:imD0BrPdj6MhWCwErKeYhJAsJDN5Tmc_.j4bATSGet-qWYe8JYUeqopMygfWCqPr_0 2024-09-12T01:04:38.856 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.854+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:38.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.858+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:04:38.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:38.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:38.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53187' 2024-09-12T01:04:38.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8527129340827294578', time=2024-09-12T02:48:30.977311+0000, chain.objs.size()=3 2024-09-12T01:04:38.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.159__multipart_mymultipart-STANDARD.2~E0Qi_2faAM5cVe9sr5wJyzOdYELjBfL.1 2024-09-12T01:04:38.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.159__multipart_mymultipart-STANDARD.2~E0Qi_2faAM5cVe9sr5wJyzOdYELjBfL.2 2024-09-12T01:04:38.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.159__multipart_mymultipart-STANDARD.2~E0Qi_2faAM5cVe9sr5wJyzOdYELjBfL.3 2024-09-12T01:04:38.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8466351098685341043', time=2024-09-12T02:48:50.395258+0000, chain.objs.size()=1 2024-09-12T01:04:38.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.179__shadow_.KI-FDdq5yNa_wsPhuu79FkTjFJhOkKi_0 2024-09-12T01:04:38.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8308230973183824196', time=2024-09-12T02:50:54.943906+0000, chain.objs.size()=1 2024-09-12T01:04:38.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.245__shadow_.RsL6eTBB715Pfh5GttqxtNlPXVXY61Z_0 2024-09-12T01:04:38.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10973770198938718735', time=2024-09-12T02:50:59.604441+0000, chain.objs.size()=1 2024-09-12T01:04:38.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.251__shadow_.0Ra3D4Rv3z275hykcnkCuZuTct-v2mE_0 2024-09-12T01:04:38.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14334601027130518469', time=2024-09-12T02:51:01.857701+0000, chain.objs.size()=1 2024-09-12T01:04:38.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.254__shadow_.y-sqgkR2xig2k9lF8lE11AFv0Si_9Q7_0 2024-09-12T01:04:38.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.296266390090945657', time=2024-09-12T02:51:06.288672+0000, chain.objs.size()=1 2024-09-12T01:04:38.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.260__shadow_.O-cWrJoKN54m4JwAQ5e6DRC_t8zNHCV_0 2024-09-12T01:04:38.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11810929944097908643', time=2024-09-12T02:51:26.788473+0000, chain.objs.size()=1 2024-09-12T01:04:38.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.HhdByG9vj8yb8ElR9eXSI0rlvYx9EdZ_0 2024-09-12T01:04:38.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7948785706029376828', time=2024-09-12T02:51:26.811297+0000, chain.objs.size()=1 2024-09-12T01:04:38.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.G7NGbB6Zsk_8uaXMwPRP8XzhdyCQyp0_0 2024-09-12T01:04:38.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3020566019317010516', time=2024-09-12T02:51:26.842681+0000, chain.objs.size()=1 2024-09-12T01:04:38.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.zqHQjYlOwn-bENX42AgPsn-q0o7Dpkc_0 2024-09-12T01:04:38.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5893676851357869556', time=2024-09-12T02:51:26.879035+0000, chain.objs.size()=1 2024-09-12T01:04:38.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.8i2iil_1FDcih2c_uIwMl4ebZjKLEdp_0 2024-09-12T01:04:38.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16108204778460793232', time=2024-09-12T02:51:26.985272+0000, chain.objs.size()=1 2024-09-12T01:04:38.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.TG1uzrk3c_MymffhNwUnOiSfnDcoPHd_0 2024-09-12T01:04:38.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2399630748184584023', time=2024-09-12T02:51:27.004999+0000, chain.objs.size()=1 2024-09-12T01:04:38.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.37z3BDR_wW5lT0-oWjmgrlDOhMfI96k_0 2024-09-12T01:04:38.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17352324827450298166', time=2024-09-12T02:51:27.014622+0000, chain.objs.size()=1 2024-09-12T01:04:38.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.JUhYLT3eVUDc9KhlxS8Di52Q7WdMa0w_0 2024-09-12T01:04:38.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11354921513755730688', time=2024-09-12T02:51:27.039074+0000, chain.objs.size()=1 2024-09-12T01:04:38.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.zojybkA4j51ej08rA4qfdgnJx-aRRNv_0 2024-09-12T01:04:38.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2000673929433034823', time=2024-09-12T02:51:27.074628+0000, chain.objs.size()=1 2024-09-12T01:04:38.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.SEgQk0XY8ozd3tYSxMVhnir-Ems9py4_0 2024-09-12T01:04:38.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7849705090337956224', time=2024-09-12T02:51:27.208210+0000, chain.objs.size()=1 2024-09-12T01:04:38.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.sz9UKZBA4kJIKyh4w-kcnSyCJOr5mdS_0 2024-09-12T01:04:38.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5375319542139822543', time=2024-09-12T02:51:27.230573+0000, chain.objs.size()=1 2024-09-12T01:04:38.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.qeAbH0rjV87hI7wji-HHRWsFt-r_DgM_0 2024-09-12T01:04:38.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16826192793491757505', time=2024-09-12T02:51:27.270021+0000, chain.objs.size()=1 2024-09-12T01:04:38.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.QLwKCewWIdlNxdTbvXoIBW9v_TeAH1p_0 2024-09-12T01:04:38.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11345478316455666937', time=2024-09-12T02:51:27.293989+0000, chain.objs.size()=1 2024-09-12T01:04:38.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.XnkjF7MgAM7JhleyFEJ69EothfRq0Ip_0 2024-09-12T01:04:38.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.749052410103177320', time=2024-09-12T02:51:27.443665+0000, chain.objs.size()=1 2024-09-12T01:04:38.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Dq9bCKnEmxjV8Q_7X1lRspm6BvMG3aH_0 2024-09-12T01:04:38.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10918058253965767188', time=2024-09-12T02:51:27.449187+0000, chain.objs.size()=1 2024-09-12T01:04:38.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.-bLJ0OyaM7P0I3ID4u0Q_H9tgG_Xj0I_0 2024-09-12T01:04:38.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17122361841682152772', time=2024-09-12T02:51:27.661295+0000, chain.objs.size()=1 2024-09-12T01:04:38.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.PmbFVPnAIuo4d4_wfxzkTCHVEZHNB34_0 2024-09-12T01:04:38.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3167665275573064061', time=2024-09-12T02:51:27.663402+0000, chain.objs.size()=1 2024-09-12T01:04:38.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.laYyvaLH7lOHPwwkhHEB5vn1AZjdMj7_0 2024-09-12T01:04:38.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14192852781506042005', time=2024-09-12T02:51:27.706363+0000, chain.objs.size()=1 2024-09-12T01:04:38.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.yTsJb3PNfq78nmNkV5SF_B8kwjqP0oa_0 2024-09-12T01:04:38.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1152051387352643296', time=2024-09-12T02:51:27.714639+0000, chain.objs.size()=1 2024-09-12T01:04:38.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ofvGvYll2TkuA3X4gIFU7eO_uQgRLhw_0 2024-09-12T01:04:38.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14300846026593073209', time=2024-09-12T02:51:27.910508+0000, chain.objs.size()=1 2024-09-12T01:04:38.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.JJZXGWB44CUMON17UYA58MTMrgdeQrZ_0 2024-09-12T01:04:38.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13599279788612157967', time=2024-09-12T02:51:27.917711+0000, chain.objs.size()=1 2024-09-12T01:04:38.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.JpJ0ab9589u1kuTf1aRZ5EnB0h009Pq_0 2024-09-12T01:04:38.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14112696319915197196', time=2024-09-12T02:51:27.953244+0000, chain.objs.size()=1 2024-09-12T01:04:38.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.-hBW9lS-2PS7f64Ru8ugeaszaGwsu4c_0 2024-09-12T01:04:38.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4579718056097073747', time=2024-09-12T02:51:27.963122+0000, chain.objs.size()=1 2024-09-12T01:04:38.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.x5R46bsij3yalnU_T22Wz_5iE46rWg5_0 2024-09-12T01:04:38.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1350639312043026045', time=2024-09-12T02:51:27.965411+0000, chain.objs.size()=1 2024-09-12T01:04:38.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.aP4t98i58xDWeFTBShqlNnqXArGhA7B_0 2024-09-12T01:04:38.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12443878693545215898', time=2024-09-12T02:51:27.968993+0000, chain.objs.size()=1 2024-09-12T01:04:38.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.bMMyW6MkOZUlcw-TsvpceJtBcUWUTGU_0 2024-09-12T01:04:38.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17447655557307971647', time=2024-09-12T02:51:28.229249+0000, chain.objs.size()=1 2024-09-12T01:04:38.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.nB2OgQ_tMW3T-gUV6Q_mPyxQlFsNmJo_0 2024-09-12T01:04:38.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.870+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11924291517260169920', time=2024-09-12T02:51:28.237097+0000, chain.objs.size()=1 2024-09-12T01:04:38.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.870+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.DBfNptamB9NFjCT8ulaIors2J-Npq8d_0 2024-09-12T01:04:38.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.870+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12064277895530375311', time=2024-09-12T02:51:28.240121+0000, chain.objs.size()=1 2024-09-12T01:04:38.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.870+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.IaDaVWrdsd2XXLV-L2w1iZzTnkAOIIZ_0 2024-09-12T01:04:38.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.870+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9409956681710046734', time=2024-09-12T02:51:28.349586+0000, chain.objs.size()=1 2024-09-12T01:04:38.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.870+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.OidbEfdY5sA20x0YWWER9JzpR_acXJ2_0 2024-09-12T01:04:38.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.870+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3891854808052564218', time=2024-09-12T02:51:28.356144+0000, chain.objs.size()=1 2024-09-12T01:04:38.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.870+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.YwxE0Mb3UVxSKv8vAaBapkPEryIOXc0_0 2024-09-12T01:04:38.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.870+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3568832574523532840', time=2024-09-12T02:51:28.358698+0000, chain.objs.size()=1 2024-09-12T01:04:38.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.870+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.RtxtTlpsTgR42LvAQP9Kw0HZucruhch_0 2024-09-12T01:04:38.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.870+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16481135135123148149', time=2024-09-12T02:51:28.368205+0000, chain.objs.size()=1 2024-09-12T01:04:38.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.870+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.pvLx5OPtW6MOvrzkmTpnKbVlJvfJnAi_0 2024-09-12T01:04:38.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.870+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15073622737497168951', time=2024-09-12T02:51:28.586097+0000, chain.objs.size()=1 2024-09-12T01:04:38.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.870+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.4rXmfNyBlRU92TnFr_0Ikeqk_AnuvVR_0 2024-09-12T01:04:38.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.870+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1973186862090652184', time=2024-09-12T02:51:28.639801+0000, chain.objs.size()=1 2024-09-12T01:04:38.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.870+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.3N-LvfkXTgXOJk-cIBWsPDobs5Kmw1r_0 2024-09-12T01:04:38.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.870+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507061622192112848', time=2024-09-12T02:51:37.990290+0000, chain.objs.size()=1 2024-09-12T01:04:38.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.870+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.275__shadow_.en8fg5Gm1t6ncAu0SMor-yGskEzeKVa_0 2024-09-12T01:04:38.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.870+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17773455552608137049', time=2024-09-12T02:51:51.714069+0000, chain.objs.size()=1 2024-09-12T01:04:38.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.870+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.292__shadow_.zBaSXw5iQ2VqfBkw8CUvh-HdINXEq7O_0 2024-09-12T01:04:38.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.870+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5792057550825763318', time=2024-09-12T02:51:56.912269+0000, chain.objs.size()=1 2024-09-12T01:04:38.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.870+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.298__shadow_.OlnUphLDRFG6H0hRckFW6z_dbwKWk2D_0 2024-09-12T01:04:38.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.874+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15061798999437312551', time=2024-09-12T02:51:59.187378+0000, chain.objs.size()=1 2024-09-12T01:04:38.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.874+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.301__shadow_.CzsV4REU-U5GGhtID-hSJqLtS5QRkek_0 2024-09-12T01:04:38.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.874+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13003003326725345053', time=2024-09-12T02:52:02.126708+0000, chain.objs.size()=1 2024-09-12T01:04:38.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.874+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.305__shadow_.94drRcyrXnDX6wuNVZ990Rta-0jk44r_0 2024-09-12T01:04:38.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.874+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17115144187149202748', time=2024-09-12T02:52:34.854005+0000, chain.objs.size()=1 2024-09-12T01:04:38.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.874+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.1Xs5UMHPlLFt8WFJQJOG358nfMso3kx_0 2024-09-12T01:04:38.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.874+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3484423913857947878', time=2024-09-12T02:52:35.067547+0000, chain.objs.size()=1 2024-09-12T01:04:38.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.874+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.jvN3nk3Gp9WhR36xQWyfNMh3TKoQyF7_0 2024-09-12T01:04:38.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.874+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3267601584295037463', time=2024-09-12T02:52:35.137202+0000, chain.objs.size()=1 2024-09-12T01:04:38.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.874+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.zebXYuOCGAIRoopM9Ijd_tbZr_34ci1_0 2024-09-12T01:04:38.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.874+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7758870889271562518', time=2024-09-12T02:52:35.144141+0000, chain.objs.size()=1 2024-09-12T01:04:38.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.874+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.2JLZiweYNMaAixEOCIokfU0mfgwTgHV_0 2024-09-12T01:04:38.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.874+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2931859540224562322', time=2024-09-12T02:52:35.165543+0000, chain.objs.size()=1 2024-09-12T01:04:38.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.874+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.9vfnEXRy6gaWmE4_e1pgugAdwRboM9Y_0 2024-09-12T01:04:38.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.874+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15001821805029384776', time=2024-09-12T02:52:35.293542+0000, chain.objs.size()=1 2024-09-12T01:04:38.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.874+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.SznpNLYIabAxz87Yw1BZRarnzZL5f14_0 2024-09-12T01:04:38.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.874+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11120005809970042023', time=2024-09-12T02:52:35.297199+0000, chain.objs.size()=1 2024-09-12T01:04:38.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.874+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.T4Ry9EBQupvZ9b3BTk232-EuBcG0ZAv_0 2024-09-12T01:04:38.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.874+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11729896486272000470', time=2024-09-12T02:52:35.300412+0000, chain.objs.size()=1 2024-09-12T01:04:38.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.874+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.aXrPrOPMUj5RW-WN5xSFbSDRvcRfuzg_0 2024-09-12T01:04:38.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.874+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16010642327477202743', time=2024-09-12T02:52:35.321045+0000, chain.objs.size()=1 2024-09-12T01:04:38.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.874+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.0ecGgmpI6k3YOxgxvks97ZjmME273J-_0 2024-09-12T01:04:38.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.878+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.968906129830739677', time=2024-09-12T02:52:35.346730+0000, chain.objs.size()=1 2024-09-12T01:04:38.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.878+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.yvMHK3Y_0JisMIt6FERSkpxxiytuxA4_0 2024-09-12T01:04:38.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.878+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12435836265693235370', time=2024-09-12T02:52:35.383797+0000, chain.objs.size()=1 2024-09-12T01:04:38.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.878+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.eKmlww3TRxBtCUF7FhJXhQ2rXHl00t9_0 2024-09-12T01:04:38.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.878+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1576150432734313158', time=2024-09-12T02:52:35.390562+0000, chain.objs.size()=1 2024-09-12T01:04:38.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.878+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.EFlpL-Q80uNp38xKhExS2ngR0-Gz2U__0 2024-09-12T01:04:38.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.878+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11482426612949825644', time=2024-09-12T02:52:35.428343+0000, chain.objs.size()=1 2024-09-12T01:04:38.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.878+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.FNZAujRI1ML_mcAouGrTkHtsJRUtky4_0 2024-09-12T01:04:38.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.878+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5839578566142892128', time=2024-09-12T02:52:35.586228+0000, chain.objs.size()=1 2024-09-12T01:04:38.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.878+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.pBkDGGAEQH9Om1w04uWBAcCL0B7J18t_0 2024-09-12T01:04:38.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.878+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2582110102323486431', time=2024-09-12T02:52:35.633229+0000, chain.objs.size()=1 2024-09-12T01:04:38.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.878+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.jq2-buwsJt5KU5P-hnfxbISmJPgOkfC_0 2024-09-12T01:04:38.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.878+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11931088218754306078', time=2024-09-12T02:52:35.838935+0000, chain.objs.size()=1 2024-09-12T01:04:38.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.878+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.d0kmAgpYUr4-iW-vHHb3AKYCSM-_DQY_0 2024-09-12T01:04:38.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.878+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10520792383513512383', time=2024-09-12T02:52:35.876637+0000, chain.objs.size()=1 2024-09-12T01:04:38.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.878+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.2pEc7CgrELpIx8YB7Mzk_erQMv0Wm4w_0 2024-09-12T01:04:38.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.878+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13816053707072356403', time=2024-09-12T02:52:36.291809+0000, chain.objs.size()=1 2024-09-12T01:04:38.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.878+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.AXWd4wDyIMZmWQi9neQV5dJcjLPwUlU_0 2024-09-12T01:04:38.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.878+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3690705817271791475', time=2024-09-12T02:52:36.372460+0000, chain.objs.size()=1 2024-09-12T01:04:38.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.878+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.iem6J8BMp0GBSSZs_n4oCzkhimYhtoG_0 2024-09-12T01:04:38.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.878+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3971604984032689151', time=2024-09-12T02:52:36.375683+0000, chain.objs.size()=1 2024-09-12T01:04:38.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.878+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ApZKbtinMt6Q5OyQbd1DsVC-o5jh3rk_0 2024-09-12T01:04:38.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.878+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17161114118724040600', time=2024-09-12T02:52:36.389595+0000, chain.objs.size()=1 2024-09-12T01:04:38.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.878+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.SxdtCAT_lXT7SlB_OuLY3Zss9cGXkTT_0 2024-09-12T01:04:38.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6890188210448400485', time=2024-09-12T02:52:36.540700+0000, chain.objs.size()=1 2024-09-12T01:04:38.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.PtaGiAfwqx0iumvel7MYbVtrAddmEO4_0 2024-09-12T01:04:38.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9208645874622623181', time=2024-09-12T02:52:36.548601+0000, chain.objs.size()=1 2024-09-12T01:04:38.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.PAC_vn-I255otTr_if6q1GvRyTtDIpS_0 2024-09-12T01:04:38.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7881579127441007937', time=2024-09-12T02:52:36.624190+0000, chain.objs.size()=1 2024-09-12T01:04:38.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.m7OnZPotquCeOMrurxAMZNU0s-VRHR2_0 2024-09-12T01:04:38.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4821864645166020176', time=2024-09-12T02:52:36.638682+0000, chain.objs.size()=1 2024-09-12T01:04:38.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Q9IR8sqXe0htvIQSLrGmygfbo2BIBBq_0 2024-09-12T01:04:38.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.464491254702090617', time=2024-09-12T02:52:36.639474+0000, chain.objs.size()=1 2024-09-12T01:04:38.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.iFN3u6mAipzAfPkTHYJOvKOiCRTdhMp_0 2024-09-12T01:04:38.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16257713341245224167', time=2024-09-12T02:52:36.754484+0000, chain.objs.size()=1 2024-09-12T01:04:38.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.GXEcx4CRrQRW1CRYvNhSLWZOfQZoEvV_0 2024-09-12T01:04:38.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4442735412480669758', time=2024-09-12T02:52:36.756411+0000, chain.objs.size()=1 2024-09-12T01:04:38.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.MRtJRzKuTimLidBiAZdrYMHky_gqdDc_0 2024-09-12T01:04:38.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5222612494327992189', time=2024-09-12T02:52:36.761566+0000, chain.objs.size()=1 2024-09-12T01:04:38.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.-136FNiqQEpM720zqU299ym09970rAF_0 2024-09-12T01:04:38.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15043602420637764027', time=2024-09-12T02:52:36.859841+0000, chain.objs.size()=1 2024-09-12T01:04:38.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.bQZgPKs13PaeNucwpKbAhjpfhLlTBn-_0 2024-09-12T01:04:38.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11682641254200953558', time=2024-09-12T02:52:36.883103+0000, chain.objs.size()=1 2024-09-12T01:04:38.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.0H_n-IEg2yiOzv8TgBmSFFJ3eOD8O0Z_0 2024-09-12T01:04:38.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11669198940754569316', time=2024-09-12T02:52:37.008632+0000, chain.objs.size()=1 2024-09-12T01:04:38.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.vLfRF1Op-LZrvIcbFjKtfEUnYPr6TIf_0 2024-09-12T01:04:38.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15204048428717543767', time=2024-09-12T02:52:37.023816+0000, chain.objs.size()=1 2024-09-12T01:04:38.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.UvDQpOesy9fvZ6IgpiNHdLg4juaZu8z_0 2024-09-12T01:04:38.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8447521340114677316', time=2024-09-12T02:52:37.070513+0000, chain.objs.size()=1 2024-09-12T01:04:38.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.QqRB-WmiFzwkDEmBqxRnrJKfFCDtWT6_0 2024-09-12T01:04:38.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9193794427213908087', time=2024-09-12T02:52:37.071435+0000, chain.objs.size()=1 2024-09-12T01:04:38.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.UQzgU5bd1_EbYtEs18Nfd3oRO1l69lS_0 2024-09-12T01:04:38.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1983773579759483870', time=2024-09-12T02:52:56.936756+0000, chain.objs.size()=1 2024-09-12T01:04:38.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.BprbQFecPYS7P8DFTaz_QUYkJe_IeNn_0 2024-09-12T01:04:38.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14709434936784532040', time=2024-09-12T02:52:56.978468+0000, chain.objs.size()=1 2024-09-12T01:04:38.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.YCRmJjvr2zNWZFciLSwpHfGtvlj-0w5_0 2024-09-12T01:04:38.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5529136858423406580', time=2024-09-12T02:52:57.153533+0000, chain.objs.size()=1 2024-09-12T01:04:38.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.aQbRu7nCT02xysNaS-yjexTcccZbVT0_0 2024-09-12T01:04:38.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18161240206412308191', time=2024-09-12T02:52:57.181244+0000, chain.objs.size()=1 2024-09-12T01:04:38.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.McAcrbEr3lz3FuVAzsASqYe3CGeIb_T_0 2024-09-12T01:04:38.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17341866785861109787', time=2024-09-12T02:52:57.269929+0000, chain.objs.size()=1 2024-09-12T01:04:38.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.kcrY2pGuIILTnuyhqhRLZPstq_Zn0Ko_0 2024-09-12T01:04:38.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2503650612770706682', time=2024-09-12T02:52:57.278076+0000, chain.objs.size()=1 2024-09-12T01:04:38.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.z0wgP3-glyEK5YY-OH7zns8wDVOE6RK_0 2024-09-12T01:04:38.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.886+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14410187388712064176', time=2024-09-12T02:52:57.407913+0000, chain.objs.size()=1 2024-09-12T01:04:38.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.886+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.vQy0fdmanFeJltco0sLFcrv4f25pob8_0 2024-09-12T01:04:38.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.886+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3869115404646953339', time=2024-09-12T02:52:57.414953+0000, chain.objs.size()=1 2024-09-12T01:04:38.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.886+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.OVD2Cws1sXX9LfjqUlN2lbfQX_7tnrL_0 2024-09-12T01:04:38.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.886+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11629994507492268726', time=2024-09-12T02:52:57.504910+0000, chain.objs.size()=1 2024-09-12T01:04:38.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.886+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.92kW2l49PwOKINQ0ip0cn_6-xNAZLTs_0 2024-09-12T01:04:38.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.886+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6281356099397306099', time=2024-09-12T02:52:57.627488+0000, chain.objs.size()=1 2024-09-12T01:04:38.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.886+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.w09KW46kPHR73fdCUgNCFBjSrnWBsgB_0 2024-09-12T01:04:38.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.886+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4298940581744363028', time=2024-09-12T02:52:57.684133+0000, chain.objs.size()=1 2024-09-12T01:04:38.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.886+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.XdVLm0npb3NWBCukb3jvSqRXrCDvW0k_0 2024-09-12T01:04:38.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.886+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3232660895069912354', time=2024-09-12T02:52:57.707504+0000, chain.objs.size()=1 2024-09-12T01:04:38.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.886+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Z03xZbQ3MMnwfPcptjdlmD4a20EuUie_0 2024-09-12T01:04:38.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.886+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8236993761732486586', time=2024-09-12T02:52:57.708795+0000, chain.objs.size()=1 2024-09-12T01:04:38.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.886+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.n3tRHNM9B_OraDjIABBYysoLTkITnDV_0 2024-09-12T01:04:38.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.886+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10368697882288444808', time=2024-09-12T02:52:57.751610+0000, chain.objs.size()=1 2024-09-12T01:04:38.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.886+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.2EMkdqUFlGx5sXksjd83PdyxEYxcke4_0 2024-09-12T01:04:38.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.886+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13457768807427747561', time=2024-09-12T02:52:57.911157+0000, chain.objs.size()=1 2024-09-12T01:04:38.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.886+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.26AlZ_Yn5Hc67HRlGOwk8geWpTaXucd_0 2024-09-12T01:04:38.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.886+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11511802656050808779', time=2024-09-12T02:52:57.939262+0000, chain.objs.size()=1 2024-09-12T01:04:38.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.886+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.gsfZFR5kx-vDEuisWnN3ncJFRrQ1Y-t_0 2024-09-12T01:04:38.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.886+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11434733902823979031', time=2024-09-12T02:52:57.953015+0000, chain.objs.size()=1 2024-09-12T01:04:38.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.886+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.rEs48eOpwXEQvO_rbf56BtxolPljmjZ_0 2024-09-12T01:04:38.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.886+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17093890622127102975', time=2024-09-12T02:52:57.977334+0000, chain.objs.size()=1 2024-09-12T01:04:38.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.886+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.xTurvRmGCGuOx5ajpSODZNlmtRJNHCv_0 2024-09-12T01:04:38.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.886+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6948486104599507743', time=2024-09-12T02:52:58.151252+0000, chain.objs.size()=1 2024-09-12T01:04:38.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.886+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.WWZZkXCkIXq1_n_3omAm0OrKg-Jh7xy_0 2024-09-12T01:04:38.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.886+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.137204446053225253', time=2024-09-12T02:52:58.153167+0000, chain.objs.size()=1 2024-09-12T01:04:38.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.886+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.JIojSTKir9pmjOwihJxG0J-eUR3NKre_0 2024-09-12T01:04:38.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.890+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/53187 2024-09-12T01:04:38.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-12T01:04:38.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10011623829299322710', time=2024-09-12T02:52:58.367090+0000, chain.objs.size()=1 2024-09-12T01:04:38.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.s6aQn0zST5zYovK_LnH_m8soJGtwNWk_0 2024-09-12T01:04:38.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14174689514733520417', time=2024-09-12T02:52:58.376827+0000, chain.objs.size()=1 2024-09-12T01:04:38.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.FwokP6nZUNTM02I0t049AmOSeFFn4Q0_0 2024-09-12T01:04:38.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9397454528929549945', time=2024-09-12T02:52:58.420695+0000, chain.objs.size()=1 2024-09-12T01:04:38.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.g041aFYIqkXLggPipBMI_BL_d_sHQol_0 2024-09-12T01:04:38.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15542133286259853253', time=2024-09-12T02:52:58.449927+0000, chain.objs.size()=1 2024-09-12T01:04:38.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.xifa-VKdwMYowVwVD2mOolx7IoVeoKO_0 2024-09-12T01:04:38.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12130541038514665924', time=2024-09-12T02:52:58.615238+0000, chain.objs.size()=1 2024-09-12T01:04:38.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.MqmrLC2NTYVSsWiPc9S_BHyWj46_Si5_0 2024-09-12T01:04:38.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.570338502586304473', time=2024-09-12T02:52:58.668040+0000, chain.objs.size()=1 2024-09-12T01:04:38.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.TaHTGkld3IAiR439QS4TUl5D34iKtRv_0 2024-09-12T01:04:38.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14958709790680072367', time=2024-09-12T02:52:58.678713+0000, chain.objs.size()=1 2024-09-12T01:04:38.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.WGngfQLfaYrVbAOmvkD4lu6uOr2860c_0 2024-09-12T01:04:38.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13278536735969038091', time=2024-09-12T02:53:29.675944+0000, chain.objs.size()=1 2024-09-12T01:04:38.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.373__shadow_.viGspAL1Zqp4NWCkPUsHTBM2UlNMN_k_0 2024-09-12T01:04:38.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3372689381529000169', time=2024-09-12T02:53:33.274670+0000, chain.objs.size()=1 2024-09-12T01:04:38.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.377__shadow_.E0XtW_Og_YHKBiSrL92Ah19qn9k5DYR_0 2024-09-12T01:04:38.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6042361003750846544', time=2024-09-12T02:53:36.449537+0000, chain.objs.size()=1 2024-09-12T01:04:38.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.381__shadow_.Y2V_xZ6hFXaBCh_C3SEzdGmBbnaOU17_0 2024-09-12T01:04:38.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14822612355340447208', time=2024-09-12T02:54:14.434066+0000, chain.objs.size()=1 2024-09-12T01:04:38.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.431__shadow_.qee24vBdou89lpjr1w89WBgbQm_Y7Qs_0 2024-09-12T01:04:38.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10391754958993583424', time=2024-09-12T02:54:42.464800+0000, chain.objs.size()=1 2024-09-12T01:04:38.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.464__shadow_.Nw7HjAha60CYgBphJbePEUL5daPiT7h_0 2024-09-12T01:04:38.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14019540992984043992', time=2024-09-12T02:54:55.814781+0000, chain.objs.size()=1 2024-09-12T01:04:38.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.486__shadow_.BpLimXrGdl_372JiTfIzJLU6RgCwSaB_0 2024-09-12T01:04:38.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13780712938512803782', time=2024-09-12T02:55:03.624307+0000, chain.objs.size()=1 2024-09-12T01:04:38.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.498__shadow_.PgVKL2ga2r4viBuVmBZjAfCPnEgCWAN_0 2024-09-12T01:04:38.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.898+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13817155857992414552', time=2024-09-12T02:55:04.482469+0000, chain.objs.size()=1 2024-09-12T01:04:38.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.898+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.499__shadow_.l8FvQYeTsEAceJ0bdsvy0VpBZzQBI4G_0 2024-09-12T01:04:38.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.898+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12279749339933242046', time=2024-09-12T02:55:04.483801+0000, chain.objs.size()=1 2024-09-12T01:04:38.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.898+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.499__shadow_.l8FvQYeTsEAceJ0bdsvy0VpBZzQBI4G_0 2024-09-12T01:04:38.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.898+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17133729285297534', time=2024-09-12T02:55:11.220186+0000, chain.objs.size()=6 2024-09-12T01:04:38.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.898+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.1 2024-09-12T01:04:38.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.898+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.2 2024-09-12T01:04:38.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.898+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.3 2024-09-12T01:04:38.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.898+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.4 2024-09-12T01:04:38.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.898+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.5 2024-09-12T01:04:38.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.898+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.6 2024-09-12T01:04:38.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.898+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12169059439872219334', time=2024-09-12T02:55:19.466187+0000, chain.objs.size()=1 2024-09-12T01:04:38.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.898+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.517__shadow_.LcIygNbydC10LaveJ9-iJiTAy2GbJvq_0 2024-09-12T01:04:38.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.898+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11236467914221523224', time=2024-09-12T02:55:44.781286+0000, chain.objs.size()=6 2024-09-12T01:04:38.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.898+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.bpUBz_euABnaq5aPKCIXzBl-zQHnAhoQ.1 2024-09-12T01:04:38.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.898+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.qBdbbRWk7DdTxHcRvZPpkCcIXobMdVB1.2 2024-09-12T01:04:38.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.902+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.JiOCWdLa0-q7hW_oIav7cx2ZTDQ2R_5M.3 2024-09-12T01:04:38.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.902+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.TsmRgkupt7Su63dcRGKU1LVH5_fnV8A-.4 2024-09-12T01:04:38.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.902+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.e-vEoRqdZ93GY0K0zFeE2MRRJZlPSbtI.5 2024-09-12T01:04:38.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.902+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.wD-ssaNyoilgmskTNhOtkBL8bZRT9PNJ.6 2024-09-12T01:04:38.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.902+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~-G5AvmgQCm885QltYpn7diPXq3AKHcB', time=2024-09-12T02:55:58.333033+0000, chain.objs.size()=3 2024-09-12T01:04:38.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.902+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.531__multipart_mymultipart.2~-G5AvmgQCm885QltYpn7diPXq3AKHcB.1 2024-09-12T01:04:38.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.902+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.531__shadow_mymultipart.2~-G5AvmgQCm885QltYpn7diPXq3AKHcB.1_1 2024-09-12T01:04:38.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.902+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.531__multipart_mymultipart.2~-G5AvmgQCm885QltYpn7diPXq3AKHcB.2 2024-09-12T01:04:38.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.902+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13736797939384057007', time=2024-09-12T02:56:59.078423+0000, chain.objs.size()=1 2024-09-12T01:04:38.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.902+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.566__shadow_.RmFlQvZPGpgSMaMe8b1a67d_CRVmIRH_0 2024-09-12T01:04:38.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.902+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5653718223798092549', time=2024-09-12T02:57:07.317749+0000, chain.objs.size()=1 2024-09-12T01:04:38.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.902+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.569__shadow:U27FApmMPxMpQOZcM15mmxktFd9i9KI_.11v-g-SVxHLGjjmaMh9bz0KLV1Z-ono_0 2024-09-12T01:04:38.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.902+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.67681710916128300', time=2024-09-12T02:57:11.181652+0000, chain.objs.size()=1 2024-09-12T01:04:38.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.902+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.571__shadow_.aszlMCUTklxavboUY7Yl7xkatrhcq1s_0 2024-09-12T01:04:38.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.902+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1371476676444797635', time=2024-09-12T02:57:18.241623+0000, chain.objs.size()=1 2024-09-12T01:04:38.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.902+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.575__shadow:li1Hm-UBxyhaHScQ0o1xT.xP7OIRHbT_.zvf58hJHqVXjv8JyiNIqchuID0iIQJ3_0 2024-09-12T01:04:38.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.906+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11629136084988640165', time=2024-09-12T02:58:21.256906+0000, chain.objs.size()=12 2024-09-12T01:04:38.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.906+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.615__multipart_multipart_enc.2~GfLJepaGrxMFTyaT_kzCUauAidM-LrW.1 2024-09-12T01:04:38.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.906+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.615__shadow_multipart_enc.2~GfLJepaGrxMFTyaT_kzCUauAidM-LrW.1_1 2024-09-12T01:04:38.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.906+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.615__multipart_multipart_enc.2~GfLJepaGrxMFTyaT_kzCUauAidM-LrW.2 2024-09-12T01:04:38.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.906+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.615__shadow_multipart_enc.2~GfLJepaGrxMFTyaT_kzCUauAidM-LrW.2_1 2024-09-12T01:04:38.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.906+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.615__multipart_multipart_enc.2~GfLJepaGrxMFTyaT_kzCUauAidM-LrW.3 2024-09-12T01:04:38.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.906+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.615__shadow_multipart_enc.2~GfLJepaGrxMFTyaT_kzCUauAidM-LrW.3_1 2024-09-12T01:04:38.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.906+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.615__multipart_multipart_enc.2~GfLJepaGrxMFTyaT_kzCUauAidM-LrW.4 2024-09-12T01:04:38.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.906+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.615__shadow_multipart_enc.2~GfLJepaGrxMFTyaT_kzCUauAidM-LrW.4_1 2024-09-12T01:04:38.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.906+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.615__multipart_multipart_enc.2~GfLJepaGrxMFTyaT_kzCUauAidM-LrW.5 2024-09-12T01:04:38.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.906+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.615__shadow_multipart_enc.2~GfLJepaGrxMFTyaT_kzCUauAidM-LrW.5_1 2024-09-12T01:04:38.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.906+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.615__multipart_multipart_enc.2~GfLJepaGrxMFTyaT_kzCUauAidM-LrW.6 2024-09-12T01:04:38.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.906+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.615__shadow_multipart_enc.2~GfLJepaGrxMFTyaT_kzCUauAidM-LrW.6_1 2024-09-12T01:04:38.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.910+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6549464167191722224', time=2024-09-12T03:00:39.445589+0000, chain.objs.size()=1 2024-09-12T01:04:38.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.910+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.632__shadow_.VhyQRMNxtkyQDGKLVDgz9tZVAabav4r_0 2024-09-12T01:04:38.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.910+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16299239843124983122', time=2024-09-12T03:00:50.837257+0000, chain.objs.size()=2 2024-09-12T01:04:38.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.910+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.647__shadow_.gFI_EV1FdMTxRAfAEjXjfm1EylH58TJ_0 2024-09-12T01:04:38.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.910+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.647__shadow_.gFI_EV1FdMTxRAfAEjXjfm1EylH58TJ_1 2024-09-12T01:04:38.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.910+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14994039353582244428', time=2024-09-12T03:00:51.806562+0000, chain.objs.size()=1 2024-09-12T01:04:38.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.910+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.648__shadow_.7HkfWkH-x6kcdIxq1OPLVkJ8kyhDjUL_0 2024-09-12T01:04:38.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.910+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2387769564159328662', time=2024-09-12T03:01:35.572251+0000, chain.objs.size()=1 2024-09-12T01:04:38.911 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.910+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.708__shadow:W7ADWE5GiVGGE6INbyrVX8agI9E3hgj_.w1UAU3Ox9hLaBkMaBYGkWw0v-j2xj9-_0 2024-09-12T01:04:38.912 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.914+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:38.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.914+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:04:38.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.918+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:38.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.918+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:38.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.918+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47595' 2024-09-12T01:04:38.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.918+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~fQ0uF9iTnIIdhas_9IpWL0V1waR4qH5', time=2024-09-12T02:49:13.945822+0000, chain.objs.size()=2 2024-09-12T01:04:38.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.918+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.201__multipart_mymultipart.2~fQ0uF9iTnIIdhas_9IpWL0V1waR4qH5.1 2024-09-12T01:04:38.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.918+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.201__shadow_mymultipart.2~fQ0uF9iTnIIdhas_9IpWL0V1waR4qH5.1_1 2024-09-12T01:04:38.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.918+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4865175249619740566', time=2024-09-12T02:50:44.149235+0000, chain.objs.size()=1 2024-09-12T01:04:38.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.918+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.233__shadow_.PemZFV6G96lb2aYNSal28mhHzk20zDr_0 2024-09-12T01:04:38.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.918+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7551753217336369057', time=2024-09-12T02:50:48.896434+0000, chain.objs.size()=1 2024-09-12T01:04:38.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.918+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.238__shadow_.QgcBlmIffQBl72V8QqPKuaHIKbXyZfQ_0 2024-09-12T01:04:38.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.918+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6938305316056320735', time=2024-09-12T02:51:00.337404+0000, chain.objs.size()=1 2024-09-12T01:04:38.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.918+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.252__shadow_.FSh7e3m4Q6hG6xDuBg6qyQvL5AGLkSS_0 2024-09-12T01:04:38.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.918+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7850987734376104923', time=2024-09-12T02:51:02.581237+0000, chain.objs.size()=1 2024-09-12T01:04:38.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.918+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.255__shadow_.V8pb92lAWw0FbWTKy-XeP7H7gMV88nW_0 2024-09-12T01:04:38.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.918+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6522657011377795715', time=2024-09-12T02:51:26.824801+0000, chain.objs.size()=1 2024-09-12T01:04:38.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.918+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.-Rm-3K5aoeoc8BtqsL-oWzMo2eJbwrL_0 2024-09-12T01:04:38.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.918+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6235734256170895017', time=2024-09-12T02:51:26.829556+0000, chain.objs.size()=1 2024-09-12T01:04:38.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.918+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.5QPH7y2Wu1NG5Q5DuqxA-fSFIRQcQFb_0 2024-09-12T01:04:38.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.918+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3697986354913023051', time=2024-09-12T02:51:26.843993+0000, chain.objs.size()=1 2024-09-12T01:04:38.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.918+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.6o7RnxYn8CT05djxvlqm-Prp75PSIF8_0 2024-09-12T01:04:38.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.918+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6498244262734103682', time=2024-09-12T02:51:26.855387+0000, chain.objs.size()=1 2024-09-12T01:04:38.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.918+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Rik6dpcK2qtljscf8_eP5ahGUN32Cxh_0 2024-09-12T01:04:38.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.918+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12140272960808150972', time=2024-09-12T02:51:26.865209+0000, chain.objs.size()=1 2024-09-12T01:04:38.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.918+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Edg2vwKk__uIho718HBHp0TiPjPTgBt_0 2024-09-12T01:04:38.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.918+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12474891411166527953', time=2024-09-12T02:51:26.869255+0000, chain.objs.size()=1 2024-09-12T01:04:38.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.918+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.jkExZzFmvtZYM2EQVotNPFqs5lTpyeM_0 2024-09-12T01:04:38.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.922+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16329513015277742884', time=2024-09-12T02:51:26.994765+0000, chain.objs.size()=1 2024-09-12T01:04:38.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.922+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.QV77zTiDdPVzFj1mOUKvLaB7Aw7En8G_0 2024-09-12T01:04:38.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.922+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4519078776561933389', time=2024-09-12T02:51:27.039176+0000, chain.objs.size()=1 2024-09-12T01:04:38.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.922+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.fSw42AzqHq_d2AJSPCuk7uHolya7wJ-_0 2024-09-12T01:04:38.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.922+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9835332463356119092', time=2024-09-12T02:51:27.200960+0000, chain.objs.size()=1 2024-09-12T01:04:38.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.922+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.j9v0T533IW87DY2pKv_elLawcSERIgL_0 2024-09-12T01:04:38.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.922+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9803184499685267705', time=2024-09-12T02:51:27.205464+0000, chain.objs.size()=1 2024-09-12T01:04:38.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.922+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.VP1LPGoBehjS-Dy6cBNGnnMv_xFfNMA_0 2024-09-12T01:04:38.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.922+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.963809123405242983', time=2024-09-12T02:51:27.240642+0000, chain.objs.size()=1 2024-09-12T01:04:38.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.922+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.MpwZzAP3bWtA-nuBApAvNn8pzntFiTR_0 2024-09-12T01:04:38.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.922+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10658991551776617654', time=2024-09-12T02:51:27.257608+0000, chain.objs.size()=1 2024-09-12T01:04:38.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.922+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.NJEBxjEtwDZT5ditQV4rVKP06JxWRP-_0 2024-09-12T01:04:38.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.922+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4436322172962438992', time=2024-09-12T02:51:27.262312+0000, chain.objs.size()=1 2024-09-12T01:04:38.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.922+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.a5ps_XLFovb8kEuZCNP1yBWhYs6Ix83_0 2024-09-12T01:04:38.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.922+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17403872210694512843', time=2024-09-12T02:51:27.278060+0000, chain.objs.size()=1 2024-09-12T01:04:38.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.922+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.f2WSbZpGAxEn1PWH5DvHtBV0pOW_UaL_0 2024-09-12T01:04:38.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.922+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14521127382380859168', time=2024-09-12T02:51:27.289528+0000, chain.objs.size()=1 2024-09-12T01:04:38.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.922+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.noZnAVxvqTsJgDA6YdexzznwbIypbuK_0 2024-09-12T01:04:38.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.922+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9838272709306511196', time=2024-09-12T02:51:27.310986+0000, chain.objs.size()=1 2024-09-12T01:04:38.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.922+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.XJeVZYJMMjoXzslYIPnC3JaM7DIEH6E_0 2024-09-12T01:04:38.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.922+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16714605876048948110', time=2024-09-12T02:51:27.312093+0000, chain.objs.size()=1 2024-09-12T01:04:38.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.922+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.kBr2yFix5YvZooWipsVsxnr5IL9vO0g_0 2024-09-12T01:04:38.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.922+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10688744277194559254', time=2024-09-12T02:51:27.323653+0000, chain.objs.size()=1 2024-09-12T01:04:38.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.922+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.1GWnOgX8XiSRWT12ecO0TIWR2lh5Wv2_0 2024-09-12T01:04:38.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.922+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16160611436766316311', time=2024-09-12T02:51:27.420989+0000, chain.objs.size()=1 2024-09-12T01:04:38.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.922+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.xdwe7U3C84s7QS8pfpEEaTLJT5MQmmb_0 2024-09-12T01:04:38.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15278978146938024793', time=2024-09-12T02:51:27.661156+0000, chain.objs.size()=1 2024-09-12T01:04:38.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.sTIoICNOLUUNQb4fGT518h4o-OQxvIT_0 2024-09-12T01:04:38.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15748741109374964107', time=2024-09-12T02:51:27.706472+0000, chain.objs.size()=1 2024-09-12T01:04:38.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.IgIzaDdOxFx70mNps2IWRbVMg2vXFUt_0 2024-09-12T01:04:38.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6008904557316395962', time=2024-09-12T02:51:27.727794+0000, chain.objs.size()=1 2024-09-12T01:04:38.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Xz8bhaE_PMMj9LVeAJFqp3sJ2wewqBC_0 2024-09-12T01:04:38.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17113309921112159686', time=2024-09-12T02:51:27.735706+0000, chain.objs.size()=1 2024-09-12T01:04:38.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.f6jOQctxjTEoCWfGqD0509o63HNdUFv_0 2024-09-12T01:04:38.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1378898414388314414', time=2024-09-12T02:51:27.837380+0000, chain.objs.size()=1 2024-09-12T01:04:38.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.AoP7BRMdhHLsJZGHAB_9pa1TfHwU5wG_0 2024-09-12T01:04:38.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5655087124339436446', time=2024-09-12T02:51:27.882877+0000, chain.objs.size()=1 2024-09-12T01:04:38.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.yx5xM23zihVKJ1gFtmxyWzFrK-DPoL2_0 2024-09-12T01:04:38.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7953262172871441483', time=2024-09-12T02:51:27.906653+0000, chain.objs.size()=1 2024-09-12T01:04:38.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.S-KjyzA76Bcd-tUSXlQrjILxmzuaBYZ_0 2024-09-12T01:04:38.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4164430353252148740', time=2024-09-12T02:51:27.956536+0000, chain.objs.size()=1 2024-09-12T01:04:38.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.rzjX7N6HaxBl1-0GC-6rUBYB6o9Myux_0 2024-09-12T01:04:38.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13708139260219463934', time=2024-09-12T02:51:27.959092+0000, chain.objs.size()=1 2024-09-12T01:04:38.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.xWeG2Rq35Nou3JmtqgstblRm5cKnRay_0 2024-09-12T01:04:38.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1021277695831343477', time=2024-09-12T02:51:28.123954+0000, chain.objs.size()=1 2024-09-12T01:04:38.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.xyj5dXOyhexuBsSCJZg4rDCaLiAMSBF_0 2024-09-12T01:04:38.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14586852774071681345', time=2024-09-12T02:51:28.128384+0000, chain.objs.size()=1 2024-09-12T01:04:38.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.aX8DCg0qyzSt7yJTSdJ48ibJS46dzrY_0 2024-09-12T01:04:38.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5270311080015095016', time=2024-09-12T02:51:28.160171+0000, chain.objs.size()=1 2024-09-12T01:04:38.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.pE68ZK953zJsN_VAYpCvYHr6FSMdeWn_0 2024-09-12T01:04:38.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11456459181353100231', time=2024-09-12T02:51:28.204375+0000, chain.objs.size()=1 2024-09-12T01:04:38.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.1ZpVwQi7E2fKqfvQG_owK6SH1y11uXU_0 2024-09-12T01:04:38.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3501997627331073764', time=2024-09-12T02:51:28.249281+0000, chain.objs.size()=1 2024-09-12T01:04:38.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.9WJcwXMq0yGlEr5xZWJzniEZ6dpT_uT_0 2024-09-12T01:04:38.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2800793097146508637', time=2024-09-12T02:51:28.376545+0000, chain.objs.size()=1 2024-09-12T01:04:38.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.v1tjsk_f7Tur-Ptpn8MLREzdCap2VQy_0 2024-09-12T01:04:38.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9719240270352684853', time=2024-09-12T02:51:28.641848+0000, chain.objs.size()=1 2024-09-12T01:04:38.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.IMUyUFHMhU7zk11VHwuN6wKCHcfbiOZ_0 2024-09-12T01:04:38.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3522419712390228314', time=2024-09-12T02:51:37.251545+0000, chain.objs.size()=1 2024-09-12T01:04:38.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.274__shadow_.SLYWOyMPdDkw71sOxb5tAC_JsRSLmvp_0 2024-09-12T01:04:38.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12707790519684212497', time=2024-09-12T02:51:41.675600+0000, chain.objs.size()=1 2024-09-12T01:04:38.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.280__shadow_.VPmC7erTluzpGsCH8ktFhRreTNASZq6_0 2024-09-12T01:04:38.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8413985476965974341', time=2024-09-12T02:51:51.715955+0000, chain.objs.size()=1 2024-09-12T01:04:38.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.292__shadow_.C60waGK8olpahd5wdSxotteARx-StYk_0 2024-09-12T01:04:38.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15414144136168600773', time=2024-09-12T02:51:53.175946+0000, chain.objs.size()=1 2024-09-12T01:04:38.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.293__shadow_.d7hMuwybLFmOY0IkQYUwdC3dqm8x8ky_0 2024-09-12T01:04:38.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6725059921230657829', time=2024-09-12T02:52:01.420340+0000, chain.objs.size()=1 2024-09-12T01:04:38.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.304__shadow_.4izHfx_D12nBVR4xoAovPUtO0KQX77v_0 2024-09-12T01:04:38.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12284441510310807833', time=2024-09-12T02:52:35.020435+0000, chain.objs.size()=1 2024-09-12T01:04:38.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.dZ9dC3Hb6qAGwtsX3_JR2lWbxbLmcBD_0 2024-09-12T01:04:38.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17400012186005032709', time=2024-09-12T02:52:35.047900+0000, chain.objs.size()=1 2024-09-12T01:04:38.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.vINNxLmYXFD3pkGET4JF-7UoQX4YSP4_0 2024-09-12T01:04:38.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10531183388728559914', time=2024-09-12T02:52:35.061828+0000, chain.objs.size()=1 2024-09-12T01:04:38.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.CON0QQ-GZWEzv4PLbIuSC191ichJ3kz_0 2024-09-12T01:04:38.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6467003319502132246', time=2024-09-12T02:52:35.064604+0000, chain.objs.size()=1 2024-09-12T01:04:38.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.PgqSFYR-3Naezy7oh0_cVbOpP94LIkp_0 2024-09-12T01:04:38.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14664564656439225045', time=2024-09-12T02:52:35.099399+0000, chain.objs.size()=1 2024-09-12T01:04:38.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.kLO-CXwicK97wm8CH0_MBVxebQdfoNt_0 2024-09-12T01:04:38.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13900422892384631126', time=2024-09-12T02:52:35.173126+0000, chain.objs.size()=1 2024-09-12T01:04:38.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.1M64mPuEP1MaKmQXzQNavEaccZhlhPu_0 2024-09-12T01:04:38.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1434522228090175294', time=2024-09-12T02:52:35.180067+0000, chain.objs.size()=1 2024-09-12T01:04:38.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.KDgvzZ_U4Dg0DLGj-v0whFsYwNCji5z_0 2024-09-12T01:04:38.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10715878207414933314', time=2024-09-12T02:52:35.313812+0000, chain.objs.size()=1 2024-09-12T01:04:38.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Zqj1zUkYV0f_t9u_3M8NQfoJ0b12c0k_0 2024-09-12T01:04:38.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6699714822380225904', time=2024-09-12T02:52:35.339924+0000, chain.objs.size()=1 2024-09-12T01:04:38.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.kOWz2h4j4Rj5CdHxIcYNoeqNPUCfqyj_0 2024-09-12T01:04:38.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.456406158163609432', time=2024-09-12T02:52:35.362784+0000, chain.objs.size()=1 2024-09-12T01:04:38.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.SXuyxdFd_Jwcrv2fDG4VnYFPr-3Bhd2_0 2024-09-12T01:04:38.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.934+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3841716900223252420', time=2024-09-12T02:52:35.408432+0000, chain.objs.size()=1 2024-09-12T01:04:38.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.934+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ufFZ-TJNKQz3KijnDYgL2jCtXDEJTFk_0 2024-09-12T01:04:38.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.934+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14983675780538000325', time=2024-09-12T02:52:35.420667+0000, chain.objs.size()=1 2024-09-12T01:04:38.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.934+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.6RzkxAHjnaRekqBJLhiHOnhtA9rVQDi_0 2024-09-12T01:04:38.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.934+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7509602939589995392', time=2024-09-12T02:52:35.595906+0000, chain.objs.size()=1 2024-09-12T01:04:38.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.934+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.froT-3D_hmCsM-SN4lHXSYhp_LysKhm_0 2024-09-12T01:04:38.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.934+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13980325931742001505', time=2024-09-12T02:52:35.602342+0000, chain.objs.size()=1 2024-09-12T01:04:38.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.934+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.2nzl9cu_HHkXO8gaB20aNYa8M9GgmR5_0 2024-09-12T01:04:38.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.934+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7073103438459281009', time=2024-09-12T02:52:35.607326+0000, chain.objs.size()=1 2024-09-12T01:04:38.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.934+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Rrfx6Wn_WtDwh5eolBgPolmgW1ozd-2_0 2024-09-12T01:04:38.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.934+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14738853414494449649', time=2024-09-12T02:52:35.647989+0000, chain.objs.size()=1 2024-09-12T01:04:38.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.934+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.zc18dT284KA5nuVYMN-YM7zQIMU57u4_0 2024-09-12T01:04:38.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.934+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16227424668434177845', time=2024-09-12T02:52:35.654344+0000, chain.objs.size()=1 2024-09-12T01:04:38.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.934+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ZNo0oGWuIu_ComcynHokUldyAH5uKu7_0 2024-09-12T01:04:38.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.934+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18134090472736100504', time=2024-09-12T02:52:35.655857+0000, chain.objs.size()=1 2024-09-12T01:04:38.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.934+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.pG_yJND_qbDU8B6EXXH9b3tZDQBuEpV_0 2024-09-12T01:04:38.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.934+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15602142456949543004', time=2024-09-12T02:52:35.658530+0000, chain.objs.size()=1 2024-09-12T01:04:38.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.934+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.RF_z_mYL6Aw13jm84ecUSuzewhW0KM0_0 2024-09-12T01:04:38.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.934+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16491521671389752987', time=2024-09-12T02:52:35.859659+0000, chain.objs.size()=1 2024-09-12T01:04:38.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.934+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.FR1Kuc_C3e2xI1umqQklYrJXcLC1XJR_0 2024-09-12T01:04:38.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3546780321870421960', time=2024-09-12T02:52:35.866452+0000, chain.objs.size()=1 2024-09-12T01:04:38.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.nwMkUSoOfFl5IC3HBFqElwhd8NbCyO5_0 2024-09-12T01:04:38.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15872891855811280451', time=2024-09-12T02:52:35.884418+0000, chain.objs.size()=1 2024-09-12T01:04:38.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.h6U7aJqF2J2-TxiyELXJRS-NGs0OD-m_0 2024-09-12T01:04:38.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11258540797911502881', time=2024-09-12T02:52:35.885922+0000, chain.objs.size()=1 2024-09-12T01:04:38.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.1Y6uMlP03c5FwuBu44IDh3S3jcEKv1e_0 2024-09-12T01:04:38.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15445494765133726443', time=2024-09-12T02:52:36.235554+0000, chain.objs.size()=1 2024-09-12T01:04:38.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.OB874bH1nLWaaPHVJbL619c67JKqiOy_0 2024-09-12T01:04:38.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2173619335050230153', time=2024-09-12T02:52:36.238851+0000, chain.objs.size()=1 2024-09-12T01:04:38.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Ls0pX9RXpv6VChzMqByPjo5zhTVP6jP_0 2024-09-12T01:04:38.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7636218060908805405', time=2024-09-12T02:52:36.322757+0000, chain.objs.size()=1 2024-09-12T01:04:38.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.AtfkLsAK0WjU_mAnJo-mBWxsSnggNVf_0 2024-09-12T01:04:38.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8557423326554444816', time=2024-09-12T02:52:36.340187+0000, chain.objs.size()=1 2024-09-12T01:04:38.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.7ASqevahFioN2c6hpgBzKyVTOF5sE9A_0 2024-09-12T01:04:38.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14456210524610625103', time=2024-09-12T02:52:36.541168+0000, chain.objs.size()=1 2024-09-12T01:04:38.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.pM3aXwq-5RY4nNBGrkzad2XMPWOV81J_0 2024-09-12T01:04:38.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12629090430623163181', time=2024-09-12T02:52:36.591920+0000, chain.objs.size()=1 2024-09-12T01:04:38.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.UnsGuGPKTpCE0ncNCQSwkltyOULRtYf_0 2024-09-12T01:04:38.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9102991450804101001', time=2024-09-12T02:52:36.623424+0000, chain.objs.size()=1 2024-09-12T01:04:38.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Y0oMGM42cQJjYylKi6dRtJ3iRlEmmb4_0 2024-09-12T01:04:38.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9452318400203555938', time=2024-09-12T02:52:36.631575+0000, chain.objs.size()=1 2024-09-12T01:04:38.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.AnuQFeTIDuMeN4N6cGlMoQmv5uP3jfe_0 2024-09-12T01:04:38.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1521989891481203260', time=2024-09-12T02:52:36.762105+0000, chain.objs.size()=1 2024-09-12T01:04:38.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Z7kQRi703ZP2GxdIETbaXm0RsTNAxdl_0 2024-09-12T01:04:38.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17944995459981268456', time=2024-09-12T02:52:36.821124+0000, chain.objs.size()=1 2024-09-12T01:04:38.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.EydGZmAfenjlu1vg7hcsGpoAGQMTn9j_0 2024-09-12T01:04:38.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6790674828318174062', time=2024-09-12T02:52:36.862408+0000, chain.objs.size()=1 2024-09-12T01:04:38.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.VPNCyYmnmPwe4JDqVKDFgJ__kE80Nm4_0 2024-09-12T01:04:38.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1415578125857874776', time=2024-09-12T02:52:37.022612+0000, chain.objs.size()=1 2024-09-12T01:04:38.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.DuTHegKnF4rR9hIxwltBuIuy19hcMVq_0 2024-09-12T01:04:38.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14143670831355949928', time=2024-09-12T02:52:37.071384+0000, chain.objs.size()=1 2024-09-12T01:04:38.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.D7hF-LSzXKgeCe45B7ETp1qdKkAP7Wt_0 2024-09-12T01:04:38.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8785514836545214823', time=2024-09-12T02:52:56.904559+0000, chain.objs.size()=1 2024-09-12T01:04:38.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.938+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.dEh4OaVaspxBN-8RBQPOvPLERWMEfm__0 2024-09-12T01:04:38.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.942+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16576871349573889343', time=2024-09-12T02:52:57.038031+0000, chain.objs.size()=1 2024-09-12T01:04:38.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.JBrGxiCJawSJu79HAXFrV6K6zeM2kxd_0 2024-09-12T01:04:38.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.942+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17048009103145915133', time=2024-09-12T02:52:57.157611+0000, chain.objs.size()=1 2024-09-12T01:04:38.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Ixm9JJ4bu9XnfVI5-zkzfXeTepFZhYI_0 2024-09-12T01:04:38.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.942+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7436380821387321323', time=2024-09-12T02:52:57.202313+0000, chain.objs.size()=1 2024-09-12T01:04:38.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.nGkXnsmmcyc_CSu4XBcw7OTpPJMQvhX_0 2024-09-12T01:04:38.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.942+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1049056812497865463', time=2024-09-12T02:52:57.230633+0000, chain.objs.size()=1 2024-09-12T01:04:38.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.3XwazgWTHCx-fXlhnmFFQGhsoPdq8Of_0 2024-09-12T01:04:38.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.942+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5008522878419196411', time=2024-09-12T02:52:57.274005+0000, chain.objs.size()=1 2024-09-12T01:04:38.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.EKkFMtsOXMDna7PVlUC6xVhtaazTNBy_0 2024-09-12T01:04:38.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.942+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5493230393146990634', time=2024-09-12T02:52:57.283382+0000, chain.objs.size()=1 2024-09-12T01:04:38.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.X98P9pnaGwmmW531dtWMj8A6JW6NljK_0 2024-09-12T01:04:38.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.942+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11664954275111435093', time=2024-09-12T02:52:57.400357+0000, chain.objs.size()=1 2024-09-12T01:04:38.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.bpSUZ4U6qP_QfQUXzmFhzt4AE88BrqE_0 2024-09-12T01:04:38.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.942+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13757430857447702091', time=2024-09-12T02:52:57.485441+0000, chain.objs.size()=1 2024-09-12T01:04:38.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.VLFSM89CKd0hQx8N7osxq6ec_vqd-BC_0 2024-09-12T01:04:38.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.942+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9712794217027532247', time=2024-09-12T02:52:57.506416+0000, chain.objs.size()=1 2024-09-12T01:04:38.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.0qMFM3LKOZU6euQMo7cntyEFv7zYyDQ_0 2024-09-12T01:04:38.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.942+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13586932517859332444', time=2024-09-12T02:52:57.515406+0000, chain.objs.size()=1 2024-09-12T01:04:38.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.cS8JwluKqpFMuc_or7SKNGxoyPXm-zg_0 2024-09-12T01:04:38.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.942+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4836894485437382786', time=2024-09-12T02:52:57.721774+0000, chain.objs.size()=1 2024-09-12T01:04:38.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.8ludOuL38g2zxRcUjREghmnQpWpXJCN_0 2024-09-12T01:04:38.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.942+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11431718773532774011', time=2024-09-12T02:52:58.144064+0000, chain.objs.size()=1 2024-09-12T01:04:38.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.YdbmL7gstVGaAvUTQg67Ib4NGxF1uBf_0 2024-09-12T01:04:38.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.942+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4551962158205466403', time=2024-09-12T02:52:58.161247+0000, chain.objs.size()=1 2024-09-12T01:04:38.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Eh-NiwMUM9r0gSPsuI0qkUAis1bsRLM_0 2024-09-12T01:04:38.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.942+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1771821016714118695', time=2024-09-12T02:52:58.166435+0000, chain.objs.size()=1 2024-09-12T01:04:38.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.d8RCjKD-Mb4tZVvAlU2-HCbhgX8EA61_0 2024-09-12T01:04:38.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.942+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7621147957151449498', time=2024-09-12T02:52:58.177366+0000, chain.objs.size()=1 2024-09-12T01:04:38.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.x0dfTa_K8rW8iH28axyoDuE9asHudkL_0 2024-09-12T01:04:38.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.946+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16340814141922341304', time=2024-09-12T02:52:58.239033+0000, chain.objs.size()=1 2024-09-12T01:04:38.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.946+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.YK-rym1s1EaXd7MUtwb8M-c69MI6_lF_0 2024-09-12T01:04:38.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.946+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10054746209633321750', time=2024-09-12T02:52:58.401568+0000, chain.objs.size()=1 2024-09-12T01:04:38.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.946+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Z4It6G8Xvv1JkyIYUHy3kqIDasjyWAG_0 2024-09-12T01:04:38.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.946+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.832319659245422387', time=2024-09-12T02:52:58.484534+0000, chain.objs.size()=1 2024-09-12T01:04:38.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.946+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Il6i9_B9Fl5xGkymcuYNEaviRoTTkmy_0 2024-09-12T01:04:38.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.946+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47595 2024-09-12T01:04:38.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.950+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T01:04:38.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.950+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2549221334748817293', time=2024-09-12T02:52:58.501332+0000, chain.objs.size()=1 2024-09-12T01:04:38.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.eFZGeG4Com71hfwGJ_qHHkNaii-1CpB_0 2024-09-12T01:04:38.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.950+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7208749054736064527', time=2024-09-12T02:52:58.644669+0000, chain.objs.size()=1 2024-09-12T01:04:38.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.YinzbuXve6371_lp5o8K8IAHpjHktt0_0 2024-09-12T01:04:38.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.950+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11848590655249471159', time=2024-09-12T02:52:58.650535+0000, chain.objs.size()=1 2024-09-12T01:04:38.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.-LEfQdsCH9kmf_x2M_aK7KHrGmA4uSA_0 2024-09-12T01:04:38.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.950+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10591585990091257883', time=2024-09-12T02:52:58.657674+0000, chain.objs.size()=1 2024-09-12T01:04:38.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.3FdzuHhjxFgQRBwSfRtiqMT5P735v3k_0 2024-09-12T01:04:38.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.950+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11162072936498875528', time=2024-09-12T02:52:58.689886+0000, chain.objs.size()=1 2024-09-12T01:04:38.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.avWWVPhfaTXHVXFlJGpt6X5yLhZr0yC_0 2024-09-12T01:04:38.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.950+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3193969252703314981', time=2024-09-12T02:53:01.705426+0000, chain.objs.size()=1 2024-09-12T01:04:38.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.329__shadow_.KYcxcGVeYs9gwgJDbzPgxHXilQKaXPc_0 2024-09-12T01:04:38.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.950+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16657867475251905758', time=2024-09-12T02:53:05.929143+0000, chain.objs.size()=1 2024-09-12T01:04:38.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.335__shadow_.EaVd5HCICNG3Qx3HNBIFIY930BgtYKA_0 2024-09-12T01:04:38.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.950+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13135925004034881698', time=2024-09-12T02:54:44.703615+0000, chain.objs.size()=1 2024-09-12T01:04:38.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.466__shadow_.Nw5KDfP20nVIxVmeKuLTj76D49t5Kpg_0 2024-09-12T01:04:38.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.950+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3216220419733402245', time=2024-09-12T02:54:53.300637+0000, chain.objs.size()=1 2024-09-12T01:04:38.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.483__shadow_.kmWgtpCIIHUvIOW_HZzEpY5TYw9glgb_0 2024-09-12T01:04:38.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.950+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15595219879716337445', time=2024-09-12T02:55:07.269469+0000, chain.objs.size()=1 2024-09-12T01:04:38.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.503__shadow:6LMeYfVzuD7PUiSwyt-9RW46Hh57mqn_.UcslrmdoBCcU7pOGIUMlA4mj_NOCVe1_0 2024-09-12T01:04:38.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.950+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6299436489832328705', time=2024-09-12T02:55:51.377818+0000, chain.objs.size()=3 2024-09-12T01:04:38.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.525__multipart_mymultipart.2~J7ShCEmT9ThzLabGc87nhcgxf-GQ6wS.1 2024-09-12T01:04:38.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.525__multipart_mymultipart.2~J7ShCEmT9ThzLabGc87nhcgxf-GQ6wS.2 2024-09-12T01:04:38.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.954+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.525__multipart_mymultipart.2~J7ShCEmT9ThzLabGc87nhcgxf-GQ6wS.3 2024-09-12T01:04:38.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.954+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13396962944134967540', time=2024-09-12T02:55:51.955900+0000, chain.objs.size()=2 2024-09-12T01:04:38.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.954+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.525__multipart_mymultipart.2~57scBxxFN-u_jF-dVzwCrH3vPvOCwi1.1 2024-09-12T01:04:38.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.954+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.525__multipart_mymultipart.2~57scBxxFN-u_jF-dVzwCrH3vPvOCwi1.2 2024-09-12T01:04:38.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.954+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13220577837649473213', time=2024-09-12T02:56:18.550765+0000, chain.objs.size()=1 2024-09-12T01:04:38.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.954+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.536__multipart_mymultipart.2~B5xGYdrVjCTbknF6qjkQPXVJkAHCqpn.1 2024-09-12T01:04:38.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.954+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18320937935139193287', time=2024-09-12T02:57:35.170882+0000, chain.objs.size()=1 2024-09-12T01:04:38.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.954+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:nF9Hq6OEbn8w8jQGUU3uzAocb7FUwMi_.8pEx43p5JWhEy8N-jWIfDGqOBG10PQ5_0 2024-09-12T01:04:38.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.954+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10009455845986867548', time=2024-09-12T02:58:01.801597+0000, chain.objs.size()=1 2024-09-12T01:04:38.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.954+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.602__shadow_.xGC9z4vHq-8dJQ_ggJQfgjCdMdRIUD__0 2024-09-12T01:04:38.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.954+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9400013456109488751', time=2024-09-12T03:00:52.722661+0000, chain.objs.size()=2 2024-09-12T01:04:38.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.954+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.649__shadow_.GmxejWpJAm6R9cLV8R2kJePe7o3ct6V_0 2024-09-12T01:04:38.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.954+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.649__shadow_.GmxejWpJAm6R9cLV8R2kJePe7o3ct6V_1 2024-09-12T01:04:38.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.954+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4371926221492136837', time=2024-09-12T03:01:09.530244+0000, chain.objs.size()=1 2024-09-12T01:04:38.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.954+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.668__shadow_.JGtsoEnsb9g6ZebQz592b2i3lo50SI4_0 2024-09-12T01:04:38.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.954+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12376153847935005446', time=2024-09-12T03:01:26.981019+0000, chain.objs.size()=1 2024-09-12T01:04:38.955 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.954+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.696__shadow:EjhGfWDx2NYBU4VH2BIWUzpZgppihIP_.egd8gt62mpksPmZviDUNlsN8_TJt693_0 2024-09-12T01:04:38.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.958+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:38.959 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.958+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:04:38.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.962+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:38.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.962+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:38.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.962+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52815' 2024-09-12T01:04:38.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.962+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5531666175867099422', time=2024-09-12T02:48:56.948092+0000, chain.objs.size()=1 2024-09-12T01:04:38.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.962+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.189__shadow_.MVgp7etRNiRfZThedZh50PesKBkS5bF_0 2024-09-12T01:04:38.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.962+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17658866204044301223', time=2024-09-12T02:49:10.962386+0000, chain.objs.size()=1 2024-09-12T01:04:38.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.962+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.197__shadow_.pbnQ48MLtRVl3gHAk94VdLoBBU0uv07_0 2024-09-12T01:04:38.963 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.962+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3763113268292566858', time=2024-09-12T02:50:42.724729+0000, chain.objs.size()=1 2024-09-12T01:04:38.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.962+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.231__shadow_.cxwio7dRoDwfRkym8QLRtKrP7BpTjzt_0 2024-09-12T01:04:38.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.962+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17704961498105600209', time=2024-09-12T02:51:00.337646+0000, chain.objs.size()=1 2024-09-12T01:04:38.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.962+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.252__shadow_.uFlyV-jK7YSh4lA106OHgyMh4Uif8fG_0 2024-09-12T01:04:38.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.962+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18085368218680494866', time=2024-09-12T02:51:01.857292+0000, chain.objs.size()=1 2024-09-12T01:04:38.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.962+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.254__shadow_.ExyNqIbW6WTAUiClsXcnVHyrEuA70gV_0 2024-09-12T01:04:38.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.962+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7904537101295241509', time=2024-09-12T02:51:26.771181+0000, chain.objs.size()=1 2024-09-12T01:04:38.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.962+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.8JugLBT_GtZRmezTVsplHh9tWsny8Wl_0 2024-09-12T01:04:38.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.962+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3581354578798233967', time=2024-09-12T02:51:26.828347+0000, chain.objs.size()=1 2024-09-12T01:04:38.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.962+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_._ueuBmNtxIyzFWXCgs5AfoJepOSZt-C_0 2024-09-12T01:04:38.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.962+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11745487728259320405', time=2024-09-12T02:51:26.863684+0000, chain.objs.size()=1 2024-09-12T01:04:38.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.962+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.TpLsiNUj2pjpfwsc7kj-gHRFk3oDynB_0 2024-09-12T01:04:38.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.962+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7412937828113242730', time=2024-09-12T02:51:26.880727+0000, chain.objs.size()=1 2024-09-12T01:04:38.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.962+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.pqTEP-uxMmWT4xl0NjUOq-ctVdlKiD1_0 2024-09-12T01:04:38.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.962+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4436862741776501764', time=2024-09-12T02:51:26.881403+0000, chain.objs.size()=1 2024-09-12T01:04:38.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.962+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.7IuJ5KWj6PLVEOMJTItO7xTaSDKekWv_0 2024-09-12T01:04:38.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.962+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13838064620341763840', time=2024-09-12T02:51:27.023588+0000, chain.objs.size()=1 2024-09-12T01:04:38.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.962+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.3tNCVqiD0XbffchUBWD3ThR558tQhyY_0 2024-09-12T01:04:38.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.962+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4342501131628307635', time=2024-09-12T02:51:27.072286+0000, chain.objs.size()=1 2024-09-12T01:04:38.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.962+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.30aQiW-qK8G6zvBquC15LGJw45o4l-1_0 2024-09-12T01:04:38.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.701164550168648432', time=2024-09-12T02:51:27.233579+0000, chain.objs.size()=1 2024-09-12T01:04:38.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.nKh1AZjc8lLWNML38HtGR-RU7gkeZ6c_0 2024-09-12T01:04:38.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5038969207828499275', time=2024-09-12T02:51:27.250142+0000, chain.objs.size()=1 2024-09-12T01:04:38.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.YUqytV7j9x-n4eU6che38Loo-okBYVT_0 2024-09-12T01:04:38.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14207978829797715821', time=2024-09-12T02:51:27.263847+0000, chain.objs.size()=1 2024-09-12T01:04:38.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.4xfp7LGYtzmd-TPsMrEk8GTSwOQKhSc_0 2024-09-12T01:04:38.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6091565494065693309', time=2024-09-12T02:51:27.329904+0000, chain.objs.size()=1 2024-09-12T01:04:38.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.wwzIdZ0FHXWAXtCF6nNnGezkuN-E9Q7_0 2024-09-12T01:04:38.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10305512412398535581', time=2024-09-12T02:51:27.331963+0000, chain.objs.size()=1 2024-09-12T01:04:38.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.bIFtnBjIsUK3lPVm-KME_Da6I5s9I15_0 2024-09-12T01:04:38.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2307722560666573263', time=2024-09-12T02:51:27.512743+0000, chain.objs.size()=1 2024-09-12T01:04:38.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.zJiVRea3N-Xa-xwINWh-on8_2z1HXZV_0 2024-09-12T01:04:38.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3239306500579659079', time=2024-09-12T02:51:27.513464+0000, chain.objs.size()=1 2024-09-12T01:04:38.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.YE41u6-HuB6RISLR40kJwU5pggOYacr_0 2024-09-12T01:04:38.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3502039686127445769', time=2024-09-12T02:51:27.533194+0000, chain.objs.size()=1 2024-09-12T01:04:38.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Xeb-Pg0ofd3IaToymw5wmIgnQRW8NeQ_0 2024-09-12T01:04:38.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6061465107651881474', time=2024-09-12T02:51:27.535897+0000, chain.objs.size()=1 2024-09-12T01:04:38.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.2FpoyEfTWc6ZqtF7O0pGd-ZNr9PgS-r_0 2024-09-12T01:04:38.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17989442244647225233', time=2024-09-12T02:51:27.644879+0000, chain.objs.size()=1 2024-09-12T01:04:38.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.1AkljMy-Hc-r2fo7JFdxBWjfKnlAWhK_0 2024-09-12T01:04:38.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10895556183720236863', time=2024-09-12T02:51:27.661429+0000, chain.objs.size()=1 2024-09-12T01:04:38.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.LY-HxjGPnCFW-_8LCzxbWWCYCjhdJqf_0 2024-09-12T01:04:38.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8693951406602445036', time=2024-09-12T02:51:27.679426+0000, chain.objs.size()=1 2024-09-12T01:04:38.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_._URnWo_6c2kNJxS7KRTyLi5nnxXcyOc_0 2024-09-12T01:04:38.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15731895591830479603', time=2024-09-12T02:51:27.683267+0000, chain.objs.size()=1 2024-09-12T01:04:38.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Rh73bEAgU6flBTYi0UaihV_xWQwgl6F_0 2024-09-12T01:04:38.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5796983719295206150', time=2024-09-12T02:51:27.689075+0000, chain.objs.size()=1 2024-09-12T01:04:38.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.6UrSiLn0mT7W1cm-pG9zDkA36d1aEew_0 2024-09-12T01:04:38.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11748623177705922915', time=2024-09-12T02:51:27.718234+0000, chain.objs.size()=1 2024-09-12T01:04:38.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.fO3SU0dacseJLoDMWot-kxJrjN9KvBq_0 2024-09-12T01:04:38.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3378624638986370395', time=2024-09-12T02:51:27.902086+0000, chain.objs.size()=1 2024-09-12T01:04:38.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Togeu7HceElaXaCxNnPjWAvDK6W8XJP_0 2024-09-12T01:04:38.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14611975602330210058', time=2024-09-12T02:51:27.959636+0000, chain.objs.size()=1 2024-09-12T01:04:38.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.r2pTfgNIuSVo4ATZaPALtyXbMKauek3_0 2024-09-12T01:04:38.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6909984344222981436', time=2024-09-12T02:51:28.123192+0000, chain.objs.size()=1 2024-09-12T01:04:38.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.m5RSE4UyjyZKH0ikRqxkZCcIVO3jxXh_0 2024-09-12T01:04:38.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13062897881020840482', time=2024-09-12T02:51:28.190161+0000, chain.objs.size()=1 2024-09-12T01:04:38.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.MPvmi1Lv6Ws0ttmT2QOdehc0gVKJlcB_0 2024-09-12T01:04:38.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10105718421388674466', time=2024-09-12T02:51:28.223293+0000, chain.objs.size()=1 2024-09-12T01:04:38.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ii1JPZEzlNzc-sOV1MYA8Obvnw8NT70_0 2024-09-12T01:04:38.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9538465623548479211', time=2024-09-12T02:51:28.340401+0000, chain.objs.size()=1 2024-09-12T01:04:38.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.C4UAJbcc_WHt8c7pvOBbd6quAlXFh7o_0 2024-09-12T01:04:38.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.122700874390408888', time=2024-09-12T02:51:28.342196+0000, chain.objs.size()=1 2024-09-12T01:04:38.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Of0_aOngelcwTTiZ1jfo7MnNdtTHE2h_0 2024-09-12T01:04:38.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2064286142022979204', time=2024-09-12T02:51:28.369789+0000, chain.objs.size()=1 2024-09-12T01:04:38.970 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.rPaNzgIVdAfk0boETXnEsykfw8NxcL6_0 2024-09-12T01:04:38.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3134617215004776389', time=2024-09-12T02:51:28.600945+0000, chain.objs.size()=1 2024-09-12T01:04:38.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.crjZaU2Ib1XiWIDWftz25tzl4_akWwL_0 2024-09-12T01:04:38.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1371429008377242394', time=2024-09-12T02:51:28.604639+0000, chain.objs.size()=1 2024-09-12T01:04:38.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_._AhoIhTKwENeBtEZ7LrfLFRTVFhpNxb_0 2024-09-12T01:04:38.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12221189568839393703', time=2024-09-12T02:51:28.641657+0000, chain.objs.size()=1 2024-09-12T01:04:38.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.yhhB5gn8enXna59Gj8Hzc_Ex-C732Xk_0 2024-09-12T01:04:38.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18020804613997310648', time=2024-09-12T02:51:41.678771+0000, chain.objs.size()=1 2024-09-12T01:04:38.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.280__shadow_.VbIELwY43iz7oz4emG3gjghl_8DscNM_0 2024-09-12T01:04:38.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12842163413374956982', time=2024-09-12T02:51:44.714737+0000, chain.objs.size()=1 2024-09-12T01:04:38.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.284__shadow_.cnu64eskHc3OYjo03DG3e2H26jDcE-t_0 2024-09-12T01:04:38.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11968606935028398975', time=2024-09-12T02:51:46.990393+0000, chain.objs.size()=1 2024-09-12T01:04:38.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.287__shadow_.d9im7xFIF48NiJO3LzIEKW-92Bj_Zd-_0 2024-09-12T01:04:38.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3379994722800463895', time=2024-09-12T02:51:53.162857+0000, chain.objs.size()=1 2024-09-12T01:04:38.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.293__shadow_.mh5XgAGpKqQlBCThLdRqTK1UIAh-iqE_0 2024-09-12T01:04:38.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9104920449528627252', time=2024-09-12T02:51:54.644531+0000, chain.objs.size()=1 2024-09-12T01:04:38.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.295__shadow_.dlYg4K5mT4GzGQjENuPfw4dt1xxY4o2_0 2024-09-12T01:04:38.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10317834742081099962', time=2024-09-12T02:51:56.106600+0000, chain.objs.size()=1 2024-09-12T01:04:38.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.297__shadow_.m3YqeQHStRomzghzpDPYCSEqPZ-G49Z_0 2024-09-12T01:04:38.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18176223506053853385', time=2024-09-12T02:52:34.821562+0000, chain.objs.size()=1 2024-09-12T01:04:38.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.xhmCZ4i7XYpzOjGifSRwiuGJtdGnNAP_0 2024-09-12T01:04:38.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11409300103614836394', time=2024-09-12T02:52:34.838327+0000, chain.objs.size()=1 2024-09-12T01:04:38.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.970+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.9xAtHz8hCAuzw7WiLOlzVWDn2vtKx-T_0 2024-09-12T01:04:38.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11054743254019368571', time=2024-09-12T02:52:35.090563+0000, chain.objs.size()=1 2024-09-12T01:04:38.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.GR61rqV-9ha6izUz48ZP0jtwO9CcTK8_0 2024-09-12T01:04:38.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3770171614799411983', time=2024-09-12T02:52:35.149451+0000, chain.objs.size()=1 2024-09-12T01:04:38.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.DFy6whhdSq8HwPhcBEylMZWCJDw4IqL_0 2024-09-12T01:04:38.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3361319388839891751', time=2024-09-12T02:52:35.299309+0000, chain.objs.size()=1 2024-09-12T01:04:38.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.g_1a_Ak9SjiZcovIJVcxYUNCjk0kt3s_0 2024-09-12T01:04:38.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10424708151581842562', time=2024-09-12T02:52:35.315696+0000, chain.objs.size()=1 2024-09-12T01:04:38.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.6EHBDniFAMyZkymOs5yUKZ4LT1zAceS_0 2024-09-12T01:04:38.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.399612534392418185', time=2024-09-12T02:52:35.348038+0000, chain.objs.size()=1 2024-09-12T01:04:38.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.5_SvqGvh9WOj-ZuRJQh4JEZN_a0taxx_0 2024-09-12T01:04:38.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13118950000803083106', time=2024-09-12T02:52:35.373697+0000, chain.objs.size()=1 2024-09-12T01:04:38.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.wIbrxiR7e6N0zoTyW_BsdMd4NAi2Mrv_0 2024-09-12T01:04:38.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7674369035676319168', time=2024-09-12T02:52:35.407017+0000, chain.objs.size()=1 2024-09-12T01:04:38.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.pqiESmtd6KBOt7G6YjfL3FC6NARn6nI_0 2024-09-12T01:04:38.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15848292882370805617', time=2024-09-12T02:52:35.559805+0000, chain.objs.size()=1 2024-09-12T01:04:38.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_._eIeZdTIbcyMsqWeTblqHB9zpBV_8hN_0 2024-09-12T01:04:38.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5404872779798166808', time=2024-09-12T02:52:35.613324+0000, chain.objs.size()=1 2024-09-12T01:04:38.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.-Al0nj6l3RRFnygNuKEJAcytj5yMD47_0 2024-09-12T01:04:38.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.815944644017720624', time=2024-09-12T02:52:35.658681+0000, chain.objs.size()=1 2024-09-12T01:04:38.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.7HLrDSBhOmkQ7ooYdQwIia0WhArfXsi_0 2024-09-12T01:04:38.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8193496597471895921', time=2024-09-12T02:52:35.666537+0000, chain.objs.size()=1 2024-09-12T01:04:38.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.V1_TGiFuAvt49N2DOAJjpLBuunK-k5d_0 2024-09-12T01:04:38.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1558012899459719869', time=2024-09-12T02:52:35.794885+0000, chain.objs.size()=1 2024-09-12T01:04:38.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.1v7sP9s4Keo3rspROD22g7v8j052P5B_0 2024-09-12T01:04:38.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8045086919259334122', time=2024-09-12T02:52:35.811018+0000, chain.objs.size()=1 2024-09-12T01:04:38.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.xRpUptZ5fcB3otn4GJq8ZbUXIKNellp_0 2024-09-12T01:04:38.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15939410564234514394', time=2024-09-12T02:52:35.822193+0000, chain.objs.size()=1 2024-09-12T01:04:38.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.5jkZRk1jZLqLVx8lUqlI04L8HASv58q_0 2024-09-12T01:04:38.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4613562076970814023', time=2024-09-12T02:52:35.831004+0000, chain.objs.size()=1 2024-09-12T01:04:38.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.OJiv4-6kxJv7jiXXqzRZVFpU-8iaIKB_0 2024-09-12T01:04:38.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2142658917654950460', time=2024-09-12T02:52:36.231992+0000, chain.objs.size()=1 2024-09-12T01:04:38.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.gVlScBHCtdwxEDFK4z3z05-mR9z12ss_0 2024-09-12T01:04:38.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3268291640615650371', time=2024-09-12T02:52:36.234980+0000, chain.objs.size()=1 2024-09-12T01:04:38.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.elWBDFt6_8ziTaTjf8zwRxXqTNLC_3l_0 2024-09-12T01:04:38.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17951160583739627349', time=2024-09-12T02:52:36.266456+0000, chain.objs.size()=1 2024-09-12T01:04:38.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.uDyxF4Rb7IfoieqsuqKEoP52cslds6t_0 2024-09-12T01:04:38.978 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12515282720684275707', time=2024-09-12T02:52:36.296528+0000, chain.objs.size()=1 2024-09-12T01:04:38.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.RzsMS7EB_h0ETwCKPflUiizrqveyfdp_0 2024-09-12T01:04:38.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3840189514148477123', time=2024-09-12T02:52:36.360116+0000, chain.objs.size()=1 2024-09-12T01:04:38.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.mXrVtfHoIgM8xD2fljO86Ss4PmR4zTT_0 2024-09-12T01:04:38.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2550565723719990648', time=2024-09-12T02:52:36.371779+0000, chain.objs.size()=1 2024-09-12T01:04:38.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.o63DMtxuJXLq93lYPc_QFfVGMM0A5Ap_0 2024-09-12T01:04:38.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8230447308466155324', time=2024-09-12T02:52:36.506882+0000, chain.objs.size()=1 2024-09-12T01:04:38.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ZHBG11nGVvXvJDOb9lMGA9SQhJtpqtl_0 2024-09-12T01:04:38.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13978854698509071252', time=2024-09-12T02:52:36.808840+0000, chain.objs.size()=1 2024-09-12T01:04:38.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.F3UDdpgUIsrlSBH111iVRRRky5biNWR_0 2024-09-12T01:04:38.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3725708167677440379', time=2024-09-12T02:52:36.835011+0000, chain.objs.size()=1 2024-09-12T01:04:38.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.KNhnQnta9koOHCKjaG8ek3poC6sWkUr_0 2024-09-12T01:04:38.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12653756588615326926', time=2024-09-12T02:52:36.864288+0000, chain.objs.size()=1 2024-09-12T01:04:38.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.1elfAKIM5vxsmfhQfaItB42fG4qVt2N_0 2024-09-12T01:04:38.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13004461567580534656', time=2024-09-12T02:52:56.959794+0000, chain.objs.size()=1 2024-09-12T01:04:38.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.8OT6DBk1pp6ADZniyKx6Bnu-ZDpzmMH_0 2024-09-12T01:04:38.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12224478105003288771', time=2024-09-12T02:52:56.986457+0000, chain.objs.size()=1 2024-09-12T01:04:38.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Sxfs6QEIYFk0JNOHTX83nzRv0mSqTPX_0 2024-09-12T01:04:38.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5913071954455305510', time=2024-09-12T02:52:56.989723+0000, chain.objs.size()=1 2024-09-12T01:04:38.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.7Hn_UDthqfRD3gd-ePGEsh2yEMbsTOO_0 2024-09-12T01:04:38.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4608683303836368900', time=2024-09-12T02:52:56.992893+0000, chain.objs.size()=1 2024-09-12T01:04:38.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.eP7QMb_efmhdO11OURIMN8xj6tfOicm_0 2024-09-12T01:04:38.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.957305564312959943', time=2024-09-12T02:52:56.995893+0000, chain.objs.size()=1 2024-09-12T01:04:38.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.xdqt5PxiLEfbOmhVbhp3M2fr4s07NME_0 2024-09-12T01:04:38.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11936326474874598394', time=2024-09-12T02:52:57.014005+0000, chain.objs.size()=1 2024-09-12T01:04:38.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.3N1OKqUSLL3sGvozD9UE6yBMNFslpm9_0 2024-09-12T01:04:38.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11417911717871916372', time=2024-09-12T02:52:57.033260+0000, chain.objs.size()=1 2024-09-12T01:04:38.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.aujy4t2qn-ZAtz2HmXncTBOTGYZKesv_0 2024-09-12T01:04:38.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13266531927113486090', time=2024-09-12T02:52:57.157111+0000, chain.objs.size()=1 2024-09-12T01:04:38.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.o072FbPUYhAkm4WpG2VPXeyHUL8pRXD_0 2024-09-12T01:04:38.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5556799537615350100', time=2024-09-12T02:52:57.228818+0000, chain.objs.size()=1 2024-09-12T01:04:38.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.w4GyYjmHr6Vu86_CI7tQldjIgJ0MGYa_0 2024-09-12T01:04:38.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14693698500144084322', time=2024-09-12T02:52:57.230406+0000, chain.objs.size()=1 2024-09-12T01:04:38.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ksza0xYiH8oShYUIUXNVrZK5lb_wcPl_0 2024-09-12T01:04:38.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9678961114046111830', time=2024-09-12T02:52:57.234356+0000, chain.objs.size()=1 2024-09-12T01:04:38.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.XtKQ4692lBULzgWU-YC6pLiq1Tz3Vse_0 2024-09-12T01:04:38.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4622414537698732469', time=2024-09-12T02:52:57.258125+0000, chain.objs.size()=1 2024-09-12T01:04:38.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.uTOaM6H3yoQkQMfKkLv-ypoM94BsLQb_0 2024-09-12T01:04:38.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8996603741480847023', time=2024-09-12T02:52:57.426377+0000, chain.objs.size()=1 2024-09-12T01:04:38.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.QezC-b-lIgtmUWG7ASUXhZG_Y2hqrYs_0 2024-09-12T01:04:38.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17079312152090987329', time=2024-09-12T02:52:57.460996+0000, chain.objs.size()=1 2024-09-12T01:04:38.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.mgxgrozQSwhJ0LZ6GsN7_Pv9m1g-_qW_0 2024-09-12T01:04:38.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10792958754714250938', time=2024-09-12T02:52:57.480588+0000, chain.objs.size()=1 2024-09-12T01:04:38.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.umpeL7YD3D1Ix_tsgfsKokhFbJ0Swon_0 2024-09-12T01:04:38.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8140646911970402589', time=2024-09-12T02:52:57.491484+0000, chain.objs.size()=1 2024-09-12T01:04:38.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Y4L-GxO3cg21vy3Ss701OrJW8wfEO5p_0 2024-09-12T01:04:38.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4073557737697634964', time=2024-09-12T02:52:57.641606+0000, chain.objs.size()=1 2024-09-12T01:04:38.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.X0Of1TrKdxuh-i_5qvXLqT487mTkViC_0 2024-09-12T01:04:38.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1414501936070809750', time=2024-09-12T02:52:57.651420+0000, chain.objs.size()=1 2024-09-12T01:04:38.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.LLnihpisE5Gwte9uL71LfnwbDTV4gSN_0 2024-09-12T01:04:38.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2395300017165778113', time=2024-09-12T02:52:57.695243+0000, chain.objs.size()=1 2024-09-12T01:04:38.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.pnfXKHgi2XQjY-fHc_BeN7G3mIJ0Upl_0 2024-09-12T01:04:38.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6736699038676553013', time=2024-09-12T02:52:57.712008+0000, chain.objs.size()=1 2024-09-12T01:04:38.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.uPpMwj5UZxCKE6tDkjRuORz2NdKtwio_0 2024-09-12T01:04:38.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6715040124353930872', time=2024-09-12T02:52:57.888800+0000, chain.objs.size()=1 2024-09-12T01:04:38.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.-opi9yFMTPGDveKAw9tHbBM22abROAA_0 2024-09-12T01:04:38.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13733764588551508282', time=2024-09-12T02:52:57.901421+0000, chain.objs.size()=1 2024-09-12T01:04:38.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ZH4RFpiE_R9WfQjCk5TdlKUUgq_LfnQ_0 2024-09-12T01:04:38.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16790428711790376365', time=2024-09-12T02:52:57.961809+0000, chain.objs.size()=1 2024-09-12T01:04:38.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.L3hA9XnZSj4GREzXgS9W0sI3CfdFYIp_0 2024-09-12T01:04:38.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3339283403502695540', time=2024-09-12T02:52:57.968506+0000, chain.objs.size()=1 2024-09-12T01:04:38.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.P3b0Rg_ulFtScPwSprRbw8Y1fd2FkZR_0 2024-09-12T01:04:38.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.158494948083099820', time=2024-09-12T02:52:57.980301+0000, chain.objs.size()=1 2024-09-12T01:04:38.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.lvWBM5CauRg9que2JRSp_VtKaebGCWN_0 2024-09-12T01:04:38.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.545147297913352240', time=2024-09-12T02:52:57.985773+0000, chain.objs.size()=1 2024-09-12T01:04:38.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.qQHyOWXVzWV28q1jHKSA_iQqC1NzHzu_0 2024-09-12T01:04:38.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13464202424577776844', time=2024-09-12T02:52:58.222740+0000, chain.objs.size()=1 2024-09-12T01:04:38.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.S86Ri3dUXFAOs8IAeZK9to6n82SKesq_0 2024-09-12T01:04:38.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9161960827544386364', time=2024-09-12T02:52:58.229127+0000, chain.objs.size()=1 2024-09-12T01:04:38.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.eyX28Nd3ULO_7dEKJRa2EXGbHx1N1XF_0 2024-09-12T01:04:38.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9438717783761261995', time=2024-09-12T02:52:58.237777+0000, chain.objs.size()=1 2024-09-12T01:04:38.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.-1j6y6_2a5jYjPFAYs8sT1q1887HS6t_0 2024-09-12T01:04:38.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.986+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/52815 2024-09-12T01:04:38.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.986+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-12T01:04:38.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.986+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9367649561268071408', time=2024-09-12T02:52:58.365825+0000, chain.objs.size()=1 2024-09-12T01:04:38.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.986+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.0yob8lai8peDDvcWaaiO6zpIuWHXQOd_0 2024-09-12T01:04:38.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.986+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17959057847003486436', time=2024-09-12T02:52:58.367440+0000, chain.objs.size()=1 2024-09-12T01:04:38.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.986+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.XnLd9heke-0sOluVjuq9AluMrVaE0my_0 2024-09-12T01:04:38.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.986+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17916983515610633116', time=2024-09-12T02:52:58.440409+0000, chain.objs.size()=1 2024-09-12T01:04:38.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.986+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ROR6MML8uQyks-n1aEHTNgAYLnj0BEZ_0 2024-09-12T01:04:38.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.986+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13951475356231912452', time=2024-09-12T02:52:58.499751+0000, chain.objs.size()=1 2024-09-12T01:04:38.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.986+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.cZaUR-OIg8W06ebD3t_QSDMl8LCIm7O_0 2024-09-12T01:04:38.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.986+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5067901274538278319', time=2024-09-12T02:52:58.639649+0000, chain.objs.size()=1 2024-09-12T01:04:38.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.986+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.tdzbsorzIAu5yFzGfnU16ESe9g6_Q6e_0 2024-09-12T01:04:38.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.986+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.644235457773864233', time=2024-09-12T02:52:58.664689+0000, chain.objs.size()=1 2024-09-12T01:04:38.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.986+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.fxRocsyG0QLiub1ivr9Yubln-PMqRLk_0 2024-09-12T01:04:38.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.986+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7490501026139405716', time=2024-09-12T02:52:58.671756+0000, chain.objs.size()=1 2024-09-12T01:04:38.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.986+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.l9JVi6oO_wtRWc2CVEphXQm0cq72N_a_0 2024-09-12T01:04:38.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.986+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1414020120721640605', time=2024-09-12T02:53:33.482145+0000, chain.objs.size()=1 2024-09-12T01:04:38.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.986+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.377__shadow_.KI7ZKIa-T-WczciySViEoaTnaMy0y1c_0 2024-09-12T01:04:38.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.986+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4995987203156611486', time=2024-09-12T02:54:53.300580+0000, chain.objs.size()=1 2024-09-12T01:04:38.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.986+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.483__shadow_.mYCjOOLqvE-bGyKOsdcsBFkC_IQQXGJ_0 2024-09-12T01:04:38.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.986+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~oPBPAtV18ropqioQmB0Fbz9hgMa_1sU', time=2024-09-12T02:56:00.819563+0000, chain.objs.size()=1 2024-09-12T01:04:38.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.986+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.534__multipart_mymultipart.2~oPBPAtV18ropqioQmB0Fbz9hgMa_1sU.1 2024-09-12T01:04:38.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.986+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11743863691779140584', time=2024-09-12T02:56:43.540243+0000, chain.objs.size()=1 2024-09-12T01:04:38.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.986+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.554__shadow_.yGLEXYpL7GkrT5u4UMQBzF97XWxDjmq_0 2024-09-12T01:04:38.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.986+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8081068224926537118', time=2024-09-12T02:56:50.240837+0000, chain.objs.size()=1 2024-09-12T01:04:38.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.986+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.560__shadow_.KOwjWctpL3odbd6Qagueqf6exO3u8w__0 2024-09-12T01:04:38.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.990+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9333228582185109082', time=2024-09-12T02:57:06.991787+0000, chain.objs.size()=1 2024-09-12T01:04:38.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.990+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.569__shadow:GR2gcjrCbvCj.i9g1jq9YrqmdFtpgtD_.nPh9dX1W6Hj8H25lFEj9uLyp6TYsXDp_0 2024-09-12T01:04:38.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.990+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4723185835399391296', time=2024-09-12T02:57:08.306278+0000, chain.objs.size()=1 2024-09-12T01:04:38.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.990+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.569__shadow:MhB6eDXQMaKTyteGmJJ0h5sqMl33X0h_.sYrMlFB-QQZiBFUndzHGLbxNUDALL2c_0 2024-09-12T01:04:38.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.990+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16883386058507267046', time=2024-09-12T02:57:16.981796+0000, chain.objs.size()=1 2024-09-12T01:04:38.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.990+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.574__shadow:AZ7ULeKbmRFbQoUXPpxZp9Pz6HWf7s8_.TsNUNtaRr24cwk_YxttwWyIR9Hc1oZK_0 2024-09-12T01:04:38.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.990+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9306465024925379379', time=2024-09-12T02:57:27.202375+0000, chain.objs.size()=1 2024-09-12T01:04:38.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.990+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:aDL947oBCEV-ji9ZVDSFFTO39mMsPIj_.GIoFzsLLHrp5M8CekR4FwBsZ4XPXV3-_0 2024-09-12T01:04:38.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.990+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8109167321308073363', time=2024-09-12T02:57:52.163322+0000, chain.objs.size()=1 2024-09-12T01:04:38.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.990+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.587__shadow:-VeNuAsM4R7JToCe42JBQ9fhW15O93m_.U3ex9c4LLohR937jHX4WTMs983QWffP_0 2024-09-12T01:04:38.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.990+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13672767447393362745', time=2024-09-12T02:57:58.184734+0000, chain.objs.size()=1 2024-09-12T01:04:38.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.990+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.596__shadow_.K61TnMzyL9dmnv6564m6Yx5ORbg3hTF_0 2024-09-12T01:04:38.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.990+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9939334853731055690', time=2024-09-12T03:00:25.164355+0000, chain.objs.size()=1 2024-09-12T01:04:38.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.990+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.619__shadow_.56mibSWOL-JNrNKGUmC1lzZf0b_sKpZ_0 2024-09-12T01:04:38.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.990+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7943950192144073744', time=2024-09-12T03:00:47.181323+0000, chain.objs.size()=1 2024-09-12T01:04:38.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.990+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.643__shadow_.c9n8b0swrxWzN1BP4MEhQDua1wnBurq_0 2024-09-12T01:04:38.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.990+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17380429092865407976', time=2024-09-12T03:01:06.454199+0000, chain.objs.size()=1 2024-09-12T01:04:38.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.990+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.664__shadow_.sguaRKrDX8wf0t5ubI2dREHgk55pgr6_0 2024-09-12T01:04:38.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.990+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2413224696637954595', time=2024-09-12T03:01:07.382604+0000, chain.objs.size()=1 2024-09-12T01:04:38.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.990+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.665__shadow_.AR4X6en_CPV9dzPbA8TG0SUnPzHjxBt_0 2024-09-12T01:04:38.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.990+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10363133384341800479', time=2024-09-12T03:01:16.235671+0000, chain.objs.size()=1 2024-09-12T01:04:38.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.990+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.679__shadow_.LniQITzpu3FpNtvbegWXqiNpZpVwymL_0 2024-09-12T01:04:38.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.994+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10206102709442679545', time=2024-09-12T03:01:36.193267+0000, chain.objs.size()=1 2024-09-12T01:04:38.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.994+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.709__shadow_.w5AaTl1KNVJlMUmq7bpfxreNUiWo7-m_0 2024-09-12T01:04:38.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.994+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:38.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.998+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:04:38.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.998+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:38.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.998+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:39.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.998+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53047' 2024-09-12T01:04:39.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.998+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9530603736059582393', time=2024-09-12T02:50:42.724780+0000, chain.objs.size()=1 2024-09-12T01:04:39.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.998+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.231__shadow_.7XX9R3f5NeZ4H-iw2_3LpJSVbFKiZQu_0 2024-09-12T01:04:39.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.998+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14027010710382681697', time=2024-09-12T02:50:50.303743+0000, chain.objs.size()=1 2024-09-12T01:04:39.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.998+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.240__shadow_.97bZSivY7wBMpbucByJI40DfKrbmBvQ_0 2024-09-12T01:04:39.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.998+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7947874684797152938', time=2024-09-12T02:50:51.057039+0000, chain.objs.size()=1 2024-09-12T01:04:39.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.998+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.241__shadow_.f_Sw7bD9yAfYHGUXFQj0W9j1y7VYukB_0 2024-09-12T01:04:39.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.998+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.109287296647586239', time=2024-09-12T02:50:55.741589+0000, chain.objs.size()=1 2024-09-12T01:04:39.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.998+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.246__shadow_.mCAyPDrsjGDaF24UowAuzjv1Xl3SDs__0 2024-09-12T01:04:39.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.998+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13881655426359607570', time=2024-09-12T02:50:58.153257+0000, chain.objs.size()=1 2024-09-12T01:04:39.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.998+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.249__shadow_.SeDnXX6eGYHFBg5m_V3-hcQg0IAmYHC_0 2024-09-12T01:04:39.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.998+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18115551700476835083', time=2024-09-12T02:51:05.545200+0000, chain.objs.size()=1 2024-09-12T01:04:39.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.998+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.259__shadow_.ffLk78tFytnpab17ikkeCP6R02jXkiG_0 2024-09-12T01:04:39.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.998+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4631978914154341298', time=2024-09-12T02:51:06.285296+0000, chain.objs.size()=1 2024-09-12T01:04:39.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.998+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.260__shadow_.dw3HnHPBMdoPVOn_8Swcsl4yFxxSPsq_0 2024-09-12T01:04:39.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.998+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15578747163955526447', time=2024-09-12T02:51:26.812872+0000, chain.objs.size()=1 2024-09-12T01:04:39.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.998+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.YRZhTrIWGzuxcwppxBjxUs-8akC_mYq_0 2024-09-12T01:04:39.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.998+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4727881635052722653', time=2024-09-12T02:51:26.846116+0000, chain.objs.size()=1 2024-09-12T01:04:39.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.998+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.HsUmkGSQ6MZpbp5XUvme4BUrvI4ygBs_0 2024-09-12T01:04:39.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.998+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1844809224872434292', time=2024-09-12T02:51:26.870773+0000, chain.objs.size()=1 2024-09-12T01:04:39.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.998+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Cb672kuOXqdSQLOOewYViiy517HOJ4g_0 2024-09-12T01:04:39.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.998+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8917775861110341036', time=2024-09-12T02:51:27.059039+0000, chain.objs.size()=1 2024-09-12T01:04:39.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.998+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.r7fL5VO6ASdsyIt_13i-6A1i_yWR5_W_0 2024-09-12T01:04:39.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.998+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5087496275567914937', time=2024-09-12T02:51:27.225676+0000, chain.objs.size()=1 2024-09-12T01:04:39.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:38.998+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.uB5g2QBUXdvTuEHfca_j6PjQrYD-_1A_0 2024-09-12T01:04:39.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.002+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13899501088552615917', time=2024-09-12T02:51:27.253849+0000, chain.objs.size()=1 2024-09-12T01:04:39.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.002+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.GRHlbd7IN8Ad9K7zbX3xtfhUElkNK7c_0 2024-09-12T01:04:39.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.002+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16532865427423446195', time=2024-09-12T02:51:27.292541+0000, chain.objs.size()=1 2024-09-12T01:04:39.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.002+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.GWMU1AB94zPXC6isNDbw_MEJ9TJNDwz_0 2024-09-12T01:04:39.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.002+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7011107980175480326', time=2024-09-12T02:51:27.296032+0000, chain.objs.size()=1 2024-09-12T01:04:39.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.002+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.zaBuYV0g_mbvQHMPkn6JfSKZI3zUqdd_0 2024-09-12T01:04:39.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.002+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.526794555028345203', time=2024-09-12T02:51:27.319110+0000, chain.objs.size()=1 2024-09-12T01:04:39.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.002+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.t7iEYRPNBMwd8faBy1x7MTRK5BKp8k7_0 2024-09-12T01:04:39.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.002+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16293914632563848383', time=2024-09-12T02:51:27.449759+0000, chain.objs.size()=1 2024-09-12T01:04:39.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.002+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.CKepsDGdmHVm5lVsAhEVFehyC3pM_MG_0 2024-09-12T01:04:39.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.002+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4754861563720594371', time=2024-09-12T02:51:27.468992+0000, chain.objs.size()=1 2024-09-12T01:04:39.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.002+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.mvq9kBie-LuhMUTc4VVS48ZK_CKhLI6_0 2024-09-12T01:04:39.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.002+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16602228837354417819', time=2024-09-12T02:51:27.525997+0000, chain.objs.size()=1 2024-09-12T01:04:39.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.002+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.aFmmLBhAtrG2wvsRGBeNeXror3ZiuB9_0 2024-09-12T01:04:39.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.002+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14904572015079264722', time=2024-09-12T02:51:27.625267+0000, chain.objs.size()=1 2024-09-12T01:04:39.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.002+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.CF4N6fOdHL-aAU9zWlmrHXKCviT7n8R_0 2024-09-12T01:04:39.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.002+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17587120183163100258', time=2024-09-12T02:51:27.627222+0000, chain.objs.size()=1 2024-09-12T01:04:39.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.002+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.eOjZu0oKkQzFW9-kETmrILGwiip-w3J_0 2024-09-12T01:04:39.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.002+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1506424636396881884', time=2024-09-12T02:51:27.672233+0000, chain.objs.size()=1 2024-09-12T01:04:39.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.002+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Q3iEr2Nxhk-Q7hvCMtpQ84Cd7NRFG3m_0 2024-09-12T01:04:39.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.002+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2803935474429555719', time=2024-09-12T02:51:27.673045+0000, chain.objs.size()=1 2024-09-12T01:04:39.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.002+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.-FHF3kdMz0SMc3ntzPsBna-nCA7UKdz_0 2024-09-12T01:04:39.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17864449946470822290', time=2024-09-12T02:51:27.864529+0000, chain.objs.size()=1 2024-09-12T01:04:39.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.vwAv7fTuXJsIKVQM-DA0NGLyI6yAuck_0 2024-09-12T01:04:39.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6841006846565932077', time=2024-09-12T02:51:27.901919+0000, chain.objs.size()=1 2024-09-12T01:04:39.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.QT16fUcjDS5_fp_pv7ngImWstaXgBhF_0 2024-09-12T01:04:39.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1416831123652269810', time=2024-09-12T02:51:27.936228+0000, chain.objs.size()=1 2024-09-12T01:04:39.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.1_3PONcfWmhpnsQkhPPg5IY_aJwMBv-_0 2024-09-12T01:04:39.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5944812142150122639', time=2024-09-12T02:51:27.950213+0000, chain.objs.size()=1 2024-09-12T01:04:39.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.PyEwjF96De2aAXgFOuzL6JOdR8hYzGH_0 2024-09-12T01:04:39.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.981643122523291087', time=2024-09-12T02:51:27.953502+0000, chain.objs.size()=1 2024-09-12T01:04:39.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.XsT_THn6WmkK5ELs05wSVGzEOO3jF97_0 2024-09-12T01:04:39.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16349385810523495029', time=2024-09-12T02:51:28.153205+0000, chain.objs.size()=1 2024-09-12T01:04:39.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ZppOfpGmrG9flqw3_xAXgegDBC-hdCA_0 2024-09-12T01:04:39.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8289108437286401167', time=2024-09-12T02:51:28.169767+0000, chain.objs.size()=1 2024-09-12T01:04:39.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.p3oqeqXQC5NUIq9PP-hc37gdrB3megQ_0 2024-09-12T01:04:39.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13091737781306194478', time=2024-09-12T02:51:28.186065+0000, chain.objs.size()=1 2024-09-12T01:04:39.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.MkCyAwR2DgccnoSDydb4otrwS8XDxyX_0 2024-09-12T01:04:39.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2287080021800915545', time=2024-09-12T02:51:28.217030+0000, chain.objs.size()=1 2024-09-12T01:04:39.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.68t3zSdR7Zo4m4EHMz2OmxgsjV4ToK__0 2024-09-12T01:04:39.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2555652840905884471', time=2024-09-12T02:51:28.242964+0000, chain.objs.size()=1 2024-09-12T01:04:39.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.XHM5AkPsDQINkvti4Rfe-zA4jxbnEqo_0 2024-09-12T01:04:39.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13809935504051395107', time=2024-09-12T02:51:28.380614+0000, chain.objs.size()=1 2024-09-12T01:04:39.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.cpZCEx7Gwn1FZJSnXzB1jL7os4QmPWs_0 2024-09-12T01:04:39.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17144000895920585569', time=2024-09-12T02:51:28.608094+0000, chain.objs.size()=1 2024-09-12T01:04:39.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.RMS_ry6U5YH9fg497JDT9XUghrDPDwn_0 2024-09-12T01:04:39.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13671048652455694299', time=2024-09-12T02:51:28.609991+0000, chain.objs.size()=1 2024-09-12T01:04:39.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.jZnsmoV6ostpA2hu3eH9S0dYq3ODjbC_0 2024-09-12T01:04:39.009 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9182146921631226679', time=2024-09-12T02:51:31.499239+0000, chain.objs.size()=1 2024-09-12T01:04:39.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.266__shadow_.ewE6AOl34gX9l0FP4z-P3qBLCZ8livh_0 2024-09-12T01:04:39.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4494823420373958985', time=2024-09-12T02:51:42.400407+0000, chain.objs.size()=1 2024-09-12T01:04:39.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.281__shadow_.UBU9s8Zbsw0ABTHS8ZDSuuQFI7V2w7D_0 2024-09-12T01:04:39.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3980413904188906216', time=2024-09-12T02:51:44.712119+0000, chain.objs.size()=1 2024-09-12T01:04:39.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.284__shadow_.bG-KQcL1AvnjGuS8dAiJq1SONT91T2N_0 2024-09-12T01:04:39.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.228696976268522439', time=2024-09-12T02:51:46.989956+0000, chain.objs.size()=1 2024-09-12T01:04:39.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.287__shadow_.lAEiByyKcq9k_RgDNiW5NQT0nLtr5WG_0 2024-09-12T01:04:39.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16789397282355236412', time=2024-09-12T02:51:46.991889+0000, chain.objs.size()=1 2024-09-12T01:04:39.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.287__shadow_.Pq0nb6UX9-a8rliXRnlAH90LzSS7PmZ_0 2024-09-12T01:04:39.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16260023714575215494', time=2024-09-12T02:51:51.743035+0000, chain.objs.size()=1 2024-09-12T01:04:39.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.292__shadow_.JcS4FHAAwqu4i6-QNDp-Rm2OtREhuw8_0 2024-09-12T01:04:39.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7109656206882063635', time=2024-09-12T02:51:53.157647+0000, chain.objs.size()=1 2024-09-12T01:04:39.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.293__shadow_.lGvLtdunSuxaeekDdOxSkHbTMFNW5cY_0 2024-09-12T01:04:39.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1977160906169183900', time=2024-09-12T02:51:53.162323+0000, chain.objs.size()=1 2024-09-12T01:04:39.011 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.006+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.293__shadow_.M1HuPsC92JnOFwvUcTTHItpUy10OTV7_0 2024-09-12T01:04:39.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.685954302679213392', time=2024-09-12T02:52:03.065212+0000, chain.objs.size()=1 2024-09-12T01:04:39.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.306__shadow_.zJXTiuJIjDp_AUDgDkGFqhP_MC03V2J_0 2024-09-12T01:04:39.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11427335342852851481', time=2024-09-12T02:52:34.850817+0000, chain.objs.size()=1 2024-09-12T01:04:39.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.x8jjIgiSECfFnOUPufsKM5qISWXd3S3_0 2024-09-12T01:04:39.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13518957582936333812', time=2024-09-12T02:52:35.098722+0000, chain.objs.size()=1 2024-09-12T01:04:39.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.5rQzyHCEjPLVUjD4pEaXN7xRE8D8p_T_0 2024-09-12T01:04:39.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15904921833659743565', time=2024-09-12T02:52:35.107573+0000, chain.objs.size()=1 2024-09-12T01:04:39.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.PhtjLodXBql01DhEocrYDN1zvAl15cb_0 2024-09-12T01:04:39.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6994137802377199625', time=2024-09-12T02:52:35.133625+0000, chain.objs.size()=1 2024-09-12T01:04:39.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.lHo6U7IwgrcBA7NLpVKUDgaLY2w4waR_0 2024-09-12T01:04:39.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7821872423600155036', time=2024-09-12T02:52:35.180785+0000, chain.objs.size()=1 2024-09-12T01:04:39.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.KUztDKBPWwccOTqpQgOBXkceqqMWRvF_0 2024-09-12T01:04:39.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.201635474795926710', time=2024-09-12T02:52:35.335721+0000, chain.objs.size()=1 2024-09-12T01:04:39.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.nKh0EjwtROVKnUttrBryhvgyYjnnkhZ_0 2024-09-12T01:04:39.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9994858581026787246', time=2024-09-12T02:52:35.423002+0000, chain.objs.size()=1 2024-09-12T01:04:39.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.sB18ZjaLefsY2wgp4pgabVQLUqGPFJF_0 2024-09-12T01:04:39.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9642634932691126140', time=2024-09-12T02:52:35.657795+0000, chain.objs.size()=1 2024-09-12T01:04:39.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.CR5GT0DgRcUO74XfbuB_y77V5gylKXV_0 2024-09-12T01:04:39.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4854978142220611211', time=2024-09-12T02:52:35.773439+0000, chain.objs.size()=1 2024-09-12T01:04:39.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.adI9qTJh7Fb2nAVg6ok7NMEMSWkZ1We_0 2024-09-12T01:04:39.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9637103197011409585', time=2024-09-12T02:52:35.786091+0000, chain.objs.size()=1 2024-09-12T01:04:39.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.68uHS32KvVUynR6HtGSaYRdymhING8P_0 2024-09-12T01:04:39.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.960280092960600545', time=2024-09-12T02:52:35.792926+0000, chain.objs.size()=1 2024-09-12T01:04:39.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.I16uBDPVJu1S24xdBqeNb8rqznjs6Q5_0 2024-09-12T01:04:39.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2835827896283985565', time=2024-09-12T02:52:35.802370+0000, chain.objs.size()=1 2024-09-12T01:04:39.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.e7AfFCEPrR9BBRl__ivh-MhH9IFtu8p_0 2024-09-12T01:04:39.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4576908081819161529', time=2024-09-12T02:52:35.805856+0000, chain.objs.size()=1 2024-09-12T01:04:39.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.MZpLmZ9ZyAVgiGA7908-kW1cnpEtt7__0 2024-09-12T01:04:39.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14692235455330364552', time=2024-09-12T02:52:35.848115+0000, chain.objs.size()=1 2024-09-12T01:04:39.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.rFlUs-8oLNvFRnIspWc0BxzVibJBrh-_0 2024-09-12T01:04:39.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15241319125869318788', time=2024-09-12T02:52:36.274012+0000, chain.objs.size()=1 2024-09-12T01:04:39.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.q-_C2FJFbZcFEmP0OhNinT7NgsW4OoX_0 2024-09-12T01:04:39.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16038337060260907741', time=2024-09-12T02:52:36.296322+0000, chain.objs.size()=1 2024-09-12T01:04:39.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.010+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.GM1Bd1m79PIasEaeUBfd9EW1_H8Ibnj_0 2024-09-12T01:04:39.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15258058921966485296', time=2024-09-12T02:52:36.312610+0000, chain.objs.size()=1 2024-09-12T01:04:39.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.VpsuHRtJjj08v3r-fv6WxWUtQpDJSQr_0 2024-09-12T01:04:39.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5955370167065401792', time=2024-09-12T02:52:36.391204+0000, chain.objs.size()=1 2024-09-12T01:04:39.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.RHAb5J-pI8QzhZ3yaaczYSQEYFFiVJL_0 2024-09-12T01:04:39.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15418971637729730520', time=2024-09-12T02:52:36.544128+0000, chain.objs.size()=1 2024-09-12T01:04:39.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.kxQP1PB5gFXwoSwJr7PBuzkI1plYE_Q_0 2024-09-12T01:04:39.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2047616474700605864', time=2024-09-12T02:52:36.578115+0000, chain.objs.size()=1 2024-09-12T01:04:39.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.4nKJKJGXRhvkhLZMOnmybDNeo0pSl3c_0 2024-09-12T01:04:39.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3500520759056954839', time=2024-09-12T02:52:36.600985+0000, chain.objs.size()=1 2024-09-12T01:04:39.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.pe_7GHOh3eW5T1w8L5t3Ql3GC5-f2k2_0 2024-09-12T01:04:39.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3465890680002367550', time=2024-09-12T02:52:36.602286+0000, chain.objs.size()=1 2024-09-12T01:04:39.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.aICOQgNroIZ1BiDuBv7cAygADEUzOcZ_0 2024-09-12T01:04:39.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14389375394880644328', time=2024-09-12T02:52:36.807318+0000, chain.objs.size()=1 2024-09-12T01:04:39.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.1f-KwLNc-RTqckgy0GBsFfHX-a_rwSb_0 2024-09-12T01:04:39.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16382146290716086047', time=2024-09-12T02:52:36.863356+0000, chain.objs.size()=1 2024-09-12T01:04:39.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.pkS2rgPUVkF6qFn5kM_pNC5RPHblDa2_0 2024-09-12T01:04:39.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8108167627634627844', time=2024-09-12T02:52:36.864660+0000, chain.objs.size()=1 2024-09-12T01:04:39.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.cA9fODfH_2oNLEXUE0G9uDRQYMILcK8_0 2024-09-12T01:04:39.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16629089491699629464', time=2024-09-12T02:52:36.868427+0000, chain.objs.size()=1 2024-09-12T01:04:39.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.LBk-oNUlcFnZxjqBJQx6fK735VLs1IY_0 2024-09-12T01:04:39.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18048158385986575577', time=2024-09-12T02:52:36.875307+0000, chain.objs.size()=1 2024-09-12T01:04:39.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.4S-Ze1zkwj098woVxmfLQGCFwOE7tX0_0 2024-09-12T01:04:39.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8246296641352934511', time=2024-09-12T02:52:36.877684+0000, chain.objs.size()=1 2024-09-12T01:04:39.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.gFQEAJ90br5BW7j5SGHlywXCInhaZ_z_0 2024-09-12T01:04:39.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10974241388455629630', time=2024-09-12T02:52:37.013490+0000, chain.objs.size()=1 2024-09-12T01:04:39.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.KqgEdQbc44xccYarEgU5LX82v0awoh6_0 2024-09-12T01:04:39.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5275149686301050420', time=2024-09-12T02:52:37.069899+0000, chain.objs.size()=1 2024-09-12T01:04:39.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.xxSBpsDe93WncNP3qtqAkrxurtMojqV_0 2024-09-12T01:04:39.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9273364230335984645', time=2024-09-12T02:52:37.096418+0000, chain.objs.size()=1 2024-09-12T01:04:39.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.vyQFhAW_Vs0S1TUI4KgpAF2i1RVvq1c_0 2024-09-12T01:04:39.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16914779564466420508', time=2024-09-12T02:52:37.098895+0000, chain.objs.size()=1 2024-09-12T01:04:39.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.nut8AeI0ZA4tgDU7xV7h5GWCBbblX0e_0 2024-09-12T01:04:39.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5949924771641414908', time=2024-09-12T02:52:56.968112+0000, chain.objs.size()=1 2024-09-12T01:04:39.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.unr0skAnd6hJuy0sPgGmwVTgrjhfmda_0 2024-09-12T01:04:39.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.523655182098431868', time=2024-09-12T02:52:56.983253+0000, chain.objs.size()=1 2024-09-12T01:04:39.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.y-L_HlZCy1sW1VRTGrzbZqF8TDHI3YK_0 2024-09-12T01:04:39.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.466991847179724131', time=2024-09-12T02:52:56.998623+0000, chain.objs.size()=1 2024-09-12T01:04:39.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.2IDaA9SzLXuYiXTw6x2XY-YkXbG1yCe_0 2024-09-12T01:04:39.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11822660016777990189', time=2024-09-12T02:52:57.003566+0000, chain.objs.size()=1 2024-09-12T01:04:39.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.kNHT_B8e5j5DsyEirBlbOoYlj9I84W8_0 2024-09-12T01:04:39.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15118625643175469126', time=2024-09-12T02:52:57.024220+0000, chain.objs.size()=1 2024-09-12T01:04:39.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.4teQgIgWg_oUyJ8T6e3D8KaqYAPjVqC_0 2024-09-12T01:04:39.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5550833978926588044', time=2024-09-12T02:52:57.196721+0000, chain.objs.size()=1 2024-09-12T01:04:39.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.hcGKvQKS4f-D4R0tki9h59llWrQKFqi_0 2024-09-12T01:04:39.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17236403206112844811', time=2024-09-12T02:52:57.200716+0000, chain.objs.size()=1 2024-09-12T01:04:39.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.r2tB8V2kXNbnlVVtQq8vCCMwIfm_Ps9_0 2024-09-12T01:04:39.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4192597149585449004', time=2024-09-12T02:52:57.234660+0000, chain.objs.size()=1 2024-09-12T01:04:39.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.KrvTzmeRwxHVM0sHHvAfmhFa7x9W02e_0 2024-09-12T01:04:39.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14651640060254566396', time=2024-09-12T02:52:57.250150+0000, chain.objs.size()=1 2024-09-12T01:04:39.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.8O25nKcsDg6INBqOQXj8YuuJodY0jrt_0 2024-09-12T01:04:39.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6449020809990256927', time=2024-09-12T02:52:57.263710+0000, chain.objs.size()=1 2024-09-12T01:04:39.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.TghurnY-ibfYFLmUJa4v2KtWnTXlO-d_0 2024-09-12T01:04:39.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3080676075282981301', time=2024-09-12T02:52:57.265254+0000, chain.objs.size()=1 2024-09-12T01:04:39.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.cGDUPaNw-35QzcxBeFIF9IIvqtjjzr3_0 2024-09-12T01:04:39.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14186094271159978805', time=2024-09-12T02:52:57.406138+0000, chain.objs.size()=1 2024-09-12T01:04:39.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.xNrZqNmeny-ZfDOe_q6XZ1QF_vEBi4o_0 2024-09-12T01:04:39.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11929426038371080071', time=2024-09-12T02:52:57.490094+0000, chain.objs.size()=1 2024-09-12T01:04:39.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.YtRRVZsmRFJbb_v9M3Ax89wGPxoLMzI_0 2024-09-12T01:04:39.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.203721099318508869', time=2024-09-12T02:52:57.491425+0000, chain.objs.size()=1 2024-09-12T01:04:39.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.SLmFDKwZlBUdIqUTByTmG_163_HKcar_0 2024-09-12T01:04:39.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12427361550295033236', time=2024-09-12T02:52:57.636196+0000, chain.objs.size()=1 2024-09-12T01:04:39.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.bMgJ8ej8eKSCgeQ2mB7i85lrCz5w-_L_0 2024-09-12T01:04:39.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14758099214770391231', time=2024-09-12T02:52:57.661425+0000, chain.objs.size()=1 2024-09-12T01:04:39.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Ru_rGINz-RwQXNgQw3HRRYQvN9NMYTy_0 2024-09-12T01:04:39.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6750640841400834590', time=2024-09-12T02:52:57.669351+0000, chain.objs.size()=1 2024-09-12T01:04:39.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.JlYX---tqQzn9C4ON8pZa6ZlgQFxWdZ_0 2024-09-12T01:04:39.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6245521620483575166', time=2024-09-12T02:52:57.701966+0000, chain.objs.size()=1 2024-09-12T01:04:39.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.fCvY78NjZ2LJisAeYHzYwEKoBzgB1SM_0 2024-09-12T01:04:39.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13323253081334373593', time=2024-09-12T02:52:57.747813+0000, chain.objs.size()=1 2024-09-12T01:04:39.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.r39bkpAR6B6B1iateeod3X2esF2eT6A_0 2024-09-12T01:04:39.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17663813323528163523', time=2024-09-12T02:52:57.750815+0000, chain.objs.size()=1 2024-09-12T01:04:39.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.oh7f9PmN25wCTT5l9To6JHaFML0w_CL_0 2024-09-12T01:04:39.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6610764612723864475', time=2024-09-12T02:52:57.857659+0000, chain.objs.size()=1 2024-09-12T01:04:39.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.E4AFMN8DAnop9aygx0kuZ2AUVmpLk7L_0 2024-09-12T01:04:39.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2092891984086426665', time=2024-09-12T02:52:57.912604+0000, chain.objs.size()=1 2024-09-12T01:04:39.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.wwjU6QzR41YQgUuEatDq3-ZKTRY_i8t_0 2024-09-12T01:04:39.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12080605279198029534', time=2024-09-12T02:52:57.915264+0000, chain.objs.size()=1 2024-09-12T01:04:39.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.10U0ylxNi6wRum8r9a1pUj-4cIQgIV3_0 2024-09-12T01:04:39.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.022+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/53047 2024-09-12T01:04:39.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.022+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=37, truncated=0, next_marker='' 2024-09-12T01:04:39.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.022+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.70177067787657400', time=2024-09-12T02:52:57.925881+0000, chain.objs.size()=1 2024-09-12T01:04:39.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.022+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.E-k8-_1g5Xmc_WJrJl0Q_6iZVhxxp2F_0 2024-09-12T01:04:39.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.022+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4798064256276551511', time=2024-09-12T02:52:57.926981+0000, chain.objs.size()=1 2024-09-12T01:04:39.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.022+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.62i7wjS-UUT_zrF9I0qwbC64e1s_25q_0 2024-09-12T01:04:39.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.022+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7414872210621421458', time=2024-09-12T02:52:57.927864+0000, chain.objs.size()=1 2024-09-12T01:04:39.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.022+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.MdrbBeudm5omaLrQ6YBRjmLyqkFBR8R_0 2024-09-12T01:04:39.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.022+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2107953012506868194', time=2024-09-12T02:52:57.983213+0000, chain.objs.size()=1 2024-09-12T01:04:39.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.022+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ZCxGa0R13u5W6aDO7S_Hxpui22Ei-VO_0 2024-09-12T01:04:39.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.022+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9770379637100797730', time=2024-09-12T02:52:57.989589+0000, chain.objs.size()=1 2024-09-12T01:04:39.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.022+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.LAlXQaPNTfBAW3v5l6ql_yvl6MJiDyf_0 2024-09-12T01:04:39.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.022+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5734375974272214307', time=2024-09-12T02:52:58.103599+0000, chain.objs.size()=1 2024-09-12T01:04:39.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.022+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.6d2KZ5Z9B5Ygjyrd2dEUIHBKr4xNKtf_0 2024-09-12T01:04:39.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.022+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6648450277830690851', time=2024-09-12T02:52:58.144833+0000, chain.objs.size()=1 2024-09-12T01:04:39.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.022+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.RWYl5TKMgN59lQSdjN8WW-ylWL8DKXW_0 2024-09-12T01:04:39.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.022+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6251864396216925290', time=2024-09-12T02:52:58.184181+0000, chain.objs.size()=1 2024-09-12T01:04:39.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.022+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.FL9tNoUHxDxlebuzHoQ--kdTHHzwtqR_0 2024-09-12T01:04:39.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.022+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6058345283418591798', time=2024-09-12T02:52:58.232863+0000, chain.objs.size()=1 2024-09-12T01:04:39.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.022+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.EWjK9vSt3KFHXHsmpLUgaQpzpXISWPS_0 2024-09-12T01:04:39.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.022+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18012331668139481786', time=2024-09-12T02:52:58.233730+0000, chain.objs.size()=1 2024-09-12T01:04:39.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.022+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.xObHovj867K-eDzzetxp5HPSOGuRJUE_0 2024-09-12T01:04:39.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.022+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6777985782868219977', time=2024-09-12T02:52:58.245221+0000, chain.objs.size()=1 2024-09-12T01:04:39.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.022+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.vk57d9tn9llswqGL3X08L1ig7An1tWm_0 2024-09-12T01:04:39.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.022+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3993875244489304038', time=2024-09-12T02:52:58.441876+0000, chain.objs.size()=1 2024-09-12T01:04:39.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.022+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.GVZEdGMkCjVw2ZSmymFHhwLxQyl6zFc_0 2024-09-12T01:04:39.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.026+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4852433545311195274', time=2024-09-12T02:52:58.445640+0000, chain.objs.size()=1 2024-09-12T01:04:39.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.026+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.XtgjlV4zf6cifPEkjE4EGxoz-kTD1Nj_0 2024-09-12T01:04:39.028 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.026+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16566323682053278203', time=2024-09-12T02:52:58.466043+0000, chain.objs.size()=1 2024-09-12T01:04:39.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.026+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.FZCwNohtB9T6jr8H3QbBP5I9RXr4nQ1_0 2024-09-12T01:04:39.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.026+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2620668943262053478', time=2024-09-12T02:52:58.616925+0000, chain.objs.size()=1 2024-09-12T01:04:39.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.026+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.FCl8Ng5Mnl0u_JkMBcJRcakukWV7Vk0_0 2024-09-12T01:04:39.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.026+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12738453841129305099', time=2024-09-12T02:52:58.664658+0000, chain.objs.size()=1 2024-09-12T01:04:39.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.026+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ETY3Sg44iUuM3KMQMWyH8HAeTmnZP_F_0 2024-09-12T01:04:39.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.026+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11977166876129595673', time=2024-09-12T02:52:58.682067+0000, chain.objs.size()=1 2024-09-12T01:04:39.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.026+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.QT0dEY4jUm48GGCELizkX6rVbdu9ySy_0 2024-09-12T01:04:39.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.026+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9094290491938157605', time=2024-09-12T02:52:58.683097+0000, chain.objs.size()=1 2024-09-12T01:04:39.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.026+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.zGjf8cigW3BP4HaM2cFeOUhz8txHh6R_0 2024-09-12T01:04:39.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.026+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14408414805330532633', time=2024-09-12T02:52:58.686202+0000, chain.objs.size()=1 2024-09-12T01:04:39.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.026+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.dpH7Mb8Xh4Qyxe15Vd3nwio7OHCq6Pm_0 2024-09-12T01:04:39.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.026+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2317645071477761608', time=2024-09-12T02:54:20.984485+0000, chain.objs.size()=1 2024-09-12T01:04:39.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.026+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.440__shadow_.KTsHzyJmHD7dSBU2GQsLDBj43tSse_p_0 2024-09-12T01:04:39.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.026+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12037462229172153563', time=2024-09-12T02:54:39.795056+0000, chain.objs.size()=1 2024-09-12T01:04:39.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.026+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.461__shadow_.wZmlERcGAEGezxHXua5iYclJULgDgBl_0 2024-09-12T01:04:39.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.026+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17823981891729402481', time=2024-09-12T02:55:45.687726+0000, chain.objs.size()=1 2024-09-12T01:04:39.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.026+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.523__multipart_mymultipart.2~5_bUSqYtAINi_EQgsvZ9MMrl4BwCE_U.1 2024-09-12T01:04:39.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.026+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.686046516348682018', time=2024-09-12T02:56:40.228897+0000, chain.objs.size()=1 2024-09-12T01:04:39.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.026+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.551__shadow_.Yx9SezgjgyfCyNOABvREMQ0CBc25KFL_0 2024-09-12T01:04:39.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5256996555730666992', time=2024-09-12T02:56:42.443367+0000, chain.objs.size()=1 2024-09-12T01:04:39.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.553__shadow_.JCSGaVSFzgRkYYf_OqOvVlg83Udlpxc_0 2024-09-12T01:04:39.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15829694340878932300', time=2024-09-12T02:56:47.217611+0000, chain.objs.size()=1 2024-09-12T01:04:39.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.557__shadow_.ikZKU0Zdcog1ZGdnx7WVlqmO4r8n_fl_0 2024-09-12T01:04:39.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15858617662966866728', time=2024-09-12T02:57:02.773788+0000, chain.objs.size()=1 2024-09-12T01:04:39.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.569__shadow:nfWkztXfJySiCF839d0ZUiSbVK-qUG-_.CL8L9_gadY_URMbLLlGMk-xr3tWYJ2E_0 2024-09-12T01:04:39.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13568830592289750348', time=2024-09-12T02:57:10.343996+0000, chain.objs.size()=1 2024-09-12T01:04:39.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.570__shadow:fRz84Y3uopxjsiGmK29gttfrguKB1J6_.j3-ttH4bQX84GUtkkngEUgitZz-y8Rj_0 2024-09-12T01:04:39.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6032871675993551900', time=2024-09-12T02:57:21.747125+0000, chain.objs.size()=1 2024-09-12T01:04:39.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.576__shadow:ZS7kjYt.9MTty6STPaZPMW-YHMO5pNZ_.rZKqxrUh0lvx7Idya_j251kbe9n8jDx_0 2024-09-12T01:04:39.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16041388469424765743', time=2024-09-12T02:57:29.166605+0000, chain.objs.size()=1 2024-09-12T01:04:39.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:phiZ5FAyTPGTZGq0fAVlsJxlaQlM5kt_.7rj0UFhChE_mr52BZQSmaTtKGjgn3R1_0 2024-09-12T01:04:39.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15609824255050434436', time=2024-09-12T02:57:42.847724+0000, chain.objs.size()=4 2024-09-12T01:04:39.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.578__multipart_testobj.2~mBAEY6QYs6Q4GPMjY-mAQ8Iasq1aml0.1 2024-09-12T01:04:39.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.578__multipart_testobj.2~mBAEY6QYs6Q4GPMjY-mAQ8Iasq1aml0.2 2024-09-12T01:04:39.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.578__multipart_testobj.2~mBAEY6QYs6Q4GPMjY-mAQ8Iasq1aml0.3 2024-09-12T01:04:39.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.578__multipart_testobj.2~mBAEY6QYs6Q4GPMjY-mAQ8Iasq1aml0.4 2024-09-12T01:04:39.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12355113628492926217', time=2024-09-12T03:00:57.729881+0000, chain.objs.size()=1 2024-09-12T01:04:39.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.655__shadow_.Xiy_Qyy_-u3YC7t-4aEl5KPcPqRtiTN_0 2024-09-12T01:04:39.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7053085927453002100', time=2024-09-12T03:01:05.477282+0000, chain.objs.size()=1 2024-09-12T01:04:39.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.663__shadow_.ENn4Sm3pRqJFEW3472XK3EhO5XPqXo7_0 2024-09-12T01:04:39.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10852813893786432005', time=2024-09-12T03:01:07.383084+0000, chain.objs.size()=1 2024-09-12T01:04:39.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.665__shadow_.QoT-6H8tr-D2nBaeF5wGKt5PrrTz1-p_0 2024-09-12T01:04:39.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12549958124883424014', time=2024-09-12T03:01:09.711281+0000, chain.objs.size()=1 2024-09-12T01:04:39.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.668__shadow_.j3_WzqPV4scGSijeHcTKMkW3IC4iouW_0 2024-09-12T01:04:39.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16008752694583480435', time=2024-09-12T03:01:23.479649+0000, chain.objs.size()=1 2024-09-12T01:04:39.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.691__shadow_.soh6HtmNdo4U2UROtLjnG6NB8z06gWF_0 2024-09-12T01:04:39.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7279581627709529712', time=2024-09-12T03:01:38.858768+0000, chain.objs.size()=1 2024-09-12T01:04:39.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.713__shadow:qqEE7P.5vyKQtMspQLE-c9UO1.DnICz_.bhrcQzCMC9Wj4OhaUat5CN1eTSYm4Ly_0 2024-09-12T01:04:39.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11205662058876364106', time=2024-09-12T03:02:17.853598+0000, chain.objs.size()=1 2024-09-12T01:04:39.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.739__shadow_.652Bjk9HvhLeEnVUnbQ5UDywNvDZK63_0 2024-09-12T01:04:39.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.034+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:39.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.038+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:04:39.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.038+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:39.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.038+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:39.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.042+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54392' 2024-09-12T01:04:39.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.042+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7535929839140081634', time=2024-09-12T02:48:29.133882+0000, chain.objs.size()=3 2024-09-12T01:04:39.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.042+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.158__shadow_.DR6mPkN8LKtLzosW9ZiH_ws84K29xdo_0 2024-09-12T01:04:39.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.042+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.158__shadow_.DR6mPkN8LKtLzosW9ZiH_ws84K29xdo_1 2024-09-12T01:04:39.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.042+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.158__shadow_.DR6mPkN8LKtLzosW9ZiH_ws84K29xdo_2 2024-09-12T01:04:39.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.042+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='_WMzLcjFJ57JaAG3Z_7ZdKkhZ3za26Y0', time=2024-09-12T02:48:35.687322+0000, chain.objs.size()=3 2024-09-12T01:04:39.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.042+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.161__shadow_.XpKBRXgUGASkopMIalwCWZ_ri2-UT4v_0 2024-09-12T01:04:39.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.042+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.161__shadow_.XpKBRXgUGASkopMIalwCWZ_ri2-UT4v_1 2024-09-12T01:04:39.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.042+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.161__shadow_.XpKBRXgUGASkopMIalwCWZ_ri2-UT4v_2 2024-09-12T01:04:39.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.042+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13061038416213498724', time=2024-09-12T02:50:51.787727+0000, chain.objs.size()=1 2024-09-12T01:04:39.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.042+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.242__shadow_.K1U5PuRop0YwmLDg7WX7syFtM5lFAO8_0 2024-09-12T01:04:39.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.042+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14618898686373505719', time=2024-09-12T02:50:53.005567+0000, chain.objs.size()=1 2024-09-12T01:04:39.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.042+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.243__shadow_.qzG3m7OImxgk17pJBzueXe9_C3yhGhz_0 2024-09-12T01:04:39.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.042+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2515841150350453647', time=2024-09-12T02:50:53.007573+0000, chain.objs.size()=1 2024-09-12T01:04:39.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.042+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.243__shadow_.svHMqiofmyG9YYRx69LAFAiP0M9smrB_0 2024-09-12T01:04:39.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.042+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3921765430588829902', time=2024-09-12T02:50:55.743549+0000, chain.objs.size()=1 2024-09-12T01:04:39.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.042+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.246__shadow_.AvAY5youFSL_GlHalakEM7mc26LNXvJ_0 2024-09-12T01:04:39.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.042+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17594544837412232211', time=2024-09-12T02:50:58.900474+0000, chain.objs.size()=1 2024-09-12T01:04:39.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.042+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.250__shadow_.9hiMiGqK3SMIDuriu8zU6X3XmTYfM_G_0 2024-09-12T01:04:39.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.042+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16813754009154611034', time=2024-09-12T02:51:06.284769+0000, chain.objs.size()=1 2024-09-12T01:04:39.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.042+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.260__shadow_.271oeExLS0QhW68PPH-U_g3GkczA5Mr_0 2024-09-12T01:04:39.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.046+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4099261932983832543', time=2024-09-12T02:51:26.767950+0000, chain.objs.size()=1 2024-09-12T01:04:39.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.o8c65ptqkVknN-HzixLy3Nj0loClDkY_0 2024-09-12T01:04:39.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.046+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16642440813404319643', time=2024-09-12T02:51:26.786454+0000, chain.objs.size()=1 2024-09-12T01:04:39.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.4JgKsk-RswQGaYkpLBjQJI48StxIxQD_0 2024-09-12T01:04:39.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.046+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8495896581719549525', time=2024-09-12T02:51:26.809262+0000, chain.objs.size()=1 2024-09-12T01:04:39.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.xGmuPFqzWfb1yQtupMFToR0GbwZnfwm_0 2024-09-12T01:04:39.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.046+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3346266396366145348', time=2024-09-12T02:51:26.810990+0000, chain.objs.size()=1 2024-09-12T01:04:39.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.JYdpAkmnF3AyGlUFFGI3EJvBHM5nhiW_0 2024-09-12T01:04:39.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.046+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5445810406988673209', time=2024-09-12T02:51:26.863239+0000, chain.objs.size()=1 2024-09-12T01:04:39.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.-geJ_L_ZyyRMX7iap_lS8piL-Qmm03o_0 2024-09-12T01:04:39.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.046+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14587894539426501587', time=2024-09-12T02:51:26.978521+0000, chain.objs.size()=1 2024-09-12T01:04:39.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_._HdDz9JL97Bui898V5dxMedHHtQI1H4_0 2024-09-12T01:04:39.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.046+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3031143560716406533', time=2024-09-12T02:51:27.075892+0000, chain.objs.size()=1 2024-09-12T01:04:39.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.0ZOYrfNsTGDIhDvlMvq5AQNrJFp2IAe_0 2024-09-12T01:04:39.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.046+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16134278921502545474', time=2024-09-12T02:51:27.214887+0000, chain.objs.size()=1 2024-09-12T01:04:39.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.rT15f-ajoWzp-ypZakVdySvf7XkeoKn_0 2024-09-12T01:04:39.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.046+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18184017940553504667', time=2024-09-12T02:51:27.242053+0000, chain.objs.size()=1 2024-09-12T01:04:39.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.03wVycEp0Nx_PesXlanrUFhqoAaklFM_0 2024-09-12T01:04:39.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.046+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10128733763570009480', time=2024-09-12T02:51:27.287251+0000, chain.objs.size()=1 2024-09-12T01:04:39.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.uVFRasScySKvqjZ-GaplWTFtNI24a8w_0 2024-09-12T01:04:39.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.046+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6681918593500145164', time=2024-09-12T02:51:27.299591+0000, chain.objs.size()=1 2024-09-12T01:04:39.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.b_aEcrxZxt9CQ-NTw3vne0Za3UULdKY_0 2024-09-12T01:04:39.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.046+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10716922871895365106', time=2024-09-12T02:51:27.416129+0000, chain.objs.size()=1 2024-09-12T01:04:39.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.mNK5mGJ9sEnj2UGL3OCk-e4P4XIE-zO_0 2024-09-12T01:04:39.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.046+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3660428798945720390', time=2024-09-12T02:51:27.450050+0000, chain.objs.size()=1 2024-09-12T01:04:39.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.qh05LBipiXkqpVkhsnhUhA-xYjzyiVj_0 2024-09-12T01:04:39.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.046+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.698991928255214790', time=2024-09-12T02:51:27.520713+0000, chain.objs.size()=1 2024-09-12T01:04:39.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.i4mC0oAVtVrpb2AlEx-OycbbiJrr_tv_0 2024-09-12T01:04:39.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.050+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8660014347419078989', time=2024-09-12T02:51:27.627223+0000, chain.objs.size()=1 2024-09-12T01:04:39.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.050+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.eAZqLZqijSIW3waij0N7STt-MjHukcU_0 2024-09-12T01:04:39.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.050+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15460798214142804877', time=2024-09-12T02:51:27.658161+0000, chain.objs.size()=1 2024-09-12T01:04:39.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.050+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.kkbPebyLaiJq68mrM0Z7W5Vb1E2AxIO_0 2024-09-12T01:04:39.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.050+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15553797394168519998', time=2024-09-12T02:51:27.722092+0000, chain.objs.size()=1 2024-09-12T01:04:39.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.050+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.tQh640sBAborgUVFyS-KWDAw6Itqldu_0 2024-09-12T01:04:39.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.050+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6684690286434982204', time=2024-09-12T02:51:27.738838+0000, chain.objs.size()=1 2024-09-12T01:04:39.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.050+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Q44Hm7KEbQJZ9uvD9_vLCmfdEfyDI1i_0 2024-09-12T01:04:39.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.050+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3181481926265928898', time=2024-09-12T02:51:27.901684+0000, chain.objs.size()=1 2024-09-12T01:04:39.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.050+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.I2kJGsnbz4l9J1beiyK5fp3hW-BbeY5_0 2024-09-12T01:04:39.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.050+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16147311837610036637', time=2024-09-12T02:51:27.951394+0000, chain.objs.size()=1 2024-09-12T01:04:39.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.050+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.FbKNvLSdYQ6uzBcO3EtQ7d0GHHANP34_0 2024-09-12T01:04:39.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.050+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3799723512417473576', time=2024-09-12T02:51:28.125184+0000, chain.objs.size()=1 2024-09-12T01:04:39.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.050+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.x9zxQDtyLKMA5A0DSdrpRARukVzm6q-_0 2024-09-12T01:04:39.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.050+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16159138075360420329', time=2024-09-12T02:51:28.142752+0000, chain.objs.size()=1 2024-09-12T01:04:39.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.050+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.3qLP4zBkMdIwyh32CdU7xMe4lPzcNEU_0 2024-09-12T01:04:39.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.050+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4329532692074417344', time=2024-09-12T02:51:28.215398+0000, chain.objs.size()=1 2024-09-12T01:04:39.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.050+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.S4m3pQKs0I5c2JxHL27falZeCxbBgyM_0 2024-09-12T01:04:39.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.050+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7088811897463827043', time=2024-09-12T02:51:28.372603+0000, chain.objs.size()=1 2024-09-12T01:04:39.052 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.050+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.quVJzX6TB1SNdjPz85wSted5xqrmT_R_0 2024-09-12T01:04:39.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.050+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.528694959784339759', time=2024-09-12T02:51:28.649002+0000, chain.objs.size()=1 2024-09-12T01:04:39.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.050+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.iYVw_CtPRPgFsaYm3WH8S2kbV3ydqfv_0 2024-09-12T01:04:39.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.050+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14900199736369194621', time=2024-09-12T02:51:28.669887+0000, chain.objs.size()=1 2024-09-12T01:04:39.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.050+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.2f4qYoFpVKOpYsnKq6rI90NnV3aJ0De_0 2024-09-12T01:04:39.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.050+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5564347220017933970', time=2024-09-12T02:51:30.788248+0000, chain.objs.size()=1 2024-09-12T01:04:39.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.050+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.265__shadow_.5CUXJbEfXdJuep2o-BBia3dlpzMqJCW_0 2024-09-12T01:04:39.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.050+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8486233939938195516', time=2024-09-12T02:51:31.499812+0000, chain.objs.size()=1 2024-09-12T01:04:39.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.050+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.266__shadow_.4WpQJB8qfb5rtNac3JButhmSwzteBFj_0 2024-09-12T01:04:39.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15261950057495028041', time=2024-09-12T02:51:41.676037+0000, chain.objs.size()=1 2024-09-12T01:04:39.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.280__shadow_.baZJKPGCeCdc8_owqfoaTjGyLA2YEMM_0 2024-09-12T01:04:39.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11967994025514076445', time=2024-09-12T02:51:43.965622+0000, chain.objs.size()=1 2024-09-12T01:04:39.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.283__shadow_.3-JXlG17KWA50rWaYCxswQf9D2g8var_0 2024-09-12T01:04:39.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9259529690964329512', time=2024-09-12T02:51:48.522258+0000, chain.objs.size()=1 2024-09-12T01:04:39.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.289__shadow_.QIzlALsm0vOlfxxt-OOYpYWuMkA_R4__0 2024-09-12T01:04:39.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1925330173125181785', time=2024-09-12T02:51:51.723547+0000, chain.objs.size()=1 2024-09-12T01:04:39.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.292__shadow_.CJuW98pzxWLij2r-7MIfamMZuFr6p4E_0 2024-09-12T01:04:39.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9020012288847642690', time=2024-09-12T02:52:02.125860+0000, chain.objs.size()=1 2024-09-12T01:04:39.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.305__shadow_.FkYlik5VBjaxqQrJm_zOGGuRncPQIhR_0 2024-09-12T01:04:39.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10788877393595564647', time=2024-09-12T02:52:10.450147+0000, chain.objs.size()=1 2024-09-12T01:04:39.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.315__shadow_.KM6NIYgjq2USGIsN_UrMwbEbLYul7bg_0 2024-09-12T01:04:39.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12254702567550773587', time=2024-09-12T02:52:34.821646+0000, chain.objs.size()=1 2024-09-12T01:04:39.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.e41v8lSoyKcpKbwIR7w86VmR_in8lLA_0 2024-09-12T01:04:39.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2400964384620989207', time=2024-09-12T02:52:34.823999+0000, chain.objs.size()=1 2024-09-12T01:04:39.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Ll4h1sVrRy27RydvfOT3yNpNWxP-QFR_0 2024-09-12T01:04:39.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10779239467396924215', time=2024-09-12T02:52:34.825912+0000, chain.objs.size()=1 2024-09-12T01:04:39.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.X4PJRwDb3JOfngpBPah2eraAqQwzZTU_0 2024-09-12T01:04:39.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5323610196558926253', time=2024-09-12T02:52:35.074690+0000, chain.objs.size()=1 2024-09-12T01:04:39.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.u42Ma3OGXApnMy4j4RIwMk-w9mgKKDp_0 2024-09-12T01:04:39.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14357623200510794476', time=2024-09-12T02:52:35.085435+0000, chain.objs.size()=1 2024-09-12T01:04:39.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.yHBAADUJ73Xh-CtAerla-Ks5VmiTJA8_0 2024-09-12T01:04:39.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6282407397506620402', time=2024-09-12T02:52:35.119106+0000, chain.objs.size()=1 2024-09-12T01:04:39.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.0x1o6vKePQq7stmSImu4ngLHgCbf0I4_0 2024-09-12T01:04:39.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17526892860787376149', time=2024-09-12T02:52:35.137935+0000, chain.objs.size()=1 2024-09-12T01:04:39.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.SQWL3I_uyzfFYKvFXE6rsgbJ7LoD2bg_0 2024-09-12T01:04:39.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16856863897478474973', time=2024-09-12T02:52:35.172202+0000, chain.objs.size()=1 2024-09-12T01:04:39.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.SwD2hgPsnrDHpaUyDVbOv59se6ttunR_0 2024-09-12T01:04:39.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14558080200073062964', time=2024-09-12T02:52:35.351362+0000, chain.objs.size()=1 2024-09-12T01:04:39.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.4csaOaZtm39lv9wxUc7ZAHHohS14Md4_0 2024-09-12T01:04:39.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9319206671251429246', time=2024-09-12T02:52:35.396273+0000, chain.objs.size()=1 2024-09-12T01:04:39.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.toKzze6NIJbrYKmHrr3vWOS1MV6hRux_0 2024-09-12T01:04:39.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14243599752676365010', time=2024-09-12T02:52:35.423060+0000, chain.objs.size()=1 2024-09-12T01:04:39.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.5fubRi0ZWZ4FGSlZs_RS-IvXWh7Q7ni_0 2024-09-12T01:04:39.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8984467653775085873', time=2024-09-12T02:52:35.614325+0000, chain.objs.size()=1 2024-09-12T01:04:39.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.hks3wxZuv_JKuFZS664XX3pP-2AtCSX_0 2024-09-12T01:04:39.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7716532406732971580', time=2024-09-12T02:52:35.616699+0000, chain.objs.size()=1 2024-09-12T01:04:39.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_._R6EY0EWtyLPKMH22CEyyJdjaz1Bhms_0 2024-09-12T01:04:39.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.728181357861799519', time=2024-09-12T02:52:35.655743+0000, chain.objs.size()=1 2024-09-12T01:04:39.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.L2hQvU037YB0X-dp-wJajFcLaWjuSrE_0 2024-09-12T01:04:39.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.058+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1424274111112769024', time=2024-09-12T02:52:35.775461+0000, chain.objs.size()=1 2024-09-12T01:04:39.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.058+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.69miwuoEH5VHd0B9SJNkiTvoacxwUxE_0 2024-09-12T01:04:39.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.058+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1874034229971523419', time=2024-09-12T02:52:35.818460+0000, chain.objs.size()=1 2024-09-12T01:04:39.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.058+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.4sszsgr0-D7UqRLsHw-01HdrE3MY0xe_0 2024-09-12T01:04:39.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.058+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2270723389177091462', time=2024-09-12T02:52:35.830307+0000, chain.objs.size()=1 2024-09-12T01:04:39.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.058+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.flkbaLo5PGmN1P_KD2lcTSD8ZdWwL9f_0 2024-09-12T01:04:39.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.058+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.660349551696509690', time=2024-09-12T02:52:35.880151+0000, chain.objs.size()=1 2024-09-12T01:04:39.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.058+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.xNTmv7d94wyNu49eZUCLC9FSqNv2N5J_0 2024-09-12T01:04:39.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.058+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2188851935871880470', time=2024-09-12T02:52:36.298865+0000, chain.objs.size()=1 2024-09-12T01:04:39.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.058+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.R2O7UROP9G8XWXCtvh8HUzn6eBhI1-t_0 2024-09-12T01:04:39.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.058+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10301693181627660635', time=2024-09-12T02:52:36.317806+0000, chain.objs.size()=1 2024-09-12T01:04:39.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.058+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.D8p0VUHk6ZFHSyeRHk8UR9HtpUqfme4_0 2024-09-12T01:04:39.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.058+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10855278318061436093', time=2024-09-12T02:52:36.350699+0000, chain.objs.size()=1 2024-09-12T01:04:39.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.058+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.-rB86Cl8vaMk8abHbM0gq_AQceUgiC6_0 2024-09-12T01:04:39.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.058+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17551544289073932767', time=2024-09-12T02:52:36.513113+0000, chain.objs.size()=1 2024-09-12T01:04:39.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.058+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.cGvMN7nyQ3GVi-jRhgw6gHe_Lq0bt10_0 2024-09-12T01:04:39.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.058+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3881084728205036774', time=2024-09-12T02:52:36.535500+0000, chain.objs.size()=1 2024-09-12T01:04:39.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.058+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.rPx1drWCFdcdzSFIGXkYFrvr1YPYmdI_0 2024-09-12T01:04:39.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.058+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9368142865744664103', time=2024-09-12T02:52:36.596594+0000, chain.objs.size()=1 2024-09-12T01:04:39.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.058+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.vyUDH8hzkObL-pB2S9DcRESWa5l5P7R_0 2024-09-12T01:04:39.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.058+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14931368051135845597', time=2024-09-12T02:52:36.607950+0000, chain.objs.size()=1 2024-09-12T01:04:39.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.058+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.A11vlxc057_slY-nU957OJIDXXJ6lSY_0 2024-09-12T01:04:39.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.062+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1732310811599800894', time=2024-09-12T02:52:36.611262+0000, chain.objs.size()=1 2024-09-12T01:04:39.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.062+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ANl9AkJ2E3ubPdjfSMkksEGpDiF9m6R_0 2024-09-12T01:04:39.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.062+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10172105301201583292', time=2024-09-12T02:52:36.633848+0000, chain.objs.size()=1 2024-09-12T01:04:39.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.062+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.SoRMTVtkQCJiNOD-y4lO6BaEwEzCNz-_0 2024-09-12T01:04:39.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.062+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1666431953084089172', time=2024-09-12T02:52:36.642497+0000, chain.objs.size()=1 2024-09-12T01:04:39.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.062+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.aPzasx5gTZIWeNPQVgSI2Ka5--jdpLI_0 2024-09-12T01:04:39.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10419547959250517249', time=2024-09-12T02:52:36.797774+0000, chain.objs.size()=1 2024-09-12T01:04:39.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.a3IofYEXNG3hBh-EVHDDyI8MzDaT-nT_0 2024-09-12T01:04:39.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8890094082049368534', time=2024-09-12T02:52:36.826303+0000, chain.objs.size()=1 2024-09-12T01:04:39.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Ty1jE3_EIXPkYYJd7uxh-8XUbDOHWdq_0 2024-09-12T01:04:39.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8309449761296002940', time=2024-09-12T02:52:36.870531+0000, chain.objs.size()=1 2024-09-12T01:04:39.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.vYu6h3B6ABQTvhyWCrsIbvgqP-NHmGU_0 2024-09-12T01:04:39.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4279789808363466696', time=2024-09-12T02:52:36.871325+0000, chain.objs.size()=1 2024-09-12T01:04:39.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.jx38ZiYOPPi56nqFiE7jhzbC9zykS0G_0 2024-09-12T01:04:39.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3901705343238569815', time=2024-09-12T02:52:36.990811+0000, chain.objs.size()=1 2024-09-12T01:04:39.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.EXK3cGicR9mIivMZhqLHafAfTGF9Wre_0 2024-09-12T01:04:39.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6986721407414809910', time=2024-09-12T02:52:37.018200+0000, chain.objs.size()=1 2024-09-12T01:04:39.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.mK8T8szkOOzMiSILzWLc8F-yqQGJC5Y_0 2024-09-12T01:04:39.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1498083751079410257', time=2024-09-12T02:52:37.029555+0000, chain.objs.size()=1 2024-09-12T01:04:39.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.rshKWBOUJmUDeX0MYtDqwpYz_NBmHXI_0 2024-09-12T01:04:39.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8186241172700978533', time=2024-09-12T02:52:37.048152+0000, chain.objs.size()=1 2024-09-12T01:04:39.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.WpdOdIeYrWvXMLjsIo0jHusga7ZS19-_0 2024-09-12T01:04:39.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11070652542971295065', time=2024-09-12T02:52:37.056640+0000, chain.objs.size()=1 2024-09-12T01:04:39.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.M6NARD5tWtnnssh9B8S096Cnken0ar__0 2024-09-12T01:04:39.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6326508314339602005', time=2024-09-12T02:52:37.060573+0000, chain.objs.size()=1 2024-09-12T01:04:39.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.aspxtrWOgBKnACbMC9MTOLD7AaBe6jH_0 2024-09-12T01:04:39.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16249221950506004488', time=2024-09-12T02:52:37.090142+0000, chain.objs.size()=1 2024-09-12T01:04:39.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.9XAlg5XMotKoiTga-3K4FiAZ9vO4QJM_0 2024-09-12T01:04:39.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1741420418326962466', time=2024-09-12T02:52:56.932276+0000, chain.objs.size()=1 2024-09-12T01:04:39.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.0h2khwLzkfD3gGbPOXMJHMAZpwQwsEF_0 2024-09-12T01:04:39.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14530293135507364425', time=2024-09-12T02:52:56.994239+0000, chain.objs.size()=1 2024-09-12T01:04:39.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.9doRthLTb68LA0i-rwP9sGY2ii7nZEy_0 2024-09-12T01:04:39.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9576545002798390407', time=2024-09-12T02:52:57.047807+0000, chain.objs.size()=1 2024-09-12T01:04:39.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.5Uxmv-gpmuUrJbSC1SUtCeSSDB9MoDe_0 2024-09-12T01:04:39.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8129102965302083006', time=2024-09-12T02:52:57.209692+0000, chain.objs.size()=1 2024-09-12T01:04:39.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.7dtsyEibR66yyd659FcB25kQRv3MDxL_0 2024-09-12T01:04:39.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11837792735206071023', time=2024-09-12T02:52:57.211822+0000, chain.objs.size()=1 2024-09-12T01:04:39.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.066+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.iMKnWOky_JKzv7vmYgQ81ZHbkVUNJpp_0 2024-09-12T01:04:39.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.070+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14903772277320515292', time=2024-09-12T02:52:57.213308+0000, chain.objs.size()=1 2024-09-12T01:04:39.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.070+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.C_-kPPRntNWFd-eTi8swe4Jpu2zBqnN_0 2024-09-12T01:04:39.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.070+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15135511922426052023', time=2024-09-12T02:52:57.237547+0000, chain.objs.size()=1 2024-09-12T01:04:39.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.070+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.V3JvbceMcOQjkYtEmU3WlgXQCdiYnZL_0 2024-09-12T01:04:39.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.070+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8960149781701407380', time=2024-09-12T02:52:57.246544+0000, chain.objs.size()=1 2024-09-12T01:04:39.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.070+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.7yDG8gBarAem2hSDuh-s6JG_r027-iq_0 2024-09-12T01:04:39.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.070+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13436732363291481512', time=2024-09-12T02:52:57.267417+0000, chain.objs.size()=1 2024-09-12T01:04:39.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.070+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.R_3iDTQ8PxMwgBLxSLXkvb3OUUATM1B_0 2024-09-12T01:04:39.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.070+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7127525263945006964', time=2024-09-12T02:52:57.284899+0000, chain.objs.size()=1 2024-09-12T01:04:39.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.070+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.nYgouMSVFxpBwLh97eW2P1vHOJYKt5c_0 2024-09-12T01:04:39.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.070+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5930737499342819388', time=2024-09-12T02:52:57.415244+0000, chain.objs.size()=1 2024-09-12T01:04:39.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.070+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.gSFVhJ0kjUsNtrdbG4bmM6iaxV4zhzO_0 2024-09-12T01:04:39.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.070+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15553543578942462669', time=2024-09-12T02:52:57.442483+0000, chain.objs.size()=1 2024-09-12T01:04:39.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.070+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.A9HhIlkCs8iRPbSb476VXfOryq5lTZE_0 2024-09-12T01:04:39.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.070+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3157413144917311134', time=2024-09-12T02:52:57.468805+0000, chain.objs.size()=1 2024-09-12T01:04:39.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.070+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.NWR1vKJxkGKWdq7_Viju72eVXxTX8MA_0 2024-09-12T01:04:39.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.070+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4017673299045797098', time=2024-09-12T02:52:57.483263+0000, chain.objs.size()=1 2024-09-12T01:04:39.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.070+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.PKa37-KgRsSA0rAd-a0Pspw79stoKy7_0 2024-09-12T01:04:39.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.070+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15146310465244583529', time=2024-09-12T02:52:57.667829+0000, chain.objs.size()=1 2024-09-12T01:04:39.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.070+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.-0QmmK867sgHc2XDF-oDH9Q6Nbf0oSu_0 2024-09-12T01:04:39.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.070+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5128036877169637992', time=2024-09-12T02:52:57.711670+0000, chain.objs.size()=1 2024-09-12T01:04:39.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.070+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.E3xKpTmnwUoBLROXDchikecB2QSgUwK_0 2024-09-12T01:04:39.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.070+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14779067117134715685', time=2024-09-12T02:52:57.717958+0000, chain.objs.size()=1 2024-09-12T01:04:39.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.070+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.iqcXcy-3hemC30XOYDSjY9XbnlhYqdx_0 2024-09-12T01:04:39.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.070+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18140029782526825541', time=2024-09-12T02:52:57.883063+0000, chain.objs.size()=1 2024-09-12T01:04:39.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.070+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.nHIolpUvYSHU36z7n2XJMRY0Q_E3qbC_0 2024-09-12T01:04:39.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.070+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11594287100475359515', time=2024-09-12T02:52:57.892251+0000, chain.objs.size()=1 2024-09-12T01:04:39.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.070+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.WDxxWfw56PEuWftreenFNWQ_Ho3B24v_0 2024-09-12T01:04:39.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/54392 2024-09-12T01:04:39.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-12T01:04:39.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12262909324284934934', time=2024-09-12T02:52:57.910069+0000, chain.objs.size()=1 2024-09-12T01:04:39.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Ws83-SLkd27roT1-IgBDGeUjTVfdmEI_0 2024-09-12T01:04:39.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1845130662740256138', time=2024-09-12T02:52:57.975579+0000, chain.objs.size()=1 2024-09-12T01:04:39.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.TrNRSE9CWM4kfdx0UVlhNKAMhPdokbk_0 2024-09-12T01:04:39.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4750635699443926163', time=2024-09-12T02:52:58.116322+0000, chain.objs.size()=1 2024-09-12T01:04:39.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.1trpxHxvvl7rug6dbFg3jWuecir34NG_0 2024-09-12T01:04:39.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2622852274760246231', time=2024-09-12T02:52:58.176180+0000, chain.objs.size()=1 2024-09-12T01:04:39.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ekDOK1sW_Vr0O-1eLXOa8F4xHRRSxZN_0 2024-09-12T01:04:39.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2719138532797048833', time=2024-09-12T02:52:58.200372+0000, chain.objs.size()=1 2024-09-12T01:04:39.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.HlXw3VGoC2mnOitfYw1QsbrvyIDbhyW_0 2024-09-12T01:04:39.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7641685758125013500', time=2024-09-12T02:52:58.392043+0000, chain.objs.size()=1 2024-09-12T01:04:39.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.4HbuDHPRU8zXpffE-beT1Y2Kj93pK1t_0 2024-09-12T01:04:39.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11425291652571615053', time=2024-09-12T02:52:58.442070+0000, chain.objs.size()=1 2024-09-12T01:04:39.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.c5CIGf4yQFKpynXJmkkZ5ZMu7bzq0GH_0 2024-09-12T01:04:39.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16766071050828304688', time=2024-09-12T02:52:58.491866+0000, chain.objs.size()=1 2024-09-12T01:04:39.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.DJAfb5StM9gDB9GaAHVbgs-nDpYNYyt_0 2024-09-12T01:04:39.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10256236371663595762', time=2024-09-12T02:52:58.593617+0000, chain.objs.size()=1 2024-09-12T01:04:39.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.1LLZmsQBp6w7CDwkVBO7bOHoK62QpYp_0 2024-09-12T01:04:39.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16753178237650367245', time=2024-09-12T02:52:58.614182+0000, chain.objs.size()=1 2024-09-12T01:04:39.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.SG6EmUS6LKTZMg9AMkHi3pXb9Vns6gT_0 2024-09-12T01:04:39.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7919117029484164742', time=2024-09-12T02:52:58.632937+0000, chain.objs.size()=1 2024-09-12T01:04:39.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Nuh_Qnf_JoTXdhxSO25VYl6V1DKv-ci_0 2024-09-12T01:04:39.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3574309634841716015', time=2024-09-12T02:52:58.690453+0000, chain.objs.size()=1 2024-09-12T01:04:39.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.EEcJ45yivLWLfPaM2ZDpYF2ArjU2zCA_0 2024-09-12T01:04:39.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.078+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4093213029802489557', time=2024-09-12T02:53:32.090341+0000, chain.objs.size()=1 2024-09-12T01:04:39.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.078+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.375__shadow_.ezOe7GG1rHz20x3aglFwvabT852_PJx_0 2024-09-12T01:04:39.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.078+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17586057423843851488', time=2024-09-12T02:53:43.473443+0000, chain.objs.size()=1 2024-09-12T01:04:39.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.078+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.390__shadow_.o5PuWNLUPNHMx-xP4cjCJSS0J5fefyh_0 2024-09-12T01:04:39.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.078+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.503707606591905357', time=2024-09-12T02:53:43.475263+0000, chain.objs.size()=1 2024-09-12T01:04:39.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.078+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.390__shadow_.kpqtvDdsmPnputSA-toPvFMlbMkOqqF_0 2024-09-12T01:04:39.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.078+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16081551018604241319', time=2024-09-12T02:54:23.327173+0000, chain.objs.size()=1 2024-09-12T01:04:39.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.078+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.443__shadow_.qGyTbdXcZZGyb5w_NaqoeWBn6VDyCRA_0 2024-09-12T01:04:39.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.078+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6268837080148234642', time=2024-09-12T02:54:24.372146+0000, chain.objs.size()=1 2024-09-12T01:04:39.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.078+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.444__shadow_.f5AORKwQ0NUduQhjCKt9SO8pv1sZHRk_0 2024-09-12T01:04:39.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.078+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.894295575275100770', time=2024-09-12T02:55:07.268650+0000, chain.objs.size()=1 2024-09-12T01:04:39.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.078+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.503__shadow:6LMeYfVzuD7PUiSwyt-9RW46Hh57mqn_.UcslrmdoBCcU7pOGIUMlA4mj_NOCVe1_0 2024-09-12T01:04:39.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.078+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11834491749982049914', time=2024-09-12T02:55:14.348910+0000, chain.objs.size()=1 2024-09-12T01:04:39.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.078+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.512__shadow_.YJL672mhiMjlcJd_jF3i0UKvo-0sh4A_0 2024-09-12T01:04:39.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.078+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10624310508241262963', time=2024-09-12T02:55:51.777115+0000, chain.objs.size()=1 2024-09-12T01:04:39.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.078+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.524__shadow_.JJXeh8RI4UuJWFkDfNZu4A8FeHJduYe_0 2024-09-12T01:04:39.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.078+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~DH3quvM8M2mIO-NwzMC3i8G9sEijrFb', time=2024-09-12T02:56:01.958504+0000, chain.objs.size()=2 2024-09-12T01:04:39.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.078+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.535__multipart_mymultipart.2~DH3quvM8M2mIO-NwzMC3i8G9sEijrFb.3 2024-09-12T01:04:39.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.078+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.535__shadow_mymultipart.2~DH3quvM8M2mIO-NwzMC3i8G9sEijrFb.3_1 2024-09-12T01:04:39.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.078+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5703656431265262165', time=2024-09-12T02:56:50.930031+0000, chain.objs.size()=1 2024-09-12T01:04:39.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.078+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.561__multipart_mymultipart.2~X2QMLgCuZ1wkfNbaj5Hki4t5Me4GPJj.1 2024-09-12T01:04:39.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.078+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16473930945418038435', time=2024-09-12T02:56:57.012989+0000, chain.objs.size()=3 2024-09-12T01:04:39.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.078+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.563__shadow_.XxO-B3tOFoJJjO48lBq8p9Eb7xPeeNa_0 2024-09-12T01:04:39.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.082+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.563__shadow_.XxO-B3tOFoJJjO48lBq8p9Eb7xPeeNa_1 2024-09-12T01:04:39.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.082+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.563__shadow_.XxO-B3tOFoJJjO48lBq8p9Eb7xPeeNa_2 2024-09-12T01:04:39.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.082+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10365881633014192118', time=2024-09-12T02:57:01.551745+0000, chain.objs.size()=1 2024-09-12T01:04:39.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.082+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.569__shadow:W2kSUAdF0A1aeVLhYVbtXtX33J.adTx_.tNPz9FfxGDbPNUqlEWaBA4vhOzpmuMV_0 2024-09-12T01:04:39.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.082+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13608603271351951974', time=2024-09-12T02:57:07.594746+0000, chain.objs.size()=1 2024-09-12T01:04:39.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.082+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.569__shadow:Ib-9eArbRNm6qE4woR1EbH.Rc6FTAk-_.EkdnyO-K8e0fOt4WM2fOkDbzHLToxKo_0 2024-09-12T01:04:39.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.082+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7775397346231209841', time=2024-09-12T02:57:13.186693+0000, chain.objs.size()=1 2024-09-12T01:04:39.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.082+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.573__shadow_.QO69yNDzhk3sYcHev_BIenlrFRV47ww_0 2024-09-12T01:04:39.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.082+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9417064910357414143', time=2024-09-12T02:57:15.355229+0000, chain.objs.size()=1 2024-09-12T01:04:39.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.082+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.574__shadow:nFyYqFxLmsjcKcsiKPlm9gICw89a0F._.LSra78O6tKwWFZrJB0xXk2Huy_wHAlm_0 2024-09-12T01:04:39.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.082+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12333996230032066621', time=2024-09-12T02:57:31.952580+0000, chain.objs.size()=1 2024-09-12T01:04:39.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.082+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:879p7WyHzWMQ8tyD4vqqAcVCJvrSE6S_.806b_fg7avHNLfigURPHKH_h2sL8paK_0 2024-09-12T01:04:39.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.082+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1821883100597419163', time=2024-09-12T02:57:37.867647+0000, chain.objs.size()=1 2024-09-12T01:04:39.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.082+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:T0SHtcC-3i7za6LSFsMw2bFVDn8RSQy_.noQwFkl-tVSQdNx2c6XUCUVW5zFVCY3_0 2024-09-12T01:04:39.084 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.082+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:39.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.086+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:04:39.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.086+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:39.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.086+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:39.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53640' 2024-09-12T01:04:39.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8292102589793181283', time=2024-09-12T02:48:32.430891+0000, chain.objs.size()=3 2024-09-12T01:04:39.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.160__shadow_.3lBtmDSae_H7qqZNdIcD91bPGQt4wXf_0 2024-09-12T01:04:39.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.160__shadow_.3lBtmDSae_H7qqZNdIcD91bPGQt4wXf_1 2024-09-12T01:04:39.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.160__shadow_.3lBtmDSae_H7qqZNdIcD91bPGQt4wXf_2 2024-09-12T01:04:39.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6297014446478781378', time=2024-09-12T02:50:41.080607+0000, chain.objs.size()=1 2024-09-12T01:04:39.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.228__shadow_.ls22szGbK8v5LrKabL3Y6-cvti0WFI4_0 2024-09-12T01:04:39.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.627756844976809297', time=2024-09-12T02:50:47.634155+0000, chain.objs.size()=1 2024-09-12T01:04:39.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.237__shadow_.w_TevOLVXL9GDFj6tvmClFKEslBedlt_0 2024-09-12T01:04:39.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9870401001873229909', time=2024-09-12T02:50:48.900801+0000, chain.objs.size()=1 2024-09-12T01:04:39.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.238__shadow_.tfD4crRorLWZxmxiS1-jGw8xTrmoTEC_0 2024-09-12T01:04:39.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4217488148727558202', time=2024-09-12T02:50:58.900681+0000, chain.objs.size()=1 2024-09-12T01:04:39.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.250__shadow_.MYZ27bnxPY6K06s7d22wwn7dMkedeZE_0 2024-09-12T01:04:39.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15080299827511073915', time=2024-09-12T02:51:03.338018+0000, chain.objs.size()=1 2024-09-12T01:04:39.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.256__shadow_.B5AgWIzc-nEyjxMRq6nSD8ykLoBAPHp_0 2024-09-12T01:04:39.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8497082979082395670', time=2024-09-12T02:51:04.751630+0000, chain.objs.size()=1 2024-09-12T01:04:39.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.258__shadow_.mTJ4vJ1plojFIdr13pKZ4oNjtz1ke-R_0 2024-09-12T01:04:39.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11863239116620350981', time=2024-09-12T02:51:26.742670+0000, chain.objs.size()=1 2024-09-12T01:04:39.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.7yUl8iao7Y0KKFRhNBMDhl2O3nXLf5S_0 2024-09-12T01:04:39.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15410290352115437057', time=2024-09-12T02:51:26.811758+0000, chain.objs.size()=1 2024-09-12T01:04:39.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.BN7s-HkZW5eazlUw-S1xSrZEEAGo7qn_0 2024-09-12T01:04:39.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8630963970614343269', time=2024-09-12T02:51:26.846100+0000, chain.objs.size()=1 2024-09-12T01:04:39.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.uL3kv2J0QEdJ5UiJJCeh-UzHwJ90PQg_0 2024-09-12T01:04:39.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14746492717856377117', time=2024-09-12T02:51:26.868773+0000, chain.objs.size()=1 2024-09-12T01:04:39.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.zk8kq3xKOh_aC6D-ScaAgraVWZTrvcx_0 2024-09-12T01:04:39.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7468479892915359259', time=2024-09-12T02:51:26.879039+0000, chain.objs.size()=1 2024-09-12T01:04:39.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.XIV7zFaEc32ylzn27B3xc3okT7i6afm_0 2024-09-12T01:04:39.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1707626032631209186', time=2024-09-12T02:51:27.081753+0000, chain.objs.size()=1 2024-09-12T01:04:39.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.2yoLffbKj3Z_BMyRpPuMP0nKcDdRFQi_0 2024-09-12T01:04:39.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14148595305447535343', time=2024-09-12T02:51:27.201240+0000, chain.objs.size()=1 2024-09-12T01:04:39.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.78WysHeR9IG99SYgs3vML9h4nmWTdF8_0 2024-09-12T01:04:39.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13683863945162262542', time=2024-09-12T02:51:27.205650+0000, chain.objs.size()=1 2024-09-12T01:04:39.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.cKLkCHnaU1v5btOzCcvNnl6VK3MQfzT_0 2024-09-12T01:04:39.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12399921691455108896', time=2024-09-12T02:51:27.266001+0000, chain.objs.size()=1 2024-09-12T01:04:39.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.uLZGWPlKaFoBNEP3hIFkbLPLB9CpkCJ_0 2024-09-12T01:04:39.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13805736782032952366', time=2024-09-12T02:51:27.276575+0000, chain.objs.size()=1 2024-09-12T01:04:39.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.BmJzFWVkZgTD8yLOE_eLVZOUg8rHVZd_0 2024-09-12T01:04:39.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15441775590703957673', time=2024-09-12T02:51:27.443359+0000, chain.objs.size()=1 2024-09-12T01:04:39.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.xD2JZSQOZ9Nc3pvnjNQk25O-W_Ac1DT_0 2024-09-12T01:04:39.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12613020643929880826', time=2024-09-12T02:51:27.457009+0000, chain.objs.size()=1 2024-09-12T01:04:39.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.UrNJfzvr0XTQjU1J2R-zj5KPwq6BmVD_0 2024-09-12T01:04:39.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8245717748245787501', time=2024-09-12T02:51:27.488831+0000, chain.objs.size()=1 2024-09-12T01:04:39.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.kCwZBtYKZC3lofo9OVdgANDzBglqryt_0 2024-09-12T01:04:39.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17647234684455008753', time=2024-09-12T02:51:27.497220+0000, chain.objs.size()=1 2024-09-12T01:04:39.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.090+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.fEWcpd33m4ku1Ij_dnk947oGOk50XaQ_0 2024-09-12T01:04:39.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.094+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17132178858681087945', time=2024-09-12T02:51:27.510886+0000, chain.objs.size()=1 2024-09-12T01:04:39.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.094+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ao4en6GcSxnvQ5ND9j6GL_1pyuBwFV-_0 2024-09-12T01:04:39.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.094+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14197839732828323355', time=2024-09-12T02:51:27.513132+0000, chain.objs.size()=1 2024-09-12T01:04:39.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.094+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.TNPw_XKj0rdwUmBG3VwS9_LVsgdms9U_0 2024-09-12T01:04:39.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.094+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5949328631958113049', time=2024-09-12T02:51:27.525820+0000, chain.objs.size()=1 2024-09-12T01:04:39.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.094+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.f7G2gQihnUo9jf1Bb6Jvn1TW0nklzut_0 2024-09-12T01:04:39.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.094+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2784752772011924183', time=2024-09-12T02:51:27.625410+0000, chain.objs.size()=1 2024-09-12T01:04:39.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.094+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.4Feu1NYHmNo5M4tudGFO4sM8Ul7PV0Q_0 2024-09-12T01:04:39.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.094+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11074330738797402883', time=2024-09-12T02:51:27.651901+0000, chain.objs.size()=1 2024-09-12T01:04:39.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.094+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.-LbcLdsI3wRqWKrTX9hPTfg6lVY9qKV_0 2024-09-12T01:04:39.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.094+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7113798477556098365', time=2024-09-12T02:51:27.665516+0000, chain.objs.size()=1 2024-09-12T01:04:39.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.094+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.qntUKpeFCrrEFdb1Uk956O6AZ1hCilW_0 2024-09-12T01:04:39.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.094+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10113892370758415332', time=2024-09-12T02:51:27.676678+0000, chain.objs.size()=1 2024-09-12T01:04:39.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.094+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.dOO2JPZKGIFqUeOBa-QN9DiEnCM1fvH_0 2024-09-12T01:04:39.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.094+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11992992947291451158', time=2024-09-12T02:51:27.701992+0000, chain.objs.size()=1 2024-09-12T01:04:39.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.094+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.VIfIu7TtgcV9osoWSOIQBhr1Va9jVzZ_0 2024-09-12T01:04:39.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.094+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14825591436689031364', time=2024-09-12T02:51:27.843491+0000, chain.objs.size()=1 2024-09-12T01:04:39.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.094+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.6OQSEzyWNqndf5TzVthsgRZ2YtJngvi_0 2024-09-12T01:04:39.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.094+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18375496751826333371', time=2024-09-12T02:51:27.905664+0000, chain.objs.size()=1 2024-09-12T01:04:39.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.094+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.cI75NQYsQjl3gRIvsw78KQ1D2WY1j0__0 2024-09-12T01:04:39.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.094+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18141931907430682950', time=2024-09-12T02:51:27.936787+0000, chain.objs.size()=1 2024-09-12T01:04:39.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.094+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.4muG0vHv85lKiuOW7j3hiUJRONU8QHq_0 2024-09-12T01:04:39.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.094+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11572873136496924719', time=2024-09-12T02:51:27.961388+0000, chain.objs.size()=1 2024-09-12T01:04:39.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.094+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.FEorSHQ02RPtYXK-lKIkG-9dq0llPFm_0 2024-09-12T01:04:39.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.094+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2633857886014974162', time=2024-09-12T02:51:27.970732+0000, chain.objs.size()=1 2024-09-12T01:04:39.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.094+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.UMG2c5sonFa8c2LlybrLK5YdkKqNeym_0 2024-09-12T01:04:39.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.098+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6670150484292023276', time=2024-09-12T02:51:28.221203+0000, chain.objs.size()=1 2024-09-12T01:04:39.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.098+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.LVyP7dskicCvAf36lZiwprNViYFKApS_0 2024-09-12T01:04:39.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.098+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9530880533835487728', time=2024-09-12T02:51:28.226427+0000, chain.objs.size()=1 2024-09-12T01:04:39.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.098+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.AWj2Vm0AJj1EctYrlTaVgeDIVpsfl5S_0 2024-09-12T01:04:39.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.098+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1019647753724934712', time=2024-09-12T02:51:28.246753+0000, chain.objs.size()=1 2024-09-12T01:04:39.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.098+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.MQTFaIOGhbfNylfXsJmJqavrZRJukWm_0 2024-09-12T01:04:39.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.098+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16898103693015255257', time=2024-09-12T02:51:28.251055+0000, chain.objs.size()=1 2024-09-12T01:04:39.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.098+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Q3RBQPAH1tdgXCj-n5Dw3M92ERifu21_0 2024-09-12T01:04:39.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.098+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13088083905922700079', time=2024-09-12T02:51:28.661181+0000, chain.objs.size()=1 2024-09-12T01:04:39.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.098+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ET0BIDEgT6j71INgsbnRVhUJppxroAH_0 2024-09-12T01:04:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.098+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5302161000688059539', time=2024-09-12T02:51:30.787020+0000, chain.objs.size()=1 2024-09-12T01:04:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.098+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.265__shadow_.ohdkGdl0A0tEXuWY1DZBmVpCce7XbYJ_0 2024-09-12T01:04:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.098+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3723810318446984893', time=2024-09-12T02:51:43.965569+0000, chain.objs.size()=1 2024-09-12T01:04:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.098+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.283__shadow_.tqV0Izp3rSjH8JKZaNLrgQDLgqKnuLW_0 2024-09-12T01:04:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.098+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15710822811986548794', time=2024-09-12T02:51:51.715031+0000, chain.objs.size()=1 2024-09-12T01:04:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.098+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.292__shadow_.ObClYnq_yg1PPQY3BeXIBQUy6R9a2Oo_0 2024-09-12T01:04:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.098+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3273556862899131008', time=2024-09-12T02:51:58.472591+0000, chain.objs.size()=1 2024-09-12T01:04:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.098+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.300__shadow_.7zvYStZGKu9lasXOZIo36Hox4V6oqV1_0 2024-09-12T01:04:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.098+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7817899030214243773', time=2024-09-12T02:52:35.118305+0000, chain.objs.size()=1 2024-09-12T01:04:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.098+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.mDcf_CXO30SC9StFJwSNLjFTpjdzVHj_0 2024-09-12T01:04:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.098+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14923162988779541667', time=2024-09-12T02:52:35.124002+0000, chain.objs.size()=1 2024-09-12T01:04:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.098+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.nPCVBNtTDHv6RCj-ZtN7fUWLz_6o9V2_0 2024-09-12T01:04:39.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.098+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10444442418015856230', time=2024-09-12T02:52:35.150160+0000, chain.objs.size()=1 2024-09-12T01:04:39.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.098+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.dJowtAi1jizLIzEqbDf6vN1pWniIuGW_0 2024-09-12T01:04:39.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13376611778130789668', time=2024-09-12T02:52:35.183609+0000, chain.objs.size()=1 2024-09-12T01:04:39.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.2ck2Ory5RdlPcc4tWqnsuW2_PZVR0Eo_0 2024-09-12T01:04:39.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9223538534712548605', time=2024-09-12T02:52:35.307931+0000, chain.objs.size()=1 2024-09-12T01:04:39.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.-R_qxIQzYJfdffHArY5_JfUW6qFRxSU_0 2024-09-12T01:04:39.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10237978567626115402', time=2024-09-12T02:52:35.351700+0000, chain.objs.size()=1 2024-09-12T01:04:39.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.3mNKQS5UXMGQU-o3CqskPmk_QyzOjo0_0 2024-09-12T01:04:39.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16189398235807952170', time=2024-09-12T02:52:35.402403+0000, chain.objs.size()=1 2024-09-12T01:04:39.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.LwiG3ROH0A5nvpnXIB7-bsfHT6XQTQo_0 2024-09-12T01:04:39.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2069677540695575856', time=2024-09-12T02:52:35.565318+0000, chain.objs.size()=1 2024-09-12T01:04:39.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Wv7uicH6E-mLLWLvWDZhyj-JRswTJde_0 2024-09-12T01:04:39.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17779001470380845216', time=2024-09-12T02:52:35.581428+0000, chain.objs.size()=1 2024-09-12T01:04:39.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.S-Ie7rdMo6_E8GCt3Bt0JBK2Ik3w-mk_0 2024-09-12T01:04:39.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9961985391420404170', time=2024-09-12T02:52:35.603021+0000, chain.objs.size()=1 2024-09-12T01:04:39.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.maIo6QSGFi2MtnX-wuipOEJnxvF2zRM_0 2024-09-12T01:04:39.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14083491973770465929', time=2024-09-12T02:52:35.629079+0000, chain.objs.size()=1 2024-09-12T01:04:39.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.2YhsNx1Ej9TkaZOpJ_ijPcbVxK3XDiD_0 2024-09-12T01:04:39.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11199430330391438612', time=2024-09-12T02:52:35.669882+0000, chain.objs.size()=1 2024-09-12T01:04:39.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.5clkYUtTtO2Rbi9Bk9rA5zuFFB5e9aK_0 2024-09-12T01:04:39.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8634729717886419444', time=2024-09-12T02:52:35.768247+0000, chain.objs.size()=1 2024-09-12T01:04:39.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Xg9QlSq4OyFffX4h0aYdnnumi7m1bC9_0 2024-09-12T01:04:39.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10750366214282051482', time=2024-09-12T02:52:35.806089+0000, chain.objs.size()=1 2024-09-12T01:04:39.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.sPJGZqWr4uwB0Kl0QClZaSUS1QkqJ3Z_0 2024-09-12T01:04:39.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11693279647173202589', time=2024-09-12T02:52:35.837612+0000, chain.objs.size()=1 2024-09-12T01:04:39.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.bhYtXq1JWrWXDnLMuon1zmVfvg-l5GY_0 2024-09-12T01:04:39.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16628591866452125333', time=2024-09-12T02:52:35.842795+0000, chain.objs.size()=1 2024-09-12T01:04:39.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.KaZAVsPj2t-cQwAm2wnqqGnGD8KRXAI_0 2024-09-12T01:04:39.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17865462026926880713', time=2024-09-12T02:52:35.843898+0000, chain.objs.size()=1 2024-09-12T01:04:39.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.vrOdvjIESnqSH3d5zaXQQKvCqXnrmTb_0 2024-09-12T01:04:39.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2761351356494132929', time=2024-09-12T02:52:35.849853+0000, chain.objs.size()=1 2024-09-12T01:04:39.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.LRKtbFc8mwk7qCvQZFx4_RbDbnxaVOF_0 2024-09-12T01:04:39.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12899605861458046731', time=2024-09-12T02:52:36.237560+0000, chain.objs.size()=1 2024-09-12T01:04:39.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.MDtmzSrAAQXKwFbVSikwpOzrM2lDwbx_0 2024-09-12T01:04:39.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5719268761707030560', time=2024-09-12T02:52:36.330756+0000, chain.objs.size()=1 2024-09-12T01:04:39.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_._CUFpRWln6FYIbQ_MmFG4NX-SX-5DiR_0 2024-09-12T01:04:39.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14959644045719697264', time=2024-09-12T02:52:36.355404+0000, chain.objs.size()=1 2024-09-12T01:04:39.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.B2TRXxMr2tcGc2ahds8865xGVmivegO_0 2024-09-12T01:04:39.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9599439363394188407', time=2024-09-12T02:52:36.388676+0000, chain.objs.size()=1 2024-09-12T01:04:39.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.YCu6DT_nJLgRLZGKLVNhx9HE7NIdYhy_0 2024-09-12T01:04:39.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4476831412467563241', time=2024-09-12T02:52:36.535887+0000, chain.objs.size()=1 2024-09-12T01:04:39.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.MKOvInI7nrPcH569GKsWklwVLl5RTSs_0 2024-09-12T01:04:39.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.106+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14241233144899511425', time=2024-09-12T02:52:36.590192+0000, chain.objs.size()=1 2024-09-12T01:04:39.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.106+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.r7xz6DcWOErnu1F4ClUzcbYCngumYME_0 2024-09-12T01:04:39.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.106+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4847919452113693606', time=2024-09-12T02:52:36.601742+0000, chain.objs.size()=1 2024-09-12T01:04:39.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.106+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.qkc7DKCUiTUT4abB4pz0-B0eA8ab28S_0 2024-09-12T01:04:39.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.106+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15505793328689461568', time=2024-09-12T02:52:36.626217+0000, chain.objs.size()=1 2024-09-12T01:04:39.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.106+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.5HDlvw71V7WPF1Qsw8-L9zxDOmon6Jb_0 2024-09-12T01:04:39.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.106+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4612668547129779818', time=2024-09-12T02:52:36.635128+0000, chain.objs.size()=1 2024-09-12T01:04:39.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.106+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.YlDhmWDqdhEudDGSRYDwOP9eLzpXcW9_0 2024-09-12T01:04:39.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.106+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2576204168984801920', time=2024-09-12T02:52:36.640829+0000, chain.objs.size()=1 2024-09-12T01:04:39.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.106+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.rckHSg-VXzgmirjf7xG35YUnSieNMJP_0 2024-09-12T01:04:39.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.106+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12445289369412888810', time=2024-09-12T02:52:36.641639+0000, chain.objs.size()=1 2024-09-12T01:04:39.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.106+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.0eEWIs5xo56l3QmepT-DqDtF4brGQlP_0 2024-09-12T01:04:39.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.106+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7423650324883640238', time=2024-09-12T02:52:36.779270+0000, chain.objs.size()=1 2024-09-12T01:04:39.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.106+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.i6MygkvKPugYr-wSM0TN1i5or-qxNVs_0 2024-09-12T01:04:39.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.106+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2812658769447710768', time=2024-09-12T02:52:36.797525+0000, chain.objs.size()=1 2024-09-12T01:04:39.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.106+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.plGaF5FKAyVYT2jUToSdP_OdweH3N_b_0 2024-09-12T01:04:39.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.106+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13804783016951695158', time=2024-09-12T02:52:36.817113+0000, chain.objs.size()=1 2024-09-12T01:04:39.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.106+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.qNb24N9j1yiDsJIwPbn-seVl1mYtLzT_0 2024-09-12T01:04:39.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.106+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15246981874109171514', time=2024-09-12T02:52:36.822260+0000, chain.objs.size()=1 2024-09-12T01:04:39.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.106+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.bJw2E6aReG8DGvcfVw-mttIMdMoh3Kn_0 2024-09-12T01:04:39.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.106+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1425979752610162845', time=2024-09-12T02:52:37.072106+0000, chain.objs.size()=1 2024-09-12T01:04:39.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.106+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.050OE9XlsjPtgeBQ1hnlziV0m8-SQYw_0 2024-09-12T01:04:39.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.106+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3015120026887880892', time=2024-09-12T02:52:37.098336+0000, chain.objs.size()=1 2024-09-12T01:04:39.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.106+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.2FVOt_7R70L0hVq1YHUU6Mqz_3IYylz_0 2024-09-12T01:04:39.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.106+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15108326452194805963', time=2024-09-12T02:52:56.907714+0000, chain.objs.size()=1 2024-09-12T01:04:39.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.106+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.uD3c4avxSj1Qpws2FdPCOIRaHUlOz0n_0 2024-09-12T01:04:39.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11596486838877013188', time=2024-09-12T02:52:56.999477+0000, chain.objs.size()=1 2024-09-12T01:04:39.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.jVDbru5Z2VcHqr4LKz89jSjs0dDyLx9_0 2024-09-12T01:04:39.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6594906820832800921', time=2024-09-12T02:52:57.039937+0000, chain.objs.size()=1 2024-09-12T01:04:39.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Gl0_MaNByAJ6pFPdhd_0OHW-WVisBLj_0 2024-09-12T01:04:39.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7808366301472810805', time=2024-09-12T02:52:57.261090+0000, chain.objs.size()=1 2024-09-12T01:04:39.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.xoDUQ6ni5mVJmKxBhtDhq6D4KQZTz2h_0 2024-09-12T01:04:39.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11452033872266843748', time=2024-09-12T02:52:57.502132+0000, chain.objs.size()=1 2024-09-12T01:04:39.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.rw5oZmuod735-5DoV3Cb19RXbCigqUg_0 2024-09-12T01:04:39.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1143884917726980229', time=2024-09-12T02:52:57.674166+0000, chain.objs.size()=1 2024-09-12T01:04:39.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.SOkMpkfQ4vWKdBZWvSUnvh0M4ip5Beb_0 2024-09-12T01:04:39.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2676303492318678905', time=2024-09-12T02:52:57.860205+0000, chain.objs.size()=1 2024-09-12T01:04:39.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.yI8kyqraas4tEvHEH-hyw3_wjevptev_0 2024-09-12T01:04:39.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17364349399752535932', time=2024-09-12T02:52:57.864871+0000, chain.objs.size()=1 2024-09-12T01:04:39.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.4EbYMOEL5UHMUlM64EPjoxtE_lG8bf0_0 2024-09-12T01:04:39.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8815949408389537512', time=2024-09-12T02:52:57.907068+0000, chain.objs.size()=1 2024-09-12T01:04:39.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.TtdhlQWcUxmokzB0cpNi0X5ba-HHcUz_0 2024-09-12T01:04:39.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5567358771573384292', time=2024-09-12T02:52:57.923150+0000, chain.objs.size()=1 2024-09-12T01:04:39.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.X_vOv--ij_SRWQ4LsZN6UQ-bNuL3Ffi_0 2024-09-12T01:04:39.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14182460558658254429', time=2024-09-12T02:52:57.940795+0000, chain.objs.size()=1 2024-09-12T01:04:39.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.nA_Qz_9k2jvTd5IFXrCruyrVlqb_dLI_0 2024-09-12T01:04:39.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15507033664821185714', time=2024-09-12T02:52:57.942041+0000, chain.objs.size()=1 2024-09-12T01:04:39.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ff3ofl_ngwR-eNFPcnlkhQjr__sfDtU_0 2024-09-12T01:04:39.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1360763554751785110', time=2024-09-12T02:52:57.991176+0000, chain.objs.size()=1 2024-09-12T01:04:39.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.EZv-i-Spao3SYOkvs7CQ_1X6G2oWn4v_0 2024-09-12T01:04:39.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10220763495318659134', time=2024-09-12T02:52:58.107098+0000, chain.objs.size()=1 2024-09-12T01:04:39.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.11EAHBbhiWUuZMH59s6enFbPYE1zHts_0 2024-09-12T01:04:39.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18098536227598999706', time=2024-09-12T02:52:58.109290+0000, chain.objs.size()=1 2024-09-12T01:04:39.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.8-34O0ydnb-nQsLx4HVFN-C5-AF97LD_0 2024-09-12T01:04:39.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9548438495392790859', time=2024-09-12T02:52:58.187179+0000, chain.objs.size()=1 2024-09-12T01:04:39.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.njnlYMU813xkdmxliLplgESxHrnMO5a_0 2024-09-12T01:04:39.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15940417297414428041', time=2024-09-12T02:52:58.214086+0000, chain.objs.size()=1 2024-09-12T01:04:39.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Pvp_blO8M268pmFR3DGrYZU8DXmu5Zg_0 2024-09-12T01:04:39.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13096678711693751232', time=2024-09-12T02:52:58.386025+0000, chain.objs.size()=1 2024-09-12T01:04:39.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.7YPKUvsn5FW8SOFU66Iwugf5uH5Nj6W_0 2024-09-12T01:04:39.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7831319157833448072', time=2024-09-12T02:52:58.440426+0000, chain.objs.size()=1 2024-09-12T01:04:39.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.InJyMsnx6TIFSRuvrurkD3wp3d8cJRM_0 2024-09-12T01:04:39.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12672247935474588295', time=2024-09-12T02:52:58.469453+0000, chain.objs.size()=1 2024-09-12T01:04:39.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.1wZmkGc3_YiRWef-hrQNvRmko5VaxtJ_0 2024-09-12T01:04:39.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10544097451423479792', time=2024-09-12T02:52:58.473449+0000, chain.objs.size()=1 2024-09-12T01:04:39.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.R6g0W2HrN1HtRWpR1I2gboVm_OV0Lzh_0 2024-09-12T01:04:39.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18301015438142956910', time=2024-09-12T02:52:58.489016+0000, chain.objs.size()=1 2024-09-12T01:04:39.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.xvppV4jrp1apig4hwVRrx_DOs-z_w3o_0 2024-09-12T01:04:39.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.114+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/53640 2024-09-12T01:04:39.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-12T01:04:39.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11879516873700036827', time=2024-09-12T02:52:58.628552+0000, chain.objs.size()=1 2024-09-12T01:04:39.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.spTQT2ua_fJpFdb_JGVdnVFUIaJ9DHq_0 2024-09-12T01:04:39.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8217735282613870492', time=2024-09-12T02:52:58.661546+0000, chain.objs.size()=1 2024-09-12T01:04:39.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.745ltEfrkLmDkUiiky63XIty9t7rK4N_0 2024-09-12T01:04:39.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14414250057986790749', time=2024-09-12T02:52:58.670330+0000, chain.objs.size()=1 2024-09-12T01:04:39.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.tJuAvGhdweW8mGgmXQSsDI2pg5Tawov_0 2024-09-12T01:04:39.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8154750174516242971', time=2024-09-12T02:52:58.672680+0000, chain.objs.size()=1 2024-09-12T01:04:39.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.VUDKPev_wzTuZrZpdz46IOVY-rFIuMa_0 2024-09-12T01:04:39.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17810660585638543883', time=2024-09-12T02:54:18.857329+0000, chain.objs.size()=1 2024-09-12T01:04:39.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.437__shadow_.IS6yExWNK4Jy7brYb6lbP0D79Bc6NFZ_0 2024-09-12T01:04:39.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8908193029035822319', time=2024-09-12T02:54:43.758768+0000, chain.objs.size()=1 2024-09-12T01:04:39.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.465__shadow_.ELuxX6kzWH183je1jQIy4hd0cpBBKfb_0 2024-09-12T01:04:39.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3224096083437705058', time=2024-09-12T02:54:53.311917+0000, chain.objs.size()=1 2024-09-12T01:04:39.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.483__shadow_.Z8wAdSiYTGB5q_t-W9vYVHq6uB_I4yV_0 2024-09-12T01:04:39.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17506248769278890912', time=2024-09-12T02:54:59.832171+0000, chain.objs.size()=1 2024-09-12T01:04:39.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.491__shadow_.cvlVFNQS2pBZUEZghuSgoKMfCP3gWMj_0 2024-09-12T01:04:39.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1021692979468978229', time=2024-09-12T02:55:02.446596+0000, chain.objs.size()=1 2024-09-12T01:04:39.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.496__shadow_.WSF2MLxY6ypUY29ux4prXQTYgfIazJE_0 2024-09-12T01:04:39.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12577235405054036730', time=2024-09-12T02:55:47.168050+0000, chain.objs.size()=3 2024-09-12T01:04:39.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.523__multipart_mymultipart.2~ON1TSzUjNAJxSanssiwFsVusnn0qIh9.1 2024-09-12T01:04:39.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.523__multipart_mymultipart.2~ON1TSzUjNAJxSanssiwFsVusnn0qIh9.2 2024-09-12T01:04:39.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.523__multipart_mymultipart.2~ON1TSzUjNAJxSanssiwFsVusnn0qIh9.3 2024-09-12T01:04:39.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6157959574447621044', time=2024-09-12T02:55:49.419257+0000, chain.objs.size()=2 2024-09-12T01:04:39.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.525__multipart_mymultipart.2~mxj_bitvvWNe5LXJM6Gq8QY8Xeb87ey.1 2024-09-12T01:04:39.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.525__multipart_mymultipart.2~mxj_bitvvWNe5LXJM6Gq8QY8Xeb87ey.2 2024-09-12T01:04:39.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10799360651135072152', time=2024-09-12T02:56:43.817301+0000, chain.objs.size()=1 2024-09-12T01:04:39.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.554__shadow_.zzIuxzF-TAquoiZ7q4u-zA4CK5pkGiz_0 2024-09-12T01:04:39.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12870003173306754429', time=2024-09-12T02:57:10.408586+0000, chain.objs.size()=1 2024-09-12T01:04:39.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.570__shadow:MUV9-jZmzXI4NfWL2uPEkTIsGmJd9wr_.CX0rdlZFo6h5f0PP7Ed_U-snrvu14Eu_0 2024-09-12T01:04:39.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.390270793603772772', time=2024-09-12T02:57:12.240459+0000, chain.objs.size()=1 2024-09-12T01:04:39.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.572__shadow_.o4uhRATOblgsx4L_W0jzL3CXSR2u6mT_0 2024-09-12T01:04:39.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6420603050311484112', time=2024-09-12T02:57:14.551854+0000, chain.objs.size()=1 2024-09-12T01:04:39.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.574__shadow_.Ok1_n7qbdWFrN0-YSewexOY-heo0kBK_0 2024-09-12T01:04:39.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12834789650591560223', time=2024-09-12T02:57:22.082562+0000, chain.objs.size()=1 2024-09-12T01:04:39.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.576__shadow:QNbtDLmgeUeyRUnKdmNajyXwneVJKDi_.gcl89gDRXxEHM9blSEsy7Sz26-A2N2x_0 2024-09-12T01:04:39.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4998177703011316353', time=2024-09-12T02:57:30.300903+0000, chain.objs.size()=1 2024-09-12T01:04:39.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:nyJsg7zj4OEPREX-J2r6V1f7mX8.HTB_.YvkoYtHcnKsqTSXakWVFa21VkAk1m-N_0 2024-09-12T01:04:39.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2702940825944265821', time=2024-09-12T02:57:46.506495+0000, chain.objs.size()=1 2024-09-12T01:04:39.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.580__shadow:rXXOQ7Xlyq8t1.c0yPpQMW7i9.5-9uq_.hCGEAbdKIG7Jgtm13ZlKUvKdszFl9XS_0 2024-09-12T01:04:39.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15775940162546575392', time=2024-09-12T02:57:52.268231+0000, chain.objs.size()=1 2024-09-12T01:04:39.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.587__shadow:5nszuuf-kvhx.XvdM5haYGhJkqjQDiC_.dmTEdbT4jzsJKnlcIqinuqezoKp6u7o_0 2024-09-12T01:04:39.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17355829333439767344', time=2024-09-12T03:00:44.248834+0000, chain.objs.size()=1 2024-09-12T01:04:39.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.639__shadow_.2wGCKGfqA4gWAwClWVIWOQuJ4A_ajkL_0 2024-09-12T01:04:39.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9580370255160535565', time=2024-09-12T03:01:08.427637+0000, chain.objs.size()=1 2024-09-12T01:04:39.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.666__shadow_.gXkjxm_BAuex01FU9jG77H236-BKeEV_0 2024-09-12T01:04:39.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.122+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10434991826871732800', time=2024-09-12T03:01:29.677315+0000, chain.objs.size()=1 2024-09-12T01:04:39.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.122+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.700__shadow:rLPqp5Maw4DMVyY3pLCwvYJdCTLhZcb_.H95QEiKWUvS41wdZjAXNfMQx2AKDbgq_0 2024-09-12T01:04:39.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.122+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13045628693849469067', time=2024-09-12T03:02:12.661603+0000, chain.objs.size()=1 2024-09-12T01:04:39.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.122+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.734__shadow_.rIc1yUJCfjgP1CVd9Tdd0aO04UuPQ8J_0 2024-09-12T01:04:39.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.122+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8574277814208321501', time=2024-09-12T03:02:22.568440+0000, chain.objs.size()=1 2024-09-12T01:04:39.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.122+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.744__shadow_.GiAf6pbTK_A2hNO0Ga2-eypnNfCOyI7_0 2024-09-12T01:04:39.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.122+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:39.126 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.126+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:04:39.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.126+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:39.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.126+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:39.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.130+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49225' 2024-09-12T01:04:39.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.130+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3710234761187477007', time=2024-09-12T02:48:38.024804+0000, chain.objs.size()=3 2024-09-12T01:04:39.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.130+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.164__multipart_foo.2~YRVrkpJk06bOPfj4pQKXD9mJXUBuXUC.1 2024-09-12T01:04:39.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.130+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.164__shadow_foo.2~YRVrkpJk06bOPfj4pQKXD9mJXUBuXUC.1_1 2024-09-12T01:04:39.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.130+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.164__multipart_foo.2~YRVrkpJk06bOPfj4pQKXD9mJXUBuXUC.2 2024-09-12T01:04:39.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.130+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10451934389961688374', time=2024-09-12T02:50:51.789857+0000, chain.objs.size()=1 2024-09-12T01:04:39.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.130+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.242__shadow_.X3002F1JniBr-wBVFjTlRdI40Abr41S_0 2024-09-12T01:04:39.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.130+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.231163520126473638', time=2024-09-12T02:50:54.232001+0000, chain.objs.size()=1 2024-09-12T01:04:39.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.130+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.244__shadow_.6dzI7ulzDcc0S92eSCcCzIu0HQ5AyPE_0 2024-09-12T01:04:39.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.130+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4583137213976022540', time=2024-09-12T02:51:26.743970+0000, chain.objs.size()=1 2024-09-12T01:04:39.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.130+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.n3408-mBw4XjH2IjzHsGEGBQI8H-rV7_0 2024-09-12T01:04:39.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.130+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16745059380257264447', time=2024-09-12T02:51:26.819094+0000, chain.objs.size()=1 2024-09-12T01:04:39.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.130+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.lMm0yrBb-Fb0W-tv45Qg27rnrSKwMhx_0 2024-09-12T01:04:39.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.130+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1083386548581580725', time=2024-09-12T02:51:26.831731+0000, chain.objs.size()=1 2024-09-12T01:04:39.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.130+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.YzZuDhldPuzzJvETGIgENerXRLXqfEv_0 2024-09-12T01:04:39.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.130+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.591918174142210914', time=2024-09-12T02:51:26.851189+0000, chain.objs.size()=1 2024-09-12T01:04:39.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.130+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.GlRZKx0UfefQyrM67qrzUGdApVCY3dz_0 2024-09-12T01:04:39.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.130+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5995526338168531958', time=2024-09-12T02:51:26.872509+0000, chain.objs.size()=1 2024-09-12T01:04:39.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.130+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.2L70n7txB9mvhEj9kwy55DssnpzAPeJ_0 2024-09-12T01:04:39.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.130+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11223174351689033739', time=2024-09-12T02:51:26.987618+0000, chain.objs.size()=1 2024-09-12T01:04:39.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.130+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.cOAU3SRY1_CEn5iZoNPk_WiqOEylIpP_0 2024-09-12T01:04:39.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.130+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8205413876356500901', time=2024-09-12T02:51:27.011631+0000, chain.objs.size()=1 2024-09-12T01:04:39.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.130+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.NacfKbVg0Dh7WDaFSPdHRjt8DqnIlAp_0 2024-09-12T01:04:39.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.134+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16395475695031152908', time=2024-09-12T02:51:27.026429+0000, chain.objs.size()=1 2024-09-12T01:04:39.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.134+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.q24ZW1Rxr71es5DiWqhErts5kXgrV6s_0 2024-09-12T01:04:39.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.134+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14933035424175166958', time=2024-09-12T02:51:27.030538+0000, chain.objs.size()=1 2024-09-12T01:04:39.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.134+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.sZbpCzWNRxRcHIekhMBTWr0_XUJ1_Dv_0 2024-09-12T01:04:39.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.134+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.349875603552723253', time=2024-09-12T02:51:27.034799+0000, chain.objs.size()=1 2024-09-12T01:04:39.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.134+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.hCShbz5gJomPj1_RNfqQUGeFR813JAF_0 2024-09-12T01:04:39.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.134+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13985411028129969055', time=2024-09-12T02:51:27.196015+0000, chain.objs.size()=1 2024-09-12T01:04:39.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.134+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.JD2YjmbYyo4XTtC3NnkZjalTO5Idt7u_0 2024-09-12T01:04:39.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.134+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16900091973489786573', time=2024-09-12T02:51:27.253223+0000, chain.objs.size()=1 2024-09-12T01:04:39.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.134+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.R9DKEwvT9CT60o5yn5awtj4Xc4BS88Y_0 2024-09-12T01:04:39.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.134+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14101746887272319745', time=2024-09-12T02:51:27.285801+0000, chain.objs.size()=1 2024-09-12T01:04:39.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.134+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.uf9aVxTRRQomhkvv2HMt2Sg7WZL57qY_0 2024-09-12T01:04:39.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.134+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9266161906808751782', time=2024-09-12T02:51:27.432102+0000, chain.objs.size()=1 2024-09-12T01:04:39.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.134+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.06TbcvcCfuZvaP2G3HricrDLp_iKL62_0 2024-09-12T01:04:39.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.134+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8738776705403263493', time=2024-09-12T02:51:27.442287+0000, chain.objs.size()=1 2024-09-12T01:04:39.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.134+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.1QziiaM6mEQkHr3ZzKZc5H4G8_38vgV_0 2024-09-12T01:04:39.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.134+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16904385374508201178', time=2024-09-12T02:51:27.462626+0000, chain.objs.size()=1 2024-09-12T01:04:39.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.134+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.RBKZxDJ_TzzgrB1GJcQBzk_Jfre2aRk_0 2024-09-12T01:04:39.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.134+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.652842506444997939', time=2024-09-12T02:51:27.478315+0000, chain.objs.size()=1 2024-09-12T01:04:39.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.134+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.LDvPlCb4YOQoVx7qbWEB8NZzjOjovSY_0 2024-09-12T01:04:39.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.134+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15677355076142216791', time=2024-09-12T02:51:27.492638+0000, chain.objs.size()=1 2024-09-12T01:04:39.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.134+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.VAsmHlwgp1QXL4cwGBCBIK2WLWZQpOP_0 2024-09-12T01:04:39.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.138+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1260969822879887284', time=2024-09-12T02:51:27.497170+0000, chain.objs.size()=1 2024-09-12T01:04:39.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.138+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.nJNtPw9eSfHYK9GFPeaJaVb9AKuQv2u_0 2024-09-12T01:04:39.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.142+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7638205551103170017', time=2024-09-12T02:51:27.525114+0000, chain.objs.size()=1 2024-09-12T01:04:39.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.142+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.93Enbn78v7qRS29F8jpnUqyZF3ysfyc_0 2024-09-12T01:04:39.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.142+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.547304741293584078', time=2024-09-12T02:51:27.627205+0000, chain.objs.size()=1 2024-09-12T01:04:39.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.142+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.hBBK8iLcR5ldewnQrP_iED8AEUWnhM9_0 2024-09-12T01:04:39.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.142+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11004854597977651477', time=2024-09-12T02:51:27.696559+0000, chain.objs.size()=1 2024-09-12T01:04:39.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.142+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.h6N8FW-gwYZmnjeNoWePRpuGpeJvc9I_0 2024-09-12T01:04:39.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.142+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13382914919595779224', time=2024-09-12T02:51:27.712533+0000, chain.objs.size()=1 2024-09-12T01:04:39.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.142+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.GOoPW6wHVQHO1_9Q7io6Gvp6GjZlqNZ_0 2024-09-12T01:04:39.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.142+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17592333461705623731', time=2024-09-12T02:51:27.717213+0000, chain.objs.size()=1 2024-09-12T01:04:39.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.142+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.CKKRIkC8lQTEPkSLmh6NIohjcc1STWd_0 2024-09-12T01:04:39.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.142+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12599800538797886659', time=2024-09-12T02:51:27.732709+0000, chain.objs.size()=1 2024-09-12T01:04:39.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.142+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.GVQ925vzNAktoaXe3DCQLEKWfVumC0D_0 2024-09-12T01:04:39.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.142+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12238565046545686353', time=2024-09-12T02:51:27.849218+0000, chain.objs.size()=1 2024-09-12T01:04:39.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.142+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.FyZwh59JF_F9SXQVwMQDW8ca33IfWv4_0 2024-09-12T01:04:39.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.142+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15614175889838633042', time=2024-09-12T02:51:27.914306+0000, chain.objs.size()=1 2024-09-12T01:04:39.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.142+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.8vLohh5z_vxrOIlxVzE0HYXrMfCZasR_0 2024-09-12T01:04:39.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.142+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15216116157188885021', time=2024-09-12T02:51:27.951030+0000, chain.objs.size()=1 2024-09-12T01:04:39.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.142+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.NMvu8SaH-05nI-vX2N1bi8p_92V7WX9_0 2024-09-12T01:04:39.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.142+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.433116288114347904', time=2024-09-12T02:51:28.195740+0000, chain.objs.size()=1 2024-09-12T01:04:39.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.142+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.QmBqnFn465SA-fYkdP8qoTOYSt_BGBq_0 2024-09-12T01:04:39.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8892360214722527608', time=2024-09-12T02:51:28.208322+0000, chain.objs.size()=1 2024-09-12T01:04:39.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.zCuiFf9CWi_JbsIjDexkxa_i4rEwvo8_0 2024-09-12T01:04:39.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4556496899619806860', time=2024-09-12T02:51:28.214527+0000, chain.objs.size()=1 2024-09-12T01:04:39.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.jxg24XtnjcYDSfS0NAbv6Ve9sQmF0Xd_0 2024-09-12T01:04:39.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9998659622468825282', time=2024-09-12T02:51:28.221097+0000, chain.objs.size()=1 2024-09-12T01:04:39.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.xgQaWVyCv5FM1fwP1V_Zi3qt-KfTh8k_0 2024-09-12T01:04:39.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13268348884296861166', time=2024-09-12T02:51:28.244366+0000, chain.objs.size()=1 2024-09-12T01:04:39.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Nzce4tNQI53WCmF5bWtIWkOdj8Sxweb_0 2024-09-12T01:04:39.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8991527988867350476', time=2024-09-12T02:51:28.249914+0000, chain.objs.size()=1 2024-09-12T01:04:39.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.OE0SakN6V5QNtS7kpRRHuwIJIxPigGh_0 2024-09-12T01:04:39.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14527407957911088600', time=2024-09-12T02:51:28.661719+0000, chain.objs.size()=1 2024-09-12T01:04:39.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.c4B4POwf9kahXSC2CuXd0b2ekpQskkR_0 2024-09-12T01:04:39.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6510424073549087912', time=2024-09-12T02:51:28.669953+0000, chain.objs.size()=1 2024-09-12T01:04:39.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.s8Xtbu3lDoDUm-BNsrpx5J7jhwlBFsU_0 2024-09-12T01:04:39.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8810652688716895918', time=2024-09-12T02:51:36.523841+0000, chain.objs.size()=1 2024-09-12T01:04:39.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.273__shadow_.b_v3tYrb1F6Nj8hO4R9DaRm_yxJkJFK_0 2024-09-12T01:04:39.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6719825071046067165', time=2024-09-12T02:51:40.221076+0000, chain.objs.size()=1 2024-09-12T01:04:39.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.278__shadow_.8V9yEQGm642vBQNnSqM7FnvGxgCN2Nu_0 2024-09-12T01:04:39.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18036898779115752265', time=2024-09-12T02:51:47.748365+0000, chain.objs.size()=1 2024-09-12T01:04:39.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.288__shadow_.9vLQpyhSlJ-3A_i475gwe4zl6FK7zrD_0 2024-09-12T01:04:39.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1183467656816615364', time=2024-09-12T02:51:51.728252+0000, chain.objs.size()=1 2024-09-12T01:04:39.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.292__shadow_.rw-336mnWS4-kyYfIVyLNeU7P8HklWU_0 2024-09-12T01:04:39.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14300547167545014205', time=2024-09-12T02:51:53.921714+0000, chain.objs.size()=1 2024-09-12T01:04:39.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.294__shadow_.XoevMJjqNx6sPBCbWvJnEPibWQmOWw2_0 2024-09-12T01:04:39.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.92870858283646559', time=2024-09-12T02:52:35.114664+0000, chain.objs.size()=1 2024-09-12T01:04:39.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.pWr2v3IxZWyTR9QriK7TdVianplBcbq_0 2024-09-12T01:04:39.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9936645712861132423', time=2024-09-12T02:52:35.124755+0000, chain.objs.size()=1 2024-09-12T01:04:39.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.-pwsx0Gr9gpFbes1NxiIGa_cZuSHchE_0 2024-09-12T01:04:39.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4116261615290837011', time=2024-09-12T02:52:35.154303+0000, chain.objs.size()=1 2024-09-12T01:04:39.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.KB-wUflUYfMu2l-7C057W12wk3YYl73_0 2024-09-12T01:04:39.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5949687749868900039', time=2024-09-12T02:52:35.169178+0000, chain.objs.size()=1 2024-09-12T01:04:39.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.B2knLFKMslyi_xd2ealHYlr_D2LcSru_0 2024-09-12T01:04:39.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.967887460843291450', time=2024-09-12T02:52:35.373782+0000, chain.objs.size()=1 2024-09-12T01:04:39.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.5FXD9V7D-mr4F78uKi0VKDka8mj0Avn_0 2024-09-12T01:04:39.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18185185850084934129', time=2024-09-12T02:52:35.388459+0000, chain.objs.size()=1 2024-09-12T01:04:39.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Yzdp6tv0NhKJB25wcgCralLx673v5El_0 2024-09-12T01:04:39.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15514785155754278355', time=2024-09-12T02:52:35.412531+0000, chain.objs.size()=1 2024-09-12T01:04:39.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.146+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.OJIGlLQUrhjBL5FFFGSwproBBuQh1p5_0 2024-09-12T01:04:39.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.150+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1500907164415157349', time=2024-09-12T02:52:35.543727+0000, chain.objs.size()=1 2024-09-12T01:04:39.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.150+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.5ZvN0ve5bXDaKrPD4OIreqPKWWsNEEX_0 2024-09-12T01:04:39.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.150+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13787491699788155578', time=2024-09-12T02:52:35.573662+0000, chain.objs.size()=1 2024-09-12T01:04:39.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.150+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.5NxbwXRv9kSM-wafWtFGT5E8yd6rIKi_0 2024-09-12T01:04:39.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.150+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9044379787509289560', time=2024-09-12T02:52:35.668939+0000, chain.objs.size()=1 2024-09-12T01:04:39.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.150+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.vKdyzVNzQlEVQqYXz02xRtaYNL0zBre_0 2024-09-12T01:04:39.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.150+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7114112684789894960', time=2024-09-12T02:52:35.671997+0000, chain.objs.size()=1 2024-09-12T01:04:39.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.150+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.0EXZthCg1SA954hnkumueZ3Fh4A0aig_0 2024-09-12T01:04:39.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.150+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15259701815648142910', time=2024-09-12T02:52:35.786772+0000, chain.objs.size()=1 2024-09-12T01:04:39.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.150+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.hfXJz3deRQV7smApUoA2F1Booj0NHo1_0 2024-09-12T01:04:39.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.150+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5375834005938361841', time=2024-09-12T02:52:35.830400+0000, chain.objs.size()=1 2024-09-12T01:04:39.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.150+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.rflhN1VS1ULDfFFrnXotwpUqmTvnC9e_0 2024-09-12T01:04:39.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.150+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10555154284859012679', time=2024-09-12T02:52:35.843972+0000, chain.objs.size()=1 2024-09-12T01:04:39.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.150+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.HCKky2O5K09oN-CiDZ7UiA5-S32xCoD_0 2024-09-12T01:04:39.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.150+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12560562089128410549', time=2024-09-12T02:52:36.305394+0000, chain.objs.size()=1 2024-09-12T01:04:39.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.150+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Ds__beX4qks7XlG5VPd_eCZZfe2Ssk1_0 2024-09-12T01:04:39.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.150+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18192507916089925819', time=2024-09-12T02:52:36.326929+0000, chain.objs.size()=1 2024-09-12T01:04:39.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.150+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.2JumnZuKHiV4YU2PwXRLbhiBRS62shQ_0 2024-09-12T01:04:39.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.150+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11904420678387330458', time=2024-09-12T02:52:36.331934+0000, chain.objs.size()=1 2024-09-12T01:04:39.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.150+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Pb-kLOb1vqeLxd1rTaqRkLrc6MGsBG-_0 2024-09-12T01:04:39.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.150+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17077771908930983115', time=2024-09-12T02:52:36.505116+0000, chain.objs.size()=1 2024-09-12T01:04:39.152 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.150+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.FyJ_5qlbl5zoDZemWmn8wqLsH3idboM_0 2024-09-12T01:04:39.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.154+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9691008608768184918', time=2024-09-12T02:52:36.510761+0000, chain.objs.size()=1 2024-09-12T01:04:39.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.154+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.EC5ceaNOgCbMeyK06EJDyr4PX7W5dRR_0 2024-09-12T01:04:39.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.154+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9018154196293090399', time=2024-09-12T02:52:36.577407+0000, chain.objs.size()=1 2024-09-12T01:04:39.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.154+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.0hdm6doasN_x9LUJYdiQUwqoJeTzdzM_0 2024-09-12T01:04:39.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.154+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12285393211644129708', time=2024-09-12T02:52:36.586081+0000, chain.objs.size()=1 2024-09-12T01:04:39.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.154+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.lEBVtg5znaBFCstlmCtGxxlFLhdUiop_0 2024-09-12T01:04:39.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.154+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4050242619485547515', time=2024-09-12T02:52:36.608116+0000, chain.objs.size()=1 2024-09-12T01:04:39.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.154+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.JbJQwJZ7tln4luXXUyHT_uMWQp_YYJn_0 2024-09-12T01:04:39.154 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.154+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16290059233590344011', time=2024-09-12T02:52:36.618932+0000, chain.objs.size()=1 2024-09-12T01:04:39.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.154+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.pTK0jMe0gLKsvnwl6cdPd5dJua71BLU_0 2024-09-12T01:04:39.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.154+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9137679415733398905', time=2024-09-12T02:52:36.633803+0000, chain.objs.size()=1 2024-09-12T01:04:39.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.154+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.R9NJ2FhBycXZ-YuG9ZjM8T5g37jyc4H_0 2024-09-12T01:04:39.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.154+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.761896114240755559', time=2024-09-12T02:52:36.780165+0000, chain.objs.size()=1 2024-09-12T01:04:39.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.154+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.J2XeLLL-IXLzcp1jNNfHQxlnjHg59e1_0 2024-09-12T01:04:39.155 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.154+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6408617998460082905', time=2024-09-12T02:52:36.820706+0000, chain.objs.size()=1 2024-09-12T01:04:39.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.154+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.L_AvJiYj6zrLJfkfzk3uAX_mlagdPW5_0 2024-09-12T01:04:39.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.154+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13609026034733664525', time=2024-09-12T02:52:36.838529+0000, chain.objs.size()=1 2024-09-12T01:04:39.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.154+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ZT2t8O3PTRiKa8f2J7sp6dnLXa8QdPX_0 2024-09-12T01:04:39.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.154+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6062182093628175002', time=2024-09-12T02:52:36.990779+0000, chain.objs.size()=1 2024-09-12T01:04:39.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.154+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.2nNAhbGYzdnDE-Eyq5NH_Xg9iUQ02WR_0 2024-09-12T01:04:39.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.154+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7547908976775218473', time=2024-09-12T02:52:37.047635+0000, chain.objs.size()=1 2024-09-12T01:04:39.156 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.154+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.5Td-lAT28N0zWUk7LyApB-_Omb_wQnS_0 2024-09-12T01:04:39.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.482581768454265471', time=2024-09-12T02:52:37.056739+0000, chain.objs.size()=1 2024-09-12T01:04:39.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.91sxDqe5EwwCBovMc-W5KRwG4s8KNgw_0 2024-09-12T01:04:39.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5739321854648315226', time=2024-09-12T02:52:56.951025+0000, chain.objs.size()=1 2024-09-12T01:04:39.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.8Viz92RUh35IimASPkaUUFw2vqKJDtK_0 2024-09-12T01:04:39.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.592403857139679106', time=2024-09-12T02:52:57.044609+0000, chain.objs.size()=1 2024-09-12T01:04:39.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.v_lU0JTkCsrscLg4NyrBm6lRGXbVSxR_0 2024-09-12T01:04:39.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9273172671148059786', time=2024-09-12T02:52:57.256243+0000, chain.objs.size()=1 2024-09-12T01:04:39.157 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.aQgJQrYkt-cqv3WkAGs96spmyQ_-kpt_0 2024-09-12T01:04:39.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15224861955864287057', time=2024-09-12T02:52:57.285261+0000, chain.objs.size()=1 2024-09-12T01:04:39.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.e_b-D3PsTuwL_jjhAnB4IBbP4Zu0Ui0_0 2024-09-12T01:04:39.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11545715012536447161', time=2024-09-12T02:52:57.417777+0000, chain.objs.size()=1 2024-09-12T01:04:39.158 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.5pK5ZbdWJYoiWv-VLzfQxTZyrqlz0Df_0 2024-09-12T01:04:39.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14207659457825312955', time=2024-09-12T02:52:57.450694+0000, chain.objs.size()=1 2024-09-12T01:04:39.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.rYWp7Q3Ghls-PEIWkrJeH9ohDq-mpj-_0 2024-09-12T01:04:39.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5697972689060964105', time=2024-09-12T02:52:57.487436+0000, chain.objs.size()=1 2024-09-12T01:04:39.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.H7OuLubz5BcYGsaUxe74ethcwKuued9_0 2024-09-12T01:04:39.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17837913914736621096', time=2024-09-12T02:52:57.530045+0000, chain.objs.size()=1 2024-09-12T01:04:39.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.FwJZVkIxV02VI5CrNw2ncf9jwC9Ikte_0 2024-09-12T01:04:39.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7256925678319039672', time=2024-09-12T02:52:57.631971+0000, chain.objs.size()=1 2024-09-12T01:04:39.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ZM97Q_lKa6QANouksHycw5GBooeqQVL_0 2024-09-12T01:04:39.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7237892757615520333', time=2024-09-12T02:52:57.714832+0000, chain.objs.size()=1 2024-09-12T01:04:39.159 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.EF3_aM524oK0Ho64AdTfKJPKDU27rXO_0 2024-09-12T01:04:39.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14450418316453446919', time=2024-09-12T02:52:57.736928+0000, chain.objs.size()=1 2024-09-12T01:04:39.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.d2qnTv6quNOZ2FX8tSVwnzxhWh9KgH2_0 2024-09-12T01:04:39.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12903841260636743065', time=2024-09-12T02:52:57.749643+0000, chain.objs.size()=1 2024-09-12T01:04:39.160 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.7rfIzoXpnWliUOohJujliXaVQmwZQY0_0 2024-09-12T01:04:39.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14189057654280268337', time=2024-09-12T02:52:58.124825+0000, chain.objs.size()=1 2024-09-12T01:04:39.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.w4gvJc7zsM2EBUIWyum1b0GdBNL82Co_0 2024-09-12T01:04:39.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4599294008797675449', time=2024-09-12T02:52:58.159030+0000, chain.objs.size()=1 2024-09-12T01:04:39.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.BgXNcBnCMCX58aCihdOyCuJe7QCg508_0 2024-09-12T01:04:39.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7087147485827630369', time=2024-09-12T02:52:58.166577+0000, chain.objs.size()=1 2024-09-12T01:04:39.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_._zpe3Nh4SR1uZJBfZ6hZ8eeFrpTvgtS_0 2024-09-12T01:04:39.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6456607278398522430', time=2024-09-12T02:52:58.216359+0000, chain.objs.size()=1 2024-09-12T01:04:39.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.PKGgurHieJIutW6kfH0bQ9HhOlWQ8dj_0 2024-09-12T01:04:39.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16320129402525264877', time=2024-09-12T02:52:58.217156+0000, chain.objs.size()=1 2024-09-12T01:04:39.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.C23OjcGKilBjm2bmjVeB9EBx64R9rFs_0 2024-09-12T01:04:39.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5395661145324483206', time=2024-09-12T02:52:58.246865+0000, chain.objs.size()=1 2024-09-12T01:04:39.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.RbMfTbxcSG1qLXLHw-rArxr6oSXgQo5_0 2024-09-12T01:04:39.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16247794309384769682', time=2024-09-12T02:52:58.247599+0000, chain.objs.size()=1 2024-09-12T01:04:39.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.wecNAporw8FMlXXEAcFqCAY1SiddsBD_0 2024-09-12T01:04:39.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7184324685967421311', time=2024-09-12T02:52:58.250069+0000, chain.objs.size()=1 2024-09-12T01:04:39.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.N0ymTMTWK2pFriyHc-Ds7Pa9W9lfetm_0 2024-09-12T01:04:39.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.741567239291279827', time=2024-09-12T02:52:58.391996+0000, chain.objs.size()=1 2024-09-12T01:04:39.162 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.158+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.61CUG2uG_IYJQgF9Ze41VdYuCoRDvzg_0 2024-09-12T01:04:39.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.162+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3470781947294448226', time=2024-09-12T02:52:58.418545+0000, chain.objs.size()=1 2024-09-12T01:04:39.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.162+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.fk9RhfoZSYMett_yEPLlESeLPp3h-BR_0 2024-09-12T01:04:39.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.162+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5831916295263636631', time=2024-09-12T02:52:58.421575+0000, chain.objs.size()=1 2024-09-12T01:04:39.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.162+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.7UA1J4kh0esXELVKRZaWRaT9EfQY4GY_0 2024-09-12T01:04:39.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.162+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12622948334512161807', time=2024-09-12T02:52:58.482021+0000, chain.objs.size()=1 2024-09-12T01:04:39.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.162+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.mB9rKHrSNgMh7VDqrtEBe7rm0AD4oim_0 2024-09-12T01:04:39.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.162+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10434890797712921415', time=2024-09-12T02:52:58.497965+0000, chain.objs.size()=1 2024-09-12T01:04:39.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.162+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.AwhfMxR5-ULfW2eS4XEhRqChYz4s0PC_0 2024-09-12T01:04:39.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.162+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5661096406137421582', time=2024-09-12T02:52:58.502426+0000, chain.objs.size()=1 2024-09-12T01:04:39.163 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.162+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.eoeoQqGZLe0RIrUhZz2-oxYamL4cYlx_0 2024-09-12T01:04:39.164 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.162+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49225 2024-09-12T01:04:39.167 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.166+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T01:04:39.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.166+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17178552997086223975', time=2024-09-12T02:52:58.665648+0000, chain.objs.size()=1 2024-09-12T01:04:39.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.166+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.jXpVR3kUGqt4pRZrU8n28oRYTGh6UJc_0 2024-09-12T01:04:39.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.166+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18103334836689034791', time=2024-09-12T02:52:58.688780+0000, chain.objs.size()=1 2024-09-12T01:04:39.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.166+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.CfOO9yNPUJE8roQDCoCbxL1mQydZkb0_0 2024-09-12T01:04:39.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.166+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15786978132338129127', time=2024-09-12T02:53:26.899222+0000, chain.objs.size()=1 2024-09-12T01:04:39.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.166+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.369__shadow_.7F3-Y0OCUFuws2wdNuc6qtb0n2yI-Ha_0 2024-09-12T01:04:39.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.166+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3051981330995763740', time=2024-09-12T02:54:12.971103+0000, chain.objs.size()=1 2024-09-12T01:04:39.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.166+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.429__shadow_.mcXYh7hLj1PzgTo6W2oZXrWIDIkWHm7_0 2024-09-12T01:04:39.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.166+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12777089661369127190', time=2024-09-12T02:54:37.630435+0000, chain.objs.size()=1 2024-09-12T01:04:39.168 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.166+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.459__shadow_.FRQJDki62Qk3Qf_mq-Z_91c6y-Etm_Q_0 2024-09-12T01:04:39.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.166+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2196173699079291481', time=2024-09-12T02:54:43.758696+0000, chain.objs.size()=1 2024-09-12T01:04:39.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.166+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.465__shadow_.zFwBll8hnZPHXhHnb-YXB5HGcHUy8bG_0 2024-09-12T01:04:39.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.166+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17760414336411378235', time=2024-09-12T02:54:57.336590+0000, chain.objs.size()=1 2024-09-12T01:04:39.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.166+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.488__shadow_.zd28AYH1ze4K5PLCzDOT0ex--KhJUbV_0 2024-09-12T01:04:39.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.166+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12459963557839195572', time=2024-09-12T02:54:58.157871+0000, chain.objs.size()=1 2024-09-12T01:04:39.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.166+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.489__shadow_.1PUTiabJsGnxOAbw9pQwAxSpXu1yFIE_0 2024-09-12T01:04:39.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.166+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.90723901148126720', time=2024-09-12T02:55:16.487763+0000, chain.objs.size()=1 2024-09-12T01:04:39.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.166+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.516__multipart_mymultipartcopy.2~p6EWvZMI8I6HlwJPfSJUrGaERo2tXuV.1 2024-09-12T01:04:39.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.166+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.139230391538201736', time=2024-09-12T02:57:15.774945+0000, chain.objs.size()=1 2024-09-12T01:04:39.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.166+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.574__shadow:sUuiZDKgFbtmyf6VRiygF5tfHi-xua1_.jsYB8fVxQ_2pgfFu6Hy_3toRsM2DFga_0 2024-09-12T01:04:39.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.166+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2313731861792062476', time=2024-09-12T02:57:25.826575+0000, chain.objs.size()=1 2024-09-12T01:04:39.169 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.166+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:ygRdjObk.srw81cZKXXxCDihjoK4J94_.6r6gRxFEXJ188Vx9JaQxzSlzCjvC59G_0 2024-09-12T01:04:39.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.166+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7587541647397886311', time=2024-09-12T02:57:28.178775+0000, chain.objs.size()=1 2024-09-12T01:04:39.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.166+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:4EruUN83VZJBT.dDtAc6.-0v5TEJDhh_.LUl1PzslIyNskjiU4TMxqo1Crl5AV1W_0 2024-09-12T01:04:39.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.170+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14584353858791901624', time=2024-09-12T02:57:46.342848+0000, chain.objs.size()=1 2024-09-12T01:04:39.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.170+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.580__shadow:rXXOQ7Xlyq8t1.c0yPpQMW7i9.5-9uq_.hCGEAbdKIG7Jgtm13ZlKUvKdszFl9XS_0 2024-09-12T01:04:39.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.170+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2877723439674124823', time=2024-09-12T02:57:51.355038+0000, chain.objs.size()=1 2024-09-12T01:04:39.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.170+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.586__shadow:2Di7VD77UV-fAc-irB5J1olcwKR8d8j_.gVt8CdjD4dGich_v3vtov25s_lMll0u_0 2024-09-12T01:04:39.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.170+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3963218941075691840', time=2024-09-12T03:00:35.770796+0000, chain.objs.size()=1 2024-09-12T01:04:39.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.170+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.627__shadow_.trBei_6lBgDpNnM4G4bt_V8Rl1RIEY0_0 2024-09-12T01:04:39.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.170+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11986335204109144077', time=2024-09-12T03:00:36.505639+0000, chain.objs.size()=1 2024-09-12T01:04:39.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.170+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.628__shadow_.EuzjjtJcZOsBaHprmg3RwsQHwldqRHx_0 2024-09-12T01:04:39.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.170+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13814124701905328793', time=2024-09-12T03:01:07.382449+0000, chain.objs.size()=1 2024-09-12T01:04:39.171 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.170+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.665__shadow_.XOlrEDapNXETmIqhCiEMMi04TZez0Ca_0 2024-09-12T01:04:39.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.174+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:39.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.174+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:04:39.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.178+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:39.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.178+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:39.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.178+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52927' 2024-09-12T01:04:39.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.178+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='_fzKaAI_rama9_BdD7yxwGyIiP5gOytZ', time=2024-09-12T02:48:32.760484+0000, chain.objs.size()=3 2024-09-12T01:04:39.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.178+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.160__shadow_.rbfC6NTjNuE37t7l78ntIvNB6OjTiwo_0 2024-09-12T01:04:39.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.178+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.160__shadow_.rbfC6NTjNuE37t7l78ntIvNB6OjTiwo_1 2024-09-12T01:04:39.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.178+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.160__shadow_.rbfC6NTjNuE37t7l78ntIvNB6OjTiwo_2 2024-09-12T01:04:39.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.178+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8395403348820063303', time=2024-09-12T02:49:12.356018+0000, chain.objs.size()=1 2024-09-12T01:04:39.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.178+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.199__shadow_.SUOdXaeWnpFw_REcHzWGBuZz0Xr1AOW_0 2024-09-12T01:04:39.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.178+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1653354918727274771', time=2024-09-12T02:51:04.751172+0000, chain.objs.size()=1 2024-09-12T01:04:39.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.178+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.258__shadow_.L-OCwyj_6sr4m7XKLnItnkh6q1Sl8L4_0 2024-09-12T01:04:39.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.178+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1273738480466634985', time=2024-09-12T02:51:26.749472+0000, chain.objs.size()=1 2024-09-12T01:04:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.178+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.cK2G81NGlSr6u-NdibSnpExCBbRocZN_0 2024-09-12T01:04:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.178+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4124742777485399051', time=2024-09-12T02:51:26.841103+0000, chain.objs.size()=1 2024-09-12T01:04:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.178+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.MVZfsoZ8X9Z8o2A9zyi53o6mz3xzJ4K_0 2024-09-12T01:04:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.178+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6259934812442309767', time=2024-09-12T02:51:26.882968+0000, chain.objs.size()=1 2024-09-12T01:04:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.178+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.hsVYL1AKNmHUHHXrQa4rIr2K-gaLCSq_0 2024-09-12T01:04:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.178+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1154928009307131175', time=2024-09-12T02:51:27.002690+0000, chain.objs.size()=1 2024-09-12T01:04:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.178+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.J2wTD_g6Xn_lU4_CT39z-EmB7ZSe2jL_0 2024-09-12T01:04:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.178+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1937958418542293728', time=2024-09-12T02:51:27.004805+0000, chain.objs.size()=1 2024-09-12T01:04:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.178+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.jv6-J2mUFOrHnOZyVmAxxikQO5Diufu_0 2024-09-12T01:04:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.178+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.937626744193159088', time=2024-09-12T02:51:27.008192+0000, chain.objs.size()=1 2024-09-12T01:04:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.178+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.8hI1d6w3z-5wLxPrDR7fIw5wKjLVkb6_0 2024-09-12T01:04:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.178+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5308896028116669184', time=2024-09-12T02:51:27.014942+0000, chain.objs.size()=1 2024-09-12T01:04:39.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.178+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.XQCgUuNaMN-2-GSaYEeRhnbrGm-AeAR_0 2024-09-12T01:04:39.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.182+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7609077460552024327', time=2024-09-12T02:51:27.024492+0000, chain.objs.size()=1 2024-09-12T01:04:39.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.182+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.QLl5ErclZnvm05SqQOkamE_UXWHhs4B_0 2024-09-12T01:04:39.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.182+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9519178400136299712', time=2024-09-12T02:51:27.046454+0000, chain.objs.size()=1 2024-09-12T01:04:39.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.182+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.z4YiAUOdRmUtODEA-kM7Hef4orzCv9u_0 2024-09-12T01:04:39.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.182+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5065723167908687715', time=2024-09-12T02:51:27.300887+0000, chain.objs.size()=1 2024-09-12T01:04:39.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.182+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.BRwa7ruqm452XZ-N8rxODoDWTAkPCsx_0 2024-09-12T01:04:39.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.182+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8467073983845362156', time=2024-09-12T02:51:27.441340+0000, chain.objs.size()=1 2024-09-12T01:04:39.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.182+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.MS9e3ZA46BMQSi5CYAhjDR7YMfeHhiV_0 2024-09-12T01:04:39.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.182+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18167545579130268414', time=2024-09-12T02:51:27.455528+0000, chain.objs.size()=1 2024-09-12T01:04:39.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.182+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.cPUkH2FldW2TzU5N7iNO9umW7YxKQng_0 2024-09-12T01:04:39.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.182+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13047454150839653923', time=2024-09-12T02:51:27.471404+0000, chain.objs.size()=1 2024-09-12T01:04:39.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.182+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.0gs7W3-SykoHsB7oWkMT9xM5EatyXkC_0 2024-09-12T01:04:39.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.182+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.315473964858823839', time=2024-09-12T02:51:27.697480+0000, chain.objs.size()=1 2024-09-12T01:04:39.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.182+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.RRTuU8uajAnQoM6gFGLgpZJn4oKXOXU_0 2024-09-12T01:04:39.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.182+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.358231383933320082', time=2024-09-12T02:51:27.711555+0000, chain.objs.size()=1 2024-09-12T01:04:39.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.182+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.qNf-oOScttTNFV6-wpPZZFljxze095q_0 2024-09-12T01:04:39.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.182+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8388244589487036804', time=2024-09-12T02:51:27.734432+0000, chain.objs.size()=1 2024-09-12T01:04:39.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.182+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.EL9ZbAxj28SQmJm9pIaBKiRo9tbe3tu_0 2024-09-12T01:04:39.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.182+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17611900605359367227', time=2024-09-12T02:51:27.904703+0000, chain.objs.size()=1 2024-09-12T01:04:39.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.182+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.dpbzO4bGKiQm9POLL463s7ZGOM4IUg2_0 2024-09-12T01:04:39.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.182+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2218681492413529051', time=2024-09-12T02:51:27.931561+0000, chain.objs.size()=1 2024-09-12T01:04:39.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.182+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.FYtKmv8AHr_lQd_rheZsbvUHie7wyMu_0 2024-09-12T01:04:39.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.182+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2876580844878035325', time=2024-09-12T02:51:27.960285+0000, chain.objs.size()=1 2024-09-12T01:04:39.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.182+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.C_tWyDAblRR_yvxNuoy3N_YBdQZaq0r_0 2024-09-12T01:04:39.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.182+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8460340670122114005', time=2024-09-12T02:51:27.965061+0000, chain.objs.size()=1 2024-09-12T01:04:39.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.182+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Hog4jmiRnfDyitigFFihE4xSzoAmmUQ_0 2024-09-12T01:04:39.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13518191646834731408', time=2024-09-12T02:51:28.181077+0000, chain.objs.size()=1 2024-09-12T01:04:39.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.J0RvGFnrOj7rTByjY4W_8tb2o6JtVZu_0 2024-09-12T01:04:39.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17732394106983995221', time=2024-09-12T02:51:28.200888+0000, chain.objs.size()=1 2024-09-12T01:04:39.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ofyJWONnNxlcQUjFYmhY16ki5p6gBh3_0 2024-09-12T01:04:39.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9899473942465242106', time=2024-09-12T02:51:28.229234+0000, chain.objs.size()=1 2024-09-12T01:04:39.185 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.RLa5Sk6fMpXzQEiiXNtdRACtp6IAJFi_0 2024-09-12T01:04:39.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17361403022688333707', time=2024-09-12T02:51:28.246590+0000, chain.objs.size()=1 2024-09-12T01:04:39.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.kZaTutJ6EMickL4aPml9XRflVdTeve7_0 2024-09-12T01:04:39.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17791073014960491451', time=2024-09-12T02:51:28.380441+0000, chain.objs.size()=1 2024-09-12T01:04:39.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.u19sFIgxxJ_AoJkEMy6UtgQ6DsaQ9Ca_0 2024-09-12T01:04:39.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1352643464693405484', time=2024-09-12T02:51:28.383664+0000, chain.objs.size()=1 2024-09-12T01:04:39.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.-IYnyMwSi1-ew5JtiezBToMcpWNXvYM_0 2024-09-12T01:04:39.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18051231787702572752', time=2024-09-12T02:51:28.609409+0000, chain.objs.size()=1 2024-09-12T01:04:39.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.6bWqranAK8Plr-rukrXG268t7FwD4-2_0 2024-09-12T01:04:39.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10086588611907200320', time=2024-09-12T02:51:28.665260+0000, chain.objs.size()=1 2024-09-12T01:04:39.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.rdHuefAjXhigwRIn9DLgvcJGA0ECWCF_0 2024-09-12T01:04:39.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17342829939814330705', time=2024-09-12T02:51:32.207505+0000, chain.objs.size()=1 2024-09-12T01:04:39.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.267__shadow_.QtUKntpnpbV9BdUISD6pR8pTrfC9ZGz_0 2024-09-12T01:04:39.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11174691842436517374', time=2024-09-12T02:51:32.209725+0000, chain.objs.size()=1 2024-09-12T01:04:39.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.267__shadow_.XZiAaxBHuaEM0UldcfWkE37W21xNggT_0 2024-09-12T01:04:39.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6662462451997316785', time=2024-09-12T02:51:35.830358+0000, chain.objs.size()=1 2024-09-12T01:04:39.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.272__shadow_.pU7R72k_--P0g2T01cDD6cWujdKvzHC_0 2024-09-12T01:04:39.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2312423458485980042', time=2024-09-12T02:51:43.226811+0000, chain.objs.size()=1 2024-09-12T01:04:39.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.282__shadow_.mz5tFfDZA2tYLLqxxnCJLDkh1Q5tLXZ_0 2024-09-12T01:04:39.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5387280127518545915', time=2024-09-12T02:51:46.267690+0000, chain.objs.size()=1 2024-09-12T01:04:39.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.286__shadow_.rCvC9Os3ZD4ygmBPUi_zjuHJ9zuRJvs_0 2024-09-12T01:04:39.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15730788634804407640', time=2024-09-12T02:51:51.727385+0000, chain.objs.size()=1 2024-09-12T01:04:39.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.292__shadow_.Q2IjcaxAlut4smSKiQL-Gq4wN6ryoht_0 2024-09-12T01:04:39.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16831863940605881914', time=2024-09-12T02:51:53.164402+0000, chain.objs.size()=1 2024-09-12T01:04:39.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.293__shadow_.5krJHfG3V5wrSIp7RK-oXEKr4zaYzu6_0 2024-09-12T01:04:39.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8549456209395850545', time=2024-09-12T02:51:53.190799+0000, chain.objs.size()=1 2024-09-12T01:04:39.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.293__shadow_.wHnIoThACXxxiMTW-FjkjyEmabpKa0Q_0 2024-09-12T01:04:39.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7123699768915310617', time=2024-09-12T02:51:53.920901+0000, chain.objs.size()=1 2024-09-12T01:04:39.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.294__shadow_.9Cq2NB8BD0qL6aLuHjMmPI3h_TtwYaH_0 2024-09-12T01:04:39.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17309491867899867195', time=2024-09-12T02:52:12.949360+0000, chain.objs.size()=1 2024-09-12T01:04:39.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.319__shadow:ERx8-NeFTJ1BzobbRxwyITW29Tyk9Lj_.JjTp9obfanjkwGOSG5GocpVahdBVcMI_0 2024-09-12T01:04:39.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2966211253827930392', time=2024-09-12T02:52:35.094647+0000, chain.objs.size()=1 2024-09-12T01:04:39.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Yjgy-2PvX9Ygr20MC1p7tXEZKQh_mGZ_0 2024-09-12T01:04:39.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4039264013049016059', time=2024-09-12T02:52:35.109428+0000, chain.objs.size()=1 2024-09-12T01:04:39.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.fYPcbkeURpc6RPyCRIkNxtexQHsMyn8_0 2024-09-12T01:04:39.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4745591246649532091', time=2024-09-12T02:52:35.142470+0000, chain.objs.size()=1 2024-09-12T01:04:39.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.186+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.cBkzNvxfHn0BCTaHM9QLZp7kH-9Hq29_0 2024-09-12T01:04:39.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.190+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12230715706901953220', time=2024-09-12T02:52:35.146704+0000, chain.objs.size()=1 2024-09-12T01:04:39.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.190+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.DNo50VNoQ5GTHgLrbWjX_icmR6c4P5y_0 2024-09-12T01:04:39.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.190+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11501591929203789692', time=2024-09-12T02:52:35.323148+0000, chain.objs.size()=1 2024-09-12T01:04:39.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.190+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.IlDn1kVTG2Grzfevk1Y4VyhKw47-YpH_0 2024-09-12T01:04:39.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.190+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12101220645740455443', time=2024-09-12T02:52:35.340799+0000, chain.objs.size()=1 2024-09-12T01:04:39.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.190+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.VCrBrFL4Jxzw3_uRZySjbHIyONEjbvX_0 2024-09-12T01:04:39.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.190+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3641049102016517452', time=2024-09-12T02:52:35.391454+0000, chain.objs.size()=1 2024-09-12T01:04:39.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.190+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.sR9aC3AaA-Nv1wxS1Rw9RhxysJ8Oa9Y_0 2024-09-12T01:04:39.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.190+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3130949279935833005', time=2024-09-12T02:52:35.399915+0000, chain.objs.size()=1 2024-09-12T01:04:39.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.190+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.mSaezpl7x2rQRzXRgsKtD3bhkUqhsZL_0 2024-09-12T01:04:39.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.190+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.905217672384711984', time=2024-09-12T02:52:35.425613+0000, chain.objs.size()=1 2024-09-12T01:04:39.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.190+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.MKipEMyntK34I7-8nrQL7Z6ZF5aAh2Q_0 2024-09-12T01:04:39.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.190+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15498038882795745599', time=2024-09-12T02:52:35.536686+0000, chain.objs.size()=1 2024-09-12T01:04:39.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.190+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.3-lALv5-ZuWYw4_rnl6r-Yg4FPKo-o5_0 2024-09-12T01:04:39.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.190+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2675179591514032772', time=2024-09-12T02:52:35.567453+0000, chain.objs.size()=1 2024-09-12T01:04:39.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.190+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.a3YgP-sTVLf0ov3HUT1cP8ReT5BeO1Q_0 2024-09-12T01:04:39.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.190+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2534632653348047632', time=2024-09-12T02:52:35.594309+0000, chain.objs.size()=1 2024-09-12T01:04:39.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.190+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.eiZ-gofMcQKt7SURIER2k7c4po6pL9c_0 2024-09-12T01:04:39.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.190+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6600420691456248969', time=2024-09-12T02:52:35.596677+0000, chain.objs.size()=1 2024-09-12T01:04:39.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.190+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.211VFw2RTIWTAbZDSGGijpc-Ysojoyn_0 2024-09-12T01:04:39.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.190+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3582739667197992578', time=2024-09-12T02:52:35.782804+0000, chain.objs.size()=1 2024-09-12T01:04:39.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.190+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.gs_Bvl0C2KQQP3yexCBhmlkf13hRhCE_0 2024-09-12T01:04:39.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.190+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6111378996823921318', time=2024-09-12T02:52:35.789992+0000, chain.objs.size()=1 2024-09-12T01:04:39.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.190+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.j2LKE4iClHiqlGRyzqt4FAyvIxWw8vt_0 2024-09-12T01:04:39.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7406683456383557610', time=2024-09-12T02:52:35.808480+0000, chain.objs.size()=1 2024-09-12T01:04:39.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.wCrqi7ZfLhEpLiEqZcpT9v8XztCVf06_0 2024-09-12T01:04:39.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15418239391615217974', time=2024-09-12T02:52:36.315625+0000, chain.objs.size()=1 2024-09-12T01:04:39.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.NoQaP7atJF5kd_OMcN7-zZXxeV42pzV_0 2024-09-12T01:04:39.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2005083591830990748', time=2024-09-12T02:52:36.371734+0000, chain.objs.size()=1 2024-09-12T01:04:39.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.5K2ESFrs_dRXEi_qY9kOJSAa0UPfNbp_0 2024-09-12T01:04:39.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12881100910183432413', time=2024-09-12T02:52:36.506879+0000, chain.objs.size()=1 2024-09-12T01:04:39.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.F59pZUg5c30Qp4FH5n4dzrElbmze-An_0 2024-09-12T01:04:39.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16314012195944513773', time=2024-09-12T02:52:36.582644+0000, chain.objs.size()=1 2024-09-12T01:04:39.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.-6aC0nO2704fcgjie5B6FtD_AInbdQg_0 2024-09-12T01:04:39.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8841388058802186670', time=2024-09-12T02:52:36.592266+0000, chain.objs.size()=1 2024-09-12T01:04:39.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.FUxfYeA-PCkvlluutouE_iS9eQgSrBU_0 2024-09-12T01:04:39.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16515870486797458757', time=2024-09-12T02:52:36.757883+0000, chain.objs.size()=1 2024-09-12T01:04:39.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.-fW1lTr8QwqZ9gNcXfTTJ8Uzuv6diap_0 2024-09-12T01:04:39.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8822170523927207474', time=2024-09-12T02:52:36.771261+0000, chain.objs.size()=1 2024-09-12T01:04:39.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.01hEsDDK7r238Q0DwjI6vb1-XfGF-Bx_0 2024-09-12T01:04:39.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15290846469254785926', time=2024-09-12T02:52:36.772978+0000, chain.objs.size()=1 2024-09-12T01:04:39.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.v4Yimow_EuIqufzQOnPl1UAiL332KwE_0 2024-09-12T01:04:39.196 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8150555702401196717', time=2024-09-12T02:52:36.837283+0000, chain.objs.size()=1 2024-09-12T01:04:39.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.UyPn6JJqS32qaahrbkdh7-gTxBQpg0L_0 2024-09-12T01:04:39.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9024361247850293664', time=2024-09-12T02:52:36.885092+0000, chain.objs.size()=1 2024-09-12T01:04:39.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.hfxiOXoMMBe3oPT3EuTl9FGABb_TOs3_0 2024-09-12T01:04:39.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7052634718280289111', time=2024-09-12T02:52:36.991252+0000, chain.objs.size()=1 2024-09-12T01:04:39.197 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.7xF1tglEtdU0xm5ShUaLHcwE2OeHuZj_0 2024-09-12T01:04:39.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11267779011998293264', time=2024-09-12T02:52:56.974118+0000, chain.objs.size()=1 2024-09-12T01:04:39.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Yx2qlV3vD9dPu-X_8RVnCU-E1kGrZMn_0 2024-09-12T01:04:39.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12976983528330056429', time=2024-09-12T02:52:57.009005+0000, chain.objs.size()=1 2024-09-12T01:04:39.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.lM4cVHYPgx23MNJczMSb9BEJRnXUTNy_0 2024-09-12T01:04:39.198 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.900131038386403280', time=2024-09-12T02:52:57.159721+0000, chain.objs.size()=1 2024-09-12T01:04:39.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Q-QVw8OqT0UTXvtzKJ3oqQOzi5J2HYW_0 2024-09-12T01:04:39.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13282182339180787534', time=2024-09-12T02:52:57.182235+0000, chain.objs.size()=1 2024-09-12T01:04:39.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.umUEv7L93j52ZDO5SG1aqLbeNm5ousX_0 2024-09-12T01:04:39.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17497681619018690299', time=2024-09-12T02:52:57.236382+0000, chain.objs.size()=1 2024-09-12T01:04:39.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.7R7qF42CCZI_WFRKM8MnT5tp8qRVY1u_0 2024-09-12T01:04:39.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8732132781386371467', time=2024-09-12T02:52:57.257313+0000, chain.objs.size()=1 2024-09-12T01:04:39.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.NWjIgT5TyAx3xEUHwwuFpjquYOeUw80_0 2024-09-12T01:04:39.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1670641653124847649', time=2024-09-12T02:52:57.268690+0000, chain.objs.size()=1 2024-09-12T01:04:39.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.2pSHxIy5qPWVbf27UZwm-z0JvW9U7Rf_0 2024-09-12T01:04:39.199 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8094742343866835892', time=2024-09-12T02:52:57.283603+0000, chain.objs.size()=1 2024-09-12T01:04:39.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.a9jsrqEnc-jQx9TgbHKh0tHNehDkbX3_0 2024-09-12T01:04:39.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.787142574100363482', time=2024-09-12T02:52:57.410231+0000, chain.objs.size()=1 2024-09-12T01:04:39.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.RdZTFS4xHg0GX_zR0pbY69ustQnkHpG_0 2024-09-12T01:04:39.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11902110554167391679', time=2024-09-12T02:52:57.442672+0000, chain.objs.size()=1 2024-09-12T01:04:39.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.194+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.UPsHtPxNtkZ1LjfPX9cO_R4b2mSMxzd_0 2024-09-12T01:04:39.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3253608746222490341', time=2024-09-12T02:52:57.444596+0000, chain.objs.size()=1 2024-09-12T01:04:39.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.RM62lEqiVsG-OlfFOyNfGBBiVW2nfhb_0 2024-09-12T01:04:39.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7901904860597320930', time=2024-09-12T02:52:57.458380+0000, chain.objs.size()=1 2024-09-12T01:04:39.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.U7eH0EdBgkX1kuW_28CJNvNZWR3Rk8M_0 2024-09-12T01:04:39.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5307925450254382245', time=2024-09-12T02:52:57.476635+0000, chain.objs.size()=1 2024-09-12T01:04:39.200 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.vte1gsjDcP2BfnOuXDSR758f76wxFYw_0 2024-09-12T01:04:39.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12287164119975291105', time=2024-09-12T02:52:57.477636+0000, chain.objs.size()=1 2024-09-12T01:04:39.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.uy5raV6xe3HOSWYkI8nhN5TwKvB94Aj_0 2024-09-12T01:04:39.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11087607928786455502', time=2024-09-12T02:52:57.495436+0000, chain.objs.size()=1 2024-09-12T01:04:39.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.p_vMzvgfgMN_Sck0SdRUIUONZJbpsLE_0 2024-09-12T01:04:39.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7554438099712894025', time=2024-09-12T02:52:57.515565+0000, chain.objs.size()=1 2024-09-12T01:04:39.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.4-Qk22OO8Hhci5dGDR5bY64d94oOQUZ_0 2024-09-12T01:04:39.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15518375331979319062', time=2024-09-12T02:52:57.517228+0000, chain.objs.size()=1 2024-09-12T01:04:39.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.eqJxesCpkDRtyrKrZd16Fi4nlUOX8By_0 2024-09-12T01:04:39.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9424549761191760945', time=2024-09-12T02:52:57.649628+0000, chain.objs.size()=1 2024-09-12T01:04:39.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.eQjzmqbdRAlIBejWljLQxcxjg5-lzbA_0 2024-09-12T01:04:39.201 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9019026113689565612', time=2024-09-12T02:52:57.865521+0000, chain.objs.size()=1 2024-09-12T01:04:39.202 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.QAnlCD3dcMVUYtF1mds_M1akwlMfu5y_0 2024-09-12T01:04:39.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9631413617900897077', time=2024-09-12T02:52:57.897258+0000, chain.objs.size()=1 2024-09-12T01:04:39.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.a8PluD7Hrk73CydOq8Zabdwy_3q8vZN_0 2024-09-12T01:04:39.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6920234108333218351', time=2024-09-12T02:52:57.906812+0000, chain.objs.size()=1 2024-09-12T01:04:39.203 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.A3pKW8q1ZTYZk24_DYGCKlCpx_Capym_0 2024-09-12T01:04:39.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13612178866048916811', time=2024-09-12T02:52:58.194528+0000, chain.objs.size()=1 2024-09-12T01:04:39.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.I8R8JILI-vkA_ncbl5rWDTeTtgxI9ZE_0 2024-09-12T01:04:39.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8941448946172955861', time=2024-09-12T02:52:58.206642+0000, chain.objs.size()=1 2024-09-12T01:04:39.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.pF4CCXeMP-Ok2CvAWxEDvO76XzGbJkz_0 2024-09-12T01:04:39.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7582945418750558752', time=2024-09-12T02:52:58.219042+0000, chain.objs.size()=1 2024-09-12T01:04:39.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ymbg85I7hanWKVaCdK1L40VDxSaS0mF_0 2024-09-12T01:04:39.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.453265977773508963', time=2024-09-12T02:52:58.238305+0000, chain.objs.size()=1 2024-09-12T01:04:39.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.HROixMZKG06BCP53Aks46-E5QbEnorN_0 2024-09-12T01:04:39.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6442900358536304534', time=2024-09-12T02:52:58.471063+0000, chain.objs.size()=1 2024-09-12T01:04:39.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.g_rH0lbZknewuM9HjI_0CjiqxUQmONW_0 2024-09-12T01:04:39.204 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4141818466275936548', time=2024-09-12T02:52:58.497962+0000, chain.objs.size()=1 2024-09-12T01:04:39.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.JqF_Z53JUkKzPBT10LGJGl_PZOfBuMS_0 2024-09-12T01:04:39.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1516930489936155855', time=2024-09-12T02:54:33.554368+0000, chain.objs.size()=1 2024-09-12T01:04:39.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.198+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.455__shadow_.Qa-Zi83-3WS2DdVwOlGi8pZ42YgQe_r_0 2024-09-12T01:04:39.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.202+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14099397322059061168', time=2024-09-12T02:55:00.531458+0000, chain.objs.size()=1 2024-09-12T01:04:39.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.202+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.493__shadow_.hL0ovKLaOp_R3_ddkrCc2aK26gHIgeC_0 2024-09-12T01:04:39.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.202+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4580666624227217889', time=2024-09-12T02:55:07.607683+0000, chain.objs.size()=1 2024-09-12T01:04:39.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.202+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.503__shadow:6LMeYfVzuD7PUiSwyt-9RW46Hh57mqn_.UcslrmdoBCcU7pOGIUMlA4mj_NOCVe1_0 2024-09-12T01:04:39.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.202+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15017013534622396791', time=2024-09-12T02:55:45.962216+0000, chain.objs.size()=2 2024-09-12T01:04:39.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.202+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.523__multipart_mymultipart.2~C7ecjwalfjgb6_psThFQQ67yLvRmXUY.1 2024-09-12T01:04:39.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.202+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.523__multipart_mymultipart.2~C7ecjwalfjgb6_psThFQQ67yLvRmXUY.2 2024-09-12T01:04:39.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.202+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2809696208820094735', time=2024-09-12T02:55:54.338895+0000, chain.objs.size()=7 2024-09-12T01:04:39.205 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.202+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.527__multipart_mymultipart.2~GGJd0YWnGAUrz82qtlUgc8bc_3fqie1.1 2024-09-12T01:04:39.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.202+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.527__shadow_mymultipart.2~GGJd0YWnGAUrz82qtlUgc8bc_3fqie1.1_1 2024-09-12T01:04:39.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.202+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.527__multipart_mymultipart.2~GGJd0YWnGAUrz82qtlUgc8bc_3fqie1.2 2024-09-12T01:04:39.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.202+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.527__shadow_mymultipart.2~GGJd0YWnGAUrz82qtlUgc8bc_3fqie1.2_1 2024-09-12T01:04:39.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.202+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.527__multipart_mymultipart.2~GGJd0YWnGAUrz82qtlUgc8bc_3fqie1.3 2024-09-12T01:04:39.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.202+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.527__shadow_mymultipart.2~GGJd0YWnGAUrz82qtlUgc8bc_3fqie1.3_1 2024-09-12T01:04:39.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.202+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.527__multipart_mymultipart.2~GGJd0YWnGAUrz82qtlUgc8bc_3fqie1.4 2024-09-12T01:04:39.206 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.206+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/52927 2024-09-12T01:04:39.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.206+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T01:04:39.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.206+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9800378517610680808', time=2024-09-12T02:57:10.376909+0000, chain.objs.size()=1 2024-09-12T01:04:39.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.206+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.570__shadow:W-r3RNIvOu9399VYuKuElav.x1SZmy3_.8hXAbT_EV3MefvzLgTRuo__zE-8HZdh_0 2024-09-12T01:04:39.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.206+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3835889365683622386', time=2024-09-12T02:57:46.304330+0000, chain.objs.size()=1 2024-09-12T01:04:39.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.206+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.580__shadow:rXXOQ7Xlyq8t1.c0yPpQMW7i9.5-9uq_.hCGEAbdKIG7Jgtm13ZlKUvKdszFl9XS_0 2024-09-12T01:04:39.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.206+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7594320464508249885', time=2024-09-12T02:57:52.283554+0000, chain.objs.size()=1 2024-09-12T01:04:39.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.206+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.587__shadow:gXvbYVo3Aq6sWabx2Sj7Vb0MK8342xl_.TlytA-ZTn5GJ7cu0qAApNaE-7ZIm7FN_0 2024-09-12T01:04:39.208 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.206+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10112405342659653264', time=2024-09-12T02:58:03.961608+0000, chain.objs.size()=1 2024-09-12T01:04:39.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.206+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.605__shadow_.aSsgYGzi4HSDFHWdefWGceqG_a0YQ7F_0 2024-09-12T01:04:39.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.206+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7266929819917447453', time=2024-09-12T03:00:44.070385+0000, chain.objs.size()=1 2024-09-12T01:04:39.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.206+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.638__shadow_._hH0WW-JZJ92cH5mVY5xsvJwJSJV9TP_0 2024-09-12T01:04:39.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.206+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.132684524539494143', time=2024-09-12T03:01:32.654414+0000, chain.objs.size()=1 2024-09-12T01:04:39.209 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.206+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.704__shadow:iM1E4V.erQfa-pkDRdzv2Sx1ckhywbz_.T_62JeGavksNzJ0g3zZ5pjSYzMUwm6M_0 2024-09-12T01:04:39.210 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.210+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:39.212 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.210+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:04:39.213 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.214+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:39.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.214+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:39.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.214+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45295' 2024-09-12T01:04:39.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.214+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='_GatfBGyX3aI4cF2ih_2L4H4gWBmarpQ', time=2024-09-12T02:48:35.477640+0000, chain.objs.size()=3 2024-09-12T01:04:39.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.214+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.161__shadow_.Uh_Naz8LepLICmhuviJhi9bOWeYAPrg_0 2024-09-12T01:04:39.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.214+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.161__shadow_.Uh_Naz8LepLICmhuviJhi9bOWeYAPrg_1 2024-09-12T01:04:39.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.214+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.161__shadow_.Uh_Naz8LepLICmhuviJhi9bOWeYAPrg_2 2024-09-12T01:04:39.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.214+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12467020993805848625', time=2024-09-12T02:50:41.971278+0000, chain.objs.size()=1 2024-09-12T01:04:39.215 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.214+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.230__shadow_.hYm32uV3YvifRZVA4gGfzuAN2zQrXuu_0 2024-09-12T01:04:39.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.214+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16442599508664478032', time=2024-09-12T02:50:53.007288+0000, chain.objs.size()=1 2024-09-12T01:04:39.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.214+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.243__shadow_.B0c5JLSzxtmWFu2C1aQK-bziI6NWiOQ_0 2024-09-12T01:04:39.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.214+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12290844763951932149', time=2024-09-12T02:51:04.750813+0000, chain.objs.size()=1 2024-09-12T01:04:39.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.214+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.258__shadow_.Ee2ZhfGaLZgwyPKc5SefleqqkjVvqyC_0 2024-09-12T01:04:39.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.214+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16079239998876596833', time=2024-09-12T02:51:26.760710+0000, chain.objs.size()=1 2024-09-12T01:04:39.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.214+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.1U1C62CBeu8p7hLAZXI-aaIPX-9hsvb_0 2024-09-12T01:04:39.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.214+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17370087705648343816', time=2024-09-12T02:51:26.797117+0000, chain.objs.size()=1 2024-09-12T01:04:39.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.214+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.1shkgO-u8bIMUrOnQ8sM71VlOAAvtWj_0 2024-09-12T01:04:39.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.214+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2412087625213030213', time=2024-09-12T02:51:26.988887+0000, chain.objs.size()=1 2024-09-12T01:04:39.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.214+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.cO5ekNJOtmZdLLFYSGYKe097ZMzq9vk_0 2024-09-12T01:04:39.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.214+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1941744760343730979', time=2024-09-12T02:51:27.009098+0000, chain.objs.size()=1 2024-09-12T01:04:39.216 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.214+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.agaju8B-8t2_rj70DqMf1NqUYHfK9Qi_0 2024-09-12T01:04:39.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.214+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8890916241860347737', time=2024-09-12T02:51:27.060286+0000, chain.objs.size()=1 2024-09-12T01:04:39.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.214+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.KP8ju5QbHaaUM03y0cJnti_ZjOPKGjJ_0 2024-09-12T01:04:39.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.214+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.80229809468833830', time=2024-09-12T02:51:27.068534+0000, chain.objs.size()=1 2024-09-12T01:04:39.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.214+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.0BdCTQcObwD9-RccyvhopA7J15fRV5U_0 2024-09-12T01:04:39.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.218+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13189036813441685016', time=2024-09-12T02:51:27.225372+0000, chain.objs.size()=1 2024-09-12T01:04:39.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.218+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.IGsRxT9KwceEklTdyU5J2JuLVGhN9Z9_0 2024-09-12T01:04:39.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.218+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16225540775809166406', time=2024-09-12T02:51:27.270201+0000, chain.objs.size()=1 2024-09-12T01:04:39.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.218+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.1krkA1CvXmCnXo4I1GNmOFS5JJ4fr3W_0 2024-09-12T01:04:39.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.218+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8110409149952595538', time=2024-09-12T02:51:27.274200+0000, chain.objs.size()=1 2024-09-12T01:04:39.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.218+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.PJXZBw8PlvhWY6jDttzEbO1W5eNGCGG_0 2024-09-12T01:04:39.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.218+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4030777110585743150', time=2024-09-12T02:51:27.311168+0000, chain.objs.size()=1 2024-09-12T01:04:39.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.218+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.gPoscz-Z3iTYqtFxOu75H2_uFsCMfkE_0 2024-09-12T01:04:39.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.218+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2072972467820819052', time=2024-09-12T02:51:27.317083+0000, chain.objs.size()=1 2024-09-12T01:04:39.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.218+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.CIY_j7K7_fJDxXuVUEdEvFoWuVgeJ8e_0 2024-09-12T01:04:39.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.218+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4976642207687245381', time=2024-09-12T02:51:27.417884+0000, chain.objs.size()=1 2024-09-12T01:04:39.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.218+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.KMNewa4Lm8zJwsqLx6jBoRmI21AzfBT_0 2024-09-12T01:04:39.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.218+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3746487261801903461', time=2024-09-12T02:51:27.494764+0000, chain.objs.size()=1 2024-09-12T01:04:39.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.218+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.zrGKnw7Syb8pALl0RMfrBK6q0PzXXer_0 2024-09-12T01:04:39.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.218+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10626669988464129847', time=2024-09-12T02:51:27.500573+0000, chain.objs.size()=1 2024-09-12T01:04:39.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.218+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.DRq0KPs1l-jLjTy8XA1k-rpnyXCciUn_0 2024-09-12T01:04:39.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.218+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10634702716056564174', time=2024-09-12T02:51:27.505021+0000, chain.objs.size()=1 2024-09-12T01:04:39.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.218+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Q6aowwGzLv5RIrVapmYXhmxrp8lNBoc_0 2024-09-12T01:04:39.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.218+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6267909825960086525', time=2024-09-12T02:51:27.507997+0000, chain.objs.size()=1 2024-09-12T01:04:39.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.218+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.WUDKeU3uK6W-B-iMe4roogOifTZ2QJe_0 2024-09-12T01:04:39.220 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.218+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14516392148176709372', time=2024-09-12T02:51:27.512365+0000, chain.objs.size()=1 2024-09-12T01:04:39.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.218+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.TPh3eGDi6-m4sZdhj2Nv_MOOAhtZC3J_0 2024-09-12T01:04:39.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16129695161242848033', time=2024-09-12T02:51:27.664044+0000, chain.objs.size()=1 2024-09-12T01:04:39.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.825p30lW-ewQGwt8tSusUXgh7q2jNUw_0 2024-09-12T01:04:39.221 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9602655307600270716', time=2024-09-12T02:51:27.682912+0000, chain.objs.size()=1 2024-09-12T01:04:39.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.wTKQlSWkyFcskQlX7U1YyFipUSD80Jz_0 2024-09-12T01:04:39.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11138659887971130373', time=2024-09-12T02:51:27.687549+0000, chain.objs.size()=1 2024-09-12T01:04:39.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.jOhfGmWWnvi5bQNYkG83qDMGf4YZMAX_0 2024-09-12T01:04:39.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16742583722407390716', time=2024-09-12T02:51:27.721603+0000, chain.objs.size()=1 2024-09-12T01:04:39.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.s4qnNbYDwqxkFHArrln1QyvQ3LzyMOX_0 2024-09-12T01:04:39.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6148760902286654944', time=2024-09-12T02:51:27.928316+0000, chain.objs.size()=1 2024-09-12T01:04:39.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.hTBubSHeTa8w1EuCMvbZeoJm258wv9d_0 2024-09-12T01:04:39.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4253100397851894530', time=2024-09-12T02:51:27.931114+0000, chain.objs.size()=1 2024-09-12T01:04:39.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.aElYbeuFRdeOS5Fmv0qJdpjMXhW_Hpl_0 2024-09-12T01:04:39.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16794212946893869223', time=2024-09-12T02:51:27.937600+0000, chain.objs.size()=1 2024-09-12T01:04:39.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Pf_-XoT4bHh_5GBwvsR4-Ms9lMn5EY1_0 2024-09-12T01:04:39.222 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.505038238675176794', time=2024-09-12T02:51:27.947552+0000, chain.objs.size()=1 2024-09-12T01:04:39.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.cQaFPmcbR2sMvA14oXryAEfP5wsc1H8_0 2024-09-12T01:04:39.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14927349293950365162', time=2024-09-12T02:51:28.133361+0000, chain.objs.size()=1 2024-09-12T01:04:39.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.j9qA2vbbRJu7JuFRqv_OOo4-JNYf7p0_0 2024-09-12T01:04:39.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15046813322512782692', time=2024-09-12T02:51:28.160079+0000, chain.objs.size()=1 2024-09-12T01:04:39.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.UeWDfaHzyfcQGJy_p5_OPL_HomfSqgD_0 2024-09-12T01:04:39.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11607176172707507832', time=2024-09-12T02:51:28.373346+0000, chain.objs.size()=1 2024-09-12T01:04:39.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.kgBzJee2LnVOENS1dXFerk5EyxO89wC_0 2024-09-12T01:04:39.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17425345157920389737', time=2024-09-12T02:51:28.626401+0000, chain.objs.size()=1 2024-09-12T01:04:39.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.G_5Mf6WdwLB47KDUQn5iDglJZvBk6Li_0 2024-09-12T01:04:39.224 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1764486993426604701', time=2024-09-12T02:51:28.655569+0000, chain.objs.size()=1 2024-09-12T01:04:39.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.hEKQoGqEmDEihoi49RJoixgw9gJSLG7_0 2024-09-12T01:04:39.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1833397568527020415', time=2024-09-12T02:51:28.671568+0000, chain.objs.size()=1 2024-09-12T01:04:39.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.dMbzpwUXmXTtUC2LLP5T2h3tum-gnz0_0 2024-09-12T01:04:39.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2594820712972972736', time=2024-09-12T02:51:29.367561+0000, chain.objs.size()=1 2024-09-12T01:04:39.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.263__shadow_.MO_kWsoF-zU0-Cf4iJQmI-aE18P1R6A_0 2024-09-12T01:04:39.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7217311121862709695', time=2024-09-12T02:51:39.493331+0000, chain.objs.size()=1 2024-09-12T01:04:39.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.277__shadow_.etLlAeVJ4SkPnr9wXwPnBKMET61XS1w_0 2024-09-12T01:04:39.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3637513246815435380', time=2024-09-12T02:51:43.964769+0000, chain.objs.size()=1 2024-09-12T01:04:39.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.283__shadow_.KDyynlHMa4md0oA_WZcjHWovuos2xJs_0 2024-09-12T01:04:39.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6085210849097339454', time=2024-09-12T02:51:49.261129+0000, chain.objs.size()=1 2024-09-12T01:04:39.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.290__shadow_.Wgl5IIXRv4n6lLjPPJAgq0gnRQAuvSe_0 2024-09-12T01:04:39.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17477397266048606163', time=2024-09-12T02:51:51.712256+0000, chain.objs.size()=1 2024-09-12T01:04:39.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.292__shadow_.O1ODYx11h2xL3kSKO-FJKfd08anPgZ6_0 2024-09-12T01:04:39.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8349720606775822853', time=2024-09-12T02:51:53.159013+0000, chain.objs.size()=1 2024-09-12T01:04:39.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.293__shadow_.SvUEcsnNNLOEcshQRepMnTWtv9lY8Us_0 2024-09-12T01:04:39.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15289787081511248366', time=2024-09-12T02:51:59.187727+0000, chain.objs.size()=1 2024-09-12T01:04:39.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.301__shadow_.y_JnZ8XEefFABor4E-D3Df3_Zy-BvKP_0 2024-09-12T01:04:39.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7445862645778016379', time=2024-09-12T02:52:35.020879+0000, chain.objs.size()=1 2024-09-12T01:04:39.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.222+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.CoSnt1xmY-2ng0RI7YFEDjwFLs5aHDp_0 2024-09-12T01:04:39.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14504278261330614530', time=2024-09-12T02:52:35.023105+0000, chain.objs.size()=1 2024-09-12T01:04:39.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.0w_zfRFYaxtb4Wp5JK0C0futjMxsINB_0 2024-09-12T01:04:39.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7339703950198104839', time=2024-09-12T02:52:35.033225+0000, chain.objs.size()=1 2024-09-12T01:04:39.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_._P9Vv9qzjx7pRd53lhxxQ-XSxG-UxYH_0 2024-09-12T01:04:39.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10768296275390363182', time=2024-09-12T02:52:35.066873+0000, chain.objs.size()=1 2024-09-12T01:04:39.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.RRfCErR41cUHnyWGw5INsK65PqU_rUC_0 2024-09-12T01:04:39.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7276982355438580395', time=2024-09-12T02:52:35.114801+0000, chain.objs.size()=1 2024-09-12T01:04:39.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.wNhyS4LW1vIti_XKy0J9IJL2MxgmmJA_0 2024-09-12T01:04:39.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5974776119335143108', time=2024-09-12T02:52:35.340089+0000, chain.objs.size()=1 2024-09-12T01:04:39.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.a_AnICGx5fGvcfiKw2ZkO91_b44M6sS_0 2024-09-12T01:04:39.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5174469616567152292', time=2024-09-12T02:52:35.355168+0000, chain.objs.size()=1 2024-09-12T01:04:39.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.jLCnZ1FX-t5_rA4MP4tSjG0b6QkApNY_0 2024-09-12T01:04:39.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3810498632448581017', time=2024-09-12T02:52:35.387854+0000, chain.objs.size()=1 2024-09-12T01:04:39.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.roVIuoKxWSDJOG4OZrVAGz6UU_SG1QD_0 2024-09-12T01:04:39.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5592944240149537313', time=2024-09-12T02:52:35.577727+0000, chain.objs.size()=1 2024-09-12T01:04:39.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.EyR2R4HTf1xSbZPYVtpW8xTOfrDBU2H_0 2024-09-12T01:04:39.230 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8885530411656408908', time=2024-09-12T02:52:35.669799+0000, chain.objs.size()=1 2024-09-12T01:04:39.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ucUFbtmFqUa-HuTfzD8ub4z1GeTd4Qy_0 2024-09-12T01:04:39.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15344884476279531291', time=2024-09-12T02:52:35.809580+0000, chain.objs.size()=1 2024-09-12T01:04:39.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.STgCdcd3iWA5ZEF6dCMAPyxlPhMra48_0 2024-09-12T01:04:39.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4116267394214556034', time=2024-09-12T02:52:35.847788+0000, chain.objs.size()=1 2024-09-12T01:04:39.231 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.gbs6Tg_eqOA403g-_G4pVLM7DyI9ZvB_0 2024-09-12T01:04:39.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3950104342640953563', time=2024-09-12T02:52:36.236249+0000, chain.objs.size()=1 2024-09-12T01:04:39.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.IRBd_4rr_EmLJ9BreSxD8IZUMTP3ev6_0 2024-09-12T01:04:39.232 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5844552121357347664', time=2024-09-12T02:52:36.379806+0000, chain.objs.size()=1 2024-09-12T01:04:39.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.-6UJuVABe4cBonzt2BHQygrdNF1MYkc_0 2024-09-12T01:04:39.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5444392174066922996', time=2024-09-12T02:52:36.533441+0000, chain.objs.size()=1 2024-09-12T01:04:39.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.LE31to5rm1VVgbk1tJNJaKCYYhxgUjs_0 2024-09-12T01:04:39.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1641310316688311874', time=2024-09-12T02:52:36.574560+0000, chain.objs.size()=1 2024-09-12T01:04:39.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.sJTVpwuUHtiRCjmGFWg9lhWHfRBT1hU_0 2024-09-12T01:04:39.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12546987934186698472', time=2024-09-12T02:52:36.785061+0000, chain.objs.size()=1 2024-09-12T01:04:39.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.J_TZLZ3Y27dfvYqTpS6B9ZGUlXxMAB6_0 2024-09-12T01:04:39.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12342083783311066038', time=2024-09-12T02:52:36.848458+0000, chain.objs.size()=1 2024-09-12T01:04:39.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.gwjhml8C5pYMz8znRH0JCtIuQ9YWV35_0 2024-09-12T01:04:39.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5260721378086627152', time=2024-09-12T02:52:37.044198+0000, chain.objs.size()=1 2024-09-12T01:04:39.233 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.HdH6IJYu08EW8qRLFH6hucCf6-sy3Ib_0 2024-09-12T01:04:39.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8977386105673346536', time=2024-09-12T02:52:37.072978+0000, chain.objs.size()=1 2024-09-12T01:04:39.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.7NfbNji786YS5XWA60ZAHq3m2_rWLUY_0 2024-09-12T01:04:39.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7564191146968335234', time=2024-09-12T02:52:56.898479+0000, chain.objs.size()=1 2024-09-12T01:04:39.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.J3fPMyvGhflNkD0radS54n3YpjdXaMj_0 2024-09-12T01:04:39.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6525985486755115677', time=2024-09-12T02:52:56.996355+0000, chain.objs.size()=1 2024-09-12T01:04:39.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.fgeVONT43221HAvNwI0nqVAmsWnTqkk_0 2024-09-12T01:04:39.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9537220623045771149', time=2024-09-12T02:52:57.009862+0000, chain.objs.size()=1 2024-09-12T01:04:39.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.230+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.05HwOUdtu1k8D9ZOuRD7leNjRGMhBGT_0 2024-09-12T01:04:39.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.234+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1821992642448043046', time=2024-09-12T02:52:57.216938+0000, chain.objs.size()=1 2024-09-12T01:04:39.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.234+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Vcw7sIM3fObt7Lda0MWi7Mp6i5oHCl6_0 2024-09-12T01:04:39.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.234+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10131797271751419684', time=2024-09-12T02:52:57.239369+0000, chain.objs.size()=1 2024-09-12T01:04:39.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.234+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.xtO8GnwY2aq--JlN9dTmAqPoZ4iMQu1_0 2024-09-12T01:04:39.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.234+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4525123584459912504', time=2024-09-12T02:52:57.261926+0000, chain.objs.size()=1 2024-09-12T01:04:39.235 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.234+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.4AU0RdsbtCMLVCPQ8SuAywhqMILr71y_0 2024-09-12T01:04:39.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.234+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14027468707804326619', time=2024-09-12T02:52:57.271943+0000, chain.objs.size()=1 2024-09-12T01:04:39.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.234+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.fN_-L5OkOdZ2zM5dfnnDNqoYmoQD8q0_0 2024-09-12T01:04:39.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.234+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3912717250964625942', time=2024-09-12T02:52:57.404468+0000, chain.objs.size()=1 2024-09-12T01:04:39.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.234+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.9eWtsn2SpX2Oxcea_u6CUAOQrd1tWHY_0 2024-09-12T01:04:39.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.234+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17013000151323873707', time=2024-09-12T02:52:57.425176+0000, chain.objs.size()=1 2024-09-12T01:04:39.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.234+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.7x7f3HBGjz0omOEEQOFBJXyMV4zBpm8_0 2024-09-12T01:04:39.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.234+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2193178462084782600', time=2024-09-12T02:52:57.460276+0000, chain.objs.size()=1 2024-09-12T01:04:39.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.234+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.-ff9ScvFF9hlbOP3uXnCF3iukIm0OnY_0 2024-09-12T01:04:39.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.234+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11459593984402049582', time=2024-09-12T02:52:57.467232+0000, chain.objs.size()=1 2024-09-12T01:04:39.236 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.234+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.XYE4lLYVXDmJ3OQVxZIvhHR0GgMfTAD_0 2024-09-12T01:04:39.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.238+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15330319166126191629', time=2024-09-12T02:52:57.472630+0000, chain.objs.size()=1 2024-09-12T01:04:39.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.238+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.UodzbSz8bz-hKyr1ZtHP0hcRlKNHg0j_0 2024-09-12T01:04:39.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.238+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10258030457967146388', time=2024-09-12T02:52:57.494404+0000, chain.objs.size()=1 2024-09-12T01:04:39.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.238+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.mdIy9WKmqqa0obSFPeTH-LB9fhWk3jX_0 2024-09-12T01:04:39.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.238+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4948495168358095911', time=2024-09-12T02:52:57.515413+0000, chain.objs.size()=1 2024-09-12T01:04:39.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.238+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.OzJUsaMOtGhAll4IjUrXheA_iwNSrfF_0 2024-09-12T01:04:39.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.238+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4200581272800130582', time=2024-09-12T02:52:57.665651+0000, chain.objs.size()=1 2024-09-12T01:04:39.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.238+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.LWTE64Eyc7yWkpGSC6MedlkAo-I6XZp_0 2024-09-12T01:04:39.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.238+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17227357586309197633', time=2024-09-12T02:52:57.687418+0000, chain.objs.size()=1 2024-09-12T01:04:39.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.238+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.huxPBo1M-mLnJxhq8VjD1Tpiwg7ESde_0 2024-09-12T01:04:39.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.238+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2763042130845890631', time=2024-09-12T02:52:57.714270+0000, chain.objs.size()=1 2024-09-12T01:04:39.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.238+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.uEcXOOOxbotIW15-YeRYuCP8_hN38QO_0 2024-09-12T01:04:39.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.238+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2614206929713550982', time=2024-09-12T02:52:57.740151+0000, chain.objs.size()=1 2024-09-12T01:04:39.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.238+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.FaJHcr8oIagT55BTqilCeF5nO2leRWo_0 2024-09-12T01:04:39.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.238+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7613315522631282381', time=2024-09-12T02:52:57.884036+0000, chain.objs.size()=1 2024-09-12T01:04:39.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.238+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.I_Fs-2n6F__7KXx4ws4nhdAEH_RZd-t_0 2024-09-12T01:04:39.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.238+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15377019043842556864', time=2024-09-12T02:52:57.891732+0000, chain.objs.size()=1 2024-09-12T01:04:39.239 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.238+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.4wceezv0qp5naDh1NI4va4MHzmF9Ss4_0 2024-09-12T01:04:39.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.238+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15630180420435666892', time=2024-09-12T02:52:57.907458+0000, chain.objs.size()=1 2024-09-12T01:04:39.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.238+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.T_GToFa2nLdE5aoHpy3BmcWlP1CfppP_0 2024-09-12T01:04:39.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.238+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4915324908571531180', time=2024-09-12T02:52:57.919907+0000, chain.objs.size()=1 2024-09-12T01:04:39.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.238+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.vwRYj-HmbaRpDkIzgcE8pZ3Veu2Jf_X_0 2024-09-12T01:04:39.240 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.238+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2044942482298878059', time=2024-09-12T02:52:57.928807+0000, chain.objs.size()=1 2024-09-12T01:04:39.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.238+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.0Avn0LLTRfsgw-JolPlbJ59fe8SyKRi_0 2024-09-12T01:04:39.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.238+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11411087893447058824', time=2024-09-12T02:52:57.951281+0000, chain.objs.size()=1 2024-09-12T01:04:39.241 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.238+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.cqk17xV7Jw_xzvAhLTqAcW6ZLFRXGrI_0 2024-09-12T01:04:39.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.242+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5984075296664810061', time=2024-09-12T02:52:57.961508+0000, chain.objs.size()=1 2024-09-12T01:04:39.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.242+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.-PIBibfd6uc5PuUWAKVU8uy2DTaWP78_0 2024-09-12T01:04:39.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.242+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5204621757741864621', time=2024-09-12T02:52:57.989770+0000, chain.objs.size()=1 2024-09-12T01:04:39.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.242+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.0B7ZRWBnMsZWtsBCD1cBjkXqSNGkoyK_0 2024-09-12T01:04:39.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.242+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10435490379839432627', time=2024-09-12T02:52:57.990963+0000, chain.objs.size()=1 2024-09-12T01:04:39.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.242+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.8le3ilf_HcWOvTM1z9PiyU0Rl1ULxuG_0 2024-09-12T01:04:39.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.242+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14555267272982011065', time=2024-09-12T02:52:58.124511+0000, chain.objs.size()=1 2024-09-12T01:04:39.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.242+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.gfyphmSkDWnSNeH31e_GG5uy363MTt0_0 2024-09-12T01:04:39.242 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.242+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10194937867471846217', time=2024-09-12T02:52:58.194594+0000, chain.objs.size()=1 2024-09-12T01:04:39.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.242+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_._cT9iqX4vslXpccTGyYtA0AtlkTzALy_0 2024-09-12T01:04:39.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.242+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9181573489617731648', time=2024-09-12T02:52:58.200534+0000, chain.objs.size()=1 2024-09-12T01:04:39.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.242+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.efEvu2NqRcJgTzHGe_lS4PRNVos8ojL_0 2024-09-12T01:04:39.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.242+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12154882623288346443', time=2024-09-12T02:52:58.203306+0000, chain.objs.size()=1 2024-09-12T01:04:39.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.242+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.nrFXN4vDwOQyKaqS0Yc5exLcVN2ThRG_0 2024-09-12T01:04:39.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.242+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14804700517920962860', time=2024-09-12T02:52:58.211011+0000, chain.objs.size()=1 2024-09-12T01:04:39.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.242+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.nfA9rzLFaRrHyQiA__12hM-A9ByWd19_0 2024-09-12T01:04:39.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.242+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8728473773476811204', time=2024-09-12T02:52:58.223372+0000, chain.objs.size()=1 2024-09-12T01:04:39.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.242+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.6f-ZAUh-UfW65eFseTo_Y5-ctHkdjRk_0 2024-09-12T01:04:39.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.242+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3816932258188595306', time=2024-09-12T02:52:58.233441+0000, chain.objs.size()=1 2024-09-12T01:04:39.243 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.242+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.OtN-HUx5iTezbsoKhY4lsZyqDwPVT-S_0 2024-09-12T01:04:39.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.242+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4592344312928766212', time=2024-09-12T02:52:58.364763+0000, chain.objs.size()=1 2024-09-12T01:04:39.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.242+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.W1UpS2hwI3OIZM3pk4TFqKvmt4MAkBW_0 2024-09-12T01:04:39.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.242+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9380926358264541128', time=2024-09-12T02:52:58.427793+0000, chain.objs.size()=1 2024-09-12T01:04:39.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.242+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.8JsUtCTBgWygbAsU3oV4BJ95AJBoTpp_0 2024-09-12T01:04:39.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.242+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16325479470404159897', time=2024-09-12T02:52:58.474811+0000, chain.objs.size()=1 2024-09-12T01:04:39.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.242+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.5jHWhayA1GTKDEa9Bo6UF7gQaq6eLod_0 2024-09-12T01:04:39.244 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.242+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13730640258862268212', time=2024-09-12T02:53:09.101774+0000, chain.objs.size()=1 2024-09-12T01:04:39.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.242+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.340__shadow_.5qAF7qCsxLmA-1QN9udaMJo7pGkB1KK_0 2024-09-12T01:04:39.245 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.246+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45295 2024-09-12T01:04:39.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.246+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T01:04:39.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.246+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17609618750835391740', time=2024-09-12T02:53:31.382540+0000, chain.objs.size()=1 2024-09-12T01:04:39.247 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.246+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.374__shadow_.FOBwuB49sQPD6baqmOuBWVQhz_lS9VY_0 2024-09-12T01:04:39.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.246+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16869762388647610148', time=2024-09-12T02:54:43.758483+0000, chain.objs.size()=1 2024-09-12T01:04:39.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.246+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.465__shadow_.iWXnoWj9F-lxCSbuHKVQM3b3d_PNrZE_0 2024-09-12T01:04:39.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.246+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9345880602579736188', time=2024-09-12T02:56:49.433755+0000, chain.objs.size()=1 2024-09-12T01:04:39.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.246+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.559__shadow_.XyIQplk6jGFqdCXDP4yjt9xDw8i5oEU_0 2024-09-12T01:04:39.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.246+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15590364997524448754', time=2024-09-12T02:57:14.511316+0000, chain.objs.size()=1 2024-09-12T01:04:39.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.246+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.574__shadow_.kuyxoDqR8YgT3Yua3q2hlqFgyTDOfaG_0 2024-09-12T01:04:39.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.246+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17020038818136567540', time=2024-09-12T02:57:16.146856+0000, chain.objs.size()=1 2024-09-12T01:04:39.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.246+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.574__shadow:qpfMW2f4cugNUu9YI86amLDlmfq8v9Q_.Cm9ikdC4xmpsL-o_g2jlIR0XFXWJ_8-_0 2024-09-12T01:04:39.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.246+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4154609676912441655', time=2024-09-12T02:57:18.097071+0000, chain.objs.size()=1 2024-09-12T01:04:39.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.246+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.575__shadow_.7BVyuYKz0TW91NJg8hht2I5KHp2L0MX_0 2024-09-12T01:04:39.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.246+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11584861952916620035', time=2024-09-12T02:57:18.179171+0000, chain.objs.size()=1 2024-09-12T01:04:39.248 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.246+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.575__shadow_.7BVyuYKz0TW91NJg8hht2I5KHp2L0MX_0 2024-09-12T01:04:39.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.246+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12768401866680960684', time=2024-09-12T02:57:21.369236+0000, chain.objs.size()=1 2024-09-12T01:04:39.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.246+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.576__shadow:A8m029xD4xa31Ylr5ws6PXgLQeSa6L9_.i5qFnAGFeIVYS0XzNSxP7mlzNLSDjj2_0 2024-09-12T01:04:39.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.246+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12334619557071086654', time=2024-09-12T02:57:31.382730+0000, chain.objs.size()=1 2024-09-12T01:04:39.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.246+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:lLZL5AZA0-FGRkzfKLgrPivihivCY7q_.KqnaiF1JQTl0oCLm0rCpG8cyKP5BFJ9_0 2024-09-12T01:04:39.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.246+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1356567377521362368', time=2024-09-12T02:57:46.306090+0000, chain.objs.size()=1 2024-09-12T01:04:39.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.246+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.580__shadow:zRIZKMp0kS3eLjGXIXHWR8x5alkErB2_.tAFjdM4_W4FjfMT3CrCSpCD7k5Ewdpj_0 2024-09-12T01:04:39.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.246+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8278961484760351627', time=2024-09-12T02:57:46.307903+0000, chain.objs.size()=1 2024-09-12T01:04:39.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.246+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.580__shadow:RD9R7T.SWCifB5Jk4Cu.ouVVEDXs6GE_.l3f2invbA3_55ykYVqCHjPmYpUrZCIb_0 2024-09-12T01:04:39.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.246+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15563176198667500544', time=2024-09-12T02:57:50.362100+0000, chain.objs.size()=1 2024-09-12T01:04:39.249 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.246+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.585__shadow:Mx-aKJpa1EZW1Ka7UiuM5bJamUm2Op5_.FI4ZFBpqmQLcSZthAOe5jD6p_4JcOfA_0 2024-09-12T01:04:39.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.250+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12737918434906331339', time=2024-09-12T02:57:51.381195+0000, chain.objs.size()=1 2024-09-12T01:04:39.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.250+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.586__shadow:7nKQ2N4fTgC8dhlXYoWItmUxwkOtzQX_.t0IdvbRYRRnFeae3sp10Ak6AnL2aJe2_0 2024-09-12T01:04:39.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.250+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7409812748946344563', time=2024-09-12T03:01:06.457077+0000, chain.objs.size()=1 2024-09-12T01:04:39.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.250+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.664__shadow_._lLaejtKSazRkud9-6zmI61QVcR281Y_0 2024-09-12T01:04:39.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.250+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7183648816034817727', time=2024-09-12T03:01:28.955457+0000, chain.objs.size()=1 2024-09-12T01:04:39.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.250+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.699__shadow:uDO6dJdMcD05KUOQ4hjqtb7CvVeX0VU_.7Z_kQoPDHWyJ1TA7bYmuzJrusNyzRyK_0 2024-09-12T01:04:39.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.250+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15171513165487460671', time=2024-09-12T03:01:38.204182+0000, chain.objs.size()=1 2024-09-12T01:04:39.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.250+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.712__shadow:-z6M0OswXw3TvduYOb8PKJLwNCEcr89_.P07NQPYn1gjQMaJcJBuz0gWAFSaBYtR_0 2024-09-12T01:04:39.250 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.250+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13400677413391226981', time=2024-09-12T03:02:19.413365+0000, chain.objs.size()=1 2024-09-12T01:04:39.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.250+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.741__shadow_.ilLy5rwyNLI8QrLMY_-UyZDvjFWTbye_0 2024-09-12T01:04:39.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.250+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16303990361089856919', time=2024-09-12T03:02:20.501438+0000, chain.objs.size()=1 2024-09-12T01:04:39.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.250+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.742__multipart_mymultipart3.2~yS2ZwMA0hUKakdEemgl63-0Jnoz83NA.1 2024-09-12T01:04:39.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.250+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:39.254 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.254+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:04:39.255 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.254+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:39.256 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.254+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:39.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/84791' 2024-09-12T01:04:39.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13493669300505403714', time=2024-09-12T02:48:52.995198+0000, chain.objs.size()=1 2024-09-12T01:04:39.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.183__shadow_.jfuMp03tjmD7c8bJv12fHvnBnNAjlRw_0 2024-09-12T01:04:39.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7993754041245384609', time=2024-09-12T02:50:44.917438+0000, chain.objs.size()=1 2024-09-12T01:04:39.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.234__shadow_.D6Nc7o2coKpLEbs-Gk7YBd0dDmgIwBO_0 2024-09-12T01:04:39.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5129029864199168792', time=2024-09-12T02:50:45.701399+0000, chain.objs.size()=1 2024-09-12T01:04:39.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.235__shadow_.cN4wE4F4ETb51yxcSO-NqB6n7zBVos-_0 2024-09-12T01:04:39.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12073567290995478849', time=2024-09-12T02:50:53.007827+0000, chain.objs.size()=1 2024-09-12T01:04:39.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.243__shadow_.DU_eocYF8vEgOlgknraCeQPNzk9t5GN_0 2024-09-12T01:04:39.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18181057817338902789', time=2024-09-12T02:50:54.231648+0000, chain.objs.size()=1 2024-09-12T01:04:39.258 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.244__shadow_.OILddBvvVyj3Gfj4U3F0qrUethoMflG_0 2024-09-12T01:04:39.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12469950549498985695', time=2024-09-12T02:50:57.451423+0000, chain.objs.size()=1 2024-09-12T01:04:39.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.248__shadow_.4yNToROeN6ymybrTuA4qUaOLGgECuJt_0 2024-09-12T01:04:39.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11316664931358422938', time=2024-09-12T02:51:01.120875+0000, chain.objs.size()=1 2024-09-12T01:04:39.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.253__shadow_.BAUaFSdve_uA1Ru2JQNhwwvtrRTl9vk_0 2024-09-12T01:04:39.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5384349964082763840', time=2024-09-12T02:51:01.856731+0000, chain.objs.size()=1 2024-09-12T01:04:39.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.254__shadow_.IJg-QZQuHWDmHJP_4A59uwghxGx5wfm_0 2024-09-12T01:04:39.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1392261704113029162', time=2024-09-12T02:51:26.773887+0000, chain.objs.size()=1 2024-09-12T01:04:39.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.M9AF4TsAm6xxaaLhKN32-_xIfNIlgwl_0 2024-09-12T01:04:39.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9914912892310420287', time=2024-09-12T02:51:26.828265+0000, chain.objs.size()=1 2024-09-12T01:04:39.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.GehC0ElYNC2_gUt-qNdijrBYaxxod3a_0 2024-09-12T01:04:39.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15406300517466074432', time=2024-09-12T02:51:27.002891+0000, chain.objs.size()=1 2024-09-12T01:04:39.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.UpUQKjcZCLvQ6nTJSE0xBgI7qE_ZpdL_0 2024-09-12T01:04:39.260 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12603885447587321306', time=2024-09-12T02:51:27.023976+0000, chain.objs.size()=1 2024-09-12T01:04:39.260 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.rlN9ddVUZm1dXN1C6MXN-a-k243OTB2_0 2024-09-12T01:04:39.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14820263964809919616', time=2024-09-12T02:51:27.082002+0000, chain.objs.size()=1 2024-09-12T01:04:39.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.UM5YaLAsh0xyJwl1bDiANYTHPK-vl0M_0 2024-09-12T01:04:39.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12993089238410933374', time=2024-09-12T02:51:27.291175+0000, chain.objs.size()=1 2024-09-12T01:04:39.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.8ylmzAAMyOOUr_gZIw6Cgy0PXRKLNGy_0 2024-09-12T01:04:39.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9135939401343754366', time=2024-09-12T02:51:27.319142+0000, chain.objs.size()=1 2024-09-12T01:04:39.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.z4b9gbu6OdiMvIbMryrb16CbCgtELdg_0 2024-09-12T01:04:39.261 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3833680126739964641', time=2024-09-12T02:51:27.474049+0000, chain.objs.size()=1 2024-09-12T01:04:39.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.cU6lkZE7t65nKrTE82qgxGD3eoFPPnO_0 2024-09-12T01:04:39.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8034794166485029053', time=2024-09-12T02:51:27.482793+0000, chain.objs.size()=1 2024-09-12T01:04:39.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.3nqK8_gAIDhVHsQzl8wWWHNFKuu4bL4_0 2024-09-12T01:04:39.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14994089600797860528', time=2024-09-12T02:51:27.488160+0000, chain.objs.size()=1 2024-09-12T01:04:39.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.etmnqkR6ilT4_8ZTp7bIvrhEkh1W_lR_0 2024-09-12T01:04:39.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13258245324164964944', time=2024-09-12T02:51:27.533077+0000, chain.objs.size()=1 2024-09-12T01:04:39.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.258+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.SGHdSR6SdU3oUz1LAmjdJcFu2yy3ewn_0 2024-09-12T01:04:39.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12362523553036451043', time=2024-09-12T02:51:27.626469+0000, chain.objs.size()=1 2024-09-12T01:04:39.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.l0JYxOhrp6Q1xBKLR3RJrmSxC0Q3ea8_0 2024-09-12T01:04:39.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17402622797078373866', time=2024-09-12T02:51:27.671284+0000, chain.objs.size()=1 2024-09-12T01:04:39.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.FClweplu7hkKijJPznrTgNHFQ3b8uFt_0 2024-09-12T01:04:39.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10291224741841278830', time=2024-09-12T02:51:27.682582+0000, chain.objs.size()=1 2024-09-12T01:04:39.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.p2DGzbdA2xJqeMsk56zCbzrtmx7U3Lu_0 2024-09-12T01:04:39.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6425132904014793541', time=2024-09-12T02:51:27.710049+0000, chain.objs.size()=1 2024-09-12T01:04:39.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.xSd96r-obfdSxZcy4i7Gz3EWxbwxg4V_0 2024-09-12T01:04:39.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15850881026294407488', time=2024-09-12T02:51:27.719840+0000, chain.objs.size()=1 2024-09-12T01:04:39.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.S8EAv2r2U3PmJoqw4_JmeNsOfRAapnI_0 2024-09-12T01:04:39.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5182998086049193469', time=2024-09-12T02:51:27.916430+0000, chain.objs.size()=1 2024-09-12T01:04:39.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.lhgGj7lHxZB0CGce7qMnVpPPpCTMJMO_0 2024-09-12T01:04:39.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4373028608637244816', time=2024-09-12T02:51:27.966253+0000, chain.objs.size()=1 2024-09-12T01:04:39.264 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.y0zqpntjXhNtdDYo84uE9BRBA38rvFB_0 2024-09-12T01:04:39.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9449208780892418918', time=2024-09-12T02:51:28.136543+0000, chain.objs.size()=1 2024-09-12T01:04:39.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ZgIlT97c71qSh7a6Df054am7zeVXdWx_0 2024-09-12T01:04:39.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11598105246758505696', time=2024-09-12T02:51:28.212645+0000, chain.objs.size()=1 2024-09-12T01:04:39.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.C1e6_osuw0sPMvOMroUMMOqtY7u5TEB_0 2024-09-12T01:04:39.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6919081658657550036', time=2024-09-12T02:51:28.215303+0000, chain.objs.size()=1 2024-09-12T01:04:39.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.m6w5wRElJQh-WqzXS_r1aHVyTGQbODu_0 2024-09-12T01:04:39.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11404821963869935658', time=2024-09-12T02:51:28.221687+0000, chain.objs.size()=1 2024-09-12T01:04:39.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.WywKk0tAXkjW3yfqsqdo-JfaUXE72z8_0 2024-09-12T01:04:39.265 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2777210226430423889', time=2024-09-12T02:51:28.242729+0000, chain.objs.size()=1 2024-09-12T01:04:39.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.KBmXsbB8lXGHc4_m03ut6hYj0EkDDbc_0 2024-09-12T01:04:39.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15396629148242879431', time=2024-09-12T02:51:28.336284+0000, chain.objs.size()=1 2024-09-12T01:04:39.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.9oU_pmM7B0pbUOU799wEm7tTXuFIEt5_0 2024-09-12T01:04:39.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15401652368700294692', time=2024-09-12T02:51:28.353057+0000, chain.objs.size()=1 2024-09-12T01:04:39.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.grnYGIvPfP7Ev1eQyW-49n0V_7VVwsy_0 2024-09-12T01:04:39.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8201563103098972291', time=2024-09-12T02:51:28.591137+0000, chain.objs.size()=1 2024-09-12T01:04:39.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.I-KVhlFlaJ2e1Tl_2CcUht0yglS8cxm_0 2024-09-12T01:04:39.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.769881147995629209', time=2024-09-12T02:51:28.603240+0000, chain.objs.size()=1 2024-09-12T01:04:39.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.hW5F5eYr8ZXfBk9jm1qe7C1LY5Ke8OP_0 2024-09-12T01:04:39.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2211288672711112370', time=2024-09-12T02:51:28.611957+0000, chain.objs.size()=1 2024-09-12T01:04:39.266 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.iacUioVQgGfdzpUfLlWXDN7qcJvWslm_0 2024-09-12T01:04:39.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5319723791973881467', time=2024-09-12T02:51:43.223695+0000, chain.objs.size()=1 2024-09-12T01:04:39.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.262+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.282__shadow_.bir42Jhv4oBV7fuO0sG20JyPD0ul5Xd_0 2024-09-12T01:04:39.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.266+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13350322635933668072', time=2024-09-12T02:51:53.192098+0000, chain.objs.size()=1 2024-09-12T01:04:39.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.266+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.293__shadow_.iJqa0YQZz0vV6xG6pzpeX2sEgW38LHr_0 2024-09-12T01:04:39.267 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.266+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13148211590719889541', time=2024-09-12T02:51:54.647484+0000, chain.objs.size()=1 2024-09-12T01:04:39.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.266+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.295__shadow_.Jl-Q9BChKBMSzLuCdwOihKBFlRQ6dgh_0 2024-09-12T01:04:39.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.266+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14322589893886115577', time=2024-09-12T02:51:55.368194+0000, chain.objs.size()=1 2024-09-12T01:04:39.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.266+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.296__shadow_.8X5i-R3h_ge49JPATzfo_0ARG1xDGNM_0 2024-09-12T01:04:39.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.266+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8766005572323680583', time=2024-09-12T02:51:59.952352+0000, chain.objs.size()=1 2024-09-12T01:04:39.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.266+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.302__shadow_.3BQC8NZ-cpBYxH_kpO3K9QN9p7rHhps_0 2024-09-12T01:04:39.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.266+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13246908508210354923', time=2024-09-12T02:52:34.819249+0000, chain.objs.size()=1 2024-09-12T01:04:39.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.266+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Awh0JwJb25ba8boaGiCGNIC27OxOCux_0 2024-09-12T01:04:39.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.266+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2674181368878397558', time=2024-09-12T02:52:34.841650+0000, chain.objs.size()=1 2024-09-12T01:04:39.268 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.266+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ZAp9FFeVNbpGlJa065UW2-F2ox6miNq_0 2024-09-12T01:04:39.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.266+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7816086541979311390', time=2024-09-12T02:52:35.044328+0000, chain.objs.size()=1 2024-09-12T01:04:39.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.266+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.uNuYA414TCc1YIRWspsq4t9MqVZ0z0F_0 2024-09-12T01:04:39.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.266+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16487802116852404036', time=2024-09-12T02:52:35.137551+0000, chain.objs.size()=1 2024-09-12T01:04:39.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.266+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.XTEg4ODiSQyZ-dvGM3sr1JumpilR22w_0 2024-09-12T01:04:39.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.266+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5609133855220613421', time=2024-09-12T02:52:35.165163+0000, chain.objs.size()=1 2024-09-12T01:04:39.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.266+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.0HeAEC4owdkCZEW_HtlUCMrXGxtfbeq_0 2024-09-12T01:04:39.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.266+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2719550930194074753', time=2024-09-12T02:52:35.322399+0000, chain.objs.size()=1 2024-09-12T01:04:39.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.266+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.oswUO552pegtt8ND1lRko8-nIGPjR0J_0 2024-09-12T01:04:39.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.266+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7968285826193982194', time=2024-09-12T02:52:35.336838+0000, chain.objs.size()=1 2024-09-12T01:04:39.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.266+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.pGLn1X8Ve2-nT-smSUMUMRKdSAcPtlH_0 2024-09-12T01:04:39.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.266+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3572431944198012840', time=2024-09-12T02:52:35.417326+0000, chain.objs.size()=1 2024-09-12T01:04:39.270 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.266+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.xUxGSDfLM-F8G5EAmzSE0WFd_ZwIcJ7_0 2024-09-12T01:04:39.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.266+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10772227051629767854', time=2024-09-12T02:52:35.599951+0000, chain.objs.size()=1 2024-09-12T01:04:39.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.266+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.us8RONJbG5P68XQjcya6wL1DF8-GqXx_0 2024-09-12T01:04:39.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.266+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6377210696958019371', time=2024-09-12T02:52:35.608306+0000, chain.objs.size()=1 2024-09-12T01:04:39.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.266+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.WdjXu2ADP1rbKdCeXDACegQd1ikdo_g_0 2024-09-12T01:04:39.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.270+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5567063758698636611', time=2024-09-12T02:52:35.635410+0000, chain.objs.size()=1 2024-09-12T01:04:39.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.270+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_._8TaBttu0weMqnI4Fia8xrNzy-R1TWm_0 2024-09-12T01:04:39.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.270+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.645619455243392720', time=2024-09-12T02:52:35.652868+0000, chain.objs.size()=1 2024-09-12T01:04:39.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.270+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.GvuA3swVubhvPRKmZFU4ing1Ynep_xc_0 2024-09-12T01:04:39.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.270+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9578934032627473765', time=2024-09-12T02:52:35.659999+0000, chain.objs.size()=1 2024-09-12T01:04:39.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.270+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.nNXfOP-SB2JiuYwfSusHsTW8kpJ4u4y_0 2024-09-12T01:04:39.272 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.270+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4257757398614541536', time=2024-09-12T02:52:35.770916+0000, chain.objs.size()=1 2024-09-12T01:04:39.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.270+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.SZgfZBSUmuwa0V4PpWcRH6aZTx30Z7u_0 2024-09-12T01:04:39.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.270+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12230448439733058299', time=2024-09-12T02:52:35.860226+0000, chain.objs.size()=1 2024-09-12T01:04:39.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.270+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.P67gibbXlKKqodg-wTeqzKG3tPnjHXX_0 2024-09-12T01:04:39.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.270+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4957980119509467341', time=2024-09-12T02:52:35.866382+0000, chain.objs.size()=1 2024-09-12T01:04:39.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.270+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.FGiPV6qHUkM90R54_bKRM9MsgjXXtrC_0 2024-09-12T01:04:39.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.270+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11743104451583950634', time=2024-09-12T02:52:35.890836+0000, chain.objs.size()=1 2024-09-12T01:04:39.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.270+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.t3OysNUFEgEzi65DHd8QQbk3qN2FxaY_0 2024-09-12T01:04:39.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.270+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10585844087132191224', time=2024-09-12T02:52:36.242930+0000, chain.objs.size()=1 2024-09-12T01:04:39.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.270+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.KbRjkSS_lCM_qVSFHRkybZjPmSo2_Vg_0 2024-09-12T01:04:39.273 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.270+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.541923888995712109', time=2024-09-12T02:52:36.319250+0000, chain.objs.size()=1 2024-09-12T01:04:39.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.270+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.-yx2sEqpGvvPH57fg7w3_GAvvt2wEPM_0 2024-09-12T01:04:39.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.270+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16984444227908456231', time=2024-09-12T02:52:36.339349+0000, chain.objs.size()=1 2024-09-12T01:04:39.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.270+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Dg44Cm_WGk-pWqlZuMkC2bHH520LHyU_0 2024-09-12T01:04:39.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.270+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14826013291678052296', time=2024-09-12T02:52:36.353059+0000, chain.objs.size()=1 2024-09-12T01:04:39.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.270+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.7U4fnSnwBGQhb_YPdqQVy5SzU5uz-Z__0 2024-09-12T01:04:39.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.270+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5237874767163401607', time=2024-09-12T02:52:36.367434+0000, chain.objs.size()=1 2024-09-12T01:04:39.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.270+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.V6RWT-yXdZUCas4baxBwxU7_w_jSTla_0 2024-09-12T01:04:39.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.270+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10291277628334934861', time=2024-09-12T02:52:36.374411+0000, chain.objs.size()=1 2024-09-12T01:04:39.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.270+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.soDAry-LCY_1NEXpzHgRUCuETZBkDjy_0 2024-09-12T01:04:39.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.270+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10852951982360560811', time=2024-09-12T02:52:36.387893+0000, chain.objs.size()=1 2024-09-12T01:04:39.274 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.270+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.nKlNwSMqJ5UAXHEFaQZFcW_CbZYGQl8_0 2024-09-12T01:04:39.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16053866121372611061', time=2024-09-12T02:52:36.392666+0000, chain.objs.size()=1 2024-09-12T01:04:39.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.3ZaHEYIEAGlwuYhVcbQzFvEYOqJxDja_0 2024-09-12T01:04:39.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15783416706849153184', time=2024-09-12T02:52:36.528724+0000, chain.objs.size()=1 2024-09-12T01:04:39.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.3qDfAZmrD7JdmKyvOU0lQkpF10D2Gdq_0 2024-09-12T01:04:39.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11884029255339660648', time=2024-09-12T02:52:36.553425+0000, chain.objs.size()=1 2024-09-12T01:04:39.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.cuL-54b_tNLOgntBprcqyuY2CFetGTy_0 2024-09-12T01:04:39.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.307752669929600831', time=2024-09-12T02:52:36.563563+0000, chain.objs.size()=1 2024-09-12T01:04:39.276 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ddbgz6AxCOG45l2EQjiMsVj3ahkDqVD_0 2024-09-12T01:04:39.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.496229230471441156', time=2024-09-12T02:52:36.609314+0000, chain.objs.size()=1 2024-09-12T01:04:39.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.PCPRfy9TCcTAaoThmrgbNpNqsu0-HFr_0 2024-09-12T01:04:39.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1826043635762806658', time=2024-09-12T02:52:36.617700+0000, chain.objs.size()=1 2024-09-12T01:04:39.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.A08czFWZVqRedefbYgz3jDDRqoYrIqe_0 2024-09-12T01:04:39.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4611803267657204828', time=2024-09-12T02:52:36.748743+0000, chain.objs.size()=1 2024-09-12T01:04:39.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.aXBfp5q7M7Tn-n3xwgmuXqGcsNdhj0J_0 2024-09-12T01:04:39.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.950956960263380377', time=2024-09-12T02:52:37.060762+0000, chain.objs.size()=1 2024-09-12T01:04:39.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.AD3-ooTjLs8faXDzw8AfItsd_6NmKDH_0 2024-09-12T01:04:39.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12278587439108080078', time=2024-09-12T02:52:56.925460+0000, chain.objs.size()=1 2024-09-12T01:04:39.277 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.lEL34qtOj-jhGF5fDFmC83tnWBs1Q6C_0 2024-09-12T01:04:39.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18006058467125807956', time=2024-09-12T02:52:56.993773+0000, chain.objs.size()=1 2024-09-12T01:04:39.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Dd25WLpfPG3BCciyx1sxGFNPBD2RWmQ_0 2024-09-12T01:04:39.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7816851028518124825', time=2024-09-12T02:52:57.004184+0000, chain.objs.size()=1 2024-09-12T01:04:39.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.i1ufq6q0H0MdZHklTuh7wjXnaUTdR9w_0 2024-09-12T01:04:39.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16769885799765734223', time=2024-09-12T02:52:57.216621+0000, chain.objs.size()=1 2024-09-12T01:04:39.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.RQcalrMF-ezEinr0UKPiXp-g5_J59Tk_0 2024-09-12T01:04:39.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10263217092471549490', time=2024-09-12T02:52:57.401603+0000, chain.objs.size()=1 2024-09-12T01:04:39.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.1OCpvrj9NMTM_yeNFHeESQCCdTl4OEh_0 2024-09-12T01:04:39.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11924729942362669394', time=2024-09-12T02:52:57.469049+0000, chain.objs.size()=1 2024-09-12T01:04:39.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.UlX9xFLkTXKG4YO7yRCf-tr8rHpgY-R_0 2024-09-12T01:04:39.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13273941190226871392', time=2024-09-12T02:52:57.472252+0000, chain.objs.size()=1 2024-09-12T01:04:39.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.f5im9Y4zXKcL6YLY4LR6YkuqjXU9xbb_0 2024-09-12T01:04:39.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1821258152195557115', time=2024-09-12T02:52:57.671216+0000, chain.objs.size()=1 2024-09-12T01:04:39.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Vfw8Q5K3Wh4nRLnN5a2nZVYj2TV4OwS_0 2024-09-12T01:04:39.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8569031230081272451', time=2024-09-12T02:52:57.710259+0000, chain.objs.size()=1 2024-09-12T01:04:39.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.274+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.PRCsJa7zzwUEc0ki1AxCGcUnArJmozL_0 2024-09-12T01:04:39.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.278+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4738605908715587607', time=2024-09-12T02:52:57.722181+0000, chain.objs.size()=1 2024-09-12T01:04:39.279 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.278+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.a7A0JrTSMEG7dYpFPgZTOOwwf7Xhptj_0 2024-09-12T01:04:39.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.278+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8736416636765289293', time=2024-09-12T02:52:57.723693+0000, chain.objs.size()=1 2024-09-12T01:04:39.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.278+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.zfmv3qfh0jb81b969WPurLSz7k5WJ8k_0 2024-09-12T01:04:39.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.278+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12354820148933501978', time=2024-09-12T02:52:57.724487+0000, chain.objs.size()=1 2024-09-12T01:04:39.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.278+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.rVSkf2pfAWlMEBSW1SEivT90inI1LWt_0 2024-09-12T01:04:39.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.278+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10122633818597899590', time=2024-09-12T02:52:57.739640+0000, chain.objs.size()=1 2024-09-12T01:04:39.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.278+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.t9k0gh6cfIF6SViT-1Kxui7ZEdVsmUg_0 2024-09-12T01:04:39.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.278+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13934878654532430693', time=2024-09-12T02:52:57.915391+0000, chain.objs.size()=1 2024-09-12T01:04:39.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.278+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.L82KkU7ecVDtfBoQ6h8gXcttZhnvI7i_0 2024-09-12T01:04:39.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.282+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9128913052593658941', time=2024-09-12T02:52:57.973598+0000, chain.objs.size()=1 2024-09-12T01:04:39.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.282+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.k-hKoJAovuXLcWPptEr8Y33Ut-lXqS2_0 2024-09-12T01:04:39.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.282+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.906030116903625009', time=2024-09-12T02:52:57.974814+0000, chain.objs.size()=1 2024-09-12T01:04:39.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.282+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ye8wKRI4egk-8yxPqDqvSN7rvUAu79D_0 2024-09-12T01:04:39.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.282+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10264488734864877470', time=2024-09-12T02:52:58.176012+0000, chain.objs.size()=1 2024-09-12T01:04:39.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.282+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.oFa54YMxmyjy8uZ1XN8RRB8CesmbQ7k_0 2024-09-12T01:04:39.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.282+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11344859196370034331', time=2024-09-12T02:52:58.179337+0000, chain.objs.size()=1 2024-09-12T01:04:39.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.282+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Sjq_yDxOfQFvX0Jy_fUx0yL8QQ-KJc3_0 2024-09-12T01:04:39.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.282+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11634321454615276450', time=2024-09-12T02:52:58.204196+0000, chain.objs.size()=1 2024-09-12T01:04:39.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.282+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.b6OlPxAjq9RgAnTg068Ssg_5qz8fN___0 2024-09-12T01:04:39.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.282+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2486222673775830889', time=2024-09-12T02:52:58.205191+0000, chain.objs.size()=1 2024-09-12T01:04:39.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.282+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.kdRMPDAkdk3MJjOTzCU_b7ZcgJkqbba_0 2024-09-12T01:04:39.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.282+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10340593625463320004', time=2024-09-12T02:52:58.207058+0000, chain.objs.size()=1 2024-09-12T01:04:39.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.282+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.WKd6QFyufveFeKsYuD3EhrfkWM74D3g_0 2024-09-12T01:04:39.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.282+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18320639331643688190', time=2024-09-12T02:52:58.216462+0000, chain.objs.size()=1 2024-09-12T01:04:39.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.282+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.mnPkgUeozCKyQXgbyaZKfBzCPXxn_qa_0 2024-09-12T01:04:39.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.282+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4333605345078766720', time=2024-09-12T02:52:58.221242+0000, chain.objs.size()=1 2024-09-12T01:04:39.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.282+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.I5PhQPm8spFvWgvSf41BQl0fyOIUnEx_0 2024-09-12T01:04:39.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.282+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11468513389161589397', time=2024-09-12T02:52:58.391135+0000, chain.objs.size()=1 2024-09-12T01:04:39.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.282+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Wf7vLlkvBOdRVliNyJ4eCxv-aZh2FS1_0 2024-09-12T01:04:39.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.282+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12908763975925457473', time=2024-09-12T02:52:58.435283+0000, chain.objs.size()=1 2024-09-12T01:04:39.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.282+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.9rDjntWBxxWmepr41gP_ZL2TXBKwSwz_0 2024-09-12T01:04:39.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.282+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14275693208490718351', time=2024-09-12T02:52:58.472233+0000, chain.objs.size()=1 2024-09-12T01:04:39.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.282+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.m1h8Iye-KqjrJCygTfUx6DqElkKLuXu_0 2024-09-12T01:04:39.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.286+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2597745441085108268', time=2024-09-12T02:52:58.473033+0000, chain.objs.size()=1 2024-09-12T01:04:39.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.286+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.TJueUB-5stD_rKOBkyRnkLtNP84xbk-_0 2024-09-12T01:04:39.288 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.286+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/84791 2024-09-12T01:04:39.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.290+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T01:04:39.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.290+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8957335312705047033', time=2024-09-12T02:52:58.596696+0000, chain.objs.size()=1 2024-09-12T01:04:39.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.290+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.thOzKyrFeh4uHeqv3LbZ2ppL47j7oxT_0 2024-09-12T01:04:39.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.290+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4737793921614254265', time=2024-09-12T02:52:58.598721+0000, chain.objs.size()=1 2024-09-12T01:04:39.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.290+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.GuHiNnU8hd6GfiWyedlYQT8P3J5NGHm_0 2024-09-12T01:04:39.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.290+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13892982492662177777', time=2024-09-12T02:52:58.670219+0000, chain.objs.size()=1 2024-09-12T01:04:39.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.290+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.N4dmzYRJTMtFWO_EUPn3qWK6xGzKHOR_0 2024-09-12T01:04:39.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.290+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.465733804906781806', time=2024-09-12T02:53:04.593256+0000, chain.objs.size()=1 2024-09-12T01:04:39.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.290+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.333__shadow_.YjfUmSeKOc98fZOkDCAIhvp17ifG2-h_0 2024-09-12T01:04:39.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.290+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16297591052407081570', time=2024-09-12T02:54:53.305007+0000, chain.objs.size()=1 2024-09-12T01:04:39.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.290+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.483__shadow_.dwkh6Qnz3l3AP2KzPbQZwII3Xi9CtDx_0 2024-09-12T01:04:39.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.290+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4375086614156484136', time=2024-09-12T02:55:03.447698+0000, chain.objs.size()=1 2024-09-12T01:04:39.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.290+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.497__shadow_.pdjKmNkOczotCIeoEyrnVdm48XG40qU_0 2024-09-12T01:04:39.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.290+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1045080788423899275', time=2024-09-12T02:55:18.612612+0000, chain.objs.size()=1 2024-09-12T01:04:39.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.290+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.518__multipart_mymultipart.2~RwT21f1nhiIgbvYuB42Q2nYGmC7NBZl.1 2024-09-12T01:04:39.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.290+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4331558416366863974', time=2024-09-12T02:55:19.464378+0000, chain.objs.size()=1 2024-09-12T01:04:39.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.290+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.517__shadow_.xb1h6PgW32sG_KPqHYJejeWur-9a8l-_0 2024-09-12T01:04:39.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.290+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~e0BwqdFAQ8Qn1GTa35Rf-3GAS6aOgyb', time=2024-09-12T02:55:28.727546+0000, chain.objs.size()=1 2024-09-12T01:04:39.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.290+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.2~e0BwqdFAQ8Qn1GTa35Rf-3GAS6aOgyb.1 2024-09-12T01:04:39.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.290+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~XjaTTqcCRPhzht3XsRsI753kgTbBRjx', time=2024-09-12T02:55:37.854221+0000, chain.objs.size()=1 2024-09-12T01:04:39.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.290+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.2~XjaTTqcCRPhzht3XsRsI753kgTbBRjx.2 2024-09-12T01:04:39.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.290+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~XjaTTqcCRPhzht3XsRsI753kgTbBRjx', time=2024-09-12T02:55:37.857978+0000, chain.objs.size()=1 2024-09-12T01:04:39.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.290+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.2~XjaTTqcCRPhzht3XsRsI753kgTbBRjx.3 2024-09-12T01:04:39.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.290+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7202548267437682663', time=2024-09-12T02:57:30.983192+0000, chain.objs.size()=1 2024-09-12T01:04:39.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.290+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:slTrFaKkEMEtrzn5w..ABF9DPFoXDYd_.DIXd4Mv2yIOgluTvCTlX3USCDOZjEoY_0 2024-09-12T01:04:39.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.294+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7457549261638947823', time=2024-09-12T02:57:46.508039+0000, chain.objs.size()=1 2024-09-12T01:04:39.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.294+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.580__shadow:RD9R7T.SWCifB5Jk4Cu.ouVVEDXs6GE_.l3f2invbA3_55ykYVqCHjPmYpUrZCIb_0 2024-09-12T01:04:39.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.294+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17817140232313282768', time=2024-09-12T02:57:52.155662+0000, chain.objs.size()=1 2024-09-12T01:04:39.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.294+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.587__shadow:zEkjwyL7t8XqF7KCh9-M9ATD5gRlj1A_._0kTVEpGAtb1oCwthNwyov4Cddjvptm_0 2024-09-12T01:04:39.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.294+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7402097701095939332', time=2024-09-12T03:00:24.336745+0000, chain.objs.size()=1 2024-09-12T01:04:39.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.294+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.618__shadow_.q6B71Y-k_JGPJCxG3lNl-RgtyHBJ0wY_0 2024-09-12T01:04:39.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.294+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9169449638369551692', time=2024-09-12T03:00:25.845419+0000, chain.objs.size()=1 2024-09-12T01:04:39.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.294+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.620__shadow_.jcfil97_BKeMpmjuAS8U1RMq1rVfbWf_0 2024-09-12T01:04:39.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.294+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1846326412467558292', time=2024-09-12T03:00:41.730278+0000, chain.objs.size()=1 2024-09-12T01:04:39.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.294+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.635__shadow_.hxG_Yku5O1vtK84doQjPmJAGSkFnHoL_0 2024-09-12T01:04:39.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.294+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.590164896789751841', time=2024-09-12T03:00:43.285348+0000, chain.objs.size()=1 2024-09-12T01:04:39.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.294+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.637__shadow_.JORcNo3qGUMJMNMCKfQds4phmw7j1p8_0 2024-09-12T01:04:39.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.294+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16437800100704274431', time=2024-09-12T03:01:08.600610+0000, chain.objs.size()=1 2024-09-12T01:04:39.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.294+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.666__shadow_.gXkjxm_BAuex01FU9jG77H236-BKeEV_0 2024-09-12T01:04:39.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.294+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12078216874291561193', time=2024-09-12T03:01:08.602325+0000, chain.objs.size()=1 2024-09-12T01:04:39.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.294+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.666__shadow_.03upu-TmYEVltW7m_d8mCalkCnhYG1w_0 2024-09-12T01:04:39.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.294+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16424786348890825840', time=2024-09-12T03:01:09.530421+0000, chain.objs.size()=1 2024-09-12T01:04:39.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.294+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.668__shadow_.j3_WzqPV4scGSijeHcTKMkW3IC4iouW_0 2024-09-12T01:04:39.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.294+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~g34za7uz2DzZnU9s1tQN1UhbKmelGrU', time=2024-09-12T03:02:20.585798+0000, chain.objs.size()=1 2024-09-12T01:04:39.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.294+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.742__multipart_mymultipart2.2~g34za7uz2DzZnU9s1tQN1UhbKmelGrU.1 2024-09-12T01:04:39.296 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.298+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:39.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.298+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:04:39.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.298+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:39.300 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.302+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:39.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.302+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51597' 2024-09-12T01:04:39.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.302+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='_aoJzQJwaKvUsZDvGzMPSzwH8CVqYkYy', time=2024-09-12T02:48:32.775559+0000, chain.objs.size()=3 2024-09-12T01:04:39.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.302+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.160__shadow_.mpPPDUDP63wSBhwCE0qXOcQhLR_-oHc_0 2024-09-12T01:04:39.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.302+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.160__shadow_.mpPPDUDP63wSBhwCE0qXOcQhLR_-oHc_1 2024-09-12T01:04:39.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.302+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.160__shadow_.mpPPDUDP63wSBhwCE0qXOcQhLR_-oHc_2 2024-09-12T01:04:39.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.302+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='_s3BGO_12ILpwgZwG3Lp97v9tIYngbmd', time=2024-09-12T02:48:34.607999+0000, chain.objs.size()=3 2024-09-12T01:04:39.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.302+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.161__shadow_.B2gvlIkn3y4AJAzTGIobf0RL0gDIQia_0 2024-09-12T01:04:39.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.302+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.161__shadow_.B2gvlIkn3y4AJAzTGIobf0RL0gDIQia_1 2024-09-12T01:04:39.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.302+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.161__shadow_.B2gvlIkn3y4AJAzTGIobf0RL0gDIQia_2 2024-09-12T01:04:39.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.302+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17139339930872102325', time=2024-09-12T02:48:35.341668+0000, chain.objs.size()=5 2024-09-12T01:04:39.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.302+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.161__multipart_foo-FROZEN.2~OcAuNdc4BDm_XQszPE9y-BeplVHRwAJ.1 2024-09-12T01:04:39.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.302+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.161__shadow_foo-FROZEN.2~OcAuNdc4BDm_XQszPE9y-BeplVHRwAJ.1_1 2024-09-12T01:04:39.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.302+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.161__multipart_foo-FROZEN.2~OcAuNdc4BDm_XQszPE9y-BeplVHRwAJ.2 2024-09-12T01:04:39.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.302+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.161__shadow_foo-FROZEN.2~OcAuNdc4BDm_XQszPE9y-BeplVHRwAJ.2_1 2024-09-12T01:04:39.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.302+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.161__multipart_foo-FROZEN.2~OcAuNdc4BDm_XQszPE9y-BeplVHRwAJ.3 2024-09-12T01:04:39.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.302+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13924875636076759831', time=2024-09-12T02:50:44.916609+0000, chain.objs.size()=1 2024-09-12T01:04:39.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.302+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.234__shadow_.TAtOMd73YMN5GY8fYii0b5w4bR0L2c0_0 2024-09-12T01:04:39.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.306+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16745805726859751391', time=2024-09-12T02:50:44.918914+0000, chain.objs.size()=1 2024-09-12T01:04:39.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.306+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.234__shadow_.n5maKv5McspZpQ0zYzNrL8dZHPtqsYq_0 2024-09-12T01:04:39.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.306+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6854823866628874830', time=2024-09-12T02:50:46.423655+0000, chain.objs.size()=1 2024-09-12T01:04:39.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.306+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.236__shadow_.qfIc5YlluSxkiLJjUnjvqQn3oFrUAzB_0 2024-09-12T01:04:39.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.306+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5853287392985512288', time=2024-09-12T02:50:55.741415+0000, chain.objs.size()=1 2024-09-12T01:04:39.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.306+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.246__shadow_.06WqyHaO0KTueJqajo47jj_GyznWGfD_0 2024-09-12T01:04:39.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.306+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.706674774336327286', time=2024-09-12T02:51:04.048974+0000, chain.objs.size()=1 2024-09-12T01:04:39.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.306+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.257__shadow_.S945zw_x_RbUkWv5OdXiaYlSr8hydqf_0 2024-09-12T01:04:39.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.306+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6676937730341664875', time=2024-09-12T02:51:26.794384+0000, chain.objs.size()=1 2024-09-12T01:04:39.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.306+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.G-rWXgK75PRh_VU_HnyD_P9uou4SIK6_0 2024-09-12T01:04:39.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.306+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14960058040857043410', time=2024-09-12T02:51:26.842064+0000, chain.objs.size()=1 2024-09-12T01:04:39.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.306+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.f0hkMu9lJFl3IP6vQNtWeCv0ZerRwVp_0 2024-09-12T01:04:39.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.306+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4413520326686156232', time=2024-09-12T02:51:26.882156+0000, chain.objs.size()=1 2024-09-12T01:04:39.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.306+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.YFcoSN8GjRtHHnHqFtl2mZTwwjM7sF0_0 2024-09-12T01:04:39.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.306+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2058733968581434642', time=2024-09-12T02:51:26.980077+0000, chain.objs.size()=1 2024-09-12T01:04:39.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.306+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Fo_xo4KPwXoWJGg_QLPi_Dbp2xvM1VX_0 2024-09-12T01:04:39.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.306+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16017780539525894938', time=2024-09-12T02:51:26.984389+0000, chain.objs.size()=1 2024-09-12T01:04:39.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.306+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.0BZqOMVnBjXKRx3aftQz49WQn2cQS92_0 2024-09-12T01:04:39.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.306+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17813556719782147720', time=2024-09-12T02:51:27.071927+0000, chain.objs.size()=1 2024-09-12T01:04:39.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.306+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.nB7WBm06xBgGNalStUU22tY1CgcmFa7_0 2024-09-12T01:04:39.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.306+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17961018581489707121', time=2024-09-12T02:51:27.085459+0000, chain.objs.size()=1 2024-09-12T01:04:39.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.306+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.EwYwts4eYtiPzkGRQMB2dKGVVbQrY-z_0 2024-09-12T01:04:39.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.306+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8813072069169898331', time=2024-09-12T02:51:27.248691+0000, chain.objs.size()=1 2024-09-12T01:04:39.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.306+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.7V4DZGXcm65xt7K5h7HY95PXSCRxUb0_0 2024-09-12T01:04:39.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.306+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15073456765777158393', time=2024-09-12T02:51:27.269660+0000, chain.objs.size()=1 2024-09-12T01:04:39.309 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.306+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.eJZ5Xpf7m_4J1WK_Y5gvgH7aqfQ5Hb-_0 2024-09-12T01:04:39.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.310+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7471742498011284352', time=2024-09-12T02:51:27.285148+0000, chain.objs.size()=1 2024-09-12T01:04:39.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.310+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Xug4l4R8nJwyTg6YavcYodjHtTrPUzL_0 2024-09-12T01:04:39.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.310+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3772634374761564996', time=2024-09-12T02:51:27.324263+0000, chain.objs.size()=1 2024-09-12T01:04:39.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.310+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.-4-7roVPWm65Wt_90gdsVCoEdh6Bir6_0 2024-09-12T01:04:39.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.310+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2559069900676907489', time=2024-09-12T02:51:27.455401+0000, chain.objs.size()=1 2024-09-12T01:04:39.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.310+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.FK05TIX4opsjY_lAqSG74OKDZxtsL8v_0 2024-09-12T01:04:39.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.310+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14581591004968929132', time=2024-09-12T02:51:27.480575+0000, chain.objs.size()=1 2024-09-12T01:04:39.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.310+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.jkPVzPO0lPKhTJ3KIxEj_JqgCJ_3_Et_0 2024-09-12T01:04:39.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.310+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.335133408082054081', time=2024-09-12T02:51:27.481641+0000, chain.objs.size()=1 2024-09-12T01:04:39.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.310+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.EnN4GZ6S3ufoDeDD-bqmRUzQrjUsTQ2_0 2024-09-12T01:04:39.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.310+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1265902955693299195', time=2024-09-12T02:51:27.717031+0000, chain.objs.size()=1 2024-09-12T01:04:39.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.310+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Ph3PW4UITcnHfyCUKWnvMIvZt1RfXqj_0 2024-09-12T01:04:39.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.310+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15211882360045526625', time=2024-09-12T02:51:27.890079+0000, chain.objs.size()=1 2024-09-12T01:04:39.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.310+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.T3s1IS3E1D6x5RAQ4-ehNxzFpYjn877_0 2024-09-12T01:04:39.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.310+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11990442921500890037', time=2024-09-12T02:51:28.149235+0000, chain.objs.size()=1 2024-09-12T01:04:39.312 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.310+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.yhAEvhcHzEbVZbtYNReG2jIWK2_j8ja_0 2024-09-12T01:04:39.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.310+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3342022774408214477', time=2024-09-12T02:51:28.167768+0000, chain.objs.size()=1 2024-09-12T01:04:39.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.310+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.EFlVJiMYMgRkTscfuwAgss_lP7y9x5y_0 2024-09-12T01:04:39.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.310+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12484784340158993029', time=2024-09-12T02:51:28.171996+0000, chain.objs.size()=1 2024-09-12T01:04:39.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.310+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.eYYf0-U9yZwBlygJWX2IiNt1r-hoSYk_0 2024-09-12T01:04:39.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.310+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13610547785767251150', time=2024-09-12T02:51:28.181265+0000, chain.objs.size()=1 2024-09-12T01:04:39.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.310+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.aOc3H4b6IwxbPdEaHMIWCcPP80OmkLv_0 2024-09-12T01:04:39.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.310+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6730861181102245408', time=2024-09-12T02:51:28.195795+0000, chain.objs.size()=1 2024-09-12T01:04:39.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.310+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.mek2Wf02Lq3Y6z-zSYuZt8c3PQ15Cno_0 2024-09-12T01:04:39.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.310+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14515418168673688075', time=2024-09-12T02:51:28.212917+0000, chain.objs.size()=1 2024-09-12T01:04:39.316 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.310+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.YtK3M_UHrx6aMSYGfHkMiX4kzIJgti4_0 2024-09-12T01:04:39.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.314+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12039458756048441205', time=2024-09-12T02:51:28.247146+0000, chain.objs.size()=1 2024-09-12T01:04:39.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.314+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ZrPItjf_1t2Zthyz8WATg6x_FgbR8bJ_0 2024-09-12T01:04:39.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.314+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12305543942841010472', time=2024-09-12T02:51:28.361330+0000, chain.objs.size()=1 2024-09-12T01:04:39.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.314+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.CuWJkYuzlAaQV3yNPYNymDS5F68h43L_0 2024-09-12T01:04:39.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.314+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15694027507297656336', time=2024-09-12T02:51:28.599497+0000, chain.objs.size()=1 2024-09-12T01:04:39.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.314+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.YRJ1LwRwmlOCaE47Qs2bHD5ePsm8Kbz_0 2024-09-12T01:04:39.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.314+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4346671364905757684', time=2024-09-12T02:51:28.628459+0000, chain.objs.size()=1 2024-09-12T01:04:39.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.314+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Hj8QYLhXOAfKGC2jcaHzPwOYknlkAu1_0 2024-09-12T01:04:39.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.314+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10293577951362822954', time=2024-09-12T02:51:28.632996+0000, chain.objs.size()=1 2024-09-12T01:04:39.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.314+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.JczQ4Yce43evCN7KT84eXCnFRoQNxTe_0 2024-09-12T01:04:39.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.314+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9301017056795832995', time=2024-09-12T02:51:47.748394+0000, chain.objs.size()=1 2024-09-12T01:04:39.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.314+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.288__shadow_.P_hyxteHCPl4xL3en-gpWHzBcH74WVj_0 2024-09-12T01:04:39.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.314+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3373091917603945913', time=2024-09-12T02:51:51.716541+0000, chain.objs.size()=1 2024-09-12T01:04:39.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.314+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.292__shadow_.LcCInyy3CyGiHXeE1LBLh0Kc2Vtw14T_0 2024-09-12T01:04:39.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.314+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11226119803180523915', time=2024-09-12T02:51:51.753129+0000, chain.objs.size()=1 2024-09-12T01:04:39.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.314+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.292__shadow_.vwgDW92H2AIs0TbGtKV-cHW-otHxtPG_0 2024-09-12T01:04:39.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.314+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14326593253493348002', time=2024-09-12T02:51:53.162860+0000, chain.objs.size()=1 2024-09-12T01:04:39.319 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.314+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.293__shadow_.CvQ72bwxDtVpJA-v2q0UnrJfG-5ImT1_0 2024-09-12T01:04:39.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.314+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16234821190427375498', time=2024-09-12T02:51:59.951188+0000, chain.objs.size()=1 2024-09-12T01:04:39.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.314+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.302__shadow_.cbKSatDGKvD9hq_akXpP7uAgcn4Yf7k_0 2024-09-12T01:04:39.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.314+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5757425801015823595', time=2024-09-12T02:52:35.149024+0000, chain.objs.size()=1 2024-09-12T01:04:39.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.314+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Xei78nXjXGL0QToDIId2MqlxVDlB70V_0 2024-09-12T01:04:39.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.314+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1105744691199233731', time=2024-09-12T02:52:35.358598+0000, chain.objs.size()=1 2024-09-12T01:04:39.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.314+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Lc1pQjnLO1ezIdHBK-yzbxxSzFO1ho__0 2024-09-12T01:04:39.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.314+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16400904805959221499', time=2024-09-12T02:52:35.413331+0000, chain.objs.size()=1 2024-09-12T01:04:39.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.314+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.lIN5blks5hvL1tB06vV_1icBRTW9keg_0 2024-09-12T01:04:39.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.318+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.994660982505106267', time=2024-09-12T02:52:35.560539+0000, chain.objs.size()=1 2024-09-12T01:04:39.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.318+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.OaFMO_c544Y2AWqwXYB6OgvxA4tOozs_0 2024-09-12T01:04:39.320 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.318+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14060313000644597321', time=2024-09-12T02:52:35.567990+0000, chain.objs.size()=1 2024-09-12T01:04:39.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.318+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ILwuZ8llbiAmjBdg5KC3SHl5szcmu7v_0 2024-09-12T01:04:39.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.318+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12968716740368231920', time=2024-09-12T02:52:35.609198+0000, chain.objs.size()=1 2024-09-12T01:04:39.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.318+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.3daVOaQMILhf9GsaL7S7NC0nNDWfHFK_0 2024-09-12T01:04:39.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.318+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8258961110807687658', time=2024-09-12T02:52:35.612061+0000, chain.objs.size()=1 2024-09-12T01:04:39.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.318+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.044AQesb-cZl5NLmYb3mPXzmjnly0rq_0 2024-09-12T01:04:39.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.318+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2417258333854073867', time=2024-09-12T02:52:35.649917+0000, chain.objs.size()=1 2024-09-12T01:04:39.321 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.318+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.TsUezWkStNK-qCeGS1VAeLOkviJznNo_0 2024-09-12T01:04:39.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16021806265350345358', time=2024-09-12T02:52:35.767468+0000, chain.objs.size()=1 2024-09-12T01:04:39.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.OcNPdF8AvEmc0OQg0oVRrM2DlBuiVD9_0 2024-09-12T01:04:39.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.453180563090491341', time=2024-09-12T02:52:35.789258+0000, chain.objs.size()=1 2024-09-12T01:04:39.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.2TTrrOn-IfXxjvT3SQvVAhFmYJpwgNY_0 2024-09-12T01:04:39.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14908182762211144716', time=2024-09-12T02:52:35.861910+0000, chain.objs.size()=1 2024-09-12T01:04:39.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.9jNFiU55_NxI9MBHqbiRE5HSiSZEXe__0 2024-09-12T01:04:39.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4390904168331559829', time=2024-09-12T02:52:36.238498+0000, chain.objs.size()=1 2024-09-12T01:04:39.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.yVwpCRpeyjvQVlLhg3ufnwxX4RWOisJ_0 2024-09-12T01:04:39.322 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8869611604982474718', time=2024-09-12T02:52:36.356871+0000, chain.objs.size()=1 2024-09-12T01:04:39.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.to0cVVo2R_COjG0TUEWeX3OkeLAbujR_0 2024-09-12T01:04:39.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1766976433934385786', time=2024-09-12T02:52:36.378530+0000, chain.objs.size()=1 2024-09-12T01:04:39.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.SMNDbHoP81a6vKXQsHm5rM-EUEPgfVB_0 2024-09-12T01:04:39.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2267685313843546137', time=2024-09-12T02:52:36.553482+0000, chain.objs.size()=1 2024-09-12T01:04:39.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.wyDz4kiQRBcWhByxs2YNOxi6upGlWOh_0 2024-09-12T01:04:39.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17586830045114380887', time=2024-09-12T02:52:36.632886+0000, chain.objs.size()=1 2024-09-12T01:04:39.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.-JtM_EMOpVow9Ua9_oMYLzrMth63ju9_0 2024-09-12T01:04:39.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1147110519242599679', time=2024-09-12T02:52:36.840244+0000, chain.objs.size()=1 2024-09-12T01:04:39.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_._z3EPpmuLvuPFj73M5JL3POhPrHlZcj_0 2024-09-12T01:04:39.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4850458261509405514', time=2024-09-12T02:52:36.841661+0000, chain.objs.size()=1 2024-09-12T01:04:39.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.n1L49msXhwz2TgpRvU0Be6ytVDDFgq-_0 2024-09-12T01:04:39.323 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12372281288285381151', time=2024-09-12T02:52:36.856759+0000, chain.objs.size()=1 2024-09-12T01:04:39.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.cDBLoYOsuW4VsQtbARPLzVGCG-0M0qv_0 2024-09-12T01:04:39.324 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16828631207241258051', time=2024-09-12T02:52:36.875346+0000, chain.objs.size()=1 2024-09-12T01:04:39.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.YtRVZOXhq5r3vZ5z9sYQ1_mNbaGa-pd_0 2024-09-12T01:04:39.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12843354911051362196', time=2024-09-12T02:52:36.996223+0000, chain.objs.size()=1 2024-09-12T01:04:39.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.J6U2--bbOZkC5k8FgOqMqBZ5YdvoH-l_0 2024-09-12T01:04:39.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16685065070270709456', time=2024-09-12T02:52:37.016214+0000, chain.objs.size()=1 2024-09-12T01:04:39.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.MmhEtk1zm5lv_HOIEkMxOPvyhn3Culx_0 2024-09-12T01:04:39.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1275243966331790588', time=2024-09-12T02:52:37.047213+0000, chain.objs.size()=1 2024-09-12T01:04:39.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.0MJVlAfm9y9F72VLbtNJTuYoPchr05k_0 2024-09-12T01:04:39.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12908325278090383662', time=2024-09-12T02:52:37.073930+0000, chain.objs.size()=1 2024-09-12T01:04:39.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.-0FxUIpwLNSQKXxzdUmui-dDmho4_io_0 2024-09-12T01:04:39.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15486149285191996595', time=2024-09-12T02:52:56.934111+0000, chain.objs.size()=1 2024-09-12T01:04:39.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Xj1WDadgiyBoQqvgT6sQUymc_It4bfl_0 2024-09-12T01:04:39.325 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4607323261734393628', time=2024-09-12T02:52:56.945421+0000, chain.objs.size()=1 2024-09-12T01:04:39.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.-FfHQ2siKNqfW70v-ejFZKBfmdZg4h7_0 2024-09-12T01:04:39.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2147327188499974810', time=2024-09-12T02:52:56.953024+0000, chain.objs.size()=1 2024-09-12T01:04:39.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.pI8MkCcJ6R2D7uLQBXTFfNp3Psk2s8v_0 2024-09-12T01:04:39.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17542140728189746843', time=2024-09-12T02:52:56.974410+0000, chain.objs.size()=1 2024-09-12T01:04:39.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.3qVH8Qv-FvCM2wsM1eOax4OU7HBH-1K_0 2024-09-12T01:04:39.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7086615975170478351', time=2024-09-12T02:52:56.993374+0000, chain.objs.size()=1 2024-09-12T01:04:39.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.8Pfmi3DspoUr1wh-QRf_RbjFEQNWp7d_0 2024-09-12T01:04:39.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17544171174835672814', time=2024-09-12T02:52:57.190413+0000, chain.objs.size()=1 2024-09-12T01:04:39.326 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.322+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.yDZ3JeDrurxDdSXAhlB60Bs9WRdlsC-_0 2024-09-12T01:04:39.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1669611121344897050', time=2024-09-12T02:52:57.259517+0000, chain.objs.size()=1 2024-09-12T01:04:39.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.S63fKGzCuOFL3o2Y5maBubNB4arcpet_0 2024-09-12T01:04:39.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3517162848178510753', time=2024-09-12T02:52:57.281171+0000, chain.objs.size()=1 2024-09-12T01:04:39.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.uCMSetjmbxOum1Puf7etn2WHDLTTkPS_0 2024-09-12T01:04:39.327 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9417841240361225873', time=2024-09-12T02:52:57.285626+0000, chain.objs.size()=1 2024-09-12T01:04:39.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.G2CBRkt9mh75wefEXL2Lc81sdkWHwlI_0 2024-09-12T01:04:39.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15439406030113964407', time=2024-09-12T02:52:57.427049+0000, chain.objs.size()=1 2024-09-12T01:04:39.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.3aT5E1SyhaHr6pOOs6j-TUKlVb4xASX_0 2024-09-12T01:04:39.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8555039302548917401', time=2024-09-12T02:52:57.437469+0000, chain.objs.size()=1 2024-09-12T01:04:39.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.tk09-j3b8XGQMYnJK7_WqWFhm-fG0OW_0 2024-09-12T01:04:39.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10917144971415549483', time=2024-09-12T02:52:57.446228+0000, chain.objs.size()=1 2024-09-12T01:04:39.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.h5HVd554rUWr2x7qJBVEOX4_VkSjyGY_0 2024-09-12T01:04:39.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14720067134217974166', time=2024-09-12T02:52:57.518165+0000, chain.objs.size()=1 2024-09-12T01:04:39.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.sTkjLAv5WQ9SV4hCM681VU_hU3DW9ZF_0 2024-09-12T01:04:39.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9080754940464605462', time=2024-09-12T02:52:57.521519+0000, chain.objs.size()=1 2024-09-12T01:04:39.328 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.mP2hrf-Mjw6EI0TqgkoaF7qSkHvdsAl_0 2024-09-12T01:04:39.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10886307923626310540', time=2024-09-12T02:52:57.666380+0000, chain.objs.size()=1 2024-09-12T01:04:39.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.B_hI2EtMRAaLpqr6a8gXVlipz5hIUia_0 2024-09-12T01:04:39.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15387208035837474332', time=2024-09-12T02:52:57.684044+0000, chain.objs.size()=1 2024-09-12T01:04:39.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.p6nEYjPykFUFGT5sb1_8DAhnc9iv8Jr_0 2024-09-12T01:04:39.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4634386388864832279', time=2024-09-12T02:52:57.747813+0000, chain.objs.size()=1 2024-09-12T01:04:39.329 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.65fWpuxUW8kLDxKZYud6WNU3jOtOaGT_0 2024-09-12T01:04:39.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11037038654688616435', time=2024-09-12T02:52:57.857659+0000, chain.objs.size()=1 2024-09-12T01:04:39.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Z5eNEd1AO_iGYSKrRoUaW1ZhiXLvdpP_0 2024-09-12T01:04:39.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11017260265710295429', time=2024-09-12T02:52:57.868594+0000, chain.objs.size()=1 2024-09-12T01:04:39.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.vGFhtUkW11AAngxZ1VOhvvxSGqaQf6P_0 2024-09-12T01:04:39.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7685819583254936875', time=2024-09-12T02:52:57.971959+0000, chain.objs.size()=1 2024-09-12T01:04:39.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.b3SNZz0tyFKyyOvyBo-SxUWqKHNgTI1_0 2024-09-12T01:04:39.330 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6528036414112878715', time=2024-09-12T02:52:58.235870+0000, chain.objs.size()=1 2024-09-12T01:04:39.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.mJbdOpiI1PC9L2e32cFXi1I4jSdAgR5_0 2024-09-12T01:04:39.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2852878074916658681', time=2024-09-12T02:52:58.236627+0000, chain.objs.size()=1 2024-09-12T01:04:39.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.guPDRGty4dJ1wz4ZJ-oMkOQmDrHpzrM_0 2024-09-12T01:04:39.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13786944617605218857', time=2024-09-12T02:52:58.237808+0000, chain.objs.size()=1 2024-09-12T01:04:39.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.sQFb94f8foRkgDL-o7B2qNl2c3YNDcn_0 2024-09-12T01:04:39.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17940949811795115555', time=2024-09-12T02:52:58.362401+0000, chain.objs.size()=1 2024-09-12T01:04:39.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.326+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.rgliiJciPhEFkKiRnFjJs8nEwi9Kei__0 2024-09-12T01:04:39.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.330+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9655439165770378239', time=2024-09-12T02:52:58.364212+0000, chain.objs.size()=1 2024-09-12T01:04:39.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.330+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.xSauzqhrwYWovgHchzk75pC2uMLwOob_0 2024-09-12T01:04:39.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.330+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5313571673478249136', time=2024-09-12T02:52:58.439772+0000, chain.objs.size()=1 2024-09-12T01:04:39.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.330+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.n8mfqOjps6ljV20Mb8tEbcMEH_z6dZO_0 2024-09-12T01:04:39.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.330+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17720383697447244990', time=2024-09-12T02:52:58.445753+0000, chain.objs.size()=1 2024-09-12T01:04:39.331 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.330+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.YWvNd4SBhLAkc6gLem-XUJPlr8FTiMK_0 2024-09-12T01:04:39.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.330+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.110405143648455365', time=2024-09-12T02:52:58.453878+0000, chain.objs.size()=1 2024-09-12T01:04:39.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.330+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Uo3CHYaziKoTJlrdPYx0rWdMezpZExb_0 2024-09-12T01:04:39.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.330+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18352039832011817073', time=2024-09-12T02:52:58.487826+0000, chain.objs.size()=1 2024-09-12T01:04:39.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.330+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.YN0M1jZx79hg29ndlm962OU0x3IubcO_0 2024-09-12T01:04:39.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.330+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4509592453157772492', time=2024-09-12T02:52:58.493679+0000, chain.objs.size()=1 2024-09-12T01:04:39.332 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.330+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.US913HosztmU3xWdlzIyM3OQRuNHYSa_0 2024-09-12T01:04:39.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.334+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11691710810044666680', time=2024-09-12T02:52:58.595551+0000, chain.objs.size()=1 2024-09-12T01:04:39.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.334+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.OQaIPB1M17cS4qv3uHYql0VaSbfsgUc_0 2024-09-12T01:04:39.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.334+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.490663783329613407', time=2024-09-12T02:52:58.689666+0000, chain.objs.size()=1 2024-09-12T01:04:39.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.334+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.qxyUszrrjR1oSyl31jKl8JpctVPc9JY_0 2024-09-12T01:04:39.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.334+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1577741876600100992', time=2024-09-12T02:53:56.521621+0000, chain.objs.size()=1 2024-09-12T01:04:39.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.334+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.407__shadow_.P8yiYF_-j1YGMzQyzrfHcroIb6GBePB_0 2024-09-12T01:04:39.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.334+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7562231559247356451', time=2024-09-12T02:54:36.630967+0000, chain.objs.size()=1 2024-09-12T01:04:39.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.334+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.458__shadow_.uhvHtjXMp0ViH1lgKiraQSyYD4DprD1_0 2024-09-12T01:04:39.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.334+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5301887230887792934', time=2024-09-12T02:55:03.447994+0000, chain.objs.size()=1 2024-09-12T01:04:39.334 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.334+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.497__shadow_.pdjKmNkOczotCIeoEyrnVdm48XG40qU_0 2024-09-12T01:04:39.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.334+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14912574346950287287', time=2024-09-12T02:55:26.036154+0000, chain.objs.size()=3 2024-09-12T01:04:39.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.334+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.521__multipart_mymultipart.2~a2EoaQx4jYTRr_fD5CDtsqT-q-JyeG5.1 2024-09-12T01:04:39.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.334+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.521__multipart_mymultipart.2~a2EoaQx4jYTRr_fD5CDtsqT-q-JyeG5.2 2024-09-12T01:04:39.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.334+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.521__multipart_mymultipart.2~a2EoaQx4jYTRr_fD5CDtsqT-q-JyeG5.3 2024-09-12T01:04:39.335 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.334+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51597 2024-09-12T01:04:39.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.338+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T01:04:39.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.338+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12789590441896834512', time=2024-09-12T02:56:48.098661+0000, chain.objs.size()=1 2024-09-12T01:04:39.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.338+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.558__shadow_.5QluDctTMWKgXl4azxmx9WJe_3GOYxh_0 2024-09-12T01:04:39.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.338+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7812904607737903242', time=2024-09-12T02:57:03.667831+0000, chain.objs.size()=1 2024-09-12T01:04:39.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.338+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.569__shadow:n0TKL9Z8BenAxfFM-ikeOfDc8Vsc1WU_.erH8Hu59fxOawDO5ofUYI_Zh2kxI7jx_0 2024-09-12T01:04:39.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.338+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1748219825671669404', time=2024-09-12T02:57:20.466635+0000, chain.objs.size()=1 2024-09-12T01:04:39.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.338+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.576__shadow:.BfIMrUvoeGFiEXr3cGinToY-V0tOw2_.YlBd8JjKP0dVt58UYtjB87G-bj6NhXp_0 2024-09-12T01:04:39.338 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.338+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13794367358431447187', time=2024-09-12T02:57:25.400074+0000, chain.objs.size()=1 2024-09-12T01:04:39.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.338+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:cqALG3CSLGeU-6d8.IgnDGm3RMzk2FP_.va6ugzYbvRUmqmo9ReYkUXAMeYuFxA9_0 2024-09-12T01:04:39.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.338+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5644355381669995958', time=2024-09-12T02:57:36.740037+0000, chain.objs.size()=1 2024-09-12T01:04:39.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.338+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:KUkwu2S0brRihD4F6m1g8AQWIwaibZK_.-KarCzzglwMNVPN9k7eftsLFrDczByv_0 2024-09-12T01:04:39.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.338+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1270691368451166630', time=2024-09-12T02:57:44.637735+0000, chain.objs.size()=1 2024-09-12T01:04:39.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.338+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.579__shadow:WVmCi6wxXs8EKtUGuSZR8gmumYAkjaE_.dkraPuK2f5l52z7sCBhsbXTE0-yOB0i_0 2024-09-12T01:04:39.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.338+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3122686200707290827', time=2024-09-12T02:57:52.173850+0000, chain.objs.size()=1 2024-09-12T01:04:39.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.338+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.587__shadow:oUNdh-bGTXCvohdRdUkbbxeAbnULJVP_.Z2-rbvByHXmXaswy65TmgFVBgpkb5VV_0 2024-09-12T01:04:39.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.338+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.431766543277044767', time=2024-09-12T02:58:06.080773+0000, chain.objs.size()=1 2024-09-12T01:04:39.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.338+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.608__shadow_.E-2-p8yO-ltgt1j2RsGjKxd3rhGaKLU_0 2024-09-12T01:04:39.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.338+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~0ej_oOF5o353K7IL5ve2MmV1FQ22afQ', time=2024-09-12T03:00:32.811162+0000, chain.objs.size()=12 2024-09-12T01:04:39.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.338+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.624__multipart_multipart_enc.2~0ej_oOF5o353K7IL5ve2MmV1FQ22afQ.1 2024-09-12T01:04:39.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.338+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.624__shadow_multipart_enc.2~0ej_oOF5o353K7IL5ve2MmV1FQ22afQ.1_1 2024-09-12T01:04:39.339 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.338+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.624__multipart_multipart_enc.2~0ej_oOF5o353K7IL5ve2MmV1FQ22afQ.2 2024-09-12T01:04:39.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.338+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.624__shadow_multipart_enc.2~0ej_oOF5o353K7IL5ve2MmV1FQ22afQ.2_1 2024-09-12T01:04:39.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.338+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.624__multipart_multipart_enc.2~0ej_oOF5o353K7IL5ve2MmV1FQ22afQ.3 2024-09-12T01:04:39.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.338+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.624__shadow_multipart_enc.2~0ej_oOF5o353K7IL5ve2MmV1FQ22afQ.3_1 2024-09-12T01:04:39.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.338+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.624__multipart_multipart_enc.2~0ej_oOF5o353K7IL5ve2MmV1FQ22afQ.4 2024-09-12T01:04:39.340 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.338+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.624__shadow_multipart_enc.2~0ej_oOF5o353K7IL5ve2MmV1FQ22afQ.4_1 2024-09-12T01:04:39.341 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.342+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.624__multipart_multipart_enc.2~0ej_oOF5o353K7IL5ve2MmV1FQ22afQ.5 2024-09-12T01:04:39.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.342+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.624__shadow_multipart_enc.2~0ej_oOF5o353K7IL5ve2MmV1FQ22afQ.5_1 2024-09-12T01:04:39.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.342+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.624__multipart_multipart_enc.2~0ej_oOF5o353K7IL5ve2MmV1FQ22afQ.6 2024-09-12T01:04:39.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.342+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.624__shadow_multipart_enc.2~0ej_oOF5o353K7IL5ve2MmV1FQ22afQ.6_1 2024-09-12T01:04:39.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.342+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~NUuJMiUvzfRhKNmy98W_fmOS3okB-IJ', time=2024-09-12T03:00:34.474891+0000, chain.objs.size()=12 2024-09-12T01:04:39.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.342+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.625__multipart_multipart_enc.2~NUuJMiUvzfRhKNmy98W_fmOS3okB-IJ.1 2024-09-12T01:04:39.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.342+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.625__shadow_multipart_enc.2~NUuJMiUvzfRhKNmy98W_fmOS3okB-IJ.1_1 2024-09-12T01:04:39.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.342+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.625__multipart_multipart_enc.2~NUuJMiUvzfRhKNmy98W_fmOS3okB-IJ.2 2024-09-12T01:04:39.342 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.342+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.625__shadow_multipart_enc.2~NUuJMiUvzfRhKNmy98W_fmOS3okB-IJ.2_1 2024-09-12T01:04:39.343 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.342+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.625__multipart_multipart_enc.2~NUuJMiUvzfRhKNmy98W_fmOS3okB-IJ.3 2024-09-12T01:04:39.345 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.346+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.625__shadow_multipart_enc.2~NUuJMiUvzfRhKNmy98W_fmOS3okB-IJ.3_1 2024-09-12T01:04:39.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.346+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.625__multipart_multipart_enc.2~NUuJMiUvzfRhKNmy98W_fmOS3okB-IJ.4 2024-09-12T01:04:39.346 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.346+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.625__shadow_multipart_enc.2~NUuJMiUvzfRhKNmy98W_fmOS3okB-IJ.4_1 2024-09-12T01:04:39.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.350+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.625__multipart_multipart_enc.2~NUuJMiUvzfRhKNmy98W_fmOS3okB-IJ.5 2024-09-12T01:04:39.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.350+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.625__shadow_multipart_enc.2~NUuJMiUvzfRhKNmy98W_fmOS3okB-IJ.5_1 2024-09-12T01:04:39.350 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.350+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.625__multipart_multipart_enc.2~NUuJMiUvzfRhKNmy98W_fmOS3okB-IJ.6 2024-09-12T01:04:39.351 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.350+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.625__shadow_multipart_enc.2~NUuJMiUvzfRhKNmy98W_fmOS3okB-IJ.6_1 2024-09-12T01:04:39.351 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.350+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8327547935182293645', time=2024-09-12T03:00:49.021779+0000, chain.objs.size()=2 2024-09-12T01:04:39.351 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.350+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.645__shadow_._8iSNKEyJbamc6nn9410GOCETi_WJ9u_0 2024-09-12T01:04:39.351 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.350+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.645__shadow_._8iSNKEyJbamc6nn9410GOCETi_WJ9u_1 2024-09-12T01:04:39.351 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.350+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13136764867839595433', time=2024-09-12T03:00:49.891672+0000, chain.objs.size()=1 2024-09-12T01:04:39.351 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.350+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.646__shadow_.wGslYjfLyH9mB-6YQ3gBNdTp6zRpzJ5_0 2024-09-12T01:04:39.355 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.354+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:39.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.358+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:04:39.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.358+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:39.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:39.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51345' 2024-09-12T01:04:39.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7319326217465806098', time=2024-09-12T02:48:28.161801+0000, chain.objs.size()=1 2024-09-12T01:04:39.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.157__shadow:Gvrd2IFRlIK9OULWvdlLMHKTvyZyCfq_.srEEc8YbhHDghMvbRyKrEk0-sJOoU42_0 2024-09-12T01:04:39.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8636604502962009710', time=2024-09-12T02:50:44.149502+0000, chain.objs.size()=1 2024-09-12T01:04:39.362 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.233__shadow_.kjGczyebMYbMG7dmUoZRgIhpt29Okf7_0 2024-09-12T01:04:39.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7741852847983185353', time=2024-09-12T02:50:46.421091+0000, chain.objs.size()=1 2024-09-12T01:04:39.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.236__shadow_.8gfUITI-tPZ3fgFNXbuwexPsfQDCh_h_0 2024-09-12T01:04:39.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1942216284870729348', time=2024-09-12T02:51:04.049179+0000, chain.objs.size()=1 2024-09-12T01:04:39.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.257__shadow_.3eUwEfnly5eyGdipTj0XyQRpJW8snuu_0 2024-09-12T01:04:39.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6870593482151338204', time=2024-09-12T02:51:05.544121+0000, chain.objs.size()=1 2024-09-12T01:04:39.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.259__shadow_.-hz4tgtNlqMZ5Yp45jrQgpBgA8Rd9Mv_0 2024-09-12T01:04:39.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10504748287368132461', time=2024-09-12T02:51:07.015899+0000, chain.objs.size()=1 2024-09-12T01:04:39.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.261__shadow_.i9D8re-fbU-MvS9p17UJMxu7garNIQ-_0 2024-09-12T01:04:39.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2838738785903201965', time=2024-09-12T02:51:26.733540+0000, chain.objs.size()=1 2024-09-12T01:04:39.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.E58Cv9_4GX5zpNQvORbVsYKDb1TF7uQ_0 2024-09-12T01:04:39.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3980420567882811875', time=2024-09-12T02:51:26.875192+0000, chain.objs.size()=1 2024-09-12T01:04:39.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_._PiWqXx39bqWrcygSYNaNsegOpAZlg7_0 2024-09-12T01:04:39.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10131594517643633336', time=2024-09-12T02:51:26.999572+0000, chain.objs.size()=1 2024-09-12T01:04:39.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.N3DX2eVL_cIV8xy_mXhxtkb_3MZgX93_0 2024-09-12T01:04:39.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14214882676531953508', time=2024-09-12T02:51:27.013069+0000, chain.objs.size()=1 2024-09-12T01:04:39.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.WuHCzyv-ARKO0Gw4V9iaMA4ZYIagZ6l_0 2024-09-12T01:04:39.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14894294728603222159', time=2024-09-12T02:51:27.032374+0000, chain.objs.size()=1 2024-09-12T01:04:39.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.6KO1y9YLR8T-UdFLsu649fa6PwEJv6j_0 2024-09-12T01:04:39.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10007308811541348207', time=2024-09-12T02:51:27.047075+0000, chain.objs.size()=1 2024-09-12T01:04:39.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.CwSogJKzWbvvvPw82GXi2us_1cie0RL_0 2024-09-12T01:04:39.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11164302720579367124', time=2024-09-12T02:51:27.232544+0000, chain.objs.size()=1 2024-09-12T01:04:39.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.sVZ-V1a3TceqYJ5ts5LTTPpn6Tf3pg3_0 2024-09-12T01:04:39.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17831555206697393359', time=2024-09-12T02:51:27.261274+0000, chain.objs.size()=1 2024-09-12T01:04:39.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.RDadrkRI2DUVCwYOiTwJWod_7rWnV73_0 2024-09-12T01:04:39.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9035636930909508134', time=2024-09-12T02:51:27.324675+0000, chain.objs.size()=1 2024-09-12T01:04:39.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.VLcvL6wvvmsBWipXcZVH86RgMcVCW4V_0 2024-09-12T01:04:39.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11190791393486095115', time=2024-09-12T02:51:27.437453+0000, chain.objs.size()=1 2024-09-12T01:04:39.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.362+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.yHDIfrEgMLglMUUoNxTreUkLuV4NcDe_0 2024-09-12T01:04:39.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.366+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7364655921173075613', time=2024-09-12T02:51:27.485351+0000, chain.objs.size()=1 2024-09-12T01:04:39.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.366+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.g69yw95gq1gbIJyBp7_oxEtJGOu9BXX_0 2024-09-12T01:04:39.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.366+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10466493553968731550', time=2024-09-12T02:51:27.506431+0000, chain.objs.size()=1 2024-09-12T01:04:39.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.366+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.7SSS8kgGgx2aH9D6qPDfA2R-0LYTyLj_0 2024-09-12T01:04:39.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.366+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11381452466651360537', time=2024-09-12T02:51:27.536881+0000, chain.objs.size()=1 2024-09-12T01:04:39.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.366+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.h2Ggu0s7ff9s5NMCRLq8JdmPnaElKsT_0 2024-09-12T01:04:39.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.366+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18431407125841158924', time=2024-09-12T02:51:27.672589+0000, chain.objs.size()=1 2024-09-12T01:04:39.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.366+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.5smDZmiE2mJHEkCod0VA56G6L_R0tAQ_0 2024-09-12T01:04:39.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.366+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6455582686604824829', time=2024-09-12T02:51:27.965379+0000, chain.objs.size()=1 2024-09-12T01:04:39.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.366+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.EwBOjDpCtfulF3nG8lAHU6xq7CVsSuT_0 2024-09-12T01:04:39.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.366+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4917846215838534332', time=2024-09-12T02:51:28.171729+0000, chain.objs.size()=1 2024-09-12T01:04:39.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.366+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.7wi7RZPdJNoj1CrVGcVyyvoeZ6O7WsJ_0 2024-09-12T01:04:39.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.366+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1162760937752402482', time=2024-09-12T02:51:28.182707+0000, chain.objs.size()=1 2024-09-12T01:04:39.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.366+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.bFphDn_-qkQ1pCcTw_uYEl4tcUK-ESd_0 2024-09-12T01:04:39.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.366+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10659783736776257077', time=2024-09-12T02:51:28.187192+0000, chain.objs.size()=1 2024-09-12T01:04:39.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.366+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.0RqRuIlGSgxh6BMHVwDhpVH27PsfnhX_0 2024-09-12T01:04:39.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.366+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6064277575177819625', time=2024-09-12T02:51:28.250385+0000, chain.objs.size()=1 2024-09-12T01:04:39.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.366+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ZZdZRcA3WHj_CNKvblYtV3U8ElQ0FgF_0 2024-09-12T01:04:39.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.366+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17610591212055575960', time=2024-09-12T02:51:28.335698+0000, chain.objs.size()=1 2024-09-12T01:04:39.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.366+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.6szt_qeOX4HZ_Z892oBkBnMXfhn__zK_0 2024-09-12T01:04:39.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.366+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9379885490564910240', time=2024-09-12T02:51:28.367202+0000, chain.objs.size()=1 2024-09-12T01:04:39.368 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.366+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ctHAEiDOYI1_A0_H3u5tDgDdrpII_1w_0 2024-09-12T01:04:39.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.366+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7488590573228791573', time=2024-09-12T02:51:28.675164+0000, chain.objs.size()=1 2024-09-12T01:04:39.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.366+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.v5hnFnMl7KfPUGTg5_BNstSosw4SMaI_0 2024-09-12T01:04:39.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.366+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16705802352561369434', time=2024-09-12T02:51:38.781172+0000, chain.objs.size()=1 2024-09-12T01:04:39.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.366+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.276__shadow_.3xS7N35GCVDgkMrRzx4oQD9N74C6kHy_0 2024-09-12T01:04:39.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.366+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2992724977327425822', time=2024-09-12T02:51:38.782790+0000, chain.objs.size()=1 2024-09-12T01:04:39.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.366+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.276__shadow_.JaIY0T6KNhel6ROkQ-tkU6K0C7jeHkn_0 2024-09-12T01:04:39.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.370+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9293055548908421960', time=2024-09-12T02:51:40.220787+0000, chain.objs.size()=1 2024-09-12T01:04:39.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.370+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.278__shadow_.hVylx4E5Qso98THyeLjWw9vL0odejs9_0 2024-09-12T01:04:39.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.370+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16541729838991385586', time=2024-09-12T02:51:45.492204+0000, chain.objs.size()=1 2024-09-12T01:04:39.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.370+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.285__shadow_.TNaOylL9OWCgWDChdE0-IBHGqY6p8X__0 2024-09-12T01:04:39.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.370+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12018558102660802446', time=2024-09-12T02:51:49.259433+0000, chain.objs.size()=1 2024-09-12T01:04:39.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.370+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.290__shadow_.ViGPX-FNF4zJUdDvDqs3KCTD0z4qdIo_0 2024-09-12T01:04:39.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.370+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9528484262634860048', time=2024-09-12T02:51:57.670191+0000, chain.objs.size()=1 2024-09-12T01:04:39.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.370+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.299__shadow_.RihOHF-7t9Op_LEhVhim6TtBgWZn4pA_0 2024-09-12T01:04:39.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.370+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15076802414715600996', time=2024-09-12T02:51:59.188201+0000, chain.objs.size()=1 2024-09-12T01:04:39.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.370+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.301__shadow_.ZnvBKYfw2fc-qQ7gzi-7nhSk88LHKbe_0 2024-09-12T01:04:39.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.370+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15152955329866673969', time=2024-09-12T02:52:03.065056+0000, chain.objs.size()=1 2024-09-12T01:04:39.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.370+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.306__shadow_.EO_4Bai-optK8CbcycmW65Gwe0PT2QW_0 2024-09-12T01:04:39.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.370+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17026849233568596556', time=2024-09-12T02:52:35.042934+0000, chain.objs.size()=1 2024-09-12T01:04:39.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.370+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.BIFPFbYDFlC8gGbVbYEAkaByC5c2zAS_0 2024-09-12T01:04:39.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.370+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14205511912274685800', time=2024-09-12T02:52:35.047524+0000, chain.objs.size()=1 2024-09-12T01:04:39.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.370+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.SXvAT-NuPIf7lpDSrcRDF7dulUOrCw__0 2024-09-12T01:04:39.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.370+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9914006142456580608', time=2024-09-12T02:52:35.077137+0000, chain.objs.size()=1 2024-09-12T01:04:39.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.370+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.hPllnhF0e5HAdMXx4ZqQYxvgPY_9KS5_0 2024-09-12T01:04:39.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.370+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11879677715041465168', time=2024-09-12T02:52:35.079198+0000, chain.objs.size()=1 2024-09-12T01:04:39.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.370+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.4bussUT6liiJfy-42fBRrIAYbHjbRgR_0 2024-09-12T01:04:39.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.370+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11021799549088110787', time=2024-09-12T02:52:35.176536+0000, chain.objs.size()=1 2024-09-12T01:04:39.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.370+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ERrfw5OSkM2P-MovkqC8I7QWIdX6JbD_0 2024-09-12T01:04:39.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.370+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.320671570943041318', time=2024-09-12T02:52:35.331892+0000, chain.objs.size()=1 2024-09-12T01:04:39.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.370+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.l6-IUzFv2ENzalD4i6UELhW6WR8PUg7_0 2024-09-12T01:04:39.372 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.370+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1883756153502899299', time=2024-09-12T02:52:35.569678+0000, chain.objs.size()=1 2024-09-12T01:04:39.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.370+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.xLDtfXzztFy9-WjccBeXyR_BWTaN6c0_0 2024-09-12T01:04:39.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.370+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2305617063174799042', time=2024-09-12T02:52:35.571583+0000, chain.objs.size()=1 2024-09-12T01:04:39.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.370+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_._F_6TUNxoC_QlEA0vOXcxjoKoqt-HA__0 2024-09-12T01:04:39.373 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.374+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.775595453426374365', time=2024-09-12T02:52:35.600534+0000, chain.objs.size()=1 2024-09-12T01:04:39.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.374+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Yy394eXxy9ITGY8KCNGBPE1gNyXcOyn_0 2024-09-12T01:04:39.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.374+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17383738923643794992', time=2024-09-12T02:52:35.623356+0000, chain.objs.size()=1 2024-09-12T01:04:39.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.374+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.z7VEUcUA7lderzX-4xp23v__IF7EJKk_0 2024-09-12T01:04:39.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.374+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8437150276588836343', time=2024-09-12T02:52:35.647809+0000, chain.objs.size()=1 2024-09-12T01:04:39.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.374+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.-wLQuItkT8-ZeUKEF_wN9ZxY4lcL2Gb_0 2024-09-12T01:04:39.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.374+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2216288116043528821', time=2024-09-12T02:52:35.649692+0000, chain.objs.size()=1 2024-09-12T01:04:39.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.374+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.r4SbKUFxFjt0suwbezC2__qL1h1QTFR_0 2024-09-12T01:04:39.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.374+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5331450415768252301', time=2024-09-12T02:52:35.652781+0000, chain.objs.size()=1 2024-09-12T01:04:39.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.374+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.JAOpAzfaaGf4GNV6KnsI11lXJenv_i2_0 2024-09-12T01:04:39.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.374+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11009548153493009449', time=2024-09-12T02:52:35.821446+0000, chain.objs.size()=1 2024-09-12T01:04:39.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.374+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.hoVtEr-GnJ4icJFuLgI7soZyThPlAaa_0 2024-09-12T01:04:39.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.374+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16647417630671946480', time=2024-09-12T02:52:35.831868+0000, chain.objs.size()=1 2024-09-12T01:04:39.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.374+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.eh9EKDFaPApJxy3WAhmZbQin6cGNcaA_0 2024-09-12T01:04:39.376 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.374+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7857123179678203356', time=2024-09-12T02:52:35.855424+0000, chain.objs.size()=1 2024-09-12T01:04:39.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.374+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.eccfoCUam75Qwg_OM81FC6UmnJwLrLA_0 2024-09-12T01:04:39.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.374+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12913038998634995304', time=2024-09-12T02:52:35.872573+0000, chain.objs.size()=1 2024-09-12T01:04:39.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.374+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.CUvTblrRl5dKfMEgiNVoApacR6E9JoM_0 2024-09-12T01:04:39.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.374+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13946869715090099394', time=2024-09-12T02:52:35.875509+0000, chain.objs.size()=1 2024-09-12T01:04:39.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.374+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.DA3KoSIf1kH5weHmH8inJ8pWPSjBHFO_0 2024-09-12T01:04:39.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.374+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16152274217232117955', time=2024-09-12T02:52:36.241650+0000, chain.objs.size()=1 2024-09-12T01:04:39.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.374+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.dg88Lyfh5Cd_BgjT7YC7fytlI47Tb7I_0 2024-09-12T01:04:39.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.374+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14613335270767106508', time=2024-09-12T02:52:36.248215+0000, chain.objs.size()=1 2024-09-12T01:04:39.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.374+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.zRc-OFR5fbdA6_y0-z3TyEzDwITnVQS_0 2024-09-12T01:04:39.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.374+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6324314174471629303', time=2024-09-12T02:52:36.333634+0000, chain.objs.size()=1 2024-09-12T01:04:39.377 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.374+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.RX02Zvvak88jTcc4cuNNT3_n49QSYHw_0 2024-09-12T01:04:39.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.374+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8827171998795052463', time=2024-09-12T02:52:36.336833+0000, chain.objs.size()=1 2024-09-12T01:04:39.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.374+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.IFJeOWS_CDFh7rRK9D3lW8SoJ5zSOqP_0 2024-09-12T01:04:39.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.378+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3407897213367993925', time=2024-09-12T02:52:36.371929+0000, chain.objs.size()=1 2024-09-12T01:04:39.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.378+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.SA33IES-hogjn4Arj2xpGMaZNc2TXlu_0 2024-09-12T01:04:39.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.378+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17719688190770499174', time=2024-09-12T02:52:36.530357+0000, chain.objs.size()=1 2024-09-12T01:04:39.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.378+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.VpluNEP5OFOIcbUsCl876u1YQEb9Log_0 2024-09-12T01:04:39.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.378+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15359038310313556176', time=2024-09-12T02:52:36.569759+0000, chain.objs.size()=1 2024-09-12T01:04:39.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.378+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.xOu77ZwdkqTezxPcZX_IhqPdcLGucj8_0 2024-09-12T01:04:39.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.378+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7086972151005644731', time=2024-09-12T02:52:36.585872+0000, chain.objs.size()=1 2024-09-12T01:04:39.378 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.378+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.wS_6-PE4u9TDt45RTV55dqoUHQMcKvT_0 2024-09-12T01:04:39.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.378+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17121421000258621718', time=2024-09-12T02:52:36.620967+0000, chain.objs.size()=1 2024-09-12T01:04:39.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.378+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.zbTXfbVaK_MhPdMGVXEy6bUoVQ2-zMy_0 2024-09-12T01:04:39.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.378+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.341634211931255922', time=2024-09-12T02:52:36.757318+0000, chain.objs.size()=1 2024-09-12T01:04:39.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.378+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.p7zAYd2-FzqZwtqDgcPzUgWmOkCxZ39_0 2024-09-12T01:04:39.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.378+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9719115760423903560', time=2024-09-12T02:52:36.817061+0000, chain.objs.size()=1 2024-09-12T01:04:39.379 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.378+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.3T1QtQge9bd6fSrtT9QGdMgLuLPjEHm_0 2024-09-12T01:04:39.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.378+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17572560190220882224', time=2024-09-12T02:52:36.819191+0000, chain.objs.size()=1 2024-09-12T01:04:39.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.378+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ARiLRxQpvKBJ9Fij01TLCw3dAZUEfom_0 2024-09-12T01:04:39.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.378+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14671032560581470120', time=2024-09-12T02:52:36.825851+0000, chain.objs.size()=1 2024-09-12T01:04:39.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.378+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.DL172pXQSg5otxq4I7GB59z-48anLfT_0 2024-09-12T01:04:39.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.378+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9609933747133542905', time=2024-09-12T02:52:36.849840+0000, chain.objs.size()=1 2024-09-12T01:04:39.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.378+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Az2igXQNwUpqsSvzSr4NwhDARMv4HIu_0 2024-09-12T01:04:39.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.378+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16445142533603562373', time=2024-09-12T02:52:36.869500+0000, chain.objs.size()=1 2024-09-12T01:04:39.380 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.378+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.L3J3WWyvhh2YvbKxjJASCDqcPMehYsA_0 2024-09-12T01:04:39.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.378+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11802640835016358846', time=2024-09-12T02:52:36.877769+0000, chain.objs.size()=1 2024-09-12T01:04:39.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.378+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.DgX_grqGMwkOojWG76ChgBPcjItgCpT_0 2024-09-12T01:04:39.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.378+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7299306662039095933', time=2024-09-12T02:52:36.880326+0000, chain.objs.size()=1 2024-09-12T01:04:39.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.378+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.TseeGQ3qkVcj2NXlZo_vDi_5RRRO09l_0 2024-09-12T01:04:39.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.378+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6901409355586110567', time=2024-09-12T02:52:37.069375+0000, chain.objs.size()=1 2024-09-12T01:04:39.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.378+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.335YyC0cRy9xnZf94iw-QDFCChxCVJF_0 2024-09-12T01:04:39.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.378+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9880172092427460418', time=2024-09-12T02:52:37.078849+0000, chain.objs.size()=1 2024-09-12T01:04:39.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.378+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.sawraN48alDkpSmYeFrcf76xms95OGd_0 2024-09-12T01:04:39.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7262500540102853373', time=2024-09-12T02:52:37.087533+0000, chain.objs.size()=1 2024-09-12T01:04:39.381 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.GH9hDFUisGbeN9h9gXlcTaujPtSaVGh_0 2024-09-12T01:04:39.382 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17727636096390040907', time=2024-09-12T02:52:56.895823+0000, chain.objs.size()=1 2024-09-12T01:04:39.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ZKisLeQGQe8z20B6aCbxSkh8aSYTbeX_0 2024-09-12T01:04:39.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17113540521858320085', time=2024-09-12T02:52:56.972236+0000, chain.objs.size()=1 2024-09-12T01:04:39.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.MVbacX6hKZILZEJQeeKKHTx_iDiHdTi_0 2024-09-12T01:04:39.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12727625789507048920', time=2024-09-12T02:52:56.995599+0000, chain.objs.size()=1 2024-09-12T01:04:39.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.yjfS_RhdmJMtJQb4qwBSZFooIAP9geH_0 2024-09-12T01:04:39.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7388437895246159803', time=2024-09-12T02:52:57.023892+0000, chain.objs.size()=1 2024-09-12T01:04:39.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_._B9tWgdbiZW_hgw7GlTUmowctCbYTgv_0 2024-09-12T01:04:39.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17780361089425231247', time=2024-09-12T02:52:57.168240+0000, chain.objs.size()=1 2024-09-12T01:04:39.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.hlTO5CenmFCFFwbrz-xPB2mVa3Ep18n_0 2024-09-12T01:04:39.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11048649730073613151', time=2024-09-12T02:52:57.197457+0000, chain.objs.size()=1 2024-09-12T01:04:39.383 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.rc6nQKctsK7WgqGUocJbwP74t9XSwaj_0 2024-09-12T01:04:39.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6311128815896964676', time=2024-09-12T02:52:57.202889+0000, chain.objs.size()=1 2024-09-12T01:04:39.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ZQvnyc9wrBcrpRKJuLBRhf1ZNyp0L3K_0 2024-09-12T01:04:39.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11003448850623535006', time=2024-09-12T02:52:57.246459+0000, chain.objs.size()=1 2024-09-12T01:04:39.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.30i7G1MuIiaoJl7hL_KOXmtcu1CH5qO_0 2024-09-12T01:04:39.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9481261588818181069', time=2024-09-12T02:52:57.451026+0000, chain.objs.size()=1 2024-09-12T01:04:39.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.vruvGFwvE4faM0f9gtirc-QbkvSRbwI_0 2024-09-12T01:04:39.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9717781219889807663', time=2024-09-12T02:52:57.457873+0000, chain.objs.size()=1 2024-09-12T01:04:39.384 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.O-KRFqArys9t8v-IHVAhp6JOv-cmbOX_0 2024-09-12T01:04:39.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7663576658331588225', time=2024-09-12T02:52:57.517349+0000, chain.objs.size()=1 2024-09-12T01:04:39.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.CudVQJbsmIoC0_ZDfwaTmLhRAUHi7Eb_0 2024-09-12T01:04:39.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6139147556378199550', time=2024-09-12T02:52:57.746038+0000, chain.objs.size()=1 2024-09-12T01:04:39.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.u5QaGdFnAGUNlJ989wzGSI2WmsRs8Wm_0 2024-09-12T01:04:39.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.286065984131120494', time=2024-09-12T02:52:57.935140+0000, chain.objs.size()=1 2024-09-12T01:04:39.385 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Rm8FoS-kOa7pCGBWtFhUPlBW_SSdAZ7_0 2024-09-12T01:04:39.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11069462381040154811', time=2024-09-12T02:52:57.949891+0000, chain.objs.size()=1 2024-09-12T01:04:39.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.DliXx0bxVQkJDq4ruUmMwv7chqvx6OS_0 2024-09-12T01:04:39.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12521932122974823336', time=2024-09-12T02:52:57.983546+0000, chain.objs.size()=1 2024-09-12T01:04:39.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.382+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.DIsXKadxnno5Tw5P0cuSxL0IOHhbDat_0 2024-09-12T01:04:39.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.386+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11130953354960021287', time=2024-09-12T02:52:57.986318+0000, chain.objs.size()=1 2024-09-12T01:04:39.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.386+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.mPlKLTQXs0IHhPw65QosWLn0YFOLf1M_0 2024-09-12T01:04:39.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.386+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8020053025437082304', time=2024-09-12T02:52:58.160208+0000, chain.objs.size()=1 2024-09-12T01:04:39.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.386+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.iyB9dVvLVhMKDNmQN6S4NRdXJBOgN6C_0 2024-09-12T01:04:39.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.386+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15764991483676356944', time=2024-09-12T02:52:58.189951+0000, chain.objs.size()=1 2024-09-12T01:04:39.386 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.386+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_._IIp4f7ZF45PV7_dGvdbYJzfIxzsnxE_0 2024-09-12T01:04:39.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.386+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2827354535958586080', time=2024-09-12T02:52:58.243996+0000, chain.objs.size()=1 2024-09-12T01:04:39.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.386+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.xcPWssuxg9sg6f8XUrjpUn1wwX7zUY__0 2024-09-12T01:04:39.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.386+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4496858978070963096', time=2024-09-12T02:52:58.244872+0000, chain.objs.size()=1 2024-09-12T01:04:39.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.386+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.jjuQCy3AdolJmtPNwAb0kQHLj1lfXoG_0 2024-09-12T01:04:39.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.386+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11633090135837971257', time=2024-09-12T02:52:58.363345+0000, chain.objs.size()=1 2024-09-12T01:04:39.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.386+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.-MEbB3xd6K-L5QON9t79xrEC00kwfS9_0 2024-09-12T01:04:39.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.386+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7819508897486434700', time=2024-09-12T02:52:58.392118+0000, chain.objs.size()=1 2024-09-12T01:04:39.387 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.386+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.FlrYGK7EiNVA5MpOPWAa5YgAtooSNoo_0 2024-09-12T01:04:39.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.386+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12928626420219009352', time=2024-09-12T02:52:58.418951+0000, chain.objs.size()=1 2024-09-12T01:04:39.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.386+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.wk8ETZVvhs27HDHe1h1Oy4d5B4OJXA6_0 2024-09-12T01:04:39.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.386+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1746650120952950483', time=2024-09-12T02:52:58.476658+0000, chain.objs.size()=1 2024-09-12T01:04:39.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.386+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.is-RTI4OBEi-qH3ZO6Vh0R7Wg_bZZx5_0 2024-09-12T01:04:39.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.386+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12878113926033164411', time=2024-09-12T02:52:58.491994+0000, chain.objs.size()=1 2024-09-12T01:04:39.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.386+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.J8YKLywD2u8AhrPZAw_ew_wjBS65BIY_0 2024-09-12T01:04:39.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.386+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7490568779778697866', time=2024-09-12T02:52:58.504019+0000, chain.objs.size()=1 2024-09-12T01:04:39.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.386+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ciV5ZwIoo2FRH5HjElU5HnV3IRQO9rv_0 2024-09-12T01:04:39.388 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.390+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51345 2024-09-12T01:04:39.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.390+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T01:04:39.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.390+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10834002816322208925', time=2024-09-12T02:52:58.688091+0000, chain.objs.size()=1 2024-09-12T01:04:39.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.390+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.u8LiRsBNlZgdOZEjCRb7XcVTzuGFY1b_0 2024-09-12T01:04:39.391 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.390+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4799200056381207717', time=2024-09-12T02:53:01.770299+0000, chain.objs.size()=1 2024-09-12T01:04:39.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.390+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.329__shadow_.l8AhRqGDbIFjwLq4P1nX55_rRnNjOEq_0 2024-09-12T01:04:39.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.390+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18275824742427628844', time=2024-09-12T02:53:28.213231+0000, chain.objs.size()=1 2024-09-12T01:04:39.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.390+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.371__shadow_.R5aDEPRTvAErOH8R3Vui7upBKEd7_0V_0 2024-09-12T01:04:39.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.390+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7218254121524179208', time=2024-09-12T02:54:20.185413+0000, chain.objs.size()=1 2024-09-12T01:04:39.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.390+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.439__shadow_.RbC2ccNoAfNY8EvFUYW69cYv0CVz1Lh_0 2024-09-12T01:04:39.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.390+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17726980455911687777', time=2024-09-12T02:54:27.249515+0000, chain.objs.size()=1 2024-09-12T01:04:39.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.390+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.447__shadow_.8mwh41giYWZTOEcIoeP4pshelht7ab8_0 2024-09-12T01:04:39.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.390+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7160290848746191569', time=2024-09-12T02:54:53.305446+0000, chain.objs.size()=1 2024-09-12T01:04:39.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.390+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.483__shadow_.2baD-tJIgBY0-gu_ivzOMcsHZqYadN5_0 2024-09-12T01:04:39.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.390+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8930839920269401605', time=2024-09-12T02:54:53.312729+0000, chain.objs.size()=1 2024-09-12T01:04:39.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.390+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.483__shadow_.b-xXLqdAAUCNd57bmVR4yE6CDJL5FdD_0 2024-09-12T01:04:39.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.390+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14222080969200819284', time=2024-09-12T02:55:11.555670+0000, chain.objs.size()=6 2024-09-12T01:04:39.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.390+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.1 2024-09-12T01:04:39.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.390+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.2 2024-09-12T01:04:39.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.390+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.3 2024-09-12T01:04:39.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.390+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.4 2024-09-12T01:04:39.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.390+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.5 2024-09-12T01:04:39.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.394+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.6 2024-09-12T01:04:39.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.394+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9142380762380400361', time=2024-09-12T02:55:17.997272+0000, chain.objs.size()=1 2024-09-12T01:04:39.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.394+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.518__multipart_mymultipart.2~0Ib4IiFcoEKvAbu8Xy6N7VynI9hNWhC.1 2024-09-12T01:04:39.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.394+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15480816148206673027', time=2024-09-12T02:56:49.159651+0000, chain.objs.size()=1 2024-09-12T01:04:39.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.394+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.559__shadow_.XLOjO5qxXvzn9tU-M_EfVsvoj13a4wC_0 2024-09-12T01:04:39.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.394+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17076175104904064593', time=2024-09-12T02:57:06.695668+0000, chain.objs.size()=1 2024-09-12T01:04:39.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.394+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.569__shadow:u2ghQh5k6WLTMgTilJ-PakYdjiUYkT._.K_Z_gxY2kLnNmXYrM4CyeEpkWLJlbjz_0 2024-09-12T01:04:39.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.394+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7412020428804673430', time=2024-09-12T02:57:34.071031+0000, chain.objs.size()=1 2024-09-12T01:04:39.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.394+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:dDvZgS3fG3wYRJfARZl74d9AP6KBvvf_.mCRql1C0DNOt1GsUHsn3jDs2emRtz1R_0 2024-09-12T01:04:39.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.394+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10449509050194928886', time=2024-09-12T02:58:04.629848+0000, chain.objs.size()=1 2024-09-12T01:04:39.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.394+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.606__shadow_.BgZ_FC-zdRdqT_ir5PpJEbc5QCZtsn2_0 2024-09-12T01:04:39.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.394+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10782136065400609094', time=2024-09-12T03:00:37.213707+0000, chain.objs.size()=1 2024-09-12T01:04:39.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.394+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.629__shadow_.XvOm22r9SPQFh7dOc3ClqcWw2EzRNST_0 2024-09-12T01:04:39.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.394+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2730289909940041851', time=2024-09-12T03:02:21.769800+0000, chain.objs.size()=3 2024-09-12T01:04:39.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.394+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.743__multipart_mymultipart3.2~8XA7xsqpmDJ1110ynCmNAMyykhgo9RH.1 2024-09-12T01:04:39.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.394+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.743__multipart_mymultipart3.2~8XA7xsqpmDJ1110ynCmNAMyykhgo9RH.2 2024-09-12T01:04:39.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.394+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.743__multipart_mymultipart3.2~8XA7xsqpmDJ1110ynCmNAMyykhgo9RH.3 2024-09-12T01:04:39.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.394+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14310850329254014965', time=2024-09-12T03:02:38.488679+0000, chain.objs.size()=1 2024-09-12T01:04:39.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.394+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.745__shadow_.AEsNFd3uVkyHHKy-694Q6RYCHnw-mO9_0 2024-09-12T01:04:39.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.398+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:39.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.402+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:04:39.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.402+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:39.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.402+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:39.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.402+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45461' 2024-09-12T01:04:39.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.402+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='_uexAli811ew67UVGgKhXoWOhNsyitYn', time=2024-09-12T02:48:38.176653+0000, chain.objs.size()=3 2024-09-12T01:04:39.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.402+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.165__shadow_.2vZfH9A-pk35Bed6OUctSxTdUb661MA_0 2024-09-12T01:04:39.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.402+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.165__shadow_.2vZfH9A-pk35Bed6OUctSxTdUb661MA_1 2024-09-12T01:04:39.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.402+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.165__shadow_.2vZfH9A-pk35Bed6OUctSxTdUb661MA_2 2024-09-12T01:04:39.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.402+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14967207821490692722', time=2024-09-12T02:50:51.057918+0000, chain.objs.size()=1 2024-09-12T01:04:39.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.402+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.241__shadow_.UtK3pXxrdchVuiL4zMC0gjW-tYbTg3u_0 2024-09-12T01:04:39.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.402+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11774815450452593781', time=2024-09-12T02:51:00.335827+0000, chain.objs.size()=1 2024-09-12T01:04:39.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.402+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.252__shadow_.8UXlvaOjW1e_H8AH6pGNnAmyHf6xlco_0 2024-09-12T01:04:39.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.402+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17055386355617548017', time=2024-09-12T02:51:07.016662+0000, chain.objs.size()=1 2024-09-12T01:04:39.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.402+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.261__shadow_.QlDNJ7IrbszZEonRijByc-cktKOW2Kw_0 2024-09-12T01:04:39.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.402+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3121464758284552175', time=2024-09-12T02:51:26.739103+0000, chain.objs.size()=1 2024-09-12T01:04:39.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.402+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.BTncZoERNCzKA_dzLL0NdGhiZkmLHFJ_0 2024-09-12T01:04:39.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.402+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16937797206620740685', time=2024-09-12T02:51:26.782485+0000, chain.objs.size()=1 2024-09-12T01:04:39.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.402+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.oLdQfqsfLZNqkj3FyIvQFg6oUUXkSuq_0 2024-09-12T01:04:39.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.402+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1301648536678260934', time=2024-09-12T02:51:26.802875+0000, chain.objs.size()=1 2024-09-12T01:04:39.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.402+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.PbqExeKIhkISE16DZqy0M5iUwYk5xGM_0 2024-09-12T01:04:39.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.402+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9719494384081305149', time=2024-09-12T02:51:26.808149+0000, chain.objs.size()=1 2024-09-12T01:04:39.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.402+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.URWMDihCdmcWDzklfy_vj2hG4U1OI25_0 2024-09-12T01:04:39.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.402+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3321096853530262526', time=2024-09-12T02:51:26.821130+0000, chain.objs.size()=1 2024-09-12T01:04:39.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.402+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.bPR7uX2O7YTblvzpgmPhbRo_d-65tng_0 2024-09-12T01:04:39.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.402+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8639177992342520309', time=2024-09-12T02:51:26.831223+0000, chain.objs.size()=1 2024-09-12T01:04:39.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.402+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.iP56E6Wk6_QnQax1i-gqFNoHh0BgLRo_0 2024-09-12T01:04:39.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.406+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13588200582516905726', time=2024-09-12T02:51:26.839870+0000, chain.objs.size()=1 2024-09-12T01:04:39.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.406+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.3UsOd2vJe5Zr09W7DXzziB3b6I1vLF0_0 2024-09-12T01:04:39.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.406+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2013216940557167196', time=2024-09-12T02:51:26.861041+0000, chain.objs.size()=1 2024-09-12T01:04:39.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.406+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.5z2F2q0wq7EwK9wBDpA9P60PNGW6O_9_0 2024-09-12T01:04:39.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15788404414091577184', time=2024-09-12T02:51:26.889910+0000, chain.objs.size()=1 2024-09-12T01:04:39.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.kwdcz6aFmJQAC5r9_FpboV3G59Xx9Cp_0 2024-09-12T01:04:39.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15119614073209038660', time=2024-09-12T02:51:27.010156+0000, chain.objs.size()=1 2024-09-12T01:04:39.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.19k6BuLLBPytSuWDDErg4sOcevTT0xv_0 2024-09-12T01:04:39.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16729837463250367805', time=2024-09-12T02:51:27.205405+0000, chain.objs.size()=1 2024-09-12T01:04:39.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ep4W_cNVD_Wiq8to39lVsDnaj01SSki_0 2024-09-12T01:04:39.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3715461616227864346', time=2024-09-12T02:51:27.217607+0000, chain.objs.size()=1 2024-09-12T01:04:39.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.pPszpU5Db7AGVBwW_9-9ERy3A3FaDGY_0 2024-09-12T01:04:39.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3506460311515231065', time=2024-09-12T02:51:27.223510+0000, chain.objs.size()=1 2024-09-12T01:04:39.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.xy4N8LXHSrwDE15Qp0f2jylv2yeS0fW_0 2024-09-12T01:04:39.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6926136141811063408', time=2024-09-12T02:51:27.281109+0000, chain.objs.size()=1 2024-09-12T01:04:39.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.nZDqKPf-K8kG4p7mgixVygY_sRXyByj_0 2024-09-12T01:04:39.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1045874773028935118', time=2024-09-12T02:51:27.282300+0000, chain.objs.size()=1 2024-09-12T01:04:39.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.akmhbt_GZqBBMsW9V7BTaOjydsrmuGq_0 2024-09-12T01:04:39.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17647517336317148966', time=2024-09-12T02:51:27.316250+0000, chain.objs.size()=1 2024-09-12T01:04:39.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.4EZGp0C7Pds9WJ0vjOfGcyyiNgWVp36_0 2024-09-12T01:04:39.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12666892039279463833', time=2024-09-12T02:51:27.327536+0000, chain.objs.size()=1 2024-09-12T01:04:39.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.mZMvC3AIs5c6r2fIeW4oI14e6EE6-RJ_0 2024-09-12T01:04:39.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13511202314549944344', time=2024-09-12T02:51:27.331423+0000, chain.objs.size()=1 2024-09-12T01:04:39.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Q5KLV9NwRFVpeKitIs94S4SEoTrqnGt_0 2024-09-12T01:04:39.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9283567460258905503', time=2024-09-12T02:51:27.445158+0000, chain.objs.size()=1 2024-09-12T01:04:39.411 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.J2vOtQhR5zBn1X-yYKQ4yK9je1ZINJ4_0 2024-09-12T01:04:39.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9315430957429733892', time=2024-09-12T02:51:27.520201+0000, chain.objs.size()=1 2024-09-12T01:04:39.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.kPVO28HQCn1ffMKrvawnwvHuhGNSkaR_0 2024-09-12T01:04:39.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12105633767761641151', time=2024-09-12T02:51:27.523362+0000, chain.objs.size()=1 2024-09-12T01:04:39.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Hs65p-Psn6Rk7fVK0RZqPDIneX7fA5e_0 2024-09-12T01:04:39.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5924792580280911115', time=2024-09-12T02:51:27.524789+0000, chain.objs.size()=1 2024-09-12T01:04:39.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.PY2qmBR4AzZen8Bs0AG9HAi_rToL7qh_0 2024-09-12T01:04:39.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11657882601216778650', time=2024-09-12T02:51:27.535253+0000, chain.objs.size()=1 2024-09-12T01:04:39.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.imqMsYRx3f5h3KFFht3C4k_bE20uxVa_0 2024-09-12T01:04:39.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11071432414203353792', time=2024-09-12T02:51:27.633790+0000, chain.objs.size()=1 2024-09-12T01:04:39.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.1OfBf2P1cr3zjUIwWjCqxwuxYlr0sBA_0 2024-09-12T01:04:39.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6582269343311241531', time=2024-09-12T02:51:27.674697+0000, chain.objs.size()=1 2024-09-12T01:04:39.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.410+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.cE-oqyr2RsSOWZeAV8Tl2_ytH10DFOW_0 2024-09-12T01:04:39.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.414+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2672951701528940722', time=2024-09-12T02:51:27.686563+0000, chain.objs.size()=1 2024-09-12T01:04:39.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.414+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.tzQqWU4I2OMDJvsa1Hri6aPMEMdemM7_0 2024-09-12T01:04:39.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.414+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10418859255855189731', time=2024-09-12T02:51:27.687336+0000, chain.objs.size()=1 2024-09-12T01:04:39.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.414+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.h1w6nn1cl9bgqX1-ahIvx9tspaB9ABT_0 2024-09-12T01:04:39.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.414+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14723490280005264180', time=2024-09-12T02:51:27.690014+0000, chain.objs.size()=1 2024-09-12T01:04:39.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.414+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.JwQhUWVW3Uq3hWjGsovfSc7TA8eSiFf_0 2024-09-12T01:04:39.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.414+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7814219743457905831', time=2024-09-12T02:51:27.718126+0000, chain.objs.size()=1 2024-09-12T01:04:39.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.414+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.g-9kMNKcdSsdws1Q-8ozU6LArJOuhJm_0 2024-09-12T01:04:39.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.414+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9430042317873212968', time=2024-09-12T02:51:27.849163+0000, chain.objs.size()=1 2024-09-12T01:04:39.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.414+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.zaFzaVUBD5QPyAGd1a3KokG8nqvwuwK_0 2024-09-12T01:04:39.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.414+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11098487995017183794', time=2024-09-12T02:51:27.851677+0000, chain.objs.size()=1 2024-09-12T01:04:39.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.414+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.faKKlYys0WQK_2zOWjd5uvkhXyZhu_7_0 2024-09-12T01:04:39.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.414+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15845018869752474188', time=2024-09-12T02:51:27.873399+0000, chain.objs.size()=1 2024-09-12T01:04:39.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.414+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.n62CI0n-SDeme8AIVkNlzZF-ngsiYQD_0 2024-09-12T01:04:39.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.414+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.907767180627663932', time=2024-09-12T02:51:27.878527+0000, chain.objs.size()=1 2024-09-12T01:04:39.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.414+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.IYz4p_5kagRYolk-UYcg2c0QcPKIMlL_0 2024-09-12T01:04:39.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.414+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16121707509684922176', time=2024-09-12T02:51:27.888738+0000, chain.objs.size()=1 2024-09-12T01:04:39.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.414+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.gQ8BhurHLfX8g3szhqPl1JPAE5Sk22f_0 2024-09-12T01:04:39.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.414+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8297525032732326503', time=2024-09-12T02:51:27.898529+0000, chain.objs.size()=1 2024-09-12T01:04:39.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.414+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.vwQXkzzR41X7UVHTDevCiGzuh3AuDoy_0 2024-09-12T01:04:39.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.414+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13857408299393369062', time=2024-09-12T02:51:27.966321+0000, chain.objs.size()=1 2024-09-12T01:04:39.417 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.414+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.L__QAW5aLI7DRjrAbjZjmpgkOxZdeFD_0 2024-09-12T01:04:39.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.418+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14699130248202709197', time=2024-09-12T02:51:28.133492+0000, chain.objs.size()=1 2024-09-12T01:04:39.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.418+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.-3PnxBVLcRBxbp3l6Ok-4XaxiQME2jc_0 2024-09-12T01:04:39.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.418+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15733314870584967233', time=2024-09-12T02:51:28.202784+0000, chain.objs.size()=1 2024-09-12T01:04:39.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.418+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.5N_K_vjLLiWVZIe2-oNPOGNjtJ8cGUi_0 2024-09-12T01:04:39.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.418+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17863651699077387242', time=2024-09-12T02:51:28.229527+0000, chain.objs.size()=1 2024-09-12T01:04:39.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.418+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.RLY8dM6B2XgDHZuGHPA1tGOXlk9CmV3_0 2024-09-12T01:04:39.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.418+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14239643848534159785', time=2024-09-12T02:51:28.249612+0000, chain.objs.size()=1 2024-09-12T01:04:39.418 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.418+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.nMtz8HqedzVT8GoKJ0H0bPROk-HocHq_0 2024-09-12T01:04:39.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.418+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14652823358774258862', time=2024-09-12T02:51:28.251395+0000, chain.objs.size()=1 2024-09-12T01:04:39.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.418+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.0TWEVR6JUU0iALJa8oZ2gWZZOHdrR9z_0 2024-09-12T01:04:39.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.418+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13290434889214608653', time=2024-09-12T02:51:28.252006+0000, chain.objs.size()=1 2024-09-12T01:04:39.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.418+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.YpaZpno0WQ4bryltdtNH21W7KCF3UET_0 2024-09-12T01:04:39.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.418+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3832702728416238974', time=2024-09-12T02:51:28.339514+0000, chain.objs.size()=1 2024-09-12T01:04:39.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.418+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.lxJFeVP-yDqCF6FXk56PXoTGe4rQ1Tm_0 2024-09-12T01:04:39.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.418+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6644741486565629142', time=2024-09-12T02:51:28.341613+0000, chain.objs.size()=1 2024-09-12T01:04:39.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.418+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.4LfuOmdtxPlgERfZcjt3yj0WVJiD3k-_0 2024-09-12T01:04:39.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.418+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9664456071345485160', time=2024-09-12T02:51:28.347026+0000, chain.objs.size()=1 2024-09-12T01:04:39.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.418+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.I9X8olLqSbsjmt8qDB-8Y5M1n9nS9Po_0 2024-09-12T01:04:39.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.418+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3424226199070986086', time=2024-09-12T02:51:28.351369+0000, chain.objs.size()=1 2024-09-12T01:04:39.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.418+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ZjXQlAAd_5omGCGv9QxCtdKGi4gb2GZ_0 2024-09-12T01:04:39.419 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.418+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13102014032687018695', time=2024-09-12T02:51:28.605542+0000, chain.objs.size()=1 2024-09-12T01:04:39.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.418+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.qlKlGEtz3tRgFgJMDRiZuz9hUvN9dm7_0 2024-09-12T01:04:39.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.418+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9331411272811642908', time=2024-09-12T02:51:33.658493+0000, chain.objs.size()=1 2024-09-12T01:04:39.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.418+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.269__shadow_.RXIymvlXcUj6g1632gzEStuQIbwOg0d_0 2024-09-12T01:04:39.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.418+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3878599202590581508', time=2024-09-12T02:51:40.953561+0000, chain.objs.size()=1 2024-09-12T01:04:39.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.418+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.279__shadow_.4pUv2DTuoXP5R_DbYGjl87lZFH_wft6_0 2024-09-12T01:04:39.420 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.418+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11384775236119993684', time=2024-09-12T02:51:44.715140+0000, chain.objs.size()=1 2024-09-12T01:04:39.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.418+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.284__shadow_.nnCOKa20JYifhi9mrroK78GHxltMNxn_0 2024-09-12T01:04:39.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.418+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.894421706566707272', time=2024-09-12T02:51:48.521431+0000, chain.objs.size()=1 2024-09-12T01:04:39.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.418+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.289__shadow_.P6jzjC-jFxgWhhnTuqPmimQyjYYKFyS_0 2024-09-12T01:04:39.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5272642823122094146', time=2024-09-12T02:51:53.174060+0000, chain.objs.size()=1 2024-09-12T01:04:39.421 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.293__shadow_.t7u16BOX9xDMx26W86SOlJEQmt74Nez_0 2024-09-12T01:04:39.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3110099198036378749', time=2024-09-12T02:51:56.106508+0000, chain.objs.size()=1 2024-09-12T01:04:39.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.297__shadow_.FXH3SC9fAO9s3EbrYpo-r2NhPLTkK1j_0 2024-09-12T01:04:39.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15499509336486011413', time=2024-09-12T02:51:56.915558+0000, chain.objs.size()=1 2024-09-12T01:04:39.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.298__shadow_.GgKwyz_CzQwB6DeOanUvBWL405IHVhq_0 2024-09-12T01:04:39.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17973116937612509061', time=2024-09-12T02:52:13.712515+0000, chain.objs.size()=1 2024-09-12T01:04:39.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.321__shadow_.IlQEeRmUq0O4TnI8H0_A1oiWHCi1mlU_0 2024-09-12T01:04:39.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5216345856075702727', time=2024-09-12T02:52:35.151415+0000, chain.objs.size()=1 2024-09-12T01:04:39.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.SRtkVLB05OAAYsOdm0Vv_AGPSAR9G_w_0 2024-09-12T01:04:39.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10499711713752900446', time=2024-09-12T02:52:35.306885+0000, chain.objs.size()=1 2024-09-12T01:04:39.422 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ZBdMU71Qlkck20eR-IPQi_tWdzKoKiP_0 2024-09-12T01:04:39.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12783378427466084364', time=2024-09-12T02:52:35.348766+0000, chain.objs.size()=1 2024-09-12T01:04:39.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.dbEXmiidIh6FLuqzbeuVq_rTFcvoZJi_0 2024-09-12T01:04:39.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12279739459283657793', time=2024-09-12T02:52:35.364904+0000, chain.objs.size()=1 2024-09-12T01:04:39.423 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.cTM7JPlzMlelVoF67TLOLa30C115iZd_0 2024-09-12T01:04:39.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7914440037639800759', time=2024-09-12T02:52:35.365890+0000, chain.objs.size()=1 2024-09-12T01:04:39.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.EZt8RBni-8IzUh8cXOW6BkzTu1mXIZq_0 2024-09-12T01:04:39.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36405890129299691', time=2024-09-12T02:52:35.383135+0000, chain.objs.size()=1 2024-09-12T01:04:39.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ZCe1e-_HjGjGnkWFa44wmS2nTZ09QRL_0 2024-09-12T01:04:39.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8808025234797501882', time=2024-09-12T02:52:35.409838+0000, chain.objs.size()=1 2024-09-12T01:04:39.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.kf_Rih30JiscXZSVmGknpYGNPNsub6x_0 2024-09-12T01:04:39.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13477915595813813423', time=2024-09-12T02:52:35.541218+0000, chain.objs.size()=1 2024-09-12T01:04:39.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.tVcjpJINTlOuJqYg14YaUZZxx-tE3-z_0 2024-09-12T01:04:39.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3982800058514899813', time=2024-09-12T02:52:35.543616+0000, chain.objs.size()=1 2024-09-12T01:04:39.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.kqXwVwX6IDsOJykxEHDk0sG5tq0MY5e_0 2024-09-12T01:04:39.424 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4574676869650868688', time=2024-09-12T02:52:35.610517+0000, chain.objs.size()=1 2024-09-12T01:04:39.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.JV9JlVpFzENIDfnz6y6_0AJP9HQASTA_0 2024-09-12T01:04:39.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14071432360703336562', time=2024-09-12T02:52:35.619142+0000, chain.objs.size()=1 2024-09-12T01:04:39.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.iGzrdiHdoCC9Tnn3xTUqVGcMs_4jNDw_0 2024-09-12T01:04:39.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11648377564493670311', time=2024-09-12T02:52:35.665024+0000, chain.objs.size()=1 2024-09-12T01:04:39.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.pQAVQH4UTVmQzE3gLe39M45aV0bu8JI_0 2024-09-12T01:04:39.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11756562250656101459', time=2024-09-12T02:52:35.825319+0000, chain.objs.size()=1 2024-09-12T01:04:39.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.1em2VmGQK5bTmYQyB196EaiphLrh63Y_0 2024-09-12T01:04:39.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1212820805415252260', time=2024-09-12T02:52:35.861199+0000, chain.objs.size()=1 2024-09-12T01:04:39.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.X1hSSDwWF_HNV3LOlKsjCo1rnBUwOcx_0 2024-09-12T01:04:39.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15351794756925126166', time=2024-09-12T02:52:35.870826+0000, chain.objs.size()=1 2024-09-12T01:04:39.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.xH2hiGuXFkUFxt-fLtkrbfD3JnZjmDP_0 2024-09-12T01:04:39.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8532586259738729066', time=2024-09-12T02:52:36.312924+0000, chain.objs.size()=1 2024-09-12T01:04:39.425 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.422+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Vgt7jrGIBwzoUOmb1JfB2_u1GYh0bV1_0 2024-09-12T01:04:39.426 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.426+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12828634207765243454', time=2024-09-12T02:52:36.316698+0000, chain.objs.size()=1 2024-09-12T01:04:39.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.426+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.T3t1T6DcWIBsFd-H_aTG-pPeNTCiqaY_0 2024-09-12T01:04:39.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.426+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.231840238321756157', time=2024-09-12T02:52:36.329291+0000, chain.objs.size()=1 2024-09-12T01:04:39.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.426+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.3XVjaMF4ODRB_3bZtD6bQC1mILEBjkv_0 2024-09-12T01:04:39.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.426+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11028452460394398618', time=2024-09-12T02:52:36.334250+0000, chain.objs.size()=1 2024-09-12T01:04:39.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.426+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.G-tZnd4RAuWcH_VR5fS1qsQFQCjHhSx_0 2024-09-12T01:04:39.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.426+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4504079132294440412', time=2024-09-12T02:52:36.387683+0000, chain.objs.size()=1 2024-09-12T01:04:39.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.426+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.1sxnkYavEtMh_iB9en3ZoyHfOpQQp46_0 2024-09-12T01:04:39.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.426+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.132864781432534863', time=2024-09-12T02:52:36.506745+0000, chain.objs.size()=1 2024-09-12T01:04:39.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.426+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.jpmkPadhfazoZS51XsyXunwTpCbIGz3_0 2024-09-12T01:04:39.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.426+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3564127873480823798', time=2024-09-12T02:52:36.776277+0000, chain.objs.size()=1 2024-09-12T01:04:39.427 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.426+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.zM5ygGzoU1c4bmCOcEqhbQ3MlG0Y2q7_0 2024-09-12T01:04:39.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.426+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16117221546595871161', time=2024-09-12T02:52:36.871715+0000, chain.objs.size()=1 2024-09-12T01:04:39.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.426+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.WozL0_mvDtABfzg2ppcCHos8V4sXPhu_0 2024-09-12T01:04:39.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.426+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1714862095538042326', time=2024-09-12T02:52:36.874314+0000, chain.objs.size()=1 2024-09-12T01:04:39.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.426+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.zvEH3wx5v6DiZIyZp-2zePTfdsPHXQv_0 2024-09-12T01:04:39.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.426+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10616615713467629975', time=2024-09-12T02:52:36.990202+0000, chain.objs.size()=1 2024-09-12T01:04:39.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.426+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.E6IPtEJm6ThvkejptJ7zOxFyAI6L4np_0 2024-09-12T01:04:39.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.426+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6654104217023702177', time=2024-09-12T02:52:37.031615+0000, chain.objs.size()=1 2024-09-12T01:04:39.428 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.426+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.pz5vvNjyPCHBsoFx1gnEm5s2PRvgl7K_0 2024-09-12T01:04:39.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.426+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11440252553783435457', time=2024-09-12T02:52:37.040814+0000, chain.objs.size()=1 2024-09-12T01:04:39.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.426+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.YqFIC9kHH2MaQOzazjF4HFgpJLoQU5t_0 2024-09-12T01:04:39.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.426+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.198942685322750602', time=2024-09-12T02:52:37.043610+0000, chain.objs.size()=1 2024-09-12T01:04:39.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.426+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.GAKFAU-RqajvAdcpm21GR-ZxRV7zMNC_0 2024-09-12T01:04:39.429 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.426+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.213413782483699895', time=2024-09-12T02:52:37.046825+0000, chain.objs.size()=1 2024-09-12T01:04:39.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.426+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.svakFJCmDaUm9H5C0Dh64EpwpBhP2Qt_0 2024-09-12T01:04:39.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.430+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6712454349123328660', time=2024-09-12T02:52:37.087395+0000, chain.objs.size()=1 2024-09-12T01:04:39.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.430+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.waSmF7jyAjaasaiBi9TTw5cMFL7DUeM_0 2024-09-12T01:04:39.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.430+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9611450234643536033', time=2024-09-12T02:52:37.099828+0000, chain.objs.size()=1 2024-09-12T01:04:39.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.430+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ShFWCy4koNafKs3UV-LwftPQrUJV3zE_0 2024-09-12T01:04:39.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.430+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8827778364875494702', time=2024-09-12T02:52:56.895785+0000, chain.objs.size()=1 2024-09-12T01:04:39.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.430+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.hXSmjK8oBSiK8N8V8kZr1sqI49ZHFB8_0 2024-09-12T01:04:39.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.430+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2180867819099700251', time=2024-09-12T02:52:56.932752+0000, chain.objs.size()=1 2024-09-12T01:04:39.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.430+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Kl7JuGu7qHp_XyqT_eeVqFiAhRSlk_8_0 2024-09-12T01:04:39.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.430+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6529378032808450894', time=2024-09-12T02:52:56.936785+0000, chain.objs.size()=1 2024-09-12T01:04:39.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.430+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ZgEKFpAQ2wfIQtBGPlb3xE84agpQWm9_0 2024-09-12T01:04:39.430 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.430+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3230069261458057552', time=2024-09-12T02:52:56.968913+0000, chain.objs.size()=1 2024-09-12T01:04:39.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.430+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.YIuWH6872mi_FWFNE0AM56cOrEWRtKZ_0 2024-09-12T01:04:39.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.430+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9333371539142764839', time=2024-09-12T02:52:57.007320+0000, chain.objs.size()=1 2024-09-12T01:04:39.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.430+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.V3xfY45KMgibd1s8udd6zCCVaYjnOmT_0 2024-09-12T01:04:39.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.430+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14910639650907059227', time=2024-09-12T02:52:57.019985+0000, chain.objs.size()=1 2024-09-12T01:04:39.431 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.430+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.2NNuQp_9hoomLmFcr3G4qbWyNq2zaCm_0 2024-09-12T01:04:39.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.430+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11450505721681890377', time=2024-09-12T02:52:57.195187+0000, chain.objs.size()=1 2024-09-12T01:04:39.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.430+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.YxzSyHO1vA_M-eJASVGO9DqTC2l7HLH_0 2024-09-12T01:04:39.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.430+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13032853003198754597', time=2024-09-12T02:52:57.221161+0000, chain.objs.size()=1 2024-09-12T01:04:39.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.430+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.dNkRmK7fvtYBHeGhqSoy62T4NawQfM6_0 2024-09-12T01:04:39.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.430+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11693115548073570241', time=2024-09-12T02:52:57.269770+0000, chain.objs.size()=1 2024-09-12T01:04:39.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.430+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.XWE_Lb5e2FmBNDB217qM8-USamgNGDa_0 2024-09-12T01:04:39.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.430+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11670779191848012920', time=2024-09-12T02:52:57.470510+0000, chain.objs.size()=1 2024-09-12T01:04:39.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.430+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.yQmlpNaR98zsP8xMmXGhbsu0IolDHau_0 2024-09-12T01:04:39.432 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.430+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45461 2024-09-12T01:04:39.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.434+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-12T01:04:39.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.434+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16848891368618739142', time=2024-09-12T02:52:57.475594+0000, chain.objs.size()=1 2024-09-12T01:04:39.434 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.434+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.wbT3dCzYjTIfXYn6Myfq293eBoa5BEW_0 2024-09-12T01:04:39.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.434+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4149838003920588549', time=2024-09-12T02:52:57.478013+0000, chain.objs.size()=1 2024-09-12T01:04:39.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.434+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.RI_to-GK5w-UiHU5C64PG70324zpR9Z_0 2024-09-12T01:04:39.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.434+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9026481730600228919', time=2024-09-12T02:52:57.503537+0000, chain.objs.size()=1 2024-09-12T01:04:39.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.434+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.adLRm2D4qBX830AB0PSC4VAufimDNDU_0 2024-09-12T01:04:39.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.434+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7802157007925117802', time=2024-09-12T02:52:57.513194+0000, chain.objs.size()=1 2024-09-12T01:04:39.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.434+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.9Qzc7XSiwi2Hzzl6t9ugpL9LjubkwBK_0 2024-09-12T01:04:39.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.434+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11649472016624604455', time=2024-09-12T02:52:57.731094+0000, chain.objs.size()=1 2024-09-12T01:04:39.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.434+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.c1rnoTdQa1tIQAZ1ZeCg6JnRxw6MXsD_0 2024-09-12T01:04:39.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.434+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18273181270302339075', time=2024-09-12T02:52:57.740075+0000, chain.objs.size()=1 2024-09-12T01:04:39.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.434+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ufzyOPs1tgR1BoVizrYnF61FMDyr90c_0 2024-09-12T01:04:39.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.434+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7960147699279314627', time=2024-09-12T02:52:57.975651+0000, chain.objs.size()=1 2024-09-12T01:04:39.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.434+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.o99Bh7B-kQMa_T6lNIgDY92CP0K9eXq_0 2024-09-12T01:04:39.435 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.434+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10699268253490156092', time=2024-09-12T02:52:57.988127+0000, chain.objs.size()=1 2024-09-12T01:04:39.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.434+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.HLDxF2vz4Jn9kY4V-_TjValJZW2KCfB_0 2024-09-12T01:04:39.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.434+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8067343240290508586', time=2024-09-12T02:52:58.114378+0000, chain.objs.size()=1 2024-09-12T01:04:39.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.434+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.S8y4cJYwMJuc3wcses8mV2_GXAli-hk_0 2024-09-12T01:04:39.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.434+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18266455264523115677', time=2024-09-12T02:52:58.117182+0000, chain.objs.size()=1 2024-09-12T01:04:39.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.434+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.yvzUxng9QT3XjzzzPzrlTbo-300vDsw_0 2024-09-12T01:04:39.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.434+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.446329641504917839', time=2024-09-12T02:52:58.133758+0000, chain.objs.size()=1 2024-09-12T01:04:39.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.434+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.od_Du0aNWiOzDGGgR1nP4t3oRpSUeKA_0 2024-09-12T01:04:39.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.434+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13487609002686657110', time=2024-09-12T02:52:58.681396+0000, chain.objs.size()=1 2024-09-12T01:04:39.436 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.434+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.PS5OATXxmYKaBVr1ipvzqCGQgVQ0JDJ_0 2024-09-12T01:04:39.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10154393112604247060', time=2024-09-12T02:52:59.881715+0000, chain.objs.size()=1 2024-09-12T01:04:39.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.326__shadow_.6ZHbk8i-mVOUUaAho1NmFjc_B1Rwhqq_0 2024-09-12T01:04:39.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1855363266174373130', time=2024-09-12T02:53:09.840761+0000, chain.objs.size()=1 2024-09-12T01:04:39.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.341__shadow_.Qxl14CqHq590tinUmkSnCm4pUhHgagQ_0 2024-09-12T01:04:39.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10460114062420136485', time=2024-09-12T02:54:41.886208+0000, chain.objs.size()=1 2024-09-12T01:04:39.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.463__shadow_._xgxt56gVMCCKPIapK-t5ov9IZBKQg3_0 2024-09-12T01:04:39.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1247196583908679842', time=2024-09-12T02:54:42.763093+0000, chain.objs.size()=1 2024-09-12T01:04:39.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.464__shadow_.rpxQTthqMRT1i9Y9905k7iPs2C9UUR1_0 2024-09-12T01:04:39.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8070073997571710540', time=2024-09-12T02:54:54.115061+0000, chain.objs.size()=1 2024-09-12T01:04:39.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.484__shadow_.yn61cYjxxrXv4kE69OL94Dqi0aTOI7L_0 2024-09-12T01:04:39.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4809633844100279914', time=2024-09-12T02:55:19.640020+0000, chain.objs.size()=1 2024-09-12T01:04:39.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.518__multipart_mymultipart.2~nyZNwZ_7KLzOQfijbhtBZjlp7JiBOSH.1 2024-09-12T01:04:39.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3365312028124845994', time=2024-09-12T02:55:27.257696+0000, chain.objs.size()=1 2024-09-12T01:04:39.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.520__shadow:R-LXlgmF78YyGbXSKLSgFDuOqLVzBKl_.RsCa29MBoE8ZI_DBXGAk25J4a8a72f__0 2024-09-12T01:04:39.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3654792475698925023', time=2024-09-12T02:56:52.100671+0000, chain.objs.size()=1 2024-09-12T01:04:39.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.562__shadow_.X42btZVYsWUMKpnCKAg9WLxThaNi1mu_0 2024-09-12T01:04:39.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8688494717473559019', time=2024-09-12T02:57:04.366908+0000, chain.objs.size()=1 2024-09-12T01:04:39.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.569__shadow:.eTLgQsYndYjJ.1UjzcahuRG65x3szZ_.Gh9dLbMFugb14w11eiwxXHYcJ5ZCqXz_0 2024-09-12T01:04:39.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9768432573602460843', time=2024-09-12T02:57:05.686984+0000, chain.objs.size()=1 2024-09-12T01:04:39.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.569__shadow:7Xr4eQTkBKUSchLBzEIW6priBiSErVR_.MjakMf1P9HUyhgArXNjlWcFxFdYyKY4_0 2024-09-12T01:04:39.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4016012327705326130', time=2024-09-12T02:57:44.704442+0000, chain.objs.size()=1 2024-09-12T01:04:39.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.579__shadow:RQd7IVjkCW.BfXmqn7WzbNYxO9bE5Qk_.U31lUdvSHKpQC3Pcsy1I_-EpJg-nNsO_0 2024-09-12T01:04:39.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14711105913329613535', time=2024-09-12T02:58:13.837762+0000, chain.objs.size()=12 2024-09-12T01:04:39.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.613__multipart_multipart_enc.2~QiMGALHfqMYxGSLkz9A_6RRaznDliSV.1 2024-09-12T01:04:39.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.613__shadow_multipart_enc.2~QiMGALHfqMYxGSLkz9A_6RRaznDliSV.1_1 2024-09-12T01:04:39.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.613__multipart_multipart_enc.2~QiMGALHfqMYxGSLkz9A_6RRaznDliSV.2 2024-09-12T01:04:39.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.613__shadow_multipart_enc.2~QiMGALHfqMYxGSLkz9A_6RRaznDliSV.2_1 2024-09-12T01:04:39.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.613__multipart_multipart_enc.2~QiMGALHfqMYxGSLkz9A_6RRaznDliSV.3 2024-09-12T01:04:39.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.613__shadow_multipart_enc.2~QiMGALHfqMYxGSLkz9A_6RRaznDliSV.3_1 2024-09-12T01:04:39.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.613__multipart_multipart_enc.2~QiMGALHfqMYxGSLkz9A_6RRaznDliSV.4 2024-09-12T01:04:39.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.613__shadow_multipart_enc.2~QiMGALHfqMYxGSLkz9A_6RRaznDliSV.4_1 2024-09-12T01:04:39.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.613__multipart_multipart_enc.2~QiMGALHfqMYxGSLkz9A_6RRaznDliSV.5 2024-09-12T01:04:39.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.613__shadow_multipart_enc.2~QiMGALHfqMYxGSLkz9A_6RRaznDliSV.5_1 2024-09-12T01:04:39.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.613__multipart_multipart_enc.2~QiMGALHfqMYxGSLkz9A_6RRaznDliSV.6 2024-09-12T01:04:39.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.438+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.613__shadow_multipart_enc.2~QiMGALHfqMYxGSLkz9A_6RRaznDliSV.6_1 2024-09-12T01:04:39.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.442+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17798766955028944145', time=2024-09-12T03:01:32.609706+0000, chain.objs.size()=1 2024-09-12T01:04:39.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.442+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.704__shadow:A3EXuVpuswZcpM28eExjPMMBrNhmJrm_.hVmbLicXazKXeramcr4FjHJPcw6zBRc_0 2024-09-12T01:04:39.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.446+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:39.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.446+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:04:39.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.446+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:39.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.450+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:39.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.450+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48648' 2024-09-12T01:04:39.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.450+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.944204776453651715', time=2024-09-12T02:48:30.947946+0000, chain.objs.size()=5 2024-09-12T01:04:39.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.450+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.159__multipart_mymultipart-FROZEN.2~vsJ8SXysjJykrn11a0bOvVR3nyWqk8L.1 2024-09-12T01:04:39.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.450+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.159__shadow_mymultipart-FROZEN.2~vsJ8SXysjJykrn11a0bOvVR3nyWqk8L.1_1 2024-09-12T01:04:39.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.450+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.159__multipart_mymultipart-FROZEN.2~vsJ8SXysjJykrn11a0bOvVR3nyWqk8L.2 2024-09-12T01:04:39.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.450+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.159__shadow_mymultipart-FROZEN.2~vsJ8SXysjJykrn11a0bOvVR3nyWqk8L.2_1 2024-09-12T01:04:39.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.450+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.159__multipart_mymultipart-FROZEN.2~vsJ8SXysjJykrn11a0bOvVR3nyWqk8L.3 2024-09-12T01:04:39.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.450+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7152108552042189892', time=2024-09-12T02:48:40.363651+0000, chain.objs.size()=1 2024-09-12T01:04:39.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.450+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.171__shadow_.JkejR4NrK8-rApl8Eeu47n2MdxVrlvu_0 2024-09-12T01:04:39.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.450+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5561373786595541204', time=2024-09-12T02:50:51.788679+0000, chain.objs.size()=1 2024-09-12T01:04:39.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.450+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.242__shadow_.7eOUVZ3mlGUDj7g8Z7KaVisCj8-nvkn_0 2024-09-12T01:04:39.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.450+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11960341169276790094', time=2024-09-12T02:50:57.448309+0000, chain.objs.size()=1 2024-09-12T01:04:39.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.450+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.248__shadow_.VuMzC-VbRUTx2ohQENCcq_oxwnS0DjH_0 2024-09-12T01:04:39.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.450+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1002456112794921127', time=2024-09-12T02:50:59.604097+0000, chain.objs.size()=1 2024-09-12T01:04:39.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.450+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.251__shadow_.mf2ukiNsu11clhJ6cQM5H1skOnpBcpx_0 2024-09-12T01:04:39.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.450+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6114232245383461939', time=2024-09-12T02:51:01.857317+0000, chain.objs.size()=1 2024-09-12T01:04:39.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.450+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.254__shadow_.4XEAEuYh-YMCTE5bCx47oohIwthO074_0 2024-09-12T01:04:39.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.450+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12028218697874241552', time=2024-09-12T02:51:26.795834+0000, chain.objs.size()=1 2024-09-12T01:04:39.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.450+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.vc__WwlplEn0Ivufc3yoNWIF3bUReUX_0 2024-09-12T01:04:39.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.450+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17899495646320615452', time=2024-09-12T02:51:26.852542+0000, chain.objs.size()=1 2024-09-12T01:04:39.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.450+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ubKKeafac5nWwzkHxC9rJD6cHz3H1t2_0 2024-09-12T01:04:39.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5817747645623986499', time=2024-09-12T02:51:26.867048+0000, chain.objs.size()=1 2024-09-12T01:04:39.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.M2CexyyFVj7PCEFPqIu7n7wZjO4iWCH_0 2024-09-12T01:04:39.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2588925087636479431', time=2024-09-12T02:51:26.887189+0000, chain.objs.size()=1 2024-09-12T01:04:39.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.LZpnRVLP6ve4BFTB5ANoFHn4chGRNbW_0 2024-09-12T01:04:39.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10520303996812957058', time=2024-09-12T02:51:26.978696+0000, chain.objs.size()=1 2024-09-12T01:04:39.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.iP9cV8-XlXnSYuTQaYrrbd_W6l5axAi_0 2024-09-12T01:04:39.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4503766353148445062', time=2024-09-12T02:51:26.979774+0000, chain.objs.size()=1 2024-09-12T01:04:39.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.j9gJeqg_qb1Kz4SxdaT3HzH9DVaOFK8_0 2024-09-12T01:04:39.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6419458018102380459', time=2024-09-12T02:51:27.028851+0000, chain.objs.size()=1 2024-09-12T01:04:39.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.B_v4ROpB5QGwe9U6lqBF2--ovzyqnz2_0 2024-09-12T01:04:39.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14137121717336557399', time=2024-09-12T02:51:27.031151+0000, chain.objs.size()=1 2024-09-12T01:04:39.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.3VApEM5qgKPT6PHGoiAmetNzsbe9YL6_0 2024-09-12T01:04:39.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17195720832973699249', time=2024-09-12T02:51:27.035810+0000, chain.objs.size()=1 2024-09-12T01:04:39.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.zdV5Vw1e19CC7OGGpgKbpQ7cWZG-Hmk_0 2024-09-12T01:04:39.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2899361508209849693', time=2024-09-12T02:51:27.036684+0000, chain.objs.size()=1 2024-09-12T01:04:39.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.M1qE9FZkuLw87fmTo_HfoktFfZ1zdGv_0 2024-09-12T01:04:39.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.397508956766048946', time=2024-09-12T02:51:27.037598+0000, chain.objs.size()=1 2024-09-12T01:04:39.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.pRglcXBp9DgtyOlnpaUKl9iRQ2Ffllq_0 2024-09-12T01:04:39.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9745883681404553759', time=2024-09-12T02:51:27.049073+0000, chain.objs.size()=1 2024-09-12T01:04:39.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.jwzMIz3v9FQ937HmMFAAQJtIBoRQoL5_0 2024-09-12T01:04:39.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2149731794149860583', time=2024-09-12T02:51:27.061779+0000, chain.objs.size()=1 2024-09-12T01:04:39.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.IHyrkdzowG8_kb7r6U4jqfwc2G1hSsJ_0 2024-09-12T01:04:39.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5320893372260663363', time=2024-09-12T02:51:27.222304+0000, chain.objs.size()=1 2024-09-12T01:04:39.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.2RcaDmWO0vdTd1pAEZZBqoehX5o_s0o_0 2024-09-12T01:04:39.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9281194459373186531', time=2024-09-12T02:51:27.279896+0000, chain.objs.size()=1 2024-09-12T01:04:39.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.lw3W0B6aE7q-tSaH9xAdNdfWp-oEIyC_0 2024-09-12T01:04:39.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3414280997770011343', time=2024-09-12T02:51:27.284971+0000, chain.objs.size()=1 2024-09-12T01:04:39.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.FUFPVhOJe7DggvUg1lhPitHdE9kb5nb_0 2024-09-12T01:04:39.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9385359602364971446', time=2024-09-12T02:51:27.306697+0000, chain.objs.size()=1 2024-09-12T01:04:39.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.f3NMUbxnWWUudwyCLHif94vvAOexvHP_0 2024-09-12T01:04:39.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18034077646425486259', time=2024-09-12T02:51:27.459867+0000, chain.objs.size()=1 2024-09-12T01:04:39.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.4TFxieHfHHeYMXND_GHTYr--ND1zZ41_0 2024-09-12T01:04:39.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1153898007959792467', time=2024-09-12T02:51:27.528208+0000, chain.objs.size()=1 2024-09-12T01:04:39.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.jlUz2C4FxkTVcz1Jo1UvHE_L0K2bZ-H_0 2024-09-12T01:04:39.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15805153504570704276', time=2024-09-12T02:51:27.536541+0000, chain.objs.size()=1 2024-09-12T01:04:39.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.wp-BGzh1hDqRqsz_hvQ7pOPPAqUsWD5_0 2024-09-12T01:04:39.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7540920514228131680', time=2024-09-12T02:51:27.650247+0000, chain.objs.size()=1 2024-09-12T01:04:39.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.VYWeyo5Fi-0czlOLLez8MeUygU5olgy_0 2024-09-12T01:04:39.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16243012775070836400', time=2024-09-12T02:51:27.651362+0000, chain.objs.size()=1 2024-09-12T01:04:39.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.PKC-u4zn0SHBK3-xUBmCOsjYyzPBAHO_0 2024-09-12T01:04:39.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17804663828063200643', time=2024-09-12T02:51:27.652193+0000, chain.objs.size()=1 2024-09-12T01:04:39.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.H_mZ-cc1eY97flP_WV1zccwwyZKpBr-_0 2024-09-12T01:04:39.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12133068607893006830', time=2024-09-12T02:51:27.655386+0000, chain.objs.size()=1 2024-09-12T01:04:39.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.454+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.BV8n_IAnb9330WQ2N_aWmdhYnJZZdzA_0 2024-09-12T01:04:39.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.458+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5469149280850771744', time=2024-09-12T02:51:27.677004+0000, chain.objs.size()=1 2024-09-12T01:04:39.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.458+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.IVzuXVYVmu2mpv1vvSgz7rqFR5TBL6a_0 2024-09-12T01:04:39.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.458+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1936326820713018894', time=2024-09-12T02:51:27.713462+0000, chain.objs.size()=1 2024-09-12T01:04:39.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.458+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.LYNEn4kooKY_WzXb8gWIDKzTXoPey0m_0 2024-09-12T01:04:39.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.458+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3475415205292070058', time=2024-09-12T02:51:27.869132+0000, chain.objs.size()=1 2024-09-12T01:04:39.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.458+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_._JEgbKRAhs0c1bK775T9uV01ry4qRmP_0 2024-09-12T01:04:39.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.458+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8235887577806577703', time=2024-09-12T02:51:27.901854+0000, chain.objs.size()=1 2024-09-12T01:04:39.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.458+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.G46UQ5iftWbGXe-dusiWnvN5GtY5wcl_0 2024-09-12T01:04:39.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.458+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7856219526520033709', time=2024-09-12T02:51:27.946298+0000, chain.objs.size()=1 2024-09-12T01:04:39.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.458+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.xpMqv2nIwbc2CtmfugrNPps0lfjfQuZ_0 2024-09-12T01:04:39.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.458+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8308282910482296807', time=2024-09-12T02:51:27.948488+0000, chain.objs.size()=1 2024-09-12T01:04:39.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.458+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.P5soCL_aJpviRBvVBfH0thuaKGm9xom_0 2024-09-12T01:04:39.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.458+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16307788795466345013', time=2024-09-12T02:51:28.126386+0000, chain.objs.size()=1 2024-09-12T01:04:39.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.458+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Qm8ZkErFxVg8y4HsPDTubvfcIY1Dujt_0 2024-09-12T01:04:39.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.458+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9991367844810222704', time=2024-09-12T02:51:28.193987+0000, chain.objs.size()=1 2024-09-12T01:04:39.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.458+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Qy8v5lFO2gr8Sx-Aw5K2FEXkM0GhDSe_0 2024-09-12T01:04:39.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.458+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15319239186930776308', time=2024-09-12T02:51:28.339835+0000, chain.objs.size()=1 2024-09-12T01:04:39.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.458+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.S_YhTLPdcmmtfJ9iNgj-GV5vDTtSJaT_0 2024-09-12T01:04:39.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.458+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3913647818745989844', time=2024-09-12T02:51:28.381758+0000, chain.objs.size()=1 2024-09-12T01:04:39.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.458+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.QHYbSmcO2j2jCtSYX9AfXLl69wPWYGB_0 2024-09-12T01:04:39.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.458+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16094086159139196641', time=2024-09-12T02:51:28.622895+0000, chain.objs.size()=1 2024-09-12T01:04:39.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.458+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.X1W3gfJxR4CMS1xNGpJZyWs7eouH7TM_0 2024-09-12T01:04:39.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.458+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9987314358247433159', time=2024-09-12T02:51:37.988607+0000, chain.objs.size()=1 2024-09-12T01:04:39.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.458+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.275__shadow_.IF6qaHwGLZv3l5saqWXdJzw-Uy1D6Ro_0 2024-09-12T01:04:39.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.462+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10931641960989477403', time=2024-09-12T02:51:44.712780+0000, chain.objs.size()=1 2024-09-12T01:04:39.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.462+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.284__shadow_.qLmCb9-lLg4QIxk4c60s_vkMYn3eQed_0 2024-09-12T01:04:39.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.462+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15037233357351368730', time=2024-09-12T02:51:48.521278+0000, chain.objs.size()=1 2024-09-12T01:04:39.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.462+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.289__shadow_.9jqzv26EvroD8MbZ5kn3JNRkBCxZuQ9_0 2024-09-12T01:04:39.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.462+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16752075034455087126', time=2024-09-12T02:51:53.921514+0000, chain.objs.size()=1 2024-09-12T01:04:39.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.462+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.294__shadow_.2u6Y9uIkODajLFmGOvWlJbb3lSJ590c_0 2024-09-12T01:04:39.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.462+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9236028990058094709', time=2024-09-12T02:52:00.687781+0000, chain.objs.size()=1 2024-09-12T01:04:39.463 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.462+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.303__shadow_.PM3o2eE41U4FbGcG3APEMaI_yNuBgUM_0 2024-09-12T01:04:39.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.462+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14824657662689507939', time=2024-09-12T02:52:04.188299+0000, chain.objs.size()=1 2024-09-12T01:04:39.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.462+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.307__shadow:zMScGZwiR56A4Ng-eKD0fA0KnPnLoKE_.POQHcSZU8AnFTRMUHf6QFp6dbFF1ha1_0 2024-09-12T01:04:39.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.462+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17957538129652828802', time=2024-09-12T02:52:12.944366+0000, chain.objs.size()=1 2024-09-12T01:04:39.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.462+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.319__shadow:NJi4dq7wtvfESIfZWzfqqFqkm0i336S_.Lzb6Mz5OikyqAs7shJlE_RQ4t4Eymkl_0 2024-09-12T01:04:39.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.462+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4411110582067703236', time=2024-09-12T02:52:35.026443+0000, chain.objs.size()=1 2024-09-12T01:04:39.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.462+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.bZn6hLlBR8od47zZW7nG_aoPOF6f77Q_0 2024-09-12T01:04:39.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.462+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15953562995950726664', time=2024-09-12T02:52:35.139576+0000, chain.objs.size()=1 2024-09-12T01:04:39.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.462+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.umZGfQ0fmDYNcLLGQb99kzvr5OMB5Yj_0 2024-09-12T01:04:39.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.462+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13128187940009815505', time=2024-09-12T02:52:35.144191+0000, chain.objs.size()=1 2024-09-12T01:04:39.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.462+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.fgVCTG5diNd-UO_FQf4w0YTLkOymcXI_0 2024-09-12T01:04:39.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.462+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2182122320144395579', time=2024-09-12T02:52:35.159248+0000, chain.objs.size()=1 2024-09-12T01:04:39.464 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.462+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.WZTk_-dUDOrGUH3C7ZHsfWuXpVvjZ0Q_0 2024-09-12T01:04:39.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.462+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5853752221606098203', time=2024-09-12T02:52:35.341054+0000, chain.objs.size()=1 2024-09-12T01:04:39.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.462+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.GqYN4AtwrsQLDf_PKX1DDkfy_9vjWI__0 2024-09-12T01:04:39.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.466+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14851659895297084515', time=2024-09-12T02:52:35.394146+0000, chain.objs.size()=1 2024-09-12T01:04:39.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.466+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.hqYMkIjF3g7d1KvnCtxm_1KJ28QWG7x_0 2024-09-12T01:04:39.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.466+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10697647421080652147', time=2024-09-12T02:52:35.408705+0000, chain.objs.size()=1 2024-09-12T01:04:39.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.466+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.kRYGA2NQzOTmzsoKugWbiOCcEnbW_bi_0 2024-09-12T01:04:39.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.466+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9049644947515257060', time=2024-09-12T02:52:35.591057+0000, chain.objs.size()=1 2024-09-12T01:04:39.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.466+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.lXaxvgYm2CY_hbuH4H2hkzKTFRODexS_0 2024-09-12T01:04:39.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.466+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4609672738900133632', time=2024-09-12T02:52:35.592698+0000, chain.objs.size()=1 2024-09-12T01:04:39.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.466+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.C-Wq5Pv2HU8gzwff3ySBqv26_qHQfUa_0 2024-09-12T01:04:39.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.466+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9382745602535898649', time=2024-09-12T02:52:35.622651+0000, chain.objs.size()=1 2024-09-12T01:04:39.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.466+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.2U-2T4fX9Sfnk8zi2gHkqRij4_cAS_F_0 2024-09-12T01:04:39.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.466+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14595423313087613598', time=2024-09-12T02:52:35.764083+0000, chain.objs.size()=1 2024-09-12T01:04:39.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.466+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.H9PHV0MO39b5LTnGjn1dzwhfqbr_ywm_0 2024-09-12T01:04:39.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.466+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17464565267935997227', time=2024-09-12T02:52:35.770855+0000, chain.objs.size()=1 2024-09-12T01:04:39.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.466+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.-8lXhSOdWfHTtMecdA2os5YzBJ7Mdwq_0 2024-09-12T01:04:39.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.466+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5274486282608576501', time=2024-09-12T02:52:35.798855+0000, chain.objs.size()=1 2024-09-12T01:04:39.469 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.466+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.YJo7vIFAIjH8JwdVOIA-ZCBldp53OJT_0 2024-09-12T01:04:39.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.466+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9622150870768914816', time=2024-09-12T02:52:35.812134+0000, chain.objs.size()=1 2024-09-12T01:04:39.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.466+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.w3hGp4qFGt9CRDiNN-Bznqbak5_QdXq_0 2024-09-12T01:04:39.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.466+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8780010915291365524', time=2024-09-12T02:52:35.826279+0000, chain.objs.size()=1 2024-09-12T01:04:39.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.466+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Enp8AiveP2vYDBIdYX3dxXvh8wg4Us-_0 2024-09-12T01:04:39.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.466+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12172683166496837260', time=2024-09-12T02:52:35.840135+0000, chain.objs.size()=1 2024-09-12T01:04:39.470 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.466+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.eRQ6JIFFhN6XZj9Z0rn6nr6xjcRaLgj_0 2024-09-12T01:04:39.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.470+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10361123740532762719', time=2024-09-12T02:52:35.857679+0000, chain.objs.size()=1 2024-09-12T01:04:39.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.470+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.zlPwr7Y78BYINmRqlxfB3l7lBnl6vjn_0 2024-09-12T01:04:39.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.470+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14413017304679182952', time=2024-09-12T02:52:36.267771+0000, chain.objs.size()=1 2024-09-12T01:04:39.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.470+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Lt8wlqHURF79wwosKqg-9aaRrI0usM1_0 2024-09-12T01:04:39.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.470+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8618672747475840593', time=2024-09-12T02:52:36.301144+0000, chain.objs.size()=1 2024-09-12T01:04:39.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.470+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.iKxAZQ99W9DQXmR9-6UeyfBtmceiTt2_0 2024-09-12T01:04:39.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.470+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16482246711422694515', time=2024-09-12T02:52:36.340205+0000, chain.objs.size()=1 2024-09-12T01:04:39.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.470+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.EHa6eDoNBKLzPpvzWObi2sN2Zv8A9DA_0 2024-09-12T01:04:39.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.470+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2531693513360372017', time=2024-09-12T02:52:36.359202+0000, chain.objs.size()=1 2024-09-12T01:04:39.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.470+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.WdXlgBiHi9fSe9ALVzRxKnwsfdynakJ_0 2024-09-12T01:04:39.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.470+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11915852345141965389', time=2024-09-12T02:52:36.371118+0000, chain.objs.size()=1 2024-09-12T01:04:39.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.470+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.MVKAzeoeJKijB4NmeWwnfHSh0qfGAhb_0 2024-09-12T01:04:39.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.470+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2267133681107149509', time=2024-09-12T02:52:36.389271+0000, chain.objs.size()=1 2024-09-12T01:04:39.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.470+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Clws_4uPE6QhLdXbu4-FMq5F0a2wPWF_0 2024-09-12T01:04:39.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.470+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14046557027577031999', time=2024-09-12T02:52:36.390949+0000, chain.objs.size()=1 2024-09-12T01:04:39.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.470+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.UsJNXjJcApHhp7v7QKke7xdflSV2bbx_0 2024-09-12T01:04:39.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.470+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2747282853390624805', time=2024-09-12T02:52:36.554144+0000, chain.objs.size()=1 2024-09-12T01:04:39.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.470+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.nhU0CwMSfDJx0Pcz2WqySfpchpZCh2h_0 2024-09-12T01:04:39.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.470+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17214878656598582780', time=2024-09-12T02:52:36.618497+0000, chain.objs.size()=1 2024-09-12T01:04:39.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.470+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.LWqa5c7mZuyhjtpWzUn9erj-fg2m8zo_0 2024-09-12T01:04:39.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.470+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16723111000053564724', time=2024-09-12T02:52:36.622549+0000, chain.objs.size()=1 2024-09-12T01:04:39.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.470+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.k26chnjhVFbf9dh1PYdk6MPMgNLDd_o_0 2024-09-12T01:04:39.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.474+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12520645600550856519', time=2024-09-12T02:52:36.623471+0000, chain.objs.size()=1 2024-09-12T01:04:39.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.474+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ATOJNbLo--b3iBSg6Cr4QAifmc2b7Zy_0 2024-09-12T01:04:39.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.474+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.283513720645087347', time=2024-09-12T02:52:36.751650+0000, chain.objs.size()=1 2024-09-12T01:04:39.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.474+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.bamkNkj56j2r5eiHF3sMWDTlhwIvo_k_0 2024-09-12T01:04:39.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.474+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16572728941459825621', time=2024-09-12T02:52:36.753918+0000, chain.objs.size()=1 2024-09-12T01:04:39.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.474+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.HzX8-EmxO5QOPTIbvSJm4EW_Fj-xpoN_0 2024-09-12T01:04:39.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.474+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10805888814140045213', time=2024-09-12T02:52:36.797592+0000, chain.objs.size()=1 2024-09-12T01:04:39.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.474+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.b5kp0hLPQO1zEDKQRv3dhhfyoAzIs5I_0 2024-09-12T01:04:39.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.474+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17828114792858960772', time=2024-09-12T02:52:36.834848+0000, chain.objs.size()=1 2024-09-12T01:04:39.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.474+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.7ZetmjgCsKZii_MN3Iz0h-AzRyPPFiz_0 2024-09-12T01:04:39.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.474+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14387807367359779200', time=2024-09-12T02:52:36.841103+0000, chain.objs.size()=1 2024-09-12T01:04:39.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.474+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.0LOLfUw4iL23EYnNd0arOdlfSoVJsK__0 2024-09-12T01:04:39.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.474+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5056574644178316877', time=2024-09-12T02:52:36.868096+0000, chain.objs.size()=1 2024-09-12T01:04:39.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.474+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.esdZ1HWfg622kIie4dUTI71jdcPPVcD_0 2024-09-12T01:04:39.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.474+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4670936427814539142', time=2024-09-12T02:52:36.869536+0000, chain.objs.size()=1 2024-09-12T01:04:39.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.474+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.mnM2CVz9je5jnzZ3M_Gk46yeRCny-B4_0 2024-09-12T01:04:39.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.474+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11600900970223411806', time=2024-09-12T02:52:36.877989+0000, chain.objs.size()=1 2024-09-12T01:04:39.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.474+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.2R_Hsx59VUzpv2-HFOc2YCt5HBsZmTs_0 2024-09-12T01:04:39.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.474+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.999199243672705997', time=2024-09-12T02:52:36.882048+0000, chain.objs.size()=1 2024-09-12T01:04:39.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.474+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.xHeCeek0nQ2Lue-uT4Xv0av_eamuw3g_0 2024-09-12T01:04:39.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.474+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14946483398432745308', time=2024-09-12T02:52:37.022778+0000, chain.objs.size()=1 2024-09-12T01:04:39.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.474+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.fo46NUiJDW8qeBU4G9uG5wMmhhxn8Yt_0 2024-09-12T01:04:39.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.474+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8024114588749092388', time=2024-09-12T02:52:37.058006+0000, chain.objs.size()=1 2024-09-12T01:04:39.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.474+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.5h9vov5BUWOyFLcmYf2Rmoua7FN2mQu_0 2024-09-12T01:04:39.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.478+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15903572563420040541', time=2024-09-12T02:52:37.077614+0000, chain.objs.size()=1 2024-09-12T01:04:39.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.478+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.RkmqqFJLsIJasLbVppnbj8Y43RYzwR0_0 2024-09-12T01:04:39.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.478+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9658844064246335918', time=2024-09-12T02:52:56.958807+0000, chain.objs.size()=1 2024-09-12T01:04:39.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.478+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.FsVrIz453gDLVWOBQvoWnKh0B5dQ-qF_0 2024-09-12T01:04:39.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.478+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17212023937001231854', time=2024-09-12T02:52:56.981106+0000, chain.objs.size()=1 2024-09-12T01:04:39.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.478+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.qoeVN_1lQ8ppriDw08L7AL22IijXIUY_0 2024-09-12T01:04:39.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.478+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11069698941100072285', time=2024-09-12T02:52:57.003450+0000, chain.objs.size()=1 2024-09-12T01:04:39.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.478+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Sr_nUdqHre0yNEh4LvrLOCEniHml61M_0 2024-09-12T01:04:39.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.478+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2407299468007716685', time=2024-09-12T02:52:57.008888+0000, chain.objs.size()=1 2024-09-12T01:04:39.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.478+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.eUy1cOJwAxVZZaO8A8A9C09llSoqSOK_0 2024-09-12T01:04:39.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.478+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11448180867756344471', time=2024-09-12T02:52:57.010622+0000, chain.objs.size()=1 2024-09-12T01:04:39.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.478+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.uiwMApm45r4JYcr9rJmkIDBrVI3cCmv_0 2024-09-12T01:04:39.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.478+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4543376176513793433', time=2024-09-12T02:52:57.029129+0000, chain.objs.size()=1 2024-09-12T01:04:39.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.478+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.0efCSv1idn50ZRJlL30ut5aXZkf-OGn_0 2024-09-12T01:04:39.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.478+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2919324792682189899', time=2024-09-12T02:52:57.038636+0000, chain.objs.size()=1 2024-09-12T01:04:39.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.478+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.S7__Z1HtNxyG-yE4ZqwjJz-8V1S3MJQ_0 2024-09-12T01:04:39.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.478+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10142163136178663944', time=2024-09-12T02:52:57.160007+0000, chain.objs.size()=1 2024-09-12T01:04:39.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.478+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.-tC9MAWWlW6-sRaFfIqHozOYuUJIaPR_0 2024-09-12T01:04:39.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.478+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3024110844627484769', time=2024-09-12T02:52:57.171710+0000, chain.objs.size()=1 2024-09-12T01:04:39.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.478+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.40qaWIxVVvGIT_f26GBq7HotyW15qgK_0 2024-09-12T01:04:39.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.478+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12433100983628578945', time=2024-09-12T02:52:57.174887+0000, chain.objs.size()=1 2024-09-12T01:04:39.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.478+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Umtby7tl25G4iO5sdj2PFy2IIaV9cKM_0 2024-09-12T01:04:39.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.478+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14995988444321008947', time=2024-09-12T02:52:57.185376+0000, chain.objs.size()=1 2024-09-12T01:04:39.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.478+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.6Bcn990DmxSY1hqjFMn220vvCzY32O1_0 2024-09-12T01:04:39.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.478+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12934796010778327291', time=2024-09-12T02:52:57.215533+0000, chain.objs.size()=1 2024-09-12T01:04:39.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.478+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Mj_HdnZAA5f1DcYirV735CtSa9FYl7Z_0 2024-09-12T01:04:39.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.482+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48648 2024-09-12T01:04:39.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.482+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=55, truncated=0, next_marker='' 2024-09-12T01:04:39.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.482+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15829525921008388516', time=2024-09-12T02:52:57.256087+0000, chain.objs.size()=1 2024-09-12T01:04:39.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.482+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ykkR0F7BMFtM-1diwrpPkpOGd78i3My_0 2024-09-12T01:04:39.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.482+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12427259460270998069', time=2024-09-12T02:52:57.453558+0000, chain.objs.size()=1 2024-09-12T01:04:39.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.482+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.lqVRk5qh1NuvyImFtUPx31zPLWB8nfU_0 2024-09-12T01:04:39.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.482+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4613141729527127903', time=2024-09-12T02:52:57.524384+0000, chain.objs.size()=1 2024-09-12T01:04:39.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.482+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.t8uvrNDjAMexWwsV00SZKUuaaBudbfv_0 2024-09-12T01:04:39.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.482+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.671461326783648935', time=2024-09-12T02:52:57.526880+0000, chain.objs.size()=1 2024-09-12T01:04:39.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.482+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.h8vtqBdZm1X6heYCpr_Dtkky-_nTV2o_0 2024-09-12T01:04:39.484 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.482+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17960926915432870816', time=2024-09-12T02:52:57.633013+0000, chain.objs.size()=1 2024-09-12T01:04:39.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.482+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.2Qgv4-aGmYmEIPxGRkqJJ5IialB5jrR_0 2024-09-12T01:04:39.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.482+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.273705798310570629', time=2024-09-12T02:52:57.658455+0000, chain.objs.size()=1 2024-09-12T01:04:39.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.482+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.UZZFWRe2EsYDQs8QQf2TN0UlPrdJ565_0 2024-09-12T01:04:39.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.482+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11593370162879387610', time=2024-09-12T02:52:57.664411+0000, chain.objs.size()=1 2024-09-12T01:04:39.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.482+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.HZV4r8RMgfmDl4SJcBukqFJV28zQVeN_0 2024-09-12T01:04:39.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.482+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6938058557516751964', time=2024-09-12T02:52:57.681238+0000, chain.objs.size()=1 2024-09-12T01:04:39.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.482+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.hN9snlvK4jrYqsxnrm13qGDDpjoHl14_0 2024-09-12T01:04:39.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.482+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10430730262547533920', time=2024-09-12T02:52:57.707350+0000, chain.objs.size()=1 2024-09-12T01:04:39.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.482+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.4Aq5el6jfiMKrjH8RwlPUylhzvNY3M3_0 2024-09-12T01:04:39.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.482+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7459563898386538808', time=2024-09-12T02:52:57.737538+0000, chain.objs.size()=1 2024-09-12T01:04:39.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.482+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.EUW9LVnkXVPn_EhVdWrY5B2msNZeQ1H_0 2024-09-12T01:04:39.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.482+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11879704058429522119', time=2024-09-12T02:52:57.866030+0000, chain.objs.size()=1 2024-09-12T01:04:39.485 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.482+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.DuMhwom-hfnJEETm-bg9FQWkX987Py5_0 2024-09-12T01:04:39.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.482+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18408591636494481449', time=2024-09-12T02:52:57.931901+0000, chain.objs.size()=1 2024-09-12T01:04:39.486 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.482+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ZRh91apMIhez5YHSHrv5NCCS7Jo2hIS_0 2024-09-12T01:04:39.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.486+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5034362656146494145', time=2024-09-12T02:52:57.939228+0000, chain.objs.size()=1 2024-09-12T01:04:39.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.486+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.PTB8NILwIORf9d7dzRA9TPsIDDuyWpI_0 2024-09-12T01:04:39.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.486+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3518711453705262143', time=2024-09-12T02:52:57.941860+0000, chain.objs.size()=1 2024-09-12T01:04:39.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.486+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.HautDNVd4YLTtTMa-Pf5j8sau9Tw9D1_0 2024-09-12T01:04:39.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.486+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1682934435348679203', time=2024-09-12T02:52:58.132592+0000, chain.objs.size()=1 2024-09-12T01:04:39.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.486+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.9ci_SyORiY7l8RomkAanMJSEY52FzeW_0 2024-09-12T01:04:39.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.486+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17896181589261336932', time=2024-09-12T02:52:58.156709+0000, chain.objs.size()=1 2024-09-12T01:04:39.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.486+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Pap4JfE0JBIsu1vFAUMOTwNl2xbb8S3_0 2024-09-12T01:04:39.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.486+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13032837556227996168', time=2024-09-12T02:52:58.188930+0000, chain.objs.size()=1 2024-09-12T01:04:39.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.486+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.FztjR2Kb2sT8qj9ls8YIP0VwQSXi1Ud_0 2024-09-12T01:04:39.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.486+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11472993504606906893', time=2024-09-12T02:52:58.228146+0000, chain.objs.size()=1 2024-09-12T01:04:39.487 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.486+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_._oRqEk6PFMNxnS8B_tFw2jNhMGiTqMZ_0 2024-09-12T01:04:39.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.486+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4127580048641569352', time=2024-09-12T02:52:58.366872+0000, chain.objs.size()=1 2024-09-12T01:04:39.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.486+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_._O4NS_H6HFpUnx9zABe2eu4AvIpRmxn_0 2024-09-12T01:04:39.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.486+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3057698728827161216', time=2024-09-12T02:52:58.438806+0000, chain.objs.size()=1 2024-09-12T01:04:39.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.486+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.hH6XZH4aQQJTXkL3HoJbnaMQ6QZU1sl_0 2024-09-12T01:04:39.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.486+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18052713361150184200', time=2024-09-12T02:52:58.454309+0000, chain.objs.size()=1 2024-09-12T01:04:39.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.486+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.-kGeKuIniO9KZyPp009CzjDsfLnhrE6_0 2024-09-12T01:04:39.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.486+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3158956212040411043', time=2024-09-12T02:52:58.473695+0000, chain.objs.size()=1 2024-09-12T01:04:39.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.486+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.WSfKBmhs7kGkLRYaDZl-wCpw_PRBpXq_0 2024-09-12T01:04:39.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.486+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13328603709710886846', time=2024-09-12T02:52:58.482332+0000, chain.objs.size()=1 2024-09-12T01:04:39.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.486+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.YnbHB_NPLS__Plv58LuLhaoTnWi1Xf-_0 2024-09-12T01:04:39.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.486+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1814326117370373350', time=2024-09-12T02:52:58.485090+0000, chain.objs.size()=1 2024-09-12T01:04:39.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.486+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.kt59E-HYRAANqA2njqECEoXyihEQf2A_0 2024-09-12T01:04:39.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9512047712929194829', time=2024-09-12T02:52:58.492985+0000, chain.objs.size()=1 2024-09-12T01:04:39.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.slC_vTjYBq7gO5SfjIHD-PvmoP5V1YA_0 2024-09-12T01:04:39.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14715850596535756531', time=2024-09-12T02:52:58.498077+0000, chain.objs.size()=1 2024-09-12T01:04:39.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.o2oNC-JkBbas37GvfmjcXBztBjrPAVD_0 2024-09-12T01:04:39.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8841322742575908675', time=2024-09-12T02:52:58.596074+0000, chain.objs.size()=1 2024-09-12T01:04:39.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Qvz2K0Li0m7vgLlZBigopU3pnqG9c_Z_0 2024-09-12T01:04:39.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17105532486226094352', time=2024-09-12T02:52:58.604933+0000, chain.objs.size()=1 2024-09-12T01:04:39.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.5B8pJCT6-Uv_PtV_8Iw76tTY4s27jAQ_0 2024-09-12T01:04:39.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2626367846819549718', time=2024-09-12T02:52:58.645105+0000, chain.objs.size()=1 2024-09-12T01:04:39.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.SIvhuEiONo9e9RR6lI-NjBEwyOirUVx_0 2024-09-12T01:04:39.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13816398821132672574', time=2024-09-12T02:52:58.648302+0000, chain.objs.size()=1 2024-09-12T01:04:39.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Qf2pHVACYAyZYOQYz7_4iAAU0Fl9ijl_0 2024-09-12T01:04:39.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12752403542360252810', time=2024-09-12T02:52:58.675500+0000, chain.objs.size()=1 2024-09-12T01:04:39.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.6FEdSwGhkXjRlG0byybwWYaykO3TYJZ_0 2024-09-12T01:04:39.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13930736085355832996', time=2024-09-12T02:53:00.533523+0000, chain.objs.size()=1 2024-09-12T01:04:39.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.327__shadow_.Eh7Moa8stk-6rsbu2YRPrrYKvSa3Dkd_0 2024-09-12T01:04:39.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8755493162465506797', time=2024-09-12T02:53:01.181585+0000, chain.objs.size()=1 2024-09-12T01:04:39.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.328__shadow_.iqfSIcV_eZ2hAR8_pHGTSGrFlNhBA7Q_0 2024-09-12T01:04:39.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6207241623888828357', time=2024-09-12T02:53:03.125376+0000, chain.objs.size()=1 2024-09-12T01:04:39.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.331__shadow_.HVU-_BRNuQbbq1X7vWIVdhnt_k-kGOG_0 2024-09-12T01:04:39.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16143864547475153544', time=2024-09-12T02:53:07.269389+0000, chain.objs.size()=1 2024-09-12T01:04:39.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.337__shadow_.TWCI6huBG67eJUwVoynXs9NKde1dj_t_0 2024-09-12T01:04:39.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10688996758822835270', time=2024-09-12T02:53:57.889977+0000, chain.objs.size()=1 2024-09-12T01:04:39.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.409__shadow_.EH7PcmIqIRSg-rsytSW9VaV7E7W_XcA_0 2024-09-12T01:04:39.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7671554298242402196', time=2024-09-12T02:54:21.816526+0000, chain.objs.size()=1 2024-09-12T01:04:39.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.441__shadow_.jd0NZJwkPjwdPUoQjKmOtsIz0rUXKEm_0 2024-09-12T01:04:39.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13361917656605261354', time=2024-09-12T02:54:51.620852+0000, chain.objs.size()=1 2024-09-12T01:04:39.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.481__shadow_.wTfpezosqs7l9BG6Ngvb-212p6QkuZ2_0 2024-09-12T01:04:39.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5848571932965533716', time=2024-09-12T02:55:02.446994+0000, chain.objs.size()=1 2024-09-12T01:04:39.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.496__shadow_.WSF2MLxY6ypUY29ux4prXQTYgfIazJE_0 2024-09-12T01:04:39.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17219175439930227666', time=2024-09-12T02:55:11.218160+0000, chain.objs.size()=6 2024-09-12T01:04:39.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.490+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.1 2024-09-12T01:04:39.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.494+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.2 2024-09-12T01:04:39.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.494+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.3 2024-09-12T01:04:39.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.494+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.4 2024-09-12T01:04:39.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.494+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.5 2024-09-12T01:04:39.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.494+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.6 2024-09-12T01:04:39.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.494+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.272601540692568087', time=2024-09-12T02:55:14.511596+0000, chain.objs.size()=1 2024-09-12T01:04:39.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.494+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.513__multipart_mymultipart.2~Njuu1p2af22WTOBCajo7JnL-5mk9Qvb.1 2024-09-12T01:04:39.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.494+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2697216614093930976', time=2024-09-12T02:55:19.465509+0000, chain.objs.size()=1 2024-09-12T01:04:39.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.494+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.517__shadow_.Cr8IiLjL0nH5HnhzYXBn6DUHmFA4Wx5_0 2024-09-12T01:04:39.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.494+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8345273768997508239', time=2024-09-12T02:55:27.244328+0000, chain.objs.size()=1 2024-09-12T01:04:39.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.494+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.520__shadow:X3cqhZD8E4IltzuKrvs3cHaHwLgaIk9_.QU2S0jl7WGz6DbBdF4Ljv-SJXN1ZhSC_0 2024-09-12T01:04:39.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.494+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2681510461504871464', time=2024-09-12T02:56:51.409509+0000, chain.objs.size()=1 2024-09-12T01:04:39.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.494+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.561__multipart_mymultipart.9ZKe1c8SjX_FEDoprZaOoQG15NZGdmNZ.1 2024-09-12T01:04:39.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.494+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17881944354899719339', time=2024-09-12T02:57:17.159824+0000, chain.objs.size()=1 2024-09-12T01:04:39.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.494+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.574__shadow:OW33q5gpbxq-16HFLI-IRS4QP5H6yhB_.m6mmqyclve9b8FumigrOTxjmoMYcNKn_0 2024-09-12T01:04:39.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.494+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3407254393467362011', time=2024-09-12T02:57:23.842743+0000, chain.objs.size()=1 2024-09-12T01:04:39.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.494+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:Cije-MDf207yOdHDm23HgLSPli7VtOe_.r7HyYCLcjFrbysKLrYJ5e7UcvreGeeo_0 2024-09-12T01:04:39.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.494+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9988780336546754921', time=2024-09-12T02:57:24.411029+0000, chain.objs.size()=1 2024-09-12T01:04:39.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.494+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:v2Mlqh4MTEOI3smzM23NeavN8hNM4KQ_.1LhK9TdhfUrMcusKXr7QZQAJn7F1pGF_0 2024-09-12T01:04:39.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.494+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1602673287405734744', time=2024-09-12T02:57:30.580588+0000, chain.objs.size()=1 2024-09-12T01:04:39.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.494+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:RUWur3Jy2BQU566vrFl2I94Av7dlqIN_.yM90dWP3zXnATcC0CnGAhAvkeYVN8JB_0 2024-09-12T01:04:39.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.494+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6883306985483934700', time=2024-09-12T02:57:44.705350+0000, chain.objs.size()=1 2024-09-12T01:04:39.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.494+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.579__shadow:76vdSDL9v2lVgFxBM.lEmUnh6o59JrC_.e-OyRvw8H1x2Gf0IOcorw2V344WNSFM_0 2024-09-12T01:04:39.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.494+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16398089316900129171', time=2024-09-12T02:58:02.540318+0000, chain.objs.size()=1 2024-09-12T01:04:39.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.494+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.603__shadow_.pbogZlllyDZKHQSQ0XRYQ8lSDz21MV__0 2024-09-12T01:04:39.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.494+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4602214448351406340', time=2024-09-12T03:00:40.181523+0000, chain.objs.size()=1 2024-09-12T01:04:39.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.494+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.633__shadow_.pmuwe73wHyWXDsP2D_tsbRMPMnAUcnT_0 2024-09-12T01:04:39.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.494+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17237023795088804075', time=2024-09-12T03:01:04.407492+0000, chain.objs.size()=12 2024-09-12T01:04:39.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.494+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.661__multipart_baz.2~ETCaNsBkBMFQ6NbXmN5JfTvIWCVpp53.1 2024-09-12T01:04:39.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.498+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.661__shadow_baz.2~ETCaNsBkBMFQ6NbXmN5JfTvIWCVpp53.1_1 2024-09-12T01:04:39.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.498+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.661__multipart_baz.2~ETCaNsBkBMFQ6NbXmN5JfTvIWCVpp53.2 2024-09-12T01:04:39.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.498+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.661__shadow_baz.2~ETCaNsBkBMFQ6NbXmN5JfTvIWCVpp53.2_1 2024-09-12T01:04:39.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.498+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.661__multipart_baz.2~ETCaNsBkBMFQ6NbXmN5JfTvIWCVpp53.3 2024-09-12T01:04:39.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.498+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.661__shadow_baz.2~ETCaNsBkBMFQ6NbXmN5JfTvIWCVpp53.3_1 2024-09-12T01:04:39.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.498+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.661__multipart_baz.2~ETCaNsBkBMFQ6NbXmN5JfTvIWCVpp53.4 2024-09-12T01:04:39.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.498+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.661__shadow_baz.2~ETCaNsBkBMFQ6NbXmN5JfTvIWCVpp53.4_1 2024-09-12T01:04:39.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.498+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.661__multipart_baz.2~ETCaNsBkBMFQ6NbXmN5JfTvIWCVpp53.5 2024-09-12T01:04:39.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.498+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.661__shadow_baz.2~ETCaNsBkBMFQ6NbXmN5JfTvIWCVpp53.5_1 2024-09-12T01:04:39.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.498+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.661__multipart_baz.2~ETCaNsBkBMFQ6NbXmN5JfTvIWCVpp53.6 2024-09-12T01:04:39.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.498+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.661__shadow_baz.2~ETCaNsBkBMFQ6NbXmN5JfTvIWCVpp53.6_1 2024-09-12T01:04:39.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.502+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16232618765502655122', time=2024-09-12T03:01:16.235818+0000, chain.objs.size()=1 2024-09-12T01:04:39.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.502+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.679__shadow_.epYwR5-FTvYqJtfF3qOyAQDtRxsLPkD_0 2024-09-12T01:04:39.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.502+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8712356806198559633', time=2024-09-12T03:01:24.765332+0000, chain.objs.size()=1 2024-09-12T01:04:39.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.502+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.693__shadow:ia0ECCgFP9m1mxImOVNr8d1Xgb63xSF_.9EvastNJarks2iVumYMxXk4iRzSrY65_0 2024-09-12T01:04:39.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.502+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14251442478018719709', time=2024-09-12T03:01:36.894457+0000, chain.objs.size()=1 2024-09-12T01:04:39.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.502+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.710__shadow:ahsCrGJDRNSlPPuVdsng2CSlQluBN9U_.3bm2Ydiao-z_XW8ZB0tEMDOb2i4UQfC_0 2024-09-12T01:04:39.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.506+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:39.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.506+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:04:39.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.510+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:39.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.510+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:39.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.510+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50993' 2024-09-12T01:04:39.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.510+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1981252173707459880', time=2024-09-12T02:48:23.906245+0000, chain.objs.size()=1 2024-09-12T01:04:39.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.510+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.151__shadow_.bRLjTU8Et4PuF3PYVWpVNMB_8IgCGgx_0 2024-09-12T01:04:39.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.510+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='_LjakE5iWz4HYAidLZlr7K_jUCLux7jW', time=2024-09-12T02:48:35.700783+0000, chain.objs.size()=1 2024-09-12T01:04:39.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.510+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.161__shadow_.GC9MJocP0Ckarw5RVyHwdQv4VmEGd3U_0 2024-09-12T01:04:39.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.510+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7388734860198819261', time=2024-09-12T02:48:52.346323+0000, chain.objs.size()=1 2024-09-12T01:04:39.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.510+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.182__shadow_.jajatjuTajfDEHeBTKAKHvLw9TEoB4t_0 2024-09-12T01:04:39.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.510+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8951823138606956855', time=2024-09-12T02:51:26.748390+0000, chain.objs.size()=1 2024-09-12T01:04:39.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.510+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.AQQ6yvhDXI_q0sH60UmUIjw2X631Kse_0 2024-09-12T01:04:39.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.510+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17046759957967332781', time=2024-09-12T02:51:26.776816+0000, chain.objs.size()=1 2024-09-12T01:04:39.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.510+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ibMOIXudrMsFKbSj9vJkd0JYOsqr8SV_0 2024-09-12T01:04:39.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.510+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2654877377782681035', time=2024-09-12T02:51:26.791646+0000, chain.objs.size()=1 2024-09-12T01:04:39.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.510+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.zWxAS01ZG3ZEcJKAdKE_E-A_aVv24AR_0 2024-09-12T01:04:39.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.510+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12955813161770523588', time=2024-09-12T02:51:26.830270+0000, chain.objs.size()=1 2024-09-12T01:04:39.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.510+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.pAwa3woj_8QbzdBwFo7rNuCkczltW3d_0 2024-09-12T01:04:39.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.510+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3134359796272958926', time=2024-09-12T02:51:26.855217+0000, chain.objs.size()=1 2024-09-12T01:04:39.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.510+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.u9rHiLUg_oRjq4m4jGHtRxsXUuxxZP9_0 2024-09-12T01:04:39.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.510+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15620478595361030639', time=2024-09-12T02:51:26.981728+0000, chain.objs.size()=1 2024-09-12T01:04:39.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.510+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.OceE3LmChwwhC2lRBsqumczwXmfTQ5p_0 2024-09-12T01:04:39.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.510+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3296886635654309729', time=2024-09-12T02:51:26.997538+0000, chain.objs.size()=1 2024-09-12T01:04:39.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.510+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.uJCkRI15IskQ1oBHT57tuY5HI3RuB19_0 2024-09-12T01:04:39.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.510+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6382288169719378771', time=2024-09-12T02:51:27.003964+0000, chain.objs.size()=1 2024-09-12T01:04:39.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.510+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Pq2lT53FQdINPxM6ziTUaB6h2h80yFk_0 2024-09-12T01:04:39.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.510+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13973456805795087922', time=2024-09-12T02:51:27.058182+0000, chain.objs.size()=1 2024-09-12T01:04:39.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.510+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.C-uFep9Kn_wqy4AGmU_20adJozXZWQ0_0 2024-09-12T01:04:39.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3566754242912489069', time=2024-09-12T02:51:27.058958+0000, chain.objs.size()=1 2024-09-12T01:04:39.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.hT3488nyeI6wWAlm7j6-ZirlOW1qEx8_0 2024-09-12T01:04:39.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11187960975003853531', time=2024-09-12T02:51:27.086313+0000, chain.objs.size()=1 2024-09-12T01:04:39.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.zjseBFC9Tfbd0bWUKwD_h1Ikmn5H8XF_0 2024-09-12T01:04:39.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8382649493953954937', time=2024-09-12T02:51:27.267206+0000, chain.objs.size()=1 2024-09-12T01:04:39.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.bKgoKCN7tS4LFKdNVlkDY6Xyj34CCGJ_0 2024-09-12T01:04:39.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.991013231792920630', time=2024-09-12T02:51:27.483586+0000, chain.objs.size()=1 2024-09-12T01:04:39.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.L0kVi6L_f_jfGoToTYrXtSFJIn7MAFS_0 2024-09-12T01:04:39.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11095205922829652256', time=2024-09-12T02:51:27.535966+0000, chain.objs.size()=1 2024-09-12T01:04:39.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.eqf5-j61a5Fry1VvkcUW7pUIXLRgy1M_0 2024-09-12T01:04:39.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18053495633287749381', time=2024-09-12T02:51:27.627910+0000, chain.objs.size()=1 2024-09-12T01:04:39.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.JsvOt6x5tnhCSQ8M_QzQjH3sv7b-CC2_0 2024-09-12T01:04:39.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4590013473919457795', time=2024-09-12T02:51:27.646462+0000, chain.objs.size()=1 2024-09-12T01:04:39.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.lIK_m0c9IevnNj7a-n--rgjPmVA906i_0 2024-09-12T01:04:39.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5255591014536594009', time=2024-09-12T02:51:27.661278+0000, chain.objs.size()=1 2024-09-12T01:04:39.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.-BvPxA9bftb6vzp66Rdspkjhy80YXu6_0 2024-09-12T01:04:39.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1600687893171812260', time=2024-09-12T02:51:27.691765+0000, chain.objs.size()=1 2024-09-12T01:04:39.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.lcCeS3YV1c9nQTt-WEphn2c9rjlDk5O_0 2024-09-12T01:04:39.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17301028560024071397', time=2024-09-12T02:51:27.844800+0000, chain.objs.size()=1 2024-09-12T01:04:39.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.zD8pNbm5V-xr1udkcFkIwSavVvZjl3u_0 2024-09-12T01:04:39.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5744387606352218958', time=2024-09-12T02:51:27.846753+0000, chain.objs.size()=1 2024-09-12T01:04:39.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.DT36OnuQ6tLe-F1dZNDyNxmcxZ81Gnb_0 2024-09-12T01:04:39.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10439123145293457230', time=2024-09-12T02:51:27.871457+0000, chain.objs.size()=1 2024-09-12T01:04:39.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ATNxP6-d5pQ8uHnmivjjf-mqmt6ilBH_0 2024-09-12T01:04:39.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12836144306762399371', time=2024-09-12T02:51:27.964144+0000, chain.objs.size()=1 2024-09-12T01:04:39.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.EYKHdeWPYoKc2q2yeQ5_jlw0mK9EHdZ_0 2024-09-12T01:04:39.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3984109368066156607', time=2024-09-12T02:51:28.167871+0000, chain.objs.size()=1 2024-09-12T01:04:39.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ep4_w-0nWFUooRfGM4k0S4S52qJMdIZ_0 2024-09-12T01:04:39.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3570556867062360966', time=2024-09-12T02:51:28.226839+0000, chain.objs.size()=1 2024-09-12T01:04:39.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.l4YHXA7WTvLosgfplZmFS6ofLAsCqM2_0 2024-09-12T01:04:39.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9083982498353137595', time=2024-09-12T02:51:28.232716+0000, chain.objs.size()=1 2024-09-12T01:04:39.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.2hqUMeBjHBA00KkQB6q7Eo8E9wkI1Qv_0 2024-09-12T01:04:39.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18299337935343998748', time=2024-09-12T02:51:28.332615+0000, chain.objs.size()=1 2024-09-12T01:04:39.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.3IBEUQ3QlIWGOmhqd4HtTk5xtnsya1X_0 2024-09-12T01:04:39.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13978412684933298009', time=2024-09-12T02:51:28.381387+0000, chain.objs.size()=1 2024-09-12T01:04:39.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.n355R82rylFwaB01Rk7-wGerIPUP45-_0 2024-09-12T01:04:39.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1215951070795744422', time=2024-09-12T02:51:28.648869+0000, chain.objs.size()=1 2024-09-12T01:04:39.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.XDMQLV6mVieQfTh9hfJCq4mOIpKXj-D_0 2024-09-12T01:04:39.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8667996338165810738', time=2024-09-12T02:51:33.658910+0000, chain.objs.size()=1 2024-09-12T01:04:39.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.269__shadow_.myTlscMJFK1vcRnBsBgxJdGcey7f-Re_0 2024-09-12T01:04:39.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2477822659180903166', time=2024-09-12T02:51:36.524966+0000, chain.objs.size()=1 2024-09-12T01:04:39.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.273__shadow_.Ea2jEybBHBa7OnLvJj7j67KN0L-o8Fx_0 2024-09-12T01:04:39.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17845445344855776662', time=2024-09-12T02:51:45.492764+0000, chain.objs.size()=1 2024-09-12T01:04:39.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.514+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.285__shadow_._PVF8hOFuriWksZdc2ste9pFnYCJF7l_0 2024-09-12T01:04:39.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.518+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1636416843913265967', time=2024-09-12T02:51:51.726330+0000, chain.objs.size()=1 2024-09-12T01:04:39.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.518+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.292__shadow_.JzzmFKDEwfDTWyWdFsmDeao9G9XkODo_0 2024-09-12T01:04:39.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.518+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13894821423070187949', time=2024-09-12T02:51:51.751357+0000, chain.objs.size()=1 2024-09-12T01:04:39.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.518+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.292__shadow_.wgGpb3lr8Ki8hdPTAfugr-HEInnI3Hv_0 2024-09-12T01:04:39.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.518+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1742288601220149912', time=2024-09-12T02:51:57.669606+0000, chain.objs.size()=1 2024-09-12T01:04:39.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.518+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.299__shadow_.0WTU62dAtBaTLCgQtgCKarn_ejvQzUD_0 2024-09-12T01:04:39.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.518+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9564508617096160688', time=2024-09-12T02:51:58.472070+0000, chain.objs.size()=1 2024-09-12T01:04:39.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.518+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.300__shadow_.LWk65Rr58Zvp6Wb0xUdI_q-YlhHgx69_0 2024-09-12T01:04:39.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.518+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4409595834033077038', time=2024-09-12T02:52:35.035506+0000, chain.objs.size()=1 2024-09-12T01:04:39.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.518+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.qwaMiDmpqsME7jRs41yi-CemGDJJBvh_0 2024-09-12T01:04:39.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.518+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7561097176492982419', time=2024-09-12T02:52:35.141062+0000, chain.objs.size()=1 2024-09-12T01:04:39.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.518+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.-UzApjaUc62B-9qA8WDowZNEDtxJa2d_0 2024-09-12T01:04:39.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.518+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1851024797711435061', time=2024-09-12T02:52:35.142533+0000, chain.objs.size()=1 2024-09-12T01:04:39.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.518+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.cZmObBnZHM5q26IdLX7uPPIQ5XfiCsb_0 2024-09-12T01:04:39.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.518+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12816126160095986374', time=2024-09-12T02:52:35.187071+0000, chain.objs.size()=1 2024-09-12T01:04:39.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.518+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.pv9fWHJzefBnX6gZbUSYglYoX44NAB9_0 2024-09-12T01:04:39.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.518+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1318633253054608445', time=2024-09-12T02:52:35.328658+0000, chain.objs.size()=1 2024-09-12T01:04:39.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.518+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.PQdBZc-tUzm5pFatpKlAIY_Z2l-rgy9_0 2024-09-12T01:04:39.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.518+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9998089624308554598', time=2024-09-12T02:52:35.340551+0000, chain.objs.size()=1 2024-09-12T01:04:39.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.518+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.7LjPen9oUtBdr71k02HvIeL_t_7poaA_0 2024-09-12T01:04:39.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.518+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17856961260200683236', time=2024-09-12T02:52:35.362194+0000, chain.objs.size()=1 2024-09-12T01:04:39.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.518+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.A6WGgHxEPkLmqm_RuOMHtenKhonRiMQ_0 2024-09-12T01:04:39.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.518+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4952096371997962773', time=2024-09-12T02:52:35.365244+0000, chain.objs.size()=1 2024-09-12T01:04:39.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.518+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Dt4hXc1ZOzPQUBu-KfsOxH3iKw2pBcy_0 2024-09-12T01:04:39.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.518+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5119625031994714692', time=2024-09-12T02:52:35.366330+0000, chain.objs.size()=1 2024-09-12T01:04:39.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.518+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.NxYhWGU0C0TjW3zwsL5tEefYXZwu6aT_0 2024-09-12T01:04:39.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.518+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4104621357522201284', time=2024-09-12T02:52:35.381023+0000, chain.objs.size()=1 2024-09-12T01:04:39.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.518+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.thkNPbC_Ppeoc3ubA479Rx84UGCZhoy_0 2024-09-12T01:04:39.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8029546560147764375', time=2024-09-12T02:52:35.409501+0000, chain.objs.size()=1 2024-09-12T01:04:39.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.eV9LsPWxQR2ApfHTVmy63Z7_vBlRkXb_0 2024-09-12T01:04:39.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13672022728596219175', time=2024-09-12T02:52:35.423374+0000, chain.objs.size()=1 2024-09-12T01:04:39.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.iP84nYMQ2Ihl70PvQbnvukaRtIhFM5H_0 2024-09-12T01:04:39.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2449683642913446104', time=2024-09-12T02:52:35.543538+0000, chain.objs.size()=1 2024-09-12T01:04:39.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.7iqNMBilrH4_8auty7mut5LfoSLruDW_0 2024-09-12T01:04:39.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15600414170059855492', time=2024-09-12T02:52:35.566331+0000, chain.objs.size()=1 2024-09-12T01:04:39.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.9m0ipHwYa3ptFTvDfLnWIYASU6ub9Wk_0 2024-09-12T01:04:39.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16953261312286242114', time=2024-09-12T02:52:35.590437+0000, chain.objs.size()=1 2024-09-12T01:04:39.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.dU--16HWjtkOAPCN1P8sd67gGqocKS1_0 2024-09-12T01:04:39.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9971252790038367629', time=2024-09-12T02:52:35.647298+0000, chain.objs.size()=1 2024-09-12T01:04:39.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.P38AJUQirpWcsELsOGWEGEeVryY2psI_0 2024-09-12T01:04:39.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7290577530114726436', time=2024-09-12T02:52:35.666173+0000, chain.objs.size()=1 2024-09-12T01:04:39.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.0kiwkkHNHlVE7SD8av8vnwHaQb-Hp6s_0 2024-09-12T01:04:39.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9703233931560269577', time=2024-09-12T02:52:35.820439+0000, chain.objs.size()=1 2024-09-12T01:04:39.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.4ac9w_MMH2wiIT1z8nL5ZpyyNDPLO4g_0 2024-09-12T01:04:39.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14780100397715246124', time=2024-09-12T02:52:35.823826+0000, chain.objs.size()=1 2024-09-12T01:04:39.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.dClvAf7uAZ94ZnhQEAIQd5UDcmeyN0n_0 2024-09-12T01:04:39.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3845624771222842200', time=2024-09-12T02:52:35.847388+0000, chain.objs.size()=1 2024-09-12T01:04:39.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Ex62I8DLVlMLc86cduP0b7_s5w2RrMd_0 2024-09-12T01:04:39.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12131760043524390421', time=2024-09-12T02:52:35.859494+0000, chain.objs.size()=1 2024-09-12T01:04:39.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.YZo-QP6ZGJBTZScqYXixAK_fs53_dLK_0 2024-09-12T01:04:39.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4576187823052177629', time=2024-09-12T02:52:35.867712+0000, chain.objs.size()=1 2024-09-12T01:04:39.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.1VeLU_fs-W6-Gg2kwYgqda72Ytc1HLP_0 2024-09-12T01:04:39.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5372353895554055549', time=2024-09-12T02:52:35.888894+0000, chain.objs.size()=1 2024-09-12T01:04:39.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.MtOOTuTbKBnwUrK4KEENhy7o3D3s0yY_0 2024-09-12T01:04:39.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11358853013702788021', time=2024-09-12T02:52:36.287733+0000, chain.objs.size()=1 2024-09-12T01:04:39.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.lidl0GHz_w62mejV1nYAhpxE_vvzS0N_0 2024-09-12T01:04:39.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8397654945062656020', time=2024-09-12T02:52:36.304781+0000, chain.objs.size()=1 2024-09-12T01:04:39.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.c2HuYmP4CDGEUnMNtRaX1tH8n10G5yd_0 2024-09-12T01:04:39.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8377291484618384723', time=2024-09-12T02:52:36.316269+0000, chain.objs.size()=1 2024-09-12T01:04:39.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.CnYtnvaZGslqEnrIWsLhFPUMAAuZYYn_0 2024-09-12T01:04:39.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8932623400068231670', time=2024-09-12T02:52:36.334439+0000, chain.objs.size()=1 2024-09-12T01:04:39.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.522+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.t0x6XFX9tDwMmkkk2NoLUOMsSDNK3O1_0 2024-09-12T01:04:39.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12158109957836831464', time=2024-09-12T02:52:36.340322+0000, chain.objs.size()=1 2024-09-12T01:04:39.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ISRCViDz6TEwbhAVFUk2HoTVTIj3huE_0 2024-09-12T01:04:39.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13928637691795574105', time=2024-09-12T02:52:36.355724+0000, chain.objs.size()=1 2024-09-12T01:04:39.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.edvdh9_rNinFP8fb0zT9YJxA0YOneTt_0 2024-09-12T01:04:39.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12360084754884352604', time=2024-09-12T02:52:36.360181+0000, chain.objs.size()=1 2024-09-12T01:04:39.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.m4l2d44zoxavRsqyB3ZKmGiqMr6tc7M_0 2024-09-12T01:04:39.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17981302550057210170', time=2024-09-12T02:52:36.534758+0000, chain.objs.size()=1 2024-09-12T01:04:39.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.q9Z6kiiGmkXbXSN2K_qPSOxPthBTt9O_0 2024-09-12T01:04:39.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3932081917538158333', time=2024-09-12T02:52:36.549327+0000, chain.objs.size()=1 2024-09-12T01:04:39.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.IihWg5W0dKC0y1ZJ3QTOKpwhV13-vp5_0 2024-09-12T01:04:39.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2478411626212675199', time=2024-09-12T02:52:36.597763+0000, chain.objs.size()=1 2024-09-12T01:04:39.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.zRh7OMjY7yHJVeg9iVa-eVqK5rhPJrN_0 2024-09-12T01:04:39.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17309081721083316019', time=2024-09-12T02:52:36.628390+0000, chain.objs.size()=1 2024-09-12T01:04:39.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.y1mliPSTebpijWxoin1qS_6KCgIv_G3_0 2024-09-12T01:04:39.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1341191849807062636', time=2024-09-12T02:52:36.633787+0000, chain.objs.size()=1 2024-09-12T01:04:39.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.lT4XZjWh7bMzuafy8suIu4W7RbQ0X2L_0 2024-09-12T01:04:39.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13944474740979745326', time=2024-09-12T02:52:36.636227+0000, chain.objs.size()=1 2024-09-12T01:04:39.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.5Qa-AM8I3m_Mngsgit53QUkAcOLa6qS_0 2024-09-12T01:04:39.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17794586284899309322', time=2024-09-12T02:52:36.644406+0000, chain.objs.size()=1 2024-09-12T01:04:39.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.UToUt3j3eo3tpNOBKF9xieILyG4Mdxg_0 2024-09-12T01:04:39.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16603219386970934464', time=2024-09-12T02:52:36.760715+0000, chain.objs.size()=1 2024-09-12T01:04:39.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.8-EsmyQoGLSXbB5rETFIKV71ZJ5Kt_R_0 2024-09-12T01:04:39.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3178079151667936042', time=2024-09-12T02:52:36.788527+0000, chain.objs.size()=1 2024-09-12T01:04:39.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.pBlV3ybusSU7yvJV2K7ns-Q8DnaevgR_0 2024-09-12T01:04:39.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1584864491353003048', time=2024-09-12T02:52:36.834215+0000, chain.objs.size()=1 2024-09-12T01:04:39.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.604uBpauOg-jtWhZDw6H5LaumiQGHcp_0 2024-09-12T01:04:39.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2283714083278176192', time=2024-09-12T02:52:36.838300+0000, chain.objs.size()=1 2024-09-12T01:04:39.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.KZppEmctb2mDduoeUlfsrjY5fCSpcDb_0 2024-09-12T01:04:39.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7892584867545779854', time=2024-09-12T02:52:36.857452+0000, chain.objs.size()=1 2024-09-12T01:04:39.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.3KwU4a7NtpUYE-GoGmbUS7bcgS5sM-q_0 2024-09-12T01:04:39.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15596771723673788765', time=2024-09-12T02:52:36.883038+0000, chain.objs.size()=1 2024-09-12T01:04:39.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.oAhvTUlvQLZjCZXnzIkjW7H7EUp6Fx7_0 2024-09-12T01:04:39.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14529412290951506091', time=2024-09-12T02:52:37.007126+0000, chain.objs.size()=1 2024-09-12T01:04:39.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.soy0wMS8Eo_p2-rpo_3IDMxZgpd3Kzc_0 2024-09-12T01:04:39.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3511906336156850678', time=2024-09-12T02:52:37.018929+0000, chain.objs.size()=1 2024-09-12T01:04:39.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.1tobzqEhaxJ6N0H6Xx6FPhehs9zzTkN_0 2024-09-12T01:04:39.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12245500841644163321', time=2024-09-12T02:52:37.078870+0000, chain.objs.size()=1 2024-09-12T01:04:39.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.KazfA-ezsIYsidYvxT5Cd-voN2044dj_0 2024-09-12T01:04:39.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11889541442322753544', time=2024-09-12T02:52:37.096435+0000, chain.objs.size()=1 2024-09-12T01:04:39.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.OFXORHVzknIzAGoklSnqpSayzHlOWhr_0 2024-09-12T01:04:39.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4607885492385525811', time=2024-09-12T02:52:56.895892+0000, chain.objs.size()=1 2024-09-12T01:04:39.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.526+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ObjpmJAzfxFmFQPZ-G7x6Jqr77RwbR8_0 2024-09-12T01:04:39.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.530+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15540658788826217634', time=2024-09-12T02:52:56.899325+0000, chain.objs.size()=1 2024-09-12T01:04:39.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.530+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.QpfDxhIbW-jJ5oXcGZT4rS4cJHAS5sn_0 2024-09-12T01:04:39.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.530+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8469566460918783783', time=2024-09-12T02:52:56.904092+0000, chain.objs.size()=1 2024-09-12T01:04:39.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.530+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.FV5vJf0x7zJTDGTl5rj0vDYlpc6sYH__0 2024-09-12T01:04:39.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.530+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.744752538665897826', time=2024-09-12T02:52:56.980726+0000, chain.objs.size()=1 2024-09-12T01:04:39.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.530+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.m-x2zuyIISUPDNokIHidgNAV1KgJN5Q_0 2024-09-12T01:04:39.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.530+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3632496395844363717', time=2024-09-12T02:52:56.990740+0000, chain.objs.size()=1 2024-09-12T01:04:39.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.530+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.tqpwpXMShYMI1hdz_7jfstlSO9XMBl0_0 2024-09-12T01:04:39.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.530+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9586295552510787971', time=2024-09-12T02:52:57.022729+0000, chain.objs.size()=1 2024-09-12T01:04:39.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.530+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.rjiPDyNvi8rwZ0PJyPxQ19_Zd_rSP5J_0 2024-09-12T01:04:39.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.530+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8524973437204887541', time=2024-09-12T02:52:57.044668+0000, chain.objs.size()=1 2024-09-12T01:04:39.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.530+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.tClhtO_fUWv2fqXM_2mERxbaD7NjiUP_0 2024-09-12T01:04:39.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.530+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6495077146245821234', time=2024-09-12T02:52:57.214704+0000, chain.objs.size()=1 2024-09-12T01:04:39.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.530+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.rxYOPw9NpCWRX5-FhqrkEnVFosHsjzA_0 2024-09-12T01:04:39.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.530+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1963414184533570102', time=2024-09-12T02:52:57.287072+0000, chain.objs.size()=1 2024-09-12T01:04:39.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.530+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.byQs1_kPO-yXcX9ed0jL_gGn_LzTRze_0 2024-09-12T01:04:39.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.530+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14101541624884021099', time=2024-09-12T02:52:57.434491+0000, chain.objs.size()=1 2024-09-12T01:04:39.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.530+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.8StUZLedr75gBNiuxHtPvcDX2OVJ8M8_0 2024-09-12T01:04:39.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.530+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16156156393388787590', time=2024-09-12T02:52:57.474964+0000, chain.objs.size()=1 2024-09-12T01:04:39.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.530+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.vqHOU54sEVBf5nrNtscce0UtYpOh0Zc_0 2024-09-12T01:04:39.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.530+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16321701587607007013', time=2024-09-12T02:52:57.512027+0000, chain.objs.size()=1 2024-09-12T01:04:39.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.530+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.MDCsX_ep88kSo5KBXJFGrsw3BMjrjUv_0 2024-09-12T01:04:39.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.530+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13086098921861364118', time=2024-09-12T02:52:57.635545+0000, chain.objs.size()=1 2024-09-12T01:04:39.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.530+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.e2udcPI7PnqBii0c3J_Sd7gkJHHKHPq_0 2024-09-12T01:04:39.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.530+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7315372619739087395', time=2024-09-12T02:52:57.861010+0000, chain.objs.size()=1 2024-09-12T01:04:39.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.530+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.l_QGiqPOJgQ0RX_5gVJJFtNOpxSc5qg_0 2024-09-12T01:04:39.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.530+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16940523761243556118', time=2024-09-12T02:52:57.905626+0000, chain.objs.size()=1 2024-09-12T01:04:39.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.530+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ukHPIoDb38WIjxDDT5qNmSIINXDErBR_0 2024-09-12T01:04:39.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.534+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50993 2024-09-12T01:04:39.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.534+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T01:04:39.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.534+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13714871695615026808', time=2024-09-12T02:52:57.942871+0000, chain.objs.size()=1 2024-09-12T01:04:39.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.534+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.jHN5ODD_mb6OcxIr0lAcMQ_VxOsuyrh_0 2024-09-12T01:04:39.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.534+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17140467183924955591', time=2024-09-12T02:52:57.970146+0000, chain.objs.size()=1 2024-09-12T01:04:39.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.534+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.xwiENcc38SmVDGr67dbrqUB09aGx2Le_0 2024-09-12T01:04:39.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.534+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7060327094968412021', time=2024-09-12T02:52:58.144550+0000, chain.objs.size()=1 2024-09-12T01:04:39.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.534+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.hEqQCSMT_uIxRWA60s6fbEV82HOKGa5_0 2024-09-12T01:04:39.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.534+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8871507888685099967', time=2024-09-12T02:52:58.242060+0000, chain.objs.size()=1 2024-09-12T01:04:39.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.534+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.1d5wov6M3pPhBMGYfEYZE21Ux1Q7tuM_0 2024-09-12T01:04:39.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.534+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9029590907526272621', time=2024-09-12T02:52:58.392835+0000, chain.objs.size()=1 2024-09-12T01:04:39.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.534+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.u8Vy_gJ_tupCTgckC-VhLu5vlplopY0_0 2024-09-12T01:04:39.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.534+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8050746074730945785', time=2024-09-12T02:52:58.455335+0000, chain.objs.size()=1 2024-09-12T01:04:39.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.534+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Woo_fQhJ4wRfNY8douAi35eYlkAC6NS_0 2024-09-12T01:04:39.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.538+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16802677427304912359', time=2024-09-12T02:52:58.462246+0000, chain.objs.size()=1 2024-09-12T01:04:39.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.538+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.VviU7QTu3RwBzeaQT30yoXKQ3fGMoPF_0 2024-09-12T01:04:39.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.538+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10749161148697767408', time=2024-09-12T02:52:58.671974+0000, chain.objs.size()=1 2024-09-12T01:04:39.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.538+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.MrMSbZnO_ob8D0CEBYCta717TZJ9s_i_0 2024-09-12T01:04:39.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.538+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17308652053487663879', time=2024-09-12T02:52:58.678464+0000, chain.objs.size()=1 2024-09-12T01:04:39.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.538+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ROqme86sylyHc6tHV-mh9whGxVHLHrz_0 2024-09-12T01:04:39.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.538+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4598238654059988623', time=2024-09-12T02:52:58.683678+0000, chain.objs.size()=1 2024-09-12T01:04:39.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.538+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.njIZPqB_Divl8cdEyTvkvMdUEP92AMS_0 2024-09-12T01:04:39.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.538+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18342482430637679588', time=2024-09-12T02:52:58.696901+0000, chain.objs.size()=1 2024-09-12T01:04:39.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.538+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.RLB39dRpULzlMZ9l7LTwTuNU_OA8wRl_0 2024-09-12T01:04:39.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.538+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9624734539301572635', time=2024-09-12T02:53:57.173603+0000, chain.objs.size()=1 2024-09-12T01:04:39.539 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.538+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.408__shadow_.RUw_M66_28XeqPps5_HHLXipPZcZDOT_0 2024-09-12T01:04:39.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.538+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7589168714001205315', time=2024-09-12T02:55:07.269644+0000, chain.objs.size()=1 2024-09-12T01:04:39.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.538+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.503__shadow:6LMeYfVzuD7PUiSwyt-9RW46Hh57mqn_.UcslrmdoBCcU7pOGIUMlA4mj_NOCVe1_0 2024-09-12T01:04:39.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.538+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3433948970865024095', time=2024-09-12T02:55:48.913157+0000, chain.objs.size()=1 2024-09-12T01:04:39.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.538+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.525__multipart_mymultipart.2~dwUAI7EVkujxEg4LKBeW_OCTfkNqhDI.1 2024-09-12T01:04:39.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.538+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.518176451024896259', time=2024-09-12T02:56:48.172329+0000, chain.objs.size()=1 2024-09-12T01:04:39.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.538+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.558__shadow_.W6LT1x6uaeiiJOBIvJa3WqgoHIF61ur_0 2024-09-12T01:04:39.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.538+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12991832581275766428', time=2024-09-12T02:57:09.308037+0000, chain.objs.size()=1 2024-09-12T01:04:39.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.538+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.569__shadow:9JhM2CaNnShMbvIwUa4BhyuQKh.9W-b_.z9K-HfGzHO7F5sC_beGHPUhjL9dQ09E_0 2024-09-12T01:04:39.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.538+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.305431580572349034', time=2024-09-12T02:57:32.471972+0000, chain.objs.size()=1 2024-09-12T01:04:39.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.538+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:p86nGrDUaKYUctENF4AIYYqiNBgk3F2_.YmSfofuBfFINvBPTeN-rNUQkAavvd5l_0 2024-09-12T01:04:39.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.538+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10415375941400207563', time=2024-09-12T02:57:52.126192+0000, chain.objs.size()=1 2024-09-12T01:04:39.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.538+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.587__shadow:kGwEkXLo6Xlk0Q2EV1dOoNWMke1pejp_.cAv9RwFEBuWlH2V7WumRrtdzN-d77h6_0 2024-09-12T01:04:39.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.538+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18351226386757676144', time=2024-09-12T02:58:05.305606+0000, chain.objs.size()=1 2024-09-12T01:04:39.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.538+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.607__shadow_.2YoeaV0OjNPe1IZrNIZvJC5ZW_Y-XnB_0 2024-09-12T01:04:39.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.538+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13671566275227416766', time=2024-09-12T03:01:37.708263+0000, chain.objs.size()=1 2024-09-12T01:04:39.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.538+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.711__multipart_file1.2~F6zGoN53R0DfxAenBJnY6Jw1Dpx8QOE.1 2024-09-12T01:04:39.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.542+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:39.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.542+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:04:39.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.546+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:39.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.546+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:39.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.546+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=0, next_marker='' 2024-09-12T01:04:39.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.546+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='_cAOEZYv4HJR7P32LHmpeUM8Sy8CXfVO', time=2024-09-12T02:48:36.813461+0000, chain.objs.size()=3 2024-09-12T01:04:39.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.546+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.163__shadow_.ZFnsTFxGq2ThfJgH2pRZf8CaDM1n3gC_0 2024-09-12T01:04:39.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.546+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.163__shadow_.ZFnsTFxGq2ThfJgH2pRZf8CaDM1n3gC_1 2024-09-12T01:04:39.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.546+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.163__shadow_.ZFnsTFxGq2ThfJgH2pRZf8CaDM1n3gC_2 2024-09-12T01:04:39.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.546+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2678345698677102310', time=2024-09-12T02:48:48.382467+0000, chain.objs.size()=1 2024-09-12T01:04:39.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.546+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.176__shadow_.ZwNYW9cSLo0h5joAJIkmQFyb0JIoppP_0 2024-09-12T01:04:39.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.546+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15692389351001998040', time=2024-09-12T02:50:51.788619+0000, chain.objs.size()=1 2024-09-12T01:04:39.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.546+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.242__shadow_.t_Vkwes5MVPEsrorGVs4LQ1hYz88kGg_0 2024-09-12T01:04:39.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.546+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15968315409228551210', time=2024-09-12T02:51:26.844227+0000, chain.objs.size()=1 2024-09-12T01:04:39.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.546+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.CY8CIOBPSApeCFxws3-DrgB0wqY3ICL_0 2024-09-12T01:04:39.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.546+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.962727805387079387', time=2024-09-12T02:51:26.859925+0000, chain.objs.size()=1 2024-09-12T01:04:39.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.546+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.yHdPUvp3_T2EQe3RlTc17goYqBe7jw2_0 2024-09-12T01:04:39.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.546+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.203482426118145643', time=2024-09-12T02:51:27.018245+0000, chain.objs.size()=1 2024-09-12T01:04:39.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.546+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.rGeRyU2gqBAPfWIFR9DFvkAXsetfR1o_0 2024-09-12T01:04:39.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.546+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14173102599946171154', time=2024-09-12T02:51:27.026890+0000, chain.objs.size()=1 2024-09-12T01:04:39.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.546+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Y-Gk8cLvCwKeBGtz56U5NF9t_Z3p_T3_0 2024-09-12T01:04:39.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.546+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8509182561427956273', time=2024-09-12T02:51:27.060169+0000, chain.objs.size()=1 2024-09-12T01:04:39.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.546+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.gi46U0YNr2RMsy2VgiZjktvWJCdr95A_0 2024-09-12T01:04:39.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.546+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3214156257330347368', time=2024-09-12T02:51:27.064576+0000, chain.objs.size()=1 2024-09-12T01:04:39.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.546+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.1ZPihWsN2aQp_1-aWmKmklHXsbYBenS_0 2024-09-12T01:04:39.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.546+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14380555552537123305', time=2024-09-12T02:51:27.071640+0000, chain.objs.size()=1 2024-09-12T01:04:39.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.546+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.mxeqqqvfwyq98PTW3vEiU-M_dhGu4qI_0 2024-09-12T01:04:39.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.550+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12713165410520843744', time=2024-09-12T02:51:27.083674+0000, chain.objs.size()=1 2024-09-12T01:04:39.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.550+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.DqAf9TuhQ_QffJ-9Kz-nW7wTUqcW5Sc_0 2024-09-12T01:04:39.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.550+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11011303786653465463', time=2024-09-12T02:51:27.086351+0000, chain.objs.size()=1 2024-09-12T01:04:39.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.550+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.pj5w2_sglEmxJgrze26txuncqT1tfJy_0 2024-09-12T01:04:39.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.550+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.391405240783143588', time=2024-09-12T02:51:27.200875+0000, chain.objs.size()=1 2024-09-12T01:04:39.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.550+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.y-HIjgzi3XUxcP_moymrZ4ymUNDPmxC_0 2024-09-12T01:04:39.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.550+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6770315179687190034', time=2024-09-12T02:51:27.205489+0000, chain.objs.size()=1 2024-09-12T01:04:39.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.550+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.hOvmVUPgQ8CiRnnzRbGXycQqlCGS12K_0 2024-09-12T01:04:39.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.550+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9519790961755548856', time=2024-09-12T02:51:27.221387+0000, chain.objs.size()=1 2024-09-12T01:04:39.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.550+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.gA68Z9ZZJLPA2eWqRRU7BRhDH05TvZV_0 2024-09-12T01:04:39.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.550+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9795892891679200914', time=2024-09-12T02:51:27.270176+0000, chain.objs.size()=1 2024-09-12T01:04:39.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.550+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Rebbku_7mJgeN5k9ZvfLCZcQ6jJQTqn_0 2024-09-12T01:04:39.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.550+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13220112858703855588', time=2024-09-12T02:51:27.292500+0000, chain.objs.size()=1 2024-09-12T01:04:39.551 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.550+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.b0o6U1o8psXyi96LuFvV_h6v9gOP8lp_0 2024-09-12T01:04:39.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.550+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.701094502998872478', time=2024-09-12T02:51:27.323992+0000, chain.objs.size()=1 2024-09-12T01:04:39.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.550+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.r74deePeiW4ER7FLMSTE08g9aa0esFH_0 2024-09-12T01:04:39.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.550+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.116131219529183414', time=2024-09-12T02:51:27.326022+0000, chain.objs.size()=1 2024-09-12T01:04:39.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.550+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.cSjhu3ZUo6QRbyRvs15ijhcW16ppN7m_0 2024-09-12T01:04:39.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.550+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18038542383620059822', time=2024-09-12T02:51:27.418890+0000, chain.objs.size()=1 2024-09-12T01:04:39.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.550+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.gQi9Bt7vSOPEfma9fJdMth8YnqiL4dz_0 2024-09-12T01:04:39.552 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.550+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16120214558779910734', time=2024-09-12T02:51:27.427657+0000, chain.objs.size()=1 2024-09-12T01:04:39.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.550+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ZaMYdsY9VWuLV6N6fCrkESCC6j_pGNw_0 2024-09-12T01:04:39.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.550+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14475219487799107580', time=2024-09-12T02:51:27.429175+0000, chain.objs.size()=1 2024-09-12T01:04:39.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.550+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.WoTuNQnmRqXL-v4q97t4l4YsgLCrYTq_0 2024-09-12T01:04:39.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.550+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4031590126339793479', time=2024-09-12T02:51:27.471929+0000, chain.objs.size()=1 2024-09-12T01:04:39.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.550+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.tZZNW-jhChlhVs-QyC-K7hzcUysC6Am_0 2024-09-12T01:04:39.553 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8307802422288407616', time=2024-09-12T02:51:27.482350+0000, chain.objs.size()=1 2024-09-12T01:04:39.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.VOMSN0537AzZB0uVxKVARd2aw0iDyT7_0 2024-09-12T01:04:39.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4696728561096786618', time=2024-09-12T02:51:27.496930+0000, chain.objs.size()=1 2024-09-12T01:04:39.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_._O60ZqOcfX1DdYrAJ2073BaB2Xlxr6q_0 2024-09-12T01:04:39.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15894439679935468902', time=2024-09-12T02:51:27.510191+0000, chain.objs.size()=1 2024-09-12T01:04:39.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.F6pdP6bKf8gJF8Cs9JkpEA87306ikQO_0 2024-09-12T01:04:39.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16166927115338950481', time=2024-09-12T02:51:27.699906+0000, chain.objs.size()=1 2024-09-12T01:04:39.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ZxdNl5i7X3_12bgBAu3n8dubcVDqDqU_0 2024-09-12T01:04:39.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12354591562542766493', time=2024-09-12T02:51:27.870602+0000, chain.objs.size()=1 2024-09-12T01:04:39.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Ry8UJ2aW6a_jKEATV-UIIbnpRgtfKaJ_0 2024-09-12T01:04:39.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12650474978140392783', time=2024-09-12T02:51:27.904238+0000, chain.objs.size()=1 2024-09-12T01:04:39.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.H8xt0c4Qw4qohcKPFYq8auzupNwZBS0_0 2024-09-12T01:04:39.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4943195422857332846', time=2024-09-12T02:51:28.126645+0000, chain.objs.size()=1 2024-09-12T01:04:39.554 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.mN3n1gvsqp3oFuzFhLbCM3AFfalnB39_0 2024-09-12T01:04:39.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11489788313223177902', time=2024-09-12T02:51:28.150792+0000, chain.objs.size()=1 2024-09-12T01:04:39.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.j4Zv3jw1m82sr5e0MfuKJalBi1ovQkQ_0 2024-09-12T01:04:39.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.24664979014415048', time=2024-09-12T02:51:28.160096+0000, chain.objs.size()=1 2024-09-12T01:04:39.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.4Zj4lDCHjufNogIXGel8Z621Cx-eBXc_0 2024-09-12T01:04:39.555 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16872061116082661662', time=2024-09-12T02:51:28.173499+0000, chain.objs.size()=1 2024-09-12T01:04:39.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.n8WooZQMtH_jt7G6r4TAZQB2_XJiWWG_0 2024-09-12T01:04:39.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13009227742971228082', time=2024-09-12T02:51:28.179237+0000, chain.objs.size()=1 2024-09-12T01:04:39.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.2OKqy7G_bILXJ_FshbPW60o9OQlvESn_0 2024-09-12T01:04:39.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.841355192239458630', time=2024-09-12T02:51:28.191800+0000, chain.objs.size()=1 2024-09-12T01:04:39.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.E4azV3cbHEK2deedE8PMTkGtE4HD9xV_0 2024-09-12T01:04:39.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6581853821301073302', time=2024-09-12T02:51:28.365793+0000, chain.objs.size()=1 2024-09-12T01:04:39.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.hA-nA0n11Pqkpuz4ptVUYWB1150qFwN_0 2024-09-12T01:04:39.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5257670031200282287', time=2024-09-12T02:51:30.103519+0000, chain.objs.size()=1 2024-09-12T01:04:39.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.264__shadow_.UtGOljylQmjpU95xGj_cw3-93Tq9n4F_0 2024-09-12T01:04:39.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6106933172665837326', time=2024-09-12T02:51:46.267427+0000, chain.objs.size()=1 2024-09-12T01:04:39.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.286__shadow_.9c1XIaP1BNP_6-ZjoAMLP5ERHbglG3I_0 2024-09-12T01:04:39.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15075832966438535529', time=2024-09-12T02:51:48.521549+0000, chain.objs.size()=1 2024-09-12T01:04:39.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.289__shadow_._FO6ewZDfTXHpLAE9jv2FTh38IuStD8_0 2024-09-12T01:04:39.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4501771295162484078', time=2024-09-12T02:52:35.107865+0000, chain.objs.size()=1 2024-09-12T01:04:39.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.YO1hx_ntC75JQZ79bPO8qLtcRUGu8Ei_0 2024-09-12T01:04:39.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18121688060614143300', time=2024-09-12T02:52:35.125908+0000, chain.objs.size()=1 2024-09-12T01:04:39.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.D5bdU6pWamSCLAoeXKWAtDP3s4WJx3u_0 2024-09-12T01:04:39.557 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5882816385363758989', time=2024-09-12T02:52:35.385657+0000, chain.objs.size()=1 2024-09-12T01:04:39.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.554+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.GdPanZMnNagsfCjo3HQTvP8FeUAi6_Q_0 2024-09-12T01:04:39.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.558+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13578947503431962871', time=2024-09-12T02:52:35.396737+0000, chain.objs.size()=1 2024-09-12T01:04:39.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.558+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.TmCaqCWh-Ooawq8RghIPzv_9l3ZOhD5_0 2024-09-12T01:04:39.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.558+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3176833747435142816', time=2024-09-12T02:52:35.672217+0000, chain.objs.size()=1 2024-09-12T01:04:39.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.558+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.svxC5pfAalqlqPrs8HNe5CscdDGr6_A_0 2024-09-12T01:04:39.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.558+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8107977075624432248', time=2024-09-12T02:52:35.766636+0000, chain.objs.size()=1 2024-09-12T01:04:39.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.558+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.37wbPvUzossC5pxrgDvtEFvB15Htuh7_0 2024-09-12T01:04:39.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.558+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6363380557814792435', time=2024-09-12T02:52:35.810293+0000, chain.objs.size()=1 2024-09-12T01:04:39.558 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.558+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ZUgRFE_6B4O1xUuleeg6B_d2Fbz5ddc_0 2024-09-12T01:04:39.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.562+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12115581400033128690', time=2024-09-12T02:52:35.833824+0000, chain.objs.size()=1 2024-09-12T01:04:39.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.562+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.zHra6ijrFjWPp3H8qeAyXAsULrQbiox_0 2024-09-12T01:04:39.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.562+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9611002111428974005', time=2024-09-12T02:52:35.852172+0000, chain.objs.size()=1 2024-09-12T01:04:39.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.562+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.hPY5LoQSziw0v-mk9fTeZ992GmR5mgn_0 2024-09-12T01:04:39.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.562+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14744784127840861327', time=2024-09-12T02:52:35.882668+0000, chain.objs.size()=1 2024-09-12T01:04:39.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.562+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.VjJW2BYWGxfsgSQ8ZeaMWBvNcb82oX__0 2024-09-12T01:04:39.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.562+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7843108935321140730', time=2024-09-12T02:52:36.316752+0000, chain.objs.size()=1 2024-09-12T01:04:39.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.562+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.j1zEdtF2LYBeNiSgaEPHJKM5FMTf4MX_0 2024-09-12T01:04:39.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.562+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15307905639471838947', time=2024-09-12T02:52:36.322158+0000, chain.objs.size()=1 2024-09-12T01:04:39.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.562+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.qWz4L8bIavVFicB6G2Dw2TCYNcW1eqO_0 2024-09-12T01:04:39.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.562+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8716615731244718582', time=2024-09-12T02:52:36.380990+0000, chain.objs.size()=1 2024-09-12T01:04:39.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.562+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.cLEkgNn43sbzhQigXforPWXxT63bxIb_0 2024-09-12T01:04:39.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.562+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17260027560095196966', time=2024-09-12T02:52:36.505724+0000, chain.objs.size()=1 2024-09-12T01:04:39.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.562+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.vHuYI1Y3Lxkccz8US87WZCG2l-A3VBy_0 2024-09-12T01:04:39.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.562+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9196031536418444866', time=2024-09-12T02:52:36.799427+0000, chain.objs.size()=1 2024-09-12T01:04:39.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.562+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.U_U2gGmUhA1BYie0NyDw176tLrzUz0Q_0 2024-09-12T01:04:39.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.562+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13640864285889167446', time=2024-09-12T02:52:36.801937+0000, chain.objs.size()=1 2024-09-12T01:04:39.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.562+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.XXLsBSqZK4L25DAC4nDYYJ15xXQxglh_0 2024-09-12T01:04:39.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.562+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3291398747638842528', time=2024-09-12T02:52:36.824306+0000, chain.objs.size()=1 2024-09-12T01:04:39.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.562+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.8SIM6Ycotlq1O1BkWeiHedbqq7FEkP7_0 2024-09-12T01:04:39.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.562+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4265449369425078829', time=2024-09-12T02:52:37.034304+0000, chain.objs.size()=1 2024-09-12T01:04:39.563 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.562+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.kSPSE7XdCiCm-h-ub0trvJm0nKz5JWx_0 2024-09-12T01:04:39.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.562+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8571281915783673096', time=2024-09-12T02:52:37.064683+0000, chain.objs.size()=1 2024-09-12T01:04:39.564 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.562+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Y-skVem2WbVSpt4zs8CGXbBkXmiu7YQ_0 2024-09-12T01:04:39.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18172996551612948545', time=2024-09-12T02:52:57.025202+0000, chain.objs.size()=1 2024-09-12T01:04:39.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.hCOgVgHlwqQzJW8y3W7BQYlbXPA_g3d_0 2024-09-12T01:04:39.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14717102185569854397', time=2024-09-12T02:52:57.036167+0000, chain.objs.size()=1 2024-09-12T01:04:39.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.4b6clg7XwjdN5wYAqJBxU34r88c9zB-_0 2024-09-12T01:04:39.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15693247758473140236', time=2024-09-12T02:52:57.037639+0000, chain.objs.size()=1 2024-09-12T01:04:39.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.mTAazEF93CmzZnWm3ztekHs8blROIQL_0 2024-09-12T01:04:39.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3377496885565911580', time=2024-09-12T02:52:57.043761+0000, chain.objs.size()=1 2024-09-12T01:04:39.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.wZenO8vVEq8GrURD_ATdNEWHnMug2lP_0 2024-09-12T01:04:39.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10170659883071598552', time=2024-09-12T02:52:57.162967+0000, chain.objs.size()=1 2024-09-12T01:04:39.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.3rk0QrORsQkjf_32eQ7gSVywjkd14P-_0 2024-09-12T01:04:39.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16352027682760930507', time=2024-09-12T02:52:57.182676+0000, chain.objs.size()=1 2024-09-12T01:04:39.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Xlpzx46vxskrnWiUgpeTpXDJcb5vXHQ_0 2024-09-12T01:04:39.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12950862569778428787', time=2024-09-12T02:52:57.246428+0000, chain.objs.size()=1 2024-09-12T01:04:39.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.hHEc9hZ47g0ie1aH1KPdh8ddtyy3hfA_0 2024-09-12T01:04:39.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12961203155977840784', time=2024-09-12T02:52:57.256152+0000, chain.objs.size()=1 2024-09-12T01:04:39.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.8fQW_WXM-7Wa7oQ3Nwmt9NJJHqzF7q2_0 2024-09-12T01:04:39.566 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12776720518926225596', time=2024-09-12T02:52:57.269460+0000, chain.objs.size()=1 2024-09-12T01:04:39.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.O7Dkfci_FARzEYfhCtmr474qhP90YQA_0 2024-09-12T01:04:39.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13617731310075501645', time=2024-09-12T02:52:57.438999+0000, chain.objs.size()=1 2024-09-12T01:04:39.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_._YNA1ohO2VOjqu0NPekNf2jv-0s3Z2A_0 2024-09-12T01:04:39.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16582078462642612253', time=2024-09-12T02:52:57.485607+0000, chain.objs.size()=1 2024-09-12T01:04:39.567 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.AqW1hVeqEX3enzhLVCc1iEk6nQvoKsT_0 2024-09-12T01:04:39.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5943821762186141781', time=2024-09-12T02:52:57.513762+0000, chain.objs.size()=1 2024-09-12T01:04:39.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.cfcfYPmi2nXtUC9ptgzw5yylFEMKSfA_0 2024-09-12T01:04:39.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10429106275459864518', time=2024-09-12T02:52:57.517313+0000, chain.objs.size()=1 2024-09-12T01:04:39.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.xUyITaoPql8OWioTuRmAiERUQMf_rGh_0 2024-09-12T01:04:39.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9183932314852960367', time=2024-09-12T02:52:57.521517+0000, chain.objs.size()=1 2024-09-12T01:04:39.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.TxpHzr9eqIVrcgwv9e8MEE5EDJm8mEg_0 2024-09-12T01:04:39.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17221428998988234425', time=2024-09-12T02:52:57.633468+0000, chain.objs.size()=1 2024-09-12T01:04:39.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.SetH1vYIXU20YdHinr-UC1XdaiqYFIs_0 2024-09-12T01:04:39.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2046098748082851355', time=2024-09-12T02:52:57.654572+0000, chain.objs.size()=1 2024-09-12T01:04:39.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.WpDSyoiRwqb4TgP_CSHxcMpL1__VsTk_0 2024-09-12T01:04:39.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16197471699336479454', time=2024-09-12T02:52:57.679924+0000, chain.objs.size()=1 2024-09-12T01:04:39.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.hOiuW0DqcP5qYm8pMJsaREQ08Aus_aL_0 2024-09-12T01:04:39.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.897381954336335424', time=2024-09-12T02:52:57.728179+0000, chain.objs.size()=1 2024-09-12T01:04:39.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.4YO74tHS6fll_3RlDUFD8xZP9mLbwmL_0 2024-09-12T01:04:39.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2920559272580161908', time=2024-09-12T02:52:57.744898+0000, chain.objs.size()=1 2024-09-12T01:04:39.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.G34VNzBWO0fdPolrNPj6rV_kDirLThe_0 2024-09-12T01:04:39.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15734969682894138997', time=2024-09-12T02:52:57.861258+0000, chain.objs.size()=1 2024-09-12T01:04:39.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.jEAH5ItHmrdGagqf23AudrzMTel0DwT_0 2024-09-12T01:04:39.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13203982473842790479', time=2024-09-12T02:52:57.952844+0000, chain.objs.size()=1 2024-09-12T01:04:39.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Bv0DmtfgPzQtoAJBHsj7VYB6MELD6lm_0 2024-09-12T01:04:39.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1564936370053097070', time=2024-09-12T02:52:58.365580+0000, chain.objs.size()=1 2024-09-12T01:04:39.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.566+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.bm5SQzlUEmxrPrkAcNA_jeQ7EbahL0B_0 2024-09-12T01:04:39.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.570+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2325384250790757200', time=2024-09-12T02:52:58.380251+0000, chain.objs.size()=1 2024-09-12T01:04:39.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.570+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.yq4Io1P6gohKOLDb2V-Ldo_GxAmgMwM_0 2024-09-12T01:04:39.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.570+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6257687311483080921', time=2024-09-12T02:52:58.449147+0000, chain.objs.size()=1 2024-09-12T01:04:39.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.570+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.W-8O_tjcemaULXjf06QGq9GrbWXNjhq_0 2024-09-12T01:04:39.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.570+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15688566735770409166', time=2024-09-12T02:52:58.473760+0000, chain.objs.size()=1 2024-09-12T01:04:39.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.570+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.y4bToLVJ2iIu7ME7g8MKvEF-pN6DYNi_0 2024-09-12T01:04:39.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.570+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13283033567557898545', time=2024-09-12T02:52:58.505000+0000, chain.objs.size()=1 2024-09-12T01:04:39.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.570+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.fF3Rd4lKtwJAMaGG16jXB9kUkSimJs9_0 2024-09-12T01:04:39.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.570+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11801402777382632139', time=2024-09-12T02:52:58.505752+0000, chain.objs.size()=1 2024-09-12T01:04:39.571 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.570+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.l0ED6XgM4U7VjyNfloW4MgaWchPv-e-_0 2024-09-12T01:04:39.572 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.574+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16320052927886633094', time=2024-09-12T02:52:58.624396+0000, chain.objs.size()=1 2024-09-12T01:04:39.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.574+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.L4bGLltmdK88ZJjAzXmIY_XZOsEq1Dk_0 2024-09-12T01:04:39.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.574+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16219460480466201466', time=2024-09-12T02:52:58.694786+0000, chain.objs.size()=1 2024-09-12T01:04:39.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.574+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ClgSC5uot3WdxEbLugfdWczG7sYfWHN_0 2024-09-12T01:04:39.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.574+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7588707319233843747', time=2024-09-12T02:52:58.695551+0000, chain.objs.size()=1 2024-09-12T01:04:39.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.574+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.B6rF9Ln2ghDs03S5kgWcJr0UwNAIEJN_0 2024-09-12T01:04:39.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.574+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17329733620903465170', time=2024-09-12T02:53:13.261778+0000, chain.objs.size()=1 2024-09-12T01:04:39.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.574+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.346__shadow_.YEA8ajfWSvkH59T6p3r1UHPTNri030r_0 2024-09-12T01:04:39.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.574+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7650466833790356967', time=2024-09-12T02:53:27.586175+0000, chain.objs.size()=1 2024-09-12T01:04:39.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.574+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.370__shadow_.eu_OL-Sdo9YnazQYgWXjUJmAbOHAs3C_0 2024-09-12T01:04:39.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.574+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11758388489336434401', time=2024-09-12T02:54:35.637494+0000, chain.objs.size()=1 2024-09-12T01:04:39.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.574+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.457__shadow_.nbmX_Yapql2cExSWAj8aR8kEBE-jwP8_0 2024-09-12T01:04:39.573 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.574+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11696881997578311353', time=2024-09-12T02:54:40.886063+0000, chain.objs.size()=1 2024-09-12T01:04:39.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.574+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.462__shadow_.iDA9gFLB0BIIpSOSZ6aRFm02ZHtiC_l_0 2024-09-12T01:04:39.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.574+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~BVvjgTPwwu79sf3aGG53H_RasFk_4yx', time=2024-09-12T02:55:34.808418+0000, chain.objs.size()=1 2024-09-12T01:04:39.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.574+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.2~BVvjgTPwwu79sf3aGG53H_RasFk_4yx.3 2024-09-12T01:04:39.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.574+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8326171647239391428', time=2024-09-12T02:56:39.189871+0000, chain.objs.size()=1 2024-09-12T01:04:39.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.574+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.550__shadow_.u10vQkDaFUGtFOjPF6tI51NeyalvtlQ_0 2024-09-12T01:04:39.574 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.574+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3938799853010662551', time=2024-09-12T02:57:04.987262+0000, chain.objs.size()=1 2024-09-12T01:04:39.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.574+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.569__shadow:-dPQXEQ-hfwUXa4.R2DCEDDk1Q2w3tF_.jLAWfcnSX06yQxu3meAKK2f9PWtWrE9_0 2024-09-12T01:04:39.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.574+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17653885265723305079', time=2024-09-12T02:57:22.362952+0000, chain.objs.size()=1 2024-09-12T01:04:39.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.574+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.576__shadow:xyw1HCOIZoFDzzgmuEXNYHpkGZvLgkj_.LvdDryk4p8wSHT07Y6yRLzXfcdlaJEb_0 2024-09-12T01:04:39.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.574+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14221616988842912304', time=2024-09-12T02:57:38.552585+0000, chain.objs.size()=1 2024-09-12T01:04:39.575 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.574+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:xmeCKj2iYsp2zxvu2.a5WkxRGtnKVWi_.89RUvHfhfCnxJRTc8-TPX1LsWoM2xWb_0 2024-09-12T01:04:39.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.574+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11469590848121438952', time=2024-09-12T02:57:44.620760+0000, chain.objs.size()=1 2024-09-12T01:04:39.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.574+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.579__shadow:SZbFY--xEymgqdtJ8EFy5y3MwUvcruY_.apAeincXLhsZ0Tun1_HOy90ke5tnxvi_0 2024-09-12T01:04:39.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.574+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6224195426996154933', time=2024-09-12T03:00:58.657860+0000, chain.objs.size()=1 2024-09-12T01:04:39.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.574+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.656__shadow_.8HpIfMoVReLme-GYfcrg05UTscNw1vr_0 2024-09-12T01:04:39.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.574+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11995733123509639970', time=2024-09-12T03:01:30.340556+0000, chain.objs.size()=1 2024-09-12T01:04:39.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.574+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.701__shadow:wejT4TRaRLZjmQyzuC0RUQg159y-fz6_.Ang8_vpBDgEIQbLfPXafIrvmaqSUG1r_0 2024-09-12T01:04:39.578 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.578+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:39.581 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.582+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:04:39.582 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.582+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:39.583 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.582+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:39.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.582+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44815' 2024-09-12T01:04:39.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.582+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6351955490329066379', time=2024-09-12T02:48:56.248914+0000, chain.objs.size()=1 2024-09-12T01:04:39.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.582+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.188__shadow_.OSTmjcD4Jk8qz_XOUDoFhSSVVy7dYR7_0 2024-09-12T01:04:39.584 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.582+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16435881880284521787', time=2024-09-12T02:50:49.562307+0000, chain.objs.size()=1 2024-09-12T01:04:39.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.582+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.239__shadow_.XvsZ1cFhf8d8Y2yVQFoRjkFxBrGrXKD_0 2024-09-12T01:04:39.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.582+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11001772438754806968', time=2024-09-12T02:50:51.057027+0000, chain.objs.size()=1 2024-09-12T01:04:39.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.582+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.241__shadow_.7oR-TgbZOWv_3mFy03wLRcWE2WaLbSc_0 2024-09-12T01:04:39.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.582+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6195005604396987305', time=2024-09-12T02:50:56.706099+0000, chain.objs.size()=1 2024-09-12T01:04:39.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.582+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.247__shadow_.NF4gSBNm4nO3flzvrtWJ8QPzh9pcWPi_0 2024-09-12T01:04:39.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.582+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10127188737926496435', time=2024-09-12T02:50:58.156288+0000, chain.objs.size()=1 2024-09-12T01:04:39.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.582+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.249__shadow_.JIVAnCXNAE1ivn8QapcUlJJbzdZFfwL_0 2024-09-12T01:04:39.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.582+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11957596543437662666', time=2024-09-12T02:51:01.122338+0000, chain.objs.size()=1 2024-09-12T01:04:39.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.582+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.253__shadow_.PZ0bk-_au5fBhNXIoL10QMnTrIVnQwC_0 2024-09-12T01:04:39.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.582+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10778322145398354417', time=2024-09-12T02:51:06.285440+0000, chain.objs.size()=1 2024-09-12T01:04:39.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.582+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.260__shadow_.8GvWiircl-nHzwn1HznX-V9Pxgx8rxY_0 2024-09-12T01:04:39.585 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.582+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10945278988301951961', time=2024-09-12T02:51:26.744883+0000, chain.objs.size()=1 2024-09-12T01:04:39.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.582+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.gClkW3rDzqA5ld11EutO13L3asx31N2_0 2024-09-12T01:04:39.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.582+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13229527356807865447', time=2024-09-12T02:51:26.752124+0000, chain.objs.size()=1 2024-09-12T01:04:39.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.582+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.6dLWg69uPPMehWuYGCFX72Y5wmH_ty1_0 2024-09-12T01:04:39.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.582+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1987354517437575771', time=2024-09-12T02:51:26.782005+0000, chain.objs.size()=1 2024-09-12T01:04:39.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.582+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.r5vC9V2Uj5skDN_0EYDk7NnHR54ElZX_0 2024-09-12T01:04:39.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.582+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12528025384925523490', time=2024-09-12T02:51:26.834671+0000, chain.objs.size()=1 2024-09-12T01:04:39.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.582+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Q13rw90E8JxHwJ-bDegAqMvE7dj4mmB_0 2024-09-12T01:04:39.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.582+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6702709466664609757', time=2024-09-12T02:51:26.886420+0000, chain.objs.size()=1 2024-09-12T01:04:39.586 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.582+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.DOXDrjlNwDS40E_sgkMxnrQgdJBjcB5_0 2024-09-12T01:04:39.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.586+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18206833026170080172', time=2024-09-12T02:51:26.981449+0000, chain.objs.size()=1 2024-09-12T01:04:39.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.586+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Mbkvj35dGYMm5w86roakqJS6oBf2Gby_0 2024-09-12T01:04:39.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.586+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.231913244747173151', time=2024-09-12T02:51:27.000392+0000, chain.objs.size()=1 2024-09-12T01:04:39.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.586+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.I6Z_LOYDhJOC_xaewsRRKV4OpaKF7Av_0 2024-09-12T01:04:39.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.586+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9208559169291833306', time=2024-09-12T02:51:27.003598+0000, chain.objs.size()=1 2024-09-12T01:04:39.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.586+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.nSUOaqd4vZzS6jkeCzbmEAdZ02pjX7w_0 2024-09-12T01:04:39.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.586+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5480824433354285074', time=2024-09-12T02:51:27.018273+0000, chain.objs.size()=1 2024-09-12T01:04:39.587 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.586+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.71dwsT1Xg73vLTgDYCvSRo2dZn059Z5_0 2024-09-12T01:04:39.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8886571403911066070', time=2024-09-12T02:51:27.055627+0000, chain.objs.size()=1 2024-09-12T01:04:39.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.02VG2xpFItJh2RvxmksU3As0wS6TtLv_0 2024-09-12T01:04:39.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12714839515974085260', time=2024-09-12T02:51:27.073471+0000, chain.objs.size()=1 2024-09-12T01:04:39.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.x2N0QyHjpbjuIHibV1rp_051gMucltI_0 2024-09-12T01:04:39.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5038327025735485096', time=2024-09-12T02:51:27.081799+0000, chain.objs.size()=1 2024-09-12T01:04:39.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.GYClVi-Pul-JkC2FvgTYVBS3Lsznq5K_0 2024-09-12T01:04:39.589 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7064931713900009451', time=2024-09-12T02:51:27.205338+0000, chain.objs.size()=1 2024-09-12T01:04:39.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.TmLbxOfbNWy1nMBaqDrySLS0l-qeleP_0 2024-09-12T01:04:39.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11428703506801539999', time=2024-09-12T02:51:27.256070+0000, chain.objs.size()=1 2024-09-12T01:04:39.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.SuioLv5G6D3yEMmOImOAzvSLDvo0WWr_0 2024-09-12T01:04:39.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16022023476431181302', time=2024-09-12T02:51:27.299163+0000, chain.objs.size()=1 2024-09-12T01:04:39.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ExsmlWdBU0Sjn4QQhkg6Qo-UBU0WCv-_0 2024-09-12T01:04:39.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.70731225984586756', time=2024-09-12T02:51:27.302722+0000, chain.objs.size()=1 2024-09-12T01:04:39.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.AuZjUepsJU91UOas8U6kEDxWNn5_cJy_0 2024-09-12T01:04:39.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11735635752100510845', time=2024-09-12T02:51:27.312846+0000, chain.objs.size()=1 2024-09-12T01:04:39.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.sx1gABr2WoKDC_xvsVCUTo2bSY6fzr2_0 2024-09-12T01:04:39.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16621417299368264301', time=2024-09-12T02:51:27.315037+0000, chain.objs.size()=1 2024-09-12T01:04:39.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.qv0nkNwRJen6LWGv3MVfIqj3OkavURd_0 2024-09-12T01:04:39.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13693134335248357030', time=2024-09-12T02:51:27.417634+0000, chain.objs.size()=1 2024-09-12T01:04:39.590 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.yMJNTI8Fg3OPNoqkb0N_-pweDxnmR3G_0 2024-09-12T01:04:39.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12472345811374400465', time=2024-09-12T02:51:27.648939+0000, chain.objs.size()=1 2024-09-12T01:04:39.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.NmaKXvyFhcfmcidvCTWyq0Xzonwl7oW_0 2024-09-12T01:04:39.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18446300419443701176', time=2024-09-12T02:51:27.669470+0000, chain.objs.size()=1 2024-09-12T01:04:39.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.pHEVx-2pdubNFG0f66qxOBkYVk7lPJQ_0 2024-09-12T01:04:39.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3969274072008348526', time=2024-09-12T02:51:27.678957+0000, chain.objs.size()=1 2024-09-12T01:04:39.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.UUVnmUjEFQak2tGaLDmdfX42Tv8NQ4-_0 2024-09-12T01:04:39.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16067315779270544563', time=2024-09-12T02:51:27.692049+0000, chain.objs.size()=1 2024-09-12T01:04:39.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.CSiWYiL3lOzCNteS2u9DgAirdK6-2Qv_0 2024-09-12T01:04:39.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3114080283768912658', time=2024-09-12T02:51:27.736960+0000, chain.objs.size()=1 2024-09-12T01:04:39.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.619Qcs-7rRIzPbcUzx_JI6wqVVczqrX_0 2024-09-12T01:04:39.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18270973266171441805', time=2024-09-12T02:51:27.913610+0000, chain.objs.size()=1 2024-09-12T01:04:39.592 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Wjxm2jIcJfmTDSpMilw8CXdIKveJ1y4_0 2024-09-12T01:04:39.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16851283825858562294', time=2024-09-12T02:51:28.125829+0000, chain.objs.size()=1 2024-09-12T01:04:39.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.fAD3d9P6ZAHIBpU1ZNZttdumDaZJZwi_0 2024-09-12T01:04:39.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13806554417060477098', time=2024-09-12T02:51:28.200889+0000, chain.objs.size()=1 2024-09-12T01:04:39.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.XBIHTqT6fq_7-KBTBSb5NrdcF6wgBs7_0 2024-09-12T01:04:39.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11378049754330880818', time=2024-09-12T02:51:28.204377+0000, chain.objs.size()=1 2024-09-12T01:04:39.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.cJ80bkc_sUhtjwXDtLVNRtw0hQGlIEp_0 2024-09-12T01:04:39.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8397940096615323525', time=2024-09-12T02:51:28.218823+0000, chain.objs.size()=1 2024-09-12T01:04:39.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.TLyYeTrJp0qOQZQk3MzZG-YKe_Zq3vV_0 2024-09-12T01:04:39.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4268807405146134336', time=2024-09-12T02:51:28.238398+0000, chain.objs.size()=1 2024-09-12T01:04:39.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Q0zWOYBAtxCXqEBIbAU0tWhAxUJ5Zxu_0 2024-09-12T01:04:39.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13584056971802588324', time=2024-09-12T02:51:28.353405+0000, chain.objs.size()=1 2024-09-12T01:04:39.593 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.590+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.jHYKLJvMUILCXj8bZQcyRQZ5kizMoM-_0 2024-09-12T01:04:39.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.594+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12105655367321197425', time=2024-09-12T02:51:28.362519+0000, chain.objs.size()=1 2024-09-12T01:04:39.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.594+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.VK9C9YHp7fF4XigJwS-5D4RvslRPTD9_0 2024-09-12T01:04:39.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.594+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9353018984280964170', time=2024-09-12T02:51:28.374196+0000, chain.objs.size()=1 2024-09-12T01:04:39.594 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.594+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.zZMGx05Lh7385R5cHovPv6MWIv_SnPf_0 2024-09-12T01:04:39.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.594+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6679652740002044980', time=2024-09-12T02:51:28.638377+0000, chain.objs.size()=1 2024-09-12T01:04:39.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.594+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.R7YdFDUZkrc001iyDXOnmkLh35tKupF_0 2024-09-12T01:04:39.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.594+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6870182517153265', time=2024-09-12T02:51:28.646162+0000, chain.objs.size()=1 2024-09-12T01:04:39.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.594+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.7refHiX1ddeU8lSscloRigcAdJHEWot_0 2024-09-12T01:04:39.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.594+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9518370796083390943', time=2024-09-12T02:51:30.787632+0000, chain.objs.size()=1 2024-09-12T01:04:39.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.594+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.265__shadow_.OheaWbpceVmTWC_sZeRWuq07YwEop9G_0 2024-09-12T01:04:39.595 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.594+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11219780499955406292', time=2024-09-12T02:51:40.223776+0000, chain.objs.size()=1 2024-09-12T01:04:39.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.594+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.278__shadow_.Tk2fdgcCVh5wQacQsC8u_K7mHmP06uZ_0 2024-09-12T01:04:39.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.594+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7375782496833320128', time=2024-09-12T02:51:41.676911+0000, chain.objs.size()=1 2024-09-12T01:04:39.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.594+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.280__shadow_.w-RO-5VqgXy7uRIUs8duFPYi_WYrWNh_0 2024-09-12T01:04:39.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.594+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11194314958542067862', time=2024-09-12T02:51:51.743313+0000, chain.objs.size()=1 2024-09-12T01:04:39.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.594+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.292__shadow_.zQ2R2hJa7MyaupXdglmSXn_RdhPTQKZ_0 2024-09-12T01:04:39.596 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.594+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14597523489073248479', time=2024-09-12T02:51:51.749756+0000, chain.objs.size()=1 2024-09-12T01:04:39.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.594+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.292__shadow_.KlvRRL4zdUy-L0c9UG-q8aLdX2HxfM0_0 2024-09-12T01:04:39.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.594+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14518770195688476088', time=2024-09-12T02:51:53.175873+0000, chain.objs.size()=1 2024-09-12T01:04:39.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.594+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.293__shadow_.xDTnEF1gPsdtKUEw--R2whShlN5GA_9_0 2024-09-12T01:04:39.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.594+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1510382971509599905', time=2024-09-12T02:51:53.189071+0000, chain.objs.size()=1 2024-09-12T01:04:39.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.594+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.293__shadow_.09bN6yfb91IKSLo__QipSLScVmqt9UV_0 2024-09-12T01:04:39.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.594+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10226444482279875995', time=2024-09-12T02:51:58.472044+0000, chain.objs.size()=1 2024-09-12T01:04:39.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.594+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.300__shadow_.a-jTD0WudrtykyTA6zpyyglen1MrIqF_0 2024-09-12T01:04:39.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1943960020878658936', time=2024-09-12T02:52:34.841027+0000, chain.objs.size()=1 2024-09-12T01:04:39.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Fmn9GFWj5mjEw9vZZqss9HT-MopbwSF_0 2024-09-12T01:04:39.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7830037707805568047', time=2024-09-12T02:52:35.090676+0000, chain.objs.size()=1 2024-09-12T01:04:39.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.6oPAQBecrHXqgAv4qnaZvT98fsqimJg_0 2024-09-12T01:04:39.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9976014316090563504', time=2024-09-12T02:52:35.161282+0000, chain.objs.size()=1 2024-09-12T01:04:39.598 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.NjreLpRBiKNa9qIvwPIzACp3aKzuOUh_0 2024-09-12T01:04:39.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11301915191718679183', time=2024-09-12T02:52:35.161976+0000, chain.objs.size()=1 2024-09-12T01:04:39.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.OnrezXcy73QEgGkMLo4XvcwBRSbuhIN_0 2024-09-12T01:04:39.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8828086642860540564', time=2024-09-12T02:52:35.183502+0000, chain.objs.size()=1 2024-09-12T01:04:39.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.olUnlUzNqVzDNgvSvyXq3Y0KxfcEP80_0 2024-09-12T01:04:39.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1523900818989417516', time=2024-09-12T02:52:35.318859+0000, chain.objs.size()=1 2024-09-12T01:04:39.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.fZ_vE_EujmFmwCI2Wtt3sriFp5q4tn3_0 2024-09-12T01:04:39.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10567083183868568842', time=2024-09-12T02:52:35.373472+0000, chain.objs.size()=1 2024-09-12T01:04:39.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.aKligW5BIDhqvUZ7A5ShTpYq-jXzYPA_0 2024-09-12T01:04:39.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.502738611437452279', time=2024-09-12T02:52:35.379306+0000, chain.objs.size()=1 2024-09-12T01:04:39.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.K7RsgoeFC-fG8p_ADtejr-n3h1RNZHS_0 2024-09-12T01:04:39.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6404584260311459148', time=2024-09-12T02:52:35.403814+0000, chain.objs.size()=1 2024-09-12T01:04:39.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.VbXoWHoUBdB7kqYdEPRD8QHcnYFzFoA_0 2024-09-12T01:04:39.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8665988034397055650', time=2024-09-12T02:52:35.419009+0000, chain.objs.size()=1 2024-09-12T01:04:39.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.TqkReMWFh13P6SlAFr6h7seEUM_-zTx_0 2024-09-12T01:04:39.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11412808294715082920', time=2024-09-12T02:52:35.607635+0000, chain.objs.size()=1 2024-09-12T01:04:39.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.6mdWByITDSSw6W_ENwTVTVl6YlKuzkP_0 2024-09-12T01:04:39.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.978019153231121972', time=2024-09-12T02:52:35.612543+0000, chain.objs.size()=1 2024-09-12T01:04:39.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.0zF2OZnhfQCYAVu0P8KqNJjXRQh_HiH_0 2024-09-12T01:04:39.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15757056924772130606', time=2024-09-12T02:52:35.644358+0000, chain.objs.size()=1 2024-09-12T01:04:39.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.wqaXI1otr_DFGMqnOaElstrwUu9xL9F_0 2024-09-12T01:04:39.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2481574449847535294', time=2024-09-12T02:52:35.667729+0000, chain.objs.size()=1 2024-09-12T01:04:39.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_._ORWzstnlU7btp_r62sXXzkoigAxA2v_0 2024-09-12T01:04:39.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3610681877933901296', time=2024-09-12T02:52:35.837793+0000, chain.objs.size()=1 2024-09-12T01:04:39.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.8lfKDTDW7Jf7e0W4B3RTkofzVqT9084_0 2024-09-12T01:04:39.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9247050241558621839', time=2024-09-12T02:52:35.861819+0000, chain.objs.size()=1 2024-09-12T01:04:39.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.wbjZMKhcXsfKuQF7-GeShwifC-oegix_0 2024-09-12T01:04:39.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5822998131759358650', time=2024-09-12T02:52:35.869446+0000, chain.objs.size()=1 2024-09-12T01:04:39.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.598+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.TLe_WyNLQ47zjjyOvmifKTAh53SPSqG_0 2024-09-12T01:04:39.601 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5548857816797113007', time=2024-09-12T02:52:35.885153+0000, chain.objs.size()=1 2024-09-12T01:04:39.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.5ppWqhW8nhOnCGy_x2bnVaYzaILjTwo_0 2024-09-12T01:04:39.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4131591811418074366', time=2024-09-12T02:52:36.270357+0000, chain.objs.size()=1 2024-09-12T01:04:39.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.E2muaqRPpz9-liYl8ul0VXdmMHzGkEQ_0 2024-09-12T01:04:39.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12020886033954514307', time=2024-09-12T02:52:36.354959+0000, chain.objs.size()=1 2024-09-12T01:04:39.602 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.qFBcayEjcNMdudkyqOz3CI7X76ZuKlo_0 2024-09-12T01:04:39.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2111680310930833857', time=2024-09-12T02:52:36.387581+0000, chain.objs.size()=1 2024-09-12T01:04:39.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.XEfHkT8OtACDx2hPzUkevuMUC1gGsBa_0 2024-09-12T01:04:39.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3355344391886638760', time=2024-09-12T02:52:36.510749+0000, chain.objs.size()=1 2024-09-12T01:04:39.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.hzKK2fwAUX1Q9lX6wUXbwORoLJdfjlB_0 2024-09-12T01:04:39.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17739924564285462384', time=2024-09-12T02:52:36.607725+0000, chain.objs.size()=1 2024-09-12T01:04:39.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.EPolKBDJDvUJFYYMBUW9Syewn0htdTt_0 2024-09-12T01:04:39.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1168607709601090490', time=2024-09-12T02:52:36.639867+0000, chain.objs.size()=1 2024-09-12T01:04:39.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.kQYWclhYifdauWEl4ueq7sIPqnuo1ZK_0 2024-09-12T01:04:39.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7051884916349590096', time=2024-09-12T02:52:36.643181+0000, chain.objs.size()=1 2024-09-12T01:04:39.603 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.QqxFenJhgPV76Naah0qwH0Esy4ga51H_0 2024-09-12T01:04:39.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.29867397647147700', time=2024-09-12T02:52:36.764963+0000, chain.objs.size()=1 2024-09-12T01:04:39.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.C6six-MIvZgT7HZ9hGkRREbvNHToxzs_0 2024-09-12T01:04:39.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9080380467925579522', time=2024-09-12T02:52:36.810651+0000, chain.objs.size()=1 2024-09-12T01:04:39.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.0HMP06SGePpMoiQKwp3Udug7m9UFpJe_0 2024-09-12T01:04:39.604 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3550709302799447924', time=2024-09-12T02:52:36.820280+0000, chain.objs.size()=1 2024-09-12T01:04:39.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.q9K0oYzsrRMbX17wnLlK3_TloHeLNG1_0 2024-09-12T01:04:39.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11727430066969075545', time=2024-09-12T02:52:36.822079+0000, chain.objs.size()=1 2024-09-12T01:04:39.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.IA5QDoY78en7lMTMQhzZAQOdkcK5V2U_0 2024-09-12T01:04:39.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9615337405886242540', time=2024-09-12T02:52:36.842366+0000, chain.objs.size()=1 2024-09-12T01:04:39.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.vw_rIGmKz7th5U1EIJOpfypY70Dy6sW_0 2024-09-12T01:04:39.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9118782588576087535', time=2024-09-12T02:52:36.852649+0000, chain.objs.size()=1 2024-09-12T01:04:39.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.imlAZPzqwnd4Nevs4wx6tJThpZ77Hc-_0 2024-09-12T01:04:39.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2866844906758719973', time=2024-09-12T02:52:36.863964+0000, chain.objs.size()=1 2024-09-12T01:04:39.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.dI-6l8_aDJZysHI0_p4uKnVGfWjekH5_0 2024-09-12T01:04:39.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5624287614858115943', time=2024-09-12T02:52:37.012295+0000, chain.objs.size()=1 2024-09-12T01:04:39.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Wryxl6t0AVogIvlhae7szH6R50-qOkV_0 2024-09-12T01:04:39.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3674163975618898860', time=2024-09-12T02:52:37.091539+0000, chain.objs.size()=1 2024-09-12T01:04:39.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.iFjR4FW0PrcZKiIWuodvqYlXHtqbZkH_0 2024-09-12T01:04:39.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4279937970862220525', time=2024-09-12T02:52:37.093446+0000, chain.objs.size()=1 2024-09-12T01:04:39.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.vNoc9XmNVgHabUzn_ixoSfCDRA16zoS_0 2024-09-12T01:04:39.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8957384297190379963', time=2024-09-12T02:52:56.956570+0000, chain.objs.size()=1 2024-09-12T01:04:39.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.602+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Dl5dDwqw4dpk4BwJik5E3Z8Q7p-zrOQ_0 2024-09-12T01:04:39.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.606+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3962659497880147651', time=2024-09-12T02:52:57.008584+0000, chain.objs.size()=1 2024-09-12T01:04:39.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.606+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.W5AcmAvYbsNu9WWwj6aagmCC5ckERX9_0 2024-09-12T01:04:39.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.606+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6302662409178015199', time=2024-09-12T02:52:57.010942+0000, chain.objs.size()=1 2024-09-12T01:04:39.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.606+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ctSWUvA7SUOiVJbZrnUna0mKBZuJk-Z_0 2024-09-12T01:04:39.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.606+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10733355523887724936', time=2024-09-12T02:52:57.025403+0000, chain.objs.size()=1 2024-09-12T01:04:39.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.606+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.h9Wr7HOoOmcs6pcoCGvX_BBZTuMOhYs_0 2024-09-12T01:04:39.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.606+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9500328120051307117', time=2024-09-12T02:52:57.180121+0000, chain.objs.size()=1 2024-09-12T01:04:39.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.606+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ghxHaBobVYr1aoXBRvhLH05huS_eOlA_0 2024-09-12T01:04:39.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.606+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15678735178045923536', time=2024-09-12T02:52:57.231127+0000, chain.objs.size()=1 2024-09-12T01:04:39.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.606+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.MNkOjEKlBWFGHW-uKHOvpPkmT4IrXfv_0 2024-09-12T01:04:39.607 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.606+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7360317347482615347', time=2024-09-12T02:52:57.242975+0000, chain.objs.size()=1 2024-09-12T01:04:39.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.606+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.JobQCjfs0iu3UdDtDhlHRHjjGo6cSCk_0 2024-09-12T01:04:39.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.606+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17139571429273452078', time=2024-09-12T02:52:57.274596+0000, chain.objs.size()=1 2024-09-12T01:04:39.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.606+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.dV7At8TwpkziwIpF7XI6FLDexkguCxR_0 2024-09-12T01:04:39.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.606+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8902250777169476672', time=2024-09-12T02:52:57.436600+0000, chain.objs.size()=1 2024-09-12T01:04:39.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.606+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.AUxxQKIS2CuaSJBCxLZhhu_HbcGDZYa_0 2024-09-12T01:04:39.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.606+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18117127070301749018', time=2024-09-12T02:52:57.657642+0000, chain.objs.size()=1 2024-09-12T01:04:39.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.606+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Frw3JGJwhSMKVQ6qEc7R5reFM6tKmrr_0 2024-09-12T01:04:39.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.606+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11047994544865356057', time=2024-09-12T02:52:57.694343+0000, chain.objs.size()=1 2024-09-12T01:04:39.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.606+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.gMCv3S_ufBBBgy64ePX1bG-5VA_hUPk_0 2024-09-12T01:04:39.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.606+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5622949372033239074', time=2024-09-12T02:52:57.739658+0000, chain.objs.size()=1 2024-09-12T01:04:39.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.606+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.9MXewwB6PpaNwq7-j1Z7iJiZbQ8pbjH_0 2024-09-12T01:04:39.608 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.606+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11632194606673998503', time=2024-09-12T02:52:57.902996+0000, chain.objs.size()=1 2024-09-12T01:04:39.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.606+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.z7qRKkRi3R1snq7qNFLWprWM_mTER0i_0 2024-09-12T01:04:39.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.606+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7057942727362812126', time=2024-09-12T02:52:57.957451+0000, chain.objs.size()=1 2024-09-12T01:04:39.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.606+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.mtJlA0R1_Grt9eOKbNwP5qZiFkDEHYv_0 2024-09-12T01:04:39.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.606+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1836000740658809186', time=2024-09-12T02:52:57.961215+0000, chain.objs.size()=1 2024-09-12T01:04:39.609 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.606+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.A-k5WhX4096eqq-AzGebeZTcoJj_4iT_0 2024-09-12T01:04:39.610 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.610+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44815 2024-09-12T01:04:39.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.610+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-09-12T01:04:39.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.610+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16848190476010857202', time=2024-09-12T02:52:57.964000+0000, chain.objs.size()=1 2024-09-12T01:04:39.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.610+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.4dgcr8t83iH7Qq-io4yBCkjbgrGITCe_0 2024-09-12T01:04:39.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.610+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6253580111638944134', time=2024-09-12T02:52:57.971956+0000, chain.objs.size()=1 2024-09-12T01:04:39.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.610+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.zcUX36zkHA_nECrtQKo8--2dubzDtwW_0 2024-09-12T01:04:39.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.610+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5368928095456188821', time=2024-09-12T02:52:57.980613+0000, chain.objs.size()=1 2024-09-12T01:04:39.612 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.610+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_._KkFT2MD87IGiaUUY3j7fHIqokGf21u_0 2024-09-12T01:04:39.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.610+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7090889537579724948', time=2024-09-12T02:52:57.991096+0000, chain.objs.size()=1 2024-09-12T01:04:39.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.610+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.6EPeG3aYbLAf_9B0Y4BFIcGqaXV1fRN_0 2024-09-12T01:04:39.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.610+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2917573753025202852', time=2024-09-12T02:52:58.111554+0000, chain.objs.size()=1 2024-09-12T01:04:39.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.610+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.cHgT5mX4_R3S5gBejdHK4xU6gTvfKI6_0 2024-09-12T01:04:39.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.610+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5603613857778372964', time=2024-09-12T02:52:58.134872+0000, chain.objs.size()=1 2024-09-12T01:04:39.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.610+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.jVJlOYOQO0h_G3niR8PlIKDd2SPLy3C_0 2024-09-12T01:04:39.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.610+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10758158761128804577', time=2024-09-12T02:52:58.222750+0000, chain.objs.size()=1 2024-09-12T01:04:39.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.610+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.LScmSj1ehQjU3mE1LzeSZ8fPsHPCB3J_0 2024-09-12T01:04:39.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.610+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8911830705823382933', time=2024-09-12T02:52:58.248648+0000, chain.objs.size()=1 2024-09-12T01:04:39.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.610+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.phGk1Cayt46r2xScYFy8_zWz2fgiAZ1_0 2024-09-12T01:04:39.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.610+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.349796680763558244', time=2024-09-12T02:52:58.415062+0000, chain.objs.size()=1 2024-09-12T01:04:39.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.610+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.mPI6ow587ngSDhb-Afd0owxQ4zK02Gn_0 2024-09-12T01:04:39.613 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.610+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4819498436824250849', time=2024-09-12T02:52:58.416905+0000, chain.objs.size()=1 2024-09-12T01:04:39.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.610+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.x9RzFu5zP6rCFd7Enw91HiLWeFR-i4b_0 2024-09-12T01:04:39.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.610+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6593910771467640949', time=2024-09-12T02:52:58.436989+0000, chain.objs.size()=1 2024-09-12T01:04:39.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.610+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.sxXHO3PlZAP3i0zhxW31JRwUpkcQ6i1_0 2024-09-12T01:04:39.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.610+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2311195468334376999', time=2024-09-12T02:52:58.453924+0000, chain.objs.size()=1 2024-09-12T01:04:39.614 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.610+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.l7wT7gA5qDtih0ct4xljEgDO5cnMEzB_0 2024-09-12T01:04:39.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17287866048706726237', time=2024-09-12T02:52:58.464705+0000, chain.objs.size()=1 2024-09-12T01:04:39.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.JHqPqV2ir7TDPzeQzu_NXRl5295qKes_0 2024-09-12T01:04:39.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3459485027603237233', time=2024-09-12T02:52:58.479579+0000, chain.objs.size()=1 2024-09-12T01:04:39.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.-Q48z_P86Xh0hGi88b4KiRTGLvabFF4_0 2024-09-12T01:04:39.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6515607074482724538', time=2024-09-12T02:52:58.486375+0000, chain.objs.size()=1 2024-09-12T01:04:39.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.z5Q4XoBYqLX_al0wPhJ18s83mQUd-ol_0 2024-09-12T01:04:39.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5574761102555307310', time=2024-09-12T02:52:58.501231+0000, chain.objs.size()=1 2024-09-12T01:04:39.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.hxmv4Jrg28iS4ebOowLQJN0z9G6gbXL_0 2024-09-12T01:04:39.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17655803106035477542', time=2024-09-12T02:52:58.502670+0000, chain.objs.size()=1 2024-09-12T01:04:39.616 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.gb3_TGbyKTm5FmVUNELbVjrzt6nXlRM_0 2024-09-12T01:04:39.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.745362488924596122', time=2024-09-12T02:52:58.628584+0000, chain.objs.size()=1 2024-09-12T01:04:39.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ihOHYqAkBhStHu7dtJInuecKNG5ob2v_0 2024-09-12T01:04:39.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16053886187616843893', time=2024-09-12T02:52:58.629907+0000, chain.objs.size()=1 2024-09-12T01:04:39.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.TLCZVk4J3sCg_ElazdDMv8-_9SssPfo_0 2024-09-12T01:04:39.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.493282329417128399', time=2024-09-12T02:52:58.633540+0000, chain.objs.size()=1 2024-09-12T01:04:39.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.evZR2KHaKT1XnCyraqH1vG8NOdys8Id_0 2024-09-12T01:04:39.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7929047799582095325', time=2024-09-12T02:53:36.246481+0000, chain.objs.size()=1 2024-09-12T01:04:39.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.381__shadow_.33lqRS3diy5lTLqAhYrR3C_iS8T0FLX_0 2024-09-12T01:04:39.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11734523926690911931', time=2024-09-12T02:53:47.816807+0000, chain.objs.size()=1 2024-09-12T01:04:39.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.394__shadow:2URlohO2scly1bhqj8p503-3LCWeRzB_.5BxoBjjmjnHy9k9QJTqOc1YNd7XMYXu_0 2024-09-12T01:04:39.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16965381484866146081', time=2024-09-12T02:54:33.554699+0000, chain.objs.size()=1 2024-09-12T01:04:39.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.455__shadow_.4wwLUivctOd_JOL91bGq-50v5Wa5Sac_0 2024-09-12T01:04:39.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9542305487503706581', time=2024-09-12T02:54:53.304712+0000, chain.objs.size()=1 2024-09-12T01:04:39.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.483__shadow_.32R5BD7U4sNgE1gFLeyRFwIJrSYKZTR_0 2024-09-12T01:04:39.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6690961449470726137', time=2024-09-12T02:57:01.887118+0000, chain.objs.size()=1 2024-09-12T01:04:39.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.569__shadow:sP3EzqoBU1cyV3oZG04WWOyPzUO1RY8_.Dfq0EeJV_JHU-s25CE46PC3xjQ5yv1o_0 2024-09-12T01:04:39.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9228300011372234061', time=2024-09-12T02:57:02.596570+0000, chain.objs.size()=1 2024-09-12T01:04:39.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.569__shadow:pTntf6z2oAOZLJbBQB991nO6IIZ4KoL_.rsRCEIAI6tT4zZg34XU24PVSWLiks7M_0 2024-09-12T01:04:39.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15652409027973495391', time=2024-09-12T02:57:06.294377+0000, chain.objs.size()=1 2024-09-12T01:04:39.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.569__shadow:UzkhRpLkyKhOYAouu46FNpJcUhYCJgO_.MI7mkmF3w3HQdHIs8mfzIMT4ZJDlhiZ_0 2024-09-12T01:04:39.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4667332275656550311', time=2024-09-12T02:57:09.131144+0000, chain.objs.size()=1 2024-09-12T01:04:39.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.569__shadow:IUv.82ZhBFAyRvAqFiibwZOmk4XTLGQ_.GquEb49YnOEUNXFaoor_8-JifvTPu8B_0 2024-09-12T01:04:39.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6123393740016585703', time=2024-09-12T02:57:26.803354+0000, chain.objs.size()=1 2024-09-12T01:04:39.618 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.614+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:WmT4i4vVbMq9hIWIQJI3khew5O1bDi3_.i14LdV8rrX3Z6GhcWLEWIm8vdM6Zx7d_0 2024-09-12T01:04:39.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.618+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6832846387794036957', time=2024-09-12T03:02:18.729500+0000, chain.objs.size()=1 2024-09-12T01:04:39.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.618+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.740__shadow_.wBH9I4Wmg9j30esEi2VgL0-mN3auuN0_0 2024-09-12T01:04:39.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.618+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:39.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.622+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:04:39.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.622+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:39.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.622+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:39.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45713' 2024-09-12T01:04:39.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4867703630753252706', time=2024-09-12T02:48:22.906419+0000, chain.objs.size()=1 2024-09-12T01:04:39.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.147__shadow_.kpsZF2yDIzux46JmQ6L5l_Z4A0pKxAi_0 2024-09-12T01:04:39.625 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4981136885333134670', time=2024-09-12T02:51:26.776911+0000, chain.objs.size()=1 2024-09-12T01:04:39.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.YBsRfQtRs6IQBTwmGvXqvrdn_CAIbdq_0 2024-09-12T01:04:39.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1829359992795070341', time=2024-09-12T02:51:26.868882+0000, chain.objs.size()=1 2024-09-12T01:04:39.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.moE-PjhPcrdbo9ihmB94nP1L2bkuBvV_0 2024-09-12T01:04:39.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11435729565639057463', time=2024-09-12T02:51:26.984531+0000, chain.objs.size()=1 2024-09-12T01:04:39.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.GxNAYvBl5NVI6mN9NL_NwoypGuL3Qpu_0 2024-09-12T01:04:39.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16004030046879485672', time=2024-09-12T02:51:27.020338+0000, chain.objs.size()=1 2024-09-12T01:04:39.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.C1fvifCqTmLS1tUE70xckb7CkZiOvsv_0 2024-09-12T01:04:39.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3553297367265533034', time=2024-09-12T02:51:27.069852+0000, chain.objs.size()=1 2024-09-12T01:04:39.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.2ikHOWyc-ETV-g_QynBVwT32Kwzjk3r_0 2024-09-12T01:04:39.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17747957485152937481', time=2024-09-12T02:51:27.086267+0000, chain.objs.size()=1 2024-09-12T01:04:39.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Wp2lhvAwPZ1RZEFSzkaqAv9pnOHg1bA_0 2024-09-12T01:04:39.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4485122211631952743', time=2024-09-12T02:51:27.197163+0000, chain.objs.size()=1 2024-09-12T01:04:39.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.GqHjsW4pfwCA5H47deiGBrFl8-jhSZl_0 2024-09-12T01:04:39.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12550782803712434586', time=2024-09-12T02:51:27.307154+0000, chain.objs.size()=1 2024-09-12T01:04:39.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.qbV8SEz_MckYmHPMJb9bmwm8iPFEnqa_0 2024-09-12T01:04:39.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15534478572434675057', time=2024-09-12T02:51:27.316352+0000, chain.objs.size()=1 2024-09-12T01:04:39.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.OrvdyDweUmiW7NCeeHPsALwFayRCRjL_0 2024-09-12T01:04:39.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9893784846542314717', time=2024-09-12T02:51:27.330298+0000, chain.objs.size()=1 2024-09-12T01:04:39.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.wt7QxdIOlpdXpnSpgoQtZXZojlMaoKQ_0 2024-09-12T01:04:39.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15813124824387685068', time=2024-09-12T02:51:27.422642+0000, chain.objs.size()=1 2024-09-12T01:04:39.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Ei_SHFIyJ2g6ixxaezLdx9TXU4zzsQP_0 2024-09-12T01:04:39.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7821560610829363536', time=2024-09-12T02:51:27.454068+0000, chain.objs.size()=1 2024-09-12T01:04:39.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.2Kw9QNYdd6vlE3VgW4phQPoN93_zUaD_0 2024-09-12T01:04:39.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17318988205098623625', time=2024-09-12T02:51:27.477336+0000, chain.objs.size()=1 2024-09-12T01:04:39.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.2HwIrG_cjuYpsw_f46LVDPuDCJnMHgQ_0 2024-09-12T01:04:39.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.90671768427129692', time=2024-09-12T02:51:27.501553+0000, chain.objs.size()=1 2024-09-12T01:04:39.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.nx0_Uy3eXm2OwA6ATZjU5iAx2SnJBIl_0 2024-09-12T01:04:39.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15179730189421287811', time=2024-09-12T02:51:27.527853+0000, chain.objs.size()=1 2024-09-12T01:04:39.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.5Hde23Bn1ntp7qRs8nBo4KHpNWG-LH9_0 2024-09-12T01:04:39.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4065822902778055791', time=2024-09-12T02:51:27.698185+0000, chain.objs.size()=1 2024-09-12T01:04:39.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.LCEIbzdyHvvbTAeVX8j7VEWE51KEiyP_0 2024-09-12T01:04:39.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3286424760776812745', time=2024-09-12T02:51:27.702212+0000, chain.objs.size()=1 2024-09-12T01:04:39.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.bZb9lPP7ivMQHcsTNClQhd5l5pn2Pkp_0 2024-09-12T01:04:39.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9143059860006201610', time=2024-09-12T02:51:27.715524+0000, chain.objs.size()=1 2024-09-12T01:04:39.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.NXNIZoNJdaVFXcAhyG7Oz37WuPXsQnV_0 2024-09-12T01:04:39.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17581837881808500106', time=2024-09-12T02:51:27.727090+0000, chain.objs.size()=1 2024-09-12T01:04:39.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.OitOpVd4o0ggEQCTa2mlPU1AJlidkeP_0 2024-09-12T01:04:39.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1479516655436687025', time=2024-09-12T02:51:27.731277+0000, chain.objs.size()=1 2024-09-12T01:04:39.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.YKHlGvWU11NvRM5lFEaIkRt_jNX7Qmd_0 2024-09-12T01:04:39.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15272100856194388904', time=2024-09-12T02:51:27.842807+0000, chain.objs.size()=1 2024-09-12T01:04:39.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.sANZtg3LC9vo9NaoFcPUzckKHLmbKGC_0 2024-09-12T01:04:39.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13887179482577704197', time=2024-09-12T02:51:27.862659+0000, chain.objs.size()=1 2024-09-12T01:04:39.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.626+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.E03_cVZ7RSiI8dY-r0r4IZizX6I5wjW_0 2024-09-12T01:04:39.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.630+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18055640588952847024', time=2024-09-12T02:51:27.885313+0000, chain.objs.size()=1 2024-09-12T01:04:39.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.630+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.mDx7F9d0dy0m3rBXMZFcIceCR_Uzo8u_0 2024-09-12T01:04:39.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.630+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5744370870881171923', time=2024-09-12T02:51:27.921537+0000, chain.objs.size()=1 2024-09-12T01:04:39.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.630+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.TYq7IVWA8_WIfPVPMSE8JFb924NBRy8_0 2024-09-12T01:04:39.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.630+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2268101870948932712', time=2024-09-12T02:51:27.932418+0000, chain.objs.size()=1 2024-09-12T01:04:39.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.630+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.NDaDSvFhV7nyX-ENzaRA0Y8rVToWlOM_0 2024-09-12T01:04:39.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.630+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8519247082149100602', time=2024-09-12T02:51:28.152674+0000, chain.objs.size()=1 2024-09-12T01:04:39.631 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.630+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.9wqEmz1KogZIVqtAnfHsQ1l-069fn06_0 2024-09-12T01:04:39.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.630+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16299203750084869551', time=2024-09-12T02:51:28.184186+0000, chain.objs.size()=1 2024-09-12T01:04:39.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.630+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.TVBWjXAwgqVPQYSpv_Rw0CD4j8-Ncgu_0 2024-09-12T01:04:39.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.630+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10268189614738270327', time=2024-09-12T02:51:28.208267+0000, chain.objs.size()=1 2024-09-12T01:04:39.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.630+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ZUd-XapFaeCecAab21FG2usS_62spuS_0 2024-09-12T01:04:39.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.630+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6044939610624936642', time=2024-09-12T02:51:28.334020+0000, chain.objs.size()=1 2024-09-12T01:04:39.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.630+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.5os1JTt6YlGUbZtV95wtarcVeo38Igh_0 2024-09-12T01:04:39.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.630+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12706959750543917217', time=2024-09-12T02:51:28.358963+0000, chain.objs.size()=1 2024-09-12T01:04:39.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.630+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.RKC8AD0p3tBeC8AGNq8bYNBtmG71ine_0 2024-09-12T01:04:39.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.630+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18153235935348376567', time=2024-09-12T02:51:28.364312+0000, chain.objs.size()=1 2024-09-12T01:04:39.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.630+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.JHQQuJVzj2GgNxj7PcnpZbcB00bjIvp_0 2024-09-12T01:04:39.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.630+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17979056133585710089', time=2024-09-12T02:51:28.369628+0000, chain.objs.size()=1 2024-09-12T01:04:39.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.630+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.pWW3liY62Jfcjs1d6hdglemOw7-fegE_0 2024-09-12T01:04:39.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.630+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5488498457503536646', time=2024-09-12T02:51:28.384087+0000, chain.objs.size()=1 2024-09-12T01:04:39.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.630+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.i_ph_wNJZru9Rxl-BdazCRhj5sFk9ke_0 2024-09-12T01:04:39.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.630+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11328929306446262208', time=2024-09-12T02:51:28.391592+0000, chain.objs.size()=1 2024-09-12T01:04:39.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.630+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.tXcIh4OacEwiBFe3Ay0IV4OKph7ElYo_0 2024-09-12T01:04:39.633 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.630+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10942517543239276637', time=2024-09-12T02:51:28.397192+0000, chain.objs.size()=1 2024-09-12T01:04:39.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.630+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.x_tyglq1wCICVgn97g1YByG_Mc-DPHz_0 2024-09-12T01:04:39.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.630+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12979811178684214096', time=2024-09-12T02:51:28.619084+0000, chain.objs.size()=1 2024-09-12T01:04:39.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.630+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.aXXuB2744YwxKFt0rAWArQ3PlOCRUtp_0 2024-09-12T01:04:39.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2581627376434125214', time=2024-09-12T02:51:28.620854+0000, chain.objs.size()=1 2024-09-12T01:04:39.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.vcj4MkAGGVT39GCdw-pHYbwGWI44DEk_0 2024-09-12T01:04:39.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17874006211817236944', time=2024-09-12T02:51:28.628384+0000, chain.objs.size()=1 2024-09-12T01:04:39.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.SBfkuvofb8MB2-qs05HutN4KlXtRVK4_0 2024-09-12T01:04:39.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1450252686089361860', time=2024-09-12T02:51:35.086038+0000, chain.objs.size()=1 2024-09-12T01:04:39.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.271__shadow_.Ti3thihcvS4A1CqQ6tQv4P5QdAnDoAI_0 2024-09-12T01:04:39.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5118549050515176801', time=2024-09-12T02:51:50.282071+0000, chain.objs.size()=1 2024-09-12T01:04:39.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.291__shadow_.uw92Vnuy069ZHAQwIuTqMvNmYNGmaHc_0 2024-09-12T01:04:39.634 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2680058527858512322', time=2024-09-12T02:51:53.183223+0000, chain.objs.size()=1 2024-09-12T01:04:39.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.293__shadow_.sz6H2Mf0IxLNmmELijzdWf5kezsrlWv_0 2024-09-12T01:04:39.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12081159336462437599', time=2024-09-12T02:51:53.191459+0000, chain.objs.size()=1 2024-09-12T01:04:39.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.293__shadow_.1yDNM4OhMknLrs_f0pPNhzoklAcyzbU_0 2024-09-12T01:04:39.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12854993839517234322', time=2024-09-12T02:51:59.954502+0000, chain.objs.size()=1 2024-09-12T01:04:39.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.302__shadow_.B6NEywEeBWBMvZZDCFav3bSEqsS2NeI_0 2024-09-12T01:04:39.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2949908044572875590', time=2024-09-12T02:52:34.818814+0000, chain.objs.size()=1 2024-09-12T01:04:39.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.LBtxEfDg0N93NFkFY2jq1b3mGO_fxtl_0 2024-09-12T01:04:39.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2528376134117892706', time=2024-09-12T02:52:35.082644+0000, chain.objs.size()=1 2024-09-12T01:04:39.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.erCDIR6COfcdQJtbkzVxl_2N3EERlED_0 2024-09-12T01:04:39.636 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6300676858176559646', time=2024-09-12T02:52:35.126649+0000, chain.objs.size()=1 2024-09-12T01:04:39.636 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.n4p2u24PSR2mScy5ExHmo21EVaNdoR1_0 2024-09-12T01:04:39.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5254304872220207373', time=2024-09-12T02:52:35.296407+0000, chain.objs.size()=1 2024-09-12T01:04:39.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ENRTqq27urZYk4yvazSSKfYcaOH2Adj_0 2024-09-12T01:04:39.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9097487149442671521', time=2024-09-12T02:52:35.301066+0000, chain.objs.size()=1 2024-09-12T01:04:39.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.jLx5xl6Hxp-p4qtTmPaKhBByA7DI41z_0 2024-09-12T01:04:39.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12017274608212491165', time=2024-09-12T02:52:35.351584+0000, chain.objs.size()=1 2024-09-12T01:04:39.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.jDaesmS9r4oInNi0TOfKHeX_QQ6ZmeW_0 2024-09-12T01:04:39.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11717280427919959302', time=2024-09-12T02:52:35.388475+0000, chain.objs.size()=1 2024-09-12T01:04:39.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.FUodjS7fqAxJGDTtA5Wx7FzR7rr8KUf_0 2024-09-12T01:04:39.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18168999668867082368', time=2024-09-12T02:52:35.423890+0000, chain.objs.size()=1 2024-09-12T01:04:39.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.PinNvXafMp54-fk0FgxOiPdymD21avL_0 2024-09-12T01:04:39.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16138006619361595395', time=2024-09-12T02:52:35.546360+0000, chain.objs.size()=1 2024-09-12T01:04:39.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.gHMurO8UbtS_HWLpTwblk8Zjpfse6--_0 2024-09-12T01:04:39.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2664959338355020983', time=2024-09-12T02:52:35.562543+0000, chain.objs.size()=1 2024-09-12T01:04:39.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.DyIQCyE1Hw1AdMePVm5zA4RStwxJx-i_0 2024-09-12T01:04:39.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3748910806258284241', time=2024-09-12T02:52:35.627322+0000, chain.objs.size()=1 2024-09-12T01:04:39.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.MUeBCTR0JHl6m2MKlf7msanYhZcOYRo_0 2024-09-12T01:04:39.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7477863842825408387', time=2024-09-12T02:52:35.638818+0000, chain.objs.size()=1 2024-09-12T01:04:39.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.5ZapiPoD4YLOSyhkHMG02LjqSMcD5ey_0 2024-09-12T01:04:39.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13596391718332771951', time=2024-09-12T02:52:35.663089+0000, chain.objs.size()=1 2024-09-12T01:04:39.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.V4Mo5Fax0vVG7k9BXu4iN2kOVtFULyJ_0 2024-09-12T01:04:39.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.646337420479892816', time=2024-09-12T02:52:35.762658+0000, chain.objs.size()=1 2024-09-12T01:04:39.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.634+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.fwjk92DXaD0qG0WS72gZMMDC6myqX3P_0 2024-09-12T01:04:39.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4089771583016322271', time=2024-09-12T02:52:35.765585+0000, chain.objs.size()=1 2024-09-12T01:04:39.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ai3YjdqYIdYkE6LQpLs9Vm_vmKGqCNR_0 2024-09-12T01:04:39.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1700601154918924066', time=2024-09-12T02:52:35.837007+0000, chain.objs.size()=1 2024-09-12T01:04:39.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.VBe8dLqA5W5EaD84f00lhyla6Z3RAGi_0 2024-09-12T01:04:39.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10898810042046816887', time=2024-09-12T02:52:35.860316+0000, chain.objs.size()=1 2024-09-12T01:04:39.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.DVcv23H2ceZoOspoSYj1ceWBouV22dF_0 2024-09-12T01:04:39.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16855141511920049111', time=2024-09-12T02:52:35.879643+0000, chain.objs.size()=1 2024-09-12T01:04:39.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.QnXxjdw7Jbnyt1-DCB8F_u6BRwcXrBc_0 2024-09-12T01:04:39.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1222137218583554991', time=2024-09-12T02:52:35.891633+0000, chain.objs.size()=1 2024-09-12T01:04:39.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.PuELdshi7qkdVoPw1jmGnRwCZjMB8Wf_0 2024-09-12T01:04:39.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13688544433137380815', time=2024-09-12T02:52:36.321638+0000, chain.objs.size()=1 2024-09-12T01:04:39.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.VUREPAMWjJlWC1lUJKLinaaK8io4uc8_0 2024-09-12T01:04:39.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15167387550826939409', time=2024-09-12T02:52:36.529247+0000, chain.objs.size()=1 2024-09-12T01:04:39.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.kkLNplRq1cUCPl17Ck8Yjp7pkxzZnRR_0 2024-09-12T01:04:39.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17897457913205652452', time=2024-09-12T02:52:36.563444+0000, chain.objs.size()=1 2024-09-12T01:04:39.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_._yZvm1Fysz8TxZKSByMcnXDUfR1qteH_0 2024-09-12T01:04:39.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9721106710241497955', time=2024-09-12T02:52:36.601904+0000, chain.objs.size()=1 2024-09-12T01:04:39.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.33aGltuMMqZwVRTew0zGpkEFA7VBFOt_0 2024-09-12T01:04:39.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3039940437690083174', time=2024-09-12T02:52:36.607039+0000, chain.objs.size()=1 2024-09-12T01:04:39.641 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.p47ZwgoKuKqRW5uZzmFE46XCdiFgDBC_0 2024-09-12T01:04:39.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11917401758128903913', time=2024-09-12T02:52:36.613297+0000, chain.objs.size()=1 2024-09-12T01:04:39.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.J93Di7sq2R_oUYrTfI1KTw-aqVBPlAi_0 2024-09-12T01:04:39.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2469271050381480914', time=2024-09-12T02:52:36.624559+0000, chain.objs.size()=1 2024-09-12T01:04:39.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.IplViwi9jjRHbRrufwbgwrUKIOyqAUR_0 2024-09-12T01:04:39.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14712105931275627457', time=2024-09-12T02:52:36.852256+0000, chain.objs.size()=1 2024-09-12T01:04:39.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.UKUY-nsg5_S6-blOpxsMxFDOAcnuEzK_0 2024-09-12T01:04:39.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16025177654229217619', time=2024-09-12T02:52:36.855926+0000, chain.objs.size()=1 2024-09-12T01:04:39.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.OB5T2kXEKQiS180S3UOnEaTKpnJj8Yg_0 2024-09-12T01:04:39.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13765612713914094097', time=2024-09-12T02:52:37.036606+0000, chain.objs.size()=1 2024-09-12T01:04:39.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.toK7vCFySWUmPIkBgSHnaQpc_PSPK72_0 2024-09-12T01:04:39.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4044259242985543724', time=2024-09-12T02:52:37.040262+0000, chain.objs.size()=1 2024-09-12T01:04:39.642 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.9vRxgh_k8-Xb2W97cy3iIFmY9o8rzxO_0 2024-09-12T01:04:39.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9708831449473879234', time=2024-09-12T02:52:37.060533+0000, chain.objs.size()=1 2024-09-12T01:04:39.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.-z0EUma2T7mebqK99TxHH3LyEpmrPKj_0 2024-09-12T01:04:39.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2176675039214994155', time=2024-09-12T02:52:37.090592+0000, chain.objs.size()=1 2024-09-12T01:04:39.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.5p878rqcItjjb6onn55cA26oQGsP8tB_0 2024-09-12T01:04:39.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13493683643660929301', time=2024-09-12T02:52:37.094662+0000, chain.objs.size()=1 2024-09-12T01:04:39.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Om4csf8zihGNfwe5RsutqNG3i5mfnlK_0 2024-09-12T01:04:39.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8686676813242484170', time=2024-09-12T02:52:56.955483+0000, chain.objs.size()=1 2024-09-12T01:04:39.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.EwNraGjftiO-S-h96pCcUvoRSq4c6b7_0 2024-09-12T01:04:39.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17991260814603457318', time=2024-09-12T02:52:57.041802+0000, chain.objs.size()=1 2024-09-12T01:04:39.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.VGhrX0sBcXsFOp4bfnvp8ZZCmuNCoV0_0 2024-09-12T01:04:39.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16839643735594961901', time=2024-09-12T02:52:57.458199+0000, chain.objs.size()=1 2024-09-12T01:04:39.643 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.638+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.QhCEXS9K3HJzh37u_6n9p9B2UkLvNVu_0 2024-09-12T01:04:39.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.642+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4854965444050432622', time=2024-09-12T02:52:57.665658+0000, chain.objs.size()=1 2024-09-12T01:04:39.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.642+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.oOPSQBDs2KorktcV8ooiwvhDhCd800L_0 2024-09-12T01:04:39.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.642+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16147309904859628937', time=2024-09-12T02:52:57.682736+0000, chain.objs.size()=1 2024-09-12T01:04:39.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.642+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.KsSJO4x2QosLKnChKFhmiI6HZNhrc5u_0 2024-09-12T01:04:39.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.642+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7554639228162837452', time=2024-09-12T02:52:57.698359+0000, chain.objs.size()=1 2024-09-12T01:04:39.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.642+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.d0ZnBYqvGFsnza6DCVlCZpoEYvJ-wsz_0 2024-09-12T01:04:39.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.642+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15579475314786675122', time=2024-09-12T02:52:57.706259+0000, chain.objs.size()=1 2024-09-12T01:04:39.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.642+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.bNZt8Cfdu0ruvFzrUtVYrGHHwo4Nc_3_0 2024-09-12T01:04:39.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.642+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12331517106116461748', time=2024-09-12T02:52:57.744691+0000, chain.objs.size()=1 2024-09-12T01:04:39.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.642+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.GJUppOkTBt7CviTbcnVc9ilnwNj1T6g_0 2024-09-12T01:04:39.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.642+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1143864615257697567', time=2024-09-12T02:52:57.866366+0000, chain.objs.size()=1 2024-09-12T01:04:39.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.642+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.eKE-nyeLSCPtPrdrDd6hNVVMoYuoPIc_0 2024-09-12T01:04:39.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.642+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17608650213098518345', time=2024-09-12T02:52:57.920638+0000, chain.objs.size()=1 2024-09-12T01:04:39.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.642+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.0_PCfQV19JpS8PFfv2qv59IsET0dE8u_0 2024-09-12T01:04:39.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.642+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3013180947796228259', time=2024-09-12T02:52:57.929157+0000, chain.objs.size()=1 2024-09-12T01:04:39.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.642+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.cynHpmWzD9xdYggH3M30O7Vnkb4d7kJ_0 2024-09-12T01:04:39.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.642+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4816861851732913851', time=2024-09-12T02:52:57.943920+0000, chain.objs.size()=1 2024-09-12T01:04:39.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.642+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.4jEPeQPOBB2GYauAjOewOoMHnr9TY5b_0 2024-09-12T01:04:39.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.642+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9217254196761508710', time=2024-09-12T02:52:57.986497+0000, chain.objs.size()=1 2024-09-12T01:04:39.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.642+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.fhDC9IbV8FmF9xUbzm8LCn0-XlFUxA__0 2024-09-12T01:04:39.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.642+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3768081564278396191', time=2024-09-12T02:52:57.992119+0000, chain.objs.size()=1 2024-09-12T01:04:39.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.642+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.50PqcpG1PldONNSKi4HEDriXUusQqMu_0 2024-09-12T01:04:39.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.642+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10675887887771805144', time=2024-09-12T02:52:58.103463+0000, chain.objs.size()=1 2024-09-12T01:04:39.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.642+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.YTwo_XMYI4z2q3dXkJiQmLa2D1ylx0y_0 2024-09-12T01:04:39.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.646+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1290698923645345431', time=2024-09-12T02:52:58.156985+0000, chain.objs.size()=1 2024-09-12T01:04:39.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.646+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.f3YoEadOAjry5EZ1htJReNV5kNpu-Ml_0 2024-09-12T01:04:39.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.646+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16668048051192547919', time=2024-09-12T02:52:58.167744+0000, chain.objs.size()=1 2024-09-12T01:04:39.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.646+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.rm9m2O2NtgouamoCTXVZi3MEostVk36_0 2024-09-12T01:04:39.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.646+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12660784352568220878', time=2024-09-12T02:52:58.187981+0000, chain.objs.size()=1 2024-09-12T01:04:39.650 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.646+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.HevNFyljr638JYAtIMn30Ez47Virg8A_0 2024-09-12T01:04:39.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.646+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8183398835591222799', time=2024-09-12T02:52:58.220981+0000, chain.objs.size()=1 2024-09-12T01:04:39.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.646+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.vecpsQfGUH32tgnQROn1KVgU2e4iTxN_0 2024-09-12T01:04:39.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.646+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2248056876231856309', time=2024-09-12T02:52:58.228410+0000, chain.objs.size()=1 2024-09-12T01:04:39.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.646+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.LzAGTaSLlcumQkabFecZjPCJokGoAE7_0 2024-09-12T01:04:39.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.646+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11518599733357507406', time=2024-09-12T02:52:58.247091+0000, chain.objs.size()=1 2024-09-12T01:04:39.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.646+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.VYE2dJfYKRljS9fqV7fDLnOXIjcy49l_0 2024-09-12T01:04:39.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.646+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15265440989134117000', time=2024-09-12T02:52:58.248658+0000, chain.objs.size()=1 2024-09-12T01:04:39.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.646+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.-kTiQ3CqT5dQ9R6RmWGCoyThAVOEpc2_0 2024-09-12T01:04:39.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.646+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9432482986498205970', time=2024-09-12T02:52:58.422049+0000, chain.objs.size()=1 2024-09-12T01:04:39.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.646+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.x1DBZXi9h_hzW7Dc0tCqnxVBH0CC7IP_0 2024-09-12T01:04:39.651 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.650+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45713 2024-09-12T01:04:39.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.650+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T01:04:39.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.650+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3146583514882222000', time=2024-09-12T02:52:58.457250+0000, chain.objs.size()=1 2024-09-12T01:04:39.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.650+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.97_Nz6pu9fUgu2UaMEYfxebd8t23q23_0 2024-09-12T01:04:39.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.650+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6126547524822039121', time=2024-09-12T02:52:58.484003+0000, chain.objs.size()=1 2024-09-12T01:04:39.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.650+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.DDE1ISFrTLUVaVnGf-iQQ6lNmOKDN3l_0 2024-09-12T01:04:39.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.650+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3468185314301538840', time=2024-09-12T02:52:58.491632+0000, chain.objs.size()=1 2024-09-12T01:04:39.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.650+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.s_YFTPbewM_WCO8xEq7l_K0tsAD_saq_0 2024-09-12T01:04:39.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.650+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3842297711048320765', time=2024-09-12T02:52:58.590064+0000, chain.objs.size()=1 2024-09-12T01:04:39.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.650+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ZskUQcxMd5_i9jCfozpKHabN44JFZw8_0 2024-09-12T01:04:39.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.650+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6344813307552036587', time=2024-09-12T02:52:58.662029+0000, chain.objs.size()=1 2024-09-12T01:04:39.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.650+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.bf8vBW0MZhr0lCUlYrrnZGEZCe3C-Il_0 2024-09-12T01:04:39.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.650+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6473062483440639666', time=2024-09-12T02:52:58.665783+0000, chain.objs.size()=1 2024-09-12T01:04:39.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.650+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.jIrUvFmuBaek5PKJ0G5VufIGc6s-0LR_0 2024-09-12T01:04:39.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.650+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2109924181697790006', time=2024-09-12T02:52:58.682998+0000, chain.objs.size()=1 2024-09-12T01:04:39.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.650+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.YxY7LynGz7g2I9jcuQ9AOfiMWpuChmI_0 2024-09-12T01:04:39.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.650+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10991438526986802895', time=2024-09-12T02:53:02.498237+0000, chain.objs.size()=1 2024-09-12T01:04:39.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.650+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.330__shadow_.giw19djbcwe5V2Tuf9OcFLBpYqM72-0_0 2024-09-12T01:04:39.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.650+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9219825246581521507', time=2024-09-12T02:53:10.626454+0000, chain.objs.size()=1 2024-09-12T01:04:39.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.650+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.342__shadow_.uOitcaHiO2oSszrR90Rv0kTLa8RQNH8_0 2024-09-12T01:04:39.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.650+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5508376915707966546', time=2024-09-12T02:54:38.754580+0000, chain.objs.size()=1 2024-09-12T01:04:39.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.650+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.460__shadow_.fAxQ-ep76eI_JO5PbNek8DR6HJoaOfR_0 2024-09-12T01:04:39.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.650+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17766760584652960860', time=2024-09-12T02:54:54.113561+0000, chain.objs.size()=1 2024-09-12T01:04:39.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.650+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.484__shadow_.RrIa2zsSnyvKVnx8lr7JUluuiba9Xih_0 2024-09-12T01:04:39.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.650+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8967162989896230898', time=2024-09-12T02:55:27.423578+0000, chain.objs.size()=3 2024-09-12T01:04:39.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.650+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.521__multipart_mymultipart.2~s7bBx3PNfn7vdR24NFUuzVq1IyggfSH.1 2024-09-12T01:04:39.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.654+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.521__multipart_mymultipart.2~s7bBx3PNfn7vdR24NFUuzVq1IyggfSH.2 2024-09-12T01:04:39.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.654+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.521__multipart_mymultipart.2~s7bBx3PNfn7vdR24NFUuzVq1IyggfSH.3 2024-09-12T01:04:39.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.654+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9567876451861783234', time=2024-09-12T02:56:40.520882+0000, chain.objs.size()=1 2024-09-12T01:04:39.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.654+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.551__shadow_.puSoEBBCHdfgNLmMcGp6uF0zywx0u7B_0 2024-09-12T01:04:39.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.654+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2420230568971230665', time=2024-09-12T02:57:04.079360+0000, chain.objs.size()=1 2024-09-12T01:04:39.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.654+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.569__shadow:kbVQSCnzn5lGE3cWRVFK5I7pnwHGWaN_.WsqW-sGqCaYLva-5U5JxvY9QoEFXj1i_0 2024-09-12T01:04:39.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.654+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12444436691472955218', time=2024-09-12T02:57:05.393388+0000, chain.objs.size()=1 2024-09-12T01:04:39.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.654+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.569__shadow:j-pk9KVqvHYCznNbV6prt8zPR6bTfQV_.1I0c-cS-15gf_aMWnodh7SIOjQG3Ko-_0 2024-09-12T01:04:39.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.654+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11721524518032988927', time=2024-09-12T02:57:46.506135+0000, chain.objs.size()=1 2024-09-12T01:04:39.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.654+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.580__shadow:zRIZKMp0kS3eLjGXIXHWR8x5alkErB2_.tAFjdM4_W4FjfMT3CrCSpCD7k5Ewdpj_0 2024-09-12T01:04:39.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.654+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7768004861538880634', time=2024-09-12T02:57:58.184676+0000, chain.objs.size()=1 2024-09-12T01:04:39.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.654+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.596__shadow_.w8ddzrDkRBuO0yxkshpt67QOEUZDce7_0 2024-09-12T01:04:39.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.654+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14901162301907308223', time=2024-09-12T03:00:24.497220+0000, chain.objs.size()=1 2024-09-12T01:04:39.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.654+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.618__shadow_.ZzS2RURd27IwRx8c8rzg4EGTEWhk456_0 2024-09-12T01:04:39.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.654+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11766092541984520272', time=2024-09-12T03:02:02.539371+0000, chain.objs.size()=1 2024-09-12T01:04:39.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.654+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.719__shadow_.sLuraPT0dMPG61PhPr6gS20MSmaDzpl_0 2024-09-12T01:04:39.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.658+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:39.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.658+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:04:39.662 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.662+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:39.663 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.662+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:39.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.662+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53006' 2024-09-12T01:04:39.664 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.662+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18255140071750566913', time=2024-09-12T02:48:29.159853+0000, chain.objs.size()=1 2024-09-12T01:04:39.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.662+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.158__shadow_.jCVbPfWtEXmNlNvdc4yr1JbRSt94Yo2_0 2024-09-12T01:04:39.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.662+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11709558660540636634', time=2024-09-12T02:49:15.604005+0000, chain.objs.size()=1 2024-09-12T01:04:39.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.662+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.203__shadow_.bgkcObXca1h_4vnWZR83UQP8Gv4NvKZ_0 2024-09-12T01:04:39.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.662+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13336829972191662792', time=2024-09-12T02:50:47.633449+0000, chain.objs.size()=1 2024-09-12T01:04:39.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.662+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.237__shadow_.MuMWZv9CC-ZM9hfUJNYX-tkl1XMLR8I_0 2024-09-12T01:04:39.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.662+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9501438779368160052', time=2024-09-12T02:50:48.896550+0000, chain.objs.size()=1 2024-09-12T01:04:39.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.662+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.238__shadow_.gZ_GbT3nzAe0AUEQIDbceXnG3AuAkQ8_0 2024-09-12T01:04:39.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.662+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14176292943799353250', time=2024-09-12T02:51:01.119908+0000, chain.objs.size()=1 2024-09-12T01:04:39.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.662+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.253__shadow_.dD0BG7Pl7Ol65_tRZEJ0bBwLoEx-yxI_0 2024-09-12T01:04:39.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.662+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2381307602150820232', time=2024-09-12T02:51:26.867774+0000, chain.objs.size()=1 2024-09-12T01:04:39.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.662+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.EFYuA0N9miNrsdW5IKRBipIRG92EWfo_0 2024-09-12T01:04:39.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.662+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9655640393005342504', time=2024-09-12T02:51:26.981766+0000, chain.objs.size()=1 2024-09-12T01:04:39.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.662+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.P0YqaGCBA6IND-PpLFMQ3OE68Re7ek8_0 2024-09-12T01:04:39.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.662+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11041359842215409213', time=2024-09-12T02:51:27.023346+0000, chain.objs.size()=1 2024-09-12T01:04:39.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.662+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.cfDlSdiYwova5vbYiwyFM1Nq4xdmGnZ_0 2024-09-12T01:04:39.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.662+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16913405546431497112', time=2024-09-12T02:51:27.042383+0000, chain.objs.size()=1 2024-09-12T01:04:39.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.662+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.03MDV2M-_rh4KFdZ-53uVET09dooVga_0 2024-09-12T01:04:39.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.662+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10272772958382879886', time=2024-09-12T02:51:27.053742+0000, chain.objs.size()=1 2024-09-12T01:04:39.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.662+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.1TuSkQTvYbcZg_No6bRMrJPn5bgiFVY_0 2024-09-12T01:04:39.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.662+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12163443071199633243', time=2024-09-12T02:51:27.057919+0000, chain.objs.size()=1 2024-09-12T01:04:39.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.662+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.NWn-VXJf8otTMeYlS_XNsnYFo70BbJl_0 2024-09-12T01:04:39.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.662+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16025727579702754112', time=2024-09-12T02:51:27.082928+0000, chain.objs.size()=1 2024-09-12T01:04:39.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.662+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.l3mTpLY0JzT_RnmbRa4T5eEowvwR4hL_0 2024-09-12T01:04:39.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.666+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12015334320078083493', time=2024-09-12T02:51:27.246979+0000, chain.objs.size()=1 2024-09-12T01:04:39.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.666+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Bq2qqtyi5PEpSCsGmLrkzZ5Ji9ODVT8_0 2024-09-12T01:04:39.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4087961757681951608', time=2024-09-12T02:51:27.251655+0000, chain.objs.size()=1 2024-09-12T01:04:39.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.kp2CpnLsTkdbUa2SzKUvEcTES-AL0ug_0 2024-09-12T01:04:39.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3358871184635809172', time=2024-09-12T02:51:27.270322+0000, chain.objs.size()=1 2024-09-12T01:04:39.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ZblrI4WgaYUI86VzxUpjbLrKGsCKQq__0 2024-09-12T01:04:39.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16827726712262910828', time=2024-09-12T02:51:27.284881+0000, chain.objs.size()=1 2024-09-12T01:04:39.669 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.3cEhziSPKAPQos90TUxvsvhh2uYH7sM_0 2024-09-12T01:04:39.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11320727087380558050', time=2024-09-12T02:51:27.297118+0000, chain.objs.size()=1 2024-09-12T01:04:39.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.DffFeFL8ougRFrXhT4L8i1XxAS59RHU_0 2024-09-12T01:04:39.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4405515495124606375', time=2024-09-12T02:51:27.325252+0000, chain.objs.size()=1 2024-09-12T01:04:39.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.HqLgo7SV1UKVI0KKhxPhZacLd6zrmYC_0 2024-09-12T01:04:39.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12563049128730685180', time=2024-09-12T02:51:27.329490+0000, chain.objs.size()=1 2024-09-12T01:04:39.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ZY1M449qarHmusSRaCnZMrQ3LCE0dl7_0 2024-09-12T01:04:39.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7051399765932217442', time=2024-09-12T02:51:27.420481+0000, chain.objs.size()=1 2024-09-12T01:04:39.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.h9Yswx88kv_iGf9RI1_5sJu8dEtufjo_0 2024-09-12T01:04:39.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7280293146149669902', time=2024-09-12T02:51:27.440933+0000, chain.objs.size()=1 2024-09-12T01:04:39.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Cf31uueC4jUlQwrcNbKXTtVjxRogI8L_0 2024-09-12T01:04:39.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13269688686207066913', time=2024-09-12T02:51:27.473346+0000, chain.objs.size()=1 2024-09-12T01:04:39.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.up0aBT3fkPUgnUdUUJO3K4WVVHOB8DJ_0 2024-09-12T01:04:39.670 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18164169036250308953', time=2024-09-12T02:51:27.495640+0000, chain.objs.size()=1 2024-09-12T01:04:39.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ryccK8TuUMQLBd7xdsWkKj11RdEMXZ6_0 2024-09-12T01:04:39.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18277116747420235364', time=2024-09-12T02:51:27.667386+0000, chain.objs.size()=1 2024-09-12T01:04:39.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.wzX-9mLmxy3gsYtiTxAL8KG4qew8gVG_0 2024-09-12T01:04:39.671 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17118678947125036984', time=2024-09-12T02:51:27.694349+0000, chain.objs.size()=1 2024-09-12T01:04:39.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.b-G-2BLTcFtzEmfNxh-TFNhbZ2XriPJ_0 2024-09-12T01:04:39.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8777280301892693921', time=2024-09-12T02:51:27.868925+0000, chain.objs.size()=1 2024-09-12T01:04:39.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.u4BVBOMjzp8EqhKRsyobQicYwKbP1mI_0 2024-09-12T01:04:39.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18028027770426438064', time=2024-09-12T02:51:27.884065+0000, chain.objs.size()=1 2024-09-12T01:04:39.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.t6OLK00uee4NV5kvD6SdEiNrKNozUiV_0 2024-09-12T01:04:39.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12368798693243033932', time=2024-09-12T02:51:27.908858+0000, chain.objs.size()=1 2024-09-12T01:04:39.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.XYlijuHUehdzvj08vnGQXzygzdN4FLv_0 2024-09-12T01:04:39.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18087866365155129219', time=2024-09-12T02:51:27.910053+0000, chain.objs.size()=1 2024-09-12T01:04:39.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.7CoyvdhoTAsxKRsUuc7DukbVqXGklQ4_0 2024-09-12T01:04:39.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1653018806988857576', time=2024-09-12T02:51:28.144427+0000, chain.objs.size()=1 2024-09-12T01:04:39.672 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.H0yPpdXftJH3wUe2PMF6YGVNYiSs1nC_0 2024-09-12T01:04:39.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5926473063810498041', time=2024-09-12T02:51:28.224822+0000, chain.objs.size()=1 2024-09-12T01:04:39.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.j3ZMh3t-U5rKMDeIMLFpu_mRr0UFgrH_0 2024-09-12T01:04:39.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1034584714601688266', time=2024-09-12T02:51:28.236680+0000, chain.objs.size()=1 2024-09-12T01:04:39.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.xaSllcoF8SReNb_FxbvapAmm13hXe5j_0 2024-09-12T01:04:39.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12243300598579903193', time=2024-09-12T02:51:28.245482+0000, chain.objs.size()=1 2024-09-12T01:04:39.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Nc2k46fb2lqdrEvWOmDYRQ4D2qM73xU_0 2024-09-12T01:04:39.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7812801478323648823', time=2024-09-12T02:51:28.335648+0000, chain.objs.size()=1 2024-09-12T01:04:39.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.S-F-2vWPmrOSDMbN2PCV01wcBezXLtt_0 2024-09-12T01:04:39.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11210488379312227897', time=2024-09-12T02:51:28.353570+0000, chain.objs.size()=1 2024-09-12T01:04:39.673 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.670+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.AYLUKeirRyVfRqfZLWMpDUagPNeP755_0 2024-09-12T01:04:39.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.674+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4298311048429017019', time=2024-09-12T02:51:28.634569+0000, chain.objs.size()=1 2024-09-12T01:04:39.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.674+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.2heEgONlegNiSMbr09PDCr17-bBCEt7_0 2024-09-12T01:04:39.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.674+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.352922150775555663', time=2024-09-12T02:51:28.655016+0000, chain.objs.size()=1 2024-09-12T01:04:39.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.674+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.A6ighQZWwHZv4d2_uWrGCoZOQYW6JcQ_0 2024-09-12T01:04:39.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.674+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12658116656637821269', time=2024-09-12T02:51:28.662115+0000, chain.objs.size()=1 2024-09-12T01:04:39.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.674+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.S_5uvam77mvuRyCwb0b0_gVYZXtDB83_0 2024-09-12T01:04:39.674 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.674+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1817956232808838951', time=2024-09-12T02:51:35.086027+0000, chain.objs.size()=1 2024-09-12T01:04:39.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.674+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.271__shadow_.Lips-kX632E_2EUNUby4BfkiWVuE2pe_0 2024-09-12T01:04:39.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.674+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9868076386320217480', time=2024-09-12T02:51:35.831320+0000, chain.objs.size()=1 2024-09-12T01:04:39.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.674+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.272__shadow_.GEzsY7LnSyCoCRWlxbXCsTPhmF6zg-d_0 2024-09-12T01:04:39.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.674+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2715383525174738111', time=2024-09-12T02:51:49.264202+0000, chain.objs.size()=1 2024-09-12T01:04:39.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.674+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.290__shadow_.V8Q5IF7LqIqBK_qWTgwQn_oIFE_xixs_0 2024-09-12T01:04:39.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.674+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10918656253384444539', time=2024-09-12T02:51:51.749880+0000, chain.objs.size()=1 2024-09-12T01:04:39.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.674+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.292__shadow_.gnS2G7zj2qSjxks6Y3oDzvJxqs90LNN_0 2024-09-12T01:04:39.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.674+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9473272590777471181', time=2024-09-12T02:51:53.155281+0000, chain.objs.size()=1 2024-09-12T01:04:39.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.674+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.293__shadow_.aO4ZccN1lLK8KaafngiAoqWTexqjxda_0 2024-09-12T01:04:39.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.674+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1857463732072585972', time=2024-09-12T02:51:53.188368+0000, chain.objs.size()=1 2024-09-12T01:04:39.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.674+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.293__shadow_.4iFxUJAgznBZL3K-o1cr-bcypQIElG0_0 2024-09-12T01:04:39.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.674+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4227764954163499293', time=2024-09-12T02:52:35.116743+0000, chain.objs.size()=1 2024-09-12T01:04:39.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.674+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.xbFxz61GwARrgaDqWvIPniq9xIb-TxD_0 2024-09-12T01:04:39.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.674+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3423366685637127401', time=2024-09-12T02:52:35.122441+0000, chain.objs.size()=1 2024-09-12T01:04:39.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.674+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.vlyOcEmhlO7CxwNkOutnpGWUnclvuI-_0 2024-09-12T01:04:39.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.674+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13978771431326489824', time=2024-09-12T02:52:35.144293+0000, chain.objs.size()=1 2024-09-12T01:04:39.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.674+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.0qJu4kA_M4Ru_fGJah7xD1XQbrR8MUR_0 2024-09-12T01:04:39.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.674+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1097607343827230603', time=2024-09-12T02:52:35.160273+0000, chain.objs.size()=1 2024-09-12T01:04:39.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.674+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.KvG1wVHe8Y6FWD8eCgeyNZF232GMq7L_0 2024-09-12T01:04:39.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.674+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13179968086533146752', time=2024-09-12T02:52:35.302386+0000, chain.objs.size()=1 2024-09-12T01:04:39.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.674+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.7crJ3K9DJ4dNcjK-k_RjJN2rsQY2T29_0 2024-09-12T01:04:39.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.674+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7037158354682218764', time=2024-09-12T02:52:35.317563+0000, chain.objs.size()=1 2024-09-12T01:04:39.677 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.674+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.teOwRWmpUqd28DpR3MaeQ7riM9xqyG-_0 2024-09-12T01:04:39.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.678+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16375315484767255796', time=2024-09-12T02:52:35.357965+0000, chain.objs.size()=1 2024-09-12T01:04:39.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.678+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.SswSQpeX7k1s_qSDLGSxDeJbvEAeME-_0 2024-09-12T01:04:39.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.678+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2241154575697944782', time=2024-09-12T02:52:35.540371+0000, chain.objs.size()=1 2024-09-12T01:04:39.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.678+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.CGgIFYYtfkWKnK9fbJHnUTOU8CwuIAG_0 2024-09-12T01:04:39.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.678+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5440331763962656173', time=2024-09-12T02:52:35.545469+0000, chain.objs.size()=1 2024-09-12T01:04:39.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.678+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.nrRCFf00mRg4AHBeUTEoz85iZDi5PvP_0 2024-09-12T01:04:39.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.678+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12491218588674138688', time=2024-09-12T02:52:35.559313+0000, chain.objs.size()=1 2024-09-12T01:04:39.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.678+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.40Na-qignDBlKK3kM3ZQAAQIusHdHRl_0 2024-09-12T01:04:39.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.678+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13048888131382225985', time=2024-09-12T02:52:35.596252+0000, chain.objs.size()=1 2024-09-12T01:04:39.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.678+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.guzAgg1C7ZO4xq5B-kfmwIQACD-31Cp_0 2024-09-12T01:04:39.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.678+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3008698918928007140', time=2024-09-12T02:52:35.632973+0000, chain.objs.size()=1 2024-09-12T01:04:39.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.678+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.p3i6HSi_XnO-mULqOi1JUN-XFE0saeg_0 2024-09-12T01:04:39.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.678+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14263616297307440069', time=2024-09-12T02:52:35.645523+0000, chain.objs.size()=1 2024-09-12T01:04:39.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.678+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Q3WnYD8oXkn-4OL6cfeSsx4riDcdfjQ_0 2024-09-12T01:04:39.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.678+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14958478199936203135', time=2024-09-12T02:52:35.797501+0000, chain.objs.size()=1 2024-09-12T01:04:39.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.678+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.kqjnH-hUXM5HUwGxUM1M0Hk1AO2Fxe3_0 2024-09-12T01:04:39.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.678+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6434995016375741261', time=2024-09-12T02:52:35.808898+0000, chain.objs.size()=1 2024-09-12T01:04:39.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.678+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.2C1X0CEmroztL-d43JtKJI2z5ol6iEN_0 2024-09-12T01:04:39.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.678+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9842461679525413670', time=2024-09-12T02:52:35.819711+0000, chain.objs.size()=1 2024-09-12T01:04:39.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.678+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Gpi8fjSWznmMZvZ93o-Pkf4FYIZGRVo_0 2024-09-12T01:04:39.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.678+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15406241098276040375', time=2024-09-12T02:52:35.877865+0000, chain.objs.size()=1 2024-09-12T01:04:39.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.678+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.f8mBxzGFUPVgz-FFE81WrUhfcFu7nDO_0 2024-09-12T01:04:39.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.678+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4231278374427348874', time=2024-09-12T02:52:36.384595+0000, chain.objs.size()=1 2024-09-12T01:04:39.680 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.678+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.H57MjTK6nO_Y4B3kmwDYdxU1BHf44sK_0 2024-09-12T01:04:39.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.678+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8297593888039367848', time=2024-09-12T02:52:36.563617+0000, chain.objs.size()=1 2024-09-12T01:04:39.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.678+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.dk3TZdZRewwzqb0uCvX5gnWHPfusKSl_0 2024-09-12T01:04:39.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.678+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9587816921289310768', time=2024-09-12T02:52:36.582288+0000, chain.objs.size()=1 2024-09-12T01:04:39.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.678+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.6AXPygxCsUnsqMaUYMfHtLB653xRGiL_0 2024-09-12T01:04:39.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.678+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15155371791866560755', time=2024-09-12T02:52:36.788643+0000, chain.objs.size()=1 2024-09-12T01:04:39.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.678+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.YPPdA668ITSomiKmbCQAysgXzujRwC9_0 2024-09-12T01:04:39.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.682+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4185982244742178367', time=2024-09-12T02:52:36.802981+0000, chain.objs.size()=1 2024-09-12T01:04:39.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.682+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.v3nzB0gHyjD7aCyfst00dVYXSRCm-Bt_0 2024-09-12T01:04:39.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.682+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7446858499720651934', time=2024-09-12T02:52:36.855879+0000, chain.objs.size()=1 2024-09-12T01:04:39.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.682+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.7RDqk2TbJzkAvFFeoOErqqiveI12Oo0_0 2024-09-12T01:04:39.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.682+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6325417197276871370', time=2024-09-12T02:52:36.998706+0000, chain.objs.size()=1 2024-09-12T01:04:39.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.682+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.JLk5t7UGmP3MfAP0QWoT_2LtHU5ESSg_0 2024-09-12T01:04:39.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.682+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7931037387884419324', time=2024-09-12T02:52:37.032743+0000, chain.objs.size()=1 2024-09-12T01:04:39.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.682+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.RAcvb7ayeEdJZMYtRmEqMsAaQNS2y3E_0 2024-09-12T01:04:39.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.682+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2682624580444954182', time=2024-09-12T02:52:37.042585+0000, chain.objs.size()=1 2024-09-12T01:04:39.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.682+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Y3Giz4d2QiVtIdzGb9HxDUKi2pFfGmS_0 2024-09-12T01:04:39.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.682+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7052560032509534677', time=2024-09-12T02:52:37.054667+0000, chain.objs.size()=1 2024-09-12T01:04:39.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.682+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_._VG31ykT-haU27yZD0R9VD1HsyY_cGX_0 2024-09-12T01:04:39.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.682+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5797195026897296797', time=2024-09-12T02:52:56.905482+0000, chain.objs.size()=1 2024-09-12T01:04:39.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.682+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.JEHumyiOKD4W6Avu_O5a0h6C6W8AvUl_0 2024-09-12T01:04:39.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.682+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12503074199935718514', time=2024-09-12T02:52:56.929043+0000, chain.objs.size()=1 2024-09-12T01:04:39.683 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.682+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.4hnO6oIEpbQB9Nsixkda7OPOWZluTS5_0 2024-09-12T01:04:39.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.682+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13350473091962905705', time=2024-09-12T02:52:56.981510+0000, chain.objs.size()=1 2024-09-12T01:04:39.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.682+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Dg8cWzeu-bOrExBSVhKbwJVn1B0k0xA_0 2024-09-12T01:04:39.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.682+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12855703839674537435', time=2024-09-12T02:52:57.002376+0000, chain.objs.size()=1 2024-09-12T01:04:39.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.682+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.fx_MjHGZsP8VzAPnHj37WVb6nXjaiEP_0 2024-09-12T01:04:39.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.682+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2139355039747819160', time=2024-09-12T02:52:57.170061+0000, chain.objs.size()=1 2024-09-12T01:04:39.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.682+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ytj9VKECB6cysNL6f-mGCOvvT-EJVOP_0 2024-09-12T01:04:39.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.682+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16379466738435685425', time=2024-09-12T02:52:57.188140+0000, chain.objs.size()=1 2024-09-12T01:04:39.684 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.682+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.iVjYq9GAA5i8JqqGdEh-OX2zrTU5H9S_0 2024-09-12T01:04:39.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.686+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12094414424376811136', time=2024-09-12T02:52:57.195823+0000, chain.objs.size()=1 2024-09-12T01:04:39.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.686+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.frrvvUkKRh6iB_d7hBu2isCIo1hgWfn_0 2024-09-12T01:04:39.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.686+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6102444014096095441', time=2024-09-12T02:52:57.272659+0000, chain.objs.size()=1 2024-09-12T01:04:39.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.686+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.lGgxcgxQFYGrNba-3P_qj_vem8DIihh_0 2024-09-12T01:04:39.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.686+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8994577209728246871', time=2024-09-12T02:52:57.278593+0000, chain.objs.size()=1 2024-09-12T01:04:39.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.686+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.RwwfQqsJNtSSMpoIoNfAY4enkw6a3kl_0 2024-09-12T01:04:39.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.686+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6986087626343584673', time=2024-09-12T02:52:57.400361+0000, chain.objs.size()=1 2024-09-12T01:04:39.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.686+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.OWOYIRC8WNfw8FtjebBh93uOk3F97y2_0 2024-09-12T01:04:39.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.686+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10833437476090420798', time=2024-09-12T02:52:57.492345+0000, chain.objs.size()=1 2024-09-12T01:04:39.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.686+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.IAQODOIUtPs24N049xXpnmNZPSbYEyh_0 2024-09-12T01:04:39.687 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.686+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11806234874594731306', time=2024-09-12T02:52:57.519524+0000, chain.objs.size()=1 2024-09-12T01:04:39.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.686+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.2ysyJ0nmw0fEYkQejIaR9r_3Tzco06N_0 2024-09-12T01:04:39.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.686+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8018176052058530431', time=2024-09-12T02:52:57.638045+0000, chain.objs.size()=1 2024-09-12T01:04:39.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.686+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.vvwigdL_aTLcQZy_NNrBKndMzqVvE-x_0 2024-09-12T01:04:39.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.686+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3980705414490415054', time=2024-09-12T02:52:57.671065+0000, chain.objs.size()=1 2024-09-12T01:04:39.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.686+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.6d3jiQETjM2zW6EOhOI_X9GxuKfBwF2_0 2024-09-12T01:04:39.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.686+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2383841468005716', time=2024-09-12T02:52:57.709597+0000, chain.objs.size()=1 2024-09-12T01:04:39.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.686+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.vlWEKldgavlaUEvC3fi-f6KkFwXc1wM_0 2024-09-12T01:04:39.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.686+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3184661753809392653', time=2024-09-12T02:52:57.736936+0000, chain.objs.size()=1 2024-09-12T01:04:39.688 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.686+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.cn1BHHmr3owNCk6wWcBkgLyh-911qgd_0 2024-09-12T01:04:39.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.690+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16190036797215185785', time=2024-09-12T02:52:57.750195+0000, chain.objs.size()=1 2024-09-12T01:04:39.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.690+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.-LYtRDFUTrKUYk6xJt0ENqyZ-WtQwyI_0 2024-09-12T01:04:39.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.690+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12653557777318389092', time=2024-09-12T02:52:57.751023+0000, chain.objs.size()=1 2024-09-12T01:04:39.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.690+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_._rg8yziS4aaJQt7nLzUDaJ1NyB4xrQS_0 2024-09-12T01:04:39.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.690+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9640861967054530769', time=2024-09-12T02:52:57.930192+0000, chain.objs.size()=1 2024-09-12T01:04:39.689 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.690+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_._sWmmAmi7cMMOnoucAf0MTXxXCaQGl1_0 2024-09-12T01:04:39.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.690+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18058034966058075158', time=2024-09-12T02:52:57.935666+0000, chain.objs.size()=1 2024-09-12T01:04:39.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.690+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Et6qCpbpvhlt7cUklF-m7eTdXSpWYV2_0 2024-09-12T01:04:39.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.690+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6586278557004708834', time=2024-09-12T02:52:57.962508+0000, chain.objs.size()=1 2024-09-12T01:04:39.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.690+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_._whiqBR-eEFcRq8KisYvU57L43otmWV_0 2024-09-12T01:04:39.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.690+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11405106567809987648', time=2024-09-12T02:52:57.978618+0000, chain.objs.size()=1 2024-09-12T01:04:39.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.690+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.JTt4-isLZ0Hc91YQoXkTFZzhWN18lBA_0 2024-09-12T01:04:39.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.690+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8074728560921343391', time=2024-09-12T02:52:58.101015+0000, chain.objs.size()=1 2024-09-12T01:04:39.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.690+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.l8n6ktm14VNmifnx3JzMlCLPK3MERpL_0 2024-09-12T01:04:39.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.690+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5868608268960783623', time=2024-09-12T02:52:58.234921+0000, chain.objs.size()=1 2024-09-12T01:04:39.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.690+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.-8AWBaMHlpR9A_fwWThQT5z9FKaHE71_0 2024-09-12T01:04:39.690 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.690+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7216535975131647568', time=2024-09-12T02:52:58.247296+0000, chain.objs.size()=1 2024-09-12T01:04:39.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.690+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.1xUIhIIBoGEb5hrApRTdMuQNg1G4kAD_0 2024-09-12T01:04:39.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.690+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9461724516613280932', time=2024-09-12T02:52:58.387887+0000, chain.objs.size()=1 2024-09-12T01:04:39.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.690+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.puk6x6tR8Y5bwNqRmSjmGvFfCOxKbKV_0 2024-09-12T01:04:39.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.690+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2615543471718069075', time=2024-09-12T02:52:58.461684+0000, chain.objs.size()=1 2024-09-12T01:04:39.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.690+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.1DRuaYm4mg4LeQpPRpYfRCRxXOo-ekM_0 2024-09-12T01:04:39.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.690+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3104028476250433283', time=2024-09-12T02:52:58.464441+0000, chain.objs.size()=1 2024-09-12T01:04:39.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.690+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.B8Fb1IQPrCvQOL3DtR_wkatQfsIVpuC_0 2024-09-12T01:04:39.691 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.690+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2367780984279152569', time=2024-09-12T02:52:58.609380+0000, chain.objs.size()=1 2024-09-12T01:04:39.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.690+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.h4FUxoq4uSxfTyFk8ouy31oGqn8nazZ_0 2024-09-12T01:04:39.692 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.690+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/53006 2024-09-12T01:04:39.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.694+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-12T01:04:39.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.694+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3701018795205379704', time=2024-09-12T02:52:58.611027+0000, chain.objs.size()=1 2024-09-12T01:04:39.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.694+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.MyLkH5A8C28rpKVBnZqeCYdwUxHh2HC_0 2024-09-12T01:04:39.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.694+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.199917964063529158', time=2024-09-12T02:52:58.644779+0000, chain.objs.size()=1 2024-09-12T01:04:39.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.694+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.7RjP18nYkZMadi5UR01NLtj9bSa10JF_0 2024-09-12T01:04:39.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.694+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9663603608155613674', time=2024-09-12T02:53:03.885274+0000, chain.objs.size()=1 2024-09-12T01:04:39.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.694+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.332__shadow_.Nc8EpXfX6b__QZnsprfuZz_lww94oyV_0 2024-09-12T01:04:39.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.694+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9527416046516977011', time=2024-09-12T02:54:18.081945+0000, chain.objs.size()=1 2024-09-12T01:04:39.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.694+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.436__shadow_.q2Q4nvQHKGGgjZRlAd36br-_n9n9rvi_0 2024-09-12T01:04:39.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.694+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.919300164306170950', time=2024-09-12T02:54:40.886497+0000, chain.objs.size()=1 2024-09-12T01:04:39.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.694+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.462__shadow_.1eQx9SVfOhXq3AbZgVSPT93sVqcL-MS_0 2024-09-12T01:04:39.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.694+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16295787349596485604', time=2024-09-12T02:54:53.304409+0000, chain.objs.size()=1 2024-09-12T01:04:39.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.694+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.483__shadow_.Uujic_EJ262R7p1F_dcZnX6AmhUfyvq_0 2024-09-12T01:04:39.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.694+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14701998121240334748', time=2024-09-12T02:55:03.624082+0000, chain.objs.size()=1 2024-09-12T01:04:39.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.694+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.498__shadow_.PgVKL2ga2r4viBuVmBZjAfCPnEgCWAN_0 2024-09-12T01:04:39.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.694+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2959962420501896753', time=2024-09-12T02:55:19.465134+0000, chain.objs.size()=1 2024-09-12T01:04:39.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.694+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.517__shadow_.xorcgA7x-mm4-RnwrVdpR5vEM44SE5C_0 2024-09-12T01:04:39.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.694+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17288387180494188906', time=2024-09-12T02:55:23.161307+0000, chain.objs.size()=6 2024-09-12T01:04:39.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.694+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.519__multipart_mymultipart.2~6tvA3mS5bRX_UzrEpMI4SS4JEU3wKJ8.1 2024-09-12T01:04:39.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.694+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.519__multipart_mymultipart.2~6tvA3mS5bRX_UzrEpMI4SS4JEU3wKJ8.2 2024-09-12T01:04:39.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.694+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.519__multipart_mymultipart.2~6tvA3mS5bRX_UzrEpMI4SS4JEU3wKJ8.3 2024-09-12T01:04:39.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.694+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.519__multipart_mymultipart.2~6tvA3mS5bRX_UzrEpMI4SS4JEU3wKJ8.4 2024-09-12T01:04:39.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.519__multipart_mymultipart.2~6tvA3mS5bRX_UzrEpMI4SS4JEU3wKJ8.5 2024-09-12T01:04:39.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.519__multipart_mymultipart.2~6tvA3mS5bRX_UzrEpMI4SS4JEU3wKJ8.6 2024-09-12T01:04:39.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12193724962204248991', time=2024-09-12T02:55:47.322355+0000, chain.objs.size()=2 2024-09-12T01:04:39.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.523__multipart_mymultipart.2~3qgnpSJY0AKNlEl-YFo5ZduoOS4yWf7.1 2024-09-12T01:04:39.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.523__multipart_mymultipart.2~3qgnpSJY0AKNlEl-YFo5ZduoOS4yWf7.2 2024-09-12T01:04:39.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4445811032564634882', time=2024-09-12T02:55:50.753694+0000, chain.objs.size()=3 2024-09-12T01:04:39.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.525__multipart_mymultipart.2~c3aD71R-avPhtt1Z01x0iRo6rNQDDkO.1 2024-09-12T01:04:39.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.525__multipart_mymultipart.2~c3aD71R-avPhtt1Z01x0iRo6rNQDDkO.2 2024-09-12T01:04:39.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.525__multipart_mymultipart.2~c3aD71R-avPhtt1Z01x0iRo6rNQDDkO.3 2024-09-12T01:04:39.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18337995348700875754', time=2024-09-12T02:57:03.391569+0000, chain.objs.size()=1 2024-09-12T01:04:39.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.569__shadow:FtRzvvLG1yCSTZSdq0KMu-znMHd17BU_.YnTDAi-7cq1J-sCY68I3_rgB15bMkW3_0 2024-09-12T01:04:39.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18296518909351677135', time=2024-09-12T02:57:04.699090+0000, chain.objs.size()=1 2024-09-12T01:04:39.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.569__shadow:JN0jUs3y0KVzz2fUeE8Gl6j23M.4WcJ_.lBr0vUWhIe8aA9cFAHbbBDYLTTuwbSc_0 2024-09-12T01:04:39.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16870486126365327908', time=2024-09-12T02:57:08.906510+0000, chain.objs.size()=1 2024-09-12T01:04:39.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.569__shadow:fuVpQE02-NknyXVOGUlYa6aeRpDhs-m_.xCZR2JLAdWkIvCETOsYX8k28x2Fxz6W_0 2024-09-12T01:04:39.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8267816528643713079', time=2024-09-12T02:57:14.879758+0000, chain.objs.size()=1 2024-09-12T01:04:39.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.574__shadow:fSZhOpados6-SJADDGv9JJnMZ0qYJg8_.TxDKVCkr2PVQpiGlMD82wE3SN_z42zG_0 2024-09-12T01:04:39.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6778507238928251049', time=2024-09-12T02:57:26.523222+0000, chain.objs.size()=1 2024-09-12T01:04:39.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:p178LPySqYXLYK7m6jPHviQoSRiQJT9_.Nt-5KImTQfSlNn_e-z-jhOy8ZWJ7Zjs_0 2024-09-12T01:04:39.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12065379335627783517', time=2024-09-12T02:57:38.370720+0000, chain.objs.size()=1 2024-09-12T01:04:39.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:sPN8sfsJjRVTYuF-G4mk0BtWem6HWDI_.mbE20lpn3uB1R-pjeqgP6mwqpglHtnR_0 2024-09-12T01:04:39.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17428586586514347797', time=2024-09-12T02:57:44.666627+0000, chain.objs.size()=1 2024-09-12T01:04:39.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.579__shadow:vimllmyEoqvAVtzXva3cOqtmw5Wswe2_.ssl-15QyeH6-i2_EOB4rd9BqY_thhcZ_0 2024-09-12T01:04:39.700 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10352090015734107902', time=2024-09-12T03:00:31.049825+0000, chain.objs.size()=12 2024-09-12T01:04:39.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.623__multipart_multipart_enc.2~0qqde91Kcgg2hS81nVRcJEQptfklKw5.1 2024-09-12T01:04:39.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.623__shadow_multipart_enc.2~0qqde91Kcgg2hS81nVRcJEQptfklKw5.1_1 2024-09-12T01:04:39.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.623__multipart_multipart_enc.2~0qqde91Kcgg2hS81nVRcJEQptfklKw5.2 2024-09-12T01:04:39.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.623__shadow_multipart_enc.2~0qqde91Kcgg2hS81nVRcJEQptfklKw5.2_1 2024-09-12T01:04:39.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.623__multipart_multipart_enc.2~0qqde91Kcgg2hS81nVRcJEQptfklKw5.3 2024-09-12T01:04:39.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.623__shadow_multipart_enc.2~0qqde91Kcgg2hS81nVRcJEQptfklKw5.3_1 2024-09-12T01:04:39.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.623__multipart_multipart_enc.2~0qqde91Kcgg2hS81nVRcJEQptfklKw5.4 2024-09-12T01:04:39.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.623__shadow_multipart_enc.2~0qqde91Kcgg2hS81nVRcJEQptfklKw5.4_1 2024-09-12T01:04:39.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.623__multipart_multipart_enc.2~0qqde91Kcgg2hS81nVRcJEQptfklKw5.5 2024-09-12T01:04:39.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.698+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.623__shadow_multipart_enc.2~0qqde91Kcgg2hS81nVRcJEQptfklKw5.5_1 2024-09-12T01:04:39.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.702+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.623__multipart_multipart_enc.2~0qqde91Kcgg2hS81nVRcJEQptfklKw5.6 2024-09-12T01:04:39.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.702+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.623__shadow_multipart_enc.2~0qqde91Kcgg2hS81nVRcJEQptfklKw5.6_1 2024-09-12T01:04:39.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.702+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1033014374222835257', time=2024-09-12T03:00:42.481399+0000, chain.objs.size()=1 2024-09-12T01:04:39.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.702+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.636__shadow_.cXgIN8JTJBM_-nlvT4SnPT0R_a3sHjk_0 2024-09-12T01:04:39.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.702+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14687481121257185774', time=2024-09-12T03:00:54.401694+0000, chain.objs.size()=1 2024-09-12T01:04:39.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.702+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.651__shadow_.yo7sIFmXcO2obDEfm_pQ-5m2RqZWrwZ_0 2024-09-12T01:04:39.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.702+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5756553540019275902', time=2024-09-12T03:01:25.402799+0000, chain.objs.size()=1 2024-09-12T01:04:39.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.702+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.694__shadow:vyLS1DYma6jE9xpjmShYrFy6P4kricv_.8H-Wx5PHh3wsX_H2od8otj03FfTImdL_0 2024-09-12T01:04:39.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.702+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3514772860564208551', time=2024-09-12T03:01:34.838553+0000, chain.objs.size()=1 2024-09-12T01:04:39.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.702+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.707__shadow:wYTg4rDzxA0o7Aq8CwajB1RpXaDQhRp_.xPvKsLAmTd-yygMpoKLxT9rluvQ1fgZ_0 2024-09-12T01:04:39.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.706+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2674698536380023989', time=2024-09-12T03:01:50.758588+0000, chain.objs.size()=1 2024-09-12T01:04:39.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.706+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.716__shadow:cMIGXzI8KLjkg6r8d8Ajk6wCJ..Ayre_.elYEEp8HVVdrSQ1IoqJlQTKcnJQHolh_0 2024-09-12T01:04:39.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.706+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1594138671777397081', time=2024-09-12T03:02:01.040059+0000, chain.objs.size()=1 2024-09-12T01:04:39.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.706+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.717__shadow:OWcTLfqhFstfsJtrQiHkOJd.mWTF9Qz_.DPiknkbdOSryJaGpmc3G_wUDgP1OSdS_0 2024-09-12T01:04:39.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.706+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:39.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.710+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:04:39.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.710+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:39.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.710+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:39.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.710+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50140' 2024-09-12T01:04:39.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.710+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='_SC_gv_KFFLB1Y2LIC9n5FwgKSbriuvN', time=2024-09-12T02:48:38.160102+0000, chain.objs.size()=3 2024-09-12T01:04:39.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.710+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.165__shadow_.kiRCsW4g5U4yJTX_gcPcpFv5EzFD-8e_0 2024-09-12T01:04:39.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.710+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.165__shadow_.kiRCsW4g5U4yJTX_gcPcpFv5EzFD-8e_1 2024-09-12T01:04:39.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.710+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.165__shadow_.kiRCsW4g5U4yJTX_gcPcpFv5EzFD-8e_2 2024-09-12T01:04:39.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.710+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15104733546496689493', time=2024-09-12T02:50:54.229310+0000, chain.objs.size()=1 2024-09-12T01:04:39.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.710+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.244__shadow_.BXmdDuvLxsnCP6Hdpu0J6esKSjlYojE_0 2024-09-12T01:04:39.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.710+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16460030159952409158', time=2024-09-12T02:51:03.336419+0000, chain.objs.size()=1 2024-09-12T01:04:39.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.710+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.256__shadow_.PwX5jwwh5prf4TJDCiPAL6mo88aA1AC_0 2024-09-12T01:04:39.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.710+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17438758460783154402', time=2024-09-12T02:51:03.338164+0000, chain.objs.size()=1 2024-09-12T01:04:39.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.710+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.256__shadow_.BRdQ61WZoQtFCTEuZ6_BL1IvFxPP7yT_0 2024-09-12T01:04:39.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.710+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15530379801529816295', time=2024-09-12T02:51:07.016553+0000, chain.objs.size()=1 2024-09-12T01:04:39.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.710+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.261__shadow_.BZkZR1lCUg73TZMpO8iaJ-HbpTLfn9O_0 2024-09-12T01:04:39.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.710+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10668651638032432593', time=2024-09-12T02:51:26.842685+0000, chain.objs.size()=1 2024-09-12T01:04:39.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.710+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.BSCvKujDn_MYVuUEqpIA8kqOyJtWrpI_0 2024-09-12T01:04:39.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.710+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15457976514512419279', time=2024-09-12T02:51:26.863706+0000, chain.objs.size()=1 2024-09-12T01:04:39.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.710+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.fLSj4JoHeGA2Zy192zKQn8MYlQJxAZS_0 2024-09-12T01:04:39.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.710+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5029386405818986900', time=2024-09-12T02:51:26.867672+0000, chain.objs.size()=1 2024-09-12T01:04:39.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.710+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.aKzDBWl9C9JZA-k8Z3i-AlPcpAZ28Vt_0 2024-09-12T01:04:39.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.710+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13348428508321497635', time=2024-09-12T02:51:26.887187+0000, chain.objs.size()=1 2024-09-12T01:04:39.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.710+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.l2vX1-ZcOXrXr7kK4nSHxmvQQNGYgWg_0 2024-09-12T01:04:39.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.710+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10221818650338803831', time=2024-09-12T02:51:26.997691+0000, chain.objs.size()=1 2024-09-12T01:04:39.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.710+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.TZvm_Bl7_qU9UpnwZHRtrsL-4Y7F1_d_0 2024-09-12T01:04:39.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.714+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16712468262687899274', time=2024-09-12T02:51:27.046413+0000, chain.objs.size()=1 2024-09-12T01:04:39.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.714+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.-POolD9erL6jL6_rX42VPp-1GRsJSKV_0 2024-09-12T01:04:39.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.714+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10718540287631648328', time=2024-09-12T02:51:27.056698+0000, chain.objs.size()=1 2024-09-12T01:04:39.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.714+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.d4NU0cUCccGaSgkShwRTuEkFvkpycAi_0 2024-09-12T01:04:39.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.714+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4206426440465997005', time=2024-09-12T02:51:27.256283+0000, chain.objs.size()=1 2024-09-12T01:04:39.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.714+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.4V7HrKdwFzeQy5Q66zR-TzKBz6jLNvq_0 2024-09-12T01:04:39.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.714+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15088250507701200924', time=2024-09-12T02:51:27.290763+0000, chain.objs.size()=1 2024-09-12T01:04:39.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.714+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Fygb1BAqDAw6klo4s47Exng8XZZv71B_0 2024-09-12T01:04:39.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.714+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3434010782370579600', time=2024-09-12T02:51:27.302808+0000, chain.objs.size()=1 2024-09-12T01:04:39.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.714+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.sd2Fua4AA8w7PiCqtITJnrP2vFYTsYV_0 2024-09-12T01:04:39.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.714+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2070716220092245137', time=2024-09-12T02:51:27.308394+0000, chain.objs.size()=1 2024-09-12T01:04:39.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.714+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.VfCeUUQBSdQedOVRaux4yC5NKolKiQK_0 2024-09-12T01:04:39.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.714+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11288793497942444194', time=2024-09-12T02:51:27.490769+0000, chain.objs.size()=1 2024-09-12T01:04:39.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.714+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Wxk34lyhvoBxqANoie47k-d-93xHDHZ_0 2024-09-12T01:04:39.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.714+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10379412681179311126', time=2024-09-12T02:51:27.513158+0000, chain.objs.size()=1 2024-09-12T01:04:39.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.714+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.sBvkhIG-0972ozZnN-bOaHJjhoO9YEt_0 2024-09-12T01:04:39.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.714+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14267953069245020268', time=2024-09-12T02:51:27.515108+0000, chain.objs.size()=1 2024-09-12T01:04:39.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.714+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.enXp6MCV1a6MvejN2b6kokCHM-xbPde_0 2024-09-12T01:04:39.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.714+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9775078840542347092', time=2024-09-12T02:51:27.523544+0000, chain.objs.size()=1 2024-09-12T01:04:39.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.714+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.z3HS1ihEhU6yWASrgNo1BMDXrFcH6I9_0 2024-09-12T01:04:39.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.714+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9485174416248816373', time=2024-09-12T02:51:27.528077+0000, chain.objs.size()=1 2024-09-12T01:04:39.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.714+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Wwu9mPSSPvWlUU-IEK4TmGF1RnRQZD2_0 2024-09-12T01:04:39.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.718+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4760079029889001194', time=2024-09-12T02:51:27.637562+0000, chain.objs.size()=1 2024-09-12T01:04:39.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.718+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.xWwimWq8ES3Lv4wy9HInq9Xjv8Pigtw_0 2024-09-12T01:04:39.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.718+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5849653811481315545', time=2024-09-12T02:51:27.644630+0000, chain.objs.size()=1 2024-09-12T01:04:39.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.718+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.xcyfdM-4Q4uQED4b64fpx-xg-Y-POa1_0 2024-09-12T01:04:39.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.718+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13950675300643095978', time=2024-09-12T02:51:27.693074+0000, chain.objs.size()=1 2024-09-12T01:04:39.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.718+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.a08f9bKv4rBirYsj_RJc4ehK0KYIg-y_0 2024-09-12T01:04:39.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.718+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18355697903611196634', time=2024-09-12T02:51:27.700998+0000, chain.objs.size()=1 2024-09-12T01:04:39.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.718+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.RiAcN1Is76rBXzMJmaEOdDGehwzO7Pc_0 2024-09-12T01:04:39.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.718+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3420607697314970309', time=2024-09-12T02:51:27.726876+0000, chain.objs.size()=1 2024-09-12T01:04:39.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.718+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.1OYrK9PF_GVAy_wMbUdYIIIL6OMsUQG_0 2024-09-12T01:04:39.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.718+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13335568521835484750', time=2024-09-12T02:51:27.843632+0000, chain.objs.size()=1 2024-09-12T01:04:39.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.718+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.9XCrX3qXJKOV-1ZZvktNnDIUFAiNdLg_0 2024-09-12T01:04:39.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.718+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.297691780631705719', time=2024-09-12T02:51:27.886730+0000, chain.objs.size()=1 2024-09-12T01:04:39.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.718+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ndWMHRTwda-Tcv3O6UMCY1kUt1YrePk_0 2024-09-12T01:04:39.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.718+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15462461865563841189', time=2024-09-12T02:51:27.892658+0000, chain.objs.size()=1 2024-09-12T01:04:39.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.718+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.F2Eeb1CHC8k4XUDxIPw7wwwSodW6xal_0 2024-09-12T01:04:39.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.718+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3436280076164405490', time=2024-09-12T02:51:27.914013+0000, chain.objs.size()=1 2024-09-12T01:04:39.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.718+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.CqTekxGCh2SZazUkWsgphUNGvNSQ1AI_0 2024-09-12T01:04:39.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.718+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2319734896511229835', time=2024-09-12T02:51:27.945085+0000, chain.objs.size()=1 2024-09-12T01:04:39.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.718+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.1FbTeZ4yEh_mNRuGAm9jBONMJ0eDDrB_0 2024-09-12T01:04:39.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.718+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16568924659439604008', time=2024-09-12T02:51:28.121564+0000, chain.objs.size()=1 2024-09-12T01:04:39.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.718+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.2mvOK9Z1hjHa9G4304Ych218ErAyEQJ_0 2024-09-12T01:04:39.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.718+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2683077765318083931', time=2024-09-12T02:51:28.240726+0000, chain.objs.size()=1 2024-09-12T01:04:39.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.718+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.qQ7qMbcuBi0Rm94ECfbOyU20ajAPulA_0 2024-09-12T01:04:39.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.718+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10986395620392734983', time=2024-09-12T02:51:28.341902+0000, chain.objs.size()=1 2024-09-12T01:04:39.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.718+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.YVGWLY6BnncaKBweRwHCS66oJrTa048_0 2024-09-12T01:04:39.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.718+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10373983789296288741', time=2024-09-12T02:51:28.352771+0000, chain.objs.size()=1 2024-09-12T01:04:39.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.718+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.dn2Vpsc4WvPYAUZ-O6l_aV017W2HZ_3_0 2024-09-12T01:04:39.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.718+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17593246084973185559', time=2024-09-12T02:51:34.364388+0000, chain.objs.size()=1 2024-09-12T01:04:39.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.718+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.270__shadow_.BJewm_H5yBwDlE_sF7NgiiWcpmGk7Po_0 2024-09-12T01:04:39.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13714026164556617606', time=2024-09-12T02:51:39.494700+0000, chain.objs.size()=1 2024-09-12T01:04:39.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.277__shadow_.0eFLAdfLForrd5ZMX4ixWWFJrhPuReG_0 2024-09-12T01:04:39.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15225241747761918272', time=2024-09-12T02:51:42.400909+0000, chain.objs.size()=1 2024-09-12T01:04:39.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.281__shadow_.Mvn84Fa1GAjvLvrI3rQ7Hxlq42xV7vS_0 2024-09-12T01:04:39.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10940257986212504649', time=2024-09-12T02:51:55.369038+0000, chain.objs.size()=1 2024-09-12T01:04:39.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.296__shadow_.AdVmubBdFZuMTiwUdprRSvgZlZqqZfZ_0 2024-09-12T01:04:39.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9964332398960640030', time=2024-09-12T02:51:56.104737+0000, chain.objs.size()=1 2024-09-12T01:04:39.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.297__shadow_.7_Fy9fiDrXyfynPh1u0Ou0m_IUzYZD3_0 2024-09-12T01:04:39.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14639321020542712817', time=2024-09-12T02:51:57.673062+0000, chain.objs.size()=1 2024-09-12T01:04:39.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.299__shadow_.At8RdpoJBg6S0g7mb6j3eEXXBTg8mgJ_0 2024-09-12T01:04:39.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11717564963139996796', time=2024-09-12T02:52:00.688108+0000, chain.objs.size()=1 2024-09-12T01:04:39.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.303__shadow_.CGqW9Co6rBZR8sAaRYNgZRhsp8XFf_I_0 2024-09-12T01:04:39.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.305113329595182634', time=2024-09-12T02:52:01.421071+0000, chain.objs.size()=1 2024-09-12T01:04:39.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.304__shadow_.E4dFXnyzyfR50JgMqWtti6HEwAbDctm_0 2024-09-12T01:04:39.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11461592791923818310', time=2024-09-12T02:52:13.712180+0000, chain.objs.size()=1 2024-09-12T01:04:39.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.321__shadow_.HlM0x0MSIJ3XLQVkO9EGF-FDToDL_WC_0 2024-09-12T01:04:39.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1079607768129238487', time=2024-09-12T02:52:34.829639+0000, chain.objs.size()=1 2024-09-12T01:04:39.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.bEIrgMH7HcoiTJTJEsL1jgq1PCcmyJ0_0 2024-09-12T01:04:39.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2376409185829731519', time=2024-09-12T02:52:35.027703+0000, chain.objs.size()=1 2024-09-12T01:04:39.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.5_chX23xeV9hddgW3kl4R96Mc9S-Uax_0 2024-09-12T01:04:39.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15171232308935699166', time=2024-09-12T02:52:35.047573+0000, chain.objs.size()=1 2024-09-12T01:04:39.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.T2UW_nRfUr7sq1CE6ygjWJiwqaHGhTh_0 2024-09-12T01:04:39.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0b297640 0 -- 172.21.15.43:0/1860143151 >> [v2:172.21.15.97:6816/489545787,v1:172.21.15.97:6817/489545787] conn(0x7f8afc063340 msgr2=0x7f8afc0043d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:39.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15098299162688998489', time=2024-09-12T02:52:35.089472+0000, chain.objs.size()=1 2024-09-12T01:04:39.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.PUUOgflzFCucdxAiSI6R3eClf9Us-o8_0 2024-09-12T01:04:39.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7254470872698564571', time=2024-09-12T02:52:35.107811+0000, chain.objs.size()=1 2024-09-12T01:04:39.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.TlYgqWuFNoYRt3anuuRRZfr45CD8mVO_0 2024-09-12T01:04:39.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13992285013870424583', time=2024-09-12T02:52:35.163402+0000, chain.objs.size()=1 2024-09-12T01:04:39.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.94rfOfON_12BWjeiZQ4MiR0nLpYvIeQ_0 2024-09-12T01:04:39.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9902437609055574628', time=2024-09-12T02:52:35.172332+0000, chain.objs.size()=1 2024-09-12T01:04:39.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.rfpvmGxFuONuusBI9-y4FgQb6n9ByQZ_0 2024-09-12T01:04:39.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.397885503790512484', time=2024-09-12T02:52:35.346579+0000, chain.objs.size()=1 2024-09-12T01:04:39.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_._23dzFfTBblPtlKv6cp3rd3wY9AiRCa_0 2024-09-12T01:04:39.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13706154787263235787', time=2024-09-12T02:52:35.373565+0000, chain.objs.size()=1 2024-09-12T01:04:39.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.invgagvnXNw2rStR-mcPICXs1hPWLvI_0 2024-09-12T01:04:39.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10264248347959152750', time=2024-09-12T02:52:35.417509+0000, chain.objs.size()=1 2024-09-12T01:04:39.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.xrB3V5G4Aq7N-DLjw8mPM7CJz7FHDCV_0 2024-09-12T01:04:39.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1078966058486340774', time=2024-09-12T02:52:35.642763+0000, chain.objs.size()=1 2024-09-12T01:04:39.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Vs14BhFyvpSdUPdVCIIZERskPT_oS4l_0 2024-09-12T01:04:39.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14489432468290592185', time=2024-09-12T02:52:35.785005+0000, chain.objs.size()=1 2024-09-12T01:04:39.726 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.pbf2JL7mYKnD_gfuDCij2qG6llHmK6V_0 2024-09-12T01:04:39.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8290625493883997534', time=2024-09-12T02:52:35.795797+0000, chain.objs.size()=1 2024-09-12T01:04:39.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.56h9xRRiJzvfeC23V18LIyEPZ9uyTBQ_0 2024-09-12T01:04:39.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10209662633828838841', time=2024-09-12T02:52:35.888872+0000, chain.objs.size()=1 2024-09-12T01:04:39.727 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.722+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.kzmwZvpwdOpThYPSR2AGdfuhpGqTRhh_0 2024-09-12T01:04:39.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.726+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8166406564308281634', time=2024-09-12T02:52:35.889733+0000, chain.objs.size()=1 2024-09-12T01:04:39.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.726+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.xQ4LjqkK_bJVzBPkkO5my5Ri0IklbmD_0 2024-09-12T01:04:39.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.726+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11260421394123302159', time=2024-09-12T02:52:36.263247+0000, chain.objs.size()=1 2024-09-12T01:04:39.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.726+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.JPk7Vs6b94qe_GV71LVMVXbLBHgVl0f_0 2024-09-12T01:04:39.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.726+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3603902584078453962', time=2024-09-12T02:52:36.265103+0000, chain.objs.size()=1 2024-09-12T01:04:39.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.726+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.maPtTzGUqlFnD3x6Oq9EKK0z--qsdsC_0 2024-09-12T01:04:39.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.726+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5553638668205885429', time=2024-09-12T02:52:36.269848+0000, chain.objs.size()=1 2024-09-12T01:04:39.728 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.726+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.aczES1ioCNPxW3Hp3selpHFDch2faVB_0 2024-09-12T01:04:39.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.726+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8706961456125112655', time=2024-09-12T02:52:36.279251+0000, chain.objs.size()=1 2024-09-12T01:04:39.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.726+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.vXU5Z7p7i1-8p8Cb5dvsk-6clPfueDg_0 2024-09-12T01:04:39.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.726+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6409578470185254832', time=2024-09-12T02:52:36.352660+0000, chain.objs.size()=1 2024-09-12T01:04:39.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.726+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.SmqdMd9uw501OganVanxXx-tvfdBHvg_0 2024-09-12T01:04:39.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.726+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13818204860423761404', time=2024-09-12T02:52:36.359329+0000, chain.objs.size()=1 2024-09-12T01:04:39.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.726+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.a1-aEiBTwoF6Ehx_FiM-3kHqgcMXhRQ_0 2024-09-12T01:04:39.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.726+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1491282005106710002', time=2024-09-12T02:52:36.543736+0000, chain.objs.size()=1 2024-09-12T01:04:39.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.726+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.1H1zkJ_m5xY6Qcvh1YdoqQMQ6jiihgx_0 2024-09-12T01:04:39.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.726+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5994441760244680708', time=2024-09-12T02:52:36.600399+0000, chain.objs.size()=1 2024-09-12T01:04:39.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.726+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.iRs1tMYhFUdJaL_oMiYIgKa_gK-Kcpg_0 2024-09-12T01:04:39.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.726+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10846187879923317999', time=2024-09-12T02:52:36.775988+0000, chain.objs.size()=1 2024-09-12T01:04:39.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.726+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.QFC0eLa6pZl-MBw_V13LKurRye5vvvv_0 2024-09-12T01:04:39.729 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.726+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16295013703968256930', time=2024-09-12T02:52:36.786712+0000, chain.objs.size()=1 2024-09-12T01:04:39.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.726+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ZRvDJdMfRvC3sI7dW748lLUHms2_Ekd_0 2024-09-12T01:04:39.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.726+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14756056924659466965', time=2024-09-12T02:52:36.843424+0000, chain.objs.size()=1 2024-09-12T01:04:39.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.726+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.LW_deER6G_30UomZZvZpxNgdZ4YIT0a_0 2024-09-12T01:04:39.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.730+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4900400053154831187', time=2024-09-12T02:52:36.875068+0000, chain.objs.size()=1 2024-09-12T01:04:39.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.730+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.lc3m4zkstATf8gkolcCZl_4akiiIVE2_0 2024-09-12T01:04:39.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.730+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9334984049988013409', time=2024-09-12T02:52:37.019391+0000, chain.objs.size()=1 2024-09-12T01:04:39.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.730+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.iabrxrpEFLpTMiZv5N26wOM2dcMvy_s_0 2024-09-12T01:04:39.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.730+0000 7f8b0ba98640 0 -- 172.21.15.43:0/1860143151 >> [v2:172.21.15.97:6808/3829003147,v1:172.21.15.97:6809/3829003147] conn(0x558657710100 msgr2=0x7f89d40865f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:39.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.730+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7959427902224928122', time=2024-09-12T02:52:56.938461+0000, chain.objs.size()=1 2024-09-12T01:04:39.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.730+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.7aeReEVrGT2Stw7OqybQ-bChx82rZxJ_0 2024-09-12T01:04:39.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.730+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6066726578252070720', time=2024-09-12T02:52:56.974502+0000, chain.objs.size()=1 2024-09-12T01:04:39.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.730+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.1Q_jUXjrdi_-uZqkEg--f6bBjNvBXaS_0 2024-09-12T01:04:39.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.730+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6006226912016397604', time=2024-09-12T02:52:57.016150+0000, chain.objs.size()=1 2024-09-12T01:04:39.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.730+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.AQljvh0jWYNOKOi8r-eIYUpBCL4mh3Q_0 2024-09-12T01:04:39.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.730+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2789189361918077081', time=2024-09-12T02:52:57.022972+0000, chain.objs.size()=1 2024-09-12T01:04:39.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.730+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.QRdLvlBD3T3a6L5Dp5aTTsnHXzocUmH_0 2024-09-12T01:04:39.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.730+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2499697908404159621', time=2024-09-12T02:52:57.045888+0000, chain.objs.size()=1 2024-09-12T01:04:39.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.730+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.4eyjtluXSvhdGLNPlAcXrEj4q2RenJa_0 2024-09-12T01:04:39.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.730+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1308426930731035267', time=2024-09-12T02:52:57.225322+0000, chain.objs.size()=1 2024-09-12T01:04:39.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.730+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.QCoIOebYREGGTZbPvNI5wYqoYeXzAv0_0 2024-09-12T01:04:39.732 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.730+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14977834920758042620', time=2024-09-12T02:52:57.230198+0000, chain.objs.size()=1 2024-09-12T01:04:39.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.730+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.SyoLNnMpCkOgRLZfg5GKdpTW8ZfWWXs_0 2024-09-12T01:04:39.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.730+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9184684869879256934', time=2024-09-12T02:52:57.231089+0000, chain.objs.size()=1 2024-09-12T01:04:39.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.730+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.NWwqqq2X1OrFw1rWVsjbnO-UPH7o7Nk_0 2024-09-12T01:04:39.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.730+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6059586731955533792', time=2024-09-12T02:52:57.284985+0000, chain.objs.size()=1 2024-09-12T01:04:39.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.730+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.15RApQu4kf7jXzVK-t-dcQ_n6JbIDJ-_0 2024-09-12T01:04:39.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.730+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15421627889630216092', time=2024-09-12T02:52:57.474195+0000, chain.objs.size()=1 2024-09-12T01:04:39.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.730+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.i9uNOSxbjszCRm_LIWBqFdvSwxRMMVB_0 2024-09-12T01:04:39.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.730+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12414797418503945608', time=2024-09-12T02:52:57.478578+0000, chain.objs.size()=1 2024-09-12T01:04:39.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.730+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.v5RcBlFbWJN1IoRgYJz8HpDPfboDEgb_0 2024-09-12T01:04:39.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.730+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6352274821498943832', time=2024-09-12T02:52:57.493766+0000, chain.objs.size()=1 2024-09-12T01:04:39.733 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.730+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.BDbkFp9G7TRfWRrMLa_RhpIgafOwf3-_0 2024-09-12T01:04:39.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.734+0000 7f8b0b297640 0 -- 172.21.15.43:0/1860143151 >> [v2:172.21.15.97:6800/838866664,v1:172.21.15.97:6801/838866664] conn(0x7f89d4081860 msgr2=0x7f89d4083c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:39.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.734+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4915570687850893383', time=2024-09-12T02:52:57.505064+0000, chain.objs.size()=1 2024-09-12T01:04:39.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.734+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.8biLXdMkWPulU1uD8gujaA3qpLAUnv__0 2024-09-12T01:04:39.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.734+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6643895607612146554', time=2024-09-12T02:52:57.515296+0000, chain.objs.size()=1 2024-09-12T01:04:39.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.734+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.5QmKwDM6tKS8WOMPwCOHwo8b2ugF1G__0 2024-09-12T01:04:39.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.734+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7003374504623687902', time=2024-09-12T02:52:57.623944+0000, chain.objs.size()=1 2024-09-12T01:04:39.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.734+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.KWg5XN0MA6OPlQ1nkbakw-XK9vjMagd_0 2024-09-12T01:04:39.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.734+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17295248961989553229', time=2024-09-12T02:52:57.695653+0000, chain.objs.size()=1 2024-09-12T01:04:39.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.734+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.SOishrDbYcHrNtsM3IXkoaQuM85v5Kv_0 2024-09-12T01:04:39.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.734+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17582840661440096586', time=2024-09-12T02:52:57.696757+0000, chain.objs.size()=1 2024-09-12T01:04:39.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.734+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.bs4L2jWZFmAjyAbLbT7lDuf_uLFYBdy_0 2024-09-12T01:04:39.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.734+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4565251842352137770', time=2024-09-12T02:52:57.719898+0000, chain.objs.size()=1 2024-09-12T01:04:39.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.734+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.UBihk8HzOGW-vrIsDL36PEjJLXEyZ0G_0 2024-09-12T01:04:39.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.734+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10538483221661344889', time=2024-09-12T02:52:57.727357+0000, chain.objs.size()=1 2024-09-12T01:04:39.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.734+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.g6ucjh-egJ0MKuKmzoep3_NPXiIVW5M_0 2024-09-12T01:04:39.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.734+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1890710374155263007', time=2024-09-12T02:52:57.859800+0000, chain.objs.size()=1 2024-09-12T01:04:39.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.734+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.o2F01T4W-NN9_ow1U1axIl38Wgm12OP_0 2024-09-12T01:04:39.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.734+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14169342330947750582', time=2024-09-12T02:52:57.903056+0000, chain.objs.size()=1 2024-09-12T01:04:39.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.734+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.GOmQ_95s18fZS7APM92ywCTvmB9c8iK_0 2024-09-12T01:04:39.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.734+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8834350300382201262', time=2024-09-12T02:52:57.927087+0000, chain.objs.size()=1 2024-09-12T01:04:39.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.734+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ttC9MXYS3T-qi5pV-c4b4rkEZkZY7Lj_0 2024-09-12T01:04:39.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.734+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6734422844963771634', time=2024-09-12T02:52:57.928233+0000, chain.objs.size()=1 2024-09-12T01:04:39.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.734+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.mADr8u9yJLsevEbV2q7XTvelVfx6OdD_0 2024-09-12T01:04:39.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.734+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11394252578677243329', time=2024-09-12T02:52:57.932578+0000, chain.objs.size()=1 2024-09-12T01:04:39.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.734+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ERCXocVN-SFR9XjUHXScyKTOy04eea0_0 2024-09-12T01:04:39.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.738+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4610298185522100776', time=2024-09-12T02:52:57.944864+0000, chain.objs.size()=1 2024-09-12T01:04:39.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.738+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_._O-LNJqRahzKE664x67WkqdBiwcy0CU_0 2024-09-12T01:04:39.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.738+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8432663871114692010', time=2024-09-12T02:52:57.988126+0000, chain.objs.size()=1 2024-09-12T01:04:39.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.738+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Lj_hD5OTwvrrGGyf4q8vd55Dq3LX4Qw_0 2024-09-12T01:04:39.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.738+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11384270386680965661', time=2024-09-12T02:52:58.221205+0000, chain.objs.size()=1 2024-09-12T01:04:39.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.738+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.vTG5qJMfu-xNO3ZWxBVwJZWMJs-EIJ-_0 2024-09-12T01:04:39.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.738+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14643556097596324395', time=2024-09-12T02:52:58.233513+0000, chain.objs.size()=1 2024-09-12T01:04:39.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.738+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.G5kExQ1MLhOq0yVUFQeyG7bFUhQCUWs_0 2024-09-12T01:04:39.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.738+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50140 2024-09-12T01:04:39.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.742+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T01:04:39.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.742+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6555407492808277565', time=2024-09-12T02:52:58.417851+0000, chain.objs.size()=1 2024-09-12T01:04:39.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.742+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Vvs4uID_ppYL1Acoa2R6nXLysDppUY2_0 2024-09-12T01:04:39.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.742+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1658432956281270116', time=2024-09-12T02:52:58.501654+0000, chain.objs.size()=1 2024-09-12T01:04:39.741 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.742+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.scBlFIDG5jlhS3hoX1JzOM5-npcTdj7_0 2024-09-12T01:04:39.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.742+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3781943763455885964', time=2024-09-12T02:52:58.596159+0000, chain.objs.size()=1 2024-09-12T01:04:39.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.742+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.LTUtzQI-2oQIr4uv73nEi-kwTufPC70_0 2024-09-12T01:04:39.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.742+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5772819835889027281', time=2024-09-12T02:52:58.620950+0000, chain.objs.size()=1 2024-09-12T01:04:39.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.742+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.7iq0kwFr_bfxH3bI8YeWs7DiAaM5s5e_0 2024-09-12T01:04:39.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.742+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16509311672518520027', time=2024-09-12T02:53:39.063472+0000, chain.objs.size()=1 2024-09-12T01:04:39.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.742+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.384__shadow_.FnwZar9tsrojQAoyGcFiVEi9u9OA8iW_0 2024-09-12T01:04:39.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.742+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.920692627222485163', time=2024-09-12T02:54:38.755143+0000, chain.objs.size()=1 2024-09-12T01:04:39.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.742+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.460__shadow_.TCmTTpA84ps_hdENAYGTIkMJbXFXoqs_0 2024-09-12T01:04:39.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.742+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10565482379048289575', time=2024-09-12T02:54:44.476012+0000, chain.objs.size()=1 2024-09-12T01:04:39.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.742+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.466__shadow_.ueySnV4OIBTe2Q1yvr_q0sFOiZ7AbP0_0 2024-09-12T01:04:39.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.742+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6185307314108096690', time=2024-09-12T02:54:59.654270+0000, chain.objs.size()=1 2024-09-12T01:04:39.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.742+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.491__shadow_.cvlVFNQS2pBZUEZghuSgoKMfCP3gWMj_0 2024-09-12T01:04:39.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.742+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7310517022429531049', time=2024-09-12T02:55:11.556244+0000, chain.objs.size()=6 2024-09-12T01:04:39.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.742+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.1 2024-09-12T01:04:39.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.742+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.2 2024-09-12T01:04:39.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.742+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.3 2024-09-12T01:04:39.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.742+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.4 2024-09-12T01:04:39.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.742+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.5 2024-09-12T01:04:39.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.742+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.6 2024-09-12T01:04:39.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.742+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9116845871734933202', time=2024-09-12T02:55:31.805410+0000, chain.objs.size()=6 2024-09-12T01:04:39.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.742+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.R6WwgzR1tUIcJZcGbg5EIRuErBN2dlZs.1 2024-09-12T01:04:39.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.742+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.2~e0BwqdFAQ8Qn1GTa35Rf-3GAS6aOgyb.2 2024-09-12T01:04:39.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.742+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.2~e0BwqdFAQ8Qn1GTa35Rf-3GAS6aOgyb.3 2024-09-12T01:04:39.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.742+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.2~e0BwqdFAQ8Qn1GTa35Rf-3GAS6aOgyb.4 2024-09-12T01:04:39.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.742+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.2~e0BwqdFAQ8Qn1GTa35Rf-3GAS6aOgyb.5 2024-09-12T01:04:39.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.746+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.2~e0BwqdFAQ8Qn1GTa35Rf-3GAS6aOgyb.6 2024-09-12T01:04:39.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.746+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15512896794180824223', time=2024-09-12T02:55:34.822792+0000, chain.objs.size()=6 2024-09-12T01:04:39.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.746+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.2~syI2OwC_ZA7fE9dP7C6mDOFFDdC5WXz.1 2024-09-12T01:04:39.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.746+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.CbQdRc7Ju8gnW70zlob4qtqRXeqKDfXR.2 2024-09-12T01:04:39.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.746+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.2~syI2OwC_ZA7fE9dP7C6mDOFFDdC5WXz.3 2024-09-12T01:04:39.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.746+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.2~syI2OwC_ZA7fE9dP7C6mDOFFDdC5WXz.4 2024-09-12T01:04:39.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.746+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.2~syI2OwC_ZA7fE9dP7C6mDOFFDdC5WXz.5 2024-09-12T01:04:39.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.746+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.2~syI2OwC_ZA7fE9dP7C6mDOFFDdC5WXz.6 2024-09-12T01:04:39.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.746+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2898883345758951101', time=2024-09-12T02:57:37.167600+0000, chain.objs.size()=1 2024-09-12T01:04:39.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.746+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:zaVo6T2N4sTfWzu5GcBxuuoejRG1sJy_.BTZERaKI2I9S3lqetgBsp591gdgq7fp_0 2024-09-12T01:04:39.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.746+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15902291482762221626', time=2024-09-12T02:57:42.534480+0000, chain.objs.size()=7 2024-09-12T01:04:39.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.746+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.578__multipart_testobj.2~I-wyUXOgKZMhTvI0p2EnkbX8yPnnlP-.1 2024-09-12T01:04:39.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.746+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.578__shadow_testobj.2~I-wyUXOgKZMhTvI0p2EnkbX8yPnnlP-.1_1 2024-09-12T01:04:39.747 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.746+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.578__multipart_testobj.2~I-wyUXOgKZMhTvI0p2EnkbX8yPnnlP-.2 2024-09-12T01:04:39.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.750+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.578__shadow_testobj.2~I-wyUXOgKZMhTvI0p2EnkbX8yPnnlP-.2_1 2024-09-12T01:04:39.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.750+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.578__multipart_testobj.2~I-wyUXOgKZMhTvI0p2EnkbX8yPnnlP-.3 2024-09-12T01:04:39.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.750+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.578__shadow_testobj.2~I-wyUXOgKZMhTvI0p2EnkbX8yPnnlP-.3_1 2024-09-12T01:04:39.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.750+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.578__multipart_testobj.2~I-wyUXOgKZMhTvI0p2EnkbX8yPnnlP-.4 2024-09-12T01:04:39.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.750+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13549322979496064465', time=2024-09-12T03:01:04.243471+0000, chain.objs.size()=6 2024-09-12T01:04:39.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.750+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.660__multipart_bar.2~VV2H49poqa8juZKMkR43_U1yNlISGem.1 2024-09-12T01:04:39.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.750+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.660__multipart_bar.2~VV2H49poqa8juZKMkR43_U1yNlISGem.2 2024-09-12T01:04:39.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.750+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.660__multipart_bar.2~VV2H49poqa8juZKMkR43_U1yNlISGem.3 2024-09-12T01:04:39.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.750+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.660__multipart_bar.2~VV2H49poqa8juZKMkR43_U1yNlISGem.4 2024-09-12T01:04:39.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.750+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.660__multipart_bar.2~VV2H49poqa8juZKMkR43_U1yNlISGem.5 2024-09-12T01:04:39.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.750+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.660__multipart_bar.2~VV2H49poqa8juZKMkR43_U1yNlISGem.6 2024-09-12T01:04:39.752 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.754+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:39.755 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.754+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:04:39.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.754+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:39.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.758+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:39.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.758+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47744' 2024-09-12T01:04:39.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.758+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='_DZ6qJ02HZ73CUreKFYlGgX66cmPFRLn', time=2024-09-12T02:48:32.052221+0000, chain.objs.size()=3 2024-09-12T01:04:39.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.758+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.160__shadow_.F1825k9a9NxhSEsW3TDyyTwoAY7BA4-_0 2024-09-12T01:04:39.758 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.758+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.160__shadow_.F1825k9a9NxhSEsW3TDyyTwoAY7BA4-_1 2024-09-12T01:04:39.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.758+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.160__shadow_.F1825k9a9NxhSEsW3TDyyTwoAY7BA4-_2 2024-09-12T01:04:39.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.758+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12606185553717646840', time=2024-09-12T02:50:42.724353+0000, chain.objs.size()=1 2024-09-12T01:04:39.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.758+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.231__shadow_.GSeKPFyXSDKZmo3gJn2xM9QtxnFC-Wo_0 2024-09-12T01:04:39.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.758+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7712625661023635978', time=2024-09-12T02:50:54.230659+0000, chain.objs.size()=1 2024-09-12T01:04:39.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.758+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.244__shadow_.tbuJdFZWY5HP51NHAq-3kwPOGppK6HW_0 2024-09-12T01:04:39.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.758+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9648905266791695215', time=2024-09-12T02:50:54.944010+0000, chain.objs.size()=1 2024-09-12T01:04:39.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.758+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.245__shadow_.UhwSTpeqndXP3QrKaIZrTTxJl-LUEuN_0 2024-09-12T01:04:39.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.758+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3820529802487690256', time=2024-09-12T02:51:00.336103+0000, chain.objs.size()=1 2024-09-12T01:04:39.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.758+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.252__shadow_.Fxmg7E_28SCG--KC6qxY0lCbdleDiml_0 2024-09-12T01:04:39.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.758+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8815814201760999826', time=2024-09-12T02:51:26.774479+0000, chain.objs.size()=1 2024-09-12T01:04:39.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.758+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.MFCP21izURQCuNVgW7JfyoM79jct3cC_0 2024-09-12T01:04:39.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.758+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11854340723005260124', time=2024-09-12T02:51:26.794233+0000, chain.objs.size()=1 2024-09-12T01:04:39.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.758+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.jQzHXRUNOsJhajEy04efR7rWWkPDDNe_0 2024-09-12T01:04:39.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.758+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.771978304595643978', time=2024-09-12T02:51:26.888388+0000, chain.objs.size()=1 2024-09-12T01:04:39.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.758+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.iTSs0jRSJ5fqBO74IlA7ykG3N3YNPh6_0 2024-09-12T01:04:39.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.758+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10187146250492789271', time=2024-09-12T02:51:26.997208+0000, chain.objs.size()=1 2024-09-12T01:04:39.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.758+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Tewjiitgk7A34fHikY3Tq08_-I6ON1S_0 2024-09-12T01:04:39.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.758+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8120032726553209024', time=2024-09-12T02:51:27.080179+0000, chain.objs.size()=1 2024-09-12T01:04:39.760 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.758+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.epELc80lnih9LYKR9HNtiVqu7K8PwAm_0 2024-09-12T01:04:39.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.758+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11293951259303256711', time=2024-09-12T02:51:27.271332+0000, chain.objs.size()=1 2024-09-12T01:04:39.761 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.758+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.s2wZCONN44RjbF6QCDGiS8hGVoZS6M7_0 2024-09-12T01:04:39.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.758+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7475496208543321462', time=2024-09-12T02:51:27.288906+0000, chain.objs.size()=1 2024-09-12T01:04:39.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.758+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.BufXLxsZsYhIY1TzA1VguH_DAMIcwNN_0 2024-09-12T01:04:39.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.264677921155649331', time=2024-09-12T02:51:27.457250+0000, chain.objs.size()=1 2024-09-12T01:04:39.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.btAc4lCSjHWwhP6s8GuhL4uMoigtKLt_0 2024-09-12T01:04:39.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3362647985092716938', time=2024-09-12T02:51:27.499152+0000, chain.objs.size()=1 2024-09-12T01:04:39.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.JfKfZfnHVer-ovji_4brst0SFTJYO_c_0 2024-09-12T01:04:39.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8773946532926757314', time=2024-09-12T02:51:27.499742+0000, chain.objs.size()=1 2024-09-12T01:04:39.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.HH5N3djsU002pEggv7JJxTyeoqNP453_0 2024-09-12T01:04:39.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14085326102367479999', time=2024-09-12T02:51:27.526780+0000, chain.objs.size()=1 2024-09-12T01:04:39.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.mjpiLE0PpSOPHbl9ecFFblhfjMDUOeC_0 2024-09-12T01:04:39.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15113186743940352567', time=2024-09-12T02:51:27.646055+0000, chain.objs.size()=1 2024-09-12T01:04:39.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.OR3zlej4stgGWYweL4L5TLVhRQhh4Uj_0 2024-09-12T01:04:39.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8983747545333133683', time=2024-09-12T02:51:27.676010+0000, chain.objs.size()=1 2024-09-12T01:04:39.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.tXmNW7uFcYXuZTUZptt2MHMJnVba6IM_0 2024-09-12T01:04:39.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2761923442024843929', time=2024-09-12T02:51:27.691808+0000, chain.objs.size()=1 2024-09-12T01:04:39.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.nifFZkZqoQiQaEtdqSTBsmf6u8KkrbH_0 2024-09-12T01:04:39.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10581547336013053133', time=2024-09-12T02:51:27.714881+0000, chain.objs.size()=1 2024-09-12T01:04:39.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.R_PBuUyRRv_mJh9zMJljq5JhHzdVHtj_0 2024-09-12T01:04:39.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5951172877429761202', time=2024-09-12T02:51:27.719735+0000, chain.objs.size()=1 2024-09-12T01:04:39.763 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.pdeTbF208RCJoYO6vIAK-0E_TaJSwbp_0 2024-09-12T01:04:39.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17965744119729328428', time=2024-09-12T02:51:27.726044+0000, chain.objs.size()=1 2024-09-12T01:04:39.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.koUO_hiyzrDgdQb_4u7EdTMcR2zmH2I_0 2024-09-12T01:04:39.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10954908878553897267', time=2024-09-12T02:51:27.733855+0000, chain.objs.size()=1 2024-09-12T01:04:39.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.IKPQLMTNScfDpM-UjkSXKuZtnRGcyO3_0 2024-09-12T01:04:39.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.484957219638001316', time=2024-09-12T02:51:27.884725+0000, chain.objs.size()=1 2024-09-12T01:04:39.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.0RgbWe5l2DAEE6K75fWR0BUCztx0uIY_0 2024-09-12T01:04:39.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12029074876239896728', time=2024-09-12T02:51:27.933719+0000, chain.objs.size()=1 2024-09-12T01:04:39.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.fEVaCJ86PCC_b6iANpw-m_LIoH9Bj9P_0 2024-09-12T01:04:39.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16484785434918371497', time=2024-09-12T02:51:27.936530+0000, chain.objs.size()=1 2024-09-12T01:04:39.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.yeYuQNq4eFK87VHyS9vT3tAVE6Zrzzx_0 2024-09-12T01:04:39.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16133204355225806110', time=2024-09-12T02:51:27.941002+0000, chain.objs.size()=1 2024-09-12T01:04:39.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.k5zQiqCYvigTTptp3C0SaSEUiB8LnWQ_0 2024-09-12T01:04:39.765 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17063567230676249808', time=2024-09-12T02:51:27.943417+0000, chain.objs.size()=1 2024-09-12T01:04:39.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.PUMy5XfeRnpwqfRxJOyvjIwlezcB5-N_0 2024-09-12T01:04:39.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.957760544496468400', time=2024-09-12T02:51:27.958168+0000, chain.objs.size()=1 2024-09-12T01:04:39.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.mD2Q_RO2lcQr-7ELfI5Lo66VTaa-DJD_0 2024-09-12T01:04:39.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11889000879951192131', time=2024-09-12T02:51:27.959000+0000, chain.objs.size()=1 2024-09-12T01:04:39.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.3cQIaS-GDqnUQ9LdW_34EqReOYzy_W-_0 2024-09-12T01:04:39.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4965407236941618885', time=2024-09-12T02:51:28.188716+0000, chain.objs.size()=1 2024-09-12T01:04:39.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.v81-vYLBvSDWQhR5k3xuKHIUF_aeElS_0 2024-09-12T01:04:39.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4124088676764870722', time=2024-09-12T02:51:28.209177+0000, chain.objs.size()=1 2024-09-12T01:04:39.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.baaYxvOwC-mCYsNlr7lj9VpIx3wJ8TE_0 2024-09-12T01:04:39.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7380433630624729538', time=2024-09-12T02:51:28.234583+0000, chain.objs.size()=1 2024-09-12T01:04:39.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.762+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Y21hnFgHB82cQ0PDh0P2ywqbeKpYd-v_0 2024-09-12T01:04:39.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.766+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7204354265926246080', time=2024-09-12T02:51:28.361151+0000, chain.objs.size()=1 2024-09-12T01:04:39.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.766+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.GggTwN5gJqVORpjqIA2arDKR4cVfR8W_0 2024-09-12T01:04:39.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.766+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5555461412902998146', time=2024-09-12T02:51:28.639753+0000, chain.objs.size()=1 2024-09-12T01:04:39.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.766+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.L96Q4yjx6TRAOnqU7bbrZVEQ5kcweG4_0 2024-09-12T01:04:39.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.766+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16091441499446173169', time=2024-09-12T02:51:28.672333+0000, chain.objs.size()=1 2024-09-12T01:04:39.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.766+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.gFfh4eNtxKMHE_TRxMQ33rLvpq17g9z_0 2024-09-12T01:04:39.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.766+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8232732871723413142', time=2024-09-12T02:51:37.251476+0000, chain.objs.size()=1 2024-09-12T01:04:39.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.766+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.274__shadow_.U3QvprmFV40gsQ3U7ZFIPN-AHXx30in_0 2024-09-12T01:04:39.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.766+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2714004743983809961', time=2024-09-12T02:51:46.268300+0000, chain.objs.size()=1 2024-09-12T01:04:39.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.766+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.286__shadow_.RQplN2mNHZOXNYBsvvBrWkXD1K9k0cM_0 2024-09-12T01:04:39.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.766+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11178473397459444888', time=2024-09-12T02:51:46.270430+0000, chain.objs.size()=1 2024-09-12T01:04:39.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.766+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.286__shadow_.p7LlMVTswtcXv3H-JywfVCbyM9ZGl28_0 2024-09-12T01:04:39.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.766+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17629721955699747161', time=2024-09-12T02:51:46.988723+0000, chain.objs.size()=1 2024-09-12T01:04:39.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.766+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.287__shadow_.EH1_7OaYle4SwoYM7HxavBKj5rdQrvM_0 2024-09-12T01:04:39.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.766+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8066553181316317633', time=2024-09-12T02:51:51.722539+0000, chain.objs.size()=1 2024-09-12T01:04:39.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.766+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.292__shadow_.L05N4_j-kE2JGfwfDOn8RWB7dXwB-db_0 2024-09-12T01:04:39.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.766+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10027395871497297974', time=2024-09-12T02:51:51.726635+0000, chain.objs.size()=1 2024-09-12T01:04:39.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.766+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.292__shadow_.01fzOGax7hoWgLKTPJ4UFerhOsq3CVU_0 2024-09-12T01:04:39.769 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.766+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3997111991532274558', time=2024-09-12T02:51:53.165969+0000, chain.objs.size()=1 2024-09-12T01:04:39.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.766+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.293__shadow_.z1RfOaWL00T7YMq-fXzrHGh72RpFwOc_0 2024-09-12T01:04:39.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.766+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.97496280052132200', time=2024-09-12T02:52:12.949776+0000, chain.objs.size()=1 2024-09-12T01:04:39.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.766+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.319__shadow:PGfsMorNTmzhgni2G.yiUFuCmMFm2J0_.-7YooRaa1xPYc7UAt_PgbyZZZZpQ-Xr_0 2024-09-12T01:04:39.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.766+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8038092795901053221', time=2024-09-12T02:52:34.822471+0000, chain.objs.size()=1 2024-09-12T01:04:39.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.766+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.cP3WldwN73vfk9DltLCMigKRuEzn4NL_0 2024-09-12T01:04:39.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.766+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18443534610660105356', time=2024-09-12T02:52:35.162630+0000, chain.objs.size()=1 2024-09-12T01:04:39.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.766+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.UwKXLPoYLM9LB93S5z2t6k-_hOjJXzX_0 2024-09-12T01:04:39.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.766+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12232240092918595676', time=2024-09-12T02:52:35.172237+0000, chain.objs.size()=1 2024-09-12T01:04:39.770 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.766+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.l_IxBmFapE3XHwzn0Z7Z2s1GAnua6Td_0 2024-09-12T01:04:39.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.766+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14372584116755101245', time=2024-09-12T02:52:35.333454+0000, chain.objs.size()=1 2024-09-12T01:04:39.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.766+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.JebkC_apBwazEpDCSZneEEz5x03PdPZ_0 2024-09-12T01:04:39.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13328384847202202545', time=2024-09-12T02:52:35.350628+0000, chain.objs.size()=1 2024-09-12T01:04:39.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.eiq4Iy63NaQJRi0BiFKnO7yZQnm-GUl_0 2024-09-12T01:04:39.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6830450455898497657', time=2024-09-12T02:52:35.386666+0000, chain.objs.size()=1 2024-09-12T01:04:39.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.tb3olyPib7e64S6Qph9DnoV-QXebg51_0 2024-09-12T01:04:39.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9313575914325808055', time=2024-09-12T02:52:35.393432+0000, chain.objs.size()=1 2024-09-12T01:04:39.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.AaCXOaqlbN1CBdLwV766CYsePSvjDf9_0 2024-09-12T01:04:39.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7240060893400490852', time=2024-09-12T02:52:35.537302+0000, chain.objs.size()=1 2024-09-12T01:04:39.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.zr6Av4uFRALnih9yeDCFAZelLWFDsmc_0 2024-09-12T01:04:39.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17207258167488124045', time=2024-09-12T02:52:35.571279+0000, chain.objs.size()=1 2024-09-12T01:04:39.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.COpDhQBXQD6tc3FIq8TZuEMyF-wctIw_0 2024-09-12T01:04:39.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3995694299780638501', time=2024-09-12T02:52:35.584754+0000, chain.objs.size()=1 2024-09-12T01:04:39.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.N95srWt27VSg4Ei5-SaHnInwZiFUrmz_0 2024-09-12T01:04:39.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12245127795045454979', time=2024-09-12T02:52:35.601089+0000, chain.objs.size()=1 2024-09-12T01:04:39.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.JY4D2OC97mbuEBMq6J1yMUbP_Uk1yfd_0 2024-09-12T01:04:39.773 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13075037413317345050', time=2024-09-12T02:52:35.617158+0000, chain.objs.size()=1 2024-09-12T01:04:39.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.gacgLM8G0hzWCL8VVFJ80YLYmsO1UNY_0 2024-09-12T01:04:39.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3547561797285302272', time=2024-09-12T02:52:35.621254+0000, chain.objs.size()=1 2024-09-12T01:04:39.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.bCTPtfSsnrDlVgh2LOsDLZYWxob5KBJ_0 2024-09-12T01:04:39.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10053876867089889684', time=2024-09-12T02:52:35.877991+0000, chain.objs.size()=1 2024-09-12T01:04:39.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.RX6AChn8YvuG1OlXbO_sgzPPE5oDvR8_0 2024-09-12T01:04:39.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2878122771678394691', time=2024-09-12T02:52:35.881147+0000, chain.objs.size()=1 2024-09-12T01:04:39.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.qBHp5rMSbVmIwYc0--IckDsEVoTwdBH_0 2024-09-12T01:04:39.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6314510527810514508', time=2024-09-12T02:52:36.237499+0000, chain.objs.size()=1 2024-09-12T01:04:39.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.0lRj9acF76uVGcQ7j2KkY89fd7LFIr1_0 2024-09-12T01:04:39.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12143699435221143136', time=2024-09-12T02:52:36.310107+0000, chain.objs.size()=1 2024-09-12T01:04:39.774 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Q0KgnTDeBC5wilrE2H_qX9-Sixag027_0 2024-09-12T01:04:39.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9298639346441637400', time=2024-09-12T02:52:36.335727+0000, chain.objs.size()=1 2024-09-12T01:04:39.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.t1nlk6vUmpIddaVxDR-0v9_R1rw-aRm_0 2024-09-12T01:04:39.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14313329493972145251', time=2024-09-12T02:52:36.368755+0000, chain.objs.size()=1 2024-09-12T01:04:39.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.JGk0-eDxkP5_BukTwV3Qam47nMuhiQr_0 2024-09-12T01:04:39.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12149512942287830980', time=2024-09-12T02:52:36.376361+0000, chain.objs.size()=1 2024-09-12T01:04:39.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.IWULCXvqblvxUNqAIEQn6f05X5pPDC0_0 2024-09-12T01:04:39.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16607062635386875762', time=2024-09-12T02:52:36.609271+0000, chain.objs.size()=1 2024-09-12T01:04:39.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.t8pIbZ0mczxLMo9wTKGmUFtl2PdFojc_0 2024-09-12T01:04:39.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4540597491317464619', time=2024-09-12T02:52:36.617507+0000, chain.objs.size()=1 2024-09-12T01:04:39.775 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.JvRkReTTpDiEPF0CRhXngWPvNhIETI0_0 2024-09-12T01:04:39.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15753476940584239837', time=2024-09-12T02:52:36.631168+0000, chain.objs.size()=1 2024-09-12T01:04:39.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.pkKwsHBVMSeDapY-wdlfHLha0i06u2B_0 2024-09-12T01:04:39.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.311705569718672309', time=2024-09-12T02:52:36.816989+0000, chain.objs.size()=1 2024-09-12T01:04:39.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.wtaEXwQZf32oRMcO-bs07vfPtgvnV3S_0 2024-09-12T01:04:39.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4785028176900876273', time=2024-09-12T02:52:36.820241+0000, chain.objs.size()=1 2024-09-12T01:04:39.776 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.770+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.I_S1UMCeiQQJB5QFWgN17bxtYiED7uc_0 2024-09-12T01:04:39.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.774+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5823743587149157599', time=2024-09-12T02:52:36.829553+0000, chain.objs.size()=1 2024-09-12T01:04:39.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.774+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.zQij4eU6nSF1LtEwc9VWA6VF0x1VO69_0 2024-09-12T01:04:39.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.774+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6626041230862299933', time=2024-09-12T02:52:36.840589+0000, chain.objs.size()=1 2024-09-12T01:04:39.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.774+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.cfLs1wHIAf3i0h6xHykPW7L2OTYD80i_0 2024-09-12T01:04:39.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.774+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6644626502948857357', time=2024-09-12T02:52:37.019501+0000, chain.objs.size()=1 2024-09-12T01:04:39.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.774+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.jbRPAbbpn4l2rnTyNAGq8VUfeqaUDMo_0 2024-09-12T01:04:39.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.774+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12402521427586172867', time=2024-09-12T02:52:37.060559+0000, chain.objs.size()=1 2024-09-12T01:04:39.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.774+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.aLyeg7YsGSPBryHgVz8Sz-mtyEQgLcM_0 2024-09-12T01:04:39.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.774+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16260432609399002571', time=2024-09-12T02:52:37.077264+0000, chain.objs.size()=1 2024-09-12T01:04:39.778 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.774+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.N0Ijg5APEFY2HBwhlSBXTeTCsvMXokA_0 2024-09-12T01:04:39.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.774+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7935426404213020107', time=2024-09-12T02:52:37.090189+0000, chain.objs.size()=1 2024-09-12T01:04:39.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.774+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.m6bB0VLSYuTFd-NGtiVMnR6CI-W6x0y_0 2024-09-12T01:04:39.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.774+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17153903321160037005', time=2024-09-12T02:52:56.946525+0000, chain.objs.size()=1 2024-09-12T01:04:39.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.774+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.KeFduja5sD8Q74h3NBPU6nojOEZbL7M_0 2024-09-12T01:04:39.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.774+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5255575092968235467', time=2024-09-12T02:52:57.019928+0000, chain.objs.size()=1 2024-09-12T01:04:39.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.774+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.qpud9DmdXNhZmozgklmP8EEOwLJHOL9_0 2024-09-12T01:04:39.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.774+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7977184490394146935', time=2024-09-12T02:52:57.028317+0000, chain.objs.size()=1 2024-09-12T01:04:39.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.774+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_._2F9nqSVNdISf4KoumENz9bnSauzk3h_0 2024-09-12T01:04:39.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.774+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6793352226655603519', time=2024-09-12T02:52:57.229494+0000, chain.objs.size()=1 2024-09-12T01:04:39.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.774+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.iYdDoipNSl7FiUhWbmZJr8meW8gkVbs_0 2024-09-12T01:04:39.779 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.774+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8302886875356205322', time=2024-09-12T02:52:57.283822+0000, chain.objs.size()=1 2024-09-12T01:04:39.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.774+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.F_9F8lIHIE5PlkUqiYi0myPv9G7k6O9_0 2024-09-12T01:04:39.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.774+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1912247157979622585', time=2024-09-12T02:52:57.427735+0000, chain.objs.size()=1 2024-09-12T01:04:39.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.774+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.3RfKAQDF4T6AkY4ngOe-xHjAPG8j7eg_0 2024-09-12T01:04:39.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.774+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9341321446232728768', time=2024-09-12T02:52:57.476253+0000, chain.objs.size()=1 2024-09-12T01:04:39.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.774+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Xt8rXPVB7mV4eJk7EWOLgfvxBphLqZm_0 2024-09-12T01:04:39.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14730467614205020333', time=2024-09-12T02:52:57.498290+0000, chain.objs.size()=1 2024-09-12T01:04:39.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.VgMrDtbsCFbhB9JF7OBDesGb1Lknb7w_0 2024-09-12T01:04:39.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1125040002098136034', time=2024-09-12T02:52:57.521973+0000, chain.objs.size()=1 2024-09-12T01:04:39.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.iczSHzUzSD5pW_amtguXYJHhkd68i2w_0 2024-09-12T01:04:39.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10761239387036325644', time=2024-09-12T02:52:57.532143+0000, chain.objs.size()=1 2024-09-12T01:04:39.780 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.waqL6FN7ZQB4ltAtjy-lsrI_wL5qlj8_0 2024-09-12T01:04:39.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2851930831794277234', time=2024-09-12T02:52:57.650734+0000, chain.objs.size()=1 2024-09-12T01:04:39.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_._NdxBxZv3Ov7BSMLO0z-2-e3E5vMrSV_0 2024-09-12T01:04:39.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9626285429768822823', time=2024-09-12T02:52:57.684536+0000, chain.objs.size()=1 2024-09-12T01:04:39.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.SMUsUgOxTpsqezlY4RYu3oSYN-gdm2q_0 2024-09-12T01:04:39.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11633717171610273621', time=2024-09-12T02:52:57.702051+0000, chain.objs.size()=1 2024-09-12T01:04:39.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.m4nrY3UvprHpyV2-2spfHKLNc-ABNjZ_0 2024-09-12T01:04:39.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3123796941629160976', time=2024-09-12T02:52:57.728627+0000, chain.objs.size()=1 2024-09-12T01:04:39.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.0mGlth-4ZTDGwSLGl3ZLJIfXXtYYk8R_0 2024-09-12T01:04:39.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16914040160732914919', time=2024-09-12T02:52:57.742345+0000, chain.objs.size()=1 2024-09-12T01:04:39.781 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ID06cwgYslkHyNpOfoIapumNtecOctY_0 2024-09-12T01:04:39.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9370633309135156739', time=2024-09-12T02:52:57.883309+0000, chain.objs.size()=1 2024-09-12T01:04:39.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.trFoesYhRDXDpJwtxjlfP1TUaOe5cmp_0 2024-09-12T01:04:39.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8676751057558094536', time=2024-09-12T02:52:57.884539+0000, chain.objs.size()=1 2024-09-12T01:04:39.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.vvjxRPYGc4Kb1YH0ABr5m_Qh1VB0-EN_0 2024-09-12T01:04:39.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6868260220761501997', time=2024-09-12T02:52:57.956579+0000, chain.objs.size()=1 2024-09-12T01:04:39.782 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.uETVb-6sQLyUr6qJGiToKFm3yTqYzR-_0 2024-09-12T01:04:39.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7018297695727536820', time=2024-09-12T02:52:57.959811+0000, chain.objs.size()=1 2024-09-12T01:04:39.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.7Eu_3dU_m1jP3dN8xyw2nlF2SOwqLAf_0 2024-09-12T01:04:39.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16075831288587351885', time=2024-09-12T02:52:58.147880+0000, chain.objs.size()=1 2024-09-12T01:04:39.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.oKGnm49pJcl7Egv8kp0Um4RSGq4NUSE_0 2024-09-12T01:04:39.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16973305521018152719', time=2024-09-12T02:52:58.170919+0000, chain.objs.size()=1 2024-09-12T01:04:39.783 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.qRjGYN5ydjN0MRdsGiyLxjJTgYt_rF-_0 2024-09-12T01:04:39.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4649107738548604180', time=2024-09-12T02:52:58.172666+0000, chain.objs.size()=1 2024-09-12T01:04:39.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.IyNcUmm-rWakzT0JsgfXR2uP8avcCwr_0 2024-09-12T01:04:39.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.498965111688723968', time=2024-09-12T02:52:58.185981+0000, chain.objs.size()=1 2024-09-12T01:04:39.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.YAYwymnZ6DsqsNSwp0Wq6t7Ud-9ZEBg_0 2024-09-12T01:04:39.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13486423127166437850', time=2024-09-12T02:52:58.189754+0000, chain.objs.size()=1 2024-09-12T01:04:39.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.VBnOUgiqEep7-pqxiFSHgQY55PTFSfh_0 2024-09-12T01:04:39.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15150569242113211221', time=2024-09-12T02:52:58.202379+0000, chain.objs.size()=1 2024-09-12T01:04:39.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.778+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.2QIaKTa73FX2yGYk5bev_ApxG5yWhay_0 2024-09-12T01:04:39.784 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.782+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47744 2024-09-12T01:04:39.785 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.782+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T01:04:39.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.782+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7762593310722016224', time=2024-09-12T02:52:58.375741+0000, chain.objs.size()=1 2024-09-12T01:04:39.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.782+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ma2hqyfCOVfaWQh50FJhvWxz8S6Iwaj_0 2024-09-12T01:04:39.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.782+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3946172393866301553', time=2024-09-12T02:52:58.422024+0000, chain.objs.size()=1 2024-09-12T01:04:39.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.782+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.sIQUzeymiCRevJewNRWiXT0goAheXs0_0 2024-09-12T01:04:39.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.782+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9262004781874083651', time=2024-09-12T02:52:58.439364+0000, chain.objs.size()=1 2024-09-12T01:04:39.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.782+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ceaKDSr1Bq_aKEDrt2_Z7I5b-c2dvgx_0 2024-09-12T01:04:39.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.782+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5979292381508102306', time=2024-09-12T02:52:58.649726+0000, chain.objs.size()=1 2024-09-12T01:04:39.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.782+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.tO6P_N7NaJ1AmlodgoSij4_ARmxMeY2_0 2024-09-12T01:04:39.786 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.782+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8990282932529630636', time=2024-09-12T02:52:58.651287+0000, chain.objs.size()=1 2024-09-12T01:04:39.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.782+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.iQDkifq31H0lylzEExon68YygMwaAb7_0 2024-09-12T01:04:39.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.782+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8152454530891858771', time=2024-09-12T02:52:58.665444+0000, chain.objs.size()=1 2024-09-12T01:04:39.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.782+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.l9K5DwooTSBM_dyX4Rn5G4ErSZ9z4QZ_0 2024-09-12T01:04:39.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.782+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3018866704355951233', time=2024-09-12T02:52:58.685084+0000, chain.objs.size()=1 2024-09-12T01:04:39.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.782+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.HHRxHrlte_3SVU-_t0Co3NMLZoj3TF3_0 2024-09-12T01:04:39.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.782+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15230050538151584224', time=2024-09-12T02:52:58.688711+0000, chain.objs.size()=1 2024-09-12T01:04:39.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.782+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.aKJ4ODJ0pSP5PLguOzC1F9yvOTWPP4C_0 2024-09-12T01:04:39.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.782+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16190255616773861026', time=2024-09-12T02:53:05.301058+0000, chain.objs.size()=1 2024-09-12T01:04:39.787 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.782+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.334__shadow_.WjrPXrN6RIH-pl-G-8ao2leqV8aXqys_0 2024-09-12T01:04:39.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.782+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7151042094727161056', time=2024-09-12T02:54:53.304725+0000, chain.objs.size()=1 2024-09-12T01:04:39.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.782+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.483__shadow_.Oxlh7EE78hOGxwomgUR8iCd8-GljGI__0 2024-09-12T01:04:39.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.782+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8172334846684180516', time=2024-09-12T02:54:53.313692+0000, chain.objs.size()=1 2024-09-12T01:04:39.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.782+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.483__shadow_.0JQf4KP_B-EMaIc3-mlUoP0j27a-kjb_0 2024-09-12T01:04:39.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.782+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11008401388251040225', time=2024-09-12T02:54:54.112305+0000, chain.objs.size()=1 2024-09-12T01:04:39.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.782+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.484__shadow_.c2_BB37MGXNkVDE6cWO7RGYPthdGsGJ_0 2024-09-12T01:04:39.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.786+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2969608369762229593', time=2024-09-12T02:54:54.630339+0000, chain.objs.size()=1 2024-09-12T01:04:39.788 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.786+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.485__shadow_.aXA93WN81wQHzGJgS9zZeGswk5WLJg__0 2024-09-12T01:04:39.789 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.786+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12525430695420540875', time=2024-09-12T02:55:02.235492+0000, chain.objs.size()=1 2024-09-12T01:04:39.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.786+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.496__shadow_.WSF2MLxY6ypUY29ux4prXQTYgfIazJE_0 2024-09-12T01:04:39.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.786+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4911481758940610720', time=2024-09-12T02:55:11.216944+0000, chain.objs.size()=6 2024-09-12T01:04:39.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.786+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.1 2024-09-12T01:04:39.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.786+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.2 2024-09-12T01:04:39.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.786+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.3 2024-09-12T01:04:39.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.786+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.4 2024-09-12T01:04:39.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.786+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.5 2024-09-12T01:04:39.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.786+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.6 2024-09-12T01:04:39.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.786+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2130370204944494147', time=2024-09-12T02:57:20.941826+0000, chain.objs.size()=1 2024-09-12T01:04:39.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.786+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.576__shadow:VOqGgMfOOW0pMcQ4dcsL8ITjD9Cyglv_.EetJAgkkdhI6rXcChIBGmp-_QRFncmF_0 2024-09-12T01:04:39.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.786+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8470853095012774156', time=2024-09-12T02:57:32.944409+0000, chain.objs.size()=1 2024-09-12T01:04:39.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.786+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:YM0RdMusWV-TH6lId9lM4xEVfxhoRR3_.cJvF-o68DgPJmyCH46dT0MoQQN8EFB0_0 2024-09-12T01:04:39.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.786+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1255669841154074389', time=2024-09-12T02:57:34.576670+0000, chain.objs.size()=1 2024-09-12T01:04:39.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.786+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:JsZuStjR4u-9NuJ.OgrvMepAiC951L7_.Sr_rtmzTiLX4IdJaVlvoktt0Zyot8c-_0 2024-09-12T01:04:39.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.786+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2973268462159518621', time=2024-09-12T02:57:46.314391+0000, chain.objs.size()=1 2024-09-12T01:04:39.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.786+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.580__shadow:zRIZKMp0kS3eLjGXIXHWR8x5alkErB2_.tAFjdM4_W4FjfMT3CrCSpCD7k5Ewdpj_0 2024-09-12T01:04:39.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.786+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17329589145662972336', time=2024-09-12T03:00:46.321783+0000, chain.objs.size()=2 2024-09-12T01:04:39.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.786+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.642__shadow_.0Qedm4fikfPXCYHSPCA1CMlz-jno6H4_0 2024-09-12T01:04:39.791 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.786+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.642__shadow_.0Qedm4fikfPXCYHSPCA1CMlz-jno6H4_1 2024-09-12T01:04:39.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.790+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:39.793 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.794+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:04:39.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.794+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:39.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.794+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:39.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.798+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54863' 2024-09-12T01:04:39.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.798+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16014476294396186175', time=2024-09-12T02:48:31.918166+0000, chain.objs.size()=3 2024-09-12T01:04:39.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.798+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.160__shadow_.ow9SedKw-Hm9bE_C6elxo6w6m6b6CBd_0 2024-09-12T01:04:39.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.798+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.160__shadow_.ow9SedKw-Hm9bE_C6elxo6w6m6b6CBd_1 2024-09-12T01:04:39.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.798+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.160__shadow_.ow9SedKw-Hm9bE_C6elxo6w6m6b6CBd_2 2024-09-12T01:04:39.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.798+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15829814875784358284', time=2024-09-12T02:48:34.473907+0000, chain.objs.size()=5 2024-09-12T01:04:39.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.798+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.161__multipart_foo-LUKEWARM.2~o5Y4bGP6OAsgUgkwjuw55oTvjfdsr6V.1 2024-09-12T01:04:39.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.798+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.161__shadow_foo-LUKEWARM.2~o5Y4bGP6OAsgUgkwjuw55oTvjfdsr6V.1_1 2024-09-12T01:04:39.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.798+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.161__multipart_foo-LUKEWARM.2~o5Y4bGP6OAsgUgkwjuw55oTvjfdsr6V.2 2024-09-12T01:04:39.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.798+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.161__shadow_foo-LUKEWARM.2~o5Y4bGP6OAsgUgkwjuw55oTvjfdsr6V.2_1 2024-09-12T01:04:39.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.798+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.161__multipart_foo-LUKEWARM.2~o5Y4bGP6OAsgUgkwjuw55oTvjfdsr6V.3 2024-09-12T01:04:39.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.798+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2408425256465261005', time=2024-09-12T02:50:45.703172+0000, chain.objs.size()=1 2024-09-12T01:04:39.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.798+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.235__shadow_.N8YELUa1zM1-UQ408jx_ebQnsLYWO3I_0 2024-09-12T01:04:39.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.798+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16706300364358955105', time=2024-09-12T02:51:26.768098+0000, chain.objs.size()=1 2024-09-12T01:04:39.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.798+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.9OsIFErjhmTiSv4aSxXVZjmYoTFr_Fg_0 2024-09-12T01:04:39.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.798+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16325642493606048486', time=2024-09-12T02:51:26.858868+0000, chain.objs.size()=1 2024-09-12T01:04:39.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.798+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.fNdq5WP5Cq38iMijus9qsBwWQxd-IWD_0 2024-09-12T01:04:39.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.798+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5298701643748114233', time=2024-09-12T02:51:26.859872+0000, chain.objs.size()=1 2024-09-12T01:04:39.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.798+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Egt6QZpHzhmKhm6U7DmvvGYqrTGD6Cq_0 2024-09-12T01:04:39.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.798+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17832925223938972816', time=2024-09-12T02:51:27.044217+0000, chain.objs.size()=1 2024-09-12T01:04:39.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.798+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.S6LInbequjB-ckxz4is7Sb6l65lNNQz_0 2024-09-12T01:04:39.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12167478297566087735', time=2024-09-12T02:51:27.422869+0000, chain.objs.size()=1 2024-09-12T01:04:39.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.06PdybHjNyjquwrBSoswcGdKjjBFqLt_0 2024-09-12T01:04:39.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1743401648557506583', time=2024-09-12T02:51:27.424309+0000, chain.objs.size()=1 2024-09-12T01:04:39.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.TlA4YNnQ7bKpvA9YN3i8KGNIkVRGPEh_0 2024-09-12T01:04:39.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5492683242244039417', time=2024-09-12T02:51:27.487913+0000, chain.objs.size()=1 2024-09-12T01:04:39.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.9N_8-Xl3OJbL1jX0YGqar9gFjY09eNA_0 2024-09-12T01:04:39.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14505804043222568242', time=2024-09-12T02:51:27.492816+0000, chain.objs.size()=1 2024-09-12T01:04:39.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_._YThQZ70hXprpngE9axQL0HvRYWPRw6_0 2024-09-12T01:04:39.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13829894549357841091', time=2024-09-12T02:51:27.501723+0000, chain.objs.size()=1 2024-09-12T01:04:39.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.1T9XvBAgMFbDxElR01SJYJq-hdKjHZ1_0 2024-09-12T01:04:39.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6196642613927403699', time=2024-09-12T02:51:27.526009+0000, chain.objs.size()=1 2024-09-12T01:04:39.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Ipvvw9jNcXK30PyLdxg4P_mpUboYuOx_0 2024-09-12T01:04:39.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10474906762806459311', time=2024-09-12T02:51:27.624546+0000, chain.objs.size()=1 2024-09-12T01:04:39.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ECR9o11jbE0I9og7PgoxiD0L1CI20yI_0 2024-09-12T01:04:39.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17113970363401508918', time=2024-09-12T02:51:27.667873+0000, chain.objs.size()=1 2024-09-12T01:04:39.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.aIjasV7MvZHiiD_3SPa-lN9HmLf75qv_0 2024-09-12T01:04:39.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5478426167125736557', time=2024-09-12T02:51:27.679097+0000, chain.objs.size()=1 2024-09-12T01:04:39.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.1ehoDwl9zROFf9t-eBPJuzJu0nM9X3n_0 2024-09-12T01:04:39.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14018768090390955250', time=2024-09-12T02:51:27.722791+0000, chain.objs.size()=1 2024-09-12T01:04:39.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ifraOjGCulnBXpoJ7_Vs-5OltG7d5Nj_0 2024-09-12T01:04:39.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18095915050823429789', time=2024-09-12T02:51:27.737270+0000, chain.objs.size()=1 2024-09-12T01:04:39.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.qf3RbT16IaDj-a54n4Q8lGXB14NudWq_0 2024-09-12T01:04:39.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18140902709248513664', time=2024-09-12T02:51:27.843624+0000, chain.objs.size()=1 2024-09-12T01:04:39.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Pcy8tSb8CMvNtBxRe1qvR7NvwR-n1gW_0 2024-09-12T01:04:39.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3359950445348538794', time=2024-09-12T02:51:27.948493+0000, chain.objs.size()=1 2024-09-12T01:04:39.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.PM0S-GjcRDS1JKhFtvxA71k0Kf57Q1i_0 2024-09-12T01:04:39.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2619028051050818060', time=2024-09-12T02:51:27.968571+0000, chain.objs.size()=1 2024-09-12T01:04:39.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.kSpRpxzwN58leGfSg9tg7ZRSs0kE0gv_0 2024-09-12T01:04:39.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13612725967559357609', time=2024-09-12T02:51:28.147570+0000, chain.objs.size()=1 2024-09-12T01:04:39.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.G5CLK7XmibrIVM11ANrcS1TpOSofnQi_0 2024-09-12T01:04:39.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12965137647393029146', time=2024-09-12T02:51:28.149500+0000, chain.objs.size()=1 2024-09-12T01:04:39.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Yustl5b-PhLGDreuGXW3ZmPDUfYN3Zn_0 2024-09-12T01:04:39.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.132320061500096442', time=2024-09-12T02:51:28.160396+0000, chain.objs.size()=1 2024-09-12T01:04:39.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.HT6T3ZZD001NpP7MaDbDzq2O_OwNFM2_0 2024-09-12T01:04:39.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4988558846616698561', time=2024-09-12T02:51:28.201448+0000, chain.objs.size()=1 2024-09-12T01:04:39.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.27HgLCZqe4AS8au53vOyfZ9nM4dppD4_0 2024-09-12T01:04:39.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1706433708167112761', time=2024-09-12T02:51:28.214407+0000, chain.objs.size()=1 2024-09-12T01:04:39.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.YyDt99JguuwjMIOSE7wJMAzykG18Ciz_0 2024-09-12T01:04:39.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17750983491533936946', time=2024-09-12T02:51:28.217062+0000, chain.objs.size()=1 2024-09-12T01:04:39.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.bVHPoZxxWkPWQGIXtQA0RaA88A1UarU_0 2024-09-12T01:04:39.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17642710356270348087', time=2024-09-12T02:51:28.230389+0000, chain.objs.size()=1 2024-09-12T01:04:39.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.mRg8i9pz37HB9ZPgRq4vST1-UH7UY4G_0 2024-09-12T01:04:39.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1546624326596675289', time=2024-09-12T02:51:28.338116+0000, chain.objs.size()=1 2024-09-12T01:04:39.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.802+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.TFmUApp79aM19CnAkIZoSN35ufsX9n2_0 2024-09-12T01:04:39.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.806+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17979709781183626029', time=2024-09-12T02:51:28.583770+0000, chain.objs.size()=1 2024-09-12T01:04:39.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.806+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.s1UGPndhWZXHQ673JMH2W8eEwaiDmRg_0 2024-09-12T01:04:39.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.806+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6138962864896740191', time=2024-09-12T02:51:28.592360+0000, chain.objs.size()=1 2024-09-12T01:04:39.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.806+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Op69XVCzNsKPtQfy4SlhEwsFlf_uYrW_0 2024-09-12T01:04:39.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.806+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14460862525992217525', time=2024-09-12T02:51:28.594491+0000, chain.objs.size()=1 2024-09-12T01:04:39.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.806+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.BMnUnlGGbV5pTTOa7OhFpcUzmSvvk5O_0 2024-09-12T01:04:39.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.806+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6991195376713830920', time=2024-09-12T02:51:28.604232+0000, chain.objs.size()=1 2024-09-12T01:04:39.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.806+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.pnqGNyPdNZ_muiIHHFARx228riULxN__0 2024-09-12T01:04:39.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.806+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11530120592248456786', time=2024-09-12T02:51:28.630599+0000, chain.objs.size()=1 2024-09-12T01:04:39.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.806+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.AO0s-r81ZlOFihOHpu9qFUlWW8Nx-hB_0 2024-09-12T01:04:39.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.806+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1734888271708649090', time=2024-09-12T02:51:30.099056+0000, chain.objs.size()=1 2024-09-12T01:04:39.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.806+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.264__shadow_.dURvxbHnJ8jpqxmAOyZVSBE9BkpneRC_0 2024-09-12T01:04:39.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17359751070849765339', time=2024-09-12T02:51:35.086293+0000, chain.objs.size()=1 2024-09-12T01:04:39.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.271__shadow_.63m2jiP8gPXrB198zDpz5YQKFcK1me-_0 2024-09-12T01:04:39.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13564749323513583536', time=2024-09-12T02:51:37.988727+0000, chain.objs.size()=1 2024-09-12T01:04:39.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.275__shadow_.2JXvOXx9XRG_c_HbE8rIPt9ofei4ELw_0 2024-09-12T01:04:39.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4858846898646933243', time=2024-09-12T02:51:39.492851+0000, chain.objs.size()=1 2024-09-12T01:04:39.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.277__shadow_.0RfXdjiSkzQT4ABMqF1Pkx4FgYO0Phq_0 2024-09-12T01:04:39.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4779703952042449461', time=2024-09-12T02:51:42.400596+0000, chain.objs.size()=1 2024-09-12T01:04:39.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.281__shadow_.wNnLD0-vH2ciYQJLdK9rc6J-L6bness_0 2024-09-12T01:04:39.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6686773417709538430', time=2024-09-12T02:51:43.224729+0000, chain.objs.size()=1 2024-09-12T01:04:39.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.282__shadow_.785DEeJWGWOGfgkwk49uJXRnYBgHSgi_0 2024-09-12T01:04:39.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8201500082550661747', time=2024-09-12T02:51:51.745003+0000, chain.objs.size()=1 2024-09-12T01:04:39.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.292__shadow_.cfT3m3CYFSFLx8FBP_eWzbjLm2WZ10l_0 2024-09-12T01:04:39.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1322705942566465522', time=2024-09-12T02:51:53.189000+0000, chain.objs.size()=1 2024-09-12T01:04:39.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.293__shadow_.6TeYlY2i7o1rjVolitobykEaLHW-X5w_0 2024-09-12T01:04:39.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6349166286675535577', time=2024-09-12T02:51:58.472521+0000, chain.objs.size()=1 2024-09-12T01:04:39.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.300__shadow_.WHBUVn6Debwmn5vgMl0YiVV8VzRJ0cR_0 2024-09-12T01:04:39.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1044732270575365099', time=2024-09-12T02:52:01.421970+0000, chain.objs.size()=1 2024-09-12T01:04:39.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.304__shadow_.44vtblIgI5_mxP66EC1TzI238umenj1_0 2024-09-12T01:04:39.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10648910072244379178', time=2024-09-12T02:52:14.639705+0000, chain.objs.size()=1 2024-09-12T01:04:39.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.322__shadow_.vYVFg3XP7dxsUDBrSpVyYQ99dQQIADH_0 2024-09-12T01:04:39.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1835183928123957953', time=2024-09-12T02:52:35.379433+0000, chain.objs.size()=1 2024-09-12T01:04:39.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.X96m9E1_UbJdnpgzG8Qw1yh1Hzs8HQz_0 2024-09-12T01:04:39.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10778785472916123685', time=2024-09-12T02:52:35.383196+0000, chain.objs.size()=1 2024-09-12T01:04:39.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.U68UOpSLblQBMGDuOfyQVbV6mI7b-lG_0 2024-09-12T01:04:39.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5481983739998899818', time=2024-09-12T02:52:35.419615+0000, chain.objs.size()=1 2024-09-12T01:04:39.812 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.MynK1P_A7qBVx8WwsXuMgdj2Q7M_Dki_0 2024-09-12T01:04:39.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12866669249720785206', time=2024-09-12T02:52:35.538518+0000, chain.objs.size()=1 2024-09-12T01:04:39.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.zTD5GsawrXJZkoR99HnIyS2F9Y-3NpV_0 2024-09-12T01:04:39.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14935183616123447272', time=2024-09-12T02:52:35.607239+0000, chain.objs.size()=1 2024-09-12T01:04:39.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.mxL-Abz1D_EmEPtMV0OS5yU-kAM18xv_0 2024-09-12T01:04:39.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6899754717224475496', time=2024-09-12T02:52:35.623400+0000, chain.objs.size()=1 2024-09-12T01:04:39.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.D8xqZVWSeNAfnNEAhxmciHD2BOh8JJv_0 2024-09-12T01:04:39.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15339878616215778082', time=2024-09-12T02:52:35.632633+0000, chain.objs.size()=1 2024-09-12T01:04:39.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.vbd2UlVu6aTrI0tpQeEdO0nPcAOd1pI_0 2024-09-12T01:04:39.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9934573815161445840', time=2024-09-12T02:52:35.816308+0000, chain.objs.size()=1 2024-09-12T01:04:39.813 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.sq9kuxzes4wvjA3SmLcXAJhhks7-J7A_0 2024-09-12T01:04:39.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2249748627696336932', time=2024-09-12T02:52:35.825863+0000, chain.objs.size()=1 2024-09-12T01:04:39.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.3kFZI9t9I0zCDeH_FcGCZOe1RU5TXPY_0 2024-09-12T01:04:39.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14587183697449020898', time=2024-09-12T02:52:35.870548+0000, chain.objs.size()=1 2024-09-12T01:04:39.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.bXV-L-mmhgRLNpd4EDtb_sDNMm556zz_0 2024-09-12T01:04:39.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10761697197625431155', time=2024-09-12T02:52:36.235998+0000, chain.objs.size()=1 2024-09-12T01:04:39.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.NVSK-CqiPfrGt6eX85oULCF_iciOoRZ_0 2024-09-12T01:04:39.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9894536821743488974', time=2024-09-12T02:52:36.506914+0000, chain.objs.size()=1 2024-09-12T01:04:39.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.NJaUHjlWLMFJBvHif-wdqMM2hB_erUP_0 2024-09-12T01:04:39.814 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9914489959276171949', time=2024-09-12T02:52:36.511762+0000, chain.objs.size()=1 2024-09-12T01:04:39.815 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.810+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.sKv3zYhpvN86x4tX2eE0XDYz20wJ7OA_0 2024-09-12T01:04:39.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6663476383598765694', time=2024-09-12T02:52:36.581680+0000, chain.objs.size()=1 2024-09-12T01:04:39.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.osTxmzxIh-JnIolNckfNyz_22mR6YCj_0 2024-09-12T01:04:39.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9456138017524512424', time=2024-09-12T02:52:36.585063+0000, chain.objs.size()=1 2024-09-12T01:04:39.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.W_7EVZq-rnwecVkVCT68ioibxdHqO00_0 2024-09-12T01:04:39.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13069208023337306818', time=2024-09-12T02:52:36.610934+0000, chain.objs.size()=1 2024-09-12T01:04:39.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.-8ypUDxMlIBIPARRCbnhHG3CMjHLF9A_0 2024-09-12T01:04:39.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11988166452908050674', time=2024-09-12T02:52:36.823922+0000, chain.objs.size()=1 2024-09-12T01:04:39.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ll7kJkuBMowY8_v0ILymwimYbgvK_nn_0 2024-09-12T01:04:39.816 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1098603966575011526', time=2024-09-12T02:52:36.848707+0000, chain.objs.size()=1 2024-09-12T01:04:39.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.UWxQmeiS2X0EbWMjUpZ28xaiDr8DxHu_0 2024-09-12T01:04:39.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4758676486605560599', time=2024-09-12T02:52:36.883787+0000, chain.objs.size()=1 2024-09-12T01:04:39.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.3YeJMFyVEwh0oIj9b8NV41ovnFHYVDn_0 2024-09-12T01:04:39.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4563290783593348682', time=2024-09-12T02:52:36.984461+0000, chain.objs.size()=1 2024-09-12T01:04:39.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.gtqW6lQ_DEq5a-DA0gaqVOkT3t3klzJ_0 2024-09-12T01:04:39.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10595913585759402413', time=2024-09-12T02:52:36.992703+0000, chain.objs.size()=1 2024-09-12T01:04:39.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.fr2Epnuim8yhsG21V08vGEIw6Qq2Twc_0 2024-09-12T01:04:39.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.930488912252047074', time=2024-09-12T02:52:37.078601+0000, chain.objs.size()=1 2024-09-12T01:04:39.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.AwI7YeW9t-8KhTKQMkEM-jq6ZNgkm1Q_0 2024-09-12T01:04:39.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9639614305798761440', time=2024-09-12T02:52:37.079661+0000, chain.objs.size()=1 2024-09-12T01:04:39.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.I-sjdIu0YTWahRrslQt9g4JJyTJ1VFs_0 2024-09-12T01:04:39.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6685980822537295678', time=2024-09-12T02:52:37.089913+0000, chain.objs.size()=1 2024-09-12T01:04:39.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ue80wojNgWRtMbXoC9GViw85g_UpqSO_0 2024-09-12T01:04:39.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6560406944730679022', time=2024-09-12T02:52:37.100028+0000, chain.objs.size()=1 2024-09-12T01:04:39.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.iHXiZ3misKm1HbVJJqWZU3UuLhFlSlo_0 2024-09-12T01:04:39.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2694906421153977701', time=2024-09-12T02:52:57.031569+0000, chain.objs.size()=1 2024-09-12T01:04:39.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.XqAri1kQHkn9YQSCcPEwCYvalHrbx36_0 2024-09-12T01:04:39.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11454682414640686244', time=2024-09-12T02:52:57.206239+0000, chain.objs.size()=1 2024-09-12T01:04:39.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.emWQStVMDMuA_l62-CeRYYsVKYMDeJr_0 2024-09-12T01:04:39.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2858312118653251007', time=2024-09-12T02:52:57.216686+0000, chain.objs.size()=1 2024-09-12T01:04:39.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.7hfsbOZgY7-NiGL6Sn9295pM6QDE_M6_0 2024-09-12T01:04:39.818 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5643829506054032612', time=2024-09-12T02:52:57.242916+0000, chain.objs.size()=1 2024-09-12T01:04:39.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.N5ywBDQJysX-qMqsC5gJQQcCOeKgcMs_0 2024-09-12T01:04:39.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8470888234562686595', time=2024-09-12T02:52:57.244898+0000, chain.objs.size()=1 2024-09-12T01:04:39.819 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.814+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.bSz9kYkcSXm3yrI6ko3V2UCwoAWM9Te_0 2024-09-12T01:04:39.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11566315095318149069', time=2024-09-12T02:52:57.257036+0000, chain.objs.size()=1 2024-09-12T01:04:39.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.NrkxXZVKNU06k4lOpY30-t4_RDwKWt4_0 2024-09-12T01:04:39.820 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1632047887386396657', time=2024-09-12T02:52:57.284901+0000, chain.objs.size()=1 2024-09-12T01:04:39.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.OZOMFh5lTXE6dSChT-BSp4jrOFe94QZ_0 2024-09-12T01:04:39.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5450323241750909419', time=2024-09-12T02:52:57.396058+0000, chain.objs.size()=1 2024-09-12T01:04:39.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.S3G5HcGmQvV0ghoOQPZF-dk9cRAP917_0 2024-09-12T01:04:39.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17238727130170711374', time=2024-09-12T02:52:57.433101+0000, chain.objs.size()=1 2024-09-12T01:04:39.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.X07_l3bdTcnxovik-ZI1qBqvioC0iNw_0 2024-09-12T01:04:39.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.831507504639053711', time=2024-09-12T02:52:57.460010+0000, chain.objs.size()=1 2024-09-12T01:04:39.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.h_IQZhJG6xaiua-9opks8zJs9pNk8VP_0 2024-09-12T01:04:39.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1478336573872673153', time=2024-09-12T02:52:57.461022+0000, chain.objs.size()=1 2024-09-12T01:04:39.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.6dXmEzx3wZbAgaz6SNZGPNrHI4wEO5X_0 2024-09-12T01:04:39.821 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9524937745094045637', time=2024-09-12T02:52:57.625981+0000, chain.objs.size()=1 2024-09-12T01:04:39.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.i1RhnJZqs1MsOMPpBEmDV_fsDo-p8VY_0 2024-09-12T01:04:39.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12104143187697113015', time=2024-09-12T02:52:57.641635+0000, chain.objs.size()=1 2024-09-12T01:04:39.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.QPCFFSBk27Mk0gm76CtJ8r280QGvJA1_0 2024-09-12T01:04:39.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2750143420631709250', time=2024-09-12T02:52:57.649466+0000, chain.objs.size()=1 2024-09-12T01:04:39.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Y6tCG_bpBuqQDtcrPEdbKRz1qjr6K4M_0 2024-09-12T01:04:39.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.404150653824971211', time=2024-09-12T02:52:57.701852+0000, chain.objs.size()=1 2024-09-12T01:04:39.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.wv0x4NXnTFirOUWVYIsZKU9mcEW_QiW_0 2024-09-12T01:04:39.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17871624449129686538', time=2024-09-12T02:52:57.865802+0000, chain.objs.size()=1 2024-09-12T01:04:39.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.38AV2XbMfI0Slr0BlTE1tdDE3jGXnjm_0 2024-09-12T01:04:39.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.404380874463551429', time=2024-09-12T02:52:57.913022+0000, chain.objs.size()=1 2024-09-12T01:04:39.822 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Bsb_kZPyT5Bt3I3XUahXToVULKWUO-V_0 2024-09-12T01:04:39.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15300835305617465176', time=2024-09-12T02:52:57.914136+0000, chain.objs.size()=1 2024-09-12T01:04:39.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.6ibcrMVnsHHQ2uMtJzcQp85HP17Qpv8_0 2024-09-12T01:04:39.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11362481763330965514', time=2024-09-12T02:52:57.966500+0000, chain.objs.size()=1 2024-09-12T01:04:39.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.qKuUVJqZB12TTwh-foGM52pXup4IMUp_0 2024-09-12T01:04:39.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1520508311591090453', time=2024-09-12T02:52:57.973664+0000, chain.objs.size()=1 2024-09-12T01:04:39.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.0Zq2GbZzNDoahdU0iWFrxuY3vJW09k9_0 2024-09-12T01:04:39.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2549891588967736282', time=2024-09-12T02:52:57.975625+0000, chain.objs.size()=1 2024-09-12T01:04:39.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.KcpaA492d8w64-6wurEG94CPGHVxqlU_0 2024-09-12T01:04:39.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5288523610448008424', time=2024-09-12T02:52:57.989500+0000, chain.objs.size()=1 2024-09-12T01:04:39.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ppWCtRaLPR9Ct6hEmrJfkFcbU1kNfje_0 2024-09-12T01:04:39.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17465415935815490005', time=2024-09-12T02:52:58.115455+0000, chain.objs.size()=1 2024-09-12T01:04:39.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.wR0xy2pHXPy95Sc12TaXA_arRSeG6kp_0 2024-09-12T01:04:39.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10817303827028650323', time=2024-09-12T02:52:58.130280+0000, chain.objs.size()=1 2024-09-12T01:04:39.824 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.818+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Tavjh4SjqlftBckxrWxv6TvuZfZoqFs_0 2024-09-12T01:04:39.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.822+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4686110288056298550', time=2024-09-12T02:52:58.154441+0000, chain.objs.size()=1 2024-09-12T01:04:39.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.822+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.dNMtIH3yqs7qWid6kDndxOYLDu3G0OK_0 2024-09-12T01:04:39.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.822+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4720423368126500344', time=2024-09-12T02:52:58.403290+0000, chain.objs.size()=1 2024-09-12T01:04:39.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.822+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.wxq0MtjvWWQHDbIgf0QkbU77-5Gn3R4_0 2024-09-12T01:04:39.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.822+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2152018493434858038', time=2024-09-12T02:52:58.461057+0000, chain.objs.size()=1 2024-09-12T01:04:39.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.822+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.PzdjGIW-cBZvp6M0uPdMj9KigKmaben_0 2024-09-12T01:04:39.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.822+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3763726210019396183', time=2024-09-12T02:52:58.470375+0000, chain.objs.size()=1 2024-09-12T01:04:39.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.822+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.h_jvgeqLd9ZuM5pZpQh2lDCFf3CnvKi_0 2024-09-12T01:04:39.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.822+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13897089810618839479', time=2024-09-12T02:52:58.598309+0000, chain.objs.size()=1 2024-09-12T01:04:39.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.822+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_._GdzAABLQ0LK4vXoHZWON2UX6I5MT62_0 2024-09-12T01:04:39.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.822+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15869889237857714609', time=2024-09-12T02:52:58.605837+0000, chain.objs.size()=1 2024-09-12T01:04:39.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.822+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.8Ih3lvdOf8iaB1gWJDs9yi0qn_kqoXR_0 2024-09-12T01:04:39.826 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.826+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/54863 2024-09-12T01:04:39.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.826+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T01:04:39.827 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.826+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11148876831831944089', time=2024-09-12T02:52:58.628671+0000, chain.objs.size()=1 2024-09-12T01:04:39.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.826+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.iDDsNr4ZakE2vIw7ta2Caa4xnfHiMNy_0 2024-09-12T01:04:39.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.826+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15615112766976327858', time=2024-09-12T02:52:58.632250+0000, chain.objs.size()=1 2024-09-12T01:04:39.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.826+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.1hBhEY8cLLiverofzUIBFQylLnr9IRa_0 2024-09-12T01:04:39.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.826+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6676218105087331416', time=2024-09-12T02:52:58.643393+0000, chain.objs.size()=1 2024-09-12T01:04:39.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.826+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ec3e29InNzXAHfzHw_BBBLw0xnEjhat_0 2024-09-12T01:04:39.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.826+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16568670601545995490', time=2024-09-12T02:52:58.661030+0000, chain.objs.size()=1 2024-09-12T01:04:39.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.826+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.7FpHSwYgynv5bikSoVi8_RFduiUntFN_0 2024-09-12T01:04:39.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.826+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15299969708314823142', time=2024-09-12T02:53:11.914799+0000, chain.objs.size()=1 2024-09-12T01:04:39.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.826+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.344__shadow_.zSB978kg1SM_zVVQWpMP2U8UwP3Q0GQ_0 2024-09-12T01:04:39.828 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.826+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10396683545548536334', time=2024-09-12T02:53:12.614310+0000, chain.objs.size()=1 2024-09-12T01:04:39.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.826+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.345__shadow_.6ViTvuYXjH6fjP4IRbE7Gq7wQX3zdTX_0 2024-09-12T01:04:39.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.826+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6580683650451650025', time=2024-09-12T02:54:43.393036+0000, chain.objs.size()=1 2024-09-12T01:04:39.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.826+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.465__shadow_.zd0eIy8bsJHMp14rno829zYaPMdsoKy_0 2024-09-12T01:04:39.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.826+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14800632834232661726', time=2024-09-12T02:54:53.305416+0000, chain.objs.size()=1 2024-09-12T01:04:39.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.826+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.483__shadow_.EOit-62GAWeCn8GddlFTwPn3rkTNjCJ_0 2024-09-12T01:04:39.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.826+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13375776314554504130', time=2024-09-12T02:55:04.659831+0000, chain.objs.size()=1 2024-09-12T01:04:39.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.826+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.500__shadow_.meC6u2TbSEpgt36AkRW0hUIJEo9qobp_0 2024-09-12T01:04:39.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.826+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5872998346154608188', time=2024-09-12T02:55:19.146061+0000, chain.objs.size()=1 2024-09-12T01:04:39.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.826+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.518__multipart_mymultipart.2~0stwC5JIO_OmKCHTCES4wXjYzXpRXt5.1 2024-09-12T01:04:39.829 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.826+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~UlAnIMgx1uap_N0dQUzOi5YZeeNRG3M', time=2024-09-12T02:55:58.351729+0000, chain.objs.size()=2 2024-09-12T01:04:39.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.826+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.531__multipart_mymultipart2.2~UlAnIMgx1uap_N0dQUzOi5YZeeNRG3M.1 2024-09-12T01:04:39.830 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.826+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.531__shadow_mymultipart2.2~UlAnIMgx1uap_N0dQUzOi5YZeeNRG3M.1_1 2024-09-12T01:04:39.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.830+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2903607511745782941', time=2024-09-12T02:56:45.885716+0000, chain.objs.size()=1 2024-09-12T01:04:39.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.830+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.556__shadow_.n6tDd-A_Q7C0iTkpFW1JsPaf2_1wmWO_0 2024-09-12T01:04:39.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.830+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1826503284612299937', time=2024-09-12T02:56:48.438587+0000, chain.objs.size()=2 2024-09-12T01:04:39.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.830+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.558__shadow_.VUgp8XqHFFI63wyvdFXdcc5NM9oNH0c_0 2024-09-12T01:04:39.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.830+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.558__shadow_.VUgp8XqHFFI63wyvdFXdcc5NM9oNH0c_1 2024-09-12T01:04:39.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.830+0000 7f8b0aa96640 0 -- 172.21.15.43:0/1860143151 >> [v2:172.21.15.43:6800/1255554747,v1:172.21.15.43:6801/1255554747] conn(0x7f89d4081860 msgr2=0x7f89d4083c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:04:39.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.830+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18404472472925320999', time=2024-09-12T02:57:06.518677+0000, chain.objs.size()=1 2024-09-12T01:04:39.831 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.830+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.569__shadow:uvD3znjV41pBIr8.EP6wB3ya1ZcPY.i_.erwgAq-pMMkh1mpefCwxM9TGofZ8IPr_0 2024-09-12T01:04:39.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.830+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1074591971580889247', time=2024-09-12T02:57:10.311861+0000, chain.objs.size()=1 2024-09-12T01:04:39.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.830+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.570__shadow:E-aoXVODuVY.nuOE1w-iSv2yWXtNZLC_.j1AAm_MjZEAoA5-D_eRk6H6XhbJ9E-W_0 2024-09-12T01:04:39.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.830+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9866630139255057882', time=2024-09-12T02:57:42.123188+0000, chain.objs.size()=4 2024-09-12T01:04:39.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.830+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.578__multipart_testobj.2~FhdrnqXJuica15e3KsXtIrHTCwFw-CE.1 2024-09-12T01:04:39.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.830+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.578__multipart_testobj.2~FhdrnqXJuica15e3KsXtIrHTCwFw-CE.2 2024-09-12T01:04:39.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.830+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.578__multipart_testobj.2~FhdrnqXJuica15e3KsXtIrHTCwFw-CE.3 2024-09-12T01:04:39.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.830+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.578__multipart_testobj.2~FhdrnqXJuica15e3KsXtIrHTCwFw-CE.4 2024-09-12T01:04:39.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.830+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6488092710262083816', time=2024-09-12T02:57:50.387786+0000, chain.objs.size()=1 2024-09-12T01:04:39.832 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.830+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.585__shadow:ZEJHTBEOnkRAIhv1-KD6fY1EfOHqlrJ_.Mr-qy_8dUS-5t_1XZrlPx0K5hIKmA48_0 2024-09-12T01:04:39.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.830+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11511076356365050590', time=2024-09-12T03:00:38.668986+0000, chain.objs.size()=1 2024-09-12T01:04:39.833 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.830+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.631__shadow_.lIVOLye4O5M-SJKXw6WbPj3Dhfok8Hh_0 2024-09-12T01:04:39.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.830+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9065697191277355664', time=2024-09-12T03:00:55.837222+0000, chain.objs.size()=1 2024-09-12T01:04:39.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.830+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.653__shadow_.Hlb--ibdi0NY0cpihuZlGhBFIoLaHb0_0 2024-09-12T01:04:39.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.830+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15556065476772107202', time=2024-09-12T03:00:56.789801+0000, chain.objs.size()=1 2024-09-12T01:04:39.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.830+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.654__shadow_.eDISnZJa_lgKHLXvVBRulJAuRPBgh6Q_0 2024-09-12T01:04:39.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.830+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.637060285094875455', time=2024-09-12T03:01:05.473944+0000, chain.objs.size()=1 2024-09-12T01:04:39.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.830+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.663__shadow_.afVf8ursbbdQfzmEhSIUqqvZsTiyunb_0 2024-09-12T01:04:39.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.830+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4449112941213850781', time=2024-09-12T03:01:31.154260+0000, chain.objs.size()=1 2024-09-12T01:04:39.834 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.830+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.702__multipart_file1.2~0QPqEhwtNkwlsRqtCCMYWm3l_JT2fct.1 2024-09-12T01:04:39.835 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.834+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:39.839 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.838+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:04:39.840 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.838+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:39.841 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:39.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47058' 2024-09-12T01:04:39.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='_dva5kolI-G57wEhycRIj0fpQHbQH7EP', time=2024-09-12T02:48:32.787584+0000, chain.objs.size()=1 2024-09-12T01:04:39.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.160__shadow_.P9Y6CtRZJTGs72fBgZOOIViqSxFTI8N_0 2024-09-12T01:04:39.842 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='_fldKGKqIzymhZGAEOnTTuOtmujiRh3b', time=2024-09-12T02:48:33.747520+0000, chain.objs.size()=1 2024-09-12T01:04:39.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.161__shadow_.BvGKhJ5o7EtNJlhRJXwCZlXNhyZFGtA_0 2024-09-12T01:04:39.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='_Zu_4TxjCN5oCQoh7D04_tLtg5dvqUPK', time=2024-09-12T02:48:36.826334+0000, chain.objs.size()=3 2024-09-12T01:04:39.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.163__shadow_.tb7x-joowYL5GItF7mbaBlQsNuSaruD_0 2024-09-12T01:04:39.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.163__shadow_.tb7x-joowYL5GItF7mbaBlQsNuSaruD_1 2024-09-12T01:04:39.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.163__shadow_.tb7x-joowYL5GItF7mbaBlQsNuSaruD_2 2024-09-12T01:04:39.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16538264129745100306', time=2024-09-12T02:48:38.413657+0000, chain.objs.size()=1 2024-09-12T01:04:39.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.166__shadow_.ZX6skP3VyzZEdiwtUWWSlgEDx5lXbyU_0 2024-09-12T01:04:39.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11209349001471816993', time=2024-09-12T02:50:44.151139+0000, chain.objs.size()=1 2024-09-12T01:04:39.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.233__shadow_.sSZTuYWEgV688ehh0PXkD6M3jFyb2wi_0 2024-09-12T01:04:39.843 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10526873870719228738', time=2024-09-12T02:51:26.735603+0000, chain.objs.size()=1 2024-09-12T01:04:39.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.HPAo6FVnoM03ZmzkMYzglq_C0sQhj6e_0 2024-09-12T01:04:39.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9743845720654525935', time=2024-09-12T02:51:26.741928+0000, chain.objs.size()=1 2024-09-12T01:04:39.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.kbF86h3qkJyJoac4H-l3YGTVB4rlm9h_0 2024-09-12T01:04:39.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14505758718078007224', time=2024-09-12T02:51:26.820895+0000, chain.objs.size()=1 2024-09-12T01:04:39.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.mAqSoqp0qw5X6BtPJ2YLkqXD6XRNO1h_0 2024-09-12T01:04:39.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2568115262780517113', time=2024-09-12T02:51:26.850542+0000, chain.objs.size()=1 2024-09-12T01:04:39.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.GgsSsY8SDwPV0VIryNcQBTR1yfUVXbL_0 2024-09-12T01:04:39.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12133097614181625501', time=2024-09-12T02:51:26.875674+0000, chain.objs.size()=1 2024-09-12T01:04:39.844 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.uOrKiN-Tir9fgPkfrDZCDFDFVcd2-hf_0 2024-09-12T01:04:39.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9489710012368337124', time=2024-09-12T02:51:26.884312+0000, chain.objs.size()=1 2024-09-12T01:04:39.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.IuVXXCVgfbYH0iHgJHYlLu2xDFVguuW_0 2024-09-12T01:04:39.845 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4117276893375069951', time=2024-09-12T02:51:27.038447+0000, chain.objs.size()=1 2024-09-12T01:04:39.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.YeHXQq0jTQk7mls0yOzjnSgtA1f2_Bg_0 2024-09-12T01:04:39.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.842+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18094138129490983186', time=2024-09-12T02:51:27.047468+0000, chain.objs.size()=1 2024-09-12T01:04:39.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.842+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.tZi_WLxV0OWZA8znmGwCl8KIkkebnLa_0 2024-09-12T01:04:39.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2995013755392878587', time=2024-09-12T02:51:27.052873+0000, chain.objs.size()=1 2024-09-12T01:04:39.846 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.3wJ7FsTchw1NLzQbbuPg8KkZj45lo43_0 2024-09-12T01:04:39.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14778457068090996551', time=2024-09-12T02:51:27.057854+0000, chain.objs.size()=1 2024-09-12T01:04:39.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.HgNvbKGZb855jo51OlahFEV6SZi254U_0 2024-09-12T01:04:39.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13409393546495371275', time=2024-09-12T02:51:27.235375+0000, chain.objs.size()=1 2024-09-12T01:04:39.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.7M-uQYaJarPn7kXEaC_ciazPBmbUwVy_0 2024-09-12T01:04:39.847 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11892724186171832473', time=2024-09-12T02:51:27.269749+0000, chain.objs.size()=1 2024-09-12T01:04:39.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.DJcn_Ac28S3EaKiS4mwEv6K5BkQ6DaP_0 2024-09-12T01:04:39.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16889903786807538980', time=2024-09-12T02:51:27.463386+0000, chain.objs.size()=1 2024-09-12T01:04:39.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.7yI-g-L7wZ2Q8XMnFzNHHaWe66Z8IW3_0 2024-09-12T01:04:39.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5614911700894761941', time=2024-09-12T02:51:27.468137+0000, chain.objs.size()=1 2024-09-12T01:04:39.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.WqfclCNNP2lJH5oeYeYRJt5LXAiyeRh_0 2024-09-12T01:04:39.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14591402032589100888', time=2024-09-12T02:51:27.472746+0000, chain.objs.size()=1 2024-09-12T01:04:39.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.tkIb-CA31BUgiLEsd1gD4ODXlMQyPeb_0 2024-09-12T01:04:39.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.36625283070595883', time=2024-09-12T02:51:27.652523+0000, chain.objs.size()=1 2024-09-12T01:04:39.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.TslKEeL5RscUu-0HrRHyBQzh5-FpGOp_0 2024-09-12T01:04:39.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18134504098503385540', time=2024-09-12T02:51:27.878942+0000, chain.objs.size()=1 2024-09-12T01:04:39.848 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.xowqyWQdKftP3A9Z6tzBbEvaSdYs4Rw_0 2024-09-12T01:04:39.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1675846715330637944', time=2024-09-12T02:51:27.936527+0000, chain.objs.size()=1 2024-09-12T01:04:39.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.No7R6ALQKWhFRSecwlkquXvI0xuAcic_0 2024-09-12T01:04:39.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4737573276680193974', time=2024-09-12T02:51:27.957709+0000, chain.objs.size()=1 2024-09-12T01:04:39.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.VPuMMYhdjGuGpqPPI_miSHwIke62XCw_0 2024-09-12T01:04:39.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13493775913165409705', time=2024-09-12T02:51:28.209810+0000, chain.objs.size()=1 2024-09-12T01:04:39.849 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.QDkEet5jvuNtLFBPKZsmnNtY5WDMH4b_0 2024-09-12T01:04:39.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2034171979393761374', time=2024-09-12T02:51:28.228345+0000, chain.objs.size()=1 2024-09-12T01:04:39.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.lC-DL3_KCZjO6mxpYNXWrTkdt1DWc_N_0 2024-09-12T01:04:39.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15968808763097654324', time=2024-09-12T02:51:28.233336+0000, chain.objs.size()=1 2024-09-12T01:04:39.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.-989CdQM97-zq8LbTUMlJ1pbBRF0ix7_0 2024-09-12T01:04:39.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6737413960904911208', time=2024-09-12T02:51:39.495035+0000, chain.objs.size()=1 2024-09-12T01:04:39.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.277__shadow_.GPTDj7m1rjORhDnUci1ylfwb9LTRS-M_0 2024-09-12T01:04:39.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6234467879448694599', time=2024-09-12T02:51:43.223672+0000, chain.objs.size()=1 2024-09-12T01:04:39.850 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.846+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.282__shadow_.gZA_7olovEpERFUWhuN8Wzr6Zy3HvEI_0 2024-09-12T01:04:39.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.850+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9903901253021920785', time=2024-09-12T02:51:45.491030+0000, chain.objs.size()=1 2024-09-12T01:04:39.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.850+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.285__shadow_.R_5fKoMXg3NXKFIF8drhYkemDvA1sMW_0 2024-09-12T01:04:39.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.850+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.930868534497142502', time=2024-09-12T02:51:51.711168+0000, chain.objs.size()=1 2024-09-12T01:04:39.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.850+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.292__shadow_.kY8jNJkiBiCzk6b084DwZgFLquYiUTW_0 2024-09-12T01:04:39.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.850+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13981951203034941801', time=2024-09-12T02:52:35.093482+0000, chain.objs.size()=1 2024-09-12T01:04:39.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.850+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.lkVbka7ksV2nQxPxxAcxu36ZTWjxdnF_0 2024-09-12T01:04:39.851 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.850+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4832896217553741230', time=2024-09-12T02:52:35.109426+0000, chain.objs.size()=1 2024-09-12T01:04:39.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.850+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.lPFa3CEjgNzI3ZzTKr67tWeblj8iQ7s_0 2024-09-12T01:04:39.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.850+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1607461960011173798', time=2024-09-12T02:52:35.125312+0000, chain.objs.size()=1 2024-09-12T01:04:39.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.850+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.dgHL1nTjytpX_hQffOYfZY6wDTBxNsE_0 2024-09-12T01:04:39.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.850+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15795782658708419354', time=2024-09-12T02:52:35.154155+0000, chain.objs.size()=1 2024-09-12T01:04:39.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.850+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ZyN6pQqmAunPPQRqmt8CBiJwK4yCYnk_0 2024-09-12T01:04:39.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.850+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7063502739180993332', time=2024-09-12T02:52:35.181489+0000, chain.objs.size()=1 2024-09-12T01:04:39.852 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.850+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Zcqqz2AI3j0mqWdwovGoI5CYUsEs_lO_0 2024-09-12T01:04:39.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.850+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1891722392333808293', time=2024-09-12T02:52:35.299210+0000, chain.objs.size()=1 2024-09-12T01:04:39.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.850+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.HoBSzsgp151Ri_BUq0b3aZGkWIE5cMB_0 2024-09-12T01:04:39.853 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.850+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1268475983361212399', time=2024-09-12T02:52:35.307813+0000, chain.objs.size()=1 2024-09-12T01:04:39.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.850+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.x-3TL2JycOrXQTXTQWo9aA-Q4BF6oJi_0 2024-09-12T01:04:39.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.850+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3644367086854124509', time=2024-09-12T02:52:35.331852+0000, chain.objs.size()=1 2024-09-12T01:04:39.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.850+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.mViaU_Y47-36SYTCUo2O0M1HOYPSQtD_0 2024-09-12T01:04:39.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.850+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13076855779261017294', time=2024-09-12T02:52:35.546678+0000, chain.objs.size()=1 2024-09-12T01:04:39.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.850+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.uuGGhQUheCt-xtDqHcvqBhDxig9PYdE_0 2024-09-12T01:04:39.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14299717706232494802', time=2024-09-12T02:52:35.582585+0000, chain.objs.size()=1 2024-09-12T01:04:39.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ikphk6m1LbnvpORW0tCaaBbmDckvQPA_0 2024-09-12T01:04:39.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7532162217100093184', time=2024-09-12T02:52:35.632532+0000, chain.objs.size()=1 2024-09-12T01:04:39.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.TiIeFFLe60crccjlgXQb2INYUVDsd1J_0 2024-09-12T01:04:39.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14375402262272253934', time=2024-09-12T02:52:35.652493+0000, chain.objs.size()=1 2024-09-12T01:04:39.854 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.GBMzIaKOEEzUkjSqz8Kaqu_Yos2ycL6_0 2024-09-12T01:04:39.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6773054121092618371', time=2024-09-12T02:52:35.656831+0000, chain.objs.size()=1 2024-09-12T01:04:39.855 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.EOdMSMWd_YGCv3vvbgQjrdwgUFJqUo2_0 2024-09-12T01:04:39.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17008135886702505859', time=2024-09-12T02:52:35.669964+0000, chain.objs.size()=1 2024-09-12T01:04:39.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Fu7ZpFHomjAJGtWCXZ-dcW33QqcNXHZ_0 2024-09-12T01:04:39.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11595750533986644472', time=2024-09-12T02:52:35.799678+0000, chain.objs.size()=1 2024-09-12T01:04:39.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Vg_Sk1p9bSR9ALEUYFXL9AgoenFN7-0_0 2024-09-12T01:04:39.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5922166107769207294', time=2024-09-12T02:52:35.830378+0000, chain.objs.size()=1 2024-09-12T01:04:39.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.0r3-qEXPSSCZsna_0sjbqj64jp77Kdd_0 2024-09-12T01:04:39.857 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18414626108472780275', time=2024-09-12T02:52:35.838246+0000, chain.objs.size()=1 2024-09-12T01:04:39.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.hs9lll8eiUyWBUBjTIV3FJSFqtAwMAu_0 2024-09-12T01:04:39.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16131560059226352687', time=2024-09-12T02:52:35.847891+0000, chain.objs.size()=1 2024-09-12T01:04:39.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.5yKqVI9kqN1Nk-0tBdIp4rYCwiw83Sm_0 2024-09-12T01:04:39.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3229207162433653455', time=2024-09-12T02:52:36.354364+0000, chain.objs.size()=1 2024-09-12T01:04:39.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.eduaNBGRV8gL75jKqRsO3V7vVwsdYtc_0 2024-09-12T01:04:39.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18121047403246467557', time=2024-09-12T02:52:36.375593+0000, chain.objs.size()=1 2024-09-12T01:04:39.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.woOGU0rn-5Cthw6WBfcD1iH6ccm5I7R_0 2024-09-12T01:04:39.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10749270890265933420', time=2024-09-12T02:52:36.547083+0000, chain.objs.size()=1 2024-09-12T01:04:39.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.1OVLjNGxDPOpyInwde6FBlxFwIMu9XJ_0 2024-09-12T01:04:39.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5050913349796254026', time=2024-09-12T02:52:36.592750+0000, chain.objs.size()=1 2024-09-12T01:04:39.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.nMdLrh0re2Gbc0bA6iSki7atSGUOIXX_0 2024-09-12T01:04:39.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1721077803669588440', time=2024-09-12T02:52:36.617151+0000, chain.objs.size()=1 2024-09-12T01:04:39.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.mCLNQC6iUVbJT1IQW6GU33QqQ4Jli38_0 2024-09-12T01:04:39.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6816369731369894704', time=2024-09-12T02:52:36.630163+0000, chain.objs.size()=1 2024-09-12T01:04:39.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.wLwFQpjSLYopfoq4AKxr8ZlwVrM6LPz_0 2024-09-12T01:04:39.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7622698922781215541', time=2024-09-12T02:52:36.779425+0000, chain.objs.size()=1 2024-09-12T01:04:39.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.zmdgSjnB_ylL-mogc51io5aeJKi095b_0 2024-09-12T01:04:39.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14107490703654290027', time=2024-09-12T02:52:36.817871+0000, chain.objs.size()=1 2024-09-12T01:04:39.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.MS30q9x9W_Tjnh8YljrS2rHl676kTuu_0 2024-09-12T01:04:39.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8337365931441435386', time=2024-09-12T02:52:36.824935+0000, chain.objs.size()=1 2024-09-12T01:04:39.859 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.C2syZSxJ8l0wQpr4FGg0d6JCKssru_S_0 2024-09-12T01:04:39.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18176171188647800593', time=2024-09-12T02:52:36.853765+0000, chain.objs.size()=1 2024-09-12T01:04:39.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.854+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.S3BUeKsJy-_WzhveQhMmdgvCGGwh778_0 2024-09-12T01:04:39.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11963736419033212444', time=2024-09-12T02:52:36.882636+0000, chain.objs.size()=1 2024-09-12T01:04:39.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.rpoEJcgkk7CFanYyoleUWA1WtJ0OrFl_0 2024-09-12T01:04:39.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4809649645408613088', time=2024-09-12T02:52:37.059053+0000, chain.objs.size()=1 2024-09-12T01:04:39.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ii-nQuDAMIsHd2e9wam3qrerVhB6G0i_0 2024-09-12T01:04:39.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7707671746848340386', time=2024-09-12T02:52:37.084560+0000, chain.objs.size()=1 2024-09-12T01:04:39.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.b6hXVmlu81BwFQZJoYOhMVswRkFCd1J_0 2024-09-12T01:04:39.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13036176429802509556', time=2024-09-12T02:52:56.900703+0000, chain.objs.size()=1 2024-09-12T01:04:39.860 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.7WMURAEA3rsWDUEREb-w2POdMUayWIw_0 2024-09-12T01:04:39.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1773759434375631804', time=2024-09-12T02:52:56.932976+0000, chain.objs.size()=1 2024-09-12T01:04:39.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.6W6Mcsg-VT40yVPnGuGzPNlUOMYUdE6_0 2024-09-12T01:04:39.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4474945668697161316', time=2024-09-12T02:52:56.998577+0000, chain.objs.size()=1 2024-09-12T01:04:39.861 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.neF5zPawqR5EOEZB-aczPEd8vLjrBh6_0 2024-09-12T01:04:39.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15968807816049954551', time=2024-09-12T02:52:57.012627+0000, chain.objs.size()=1 2024-09-12T01:04:39.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.K7Cvq4Ep63PxlQwD_SOCi1-nu2jr7Vo_0 2024-09-12T01:04:39.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4860392678063105291', time=2024-09-12T02:52:57.017183+0000, chain.objs.size()=1 2024-09-12T01:04:39.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.foPLe11pqVPr8fHsNb9rllrGYfhqLXF_0 2024-09-12T01:04:39.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6436259919912647727', time=2024-09-12T02:52:57.024864+0000, chain.objs.size()=1 2024-09-12T01:04:39.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.lSVInun0f9za12KKQREi-X5dJY1eTV7_0 2024-09-12T01:04:39.863 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13923387201365184242', time=2024-09-12T02:52:57.036866+0000, chain.objs.size()=1 2024-09-12T01:04:39.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_._nm7jFkxI7WaSDYffEjsDl50TGC_CSN_0 2024-09-12T01:04:39.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1068957967634583120', time=2024-09-12T02:52:57.046975+0000, chain.objs.size()=1 2024-09-12T01:04:39.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.GJh3dqoiIc2Sxa6JemcgEobt1HjLB8b_0 2024-09-12T01:04:39.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6542745499421546727', time=2024-09-12T02:52:57.195060+0000, chain.objs.size()=1 2024-09-12T01:04:39.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.yrbLS8fozsh4ho97sJKmSMRCepBpKTB_0 2024-09-12T01:04:39.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8186287532940757897', time=2024-09-12T02:52:57.209340+0000, chain.objs.size()=1 2024-09-12T01:04:39.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.qzlmM2kbI7XhkmKjn5W-OMwGh27F662_0 2024-09-12T01:04:39.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12814035231247285305', time=2024-09-12T02:52:57.245261+0000, chain.objs.size()=1 2024-09-12T01:04:39.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.noay4fm1EpJKzMO0Z-zaT1t8PDgVE_U_0 2024-09-12T01:04:39.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.630633935086395930', time=2024-09-12T02:52:57.272713+0000, chain.objs.size()=1 2024-09-12T01:04:39.864 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Z_x-IKgcKEnpbOeTAmnRSw4PjaW5Bit_0 2024-09-12T01:04:39.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4252017814955964117', time=2024-09-12T02:52:57.450562+0000, chain.objs.size()=1 2024-09-12T01:04:39.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.XSHPs8F7oH7zxguVg-x6fErGzVFWsW2_0 2024-09-12T01:04:39.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12848111467787526635', time=2024-09-12T02:52:57.465425+0000, chain.objs.size()=1 2024-09-12T01:04:39.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.D-LavaDM9Ih5JFAesVVR2p3k3WyZ_Jl_0 2024-09-12T01:04:39.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10909435333118785359', time=2024-09-12T02:52:57.500197+0000, chain.objs.size()=1 2024-09-12T01:04:39.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.guP30PR-rek5do7Wm_YYUcOI5ke6ugM_0 2024-09-12T01:04:39.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8638320405216567965', time=2024-09-12T02:52:57.517169+0000, chain.objs.size()=1 2024-09-12T01:04:39.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.858+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.24Xbr3G0z8-0e9fHh7Lq-FK8UTcd2va_0 2024-09-12T01:04:39.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3474949863418892682', time=2024-09-12T02:52:57.682683+0000, chain.objs.size()=1 2024-09-12T01:04:39.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.WA8yD_cgRg_m8zUz7T2Pp7i0ppXxA_9_0 2024-09-12T01:04:39.865 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2071597981630796902', time=2024-09-12T02:52:57.698466+0000, chain.objs.size()=1 2024-09-12T01:04:39.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.2ZmwqWR2RgV62284KMymBaVrzInEu-H_0 2024-09-12T01:04:39.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10653418538990677180', time=2024-09-12T02:52:57.712777+0000, chain.objs.size()=1 2024-09-12T01:04:39.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.G6a8TE-jOi9E9doZGxYDndwNxspyLo5_0 2024-09-12T01:04:39.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14937246739136266091', time=2024-09-12T02:52:57.895938+0000, chain.objs.size()=1 2024-09-12T01:04:39.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.k6jzd9JFzm4FxnjvK_jH5oliBcsaH3E_0 2024-09-12T01:04:39.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6082808232032873159', time=2024-09-12T02:52:57.947389+0000, chain.objs.size()=1 2024-09-12T01:04:39.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.4DgyeqqVW7Uwx7R2vyh9Bj4-PAtPQ8F_0 2024-09-12T01:04:39.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1804552516388096478', time=2024-09-12T02:52:58.113307+0000, chain.objs.size()=1 2024-09-12T01:04:39.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_._9OYxWdLMvtijI5Ueglu7loZgDHyljy_0 2024-09-12T01:04:39.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4337087560013533758', time=2024-09-12T02:52:58.159863+0000, chain.objs.size()=1 2024-09-12T01:04:39.866 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.3Sz6tIwOqs_jPpxPOBW-W-aOq2h6hPL_0 2024-09-12T01:04:39.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11239975332221606670', time=2024-09-12T02:52:58.215273+0000, chain.objs.size()=1 2024-09-12T01:04:39.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.vsOJtwVELTgIOuAewOFC05h1I3i9LiU_0 2024-09-12T01:04:39.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6510146912845606020', time=2024-09-12T02:52:58.227774+0000, chain.objs.size()=1 2024-09-12T01:04:39.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.2Vzju5l8Pk1ld5egsUGeZPncC3t22_u_0 2024-09-12T01:04:39.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14232298711931801516', time=2024-09-12T02:52:58.232532+0000, chain.objs.size()=1 2024-09-12T01:04:39.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.WbnvbHIGyiINCoaFrxqOpCWiyRiLea3_0 2024-09-12T01:04:39.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9550008990391676484', time=2024-09-12T02:52:58.397037+0000, chain.objs.size()=1 2024-09-12T01:04:39.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.pis8UBrQQ7UIDtY52ISDBVaMNL1aAex_0 2024-09-12T01:04:39.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5987343062204323713', time=2024-09-12T02:52:58.404264+0000, chain.objs.size()=1 2024-09-12T01:04:39.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.fibxY7ONZ_-WfUg2rAb9v8YHSghFylQ_0 2024-09-12T01:04:39.867 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17746147724243563602', time=2024-09-12T02:52:58.442651+0000, chain.objs.size()=1 2024-09-12T01:04:39.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.nni5rnoc4xqavim5HV8H3hYdA9kRRQM_0 2024-09-12T01:04:39.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2190620606507569841', time=2024-09-12T02:52:58.607133+0000, chain.objs.size()=1 2024-09-12T01:04:39.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.VN5j0VAxZUOXbKW6abgtrsUvxUWG9Ce_0 2024-09-12T01:04:39.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10792718567526068347', time=2024-09-12T02:52:58.635522+0000, chain.objs.size()=1 2024-09-12T01:04:39.868 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ORfrhm4t5x-KfIjSbtZh4_2aWfIztsF_0 2024-09-12T01:04:39.869 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4743193223088534763', time=2024-09-12T02:52:58.656593+0000, chain.objs.size()=1 2024-09-12T01:04:39.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.O0ntKfQPmeLpsW470RH5raCcFnxeGET_0 2024-09-12T01:04:39.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12164774656773105812', time=2024-09-12T02:52:58.676394+0000, chain.objs.size()=1 2024-09-12T01:04:39.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.dsVYYjTHHWmLrnV3E5A8uudgdztxJRB_0 2024-09-12T01:04:39.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8524229938188018081', time=2024-09-12T02:52:58.677203+0000, chain.objs.size()=1 2024-09-12T01:04:39.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.JWVizDgZikoRw3GvmYkvlFjG8V4GAB9_0 2024-09-12T01:04:39.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12245672901527974940', time=2024-09-12T02:52:58.678373+0000, chain.objs.size()=1 2024-09-12T01:04:39.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.-9eeVkt_hXws2u2_0_OLH0Di5QY4vBF_0 2024-09-12T01:04:39.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1753887841730133339', time=2024-09-12T02:52:58.684326+0000, chain.objs.size()=1 2024-09-12T01:04:39.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.q_Tgqwh6ggvS1ZBXlPN7AZ6ZiTJv-fO_0 2024-09-12T01:04:39.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3479305578457968794', time=2024-09-12T02:52:58.692866+0000, chain.objs.size()=1 2024-09-12T01:04:39.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.1Qo4HVxqTXWVSOi646InQf3IEy3vwUi_0 2024-09-12T01:04:39.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2174304297499768545', time=2024-09-12T02:52:58.694535+0000, chain.objs.size()=1 2024-09-12T01:04:39.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.862+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.h62Kehov_OoB_t5qPi-NpE7opRV0qFH_0 2024-09-12T01:04:39.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47058 2024-09-12T01:04:39.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T01:04:39.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7704096070546358335', time=2024-09-12T02:53:37.480864+0000, chain.objs.size()=1 2024-09-12T01:04:39.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.382__shadow_.pI2thtPe_ILm3ZhfqyZ-RV-oQKzejiV_0 2024-09-12T01:04:39.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9372448793133237863', time=2024-09-12T02:54:15.093530+0000, chain.objs.size()=1 2024-09-12T01:04:39.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.432__shadow_.7YiPao193VLbuYrx0tBjPcJvevDBxPx_0 2024-09-12T01:04:39.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11479181142760031844', time=2024-09-12T02:54:34.601650+0000, chain.objs.size()=1 2024-09-12T01:04:39.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.456__shadow_.qaJKgXhkm7ZxCyvD_UjnVhXmd7w-9ZC_0 2024-09-12T01:04:39.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4729116449960765330', time=2024-09-12T02:55:46.329656+0000, chain.objs.size()=2 2024-09-12T01:04:39.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.523__multipart_mymultipart.2~MMKKX1u4NUyF3sObiAuLphyFLZpyUhZ.1 2024-09-12T01:04:39.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.523__multipart_mymultipart.2~MMKKX1u4NUyF3sObiAuLphyFLZpyUhZ.2 2024-09-12T01:04:39.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11966120698591293766', time=2024-09-12T02:55:46.823962+0000, chain.objs.size()=3 2024-09-12T01:04:39.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.523__multipart_mymultipart.2~lhnu4xvZUaxhd81PXZCteep1Kgeipft.1 2024-09-12T01:04:39.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.523__multipart_mymultipart.2~lhnu4xvZUaxhd81PXZCteep1Kgeipft.2 2024-09-12T01:04:39.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.523__multipart_mymultipart.2~lhnu4xvZUaxhd81PXZCteep1Kgeipft.3 2024-09-12T01:04:39.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11095248761168688700', time=2024-09-12T02:56:41.401018+0000, chain.objs.size()=1 2024-09-12T01:04:39.872 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.552__shadow_.Fyjdp9uNu_OQXjvjAyi4NSbnGhFpYpG_0 2024-09-12T01:04:39.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15141156513549574634', time=2024-09-12T02:56:41.661568+0000, chain.objs.size()=1 2024-09-12T01:04:39.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.552__shadow_.4gx1LjPPnJmSboBV3-Gp-UcIjMWZI4A_0 2024-09-12T01:04:39.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.400848322118166071', time=2024-09-12T02:57:14.617375+0000, chain.objs.size()=1 2024-09-12T01:04:39.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.574__shadow_.Q0ssDrXjHZ03A-Jncw8nJsNarYX1duz_0 2024-09-12T01:04:39.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.866+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4756075114079168248', time=2024-09-12T02:57:22.773338+0000, chain.objs.size()=1 2024-09-12T01:04:39.873 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.866+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.576__shadow:rSDYzebeZnx4mH78N7QmPegE7FmILc0_.WJgDeldq-M5o395PW_jvjUTKHY5a8Dp_0 2024-09-12T01:04:39.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.870+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:39.874 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.874+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:04:39.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.874+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:39.875 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.874+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:39.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.874+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54589' 2024-09-12T01:04:39.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.874+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5879203482141424183', time=2024-09-12T02:50:41.971574+0000, chain.objs.size()=1 2024-09-12T01:04:39.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.874+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.230__shadow_.bioLi1t3N8rf0c0AGDM_S0NT8oiVnJc_0 2024-09-12T01:04:39.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.874+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15089168916334983134', time=2024-09-12T02:50:45.703649+0000, chain.objs.size()=1 2024-09-12T01:04:39.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.874+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.235__shadow_.80yWX-ijHcLOpv5cLlANFEW_q3oMEr3_0 2024-09-12T01:04:39.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.874+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15701808412544470524', time=2024-09-12T02:50:46.420877+0000, chain.objs.size()=1 2024-09-12T01:04:39.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.874+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.236__shadow_.BMa6Ru2cXFu7maUDft5iqahYM5xP4_s_0 2024-09-12T01:04:39.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.874+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17648475136551740555', time=2024-09-12T02:50:56.704078+0000, chain.objs.size()=1 2024-09-12T01:04:39.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.874+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.247__shadow_.KAmPFHxDt2DCVZGtilAcKhstAvruLF8_0 2024-09-12T01:04:39.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.874+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16157735437586959802', time=2024-09-12T02:50:57.454640+0000, chain.objs.size()=1 2024-09-12T01:04:39.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.874+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.248__shadow_.QNeVIlaFrA96jgdpHpAjX2T_Te72Qlp_0 2024-09-12T01:04:39.877 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.874+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11000788608667207760', time=2024-09-12T02:50:58.900949+0000, chain.objs.size()=1 2024-09-12T01:04:39.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.874+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.250__shadow_.UUGLwXGf6a7KzHZdV9d52L61v264sPH_0 2024-09-12T01:04:39.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.874+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.611801182900100721', time=2024-09-12T02:51:02.581808+0000, chain.objs.size()=1 2024-09-12T01:04:39.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.874+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.255__shadow_.DefhE7VRFu4Md9NQ_cbdjzHPryot3kW_0 2024-09-12T01:04:39.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.874+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3363280578596208472', time=2024-09-12T02:51:03.337270+0000, chain.objs.size()=1 2024-09-12T01:04:39.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.874+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.256__shadow_.bHbnjthWgTF4-fnknq5RG41t5WFCrCE_0 2024-09-12T01:04:39.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.874+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7242407432785627958', time=2024-09-12T02:51:26.806726+0000, chain.objs.size()=1 2024-09-12T01:04:39.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.874+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.baCa_kA3Q7zRlksVHWbld3UCeRqA5nI_0 2024-09-12T01:04:39.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.874+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3965292155193156112', time=2024-09-12T02:51:26.854458+0000, chain.objs.size()=1 2024-09-12T01:04:39.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.874+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.4UVGNntuvzFV_ypSZndquuczkpW30X8_0 2024-09-12T01:04:39.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.874+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12817443408956434715', time=2024-09-12T02:51:26.872622+0000, chain.objs.size()=1 2024-09-12T01:04:39.878 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.874+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.pTIP_pw28c379w37itQinjcVBJ5mhM4_0 2024-09-12T01:04:39.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.874+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.342115282097751070', time=2024-09-12T02:51:27.019911+0000, chain.objs.size()=1 2024-09-12T01:04:39.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.874+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.jqz8RKsDx-JIMhpuPaPmgSHsd_lQAo2_0 2024-09-12T01:04:39.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3662352854124203835', time=2024-09-12T02:51:27.029800+0000, chain.objs.size()=1 2024-09-12T01:04:39.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.iga4DMR_0gYBDHv66rGfLdC1V4oYENy_0 2024-09-12T01:04:39.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11053702674084798385', time=2024-09-12T02:51:27.068754+0000, chain.objs.size()=1 2024-09-12T01:04:39.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.rqF5kZBuX3ueJV7FVTjTuz7KuAIwMph_0 2024-09-12T01:04:39.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3411380237910431744', time=2024-09-12T02:51:27.081069+0000, chain.objs.size()=1 2024-09-12T01:04:39.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.eDYFahgc8_0Cz9kjOkVx0Qb_QxVDcb0_0 2024-09-12T01:04:39.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1440776836044910244', time=2024-09-12T02:51:27.225218+0000, chain.objs.size()=1 2024-09-12T01:04:39.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.tzHf2XKSRzDdE9EZQPvWk3fhyeWF2Tr_0 2024-09-12T01:04:39.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12442780899903576886', time=2024-09-12T02:51:27.278921+0000, chain.objs.size()=1 2024-09-12T01:04:39.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.FphZZ1ja5azVT_Du6rwsJ-wv1CknqRV_0 2024-09-12T01:04:39.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2828671338138923391', time=2024-09-12T02:51:27.418346+0000, chain.objs.size()=1 2024-09-12T01:04:39.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.tkdth8HHAgF3J-bcoKp9tqAiBD53_QR_0 2024-09-12T01:04:39.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8176909699111998913', time=2024-09-12T02:51:27.461015+0000, chain.objs.size()=1 2024-09-12T01:04:39.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.5d4B-oCVKaARjfEnWEC-do0NiOs_6yG_0 2024-09-12T01:04:39.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9465053896088291607', time=2024-09-12T02:51:27.647706+0000, chain.objs.size()=1 2024-09-12T01:04:39.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.fVBhCwLXfHQKXpeulndE_7XwZBWUukV_0 2024-09-12T01:04:39.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5397809932130372195', time=2024-09-12T02:51:27.667682+0000, chain.objs.size()=1 2024-09-12T01:04:39.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.-gPCU_knpIWr_TyK1DparEQSC6wPfUX_0 2024-09-12T01:04:39.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15292194953509323152', time=2024-09-12T02:51:27.706784+0000, chain.objs.size()=1 2024-09-12T01:04:39.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.a9hOTEvc0vvcDlgWMNyuIQcOXLDk50N_0 2024-09-12T01:04:39.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6764092762764245554', time=2024-09-12T02:51:27.725284+0000, chain.objs.size()=1 2024-09-12T01:04:39.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.-T8D4XtcmXG__qnpM_mQm2qUXg4Xwkt_0 2024-09-12T01:04:39.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18074767823581278023', time=2024-09-12T02:51:27.732495+0000, chain.objs.size()=1 2024-09-12T01:04:39.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ng588jMma-DNGM-CDaAR0m2jZjitULP_0 2024-09-12T01:04:39.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11017950246868392482', time=2024-09-12T02:51:27.839344+0000, chain.objs.size()=1 2024-09-12T01:04:39.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.zGu5Sv5pjI3XAuaHbFSnkdEF3lGi3f6_0 2024-09-12T01:04:39.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2791211592227269874', time=2024-09-12T02:51:27.884847+0000, chain.objs.size()=1 2024-09-12T01:04:39.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.gDFXSptamzDkWovZ7gDRnK5h9P3lzI4_0 2024-09-12T01:04:39.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15944231073534152367', time=2024-09-12T02:51:27.919709+0000, chain.objs.size()=1 2024-09-12T01:04:39.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Mvw8-cSP8cCoOXtvSco-SfT5NFO44O__0 2024-09-12T01:04:39.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.674111720302881917', time=2024-09-12T02:51:27.948490+0000, chain.objs.size()=1 2024-09-12T01:04:39.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.6TvHk__oLz39B-GtF76OGsr51fekswM_0 2024-09-12T01:04:39.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14699010288827387811', time=2024-09-12T02:51:28.154030+0000, chain.objs.size()=1 2024-09-12T01:04:39.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.878+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.P4gIGWiCWtrIGlNKhRnB5gMrdvh7hB3_0 2024-09-12T01:04:39.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12115524330208590215', time=2024-09-12T02:51:28.156179+0000, chain.objs.size()=1 2024-09-12T01:04:39.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.kamSUQQ8BeRYUWmdBqneg77sHNNGkwx_0 2024-09-12T01:04:39.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13355276981756554717', time=2024-09-12T02:51:28.178630+0000, chain.objs.size()=1 2024-09-12T01:04:39.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.CDFOWrRTplBlHuuTS3hBdnuFPJY-Kw9_0 2024-09-12T01:04:39.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4876747889041629488', time=2024-09-12T02:51:28.363873+0000, chain.objs.size()=1 2024-09-12T01:04:39.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.oDmEB38KDImXbg5fAF5dIlg_QTWhiAW_0 2024-09-12T01:04:39.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3675055710149554357', time=2024-09-12T02:51:28.389760+0000, chain.objs.size()=1 2024-09-12T01:04:39.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.617xg_CWzJjFBVlXlel_KFidxhlqdLW_0 2024-09-12T01:04:39.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7498438035341648927', time=2024-09-12T02:51:30.099042+0000, chain.objs.size()=1 2024-09-12T01:04:39.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.264__shadow_.RLtbvw5KJgPLJRrabTthaXRMrhi8uAt_0 2024-09-12T01:04:39.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14414609319780108090', time=2024-09-12T02:51:32.899300+0000, chain.objs.size()=1 2024-09-12T01:04:39.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.268__shadow_.dr0Ha0ZPGVh3QIWOcE2W7Ud1rlIczqG_0 2024-09-12T01:04:39.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5307321472194443742', time=2024-09-12T02:51:42.403318+0000, chain.objs.size()=1 2024-09-12T01:04:39.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.281__shadow_.w0kmDKso_KD1d4WyB69DskG-yAPRt4C_0 2024-09-12T01:04:39.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13318296523586020358', time=2024-09-12T02:51:49.260087+0000, chain.objs.size()=1 2024-09-12T01:04:39.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.290__shadow_.I3852v-nqNgYEe3HN3UBLPQQZMdHUSf_0 2024-09-12T01:04:39.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12378856324782725037', time=2024-09-12T02:51:59.950856+0000, chain.objs.size()=1 2024-09-12T01:04:39.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.302__shadow_.gaosb_qDmcgX75DdwotuEbo_0MwzqCR_0 2024-09-12T01:04:39.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4134351585725397256', time=2024-09-12T02:52:02.123943+0000, chain.objs.size()=1 2024-09-12T01:04:39.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.305__shadow_.3kSHydGv_M_tFu2wfiEI7BvDf046EZ0_0 2024-09-12T01:04:39.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8066389904709358784', time=2024-09-12T02:52:35.133256+0000, chain.objs.size()=1 2024-09-12T01:04:39.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.yvTIa2rlrd8huJh08prNBF2LTycQyab_0 2024-09-12T01:04:39.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5690760607291689616', time=2024-09-12T02:52:35.183011+0000, chain.objs.size()=1 2024-09-12T01:04:39.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.rvJ0tW3kHxwmf8G3TgJv8M6QkNNQtUF_0 2024-09-12T01:04:39.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4485126500190357384', time=2024-09-12T02:52:35.292369+0000, chain.objs.size()=1 2024-09-12T01:04:39.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.nDcr1VL2WfSbK7DDRt4-4mGesEox9df_0 2024-09-12T01:04:39.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8888224302797334211', time=2024-09-12T02:52:35.314533+0000, chain.objs.size()=1 2024-09-12T01:04:39.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_._vb4Fb1nvt1XW2r34jrTH4fm0NEoNgI_0 2024-09-12T01:04:39.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1621686502645114161', time=2024-09-12T02:52:35.379475+0000, chain.objs.size()=1 2024-09-12T01:04:39.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.OdxkXN6pkzej3IIkDBhnDP8WNHiw6Dl_0 2024-09-12T01:04:39.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1314292491061186572', time=2024-09-12T02:52:35.410784+0000, chain.objs.size()=1 2024-09-12T01:04:39.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.XuYIBIOeryVdm6M_iAPRQZrz2LaZoQ0_0 2024-09-12T01:04:39.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11206710936752684684', time=2024-09-12T02:52:35.422334+0000, chain.objs.size()=1 2024-09-12T01:04:39.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.vhtsdU3fIY_ylG39rzwHhnuBb0gG6xM_0 2024-09-12T01:04:39.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.594444955387868763', time=2024-09-12T02:52:35.533550+0000, chain.objs.size()=1 2024-09-12T01:04:39.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.a233Mw8-7zYaO9PAVOKKfIU2D1cFAvq_0 2024-09-12T01:04:39.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2601194825032933036', time=2024-09-12T02:52:35.582847+0000, chain.objs.size()=1 2024-09-12T01:04:39.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.PAxx3dbY8jlBe2b2m1WCAStCpc-2MCs_0 2024-09-12T01:04:39.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18160495186965101201', time=2024-09-12T02:52:35.670268+0000, chain.objs.size()=1 2024-09-12T01:04:39.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.EXHnywl6RL5Es8xZysJKDcwAZsVBVNy_0 2024-09-12T01:04:39.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2223949910177700558', time=2024-09-12T02:52:35.781648+0000, chain.objs.size()=1 2024-09-12T01:04:39.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.882+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.s0zUicvElfJnLA0FJl8aa_Q_5KCCXcU_0 2024-09-12T01:04:39.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.886+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7877596057418072262', time=2024-09-12T02:52:35.805427+0000, chain.objs.size()=1 2024-09-12T01:04:39.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.886+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.rG6rL1UIAxNf7uP9X3z4rDB2NvUvkR7_0 2024-09-12T01:04:39.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.886+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15837194385278967271', time=2024-09-12T02:52:36.235763+0000, chain.objs.size()=1 2024-09-12T01:04:39.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.886+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.dl6LY_W9Elp8mMS5xIMAzRIRdbs-7XQ_0 2024-09-12T01:04:39.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.886+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11828069553239429685', time=2024-09-12T02:52:36.240357+0000, chain.objs.size()=1 2024-09-12T01:04:39.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.886+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.x5d_2OptQm_mHotwUX3-7TZ8kiCbcGk_0 2024-09-12T01:04:39.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.886+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11016014316012403947', time=2024-09-12T02:52:36.248303+0000, chain.objs.size()=1 2024-09-12T01:04:39.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.886+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.zsWIpAD1WLphgAsyBYY45gi3HWLgxzm_0 2024-09-12T01:04:39.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.886+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15402886124890614040', time=2024-09-12T02:52:36.300454+0000, chain.objs.size()=1 2024-09-12T01:04:39.891 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.886+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.-uSGq_57dU5DmRpIlVPK2YqOTLAld03_0 2024-09-12T01:04:39.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.886+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14636701628340002537', time=2024-09-12T02:52:36.354590+0000, chain.objs.size()=1 2024-09-12T01:04:39.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.886+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.fuDdSS3RKchaC_EfBxNc-6KY6PzJUXK_0 2024-09-12T01:04:39.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.886+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7580671200738194133', time=2024-09-12T02:52:36.391225+0000, chain.objs.size()=1 2024-09-12T01:04:39.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.886+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.UD2lbfUeX5ewM5ACsJ0bbAWe2VcY-5L_0 2024-09-12T01:04:39.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.886+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10392626814112545500', time=2024-09-12T02:52:36.570194+0000, chain.objs.size()=1 2024-09-12T01:04:39.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.886+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.W0SX4gr5hkhRYg5cyah9qrxsrox2OZU_0 2024-09-12T01:04:39.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.886+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15367475657056358851', time=2024-09-12T02:52:36.588898+0000, chain.objs.size()=1 2024-09-12T01:04:39.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.886+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_._nHUGPWbBfXVNFLbS54497tGETfHpac_0 2024-09-12T01:04:39.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.886+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.535420067908373803', time=2024-09-12T02:52:36.601699+0000, chain.objs.size()=1 2024-09-12T01:04:39.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.886+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.u0T-1eGue6UQPw7QgV3zfNN2O95d_Cj_0 2024-09-12T01:04:39.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.886+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12511621133626654585', time=2024-09-12T02:52:36.758452+0000, chain.objs.size()=1 2024-09-12T01:04:39.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.886+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.-teTWm-KBNO5Mu6-8-GMMr6cxpmPYa4_0 2024-09-12T01:04:39.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.886+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11343176314082441404', time=2024-09-12T02:52:36.793956+0000, chain.objs.size()=1 2024-09-12T01:04:39.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.886+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.hOpaQJ5YMXf1Q7yYw2mwx9zKKl0p--L_0 2024-09-12T01:04:39.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.890+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12176577276313507410', time=2024-09-12T02:52:36.846103+0000, chain.objs.size()=1 2024-09-12T01:04:39.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.890+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ShmsXU6zgXAhBtIqJHfWNqYJz9uridL_0 2024-09-12T01:04:39.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.890+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1966512553089833855', time=2024-09-12T02:52:36.993381+0000, chain.objs.size()=1 2024-09-12T01:04:39.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.890+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.0AOd2dA0BarACeKDy8llsOj9TuG9u7H_0 2024-09-12T01:04:39.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.890+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6400356746754426230', time=2024-09-12T02:52:37.016651+0000, chain.objs.size()=1 2024-09-12T01:04:39.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.890+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.p0ApYMJls4tQrKlD0b2Y13uOuJPUvmU_0 2024-09-12T01:04:39.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.890+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.96292938910711885', time=2024-09-12T02:52:37.048364+0000, chain.objs.size()=1 2024-09-12T01:04:39.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.890+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.3fUS1H2bx6ZlPvR_CEdMjap13n5Pke9_0 2024-09-12T01:04:39.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.890+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10545319258921278648', time=2024-09-12T02:52:37.050721+0000, chain.objs.size()=1 2024-09-12T01:04:39.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.890+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.1iDuhTMy-gcpWzmj02IASH40SyOVgHk_0 2024-09-12T01:04:39.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.890+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2919657270849840618', time=2024-09-12T02:52:56.905974+0000, chain.objs.size()=1 2024-09-12T01:04:39.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.890+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.3ytzmV6rpvHqTephXQk24yND3w99dGM_0 2024-09-12T01:04:39.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.890+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4589574919966914335', time=2024-09-12T02:52:56.976227+0000, chain.objs.size()=1 2024-09-12T01:04:39.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.890+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.wxjef-EFVY0aP6C4kg2fV4b5TQjW_Sm_0 2024-09-12T01:04:39.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.890+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.206058913409288630', time=2024-09-12T02:52:56.982202+0000, chain.objs.size()=1 2024-09-12T01:04:39.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.890+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.jBnz6c69_k02yQUi1lqnrtgPkdMyIYe_0 2024-09-12T01:04:39.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.890+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12542681031832935856', time=2024-09-12T02:52:57.034232+0000, chain.objs.size()=1 2024-09-12T01:04:39.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.890+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.sePZTqAIaKdPZBQEuK4eKgZ_p5ucf0r_0 2024-09-12T01:04:39.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.890+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2829101993584800717', time=2024-09-12T02:52:57.045412+0000, chain.objs.size()=1 2024-09-12T01:04:39.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.890+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.FzjdEPwtw5AiODcY5BY6W8hqMOArpgq_0 2024-09-12T01:04:39.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.890+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13430376814225436944', time=2024-09-12T02:52:57.246366+0000, chain.objs.size()=1 2024-09-12T01:04:39.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.890+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.fTkasYj8K2_Kx4Spf7PdeHmcQMlTmtk_0 2024-09-12T01:04:39.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.890+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13619590317465263720', time=2024-09-12T02:52:57.247230+0000, chain.objs.size()=1 2024-09-12T01:04:39.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.890+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.VUywdYt0dHi-qsEZdhDJZWTwyBT3bI2_0 2024-09-12T01:04:39.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1927257415194337482', time=2024-09-12T02:52:57.282385+0000, chain.objs.size()=1 2024-09-12T01:04:39.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.LGSIkpakxtGMXTJG2jWtT73_i0Vh6ih_0 2024-09-12T01:04:39.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15618014924858685554', time=2024-09-12T02:52:57.406417+0000, chain.objs.size()=1 2024-09-12T01:04:39.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.3EnL4HhHI3pE8Sq7SoPpV2yv3CmZ3cm_0 2024-09-12T01:04:39.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16152032357141099283', time=2024-09-12T02:52:57.442850+0000, chain.objs.size()=1 2024-09-12T01:04:39.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.yMkjJ9R9ETkrleBP_p9M8u9THsKQiU5_0 2024-09-12T01:04:39.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4359101829826132427', time=2024-09-12T02:52:57.456221+0000, chain.objs.size()=1 2024-09-12T01:04:39.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.yZLvU-8vD9J-8a3hRYzvPRY_ylnK1aS_0 2024-09-12T01:04:39.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16419500070365386732', time=2024-09-12T02:52:57.502129+0000, chain.objs.size()=1 2024-09-12T01:04:39.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.1PQP2XLXR6sjF90OylJfZm0jA0tAhmW_0 2024-09-12T01:04:39.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7051946654840113393', time=2024-09-12T02:52:57.509387+0000, chain.objs.size()=1 2024-09-12T01:04:39.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.6hEAUTQw1FcIVSeXqmnImROvpfF-Lm9_0 2024-09-12T01:04:39.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14997571824322612572', time=2024-09-12T02:52:57.652716+0000, chain.objs.size()=1 2024-09-12T01:04:39.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.HLtkk3OjpQGV4KWtk_iVL8nop3MssRn_0 2024-09-12T01:04:39.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4214775400385155106', time=2024-09-12T02:52:57.663533+0000, chain.objs.size()=1 2024-09-12T01:04:39.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.EJweI0hqzmrOhSb8pfNIVuF_yhgxadG_0 2024-09-12T01:04:39.898 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6479311673251748503', time=2024-09-12T02:52:57.679852+0000, chain.objs.size()=1 2024-09-12T01:04:39.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.SAU6igYG_5LBLXWIoQN2TcQtV0io4th_0 2024-09-12T01:04:39.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3578284819242988274', time=2024-09-12T02:52:57.709316+0000, chain.objs.size()=1 2024-09-12T01:04:39.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.vQCYXr9A_EdVtgTNWjfhgjzX0MY6HaH_0 2024-09-12T01:04:39.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18422788499995083095', time=2024-09-12T02:52:57.716184+0000, chain.objs.size()=1 2024-09-12T01:04:39.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.qixsmGNa77MpbDuEg3OeFQlnoyt6uQ9_0 2024-09-12T01:04:39.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14025672667275346957', time=2024-09-12T02:52:57.727971+0000, chain.objs.size()=1 2024-09-12T01:04:39.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.GxUhRgqA3X2zuYnmIcIgxBuOQxN6PuG_0 2024-09-12T01:04:39.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13721559606883714439', time=2024-09-12T02:52:57.740673+0000, chain.objs.size()=1 2024-09-12T01:04:39.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.6AvvWpy7XyCJIiFFQu4X3nSn3AQoQVM_0 2024-09-12T01:04:39.899 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1685021320454010467', time=2024-09-12T02:52:57.868319+0000, chain.objs.size()=1 2024-09-12T01:04:39.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.3qorYOZBPHArb2UkMk4NPhNrytQ0Kdj_0 2024-09-12T01:04:39.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3268205336867428401', time=2024-09-12T02:52:57.961674+0000, chain.objs.size()=1 2024-09-12T01:04:39.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.s1VpBzd7TjbR2Vz6sHYvIlavQFMM2FW_0 2024-09-12T01:04:39.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.743084398968914744', time=2024-09-12T02:52:58.121612+0000, chain.objs.size()=1 2024-09-12T01:04:39.900 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.pR6HtcyAYtyOwR7GDONBpqJ0jbGzZeT_0 2024-09-12T01:04:39.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10314909019676271497', time=2024-09-12T02:52:58.139740+0000, chain.objs.size()=1 2024-09-12T01:04:39.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.a_N9HHyqYwJqv5BAhPp9foduX3kN6rV_0 2024-09-12T01:04:39.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.894+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10493554606613732602', time=2024-09-12T02:52:58.197925+0000, chain.objs.size()=1 2024-09-12T01:04:39.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.898+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.8goEoFIumKSv0dA8YFcLAaA83EWBUwn_0 2024-09-12T01:04:39.901 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.898+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4643756311301922411', time=2024-09-12T02:52:58.364299+0000, chain.objs.size()=1 2024-09-12T01:04:39.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.898+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.t4VvXQ1Fq8OFB7bDPg6yB8jkj0rqqKt_0 2024-09-12T01:04:39.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.898+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1395754929282601925', time=2024-09-12T02:52:58.414040+0000, chain.objs.size()=1 2024-09-12T01:04:39.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.898+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.RUxox9ANAFCuVqSHnwrc6rNOtRhgm1F_0 2024-09-12T01:04:39.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.898+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3172080248739640255', time=2024-09-12T02:52:58.422092+0000, chain.objs.size()=1 2024-09-12T01:04:39.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.898+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.q259A3tdyWS_NwrFme_nygAM_ZXvOJV_0 2024-09-12T01:04:39.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.898+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4197756057711503423', time=2024-09-12T02:52:58.488602+0000, chain.objs.size()=1 2024-09-12T01:04:39.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.898+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.J9NFYTPsjd3_NIacKED29itHI5kL8sH_0 2024-09-12T01:04:39.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.898+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.244393971915650359', time=2024-09-12T02:52:58.489573+0000, chain.objs.size()=1 2024-09-12T01:04:39.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.898+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.8OIajZNcuWMEUfh8k6AlYPNjums9fOL_0 2024-09-12T01:04:39.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.898+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14948955671821905111', time=2024-09-12T02:52:58.602724+0000, chain.objs.size()=1 2024-09-12T01:04:39.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.898+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.GlNYuDCJxJ4OOBhUpqBqRgL70cUBK6M_0 2024-09-12T01:04:39.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.898+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5240909857471317262', time=2024-09-12T02:53:06.630501+0000, chain.objs.size()=1 2024-09-12T01:04:39.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.898+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.336__shadow_.do0B8GDdoIJVjuIVac0Wc8x7ij-sGxx_0 2024-09-12T01:04:39.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.898+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15158915191236734216', time=2024-09-12T02:54:17.149240+0000, chain.objs.size()=1 2024-09-12T01:04:39.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.898+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.435__shadow_.YKkiseAfFJJhznA-3vDASt8ZLOJYdPZ_0 2024-09-12T01:04:39.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.902+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/54589 2024-09-12T01:04:39.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.902+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T01:04:39.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.902+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5549593683597389311', time=2024-09-12T02:54:43.473144+0000, chain.objs.size()=1 2024-09-12T01:04:39.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.902+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.465__shadow_.Axh-4IYbRn1ka0Imko49XrWrLyiRfX7_0 2024-09-12T01:04:39.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.902+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13783990198151820147', time=2024-09-12T02:54:44.703651+0000, chain.objs.size()=1 2024-09-12T01:04:39.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.902+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.466__shadow_.GfNBZWkIimT8VfxC-1SAjGQtCRRNS9V_0 2024-09-12T01:04:39.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.902+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3436445431551786037', time=2024-09-12T02:54:55.813950+0000, chain.objs.size()=1 2024-09-12T01:04:39.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.902+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.486__shadow_.BpLimXrGdl_372JiTfIzJLU6RgCwSaB_0 2024-09-12T01:04:39.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.902+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8536689252629478426', time=2024-09-12T02:54:57.338445+0000, chain.objs.size()=1 2024-09-12T01:04:39.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.902+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.488__shadow_.zd28AYH1ze4K5PLCzDOT0ex--KhJUbV_0 2024-09-12T01:04:39.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.902+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3697370548420572618', time=2024-09-12T02:55:01.600482+0000, chain.objs.size()=1 2024-09-12T01:04:39.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.902+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.495__shadow_.rfycehjQ2ck_GhOGeaVpCaIJw6GJxrw_0 2024-09-12T01:04:39.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.902+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.964231070736783394', time=2024-09-12T02:55:15.248652+0000, chain.objs.size()=1 2024-09-12T01:04:39.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.902+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.514__shadow_.89eFwVbEEN4-4lQNY7I4Tv-h7oXtTdu_0 2024-09-12T01:04:39.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.902+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11476524933809555332', time=2024-09-12T02:55:26.732497+0000, chain.objs.size()=3 2024-09-12T01:04:39.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.902+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.521__multipart_mymultipart.2~N6Z4gTOOIMimaH21jdYnuOKSafeS7ZV.1 2024-09-12T01:04:39.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.902+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.521__multipart_mymultipart.2~N6Z4gTOOIMimaH21jdYnuOKSafeS7ZV.2 2024-09-12T01:04:39.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.902+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.521__multipart_mymultipart.2~N6Z4gTOOIMimaH21jdYnuOKSafeS7ZV.3 2024-09-12T01:04:39.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.902+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3971933203706941571', time=2024-09-12T02:56:46.876572+0000, chain.objs.size()=1 2024-09-12T01:04:39.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.902+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.557__shadow_.A-8v2S5BBRYFRKcnDnswbY_F3lw0dmc_0 2024-09-12T01:04:39.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.902+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9477315876713125782', time=2024-09-12T02:57:02.162055+0000, chain.objs.size()=1 2024-09-12T01:04:39.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.902+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.569__shadow:ruZhwaRasNVnKfuHIkekOa1QP6gRNWU_.HyqZVKlkNIdSHl_FFfdfvcSZG4VQFJZ_0 2024-09-12T01:04:39.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.902+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5026763871823113881', time=2024-09-12T02:57:06.010861+0000, chain.objs.size()=1 2024-09-12T01:04:39.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.902+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.569__shadow:XkxNGxJsFwQKN0xlsrxRkxtjvnpp3bM_.cw-WvNySnoB5pKbU6wQJuCsUpPa8INF_0 2024-09-12T01:04:39.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.902+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7083255220713849346', time=2024-09-12T02:57:07.831094+0000, chain.objs.size()=1 2024-09-12T01:04:39.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.902+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.569__shadow:UR4bSjjxIoA2CDY.ExjDse3E0QThNOI_.KJKoMcMR8C3RLWoOccsC4SI95Fj_fL4_0 2024-09-12T01:04:39.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.906+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782999231823602705', time=2024-09-12T02:57:28.696151+0000, chain.objs.size()=1 2024-09-12T01:04:39.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.906+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:B2OUW6keejSFRysiEX.L8T7ptP7TpFM_.g2q9h-Pnh3hZK-OgOULcVWr0QJgudwT_0 2024-09-12T01:04:39.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.906+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6233083538379093632', time=2024-09-12T02:57:48.194693+0000, chain.objs.size()=1 2024-09-12T01:04:39.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.906+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.583__shadow:sQIqYIVgqtAq4DI72h5RwWJCTDAduze_.PAVeIPL5btpEAHinik5zYWeMJVA9HJw_0 2024-09-12T01:04:39.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.906+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1948294267355706407', time=2024-09-12T03:00:55.114785+0000, chain.objs.size()=1 2024-09-12T01:04:39.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.906+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.652__shadow_.-aCKBvZO2BQXTrOMpMwfKOyN2L4__qv_0 2024-09-12T01:04:39.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.906+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13743146397403622575', time=2024-09-12T03:01:04.599035+0000, chain.objs.size()=6 2024-09-12T01:04:39.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.906+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.662__multipart_foo.2~gI9eDUuk8BEJQOztKjdViYB8cdkVMIP.1 2024-09-12T01:04:39.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.906+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.662__multipart_foo.2~gI9eDUuk8BEJQOztKjdViYB8cdkVMIP.2 2024-09-12T01:04:39.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.906+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.662__multipart_foo.2~gI9eDUuk8BEJQOztKjdViYB8cdkVMIP.3 2024-09-12T01:04:39.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.906+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.662__multipart_foo.2~gI9eDUuk8BEJQOztKjdViYB8cdkVMIP.4 2024-09-12T01:04:39.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.906+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.662__multipart_foo.2~gI9eDUuk8BEJQOztKjdViYB8cdkVMIP.5 2024-09-12T01:04:39.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.906+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.662__multipart_foo.2~gI9eDUuk8BEJQOztKjdViYB8cdkVMIP.6 2024-09-12T01:04:39.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.906+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9798530977873354559', time=2024-09-12T03:01:10.425426+0000, chain.objs.size()=1 2024-09-12T01:04:39.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.906+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.670__shadow_.vqs1KbrJgoT6nm-tMBW_G4-LuAPi3k4_0 2024-09-12T01:04:39.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.906+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11529270572914100814', time=2024-09-12T03:02:01.791597+0000, chain.objs.size()=1 2024-09-12T01:04:39.909 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.906+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.718__shadow_.Y80vibwP9orv5rAW1QoAyqU2pVb4tsc_0 2024-09-12T01:04:39.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.910+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:39.913 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.914+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:04:39.914 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.914+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:39.915 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.914+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:39.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.914+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47247' 2024-09-12T01:04:39.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.914+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7724251457524221203', time=2024-09-12T02:48:30.962552+0000, chain.objs.size()=5 2024-09-12T01:04:39.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.914+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.159__multipart_mymultipart-LUKEWARM.2~lnbPbVKDiX5ASAJMsHe3xqIONLgjewL.1 2024-09-12T01:04:39.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.914+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.159__shadow_mymultipart-LUKEWARM.2~lnbPbVKDiX5ASAJMsHe3xqIONLgjewL.1_1 2024-09-12T01:04:39.916 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.914+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.159__multipart_mymultipart-LUKEWARM.2~lnbPbVKDiX5ASAJMsHe3xqIONLgjewL.2 2024-09-12T01:04:39.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.914+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.159__shadow_mymultipart-LUKEWARM.2~lnbPbVKDiX5ASAJMsHe3xqIONLgjewL.2_1 2024-09-12T01:04:39.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.914+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.159__multipart_mymultipart-LUKEWARM.2~lnbPbVKDiX5ASAJMsHe3xqIONLgjewL.3 2024-09-12T01:04:39.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.914+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9617128951696774073', time=2024-09-12T02:48:31.366978+0000, chain.objs.size()=1 2024-09-12T01:04:39.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.914+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.160__shadow_.jeYYqrls8VrHry42OPoqZfoio_du8tw_0 2024-09-12T01:04:39.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.914+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2998401443800189118', time=2024-09-12T02:50:44.915925+0000, chain.objs.size()=1 2024-09-12T01:04:39.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.914+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.234__shadow_.Elkocb_OULfX-ZlcYDOaOETFx8U1iYv_0 2024-09-12T01:04:39.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.914+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.696209083350525321', time=2024-09-12T02:51:26.747816+0000, chain.objs.size()=1 2024-09-12T01:04:39.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.914+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.2QvwYWZFrpHa_JJdbQhFsMjA5ifSnjZ_0 2024-09-12T01:04:39.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.914+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6409405194816186815', time=2024-09-12T02:51:26.803072+0000, chain.objs.size()=1 2024-09-12T01:04:39.917 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.914+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ySPs7KaDKV0Qhgnw5Xm1UB_cWB7NMw-_0 2024-09-12T01:04:39.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.914+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16428719992043335267', time=2024-09-12T02:51:26.824554+0000, chain.objs.size()=1 2024-09-12T01:04:39.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.914+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.0wmQmkuqbcdC3B06cjHIGr2a-Xm0Pqq_0 2024-09-12T01:04:39.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.914+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18032943008118558320', time=2024-09-12T02:51:26.855490+0000, chain.objs.size()=1 2024-09-12T01:04:39.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.914+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.s9hV3IbKkq9D-ncuSHDCZB-rKczuN93_0 2024-09-12T01:04:39.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.914+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7507162745562602503', time=2024-09-12T02:51:27.006811+0000, chain.objs.size()=1 2024-09-12T01:04:39.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.914+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.hW_hxapsVwkoRnKeQ3S8wmKo_KAnYYt_0 2024-09-12T01:04:39.918 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.918+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11537643711540876048', time=2024-09-12T02:51:27.029670+0000, chain.objs.size()=1 2024-09-12T01:04:39.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.918+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Wjtb5h_mCEuonTJNCePigyKCmTlqyH8_0 2024-09-12T01:04:39.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.918+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13620742612520899419', time=2024-09-12T02:51:27.030565+0000, chain.objs.size()=1 2024-09-12T01:04:39.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.918+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.wtOM8uuY8m-60f3yHWuWzxAard4IfDQ_0 2024-09-12T01:04:39.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.918+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8131430443473182478', time=2024-09-12T02:51:27.055613+0000, chain.objs.size()=1 2024-09-12T01:04:39.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.918+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.zc-wKjvyc5yuTRrU3lffY925AaBo5gk_0 2024-09-12T01:04:39.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.918+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14360436054586814167', time=2024-09-12T02:51:27.066675+0000, chain.objs.size()=1 2024-09-12T01:04:39.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.918+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.P3KaPDCeEB3Fv0jSPN50p6lGKncNCxh_0 2024-09-12T01:04:39.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.918+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6833622599685323772', time=2024-09-12T02:51:27.068589+0000, chain.objs.size()=1 2024-09-12T01:04:39.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.918+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.HwlfBovoXQet1M3gPv01XSOdZrE65jk_0 2024-09-12T01:04:39.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.918+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4976430644532600827', time=2024-09-12T02:51:27.327561+0000, chain.objs.size()=1 2024-09-12T01:04:39.920 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.918+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.D_alZn9cegqN-b63QBqifgQM3325gmd_0 2024-09-12T01:04:39.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.918+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3505538183410647453', time=2024-09-12T02:51:27.429900+0000, chain.objs.size()=1 2024-09-12T01:04:39.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.918+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.QW4eICIim1sd8xsO8Hx7NM_urmVJkGO_0 2024-09-12T01:04:39.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.918+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3035441546648305099', time=2024-09-12T02:51:27.437755+0000, chain.objs.size()=1 2024-09-12T01:04:39.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.918+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.79pLQSdQuYnN-tO4U3pjei8e9KoaTps_0 2024-09-12T01:04:39.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.918+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11589864533747181513', time=2024-09-12T02:51:27.464261+0000, chain.objs.size()=1 2024-09-12T01:04:39.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.918+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.33864WbK3tow_nD4gUNaljXGo6pqT-G_0 2024-09-12T01:04:39.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.918+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.617489046157768088', time=2024-09-12T02:51:27.473094+0000, chain.objs.size()=1 2024-09-12T01:04:39.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.918+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.MTIfo8X5B03nHGWGvNCXhXLDUlGf2gS_0 2024-09-12T01:04:39.921 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.918+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7608622392321014103', time=2024-09-12T02:51:27.502838+0000, chain.objs.size()=1 2024-09-12T01:04:39.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.918+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.LPG0iCG2ylvhKiNRi2bJ0PkTh4QGh6k_0 2024-09-12T01:04:39.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.918+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3046460229738290441', time=2024-09-12T02:51:27.509199+0000, chain.objs.size()=1 2024-09-12T01:04:39.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.918+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.7BSVPEwtCjZJeO--fAvBW5nq3Bmrcfi_0 2024-09-12T01:04:39.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.922+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13409957359854337319', time=2024-09-12T02:51:27.532991+0000, chain.objs.size()=1 2024-09-12T01:04:39.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.922+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.O46vJ7F-ws8TjOL50TW-ZnkKK5XFsxb_0 2024-09-12T01:04:39.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.922+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15189954645238686121', time=2024-09-12T02:51:27.627484+0000, chain.objs.size()=1 2024-09-12T01:04:39.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.922+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.umTaycNy3sPR7pjP1fdApdmO0sV40J4_0 2024-09-12T01:04:39.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.922+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11221238839595633539', time=2024-09-12T02:51:27.705951+0000, chain.objs.size()=1 2024-09-12T01:04:39.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.922+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.zSSZy6kdJ_wlTAxYhT3pUTTiZqFiHLo_0 2024-09-12T01:04:39.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.922+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14019333868712835789', time=2024-09-12T02:51:27.710843+0000, chain.objs.size()=1 2024-09-12T01:04:39.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.922+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.EftBBG3RWzmxiccWxaLQQs_jeOKuAM4_0 2024-09-12T01:04:39.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.922+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12490710485771924370', time=2024-09-12T02:51:27.840744+0000, chain.objs.size()=1 2024-09-12T01:04:39.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.922+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.-MFdo6kq2gvhhxVb1kPmNLjFrQTlnSE_0 2024-09-12T01:04:39.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.922+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12706909101745733212', time=2024-09-12T02:51:27.903298+0000, chain.objs.size()=1 2024-09-12T01:04:39.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.922+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.P1-VTchyE8Cemewy0oUh6Q24atfS_ng_0 2024-09-12T01:04:39.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.922+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15983459481491510249', time=2024-09-12T02:51:27.924431+0000, chain.objs.size()=1 2024-09-12T01:04:39.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.922+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.0Dya31kAbFkDxFSoh6IOiS7cZAhxLsY_0 2024-09-12T01:04:39.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.922+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16175831249222752207', time=2024-09-12T02:51:27.928082+0000, chain.objs.size()=1 2024-09-12T01:04:39.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.922+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.s7OpNvMiyka5Ti2HgB4g2e3unjUNs1O_0 2024-09-12T01:04:39.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.922+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.741001493181906083', time=2024-09-12T02:51:27.952323+0000, chain.objs.size()=1 2024-09-12T01:04:39.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.922+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.iz8TWtuKFGyjdCwGbzxIp029wIWo_Uw_0 2024-09-12T01:04:39.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.922+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9329588218874481765', time=2024-09-12T02:51:28.148208+0000, chain.objs.size()=1 2024-09-12T01:04:39.924 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.922+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.hLBuMQxedqBUPrKHMGShN0N2Jbmvnub_0 2024-09-12T01:04:39.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.922+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10858984734190996784', time=2024-09-12T02:51:28.171438+0000, chain.objs.size()=1 2024-09-12T01:04:39.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.922+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.2R-bTOhpV02rQlUjarJzK9rSmcFHTG3_0 2024-09-12T01:04:39.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.922+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14396003141776623905', time=2024-09-12T02:51:28.175522+0000, chain.objs.size()=1 2024-09-12T01:04:39.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.922+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.poPdJYYQPi6ejRsiuhB5FVCbTMYRisu_0 2024-09-12T01:04:39.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.922+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2508336748671999539', time=2024-09-12T02:51:28.187051+0000, chain.objs.size()=1 2024-09-12T01:04:39.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.922+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.yY2zq4LE9mx33YmKpXH98gHiDUfd3Vp_0 2024-09-12T01:04:39.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17446772498679146270', time=2024-09-12T02:51:28.199609+0000, chain.objs.size()=1 2024-09-12T01:04:39.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Y1B5BWfPFkYxuQ2WVdoSgvHD50YNmxq_0 2024-09-12T01:04:39.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6132815271184562331', time=2024-09-12T02:51:28.238848+0000, chain.objs.size()=1 2024-09-12T01:04:39.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Yn270Tpsu50_RqF8Q8_r4rpa-2Mt4o7_0 2024-09-12T01:04:39.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16014213721663281512', time=2024-09-12T02:51:28.401256+0000, chain.objs.size()=1 2024-09-12T01:04:39.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.LlCFh-cB2iwo2S70BX3UnkQajtZFuan_0 2024-09-12T01:04:39.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5178354412674357781', time=2024-09-12T02:51:33.658013+0000, chain.objs.size()=1 2024-09-12T01:04:39.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.269__shadow_.VpS_-H9GWUvTShZAEKlTmQDOqJSWHSV_0 2024-09-12T01:04:39.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8987873589493745545', time=2024-09-12T02:51:38.781425+0000, chain.objs.size()=1 2024-09-12T01:04:39.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.276__shadow_.4VFpyJf1UYKQL6AnTIschvsLivtYiFh_0 2024-09-12T01:04:39.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5467624420236529175', time=2024-09-12T02:51:47.748675+0000, chain.objs.size()=1 2024-09-12T01:04:39.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.288__shadow_.JOudQV00_-H_oPxJhQO9TFBDNWT52Pb_0 2024-09-12T01:04:39.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5862191163941754263', time=2024-09-12T02:51:53.154662+0000, chain.objs.size()=1 2024-09-12T01:04:39.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.293__shadow_.TkqZQhOEcaHFjVvOl9xGfGJF4CnoEon_0 2024-09-12T01:04:39.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14920603737327034458', time=2024-09-12T02:51:55.367890+0000, chain.objs.size()=1 2024-09-12T01:04:39.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.296__shadow_.K6aM3nk0ZYgmHOWU0Wu-bTu0U02jH0s_0 2024-09-12T01:04:39.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4739617085073955317', time=2024-09-12T02:51:56.913967+0000, chain.objs.size()=1 2024-09-12T01:04:39.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.298__shadow_.RMjPHopi8ar8Tn62D6p964jNClydNiM_0 2024-09-12T01:04:39.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16419734946784949054', time=2024-09-12T02:52:04.190521+0000, chain.objs.size()=1 2024-09-12T01:04:39.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.307__shadow:M86uygLd5KNnRIJ5R32t7maCzx.VSUZ_.-4X1rLFIfU3hTjI76RgUK-oEFGT752q_0 2024-09-12T01:04:39.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15371731030136768538', time=2024-09-12T02:52:08.729661+0000, chain.objs.size()=1 2024-09-12T01:04:39.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.313__shadow_.OCoKqfGR6OTJ_-40vR1uFXqBbggJLtA_0 2024-09-12T01:04:39.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.653953752029474543', time=2024-09-12T02:52:35.055559+0000, chain.objs.size()=1 2024-09-12T01:04:39.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.__6bv_KKARZye7s8zK0L5-vh7fCVGu4_0 2024-09-12T01:04:39.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13681504462791912011', time=2024-09-12T02:52:35.129925+0000, chain.objs.size()=1 2024-09-12T01:04:39.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ckvabr6opY_a3y1loTPfDs93YtkTECz_0 2024-09-12T01:04:39.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.759575965488702176', time=2024-09-12T02:52:35.177457+0000, chain.objs.size()=1 2024-09-12T01:04:39.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.0mTl28WnE_q1wZaVc_XZQvCvzXM_-fC_0 2024-09-12T01:04:39.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1903940501671871325', time=2024-09-12T02:52:35.180879+0000, chain.objs.size()=1 2024-09-12T01:04:39.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.87jokPJsbkkuOpHKnOzGXkwWrH-o3qv_0 2024-09-12T01:04:39.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7166112617247105298', time=2024-09-12T02:52:35.185456+0000, chain.objs.size()=1 2024-09-12T01:04:39.930 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.VEy7NjoHHanj5liNhbwvUHUL4_mQVXV_0 2024-09-12T01:04:39.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2759801294962057599', time=2024-09-12T02:52:35.296569+0000, chain.objs.size()=1 2024-09-12T01:04:39.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Myl110eVLDQR-oke_CqdCPmpcBmyx1A_0 2024-09-12T01:04:39.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6425872891868439152', time=2024-09-12T02:52:35.365726+0000, chain.objs.size()=1 2024-09-12T01:04:39.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.64FRQMaY0NDb5HdPSzECF6KtO1PTRF__0 2024-09-12T01:04:39.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3909889353647932986', time=2024-09-12T02:52:35.397816+0000, chain.objs.size()=1 2024-09-12T01:04:39.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.SRTmu_mIp75WDT7BT45QltkQktG36Jh_0 2024-09-12T01:04:39.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13991178413329411012', time=2024-09-12T02:52:35.401073+0000, chain.objs.size()=1 2024-09-12T01:04:39.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.9V-FoP-iTzLu3_w5CSX3Q72hKKR88tT_0 2024-09-12T01:04:39.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6963898348129052416', time=2024-09-12T02:52:35.533810+0000, chain.objs.size()=1 2024-09-12T01:04:39.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.QMdIVcmSjyBW-zGRfD1ISScarBGQMBl_0 2024-09-12T01:04:39.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9923252669517641360', time=2024-09-12T02:52:35.572966+0000, chain.objs.size()=1 2024-09-12T01:04:39.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.926+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.B__g1FuL9ejN99ggsn8-Eqc2dRBPKxq_0 2024-09-12T01:04:39.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8855715155320276854', time=2024-09-12T02:52:35.588946+0000, chain.objs.size()=1 2024-09-12T01:04:39.933 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.lYuUmGOmNqu_GR369XD5AzDVjDJRrEq_0 2024-09-12T01:04:39.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4202119091432123359', time=2024-09-12T02:52:35.621733+0000, chain.objs.size()=1 2024-09-12T01:04:39.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.rD3VsKgKgAfvULEpQ2CqVDwDWi451Si_0 2024-09-12T01:04:39.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1994747068702435827', time=2024-09-12T02:52:35.624669+0000, chain.objs.size()=1 2024-09-12T01:04:39.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.YD_VoykEfidCFOmQAQMdPJNnsuRQUAB_0 2024-09-12T01:04:39.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11623950528529464469', time=2024-09-12T02:52:35.625968+0000, chain.objs.size()=1 2024-09-12T01:04:39.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.8YcOrYbzMVrNXBAW4KBWANegwC0dgNp_0 2024-09-12T01:04:39.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16584264480663871709', time=2024-09-12T02:52:35.626877+0000, chain.objs.size()=1 2024-09-12T01:04:39.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.j0Q7eJuNRxSCD2y42RvosNIv3FSSq1m_0 2024-09-12T01:04:39.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8131900477634866465', time=2024-09-12T02:52:35.637599+0000, chain.objs.size()=1 2024-09-12T01:04:39.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.LaLXV82xNqbxt1psQrw8FoiEt-Gm9kB_0 2024-09-12T01:04:39.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6073445196629735798', time=2024-09-12T02:52:35.638630+0000, chain.objs.size()=1 2024-09-12T01:04:39.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.iBv_s3l2iOO2-6NxO2_RH7ZfS1WcEbZ_0 2024-09-12T01:04:39.935 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5328806045987773178', time=2024-09-12T02:52:35.851921+0000, chain.objs.size()=1 2024-09-12T01:04:39.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.X18fnnQYsYQ3tn83fbt-oLABzgjd5Hj_0 2024-09-12T01:04:39.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.367368530206290926', time=2024-09-12T02:52:35.858895+0000, chain.objs.size()=1 2024-09-12T01:04:39.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.-Ib8xx46hKy4y8YvsqNTYvN6rVetH2q_0 2024-09-12T01:04:39.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14400675626017537041', time=2024-09-12T02:52:36.263247+0000, chain.objs.size()=1 2024-09-12T01:04:39.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.gsq-TfjlXdDZhuuA5NKlj9CE2HO6qdP_0 2024-09-12T01:04:39.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3436548621096069946', time=2024-09-12T02:52:36.277604+0000, chain.objs.size()=1 2024-09-12T01:04:39.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.jKJJ9NXypcNfSHD4D-Vc4Fuj1YEBNI2_0 2024-09-12T01:04:39.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.930+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13012094331803582739', time=2024-09-12T02:52:36.289567+0000, chain.objs.size()=1 2024-09-12T01:04:39.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.930+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.XASE84drEReIyc2Gw_XtXoP7k-eGg-o_0 2024-09-12T01:04:39.936 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.934+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6740098241981292530', time=2024-09-12T02:52:36.304254+0000, chain.objs.size()=1 2024-09-12T01:04:39.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.934+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.j81xtkNW-PGwrssVGwrCr8r-xyxE7-Y_0 2024-09-12T01:04:39.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.934+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2104538171103813125', time=2024-09-12T02:52:36.379544+0000, chain.objs.size()=1 2024-09-12T01:04:39.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.934+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.4BjmY6cO31w52JKIIhn6jMavf2mpeWt_0 2024-09-12T01:04:39.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.934+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3368013978834971406', time=2024-09-12T02:52:36.380647+0000, chain.objs.size()=1 2024-09-12T01:04:39.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.934+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Tu5f23SRptuRXQfmbIOLFiawjLRl_Ch_0 2024-09-12T01:04:39.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.934+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10849233473655949277', time=2024-09-12T02:52:36.601249+0000, chain.objs.size()=1 2024-09-12T01:04:39.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.934+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.aWEElZRZS63ANrws_1cyArRI2uItVlw_0 2024-09-12T01:04:39.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.934+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12007093806784301439', time=2024-09-12T02:52:36.606146+0000, chain.objs.size()=1 2024-09-12T01:04:39.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.934+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.wcEijGtOxhNuVhPIswwo4VS2z2rZ1Hy_0 2024-09-12T01:04:39.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.934+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15758957224300602965', time=2024-09-12T02:52:36.804319+0000, chain.objs.size()=1 2024-09-12T01:04:39.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.934+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.gF9prwI4NmjZFiDV8T8-Rl_Sd2mOchW_0 2024-09-12T01:04:39.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.934+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5633037347754347875', time=2024-09-12T02:52:36.836512+0000, chain.objs.size()=1 2024-09-12T01:04:39.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.934+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.gxDf3DRF6T1LrhxKAOdYWejxg3NqIuG_0 2024-09-12T01:04:39.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.934+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11187019689047745512', time=2024-09-12T02:52:36.838080+0000, chain.objs.size()=1 2024-09-12T01:04:39.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.934+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.xqeHIQ0U_SFGTIgdty9slVKEGiEJneE_0 2024-09-12T01:04:39.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.934+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13076228238826108475', time=2024-09-12T02:52:36.988311+0000, chain.objs.size()=1 2024-09-12T01:04:39.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.934+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ttKrejGjHXBYsmni9RtdjGsMlbPFvlg_0 2024-09-12T01:04:39.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.934+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15278497609351625183', time=2024-09-12T02:52:36.989905+0000, chain.objs.size()=1 2024-09-12T01:04:39.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.934+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.SATH_ZyF5oeFVx_ZzqTr0uIXnZJvy81_0 2024-09-12T01:04:39.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.934+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4856129301248507273', time=2024-09-12T02:52:37.015808+0000, chain.objs.size()=1 2024-09-12T01:04:39.939 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.934+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_._TdgcunQ8_yceTAPbCABqEH8iuULzpx_0 2024-09-12T01:04:39.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.934+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.155029084216781924', time=2024-09-12T02:52:37.092845+0000, chain.objs.size()=1 2024-09-12T01:04:39.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.934+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.UicMJ13vkvrc88dmfi2Npb4vgoFsE69_0 2024-09-12T01:04:39.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.934+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12987708706090612096', time=2024-09-12T02:52:57.014472+0000, chain.objs.size()=1 2024-09-12T01:04:39.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.934+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Rhd2fuzsFRgU_RX7fILqemgxjnV6Yby_0 2024-09-12T01:04:39.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.934+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8272830454719167756', time=2024-09-12T02:52:57.025342+0000, chain.objs.size()=1 2024-09-12T01:04:39.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.934+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.cRgYqPbb0lIdTXlvYEbj9mse_oN08vl_0 2024-09-12T01:04:39.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.938+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3876849384861352218', time=2024-09-12T02:52:57.029552+0000, chain.objs.size()=1 2024-09-12T01:04:39.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.938+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.QHWBoWUXZeb5zNOGDmurS2DPnyPJffe_0 2024-09-12T01:04:39.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.938+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13876087977747357625', time=2024-09-12T02:52:57.162637+0000, chain.objs.size()=1 2024-09-12T01:04:39.940 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.938+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Jec3q2TsQ3zDa3ti46QxvjOLY88-JHu_0 2024-09-12T01:04:39.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.938+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12024914390467019652', time=2024-09-12T02:52:57.184718+0000, chain.objs.size()=1 2024-09-12T01:04:39.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.938+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.nho6WuRdZi_pq7KxTpp8meV34-F5yfG_0 2024-09-12T01:04:39.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.938+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1215866772812962360', time=2024-09-12T02:52:57.186335+0000, chain.objs.size()=1 2024-09-12T01:04:39.941 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.938+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.JJYe0chIj9FXo3lxKp5TKT0EJcsNHGd_0 2024-09-12T01:04:39.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17158331877266978424', time=2024-09-12T02:52:57.227652+0000, chain.objs.size()=1 2024-09-12T01:04:39.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.zl94EV0gZGKjEWzxhyXgIQCwiNCBfx3_0 2024-09-12T01:04:39.942 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12978365058321564419', time=2024-09-12T02:52:57.249953+0000, chain.objs.size()=1 2024-09-12T01:04:39.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.QJXkV1oTtCs21ee6nZ4gz9jVYfwK-u7_0 2024-09-12T01:04:39.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13924498129119593802', time=2024-09-12T02:52:57.282252+0000, chain.objs.size()=1 2024-09-12T01:04:39.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.KRhjGiiz3xRra5fg9p07D66tQ78FKnK_0 2024-09-12T01:04:39.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16770812540701290879', time=2024-09-12T02:52:57.454976+0000, chain.objs.size()=1 2024-09-12T01:04:39.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.km9YMtLc1ySoBrkcIdgLGn_Hv6y4dPX_0 2024-09-12T01:04:39.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4803260286095436488', time=2024-09-12T02:52:57.491000+0000, chain.objs.size()=1 2024-09-12T01:04:39.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.yhiNNAS06CS4hPnqSBWMD8eaxPt__4i_0 2024-09-12T01:04:39.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16519451031482967759', time=2024-09-12T02:52:57.503865+0000, chain.objs.size()=1 2024-09-12T01:04:39.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.H40Qa2ObJQHVk8_7M6NisLpAqyalTrh_0 2024-09-12T01:04:39.943 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9198869449677250614', time=2024-09-12T02:52:57.695329+0000, chain.objs.size()=1 2024-09-12T01:04:39.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.KXwyfGqfG3bZSOzfvJCFuiAridj-cxZ_0 2024-09-12T01:04:39.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5061614366029212990', time=2024-09-12T02:52:57.696112+0000, chain.objs.size()=1 2024-09-12T01:04:39.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.RZ-i6R302IdVhxCMFDrJ7cdr1NMygmV_0 2024-09-12T01:04:39.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11958501678371161689', time=2024-09-12T02:52:57.699615+0000, chain.objs.size()=1 2024-09-12T01:04:39.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.hezLLQx7hsbO8ThMAGDpMF32AIQUmMP_0 2024-09-12T01:04:39.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5533912635288608563', time=2024-09-12T02:52:57.737779+0000, chain.objs.size()=1 2024-09-12T01:04:39.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Fw30XdveOwtmsOJdESXMbg7nPXq-qme_0 2024-09-12T01:04:39.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12828052510022504826', time=2024-09-12T02:52:57.895428+0000, chain.objs.size()=1 2024-09-12T01:04:39.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.XKqTALH5Bs4A4oLs8PaVI2OwG6G0QNJ_0 2024-09-12T01:04:39.944 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8831359283226082526', time=2024-09-12T02:52:57.946757+0000, chain.objs.size()=1 2024-09-12T01:04:39.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.uReXyUSkuvwiPch5BFEUQa9zrnKWqC8_0 2024-09-12T01:04:39.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4979296185384734420', time=2024-09-12T02:52:58.107891+0000, chain.objs.size()=1 2024-09-12T01:04:39.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.fX0bAxAgoVVWXdMV5VgknckqeMSZHSd_0 2024-09-12T01:04:39.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16003277242743136557', time=2024-09-12T02:52:58.162796+0000, chain.objs.size()=1 2024-09-12T01:04:39.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Q0EaGpccLqpXyktaFuxMbyhyhhMRpcK_0 2024-09-12T01:04:39.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.273729455175560877', time=2024-09-12T02:52:58.164173+0000, chain.objs.size()=1 2024-09-12T01:04:39.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.VYBq6DzG6pZU4hTe4FxVx0_9_XlCykX_0 2024-09-12T01:04:39.945 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.942+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47247 2024-09-12T01:04:39.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.946+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-12T01:04:39.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.946+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14316903007741171131', time=2024-09-12T02:52:58.198108+0000, chain.objs.size()=1 2024-09-12T01:04:39.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.946+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.b71yQ9ZH5GCLvfmWREc-SFLTnbBdhcm_0 2024-09-12T01:04:39.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.946+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17448719263674920190', time=2024-09-12T02:52:58.203036+0000, chain.objs.size()=1 2024-09-12T01:04:39.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.946+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Eu2m2Sn_5eF3a301z1UDHYO3u2EJm3M_0 2024-09-12T01:04:39.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.946+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7049455468414464019', time=2024-09-12T02:52:58.414045+0000, chain.objs.size()=1 2024-09-12T01:04:39.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.946+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.DcFtOxqmJzljUL3E_L35C6-oolK5C9i_0 2024-09-12T01:04:39.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.946+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2670703584237081865', time=2024-09-12T02:52:58.420776+0000, chain.objs.size()=1 2024-09-12T01:04:39.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.946+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.FDhfzW8mBFpTMb9c8zKVYwoCxD_rvt1_0 2024-09-12T01:04:39.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.946+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3547258331848771583', time=2024-09-12T02:52:58.494917+0000, chain.objs.size()=1 2024-09-12T01:04:39.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.946+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.t8uJYMtq6tSFEV5J3PFbaQY7ssO4suD_0 2024-09-12T01:04:39.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.946+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17138144707282394350', time=2024-09-12T02:52:58.631088+0000, chain.objs.size()=1 2024-09-12T01:04:39.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.946+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.IkX5pARr25c-JcFWdR-ezdhU6EtZRfm_0 2024-09-12T01:04:39.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.946+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6114420531780696426', time=2024-09-12T02:52:58.633124+0000, chain.objs.size()=1 2024-09-12T01:04:39.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.946+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.aVdY5N2DOR7XQW2aFFB58y6kQycQVj2_0 2024-09-12T01:04:39.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.946+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.138260812263608636', time=2024-09-12T02:53:25.606507+0000, chain.objs.size()=1 2024-09-12T01:04:39.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.946+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.367__shadow_.5qEbLKFeZJ1s03jRLdzuox3Udp-RWeP_0 2024-09-12T01:04:39.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.946+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8909536657791835312', time=2024-09-12T02:53:38.217410+0000, chain.objs.size()=1 2024-09-12T01:04:39.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.946+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.383__shadow_.PUv6_MDIhYkhjGYCJfhpcVPYMyYgSG7_0 2024-09-12T01:04:39.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.946+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6638450057568110248', time=2024-09-12T02:54:15.845074+0000, chain.objs.size()=1 2024-09-12T01:04:39.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.946+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.433__shadow_.diLGKeYDOEtWkNJmnk-iV9KUXchZtLq_0 2024-09-12T01:04:39.948 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.946+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15240499489371371860', time=2024-09-12T02:54:29.573797+0000, chain.objs.size()=1 2024-09-12T01:04:39.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.946+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.450__shadow_.-7ezfIfASJPCphqsJeOUV4eSzvHPWS4_0 2024-09-12T01:04:39.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.946+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13211543490075687026', time=2024-09-12T02:54:30.309874+0000, chain.objs.size()=1 2024-09-12T01:04:39.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.946+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.451__shadow_.2zyIBoxULwCFnMId6wbrjHFnANn1FQk_0 2024-09-12T01:04:39.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.946+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.540136700463599713', time=2024-09-12T02:54:34.601863+0000, chain.objs.size()=1 2024-09-12T01:04:39.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.946+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.456__shadow_.HJR5grSZGmsZBy3lbhLuR3a9e60FM1n_0 2024-09-12T01:04:39.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.946+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14055993331400641620', time=2024-09-12T02:54:41.886773+0000, chain.objs.size()=1 2024-09-12T01:04:39.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.946+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.463__shadow_.Ep2XfqbY5_PIKLOXkP1QZammMChcXTI_0 2024-09-12T01:04:39.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14597023963287843443', time=2024-09-12T02:54:42.537601+0000, chain.objs.size()=1 2024-09-12T01:04:39.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.464__shadow_.Jrq1ZyPBez8GeyY4ITj4bIj0y5d-Xcr_0 2024-09-12T01:04:39.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14510263132490950415', time=2024-09-12T02:54:42.762729+0000, chain.objs.size()=1 2024-09-12T01:04:39.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.464__shadow_.PfgMcqdSMiFdy4sem6Mduv09ofTsHSl_0 2024-09-12T01:04:39.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3406027543638499511', time=2024-09-12T02:55:11.385378+0000, chain.objs.size()=6 2024-09-12T01:04:39.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.1 2024-09-12T01:04:39.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.2 2024-09-12T01:04:39.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.3 2024-09-12T01:04:39.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.4 2024-09-12T01:04:39.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.5 2024-09-12T01:04:39.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.507__multipart_srcmultipart.2~I2pFQdkKM6I7wA8xf8ZSVRliBJ4g4rS.6 2024-09-12T01:04:39.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16386309151624464141', time=2024-09-12T02:55:27.230875+0000, chain.objs.size()=4 2024-09-12T01:04:39.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.520__shadow:v6s8zfsyB03o8giX1A9FERhgObOcn5O_.qYkv6kPqXEr2SnKu_nIl9h8aAp2Eszc_0 2024-09-12T01:04:39.951 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.520__shadow:v6s8zfsyB03o8giX1A9FERhgObOcn5O_.qYkv6kPqXEr2SnKu_nIl9h8aAp2Eszc_1 2024-09-12T01:04:39.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.520__shadow:v6s8zfsyB03o8giX1A9FERhgObOcn5O_.qYkv6kPqXEr2SnKu_nIl9h8aAp2Eszc_2 2024-09-12T01:04:39.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.520__shadow:v6s8zfsyB03o8giX1A9FERhgObOcn5O_.qYkv6kPqXEr2SnKu_nIl9h8aAp2Eszc_3 2024-09-12T01:04:39.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~syI2OwC_ZA7fE9dP7C6mDOFFDdC5WXz', time=2024-09-12T02:55:31.792105+0000, chain.objs.size()=1 2024-09-12T01:04:39.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.2~syI2OwC_ZA7fE9dP7C6mDOFFDdC5WXz.2 2024-09-12T01:04:39.952 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6857516565907048718', time=2024-09-12T02:56:42.682463+0000, chain.objs.size()=1 2024-09-12T01:04:39.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.553__shadow_.d0tA6q828jycvMQWzf_ASIJit3pTKzl_0 2024-09-12T01:04:39.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5123337345160519321', time=2024-09-12T02:56:44.951071+0000, chain.objs.size()=2 2024-09-12T01:04:39.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.555__shadow_.X3IKJD8hotD4xhMf9sNTXyTfjqZoFVR_0 2024-09-12T01:04:39.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.555__shadow_.X3IKJD8hotD4xhMf9sNTXyTfjqZoFVR_1 2024-09-12T01:04:39.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11303667691675957464', time=2024-09-12T02:56:46.934098+0000, chain.objs.size()=1 2024-09-12T01:04:39.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.557__shadow_.e_O3yL6tucs2Y-WndE3gr2p4nwr79Y4_0 2024-09-12T01:04:39.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17968944713602155887', time=2024-09-12T02:57:03.067485+0000, chain.objs.size()=1 2024-09-12T01:04:39.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.569__shadow:kJlLWInJf19ST1TbZX9ZBOVlNfp7.NE_.-rk9Z0zTh_y39p6I9fKvh6JqihhKK2l_0 2024-09-12T01:04:39.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10640601045096144612', time=2024-09-12T02:57:08.006649+0000, chain.objs.size()=1 2024-09-12T01:04:39.953 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.569__shadow:ph61i6HwmaGS7XQZwRie4Z45TexZAqw_.UZhCEGVD7Orm2cV_cx6fL2-CQcIIFYG_0 2024-09-12T01:04:39.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6573091851947260176', time=2024-09-12T02:57:33.368093+0000, chain.objs.size()=1 2024-09-12T01:04:39.954 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.950+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:F3bAzQZIscTVFF2tix481L6RxUzZN7r_.27whcn8_zi7YYJCAvhe4IQ8BGiS4-j__0 2024-09-12T01:04:39.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.954+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2490680601246484795', time=2024-09-12T02:57:48.207273+0000, chain.objs.size()=1 2024-09-12T01:04:39.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.954+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.583__shadow:gKHUbj3P.H.cNLiBJpZ7UXYarmHHFJF_.mQETlvfi_9y5fnqopAElrGusOyHRdZl_0 2024-09-12T01:04:39.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.954+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6355889316019114311', time=2024-09-12T02:58:19.329282+0000, chain.objs.size()=12 2024-09-12T01:04:39.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.954+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.614__multipart_multipart_enc.2~QmSwCkhEvLPINz4VV-iCz_fR-JSNnHs.1 2024-09-12T01:04:39.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.954+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.614__shadow_multipart_enc.2~QmSwCkhEvLPINz4VV-iCz_fR-JSNnHs.1_1 2024-09-12T01:04:39.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.954+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.614__multipart_multipart_enc.2~QmSwCkhEvLPINz4VV-iCz_fR-JSNnHs.2 2024-09-12T01:04:39.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.954+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.614__shadow_multipart_enc.2~QmSwCkhEvLPINz4VV-iCz_fR-JSNnHs.2_1 2024-09-12T01:04:39.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.954+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.614__multipart_multipart_enc.2~QmSwCkhEvLPINz4VV-iCz_fR-JSNnHs.3 2024-09-12T01:04:39.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.954+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.614__shadow_multipart_enc.2~QmSwCkhEvLPINz4VV-iCz_fR-JSNnHs.3_1 2024-09-12T01:04:39.956 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.954+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.614__multipart_multipart_enc.2~QmSwCkhEvLPINz4VV-iCz_fR-JSNnHs.4 2024-09-12T01:04:39.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.954+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.614__shadow_multipart_enc.2~QmSwCkhEvLPINz4VV-iCz_fR-JSNnHs.4_1 2024-09-12T01:04:39.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.954+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.614__multipart_multipart_enc.2~QmSwCkhEvLPINz4VV-iCz_fR-JSNnHs.5 2024-09-12T01:04:39.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.954+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.614__shadow_multipart_enc.2~QmSwCkhEvLPINz4VV-iCz_fR-JSNnHs.5_1 2024-09-12T01:04:39.957 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.958+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.614__multipart_multipart_enc.2~QmSwCkhEvLPINz4VV-iCz_fR-JSNnHs.6 2024-09-12T01:04:39.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.958+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.614__shadow_multipart_enc.2~QmSwCkhEvLPINz4VV-iCz_fR-JSNnHs.6_1 2024-09-12T01:04:39.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.962+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6912824196674696243', time=2024-09-12T03:01:28.239677+0000, chain.objs.size()=1 2024-09-12T01:04:39.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.962+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.698__shadow:Y-ML-2ReeaJHkD5wBVnBKkAYu5HMqD9_.0ufwr0KPV0Z91G3yOtfpCIUsft2cEoR_0 2024-09-12T01:04:39.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.962+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1902237353422503437', time=2024-09-12T03:01:31.936941+0000, chain.objs.size()=1 2024-09-12T01:04:39.961 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.962+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.703__shadow:S5CFgw.zoCX6uNMe92p4tJFI5AR4CoL_.xvSfnYGAi-E92BlpeF9WzcPAnnnABXl_0 2024-09-12T01:04:39.962 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.962+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:39.964 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.962+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:04:39.965 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:39.966 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:39.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45222' 2024-09-12T01:04:39.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18286111248123116136', time=2024-09-12T02:48:23.168340+0000, chain.objs.size()=1 2024-09-12T01:04:39.967 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.148__shadow_.2KbpmvprgMaBa_IzVpUXgwmj0jTOg8V_0 2024-09-12T01:04:39.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='_3mHBgdNsAbCKJ2X2i8uW9eiJGxeSqe8', time=2024-09-12T02:48:32.582049+0000, chain.objs.size()=3 2024-09-12T01:04:39.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.160__shadow_.mkyL_NOo1hsQyrPU6lXW8zERfVoyh9F_0 2024-09-12T01:04:39.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.160__shadow_.mkyL_NOo1hsQyrPU6lXW8zERfVoyh9F_1 2024-09-12T01:04:39.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.160__shadow_.mkyL_NOo1hsQyrPU6lXW8zERfVoyh9F_2 2024-09-12T01:04:39.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4207972657972244659', time=2024-09-12T02:49:16.358715+0000, chain.objs.size()=1 2024-09-12T01:04:39.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.204__shadow_.r1XOik-iMUehwuKaD48MXQbQk5qQaun_0 2024-09-12T01:04:39.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4266382359586936909', time=2024-09-12T02:50:58.151316+0000, chain.objs.size()=1 2024-09-12T01:04:39.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.249__shadow_.BJMUJsfdP_drrYOAyzxgZvOOXA6OMnt_0 2024-09-12T01:04:39.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4856292990175553098', time=2024-09-12T02:51:01.122100+0000, chain.objs.size()=1 2024-09-12T01:04:39.968 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.253__shadow_.-XhwqwCe4OGvRUI319l3QeQpOm2nQUN_0 2024-09-12T01:04:39.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15804305791651834826', time=2024-09-12T02:51:26.741918+0000, chain.objs.size()=1 2024-09-12T01:04:39.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.c6xMawdYb95zzK66Gz-0U8iLC3sLVu9_0 2024-09-12T01:04:39.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17206087470501106589', time=2024-09-12T02:51:26.833863+0000, chain.objs.size()=1 2024-09-12T01:04:39.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.07XO5qiksALFPS1oWMgNKJzfTgaT4e7_0 2024-09-12T01:04:39.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3211816828319226951', time=2024-09-12T02:51:26.842189+0000, chain.objs.size()=1 2024-09-12T01:04:39.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.MOt4sQ1wgCHgq5rbg-DIXnyc2VM22en_0 2024-09-12T01:04:39.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1399654867415501517', time=2024-09-12T02:51:26.854523+0000, chain.objs.size()=1 2024-09-12T01:04:39.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.yFOrEB4NLWsVHiCD2MS6NCwM-gfKvPH_0 2024-09-12T01:04:39.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6075826671552225502', time=2024-09-12T02:51:26.880315+0000, chain.objs.size()=1 2024-09-12T01:04:39.969 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.XJ8YMyqKA4zhhKMaHSqLqSaeOc7p8Bl_0 2024-09-12T01:04:39.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.966+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5959127433858205876', time=2024-09-12T02:51:26.885520+0000, chain.objs.size()=1 2024-09-12T01:04:39.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.966+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.eIALjVLtO1ZwzFe9DuefZCsqVPjE1Ol_0 2024-09-12T01:04:39.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.970+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15542742044655800134', time=2024-09-12T02:51:26.888723+0000, chain.objs.size()=1 2024-09-12T01:04:39.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.970+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ZhKnc7GpnGADRYpsyBdSNbRqjhd6DUc_0 2024-09-12T01:04:39.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.970+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11906029336616766346', time=2024-09-12T02:51:26.982519+0000, chain.objs.size()=1 2024-09-12T01:04:39.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.970+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.8qoNkhY33CyWRtzca0YF9VCGElSzvJ3_0 2024-09-12T01:04:39.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.970+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16739446962985511876', time=2024-09-12T02:51:26.989597+0000, chain.objs.size()=1 2024-09-12T01:04:39.971 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.970+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.T7ppcC8sY7MaTWMfwrxs1o8Zm_hXlpC_0 2024-09-12T01:04:39.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.970+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1342374076724029055', time=2024-09-12T02:51:27.003715+0000, chain.objs.size()=1 2024-09-12T01:04:39.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.970+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.yg9A0efE0WPcjuTzgBqHdCTBRPHJzo3_0 2024-09-12T01:04:39.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.970+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4297262181290215512', time=2024-09-12T02:51:27.062896+0000, chain.objs.size()=1 2024-09-12T01:04:39.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.970+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.KKdXC6S7QrKXHJ4O-qWv-5t9s5aSojY_0 2024-09-12T01:04:39.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.970+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18391890087380399677', time=2024-09-12T02:51:27.078185+0000, chain.objs.size()=1 2024-09-12T01:04:39.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.970+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.AAXy975UfDzsXrb9uAl-jYKNvbbY5QA_0 2024-09-12T01:04:39.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.970+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8019522655102670829', time=2024-09-12T02:51:27.201216+0000, chain.objs.size()=1 2024-09-12T01:04:39.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.970+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.5KmVqkGgGnu-AAP1ZiWgcTtgEryzCX3_0 2024-09-12T01:04:39.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.970+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8990251078655411287', time=2024-09-12T02:51:27.247708+0000, chain.objs.size()=1 2024-09-12T01:04:39.972 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.970+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.d62Yh3SQuzrgFZeBKNFUjHVsr6SRWn__0 2024-09-12T01:04:39.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.970+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7997636475102091798', time=2024-09-12T02:51:27.253387+0000, chain.objs.size()=1 2024-09-12T01:04:39.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.970+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.jKXyu9_BfhHeWebojoZnFkrYqU9-ufP_0 2024-09-12T01:04:39.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.970+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8909688080196276795', time=2024-09-12T02:51:27.301216+0000, chain.objs.size()=1 2024-09-12T01:04:39.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.970+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.6ariMlMdmti2MLdhUDcIc-8Vu-48W6G_0 2024-09-12T01:04:39.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.970+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6503278897156426638', time=2024-09-12T02:51:27.309693+0000, chain.objs.size()=1 2024-09-12T01:04:39.973 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.970+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.bx8qp6_KBm9daD5xy4OVmlOkeXGUHDG_0 2024-09-12T01:04:39.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.970+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5533928460219463526', time=2024-09-12T02:51:27.319191+0000, chain.objs.size()=1 2024-09-12T01:04:39.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.970+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Rh2fWXD8UwbTD4SHZDiWEgMdDtsuz8d_0 2024-09-12T01:04:39.974 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.970+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7362320664755318569', time=2024-09-12T02:51:27.427684+0000, chain.objs.size()=1 2024-09-12T01:04:39.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.970+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.8ewlTvCDE8Tn5fH6xOueKwL2C6Jx871_0 2024-09-12T01:04:39.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.970+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8660118267113516918', time=2024-09-12T02:51:27.469042+0000, chain.objs.size()=1 2024-09-12T01:04:39.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.970+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.tyX0uUmIrHMVcD9FHsHtIx_3Wc47Uov_0 2024-09-12T01:04:39.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2021309804604786882', time=2024-09-12T02:51:27.471658+0000, chain.objs.size()=1 2024-09-12T01:04:39.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.eBtO2BgWcMh6gfnOWDYaEdb6zW7Fcig_0 2024-09-12T01:04:39.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12947042939572469583', time=2024-09-12T02:51:27.486224+0000, chain.objs.size()=1 2024-09-12T01:04:39.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ogJZlX6LGWRh7WrDwY8izg6qQ1ZpNTP_0 2024-09-12T01:04:39.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16906496487713659994', time=2024-09-12T02:51:27.512407+0000, chain.objs.size()=1 2024-09-12T01:04:39.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.gCTFPmBlCCjvPOY75X2CEBRJvpG-D-X_0 2024-09-12T01:04:39.975 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18063087897184257674', time=2024-09-12T02:51:27.625788+0000, chain.objs.size()=1 2024-09-12T01:04:39.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.dTXEIdJllYiAjoYElY7AAGKygwBA2AL_0 2024-09-12T01:04:39.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10389249461624898452', time=2024-09-12T02:51:27.643565+0000, chain.objs.size()=1 2024-09-12T01:04:39.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.fXzYH217OOux0pJSMRwHScX_iMmTWcZ_0 2024-09-12T01:04:39.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4603946239961816342', time=2024-09-12T02:51:27.690737+0000, chain.objs.size()=1 2024-09-12T01:04:39.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.az-O0yyzS9vlpM5_GPhORTKPyLtbku3_0 2024-09-12T01:04:39.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3196014710377407422', time=2024-09-12T02:51:27.734061+0000, chain.objs.size()=1 2024-09-12T01:04:39.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.nIVhmNaDMdLboqpWa8_rC3xISrX5D6y_0 2024-09-12T01:04:39.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8232205282402088302', time=2024-09-12T02:51:27.837160+0000, chain.objs.size()=1 2024-09-12T01:04:39.976 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ERXnijwmE83HHTHoiBCJLWRpU4cMX12_0 2024-09-12T01:04:39.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10319533077781952677', time=2024-09-12T02:51:27.919022+0000, chain.objs.size()=1 2024-09-12T01:04:39.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.D31_X8HirE8SrW1oKsHKd6D9_eML5cr_0 2024-09-12T01:04:39.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12560727012868200043', time=2024-09-12T02:51:27.924211+0000, chain.objs.size()=1 2024-09-12T01:04:39.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.HmK3fmrMydAl8tfV5azVVuBTNbEoUvq_0 2024-09-12T01:04:39.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12572896616613547970', time=2024-09-12T02:51:27.938323+0000, chain.objs.size()=1 2024-09-12T01:04:39.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.NXGIrAzD1rmCiT3WKWxuJUf0oIx_C3Z_0 2024-09-12T01:04:39.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10047400029345760129', time=2024-09-12T02:51:27.941128+0000, chain.objs.size()=1 2024-09-12T01:04:39.977 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.TcGNF2y3rmwPh59eiWyp_aCYsLFuq6u_0 2024-09-12T01:04:39.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5827832191786871859', time=2024-09-12T02:51:28.129352+0000, chain.objs.size()=1 2024-09-12T01:04:39.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.qk7wmu4U40VGWRVqOb2zIQL14X5X_1t_0 2024-09-12T01:04:39.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18324441719568510257', time=2024-09-12T02:51:28.151945+0000, chain.objs.size()=1 2024-09-12T01:04:39.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Vel8BO4-rjm9gTrTr1fSxadoMZnBKaJ_0 2024-09-12T01:04:39.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16949111420133082881', time=2024-09-12T02:51:28.196225+0000, chain.objs.size()=1 2024-09-12T01:04:39.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.FVlJ64ePFAnxtvOqS6vOCHNtqkBlqaC_0 2024-09-12T01:04:39.979 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17197950151046592544', time=2024-09-12T02:51:28.391104+0000, chain.objs.size()=1 2024-09-12T01:04:39.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.TWFzQAeEbeBtI7z8IkKOkM4A453M_8r_0 2024-09-12T01:04:39.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14516636353338222720', time=2024-09-12T02:51:40.952634+0000, chain.objs.size()=1 2024-09-12T01:04:39.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.279__shadow_.s-KOgXN1yzPkochA0lL4VGJHgV-J_RS_0 2024-09-12T01:04:39.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12069807561019655174', time=2024-09-12T02:51:43.964768+0000, chain.objs.size()=1 2024-09-12T01:04:39.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.283__shadow_.X0CgtcpBHtKgvIeFvDn-tUae8meTACB_0 2024-09-12T01:04:39.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8176591553362371516', time=2024-09-12T02:51:47.748385+0000, chain.objs.size()=1 2024-09-12T01:04:39.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.288__shadow_.7Yrl0sKhqYHOTo0UoZidNopeD-xVhXF_0 2024-09-12T01:04:39.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14362475082644567132', time=2024-09-12T02:51:51.745459+0000, chain.objs.size()=1 2024-09-12T01:04:39.980 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.292__shadow_.-2QtH-O_2ZRBrNFazCDW5n6yXnzgg1k_0 2024-09-12T01:04:39.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2302533226754100740', time=2024-09-12T02:51:53.169692+0000, chain.objs.size()=1 2024-09-12T01:04:39.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.293__shadow_.UehF3LzHLDineyGTRpAc0m2AZ05FKj7_0 2024-09-12T01:04:39.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4754874399330801952', time=2024-09-12T02:51:53.188308+0000, chain.objs.size()=1 2024-09-12T01:04:39.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.293__shadow_.B1x5qVSJL_kdLTjEgRtd4GvxWOyBLnp_0 2024-09-12T01:04:39.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10326384025137531615', time=2024-09-12T02:52:01.420569+0000, chain.objs.size()=1 2024-09-12T01:04:39.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.974+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.304__shadow_.F8eIzIVBlYQbPkXVLcDoFGfM3g-c1Oq_0 2024-09-12T01:04:39.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10848684377117587642', time=2024-09-12T02:52:04.188599+0000, chain.objs.size()=1 2024-09-12T01:04:39.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.307__shadow:huiRBk5dwpv8Z0G64cnyXJr.hFZW9Jl_.mvQdA690auVUw7xvWgzRCIs6XW6398j_0 2024-09-12T01:04:39.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11342318733398990419', time=2024-09-12T02:52:35.062697+0000, chain.objs.size()=1 2024-09-12T01:04:39.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.yaRHkH4bimlqab3bH-slYScCZ7DIs-E_0 2024-09-12T01:04:39.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16554031303559548619', time=2024-09-12T02:52:35.099545+0000, chain.objs.size()=1 2024-09-12T01:04:39.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Mt85vkvrnES2bwvSPH4FtElmiYZxWTr_0 2024-09-12T01:04:39.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12939920885317185760', time=2024-09-12T02:52:35.105388+0000, chain.objs.size()=1 2024-09-12T01:04:39.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.w1zI0KMGCOkOpkEBasp_jlR3iAeiy6d_0 2024-09-12T01:04:39.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5175303465223097174', time=2024-09-12T02:52:35.142064+0000, chain.objs.size()=1 2024-09-12T01:04:39.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.qvJspwaS3SRYTDG7Kl1FJi8AWPmAwp7_0 2024-09-12T01:04:39.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10386090192103288072', time=2024-09-12T02:52:35.162617+0000, chain.objs.size()=1 2024-09-12T01:04:39.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.c2GUsAPLL9gjNfuhAV_wH0JbzgouypR_0 2024-09-12T01:04:39.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10122934466513835943', time=2024-09-12T02:52:35.294988+0000, chain.objs.size()=1 2024-09-12T01:04:39.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.5W-3645QDuaHGlBhfq8ZCTqITg3Uc8d_0 2024-09-12T01:04:39.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4817082410766956022', time=2024-09-12T02:52:35.331742+0000, chain.objs.size()=1 2024-09-12T01:04:39.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.1-wbvPt5_0CLAaH3AyLeDWcJMM0ImDH_0 2024-09-12T01:04:39.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8144320108415455823', time=2024-09-12T02:52:35.346578+0000, chain.objs.size()=1 2024-09-12T01:04:39.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.pnzO0GQUuALDjXUGLhdRh3VBSbmxTKU_0 2024-09-12T01:04:39.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3344418684828766053', time=2024-09-12T02:52:35.353937+0000, chain.objs.size()=1 2024-09-12T01:04:39.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.P8SrB-9nBh3gLIqFnRoURrL66QZgoQk_0 2024-09-12T01:04:39.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9967015554746800786', time=2024-09-12T02:52:35.372512+0000, chain.objs.size()=1 2024-09-12T01:04:39.983 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.wkfo33yrRwUTF7v0kXDgrMrWNXgyXc9_0 2024-09-12T01:04:39.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.503250916998053118', time=2024-09-12T02:52:35.390486+0000, chain.objs.size()=1 2024-09-12T01:04:39.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.kCU3egXMLXS3PZYj_nEvppUPF_Iwgeu_0 2024-09-12T01:04:39.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.978+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2876432061751633773', time=2024-09-12T02:52:35.538019+0000, chain.objs.size()=1 2024-09-12T01:04:39.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.978+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.wRUuirQ1IYMq6IKqciXItZ6Xw6KaJVs_0 2024-09-12T01:04:39.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9506219276439357729', time=2024-09-12T02:52:35.585143+0000, chain.objs.size()=1 2024-09-12T01:04:39.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.fch3G4lZ9aOurhyftRn5KhYDfMFsK8T_0 2024-09-12T01:04:39.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9920975097109569155', time=2024-09-12T02:52:35.607552+0000, chain.objs.size()=1 2024-09-12T01:04:39.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.cHC4yALnRcmcMWf2VNfA4AjFtGwuUpH_0 2024-09-12T01:04:39.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12483934286464613003', time=2024-09-12T02:52:35.632330+0000, chain.objs.size()=1 2024-09-12T01:04:39.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.tRSgKVD5TgFg4nSKJUBPXpx5vqIMsPY_0 2024-09-12T01:04:39.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17065404889763991804', time=2024-09-12T02:52:35.633259+0000, chain.objs.size()=1 2024-09-12T01:04:39.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.zfszAG315y_m8Bf-kgpIgPuG1x66Qp9_0 2024-09-12T01:04:39.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17764985754985972285', time=2024-09-12T02:52:35.671033+0000, chain.objs.size()=1 2024-09-12T01:04:39.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ofQb2yc99EcjwbMk0lra1dn2wO8_lVk_0 2024-09-12T01:04:39.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13645520812054214339', time=2024-09-12T02:52:35.845678+0000, chain.objs.size()=1 2024-09-12T01:04:39.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.G8QbwjladbtEcgfeWFJNA01JyMxPM4A_0 2024-09-12T01:04:39.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14597880687118630487', time=2024-09-12T02:52:35.865647+0000, chain.objs.size()=1 2024-09-12T01:04:39.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.n5RYp4B3ACMgWCpHzJzt2Zrcexck7cI_0 2024-09-12T01:04:39.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5645432080414685151', time=2024-09-12T02:52:35.887147+0000, chain.objs.size()=1 2024-09-12T01:04:39.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.QoMveG9ZV0BibXVcxE5i2LLW1PM2hAn_0 2024-09-12T01:04:39.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7452926663833557877', time=2024-09-12T02:52:36.271604+0000, chain.objs.size()=1 2024-09-12T01:04:39.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.oVtSSoeGJLWi4bQhrkLtEEAPqCdJ1S0_0 2024-09-12T01:04:39.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15509251156609084338', time=2024-09-12T02:52:36.275595+0000, chain.objs.size()=1 2024-09-12T01:04:39.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.yoqFcQoJgTeWvBAUgWYVVruXdt4SieZ_0 2024-09-12T01:04:39.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12941966315073789118', time=2024-09-12T02:52:36.296031+0000, chain.objs.size()=1 2024-09-12T01:04:39.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.blQCAbgitgriDFFlWv5JUpeVHOeuIxJ_0 2024-09-12T01:04:39.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13044185461874945481', time=2024-09-12T02:52:36.360155+0000, chain.objs.size()=1 2024-09-12T01:04:39.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.7G0Os03o-fDE_9U9mZw0SLgzu-tRaLB_0 2024-09-12T01:04:39.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15411947775785159669', time=2024-09-12T02:52:36.364871+0000, chain.objs.size()=1 2024-09-12T01:04:39.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.6xu6KQu3R7ymQDqJmYfHe6ojAPve-Jj_0 2024-09-12T01:04:39.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13176099074554270813', time=2024-09-12T02:52:36.374313+0000, chain.objs.size()=1 2024-09-12T01:04:39.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.vc6ITzwhKfd-TFFUQMBVx6LuBilsXIo_0 2024-09-12T01:04:39.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12502305300283474164', time=2024-09-12T02:52:36.504974+0000, chain.objs.size()=1 2024-09-12T01:04:39.988 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ar1TUoZVi8-ojr5XJeTfxOr8YKI5yFG_0 2024-09-12T01:04:39.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9938390078086694740', time=2024-09-12T02:52:36.546654+0000, chain.objs.size()=1 2024-09-12T01:04:39.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.R5mDee0BWCqxwyIaNxulfy-xYmvKXRK_0 2024-09-12T01:04:39.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7724114790595392283', time=2024-09-12T02:52:36.558734+0000, chain.objs.size()=1 2024-09-12T01:04:39.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.2Ksm5CSWLg3keUOiSYqykZhGpLoAb3f_0 2024-09-12T01:04:39.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4037938921516930168', time=2024-09-12T02:52:36.561051+0000, chain.objs.size()=1 2024-09-12T01:04:39.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.O-wUO0UeVadZE_ga3WCUY86_ErXOFul_0 2024-09-12T01:04:39.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7644944117612543012', time=2024-09-12T02:52:36.618412+0000, chain.objs.size()=1 2024-09-12T01:04:39.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.982+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.lVafwzYgZYvlcxOd9Ty_V_sZ0Tj71QW_0 2024-09-12T01:04:39.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.986+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13938613456322995944', time=2024-09-12T02:52:36.799817+0000, chain.objs.size()=1 2024-09-12T01:04:39.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.986+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.qjCpbSsy2oVbECFwhZH2xvlGdxMNVZM_0 2024-09-12T01:04:39.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.986+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13394183666231606', time=2024-09-12T02:52:36.846246+0000, chain.objs.size()=1 2024-09-12T01:04:39.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.986+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.83UdS75wiYkWZv7ou8Fs_N9TofJZIZy_0 2024-09-12T01:04:39.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.986+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13962438547910192274', time=2024-09-12T02:52:36.878064+0000, chain.objs.size()=1 2024-09-12T01:04:39.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.986+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.4oRwER6cYtc-QoWAVXY2w4AKppnfl-K_0 2024-09-12T01:04:39.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.986+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17547807236702892772', time=2024-09-12T02:52:36.883187+0000, chain.objs.size()=1 2024-09-12T01:04:39.990 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.986+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.1O-9J0eb6x2-ZCfLaS_dtrSP5BVd6Il_0 2024-09-12T01:04:39.991 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.986+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4360860226819654646', time=2024-09-12T02:52:37.008538+0000, chain.objs.size()=1 2024-09-12T01:04:39.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.986+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.1gnHKx7lk_BUuQizRMuzqZ76hSlch8v_0 2024-09-12T01:04:39.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.986+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7845924321300194508', time=2024-09-12T02:52:37.023648+0000, chain.objs.size()=1 2024-09-12T01:04:39.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.986+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.0reZR-WzAptcU_jaFY_3hjDRclZOI5B_0 2024-09-12T01:04:39.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.986+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12590470211974148941', time=2024-09-12T02:52:37.060467+0000, chain.objs.size()=1 2024-09-12T01:04:39.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.986+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Pe_cD2kIPHgvm8ebsw9FCbLcCIZ06Xk_0 2024-09-12T01:04:39.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.986+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8463892204224003430', time=2024-09-12T02:52:37.073394+0000, chain.objs.size()=1 2024-09-12T01:04:39.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.986+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.xuiJxCXL-UkzBlx9kPZZ76xo-1Mx9mW_0 2024-09-12T01:04:39.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.986+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12726957195305963294', time=2024-09-12T02:52:56.901695+0000, chain.objs.size()=1 2024-09-12T01:04:39.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.986+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.vh9f8dGHF0SKrWHbm9Sbp3ewfSinw6L_0 2024-09-12T01:04:39.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.986+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1318022499630740727', time=2024-09-12T02:52:56.956007+0000, chain.objs.size()=1 2024-09-12T01:04:39.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.986+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.SWINMhQ-0ytIlZM3gii5YAwN5CPTvaY_0 2024-09-12T01:04:39.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.986+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7215177335347468105', time=2024-09-12T02:52:57.157166+0000, chain.objs.size()=1 2024-09-12T01:04:39.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.986+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.gzXq65pJy_EmXkeBFNDndlqGntn0GxO_0 2024-09-12T01:04:39.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.986+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17209998891318928372', time=2024-09-12T02:52:57.207055+0000, chain.objs.size()=1 2024-09-12T01:04:39.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.986+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.zOuVD6PuDVy06Dp0LdBxNS6Cxs3rEMh_0 2024-09-12T01:04:39.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.986+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10055880592387695782', time=2024-09-12T02:52:57.220538+0000, chain.objs.size()=1 2024-09-12T01:04:39.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.986+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.WqR2bebgwOKY3hyPPcZhajp_6IMrnoq_0 2024-09-12T01:04:39.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.986+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12063523725583738088', time=2024-09-12T02:52:57.264088+0000, chain.objs.size()=1 2024-09-12T01:04:39.993 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.986+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.5ZVZ7hIEJOjEGQLrRWVr49EIw8eomt2_0 2024-09-12T01:04:39.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.986+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11763799204775622594', time=2024-09-12T02:52:57.275730+0000, chain.objs.size()=1 2024-09-12T01:04:39.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.986+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.VG1neLeqAl9mF5aLbjHa60Ts8oF2r_o_0 2024-09-12T01:04:39.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.990+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6160733462127921050', time=2024-09-12T02:52:57.422636+0000, chain.objs.size()=1 2024-09-12T01:04:39.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.990+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.TXcrJ_QviZzUpzvnGWw78AeZW0XHenb_0 2024-09-12T01:04:39.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.990+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5223087141320649220', time=2024-09-12T02:52:57.438771+0000, chain.objs.size()=1 2024-09-12T01:04:39.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.990+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.MEIpQssZW7h5Au2GALkfO4DKDMRxrVH_0 2024-09-12T01:04:39.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.990+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2636365732749154716', time=2024-09-12T02:52:57.452128+0000, chain.objs.size()=1 2024-09-12T01:04:39.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.990+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.cU_jyZV1lnUDeTk2IoSu09rVzVeRpS5_0 2024-09-12T01:04:39.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.990+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11729151228452260003', time=2024-09-12T02:52:57.483908+0000, chain.objs.size()=1 2024-09-12T01:04:39.994 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.990+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Sr8BEemy0MWYBly6Hx0vrVWNJY-E9E-_0 2024-09-12T01:04:39.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.990+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.450898734336521290', time=2024-09-12T02:52:57.487901+0000, chain.objs.size()=1 2024-09-12T01:04:39.995 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.990+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.itJZuT9O-U1Sp9vzSYc7WyW0KStp46U_0 2024-09-12T01:04:39.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.994+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45222 2024-09-12T01:04:39.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.994+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-12T01:04:39.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.994+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.196729048298148307', time=2024-09-12T02:52:57.489339+0000, chain.objs.size()=1 2024-09-12T01:04:39.996 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.994+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.rqU61DWW6lbMJTwtJFmq_5ln2auhQuU_0 2024-09-12T01:04:39.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.994+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9277669979482004000', time=2024-09-12T02:52:57.498297+0000, chain.objs.size()=1 2024-09-12T01:04:39.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.994+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.fpEx-gtwf0ywh2HNeJ1yxjHPutvel7v_0 2024-09-12T01:04:39.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.994+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12733922849250738774', time=2024-09-12T02:52:57.501639+0000, chain.objs.size()=1 2024-09-12T01:04:39.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.994+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.TPynvVuYyOeRM7VGntOCuZUA-qp6Uy9_0 2024-09-12T01:04:39.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.994+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10011207252866432058', time=2024-09-12T02:52:57.528517+0000, chain.objs.size()=1 2024-09-12T01:04:39.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.994+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.LovovgR0C_8nGNgCFqjHbrtLpSfiQEy_0 2024-09-12T01:04:39.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.994+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15871642334820135630', time=2024-09-12T02:52:57.530016+0000, chain.objs.size()=1 2024-09-12T01:04:39.997 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.994+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.hBkHuz__hIZz8mIXGjNlMhz2B--ea4i_0 2024-09-12T01:04:39.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.994+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4589270745859839', time=2024-09-12T02:52:57.630263+0000, chain.objs.size()=1 2024-09-12T01:04:39.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.994+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.VwMNuin5pjLfWnfxCbhR4cjF2rczU-5_0 2024-09-12T01:04:39.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.994+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12707300481555808815', time=2024-09-12T02:52:57.678156+0000, chain.objs.size()=1 2024-09-12T01:04:39.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.994+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.4ST4FsLHPasx1NZG3vcrBI50oMNwyT2_0 2024-09-12T01:04:39.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.994+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14830335370417533069', time=2024-09-12T02:52:57.712905+0000, chain.objs.size()=1 2024-09-12T01:04:39.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.994+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.4TE59pFKexWKs8dMH5QDDB75nHHKDX7_0 2024-09-12T01:04:39.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.994+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13699914455891495575', time=2024-09-12T02:52:57.862163+0000, chain.objs.size()=1 2024-09-12T01:04:39.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.994+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.YEelUIf29OhJ1MViM_t6YzixA2zSoJJ_0 2024-09-12T01:04:39.998 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.994+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13637110839499669249', time=2024-09-12T02:52:57.892335+0000, chain.objs.size()=1 2024-09-12T01:04:39.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.994+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.PcFmIChQEkmUROQuLGvvfwahTD8MRh9_0 2024-09-12T01:04:39.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.994+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16109704006509628793', time=2024-09-12T02:52:57.923597+0000, chain.objs.size()=1 2024-09-12T01:04:39.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.994+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.VI1K2AhQArbLJ4sPViixJZjKQeyEwkN_0 2024-09-12T01:04:39.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.994+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12908527471700551777', time=2024-09-12T02:52:57.939349+0000, chain.objs.size()=1 2024-09-12T01:04:39.999 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.994+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.XpHxep-NUw_liQMrNezGxHNUp6TJby7_0 2024-09-12T01:04:40.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.998+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16998686629156163742', time=2024-09-12T02:52:57.950155+0000, chain.objs.size()=1 2024-09-12T01:04:40.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.998+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.fM-l9eIECFHLrjujWataVn3vCVaAft1_0 2024-09-12T01:04:40.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.998+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.416397705026656130', time=2024-09-12T02:52:57.964233+0000, chain.objs.size()=1 2024-09-12T01:04:40.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.998+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.1KUwnUKeoObUKJGwzfKnrrxVjhsHULf_0 2024-09-12T01:04:40.000 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.998+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.993038752072824225', time=2024-09-12T02:52:58.179346+0000, chain.objs.size()=1 2024-09-12T01:04:40.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.998+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.qOXKLVW7yWi2WpHN3APRbzADe8c4aMo_0 2024-09-12T01:04:40.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.998+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5133287788510099837', time=2024-09-12T02:52:58.207377+0000, chain.objs.size()=1 2024-09-12T01:04:40.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.998+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.izJ2V8Lnzx34TGFUscsIVvJdw4XsGUx_0 2024-09-12T01:04:40.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.998+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15595233164154139703', time=2024-09-12T02:52:58.242453+0000, chain.objs.size()=1 2024-09-12T01:04:40.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.998+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.knxERt7TN2lf4gJKrj_YGIrdsPZ4xAX_0 2024-09-12T01:04:40.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.998+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7192091896603846718', time=2024-09-12T02:52:58.396398+0000, chain.objs.size()=1 2024-09-12T01:04:40.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.998+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.qghU78x-qtxz6axPbPNI4gwG4bq63E-_0 2024-09-12T01:04:40.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.998+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17132204124023917490', time=2024-09-12T02:52:58.476545+0000, chain.objs.size()=1 2024-09-12T01:04:40.001 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.998+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.UmKRfrniEu_51ibB0tvoRWht0__wP6Y_0 2024-09-12T01:04:40.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.998+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18222993948487603747', time=2024-09-12T02:52:58.639686+0000, chain.objs.size()=1 2024-09-12T01:04:40.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.998+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.3GtgEnW1V6gg93HBbzf4eQ4eefQJI6__0 2024-09-12T01:04:40.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.998+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18185520864450619841', time=2024-09-12T02:52:58.693116+0000, chain.objs.size()=1 2024-09-12T01:04:40.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.998+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.doPiHWaZ796Yw-R9WXXNpd_g-DPr5bw_0 2024-09-12T01:04:40.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.998+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13251229390792083375', time=2024-09-12T02:54:39.794533+0000, chain.objs.size()=1 2024-09-12T01:04:40.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.998+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.461__shadow_.iYzn5p-2hzzO0oCy5NMqck_hvjPscvG_0 2024-09-12T01:04:40.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.998+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9315587039910175191', time=2024-09-12T02:55:04.659635+0000, chain.objs.size()=1 2024-09-12T01:04:40.002 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:39.998+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.500__shadow_.meC6u2TbSEpgt36AkRW0hUIJEo9qobp_0 2024-09-12T01:04:40.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.002+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9492341677536136299', time=2024-09-12T02:55:07.445844+0000, chain.objs.size()=1 2024-09-12T01:04:40.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.002+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.503__shadow:6LMeYfVzuD7PUiSwyt-9RW46Hh57mqn_.UcslrmdoBCcU7pOGIUMlA4mj_NOCVe1_0 2024-09-12T01:04:40.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.002+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10400117944238200068', time=2024-09-12T02:55:16.313235+0000, chain.objs.size()=1 2024-09-12T01:04:40.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.002+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.515__shadow_.0Q9YrPHOYL2YKShG_3KlemKe9BYnbxV_0 2024-09-12T01:04:40.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.002+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.572854093207101739', time=2024-09-12T02:56:45.253534+0000, chain.objs.size()=1 2024-09-12T01:04:40.003 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.002+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.555__shadow_.vMFQ9b893xt7DR7mIkhw6iInjVXLh6k_0 2024-09-12T01:04:40.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.002+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14561116660486267633', time=2024-09-12T02:56:46.146244+0000, chain.objs.size()=1 2024-09-12T01:04:40.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.002+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.556__shadow_.5bw6-L1hGeohqScHm7nCICYxNJ6m4VG_0 2024-09-12T01:04:40.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.002+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.982997903249156509', time=2024-09-12T02:57:13.315526+0000, chain.objs.size()=1 2024-09-12T01:04:40.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.002+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.573__shadow_.EU2r8GjQdLveIs0anWC2BLJVVPvMrwW_0 2024-09-12T01:04:40.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.002+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5214181188503946997', time=2024-09-12T02:57:34.348186+0000, chain.objs.size()=1 2024-09-12T01:04:40.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.002+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:RUxU929dzLJIT1ZN0zgo7UTYAyRB0nx_.atZ3kGBKdbFA1KKcKvjribI3Pvv7v0q_0 2024-09-12T01:04:40.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.002+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13895552608319476713', time=2024-09-12T02:57:37.542759+0000, chain.objs.size()=1 2024-09-12T01:04:40.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.002+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:G1JkO1ZuPdAjjL56Lwjt9qyVsDNb6s1_.0hc_Ic1H-RUmyRAnhTXCrPBGj_k5lr4_0 2024-09-12T01:04:40.004 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.002+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18266076114728119909', time=2024-09-12T02:57:51.366849+0000, chain.objs.size()=1 2024-09-12T01:04:40.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.002+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.586__shadow:2duoKTSXaUwpykzqIckCQo1uCbXfvMP_.zLI6wnvj02t8GZTbrkLgri6S5IecUA2_0 2024-09-12T01:04:40.005 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.006+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3547960188684373726', time=2024-09-12T02:57:52.110067+0000, chain.objs.size()=1 2024-09-12T01:04:40.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.006+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.587__shadow:Ljv9ugzwu.l8t8UBkBGTU7JMJBo0ATm_.LkTPfNIRzU-MbjOb0wVz3prqKMcp5tP_0 2024-09-12T01:04:40.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.006+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10043541177191527333', time=2024-09-12T03:00:53.710546+0000, chain.objs.size()=2 2024-09-12T01:04:40.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.006+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.650__shadow_.lsQRDV3CgLGHbdEWR_40eM4uGpNdE3l_0 2024-09-12T01:04:40.006 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.006+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.650__shadow_.lsQRDV3CgLGHbdEWR_40eM4uGpNdE3l_1 2024-09-12T01:04:40.008 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.010+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:40.010 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.010+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:04:40.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.010+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:40.012 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:40.013 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50453' 2024-09-12T01:04:40.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1009587605314695885', time=2024-09-12T02:48:33.642583+0000, chain.objs.size()=3 2024-09-12T01:04:40.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.161__multipart_foo-STANDARD.2~h_sMPFt8qcXDNF626Ac8afNzRWA3Er-.1 2024-09-12T01:04:40.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.161__multipart_foo-STANDARD.2~h_sMPFt8qcXDNF626Ac8afNzRWA3Er-.2 2024-09-12T01:04:40.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.161__multipart_foo-STANDARD.2~h_sMPFt8qcXDNF626Ac8afNzRWA3Er-.3 2024-09-12T01:04:40.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1698364127319404501', time=2024-09-12T02:49:13.266971+0000, chain.objs.size()=1 2024-09-12T01:04:40.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.200__shadow_.RodhHqElgI5TkBok4-9OAGszHmqT3jL_0 2024-09-12T01:04:40.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1783473916817921233', time=2024-09-12T02:51:02.581588+0000, chain.objs.size()=1 2024-09-12T01:04:40.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.255__shadow_.-hzLeYOXuzEw1xwFXsoWq0EXhao7dlB_0 2024-09-12T01:04:40.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14895224495366900286', time=2024-09-12T02:51:26.742501+0000, chain.objs.size()=1 2024-09-12T01:04:40.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.dITO9HzqDxc0dUHS9dcd-ui63hB9ccW_0 2024-09-12T01:04:40.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12425650628094025488', time=2024-09-12T02:51:26.823932+0000, chain.objs.size()=1 2024-09-12T01:04:40.014 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.doLUzw6VBaqpbx_IBmsck4Sd4gOuLwZ_0 2024-09-12T01:04:40.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11926943145592163377', time=2024-09-12T02:51:26.850400+0000, chain.objs.size()=1 2024-09-12T01:04:40.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.VH9yKYn0Of6FhIHhgPbMTVenk58OAuP_0 2024-09-12T01:04:40.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4161638939820634995', time=2024-09-12T02:51:26.858134+0000, chain.objs.size()=1 2024-09-12T01:04:40.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.bfV1tYv2yd7JxZ60I1xQ8DciFAFL1jQ_0 2024-09-12T01:04:40.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9103363537470106852', time=2024-09-12T02:51:26.865786+0000, chain.objs.size()=1 2024-09-12T01:04:40.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.dOMRmBDiIcb_lYrhIMT2HrTuFkDIon5_0 2024-09-12T01:04:40.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3477425763936317602', time=2024-09-12T02:51:26.877942+0000, chain.objs.size()=1 2024-09-12T01:04:40.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.fII3By1nbpngDF__uglYieq0SMHsAGF_0 2024-09-12T01:04:40.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10149466183919643866', time=2024-09-12T02:51:26.885834+0000, chain.objs.size()=1 2024-09-12T01:04:40.015 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ZfVudHPY2qUFLWivSbDgNU62lB9iNRy_0 2024-09-12T01:04:40.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11958377580762467372', time=2024-09-12T02:51:26.994953+0000, chain.objs.size()=1 2024-09-12T01:04:40.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.F6yPo7KRBp25x3eCoOUpXofSzw638m5_0 2024-09-12T01:04:40.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13094339359992630317', time=2024-09-12T02:51:27.019218+0000, chain.objs.size()=1 2024-09-12T01:04:40.016 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.T0M5uZ7375JDskuKe5vcI9VLNcwB0LW_0 2024-09-12T01:04:40.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7131492399514598185', time=2024-09-12T02:51:27.039985+0000, chain.objs.size()=1 2024-09-12T01:04:40.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.0MlpaEJ1im5zj9CWdPwezyLzTXo2Hkg_0 2024-09-12T01:04:40.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6107599718151473984', time=2024-09-12T02:51:27.048733+0000, chain.objs.size()=1 2024-09-12T01:04:40.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.4jAZ7fOk0uEXqWsqu_TdJTogytky99D_0 2024-09-12T01:04:40.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12263505305053186465', time=2024-09-12T02:51:27.058561+0000, chain.objs.size()=1 2024-09-12T01:04:40.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.1vPWbpOBYbBxqmJonvbd0BlTsuofQFx_0 2024-09-12T01:04:40.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11075996902793969205', time=2024-09-12T02:51:27.078633+0000, chain.objs.size()=1 2024-09-12T01:04:40.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.9W5_xVeG6Cbey-Xla_7JxlF82qd5k8S_0 2024-09-12T01:04:40.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14555188279325347913', time=2024-09-12T02:51:27.522205+0000, chain.objs.size()=1 2024-09-12T01:04:40.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.LB1RgNpp_Ok2oOJVALxoHYPZZ4C9xd2_0 2024-09-12T01:04:40.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9727031880889240440', time=2024-09-12T02:51:27.649877+0000, chain.objs.size()=1 2024-09-12T01:04:40.017 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.kLlGdh4V_XgEbnBQ2ok7sS3yU8trQ9V_0 2024-09-12T01:04:40.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10999619863758102081', time=2024-09-12T02:51:27.689277+0000, chain.objs.size()=1 2024-09-12T01:04:40.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.__6x5wDhIxT1QAuxvSw4mpbYLj_BVze_0 2024-09-12T01:04:40.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6830126988642730920', time=2024-09-12T02:51:27.694833+0000, chain.objs.size()=1 2024-09-12T01:04:40.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.cz8lCLfBSy0EqeMuSZ5FN2UxooDguOR_0 2024-09-12T01:04:40.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8819267648779698476', time=2024-09-12T02:51:27.704171+0000, chain.objs.size()=1 2024-09-12T01:04:40.018 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.014+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.RD0FCw-vH4rJnDn_1HqPiZLQS9LKWqu_0 2024-09-12T01:04:40.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13516776879978712337', time=2024-09-12T02:51:27.704880+0000, chain.objs.size()=1 2024-09-12T01:04:40.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.l2SUIrw61lgzbARV2nt195l6rhukcxt_0 2024-09-12T01:04:40.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3982053531522374817', time=2024-09-12T02:51:27.735714+0000, chain.objs.size()=1 2024-09-12T01:04:40.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.iKe4BWJQXG5toFrSJJBOufgrQaXAHLV_0 2024-09-12T01:04:40.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11909419436667102402', time=2024-09-12T02:51:27.855529+0000, chain.objs.size()=1 2024-09-12T01:04:40.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.bHkMemDG6swVj_c9JF2QJX9mLmbXBb8_0 2024-09-12T01:04:40.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13501535850217783995', time=2024-09-12T02:51:27.871612+0000, chain.objs.size()=1 2024-09-12T01:04:40.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.msVLCstVN47VrD5_YasZBFIPUv7awrg_0 2024-09-12T01:04:40.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11932874419436193288', time=2024-09-12T02:51:27.877470+0000, chain.objs.size()=1 2024-09-12T01:04:40.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.MJRGQ2J6fzzuOQoKgREjy8XcKeTT-zo_0 2024-09-12T01:04:40.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14015238518776198656', time=2024-09-12T02:51:27.898005+0000, chain.objs.size()=1 2024-09-12T01:04:40.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.sRHL3B1OpMVJLqSzEeL5czQVGOKO1PC_0 2024-09-12T01:04:40.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10145256391536349104', time=2024-09-12T02:51:27.927979+0000, chain.objs.size()=1 2024-09-12T01:04:40.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.H1S85cDb76CMlzdMJsY-tEEUSZ1MjMH_0 2024-09-12T01:04:40.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1921209085395615447', time=2024-09-12T02:51:27.949015+0000, chain.objs.size()=1 2024-09-12T01:04:40.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.6gh1KO6MzsEqOcTSjDDp_A17juDY2QO_0 2024-09-12T01:04:40.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6073482118605024227', time=2024-09-12T02:51:27.951387+0000, chain.objs.size()=1 2024-09-12T01:04:40.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.qw-R3GiZkDumtFF6ST7AaOduUSnDgmL_0 2024-09-12T01:04:40.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5323356531657900634', time=2024-09-12T02:51:27.968092+0000, chain.objs.size()=1 2024-09-12T01:04:40.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.RPJtbJOfMLxrSoqlDcBq4KSQux0tgld_0 2024-09-12T01:04:40.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6173002168724174021', time=2024-09-12T02:51:28.150740+0000, chain.objs.size()=1 2024-09-12T01:04:40.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Y32K0pg3kmhxRo44SMajFkVBJ1bfv3y_0 2024-09-12T01:04:40.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16929123697105604341', time=2024-09-12T02:51:28.187385+0000, chain.objs.size()=1 2024-09-12T01:04:40.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.bD28mAmdVjiJbChoR03T_baaf9Ixz3k_0 2024-09-12T01:04:40.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3829292519171661026', time=2024-09-12T02:51:28.200008+0000, chain.objs.size()=1 2024-09-12T01:04:40.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.6BHy9rA_IkrNlZPCNyd4tYN3Fr7uyBr_0 2024-09-12T01:04:40.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2529478695210537378', time=2024-09-12T02:51:28.206176+0000, chain.objs.size()=1 2024-09-12T01:04:40.021 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.OuaMpfxl06olFHwY8NX9Zn32karfzMo_0 2024-09-12T01:04:40.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14290562774360772212', time=2024-09-12T02:51:28.217857+0000, chain.objs.size()=1 2024-09-12T01:04:40.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ykKv_XfqMtVZHgz7amfDTXinyDmqwKO_0 2024-09-12T01:04:40.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13717336624552637351', time=2024-09-12T02:51:28.367411+0000, chain.objs.size()=1 2024-09-12T01:04:40.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.018+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.2HvT-5pxsfi9b7kIuk_E8FuRMJku78L_0 2024-09-12T01:04:40.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.022+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15469805389393359255', time=2024-09-12T02:51:28.377613+0000, chain.objs.size()=1 2024-09-12T01:04:40.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.022+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.yTU2f_dpgX4z8f18K_z9oFtR6RSqT1X_0 2024-09-12T01:04:40.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.022+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2751660088531740430', time=2024-09-12T02:51:28.387926+0000, chain.objs.size()=1 2024-09-12T01:04:40.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.022+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.J8CBMC6hV92Q4q24oVLnLDW7wOC7usq_0 2024-09-12T01:04:40.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.022+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1897103966191832470', time=2024-09-12T02:51:28.608682+0000, chain.objs.size()=1 2024-09-12T01:04:40.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.022+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.YxQflXZiZWdpBzfoGRyXQ5VFHihwpXj_0 2024-09-12T01:04:40.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.022+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10549300668926380960', time=2024-09-12T02:51:28.667461+0000, chain.objs.size()=1 2024-09-12T01:04:40.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.022+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.4cjKuXLKklWcy0r_wKr36xJ0xGTfy4v_0 2024-09-12T01:04:40.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.022+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14798238710532503852', time=2024-09-12T02:51:28.668470+0000, chain.objs.size()=1 2024-09-12T01:04:40.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.022+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.w1HWTENkvxGqzEauqubzynW5dTgawGM_0 2024-09-12T01:04:40.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.022+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11690930925927605235', time=2024-09-12T02:51:28.670231+0000, chain.objs.size()=1 2024-09-12T01:04:40.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.022+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.IOjPsT7oJ0NHn_8tckslwASeYn7uAH-_0 2024-09-12T01:04:40.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.022+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1927169743488343757', time=2024-09-12T02:51:37.988043+0000, chain.objs.size()=1 2024-09-12T01:04:40.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.022+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.275__shadow_.LglVaAw2-ecFPEFzQggXiSwExMBJHNT_0 2024-09-12T01:04:40.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.022+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.835548795546787475', time=2024-09-12T02:51:45.495167+0000, chain.objs.size()=1 2024-09-12T01:04:40.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.022+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.285__shadow_.lutD-GEPF3QhnwijqTKJB7VCb7LGLkN_0 2024-09-12T01:04:40.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.022+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14653188083808711829', time=2024-09-12T02:51:51.751164+0000, chain.objs.size()=1 2024-09-12T01:04:40.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.022+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.292__shadow_.07DGj_kp6RBBzE5gWE-ndZeYfdI0SLo_0 2024-09-12T01:04:40.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.022+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3681722835761340595', time=2024-09-12T02:51:53.920665+0000, chain.objs.size()=1 2024-09-12T01:04:40.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.022+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.294__shadow_.LYQp1fUDnJPrk6vCHS1yoPrx3j8n3lN_0 2024-09-12T01:04:40.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.022+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11967282361043922257', time=2024-09-12T02:51:54.645290+0000, chain.objs.size()=1 2024-09-12T01:04:40.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.022+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.295__shadow_.gogIb6-SUAwP3QgjZsrxoR-oFEvtjS0_0 2024-09-12T01:04:40.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.026+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16584727211176498237', time=2024-09-12T02:51:59.188367+0000, chain.objs.size()=1 2024-09-12T01:04:40.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.026+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.301__shadow_.DhZPrVpJ7Dzc2XCcWsQK4OFi0ES-Mr6_0 2024-09-12T01:04:40.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.026+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17637454147046268691', time=2024-09-12T02:52:03.065105+0000, chain.objs.size()=1 2024-09-12T01:04:40.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.026+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.306__shadow_.5r__Nuu4ciZJQMHgi3L_7qzLzNGaXCl_0 2024-09-12T01:04:40.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.026+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1876871537635218227', time=2024-09-12T02:52:35.031064+0000, chain.objs.size()=1 2024-09-12T01:04:40.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.026+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.eaj8HUBtHpIFTDK2Jqr-sacOhDpe6KS_0 2024-09-12T01:04:40.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.026+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10171046443890657623', time=2024-09-12T02:52:35.046761+0000, chain.objs.size()=1 2024-09-12T01:04:40.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.026+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.kgxb_hJhas0MURJUWfVrcSaTZORB5RX_0 2024-09-12T01:04:40.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.026+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11094578244954714445', time=2024-09-12T02:52:35.163336+0000, chain.objs.size()=1 2024-09-12T01:04:40.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.026+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.vhI5z1ymwRcyvnR7Ja0Vf0rOqbvoDg4_0 2024-09-12T01:04:40.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.026+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15079825691623524698', time=2024-09-12T02:52:35.183411+0000, chain.objs.size()=1 2024-09-12T01:04:40.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.026+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.tbaJKfZ3cZRXh3R6u82x6Wqt8Q2Uncf_0 2024-09-12T01:04:40.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.026+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10960146492571554136', time=2024-09-12T02:52:35.362376+0000, chain.objs.size()=1 2024-09-12T01:04:40.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.026+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.COqs07BbyEg_AtUcHPilgrVWDmI7-oz_0 2024-09-12T01:04:40.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.026+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14535367195890520814', time=2024-09-12T02:52:35.404409+0000, chain.objs.size()=1 2024-09-12T01:04:40.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.026+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Bbikp7SdUzSX9PYO9NZ6ynV6QJUUu-v_0 2024-09-12T01:04:40.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.026+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9357209558682688229', time=2024-09-12T02:52:35.642801+0000, chain.objs.size()=1 2024-09-12T01:04:40.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.026+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.JksaazF9zwmd7UFzYYseZLyzdLnBJr2_0 2024-09-12T01:04:40.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.026+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11406902260443877118', time=2024-09-12T02:52:35.774919+0000, chain.objs.size()=1 2024-09-12T01:04:40.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.026+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.y_ZLA1EZqadLf7sqe7jeT7SyOhRgFQq_0 2024-09-12T01:04:40.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.026+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13794219470812751342', time=2024-09-12T02:52:35.785724+0000, chain.objs.size()=1 2024-09-12T01:04:40.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.026+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ejUSjGH-GHlAWiHZaT22PHjZ6pU1E14_0 2024-09-12T01:04:40.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4751562698079520373', time=2024-09-12T02:52:35.805365+0000, chain.objs.size()=1 2024-09-12T01:04:40.029 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.afG5bNeY8I251qX2910z6GeozNV83Q2_0 2024-09-12T01:04:40.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5870653249889792304', time=2024-09-12T02:52:35.817530+0000, chain.objs.size()=1 2024-09-12T01:04:40.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.82kJXcJAoIk3fdB3Gtrl1ckevrybj07_0 2024-09-12T01:04:40.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17640176232720641431', time=2024-09-12T02:52:35.837227+0000, chain.objs.size()=1 2024-09-12T01:04:40.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.sCc6W1LHCfx_LvbpL9R9p-GxeXMd082_0 2024-09-12T01:04:40.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3463366007602154547', time=2024-09-12T02:52:36.274779+0000, chain.objs.size()=1 2024-09-12T01:04:40.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ku70gW0t0Q01l_uPOO_JlfvF9S_O5De_0 2024-09-12T01:04:40.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2095516845972773930', time=2024-09-12T02:52:36.299602+0000, chain.objs.size()=1 2024-09-12T01:04:40.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.e7lXz6bXhZChqbpnY4U5Z-bsqJRDGAd_0 2024-09-12T01:04:40.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6013065092481783457', time=2024-09-12T02:52:36.331846+0000, chain.objs.size()=1 2024-09-12T01:04:40.030 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.zUq_BU7Cs6QxpIXV_1bqCCeelftpxLg_0 2024-09-12T01:04:40.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.249454088578365419', time=2024-09-12T02:52:36.335059+0000, chain.objs.size()=1 2024-09-12T01:04:40.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.quFAosk3Ll_ZD9uVysxI6GrWDF4WULT_0 2024-09-12T01:04:40.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17097771516225985363', time=2024-09-12T02:52:36.336401+0000, chain.objs.size()=1 2024-09-12T01:04:40.031 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.HXIpo1lJKuUFu_1OPvPdG6OBv1iLF3q_0 2024-09-12T01:04:40.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6758479716274860254', time=2024-09-12T02:52:36.352290+0000, chain.objs.size()=1 2024-09-12T01:04:40.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.KI0UcPuhK2ce3A1TEggPupLM0O3kXtu_0 2024-09-12T01:04:40.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1576295279492367555', time=2024-09-12T02:52:36.515579+0000, chain.objs.size()=1 2024-09-12T01:04:40.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ug_SfErM_qD3DJVjruKj0EaZrPmNLge_0 2024-09-12T01:04:40.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13054993820918064456', time=2024-09-12T02:52:36.562725+0000, chain.objs.size()=1 2024-09-12T01:04:40.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.NLbuUw9lNsZyo5RjbO-OfHTG95TtDuz_0 2024-09-12T01:04:40.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14047463178278245291', time=2024-09-12T02:52:36.586307+0000, chain.objs.size()=1 2024-09-12T01:04:40.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.jtHJXKqOTMo4TUe5BH1_ieekd_aVQTK_0 2024-09-12T01:04:40.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10714975215686903191', time=2024-09-12T02:52:36.625533+0000, chain.objs.size()=1 2024-09-12T01:04:40.032 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.RYtD6zF584o5RKe804ZEAOSvRaMnrZy_0 2024-09-12T01:04:40.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12867323524388850228', time=2024-09-12T02:52:36.639468+0000, chain.objs.size()=1 2024-09-12T01:04:40.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Msg0tq3GY5jK--6LcGYq1jUtlahBED-_0 2024-09-12T01:04:40.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13757361585525572864', time=2024-09-12T02:52:36.754250+0000, chain.objs.size()=1 2024-09-12T01:04:40.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.6km4M073gO1U_tmjGC08yCoG_8KSmNu_0 2024-09-12T01:04:40.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14025467587424570010', time=2024-09-12T02:52:36.760740+0000, chain.objs.size()=1 2024-09-12T01:04:40.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.w7wPDTZikcHgIT13THVnFKLSV_MS23z_0 2024-09-12T01:04:40.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12032611248988587973', time=2024-09-12T02:52:36.783249+0000, chain.objs.size()=1 2024-09-12T01:04:40.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.0tI1Hp1RAPXBu7ObwEhkkhRe-TR7b38_0 2024-09-12T01:04:40.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10110315285696136113', time=2024-09-12T02:52:36.848048+0000, chain.objs.size()=1 2024-09-12T01:04:40.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.s_zPx67nl9NhQfW1a5oqSqI0jLMgcoW_0 2024-09-12T01:04:40.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2187014135049091770', time=2024-09-12T02:52:36.861559+0000, chain.objs.size()=1 2024-09-12T01:04:40.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.030+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.zQIdfvR1lMoHG-262F8YI3VODX7qVIy_0 2024-09-12T01:04:40.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.034+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6937996576358677478', time=2024-09-12T02:52:37.037698+0000, chain.objs.size()=1 2024-09-12T01:04:40.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.034+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.X9MmD_6C535Fw4WP4OAyNoe1IAi1T-b_0 2024-09-12T01:04:40.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.034+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16678343731009987233', time=2024-09-12T02:52:37.060231+0000, chain.objs.size()=1 2024-09-12T01:04:40.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.034+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.monxXpcbCztSjvfsG-ULB44Bw_dayJH_0 2024-09-12T01:04:40.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.034+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2155221870468289391', time=2024-09-12T02:52:37.088581+0000, chain.objs.size()=1 2024-09-12T01:04:40.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.034+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.cEMnzfDHfBwjH21MqlegIeNPo9mhnl0_0 2024-09-12T01:04:40.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.034+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4541299197828035052', time=2024-09-12T02:52:37.089367+0000, chain.objs.size()=1 2024-09-12T01:04:40.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.034+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.F7-FKcf-vfd1YLWboerBBhA3X6bWBY6_0 2024-09-12T01:04:40.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.034+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.769145813775482055', time=2024-09-12T02:52:37.098254+0000, chain.objs.size()=1 2024-09-12T01:04:40.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.034+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ZnHKy2Aj74bT9vcsMd8_H40vEB53lxo_0 2024-09-12T01:04:40.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.034+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6017281993091560843', time=2024-09-12T02:52:56.960643+0000, chain.objs.size()=1 2024-09-12T01:04:40.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.034+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Xu-ttpMHUyKZWd7MvBO3p63jPf7PxQP_0 2024-09-12T01:04:40.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.034+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9771971826149259561', time=2024-09-12T02:52:56.987667+0000, chain.objs.size()=1 2024-09-12T01:04:40.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.034+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.3GDCXrn43wxrSKeIkTKSj4sF0qJaEjE_0 2024-09-12T01:04:40.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.034+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6535555440269417753', time=2024-09-12T02:52:57.048174+0000, chain.objs.size()=1 2024-09-12T01:04:40.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.034+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.d2p1t9aawGvgb2L-t3-C3GTY-BoVRBK_0 2024-09-12T01:04:40.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.034+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6143286678816570182', time=2024-09-12T02:52:57.158102+0000, chain.objs.size()=1 2024-09-12T01:04:40.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.034+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.8EP2jXlQ1Zz-IP6DBI6LGRSvKFcIsfE_0 2024-09-12T01:04:40.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.034+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9487095928786763466', time=2024-09-12T02:52:57.211641+0000, chain.objs.size()=1 2024-09-12T01:04:40.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.034+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.oL80XY4_SAgu0Ju7mf0MmUCN3D_qKiu_0 2024-09-12T01:04:40.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.034+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10848920282189866951', time=2024-09-12T02:52:57.236949+0000, chain.objs.size()=1 2024-09-12T01:04:40.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.034+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.7srePfyImAzLNZTXqEpRHZPhaEImOJg_0 2024-09-12T01:04:40.037 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.034+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11504066676513471351', time=2024-09-12T02:52:57.250545+0000, chain.objs.size()=1 2024-09-12T01:04:40.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.034+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.3eh8mnK9HoGQLirePqT3cGSKuDoVVa-_0 2024-09-12T01:04:40.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.038+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7852060786665024922', time=2024-09-12T02:52:57.259971+0000, chain.objs.size()=1 2024-09-12T01:04:40.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.038+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Aoh6MOnLDdp6GfnFg58al75FkxDDOl0_0 2024-09-12T01:04:40.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.038+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16273495882572897342', time=2024-09-12T02:52:57.274435+0000, chain.objs.size()=1 2024-09-12T01:04:40.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.038+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.hk7RVkJaoZV3YbCcC8Pf8UhXCjCB2cU_0 2024-09-12T01:04:40.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.038+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9258367809466671621', time=2024-09-12T02:52:57.441074+0000, chain.objs.size()=1 2024-09-12T01:04:40.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.038+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.GpGZt5FD8D8-klRuH1EXBMXrK1cnitU_0 2024-09-12T01:04:40.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.038+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13618268245318797941', time=2024-09-12T02:52:57.528459+0000, chain.objs.size()=1 2024-09-12T01:04:40.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.038+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.h7EAP12Hagjh0Mui_sDuaGGhRRI8lF5_0 2024-09-12T01:04:40.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.038+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13401206237525312296', time=2024-09-12T02:52:57.529276+0000, chain.objs.size()=1 2024-09-12T01:04:40.038 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.038+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.GXZC7f86vOl7CVC7u2ipbX0s3OzKuQF_0 2024-09-12T01:04:40.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.038+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3989462564853211648', time=2024-09-12T02:52:57.865975+0000, chain.objs.size()=1 2024-09-12T01:04:40.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.038+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.wLLrXvSgFdrqmi66e8hHubAkCUreCmO_0 2024-09-12T01:04:40.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.038+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13165558704240215773', time=2024-09-12T02:52:57.887703+0000, chain.objs.size()=1 2024-09-12T01:04:40.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.038+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.-i_3L53kmiyHEGGVq7GsWp2dFm8Nt7t_0 2024-09-12T01:04:40.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.038+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2697743275695060120', time=2024-09-12T02:52:57.894968+0000, chain.objs.size()=1 2024-09-12T01:04:40.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.038+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.BZKDx4_68tG0UzTsjwgxil4PVkFHf8j_0 2024-09-12T01:04:40.039 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.038+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16395008383900043325', time=2024-09-12T02:52:57.896253+0000, chain.objs.size()=1 2024-09-12T01:04:40.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.038+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.AXvtOgYqVvfa6Aoq6u35zhFI05PrxkK_0 2024-09-12T01:04:40.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.038+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.97376264841799036', time=2024-09-12T02:52:57.944827+0000, chain.objs.size()=1 2024-09-12T01:04:40.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.038+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Y1z7hsA8Tuq2BS4x_Fvhhm2NHLmMW07_0 2024-09-12T01:04:40.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.042+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50453 2024-09-12T01:04:40.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.042+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-12T01:04:40.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.042+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4005064945925381294', time=2024-09-12T02:52:57.973422+0000, chain.objs.size()=1 2024-09-12T01:04:40.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.042+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.8Yjnzqlt7g-feocc8dW4RHOGSh-oRW8_0 2024-09-12T01:04:40.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.042+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10573983233822005625', time=2024-09-12T02:52:58.105357+0000, chain.objs.size()=1 2024-09-12T01:04:40.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.042+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.nD3SxtX3VHpug7gh8dLM57Kewzx251a_0 2024-09-12T01:04:40.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.042+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10159710257153680331', time=2024-09-12T02:52:58.134749+0000, chain.objs.size()=1 2024-09-12T01:04:40.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.042+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.nRuo0Y15wrPKnq_EeiM6uxNIyRZs9Nf_0 2024-09-12T01:04:40.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.042+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1513931088938268607', time=2024-09-12T02:52:58.183838+0000, chain.objs.size()=1 2024-09-12T01:04:40.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.042+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.IHVdoq7VBLWWnmOM0AkhCXYP4Y0Z0G-_0 2024-09-12T01:04:40.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.042+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6716284761929062377', time=2024-09-12T02:52:58.216569+0000, chain.objs.size()=1 2024-09-12T01:04:40.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.042+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.tDT4PiK_gX4aRBmm_X2i5EsqC3yXTDS_0 2024-09-12T01:04:40.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.042+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14634654545008067175', time=2024-09-12T02:52:58.236506+0000, chain.objs.size()=1 2024-09-12T01:04:40.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.042+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.lEt9_--N4ygA7hW9juCJmZYhm5zL5Ul_0 2024-09-12T01:04:40.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.042+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7160564062343840847', time=2024-09-12T02:52:58.390448+0000, chain.objs.size()=1 2024-09-12T01:04:40.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.042+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.aktTx0M17SHmBvNbEM992zMaot-raP2_0 2024-09-12T01:04:40.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.042+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1189169858934790606', time=2024-09-12T02:52:58.460559+0000, chain.objs.size()=1 2024-09-12T01:04:40.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.042+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.5fmA-qeR5LV6adbF91K1PpcxeQeHlQC_0 2024-09-12T01:04:40.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.042+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4121642763943788300', time=2024-09-12T02:52:58.621783+0000, chain.objs.size()=1 2024-09-12T01:04:40.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.042+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.sN8va6Sv2e5a8C2-A-BkUrcBK8QoRIt_0 2024-09-12T01:04:40.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.042+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17276579855780294785', time=2024-09-12T02:52:58.624253+0000, chain.objs.size()=1 2024-09-12T01:04:40.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.042+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.aNhaAm8vxOybW_b3yasFdu7Vf3XwXp-_0 2024-09-12T01:04:40.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.042+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4828822018349065694', time=2024-09-12T02:52:58.648120+0000, chain.objs.size()=1 2024-09-12T01:04:40.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.042+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.uL9vvw3ggrWZISrT8_nSt-Q3J3BidHC_0 2024-09-12T01:04:40.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.042+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14464784014292162972', time=2024-09-12T02:52:58.656948+0000, chain.objs.size()=1 2024-09-12T01:04:40.045 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.042+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.F-C8qs4kYuehq1B0csgRaf3FCa2iU-y_0 2024-09-12T01:04:40.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.042+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15490213990297169418', time=2024-09-12T02:53:11.281823+0000, chain.objs.size()=1 2024-09-12T01:04:40.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.042+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.343__shadow_.cYoG6N8Ml7RXDB_JbTBlseq7-40exER_0 2024-09-12T01:04:40.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3260797151799270505', time=2024-09-12T02:54:37.629988+0000, chain.objs.size()=1 2024-09-12T01:04:40.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.459__shadow_.anBhJZS1cDUWZeR95Hxxhgyrg7Dj4wl_0 2024-09-12T01:04:40.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14731535366462822328', time=2024-09-12T02:54:54.116282+0000, chain.objs.size()=1 2024-09-12T01:04:40.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.484__shadow_.EmMkXxWkPg8lKPEL-wjvF6H6l_q3MfC_0 2024-09-12T01:04:40.046 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8569812778511184971', time=2024-09-12T02:55:07.270891+0000, chain.objs.size()=1 2024-09-12T01:04:40.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.503__shadow:6LMeYfVzuD7PUiSwyt-9RW46Hh57mqn_.UcslrmdoBCcU7pOGIUMlA4mj_NOCVe1_0 2024-09-12T01:04:40.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~TKL5qdIeGbXMmxfKBqhin9z2ZSw2G9z', time=2024-09-12T02:55:52.974601+0000, chain.objs.size()=10 2024-09-12T01:04:40.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.526__multipart_mymultipart.2~TKL5qdIeGbXMmxfKBqhin9z2ZSw2G9z.1 2024-09-12T01:04:40.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.526__multipart_mymultipart.2~TKL5qdIeGbXMmxfKBqhin9z2ZSw2G9z.2 2024-09-12T01:04:40.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.526__multipart_mymultipart.2~TKL5qdIeGbXMmxfKBqhin9z2ZSw2G9z.3 2024-09-12T01:04:40.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.526__multipart_mymultipart.2~TKL5qdIeGbXMmxfKBqhin9z2ZSw2G9z.4 2024-09-12T01:04:40.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.526__multipart_mymultipart.2~TKL5qdIeGbXMmxfKBqhin9z2ZSw2G9z.5 2024-09-12T01:04:40.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.526__multipart_mymultipart.2~TKL5qdIeGbXMmxfKBqhin9z2ZSw2G9z.6 2024-09-12T01:04:40.047 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.526__multipart_mymultipart.2~TKL5qdIeGbXMmxfKBqhin9z2ZSw2G9z.7 2024-09-12T01:04:40.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.526__multipart_mymultipart.2~TKL5qdIeGbXMmxfKBqhin9z2ZSw2G9z.8 2024-09-12T01:04:40.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.526__multipart_mymultipart.2~TKL5qdIeGbXMmxfKBqhin9z2ZSw2G9z.9 2024-09-12T01:04:40.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.526__multipart_mymultipart.2~TKL5qdIeGbXMmxfKBqhin9z2ZSw2G9z.10 2024-09-12T01:04:40.048 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13012484238428364390', time=2024-09-12T02:56:39.468921+0000, chain.objs.size()=1 2024-09-12T01:04:40.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.550__shadow_.FNZaxr0y1u6Hd6L7quzec11sLitEvXK_0 2024-09-12T01:04:40.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3830486067710998855', time=2024-09-12T02:57:03.898809+0000, chain.objs.size()=1 2024-09-12T01:04:40.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.569__shadow:iLYY-vsOhaPUA..S1m42wA93N1gTjJa_.LNk6CYw-OC3Eosy3ovxi5LA-KMg9SoD_0 2024-09-12T01:04:40.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15671418878079648151', time=2024-09-12T02:57:22.590198+0000, chain.objs.size()=1 2024-09-12T01:04:40.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.576__shadow:QL8AU67ss5hwbt1z3TtJJtMzaJsic0D_.HMXVnOTzcxFzvzMcN-J7G0BpWgQ3b21_0 2024-09-12T01:04:40.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17811658322939076719', time=2024-09-12T02:57:27.026594+0000, chain.objs.size()=1 2024-09-12T01:04:40.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:bkfGU9C7vdVlbmThk3zDwC2s6ftZU.7_.mM4fRpfbor4oBVwNFHiAo42hRvdgD-V_0 2024-09-12T01:04:40.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4387628684675418095', time=2024-09-12T02:57:38.147188+0000, chain.objs.size()=1 2024-09-12T01:04:40.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.577__shadow:Pm3N1Rpr7uw1iG9Ue2YPOc9QMC2Fqmu_.tG1CVcK7rhQ2MKxNZ517VK4KaAo1zuT_0 2024-09-12T01:04:40.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10596201355115122125', time=2024-09-12T02:57:44.714319+0000, chain.objs.size()=1 2024-09-12T01:04:40.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.579__shadow:ulosJ-TbqNsWCDkxxBW5jPfDQSIIifa_.Xh6RPCKoMB02zaHfTlCCPFWRm7S-JqR_0 2024-09-12T01:04:40.049 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1937811789358863341', time=2024-09-12T02:57:46.327513+0000, chain.objs.size()=1 2024-09-12T01:04:40.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.580__shadow:RD9R7T.SWCifB5Jk4Cu.ouVVEDXs6GE_.l3f2invbA3_55ykYVqCHjPmYpUrZCIb_0 2024-09-12T01:04:40.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2902595706169782502', time=2024-09-12T02:58:03.268426+0000, chain.objs.size()=1 2024-09-12T01:04:40.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.604__shadow_.YokF1gVgHoOx95jkYRcHYaefP0z5ljr_0 2024-09-12T01:04:40.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8729567327952555994', time=2024-09-12T02:58:22.041381+0000, chain.objs.size()=1 2024-09-12T01:04:40.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.616__shadow_.QT8TRRoZMmTiCgCfRR5D_5C5TFyVA70_0 2024-09-12T01:04:40.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10436987432470309299', time=2024-09-12T03:01:24.220399+0000, chain.objs.size()=1 2024-09-12T01:04:40.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.046+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.692__shadow:L6z9dTso7Rr4lxDb53gDzKTeWLU-T8b_.f1rauM0YvMK9AcI0uqG2bZ0cB8ub1rn_0 2024-09-12T01:04:40.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.050+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8294871740087481971', time=2024-09-12T03:01:27.566232+0000, chain.objs.size()=1 2024-09-12T01:04:40.050 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.050+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.697__shadow:HVL38oYV0iJK-qbBWiuDk4FtM.z8-c6_.ZKNjelDx9_7lvu6I7i1hJ1OuH3BJ4t__0 2024-09-12T01:04:40.051 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.050+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:40.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:04:40.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:40.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:40.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48228' 2024-09-12T01:04:40.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.588129781477841048', time=2024-09-12T02:48:38.644589+0000, chain.objs.size()=1 2024-09-12T01:04:40.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.166__shadow_.IUdk_1tdBPkRZ9sP3IxS1d_LFnTWouE_0 2024-09-12T01:04:40.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~7cGQwBm0xDmbkTecXbky-NimUAh-idm', time=2024-09-12T02:49:14.830891+0000, chain.objs.size()=2 2024-09-12T01:04:40.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.202__multipart_mymultipart.2~7cGQwBm0xDmbkTecXbky-NimUAh-idm.1 2024-09-12T01:04:40.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.202__shadow_mymultipart.2~7cGQwBm0xDmbkTecXbky-NimUAh-idm.1_1 2024-09-12T01:04:40.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.478147351818587815', time=2024-09-12T02:50:47.637627+0000, chain.objs.size()=1 2024-09-12T01:04:40.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.237__shadow_.IIila6sHfc4HbezCMb60HNJsYd0Wodr_0 2024-09-12T01:04:40.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12200672613652726972', time=2024-09-12T02:50:48.897369+0000, chain.objs.size()=1 2024-09-12T01:04:40.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.238__shadow_.TT-KK6ECCwFlM8m1NFkUIRQ6efBV6TX_0 2024-09-12T01:04:40.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9494833355739389410', time=2024-09-12T02:50:53.006878+0000, chain.objs.size()=1 2024-09-12T01:04:40.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.243__shadow_.HDVdujqOWm4AfUn_hYqLrXj6q7573nP_0 2024-09-12T01:04:40.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17228685845404451699', time=2024-09-12T02:50:54.943004+0000, chain.objs.size()=1 2024-09-12T01:04:40.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.245__shadow_.tjgZDZD9SridH9mCehZXOoAELEpRA5R_0 2024-09-12T01:04:40.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16822125028198439157', time=2024-09-12T02:50:56.703739+0000, chain.objs.size()=1 2024-09-12T01:04:40.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.247__shadow_.8sLVS9-jYPIxOaIc5NdaCEv5GZzBjQq_0 2024-09-12T01:04:40.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15064105137896427368', time=2024-09-12T02:50:56.705919+0000, chain.objs.size()=1 2024-09-12T01:04:40.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.247__shadow_.BunUw9AK0Liay1-kifHqAdO_KwZCalR_0 2024-09-12T01:04:40.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5148231591323313455', time=2024-09-12T02:50:57.449907+0000, chain.objs.size()=1 2024-09-12T01:04:40.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.248__shadow_.mO0feIOvRKhGjO_171ETReTEJH-Zhyv_0 2024-09-12T01:04:40.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9705128900992617590', time=2024-09-12T02:50:58.153532+0000, chain.objs.size()=1 2024-09-12T01:04:40.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.249__shadow_.-mBjEkDW7G4lHU4_8DaNiH1nTWB1ZtI_0 2024-09-12T01:04:40.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.054+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4394718560783914166', time=2024-09-12T02:51:26.768650+0000, chain.objs.size()=1 2024-09-12T01:04:40.058 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.054+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.hWEppkFojaf9gWX8Vv4c-H3SM6HeBFp_0 2024-09-12T01:04:40.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.058+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6822362357154366372', time=2024-09-12T02:51:26.833442+0000, chain.objs.size()=1 2024-09-12T01:04:40.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.058+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.nKoo1Aht2wp5LOclBOCOvN7vZKHNqAO_0 2024-09-12T01:04:40.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.058+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4097553055203256051', time=2024-09-12T02:51:26.866420+0000, chain.objs.size()=1 2024-09-12T01:04:40.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.058+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.o2PHA0chtp_tkYxQ4IBVpQysbRB8h_n_0 2024-09-12T01:04:40.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.058+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10240795673753032033', time=2024-09-12T02:51:27.023284+0000, chain.objs.size()=1 2024-09-12T01:04:40.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.058+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.u_OBAafU5eD238OWlNVdB2wQMZSvoJU_0 2024-09-12T01:04:40.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.058+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6440539067970572577', time=2024-09-12T02:51:27.024232+0000, chain.objs.size()=1 2024-09-12T01:04:40.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.058+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.4XyD9XUYkZfZC90q3ySYTgPoxEu5ORK_0 2024-09-12T01:04:40.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.058+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.384653845106064371', time=2024-09-12T02:51:27.040526+0000, chain.objs.size()=1 2024-09-12T01:04:40.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.058+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.DK_4JMQ6X4Xe7TXE5cenk7bxGsZE_4i_0 2024-09-12T01:04:40.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.058+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14842941498727479565', time=2024-09-12T02:51:27.195842+0000, chain.objs.size()=1 2024-09-12T01:04:40.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.058+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.euqdtAcHWA0zUWBV_zGQrNL2RUjVrrG_0 2024-09-12T01:04:40.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.058+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3075691116841137141', time=2024-09-12T02:51:27.222282+0000, chain.objs.size()=1 2024-09-12T01:04:40.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.058+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.GUv9ieOCBdjknDpvvz6mvremBUL1l0P_0 2024-09-12T01:04:40.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.058+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2184702932783925585', time=2024-09-12T02:51:27.227045+0000, chain.objs.size()=1 2024-09-12T01:04:40.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.058+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.3lS3w6X3iXG7OWV-hm6Nx0drXg1sCmc_0 2024-09-12T01:04:40.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.058+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11550720007157517811', time=2024-09-12T02:51:27.237608+0000, chain.objs.size()=1 2024-09-12T01:04:40.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.058+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.fEmiD5vMrfG2ZfEqEO9yNKAOKaqengq_0 2024-09-12T01:04:40.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.058+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6388865516927226891', time=2024-09-12T02:51:27.242952+0000, chain.objs.size()=1 2024-09-12T01:04:40.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.058+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.r2YqQAUw7GfOQDP_PtH79q0235mQZqP_0 2024-09-12T01:04:40.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.058+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12919930533749135942', time=2024-09-12T02:51:27.259542+0000, chain.objs.size()=1 2024-09-12T01:04:40.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.058+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.DjzN532JkPK_4exwSlxfyt9atIqvfEr_0 2024-09-12T01:04:40.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.058+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.219770770375047973', time=2024-09-12T02:51:27.300862+0000, chain.objs.size()=1 2024-09-12T01:04:40.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.058+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.JfwawKuixpnkHU5ETAdaHNx559iZjDc_0 2024-09-12T01:04:40.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.062+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9801209162195949814', time=2024-09-12T02:51:27.310186+0000, chain.objs.size()=1 2024-09-12T01:04:40.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.062+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.pc80cUM35fP98hxaAdix2MFm3jQbwCC_0 2024-09-12T01:04:40.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.062+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12084745030854032895', time=2024-09-12T02:51:27.325652+0000, chain.objs.size()=1 2024-09-12T01:04:40.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.062+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.H9bnvM7uA8eupgX12T6OtWC3-EdSnUC_0 2024-09-12T01:04:40.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.062+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16074187067750414317', time=2024-09-12T02:51:27.327787+0000, chain.objs.size()=1 2024-09-12T01:04:40.062 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.062+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.qgTea1DClylR3af_5dwl2LnJxvzxsIE_0 2024-09-12T01:04:40.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.062+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7093350682621537305', time=2024-09-12T02:51:27.473082+0000, chain.objs.size()=1 2024-09-12T01:04:40.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.062+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.zOC9HlW5mqjq32UjFtObBJilQKMJg5g_0 2024-09-12T01:04:40.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.062+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17914101724622554866', time=2024-09-12T02:51:27.485537+0000, chain.objs.size()=1 2024-09-12T01:04:40.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.062+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_._eoa0wW2np9SFZr1wpwt4TcrnNS8u25_0 2024-09-12T01:04:40.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.062+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16336117197651251692', time=2024-09-12T02:51:27.496453+0000, chain.objs.size()=1 2024-09-12T01:04:40.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.062+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Mt69kg3-SjUA9u8ooQU6wvXA_fIhISm_0 2024-09-12T01:04:40.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.062+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12305312674222209190', time=2024-09-12T02:51:27.535173+0000, chain.objs.size()=1 2024-09-12T01:04:40.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.062+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Sg-0q4nnNBxGttCwkq1zRKHBgSZ6i13_0 2024-09-12T01:04:40.063 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.062+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4414227432012865507', time=2024-09-12T02:51:27.634672+0000, chain.objs.size()=1 2024-09-12T01:04:40.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.062+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.XEB_fk_cmSkLrD8nJV0D5nnASdPW22E_0 2024-09-12T01:04:40.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.062+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18190475083570996565', time=2024-09-12T02:51:27.675392+0000, chain.objs.size()=1 2024-09-12T01:04:40.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.062+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.dcqYyKxKpkpn_Q5Jez-g17DbDgmRl5k_0 2024-09-12T01:04:40.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.062+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2811190690892945972', time=2024-09-12T02:51:27.704350+0000, chain.objs.size()=1 2024-09-12T01:04:40.064 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.062+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.w0eo34OAG0MRuHRC4txYQRsm3Yvsu3J_0 2024-09-12T01:04:40.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.062+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14654054988939129740', time=2024-09-12T02:51:27.862422+0000, chain.objs.size()=1 2024-09-12T01:04:40.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.062+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.NyUXpZsY2ntQZCkk0IhhDEtmLviqIan_0 2024-09-12T01:04:40.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.062+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2061394889147905036', time=2024-09-12T02:51:27.911317+0000, chain.objs.size()=1 2024-09-12T01:04:40.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.062+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Qn_NZi88uE-HA3O_eC3dOUNFigM95Kb_0 2024-09-12T01:04:40.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.062+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17317382087362240442', time=2024-09-12T02:51:27.917178+0000, chain.objs.size()=1 2024-09-12T01:04:40.065 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.062+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.fvS1yAJ6mID6sASVGgvRRWfbE9S38mw_0 2024-09-12T01:04:40.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.066+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9214628675592522374', time=2024-09-12T02:51:28.117773+0000, chain.objs.size()=1 2024-09-12T01:04:40.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.066+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Q4d01XBVpjfJVOKVN1473cbJgwbERJq_0 2024-09-12T01:04:40.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.066+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2284154707421156344', time=2024-09-12T02:51:28.169438+0000, chain.objs.size()=1 2024-09-12T01:04:40.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.066+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.fWRzG1JHHp-WhF6zlki4knywNEcUfD8_0 2024-09-12T01:04:40.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.066+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6222535671140940363', time=2024-09-12T02:51:28.189784+0000, chain.objs.size()=1 2024-09-12T01:04:40.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.066+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ae0xwkjUo2nQg39NgKO93fiVyalZMEP_0 2024-09-12T01:04:40.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.066+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10358850918395692550', time=2024-09-12T02:51:28.230199+0000, chain.objs.size()=1 2024-09-12T01:04:40.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.066+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.g5FXml7BCgliPcupMY8CG0Pl5VAtuWE_0 2024-09-12T01:04:40.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.066+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3930733594346155082', time=2024-09-12T02:51:51.718959+0000, chain.objs.size()=1 2024-09-12T01:04:40.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.066+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.292__shadow_.1eEwjf6HEeAqsNP-ulf8iZcH57I3mQ1_0 2024-09-12T01:04:40.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.066+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12051036053398795878', time=2024-09-12T02:51:53.188525+0000, chain.objs.size()=1 2024-09-12T01:04:40.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.066+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.293__shadow_.gem7Qx6GNxo7cssF-MeCkqwcEV2Mny2_0 2024-09-12T01:04:40.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.066+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14339801513012843421', time=2024-09-12T02:51:55.367328+0000, chain.objs.size()=1 2024-09-12T01:04:40.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.066+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.296__shadow_.oj6iuaIaWsRJm2CxpnIa6MF0nEOyalE_0 2024-09-12T01:04:40.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.066+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1103607773628348473', time=2024-09-12T02:51:56.911768+0000, chain.objs.size()=1 2024-09-12T01:04:40.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.066+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.298__shadow_.N5Ay-EenMWKr1TmQh8KAJkW3Y2cFchV_0 2024-09-12T01:04:40.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.066+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10659656014186814902', time=2024-09-12T02:52:35.028203+0000, chain.objs.size()=1 2024-09-12T01:04:40.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.066+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ZO-K7Y05O42TeWoFSGiYG2HqwuIGuNN_0 2024-09-12T01:04:40.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.066+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2336298911106299675', time=2024-09-12T02:52:35.081165+0000, chain.objs.size()=1 2024-09-12T01:04:40.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.066+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.5HWVSPHWe5Fj2jlcS1s1pOm2fQFSwQE_0 2024-09-12T01:04:40.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.066+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9908314561875645904', time=2024-09-12T02:52:35.177072+0000, chain.objs.size()=1 2024-09-12T01:04:40.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.066+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.WzkqcTgVnh3B81V9Box5PgetUsPV71r_0 2024-09-12T01:04:40.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.066+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3031983761678691389', time=2024-09-12T02:52:35.320423+0000, chain.objs.size()=1 2024-09-12T01:04:40.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.066+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.BzFvBVMZoy7jZebPd2XGJRp9yku1PPt_0 2024-09-12T01:04:40.068 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.070+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8072659908094858097', time=2024-09-12T02:52:35.377249+0000, chain.objs.size()=1 2024-09-12T01:04:40.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.070+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.NRIeQdNu-aEnwa5t_-VTVoHD9hKjgZI_0 2024-09-12T01:04:40.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.070+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7999772604540327611', time=2024-09-12T02:52:35.379108+0000, chain.objs.size()=1 2024-09-12T01:04:40.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.070+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.uPsXW5jyJz-9oZKXbrbCWGzO11apin2_0 2024-09-12T01:04:40.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.070+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9865715254669502239', time=2024-09-12T02:52:35.400706+0000, chain.objs.size()=1 2024-09-12T01:04:40.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.070+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.6ip4G_lMxFfxVcEUj4m7YJ5l8rRGARE_0 2024-09-12T01:04:40.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.070+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3964383266428865245', time=2024-09-12T02:52:35.410147+0000, chain.objs.size()=1 2024-09-12T01:04:40.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.070+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Yeg4b-yBkHJcYgCEwKqvWYxA6i7kGtn_0 2024-09-12T01:04:40.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.070+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15484721240340676625', time=2024-09-12T02:52:35.421613+0000, chain.objs.size()=1 2024-09-12T01:04:40.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.070+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.g6TgLGPypU8uVJtv0yRbzZo7caWdAhQ_0 2024-09-12T01:04:40.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.070+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9860858669509754319', time=2024-09-12T02:52:35.426871+0000, chain.objs.size()=1 2024-09-12T01:04:40.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.070+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.rYexA9mehg3-Un9wDoLDkAerUX_SbT5_0 2024-09-12T01:04:40.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.070+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9209135139650863783', time=2024-09-12T02:52:35.621959+0000, chain.objs.size()=1 2024-09-12T01:04:40.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.070+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.bvxRH1UCLyyTdzOdTuLbFJU2uHDd05l_0 2024-09-12T01:04:40.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.070+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13551986026087983329', time=2024-09-12T02:52:35.635769+0000, chain.objs.size()=1 2024-09-12T01:04:40.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.070+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.TEwlq-QxJNrmh95DFnoi6HXL998cGdq_0 2024-09-12T01:04:40.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.070+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6024500394954668511', time=2024-09-12T02:52:35.871392+0000, chain.objs.size()=1 2024-09-12T01:04:40.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.070+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.BU8GOWJ4G3hScBPAweoYXbpi_S_FkAJ_0 2024-09-12T01:04:40.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.070+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16165028100015749016', time=2024-09-12T02:52:35.882984+0000, chain.objs.size()=1 2024-09-12T01:04:40.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.070+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.bFlii0xc5wbFNMdln5QGnfkWO28V9nQ_0 2024-09-12T01:04:40.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.070+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10665077196543211017', time=2024-09-12T02:52:36.356782+0000, chain.objs.size()=1 2024-09-12T01:04:40.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.070+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.EnRF4FlZG9G_6HWNGAiuZegwY_MlJs2_0 2024-09-12T01:04:40.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.070+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4536924357149924522', time=2024-09-12T02:52:36.565057+0000, chain.objs.size()=1 2024-09-12T01:04:40.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.070+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.4kgPXZkBeM_b_d40xySPQ9MP39NoHgi_0 2024-09-12T01:04:40.071 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.070+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1477781275353003254', time=2024-09-12T02:52:36.780842+0000, chain.objs.size()=1 2024-09-12T01:04:40.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.070+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.1ANZBtp2iuOM8CTVB00v8UJLlfQpjna_0 2024-09-12T01:04:40.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.070+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15166444263400409194', time=2024-09-12T02:52:36.787140+0000, chain.objs.size()=1 2024-09-12T01:04:40.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.070+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.mDGXl--yqoMcXCb_bYIJmNtYN4L_cgv_0 2024-09-12T01:04:40.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3747310937748202482', time=2024-09-12T02:52:36.851919+0000, chain.objs.size()=1 2024-09-12T01:04:40.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.7TY4odCMfG5Sln3b0wFlqDjsPcZjBQf_0 2024-09-12T01:04:40.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17019688206475091689', time=2024-09-12T02:52:36.996783+0000, chain.objs.size()=1 2024-09-12T01:04:40.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.s3_42ofrBHV87piXBA2_s72rET-59oj_0 2024-09-12T01:04:40.073 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14522049306472882939', time=2024-09-12T02:52:37.000867+0000, chain.objs.size()=1 2024-09-12T01:04:40.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.OTHm9RWSG843tU9_ggm0M0fNNS6jK2w_0 2024-09-12T01:04:40.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9287455305816754252', time=2024-09-12T02:52:56.938800+0000, chain.objs.size()=1 2024-09-12T01:04:40.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.NP8L66edEER3QWkpD7xy4M6jC4pSXNd_0 2024-09-12T01:04:40.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5896449791990469789', time=2024-09-12T02:52:56.996718+0000, chain.objs.size()=1 2024-09-12T01:04:40.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.MLq0srR0c5gf89WhuGgut6vNl8j1Ejo_0 2024-09-12T01:04:40.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.746735665139341942', time=2024-09-12T02:52:57.034066+0000, chain.objs.size()=1 2024-09-12T01:04:40.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.snG09_OP_2BIMQBsrIpVKCl1iGr--PD_0 2024-09-12T01:04:40.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4438283242458747151', time=2024-09-12T02:52:57.034905+0000, chain.objs.size()=1 2024-09-12T01:04:40.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.iakKlQkBNBP1MiPvY-Zo49icg4T3ZBW_0 2024-09-12T01:04:40.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14734132862750897014', time=2024-09-12T02:52:57.044351+0000, chain.objs.size()=1 2024-09-12T01:04:40.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.x4gl79_NJmGwbVcHBIl1BzBwLwL8XmO_0 2024-09-12T01:04:40.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.461417311815979286', time=2024-09-12T02:52:57.398667+0000, chain.objs.size()=1 2024-09-12T01:04:40.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.gG09pL9JHjmBE6Km4JxNThESS9ThBLl_0 2024-09-12T01:04:40.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6095644505818884018', time=2024-09-12T02:52:57.406720+0000, chain.objs.size()=1 2024-09-12T01:04:40.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.5XB2I2WO0C8GKdWyBq1MWy7oswABsCn_0 2024-09-12T01:04:40.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1261852967408730781', time=2024-09-12T02:52:57.464439+0000, chain.objs.size()=1 2024-09-12T01:04:40.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.LcsfPqOjg7pcUPGq5N8OgV3JUibeTGt_0 2024-09-12T01:04:40.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10297187446501938849', time=2024-09-12T02:52:57.470998+0000, chain.objs.size()=1 2024-09-12T01:04:40.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_._BuGndcZlsoTkW-TtTwf0MRTSPZTh50_0 2024-09-12T01:04:40.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1179063111912238938', time=2024-09-12T02:52:57.488980+0000, chain.objs.size()=1 2024-09-12T01:04:40.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.8yzfcG4eKVH2-gcdhiq1iQgD_OCEtUb_0 2024-09-12T01:04:40.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11333905917553845557', time=2024-09-12T02:52:57.526315+0000, chain.objs.size()=1 2024-09-12T01:04:40.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.khQlYJAcIkgDaVkS_WgNyIkx4C0ZPwp_0 2024-09-12T01:04:40.076 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9116001650651800330', time=2024-09-12T02:52:57.646498+0000, chain.objs.size()=1 2024-09-12T01:04:40.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.FoY4qwhUeoAbMjdFr3L8peCvLTrEolu_0 2024-09-12T01:04:40.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10207337369730689606', time=2024-09-12T02:52:57.676361+0000, chain.objs.size()=1 2024-09-12T01:04:40.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.RIlR4Ek52C70pU0liOJj3ApV3QZu_8-_0 2024-09-12T01:04:40.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1408483192385828696', time=2024-09-12T02:52:57.694619+0000, chain.objs.size()=1 2024-09-12T01:04:40.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.m4tDP4X9OHDpYQKkm0Nhd1hfxn2QOYe_0 2024-09-12T01:04:40.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4172347684907724306', time=2024-09-12T02:52:57.736898+0000, chain.objs.size()=1 2024-09-12T01:04:40.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.W2hFWWgl1LEDQPhwGd1neLX2T9yutll_0 2024-09-12T01:04:40.077 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11047237046293016684', time=2024-09-12T02:52:57.993640+0000, chain.objs.size()=1 2024-09-12T01:04:40.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.v9WfkExso7wHE3jMQaOuja4GDAPi-Z3_0 2024-09-12T01:04:40.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1618457510226279424', time=2024-09-12T02:52:58.189936+0000, chain.objs.size()=1 2024-09-12T01:04:40.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Z_28ZlvfGn5rA3fXtl8DsNAXHm5p6GE_0 2024-09-12T01:04:40.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9674007648698410915', time=2024-09-12T02:52:58.208191+0000, chain.objs.size()=1 2024-09-12T01:04:40.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.m88X1iYTYc-wToiJrJncBkJPW_Ci1A8_0 2024-09-12T01:04:40.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6269650183949803544', time=2024-09-12T02:52:58.220754+0000, chain.objs.size()=1 2024-09-12T01:04:40.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.074+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.31KCfXwukymt9WisrVSpSS_Rs2ztFZu_0 2024-09-12T01:04:40.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.078+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17723313605330473158', time=2024-09-12T02:52:58.226142+0000, chain.objs.size()=1 2024-09-12T01:04:40.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.078+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.3yoIhTnf4m4F_B_ALE208EOrqDtptYc_0 2024-09-12T01:04:40.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.078+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8930242026078246451', time=2024-09-12T02:52:58.456916+0000, chain.objs.size()=1 2024-09-12T01:04:40.078 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.078+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.vKmikPkIfZfGK7BbkRiDH-bOHsD993A_0 2024-09-12T01:04:40.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.078+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13421728948013193067', time=2024-09-12T02:52:58.466956+0000, chain.objs.size()=1 2024-09-12T01:04:40.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.078+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.XI-vhjoHYy6XtBRrfp_mYN11YuH0tIj_0 2024-09-12T01:04:40.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.078+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.193600103630434740', time=2024-09-12T02:52:58.470370+0000, chain.objs.size()=1 2024-09-12T01:04:40.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.078+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.lSEqi0LfrOnY4Kub-PpJ-UXfAug2Uhg_0 2024-09-12T01:04:40.079 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.078+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.252269573342440035', time=2024-09-12T02:52:58.604022+0000, chain.objs.size()=1 2024-09-12T01:04:40.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.078+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.rpWrOXV875GuIUJGwoICcakewvcDLPv_0 2024-09-12T01:04:40.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.078+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12132270042669504738', time=2024-09-12T02:52:58.628367+0000, chain.objs.size()=1 2024-09-12T01:04:40.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.078+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ir_nEcsDO-4lBhc1j7IHLjFuJ_5Je4g_0 2024-09-12T01:04:40.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.078+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5159718624934627632', time=2024-09-12T02:52:58.629544+0000, chain.objs.size()=1 2024-09-12T01:04:40.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.078+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.O1LznaduhX-O6BvCLXX6Mgc6O-sNriH_0 2024-09-12T01:04:40.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.078+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9859462553695169553', time=2024-09-12T02:52:58.644335+0000, chain.objs.size()=1 2024-09-12T01:04:40.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.078+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_._Bf43u-HzUfWhVd0CaNJjLMjlkuSqru_0 2024-09-12T01:04:40.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.078+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13016688621258001239', time=2024-09-12T02:52:58.652201+0000, chain.objs.size()=1 2024-09-12T01:04:40.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.078+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.3250hMQwaTRo73VrbBgDh9heUIDHAi2_0 2024-09-12T01:04:40.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.078+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18329072295338083098', time=2024-09-12T02:52:58.660667+0000, chain.objs.size()=1 2024-09-12T01:04:40.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.078+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.BUkggfSzK3LCffjHnqZKoqsDfxKQYI7_0 2024-09-12T01:04:40.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.078+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5625790384135198501', time=2024-09-12T02:52:58.675703+0000, chain.objs.size()=1 2024-09-12T01:04:40.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.078+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.fD73NVP4ket-_XWW-LYBpQwaCk-igfa_0 2024-09-12T01:04:40.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.078+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14225420572925486692', time=2024-09-12T02:52:58.676802+0000, chain.objs.size()=1 2024-09-12T01:04:40.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.078+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.CYt2opo6NFIwwdiObLKU5M0uq5Ye_es_0 2024-09-12T01:04:40.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.078+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5522712939385439851', time=2024-09-12T02:53:04.376283+0000, chain.objs.size()=1 2024-09-12T01:04:40.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.078+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.333__shadow_.WvF-1FfaJnpw8oZYDrIvgXvokHaKZpt_0 2024-09-12T01:04:40.081 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.078+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4398679116412100589', time=2024-09-12T02:53:32.738158+0000, chain.objs.size()=1 2024-09-12T01:04:40.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.078+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.376__shadow_.Q2uWcHBIGS5ae3vZagXoXBHusXmc1P4_0 2024-09-12T01:04:40.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.082+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14214255337962070465', time=2024-09-12T02:53:58.726034+0000, chain.objs.size()=1 2024-09-12T01:04:40.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.082+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.410__shadow_.QpZuUxq40U5rq-I4x3-j0HBHHvE7zZI_0 2024-09-12T01:04:40.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.082+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8118877987642057811', time=2024-09-12T02:54:16.399916+0000, chain.objs.size()=1 2024-09-12T01:04:40.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.082+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.434__shadow_.m5ZBS39X6ijcMrlbTmEoEt2lTrZCJa2_0 2024-09-12T01:04:40.082 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.082+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48228 2024-09-12T01:04:40.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T01:04:40.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4059500206173941217', time=2024-09-12T02:54:22.584988+0000, chain.objs.size()=1 2024-09-12T01:04:40.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.442__shadow_.C7MU0frrJytAeJAfep3AqKadrFtNWoG_0 2024-09-12T01:04:40.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17077402184515475564', time=2024-09-12T02:54:44.397407+0000, chain.objs.size()=1 2024-09-12T01:04:40.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.466__shadow_.3_O6TMqewrDx5DxHLEMLvbdyV63ANpn_0 2024-09-12T01:04:40.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8933821305885988636', time=2024-09-12T02:54:44.702478+0000, chain.objs.size()=1 2024-09-12T01:04:40.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.466__shadow_.4RJah_hiSBi_CNb_mX21tfmI682vZgA_0 2024-09-12T01:04:40.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15697057035579398721', time=2024-09-12T02:54:56.570205+0000, chain.objs.size()=1 2024-09-12T01:04:40.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.487__shadow_.bHuG0nBY4FrDUPswqJnB29YL6BHA3Uc_0 2024-09-12T01:04:40.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5667838831705108618', time=2024-09-12T02:54:58.627324+0000, chain.objs.size()=1 2024-09-12T01:04:40.085 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.490__shadow_.KwSv2NOKs1eQPc56Kc4Zro3BsoYnfsk_0 2024-09-12T01:04:40.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5667838831705108618', time=2024-09-12T02:54:58.840923+0000, chain.objs.size()=1 2024-09-12T01:04:40.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.490__shadow_.KwSv2NOKs1eQPc56Kc4Zro3BsoYnfsk_0 2024-09-12T01:04:40.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12369839223785093699', time=2024-09-12T02:55:01.601406+0000, chain.objs.size()=1 2024-09-12T01:04:40.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.495__shadow_.rfycehjQ2ck_GhOGeaVpCaIJw6GJxrw_0 2024-09-12T01:04:40.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16962989669728958376', time=2024-09-12T02:55:37.871772+0000, chain.objs.size()=6 2024-09-12T01:04:40.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.2~BVvjgTPwwu79sf3aGG53H_RasFk_4yx.1 2024-09-12T01:04:40.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.2~BVvjgTPwwu79sf3aGG53H_RasFk_4yx.2 2024-09-12T01:04:40.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.dTX-HaZhFWVeLVv81IFm71x9HFde6hSi.3 2024-09-12T01:04:40.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.2~BVvjgTPwwu79sf3aGG53H_RasFk_4yx.4 2024-09-12T01:04:40.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.2~BVvjgTPwwu79sf3aGG53H_RasFk_4yx.5 2024-09-12T01:04:40.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.522__multipart_mymultipart.2~BVvjgTPwwu79sf3aGG53H_RasFk_4yx.6 2024-09-12T01:04:40.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13186479013699484035', time=2024-09-12T02:55:50.050400+0000, chain.objs.size()=2 2024-09-12T01:04:40.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.525__multipart_mymultipart.2~TvLRk0TtiNYj7SGbtJes020JyquxJX8.1 2024-09-12T01:04:40.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.525__multipart_mymultipart.2~TvLRk0TtiNYj7SGbtJes020JyquxJX8.2 2024-09-12T01:04:40.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6934915520951049005', time=2024-09-12T02:56:16.025191+0000, chain.objs.size()=7 2024-09-12T01:04:40.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.535__multipart_mymultipart.2~DH3quvM8M2mIO-NwzMC3i8G9sEijrFb.1 2024-09-12T01:04:40.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.535__shadow_mymultipart.2~DH3quvM8M2mIO-NwzMC3i8G9sEijrFb.1_1 2024-09-12T01:04:40.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.535__multipart_mymultipart.2~DH3quvM8M2mIO-NwzMC3i8G9sEijrFb.2 2024-09-12T01:04:40.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.535__shadow_mymultipart.2~DH3quvM8M2mIO-NwzMC3i8G9sEijrFb.2_1 2024-09-12T01:04:40.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.535__multipart_mymultipart.UoalsFp6weW6X8BRZ2o8EIFaxE-phkrF.3 2024-09-12T01:04:40.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.535__shadow_mymultipart.UoalsFp6weW6X8BRZ2o8EIFaxE-phkrF.3_1 2024-09-12T01:04:40.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.535__multipart_mymultipart.2~DH3quvM8M2mIO-NwzMC3i8G9sEijrFb.4 2024-09-12T01:04:40.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6635267294391527242', time=2024-09-12T02:56:19.305641+0000, chain.objs.size()=1 2024-09-12T01:04:40.088 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.537__shadow_.bHq3Q9Ut4OcX400zs4FRJxdkDlwRyMh_0 2024-09-12T01:04:40.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8465734656532756522', time=2024-09-12T02:57:16.475893+0000, chain.objs.size()=1 2024-09-12T01:04:40.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.086+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.574__shadow:NC5nQPqikODohlMCIqyVAXZ0HacWpvK_.9j5SUcnx4Xf8SRxxa65KQic4sImi_sm_0 2024-09-12T01:04:40.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.090+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8375942240148687135', time=2024-09-12T03:00:45.419829+0000, chain.objs.size()=1 2024-09-12T01:04:40.089 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.090+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.641__shadow_.oFWXTiGI-517UuJpW3Bt9T4CaUcKJZj_0 2024-09-12T01:04:40.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.090+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9785049904191277314', time=2024-09-12T03:01:16.237343+0000, chain.objs.size()=1 2024-09-12T01:04:40.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.090+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.679__shadow_.itSFEdzwtNuO0bkIevN9aBJ8bI_T6dt_0 2024-09-12T01:04:40.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.090+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17190516127252984152', time=2024-09-12T03:01:50.053279+0000, chain.objs.size()=1 2024-09-12T01:04:40.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.090+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.715__shadow:6PGVvuiqeseDOpRrqIGpdEVSevfWmeJ_.6yF8GIm1fw1LdAihhtzqTvpw8-j6AGN_0 2024-09-12T01:04:40.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.090+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.188620219732161019', time=2024-09-12T03:04:26.401401+0000, chain.objs.size()=1 2024-09-12T01:04:40.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.090+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.782__shadow_.iKHx6vjMAykf9dS99FlQOqX_0u9lC0t_0 2024-09-12T01:04:40.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.090+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:40.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.094+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:04:40.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.094+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:40.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.094+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:40.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.094+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44216' 2024-09-12T01:04:40.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.094+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8668375485813322859', time=2024-09-12T02:48:29.146141+0000, chain.objs.size()=3 2024-09-12T01:04:40.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.094+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.158__shadow_.iOZ9Jiv9lOqGs3hzHYcfGLKwHVXmtm5_0 2024-09-12T01:04:40.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.094+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.158__shadow_.iOZ9Jiv9lOqGs3hzHYcfGLKwHVXmtm5_1 2024-09-12T01:04:40.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.094+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.158__shadow_.iOZ9Jiv9lOqGs3hzHYcfGLKwHVXmtm5_2 2024-09-12T01:04:40.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.094+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14260403099754453953', time=2024-09-12T02:50:46.419797+0000, chain.objs.size()=1 2024-09-12T01:04:40.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.094+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.236__shadow_.txW_xwzof8yUYL1wS4gn55541xDYIY9_0 2024-09-12T01:04:40.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.094+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3660677470908192784', time=2024-09-12T02:50:47.635653+0000, chain.objs.size()=1 2024-09-12T01:04:40.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.094+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.237__shadow_.JPRfAL_I8IxfOoV7t9JXX3YCiMnp11e_0 2024-09-12T01:04:40.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.094+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17487032280236632327', time=2024-09-12T02:50:54.944551+0000, chain.objs.size()=1 2024-09-12T01:04:40.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.094+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.245__shadow_.y2Zy1InUjFPgP-GfbEScOqpuKV4-nAM_0 2024-09-12T01:04:40.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.094+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9191666881334982915', time=2024-09-12T02:50:58.898858+0000, chain.objs.size()=1 2024-09-12T01:04:40.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.094+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.250__shadow_.JD-PuCG50AiLwPg_wlxGJVNOCgC_4B8_0 2024-09-12T01:04:40.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.094+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6674686514206652339', time=2024-09-12T02:50:59.604875+0000, chain.objs.size()=1 2024-09-12T01:04:40.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.094+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.251__shadow_.ukiBDmEvyx8sZELonluaOz8i4Tpzhao_0 2024-09-12T01:04:40.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.094+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7298039948159324394', time=2024-09-12T02:51:02.579129+0000, chain.objs.size()=1 2024-09-12T01:04:40.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.094+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.255__shadow_.HLU4fw3Ffnmo-WYijoIaEzzUuxYcM3-_0 2024-09-12T01:04:40.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.094+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.66852749971214446', time=2024-09-12T02:51:04.048617+0000, chain.objs.size()=1 2024-09-12T01:04:40.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.094+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.257__shadow_.aRl8clXy3lE7Rwa9JE9WCH9xPfb7XQU_0 2024-09-12T01:04:40.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.094+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5099173717306894359', time=2024-09-12T02:51:07.015693+0000, chain.objs.size()=1 2024-09-12T01:04:40.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.094+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.261__shadow_.xTv93x0XZSmG_AlpbR5bvJ6Rd245_yF_0 2024-09-12T01:04:40.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.094+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14970184602866291715', time=2024-09-12T02:51:26.812228+0000, chain.objs.size()=1 2024-09-12T01:04:40.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.094+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.a0pJZkkmqlunfd6rTlMhDuEN6pbVNFJ_0 2024-09-12T01:04:40.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.098+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11392429389447536841', time=2024-09-12T02:51:26.837622+0000, chain.objs.size()=1 2024-09-12T01:04:40.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.098+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Pa2xJdsN9z9GsAhDvj_jVj3Jq7VHmfi_0 2024-09-12T01:04:40.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.098+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13135381561865212812', time=2024-09-12T02:51:26.889571+0000, chain.objs.size()=1 2024-09-12T01:04:40.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.098+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.DLimV0gOVLjI89uDJbynu25eaDPHcFX_0 2024-09-12T01:04:40.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.098+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9984830771825886952', time=2024-09-12T02:51:26.891472+0000, chain.objs.size()=1 2024-09-12T01:04:40.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.098+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.0HK25ZjgGWFvDXm8Fa7XYvBJCtEoh2z_0 2024-09-12T01:04:40.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3000155204340233310', time=2024-09-12T02:51:26.989243+0000, chain.objs.size()=1 2024-09-12T01:04:40.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.rw98Al_DC4ifWKCw8YzhLuGPh6NAbBt_0 2024-09-12T01:04:40.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7059026463466485800', time=2024-09-12T02:51:27.039642+0000, chain.objs.size()=1 2024-09-12T01:04:40.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.u5VYp10GabuN90oJbKV8OhMBSG1D0mj_0 2024-09-12T01:04:40.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7066256816169614413', time=2024-09-12T02:51:27.072198+0000, chain.objs.size()=1 2024-09-12T01:04:40.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.1XISqlYNGoeilF8oC2V38C98M0842mX_0 2024-09-12T01:04:40.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3874221220119308239', time=2024-09-12T02:51:27.079913+0000, chain.objs.size()=1 2024-09-12T01:04:40.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.jwy0DN1BwWDXJYSLI4ds5Y5vCb92SEi_0 2024-09-12T01:04:40.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9918872485858403766', time=2024-09-12T02:51:27.200089+0000, chain.objs.size()=1 2024-09-12T01:04:40.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.-4DnPi2mYh_9mZGM6m15ae1ExXGlSZp_0 2024-09-12T01:04:40.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8219564626579858472', time=2024-09-12T02:51:27.260935+0000, chain.objs.size()=1 2024-09-12T01:04:40.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.CQc4-tkypXP-zRHYDQsMabGk-GgnDbP_0 2024-09-12T01:04:40.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8029199092426934910', time=2024-09-12T02:51:27.279192+0000, chain.objs.size()=1 2024-09-12T01:04:40.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.zoVCPdo6J88N-jWn5Cyb_S6ALJRMcvM_0 2024-09-12T01:04:40.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3961573485425993797', time=2024-09-12T02:51:27.296134+0000, chain.objs.size()=1 2024-09-12T01:04:40.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.0GVF--7NEjL1C4bRD6_cnEASfIHMATs_0 2024-09-12T01:04:40.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.610511413455448968', time=2024-09-12T02:51:27.305225+0000, chain.objs.size()=1 2024-09-12T01:04:40.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.DhdgLehZSZdjRzcz6_L_GztX3QI6aIt_0 2024-09-12T01:04:40.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4581538221646142411', time=2024-09-12T02:51:27.455718+0000, chain.objs.size()=1 2024-09-12T01:04:40.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.lsbgWZpB-F1QAWbZu8JPG3O1o6QyX74_0 2024-09-12T01:04:40.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12457374726715448741', time=2024-09-12T02:51:27.460692+0000, chain.objs.size()=1 2024-09-12T01:04:40.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.SqPAZ5NW6r6m3X2REl2hmKyvaRVLH_H_0 2024-09-12T01:04:40.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9931480946353842220', time=2024-09-12T02:51:27.484721+0000, chain.objs.size()=1 2024-09-12T01:04:40.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.xnv7H6M4x83Qw9u5Bh7Xz7VGInqe5bS_0 2024-09-12T01:04:40.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6483063206218343077', time=2024-09-12T02:51:27.489717+0000, chain.objs.size()=1 2024-09-12T01:04:40.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.t7D18DLsisG9R8tzdYQDrpph8glHTgl_0 2024-09-12T01:04:40.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.102+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17889868423264232772', time=2024-09-12T02:51:27.522823+0000, chain.objs.size()=1 2024-09-12T01:04:40.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.102+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.pQeX0sXR7T2G-we30zmyE0Abz4Ny1IQ_0 2024-09-12T01:04:40.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.106+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15706896051572974426', time=2024-09-12T02:51:27.636363+0000, chain.objs.size()=1 2024-09-12T01:04:40.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.106+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.DJLp1YQM2wZcJHZltGiqqhzHnvlezaN_0 2024-09-12T01:04:40.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.106+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12063569113005812243', time=2024-09-12T02:51:27.662659+0000, chain.objs.size()=1 2024-09-12T01:04:40.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.106+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.VoLi3YaTlyFPYhcMVCyPMTJOSTQHQhT_0 2024-09-12T01:04:40.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.106+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11331854290110951647', time=2024-09-12T02:51:27.686040+0000, chain.objs.size()=1 2024-09-12T01:04:40.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.106+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.iutwQFzu_vh3WZL9K_JOTqyc7HsN4xP_0 2024-09-12T01:04:40.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.106+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7696704970991804507', time=2024-09-12T02:51:27.727266+0000, chain.objs.size()=1 2024-09-12T01:04:40.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.106+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.IDEEJbOvpiP5lR__dWUSvIz9lMtQ6r9_0 2024-09-12T01:04:40.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.106+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10360943919582313958', time=2024-09-12T02:51:27.890730+0000, chain.objs.size()=1 2024-09-12T01:04:40.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.106+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.FJMebkfELjmBUIO40UDshw5WU2iDF4m_0 2024-09-12T01:04:40.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.106+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13267029204465900029', time=2024-09-12T02:51:27.930411+0000, chain.objs.size()=1 2024-09-12T01:04:40.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.106+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.0pWmBGBeSngOVxAgjOq5PEnPbcuzyPa_0 2024-09-12T01:04:40.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.106+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16013853802734842359', time=2024-09-12T02:51:27.942293+0000, chain.objs.size()=1 2024-09-12T01:04:40.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.106+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.bkDPJUp3vXEWYN1yv3-Er4L1J6EVRUy_0 2024-09-12T01:04:40.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.106+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.229751607298556604', time=2024-09-12T02:51:28.123859+0000, chain.objs.size()=1 2024-09-12T01:04:40.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.106+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.5rKd32kVHfAmjnrJTMRCmkByi_Nj4-v_0 2024-09-12T01:04:40.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.106+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14105327526447848679', time=2024-09-12T02:51:28.185264+0000, chain.objs.size()=1 2024-09-12T01:04:40.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.106+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.ph37jPQrNqZB3JKsuD-MyW9Y9JOlmS9_0 2024-09-12T01:04:40.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.106+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9194304351196506549', time=2024-09-12T02:51:28.193544+0000, chain.objs.size()=1 2024-09-12T01:04:40.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.106+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.Wg-NkIRVnRscFAGhCs3O3U7M_Icn0BZ_0 2024-09-12T01:04:40.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.106+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.402680586684786937', time=2024-09-12T02:51:28.198719+0000, chain.objs.size()=1 2024-09-12T01:04:40.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.106+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.9tDHHxdwfDiCzBiLfdGKJoYZPuGKuaI_0 2024-09-12T01:04:40.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.106+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4111384903756826769', time=2024-09-12T02:51:28.211160+0000, chain.objs.size()=1 2024-09-12T01:04:40.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.106+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.jZABvQWGTmSnM_e5Pc5zshIzzu00ape_0 2024-09-12T01:04:40.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6492794649619210300', time=2024-09-12T02:51:28.233706+0000, chain.objs.size()=1 2024-09-12T01:04:40.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.X6YfcfeU7VRBQvvfm1Vq7zODk1BTIcn_0 2024-09-12T01:04:40.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15671807191259076870', time=2024-09-12T02:51:28.243596+0000, chain.objs.size()=1 2024-09-12T01:04:40.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.0QCgji9BqmOBjuQt9UnbFmaw2pBsuGk_0 2024-09-12T01:04:40.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4191957851585560010', time=2024-09-12T02:51:28.344462+0000, chain.objs.size()=1 2024-09-12T01:04:40.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.cZv0LFvIOamJb_-zo7bXHMG3XNRYPjw_0 2024-09-12T01:04:40.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16434280085466533687', time=2024-09-12T02:51:28.387403+0000, chain.objs.size()=1 2024-09-12T01:04:40.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.6wSl_TqILHWZ_vx5WslZY26wKIFuFqX_0 2024-09-12T01:04:40.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12680421569161745764', time=2024-09-12T02:51:28.651224+0000, chain.objs.size()=1 2024-09-12T01:04:40.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.262__shadow_.a40TEOYnHFAM4C1ObIPteQd2pYe_IoS_0 2024-09-12T01:04:40.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13134190938221475163', time=2024-09-12T02:51:29.367444+0000, chain.objs.size()=1 2024-09-12T01:04:40.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.263__shadow_.FKzJ4-MFpPMqi1Qy-yd_dH9XZG9v-Zq_0 2024-09-12T01:04:40.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13864937586307072534', time=2024-09-12T02:51:34.367098+0000, chain.objs.size()=1 2024-09-12T01:04:40.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.270__shadow_.JlkLh4M216w-eFwJa9dLDJJgLU4L7Ca_0 2024-09-12T01:04:40.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11881102781309656827', time=2024-09-12T02:51:36.524741+0000, chain.objs.size()=1 2024-09-12T01:04:40.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.273__shadow_.QZohdTwyfoOQb3xsIB_EM5NOx0OcfRf_0 2024-09-12T01:04:40.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9191973202947116094', time=2024-09-12T02:51:51.722254+0000, chain.objs.size()=1 2024-09-12T01:04:40.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.292__shadow_.1Pbc-JNmmYmbIIVc4TkrourEVKazIGy_0 2024-09-12T01:04:40.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.661796466634310171', time=2024-09-12T02:51:53.164643+0000, chain.objs.size()=1 2024-09-12T01:04:40.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.293__shadow_.6SZQpZrp7upgI7npj_iOgs92NQqfaQD_0 2024-09-12T01:04:40.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10638755564811735984', time=2024-09-12T02:52:00.689429+0000, chain.objs.size()=1 2024-09-12T01:04:40.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.303__shadow_.wEHoASQqRWX_zILvXD0zpHiahjCCMrr_0 2024-09-12T01:04:40.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14523509540208509732', time=2024-09-12T02:52:00.692137+0000, chain.objs.size()=1 2024-09-12T01:04:40.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.303__shadow_.4N5nTLgKOrGfeboFgztfOLp4bowPtGt_0 2024-09-12T01:04:40.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.695608259968752275', time=2024-09-12T02:52:14.638965+0000, chain.objs.size()=1 2024-09-12T01:04:40.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.322__shadow_.wae2r4M27c9793DB_t971Wr48HA7dw1_0 2024-09-12T01:04:40.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12300463482906520949', time=2024-09-12T02:52:35.070920+0000, chain.objs.size()=1 2024-09-12T01:04:40.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.Xjars-O_xYq_cIZSEQpcYwBDXuM6ZtW_0 2024-09-12T01:04:40.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11067392070343319801', time=2024-09-12T02:52:35.115973+0000, chain.objs.size()=1 2024-09-12T01:04:40.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.KlqOn36139YCnKqy29rnEoFk8YX5cYo_0 2024-09-12T01:04:40.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8581601750686207754', time=2024-09-12T02:52:35.132791+0000, chain.objs.size()=1 2024-09-12T01:04:40.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ulQtsaW83j1VtAQaoDuzFNdMQQtUUuQ_0 2024-09-12T01:04:40.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.592898677751591619', time=2024-09-12T02:52:35.157660+0000, chain.objs.size()=1 2024-09-12T01:04:40.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.eQ8pnZDQ6bZMdK-1JAGcovvc3XPrjGV_0 2024-09-12T01:04:40.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12706783537394246302', time=2024-09-12T02:52:35.158826+0000, chain.objs.size()=1 2024-09-12T01:04:40.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.32WPW-jemzHhZuHMpor-R5CpI2iXR4r_0 2024-09-12T01:04:40.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16165899132642037593', time=2024-09-12T02:52:35.176756+0000, chain.objs.size()=1 2024-09-12T01:04:40.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.df6HbjJTJEZFQ1dh7GiAxAACLH1l5Si_0 2024-09-12T01:04:40.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.241943579408606173', time=2024-09-12T02:52:35.183167+0000, chain.objs.size()=1 2024-09-12T01:04:40.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.RIYKn6EyPwYa8ff20zYe9nDNCcdrtaS_0 2024-09-12T01:04:40.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16837339972271348102', time=2024-09-12T02:52:35.337093+0000, chain.objs.size()=1 2024-09-12T01:04:40.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.110+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.uuKKH9alhEmxh6RfrDYoKApQSlTfBdb_0 2024-09-12T01:04:40.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.114+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2609316592289166455', time=2024-09-12T02:52:35.358280+0000, chain.objs.size()=1 2024-09-12T01:04:40.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.114+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ULvC4psnCa6kqA3pDLke0_ihMW5nkFQ_0 2024-09-12T01:04:40.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.114+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12145792109987712494', time=2024-09-12T02:52:35.378695+0000, chain.objs.size()=1 2024-09-12T01:04:40.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.114+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.43Mlg-27_OGC-doXETiUhs5dZg_LYNM_0 2024-09-12T01:04:40.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.114+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6849342635864811929', time=2024-09-12T02:52:35.567882+0000, chain.objs.size()=1 2024-09-12T01:04:40.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.114+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.NGot7qfF33W0hwvsflyO67DqYgnqTap_0 2024-09-12T01:04:40.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.114+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2050588896650302073', time=2024-09-12T02:52:35.610643+0000, chain.objs.size()=1 2024-09-12T01:04:40.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.114+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.jd1-MubVeCxBrNmYF9KPPLD4I7R2m0P_0 2024-09-12T01:04:40.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.114+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17267466950492437405', time=2024-09-12T02:52:35.629278+0000, chain.objs.size()=1 2024-09-12T01:04:40.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.114+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.b6xKOMoJ6U1KiGn-KUcbCZqphQ4SC_A_0 2024-09-12T01:04:40.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.114+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9221854645247226414', time=2024-09-12T02:52:35.787329+0000, chain.objs.size()=1 2024-09-12T01:04:40.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.114+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.0ZcWGsrA6x3GLZ9639qJ4sJsQ3Bcty1_0 2024-09-12T01:04:40.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.114+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3975718772408215742', time=2024-09-12T02:52:35.799482+0000, chain.objs.size()=1 2024-09-12T01:04:40.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.114+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.euN8etMubgklGRqZftPojuHmJRT1h9P_0 2024-09-12T01:04:40.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.114+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14602940475213759432', time=2024-09-12T02:52:35.844099+0000, chain.objs.size()=1 2024-09-12T01:04:40.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.114+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.OFP3fQ9yt0Ox75gXLLAcoSgtzHCLfy8_0 2024-09-12T01:04:40.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.114+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3666602699538430694', time=2024-09-12T02:52:35.852102+0000, chain.objs.size()=1 2024-09-12T01:04:40.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.114+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.RipZ6YapK0D0VA-cYZwtsQV6mHPvZAO_0 2024-09-12T01:04:40.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.114+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8831593612033029333', time=2024-09-12T02:52:35.855516+0000, chain.objs.size()=1 2024-09-12T01:04:40.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.114+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.qQeZ1suZlzjDfngNgmolH4aV_cS4gC7_0 2024-09-12T01:04:40.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.114+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6902299599751451682', time=2024-09-12T02:52:35.865706+0000, chain.objs.size()=1 2024-09-12T01:04:40.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.114+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.FNM0IRDBUr9-RNeQAgpuzwZIBmCuFv__0 2024-09-12T01:04:40.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.114+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9141062714649800310', time=2024-09-12T02:52:35.882911+0000, chain.objs.size()=1 2024-09-12T01:04:40.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.114+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.dYazVTUZ5RCRKazxTl7nVn6-OWaKWLs_0 2024-09-12T01:04:40.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.114+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2310752065325810665', time=2024-09-12T02:52:36.290045+0000, chain.objs.size()=1 2024-09-12T01:04:40.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.114+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.RajjYDC4tlZDRf2BWJwBV2JUVtOcVN7_0 2024-09-12T01:04:40.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.114+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12696868446197106266', time=2024-09-12T02:52:36.312742+0000, chain.objs.size()=1 2024-09-12T01:04:40.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.114+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.on4BglrIHV9-FPhrz8jWRTLETCE9zlR_0 2024-09-12T01:04:40.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11912364344840977969', time=2024-09-12T02:52:36.338199+0000, chain.objs.size()=1 2024-09-12T01:04:40.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.xDVu9EHK01fb0AoU52qgC2lGwH5Xf92_0 2024-09-12T01:04:40.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8085576876357890884', time=2024-09-12T02:52:36.348077+0000, chain.objs.size()=1 2024-09-12T01:04:40.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.lxOK64o2aKPOppL8-xITcux10mEowHw_0 2024-09-12T01:04:40.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7214131618591814343', time=2024-09-12T02:52:36.556489+0000, chain.objs.size()=1 2024-09-12T01:04:40.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.ph-TezaY5MVamRlEeR4wIRsNM-iIWtD_0 2024-09-12T01:04:40.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7995966327492185161', time=2024-09-12T02:52:36.576290+0000, chain.objs.size()=1 2024-09-12T01:04:40.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_._aqnxYz0CR-1agvk5wyJFwr7yS1GZdL_0 2024-09-12T01:04:40.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17435124610841401034', time=2024-09-12T02:52:36.748849+0000, chain.objs.size()=1 2024-09-12T01:04:40.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.o421-K84i5AaIzlVFhMYUVh-RCkmCwA_0 2024-09-12T01:04:40.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12951733651797227783', time=2024-09-12T02:52:36.859326+0000, chain.objs.size()=1 2024-09-12T01:04:40.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.7P7T8D_79Z3ZSpWRDiJ__h4kCEhmLBc_0 2024-09-12T01:04:40.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13842587614928643193', time=2024-09-12T02:52:36.872991+0000, chain.objs.size()=1 2024-09-12T01:04:40.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.P92PS1GBoy-50DaLGelKZAr041ZArNa_0 2024-09-12T01:04:40.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13133307233195013433', time=2024-09-12T02:52:37.037758+0000, chain.objs.size()=1 2024-09-12T01:04:40.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.1nHzsfW6JovxBVXCqkRqnN4TV7Co98w_0 2024-09-12T01:04:40.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8235453174972409892', time=2024-09-12T02:52:37.058024+0000, chain.objs.size()=1 2024-09-12T01:04:40.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.323__shadow_.M5tXOQ4ai7s7nF4vgstUL0FulNuXzJN_0 2024-09-12T01:04:40.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3665875807142564283', time=2024-09-12T02:52:56.903790+0000, chain.objs.size()=1 2024-09-12T01:04:40.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ivp8eDMV3aVnzjSBLkmJZGjP1NXUyvC_0 2024-09-12T01:04:40.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1645137793860926340', time=2024-09-12T02:52:56.944907+0000, chain.objs.size()=1 2024-09-12T01:04:40.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.FlEgvm9WS6xi92WcBCeRZHbIKFjKx1L_0 2024-09-12T01:04:40.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7109135038587093265', time=2024-09-12T02:52:56.949633+0000, chain.objs.size()=1 2024-09-12T01:04:40.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.4WEzKlk-N4tJkXZeMRbNRMzFYOTLJQH_0 2024-09-12T01:04:40.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15231031711781123071', time=2024-09-12T02:52:57.021622+0000, chain.objs.size()=1 2024-09-12T01:04:40.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.NrHHU1Ex00JuGZ_ZdFdy5uHxC_zj0Pq_0 2024-09-12T01:04:40.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10560641867929415554', time=2024-09-12T02:52:57.047311+0000, chain.objs.size()=1 2024-09-12T01:04:40.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.wyGNL3QUiJ14LEeJI9IJJtA8sZ5GhNT_0 2024-09-12T01:04:40.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14881751537089051734', time=2024-09-12T02:52:57.206020+0000, chain.objs.size()=1 2024-09-12T01:04:40.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.m8tPO9-NZLqWp3PvpOewYgQVPt3OAY1_0 2024-09-12T01:04:40.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4888280984390160062', time=2024-09-12T02:52:57.247947+0000, chain.objs.size()=1 2024-09-12T01:04:40.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.XbkGluPBFWwbX53vrJthYISk35KEz7u_0 2024-09-12T01:04:40.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.14013287858214602994', time=2024-09-12T02:52:57.261271+0000, chain.objs.size()=1 2024-09-12T01:04:40.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.118+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_._gbPDFaT25KEjxHKYBlV1fk0R230L4r_0 2024-09-12T01:04:40.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.122+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3265927135241723467', time=2024-09-12T02:52:57.287554+0000, chain.objs.size()=1 2024-09-12T01:04:40.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.122+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.oEYFCe-6lySyd4kS3N-ZEPsqcuyi85o_0 2024-09-12T01:04:40.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.122+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.15114519809141620447', time=2024-09-12T02:52:57.527040+0000, chain.objs.size()=1 2024-09-12T01:04:40.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.122+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.SQiGX5ykypWChXOqUIURBrm1k62BoKf_0 2024-09-12T01:04:40.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.122+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5913954654451572042', time=2024-09-12T02:52:57.629041+0000, chain.objs.size()=1 2024-09-12T01:04:40.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.122+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.gAKuKvGJ_qjdcei1EmOhbr5zjHw8iGD_0 2024-09-12T01:04:40.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.122+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8910557946729819393', time=2024-09-12T02:52:57.629933+0000, chain.objs.size()=1 2024-09-12T01:04:40.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.122+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_._ANg1M3kciKuUVXMdQBzcDh8hW2SvVL_0 2024-09-12T01:04:40.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.122+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18233371538267321387', time=2024-09-12T02:52:57.630615+0000, chain.objs.size()=1 2024-09-12T01:04:40.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.122+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.DqcLSScwL6Y2LIGwqsXY8VdmzR2XNuP_0 2024-09-12T01:04:40.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.122+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1912008946491856754', time=2024-09-12T02:52:57.683021+0000, chain.objs.size()=1 2024-09-12T01:04:40.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.122+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ODQsXnKm6puUKN8yOfVz8sTtgtt8ISC_0 2024-09-12T01:04:40.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.122+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10136429063006248923', time=2024-09-12T02:52:57.690435+0000, chain.objs.size()=1 2024-09-12T01:04:40.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.122+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.4jMh4FboQKK4U7gdbrs5e7jJClTpCwM_0 2024-09-12T01:04:40.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.122+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8997645631390693539', time=2024-09-12T02:52:57.718086+0000, chain.objs.size()=1 2024-09-12T01:04:40.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.122+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.6dGLN0HfTrfmXWIpcATdJcc6XLbGJ6r_0 2024-09-12T01:04:40.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.122+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4367714859286010932', time=2024-09-12T02:52:57.725367+0000, chain.objs.size()=1 2024-09-12T01:04:40.123 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.122+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Xr_ESAKPMx_5pxVnADgSMSOJT4UzRX8_0 2024-09-12T01:04:40.125 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.126+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44216 2024-09-12T01:04:40.127 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.126+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=34, truncated=0, next_marker='' 2024-09-12T01:04:40.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.126+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17432483625521635839', time=2024-09-12T02:52:57.726346+0000, chain.objs.size()=1 2024-09-12T01:04:40.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.126+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.eHZAmgf8DCWQjW4gfkXxcZup4eWZg4S_0 2024-09-12T01:04:40.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.126+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8144032132899692623', time=2024-09-12T02:52:57.735128+0000, chain.objs.size()=1 2024-09-12T01:04:40.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.126+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.qkK-Fka6bLEizKpTr9ILhoua658SSTW_0 2024-09-12T01:04:40.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.126+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7196685863933180462', time=2024-09-12T02:52:57.934934+0000, chain.objs.size()=1 2024-09-12T01:04:40.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.126+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.P0hcE-L8knrXNlOyg24hLQAD3-iKdpP_0 2024-09-12T01:04:40.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.126+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12333908983531162590', time=2024-09-12T02:52:58.135588+0000, chain.objs.size()=1 2024-09-12T01:04:40.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.126+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.UU3x4757A9W0YMen61qdOjOTwZI3vWM_0 2024-09-12T01:04:40.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.126+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.2035170257864408366', time=2024-09-12T02:52:58.183351+0000, chain.objs.size()=1 2024-09-12T01:04:40.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.126+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.M6SsVBVWzZq6gu4WKaZJuf6uRGb9iuk_0 2024-09-12T01:04:40.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.126+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.11824537269331600952', time=2024-09-12T02:52:58.195670+0000, chain.objs.size()=1 2024-09-12T01:04:40.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.126+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.RI-ZoH8yPpehGlvHyOa2qiWm3v80a_x_0 2024-09-12T01:04:40.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.126+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.17564105010634301031', time=2024-09-12T02:52:58.211414+0000, chain.objs.size()=1 2024-09-12T01:04:40.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.126+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.Mm28oahqEauY_WLhI07PCbMGWk82suU_0 2024-09-12T01:04:40.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.126+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10140321652392598349', time=2024-09-12T02:52:58.243957+0000, chain.objs.size()=1 2024-09-12T01:04:40.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.126+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.t632GwiktxT6du9Q1KBXCe56dLz11I4_0 2024-09-12T01:04:40.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.126+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1012987637554610260', time=2024-09-12T02:52:58.363703+0000, chain.objs.size()=1 2024-09-12T01:04:40.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.126+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.nKU1diPxPUWhJEU9Usao_CkgSU5OrqC_0 2024-09-12T01:04:40.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.126+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9359649784922587913', time=2024-09-12T02:52:58.365392+0000, chain.objs.size()=1 2024-09-12T01:04:40.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.126+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.nhKDgArfbB4gtnTPMOLeGWETdkTlp4j_0 2024-09-12T01:04:40.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.126+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.18217546186518100851', time=2024-09-12T02:52:58.438914+0000, chain.objs.size()=1 2024-09-12T01:04:40.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.126+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.IVUCQLBJdQexdcSQ_TMrol5m-SogC92_0 2024-09-12T01:04:40.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.126+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12614017646785241930', time=2024-09-12T02:52:58.444667+0000, chain.objs.size()=1 2024-09-12T01:04:40.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.126+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.BdAdH7211812qvM7_p4fVsNDf5ZB5fE_0 2024-09-12T01:04:40.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.130+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.12355659183803040855', time=2024-09-12T02:52:58.456426+0000, chain.objs.size()=1 2024-09-12T01:04:40.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.130+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.wXuJaIaCIIrAaAjwIR-DkFrUjNlwG18_0 2024-09-12T01:04:40.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.130+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.773322687124315974', time=2024-09-12T02:52:58.458082+0000, chain.objs.size()=1 2024-09-12T01:04:40.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.130+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.HxPH5L4ucEmDYtKZzy-36DN4TvvzVZ9_0 2024-09-12T01:04:40.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.130+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5613676482256617294', time=2024-09-12T02:52:58.460353+0000, chain.objs.size()=1 2024-09-12T01:04:40.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.130+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.YlD6gAk5HWqX1pcU06WpEw1bp5PqW5i_0 2024-09-12T01:04:40.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.130+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5071400620084158938', time=2024-09-12T02:52:58.501739+0000, chain.objs.size()=1 2024-09-12T01:04:40.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.130+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.bfiVBTvjv21p73z4CVjNBNZmHvXxUhM_0 2024-09-12T01:04:40.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.130+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16916300894589935151', time=2024-09-12T02:52:58.647176+0000, chain.objs.size()=1 2024-09-12T01:04:40.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.130+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.NTcDPX5lrziSv-4aahHW3GI9PVlz37l_0 2024-09-12T01:04:40.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.130+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9701369579041896791', time=2024-09-12T02:52:58.652492+0000, chain.objs.size()=1 2024-09-12T01:04:40.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.130+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.bNVm8OJvoobVREeTNKS9HOfOV5aN2-l_0 2024-09-12T01:04:40.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.130+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6933514523867934570', time=2024-09-12T02:52:58.658763+0000, chain.objs.size()=1 2024-09-12T01:04:40.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.130+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.ZFLs05orxa4ZM4K5nkCmtO8iFDDZK8c_0 2024-09-12T01:04:40.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.130+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.8758883049913298006', time=2024-09-12T02:52:58.659739+0000, chain.objs.size()=1 2024-09-12T01:04:40.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.130+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.324__shadow_.X-hagQwcbDgF9BvAc6xlMtjjz9zkbNO_0 2024-09-12T01:04:40.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.130+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.674121781342504222', time=2024-09-12T02:53:03.717608+0000, chain.objs.size()=1 2024-09-12T01:04:40.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.130+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.332__shadow_.IiWPmJCaJibUEq6Ts4P489Sr8BLFORc_0 2024-09-12T01:04:40.133 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.130+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6310218056659796052', time=2024-09-12T02:53:35.001643+0000, chain.objs.size()=1 2024-09-12T01:04:40.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.130+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.379__shadow_.ojRJ2xhDyPH73RLZjLae2uORYDnOk3L_0 2024-09-12T01:04:40.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.130+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.1209956836533433457', time=2024-09-12T02:54:36.630965+0000, chain.objs.size()=1 2024-09-12T01:04:40.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.130+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.458__shadow_.-I0pJgGXrAlW-_tDoIkF1r0xaD60VVm_0 2024-09-12T01:04:40.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.130+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6184054327051220727', time=2024-09-12T02:54:54.113210+0000, chain.objs.size()=1 2024-09-12T01:04:40.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.130+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.484__shadow_.NYMnUP0d-kfB3Ox3FX6nQtlvK4sDJ1J_0 2024-09-12T01:04:40.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.130+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.4561037791475461515', time=2024-09-12T02:56:45.914689+0000, chain.objs.size()=1 2024-09-12T01:04:40.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.130+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.556__shadow_.vQa0xN9pD9fEVSySAUxhT2WOUcT5QnN_0 2024-09-12T01:04:40.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.134+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.5484974458652455587', time=2024-09-12T02:57:12.158204+0000, chain.objs.size()=1 2024-09-12T01:04:40.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.134+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.572__shadow:sia4CKKBQ2l4XhQglBz6hNIglm1OlSP_.4xfX4LTrQ961ukAypT5v2grC9tqZEw0_0 2024-09-12T01:04:40.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.134+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6421221794584537443', time=2024-09-12T02:57:16.750963+0000, chain.objs.size()=1 2024-09-12T01:04:40.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.134+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.574__shadow:3Q-6Rc5MGD2J00-UfMwkXwO-Z4rwvjA_.uNe5LQwuR88fRyIbnKEiaGq_7X6bbuI_0 2024-09-12T01:04:40.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.134+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.10594131334330831464', time=2024-09-12T02:57:19.943226+0000, chain.objs.size()=1 2024-09-12T01:04:40.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.134+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.576__shadow:IFqWE5gaUKQ9ow.M4k36GoayuoSMZ2g_.hX2hISgn46yQLnLjOnXutliJGnPKcKQ_0 2024-09-12T01:04:40.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.134+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.6879468032068899402', time=2024-09-12T02:57:44.644438+0000, chain.objs.size()=1 2024-09-12T01:04:40.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.134+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.579__shadow:-LZS-dqxLlZkJEiU6RmzNKk3nYxUBYI_.7zorXrEgMOXFGmIoKegWwiGr-Emmk6G_0 2024-09-12T01:04:40.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.134+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.16009274829253654655', time=2024-09-12T02:57:47.120599+0000, chain.objs.size()=1 2024-09-12T01:04:40.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.134+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.582__shadow:gx02ZFgZnw1isB.kIuGvuxF6q2Q582p_.BKfnjfsyMyHtq1ZNj7mSfgYHxJilu6f_0 2024-09-12T01:04:40.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.134+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.9797610894189202203', time=2024-09-12T03:01:05.475930+0000, chain.objs.size()=1 2024-09-12T01:04:40.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.134+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.663__shadow_.z6PyfA6nsALXp5aufwUwgIk9enXgTho_0 2024-09-12T01:04:40.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.134+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.7470828940581008663', time=2024-09-12T03:01:08.430709+0000, chain.objs.size()=1 2024-09-12T01:04:40.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.134+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.666__shadow_.6-zxdYENFcpu59uvH71LcAJ5L09XfCY_0 2024-09-12T01:04:40.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.134+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.13659650143108053688', time=2024-09-12T03:01:22.733548+0000, chain.objs.size()=1 2024-09-12T01:04:40.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.134+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.690__shadow:43jhYG5-94x.GqpSI5ONU-MN3MfKJcC_.jPh1CLSXBYnWLoRruCQG3mCwEbt53A-_0 2024-09-12T01:04:40.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.134+0000 7f8b0d7919c0 20 garbage collection: RGWGC::process iterating over entry tag='af15766d-a760-4e2f-9cfc-808f2566cb70.4547.3940278714165218666', time=2024-09-12T03:01:34.173594+0000, chain.objs.size()=1 2024-09-12T01:04:40.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.134+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:af15766d-a760-4e2f-9cfc-808f2566cb70.4547.706__shadow_.fDtddt-SNsXueDNsZvk315cHgWnmpZO_0 2024-09-12T01:04:40.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.138+0000 7f8b0d7919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:40.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.142+0000 7f89c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:40.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.142+0000 7f8b0d7919c0 20 remove_watcher() i=0 2024-09-12T01:04:40.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.142+0000 7f8b0d7919c0 2 removed watcher, disabling cache 2024-09-12T01:04:40.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.142+0000 7f8b0d7919c0 20 remove_watcher() i=1 2024-09-12T01:04:40.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.146+0000 7f8b0d7919c0 20 remove_watcher() i=2 2024-09-12T01:04:40.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.146+0000 7f8b0d7919c0 20 remove_watcher() i=3 2024-09-12T01:04:40.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.146+0000 7f8b0d7919c0 20 remove_watcher() i=4 2024-09-12T01:04:40.148 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.146+0000 7f8b0d7919c0 20 remove_watcher() i=5 2024-09-12T01:04:40.149 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.150+0000 7f8b0d7919c0 20 remove_watcher() i=6 2024-09-12T01:04:40.150 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:40.150+0000 7f8b0d7919c0 20 remove_watcher() i=7 2024-09-12T01:04:40.162 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-12T01:04:40.174 DEBUG:teuthology.orchestra.run.smithi043:> rm -f /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/root.key 2024-09-12T01:04:40.208 DEBUG:teuthology.orchestra.run.smithi043:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-12T01:04:40.257 DEBUG:teuthology.orchestra.run.smithi043:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.crt /home/ubuntu/cephtest/ca/rgw.client.0.key 2024-09-12T01:04:40.308 DEBUG:teuthology.orchestra.run.smithi043:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-12T01:04:40.357 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm /usr/local/share/ca-certificates/root.crt 2024-09-12T01:04:40.412 DEBUG:teuthology.orchestra.run.smithi043:> sudo update-ca-certificates 2024-09-12T01:04:40.468 INFO:teuthology.orchestra.run.smithi043.stdout:Updating certificates in /etc/ssl/certs... 2024-09-12T01:04:40.833 INFO:teuthology.orchestra.run.smithi043.stdout:0 added, 0 removed; done. 2024-09-12T01:04:40.834 INFO:teuthology.orchestra.run.smithi043.stdout:Running hooks in /etc/ca-certificates/update.d... 2024-09-12T01:04:40.836 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:04:41.066 INFO:teuthology.orchestra.run.smithi043.stdout:done. 2024-09-12T01:04:41.066 INFO:teuthology.orchestra.run.smithi043.stdout:done. 2024-09-12T01:04:41.070 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T01:04:41.080 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T01:04:41.081 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:04:41.484 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:04:41.497 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-12T01:04:41.515 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":1660,"stamp":"2024-09-12T01:04:40.033691+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":691933335,"num_objects":5010,"num_object_clones":0,"num_object_copies":10020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5010,"num_whiteouts":0,"num_read":285537,"num_read_kb":2557194,"num_write":157039,"num_write_kb":2441380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13656,"ondisk_log_size":13656,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2814664,"kb_used_data":1411720,"kb_used_omap":12,"kb_used_meta":1402803,"kb_avail":752160056,"statfs":{"total":773094113280,"available":770211897344,"internally_reserved":0,"allocated":1445601280,"data_stored":1400422886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1436470835},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1160,"num_objects":-18,"num_object_clones":0,"num_object_copies":-36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-18,"num_whiteouts":0,"num_read":316,"num_read_kb":305,"num_write":77,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009705"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.738562+0000","last_change":"2024-09-12T00:46:09.507731+0000","last_active":"2024-09-12T01:01:12.738562+0000","last_peered":"2024-09-12T01:01:12.738562+0000","last_clean":"2024-09-12T01:01:12.738562+0000","last_became_active":"2024-09-12T00:46:09.506992+0000","last_became_peered":"2024-09-12T00:46:09.506992+0000","last_unstale":"2024-09-12T01:01:12.738562+0000","last_undegraded":"2024-09-12T01:01:12.738562+0000","last_fullsized":"2024-09-12T01:01:12.738562+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:58.022915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"265'8","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.721957+0000","last_change":"2024-09-12T00:34:55.237418+0000","last_active":"2024-09-12T00:59:57.721957+0000","last_peered":"2024-09-12T00:59:57.721957+0000","last_clean":"2024-09-12T00:59:57.721957+0000","last_became_active":"2024-09-12T00:34:55.236531+0000","last_became_peered":"2024-09-12T00:34:55.236531+0000","last_unstale":"2024-09-12T00:59:57.721957+0000","last_undegraded":"2024-09-12T00:59:57.721957+0000","last_fullsized":"2024-09-12T00:59:57.721957+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:18.916486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"268'2","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:51.722688+0000","last_change":"2024-09-12T00:34:52.172747+0000","last_active":"2024-09-12T00:59:51.722688+0000","last_peered":"2024-09-12T00:59:51.722688+0000","last_clean":"2024-09-12T00:59:51.722688+0000","last_became_active":"2024-09-12T00:34:52.171918+0000","last_became_peered":"2024-09-12T00:34:52.171918+0000","last_unstale":"2024-09-12T00:59:51.722688+0000","last_undegraded":"2024-09-12T00:59:51.722688+0000","last_fullsized":"2024-09-12T00:59:51.722688+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:15.468426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4197502,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4100,"num_write":2,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'30","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.578508+0000","last_change":"2024-09-12T00:33:10.849736+0000","last_active":"2024-09-12T01:02:21.578508+0000","last_peered":"2024-09-12T01:02:21.578508+0000","last_clean":"2024-09-12T01:02:21.578508+0000","last_became_active":"2024-09-12T00:33:10.848975+0000","last_became_peered":"2024-09-12T00:33:10.848975+0000","last_unstale":"2024-09-12T01:02:21.578508+0000","last_undegraded":"2024-09-12T01:02:21.578508+0000","last_fullsized":"2024-09-12T01:02:21.578508+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:54.113531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":60,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:11.710587+0000","last_change":"2024-09-12T00:46:09.510162+0000","last_active":"2024-09-12T01:01:11.710587+0000","last_peered":"2024-09-12T01:01:11.710587+0000","last_clean":"2024-09-12T01:01:11.710587+0000","last_became_active":"2024-09-12T00:46:09.509800+0000","last_became_peered":"2024-09-12T00:46:09.509800+0000","last_unstale":"2024-09-12T01:01:11.710587+0000","last_undegraded":"2024-09-12T01:01:11.710587+0000","last_fullsized":"2024-09-12T01:01:11.710587+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:13.709511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'6","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.518261+0000","last_change":"2024-09-12T00:34:55.233869+0000","last_active":"2024-09-12T00:59:57.518261+0000","last_peered":"2024-09-12T00:59:57.518261+0000","last_clean":"2024-09-12T00:59:57.518261+0000","last_became_active":"2024-09-12T00:34:55.232607+0000","last_became_peered":"2024-09-12T00:34:55.232607+0000","last_unstale":"2024-09-12T00:59:57.518261+0000","last_undegraded":"2024-09-12T00:59:57.518261+0000","last_fullsized":"2024-09-12T00:59:57.518261+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:24.955277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":11,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"268'1","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:51.520904+0000","last_change":"2024-09-12T00:34:52.211653+0000","last_active":"2024-09-12T00:59:51.520904+0000","last_peered":"2024-09-12T00:59:51.520904+0000","last_clean":"2024-09-12T00:59:51.520904+0000","last_became_active":"2024-09-12T00:34:52.210935+0000","last_became_peered":"2024-09-12T00:34:52.210935+0000","last_unstale":"2024-09-12T00:59:51.520904+0000","last_undegraded":"2024-09-12T00:59:51.520904+0000","last_fullsized":"2024-09-12T00:59:51.520904+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:38.800194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'30","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:14.858026+0000","last_change":"2024-09-12T00:33:10.852168+0000","last_active":"2024-09-12T01:02:14.858026+0000","last_peered":"2024-09-12T01:02:14.858026+0000","last_clean":"2024-09-12T01:02:14.858026+0000","last_became_active":"2024-09-12T00:33:10.851334+0000","last_became_peered":"2024-09-12T00:33:10.851334+0000","last_unstale":"2024-09-12T01:02:14.858026+0000","last_undegraded":"2024-09-12T01:02:14.858026+0000","last_fullsized":"2024-09-12T01:02:14.858026+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:46.569072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":55,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:42.712847+0000","last_change":"2024-09-12T00:46:09.508043+0000","last_active":"2024-09-12T01:00:42.712847+0000","last_peered":"2024-09-12T01:00:42.712847+0000","last_clean":"2024-09-12T01:00:42.712847+0000","last_became_active":"2024-09-12T00:46:09.507324+0000","last_became_peered":"2024-09-12T00:46:09.507324+0000","last_unstale":"2024-09-12T01:00:42.712847+0000","last_undegraded":"2024-09-12T01:00:42.712847+0000","last_fullsized":"2024-09-12T01:00:42.712847+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:56.424671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"268'1","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:01.573414+0000","last_change":"2024-09-12T00:34:55.253609+0000","last_active":"2024-09-12T01:02:01.573414+0000","last_peered":"2024-09-12T01:02:01.573414+0000","last_clean":"2024-09-12T01:02:01.573414+0000","last_became_active":"2024-09-12T00:34:55.252880+0000","last_became_peered":"2024-09-12T00:34:55.252880+0000","last_unstale":"2024-09-12T01:02:01.573414+0000","last_undegraded":"2024-09-12T01:02:01.573414+0000","last_fullsized":"2024-09-12T01:02:01.573414+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:39.510072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"268'1","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:51.706461+0000","last_change":"2024-09-12T00:34:52.198542+0000","last_active":"2024-09-12T01:00:51.706461+0000","last_peered":"2024-09-12T01:00:51.706461+0000","last_clean":"2024-09-12T01:00:51.706461+0000","last_became_active":"2024-09-12T00:34:52.195513+0000","last_became_peered":"2024-09-12T00:34:52.195513+0000","last_unstale":"2024-09-12T01:00:51.706461+0000","last_undegraded":"2024-09-12T01:00:51.706461+0000","last_fullsized":"2024-09-12T01:00:51.706461+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:23.382695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'20","reported_seq":99,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.549669+0000","last_change":"2024-09-12T00:33:10.848259+0000","last_active":"2024-09-12T01:00:41.549669+0000","last_peered":"2024-09-12T01:00:41.549669+0000","last_clean":"2024-09-12T01:00:41.549669+0000","last_became_active":"2024-09-12T00:33:10.847432+0000","last_became_peered":"2024-09-12T00:33:10.847432+0000","last_unstale":"2024-09-12T01:00:41.549669+0000","last_undegraded":"2024-09-12T01:00:41.549669+0000","last_fullsized":"2024-09-12T01:00:41.549669+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:33.335638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":67,"num_write":46,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:46.737552+0000","last_change":"2024-09-12T00:46:09.497586+0000","last_active":"2024-09-12T01:00:46.737552+0000","last_peered":"2024-09-12T01:00:46.737552+0000","last_clean":"2024-09-12T01:00:46.737552+0000","last_became_active":"2024-09-12T00:46:09.496807+0000","last_became_peered":"2024-09-12T00:46:09.496807+0000","last_unstale":"2024-09-12T01:00:46.737552+0000","last_undegraded":"2024-09-12T01:00:46.737552+0000","last_fullsized":"2024-09-12T01:00:46.737552+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:06.744888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:01.741428+0000","last_change":"2024-09-12T00:34:55.248775+0000","last_active":"2024-09-12T01:01:01.741428+0000","last_peered":"2024-09-12T01:01:01.741428+0000","last_clean":"2024-09-12T01:01:01.741428+0000","last_became_active":"2024-09-12T00:34:55.248058+0000","last_became_peered":"2024-09-12T00:34:55.248058+0000","last_unstale":"2024-09-12T01:01:01.741428+0000","last_undegraded":"2024-09-12T01:01:01.741428+0000","last_fullsized":"2024-09-12T01:01:01.741428+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:55.550280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"268'7","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.546316+0000","last_change":"2024-09-12T00:34:52.170876+0000","last_active":"2024-09-12T01:01:57.546316+0000","last_peered":"2024-09-12T01:01:57.546316+0000","last_clean":"2024-09-12T01:01:57.546316+0000","last_became_active":"2024-09-12T00:34:52.170013+0000","last_became_peered":"2024-09-12T00:34:52.170013+0000","last_unstale":"2024-09-12T01:01:57.546316+0000","last_undegraded":"2024-09-12T01:01:57.546316+0000","last_fullsized":"2024-09-12T01:01:57.546316+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:37.972262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":10242,"num_write":7,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'17","reported_seq":88,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:20.286340+0000","last_change":"2024-09-12T00:33:10.840336+0000","last_active":"2024-09-12T01:02:20.286340+0000","last_peered":"2024-09-12T01:02:20.286340+0000","last_clean":"2024-09-12T01:02:20.286340+0000","last_became_active":"2024-09-12T00:33:10.839248+0000","last_became_peered":"2024-09-12T00:33:10.839248+0000","last_unstale":"2024-09-12T01:02:20.286340+0000","last_undegraded":"2024-09-12T01:02:20.286340+0000","last_fullsized":"2024-09-12T01:02:20.286340+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:57.557088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":49,"num_write":38,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:16.761099+0000","last_change":"2024-09-12T00:46:09.501613+0000","last_active":"2024-09-12T01:02:16.761099+0000","last_peered":"2024-09-12T01:02:16.761099+0000","last_clean":"2024-09-12T01:02:16.761099+0000","last_became_active":"2024-09-12T00:46:09.499830+0000","last_became_peered":"2024-09-12T00:46:09.499830+0000","last_unstale":"2024-09-12T01:02:16.761099+0000","last_undegraded":"2024-09-12T01:02:16.761099+0000","last_fullsized":"2024-09-12T01:02:16.761099+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:10.541266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"268'2","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:32.743222+0000","last_change":"2024-09-12T00:34:55.242753+0000","last_active":"2024-09-12T01:01:32.743222+0000","last_peered":"2024-09-12T01:01:32.743222+0000","last_clean":"2024-09-12T01:01:32.743222+0000","last_became_active":"2024-09-12T00:34:55.242012+0000","last_became_peered":"2024-09-12T00:34:55.242012+0000","last_unstale":"2024-09-12T01:01:32.743222+0000","last_undegraded":"2024-09-12T01:01:32.743222+0000","last_fullsized":"2024-09-12T01:01:32.743222+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:49.280445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'6","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:26.564638+0000","last_change":"2024-09-12T00:34:52.206650+0000","last_active":"2024-09-12T01:01:26.564638+0000","last_peered":"2024-09-12T01:01:26.564638+0000","last_clean":"2024-09-12T01:01:26.564638+0000","last_became_active":"2024-09-12T00:34:52.205385+0000","last_became_peered":"2024-09-12T00:34:52.205385+0000","last_unstale":"2024-09-12T01:01:26.564638+0000","last_undegraded":"2024-09-12T01:01:26.564638+0000","last_fullsized":"2024-09-12T01:01:26.564638+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:45.297232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'48","reported_seq":172,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.736371+0000","last_change":"2024-09-12T00:33:10.843742+0000","last_active":"2024-09-12T01:00:41.736371+0000","last_peered":"2024-09-12T01:00:41.736371+0000","last_clean":"2024-09-12T01:00:41.736371+0000","last_became_active":"2024-09-12T00:33:10.842427+0000","last_became_peered":"2024-09-12T00:33:10.842427+0000","last_unstale":"2024-09-12T01:00:41.736371+0000","last_undegraded":"2024-09-12T01:00:41.736371+0000","last_fullsized":"2024-09-12T01:00:41.736371+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:10.839165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":162,"num_write":92,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:46.533904+0000","last_change":"2024-09-12T00:46:09.514586+0000","last_active":"2024-09-12T01:00:46.533904+0000","last_peered":"2024-09-12T01:00:46.533904+0000","last_clean":"2024-09-12T01:00:46.533904+0000","last_became_active":"2024-09-12T00:46:09.513617+0000","last_became_peered":"2024-09-12T00:46:09.513617+0000","last_unstale":"2024-09-12T01:00:46.533904+0000","last_undegraded":"2024-09-12T01:00:46.533904+0000","last_fullsized":"2024-09-12T01:00:46.533904+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:01.938146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"265'7","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:32.723080+0000","last_change":"2024-09-12T00:35:57.378205+0000","last_active":"2024-09-12T01:01:32.723080+0000","last_peered":"2024-09-12T01:01:32.723080+0000","last_clean":"2024-09-12T01:01:32.723080+0000","last_became_active":"2024-09-12T00:35:57.345894+0000","last_became_peered":"2024-09-12T00:35:57.345894+0000","last_unstale":"2024-09-12T01:01:32.723080+0000","last_undegraded":"2024-09-12T01:01:32.723080+0000","last_fullsized":"2024-09-12T01:01:32.723080+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:29.209762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"265'2","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:37.541584+0000","last_change":"2024-09-12T00:34:52.189042+0000","last_active":"2024-09-12T01:01:37.541584+0000","last_peered":"2024-09-12T01:01:37.541584+0000","last_clean":"2024-09-12T01:01:37.541584+0000","last_became_active":"2024-09-12T00:34:52.188352+0000","last_became_peered":"2024-09-12T00:34:52.188352+0000","last_unstale":"2024-09-12T01:01:37.541584+0000","last_undegraded":"2024-09-12T01:01:37.541584+0000","last_fullsized":"2024-09-12T01:01:37.541584+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:23.453176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'29","reported_seq":125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:42.712902+0000","last_change":"2024-09-12T00:33:10.846375+0000","last_active":"2024-09-12T01:00:42.712902+0000","last_peered":"2024-09-12T01:00:42.712902+0000","last_clean":"2024-09-12T01:00:42.712902+0000","last_became_active":"2024-09-12T00:33:10.845301+0000","last_became_peered":"2024-09-12T00:33:10.845301+0000","last_unstale":"2024-09-12T01:00:42.712902+0000","last_undegraded":"2024-09-12T01:00:42.712902+0000","last_fullsized":"2024-09-12T01:00:42.712902+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:52.282677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.534764+0000","last_change":"2024-09-12T00:46:09.499014+0000","last_active":"2024-09-12T01:01:12.534764+0000","last_peered":"2024-09-12T01:01:12.534764+0000","last_clean":"2024-09-12T01:01:12.534764+0000","last_became_active":"2024-09-12T00:46:09.498002+0000","last_became_peered":"2024-09-12T00:46:09.498002+0000","last_unstale":"2024-09-12T01:01:12.534764+0000","last_undegraded":"2024-09-12T01:01:12.534764+0000","last_fullsized":"2024-09-12T01:01:12.534764+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:50.022966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":34,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.703624+0000","last_change":"2024-09-12T00:34:55.215867+0000","last_active":"2024-09-12T00:59:57.703624+0000","last_peered":"2024-09-12T00:59:57.703624+0000","last_clean":"2024-09-12T00:59:57.703624+0000","last_became_active":"2024-09-12T00:34:55.215076+0000","last_became_peered":"2024-09-12T00:34:55.215076+0000","last_unstale":"2024-09-12T00:59:57.703624+0000","last_undegraded":"2024-09-12T00:59:57.703624+0000","last_fullsized":"2024-09-12T00:59:57.703624+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:36.048042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"265'2","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:52.517005+0000","last_change":"2024-09-12T00:34:52.199214+0000","last_active":"2024-09-12T00:59:52.517005+0000","last_peered":"2024-09-12T00:59:52.517005+0000","last_clean":"2024-09-12T00:59:52.517005+0000","last_became_active":"2024-09-12T00:34:52.198548+0000","last_became_peered":"2024-09-12T00:34:52.198548+0000","last_unstale":"2024-09-12T00:59:52.517005+0000","last_undegraded":"2024-09-12T00:59:52.517005+0000","last_fullsized":"2024-09-12T00:59:52.517005+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:36.364945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'18","reported_seq":93,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:56.536596+0000","last_change":"2024-09-12T00:33:10.857470+0000","last_active":"2024-09-12T00:59:56.536596+0000","last_peered":"2024-09-12T00:59:56.536596+0000","last_clean":"2024-09-12T00:59:56.536596+0000","last_became_active":"2024-09-12T00:33:10.856664+0000","last_became_peered":"2024-09-12T00:33:10.856664+0000","last_unstale":"2024-09-12T00:59:56.536596+0000","last_undegraded":"2024-09-12T00:59:56.536596+0000","last_fullsized":"2024-09-12T00:59:56.536596+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:26.626571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":59,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.534815+0000","last_change":"2024-09-12T00:46:09.504100+0000","last_active":"2024-09-12T01:01:12.534815+0000","last_peered":"2024-09-12T01:01:12.534815+0000","last_clean":"2024-09-12T01:01:12.534815+0000","last_became_active":"2024-09-12T00:46:09.503361+0000","last_became_peered":"2024-09-12T00:46:09.503361+0000","last_unstale":"2024-09-12T01:01:12.534815+0000","last_undegraded":"2024-09-12T01:01:12.534815+0000","last_fullsized":"2024-09-12T01:01:12.534815+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:15.687886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":34,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:56.723763+0000","last_change":"2024-09-12T00:34:55.217786+0000","last_active":"2024-09-12T00:59:56.723763+0000","last_peered":"2024-09-12T00:59:56.723763+0000","last_clean":"2024-09-12T00:59:56.723763+0000","last_became_active":"2024-09-12T00:34:55.217009+0000","last_became_peered":"2024-09-12T00:34:55.217009+0000","last_unstale":"2024-09-12T00:59:56.723763+0000","last_undegraded":"2024-09-12T00:59:56.723763+0000","last_fullsized":"2024-09-12T00:59:56.723763+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:52.140153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"268'1","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:51.532437+0000","last_change":"2024-09-12T00:34:52.206482+0000","last_active":"2024-09-12T00:59:51.532437+0000","last_peered":"2024-09-12T00:59:51.532437+0000","last_clean":"2024-09-12T00:59:51.532437+0000","last_became_active":"2024-09-12T00:34:52.202432+0000","last_became_peered":"2024-09-12T00:34:52.202432+0000","last_unstale":"2024-09-12T00:59:51.532437+0000","last_undegraded":"2024-09-12T00:59:51.532437+0000","last_fullsized":"2024-09-12T00:59:51.532437+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:47.587915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"268'46","reported_seq":174,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.554878+0000","last_change":"2024-09-12T00:33:10.846991+0000","last_active":"2024-09-12T01:02:11.554878+0000","last_peered":"2024-09-12T01:02:11.554878+0000","last_clean":"2024-09-12T01:02:11.554878+0000","last_became_active":"2024-09-12T00:33:10.846370+0000","last_became_peered":"2024-09-12T00:33:10.846370+0000","last_unstale":"2024-09-12T01:02:11.554878+0000","last_undegraded":"2024-09-12T01:02:11.554878+0000","last_fullsized":"2024-09-12T01:02:11.554878+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:49.969549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":168,"num_write":82,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:11.525647+0000","last_change":"2024-09-12T00:46:09.494884+0000","last_active":"2024-09-12T01:00:11.525647+0000","last_peered":"2024-09-12T01:00:11.525647+0000","last_clean":"2024-09-12T01:00:11.525647+0000","last_became_active":"2024-09-12T00:46:09.494139+0000","last_became_peered":"2024-09-12T00:46:09.494139+0000","last_unstale":"2024-09-12T01:00:11.525647+0000","last_undegraded":"2024-09-12T01:00:11.525647+0000","last_fullsized":"2024-09-12T01:00:11.525647+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:16.093338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":35,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:31.748997+0000","last_change":"2024-09-12T00:34:55.253827+0000","last_active":"2024-09-12T01:01:31.748997+0000","last_peered":"2024-09-12T01:01:31.748997+0000","last_clean":"2024-09-12T01:01:31.748997+0000","last_became_active":"2024-09-12T00:34:55.253209+0000","last_became_peered":"2024-09-12T00:34:55.253209+0000","last_unstale":"2024-09-12T01:01:31.748997+0000","last_undegraded":"2024-09-12T01:01:31.748997+0000","last_fullsized":"2024-09-12T01:01:31.748997+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:58.016129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'1","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:32.729826+0000","last_change":"2024-09-12T00:34:52.180802+0000","last_active":"2024-09-12T01:00:32.729826+0000","last_peered":"2024-09-12T01:00:32.729826+0000","last_clean":"2024-09-12T01:00:32.729826+0000","last_became_active":"2024-09-12T00:34:52.180036+0000","last_became_peered":"2024-09-12T00:34:52.180036+0000","last_unstale":"2024-09-12T01:00:32.729826+0000","last_undegraded":"2024-09-12T01:00:32.729826+0000","last_fullsized":"2024-09-12T01:00:32.729826+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:25.152180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'75","reported_seq":263,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.576052+0000","last_change":"2024-09-12T00:33:10.852500+0000","last_active":"2024-09-12T01:02:11.576052+0000","last_peered":"2024-09-12T01:02:11.576052+0000","last_clean":"2024-09-12T01:02:11.576052+0000","last_became_active":"2024-09-12T00:33:10.851672+0000","last_became_peered":"2024-09-12T00:33:10.851672+0000","last_unstale":"2024-09-12T01:02:11.576052+0000","last_undegraded":"2024-09-12T01:02:11.576052+0000","last_fullsized":"2024-09-12T01:02:11.576052+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:45.023568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":415,"num_read_kb":311,"num_write":116,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:11.698157+0000","last_change":"2024-09-12T00:46:09.519546+0000","last_active":"2024-09-12T01:00:11.698157+0000","last_peered":"2024-09-12T01:00:11.698157+0000","last_clean":"2024-09-12T01:00:11.698157+0000","last_became_active":"2024-09-12T00:46:09.513012+0000","last_became_peered":"2024-09-12T00:46:09.513012+0000","last_unstale":"2024-09-12T01:00:11.698157+0000","last_undegraded":"2024-09-12T01:00:11.698157+0000","last_fullsized":"2024-09-12T01:00:11.698157+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:10.067526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"268'6","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.736417+0000","last_change":"2024-09-12T00:34:55.254204+0000","last_active":"2024-09-12T01:00:41.736417+0000","last_peered":"2024-09-12T01:00:41.736417+0000","last_clean":"2024-09-12T01:00:41.736417+0000","last_became_active":"2024-09-12T00:34:55.252580+0000","last_became_peered":"2024-09-12T00:34:55.252580+0000","last_unstale":"2024-09-12T01:00:41.736417+0000","last_undegraded":"2024-09-12T01:00:41.736417+0000","last_fullsized":"2024-09-12T01:00:41.736417+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:00.820979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":14336,"num_write":16,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:27.538170+0000","last_change":"2024-09-12T00:34:52.204725+0000","last_active":"2024-09-12T01:01:27.538170+0000","last_peered":"2024-09-12T01:01:27.538170+0000","last_clean":"2024-09-12T01:01:27.538170+0000","last_became_active":"2024-09-12T00:34:52.204021+0000","last_became_peered":"2024-09-12T00:34:52.204021+0000","last_unstale":"2024-09-12T01:01:27.538170+0000","last_undegraded":"2024-09-12T01:01:27.538170+0000","last_fullsized":"2024-09-12T01:01:27.538170+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:45.824620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'35","reported_seq":145,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.759818+0000","last_change":"2024-09-12T00:33:10.850040+0000","last_active":"2024-09-12T01:02:11.759818+0000","last_peered":"2024-09-12T01:02:11.759818+0000","last_clean":"2024-09-12T01:02:11.759818+0000","last_became_active":"2024-09-12T00:33:10.849228+0000","last_became_peered":"2024-09-12T00:33:10.849228+0000","last_unstale":"2024-09-12T01:02:11.759818+0000","last_undegraded":"2024-09-12T01:02:11.759818+0000","last_fullsized":"2024-09-12T01:02:11.759818+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:46.335542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":134,"num_write":61,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:12.520461+0000","last_change":"2024-09-12T00:46:09.500158+0000","last_active":"2024-09-12T01:00:12.520461+0000","last_peered":"2024-09-12T01:00:12.520461+0000","last_clean":"2024-09-12T01:00:12.520461+0000","last_became_active":"2024-09-12T00:46:09.499137+0000","last_became_peered":"2024-09-12T00:46:09.499137+0000","last_unstale":"2024-09-12T01:00:12.520461+0000","last_undegraded":"2024-09-12T01:00:12.520461+0000","last_fullsized":"2024-09-12T01:00:12.520461+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:28.716621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"268'4","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:31.749130+0000","last_change":"2024-09-12T00:34:55.254921+0000","last_active":"2024-09-12T01:01:31.749130+0000","last_peered":"2024-09-12T01:01:31.749130+0000","last_clean":"2024-09-12T01:01:31.749130+0000","last_became_active":"2024-09-12T00:34:55.254250+0000","last_became_peered":"2024-09-12T00:34:55.254250+0000","last_unstale":"2024-09-12T01:01:31.749130+0000","last_undegraded":"2024-09-12T01:01:31.749130+0000","last_fullsized":"2024-09-12T01:01:31.749130+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:45.939058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":9,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:26.714599+0000","last_change":"2024-09-12T00:34:52.179911+0000","last_active":"2024-09-12T01:01:26.714599+0000","last_peered":"2024-09-12T01:01:26.714599+0000","last_clean":"2024-09-12T01:01:26.714599+0000","last_became_active":"2024-09-12T00:34:52.173822+0000","last_became_peered":"2024-09-12T00:34:52.173822+0000","last_unstale":"2024-09-12T01:01:26.714599+0000","last_undegraded":"2024-09-12T01:01:26.714599+0000","last_fullsized":"2024-09-12T01:01:26.714599+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:44.199880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'34","reported_seq":141,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.724049+0000","last_change":"2024-09-12T00:33:10.842194+0000","last_active":"2024-09-12T01:02:11.724049+0000","last_peered":"2024-09-12T01:02:11.724049+0000","last_clean":"2024-09-12T01:02:11.724049+0000","last_became_active":"2024-09-12T00:33:10.841363+0000","last_became_peered":"2024-09-12T00:33:10.841363+0000","last_unstale":"2024-09-12T01:02:11.724049+0000","last_undegraded":"2024-09-12T01:02:11.724049+0000","last_fullsized":"2024-09-12T01:02:11.724049+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:29.266511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":128,"num_write":55,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:12.725014+0000","last_change":"2024-09-12T00:46:09.506737+0000","last_active":"2024-09-12T01:00:12.725014+0000","last_peered":"2024-09-12T01:00:12.725014+0000","last_clean":"2024-09-12T01:00:12.725014+0000","last_became_active":"2024-09-12T00:46:09.502684+0000","last_became_peered":"2024-09-12T00:46:09.502684+0000","last_unstale":"2024-09-12T01:00:12.725014+0000","last_undegraded":"2024-09-12T01:00:12.725014+0000","last_fullsized":"2024-09-12T01:00:12.725014+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:55.402567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"268'5","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:32.540359+0000","last_change":"2024-09-12T00:34:55.227141+0000","last_active":"2024-09-12T01:01:32.540359+0000","last_peered":"2024-09-12T01:01:32.540359+0000","last_clean":"2024-09-12T01:01:32.540359+0000","last_became_active":"2024-09-12T00:34:55.226388+0000","last_became_peered":"2024-09-12T00:34:55.226388+0000","last_unstale":"2024-09-12T01:01:32.540359+0000","last_undegraded":"2024-09-12T01:01:32.540359+0000","last_fullsized":"2024-09-12T01:01:32.540359+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:59.431333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":15,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"268'10","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:26.564896+0000","last_change":"2024-09-12T00:34:52.197590+0000","last_active":"2024-09-12T01:01:26.564896+0000","last_peered":"2024-09-12T01:01:26.564896+0000","last_clean":"2024-09-12T01:01:26.564896+0000","last_became_active":"2024-09-12T00:34:52.196770+0000","last_became_peered":"2024-09-12T00:34:52.196770+0000","last_unstale":"2024-09-12T01:01:26.564896+0000","last_undegraded":"2024-09-12T01:01:26.564896+0000","last_fullsized":"2024-09-12T01:01:26.564896+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:15.638504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":15,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'4","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:37.433116+0000","last_change":"2024-09-12T00:33:10.858900+0000","last_active":"2024-09-12T01:01:37.433116+0000","last_peered":"2024-09-12T01:01:37.433116+0000","last_clean":"2024-09-12T01:01:37.433116+0000","last_became_active":"2024-09-12T00:33:10.858178+0000","last_became_peered":"2024-09-12T00:33:10.858178+0000","last_unstale":"2024-09-12T01:01:37.433116+0000","last_undegraded":"2024-09-12T01:01:37.433116+0000","last_fullsized":"2024-09-12T01:01:37.433116+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:45.562348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.736528+0000","last_change":"2024-09-12T00:46:09.522998+0000","last_active":"2024-09-12T01:00:41.736528+0000","last_peered":"2024-09-12T01:00:41.736528+0000","last_clean":"2024-09-12T01:00:41.736528+0000","last_became_active":"2024-09-12T00:46:09.521706+0000","last_became_peered":"2024-09-12T00:46:09.521706+0000","last_unstale":"2024-09-12T01:00:41.736528+0000","last_undegraded":"2024-09-12T01:00:41.736528+0000","last_fullsized":"2024-09-12T01:00:41.736528+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:39.145979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"268'2","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:36.531591+0000","last_change":"2024-09-12T00:34:55.224573+0000","last_active":"2024-09-12T01:00:36.531591+0000","last_peered":"2024-09-12T01:00:36.531591+0000","last_clean":"2024-09-12T01:00:36.531591+0000","last_became_active":"2024-09-12T00:34:55.223787+0000","last_became_peered":"2024-09-12T00:34:55.223787+0000","last_unstale":"2024-09-12T01:00:36.531591+0000","last_undegraded":"2024-09-12T01:00:36.531591+0000","last_fullsized":"2024-09-12T01:00:36.531591+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:30.131692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"268'5","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:32.525816+0000","last_change":"2024-09-12T00:34:52.184714+0000","last_active":"2024-09-12T01:00:32.525816+0000","last_peered":"2024-09-12T01:00:32.525816+0000","last_clean":"2024-09-12T01:00:32.525816+0000","last_became_active":"2024-09-12T00:34:52.183982+0000","last_became_peered":"2024-09-12T00:34:52.183982+0000","last_unstale":"2024-09-12T01:00:32.525816+0000","last_undegraded":"2024-09-12T01:00:32.525816+0000","last_fullsized":"2024-09-12T01:00:32.525816+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:07.745456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":5649,"num_write":5,"num_write_kb":5649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'25","reported_seq":115,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.534711+0000","last_change":"2024-09-12T00:33:10.858835+0000","last_active":"2024-09-12T01:01:12.534711+0000","last_peered":"2024-09-12T01:01:12.534711+0000","last_clean":"2024-09-12T01:01:12.534711+0000","last_became_active":"2024-09-12T00:33:10.858212+0000","last_became_peered":"2024-09-12T00:33:10.858212+0000","last_unstale":"2024-09-12T01:01:12.534711+0000","last_undegraded":"2024-09-12T01:01:12.534711+0000","last_fullsized":"2024-09-12T01:01:12.534711+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:58.477753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":92,"num_write":42,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.549794+0000","last_change":"2024-09-12T00:46:09.518627+0000","last_active":"2024-09-12T01:00:41.549794+0000","last_peered":"2024-09-12T01:00:41.549794+0000","last_clean":"2024-09-12T01:00:41.549794+0000","last_became_active":"2024-09-12T00:46:09.517833+0000","last_became_peered":"2024-09-12T00:46:09.517833+0000","last_unstale":"2024-09-12T01:00:41.549794+0000","last_undegraded":"2024-09-12T01:00:41.549794+0000","last_fullsized":"2024-09-12T01:00:41.549794+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:23.918442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'9","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:36.531490+0000","last_change":"2024-09-12T00:34:55.227520+0000","last_active":"2024-09-12T01:00:36.531490+0000","last_peered":"2024-09-12T01:00:36.531490+0000","last_clean":"2024-09-12T01:00:36.531490+0000","last_became_active":"2024-09-12T00:34:55.226334+0000","last_became_peered":"2024-09-12T00:34:55.226334+0000","last_unstale":"2024-09-12T01:00:36.531490+0000","last_undegraded":"2024-09-12T01:00:36.531490+0000","last_fullsized":"2024-09-12T01:00:36.531490+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:23.592244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":14,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'5","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:31.733086+0000","last_change":"2024-09-12T00:34:52.179045+0000","last_active":"2024-09-12T01:00:31.733086+0000","last_peered":"2024-09-12T01:00:31.733086+0000","last_clean":"2024-09-12T01:00:31.733086+0000","last_became_active":"2024-09-12T00:34:52.174421+0000","last_became_peered":"2024-09-12T00:34:52.174421+0000","last_unstale":"2024-09-12T01:00:31.733086+0000","last_undegraded":"2024-09-12T01:00:31.733086+0000","last_fullsized":"2024-09-12T01:00:31.733086+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:27.648444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":5438,"num_write":5,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"268'52","reported_seq":187,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.554333+0000","last_change":"2024-09-12T00:33:10.849621+0000","last_active":"2024-09-12T01:02:21.554333+0000","last_peered":"2024-09-12T01:02:21.554333+0000","last_clean":"2024-09-12T01:02:21.554333+0000","last_became_active":"2024-09-12T00:33:10.848890+0000","last_became_peered":"2024-09-12T00:33:10.848890+0000","last_unstale":"2024-09-12T01:02:21.554333+0000","last_undegraded":"2024-09-12T01:02:21.554333+0000","last_fullsized":"2024-09-12T01:02:21.554333+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:26.708631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":180,"num_write":98,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:16.541674+0000","last_change":"2024-09-12T00:46:09.521885+0000","last_active":"2024-09-12T01:00:16.541674+0000","last_peered":"2024-09-12T01:00:16.541674+0000","last_clean":"2024-09-12T01:00:16.541674+0000","last_became_active":"2024-09-12T00:46:09.521575+0000","last_became_peered":"2024-09-12T00:46:09.521575+0000","last_unstale":"2024-09-12T01:00:16.541674+0000","last_undegraded":"2024-09-12T01:00:16.541674+0000","last_fullsized":"2024-09-12T01:00:16.541674+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:19.905486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"268'5","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:36.735003+0000","last_change":"2024-09-12T00:34:55.233021+0000","last_active":"2024-09-12T01:00:36.735003+0000","last_peered":"2024-09-12T01:00:36.735003+0000","last_clean":"2024-09-12T01:00:36.735003+0000","last_became_active":"2024-09-12T00:34:55.232215+0000","last_became_peered":"2024-09-12T00:34:55.232215+0000","last_unstale":"2024-09-12T01:00:36.735003+0000","last_undegraded":"2024-09-12T01:00:36.735003+0000","last_fullsized":"2024-09-12T01:00:36.735003+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:02.623358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4254673,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":8310,"num_write":10,"num_write_kb":8251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"268'3","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:32.710859+0000","last_change":"2024-09-12T00:34:52.200570+0000","last_active":"2024-09-12T01:00:32.710859+0000","last_peered":"2024-09-12T01:00:32.710859+0000","last_clean":"2024-09-12T01:00:32.710859+0000","last_became_active":"2024-09-12T00:34:52.199793+0000","last_became_peered":"2024-09-12T00:34:52.199793+0000","last_unstale":"2024-09-12T01:00:32.710859+0000","last_undegraded":"2024-09-12T01:00:32.710859+0000","last_fullsized":"2024-09-12T01:00:32.710859+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:28.505129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'20","reported_seq":103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.535700+0000","last_change":"2024-09-12T00:33:10.845733+0000","last_active":"2024-09-12T01:01:12.535700+0000","last_peered":"2024-09-12T01:01:12.535700+0000","last_clean":"2024-09-12T01:01:12.535700+0000","last_became_active":"2024-09-12T00:33:10.844957+0000","last_became_peered":"2024-09-12T00:33:10.844957+0000","last_unstale":"2024-09-12T01:01:12.535700+0000","last_undegraded":"2024-09-12T01:01:12.535700+0000","last_fullsized":"2024-09-12T01:01:12.535700+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:00.371030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":73,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.736485+0000","last_change":"2024-09-12T00:46:09.515049+0000","last_active":"2024-09-12T01:00:41.736485+0000","last_peered":"2024-09-12T01:00:41.736485+0000","last_clean":"2024-09-12T01:00:41.736485+0000","last_became_active":"2024-09-12T00:46:09.514727+0000","last_became_peered":"2024-09-12T00:46:09.514727+0000","last_unstale":"2024-09-12T01:00:41.736485+0000","last_undegraded":"2024-09-12T01:00:41.736485+0000","last_fullsized":"2024-09-12T01:00:41.736485+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:28.627541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"268'5","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:37.711861+0000","last_change":"2024-09-12T00:34:55.220880+0000","last_active":"2024-09-12T01:00:37.711861+0000","last_peered":"2024-09-12T01:00:37.711861+0000","last_clean":"2024-09-12T01:00:37.711861+0000","last_became_active":"2024-09-12T00:34:55.220179+0000","last_became_peered":"2024-09-12T00:34:55.220179+0000","last_unstale":"2024-09-12T01:00:37.711861+0000","last_undegraded":"2024-09-12T01:00:37.711861+0000","last_fullsized":"2024-09-12T01:00:37.711861+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:14.092881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"268'5","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:32.729791+0000","last_change":"2024-09-12T00:34:52.197324+0000","last_active":"2024-09-12T01:00:32.729791+0000","last_peered":"2024-09-12T01:00:32.729791+0000","last_clean":"2024-09-12T01:00:32.729791+0000","last_became_active":"2024-09-12T00:34:52.196592+0000","last_became_peered":"2024-09-12T00:34:52.196592+0000","last_unstale":"2024-09-12T01:00:32.729791+0000","last_undegraded":"2024-09-12T01:00:32.729791+0000","last_fullsized":"2024-09-12T01:00:32.729791+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:12.628205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":10,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'27","reported_seq":117,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:11.743558+0000","last_change":"2024-09-12T00:33:10.842922+0000","last_active":"2024-09-12T01:01:11.743558+0000","last_peered":"2024-09-12T01:01:11.743558+0000","last_clean":"2024-09-12T01:01:11.743558+0000","last_became_active":"2024-09-12T00:33:10.842139+0000","last_became_peered":"2024-09-12T00:33:10.842139+0000","last_unstale":"2024-09-12T01:01:11.743558+0000","last_undegraded":"2024-09-12T01:01:11.743558+0000","last_fullsized":"2024-09-12T01:01:11.743558+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:22.677651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":87,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:21.713467+0000","last_change":"2024-09-12T00:46:09.495008+0000","last_active":"2024-09-12T01:01:21.713467+0000","last_peered":"2024-09-12T01:01:21.713467+0000","last_clean":"2024-09-12T01:01:21.713467+0000","last_became_active":"2024-09-12T00:46:09.494257+0000","last_became_peered":"2024-09-12T00:46:09.494257+0000","last_unstale":"2024-09-12T01:01:21.713467+0000","last_undegraded":"2024-09-12T01:01:21.713467+0000","last_fullsized":"2024-09-12T01:01:21.713467+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:13.650561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":36,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.755822+0000","last_change":"2024-09-12T00:34:55.228058+0000","last_active":"2024-09-12T01:01:56.755822+0000","last_peered":"2024-09-12T01:01:56.755822+0000","last_clean":"2024-09-12T01:01:56.755822+0000","last_became_active":"2024-09-12T00:34:55.226471+0000","last_became_peered":"2024-09-12T00:34:55.226471+0000","last_unstale":"2024-09-12T01:01:56.755822+0000","last_undegraded":"2024-09-12T01:01:56.755822+0000","last_fullsized":"2024-09-12T01:01:56.755822+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:56.137407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'2","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:52.543792+0000","last_change":"2024-09-12T00:34:52.203278+0000","last_active":"2024-09-12T01:01:52.543792+0000","last_peered":"2024-09-12T01:01:52.543792+0000","last_clean":"2024-09-12T01:01:52.543792+0000","last_became_active":"2024-09-12T00:34:52.202587+0000","last_became_peered":"2024-09-12T00:34:52.202587+0000","last_unstale":"2024-09-12T01:01:52.543792+0000","last_undegraded":"2024-09-12T01:01:52.543792+0000","last_fullsized":"2024-09-12T01:01:52.543792+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:59.179898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'23","reported_seq":108,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:16.729118+0000","last_change":"2024-09-12T00:33:10.833328+0000","last_active":"2024-09-12T01:00:16.729118+0000","last_peered":"2024-09-12T01:00:16.729118+0000","last_clean":"2024-09-12T01:00:16.729118+0000","last_became_active":"2024-09-12T00:33:10.832622+0000","last_became_peered":"2024-09-12T00:33:10.832622+0000","last_unstale":"2024-09-12T01:00:16.729118+0000","last_undegraded":"2024-09-12T01:00:16.729118+0000","last_fullsized":"2024-09-12T01:00:16.729118+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:46.829359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":78,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.544986+0000","last_change":"2024-09-12T00:46:09.502064+0000","last_active":"2024-09-12T01:01:57.544986+0000","last_peered":"2024-09-12T01:01:57.544986+0000","last_clean":"2024-09-12T01:01:57.544986+0000","last_became_active":"2024-09-12T00:46:09.501361+0000","last_became_peered":"2024-09-12T00:46:09.501361+0000","last_unstale":"2024-09-12T01:01:57.544986+0000","last_undegraded":"2024-09-12T01:01:57.544986+0000","last_fullsized":"2024-09-12T01:01:57.544986+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:11.638769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"268'1","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.755723+0000","last_change":"2024-09-12T00:34:55.222844+0000","last_active":"2024-09-12T01:01:56.755723+0000","last_peered":"2024-09-12T01:01:56.755723+0000","last_clean":"2024-09-12T01:01:56.755723+0000","last_became_active":"2024-09-12T00:34:55.222079+0000","last_became_peered":"2024-09-12T00:34:55.222079+0000","last_unstale":"2024-09-12T01:01:56.755723+0000","last_undegraded":"2024-09-12T01:01:56.755723+0000","last_fullsized":"2024-09-12T01:01:56.755723+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:10.859567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3198,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"268'2","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:51.719742+0000","last_change":"2024-09-12T00:34:52.177816+0000","last_active":"2024-09-12T01:01:51.719742+0000","last_peered":"2024-09-12T01:01:51.719742+0000","last_clean":"2024-09-12T01:01:51.719742+0000","last_became_active":"2024-09-12T00:34:52.176108+0000","last_became_peered":"2024-09-12T00:34:52.176108+0000","last_unstale":"2024-09-12T01:01:51.719742+0000","last_undegraded":"2024-09-12T01:01:51.719742+0000","last_fullsized":"2024-09-12T01:01:51.719742+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:39.727514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'16","reported_seq":90,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:12.725245+0000","last_change":"2024-09-12T00:33:10.850501+0000","last_active":"2024-09-12T01:00:12.725245+0000","last_peered":"2024-09-12T01:00:12.725245+0000","last_clean":"2024-09-12T01:00:12.725245+0000","last_became_active":"2024-09-12T00:33:10.849703+0000","last_became_peered":"2024-09-12T00:33:10.849703+0000","last_unstale":"2024-09-12T01:00:12.725245+0000","last_undegraded":"2024-09-12T01:00:12.725245+0000","last_fullsized":"2024-09-12T01:00:12.725245+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:34.698555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:22.721112+0000","last_change":"2024-09-12T00:46:09.517232+0000","last_active":"2024-09-12T01:01:22.721112+0000","last_peered":"2024-09-12T01:01:22.721112+0000","last_clean":"2024-09-12T01:01:22.721112+0000","last_became_active":"2024-09-12T00:46:09.514197+0000","last_became_peered":"2024-09-12T00:46:09.514197+0000","last_unstale":"2024-09-12T01:01:22.721112+0000","last_undegraded":"2024-09-12T01:01:22.721112+0000","last_fullsized":"2024-09-12T01:01:22.721112+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:13.571995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"268'7","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:01.552559+0000","last_change":"2024-09-12T00:34:55.253416+0000","last_active":"2024-09-12T01:02:01.552559+0000","last_peered":"2024-09-12T01:02:01.552559+0000","last_clean":"2024-09-12T01:02:01.552559+0000","last_became_active":"2024-09-12T00:34:55.252651+0000","last_became_peered":"2024-09-12T00:34:55.252651+0000","last_unstale":"2024-09-12T01:02:01.552559+0000","last_undegraded":"2024-09-12T01:02:01.552559+0000","last_fullsized":"2024-09-12T01:02:01.552559+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:51.619823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":7697,"num_write":7,"num_write_kb":6673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"268'2","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:51.570617+0000","last_change":"2024-09-12T00:34:52.201618+0000","last_active":"2024-09-12T01:01:51.570617+0000","last_peered":"2024-09-12T01:01:51.570617+0000","last_clean":"2024-09-12T01:01:51.570617+0000","last_became_active":"2024-09-12T00:34:52.177094+0000","last_became_peered":"2024-09-12T00:34:52.177094+0000","last_unstale":"2024-09-12T01:01:51.570617+0000","last_undegraded":"2024-09-12T01:01:51.570617+0000","last_fullsized":"2024-09-12T01:01:51.570617+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:28.340168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"268'31","reported_seq":132,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:12.706722+0000","last_change":"2024-09-12T00:33:10.863914+0000","last_active":"2024-09-12T01:00:12.706722+0000","last_peered":"2024-09-12T01:00:12.706722+0000","last_clean":"2024-09-12T01:00:12.706722+0000","last_became_active":"2024-09-12T00:33:10.862993+0000","last_became_peered":"2024-09-12T00:33:10.862993+0000","last_unstale":"2024-09-12T01:00:12.706722+0000","last_undegraded":"2024-09-12T01:00:12.706722+0000","last_fullsized":"2024-09-12T01:00:12.706722+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:01.904051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":107,"num_write":58,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:22.536912+0000","last_change":"2024-09-12T00:46:09.499178+0000","last_active":"2024-09-12T01:01:22.536912+0000","last_peered":"2024-09-12T01:01:22.536912+0000","last_clean":"2024-09-12T01:01:22.536912+0000","last_became_active":"2024-09-12T00:46:09.498482+0000","last_became_peered":"2024-09-12T00:46:09.498482+0000","last_unstale":"2024-09-12T01:01:22.536912+0000","last_undegraded":"2024-09-12T01:01:22.536912+0000","last_fullsized":"2024-09-12T01:01:22.536912+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:41.343998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":36,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.755870+0000","last_change":"2024-09-12T00:34:55.229076+0000","last_active":"2024-09-12T01:01:56.755870+0000","last_peered":"2024-09-12T01:01:56.755870+0000","last_clean":"2024-09-12T01:01:56.755870+0000","last_became_active":"2024-09-12T00:34:55.228136+0000","last_became_peered":"2024-09-12T00:34:55.228136+0000","last_unstale":"2024-09-12T01:01:56.755870+0000","last_undegraded":"2024-09-12T01:01:56.755870+0000","last_fullsized":"2024-09-12T01:01:56.755870+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:13.739031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.551311+0000","last_change":"2024-09-12T00:34:52.191163+0000","last_active":"2024-09-12T01:01:56.551311+0000","last_peered":"2024-09-12T01:01:56.551311+0000","last_clean":"2024-09-12T01:01:56.551311+0000","last_became_active":"2024-09-12T00:34:52.190350+0000","last_became_peered":"2024-09-12T00:34:52.190350+0000","last_unstale":"2024-09-12T01:01:56.551311+0000","last_undegraded":"2024-09-12T01:01:56.551311+0000","last_fullsized":"2024-09-12T01:01:56.551311+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:44.544700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'31","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:11.698235+0000","last_change":"2024-09-12T00:33:10.834922+0000","last_active":"2024-09-12T01:00:11.698235+0000","last_peered":"2024-09-12T01:00:11.698235+0000","last_clean":"2024-09-12T01:00:11.698235+0000","last_became_active":"2024-09-12T00:33:10.834095+0000","last_became_peered":"2024-09-12T00:33:10.834095+0000","last_unstale":"2024-09-12T01:00:11.698235+0000","last_undegraded":"2024-09-12T01:00:11.698235+0000","last_fullsized":"2024-09-12T01:00:11.698235+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:09.706426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":107,"num_write":54,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.755937+0000","last_change":"2024-09-12T00:46:09.502145+0000","last_active":"2024-09-12T01:01:56.755937+0000","last_peered":"2024-09-12T01:01:56.755937+0000","last_clean":"2024-09-12T01:01:56.755937+0000","last_became_active":"2024-09-12T00:46:09.500779+0000","last_became_peered":"2024-09-12T00:46:09.500779+0000","last_unstale":"2024-09-12T01:01:56.755937+0000","last_undegraded":"2024-09-12T01:01:56.755937+0000","last_fullsized":"2024-09-12T01:01:56.755937+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:52.290781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"268'6","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.532068+0000","last_change":"2024-09-12T00:34:55.242037+0000","last_active":"2024-09-12T01:00:57.532068+0000","last_peered":"2024-09-12T01:00:57.532068+0000","last_clean":"2024-09-12T01:00:57.532068+0000","last_became_active":"2024-09-12T00:34:55.241223+0000","last_became_peered":"2024-09-12T00:34:55.241223+0000","last_unstale":"2024-09-12T01:00:57.532068+0000","last_undegraded":"2024-09-12T01:00:57.532068+0000","last_fullsized":"2024-09-12T01:00:57.532068+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:56.166816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":9218,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"268'1","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:51.552448+0000","last_change":"2024-09-12T00:34:52.206116+0000","last_active":"2024-09-12T01:00:51.552448+0000","last_peered":"2024-09-12T01:00:51.552448+0000","last_clean":"2024-09-12T01:00:51.552448+0000","last_became_active":"2024-09-12T00:34:52.202407+0000","last_became_peered":"2024-09-12T00:34:52.202407+0000","last_unstale":"2024-09-12T01:00:51.552448+0000","last_undegraded":"2024-09-12T01:00:51.552448+0000","last_fullsized":"2024-09-12T01:00:51.552448+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:16.024426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'46","reported_seq":178,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:11.540316+0000","last_change":"2024-09-12T00:33:10.860057+0000","last_active":"2024-09-12T01:00:11.540316+0000","last_peered":"2024-09-12T01:00:11.540316+0000","last_clean":"2024-09-12T01:00:11.540316+0000","last_became_active":"2024-09-12T00:33:10.859459+0000","last_became_peered":"2024-09-12T00:33:10.859459+0000","last_unstale":"2024-09-12T01:00:11.540316+0000","last_undegraded":"2024-09-12T01:00:11.540316+0000","last_fullsized":"2024-09-12T01:00:11.540316+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:02.662726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":176,"num_write":75,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.546185+0000","last_change":"2024-09-12T00:46:09.505921+0000","last_active":"2024-09-12T01:02:02.546185+0000","last_peered":"2024-09-12T01:02:02.546185+0000","last_clean":"2024-09-12T01:02:02.546185+0000","last_became_active":"2024-09-12T00:46:09.505143+0000","last_became_peered":"2024-09-12T00:46:09.505143+0000","last_unstale":"2024-09-12T01:02:02.546185+0000","last_undegraded":"2024-09-12T01:02:02.546185+0000","last_fullsized":"2024-09-12T01:02:02.546185+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:58.286882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"268'1","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.530957+0000","last_change":"2024-09-12T00:34:55.253946+0000","last_active":"2024-09-12T01:00:57.530957+0000","last_peered":"2024-09-12T01:00:57.530957+0000","last_clean":"2024-09-12T01:00:57.530957+0000","last_became_active":"2024-09-12T00:34:55.253169+0000","last_became_peered":"2024-09-12T00:34:55.253169+0000","last_unstale":"2024-09-12T01:00:57.530957+0000","last_undegraded":"2024-09-12T01:00:57.530957+0000","last_fullsized":"2024-09-12T01:00:57.530957+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:41.186189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"268'1","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:51.534862+0000","last_change":"2024-09-12T00:34:52.190974+0000","last_active":"2024-09-12T01:00:51.534862+0000","last_peered":"2024-09-12T01:00:51.534862+0000","last_clean":"2024-09-12T01:00:51.534862+0000","last_became_active":"2024-09-12T00:34:52.190174+0000","last_became_peered":"2024-09-12T00:34:52.190174+0000","last_unstale":"2024-09-12T01:00:51.534862+0000","last_undegraded":"2024-09-12T01:00:51.534862+0000","last_fullsized":"2024-09-12T01:00:51.534862+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:22.602978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'29","reported_seq":121,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:32.539090+0000","last_change":"2024-09-12T00:33:10.850390+0000","last_active":"2024-09-12T01:01:32.539090+0000","last_peered":"2024-09-12T01:01:32.539090+0000","last_clean":"2024-09-12T01:01:32.539090+0000","last_became_active":"2024-09-12T00:33:10.849658+0000","last_became_peered":"2024-09-12T00:33:10.849658+0000","last_unstale":"2024-09-12T01:01:32.539090+0000","last_undegraded":"2024-09-12T01:01:32.539090+0000","last_fullsized":"2024-09-12T01:01:32.539090+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:17.300231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":91,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.545034+0000","last_change":"2024-09-12T00:46:09.487986+0000","last_active":"2024-09-12T01:01:57.545034+0000","last_peered":"2024-09-12T01:01:57.545034+0000","last_clean":"2024-09-12T01:01:57.545034+0000","last_became_active":"2024-09-12T00:46:09.485933+0000","last_became_peered":"2024-09-12T00:46:09.485933+0000","last_unstale":"2024-09-12T01:01:57.545034+0000","last_undegraded":"2024-09-12T01:01:57.545034+0000","last_fullsized":"2024-09-12T01:01:57.545034+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:26.699689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"268'1","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.551187+0000","last_change":"2024-09-12T00:34:55.237633+0000","last_active":"2024-09-12T01:01:56.551187+0000","last_peered":"2024-09-12T01:01:56.551187+0000","last_clean":"2024-09-12T01:01:56.551187+0000","last_became_active":"2024-09-12T00:34:55.236708+0000","last_became_peered":"2024-09-12T00:34:55.236708+0000","last_unstale":"2024-09-12T01:01:56.551187+0000","last_undegraded":"2024-09-12T01:01:56.551187+0000","last_fullsized":"2024-09-12T01:01:56.551187+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:53.892191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'2","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:01.554912+0000","last_change":"2024-09-12T00:34:52.209042+0000","last_active":"2024-09-12T01:01:01.554912+0000","last_peered":"2024-09-12T01:01:01.554912+0000","last_clean":"2024-09-12T01:01:01.554912+0000","last_became_active":"2024-09-12T00:34:52.205829+0000","last_became_peered":"2024-09-12T00:34:52.205829+0000","last_unstale":"2024-09-12T01:01:01.554912+0000","last_undegraded":"2024-09-12T01:01:01.554912+0000","last_fullsized":"2024-09-12T01:01:01.554912+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:59.524499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'30","reported_seq":133,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:21.746083+0000","last_change":"2024-09-12T00:33:10.825945+0000","last_active":"2024-09-12T01:01:21.746083+0000","last_peered":"2024-09-12T01:01:21.746083+0000","last_clean":"2024-09-12T01:01:21.746083+0000","last_became_active":"2024-09-12T00:33:10.825191+0000","last_became_peered":"2024-09-12T00:33:10.825191+0000","last_unstale":"2024-09-12T01:01:21.746083+0000","last_undegraded":"2024-09-12T01:01:21.746083+0000","last_fullsized":"2024-09-12T01:01:21.746083+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:47.230850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":116,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.571862+0000","last_change":"2024-09-12T00:46:09.505717+0000","last_active":"2024-09-12T01:01:56.571862+0000","last_peered":"2024-09-12T01:01:56.571862+0000","last_clean":"2024-09-12T01:01:56.571862+0000","last_became_active":"2024-09-12T00:46:09.504789+0000","last_became_peered":"2024-09-12T00:46:09.504789+0000","last_unstale":"2024-09-12T01:01:56.571862+0000","last_undegraded":"2024-09-12T01:01:56.571862+0000","last_fullsized":"2024-09-12T01:01:56.571862+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:54.929380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'2","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.533522+0000","last_change":"2024-09-12T00:34:55.238407+0000","last_active":"2024-09-12T01:01:07.533522+0000","last_peered":"2024-09-12T01:01:07.533522+0000","last_clean":"2024-09-12T01:01:07.533522+0000","last_became_active":"2024-09-12T00:34:55.237691+0000","last_became_peered":"2024-09-12T00:34:55.237691+0000","last_unstale":"2024-09-12T01:01:07.533522+0000","last_undegraded":"2024-09-12T01:01:07.533522+0000","last_fullsized":"2024-09-12T01:01:07.533522+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:43.698302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'8","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:52.545095+0000","last_change":"2024-09-12T00:34:52.200839+0000","last_active":"2024-09-12T01:01:52.545095+0000","last_peered":"2024-09-12T01:01:52.545095+0000","last_clean":"2024-09-12T01:01:52.545095+0000","last_became_active":"2024-09-12T00:34:52.200033+0000","last_became_peered":"2024-09-12T00:34:52.200033+0000","last_unstale":"2024-09-12T01:01:52.545095+0000","last_undegraded":"2024-09-12T01:01:52.545095+0000","last_fullsized":"2024-09-12T01:01:52.545095+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:12.523538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":17410,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'38","reported_seq":149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:20.583311+0000","last_change":"2024-09-12T00:33:10.856023+0000","last_active":"2024-09-12T01:02:20.583311+0000","last_peered":"2024-09-12T01:02:20.583311+0000","last_clean":"2024-09-12T01:02:20.583311+0000","last_became_active":"2024-09-12T00:33:10.855257+0000","last_became_peered":"2024-09-12T00:33:10.855257+0000","last_unstale":"2024-09-12T01:02:20.583311+0000","last_undegraded":"2024-09-12T01:02:20.583311+0000","last_fullsized":"2024-09-12T01:02:20.583311+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:54.073580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":126,"num_write":70,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.528702+0000","last_change":"2024-09-12T00:46:09.504978+0000","last_active":"2024-09-12T01:00:47.528702+0000","last_peered":"2024-09-12T01:00:47.528702+0000","last_clean":"2024-09-12T01:00:47.528702+0000","last_became_active":"2024-09-12T00:46:09.504114+0000","last_became_peered":"2024-09-12T00:46:09.504114+0000","last_unstale":"2024-09-12T01:00:47.528702+0000","last_undegraded":"2024-09-12T01:00:47.528702+0000","last_fullsized":"2024-09-12T01:00:47.528702+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:13.348535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'2","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.575855+0000","last_change":"2024-09-12T00:34:55.235646+0000","last_active":"2024-09-12T01:02:11.575855+0000","last_peered":"2024-09-12T01:02:11.575855+0000","last_clean":"2024-09-12T01:02:11.575855+0000","last_became_active":"2024-09-12T00:34:55.234795+0000","last_became_peered":"2024-09-12T00:34:55.234795+0000","last_unstale":"2024-09-12T01:02:11.575855+0000","last_undegraded":"2024-09-12T01:02:11.575855+0000","last_fullsized":"2024-09-12T01:02:11.575855+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:10.241846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"268'6","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.545015+0000","last_change":"2024-09-12T00:34:52.199095+0000","last_active":"2024-09-12T01:01:57.545015+0000","last_peered":"2024-09-12T01:01:57.545015+0000","last_clean":"2024-09-12T01:01:57.545015+0000","last_became_active":"2024-09-12T00:34:52.198346+0000","last_became_peered":"2024-09-12T00:34:52.198346+0000","last_unstale":"2024-09-12T01:01:57.545015+0000","last_undegraded":"2024-09-12T01:01:57.545015+0000","last_fullsized":"2024-09-12T01:01:57.545015+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:09.225827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":5122,"num_write":11,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'29","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:21.563766+0000","last_change":"2024-09-12T00:33:10.848211+0000","last_active":"2024-09-12T01:01:21.563766+0000","last_peered":"2024-09-12T01:01:21.563766+0000","last_clean":"2024-09-12T01:01:21.563766+0000","last_became_active":"2024-09-12T00:33:10.847386+0000","last_became_peered":"2024-09-12T00:33:10.847386+0000","last_unstale":"2024-09-12T01:01:21.563766+0000","last_undegraded":"2024-09-12T01:01:21.563766+0000","last_fullsized":"2024-09-12T01:01:21.563766+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:03.256270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":106,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.732885+0000","last_change":"2024-09-12T00:46:09.514213+0000","last_active":"2024-09-12T01:00:47.732885+0000","last_peered":"2024-09-12T01:00:47.732885+0000","last_clean":"2024-09-12T01:00:47.732885+0000","last_became_active":"2024-09-12T00:46:09.509685+0000","last_became_peered":"2024-09-12T00:46:09.509685+0000","last_unstale":"2024-09-12T01:00:47.732885+0000","last_undegraded":"2024-09-12T01:00:47.732885+0000","last_fullsized":"2024-09-12T01:00:47.732885+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:20.031144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"268'1","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:01.573271+0000","last_change":"2024-09-12T00:34:55.251608+0000","last_active":"2024-09-12T01:02:01.573271+0000","last_peered":"2024-09-12T01:02:01.573271+0000","last_clean":"2024-09-12T01:02:01.573271+0000","last_became_active":"2024-09-12T00:34:55.251057+0000","last_became_peered":"2024-09-12T00:34:55.251057+0000","last_unstale":"2024-09-12T01:02:01.573271+0000","last_undegraded":"2024-09-12T01:02:01.573271+0000","last_fullsized":"2024-09-12T01:02:01.573271+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:44.787440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"268'5","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.720915+0000","last_change":"2024-09-12T00:34:52.178623+0000","last_active":"2024-09-12T01:01:56.720915+0000","last_peered":"2024-09-12T01:01:56.720915+0000","last_clean":"2024-09-12T01:01:56.720915+0000","last_became_active":"2024-09-12T00:34:52.177088+0000","last_became_peered":"2024-09-12T00:34:52.177088+0000","last_unstale":"2024-09-12T01:01:56.720915+0000","last_undegraded":"2024-09-12T01:01:56.720915+0000","last_fullsized":"2024-09-12T01:01:56.720915+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:51.705833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":15,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"268'21","reported_seq":103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:22.721225+0000","last_change":"2024-09-12T00:33:10.845217+0000","last_active":"2024-09-12T01:01:22.721225+0000","last_peered":"2024-09-12T01:01:22.721225+0000","last_clean":"2024-09-12T01:01:22.721225+0000","last_became_active":"2024-09-12T00:33:10.844093+0000","last_became_peered":"2024-09-12T00:33:10.844093+0000","last_unstale":"2024-09-12T01:01:22.721225+0000","last_undegraded":"2024-09-12T01:01:22.721225+0000","last_fullsized":"2024-09-12T01:01:22.721225+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:20.325448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":69,"num_write":38,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:16.556161+0000","last_change":"2024-09-12T00:46:09.498490+0000","last_active":"2024-09-12T01:02:16.556161+0000","last_peered":"2024-09-12T01:02:16.556161+0000","last_clean":"2024-09-12T01:02:16.556161+0000","last_became_active":"2024-09-12T00:46:09.497751+0000","last_became_peered":"2024-09-12T00:46:09.497751+0000","last_unstale":"2024-09-12T01:02:16.556161+0000","last_undegraded":"2024-09-12T01:02:16.556161+0000","last_fullsized":"2024-09-12T01:02:16.556161+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.301246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":36,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.531241+0000","last_change":"2024-09-12T00:34:55.254981+0000","last_active":"2024-09-12T01:00:57.531241+0000","last_peered":"2024-09-12T01:00:57.531241+0000","last_clean":"2024-09-12T01:00:57.531241+0000","last_became_active":"2024-09-12T00:34:55.254446+0000","last_became_peered":"2024-09-12T00:34:55.254446+0000","last_unstale":"2024-09-12T01:00:57.531241+0000","last_undegraded":"2024-09-12T01:00:57.531241+0000","last_fullsized":"2024-09-12T01:00:57.531241+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:32.699370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:52.734131+0000","last_change":"2024-09-12T00:34:52.194065+0000","last_active":"2024-09-12T01:00:52.734131+0000","last_peered":"2024-09-12T01:00:52.734131+0000","last_clean":"2024-09-12T01:00:52.734131+0000","last_became_active":"2024-09-12T00:34:52.193306+0000","last_became_peered":"2024-09-12T00:34:52.193306+0000","last_unstale":"2024-09-12T01:00:52.734131+0000","last_undegraded":"2024-09-12T01:00:52.734131+0000","last_fullsized":"2024-09-12T01:00:52.734131+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:42.593529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"268'36","reported_seq":152,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:32.552885+0000","last_change":"2024-09-12T00:33:10.860393+0000","last_active":"2024-09-12T01:02:32.552885+0000","last_peered":"2024-09-12T01:02:32.552885+0000","last_clean":"2024-09-12T01:02:32.552885+0000","last_became_active":"2024-09-12T00:33:10.859799+0000","last_became_peered":"2024-09-12T00:33:10.859799+0000","last_unstale":"2024-09-12T01:02:32.552885+0000","last_undegraded":"2024-09-12T01:02:32.552885+0000","last_fullsized":"2024-09-12T01:02:32.552885+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:39.916797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":137,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.529751+0000","last_change":"2024-09-12T00:46:09.499691+0000","last_active":"2024-09-12T01:00:47.529751+0000","last_peered":"2024-09-12T01:00:47.529751+0000","last_clean":"2024-09-12T01:00:47.529751+0000","last_became_active":"2024-09-12T00:46:09.498942+0000","last_became_peered":"2024-09-12T00:46:09.498942+0000","last_unstale":"2024-09-12T01:00:47.529751+0000","last_undegraded":"2024-09-12T01:00:47.529751+0000","last_fullsized":"2024-09-12T01:00:47.529751+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:21.881186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'1","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.532379+0000","last_change":"2024-09-12T00:34:55.215046+0000","last_active":"2024-09-12T01:00:57.532379+0000","last_peered":"2024-09-12T01:00:57.532379+0000","last_clean":"2024-09-12T01:00:57.532379+0000","last_became_active":"2024-09-12T00:34:55.214265+0000","last_became_peered":"2024-09-12T00:34:55.214265+0000","last_unstale":"2024-09-12T01:00:57.532379+0000","last_undegraded":"2024-09-12T01:00:57.532379+0000","last_fullsized":"2024-09-12T01:00:57.532379+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:54.580385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"268'6","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:52.530010+0000","last_change":"2024-09-12T00:34:52.204774+0000","last_active":"2024-09-12T01:00:52.530010+0000","last_peered":"2024-09-12T01:00:52.530010+0000","last_clean":"2024-09-12T01:00:52.530010+0000","last_became_active":"2024-09-12T00:34:52.204050+0000","last_became_peered":"2024-09-12T00:34:52.204050+0000","last_unstale":"2024-09-12T01:00:52.530010+0000","last_undegraded":"2024-09-12T01:00:52.530010+0000","last_fullsized":"2024-09-12T01:00:52.530010+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:46.767075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'20","reported_seq":104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.557497+0000","last_change":"2024-09-12T00:33:10.842211+0000","last_active":"2024-09-12T01:02:21.557497+0000","last_peered":"2024-09-12T01:02:21.557497+0000","last_clean":"2024-09-12T01:02:21.557497+0000","last_became_active":"2024-09-12T00:33:10.841411+0000","last_became_peered":"2024-09-12T00:33:10.841411+0000","last_unstale":"2024-09-12T01:02:21.557497+0000","last_undegraded":"2024-09-12T01:02:21.557497+0000","last_fullsized":"2024-09-12T01:02:21.557497+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:13.664749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":70,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"267'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:21.713593+0000","last_change":"2024-09-12T00:46:09.520640+0000","last_active":"2024-09-12T01:01:21.713593+0000","last_peered":"2024-09-12T01:01:21.713593+0000","last_clean":"2024-09-12T01:01:21.713593+0000","last_became_active":"2024-09-12T00:46:09.520251+0000","last_became_peered":"2024-09-12T00:46:09.520251+0000","last_unstale":"2024-09-12T01:01:21.713593+0000","last_undegraded":"2024-09-12T01:01:21.713593+0000","last_fullsized":"2024-09-12T01:01:21.713593+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:17.060682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"268'4","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:01.552378+0000","last_change":"2024-09-12T00:34:55.232689+0000","last_active":"2024-09-12T01:02:01.552378+0000","last_peered":"2024-09-12T01:02:01.552378+0000","last_clean":"2024-09-12T01:02:01.552378+0000","last_became_active":"2024-09-12T00:34:55.230698+0000","last_became_peered":"2024-09-12T00:34:55.230698+0000","last_unstale":"2024-09-12T01:02:01.552378+0000","last_undegraded":"2024-09-12T01:02:01.552378+0000","last_fullsized":"2024-09-12T01:02:01.552378+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:43.460598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"265'5","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.532248+0000","last_change":"2024-09-12T00:34:52.212267+0000","last_active":"2024-09-12T01:01:02.532248+0000","last_peered":"2024-09-12T01:01:02.532248+0000","last_clean":"2024-09-12T01:01:02.532248+0000","last_became_active":"2024-09-12T00:34:52.211709+0000","last_became_peered":"2024-09-12T00:34:52.211709+0000","last_unstale":"2024-09-12T01:01:02.532248+0000","last_undegraded":"2024-09-12T01:01:02.532248+0000","last_fullsized":"2024-09-12T01:01:02.532248+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:37.180708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'225","reported_seq":751,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:22.754603+0000","last_change":"2024-09-12T00:33:10.853482+0000","last_active":"2024-09-12T01:02:22.754603+0000","last_peered":"2024-09-12T01:02:22.754603+0000","last_clean":"2024-09-12T01:02:22.754603+0000","last_became_active":"2024-09-12T00:33:10.852751+0000","last_became_peered":"2024-09-12T00:33:10.852751+0000","last_unstale":"2024-09-12T01:02:22.754603+0000","last_undegraded":"2024-09-12T01:02:22.754603+0000","last_fullsized":"2024-09-12T01:02:22.754603+0000","mapping_epoch":255,"log_start":"265'200","ondisk_log_start":"265'200","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:29.381396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1385,"num_read_kb":1074,"num_write":267,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:21.563715+0000","last_change":"2024-09-12T00:46:09.516940+0000","last_active":"2024-09-12T01:01:21.563715+0000","last_peered":"2024-09-12T01:01:21.563715+0000","last_clean":"2024-09-12T01:01:21.563715+0000","last_became_active":"2024-09-12T00:46:09.516404+0000","last_became_peered":"2024-09-12T00:46:09.516404+0000","last_unstale":"2024-09-12T01:01:21.563715+0000","last_undegraded":"2024-09-12T01:01:21.563715+0000","last_fullsized":"2024-09-12T01:01:21.563715+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:40.623194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"268'5","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.735055+0000","last_change":"2024-09-12T00:34:55.236475+0000","last_active":"2024-09-12T01:00:57.735055+0000","last_peered":"2024-09-12T01:00:57.735055+0000","last_clean":"2024-09-12T01:00:57.735055+0000","last_became_active":"2024-09-12T00:34:55.235522+0000","last_became_peered":"2024-09-12T00:34:55.235522+0000","last_unstale":"2024-09-12T01:00:57.735055+0000","last_undegraded":"2024-09-12T01:00:57.735055+0000","last_fullsized":"2024-09-12T01:00:57.735055+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:26.945052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":5,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"268'5","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.544918+0000","last_change":"2024-09-12T00:34:52.184510+0000","last_active":"2024-09-12T01:01:57.544918+0000","last_peered":"2024-09-12T01:01:57.544918+0000","last_clean":"2024-09-12T01:01:57.544918+0000","last_became_active":"2024-09-12T00:34:52.183769+0000","last_became_peered":"2024-09-12T00:34:52.183769+0000","last_unstale":"2024-09-12T01:01:57.544918+0000","last_undegraded":"2024-09-12T01:01:57.544918+0000","last_fullsized":"2024-09-12T01:01:57.544918+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:59.439643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8194,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'27","reported_seq":122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:22.554180+0000","last_change":"2024-09-12T00:33:10.831668+0000","last_active":"2024-09-12T01:02:22.554180+0000","last_peered":"2024-09-12T01:02:22.554180+0000","last_clean":"2024-09-12T01:02:22.554180+0000","last_became_active":"2024-09-12T00:33:10.830931+0000","last_became_peered":"2024-09-12T00:33:10.830931+0000","last_unstale":"2024-09-12T01:02:22.554180+0000","last_undegraded":"2024-09-12T01:02:22.554180+0000","last_fullsized":"2024-09-12T01:02:22.554180+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:45.604877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":90,"num_write":55,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:46.551264+0000","last_change":"2024-09-12T00:46:09.518153+0000","last_active":"2024-09-12T01:00:46.551264+0000","last_peered":"2024-09-12T01:00:46.551264+0000","last_clean":"2024-09-12T01:00:46.551264+0000","last_became_active":"2024-09-12T00:46:09.517353+0000","last_became_peered":"2024-09-12T00:46:09.517353+0000","last_unstale":"2024-09-12T01:00:46.551264+0000","last_undegraded":"2024-09-12T01:00:46.551264+0000","last_fullsized":"2024-09-12T01:00:46.551264+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:41.256919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"268'8","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.729350+0000","last_change":"2024-09-12T00:34:55.225406+0000","last_active":"2024-09-12T01:02:02.729350+0000","last_peered":"2024-09-12T01:02:02.729350+0000","last_clean":"2024-09-12T01:02:02.729350+0000","last_became_active":"2024-09-12T00:34:55.224353+0000","last_became_peered":"2024-09-12T00:34:55.224353+0000","last_unstale":"2024-09-12T01:02:02.729350+0000","last_undegraded":"2024-09-12T01:02:02.729350+0000","last_fullsized":"2024-09-12T01:02:02.729350+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:35.525207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":22530,"num_write":13,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"268'3","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.551132+0000","last_change":"2024-09-12T00:34:52.204414+0000","last_active":"2024-09-12T01:01:56.551132+0000","last_peered":"2024-09-12T01:01:56.551132+0000","last_clean":"2024-09-12T01:01:56.551132+0000","last_became_active":"2024-09-12T00:34:52.203625+0000","last_became_peered":"2024-09-12T00:34:52.203625+0000","last_unstale":"2024-09-12T01:01:56.551132+0000","last_undegraded":"2024-09-12T01:01:56.551132+0000","last_fullsized":"2024-09-12T01:01:56.551132+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:35.762002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5303249,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":10299,"num_write":3,"num_write_kb":5179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'24","reported_seq":111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:22.733835+0000","last_change":"2024-09-12T00:33:10.845131+0000","last_active":"2024-09-12T01:02:22.733835+0000","last_peered":"2024-09-12T01:02:22.733835+0000","last_clean":"2024-09-12T01:02:22.733835+0000","last_became_active":"2024-09-12T00:33:10.844416+0000","last_became_peered":"2024-09-12T00:33:10.844416+0000","last_unstale":"2024-09-12T01:02:22.733835+0000","last_undegraded":"2024-09-12T01:02:22.733835+0000","last_fullsized":"2024-09-12T01:02:22.733835+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:44.761181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:52.529941+0000","last_change":"2024-09-12T00:46:09.494534+0000","last_active":"2024-09-12T01:00:52.529941+0000","last_peered":"2024-09-12T01:00:52.529941+0000","last_clean":"2024-09-12T01:00:52.529941+0000","last_became_active":"2024-09-12T00:46:09.493808+0000","last_became_peered":"2024-09-12T00:46:09.493808+0000","last_unstale":"2024-09-12T01:00:52.529941+0000","last_undegraded":"2024-09-12T01:00:52.529941+0000","last_fullsized":"2024-09-12T01:00:52.529941+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:01.945866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"268'1","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.547434+0000","last_change":"2024-09-12T00:34:55.234328+0000","last_active":"2024-09-12T01:02:02.547434+0000","last_peered":"2024-09-12T01:02:02.547434+0000","last_clean":"2024-09-12T01:02:02.547434+0000","last_became_active":"2024-09-12T00:34:55.233708+0000","last_became_peered":"2024-09-12T00:34:55.233708+0000","last_unstale":"2024-09-12T01:02:02.547434+0000","last_undegraded":"2024-09-12T01:02:02.547434+0000","last_fullsized":"2024-09-12T01:02:02.547434+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:10.278114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"268'1","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.728291+0000","last_change":"2024-09-12T00:34:52.188218+0000","last_active":"2024-09-12T01:01:57.728291+0000","last_peered":"2024-09-12T01:01:57.728291+0000","last_clean":"2024-09-12T01:01:57.728291+0000","last_became_active":"2024-09-12T00:34:52.186234+0000","last_became_peered":"2024-09-12T00:34:52.186234+0000","last_unstale":"2024-09-12T01:01:57.728291+0000","last_undegraded":"2024-09-12T01:01:57.728291+0000","last_fullsized":"2024-09-12T01:01:57.728291+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:37.401626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'27","reported_seq":126,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:22.536821+0000","last_change":"2024-09-12T00:33:10.853895+0000","last_active":"2024-09-12T01:01:22.536821+0000","last_peered":"2024-09-12T01:01:22.536821+0000","last_clean":"2024-09-12T01:01:22.536821+0000","last_became_active":"2024-09-12T00:33:10.853205+0000","last_became_peered":"2024-09-12T00:33:10.853205+0000","last_unstale":"2024-09-12T01:01:22.536821+0000","last_undegraded":"2024-09-12T01:01:22.536821+0000","last_fullsized":"2024-09-12T01:01:22.536821+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:11.434006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":100,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'301","reported_seq":948,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.658623+0000","last_change":"2024-09-12T00:18:22.882778+0000","last_active":"2024-09-12T01:02:57.658623+0000","last_peered":"2024-09-12T01:02:57.658623+0000","last_clean":"2024-09-12T01:02:57.658623+0000","last_became_active":"2024-09-12T00:18:22.878117+0000","last_became_peered":"2024-09-12T00:18:22.878117+0000","last_unstale":"2024-09-12T01:02:57.658623+0000","last_undegraded":"2024-09-12T01:02:57.658623+0000","last_fullsized":"2024-09-12T01:02:57.658623+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:42.771146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11589007,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":460,"num_read_kb":62532,"num_write":1140,"num_write_kb":43415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'436","reported_seq":1878,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.826302+0000","last_change":"2024-09-12T00:18:24.871900+0000","last_active":"2024-09-12T01:04:30.826302+0000","last_peered":"2024-09-12T01:04:30.826302+0000","last_clean":"2024-09-12T01:04:30.826302+0000","last_became_active":"2024-09-12T00:18:24.870370+0000","last_became_peered":"2024-09-12T00:18:24.870370+0000","last_unstale":"2024-09-12T01:04:30.826302+0000","last_undegraded":"2024-09-12T01:04:30.826302+0000","last_fullsized":"2024-09-12T01:04:30.826302+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:30.348388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2205,"num_read_kb":2060,"num_write":503,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'274","reported_seq":919,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:26.407073+0000","last_change":"2024-09-12T00:18:22.845696+0000","last_active":"2024-09-12T01:04:26.407073+0000","last_peered":"2024-09-12T01:04:26.407073+0000","last_clean":"2024-09-12T01:04:26.407073+0000","last_became_active":"2024-09-12T00:18:22.845439+0000","last_became_peered":"2024-09-12T00:18:22.845439+0000","last_unstale":"2024-09-12T01:04:26.407073+0000","last_undegraded":"2024-09-12T01:04:26.407073+0000","last_fullsized":"2024-09-12T01:04:26.407073+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:58.019520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11065218,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":421,"num_read_kb":5684,"num_write":947,"num_write_kb":33510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'1348","reported_seq":3035,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.828330+0000","last_change":"2024-09-12T00:18:24.872059+0000","last_active":"2024-09-12T01:04:30.828330+0000","last_peered":"2024-09-12T01:04:30.828330+0000","last_clean":"2024-09-12T01:04:30.828330+0000","last_became_active":"2024-09-12T00:18:24.866026+0000","last_became_peered":"2024-09-12T00:18:24.866026+0000","last_unstale":"2024-09-12T01:04:30.828330+0000","last_undegraded":"2024-09-12T01:04:30.828330+0000","last_fullsized":"2024-09-12T01:04:30.828330+0000","mapping_epoch":26,"log_start":"268'1300","ondisk_log_start":"268'1300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":1300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:28.162969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6196,"num_read_kb":5451,"num_write":1895,"num_write_kb":802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'280","reported_seq":969,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.555954+0000","last_change":"2024-09-12T00:18:22.839649+0000","last_active":"2024-09-12T01:02:49.555954+0000","last_peered":"2024-09-12T01:02:49.555954+0000","last_clean":"2024-09-12T01:02:49.555954+0000","last_became_active":"2024-09-12T00:18:22.839379+0000","last_became_peered":"2024-09-12T00:18:22.839379+0000","last_unstale":"2024-09-12T01:02:49.555954+0000","last_undegraded":"2024-09-12T01:02:49.555954+0000","last_fullsized":"2024-09-12T01:02:49.555954+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:58.587843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1925566,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":510,"num_read_kb":68999,"num_write":1025,"num_write_kb":32744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'868","reported_seq":2673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.884045+0000","last_change":"2024-09-12T00:18:24.861905+0000","last_active":"2024-09-12T01:03:25.884045+0000","last_peered":"2024-09-12T01:03:25.884045+0000","last_clean":"2024-09-12T01:03:25.884045+0000","last_became_active":"2024-09-12T00:18:24.860995+0000","last_became_peered":"2024-09-12T00:18:24.860995+0000","last_unstale":"2024-09-12T01:03:25.884045+0000","last_undegraded":"2024-09-12T01:03:25.884045+0000","last_fullsized":"2024-09-12T01:03:25.884045+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:40.241884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4298,"num_read_kb":3905,"num_write":1128,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'273","reported_seq":930,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.349468+0000","last_change":"2024-09-12T00:18:55.961308+0000","last_active":"2024-09-12T01:02:46.349468+0000","last_peered":"2024-09-12T01:02:46.349468+0000","last_clean":"2024-09-12T01:02:46.349468+0000","last_became_active":"2024-09-12T00:18:55.960413+0000","last_became_peered":"2024-09-12T00:18:55.960413+0000","last_unstale":"2024-09-12T01:02:46.349468+0000","last_undegraded":"2024-09-12T01:02:46.349468+0000","last_fullsized":"2024-09-12T01:02:46.349468+0000","mapping_epoch":37,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:23.952063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5101376,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":426,"num_read_kb":54974,"num_write":1014,"num_write_kb":32836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'765","reported_seq":2314,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.594303+0000","last_change":"2024-09-12T00:18:55.956119+0000","last_active":"2024-09-12T01:03:26.594303+0000","last_peered":"2024-09-12T01:03:26.594303+0000","last_clean":"2024-09-12T01:03:26.594303+0000","last_became_active":"2024-09-12T00:18:55.955870+0000","last_became_peered":"2024-09-12T00:18:55.955870+0000","last_unstale":"2024-09-12T01:03:26.594303+0000","last_undegraded":"2024-09-12T01:03:26.594303+0000","last_fullsized":"2024-09-12T01:03:26.594303+0000","mapping_epoch":37,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:06.351457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3626,"num_read_kb":3280,"num_write":1010,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'287","reported_seq":916,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.084946+0000","last_change":"2024-09-12T00:18:22.878663+0000","last_active":"2024-09-12T01:02:51.084946+0000","last_peered":"2024-09-12T01:02:51.084946+0000","last_clean":"2024-09-12T01:02:51.084946+0000","last_became_active":"2024-09-12T00:18:22.870564+0000","last_became_peered":"2024-09-12T00:18:22.870564+0000","last_unstale":"2024-09-12T01:02:51.084946+0000","last_undegraded":"2024-09-12T01:02:51.084946+0000","last_fullsized":"2024-09-12T01:02:51.084946+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:54.849057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9915971,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":448,"num_read_kb":32133,"num_write":990,"num_write_kb":41090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"268'482","reported_seq":2083,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.841743+0000","last_change":"2024-09-12T00:18:24.847333+0000","last_active":"2024-09-12T01:04:30.841743+0000","last_peered":"2024-09-12T01:04:30.841743+0000","last_clean":"2024-09-12T01:04:30.841743+0000","last_became_active":"2024-09-12T00:18:24.846508+0000","last_became_peered":"2024-09-12T00:18:24.846508+0000","last_unstale":"2024-09-12T01:04:30.841743+0000","last_undegraded":"2024-09-12T01:04:30.841743+0000","last_fullsized":"2024-09-12T01:04:30.841743+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:28.677103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2844,"num_read_kb":2655,"num_write":659,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'287","reported_seq":922,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.582459+0000","last_change":"2024-09-12T00:18:22.862931+0000","last_active":"2024-09-12T01:03:02.582459+0000","last_peered":"2024-09-12T01:03:02.582459+0000","last_clean":"2024-09-12T01:03:02.582459+0000","last_became_active":"2024-09-12T00:18:22.861074+0000","last_became_peered":"2024-09-12T00:18:22.861074+0000","last_unstale":"2024-09-12T01:03:02.582459+0000","last_undegraded":"2024-09-12T01:03:02.582459+0000","last_fullsized":"2024-09-12T01:03:02.582459+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:03.827376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704504,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":479,"num_read_kb":4860,"num_write":1022,"num_write_kb":10925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'1019","reported_seq":2748,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.884432+0000","last_change":"2024-09-12T00:18:24.878012+0000","last_active":"2024-09-12T01:03:25.884432+0000","last_peered":"2024-09-12T01:03:25.884432+0000","last_clean":"2024-09-12T01:03:25.884432+0000","last_became_active":"2024-09-12T00:18:24.875913+0000","last_became_peered":"2024-09-12T00:18:24.875913+0000","last_unstale":"2024-09-12T01:03:25.884432+0000","last_undegraded":"2024-09-12T01:03:25.884432+0000","last_fullsized":"2024-09-12T01:03:25.884432+0000","mapping_epoch":26,"log_start":"268'1000","ondisk_log_start":"268'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":1000,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:16.720932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4809,"num_read_kb":4259,"num_write":1397,"num_write_kb":538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'235","reported_seq":821,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:05.474842+0000","last_change":"2024-09-12T00:19:56.413205+0000","last_active":"2024-09-12T01:01:05.474842+0000","last_peered":"2024-09-12T01:01:05.474842+0000","last_clean":"2024-09-12T01:01:05.474842+0000","last_became_active":"2024-09-12T00:19:56.412792+0000","last_became_peered":"2024-09-12T00:19:56.412792+0000","last_unstale":"2024-09-12T01:01:05.474842+0000","last_undegraded":"2024-09-12T01:01:05.474842+0000","last_fullsized":"2024-09-12T01:01:05.474842+0000","mapping_epoch":39,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:43.504414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16348253,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":352,"num_read_kb":40979,"num_write":922,"num_write_kb":28776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"268'464","reported_seq":2043,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.191451+0000","last_change":"2024-09-12T00:18:24.862828+0000","last_active":"2024-09-12T01:03:11.191451+0000","last_peered":"2024-09-12T01:03:11.191451+0000","last_clean":"2024-09-12T01:03:11.191451+0000","last_became_active":"2024-09-12T00:18:24.862084+0000","last_became_peered":"2024-09-12T00:18:24.862084+0000","last_unstale":"2024-09-12T01:03:11.191451+0000","last_undegraded":"2024-09-12T01:03:11.191451+0000","last_fullsized":"2024-09-12T01:03:11.191451+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:22.898376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2471,"num_read_kb":2327,"num_write":538,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'300","reported_seq":947,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:17.852530+0000","last_change":"2024-09-12T00:18:22.867992+0000","last_active":"2024-09-12T01:02:17.852530+0000","last_peered":"2024-09-12T01:02:17.852530+0000","last_clean":"2024-09-12T01:02:17.852530+0000","last_became_active":"2024-09-12T00:18:22.867749+0000","last_became_peered":"2024-09-12T00:18:22.867749+0000","last_unstale":"2024-09-12T01:02:17.852530+0000","last_undegraded":"2024-09-12T01:02:17.852530+0000","last_fullsized":"2024-09-12T01:02:17.852530+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:43.955119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11592589,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":459,"num_read_kb":6849,"num_write":1135,"num_write_kb":38257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'505","reported_seq":2322,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.741434+0000","last_change":"2024-09-12T00:18:24.848517+0000","last_active":"2024-09-12T01:03:06.741434+0000","last_peered":"2024-09-12T01:03:06.741434+0000","last_clean":"2024-09-12T01:03:06.741434+0000","last_became_active":"2024-09-12T00:18:24.848163+0000","last_became_peered":"2024-09-12T00:18:24.848163+0000","last_unstale":"2024-09-12T01:03:06.741434+0000","last_undegraded":"2024-09-12T01:03:06.741434+0000","last_fullsized":"2024-09-12T01:03:06.741434+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:12.252460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2972,"num_read_kb":2819,"num_write":593,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'484","reported_seq":2139,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.426992+0000","last_change":"2024-09-12T00:18:24.861887+0000","last_active":"2024-09-12T01:03:09.426992+0000","last_peered":"2024-09-12T01:03:09.426992+0000","last_clean":"2024-09-12T01:03:09.426992+0000","last_became_active":"2024-09-12T00:18:24.860744+0000","last_became_peered":"2024-09-12T00:18:24.860744+0000","last_unstale":"2024-09-12T01:03:09.426992+0000","last_undegraded":"2024-09-12T01:03:09.426992+0000","last_fullsized":"2024-09-12T01:03:09.426992+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:47.298360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2780,"num_read_kb":2600,"num_write":590,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'252","reported_seq":857,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.546217+0000","last_change":"2024-09-12T00:18:55.963205+0000","last_active":"2024-09-12T01:02:02.546217+0000","last_peered":"2024-09-12T01:02:02.546217+0000","last_clean":"2024-09-12T01:02:02.546217+0000","last_became_active":"2024-09-12T00:18:55.962742+0000","last_became_peered":"2024-09-12T00:18:55.962742+0000","last_unstale":"2024-09-12T01:02:02.546217+0000","last_undegraded":"2024-09-12T01:02:02.546217+0000","last_fullsized":"2024-09-12T01:02:02.546217+0000","mapping_epoch":37,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:05.336107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19072504,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":335,"num_read_kb":39262,"num_write":879,"num_write_kb":33071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'395","reported_seq":1848,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.099361+0000","last_change":"2024-09-12T00:18:24.873912+0000","last_active":"2024-09-12T01:03:25.099361+0000","last_peered":"2024-09-12T01:03:25.099361+0000","last_clean":"2024-09-12T01:03:25.099361+0000","last_became_active":"2024-09-12T00:18:24.872902+0000","last_became_peered":"2024-09-12T00:18:24.872902+0000","last_unstale":"2024-09-12T01:03:25.099361+0000","last_undegraded":"2024-09-12T01:03:25.099361+0000","last_fullsized":"2024-09-12T01:03:25.099361+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:21.474486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2097,"num_read_kb":1984,"num_write":437,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'239","reported_seq":850,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.898205+0000","last_change":"2024-09-12T00:18:22.864186+0000","last_active":"2024-09-12T01:03:21.898205+0000","last_peered":"2024-09-12T01:03:21.898205+0000","last_clean":"2024-09-12T01:03:21.898205+0000","last_became_active":"2024-09-12T00:18:22.860078+0000","last_became_peered":"2024-09-12T00:18:22.860078+0000","last_unstale":"2024-09-12T01:03:21.898205+0000","last_undegraded":"2024-09-12T01:03:21.898205+0000","last_fullsized":"2024-09-12T01:03:21.898205+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:36.759909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13972538,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":347,"num_read_kb":38650,"num_write":881,"num_write_kb":29439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"268'420","reported_seq":2039,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.347017+0000","last_change":"2024-09-12T00:18:24.852828+0000","last_active":"2024-09-12T01:03:37.347017+0000","last_peered":"2024-09-12T01:03:37.347017+0000","last_clean":"2024-09-12T01:03:37.347017+0000","last_became_active":"2024-09-12T00:18:24.852029+0000","last_became_peered":"2024-09-12T00:18:24.852029+0000","last_unstale":"2024-09-12T01:03:37.347017+0000","last_undegraded":"2024-09-12T01:03:37.347017+0000","last_fullsized":"2024-09-12T01:03:37.347017+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:43.017405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2334,"num_read_kb":2233,"num_write":466,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'243","reported_seq":845,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.538010+0000","last_change":"2024-09-12T00:18:22.863392+0000","last_active":"2024-09-12T01:02:02.538010+0000","last_peered":"2024-09-12T01:02:02.538010+0000","last_clean":"2024-09-12T01:02:02.538010+0000","last_became_active":"2024-09-12T00:18:22.862665+0000","last_became_peered":"2024-09-12T00:18:22.862665+0000","last_unstale":"2024-09-12T01:02:02.538010+0000","last_undegraded":"2024-09-12T01:02:02.538010+0000","last_fullsized":"2024-09-12T01:02:02.538010+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:02.077750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8421745,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":327,"num_read_kb":22932,"num_write":871,"num_write_kb":21492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'474","reported_seq":2097,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.094302+0000","last_change":"2024-09-12T00:18:24.850211+0000","last_active":"2024-09-12T01:03:04.094302+0000","last_peered":"2024-09-12T01:03:04.094302+0000","last_clean":"2024-09-12T01:03:04.094302+0000","last_became_active":"2024-09-12T00:18:24.849491+0000","last_became_peered":"2024-09-12T00:18:24.849491+0000","last_unstale":"2024-09-12T01:03:04.094302+0000","last_undegraded":"2024-09-12T01:03:04.094302+0000","last_fullsized":"2024-09-12T01:03:04.094302+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:35.044376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2579,"num_read_kb":2421,"num_write":543,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'273","reported_seq":898,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:40.430540+0000","last_change":"2024-09-12T00:18:22.857585+0000","last_active":"2024-09-12T01:02:40.430540+0000","last_peered":"2024-09-12T01:02:40.430540+0000","last_clean":"2024-09-12T01:02:40.430540+0000","last_became_active":"2024-09-12T00:18:22.856051+0000","last_became_peered":"2024-09-12T00:18:22.856051+0000","last_unstale":"2024-09-12T01:02:40.430540+0000","last_undegraded":"2024-09-12T01:02:40.430540+0000","last_fullsized":"2024-09-12T01:02:40.430540+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:50.867035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5601827,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":382,"num_read_kb":24886,"num_write":993,"num_write_kb":15091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"268'428","reported_seq":1974,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.171993+0000","last_change":"2024-09-12T00:18:24.854571+0000","last_active":"2024-09-12T01:02:58.171993+0000","last_peered":"2024-09-12T01:02:58.171993+0000","last_clean":"2024-09-12T01:02:58.171993+0000","last_became_active":"2024-09-12T00:18:24.853796+0000","last_became_peered":"2024-09-12T00:18:24.853796+0000","last_unstale":"2024-09-12T01:02:58.171993+0000","last_undegraded":"2024-09-12T01:02:58.171993+0000","last_fullsized":"2024-09-12T01:02:58.171993+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:33.514455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2472,"num_read_kb":2322,"num_write":521,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'270","reported_seq":1023,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.724364+0000","last_change":"2024-09-12T00:18:22.838428+0000","last_active":"2024-09-12T01:02:58.724364+0000","last_peered":"2024-09-12T01:02:58.724364+0000","last_clean":"2024-09-12T01:02:58.724364+0000","last_became_active":"2024-09-12T00:18:22.834904+0000","last_became_peered":"2024-09-12T00:18:22.834904+0000","last_unstale":"2024-09-12T01:02:58.724364+0000","last_undegraded":"2024-09-12T01:02:58.724364+0000","last_fullsized":"2024-09-12T01:02:58.724364+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:19.289534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12614868,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":531,"num_read_kb":49706,"num_write":1001,"num_write_kb":43110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'502","reported_seq":2049,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.347103+0000","last_change":"2024-09-12T00:18:24.876805+0000","last_active":"2024-09-12T01:03:37.347103+0000","last_peered":"2024-09-12T01:03:37.347103+0000","last_clean":"2024-09-12T01:03:37.347103+0000","last_became_active":"2024-09-12T00:18:24.875112+0000","last_became_peered":"2024-09-12T00:18:24.875112+0000","last_unstale":"2024-09-12T01:03:37.347103+0000","last_undegraded":"2024-09-12T01:03:37.347103+0000","last_fullsized":"2024-09-12T01:03:37.347103+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:20.839260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2595,"num_read_kb":2402,"num_write":619,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'318","reported_seq":1008,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.381620+0000","last_change":"2024-09-12T00:18:22.841353+0000","last_active":"2024-09-12T01:01:07.381620+0000","last_peered":"2024-09-12T01:01:07.381620+0000","last_clean":"2024-09-12T01:01:07.381620+0000","last_became_active":"2024-09-12T00:18:22.841069+0000","last_became_peered":"2024-09-12T00:18:22.841069+0000","last_unstale":"2024-09-12T01:01:07.381620+0000","last_undegraded":"2024-09-12T01:01:07.381620+0000","last_fullsized":"2024-09-12T01:01:07.381620+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:51.842199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8420162,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":628,"num_read_kb":23761,"num_write":1226,"num_write_kb":30294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'127","reported_seq":651,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.974481+0000","last_change":"2024-09-12T00:18:32.894030+0000","last_active":"2024-09-12T01:03:25.974481+0000","last_peered":"2024-09-12T01:03:25.974481+0000","last_clean":"2024-09-12T01:03:25.974481+0000","last_became_active":"2024-09-12T00:18:32.893410+0000","last_became_peered":"2024-09-12T00:18:32.893410+0000","last_unstale":"2024-09-12T01:03:25.974481+0000","last_undegraded":"2024-09-12T01:03:25.974481+0000","last_fullsized":"2024-09-12T01:03:25.974481+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:21.781324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":200,"num_read_kb":180,"num_write":310,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'427","reported_seq":2029,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.883962+0000","last_change":"2024-09-12T00:18:24.863390+0000","last_active":"2024-09-12T01:03:25.883962+0000","last_peered":"2024-09-12T01:03:25.883962+0000","last_clean":"2024-09-12T01:03:25.883962+0000","last_became_active":"2024-09-12T00:18:24.862963+0000","last_became_peered":"2024-09-12T00:18:24.862963+0000","last_unstale":"2024-09-12T01:03:25.883962+0000","last_undegraded":"2024-09-12T01:03:25.883962+0000","last_fullsized":"2024-09-12T01:03:25.883962+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:47.762563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2444,"num_read_kb":2313,"num_write":504,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"268'279","reported_seq":923,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:22.373926+0000","last_change":"2024-09-12T00:18:55.955847+0000","last_active":"2024-09-12T01:02:22.373926+0000","last_peered":"2024-09-12T01:02:22.373926+0000","last_clean":"2024-09-12T01:02:22.373926+0000","last_became_active":"2024-09-12T00:18:55.954978+0000","last_became_peered":"2024-09-12T00:18:55.954978+0000","last_unstale":"2024-09-12T01:02:22.373926+0000","last_undegraded":"2024-09-12T01:02:22.373926+0000","last_fullsized":"2024-09-12T01:02:22.373926+0000","mapping_epoch":37,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:00.249837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4250562,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":428,"num_read_kb":26304,"num_write":1033,"num_write_kb":30933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.749399+0000","last_change":"2024-09-12T00:18:26.872530+0000","last_active":"2024-09-12T01:01:57.749399+0000","last_peered":"2024-09-12T01:01:57.749399+0000","last_clean":"2024-09-12T01:01:57.749399+0000","last_became_active":"2024-09-12T00:18:26.871803+0000","last_became_peered":"2024-09-12T00:18:26.871803+0000","last_unstale":"2024-09-12T01:01:57.749399+0000","last_undegraded":"2024-09-12T01:01:57.749399+0000","last_fullsized":"2024-09-12T01:01:57.749399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:22.818539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'336","reported_seq":948,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:26.605376+0000","last_change":"2024-09-12T00:18:28.875623+0000","last_active":"2024-09-12T01:04:26.605376+0000","last_peered":"2024-09-12T01:04:26.605376+0000","last_clean":"2024-09-12T01:04:26.605376+0000","last_became_active":"2024-09-12T00:18:28.874861+0000","last_became_peered":"2024-09-12T00:18:28.874861+0000","last_unstale":"2024-09-12T01:04:26.605376+0000","last_undegraded":"2024-09-12T01:04:26.605376+0000","last_fullsized":"2024-09-12T01:04:26.605376+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:25.073806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58756,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":540,"num_read_kb":1030,"num_write":430,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.546262+0000","last_change":"2024-09-12T00:18:30.894626+0000","last_active":"2024-09-12T01:02:02.546262+0000","last_peered":"2024-09-12T01:02:02.546262+0000","last_clean":"2024-09-12T01:02:02.546262+0000","last_became_active":"2024-09-12T00:18:30.893886+0000","last_became_peered":"2024-09-12T00:18:30.893886+0000","last_unstale":"2024-09-12T01:02:02.546262+0000","last_undegraded":"2024-09-12T01:02:02.546262+0000","last_fullsized":"2024-09-12T01:02:02.546262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:00.518894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'2426","reported_seq":4321,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.416183+0000","last_change":"2024-09-12T00:18:32.899968+0000","last_active":"2024-09-12T01:03:37.416183+0000","last_peered":"2024-09-12T01:03:37.416183+0000","last_clean":"2024-09-12T01:03:37.416183+0000","last_became_active":"2024-09-12T00:18:32.899168+0000","last_became_peered":"2024-09-12T00:18:32.899168+0000","last_unstale":"2024-09-12T01:03:37.416183+0000","last_undegraded":"2024-09-12T01:03:37.416183+0000","last_fullsized":"2024-09-12T01:03:37.416183+0000","mapping_epoch":34,"log_start":"268'2400","ondisk_log_start":"268'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":2400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:13.149755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6111,"num_read_kb":6108,"num_write":4843,"num_write_kb":1788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'1288","reported_seq":2834,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.884108+0000","last_change":"2024-09-12T00:18:24.870986+0000","last_active":"2024-09-12T01:03:25.884108+0000","last_peered":"2024-09-12T01:03:25.884108+0000","last_clean":"2024-09-12T01:03:25.884108+0000","last_became_active":"2024-09-12T00:18:24.869219+0000","last_became_peered":"2024-09-12T00:18:24.869219+0000","last_unstale":"2024-09-12T01:03:25.884108+0000","last_undegraded":"2024-09-12T01:03:25.884108+0000","last_fullsized":"2024-09-12T01:03:25.884108+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":1200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:32.390226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5815,"num_read_kb":5070,"num_write":1809,"num_write_kb":816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'214","reported_seq":783,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:08.179631+0000","last_change":"2024-09-12T00:18:55.953884+0000","last_active":"2024-09-12T01:01:08.179631+0000","last_peered":"2024-09-12T01:01:08.179631+0000","last_clean":"2024-09-12T01:01:08.179631+0000","last_became_active":"2024-09-12T00:18:55.953363+0000","last_became_peered":"2024-09-12T00:18:55.953363+0000","last_unstale":"2024-09-12T01:01:08.179631+0000","last_undegraded":"2024-09-12T01:01:08.179631+0000","last_fullsized":"2024-09-12T01:01:08.179631+0000","mapping_epoch":37,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:06.656289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7324749,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":293,"num_read_kb":12331,"num_write":809,"num_write_kb":28931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:31.733365+0000","last_change":"2024-09-12T00:18:26.848809+0000","last_active":"2024-09-12T01:00:31.733365+0000","last_peered":"2024-09-12T01:00:31.733365+0000","last_clean":"2024-09-12T01:00:31.733365+0000","last_became_active":"2024-09-12T00:18:26.848272+0000","last_became_peered":"2024-09-12T00:18:26.848272+0000","last_unstale":"2024-09-12T01:00:31.733365+0000","last_undegraded":"2024-09-12T01:00:31.733365+0000","last_fullsized":"2024-09-12T01:00:31.733365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:32.968436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'90","reported_seq":626,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.547603+0000","last_change":"2024-09-12T00:18:28.883255+0000","last_active":"2024-09-12T01:02:02.547603+0000","last_peered":"2024-09-12T01:02:02.547603+0000","last_clean":"2024-09-12T01:02:02.547603+0000","last_became_active":"2024-09-12T00:18:28.882630+0000","last_became_peered":"2024-09-12T00:18:28.882630+0000","last_unstale":"2024-09-12T01:02:02.547603+0000","last_undegraded":"2024-09-12T01:02:02.547603+0000","last_fullsized":"2024-09-12T01:02:02.547603+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:19.332138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":98,"num_write":70,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.547576+0000","last_change":"2024-09-12T00:18:30.901543+0000","last_active":"2024-09-12T01:02:02.547576+0000","last_peered":"2024-09-12T01:02:02.547576+0000","last_clean":"2024-09-12T01:02:02.547576+0000","last_became_active":"2024-09-12T00:18:30.900908+0000","last_became_peered":"2024-09-12T00:18:30.900908+0000","last_unstale":"2024-09-12T01:02:02.547576+0000","last_undegraded":"2024-09-12T01:02:02.547576+0000","last_fullsized":"2024-09-12T01:02:02.547576+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:06.507522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'120","reported_seq":626,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.178090+0000","last_change":"2024-09-12T00:18:32.910263+0000","last_active":"2024-09-12T01:02:58.178090+0000","last_peered":"2024-09-12T01:02:58.178090+0000","last_clean":"2024-09-12T01:02:58.178090+0000","last_became_active":"2024-09-12T00:18:32.909547+0000","last_became_peered":"2024-09-12T00:18:32.909547+0000","last_unstale":"2024-09-12T01:02:58.178090+0000","last_undegraded":"2024-09-12T01:02:58.178090+0000","last_fullsized":"2024-09-12T01:02:58.178090+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:15.935680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":128,"num_write":294,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'1255","reported_seq":2899,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.742323+0000","last_change":"2024-09-12T00:18:24.859628+0000","last_active":"2024-09-12T01:03:06.742323+0000","last_peered":"2024-09-12T01:03:06.742323+0000","last_clean":"2024-09-12T01:03:06.742323+0000","last_became_active":"2024-09-12T00:18:24.859237+0000","last_became_peered":"2024-09-12T00:18:24.859237+0000","last_unstale":"2024-09-12T01:03:06.742323+0000","last_undegraded":"2024-09-12T01:03:06.742323+0000","last_fullsized":"2024-09-12T01:03:06.742323+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:27.993852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5766,"num_read_kb":5095,"num_write":1782,"num_write_kb":773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'308","reported_seq":1026,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:14.179546+0000","last_change":"2024-09-12T00:18:22.878983+0000","last_active":"2024-09-12T01:02:14.179546+0000","last_peered":"2024-09-12T01:02:14.179546+0000","last_clean":"2024-09-12T01:02:14.179546+0000","last_became_active":"2024-09-12T00:18:22.873262+0000","last_became_peered":"2024-09-12T00:18:22.873262+0000","last_unstale":"2024-09-12T01:02:14.179546+0000","last_undegraded":"2024-09-12T01:02:14.179546+0000","last_fullsized":"2024-09-12T01:02:14.179546+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:06.551453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18286806,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":535,"num_read_kb":24518,"num_write":1149,"num_write_kb":41630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.756017+0000","last_change":"2024-09-12T00:18:26.855885+0000","last_active":"2024-09-12T01:01:56.756017+0000","last_peered":"2024-09-12T01:01:56.756017+0000","last_clean":"2024-09-12T01:01:56.756017+0000","last_became_active":"2024-09-12T00:18:26.855348+0000","last_became_peered":"2024-09-12T00:18:26.855348+0000","last_unstale":"2024-09-12T01:01:56.756017+0000","last_undegraded":"2024-09-12T01:01:56.756017+0000","last_fullsized":"2024-09-12T01:01:56.756017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:48.816326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'118","reported_seq":670,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:19.297862+0000","last_change":"2024-09-12T00:18:28.885573+0000","last_active":"2024-09-12T01:01:19.297862+0000","last_peered":"2024-09-12T01:01:19.297862+0000","last_clean":"2024-09-12T01:01:19.297862+0000","last_became_active":"2024-09-12T00:18:28.884722+0000","last_became_peered":"2024-09-12T00:18:28.884722+0000","last_unstale":"2024-09-12T01:01:19.297862+0000","last_undegraded":"2024-09-12T01:01:19.297862+0000","last_fullsized":"2024-09-12T01:01:19.297862+0000","mapping_epoch":30,"log_start":"268'100","ondisk_log_start":"268'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:22.842377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":98,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'780","reported_seq":4738,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.829366+0000","last_change":"2024-09-12T00:18:30.894494+0000","last_active":"2024-09-12T01:04:31.829366+0000","last_peered":"2024-09-12T01:04:31.829366+0000","last_clean":"2024-09-12T01:04:31.829366+0000","last_became_active":"2024-09-12T00:18:30.893739+0000","last_became_peered":"2024-09-12T00:18:30.893739+0000","last_unstale":"2024-09-12T01:04:31.829366+0000","last_undegraded":"2024-09-12T01:04:31.829366+0000","last_fullsized":"2024-09-12T01:04:31.829366+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:28.177468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'210","reported_seq":1045,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.023471+0000","last_change":"2024-09-12T00:18:32.884849+0000","last_active":"2024-09-12T01:03:26.023471+0000","last_peered":"2024-09-12T01:03:26.023471+0000","last_clean":"2024-09-12T01:03:26.023471+0000","last_became_active":"2024-09-12T00:18:32.884130+0000","last_became_peered":"2024-09-12T00:18:32.884130+0000","last_unstale":"2024-09-12T01:03:26.023471+0000","last_undegraded":"2024-09-12T01:03:26.023471+0000","last_fullsized":"2024-09-12T01:03:26.023471+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:08.903193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":639,"num_read_kb":629,"num_write":484,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'892","reported_seq":2621,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.348876+0000","last_change":"2024-09-12T00:18:24.868470+0000","last_active":"2024-09-12T01:03:37.348876+0000","last_peered":"2024-09-12T01:03:37.348876+0000","last_clean":"2024-09-12T01:03:37.348876+0000","last_became_active":"2024-09-12T00:18:24.868103+0000","last_became_peered":"2024-09-12T00:18:24.868103+0000","last_unstale":"2024-09-12T01:03:37.348876+0000","last_undegraded":"2024-09-12T01:03:37.348876+0000","last_fullsized":"2024-09-12T01:03:37.348876+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":800,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:19.861066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4419,"num_read_kb":4003,"num_write":1187,"num_write_kb":433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'258","reported_seq":875,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.397104+0000","last_change":"2024-09-12T00:18:22.852318+0000","last_active":"2024-09-12T01:03:01.397104+0000","last_peered":"2024-09-12T01:03:01.397104+0000","last_clean":"2024-09-12T01:03:01.397104+0000","last_became_active":"2024-09-12T00:18:22.850530+0000","last_became_peered":"2024-09-12T00:18:22.850530+0000","last_unstale":"2024-09-12T01:03:01.397104+0000","last_undegraded":"2024-09-12T01:03:01.397104+0000","last_fullsized":"2024-09-12T01:03:01.397104+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:16.232313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10094467,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":403,"num_read_kb":6949,"num_write":1033,"num_write_kb":36294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.749449+0000","last_change":"2024-09-12T00:18:26.868989+0000","last_active":"2024-09-12T01:01:57.749449+0000","last_peered":"2024-09-12T01:01:57.749449+0000","last_clean":"2024-09-12T01:01:57.749449+0000","last_became_active":"2024-09-12T00:18:26.867729+0000","last_became_peered":"2024-09-12T00:18:26.867729+0000","last_unstale":"2024-09-12T01:01:57.749449+0000","last_undegraded":"2024-09-12T01:01:57.749449+0000","last_fullsized":"2024-09-12T01:01:57.749449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:38.364796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'259","reported_seq":829,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:27.579703+0000","last_change":"2024-09-12T00:18:28.885774+0000","last_active":"2024-09-12T01:04:27.579703+0000","last_peered":"2024-09-12T01:04:27.579703+0000","last_clean":"2024-09-12T01:04:27.579703+0000","last_became_active":"2024-09-12T00:18:28.884779+0000","last_became_peered":"2024-09-12T00:18:28.884779+0000","last_unstale":"2024-09-12T01:04:27.579703+0000","last_undegraded":"2024-09-12T01:04:27.579703+0000","last_fullsized":"2024-09-12T01:04:27.579703+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:17.954386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55235,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":430,"num_read_kb":898,"num_write":352,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'813","reported_seq":2283,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.837317+0000","last_change":"2024-09-12T00:18:30.903331+0000","last_active":"2024-09-12T01:04:31.837317+0000","last_peered":"2024-09-12T01:04:31.837317+0000","last_clean":"2024-09-12T01:04:31.837317+0000","last_became_active":"2024-09-12T00:18:30.894642+0000","last_became_peered":"2024-09-12T00:18:30.894642+0000","last_unstale":"2024-09-12T01:04:31.837317+0000","last_undegraded":"2024-09-12T01:04:31.837317+0000","last_fullsized":"2024-09-12T01:04:31.837317+0000","mapping_epoch":32,"log_start":"268'800","ondisk_log_start":"268'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":800,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:23.687695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'475","reported_seq":2078,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.413042+0000","last_change":"2024-09-12T00:18:24.871053+0000","last_active":"2024-09-12T01:03:37.413042+0000","last_peered":"2024-09-12T01:03:37.413042+0000","last_clean":"2024-09-12T01:03:37.413042+0000","last_became_active":"2024-09-12T00:18:24.869435+0000","last_became_peered":"2024-09-12T00:18:24.869435+0000","last_unstale":"2024-09-12T01:03:37.413042+0000","last_undegraded":"2024-09-12T01:03:37.413042+0000","last_fullsized":"2024-09-12T01:03:37.413042+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:43.049599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2569,"num_read_kb":2408,"num_write":545,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'302","reported_seq":930,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.086642+0000","last_change":"2024-09-12T00:18:22.881670+0000","last_active":"2024-09-12T01:02:51.086642+0000","last_peered":"2024-09-12T01:02:51.086642+0000","last_clean":"2024-09-12T01:02:51.086642+0000","last_became_active":"2024-09-12T00:18:22.877327+0000","last_became_peered":"2024-09-12T00:18:22.877327+0000","last_unstale":"2024-09-12T01:02:51.086642+0000","last_undegraded":"2024-09-12T01:02:51.086642+0000","last_fullsized":"2024-09-12T01:02:51.086642+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:34.237861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12210018,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":427,"num_read_kb":23147,"num_write":1006,"num_write_kb":55226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:47.542554+0000","last_change":"2024-09-12T00:18:26.876329+0000","last_active":"2024-09-12T01:01:47.542554+0000","last_peered":"2024-09-12T01:01:47.542554+0000","last_clean":"2024-09-12T01:01:47.542554+0000","last_became_active":"2024-09-12T00:18:26.874638+0000","last_became_peered":"2024-09-12T00:18:26.874638+0000","last_unstale":"2024-09-12T01:01:47.542554+0000","last_undegraded":"2024-09-12T01:01:47.542554+0000","last_fullsized":"2024-09-12T01:01:47.542554+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:33.159889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'331","reported_seq":946,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:12.382172+0000","last_change":"2024-09-12T00:18:28.896980+0000","last_active":"2024-09-12T01:04:12.382172+0000","last_peered":"2024-09-12T01:04:12.382172+0000","last_clean":"2024-09-12T01:04:12.382172+0000","last_became_active":"2024-09-12T00:18:28.895950+0000","last_became_peered":"2024-09-12T00:18:28.895950+0000","last_unstale":"2024-09-12T01:04:12.382172+0000","last_undegraded":"2024-09-12T01:04:12.382172+0000","last_fullsized":"2024-09-12T01:04:12.382172+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:16.223388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53744,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":529,"num_read_kb":962,"num_write":410,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:16.542412+0000","last_change":"2024-09-12T00:18:30.874823+0000","last_active":"2024-09-12T01:01:16.542412+0000","last_peered":"2024-09-12T01:01:16.542412+0000","last_clean":"2024-09-12T01:01:16.542412+0000","last_became_active":"2024-09-12T00:18:30.874074+0000","last_became_peered":"2024-09-12T00:18:30.874074+0000","last_unstale":"2024-09-12T01:01:16.542412+0000","last_undegraded":"2024-09-12T01:01:16.542412+0000","last_fullsized":"2024-09-12T01:01:16.542412+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:46.157942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'552","reported_seq":1366,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.801949+0000","last_change":"2024-09-12T00:18:32.900714+0000","last_active":"2024-09-12T01:04:31.801949+0000","last_peered":"2024-09-12T01:04:31.801949+0000","last_clean":"2024-09-12T01:04:31.801949+0000","last_became_active":"2024-09-12T00:18:32.899046+0000","last_became_peered":"2024-09-12T00:18:32.899046+0000","last_unstale":"2024-09-12T01:04:31.801949+0000","last_undegraded":"2024-09-12T01:04:31.801949+0000","last_fullsized":"2024-09-12T01:04:31.801949+0000","mapping_epoch":34,"log_start":"268'500","ondisk_log_start":"268'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:25.804502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1268,"num_read_kb":1267,"num_write":1132,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'483","reported_seq":2092,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.248460+0000","last_change":"2024-09-12T00:18:24.862220+0000","last_active":"2024-09-12T01:02:59.248460+0000","last_peered":"2024-09-12T01:02:59.248460+0000","last_clean":"2024-09-12T01:02:59.248460+0000","last_became_active":"2024-09-12T00:18:24.861455+0000","last_became_peered":"2024-09-12T00:18:24.861455+0000","last_unstale":"2024-09-12T01:02:59.248460+0000","last_undegraded":"2024-09-12T01:02:59.248460+0000","last_fullsized":"2024-09-12T01:02:59.248460+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:58.186022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2490,"num_read_kb":2350,"num_write":569,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'294","reported_seq":949,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.581667+0000","last_change":"2024-09-12T00:18:22.872925+0000","last_active":"2024-09-12T01:03:10.581667+0000","last_peered":"2024-09-12T01:03:10.581667+0000","last_clean":"2024-09-12T01:03:10.581667+0000","last_became_active":"2024-09-12T00:18:22.871330+0000","last_became_peered":"2024-09-12T00:18:22.871330+0000","last_unstale":"2024-09-12T01:03:10.581667+0000","last_undegraded":"2024-09-12T01:03:10.581667+0000","last_fullsized":"2024-09-12T01:03:10.581667+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:49.802108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587191,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":470,"num_read_kb":9754,"num_write":1030,"num_write_kb":25837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"36'3","reported_seq":983,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.661620+0000","last_change":"2024-09-12T00:18:26.859307+0000","last_active":"2024-09-12T01:04:31.661620+0000","last_peered":"2024-09-12T01:04:31.661620+0000","last_clean":"2024-09-12T01:04:31.661620+0000","last_became_active":"2024-09-12T00:18:26.858529+0000","last_became_peered":"2024-09-12T00:18:26.858529+0000","last_unstale":"2024-09-12T01:04:31.661620+0000","last_undegraded":"2024-09-12T01:04:31.661620+0000","last_fullsized":"2024-09-12T01:04:31.661620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:58.521971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":719,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'281","reported_seq":860,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:31.779506+0000","last_change":"2024-09-12T00:18:28.896114+0000","last_active":"2024-09-12T01:03:31.779506+0000","last_peered":"2024-09-12T01:03:31.779506+0000","last_clean":"2024-09-12T01:03:31.779506+0000","last_became_active":"2024-09-12T00:18:28.895521+0000","last_became_peered":"2024-09-12T00:18:28.895521+0000","last_unstale":"2024-09-12T01:03:31.779506+0000","last_undegraded":"2024-09-12T01:03:31.779506+0000","last_fullsized":"2024-09-12T01:03:31.779506+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:58.027139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55898,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":458,"num_read_kb":962,"num_write":382,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.755573+0000","last_change":"2024-09-12T00:18:30.907840+0000","last_active":"2024-09-12T01:01:56.755573+0000","last_peered":"2024-09-12T01:01:56.755573+0000","last_clean":"2024-09-12T01:01:56.755573+0000","last_became_active":"2024-09-12T00:18:30.905601+0000","last_became_peered":"2024-09-12T00:18:30.905601+0000","last_unstale":"2024-09-12T01:01:56.755573+0000","last_undegraded":"2024-09-12T01:01:56.755573+0000","last_fullsized":"2024-09-12T01:01:56.755573+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:08.252494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'122","reported_seq":612,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:20.723358+0000","last_change":"2024-09-12T00:18:32.900357+0000","last_active":"2024-09-12T01:04:20.723358+0000","last_peered":"2024-09-12T01:04:20.723358+0000","last_clean":"2024-09-12T01:04:20.723358+0000","last_became_active":"2024-09-12T00:18:32.899284+0000","last_became_peered":"2024-09-12T00:18:32.899284+0000","last_unstale":"2024-09-12T01:04:20.723358+0000","last_undegraded":"2024-09-12T01:04:20.723358+0000","last_fullsized":"2024-09-12T01:04:20.723358+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:39.218682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":95,"num_write":292,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'840","reported_seq":2341,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.885035+0000","last_change":"2024-09-12T00:18:24.871047+0000","last_active":"2024-09-12T01:03:25.885035+0000","last_peered":"2024-09-12T01:03:25.885035+0000","last_clean":"2024-09-12T01:03:25.885035+0000","last_became_active":"2024-09-12T00:18:24.869582+0000","last_became_peered":"2024-09-12T00:18:24.869582+0000","last_unstale":"2024-09-12T01:03:25.885035+0000","last_undegraded":"2024-09-12T01:03:25.885035+0000","last_fullsized":"2024-09-12T01:03:25.885035+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":800,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:44.515642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4018,"num_read_kb":3569,"num_write":1156,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'216","reported_seq":816,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:05.774855+0000","last_change":"2024-09-12T00:18:22.881172+0000","last_active":"2024-09-12T01:03:05.774855+0000","last_peered":"2024-09-12T01:03:05.774855+0000","last_clean":"2024-09-12T01:03:05.774855+0000","last_became_active":"2024-09-12T00:18:22.875150+0000","last_became_peered":"2024-09-12T00:18:22.875150+0000","last_unstale":"2024-09-12T01:03:05.774855+0000","last_undegraded":"2024-09-12T01:03:05.774855+0000","last_fullsized":"2024-09-12T01:03:05.774855+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:21.799238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3370821,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":328,"num_read_kb":19791,"num_write":733,"num_write_kb":25570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'5","reported_seq":982,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.660500+0000","last_change":"2024-09-12T00:18:26.858101+0000","last_active":"2024-09-12T01:04:31.660500+0000","last_peered":"2024-09-12T01:04:31.660500+0000","last_clean":"2024-09-12T01:04:31.660500+0000","last_became_active":"2024-09-12T00:18:26.857788+0000","last_became_peered":"2024-09-12T00:18:26.857788+0000","last_unstale":"2024-09-12T01:04:31.660500+0000","last_undegraded":"2024-09-12T01:04:31.660500+0000","last_fullsized":"2024-09-12T01:04:31.660500+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:18.621326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":1184,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'299","reported_seq":892,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:02.573313+0000","last_change":"2024-09-12T00:18:28.887534+0000","last_active":"2024-09-12T01:04:02.573313+0000","last_peered":"2024-09-12T01:04:02.573313+0000","last_clean":"2024-09-12T01:04:02.573313+0000","last_became_active":"2024-09-12T00:18:28.886806+0000","last_became_peered":"2024-09-12T00:18:28.886806+0000","last_unstale":"2024-09-12T01:04:02.573313+0000","last_undegraded":"2024-09-12T01:04:02.573313+0000","last_fullsized":"2024-09-12T01:04:02.573313+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:57.100168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52779,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":481,"num_read_kb":938,"num_write":386,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'804","reported_seq":2407,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.839310+0000","last_change":"2024-09-12T00:18:30.895445+0000","last_active":"2024-09-12T01:04:31.839310+0000","last_peered":"2024-09-12T01:04:31.839310+0000","last_clean":"2024-09-12T01:04:31.839310+0000","last_became_active":"2024-09-12T00:18:30.888688+0000","last_became_peered":"2024-09-12T00:18:30.888688+0000","last_unstale":"2024-09-12T01:04:31.839310+0000","last_undegraded":"2024-09-12T01:04:31.839310+0000","last_fullsized":"2024-09-12T01:04:31.839310+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:44.135657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'131","reported_seq":633,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.832406+0000","last_change":"2024-09-12T00:18:32.909612+0000","last_active":"2024-09-12T01:04:30.832406+0000","last_peered":"2024-09-12T01:04:30.832406+0000","last_clean":"2024-09-12T01:04:30.832406+0000","last_became_active":"2024-09-12T00:18:32.904609+0000","last_became_peered":"2024-09-12T00:18:32.904609+0000","last_unstale":"2024-09-12T01:04:30.832406+0000","last_undegraded":"2024-09-12T01:04:30.832406+0000","last_fullsized":"2024-09-12T01:04:30.832406+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:02.670740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":137,"num_read_kb":127,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'815","reported_seq":2289,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.884794+0000","last_change":"2024-09-12T00:18:24.857093+0000","last_active":"2024-09-12T01:03:25.884794+0000","last_peered":"2024-09-12T01:03:25.884794+0000","last_clean":"2024-09-12T01:03:25.884794+0000","last_became_active":"2024-09-12T00:18:24.856572+0000","last_became_peered":"2024-09-12T00:18:24.856572+0000","last_unstale":"2024-09-12T01:03:25.884794+0000","last_undegraded":"2024-09-12T01:03:25.884794+0000","last_fullsized":"2024-09-12T01:03:25.884794+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:45.768362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3705,"num_read_kb":3326,"num_write":1078,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'313","reported_seq":1023,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.855722+0000","last_change":"2024-09-12T00:18:22.871676+0000","last_active":"2024-09-12T01:03:08.855722+0000","last_peered":"2024-09-12T01:03:08.855722+0000","last_clean":"2024-09-12T01:03:08.855722+0000","last_became_active":"2024-09-12T00:18:22.865067+0000","last_became_peered":"2024-09-12T00:18:22.865067+0000","last_unstale":"2024-09-12T01:03:08.855722+0000","last_undegraded":"2024-09-12T01:03:08.855722+0000","last_fullsized":"2024-09-12T01:03:08.855722+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:05.321786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11583600,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":576,"num_read_kb":35348,"num_write":1303,"num_write_kb":29498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:51.719678+0000","last_change":"2024-09-12T00:18:26.868176+0000","last_active":"2024-09-12T01:01:51.719678+0000","last_peered":"2024-09-12T01:01:51.719678+0000","last_clean":"2024-09-12T01:01:51.719678+0000","last_became_active":"2024-09-12T00:18:26.867793+0000","last_became_peered":"2024-09-12T00:18:26.867793+0000","last_unstale":"2024-09-12T01:01:51.719678+0000","last_undegraded":"2024-09-12T01:01:51.719678+0000","last_fullsized":"2024-09-12T01:01:51.719678+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:45.564325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'465","reported_seq":1101,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.731704+0000","last_change":"2024-09-12T00:18:28.876606+0000","last_active":"2024-09-12T01:04:31.731704+0000","last_peered":"2024-09-12T01:04:31.731704+0000","last_clean":"2024-09-12T01:04:31.731704+0000","last_became_active":"2024-09-12T00:18:28.875891+0000","last_became_peered":"2024-09-12T00:18:28.875891+0000","last_unstale":"2024-09-12T01:04:31.731704+0000","last_undegraded":"2024-09-12T01:04:31.731704+0000","last_fullsized":"2024-09-12T01:04:31.731704+0000","mapping_epoch":30,"log_start":"268'400","ondisk_log_start":"268'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:20.466018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112951,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":808,"num_read_kb":1735,"num_write":668,"num_write_kb":563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:51.719618+0000","last_change":"2024-09-12T00:18:30.896208+0000","last_active":"2024-09-12T01:01:51.719618+0000","last_peered":"2024-09-12T01:01:51.719618+0000","last_clean":"2024-09-12T01:01:51.719618+0000","last_became_active":"2024-09-12T00:18:30.895401+0000","last_became_peered":"2024-09-12T00:18:30.895401+0000","last_unstale":"2024-09-12T01:01:51.719618+0000","last_undegraded":"2024-09-12T01:01:51.719618+0000","last_fullsized":"2024-09-12T01:01:51.719618+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:42.017008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'152","reported_seq":679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.551335+0000","last_change":"2024-09-12T00:18:32.893457+0000","last_active":"2024-09-12T01:01:56.551335+0000","last_peered":"2024-09-12T01:01:56.551335+0000","last_clean":"2024-09-12T01:01:56.551335+0000","last_became_active":"2024-09-12T00:18:32.892682+0000","last_became_peered":"2024-09-12T00:18:32.892682+0000","last_unstale":"2024-09-12T01:01:56.551335+0000","last_undegraded":"2024-09-12T01:01:56.551335+0000","last_fullsized":"2024-09-12T01:01:56.551335+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:17.913143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1103,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":196,"num_read_kb":180,"num_write":352,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'459","reported_seq":2074,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.823138+0000","last_change":"2024-09-12T00:18:24.853418+0000","last_active":"2024-09-12T01:04:30.823138+0000","last_peered":"2024-09-12T01:04:30.823138+0000","last_clean":"2024-09-12T01:04:30.823138+0000","last_became_active":"2024-09-12T00:18:24.852683+0000","last_became_peered":"2024-09-12T00:18:24.852683+0000","last_unstale":"2024-09-12T01:04:30.823138+0000","last_undegraded":"2024-09-12T01:04:30.823138+0000","last_fullsized":"2024-09-12T01:04:30.823138+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:11.403174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2390,"num_read_kb":2271,"num_write":519,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'292","reported_seq":942,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.908684+0000","last_change":"2024-09-12T00:18:22.842425+0000","last_active":"2024-09-12T01:03:21.908684+0000","last_peered":"2024-09-12T01:03:21.908684+0000","last_clean":"2024-09-12T01:03:21.908684+0000","last_became_active":"2024-09-12T00:18:22.841689+0000","last_became_peered":"2024-09-12T00:18:22.841689+0000","last_unstale":"2024-09-12T01:03:21.908684+0000","last_undegraded":"2024-09-12T01:03:21.908684+0000","last_fullsized":"2024-09-12T01:03:21.908684+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:53.341537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14711944,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":427,"num_read_kb":55764,"num_write":1091,"num_write_kb":35616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:11.710704+0000","last_change":"2024-09-12T00:18:26.858051+0000","last_active":"2024-09-12T01:01:11.710704+0000","last_peered":"2024-09-12T01:01:11.710704+0000","last_clean":"2024-09-12T01:01:11.710704+0000","last_became_active":"2024-09-12T00:18:26.845618+0000","last_became_peered":"2024-09-12T00:18:26.845618+0000","last_unstale":"2024-09-12T01:01:11.710704+0000","last_undegraded":"2024-09-12T01:01:11.710704+0000","last_fullsized":"2024-09-12T01:01:11.710704+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:08.376001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'294","reported_seq":876,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:32.569648+0000","last_change":"2024-09-12T00:18:28.885743+0000","last_active":"2024-09-12T01:03:32.569648+0000","last_peered":"2024-09-12T01:03:32.569648+0000","last_clean":"2024-09-12T01:03:32.569648+0000","last_became_active":"2024-09-12T00:18:28.884044+0000","last_became_peered":"2024-09-12T00:18:28.884044+0000","last_unstale":"2024-09-12T01:03:32.569648+0000","last_undegraded":"2024-09-12T01:03:32.569648+0000","last_fullsized":"2024-09-12T01:03:32.569648+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:10.970556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69457,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":506,"num_read_kb":1021,"num_write":458,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":492,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:26.564933+0000","last_change":"2024-09-12T00:18:30.903530+0000","last_active":"2024-09-12T01:01:26.564933+0000","last_peered":"2024-09-12T01:01:26.564933+0000","last_clean":"2024-09-12T01:01:26.564933+0000","last_became_active":"2024-09-12T00:18:30.902697+0000","last_became_peered":"2024-09-12T00:18:30.902697+0000","last_unstale":"2024-09-12T01:01:26.564933+0000","last_undegraded":"2024-09-12T01:01:26.564933+0000","last_fullsized":"2024-09-12T01:01:26.564933+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:52.611643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'136","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:41.767596+0000","last_change":"2024-09-12T00:18:32.901132+0000","last_active":"2024-09-12T01:02:41.767596+0000","last_peered":"2024-09-12T01:02:41.767596+0000","last_clean":"2024-09-12T01:02:41.767596+0000","last_became_active":"2024-09-12T00:18:32.900235+0000","last_became_peered":"2024-09-12T00:18:32.900235+0000","last_unstale":"2024-09-12T01:02:41.767596+0000","last_undegraded":"2024-09-12T01:02:41.767596+0000","last_fullsized":"2024-09-12T01:02:41.767596+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:52.036568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":465,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":124,"num_read_kb":118,"num_write":347,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'436","reported_seq":2078,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.197412+0000","last_change":"2024-09-12T00:18:24.873781+0000","last_active":"2024-09-12T01:03:08.197412+0000","last_peered":"2024-09-12T01:03:08.197412+0000","last_clean":"2024-09-12T01:03:08.197412+0000","last_became_active":"2024-09-12T00:18:24.872637+0000","last_became_peered":"2024-09-12T00:18:24.872637+0000","last_unstale":"2024-09-12T01:03:08.197412+0000","last_undegraded":"2024-09-12T01:03:08.197412+0000","last_fullsized":"2024-09-12T01:03:08.197412+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:31.196044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2400,"num_read_kb":2300,"num_write":500,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'286","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.660542+0000","last_change":"2024-09-12T00:18:22.862177+0000","last_active":"2024-09-12T01:02:57.660542+0000","last_peered":"2024-09-12T01:02:57.660542+0000","last_clean":"2024-09-12T01:02:57.660542+0000","last_became_active":"2024-09-12T00:18:22.861450+0000","last_became_peered":"2024-09-12T00:18:22.861450+0000","last_unstale":"2024-09-12T01:02:57.660542+0000","last_undegraded":"2024-09-12T01:02:57.660542+0000","last_fullsized":"2024-09-12T01:02:57.660542+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:19.289534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4911848,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":522,"num_read_kb":32647,"num_write":1116,"num_write_kb":29925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:11.541211+0000","last_change":"2024-09-12T00:18:26.859580+0000","last_active":"2024-09-12T01:01:11.541211+0000","last_peered":"2024-09-12T01:01:11.541211+0000","last_clean":"2024-09-12T01:01:11.541211+0000","last_became_active":"2024-09-12T00:18:26.859109+0000","last_became_peered":"2024-09-12T00:18:26.859109+0000","last_unstale":"2024-09-12T01:01:11.541211+0000","last_undegraded":"2024-09-12T01:01:11.541211+0000","last_fullsized":"2024-09-12T01:01:11.541211+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:53.815705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'298","reported_seq":884,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:36.741152+0000","last_change":"2024-09-12T00:18:28.882686+0000","last_active":"2024-09-12T01:03:36.741152+0000","last_peered":"2024-09-12T01:03:36.741152+0000","last_clean":"2024-09-12T01:03:36.741152+0000","last_became_active":"2024-09-12T00:18:28.881947+0000","last_became_peered":"2024-09-12T00:18:28.881947+0000","last_unstale":"2024-09-12T01:03:36.741152+0000","last_undegraded":"2024-09-12T01:03:36.741152+0000","last_fullsized":"2024-09-12T01:03:36.741152+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:53.647502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56742,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":486,"num_read_kb":984,"num_write":398,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'743","reported_seq":4313,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.831489+0000","last_change":"2024-09-12T00:18:30.873089+0000","last_active":"2024-09-12T01:04:31.831489+0000","last_peered":"2024-09-12T01:04:31.831489+0000","last_clean":"2024-09-12T01:04:31.831489+0000","last_became_active":"2024-09-12T00:18:30.872360+0000","last_became_peered":"2024-09-12T00:18:30.872360+0000","last_unstale":"2024-09-12T01:04:31.831489+0000","last_undegraded":"2024-09-12T01:04:31.831489+0000","last_fullsized":"2024-09-12T01:04:31.831489+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:32.019462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'112","reported_seq":623,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.964702+0000","last_change":"2024-09-12T00:18:32.897273+0000","last_active":"2024-09-12T01:03:25.964702+0000","last_peered":"2024-09-12T01:03:25.964702+0000","last_clean":"2024-09-12T01:03:25.964702+0000","last_became_active":"2024-09-12T00:18:32.896338+0000","last_became_peered":"2024-09-12T00:18:32.896338+0000","last_unstale":"2024-09-12T01:03:25.964702+0000","last_undegraded":"2024-09-12T01:03:25.964702+0000","last_fullsized":"2024-09-12T01:03:25.964702+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:36.916435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":125,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'462","reported_seq":2012,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.821991+0000","last_change":"2024-09-12T00:18:24.880332+0000","last_active":"2024-09-12T01:04:30.821991+0000","last_peered":"2024-09-12T01:04:30.821991+0000","last_clean":"2024-09-12T01:04:30.821991+0000","last_became_active":"2024-09-12T00:18:24.879622+0000","last_became_peered":"2024-09-12T00:18:24.879622+0000","last_unstale":"2024-09-12T01:04:30.821991+0000","last_undegraded":"2024-09-12T01:04:30.821991+0000","last_fullsized":"2024-09-12T01:04:30.821991+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:02.247072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2528,"num_read_kb":2373,"num_write":555,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'332","reported_seq":1029,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:52.573586+0000","last_change":"2024-09-12T00:18:22.849525+0000","last_active":"2024-09-12T01:03:52.573586+0000","last_peered":"2024-09-12T01:03:52.573586+0000","last_clean":"2024-09-12T01:03:52.573586+0000","last_became_active":"2024-09-12T00:18:22.847861+0000","last_became_peered":"2024-09-12T00:18:22.847861+0000","last_unstale":"2024-09-12T01:03:52.573586+0000","last_undegraded":"2024-09-12T01:03:52.573586+0000","last_fullsized":"2024-09-12T01:03:52.573586+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:43.232146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78962,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":640,"num_read_kb":61883,"num_write":1149,"num_write_kb":26157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1450,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.674782+0000","last_change":"2024-09-12T00:18:26.872031+0000","last_active":"2024-09-12T01:04:31.674782+0000","last_peered":"2024-09-12T01:04:31.674782+0000","last_clean":"2024-09-12T01:04:31.674782+0000","last_became_active":"2024-09-12T00:18:26.871356+0000","last_became_peered":"2024-09-12T00:18:26.871356+0000","last_unstale":"2024-09-12T01:04:31.674782+0000","last_undegraded":"2024-09-12T01:04:31.674782+0000","last_fullsized":"2024-09-12T01:04:31.674782+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:31.045577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":948,"num_read_kb":948,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'72","reported_seq":600,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:16.745058+0000","last_change":"2024-09-12T00:18:28.889216+0000","last_active":"2024-09-12T01:01:16.745058+0000","last_peered":"2024-09-12T01:01:16.745058+0000","last_clean":"2024-09-12T01:01:16.745058+0000","last_became_active":"2024-09-12T00:18:28.888423+0000","last_became_peered":"2024-09-12T00:18:28.888423+0000","last_unstale":"2024-09-12T01:01:16.745058+0000","last_undegraded":"2024-09-12T01:01:16.745058+0000","last_fullsized":"2024-09-12T01:01:16.745058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:38.462514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":78,"num_read_kb":72,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'763","reported_seq":2110,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.834256+0000","last_change":"2024-09-12T00:18:30.902806+0000","last_active":"2024-09-12T01:04:31.834256+0000","last_peered":"2024-09-12T01:04:31.834256+0000","last_clean":"2024-09-12T01:04:31.834256+0000","last_became_active":"2024-09-12T00:18:30.898814+0000","last_became_peered":"2024-09-12T00:18:30.898814+0000","last_unstale":"2024-09-12T01:04:31.834256+0000","last_undegraded":"2024-09-12T01:04:31.834256+0000","last_fullsized":"2024-09-12T01:04:31.834256+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:14.302064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'94","reported_seq":594,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.707747+0000","last_change":"2024-09-12T00:18:32.909724+0000","last_active":"2024-09-12T01:03:20.707747+0000","last_peered":"2024-09-12T01:03:20.707747+0000","last_clean":"2024-09-12T01:03:20.707747+0000","last_became_active":"2024-09-12T00:18:32.907797+0000","last_became_peered":"2024-09-12T00:18:32.907797+0000","last_unstale":"2024-09-12T01:03:20.707747+0000","last_undegraded":"2024-09-12T01:03:20.707747+0000","last_fullsized":"2024-09-12T01:03:20.707747+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:54.545857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":73,"num_write":219,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'509","reported_seq":2082,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.413084+0000","last_change":"2024-09-12T00:18:56.197323+0000","last_active":"2024-09-12T01:03:37.413084+0000","last_peered":"2024-09-12T01:03:37.413084+0000","last_clean":"2024-09-12T01:03:37.413084+0000","last_became_active":"2024-09-12T00:18:56.196419+0000","last_became_peered":"2024-09-12T00:18:56.196419+0000","last_unstale":"2024-09-12T01:03:37.413084+0000","last_undegraded":"2024-09-12T01:03:37.413084+0000","last_fullsized":"2024-09-12T01:03:37.413084+0000","mapping_epoch":37,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:19.400713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2644,"num_read_kb":2454,"num_write":619,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"268'330","reported_seq":1114,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.193180+0000","last_change":"2024-09-12T00:18:22.835371+0000","last_active":"2024-09-12T01:02:55.193180+0000","last_peered":"2024-09-12T01:02:55.193180+0000","last_clean":"2024-09-12T01:02:55.193180+0000","last_became_active":"2024-09-12T00:18:22.834072+0000","last_became_peered":"2024-09-12T00:18:22.834072+0000","last_unstale":"2024-09-12T01:02:55.193180+0000","last_undegraded":"2024-09-12T01:02:55.193180+0000","last_fullsized":"2024-09-12T01:02:55.193180+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:54.066638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2365598,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":777,"num_read_kb":11806,"num_write":1118,"num_write_kb":23298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.536055+0000","last_change":"2024-09-12T00:18:26.872530+0000","last_active":"2024-09-12T01:01:12.536055+0000","last_peered":"2024-09-12T01:01:12.536055+0000","last_clean":"2024-09-12T01:01:12.536055+0000","last_became_active":"2024-09-12T00:18:26.871183+0000","last_became_peered":"2024-09-12T00:18:26.871183+0000","last_unstale":"2024-09-12T01:01:12.536055+0000","last_undegraded":"2024-09-12T01:01:12.536055+0000","last_fullsized":"2024-09-12T01:01:12.536055+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:37.626693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'365","reported_seq":968,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.561953+0000","last_change":"2024-09-12T00:18:28.895040+0000","last_active":"2024-09-12T01:03:37.561953+0000","last_peered":"2024-09-12T01:03:37.561953+0000","last_clean":"2024-09-12T01:03:37.561953+0000","last_became_active":"2024-09-12T00:18:28.889343+0000","last_became_peered":"2024-09-12T00:18:28.889343+0000","last_unstale":"2024-09-12T01:03:37.561953+0000","last_undegraded":"2024-09-12T01:03:37.561953+0000","last_fullsized":"2024-09-12T01:03:37.561953+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:17.252099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57094,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1168,"num_read_kb":1657,"num_write":1682,"num_write_kb":1547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:17.720087+0000","last_change":"2024-09-12T00:18:30.906396+0000","last_active":"2024-09-12T01:01:17.720087+0000","last_peered":"2024-09-12T01:01:17.720087+0000","last_clean":"2024-09-12T01:01:17.720087+0000","last_became_active":"2024-09-12T00:18:30.905770+0000","last_became_peered":"2024-09-12T00:18:30.905770+0000","last_unstale":"2024-09-12T01:01:17.720087+0000","last_undegraded":"2024-09-12T01:01:17.720087+0000","last_fullsized":"2024-09-12T01:01:17.720087+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:26.490700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'134","reported_seq":635,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.562136+0000","last_change":"2024-09-12T00:18:32.886440+0000","last_active":"2024-09-12T01:03:23.562136+0000","last_peered":"2024-09-12T01:03:23.562136+0000","last_clean":"2024-09-12T01:03:23.562136+0000","last_became_active":"2024-09-12T00:18:32.885619+0000","last_became_peered":"2024-09-12T00:18:32.885619+0000","last_unstale":"2024-09-12T01:03:23.562136+0000","last_undegraded":"2024-09-12T01:03:23.562136+0000","last_fullsized":"2024-09-12T01:03:23.562136+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:21.997695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":117,"num_write":301,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'771","reported_seq":2188,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.192347+0000","last_change":"2024-09-12T00:18:24.880137+0000","last_active":"2024-09-12T01:03:11.192347+0000","last_peered":"2024-09-12T01:03:11.192347+0000","last_clean":"2024-09-12T01:03:11.192347+0000","last_became_active":"2024-09-12T00:18:24.879462+0000","last_became_peered":"2024-09-12T00:18:24.879462+0000","last_unstale":"2024-09-12T01:03:11.192347+0000","last_undegraded":"2024-09-12T01:03:11.192347+0000","last_fullsized":"2024-09-12T01:03:11.192347+0000","mapping_epoch":26,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:59.861183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3687,"num_read_kb":3308,"num_write":1074,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:17.549465+0000","last_change":"2024-09-12T00:18:03.927642+0000","last_active":"2024-09-12T01:02:17.549465+0000","last_peered":"2024-09-12T01:02:17.549465+0000","last_clean":"2024-09-12T01:02:17.549465+0000","last_became_active":"2024-09-12T00:18:03.924829+0000","last_became_peered":"2024-09-12T00:18:03.924829+0000","last_unstale":"2024-09-12T01:02:17.549465+0000","last_undegraded":"2024-09-12T01:02:17.549465+0000","last_fullsized":"2024-09-12T01:02:17.549465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:02.531521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:02.531521+0000","last_clean_scrub_stamp":"2024-09-12T00:18:02.531521+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:47.557338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.749313+0000","last_change":"2024-09-12T00:18:10.661688+0000","last_active":"2024-09-12T01:01:57.749313+0000","last_peered":"2024-09-12T01:01:57.749313+0000","last_clean":"2024-09-12T01:01:57.749313+0000","last_became_active":"2024-09-12T00:18:08.644385+0000","last_became_peered":"2024-09-12T00:18:08.644385+0000","last_unstale":"2024-09-12T01:01:57.749313+0000","last_undegraded":"2024-09-12T01:01:57.749313+0000","last_fullsized":"2024-09-12T01:01:57.749313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:31.240227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001156741,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'286","reported_seq":935,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.759591+0000","last_change":"2024-09-12T00:18:22.868181+0000","last_active":"2024-09-12T01:02:11.759591+0000","last_peered":"2024-09-12T01:02:11.759591+0000","last_clean":"2024-09-12T01:02:11.759591+0000","last_became_active":"2024-09-12T00:18:22.867571+0000","last_became_peered":"2024-09-12T00:18:22.867571+0000","last_unstale":"2024-09-12T01:02:11.759591+0000","last_undegraded":"2024-09-12T01:02:11.759591+0000","last_fullsized":"2024-09-12T01:02:11.759591+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:17.614856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12470712,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":400,"num_read_kb":26849,"num_write":1023,"num_write_kb":40025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.548434+0000","last_change":"2024-09-12T00:18:26.847189+0000","last_active":"2024-09-12T01:02:12.548434+0000","last_peered":"2024-09-12T01:02:12.548434+0000","last_clean":"2024-09-12T01:02:12.548434+0000","last_became_active":"2024-09-12T00:18:26.846668+0000","last_became_peered":"2024-09-12T00:18:26.846668+0000","last_unstale":"2024-09-12T01:02:12.548434+0000","last_undegraded":"2024-09-12T01:02:12.548434+0000","last_fullsized":"2024-09-12T01:02:12.548434+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:06.265320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'687","reported_seq":1384,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.769278+0000","last_change":"2024-09-12T00:18:28.887266+0000","last_active":"2024-09-12T01:04:31.769278+0000","last_peered":"2024-09-12T01:04:31.769278+0000","last_clean":"2024-09-12T01:04:31.769278+0000","last_became_active":"2024-09-12T00:18:28.885217+0000","last_became_peered":"2024-09-12T00:18:28.885217+0000","last_unstale":"2024-09-12T01:04:31.769278+0000","last_undegraded":"2024-09-12T01:04:31.769278+0000","last_fullsized":"2024-09-12T01:04:31.769278+0000","mapping_epoch":30,"log_start":"268'600","ondisk_log_start":"268'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":600,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:06.515258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212657,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1339,"num_read_kb":2881,"num_write":1248,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":493,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:51.570679+0000","last_change":"2024-09-12T00:18:30.899429+0000","last_active":"2024-09-12T01:01:51.570679+0000","last_peered":"2024-09-12T01:01:51.570679+0000","last_clean":"2024-09-12T01:01:51.570679+0000","last_became_active":"2024-09-12T00:18:30.898689+0000","last_became_peered":"2024-09-12T00:18:30.898689+0000","last_unstale":"2024-09-12T01:01:51.570679+0000","last_undegraded":"2024-09-12T01:01:51.570679+0000","last_fullsized":"2024-09-12T01:01:51.570679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:03.955121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'198","reported_seq":907,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.899528+0000","last_change":"2024-09-12T00:18:32.895955+0000","last_active":"2024-09-12T01:03:25.899528+0000","last_peered":"2024-09-12T01:03:25.899528+0000","last_clean":"2024-09-12T01:03:25.899528+0000","last_became_active":"2024-09-12T00:18:32.895239+0000","last_became_peered":"2024-09-12T00:18:32.895239+0000","last_unstale":"2024-09-12T01:03:25.899528+0000","last_undegraded":"2024-09-12T01:03:25.899528+0000","last_fullsized":"2024-09-12T01:03:25.899528+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:55.084809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1443,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":458,"num_write":434,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'488","reported_seq":2064,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.768001+0000","last_change":"2024-09-12T00:18:24.867486+0000","last_active":"2024-09-12T01:02:55.768001+0000","last_peered":"2024-09-12T01:02:55.768001+0000","last_clean":"2024-09-12T01:02:55.768001+0000","last_became_active":"2024-09-12T00:18:24.867067+0000","last_became_peered":"2024-09-12T00:18:24.867067+0000","last_unstale":"2024-09-12T01:02:55.768001+0000","last_undegraded":"2024-09-12T01:02:55.768001+0000","last_fullsized":"2024-09-12T01:02:55.768001+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:22.498521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2524,"num_read_kb":2362,"num_write":607,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":524,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:22.550569+0000","last_change":"2024-09-12T00:18:10.895303+0000","last_active":"2024-09-12T01:02:22.550569+0000","last_peered":"2024-09-12T01:02:22.550569+0000","last_clean":"2024-09-12T01:02:22.550569+0000","last_became_active":"2024-09-12T00:18:08.646097+0000","last_became_peered":"2024-09-12T00:18:08.646097+0000","last_unstale":"2024-09-12T01:02:22.550569+0000","last_undegraded":"2024-09-12T01:02:22.550569+0000","last_fullsized":"2024-09-12T01:02:22.550569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:23.989230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001003409,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'295","reported_seq":958,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.352904+0000","last_change":"2024-09-12T00:18:22.858083+0000","last_active":"2024-09-12T01:02:21.352904+0000","last_peered":"2024-09-12T01:02:21.352904+0000","last_clean":"2024-09-12T01:02:21.352904+0000","last_became_active":"2024-09-12T00:18:22.857461+0000","last_became_peered":"2024-09-12T00:18:22.857461+0000","last_unstale":"2024-09-12T01:02:21.352904+0000","last_undegraded":"2024-09-12T01:02:21.352904+0000","last_fullsized":"2024-09-12T01:02:21.352904+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:17.632592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8949434,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":507,"num_read_kb":72256,"num_write":1008,"num_write_kb":25510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:47.747024+0000","last_change":"2024-09-12T00:18:26.872369+0000","last_active":"2024-09-12T01:01:47.747024+0000","last_peered":"2024-09-12T01:01:47.747024+0000","last_clean":"2024-09-12T01:01:47.747024+0000","last_became_active":"2024-09-12T00:18:26.871674+0000","last_became_peered":"2024-09-12T00:18:26.871674+0000","last_unstale":"2024-09-12T01:01:47.747024+0000","last_undegraded":"2024-09-12T01:01:47.747024+0000","last_fullsized":"2024-09-12T01:01:47.747024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:53.162492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'1305","reported_seq":2799,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.821026+0000","last_change":"2024-09-12T00:18:28.890022+0000","last_active":"2024-09-12T01:04:31.821026+0000","last_peered":"2024-09-12T01:04:31.821026+0000","last_clean":"2024-09-12T01:04:31.821026+0000","last_became_active":"2024-09-12T00:18:28.889257+0000","last_became_peered":"2024-09-12T00:18:28.889257+0000","last_unstale":"2024-09-12T01:04:31.821026+0000","last_undegraded":"2024-09-12T01:04:31.821026+0000","last_fullsized":"2024-09-12T01:04:31.821026+0000","mapping_epoch":30,"log_start":"268'1201","ondisk_log_start":"268'1201","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":1201,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:45.298192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186105,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2077,"num_read_kb":3673,"num_write":1202,"num_write_kb":1048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":492,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:27.551882+0000","last_change":"2024-09-12T00:18:30.896021+0000","last_active":"2024-09-12T01:02:27.551882+0000","last_peered":"2024-09-12T01:02:27.551882+0000","last_clean":"2024-09-12T01:02:27.551882+0000","last_became_active":"2024-09-12T00:18:30.895305+0000","last_became_peered":"2024-09-12T00:18:30.895305+0000","last_unstale":"2024-09-12T01:02:27.551882+0000","last_undegraded":"2024-09-12T01:02:27.551882+0000","last_fullsized":"2024-09-12T01:02:27.551882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:43.210391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'203","reported_seq":730,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:06.553696+0000","last_change":"2024-09-12T00:18:32.888386+0000","last_active":"2024-09-12T01:02:06.553696+0000","last_peered":"2024-09-12T01:02:06.553696+0000","last_clean":"2024-09-12T01:02:06.553696+0000","last_became_active":"2024-09-12T00:18:32.887528+0000","last_became_peered":"2024-09-12T00:18:32.887528+0000","last_unstale":"2024-09-12T01:02:06.553696+0000","last_undegraded":"2024-09-12T01:02:06.553696+0000","last_fullsized":"2024-09-12T01:02:06.553696+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:38.435598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":310,"num_read_kb":309,"num_write":446,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'1278","reported_seq":3138,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.820547+0000","last_change":"2024-09-12T00:18:24.878345+0000","last_active":"2024-09-12T01:04:30.820547+0000","last_peered":"2024-09-12T01:04:30.820547+0000","last_clean":"2024-09-12T01:04:30.820547+0000","last_became_active":"2024-09-12T00:18:24.877964+0000","last_became_peered":"2024-09-12T00:18:24.877964+0000","last_unstale":"2024-09-12T01:04:30.820547+0000","last_undegraded":"2024-09-12T01:04:30.820547+0000","last_fullsized":"2024-09-12T01:04:30.820547+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":1200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:26.929945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6082,"num_read_kb":5401,"num_write":1732,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.720736+0000","last_change":"2024-09-12T00:18:10.654679+0000","last_active":"2024-09-12T01:01:56.720736+0000","last_peered":"2024-09-12T01:01:56.720736+0000","last_clean":"2024-09-12T01:01:56.720736+0000","last_became_active":"2024-09-12T00:18:08.874442+0000","last_became_peered":"2024-09-12T00:18:08.874442+0000","last_unstale":"2024-09-12T01:01:56.720736+0000","last_undegraded":"2024-09-12T01:01:56.720736+0000","last_fullsized":"2024-09-12T01:01:56.720736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:30.659138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010707620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'305","reported_seq":1023,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:29.920089+0000","last_change":"2024-09-12T00:18:22.835171+0000","last_active":"2024-09-12T01:04:29.920089+0000","last_peered":"2024-09-12T01:04:29.920089+0000","last_clean":"2024-09-12T01:04:29.920089+0000","last_became_active":"2024-09-12T00:18:22.834724+0000","last_became_peered":"2024-09-12T00:18:22.834724+0000","last_unstale":"2024-09-12T01:04:29.920089+0000","last_undegraded":"2024-09-12T01:04:29.920089+0000","last_fullsized":"2024-09-12T01:04:29.920089+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:08.633740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4717516,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":613,"num_read_kb":9051,"num_write":1161,"num_write_kb":24587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:46.718701+0000","last_change":"2024-09-12T00:18:26.868058+0000","last_active":"2024-09-12T01:01:46.718701+0000","last_peered":"2024-09-12T01:01:46.718701+0000","last_clean":"2024-09-12T01:01:46.718701+0000","last_became_active":"2024-09-12T00:18:26.867343+0000","last_became_peered":"2024-09-12T00:18:26.867343+0000","last_unstale":"2024-09-12T01:01:46.718701+0000","last_undegraded":"2024-09-12T01:01:46.718701+0000","last_fullsized":"2024-09-12T01:01:46.718701+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:35.314858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'252","reported_seq":1356,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.962448+0000","last_change":"2024-09-12T00:18:28.892634+0000","last_active":"2024-09-12T01:04:31.962448+0000","last_peered":"2024-09-12T01:04:31.962448+0000","last_clean":"2024-09-12T01:04:31.962448+0000","last_became_active":"2024-09-12T00:18:28.889058+0000","last_became_peered":"2024-09-12T00:18:28.889058+0000","last_unstale":"2024-09-12T01:04:31.962448+0000","last_undegraded":"2024-09-12T01:04:31.962448+0000","last_fullsized":"2024-09-12T01:04:31.962448+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:46.530785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":190,"num_read_kb":179,"num_write":165,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":494,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:16.577209+0000","last_change":"2024-09-12T00:18:30.896789+0000","last_active":"2024-09-12T01:02:16.577209+0000","last_peered":"2024-09-12T01:02:16.577209+0000","last_clean":"2024-09-12T01:02:16.577209+0000","last_became_active":"2024-09-12T00:18:30.896073+0000","last_became_peered":"2024-09-12T00:18:30.896073+0000","last_unstale":"2024-09-12T01:02:16.577209+0000","last_undegraded":"2024-09-12T01:02:16.577209+0000","last_fullsized":"2024-09-12T01:02:16.577209+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:47.152911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'272","reported_seq":884,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.079029+0000","last_change":"2024-09-12T00:18:32.914870+0000","last_active":"2024-09-12T01:03:26.079029+0000","last_peered":"2024-09-12T01:03:26.079029+0000","last_clean":"2024-09-12T01:03:26.079029+0000","last_became_active":"2024-09-12T00:18:32.914004+0000","last_became_peered":"2024-09-12T00:18:32.914004+0000","last_unstale":"2024-09-12T01:03:26.079029+0000","last_undegraded":"2024-09-12T01:03:26.079029+0000","last_fullsized":"2024-09-12T01:03:26.079029+0000","mapping_epoch":34,"log_start":"268'200","ondisk_log_start":"268'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:37.374742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":517,"num_read_kb":535,"num_write":598,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'816","reported_seq":2373,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.819708+0000","last_change":"2024-09-12T00:18:24.870195+0000","last_active":"2024-09-12T01:04:30.819708+0000","last_peered":"2024-09-12T01:04:30.819708+0000","last_clean":"2024-09-12T01:04:30.819708+0000","last_became_active":"2024-09-12T00:18:24.869633+0000","last_became_peered":"2024-09-12T00:18:24.869633+0000","last_unstale":"2024-09-12T01:04:30.819708+0000","last_undegraded":"2024-09-12T01:04:30.819708+0000","last_fullsized":"2024-09-12T01:04:30.819708+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:24.540261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3879,"num_read_kb":3488,"num_write":1067,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.749218+0000","last_change":"2024-09-12T00:18:10.662993+0000","last_active":"2024-09-12T01:01:57.749218+0000","last_peered":"2024-09-12T01:01:57.749218+0000","last_clean":"2024-09-12T01:01:57.749218+0000","last_became_active":"2024-09-12T00:18:08.645156+0000","last_became_peered":"2024-09-12T00:18:08.645156+0000","last_unstale":"2024-09-12T01:01:57.749218+0000","last_undegraded":"2024-09-12T01:01:57.749218+0000","last_fullsized":"2024-09-12T01:01:57.749218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:52.068369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024595709999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'316","reported_seq":999,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.898917+0000","last_change":"2024-09-12T00:18:22.855734+0000","last_active":"2024-09-12T01:03:21.898917+0000","last_peered":"2024-09-12T01:03:21.898917+0000","last_clean":"2024-09-12T01:03:21.898917+0000","last_became_active":"2024-09-12T00:18:22.854940+0000","last_became_peered":"2024-09-12T00:18:22.854940+0000","last_unstale":"2024-09-12T01:03:21.898917+0000","last_undegraded":"2024-09-12T01:03:21.898917+0000","last_fullsized":"2024-09-12T01:03:21.898917+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:05.965555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11634921,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":527,"num_read_kb":32176,"num_write":1165,"num_write_kb":29732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.578382+0000","last_change":"2024-09-12T00:18:26.856551+0000","last_active":"2024-09-12T01:02:21.578382+0000","last_peered":"2024-09-12T01:02:21.578382+0000","last_clean":"2024-09-12T01:02:21.578382+0000","last_became_active":"2024-09-12T00:18:26.855239+0000","last_became_peered":"2024-09-12T00:18:26.855239+0000","last_unstale":"2024-09-12T01:02:21.578382+0000","last_undegraded":"2024-09-12T01:02:21.578382+0000","last_fullsized":"2024-09-12T01:02:21.578382+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:33.287785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'122","reported_seq":671,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:01.784399+0000","last_change":"2024-09-12T00:18:28.891881+0000","last_active":"2024-09-12T01:04:01.784399+0000","last_peered":"2024-09-12T01:04:01.784399+0000","last_clean":"2024-09-12T01:04:01.784399+0000","last_became_active":"2024-09-12T00:18:28.891173+0000","last_became_peered":"2024-09-12T00:18:28.891173+0000","last_unstale":"2024-09-12T01:04:01.784399+0000","last_undegraded":"2024-09-12T01:04:01.784399+0000","last_fullsized":"2024-09-12T01:04:01.784399+0000","mapping_epoch":30,"log_start":"268'100","ondisk_log_start":"268'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:02.040523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":142,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":491,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:52.727361+0000","last_change":"2024-09-12T00:18:30.904713+0000","last_active":"2024-09-12T01:01:52.727361+0000","last_peered":"2024-09-12T01:01:52.727361+0000","last_clean":"2024-09-12T01:01:52.727361+0000","last_became_active":"2024-09-12T00:18:30.904080+0000","last_became_peered":"2024-09-12T00:18:30.904080+0000","last_unstale":"2024-09-12T01:01:52.727361+0000","last_undegraded":"2024-09-12T01:01:52.727361+0000","last_fullsized":"2024-09-12T01:01:52.727361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:14.500655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'108","reported_seq":658,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.275864+0000","last_change":"2024-09-12T00:18:32.905383+0000","last_active":"2024-09-12T01:02:54.275864+0000","last_peered":"2024-09-12T01:02:54.275864+0000","last_clean":"2024-09-12T01:02:54.275864+0000","last_became_active":"2024-09-12T00:18:32.903109+0000","last_became_peered":"2024-09-12T00:18:32.903109+0000","last_unstale":"2024-09-12T01:02:54.275864+0000","last_undegraded":"2024-09-12T01:02:54.275864+0000","last_fullsized":"2024-09-12T01:02:54.275864+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:48.630615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":206,"num_read_kb":202,"num_write":268,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'472","reported_seq":1985,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.120332+0000","last_change":"2024-09-12T00:18:24.878475+0000","last_active":"2024-09-12T01:03:25.120332+0000","last_peered":"2024-09-12T01:03:25.120332+0000","last_clean":"2024-09-12T01:03:25.120332+0000","last_became_active":"2024-09-12T00:18:24.878031+0000","last_became_peered":"2024-09-12T00:18:24.878031+0000","last_unstale":"2024-09-12T01:03:25.120332+0000","last_undegraded":"2024-09-12T01:03:25.120332+0000","last_fullsized":"2024-09-12T01:03:25.120332+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:27.805912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2325,"num_read_kb":2173,"num_write":541,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'253","reported_seq":867,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.898632+0000","last_change":"2024-09-12T00:18:22.873808+0000","last_active":"2024-09-12T01:03:21.898632+0000","last_peered":"2024-09-12T01:03:21.898632+0000","last_clean":"2024-09-12T01:03:21.898632+0000","last_became_active":"2024-09-12T00:18:22.861336+0000","last_became_peered":"2024-09-12T00:18:22.861336+0000","last_unstale":"2024-09-12T01:03:21.898632+0000","last_undegraded":"2024-09-12T01:03:21.898632+0000","last_fullsized":"2024-09-12T01:03:21.898632+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:07.579776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13735787,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":353,"num_read_kb":16866,"num_write":896,"num_write_kb":39669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.551222+0000","last_change":"2024-09-12T00:18:10.665342+0000","last_active":"2024-09-12T01:01:56.551222+0000","last_peered":"2024-09-12T01:01:56.551222+0000","last_clean":"2024-09-12T01:01:56.551222+0000","last_became_active":"2024-09-12T00:18:08.956785+0000","last_became_peered":"2024-09-12T00:18:08.956785+0000","last_unstale":"2024-09-12T01:01:56.551222+0000","last_undegraded":"2024-09-12T01:01:56.551222+0000","last_fullsized":"2024-09-12T01:01:56.551222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:11.556988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012417909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.575765+0000","last_change":"2024-09-12T00:18:26.879934+0000","last_active":"2024-09-12T01:02:11.575765+0000","last_peered":"2024-09-12T01:02:11.575765+0000","last_clean":"2024-09-12T01:02:11.575765+0000","last_became_active":"2024-09-12T00:18:26.879511+0000","last_became_peered":"2024-09-12T00:18:26.879511+0000","last_unstale":"2024-09-12T01:02:11.575765+0000","last_undegraded":"2024-09-12T01:02:11.575765+0000","last_fullsized":"2024-09-12T01:02:11.575765+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:50.925795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'552","reported_seq":1220,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.751607+0000","last_change":"2024-09-12T00:18:28.880341+0000","last_active":"2024-09-12T01:04:31.751607+0000","last_peered":"2024-09-12T01:04:31.751607+0000","last_clean":"2024-09-12T01:04:31.751607+0000","last_became_active":"2024-09-12T00:18:28.879614+0000","last_became_peered":"2024-09-12T00:18:28.879614+0000","last_unstale":"2024-09-12T01:04:31.751607+0000","last_undegraded":"2024-09-12T01:04:31.751607+0000","last_fullsized":"2024-09-12T01:04:31.751607+0000","mapping_epoch":30,"log_start":"268'500","ondisk_log_start":"268'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:03.149386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117967,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":920,"num_read_kb":1830,"num_write":792,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:17.552865+0000","last_change":"2024-09-12T00:18:30.904154+0000","last_active":"2024-09-12T01:02:17.552865+0000","last_peered":"2024-09-12T01:02:17.552865+0000","last_clean":"2024-09-12T01:02:17.552865+0000","last_became_active":"2024-09-12T00:18:30.903532+0000","last_became_peered":"2024-09-12T00:18:30.903532+0000","last_unstale":"2024-09-12T01:02:17.552865+0000","last_undegraded":"2024-09-12T01:02:17.552865+0000","last_fullsized":"2024-09-12T01:02:17.552865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:56.341364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'142","reported_seq":649,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.969443+0000","last_change":"2024-09-12T00:18:32.897568+0000","last_active":"2024-09-12T01:03:25.969443+0000","last_peered":"2024-09-12T01:03:25.969443+0000","last_clean":"2024-09-12T01:03:25.969443+0000","last_became_active":"2024-09-12T00:18:32.896532+0000","last_became_peered":"2024-09-12T00:18:32.896532+0000","last_unstale":"2024-09-12T01:03:25.969443+0000","last_undegraded":"2024-09-12T01:03:25.969443+0000","last_fullsized":"2024-09-12T01:03:25.969443+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:19.854551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":138,"num_write":339,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'364","reported_seq":1903,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.171828+0000","last_change":"2024-09-12T00:18:24.856127+0000","last_active":"2024-09-12T01:03:03.171828+0000","last_peered":"2024-09-12T01:03:03.171828+0000","last_clean":"2024-09-12T01:03:03.171828+0000","last_became_active":"2024-09-12T00:18:24.852620+0000","last_became_peered":"2024-09-12T00:18:24.852620+0000","last_unstale":"2024-09-12T01:03:03.171828+0000","last_undegraded":"2024-09-12T01:03:03.171828+0000","last_fullsized":"2024-09-12T01:03:03.171828+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:07.552365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2109,"num_read_kb":2037,"num_write":400,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'275","reported_seq":921,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.555047+0000","last_change":"2024-09-12T00:18:22.839269+0000","last_active":"2024-09-12T01:02:11.555047+0000","last_peered":"2024-09-12T01:02:11.555047+0000","last_clean":"2024-09-12T01:02:11.555047+0000","last_became_active":"2024-09-12T00:18:22.839001+0000","last_became_peered":"2024-09-12T00:18:22.839001+0000","last_unstale":"2024-09-12T01:02:11.555047+0000","last_undegraded":"2024-09-12T01:02:11.555047+0000","last_fullsized":"2024-09-12T01:02:11.555047+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:51.522439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7372265,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":413,"num_read_kb":59946,"num_write":909,"num_write_kb":34875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:07.547276+0000","last_change":"2024-09-12T00:18:10.895453+0000","last_active":"2024-09-12T01:02:07.547276+0000","last_peered":"2024-09-12T01:02:07.547276+0000","last_clean":"2024-09-12T01:02:07.547276+0000","last_became_active":"2024-09-12T00:18:08.958069+0000","last_became_peered":"2024-09-12T00:18:08.958069+0000","last_unstale":"2024-09-12T01:02:07.547276+0000","last_undegraded":"2024-09-12T01:02:07.547276+0000","last_fullsized":"2024-09-12T01:02:07.547276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:41.978158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001047189,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.731707+0000","last_change":"2024-09-12T00:18:26.866580+0000","last_active":"2024-09-12T01:02:12.731707+0000","last_peered":"2024-09-12T01:02:12.731707+0000","last_clean":"2024-09-12T01:02:12.731707+0000","last_became_active":"2024-09-12T00:18:26.865743+0000","last_became_peered":"2024-09-12T00:18:26.865743+0000","last_unstale":"2024-09-12T01:02:12.731707+0000","last_undegraded":"2024-09-12T01:02:12.731707+0000","last_fullsized":"2024-09-12T01:02:12.731707+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:54.698335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'164","reported_seq":741,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.887776+0000","last_change":"2024-09-12T00:18:28.877919+0000","last_active":"2024-09-12T01:03:25.887776+0000","last_peered":"2024-09-12T01:03:25.887776+0000","last_clean":"2024-09-12T01:03:25.887776+0000","last_became_active":"2024-09-12T00:18:28.877233+0000","last_became_peered":"2024-09-12T00:18:28.877233+0000","last_unstale":"2024-09-12T01:03:25.887776+0000","last_undegraded":"2024-09-12T01:03:25.887776+0000","last_fullsized":"2024-09-12T01:03:25.887776+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:54.638936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":206,"num_read_kb":196,"num_write":136,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'788","reported_seq":2602,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.826688+0000","last_change":"2024-09-12T00:18:30.874256+0000","last_active":"2024-09-12T01:04:31.826688+0000","last_peered":"2024-09-12T01:04:31.826688+0000","last_clean":"2024-09-12T01:04:31.826688+0000","last_became_active":"2024-09-12T00:18:30.873484+0000","last_became_peered":"2024-09-12T00:18:30.873484+0000","last_unstale":"2024-09-12T01:04:31.826688+0000","last_undegraded":"2024-09-12T01:04:31.826688+0000","last_fullsized":"2024-09-12T01:04:31.826688+0000","mapping_epoch":32,"log_start":"268'702","ondisk_log_start":"268'702","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":702,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:48.826950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'163","reported_seq":681,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.836361+0000","last_change":"2024-09-12T00:18:32.894083+0000","last_active":"2024-09-12T01:04:30.836361+0000","last_peered":"2024-09-12T01:04:30.836361+0000","last_clean":"2024-09-12T01:04:30.836361+0000","last_became_active":"2024-09-12T00:18:32.893315+0000","last_became_peered":"2024-09-12T00:18:32.893315+0000","last_unstale":"2024-09-12T01:04:30.836361+0000","last_undegraded":"2024-09-12T01:04:30.836361+0000","last_fullsized":"2024-09-12T01:04:30.836361+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:09.991201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":201,"num_read_kb":185,"num_write":395,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'450","reported_seq":2014,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.120605+0000","last_change":"2024-09-12T00:18:24.866105+0000","last_active":"2024-09-12T01:03:25.120605+0000","last_peered":"2024-09-12T01:03:25.120605+0000","last_clean":"2024-09-12T01:03:25.120605+0000","last_became_active":"2024-09-12T00:18:24.865603+0000","last_became_peered":"2024-09-12T00:18:24.865603+0000","last_unstale":"2024-09-12T01:03:25.120605+0000","last_undegraded":"2024-09-12T01:03:25.120605+0000","last_fullsized":"2024-09-12T01:03:25.120605+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:38.883418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2591,"num_read_kb":2430,"num_write":539,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'278","reported_seq":902,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:14.657349+0000","last_change":"2024-09-12T00:18:22.870893+0000","last_active":"2024-09-12T01:02:14.657349+0000","last_peered":"2024-09-12T01:02:14.657349+0000","last_clean":"2024-09-12T01:02:14.657349+0000","last_became_active":"2024-09-12T00:18:22.870180+0000","last_became_peered":"2024-09-12T00:18:22.870180+0000","last_unstale":"2024-09-12T01:02:14.657349+0000","last_undegraded":"2024-09-12T01:02:14.657349+0000","last_fullsized":"2024-09-12T01:02:14.657349+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:39.546988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5273149,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":371,"num_read_kb":16363,"num_write":982,"num_write_kb":31356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:31.545792+0000","last_change":"2024-09-12T00:18:10.665231+0000","last_active":"2024-09-12T01:01:31.545792+0000","last_peered":"2024-09-12T01:01:31.545792+0000","last_clean":"2024-09-12T01:01:31.545792+0000","last_became_active":"2024-09-12T00:18:08.638003+0000","last_became_peered":"2024-09-12T00:18:08.638003+0000","last_unstale":"2024-09-12T01:01:31.545792+0000","last_undegraded":"2024-09-12T01:01:31.545792+0000","last_fullsized":"2024-09-12T01:01:31.545792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:05.656587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010953429999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.549583+0000","last_change":"2024-09-12T00:18:26.859001+0000","last_active":"2024-09-12T01:02:12.549583+0000","last_peered":"2024-09-12T01:02:12.549583+0000","last_clean":"2024-09-12T01:02:12.549583+0000","last_became_active":"2024-09-12T00:18:26.858300+0000","last_became_peered":"2024-09-12T00:18:26.858300+0000","last_unstale":"2024-09-12T01:02:12.549583+0000","last_undegraded":"2024-09-12T01:02:12.549583+0000","last_fullsized":"2024-09-12T01:02:12.549583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:24.947974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'109","reported_seq":658,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:17.552956+0000","last_change":"2024-09-12T00:18:28.882042+0000","last_active":"2024-09-12T01:02:17.552956+0000","last_peered":"2024-09-12T01:02:17.552956+0000","last_clean":"2024-09-12T01:02:17.552956+0000","last_became_active":"2024-09-12T00:18:28.880684+0000","last_became_peered":"2024-09-12T00:18:28.880684+0000","last_unstale":"2024-09-12T01:02:17.552956+0000","last_undegraded":"2024-09-12T01:02:17.552956+0000","last_fullsized":"2024-09-12T01:02:17.552956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:05.919489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'813","reported_seq":2638,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.835686+0000","last_change":"2024-09-12T00:18:30.903318+0000","last_active":"2024-09-12T01:04:31.835686+0000","last_peered":"2024-09-12T01:04:31.835686+0000","last_clean":"2024-09-12T01:04:31.835686+0000","last_became_active":"2024-09-12T00:18:30.902580+0000","last_became_peered":"2024-09-12T00:18:30.902580+0000","last_unstale":"2024-09-12T01:04:31.835686+0000","last_undegraded":"2024-09-12T01:04:31.835686+0000","last_fullsized":"2024-09-12T01:04:31.835686+0000","mapping_epoch":32,"log_start":"268'800","ondisk_log_start":"268'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":800,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:13.015304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'173","reported_seq":673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:24.492347+0000","last_change":"2024-09-12T00:18:32.903845+0000","last_active":"2024-09-12T01:03:24.492347+0000","last_peered":"2024-09-12T01:03:24.492347+0000","last_clean":"2024-09-12T01:03:24.492347+0000","last_became_active":"2024-09-12T00:18:32.902970+0000","last_became_peered":"2024-09-12T00:18:32.902970+0000","last_unstale":"2024-09-12T01:03:24.492347+0000","last_undegraded":"2024-09-12T01:03:24.492347+0000","last_fullsized":"2024-09-12T01:03:24.492347+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:29.969603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":388,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'588","reported_seq":2161,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.347778+0000","last_change":"2024-09-12T00:18:24.879885+0000","last_active":"2024-09-12T01:03:37.347778+0000","last_peered":"2024-09-12T01:03:37.347778+0000","last_clean":"2024-09-12T01:03:37.347778+0000","last_became_active":"2024-09-12T00:18:24.879205+0000","last_became_peered":"2024-09-12T00:18:24.879205+0000","last_unstale":"2024-09-12T01:03:37.347778+0000","last_undegraded":"2024-09-12T01:03:37.347778+0000","last_fullsized":"2024-09-12T01:03:37.347778+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":500,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:25.009708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":3160,"num_read_kb":2876,"num_write":787,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'273","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:42.596916+0000","last_change":"2024-09-12T00:18:22.850648+0000","last_active":"2024-09-12T01:02:42.596916+0000","last_peered":"2024-09-12T01:02:42.596916+0000","last_clean":"2024-09-12T01:02:42.596916+0000","last_became_active":"2024-09-12T00:18:22.850326+0000","last_became_peered":"2024-09-12T00:18:22.850326+0000","last_unstale":"2024-09-12T01:02:42.596916+0000","last_undegraded":"2024-09-12T01:02:42.596916+0000","last_fullsized":"2024-09-12T01:02:42.596916+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:20.333270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2120764,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":492,"num_read_kb":1531,"num_write":992,"num_write_kb":23375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:32.723228+0000","last_change":"2024-09-12T00:18:10.895554+0000","last_active":"2024-09-12T01:01:32.723228+0000","last_peered":"2024-09-12T01:01:32.723228+0000","last_clean":"2024-09-12T01:01:32.723228+0000","last_became_active":"2024-09-12T00:18:08.648187+0000","last_became_peered":"2024-09-12T00:18:08.648187+0000","last_unstale":"2024-09-12T01:01:32.723228+0000","last_undegraded":"2024-09-12T01:01:32.723228+0000","last_fullsized":"2024-09-12T01:01:32.723228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:14.147236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001130048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:31.765082+0000","last_change":"2024-09-12T00:18:26.851380+0000","last_active":"2024-09-12T01:02:31.765082+0000","last_peered":"2024-09-12T01:02:31.765082+0000","last_clean":"2024-09-12T01:02:31.765082+0000","last_became_active":"2024-09-12T00:18:26.851038+0000","last_became_peered":"2024-09-12T00:18:26.851038+0000","last_unstale":"2024-09-12T01:02:31.765082+0000","last_undegraded":"2024-09-12T01:02:31.765082+0000","last_fullsized":"2024-09-12T01:02:31.765082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:34.120180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'734","reported_seq":1445,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.743617+0000","last_change":"2024-09-12T00:18:28.885754+0000","last_active":"2024-09-12T01:04:31.743617+0000","last_peered":"2024-09-12T01:04:31.743617+0000","last_clean":"2024-09-12T01:04:31.743617+0000","last_became_active":"2024-09-12T00:18:28.884726+0000","last_became_peered":"2024-09-12T00:18:28.884726+0000","last_unstale":"2024-09-12T01:04:31.743617+0000","last_undegraded":"2024-09-12T01:04:31.743617+0000","last_fullsized":"2024-09-12T01:04:31.743617+0000","mapping_epoch":30,"log_start":"268'700","ondisk_log_start":"268'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":700,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:33.539730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187598,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1298,"num_read_kb":2803,"num_write":1074,"num_write_kb":914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:16.760930+0000","last_change":"2024-09-12T00:18:30.902052+0000","last_active":"2024-09-12T01:02:16.760930+0000","last_peered":"2024-09-12T01:02:16.760930+0000","last_clean":"2024-09-12T01:02:16.760930+0000","last_became_active":"2024-09-12T00:18:30.900777+0000","last_became_peered":"2024-09-12T00:18:30.900777+0000","last_unstale":"2024-09-12T01:02:16.760930+0000","last_undegraded":"2024-09-12T01:02:16.760930+0000","last_fullsized":"2024-09-12T01:02:16.760930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:05.763516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'111","reported_seq":608,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.877760+0000","last_change":"2024-09-12T00:18:32.900574+0000","last_active":"2024-09-12T01:03:25.877760+0000","last_peered":"2024-09-12T01:03:25.877760+0000","last_clean":"2024-09-12T01:03:25.877760+0000","last_became_active":"2024-09-12T00:18:32.899881+0000","last_became_peered":"2024-09-12T00:18:32.899881+0000","last_unstale":"2024-09-12T01:03:25.877760+0000","last_undegraded":"2024-09-12T01:03:25.877760+0000","last_fullsized":"2024-09-12T01:03:25.877760+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:39.617551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":105,"num_write":264,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'146","reported_seq":709,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.030418+0000","last_change":"2024-09-12T00:18:32.904423+0000","last_active":"2024-09-12T01:03:26.030418+0000","last_peered":"2024-09-12T01:03:26.030418+0000","last_clean":"2024-09-12T01:03:26.030418+0000","last_became_active":"2024-09-12T00:18:32.902596+0000","last_became_peered":"2024-09-12T00:18:32.902596+0000","last_unstale":"2024-09-12T01:03:26.030418+0000","last_undegraded":"2024-09-12T01:03:26.030418+0000","last_fullsized":"2024-09-12T01:03:26.030418+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:15.240829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":238,"num_read_kb":229,"num_write":342,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'482","reported_seq":2105,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.705235+0000","last_change":"2024-09-12T00:18:24.880298+0000","last_active":"2024-09-12T01:03:20.705235+0000","last_peered":"2024-09-12T01:03:20.705235+0000","last_clean":"2024-09-12T01:03:20.705235+0000","last_became_active":"2024-09-12T00:18:24.879640+0000","last_became_peered":"2024-09-12T00:18:24.879640+0000","last_unstale":"2024-09-12T01:03:20.705235+0000","last_undegraded":"2024-09-12T01:03:20.705235+0000","last_fullsized":"2024-09-12T01:03:20.705235+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:24.256945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2579,"num_read_kb":2446,"num_write":588,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'318","reported_seq":969,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:22.292716+0000","last_change":"2024-09-12T00:18:22.877577+0000","last_active":"2024-09-12T01:02:22.292716+0000","last_peered":"2024-09-12T01:02:22.292716+0000","last_clean":"2024-09-12T01:02:22.292716+0000","last_became_active":"2024-09-12T00:18:22.874059+0000","last_became_peered":"2024-09-12T00:18:22.874059+0000","last_unstale":"2024-09-12T01:02:22.292716+0000","last_undegraded":"2024-09-12T01:02:22.292716+0000","last_fullsized":"2024-09-12T01:02:22.292716+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:35.192212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14747835,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":494,"num_read_kb":19539,"num_write":1151,"num_write_kb":37354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:26.529417+0000","last_change":"2024-09-12T00:18:26.868055+0000","last_active":"2024-09-12T01:00:26.529417+0000","last_peered":"2024-09-12T01:00:26.529417+0000","last_clean":"2024-09-12T01:00:26.529417+0000","last_became_active":"2024-09-12T00:18:26.866940+0000","last_became_peered":"2024-09-12T00:18:26.866940+0000","last_unstale":"2024-09-12T01:00:26.529417+0000","last_undegraded":"2024-09-12T01:00:26.529417+0000","last_fullsized":"2024-09-12T01:00:26.529417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:32.546738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'289","reported_seq":872,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.848602+0000","last_change":"2024-09-12T00:18:28.878607+0000","last_active":"2024-09-12T01:04:30.848602+0000","last_peered":"2024-09-12T01:04:30.848602+0000","last_clean":"2024-09-12T01:04:30.848602+0000","last_became_active":"2024-09-12T00:18:28.877560+0000","last_became_peered":"2024-09-12T00:18:28.877560+0000","last_unstale":"2024-09-12T01:04:30.848602+0000","last_undegraded":"2024-09-12T01:04:30.848602+0000","last_fullsized":"2024-09-12T01:04:30.848602+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:45.619406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55164,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":468,"num_read_kb":971,"num_write":386,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:31.733041+0000","last_change":"2024-09-12T00:18:30.903541+0000","last_active":"2024-09-12T01:00:31.733041+0000","last_peered":"2024-09-12T01:00:31.733041+0000","last_clean":"2024-09-12T01:00:31.733041+0000","last_became_active":"2024-09-12T00:18:30.901022+0000","last_became_peered":"2024-09-12T00:18:30.901022+0000","last_unstale":"2024-09-12T01:00:31.733041+0000","last_undegraded":"2024-09-12T01:00:31.733041+0000","last_fullsized":"2024-09-12T01:00:31.733041+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:14.300352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'140","reported_seq":653,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.196600+0000","last_change":"2024-09-12T00:18:32.901918+0000","last_active":"2024-09-12T01:03:01.196600+0000","last_peered":"2024-09-12T01:03:01.196600+0000","last_clean":"2024-09-12T01:03:01.196600+0000","last_became_active":"2024-09-12T00:18:32.900434+0000","last_became_peered":"2024-09-12T00:18:32.900434+0000","last_unstale":"2024-09-12T01:03:01.196600+0000","last_undegraded":"2024-09-12T01:03:01.196600+0000","last_fullsized":"2024-09-12T01:03:01.196600+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:49.600913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":83,"num_write":305,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'543","reported_seq":1959,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.741300+0000","last_change":"2024-09-12T00:18:24.878881+0000","last_active":"2024-09-12T01:03:06.741300+0000","last_peered":"2024-09-12T01:03:06.741300+0000","last_clean":"2024-09-12T01:03:06.741300+0000","last_became_active":"2024-09-12T00:18:24.878531+0000","last_became_peered":"2024-09-12T00:18:24.878531+0000","last_unstale":"2024-09-12T01:03:06.741300+0000","last_undegraded":"2024-09-12T01:03:06.741300+0000","last_fullsized":"2024-09-12T01:03:06.741300+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:48.183195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2546,"num_read_kb":2313,"num_write":710,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'336","reported_seq":1058,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:52.543841+0000","last_change":"2024-09-12T00:18:56.194776+0000","last_active":"2024-09-12T01:01:52.543841+0000","last_peered":"2024-09-12T01:01:52.543841+0000","last_clean":"2024-09-12T01:01:52.543841+0000","last_became_active":"2024-09-12T00:18:56.193958+0000","last_became_peered":"2024-09-12T00:18:56.193958+0000","last_unstale":"2024-09-12T01:01:52.543841+0000","last_undegraded":"2024-09-12T01:01:52.543841+0000","last_fullsized":"2024-09-12T01:01:52.543841+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:37.859959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8411057,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":707,"num_read_kb":16311,"num_write":1176,"num_write_kb":28883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:26.731697+0000","last_change":"2024-09-12T00:18:26.852947+0000","last_active":"2024-09-12T01:00:26.731697+0000","last_peered":"2024-09-12T01:00:26.731697+0000","last_clean":"2024-09-12T01:00:26.731697+0000","last_became_active":"2024-09-12T00:18:26.852430+0000","last_became_peered":"2024-09-12T00:18:26.852430+0000","last_unstale":"2024-09-12T01:00:26.731697+0000","last_undegraded":"2024-09-12T01:00:26.731697+0000","last_fullsized":"2024-09-12T01:00:26.731697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:06.569149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'47","reported_seq":552,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:16.496467+0000","last_change":"2024-09-12T00:18:28.889342+0000","last_active":"2024-09-12T01:02:16.496467+0000","last_peered":"2024-09-12T01:02:16.496467+0000","last_clean":"2024-09-12T01:02:16.496467+0000","last_became_active":"2024-09-12T00:18:28.888625+0000","last_became_peered":"2024-09-12T00:18:28.888625+0000","last_unstale":"2024-09-12T01:02:16.496467+0000","last_undegraded":"2024-09-12T01:02:16.496467+0000","last_fullsized":"2024-09-12T01:02:16.496467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:38.074165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:32.525392+0000","last_change":"2024-09-12T00:18:30.895269+0000","last_active":"2024-09-12T01:00:32.525392+0000","last_peered":"2024-09-12T01:00:32.525392+0000","last_clean":"2024-09-12T01:00:32.525392+0000","last_became_active":"2024-09-12T00:18:30.894388+0000","last_became_peered":"2024-09-12T00:18:30.894388+0000","last_unstale":"2024-09-12T01:00:32.525392+0000","last_undegraded":"2024-09-12T01:00:32.525392+0000","last_fullsized":"2024-09-12T01:00:32.525392+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:32.983260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'210","reported_seq":728,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.127161+0000","last_change":"2024-09-12T00:18:32.904521+0000","last_active":"2024-09-12T01:03:25.127161+0000","last_peered":"2024-09-12T01:03:25.127161+0000","last_clean":"2024-09-12T01:03:25.127161+0000","last_became_active":"2024-09-12T00:18:32.903719+0000","last_became_peered":"2024-09-12T00:18:32.903719+0000","last_unstale":"2024-09-12T01:03:25.127161+0000","last_undegraded":"2024-09-12T01:03:25.127161+0000","last_fullsized":"2024-09-12T01:03:25.127161+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:22.565162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":286,"num_read_kb":283,"num_write":470,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'850","reported_seq":2448,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.178028+0000","last_change":"2024-09-12T00:18:24.865796+0000","last_active":"2024-09-12T01:03:11.178028+0000","last_peered":"2024-09-12T01:03:11.178028+0000","last_clean":"2024-09-12T01:03:11.178028+0000","last_became_active":"2024-09-12T00:18:24.865480+0000","last_became_peered":"2024-09-12T00:18:24.865480+0000","last_unstale":"2024-09-12T01:03:11.178028+0000","last_undegraded":"2024-09-12T01:03:11.178028+0000","last_fullsized":"2024-09-12T01:03:11.178028+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":800,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:13.433725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4053,"num_read_kb":3643,"num_write":1115,"num_write_kb":411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'315","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.732591+0000","last_change":"2024-09-12T00:18:55.955883+0000","last_active":"2024-09-12T01:03:09.732591+0000","last_peered":"2024-09-12T01:03:09.732591+0000","last_clean":"2024-09-12T01:03:09.732591+0000","last_became_active":"2024-09-12T00:18:55.955303+0000","last_became_peered":"2024-09-12T00:18:55.955303+0000","last_unstale":"2024-09-12T01:03:09.732591+0000","last_undegraded":"2024-09-12T01:03:09.732591+0000","last_fullsized":"2024-09-12T01:03:09.732591+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:26.714282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11123122,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":524,"num_read_kb":40569,"num_write":1286,"num_write_kb":40151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:27.524107+0000","last_change":"2024-09-12T00:18:26.860720+0000","last_active":"2024-09-12T01:00:27.524107+0000","last_peered":"2024-09-12T01:00:27.524107+0000","last_clean":"2024-09-12T01:00:27.524107+0000","last_became_active":"2024-09-12T00:18:26.859801+0000","last_became_peered":"2024-09-12T00:18:26.859801+0000","last_unstale":"2024-09-12T01:00:27.524107+0000","last_undegraded":"2024-09-12T01:00:27.524107+0000","last_fullsized":"2024-09-12T01:00:27.524107+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:36.551977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'311","reported_seq":904,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.770214+0000","last_change":"2024-09-12T00:18:28.878040+0000","last_active":"2024-09-12T01:02:51.770214+0000","last_peered":"2024-09-12T01:02:51.770214+0000","last_clean":"2024-09-12T01:02:51.770214+0000","last_became_active":"2024-09-12T00:18:28.877317+0000","last_became_peered":"2024-09-12T00:18:28.877317+0000","last_unstale":"2024-09-12T01:02:51.770214+0000","last_undegraded":"2024-09-12T01:02:51.770214+0000","last_fullsized":"2024-09-12T01:02:51.770214+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:36.629509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62859,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":1022,"num_write":412,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:32.710908+0000","last_change":"2024-09-12T00:18:30.904722+0000","last_active":"2024-09-12T01:00:32.710908+0000","last_peered":"2024-09-12T01:00:32.710908+0000","last_clean":"2024-09-12T01:00:32.710908+0000","last_became_active":"2024-09-12T00:18:30.904052+0000","last_became_peered":"2024-09-12T00:18:30.904052+0000","last_unstale":"2024-09-12T01:00:32.710908+0000","last_undegraded":"2024-09-12T01:00:32.710908+0000","last_fullsized":"2024-09-12T01:00:32.710908+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:47.904502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'138","reported_seq":657,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.556907+0000","last_change":"2024-09-12T00:18:32.900262+0000","last_active":"2024-09-12T01:03:23.556907+0000","last_peered":"2024-09-12T01:03:23.556907+0000","last_clean":"2024-09-12T01:03:23.556907+0000","last_became_active":"2024-09-12T00:18:32.899607+0000","last_became_peered":"2024-09-12T00:18:32.899607+0000","last_unstale":"2024-09-12T01:03:23.556907+0000","last_undegraded":"2024-09-12T01:03:23.556907+0000","last_fullsized":"2024-09-12T01:03:23.556907+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:26.707774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":193,"num_read_kb":183,"num_write":356,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'350","reported_seq":1891,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.346899+0000","last_change":"2024-09-12T00:18:24.863688+0000","last_active":"2024-09-12T01:03:37.346899+0000","last_peered":"2024-09-12T01:03:37.346899+0000","last_clean":"2024-09-12T01:03:37.346899+0000","last_became_active":"2024-09-12T00:18:24.863389+0000","last_became_peered":"2024-09-12T00:18:24.863389+0000","last_unstale":"2024-09-12T01:03:37.346899+0000","last_undegraded":"2024-09-12T01:03:37.346899+0000","last_fullsized":"2024-09-12T01:03:37.346899+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:05.818950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2172,"num_read_kb":2099,"num_write":388,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'285","reported_seq":919,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:13.851507+0000","last_change":"2024-09-12T00:18:22.863804+0000","last_active":"2024-09-12T01:02:13.851507+0000","last_peered":"2024-09-12T01:02:13.851507+0000","last_clean":"2024-09-12T01:02:13.851507+0000","last_became_active":"2024-09-12T00:18:22.863535+0000","last_became_peered":"2024-09-12T00:18:22.863535+0000","last_unstale":"2024-09-12T01:02:13.851507+0000","last_undegraded":"2024-09-12T01:02:13.851507+0000","last_fullsized":"2024-09-12T01:02:13.851507+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:39.498808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2451042,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":431,"num_read_kb":3769,"num_write":1015,"num_write_kb":28344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:27.709827+0000","last_change":"2024-09-12T00:18:26.875530+0000","last_active":"2024-09-12T01:00:27.709827+0000","last_peered":"2024-09-12T01:00:27.709827+0000","last_clean":"2024-09-12T01:00:27.709827+0000","last_became_active":"2024-09-12T00:18:26.874839+0000","last_became_peered":"2024-09-12T00:18:26.874839+0000","last_unstale":"2024-09-12T01:00:27.709827+0000","last_undegraded":"2024-09-12T01:00:27.709827+0000","last_fullsized":"2024-09-12T01:00:27.709827+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:15.854373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'266","reported_seq":830,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.557384+0000","last_change":"2024-09-12T00:18:28.891511+0000","last_active":"2024-09-12T01:02:52.557384+0000","last_peered":"2024-09-12T01:02:52.557384+0000","last_clean":"2024-09-12T01:02:52.557384+0000","last_became_active":"2024-09-12T00:18:28.888325+0000","last_became_peered":"2024-09-12T00:18:28.888325+0000","last_unstale":"2024-09-12T01:02:52.557384+0000","last_undegraded":"2024-09-12T01:02:52.557384+0000","last_fullsized":"2024-09-12T01:02:52.557384+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:42.542012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61114,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":440,"num_read_kb":948,"num_write":366,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":491,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:31.547022+0000","last_change":"2024-09-12T00:18:30.900318+0000","last_active":"2024-09-12T01:00:31.547022+0000","last_peered":"2024-09-12T01:00:31.547022+0000","last_clean":"2024-09-12T01:00:31.547022+0000","last_became_active":"2024-09-12T00:18:30.899237+0000","last_became_peered":"2024-09-12T00:18:30.899237+0000","last_unstale":"2024-09-12T01:00:31.547022+0000","last_undegraded":"2024-09-12T01:00:31.547022+0000","last_fullsized":"2024-09-12T01:00:31.547022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:30.916112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'930","reported_seq":2365,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.094892+0000","last_change":"2024-09-12T00:18:24.861100+0000","last_active":"2024-09-12T01:03:04.094892+0000","last_peered":"2024-09-12T01:03:04.094892+0000","last_clean":"2024-09-12T01:03:04.094892+0000","last_became_active":"2024-09-12T00:18:24.859351+0000","last_became_peered":"2024-09-12T00:18:24.859351+0000","last_unstale":"2024-09-12T01:03:04.094892+0000","last_undegraded":"2024-09-12T01:03:04.094892+0000","last_fullsized":"2024-09-12T01:03:04.094892+0000","mapping_epoch":26,"log_start":"268'900","ondisk_log_start":"268'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":900,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:16.033612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4324,"num_read_kb":3896,"num_write":1355,"num_write_kb":567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'249","reported_seq":949,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.755421+0000","last_change":"2024-09-12T00:18:22.840532+0000","last_active":"2024-09-12T01:01:56.755421+0000","last_peered":"2024-09-12T01:01:56.755421+0000","last_clean":"2024-09-12T01:01:56.755421+0000","last_became_active":"2024-09-12T00:18:22.840244+0000","last_became_peered":"2024-09-12T00:18:22.840244+0000","last_unstale":"2024-09-12T01:01:56.755421+0000","last_undegraded":"2024-09-12T01:01:56.755421+0000","last_fullsized":"2024-09-12T01:01:56.755421+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:57.476911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5274976,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":554,"num_read_kb":30344,"num_write":897,"num_write_kb":34968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:36.582308+0000","last_change":"2024-09-12T00:18:26.856078+0000","last_active":"2024-09-12T01:02:36.582308+0000","last_peered":"2024-09-12T01:02:36.582308+0000","last_clean":"2024-09-12T01:02:36.582308+0000","last_became_active":"2024-09-12T00:18:26.855432+0000","last_became_peered":"2024-09-12T00:18:26.855432+0000","last_unstale":"2024-09-12T01:02:36.582308+0000","last_undegraded":"2024-09-12T01:02:36.582308+0000","last_fullsized":"2024-09-12T01:02:36.582308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:58.468112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'459","reported_seq":1092,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.736135+0000","last_change":"2024-09-12T00:18:28.888006+0000","last_active":"2024-09-12T01:04:31.736135+0000","last_peered":"2024-09-12T01:04:31.736135+0000","last_clean":"2024-09-12T01:04:31.736135+0000","last_became_active":"2024-09-12T00:18:28.887245+0000","last_became_peered":"2024-09-12T00:18:28.887245+0000","last_unstale":"2024-09-12T01:04:31.736135+0000","last_undegraded":"2024-09-12T01:04:31.736135+0000","last_fullsized":"2024-09-12T01:04:31.736135+0000","mapping_epoch":30,"log_start":"268'400","ondisk_log_start":"268'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:58.763012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105863,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":819,"num_read_kb":1744,"num_write":714,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":490,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.736385+0000","last_change":"2024-09-12T00:18:30.906327+0000","last_active":"2024-09-12T01:01:02.736385+0000","last_peered":"2024-09-12T01:01:02.736385+0000","last_clean":"2024-09-12T01:01:02.736385+0000","last_became_active":"2024-09-12T00:18:30.905680+0000","last_became_peered":"2024-09-12T00:18:30.905680+0000","last_unstale":"2024-09-12T01:01:02.736385+0000","last_undegraded":"2024-09-12T01:01:02.736385+0000","last_fullsized":"2024-09-12T01:01:02.736385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:50.953253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'152","reported_seq":659,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:43.232099+0000","last_change":"2024-09-12T00:18:32.905858+0000","last_active":"2024-09-12T01:02:43.232099+0000","last_peered":"2024-09-12T01:02:43.232099+0000","last_clean":"2024-09-12T01:02:43.232099+0000","last_became_active":"2024-09-12T00:18:32.905070+0000","last_became_peered":"2024-09-12T00:18:32.905070+0000","last_unstale":"2024-09-12T01:02:43.232099+0000","last_undegraded":"2024-09-12T01:02:43.232099+0000","last_fullsized":"2024-09-12T01:02:43.232099+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:11.929111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":167,"num_read_kb":179,"num_write":337,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'639","reported_seq":2054,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.704634+0000","last_change":"2024-09-12T00:18:24.865575+0000","last_active":"2024-09-12T01:03:20.704634+0000","last_peered":"2024-09-12T01:03:20.704634+0000","last_clean":"2024-09-12T01:03:20.704634+0000","last_became_active":"2024-09-12T00:18:24.865142+0000","last_became_peered":"2024-09-12T00:18:24.865142+0000","last_unstale":"2024-09-12T01:03:20.704634+0000","last_undegraded":"2024-09-12T01:03:20.704634+0000","last_fullsized":"2024-09-12T01:03:20.704634+0000","mapping_epoch":26,"log_start":"268'600","ondisk_log_start":"268'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":600,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:47.722129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2990,"num_read_kb":2759,"num_write":892,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'290","reported_seq":1214,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:06.553575+0000","last_change":"2024-09-12T00:18:22.846016+0000","last_active":"2024-09-12T01:02:06.553575+0000","last_peered":"2024-09-12T01:02:06.553575+0000","last_clean":"2024-09-12T01:02:06.553575+0000","last_became_active":"2024-09-12T00:18:22.845288+0000","last_became_peered":"2024-09-12T00:18:22.845288+0000","last_unstale":"2024-09-12T01:02:06.553575+0000","last_undegraded":"2024-09-12T01:02:06.553575+0000","last_fullsized":"2024-09-12T01:02:06.553575+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:08.062033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2200296,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1065,"num_read_kb":11057,"num_write":1161,"num_write_kb":25104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.731837+0000","last_change":"2024-09-12T00:18:26.875611+0000","last_active":"2024-09-12T01:02:12.731837+0000","last_peered":"2024-09-12T01:02:12.731837+0000","last_clean":"2024-09-12T01:02:12.731837+0000","last_became_active":"2024-09-12T00:18:26.874972+0000","last_became_peered":"2024-09-12T00:18:26.874972+0000","last_unstale":"2024-09-12T01:02:12.731837+0000","last_undegraded":"2024-09-12T01:02:12.731837+0000","last_fullsized":"2024-09-12T01:02:12.731837+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:26.192283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'312","reported_seq":890,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:32.566874+0000","last_change":"2024-09-12T00:18:28.893601+0000","last_active":"2024-09-12T01:03:32.566874+0000","last_peered":"2024-09-12T01:03:32.566874+0000","last_clean":"2024-09-12T01:03:32.566874+0000","last_became_active":"2024-09-12T00:18:28.892852+0000","last_became_peered":"2024-09-12T00:18:28.892852+0000","last_unstale":"2024-09-12T01:03:32.566874+0000","last_undegraded":"2024-09-12T01:03:32.566874+0000","last_fullsized":"2024-09-12T01:03:32.566874+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:16.294300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66489,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":526,"num_read_kb":1071,"num_write":450,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:01.538521+0000","last_change":"2024-09-12T00:18:30.893248+0000","last_active":"2024-09-12T01:01:01.538521+0000","last_peered":"2024-09-12T01:01:01.538521+0000","last_clean":"2024-09-12T01:01:01.538521+0000","last_became_active":"2024-09-12T00:18:30.892643+0000","last_became_peered":"2024-09-12T00:18:30.892643+0000","last_unstale":"2024-09-12T01:01:01.538521+0000","last_undegraded":"2024-09-12T01:01:01.538521+0000","last_fullsized":"2024-09-12T01:01:01.538521+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:18.646293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'240","reported_seq":780,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.132867+0000","last_change":"2024-09-12T00:18:32.902236+0000","last_active":"2024-09-12T01:03:02.132867+0000","last_peered":"2024-09-12T01:03:02.132867+0000","last_clean":"2024-09-12T01:03:02.132867+0000","last_became_active":"2024-09-12T00:18:32.901587+0000","last_became_peered":"2024-09-12T00:18:32.901587+0000","last_unstale":"2024-09-12T01:03:02.132867+0000","last_undegraded":"2024-09-12T01:03:02.132867+0000","last_fullsized":"2024-09-12T01:03:02.132867+0000","mapping_epoch":34,"log_start":"268'200","ondisk_log_start":"268'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:22.015039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":371,"num_read_kb":330,"num_write":585,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'492","reported_seq":2033,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.884678+0000","last_change":"2024-09-12T00:18:24.861062+0000","last_active":"2024-09-12T01:03:25.884678+0000","last_peered":"2024-09-12T01:03:25.884678+0000","last_clean":"2024-09-12T01:03:25.884678+0000","last_became_active":"2024-09-12T00:18:24.860647+0000","last_became_peered":"2024-09-12T00:18:24.860647+0000","last_unstale":"2024-09-12T01:03:25.884678+0000","last_undegraded":"2024-09-12T01:03:25.884678+0000","last_fullsized":"2024-09-12T01:03:25.884678+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:16.460437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2720,"num_read_kb":2539,"num_write":620,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'302","reported_seq":975,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.259914+0000","last_change":"2024-09-12T00:18:22.856961+0000","last_active":"2024-09-12T01:04:24.259914+0000","last_peered":"2024-09-12T01:04:24.259914+0000","last_clean":"2024-09-12T01:04:24.259914+0000","last_became_active":"2024-09-12T00:18:22.856073+0000","last_became_peered":"2024-09-12T00:18:22.856073+0000","last_unstale":"2024-09-12T01:04:24.259914+0000","last_undegraded":"2024-09-12T01:04:24.259914+0000","last_fullsized":"2024-09-12T01:04:24.259914+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:02.567076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5779758,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":509,"num_read_kb":15674,"num_write":1060,"num_write_kb":22765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.532329+0000","last_change":"2024-09-12T00:18:26.862928+0000","last_active":"2024-09-12T01:00:57.532329+0000","last_peered":"2024-09-12T01:00:57.532329+0000","last_clean":"2024-09-12T01:00:57.532329+0000","last_became_active":"2024-09-12T00:18:26.862012+0000","last_became_peered":"2024-09-12T00:18:26.862012+0000","last_unstale":"2024-09-12T01:00:57.532329+0000","last_undegraded":"2024-09-12T01:00:57.532329+0000","last_fullsized":"2024-09-12T01:00:57.532329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:16.642244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'273","reported_seq":859,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:21.788196+0000","last_change":"2024-09-12T00:18:28.882861+0000","last_active":"2024-09-12T01:04:21.788196+0000","last_peered":"2024-09-12T01:04:21.788196+0000","last_clean":"2024-09-12T01:04:21.788196+0000","last_became_active":"2024-09-12T00:18:28.882129+0000","last_became_peered":"2024-09-12T00:18:28.882129+0000","last_unstale":"2024-09-12T01:04:21.788196+0000","last_undegraded":"2024-09-12T01:04:21.788196+0000","last_fullsized":"2024-09-12T01:04:21.788196+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:30.970755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56241,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":449,"num_read_kb":926,"num_write":366,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.532795+0000","last_change":"2024-09-12T00:18:30.906689+0000","last_active":"2024-09-12T01:00:41.532795+0000","last_peered":"2024-09-12T01:00:41.532795+0000","last_clean":"2024-09-12T01:00:41.532795+0000","last_became_active":"2024-09-12T00:18:30.902511+0000","last_became_peered":"2024-09-12T00:18:30.902511+0000","last_unstale":"2024-09-12T01:00:41.532795+0000","last_undegraded":"2024-09-12T01:00:41.532795+0000","last_fullsized":"2024-09-12T01:00:41.532795+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:02.675233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'129","reported_seq":646,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.800676+0000","last_change":"2024-09-12T00:18:32.901622+0000","last_active":"2024-09-12T01:04:31.800676+0000","last_peered":"2024-09-12T01:04:31.800676+0000","last_clean":"2024-09-12T01:04:31.800676+0000","last_became_active":"2024-09-12T00:18:32.899968+0000","last_became_peered":"2024-09-12T00:18:32.899968+0000","last_unstale":"2024-09-12T01:04:31.800676+0000","last_undegraded":"2024-09-12T01:04:31.800676+0000","last_fullsized":"2024-09-12T01:04:31.800676+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:05.182292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":825,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":214,"num_read_kb":184,"num_write":320,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'363","reported_seq":1735,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.094141+0000","last_change":"2024-09-12T00:18:24.861615+0000","last_active":"2024-09-12T01:03:04.094141+0000","last_peered":"2024-09-12T01:03:04.094141+0000","last_clean":"2024-09-12T01:03:04.094141+0000","last_became_active":"2024-09-12T00:18:24.861271+0000","last_became_peered":"2024-09-12T00:18:24.861271+0000","last_unstale":"2024-09-12T01:03:04.094141+0000","last_undegraded":"2024-09-12T01:03:04.094141+0000","last_fullsized":"2024-09-12T01:03:04.094141+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:54.383255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2074,"num_read_kb":1954,"num_write":427,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'279","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:19.184085+0000","last_change":"2024-09-12T00:18:22.860377+0000","last_active":"2024-09-12T01:02:19.184085+0000","last_peered":"2024-09-12T01:02:19.184085+0000","last_clean":"2024-09-12T01:02:19.184085+0000","last_became_active":"2024-09-12T00:18:22.859695+0000","last_became_peered":"2024-09-12T00:18:22.859695+0000","last_unstale":"2024-09-12T01:02:19.184085+0000","last_undegraded":"2024-09-12T01:02:19.184085+0000","last_fullsized":"2024-09-12T01:02:19.184085+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:06.061275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8676243,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":415,"num_read_kb":12424,"num_write":1046,"num_write_kb":25448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:56.536187+0000","last_change":"2024-09-12T00:18:26.859701+0000","last_active":"2024-09-12T01:00:56.536187+0000","last_peered":"2024-09-12T01:00:56.536187+0000","last_clean":"2024-09-12T01:00:56.536187+0000","last_became_active":"2024-09-12T00:18:26.859234+0000","last_became_peered":"2024-09-12T00:18:26.859234+0000","last_unstale":"2024-09-12T01:00:56.536187+0000","last_undegraded":"2024-09-12T01:00:56.536187+0000","last_fullsized":"2024-09-12T01:00:56.536187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:11.914399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'122","reported_seq":655,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:18.833187+0000","last_change":"2024-09-12T00:18:28.884827+0000","last_active":"2024-09-12T01:02:18.833187+0000","last_peered":"2024-09-12T01:02:18.833187+0000","last_clean":"2024-09-12T01:02:18.833187+0000","last_became_active":"2024-09-12T00:18:28.883277+0000","last_became_peered":"2024-09-12T00:18:28.883277+0000","last_unstale":"2024-09-12T01:02:18.833187+0000","last_undegraded":"2024-09-12T01:02:18.833187+0000","last_fullsized":"2024-09-12T01:02:18.833187+0000","mapping_epoch":30,"log_start":"268'100","ondisk_log_start":"268'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:38.381310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":135,"num_read_kb":124,"num_write":148,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'765","reported_seq":2196,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.824090+0000","last_change":"2024-09-12T00:18:30.895935+0000","last_active":"2024-09-12T01:04:31.824090+0000","last_peered":"2024-09-12T01:04:31.824090+0000","last_clean":"2024-09-12T01:04:31.824090+0000","last_became_active":"2024-09-12T00:18:30.893175+0000","last_became_peered":"2024-09-12T00:18:30.893175+0000","last_unstale":"2024-09-12T01:04:31.824090+0000","last_undegraded":"2024-09-12T01:04:31.824090+0000","last_fullsized":"2024-09-12T01:04:31.824090+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:51.257227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'108","reported_seq":602,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.731248+0000","last_change":"2024-09-12T00:18:32.909110+0000","last_active":"2024-09-12T01:03:06.731248+0000","last_peered":"2024-09-12T01:03:06.731248+0000","last_clean":"2024-09-12T01:03:06.731248+0000","last_became_active":"2024-09-12T00:18:32.908295+0000","last_became_peered":"2024-09-12T00:18:32.908295+0000","last_unstale":"2024-09-12T01:03:06.731248+0000","last_undegraded":"2024-09-12T01:03:06.731248+0000","last_fullsized":"2024-09-12T01:03:06.731248+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:19.170686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":102,"num_write":264,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'833","reported_seq":2453,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.192049+0000","last_change":"2024-09-12T00:18:24.861275+0000","last_active":"2024-09-12T01:03:11.192049+0000","last_peered":"2024-09-12T01:03:11.192049+0000","last_clean":"2024-09-12T01:03:11.192049+0000","last_became_active":"2024-09-12T00:18:24.860266+0000","last_became_peered":"2024-09-12T00:18:24.860266+0000","last_unstale":"2024-09-12T01:03:11.192049+0000","last_undegraded":"2024-09-12T01:03:11.192049+0000","last_fullsized":"2024-09-12T01:03:11.192049+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":800,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:29.020383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4128,"num_read_kb":3735,"num_write":1126,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'256","reported_seq":860,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.904315+0000","last_change":"2024-09-12T00:18:22.872906+0000","last_active":"2024-09-12T01:03:21.904315+0000","last_peered":"2024-09-12T01:03:21.904315+0000","last_clean":"2024-09-12T01:03:21.904315+0000","last_became_active":"2024-09-12T00:18:22.867694+0000","last_became_peered":"2024-09-12T00:18:22.867694+0000","last_unstale":"2024-09-12T01:03:21.904315+0000","last_undegraded":"2024-09-12T01:03:21.904315+0000","last_fullsized":"2024-09-12T01:03:21.904315+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:34.546151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7347981,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":350,"num_read_kb":19923,"num_write":927,"num_write_kb":45748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.531105+0000","last_change":"2024-09-12T00:18:26.865232+0000","last_active":"2024-09-12T01:00:57.531105+0000","last_peered":"2024-09-12T01:00:57.531105+0000","last_clean":"2024-09-12T01:00:57.531105+0000","last_became_active":"2024-09-12T00:18:26.864536+0000","last_became_peered":"2024-09-12T00:18:26.864536+0000","last_unstale":"2024-09-12T01:00:57.531105+0000","last_undegraded":"2024-09-12T01:00:57.531105+0000","last_fullsized":"2024-09-12T01:00:57.531105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:55.926276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'332","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.720502+0000","last_change":"2024-09-12T00:18:28.885849+0000","last_active":"2024-09-12T01:04:31.720502+0000","last_peered":"2024-09-12T01:04:31.720502+0000","last_clean":"2024-09-12T01:04:31.720502+0000","last_became_active":"2024-09-12T00:18:28.885152+0000","last_became_peered":"2024-09-12T00:18:28.885152+0000","last_unstale":"2024-09-12T01:04:31.720502+0000","last_undegraded":"2024-09-12T01:04:31.720502+0000","last_fullsized":"2024-09-12T01:04:31.720502+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:29.158839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62718,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":526,"num_read_kb":1016,"num_write":430,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":491,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:01.573124+0000","last_change":"2024-09-12T00:18:30.895751+0000","last_active":"2024-09-12T01:02:01.573124+0000","last_peered":"2024-09-12T01:02:01.573124+0000","last_clean":"2024-09-12T01:02:01.573124+0000","last_became_active":"2024-09-12T00:18:30.888974+0000","last_became_peered":"2024-09-12T00:18:30.888974+0000","last_unstale":"2024-09-12T01:02:01.573124+0000","last_undegraded":"2024-09-12T01:02:01.573124+0000","last_fullsized":"2024-09-12T01:02:01.573124+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:53.240426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'97","reported_seq":604,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.290751+0000","last_change":"2024-09-12T00:18:32.915634+0000","last_active":"2024-09-12T01:03:23.290751+0000","last_peered":"2024-09-12T01:03:23.290751+0000","last_clean":"2024-09-12T01:03:23.290751+0000","last_became_active":"2024-09-12T00:18:32.914994+0000","last_became_peered":"2024-09-12T00:18:32.914994+0000","last_unstale":"2024-09-12T01:03:23.290751+0000","last_undegraded":"2024-09-12T01:03:23.290751+0000","last_fullsized":"2024-09-12T01:03:23.290751+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:03.290807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":129,"num_write":234,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'858","reported_seq":2375,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.841192+0000","last_change":"2024-09-12T00:18:24.854861+0000","last_active":"2024-09-12T01:04:30.841192+0000","last_peered":"2024-09-12T01:04:30.841192+0000","last_clean":"2024-09-12T01:04:30.841192+0000","last_became_active":"2024-09-12T00:18:24.854089+0000","last_became_peered":"2024-09-12T00:18:24.854089+0000","last_unstale":"2024-09-12T01:04:30.841192+0000","last_undegraded":"2024-09-12T01:04:30.841192+0000","last_fullsized":"2024-09-12T01:04:30.841192+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":800,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:09.009238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4036,"num_read_kb":3617,"num_write":1169,"num_write_kb":474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'279","reported_seq":914,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.988464+0000","last_change":"2024-09-12T00:18:22.876376+0000","last_active":"2024-09-12T01:02:56.988464+0000","last_peered":"2024-09-12T01:02:56.988464+0000","last_clean":"2024-09-12T01:02:56.988464+0000","last_became_active":"2024-09-12T00:18:22.867744+0000","last_became_peered":"2024-09-12T00:18:22.867744+0000","last_unstale":"2024-09-12T01:02:56.988464+0000","last_undegraded":"2024-09-12T01:02:56.988464+0000","last_fullsized":"2024-09-12T01:02:56.988464+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:17.533748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1050382,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":454,"num_read_kb":9523,"num_write":1132,"num_write_kb":17845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.735193+0000","last_change":"2024-09-12T00:18:26.858490+0000","last_active":"2024-09-12T01:00:57.735193+0000","last_peered":"2024-09-12T01:00:57.735193+0000","last_clean":"2024-09-12T01:00:57.735193+0000","last_became_active":"2024-09-12T00:18:26.857810+0000","last_became_peered":"2024-09-12T00:18:26.857810+0000","last_unstale":"2024-09-12T01:00:57.735193+0000","last_undegraded":"2024-09-12T01:00:57.735193+0000","last_fullsized":"2024-09-12T01:00:57.735193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:16.264419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'250","reported_seq":822,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:26.605251+0000","last_change":"2024-09-12T00:18:28.882323+0000","last_active":"2024-09-12T01:04:26.605251+0000","last_peered":"2024-09-12T01:04:26.605251+0000","last_clean":"2024-09-12T01:04:26.605251+0000","last_became_active":"2024-09-12T00:18:28.881556+0000","last_became_peered":"2024-09-12T00:18:28.881556+0000","last_unstale":"2024-09-12T01:04:26.605251+0000","last_undegraded":"2024-09-12T01:04:26.605251+0000","last_fullsized":"2024-09-12T01:04:26.605251+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:58.134241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56925,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":417,"num_read_kb":875,"num_write":340,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:07.730322+0000","last_change":"2024-09-12T00:18:30.902376+0000","last_active":"2024-09-12T01:02:07.730322+0000","last_peered":"2024-09-12T01:02:07.730322+0000","last_clean":"2024-09-12T01:02:07.730322+0000","last_became_active":"2024-09-12T00:18:30.898539+0000","last_became_peered":"2024-09-12T00:18:30.898539+0000","last_unstale":"2024-09-12T01:02:07.730322+0000","last_undegraded":"2024-09-12T01:02:07.730322+0000","last_fullsized":"2024-09-12T01:02:07.730322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:18.476695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'110","reported_seq":637,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.199453+0000","last_change":"2024-09-12T00:18:32.908261+0000","last_active":"2024-09-12T01:03:08.199453+0000","last_peered":"2024-09-12T01:03:08.199453+0000","last_clean":"2024-09-12T01:03:08.199453+0000","last_became_active":"2024-09-12T00:18:32.907530+0000","last_became_peered":"2024-09-12T00:18:32.907530+0000","last_unstale":"2024-09-12T01:03:08.199453+0000","last_undegraded":"2024-09-12T01:03:08.199453+0000","last_fullsized":"2024-09-12T01:03:08.199453+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:37.368919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":167,"num_read_kb":160,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'364","reported_seq":1689,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.349766+0000","last_change":"2024-09-12T00:18:24.842626+0000","last_active":"2024-09-12T01:03:10.349766+0000","last_peered":"2024-09-12T01:03:10.349766+0000","last_clean":"2024-09-12T01:03:10.349766+0000","last_became_active":"2024-09-12T00:18:24.842263+0000","last_became_peered":"2024-09-12T00:18:24.842263+0000","last_unstale":"2024-09-12T01:03:10.349766+0000","last_undegraded":"2024-09-12T01:03:10.349766+0000","last_fullsized":"2024-09-12T01:03:10.349766+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:07.799244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1879,"num_read_kb":1766,"num_write":437,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'371","reported_seq":1145,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.897887+0000","last_change":"2024-09-12T00:18:22.837822+0000","last_active":"2024-09-12T01:03:21.897887+0000","last_peered":"2024-09-12T01:03:21.897887+0000","last_clean":"2024-09-12T01:03:21.897887+0000","last_became_active":"2024-09-12T00:18:22.837412+0000","last_became_peered":"2024-09-12T00:18:22.837412+0000","last_unstale":"2024-09-12T01:03:21.897887+0000","last_undegraded":"2024-09-12T01:03:21.897887+0000","last_fullsized":"2024-09-12T01:03:21.897887+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:41.073377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10323841,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":841,"num_read_kb":48874,"num_write":1277,"num_write_kb":53147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.546076+0000","last_change":"2024-09-12T00:18:26.869821+0000","last_active":"2024-09-12T01:01:57.546076+0000","last_peered":"2024-09-12T01:01:57.546076+0000","last_clean":"2024-09-12T01:01:57.546076+0000","last_became_active":"2024-09-12T00:18:26.868407+0000","last_became_peered":"2024-09-12T00:18:26.868407+0000","last_unstale":"2024-09-12T01:01:57.546076+0000","last_undegraded":"2024-09-12T01:01:57.546076+0000","last_fullsized":"2024-09-12T01:01:57.546076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:11.537097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'262","reported_seq":829,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:31.779552+0000","last_change":"2024-09-12T00:18:28.896471+0000","last_active":"2024-09-12T01:03:31.779552+0000","last_peered":"2024-09-12T01:03:31.779552+0000","last_clean":"2024-09-12T01:03:31.779552+0000","last_became_active":"2024-09-12T00:18:28.895848+0000","last_became_peered":"2024-09-12T00:18:28.895848+0000","last_unstale":"2024-09-12T01:03:31.779552+0000","last_undegraded":"2024-09-12T01:03:31.779552+0000","last_fullsized":"2024-09-12T01:03:31.779552+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:11.864170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67199,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":420,"num_read_kb":922,"num_write":354,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":494,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.533540+0000","last_change":"2024-09-12T00:18:30.893385+0000","last_active":"2024-09-12T01:01:02.533540+0000","last_peered":"2024-09-12T01:01:02.533540+0000","last_clean":"2024-09-12T01:01:02.533540+0000","last_became_active":"2024-09-12T00:18:30.892682+0000","last_became_peered":"2024-09-12T00:18:30.892682+0000","last_unstale":"2024-09-12T01:01:02.533540+0000","last_undegraded":"2024-09-12T01:01:02.533540+0000","last_fullsized":"2024-09-12T01:01:02.533540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:03.256684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'208","reported_seq":1695,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.225211+0000","last_change":"2024-09-12T00:18:32.911619+0000","last_active":"2024-09-12T01:03:23.225211+0000","last_peered":"2024-09-12T01:03:23.225211+0000","last_clean":"2024-09-12T01:03:23.225211+0000","last_became_active":"2024-09-12T00:18:32.911082+0000","last_became_peered":"2024-09-12T00:18:32.911082+0000","last_unstale":"2024-09-12T01:03:23.225211+0000","last_undegraded":"2024-09-12T01:03:23.225211+0000","last_fullsized":"2024-09-12T01:03:23.225211+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:46.062158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1287,"num_read_kb":1263,"num_write":482,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'525","reported_seq":2115,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.829396+0000","last_change":"2024-09-12T00:18:24.881623+0000","last_active":"2024-09-12T01:04:30.829396+0000","last_peered":"2024-09-12T01:04:30.829396+0000","last_clean":"2024-09-12T01:04:30.829396+0000","last_became_active":"2024-09-12T00:18:24.881029+0000","last_became_peered":"2024-09-12T00:18:24.881029+0000","last_unstale":"2024-09-12T01:04:30.829396+0000","last_undegraded":"2024-09-12T01:04:30.829396+0000","last_fullsized":"2024-09-12T01:04:30.829396+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:53.918281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2735,"num_read_kb":2532,"num_write":658,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'327","reported_seq":1033,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:25.747038+0000","last_change":"2024-09-12T00:18:22.864476+0000","last_active":"2024-09-12T01:04:25.747038+0000","last_peered":"2024-09-12T01:04:25.747038+0000","last_clean":"2024-09-12T01:04:25.747038+0000","last_became_active":"2024-09-12T00:18:22.863907+0000","last_became_peered":"2024-09-12T00:18:22.863907+0000","last_unstale":"2024-09-12T01:04:25.747038+0000","last_undegraded":"2024-09-12T01:04:25.747038+0000","last_fullsized":"2024-09-12T01:04:25.747038+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:45.526909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6506830,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":578,"num_read_kb":24608,"num_write":1184,"num_write_kb":29666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:06.553634+0000","last_change":"2024-09-12T00:18:26.867344+0000","last_active":"2024-09-12T01:02:06.553634+0000","last_peered":"2024-09-12T01:02:06.553634+0000","last_clean":"2024-09-12T01:02:06.553634+0000","last_became_active":"2024-09-12T00:18:26.866967+0000","last_became_peered":"2024-09-12T00:18:26.866967+0000","last_unstale":"2024-09-12T01:02:06.553634+0000","last_undegraded":"2024-09-12T01:02:06.553634+0000","last_fullsized":"2024-09-12T01:02:06.553634+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:36.323953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'304","reported_seq":901,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:32.569512+0000","last_change":"2024-09-12T00:18:28.898664+0000","last_active":"2024-09-12T01:03:32.569512+0000","last_peered":"2024-09-12T01:03:32.569512+0000","last_clean":"2024-09-12T01:03:32.569512+0000","last_became_active":"2024-09-12T00:18:28.897709+0000","last_became_peered":"2024-09-12T00:18:28.897709+0000","last_unstale":"2024-09-12T01:03:32.569512+0000","last_undegraded":"2024-09-12T01:03:32.569512+0000","last_fullsized":"2024-09-12T01:03:32.569512+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:21.269051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63713,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":512,"num_read_kb":1035,"num_write":416,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":490,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:01.554976+0000","last_change":"2024-09-12T00:18:30.898241+0000","last_active":"2024-09-12T01:01:01.554976+0000","last_peered":"2024-09-12T01:01:01.554976+0000","last_clean":"2024-09-12T01:01:01.554976+0000","last_became_active":"2024-09-12T00:18:30.889179+0000","last_became_peered":"2024-09-12T00:18:30.889179+0000","last_unstale":"2024-09-12T01:01:01.554976+0000","last_undegraded":"2024-09-12T01:01:01.554976+0000","last_fullsized":"2024-09-12T01:01:01.554976+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:34.242145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'191","reported_seq":755,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.817447+0000","last_change":"2024-09-12T00:18:32.908462+0000","last_active":"2024-09-12T01:04:30.817447+0000","last_peered":"2024-09-12T01:04:30.817447+0000","last_clean":"2024-09-12T01:04:30.817447+0000","last_became_active":"2024-09-12T00:18:32.907658+0000","last_became_peered":"2024-09-12T00:18:32.907658+0000","last_unstale":"2024-09-12T01:04:30.817447+0000","last_undegraded":"2024-09-12T01:04:30.817447+0000","last_fullsized":"2024-09-12T01:04:30.817447+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:03.641123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":435,"num_read_kb":358,"num_write":481,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'411","reported_seq":1911,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.825050+0000","last_change":"2024-09-12T00:18:24.878945+0000","last_active":"2024-09-12T01:04:30.825050+0000","last_peered":"2024-09-12T01:04:30.825050+0000","last_clean":"2024-09-12T01:04:30.825050+0000","last_became_active":"2024-09-12T00:18:24.878522+0000","last_became_peered":"2024-09-12T00:18:24.878522+0000","last_unstale":"2024-09-12T01:04:30.825050+0000","last_undegraded":"2024-09-12T01:04:30.825050+0000","last_fullsized":"2024-09-12T01:04:30.825050+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:42.239984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2233,"num_read_kb":2110,"num_write":497,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'312","reported_seq":979,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.623973+0000","last_change":"2024-09-12T00:18:22.853126+0000","last_active":"2024-09-12T01:03:00.623973+0000","last_peered":"2024-09-12T01:03:00.623973+0000","last_clean":"2024-09-12T01:03:00.623973+0000","last_became_active":"2024-09-12T00:18:22.851554+0000","last_became_peered":"2024-09-12T00:18:22.851554+0000","last_unstale":"2024-09-12T01:03:00.623973+0000","last_undegraded":"2024-09-12T01:03:00.623973+0000","last_fullsized":"2024-09-12T01:03:00.623973+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:48.723489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5569392,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":502,"num_read_kb":70445,"num_write":1073,"num_write_kb":38293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"268'1219","reported_seq":2832,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.908340+0000","last_change":"2024-09-12T00:18:24.857511+0000","last_active":"2024-09-12T01:02:46.908340+0000","last_peered":"2024-09-12T01:02:46.908340+0000","last_clean":"2024-09-12T01:02:46.908340+0000","last_became_active":"2024-09-12T00:18:24.857107+0000","last_became_peered":"2024-09-12T00:18:24.857107+0000","last_unstale":"2024-09-12T01:02:46.908340+0000","last_undegraded":"2024-09-12T01:02:46.908340+0000","last_fullsized":"2024-09-12T01:02:46.908340+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":1200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:46.479301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5568,"num_read_kb":4913,"num_write":1657,"num_write_kb":681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"268'282","reported_seq":933,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.183343+0000","last_change":"2024-09-12T00:18:56.194536+0000","last_active":"2024-09-12T01:02:21.183343+0000","last_peered":"2024-09-12T01:02:21.183343+0000","last_clean":"2024-09-12T01:02:21.183343+0000","last_became_active":"2024-09-12T00:18:56.193721+0000","last_became_peered":"2024-09-12T00:18:56.193721+0000","last_unstale":"2024-09-12T01:02:21.183343+0000","last_undegraded":"2024-09-12T01:02:21.183343+0000","last_fullsized":"2024-09-12T01:02:21.183343+0000","mapping_epoch":37,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:45.173064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4807193,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":395,"num_read_kb":19261,"num_write":951,"num_write_kb":26595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'860","reported_seq":2457,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.120737+0000","last_change":"2024-09-12T00:18:24.871814+0000","last_active":"2024-09-12T01:03:25.120737+0000","last_peered":"2024-09-12T01:03:25.120737+0000","last_clean":"2024-09-12T01:03:25.120737+0000","last_became_active":"2024-09-12T00:18:24.870288+0000","last_became_peered":"2024-09-12T00:18:24.870288+0000","last_unstale":"2024-09-12T01:03:25.120737+0000","last_undegraded":"2024-09-12T01:03:25.120737+0000","last_fullsized":"2024-09-12T01:03:25.120737+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":800,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:41.437287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4146,"num_read_kb":3713,"num_write":1130,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'328","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:22.248499+0000","last_change":"2024-09-12T00:18:22.872673+0000","last_active":"2024-09-12T01:03:22.248499+0000","last_peered":"2024-09-12T01:03:22.248499+0000","last_clean":"2024-09-12T01:03:22.248499+0000","last_became_active":"2024-09-12T00:18:22.866341+0000","last_became_peered":"2024-09-12T00:18:22.866341+0000","last_unstale":"2024-09-12T01:03:22.248499+0000","last_undegraded":"2024-09-12T01:03:22.248499+0000","last_fullsized":"2024-09-12T01:03:22.248499+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:24.768958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22504054,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":396,"num_read_kb":25322,"num_write":1082,"num_write_kb":64729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'397","reported_seq":1894,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.440536+0000","last_change":"2024-09-12T00:18:24.866032+0000","last_active":"2024-09-12T01:03:09.440536+0000","last_peered":"2024-09-12T01:03:09.440536+0000","last_clean":"2024-09-12T01:03:09.440536+0000","last_became_active":"2024-09-12T00:18:24.865674+0000","last_became_peered":"2024-09-12T00:18:24.865674+0000","last_unstale":"2024-09-12T01:03:09.440536+0000","last_undegraded":"2024-09-12T01:03:09.440536+0000","last_fullsized":"2024-09-12T01:03:09.440536+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:58.235628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2040,"num_read_kb":1953,"num_write":432,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'264","reported_seq":1009,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.539380+0000","last_change":"2024-09-12T00:18:22.844535+0000","last_active":"2024-09-12T01:03:03.539380+0000","last_peered":"2024-09-12T01:03:03.539380+0000","last_clean":"2024-09-12T01:03:03.539380+0000","last_became_active":"2024-09-12T00:18:22.844095+0000","last_became_peered":"2024-09-12T00:18:22.844095+0000","last_unstale":"2024-09-12T01:03:03.539380+0000","last_undegraded":"2024-09-12T01:03:03.539380+0000","last_fullsized":"2024-09-12T01:03:03.539380+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:23.543074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1812643,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":683,"num_read_kb":58308,"num_write":920,"num_write_kb":25022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"268'383","reported_seq":1843,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.346854+0000","last_change":"2024-09-12T00:18:24.866012+0000","last_active":"2024-09-12T01:03:37.346854+0000","last_peered":"2024-09-12T01:03:37.346854+0000","last_clean":"2024-09-12T01:03:37.346854+0000","last_became_active":"2024-09-12T00:18:24.865720+0000","last_became_peered":"2024-09-12T00:18:24.865720+0000","last_unstale":"2024-09-12T01:03:37.346854+0000","last_undegraded":"2024-09-12T01:03:37.346854+0000","last_fullsized":"2024-09-12T01:03:37.346854+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:30.348388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2058,"num_read_kb":1953,"num_write":433,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'303","reported_seq":978,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:22.057395+0000","last_change":"2024-09-12T00:18:22.858174+0000","last_active":"2024-09-12T01:03:22.057395+0000","last_peered":"2024-09-12T01:03:22.057395+0000","last_clean":"2024-09-12T01:03:22.057395+0000","last_became_active":"2024-09-12T00:18:22.857896+0000","last_became_peered":"2024-09-12T00:18:22.857896+0000","last_unstale":"2024-09-12T01:03:22.057395+0000","last_undegraded":"2024-09-12T01:03:22.057395+0000","last_fullsized":"2024-09-12T01:03:22.057395+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:35.667728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6705118,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":504,"num_read_kb":17790,"num_write":1122,"num_write_kb":44407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'440","reported_seq":2170,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.192270+0000","last_change":"2024-09-12T00:18:24.867735+0000","last_active":"2024-09-12T01:03:11.192270+0000","last_peered":"2024-09-12T01:03:11.192270+0000","last_clean":"2024-09-12T01:03:11.192270+0000","last_became_active":"2024-09-12T00:18:24.866980+0000","last_became_peered":"2024-09-12T00:18:24.866980+0000","last_unstale":"2024-09-12T01:03:11.192270+0000","last_undegraded":"2024-09-12T01:03:11.192270+0000","last_fullsized":"2024-09-12T01:03:11.192270+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:25.227858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2639,"num_read_kb":2518,"num_write":497,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'266","reported_seq":924,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:46.549024+0000","last_change":"2024-09-12T00:18:22.847482+0000","last_active":"2024-09-12T01:01:46.549024+0000","last_peered":"2024-09-12T01:01:46.549024+0000","last_clean":"2024-09-12T01:01:46.549024+0000","last_became_active":"2024-09-12T00:18:22.846805+0000","last_became_peered":"2024-09-12T00:18:22.846805+0000","last_unstale":"2024-09-12T01:01:46.549024+0000","last_undegraded":"2024-09-12T01:01:46.549024+0000","last_fullsized":"2024-09-12T01:01:46.549024+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:38.931220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13654801,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":403,"num_read_kb":82569,"num_write":1018,"num_write_kb":46093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'467","reported_seq":2006,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.119546+0000","last_change":"2024-09-12T00:18:24.862315+0000","last_active":"2024-09-12T01:03:25.119546+0000","last_peered":"2024-09-12T01:03:25.119546+0000","last_clean":"2024-09-12T01:03:25.119546+0000","last_became_active":"2024-09-12T00:18:24.862022+0000","last_became_peered":"2024-09-12T00:18:24.862022+0000","last_unstale":"2024-09-12T01:03:25.119546+0000","last_undegraded":"2024-09-12T01:03:25.119546+0000","last_fullsized":"2024-09-12T01:03:25.119546+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:31.362187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2433,"num_read_kb":2274,"num_write":552,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'281","reported_seq":905,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.869611+0000","last_change":"2024-09-12T00:18:22.872677+0000","last_active":"2024-09-12T01:02:47.869611+0000","last_peered":"2024-09-12T01:02:47.869611+0000","last_clean":"2024-09-12T01:02:47.869611+0000","last_became_active":"2024-09-12T00:18:22.871980+0000","last_became_peered":"2024-09-12T00:18:22.871980+0000","last_unstale":"2024-09-12T01:02:47.869611+0000","last_undegraded":"2024-09-12T01:02:47.869611+0000","last_fullsized":"2024-09-12T01:02:47.869611+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:06.765741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6571929,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":404,"num_read_kb":12975,"num_write":1053,"num_write_kb":44636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'438","reported_seq":2028,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.704380+0000","last_change":"2024-09-12T00:18:24.865050+0000","last_active":"2024-09-12T01:03:20.704380+0000","last_peered":"2024-09-12T01:03:20.704380+0000","last_clean":"2024-09-12T01:03:20.704380+0000","last_became_active":"2024-09-12T00:18:24.857010+0000","last_became_peered":"2024-09-12T00:18:24.857010+0000","last_unstale":"2024-09-12T01:03:20.704380+0000","last_undegraded":"2024-09-12T01:03:20.704380+0000","last_fullsized":"2024-09-12T01:03:20.704380+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:11.724243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2477,"num_read_kb":2332,"num_write":519,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'304","reported_seq":932,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.537630+0000","last_change":"2024-09-12T00:18:22.857829+0000","last_active":"2024-09-12T01:03:03.537630+0000","last_peered":"2024-09-12T01:03:03.537630+0000","last_clean":"2024-09-12T01:03:03.537630+0000","last_became_active":"2024-09-12T00:18:22.857468+0000","last_became_peered":"2024-09-12T00:18:22.857468+0000","last_unstale":"2024-09-12T01:03:03.537630+0000","last_undegraded":"2024-09-12T01:03:03.537630+0000","last_fullsized":"2024-09-12T01:03:03.537630+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:27.114391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":434508,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":421,"num_read_kb":4428,"num_write":1055,"num_write_kb":23710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"268'835","reported_seq":2445,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.175301+0000","last_change":"2024-09-12T00:18:24.857824+0000","last_active":"2024-09-12T01:03:11.175301+0000","last_peered":"2024-09-12T01:03:11.175301+0000","last_clean":"2024-09-12T01:03:11.175301+0000","last_became_active":"2024-09-12T00:18:24.857438+0000","last_became_peered":"2024-09-12T00:18:24.857438+0000","last_unstale":"2024-09-12T01:03:11.175301+0000","last_undegraded":"2024-09-12T01:03:11.175301+0000","last_fullsized":"2024-09-12T01:03:11.175301+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:33.071795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3858,"num_read_kb":3490,"num_write":1078,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'306","reported_seq":921,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.895781+0000","last_change":"2024-09-12T00:18:22.859579+0000","last_active":"2024-09-12T01:03:21.895781+0000","last_peered":"2024-09-12T01:03:21.895781+0000","last_clean":"2024-09-12T01:03:21.895781+0000","last_became_active":"2024-09-12T00:18:22.858851+0000","last_became_peered":"2024-09-12T00:18:22.858851+0000","last_unstale":"2024-09-12T01:03:21.895781+0000","last_undegraded":"2024-09-12T01:03:21.895781+0000","last_fullsized":"2024-09-12T01:03:21.895781+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:42.545358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10694505,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":405,"num_read_kb":6076,"num_write":1027,"num_write_kb":43198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'1186","reported_seq":2695,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.865689+0000","last_change":"2024-09-12T00:18:24.858035+0000","last_active":"2024-09-12T01:03:25.865689+0000","last_peered":"2024-09-12T01:03:25.865689+0000","last_clean":"2024-09-12T01:03:25.865689+0000","last_became_active":"2024-09-12T00:18:24.856121+0000","last_became_peered":"2024-09-12T00:18:24.856121+0000","last_unstale":"2024-09-12T01:03:25.865689+0000","last_undegraded":"2024-09-12T01:03:25.865689+0000","last_fullsized":"2024-09-12T01:03:25.865689+0000","mapping_epoch":26,"log_start":"268'1100","ondisk_log_start":"268'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":1100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:36.093783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5211,"num_read_kb":4574,"num_write":1611,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'301","reported_seq":1048,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:28.248269+0000","last_change":"2024-09-12T00:18:22.858631+0000","last_active":"2024-09-12T01:01:28.248269+0000","last_peered":"2024-09-12T01:01:28.248269+0000","last_clean":"2024-09-12T01:01:28.248269+0000","last_became_active":"2024-09-12T00:18:22.857806+0000","last_became_peered":"2024-09-12T00:18:22.857806+0000","last_unstale":"2024-09-12T01:01:28.248269+0000","last_undegraded":"2024-09-12T01:01:28.248269+0000","last_fullsized":"2024-09-12T01:01:28.248269+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:33.277291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9986390,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":621,"num_read_kb":44063,"num_write":1157,"num_write_kb":47646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"268'824","reported_seq":2369,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.350086+0000","last_change":"2024-09-12T00:18:24.856950+0000","last_active":"2024-09-12T01:03:10.350086+0000","last_peered":"2024-09-12T01:03:10.350086+0000","last_clean":"2024-09-12T01:03:10.350086+0000","last_became_active":"2024-09-12T00:18:24.856616+0000","last_became_peered":"2024-09-12T00:18:24.856616+0000","last_unstale":"2024-09-12T01:03:10.350086+0000","last_undegraded":"2024-09-12T01:03:10.350086+0000","last_fullsized":"2024-09-12T01:03:10.350086+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:56.988343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3862,"num_read_kb":3471,"num_write":1076,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'313","reported_seq":1084,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.191500+0000","last_change":"2024-09-12T00:18:22.874720+0000","last_active":"2024-09-12T01:02:55.191500+0000","last_peered":"2024-09-12T01:02:55.191500+0000","last_clean":"2024-09-12T01:02:55.191500+0000","last_became_active":"2024-09-12T00:18:22.873756+0000","last_became_peered":"2024-09-12T00:18:22.873756+0000","last_unstale":"2024-09-12T01:02:55.191500+0000","last_undegraded":"2024-09-12T01:02:55.191500+0000","last_fullsized":"2024-09-12T01:02:55.191500+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:18.449548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8958017,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":835,"num_read_kb":25126,"num_write":1201,"num_write_kb":39639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'1580","reported_seq":3271,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.439933+0000","last_change":"2024-09-12T00:18:24.883740+0000","last_active":"2024-09-12T01:03:09.439933+0000","last_peered":"2024-09-12T01:03:09.439933+0000","last_clean":"2024-09-12T01:03:09.439933+0000","last_became_active":"2024-09-12T00:18:24.882937+0000","last_became_peered":"2024-09-12T00:18:24.882937+0000","last_unstale":"2024-09-12T01:03:09.439933+0000","last_undegraded":"2024-09-12T01:03:09.439933+0000","last_fullsized":"2024-09-12T01:03:09.439933+0000","mapping_epoch":26,"log_start":"268'1500","ondisk_log_start":"268'1500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":1500,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:22.907432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7111,"num_read_kb":6230,"num_write":2206,"num_write_kb":938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'356","reported_seq":1086,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:23.191677+0000","last_change":"2024-09-12T00:18:22.869861+0000","last_active":"2024-09-12T01:04:23.191677+0000","last_peered":"2024-09-12T01:04:23.191677+0000","last_clean":"2024-09-12T01:04:23.191677+0000","last_became_active":"2024-09-12T00:18:22.869527+0000","last_became_peered":"2024-09-12T00:18:22.869527+0000","last_unstale":"2024-09-12T01:04:23.191677+0000","last_undegraded":"2024-09-12T01:04:23.191677+0000","last_fullsized":"2024-09-12T01:04:23.191677+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:28.494266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1661019,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":695,"num_read_kb":72881,"num_write":1366,"num_write_kb":29040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'772","reported_seq":2178,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.702907+0000","last_change":"2024-09-12T00:18:24.866786+0000","last_active":"2024-09-12T01:03:20.702907+0000","last_peered":"2024-09-12T01:03:20.702907+0000","last_clean":"2024-09-12T01:03:20.702907+0000","last_became_active":"2024-09-12T00:18:24.866062+0000","last_became_peered":"2024-09-12T00:18:24.866062+0000","last_unstale":"2024-09-12T01:03:20.702907+0000","last_undegraded":"2024-09-12T01:03:20.702907+0000","last_fullsized":"2024-09-12T01:03:20.702907+0000","mapping_epoch":26,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:41.456955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3587,"num_read_kb":3210,"num_write":1032,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'315","reported_seq":996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:21.098923+0000","last_change":"2024-09-12T00:18:22.858952+0000","last_active":"2024-09-12T01:04:21.098923+0000","last_peered":"2024-09-12T01:04:21.098923+0000","last_clean":"2024-09-12T01:04:21.098923+0000","last_became_active":"2024-09-12T00:18:22.858141+0000","last_became_peered":"2024-09-12T00:18:22.858141+0000","last_unstale":"2024-09-12T01:04:21.098923+0000","last_undegraded":"2024-09-12T01:04:21.098923+0000","last_fullsized":"2024-09-12T01:04:21.098923+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:25.792326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389308,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":591,"num_read_kb":25195,"num_write":1293,"num_write_kb":34646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'1217","reported_seq":3118,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.594177+0000","last_change":"2024-09-12T00:18:24.860271+0000","last_active":"2024-09-12T01:03:26.594177+0000","last_peered":"2024-09-12T01:03:26.594177+0000","last_clean":"2024-09-12T01:03:26.594177+0000","last_became_active":"2024-09-12T00:18:24.859973+0000","last_became_peered":"2024-09-12T00:18:24.859973+0000","last_unstale":"2024-09-12T01:03:26.594177+0000","last_undegraded":"2024-09-12T01:03:26.594177+0000","last_fullsized":"2024-09-12T01:03:26.594177+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":1200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:18.330323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5984,"num_read_kb":5306,"num_write":1779,"num_write_kb":823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'284","reported_seq":910,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.420265+0000","last_change":"2024-09-12T00:18:55.952101+0000","last_active":"2024-09-12T01:03:11.420265+0000","last_peered":"2024-09-12T01:03:11.420265+0000","last_clean":"2024-09-12T01:03:11.420265+0000","last_became_active":"2024-09-12T00:18:55.951826+0000","last_became_peered":"2024-09-12T00:18:55.951826+0000","last_unstale":"2024-09-12T01:03:11.420265+0000","last_undegraded":"2024-09-12T01:03:11.420265+0000","last_fullsized":"2024-09-12T01:03:11.420265+0000","mapping_epoch":37,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:47.686652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1432648,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":436,"num_read_kb":11605,"num_write":1010,"num_write_kb":32221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"268'537","reported_seq":2005,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.346854+0000","last_change":"2024-09-12T00:18:24.849840+0000","last_active":"2024-09-12T01:03:37.346854+0000","last_peered":"2024-09-12T01:03:37.346854+0000","last_clean":"2024-09-12T01:03:37.346854+0000","last_became_active":"2024-09-12T00:18:24.849540+0000","last_became_peered":"2024-09-12T00:18:24.849540+0000","last_unstale":"2024-09-12T01:03:37.346854+0000","last_undegraded":"2024-09-12T01:03:37.346854+0000","last_fullsized":"2024-09-12T01:03:37.346854+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:12.695354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2717,"num_read_kb":2465,"num_write":714,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'310","reported_seq":1004,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.540921+0000","last_change":"2024-09-12T00:18:22.834810+0000","last_active":"2024-09-12T01:03:07.540921+0000","last_peered":"2024-09-12T01:03:07.540921+0000","last_clean":"2024-09-12T01:03:07.540921+0000","last_became_active":"2024-09-12T00:18:22.834527+0000","last_became_peered":"2024-09-12T00:18:22.834527+0000","last_unstale":"2024-09-12T01:03:07.540921+0000","last_undegraded":"2024-09-12T01:03:07.540921+0000","last_fullsized":"2024-09-12T01:03:07.540921+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:49.103125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1051256,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":615,"num_read_kb":13548,"num_write":1311,"num_write_kb":27172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'350","reported_seq":1704,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.704302+0000","last_change":"2024-09-12T00:18:24.871103+0000","last_active":"2024-09-12T01:03:20.704302+0000","last_peered":"2024-09-12T01:03:20.704302+0000","last_clean":"2024-09-12T01:03:20.704302+0000","last_became_active":"2024-09-12T00:18:24.870016+0000","last_became_peered":"2024-09-12T00:18:24.870016+0000","last_unstale":"2024-09-12T01:03:20.704302+0000","last_undegraded":"2024-09-12T01:03:20.704302+0000","last_fullsized":"2024-09-12T01:03:20.704302+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:57.415861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1783,"num_read_kb":1704,"num_write":384,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'275","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.548016+0000","last_change":"2024-09-12T00:18:22.883934+0000","last_active":"2024-09-12T01:02:53.548016+0000","last_peered":"2024-09-12T01:02:53.548016+0000","last_clean":"2024-09-12T01:02:53.548016+0000","last_became_active":"2024-09-12T00:18:22.883246+0000","last_became_peered":"2024-09-12T00:18:22.883246+0000","last_unstale":"2024-09-12T01:02:53.548016+0000","last_undegraded":"2024-09-12T01:02:53.548016+0000","last_fullsized":"2024-09-12T01:02:53.548016+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:32.140402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10133923,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":445,"num_read_kb":42045,"num_write":1046,"num_write_kb":34022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'308","reported_seq":975,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:37.707227+0000","last_change":"2024-09-12T00:18:22.857851+0000","last_active":"2024-09-12T01:01:37.707227+0000","last_peered":"2024-09-12T01:01:37.707227+0000","last_clean":"2024-09-12T01:01:37.707227+0000","last_became_active":"2024-09-12T00:18:22.857072+0000","last_became_peered":"2024-09-12T00:18:22.857072+0000","last_unstale":"2024-09-12T01:01:37.707227+0000","last_undegraded":"2024-09-12T01:01:37.707227+0000","last_fullsized":"2024-09-12T01:01:37.707227+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:08.141312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13407224,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":482,"num_read_kb":42639,"num_write":1182,"num_write_kb":40559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'475","reported_seq":2175,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.700952+0000","last_change":"2024-09-12T00:18:24.867195+0000","last_active":"2024-09-12T01:03:20.700952+0000","last_peered":"2024-09-12T01:03:20.700952+0000","last_clean":"2024-09-12T01:03:20.700952+0000","last_became_active":"2024-09-12T00:18:24.866883+0000","last_became_peered":"2024-09-12T00:18:24.866883+0000","last_unstale":"2024-09-12T01:03:20.700952+0000","last_undegraded":"2024-09-12T01:03:20.700952+0000","last_fullsized":"2024-09-12T01:03:20.700952+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:14.739354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2661,"num_read_kb":2525,"num_write":544,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'382","reported_seq":1109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:40.568273+0000","last_change":"2024-09-12T00:18:22.858917+0000","last_active":"2024-09-12T01:02:40.568273+0000","last_peered":"2024-09-12T01:02:40.568273+0000","last_clean":"2024-09-12T01:02:40.568273+0000","last_became_active":"2024-09-12T00:18:22.858176+0000","last_became_peered":"2024-09-12T00:18:22.858176+0000","last_unstale":"2024-09-12T01:02:40.568273+0000","last_undegraded":"2024-09-12T01:02:40.568273+0000","last_fullsized":"2024-09-12T01:02:40.568273+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:56.261213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17620765,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":772,"num_read_kb":63076,"num_write":1184,"num_write_kb":30414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'807","reported_seq":2404,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.172100+0000","last_change":"2024-09-12T00:18:24.856340+0000","last_active":"2024-09-12T01:03:03.172100+0000","last_peered":"2024-09-12T01:03:03.172100+0000","last_clean":"2024-09-12T01:03:03.172100+0000","last_became_active":"2024-09-12T00:18:24.855524+0000","last_became_peered":"2024-09-12T00:18:24.855524+0000","last_unstale":"2024-09-12T01:03:03.172100+0000","last_undegraded":"2024-09-12T01:03:03.172100+0000","last_fullsized":"2024-09-12T01:03:03.172100+0000","mapping_epoch":26,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:08.775534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3793,"num_read_kb":3425,"num_write":1052,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6125,"num_read_kb":4422,"num_write":1992,"num_write_kb":889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":963,"ondisk_log_size":963,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15018,"num_read_kb":14677,"num_write":16721,"num_write_kb":4879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1955,"ondisk_log_size":1955,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":467,"ondisk_log_size":467,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1935422,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":17286,"num_read_kb":32998,"num_write":14601,"num_write_kb":11568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3334144,"data_stored":2791852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1959,"ondisk_log_size":1959,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2392,"num_read_kb":2851,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212220,"num_read_kb":193790,"num_write":55147,"num_write_kb":18721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3785,"ondisk_log_size":3785,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":525685298,"num_objects":4460,"num_object_clones":0,"num_object_copies":8920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4460,"num_whiteouts":0,"num_read":32134,"num_read_kb":1921454,"num_write":68115,"num_write_kb":2133559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1084129280,"data_stored":1051370596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4234,"ondisk_log_size":4234,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":81852495,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":143,"num_read_kb":193499,"num_write":160,"num_write_kb":135054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163708928,"data_stored":163704990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":81852495,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":141,"num_read_kb":193436,"num_write":160,"num_write_kb":135054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163708928,"data_stored":163704990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510005,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":458396,"kb_used_data":188428,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":93913444,"statfs":{"total":96636764160,"available":96167366656,"internally_reserved":0,"allocated":192950272,"data_stored":187084399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":276429258},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510004,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":375476,"kb_used_data":149924,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":93996364,"statfs":{"total":96636764160,"available":96252276736,"internally_reserved":0,"allocated":153522176,"data_stored":148408360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":230947273},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510004,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":337472,"kb_used_data":216112,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94034368,"statfs":{"total":96636764160,"available":96291192832,"internally_reserved":0,"allocated":221298688,"data_stored":215015112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510005,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255900,"kb_used_data":192780,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94115940,"statfs":{"total":96636764160,"available":96374722560,"internally_reserved":0,"allocated":197406720,"data_stored":191246398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542709,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":467752,"kb_used_data":215832,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":93904088,"statfs":{"total":96636764160,"available":96157786112,"internally_reserved":0,"allocated":221011968,"data_stored":214733879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257948103},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542707,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202504,"kb_used_data":104760,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94169336,"statfs":{"total":96636764160,"available":96429400064,"internally_reserved":0,"allocated":107274240,"data_stored":103037877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542708,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":295632,"kb_used_data":160384,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94076208,"statfs":{"total":96636764160,"available":96334036992,"internally_reserved":0,"allocated":164233216,"data_stored":159231069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542709,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":421532,"kb_used_data":183500,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":93950308,"statfs":{"total":96636764160,"available":96205115392,"internally_reserved":0,"allocated":187904000,"data_stored":181665792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":136011776,"data_stored":131334602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":108634112,"data_stored":105174233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":68845568,"data_stored":66097501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":172634112,"data_stored":167939379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":151691264,"data_stored":146999295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":168640512,"data_stored":164007630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":115916800,"data_stored":112330276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":161755136,"data_stored":157487680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":341789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":483328,"data_stored":408704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":127439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":569344,"data_stored":478098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":94065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":679936,"data_stored":563219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":254314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":626688,"data_stored":524224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":5044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":5163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34603008,"data_stored":34603008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24178688,"data_stored":24177617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19927040,"data_stored":19926142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17829888,"data_stored":17828990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13692928,"data_stored":13691857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12586110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27262976,"data_stored":27262976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24182784,"data_stored":24180815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24117248,"data_stored":24117248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17887232,"data_stored":17886161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:04:41.531 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:04:41.920 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:04:41.937 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-12T01:04:41.955 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":1660,"stamp":"2024-09-12T01:04:40.033691+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":691933335,"num_objects":5010,"num_object_clones":0,"num_object_copies":10020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5010,"num_whiteouts":0,"num_read":285537,"num_read_kb":2557194,"num_write":157039,"num_write_kb":2441380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13656,"ondisk_log_size":13656,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2814664,"kb_used_data":1411720,"kb_used_omap":12,"kb_used_meta":1402803,"kb_avail":752160056,"statfs":{"total":773094113280,"available":770211897344,"internally_reserved":0,"allocated":1445601280,"data_stored":1400422886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1436470835},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1160,"num_objects":-18,"num_object_clones":0,"num_object_copies":-36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-18,"num_whiteouts":0,"num_read":316,"num_read_kb":305,"num_write":77,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009705"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.738562+0000","last_change":"2024-09-12T00:46:09.507731+0000","last_active":"2024-09-12T01:01:12.738562+0000","last_peered":"2024-09-12T01:01:12.738562+0000","last_clean":"2024-09-12T01:01:12.738562+0000","last_became_active":"2024-09-12T00:46:09.506992+0000","last_became_peered":"2024-09-12T00:46:09.506992+0000","last_unstale":"2024-09-12T01:01:12.738562+0000","last_undegraded":"2024-09-12T01:01:12.738562+0000","last_fullsized":"2024-09-12T01:01:12.738562+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:58.022915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"265'8","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.721957+0000","last_change":"2024-09-12T00:34:55.237418+0000","last_active":"2024-09-12T00:59:57.721957+0000","last_peered":"2024-09-12T00:59:57.721957+0000","last_clean":"2024-09-12T00:59:57.721957+0000","last_became_active":"2024-09-12T00:34:55.236531+0000","last_became_peered":"2024-09-12T00:34:55.236531+0000","last_unstale":"2024-09-12T00:59:57.721957+0000","last_undegraded":"2024-09-12T00:59:57.721957+0000","last_fullsized":"2024-09-12T00:59:57.721957+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:18.916486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"268'2","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:51.722688+0000","last_change":"2024-09-12T00:34:52.172747+0000","last_active":"2024-09-12T00:59:51.722688+0000","last_peered":"2024-09-12T00:59:51.722688+0000","last_clean":"2024-09-12T00:59:51.722688+0000","last_became_active":"2024-09-12T00:34:52.171918+0000","last_became_peered":"2024-09-12T00:34:52.171918+0000","last_unstale":"2024-09-12T00:59:51.722688+0000","last_undegraded":"2024-09-12T00:59:51.722688+0000","last_fullsized":"2024-09-12T00:59:51.722688+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:15.468426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4197502,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4100,"num_write":2,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'30","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.578508+0000","last_change":"2024-09-12T00:33:10.849736+0000","last_active":"2024-09-12T01:02:21.578508+0000","last_peered":"2024-09-12T01:02:21.578508+0000","last_clean":"2024-09-12T01:02:21.578508+0000","last_became_active":"2024-09-12T00:33:10.848975+0000","last_became_peered":"2024-09-12T00:33:10.848975+0000","last_unstale":"2024-09-12T01:02:21.578508+0000","last_undegraded":"2024-09-12T01:02:21.578508+0000","last_fullsized":"2024-09-12T01:02:21.578508+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:54.113531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":60,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:11.710587+0000","last_change":"2024-09-12T00:46:09.510162+0000","last_active":"2024-09-12T01:01:11.710587+0000","last_peered":"2024-09-12T01:01:11.710587+0000","last_clean":"2024-09-12T01:01:11.710587+0000","last_became_active":"2024-09-12T00:46:09.509800+0000","last_became_peered":"2024-09-12T00:46:09.509800+0000","last_unstale":"2024-09-12T01:01:11.710587+0000","last_undegraded":"2024-09-12T01:01:11.710587+0000","last_fullsized":"2024-09-12T01:01:11.710587+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:13.709511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'6","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.518261+0000","last_change":"2024-09-12T00:34:55.233869+0000","last_active":"2024-09-12T00:59:57.518261+0000","last_peered":"2024-09-12T00:59:57.518261+0000","last_clean":"2024-09-12T00:59:57.518261+0000","last_became_active":"2024-09-12T00:34:55.232607+0000","last_became_peered":"2024-09-12T00:34:55.232607+0000","last_unstale":"2024-09-12T00:59:57.518261+0000","last_undegraded":"2024-09-12T00:59:57.518261+0000","last_fullsized":"2024-09-12T00:59:57.518261+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:24.955277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":11,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"268'1","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:51.520904+0000","last_change":"2024-09-12T00:34:52.211653+0000","last_active":"2024-09-12T00:59:51.520904+0000","last_peered":"2024-09-12T00:59:51.520904+0000","last_clean":"2024-09-12T00:59:51.520904+0000","last_became_active":"2024-09-12T00:34:52.210935+0000","last_became_peered":"2024-09-12T00:34:52.210935+0000","last_unstale":"2024-09-12T00:59:51.520904+0000","last_undegraded":"2024-09-12T00:59:51.520904+0000","last_fullsized":"2024-09-12T00:59:51.520904+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:38.800194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'30","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:14.858026+0000","last_change":"2024-09-12T00:33:10.852168+0000","last_active":"2024-09-12T01:02:14.858026+0000","last_peered":"2024-09-12T01:02:14.858026+0000","last_clean":"2024-09-12T01:02:14.858026+0000","last_became_active":"2024-09-12T00:33:10.851334+0000","last_became_peered":"2024-09-12T00:33:10.851334+0000","last_unstale":"2024-09-12T01:02:14.858026+0000","last_undegraded":"2024-09-12T01:02:14.858026+0000","last_fullsized":"2024-09-12T01:02:14.858026+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:46.569072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":55,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:42.712847+0000","last_change":"2024-09-12T00:46:09.508043+0000","last_active":"2024-09-12T01:00:42.712847+0000","last_peered":"2024-09-12T01:00:42.712847+0000","last_clean":"2024-09-12T01:00:42.712847+0000","last_became_active":"2024-09-12T00:46:09.507324+0000","last_became_peered":"2024-09-12T00:46:09.507324+0000","last_unstale":"2024-09-12T01:00:42.712847+0000","last_undegraded":"2024-09-12T01:00:42.712847+0000","last_fullsized":"2024-09-12T01:00:42.712847+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:56.424671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"268'1","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:01.573414+0000","last_change":"2024-09-12T00:34:55.253609+0000","last_active":"2024-09-12T01:02:01.573414+0000","last_peered":"2024-09-12T01:02:01.573414+0000","last_clean":"2024-09-12T01:02:01.573414+0000","last_became_active":"2024-09-12T00:34:55.252880+0000","last_became_peered":"2024-09-12T00:34:55.252880+0000","last_unstale":"2024-09-12T01:02:01.573414+0000","last_undegraded":"2024-09-12T01:02:01.573414+0000","last_fullsized":"2024-09-12T01:02:01.573414+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:39.510072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"268'1","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:51.706461+0000","last_change":"2024-09-12T00:34:52.198542+0000","last_active":"2024-09-12T01:00:51.706461+0000","last_peered":"2024-09-12T01:00:51.706461+0000","last_clean":"2024-09-12T01:00:51.706461+0000","last_became_active":"2024-09-12T00:34:52.195513+0000","last_became_peered":"2024-09-12T00:34:52.195513+0000","last_unstale":"2024-09-12T01:00:51.706461+0000","last_undegraded":"2024-09-12T01:00:51.706461+0000","last_fullsized":"2024-09-12T01:00:51.706461+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:23.382695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'20","reported_seq":99,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.549669+0000","last_change":"2024-09-12T00:33:10.848259+0000","last_active":"2024-09-12T01:00:41.549669+0000","last_peered":"2024-09-12T01:00:41.549669+0000","last_clean":"2024-09-12T01:00:41.549669+0000","last_became_active":"2024-09-12T00:33:10.847432+0000","last_became_peered":"2024-09-12T00:33:10.847432+0000","last_unstale":"2024-09-12T01:00:41.549669+0000","last_undegraded":"2024-09-12T01:00:41.549669+0000","last_fullsized":"2024-09-12T01:00:41.549669+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:33.335638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":67,"num_write":46,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:46.737552+0000","last_change":"2024-09-12T00:46:09.497586+0000","last_active":"2024-09-12T01:00:46.737552+0000","last_peered":"2024-09-12T01:00:46.737552+0000","last_clean":"2024-09-12T01:00:46.737552+0000","last_became_active":"2024-09-12T00:46:09.496807+0000","last_became_peered":"2024-09-12T00:46:09.496807+0000","last_unstale":"2024-09-12T01:00:46.737552+0000","last_undegraded":"2024-09-12T01:00:46.737552+0000","last_fullsized":"2024-09-12T01:00:46.737552+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:06.744888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:01.741428+0000","last_change":"2024-09-12T00:34:55.248775+0000","last_active":"2024-09-12T01:01:01.741428+0000","last_peered":"2024-09-12T01:01:01.741428+0000","last_clean":"2024-09-12T01:01:01.741428+0000","last_became_active":"2024-09-12T00:34:55.248058+0000","last_became_peered":"2024-09-12T00:34:55.248058+0000","last_unstale":"2024-09-12T01:01:01.741428+0000","last_undegraded":"2024-09-12T01:01:01.741428+0000","last_fullsized":"2024-09-12T01:01:01.741428+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:55.550280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"268'7","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.546316+0000","last_change":"2024-09-12T00:34:52.170876+0000","last_active":"2024-09-12T01:01:57.546316+0000","last_peered":"2024-09-12T01:01:57.546316+0000","last_clean":"2024-09-12T01:01:57.546316+0000","last_became_active":"2024-09-12T00:34:52.170013+0000","last_became_peered":"2024-09-12T00:34:52.170013+0000","last_unstale":"2024-09-12T01:01:57.546316+0000","last_undegraded":"2024-09-12T01:01:57.546316+0000","last_fullsized":"2024-09-12T01:01:57.546316+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:37.972262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":10242,"num_write":7,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'17","reported_seq":88,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:20.286340+0000","last_change":"2024-09-12T00:33:10.840336+0000","last_active":"2024-09-12T01:02:20.286340+0000","last_peered":"2024-09-12T01:02:20.286340+0000","last_clean":"2024-09-12T01:02:20.286340+0000","last_became_active":"2024-09-12T00:33:10.839248+0000","last_became_peered":"2024-09-12T00:33:10.839248+0000","last_unstale":"2024-09-12T01:02:20.286340+0000","last_undegraded":"2024-09-12T01:02:20.286340+0000","last_fullsized":"2024-09-12T01:02:20.286340+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:57.557088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":49,"num_write":38,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:16.761099+0000","last_change":"2024-09-12T00:46:09.501613+0000","last_active":"2024-09-12T01:02:16.761099+0000","last_peered":"2024-09-12T01:02:16.761099+0000","last_clean":"2024-09-12T01:02:16.761099+0000","last_became_active":"2024-09-12T00:46:09.499830+0000","last_became_peered":"2024-09-12T00:46:09.499830+0000","last_unstale":"2024-09-12T01:02:16.761099+0000","last_undegraded":"2024-09-12T01:02:16.761099+0000","last_fullsized":"2024-09-12T01:02:16.761099+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:10.541266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"268'2","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:32.743222+0000","last_change":"2024-09-12T00:34:55.242753+0000","last_active":"2024-09-12T01:01:32.743222+0000","last_peered":"2024-09-12T01:01:32.743222+0000","last_clean":"2024-09-12T01:01:32.743222+0000","last_became_active":"2024-09-12T00:34:55.242012+0000","last_became_peered":"2024-09-12T00:34:55.242012+0000","last_unstale":"2024-09-12T01:01:32.743222+0000","last_undegraded":"2024-09-12T01:01:32.743222+0000","last_fullsized":"2024-09-12T01:01:32.743222+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:49.280445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'6","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:26.564638+0000","last_change":"2024-09-12T00:34:52.206650+0000","last_active":"2024-09-12T01:01:26.564638+0000","last_peered":"2024-09-12T01:01:26.564638+0000","last_clean":"2024-09-12T01:01:26.564638+0000","last_became_active":"2024-09-12T00:34:52.205385+0000","last_became_peered":"2024-09-12T00:34:52.205385+0000","last_unstale":"2024-09-12T01:01:26.564638+0000","last_undegraded":"2024-09-12T01:01:26.564638+0000","last_fullsized":"2024-09-12T01:01:26.564638+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:45.297232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'48","reported_seq":172,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.736371+0000","last_change":"2024-09-12T00:33:10.843742+0000","last_active":"2024-09-12T01:00:41.736371+0000","last_peered":"2024-09-12T01:00:41.736371+0000","last_clean":"2024-09-12T01:00:41.736371+0000","last_became_active":"2024-09-12T00:33:10.842427+0000","last_became_peered":"2024-09-12T00:33:10.842427+0000","last_unstale":"2024-09-12T01:00:41.736371+0000","last_undegraded":"2024-09-12T01:00:41.736371+0000","last_fullsized":"2024-09-12T01:00:41.736371+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:10.839165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":162,"num_write":92,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:46.533904+0000","last_change":"2024-09-12T00:46:09.514586+0000","last_active":"2024-09-12T01:00:46.533904+0000","last_peered":"2024-09-12T01:00:46.533904+0000","last_clean":"2024-09-12T01:00:46.533904+0000","last_became_active":"2024-09-12T00:46:09.513617+0000","last_became_peered":"2024-09-12T00:46:09.513617+0000","last_unstale":"2024-09-12T01:00:46.533904+0000","last_undegraded":"2024-09-12T01:00:46.533904+0000","last_fullsized":"2024-09-12T01:00:46.533904+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:01.938146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"265'7","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:32.723080+0000","last_change":"2024-09-12T00:35:57.378205+0000","last_active":"2024-09-12T01:01:32.723080+0000","last_peered":"2024-09-12T01:01:32.723080+0000","last_clean":"2024-09-12T01:01:32.723080+0000","last_became_active":"2024-09-12T00:35:57.345894+0000","last_became_peered":"2024-09-12T00:35:57.345894+0000","last_unstale":"2024-09-12T01:01:32.723080+0000","last_undegraded":"2024-09-12T01:01:32.723080+0000","last_fullsized":"2024-09-12T01:01:32.723080+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:29.209762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"265'2","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:37.541584+0000","last_change":"2024-09-12T00:34:52.189042+0000","last_active":"2024-09-12T01:01:37.541584+0000","last_peered":"2024-09-12T01:01:37.541584+0000","last_clean":"2024-09-12T01:01:37.541584+0000","last_became_active":"2024-09-12T00:34:52.188352+0000","last_became_peered":"2024-09-12T00:34:52.188352+0000","last_unstale":"2024-09-12T01:01:37.541584+0000","last_undegraded":"2024-09-12T01:01:37.541584+0000","last_fullsized":"2024-09-12T01:01:37.541584+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:23.453176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'29","reported_seq":125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:42.712902+0000","last_change":"2024-09-12T00:33:10.846375+0000","last_active":"2024-09-12T01:00:42.712902+0000","last_peered":"2024-09-12T01:00:42.712902+0000","last_clean":"2024-09-12T01:00:42.712902+0000","last_became_active":"2024-09-12T00:33:10.845301+0000","last_became_peered":"2024-09-12T00:33:10.845301+0000","last_unstale":"2024-09-12T01:00:42.712902+0000","last_undegraded":"2024-09-12T01:00:42.712902+0000","last_fullsized":"2024-09-12T01:00:42.712902+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:52.282677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.534764+0000","last_change":"2024-09-12T00:46:09.499014+0000","last_active":"2024-09-12T01:01:12.534764+0000","last_peered":"2024-09-12T01:01:12.534764+0000","last_clean":"2024-09-12T01:01:12.534764+0000","last_became_active":"2024-09-12T00:46:09.498002+0000","last_became_peered":"2024-09-12T00:46:09.498002+0000","last_unstale":"2024-09-12T01:01:12.534764+0000","last_undegraded":"2024-09-12T01:01:12.534764+0000","last_fullsized":"2024-09-12T01:01:12.534764+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:50.022966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":34,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.703624+0000","last_change":"2024-09-12T00:34:55.215867+0000","last_active":"2024-09-12T00:59:57.703624+0000","last_peered":"2024-09-12T00:59:57.703624+0000","last_clean":"2024-09-12T00:59:57.703624+0000","last_became_active":"2024-09-12T00:34:55.215076+0000","last_became_peered":"2024-09-12T00:34:55.215076+0000","last_unstale":"2024-09-12T00:59:57.703624+0000","last_undegraded":"2024-09-12T00:59:57.703624+0000","last_fullsized":"2024-09-12T00:59:57.703624+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:36.048042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"265'2","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:52.517005+0000","last_change":"2024-09-12T00:34:52.199214+0000","last_active":"2024-09-12T00:59:52.517005+0000","last_peered":"2024-09-12T00:59:52.517005+0000","last_clean":"2024-09-12T00:59:52.517005+0000","last_became_active":"2024-09-12T00:34:52.198548+0000","last_became_peered":"2024-09-12T00:34:52.198548+0000","last_unstale":"2024-09-12T00:59:52.517005+0000","last_undegraded":"2024-09-12T00:59:52.517005+0000","last_fullsized":"2024-09-12T00:59:52.517005+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:36.364945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'18","reported_seq":93,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:56.536596+0000","last_change":"2024-09-12T00:33:10.857470+0000","last_active":"2024-09-12T00:59:56.536596+0000","last_peered":"2024-09-12T00:59:56.536596+0000","last_clean":"2024-09-12T00:59:56.536596+0000","last_became_active":"2024-09-12T00:33:10.856664+0000","last_became_peered":"2024-09-12T00:33:10.856664+0000","last_unstale":"2024-09-12T00:59:56.536596+0000","last_undegraded":"2024-09-12T00:59:56.536596+0000","last_fullsized":"2024-09-12T00:59:56.536596+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:26.626571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":59,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.534815+0000","last_change":"2024-09-12T00:46:09.504100+0000","last_active":"2024-09-12T01:01:12.534815+0000","last_peered":"2024-09-12T01:01:12.534815+0000","last_clean":"2024-09-12T01:01:12.534815+0000","last_became_active":"2024-09-12T00:46:09.503361+0000","last_became_peered":"2024-09-12T00:46:09.503361+0000","last_unstale":"2024-09-12T01:01:12.534815+0000","last_undegraded":"2024-09-12T01:01:12.534815+0000","last_fullsized":"2024-09-12T01:01:12.534815+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:15.687886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":34,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:56.723763+0000","last_change":"2024-09-12T00:34:55.217786+0000","last_active":"2024-09-12T00:59:56.723763+0000","last_peered":"2024-09-12T00:59:56.723763+0000","last_clean":"2024-09-12T00:59:56.723763+0000","last_became_active":"2024-09-12T00:34:55.217009+0000","last_became_peered":"2024-09-12T00:34:55.217009+0000","last_unstale":"2024-09-12T00:59:56.723763+0000","last_undegraded":"2024-09-12T00:59:56.723763+0000","last_fullsized":"2024-09-12T00:59:56.723763+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:52.140153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"268'1","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:51.532437+0000","last_change":"2024-09-12T00:34:52.206482+0000","last_active":"2024-09-12T00:59:51.532437+0000","last_peered":"2024-09-12T00:59:51.532437+0000","last_clean":"2024-09-12T00:59:51.532437+0000","last_became_active":"2024-09-12T00:34:52.202432+0000","last_became_peered":"2024-09-12T00:34:52.202432+0000","last_unstale":"2024-09-12T00:59:51.532437+0000","last_undegraded":"2024-09-12T00:59:51.532437+0000","last_fullsized":"2024-09-12T00:59:51.532437+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:47.587915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"268'46","reported_seq":174,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.554878+0000","last_change":"2024-09-12T00:33:10.846991+0000","last_active":"2024-09-12T01:02:11.554878+0000","last_peered":"2024-09-12T01:02:11.554878+0000","last_clean":"2024-09-12T01:02:11.554878+0000","last_became_active":"2024-09-12T00:33:10.846370+0000","last_became_peered":"2024-09-12T00:33:10.846370+0000","last_unstale":"2024-09-12T01:02:11.554878+0000","last_undegraded":"2024-09-12T01:02:11.554878+0000","last_fullsized":"2024-09-12T01:02:11.554878+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:49.969549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":168,"num_write":82,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:11.525647+0000","last_change":"2024-09-12T00:46:09.494884+0000","last_active":"2024-09-12T01:00:11.525647+0000","last_peered":"2024-09-12T01:00:11.525647+0000","last_clean":"2024-09-12T01:00:11.525647+0000","last_became_active":"2024-09-12T00:46:09.494139+0000","last_became_peered":"2024-09-12T00:46:09.494139+0000","last_unstale":"2024-09-12T01:00:11.525647+0000","last_undegraded":"2024-09-12T01:00:11.525647+0000","last_fullsized":"2024-09-12T01:00:11.525647+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:16.093338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":35,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:31.748997+0000","last_change":"2024-09-12T00:34:55.253827+0000","last_active":"2024-09-12T01:01:31.748997+0000","last_peered":"2024-09-12T01:01:31.748997+0000","last_clean":"2024-09-12T01:01:31.748997+0000","last_became_active":"2024-09-12T00:34:55.253209+0000","last_became_peered":"2024-09-12T00:34:55.253209+0000","last_unstale":"2024-09-12T01:01:31.748997+0000","last_undegraded":"2024-09-12T01:01:31.748997+0000","last_fullsized":"2024-09-12T01:01:31.748997+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:58.016129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'1","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:32.729826+0000","last_change":"2024-09-12T00:34:52.180802+0000","last_active":"2024-09-12T01:00:32.729826+0000","last_peered":"2024-09-12T01:00:32.729826+0000","last_clean":"2024-09-12T01:00:32.729826+0000","last_became_active":"2024-09-12T00:34:52.180036+0000","last_became_peered":"2024-09-12T00:34:52.180036+0000","last_unstale":"2024-09-12T01:00:32.729826+0000","last_undegraded":"2024-09-12T01:00:32.729826+0000","last_fullsized":"2024-09-12T01:00:32.729826+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:25.152180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'75","reported_seq":263,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.576052+0000","last_change":"2024-09-12T00:33:10.852500+0000","last_active":"2024-09-12T01:02:11.576052+0000","last_peered":"2024-09-12T01:02:11.576052+0000","last_clean":"2024-09-12T01:02:11.576052+0000","last_became_active":"2024-09-12T00:33:10.851672+0000","last_became_peered":"2024-09-12T00:33:10.851672+0000","last_unstale":"2024-09-12T01:02:11.576052+0000","last_undegraded":"2024-09-12T01:02:11.576052+0000","last_fullsized":"2024-09-12T01:02:11.576052+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:45.023568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":415,"num_read_kb":311,"num_write":116,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:11.698157+0000","last_change":"2024-09-12T00:46:09.519546+0000","last_active":"2024-09-12T01:00:11.698157+0000","last_peered":"2024-09-12T01:00:11.698157+0000","last_clean":"2024-09-12T01:00:11.698157+0000","last_became_active":"2024-09-12T00:46:09.513012+0000","last_became_peered":"2024-09-12T00:46:09.513012+0000","last_unstale":"2024-09-12T01:00:11.698157+0000","last_undegraded":"2024-09-12T01:00:11.698157+0000","last_fullsized":"2024-09-12T01:00:11.698157+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:10.067526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"268'6","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.736417+0000","last_change":"2024-09-12T00:34:55.254204+0000","last_active":"2024-09-12T01:00:41.736417+0000","last_peered":"2024-09-12T01:00:41.736417+0000","last_clean":"2024-09-12T01:00:41.736417+0000","last_became_active":"2024-09-12T00:34:55.252580+0000","last_became_peered":"2024-09-12T00:34:55.252580+0000","last_unstale":"2024-09-12T01:00:41.736417+0000","last_undegraded":"2024-09-12T01:00:41.736417+0000","last_fullsized":"2024-09-12T01:00:41.736417+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:00.820979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":14336,"num_write":16,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:27.538170+0000","last_change":"2024-09-12T00:34:52.204725+0000","last_active":"2024-09-12T01:01:27.538170+0000","last_peered":"2024-09-12T01:01:27.538170+0000","last_clean":"2024-09-12T01:01:27.538170+0000","last_became_active":"2024-09-12T00:34:52.204021+0000","last_became_peered":"2024-09-12T00:34:52.204021+0000","last_unstale":"2024-09-12T01:01:27.538170+0000","last_undegraded":"2024-09-12T01:01:27.538170+0000","last_fullsized":"2024-09-12T01:01:27.538170+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:45.824620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'35","reported_seq":145,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.759818+0000","last_change":"2024-09-12T00:33:10.850040+0000","last_active":"2024-09-12T01:02:11.759818+0000","last_peered":"2024-09-12T01:02:11.759818+0000","last_clean":"2024-09-12T01:02:11.759818+0000","last_became_active":"2024-09-12T00:33:10.849228+0000","last_became_peered":"2024-09-12T00:33:10.849228+0000","last_unstale":"2024-09-12T01:02:11.759818+0000","last_undegraded":"2024-09-12T01:02:11.759818+0000","last_fullsized":"2024-09-12T01:02:11.759818+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:46.335542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":134,"num_write":61,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:12.520461+0000","last_change":"2024-09-12T00:46:09.500158+0000","last_active":"2024-09-12T01:00:12.520461+0000","last_peered":"2024-09-12T01:00:12.520461+0000","last_clean":"2024-09-12T01:00:12.520461+0000","last_became_active":"2024-09-12T00:46:09.499137+0000","last_became_peered":"2024-09-12T00:46:09.499137+0000","last_unstale":"2024-09-12T01:00:12.520461+0000","last_undegraded":"2024-09-12T01:00:12.520461+0000","last_fullsized":"2024-09-12T01:00:12.520461+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:28.716621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"268'4","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:31.749130+0000","last_change":"2024-09-12T00:34:55.254921+0000","last_active":"2024-09-12T01:01:31.749130+0000","last_peered":"2024-09-12T01:01:31.749130+0000","last_clean":"2024-09-12T01:01:31.749130+0000","last_became_active":"2024-09-12T00:34:55.254250+0000","last_became_peered":"2024-09-12T00:34:55.254250+0000","last_unstale":"2024-09-12T01:01:31.749130+0000","last_undegraded":"2024-09-12T01:01:31.749130+0000","last_fullsized":"2024-09-12T01:01:31.749130+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:45.939058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":9,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:26.714599+0000","last_change":"2024-09-12T00:34:52.179911+0000","last_active":"2024-09-12T01:01:26.714599+0000","last_peered":"2024-09-12T01:01:26.714599+0000","last_clean":"2024-09-12T01:01:26.714599+0000","last_became_active":"2024-09-12T00:34:52.173822+0000","last_became_peered":"2024-09-12T00:34:52.173822+0000","last_unstale":"2024-09-12T01:01:26.714599+0000","last_undegraded":"2024-09-12T01:01:26.714599+0000","last_fullsized":"2024-09-12T01:01:26.714599+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:44.199880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'34","reported_seq":141,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.724049+0000","last_change":"2024-09-12T00:33:10.842194+0000","last_active":"2024-09-12T01:02:11.724049+0000","last_peered":"2024-09-12T01:02:11.724049+0000","last_clean":"2024-09-12T01:02:11.724049+0000","last_became_active":"2024-09-12T00:33:10.841363+0000","last_became_peered":"2024-09-12T00:33:10.841363+0000","last_unstale":"2024-09-12T01:02:11.724049+0000","last_undegraded":"2024-09-12T01:02:11.724049+0000","last_fullsized":"2024-09-12T01:02:11.724049+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:29.266511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":128,"num_write":55,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:12.725014+0000","last_change":"2024-09-12T00:46:09.506737+0000","last_active":"2024-09-12T01:00:12.725014+0000","last_peered":"2024-09-12T01:00:12.725014+0000","last_clean":"2024-09-12T01:00:12.725014+0000","last_became_active":"2024-09-12T00:46:09.502684+0000","last_became_peered":"2024-09-12T00:46:09.502684+0000","last_unstale":"2024-09-12T01:00:12.725014+0000","last_undegraded":"2024-09-12T01:00:12.725014+0000","last_fullsized":"2024-09-12T01:00:12.725014+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:55.402567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"268'5","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:32.540359+0000","last_change":"2024-09-12T00:34:55.227141+0000","last_active":"2024-09-12T01:01:32.540359+0000","last_peered":"2024-09-12T01:01:32.540359+0000","last_clean":"2024-09-12T01:01:32.540359+0000","last_became_active":"2024-09-12T00:34:55.226388+0000","last_became_peered":"2024-09-12T00:34:55.226388+0000","last_unstale":"2024-09-12T01:01:32.540359+0000","last_undegraded":"2024-09-12T01:01:32.540359+0000","last_fullsized":"2024-09-12T01:01:32.540359+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:59.431333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":15,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"268'10","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:26.564896+0000","last_change":"2024-09-12T00:34:52.197590+0000","last_active":"2024-09-12T01:01:26.564896+0000","last_peered":"2024-09-12T01:01:26.564896+0000","last_clean":"2024-09-12T01:01:26.564896+0000","last_became_active":"2024-09-12T00:34:52.196770+0000","last_became_peered":"2024-09-12T00:34:52.196770+0000","last_unstale":"2024-09-12T01:01:26.564896+0000","last_undegraded":"2024-09-12T01:01:26.564896+0000","last_fullsized":"2024-09-12T01:01:26.564896+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:15.638504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":25602,"num_write":15,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'4","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:37.433116+0000","last_change":"2024-09-12T00:33:10.858900+0000","last_active":"2024-09-12T01:01:37.433116+0000","last_peered":"2024-09-12T01:01:37.433116+0000","last_clean":"2024-09-12T01:01:37.433116+0000","last_became_active":"2024-09-12T00:33:10.858178+0000","last_became_peered":"2024-09-12T00:33:10.858178+0000","last_unstale":"2024-09-12T01:01:37.433116+0000","last_undegraded":"2024-09-12T01:01:37.433116+0000","last_fullsized":"2024-09-12T01:01:37.433116+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:45.562348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.736528+0000","last_change":"2024-09-12T00:46:09.522998+0000","last_active":"2024-09-12T01:00:41.736528+0000","last_peered":"2024-09-12T01:00:41.736528+0000","last_clean":"2024-09-12T01:00:41.736528+0000","last_became_active":"2024-09-12T00:46:09.521706+0000","last_became_peered":"2024-09-12T00:46:09.521706+0000","last_unstale":"2024-09-12T01:00:41.736528+0000","last_undegraded":"2024-09-12T01:00:41.736528+0000","last_fullsized":"2024-09-12T01:00:41.736528+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:39.145979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"268'2","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:36.531591+0000","last_change":"2024-09-12T00:34:55.224573+0000","last_active":"2024-09-12T01:00:36.531591+0000","last_peered":"2024-09-12T01:00:36.531591+0000","last_clean":"2024-09-12T01:00:36.531591+0000","last_became_active":"2024-09-12T00:34:55.223787+0000","last_became_peered":"2024-09-12T00:34:55.223787+0000","last_unstale":"2024-09-12T01:00:36.531591+0000","last_undegraded":"2024-09-12T01:00:36.531591+0000","last_fullsized":"2024-09-12T01:00:36.531591+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:30.131692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"268'5","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:32.525816+0000","last_change":"2024-09-12T00:34:52.184714+0000","last_active":"2024-09-12T01:00:32.525816+0000","last_peered":"2024-09-12T01:00:32.525816+0000","last_clean":"2024-09-12T01:00:32.525816+0000","last_became_active":"2024-09-12T00:34:52.183982+0000","last_became_peered":"2024-09-12T00:34:52.183982+0000","last_unstale":"2024-09-12T01:00:32.525816+0000","last_undegraded":"2024-09-12T01:00:32.525816+0000","last_fullsized":"2024-09-12T01:00:32.525816+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:07.745456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":5649,"num_write":5,"num_write_kb":5649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'25","reported_seq":115,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.534711+0000","last_change":"2024-09-12T00:33:10.858835+0000","last_active":"2024-09-12T01:01:12.534711+0000","last_peered":"2024-09-12T01:01:12.534711+0000","last_clean":"2024-09-12T01:01:12.534711+0000","last_became_active":"2024-09-12T00:33:10.858212+0000","last_became_peered":"2024-09-12T00:33:10.858212+0000","last_unstale":"2024-09-12T01:01:12.534711+0000","last_undegraded":"2024-09-12T01:01:12.534711+0000","last_fullsized":"2024-09-12T01:01:12.534711+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:58.477753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":92,"num_write":42,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.549794+0000","last_change":"2024-09-12T00:46:09.518627+0000","last_active":"2024-09-12T01:00:41.549794+0000","last_peered":"2024-09-12T01:00:41.549794+0000","last_clean":"2024-09-12T01:00:41.549794+0000","last_became_active":"2024-09-12T00:46:09.517833+0000","last_became_peered":"2024-09-12T00:46:09.517833+0000","last_unstale":"2024-09-12T01:00:41.549794+0000","last_undegraded":"2024-09-12T01:00:41.549794+0000","last_fullsized":"2024-09-12T01:00:41.549794+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:23.918442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'9","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:36.531490+0000","last_change":"2024-09-12T00:34:55.227520+0000","last_active":"2024-09-12T01:00:36.531490+0000","last_peered":"2024-09-12T01:00:36.531490+0000","last_clean":"2024-09-12T01:00:36.531490+0000","last_became_active":"2024-09-12T00:34:55.226334+0000","last_became_peered":"2024-09-12T00:34:55.226334+0000","last_unstale":"2024-09-12T01:00:36.531490+0000","last_undegraded":"2024-09-12T01:00:36.531490+0000","last_fullsized":"2024-09-12T01:00:36.531490+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:23.592244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":14,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'5","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:31.733086+0000","last_change":"2024-09-12T00:34:52.179045+0000","last_active":"2024-09-12T01:00:31.733086+0000","last_peered":"2024-09-12T01:00:31.733086+0000","last_clean":"2024-09-12T01:00:31.733086+0000","last_became_active":"2024-09-12T00:34:52.174421+0000","last_became_peered":"2024-09-12T00:34:52.174421+0000","last_unstale":"2024-09-12T01:00:31.733086+0000","last_undegraded":"2024-09-12T01:00:31.733086+0000","last_fullsized":"2024-09-12T01:00:31.733086+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:27.648444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":5438,"num_write":5,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"268'52","reported_seq":187,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.554333+0000","last_change":"2024-09-12T00:33:10.849621+0000","last_active":"2024-09-12T01:02:21.554333+0000","last_peered":"2024-09-12T01:02:21.554333+0000","last_clean":"2024-09-12T01:02:21.554333+0000","last_became_active":"2024-09-12T00:33:10.848890+0000","last_became_peered":"2024-09-12T00:33:10.848890+0000","last_unstale":"2024-09-12T01:02:21.554333+0000","last_undegraded":"2024-09-12T01:02:21.554333+0000","last_fullsized":"2024-09-12T01:02:21.554333+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:26.708631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":180,"num_write":98,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:16.541674+0000","last_change":"2024-09-12T00:46:09.521885+0000","last_active":"2024-09-12T01:00:16.541674+0000","last_peered":"2024-09-12T01:00:16.541674+0000","last_clean":"2024-09-12T01:00:16.541674+0000","last_became_active":"2024-09-12T00:46:09.521575+0000","last_became_peered":"2024-09-12T00:46:09.521575+0000","last_unstale":"2024-09-12T01:00:16.541674+0000","last_undegraded":"2024-09-12T01:00:16.541674+0000","last_fullsized":"2024-09-12T01:00:16.541674+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:19.905486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"268'5","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:36.735003+0000","last_change":"2024-09-12T00:34:55.233021+0000","last_active":"2024-09-12T01:00:36.735003+0000","last_peered":"2024-09-12T01:00:36.735003+0000","last_clean":"2024-09-12T01:00:36.735003+0000","last_became_active":"2024-09-12T00:34:55.232215+0000","last_became_peered":"2024-09-12T00:34:55.232215+0000","last_unstale":"2024-09-12T01:00:36.735003+0000","last_undegraded":"2024-09-12T01:00:36.735003+0000","last_fullsized":"2024-09-12T01:00:36.735003+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:02.623358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4254673,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":8310,"num_write":10,"num_write_kb":8251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"268'3","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:32.710859+0000","last_change":"2024-09-12T00:34:52.200570+0000","last_active":"2024-09-12T01:00:32.710859+0000","last_peered":"2024-09-12T01:00:32.710859+0000","last_clean":"2024-09-12T01:00:32.710859+0000","last_became_active":"2024-09-12T00:34:52.199793+0000","last_became_peered":"2024-09-12T00:34:52.199793+0000","last_unstale":"2024-09-12T01:00:32.710859+0000","last_undegraded":"2024-09-12T01:00:32.710859+0000","last_fullsized":"2024-09-12T01:00:32.710859+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:28.505129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'20","reported_seq":103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.535700+0000","last_change":"2024-09-12T00:33:10.845733+0000","last_active":"2024-09-12T01:01:12.535700+0000","last_peered":"2024-09-12T01:01:12.535700+0000","last_clean":"2024-09-12T01:01:12.535700+0000","last_became_active":"2024-09-12T00:33:10.844957+0000","last_became_peered":"2024-09-12T00:33:10.844957+0000","last_unstale":"2024-09-12T01:01:12.535700+0000","last_undegraded":"2024-09-12T01:01:12.535700+0000","last_fullsized":"2024-09-12T01:01:12.535700+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:00.371030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":73,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.736485+0000","last_change":"2024-09-12T00:46:09.515049+0000","last_active":"2024-09-12T01:00:41.736485+0000","last_peered":"2024-09-12T01:00:41.736485+0000","last_clean":"2024-09-12T01:00:41.736485+0000","last_became_active":"2024-09-12T00:46:09.514727+0000","last_became_peered":"2024-09-12T00:46:09.514727+0000","last_unstale":"2024-09-12T01:00:41.736485+0000","last_undegraded":"2024-09-12T01:00:41.736485+0000","last_fullsized":"2024-09-12T01:00:41.736485+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:28.627541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"268'5","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:37.711861+0000","last_change":"2024-09-12T00:34:55.220880+0000","last_active":"2024-09-12T01:00:37.711861+0000","last_peered":"2024-09-12T01:00:37.711861+0000","last_clean":"2024-09-12T01:00:37.711861+0000","last_became_active":"2024-09-12T00:34:55.220179+0000","last_became_peered":"2024-09-12T00:34:55.220179+0000","last_unstale":"2024-09-12T01:00:37.711861+0000","last_undegraded":"2024-09-12T01:00:37.711861+0000","last_fullsized":"2024-09-12T01:00:37.711861+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:14.092881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"268'5","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:32.729791+0000","last_change":"2024-09-12T00:34:52.197324+0000","last_active":"2024-09-12T01:00:32.729791+0000","last_peered":"2024-09-12T01:00:32.729791+0000","last_clean":"2024-09-12T01:00:32.729791+0000","last_became_active":"2024-09-12T00:34:52.196592+0000","last_became_peered":"2024-09-12T00:34:52.196592+0000","last_unstale":"2024-09-12T01:00:32.729791+0000","last_undegraded":"2024-09-12T01:00:32.729791+0000","last_fullsized":"2024-09-12T01:00:32.729791+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:12.628205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":10,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'27","reported_seq":117,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:11.743558+0000","last_change":"2024-09-12T00:33:10.842922+0000","last_active":"2024-09-12T01:01:11.743558+0000","last_peered":"2024-09-12T01:01:11.743558+0000","last_clean":"2024-09-12T01:01:11.743558+0000","last_became_active":"2024-09-12T00:33:10.842139+0000","last_became_peered":"2024-09-12T00:33:10.842139+0000","last_unstale":"2024-09-12T01:01:11.743558+0000","last_undegraded":"2024-09-12T01:01:11.743558+0000","last_fullsized":"2024-09-12T01:01:11.743558+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:22.677651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":87,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:21.713467+0000","last_change":"2024-09-12T00:46:09.495008+0000","last_active":"2024-09-12T01:01:21.713467+0000","last_peered":"2024-09-12T01:01:21.713467+0000","last_clean":"2024-09-12T01:01:21.713467+0000","last_became_active":"2024-09-12T00:46:09.494257+0000","last_became_peered":"2024-09-12T00:46:09.494257+0000","last_unstale":"2024-09-12T01:01:21.713467+0000","last_undegraded":"2024-09-12T01:01:21.713467+0000","last_fullsized":"2024-09-12T01:01:21.713467+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:13.650561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":36,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.755822+0000","last_change":"2024-09-12T00:34:55.228058+0000","last_active":"2024-09-12T01:01:56.755822+0000","last_peered":"2024-09-12T01:01:56.755822+0000","last_clean":"2024-09-12T01:01:56.755822+0000","last_became_active":"2024-09-12T00:34:55.226471+0000","last_became_peered":"2024-09-12T00:34:55.226471+0000","last_unstale":"2024-09-12T01:01:56.755822+0000","last_undegraded":"2024-09-12T01:01:56.755822+0000","last_fullsized":"2024-09-12T01:01:56.755822+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:56.137407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'2","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:52.543792+0000","last_change":"2024-09-12T00:34:52.203278+0000","last_active":"2024-09-12T01:01:52.543792+0000","last_peered":"2024-09-12T01:01:52.543792+0000","last_clean":"2024-09-12T01:01:52.543792+0000","last_became_active":"2024-09-12T00:34:52.202587+0000","last_became_peered":"2024-09-12T00:34:52.202587+0000","last_unstale":"2024-09-12T01:01:52.543792+0000","last_undegraded":"2024-09-12T01:01:52.543792+0000","last_fullsized":"2024-09-12T01:01:52.543792+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:59.179898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'23","reported_seq":108,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:16.729118+0000","last_change":"2024-09-12T00:33:10.833328+0000","last_active":"2024-09-12T01:00:16.729118+0000","last_peered":"2024-09-12T01:00:16.729118+0000","last_clean":"2024-09-12T01:00:16.729118+0000","last_became_active":"2024-09-12T00:33:10.832622+0000","last_became_peered":"2024-09-12T00:33:10.832622+0000","last_unstale":"2024-09-12T01:00:16.729118+0000","last_undegraded":"2024-09-12T01:00:16.729118+0000","last_fullsized":"2024-09-12T01:00:16.729118+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:46.829359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":78,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.544986+0000","last_change":"2024-09-12T00:46:09.502064+0000","last_active":"2024-09-12T01:01:57.544986+0000","last_peered":"2024-09-12T01:01:57.544986+0000","last_clean":"2024-09-12T01:01:57.544986+0000","last_became_active":"2024-09-12T00:46:09.501361+0000","last_became_peered":"2024-09-12T00:46:09.501361+0000","last_unstale":"2024-09-12T01:01:57.544986+0000","last_undegraded":"2024-09-12T01:01:57.544986+0000","last_fullsized":"2024-09-12T01:01:57.544986+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:11.638769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"268'1","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.755723+0000","last_change":"2024-09-12T00:34:55.222844+0000","last_active":"2024-09-12T01:01:56.755723+0000","last_peered":"2024-09-12T01:01:56.755723+0000","last_clean":"2024-09-12T01:01:56.755723+0000","last_became_active":"2024-09-12T00:34:55.222079+0000","last_became_peered":"2024-09-12T00:34:55.222079+0000","last_unstale":"2024-09-12T01:01:56.755723+0000","last_undegraded":"2024-09-12T01:01:56.755723+0000","last_fullsized":"2024-09-12T01:01:56.755723+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:10.859567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3198,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"268'2","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:51.719742+0000","last_change":"2024-09-12T00:34:52.177816+0000","last_active":"2024-09-12T01:01:51.719742+0000","last_peered":"2024-09-12T01:01:51.719742+0000","last_clean":"2024-09-12T01:01:51.719742+0000","last_became_active":"2024-09-12T00:34:52.176108+0000","last_became_peered":"2024-09-12T00:34:52.176108+0000","last_unstale":"2024-09-12T01:01:51.719742+0000","last_undegraded":"2024-09-12T01:01:51.719742+0000","last_fullsized":"2024-09-12T01:01:51.719742+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:39.727514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'16","reported_seq":90,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:12.725245+0000","last_change":"2024-09-12T00:33:10.850501+0000","last_active":"2024-09-12T01:00:12.725245+0000","last_peered":"2024-09-12T01:00:12.725245+0000","last_clean":"2024-09-12T01:00:12.725245+0000","last_became_active":"2024-09-12T00:33:10.849703+0000","last_became_peered":"2024-09-12T00:33:10.849703+0000","last_unstale":"2024-09-12T01:00:12.725245+0000","last_undegraded":"2024-09-12T01:00:12.725245+0000","last_fullsized":"2024-09-12T01:00:12.725245+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:34.698555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:22.721112+0000","last_change":"2024-09-12T00:46:09.517232+0000","last_active":"2024-09-12T01:01:22.721112+0000","last_peered":"2024-09-12T01:01:22.721112+0000","last_clean":"2024-09-12T01:01:22.721112+0000","last_became_active":"2024-09-12T00:46:09.514197+0000","last_became_peered":"2024-09-12T00:46:09.514197+0000","last_unstale":"2024-09-12T01:01:22.721112+0000","last_undegraded":"2024-09-12T01:01:22.721112+0000","last_fullsized":"2024-09-12T01:01:22.721112+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:13.571995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"268'7","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:01.552559+0000","last_change":"2024-09-12T00:34:55.253416+0000","last_active":"2024-09-12T01:02:01.552559+0000","last_peered":"2024-09-12T01:02:01.552559+0000","last_clean":"2024-09-12T01:02:01.552559+0000","last_became_active":"2024-09-12T00:34:55.252651+0000","last_became_peered":"2024-09-12T00:34:55.252651+0000","last_unstale":"2024-09-12T01:02:01.552559+0000","last_undegraded":"2024-09-12T01:02:01.552559+0000","last_fullsized":"2024-09-12T01:02:01.552559+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:51.619823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":7697,"num_write":7,"num_write_kb":6673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"268'2","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:51.570617+0000","last_change":"2024-09-12T00:34:52.201618+0000","last_active":"2024-09-12T01:01:51.570617+0000","last_peered":"2024-09-12T01:01:51.570617+0000","last_clean":"2024-09-12T01:01:51.570617+0000","last_became_active":"2024-09-12T00:34:52.177094+0000","last_became_peered":"2024-09-12T00:34:52.177094+0000","last_unstale":"2024-09-12T01:01:51.570617+0000","last_undegraded":"2024-09-12T01:01:51.570617+0000","last_fullsized":"2024-09-12T01:01:51.570617+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:28.340168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"268'31","reported_seq":132,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:12.706722+0000","last_change":"2024-09-12T00:33:10.863914+0000","last_active":"2024-09-12T01:00:12.706722+0000","last_peered":"2024-09-12T01:00:12.706722+0000","last_clean":"2024-09-12T01:00:12.706722+0000","last_became_active":"2024-09-12T00:33:10.862993+0000","last_became_peered":"2024-09-12T00:33:10.862993+0000","last_unstale":"2024-09-12T01:00:12.706722+0000","last_undegraded":"2024-09-12T01:00:12.706722+0000","last_fullsized":"2024-09-12T01:00:12.706722+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:01.904051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":107,"num_write":58,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:22.536912+0000","last_change":"2024-09-12T00:46:09.499178+0000","last_active":"2024-09-12T01:01:22.536912+0000","last_peered":"2024-09-12T01:01:22.536912+0000","last_clean":"2024-09-12T01:01:22.536912+0000","last_became_active":"2024-09-12T00:46:09.498482+0000","last_became_peered":"2024-09-12T00:46:09.498482+0000","last_unstale":"2024-09-12T01:01:22.536912+0000","last_undegraded":"2024-09-12T01:01:22.536912+0000","last_fullsized":"2024-09-12T01:01:22.536912+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:41.343998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":36,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.755870+0000","last_change":"2024-09-12T00:34:55.229076+0000","last_active":"2024-09-12T01:01:56.755870+0000","last_peered":"2024-09-12T01:01:56.755870+0000","last_clean":"2024-09-12T01:01:56.755870+0000","last_became_active":"2024-09-12T00:34:55.228136+0000","last_became_peered":"2024-09-12T00:34:55.228136+0000","last_unstale":"2024-09-12T01:01:56.755870+0000","last_undegraded":"2024-09-12T01:01:56.755870+0000","last_fullsized":"2024-09-12T01:01:56.755870+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:13.739031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.551311+0000","last_change":"2024-09-12T00:34:52.191163+0000","last_active":"2024-09-12T01:01:56.551311+0000","last_peered":"2024-09-12T01:01:56.551311+0000","last_clean":"2024-09-12T01:01:56.551311+0000","last_became_active":"2024-09-12T00:34:52.190350+0000","last_became_peered":"2024-09-12T00:34:52.190350+0000","last_unstale":"2024-09-12T01:01:56.551311+0000","last_undegraded":"2024-09-12T01:01:56.551311+0000","last_fullsized":"2024-09-12T01:01:56.551311+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:44.544700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'31","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:11.698235+0000","last_change":"2024-09-12T00:33:10.834922+0000","last_active":"2024-09-12T01:00:11.698235+0000","last_peered":"2024-09-12T01:00:11.698235+0000","last_clean":"2024-09-12T01:00:11.698235+0000","last_became_active":"2024-09-12T00:33:10.834095+0000","last_became_peered":"2024-09-12T00:33:10.834095+0000","last_unstale":"2024-09-12T01:00:11.698235+0000","last_undegraded":"2024-09-12T01:00:11.698235+0000","last_fullsized":"2024-09-12T01:00:11.698235+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:09.706426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":107,"num_write":54,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.755937+0000","last_change":"2024-09-12T00:46:09.502145+0000","last_active":"2024-09-12T01:01:56.755937+0000","last_peered":"2024-09-12T01:01:56.755937+0000","last_clean":"2024-09-12T01:01:56.755937+0000","last_became_active":"2024-09-12T00:46:09.500779+0000","last_became_peered":"2024-09-12T00:46:09.500779+0000","last_unstale":"2024-09-12T01:01:56.755937+0000","last_undegraded":"2024-09-12T01:01:56.755937+0000","last_fullsized":"2024-09-12T01:01:56.755937+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:52.290781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"268'6","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.532068+0000","last_change":"2024-09-12T00:34:55.242037+0000","last_active":"2024-09-12T01:00:57.532068+0000","last_peered":"2024-09-12T01:00:57.532068+0000","last_clean":"2024-09-12T01:00:57.532068+0000","last_became_active":"2024-09-12T00:34:55.241223+0000","last_became_peered":"2024-09-12T00:34:55.241223+0000","last_unstale":"2024-09-12T01:00:57.532068+0000","last_undegraded":"2024-09-12T01:00:57.532068+0000","last_fullsized":"2024-09-12T01:00:57.532068+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:56.166816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":9218,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"268'1","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:51.552448+0000","last_change":"2024-09-12T00:34:52.206116+0000","last_active":"2024-09-12T01:00:51.552448+0000","last_peered":"2024-09-12T01:00:51.552448+0000","last_clean":"2024-09-12T01:00:51.552448+0000","last_became_active":"2024-09-12T00:34:52.202407+0000","last_became_peered":"2024-09-12T00:34:52.202407+0000","last_unstale":"2024-09-12T01:00:51.552448+0000","last_undegraded":"2024-09-12T01:00:51.552448+0000","last_fullsized":"2024-09-12T01:00:51.552448+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:16.024426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'46","reported_seq":178,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:11.540316+0000","last_change":"2024-09-12T00:33:10.860057+0000","last_active":"2024-09-12T01:00:11.540316+0000","last_peered":"2024-09-12T01:00:11.540316+0000","last_clean":"2024-09-12T01:00:11.540316+0000","last_became_active":"2024-09-12T00:33:10.859459+0000","last_became_peered":"2024-09-12T00:33:10.859459+0000","last_unstale":"2024-09-12T01:00:11.540316+0000","last_undegraded":"2024-09-12T01:00:11.540316+0000","last_fullsized":"2024-09-12T01:00:11.540316+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:02.662726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":176,"num_write":75,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.546185+0000","last_change":"2024-09-12T00:46:09.505921+0000","last_active":"2024-09-12T01:02:02.546185+0000","last_peered":"2024-09-12T01:02:02.546185+0000","last_clean":"2024-09-12T01:02:02.546185+0000","last_became_active":"2024-09-12T00:46:09.505143+0000","last_became_peered":"2024-09-12T00:46:09.505143+0000","last_unstale":"2024-09-12T01:02:02.546185+0000","last_undegraded":"2024-09-12T01:02:02.546185+0000","last_fullsized":"2024-09-12T01:02:02.546185+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:58.286882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"268'1","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.530957+0000","last_change":"2024-09-12T00:34:55.253946+0000","last_active":"2024-09-12T01:00:57.530957+0000","last_peered":"2024-09-12T01:00:57.530957+0000","last_clean":"2024-09-12T01:00:57.530957+0000","last_became_active":"2024-09-12T00:34:55.253169+0000","last_became_peered":"2024-09-12T00:34:55.253169+0000","last_unstale":"2024-09-12T01:00:57.530957+0000","last_undegraded":"2024-09-12T01:00:57.530957+0000","last_fullsized":"2024-09-12T01:00:57.530957+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:41.186189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"268'1","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:51.534862+0000","last_change":"2024-09-12T00:34:52.190974+0000","last_active":"2024-09-12T01:00:51.534862+0000","last_peered":"2024-09-12T01:00:51.534862+0000","last_clean":"2024-09-12T01:00:51.534862+0000","last_became_active":"2024-09-12T00:34:52.190174+0000","last_became_peered":"2024-09-12T00:34:52.190174+0000","last_unstale":"2024-09-12T01:00:51.534862+0000","last_undegraded":"2024-09-12T01:00:51.534862+0000","last_fullsized":"2024-09-12T01:00:51.534862+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:22.602978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'29","reported_seq":121,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:32.539090+0000","last_change":"2024-09-12T00:33:10.850390+0000","last_active":"2024-09-12T01:01:32.539090+0000","last_peered":"2024-09-12T01:01:32.539090+0000","last_clean":"2024-09-12T01:01:32.539090+0000","last_became_active":"2024-09-12T00:33:10.849658+0000","last_became_peered":"2024-09-12T00:33:10.849658+0000","last_unstale":"2024-09-12T01:01:32.539090+0000","last_undegraded":"2024-09-12T01:01:32.539090+0000","last_fullsized":"2024-09-12T01:01:32.539090+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:17.300231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":91,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.545034+0000","last_change":"2024-09-12T00:46:09.487986+0000","last_active":"2024-09-12T01:01:57.545034+0000","last_peered":"2024-09-12T01:01:57.545034+0000","last_clean":"2024-09-12T01:01:57.545034+0000","last_became_active":"2024-09-12T00:46:09.485933+0000","last_became_peered":"2024-09-12T00:46:09.485933+0000","last_unstale":"2024-09-12T01:01:57.545034+0000","last_undegraded":"2024-09-12T01:01:57.545034+0000","last_fullsized":"2024-09-12T01:01:57.545034+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:26.699689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"268'1","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.551187+0000","last_change":"2024-09-12T00:34:55.237633+0000","last_active":"2024-09-12T01:01:56.551187+0000","last_peered":"2024-09-12T01:01:56.551187+0000","last_clean":"2024-09-12T01:01:56.551187+0000","last_became_active":"2024-09-12T00:34:55.236708+0000","last_became_peered":"2024-09-12T00:34:55.236708+0000","last_unstale":"2024-09-12T01:01:56.551187+0000","last_undegraded":"2024-09-12T01:01:56.551187+0000","last_fullsized":"2024-09-12T01:01:56.551187+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:53.892191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'2","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:01.554912+0000","last_change":"2024-09-12T00:34:52.209042+0000","last_active":"2024-09-12T01:01:01.554912+0000","last_peered":"2024-09-12T01:01:01.554912+0000","last_clean":"2024-09-12T01:01:01.554912+0000","last_became_active":"2024-09-12T00:34:52.205829+0000","last_became_peered":"2024-09-12T00:34:52.205829+0000","last_unstale":"2024-09-12T01:01:01.554912+0000","last_undegraded":"2024-09-12T01:01:01.554912+0000","last_fullsized":"2024-09-12T01:01:01.554912+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:59.524499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'30","reported_seq":133,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:21.746083+0000","last_change":"2024-09-12T00:33:10.825945+0000","last_active":"2024-09-12T01:01:21.746083+0000","last_peered":"2024-09-12T01:01:21.746083+0000","last_clean":"2024-09-12T01:01:21.746083+0000","last_became_active":"2024-09-12T00:33:10.825191+0000","last_became_peered":"2024-09-12T00:33:10.825191+0000","last_unstale":"2024-09-12T01:01:21.746083+0000","last_undegraded":"2024-09-12T01:01:21.746083+0000","last_fullsized":"2024-09-12T01:01:21.746083+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:47.230850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":116,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.571862+0000","last_change":"2024-09-12T00:46:09.505717+0000","last_active":"2024-09-12T01:01:56.571862+0000","last_peered":"2024-09-12T01:01:56.571862+0000","last_clean":"2024-09-12T01:01:56.571862+0000","last_became_active":"2024-09-12T00:46:09.504789+0000","last_became_peered":"2024-09-12T00:46:09.504789+0000","last_unstale":"2024-09-12T01:01:56.571862+0000","last_undegraded":"2024-09-12T01:01:56.571862+0000","last_fullsized":"2024-09-12T01:01:56.571862+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:54.929380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'2","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.533522+0000","last_change":"2024-09-12T00:34:55.238407+0000","last_active":"2024-09-12T01:01:07.533522+0000","last_peered":"2024-09-12T01:01:07.533522+0000","last_clean":"2024-09-12T01:01:07.533522+0000","last_became_active":"2024-09-12T00:34:55.237691+0000","last_became_peered":"2024-09-12T00:34:55.237691+0000","last_unstale":"2024-09-12T01:01:07.533522+0000","last_undegraded":"2024-09-12T01:01:07.533522+0000","last_fullsized":"2024-09-12T01:01:07.533522+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:43.698302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'8","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:52.545095+0000","last_change":"2024-09-12T00:34:52.200839+0000","last_active":"2024-09-12T01:01:52.545095+0000","last_peered":"2024-09-12T01:01:52.545095+0000","last_clean":"2024-09-12T01:01:52.545095+0000","last_became_active":"2024-09-12T00:34:52.200033+0000","last_became_peered":"2024-09-12T00:34:52.200033+0000","last_unstale":"2024-09-12T01:01:52.545095+0000","last_undegraded":"2024-09-12T01:01:52.545095+0000","last_fullsized":"2024-09-12T01:01:52.545095+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:12.523538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":17410,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'38","reported_seq":149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:20.583311+0000","last_change":"2024-09-12T00:33:10.856023+0000","last_active":"2024-09-12T01:02:20.583311+0000","last_peered":"2024-09-12T01:02:20.583311+0000","last_clean":"2024-09-12T01:02:20.583311+0000","last_became_active":"2024-09-12T00:33:10.855257+0000","last_became_peered":"2024-09-12T00:33:10.855257+0000","last_unstale":"2024-09-12T01:02:20.583311+0000","last_undegraded":"2024-09-12T01:02:20.583311+0000","last_fullsized":"2024-09-12T01:02:20.583311+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:54.073580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":126,"num_write":70,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.528702+0000","last_change":"2024-09-12T00:46:09.504978+0000","last_active":"2024-09-12T01:00:47.528702+0000","last_peered":"2024-09-12T01:00:47.528702+0000","last_clean":"2024-09-12T01:00:47.528702+0000","last_became_active":"2024-09-12T00:46:09.504114+0000","last_became_peered":"2024-09-12T00:46:09.504114+0000","last_unstale":"2024-09-12T01:00:47.528702+0000","last_undegraded":"2024-09-12T01:00:47.528702+0000","last_fullsized":"2024-09-12T01:00:47.528702+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:13.348535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'2","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.575855+0000","last_change":"2024-09-12T00:34:55.235646+0000","last_active":"2024-09-12T01:02:11.575855+0000","last_peered":"2024-09-12T01:02:11.575855+0000","last_clean":"2024-09-12T01:02:11.575855+0000","last_became_active":"2024-09-12T00:34:55.234795+0000","last_became_peered":"2024-09-12T00:34:55.234795+0000","last_unstale":"2024-09-12T01:02:11.575855+0000","last_undegraded":"2024-09-12T01:02:11.575855+0000","last_fullsized":"2024-09-12T01:02:11.575855+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:10.241846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"268'6","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.545015+0000","last_change":"2024-09-12T00:34:52.199095+0000","last_active":"2024-09-12T01:01:57.545015+0000","last_peered":"2024-09-12T01:01:57.545015+0000","last_clean":"2024-09-12T01:01:57.545015+0000","last_became_active":"2024-09-12T00:34:52.198346+0000","last_became_peered":"2024-09-12T00:34:52.198346+0000","last_unstale":"2024-09-12T01:01:57.545015+0000","last_undegraded":"2024-09-12T01:01:57.545015+0000","last_fullsized":"2024-09-12T01:01:57.545015+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:09.225827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":5122,"num_write":11,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'29","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:21.563766+0000","last_change":"2024-09-12T00:33:10.848211+0000","last_active":"2024-09-12T01:01:21.563766+0000","last_peered":"2024-09-12T01:01:21.563766+0000","last_clean":"2024-09-12T01:01:21.563766+0000","last_became_active":"2024-09-12T00:33:10.847386+0000","last_became_peered":"2024-09-12T00:33:10.847386+0000","last_unstale":"2024-09-12T01:01:21.563766+0000","last_undegraded":"2024-09-12T01:01:21.563766+0000","last_fullsized":"2024-09-12T01:01:21.563766+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:03.256270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":106,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.732885+0000","last_change":"2024-09-12T00:46:09.514213+0000","last_active":"2024-09-12T01:00:47.732885+0000","last_peered":"2024-09-12T01:00:47.732885+0000","last_clean":"2024-09-12T01:00:47.732885+0000","last_became_active":"2024-09-12T00:46:09.509685+0000","last_became_peered":"2024-09-12T00:46:09.509685+0000","last_unstale":"2024-09-12T01:00:47.732885+0000","last_undegraded":"2024-09-12T01:00:47.732885+0000","last_fullsized":"2024-09-12T01:00:47.732885+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:20.031144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"268'1","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:01.573271+0000","last_change":"2024-09-12T00:34:55.251608+0000","last_active":"2024-09-12T01:02:01.573271+0000","last_peered":"2024-09-12T01:02:01.573271+0000","last_clean":"2024-09-12T01:02:01.573271+0000","last_became_active":"2024-09-12T00:34:55.251057+0000","last_became_peered":"2024-09-12T00:34:55.251057+0000","last_unstale":"2024-09-12T01:02:01.573271+0000","last_undegraded":"2024-09-12T01:02:01.573271+0000","last_fullsized":"2024-09-12T01:02:01.573271+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:44.787440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"268'5","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.720915+0000","last_change":"2024-09-12T00:34:52.178623+0000","last_active":"2024-09-12T01:01:56.720915+0000","last_peered":"2024-09-12T01:01:56.720915+0000","last_clean":"2024-09-12T01:01:56.720915+0000","last_became_active":"2024-09-12T00:34:52.177088+0000","last_became_peered":"2024-09-12T00:34:52.177088+0000","last_unstale":"2024-09-12T01:01:56.720915+0000","last_undegraded":"2024-09-12T01:01:56.720915+0000","last_fullsized":"2024-09-12T01:01:56.720915+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:51.705833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":15,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"268'21","reported_seq":103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:22.721225+0000","last_change":"2024-09-12T00:33:10.845217+0000","last_active":"2024-09-12T01:01:22.721225+0000","last_peered":"2024-09-12T01:01:22.721225+0000","last_clean":"2024-09-12T01:01:22.721225+0000","last_became_active":"2024-09-12T00:33:10.844093+0000","last_became_peered":"2024-09-12T00:33:10.844093+0000","last_unstale":"2024-09-12T01:01:22.721225+0000","last_undegraded":"2024-09-12T01:01:22.721225+0000","last_fullsized":"2024-09-12T01:01:22.721225+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:20.325448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":69,"num_write":38,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:16.556161+0000","last_change":"2024-09-12T00:46:09.498490+0000","last_active":"2024-09-12T01:02:16.556161+0000","last_peered":"2024-09-12T01:02:16.556161+0000","last_clean":"2024-09-12T01:02:16.556161+0000","last_became_active":"2024-09-12T00:46:09.497751+0000","last_became_peered":"2024-09-12T00:46:09.497751+0000","last_unstale":"2024-09-12T01:02:16.556161+0000","last_undegraded":"2024-09-12T01:02:16.556161+0000","last_fullsized":"2024-09-12T01:02:16.556161+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.301246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":36,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.531241+0000","last_change":"2024-09-12T00:34:55.254981+0000","last_active":"2024-09-12T01:00:57.531241+0000","last_peered":"2024-09-12T01:00:57.531241+0000","last_clean":"2024-09-12T01:00:57.531241+0000","last_became_active":"2024-09-12T00:34:55.254446+0000","last_became_peered":"2024-09-12T00:34:55.254446+0000","last_unstale":"2024-09-12T01:00:57.531241+0000","last_undegraded":"2024-09-12T01:00:57.531241+0000","last_fullsized":"2024-09-12T01:00:57.531241+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:32.699370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:52.734131+0000","last_change":"2024-09-12T00:34:52.194065+0000","last_active":"2024-09-12T01:00:52.734131+0000","last_peered":"2024-09-12T01:00:52.734131+0000","last_clean":"2024-09-12T01:00:52.734131+0000","last_became_active":"2024-09-12T00:34:52.193306+0000","last_became_peered":"2024-09-12T00:34:52.193306+0000","last_unstale":"2024-09-12T01:00:52.734131+0000","last_undegraded":"2024-09-12T01:00:52.734131+0000","last_fullsized":"2024-09-12T01:00:52.734131+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:42.593529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"268'36","reported_seq":152,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:32.552885+0000","last_change":"2024-09-12T00:33:10.860393+0000","last_active":"2024-09-12T01:02:32.552885+0000","last_peered":"2024-09-12T01:02:32.552885+0000","last_clean":"2024-09-12T01:02:32.552885+0000","last_became_active":"2024-09-12T00:33:10.859799+0000","last_became_peered":"2024-09-12T00:33:10.859799+0000","last_unstale":"2024-09-12T01:02:32.552885+0000","last_undegraded":"2024-09-12T01:02:32.552885+0000","last_fullsized":"2024-09-12T01:02:32.552885+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:39.916797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":137,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.529751+0000","last_change":"2024-09-12T00:46:09.499691+0000","last_active":"2024-09-12T01:00:47.529751+0000","last_peered":"2024-09-12T01:00:47.529751+0000","last_clean":"2024-09-12T01:00:47.529751+0000","last_became_active":"2024-09-12T00:46:09.498942+0000","last_became_peered":"2024-09-12T00:46:09.498942+0000","last_unstale":"2024-09-12T01:00:47.529751+0000","last_undegraded":"2024-09-12T01:00:47.529751+0000","last_fullsized":"2024-09-12T01:00:47.529751+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:21.881186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'1","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.532379+0000","last_change":"2024-09-12T00:34:55.215046+0000","last_active":"2024-09-12T01:00:57.532379+0000","last_peered":"2024-09-12T01:00:57.532379+0000","last_clean":"2024-09-12T01:00:57.532379+0000","last_became_active":"2024-09-12T00:34:55.214265+0000","last_became_peered":"2024-09-12T00:34:55.214265+0000","last_unstale":"2024-09-12T01:00:57.532379+0000","last_undegraded":"2024-09-12T01:00:57.532379+0000","last_fullsized":"2024-09-12T01:00:57.532379+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:54.580385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"268'6","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:52.530010+0000","last_change":"2024-09-12T00:34:52.204774+0000","last_active":"2024-09-12T01:00:52.530010+0000","last_peered":"2024-09-12T01:00:52.530010+0000","last_clean":"2024-09-12T01:00:52.530010+0000","last_became_active":"2024-09-12T00:34:52.204050+0000","last_became_peered":"2024-09-12T00:34:52.204050+0000","last_unstale":"2024-09-12T01:00:52.530010+0000","last_undegraded":"2024-09-12T01:00:52.530010+0000","last_fullsized":"2024-09-12T01:00:52.530010+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:46.767075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'20","reported_seq":104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.557497+0000","last_change":"2024-09-12T00:33:10.842211+0000","last_active":"2024-09-12T01:02:21.557497+0000","last_peered":"2024-09-12T01:02:21.557497+0000","last_clean":"2024-09-12T01:02:21.557497+0000","last_became_active":"2024-09-12T00:33:10.841411+0000","last_became_peered":"2024-09-12T00:33:10.841411+0000","last_unstale":"2024-09-12T01:02:21.557497+0000","last_undegraded":"2024-09-12T01:02:21.557497+0000","last_fullsized":"2024-09-12T01:02:21.557497+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:13.664749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":70,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"267'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:21.713593+0000","last_change":"2024-09-12T00:46:09.520640+0000","last_active":"2024-09-12T01:01:21.713593+0000","last_peered":"2024-09-12T01:01:21.713593+0000","last_clean":"2024-09-12T01:01:21.713593+0000","last_became_active":"2024-09-12T00:46:09.520251+0000","last_became_peered":"2024-09-12T00:46:09.520251+0000","last_unstale":"2024-09-12T01:01:21.713593+0000","last_undegraded":"2024-09-12T01:01:21.713593+0000","last_fullsized":"2024-09-12T01:01:21.713593+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:17.060682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"268'4","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:01.552378+0000","last_change":"2024-09-12T00:34:55.232689+0000","last_active":"2024-09-12T01:02:01.552378+0000","last_peered":"2024-09-12T01:02:01.552378+0000","last_clean":"2024-09-12T01:02:01.552378+0000","last_became_active":"2024-09-12T00:34:55.230698+0000","last_became_peered":"2024-09-12T00:34:55.230698+0000","last_unstale":"2024-09-12T01:02:01.552378+0000","last_undegraded":"2024-09-12T01:02:01.552378+0000","last_fullsized":"2024-09-12T01:02:01.552378+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:43.460598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"265'5","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.532248+0000","last_change":"2024-09-12T00:34:52.212267+0000","last_active":"2024-09-12T01:01:02.532248+0000","last_peered":"2024-09-12T01:01:02.532248+0000","last_clean":"2024-09-12T01:01:02.532248+0000","last_became_active":"2024-09-12T00:34:52.211709+0000","last_became_peered":"2024-09-12T00:34:52.211709+0000","last_unstale":"2024-09-12T01:01:02.532248+0000","last_undegraded":"2024-09-12T01:01:02.532248+0000","last_fullsized":"2024-09-12T01:01:02.532248+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:37.180708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'225","reported_seq":751,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:22.754603+0000","last_change":"2024-09-12T00:33:10.853482+0000","last_active":"2024-09-12T01:02:22.754603+0000","last_peered":"2024-09-12T01:02:22.754603+0000","last_clean":"2024-09-12T01:02:22.754603+0000","last_became_active":"2024-09-12T00:33:10.852751+0000","last_became_peered":"2024-09-12T00:33:10.852751+0000","last_unstale":"2024-09-12T01:02:22.754603+0000","last_undegraded":"2024-09-12T01:02:22.754603+0000","last_fullsized":"2024-09-12T01:02:22.754603+0000","mapping_epoch":255,"log_start":"265'200","ondisk_log_start":"265'200","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:29.381396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1385,"num_read_kb":1074,"num_write":267,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:21.563715+0000","last_change":"2024-09-12T00:46:09.516940+0000","last_active":"2024-09-12T01:01:21.563715+0000","last_peered":"2024-09-12T01:01:21.563715+0000","last_clean":"2024-09-12T01:01:21.563715+0000","last_became_active":"2024-09-12T00:46:09.516404+0000","last_became_peered":"2024-09-12T00:46:09.516404+0000","last_unstale":"2024-09-12T01:01:21.563715+0000","last_undegraded":"2024-09-12T01:01:21.563715+0000","last_fullsized":"2024-09-12T01:01:21.563715+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:40.623194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"268'5","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.735055+0000","last_change":"2024-09-12T00:34:55.236475+0000","last_active":"2024-09-12T01:00:57.735055+0000","last_peered":"2024-09-12T01:00:57.735055+0000","last_clean":"2024-09-12T01:00:57.735055+0000","last_became_active":"2024-09-12T00:34:55.235522+0000","last_became_peered":"2024-09-12T00:34:55.235522+0000","last_unstale":"2024-09-12T01:00:57.735055+0000","last_undegraded":"2024-09-12T01:00:57.735055+0000","last_fullsized":"2024-09-12T01:00:57.735055+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:26.945052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":5,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"268'5","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.544918+0000","last_change":"2024-09-12T00:34:52.184510+0000","last_active":"2024-09-12T01:01:57.544918+0000","last_peered":"2024-09-12T01:01:57.544918+0000","last_clean":"2024-09-12T01:01:57.544918+0000","last_became_active":"2024-09-12T00:34:52.183769+0000","last_became_peered":"2024-09-12T00:34:52.183769+0000","last_unstale":"2024-09-12T01:01:57.544918+0000","last_undegraded":"2024-09-12T01:01:57.544918+0000","last_fullsized":"2024-09-12T01:01:57.544918+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:59.439643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8194,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'27","reported_seq":122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:22.554180+0000","last_change":"2024-09-12T00:33:10.831668+0000","last_active":"2024-09-12T01:02:22.554180+0000","last_peered":"2024-09-12T01:02:22.554180+0000","last_clean":"2024-09-12T01:02:22.554180+0000","last_became_active":"2024-09-12T00:33:10.830931+0000","last_became_peered":"2024-09-12T00:33:10.830931+0000","last_unstale":"2024-09-12T01:02:22.554180+0000","last_undegraded":"2024-09-12T01:02:22.554180+0000","last_fullsized":"2024-09-12T01:02:22.554180+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:45.604877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":90,"num_write":55,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:46.551264+0000","last_change":"2024-09-12T00:46:09.518153+0000","last_active":"2024-09-12T01:00:46.551264+0000","last_peered":"2024-09-12T01:00:46.551264+0000","last_clean":"2024-09-12T01:00:46.551264+0000","last_became_active":"2024-09-12T00:46:09.517353+0000","last_became_peered":"2024-09-12T00:46:09.517353+0000","last_unstale":"2024-09-12T01:00:46.551264+0000","last_undegraded":"2024-09-12T01:00:46.551264+0000","last_fullsized":"2024-09-12T01:00:46.551264+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:41.256919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"268'8","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.729350+0000","last_change":"2024-09-12T00:34:55.225406+0000","last_active":"2024-09-12T01:02:02.729350+0000","last_peered":"2024-09-12T01:02:02.729350+0000","last_clean":"2024-09-12T01:02:02.729350+0000","last_became_active":"2024-09-12T00:34:55.224353+0000","last_became_peered":"2024-09-12T00:34:55.224353+0000","last_unstale":"2024-09-12T01:02:02.729350+0000","last_undegraded":"2024-09-12T01:02:02.729350+0000","last_fullsized":"2024-09-12T01:02:02.729350+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:35.525207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":22530,"num_write":13,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"268'3","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.551132+0000","last_change":"2024-09-12T00:34:52.204414+0000","last_active":"2024-09-12T01:01:56.551132+0000","last_peered":"2024-09-12T01:01:56.551132+0000","last_clean":"2024-09-12T01:01:56.551132+0000","last_became_active":"2024-09-12T00:34:52.203625+0000","last_became_peered":"2024-09-12T00:34:52.203625+0000","last_unstale":"2024-09-12T01:01:56.551132+0000","last_undegraded":"2024-09-12T01:01:56.551132+0000","last_fullsized":"2024-09-12T01:01:56.551132+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:35.762002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5303249,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":10299,"num_write":3,"num_write_kb":5179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'24","reported_seq":111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:22.733835+0000","last_change":"2024-09-12T00:33:10.845131+0000","last_active":"2024-09-12T01:02:22.733835+0000","last_peered":"2024-09-12T01:02:22.733835+0000","last_clean":"2024-09-12T01:02:22.733835+0000","last_became_active":"2024-09-12T00:33:10.844416+0000","last_became_peered":"2024-09-12T00:33:10.844416+0000","last_unstale":"2024-09-12T01:02:22.733835+0000","last_undegraded":"2024-09-12T01:02:22.733835+0000","last_fullsized":"2024-09-12T01:02:22.733835+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:44.761181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:52.529941+0000","last_change":"2024-09-12T00:46:09.494534+0000","last_active":"2024-09-12T01:00:52.529941+0000","last_peered":"2024-09-12T01:00:52.529941+0000","last_clean":"2024-09-12T01:00:52.529941+0000","last_became_active":"2024-09-12T00:46:09.493808+0000","last_became_peered":"2024-09-12T00:46:09.493808+0000","last_unstale":"2024-09-12T01:00:52.529941+0000","last_undegraded":"2024-09-12T01:00:52.529941+0000","last_fullsized":"2024-09-12T01:00:52.529941+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:01.945866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"268'1","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.547434+0000","last_change":"2024-09-12T00:34:55.234328+0000","last_active":"2024-09-12T01:02:02.547434+0000","last_peered":"2024-09-12T01:02:02.547434+0000","last_clean":"2024-09-12T01:02:02.547434+0000","last_became_active":"2024-09-12T00:34:55.233708+0000","last_became_peered":"2024-09-12T00:34:55.233708+0000","last_unstale":"2024-09-12T01:02:02.547434+0000","last_undegraded":"2024-09-12T01:02:02.547434+0000","last_fullsized":"2024-09-12T01:02:02.547434+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:10.278114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"268'1","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.728291+0000","last_change":"2024-09-12T00:34:52.188218+0000","last_active":"2024-09-12T01:01:57.728291+0000","last_peered":"2024-09-12T01:01:57.728291+0000","last_clean":"2024-09-12T01:01:57.728291+0000","last_became_active":"2024-09-12T00:34:52.186234+0000","last_became_peered":"2024-09-12T00:34:52.186234+0000","last_unstale":"2024-09-12T01:01:57.728291+0000","last_undegraded":"2024-09-12T01:01:57.728291+0000","last_fullsized":"2024-09-12T01:01:57.728291+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:37.401626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'27","reported_seq":126,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:22.536821+0000","last_change":"2024-09-12T00:33:10.853895+0000","last_active":"2024-09-12T01:01:22.536821+0000","last_peered":"2024-09-12T01:01:22.536821+0000","last_clean":"2024-09-12T01:01:22.536821+0000","last_became_active":"2024-09-12T00:33:10.853205+0000","last_became_peered":"2024-09-12T00:33:10.853205+0000","last_unstale":"2024-09-12T01:01:22.536821+0000","last_undegraded":"2024-09-12T01:01:22.536821+0000","last_fullsized":"2024-09-12T01:01:22.536821+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:11.434006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":100,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'301","reported_seq":948,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.658623+0000","last_change":"2024-09-12T00:18:22.882778+0000","last_active":"2024-09-12T01:02:57.658623+0000","last_peered":"2024-09-12T01:02:57.658623+0000","last_clean":"2024-09-12T01:02:57.658623+0000","last_became_active":"2024-09-12T00:18:22.878117+0000","last_became_peered":"2024-09-12T00:18:22.878117+0000","last_unstale":"2024-09-12T01:02:57.658623+0000","last_undegraded":"2024-09-12T01:02:57.658623+0000","last_fullsized":"2024-09-12T01:02:57.658623+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:42.771146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11589007,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":460,"num_read_kb":62532,"num_write":1140,"num_write_kb":43415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'436","reported_seq":1878,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.826302+0000","last_change":"2024-09-12T00:18:24.871900+0000","last_active":"2024-09-12T01:04:30.826302+0000","last_peered":"2024-09-12T01:04:30.826302+0000","last_clean":"2024-09-12T01:04:30.826302+0000","last_became_active":"2024-09-12T00:18:24.870370+0000","last_became_peered":"2024-09-12T00:18:24.870370+0000","last_unstale":"2024-09-12T01:04:30.826302+0000","last_undegraded":"2024-09-12T01:04:30.826302+0000","last_fullsized":"2024-09-12T01:04:30.826302+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:30.348388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2205,"num_read_kb":2060,"num_write":503,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'274","reported_seq":919,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:26.407073+0000","last_change":"2024-09-12T00:18:22.845696+0000","last_active":"2024-09-12T01:04:26.407073+0000","last_peered":"2024-09-12T01:04:26.407073+0000","last_clean":"2024-09-12T01:04:26.407073+0000","last_became_active":"2024-09-12T00:18:22.845439+0000","last_became_peered":"2024-09-12T00:18:22.845439+0000","last_unstale":"2024-09-12T01:04:26.407073+0000","last_undegraded":"2024-09-12T01:04:26.407073+0000","last_fullsized":"2024-09-12T01:04:26.407073+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:58.019520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11065218,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":421,"num_read_kb":5684,"num_write":947,"num_write_kb":33510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'1348","reported_seq":3035,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.828330+0000","last_change":"2024-09-12T00:18:24.872059+0000","last_active":"2024-09-12T01:04:30.828330+0000","last_peered":"2024-09-12T01:04:30.828330+0000","last_clean":"2024-09-12T01:04:30.828330+0000","last_became_active":"2024-09-12T00:18:24.866026+0000","last_became_peered":"2024-09-12T00:18:24.866026+0000","last_unstale":"2024-09-12T01:04:30.828330+0000","last_undegraded":"2024-09-12T01:04:30.828330+0000","last_fullsized":"2024-09-12T01:04:30.828330+0000","mapping_epoch":26,"log_start":"268'1300","ondisk_log_start":"268'1300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":1300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:28.162969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6196,"num_read_kb":5451,"num_write":1895,"num_write_kb":802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'280","reported_seq":969,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.555954+0000","last_change":"2024-09-12T00:18:22.839649+0000","last_active":"2024-09-12T01:02:49.555954+0000","last_peered":"2024-09-12T01:02:49.555954+0000","last_clean":"2024-09-12T01:02:49.555954+0000","last_became_active":"2024-09-12T00:18:22.839379+0000","last_became_peered":"2024-09-12T00:18:22.839379+0000","last_unstale":"2024-09-12T01:02:49.555954+0000","last_undegraded":"2024-09-12T01:02:49.555954+0000","last_fullsized":"2024-09-12T01:02:49.555954+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:58.587843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1925566,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":510,"num_read_kb":68999,"num_write":1025,"num_write_kb":32744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'868","reported_seq":2673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.884045+0000","last_change":"2024-09-12T00:18:24.861905+0000","last_active":"2024-09-12T01:03:25.884045+0000","last_peered":"2024-09-12T01:03:25.884045+0000","last_clean":"2024-09-12T01:03:25.884045+0000","last_became_active":"2024-09-12T00:18:24.860995+0000","last_became_peered":"2024-09-12T00:18:24.860995+0000","last_unstale":"2024-09-12T01:03:25.884045+0000","last_undegraded":"2024-09-12T01:03:25.884045+0000","last_fullsized":"2024-09-12T01:03:25.884045+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:40.241884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4298,"num_read_kb":3905,"num_write":1128,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'273","reported_seq":930,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.349468+0000","last_change":"2024-09-12T00:18:55.961308+0000","last_active":"2024-09-12T01:02:46.349468+0000","last_peered":"2024-09-12T01:02:46.349468+0000","last_clean":"2024-09-12T01:02:46.349468+0000","last_became_active":"2024-09-12T00:18:55.960413+0000","last_became_peered":"2024-09-12T00:18:55.960413+0000","last_unstale":"2024-09-12T01:02:46.349468+0000","last_undegraded":"2024-09-12T01:02:46.349468+0000","last_fullsized":"2024-09-12T01:02:46.349468+0000","mapping_epoch":37,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:23.952063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5101376,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":426,"num_read_kb":54974,"num_write":1014,"num_write_kb":32836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'765","reported_seq":2314,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.594303+0000","last_change":"2024-09-12T00:18:55.956119+0000","last_active":"2024-09-12T01:03:26.594303+0000","last_peered":"2024-09-12T01:03:26.594303+0000","last_clean":"2024-09-12T01:03:26.594303+0000","last_became_active":"2024-09-12T00:18:55.955870+0000","last_became_peered":"2024-09-12T00:18:55.955870+0000","last_unstale":"2024-09-12T01:03:26.594303+0000","last_undegraded":"2024-09-12T01:03:26.594303+0000","last_fullsized":"2024-09-12T01:03:26.594303+0000","mapping_epoch":37,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:06.351457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3626,"num_read_kb":3280,"num_write":1010,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'287","reported_seq":916,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.084946+0000","last_change":"2024-09-12T00:18:22.878663+0000","last_active":"2024-09-12T01:02:51.084946+0000","last_peered":"2024-09-12T01:02:51.084946+0000","last_clean":"2024-09-12T01:02:51.084946+0000","last_became_active":"2024-09-12T00:18:22.870564+0000","last_became_peered":"2024-09-12T00:18:22.870564+0000","last_unstale":"2024-09-12T01:02:51.084946+0000","last_undegraded":"2024-09-12T01:02:51.084946+0000","last_fullsized":"2024-09-12T01:02:51.084946+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:54.849057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9915971,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":448,"num_read_kb":32133,"num_write":990,"num_write_kb":41090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"268'482","reported_seq":2083,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.841743+0000","last_change":"2024-09-12T00:18:24.847333+0000","last_active":"2024-09-12T01:04:30.841743+0000","last_peered":"2024-09-12T01:04:30.841743+0000","last_clean":"2024-09-12T01:04:30.841743+0000","last_became_active":"2024-09-12T00:18:24.846508+0000","last_became_peered":"2024-09-12T00:18:24.846508+0000","last_unstale":"2024-09-12T01:04:30.841743+0000","last_undegraded":"2024-09-12T01:04:30.841743+0000","last_fullsized":"2024-09-12T01:04:30.841743+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:28.677103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2844,"num_read_kb":2655,"num_write":659,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'287","reported_seq":922,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.582459+0000","last_change":"2024-09-12T00:18:22.862931+0000","last_active":"2024-09-12T01:03:02.582459+0000","last_peered":"2024-09-12T01:03:02.582459+0000","last_clean":"2024-09-12T01:03:02.582459+0000","last_became_active":"2024-09-12T00:18:22.861074+0000","last_became_peered":"2024-09-12T00:18:22.861074+0000","last_unstale":"2024-09-12T01:03:02.582459+0000","last_undegraded":"2024-09-12T01:03:02.582459+0000","last_fullsized":"2024-09-12T01:03:02.582459+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:03.827376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704504,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":479,"num_read_kb":4860,"num_write":1022,"num_write_kb":10925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'1019","reported_seq":2748,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.884432+0000","last_change":"2024-09-12T00:18:24.878012+0000","last_active":"2024-09-12T01:03:25.884432+0000","last_peered":"2024-09-12T01:03:25.884432+0000","last_clean":"2024-09-12T01:03:25.884432+0000","last_became_active":"2024-09-12T00:18:24.875913+0000","last_became_peered":"2024-09-12T00:18:24.875913+0000","last_unstale":"2024-09-12T01:03:25.884432+0000","last_undegraded":"2024-09-12T01:03:25.884432+0000","last_fullsized":"2024-09-12T01:03:25.884432+0000","mapping_epoch":26,"log_start":"268'1000","ondisk_log_start":"268'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":1000,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:16.720932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4809,"num_read_kb":4259,"num_write":1397,"num_write_kb":538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'235","reported_seq":821,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:05.474842+0000","last_change":"2024-09-12T00:19:56.413205+0000","last_active":"2024-09-12T01:01:05.474842+0000","last_peered":"2024-09-12T01:01:05.474842+0000","last_clean":"2024-09-12T01:01:05.474842+0000","last_became_active":"2024-09-12T00:19:56.412792+0000","last_became_peered":"2024-09-12T00:19:56.412792+0000","last_unstale":"2024-09-12T01:01:05.474842+0000","last_undegraded":"2024-09-12T01:01:05.474842+0000","last_fullsized":"2024-09-12T01:01:05.474842+0000","mapping_epoch":39,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:43.504414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16348253,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":352,"num_read_kb":40979,"num_write":922,"num_write_kb":28776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"268'464","reported_seq":2043,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.191451+0000","last_change":"2024-09-12T00:18:24.862828+0000","last_active":"2024-09-12T01:03:11.191451+0000","last_peered":"2024-09-12T01:03:11.191451+0000","last_clean":"2024-09-12T01:03:11.191451+0000","last_became_active":"2024-09-12T00:18:24.862084+0000","last_became_peered":"2024-09-12T00:18:24.862084+0000","last_unstale":"2024-09-12T01:03:11.191451+0000","last_undegraded":"2024-09-12T01:03:11.191451+0000","last_fullsized":"2024-09-12T01:03:11.191451+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:22.898376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2471,"num_read_kb":2327,"num_write":538,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'300","reported_seq":947,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:17.852530+0000","last_change":"2024-09-12T00:18:22.867992+0000","last_active":"2024-09-12T01:02:17.852530+0000","last_peered":"2024-09-12T01:02:17.852530+0000","last_clean":"2024-09-12T01:02:17.852530+0000","last_became_active":"2024-09-12T00:18:22.867749+0000","last_became_peered":"2024-09-12T00:18:22.867749+0000","last_unstale":"2024-09-12T01:02:17.852530+0000","last_undegraded":"2024-09-12T01:02:17.852530+0000","last_fullsized":"2024-09-12T01:02:17.852530+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:43.955119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11592589,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":459,"num_read_kb":6849,"num_write":1135,"num_write_kb":38257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'505","reported_seq":2322,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.741434+0000","last_change":"2024-09-12T00:18:24.848517+0000","last_active":"2024-09-12T01:03:06.741434+0000","last_peered":"2024-09-12T01:03:06.741434+0000","last_clean":"2024-09-12T01:03:06.741434+0000","last_became_active":"2024-09-12T00:18:24.848163+0000","last_became_peered":"2024-09-12T00:18:24.848163+0000","last_unstale":"2024-09-12T01:03:06.741434+0000","last_undegraded":"2024-09-12T01:03:06.741434+0000","last_fullsized":"2024-09-12T01:03:06.741434+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:12.252460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2972,"num_read_kb":2819,"num_write":593,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'484","reported_seq":2139,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.426992+0000","last_change":"2024-09-12T00:18:24.861887+0000","last_active":"2024-09-12T01:03:09.426992+0000","last_peered":"2024-09-12T01:03:09.426992+0000","last_clean":"2024-09-12T01:03:09.426992+0000","last_became_active":"2024-09-12T00:18:24.860744+0000","last_became_peered":"2024-09-12T00:18:24.860744+0000","last_unstale":"2024-09-12T01:03:09.426992+0000","last_undegraded":"2024-09-12T01:03:09.426992+0000","last_fullsized":"2024-09-12T01:03:09.426992+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:47.298360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2780,"num_read_kb":2600,"num_write":590,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'252","reported_seq":857,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.546217+0000","last_change":"2024-09-12T00:18:55.963205+0000","last_active":"2024-09-12T01:02:02.546217+0000","last_peered":"2024-09-12T01:02:02.546217+0000","last_clean":"2024-09-12T01:02:02.546217+0000","last_became_active":"2024-09-12T00:18:55.962742+0000","last_became_peered":"2024-09-12T00:18:55.962742+0000","last_unstale":"2024-09-12T01:02:02.546217+0000","last_undegraded":"2024-09-12T01:02:02.546217+0000","last_fullsized":"2024-09-12T01:02:02.546217+0000","mapping_epoch":37,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:05.336107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19072504,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":335,"num_read_kb":39262,"num_write":879,"num_write_kb":33071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'395","reported_seq":1848,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.099361+0000","last_change":"2024-09-12T00:18:24.873912+0000","last_active":"2024-09-12T01:03:25.099361+0000","last_peered":"2024-09-12T01:03:25.099361+0000","last_clean":"2024-09-12T01:03:25.099361+0000","last_became_active":"2024-09-12T00:18:24.872902+0000","last_became_peered":"2024-09-12T00:18:24.872902+0000","last_unstale":"2024-09-12T01:03:25.099361+0000","last_undegraded":"2024-09-12T01:03:25.099361+0000","last_fullsized":"2024-09-12T01:03:25.099361+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:21.474486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2097,"num_read_kb":1984,"num_write":437,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'239","reported_seq":850,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.898205+0000","last_change":"2024-09-12T00:18:22.864186+0000","last_active":"2024-09-12T01:03:21.898205+0000","last_peered":"2024-09-12T01:03:21.898205+0000","last_clean":"2024-09-12T01:03:21.898205+0000","last_became_active":"2024-09-12T00:18:22.860078+0000","last_became_peered":"2024-09-12T00:18:22.860078+0000","last_unstale":"2024-09-12T01:03:21.898205+0000","last_undegraded":"2024-09-12T01:03:21.898205+0000","last_fullsized":"2024-09-12T01:03:21.898205+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:36.759909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13972538,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":347,"num_read_kb":38650,"num_write":881,"num_write_kb":29439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"268'420","reported_seq":2039,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.347017+0000","last_change":"2024-09-12T00:18:24.852828+0000","last_active":"2024-09-12T01:03:37.347017+0000","last_peered":"2024-09-12T01:03:37.347017+0000","last_clean":"2024-09-12T01:03:37.347017+0000","last_became_active":"2024-09-12T00:18:24.852029+0000","last_became_peered":"2024-09-12T00:18:24.852029+0000","last_unstale":"2024-09-12T01:03:37.347017+0000","last_undegraded":"2024-09-12T01:03:37.347017+0000","last_fullsized":"2024-09-12T01:03:37.347017+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:43.017405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2334,"num_read_kb":2233,"num_write":466,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'243","reported_seq":845,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.538010+0000","last_change":"2024-09-12T00:18:22.863392+0000","last_active":"2024-09-12T01:02:02.538010+0000","last_peered":"2024-09-12T01:02:02.538010+0000","last_clean":"2024-09-12T01:02:02.538010+0000","last_became_active":"2024-09-12T00:18:22.862665+0000","last_became_peered":"2024-09-12T00:18:22.862665+0000","last_unstale":"2024-09-12T01:02:02.538010+0000","last_undegraded":"2024-09-12T01:02:02.538010+0000","last_fullsized":"2024-09-12T01:02:02.538010+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:02.077750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8421745,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":327,"num_read_kb":22932,"num_write":871,"num_write_kb":21492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'474","reported_seq":2097,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.094302+0000","last_change":"2024-09-12T00:18:24.850211+0000","last_active":"2024-09-12T01:03:04.094302+0000","last_peered":"2024-09-12T01:03:04.094302+0000","last_clean":"2024-09-12T01:03:04.094302+0000","last_became_active":"2024-09-12T00:18:24.849491+0000","last_became_peered":"2024-09-12T00:18:24.849491+0000","last_unstale":"2024-09-12T01:03:04.094302+0000","last_undegraded":"2024-09-12T01:03:04.094302+0000","last_fullsized":"2024-09-12T01:03:04.094302+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:35.044376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2579,"num_read_kb":2421,"num_write":543,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'273","reported_seq":898,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:40.430540+0000","last_change":"2024-09-12T00:18:22.857585+0000","last_active":"2024-09-12T01:02:40.430540+0000","last_peered":"2024-09-12T01:02:40.430540+0000","last_clean":"2024-09-12T01:02:40.430540+0000","last_became_active":"2024-09-12T00:18:22.856051+0000","last_became_peered":"2024-09-12T00:18:22.856051+0000","last_unstale":"2024-09-12T01:02:40.430540+0000","last_undegraded":"2024-09-12T01:02:40.430540+0000","last_fullsized":"2024-09-12T01:02:40.430540+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:50.867035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5601827,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":382,"num_read_kb":24886,"num_write":993,"num_write_kb":15091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"268'428","reported_seq":1974,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.171993+0000","last_change":"2024-09-12T00:18:24.854571+0000","last_active":"2024-09-12T01:02:58.171993+0000","last_peered":"2024-09-12T01:02:58.171993+0000","last_clean":"2024-09-12T01:02:58.171993+0000","last_became_active":"2024-09-12T00:18:24.853796+0000","last_became_peered":"2024-09-12T00:18:24.853796+0000","last_unstale":"2024-09-12T01:02:58.171993+0000","last_undegraded":"2024-09-12T01:02:58.171993+0000","last_fullsized":"2024-09-12T01:02:58.171993+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:33.514455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2472,"num_read_kb":2322,"num_write":521,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'270","reported_seq":1023,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.724364+0000","last_change":"2024-09-12T00:18:22.838428+0000","last_active":"2024-09-12T01:02:58.724364+0000","last_peered":"2024-09-12T01:02:58.724364+0000","last_clean":"2024-09-12T01:02:58.724364+0000","last_became_active":"2024-09-12T00:18:22.834904+0000","last_became_peered":"2024-09-12T00:18:22.834904+0000","last_unstale":"2024-09-12T01:02:58.724364+0000","last_undegraded":"2024-09-12T01:02:58.724364+0000","last_fullsized":"2024-09-12T01:02:58.724364+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:19.289534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12614868,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":531,"num_read_kb":49706,"num_write":1001,"num_write_kb":43110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'502","reported_seq":2049,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.347103+0000","last_change":"2024-09-12T00:18:24.876805+0000","last_active":"2024-09-12T01:03:37.347103+0000","last_peered":"2024-09-12T01:03:37.347103+0000","last_clean":"2024-09-12T01:03:37.347103+0000","last_became_active":"2024-09-12T00:18:24.875112+0000","last_became_peered":"2024-09-12T00:18:24.875112+0000","last_unstale":"2024-09-12T01:03:37.347103+0000","last_undegraded":"2024-09-12T01:03:37.347103+0000","last_fullsized":"2024-09-12T01:03:37.347103+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:20.839260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2595,"num_read_kb":2402,"num_write":619,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'318","reported_seq":1008,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.381620+0000","last_change":"2024-09-12T00:18:22.841353+0000","last_active":"2024-09-12T01:01:07.381620+0000","last_peered":"2024-09-12T01:01:07.381620+0000","last_clean":"2024-09-12T01:01:07.381620+0000","last_became_active":"2024-09-12T00:18:22.841069+0000","last_became_peered":"2024-09-12T00:18:22.841069+0000","last_unstale":"2024-09-12T01:01:07.381620+0000","last_undegraded":"2024-09-12T01:01:07.381620+0000","last_fullsized":"2024-09-12T01:01:07.381620+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:51.842199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8420162,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":628,"num_read_kb":23761,"num_write":1226,"num_write_kb":30294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'127","reported_seq":651,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.974481+0000","last_change":"2024-09-12T00:18:32.894030+0000","last_active":"2024-09-12T01:03:25.974481+0000","last_peered":"2024-09-12T01:03:25.974481+0000","last_clean":"2024-09-12T01:03:25.974481+0000","last_became_active":"2024-09-12T00:18:32.893410+0000","last_became_peered":"2024-09-12T00:18:32.893410+0000","last_unstale":"2024-09-12T01:03:25.974481+0000","last_undegraded":"2024-09-12T01:03:25.974481+0000","last_fullsized":"2024-09-12T01:03:25.974481+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:21.781324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":200,"num_read_kb":180,"num_write":310,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'427","reported_seq":2029,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.883962+0000","last_change":"2024-09-12T00:18:24.863390+0000","last_active":"2024-09-12T01:03:25.883962+0000","last_peered":"2024-09-12T01:03:25.883962+0000","last_clean":"2024-09-12T01:03:25.883962+0000","last_became_active":"2024-09-12T00:18:24.862963+0000","last_became_peered":"2024-09-12T00:18:24.862963+0000","last_unstale":"2024-09-12T01:03:25.883962+0000","last_undegraded":"2024-09-12T01:03:25.883962+0000","last_fullsized":"2024-09-12T01:03:25.883962+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:47.762563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2444,"num_read_kb":2313,"num_write":504,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"268'279","reported_seq":923,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:22.373926+0000","last_change":"2024-09-12T00:18:55.955847+0000","last_active":"2024-09-12T01:02:22.373926+0000","last_peered":"2024-09-12T01:02:22.373926+0000","last_clean":"2024-09-12T01:02:22.373926+0000","last_became_active":"2024-09-12T00:18:55.954978+0000","last_became_peered":"2024-09-12T00:18:55.954978+0000","last_unstale":"2024-09-12T01:02:22.373926+0000","last_undegraded":"2024-09-12T01:02:22.373926+0000","last_fullsized":"2024-09-12T01:02:22.373926+0000","mapping_epoch":37,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:00.249837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4250562,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":428,"num_read_kb":26304,"num_write":1033,"num_write_kb":30933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.749399+0000","last_change":"2024-09-12T00:18:26.872530+0000","last_active":"2024-09-12T01:01:57.749399+0000","last_peered":"2024-09-12T01:01:57.749399+0000","last_clean":"2024-09-12T01:01:57.749399+0000","last_became_active":"2024-09-12T00:18:26.871803+0000","last_became_peered":"2024-09-12T00:18:26.871803+0000","last_unstale":"2024-09-12T01:01:57.749399+0000","last_undegraded":"2024-09-12T01:01:57.749399+0000","last_fullsized":"2024-09-12T01:01:57.749399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:22.818539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'336","reported_seq":948,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:26.605376+0000","last_change":"2024-09-12T00:18:28.875623+0000","last_active":"2024-09-12T01:04:26.605376+0000","last_peered":"2024-09-12T01:04:26.605376+0000","last_clean":"2024-09-12T01:04:26.605376+0000","last_became_active":"2024-09-12T00:18:28.874861+0000","last_became_peered":"2024-09-12T00:18:28.874861+0000","last_unstale":"2024-09-12T01:04:26.605376+0000","last_undegraded":"2024-09-12T01:04:26.605376+0000","last_fullsized":"2024-09-12T01:04:26.605376+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:25.073806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58756,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":540,"num_read_kb":1030,"num_write":430,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.546262+0000","last_change":"2024-09-12T00:18:30.894626+0000","last_active":"2024-09-12T01:02:02.546262+0000","last_peered":"2024-09-12T01:02:02.546262+0000","last_clean":"2024-09-12T01:02:02.546262+0000","last_became_active":"2024-09-12T00:18:30.893886+0000","last_became_peered":"2024-09-12T00:18:30.893886+0000","last_unstale":"2024-09-12T01:02:02.546262+0000","last_undegraded":"2024-09-12T01:02:02.546262+0000","last_fullsized":"2024-09-12T01:02:02.546262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:00.518894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'2426","reported_seq":4321,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.416183+0000","last_change":"2024-09-12T00:18:32.899968+0000","last_active":"2024-09-12T01:03:37.416183+0000","last_peered":"2024-09-12T01:03:37.416183+0000","last_clean":"2024-09-12T01:03:37.416183+0000","last_became_active":"2024-09-12T00:18:32.899168+0000","last_became_peered":"2024-09-12T00:18:32.899168+0000","last_unstale":"2024-09-12T01:03:37.416183+0000","last_undegraded":"2024-09-12T01:03:37.416183+0000","last_fullsized":"2024-09-12T01:03:37.416183+0000","mapping_epoch":34,"log_start":"268'2400","ondisk_log_start":"268'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":2400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:13.149755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6111,"num_read_kb":6108,"num_write":4843,"num_write_kb":1788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'1288","reported_seq":2834,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.884108+0000","last_change":"2024-09-12T00:18:24.870986+0000","last_active":"2024-09-12T01:03:25.884108+0000","last_peered":"2024-09-12T01:03:25.884108+0000","last_clean":"2024-09-12T01:03:25.884108+0000","last_became_active":"2024-09-12T00:18:24.869219+0000","last_became_peered":"2024-09-12T00:18:24.869219+0000","last_unstale":"2024-09-12T01:03:25.884108+0000","last_undegraded":"2024-09-12T01:03:25.884108+0000","last_fullsized":"2024-09-12T01:03:25.884108+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":1200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:32.390226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5815,"num_read_kb":5070,"num_write":1809,"num_write_kb":816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'214","reported_seq":783,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:08.179631+0000","last_change":"2024-09-12T00:18:55.953884+0000","last_active":"2024-09-12T01:01:08.179631+0000","last_peered":"2024-09-12T01:01:08.179631+0000","last_clean":"2024-09-12T01:01:08.179631+0000","last_became_active":"2024-09-12T00:18:55.953363+0000","last_became_peered":"2024-09-12T00:18:55.953363+0000","last_unstale":"2024-09-12T01:01:08.179631+0000","last_undegraded":"2024-09-12T01:01:08.179631+0000","last_fullsized":"2024-09-12T01:01:08.179631+0000","mapping_epoch":37,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:06.656289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7324749,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":293,"num_read_kb":12331,"num_write":809,"num_write_kb":28931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:31.733365+0000","last_change":"2024-09-12T00:18:26.848809+0000","last_active":"2024-09-12T01:00:31.733365+0000","last_peered":"2024-09-12T01:00:31.733365+0000","last_clean":"2024-09-12T01:00:31.733365+0000","last_became_active":"2024-09-12T00:18:26.848272+0000","last_became_peered":"2024-09-12T00:18:26.848272+0000","last_unstale":"2024-09-12T01:00:31.733365+0000","last_undegraded":"2024-09-12T01:00:31.733365+0000","last_fullsized":"2024-09-12T01:00:31.733365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:32.968436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'90","reported_seq":626,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.547603+0000","last_change":"2024-09-12T00:18:28.883255+0000","last_active":"2024-09-12T01:02:02.547603+0000","last_peered":"2024-09-12T01:02:02.547603+0000","last_clean":"2024-09-12T01:02:02.547603+0000","last_became_active":"2024-09-12T00:18:28.882630+0000","last_became_peered":"2024-09-12T00:18:28.882630+0000","last_unstale":"2024-09-12T01:02:02.547603+0000","last_undegraded":"2024-09-12T01:02:02.547603+0000","last_fullsized":"2024-09-12T01:02:02.547603+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:19.332138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":98,"num_write":70,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.547576+0000","last_change":"2024-09-12T00:18:30.901543+0000","last_active":"2024-09-12T01:02:02.547576+0000","last_peered":"2024-09-12T01:02:02.547576+0000","last_clean":"2024-09-12T01:02:02.547576+0000","last_became_active":"2024-09-12T00:18:30.900908+0000","last_became_peered":"2024-09-12T00:18:30.900908+0000","last_unstale":"2024-09-12T01:02:02.547576+0000","last_undegraded":"2024-09-12T01:02:02.547576+0000","last_fullsized":"2024-09-12T01:02:02.547576+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:06.507522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'120","reported_seq":626,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.178090+0000","last_change":"2024-09-12T00:18:32.910263+0000","last_active":"2024-09-12T01:02:58.178090+0000","last_peered":"2024-09-12T01:02:58.178090+0000","last_clean":"2024-09-12T01:02:58.178090+0000","last_became_active":"2024-09-12T00:18:32.909547+0000","last_became_peered":"2024-09-12T00:18:32.909547+0000","last_unstale":"2024-09-12T01:02:58.178090+0000","last_undegraded":"2024-09-12T01:02:58.178090+0000","last_fullsized":"2024-09-12T01:02:58.178090+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:15.935680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":128,"num_write":294,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'1255","reported_seq":2899,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.742323+0000","last_change":"2024-09-12T00:18:24.859628+0000","last_active":"2024-09-12T01:03:06.742323+0000","last_peered":"2024-09-12T01:03:06.742323+0000","last_clean":"2024-09-12T01:03:06.742323+0000","last_became_active":"2024-09-12T00:18:24.859237+0000","last_became_peered":"2024-09-12T00:18:24.859237+0000","last_unstale":"2024-09-12T01:03:06.742323+0000","last_undegraded":"2024-09-12T01:03:06.742323+0000","last_fullsized":"2024-09-12T01:03:06.742323+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:27.993852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5766,"num_read_kb":5095,"num_write":1782,"num_write_kb":773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'308","reported_seq":1026,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:14.179546+0000","last_change":"2024-09-12T00:18:22.878983+0000","last_active":"2024-09-12T01:02:14.179546+0000","last_peered":"2024-09-12T01:02:14.179546+0000","last_clean":"2024-09-12T01:02:14.179546+0000","last_became_active":"2024-09-12T00:18:22.873262+0000","last_became_peered":"2024-09-12T00:18:22.873262+0000","last_unstale":"2024-09-12T01:02:14.179546+0000","last_undegraded":"2024-09-12T01:02:14.179546+0000","last_fullsized":"2024-09-12T01:02:14.179546+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:06.551453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18286806,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":535,"num_read_kb":24518,"num_write":1149,"num_write_kb":41630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.756017+0000","last_change":"2024-09-12T00:18:26.855885+0000","last_active":"2024-09-12T01:01:56.756017+0000","last_peered":"2024-09-12T01:01:56.756017+0000","last_clean":"2024-09-12T01:01:56.756017+0000","last_became_active":"2024-09-12T00:18:26.855348+0000","last_became_peered":"2024-09-12T00:18:26.855348+0000","last_unstale":"2024-09-12T01:01:56.756017+0000","last_undegraded":"2024-09-12T01:01:56.756017+0000","last_fullsized":"2024-09-12T01:01:56.756017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:48.816326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'118","reported_seq":670,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:19.297862+0000","last_change":"2024-09-12T00:18:28.885573+0000","last_active":"2024-09-12T01:01:19.297862+0000","last_peered":"2024-09-12T01:01:19.297862+0000","last_clean":"2024-09-12T01:01:19.297862+0000","last_became_active":"2024-09-12T00:18:28.884722+0000","last_became_peered":"2024-09-12T00:18:28.884722+0000","last_unstale":"2024-09-12T01:01:19.297862+0000","last_undegraded":"2024-09-12T01:01:19.297862+0000","last_fullsized":"2024-09-12T01:01:19.297862+0000","mapping_epoch":30,"log_start":"268'100","ondisk_log_start":"268'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:22.842377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":98,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'780","reported_seq":4738,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.829366+0000","last_change":"2024-09-12T00:18:30.894494+0000","last_active":"2024-09-12T01:04:31.829366+0000","last_peered":"2024-09-12T01:04:31.829366+0000","last_clean":"2024-09-12T01:04:31.829366+0000","last_became_active":"2024-09-12T00:18:30.893739+0000","last_became_peered":"2024-09-12T00:18:30.893739+0000","last_unstale":"2024-09-12T01:04:31.829366+0000","last_undegraded":"2024-09-12T01:04:31.829366+0000","last_fullsized":"2024-09-12T01:04:31.829366+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:28.177468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'210","reported_seq":1045,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.023471+0000","last_change":"2024-09-12T00:18:32.884849+0000","last_active":"2024-09-12T01:03:26.023471+0000","last_peered":"2024-09-12T01:03:26.023471+0000","last_clean":"2024-09-12T01:03:26.023471+0000","last_became_active":"2024-09-12T00:18:32.884130+0000","last_became_peered":"2024-09-12T00:18:32.884130+0000","last_unstale":"2024-09-12T01:03:26.023471+0000","last_undegraded":"2024-09-12T01:03:26.023471+0000","last_fullsized":"2024-09-12T01:03:26.023471+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:08.903193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":639,"num_read_kb":629,"num_write":484,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'892","reported_seq":2621,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.348876+0000","last_change":"2024-09-12T00:18:24.868470+0000","last_active":"2024-09-12T01:03:37.348876+0000","last_peered":"2024-09-12T01:03:37.348876+0000","last_clean":"2024-09-12T01:03:37.348876+0000","last_became_active":"2024-09-12T00:18:24.868103+0000","last_became_peered":"2024-09-12T00:18:24.868103+0000","last_unstale":"2024-09-12T01:03:37.348876+0000","last_undegraded":"2024-09-12T01:03:37.348876+0000","last_fullsized":"2024-09-12T01:03:37.348876+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":800,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:19.861066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4419,"num_read_kb":4003,"num_write":1187,"num_write_kb":433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'258","reported_seq":875,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.397104+0000","last_change":"2024-09-12T00:18:22.852318+0000","last_active":"2024-09-12T01:03:01.397104+0000","last_peered":"2024-09-12T01:03:01.397104+0000","last_clean":"2024-09-12T01:03:01.397104+0000","last_became_active":"2024-09-12T00:18:22.850530+0000","last_became_peered":"2024-09-12T00:18:22.850530+0000","last_unstale":"2024-09-12T01:03:01.397104+0000","last_undegraded":"2024-09-12T01:03:01.397104+0000","last_fullsized":"2024-09-12T01:03:01.397104+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:16.232313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10094467,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":403,"num_read_kb":6949,"num_write":1033,"num_write_kb":36294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.749449+0000","last_change":"2024-09-12T00:18:26.868989+0000","last_active":"2024-09-12T01:01:57.749449+0000","last_peered":"2024-09-12T01:01:57.749449+0000","last_clean":"2024-09-12T01:01:57.749449+0000","last_became_active":"2024-09-12T00:18:26.867729+0000","last_became_peered":"2024-09-12T00:18:26.867729+0000","last_unstale":"2024-09-12T01:01:57.749449+0000","last_undegraded":"2024-09-12T01:01:57.749449+0000","last_fullsized":"2024-09-12T01:01:57.749449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:38.364796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'259","reported_seq":829,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:27.579703+0000","last_change":"2024-09-12T00:18:28.885774+0000","last_active":"2024-09-12T01:04:27.579703+0000","last_peered":"2024-09-12T01:04:27.579703+0000","last_clean":"2024-09-12T01:04:27.579703+0000","last_became_active":"2024-09-12T00:18:28.884779+0000","last_became_peered":"2024-09-12T00:18:28.884779+0000","last_unstale":"2024-09-12T01:04:27.579703+0000","last_undegraded":"2024-09-12T01:04:27.579703+0000","last_fullsized":"2024-09-12T01:04:27.579703+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:17.954386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55235,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":430,"num_read_kb":898,"num_write":352,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'813","reported_seq":2283,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.837317+0000","last_change":"2024-09-12T00:18:30.903331+0000","last_active":"2024-09-12T01:04:31.837317+0000","last_peered":"2024-09-12T01:04:31.837317+0000","last_clean":"2024-09-12T01:04:31.837317+0000","last_became_active":"2024-09-12T00:18:30.894642+0000","last_became_peered":"2024-09-12T00:18:30.894642+0000","last_unstale":"2024-09-12T01:04:31.837317+0000","last_undegraded":"2024-09-12T01:04:31.837317+0000","last_fullsized":"2024-09-12T01:04:31.837317+0000","mapping_epoch":32,"log_start":"268'800","ondisk_log_start":"268'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":800,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:23.687695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'475","reported_seq":2078,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.413042+0000","last_change":"2024-09-12T00:18:24.871053+0000","last_active":"2024-09-12T01:03:37.413042+0000","last_peered":"2024-09-12T01:03:37.413042+0000","last_clean":"2024-09-12T01:03:37.413042+0000","last_became_active":"2024-09-12T00:18:24.869435+0000","last_became_peered":"2024-09-12T00:18:24.869435+0000","last_unstale":"2024-09-12T01:03:37.413042+0000","last_undegraded":"2024-09-12T01:03:37.413042+0000","last_fullsized":"2024-09-12T01:03:37.413042+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:43.049599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2569,"num_read_kb":2408,"num_write":545,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'302","reported_seq":930,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.086642+0000","last_change":"2024-09-12T00:18:22.881670+0000","last_active":"2024-09-12T01:02:51.086642+0000","last_peered":"2024-09-12T01:02:51.086642+0000","last_clean":"2024-09-12T01:02:51.086642+0000","last_became_active":"2024-09-12T00:18:22.877327+0000","last_became_peered":"2024-09-12T00:18:22.877327+0000","last_unstale":"2024-09-12T01:02:51.086642+0000","last_undegraded":"2024-09-12T01:02:51.086642+0000","last_fullsized":"2024-09-12T01:02:51.086642+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:34.237861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12210018,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":427,"num_read_kb":23147,"num_write":1006,"num_write_kb":55226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:47.542554+0000","last_change":"2024-09-12T00:18:26.876329+0000","last_active":"2024-09-12T01:01:47.542554+0000","last_peered":"2024-09-12T01:01:47.542554+0000","last_clean":"2024-09-12T01:01:47.542554+0000","last_became_active":"2024-09-12T00:18:26.874638+0000","last_became_peered":"2024-09-12T00:18:26.874638+0000","last_unstale":"2024-09-12T01:01:47.542554+0000","last_undegraded":"2024-09-12T01:01:47.542554+0000","last_fullsized":"2024-09-12T01:01:47.542554+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:33.159889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'331","reported_seq":946,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:12.382172+0000","last_change":"2024-09-12T00:18:28.896980+0000","last_active":"2024-09-12T01:04:12.382172+0000","last_peered":"2024-09-12T01:04:12.382172+0000","last_clean":"2024-09-12T01:04:12.382172+0000","last_became_active":"2024-09-12T00:18:28.895950+0000","last_became_peered":"2024-09-12T00:18:28.895950+0000","last_unstale":"2024-09-12T01:04:12.382172+0000","last_undegraded":"2024-09-12T01:04:12.382172+0000","last_fullsized":"2024-09-12T01:04:12.382172+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:16.223388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53744,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":529,"num_read_kb":962,"num_write":410,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:16.542412+0000","last_change":"2024-09-12T00:18:30.874823+0000","last_active":"2024-09-12T01:01:16.542412+0000","last_peered":"2024-09-12T01:01:16.542412+0000","last_clean":"2024-09-12T01:01:16.542412+0000","last_became_active":"2024-09-12T00:18:30.874074+0000","last_became_peered":"2024-09-12T00:18:30.874074+0000","last_unstale":"2024-09-12T01:01:16.542412+0000","last_undegraded":"2024-09-12T01:01:16.542412+0000","last_fullsized":"2024-09-12T01:01:16.542412+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:46.157942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'552","reported_seq":1366,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.801949+0000","last_change":"2024-09-12T00:18:32.900714+0000","last_active":"2024-09-12T01:04:31.801949+0000","last_peered":"2024-09-12T01:04:31.801949+0000","last_clean":"2024-09-12T01:04:31.801949+0000","last_became_active":"2024-09-12T00:18:32.899046+0000","last_became_peered":"2024-09-12T00:18:32.899046+0000","last_unstale":"2024-09-12T01:04:31.801949+0000","last_undegraded":"2024-09-12T01:04:31.801949+0000","last_fullsized":"2024-09-12T01:04:31.801949+0000","mapping_epoch":34,"log_start":"268'500","ondisk_log_start":"268'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:25.804502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1268,"num_read_kb":1267,"num_write":1132,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'483","reported_seq":2092,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.248460+0000","last_change":"2024-09-12T00:18:24.862220+0000","last_active":"2024-09-12T01:02:59.248460+0000","last_peered":"2024-09-12T01:02:59.248460+0000","last_clean":"2024-09-12T01:02:59.248460+0000","last_became_active":"2024-09-12T00:18:24.861455+0000","last_became_peered":"2024-09-12T00:18:24.861455+0000","last_unstale":"2024-09-12T01:02:59.248460+0000","last_undegraded":"2024-09-12T01:02:59.248460+0000","last_fullsized":"2024-09-12T01:02:59.248460+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:58.186022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2490,"num_read_kb":2350,"num_write":569,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'294","reported_seq":949,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.581667+0000","last_change":"2024-09-12T00:18:22.872925+0000","last_active":"2024-09-12T01:03:10.581667+0000","last_peered":"2024-09-12T01:03:10.581667+0000","last_clean":"2024-09-12T01:03:10.581667+0000","last_became_active":"2024-09-12T00:18:22.871330+0000","last_became_peered":"2024-09-12T00:18:22.871330+0000","last_unstale":"2024-09-12T01:03:10.581667+0000","last_undegraded":"2024-09-12T01:03:10.581667+0000","last_fullsized":"2024-09-12T01:03:10.581667+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:49.802108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587191,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":470,"num_read_kb":9754,"num_write":1030,"num_write_kb":25837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"36'3","reported_seq":983,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.661620+0000","last_change":"2024-09-12T00:18:26.859307+0000","last_active":"2024-09-12T01:04:31.661620+0000","last_peered":"2024-09-12T01:04:31.661620+0000","last_clean":"2024-09-12T01:04:31.661620+0000","last_became_active":"2024-09-12T00:18:26.858529+0000","last_became_peered":"2024-09-12T00:18:26.858529+0000","last_unstale":"2024-09-12T01:04:31.661620+0000","last_undegraded":"2024-09-12T01:04:31.661620+0000","last_fullsized":"2024-09-12T01:04:31.661620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:58.521971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":719,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'281","reported_seq":860,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:31.779506+0000","last_change":"2024-09-12T00:18:28.896114+0000","last_active":"2024-09-12T01:03:31.779506+0000","last_peered":"2024-09-12T01:03:31.779506+0000","last_clean":"2024-09-12T01:03:31.779506+0000","last_became_active":"2024-09-12T00:18:28.895521+0000","last_became_peered":"2024-09-12T00:18:28.895521+0000","last_unstale":"2024-09-12T01:03:31.779506+0000","last_undegraded":"2024-09-12T01:03:31.779506+0000","last_fullsized":"2024-09-12T01:03:31.779506+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:58.027139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55898,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":458,"num_read_kb":962,"num_write":382,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.755573+0000","last_change":"2024-09-12T00:18:30.907840+0000","last_active":"2024-09-12T01:01:56.755573+0000","last_peered":"2024-09-12T01:01:56.755573+0000","last_clean":"2024-09-12T01:01:56.755573+0000","last_became_active":"2024-09-12T00:18:30.905601+0000","last_became_peered":"2024-09-12T00:18:30.905601+0000","last_unstale":"2024-09-12T01:01:56.755573+0000","last_undegraded":"2024-09-12T01:01:56.755573+0000","last_fullsized":"2024-09-12T01:01:56.755573+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:08.252494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'122","reported_seq":612,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:20.723358+0000","last_change":"2024-09-12T00:18:32.900357+0000","last_active":"2024-09-12T01:04:20.723358+0000","last_peered":"2024-09-12T01:04:20.723358+0000","last_clean":"2024-09-12T01:04:20.723358+0000","last_became_active":"2024-09-12T00:18:32.899284+0000","last_became_peered":"2024-09-12T00:18:32.899284+0000","last_unstale":"2024-09-12T01:04:20.723358+0000","last_undegraded":"2024-09-12T01:04:20.723358+0000","last_fullsized":"2024-09-12T01:04:20.723358+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:39.218682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":95,"num_write":292,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'840","reported_seq":2341,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.885035+0000","last_change":"2024-09-12T00:18:24.871047+0000","last_active":"2024-09-12T01:03:25.885035+0000","last_peered":"2024-09-12T01:03:25.885035+0000","last_clean":"2024-09-12T01:03:25.885035+0000","last_became_active":"2024-09-12T00:18:24.869582+0000","last_became_peered":"2024-09-12T00:18:24.869582+0000","last_unstale":"2024-09-12T01:03:25.885035+0000","last_undegraded":"2024-09-12T01:03:25.885035+0000","last_fullsized":"2024-09-12T01:03:25.885035+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":800,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:44.515642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4018,"num_read_kb":3569,"num_write":1156,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'216","reported_seq":816,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:05.774855+0000","last_change":"2024-09-12T00:18:22.881172+0000","last_active":"2024-09-12T01:03:05.774855+0000","last_peered":"2024-09-12T01:03:05.774855+0000","last_clean":"2024-09-12T01:03:05.774855+0000","last_became_active":"2024-09-12T00:18:22.875150+0000","last_became_peered":"2024-09-12T00:18:22.875150+0000","last_unstale":"2024-09-12T01:03:05.774855+0000","last_undegraded":"2024-09-12T01:03:05.774855+0000","last_fullsized":"2024-09-12T01:03:05.774855+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:21.799238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3370821,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":328,"num_read_kb":19791,"num_write":733,"num_write_kb":25570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'5","reported_seq":982,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.660500+0000","last_change":"2024-09-12T00:18:26.858101+0000","last_active":"2024-09-12T01:04:31.660500+0000","last_peered":"2024-09-12T01:04:31.660500+0000","last_clean":"2024-09-12T01:04:31.660500+0000","last_became_active":"2024-09-12T00:18:26.857788+0000","last_became_peered":"2024-09-12T00:18:26.857788+0000","last_unstale":"2024-09-12T01:04:31.660500+0000","last_undegraded":"2024-09-12T01:04:31.660500+0000","last_fullsized":"2024-09-12T01:04:31.660500+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:18.621326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":1184,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'299","reported_seq":892,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:02.573313+0000","last_change":"2024-09-12T00:18:28.887534+0000","last_active":"2024-09-12T01:04:02.573313+0000","last_peered":"2024-09-12T01:04:02.573313+0000","last_clean":"2024-09-12T01:04:02.573313+0000","last_became_active":"2024-09-12T00:18:28.886806+0000","last_became_peered":"2024-09-12T00:18:28.886806+0000","last_unstale":"2024-09-12T01:04:02.573313+0000","last_undegraded":"2024-09-12T01:04:02.573313+0000","last_fullsized":"2024-09-12T01:04:02.573313+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:57.100168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52779,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":481,"num_read_kb":938,"num_write":386,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'804","reported_seq":2407,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.839310+0000","last_change":"2024-09-12T00:18:30.895445+0000","last_active":"2024-09-12T01:04:31.839310+0000","last_peered":"2024-09-12T01:04:31.839310+0000","last_clean":"2024-09-12T01:04:31.839310+0000","last_became_active":"2024-09-12T00:18:30.888688+0000","last_became_peered":"2024-09-12T00:18:30.888688+0000","last_unstale":"2024-09-12T01:04:31.839310+0000","last_undegraded":"2024-09-12T01:04:31.839310+0000","last_fullsized":"2024-09-12T01:04:31.839310+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:44.135657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'131","reported_seq":633,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.832406+0000","last_change":"2024-09-12T00:18:32.909612+0000","last_active":"2024-09-12T01:04:30.832406+0000","last_peered":"2024-09-12T01:04:30.832406+0000","last_clean":"2024-09-12T01:04:30.832406+0000","last_became_active":"2024-09-12T00:18:32.904609+0000","last_became_peered":"2024-09-12T00:18:32.904609+0000","last_unstale":"2024-09-12T01:04:30.832406+0000","last_undegraded":"2024-09-12T01:04:30.832406+0000","last_fullsized":"2024-09-12T01:04:30.832406+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:02.670740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":137,"num_read_kb":127,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'815","reported_seq":2289,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.884794+0000","last_change":"2024-09-12T00:18:24.857093+0000","last_active":"2024-09-12T01:03:25.884794+0000","last_peered":"2024-09-12T01:03:25.884794+0000","last_clean":"2024-09-12T01:03:25.884794+0000","last_became_active":"2024-09-12T00:18:24.856572+0000","last_became_peered":"2024-09-12T00:18:24.856572+0000","last_unstale":"2024-09-12T01:03:25.884794+0000","last_undegraded":"2024-09-12T01:03:25.884794+0000","last_fullsized":"2024-09-12T01:03:25.884794+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:45.768362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3705,"num_read_kb":3326,"num_write":1078,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'313","reported_seq":1023,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.855722+0000","last_change":"2024-09-12T00:18:22.871676+0000","last_active":"2024-09-12T01:03:08.855722+0000","last_peered":"2024-09-12T01:03:08.855722+0000","last_clean":"2024-09-12T01:03:08.855722+0000","last_became_active":"2024-09-12T00:18:22.865067+0000","last_became_peered":"2024-09-12T00:18:22.865067+0000","last_unstale":"2024-09-12T01:03:08.855722+0000","last_undegraded":"2024-09-12T01:03:08.855722+0000","last_fullsized":"2024-09-12T01:03:08.855722+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:05.321786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11583600,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":576,"num_read_kb":35348,"num_write":1303,"num_write_kb":29498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:51.719678+0000","last_change":"2024-09-12T00:18:26.868176+0000","last_active":"2024-09-12T01:01:51.719678+0000","last_peered":"2024-09-12T01:01:51.719678+0000","last_clean":"2024-09-12T01:01:51.719678+0000","last_became_active":"2024-09-12T00:18:26.867793+0000","last_became_peered":"2024-09-12T00:18:26.867793+0000","last_unstale":"2024-09-12T01:01:51.719678+0000","last_undegraded":"2024-09-12T01:01:51.719678+0000","last_fullsized":"2024-09-12T01:01:51.719678+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:45.564325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'465","reported_seq":1101,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.731704+0000","last_change":"2024-09-12T00:18:28.876606+0000","last_active":"2024-09-12T01:04:31.731704+0000","last_peered":"2024-09-12T01:04:31.731704+0000","last_clean":"2024-09-12T01:04:31.731704+0000","last_became_active":"2024-09-12T00:18:28.875891+0000","last_became_peered":"2024-09-12T00:18:28.875891+0000","last_unstale":"2024-09-12T01:04:31.731704+0000","last_undegraded":"2024-09-12T01:04:31.731704+0000","last_fullsized":"2024-09-12T01:04:31.731704+0000","mapping_epoch":30,"log_start":"268'400","ondisk_log_start":"268'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:20.466018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112951,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":808,"num_read_kb":1735,"num_write":668,"num_write_kb":563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:51.719618+0000","last_change":"2024-09-12T00:18:30.896208+0000","last_active":"2024-09-12T01:01:51.719618+0000","last_peered":"2024-09-12T01:01:51.719618+0000","last_clean":"2024-09-12T01:01:51.719618+0000","last_became_active":"2024-09-12T00:18:30.895401+0000","last_became_peered":"2024-09-12T00:18:30.895401+0000","last_unstale":"2024-09-12T01:01:51.719618+0000","last_undegraded":"2024-09-12T01:01:51.719618+0000","last_fullsized":"2024-09-12T01:01:51.719618+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:42.017008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'152","reported_seq":679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.551335+0000","last_change":"2024-09-12T00:18:32.893457+0000","last_active":"2024-09-12T01:01:56.551335+0000","last_peered":"2024-09-12T01:01:56.551335+0000","last_clean":"2024-09-12T01:01:56.551335+0000","last_became_active":"2024-09-12T00:18:32.892682+0000","last_became_peered":"2024-09-12T00:18:32.892682+0000","last_unstale":"2024-09-12T01:01:56.551335+0000","last_undegraded":"2024-09-12T01:01:56.551335+0000","last_fullsized":"2024-09-12T01:01:56.551335+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:17.913143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1103,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":196,"num_read_kb":180,"num_write":352,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'459","reported_seq":2074,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.823138+0000","last_change":"2024-09-12T00:18:24.853418+0000","last_active":"2024-09-12T01:04:30.823138+0000","last_peered":"2024-09-12T01:04:30.823138+0000","last_clean":"2024-09-12T01:04:30.823138+0000","last_became_active":"2024-09-12T00:18:24.852683+0000","last_became_peered":"2024-09-12T00:18:24.852683+0000","last_unstale":"2024-09-12T01:04:30.823138+0000","last_undegraded":"2024-09-12T01:04:30.823138+0000","last_fullsized":"2024-09-12T01:04:30.823138+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:11.403174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2390,"num_read_kb":2271,"num_write":519,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'292","reported_seq":942,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.908684+0000","last_change":"2024-09-12T00:18:22.842425+0000","last_active":"2024-09-12T01:03:21.908684+0000","last_peered":"2024-09-12T01:03:21.908684+0000","last_clean":"2024-09-12T01:03:21.908684+0000","last_became_active":"2024-09-12T00:18:22.841689+0000","last_became_peered":"2024-09-12T00:18:22.841689+0000","last_unstale":"2024-09-12T01:03:21.908684+0000","last_undegraded":"2024-09-12T01:03:21.908684+0000","last_fullsized":"2024-09-12T01:03:21.908684+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:53.341537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14711944,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":427,"num_read_kb":55764,"num_write":1091,"num_write_kb":35616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:11.710704+0000","last_change":"2024-09-12T00:18:26.858051+0000","last_active":"2024-09-12T01:01:11.710704+0000","last_peered":"2024-09-12T01:01:11.710704+0000","last_clean":"2024-09-12T01:01:11.710704+0000","last_became_active":"2024-09-12T00:18:26.845618+0000","last_became_peered":"2024-09-12T00:18:26.845618+0000","last_unstale":"2024-09-12T01:01:11.710704+0000","last_undegraded":"2024-09-12T01:01:11.710704+0000","last_fullsized":"2024-09-12T01:01:11.710704+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:08.376001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'294","reported_seq":876,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:32.569648+0000","last_change":"2024-09-12T00:18:28.885743+0000","last_active":"2024-09-12T01:03:32.569648+0000","last_peered":"2024-09-12T01:03:32.569648+0000","last_clean":"2024-09-12T01:03:32.569648+0000","last_became_active":"2024-09-12T00:18:28.884044+0000","last_became_peered":"2024-09-12T00:18:28.884044+0000","last_unstale":"2024-09-12T01:03:32.569648+0000","last_undegraded":"2024-09-12T01:03:32.569648+0000","last_fullsized":"2024-09-12T01:03:32.569648+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:10.970556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69457,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":506,"num_read_kb":1021,"num_write":458,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":492,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:26.564933+0000","last_change":"2024-09-12T00:18:30.903530+0000","last_active":"2024-09-12T01:01:26.564933+0000","last_peered":"2024-09-12T01:01:26.564933+0000","last_clean":"2024-09-12T01:01:26.564933+0000","last_became_active":"2024-09-12T00:18:30.902697+0000","last_became_peered":"2024-09-12T00:18:30.902697+0000","last_unstale":"2024-09-12T01:01:26.564933+0000","last_undegraded":"2024-09-12T01:01:26.564933+0000","last_fullsized":"2024-09-12T01:01:26.564933+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:52.611643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'136","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:41.767596+0000","last_change":"2024-09-12T00:18:32.901132+0000","last_active":"2024-09-12T01:02:41.767596+0000","last_peered":"2024-09-12T01:02:41.767596+0000","last_clean":"2024-09-12T01:02:41.767596+0000","last_became_active":"2024-09-12T00:18:32.900235+0000","last_became_peered":"2024-09-12T00:18:32.900235+0000","last_unstale":"2024-09-12T01:02:41.767596+0000","last_undegraded":"2024-09-12T01:02:41.767596+0000","last_fullsized":"2024-09-12T01:02:41.767596+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:52.036568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":465,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":124,"num_read_kb":118,"num_write":347,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'436","reported_seq":2078,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.197412+0000","last_change":"2024-09-12T00:18:24.873781+0000","last_active":"2024-09-12T01:03:08.197412+0000","last_peered":"2024-09-12T01:03:08.197412+0000","last_clean":"2024-09-12T01:03:08.197412+0000","last_became_active":"2024-09-12T00:18:24.872637+0000","last_became_peered":"2024-09-12T00:18:24.872637+0000","last_unstale":"2024-09-12T01:03:08.197412+0000","last_undegraded":"2024-09-12T01:03:08.197412+0000","last_fullsized":"2024-09-12T01:03:08.197412+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:31.196044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2400,"num_read_kb":2300,"num_write":500,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'286","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.660542+0000","last_change":"2024-09-12T00:18:22.862177+0000","last_active":"2024-09-12T01:02:57.660542+0000","last_peered":"2024-09-12T01:02:57.660542+0000","last_clean":"2024-09-12T01:02:57.660542+0000","last_became_active":"2024-09-12T00:18:22.861450+0000","last_became_peered":"2024-09-12T00:18:22.861450+0000","last_unstale":"2024-09-12T01:02:57.660542+0000","last_undegraded":"2024-09-12T01:02:57.660542+0000","last_fullsized":"2024-09-12T01:02:57.660542+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:19.289534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4911848,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":522,"num_read_kb":32647,"num_write":1116,"num_write_kb":29925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:11.541211+0000","last_change":"2024-09-12T00:18:26.859580+0000","last_active":"2024-09-12T01:01:11.541211+0000","last_peered":"2024-09-12T01:01:11.541211+0000","last_clean":"2024-09-12T01:01:11.541211+0000","last_became_active":"2024-09-12T00:18:26.859109+0000","last_became_peered":"2024-09-12T00:18:26.859109+0000","last_unstale":"2024-09-12T01:01:11.541211+0000","last_undegraded":"2024-09-12T01:01:11.541211+0000","last_fullsized":"2024-09-12T01:01:11.541211+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:53.815705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'298","reported_seq":884,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:36.741152+0000","last_change":"2024-09-12T00:18:28.882686+0000","last_active":"2024-09-12T01:03:36.741152+0000","last_peered":"2024-09-12T01:03:36.741152+0000","last_clean":"2024-09-12T01:03:36.741152+0000","last_became_active":"2024-09-12T00:18:28.881947+0000","last_became_peered":"2024-09-12T00:18:28.881947+0000","last_unstale":"2024-09-12T01:03:36.741152+0000","last_undegraded":"2024-09-12T01:03:36.741152+0000","last_fullsized":"2024-09-12T01:03:36.741152+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:53.647502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56742,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":486,"num_read_kb":984,"num_write":398,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'743","reported_seq":4313,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.831489+0000","last_change":"2024-09-12T00:18:30.873089+0000","last_active":"2024-09-12T01:04:31.831489+0000","last_peered":"2024-09-12T01:04:31.831489+0000","last_clean":"2024-09-12T01:04:31.831489+0000","last_became_active":"2024-09-12T00:18:30.872360+0000","last_became_peered":"2024-09-12T00:18:30.872360+0000","last_unstale":"2024-09-12T01:04:31.831489+0000","last_undegraded":"2024-09-12T01:04:31.831489+0000","last_fullsized":"2024-09-12T01:04:31.831489+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:32.019462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'112","reported_seq":623,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.964702+0000","last_change":"2024-09-12T00:18:32.897273+0000","last_active":"2024-09-12T01:03:25.964702+0000","last_peered":"2024-09-12T01:03:25.964702+0000","last_clean":"2024-09-12T01:03:25.964702+0000","last_became_active":"2024-09-12T00:18:32.896338+0000","last_became_peered":"2024-09-12T00:18:32.896338+0000","last_unstale":"2024-09-12T01:03:25.964702+0000","last_undegraded":"2024-09-12T01:03:25.964702+0000","last_fullsized":"2024-09-12T01:03:25.964702+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:36.916435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":125,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'462","reported_seq":2012,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.821991+0000","last_change":"2024-09-12T00:18:24.880332+0000","last_active":"2024-09-12T01:04:30.821991+0000","last_peered":"2024-09-12T01:04:30.821991+0000","last_clean":"2024-09-12T01:04:30.821991+0000","last_became_active":"2024-09-12T00:18:24.879622+0000","last_became_peered":"2024-09-12T00:18:24.879622+0000","last_unstale":"2024-09-12T01:04:30.821991+0000","last_undegraded":"2024-09-12T01:04:30.821991+0000","last_fullsized":"2024-09-12T01:04:30.821991+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:02.247072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2528,"num_read_kb":2373,"num_write":555,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'332","reported_seq":1029,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:52.573586+0000","last_change":"2024-09-12T00:18:22.849525+0000","last_active":"2024-09-12T01:03:52.573586+0000","last_peered":"2024-09-12T01:03:52.573586+0000","last_clean":"2024-09-12T01:03:52.573586+0000","last_became_active":"2024-09-12T00:18:22.847861+0000","last_became_peered":"2024-09-12T00:18:22.847861+0000","last_unstale":"2024-09-12T01:03:52.573586+0000","last_undegraded":"2024-09-12T01:03:52.573586+0000","last_fullsized":"2024-09-12T01:03:52.573586+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:43.232146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78962,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":640,"num_read_kb":61883,"num_write":1149,"num_write_kb":26157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1450,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.674782+0000","last_change":"2024-09-12T00:18:26.872031+0000","last_active":"2024-09-12T01:04:31.674782+0000","last_peered":"2024-09-12T01:04:31.674782+0000","last_clean":"2024-09-12T01:04:31.674782+0000","last_became_active":"2024-09-12T00:18:26.871356+0000","last_became_peered":"2024-09-12T00:18:26.871356+0000","last_unstale":"2024-09-12T01:04:31.674782+0000","last_undegraded":"2024-09-12T01:04:31.674782+0000","last_fullsized":"2024-09-12T01:04:31.674782+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:31.045577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":948,"num_read_kb":948,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'72","reported_seq":600,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:16.745058+0000","last_change":"2024-09-12T00:18:28.889216+0000","last_active":"2024-09-12T01:01:16.745058+0000","last_peered":"2024-09-12T01:01:16.745058+0000","last_clean":"2024-09-12T01:01:16.745058+0000","last_became_active":"2024-09-12T00:18:28.888423+0000","last_became_peered":"2024-09-12T00:18:28.888423+0000","last_unstale":"2024-09-12T01:01:16.745058+0000","last_undegraded":"2024-09-12T01:01:16.745058+0000","last_fullsized":"2024-09-12T01:01:16.745058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:38.462514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":78,"num_read_kb":72,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'763","reported_seq":2110,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.834256+0000","last_change":"2024-09-12T00:18:30.902806+0000","last_active":"2024-09-12T01:04:31.834256+0000","last_peered":"2024-09-12T01:04:31.834256+0000","last_clean":"2024-09-12T01:04:31.834256+0000","last_became_active":"2024-09-12T00:18:30.898814+0000","last_became_peered":"2024-09-12T00:18:30.898814+0000","last_unstale":"2024-09-12T01:04:31.834256+0000","last_undegraded":"2024-09-12T01:04:31.834256+0000","last_fullsized":"2024-09-12T01:04:31.834256+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:14.302064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'94","reported_seq":594,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.707747+0000","last_change":"2024-09-12T00:18:32.909724+0000","last_active":"2024-09-12T01:03:20.707747+0000","last_peered":"2024-09-12T01:03:20.707747+0000","last_clean":"2024-09-12T01:03:20.707747+0000","last_became_active":"2024-09-12T00:18:32.907797+0000","last_became_peered":"2024-09-12T00:18:32.907797+0000","last_unstale":"2024-09-12T01:03:20.707747+0000","last_undegraded":"2024-09-12T01:03:20.707747+0000","last_fullsized":"2024-09-12T01:03:20.707747+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:54.545857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":73,"num_write":219,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'509","reported_seq":2082,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.413084+0000","last_change":"2024-09-12T00:18:56.197323+0000","last_active":"2024-09-12T01:03:37.413084+0000","last_peered":"2024-09-12T01:03:37.413084+0000","last_clean":"2024-09-12T01:03:37.413084+0000","last_became_active":"2024-09-12T00:18:56.196419+0000","last_became_peered":"2024-09-12T00:18:56.196419+0000","last_unstale":"2024-09-12T01:03:37.413084+0000","last_undegraded":"2024-09-12T01:03:37.413084+0000","last_fullsized":"2024-09-12T01:03:37.413084+0000","mapping_epoch":37,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:19.400713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2644,"num_read_kb":2454,"num_write":619,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"268'330","reported_seq":1114,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.193180+0000","last_change":"2024-09-12T00:18:22.835371+0000","last_active":"2024-09-12T01:02:55.193180+0000","last_peered":"2024-09-12T01:02:55.193180+0000","last_clean":"2024-09-12T01:02:55.193180+0000","last_became_active":"2024-09-12T00:18:22.834072+0000","last_became_peered":"2024-09-12T00:18:22.834072+0000","last_unstale":"2024-09-12T01:02:55.193180+0000","last_undegraded":"2024-09-12T01:02:55.193180+0000","last_fullsized":"2024-09-12T01:02:55.193180+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:54.066638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2365598,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":777,"num_read_kb":11806,"num_write":1118,"num_write_kb":23298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.536055+0000","last_change":"2024-09-12T00:18:26.872530+0000","last_active":"2024-09-12T01:01:12.536055+0000","last_peered":"2024-09-12T01:01:12.536055+0000","last_clean":"2024-09-12T01:01:12.536055+0000","last_became_active":"2024-09-12T00:18:26.871183+0000","last_became_peered":"2024-09-12T00:18:26.871183+0000","last_unstale":"2024-09-12T01:01:12.536055+0000","last_undegraded":"2024-09-12T01:01:12.536055+0000","last_fullsized":"2024-09-12T01:01:12.536055+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:37.626693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'365","reported_seq":968,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.561953+0000","last_change":"2024-09-12T00:18:28.895040+0000","last_active":"2024-09-12T01:03:37.561953+0000","last_peered":"2024-09-12T01:03:37.561953+0000","last_clean":"2024-09-12T01:03:37.561953+0000","last_became_active":"2024-09-12T00:18:28.889343+0000","last_became_peered":"2024-09-12T00:18:28.889343+0000","last_unstale":"2024-09-12T01:03:37.561953+0000","last_undegraded":"2024-09-12T01:03:37.561953+0000","last_fullsized":"2024-09-12T01:03:37.561953+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:17.252099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57094,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1168,"num_read_kb":1657,"num_write":1682,"num_write_kb":1547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:17.720087+0000","last_change":"2024-09-12T00:18:30.906396+0000","last_active":"2024-09-12T01:01:17.720087+0000","last_peered":"2024-09-12T01:01:17.720087+0000","last_clean":"2024-09-12T01:01:17.720087+0000","last_became_active":"2024-09-12T00:18:30.905770+0000","last_became_peered":"2024-09-12T00:18:30.905770+0000","last_unstale":"2024-09-12T01:01:17.720087+0000","last_undegraded":"2024-09-12T01:01:17.720087+0000","last_fullsized":"2024-09-12T01:01:17.720087+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:26.490700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'134","reported_seq":635,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.562136+0000","last_change":"2024-09-12T00:18:32.886440+0000","last_active":"2024-09-12T01:03:23.562136+0000","last_peered":"2024-09-12T01:03:23.562136+0000","last_clean":"2024-09-12T01:03:23.562136+0000","last_became_active":"2024-09-12T00:18:32.885619+0000","last_became_peered":"2024-09-12T00:18:32.885619+0000","last_unstale":"2024-09-12T01:03:23.562136+0000","last_undegraded":"2024-09-12T01:03:23.562136+0000","last_fullsized":"2024-09-12T01:03:23.562136+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:21.997695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":117,"num_write":301,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'771","reported_seq":2188,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.192347+0000","last_change":"2024-09-12T00:18:24.880137+0000","last_active":"2024-09-12T01:03:11.192347+0000","last_peered":"2024-09-12T01:03:11.192347+0000","last_clean":"2024-09-12T01:03:11.192347+0000","last_became_active":"2024-09-12T00:18:24.879462+0000","last_became_peered":"2024-09-12T00:18:24.879462+0000","last_unstale":"2024-09-12T01:03:11.192347+0000","last_undegraded":"2024-09-12T01:03:11.192347+0000","last_fullsized":"2024-09-12T01:03:11.192347+0000","mapping_epoch":26,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:59.861183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3687,"num_read_kb":3308,"num_write":1074,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:17.549465+0000","last_change":"2024-09-12T00:18:03.927642+0000","last_active":"2024-09-12T01:02:17.549465+0000","last_peered":"2024-09-12T01:02:17.549465+0000","last_clean":"2024-09-12T01:02:17.549465+0000","last_became_active":"2024-09-12T00:18:03.924829+0000","last_became_peered":"2024-09-12T00:18:03.924829+0000","last_unstale":"2024-09-12T01:02:17.549465+0000","last_undegraded":"2024-09-12T01:02:17.549465+0000","last_fullsized":"2024-09-12T01:02:17.549465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:02.531521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:02.531521+0000","last_clean_scrub_stamp":"2024-09-12T00:18:02.531521+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:47.557338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.749313+0000","last_change":"2024-09-12T00:18:10.661688+0000","last_active":"2024-09-12T01:01:57.749313+0000","last_peered":"2024-09-12T01:01:57.749313+0000","last_clean":"2024-09-12T01:01:57.749313+0000","last_became_active":"2024-09-12T00:18:08.644385+0000","last_became_peered":"2024-09-12T00:18:08.644385+0000","last_unstale":"2024-09-12T01:01:57.749313+0000","last_undegraded":"2024-09-12T01:01:57.749313+0000","last_fullsized":"2024-09-12T01:01:57.749313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:31.240227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001156741,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'286","reported_seq":935,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.759591+0000","last_change":"2024-09-12T00:18:22.868181+0000","last_active":"2024-09-12T01:02:11.759591+0000","last_peered":"2024-09-12T01:02:11.759591+0000","last_clean":"2024-09-12T01:02:11.759591+0000","last_became_active":"2024-09-12T00:18:22.867571+0000","last_became_peered":"2024-09-12T00:18:22.867571+0000","last_unstale":"2024-09-12T01:02:11.759591+0000","last_undegraded":"2024-09-12T01:02:11.759591+0000","last_fullsized":"2024-09-12T01:02:11.759591+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:17.614856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12470712,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":400,"num_read_kb":26849,"num_write":1023,"num_write_kb":40025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.548434+0000","last_change":"2024-09-12T00:18:26.847189+0000","last_active":"2024-09-12T01:02:12.548434+0000","last_peered":"2024-09-12T01:02:12.548434+0000","last_clean":"2024-09-12T01:02:12.548434+0000","last_became_active":"2024-09-12T00:18:26.846668+0000","last_became_peered":"2024-09-12T00:18:26.846668+0000","last_unstale":"2024-09-12T01:02:12.548434+0000","last_undegraded":"2024-09-12T01:02:12.548434+0000","last_fullsized":"2024-09-12T01:02:12.548434+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:06.265320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'687","reported_seq":1384,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.769278+0000","last_change":"2024-09-12T00:18:28.887266+0000","last_active":"2024-09-12T01:04:31.769278+0000","last_peered":"2024-09-12T01:04:31.769278+0000","last_clean":"2024-09-12T01:04:31.769278+0000","last_became_active":"2024-09-12T00:18:28.885217+0000","last_became_peered":"2024-09-12T00:18:28.885217+0000","last_unstale":"2024-09-12T01:04:31.769278+0000","last_undegraded":"2024-09-12T01:04:31.769278+0000","last_fullsized":"2024-09-12T01:04:31.769278+0000","mapping_epoch":30,"log_start":"268'600","ondisk_log_start":"268'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":600,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:06.515258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212657,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1339,"num_read_kb":2881,"num_write":1248,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":493,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:51.570679+0000","last_change":"2024-09-12T00:18:30.899429+0000","last_active":"2024-09-12T01:01:51.570679+0000","last_peered":"2024-09-12T01:01:51.570679+0000","last_clean":"2024-09-12T01:01:51.570679+0000","last_became_active":"2024-09-12T00:18:30.898689+0000","last_became_peered":"2024-09-12T00:18:30.898689+0000","last_unstale":"2024-09-12T01:01:51.570679+0000","last_undegraded":"2024-09-12T01:01:51.570679+0000","last_fullsized":"2024-09-12T01:01:51.570679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:03.955121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'198","reported_seq":907,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.899528+0000","last_change":"2024-09-12T00:18:32.895955+0000","last_active":"2024-09-12T01:03:25.899528+0000","last_peered":"2024-09-12T01:03:25.899528+0000","last_clean":"2024-09-12T01:03:25.899528+0000","last_became_active":"2024-09-12T00:18:32.895239+0000","last_became_peered":"2024-09-12T00:18:32.895239+0000","last_unstale":"2024-09-12T01:03:25.899528+0000","last_undegraded":"2024-09-12T01:03:25.899528+0000","last_fullsized":"2024-09-12T01:03:25.899528+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:55.084809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1443,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":458,"num_write":434,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'488","reported_seq":2064,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.768001+0000","last_change":"2024-09-12T00:18:24.867486+0000","last_active":"2024-09-12T01:02:55.768001+0000","last_peered":"2024-09-12T01:02:55.768001+0000","last_clean":"2024-09-12T01:02:55.768001+0000","last_became_active":"2024-09-12T00:18:24.867067+0000","last_became_peered":"2024-09-12T00:18:24.867067+0000","last_unstale":"2024-09-12T01:02:55.768001+0000","last_undegraded":"2024-09-12T01:02:55.768001+0000","last_fullsized":"2024-09-12T01:02:55.768001+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:22.498521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2524,"num_read_kb":2362,"num_write":607,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":524,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:22.550569+0000","last_change":"2024-09-12T00:18:10.895303+0000","last_active":"2024-09-12T01:02:22.550569+0000","last_peered":"2024-09-12T01:02:22.550569+0000","last_clean":"2024-09-12T01:02:22.550569+0000","last_became_active":"2024-09-12T00:18:08.646097+0000","last_became_peered":"2024-09-12T00:18:08.646097+0000","last_unstale":"2024-09-12T01:02:22.550569+0000","last_undegraded":"2024-09-12T01:02:22.550569+0000","last_fullsized":"2024-09-12T01:02:22.550569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:23.989230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001003409,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'295","reported_seq":958,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.352904+0000","last_change":"2024-09-12T00:18:22.858083+0000","last_active":"2024-09-12T01:02:21.352904+0000","last_peered":"2024-09-12T01:02:21.352904+0000","last_clean":"2024-09-12T01:02:21.352904+0000","last_became_active":"2024-09-12T00:18:22.857461+0000","last_became_peered":"2024-09-12T00:18:22.857461+0000","last_unstale":"2024-09-12T01:02:21.352904+0000","last_undegraded":"2024-09-12T01:02:21.352904+0000","last_fullsized":"2024-09-12T01:02:21.352904+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:17.632592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8949434,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":507,"num_read_kb":72256,"num_write":1008,"num_write_kb":25510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:47.747024+0000","last_change":"2024-09-12T00:18:26.872369+0000","last_active":"2024-09-12T01:01:47.747024+0000","last_peered":"2024-09-12T01:01:47.747024+0000","last_clean":"2024-09-12T01:01:47.747024+0000","last_became_active":"2024-09-12T00:18:26.871674+0000","last_became_peered":"2024-09-12T00:18:26.871674+0000","last_unstale":"2024-09-12T01:01:47.747024+0000","last_undegraded":"2024-09-12T01:01:47.747024+0000","last_fullsized":"2024-09-12T01:01:47.747024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:53.162492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'1305","reported_seq":2799,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.821026+0000","last_change":"2024-09-12T00:18:28.890022+0000","last_active":"2024-09-12T01:04:31.821026+0000","last_peered":"2024-09-12T01:04:31.821026+0000","last_clean":"2024-09-12T01:04:31.821026+0000","last_became_active":"2024-09-12T00:18:28.889257+0000","last_became_peered":"2024-09-12T00:18:28.889257+0000","last_unstale":"2024-09-12T01:04:31.821026+0000","last_undegraded":"2024-09-12T01:04:31.821026+0000","last_fullsized":"2024-09-12T01:04:31.821026+0000","mapping_epoch":30,"log_start":"268'1201","ondisk_log_start":"268'1201","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":1201,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:45.298192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186105,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2077,"num_read_kb":3673,"num_write":1202,"num_write_kb":1048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":492,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:27.551882+0000","last_change":"2024-09-12T00:18:30.896021+0000","last_active":"2024-09-12T01:02:27.551882+0000","last_peered":"2024-09-12T01:02:27.551882+0000","last_clean":"2024-09-12T01:02:27.551882+0000","last_became_active":"2024-09-12T00:18:30.895305+0000","last_became_peered":"2024-09-12T00:18:30.895305+0000","last_unstale":"2024-09-12T01:02:27.551882+0000","last_undegraded":"2024-09-12T01:02:27.551882+0000","last_fullsized":"2024-09-12T01:02:27.551882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:43.210391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'203","reported_seq":730,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:06.553696+0000","last_change":"2024-09-12T00:18:32.888386+0000","last_active":"2024-09-12T01:02:06.553696+0000","last_peered":"2024-09-12T01:02:06.553696+0000","last_clean":"2024-09-12T01:02:06.553696+0000","last_became_active":"2024-09-12T00:18:32.887528+0000","last_became_peered":"2024-09-12T00:18:32.887528+0000","last_unstale":"2024-09-12T01:02:06.553696+0000","last_undegraded":"2024-09-12T01:02:06.553696+0000","last_fullsized":"2024-09-12T01:02:06.553696+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:38.435598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":310,"num_read_kb":309,"num_write":446,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'1278","reported_seq":3138,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.820547+0000","last_change":"2024-09-12T00:18:24.878345+0000","last_active":"2024-09-12T01:04:30.820547+0000","last_peered":"2024-09-12T01:04:30.820547+0000","last_clean":"2024-09-12T01:04:30.820547+0000","last_became_active":"2024-09-12T00:18:24.877964+0000","last_became_peered":"2024-09-12T00:18:24.877964+0000","last_unstale":"2024-09-12T01:04:30.820547+0000","last_undegraded":"2024-09-12T01:04:30.820547+0000","last_fullsized":"2024-09-12T01:04:30.820547+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":1200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:26.929945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6082,"num_read_kb":5401,"num_write":1732,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.720736+0000","last_change":"2024-09-12T00:18:10.654679+0000","last_active":"2024-09-12T01:01:56.720736+0000","last_peered":"2024-09-12T01:01:56.720736+0000","last_clean":"2024-09-12T01:01:56.720736+0000","last_became_active":"2024-09-12T00:18:08.874442+0000","last_became_peered":"2024-09-12T00:18:08.874442+0000","last_unstale":"2024-09-12T01:01:56.720736+0000","last_undegraded":"2024-09-12T01:01:56.720736+0000","last_fullsized":"2024-09-12T01:01:56.720736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:30.659138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010707620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'305","reported_seq":1023,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:29.920089+0000","last_change":"2024-09-12T00:18:22.835171+0000","last_active":"2024-09-12T01:04:29.920089+0000","last_peered":"2024-09-12T01:04:29.920089+0000","last_clean":"2024-09-12T01:04:29.920089+0000","last_became_active":"2024-09-12T00:18:22.834724+0000","last_became_peered":"2024-09-12T00:18:22.834724+0000","last_unstale":"2024-09-12T01:04:29.920089+0000","last_undegraded":"2024-09-12T01:04:29.920089+0000","last_fullsized":"2024-09-12T01:04:29.920089+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:08.633740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4717516,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":613,"num_read_kb":9051,"num_write":1161,"num_write_kb":24587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:46.718701+0000","last_change":"2024-09-12T00:18:26.868058+0000","last_active":"2024-09-12T01:01:46.718701+0000","last_peered":"2024-09-12T01:01:46.718701+0000","last_clean":"2024-09-12T01:01:46.718701+0000","last_became_active":"2024-09-12T00:18:26.867343+0000","last_became_peered":"2024-09-12T00:18:26.867343+0000","last_unstale":"2024-09-12T01:01:46.718701+0000","last_undegraded":"2024-09-12T01:01:46.718701+0000","last_fullsized":"2024-09-12T01:01:46.718701+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:35.314858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'252","reported_seq":1356,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.962448+0000","last_change":"2024-09-12T00:18:28.892634+0000","last_active":"2024-09-12T01:04:31.962448+0000","last_peered":"2024-09-12T01:04:31.962448+0000","last_clean":"2024-09-12T01:04:31.962448+0000","last_became_active":"2024-09-12T00:18:28.889058+0000","last_became_peered":"2024-09-12T00:18:28.889058+0000","last_unstale":"2024-09-12T01:04:31.962448+0000","last_undegraded":"2024-09-12T01:04:31.962448+0000","last_fullsized":"2024-09-12T01:04:31.962448+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:46.530785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":190,"num_read_kb":179,"num_write":165,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":494,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:16.577209+0000","last_change":"2024-09-12T00:18:30.896789+0000","last_active":"2024-09-12T01:02:16.577209+0000","last_peered":"2024-09-12T01:02:16.577209+0000","last_clean":"2024-09-12T01:02:16.577209+0000","last_became_active":"2024-09-12T00:18:30.896073+0000","last_became_peered":"2024-09-12T00:18:30.896073+0000","last_unstale":"2024-09-12T01:02:16.577209+0000","last_undegraded":"2024-09-12T01:02:16.577209+0000","last_fullsized":"2024-09-12T01:02:16.577209+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:47.152911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'272","reported_seq":884,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.079029+0000","last_change":"2024-09-12T00:18:32.914870+0000","last_active":"2024-09-12T01:03:26.079029+0000","last_peered":"2024-09-12T01:03:26.079029+0000","last_clean":"2024-09-12T01:03:26.079029+0000","last_became_active":"2024-09-12T00:18:32.914004+0000","last_became_peered":"2024-09-12T00:18:32.914004+0000","last_unstale":"2024-09-12T01:03:26.079029+0000","last_undegraded":"2024-09-12T01:03:26.079029+0000","last_fullsized":"2024-09-12T01:03:26.079029+0000","mapping_epoch":34,"log_start":"268'200","ondisk_log_start":"268'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:37.374742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":517,"num_read_kb":535,"num_write":598,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'816","reported_seq":2373,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.819708+0000","last_change":"2024-09-12T00:18:24.870195+0000","last_active":"2024-09-12T01:04:30.819708+0000","last_peered":"2024-09-12T01:04:30.819708+0000","last_clean":"2024-09-12T01:04:30.819708+0000","last_became_active":"2024-09-12T00:18:24.869633+0000","last_became_peered":"2024-09-12T00:18:24.869633+0000","last_unstale":"2024-09-12T01:04:30.819708+0000","last_undegraded":"2024-09-12T01:04:30.819708+0000","last_fullsized":"2024-09-12T01:04:30.819708+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:24.540261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3879,"num_read_kb":3488,"num_write":1067,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.749218+0000","last_change":"2024-09-12T00:18:10.662993+0000","last_active":"2024-09-12T01:01:57.749218+0000","last_peered":"2024-09-12T01:01:57.749218+0000","last_clean":"2024-09-12T01:01:57.749218+0000","last_became_active":"2024-09-12T00:18:08.645156+0000","last_became_peered":"2024-09-12T00:18:08.645156+0000","last_unstale":"2024-09-12T01:01:57.749218+0000","last_undegraded":"2024-09-12T01:01:57.749218+0000","last_fullsized":"2024-09-12T01:01:57.749218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:52.068369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024595709999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'316","reported_seq":999,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.898917+0000","last_change":"2024-09-12T00:18:22.855734+0000","last_active":"2024-09-12T01:03:21.898917+0000","last_peered":"2024-09-12T01:03:21.898917+0000","last_clean":"2024-09-12T01:03:21.898917+0000","last_became_active":"2024-09-12T00:18:22.854940+0000","last_became_peered":"2024-09-12T00:18:22.854940+0000","last_unstale":"2024-09-12T01:03:21.898917+0000","last_undegraded":"2024-09-12T01:03:21.898917+0000","last_fullsized":"2024-09-12T01:03:21.898917+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:05.965555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11634921,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":527,"num_read_kb":32176,"num_write":1165,"num_write_kb":29732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.578382+0000","last_change":"2024-09-12T00:18:26.856551+0000","last_active":"2024-09-12T01:02:21.578382+0000","last_peered":"2024-09-12T01:02:21.578382+0000","last_clean":"2024-09-12T01:02:21.578382+0000","last_became_active":"2024-09-12T00:18:26.855239+0000","last_became_peered":"2024-09-12T00:18:26.855239+0000","last_unstale":"2024-09-12T01:02:21.578382+0000","last_undegraded":"2024-09-12T01:02:21.578382+0000","last_fullsized":"2024-09-12T01:02:21.578382+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:33.287785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'122","reported_seq":671,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:01.784399+0000","last_change":"2024-09-12T00:18:28.891881+0000","last_active":"2024-09-12T01:04:01.784399+0000","last_peered":"2024-09-12T01:04:01.784399+0000","last_clean":"2024-09-12T01:04:01.784399+0000","last_became_active":"2024-09-12T00:18:28.891173+0000","last_became_peered":"2024-09-12T00:18:28.891173+0000","last_unstale":"2024-09-12T01:04:01.784399+0000","last_undegraded":"2024-09-12T01:04:01.784399+0000","last_fullsized":"2024-09-12T01:04:01.784399+0000","mapping_epoch":30,"log_start":"268'100","ondisk_log_start":"268'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:02.040523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":142,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":491,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:52.727361+0000","last_change":"2024-09-12T00:18:30.904713+0000","last_active":"2024-09-12T01:01:52.727361+0000","last_peered":"2024-09-12T01:01:52.727361+0000","last_clean":"2024-09-12T01:01:52.727361+0000","last_became_active":"2024-09-12T00:18:30.904080+0000","last_became_peered":"2024-09-12T00:18:30.904080+0000","last_unstale":"2024-09-12T01:01:52.727361+0000","last_undegraded":"2024-09-12T01:01:52.727361+0000","last_fullsized":"2024-09-12T01:01:52.727361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:14.500655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'108","reported_seq":658,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.275864+0000","last_change":"2024-09-12T00:18:32.905383+0000","last_active":"2024-09-12T01:02:54.275864+0000","last_peered":"2024-09-12T01:02:54.275864+0000","last_clean":"2024-09-12T01:02:54.275864+0000","last_became_active":"2024-09-12T00:18:32.903109+0000","last_became_peered":"2024-09-12T00:18:32.903109+0000","last_unstale":"2024-09-12T01:02:54.275864+0000","last_undegraded":"2024-09-12T01:02:54.275864+0000","last_fullsized":"2024-09-12T01:02:54.275864+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:48.630615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":206,"num_read_kb":202,"num_write":268,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'472","reported_seq":1985,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.120332+0000","last_change":"2024-09-12T00:18:24.878475+0000","last_active":"2024-09-12T01:03:25.120332+0000","last_peered":"2024-09-12T01:03:25.120332+0000","last_clean":"2024-09-12T01:03:25.120332+0000","last_became_active":"2024-09-12T00:18:24.878031+0000","last_became_peered":"2024-09-12T00:18:24.878031+0000","last_unstale":"2024-09-12T01:03:25.120332+0000","last_undegraded":"2024-09-12T01:03:25.120332+0000","last_fullsized":"2024-09-12T01:03:25.120332+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:27.805912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2325,"num_read_kb":2173,"num_write":541,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'253","reported_seq":867,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.898632+0000","last_change":"2024-09-12T00:18:22.873808+0000","last_active":"2024-09-12T01:03:21.898632+0000","last_peered":"2024-09-12T01:03:21.898632+0000","last_clean":"2024-09-12T01:03:21.898632+0000","last_became_active":"2024-09-12T00:18:22.861336+0000","last_became_peered":"2024-09-12T00:18:22.861336+0000","last_unstale":"2024-09-12T01:03:21.898632+0000","last_undegraded":"2024-09-12T01:03:21.898632+0000","last_fullsized":"2024-09-12T01:03:21.898632+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:07.579776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13735787,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":353,"num_read_kb":16866,"num_write":896,"num_write_kb":39669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.551222+0000","last_change":"2024-09-12T00:18:10.665342+0000","last_active":"2024-09-12T01:01:56.551222+0000","last_peered":"2024-09-12T01:01:56.551222+0000","last_clean":"2024-09-12T01:01:56.551222+0000","last_became_active":"2024-09-12T00:18:08.956785+0000","last_became_peered":"2024-09-12T00:18:08.956785+0000","last_unstale":"2024-09-12T01:01:56.551222+0000","last_undegraded":"2024-09-12T01:01:56.551222+0000","last_fullsized":"2024-09-12T01:01:56.551222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:11.556988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012417909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.575765+0000","last_change":"2024-09-12T00:18:26.879934+0000","last_active":"2024-09-12T01:02:11.575765+0000","last_peered":"2024-09-12T01:02:11.575765+0000","last_clean":"2024-09-12T01:02:11.575765+0000","last_became_active":"2024-09-12T00:18:26.879511+0000","last_became_peered":"2024-09-12T00:18:26.879511+0000","last_unstale":"2024-09-12T01:02:11.575765+0000","last_undegraded":"2024-09-12T01:02:11.575765+0000","last_fullsized":"2024-09-12T01:02:11.575765+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:50.925795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'552","reported_seq":1220,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.751607+0000","last_change":"2024-09-12T00:18:28.880341+0000","last_active":"2024-09-12T01:04:31.751607+0000","last_peered":"2024-09-12T01:04:31.751607+0000","last_clean":"2024-09-12T01:04:31.751607+0000","last_became_active":"2024-09-12T00:18:28.879614+0000","last_became_peered":"2024-09-12T00:18:28.879614+0000","last_unstale":"2024-09-12T01:04:31.751607+0000","last_undegraded":"2024-09-12T01:04:31.751607+0000","last_fullsized":"2024-09-12T01:04:31.751607+0000","mapping_epoch":30,"log_start":"268'500","ondisk_log_start":"268'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:03.149386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117967,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":920,"num_read_kb":1830,"num_write":792,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:17.552865+0000","last_change":"2024-09-12T00:18:30.904154+0000","last_active":"2024-09-12T01:02:17.552865+0000","last_peered":"2024-09-12T01:02:17.552865+0000","last_clean":"2024-09-12T01:02:17.552865+0000","last_became_active":"2024-09-12T00:18:30.903532+0000","last_became_peered":"2024-09-12T00:18:30.903532+0000","last_unstale":"2024-09-12T01:02:17.552865+0000","last_undegraded":"2024-09-12T01:02:17.552865+0000","last_fullsized":"2024-09-12T01:02:17.552865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:56.341364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'142","reported_seq":649,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.969443+0000","last_change":"2024-09-12T00:18:32.897568+0000","last_active":"2024-09-12T01:03:25.969443+0000","last_peered":"2024-09-12T01:03:25.969443+0000","last_clean":"2024-09-12T01:03:25.969443+0000","last_became_active":"2024-09-12T00:18:32.896532+0000","last_became_peered":"2024-09-12T00:18:32.896532+0000","last_unstale":"2024-09-12T01:03:25.969443+0000","last_undegraded":"2024-09-12T01:03:25.969443+0000","last_fullsized":"2024-09-12T01:03:25.969443+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:19.854551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":138,"num_write":339,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'364","reported_seq":1903,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.171828+0000","last_change":"2024-09-12T00:18:24.856127+0000","last_active":"2024-09-12T01:03:03.171828+0000","last_peered":"2024-09-12T01:03:03.171828+0000","last_clean":"2024-09-12T01:03:03.171828+0000","last_became_active":"2024-09-12T00:18:24.852620+0000","last_became_peered":"2024-09-12T00:18:24.852620+0000","last_unstale":"2024-09-12T01:03:03.171828+0000","last_undegraded":"2024-09-12T01:03:03.171828+0000","last_fullsized":"2024-09-12T01:03:03.171828+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:07.552365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2109,"num_read_kb":2037,"num_write":400,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'275","reported_seq":921,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.555047+0000","last_change":"2024-09-12T00:18:22.839269+0000","last_active":"2024-09-12T01:02:11.555047+0000","last_peered":"2024-09-12T01:02:11.555047+0000","last_clean":"2024-09-12T01:02:11.555047+0000","last_became_active":"2024-09-12T00:18:22.839001+0000","last_became_peered":"2024-09-12T00:18:22.839001+0000","last_unstale":"2024-09-12T01:02:11.555047+0000","last_undegraded":"2024-09-12T01:02:11.555047+0000","last_fullsized":"2024-09-12T01:02:11.555047+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:51.522439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7372265,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":413,"num_read_kb":59946,"num_write":909,"num_write_kb":34875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:07.547276+0000","last_change":"2024-09-12T00:18:10.895453+0000","last_active":"2024-09-12T01:02:07.547276+0000","last_peered":"2024-09-12T01:02:07.547276+0000","last_clean":"2024-09-12T01:02:07.547276+0000","last_became_active":"2024-09-12T00:18:08.958069+0000","last_became_peered":"2024-09-12T00:18:08.958069+0000","last_unstale":"2024-09-12T01:02:07.547276+0000","last_undegraded":"2024-09-12T01:02:07.547276+0000","last_fullsized":"2024-09-12T01:02:07.547276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:41.978158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001047189,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.731707+0000","last_change":"2024-09-12T00:18:26.866580+0000","last_active":"2024-09-12T01:02:12.731707+0000","last_peered":"2024-09-12T01:02:12.731707+0000","last_clean":"2024-09-12T01:02:12.731707+0000","last_became_active":"2024-09-12T00:18:26.865743+0000","last_became_peered":"2024-09-12T00:18:26.865743+0000","last_unstale":"2024-09-12T01:02:12.731707+0000","last_undegraded":"2024-09-12T01:02:12.731707+0000","last_fullsized":"2024-09-12T01:02:12.731707+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:54.698335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'164","reported_seq":741,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.887776+0000","last_change":"2024-09-12T00:18:28.877919+0000","last_active":"2024-09-12T01:03:25.887776+0000","last_peered":"2024-09-12T01:03:25.887776+0000","last_clean":"2024-09-12T01:03:25.887776+0000","last_became_active":"2024-09-12T00:18:28.877233+0000","last_became_peered":"2024-09-12T00:18:28.877233+0000","last_unstale":"2024-09-12T01:03:25.887776+0000","last_undegraded":"2024-09-12T01:03:25.887776+0000","last_fullsized":"2024-09-12T01:03:25.887776+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:54.638936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":206,"num_read_kb":196,"num_write":136,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'788","reported_seq":2602,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.826688+0000","last_change":"2024-09-12T00:18:30.874256+0000","last_active":"2024-09-12T01:04:31.826688+0000","last_peered":"2024-09-12T01:04:31.826688+0000","last_clean":"2024-09-12T01:04:31.826688+0000","last_became_active":"2024-09-12T00:18:30.873484+0000","last_became_peered":"2024-09-12T00:18:30.873484+0000","last_unstale":"2024-09-12T01:04:31.826688+0000","last_undegraded":"2024-09-12T01:04:31.826688+0000","last_fullsized":"2024-09-12T01:04:31.826688+0000","mapping_epoch":32,"log_start":"268'702","ondisk_log_start":"268'702","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":702,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:48.826950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'163","reported_seq":681,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.836361+0000","last_change":"2024-09-12T00:18:32.894083+0000","last_active":"2024-09-12T01:04:30.836361+0000","last_peered":"2024-09-12T01:04:30.836361+0000","last_clean":"2024-09-12T01:04:30.836361+0000","last_became_active":"2024-09-12T00:18:32.893315+0000","last_became_peered":"2024-09-12T00:18:32.893315+0000","last_unstale":"2024-09-12T01:04:30.836361+0000","last_undegraded":"2024-09-12T01:04:30.836361+0000","last_fullsized":"2024-09-12T01:04:30.836361+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:09.991201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":201,"num_read_kb":185,"num_write":395,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'450","reported_seq":2014,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.120605+0000","last_change":"2024-09-12T00:18:24.866105+0000","last_active":"2024-09-12T01:03:25.120605+0000","last_peered":"2024-09-12T01:03:25.120605+0000","last_clean":"2024-09-12T01:03:25.120605+0000","last_became_active":"2024-09-12T00:18:24.865603+0000","last_became_peered":"2024-09-12T00:18:24.865603+0000","last_unstale":"2024-09-12T01:03:25.120605+0000","last_undegraded":"2024-09-12T01:03:25.120605+0000","last_fullsized":"2024-09-12T01:03:25.120605+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:38.883418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2591,"num_read_kb":2430,"num_write":539,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'278","reported_seq":902,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:14.657349+0000","last_change":"2024-09-12T00:18:22.870893+0000","last_active":"2024-09-12T01:02:14.657349+0000","last_peered":"2024-09-12T01:02:14.657349+0000","last_clean":"2024-09-12T01:02:14.657349+0000","last_became_active":"2024-09-12T00:18:22.870180+0000","last_became_peered":"2024-09-12T00:18:22.870180+0000","last_unstale":"2024-09-12T01:02:14.657349+0000","last_undegraded":"2024-09-12T01:02:14.657349+0000","last_fullsized":"2024-09-12T01:02:14.657349+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:39.546988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5273149,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":371,"num_read_kb":16363,"num_write":982,"num_write_kb":31356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:31.545792+0000","last_change":"2024-09-12T00:18:10.665231+0000","last_active":"2024-09-12T01:01:31.545792+0000","last_peered":"2024-09-12T01:01:31.545792+0000","last_clean":"2024-09-12T01:01:31.545792+0000","last_became_active":"2024-09-12T00:18:08.638003+0000","last_became_peered":"2024-09-12T00:18:08.638003+0000","last_unstale":"2024-09-12T01:01:31.545792+0000","last_undegraded":"2024-09-12T01:01:31.545792+0000","last_fullsized":"2024-09-12T01:01:31.545792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:05.656587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010953429999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.549583+0000","last_change":"2024-09-12T00:18:26.859001+0000","last_active":"2024-09-12T01:02:12.549583+0000","last_peered":"2024-09-12T01:02:12.549583+0000","last_clean":"2024-09-12T01:02:12.549583+0000","last_became_active":"2024-09-12T00:18:26.858300+0000","last_became_peered":"2024-09-12T00:18:26.858300+0000","last_unstale":"2024-09-12T01:02:12.549583+0000","last_undegraded":"2024-09-12T01:02:12.549583+0000","last_fullsized":"2024-09-12T01:02:12.549583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:24.947974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'109","reported_seq":658,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:17.552956+0000","last_change":"2024-09-12T00:18:28.882042+0000","last_active":"2024-09-12T01:02:17.552956+0000","last_peered":"2024-09-12T01:02:17.552956+0000","last_clean":"2024-09-12T01:02:17.552956+0000","last_became_active":"2024-09-12T00:18:28.880684+0000","last_became_peered":"2024-09-12T00:18:28.880684+0000","last_unstale":"2024-09-12T01:02:17.552956+0000","last_undegraded":"2024-09-12T01:02:17.552956+0000","last_fullsized":"2024-09-12T01:02:17.552956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:05.919489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'813","reported_seq":2638,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.835686+0000","last_change":"2024-09-12T00:18:30.903318+0000","last_active":"2024-09-12T01:04:31.835686+0000","last_peered":"2024-09-12T01:04:31.835686+0000","last_clean":"2024-09-12T01:04:31.835686+0000","last_became_active":"2024-09-12T00:18:30.902580+0000","last_became_peered":"2024-09-12T00:18:30.902580+0000","last_unstale":"2024-09-12T01:04:31.835686+0000","last_undegraded":"2024-09-12T01:04:31.835686+0000","last_fullsized":"2024-09-12T01:04:31.835686+0000","mapping_epoch":32,"log_start":"268'800","ondisk_log_start":"268'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":800,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:13.015304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'173","reported_seq":673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:24.492347+0000","last_change":"2024-09-12T00:18:32.903845+0000","last_active":"2024-09-12T01:03:24.492347+0000","last_peered":"2024-09-12T01:03:24.492347+0000","last_clean":"2024-09-12T01:03:24.492347+0000","last_became_active":"2024-09-12T00:18:32.902970+0000","last_became_peered":"2024-09-12T00:18:32.902970+0000","last_unstale":"2024-09-12T01:03:24.492347+0000","last_undegraded":"2024-09-12T01:03:24.492347+0000","last_fullsized":"2024-09-12T01:03:24.492347+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:29.969603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":388,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'588","reported_seq":2161,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.347778+0000","last_change":"2024-09-12T00:18:24.879885+0000","last_active":"2024-09-12T01:03:37.347778+0000","last_peered":"2024-09-12T01:03:37.347778+0000","last_clean":"2024-09-12T01:03:37.347778+0000","last_became_active":"2024-09-12T00:18:24.879205+0000","last_became_peered":"2024-09-12T00:18:24.879205+0000","last_unstale":"2024-09-12T01:03:37.347778+0000","last_undegraded":"2024-09-12T01:03:37.347778+0000","last_fullsized":"2024-09-12T01:03:37.347778+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":500,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:25.009708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":3160,"num_read_kb":2876,"num_write":787,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'273","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:42.596916+0000","last_change":"2024-09-12T00:18:22.850648+0000","last_active":"2024-09-12T01:02:42.596916+0000","last_peered":"2024-09-12T01:02:42.596916+0000","last_clean":"2024-09-12T01:02:42.596916+0000","last_became_active":"2024-09-12T00:18:22.850326+0000","last_became_peered":"2024-09-12T00:18:22.850326+0000","last_unstale":"2024-09-12T01:02:42.596916+0000","last_undegraded":"2024-09-12T01:02:42.596916+0000","last_fullsized":"2024-09-12T01:02:42.596916+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:20.333270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2120764,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":492,"num_read_kb":1531,"num_write":992,"num_write_kb":23375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:32.723228+0000","last_change":"2024-09-12T00:18:10.895554+0000","last_active":"2024-09-12T01:01:32.723228+0000","last_peered":"2024-09-12T01:01:32.723228+0000","last_clean":"2024-09-12T01:01:32.723228+0000","last_became_active":"2024-09-12T00:18:08.648187+0000","last_became_peered":"2024-09-12T00:18:08.648187+0000","last_unstale":"2024-09-12T01:01:32.723228+0000","last_undegraded":"2024-09-12T01:01:32.723228+0000","last_fullsized":"2024-09-12T01:01:32.723228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:14.147236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001130048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:31.765082+0000","last_change":"2024-09-12T00:18:26.851380+0000","last_active":"2024-09-12T01:02:31.765082+0000","last_peered":"2024-09-12T01:02:31.765082+0000","last_clean":"2024-09-12T01:02:31.765082+0000","last_became_active":"2024-09-12T00:18:26.851038+0000","last_became_peered":"2024-09-12T00:18:26.851038+0000","last_unstale":"2024-09-12T01:02:31.765082+0000","last_undegraded":"2024-09-12T01:02:31.765082+0000","last_fullsized":"2024-09-12T01:02:31.765082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:34.120180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'734","reported_seq":1445,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.743617+0000","last_change":"2024-09-12T00:18:28.885754+0000","last_active":"2024-09-12T01:04:31.743617+0000","last_peered":"2024-09-12T01:04:31.743617+0000","last_clean":"2024-09-12T01:04:31.743617+0000","last_became_active":"2024-09-12T00:18:28.884726+0000","last_became_peered":"2024-09-12T00:18:28.884726+0000","last_unstale":"2024-09-12T01:04:31.743617+0000","last_undegraded":"2024-09-12T01:04:31.743617+0000","last_fullsized":"2024-09-12T01:04:31.743617+0000","mapping_epoch":30,"log_start":"268'700","ondisk_log_start":"268'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":700,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:33.539730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187598,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1298,"num_read_kb":2803,"num_write":1074,"num_write_kb":914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:16.760930+0000","last_change":"2024-09-12T00:18:30.902052+0000","last_active":"2024-09-12T01:02:16.760930+0000","last_peered":"2024-09-12T01:02:16.760930+0000","last_clean":"2024-09-12T01:02:16.760930+0000","last_became_active":"2024-09-12T00:18:30.900777+0000","last_became_peered":"2024-09-12T00:18:30.900777+0000","last_unstale":"2024-09-12T01:02:16.760930+0000","last_undegraded":"2024-09-12T01:02:16.760930+0000","last_fullsized":"2024-09-12T01:02:16.760930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:05.763516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'111","reported_seq":608,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.877760+0000","last_change":"2024-09-12T00:18:32.900574+0000","last_active":"2024-09-12T01:03:25.877760+0000","last_peered":"2024-09-12T01:03:25.877760+0000","last_clean":"2024-09-12T01:03:25.877760+0000","last_became_active":"2024-09-12T00:18:32.899881+0000","last_became_peered":"2024-09-12T00:18:32.899881+0000","last_unstale":"2024-09-12T01:03:25.877760+0000","last_undegraded":"2024-09-12T01:03:25.877760+0000","last_fullsized":"2024-09-12T01:03:25.877760+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:39.617551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":105,"num_write":264,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'146","reported_seq":709,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.030418+0000","last_change":"2024-09-12T00:18:32.904423+0000","last_active":"2024-09-12T01:03:26.030418+0000","last_peered":"2024-09-12T01:03:26.030418+0000","last_clean":"2024-09-12T01:03:26.030418+0000","last_became_active":"2024-09-12T00:18:32.902596+0000","last_became_peered":"2024-09-12T00:18:32.902596+0000","last_unstale":"2024-09-12T01:03:26.030418+0000","last_undegraded":"2024-09-12T01:03:26.030418+0000","last_fullsized":"2024-09-12T01:03:26.030418+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:15.240829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":238,"num_read_kb":229,"num_write":342,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'482","reported_seq":2105,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.705235+0000","last_change":"2024-09-12T00:18:24.880298+0000","last_active":"2024-09-12T01:03:20.705235+0000","last_peered":"2024-09-12T01:03:20.705235+0000","last_clean":"2024-09-12T01:03:20.705235+0000","last_became_active":"2024-09-12T00:18:24.879640+0000","last_became_peered":"2024-09-12T00:18:24.879640+0000","last_unstale":"2024-09-12T01:03:20.705235+0000","last_undegraded":"2024-09-12T01:03:20.705235+0000","last_fullsized":"2024-09-12T01:03:20.705235+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:24.256945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2579,"num_read_kb":2446,"num_write":588,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'318","reported_seq":969,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:22.292716+0000","last_change":"2024-09-12T00:18:22.877577+0000","last_active":"2024-09-12T01:02:22.292716+0000","last_peered":"2024-09-12T01:02:22.292716+0000","last_clean":"2024-09-12T01:02:22.292716+0000","last_became_active":"2024-09-12T00:18:22.874059+0000","last_became_peered":"2024-09-12T00:18:22.874059+0000","last_unstale":"2024-09-12T01:02:22.292716+0000","last_undegraded":"2024-09-12T01:02:22.292716+0000","last_fullsized":"2024-09-12T01:02:22.292716+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:35.192212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14747835,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":494,"num_read_kb":19539,"num_write":1151,"num_write_kb":37354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:26.529417+0000","last_change":"2024-09-12T00:18:26.868055+0000","last_active":"2024-09-12T01:00:26.529417+0000","last_peered":"2024-09-12T01:00:26.529417+0000","last_clean":"2024-09-12T01:00:26.529417+0000","last_became_active":"2024-09-12T00:18:26.866940+0000","last_became_peered":"2024-09-12T00:18:26.866940+0000","last_unstale":"2024-09-12T01:00:26.529417+0000","last_undegraded":"2024-09-12T01:00:26.529417+0000","last_fullsized":"2024-09-12T01:00:26.529417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:32.546738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'289","reported_seq":872,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.848602+0000","last_change":"2024-09-12T00:18:28.878607+0000","last_active":"2024-09-12T01:04:30.848602+0000","last_peered":"2024-09-12T01:04:30.848602+0000","last_clean":"2024-09-12T01:04:30.848602+0000","last_became_active":"2024-09-12T00:18:28.877560+0000","last_became_peered":"2024-09-12T00:18:28.877560+0000","last_unstale":"2024-09-12T01:04:30.848602+0000","last_undegraded":"2024-09-12T01:04:30.848602+0000","last_fullsized":"2024-09-12T01:04:30.848602+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:45.619406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55164,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":468,"num_read_kb":971,"num_write":386,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:31.733041+0000","last_change":"2024-09-12T00:18:30.903541+0000","last_active":"2024-09-12T01:00:31.733041+0000","last_peered":"2024-09-12T01:00:31.733041+0000","last_clean":"2024-09-12T01:00:31.733041+0000","last_became_active":"2024-09-12T00:18:30.901022+0000","last_became_peered":"2024-09-12T00:18:30.901022+0000","last_unstale":"2024-09-12T01:00:31.733041+0000","last_undegraded":"2024-09-12T01:00:31.733041+0000","last_fullsized":"2024-09-12T01:00:31.733041+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:14.300352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'140","reported_seq":653,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.196600+0000","last_change":"2024-09-12T00:18:32.901918+0000","last_active":"2024-09-12T01:03:01.196600+0000","last_peered":"2024-09-12T01:03:01.196600+0000","last_clean":"2024-09-12T01:03:01.196600+0000","last_became_active":"2024-09-12T00:18:32.900434+0000","last_became_peered":"2024-09-12T00:18:32.900434+0000","last_unstale":"2024-09-12T01:03:01.196600+0000","last_undegraded":"2024-09-12T01:03:01.196600+0000","last_fullsized":"2024-09-12T01:03:01.196600+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:49.600913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":83,"num_write":305,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'543","reported_seq":1959,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.741300+0000","last_change":"2024-09-12T00:18:24.878881+0000","last_active":"2024-09-12T01:03:06.741300+0000","last_peered":"2024-09-12T01:03:06.741300+0000","last_clean":"2024-09-12T01:03:06.741300+0000","last_became_active":"2024-09-12T00:18:24.878531+0000","last_became_peered":"2024-09-12T00:18:24.878531+0000","last_unstale":"2024-09-12T01:03:06.741300+0000","last_undegraded":"2024-09-12T01:03:06.741300+0000","last_fullsized":"2024-09-12T01:03:06.741300+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:48.183195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2546,"num_read_kb":2313,"num_write":710,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'336","reported_seq":1058,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:52.543841+0000","last_change":"2024-09-12T00:18:56.194776+0000","last_active":"2024-09-12T01:01:52.543841+0000","last_peered":"2024-09-12T01:01:52.543841+0000","last_clean":"2024-09-12T01:01:52.543841+0000","last_became_active":"2024-09-12T00:18:56.193958+0000","last_became_peered":"2024-09-12T00:18:56.193958+0000","last_unstale":"2024-09-12T01:01:52.543841+0000","last_undegraded":"2024-09-12T01:01:52.543841+0000","last_fullsized":"2024-09-12T01:01:52.543841+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:37.859959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8411057,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":707,"num_read_kb":16311,"num_write":1176,"num_write_kb":28883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:26.731697+0000","last_change":"2024-09-12T00:18:26.852947+0000","last_active":"2024-09-12T01:00:26.731697+0000","last_peered":"2024-09-12T01:00:26.731697+0000","last_clean":"2024-09-12T01:00:26.731697+0000","last_became_active":"2024-09-12T00:18:26.852430+0000","last_became_peered":"2024-09-12T00:18:26.852430+0000","last_unstale":"2024-09-12T01:00:26.731697+0000","last_undegraded":"2024-09-12T01:00:26.731697+0000","last_fullsized":"2024-09-12T01:00:26.731697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:06.569149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'47","reported_seq":552,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:16.496467+0000","last_change":"2024-09-12T00:18:28.889342+0000","last_active":"2024-09-12T01:02:16.496467+0000","last_peered":"2024-09-12T01:02:16.496467+0000","last_clean":"2024-09-12T01:02:16.496467+0000","last_became_active":"2024-09-12T00:18:28.888625+0000","last_became_peered":"2024-09-12T00:18:28.888625+0000","last_unstale":"2024-09-12T01:02:16.496467+0000","last_undegraded":"2024-09-12T01:02:16.496467+0000","last_fullsized":"2024-09-12T01:02:16.496467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:38.074165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:32.525392+0000","last_change":"2024-09-12T00:18:30.895269+0000","last_active":"2024-09-12T01:00:32.525392+0000","last_peered":"2024-09-12T01:00:32.525392+0000","last_clean":"2024-09-12T01:00:32.525392+0000","last_became_active":"2024-09-12T00:18:30.894388+0000","last_became_peered":"2024-09-12T00:18:30.894388+0000","last_unstale":"2024-09-12T01:00:32.525392+0000","last_undegraded":"2024-09-12T01:00:32.525392+0000","last_fullsized":"2024-09-12T01:00:32.525392+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:32.983260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'210","reported_seq":728,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.127161+0000","last_change":"2024-09-12T00:18:32.904521+0000","last_active":"2024-09-12T01:03:25.127161+0000","last_peered":"2024-09-12T01:03:25.127161+0000","last_clean":"2024-09-12T01:03:25.127161+0000","last_became_active":"2024-09-12T00:18:32.903719+0000","last_became_peered":"2024-09-12T00:18:32.903719+0000","last_unstale":"2024-09-12T01:03:25.127161+0000","last_undegraded":"2024-09-12T01:03:25.127161+0000","last_fullsized":"2024-09-12T01:03:25.127161+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:22.565162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":286,"num_read_kb":283,"num_write":470,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'850","reported_seq":2448,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.178028+0000","last_change":"2024-09-12T00:18:24.865796+0000","last_active":"2024-09-12T01:03:11.178028+0000","last_peered":"2024-09-12T01:03:11.178028+0000","last_clean":"2024-09-12T01:03:11.178028+0000","last_became_active":"2024-09-12T00:18:24.865480+0000","last_became_peered":"2024-09-12T00:18:24.865480+0000","last_unstale":"2024-09-12T01:03:11.178028+0000","last_undegraded":"2024-09-12T01:03:11.178028+0000","last_fullsized":"2024-09-12T01:03:11.178028+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":800,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:13.433725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4053,"num_read_kb":3643,"num_write":1115,"num_write_kb":411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'315","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.732591+0000","last_change":"2024-09-12T00:18:55.955883+0000","last_active":"2024-09-12T01:03:09.732591+0000","last_peered":"2024-09-12T01:03:09.732591+0000","last_clean":"2024-09-12T01:03:09.732591+0000","last_became_active":"2024-09-12T00:18:55.955303+0000","last_became_peered":"2024-09-12T00:18:55.955303+0000","last_unstale":"2024-09-12T01:03:09.732591+0000","last_undegraded":"2024-09-12T01:03:09.732591+0000","last_fullsized":"2024-09-12T01:03:09.732591+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:26.714282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11123122,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":524,"num_read_kb":40569,"num_write":1286,"num_write_kb":40151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:27.524107+0000","last_change":"2024-09-12T00:18:26.860720+0000","last_active":"2024-09-12T01:00:27.524107+0000","last_peered":"2024-09-12T01:00:27.524107+0000","last_clean":"2024-09-12T01:00:27.524107+0000","last_became_active":"2024-09-12T00:18:26.859801+0000","last_became_peered":"2024-09-12T00:18:26.859801+0000","last_unstale":"2024-09-12T01:00:27.524107+0000","last_undegraded":"2024-09-12T01:00:27.524107+0000","last_fullsized":"2024-09-12T01:00:27.524107+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:36.551977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'311","reported_seq":904,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.770214+0000","last_change":"2024-09-12T00:18:28.878040+0000","last_active":"2024-09-12T01:02:51.770214+0000","last_peered":"2024-09-12T01:02:51.770214+0000","last_clean":"2024-09-12T01:02:51.770214+0000","last_became_active":"2024-09-12T00:18:28.877317+0000","last_became_peered":"2024-09-12T00:18:28.877317+0000","last_unstale":"2024-09-12T01:02:51.770214+0000","last_undegraded":"2024-09-12T01:02:51.770214+0000","last_fullsized":"2024-09-12T01:02:51.770214+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:36.629509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62859,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":1022,"num_write":412,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:32.710908+0000","last_change":"2024-09-12T00:18:30.904722+0000","last_active":"2024-09-12T01:00:32.710908+0000","last_peered":"2024-09-12T01:00:32.710908+0000","last_clean":"2024-09-12T01:00:32.710908+0000","last_became_active":"2024-09-12T00:18:30.904052+0000","last_became_peered":"2024-09-12T00:18:30.904052+0000","last_unstale":"2024-09-12T01:00:32.710908+0000","last_undegraded":"2024-09-12T01:00:32.710908+0000","last_fullsized":"2024-09-12T01:00:32.710908+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:47.904502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'138","reported_seq":657,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.556907+0000","last_change":"2024-09-12T00:18:32.900262+0000","last_active":"2024-09-12T01:03:23.556907+0000","last_peered":"2024-09-12T01:03:23.556907+0000","last_clean":"2024-09-12T01:03:23.556907+0000","last_became_active":"2024-09-12T00:18:32.899607+0000","last_became_peered":"2024-09-12T00:18:32.899607+0000","last_unstale":"2024-09-12T01:03:23.556907+0000","last_undegraded":"2024-09-12T01:03:23.556907+0000","last_fullsized":"2024-09-12T01:03:23.556907+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:26.707774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":193,"num_read_kb":183,"num_write":356,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'350","reported_seq":1891,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.346899+0000","last_change":"2024-09-12T00:18:24.863688+0000","last_active":"2024-09-12T01:03:37.346899+0000","last_peered":"2024-09-12T01:03:37.346899+0000","last_clean":"2024-09-12T01:03:37.346899+0000","last_became_active":"2024-09-12T00:18:24.863389+0000","last_became_peered":"2024-09-12T00:18:24.863389+0000","last_unstale":"2024-09-12T01:03:37.346899+0000","last_undegraded":"2024-09-12T01:03:37.346899+0000","last_fullsized":"2024-09-12T01:03:37.346899+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:05.818950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2172,"num_read_kb":2099,"num_write":388,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'285","reported_seq":919,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:13.851507+0000","last_change":"2024-09-12T00:18:22.863804+0000","last_active":"2024-09-12T01:02:13.851507+0000","last_peered":"2024-09-12T01:02:13.851507+0000","last_clean":"2024-09-12T01:02:13.851507+0000","last_became_active":"2024-09-12T00:18:22.863535+0000","last_became_peered":"2024-09-12T00:18:22.863535+0000","last_unstale":"2024-09-12T01:02:13.851507+0000","last_undegraded":"2024-09-12T01:02:13.851507+0000","last_fullsized":"2024-09-12T01:02:13.851507+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:39.498808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2451042,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":431,"num_read_kb":3769,"num_write":1015,"num_write_kb":28344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:27.709827+0000","last_change":"2024-09-12T00:18:26.875530+0000","last_active":"2024-09-12T01:00:27.709827+0000","last_peered":"2024-09-12T01:00:27.709827+0000","last_clean":"2024-09-12T01:00:27.709827+0000","last_became_active":"2024-09-12T00:18:26.874839+0000","last_became_peered":"2024-09-12T00:18:26.874839+0000","last_unstale":"2024-09-12T01:00:27.709827+0000","last_undegraded":"2024-09-12T01:00:27.709827+0000","last_fullsized":"2024-09-12T01:00:27.709827+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:15.854373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'266","reported_seq":830,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.557384+0000","last_change":"2024-09-12T00:18:28.891511+0000","last_active":"2024-09-12T01:02:52.557384+0000","last_peered":"2024-09-12T01:02:52.557384+0000","last_clean":"2024-09-12T01:02:52.557384+0000","last_became_active":"2024-09-12T00:18:28.888325+0000","last_became_peered":"2024-09-12T00:18:28.888325+0000","last_unstale":"2024-09-12T01:02:52.557384+0000","last_undegraded":"2024-09-12T01:02:52.557384+0000","last_fullsized":"2024-09-12T01:02:52.557384+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:42.542012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61114,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":440,"num_read_kb":948,"num_write":366,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":491,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:31.547022+0000","last_change":"2024-09-12T00:18:30.900318+0000","last_active":"2024-09-12T01:00:31.547022+0000","last_peered":"2024-09-12T01:00:31.547022+0000","last_clean":"2024-09-12T01:00:31.547022+0000","last_became_active":"2024-09-12T00:18:30.899237+0000","last_became_peered":"2024-09-12T00:18:30.899237+0000","last_unstale":"2024-09-12T01:00:31.547022+0000","last_undegraded":"2024-09-12T01:00:31.547022+0000","last_fullsized":"2024-09-12T01:00:31.547022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:30.916112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'930","reported_seq":2365,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.094892+0000","last_change":"2024-09-12T00:18:24.861100+0000","last_active":"2024-09-12T01:03:04.094892+0000","last_peered":"2024-09-12T01:03:04.094892+0000","last_clean":"2024-09-12T01:03:04.094892+0000","last_became_active":"2024-09-12T00:18:24.859351+0000","last_became_peered":"2024-09-12T00:18:24.859351+0000","last_unstale":"2024-09-12T01:03:04.094892+0000","last_undegraded":"2024-09-12T01:03:04.094892+0000","last_fullsized":"2024-09-12T01:03:04.094892+0000","mapping_epoch":26,"log_start":"268'900","ondisk_log_start":"268'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":900,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:16.033612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4324,"num_read_kb":3896,"num_write":1355,"num_write_kb":567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'249","reported_seq":949,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.755421+0000","last_change":"2024-09-12T00:18:22.840532+0000","last_active":"2024-09-12T01:01:56.755421+0000","last_peered":"2024-09-12T01:01:56.755421+0000","last_clean":"2024-09-12T01:01:56.755421+0000","last_became_active":"2024-09-12T00:18:22.840244+0000","last_became_peered":"2024-09-12T00:18:22.840244+0000","last_unstale":"2024-09-12T01:01:56.755421+0000","last_undegraded":"2024-09-12T01:01:56.755421+0000","last_fullsized":"2024-09-12T01:01:56.755421+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:57.476911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5274976,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":554,"num_read_kb":30344,"num_write":897,"num_write_kb":34968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:36.582308+0000","last_change":"2024-09-12T00:18:26.856078+0000","last_active":"2024-09-12T01:02:36.582308+0000","last_peered":"2024-09-12T01:02:36.582308+0000","last_clean":"2024-09-12T01:02:36.582308+0000","last_became_active":"2024-09-12T00:18:26.855432+0000","last_became_peered":"2024-09-12T00:18:26.855432+0000","last_unstale":"2024-09-12T01:02:36.582308+0000","last_undegraded":"2024-09-12T01:02:36.582308+0000","last_fullsized":"2024-09-12T01:02:36.582308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:58.468112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'459","reported_seq":1092,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.736135+0000","last_change":"2024-09-12T00:18:28.888006+0000","last_active":"2024-09-12T01:04:31.736135+0000","last_peered":"2024-09-12T01:04:31.736135+0000","last_clean":"2024-09-12T01:04:31.736135+0000","last_became_active":"2024-09-12T00:18:28.887245+0000","last_became_peered":"2024-09-12T00:18:28.887245+0000","last_unstale":"2024-09-12T01:04:31.736135+0000","last_undegraded":"2024-09-12T01:04:31.736135+0000","last_fullsized":"2024-09-12T01:04:31.736135+0000","mapping_epoch":30,"log_start":"268'400","ondisk_log_start":"268'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:58.763012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105863,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":819,"num_read_kb":1744,"num_write":714,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":490,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.736385+0000","last_change":"2024-09-12T00:18:30.906327+0000","last_active":"2024-09-12T01:01:02.736385+0000","last_peered":"2024-09-12T01:01:02.736385+0000","last_clean":"2024-09-12T01:01:02.736385+0000","last_became_active":"2024-09-12T00:18:30.905680+0000","last_became_peered":"2024-09-12T00:18:30.905680+0000","last_unstale":"2024-09-12T01:01:02.736385+0000","last_undegraded":"2024-09-12T01:01:02.736385+0000","last_fullsized":"2024-09-12T01:01:02.736385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:50.953253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'152","reported_seq":659,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:43.232099+0000","last_change":"2024-09-12T00:18:32.905858+0000","last_active":"2024-09-12T01:02:43.232099+0000","last_peered":"2024-09-12T01:02:43.232099+0000","last_clean":"2024-09-12T01:02:43.232099+0000","last_became_active":"2024-09-12T00:18:32.905070+0000","last_became_peered":"2024-09-12T00:18:32.905070+0000","last_unstale":"2024-09-12T01:02:43.232099+0000","last_undegraded":"2024-09-12T01:02:43.232099+0000","last_fullsized":"2024-09-12T01:02:43.232099+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:11.929111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":167,"num_read_kb":179,"num_write":337,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'639","reported_seq":2054,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.704634+0000","last_change":"2024-09-12T00:18:24.865575+0000","last_active":"2024-09-12T01:03:20.704634+0000","last_peered":"2024-09-12T01:03:20.704634+0000","last_clean":"2024-09-12T01:03:20.704634+0000","last_became_active":"2024-09-12T00:18:24.865142+0000","last_became_peered":"2024-09-12T00:18:24.865142+0000","last_unstale":"2024-09-12T01:03:20.704634+0000","last_undegraded":"2024-09-12T01:03:20.704634+0000","last_fullsized":"2024-09-12T01:03:20.704634+0000","mapping_epoch":26,"log_start":"268'600","ondisk_log_start":"268'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":600,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:47.722129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2990,"num_read_kb":2759,"num_write":892,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'290","reported_seq":1214,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:06.553575+0000","last_change":"2024-09-12T00:18:22.846016+0000","last_active":"2024-09-12T01:02:06.553575+0000","last_peered":"2024-09-12T01:02:06.553575+0000","last_clean":"2024-09-12T01:02:06.553575+0000","last_became_active":"2024-09-12T00:18:22.845288+0000","last_became_peered":"2024-09-12T00:18:22.845288+0000","last_unstale":"2024-09-12T01:02:06.553575+0000","last_undegraded":"2024-09-12T01:02:06.553575+0000","last_fullsized":"2024-09-12T01:02:06.553575+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:08.062033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2200296,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1065,"num_read_kb":11057,"num_write":1161,"num_write_kb":25104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.731837+0000","last_change":"2024-09-12T00:18:26.875611+0000","last_active":"2024-09-12T01:02:12.731837+0000","last_peered":"2024-09-12T01:02:12.731837+0000","last_clean":"2024-09-12T01:02:12.731837+0000","last_became_active":"2024-09-12T00:18:26.874972+0000","last_became_peered":"2024-09-12T00:18:26.874972+0000","last_unstale":"2024-09-12T01:02:12.731837+0000","last_undegraded":"2024-09-12T01:02:12.731837+0000","last_fullsized":"2024-09-12T01:02:12.731837+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:26.192283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'312","reported_seq":890,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:32.566874+0000","last_change":"2024-09-12T00:18:28.893601+0000","last_active":"2024-09-12T01:03:32.566874+0000","last_peered":"2024-09-12T01:03:32.566874+0000","last_clean":"2024-09-12T01:03:32.566874+0000","last_became_active":"2024-09-12T00:18:28.892852+0000","last_became_peered":"2024-09-12T00:18:28.892852+0000","last_unstale":"2024-09-12T01:03:32.566874+0000","last_undegraded":"2024-09-12T01:03:32.566874+0000","last_fullsized":"2024-09-12T01:03:32.566874+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:16.294300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66489,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":526,"num_read_kb":1071,"num_write":450,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:01.538521+0000","last_change":"2024-09-12T00:18:30.893248+0000","last_active":"2024-09-12T01:01:01.538521+0000","last_peered":"2024-09-12T01:01:01.538521+0000","last_clean":"2024-09-12T01:01:01.538521+0000","last_became_active":"2024-09-12T00:18:30.892643+0000","last_became_peered":"2024-09-12T00:18:30.892643+0000","last_unstale":"2024-09-12T01:01:01.538521+0000","last_undegraded":"2024-09-12T01:01:01.538521+0000","last_fullsized":"2024-09-12T01:01:01.538521+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:18.646293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'240","reported_seq":780,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.132867+0000","last_change":"2024-09-12T00:18:32.902236+0000","last_active":"2024-09-12T01:03:02.132867+0000","last_peered":"2024-09-12T01:03:02.132867+0000","last_clean":"2024-09-12T01:03:02.132867+0000","last_became_active":"2024-09-12T00:18:32.901587+0000","last_became_peered":"2024-09-12T00:18:32.901587+0000","last_unstale":"2024-09-12T01:03:02.132867+0000","last_undegraded":"2024-09-12T01:03:02.132867+0000","last_fullsized":"2024-09-12T01:03:02.132867+0000","mapping_epoch":34,"log_start":"268'200","ondisk_log_start":"268'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:22.015039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":371,"num_read_kb":330,"num_write":585,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'492","reported_seq":2033,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.884678+0000","last_change":"2024-09-12T00:18:24.861062+0000","last_active":"2024-09-12T01:03:25.884678+0000","last_peered":"2024-09-12T01:03:25.884678+0000","last_clean":"2024-09-12T01:03:25.884678+0000","last_became_active":"2024-09-12T00:18:24.860647+0000","last_became_peered":"2024-09-12T00:18:24.860647+0000","last_unstale":"2024-09-12T01:03:25.884678+0000","last_undegraded":"2024-09-12T01:03:25.884678+0000","last_fullsized":"2024-09-12T01:03:25.884678+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:16.460437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2720,"num_read_kb":2539,"num_write":620,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'302","reported_seq":975,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.259914+0000","last_change":"2024-09-12T00:18:22.856961+0000","last_active":"2024-09-12T01:04:24.259914+0000","last_peered":"2024-09-12T01:04:24.259914+0000","last_clean":"2024-09-12T01:04:24.259914+0000","last_became_active":"2024-09-12T00:18:22.856073+0000","last_became_peered":"2024-09-12T00:18:22.856073+0000","last_unstale":"2024-09-12T01:04:24.259914+0000","last_undegraded":"2024-09-12T01:04:24.259914+0000","last_fullsized":"2024-09-12T01:04:24.259914+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:02.567076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5779758,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":509,"num_read_kb":15674,"num_write":1060,"num_write_kb":22765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.532329+0000","last_change":"2024-09-12T00:18:26.862928+0000","last_active":"2024-09-12T01:00:57.532329+0000","last_peered":"2024-09-12T01:00:57.532329+0000","last_clean":"2024-09-12T01:00:57.532329+0000","last_became_active":"2024-09-12T00:18:26.862012+0000","last_became_peered":"2024-09-12T00:18:26.862012+0000","last_unstale":"2024-09-12T01:00:57.532329+0000","last_undegraded":"2024-09-12T01:00:57.532329+0000","last_fullsized":"2024-09-12T01:00:57.532329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:16.642244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'273","reported_seq":859,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:21.788196+0000","last_change":"2024-09-12T00:18:28.882861+0000","last_active":"2024-09-12T01:04:21.788196+0000","last_peered":"2024-09-12T01:04:21.788196+0000","last_clean":"2024-09-12T01:04:21.788196+0000","last_became_active":"2024-09-12T00:18:28.882129+0000","last_became_peered":"2024-09-12T00:18:28.882129+0000","last_unstale":"2024-09-12T01:04:21.788196+0000","last_undegraded":"2024-09-12T01:04:21.788196+0000","last_fullsized":"2024-09-12T01:04:21.788196+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:30.970755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56241,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":449,"num_read_kb":926,"num_write":366,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.532795+0000","last_change":"2024-09-12T00:18:30.906689+0000","last_active":"2024-09-12T01:00:41.532795+0000","last_peered":"2024-09-12T01:00:41.532795+0000","last_clean":"2024-09-12T01:00:41.532795+0000","last_became_active":"2024-09-12T00:18:30.902511+0000","last_became_peered":"2024-09-12T00:18:30.902511+0000","last_unstale":"2024-09-12T01:00:41.532795+0000","last_undegraded":"2024-09-12T01:00:41.532795+0000","last_fullsized":"2024-09-12T01:00:41.532795+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:02.675233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'129","reported_seq":646,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.800676+0000","last_change":"2024-09-12T00:18:32.901622+0000","last_active":"2024-09-12T01:04:31.800676+0000","last_peered":"2024-09-12T01:04:31.800676+0000","last_clean":"2024-09-12T01:04:31.800676+0000","last_became_active":"2024-09-12T00:18:32.899968+0000","last_became_peered":"2024-09-12T00:18:32.899968+0000","last_unstale":"2024-09-12T01:04:31.800676+0000","last_undegraded":"2024-09-12T01:04:31.800676+0000","last_fullsized":"2024-09-12T01:04:31.800676+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:05.182292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":825,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":214,"num_read_kb":184,"num_write":320,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'363","reported_seq":1735,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.094141+0000","last_change":"2024-09-12T00:18:24.861615+0000","last_active":"2024-09-12T01:03:04.094141+0000","last_peered":"2024-09-12T01:03:04.094141+0000","last_clean":"2024-09-12T01:03:04.094141+0000","last_became_active":"2024-09-12T00:18:24.861271+0000","last_became_peered":"2024-09-12T00:18:24.861271+0000","last_unstale":"2024-09-12T01:03:04.094141+0000","last_undegraded":"2024-09-12T01:03:04.094141+0000","last_fullsized":"2024-09-12T01:03:04.094141+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:54.383255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2074,"num_read_kb":1954,"num_write":427,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'279","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:19.184085+0000","last_change":"2024-09-12T00:18:22.860377+0000","last_active":"2024-09-12T01:02:19.184085+0000","last_peered":"2024-09-12T01:02:19.184085+0000","last_clean":"2024-09-12T01:02:19.184085+0000","last_became_active":"2024-09-12T00:18:22.859695+0000","last_became_peered":"2024-09-12T00:18:22.859695+0000","last_unstale":"2024-09-12T01:02:19.184085+0000","last_undegraded":"2024-09-12T01:02:19.184085+0000","last_fullsized":"2024-09-12T01:02:19.184085+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:06.061275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8676243,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":415,"num_read_kb":12424,"num_write":1046,"num_write_kb":25448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:56.536187+0000","last_change":"2024-09-12T00:18:26.859701+0000","last_active":"2024-09-12T01:00:56.536187+0000","last_peered":"2024-09-12T01:00:56.536187+0000","last_clean":"2024-09-12T01:00:56.536187+0000","last_became_active":"2024-09-12T00:18:26.859234+0000","last_became_peered":"2024-09-12T00:18:26.859234+0000","last_unstale":"2024-09-12T01:00:56.536187+0000","last_undegraded":"2024-09-12T01:00:56.536187+0000","last_fullsized":"2024-09-12T01:00:56.536187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:11.914399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'122","reported_seq":655,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:18.833187+0000","last_change":"2024-09-12T00:18:28.884827+0000","last_active":"2024-09-12T01:02:18.833187+0000","last_peered":"2024-09-12T01:02:18.833187+0000","last_clean":"2024-09-12T01:02:18.833187+0000","last_became_active":"2024-09-12T00:18:28.883277+0000","last_became_peered":"2024-09-12T00:18:28.883277+0000","last_unstale":"2024-09-12T01:02:18.833187+0000","last_undegraded":"2024-09-12T01:02:18.833187+0000","last_fullsized":"2024-09-12T01:02:18.833187+0000","mapping_epoch":30,"log_start":"268'100","ondisk_log_start":"268'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:38.381310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":135,"num_read_kb":124,"num_write":148,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'765","reported_seq":2196,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.824090+0000","last_change":"2024-09-12T00:18:30.895935+0000","last_active":"2024-09-12T01:04:31.824090+0000","last_peered":"2024-09-12T01:04:31.824090+0000","last_clean":"2024-09-12T01:04:31.824090+0000","last_became_active":"2024-09-12T00:18:30.893175+0000","last_became_peered":"2024-09-12T00:18:30.893175+0000","last_unstale":"2024-09-12T01:04:31.824090+0000","last_undegraded":"2024-09-12T01:04:31.824090+0000","last_fullsized":"2024-09-12T01:04:31.824090+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:51.257227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'108","reported_seq":602,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.731248+0000","last_change":"2024-09-12T00:18:32.909110+0000","last_active":"2024-09-12T01:03:06.731248+0000","last_peered":"2024-09-12T01:03:06.731248+0000","last_clean":"2024-09-12T01:03:06.731248+0000","last_became_active":"2024-09-12T00:18:32.908295+0000","last_became_peered":"2024-09-12T00:18:32.908295+0000","last_unstale":"2024-09-12T01:03:06.731248+0000","last_undegraded":"2024-09-12T01:03:06.731248+0000","last_fullsized":"2024-09-12T01:03:06.731248+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:19.170686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":102,"num_write":264,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'833","reported_seq":2453,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.192049+0000","last_change":"2024-09-12T00:18:24.861275+0000","last_active":"2024-09-12T01:03:11.192049+0000","last_peered":"2024-09-12T01:03:11.192049+0000","last_clean":"2024-09-12T01:03:11.192049+0000","last_became_active":"2024-09-12T00:18:24.860266+0000","last_became_peered":"2024-09-12T00:18:24.860266+0000","last_unstale":"2024-09-12T01:03:11.192049+0000","last_undegraded":"2024-09-12T01:03:11.192049+0000","last_fullsized":"2024-09-12T01:03:11.192049+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":800,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:29.020383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4128,"num_read_kb":3735,"num_write":1126,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'256","reported_seq":860,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.904315+0000","last_change":"2024-09-12T00:18:22.872906+0000","last_active":"2024-09-12T01:03:21.904315+0000","last_peered":"2024-09-12T01:03:21.904315+0000","last_clean":"2024-09-12T01:03:21.904315+0000","last_became_active":"2024-09-12T00:18:22.867694+0000","last_became_peered":"2024-09-12T00:18:22.867694+0000","last_unstale":"2024-09-12T01:03:21.904315+0000","last_undegraded":"2024-09-12T01:03:21.904315+0000","last_fullsized":"2024-09-12T01:03:21.904315+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:34.546151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7347981,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":350,"num_read_kb":19923,"num_write":927,"num_write_kb":45748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.531105+0000","last_change":"2024-09-12T00:18:26.865232+0000","last_active":"2024-09-12T01:00:57.531105+0000","last_peered":"2024-09-12T01:00:57.531105+0000","last_clean":"2024-09-12T01:00:57.531105+0000","last_became_active":"2024-09-12T00:18:26.864536+0000","last_became_peered":"2024-09-12T00:18:26.864536+0000","last_unstale":"2024-09-12T01:00:57.531105+0000","last_undegraded":"2024-09-12T01:00:57.531105+0000","last_fullsized":"2024-09-12T01:00:57.531105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:55.926276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'332","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.720502+0000","last_change":"2024-09-12T00:18:28.885849+0000","last_active":"2024-09-12T01:04:31.720502+0000","last_peered":"2024-09-12T01:04:31.720502+0000","last_clean":"2024-09-12T01:04:31.720502+0000","last_became_active":"2024-09-12T00:18:28.885152+0000","last_became_peered":"2024-09-12T00:18:28.885152+0000","last_unstale":"2024-09-12T01:04:31.720502+0000","last_undegraded":"2024-09-12T01:04:31.720502+0000","last_fullsized":"2024-09-12T01:04:31.720502+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:29.158839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62718,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":526,"num_read_kb":1016,"num_write":430,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":491,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:01.573124+0000","last_change":"2024-09-12T00:18:30.895751+0000","last_active":"2024-09-12T01:02:01.573124+0000","last_peered":"2024-09-12T01:02:01.573124+0000","last_clean":"2024-09-12T01:02:01.573124+0000","last_became_active":"2024-09-12T00:18:30.888974+0000","last_became_peered":"2024-09-12T00:18:30.888974+0000","last_unstale":"2024-09-12T01:02:01.573124+0000","last_undegraded":"2024-09-12T01:02:01.573124+0000","last_fullsized":"2024-09-12T01:02:01.573124+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:53.240426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'97","reported_seq":604,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.290751+0000","last_change":"2024-09-12T00:18:32.915634+0000","last_active":"2024-09-12T01:03:23.290751+0000","last_peered":"2024-09-12T01:03:23.290751+0000","last_clean":"2024-09-12T01:03:23.290751+0000","last_became_active":"2024-09-12T00:18:32.914994+0000","last_became_peered":"2024-09-12T00:18:32.914994+0000","last_unstale":"2024-09-12T01:03:23.290751+0000","last_undegraded":"2024-09-12T01:03:23.290751+0000","last_fullsized":"2024-09-12T01:03:23.290751+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:03.290807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":129,"num_write":234,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'858","reported_seq":2375,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.841192+0000","last_change":"2024-09-12T00:18:24.854861+0000","last_active":"2024-09-12T01:04:30.841192+0000","last_peered":"2024-09-12T01:04:30.841192+0000","last_clean":"2024-09-12T01:04:30.841192+0000","last_became_active":"2024-09-12T00:18:24.854089+0000","last_became_peered":"2024-09-12T00:18:24.854089+0000","last_unstale":"2024-09-12T01:04:30.841192+0000","last_undegraded":"2024-09-12T01:04:30.841192+0000","last_fullsized":"2024-09-12T01:04:30.841192+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":800,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:09.009238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4036,"num_read_kb":3617,"num_write":1169,"num_write_kb":474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'279","reported_seq":914,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.988464+0000","last_change":"2024-09-12T00:18:22.876376+0000","last_active":"2024-09-12T01:02:56.988464+0000","last_peered":"2024-09-12T01:02:56.988464+0000","last_clean":"2024-09-12T01:02:56.988464+0000","last_became_active":"2024-09-12T00:18:22.867744+0000","last_became_peered":"2024-09-12T00:18:22.867744+0000","last_unstale":"2024-09-12T01:02:56.988464+0000","last_undegraded":"2024-09-12T01:02:56.988464+0000","last_fullsized":"2024-09-12T01:02:56.988464+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:17.533748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1050382,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":454,"num_read_kb":9523,"num_write":1132,"num_write_kb":17845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.735193+0000","last_change":"2024-09-12T00:18:26.858490+0000","last_active":"2024-09-12T01:00:57.735193+0000","last_peered":"2024-09-12T01:00:57.735193+0000","last_clean":"2024-09-12T01:00:57.735193+0000","last_became_active":"2024-09-12T00:18:26.857810+0000","last_became_peered":"2024-09-12T00:18:26.857810+0000","last_unstale":"2024-09-12T01:00:57.735193+0000","last_undegraded":"2024-09-12T01:00:57.735193+0000","last_fullsized":"2024-09-12T01:00:57.735193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:16.264419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'250","reported_seq":822,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:26.605251+0000","last_change":"2024-09-12T00:18:28.882323+0000","last_active":"2024-09-12T01:04:26.605251+0000","last_peered":"2024-09-12T01:04:26.605251+0000","last_clean":"2024-09-12T01:04:26.605251+0000","last_became_active":"2024-09-12T00:18:28.881556+0000","last_became_peered":"2024-09-12T00:18:28.881556+0000","last_unstale":"2024-09-12T01:04:26.605251+0000","last_undegraded":"2024-09-12T01:04:26.605251+0000","last_fullsized":"2024-09-12T01:04:26.605251+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:58.134241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56925,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":417,"num_read_kb":875,"num_write":340,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:07.730322+0000","last_change":"2024-09-12T00:18:30.902376+0000","last_active":"2024-09-12T01:02:07.730322+0000","last_peered":"2024-09-12T01:02:07.730322+0000","last_clean":"2024-09-12T01:02:07.730322+0000","last_became_active":"2024-09-12T00:18:30.898539+0000","last_became_peered":"2024-09-12T00:18:30.898539+0000","last_unstale":"2024-09-12T01:02:07.730322+0000","last_undegraded":"2024-09-12T01:02:07.730322+0000","last_fullsized":"2024-09-12T01:02:07.730322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:18.476695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'110","reported_seq":637,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.199453+0000","last_change":"2024-09-12T00:18:32.908261+0000","last_active":"2024-09-12T01:03:08.199453+0000","last_peered":"2024-09-12T01:03:08.199453+0000","last_clean":"2024-09-12T01:03:08.199453+0000","last_became_active":"2024-09-12T00:18:32.907530+0000","last_became_peered":"2024-09-12T00:18:32.907530+0000","last_unstale":"2024-09-12T01:03:08.199453+0000","last_undegraded":"2024-09-12T01:03:08.199453+0000","last_fullsized":"2024-09-12T01:03:08.199453+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:37.368919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":167,"num_read_kb":160,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'364","reported_seq":1689,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.349766+0000","last_change":"2024-09-12T00:18:24.842626+0000","last_active":"2024-09-12T01:03:10.349766+0000","last_peered":"2024-09-12T01:03:10.349766+0000","last_clean":"2024-09-12T01:03:10.349766+0000","last_became_active":"2024-09-12T00:18:24.842263+0000","last_became_peered":"2024-09-12T00:18:24.842263+0000","last_unstale":"2024-09-12T01:03:10.349766+0000","last_undegraded":"2024-09-12T01:03:10.349766+0000","last_fullsized":"2024-09-12T01:03:10.349766+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:07.799244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1879,"num_read_kb":1766,"num_write":437,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'371","reported_seq":1145,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.897887+0000","last_change":"2024-09-12T00:18:22.837822+0000","last_active":"2024-09-12T01:03:21.897887+0000","last_peered":"2024-09-12T01:03:21.897887+0000","last_clean":"2024-09-12T01:03:21.897887+0000","last_became_active":"2024-09-12T00:18:22.837412+0000","last_became_peered":"2024-09-12T00:18:22.837412+0000","last_unstale":"2024-09-12T01:03:21.897887+0000","last_undegraded":"2024-09-12T01:03:21.897887+0000","last_fullsized":"2024-09-12T01:03:21.897887+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:41.073377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10323841,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":841,"num_read_kb":48874,"num_write":1277,"num_write_kb":53147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.546076+0000","last_change":"2024-09-12T00:18:26.869821+0000","last_active":"2024-09-12T01:01:57.546076+0000","last_peered":"2024-09-12T01:01:57.546076+0000","last_clean":"2024-09-12T01:01:57.546076+0000","last_became_active":"2024-09-12T00:18:26.868407+0000","last_became_peered":"2024-09-12T00:18:26.868407+0000","last_unstale":"2024-09-12T01:01:57.546076+0000","last_undegraded":"2024-09-12T01:01:57.546076+0000","last_fullsized":"2024-09-12T01:01:57.546076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:11.537097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'262","reported_seq":829,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:31.779552+0000","last_change":"2024-09-12T00:18:28.896471+0000","last_active":"2024-09-12T01:03:31.779552+0000","last_peered":"2024-09-12T01:03:31.779552+0000","last_clean":"2024-09-12T01:03:31.779552+0000","last_became_active":"2024-09-12T00:18:28.895848+0000","last_became_peered":"2024-09-12T00:18:28.895848+0000","last_unstale":"2024-09-12T01:03:31.779552+0000","last_undegraded":"2024-09-12T01:03:31.779552+0000","last_fullsized":"2024-09-12T01:03:31.779552+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:11.864170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67199,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":420,"num_read_kb":922,"num_write":354,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":494,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.533540+0000","last_change":"2024-09-12T00:18:30.893385+0000","last_active":"2024-09-12T01:01:02.533540+0000","last_peered":"2024-09-12T01:01:02.533540+0000","last_clean":"2024-09-12T01:01:02.533540+0000","last_became_active":"2024-09-12T00:18:30.892682+0000","last_became_peered":"2024-09-12T00:18:30.892682+0000","last_unstale":"2024-09-12T01:01:02.533540+0000","last_undegraded":"2024-09-12T01:01:02.533540+0000","last_fullsized":"2024-09-12T01:01:02.533540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:03.256684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'208","reported_seq":1695,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.225211+0000","last_change":"2024-09-12T00:18:32.911619+0000","last_active":"2024-09-12T01:03:23.225211+0000","last_peered":"2024-09-12T01:03:23.225211+0000","last_clean":"2024-09-12T01:03:23.225211+0000","last_became_active":"2024-09-12T00:18:32.911082+0000","last_became_peered":"2024-09-12T00:18:32.911082+0000","last_unstale":"2024-09-12T01:03:23.225211+0000","last_undegraded":"2024-09-12T01:03:23.225211+0000","last_fullsized":"2024-09-12T01:03:23.225211+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:46.062158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1287,"num_read_kb":1263,"num_write":482,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'525","reported_seq":2115,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.829396+0000","last_change":"2024-09-12T00:18:24.881623+0000","last_active":"2024-09-12T01:04:30.829396+0000","last_peered":"2024-09-12T01:04:30.829396+0000","last_clean":"2024-09-12T01:04:30.829396+0000","last_became_active":"2024-09-12T00:18:24.881029+0000","last_became_peered":"2024-09-12T00:18:24.881029+0000","last_unstale":"2024-09-12T01:04:30.829396+0000","last_undegraded":"2024-09-12T01:04:30.829396+0000","last_fullsized":"2024-09-12T01:04:30.829396+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:53.918281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2735,"num_read_kb":2532,"num_write":658,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'327","reported_seq":1033,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:25.747038+0000","last_change":"2024-09-12T00:18:22.864476+0000","last_active":"2024-09-12T01:04:25.747038+0000","last_peered":"2024-09-12T01:04:25.747038+0000","last_clean":"2024-09-12T01:04:25.747038+0000","last_became_active":"2024-09-12T00:18:22.863907+0000","last_became_peered":"2024-09-12T00:18:22.863907+0000","last_unstale":"2024-09-12T01:04:25.747038+0000","last_undegraded":"2024-09-12T01:04:25.747038+0000","last_fullsized":"2024-09-12T01:04:25.747038+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:45.526909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6506830,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":578,"num_read_kb":24608,"num_write":1184,"num_write_kb":29666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:06.553634+0000","last_change":"2024-09-12T00:18:26.867344+0000","last_active":"2024-09-12T01:02:06.553634+0000","last_peered":"2024-09-12T01:02:06.553634+0000","last_clean":"2024-09-12T01:02:06.553634+0000","last_became_active":"2024-09-12T00:18:26.866967+0000","last_became_peered":"2024-09-12T00:18:26.866967+0000","last_unstale":"2024-09-12T01:02:06.553634+0000","last_undegraded":"2024-09-12T01:02:06.553634+0000","last_fullsized":"2024-09-12T01:02:06.553634+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:36.323953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'304","reported_seq":901,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:32.569512+0000","last_change":"2024-09-12T00:18:28.898664+0000","last_active":"2024-09-12T01:03:32.569512+0000","last_peered":"2024-09-12T01:03:32.569512+0000","last_clean":"2024-09-12T01:03:32.569512+0000","last_became_active":"2024-09-12T00:18:28.897709+0000","last_became_peered":"2024-09-12T00:18:28.897709+0000","last_unstale":"2024-09-12T01:03:32.569512+0000","last_undegraded":"2024-09-12T01:03:32.569512+0000","last_fullsized":"2024-09-12T01:03:32.569512+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:21.269051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63713,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":512,"num_read_kb":1035,"num_write":416,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":490,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:01.554976+0000","last_change":"2024-09-12T00:18:30.898241+0000","last_active":"2024-09-12T01:01:01.554976+0000","last_peered":"2024-09-12T01:01:01.554976+0000","last_clean":"2024-09-12T01:01:01.554976+0000","last_became_active":"2024-09-12T00:18:30.889179+0000","last_became_peered":"2024-09-12T00:18:30.889179+0000","last_unstale":"2024-09-12T01:01:01.554976+0000","last_undegraded":"2024-09-12T01:01:01.554976+0000","last_fullsized":"2024-09-12T01:01:01.554976+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:34.242145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'191","reported_seq":755,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.817447+0000","last_change":"2024-09-12T00:18:32.908462+0000","last_active":"2024-09-12T01:04:30.817447+0000","last_peered":"2024-09-12T01:04:30.817447+0000","last_clean":"2024-09-12T01:04:30.817447+0000","last_became_active":"2024-09-12T00:18:32.907658+0000","last_became_peered":"2024-09-12T00:18:32.907658+0000","last_unstale":"2024-09-12T01:04:30.817447+0000","last_undegraded":"2024-09-12T01:04:30.817447+0000","last_fullsized":"2024-09-12T01:04:30.817447+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:03.641123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":435,"num_read_kb":358,"num_write":481,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'411","reported_seq":1911,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.825050+0000","last_change":"2024-09-12T00:18:24.878945+0000","last_active":"2024-09-12T01:04:30.825050+0000","last_peered":"2024-09-12T01:04:30.825050+0000","last_clean":"2024-09-12T01:04:30.825050+0000","last_became_active":"2024-09-12T00:18:24.878522+0000","last_became_peered":"2024-09-12T00:18:24.878522+0000","last_unstale":"2024-09-12T01:04:30.825050+0000","last_undegraded":"2024-09-12T01:04:30.825050+0000","last_fullsized":"2024-09-12T01:04:30.825050+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:42.239984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2233,"num_read_kb":2110,"num_write":497,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'312","reported_seq":979,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.623973+0000","last_change":"2024-09-12T00:18:22.853126+0000","last_active":"2024-09-12T01:03:00.623973+0000","last_peered":"2024-09-12T01:03:00.623973+0000","last_clean":"2024-09-12T01:03:00.623973+0000","last_became_active":"2024-09-12T00:18:22.851554+0000","last_became_peered":"2024-09-12T00:18:22.851554+0000","last_unstale":"2024-09-12T01:03:00.623973+0000","last_undegraded":"2024-09-12T01:03:00.623973+0000","last_fullsized":"2024-09-12T01:03:00.623973+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:48.723489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5569392,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":502,"num_read_kb":70445,"num_write":1073,"num_write_kb":38293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"268'1219","reported_seq":2832,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.908340+0000","last_change":"2024-09-12T00:18:24.857511+0000","last_active":"2024-09-12T01:02:46.908340+0000","last_peered":"2024-09-12T01:02:46.908340+0000","last_clean":"2024-09-12T01:02:46.908340+0000","last_became_active":"2024-09-12T00:18:24.857107+0000","last_became_peered":"2024-09-12T00:18:24.857107+0000","last_unstale":"2024-09-12T01:02:46.908340+0000","last_undegraded":"2024-09-12T01:02:46.908340+0000","last_fullsized":"2024-09-12T01:02:46.908340+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":1200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:46.479301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5568,"num_read_kb":4913,"num_write":1657,"num_write_kb":681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"268'282","reported_seq":933,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.183343+0000","last_change":"2024-09-12T00:18:56.194536+0000","last_active":"2024-09-12T01:02:21.183343+0000","last_peered":"2024-09-12T01:02:21.183343+0000","last_clean":"2024-09-12T01:02:21.183343+0000","last_became_active":"2024-09-12T00:18:56.193721+0000","last_became_peered":"2024-09-12T00:18:56.193721+0000","last_unstale":"2024-09-12T01:02:21.183343+0000","last_undegraded":"2024-09-12T01:02:21.183343+0000","last_fullsized":"2024-09-12T01:02:21.183343+0000","mapping_epoch":37,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:45.173064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4807193,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":395,"num_read_kb":19261,"num_write":951,"num_write_kb":26595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'860","reported_seq":2457,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.120737+0000","last_change":"2024-09-12T00:18:24.871814+0000","last_active":"2024-09-12T01:03:25.120737+0000","last_peered":"2024-09-12T01:03:25.120737+0000","last_clean":"2024-09-12T01:03:25.120737+0000","last_became_active":"2024-09-12T00:18:24.870288+0000","last_became_peered":"2024-09-12T00:18:24.870288+0000","last_unstale":"2024-09-12T01:03:25.120737+0000","last_undegraded":"2024-09-12T01:03:25.120737+0000","last_fullsized":"2024-09-12T01:03:25.120737+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":800,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:41.437287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4146,"num_read_kb":3713,"num_write":1130,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'328","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:22.248499+0000","last_change":"2024-09-12T00:18:22.872673+0000","last_active":"2024-09-12T01:03:22.248499+0000","last_peered":"2024-09-12T01:03:22.248499+0000","last_clean":"2024-09-12T01:03:22.248499+0000","last_became_active":"2024-09-12T00:18:22.866341+0000","last_became_peered":"2024-09-12T00:18:22.866341+0000","last_unstale":"2024-09-12T01:03:22.248499+0000","last_undegraded":"2024-09-12T01:03:22.248499+0000","last_fullsized":"2024-09-12T01:03:22.248499+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:24.768958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22504054,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":396,"num_read_kb":25322,"num_write":1082,"num_write_kb":64729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'397","reported_seq":1894,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.440536+0000","last_change":"2024-09-12T00:18:24.866032+0000","last_active":"2024-09-12T01:03:09.440536+0000","last_peered":"2024-09-12T01:03:09.440536+0000","last_clean":"2024-09-12T01:03:09.440536+0000","last_became_active":"2024-09-12T00:18:24.865674+0000","last_became_peered":"2024-09-12T00:18:24.865674+0000","last_unstale":"2024-09-12T01:03:09.440536+0000","last_undegraded":"2024-09-12T01:03:09.440536+0000","last_fullsized":"2024-09-12T01:03:09.440536+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:58.235628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2040,"num_read_kb":1953,"num_write":432,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'264","reported_seq":1009,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.539380+0000","last_change":"2024-09-12T00:18:22.844535+0000","last_active":"2024-09-12T01:03:03.539380+0000","last_peered":"2024-09-12T01:03:03.539380+0000","last_clean":"2024-09-12T01:03:03.539380+0000","last_became_active":"2024-09-12T00:18:22.844095+0000","last_became_peered":"2024-09-12T00:18:22.844095+0000","last_unstale":"2024-09-12T01:03:03.539380+0000","last_undegraded":"2024-09-12T01:03:03.539380+0000","last_fullsized":"2024-09-12T01:03:03.539380+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:23.543074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1812643,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":683,"num_read_kb":58308,"num_write":920,"num_write_kb":25022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"268'383","reported_seq":1843,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.346854+0000","last_change":"2024-09-12T00:18:24.866012+0000","last_active":"2024-09-12T01:03:37.346854+0000","last_peered":"2024-09-12T01:03:37.346854+0000","last_clean":"2024-09-12T01:03:37.346854+0000","last_became_active":"2024-09-12T00:18:24.865720+0000","last_became_peered":"2024-09-12T00:18:24.865720+0000","last_unstale":"2024-09-12T01:03:37.346854+0000","last_undegraded":"2024-09-12T01:03:37.346854+0000","last_fullsized":"2024-09-12T01:03:37.346854+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:30.348388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2058,"num_read_kb":1953,"num_write":433,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'303","reported_seq":978,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:22.057395+0000","last_change":"2024-09-12T00:18:22.858174+0000","last_active":"2024-09-12T01:03:22.057395+0000","last_peered":"2024-09-12T01:03:22.057395+0000","last_clean":"2024-09-12T01:03:22.057395+0000","last_became_active":"2024-09-12T00:18:22.857896+0000","last_became_peered":"2024-09-12T00:18:22.857896+0000","last_unstale":"2024-09-12T01:03:22.057395+0000","last_undegraded":"2024-09-12T01:03:22.057395+0000","last_fullsized":"2024-09-12T01:03:22.057395+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:35.667728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6705118,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":504,"num_read_kb":17790,"num_write":1122,"num_write_kb":44407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'440","reported_seq":2170,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.192270+0000","last_change":"2024-09-12T00:18:24.867735+0000","last_active":"2024-09-12T01:03:11.192270+0000","last_peered":"2024-09-12T01:03:11.192270+0000","last_clean":"2024-09-12T01:03:11.192270+0000","last_became_active":"2024-09-12T00:18:24.866980+0000","last_became_peered":"2024-09-12T00:18:24.866980+0000","last_unstale":"2024-09-12T01:03:11.192270+0000","last_undegraded":"2024-09-12T01:03:11.192270+0000","last_fullsized":"2024-09-12T01:03:11.192270+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:25.227858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2639,"num_read_kb":2518,"num_write":497,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'266","reported_seq":924,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:46.549024+0000","last_change":"2024-09-12T00:18:22.847482+0000","last_active":"2024-09-12T01:01:46.549024+0000","last_peered":"2024-09-12T01:01:46.549024+0000","last_clean":"2024-09-12T01:01:46.549024+0000","last_became_active":"2024-09-12T00:18:22.846805+0000","last_became_peered":"2024-09-12T00:18:22.846805+0000","last_unstale":"2024-09-12T01:01:46.549024+0000","last_undegraded":"2024-09-12T01:01:46.549024+0000","last_fullsized":"2024-09-12T01:01:46.549024+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:38.931220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13654801,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":403,"num_read_kb":82569,"num_write":1018,"num_write_kb":46093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'467","reported_seq":2006,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.119546+0000","last_change":"2024-09-12T00:18:24.862315+0000","last_active":"2024-09-12T01:03:25.119546+0000","last_peered":"2024-09-12T01:03:25.119546+0000","last_clean":"2024-09-12T01:03:25.119546+0000","last_became_active":"2024-09-12T00:18:24.862022+0000","last_became_peered":"2024-09-12T00:18:24.862022+0000","last_unstale":"2024-09-12T01:03:25.119546+0000","last_undegraded":"2024-09-12T01:03:25.119546+0000","last_fullsized":"2024-09-12T01:03:25.119546+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:31.362187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2433,"num_read_kb":2274,"num_write":552,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'281","reported_seq":905,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.869611+0000","last_change":"2024-09-12T00:18:22.872677+0000","last_active":"2024-09-12T01:02:47.869611+0000","last_peered":"2024-09-12T01:02:47.869611+0000","last_clean":"2024-09-12T01:02:47.869611+0000","last_became_active":"2024-09-12T00:18:22.871980+0000","last_became_peered":"2024-09-12T00:18:22.871980+0000","last_unstale":"2024-09-12T01:02:47.869611+0000","last_undegraded":"2024-09-12T01:02:47.869611+0000","last_fullsized":"2024-09-12T01:02:47.869611+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:06.765741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6571929,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":404,"num_read_kb":12975,"num_write":1053,"num_write_kb":44636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'438","reported_seq":2028,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.704380+0000","last_change":"2024-09-12T00:18:24.865050+0000","last_active":"2024-09-12T01:03:20.704380+0000","last_peered":"2024-09-12T01:03:20.704380+0000","last_clean":"2024-09-12T01:03:20.704380+0000","last_became_active":"2024-09-12T00:18:24.857010+0000","last_became_peered":"2024-09-12T00:18:24.857010+0000","last_unstale":"2024-09-12T01:03:20.704380+0000","last_undegraded":"2024-09-12T01:03:20.704380+0000","last_fullsized":"2024-09-12T01:03:20.704380+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:11.724243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2477,"num_read_kb":2332,"num_write":519,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'304","reported_seq":932,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.537630+0000","last_change":"2024-09-12T00:18:22.857829+0000","last_active":"2024-09-12T01:03:03.537630+0000","last_peered":"2024-09-12T01:03:03.537630+0000","last_clean":"2024-09-12T01:03:03.537630+0000","last_became_active":"2024-09-12T00:18:22.857468+0000","last_became_peered":"2024-09-12T00:18:22.857468+0000","last_unstale":"2024-09-12T01:03:03.537630+0000","last_undegraded":"2024-09-12T01:03:03.537630+0000","last_fullsized":"2024-09-12T01:03:03.537630+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:27.114391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":434508,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":421,"num_read_kb":4428,"num_write":1055,"num_write_kb":23710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"268'835","reported_seq":2445,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.175301+0000","last_change":"2024-09-12T00:18:24.857824+0000","last_active":"2024-09-12T01:03:11.175301+0000","last_peered":"2024-09-12T01:03:11.175301+0000","last_clean":"2024-09-12T01:03:11.175301+0000","last_became_active":"2024-09-12T00:18:24.857438+0000","last_became_peered":"2024-09-12T00:18:24.857438+0000","last_unstale":"2024-09-12T01:03:11.175301+0000","last_undegraded":"2024-09-12T01:03:11.175301+0000","last_fullsized":"2024-09-12T01:03:11.175301+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:33.071795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3858,"num_read_kb":3490,"num_write":1078,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'306","reported_seq":921,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.895781+0000","last_change":"2024-09-12T00:18:22.859579+0000","last_active":"2024-09-12T01:03:21.895781+0000","last_peered":"2024-09-12T01:03:21.895781+0000","last_clean":"2024-09-12T01:03:21.895781+0000","last_became_active":"2024-09-12T00:18:22.858851+0000","last_became_peered":"2024-09-12T00:18:22.858851+0000","last_unstale":"2024-09-12T01:03:21.895781+0000","last_undegraded":"2024-09-12T01:03:21.895781+0000","last_fullsized":"2024-09-12T01:03:21.895781+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:42.545358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10694505,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":405,"num_read_kb":6076,"num_write":1027,"num_write_kb":43198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'1186","reported_seq":2695,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.865689+0000","last_change":"2024-09-12T00:18:24.858035+0000","last_active":"2024-09-12T01:03:25.865689+0000","last_peered":"2024-09-12T01:03:25.865689+0000","last_clean":"2024-09-12T01:03:25.865689+0000","last_became_active":"2024-09-12T00:18:24.856121+0000","last_became_peered":"2024-09-12T00:18:24.856121+0000","last_unstale":"2024-09-12T01:03:25.865689+0000","last_undegraded":"2024-09-12T01:03:25.865689+0000","last_fullsized":"2024-09-12T01:03:25.865689+0000","mapping_epoch":26,"log_start":"268'1100","ondisk_log_start":"268'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":1100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:36.093783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5211,"num_read_kb":4574,"num_write":1611,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'301","reported_seq":1048,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:28.248269+0000","last_change":"2024-09-12T00:18:22.858631+0000","last_active":"2024-09-12T01:01:28.248269+0000","last_peered":"2024-09-12T01:01:28.248269+0000","last_clean":"2024-09-12T01:01:28.248269+0000","last_became_active":"2024-09-12T00:18:22.857806+0000","last_became_peered":"2024-09-12T00:18:22.857806+0000","last_unstale":"2024-09-12T01:01:28.248269+0000","last_undegraded":"2024-09-12T01:01:28.248269+0000","last_fullsized":"2024-09-12T01:01:28.248269+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:33.277291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9986390,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":621,"num_read_kb":44063,"num_write":1157,"num_write_kb":47646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"268'824","reported_seq":2369,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.350086+0000","last_change":"2024-09-12T00:18:24.856950+0000","last_active":"2024-09-12T01:03:10.350086+0000","last_peered":"2024-09-12T01:03:10.350086+0000","last_clean":"2024-09-12T01:03:10.350086+0000","last_became_active":"2024-09-12T00:18:24.856616+0000","last_became_peered":"2024-09-12T00:18:24.856616+0000","last_unstale":"2024-09-12T01:03:10.350086+0000","last_undegraded":"2024-09-12T01:03:10.350086+0000","last_fullsized":"2024-09-12T01:03:10.350086+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:56.988343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3862,"num_read_kb":3471,"num_write":1076,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'313","reported_seq":1084,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.191500+0000","last_change":"2024-09-12T00:18:22.874720+0000","last_active":"2024-09-12T01:02:55.191500+0000","last_peered":"2024-09-12T01:02:55.191500+0000","last_clean":"2024-09-12T01:02:55.191500+0000","last_became_active":"2024-09-12T00:18:22.873756+0000","last_became_peered":"2024-09-12T00:18:22.873756+0000","last_unstale":"2024-09-12T01:02:55.191500+0000","last_undegraded":"2024-09-12T01:02:55.191500+0000","last_fullsized":"2024-09-12T01:02:55.191500+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:18.449548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8958017,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":835,"num_read_kb":25126,"num_write":1201,"num_write_kb":39639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'1580","reported_seq":3271,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.439933+0000","last_change":"2024-09-12T00:18:24.883740+0000","last_active":"2024-09-12T01:03:09.439933+0000","last_peered":"2024-09-12T01:03:09.439933+0000","last_clean":"2024-09-12T01:03:09.439933+0000","last_became_active":"2024-09-12T00:18:24.882937+0000","last_became_peered":"2024-09-12T00:18:24.882937+0000","last_unstale":"2024-09-12T01:03:09.439933+0000","last_undegraded":"2024-09-12T01:03:09.439933+0000","last_fullsized":"2024-09-12T01:03:09.439933+0000","mapping_epoch":26,"log_start":"268'1500","ondisk_log_start":"268'1500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":1500,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:22.907432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7111,"num_read_kb":6230,"num_write":2206,"num_write_kb":938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'356","reported_seq":1086,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:23.191677+0000","last_change":"2024-09-12T00:18:22.869861+0000","last_active":"2024-09-12T01:04:23.191677+0000","last_peered":"2024-09-12T01:04:23.191677+0000","last_clean":"2024-09-12T01:04:23.191677+0000","last_became_active":"2024-09-12T00:18:22.869527+0000","last_became_peered":"2024-09-12T00:18:22.869527+0000","last_unstale":"2024-09-12T01:04:23.191677+0000","last_undegraded":"2024-09-12T01:04:23.191677+0000","last_fullsized":"2024-09-12T01:04:23.191677+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:28.494266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1661019,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":695,"num_read_kb":72881,"num_write":1366,"num_write_kb":29040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'772","reported_seq":2178,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.702907+0000","last_change":"2024-09-12T00:18:24.866786+0000","last_active":"2024-09-12T01:03:20.702907+0000","last_peered":"2024-09-12T01:03:20.702907+0000","last_clean":"2024-09-12T01:03:20.702907+0000","last_became_active":"2024-09-12T00:18:24.866062+0000","last_became_peered":"2024-09-12T00:18:24.866062+0000","last_unstale":"2024-09-12T01:03:20.702907+0000","last_undegraded":"2024-09-12T01:03:20.702907+0000","last_fullsized":"2024-09-12T01:03:20.702907+0000","mapping_epoch":26,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:41.456955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3587,"num_read_kb":3210,"num_write":1032,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'315","reported_seq":996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:21.098923+0000","last_change":"2024-09-12T00:18:22.858952+0000","last_active":"2024-09-12T01:04:21.098923+0000","last_peered":"2024-09-12T01:04:21.098923+0000","last_clean":"2024-09-12T01:04:21.098923+0000","last_became_active":"2024-09-12T00:18:22.858141+0000","last_became_peered":"2024-09-12T00:18:22.858141+0000","last_unstale":"2024-09-12T01:04:21.098923+0000","last_undegraded":"2024-09-12T01:04:21.098923+0000","last_fullsized":"2024-09-12T01:04:21.098923+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:25.792326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389308,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":591,"num_read_kb":25195,"num_write":1293,"num_write_kb":34646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'1217","reported_seq":3118,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.594177+0000","last_change":"2024-09-12T00:18:24.860271+0000","last_active":"2024-09-12T01:03:26.594177+0000","last_peered":"2024-09-12T01:03:26.594177+0000","last_clean":"2024-09-12T01:03:26.594177+0000","last_became_active":"2024-09-12T00:18:24.859973+0000","last_became_peered":"2024-09-12T00:18:24.859973+0000","last_unstale":"2024-09-12T01:03:26.594177+0000","last_undegraded":"2024-09-12T01:03:26.594177+0000","last_fullsized":"2024-09-12T01:03:26.594177+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":1200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:18.330323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5984,"num_read_kb":5306,"num_write":1779,"num_write_kb":823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'284","reported_seq":910,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.420265+0000","last_change":"2024-09-12T00:18:55.952101+0000","last_active":"2024-09-12T01:03:11.420265+0000","last_peered":"2024-09-12T01:03:11.420265+0000","last_clean":"2024-09-12T01:03:11.420265+0000","last_became_active":"2024-09-12T00:18:55.951826+0000","last_became_peered":"2024-09-12T00:18:55.951826+0000","last_unstale":"2024-09-12T01:03:11.420265+0000","last_undegraded":"2024-09-12T01:03:11.420265+0000","last_fullsized":"2024-09-12T01:03:11.420265+0000","mapping_epoch":37,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:47.686652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1432648,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":436,"num_read_kb":11605,"num_write":1010,"num_write_kb":32221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"268'537","reported_seq":2005,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.346854+0000","last_change":"2024-09-12T00:18:24.849840+0000","last_active":"2024-09-12T01:03:37.346854+0000","last_peered":"2024-09-12T01:03:37.346854+0000","last_clean":"2024-09-12T01:03:37.346854+0000","last_became_active":"2024-09-12T00:18:24.849540+0000","last_became_peered":"2024-09-12T00:18:24.849540+0000","last_unstale":"2024-09-12T01:03:37.346854+0000","last_undegraded":"2024-09-12T01:03:37.346854+0000","last_fullsized":"2024-09-12T01:03:37.346854+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:12.695354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2717,"num_read_kb":2465,"num_write":714,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'310","reported_seq":1004,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.540921+0000","last_change":"2024-09-12T00:18:22.834810+0000","last_active":"2024-09-12T01:03:07.540921+0000","last_peered":"2024-09-12T01:03:07.540921+0000","last_clean":"2024-09-12T01:03:07.540921+0000","last_became_active":"2024-09-12T00:18:22.834527+0000","last_became_peered":"2024-09-12T00:18:22.834527+0000","last_unstale":"2024-09-12T01:03:07.540921+0000","last_undegraded":"2024-09-12T01:03:07.540921+0000","last_fullsized":"2024-09-12T01:03:07.540921+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:49.103125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1051256,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":615,"num_read_kb":13548,"num_write":1311,"num_write_kb":27172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'350","reported_seq":1704,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.704302+0000","last_change":"2024-09-12T00:18:24.871103+0000","last_active":"2024-09-12T01:03:20.704302+0000","last_peered":"2024-09-12T01:03:20.704302+0000","last_clean":"2024-09-12T01:03:20.704302+0000","last_became_active":"2024-09-12T00:18:24.870016+0000","last_became_peered":"2024-09-12T00:18:24.870016+0000","last_unstale":"2024-09-12T01:03:20.704302+0000","last_undegraded":"2024-09-12T01:03:20.704302+0000","last_fullsized":"2024-09-12T01:03:20.704302+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:57.415861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1783,"num_read_kb":1704,"num_write":384,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'275","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.548016+0000","last_change":"2024-09-12T00:18:22.883934+0000","last_active":"2024-09-12T01:02:53.548016+0000","last_peered":"2024-09-12T01:02:53.548016+0000","last_clean":"2024-09-12T01:02:53.548016+0000","last_became_active":"2024-09-12T00:18:22.883246+0000","last_became_peered":"2024-09-12T00:18:22.883246+0000","last_unstale":"2024-09-12T01:02:53.548016+0000","last_undegraded":"2024-09-12T01:02:53.548016+0000","last_fullsized":"2024-09-12T01:02:53.548016+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:32.140402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10133923,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":445,"num_read_kb":42045,"num_write":1046,"num_write_kb":34022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'308","reported_seq":975,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:37.707227+0000","last_change":"2024-09-12T00:18:22.857851+0000","last_active":"2024-09-12T01:01:37.707227+0000","last_peered":"2024-09-12T01:01:37.707227+0000","last_clean":"2024-09-12T01:01:37.707227+0000","last_became_active":"2024-09-12T00:18:22.857072+0000","last_became_peered":"2024-09-12T00:18:22.857072+0000","last_unstale":"2024-09-12T01:01:37.707227+0000","last_undegraded":"2024-09-12T01:01:37.707227+0000","last_fullsized":"2024-09-12T01:01:37.707227+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:08.141312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13407224,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":482,"num_read_kb":42639,"num_write":1182,"num_write_kb":40559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'475","reported_seq":2175,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.700952+0000","last_change":"2024-09-12T00:18:24.867195+0000","last_active":"2024-09-12T01:03:20.700952+0000","last_peered":"2024-09-12T01:03:20.700952+0000","last_clean":"2024-09-12T01:03:20.700952+0000","last_became_active":"2024-09-12T00:18:24.866883+0000","last_became_peered":"2024-09-12T00:18:24.866883+0000","last_unstale":"2024-09-12T01:03:20.700952+0000","last_undegraded":"2024-09-12T01:03:20.700952+0000","last_fullsized":"2024-09-12T01:03:20.700952+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:14.739354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2661,"num_read_kb":2525,"num_write":544,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'382","reported_seq":1109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:40.568273+0000","last_change":"2024-09-12T00:18:22.858917+0000","last_active":"2024-09-12T01:02:40.568273+0000","last_peered":"2024-09-12T01:02:40.568273+0000","last_clean":"2024-09-12T01:02:40.568273+0000","last_became_active":"2024-09-12T00:18:22.858176+0000","last_became_peered":"2024-09-12T00:18:22.858176+0000","last_unstale":"2024-09-12T01:02:40.568273+0000","last_undegraded":"2024-09-12T01:02:40.568273+0000","last_fullsized":"2024-09-12T01:02:40.568273+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:56.261213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17620765,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":772,"num_read_kb":63076,"num_write":1184,"num_write_kb":30414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'807","reported_seq":2404,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.172100+0000","last_change":"2024-09-12T00:18:24.856340+0000","last_active":"2024-09-12T01:03:03.172100+0000","last_peered":"2024-09-12T01:03:03.172100+0000","last_clean":"2024-09-12T01:03:03.172100+0000","last_became_active":"2024-09-12T00:18:24.855524+0000","last_became_peered":"2024-09-12T00:18:24.855524+0000","last_unstale":"2024-09-12T01:03:03.172100+0000","last_undegraded":"2024-09-12T01:03:03.172100+0000","last_fullsized":"2024-09-12T01:03:03.172100+0000","mapping_epoch":26,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:08.775534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3793,"num_read_kb":3425,"num_write":1052,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6125,"num_read_kb":4422,"num_write":1992,"num_write_kb":889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":963,"ondisk_log_size":963,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15018,"num_read_kb":14677,"num_write":16721,"num_write_kb":4879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1955,"ondisk_log_size":1955,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":467,"ondisk_log_size":467,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1935422,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":17286,"num_read_kb":32998,"num_write":14601,"num_write_kb":11568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3334144,"data_stored":2791852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1959,"ondisk_log_size":1959,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2392,"num_read_kb":2851,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212220,"num_read_kb":193790,"num_write":55147,"num_write_kb":18721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3785,"ondisk_log_size":3785,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":525685298,"num_objects":4460,"num_object_clones":0,"num_object_copies":8920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4460,"num_whiteouts":0,"num_read":32134,"num_read_kb":1921454,"num_write":68115,"num_write_kb":2133559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1084129280,"data_stored":1051370596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4234,"ondisk_log_size":4234,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":81852495,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":143,"num_read_kb":193499,"num_write":160,"num_write_kb":135054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163708928,"data_stored":163704990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":81852495,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":141,"num_read_kb":193436,"num_write":160,"num_write_kb":135054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163708928,"data_stored":163704990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510005,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":458396,"kb_used_data":188428,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":93913444,"statfs":{"total":96636764160,"available":96167366656,"internally_reserved":0,"allocated":192950272,"data_stored":187084399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":276429258},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510004,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":375476,"kb_used_data":149924,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":93996364,"statfs":{"total":96636764160,"available":96252276736,"internally_reserved":0,"allocated":153522176,"data_stored":148408360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":230947273},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510004,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":337472,"kb_used_data":216112,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94034368,"statfs":{"total":96636764160,"available":96291192832,"internally_reserved":0,"allocated":221298688,"data_stored":215015112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510005,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255900,"kb_used_data":192780,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94115940,"statfs":{"total":96636764160,"available":96374722560,"internally_reserved":0,"allocated":197406720,"data_stored":191246398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542709,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":467752,"kb_used_data":215832,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":93904088,"statfs":{"total":96636764160,"available":96157786112,"internally_reserved":0,"allocated":221011968,"data_stored":214733879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257948103},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542707,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202504,"kb_used_data":104760,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94169336,"statfs":{"total":96636764160,"available":96429400064,"internally_reserved":0,"allocated":107274240,"data_stored":103037877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542708,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":295632,"kb_used_data":160384,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94076208,"statfs":{"total":96636764160,"available":96334036992,"internally_reserved":0,"allocated":164233216,"data_stored":159231069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542709,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":421532,"kb_used_data":183500,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":93950308,"statfs":{"total":96636764160,"available":96205115392,"internally_reserved":0,"allocated":187904000,"data_stored":181665792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":136011776,"data_stored":131334602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":108634112,"data_stored":105174233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":68845568,"data_stored":66097501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":172634112,"data_stored":167939379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":151691264,"data_stored":146999295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":168640512,"data_stored":164007630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":115916800,"data_stored":112330276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":161755136,"data_stored":157487680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":341789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":483328,"data_stored":408704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":127439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":569344,"data_stored":478098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":94065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":679936,"data_stored":563219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":254314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":626688,"data_stored":524224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":5044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":5163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34603008,"data_stored":34603008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24178688,"data_stored":24177617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19927040,"data_stored":19926142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17829888,"data_stored":17828990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13692928,"data_stored":13691857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12586110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27262976,"data_stored":27262976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24182784,"data_stored":24180815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24117248,"data_stored":24117248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17887232,"data_stored":17886161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:04:41.968 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T01:04:41.969 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:04:42.363 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:04:42.374 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-12T01:04:42.384 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":1661,"stamp":"2024-09-12T01:04:42.034220+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":403703711,"num_objects":2945,"num_object_clones":0,"num_object_copies":5890,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2945,"num_whiteouts":0,"num_read":287861,"num_read_kb":2559434,"num_write":159235,"num_write_kb":2441414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13152,"ondisk_log_size":13152,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2208972,"kb_used_data":822388,"kb_used_omap":12,"kb_used_meta":1386163,"kb_avail":752765748,"statfs":{"total":773094113280,"available":770832125952,"internally_reserved":0,"allocated":842125312,"data_stored":812014180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1419431475},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-288230784,"num_objects":-2083,"num_object_clones":0,"num_object_copies":-4166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2083,"num_whiteouts":0,"num_read":2640,"num_read_kb":2545,"num_write":2273,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007760"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.738562+0000","last_change":"2024-09-12T00:46:09.507731+0000","last_active":"2024-09-12T01:01:12.738562+0000","last_peered":"2024-09-12T01:01:12.738562+0000","last_clean":"2024-09-12T01:01:12.738562+0000","last_became_active":"2024-09-12T00:46:09.506992+0000","last_became_peered":"2024-09-12T00:46:09.506992+0000","last_unstale":"2024-09-12T01:01:12.738562+0000","last_undegraded":"2024-09-12T01:01:12.738562+0000","last_fullsized":"2024-09-12T01:01:12.738562+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:58.022915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"265'8","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.721957+0000","last_change":"2024-09-12T00:34:55.237418+0000","last_active":"2024-09-12T00:59:57.721957+0000","last_peered":"2024-09-12T00:59:57.721957+0000","last_clean":"2024-09-12T00:59:57.721957+0000","last_became_active":"2024-09-12T00:34:55.236531+0000","last_became_peered":"2024-09-12T00:34:55.236531+0000","last_unstale":"2024-09-12T00:59:57.721957+0000","last_undegraded":"2024-09-12T00:59:57.721957+0000","last_fullsized":"2024-09-12T00:59:57.721957+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:18.916486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"268'4","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.718863+0000","last_change":"2024-09-12T00:34:52.172747+0000","last_active":"2024-09-12T01:04:39.718863+0000","last_peered":"2024-09-12T01:04:39.718863+0000","last_clean":"2024-09-12T01:04:39.718863+0000","last_became_active":"2024-09-12T00:34:52.171918+0000","last_became_peered":"2024-09-12T00:34:52.171918+0000","last_unstale":"2024-09-12T01:04:39.718863+0000","last_undegraded":"2024-09-12T01:04:39.718863+0000","last_fullsized":"2024-09-12T01:04:39.718863+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:15.468426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4100,"num_write":4,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'30","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.578508+0000","last_change":"2024-09-12T00:33:10.849736+0000","last_active":"2024-09-12T01:02:21.578508+0000","last_peered":"2024-09-12T01:02:21.578508+0000","last_clean":"2024-09-12T01:02:21.578508+0000","last_became_active":"2024-09-12T00:33:10.848975+0000","last_became_peered":"2024-09-12T00:33:10.848975+0000","last_unstale":"2024-09-12T01:02:21.578508+0000","last_undegraded":"2024-09-12T01:02:21.578508+0000","last_fullsized":"2024-09-12T01:02:21.578508+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:54.113531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":60,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:11.710587+0000","last_change":"2024-09-12T00:46:09.510162+0000","last_active":"2024-09-12T01:01:11.710587+0000","last_peered":"2024-09-12T01:01:11.710587+0000","last_clean":"2024-09-12T01:01:11.710587+0000","last_became_active":"2024-09-12T00:46:09.509800+0000","last_became_peered":"2024-09-12T00:46:09.509800+0000","last_unstale":"2024-09-12T01:01:11.710587+0000","last_undegraded":"2024-09-12T01:01:11.710587+0000","last_fullsized":"2024-09-12T01:01:11.710587+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:13.709511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'6","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.518261+0000","last_change":"2024-09-12T00:34:55.233869+0000","last_active":"2024-09-12T00:59:57.518261+0000","last_peered":"2024-09-12T00:59:57.518261+0000","last_clean":"2024-09-12T00:59:57.518261+0000","last_became_active":"2024-09-12T00:34:55.232607+0000","last_became_peered":"2024-09-12T00:34:55.232607+0000","last_unstale":"2024-09-12T00:59:57.518261+0000","last_undegraded":"2024-09-12T00:59:57.518261+0000","last_fullsized":"2024-09-12T00:59:57.518261+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:24.955277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":11,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"268'2","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.557575+0000","last_change":"2024-09-12T00:34:52.211653+0000","last_active":"2024-09-12T01:02:21.557575+0000","last_peered":"2024-09-12T01:02:21.557575+0000","last_clean":"2024-09-12T01:02:21.557575+0000","last_became_active":"2024-09-12T00:34:52.210935+0000","last_became_peered":"2024-09-12T00:34:52.210935+0000","last_unstale":"2024-09-12T01:02:21.557575+0000","last_undegraded":"2024-09-12T01:02:21.557575+0000","last_fullsized":"2024-09-12T01:02:21.557575+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:38.800194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'30","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:14.858026+0000","last_change":"2024-09-12T00:33:10.852168+0000","last_active":"2024-09-12T01:02:14.858026+0000","last_peered":"2024-09-12T01:02:14.858026+0000","last_clean":"2024-09-12T01:02:14.858026+0000","last_became_active":"2024-09-12T00:33:10.851334+0000","last_became_peered":"2024-09-12T00:33:10.851334+0000","last_unstale":"2024-09-12T01:02:14.858026+0000","last_undegraded":"2024-09-12T01:02:14.858026+0000","last_fullsized":"2024-09-12T01:02:14.858026+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:46.569072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":55,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:42.712847+0000","last_change":"2024-09-12T00:46:09.508043+0000","last_active":"2024-09-12T01:00:42.712847+0000","last_peered":"2024-09-12T01:00:42.712847+0000","last_clean":"2024-09-12T01:00:42.712847+0000","last_became_active":"2024-09-12T00:46:09.507324+0000","last_became_peered":"2024-09-12T00:46:09.507324+0000","last_unstale":"2024-09-12T01:00:42.712847+0000","last_undegraded":"2024-09-12T01:00:42.712847+0000","last_fullsized":"2024-09-12T01:00:42.712847+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:56.424671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"268'2","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:06.601735+0000","last_change":"2024-09-12T00:34:55.253609+0000","last_active":"2024-09-12T01:04:06.601735+0000","last_peered":"2024-09-12T01:04:06.601735+0000","last_clean":"2024-09-12T01:04:06.601735+0000","last_became_active":"2024-09-12T00:34:55.252880+0000","last_became_peered":"2024-09-12T00:34:55.252880+0000","last_unstale":"2024-09-12T01:04:06.601735+0000","last_undegraded":"2024-09-12T01:04:06.601735+0000","last_fullsized":"2024-09-12T01:04:06.601735+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:39.510072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"268'2","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.732077+0000","last_change":"2024-09-12T00:34:52.198542+0000","last_active":"2024-09-12T01:02:51.732077+0000","last_peered":"2024-09-12T01:02:51.732077+0000","last_clean":"2024-09-12T01:02:51.732077+0000","last_became_active":"2024-09-12T00:34:52.195513+0000","last_became_peered":"2024-09-12T00:34:52.195513+0000","last_unstale":"2024-09-12T01:02:51.732077+0000","last_undegraded":"2024-09-12T01:02:51.732077+0000","last_fullsized":"2024-09-12T01:02:51.732077+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:23.382695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'20","reported_seq":99,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.549669+0000","last_change":"2024-09-12T00:33:10.848259+0000","last_active":"2024-09-12T01:00:41.549669+0000","last_peered":"2024-09-12T01:00:41.549669+0000","last_clean":"2024-09-12T01:00:41.549669+0000","last_became_active":"2024-09-12T00:33:10.847432+0000","last_became_peered":"2024-09-12T00:33:10.847432+0000","last_unstale":"2024-09-12T01:00:41.549669+0000","last_undegraded":"2024-09-12T01:00:41.549669+0000","last_fullsized":"2024-09-12T01:00:41.549669+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:33.335638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":67,"num_write":46,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:46.737552+0000","last_change":"2024-09-12T00:46:09.497586+0000","last_active":"2024-09-12T01:00:46.737552+0000","last_peered":"2024-09-12T01:00:46.737552+0000","last_clean":"2024-09-12T01:00:46.737552+0000","last_became_active":"2024-09-12T00:46:09.496807+0000","last_became_peered":"2024-09-12T00:46:09.496807+0000","last_unstale":"2024-09-12T01:00:46.737552+0000","last_undegraded":"2024-09-12T01:00:46.737552+0000","last_fullsized":"2024-09-12T01:00:46.737552+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:06.744888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:01.741428+0000","last_change":"2024-09-12T00:34:55.248775+0000","last_active":"2024-09-12T01:01:01.741428+0000","last_peered":"2024-09-12T01:01:01.741428+0000","last_clean":"2024-09-12T01:01:01.741428+0000","last_became_active":"2024-09-12T00:34:55.248058+0000","last_became_peered":"2024-09-12T00:34:55.248058+0000","last_unstale":"2024-09-12T01:01:01.741428+0000","last_undegraded":"2024-09-12T01:01:01.741428+0000","last_fullsized":"2024-09-12T01:01:01.741428+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:55.550280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"268'7","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.546316+0000","last_change":"2024-09-12T00:34:52.170876+0000","last_active":"2024-09-12T01:01:57.546316+0000","last_peered":"2024-09-12T01:01:57.546316+0000","last_clean":"2024-09-12T01:01:57.546316+0000","last_became_active":"2024-09-12T00:34:52.170013+0000","last_became_peered":"2024-09-12T00:34:52.170013+0000","last_unstale":"2024-09-12T01:01:57.546316+0000","last_undegraded":"2024-09-12T01:01:57.546316+0000","last_fullsized":"2024-09-12T01:01:57.546316+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:37.972262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":10242,"num_write":7,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'17","reported_seq":88,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:20.286340+0000","last_change":"2024-09-12T00:33:10.840336+0000","last_active":"2024-09-12T01:02:20.286340+0000","last_peered":"2024-09-12T01:02:20.286340+0000","last_clean":"2024-09-12T01:02:20.286340+0000","last_became_active":"2024-09-12T00:33:10.839248+0000","last_became_peered":"2024-09-12T00:33:10.839248+0000","last_unstale":"2024-09-12T01:02:20.286340+0000","last_undegraded":"2024-09-12T01:02:20.286340+0000","last_fullsized":"2024-09-12T01:02:20.286340+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:57.557088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":49,"num_write":38,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:16.761099+0000","last_change":"2024-09-12T00:46:09.501613+0000","last_active":"2024-09-12T01:02:16.761099+0000","last_peered":"2024-09-12T01:02:16.761099+0000","last_clean":"2024-09-12T01:02:16.761099+0000","last_became_active":"2024-09-12T00:46:09.499830+0000","last_became_peered":"2024-09-12T00:46:09.499830+0000","last_unstale":"2024-09-12T01:02:16.761099+0000","last_undegraded":"2024-09-12T01:02:16.761099+0000","last_fullsized":"2024-09-12T01:02:16.761099+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:10.541266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"268'2","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:32.743222+0000","last_change":"2024-09-12T00:34:55.242753+0000","last_active":"2024-09-12T01:01:32.743222+0000","last_peered":"2024-09-12T01:01:32.743222+0000","last_clean":"2024-09-12T01:01:32.743222+0000","last_became_active":"2024-09-12T00:34:55.242012+0000","last_became_peered":"2024-09-12T00:34:55.242012+0000","last_unstale":"2024-09-12T01:01:32.743222+0000","last_undegraded":"2024-09-12T01:01:32.743222+0000","last_fullsized":"2024-09-12T01:01:32.743222+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:49.280445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'7","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:51.599019+0000","last_change":"2024-09-12T00:34:52.206650+0000","last_active":"2024-09-12T01:03:51.599019+0000","last_peered":"2024-09-12T01:03:51.599019+0000","last_clean":"2024-09-12T01:03:51.599019+0000","last_became_active":"2024-09-12T00:34:52.205385+0000","last_became_peered":"2024-09-12T00:34:52.205385+0000","last_unstale":"2024-09-12T01:03:51.599019+0000","last_undegraded":"2024-09-12T01:03:51.599019+0000","last_fullsized":"2024-09-12T01:03:51.599019+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:45.297232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4098,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'48","reported_seq":172,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.736371+0000","last_change":"2024-09-12T00:33:10.843742+0000","last_active":"2024-09-12T01:00:41.736371+0000","last_peered":"2024-09-12T01:00:41.736371+0000","last_clean":"2024-09-12T01:00:41.736371+0000","last_became_active":"2024-09-12T00:33:10.842427+0000","last_became_peered":"2024-09-12T00:33:10.842427+0000","last_unstale":"2024-09-12T01:00:41.736371+0000","last_undegraded":"2024-09-12T01:00:41.736371+0000","last_fullsized":"2024-09-12T01:00:41.736371+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:10.839165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":162,"num_write":92,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:46.533904+0000","last_change":"2024-09-12T00:46:09.514586+0000","last_active":"2024-09-12T01:00:46.533904+0000","last_peered":"2024-09-12T01:00:46.533904+0000","last_clean":"2024-09-12T01:00:46.533904+0000","last_became_active":"2024-09-12T00:46:09.513617+0000","last_became_peered":"2024-09-12T00:46:09.513617+0000","last_unstale":"2024-09-12T01:00:46.533904+0000","last_undegraded":"2024-09-12T01:00:46.533904+0000","last_fullsized":"2024-09-12T01:00:46.533904+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:01.938146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"265'7","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:32.723080+0000","last_change":"2024-09-12T00:35:57.378205+0000","last_active":"2024-09-12T01:01:32.723080+0000","last_peered":"2024-09-12T01:01:32.723080+0000","last_clean":"2024-09-12T01:01:32.723080+0000","last_became_active":"2024-09-12T00:35:57.345894+0000","last_became_peered":"2024-09-12T00:35:57.345894+0000","last_unstale":"2024-09-12T01:01:32.723080+0000","last_undegraded":"2024-09-12T01:01:32.723080+0000","last_fullsized":"2024-09-12T01:01:32.723080+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:29.209762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"265'2","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:37.541584+0000","last_change":"2024-09-12T00:34:52.189042+0000","last_active":"2024-09-12T01:01:37.541584+0000","last_peered":"2024-09-12T01:01:37.541584+0000","last_clean":"2024-09-12T01:01:37.541584+0000","last_became_active":"2024-09-12T00:34:52.188352+0000","last_became_peered":"2024-09-12T00:34:52.188352+0000","last_unstale":"2024-09-12T01:01:37.541584+0000","last_undegraded":"2024-09-12T01:01:37.541584+0000","last_fullsized":"2024-09-12T01:01:37.541584+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:23.453176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'29","reported_seq":125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:42.712902+0000","last_change":"2024-09-12T00:33:10.846375+0000","last_active":"2024-09-12T01:00:42.712902+0000","last_peered":"2024-09-12T01:00:42.712902+0000","last_clean":"2024-09-12T01:00:42.712902+0000","last_became_active":"2024-09-12T00:33:10.845301+0000","last_became_peered":"2024-09-12T00:33:10.845301+0000","last_unstale":"2024-09-12T01:00:42.712902+0000","last_undegraded":"2024-09-12T01:00:42.712902+0000","last_fullsized":"2024-09-12T01:00:42.712902+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:52.282677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.534764+0000","last_change":"2024-09-12T00:46:09.499014+0000","last_active":"2024-09-12T01:01:12.534764+0000","last_peered":"2024-09-12T01:01:12.534764+0000","last_clean":"2024-09-12T01:01:12.534764+0000","last_became_active":"2024-09-12T00:46:09.498002+0000","last_became_peered":"2024-09-12T00:46:09.498002+0000","last_unstale":"2024-09-12T01:01:12.534764+0000","last_undegraded":"2024-09-12T01:01:12.534764+0000","last_fullsized":"2024-09-12T01:01:12.534764+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:50.022966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":34,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.703624+0000","last_change":"2024-09-12T00:34:55.215867+0000","last_active":"2024-09-12T00:59:57.703624+0000","last_peered":"2024-09-12T00:59:57.703624+0000","last_clean":"2024-09-12T00:59:57.703624+0000","last_became_active":"2024-09-12T00:34:55.215076+0000","last_became_peered":"2024-09-12T00:34:55.215076+0000","last_unstale":"2024-09-12T00:59:57.703624+0000","last_undegraded":"2024-09-12T00:59:57.703624+0000","last_fullsized":"2024-09-12T00:59:57.703624+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:36.048042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"265'2","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:52.517005+0000","last_change":"2024-09-12T00:34:52.199214+0000","last_active":"2024-09-12T00:59:52.517005+0000","last_peered":"2024-09-12T00:59:52.517005+0000","last_clean":"2024-09-12T00:59:52.517005+0000","last_became_active":"2024-09-12T00:34:52.198548+0000","last_became_peered":"2024-09-12T00:34:52.198548+0000","last_unstale":"2024-09-12T00:59:52.517005+0000","last_undegraded":"2024-09-12T00:59:52.517005+0000","last_fullsized":"2024-09-12T00:59:52.517005+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:36.364945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'18","reported_seq":93,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:56.536596+0000","last_change":"2024-09-12T00:33:10.857470+0000","last_active":"2024-09-12T00:59:56.536596+0000","last_peered":"2024-09-12T00:59:56.536596+0000","last_clean":"2024-09-12T00:59:56.536596+0000","last_became_active":"2024-09-12T00:33:10.856664+0000","last_became_peered":"2024-09-12T00:33:10.856664+0000","last_unstale":"2024-09-12T00:59:56.536596+0000","last_undegraded":"2024-09-12T00:59:56.536596+0000","last_fullsized":"2024-09-12T00:59:56.536596+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:26.626571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":59,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.534815+0000","last_change":"2024-09-12T00:46:09.504100+0000","last_active":"2024-09-12T01:01:12.534815+0000","last_peered":"2024-09-12T01:01:12.534815+0000","last_clean":"2024-09-12T01:01:12.534815+0000","last_became_active":"2024-09-12T00:46:09.503361+0000","last_became_peered":"2024-09-12T00:46:09.503361+0000","last_unstale":"2024-09-12T01:01:12.534815+0000","last_undegraded":"2024-09-12T01:01:12.534815+0000","last_fullsized":"2024-09-12T01:01:12.534815+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:15.687886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":34,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:56.723763+0000","last_change":"2024-09-12T00:34:55.217786+0000","last_active":"2024-09-12T00:59:56.723763+0000","last_peered":"2024-09-12T00:59:56.723763+0000","last_clean":"2024-09-12T00:59:56.723763+0000","last_became_active":"2024-09-12T00:34:55.217009+0000","last_became_peered":"2024-09-12T00:34:55.217009+0000","last_unstale":"2024-09-12T00:59:56.723763+0000","last_undegraded":"2024-09-12T00:59:56.723763+0000","last_fullsized":"2024-09-12T00:59:56.723763+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:52.140153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"268'2","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.578269+0000","last_change":"2024-09-12T00:34:52.206482+0000","last_active":"2024-09-12T01:02:21.578269+0000","last_peered":"2024-09-12T01:02:21.578269+0000","last_clean":"2024-09-12T01:02:21.578269+0000","last_became_active":"2024-09-12T00:34:52.202432+0000","last_became_peered":"2024-09-12T00:34:52.202432+0000","last_unstale":"2024-09-12T01:02:21.578269+0000","last_undegraded":"2024-09-12T01:02:21.578269+0000","last_fullsized":"2024-09-12T01:02:21.578269+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:47.587915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"268'46","reported_seq":174,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.554878+0000","last_change":"2024-09-12T00:33:10.846991+0000","last_active":"2024-09-12T01:02:11.554878+0000","last_peered":"2024-09-12T01:02:11.554878+0000","last_clean":"2024-09-12T01:02:11.554878+0000","last_became_active":"2024-09-12T00:33:10.846370+0000","last_became_peered":"2024-09-12T00:33:10.846370+0000","last_unstale":"2024-09-12T01:02:11.554878+0000","last_undegraded":"2024-09-12T01:02:11.554878+0000","last_fullsized":"2024-09-12T01:02:11.554878+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:49.969549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":168,"num_write":82,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:11.525647+0000","last_change":"2024-09-12T00:46:09.494884+0000","last_active":"2024-09-12T01:00:11.525647+0000","last_peered":"2024-09-12T01:00:11.525647+0000","last_clean":"2024-09-12T01:00:11.525647+0000","last_became_active":"2024-09-12T00:46:09.494139+0000","last_became_peered":"2024-09-12T00:46:09.494139+0000","last_unstale":"2024-09-12T01:00:11.525647+0000","last_undegraded":"2024-09-12T01:00:11.525647+0000","last_fullsized":"2024-09-12T01:00:11.525647+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:16.093338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":35,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:31.748997+0000","last_change":"2024-09-12T00:34:55.253827+0000","last_active":"2024-09-12T01:01:31.748997+0000","last_peered":"2024-09-12T01:01:31.748997+0000","last_clean":"2024-09-12T01:01:31.748997+0000","last_became_active":"2024-09-12T00:34:55.253209+0000","last_became_peered":"2024-09-12T00:34:55.253209+0000","last_unstale":"2024-09-12T01:01:31.748997+0000","last_undegraded":"2024-09-12T01:01:31.748997+0000","last_fullsized":"2024-09-12T01:01:31.748997+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:58.016129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'1","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:32.729826+0000","last_change":"2024-09-12T00:34:52.180802+0000","last_active":"2024-09-12T01:00:32.729826+0000","last_peered":"2024-09-12T01:00:32.729826+0000","last_clean":"2024-09-12T01:00:32.729826+0000","last_became_active":"2024-09-12T00:34:52.180036+0000","last_became_peered":"2024-09-12T00:34:52.180036+0000","last_unstale":"2024-09-12T01:00:32.729826+0000","last_undegraded":"2024-09-12T01:00:32.729826+0000","last_fullsized":"2024-09-12T01:00:32.729826+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:25.152180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'75","reported_seq":263,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.576052+0000","last_change":"2024-09-12T00:33:10.852500+0000","last_active":"2024-09-12T01:02:11.576052+0000","last_peered":"2024-09-12T01:02:11.576052+0000","last_clean":"2024-09-12T01:02:11.576052+0000","last_became_active":"2024-09-12T00:33:10.851672+0000","last_became_peered":"2024-09-12T00:33:10.851672+0000","last_unstale":"2024-09-12T01:02:11.576052+0000","last_undegraded":"2024-09-12T01:02:11.576052+0000","last_fullsized":"2024-09-12T01:02:11.576052+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:45.023568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":415,"num_read_kb":311,"num_write":116,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:11.698157+0000","last_change":"2024-09-12T00:46:09.519546+0000","last_active":"2024-09-12T01:00:11.698157+0000","last_peered":"2024-09-12T01:00:11.698157+0000","last_clean":"2024-09-12T01:00:11.698157+0000","last_became_active":"2024-09-12T00:46:09.513012+0000","last_became_peered":"2024-09-12T00:46:09.513012+0000","last_unstale":"2024-09-12T01:00:11.698157+0000","last_undegraded":"2024-09-12T01:00:11.698157+0000","last_fullsized":"2024-09-12T01:00:11.698157+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:10.067526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"268'8","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.804144+0000","last_change":"2024-09-12T00:34:55.254204+0000","last_active":"2024-09-12T01:04:39.804144+0000","last_peered":"2024-09-12T01:04:39.804144+0000","last_clean":"2024-09-12T01:04:39.804144+0000","last_became_active":"2024-09-12T00:34:55.252580+0000","last_became_peered":"2024-09-12T00:34:55.252580+0000","last_unstale":"2024-09-12T01:04:39.804144+0000","last_undegraded":"2024-09-12T01:04:39.804144+0000","last_fullsized":"2024-09-12T01:04:39.804144+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:00.820979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":14336,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:27.538170+0000","last_change":"2024-09-12T00:34:52.204725+0000","last_active":"2024-09-12T01:01:27.538170+0000","last_peered":"2024-09-12T01:01:27.538170+0000","last_clean":"2024-09-12T01:01:27.538170+0000","last_became_active":"2024-09-12T00:34:52.204021+0000","last_became_peered":"2024-09-12T00:34:52.204021+0000","last_unstale":"2024-09-12T01:01:27.538170+0000","last_undegraded":"2024-09-12T01:01:27.538170+0000","last_fullsized":"2024-09-12T01:01:27.538170+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:45.824620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'35","reported_seq":145,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.759818+0000","last_change":"2024-09-12T00:33:10.850040+0000","last_active":"2024-09-12T01:02:11.759818+0000","last_peered":"2024-09-12T01:02:11.759818+0000","last_clean":"2024-09-12T01:02:11.759818+0000","last_became_active":"2024-09-12T00:33:10.849228+0000","last_became_peered":"2024-09-12T00:33:10.849228+0000","last_unstale":"2024-09-12T01:02:11.759818+0000","last_undegraded":"2024-09-12T01:02:11.759818+0000","last_fullsized":"2024-09-12T01:02:11.759818+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:46.335542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":134,"num_write":61,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:12.520461+0000","last_change":"2024-09-12T00:46:09.500158+0000","last_active":"2024-09-12T01:00:12.520461+0000","last_peered":"2024-09-12T01:00:12.520461+0000","last_clean":"2024-09-12T01:00:12.520461+0000","last_became_active":"2024-09-12T00:46:09.499137+0000","last_became_peered":"2024-09-12T00:46:09.499137+0000","last_unstale":"2024-09-12T01:00:12.520461+0000","last_undegraded":"2024-09-12T01:00:12.520461+0000","last_fullsized":"2024-09-12T01:00:12.520461+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:28.716621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"268'5","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:56.783697+0000","last_change":"2024-09-12T00:34:55.254921+0000","last_active":"2024-09-12T01:03:56.783697+0000","last_peered":"2024-09-12T01:03:56.783697+0000","last_clean":"2024-09-12T01:03:56.783697+0000","last_became_active":"2024-09-12T00:34:55.254250+0000","last_became_peered":"2024-09-12T00:34:55.254250+0000","last_unstale":"2024-09-12T01:03:56.783697+0000","last_undegraded":"2024-09-12T01:03:56.783697+0000","last_fullsized":"2024-09-12T01:03:56.783697+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:45.939058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":318,"num_write":10,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:26.714599+0000","last_change":"2024-09-12T00:34:52.179911+0000","last_active":"2024-09-12T01:01:26.714599+0000","last_peered":"2024-09-12T01:01:26.714599+0000","last_clean":"2024-09-12T01:01:26.714599+0000","last_became_active":"2024-09-12T00:34:52.173822+0000","last_became_peered":"2024-09-12T00:34:52.173822+0000","last_unstale":"2024-09-12T01:01:26.714599+0000","last_undegraded":"2024-09-12T01:01:26.714599+0000","last_fullsized":"2024-09-12T01:01:26.714599+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:44.199880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'34","reported_seq":141,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.724049+0000","last_change":"2024-09-12T00:33:10.842194+0000","last_active":"2024-09-12T01:02:11.724049+0000","last_peered":"2024-09-12T01:02:11.724049+0000","last_clean":"2024-09-12T01:02:11.724049+0000","last_became_active":"2024-09-12T00:33:10.841363+0000","last_became_peered":"2024-09-12T00:33:10.841363+0000","last_unstale":"2024-09-12T01:02:11.724049+0000","last_undegraded":"2024-09-12T01:02:11.724049+0000","last_fullsized":"2024-09-12T01:02:11.724049+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:29.266511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":128,"num_write":55,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:12.725014+0000","last_change":"2024-09-12T00:46:09.506737+0000","last_active":"2024-09-12T01:00:12.725014+0000","last_peered":"2024-09-12T01:00:12.725014+0000","last_clean":"2024-09-12T01:00:12.725014+0000","last_became_active":"2024-09-12T00:46:09.502684+0000","last_became_peered":"2024-09-12T00:46:09.502684+0000","last_unstale":"2024-09-12T01:00:12.725014+0000","last_undegraded":"2024-09-12T01:00:12.725014+0000","last_fullsized":"2024-09-12T01:00:12.725014+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:55.402567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"268'5","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:32.540359+0000","last_change":"2024-09-12T00:34:55.227141+0000","last_active":"2024-09-12T01:01:32.540359+0000","last_peered":"2024-09-12T01:01:32.540359+0000","last_clean":"2024-09-12T01:01:32.540359+0000","last_became_active":"2024-09-12T00:34:55.226388+0000","last_became_peered":"2024-09-12T00:34:55.226388+0000","last_unstale":"2024-09-12T01:01:32.540359+0000","last_undegraded":"2024-09-12T01:01:32.540359+0000","last_fullsized":"2024-09-12T01:01:32.540359+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:59.431333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":15,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"268'11","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:51.599165+0000","last_change":"2024-09-12T00:34:52.197590+0000","last_active":"2024-09-12T01:03:51.599165+0000","last_peered":"2024-09-12T01:03:51.599165+0000","last_clean":"2024-09-12T01:03:51.599165+0000","last_became_active":"2024-09-12T00:34:52.196770+0000","last_became_peered":"2024-09-12T00:34:52.196770+0000","last_unstale":"2024-09-12T01:03:51.599165+0000","last_undegraded":"2024-09-12T01:03:51.599165+0000","last_fullsized":"2024-09-12T01:03:51.599165+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:15.638504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":25602,"num_write":16,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'4","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:37.433116+0000","last_change":"2024-09-12T00:33:10.858900+0000","last_active":"2024-09-12T01:01:37.433116+0000","last_peered":"2024-09-12T01:01:37.433116+0000","last_clean":"2024-09-12T01:01:37.433116+0000","last_became_active":"2024-09-12T00:33:10.858178+0000","last_became_peered":"2024-09-12T00:33:10.858178+0000","last_unstale":"2024-09-12T01:01:37.433116+0000","last_undegraded":"2024-09-12T01:01:37.433116+0000","last_fullsized":"2024-09-12T01:01:37.433116+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:45.562348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.736528+0000","last_change":"2024-09-12T00:46:09.522998+0000","last_active":"2024-09-12T01:00:41.736528+0000","last_peered":"2024-09-12T01:00:41.736528+0000","last_clean":"2024-09-12T01:00:41.736528+0000","last_became_active":"2024-09-12T00:46:09.521706+0000","last_became_peered":"2024-09-12T00:46:09.521706+0000","last_unstale":"2024-09-12T01:00:41.736528+0000","last_undegraded":"2024-09-12T01:00:41.736528+0000","last_fullsized":"2024-09-12T01:00:41.736528+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:39.145979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"268'4","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.848099+0000","last_change":"2024-09-12T00:34:55.224573+0000","last_active":"2024-09-12T01:04:39.848099+0000","last_peered":"2024-09-12T01:04:39.848099+0000","last_clean":"2024-09-12T01:04:39.848099+0000","last_became_active":"2024-09-12T00:34:55.223787+0000","last_became_peered":"2024-09-12T00:34:55.223787+0000","last_unstale":"2024-09-12T01:04:39.848099+0000","last_undegraded":"2024-09-12T01:04:39.848099+0000","last_fullsized":"2024-09-12T01:04:39.848099+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:30.131692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"268'5","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:32.525816+0000","last_change":"2024-09-12T00:34:52.184714+0000","last_active":"2024-09-12T01:00:32.525816+0000","last_peered":"2024-09-12T01:00:32.525816+0000","last_clean":"2024-09-12T01:00:32.525816+0000","last_became_active":"2024-09-12T00:34:52.183982+0000","last_became_peered":"2024-09-12T00:34:52.183982+0000","last_unstale":"2024-09-12T01:00:32.525816+0000","last_undegraded":"2024-09-12T01:00:32.525816+0000","last_fullsized":"2024-09-12T01:00:32.525816+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:07.745456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":5649,"num_write":5,"num_write_kb":5649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'25","reported_seq":115,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.534711+0000","last_change":"2024-09-12T00:33:10.858835+0000","last_active":"2024-09-12T01:01:12.534711+0000","last_peered":"2024-09-12T01:01:12.534711+0000","last_clean":"2024-09-12T01:01:12.534711+0000","last_became_active":"2024-09-12T00:33:10.858212+0000","last_became_peered":"2024-09-12T00:33:10.858212+0000","last_unstale":"2024-09-12T01:01:12.534711+0000","last_undegraded":"2024-09-12T01:01:12.534711+0000","last_fullsized":"2024-09-12T01:01:12.534711+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:58.477753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":92,"num_write":42,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.549794+0000","last_change":"2024-09-12T00:46:09.518627+0000","last_active":"2024-09-12T01:00:41.549794+0000","last_peered":"2024-09-12T01:00:41.549794+0000","last_clean":"2024-09-12T01:00:41.549794+0000","last_became_active":"2024-09-12T00:46:09.517833+0000","last_became_peered":"2024-09-12T00:46:09.517833+0000","last_unstale":"2024-09-12T01:00:41.549794+0000","last_undegraded":"2024-09-12T01:00:41.549794+0000","last_fullsized":"2024-09-12T01:00:41.549794+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:23.918442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'9","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:36.531490+0000","last_change":"2024-09-12T00:34:55.227520+0000","last_active":"2024-09-12T01:00:36.531490+0000","last_peered":"2024-09-12T01:00:36.531490+0000","last_clean":"2024-09-12T01:00:36.531490+0000","last_became_active":"2024-09-12T00:34:55.226334+0000","last_became_peered":"2024-09-12T00:34:55.226334+0000","last_unstale":"2024-09-12T01:00:36.531490+0000","last_undegraded":"2024-09-12T01:00:36.531490+0000","last_fullsized":"2024-09-12T01:00:36.531490+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:23.592244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":14,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'6","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.770142+0000","last_change":"2024-09-12T00:34:52.179045+0000","last_active":"2024-09-12T01:02:51.770142+0000","last_peered":"2024-09-12T01:02:51.770142+0000","last_clean":"2024-09-12T01:02:51.770142+0000","last_became_active":"2024-09-12T00:34:52.174421+0000","last_became_peered":"2024-09-12T00:34:52.174421+0000","last_unstale":"2024-09-12T01:02:51.770142+0000","last_undegraded":"2024-09-12T01:02:51.770142+0000","last_fullsized":"2024-09-12T01:02:51.770142+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:27.648444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5438,"num_write":6,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"268'52","reported_seq":187,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.554333+0000","last_change":"2024-09-12T00:33:10.849621+0000","last_active":"2024-09-12T01:02:21.554333+0000","last_peered":"2024-09-12T01:02:21.554333+0000","last_clean":"2024-09-12T01:02:21.554333+0000","last_became_active":"2024-09-12T00:33:10.848890+0000","last_became_peered":"2024-09-12T00:33:10.848890+0000","last_unstale":"2024-09-12T01:02:21.554333+0000","last_undegraded":"2024-09-12T01:02:21.554333+0000","last_fullsized":"2024-09-12T01:02:21.554333+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:26.708631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":180,"num_write":98,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:16.541674+0000","last_change":"2024-09-12T00:46:09.521885+0000","last_active":"2024-09-12T01:00:16.541674+0000","last_peered":"2024-09-12T01:00:16.541674+0000","last_clean":"2024-09-12T01:00:16.541674+0000","last_became_active":"2024-09-12T00:46:09.521575+0000","last_became_peered":"2024-09-12T00:46:09.521575+0000","last_unstale":"2024-09-12T01:00:16.541674+0000","last_undegraded":"2024-09-12T01:00:16.541674+0000","last_fullsized":"2024-09-12T01:00:16.541674+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:19.905486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"268'7","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.410496+0000","last_change":"2024-09-12T00:34:55.233021+0000","last_active":"2024-09-12T01:04:39.410496+0000","last_peered":"2024-09-12T01:04:39.410496+0000","last_clean":"2024-09-12T01:04:39.410496+0000","last_became_active":"2024-09-12T00:34:55.232215+0000","last_became_peered":"2024-09-12T00:34:55.232215+0000","last_unstale":"2024-09-12T01:04:39.410496+0000","last_undegraded":"2024-09-12T01:04:39.410496+0000","last_fullsized":"2024-09-12T01:04:39.410496+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:02.623358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8310,"num_write":12,"num_write_kb":8251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"268'3","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:32.710859+0000","last_change":"2024-09-12T00:34:52.200570+0000","last_active":"2024-09-12T01:00:32.710859+0000","last_peered":"2024-09-12T01:00:32.710859+0000","last_clean":"2024-09-12T01:00:32.710859+0000","last_became_active":"2024-09-12T00:34:52.199793+0000","last_became_peered":"2024-09-12T00:34:52.199793+0000","last_unstale":"2024-09-12T01:00:32.710859+0000","last_undegraded":"2024-09-12T01:00:32.710859+0000","last_fullsized":"2024-09-12T01:00:32.710859+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:28.505129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'20","reported_seq":103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.535700+0000","last_change":"2024-09-12T00:33:10.845733+0000","last_active":"2024-09-12T01:01:12.535700+0000","last_peered":"2024-09-12T01:01:12.535700+0000","last_clean":"2024-09-12T01:01:12.535700+0000","last_became_active":"2024-09-12T00:33:10.844957+0000","last_became_peered":"2024-09-12T00:33:10.844957+0000","last_unstale":"2024-09-12T01:01:12.535700+0000","last_undegraded":"2024-09-12T01:01:12.535700+0000","last_fullsized":"2024-09-12T01:01:12.535700+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:00.371030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":73,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.736485+0000","last_change":"2024-09-12T00:46:09.515049+0000","last_active":"2024-09-12T01:00:41.736485+0000","last_peered":"2024-09-12T01:00:41.736485+0000","last_clean":"2024-09-12T01:00:41.736485+0000","last_became_active":"2024-09-12T00:46:09.514727+0000","last_became_peered":"2024-09-12T00:46:09.514727+0000","last_unstale":"2024-09-12T01:00:41.736485+0000","last_undegraded":"2024-09-12T01:00:41.736485+0000","last_fullsized":"2024-09-12T01:00:41.736485+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:28.627541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"268'5","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:37.711861+0000","last_change":"2024-09-12T00:34:55.220880+0000","last_active":"2024-09-12T01:00:37.711861+0000","last_peered":"2024-09-12T01:00:37.711861+0000","last_clean":"2024-09-12T01:00:37.711861+0000","last_became_active":"2024-09-12T00:34:55.220179+0000","last_became_peered":"2024-09-12T00:34:55.220179+0000","last_unstale":"2024-09-12T01:00:37.711861+0000","last_undegraded":"2024-09-12T01:00:37.711861+0000","last_fullsized":"2024-09-12T01:00:37.711861+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:14.092881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"268'5","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:32.729791+0000","last_change":"2024-09-12T00:34:52.197324+0000","last_active":"2024-09-12T01:00:32.729791+0000","last_peered":"2024-09-12T01:00:32.729791+0000","last_clean":"2024-09-12T01:00:32.729791+0000","last_became_active":"2024-09-12T00:34:52.196592+0000","last_became_peered":"2024-09-12T00:34:52.196592+0000","last_unstale":"2024-09-12T01:00:32.729791+0000","last_undegraded":"2024-09-12T01:00:32.729791+0000","last_fullsized":"2024-09-12T01:00:32.729791+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:12.628205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":10,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'27","reported_seq":117,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:11.743558+0000","last_change":"2024-09-12T00:33:10.842922+0000","last_active":"2024-09-12T01:01:11.743558+0000","last_peered":"2024-09-12T01:01:11.743558+0000","last_clean":"2024-09-12T01:01:11.743558+0000","last_became_active":"2024-09-12T00:33:10.842139+0000","last_became_peered":"2024-09-12T00:33:10.842139+0000","last_unstale":"2024-09-12T01:01:11.743558+0000","last_undegraded":"2024-09-12T01:01:11.743558+0000","last_fullsized":"2024-09-12T01:01:11.743558+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:22.677651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":87,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:21.713467+0000","last_change":"2024-09-12T00:46:09.495008+0000","last_active":"2024-09-12T01:01:21.713467+0000","last_peered":"2024-09-12T01:01:21.713467+0000","last_clean":"2024-09-12T01:01:21.713467+0000","last_became_active":"2024-09-12T00:46:09.494257+0000","last_became_peered":"2024-09-12T00:46:09.494257+0000","last_unstale":"2024-09-12T01:01:21.713467+0000","last_undegraded":"2024-09-12T01:01:21.713467+0000","last_fullsized":"2024-09-12T01:01:21.713467+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:13.650561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":36,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.755822+0000","last_change":"2024-09-12T00:34:55.228058+0000","last_active":"2024-09-12T01:01:56.755822+0000","last_peered":"2024-09-12T01:01:56.755822+0000","last_clean":"2024-09-12T01:01:56.755822+0000","last_became_active":"2024-09-12T00:34:55.226471+0000","last_became_peered":"2024-09-12T00:34:55.226471+0000","last_unstale":"2024-09-12T01:01:56.755822+0000","last_undegraded":"2024-09-12T01:01:56.755822+0000","last_fullsized":"2024-09-12T01:01:56.755822+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:56.137407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'2","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:52.543792+0000","last_change":"2024-09-12T00:34:52.203278+0000","last_active":"2024-09-12T01:01:52.543792+0000","last_peered":"2024-09-12T01:01:52.543792+0000","last_clean":"2024-09-12T01:01:52.543792+0000","last_became_active":"2024-09-12T00:34:52.202587+0000","last_became_peered":"2024-09-12T00:34:52.202587+0000","last_unstale":"2024-09-12T01:01:52.543792+0000","last_undegraded":"2024-09-12T01:01:52.543792+0000","last_fullsized":"2024-09-12T01:01:52.543792+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:59.179898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'23","reported_seq":108,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:16.729118+0000","last_change":"2024-09-12T00:33:10.833328+0000","last_active":"2024-09-12T01:00:16.729118+0000","last_peered":"2024-09-12T01:00:16.729118+0000","last_clean":"2024-09-12T01:00:16.729118+0000","last_became_active":"2024-09-12T00:33:10.832622+0000","last_became_peered":"2024-09-12T00:33:10.832622+0000","last_unstale":"2024-09-12T01:00:16.729118+0000","last_undegraded":"2024-09-12T01:00:16.729118+0000","last_fullsized":"2024-09-12T01:00:16.729118+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:46.829359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":78,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.544986+0000","last_change":"2024-09-12T00:46:09.502064+0000","last_active":"2024-09-12T01:01:57.544986+0000","last_peered":"2024-09-12T01:01:57.544986+0000","last_clean":"2024-09-12T01:01:57.544986+0000","last_became_active":"2024-09-12T00:46:09.501361+0000","last_became_peered":"2024-09-12T00:46:09.501361+0000","last_unstale":"2024-09-12T01:01:57.544986+0000","last_undegraded":"2024-09-12T01:01:57.544986+0000","last_fullsized":"2024-09-12T01:01:57.544986+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:11.638769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"268'2","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:11.786015+0000","last_change":"2024-09-12T00:34:55.222844+0000","last_active":"2024-09-12T01:04:11.786015+0000","last_peered":"2024-09-12T01:04:11.786015+0000","last_clean":"2024-09-12T01:04:11.786015+0000","last_became_active":"2024-09-12T00:34:55.222079+0000","last_became_peered":"2024-09-12T00:34:55.222079+0000","last_unstale":"2024-09-12T01:04:11.786015+0000","last_undegraded":"2024-09-12T01:04:11.786015+0000","last_fullsized":"2024-09-12T01:04:11.786015+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:10.859567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"268'3","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:06.745540+0000","last_change":"2024-09-12T00:34:52.177816+0000","last_active":"2024-09-12T01:04:06.745540+0000","last_peered":"2024-09-12T01:04:06.745540+0000","last_clean":"2024-09-12T01:04:06.745540+0000","last_became_active":"2024-09-12T00:34:52.176108+0000","last_became_peered":"2024-09-12T00:34:52.176108+0000","last_unstale":"2024-09-12T01:04:06.745540+0000","last_undegraded":"2024-09-12T01:04:06.745540+0000","last_fullsized":"2024-09-12T01:04:06.745540+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:39.727514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'16","reported_seq":90,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:12.725245+0000","last_change":"2024-09-12T00:33:10.850501+0000","last_active":"2024-09-12T01:00:12.725245+0000","last_peered":"2024-09-12T01:00:12.725245+0000","last_clean":"2024-09-12T01:00:12.725245+0000","last_became_active":"2024-09-12T00:33:10.849703+0000","last_became_peered":"2024-09-12T00:33:10.849703+0000","last_unstale":"2024-09-12T01:00:12.725245+0000","last_undegraded":"2024-09-12T01:00:12.725245+0000","last_fullsized":"2024-09-12T01:00:12.725245+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:34.698555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:22.721112+0000","last_change":"2024-09-12T00:46:09.517232+0000","last_active":"2024-09-12T01:01:22.721112+0000","last_peered":"2024-09-12T01:01:22.721112+0000","last_clean":"2024-09-12T01:01:22.721112+0000","last_became_active":"2024-09-12T00:46:09.514197+0000","last_became_peered":"2024-09-12T00:46:09.514197+0000","last_unstale":"2024-09-12T01:01:22.721112+0000","last_undegraded":"2024-09-12T01:01:22.721112+0000","last_fullsized":"2024-09-12T01:01:22.721112+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:13.571995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"268'8","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:21.369472+0000","last_change":"2024-09-12T00:34:55.253416+0000","last_active":"2024-09-12T01:04:21.369472+0000","last_peered":"2024-09-12T01:04:21.369472+0000","last_clean":"2024-09-12T01:04:21.369472+0000","last_became_active":"2024-09-12T00:34:55.252651+0000","last_became_peered":"2024-09-12T00:34:55.252651+0000","last_unstale":"2024-09-12T01:04:21.369472+0000","last_undegraded":"2024-09-12T01:04:21.369472+0000","last_fullsized":"2024-09-12T01:04:21.369472+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:51.619823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":7697,"num_write":8,"num_write_kb":6673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"268'3","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:06.601687+0000","last_change":"2024-09-12T00:34:52.201618+0000","last_active":"2024-09-12T01:04:06.601687+0000","last_peered":"2024-09-12T01:04:06.601687+0000","last_clean":"2024-09-12T01:04:06.601687+0000","last_became_active":"2024-09-12T00:34:52.177094+0000","last_became_peered":"2024-09-12T00:34:52.177094+0000","last_unstale":"2024-09-12T01:04:06.601687+0000","last_undegraded":"2024-09-12T01:04:06.601687+0000","last_fullsized":"2024-09-12T01:04:06.601687+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:28.340168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"268'31","reported_seq":132,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:12.706722+0000","last_change":"2024-09-12T00:33:10.863914+0000","last_active":"2024-09-12T01:00:12.706722+0000","last_peered":"2024-09-12T01:00:12.706722+0000","last_clean":"2024-09-12T01:00:12.706722+0000","last_became_active":"2024-09-12T00:33:10.862993+0000","last_became_peered":"2024-09-12T00:33:10.862993+0000","last_unstale":"2024-09-12T01:00:12.706722+0000","last_undegraded":"2024-09-12T01:00:12.706722+0000","last_fullsized":"2024-09-12T01:00:12.706722+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:01.904051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":107,"num_write":58,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:22.536912+0000","last_change":"2024-09-12T00:46:09.499178+0000","last_active":"2024-09-12T01:01:22.536912+0000","last_peered":"2024-09-12T01:01:22.536912+0000","last_clean":"2024-09-12T01:01:22.536912+0000","last_became_active":"2024-09-12T00:46:09.498482+0000","last_became_peered":"2024-09-12T00:46:09.498482+0000","last_unstale":"2024-09-12T01:01:22.536912+0000","last_undegraded":"2024-09-12T01:01:22.536912+0000","last_fullsized":"2024-09-12T01:01:22.536912+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:41.343998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":36,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.755870+0000","last_change":"2024-09-12T00:34:55.229076+0000","last_active":"2024-09-12T01:01:56.755870+0000","last_peered":"2024-09-12T01:01:56.755870+0000","last_clean":"2024-09-12T01:01:56.755870+0000","last_became_active":"2024-09-12T00:34:55.228136+0000","last_became_peered":"2024-09-12T00:34:55.228136+0000","last_unstale":"2024-09-12T01:01:56.755870+0000","last_undegraded":"2024-09-12T01:01:56.755870+0000","last_fullsized":"2024-09-12T01:01:56.755870+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:13.739031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.551311+0000","last_change":"2024-09-12T00:34:52.191163+0000","last_active":"2024-09-12T01:01:56.551311+0000","last_peered":"2024-09-12T01:01:56.551311+0000","last_clean":"2024-09-12T01:01:56.551311+0000","last_became_active":"2024-09-12T00:34:52.190350+0000","last_became_peered":"2024-09-12T00:34:52.190350+0000","last_unstale":"2024-09-12T01:01:56.551311+0000","last_undegraded":"2024-09-12T01:01:56.551311+0000","last_fullsized":"2024-09-12T01:01:56.551311+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:44.544700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'31","reported_seq":131,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:26.726939+0000","last_change":"2024-09-12T00:33:10.834922+0000","last_active":"2024-09-12T01:02:26.726939+0000","last_peered":"2024-09-12T01:02:26.726939+0000","last_clean":"2024-09-12T01:02:26.726939+0000","last_became_active":"2024-09-12T00:33:10.834095+0000","last_became_peered":"2024-09-12T00:33:10.834095+0000","last_unstale":"2024-09-12T01:02:26.726939+0000","last_undegraded":"2024-09-12T01:02:26.726939+0000","last_fullsized":"2024-09-12T01:02:26.726939+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:09.706426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":107,"num_write":54,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.755937+0000","last_change":"2024-09-12T00:46:09.502145+0000","last_active":"2024-09-12T01:01:56.755937+0000","last_peered":"2024-09-12T01:01:56.755937+0000","last_clean":"2024-09-12T01:01:56.755937+0000","last_became_active":"2024-09-12T00:46:09.500779+0000","last_became_peered":"2024-09-12T00:46:09.500779+0000","last_unstale":"2024-09-12T01:01:56.755937+0000","last_undegraded":"2024-09-12T01:01:56.755937+0000","last_fullsized":"2024-09-12T01:01:56.755937+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:52.290781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"268'6","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.532068+0000","last_change":"2024-09-12T00:34:55.242037+0000","last_active":"2024-09-12T01:00:57.532068+0000","last_peered":"2024-09-12T01:00:57.532068+0000","last_clean":"2024-09-12T01:00:57.532068+0000","last_became_active":"2024-09-12T00:34:55.241223+0000","last_became_peered":"2024-09-12T00:34:55.241223+0000","last_unstale":"2024-09-12T01:00:57.532068+0000","last_undegraded":"2024-09-12T01:00:57.532068+0000","last_fullsized":"2024-09-12T01:00:57.532068+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:56.166816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":9218,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"268'2","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.588186+0000","last_change":"2024-09-12T00:34:52.206116+0000","last_active":"2024-09-12T01:03:01.588186+0000","last_peered":"2024-09-12T01:03:01.588186+0000","last_clean":"2024-09-12T01:03:01.588186+0000","last_became_active":"2024-09-12T00:34:52.202407+0000","last_became_peered":"2024-09-12T00:34:52.202407+0000","last_unstale":"2024-09-12T01:03:01.588186+0000","last_undegraded":"2024-09-12T01:03:01.588186+0000","last_fullsized":"2024-09-12T01:03:01.588186+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:16.024426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'46","reported_seq":179,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:26.579456+0000","last_change":"2024-09-12T00:33:10.860057+0000","last_active":"2024-09-12T01:02:26.579456+0000","last_peered":"2024-09-12T01:02:26.579456+0000","last_clean":"2024-09-12T01:02:26.579456+0000","last_became_active":"2024-09-12T00:33:10.859459+0000","last_became_peered":"2024-09-12T00:33:10.859459+0000","last_unstale":"2024-09-12T01:02:26.579456+0000","last_undegraded":"2024-09-12T01:02:26.579456+0000","last_fullsized":"2024-09-12T01:02:26.579456+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:02.662726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":176,"num_write":75,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.546185+0000","last_change":"2024-09-12T00:46:09.505921+0000","last_active":"2024-09-12T01:02:02.546185+0000","last_peered":"2024-09-12T01:02:02.546185+0000","last_clean":"2024-09-12T01:02:02.546185+0000","last_became_active":"2024-09-12T00:46:09.505143+0000","last_became_peered":"2024-09-12T00:46:09.505143+0000","last_unstale":"2024-09-12T01:02:02.546185+0000","last_undegraded":"2024-09-12T01:02:02.546185+0000","last_fullsized":"2024-09-12T01:02:02.546185+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:58.286882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"268'1","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.530957+0000","last_change":"2024-09-12T00:34:55.253946+0000","last_active":"2024-09-12T01:00:57.530957+0000","last_peered":"2024-09-12T01:00:57.530957+0000","last_clean":"2024-09-12T01:00:57.530957+0000","last_became_active":"2024-09-12T00:34:55.253169+0000","last_became_peered":"2024-09-12T00:34:55.253169+0000","last_unstale":"2024-09-12T01:00:57.530957+0000","last_undegraded":"2024-09-12T01:00:57.530957+0000","last_fullsized":"2024-09-12T01:00:57.530957+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:41.186189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"268'2","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.351704+0000","last_change":"2024-09-12T00:34:52.190974+0000","last_active":"2024-09-12T01:03:01.351704+0000","last_peered":"2024-09-12T01:03:01.351704+0000","last_clean":"2024-09-12T01:03:01.351704+0000","last_became_active":"2024-09-12T00:34:52.190174+0000","last_became_peered":"2024-09-12T00:34:52.190174+0000","last_unstale":"2024-09-12T01:03:01.351704+0000","last_undegraded":"2024-09-12T01:03:01.351704+0000","last_fullsized":"2024-09-12T01:03:01.351704+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:22.602978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'29","reported_seq":121,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:32.539090+0000","last_change":"2024-09-12T00:33:10.850390+0000","last_active":"2024-09-12T01:01:32.539090+0000","last_peered":"2024-09-12T01:01:32.539090+0000","last_clean":"2024-09-12T01:01:32.539090+0000","last_became_active":"2024-09-12T00:33:10.849658+0000","last_became_peered":"2024-09-12T00:33:10.849658+0000","last_unstale":"2024-09-12T01:01:32.539090+0000","last_undegraded":"2024-09-12T01:01:32.539090+0000","last_fullsized":"2024-09-12T01:01:32.539090+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:17.300231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":91,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.545034+0000","last_change":"2024-09-12T00:46:09.487986+0000","last_active":"2024-09-12T01:01:57.545034+0000","last_peered":"2024-09-12T01:01:57.545034+0000","last_clean":"2024-09-12T01:01:57.545034+0000","last_became_active":"2024-09-12T00:46:09.485933+0000","last_became_peered":"2024-09-12T00:46:09.485933+0000","last_unstale":"2024-09-12T01:01:57.545034+0000","last_undegraded":"2024-09-12T01:01:57.545034+0000","last_fullsized":"2024-09-12T01:01:57.545034+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:26.699689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"268'2","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:11.364205+0000","last_change":"2024-09-12T00:34:55.237633+0000","last_active":"2024-09-12T01:04:11.364205+0000","last_peered":"2024-09-12T01:04:11.364205+0000","last_clean":"2024-09-12T01:04:11.364205+0000","last_became_active":"2024-09-12T00:34:55.236708+0000","last_became_peered":"2024-09-12T00:34:55.236708+0000","last_unstale":"2024-09-12T01:04:11.364205+0000","last_undegraded":"2024-09-12T01:04:11.364205+0000","last_fullsized":"2024-09-12T01:04:11.364205+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:53.892191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'4","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.047616+0000","last_change":"2024-09-12T00:34:52.209042+0000","last_active":"2024-09-12T01:04:39.047616+0000","last_peered":"2024-09-12T01:04:39.047616+0000","last_clean":"2024-09-12T01:04:39.047616+0000","last_became_active":"2024-09-12T00:34:52.205829+0000","last_became_peered":"2024-09-12T00:34:52.205829+0000","last_unstale":"2024-09-12T01:04:39.047616+0000","last_undegraded":"2024-09-12T01:04:39.047616+0000","last_fullsized":"2024-09-12T01:04:39.047616+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:59.524499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'30","reported_seq":133,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:21.746083+0000","last_change":"2024-09-12T00:33:10.825945+0000","last_active":"2024-09-12T01:01:21.746083+0000","last_peered":"2024-09-12T01:01:21.746083+0000","last_clean":"2024-09-12T01:01:21.746083+0000","last_became_active":"2024-09-12T00:33:10.825191+0000","last_became_peered":"2024-09-12T00:33:10.825191+0000","last_unstale":"2024-09-12T01:01:21.746083+0000","last_undegraded":"2024-09-12T01:01:21.746083+0000","last_fullsized":"2024-09-12T01:01:21.746083+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:47.230850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":116,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.571862+0000","last_change":"2024-09-12T00:46:09.505717+0000","last_active":"2024-09-12T01:01:56.571862+0000","last_peered":"2024-09-12T01:01:56.571862+0000","last_clean":"2024-09-12T01:01:56.571862+0000","last_became_active":"2024-09-12T00:46:09.504789+0000","last_became_peered":"2024-09-12T00:46:09.504789+0000","last_unstale":"2024-09-12T01:01:56.571862+0000","last_undegraded":"2024-09-12T01:01:56.571862+0000","last_fullsized":"2024-09-12T01:01:56.571862+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:54.929380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'2","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.533522+0000","last_change":"2024-09-12T00:34:55.238407+0000","last_active":"2024-09-12T01:01:07.533522+0000","last_peered":"2024-09-12T01:01:07.533522+0000","last_clean":"2024-09-12T01:01:07.533522+0000","last_became_active":"2024-09-12T00:34:55.237691+0000","last_became_peered":"2024-09-12T00:34:55.237691+0000","last_unstale":"2024-09-12T01:01:07.533522+0000","last_undegraded":"2024-09-12T01:01:07.533522+0000","last_fullsized":"2024-09-12T01:01:07.533522+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:43.698302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'8","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:52.545095+0000","last_change":"2024-09-12T00:34:52.200839+0000","last_active":"2024-09-12T01:01:52.545095+0000","last_peered":"2024-09-12T01:01:52.545095+0000","last_clean":"2024-09-12T01:01:52.545095+0000","last_became_active":"2024-09-12T00:34:52.200033+0000","last_became_peered":"2024-09-12T00:34:52.200033+0000","last_unstale":"2024-09-12T01:01:52.545095+0000","last_undegraded":"2024-09-12T01:01:52.545095+0000","last_fullsized":"2024-09-12T01:01:52.545095+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:12.523538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":17410,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'38","reported_seq":149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:20.583311+0000","last_change":"2024-09-12T00:33:10.856023+0000","last_active":"2024-09-12T01:02:20.583311+0000","last_peered":"2024-09-12T01:02:20.583311+0000","last_clean":"2024-09-12T01:02:20.583311+0000","last_became_active":"2024-09-12T00:33:10.855257+0000","last_became_peered":"2024-09-12T00:33:10.855257+0000","last_unstale":"2024-09-12T01:02:20.583311+0000","last_undegraded":"2024-09-12T01:02:20.583311+0000","last_fullsized":"2024-09-12T01:02:20.583311+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:54.073580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":126,"num_write":70,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.528702+0000","last_change":"2024-09-12T00:46:09.504978+0000","last_active":"2024-09-12T01:00:47.528702+0000","last_peered":"2024-09-12T01:00:47.528702+0000","last_clean":"2024-09-12T01:00:47.528702+0000","last_became_active":"2024-09-12T00:46:09.504114+0000","last_became_peered":"2024-09-12T00:46:09.504114+0000","last_unstale":"2024-09-12T01:00:47.528702+0000","last_undegraded":"2024-09-12T01:00:47.528702+0000","last_fullsized":"2024-09-12T01:00:47.528702+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:13.348535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'2","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.575855+0000","last_change":"2024-09-12T00:34:55.235646+0000","last_active":"2024-09-12T01:02:11.575855+0000","last_peered":"2024-09-12T01:02:11.575855+0000","last_clean":"2024-09-12T01:02:11.575855+0000","last_became_active":"2024-09-12T00:34:55.234795+0000","last_became_peered":"2024-09-12T00:34:55.234795+0000","last_unstale":"2024-09-12T01:02:11.575855+0000","last_undegraded":"2024-09-12T01:02:11.575855+0000","last_fullsized":"2024-09-12T01:02:11.575855+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:10.241846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"268'6","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.545015+0000","last_change":"2024-09-12T00:34:52.199095+0000","last_active":"2024-09-12T01:01:57.545015+0000","last_peered":"2024-09-12T01:01:57.545015+0000","last_clean":"2024-09-12T01:01:57.545015+0000","last_became_active":"2024-09-12T00:34:52.198346+0000","last_became_peered":"2024-09-12T00:34:52.198346+0000","last_unstale":"2024-09-12T01:01:57.545015+0000","last_undegraded":"2024-09-12T01:01:57.545015+0000","last_fullsized":"2024-09-12T01:01:57.545015+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:09.225827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":5122,"num_write":11,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'29","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:21.563766+0000","last_change":"2024-09-12T00:33:10.848211+0000","last_active":"2024-09-12T01:01:21.563766+0000","last_peered":"2024-09-12T01:01:21.563766+0000","last_clean":"2024-09-12T01:01:21.563766+0000","last_became_active":"2024-09-12T00:33:10.847386+0000","last_became_peered":"2024-09-12T00:33:10.847386+0000","last_unstale":"2024-09-12T01:01:21.563766+0000","last_undegraded":"2024-09-12T01:01:21.563766+0000","last_fullsized":"2024-09-12T01:01:21.563766+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:03.256270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":106,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.732885+0000","last_change":"2024-09-12T00:46:09.514213+0000","last_active":"2024-09-12T01:00:47.732885+0000","last_peered":"2024-09-12T01:00:47.732885+0000","last_clean":"2024-09-12T01:00:47.732885+0000","last_became_active":"2024-09-12T00:46:09.509685+0000","last_became_peered":"2024-09-12T00:46:09.509685+0000","last_unstale":"2024-09-12T01:00:47.732885+0000","last_undegraded":"2024-09-12T01:00:47.732885+0000","last_fullsized":"2024-09-12T01:00:47.732885+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:20.031144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"268'2","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:06.601647+0000","last_change":"2024-09-12T00:34:55.251608+0000","last_active":"2024-09-12T01:04:06.601647+0000","last_peered":"2024-09-12T01:04:06.601647+0000","last_clean":"2024-09-12T01:04:06.601647+0000","last_became_active":"2024-09-12T00:34:55.251057+0000","last_became_peered":"2024-09-12T00:34:55.251057+0000","last_unstale":"2024-09-12T01:04:06.601647+0000","last_undegraded":"2024-09-12T01:04:06.601647+0000","last_fullsized":"2024-09-12T01:04:06.601647+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:44.787440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"268'6","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:01.745019+0000","last_change":"2024-09-12T00:34:52.178623+0000","last_active":"2024-09-12T01:04:01.745019+0000","last_peered":"2024-09-12T01:04:01.745019+0000","last_clean":"2024-09-12T01:04:01.745019+0000","last_became_active":"2024-09-12T00:34:52.177088+0000","last_became_peered":"2024-09-12T00:34:52.177088+0000","last_unstale":"2024-09-12T01:04:01.745019+0000","last_undegraded":"2024-09-12T01:04:01.745019+0000","last_fullsized":"2024-09-12T01:04:01.745019+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:51.705833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"268'21","reported_seq":103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:22.721225+0000","last_change":"2024-09-12T00:33:10.845217+0000","last_active":"2024-09-12T01:01:22.721225+0000","last_peered":"2024-09-12T01:01:22.721225+0000","last_clean":"2024-09-12T01:01:22.721225+0000","last_became_active":"2024-09-12T00:33:10.844093+0000","last_became_peered":"2024-09-12T00:33:10.844093+0000","last_unstale":"2024-09-12T01:01:22.721225+0000","last_undegraded":"2024-09-12T01:01:22.721225+0000","last_fullsized":"2024-09-12T01:01:22.721225+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:20.325448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":69,"num_write":38,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:16.556161+0000","last_change":"2024-09-12T00:46:09.498490+0000","last_active":"2024-09-12T01:02:16.556161+0000","last_peered":"2024-09-12T01:02:16.556161+0000","last_clean":"2024-09-12T01:02:16.556161+0000","last_became_active":"2024-09-12T00:46:09.497751+0000","last_became_peered":"2024-09-12T00:46:09.497751+0000","last_unstale":"2024-09-12T01:02:16.556161+0000","last_undegraded":"2024-09-12T01:02:16.556161+0000","last_fullsized":"2024-09-12T01:02:16.556161+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.301246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":36,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.531241+0000","last_change":"2024-09-12T00:34:55.254981+0000","last_active":"2024-09-12T01:00:57.531241+0000","last_peered":"2024-09-12T01:00:57.531241+0000","last_clean":"2024-09-12T01:00:57.531241+0000","last_became_active":"2024-09-12T00:34:55.254446+0000","last_became_peered":"2024-09-12T00:34:55.254446+0000","last_unstale":"2024-09-12T01:00:57.531241+0000","last_undegraded":"2024-09-12T01:00:57.531241+0000","last_fullsized":"2024-09-12T01:00:57.531241+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:32.699370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:52.734131+0000","last_change":"2024-09-12T00:34:52.194065+0000","last_active":"2024-09-12T01:00:52.734131+0000","last_peered":"2024-09-12T01:00:52.734131+0000","last_clean":"2024-09-12T01:00:52.734131+0000","last_became_active":"2024-09-12T00:34:52.193306+0000","last_became_peered":"2024-09-12T00:34:52.193306+0000","last_unstale":"2024-09-12T01:00:52.734131+0000","last_undegraded":"2024-09-12T01:00:52.734131+0000","last_fullsized":"2024-09-12T01:00:52.734131+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:42.593529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"268'36","reported_seq":152,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:32.552885+0000","last_change":"2024-09-12T00:33:10.860393+0000","last_active":"2024-09-12T01:02:32.552885+0000","last_peered":"2024-09-12T01:02:32.552885+0000","last_clean":"2024-09-12T01:02:32.552885+0000","last_became_active":"2024-09-12T00:33:10.859799+0000","last_became_peered":"2024-09-12T00:33:10.859799+0000","last_unstale":"2024-09-12T01:02:32.552885+0000","last_undegraded":"2024-09-12T01:02:32.552885+0000","last_fullsized":"2024-09-12T01:02:32.552885+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:39.916797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":137,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.529751+0000","last_change":"2024-09-12T00:46:09.499691+0000","last_active":"2024-09-12T01:00:47.529751+0000","last_peered":"2024-09-12T01:00:47.529751+0000","last_clean":"2024-09-12T01:00:47.529751+0000","last_became_active":"2024-09-12T00:46:09.498942+0000","last_became_peered":"2024-09-12T00:46:09.498942+0000","last_unstale":"2024-09-12T01:00:47.529751+0000","last_undegraded":"2024-09-12T01:00:47.529751+0000","last_fullsized":"2024-09-12T01:00:47.529751+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:21.881186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'1","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.532379+0000","last_change":"2024-09-12T00:34:55.215046+0000","last_active":"2024-09-12T01:00:57.532379+0000","last_peered":"2024-09-12T01:00:57.532379+0000","last_clean":"2024-09-12T01:00:57.532379+0000","last_became_active":"2024-09-12T00:34:55.214265+0000","last_became_peered":"2024-09-12T00:34:55.214265+0000","last_unstale":"2024-09-12T01:00:57.532379+0000","last_undegraded":"2024-09-12T01:00:57.532379+0000","last_fullsized":"2024-09-12T01:00:57.532379+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:54.580385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"268'6","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:52.530010+0000","last_change":"2024-09-12T00:34:52.204774+0000","last_active":"2024-09-12T01:00:52.530010+0000","last_peered":"2024-09-12T01:00:52.530010+0000","last_clean":"2024-09-12T01:00:52.530010+0000","last_became_active":"2024-09-12T00:34:52.204050+0000","last_became_peered":"2024-09-12T00:34:52.204050+0000","last_unstale":"2024-09-12T01:00:52.530010+0000","last_undegraded":"2024-09-12T01:00:52.530010+0000","last_fullsized":"2024-09-12T01:00:52.530010+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:46.767075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'20","reported_seq":104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.557497+0000","last_change":"2024-09-12T00:33:10.842211+0000","last_active":"2024-09-12T01:02:21.557497+0000","last_peered":"2024-09-12T01:02:21.557497+0000","last_clean":"2024-09-12T01:02:21.557497+0000","last_became_active":"2024-09-12T00:33:10.841411+0000","last_became_peered":"2024-09-12T00:33:10.841411+0000","last_unstale":"2024-09-12T01:02:21.557497+0000","last_undegraded":"2024-09-12T01:02:21.557497+0000","last_fullsized":"2024-09-12T01:02:21.557497+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:13.664749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":70,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"267'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:21.713593+0000","last_change":"2024-09-12T00:46:09.520640+0000","last_active":"2024-09-12T01:01:21.713593+0000","last_peered":"2024-09-12T01:01:21.713593+0000","last_clean":"2024-09-12T01:01:21.713593+0000","last_became_active":"2024-09-12T00:46:09.520251+0000","last_became_peered":"2024-09-12T00:46:09.520251+0000","last_unstale":"2024-09-12T01:01:21.713593+0000","last_undegraded":"2024-09-12T01:01:21.713593+0000","last_fullsized":"2024-09-12T01:01:21.713593+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:17.060682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"268'5","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:06.363265+0000","last_change":"2024-09-12T00:34:55.232689+0000","last_active":"2024-09-12T01:04:06.363265+0000","last_peered":"2024-09-12T01:04:06.363265+0000","last_clean":"2024-09-12T01:04:06.363265+0000","last_became_active":"2024-09-12T00:34:55.230698+0000","last_became_peered":"2024-09-12T00:34:55.230698+0000","last_unstale":"2024-09-12T01:04:06.363265+0000","last_undegraded":"2024-09-12T01:04:06.363265+0000","last_fullsized":"2024-09-12T01:04:06.363265+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:43.460598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"265'5","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.532248+0000","last_change":"2024-09-12T00:34:52.212267+0000","last_active":"2024-09-12T01:01:02.532248+0000","last_peered":"2024-09-12T01:01:02.532248+0000","last_clean":"2024-09-12T01:01:02.532248+0000","last_became_active":"2024-09-12T00:34:52.211709+0000","last_became_peered":"2024-09-12T00:34:52.211709+0000","last_unstale":"2024-09-12T01:01:02.532248+0000","last_undegraded":"2024-09-12T01:01:02.532248+0000","last_fullsized":"2024-09-12T01:01:02.532248+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:37.180708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'225","reported_seq":751,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:22.754603+0000","last_change":"2024-09-12T00:33:10.853482+0000","last_active":"2024-09-12T01:02:22.754603+0000","last_peered":"2024-09-12T01:02:22.754603+0000","last_clean":"2024-09-12T01:02:22.754603+0000","last_became_active":"2024-09-12T00:33:10.852751+0000","last_became_peered":"2024-09-12T00:33:10.852751+0000","last_unstale":"2024-09-12T01:02:22.754603+0000","last_undegraded":"2024-09-12T01:02:22.754603+0000","last_fullsized":"2024-09-12T01:02:22.754603+0000","mapping_epoch":255,"log_start":"265'200","ondisk_log_start":"265'200","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:29.381396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1385,"num_read_kb":1074,"num_write":267,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:21.563715+0000","last_change":"2024-09-12T00:46:09.516940+0000","last_active":"2024-09-12T01:01:21.563715+0000","last_peered":"2024-09-12T01:01:21.563715+0000","last_clean":"2024-09-12T01:01:21.563715+0000","last_became_active":"2024-09-12T00:46:09.516404+0000","last_became_peered":"2024-09-12T00:46:09.516404+0000","last_unstale":"2024-09-12T01:01:21.563715+0000","last_undegraded":"2024-09-12T01:01:21.563715+0000","last_fullsized":"2024-09-12T01:01:21.563715+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:40.623194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"268'5","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.735055+0000","last_change":"2024-09-12T00:34:55.236475+0000","last_active":"2024-09-12T01:00:57.735055+0000","last_peered":"2024-09-12T01:00:57.735055+0000","last_clean":"2024-09-12T01:00:57.735055+0000","last_became_active":"2024-09-12T00:34:55.235522+0000","last_became_peered":"2024-09-12T00:34:55.235522+0000","last_unstale":"2024-09-12T01:00:57.735055+0000","last_undegraded":"2024-09-12T01:00:57.735055+0000","last_fullsized":"2024-09-12T01:00:57.735055+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:26.945052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":5,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"268'5","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.544918+0000","last_change":"2024-09-12T00:34:52.184510+0000","last_active":"2024-09-12T01:01:57.544918+0000","last_peered":"2024-09-12T01:01:57.544918+0000","last_clean":"2024-09-12T01:01:57.544918+0000","last_became_active":"2024-09-12T00:34:52.183769+0000","last_became_peered":"2024-09-12T00:34:52.183769+0000","last_unstale":"2024-09-12T01:01:57.544918+0000","last_undegraded":"2024-09-12T01:01:57.544918+0000","last_fullsized":"2024-09-12T01:01:57.544918+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:59.439643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8194,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'27","reported_seq":122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:22.554180+0000","last_change":"2024-09-12T00:33:10.831668+0000","last_active":"2024-09-12T01:02:22.554180+0000","last_peered":"2024-09-12T01:02:22.554180+0000","last_clean":"2024-09-12T01:02:22.554180+0000","last_became_active":"2024-09-12T00:33:10.830931+0000","last_became_peered":"2024-09-12T00:33:10.830931+0000","last_unstale":"2024-09-12T01:02:22.554180+0000","last_undegraded":"2024-09-12T01:02:22.554180+0000","last_fullsized":"2024-09-12T01:02:22.554180+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:45.604877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":90,"num_write":55,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:46.551264+0000","last_change":"2024-09-12T00:46:09.518153+0000","last_active":"2024-09-12T01:00:46.551264+0000","last_peered":"2024-09-12T01:00:46.551264+0000","last_clean":"2024-09-12T01:00:46.551264+0000","last_became_active":"2024-09-12T00:46:09.517353+0000","last_became_peered":"2024-09-12T00:46:09.517353+0000","last_unstale":"2024-09-12T01:00:46.551264+0000","last_undegraded":"2024-09-12T01:00:46.551264+0000","last_fullsized":"2024-09-12T01:00:46.551264+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:41.256919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"268'8","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.729350+0000","last_change":"2024-09-12T00:34:55.225406+0000","last_active":"2024-09-12T01:02:02.729350+0000","last_peered":"2024-09-12T01:02:02.729350+0000","last_clean":"2024-09-12T01:02:02.729350+0000","last_became_active":"2024-09-12T00:34:55.224353+0000","last_became_peered":"2024-09-12T00:34:55.224353+0000","last_unstale":"2024-09-12T01:02:02.729350+0000","last_undegraded":"2024-09-12T01:02:02.729350+0000","last_fullsized":"2024-09-12T01:02:02.729350+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:35.525207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":22530,"num_write":13,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"268'6","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.308907+0000","last_change":"2024-09-12T00:34:52.204414+0000","last_active":"2024-09-12T01:04:39.308907+0000","last_peered":"2024-09-12T01:04:39.308907+0000","last_clean":"2024-09-12T01:04:39.308907+0000","last_became_active":"2024-09-12T00:34:52.203625+0000","last_became_peered":"2024-09-12T00:34:52.203625+0000","last_unstale":"2024-09-12T01:04:39.308907+0000","last_undegraded":"2024-09-12T01:04:39.308907+0000","last_fullsized":"2024-09-12T01:04:39.308907+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:35.762002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10299,"num_write":6,"num_write_kb":5179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'24","reported_seq":111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:22.733835+0000","last_change":"2024-09-12T00:33:10.845131+0000","last_active":"2024-09-12T01:02:22.733835+0000","last_peered":"2024-09-12T01:02:22.733835+0000","last_clean":"2024-09-12T01:02:22.733835+0000","last_became_active":"2024-09-12T00:33:10.844416+0000","last_became_peered":"2024-09-12T00:33:10.844416+0000","last_unstale":"2024-09-12T01:02:22.733835+0000","last_undegraded":"2024-09-12T01:02:22.733835+0000","last_fullsized":"2024-09-12T01:02:22.733835+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:44.761181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:52.529941+0000","last_change":"2024-09-12T00:46:09.494534+0000","last_active":"2024-09-12T01:00:52.529941+0000","last_peered":"2024-09-12T01:00:52.529941+0000","last_clean":"2024-09-12T01:00:52.529941+0000","last_became_active":"2024-09-12T00:46:09.493808+0000","last_became_peered":"2024-09-12T00:46:09.493808+0000","last_unstale":"2024-09-12T01:00:52.529941+0000","last_undegraded":"2024-09-12T01:00:52.529941+0000","last_fullsized":"2024-09-12T01:00:52.529941+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:01.945866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"268'1","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.547434+0000","last_change":"2024-09-12T00:34:55.234328+0000","last_active":"2024-09-12T01:02:02.547434+0000","last_peered":"2024-09-12T01:02:02.547434+0000","last_clean":"2024-09-12T01:02:02.547434+0000","last_became_active":"2024-09-12T00:34:55.233708+0000","last_became_peered":"2024-09-12T00:34:55.233708+0000","last_unstale":"2024-09-12T01:02:02.547434+0000","last_undegraded":"2024-09-12T01:02:02.547434+0000","last_fullsized":"2024-09-12T01:02:02.547434+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:10.278114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"268'1","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.728291+0000","last_change":"2024-09-12T00:34:52.188218+0000","last_active":"2024-09-12T01:01:57.728291+0000","last_peered":"2024-09-12T01:01:57.728291+0000","last_clean":"2024-09-12T01:01:57.728291+0000","last_became_active":"2024-09-12T00:34:52.186234+0000","last_became_peered":"2024-09-12T00:34:52.186234+0000","last_unstale":"2024-09-12T01:01:57.728291+0000","last_undegraded":"2024-09-12T01:01:57.728291+0000","last_fullsized":"2024-09-12T01:01:57.728291+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:37.401626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'27","reported_seq":126,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:22.536821+0000","last_change":"2024-09-12T00:33:10.853895+0000","last_active":"2024-09-12T01:01:22.536821+0000","last_peered":"2024-09-12T01:01:22.536821+0000","last_clean":"2024-09-12T01:01:22.536821+0000","last_became_active":"2024-09-12T00:33:10.853205+0000","last_became_peered":"2024-09-12T00:33:10.853205+0000","last_unstale":"2024-09-12T01:01:22.536821+0000","last_undegraded":"2024-09-12T01:01:22.536821+0000","last_fullsized":"2024-09-12T01:01:22.536821+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:11.434006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":100,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'301","reported_seq":948,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.658623+0000","last_change":"2024-09-12T00:18:22.882778+0000","last_active":"2024-09-12T01:02:57.658623+0000","last_peered":"2024-09-12T01:02:57.658623+0000","last_clean":"2024-09-12T01:02:57.658623+0000","last_became_active":"2024-09-12T00:18:22.878117+0000","last_became_peered":"2024-09-12T00:18:22.878117+0000","last_unstale":"2024-09-12T01:02:57.658623+0000","last_undegraded":"2024-09-12T01:02:57.658623+0000","last_fullsized":"2024-09-12T01:02:57.658623+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:42.771146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11589007,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":460,"num_read_kb":62532,"num_write":1140,"num_write_kb":43415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'436","reported_seq":1878,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.826302+0000","last_change":"2024-09-12T00:18:24.871900+0000","last_active":"2024-09-12T01:04:30.826302+0000","last_peered":"2024-09-12T01:04:30.826302+0000","last_clean":"2024-09-12T01:04:30.826302+0000","last_became_active":"2024-09-12T00:18:24.870370+0000","last_became_peered":"2024-09-12T00:18:24.870370+0000","last_unstale":"2024-09-12T01:04:30.826302+0000","last_undegraded":"2024-09-12T01:04:30.826302+0000","last_fullsized":"2024-09-12T01:04:30.826302+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:30.348388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2205,"num_read_kb":2060,"num_write":503,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'338","reported_seq":983,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.126027+0000","last_change":"2024-09-12T00:18:22.845696+0000","last_active":"2024-09-12T01:04:40.126027+0000","last_peered":"2024-09-12T01:04:40.126027+0000","last_clean":"2024-09-12T01:04:40.126027+0000","last_became_active":"2024-09-12T00:18:22.845439+0000","last_became_peered":"2024-09-12T00:18:22.845439+0000","last_unstale":"2024-09-12T01:04:40.126027+0000","last_undegraded":"2024-09-12T01:04:40.126027+0000","last_fullsized":"2024-09-12T01:04:40.126027+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:58.019520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079947,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":485,"num_read_kb":5684,"num_write":1011,"num_write_kb":33510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'1348","reported_seq":3035,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.828330+0000","last_change":"2024-09-12T00:18:24.872059+0000","last_active":"2024-09-12T01:04:30.828330+0000","last_peered":"2024-09-12T01:04:30.828330+0000","last_clean":"2024-09-12T01:04:30.828330+0000","last_became_active":"2024-09-12T00:18:24.866026+0000","last_became_peered":"2024-09-12T00:18:24.866026+0000","last_unstale":"2024-09-12T01:04:30.828330+0000","last_undegraded":"2024-09-12T01:04:30.828330+0000","last_fullsized":"2024-09-12T01:04:30.828330+0000","mapping_epoch":26,"log_start":"268'1300","ondisk_log_start":"268'1300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":1300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:28.162969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6196,"num_read_kb":5451,"num_write":1895,"num_write_kb":802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'339","reported_seq":1028,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.120762+0000","last_change":"2024-09-12T00:18:22.839649+0000","last_active":"2024-09-12T01:04:40.120762+0000","last_peered":"2024-09-12T01:04:40.120762+0000","last_clean":"2024-09-12T01:04:40.120762+0000","last_became_active":"2024-09-12T00:18:22.839379+0000","last_became_peered":"2024-09-12T00:18:22.839379+0000","last_unstale":"2024-09-12T01:04:40.120762+0000","last_undegraded":"2024-09-12T01:04:40.120762+0000","last_fullsized":"2024-09-12T01:04:40.120762+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:58.587843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560796,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":569,"num_read_kb":68999,"num_write":1084,"num_write_kb":32744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'868","reported_seq":2673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.884045+0000","last_change":"2024-09-12T00:18:24.861905+0000","last_active":"2024-09-12T01:03:25.884045+0000","last_peered":"2024-09-12T01:03:25.884045+0000","last_clean":"2024-09-12T01:03:25.884045+0000","last_became_active":"2024-09-12T00:18:24.860995+0000","last_became_peered":"2024-09-12T00:18:24.860995+0000","last_unstale":"2024-09-12T01:03:25.884045+0000","last_undegraded":"2024-09-12T01:03:25.884045+0000","last_fullsized":"2024-09-12T01:03:25.884045+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:40.241884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4298,"num_read_kb":3905,"num_write":1128,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'273","reported_seq":930,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.349468+0000","last_change":"2024-09-12T00:18:55.961308+0000","last_active":"2024-09-12T01:02:46.349468+0000","last_peered":"2024-09-12T01:02:46.349468+0000","last_clean":"2024-09-12T01:02:46.349468+0000","last_became_active":"2024-09-12T00:18:55.960413+0000","last_became_peered":"2024-09-12T00:18:55.960413+0000","last_unstale":"2024-09-12T01:02:46.349468+0000","last_undegraded":"2024-09-12T01:02:46.349468+0000","last_fullsized":"2024-09-12T01:02:46.349468+0000","mapping_epoch":37,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:23.952063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5101376,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":426,"num_read_kb":54974,"num_write":1014,"num_write_kb":32836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'765","reported_seq":2314,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.594303+0000","last_change":"2024-09-12T00:18:55.956119+0000","last_active":"2024-09-12T01:03:26.594303+0000","last_peered":"2024-09-12T01:03:26.594303+0000","last_clean":"2024-09-12T01:03:26.594303+0000","last_became_active":"2024-09-12T00:18:55.955870+0000","last_became_peered":"2024-09-12T00:18:55.955870+0000","last_unstale":"2024-09-12T01:03:26.594303+0000","last_undegraded":"2024-09-12T01:03:26.594303+0000","last_fullsized":"2024-09-12T01:03:26.594303+0000","mapping_epoch":37,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:06.351457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3626,"num_read_kb":3280,"num_write":1010,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'287","reported_seq":916,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.084946+0000","last_change":"2024-09-12T00:18:22.878663+0000","last_active":"2024-09-12T01:02:51.084946+0000","last_peered":"2024-09-12T01:02:51.084946+0000","last_clean":"2024-09-12T01:02:51.084946+0000","last_became_active":"2024-09-12T00:18:22.870564+0000","last_became_peered":"2024-09-12T00:18:22.870564+0000","last_unstale":"2024-09-12T01:02:51.084946+0000","last_undegraded":"2024-09-12T01:02:51.084946+0000","last_fullsized":"2024-09-12T01:02:51.084946+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:54.849057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9915971,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":448,"num_read_kb":32133,"num_write":990,"num_write_kb":41090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"268'482","reported_seq":2083,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.841743+0000","last_change":"2024-09-12T00:18:24.847333+0000","last_active":"2024-09-12T01:04:30.841743+0000","last_peered":"2024-09-12T01:04:30.841743+0000","last_clean":"2024-09-12T01:04:30.841743+0000","last_became_active":"2024-09-12T00:18:24.846508+0000","last_became_peered":"2024-09-12T00:18:24.846508+0000","last_unstale":"2024-09-12T01:04:30.841743+0000","last_undegraded":"2024-09-12T01:04:30.841743+0000","last_fullsized":"2024-09-12T01:04:30.841743+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:28.677103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2844,"num_read_kb":2655,"num_write":659,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'287","reported_seq":922,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.582459+0000","last_change":"2024-09-12T00:18:22.862931+0000","last_active":"2024-09-12T01:03:02.582459+0000","last_peered":"2024-09-12T01:03:02.582459+0000","last_clean":"2024-09-12T01:03:02.582459+0000","last_became_active":"2024-09-12T00:18:22.861074+0000","last_became_peered":"2024-09-12T00:18:22.861074+0000","last_unstale":"2024-09-12T01:03:02.582459+0000","last_undegraded":"2024-09-12T01:03:02.582459+0000","last_fullsized":"2024-09-12T01:03:02.582459+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:03.827376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704504,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":479,"num_read_kb":4860,"num_write":1022,"num_write_kb":10925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'1019","reported_seq":2748,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.884432+0000","last_change":"2024-09-12T00:18:24.878012+0000","last_active":"2024-09-12T01:03:25.884432+0000","last_peered":"2024-09-12T01:03:25.884432+0000","last_clean":"2024-09-12T01:03:25.884432+0000","last_became_active":"2024-09-12T00:18:24.875913+0000","last_became_peered":"2024-09-12T00:18:24.875913+0000","last_unstale":"2024-09-12T01:03:25.884432+0000","last_undegraded":"2024-09-12T01:03:25.884432+0000","last_fullsized":"2024-09-12T01:03:25.884432+0000","mapping_epoch":26,"log_start":"268'1000","ondisk_log_start":"268'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":1000,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:16.720932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4809,"num_read_kb":4259,"num_write":1397,"num_write_kb":538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'285","reported_seq":871,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.122874+0000","last_change":"2024-09-12T00:19:56.413205+0000","last_active":"2024-09-12T01:04:40.122874+0000","last_peered":"2024-09-12T01:04:40.122874+0000","last_clean":"2024-09-12T01:04:40.122874+0000","last_became_active":"2024-09-12T00:19:56.412792+0000","last_became_peered":"2024-09-12T00:19:56.412792+0000","last_unstale":"2024-09-12T01:04:40.122874+0000","last_undegraded":"2024-09-12T01:04:40.122874+0000","last_fullsized":"2024-09-12T01:04:40.122874+0000","mapping_epoch":39,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:43.504414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1343091,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":402,"num_read_kb":40979,"num_write":972,"num_write_kb":28776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"268'464","reported_seq":2043,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.191451+0000","last_change":"2024-09-12T00:18:24.862828+0000","last_active":"2024-09-12T01:03:11.191451+0000","last_peered":"2024-09-12T01:03:11.191451+0000","last_clean":"2024-09-12T01:03:11.191451+0000","last_became_active":"2024-09-12T00:18:24.862084+0000","last_became_peered":"2024-09-12T00:18:24.862084+0000","last_unstale":"2024-09-12T01:03:11.191451+0000","last_undegraded":"2024-09-12T01:03:11.191451+0000","last_fullsized":"2024-09-12T01:03:11.191451+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:22.898376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2471,"num_read_kb":2327,"num_write":538,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'370","reported_seq":1017,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.118778+0000","last_change":"2024-09-12T00:18:22.867992+0000","last_active":"2024-09-12T01:04:40.118778+0000","last_peered":"2024-09-12T01:04:40.118778+0000","last_clean":"2024-09-12T01:04:40.118778+0000","last_became_active":"2024-09-12T00:18:22.867749+0000","last_became_peered":"2024-09-12T00:18:22.867749+0000","last_unstale":"2024-09-12T01:04:40.118778+0000","last_undegraded":"2024-09-12T01:04:40.118778+0000","last_fullsized":"2024-09-12T01:04:40.118778+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:43.955119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":529,"num_read_kb":6849,"num_write":1205,"num_write_kb":38257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'505","reported_seq":2322,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.741434+0000","last_change":"2024-09-12T00:18:24.848517+0000","last_active":"2024-09-12T01:03:06.741434+0000","last_peered":"2024-09-12T01:03:06.741434+0000","last_clean":"2024-09-12T01:03:06.741434+0000","last_became_active":"2024-09-12T00:18:24.848163+0000","last_became_peered":"2024-09-12T00:18:24.848163+0000","last_unstale":"2024-09-12T01:03:06.741434+0000","last_undegraded":"2024-09-12T01:03:06.741434+0000","last_fullsized":"2024-09-12T01:03:06.741434+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:12.252460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2972,"num_read_kb":2819,"num_write":593,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'484","reported_seq":2139,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.426992+0000","last_change":"2024-09-12T00:18:24.861887+0000","last_active":"2024-09-12T01:03:09.426992+0000","last_peered":"2024-09-12T01:03:09.426992+0000","last_clean":"2024-09-12T01:03:09.426992+0000","last_became_active":"2024-09-12T00:18:24.860744+0000","last_became_peered":"2024-09-12T00:18:24.860744+0000","last_unstale":"2024-09-12T01:03:09.426992+0000","last_undegraded":"2024-09-12T01:03:09.426992+0000","last_fullsized":"2024-09-12T01:03:09.426992+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:47.298360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2780,"num_read_kb":2600,"num_write":590,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'252","reported_seq":857,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.546217+0000","last_change":"2024-09-12T00:18:55.963205+0000","last_active":"2024-09-12T01:02:02.546217+0000","last_peered":"2024-09-12T01:02:02.546217+0000","last_clean":"2024-09-12T01:02:02.546217+0000","last_became_active":"2024-09-12T00:18:55.962742+0000","last_became_peered":"2024-09-12T00:18:55.962742+0000","last_unstale":"2024-09-12T01:02:02.546217+0000","last_undegraded":"2024-09-12T01:02:02.546217+0000","last_fullsized":"2024-09-12T01:02:02.546217+0000","mapping_epoch":37,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:05.336107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19072504,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":335,"num_read_kb":39262,"num_write":879,"num_write_kb":33071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'395","reported_seq":1848,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.099361+0000","last_change":"2024-09-12T00:18:24.873912+0000","last_active":"2024-09-12T01:03:25.099361+0000","last_peered":"2024-09-12T01:03:25.099361+0000","last_clean":"2024-09-12T01:03:25.099361+0000","last_became_active":"2024-09-12T00:18:24.872902+0000","last_became_peered":"2024-09-12T00:18:24.872902+0000","last_unstale":"2024-09-12T01:03:25.099361+0000","last_undegraded":"2024-09-12T01:03:25.099361+0000","last_fullsized":"2024-09-12T01:03:25.099361+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:21.474486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2097,"num_read_kb":1984,"num_write":437,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'239","reported_seq":850,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.898205+0000","last_change":"2024-09-12T00:18:22.864186+0000","last_active":"2024-09-12T01:03:21.898205+0000","last_peered":"2024-09-12T01:03:21.898205+0000","last_clean":"2024-09-12T01:03:21.898205+0000","last_became_active":"2024-09-12T00:18:22.860078+0000","last_became_peered":"2024-09-12T00:18:22.860078+0000","last_unstale":"2024-09-12T01:03:21.898205+0000","last_undegraded":"2024-09-12T01:03:21.898205+0000","last_fullsized":"2024-09-12T01:03:21.898205+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:36.759909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13972538,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":347,"num_read_kb":38650,"num_write":881,"num_write_kb":29439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"268'420","reported_seq":2039,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.347017+0000","last_change":"2024-09-12T00:18:24.852828+0000","last_active":"2024-09-12T01:03:37.347017+0000","last_peered":"2024-09-12T01:03:37.347017+0000","last_clean":"2024-09-12T01:03:37.347017+0000","last_became_active":"2024-09-12T00:18:24.852029+0000","last_became_peered":"2024-09-12T00:18:24.852029+0000","last_unstale":"2024-09-12T01:03:37.347017+0000","last_undegraded":"2024-09-12T01:03:37.347017+0000","last_fullsized":"2024-09-12T01:03:37.347017+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:43.017405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2334,"num_read_kb":2233,"num_write":466,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'243","reported_seq":845,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.538010+0000","last_change":"2024-09-12T00:18:22.863392+0000","last_active":"2024-09-12T01:02:02.538010+0000","last_peered":"2024-09-12T01:02:02.538010+0000","last_clean":"2024-09-12T01:02:02.538010+0000","last_became_active":"2024-09-12T00:18:22.862665+0000","last_became_peered":"2024-09-12T00:18:22.862665+0000","last_unstale":"2024-09-12T01:02:02.538010+0000","last_undegraded":"2024-09-12T01:02:02.538010+0000","last_fullsized":"2024-09-12T01:02:02.538010+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:02.077750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8421745,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":327,"num_read_kb":22932,"num_write":871,"num_write_kb":21492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'474","reported_seq":2097,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.094302+0000","last_change":"2024-09-12T00:18:24.850211+0000","last_active":"2024-09-12T01:03:04.094302+0000","last_peered":"2024-09-12T01:03:04.094302+0000","last_clean":"2024-09-12T01:03:04.094302+0000","last_became_active":"2024-09-12T00:18:24.849491+0000","last_became_peered":"2024-09-12T00:18:24.849491+0000","last_unstale":"2024-09-12T01:03:04.094302+0000","last_undegraded":"2024-09-12T01:03:04.094302+0000","last_fullsized":"2024-09-12T01:03:04.094302+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:35.044376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2579,"num_read_kb":2421,"num_write":543,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'273","reported_seq":898,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:40.430540+0000","last_change":"2024-09-12T00:18:22.857585+0000","last_active":"2024-09-12T01:02:40.430540+0000","last_peered":"2024-09-12T01:02:40.430540+0000","last_clean":"2024-09-12T01:02:40.430540+0000","last_became_active":"2024-09-12T00:18:22.856051+0000","last_became_peered":"2024-09-12T00:18:22.856051+0000","last_unstale":"2024-09-12T01:02:40.430540+0000","last_undegraded":"2024-09-12T01:02:40.430540+0000","last_fullsized":"2024-09-12T01:02:40.430540+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:50.867035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5601827,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":382,"num_read_kb":24886,"num_write":993,"num_write_kb":15091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"268'428","reported_seq":1974,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.171993+0000","last_change":"2024-09-12T00:18:24.854571+0000","last_active":"2024-09-12T01:02:58.171993+0000","last_peered":"2024-09-12T01:02:58.171993+0000","last_clean":"2024-09-12T01:02:58.171993+0000","last_became_active":"2024-09-12T00:18:24.853796+0000","last_became_peered":"2024-09-12T00:18:24.853796+0000","last_unstale":"2024-09-12T01:02:58.171993+0000","last_undegraded":"2024-09-12T01:02:58.171993+0000","last_fullsized":"2024-09-12T01:02:58.171993+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:33.514455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2472,"num_read_kb":2322,"num_write":521,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'323","reported_seq":1076,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.085706+0000","last_change":"2024-09-12T00:18:22.838428+0000","last_active":"2024-09-12T01:04:40.085706+0000","last_peered":"2024-09-12T01:04:40.085706+0000","last_clean":"2024-09-12T01:04:40.085706+0000","last_became_active":"2024-09-12T00:18:22.834904+0000","last_became_peered":"2024-09-12T00:18:22.834904+0000","last_unstale":"2024-09-12T01:04:40.085706+0000","last_undegraded":"2024-09-12T01:04:40.085706+0000","last_fullsized":"2024-09-12T01:04:40.085706+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:19.289534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":584,"num_read_kb":49706,"num_write":1054,"num_write_kb":43110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'502","reported_seq":2049,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.347103+0000","last_change":"2024-09-12T00:18:24.876805+0000","last_active":"2024-09-12T01:03:37.347103+0000","last_peered":"2024-09-12T01:03:37.347103+0000","last_clean":"2024-09-12T01:03:37.347103+0000","last_became_active":"2024-09-12T00:18:24.875112+0000","last_became_peered":"2024-09-12T00:18:24.875112+0000","last_unstale":"2024-09-12T01:03:37.347103+0000","last_undegraded":"2024-09-12T01:03:37.347103+0000","last_fullsized":"2024-09-12T01:03:37.347103+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:20.839260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2595,"num_read_kb":2402,"num_write":619,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'375","reported_seq":1065,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.111875+0000","last_change":"2024-09-12T00:18:22.841353+0000","last_active":"2024-09-12T01:04:40.111875+0000","last_peered":"2024-09-12T01:04:40.111875+0000","last_clean":"2024-09-12T01:04:40.111875+0000","last_became_active":"2024-09-12T00:18:22.841069+0000","last_became_peered":"2024-09-12T00:18:22.841069+0000","last_unstale":"2024-09-12T01:04:40.111875+0000","last_undegraded":"2024-09-12T01:04:40.111875+0000","last_fullsized":"2024-09-12T01:04:40.111875+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:51.842199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":685,"num_read_kb":23761,"num_write":1283,"num_write_kb":30294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'127","reported_seq":651,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.974481+0000","last_change":"2024-09-12T00:18:32.894030+0000","last_active":"2024-09-12T01:03:25.974481+0000","last_peered":"2024-09-12T01:03:25.974481+0000","last_clean":"2024-09-12T01:03:25.974481+0000","last_became_active":"2024-09-12T00:18:32.893410+0000","last_became_peered":"2024-09-12T00:18:32.893410+0000","last_unstale":"2024-09-12T01:03:25.974481+0000","last_undegraded":"2024-09-12T01:03:25.974481+0000","last_fullsized":"2024-09-12T01:03:25.974481+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:21.781324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":200,"num_read_kb":180,"num_write":310,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'427","reported_seq":2029,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.883962+0000","last_change":"2024-09-12T00:18:24.863390+0000","last_active":"2024-09-12T01:03:25.883962+0000","last_peered":"2024-09-12T01:03:25.883962+0000","last_clean":"2024-09-12T01:03:25.883962+0000","last_became_active":"2024-09-12T00:18:24.862963+0000","last_became_peered":"2024-09-12T00:18:24.862963+0000","last_unstale":"2024-09-12T01:03:25.883962+0000","last_undegraded":"2024-09-12T01:03:25.883962+0000","last_fullsized":"2024-09-12T01:03:25.883962+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:47.762563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2444,"num_read_kb":2313,"num_write":504,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"268'279","reported_seq":923,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:22.373926+0000","last_change":"2024-09-12T00:18:55.955847+0000","last_active":"2024-09-12T01:02:22.373926+0000","last_peered":"2024-09-12T01:02:22.373926+0000","last_clean":"2024-09-12T01:02:22.373926+0000","last_became_active":"2024-09-12T00:18:55.954978+0000","last_became_peered":"2024-09-12T00:18:55.954978+0000","last_unstale":"2024-09-12T01:02:22.373926+0000","last_undegraded":"2024-09-12T01:02:22.373926+0000","last_fullsized":"2024-09-12T01:02:22.373926+0000","mapping_epoch":37,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:00.249837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4250562,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":428,"num_read_kb":26304,"num_write":1033,"num_write_kb":30933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.749399+0000","last_change":"2024-09-12T00:18:26.872530+0000","last_active":"2024-09-12T01:01:57.749399+0000","last_peered":"2024-09-12T01:01:57.749399+0000","last_clean":"2024-09-12T01:01:57.749399+0000","last_became_active":"2024-09-12T00:18:26.871803+0000","last_became_peered":"2024-09-12T00:18:26.871803+0000","last_unstale":"2024-09-12T01:01:57.749399+0000","last_undegraded":"2024-09-12T01:01:57.749399+0000","last_fullsized":"2024-09-12T01:01:57.749399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:22.818539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'341","reported_seq":958,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.402373+0000","last_change":"2024-09-12T00:18:28.875623+0000","last_active":"2024-09-12T01:04:39.402373+0000","last_peered":"2024-09-12T01:04:39.402373+0000","last_clean":"2024-09-12T01:04:39.402373+0000","last_became_active":"2024-09-12T00:18:28.874861+0000","last_became_peered":"2024-09-12T00:18:28.874861+0000","last_unstale":"2024-09-12T01:04:39.402373+0000","last_undegraded":"2024-09-12T01:04:39.402373+0000","last_fullsized":"2024-09-12T01:04:39.402373+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:25.073806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51345,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":553,"num_read_kb":1147,"num_write":436,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.546262+0000","last_change":"2024-09-12T00:18:30.894626+0000","last_active":"2024-09-12T01:02:02.546262+0000","last_peered":"2024-09-12T01:02:02.546262+0000","last_clean":"2024-09-12T01:02:02.546262+0000","last_became_active":"2024-09-12T00:18:30.893886+0000","last_became_peered":"2024-09-12T00:18:30.893886+0000","last_unstale":"2024-09-12T01:02:02.546262+0000","last_undegraded":"2024-09-12T01:02:02.546262+0000","last_fullsized":"2024-09-12T01:02:02.546262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:00.518894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'2426","reported_seq":4321,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.416183+0000","last_change":"2024-09-12T00:18:32.899968+0000","last_active":"2024-09-12T01:03:37.416183+0000","last_peered":"2024-09-12T01:03:37.416183+0000","last_clean":"2024-09-12T01:03:37.416183+0000","last_became_active":"2024-09-12T00:18:32.899168+0000","last_became_peered":"2024-09-12T00:18:32.899168+0000","last_unstale":"2024-09-12T01:03:37.416183+0000","last_undegraded":"2024-09-12T01:03:37.416183+0000","last_fullsized":"2024-09-12T01:03:37.416183+0000","mapping_epoch":34,"log_start":"268'2400","ondisk_log_start":"268'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":2400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:13.149755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6111,"num_read_kb":6108,"num_write":4843,"num_write_kb":1788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'1288","reported_seq":2834,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.884108+0000","last_change":"2024-09-12T00:18:24.870986+0000","last_active":"2024-09-12T01:03:25.884108+0000","last_peered":"2024-09-12T01:03:25.884108+0000","last_clean":"2024-09-12T01:03:25.884108+0000","last_became_active":"2024-09-12T00:18:24.869219+0000","last_became_peered":"2024-09-12T00:18:24.869219+0000","last_unstale":"2024-09-12T01:03:25.884108+0000","last_undegraded":"2024-09-12T01:03:25.884108+0000","last_fullsized":"2024-09-12T01:03:25.884108+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":1200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:32.390226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5815,"num_read_kb":5070,"num_write":1809,"num_write_kb":816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'267","reported_seq":836,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.109319+0000","last_change":"2024-09-12T00:18:55.953884+0000","last_active":"2024-09-12T01:04:40.109319+0000","last_peered":"2024-09-12T01:04:40.109319+0000","last_clean":"2024-09-12T01:04:40.109319+0000","last_became_active":"2024-09-12T00:18:55.953363+0000","last_became_peered":"2024-09-12T00:18:55.953363+0000","last_unstale":"2024-09-12T01:04:40.109319+0000","last_undegraded":"2024-09-12T01:04:40.109319+0000","last_fullsized":"2024-09-12T01:04:40.109319+0000","mapping_epoch":37,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:06.656289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079954,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":346,"num_read_kb":12333,"num_write":862,"num_write_kb":28931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:31.733365+0000","last_change":"2024-09-12T00:18:26.848809+0000","last_active":"2024-09-12T01:00:31.733365+0000","last_peered":"2024-09-12T01:00:31.733365+0000","last_clean":"2024-09-12T01:00:31.733365+0000","last_became_active":"2024-09-12T00:18:26.848272+0000","last_became_peered":"2024-09-12T00:18:26.848272+0000","last_unstale":"2024-09-12T01:00:31.733365+0000","last_undegraded":"2024-09-12T01:00:31.733365+0000","last_fullsized":"2024-09-12T01:00:31.733365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:32.968436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'90","reported_seq":626,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.547603+0000","last_change":"2024-09-12T00:18:28.883255+0000","last_active":"2024-09-12T01:02:02.547603+0000","last_peered":"2024-09-12T01:02:02.547603+0000","last_clean":"2024-09-12T01:02:02.547603+0000","last_became_active":"2024-09-12T00:18:28.882630+0000","last_became_peered":"2024-09-12T00:18:28.882630+0000","last_unstale":"2024-09-12T01:02:02.547603+0000","last_undegraded":"2024-09-12T01:02:02.547603+0000","last_fullsized":"2024-09-12T01:02:02.547603+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:19.332138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":98,"num_write":70,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.547576+0000","last_change":"2024-09-12T00:18:30.901543+0000","last_active":"2024-09-12T01:02:02.547576+0000","last_peered":"2024-09-12T01:02:02.547576+0000","last_clean":"2024-09-12T01:02:02.547576+0000","last_became_active":"2024-09-12T00:18:30.900908+0000","last_became_peered":"2024-09-12T00:18:30.900908+0000","last_unstale":"2024-09-12T01:02:02.547576+0000","last_undegraded":"2024-09-12T01:02:02.547576+0000","last_fullsized":"2024-09-12T01:02:02.547576+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:06.507522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'120","reported_seq":626,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.178090+0000","last_change":"2024-09-12T00:18:32.910263+0000","last_active":"2024-09-12T01:02:58.178090+0000","last_peered":"2024-09-12T01:02:58.178090+0000","last_clean":"2024-09-12T01:02:58.178090+0000","last_became_active":"2024-09-12T00:18:32.909547+0000","last_became_peered":"2024-09-12T00:18:32.909547+0000","last_unstale":"2024-09-12T01:02:58.178090+0000","last_undegraded":"2024-09-12T01:02:58.178090+0000","last_fullsized":"2024-09-12T01:02:58.178090+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:15.935680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":128,"num_write":294,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'1255","reported_seq":2899,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.742323+0000","last_change":"2024-09-12T00:18:24.859628+0000","last_active":"2024-09-12T01:03:06.742323+0000","last_peered":"2024-09-12T01:03:06.742323+0000","last_clean":"2024-09-12T01:03:06.742323+0000","last_became_active":"2024-09-12T00:18:24.859237+0000","last_became_peered":"2024-09-12T00:18:24.859237+0000","last_unstale":"2024-09-12T01:03:06.742323+0000","last_undegraded":"2024-09-12T01:03:06.742323+0000","last_fullsized":"2024-09-12T01:03:06.742323+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:27.993852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5766,"num_read_kb":5095,"num_write":1782,"num_write_kb":773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'308","reported_seq":1026,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:14.179546+0000","last_change":"2024-09-12T00:18:22.878983+0000","last_active":"2024-09-12T01:02:14.179546+0000","last_peered":"2024-09-12T01:02:14.179546+0000","last_clean":"2024-09-12T01:02:14.179546+0000","last_became_active":"2024-09-12T00:18:22.873262+0000","last_became_peered":"2024-09-12T00:18:22.873262+0000","last_unstale":"2024-09-12T01:02:14.179546+0000","last_undegraded":"2024-09-12T01:02:14.179546+0000","last_fullsized":"2024-09-12T01:02:14.179546+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:06.551453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18286806,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":535,"num_read_kb":24518,"num_write":1149,"num_write_kb":41630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.756017+0000","last_change":"2024-09-12T00:18:26.855885+0000","last_active":"2024-09-12T01:01:56.756017+0000","last_peered":"2024-09-12T01:01:56.756017+0000","last_clean":"2024-09-12T01:01:56.756017+0000","last_became_active":"2024-09-12T00:18:26.855348+0000","last_became_peered":"2024-09-12T00:18:26.855348+0000","last_unstale":"2024-09-12T01:01:56.756017+0000","last_undegraded":"2024-09-12T01:01:56.756017+0000","last_fullsized":"2024-09-12T01:01:56.756017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:48.816326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'118","reported_seq":670,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:19.297862+0000","last_change":"2024-09-12T00:18:28.885573+0000","last_active":"2024-09-12T01:01:19.297862+0000","last_peered":"2024-09-12T01:01:19.297862+0000","last_clean":"2024-09-12T01:01:19.297862+0000","last_became_active":"2024-09-12T00:18:28.884722+0000","last_became_peered":"2024-09-12T00:18:28.884722+0000","last_unstale":"2024-09-12T01:01:19.297862+0000","last_undegraded":"2024-09-12T01:01:19.297862+0000","last_fullsized":"2024-09-12T01:01:19.297862+0000","mapping_epoch":30,"log_start":"268'100","ondisk_log_start":"268'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:22.842377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":98,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'780","reported_seq":4738,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.829366+0000","last_change":"2024-09-12T00:18:30.894494+0000","last_active":"2024-09-12T01:04:31.829366+0000","last_peered":"2024-09-12T01:04:31.829366+0000","last_clean":"2024-09-12T01:04:31.829366+0000","last_became_active":"2024-09-12T00:18:30.893739+0000","last_became_peered":"2024-09-12T00:18:30.893739+0000","last_unstale":"2024-09-12T01:04:31.829366+0000","last_undegraded":"2024-09-12T01:04:31.829366+0000","last_fullsized":"2024-09-12T01:04:31.829366+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:28.177468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'210","reported_seq":1045,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.023471+0000","last_change":"2024-09-12T00:18:32.884849+0000","last_active":"2024-09-12T01:03:26.023471+0000","last_peered":"2024-09-12T01:03:26.023471+0000","last_clean":"2024-09-12T01:03:26.023471+0000","last_became_active":"2024-09-12T00:18:32.884130+0000","last_became_peered":"2024-09-12T00:18:32.884130+0000","last_unstale":"2024-09-12T01:03:26.023471+0000","last_undegraded":"2024-09-12T01:03:26.023471+0000","last_fullsized":"2024-09-12T01:03:26.023471+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:08.903193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":639,"num_read_kb":629,"num_write":484,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'892","reported_seq":2621,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.348876+0000","last_change":"2024-09-12T00:18:24.868470+0000","last_active":"2024-09-12T01:03:37.348876+0000","last_peered":"2024-09-12T01:03:37.348876+0000","last_clean":"2024-09-12T01:03:37.348876+0000","last_became_active":"2024-09-12T00:18:24.868103+0000","last_became_peered":"2024-09-12T00:18:24.868103+0000","last_unstale":"2024-09-12T01:03:37.348876+0000","last_undegraded":"2024-09-12T01:03:37.348876+0000","last_fullsized":"2024-09-12T01:03:37.348876+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":800,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:19.861066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4419,"num_read_kb":4003,"num_write":1187,"num_write_kb":433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'258","reported_seq":875,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.397104+0000","last_change":"2024-09-12T00:18:22.852318+0000","last_active":"2024-09-12T01:03:01.397104+0000","last_peered":"2024-09-12T01:03:01.397104+0000","last_clean":"2024-09-12T01:03:01.397104+0000","last_became_active":"2024-09-12T00:18:22.850530+0000","last_became_peered":"2024-09-12T00:18:22.850530+0000","last_unstale":"2024-09-12T01:03:01.397104+0000","last_undegraded":"2024-09-12T01:03:01.397104+0000","last_fullsized":"2024-09-12T01:03:01.397104+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:16.232313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10094467,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":403,"num_read_kb":6949,"num_write":1033,"num_write_kb":36294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.749449+0000","last_change":"2024-09-12T00:18:26.868989+0000","last_active":"2024-09-12T01:01:57.749449+0000","last_peered":"2024-09-12T01:01:57.749449+0000","last_clean":"2024-09-12T01:01:57.749449+0000","last_became_active":"2024-09-12T00:18:26.867729+0000","last_became_peered":"2024-09-12T00:18:26.867729+0000","last_unstale":"2024-09-12T01:01:57.749449+0000","last_undegraded":"2024-09-12T01:01:57.749449+0000","last_fullsized":"2024-09-12T01:01:57.749449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:38.364796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'259","reported_seq":829,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:27.579703+0000","last_change":"2024-09-12T00:18:28.885774+0000","last_active":"2024-09-12T01:04:27.579703+0000","last_peered":"2024-09-12T01:04:27.579703+0000","last_clean":"2024-09-12T01:04:27.579703+0000","last_became_active":"2024-09-12T00:18:28.884779+0000","last_became_peered":"2024-09-12T00:18:28.884779+0000","last_unstale":"2024-09-12T01:04:27.579703+0000","last_undegraded":"2024-09-12T01:04:27.579703+0000","last_fullsized":"2024-09-12T01:04:27.579703+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:17.954386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55235,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":430,"num_read_kb":898,"num_write":352,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'816","reported_seq":2286,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.568233+0000","last_change":"2024-09-12T00:18:30.903331+0000","last_active":"2024-09-12T01:04:38.568233+0000","last_peered":"2024-09-12T01:04:38.568233+0000","last_clean":"2024-09-12T01:04:38.568233+0000","last_became_active":"2024-09-12T00:18:30.894642+0000","last_became_peered":"2024-09-12T00:18:30.894642+0000","last_unstale":"2024-09-12T01:04:38.568233+0000","last_undegraded":"2024-09-12T01:04:38.568233+0000","last_fullsized":"2024-09-12T01:04:38.568233+0000","mapping_epoch":32,"log_start":"268'800","ondisk_log_start":"268'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:23.687695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'475","reported_seq":2078,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.413042+0000","last_change":"2024-09-12T00:18:24.871053+0000","last_active":"2024-09-12T01:03:37.413042+0000","last_peered":"2024-09-12T01:03:37.413042+0000","last_clean":"2024-09-12T01:03:37.413042+0000","last_became_active":"2024-09-12T00:18:24.869435+0000","last_became_peered":"2024-09-12T00:18:24.869435+0000","last_unstale":"2024-09-12T01:03:37.413042+0000","last_undegraded":"2024-09-12T01:03:37.413042+0000","last_fullsized":"2024-09-12T01:03:37.413042+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:43.049599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2569,"num_read_kb":2408,"num_write":545,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'302","reported_seq":930,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.086642+0000","last_change":"2024-09-12T00:18:22.881670+0000","last_active":"2024-09-12T01:02:51.086642+0000","last_peered":"2024-09-12T01:02:51.086642+0000","last_clean":"2024-09-12T01:02:51.086642+0000","last_became_active":"2024-09-12T00:18:22.877327+0000","last_became_peered":"2024-09-12T00:18:22.877327+0000","last_unstale":"2024-09-12T01:02:51.086642+0000","last_undegraded":"2024-09-12T01:02:51.086642+0000","last_fullsized":"2024-09-12T01:02:51.086642+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:34.237861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12210018,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":427,"num_read_kb":23147,"num_write":1006,"num_write_kb":55226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:47.542554+0000","last_change":"2024-09-12T00:18:26.876329+0000","last_active":"2024-09-12T01:01:47.542554+0000","last_peered":"2024-09-12T01:01:47.542554+0000","last_clean":"2024-09-12T01:01:47.542554+0000","last_became_active":"2024-09-12T00:18:26.874638+0000","last_became_peered":"2024-09-12T00:18:26.874638+0000","last_unstale":"2024-09-12T01:01:47.542554+0000","last_undegraded":"2024-09-12T01:01:47.542554+0000","last_fullsized":"2024-09-12T01:01:47.542554+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:33.159889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'331","reported_seq":946,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:12.382172+0000","last_change":"2024-09-12T00:18:28.896980+0000","last_active":"2024-09-12T01:04:12.382172+0000","last_peered":"2024-09-12T01:04:12.382172+0000","last_clean":"2024-09-12T01:04:12.382172+0000","last_became_active":"2024-09-12T00:18:28.895950+0000","last_became_peered":"2024-09-12T00:18:28.895950+0000","last_unstale":"2024-09-12T01:04:12.382172+0000","last_undegraded":"2024-09-12T01:04:12.382172+0000","last_fullsized":"2024-09-12T01:04:12.382172+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:16.223388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53744,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":529,"num_read_kb":962,"num_write":410,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:16.542412+0000","last_change":"2024-09-12T00:18:30.874823+0000","last_active":"2024-09-12T01:01:16.542412+0000","last_peered":"2024-09-12T01:01:16.542412+0000","last_clean":"2024-09-12T01:01:16.542412+0000","last_became_active":"2024-09-12T00:18:30.874074+0000","last_became_peered":"2024-09-12T00:18:30.874074+0000","last_unstale":"2024-09-12T01:01:16.542412+0000","last_undegraded":"2024-09-12T01:01:16.542412+0000","last_fullsized":"2024-09-12T01:01:16.542412+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:46.157942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'552","reported_seq":1366,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.801949+0000","last_change":"2024-09-12T00:18:32.900714+0000","last_active":"2024-09-12T01:04:31.801949+0000","last_peered":"2024-09-12T01:04:31.801949+0000","last_clean":"2024-09-12T01:04:31.801949+0000","last_became_active":"2024-09-12T00:18:32.899046+0000","last_became_peered":"2024-09-12T00:18:32.899046+0000","last_unstale":"2024-09-12T01:04:31.801949+0000","last_undegraded":"2024-09-12T01:04:31.801949+0000","last_fullsized":"2024-09-12T01:04:31.801949+0000","mapping_epoch":34,"log_start":"268'500","ondisk_log_start":"268'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:25.804502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1268,"num_read_kb":1267,"num_write":1132,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'483","reported_seq":2092,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.248460+0000","last_change":"2024-09-12T00:18:24.862220+0000","last_active":"2024-09-12T01:02:59.248460+0000","last_peered":"2024-09-12T01:02:59.248460+0000","last_clean":"2024-09-12T01:02:59.248460+0000","last_became_active":"2024-09-12T00:18:24.861455+0000","last_became_peered":"2024-09-12T00:18:24.861455+0000","last_unstale":"2024-09-12T01:02:59.248460+0000","last_undegraded":"2024-09-12T01:02:59.248460+0000","last_fullsized":"2024-09-12T01:02:59.248460+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:58.186022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2490,"num_read_kb":2350,"num_write":569,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'294","reported_seq":949,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.581667+0000","last_change":"2024-09-12T00:18:22.872925+0000","last_active":"2024-09-12T01:03:10.581667+0000","last_peered":"2024-09-12T01:03:10.581667+0000","last_clean":"2024-09-12T01:03:10.581667+0000","last_became_active":"2024-09-12T00:18:22.871330+0000","last_became_peered":"2024-09-12T00:18:22.871330+0000","last_unstale":"2024-09-12T01:03:10.581667+0000","last_undegraded":"2024-09-12T01:03:10.581667+0000","last_fullsized":"2024-09-12T01:03:10.581667+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:49.802108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587191,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":470,"num_read_kb":9754,"num_write":1030,"num_write_kb":25837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"36'3","reported_seq":985,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.294266+0000","last_change":"2024-09-12T00:18:26.859307+0000","last_active":"2024-09-12T01:04:38.294266+0000","last_peered":"2024-09-12T01:04:38.294266+0000","last_clean":"2024-09-12T01:04:38.294266+0000","last_became_active":"2024-09-12T00:18:26.858529+0000","last_became_peered":"2024-09-12T00:18:26.858529+0000","last_unstale":"2024-09-12T01:04:38.294266+0000","last_undegraded":"2024-09-12T01:04:38.294266+0000","last_fullsized":"2024-09-12T01:04:38.294266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:58.521971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'286","reported_seq":870,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.143127+0000","last_change":"2024-09-12T00:18:28.896114+0000","last_active":"2024-09-12T01:04:40.143127+0000","last_peered":"2024-09-12T01:04:40.143127+0000","last_clean":"2024-09-12T01:04:40.143127+0000","last_became_active":"2024-09-12T00:18:28.895521+0000","last_became_peered":"2024-09-12T00:18:28.895521+0000","last_unstale":"2024-09-12T01:04:40.143127+0000","last_undegraded":"2024-09-12T01:04:40.143127+0000","last_fullsized":"2024-09-12T01:04:40.143127+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:58.027139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":471,"num_read_kb":1097,"num_write":388,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.755573+0000","last_change":"2024-09-12T00:18:30.907840+0000","last_active":"2024-09-12T01:01:56.755573+0000","last_peered":"2024-09-12T01:01:56.755573+0000","last_clean":"2024-09-12T01:01:56.755573+0000","last_became_active":"2024-09-12T00:18:30.905601+0000","last_became_peered":"2024-09-12T00:18:30.905601+0000","last_unstale":"2024-09-12T01:01:56.755573+0000","last_undegraded":"2024-09-12T01:01:56.755573+0000","last_fullsized":"2024-09-12T01:01:56.755573+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:08.252494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'122","reported_seq":612,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:20.723358+0000","last_change":"2024-09-12T00:18:32.900357+0000","last_active":"2024-09-12T01:04:20.723358+0000","last_peered":"2024-09-12T01:04:20.723358+0000","last_clean":"2024-09-12T01:04:20.723358+0000","last_became_active":"2024-09-12T00:18:32.899284+0000","last_became_peered":"2024-09-12T00:18:32.899284+0000","last_unstale":"2024-09-12T01:04:20.723358+0000","last_undegraded":"2024-09-12T01:04:20.723358+0000","last_fullsized":"2024-09-12T01:04:20.723358+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:39.218682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":95,"num_write":292,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'840","reported_seq":2341,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.885035+0000","last_change":"2024-09-12T00:18:24.871047+0000","last_active":"2024-09-12T01:03:25.885035+0000","last_peered":"2024-09-12T01:03:25.885035+0000","last_clean":"2024-09-12T01:03:25.885035+0000","last_became_active":"2024-09-12T00:18:24.869582+0000","last_became_peered":"2024-09-12T00:18:24.869582+0000","last_unstale":"2024-09-12T01:03:25.885035+0000","last_undegraded":"2024-09-12T01:03:25.885035+0000","last_fullsized":"2024-09-12T01:03:25.885035+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":800,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:44.515642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4018,"num_read_kb":3569,"num_write":1156,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'216","reported_seq":816,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:05.774855+0000","last_change":"2024-09-12T00:18:22.881172+0000","last_active":"2024-09-12T01:03:05.774855+0000","last_peered":"2024-09-12T01:03:05.774855+0000","last_clean":"2024-09-12T01:03:05.774855+0000","last_became_active":"2024-09-12T00:18:22.875150+0000","last_became_peered":"2024-09-12T00:18:22.875150+0000","last_unstale":"2024-09-12T01:03:05.774855+0000","last_undegraded":"2024-09-12T01:03:05.774855+0000","last_fullsized":"2024-09-12T01:03:05.774855+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:21.799238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3370821,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":328,"num_read_kb":19791,"num_write":733,"num_write_kb":25570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'5","reported_seq":984,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.292875+0000","last_change":"2024-09-12T00:18:26.858101+0000","last_active":"2024-09-12T01:04:38.292875+0000","last_peered":"2024-09-12T01:04:38.292875+0000","last_clean":"2024-09-12T01:04:38.292875+0000","last_became_active":"2024-09-12T00:18:26.857788+0000","last_became_peered":"2024-09-12T00:18:26.857788+0000","last_unstale":"2024-09-12T01:04:38.292875+0000","last_undegraded":"2024-09-12T01:04:38.292875+0000","last_fullsized":"2024-09-12T01:04:38.292875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:18.621326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'299","reported_seq":892,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:02.573313+0000","last_change":"2024-09-12T00:18:28.887534+0000","last_active":"2024-09-12T01:04:02.573313+0000","last_peered":"2024-09-12T01:04:02.573313+0000","last_clean":"2024-09-12T01:04:02.573313+0000","last_became_active":"2024-09-12T00:18:28.886806+0000","last_became_peered":"2024-09-12T00:18:28.886806+0000","last_unstale":"2024-09-12T01:04:02.573313+0000","last_undegraded":"2024-09-12T01:04:02.573313+0000","last_fullsized":"2024-09-12T01:04:02.573313+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:57.100168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52779,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":481,"num_read_kb":938,"num_write":386,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'808","reported_seq":2411,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.056456+0000","last_change":"2024-09-12T00:18:30.895445+0000","last_active":"2024-09-12T01:04:40.056456+0000","last_peered":"2024-09-12T01:04:40.056456+0000","last_clean":"2024-09-12T01:04:40.056456+0000","last_became_active":"2024-09-12T00:18:30.888688+0000","last_became_peered":"2024-09-12T00:18:30.888688+0000","last_unstale":"2024-09-12T01:04:40.056456+0000","last_undegraded":"2024-09-12T01:04:40.056456+0000","last_fullsized":"2024-09-12T01:04:40.056456+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:44.135657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'131","reported_seq":633,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.832406+0000","last_change":"2024-09-12T00:18:32.909612+0000","last_active":"2024-09-12T01:04:30.832406+0000","last_peered":"2024-09-12T01:04:30.832406+0000","last_clean":"2024-09-12T01:04:30.832406+0000","last_became_active":"2024-09-12T00:18:32.904609+0000","last_became_peered":"2024-09-12T00:18:32.904609+0000","last_unstale":"2024-09-12T01:04:30.832406+0000","last_undegraded":"2024-09-12T01:04:30.832406+0000","last_fullsized":"2024-09-12T01:04:30.832406+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:02.670740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":137,"num_read_kb":127,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'815","reported_seq":2289,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.884794+0000","last_change":"2024-09-12T00:18:24.857093+0000","last_active":"2024-09-12T01:03:25.884794+0000","last_peered":"2024-09-12T01:03:25.884794+0000","last_clean":"2024-09-12T01:03:25.884794+0000","last_became_active":"2024-09-12T00:18:24.856572+0000","last_became_peered":"2024-09-12T00:18:24.856572+0000","last_unstale":"2024-09-12T01:03:25.884794+0000","last_undegraded":"2024-09-12T01:03:25.884794+0000","last_fullsized":"2024-09-12T01:03:25.884794+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:45.768362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3705,"num_read_kb":3326,"num_write":1078,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'313","reported_seq":1023,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.855722+0000","last_change":"2024-09-12T00:18:22.871676+0000","last_active":"2024-09-12T01:03:08.855722+0000","last_peered":"2024-09-12T01:03:08.855722+0000","last_clean":"2024-09-12T01:03:08.855722+0000","last_became_active":"2024-09-12T00:18:22.865067+0000","last_became_peered":"2024-09-12T00:18:22.865067+0000","last_unstale":"2024-09-12T01:03:08.855722+0000","last_undegraded":"2024-09-12T01:03:08.855722+0000","last_fullsized":"2024-09-12T01:03:08.855722+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:05.321786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11583600,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":576,"num_read_kb":35348,"num_write":1303,"num_write_kb":29498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:51.719678+0000","last_change":"2024-09-12T00:18:26.868176+0000","last_active":"2024-09-12T01:01:51.719678+0000","last_peered":"2024-09-12T01:01:51.719678+0000","last_clean":"2024-09-12T01:01:51.719678+0000","last_became_active":"2024-09-12T00:18:26.867793+0000","last_became_peered":"2024-09-12T00:18:26.867793+0000","last_unstale":"2024-09-12T01:01:51.719678+0000","last_undegraded":"2024-09-12T01:01:51.719678+0000","last_fullsized":"2024-09-12T01:01:51.719678+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:45.564325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'475","reported_seq":1121,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.758256+0000","last_change":"2024-09-12T00:18:28.876606+0000","last_active":"2024-09-12T01:04:39.758256+0000","last_peered":"2024-09-12T01:04:39.758256+0000","last_clean":"2024-09-12T01:04:39.758256+0000","last_became_active":"2024-09-12T00:18:28.875891+0000","last_became_peered":"2024-09-12T00:18:28.875891+0000","last_unstale":"2024-09-12T01:04:39.758256+0000","last_undegraded":"2024-09-12T01:04:39.758256+0000","last_fullsized":"2024-09-12T01:04:39.758256+0000","mapping_epoch":30,"log_start":"268'400","ondisk_log_start":"268'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:20.466018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96447,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":834,"num_read_kb":1977,"num_write":680,"num_write_kb":567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:51.719618+0000","last_change":"2024-09-12T00:18:30.896208+0000","last_active":"2024-09-12T01:01:51.719618+0000","last_peered":"2024-09-12T01:01:51.719618+0000","last_clean":"2024-09-12T01:01:51.719618+0000","last_became_active":"2024-09-12T00:18:30.895401+0000","last_became_peered":"2024-09-12T00:18:30.895401+0000","last_unstale":"2024-09-12T01:01:51.719618+0000","last_undegraded":"2024-09-12T01:01:51.719618+0000","last_fullsized":"2024-09-12T01:01:51.719618+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:42.017008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'152","reported_seq":679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.551335+0000","last_change":"2024-09-12T00:18:32.893457+0000","last_active":"2024-09-12T01:01:56.551335+0000","last_peered":"2024-09-12T01:01:56.551335+0000","last_clean":"2024-09-12T01:01:56.551335+0000","last_became_active":"2024-09-12T00:18:32.892682+0000","last_became_peered":"2024-09-12T00:18:32.892682+0000","last_unstale":"2024-09-12T01:01:56.551335+0000","last_undegraded":"2024-09-12T01:01:56.551335+0000","last_fullsized":"2024-09-12T01:01:56.551335+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:17.913143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1103,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":196,"num_read_kb":180,"num_write":352,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'459","reported_seq":2074,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.823138+0000","last_change":"2024-09-12T00:18:24.853418+0000","last_active":"2024-09-12T01:04:30.823138+0000","last_peered":"2024-09-12T01:04:30.823138+0000","last_clean":"2024-09-12T01:04:30.823138+0000","last_became_active":"2024-09-12T00:18:24.852683+0000","last_became_peered":"2024-09-12T00:18:24.852683+0000","last_unstale":"2024-09-12T01:04:30.823138+0000","last_undegraded":"2024-09-12T01:04:30.823138+0000","last_fullsized":"2024-09-12T01:04:30.823138+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:11.403174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2390,"num_read_kb":2271,"num_write":519,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'361","reported_seq":1011,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.008711+0000","last_change":"2024-09-12T00:18:22.842425+0000","last_active":"2024-09-12T01:04:40.008711+0000","last_peered":"2024-09-12T01:04:40.008711+0000","last_clean":"2024-09-12T01:04:40.008711+0000","last_became_active":"2024-09-12T00:18:22.841689+0000","last_became_peered":"2024-09-12T00:18:22.841689+0000","last_unstale":"2024-09-12T01:04:40.008711+0000","last_undegraded":"2024-09-12T01:04:40.008711+0000","last_fullsized":"2024-09-12T01:04:40.008711+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:53.341537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194384,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":496,"num_read_kb":55770,"num_write":1160,"num_write_kb":35616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:11.710704+0000","last_change":"2024-09-12T00:18:26.858051+0000","last_active":"2024-09-12T01:01:11.710704+0000","last_peered":"2024-09-12T01:01:11.710704+0000","last_clean":"2024-09-12T01:01:11.710704+0000","last_became_active":"2024-09-12T00:18:26.845618+0000","last_became_peered":"2024-09-12T00:18:26.845618+0000","last_unstale":"2024-09-12T01:01:11.710704+0000","last_undegraded":"2024-09-12T01:01:11.710704+0000","last_fullsized":"2024-09-12T01:01:11.710704+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:08.376001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'294","reported_seq":876,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:32.569648+0000","last_change":"2024-09-12T00:18:28.885743+0000","last_active":"2024-09-12T01:03:32.569648+0000","last_peered":"2024-09-12T01:03:32.569648+0000","last_clean":"2024-09-12T01:03:32.569648+0000","last_became_active":"2024-09-12T00:18:28.884044+0000","last_became_peered":"2024-09-12T00:18:28.884044+0000","last_unstale":"2024-09-12T01:03:32.569648+0000","last_undegraded":"2024-09-12T01:03:32.569648+0000","last_fullsized":"2024-09-12T01:03:32.569648+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:10.970556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69457,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":506,"num_read_kb":1021,"num_write":458,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":492,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:26.564933+0000","last_change":"2024-09-12T00:18:30.903530+0000","last_active":"2024-09-12T01:01:26.564933+0000","last_peered":"2024-09-12T01:01:26.564933+0000","last_clean":"2024-09-12T01:01:26.564933+0000","last_became_active":"2024-09-12T00:18:30.902697+0000","last_became_peered":"2024-09-12T00:18:30.902697+0000","last_unstale":"2024-09-12T01:01:26.564933+0000","last_undegraded":"2024-09-12T01:01:26.564933+0000","last_fullsized":"2024-09-12T01:01:26.564933+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:52.611643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'136","reported_seq":637,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:20.726584+0000","last_change":"2024-09-12T00:18:32.901132+0000","last_active":"2024-09-12T01:04:20.726584+0000","last_peered":"2024-09-12T01:04:20.726584+0000","last_clean":"2024-09-12T01:04:20.726584+0000","last_became_active":"2024-09-12T00:18:32.900235+0000","last_became_peered":"2024-09-12T00:18:32.900235+0000","last_unstale":"2024-09-12T01:04:20.726584+0000","last_undegraded":"2024-09-12T01:04:20.726584+0000","last_fullsized":"2024-09-12T01:04:20.726584+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:52.036568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":465,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":124,"num_read_kb":118,"num_write":347,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'436","reported_seq":2078,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.197412+0000","last_change":"2024-09-12T00:18:24.873781+0000","last_active":"2024-09-12T01:03:08.197412+0000","last_peered":"2024-09-12T01:03:08.197412+0000","last_clean":"2024-09-12T01:03:08.197412+0000","last_became_active":"2024-09-12T00:18:24.872637+0000","last_became_peered":"2024-09-12T00:18:24.872637+0000","last_unstale":"2024-09-12T01:03:08.197412+0000","last_undegraded":"2024-09-12T01:03:08.197412+0000","last_fullsized":"2024-09-12T01:03:08.197412+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:31.196044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2400,"num_read_kb":2300,"num_write":500,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'286","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.660542+0000","last_change":"2024-09-12T00:18:22.862177+0000","last_active":"2024-09-12T01:02:57.660542+0000","last_peered":"2024-09-12T01:02:57.660542+0000","last_clean":"2024-09-12T01:02:57.660542+0000","last_became_active":"2024-09-12T00:18:22.861450+0000","last_became_peered":"2024-09-12T00:18:22.861450+0000","last_unstale":"2024-09-12T01:02:57.660542+0000","last_undegraded":"2024-09-12T01:02:57.660542+0000","last_fullsized":"2024-09-12T01:02:57.660542+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:19.289534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4911848,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":522,"num_read_kb":32647,"num_write":1116,"num_write_kb":29925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:11.541211+0000","last_change":"2024-09-12T00:18:26.859580+0000","last_active":"2024-09-12T01:01:11.541211+0000","last_peered":"2024-09-12T01:01:11.541211+0000","last_clean":"2024-09-12T01:01:11.541211+0000","last_became_active":"2024-09-12T00:18:26.859109+0000","last_became_peered":"2024-09-12T00:18:26.859109+0000","last_unstale":"2024-09-12T01:01:11.541211+0000","last_undegraded":"2024-09-12T01:01:11.541211+0000","last_fullsized":"2024-09-12T01:01:11.541211+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:53.815705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'303","reported_seq":894,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.014048+0000","last_change":"2024-09-12T00:18:28.882686+0000","last_active":"2024-09-12T01:04:40.014048+0000","last_peered":"2024-09-12T01:04:40.014048+0000","last_clean":"2024-09-12T01:04:40.014048+0000","last_became_active":"2024-09-12T00:18:28.881947+0000","last_became_peered":"2024-09-12T00:18:28.881947+0000","last_unstale":"2024-09-12T01:04:40.014048+0000","last_undegraded":"2024-09-12T01:04:40.014048+0000","last_fullsized":"2024-09-12T01:04:40.014048+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:53.647502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45222,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":499,"num_read_kb":1119,"num_write":404,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'746","reported_seq":4316,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.558998+0000","last_change":"2024-09-12T00:18:30.873089+0000","last_active":"2024-09-12T01:04:38.558998+0000","last_peered":"2024-09-12T01:04:38.558998+0000","last_clean":"2024-09-12T01:04:38.558998+0000","last_became_active":"2024-09-12T00:18:30.872360+0000","last_became_peered":"2024-09-12T00:18:30.872360+0000","last_unstale":"2024-09-12T01:04:38.558998+0000","last_undegraded":"2024-09-12T01:04:38.558998+0000","last_fullsized":"2024-09-12T01:04:38.558998+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":700,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:32.019462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'112","reported_seq":623,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.964702+0000","last_change":"2024-09-12T00:18:32.897273+0000","last_active":"2024-09-12T01:03:25.964702+0000","last_peered":"2024-09-12T01:03:25.964702+0000","last_clean":"2024-09-12T01:03:25.964702+0000","last_became_active":"2024-09-12T00:18:32.896338+0000","last_became_peered":"2024-09-12T00:18:32.896338+0000","last_unstale":"2024-09-12T01:03:25.964702+0000","last_undegraded":"2024-09-12T01:03:25.964702+0000","last_fullsized":"2024-09-12T01:03:25.964702+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:36.916435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":125,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'462","reported_seq":2012,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.821991+0000","last_change":"2024-09-12T00:18:24.880332+0000","last_active":"2024-09-12T01:04:30.821991+0000","last_peered":"2024-09-12T01:04:30.821991+0000","last_clean":"2024-09-12T01:04:30.821991+0000","last_became_active":"2024-09-12T00:18:24.879622+0000","last_became_peered":"2024-09-12T00:18:24.879622+0000","last_unstale":"2024-09-12T01:04:30.821991+0000","last_undegraded":"2024-09-12T01:04:30.821991+0000","last_fullsized":"2024-09-12T01:04:30.821991+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:02.247072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2528,"num_read_kb":2373,"num_write":555,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'332","reported_seq":1029,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:52.573586+0000","last_change":"2024-09-12T00:18:22.849525+0000","last_active":"2024-09-12T01:03:52.573586+0000","last_peered":"2024-09-12T01:03:52.573586+0000","last_clean":"2024-09-12T01:03:52.573586+0000","last_became_active":"2024-09-12T00:18:22.847861+0000","last_became_peered":"2024-09-12T00:18:22.847861+0000","last_unstale":"2024-09-12T01:03:52.573586+0000","last_undegraded":"2024-09-12T01:03:52.573586+0000","last_fullsized":"2024-09-12T01:03:52.573586+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:43.232146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78962,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":640,"num_read_kb":61883,"num_write":1149,"num_write_kb":26157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1450,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.674782+0000","last_change":"2024-09-12T00:18:26.872031+0000","last_active":"2024-09-12T01:04:31.674782+0000","last_peered":"2024-09-12T01:04:31.674782+0000","last_clean":"2024-09-12T01:04:31.674782+0000","last_became_active":"2024-09-12T00:18:26.871356+0000","last_became_peered":"2024-09-12T00:18:26.871356+0000","last_unstale":"2024-09-12T01:04:31.674782+0000","last_undegraded":"2024-09-12T01:04:31.674782+0000","last_fullsized":"2024-09-12T01:04:31.674782+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:31.045577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":948,"num_read_kb":948,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'72","reported_seq":600,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:16.745058+0000","last_change":"2024-09-12T00:18:28.889216+0000","last_active":"2024-09-12T01:01:16.745058+0000","last_peered":"2024-09-12T01:01:16.745058+0000","last_clean":"2024-09-12T01:01:16.745058+0000","last_became_active":"2024-09-12T00:18:28.888423+0000","last_became_peered":"2024-09-12T00:18:28.888423+0000","last_unstale":"2024-09-12T01:01:16.745058+0000","last_undegraded":"2024-09-12T01:01:16.745058+0000","last_fullsized":"2024-09-12T01:01:16.745058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:38.462514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":78,"num_read_kb":72,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'763","reported_seq":2110,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.834256+0000","last_change":"2024-09-12T00:18:30.902806+0000","last_active":"2024-09-12T01:04:31.834256+0000","last_peered":"2024-09-12T01:04:31.834256+0000","last_clean":"2024-09-12T01:04:31.834256+0000","last_became_active":"2024-09-12T00:18:30.898814+0000","last_became_peered":"2024-09-12T00:18:30.898814+0000","last_unstale":"2024-09-12T01:04:31.834256+0000","last_undegraded":"2024-09-12T01:04:31.834256+0000","last_fullsized":"2024-09-12T01:04:31.834256+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:14.302064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'94","reported_seq":594,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.707747+0000","last_change":"2024-09-12T00:18:32.909724+0000","last_active":"2024-09-12T01:03:20.707747+0000","last_peered":"2024-09-12T01:03:20.707747+0000","last_clean":"2024-09-12T01:03:20.707747+0000","last_became_active":"2024-09-12T00:18:32.907797+0000","last_became_peered":"2024-09-12T00:18:32.907797+0000","last_unstale":"2024-09-12T01:03:20.707747+0000","last_undegraded":"2024-09-12T01:03:20.707747+0000","last_fullsized":"2024-09-12T01:03:20.707747+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:54.545857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":73,"num_write":219,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'509","reported_seq":2082,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.413084+0000","last_change":"2024-09-12T00:18:56.197323+0000","last_active":"2024-09-12T01:03:37.413084+0000","last_peered":"2024-09-12T01:03:37.413084+0000","last_clean":"2024-09-12T01:03:37.413084+0000","last_became_active":"2024-09-12T00:18:56.196419+0000","last_became_peered":"2024-09-12T00:18:56.196419+0000","last_unstale":"2024-09-12T01:03:37.413084+0000","last_undegraded":"2024-09-12T01:03:37.413084+0000","last_fullsized":"2024-09-12T01:03:37.413084+0000","mapping_epoch":37,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:19.400713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2644,"num_read_kb":2454,"num_write":619,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"268'406","reported_seq":1190,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.090529+0000","last_change":"2024-09-12T00:18:22.835371+0000","last_active":"2024-09-12T01:04:40.090529+0000","last_peered":"2024-09-12T01:04:40.090529+0000","last_clean":"2024-09-12T01:04:40.090529+0000","last_became_active":"2024-09-12T00:18:22.834072+0000","last_became_peered":"2024-09-12T00:18:22.834072+0000","last_unstale":"2024-09-12T01:04:40.090529+0000","last_undegraded":"2024-09-12T01:04:40.090529+0000","last_fullsized":"2024-09-12T01:04:40.090529+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:54.066638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":207192,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":853,"num_read_kb":11806,"num_write":1194,"num_write_kb":23298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.536055+0000","last_change":"2024-09-12T00:18:26.872530+0000","last_active":"2024-09-12T01:01:12.536055+0000","last_peered":"2024-09-12T01:01:12.536055+0000","last_clean":"2024-09-12T01:01:12.536055+0000","last_became_active":"2024-09-12T00:18:26.871183+0000","last_became_peered":"2024-09-12T00:18:26.871183+0000","last_unstale":"2024-09-12T01:01:12.536055+0000","last_undegraded":"2024-09-12T01:01:12.536055+0000","last_fullsized":"2024-09-12T01:01:12.536055+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:37.626693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'365","reported_seq":968,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.561953+0000","last_change":"2024-09-12T00:18:28.895040+0000","last_active":"2024-09-12T01:03:37.561953+0000","last_peered":"2024-09-12T01:03:37.561953+0000","last_clean":"2024-09-12T01:03:37.561953+0000","last_became_active":"2024-09-12T00:18:28.889343+0000","last_became_peered":"2024-09-12T00:18:28.889343+0000","last_unstale":"2024-09-12T01:03:37.561953+0000","last_undegraded":"2024-09-12T01:03:37.561953+0000","last_fullsized":"2024-09-12T01:03:37.561953+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:17.252099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57094,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1168,"num_read_kb":1657,"num_write":1682,"num_write_kb":1547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:17.720087+0000","last_change":"2024-09-12T00:18:30.906396+0000","last_active":"2024-09-12T01:01:17.720087+0000","last_peered":"2024-09-12T01:01:17.720087+0000","last_clean":"2024-09-12T01:01:17.720087+0000","last_became_active":"2024-09-12T00:18:30.905770+0000","last_became_peered":"2024-09-12T00:18:30.905770+0000","last_unstale":"2024-09-12T01:01:17.720087+0000","last_undegraded":"2024-09-12T01:01:17.720087+0000","last_fullsized":"2024-09-12T01:01:17.720087+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:26.490700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'134","reported_seq":635,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.562136+0000","last_change":"2024-09-12T00:18:32.886440+0000","last_active":"2024-09-12T01:03:23.562136+0000","last_peered":"2024-09-12T01:03:23.562136+0000","last_clean":"2024-09-12T01:03:23.562136+0000","last_became_active":"2024-09-12T00:18:32.885619+0000","last_became_peered":"2024-09-12T00:18:32.885619+0000","last_unstale":"2024-09-12T01:03:23.562136+0000","last_undegraded":"2024-09-12T01:03:23.562136+0000","last_fullsized":"2024-09-12T01:03:23.562136+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:21.997695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":117,"num_write":301,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'771","reported_seq":2188,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.192347+0000","last_change":"2024-09-12T00:18:24.880137+0000","last_active":"2024-09-12T01:03:11.192347+0000","last_peered":"2024-09-12T01:03:11.192347+0000","last_clean":"2024-09-12T01:03:11.192347+0000","last_became_active":"2024-09-12T00:18:24.879462+0000","last_became_peered":"2024-09-12T00:18:24.879462+0000","last_unstale":"2024-09-12T01:03:11.192347+0000","last_undegraded":"2024-09-12T01:03:11.192347+0000","last_fullsized":"2024-09-12T01:03:11.192347+0000","mapping_epoch":26,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:59.861183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3687,"num_read_kb":3308,"num_write":1074,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:17.549465+0000","last_change":"2024-09-12T00:18:03.927642+0000","last_active":"2024-09-12T01:02:17.549465+0000","last_peered":"2024-09-12T01:02:17.549465+0000","last_clean":"2024-09-12T01:02:17.549465+0000","last_became_active":"2024-09-12T00:18:03.924829+0000","last_became_peered":"2024-09-12T00:18:03.924829+0000","last_unstale":"2024-09-12T01:02:17.549465+0000","last_undegraded":"2024-09-12T01:02:17.549465+0000","last_fullsized":"2024-09-12T01:02:17.549465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:02.531521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:02.531521+0000","last_clean_scrub_stamp":"2024-09-12T00:18:02.531521+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:47.557338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.749313+0000","last_change":"2024-09-12T00:18:10.661688+0000","last_active":"2024-09-12T01:01:57.749313+0000","last_peered":"2024-09-12T01:01:57.749313+0000","last_clean":"2024-09-12T01:01:57.749313+0000","last_became_active":"2024-09-12T00:18:08.644385+0000","last_became_peered":"2024-09-12T00:18:08.644385+0000","last_unstale":"2024-09-12T01:01:57.749313+0000","last_undegraded":"2024-09-12T01:01:57.749313+0000","last_fullsized":"2024-09-12T01:01:57.749313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:31.240227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001156741,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'356","reported_seq":1005,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.104337+0000","last_change":"2024-09-12T00:18:22.868181+0000","last_active":"2024-09-12T01:04:40.104337+0000","last_peered":"2024-09-12T01:04:40.104337+0000","last_clean":"2024-09-12T01:04:40.104337+0000","last_became_active":"2024-09-12T00:18:22.867571+0000","last_became_peered":"2024-09-12T00:18:22.867571+0000","last_unstale":"2024-09-12T01:04:40.104337+0000","last_undegraded":"2024-09-12T01:04:40.104337+0000","last_fullsized":"2024-09-12T01:04:40.104337+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:17.614856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262231,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":470,"num_read_kb":26851,"num_write":1093,"num_write_kb":40025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.548434+0000","last_change":"2024-09-12T00:18:26.847189+0000","last_active":"2024-09-12T01:02:12.548434+0000","last_peered":"2024-09-12T01:02:12.548434+0000","last_clean":"2024-09-12T01:02:12.548434+0000","last_became_active":"2024-09-12T00:18:26.846668+0000","last_became_peered":"2024-09-12T00:18:26.846668+0000","last_unstale":"2024-09-12T01:02:12.548434+0000","last_undegraded":"2024-09-12T01:02:12.548434+0000","last_fullsized":"2024-09-12T01:02:12.548434+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:06.265320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'687","reported_seq":1384,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.769278+0000","last_change":"2024-09-12T00:18:28.887266+0000","last_active":"2024-09-12T01:04:31.769278+0000","last_peered":"2024-09-12T01:04:31.769278+0000","last_clean":"2024-09-12T01:04:31.769278+0000","last_became_active":"2024-09-12T00:18:28.885217+0000","last_became_peered":"2024-09-12T00:18:28.885217+0000","last_unstale":"2024-09-12T01:04:31.769278+0000","last_undegraded":"2024-09-12T01:04:31.769278+0000","last_fullsized":"2024-09-12T01:04:31.769278+0000","mapping_epoch":30,"log_start":"268'600","ondisk_log_start":"268'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":600,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:06.515258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212657,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1339,"num_read_kb":2881,"num_write":1248,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":493,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:51.570679+0000","last_change":"2024-09-12T00:18:30.899429+0000","last_active":"2024-09-12T01:01:51.570679+0000","last_peered":"2024-09-12T01:01:51.570679+0000","last_clean":"2024-09-12T01:01:51.570679+0000","last_became_active":"2024-09-12T00:18:30.898689+0000","last_became_peered":"2024-09-12T00:18:30.898689+0000","last_unstale":"2024-09-12T01:01:51.570679+0000","last_undegraded":"2024-09-12T01:01:51.570679+0000","last_fullsized":"2024-09-12T01:01:51.570679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:03.955121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'198","reported_seq":907,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.899528+0000","last_change":"2024-09-12T00:18:32.895955+0000","last_active":"2024-09-12T01:03:25.899528+0000","last_peered":"2024-09-12T01:03:25.899528+0000","last_clean":"2024-09-12T01:03:25.899528+0000","last_became_active":"2024-09-12T00:18:32.895239+0000","last_became_peered":"2024-09-12T00:18:32.895239+0000","last_unstale":"2024-09-12T01:03:25.899528+0000","last_undegraded":"2024-09-12T01:03:25.899528+0000","last_fullsized":"2024-09-12T01:03:25.899528+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:55.084809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1443,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":458,"num_write":434,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'488","reported_seq":2064,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.768001+0000","last_change":"2024-09-12T00:18:24.867486+0000","last_active":"2024-09-12T01:02:55.768001+0000","last_peered":"2024-09-12T01:02:55.768001+0000","last_clean":"2024-09-12T01:02:55.768001+0000","last_became_active":"2024-09-12T00:18:24.867067+0000","last_became_peered":"2024-09-12T00:18:24.867067+0000","last_unstale":"2024-09-12T01:02:55.768001+0000","last_undegraded":"2024-09-12T01:02:55.768001+0000","last_fullsized":"2024-09-12T01:02:55.768001+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:22.498521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2524,"num_read_kb":2362,"num_write":607,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":524,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:22.550569+0000","last_change":"2024-09-12T00:18:10.895303+0000","last_active":"2024-09-12T01:02:22.550569+0000","last_peered":"2024-09-12T01:02:22.550569+0000","last_clean":"2024-09-12T01:02:22.550569+0000","last_became_active":"2024-09-12T00:18:08.646097+0000","last_became_peered":"2024-09-12T00:18:08.646097+0000","last_unstale":"2024-09-12T01:02:22.550569+0000","last_undegraded":"2024-09-12T01:02:22.550569+0000","last_fullsized":"2024-09-12T01:02:22.550569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:23.989230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001003409,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'364","reported_seq":1027,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.080347+0000","last_change":"2024-09-12T00:18:22.858083+0000","last_active":"2024-09-12T01:04:40.080347+0000","last_peered":"2024-09-12T01:04:40.080347+0000","last_clean":"2024-09-12T01:04:40.080347+0000","last_became_active":"2024-09-12T00:18:22.857461+0000","last_became_peered":"2024-09-12T00:18:22.857461+0000","last_unstale":"2024-09-12T01:04:40.080347+0000","last_undegraded":"2024-09-12T01:04:40.080347+0000","last_fullsized":"2024-09-12T01:04:40.080347+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:17.632592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342049,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":576,"num_read_kb":72256,"num_write":1077,"num_write_kb":25510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:47.747024+0000","last_change":"2024-09-12T00:18:26.872369+0000","last_active":"2024-09-12T01:01:47.747024+0000","last_peered":"2024-09-12T01:01:47.747024+0000","last_clean":"2024-09-12T01:01:47.747024+0000","last_became_active":"2024-09-12T00:18:26.871674+0000","last_became_peered":"2024-09-12T00:18:26.871674+0000","last_unstale":"2024-09-12T01:01:47.747024+0000","last_undegraded":"2024-09-12T01:01:47.747024+0000","last_fullsized":"2024-09-12T01:01:47.747024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:53.162492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'1324","reported_seq":2834,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.839073+0000","last_change":"2024-09-12T00:18:28.890022+0000","last_active":"2024-09-12T01:04:39.839073+0000","last_peered":"2024-09-12T01:04:39.839073+0000","last_clean":"2024-09-12T01:04:39.839073+0000","last_became_active":"2024-09-12T00:18:28.889257+0000","last_became_peered":"2024-09-12T00:18:28.889257+0000","last_unstale":"2024-09-12T01:04:39.839073+0000","last_undegraded":"2024-09-12T01:04:39.839073+0000","last_fullsized":"2024-09-12T01:04:39.839073+0000","mapping_epoch":30,"log_start":"268'1301","ondisk_log_start":"268'1301","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":1301,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:45.298192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142532,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2119,"num_read_kb":4115,"num_write":1220,"num_write_kb":1054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":492,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:27.551882+0000","last_change":"2024-09-12T00:18:30.896021+0000","last_active":"2024-09-12T01:02:27.551882+0000","last_peered":"2024-09-12T01:02:27.551882+0000","last_clean":"2024-09-12T01:02:27.551882+0000","last_became_active":"2024-09-12T00:18:30.895305+0000","last_became_peered":"2024-09-12T00:18:30.895305+0000","last_unstale":"2024-09-12T01:02:27.551882+0000","last_undegraded":"2024-09-12T01:02:27.551882+0000","last_fullsized":"2024-09-12T01:02:27.551882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:43.210391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'203","reported_seq":730,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:06.553696+0000","last_change":"2024-09-12T00:18:32.888386+0000","last_active":"2024-09-12T01:02:06.553696+0000","last_peered":"2024-09-12T01:02:06.553696+0000","last_clean":"2024-09-12T01:02:06.553696+0000","last_became_active":"2024-09-12T00:18:32.887528+0000","last_became_peered":"2024-09-12T00:18:32.887528+0000","last_unstale":"2024-09-12T01:02:06.553696+0000","last_undegraded":"2024-09-12T01:02:06.553696+0000","last_fullsized":"2024-09-12T01:02:06.553696+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:38.435598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":310,"num_read_kb":309,"num_write":446,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'1278","reported_seq":3138,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.820547+0000","last_change":"2024-09-12T00:18:24.878345+0000","last_active":"2024-09-12T01:04:30.820547+0000","last_peered":"2024-09-12T01:04:30.820547+0000","last_clean":"2024-09-12T01:04:30.820547+0000","last_became_active":"2024-09-12T00:18:24.877964+0000","last_became_peered":"2024-09-12T00:18:24.877964+0000","last_unstale":"2024-09-12T01:04:30.820547+0000","last_undegraded":"2024-09-12T01:04:30.820547+0000","last_fullsized":"2024-09-12T01:04:30.820547+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":1200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:26.929945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6082,"num_read_kb":5401,"num_write":1732,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.720736+0000","last_change":"2024-09-12T00:18:10.654679+0000","last_active":"2024-09-12T01:01:56.720736+0000","last_peered":"2024-09-12T01:01:56.720736+0000","last_clean":"2024-09-12T01:01:56.720736+0000","last_became_active":"2024-09-12T00:18:08.874442+0000","last_became_peered":"2024-09-12T00:18:08.874442+0000","last_unstale":"2024-09-12T01:01:56.720736+0000","last_undegraded":"2024-09-12T01:01:56.720736+0000","last_fullsized":"2024-09-12T01:01:56.720736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:30.659138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010707620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'366","reported_seq":1085,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.070837+0000","last_change":"2024-09-12T00:18:22.835171+0000","last_active":"2024-09-12T01:04:40.070837+0000","last_peered":"2024-09-12T01:04:40.070837+0000","last_clean":"2024-09-12T01:04:40.070837+0000","last_became_active":"2024-09-12T00:18:22.834724+0000","last_became_peered":"2024-09-12T00:18:22.834724+0000","last_unstale":"2024-09-12T01:04:40.070837+0000","last_undegraded":"2024-09-12T01:04:40.070837+0000","last_fullsized":"2024-09-12T01:04:40.070837+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:08.633740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":674,"num_read_kb":9051,"num_write":1222,"num_write_kb":24587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:46.718701+0000","last_change":"2024-09-12T00:18:26.868058+0000","last_active":"2024-09-12T01:01:46.718701+0000","last_peered":"2024-09-12T01:01:46.718701+0000","last_clean":"2024-09-12T01:01:46.718701+0000","last_became_active":"2024-09-12T00:18:26.867343+0000","last_became_peered":"2024-09-12T00:18:26.867343+0000","last_unstale":"2024-09-12T01:01:46.718701+0000","last_undegraded":"2024-09-12T01:01:46.718701+0000","last_fullsized":"2024-09-12T01:01:46.718701+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:35.314858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'252","reported_seq":1356,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.962448+0000","last_change":"2024-09-12T00:18:28.892634+0000","last_active":"2024-09-12T01:04:31.962448+0000","last_peered":"2024-09-12T01:04:31.962448+0000","last_clean":"2024-09-12T01:04:31.962448+0000","last_became_active":"2024-09-12T00:18:28.889058+0000","last_became_peered":"2024-09-12T00:18:28.889058+0000","last_unstale":"2024-09-12T01:04:31.962448+0000","last_undegraded":"2024-09-12T01:04:31.962448+0000","last_fullsized":"2024-09-12T01:04:31.962448+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:46.530785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":190,"num_read_kb":179,"num_write":165,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":494,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:16.577209+0000","last_change":"2024-09-12T00:18:30.896789+0000","last_active":"2024-09-12T01:02:16.577209+0000","last_peered":"2024-09-12T01:02:16.577209+0000","last_clean":"2024-09-12T01:02:16.577209+0000","last_became_active":"2024-09-12T00:18:30.896073+0000","last_became_peered":"2024-09-12T00:18:30.896073+0000","last_unstale":"2024-09-12T01:02:16.577209+0000","last_undegraded":"2024-09-12T01:02:16.577209+0000","last_fullsized":"2024-09-12T01:02:16.577209+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:47.152911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'272","reported_seq":884,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.079029+0000","last_change":"2024-09-12T00:18:32.914870+0000","last_active":"2024-09-12T01:03:26.079029+0000","last_peered":"2024-09-12T01:03:26.079029+0000","last_clean":"2024-09-12T01:03:26.079029+0000","last_became_active":"2024-09-12T00:18:32.914004+0000","last_became_peered":"2024-09-12T00:18:32.914004+0000","last_unstale":"2024-09-12T01:03:26.079029+0000","last_undegraded":"2024-09-12T01:03:26.079029+0000","last_fullsized":"2024-09-12T01:03:26.079029+0000","mapping_epoch":34,"log_start":"268'200","ondisk_log_start":"268'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:37.374742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":517,"num_read_kb":535,"num_write":598,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'816","reported_seq":2373,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.819708+0000","last_change":"2024-09-12T00:18:24.870195+0000","last_active":"2024-09-12T01:04:30.819708+0000","last_peered":"2024-09-12T01:04:30.819708+0000","last_clean":"2024-09-12T01:04:30.819708+0000","last_became_active":"2024-09-12T00:18:24.869633+0000","last_became_peered":"2024-09-12T00:18:24.869633+0000","last_unstale":"2024-09-12T01:04:30.819708+0000","last_undegraded":"2024-09-12T01:04:30.819708+0000","last_fullsized":"2024-09-12T01:04:30.819708+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:24.540261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3879,"num_read_kb":3488,"num_write":1067,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.749218+0000","last_change":"2024-09-12T00:18:10.662993+0000","last_active":"2024-09-12T01:01:57.749218+0000","last_peered":"2024-09-12T01:01:57.749218+0000","last_clean":"2024-09-12T01:01:57.749218+0000","last_became_active":"2024-09-12T00:18:08.645156+0000","last_became_peered":"2024-09-12T00:18:08.645156+0000","last_unstale":"2024-09-12T01:01:57.749218+0000","last_undegraded":"2024-09-12T01:01:57.749218+0000","last_fullsized":"2024-09-12T01:01:57.749218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:52.068369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024595709999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'316","reported_seq":999,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.898917+0000","last_change":"2024-09-12T00:18:22.855734+0000","last_active":"2024-09-12T01:03:21.898917+0000","last_peered":"2024-09-12T01:03:21.898917+0000","last_clean":"2024-09-12T01:03:21.898917+0000","last_became_active":"2024-09-12T00:18:22.854940+0000","last_became_peered":"2024-09-12T00:18:22.854940+0000","last_unstale":"2024-09-12T01:03:21.898917+0000","last_undegraded":"2024-09-12T01:03:21.898917+0000","last_fullsized":"2024-09-12T01:03:21.898917+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:05.965555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11634921,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":527,"num_read_kb":32176,"num_write":1165,"num_write_kb":29732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.578382+0000","last_change":"2024-09-12T00:18:26.856551+0000","last_active":"2024-09-12T01:02:21.578382+0000","last_peered":"2024-09-12T01:02:21.578382+0000","last_clean":"2024-09-12T01:02:21.578382+0000","last_became_active":"2024-09-12T00:18:26.855239+0000","last_became_peered":"2024-09-12T00:18:26.855239+0000","last_unstale":"2024-09-12T01:02:21.578382+0000","last_undegraded":"2024-09-12T01:02:21.578382+0000","last_fullsized":"2024-09-12T01:02:21.578382+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:33.287785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'122","reported_seq":671,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:01.784399+0000","last_change":"2024-09-12T00:18:28.891881+0000","last_active":"2024-09-12T01:04:01.784399+0000","last_peered":"2024-09-12T01:04:01.784399+0000","last_clean":"2024-09-12T01:04:01.784399+0000","last_became_active":"2024-09-12T00:18:28.891173+0000","last_became_peered":"2024-09-12T00:18:28.891173+0000","last_unstale":"2024-09-12T01:04:01.784399+0000","last_undegraded":"2024-09-12T01:04:01.784399+0000","last_fullsized":"2024-09-12T01:04:01.784399+0000","mapping_epoch":30,"log_start":"268'100","ondisk_log_start":"268'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:02.040523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":142,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":491,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:52.727361+0000","last_change":"2024-09-12T00:18:30.904713+0000","last_active":"2024-09-12T01:01:52.727361+0000","last_peered":"2024-09-12T01:01:52.727361+0000","last_clean":"2024-09-12T01:01:52.727361+0000","last_became_active":"2024-09-12T00:18:30.904080+0000","last_became_peered":"2024-09-12T00:18:30.904080+0000","last_unstale":"2024-09-12T01:01:52.727361+0000","last_undegraded":"2024-09-12T01:01:52.727361+0000","last_fullsized":"2024-09-12T01:01:52.727361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:14.500655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'108","reported_seq":658,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.275864+0000","last_change":"2024-09-12T00:18:32.905383+0000","last_active":"2024-09-12T01:02:54.275864+0000","last_peered":"2024-09-12T01:02:54.275864+0000","last_clean":"2024-09-12T01:02:54.275864+0000","last_became_active":"2024-09-12T00:18:32.903109+0000","last_became_peered":"2024-09-12T00:18:32.903109+0000","last_unstale":"2024-09-12T01:02:54.275864+0000","last_undegraded":"2024-09-12T01:02:54.275864+0000","last_fullsized":"2024-09-12T01:02:54.275864+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:48.630615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":206,"num_read_kb":202,"num_write":268,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'472","reported_seq":1985,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.120332+0000","last_change":"2024-09-12T00:18:24.878475+0000","last_active":"2024-09-12T01:03:25.120332+0000","last_peered":"2024-09-12T01:03:25.120332+0000","last_clean":"2024-09-12T01:03:25.120332+0000","last_became_active":"2024-09-12T00:18:24.878031+0000","last_became_peered":"2024-09-12T00:18:24.878031+0000","last_unstale":"2024-09-12T01:03:25.120332+0000","last_undegraded":"2024-09-12T01:03:25.120332+0000","last_fullsized":"2024-09-12T01:03:25.120332+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:27.805912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2325,"num_read_kb":2173,"num_write":541,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'253","reported_seq":867,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.898632+0000","last_change":"2024-09-12T00:18:22.873808+0000","last_active":"2024-09-12T01:03:21.898632+0000","last_peered":"2024-09-12T01:03:21.898632+0000","last_clean":"2024-09-12T01:03:21.898632+0000","last_became_active":"2024-09-12T00:18:22.861336+0000","last_became_peered":"2024-09-12T00:18:22.861336+0000","last_unstale":"2024-09-12T01:03:21.898632+0000","last_undegraded":"2024-09-12T01:03:21.898632+0000","last_fullsized":"2024-09-12T01:03:21.898632+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:07.579776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13735787,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":353,"num_read_kb":16866,"num_write":896,"num_write_kb":39669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.551222+0000","last_change":"2024-09-12T00:18:10.665342+0000","last_active":"2024-09-12T01:01:56.551222+0000","last_peered":"2024-09-12T01:01:56.551222+0000","last_clean":"2024-09-12T01:01:56.551222+0000","last_became_active":"2024-09-12T00:18:08.956785+0000","last_became_peered":"2024-09-12T00:18:08.956785+0000","last_unstale":"2024-09-12T01:01:56.551222+0000","last_undegraded":"2024-09-12T01:01:56.551222+0000","last_fullsized":"2024-09-12T01:01:56.551222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:11.556988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012417909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.575765+0000","last_change":"2024-09-12T00:18:26.879934+0000","last_active":"2024-09-12T01:02:11.575765+0000","last_peered":"2024-09-12T01:02:11.575765+0000","last_clean":"2024-09-12T01:02:11.575765+0000","last_became_active":"2024-09-12T00:18:26.879511+0000","last_became_peered":"2024-09-12T00:18:26.879511+0000","last_unstale":"2024-09-12T01:02:11.575765+0000","last_undegraded":"2024-09-12T01:02:11.575765+0000","last_fullsized":"2024-09-12T01:02:11.575765+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:50.925795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'562","reported_seq":1241,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.968654+0000","last_change":"2024-09-12T00:18:28.880341+0000","last_active":"2024-09-12T01:04:39.968654+0000","last_peered":"2024-09-12T01:04:39.968654+0000","last_clean":"2024-09-12T01:04:39.968654+0000","last_became_active":"2024-09-12T00:18:28.879614+0000","last_became_peered":"2024-09-12T00:18:28.879614+0000","last_unstale":"2024-09-12T01:04:39.968654+0000","last_undegraded":"2024-09-12T01:04:39.968654+0000","last_fullsized":"2024-09-12T01:04:39.968654+0000","mapping_epoch":30,"log_start":"268'500","ondisk_log_start":"268'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:03.149386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100174,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":946,"num_read_kb":2084,"num_write":804,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:17.552865+0000","last_change":"2024-09-12T00:18:30.904154+0000","last_active":"2024-09-12T01:02:17.552865+0000","last_peered":"2024-09-12T01:02:17.552865+0000","last_clean":"2024-09-12T01:02:17.552865+0000","last_became_active":"2024-09-12T00:18:30.903532+0000","last_became_peered":"2024-09-12T00:18:30.903532+0000","last_unstale":"2024-09-12T01:02:17.552865+0000","last_undegraded":"2024-09-12T01:02:17.552865+0000","last_fullsized":"2024-09-12T01:02:17.552865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:56.341364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'142","reported_seq":649,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.969443+0000","last_change":"2024-09-12T00:18:32.897568+0000","last_active":"2024-09-12T01:03:25.969443+0000","last_peered":"2024-09-12T01:03:25.969443+0000","last_clean":"2024-09-12T01:03:25.969443+0000","last_became_active":"2024-09-12T00:18:32.896532+0000","last_became_peered":"2024-09-12T00:18:32.896532+0000","last_unstale":"2024-09-12T01:03:25.969443+0000","last_undegraded":"2024-09-12T01:03:25.969443+0000","last_fullsized":"2024-09-12T01:03:25.969443+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:19.854551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":138,"num_write":339,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'364","reported_seq":1903,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.171828+0000","last_change":"2024-09-12T00:18:24.856127+0000","last_active":"2024-09-12T01:03:03.171828+0000","last_peered":"2024-09-12T01:03:03.171828+0000","last_clean":"2024-09-12T01:03:03.171828+0000","last_became_active":"2024-09-12T00:18:24.852620+0000","last_became_peered":"2024-09-12T00:18:24.852620+0000","last_unstale":"2024-09-12T01:03:03.171828+0000","last_undegraded":"2024-09-12T01:03:03.171828+0000","last_fullsized":"2024-09-12T01:03:03.171828+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:07.552365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2109,"num_read_kb":2037,"num_write":400,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'343","reported_seq":989,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.128116+0000","last_change":"2024-09-12T00:18:22.839269+0000","last_active":"2024-09-12T01:04:40.128116+0000","last_peered":"2024-09-12T01:04:40.128116+0000","last_clean":"2024-09-12T01:04:40.128116+0000","last_became_active":"2024-09-12T00:18:22.839001+0000","last_became_peered":"2024-09-12T00:18:22.839001+0000","last_unstale":"2024-09-12T01:04:40.128116+0000","last_undegraded":"2024-09-12T01:04:40.128116+0000","last_fullsized":"2024-09-12T01:04:40.128116+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:51.522439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":481,"num_read_kb":59946,"num_write":977,"num_write_kb":34875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:07.547276+0000","last_change":"2024-09-12T00:18:10.895453+0000","last_active":"2024-09-12T01:02:07.547276+0000","last_peered":"2024-09-12T01:02:07.547276+0000","last_clean":"2024-09-12T01:02:07.547276+0000","last_became_active":"2024-09-12T00:18:08.958069+0000","last_became_peered":"2024-09-12T00:18:08.958069+0000","last_unstale":"2024-09-12T01:02:07.547276+0000","last_undegraded":"2024-09-12T01:02:07.547276+0000","last_fullsized":"2024-09-12T01:02:07.547276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:41.978158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001047189,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.731707+0000","last_change":"2024-09-12T00:18:26.866580+0000","last_active":"2024-09-12T01:02:12.731707+0000","last_peered":"2024-09-12T01:02:12.731707+0000","last_clean":"2024-09-12T01:02:12.731707+0000","last_became_active":"2024-09-12T00:18:26.865743+0000","last_became_peered":"2024-09-12T00:18:26.865743+0000","last_unstale":"2024-09-12T01:02:12.731707+0000","last_undegraded":"2024-09-12T01:02:12.731707+0000","last_fullsized":"2024-09-12T01:02:12.731707+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:54.698335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'164","reported_seq":741,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.887776+0000","last_change":"2024-09-12T00:18:28.877919+0000","last_active":"2024-09-12T01:03:25.887776+0000","last_peered":"2024-09-12T01:03:25.887776+0000","last_clean":"2024-09-12T01:03:25.887776+0000","last_became_active":"2024-09-12T00:18:28.877233+0000","last_became_peered":"2024-09-12T00:18:28.877233+0000","last_unstale":"2024-09-12T01:03:25.887776+0000","last_undegraded":"2024-09-12T01:03:25.887776+0000","last_fullsized":"2024-09-12T01:03:25.887776+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:54.638936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":206,"num_read_kb":196,"num_write":136,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'788","reported_seq":2602,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.826688+0000","last_change":"2024-09-12T00:18:30.874256+0000","last_active":"2024-09-12T01:04:31.826688+0000","last_peered":"2024-09-12T01:04:31.826688+0000","last_clean":"2024-09-12T01:04:31.826688+0000","last_became_active":"2024-09-12T00:18:30.873484+0000","last_became_peered":"2024-09-12T00:18:30.873484+0000","last_unstale":"2024-09-12T01:04:31.826688+0000","last_undegraded":"2024-09-12T01:04:31.826688+0000","last_fullsized":"2024-09-12T01:04:31.826688+0000","mapping_epoch":32,"log_start":"268'702","ondisk_log_start":"268'702","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":702,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:48.826950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'163","reported_seq":681,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.836361+0000","last_change":"2024-09-12T00:18:32.894083+0000","last_active":"2024-09-12T01:04:30.836361+0000","last_peered":"2024-09-12T01:04:30.836361+0000","last_clean":"2024-09-12T01:04:30.836361+0000","last_became_active":"2024-09-12T00:18:32.893315+0000","last_became_peered":"2024-09-12T00:18:32.893315+0000","last_unstale":"2024-09-12T01:04:30.836361+0000","last_undegraded":"2024-09-12T01:04:30.836361+0000","last_fullsized":"2024-09-12T01:04:30.836361+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:09.991201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":201,"num_read_kb":185,"num_write":395,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'450","reported_seq":2014,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.120605+0000","last_change":"2024-09-12T00:18:24.866105+0000","last_active":"2024-09-12T01:03:25.120605+0000","last_peered":"2024-09-12T01:03:25.120605+0000","last_clean":"2024-09-12T01:03:25.120605+0000","last_became_active":"2024-09-12T00:18:24.865603+0000","last_became_peered":"2024-09-12T00:18:24.865603+0000","last_unstale":"2024-09-12T01:03:25.120605+0000","last_undegraded":"2024-09-12T01:03:25.120605+0000","last_fullsized":"2024-09-12T01:03:25.120605+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:38.883418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2591,"num_read_kb":2430,"num_write":539,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'357","reported_seq":981,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.126571+0000","last_change":"2024-09-12T00:18:22.870893+0000","last_active":"2024-09-12T01:04:40.126571+0000","last_peered":"2024-09-12T01:04:40.126571+0000","last_clean":"2024-09-12T01:04:40.126571+0000","last_became_active":"2024-09-12T00:18:22.870180+0000","last_became_peered":"2024-09-12T00:18:22.870180+0000","last_unstale":"2024-09-12T01:04:40.126571+0000","last_undegraded":"2024-09-12T01:04:40.126571+0000","last_fullsized":"2024-09-12T01:04:40.126571+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:39.546988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":450,"num_read_kb":16363,"num_write":1061,"num_write_kb":31356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:31.545792+0000","last_change":"2024-09-12T00:18:10.665231+0000","last_active":"2024-09-12T01:01:31.545792+0000","last_peered":"2024-09-12T01:01:31.545792+0000","last_clean":"2024-09-12T01:01:31.545792+0000","last_became_active":"2024-09-12T00:18:08.638003+0000","last_became_peered":"2024-09-12T00:18:08.638003+0000","last_unstale":"2024-09-12T01:01:31.545792+0000","last_undegraded":"2024-09-12T01:01:31.545792+0000","last_fullsized":"2024-09-12T01:01:31.545792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:05.656587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010953429999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.549583+0000","last_change":"2024-09-12T00:18:26.859001+0000","last_active":"2024-09-12T01:02:12.549583+0000","last_peered":"2024-09-12T01:02:12.549583+0000","last_clean":"2024-09-12T01:02:12.549583+0000","last_became_active":"2024-09-12T00:18:26.858300+0000","last_became_peered":"2024-09-12T00:18:26.858300+0000","last_unstale":"2024-09-12T01:02:12.549583+0000","last_undegraded":"2024-09-12T01:02:12.549583+0000","last_fullsized":"2024-09-12T01:02:12.549583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:24.947974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'109","reported_seq":658,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:17.552956+0000","last_change":"2024-09-12T00:18:28.882042+0000","last_active":"2024-09-12T01:02:17.552956+0000","last_peered":"2024-09-12T01:02:17.552956+0000","last_clean":"2024-09-12T01:02:17.552956+0000","last_became_active":"2024-09-12T00:18:28.880684+0000","last_became_peered":"2024-09-12T00:18:28.880684+0000","last_unstale":"2024-09-12T01:02:17.552956+0000","last_undegraded":"2024-09-12T01:02:17.552956+0000","last_fullsized":"2024-09-12T01:02:17.552956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:05.919489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'816","reported_seq":2641,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.564873+0000","last_change":"2024-09-12T00:18:30.903318+0000","last_active":"2024-09-12T01:04:38.564873+0000","last_peered":"2024-09-12T01:04:38.564873+0000","last_clean":"2024-09-12T01:04:38.564873+0000","last_became_active":"2024-09-12T00:18:30.902580+0000","last_became_peered":"2024-09-12T00:18:30.902580+0000","last_unstale":"2024-09-12T01:04:38.564873+0000","last_undegraded":"2024-09-12T01:04:38.564873+0000","last_fullsized":"2024-09-12T01:04:38.564873+0000","mapping_epoch":32,"log_start":"268'800","ondisk_log_start":"268'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:13.015304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'173","reported_seq":673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:24.492347+0000","last_change":"2024-09-12T00:18:32.903845+0000","last_active":"2024-09-12T01:03:24.492347+0000","last_peered":"2024-09-12T01:03:24.492347+0000","last_clean":"2024-09-12T01:03:24.492347+0000","last_became_active":"2024-09-12T00:18:32.902970+0000","last_became_peered":"2024-09-12T00:18:32.902970+0000","last_unstale":"2024-09-12T01:03:24.492347+0000","last_undegraded":"2024-09-12T01:03:24.492347+0000","last_fullsized":"2024-09-12T01:03:24.492347+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:29.969603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":388,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'588","reported_seq":2161,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.347778+0000","last_change":"2024-09-12T00:18:24.879885+0000","last_active":"2024-09-12T01:03:37.347778+0000","last_peered":"2024-09-12T01:03:37.347778+0000","last_clean":"2024-09-12T01:03:37.347778+0000","last_became_active":"2024-09-12T00:18:24.879205+0000","last_became_peered":"2024-09-12T00:18:24.879205+0000","last_unstale":"2024-09-12T01:03:37.347778+0000","last_undegraded":"2024-09-12T01:03:37.347778+0000","last_fullsized":"2024-09-12T01:03:37.347778+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":500,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:25.009708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":3160,"num_read_kb":2876,"num_write":787,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'341","reported_seq":1062,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.048469+0000","last_change":"2024-09-12T00:18:22.850648+0000","last_active":"2024-09-12T01:04:40.048469+0000","last_peered":"2024-09-12T01:04:40.048469+0000","last_clean":"2024-09-12T01:04:40.048469+0000","last_became_active":"2024-09-12T00:18:22.850326+0000","last_became_peered":"2024-09-12T00:18:22.850326+0000","last_unstale":"2024-09-12T01:04:40.048469+0000","last_undegraded":"2024-09-12T01:04:40.048469+0000","last_fullsized":"2024-09-12T01:04:40.048469+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:20.333270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":560,"num_read_kb":1535,"num_write":1060,"num_write_kb":23375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:32.723228+0000","last_change":"2024-09-12T00:18:10.895554+0000","last_active":"2024-09-12T01:01:32.723228+0000","last_peered":"2024-09-12T01:01:32.723228+0000","last_clean":"2024-09-12T01:01:32.723228+0000","last_became_active":"2024-09-12T00:18:08.648187+0000","last_became_peered":"2024-09-12T00:18:08.648187+0000","last_unstale":"2024-09-12T01:01:32.723228+0000","last_undegraded":"2024-09-12T01:01:32.723228+0000","last_fullsized":"2024-09-12T01:01:32.723228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:14.147236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001130048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:31.765082+0000","last_change":"2024-09-12T00:18:26.851380+0000","last_active":"2024-09-12T01:02:31.765082+0000","last_peered":"2024-09-12T01:02:31.765082+0000","last_clean":"2024-09-12T01:02:31.765082+0000","last_became_active":"2024-09-12T00:18:26.851038+0000","last_became_peered":"2024-09-12T00:18:26.851038+0000","last_unstale":"2024-09-12T01:02:31.765082+0000","last_undegraded":"2024-09-12T01:02:31.765082+0000","last_fullsized":"2024-09-12T01:02:31.765082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:34.120180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'734","reported_seq":1445,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.743617+0000","last_change":"2024-09-12T00:18:28.885754+0000","last_active":"2024-09-12T01:04:31.743617+0000","last_peered":"2024-09-12T01:04:31.743617+0000","last_clean":"2024-09-12T01:04:31.743617+0000","last_became_active":"2024-09-12T00:18:28.884726+0000","last_became_peered":"2024-09-12T00:18:28.884726+0000","last_unstale":"2024-09-12T01:04:31.743617+0000","last_undegraded":"2024-09-12T01:04:31.743617+0000","last_fullsized":"2024-09-12T01:04:31.743617+0000","mapping_epoch":30,"log_start":"268'700","ondisk_log_start":"268'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":700,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:33.539730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187598,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1298,"num_read_kb":2803,"num_write":1074,"num_write_kb":914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:16.760930+0000","last_change":"2024-09-12T00:18:30.902052+0000","last_active":"2024-09-12T01:02:16.760930+0000","last_peered":"2024-09-12T01:02:16.760930+0000","last_clean":"2024-09-12T01:02:16.760930+0000","last_became_active":"2024-09-12T00:18:30.900777+0000","last_became_peered":"2024-09-12T00:18:30.900777+0000","last_unstale":"2024-09-12T01:02:16.760930+0000","last_undegraded":"2024-09-12T01:02:16.760930+0000","last_fullsized":"2024-09-12T01:02:16.760930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:05.763516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'111","reported_seq":608,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.877760+0000","last_change":"2024-09-12T00:18:32.900574+0000","last_active":"2024-09-12T01:03:25.877760+0000","last_peered":"2024-09-12T01:03:25.877760+0000","last_clean":"2024-09-12T01:03:25.877760+0000","last_became_active":"2024-09-12T00:18:32.899881+0000","last_became_peered":"2024-09-12T00:18:32.899881+0000","last_unstale":"2024-09-12T01:03:25.877760+0000","last_undegraded":"2024-09-12T01:03:25.877760+0000","last_fullsized":"2024-09-12T01:03:25.877760+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:39.617551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":105,"num_write":264,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'146","reported_seq":709,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.030418+0000","last_change":"2024-09-12T00:18:32.904423+0000","last_active":"2024-09-12T01:03:26.030418+0000","last_peered":"2024-09-12T01:03:26.030418+0000","last_clean":"2024-09-12T01:03:26.030418+0000","last_became_active":"2024-09-12T00:18:32.902596+0000","last_became_peered":"2024-09-12T00:18:32.902596+0000","last_unstale":"2024-09-12T01:03:26.030418+0000","last_undegraded":"2024-09-12T01:03:26.030418+0000","last_fullsized":"2024-09-12T01:03:26.030418+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:15.240829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":238,"num_read_kb":229,"num_write":342,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'482","reported_seq":2105,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.705235+0000","last_change":"2024-09-12T00:18:24.880298+0000","last_active":"2024-09-12T01:03:20.705235+0000","last_peered":"2024-09-12T01:03:20.705235+0000","last_clean":"2024-09-12T01:03:20.705235+0000","last_became_active":"2024-09-12T00:18:24.879640+0000","last_became_peered":"2024-09-12T00:18:24.879640+0000","last_unstale":"2024-09-12T01:03:20.705235+0000","last_undegraded":"2024-09-12T01:03:20.705235+0000","last_fullsized":"2024-09-12T01:03:20.705235+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:24.256945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2579,"num_read_kb":2446,"num_write":588,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'318","reported_seq":969,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:22.292716+0000","last_change":"2024-09-12T00:18:22.877577+0000","last_active":"2024-09-12T01:02:22.292716+0000","last_peered":"2024-09-12T01:02:22.292716+0000","last_clean":"2024-09-12T01:02:22.292716+0000","last_became_active":"2024-09-12T00:18:22.874059+0000","last_became_peered":"2024-09-12T00:18:22.874059+0000","last_unstale":"2024-09-12T01:02:22.292716+0000","last_undegraded":"2024-09-12T01:02:22.292716+0000","last_fullsized":"2024-09-12T01:02:22.292716+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:35.192212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14747835,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":494,"num_read_kb":19539,"num_write":1151,"num_write_kb":37354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:26.529417+0000","last_change":"2024-09-12T00:18:26.868055+0000","last_active":"2024-09-12T01:00:26.529417+0000","last_peered":"2024-09-12T01:00:26.529417+0000","last_clean":"2024-09-12T01:00:26.529417+0000","last_became_active":"2024-09-12T00:18:26.866940+0000","last_became_peered":"2024-09-12T00:18:26.866940+0000","last_unstale":"2024-09-12T01:00:26.529417+0000","last_undegraded":"2024-09-12T01:00:26.529417+0000","last_fullsized":"2024-09-12T01:00:26.529417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:32.546738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'294","reported_seq":882,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.624803+0000","last_change":"2024-09-12T00:18:28.878607+0000","last_active":"2024-09-12T01:04:39.624803+0000","last_peered":"2024-09-12T01:04:39.624803+0000","last_clean":"2024-09-12T01:04:39.624803+0000","last_became_active":"2024-09-12T00:18:28.877560+0000","last_became_peered":"2024-09-12T00:18:28.877560+0000","last_unstale":"2024-09-12T01:04:39.624803+0000","last_undegraded":"2024-09-12T01:04:39.624803+0000","last_fullsized":"2024-09-12T01:04:39.624803+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:45.619406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44815,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":481,"num_read_kb":1100,"num_write":392,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:31.733041+0000","last_change":"2024-09-12T00:18:30.903541+0000","last_active":"2024-09-12T01:00:31.733041+0000","last_peered":"2024-09-12T01:00:31.733041+0000","last_clean":"2024-09-12T01:00:31.733041+0000","last_became_active":"2024-09-12T00:18:30.901022+0000","last_became_peered":"2024-09-12T00:18:30.901022+0000","last_unstale":"2024-09-12T01:00:31.733041+0000","last_undegraded":"2024-09-12T01:00:31.733041+0000","last_fullsized":"2024-09-12T01:00:31.733041+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:14.300352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'140","reported_seq":654,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.209313+0000","last_change":"2024-09-12T00:18:32.901918+0000","last_active":"2024-09-12T01:03:01.209313+0000","last_peered":"2024-09-12T01:03:01.209313+0000","last_clean":"2024-09-12T01:03:01.209313+0000","last_became_active":"2024-09-12T00:18:32.900434+0000","last_became_peered":"2024-09-12T00:18:32.900434+0000","last_unstale":"2024-09-12T01:03:01.209313+0000","last_undegraded":"2024-09-12T01:03:01.209313+0000","last_fullsized":"2024-09-12T01:03:01.209313+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:49.600913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":83,"num_write":305,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'543","reported_seq":1959,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.741300+0000","last_change":"2024-09-12T00:18:24.878881+0000","last_active":"2024-09-12T01:03:06.741300+0000","last_peered":"2024-09-12T01:03:06.741300+0000","last_clean":"2024-09-12T01:03:06.741300+0000","last_became_active":"2024-09-12T00:18:24.878531+0000","last_became_peered":"2024-09-12T00:18:24.878531+0000","last_unstale":"2024-09-12T01:03:06.741300+0000","last_undegraded":"2024-09-12T01:03:06.741300+0000","last_fullsized":"2024-09-12T01:03:06.741300+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:48.183195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2546,"num_read_kb":2313,"num_write":710,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'336","reported_seq":1058,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:52.543841+0000","last_change":"2024-09-12T00:18:56.194776+0000","last_active":"2024-09-12T01:01:52.543841+0000","last_peered":"2024-09-12T01:01:52.543841+0000","last_clean":"2024-09-12T01:01:52.543841+0000","last_became_active":"2024-09-12T00:18:56.193958+0000","last_became_peered":"2024-09-12T00:18:56.193958+0000","last_unstale":"2024-09-12T01:01:52.543841+0000","last_undegraded":"2024-09-12T01:01:52.543841+0000","last_fullsized":"2024-09-12T01:01:52.543841+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:37.859959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8411057,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":707,"num_read_kb":16311,"num_write":1176,"num_write_kb":28883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:26.731697+0000","last_change":"2024-09-12T00:18:26.852947+0000","last_active":"2024-09-12T01:00:26.731697+0000","last_peered":"2024-09-12T01:00:26.731697+0000","last_clean":"2024-09-12T01:00:26.731697+0000","last_became_active":"2024-09-12T00:18:26.852430+0000","last_became_peered":"2024-09-12T00:18:26.852430+0000","last_unstale":"2024-09-12T01:00:26.731697+0000","last_undegraded":"2024-09-12T01:00:26.731697+0000","last_fullsized":"2024-09-12T01:00:26.731697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:06.569149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'47","reported_seq":552,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:16.496467+0000","last_change":"2024-09-12T00:18:28.889342+0000","last_active":"2024-09-12T01:02:16.496467+0000","last_peered":"2024-09-12T01:02:16.496467+0000","last_clean":"2024-09-12T01:02:16.496467+0000","last_became_active":"2024-09-12T00:18:28.888625+0000","last_became_peered":"2024-09-12T00:18:28.888625+0000","last_unstale":"2024-09-12T01:02:16.496467+0000","last_undegraded":"2024-09-12T01:02:16.496467+0000","last_fullsized":"2024-09-12T01:02:16.496467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:38.074165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:32.525392+0000","last_change":"2024-09-12T00:18:30.895269+0000","last_active":"2024-09-12T01:00:32.525392+0000","last_peered":"2024-09-12T01:00:32.525392+0000","last_clean":"2024-09-12T01:00:32.525392+0000","last_became_active":"2024-09-12T00:18:30.894388+0000","last_became_peered":"2024-09-12T00:18:30.894388+0000","last_unstale":"2024-09-12T01:00:32.525392+0000","last_undegraded":"2024-09-12T01:00:32.525392+0000","last_fullsized":"2024-09-12T01:00:32.525392+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:32.983260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'210","reported_seq":728,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.127161+0000","last_change":"2024-09-12T00:18:32.904521+0000","last_active":"2024-09-12T01:03:25.127161+0000","last_peered":"2024-09-12T01:03:25.127161+0000","last_clean":"2024-09-12T01:03:25.127161+0000","last_became_active":"2024-09-12T00:18:32.903719+0000","last_became_peered":"2024-09-12T00:18:32.903719+0000","last_unstale":"2024-09-12T01:03:25.127161+0000","last_undegraded":"2024-09-12T01:03:25.127161+0000","last_fullsized":"2024-09-12T01:03:25.127161+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:22.565162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":286,"num_read_kb":283,"num_write":470,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'850","reported_seq":2448,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.178028+0000","last_change":"2024-09-12T00:18:24.865796+0000","last_active":"2024-09-12T01:03:11.178028+0000","last_peered":"2024-09-12T01:03:11.178028+0000","last_clean":"2024-09-12T01:03:11.178028+0000","last_became_active":"2024-09-12T00:18:24.865480+0000","last_became_peered":"2024-09-12T00:18:24.865480+0000","last_unstale":"2024-09-12T01:03:11.178028+0000","last_undegraded":"2024-09-12T01:03:11.178028+0000","last_fullsized":"2024-09-12T01:03:11.178028+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":800,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:13.433725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4053,"num_read_kb":3643,"num_write":1115,"num_write_kb":411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'381","reported_seq":1031,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.094297+0000","last_change":"2024-09-12T00:18:55.955883+0000","last_active":"2024-09-12T01:04:40.094297+0000","last_peered":"2024-09-12T01:04:40.094297+0000","last_clean":"2024-09-12T01:04:40.094297+0000","last_became_active":"2024-09-12T00:18:55.955303+0000","last_became_peered":"2024-09-12T00:18:55.955303+0000","last_unstale":"2024-09-12T01:04:40.094297+0000","last_undegraded":"2024-09-12T01:04:40.094297+0000","last_fullsized":"2024-09-12T01:04:40.094297+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:26.714282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1605311,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":590,"num_read_kb":40569,"num_write":1352,"num_write_kb":40151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:27.524107+0000","last_change":"2024-09-12T00:18:26.860720+0000","last_active":"2024-09-12T01:00:27.524107+0000","last_peered":"2024-09-12T01:00:27.524107+0000","last_clean":"2024-09-12T01:00:27.524107+0000","last_became_active":"2024-09-12T00:18:26.859801+0000","last_became_peered":"2024-09-12T00:18:26.859801+0000","last_unstale":"2024-09-12T01:00:27.524107+0000","last_undegraded":"2024-09-12T01:00:27.524107+0000","last_fullsized":"2024-09-12T01:00:27.524107+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:36.551977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'316","reported_seq":914,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.129316+0000","last_change":"2024-09-12T00:18:28.878040+0000","last_active":"2024-09-12T01:04:39.129316+0000","last_peered":"2024-09-12T01:04:39.129316+0000","last_clean":"2024-09-12T01:04:39.129316+0000","last_became_active":"2024-09-12T00:18:28.877317+0000","last_became_peered":"2024-09-12T00:18:28.877317+0000","last_unstale":"2024-09-12T01:04:39.129316+0000","last_undegraded":"2024-09-12T01:04:39.129316+0000","last_fullsized":"2024-09-12T01:04:39.129316+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:36.629509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53640,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":520,"num_read_kb":1147,"num_write":418,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:32.710908+0000","last_change":"2024-09-12T00:18:30.904722+0000","last_active":"2024-09-12T01:00:32.710908+0000","last_peered":"2024-09-12T01:00:32.710908+0000","last_clean":"2024-09-12T01:00:32.710908+0000","last_became_active":"2024-09-12T00:18:30.904052+0000","last_became_peered":"2024-09-12T00:18:30.904052+0000","last_unstale":"2024-09-12T01:00:32.710908+0000","last_undegraded":"2024-09-12T01:00:32.710908+0000","last_fullsized":"2024-09-12T01:00:32.710908+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:47.904502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'138","reported_seq":657,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.556907+0000","last_change":"2024-09-12T00:18:32.900262+0000","last_active":"2024-09-12T01:03:23.556907+0000","last_peered":"2024-09-12T01:03:23.556907+0000","last_clean":"2024-09-12T01:03:23.556907+0000","last_became_active":"2024-09-12T00:18:32.899607+0000","last_became_peered":"2024-09-12T00:18:32.899607+0000","last_unstale":"2024-09-12T01:03:23.556907+0000","last_undegraded":"2024-09-12T01:03:23.556907+0000","last_fullsized":"2024-09-12T01:03:23.556907+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:26.707774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":193,"num_read_kb":183,"num_write":356,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'350","reported_seq":1891,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.346899+0000","last_change":"2024-09-12T00:18:24.863688+0000","last_active":"2024-09-12T01:03:37.346899+0000","last_peered":"2024-09-12T01:03:37.346899+0000","last_clean":"2024-09-12T01:03:37.346899+0000","last_became_active":"2024-09-12T00:18:24.863389+0000","last_became_peered":"2024-09-12T00:18:24.863389+0000","last_unstale":"2024-09-12T01:03:37.346899+0000","last_undegraded":"2024-09-12T01:03:37.346899+0000","last_fullsized":"2024-09-12T01:03:37.346899+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:05.818950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2172,"num_read_kb":2099,"num_write":388,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'347","reported_seq":981,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.126182+0000","last_change":"2024-09-12T00:18:22.863804+0000","last_active":"2024-09-12T01:04:40.126182+0000","last_peered":"2024-09-12T01:04:40.126182+0000","last_clean":"2024-09-12T01:04:40.126182+0000","last_became_active":"2024-09-12T00:18:22.863535+0000","last_became_peered":"2024-09-12T00:18:22.863535+0000","last_unstale":"2024-09-12T01:04:40.126182+0000","last_undegraded":"2024-09-12T01:04:40.126182+0000","last_fullsized":"2024-09-12T01:04:40.126182+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:39.498808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":493,"num_read_kb":3769,"num_write":1077,"num_write_kb":28344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:27.709827+0000","last_change":"2024-09-12T00:18:26.875530+0000","last_active":"2024-09-12T01:00:27.709827+0000","last_peered":"2024-09-12T01:00:27.709827+0000","last_clean":"2024-09-12T01:00:27.709827+0000","last_became_active":"2024-09-12T00:18:26.874839+0000","last_became_peered":"2024-09-12T00:18:26.874839+0000","last_unstale":"2024-09-12T01:00:27.709827+0000","last_undegraded":"2024-09-12T01:00:27.709827+0000","last_fullsized":"2024-09-12T01:00:27.709827+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:15.854373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'266","reported_seq":830,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.557384+0000","last_change":"2024-09-12T00:18:28.891511+0000","last_active":"2024-09-12T01:02:52.557384+0000","last_peered":"2024-09-12T01:02:52.557384+0000","last_clean":"2024-09-12T01:02:52.557384+0000","last_became_active":"2024-09-12T00:18:28.888325+0000","last_became_peered":"2024-09-12T00:18:28.888325+0000","last_unstale":"2024-09-12T01:02:52.557384+0000","last_undegraded":"2024-09-12T01:02:52.557384+0000","last_fullsized":"2024-09-12T01:02:52.557384+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:42.542012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61114,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":440,"num_read_kb":948,"num_write":366,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":491,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:31.547022+0000","last_change":"2024-09-12T00:18:30.900318+0000","last_active":"2024-09-12T01:00:31.547022+0000","last_peered":"2024-09-12T01:00:31.547022+0000","last_clean":"2024-09-12T01:00:31.547022+0000","last_became_active":"2024-09-12T00:18:30.899237+0000","last_became_peered":"2024-09-12T00:18:30.899237+0000","last_unstale":"2024-09-12T01:00:31.547022+0000","last_undegraded":"2024-09-12T01:00:31.547022+0000","last_fullsized":"2024-09-12T01:00:31.547022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:30.916112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'930","reported_seq":2365,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.094892+0000","last_change":"2024-09-12T00:18:24.861100+0000","last_active":"2024-09-12T01:03:04.094892+0000","last_peered":"2024-09-12T01:03:04.094892+0000","last_clean":"2024-09-12T01:03:04.094892+0000","last_became_active":"2024-09-12T00:18:24.859351+0000","last_became_peered":"2024-09-12T00:18:24.859351+0000","last_unstale":"2024-09-12T01:03:04.094892+0000","last_undegraded":"2024-09-12T01:03:04.094892+0000","last_fullsized":"2024-09-12T01:03:04.094892+0000","mapping_epoch":26,"log_start":"268'900","ondisk_log_start":"268'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":900,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:16.033612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4324,"num_read_kb":3896,"num_write":1355,"num_write_kb":567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'313","reported_seq":1013,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.105099+0000","last_change":"2024-09-12T00:18:22.840532+0000","last_active":"2024-09-12T01:04:40.105099+0000","last_peered":"2024-09-12T01:04:40.105099+0000","last_clean":"2024-09-12T01:04:40.105099+0000","last_became_active":"2024-09-12T00:18:22.840244+0000","last_became_peered":"2024-09-12T00:18:22.840244+0000","last_unstale":"2024-09-12T01:04:40.105099+0000","last_undegraded":"2024-09-12T01:04:40.105099+0000","last_fullsized":"2024-09-12T01:04:40.105099+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:57.476911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":618,"num_read_kb":30347,"num_write":961,"num_write_kb":34968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:36.582308+0000","last_change":"2024-09-12T00:18:26.856078+0000","last_active":"2024-09-12T01:02:36.582308+0000","last_peered":"2024-09-12T01:02:36.582308+0000","last_clean":"2024-09-12T01:02:36.582308+0000","last_became_active":"2024-09-12T00:18:26.855432+0000","last_became_peered":"2024-09-12T00:18:26.855432+0000","last_unstale":"2024-09-12T01:02:36.582308+0000","last_undegraded":"2024-09-12T01:02:36.582308+0000","last_fullsized":"2024-09-12T01:02:36.582308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:58.468112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'469","reported_seq":1112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.876428+0000","last_change":"2024-09-12T00:18:28.888006+0000","last_active":"2024-09-12T01:04:39.876428+0000","last_peered":"2024-09-12T01:04:39.876428+0000","last_clean":"2024-09-12T01:04:39.876428+0000","last_became_active":"2024-09-12T00:18:28.887245+0000","last_became_peered":"2024-09-12T00:18:28.887245+0000","last_unstale":"2024-09-12T01:04:39.876428+0000","last_undegraded":"2024-09-12T01:04:39.876428+0000","last_fullsized":"2024-09-12T01:04:39.876428+0000","mapping_epoch":30,"log_start":"268'400","ondisk_log_start":"268'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:58.763012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":845,"num_read_kb":1964,"num_write":726,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":490,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.736385+0000","last_change":"2024-09-12T00:18:30.906327+0000","last_active":"2024-09-12T01:01:02.736385+0000","last_peered":"2024-09-12T01:01:02.736385+0000","last_clean":"2024-09-12T01:01:02.736385+0000","last_became_active":"2024-09-12T00:18:30.905680+0000","last_became_peered":"2024-09-12T00:18:30.905680+0000","last_unstale":"2024-09-12T01:01:02.736385+0000","last_undegraded":"2024-09-12T01:01:02.736385+0000","last_fullsized":"2024-09-12T01:01:02.736385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:50.953253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'152","reported_seq":659,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:43.232099+0000","last_change":"2024-09-12T00:18:32.905858+0000","last_active":"2024-09-12T01:02:43.232099+0000","last_peered":"2024-09-12T01:02:43.232099+0000","last_clean":"2024-09-12T01:02:43.232099+0000","last_became_active":"2024-09-12T00:18:32.905070+0000","last_became_peered":"2024-09-12T00:18:32.905070+0000","last_unstale":"2024-09-12T01:02:43.232099+0000","last_undegraded":"2024-09-12T01:02:43.232099+0000","last_fullsized":"2024-09-12T01:02:43.232099+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:11.929111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":167,"num_read_kb":179,"num_write":337,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'639","reported_seq":2054,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.704634+0000","last_change":"2024-09-12T00:18:24.865575+0000","last_active":"2024-09-12T01:03:20.704634+0000","last_peered":"2024-09-12T01:03:20.704634+0000","last_clean":"2024-09-12T01:03:20.704634+0000","last_became_active":"2024-09-12T00:18:24.865142+0000","last_became_peered":"2024-09-12T00:18:24.865142+0000","last_unstale":"2024-09-12T01:03:20.704634+0000","last_undegraded":"2024-09-12T01:03:20.704634+0000","last_fullsized":"2024-09-12T01:03:20.704634+0000","mapping_epoch":26,"log_start":"268'600","ondisk_log_start":"268'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":600,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:47.722129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2990,"num_read_kb":2759,"num_write":892,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'341","reported_seq":1265,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.105571+0000","last_change":"2024-09-12T00:18:22.846016+0000","last_active":"2024-09-12T01:04:40.105571+0000","last_peered":"2024-09-12T01:04:40.105571+0000","last_clean":"2024-09-12T01:04:40.105571+0000","last_became_active":"2024-09-12T00:18:22.845288+0000","last_became_peered":"2024-09-12T00:18:22.845288+0000","last_unstale":"2024-09-12T01:04:40.105571+0000","last_undegraded":"2024-09-12T01:04:40.105571+0000","last_fullsized":"2024-09-12T01:04:40.105571+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:08.062033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1116,"num_read_kb":11059,"num_write":1212,"num_write_kb":25104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.731837+0000","last_change":"2024-09-12T00:18:26.875611+0000","last_active":"2024-09-12T01:02:12.731837+0000","last_peered":"2024-09-12T01:02:12.731837+0000","last_clean":"2024-09-12T01:02:12.731837+0000","last_became_active":"2024-09-12T00:18:26.874972+0000","last_became_peered":"2024-09-12T00:18:26.874972+0000","last_unstale":"2024-09-12T01:02:12.731837+0000","last_undegraded":"2024-09-12T01:02:12.731837+0000","last_fullsized":"2024-09-12T01:02:12.731837+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:26.192283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'312","reported_seq":890,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:32.566874+0000","last_change":"2024-09-12T00:18:28.893601+0000","last_active":"2024-09-12T01:03:32.566874+0000","last_peered":"2024-09-12T01:03:32.566874+0000","last_clean":"2024-09-12T01:03:32.566874+0000","last_became_active":"2024-09-12T00:18:28.892852+0000","last_became_peered":"2024-09-12T00:18:28.892852+0000","last_unstale":"2024-09-12T01:03:32.566874+0000","last_undegraded":"2024-09-12T01:03:32.566874+0000","last_fullsized":"2024-09-12T01:03:32.566874+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:16.294300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66489,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":526,"num_read_kb":1071,"num_write":450,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:01.538521+0000","last_change":"2024-09-12T00:18:30.893248+0000","last_active":"2024-09-12T01:01:01.538521+0000","last_peered":"2024-09-12T01:01:01.538521+0000","last_clean":"2024-09-12T01:01:01.538521+0000","last_became_active":"2024-09-12T00:18:30.892643+0000","last_became_peered":"2024-09-12T00:18:30.892643+0000","last_unstale":"2024-09-12T01:01:01.538521+0000","last_undegraded":"2024-09-12T01:01:01.538521+0000","last_fullsized":"2024-09-12T01:01:01.538521+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:18.646293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'240","reported_seq":780,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.132867+0000","last_change":"2024-09-12T00:18:32.902236+0000","last_active":"2024-09-12T01:03:02.132867+0000","last_peered":"2024-09-12T01:03:02.132867+0000","last_clean":"2024-09-12T01:03:02.132867+0000","last_became_active":"2024-09-12T00:18:32.901587+0000","last_became_peered":"2024-09-12T00:18:32.901587+0000","last_unstale":"2024-09-12T01:03:02.132867+0000","last_undegraded":"2024-09-12T01:03:02.132867+0000","last_fullsized":"2024-09-12T01:03:02.132867+0000","mapping_epoch":34,"log_start":"268'200","ondisk_log_start":"268'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:22.015039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":371,"num_read_kb":330,"num_write":585,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'492","reported_seq":2033,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.884678+0000","last_change":"2024-09-12T00:18:24.861062+0000","last_active":"2024-09-12T01:03:25.884678+0000","last_peered":"2024-09-12T01:03:25.884678+0000","last_clean":"2024-09-12T01:03:25.884678+0000","last_became_active":"2024-09-12T00:18:24.860647+0000","last_became_peered":"2024-09-12T00:18:24.860647+0000","last_unstale":"2024-09-12T01:03:25.884678+0000","last_undegraded":"2024-09-12T01:03:25.884678+0000","last_fullsized":"2024-09-12T01:03:25.884678+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:16.460437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2720,"num_read_kb":2539,"num_write":620,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'302","reported_seq":975,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:24.259914+0000","last_change":"2024-09-12T00:18:22.856961+0000","last_active":"2024-09-12T01:04:24.259914+0000","last_peered":"2024-09-12T01:04:24.259914+0000","last_clean":"2024-09-12T01:04:24.259914+0000","last_became_active":"2024-09-12T00:18:22.856073+0000","last_became_peered":"2024-09-12T00:18:22.856073+0000","last_unstale":"2024-09-12T01:04:24.259914+0000","last_undegraded":"2024-09-12T01:04:24.259914+0000","last_fullsized":"2024-09-12T01:04:24.259914+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:02.567076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5779758,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":509,"num_read_kb":15674,"num_write":1060,"num_write_kb":22765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.532329+0000","last_change":"2024-09-12T00:18:26.862928+0000","last_active":"2024-09-12T01:00:57.532329+0000","last_peered":"2024-09-12T01:00:57.532329+0000","last_clean":"2024-09-12T01:00:57.532329+0000","last_became_active":"2024-09-12T00:18:26.862012+0000","last_became_peered":"2024-09-12T00:18:26.862012+0000","last_unstale":"2024-09-12T01:00:57.532329+0000","last_undegraded":"2024-09-12T01:00:57.532329+0000","last_fullsized":"2024-09-12T01:00:57.532329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:16.642244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'278","reported_seq":869,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.797040+0000","last_change":"2024-09-12T00:18:28.882861+0000","last_active":"2024-09-12T01:04:39.797040+0000","last_peered":"2024-09-12T01:04:39.797040+0000","last_clean":"2024-09-12T01:04:39.797040+0000","last_became_active":"2024-09-12T00:18:28.882129+0000","last_became_peered":"2024-09-12T00:18:28.882129+0000","last_unstale":"2024-09-12T01:04:39.797040+0000","last_undegraded":"2024-09-12T01:04:39.797040+0000","last_fullsized":"2024-09-12T01:04:39.797040+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:30.970755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47744,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":1049,"num_write":372,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.532795+0000","last_change":"2024-09-12T00:18:30.906689+0000","last_active":"2024-09-12T01:00:41.532795+0000","last_peered":"2024-09-12T01:00:41.532795+0000","last_clean":"2024-09-12T01:00:41.532795+0000","last_became_active":"2024-09-12T00:18:30.902511+0000","last_became_peered":"2024-09-12T00:18:30.902511+0000","last_unstale":"2024-09-12T01:00:41.532795+0000","last_undegraded":"2024-09-12T01:00:41.532795+0000","last_fullsized":"2024-09-12T01:00:41.532795+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:02.675233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'129","reported_seq":646,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.800676+0000","last_change":"2024-09-12T00:18:32.901622+0000","last_active":"2024-09-12T01:04:31.800676+0000","last_peered":"2024-09-12T01:04:31.800676+0000","last_clean":"2024-09-12T01:04:31.800676+0000","last_became_active":"2024-09-12T00:18:32.899968+0000","last_became_peered":"2024-09-12T00:18:32.899968+0000","last_unstale":"2024-09-12T01:04:31.800676+0000","last_undegraded":"2024-09-12T01:04:31.800676+0000","last_fullsized":"2024-09-12T01:04:31.800676+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:05.182292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":825,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":214,"num_read_kb":184,"num_write":320,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'363","reported_seq":1735,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.094141+0000","last_change":"2024-09-12T00:18:24.861615+0000","last_active":"2024-09-12T01:03:04.094141+0000","last_peered":"2024-09-12T01:03:04.094141+0000","last_clean":"2024-09-12T01:03:04.094141+0000","last_became_active":"2024-09-12T00:18:24.861271+0000","last_became_peered":"2024-09-12T00:18:24.861271+0000","last_unstale":"2024-09-12T01:03:04.094141+0000","last_undegraded":"2024-09-12T01:03:04.094141+0000","last_fullsized":"2024-09-12T01:03:04.094141+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:54.383255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2074,"num_read_kb":1954,"num_write":427,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'342","reported_seq":971,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.118463+0000","last_change":"2024-09-12T00:18:22.860377+0000","last_active":"2024-09-12T01:04:40.118463+0000","last_peered":"2024-09-12T01:04:40.118463+0000","last_clean":"2024-09-12T01:04:40.118463+0000","last_became_active":"2024-09-12T00:18:22.859695+0000","last_became_peered":"2024-09-12T00:18:22.859695+0000","last_unstale":"2024-09-12T01:04:40.118463+0000","last_undegraded":"2024-09-12T01:04:40.118463+0000","last_fullsized":"2024-09-12T01:04:40.118463+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:06.061275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263211,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":478,"num_read_kb":12426,"num_write":1109,"num_write_kb":25448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:56.536187+0000","last_change":"2024-09-12T00:18:26.859701+0000","last_active":"2024-09-12T01:00:56.536187+0000","last_peered":"2024-09-12T01:00:56.536187+0000","last_clean":"2024-09-12T01:00:56.536187+0000","last_became_active":"2024-09-12T00:18:26.859234+0000","last_became_peered":"2024-09-12T00:18:26.859234+0000","last_unstale":"2024-09-12T01:00:56.536187+0000","last_undegraded":"2024-09-12T01:00:56.536187+0000","last_fullsized":"2024-09-12T01:00:56.536187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:11.914399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'122","reported_seq":655,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:18.833187+0000","last_change":"2024-09-12T00:18:28.884827+0000","last_active":"2024-09-12T01:02:18.833187+0000","last_peered":"2024-09-12T01:02:18.833187+0000","last_clean":"2024-09-12T01:02:18.833187+0000","last_became_active":"2024-09-12T00:18:28.883277+0000","last_became_peered":"2024-09-12T00:18:28.883277+0000","last_unstale":"2024-09-12T01:02:18.833187+0000","last_undegraded":"2024-09-12T01:02:18.833187+0000","last_fullsized":"2024-09-12T01:02:18.833187+0000","mapping_epoch":30,"log_start":"268'100","ondisk_log_start":"268'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:38.381310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":135,"num_read_kb":124,"num_write":148,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'765","reported_seq":2196,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.824090+0000","last_change":"2024-09-12T00:18:30.895935+0000","last_active":"2024-09-12T01:04:31.824090+0000","last_peered":"2024-09-12T01:04:31.824090+0000","last_clean":"2024-09-12T01:04:31.824090+0000","last_became_active":"2024-09-12T00:18:30.893175+0000","last_became_peered":"2024-09-12T00:18:30.893175+0000","last_unstale":"2024-09-12T01:04:31.824090+0000","last_undegraded":"2024-09-12T01:04:31.824090+0000","last_fullsized":"2024-09-12T01:04:31.824090+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:51.257227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'108","reported_seq":602,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.731248+0000","last_change":"2024-09-12T00:18:32.909110+0000","last_active":"2024-09-12T01:03:06.731248+0000","last_peered":"2024-09-12T01:03:06.731248+0000","last_clean":"2024-09-12T01:03:06.731248+0000","last_became_active":"2024-09-12T00:18:32.908295+0000","last_became_peered":"2024-09-12T00:18:32.908295+0000","last_unstale":"2024-09-12T01:03:06.731248+0000","last_undegraded":"2024-09-12T01:03:06.731248+0000","last_fullsized":"2024-09-12T01:03:06.731248+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:19.170686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":102,"num_write":264,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'833","reported_seq":2453,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.192049+0000","last_change":"2024-09-12T00:18:24.861275+0000","last_active":"2024-09-12T01:03:11.192049+0000","last_peered":"2024-09-12T01:03:11.192049+0000","last_clean":"2024-09-12T01:03:11.192049+0000","last_became_active":"2024-09-12T00:18:24.860266+0000","last_became_peered":"2024-09-12T00:18:24.860266+0000","last_unstale":"2024-09-12T01:03:11.192049+0000","last_undegraded":"2024-09-12T01:03:11.192049+0000","last_fullsized":"2024-09-12T01:03:11.192049+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":800,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:29.020383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4128,"num_read_kb":3735,"num_write":1126,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'256","reported_seq":860,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.904315+0000","last_change":"2024-09-12T00:18:22.872906+0000","last_active":"2024-09-12T01:03:21.904315+0000","last_peered":"2024-09-12T01:03:21.904315+0000","last_clean":"2024-09-12T01:03:21.904315+0000","last_became_active":"2024-09-12T00:18:22.867694+0000","last_became_peered":"2024-09-12T00:18:22.867694+0000","last_unstale":"2024-09-12T01:03:21.904315+0000","last_undegraded":"2024-09-12T01:03:21.904315+0000","last_fullsized":"2024-09-12T01:03:21.904315+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:34.546151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7347981,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":350,"num_read_kb":19923,"num_write":927,"num_write_kb":45748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.531105+0000","last_change":"2024-09-12T00:18:26.865232+0000","last_active":"2024-09-12T01:00:57.531105+0000","last_peered":"2024-09-12T01:00:57.531105+0000","last_clean":"2024-09-12T01:00:57.531105+0000","last_became_active":"2024-09-12T00:18:26.864536+0000","last_became_peered":"2024-09-12T00:18:26.864536+0000","last_unstale":"2024-09-12T01:00:57.531105+0000","last_undegraded":"2024-09-12T01:00:57.531105+0000","last_fullsized":"2024-09-12T01:00:57.531105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:55.926276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'332","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.720502+0000","last_change":"2024-09-12T00:18:28.885849+0000","last_active":"2024-09-12T01:04:31.720502+0000","last_peered":"2024-09-12T01:04:31.720502+0000","last_clean":"2024-09-12T01:04:31.720502+0000","last_became_active":"2024-09-12T00:18:28.885152+0000","last_became_peered":"2024-09-12T00:18:28.885152+0000","last_unstale":"2024-09-12T01:04:31.720502+0000","last_undegraded":"2024-09-12T01:04:31.720502+0000","last_fullsized":"2024-09-12T01:04:31.720502+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:29.158839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62718,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":526,"num_read_kb":1016,"num_write":430,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":491,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:01.573124+0000","last_change":"2024-09-12T00:18:30.895751+0000","last_active":"2024-09-12T01:02:01.573124+0000","last_peered":"2024-09-12T01:02:01.573124+0000","last_clean":"2024-09-12T01:02:01.573124+0000","last_became_active":"2024-09-12T00:18:30.888974+0000","last_became_peered":"2024-09-12T00:18:30.888974+0000","last_unstale":"2024-09-12T01:02:01.573124+0000","last_undegraded":"2024-09-12T01:02:01.573124+0000","last_fullsized":"2024-09-12T01:02:01.573124+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:53.240426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'97","reported_seq":604,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.290751+0000","last_change":"2024-09-12T00:18:32.915634+0000","last_active":"2024-09-12T01:03:23.290751+0000","last_peered":"2024-09-12T01:03:23.290751+0000","last_clean":"2024-09-12T01:03:23.290751+0000","last_became_active":"2024-09-12T00:18:32.914994+0000","last_became_peered":"2024-09-12T00:18:32.914994+0000","last_unstale":"2024-09-12T01:03:23.290751+0000","last_undegraded":"2024-09-12T01:03:23.290751+0000","last_fullsized":"2024-09-12T01:03:23.290751+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:03.290807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":129,"num_write":234,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'858","reported_seq":2375,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.841192+0000","last_change":"2024-09-12T00:18:24.854861+0000","last_active":"2024-09-12T01:04:30.841192+0000","last_peered":"2024-09-12T01:04:30.841192+0000","last_clean":"2024-09-12T01:04:30.841192+0000","last_became_active":"2024-09-12T00:18:24.854089+0000","last_became_peered":"2024-09-12T00:18:24.854089+0000","last_unstale":"2024-09-12T01:04:30.841192+0000","last_undegraded":"2024-09-12T01:04:30.841192+0000","last_fullsized":"2024-09-12T01:04:30.841192+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":800,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:09.009238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4036,"num_read_kb":3617,"num_write":1169,"num_write_kb":474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'279","reported_seq":914,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.988464+0000","last_change":"2024-09-12T00:18:22.876376+0000","last_active":"2024-09-12T01:02:56.988464+0000","last_peered":"2024-09-12T01:02:56.988464+0000","last_clean":"2024-09-12T01:02:56.988464+0000","last_became_active":"2024-09-12T00:18:22.867744+0000","last_became_peered":"2024-09-12T00:18:22.867744+0000","last_unstale":"2024-09-12T01:02:56.988464+0000","last_undegraded":"2024-09-12T01:02:56.988464+0000","last_fullsized":"2024-09-12T01:02:56.988464+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:17.533748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1050382,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":454,"num_read_kb":9523,"num_write":1132,"num_write_kb":17845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.735193+0000","last_change":"2024-09-12T00:18:26.858490+0000","last_active":"2024-09-12T01:00:57.735193+0000","last_peered":"2024-09-12T01:00:57.735193+0000","last_clean":"2024-09-12T01:00:57.735193+0000","last_became_active":"2024-09-12T00:18:26.857810+0000","last_became_peered":"2024-09-12T00:18:26.857810+0000","last_unstale":"2024-09-12T01:00:57.735193+0000","last_undegraded":"2024-09-12T01:00:57.735193+0000","last_fullsized":"2024-09-12T01:00:57.735193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:16.264419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'255","reported_seq":832,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.096997+0000","last_change":"2024-09-12T00:18:28.882323+0000","last_active":"2024-09-12T01:04:40.096997+0000","last_peered":"2024-09-12T01:04:40.096997+0000","last_clean":"2024-09-12T01:04:40.096997+0000","last_became_active":"2024-09-12T00:18:28.881556+0000","last_became_peered":"2024-09-12T00:18:28.881556+0000","last_unstale":"2024-09-12T01:04:40.096997+0000","last_undegraded":"2024-09-12T01:04:40.096997+0000","last_fullsized":"2024-09-12T01:04:40.096997+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:58.134241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48228,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":430,"num_read_kb":998,"num_write":346,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:07.730322+0000","last_change":"2024-09-12T00:18:30.902376+0000","last_active":"2024-09-12T01:02:07.730322+0000","last_peered":"2024-09-12T01:02:07.730322+0000","last_clean":"2024-09-12T01:02:07.730322+0000","last_became_active":"2024-09-12T00:18:30.898539+0000","last_became_peered":"2024-09-12T00:18:30.898539+0000","last_unstale":"2024-09-12T01:02:07.730322+0000","last_undegraded":"2024-09-12T01:02:07.730322+0000","last_fullsized":"2024-09-12T01:02:07.730322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:18.476695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'110","reported_seq":637,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.199453+0000","last_change":"2024-09-12T00:18:32.908261+0000","last_active":"2024-09-12T01:03:08.199453+0000","last_peered":"2024-09-12T01:03:08.199453+0000","last_clean":"2024-09-12T01:03:08.199453+0000","last_became_active":"2024-09-12T00:18:32.907530+0000","last_became_peered":"2024-09-12T00:18:32.907530+0000","last_unstale":"2024-09-12T01:03:08.199453+0000","last_undegraded":"2024-09-12T01:03:08.199453+0000","last_fullsized":"2024-09-12T01:03:08.199453+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:37.368919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":167,"num_read_kb":160,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'364","reported_seq":1689,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.349766+0000","last_change":"2024-09-12T00:18:24.842626+0000","last_active":"2024-09-12T01:03:10.349766+0000","last_peered":"2024-09-12T01:03:10.349766+0000","last_clean":"2024-09-12T01:03:10.349766+0000","last_became_active":"2024-09-12T00:18:24.842263+0000","last_became_peered":"2024-09-12T00:18:24.842263+0000","last_unstale":"2024-09-12T01:03:10.349766+0000","last_undegraded":"2024-09-12T01:03:10.349766+0000","last_fullsized":"2024-09-12T01:03:10.349766+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:07.799244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1879,"num_read_kb":1766,"num_write":437,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'428","reported_seq":1202,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.117266+0000","last_change":"2024-09-12T00:18:22.837822+0000","last_active":"2024-09-12T01:04:40.117266+0000","last_peered":"2024-09-12T01:04:40.117266+0000","last_clean":"2024-09-12T01:04:40.117266+0000","last_became_active":"2024-09-12T00:18:22.837412+0000","last_became_peered":"2024-09-12T00:18:22.837412+0000","last_unstale":"2024-09-12T01:04:40.117266+0000","last_undegraded":"2024-09-12T01:04:40.117266+0000","last_fullsized":"2024-09-12T01:04:40.117266+0000","mapping_epoch":24,"log_start":"268'400","ondisk_log_start":"268'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:41.073377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5614631,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":898,"num_read_kb":48874,"num_write":1334,"num_write_kb":53147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.546076+0000","last_change":"2024-09-12T00:18:26.869821+0000","last_active":"2024-09-12T01:01:57.546076+0000","last_peered":"2024-09-12T01:01:57.546076+0000","last_clean":"2024-09-12T01:01:57.546076+0000","last_became_active":"2024-09-12T00:18:26.868407+0000","last_became_peered":"2024-09-12T00:18:26.868407+0000","last_unstale":"2024-09-12T01:01:57.546076+0000","last_undegraded":"2024-09-12T01:01:57.546076+0000","last_fullsized":"2024-09-12T01:01:57.546076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:11.537097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'267","reported_seq":839,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.712285+0000","last_change":"2024-09-12T00:18:28.896471+0000","last_active":"2024-09-12T01:04:39.712285+0000","last_peered":"2024-09-12T01:04:39.712285+0000","last_clean":"2024-09-12T01:04:39.712285+0000","last_became_active":"2024-09-12T00:18:28.895848+0000","last_became_peered":"2024-09-12T00:18:28.895848+0000","last_unstale":"2024-09-12T01:04:39.712285+0000","last_undegraded":"2024-09-12T01:04:39.712285+0000","last_fullsized":"2024-09-12T01:04:39.712285+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:11.864170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53006,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":433,"num_read_kb":1065,"num_write":360,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":494,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.533540+0000","last_change":"2024-09-12T00:18:30.893385+0000","last_active":"2024-09-12T01:01:02.533540+0000","last_peered":"2024-09-12T01:01:02.533540+0000","last_clean":"2024-09-12T01:01:02.533540+0000","last_became_active":"2024-09-12T00:18:30.892682+0000","last_became_peered":"2024-09-12T00:18:30.892682+0000","last_unstale":"2024-09-12T01:01:02.533540+0000","last_undegraded":"2024-09-12T01:01:02.533540+0000","last_fullsized":"2024-09-12T01:01:02.533540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:03.256684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'208","reported_seq":1695,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.225211+0000","last_change":"2024-09-12T00:18:32.911619+0000","last_active":"2024-09-12T01:03:23.225211+0000","last_peered":"2024-09-12T01:03:23.225211+0000","last_clean":"2024-09-12T01:03:23.225211+0000","last_became_active":"2024-09-12T00:18:32.911082+0000","last_became_peered":"2024-09-12T00:18:32.911082+0000","last_unstale":"2024-09-12T01:03:23.225211+0000","last_undegraded":"2024-09-12T01:03:23.225211+0000","last_fullsized":"2024-09-12T01:03:23.225211+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:46.062158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1287,"num_read_kb":1263,"num_write":482,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'525","reported_seq":2115,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.829396+0000","last_change":"2024-09-12T00:18:24.881623+0000","last_active":"2024-09-12T01:04:30.829396+0000","last_peered":"2024-09-12T01:04:30.829396+0000","last_clean":"2024-09-12T01:04:30.829396+0000","last_became_active":"2024-09-12T00:18:24.881029+0000","last_became_peered":"2024-09-12T00:18:24.881029+0000","last_unstale":"2024-09-12T01:04:30.829396+0000","last_undegraded":"2024-09-12T01:04:30.829396+0000","last_fullsized":"2024-09-12T01:04:30.829396+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:53.918281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2735,"num_read_kb":2532,"num_write":658,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'392","reported_seq":1098,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.113293+0000","last_change":"2024-09-12T00:18:22.864476+0000","last_active":"2024-09-12T01:04:40.113293+0000","last_peered":"2024-09-12T01:04:40.113293+0000","last_clean":"2024-09-12T01:04:40.113293+0000","last_became_active":"2024-09-12T00:18:22.863907+0000","last_became_peered":"2024-09-12T00:18:22.863907+0000","last_unstale":"2024-09-12T01:04:40.113293+0000","last_undegraded":"2024-09-12T01:04:40.113293+0000","last_fullsized":"2024-09-12T01:04:40.113293+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:45.526909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1987000,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":643,"num_read_kb":24608,"num_write":1249,"num_write_kb":29666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:06.553634+0000","last_change":"2024-09-12T00:18:26.867344+0000","last_active":"2024-09-12T01:02:06.553634+0000","last_peered":"2024-09-12T01:02:06.553634+0000","last_clean":"2024-09-12T01:02:06.553634+0000","last_became_active":"2024-09-12T00:18:26.866967+0000","last_became_peered":"2024-09-12T00:18:26.866967+0000","last_unstale":"2024-09-12T01:02:06.553634+0000","last_undegraded":"2024-09-12T01:02:06.553634+0000","last_fullsized":"2024-09-12T01:02:06.553634+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:36.323953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'304","reported_seq":901,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:32.569512+0000","last_change":"2024-09-12T00:18:28.898664+0000","last_active":"2024-09-12T01:03:32.569512+0000","last_peered":"2024-09-12T01:03:32.569512+0000","last_clean":"2024-09-12T01:03:32.569512+0000","last_became_active":"2024-09-12T00:18:28.897709+0000","last_became_peered":"2024-09-12T00:18:28.897709+0000","last_unstale":"2024-09-12T01:03:32.569512+0000","last_undegraded":"2024-09-12T01:03:32.569512+0000","last_fullsized":"2024-09-12T01:03:32.569512+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:21.269051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63713,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":512,"num_read_kb":1035,"num_write":416,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":490,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:01.554976+0000","last_change":"2024-09-12T00:18:30.898241+0000","last_active":"2024-09-12T01:01:01.554976+0000","last_peered":"2024-09-12T01:01:01.554976+0000","last_clean":"2024-09-12T01:01:01.554976+0000","last_became_active":"2024-09-12T00:18:30.889179+0000","last_became_peered":"2024-09-12T00:18:30.889179+0000","last_unstale":"2024-09-12T01:01:01.554976+0000","last_undegraded":"2024-09-12T01:01:01.554976+0000","last_fullsized":"2024-09-12T01:01:01.554976+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:34.242145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'191","reported_seq":755,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.817447+0000","last_change":"2024-09-12T00:18:32.908462+0000","last_active":"2024-09-12T01:04:30.817447+0000","last_peered":"2024-09-12T01:04:30.817447+0000","last_clean":"2024-09-12T01:04:30.817447+0000","last_became_active":"2024-09-12T00:18:32.907658+0000","last_became_peered":"2024-09-12T00:18:32.907658+0000","last_unstale":"2024-09-12T01:04:30.817447+0000","last_undegraded":"2024-09-12T01:04:30.817447+0000","last_fullsized":"2024-09-12T01:04:30.817447+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:03.641123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":435,"num_read_kb":358,"num_write":481,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'411","reported_seq":1911,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.825050+0000","last_change":"2024-09-12T00:18:24.878945+0000","last_active":"2024-09-12T01:04:30.825050+0000","last_peered":"2024-09-12T01:04:30.825050+0000","last_clean":"2024-09-12T01:04:30.825050+0000","last_became_active":"2024-09-12T00:18:24.878522+0000","last_became_peered":"2024-09-12T00:18:24.878522+0000","last_unstale":"2024-09-12T01:04:30.825050+0000","last_undegraded":"2024-09-12T01:04:30.825050+0000","last_fullsized":"2024-09-12T01:04:30.825050+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:42.239984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2233,"num_read_kb":2110,"num_write":497,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'312","reported_seq":979,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.623973+0000","last_change":"2024-09-12T00:18:22.853126+0000","last_active":"2024-09-12T01:03:00.623973+0000","last_peered":"2024-09-12T01:03:00.623973+0000","last_clean":"2024-09-12T01:03:00.623973+0000","last_became_active":"2024-09-12T00:18:22.851554+0000","last_became_peered":"2024-09-12T00:18:22.851554+0000","last_unstale":"2024-09-12T01:03:00.623973+0000","last_undegraded":"2024-09-12T01:03:00.623973+0000","last_fullsized":"2024-09-12T01:03:00.623973+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:48.723489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5569392,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":502,"num_read_kb":70445,"num_write":1073,"num_write_kb":38293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"268'1219","reported_seq":2832,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.908340+0000","last_change":"2024-09-12T00:18:24.857511+0000","last_active":"2024-09-12T01:02:46.908340+0000","last_peered":"2024-09-12T01:02:46.908340+0000","last_clean":"2024-09-12T01:02:46.908340+0000","last_became_active":"2024-09-12T00:18:24.857107+0000","last_became_peered":"2024-09-12T00:18:24.857107+0000","last_unstale":"2024-09-12T01:02:46.908340+0000","last_undegraded":"2024-09-12T01:02:46.908340+0000","last_fullsized":"2024-09-12T01:02:46.908340+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":1200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:46.479301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5568,"num_read_kb":4913,"num_write":1657,"num_write_kb":681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"268'361","reported_seq":1012,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.116826+0000","last_change":"2024-09-12T00:18:56.194536+0000","last_active":"2024-09-12T01:04:40.116826+0000","last_peered":"2024-09-12T01:04:40.116826+0000","last_clean":"2024-09-12T01:04:40.116826+0000","last_became_active":"2024-09-12T00:18:56.193721+0000","last_became_peered":"2024-09-12T00:18:56.193721+0000","last_unstale":"2024-09-12T01:04:40.116826+0000","last_undegraded":"2024-09-12T01:04:40.116826+0000","last_fullsized":"2024-09-12T01:04:40.116826+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:45.173064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342105,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":474,"num_read_kb":19261,"num_write":1030,"num_write_kb":26595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'860","reported_seq":2457,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.120737+0000","last_change":"2024-09-12T00:18:24.871814+0000","last_active":"2024-09-12T01:03:25.120737+0000","last_peered":"2024-09-12T01:03:25.120737+0000","last_clean":"2024-09-12T01:03:25.120737+0000","last_became_active":"2024-09-12T00:18:24.870288+0000","last_became_peered":"2024-09-12T00:18:24.870288+0000","last_unstale":"2024-09-12T01:03:25.120737+0000","last_undegraded":"2024-09-12T01:03:25.120737+0000","last_fullsized":"2024-09-12T01:03:25.120737+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":800,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:41.437287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4146,"num_read_kb":3713,"num_write":1130,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'328","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:22.248499+0000","last_change":"2024-09-12T00:18:22.872673+0000","last_active":"2024-09-12T01:03:22.248499+0000","last_peered":"2024-09-12T01:03:22.248499+0000","last_clean":"2024-09-12T01:03:22.248499+0000","last_became_active":"2024-09-12T00:18:22.866341+0000","last_became_peered":"2024-09-12T00:18:22.866341+0000","last_unstale":"2024-09-12T01:03:22.248499+0000","last_undegraded":"2024-09-12T01:03:22.248499+0000","last_fullsized":"2024-09-12T01:03:22.248499+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:24.768958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22504054,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":396,"num_read_kb":25322,"num_write":1082,"num_write_kb":64729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'397","reported_seq":1894,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.440536+0000","last_change":"2024-09-12T00:18:24.866032+0000","last_active":"2024-09-12T01:03:09.440536+0000","last_peered":"2024-09-12T01:03:09.440536+0000","last_clean":"2024-09-12T01:03:09.440536+0000","last_became_active":"2024-09-12T00:18:24.865674+0000","last_became_peered":"2024-09-12T00:18:24.865674+0000","last_unstale":"2024-09-12T01:03:09.440536+0000","last_undegraded":"2024-09-12T01:03:09.440536+0000","last_fullsized":"2024-09-12T01:03:09.440536+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:58.235628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2040,"num_read_kb":1953,"num_write":432,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'341","reported_seq":1086,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.104940+0000","last_change":"2024-09-12T00:18:22.844535+0000","last_active":"2024-09-12T01:04:40.104940+0000","last_peered":"2024-09-12T01:04:40.104940+0000","last_clean":"2024-09-12T01:04:40.104940+0000","last_became_active":"2024-09-12T00:18:22.844095+0000","last_became_peered":"2024-09-12T00:18:22.844095+0000","last_unstale":"2024-09-12T01:04:40.104940+0000","last_undegraded":"2024-09-12T01:04:40.104940+0000","last_fullsized":"2024-09-12T01:04:40.104940+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:23.543074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":305939,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":760,"num_read_kb":58308,"num_write":997,"num_write_kb":25022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"268'383","reported_seq":1843,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.346854+0000","last_change":"2024-09-12T00:18:24.866012+0000","last_active":"2024-09-12T01:03:37.346854+0000","last_peered":"2024-09-12T01:03:37.346854+0000","last_clean":"2024-09-12T01:03:37.346854+0000","last_became_active":"2024-09-12T00:18:24.865720+0000","last_became_peered":"2024-09-12T00:18:24.865720+0000","last_unstale":"2024-09-12T01:03:37.346854+0000","last_undegraded":"2024-09-12T01:03:37.346854+0000","last_fullsized":"2024-09-12T01:03:37.346854+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:30.348388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2058,"num_read_kb":1953,"num_write":433,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'375","reported_seq":1050,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.107806+0000","last_change":"2024-09-12T00:18:22.858174+0000","last_active":"2024-09-12T01:04:40.107806+0000","last_peered":"2024-09-12T01:04:40.107806+0000","last_clean":"2024-09-12T01:04:40.107806+0000","last_became_active":"2024-09-12T00:18:22.857896+0000","last_became_peered":"2024-09-12T00:18:22.857896+0000","last_unstale":"2024-09-12T01:04:40.107806+0000","last_undegraded":"2024-09-12T01:04:40.107806+0000","last_fullsized":"2024-09-12T01:04:40.107806+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:35.667728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456478,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":576,"num_read_kb":17790,"num_write":1194,"num_write_kb":44407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'440","reported_seq":2170,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.192270+0000","last_change":"2024-09-12T00:18:24.867735+0000","last_active":"2024-09-12T01:03:11.192270+0000","last_peered":"2024-09-12T01:03:11.192270+0000","last_clean":"2024-09-12T01:03:11.192270+0000","last_became_active":"2024-09-12T00:18:24.866980+0000","last_became_peered":"2024-09-12T00:18:24.866980+0000","last_unstale":"2024-09-12T01:03:11.192270+0000","last_undegraded":"2024-09-12T01:03:11.192270+0000","last_fullsized":"2024-09-12T01:03:11.192270+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:25.227858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2639,"num_read_kb":2518,"num_write":497,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'319","reported_seq":977,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.105368+0000","last_change":"2024-09-12T00:18:22.847482+0000","last_active":"2024-09-12T01:04:40.105368+0000","last_peered":"2024-09-12T01:04:40.105368+0000","last_clean":"2024-09-12T01:04:40.105368+0000","last_became_active":"2024-09-12T00:18:22.846805+0000","last_became_peered":"2024-09-12T00:18:22.846805+0000","last_unstale":"2024-09-12T01:04:40.105368+0000","last_undegraded":"2024-09-12T01:04:40.105368+0000","last_fullsized":"2024-09-12T01:04:40.105368+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:38.931220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":456,"num_read_kb":82569,"num_write":1071,"num_write_kb":46093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'467","reported_seq":2006,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.119546+0000","last_change":"2024-09-12T00:18:24.862315+0000","last_active":"2024-09-12T01:03:25.119546+0000","last_peered":"2024-09-12T01:03:25.119546+0000","last_clean":"2024-09-12T01:03:25.119546+0000","last_became_active":"2024-09-12T00:18:24.862022+0000","last_became_peered":"2024-09-12T00:18:24.862022+0000","last_unstale":"2024-09-12T01:03:25.119546+0000","last_undegraded":"2024-09-12T01:03:25.119546+0000","last_fullsized":"2024-09-12T01:03:25.119546+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:31.362187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2433,"num_read_kb":2274,"num_write":552,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'281","reported_seq":905,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.869611+0000","last_change":"2024-09-12T00:18:22.872677+0000","last_active":"2024-09-12T01:02:47.869611+0000","last_peered":"2024-09-12T01:02:47.869611+0000","last_clean":"2024-09-12T01:02:47.869611+0000","last_became_active":"2024-09-12T00:18:22.871980+0000","last_became_peered":"2024-09-12T00:18:22.871980+0000","last_unstale":"2024-09-12T01:02:47.869611+0000","last_undegraded":"2024-09-12T01:02:47.869611+0000","last_fullsized":"2024-09-12T01:02:47.869611+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:06.765741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6571929,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":404,"num_read_kb":12975,"num_write":1053,"num_write_kb":44636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'438","reported_seq":2028,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.704380+0000","last_change":"2024-09-12T00:18:24.865050+0000","last_active":"2024-09-12T01:03:20.704380+0000","last_peered":"2024-09-12T01:03:20.704380+0000","last_clean":"2024-09-12T01:03:20.704380+0000","last_became_active":"2024-09-12T00:18:24.857010+0000","last_became_peered":"2024-09-12T00:18:24.857010+0000","last_unstale":"2024-09-12T01:03:20.704380+0000","last_undegraded":"2024-09-12T01:03:20.704380+0000","last_fullsized":"2024-09-12T01:03:20.704380+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:11.724243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2477,"num_read_kb":2332,"num_write":519,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'372","reported_seq":1000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.126270+0000","last_change":"2024-09-12T00:18:22.857829+0000","last_active":"2024-09-12T01:04:40.126270+0000","last_peered":"2024-09-12T01:04:40.126270+0000","last_clean":"2024-09-12T01:04:40.126270+0000","last_became_active":"2024-09-12T00:18:22.857468+0000","last_became_peered":"2024-09-12T00:18:22.857468+0000","last_unstale":"2024-09-12T01:04:40.126270+0000","last_undegraded":"2024-09-12T01:04:40.126270+0000","last_fullsized":"2024-09-12T01:04:40.126270+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:27.114391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375108,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":489,"num_read_kb":4433,"num_write":1123,"num_write_kb":23710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"268'835","reported_seq":2445,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.175301+0000","last_change":"2024-09-12T00:18:24.857824+0000","last_active":"2024-09-12T01:03:11.175301+0000","last_peered":"2024-09-12T01:03:11.175301+0000","last_clean":"2024-09-12T01:03:11.175301+0000","last_became_active":"2024-09-12T00:18:24.857438+0000","last_became_peered":"2024-09-12T00:18:24.857438+0000","last_unstale":"2024-09-12T01:03:11.175301+0000","last_undegraded":"2024-09-12T01:03:11.175301+0000","last_fullsized":"2024-09-12T01:03:11.175301+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:33.071795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3858,"num_read_kb":3490,"num_write":1078,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'306","reported_seq":921,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.895781+0000","last_change":"2024-09-12T00:18:22.859579+0000","last_active":"2024-09-12T01:03:21.895781+0000","last_peered":"2024-09-12T01:03:21.895781+0000","last_clean":"2024-09-12T01:03:21.895781+0000","last_became_active":"2024-09-12T00:18:22.858851+0000","last_became_peered":"2024-09-12T00:18:22.858851+0000","last_unstale":"2024-09-12T01:03:21.895781+0000","last_undegraded":"2024-09-12T01:03:21.895781+0000","last_fullsized":"2024-09-12T01:03:21.895781+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:42.545358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10694505,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":405,"num_read_kb":6076,"num_write":1027,"num_write_kb":43198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'1186","reported_seq":2695,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.865689+0000","last_change":"2024-09-12T00:18:24.858035+0000","last_active":"2024-09-12T01:03:25.865689+0000","last_peered":"2024-09-12T01:03:25.865689+0000","last_clean":"2024-09-12T01:03:25.865689+0000","last_became_active":"2024-09-12T00:18:24.856121+0000","last_became_peered":"2024-09-12T00:18:24.856121+0000","last_unstale":"2024-09-12T01:03:25.865689+0000","last_undegraded":"2024-09-12T01:03:25.865689+0000","last_fullsized":"2024-09-12T01:03:25.865689+0000","mapping_epoch":26,"log_start":"268'1100","ondisk_log_start":"268'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":1100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:36.093783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5211,"num_read_kb":4574,"num_write":1611,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'356","reported_seq":1103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.114782+0000","last_change":"2024-09-12T00:18:22.858631+0000","last_active":"2024-09-12T01:04:40.114782+0000","last_peered":"2024-09-12T01:04:40.114782+0000","last_clean":"2024-09-12T01:04:40.114782+0000","last_became_active":"2024-09-12T00:18:22.857806+0000","last_became_peered":"2024-09-12T00:18:22.857806+0000","last_unstale":"2024-09-12T01:04:40.114782+0000","last_undegraded":"2024-09-12T01:04:40.114782+0000","last_fullsized":"2024-09-12T01:04:40.114782+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:33.277291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":676,"num_read_kb":44063,"num_write":1212,"num_write_kb":47646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"268'824","reported_seq":2369,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.350086+0000","last_change":"2024-09-12T00:18:24.856950+0000","last_active":"2024-09-12T01:03:10.350086+0000","last_peered":"2024-09-12T01:03:10.350086+0000","last_clean":"2024-09-12T01:03:10.350086+0000","last_became_active":"2024-09-12T00:18:24.856616+0000","last_became_peered":"2024-09-12T00:18:24.856616+0000","last_unstale":"2024-09-12T01:03:10.350086+0000","last_undegraded":"2024-09-12T01:03:10.350086+0000","last_fullsized":"2024-09-12T01:03:10.350086+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:56.988343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3862,"num_read_kb":3471,"num_write":1076,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'313","reported_seq":1084,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.191500+0000","last_change":"2024-09-12T00:18:22.874720+0000","last_active":"2024-09-12T01:02:55.191500+0000","last_peered":"2024-09-12T01:02:55.191500+0000","last_clean":"2024-09-12T01:02:55.191500+0000","last_became_active":"2024-09-12T00:18:22.873756+0000","last_became_peered":"2024-09-12T00:18:22.873756+0000","last_unstale":"2024-09-12T01:02:55.191500+0000","last_undegraded":"2024-09-12T01:02:55.191500+0000","last_fullsized":"2024-09-12T01:02:55.191500+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:18.449548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8958017,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":835,"num_read_kb":25126,"num_write":1201,"num_write_kb":39639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'1580","reported_seq":3271,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.439933+0000","last_change":"2024-09-12T00:18:24.883740+0000","last_active":"2024-09-12T01:03:09.439933+0000","last_peered":"2024-09-12T01:03:09.439933+0000","last_clean":"2024-09-12T01:03:09.439933+0000","last_became_active":"2024-09-12T00:18:24.882937+0000","last_became_peered":"2024-09-12T00:18:24.882937+0000","last_unstale":"2024-09-12T01:03:09.439933+0000","last_undegraded":"2024-09-12T01:03:09.439933+0000","last_fullsized":"2024-09-12T01:03:09.439933+0000","mapping_epoch":26,"log_start":"268'1500","ondisk_log_start":"268'1500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":1500,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:22.907432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7111,"num_read_kb":6230,"num_write":2206,"num_write_kb":938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'433","reported_seq":1163,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.138510+0000","last_change":"2024-09-12T00:18:22.869861+0000","last_active":"2024-09-12T01:04:40.138510+0000","last_peered":"2024-09-12T01:04:40.138510+0000","last_clean":"2024-09-12T01:04:40.138510+0000","last_became_active":"2024-09-12T00:18:22.869527+0000","last_became_peered":"2024-09-12T00:18:22.869527+0000","last_unstale":"2024-09-12T01:04:40.138510+0000","last_undegraded":"2024-09-12T01:04:40.138510+0000","last_fullsized":"2024-09-12T01:04:40.138510+0000","mapping_epoch":24,"log_start":"268'400","ondisk_log_start":"268'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:28.494266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262232,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":772,"num_read_kb":72891,"num_write":1443,"num_write_kb":29040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'772","reported_seq":2178,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.702907+0000","last_change":"2024-09-12T00:18:24.866786+0000","last_active":"2024-09-12T01:03:20.702907+0000","last_peered":"2024-09-12T01:03:20.702907+0000","last_clean":"2024-09-12T01:03:20.702907+0000","last_became_active":"2024-09-12T00:18:24.866062+0000","last_became_peered":"2024-09-12T00:18:24.866062+0000","last_unstale":"2024-09-12T01:03:20.702907+0000","last_undegraded":"2024-09-12T01:03:20.702907+0000","last_fullsized":"2024-09-12T01:03:20.702907+0000","mapping_epoch":26,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:41.456955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3587,"num_read_kb":3210,"num_write":1032,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'315","reported_seq":996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:21.098923+0000","last_change":"2024-09-12T00:18:22.858952+0000","last_active":"2024-09-12T01:04:21.098923+0000","last_peered":"2024-09-12T01:04:21.098923+0000","last_clean":"2024-09-12T01:04:21.098923+0000","last_became_active":"2024-09-12T00:18:22.858141+0000","last_became_peered":"2024-09-12T00:18:22.858141+0000","last_unstale":"2024-09-12T01:04:21.098923+0000","last_undegraded":"2024-09-12T01:04:21.098923+0000","last_fullsized":"2024-09-12T01:04:21.098923+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:25.792326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389308,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":591,"num_read_kb":25195,"num_write":1293,"num_write_kb":34646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'1217","reported_seq":3118,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.594177+0000","last_change":"2024-09-12T00:18:24.860271+0000","last_active":"2024-09-12T01:03:26.594177+0000","last_peered":"2024-09-12T01:03:26.594177+0000","last_clean":"2024-09-12T01:03:26.594177+0000","last_became_active":"2024-09-12T00:18:24.859973+0000","last_became_peered":"2024-09-12T00:18:24.859973+0000","last_unstale":"2024-09-12T01:03:26.594177+0000","last_undegraded":"2024-09-12T01:03:26.594177+0000","last_fullsized":"2024-09-12T01:03:26.594177+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":1200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:18.330323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5984,"num_read_kb":5306,"num_write":1779,"num_write_kb":823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'355","reported_seq":981,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.120893+0000","last_change":"2024-09-12T00:18:55.952101+0000","last_active":"2024-09-12T01:04:40.120893+0000","last_peered":"2024-09-12T01:04:40.120893+0000","last_clean":"2024-09-12T01:04:40.120893+0000","last_became_active":"2024-09-12T00:18:55.951826+0000","last_became_peered":"2024-09-12T00:18:55.951826+0000","last_unstale":"2024-09-12T01:04:40.120893+0000","last_undegraded":"2024-09-12T01:04:40.120893+0000","last_fullsized":"2024-09-12T01:04:40.120893+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:47.686652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":11605,"num_write":1081,"num_write_kb":32221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"268'537","reported_seq":2005,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.346854+0000","last_change":"2024-09-12T00:18:24.849840+0000","last_active":"2024-09-12T01:03:37.346854+0000","last_peered":"2024-09-12T01:03:37.346854+0000","last_clean":"2024-09-12T01:03:37.346854+0000","last_became_active":"2024-09-12T00:18:24.849540+0000","last_became_peered":"2024-09-12T00:18:24.849540+0000","last_unstale":"2024-09-12T01:03:37.346854+0000","last_undegraded":"2024-09-12T01:03:37.346854+0000","last_fullsized":"2024-09-12T01:03:37.346854+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:12.695354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2717,"num_read_kb":2465,"num_write":714,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'358","reported_seq":1052,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.062994+0000","last_change":"2024-09-12T00:18:22.834810+0000","last_active":"2024-09-12T01:04:40.062994+0000","last_peered":"2024-09-12T01:04:40.062994+0000","last_clean":"2024-09-12T01:04:40.062994+0000","last_became_active":"2024-09-12T00:18:22.834527+0000","last_became_peered":"2024-09-12T00:18:22.834527+0000","last_unstale":"2024-09-12T01:04:40.062994+0000","last_undegraded":"2024-09-12T01:04:40.062994+0000","last_fullsized":"2024-09-12T01:04:40.062994+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:49.103125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":663,"num_read_kb":13548,"num_write":1359,"num_write_kb":27172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'350","reported_seq":1704,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.704302+0000","last_change":"2024-09-12T00:18:24.871103+0000","last_active":"2024-09-12T01:03:20.704302+0000","last_peered":"2024-09-12T01:03:20.704302+0000","last_clean":"2024-09-12T01:03:20.704302+0000","last_became_active":"2024-09-12T00:18:24.870016+0000","last_became_peered":"2024-09-12T00:18:24.870016+0000","last_unstale":"2024-09-12T01:03:20.704302+0000","last_undegraded":"2024-09-12T01:03:20.704302+0000","last_fullsized":"2024-09-12T01:03:20.704302+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:57.415861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1783,"num_read_kb":1704,"num_write":384,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'275","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.548016+0000","last_change":"2024-09-12T00:18:22.883934+0000","last_active":"2024-09-12T01:02:53.548016+0000","last_peered":"2024-09-12T01:02:53.548016+0000","last_clean":"2024-09-12T01:02:53.548016+0000","last_became_active":"2024-09-12T00:18:22.883246+0000","last_became_peered":"2024-09-12T00:18:22.883246+0000","last_unstale":"2024-09-12T01:02:53.548016+0000","last_undegraded":"2024-09-12T01:02:53.548016+0000","last_fullsized":"2024-09-12T01:02:53.548016+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:32.140402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10133923,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":445,"num_read_kb":42045,"num_write":1046,"num_write_kb":34022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'308","reported_seq":975,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:37.707227+0000","last_change":"2024-09-12T00:18:22.857851+0000","last_active":"2024-09-12T01:01:37.707227+0000","last_peered":"2024-09-12T01:01:37.707227+0000","last_clean":"2024-09-12T01:01:37.707227+0000","last_became_active":"2024-09-12T00:18:22.857072+0000","last_became_peered":"2024-09-12T00:18:22.857072+0000","last_unstale":"2024-09-12T01:01:37.707227+0000","last_undegraded":"2024-09-12T01:01:37.707227+0000","last_fullsized":"2024-09-12T01:01:37.707227+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:08.141312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13407224,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":482,"num_read_kb":42639,"num_write":1182,"num_write_kb":40559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'475","reported_seq":2175,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.700952+0000","last_change":"2024-09-12T00:18:24.867195+0000","last_active":"2024-09-12T01:03:20.700952+0000","last_peered":"2024-09-12T01:03:20.700952+0000","last_clean":"2024-09-12T01:03:20.700952+0000","last_became_active":"2024-09-12T00:18:24.866883+0000","last_became_peered":"2024-09-12T00:18:24.866883+0000","last_unstale":"2024-09-12T01:03:20.700952+0000","last_undegraded":"2024-09-12T01:03:20.700952+0000","last_fullsized":"2024-09-12T01:03:20.700952+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:14.739354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2661,"num_read_kb":2525,"num_write":544,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'451","reported_seq":1178,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.091229+0000","last_change":"2024-09-12T00:18:22.858917+0000","last_active":"2024-09-12T01:04:40.091229+0000","last_peered":"2024-09-12T01:04:40.091229+0000","last_clean":"2024-09-12T01:04:40.091229+0000","last_became_active":"2024-09-12T00:18:22.858176+0000","last_became_peered":"2024-09-12T00:18:22.858176+0000","last_unstale":"2024-09-12T01:04:40.091229+0000","last_undegraded":"2024-09-12T01:04:40.091229+0000","last_fullsized":"2024-09-12T01:04:40.091229+0000","mapping_epoch":24,"log_start":"268'400","ondisk_log_start":"268'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:56.261213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493507,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":841,"num_read_kb":63084,"num_write":1253,"num_write_kb":30414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'807","reported_seq":2404,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.172100+0000","last_change":"2024-09-12T00:18:24.856340+0000","last_active":"2024-09-12T01:03:03.172100+0000","last_peered":"2024-09-12T01:03:03.172100+0000","last_clean":"2024-09-12T01:03:03.172100+0000","last_became_active":"2024-09-12T00:18:24.855524+0000","last_became_peered":"2024-09-12T00:18:24.855524+0000","last_unstale":"2024-09-12T01:03:03.172100+0000","last_undegraded":"2024-09-12T01:03:03.172100+0000","last_fullsized":"2024-09-12T01:03:03.172100+0000","mapping_epoch":26,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:08.775534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3793,"num_read_kb":3425,"num_write":1052,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6125,"num_read_kb":4422,"num_write":1992,"num_write_kb":889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":963,"ondisk_log_size":963,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15018,"num_read_kb":14677,"num_write":16721,"num_write_kb":4879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1955,"ondisk_log_size":1955,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":480,"ondisk_log_size":480,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1764774,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":17510,"num_read_kb":35186,"num_write":14703,"num_write_kb":11602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1859584,"data_stored":1439260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1948,"ondisk_log_size":1948,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2398,"num_read_kb":2859,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212220,"num_read_kb":193790,"num_write":55147,"num_write_kb":18721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3785,"ondisk_log_size":3785,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":324785264,"num_objects":2426,"num_object_clones":0,"num_object_copies":4852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2426,"num_whiteouts":0,"num_read":34197,"num_read_kb":1921498,"num_write":70178,"num_write_kb":2133559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":659472384,"data_stored":641654158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3697,"ondisk_log_size":3697,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":45088768,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":156,"num_read_kb":193499,"num_write":173,"num_write_kb":135054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79753216,"data_stored":79752145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":31457280,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":159,"num_read_kb":193436,"num_write":178,"num_write_kb":135054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":70320128,"data_stored":70318159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510005,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":458396,"kb_used_data":188428,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":93913444,"statfs":{"total":96636764160,"available":96167366656,"internally_reserved":0,"allocated":192950272,"data_stored":187084399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":276429258},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510004,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":375476,"kb_used_data":149924,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":93996364,"statfs":{"total":96636764160,"available":96252276736,"internally_reserved":0,"allocated":153522176,"data_stored":148408360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":230947273},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510004,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":337472,"kb_used_data":216112,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94034368,"statfs":{"total":96636764160,"available":96291192832,"internally_reserved":0,"allocated":221298688,"data_stored":215015112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510005,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255900,"kb_used_data":192780,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94115940,"statfs":{"total":96636764160,"available":96374722560,"internally_reserved":0,"allocated":197406720,"data_stored":191246398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542710,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284248,"kb_used_data":28020,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94087592,"statfs":{"total":96636764160,"available":96345694208,"internally_reserved":0,"allocated":28692480,"data_stored":26984275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":262207943},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542708,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93704,"kb_used_data":12600,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94278136,"statfs":{"total":96636764160,"available":96540811264,"internally_reserved":0,"allocated":12902400,"data_stored":11301467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542709,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148444,"kb_used_data":8904,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94223396,"statfs":{"total":96636764160,"available":96484757504,"internally_reserved":0,"allocated":9117696,"data_stored":7484684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542710,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255332,"kb_used_data":25620,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94116508,"statfs":{"total":96636764160,"available":96375304192,"internally_reserved":0,"allocated":26234880,"data_stored":24489485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21905408,"data_stored":21688322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5402624,"data_stored":5276127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9211904,"data_stored":9091208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24948736,"data_stored":24773620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":151691264,"data_stored":146999295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":168640512,"data_stored":164007630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":115916800,"data_stored":112330276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":161755136,"data_stored":157487680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":94065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":679936,"data_stored":563219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":254314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":626688,"data_stored":524224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":5044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":5163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17829888,"data_stored":17828990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13692928,"data_stored":13691857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24117248,"data_stored":24117248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17887232,"data_stored":17886161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:04:42.396 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:04:42.749 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:04:42.749 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":268,"fsid":"e3ab48df-9588-4a92-9a12-d24598e1ef6f","created":"2024-09-12T00:17:49.122127+0000","modified":"2024-09-12T00:46:10.465950+0000","last_up_change":"2024-09-12T00:18:01.528226+0000","last_in_change":"2024-09-12T00:17:51.433076+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":15,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:18:02.319323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:18:07.498192+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T00:18:21.602649+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T00:18:23.186740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T00:18:24.970491+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T00:18:26.967748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T00:18:28.904587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T00:18:31.041688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-12T00:33:08.937313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"257","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-12T00:34:50.435762+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"260","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-12T00:34:53.392260+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"263","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-12T00:46:08.390534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"268","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a01120fa-9861-4543-877e-1a479ec703c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":1864725413},{"type":"v1","addr":"172.21.15.43:6825","nonce":1864725413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":1864725413},{"type":"v1","addr":"172.21.15.43:6827","nonce":1864725413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":1864725413},{"type":"v1","addr":"172.21.15.43:6831","nonce":1864725413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1864725413},{"type":"v1","addr":"172.21.15.43:6829","nonce":1864725413}]},"public_addr":"172.21.15.43:6825/1864725413","cluster_addr":"172.21.15.43:6827/1864725413","heartbeat_back_addr":"172.21.15.43:6831/1864725413","heartbeat_front_addr":"172.21.15.43:6829/1864725413","state":["exists","up"]},{"osd":1,"uuid":"aee942ab-cc86-4a8c-b80c-1d3a62bed36a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1255554747},{"type":"v1","addr":"172.21.15.43:6801","nonce":1255554747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1255554747},{"type":"v1","addr":"172.21.15.43:6803","nonce":1255554747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1255554747},{"type":"v1","addr":"172.21.15.43:6807","nonce":1255554747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1255554747},{"type":"v1","addr":"172.21.15.43:6805","nonce":1255554747}]},"public_addr":"172.21.15.43:6801/1255554747","cluster_addr":"172.21.15.43:6803/1255554747","heartbeat_back_addr":"172.21.15.43:6807/1255554747","heartbeat_front_addr":"172.21.15.43:6805/1255554747","state":["exists","up"]},{"osd":2,"uuid":"f0001c93-a21f-4778-9e0d-334f4aea1884","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":653473197},{"type":"v1","addr":"172.21.15.43:6817","nonce":653473197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":653473197},{"type":"v1","addr":"172.21.15.43:6819","nonce":653473197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":653473197},{"type":"v1","addr":"172.21.15.43:6823","nonce":653473197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":653473197},{"type":"v1","addr":"172.21.15.43:6821","nonce":653473197}]},"public_addr":"172.21.15.43:6817/653473197","cluster_addr":"172.21.15.43:6819/653473197","heartbeat_back_addr":"172.21.15.43:6823/653473197","heartbeat_front_addr":"172.21.15.43:6821/653473197","state":["exists","up"]},{"osd":3,"uuid":"c1251384-55ec-4132-92bb-87191c36177e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2258408181},{"type":"v1","addr":"172.21.15.43:6809","nonce":2258408181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2258408181},{"type":"v1","addr":"172.21.15.43:6811","nonce":2258408181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2258408181},{"type":"v1","addr":"172.21.15.43:6815","nonce":2258408181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2258408181},{"type":"v1","addr":"172.21.15.43:6813","nonce":2258408181}]},"public_addr":"172.21.15.43:6809/2258408181","cluster_addr":"172.21.15.43:6811/2258408181","heartbeat_back_addr":"172.21.15.43:6815/2258408181","heartbeat_front_addr":"172.21.15.43:6813/2258408181","state":["exists","up"]},{"osd":4,"uuid":"46dcd344-ed56-48b7-94f6-47abf3c37949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1948010415},{"type":"v1","addr":"172.21.15.97:6825","nonce":1948010415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1948010415},{"type":"v1","addr":"172.21.15.97:6827","nonce":1948010415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1948010415},{"type":"v1","addr":"172.21.15.97:6831","nonce":1948010415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1948010415},{"type":"v1","addr":"172.21.15.97:6829","nonce":1948010415}]},"public_addr":"172.21.15.97:6825/1948010415","cluster_addr":"172.21.15.97:6827/1948010415","heartbeat_back_addr":"172.21.15.97:6831/1948010415","heartbeat_front_addr":"172.21.15.97:6829/1948010415","state":["exists","up"]},{"osd":5,"uuid":"95347c4a-6255-49c6-85b0-8cd94d161cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":838866664},{"type":"v1","addr":"172.21.15.97:6801","nonce":838866664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":838866664},{"type":"v1","addr":"172.21.15.97:6803","nonce":838866664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":838866664},{"type":"v1","addr":"172.21.15.97:6807","nonce":838866664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":838866664},{"type":"v1","addr":"172.21.15.97:6805","nonce":838866664}]},"public_addr":"172.21.15.97:6801/838866664","cluster_addr":"172.21.15.97:6803/838866664","heartbeat_back_addr":"172.21.15.97:6807/838866664","heartbeat_front_addr":"172.21.15.97:6805/838866664","state":["exists","up"]},{"osd":6,"uuid":"f7289693-3ded-4d19-923e-87dc0973c90e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":3829003147},{"type":"v1","addr":"172.21.15.97:6809","nonce":3829003147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3829003147},{"type":"v1","addr":"172.21.15.97:6811","nonce":3829003147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":3829003147},{"type":"v1","addr":"172.21.15.97:6815","nonce":3829003147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":3829003147},{"type":"v1","addr":"172.21.15.97:6813","nonce":3829003147}]},"public_addr":"172.21.15.97:6809/3829003147","cluster_addr":"172.21.15.97:6811/3829003147","heartbeat_back_addr":"172.21.15.97:6815/3829003147","heartbeat_front_addr":"172.21.15.97:6813/3829003147","state":["exists","up"]},{"osd":7,"uuid":"0ed72a4e-1fba-41f3-ab0c-9cbd0aa332a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":489545787},{"type":"v1","addr":"172.21.15.97:6817","nonce":489545787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":489545787},{"type":"v1","addr":"172.21.15.97:6819","nonce":489545787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":489545787},{"type":"v1","addr":"172.21.15.97:6823","nonce":489545787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":489545787},{"type":"v1","addr":"172.21.15.97:6821","nonce":489545787}]},"public_addr":"172.21.15.97:6817/489545787","cluster_addr":"172.21.15.97:6819/489545787","heartbeat_back_addr":"172.21.15.97:6823/489545787","heartbeat_front_addr":"172.21.15.97:6821/489545787","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:58.472344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:57.762123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:58.470680+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:58.032194+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:58.059331+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:57.950186+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:58.141069+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:17:57.909463+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.13","mappings":[{"from":4,"to":1}]},{"pgid":"3.15","mappings":[{"from":3,"to":6}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":6}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":1}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":5}]},{"pgid":"67.18","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:04:43.771 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T01:04:43.771 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:04:43.939 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T01:04:43.940 INFO:teuthology.orchestra.run.smithi043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:04:43.940 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T01:04:43.957 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T01:04:44.263 INFO:teuthology.orchestra.run.smithi043.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T01:04:44.283 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T01:04:44.283 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:04:44.422 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T01:04:44.422 INFO:teuthology.orchestra.run.smithi043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:04:44.422 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T01:04:44.437 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T01:04:44.737 INFO:teuthology.orchestra.run.smithi043.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T01:04:44.756 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T01:04:44.757 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:04:44.909 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T01:04:44.910 INFO:teuthology.orchestra.run.smithi043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:04:44.910 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T01:04:44.926 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T01:04:45.224 INFO:teuthology.orchestra.run.smithi043.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T01:04:45.243 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T01:04:45.243 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:04:45.385 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T01:04:45.385 INFO:teuthology.orchestra.run.smithi043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:04:45.385 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T01:04:45.400 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T01:04:45.696 INFO:teuthology.orchestra.run.smithi043.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T01:04:45.715 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T01:04:45.715 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:04:46.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-12T01:04:46.042+0000 7f04f9d9b640 0 --2- 172.21.15.43:0/1090979627 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f04fc0b1860 0x7f04fc145c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T01:04:46.069 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T01:04:46.069 INFO:teuthology.orchestra.run.smithi043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:04:46.069 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T01:04:46.086 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T01:04:46.389 INFO:teuthology.orchestra.run.smithi043.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T01:04:46.407 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T01:04:46.407 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:04:46.549 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T01:04:46.549 INFO:teuthology.orchestra.run.smithi043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:04:46.549 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T01:04:46.564 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T01:04:46.863 INFO:teuthology.orchestra.run.smithi043.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T01:04:46.883 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T01:04:46.883 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:04:47.039 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T01:04:47.039 INFO:teuthology.orchestra.run.smithi043.stdout: "success": "" 2024-09-12T01:04:47.039 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T01:04:47.055 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T01:04:47.366 INFO:teuthology.orchestra.run.smithi043.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T01:04:47.387 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T01:04:47.387 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:04:47.539 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-12T01:04:47.539 INFO:teuthology.orchestra.run.smithi043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:04:47.539 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-12T01:04:47.555 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T01:04:47.857 INFO:teuthology.orchestra.run.smithi043.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T01:04:47.877 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:04:48.239 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:04:48.252 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-12T01:04:48.259 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":1664,"stamp":"2024-09-12T01:04:48.037363+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":69570780,"num_objects":858,"num_object_clones":0,"num_object_copies":1716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":858,"num_whiteouts":0,"num_read":290173,"num_read_kb":2561350,"num_write":161440,"num_write_kb":2441443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13289,"ondisk_log_size":13289,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1584204,"kb_used_data":163064,"kb_used_omap":12,"kb_used_meta":1420851,"kb_avail":753390516,"statfs":{"total":773094113280,"available":771471888384,"internally_reserved":0,"allocated":166977536,"data_stored":153602420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1454951987},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-622362593,"num_objects":-4154,"num_object_clones":0,"num_object_copies":-8308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4154,"num_whiteouts":0,"num_read":4642,"num_read_kb":4162,"num_write":4409,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006877"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.738562+0000","last_change":"2024-09-12T00:46:09.507731+0000","last_active":"2024-09-12T01:01:12.738562+0000","last_peered":"2024-09-12T01:01:12.738562+0000","last_clean":"2024-09-12T01:01:12.738562+0000","last_became_active":"2024-09-12T00:46:09.506992+0000","last_became_peered":"2024-09-12T00:46:09.506992+0000","last_unstale":"2024-09-12T01:01:12.738562+0000","last_undegraded":"2024-09-12T01:01:12.738562+0000","last_fullsized":"2024-09-12T01:01:12.738562+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:58.022915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"265'8","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.721957+0000","last_change":"2024-09-12T00:34:55.237418+0000","last_active":"2024-09-12T00:59:57.721957+0000","last_peered":"2024-09-12T00:59:57.721957+0000","last_clean":"2024-09-12T00:59:57.721957+0000","last_became_active":"2024-09-12T00:34:55.236531+0000","last_became_peered":"2024-09-12T00:34:55.236531+0000","last_unstale":"2024-09-12T00:59:57.721957+0000","last_undegraded":"2024-09-12T00:59:57.721957+0000","last_fullsized":"2024-09-12T00:59:57.721957+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:18.916486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"268'4","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.718863+0000","last_change":"2024-09-12T00:34:52.172747+0000","last_active":"2024-09-12T01:04:39.718863+0000","last_peered":"2024-09-12T01:04:39.718863+0000","last_clean":"2024-09-12T01:04:39.718863+0000","last_became_active":"2024-09-12T00:34:52.171918+0000","last_became_peered":"2024-09-12T00:34:52.171918+0000","last_unstale":"2024-09-12T01:04:39.718863+0000","last_undegraded":"2024-09-12T01:04:39.718863+0000","last_fullsized":"2024-09-12T01:04:39.718863+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:15.468426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4100,"num_write":4,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'30","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.578508+0000","last_change":"2024-09-12T00:33:10.849736+0000","last_active":"2024-09-12T01:02:21.578508+0000","last_peered":"2024-09-12T01:02:21.578508+0000","last_clean":"2024-09-12T01:02:21.578508+0000","last_became_active":"2024-09-12T00:33:10.848975+0000","last_became_peered":"2024-09-12T00:33:10.848975+0000","last_unstale":"2024-09-12T01:02:21.578508+0000","last_undegraded":"2024-09-12T01:02:21.578508+0000","last_fullsized":"2024-09-12T01:02:21.578508+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:54.113531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":60,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:11.710587+0000","last_change":"2024-09-12T00:46:09.510162+0000","last_active":"2024-09-12T01:01:11.710587+0000","last_peered":"2024-09-12T01:01:11.710587+0000","last_clean":"2024-09-12T01:01:11.710587+0000","last_became_active":"2024-09-12T00:46:09.509800+0000","last_became_peered":"2024-09-12T00:46:09.509800+0000","last_unstale":"2024-09-12T01:01:11.710587+0000","last_undegraded":"2024-09-12T01:01:11.710587+0000","last_fullsized":"2024-09-12T01:01:11.710587+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:13.709511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'7","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:27.555326+0000","last_change":"2024-09-12T00:34:55.233869+0000","last_active":"2024-09-12T01:02:27.555326+0000","last_peered":"2024-09-12T01:02:27.555326+0000","last_clean":"2024-09-12T01:02:27.555326+0000","last_became_active":"2024-09-12T00:34:55.232607+0000","last_became_peered":"2024-09-12T00:34:55.232607+0000","last_unstale":"2024-09-12T01:02:27.555326+0000","last_undegraded":"2024-09-12T01:02:27.555326+0000","last_fullsized":"2024-09-12T01:02:27.555326+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:24.955277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"268'2","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.557575+0000","last_change":"2024-09-12T00:34:52.211653+0000","last_active":"2024-09-12T01:02:21.557575+0000","last_peered":"2024-09-12T01:02:21.557575+0000","last_clean":"2024-09-12T01:02:21.557575+0000","last_became_active":"2024-09-12T00:34:52.210935+0000","last_became_peered":"2024-09-12T00:34:52.210935+0000","last_unstale":"2024-09-12T01:02:21.557575+0000","last_undegraded":"2024-09-12T01:02:21.557575+0000","last_fullsized":"2024-09-12T01:02:21.557575+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:38.800194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'30","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:14.858026+0000","last_change":"2024-09-12T00:33:10.852168+0000","last_active":"2024-09-12T01:02:14.858026+0000","last_peered":"2024-09-12T01:02:14.858026+0000","last_clean":"2024-09-12T01:02:14.858026+0000","last_became_active":"2024-09-12T00:33:10.851334+0000","last_became_peered":"2024-09-12T00:33:10.851334+0000","last_unstale":"2024-09-12T01:02:14.858026+0000","last_undegraded":"2024-09-12T01:02:14.858026+0000","last_fullsized":"2024-09-12T01:02:14.858026+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:46.569072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":55,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:42.712847+0000","last_change":"2024-09-12T00:46:09.508043+0000","last_active":"2024-09-12T01:00:42.712847+0000","last_peered":"2024-09-12T01:00:42.712847+0000","last_clean":"2024-09-12T01:00:42.712847+0000","last_became_active":"2024-09-12T00:46:09.507324+0000","last_became_peered":"2024-09-12T00:46:09.507324+0000","last_unstale":"2024-09-12T01:00:42.712847+0000","last_undegraded":"2024-09-12T01:00:42.712847+0000","last_fullsized":"2024-09-12T01:00:42.712847+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:56.424671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"268'2","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:06.601735+0000","last_change":"2024-09-12T00:34:55.253609+0000","last_active":"2024-09-12T01:04:06.601735+0000","last_peered":"2024-09-12T01:04:06.601735+0000","last_clean":"2024-09-12T01:04:06.601735+0000","last_became_active":"2024-09-12T00:34:55.252880+0000","last_became_peered":"2024-09-12T00:34:55.252880+0000","last_unstale":"2024-09-12T01:04:06.601735+0000","last_undegraded":"2024-09-12T01:04:06.601735+0000","last_fullsized":"2024-09-12T01:04:06.601735+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:39.510072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"268'2","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.732077+0000","last_change":"2024-09-12T00:34:52.198542+0000","last_active":"2024-09-12T01:02:51.732077+0000","last_peered":"2024-09-12T01:02:51.732077+0000","last_clean":"2024-09-12T01:02:51.732077+0000","last_became_active":"2024-09-12T00:34:52.195513+0000","last_became_peered":"2024-09-12T00:34:52.195513+0000","last_unstale":"2024-09-12T01:02:51.732077+0000","last_undegraded":"2024-09-12T01:02:51.732077+0000","last_fullsized":"2024-09-12T01:02:51.732077+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:23.382695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'20","reported_seq":99,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.549669+0000","last_change":"2024-09-12T00:33:10.848259+0000","last_active":"2024-09-12T01:00:41.549669+0000","last_peered":"2024-09-12T01:00:41.549669+0000","last_clean":"2024-09-12T01:00:41.549669+0000","last_became_active":"2024-09-12T00:33:10.847432+0000","last_became_peered":"2024-09-12T00:33:10.847432+0000","last_unstale":"2024-09-12T01:00:41.549669+0000","last_undegraded":"2024-09-12T01:00:41.549669+0000","last_fullsized":"2024-09-12T01:00:41.549669+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:33.335638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":67,"num_write":46,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:46.737552+0000","last_change":"2024-09-12T00:46:09.497586+0000","last_active":"2024-09-12T01:00:46.737552+0000","last_peered":"2024-09-12T01:00:46.737552+0000","last_clean":"2024-09-12T01:00:46.737552+0000","last_became_active":"2024-09-12T00:46:09.496807+0000","last_became_peered":"2024-09-12T00:46:09.496807+0000","last_unstale":"2024-09-12T01:00:46.737552+0000","last_undegraded":"2024-09-12T01:00:46.737552+0000","last_fullsized":"2024-09-12T01:00:46.737552+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:06.744888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:01.741428+0000","last_change":"2024-09-12T00:34:55.248775+0000","last_active":"2024-09-12T01:01:01.741428+0000","last_peered":"2024-09-12T01:01:01.741428+0000","last_clean":"2024-09-12T01:01:01.741428+0000","last_became_active":"2024-09-12T00:34:55.248058+0000","last_became_peered":"2024-09-12T00:34:55.248058+0000","last_unstale":"2024-09-12T01:01:01.741428+0000","last_undegraded":"2024-09-12T01:01:01.741428+0000","last_fullsized":"2024-09-12T01:01:01.741428+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:55.550280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"268'8","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:02.575836+0000","last_change":"2024-09-12T00:34:52.170876+0000","last_active":"2024-09-12T01:04:02.575836+0000","last_peered":"2024-09-12T01:04:02.575836+0000","last_clean":"2024-09-12T01:04:02.575836+0000","last_became_active":"2024-09-12T00:34:52.170013+0000","last_became_peered":"2024-09-12T00:34:52.170013+0000","last_unstale":"2024-09-12T01:04:02.575836+0000","last_undegraded":"2024-09-12T01:04:02.575836+0000","last_fullsized":"2024-09-12T01:04:02.575836+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:37.972262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10242,"num_write":8,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'17","reported_seq":88,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:20.286340+0000","last_change":"2024-09-12T00:33:10.840336+0000","last_active":"2024-09-12T01:02:20.286340+0000","last_peered":"2024-09-12T01:02:20.286340+0000","last_clean":"2024-09-12T01:02:20.286340+0000","last_became_active":"2024-09-12T00:33:10.839248+0000","last_became_peered":"2024-09-12T00:33:10.839248+0000","last_unstale":"2024-09-12T01:02:20.286340+0000","last_undegraded":"2024-09-12T01:02:20.286340+0000","last_fullsized":"2024-09-12T01:02:20.286340+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:57.557088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":49,"num_write":38,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:16.761099+0000","last_change":"2024-09-12T00:46:09.501613+0000","last_active":"2024-09-12T01:02:16.761099+0000","last_peered":"2024-09-12T01:02:16.761099+0000","last_clean":"2024-09-12T01:02:16.761099+0000","last_became_active":"2024-09-12T00:46:09.499830+0000","last_became_peered":"2024-09-12T00:46:09.499830+0000","last_unstale":"2024-09-12T01:02:16.761099+0000","last_undegraded":"2024-09-12T01:02:16.761099+0000","last_fullsized":"2024-09-12T01:02:16.761099+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:10.541266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"268'4","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.680406+0000","last_change":"2024-09-12T00:34:55.242753+0000","last_active":"2024-09-12T01:04:38.680406+0000","last_peered":"2024-09-12T01:04:38.680406+0000","last_clean":"2024-09-12T01:04:38.680406+0000","last_became_active":"2024-09-12T00:34:55.242012+0000","last_became_peered":"2024-09-12T00:34:55.242012+0000","last_unstale":"2024-09-12T01:04:38.680406+0000","last_undegraded":"2024-09-12T01:04:38.680406+0000","last_fullsized":"2024-09-12T01:04:38.680406+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:49.280445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'7","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:51.599019+0000","last_change":"2024-09-12T00:34:52.206650+0000","last_active":"2024-09-12T01:03:51.599019+0000","last_peered":"2024-09-12T01:03:51.599019+0000","last_clean":"2024-09-12T01:03:51.599019+0000","last_became_active":"2024-09-12T00:34:52.205385+0000","last_became_peered":"2024-09-12T00:34:52.205385+0000","last_unstale":"2024-09-12T01:03:51.599019+0000","last_undegraded":"2024-09-12T01:03:51.599019+0000","last_fullsized":"2024-09-12T01:03:51.599019+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:45.297232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4098,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'48","reported_seq":172,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.736371+0000","last_change":"2024-09-12T00:33:10.843742+0000","last_active":"2024-09-12T01:00:41.736371+0000","last_peered":"2024-09-12T01:00:41.736371+0000","last_clean":"2024-09-12T01:00:41.736371+0000","last_became_active":"2024-09-12T00:33:10.842427+0000","last_became_peered":"2024-09-12T00:33:10.842427+0000","last_unstale":"2024-09-12T01:00:41.736371+0000","last_undegraded":"2024-09-12T01:00:41.736371+0000","last_fullsized":"2024-09-12T01:00:41.736371+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:10.839165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":162,"num_write":92,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:46.533904+0000","last_change":"2024-09-12T00:46:09.514586+0000","last_active":"2024-09-12T01:00:46.533904+0000","last_peered":"2024-09-12T01:00:46.533904+0000","last_clean":"2024-09-12T01:00:46.533904+0000","last_became_active":"2024-09-12T00:46:09.513617+0000","last_became_peered":"2024-09-12T00:46:09.513617+0000","last_unstale":"2024-09-12T01:00:46.533904+0000","last_undegraded":"2024-09-12T01:00:46.533904+0000","last_fullsized":"2024-09-12T01:00:46.533904+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:01.938146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"265'7","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:32.723080+0000","last_change":"2024-09-12T00:35:57.378205+0000","last_active":"2024-09-12T01:01:32.723080+0000","last_peered":"2024-09-12T01:01:32.723080+0000","last_clean":"2024-09-12T01:01:32.723080+0000","last_became_active":"2024-09-12T00:35:57.345894+0000","last_became_peered":"2024-09-12T00:35:57.345894+0000","last_unstale":"2024-09-12T01:01:32.723080+0000","last_undegraded":"2024-09-12T01:01:32.723080+0000","last_fullsized":"2024-09-12T01:01:32.723080+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:29.209762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"265'2","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:37.541584+0000","last_change":"2024-09-12T00:34:52.189042+0000","last_active":"2024-09-12T01:01:37.541584+0000","last_peered":"2024-09-12T01:01:37.541584+0000","last_clean":"2024-09-12T01:01:37.541584+0000","last_became_active":"2024-09-12T00:34:52.188352+0000","last_became_peered":"2024-09-12T00:34:52.188352+0000","last_unstale":"2024-09-12T01:01:37.541584+0000","last_undegraded":"2024-09-12T01:01:37.541584+0000","last_fullsized":"2024-09-12T01:01:37.541584+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:23.453176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'29","reported_seq":125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:42.712902+0000","last_change":"2024-09-12T00:33:10.846375+0000","last_active":"2024-09-12T01:00:42.712902+0000","last_peered":"2024-09-12T01:00:42.712902+0000","last_clean":"2024-09-12T01:00:42.712902+0000","last_became_active":"2024-09-12T00:33:10.845301+0000","last_became_peered":"2024-09-12T00:33:10.845301+0000","last_unstale":"2024-09-12T01:00:42.712902+0000","last_undegraded":"2024-09-12T01:00:42.712902+0000","last_fullsized":"2024-09-12T01:00:42.712902+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:52.282677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.534764+0000","last_change":"2024-09-12T00:46:09.499014+0000","last_active":"2024-09-12T01:01:12.534764+0000","last_peered":"2024-09-12T01:01:12.534764+0000","last_clean":"2024-09-12T01:01:12.534764+0000","last_became_active":"2024-09-12T00:46:09.498002+0000","last_became_peered":"2024-09-12T00:46:09.498002+0000","last_unstale":"2024-09-12T01:01:12.534764+0000","last_undegraded":"2024-09-12T01:01:12.534764+0000","last_fullsized":"2024-09-12T01:01:12.534764+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:50.022966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":34,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.703624+0000","last_change":"2024-09-12T00:34:55.215867+0000","last_active":"2024-09-12T00:59:57.703624+0000","last_peered":"2024-09-12T00:59:57.703624+0000","last_clean":"2024-09-12T00:59:57.703624+0000","last_became_active":"2024-09-12T00:34:55.215076+0000","last_became_peered":"2024-09-12T00:34:55.215076+0000","last_unstale":"2024-09-12T00:59:57.703624+0000","last_undegraded":"2024-09-12T00:59:57.703624+0000","last_fullsized":"2024-09-12T00:59:57.703624+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:36.048042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"265'2","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:52.517005+0000","last_change":"2024-09-12T00:34:52.199214+0000","last_active":"2024-09-12T00:59:52.517005+0000","last_peered":"2024-09-12T00:59:52.517005+0000","last_clean":"2024-09-12T00:59:52.517005+0000","last_became_active":"2024-09-12T00:34:52.198548+0000","last_became_peered":"2024-09-12T00:34:52.198548+0000","last_unstale":"2024-09-12T00:59:52.517005+0000","last_undegraded":"2024-09-12T00:59:52.517005+0000","last_fullsized":"2024-09-12T00:59:52.517005+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:36.364945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'18","reported_seq":94,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.578205+0000","last_change":"2024-09-12T00:33:10.857470+0000","last_active":"2024-09-12T01:02:21.578205+0000","last_peered":"2024-09-12T01:02:21.578205+0000","last_clean":"2024-09-12T01:02:21.578205+0000","last_became_active":"2024-09-12T00:33:10.856664+0000","last_became_peered":"2024-09-12T00:33:10.856664+0000","last_unstale":"2024-09-12T01:02:21.578205+0000","last_undegraded":"2024-09-12T01:02:21.578205+0000","last_fullsized":"2024-09-12T01:02:21.578205+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":59,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.534815+0000","last_change":"2024-09-12T00:46:09.504100+0000","last_active":"2024-09-12T01:01:12.534815+0000","last_peered":"2024-09-12T01:01:12.534815+0000","last_clean":"2024-09-12T01:01:12.534815+0000","last_became_active":"2024-09-12T00:46:09.503361+0000","last_became_peered":"2024-09-12T00:46:09.503361+0000","last_unstale":"2024-09-12T01:01:12.534815+0000","last_undegraded":"2024-09-12T01:01:12.534815+0000","last_fullsized":"2024-09-12T01:01:12.534815+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:15.687886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":34,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:56.723763+0000","last_change":"2024-09-12T00:34:55.217786+0000","last_active":"2024-09-12T00:59:56.723763+0000","last_peered":"2024-09-12T00:59:56.723763+0000","last_clean":"2024-09-12T00:59:56.723763+0000","last_became_active":"2024-09-12T00:34:55.217009+0000","last_became_peered":"2024-09-12T00:34:55.217009+0000","last_unstale":"2024-09-12T00:59:56.723763+0000","last_undegraded":"2024-09-12T00:59:56.723763+0000","last_fullsized":"2024-09-12T00:59:56.723763+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:52.140153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"268'2","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.578269+0000","last_change":"2024-09-12T00:34:52.206482+0000","last_active":"2024-09-12T01:02:21.578269+0000","last_peered":"2024-09-12T01:02:21.578269+0000","last_clean":"2024-09-12T01:02:21.578269+0000","last_became_active":"2024-09-12T00:34:52.202432+0000","last_became_peered":"2024-09-12T00:34:52.202432+0000","last_unstale":"2024-09-12T01:02:21.578269+0000","last_undegraded":"2024-09-12T01:02:21.578269+0000","last_fullsized":"2024-09-12T01:02:21.578269+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:47.587915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"268'46","reported_seq":174,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.554878+0000","last_change":"2024-09-12T00:33:10.846991+0000","last_active":"2024-09-12T01:02:11.554878+0000","last_peered":"2024-09-12T01:02:11.554878+0000","last_clean":"2024-09-12T01:02:11.554878+0000","last_became_active":"2024-09-12T00:33:10.846370+0000","last_became_peered":"2024-09-12T00:33:10.846370+0000","last_unstale":"2024-09-12T01:02:11.554878+0000","last_undegraded":"2024-09-12T01:02:11.554878+0000","last_fullsized":"2024-09-12T01:02:11.554878+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:49.969549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":168,"num_write":82,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:11.525647+0000","last_change":"2024-09-12T00:46:09.494884+0000","last_active":"2024-09-12T01:00:11.525647+0000","last_peered":"2024-09-12T01:00:11.525647+0000","last_clean":"2024-09-12T01:00:11.525647+0000","last_became_active":"2024-09-12T00:46:09.494139+0000","last_became_peered":"2024-09-12T00:46:09.494139+0000","last_unstale":"2024-09-12T01:00:11.525647+0000","last_undegraded":"2024-09-12T01:00:11.525647+0000","last_fullsized":"2024-09-12T01:00:11.525647+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:16.093338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":35,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:31.748997+0000","last_change":"2024-09-12T00:34:55.253827+0000","last_active":"2024-09-12T01:01:31.748997+0000","last_peered":"2024-09-12T01:01:31.748997+0000","last_clean":"2024-09-12T01:01:31.748997+0000","last_became_active":"2024-09-12T00:34:55.253209+0000","last_became_peered":"2024-09-12T00:34:55.253209+0000","last_unstale":"2024-09-12T01:01:31.748997+0000","last_undegraded":"2024-09-12T01:01:31.748997+0000","last_fullsized":"2024-09-12T01:01:31.748997+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:58.016129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'2","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.761461+0000","last_change":"2024-09-12T00:34:52.180802+0000","last_active":"2024-09-12T01:02:52.761461+0000","last_peered":"2024-09-12T01:02:52.761461+0000","last_clean":"2024-09-12T01:02:52.761461+0000","last_became_active":"2024-09-12T00:34:52.180036+0000","last_became_peered":"2024-09-12T00:34:52.180036+0000","last_unstale":"2024-09-12T01:02:52.761461+0000","last_undegraded":"2024-09-12T01:02:52.761461+0000","last_fullsized":"2024-09-12T01:02:52.761461+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:25.152180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'75","reported_seq":263,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.576052+0000","last_change":"2024-09-12T00:33:10.852500+0000","last_active":"2024-09-12T01:02:11.576052+0000","last_peered":"2024-09-12T01:02:11.576052+0000","last_clean":"2024-09-12T01:02:11.576052+0000","last_became_active":"2024-09-12T00:33:10.851672+0000","last_became_peered":"2024-09-12T00:33:10.851672+0000","last_unstale":"2024-09-12T01:02:11.576052+0000","last_undegraded":"2024-09-12T01:02:11.576052+0000","last_fullsized":"2024-09-12T01:02:11.576052+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:45.023568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":415,"num_read_kb":311,"num_write":116,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:11.698157+0000","last_change":"2024-09-12T00:46:09.519546+0000","last_active":"2024-09-12T01:00:11.698157+0000","last_peered":"2024-09-12T01:00:11.698157+0000","last_clean":"2024-09-12T01:00:11.698157+0000","last_became_active":"2024-09-12T00:46:09.513012+0000","last_became_peered":"2024-09-12T00:46:09.513012+0000","last_unstale":"2024-09-12T01:00:11.698157+0000","last_undegraded":"2024-09-12T01:00:11.698157+0000","last_fullsized":"2024-09-12T01:00:11.698157+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:10.067526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"268'8","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.804144+0000","last_change":"2024-09-12T00:34:55.254204+0000","last_active":"2024-09-12T01:04:39.804144+0000","last_peered":"2024-09-12T01:04:39.804144+0000","last_clean":"2024-09-12T01:04:39.804144+0000","last_became_active":"2024-09-12T00:34:55.252580+0000","last_became_peered":"2024-09-12T00:34:55.252580+0000","last_unstale":"2024-09-12T01:04:39.804144+0000","last_undegraded":"2024-09-12T01:04:39.804144+0000","last_fullsized":"2024-09-12T01:04:39.804144+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:00.820979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":14336,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:27.538170+0000","last_change":"2024-09-12T00:34:52.204725+0000","last_active":"2024-09-12T01:01:27.538170+0000","last_peered":"2024-09-12T01:01:27.538170+0000","last_clean":"2024-09-12T01:01:27.538170+0000","last_became_active":"2024-09-12T00:34:52.204021+0000","last_became_peered":"2024-09-12T00:34:52.204021+0000","last_unstale":"2024-09-12T01:01:27.538170+0000","last_undegraded":"2024-09-12T01:01:27.538170+0000","last_fullsized":"2024-09-12T01:01:27.538170+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:45.824620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'35","reported_seq":145,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.759818+0000","last_change":"2024-09-12T00:33:10.850040+0000","last_active":"2024-09-12T01:02:11.759818+0000","last_peered":"2024-09-12T01:02:11.759818+0000","last_clean":"2024-09-12T01:02:11.759818+0000","last_became_active":"2024-09-12T00:33:10.849228+0000","last_became_peered":"2024-09-12T00:33:10.849228+0000","last_unstale":"2024-09-12T01:02:11.759818+0000","last_undegraded":"2024-09-12T01:02:11.759818+0000","last_fullsized":"2024-09-12T01:02:11.759818+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:46.335542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":134,"num_write":61,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:12.520461+0000","last_change":"2024-09-12T00:46:09.500158+0000","last_active":"2024-09-12T01:00:12.520461+0000","last_peered":"2024-09-12T01:00:12.520461+0000","last_clean":"2024-09-12T01:00:12.520461+0000","last_became_active":"2024-09-12T00:46:09.499137+0000","last_became_peered":"2024-09-12T00:46:09.499137+0000","last_unstale":"2024-09-12T01:00:12.520461+0000","last_undegraded":"2024-09-12T01:00:12.520461+0000","last_fullsized":"2024-09-12T01:00:12.520461+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:28.716621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"268'5","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:56.783697+0000","last_change":"2024-09-12T00:34:55.254921+0000","last_active":"2024-09-12T01:03:56.783697+0000","last_peered":"2024-09-12T01:03:56.783697+0000","last_clean":"2024-09-12T01:03:56.783697+0000","last_became_active":"2024-09-12T00:34:55.254250+0000","last_became_peered":"2024-09-12T00:34:55.254250+0000","last_unstale":"2024-09-12T01:03:56.783697+0000","last_undegraded":"2024-09-12T01:03:56.783697+0000","last_fullsized":"2024-09-12T01:03:56.783697+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:45.939058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":318,"num_write":10,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:26.714599+0000","last_change":"2024-09-12T00:34:52.179911+0000","last_active":"2024-09-12T01:01:26.714599+0000","last_peered":"2024-09-12T01:01:26.714599+0000","last_clean":"2024-09-12T01:01:26.714599+0000","last_became_active":"2024-09-12T00:34:52.173822+0000","last_became_peered":"2024-09-12T00:34:52.173822+0000","last_unstale":"2024-09-12T01:01:26.714599+0000","last_undegraded":"2024-09-12T01:01:26.714599+0000","last_fullsized":"2024-09-12T01:01:26.714599+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:44.199880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'34","reported_seq":141,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.724049+0000","last_change":"2024-09-12T00:33:10.842194+0000","last_active":"2024-09-12T01:02:11.724049+0000","last_peered":"2024-09-12T01:02:11.724049+0000","last_clean":"2024-09-12T01:02:11.724049+0000","last_became_active":"2024-09-12T00:33:10.841363+0000","last_became_peered":"2024-09-12T00:33:10.841363+0000","last_unstale":"2024-09-12T01:02:11.724049+0000","last_undegraded":"2024-09-12T01:02:11.724049+0000","last_fullsized":"2024-09-12T01:02:11.724049+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:29.266511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":128,"num_write":55,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:12.725014+0000","last_change":"2024-09-12T00:46:09.506737+0000","last_active":"2024-09-12T01:00:12.725014+0000","last_peered":"2024-09-12T01:00:12.725014+0000","last_clean":"2024-09-12T01:00:12.725014+0000","last_became_active":"2024-09-12T00:46:09.502684+0000","last_became_peered":"2024-09-12T00:46:09.502684+0000","last_unstale":"2024-09-12T01:00:12.725014+0000","last_undegraded":"2024-09-12T01:00:12.725014+0000","last_fullsized":"2024-09-12T01:00:12.725014+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:55.402567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"268'8","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.805326+0000","last_change":"2024-09-12T00:34:55.227141+0000","last_active":"2024-09-12T01:04:39.805326+0000","last_peered":"2024-09-12T01:04:39.805326+0000","last_clean":"2024-09-12T01:04:39.805326+0000","last_became_active":"2024-09-12T00:34:55.226388+0000","last_became_peered":"2024-09-12T00:34:55.226388+0000","last_unstale":"2024-09-12T01:04:39.805326+0000","last_undegraded":"2024-09-12T01:04:39.805326+0000","last_fullsized":"2024-09-12T01:04:39.805326+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:59.431333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":16384,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"268'11","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:51.599165+0000","last_change":"2024-09-12T00:34:52.197590+0000","last_active":"2024-09-12T01:03:51.599165+0000","last_peered":"2024-09-12T01:03:51.599165+0000","last_clean":"2024-09-12T01:03:51.599165+0000","last_became_active":"2024-09-12T00:34:52.196770+0000","last_became_peered":"2024-09-12T00:34:52.196770+0000","last_unstale":"2024-09-12T01:03:51.599165+0000","last_undegraded":"2024-09-12T01:03:51.599165+0000","last_fullsized":"2024-09-12T01:03:51.599165+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:15.638504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":25602,"num_write":16,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'4","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:37.433116+0000","last_change":"2024-09-12T00:33:10.858900+0000","last_active":"2024-09-12T01:01:37.433116+0000","last_peered":"2024-09-12T01:01:37.433116+0000","last_clean":"2024-09-12T01:01:37.433116+0000","last_became_active":"2024-09-12T00:33:10.858178+0000","last_became_peered":"2024-09-12T00:33:10.858178+0000","last_unstale":"2024-09-12T01:01:37.433116+0000","last_undegraded":"2024-09-12T01:01:37.433116+0000","last_fullsized":"2024-09-12T01:01:37.433116+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:45.562348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.736528+0000","last_change":"2024-09-12T00:46:09.522998+0000","last_active":"2024-09-12T01:00:41.736528+0000","last_peered":"2024-09-12T01:00:41.736528+0000","last_clean":"2024-09-12T01:00:41.736528+0000","last_became_active":"2024-09-12T00:46:09.521706+0000","last_became_peered":"2024-09-12T00:46:09.521706+0000","last_unstale":"2024-09-12T01:00:41.736528+0000","last_undegraded":"2024-09-12T01:00:41.736528+0000","last_fullsized":"2024-09-12T01:00:41.736528+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:39.145979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"268'4","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.848099+0000","last_change":"2024-09-12T00:34:55.224573+0000","last_active":"2024-09-12T01:04:39.848099+0000","last_peered":"2024-09-12T01:04:39.848099+0000","last_clean":"2024-09-12T01:04:39.848099+0000","last_became_active":"2024-09-12T00:34:55.223787+0000","last_became_peered":"2024-09-12T00:34:55.223787+0000","last_unstale":"2024-09-12T01:04:39.848099+0000","last_undegraded":"2024-09-12T01:04:39.848099+0000","last_fullsized":"2024-09-12T01:04:39.848099+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:30.131692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"268'6","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.560854+0000","last_change":"2024-09-12T00:34:52.184714+0000","last_active":"2024-09-12T01:02:52.560854+0000","last_peered":"2024-09-12T01:02:52.560854+0000","last_clean":"2024-09-12T01:02:52.560854+0000","last_became_active":"2024-09-12T00:34:52.183982+0000","last_became_peered":"2024-09-12T00:34:52.183982+0000","last_unstale":"2024-09-12T01:02:52.560854+0000","last_undegraded":"2024-09-12T01:02:52.560854+0000","last_fullsized":"2024-09-12T01:02:52.560854+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:07.745456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5649,"num_write":6,"num_write_kb":5649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'25","reported_seq":115,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.534711+0000","last_change":"2024-09-12T00:33:10.858835+0000","last_active":"2024-09-12T01:01:12.534711+0000","last_peered":"2024-09-12T01:01:12.534711+0000","last_clean":"2024-09-12T01:01:12.534711+0000","last_became_active":"2024-09-12T00:33:10.858212+0000","last_became_peered":"2024-09-12T00:33:10.858212+0000","last_unstale":"2024-09-12T01:01:12.534711+0000","last_undegraded":"2024-09-12T01:01:12.534711+0000","last_fullsized":"2024-09-12T01:01:12.534711+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:58.477753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":92,"num_write":42,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.549794+0000","last_change":"2024-09-12T00:46:09.518627+0000","last_active":"2024-09-12T01:00:41.549794+0000","last_peered":"2024-09-12T01:00:41.549794+0000","last_clean":"2024-09-12T01:00:41.549794+0000","last_became_active":"2024-09-12T00:46:09.517833+0000","last_became_peered":"2024-09-12T00:46:09.517833+0000","last_unstale":"2024-09-12T01:00:41.549794+0000","last_undegraded":"2024-09-12T01:00:41.549794+0000","last_fullsized":"2024-09-12T01:00:41.549794+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:23.918442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'9","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:36.531490+0000","last_change":"2024-09-12T00:34:55.227520+0000","last_active":"2024-09-12T01:00:36.531490+0000","last_peered":"2024-09-12T01:00:36.531490+0000","last_clean":"2024-09-12T01:00:36.531490+0000","last_became_active":"2024-09-12T00:34:55.226334+0000","last_became_peered":"2024-09-12T00:34:55.226334+0000","last_unstale":"2024-09-12T01:00:36.531490+0000","last_undegraded":"2024-09-12T01:00:36.531490+0000","last_fullsized":"2024-09-12T01:00:36.531490+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:23.592244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":14,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'6","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.770142+0000","last_change":"2024-09-12T00:34:52.179045+0000","last_active":"2024-09-12T01:02:51.770142+0000","last_peered":"2024-09-12T01:02:51.770142+0000","last_clean":"2024-09-12T01:02:51.770142+0000","last_became_active":"2024-09-12T00:34:52.174421+0000","last_became_peered":"2024-09-12T00:34:52.174421+0000","last_unstale":"2024-09-12T01:02:51.770142+0000","last_undegraded":"2024-09-12T01:02:51.770142+0000","last_fullsized":"2024-09-12T01:02:51.770142+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:27.648444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5438,"num_write":6,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"268'52","reported_seq":187,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.554333+0000","last_change":"2024-09-12T00:33:10.849621+0000","last_active":"2024-09-12T01:02:21.554333+0000","last_peered":"2024-09-12T01:02:21.554333+0000","last_clean":"2024-09-12T01:02:21.554333+0000","last_became_active":"2024-09-12T00:33:10.848890+0000","last_became_peered":"2024-09-12T00:33:10.848890+0000","last_unstale":"2024-09-12T01:02:21.554333+0000","last_undegraded":"2024-09-12T01:02:21.554333+0000","last_fullsized":"2024-09-12T01:02:21.554333+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:26.708631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":180,"num_write":98,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:16.541674+0000","last_change":"2024-09-12T00:46:09.521885+0000","last_active":"2024-09-12T01:00:16.541674+0000","last_peered":"2024-09-12T01:00:16.541674+0000","last_clean":"2024-09-12T01:00:16.541674+0000","last_became_active":"2024-09-12T00:46:09.521575+0000","last_became_peered":"2024-09-12T00:46:09.521575+0000","last_unstale":"2024-09-12T01:00:16.541674+0000","last_undegraded":"2024-09-12T01:00:16.541674+0000","last_fullsized":"2024-09-12T01:00:16.541674+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:19.905486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"268'7","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.410496+0000","last_change":"2024-09-12T00:34:55.233021+0000","last_active":"2024-09-12T01:04:39.410496+0000","last_peered":"2024-09-12T01:04:39.410496+0000","last_clean":"2024-09-12T01:04:39.410496+0000","last_became_active":"2024-09-12T00:34:55.232215+0000","last_became_peered":"2024-09-12T00:34:55.232215+0000","last_unstale":"2024-09-12T01:04:39.410496+0000","last_undegraded":"2024-09-12T01:04:39.410496+0000","last_fullsized":"2024-09-12T01:04:39.410496+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:02.623358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8310,"num_write":12,"num_write_kb":8251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"268'4","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.740083+0000","last_change":"2024-09-12T00:34:52.200570+0000","last_active":"2024-09-12T01:02:52.740083+0000","last_peered":"2024-09-12T01:02:52.740083+0000","last_clean":"2024-09-12T01:02:52.740083+0000","last_became_active":"2024-09-12T00:34:52.199793+0000","last_became_peered":"2024-09-12T00:34:52.199793+0000","last_unstale":"2024-09-12T01:02:52.740083+0000","last_undegraded":"2024-09-12T01:02:52.740083+0000","last_fullsized":"2024-09-12T01:02:52.740083+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:28.505129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'20","reported_seq":103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.535700+0000","last_change":"2024-09-12T00:33:10.845733+0000","last_active":"2024-09-12T01:01:12.535700+0000","last_peered":"2024-09-12T01:01:12.535700+0000","last_clean":"2024-09-12T01:01:12.535700+0000","last_became_active":"2024-09-12T00:33:10.844957+0000","last_became_peered":"2024-09-12T00:33:10.844957+0000","last_unstale":"2024-09-12T01:01:12.535700+0000","last_undegraded":"2024-09-12T01:01:12.535700+0000","last_fullsized":"2024-09-12T01:01:12.535700+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:00.371030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":73,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.736485+0000","last_change":"2024-09-12T00:46:09.515049+0000","last_active":"2024-09-12T01:00:41.736485+0000","last_peered":"2024-09-12T01:00:41.736485+0000","last_clean":"2024-09-12T01:00:41.736485+0000","last_became_active":"2024-09-12T00:46:09.514727+0000","last_became_peered":"2024-09-12T00:46:09.514727+0000","last_unstale":"2024-09-12T01:00:41.736485+0000","last_undegraded":"2024-09-12T01:00:41.736485+0000","last_fullsized":"2024-09-12T01:00:41.736485+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:28.627541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"268'7","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.186330+0000","last_change":"2024-09-12T00:34:55.220880+0000","last_active":"2024-09-12T01:04:39.186330+0000","last_peered":"2024-09-12T01:04:39.186330+0000","last_clean":"2024-09-12T01:04:39.186330+0000","last_became_active":"2024-09-12T00:34:55.220179+0000","last_became_peered":"2024-09-12T00:34:55.220179+0000","last_unstale":"2024-09-12T01:04:39.186330+0000","last_undegraded":"2024-09-12T01:04:39.186330+0000","last_fullsized":"2024-09-12T01:04:39.186330+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:14.092881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"268'7","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.049140+0000","last_change":"2024-09-12T00:34:52.197324+0000","last_active":"2024-09-12T01:04:39.049140+0000","last_peered":"2024-09-12T01:04:39.049140+0000","last_clean":"2024-09-12T01:04:39.049140+0000","last_became_active":"2024-09-12T00:34:52.196592+0000","last_became_peered":"2024-09-12T00:34:52.196592+0000","last_unstale":"2024-09-12T01:04:39.049140+0000","last_undegraded":"2024-09-12T01:04:39.049140+0000","last_fullsized":"2024-09-12T01:04:39.049140+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:12.628205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'27","reported_seq":117,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:11.743558+0000","last_change":"2024-09-12T00:33:10.842922+0000","last_active":"2024-09-12T01:01:11.743558+0000","last_peered":"2024-09-12T01:01:11.743558+0000","last_clean":"2024-09-12T01:01:11.743558+0000","last_became_active":"2024-09-12T00:33:10.842139+0000","last_became_peered":"2024-09-12T00:33:10.842139+0000","last_unstale":"2024-09-12T01:01:11.743558+0000","last_undegraded":"2024-09-12T01:01:11.743558+0000","last_fullsized":"2024-09-12T01:01:11.743558+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:22.677651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":87,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:21.713467+0000","last_change":"2024-09-12T00:46:09.495008+0000","last_active":"2024-09-12T01:01:21.713467+0000","last_peered":"2024-09-12T01:01:21.713467+0000","last_clean":"2024-09-12T01:01:21.713467+0000","last_became_active":"2024-09-12T00:46:09.494257+0000","last_became_peered":"2024-09-12T00:46:09.494257+0000","last_unstale":"2024-09-12T01:01:21.713467+0000","last_undegraded":"2024-09-12T01:01:21.713467+0000","last_fullsized":"2024-09-12T01:01:21.713467+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:13.650561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":36,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.755822+0000","last_change":"2024-09-12T00:34:55.228058+0000","last_active":"2024-09-12T01:01:56.755822+0000","last_peered":"2024-09-12T01:01:56.755822+0000","last_clean":"2024-09-12T01:01:56.755822+0000","last_became_active":"2024-09-12T00:34:55.226471+0000","last_became_peered":"2024-09-12T00:34:55.226471+0000","last_unstale":"2024-09-12T01:01:56.755822+0000","last_undegraded":"2024-09-12T01:01:56.755822+0000","last_fullsized":"2024-09-12T01:01:56.755822+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:56.137407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'2","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:52.543792+0000","last_change":"2024-09-12T00:34:52.203278+0000","last_active":"2024-09-12T01:01:52.543792+0000","last_peered":"2024-09-12T01:01:52.543792+0000","last_clean":"2024-09-12T01:01:52.543792+0000","last_became_active":"2024-09-12T00:34:52.202587+0000","last_became_peered":"2024-09-12T00:34:52.202587+0000","last_unstale":"2024-09-12T01:01:52.543792+0000","last_undegraded":"2024-09-12T01:01:52.543792+0000","last_fullsized":"2024-09-12T01:01:52.543792+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:59.179898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'23","reported_seq":109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:31.765303+0000","last_change":"2024-09-12T00:33:10.833328+0000","last_active":"2024-09-12T01:02:31.765303+0000","last_peered":"2024-09-12T01:02:31.765303+0000","last_clean":"2024-09-12T01:02:31.765303+0000","last_became_active":"2024-09-12T00:33:10.832622+0000","last_became_peered":"2024-09-12T00:33:10.832622+0000","last_unstale":"2024-09-12T01:02:31.765303+0000","last_undegraded":"2024-09-12T01:02:31.765303+0000","last_fullsized":"2024-09-12T01:02:31.765303+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":78,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.544986+0000","last_change":"2024-09-12T00:46:09.502064+0000","last_active":"2024-09-12T01:01:57.544986+0000","last_peered":"2024-09-12T01:01:57.544986+0000","last_clean":"2024-09-12T01:01:57.544986+0000","last_became_active":"2024-09-12T00:46:09.501361+0000","last_became_peered":"2024-09-12T00:46:09.501361+0000","last_unstale":"2024-09-12T01:01:57.544986+0000","last_undegraded":"2024-09-12T01:01:57.544986+0000","last_fullsized":"2024-09-12T01:01:57.544986+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:11.638769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"268'2","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:11.786015+0000","last_change":"2024-09-12T00:34:55.222844+0000","last_active":"2024-09-12T01:04:11.786015+0000","last_peered":"2024-09-12T01:04:11.786015+0000","last_clean":"2024-09-12T01:04:11.786015+0000","last_became_active":"2024-09-12T00:34:55.222079+0000","last_became_peered":"2024-09-12T00:34:55.222079+0000","last_unstale":"2024-09-12T01:04:11.786015+0000","last_undegraded":"2024-09-12T01:04:11.786015+0000","last_fullsized":"2024-09-12T01:04:11.786015+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:10.859567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"268'3","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:06.745540+0000","last_change":"2024-09-12T00:34:52.177816+0000","last_active":"2024-09-12T01:04:06.745540+0000","last_peered":"2024-09-12T01:04:06.745540+0000","last_clean":"2024-09-12T01:04:06.745540+0000","last_became_active":"2024-09-12T00:34:52.176108+0000","last_became_peered":"2024-09-12T00:34:52.176108+0000","last_unstale":"2024-09-12T01:04:06.745540+0000","last_undegraded":"2024-09-12T01:04:06.745540+0000","last_fullsized":"2024-09-12T01:04:06.745540+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:39.727514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'16","reported_seq":91,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:27.755866+0000","last_change":"2024-09-12T00:33:10.850501+0000","last_active":"2024-09-12T01:02:27.755866+0000","last_peered":"2024-09-12T01:02:27.755866+0000","last_clean":"2024-09-12T01:02:27.755866+0000","last_became_active":"2024-09-12T00:33:10.849703+0000","last_became_peered":"2024-09-12T00:33:10.849703+0000","last_unstale":"2024-09-12T01:02:27.755866+0000","last_undegraded":"2024-09-12T01:02:27.755866+0000","last_fullsized":"2024-09-12T01:02:27.755866+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:34.698555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:22.721112+0000","last_change":"2024-09-12T00:46:09.517232+0000","last_active":"2024-09-12T01:01:22.721112+0000","last_peered":"2024-09-12T01:01:22.721112+0000","last_clean":"2024-09-12T01:01:22.721112+0000","last_became_active":"2024-09-12T00:46:09.514197+0000","last_became_peered":"2024-09-12T00:46:09.514197+0000","last_unstale":"2024-09-12T01:01:22.721112+0000","last_undegraded":"2024-09-12T01:01:22.721112+0000","last_fullsized":"2024-09-12T01:01:22.721112+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:13.571995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"268'8","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:21.369472+0000","last_change":"2024-09-12T00:34:55.253416+0000","last_active":"2024-09-12T01:04:21.369472+0000","last_peered":"2024-09-12T01:04:21.369472+0000","last_clean":"2024-09-12T01:04:21.369472+0000","last_became_active":"2024-09-12T00:34:55.252651+0000","last_became_peered":"2024-09-12T00:34:55.252651+0000","last_unstale":"2024-09-12T01:04:21.369472+0000","last_undegraded":"2024-09-12T01:04:21.369472+0000","last_fullsized":"2024-09-12T01:04:21.369472+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:51.619823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":7697,"num_write":8,"num_write_kb":6673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"268'3","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:06.601687+0000","last_change":"2024-09-12T00:34:52.201618+0000","last_active":"2024-09-12T01:04:06.601687+0000","last_peered":"2024-09-12T01:04:06.601687+0000","last_clean":"2024-09-12T01:04:06.601687+0000","last_became_active":"2024-09-12T00:34:52.177094+0000","last_became_peered":"2024-09-12T00:34:52.177094+0000","last_unstale":"2024-09-12T01:04:06.601687+0000","last_undegraded":"2024-09-12T01:04:06.601687+0000","last_fullsized":"2024-09-12T01:04:06.601687+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:28.340168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"268'31","reported_seq":133,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:27.735000+0000","last_change":"2024-09-12T00:33:10.863914+0000","last_active":"2024-09-12T01:02:27.735000+0000","last_peered":"2024-09-12T01:02:27.735000+0000","last_clean":"2024-09-12T01:02:27.735000+0000","last_became_active":"2024-09-12T00:33:10.862993+0000","last_became_peered":"2024-09-12T00:33:10.862993+0000","last_unstale":"2024-09-12T01:02:27.735000+0000","last_undegraded":"2024-09-12T01:02:27.735000+0000","last_fullsized":"2024-09-12T01:02:27.735000+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:01.904051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":107,"num_write":58,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:22.536912+0000","last_change":"2024-09-12T00:46:09.499178+0000","last_active":"2024-09-12T01:01:22.536912+0000","last_peered":"2024-09-12T01:01:22.536912+0000","last_clean":"2024-09-12T01:01:22.536912+0000","last_became_active":"2024-09-12T00:46:09.498482+0000","last_became_peered":"2024-09-12T00:46:09.498482+0000","last_unstale":"2024-09-12T01:01:22.536912+0000","last_undegraded":"2024-09-12T01:01:22.536912+0000","last_fullsized":"2024-09-12T01:01:22.536912+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:41.343998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":36,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.755870+0000","last_change":"2024-09-12T00:34:55.229076+0000","last_active":"2024-09-12T01:01:56.755870+0000","last_peered":"2024-09-12T01:01:56.755870+0000","last_clean":"2024-09-12T01:01:56.755870+0000","last_became_active":"2024-09-12T00:34:55.228136+0000","last_became_peered":"2024-09-12T00:34:55.228136+0000","last_unstale":"2024-09-12T01:01:56.755870+0000","last_undegraded":"2024-09-12T01:01:56.755870+0000","last_fullsized":"2024-09-12T01:01:56.755870+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:13.739031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.551311+0000","last_change":"2024-09-12T00:34:52.191163+0000","last_active":"2024-09-12T01:01:56.551311+0000","last_peered":"2024-09-12T01:01:56.551311+0000","last_clean":"2024-09-12T01:01:56.551311+0000","last_became_active":"2024-09-12T00:34:52.190350+0000","last_became_peered":"2024-09-12T00:34:52.190350+0000","last_unstale":"2024-09-12T01:01:56.551311+0000","last_undegraded":"2024-09-12T01:01:56.551311+0000","last_fullsized":"2024-09-12T01:01:56.551311+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:44.544700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'31","reported_seq":131,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:26.726939+0000","last_change":"2024-09-12T00:33:10.834922+0000","last_active":"2024-09-12T01:02:26.726939+0000","last_peered":"2024-09-12T01:02:26.726939+0000","last_clean":"2024-09-12T01:02:26.726939+0000","last_became_active":"2024-09-12T00:33:10.834095+0000","last_became_peered":"2024-09-12T00:33:10.834095+0000","last_unstale":"2024-09-12T01:02:26.726939+0000","last_undegraded":"2024-09-12T01:02:26.726939+0000","last_fullsized":"2024-09-12T01:02:26.726939+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:09.706426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":107,"num_write":54,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.755937+0000","last_change":"2024-09-12T00:46:09.502145+0000","last_active":"2024-09-12T01:01:56.755937+0000","last_peered":"2024-09-12T01:01:56.755937+0000","last_clean":"2024-09-12T01:01:56.755937+0000","last_became_active":"2024-09-12T00:46:09.500779+0000","last_became_peered":"2024-09-12T00:46:09.500779+0000","last_unstale":"2024-09-12T01:01:56.755937+0000","last_undegraded":"2024-09-12T01:01:56.755937+0000","last_fullsized":"2024-09-12T01:01:56.755937+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:52.290781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"268'8","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.185609+0000","last_change":"2024-09-12T00:34:55.242037+0000","last_active":"2024-09-12T01:04:39.185609+0000","last_peered":"2024-09-12T01:04:39.185609+0000","last_clean":"2024-09-12T01:04:39.185609+0000","last_became_active":"2024-09-12T00:34:55.241223+0000","last_became_peered":"2024-09-12T00:34:55.241223+0000","last_unstale":"2024-09-12T01:04:39.185609+0000","last_undegraded":"2024-09-12T01:04:39.185609+0000","last_fullsized":"2024-09-12T01:04:39.185609+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:56.166816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9218,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"268'2","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.588186+0000","last_change":"2024-09-12T00:34:52.206116+0000","last_active":"2024-09-12T01:03:01.588186+0000","last_peered":"2024-09-12T01:03:01.588186+0000","last_clean":"2024-09-12T01:03:01.588186+0000","last_became_active":"2024-09-12T00:34:52.202407+0000","last_became_peered":"2024-09-12T00:34:52.202407+0000","last_unstale":"2024-09-12T01:03:01.588186+0000","last_undegraded":"2024-09-12T01:03:01.588186+0000","last_fullsized":"2024-09-12T01:03:01.588186+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:16.024426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'46","reported_seq":179,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:26.579456+0000","last_change":"2024-09-12T00:33:10.860057+0000","last_active":"2024-09-12T01:02:26.579456+0000","last_peered":"2024-09-12T01:02:26.579456+0000","last_clean":"2024-09-12T01:02:26.579456+0000","last_became_active":"2024-09-12T00:33:10.859459+0000","last_became_peered":"2024-09-12T00:33:10.859459+0000","last_unstale":"2024-09-12T01:02:26.579456+0000","last_undegraded":"2024-09-12T01:02:26.579456+0000","last_fullsized":"2024-09-12T01:02:26.579456+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:02.662726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":176,"num_write":75,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.546185+0000","last_change":"2024-09-12T00:46:09.505921+0000","last_active":"2024-09-12T01:02:02.546185+0000","last_peered":"2024-09-12T01:02:02.546185+0000","last_clean":"2024-09-12T01:02:02.546185+0000","last_became_active":"2024-09-12T00:46:09.505143+0000","last_became_peered":"2024-09-12T00:46:09.505143+0000","last_unstale":"2024-09-12T01:02:02.546185+0000","last_undegraded":"2024-09-12T01:02:02.546185+0000","last_fullsized":"2024-09-12T01:02:02.546185+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:58.286882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"268'2","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.560722+0000","last_change":"2024-09-12T00:34:55.253946+0000","last_active":"2024-09-12T01:03:07.560722+0000","last_peered":"2024-09-12T01:03:07.560722+0000","last_clean":"2024-09-12T01:03:07.560722+0000","last_became_active":"2024-09-12T00:34:55.253169+0000","last_became_peered":"2024-09-12T00:34:55.253169+0000","last_unstale":"2024-09-12T01:03:07.560722+0000","last_undegraded":"2024-09-12T01:03:07.560722+0000","last_fullsized":"2024-09-12T01:03:07.560722+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:41.186189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"268'2","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.351704+0000","last_change":"2024-09-12T00:34:52.190974+0000","last_active":"2024-09-12T01:03:01.351704+0000","last_peered":"2024-09-12T01:03:01.351704+0000","last_clean":"2024-09-12T01:03:01.351704+0000","last_became_active":"2024-09-12T00:34:52.190174+0000","last_became_peered":"2024-09-12T00:34:52.190174+0000","last_unstale":"2024-09-12T01:03:01.351704+0000","last_undegraded":"2024-09-12T01:03:01.351704+0000","last_fullsized":"2024-09-12T01:03:01.351704+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:22.602978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'29","reported_seq":121,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:32.539090+0000","last_change":"2024-09-12T00:33:10.850390+0000","last_active":"2024-09-12T01:01:32.539090+0000","last_peered":"2024-09-12T01:01:32.539090+0000","last_clean":"2024-09-12T01:01:32.539090+0000","last_became_active":"2024-09-12T00:33:10.849658+0000","last_became_peered":"2024-09-12T00:33:10.849658+0000","last_unstale":"2024-09-12T01:01:32.539090+0000","last_undegraded":"2024-09-12T01:01:32.539090+0000","last_fullsized":"2024-09-12T01:01:32.539090+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:17.300231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":91,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.545034+0000","last_change":"2024-09-12T00:46:09.487986+0000","last_active":"2024-09-12T01:01:57.545034+0000","last_peered":"2024-09-12T01:01:57.545034+0000","last_clean":"2024-09-12T01:01:57.545034+0000","last_became_active":"2024-09-12T00:46:09.485933+0000","last_became_peered":"2024-09-12T00:46:09.485933+0000","last_unstale":"2024-09-12T01:01:57.545034+0000","last_undegraded":"2024-09-12T01:01:57.545034+0000","last_fullsized":"2024-09-12T01:01:57.545034+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:26.699689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"268'2","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:11.364205+0000","last_change":"2024-09-12T00:34:55.237633+0000","last_active":"2024-09-12T01:04:11.364205+0000","last_peered":"2024-09-12T01:04:11.364205+0000","last_clean":"2024-09-12T01:04:11.364205+0000","last_became_active":"2024-09-12T00:34:55.236708+0000","last_became_peered":"2024-09-12T00:34:55.236708+0000","last_unstale":"2024-09-12T01:04:11.364205+0000","last_undegraded":"2024-09-12T01:04:11.364205+0000","last_fullsized":"2024-09-12T01:04:11.364205+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:53.892191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'4","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.047616+0000","last_change":"2024-09-12T00:34:52.209042+0000","last_active":"2024-09-12T01:04:39.047616+0000","last_peered":"2024-09-12T01:04:39.047616+0000","last_clean":"2024-09-12T01:04:39.047616+0000","last_became_active":"2024-09-12T00:34:52.205829+0000","last_became_peered":"2024-09-12T00:34:52.205829+0000","last_unstale":"2024-09-12T01:04:39.047616+0000","last_undegraded":"2024-09-12T01:04:39.047616+0000","last_fullsized":"2024-09-12T01:04:39.047616+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:59.524499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'30","reported_seq":133,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:21.746083+0000","last_change":"2024-09-12T00:33:10.825945+0000","last_active":"2024-09-12T01:01:21.746083+0000","last_peered":"2024-09-12T01:01:21.746083+0000","last_clean":"2024-09-12T01:01:21.746083+0000","last_became_active":"2024-09-12T00:33:10.825191+0000","last_became_peered":"2024-09-12T00:33:10.825191+0000","last_unstale":"2024-09-12T01:01:21.746083+0000","last_undegraded":"2024-09-12T01:01:21.746083+0000","last_fullsized":"2024-09-12T01:01:21.746083+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:47.230850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":116,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.571862+0000","last_change":"2024-09-12T00:46:09.505717+0000","last_active":"2024-09-12T01:01:56.571862+0000","last_peered":"2024-09-12T01:01:56.571862+0000","last_clean":"2024-09-12T01:01:56.571862+0000","last_became_active":"2024-09-12T00:46:09.504789+0000","last_became_peered":"2024-09-12T00:46:09.504789+0000","last_unstale":"2024-09-12T01:01:56.571862+0000","last_undegraded":"2024-09-12T01:01:56.571862+0000","last_fullsized":"2024-09-12T01:01:56.571862+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:54.929380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'2","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.533522+0000","last_change":"2024-09-12T00:34:55.238407+0000","last_active":"2024-09-12T01:01:07.533522+0000","last_peered":"2024-09-12T01:01:07.533522+0000","last_clean":"2024-09-12T01:01:07.533522+0000","last_became_active":"2024-09-12T00:34:55.237691+0000","last_became_peered":"2024-09-12T00:34:55.237691+0000","last_unstale":"2024-09-12T01:01:07.533522+0000","last_undegraded":"2024-09-12T01:01:07.533522+0000","last_fullsized":"2024-09-12T01:01:07.533522+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:43.698302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'8","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:52.545095+0000","last_change":"2024-09-12T00:34:52.200839+0000","last_active":"2024-09-12T01:01:52.545095+0000","last_peered":"2024-09-12T01:01:52.545095+0000","last_clean":"2024-09-12T01:01:52.545095+0000","last_became_active":"2024-09-12T00:34:52.200033+0000","last_became_peered":"2024-09-12T00:34:52.200033+0000","last_unstale":"2024-09-12T01:01:52.545095+0000","last_undegraded":"2024-09-12T01:01:52.545095+0000","last_fullsized":"2024-09-12T01:01:52.545095+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:12.523538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":17410,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'38","reported_seq":149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:20.583311+0000","last_change":"2024-09-12T00:33:10.856023+0000","last_active":"2024-09-12T01:02:20.583311+0000","last_peered":"2024-09-12T01:02:20.583311+0000","last_clean":"2024-09-12T01:02:20.583311+0000","last_became_active":"2024-09-12T00:33:10.855257+0000","last_became_peered":"2024-09-12T00:33:10.855257+0000","last_unstale":"2024-09-12T01:02:20.583311+0000","last_undegraded":"2024-09-12T01:02:20.583311+0000","last_fullsized":"2024-09-12T01:02:20.583311+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:54.073580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":126,"num_write":70,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.528702+0000","last_change":"2024-09-12T00:46:09.504978+0000","last_active":"2024-09-12T01:00:47.528702+0000","last_peered":"2024-09-12T01:00:47.528702+0000","last_clean":"2024-09-12T01:00:47.528702+0000","last_became_active":"2024-09-12T00:46:09.504114+0000","last_became_peered":"2024-09-12T00:46:09.504114+0000","last_unstale":"2024-09-12T01:00:47.528702+0000","last_undegraded":"2024-09-12T01:00:47.528702+0000","last_fullsized":"2024-09-12T01:00:47.528702+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:13.348535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'2","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.575855+0000","last_change":"2024-09-12T00:34:55.235646+0000","last_active":"2024-09-12T01:02:11.575855+0000","last_peered":"2024-09-12T01:02:11.575855+0000","last_clean":"2024-09-12T01:02:11.575855+0000","last_became_active":"2024-09-12T00:34:55.234795+0000","last_became_peered":"2024-09-12T00:34:55.234795+0000","last_unstale":"2024-09-12T01:02:11.575855+0000","last_undegraded":"2024-09-12T01:02:11.575855+0000","last_fullsized":"2024-09-12T01:02:11.575855+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:10.241846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"268'7","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:02.573483+0000","last_change":"2024-09-12T00:34:52.199095+0000","last_active":"2024-09-12T01:04:02.573483+0000","last_peered":"2024-09-12T01:04:02.573483+0000","last_clean":"2024-09-12T01:04:02.573483+0000","last_became_active":"2024-09-12T00:34:52.198346+0000","last_became_peered":"2024-09-12T00:34:52.198346+0000","last_unstale":"2024-09-12T01:04:02.573483+0000","last_undegraded":"2024-09-12T01:04:02.573483+0000","last_fullsized":"2024-09-12T01:04:02.573483+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:09.225827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'29","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:21.563766+0000","last_change":"2024-09-12T00:33:10.848211+0000","last_active":"2024-09-12T01:01:21.563766+0000","last_peered":"2024-09-12T01:01:21.563766+0000","last_clean":"2024-09-12T01:01:21.563766+0000","last_became_active":"2024-09-12T00:33:10.847386+0000","last_became_peered":"2024-09-12T00:33:10.847386+0000","last_unstale":"2024-09-12T01:01:21.563766+0000","last_undegraded":"2024-09-12T01:01:21.563766+0000","last_fullsized":"2024-09-12T01:01:21.563766+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:03.256270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":106,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.732885+0000","last_change":"2024-09-12T00:46:09.514213+0000","last_active":"2024-09-12T01:00:47.732885+0000","last_peered":"2024-09-12T01:00:47.732885+0000","last_clean":"2024-09-12T01:00:47.732885+0000","last_became_active":"2024-09-12T00:46:09.509685+0000","last_became_peered":"2024-09-12T00:46:09.509685+0000","last_unstale":"2024-09-12T01:00:47.732885+0000","last_undegraded":"2024-09-12T01:00:47.732885+0000","last_fullsized":"2024-09-12T01:00:47.732885+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:20.031144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"268'2","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:06.601647+0000","last_change":"2024-09-12T00:34:55.251608+0000","last_active":"2024-09-12T01:04:06.601647+0000","last_peered":"2024-09-12T01:04:06.601647+0000","last_clean":"2024-09-12T01:04:06.601647+0000","last_became_active":"2024-09-12T00:34:55.251057+0000","last_became_peered":"2024-09-12T00:34:55.251057+0000","last_unstale":"2024-09-12T01:04:06.601647+0000","last_undegraded":"2024-09-12T01:04:06.601647+0000","last_fullsized":"2024-09-12T01:04:06.601647+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:44.787440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"268'6","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:01.745019+0000","last_change":"2024-09-12T00:34:52.178623+0000","last_active":"2024-09-12T01:04:01.745019+0000","last_peered":"2024-09-12T01:04:01.745019+0000","last_clean":"2024-09-12T01:04:01.745019+0000","last_became_active":"2024-09-12T00:34:52.177088+0000","last_became_peered":"2024-09-12T00:34:52.177088+0000","last_unstale":"2024-09-12T01:04:01.745019+0000","last_undegraded":"2024-09-12T01:04:01.745019+0000","last_fullsized":"2024-09-12T01:04:01.745019+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:51.705833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"268'21","reported_seq":103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:22.721225+0000","last_change":"2024-09-12T00:33:10.845217+0000","last_active":"2024-09-12T01:01:22.721225+0000","last_peered":"2024-09-12T01:01:22.721225+0000","last_clean":"2024-09-12T01:01:22.721225+0000","last_became_active":"2024-09-12T00:33:10.844093+0000","last_became_peered":"2024-09-12T00:33:10.844093+0000","last_unstale":"2024-09-12T01:01:22.721225+0000","last_undegraded":"2024-09-12T01:01:22.721225+0000","last_fullsized":"2024-09-12T01:01:22.721225+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:20.325448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":69,"num_write":38,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:16.556161+0000","last_change":"2024-09-12T00:46:09.498490+0000","last_active":"2024-09-12T01:02:16.556161+0000","last_peered":"2024-09-12T01:02:16.556161+0000","last_clean":"2024-09-12T01:02:16.556161+0000","last_became_active":"2024-09-12T00:46:09.497751+0000","last_became_peered":"2024-09-12T00:46:09.497751+0000","last_unstale":"2024-09-12T01:02:16.556161+0000","last_undegraded":"2024-09-12T01:02:16.556161+0000","last_fullsized":"2024-09-12T01:02:16.556161+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.301246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":36,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.531241+0000","last_change":"2024-09-12T00:34:55.254981+0000","last_active":"2024-09-12T01:00:57.531241+0000","last_peered":"2024-09-12T01:00:57.531241+0000","last_clean":"2024-09-12T01:00:57.531241+0000","last_became_active":"2024-09-12T00:34:55.254446+0000","last_became_peered":"2024-09-12T00:34:55.254446+0000","last_unstale":"2024-09-12T01:00:57.531241+0000","last_undegraded":"2024-09-12T01:00:57.531241+0000","last_fullsized":"2024-09-12T01:00:57.531241+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:32.699370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:52.734131+0000","last_change":"2024-09-12T00:34:52.194065+0000","last_active":"2024-09-12T01:00:52.734131+0000","last_peered":"2024-09-12T01:00:52.734131+0000","last_clean":"2024-09-12T01:00:52.734131+0000","last_became_active":"2024-09-12T00:34:52.193306+0000","last_became_peered":"2024-09-12T00:34:52.193306+0000","last_unstale":"2024-09-12T01:00:52.734131+0000","last_undegraded":"2024-09-12T01:00:52.734131+0000","last_fullsized":"2024-09-12T01:00:52.734131+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:42.593529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"268'36","reported_seq":152,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:32.552885+0000","last_change":"2024-09-12T00:33:10.860393+0000","last_active":"2024-09-12T01:02:32.552885+0000","last_peered":"2024-09-12T01:02:32.552885+0000","last_clean":"2024-09-12T01:02:32.552885+0000","last_became_active":"2024-09-12T00:33:10.859799+0000","last_became_peered":"2024-09-12T00:33:10.859799+0000","last_unstale":"2024-09-12T01:02:32.552885+0000","last_undegraded":"2024-09-12T01:02:32.552885+0000","last_fullsized":"2024-09-12T01:02:32.552885+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:39.916797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":137,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.529751+0000","last_change":"2024-09-12T00:46:09.499691+0000","last_active":"2024-09-12T01:00:47.529751+0000","last_peered":"2024-09-12T01:00:47.529751+0000","last_clean":"2024-09-12T01:00:47.529751+0000","last_became_active":"2024-09-12T00:46:09.498942+0000","last_became_peered":"2024-09-12T00:46:09.498942+0000","last_unstale":"2024-09-12T01:00:47.529751+0000","last_undegraded":"2024-09-12T01:00:47.529751+0000","last_fullsized":"2024-09-12T01:00:47.529751+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:21.881186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'2","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.564072+0000","last_change":"2024-09-12T00:34:55.215046+0000","last_active":"2024-09-12T01:03:07.564072+0000","last_peered":"2024-09-12T01:03:07.564072+0000","last_clean":"2024-09-12T01:03:07.564072+0000","last_became_active":"2024-09-12T00:34:55.214265+0000","last_became_peered":"2024-09-12T00:34:55.214265+0000","last_unstale":"2024-09-12T01:03:07.564072+0000","last_undegraded":"2024-09-12T01:03:07.564072+0000","last_fullsized":"2024-09-12T01:03:07.564072+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:54.580385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"268'9","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.457051+0000","last_change":"2024-09-12T00:34:52.204774+0000","last_active":"2024-09-12T01:04:39.457051+0000","last_peered":"2024-09-12T01:04:39.457051+0000","last_clean":"2024-09-12T01:04:39.457051+0000","last_became_active":"2024-09-12T00:34:52.204050+0000","last_became_peered":"2024-09-12T00:34:52.204050+0000","last_unstale":"2024-09-12T01:04:39.457051+0000","last_undegraded":"2024-09-12T01:04:39.457051+0000","last_fullsized":"2024-09-12T01:04:39.457051+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:46.767075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5120,"num_write":14,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'20","reported_seq":104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.557497+0000","last_change":"2024-09-12T00:33:10.842211+0000","last_active":"2024-09-12T01:02:21.557497+0000","last_peered":"2024-09-12T01:02:21.557497+0000","last_clean":"2024-09-12T01:02:21.557497+0000","last_became_active":"2024-09-12T00:33:10.841411+0000","last_became_peered":"2024-09-12T00:33:10.841411+0000","last_unstale":"2024-09-12T01:02:21.557497+0000","last_undegraded":"2024-09-12T01:02:21.557497+0000","last_fullsized":"2024-09-12T01:02:21.557497+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:13.664749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":70,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"267'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:21.713593+0000","last_change":"2024-09-12T00:46:09.520640+0000","last_active":"2024-09-12T01:01:21.713593+0000","last_peered":"2024-09-12T01:01:21.713593+0000","last_clean":"2024-09-12T01:01:21.713593+0000","last_became_active":"2024-09-12T00:46:09.520251+0000","last_became_peered":"2024-09-12T00:46:09.520251+0000","last_unstale":"2024-09-12T01:01:21.713593+0000","last_undegraded":"2024-09-12T01:01:21.713593+0000","last_fullsized":"2024-09-12T01:01:21.713593+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:17.060682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"268'5","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:06.363265+0000","last_change":"2024-09-12T00:34:55.232689+0000","last_active":"2024-09-12T01:04:06.363265+0000","last_peered":"2024-09-12T01:04:06.363265+0000","last_clean":"2024-09-12T01:04:06.363265+0000","last_became_active":"2024-09-12T00:34:55.230698+0000","last_became_peered":"2024-09-12T00:34:55.230698+0000","last_unstale":"2024-09-12T01:04:06.363265+0000","last_undegraded":"2024-09-12T01:04:06.363265+0000","last_fullsized":"2024-09-12T01:04:06.363265+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:43.460598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"265'5","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.532248+0000","last_change":"2024-09-12T00:34:52.212267+0000","last_active":"2024-09-12T01:01:02.532248+0000","last_peered":"2024-09-12T01:01:02.532248+0000","last_clean":"2024-09-12T01:01:02.532248+0000","last_became_active":"2024-09-12T00:34:52.211709+0000","last_became_peered":"2024-09-12T00:34:52.211709+0000","last_unstale":"2024-09-12T01:01:02.532248+0000","last_undegraded":"2024-09-12T01:01:02.532248+0000","last_fullsized":"2024-09-12T01:01:02.532248+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:37.180708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'225","reported_seq":751,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:22.754603+0000","last_change":"2024-09-12T00:33:10.853482+0000","last_active":"2024-09-12T01:02:22.754603+0000","last_peered":"2024-09-12T01:02:22.754603+0000","last_clean":"2024-09-12T01:02:22.754603+0000","last_became_active":"2024-09-12T00:33:10.852751+0000","last_became_peered":"2024-09-12T00:33:10.852751+0000","last_unstale":"2024-09-12T01:02:22.754603+0000","last_undegraded":"2024-09-12T01:02:22.754603+0000","last_fullsized":"2024-09-12T01:02:22.754603+0000","mapping_epoch":255,"log_start":"265'200","ondisk_log_start":"265'200","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:29.381396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1385,"num_read_kb":1074,"num_write":267,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:21.563715+0000","last_change":"2024-09-12T00:46:09.516940+0000","last_active":"2024-09-12T01:01:21.563715+0000","last_peered":"2024-09-12T01:01:21.563715+0000","last_clean":"2024-09-12T01:01:21.563715+0000","last_became_active":"2024-09-12T00:46:09.516404+0000","last_became_peered":"2024-09-12T00:46:09.516404+0000","last_unstale":"2024-09-12T01:01:21.563715+0000","last_undegraded":"2024-09-12T01:01:21.563715+0000","last_fullsized":"2024-09-12T01:01:21.563715+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:40.623194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"268'8","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.849509+0000","last_change":"2024-09-12T00:34:55.236475+0000","last_active":"2024-09-12T01:04:39.849509+0000","last_peered":"2024-09-12T01:04:39.849509+0000","last_clean":"2024-09-12T01:04:39.849509+0000","last_became_active":"2024-09-12T00:34:55.235522+0000","last_became_peered":"2024-09-12T00:34:55.235522+0000","last_unstale":"2024-09-12T01:04:39.849509+0000","last_undegraded":"2024-09-12T01:04:39.849509+0000","last_fullsized":"2024-09-12T01:04:39.849509+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:26.945052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":10240,"num_write":8,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"268'6","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:02.573368+0000","last_change":"2024-09-12T00:34:52.184510+0000","last_active":"2024-09-12T01:04:02.573368+0000","last_peered":"2024-09-12T01:04:02.573368+0000","last_clean":"2024-09-12T01:04:02.573368+0000","last_became_active":"2024-09-12T00:34:52.183769+0000","last_became_peered":"2024-09-12T00:34:52.183769+0000","last_unstale":"2024-09-12T01:04:02.573368+0000","last_undegraded":"2024-09-12T01:04:02.573368+0000","last_fullsized":"2024-09-12T01:04:02.573368+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:59.439643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'27","reported_seq":122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:22.554180+0000","last_change":"2024-09-12T00:33:10.831668+0000","last_active":"2024-09-12T01:02:22.554180+0000","last_peered":"2024-09-12T01:02:22.554180+0000","last_clean":"2024-09-12T01:02:22.554180+0000","last_became_active":"2024-09-12T00:33:10.830931+0000","last_became_peered":"2024-09-12T00:33:10.830931+0000","last_unstale":"2024-09-12T01:02:22.554180+0000","last_undegraded":"2024-09-12T01:02:22.554180+0000","last_fullsized":"2024-09-12T01:02:22.554180+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:45.604877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":90,"num_write":55,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:46.551264+0000","last_change":"2024-09-12T00:46:09.518153+0000","last_active":"2024-09-12T01:00:46.551264+0000","last_peered":"2024-09-12T01:00:46.551264+0000","last_clean":"2024-09-12T01:00:46.551264+0000","last_became_active":"2024-09-12T00:46:09.517353+0000","last_became_peered":"2024-09-12T00:46:09.517353+0000","last_unstale":"2024-09-12T01:00:46.551264+0000","last_undegraded":"2024-09-12T01:00:46.551264+0000","last_fullsized":"2024-09-12T01:00:46.551264+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:41.256919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"268'9","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:07.380394+0000","last_change":"2024-09-12T00:34:55.225406+0000","last_active":"2024-09-12T01:04:07.380394+0000","last_peered":"2024-09-12T01:04:07.380394+0000","last_clean":"2024-09-12T01:04:07.380394+0000","last_became_active":"2024-09-12T00:34:55.224353+0000","last_became_peered":"2024-09-12T00:34:55.224353+0000","last_unstale":"2024-09-12T01:04:07.380394+0000","last_undegraded":"2024-09-12T01:04:07.380394+0000","last_fullsized":"2024-09-12T01:04:07.380394+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:35.525207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":22530,"num_write":14,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"268'6","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.308907+0000","last_change":"2024-09-12T00:34:52.204414+0000","last_active":"2024-09-12T01:04:39.308907+0000","last_peered":"2024-09-12T01:04:39.308907+0000","last_clean":"2024-09-12T01:04:39.308907+0000","last_became_active":"2024-09-12T00:34:52.203625+0000","last_became_peered":"2024-09-12T00:34:52.203625+0000","last_unstale":"2024-09-12T01:04:39.308907+0000","last_undegraded":"2024-09-12T01:04:39.308907+0000","last_fullsized":"2024-09-12T01:04:39.308907+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:35.762002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10299,"num_write":6,"num_write_kb":5179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'24","reported_seq":111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:22.733835+0000","last_change":"2024-09-12T00:33:10.845131+0000","last_active":"2024-09-12T01:02:22.733835+0000","last_peered":"2024-09-12T01:02:22.733835+0000","last_clean":"2024-09-12T01:02:22.733835+0000","last_became_active":"2024-09-12T00:33:10.844416+0000","last_became_peered":"2024-09-12T00:33:10.844416+0000","last_unstale":"2024-09-12T01:02:22.733835+0000","last_undegraded":"2024-09-12T01:02:22.733835+0000","last_fullsized":"2024-09-12T01:02:22.733835+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:44.761181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:52.529941+0000","last_change":"2024-09-12T00:46:09.494534+0000","last_active":"2024-09-12T01:00:52.529941+0000","last_peered":"2024-09-12T01:00:52.529941+0000","last_clean":"2024-09-12T01:00:52.529941+0000","last_became_active":"2024-09-12T00:46:09.493808+0000","last_became_peered":"2024-09-12T00:46:09.493808+0000","last_unstale":"2024-09-12T01:00:52.529941+0000","last_undegraded":"2024-09-12T01:00:52.529941+0000","last_fullsized":"2024-09-12T01:00:52.529941+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:01.945866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"268'2","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:07.576769+0000","last_change":"2024-09-12T00:34:55.234328+0000","last_active":"2024-09-12T01:04:07.576769+0000","last_peered":"2024-09-12T01:04:07.576769+0000","last_clean":"2024-09-12T01:04:07.576769+0000","last_became_active":"2024-09-12T00:34:55.233708+0000","last_became_peered":"2024-09-12T00:34:55.233708+0000","last_unstale":"2024-09-12T01:04:07.576769+0000","last_undegraded":"2024-09-12T01:04:07.576769+0000","last_fullsized":"2024-09-12T01:04:07.576769+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:10.278114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"268'2","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:02.379362+0000","last_change":"2024-09-12T00:34:52.188218+0000","last_active":"2024-09-12T01:04:02.379362+0000","last_peered":"2024-09-12T01:04:02.379362+0000","last_clean":"2024-09-12T01:04:02.379362+0000","last_became_active":"2024-09-12T00:34:52.186234+0000","last_became_peered":"2024-09-12T00:34:52.186234+0000","last_unstale":"2024-09-12T01:04:02.379362+0000","last_undegraded":"2024-09-12T01:04:02.379362+0000","last_fullsized":"2024-09-12T01:04:02.379362+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:37.401626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'27","reported_seq":126,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:22.536821+0000","last_change":"2024-09-12T00:33:10.853895+0000","last_active":"2024-09-12T01:01:22.536821+0000","last_peered":"2024-09-12T01:01:22.536821+0000","last_clean":"2024-09-12T01:01:22.536821+0000","last_became_active":"2024-09-12T00:33:10.853205+0000","last_became_peered":"2024-09-12T00:33:10.853205+0000","last_unstale":"2024-09-12T01:01:22.536821+0000","last_undegraded":"2024-09-12T01:01:22.536821+0000","last_fullsized":"2024-09-12T01:01:22.536821+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:11.434006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":100,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'363","reported_seq":1010,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.087303+0000","last_change":"2024-09-12T00:18:22.882778+0000","last_active":"2024-09-12T01:04:40.087303+0000","last_peered":"2024-09-12T01:04:40.087303+0000","last_clean":"2024-09-12T01:04:40.087303+0000","last_became_active":"2024-09-12T00:18:22.878117+0000","last_became_peered":"2024-09-12T00:18:22.878117+0000","last_unstale":"2024-09-12T01:04:40.087303+0000","last_undegraded":"2024-09-12T01:04:40.087303+0000","last_fullsized":"2024-09-12T01:04:40.087303+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:42.771146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":522,"num_read_kb":62534,"num_write":1202,"num_write_kb":43415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'436","reported_seq":1878,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.826302+0000","last_change":"2024-09-12T00:18:24.871900+0000","last_active":"2024-09-12T01:04:30.826302+0000","last_peered":"2024-09-12T01:04:30.826302+0000","last_clean":"2024-09-12T01:04:30.826302+0000","last_became_active":"2024-09-12T00:18:24.870370+0000","last_became_peered":"2024-09-12T00:18:24.870370+0000","last_unstale":"2024-09-12T01:04:30.826302+0000","last_undegraded":"2024-09-12T01:04:30.826302+0000","last_fullsized":"2024-09-12T01:04:30.826302+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:30.348388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2205,"num_read_kb":2060,"num_write":503,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'338","reported_seq":983,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.126027+0000","last_change":"2024-09-12T00:18:22.845696+0000","last_active":"2024-09-12T01:04:40.126027+0000","last_peered":"2024-09-12T01:04:40.126027+0000","last_clean":"2024-09-12T01:04:40.126027+0000","last_became_active":"2024-09-12T00:18:22.845439+0000","last_became_peered":"2024-09-12T00:18:22.845439+0000","last_unstale":"2024-09-12T01:04:40.126027+0000","last_undegraded":"2024-09-12T01:04:40.126027+0000","last_fullsized":"2024-09-12T01:04:40.126027+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:58.019520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079947,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":485,"num_read_kb":5684,"num_write":1011,"num_write_kb":33510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'1348","reported_seq":3035,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.828330+0000","last_change":"2024-09-12T00:18:24.872059+0000","last_active":"2024-09-12T01:04:30.828330+0000","last_peered":"2024-09-12T01:04:30.828330+0000","last_clean":"2024-09-12T01:04:30.828330+0000","last_became_active":"2024-09-12T00:18:24.866026+0000","last_became_peered":"2024-09-12T00:18:24.866026+0000","last_unstale":"2024-09-12T01:04:30.828330+0000","last_undegraded":"2024-09-12T01:04:30.828330+0000","last_fullsized":"2024-09-12T01:04:30.828330+0000","mapping_epoch":26,"log_start":"268'1300","ondisk_log_start":"268'1300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":1300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:28.162969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6196,"num_read_kb":5451,"num_write":1895,"num_write_kb":802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'339","reported_seq":1028,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.120762+0000","last_change":"2024-09-12T00:18:22.839649+0000","last_active":"2024-09-12T01:04:40.120762+0000","last_peered":"2024-09-12T01:04:40.120762+0000","last_clean":"2024-09-12T01:04:40.120762+0000","last_became_active":"2024-09-12T00:18:22.839379+0000","last_became_peered":"2024-09-12T00:18:22.839379+0000","last_unstale":"2024-09-12T01:04:40.120762+0000","last_undegraded":"2024-09-12T01:04:40.120762+0000","last_fullsized":"2024-09-12T01:04:40.120762+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:58.587843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560796,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":569,"num_read_kb":68999,"num_write":1084,"num_write_kb":32744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'868","reported_seq":2673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.884045+0000","last_change":"2024-09-12T00:18:24.861905+0000","last_active":"2024-09-12T01:03:25.884045+0000","last_peered":"2024-09-12T01:03:25.884045+0000","last_clean":"2024-09-12T01:03:25.884045+0000","last_became_active":"2024-09-12T00:18:24.860995+0000","last_became_peered":"2024-09-12T00:18:24.860995+0000","last_unstale":"2024-09-12T01:03:25.884045+0000","last_undegraded":"2024-09-12T01:03:25.884045+0000","last_fullsized":"2024-09-12T01:03:25.884045+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:40.241884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4298,"num_read_kb":3905,"num_write":1128,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'332","reported_seq":989,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.080282+0000","last_change":"2024-09-12T00:18:55.961308+0000","last_active":"2024-09-12T01:04:40.080282+0000","last_peered":"2024-09-12T01:04:40.080282+0000","last_clean":"2024-09-12T01:04:40.080282+0000","last_became_active":"2024-09-12T00:18:55.960413+0000","last_became_peered":"2024-09-12T00:18:55.960413+0000","last_unstale":"2024-09-12T01:04:40.080282+0000","last_undegraded":"2024-09-12T01:04:40.080282+0000","last_fullsized":"2024-09-12T01:04:40.080282+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:23.952063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":867046,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":485,"num_read_kb":54980,"num_write":1073,"num_write_kb":32836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'765","reported_seq":2314,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.594303+0000","last_change":"2024-09-12T00:18:55.956119+0000","last_active":"2024-09-12T01:03:26.594303+0000","last_peered":"2024-09-12T01:03:26.594303+0000","last_clean":"2024-09-12T01:03:26.594303+0000","last_became_active":"2024-09-12T00:18:55.955870+0000","last_became_peered":"2024-09-12T00:18:55.955870+0000","last_unstale":"2024-09-12T01:03:26.594303+0000","last_undegraded":"2024-09-12T01:03:26.594303+0000","last_fullsized":"2024-09-12T01:03:26.594303+0000","mapping_epoch":37,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:06.351457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3626,"num_read_kb":3280,"num_write":1010,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'337","reported_seq":966,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.103244+0000","last_change":"2024-09-12T00:18:22.878663+0000","last_active":"2024-09-12T01:04:40.103244+0000","last_peered":"2024-09-12T01:04:40.103244+0000","last_clean":"2024-09-12T01:04:40.103244+0000","last_became_active":"2024-09-12T00:18:22.870564+0000","last_became_peered":"2024-09-12T00:18:22.870564+0000","last_unstale":"2024-09-12T01:04:40.103244+0000","last_undegraded":"2024-09-12T01:04:40.103244+0000","last_fullsized":"2024-09-12T01:04:40.103244+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:54.849057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":498,"num_read_kb":32133,"num_write":1040,"num_write_kb":41090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"268'482","reported_seq":2083,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.841743+0000","last_change":"2024-09-12T00:18:24.847333+0000","last_active":"2024-09-12T01:04:30.841743+0000","last_peered":"2024-09-12T01:04:30.841743+0000","last_clean":"2024-09-12T01:04:30.841743+0000","last_became_active":"2024-09-12T00:18:24.846508+0000","last_became_peered":"2024-09-12T00:18:24.846508+0000","last_unstale":"2024-09-12T01:04:30.841743+0000","last_undegraded":"2024-09-12T01:04:30.841743+0000","last_fullsized":"2024-09-12T01:04:30.841743+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:28.677103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2844,"num_read_kb":2655,"num_write":659,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'349","reported_seq":984,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.112655+0000","last_change":"2024-09-12T00:18:22.862931+0000","last_active":"2024-09-12T01:04:40.112655+0000","last_peered":"2024-09-12T01:04:40.112655+0000","last_clean":"2024-09-12T01:04:40.112655+0000","last_became_active":"2024-09-12T00:18:22.861074+0000","last_became_peered":"2024-09-12T00:18:22.861074+0000","last_unstale":"2024-09-12T01:04:40.112655+0000","last_undegraded":"2024-09-12T01:04:40.112655+0000","last_fullsized":"2024-09-12T01:04:40.112655+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:03.827376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":434032,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":541,"num_read_kb":4860,"num_write":1084,"num_write_kb":10925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'1019","reported_seq":2748,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.884432+0000","last_change":"2024-09-12T00:18:24.878012+0000","last_active":"2024-09-12T01:03:25.884432+0000","last_peered":"2024-09-12T01:03:25.884432+0000","last_clean":"2024-09-12T01:03:25.884432+0000","last_became_active":"2024-09-12T00:18:24.875913+0000","last_became_peered":"2024-09-12T00:18:24.875913+0000","last_unstale":"2024-09-12T01:03:25.884432+0000","last_undegraded":"2024-09-12T01:03:25.884432+0000","last_fullsized":"2024-09-12T01:03:25.884432+0000","mapping_epoch":26,"log_start":"268'1000","ondisk_log_start":"268'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":1000,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:16.720932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4809,"num_read_kb":4259,"num_write":1397,"num_write_kb":538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'285","reported_seq":871,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.122874+0000","last_change":"2024-09-12T00:19:56.413205+0000","last_active":"2024-09-12T01:04:40.122874+0000","last_peered":"2024-09-12T01:04:40.122874+0000","last_clean":"2024-09-12T01:04:40.122874+0000","last_became_active":"2024-09-12T00:19:56.412792+0000","last_became_peered":"2024-09-12T00:19:56.412792+0000","last_unstale":"2024-09-12T01:04:40.122874+0000","last_undegraded":"2024-09-12T01:04:40.122874+0000","last_fullsized":"2024-09-12T01:04:40.122874+0000","mapping_epoch":39,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:43.504414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1343091,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":402,"num_read_kb":40979,"num_write":972,"num_write_kb":28776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"268'464","reported_seq":2043,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.191451+0000","last_change":"2024-09-12T00:18:24.862828+0000","last_active":"2024-09-12T01:03:11.191451+0000","last_peered":"2024-09-12T01:03:11.191451+0000","last_clean":"2024-09-12T01:03:11.191451+0000","last_became_active":"2024-09-12T00:18:24.862084+0000","last_became_peered":"2024-09-12T00:18:24.862084+0000","last_unstale":"2024-09-12T01:03:11.191451+0000","last_undegraded":"2024-09-12T01:03:11.191451+0000","last_fullsized":"2024-09-12T01:03:11.191451+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:22.898376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2471,"num_read_kb":2327,"num_write":538,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'370","reported_seq":1017,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.118778+0000","last_change":"2024-09-12T00:18:22.867992+0000","last_active":"2024-09-12T01:04:40.118778+0000","last_peered":"2024-09-12T01:04:40.118778+0000","last_clean":"2024-09-12T01:04:40.118778+0000","last_became_active":"2024-09-12T00:18:22.867749+0000","last_became_peered":"2024-09-12T00:18:22.867749+0000","last_unstale":"2024-09-12T01:04:40.118778+0000","last_undegraded":"2024-09-12T01:04:40.118778+0000","last_fullsized":"2024-09-12T01:04:40.118778+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:43.955119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":529,"num_read_kb":6849,"num_write":1205,"num_write_kb":38257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'505","reported_seq":2322,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.741434+0000","last_change":"2024-09-12T00:18:24.848517+0000","last_active":"2024-09-12T01:03:06.741434+0000","last_peered":"2024-09-12T01:03:06.741434+0000","last_clean":"2024-09-12T01:03:06.741434+0000","last_became_active":"2024-09-12T00:18:24.848163+0000","last_became_peered":"2024-09-12T00:18:24.848163+0000","last_unstale":"2024-09-12T01:03:06.741434+0000","last_undegraded":"2024-09-12T01:03:06.741434+0000","last_fullsized":"2024-09-12T01:03:06.741434+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:12.252460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2972,"num_read_kb":2819,"num_write":593,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'484","reported_seq":2139,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.426992+0000","last_change":"2024-09-12T00:18:24.861887+0000","last_active":"2024-09-12T01:03:09.426992+0000","last_peered":"2024-09-12T01:03:09.426992+0000","last_clean":"2024-09-12T01:03:09.426992+0000","last_became_active":"2024-09-12T00:18:24.860744+0000","last_became_peered":"2024-09-12T00:18:24.860744+0000","last_unstale":"2024-09-12T01:03:09.426992+0000","last_undegraded":"2024-09-12T01:03:09.426992+0000","last_fullsized":"2024-09-12T01:03:09.426992+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:47.298360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2780,"num_read_kb":2600,"num_write":590,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'308","reported_seq":913,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.129361+0000","last_change":"2024-09-12T00:18:55.963205+0000","last_active":"2024-09-12T01:04:40.129361+0000","last_peered":"2024-09-12T01:04:40.129361+0000","last_clean":"2024-09-12T01:04:40.129361+0000","last_became_active":"2024-09-12T00:18:55.962742+0000","last_became_peered":"2024-09-12T00:18:55.962742+0000","last_unstale":"2024-09-12T01:04:40.129361+0000","last_undegraded":"2024-09-12T01:04:40.129361+0000","last_fullsized":"2024-09-12T01:04:40.129361+0000","mapping_epoch":37,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:05.336107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":391,"num_read_kb":39262,"num_write":935,"num_write_kb":33071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'395","reported_seq":1848,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.099361+0000","last_change":"2024-09-12T00:18:24.873912+0000","last_active":"2024-09-12T01:03:25.099361+0000","last_peered":"2024-09-12T01:03:25.099361+0000","last_clean":"2024-09-12T01:03:25.099361+0000","last_became_active":"2024-09-12T00:18:24.872902+0000","last_became_peered":"2024-09-12T00:18:24.872902+0000","last_unstale":"2024-09-12T01:03:25.099361+0000","last_undegraded":"2024-09-12T01:03:25.099361+0000","last_fullsized":"2024-09-12T01:03:25.099361+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:21.474486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2097,"num_read_kb":1984,"num_write":437,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'305","reported_seq":916,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.108947+0000","last_change":"2024-09-12T00:18:22.864186+0000","last_active":"2024-09-12T01:04:40.108947+0000","last_peered":"2024-09-12T01:04:40.108947+0000","last_clean":"2024-09-12T01:04:40.108947+0000","last_became_active":"2024-09-12T00:18:22.860078+0000","last_became_peered":"2024-09-12T00:18:22.860078+0000","last_unstale":"2024-09-12T01:04:40.108947+0000","last_undegraded":"2024-09-12T01:04:40.108947+0000","last_fullsized":"2024-09-12T01:04:40.108947+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:36.759909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4534636,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":413,"num_read_kb":38650,"num_write":947,"num_write_kb":29439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"268'420","reported_seq":2039,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.347017+0000","last_change":"2024-09-12T00:18:24.852828+0000","last_active":"2024-09-12T01:03:37.347017+0000","last_peered":"2024-09-12T01:03:37.347017+0000","last_clean":"2024-09-12T01:03:37.347017+0000","last_became_active":"2024-09-12T00:18:24.852029+0000","last_became_peered":"2024-09-12T00:18:24.852029+0000","last_unstale":"2024-09-12T01:03:37.347017+0000","last_undegraded":"2024-09-12T01:03:37.347017+0000","last_fullsized":"2024-09-12T01:03:37.347017+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:43.017405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2334,"num_read_kb":2233,"num_write":466,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'317","reported_seq":919,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.085589+0000","last_change":"2024-09-12T00:18:22.863392+0000","last_active":"2024-09-12T01:04:40.085589+0000","last_peered":"2024-09-12T01:04:40.085589+0000","last_clean":"2024-09-12T01:04:40.085589+0000","last_became_active":"2024-09-12T00:18:22.862665+0000","last_became_peered":"2024-09-12T00:18:22.862665+0000","last_unstale":"2024-09-12T01:04:40.085589+0000","last_undegraded":"2024-09-12T01:04:40.085589+0000","last_fullsized":"2024-09-12T01:04:40.085589+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:02.077750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079909,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":401,"num_read_kb":22932,"num_write":945,"num_write_kb":21492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'474","reported_seq":2097,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.094302+0000","last_change":"2024-09-12T00:18:24.850211+0000","last_active":"2024-09-12T01:03:04.094302+0000","last_peered":"2024-09-12T01:03:04.094302+0000","last_clean":"2024-09-12T01:03:04.094302+0000","last_became_active":"2024-09-12T00:18:24.849491+0000","last_became_peered":"2024-09-12T00:18:24.849491+0000","last_unstale":"2024-09-12T01:03:04.094302+0000","last_undegraded":"2024-09-12T01:03:04.094302+0000","last_fullsized":"2024-09-12T01:03:04.094302+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:35.044376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2579,"num_read_kb":2421,"num_write":543,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'349","reported_seq":974,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.113372+0000","last_change":"2024-09-12T00:18:22.857585+0000","last_active":"2024-09-12T01:04:40.113372+0000","last_peered":"2024-09-12T01:04:40.113372+0000","last_clean":"2024-09-12T01:04:40.113372+0000","last_became_active":"2024-09-12T00:18:22.856051+0000","last_became_peered":"2024-09-12T00:18:22.856051+0000","last_unstale":"2024-09-12T01:04:40.113372+0000","last_undegraded":"2024-09-12T01:04:40.113372+0000","last_fullsized":"2024-09-12T01:04:40.113372+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:50.867035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":458,"num_read_kb":24886,"num_write":1069,"num_write_kb":15091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"268'428","reported_seq":1974,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.171993+0000","last_change":"2024-09-12T00:18:24.854571+0000","last_active":"2024-09-12T01:02:58.171993+0000","last_peered":"2024-09-12T01:02:58.171993+0000","last_clean":"2024-09-12T01:02:58.171993+0000","last_became_active":"2024-09-12T00:18:24.853796+0000","last_became_peered":"2024-09-12T00:18:24.853796+0000","last_unstale":"2024-09-12T01:02:58.171993+0000","last_undegraded":"2024-09-12T01:02:58.171993+0000","last_fullsized":"2024-09-12T01:02:58.171993+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:33.514455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2472,"num_read_kb":2322,"num_write":521,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'323","reported_seq":1076,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.085706+0000","last_change":"2024-09-12T00:18:22.838428+0000","last_active":"2024-09-12T01:04:40.085706+0000","last_peered":"2024-09-12T01:04:40.085706+0000","last_clean":"2024-09-12T01:04:40.085706+0000","last_became_active":"2024-09-12T00:18:22.834904+0000","last_became_peered":"2024-09-12T00:18:22.834904+0000","last_unstale":"2024-09-12T01:04:40.085706+0000","last_undegraded":"2024-09-12T01:04:40.085706+0000","last_fullsized":"2024-09-12T01:04:40.085706+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:19.289534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":584,"num_read_kb":49706,"num_write":1054,"num_write_kb":43110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'502","reported_seq":2049,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.347103+0000","last_change":"2024-09-12T00:18:24.876805+0000","last_active":"2024-09-12T01:03:37.347103+0000","last_peered":"2024-09-12T01:03:37.347103+0000","last_clean":"2024-09-12T01:03:37.347103+0000","last_became_active":"2024-09-12T00:18:24.875112+0000","last_became_peered":"2024-09-12T00:18:24.875112+0000","last_unstale":"2024-09-12T01:03:37.347103+0000","last_undegraded":"2024-09-12T01:03:37.347103+0000","last_fullsized":"2024-09-12T01:03:37.347103+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:20.839260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2595,"num_read_kb":2402,"num_write":619,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'375","reported_seq":1065,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.111875+0000","last_change":"2024-09-12T00:18:22.841353+0000","last_active":"2024-09-12T01:04:40.111875+0000","last_peered":"2024-09-12T01:04:40.111875+0000","last_clean":"2024-09-12T01:04:40.111875+0000","last_became_active":"2024-09-12T00:18:22.841069+0000","last_became_peered":"2024-09-12T00:18:22.841069+0000","last_unstale":"2024-09-12T01:04:40.111875+0000","last_undegraded":"2024-09-12T01:04:40.111875+0000","last_fullsized":"2024-09-12T01:04:40.111875+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:51.842199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":685,"num_read_kb":23761,"num_write":1283,"num_write_kb":30294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'127","reported_seq":651,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.974481+0000","last_change":"2024-09-12T00:18:32.894030+0000","last_active":"2024-09-12T01:03:25.974481+0000","last_peered":"2024-09-12T01:03:25.974481+0000","last_clean":"2024-09-12T01:03:25.974481+0000","last_became_active":"2024-09-12T00:18:32.893410+0000","last_became_peered":"2024-09-12T00:18:32.893410+0000","last_unstale":"2024-09-12T01:03:25.974481+0000","last_undegraded":"2024-09-12T01:03:25.974481+0000","last_fullsized":"2024-09-12T01:03:25.974481+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:21.781324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":200,"num_read_kb":180,"num_write":310,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'427","reported_seq":2029,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.883962+0000","last_change":"2024-09-12T00:18:24.863390+0000","last_active":"2024-09-12T01:03:25.883962+0000","last_peered":"2024-09-12T01:03:25.883962+0000","last_clean":"2024-09-12T01:03:25.883962+0000","last_became_active":"2024-09-12T00:18:24.862963+0000","last_became_peered":"2024-09-12T00:18:24.862963+0000","last_unstale":"2024-09-12T01:03:25.883962+0000","last_undegraded":"2024-09-12T01:03:25.883962+0000","last_fullsized":"2024-09-12T01:03:25.883962+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:47.762563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2444,"num_read_kb":2313,"num_write":504,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"268'336","reported_seq":980,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.106866+0000","last_change":"2024-09-12T00:18:55.955847+0000","last_active":"2024-09-12T01:04:40.106866+0000","last_peered":"2024-09-12T01:04:40.106866+0000","last_clean":"2024-09-12T01:04:40.106866+0000","last_became_active":"2024-09-12T00:18:55.954978+0000","last_became_peered":"2024-09-12T00:18:55.954978+0000","last_unstale":"2024-09-12T01:04:40.106866+0000","last_undegraded":"2024-09-12T01:04:40.106866+0000","last_fullsized":"2024-09-12T01:04:40.106866+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:00.249837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":485,"num_read_kb":26304,"num_write":1090,"num_write_kb":30933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.749399+0000","last_change":"2024-09-12T00:18:26.872530+0000","last_active":"2024-09-12T01:01:57.749399+0000","last_peered":"2024-09-12T01:01:57.749399+0000","last_clean":"2024-09-12T01:01:57.749399+0000","last_became_active":"2024-09-12T00:18:26.871803+0000","last_became_peered":"2024-09-12T00:18:26.871803+0000","last_unstale":"2024-09-12T01:01:57.749399+0000","last_undegraded":"2024-09-12T01:01:57.749399+0000","last_fullsized":"2024-09-12T01:01:57.749399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:22.818539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'341","reported_seq":958,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.402373+0000","last_change":"2024-09-12T00:18:28.875623+0000","last_active":"2024-09-12T01:04:39.402373+0000","last_peered":"2024-09-12T01:04:39.402373+0000","last_clean":"2024-09-12T01:04:39.402373+0000","last_became_active":"2024-09-12T00:18:28.874861+0000","last_became_peered":"2024-09-12T00:18:28.874861+0000","last_unstale":"2024-09-12T01:04:39.402373+0000","last_undegraded":"2024-09-12T01:04:39.402373+0000","last_fullsized":"2024-09-12T01:04:39.402373+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:25.073806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51345,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":553,"num_read_kb":1147,"num_write":436,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.546262+0000","last_change":"2024-09-12T00:18:30.894626+0000","last_active":"2024-09-12T01:02:02.546262+0000","last_peered":"2024-09-12T01:02:02.546262+0000","last_clean":"2024-09-12T01:02:02.546262+0000","last_became_active":"2024-09-12T00:18:30.893886+0000","last_became_peered":"2024-09-12T00:18:30.893886+0000","last_unstale":"2024-09-12T01:02:02.546262+0000","last_undegraded":"2024-09-12T01:02:02.546262+0000","last_fullsized":"2024-09-12T01:02:02.546262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:00.518894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'2426","reported_seq":4321,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.416183+0000","last_change":"2024-09-12T00:18:32.899968+0000","last_active":"2024-09-12T01:03:37.416183+0000","last_peered":"2024-09-12T01:03:37.416183+0000","last_clean":"2024-09-12T01:03:37.416183+0000","last_became_active":"2024-09-12T00:18:32.899168+0000","last_became_peered":"2024-09-12T00:18:32.899168+0000","last_unstale":"2024-09-12T01:03:37.416183+0000","last_undegraded":"2024-09-12T01:03:37.416183+0000","last_fullsized":"2024-09-12T01:03:37.416183+0000","mapping_epoch":34,"log_start":"268'2400","ondisk_log_start":"268'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":2400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:13.149755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6111,"num_read_kb":6108,"num_write":4843,"num_write_kb":1788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'1288","reported_seq":2834,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.884108+0000","last_change":"2024-09-12T00:18:24.870986+0000","last_active":"2024-09-12T01:03:25.884108+0000","last_peered":"2024-09-12T01:03:25.884108+0000","last_clean":"2024-09-12T01:03:25.884108+0000","last_became_active":"2024-09-12T00:18:24.869219+0000","last_became_peered":"2024-09-12T00:18:24.869219+0000","last_unstale":"2024-09-12T01:03:25.884108+0000","last_undegraded":"2024-09-12T01:03:25.884108+0000","last_fullsized":"2024-09-12T01:03:25.884108+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":1200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:32.390226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5815,"num_read_kb":5070,"num_write":1809,"num_write_kb":816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'273","reported_seq":850,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:46.448096+0000","last_change":"2024-09-12T01:04:46.448096+0000","last_active":"2024-09-12T01:04:46.448096+0000","last_peered":"2024-09-12T01:04:46.448096+0000","last_clean":"2024-09-12T01:04:46.448096+0000","last_became_active":"2024-09-12T00:18:55.953363+0000","last_became_peered":"2024-09-12T00:18:55.953363+0000","last_unstale":"2024-09-12T01:04:46.448096+0000","last_undegraded":"2024-09-12T01:04:46.448096+0000","last_fullsized":"2024-09-12T01:04:46.448096+0000","mapping_epoch":37,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'273","last_scrub_stamp":"2024-09-12T01:04:46.447974+0000","last_deep_scrub":"268'273","last_deep_scrub_stamp":"2024-09-12T01:04:46.447974+0000","last_clean_scrub_stamp":"2024-09-12T01:04:46.447974+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:00.461692+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079954,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":346,"num_read_kb":12333,"num_write":862,"num_write_kb":28931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:31.733365+0000","last_change":"2024-09-12T00:18:26.848809+0000","last_active":"2024-09-12T01:00:31.733365+0000","last_peered":"2024-09-12T01:00:31.733365+0000","last_clean":"2024-09-12T01:00:31.733365+0000","last_became_active":"2024-09-12T00:18:26.848272+0000","last_became_peered":"2024-09-12T00:18:26.848272+0000","last_unstale":"2024-09-12T01:00:31.733365+0000","last_undegraded":"2024-09-12T01:00:31.733365+0000","last_fullsized":"2024-09-12T01:00:31.733365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:32.968436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'90","reported_seq":626,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.547603+0000","last_change":"2024-09-12T00:18:28.883255+0000","last_active":"2024-09-12T01:02:02.547603+0000","last_peered":"2024-09-12T01:02:02.547603+0000","last_clean":"2024-09-12T01:02:02.547603+0000","last_became_active":"2024-09-12T00:18:28.882630+0000","last_became_peered":"2024-09-12T00:18:28.882630+0000","last_unstale":"2024-09-12T01:02:02.547603+0000","last_undegraded":"2024-09-12T01:02:02.547603+0000","last_fullsized":"2024-09-12T01:02:02.547603+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:19.332138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":98,"num_write":70,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.547576+0000","last_change":"2024-09-12T00:18:30.901543+0000","last_active":"2024-09-12T01:02:02.547576+0000","last_peered":"2024-09-12T01:02:02.547576+0000","last_clean":"2024-09-12T01:02:02.547576+0000","last_became_active":"2024-09-12T00:18:30.900908+0000","last_became_peered":"2024-09-12T00:18:30.900908+0000","last_unstale":"2024-09-12T01:02:02.547576+0000","last_undegraded":"2024-09-12T01:02:02.547576+0000","last_fullsized":"2024-09-12T01:02:02.547576+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:06.507522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'120","reported_seq":626,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.178090+0000","last_change":"2024-09-12T00:18:32.910263+0000","last_active":"2024-09-12T01:02:58.178090+0000","last_peered":"2024-09-12T01:02:58.178090+0000","last_clean":"2024-09-12T01:02:58.178090+0000","last_became_active":"2024-09-12T00:18:32.909547+0000","last_became_peered":"2024-09-12T00:18:32.909547+0000","last_unstale":"2024-09-12T01:02:58.178090+0000","last_undegraded":"2024-09-12T01:02:58.178090+0000","last_fullsized":"2024-09-12T01:02:58.178090+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:15.935680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":128,"num_write":294,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'1255","reported_seq":2899,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.742323+0000","last_change":"2024-09-12T00:18:24.859628+0000","last_active":"2024-09-12T01:03:06.742323+0000","last_peered":"2024-09-12T01:03:06.742323+0000","last_clean":"2024-09-12T01:03:06.742323+0000","last_became_active":"2024-09-12T00:18:24.859237+0000","last_became_peered":"2024-09-12T00:18:24.859237+0000","last_unstale":"2024-09-12T01:03:06.742323+0000","last_undegraded":"2024-09-12T01:03:06.742323+0000","last_fullsized":"2024-09-12T01:03:06.742323+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:27.993852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5766,"num_read_kb":5095,"num_write":1782,"num_write_kb":773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'380","reported_seq":1098,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.091589+0000","last_change":"2024-09-12T00:18:22.878983+0000","last_active":"2024-09-12T01:04:40.091589+0000","last_peered":"2024-09-12T01:04:40.091589+0000","last_clean":"2024-09-12T01:04:40.091589+0000","last_became_active":"2024-09-12T00:18:22.873262+0000","last_became_peered":"2024-09-12T00:18:22.873262+0000","last_unstale":"2024-09-12T01:04:40.091589+0000","last_undegraded":"2024-09-12T01:04:40.091589+0000","last_fullsized":"2024-09-12T01:04:40.091589+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:06.551453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":606,"num_read_kb":24526,"num_write":1220,"num_write_kb":41630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.756017+0000","last_change":"2024-09-12T00:18:26.855885+0000","last_active":"2024-09-12T01:01:56.756017+0000","last_peered":"2024-09-12T01:01:56.756017+0000","last_clean":"2024-09-12T01:01:56.756017+0000","last_became_active":"2024-09-12T00:18:26.855348+0000","last_became_peered":"2024-09-12T00:18:26.855348+0000","last_unstale":"2024-09-12T01:01:56.756017+0000","last_undegraded":"2024-09-12T01:01:56.756017+0000","last_fullsized":"2024-09-12T01:01:56.756017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:48.816326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'118","reported_seq":670,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:19.297862+0000","last_change":"2024-09-12T00:18:28.885573+0000","last_active":"2024-09-12T01:01:19.297862+0000","last_peered":"2024-09-12T01:01:19.297862+0000","last_clean":"2024-09-12T01:01:19.297862+0000","last_became_active":"2024-09-12T00:18:28.884722+0000","last_became_peered":"2024-09-12T00:18:28.884722+0000","last_unstale":"2024-09-12T01:01:19.297862+0000","last_undegraded":"2024-09-12T01:01:19.297862+0000","last_fullsized":"2024-09-12T01:01:19.297862+0000","mapping_epoch":30,"log_start":"268'100","ondisk_log_start":"268'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:22.842377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":98,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'784","reported_seq":4742,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.731633+0000","last_change":"2024-09-12T00:18:30.894494+0000","last_active":"2024-09-12T01:04:39.731633+0000","last_peered":"2024-09-12T01:04:39.731633+0000","last_clean":"2024-09-12T01:04:39.731633+0000","last_became_active":"2024-09-12T00:18:30.893739+0000","last_became_peered":"2024-09-12T00:18:30.893739+0000","last_unstale":"2024-09-12T01:04:39.731633+0000","last_undegraded":"2024-09-12T01:04:39.731633+0000","last_fullsized":"2024-09-12T01:04:39.731633+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:28.177468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'210","reported_seq":1045,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.023471+0000","last_change":"2024-09-12T00:18:32.884849+0000","last_active":"2024-09-12T01:03:26.023471+0000","last_peered":"2024-09-12T01:03:26.023471+0000","last_clean":"2024-09-12T01:03:26.023471+0000","last_became_active":"2024-09-12T00:18:32.884130+0000","last_became_peered":"2024-09-12T00:18:32.884130+0000","last_unstale":"2024-09-12T01:03:26.023471+0000","last_undegraded":"2024-09-12T01:03:26.023471+0000","last_fullsized":"2024-09-12T01:03:26.023471+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:08.903193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":639,"num_read_kb":629,"num_write":484,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'892","reported_seq":2621,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.348876+0000","last_change":"2024-09-12T00:18:24.868470+0000","last_active":"2024-09-12T01:03:37.348876+0000","last_peered":"2024-09-12T01:03:37.348876+0000","last_clean":"2024-09-12T01:03:37.348876+0000","last_became_active":"2024-09-12T00:18:24.868103+0000","last_became_peered":"2024-09-12T00:18:24.868103+0000","last_unstale":"2024-09-12T01:03:37.348876+0000","last_undegraded":"2024-09-12T01:03:37.348876+0000","last_fullsized":"2024-09-12T01:03:37.348876+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":800,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:19.861066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4419,"num_read_kb":4003,"num_write":1187,"num_write_kb":433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'315","reported_seq":932,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.136901+0000","last_change":"2024-09-12T00:18:22.852318+0000","last_active":"2024-09-12T01:04:40.136901+0000","last_peered":"2024-09-12T01:04:40.136901+0000","last_clean":"2024-09-12T01:04:40.136901+0000","last_became_active":"2024-09-12T00:18:22.850530+0000","last_became_peered":"2024-09-12T00:18:22.850530+0000","last_unstale":"2024-09-12T01:04:40.136901+0000","last_undegraded":"2024-09-12T01:04:40.136901+0000","last_fullsized":"2024-09-12T01:04:40.136901+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:16.232313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263200,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":460,"num_read_kb":6949,"num_write":1090,"num_write_kb":36294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.749449+0000","last_change":"2024-09-12T00:18:26.868989+0000","last_active":"2024-09-12T01:01:57.749449+0000","last_peered":"2024-09-12T01:01:57.749449+0000","last_clean":"2024-09-12T01:01:57.749449+0000","last_became_active":"2024-09-12T00:18:26.867729+0000","last_became_peered":"2024-09-12T00:18:26.867729+0000","last_unstale":"2024-09-12T01:01:57.749449+0000","last_undegraded":"2024-09-12T01:01:57.749449+0000","last_fullsized":"2024-09-12T01:01:57.749449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:38.364796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'264","reported_seq":839,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.179373+0000","last_change":"2024-09-12T00:18:28.885774+0000","last_active":"2024-09-12T01:04:39.179373+0000","last_peered":"2024-09-12T01:04:39.179373+0000","last_clean":"2024-09-12T01:04:39.179373+0000","last_became_active":"2024-09-12T00:18:28.884779+0000","last_became_peered":"2024-09-12T00:18:28.884779+0000","last_unstale":"2024-09-12T01:04:39.179373+0000","last_undegraded":"2024-09-12T01:04:39.179373+0000","last_fullsized":"2024-09-12T01:04:39.179373+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:17.954386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49225,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":1009,"num_write":358,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'816","reported_seq":2286,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.568233+0000","last_change":"2024-09-12T00:18:30.903331+0000","last_active":"2024-09-12T01:04:38.568233+0000","last_peered":"2024-09-12T01:04:38.568233+0000","last_clean":"2024-09-12T01:04:38.568233+0000","last_became_active":"2024-09-12T00:18:30.894642+0000","last_became_peered":"2024-09-12T00:18:30.894642+0000","last_unstale":"2024-09-12T01:04:38.568233+0000","last_undegraded":"2024-09-12T01:04:38.568233+0000","last_fullsized":"2024-09-12T01:04:38.568233+0000","mapping_epoch":32,"log_start":"268'800","ondisk_log_start":"268'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:23.687695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'475","reported_seq":2078,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.413042+0000","last_change":"2024-09-12T00:18:24.871053+0000","last_active":"2024-09-12T01:03:37.413042+0000","last_peered":"2024-09-12T01:03:37.413042+0000","last_clean":"2024-09-12T01:03:37.413042+0000","last_became_active":"2024-09-12T00:18:24.869435+0000","last_became_peered":"2024-09-12T00:18:24.869435+0000","last_unstale":"2024-09-12T01:03:37.413042+0000","last_undegraded":"2024-09-12T01:03:37.413042+0000","last_fullsized":"2024-09-12T01:03:37.413042+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:43.049599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2569,"num_read_kb":2408,"num_write":545,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'373","reported_seq":1001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.077815+0000","last_change":"2024-09-12T00:18:22.881670+0000","last_active":"2024-09-12T01:04:40.077815+0000","last_peered":"2024-09-12T01:04:40.077815+0000","last_clean":"2024-09-12T01:04:40.077815+0000","last_became_active":"2024-09-12T00:18:22.877327+0000","last_became_peered":"2024-09-12T00:18:22.877327+0000","last_unstale":"2024-09-12T01:04:40.077815+0000","last_undegraded":"2024-09-12T01:04:40.077815+0000","last_fullsized":"2024-09-12T01:04:40.077815+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:34.237861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170146,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":498,"num_read_kb":23147,"num_write":1077,"num_write_kb":55226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:47.542554+0000","last_change":"2024-09-12T00:18:26.876329+0000","last_active":"2024-09-12T01:01:47.542554+0000","last_peered":"2024-09-12T01:01:47.542554+0000","last_clean":"2024-09-12T01:01:47.542554+0000","last_became_active":"2024-09-12T00:18:26.874638+0000","last_became_peered":"2024-09-12T00:18:26.874638+0000","last_unstale":"2024-09-12T01:01:47.542554+0000","last_undegraded":"2024-09-12T01:01:47.542554+0000","last_fullsized":"2024-09-12T01:01:47.542554+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:33.159889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'335","reported_seq":954,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.584718+0000","last_change":"2024-09-12T00:18:28.896980+0000","last_active":"2024-09-12T01:04:39.584718+0000","last_peered":"2024-09-12T01:04:39.584718+0000","last_clean":"2024-09-12T01:04:39.584718+0000","last_became_active":"2024-09-12T00:18:28.895950+0000","last_became_peered":"2024-09-12T00:18:28.895950+0000","last_unstale":"2024-09-12T01:04:39.584718+0000","last_undegraded":"2024-09-12T01:04:39.584718+0000","last_fullsized":"2024-09-12T01:04:39.584718+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:16.223388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19722,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":538,"num_read_kb":1043,"num_write":414,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:16.542412+0000","last_change":"2024-09-12T00:18:30.874823+0000","last_active":"2024-09-12T01:01:16.542412+0000","last_peered":"2024-09-12T01:01:16.542412+0000","last_clean":"2024-09-12T01:01:16.542412+0000","last_became_active":"2024-09-12T00:18:30.874074+0000","last_became_peered":"2024-09-12T00:18:30.874074+0000","last_unstale":"2024-09-12T01:01:16.542412+0000","last_undegraded":"2024-09-12T01:01:16.542412+0000","last_fullsized":"2024-09-12T01:01:16.542412+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:46.157942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'552","reported_seq":1366,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.801949+0000","last_change":"2024-09-12T00:18:32.900714+0000","last_active":"2024-09-12T01:04:31.801949+0000","last_peered":"2024-09-12T01:04:31.801949+0000","last_clean":"2024-09-12T01:04:31.801949+0000","last_became_active":"2024-09-12T00:18:32.899046+0000","last_became_peered":"2024-09-12T00:18:32.899046+0000","last_unstale":"2024-09-12T01:04:31.801949+0000","last_undegraded":"2024-09-12T01:04:31.801949+0000","last_fullsized":"2024-09-12T01:04:31.801949+0000","mapping_epoch":34,"log_start":"268'500","ondisk_log_start":"268'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:25.804502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1268,"num_read_kb":1267,"num_write":1132,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'483","reported_seq":2092,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.248460+0000","last_change":"2024-09-12T00:18:24.862220+0000","last_active":"2024-09-12T01:02:59.248460+0000","last_peered":"2024-09-12T01:02:59.248460+0000","last_clean":"2024-09-12T01:02:59.248460+0000","last_became_active":"2024-09-12T00:18:24.861455+0000","last_became_peered":"2024-09-12T00:18:24.861455+0000","last_unstale":"2024-09-12T01:02:59.248460+0000","last_undegraded":"2024-09-12T01:02:59.248460+0000","last_fullsized":"2024-09-12T01:02:59.248460+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:58.186022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2490,"num_read_kb":2350,"num_write":569,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'365","reported_seq":1020,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.136646+0000","last_change":"2024-09-12T00:18:22.872925+0000","last_active":"2024-09-12T01:04:40.136646+0000","last_peered":"2024-09-12T01:04:40.136646+0000","last_clean":"2024-09-12T01:04:40.136646+0000","last_became_active":"2024-09-12T00:18:22.871330+0000","last_became_peered":"2024-09-12T00:18:22.871330+0000","last_unstale":"2024-09-12T01:04:40.136646+0000","last_undegraded":"2024-09-12T01:04:40.136646+0000","last_fullsized":"2024-09-12T01:04:40.136646+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:49.802108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22053,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":541,"num_read_kb":9754,"num_write":1101,"num_write_kb":25837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"36'3","reported_seq":985,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.294266+0000","last_change":"2024-09-12T00:18:26.859307+0000","last_active":"2024-09-12T01:04:38.294266+0000","last_peered":"2024-09-12T01:04:38.294266+0000","last_clean":"2024-09-12T01:04:38.294266+0000","last_became_active":"2024-09-12T00:18:26.858529+0000","last_became_peered":"2024-09-12T00:18:26.858529+0000","last_unstale":"2024-09-12T01:04:38.294266+0000","last_undegraded":"2024-09-12T01:04:38.294266+0000","last_fullsized":"2024-09-12T01:04:38.294266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:58.521971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'286","reported_seq":870,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.143127+0000","last_change":"2024-09-12T00:18:28.896114+0000","last_active":"2024-09-12T01:04:40.143127+0000","last_peered":"2024-09-12T01:04:40.143127+0000","last_clean":"2024-09-12T01:04:40.143127+0000","last_became_active":"2024-09-12T00:18:28.895521+0000","last_became_peered":"2024-09-12T00:18:28.895521+0000","last_unstale":"2024-09-12T01:04:40.143127+0000","last_undegraded":"2024-09-12T01:04:40.143127+0000","last_fullsized":"2024-09-12T01:04:40.143127+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:58.027139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":471,"num_read_kb":1097,"num_write":388,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.755573+0000","last_change":"2024-09-12T00:18:30.907840+0000","last_active":"2024-09-12T01:01:56.755573+0000","last_peered":"2024-09-12T01:01:56.755573+0000","last_clean":"2024-09-12T01:01:56.755573+0000","last_became_active":"2024-09-12T00:18:30.905601+0000","last_became_peered":"2024-09-12T00:18:30.905601+0000","last_unstale":"2024-09-12T01:01:56.755573+0000","last_undegraded":"2024-09-12T01:01:56.755573+0000","last_fullsized":"2024-09-12T01:01:56.755573+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:08.252494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'122","reported_seq":612,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:20.723358+0000","last_change":"2024-09-12T00:18:32.900357+0000","last_active":"2024-09-12T01:04:20.723358+0000","last_peered":"2024-09-12T01:04:20.723358+0000","last_clean":"2024-09-12T01:04:20.723358+0000","last_became_active":"2024-09-12T00:18:32.899284+0000","last_became_peered":"2024-09-12T00:18:32.899284+0000","last_unstale":"2024-09-12T01:04:20.723358+0000","last_undegraded":"2024-09-12T01:04:20.723358+0000","last_fullsized":"2024-09-12T01:04:20.723358+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:39.218682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":95,"num_write":292,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'840","reported_seq":2341,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.885035+0000","last_change":"2024-09-12T00:18:24.871047+0000","last_active":"2024-09-12T01:03:25.885035+0000","last_peered":"2024-09-12T01:03:25.885035+0000","last_clean":"2024-09-12T01:03:25.885035+0000","last_became_active":"2024-09-12T00:18:24.869582+0000","last_became_peered":"2024-09-12T00:18:24.869582+0000","last_unstale":"2024-09-12T01:03:25.885035+0000","last_undegraded":"2024-09-12T01:03:25.885035+0000","last_fullsized":"2024-09-12T01:03:25.885035+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":800,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:44.515642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4018,"num_read_kb":3569,"num_write":1156,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'262","reported_seq":862,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.091568+0000","last_change":"2024-09-12T00:18:22.881172+0000","last_active":"2024-09-12T01:04:40.091568+0000","last_peered":"2024-09-12T01:04:40.091568+0000","last_clean":"2024-09-12T01:04:40.091568+0000","last_became_active":"2024-09-12T00:18:22.875150+0000","last_became_peered":"2024-09-12T00:18:22.875150+0000","last_unstale":"2024-09-12T01:04:40.091568+0000","last_undegraded":"2024-09-12T01:04:40.091568+0000","last_fullsized":"2024-09-12T01:04:40.091568+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:21.799238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174702,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":374,"num_read_kb":19791,"num_write":779,"num_write_kb":25570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'5","reported_seq":984,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.292875+0000","last_change":"2024-09-12T00:18:26.858101+0000","last_active":"2024-09-12T01:04:38.292875+0000","last_peered":"2024-09-12T01:04:38.292875+0000","last_clean":"2024-09-12T01:04:38.292875+0000","last_became_active":"2024-09-12T00:18:26.857788+0000","last_became_peered":"2024-09-12T00:18:26.857788+0000","last_unstale":"2024-09-12T01:04:38.292875+0000","last_undegraded":"2024-09-12T01:04:38.292875+0000","last_fullsized":"2024-09-12T01:04:38.292875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:18.621326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'304","reported_seq":902,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.663169+0000","last_change":"2024-09-12T00:18:28.887534+0000","last_active":"2024-09-12T01:04:39.663169+0000","last_peered":"2024-09-12T01:04:39.663169+0000","last_clean":"2024-09-12T01:04:39.663169+0000","last_became_active":"2024-09-12T00:18:28.886806+0000","last_became_peered":"2024-09-12T00:18:28.886806+0000","last_unstale":"2024-09-12T01:04:39.663169+0000","last_undegraded":"2024-09-12T01:04:39.663169+0000","last_fullsized":"2024-09-12T01:04:39.663169+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:57.100168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45713,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":494,"num_read_kb":1053,"num_write":392,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'808","reported_seq":2411,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.056456+0000","last_change":"2024-09-12T00:18:30.895445+0000","last_active":"2024-09-12T01:04:40.056456+0000","last_peered":"2024-09-12T01:04:40.056456+0000","last_clean":"2024-09-12T01:04:40.056456+0000","last_became_active":"2024-09-12T00:18:30.888688+0000","last_became_peered":"2024-09-12T00:18:30.888688+0000","last_unstale":"2024-09-12T01:04:40.056456+0000","last_undegraded":"2024-09-12T01:04:40.056456+0000","last_fullsized":"2024-09-12T01:04:40.056456+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:44.135657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'131","reported_seq":633,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.832406+0000","last_change":"2024-09-12T00:18:32.909612+0000","last_active":"2024-09-12T01:04:30.832406+0000","last_peered":"2024-09-12T01:04:30.832406+0000","last_clean":"2024-09-12T01:04:30.832406+0000","last_became_active":"2024-09-12T00:18:32.904609+0000","last_became_peered":"2024-09-12T00:18:32.904609+0000","last_unstale":"2024-09-12T01:04:30.832406+0000","last_undegraded":"2024-09-12T01:04:30.832406+0000","last_fullsized":"2024-09-12T01:04:30.832406+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:02.670740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":137,"num_read_kb":127,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'815","reported_seq":2289,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.884794+0000","last_change":"2024-09-12T00:18:24.857093+0000","last_active":"2024-09-12T01:03:25.884794+0000","last_peered":"2024-09-12T01:03:25.884794+0000","last_clean":"2024-09-12T01:03:25.884794+0000","last_became_active":"2024-09-12T00:18:24.856572+0000","last_became_peered":"2024-09-12T00:18:24.856572+0000","last_unstale":"2024-09-12T01:03:25.884794+0000","last_undegraded":"2024-09-12T01:03:25.884794+0000","last_fullsized":"2024-09-12T01:03:25.884794+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:45.768362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3705,"num_read_kb":3326,"num_write":1078,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'381","reported_seq":1091,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.121203+0000","last_change":"2024-09-12T00:18:22.871676+0000","last_active":"2024-09-12T01:04:40.121203+0000","last_peered":"2024-09-12T01:04:40.121203+0000","last_clean":"2024-09-12T01:04:40.121203+0000","last_became_active":"2024-09-12T00:18:22.865067+0000","last_became_peered":"2024-09-12T00:18:22.865067+0000","last_unstale":"2024-09-12T01:04:40.121203+0000","last_undegraded":"2024-09-12T01:04:40.121203+0000","last_fullsized":"2024-09-12T01:04:40.121203+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:05.321786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300494,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":644,"num_read_kb":35348,"num_write":1371,"num_write_kb":29498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:51.719678+0000","last_change":"2024-09-12T00:18:26.868176+0000","last_active":"2024-09-12T01:01:51.719678+0000","last_peered":"2024-09-12T01:01:51.719678+0000","last_clean":"2024-09-12T01:01:51.719678+0000","last_became_active":"2024-09-12T00:18:26.867793+0000","last_became_peered":"2024-09-12T00:18:26.867793+0000","last_unstale":"2024-09-12T01:01:51.719678+0000","last_undegraded":"2024-09-12T01:01:51.719678+0000","last_fullsized":"2024-09-12T01:01:51.719678+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:45.564325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'475","reported_seq":1121,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.758256+0000","last_change":"2024-09-12T00:18:28.876606+0000","last_active":"2024-09-12T01:04:39.758256+0000","last_peered":"2024-09-12T01:04:39.758256+0000","last_clean":"2024-09-12T01:04:39.758256+0000","last_became_active":"2024-09-12T00:18:28.875891+0000","last_became_peered":"2024-09-12T00:18:28.875891+0000","last_unstale":"2024-09-12T01:04:39.758256+0000","last_undegraded":"2024-09-12T01:04:39.758256+0000","last_fullsized":"2024-09-12T01:04:39.758256+0000","mapping_epoch":30,"log_start":"268'400","ondisk_log_start":"268'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:20.466018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96447,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":834,"num_read_kb":1977,"num_write":680,"num_write_kb":567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:51.719618+0000","last_change":"2024-09-12T00:18:30.896208+0000","last_active":"2024-09-12T01:01:51.719618+0000","last_peered":"2024-09-12T01:01:51.719618+0000","last_clean":"2024-09-12T01:01:51.719618+0000","last_became_active":"2024-09-12T00:18:30.895401+0000","last_became_peered":"2024-09-12T00:18:30.895401+0000","last_unstale":"2024-09-12T01:01:51.719618+0000","last_undegraded":"2024-09-12T01:01:51.719618+0000","last_fullsized":"2024-09-12T01:01:51.719618+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:42.017008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'152","reported_seq":679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.551335+0000","last_change":"2024-09-12T00:18:32.893457+0000","last_active":"2024-09-12T01:01:56.551335+0000","last_peered":"2024-09-12T01:01:56.551335+0000","last_clean":"2024-09-12T01:01:56.551335+0000","last_became_active":"2024-09-12T00:18:32.892682+0000","last_became_peered":"2024-09-12T00:18:32.892682+0000","last_unstale":"2024-09-12T01:01:56.551335+0000","last_undegraded":"2024-09-12T01:01:56.551335+0000","last_fullsized":"2024-09-12T01:01:56.551335+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:17.913143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1103,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":196,"num_read_kb":180,"num_write":352,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'459","reported_seq":2074,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.823138+0000","last_change":"2024-09-12T00:18:24.853418+0000","last_active":"2024-09-12T01:04:30.823138+0000","last_peered":"2024-09-12T01:04:30.823138+0000","last_clean":"2024-09-12T01:04:30.823138+0000","last_became_active":"2024-09-12T00:18:24.852683+0000","last_became_peered":"2024-09-12T00:18:24.852683+0000","last_unstale":"2024-09-12T01:04:30.823138+0000","last_undegraded":"2024-09-12T01:04:30.823138+0000","last_fullsized":"2024-09-12T01:04:30.823138+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:11.403174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2390,"num_read_kb":2271,"num_write":519,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'361","reported_seq":1011,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.008711+0000","last_change":"2024-09-12T00:18:22.842425+0000","last_active":"2024-09-12T01:04:40.008711+0000","last_peered":"2024-09-12T01:04:40.008711+0000","last_clean":"2024-09-12T01:04:40.008711+0000","last_became_active":"2024-09-12T00:18:22.841689+0000","last_became_peered":"2024-09-12T00:18:22.841689+0000","last_unstale":"2024-09-12T01:04:40.008711+0000","last_undegraded":"2024-09-12T01:04:40.008711+0000","last_fullsized":"2024-09-12T01:04:40.008711+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:53.341537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194384,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":496,"num_read_kb":55770,"num_write":1160,"num_write_kb":35616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:11.710704+0000","last_change":"2024-09-12T00:18:26.858051+0000","last_active":"2024-09-12T01:01:11.710704+0000","last_peered":"2024-09-12T01:01:11.710704+0000","last_clean":"2024-09-12T01:01:11.710704+0000","last_became_active":"2024-09-12T00:18:26.845618+0000","last_became_peered":"2024-09-12T00:18:26.845618+0000","last_unstale":"2024-09-12T01:01:11.710704+0000","last_undegraded":"2024-09-12T01:01:11.710704+0000","last_fullsized":"2024-09-12T01:01:11.710704+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:08.376001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'299","reported_seq":886,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.918791+0000","last_change":"2024-09-12T00:18:28.885743+0000","last_active":"2024-09-12T01:04:38.918791+0000","last_peered":"2024-09-12T01:04:38.918791+0000","last_clean":"2024-09-12T01:04:38.918791+0000","last_became_active":"2024-09-12T00:18:28.884044+0000","last_became_peered":"2024-09-12T00:18:28.884044+0000","last_unstale":"2024-09-12T01:04:38.918791+0000","last_undegraded":"2024-09-12T01:04:38.918791+0000","last_fullsized":"2024-09-12T01:04:38.918791+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:10.970556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53187,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":519,"num_read_kb":1172,"num_write":464,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":492,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:26.564933+0000","last_change":"2024-09-12T00:18:30.903530+0000","last_active":"2024-09-12T01:01:26.564933+0000","last_peered":"2024-09-12T01:01:26.564933+0000","last_clean":"2024-09-12T01:01:26.564933+0000","last_became_active":"2024-09-12T00:18:30.902697+0000","last_became_peered":"2024-09-12T00:18:30.902697+0000","last_unstale":"2024-09-12T01:01:26.564933+0000","last_undegraded":"2024-09-12T01:01:26.564933+0000","last_fullsized":"2024-09-12T01:01:26.564933+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:52.611643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'136","reported_seq":637,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:20.726584+0000","last_change":"2024-09-12T00:18:32.901132+0000","last_active":"2024-09-12T01:04:20.726584+0000","last_peered":"2024-09-12T01:04:20.726584+0000","last_clean":"2024-09-12T01:04:20.726584+0000","last_became_active":"2024-09-12T00:18:32.900235+0000","last_became_peered":"2024-09-12T00:18:32.900235+0000","last_unstale":"2024-09-12T01:04:20.726584+0000","last_undegraded":"2024-09-12T01:04:20.726584+0000","last_fullsized":"2024-09-12T01:04:20.726584+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:52.036568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":465,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":124,"num_read_kb":118,"num_write":347,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'436","reported_seq":2078,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.197412+0000","last_change":"2024-09-12T00:18:24.873781+0000","last_active":"2024-09-12T01:03:08.197412+0000","last_peered":"2024-09-12T01:03:08.197412+0000","last_clean":"2024-09-12T01:03:08.197412+0000","last_became_active":"2024-09-12T00:18:24.872637+0000","last_became_peered":"2024-09-12T00:18:24.872637+0000","last_unstale":"2024-09-12T01:03:08.197412+0000","last_undegraded":"2024-09-12T01:03:08.197412+0000","last_fullsized":"2024-09-12T01:03:08.197412+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:31.196044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2400,"num_read_kb":2300,"num_write":500,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'349","reported_seq":1028,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.138045+0000","last_change":"2024-09-12T00:18:22.862177+0000","last_active":"2024-09-12T01:04:40.138045+0000","last_peered":"2024-09-12T01:04:40.138045+0000","last_clean":"2024-09-12T01:04:40.138045+0000","last_became_active":"2024-09-12T00:18:22.861450+0000","last_became_peered":"2024-09-12T00:18:22.861450+0000","last_unstale":"2024-09-12T01:04:40.138045+0000","last_undegraded":"2024-09-12T01:04:40.138045+0000","last_fullsized":"2024-09-12T01:04:40.138045+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:19.289534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":662355,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":585,"num_read_kb":32647,"num_write":1179,"num_write_kb":29925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:11.541211+0000","last_change":"2024-09-12T00:18:26.859580+0000","last_active":"2024-09-12T01:01:11.541211+0000","last_peered":"2024-09-12T01:01:11.541211+0000","last_clean":"2024-09-12T01:01:11.541211+0000","last_became_active":"2024-09-12T00:18:26.859109+0000","last_became_peered":"2024-09-12T00:18:26.859109+0000","last_unstale":"2024-09-12T01:01:11.541211+0000","last_undegraded":"2024-09-12T01:01:11.541211+0000","last_fullsized":"2024-09-12T01:01:11.541211+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:53.815705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'303","reported_seq":894,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.014048+0000","last_change":"2024-09-12T00:18:28.882686+0000","last_active":"2024-09-12T01:04:40.014048+0000","last_peered":"2024-09-12T01:04:40.014048+0000","last_clean":"2024-09-12T01:04:40.014048+0000","last_became_active":"2024-09-12T00:18:28.881947+0000","last_became_peered":"2024-09-12T00:18:28.881947+0000","last_unstale":"2024-09-12T01:04:40.014048+0000","last_undegraded":"2024-09-12T01:04:40.014048+0000","last_fullsized":"2024-09-12T01:04:40.014048+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:53.647502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45222,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":499,"num_read_kb":1119,"num_write":404,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'746","reported_seq":4316,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.558998+0000","last_change":"2024-09-12T00:18:30.873089+0000","last_active":"2024-09-12T01:04:38.558998+0000","last_peered":"2024-09-12T01:04:38.558998+0000","last_clean":"2024-09-12T01:04:38.558998+0000","last_became_active":"2024-09-12T00:18:30.872360+0000","last_became_peered":"2024-09-12T00:18:30.872360+0000","last_unstale":"2024-09-12T01:04:38.558998+0000","last_undegraded":"2024-09-12T01:04:38.558998+0000","last_fullsized":"2024-09-12T01:04:38.558998+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":700,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:32.019462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'112","reported_seq":623,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.964702+0000","last_change":"2024-09-12T00:18:32.897273+0000","last_active":"2024-09-12T01:03:25.964702+0000","last_peered":"2024-09-12T01:03:25.964702+0000","last_clean":"2024-09-12T01:03:25.964702+0000","last_became_active":"2024-09-12T00:18:32.896338+0000","last_became_peered":"2024-09-12T00:18:32.896338+0000","last_unstale":"2024-09-12T01:03:25.964702+0000","last_undegraded":"2024-09-12T01:03:25.964702+0000","last_fullsized":"2024-09-12T01:03:25.964702+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:36.916435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":125,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'462","reported_seq":2012,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.821991+0000","last_change":"2024-09-12T00:18:24.880332+0000","last_active":"2024-09-12T01:04:30.821991+0000","last_peered":"2024-09-12T01:04:30.821991+0000","last_clean":"2024-09-12T01:04:30.821991+0000","last_became_active":"2024-09-12T00:18:24.879622+0000","last_became_peered":"2024-09-12T00:18:24.879622+0000","last_unstale":"2024-09-12T01:04:30.821991+0000","last_undegraded":"2024-09-12T01:04:30.821991+0000","last_fullsized":"2024-09-12T01:04:30.821991+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:02.247072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2528,"num_read_kb":2373,"num_write":555,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'408","reported_seq":1113,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.190525+0000","last_change":"2024-09-12T01:04:47.190525+0000","last_active":"2024-09-12T01:04:47.190525+0000","last_peered":"2024-09-12T01:04:47.190525+0000","last_clean":"2024-09-12T01:04:47.190525+0000","last_became_active":"2024-09-12T00:18:22.847861+0000","last_became_peered":"2024-09-12T00:18:22.847861+0000","last_unstale":"2024-09-12T01:04:47.190525+0000","last_undegraded":"2024-09-12T01:04:47.190525+0000","last_fullsized":"2024-09-12T01:04:47.190525+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'408","last_scrub_stamp":"2024-09-12T01:04:47.190319+0000","last_deep_scrub":"268'408","last_deep_scrub_stamp":"2024-09-12T01:04:47.190319+0000","last_clean_scrub_stamp":"2024-09-12T01:04:47.190319+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:08.728064+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":711,"num_read_kb":61883,"num_write":1220,"num_write_kb":26157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1454,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.307415+0000","last_change":"2024-09-12T00:18:26.872031+0000","last_active":"2024-09-12T01:04:38.307415+0000","last_peered":"2024-09-12T01:04:38.307415+0000","last_clean":"2024-09-12T01:04:38.307415+0000","last_became_active":"2024-09-12T00:18:26.871356+0000","last_became_peered":"2024-09-12T00:18:26.871356+0000","last_unstale":"2024-09-12T01:04:38.307415+0000","last_undegraded":"2024-09-12T01:04:38.307415+0000","last_fullsized":"2024-09-12T01:04:38.307415+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:31.045577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'72","reported_seq":600,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:16.745058+0000","last_change":"2024-09-12T00:18:28.889216+0000","last_active":"2024-09-12T01:01:16.745058+0000","last_peered":"2024-09-12T01:01:16.745058+0000","last_clean":"2024-09-12T01:01:16.745058+0000","last_became_active":"2024-09-12T00:18:28.888423+0000","last_became_peered":"2024-09-12T00:18:28.888423+0000","last_unstale":"2024-09-12T01:01:16.745058+0000","last_undegraded":"2024-09-12T01:01:16.745058+0000","last_fullsized":"2024-09-12T01:01:16.745058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:38.462514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":78,"num_read_kb":72,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'768","reported_seq":2115,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.737575+0000","last_change":"2024-09-12T00:18:30.902806+0000","last_active":"2024-09-12T01:04:39.737575+0000","last_peered":"2024-09-12T01:04:39.737575+0000","last_clean":"2024-09-12T01:04:39.737575+0000","last_became_active":"2024-09-12T00:18:30.898814+0000","last_became_peered":"2024-09-12T00:18:30.898814+0000","last_unstale":"2024-09-12T01:04:39.737575+0000","last_undegraded":"2024-09-12T01:04:39.737575+0000","last_fullsized":"2024-09-12T01:04:39.737575+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:14.302064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'94","reported_seq":594,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.707747+0000","last_change":"2024-09-12T00:18:32.909724+0000","last_active":"2024-09-12T01:03:20.707747+0000","last_peered":"2024-09-12T01:03:20.707747+0000","last_clean":"2024-09-12T01:03:20.707747+0000","last_became_active":"2024-09-12T00:18:32.907797+0000","last_became_peered":"2024-09-12T00:18:32.907797+0000","last_unstale":"2024-09-12T01:03:20.707747+0000","last_undegraded":"2024-09-12T01:03:20.707747+0000","last_fullsized":"2024-09-12T01:03:20.707747+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:54.545857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":73,"num_write":219,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'509","reported_seq":2082,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.413084+0000","last_change":"2024-09-12T00:18:56.197323+0000","last_active":"2024-09-12T01:03:37.413084+0000","last_peered":"2024-09-12T01:03:37.413084+0000","last_clean":"2024-09-12T01:03:37.413084+0000","last_became_active":"2024-09-12T00:18:56.196419+0000","last_became_peered":"2024-09-12T00:18:56.196419+0000","last_unstale":"2024-09-12T01:03:37.413084+0000","last_undegraded":"2024-09-12T01:03:37.413084+0000","last_fullsized":"2024-09-12T01:03:37.413084+0000","mapping_epoch":37,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:19.400713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2644,"num_read_kb":2454,"num_write":619,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"268'406","reported_seq":1190,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.090529+0000","last_change":"2024-09-12T00:18:22.835371+0000","last_active":"2024-09-12T01:04:40.090529+0000","last_peered":"2024-09-12T01:04:40.090529+0000","last_clean":"2024-09-12T01:04:40.090529+0000","last_became_active":"2024-09-12T00:18:22.834072+0000","last_became_peered":"2024-09-12T00:18:22.834072+0000","last_unstale":"2024-09-12T01:04:40.090529+0000","last_undegraded":"2024-09-12T01:04:40.090529+0000","last_fullsized":"2024-09-12T01:04:40.090529+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:54.066638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":207192,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":853,"num_read_kb":11806,"num_write":1194,"num_write_kb":23298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.536055+0000","last_change":"2024-09-12T00:18:26.872530+0000","last_active":"2024-09-12T01:01:12.536055+0000","last_peered":"2024-09-12T01:01:12.536055+0000","last_clean":"2024-09-12T01:01:12.536055+0000","last_became_active":"2024-09-12T00:18:26.871183+0000","last_became_peered":"2024-09-12T00:18:26.871183+0000","last_unstale":"2024-09-12T01:01:12.536055+0000","last_undegraded":"2024-09-12T01:01:12.536055+0000","last_fullsized":"2024-09-12T01:01:12.536055+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:37.626693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'370","reported_seq":978,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.450673+0000","last_change":"2024-09-12T00:18:28.895040+0000","last_active":"2024-09-12T01:04:39.450673+0000","last_peered":"2024-09-12T01:04:39.450673+0000","last_clean":"2024-09-12T01:04:39.450673+0000","last_became_active":"2024-09-12T00:18:28.889343+0000","last_became_peered":"2024-09-12T00:18:28.889343+0000","last_unstale":"2024-09-12T01:04:39.450673+0000","last_undegraded":"2024-09-12T01:04:39.450673+0000","last_fullsized":"2024-09-12T01:04:39.450673+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:17.252099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45461,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1181,"num_read_kb":1792,"num_write":1688,"num_write_kb":1549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":490,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:17.720087+0000","last_change":"2024-09-12T00:18:30.906396+0000","last_active":"2024-09-12T01:01:17.720087+0000","last_peered":"2024-09-12T01:01:17.720087+0000","last_clean":"2024-09-12T01:01:17.720087+0000","last_became_active":"2024-09-12T00:18:30.905770+0000","last_became_peered":"2024-09-12T00:18:30.905770+0000","last_unstale":"2024-09-12T01:01:17.720087+0000","last_undegraded":"2024-09-12T01:01:17.720087+0000","last_fullsized":"2024-09-12T01:01:17.720087+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:26.490700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'134","reported_seq":635,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.562136+0000","last_change":"2024-09-12T00:18:32.886440+0000","last_active":"2024-09-12T01:03:23.562136+0000","last_peered":"2024-09-12T01:03:23.562136+0000","last_clean":"2024-09-12T01:03:23.562136+0000","last_became_active":"2024-09-12T00:18:32.885619+0000","last_became_peered":"2024-09-12T00:18:32.885619+0000","last_unstale":"2024-09-12T01:03:23.562136+0000","last_undegraded":"2024-09-12T01:03:23.562136+0000","last_fullsized":"2024-09-12T01:03:23.562136+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:21.997695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":117,"num_write":301,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'771","reported_seq":2188,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.192347+0000","last_change":"2024-09-12T00:18:24.880137+0000","last_active":"2024-09-12T01:03:11.192347+0000","last_peered":"2024-09-12T01:03:11.192347+0000","last_clean":"2024-09-12T01:03:11.192347+0000","last_became_active":"2024-09-12T00:18:24.879462+0000","last_became_peered":"2024-09-12T00:18:24.879462+0000","last_unstale":"2024-09-12T01:03:11.192347+0000","last_undegraded":"2024-09-12T01:03:11.192347+0000","last_fullsized":"2024-09-12T01:03:11.192347+0000","mapping_epoch":26,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:59.861183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3687,"num_read_kb":3308,"num_write":1074,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:17.549465+0000","last_change":"2024-09-12T00:18:03.927642+0000","last_active":"2024-09-12T01:02:17.549465+0000","last_peered":"2024-09-12T01:02:17.549465+0000","last_clean":"2024-09-12T01:02:17.549465+0000","last_became_active":"2024-09-12T00:18:03.924829+0000","last_became_peered":"2024-09-12T00:18:03.924829+0000","last_unstale":"2024-09-12T01:02:17.549465+0000","last_undegraded":"2024-09-12T01:02:17.549465+0000","last_fullsized":"2024-09-12T01:02:17.549465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:02.531521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:02.531521+0000","last_clean_scrub_stamp":"2024-09-12T00:18:02.531521+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:47.557338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.749313+0000","last_change":"2024-09-12T00:18:10.661688+0000","last_active":"2024-09-12T01:01:57.749313+0000","last_peered":"2024-09-12T01:01:57.749313+0000","last_clean":"2024-09-12T01:01:57.749313+0000","last_became_active":"2024-09-12T00:18:08.644385+0000","last_became_peered":"2024-09-12T00:18:08.644385+0000","last_unstale":"2024-09-12T01:01:57.749313+0000","last_undegraded":"2024-09-12T01:01:57.749313+0000","last_fullsized":"2024-09-12T01:01:57.749313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:31.240227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001156741,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'363","reported_seq":1020,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:46.290029+0000","last_change":"2024-09-12T01:04:46.290029+0000","last_active":"2024-09-12T01:04:46.290029+0000","last_peered":"2024-09-12T01:04:46.290029+0000","last_clean":"2024-09-12T01:04:46.290029+0000","last_became_active":"2024-09-12T00:18:22.867571+0000","last_became_peered":"2024-09-12T00:18:22.867571+0000","last_unstale":"2024-09-12T01:04:46.290029+0000","last_undegraded":"2024-09-12T01:04:46.290029+0000","last_fullsized":"2024-09-12T01:04:46.290029+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'363","last_scrub_stamp":"2024-09-12T01:04:46.289871+0000","last_deep_scrub":"268'363","last_deep_scrub_stamp":"2024-09-12T01:04:46.289871+0000","last_clean_scrub_stamp":"2024-09-12T01:04:46.289871+0000","objects_scrubbed":7,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:39.208915+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262231,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":470,"num_read_kb":26851,"num_write":1093,"num_write_kb":40025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.548434+0000","last_change":"2024-09-12T00:18:26.847189+0000","last_active":"2024-09-12T01:02:12.548434+0000","last_peered":"2024-09-12T01:02:12.548434+0000","last_clean":"2024-09-12T01:02:12.548434+0000","last_became_active":"2024-09-12T00:18:26.846668+0000","last_became_peered":"2024-09-12T00:18:26.846668+0000","last_unstale":"2024-09-12T01:02:12.548434+0000","last_undegraded":"2024-09-12T01:02:12.548434+0000","last_fullsized":"2024-09-12T01:02:12.548434+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:06.265320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'702","reported_seq":1414,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.916401+0000","last_change":"2024-09-12T00:18:28.887266+0000","last_active":"2024-09-12T01:04:39.916401+0000","last_peered":"2024-09-12T01:04:39.916401+0000","last_clean":"2024-09-12T01:04:39.916401+0000","last_became_active":"2024-09-12T00:18:28.885217+0000","last_became_peered":"2024-09-12T00:18:28.885217+0000","last_unstale":"2024-09-12T01:04:39.916401+0000","last_undegraded":"2024-09-12T01:04:39.916401+0000","last_fullsized":"2024-09-12T01:04:39.916401+0000","mapping_epoch":30,"log_start":"268'600","ondisk_log_start":"268'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":600,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:06.515258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190373,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1378,"num_read_kb":3232,"num_write":1266,"num_write_kb":1158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":493,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:51.570679+0000","last_change":"2024-09-12T00:18:30.899429+0000","last_active":"2024-09-12T01:01:51.570679+0000","last_peered":"2024-09-12T01:01:51.570679+0000","last_clean":"2024-09-12T01:01:51.570679+0000","last_became_active":"2024-09-12T00:18:30.898689+0000","last_became_peered":"2024-09-12T00:18:30.898689+0000","last_unstale":"2024-09-12T01:01:51.570679+0000","last_undegraded":"2024-09-12T01:01:51.570679+0000","last_fullsized":"2024-09-12T01:01:51.570679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:03.955121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'198","reported_seq":907,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.899528+0000","last_change":"2024-09-12T00:18:32.895955+0000","last_active":"2024-09-12T01:03:25.899528+0000","last_peered":"2024-09-12T01:03:25.899528+0000","last_clean":"2024-09-12T01:03:25.899528+0000","last_became_active":"2024-09-12T00:18:32.895239+0000","last_became_peered":"2024-09-12T00:18:32.895239+0000","last_unstale":"2024-09-12T01:03:25.899528+0000","last_undegraded":"2024-09-12T01:03:25.899528+0000","last_fullsized":"2024-09-12T01:03:25.899528+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:55.084809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1443,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":458,"num_write":434,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'488","reported_seq":2064,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.768001+0000","last_change":"2024-09-12T00:18:24.867486+0000","last_active":"2024-09-12T01:02:55.768001+0000","last_peered":"2024-09-12T01:02:55.768001+0000","last_clean":"2024-09-12T01:02:55.768001+0000","last_became_active":"2024-09-12T00:18:24.867067+0000","last_became_peered":"2024-09-12T00:18:24.867067+0000","last_unstale":"2024-09-12T01:02:55.768001+0000","last_undegraded":"2024-09-12T01:02:55.768001+0000","last_fullsized":"2024-09-12T01:02:55.768001+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:22.498521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2524,"num_read_kb":2362,"num_write":607,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":524,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:22.550569+0000","last_change":"2024-09-12T00:18:10.895303+0000","last_active":"2024-09-12T01:02:22.550569+0000","last_peered":"2024-09-12T01:02:22.550569+0000","last_clean":"2024-09-12T01:02:22.550569+0000","last_became_active":"2024-09-12T00:18:08.646097+0000","last_became_peered":"2024-09-12T00:18:08.646097+0000","last_unstale":"2024-09-12T01:02:22.550569+0000","last_undegraded":"2024-09-12T01:02:22.550569+0000","last_fullsized":"2024-09-12T01:02:22.550569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:23.989230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001003409,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'368","reported_seq":1039,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:46.266343+0000","last_change":"2024-09-12T01:04:46.266343+0000","last_active":"2024-09-12T01:04:46.266343+0000","last_peered":"2024-09-12T01:04:46.266343+0000","last_clean":"2024-09-12T01:04:46.266343+0000","last_became_active":"2024-09-12T00:18:22.857461+0000","last_became_peered":"2024-09-12T00:18:22.857461+0000","last_unstale":"2024-09-12T01:04:46.266343+0000","last_undegraded":"2024-09-12T01:04:46.266343+0000","last_fullsized":"2024-09-12T01:04:46.266343+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'368","last_scrub_stamp":"2024-09-12T01:04:46.266244+0000","last_deep_scrub":"268'368","last_deep_scrub_stamp":"2024-09-12T01:04:46.266244+0000","last_clean_scrub_stamp":"2024-09-12T01:04:46.266244+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:56.316874+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342049,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":576,"num_read_kb":72256,"num_write":1077,"num_write_kb":25510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:47.747024+0000","last_change":"2024-09-12T00:18:26.872369+0000","last_active":"2024-09-12T01:01:47.747024+0000","last_peered":"2024-09-12T01:01:47.747024+0000","last_clean":"2024-09-12T01:01:47.747024+0000","last_became_active":"2024-09-12T00:18:26.871674+0000","last_became_peered":"2024-09-12T00:18:26.871674+0000","last_unstale":"2024-09-12T01:01:47.747024+0000","last_undegraded":"2024-09-12T01:01:47.747024+0000","last_fullsized":"2024-09-12T01:01:47.747024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:53.162492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'1324","reported_seq":2834,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.839073+0000","last_change":"2024-09-12T00:18:28.890022+0000","last_active":"2024-09-12T01:04:39.839073+0000","last_peered":"2024-09-12T01:04:39.839073+0000","last_clean":"2024-09-12T01:04:39.839073+0000","last_became_active":"2024-09-12T00:18:28.889257+0000","last_became_peered":"2024-09-12T00:18:28.889257+0000","last_unstale":"2024-09-12T01:04:39.839073+0000","last_undegraded":"2024-09-12T01:04:39.839073+0000","last_fullsized":"2024-09-12T01:04:39.839073+0000","mapping_epoch":30,"log_start":"268'1301","ondisk_log_start":"268'1301","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":1301,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:45.298192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142532,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2119,"num_read_kb":4115,"num_write":1220,"num_write_kb":1054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":492,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:27.551882+0000","last_change":"2024-09-12T00:18:30.896021+0000","last_active":"2024-09-12T01:02:27.551882+0000","last_peered":"2024-09-12T01:02:27.551882+0000","last_clean":"2024-09-12T01:02:27.551882+0000","last_became_active":"2024-09-12T00:18:30.895305+0000","last_became_peered":"2024-09-12T00:18:30.895305+0000","last_unstale":"2024-09-12T01:02:27.551882+0000","last_undegraded":"2024-09-12T01:02:27.551882+0000","last_fullsized":"2024-09-12T01:02:27.551882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:43.210391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'203","reported_seq":730,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:06.553696+0000","last_change":"2024-09-12T00:18:32.888386+0000","last_active":"2024-09-12T01:02:06.553696+0000","last_peered":"2024-09-12T01:02:06.553696+0000","last_clean":"2024-09-12T01:02:06.553696+0000","last_became_active":"2024-09-12T00:18:32.887528+0000","last_became_peered":"2024-09-12T00:18:32.887528+0000","last_unstale":"2024-09-12T01:02:06.553696+0000","last_undegraded":"2024-09-12T01:02:06.553696+0000","last_fullsized":"2024-09-12T01:02:06.553696+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:38.435598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":310,"num_read_kb":309,"num_write":446,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'1278","reported_seq":3138,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.820547+0000","last_change":"2024-09-12T00:18:24.878345+0000","last_active":"2024-09-12T01:04:30.820547+0000","last_peered":"2024-09-12T01:04:30.820547+0000","last_clean":"2024-09-12T01:04:30.820547+0000","last_became_active":"2024-09-12T00:18:24.877964+0000","last_became_peered":"2024-09-12T00:18:24.877964+0000","last_unstale":"2024-09-12T01:04:30.820547+0000","last_undegraded":"2024-09-12T01:04:30.820547+0000","last_fullsized":"2024-09-12T01:04:30.820547+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":1200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:26.929945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6082,"num_read_kb":5401,"num_write":1732,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:45.470703+0000","last_change":"2024-09-12T01:04:45.470703+0000","last_active":"2024-09-12T01:04:45.470703+0000","last_peered":"2024-09-12T01:04:45.470703+0000","last_clean":"2024-09-12T01:04:45.470703+0000","last_became_active":"2024-09-12T00:18:08.874442+0000","last_became_peered":"2024-09-12T00:18:08.874442+0000","last_unstale":"2024-09-12T01:04:45.470703+0000","last_undegraded":"2024-09-12T01:04:45.470703+0000","last_fullsized":"2024-09-12T01:04:45.470703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:45.470576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:45.470576+0000","last_clean_scrub_stamp":"2024-09-12T01:04:45.470576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:41.288997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010707620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'366","reported_seq":1085,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.070837+0000","last_change":"2024-09-12T00:18:22.835171+0000","last_active":"2024-09-12T01:04:40.070837+0000","last_peered":"2024-09-12T01:04:40.070837+0000","last_clean":"2024-09-12T01:04:40.070837+0000","last_became_active":"2024-09-12T00:18:22.834724+0000","last_became_peered":"2024-09-12T00:18:22.834724+0000","last_unstale":"2024-09-12T01:04:40.070837+0000","last_undegraded":"2024-09-12T01:04:40.070837+0000","last_fullsized":"2024-09-12T01:04:40.070837+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:08.633740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":674,"num_read_kb":9051,"num_write":1222,"num_write_kb":24587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:46.718701+0000","last_change":"2024-09-12T00:18:26.868058+0000","last_active":"2024-09-12T01:01:46.718701+0000","last_peered":"2024-09-12T01:01:46.718701+0000","last_clean":"2024-09-12T01:01:46.718701+0000","last_became_active":"2024-09-12T00:18:26.867343+0000","last_became_peered":"2024-09-12T00:18:26.867343+0000","last_unstale":"2024-09-12T01:01:46.718701+0000","last_undegraded":"2024-09-12T01:01:46.718701+0000","last_fullsized":"2024-09-12T01:01:46.718701+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:35.314858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'252","reported_seq":1356,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.962448+0000","last_change":"2024-09-12T00:18:28.892634+0000","last_active":"2024-09-12T01:04:31.962448+0000","last_peered":"2024-09-12T01:04:31.962448+0000","last_clean":"2024-09-12T01:04:31.962448+0000","last_became_active":"2024-09-12T00:18:28.889058+0000","last_became_peered":"2024-09-12T00:18:28.889058+0000","last_unstale":"2024-09-12T01:04:31.962448+0000","last_undegraded":"2024-09-12T01:04:31.962448+0000","last_fullsized":"2024-09-12T01:04:31.962448+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:46.530785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":190,"num_read_kb":179,"num_write":165,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":494,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:16.577209+0000","last_change":"2024-09-12T00:18:30.896789+0000","last_active":"2024-09-12T01:02:16.577209+0000","last_peered":"2024-09-12T01:02:16.577209+0000","last_clean":"2024-09-12T01:02:16.577209+0000","last_became_active":"2024-09-12T00:18:30.896073+0000","last_became_peered":"2024-09-12T00:18:30.896073+0000","last_unstale":"2024-09-12T01:02:16.577209+0000","last_undegraded":"2024-09-12T01:02:16.577209+0000","last_fullsized":"2024-09-12T01:02:16.577209+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:47.152911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'272","reported_seq":884,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.079029+0000","last_change":"2024-09-12T00:18:32.914870+0000","last_active":"2024-09-12T01:03:26.079029+0000","last_peered":"2024-09-12T01:03:26.079029+0000","last_clean":"2024-09-12T01:03:26.079029+0000","last_became_active":"2024-09-12T00:18:32.914004+0000","last_became_peered":"2024-09-12T00:18:32.914004+0000","last_unstale":"2024-09-12T01:03:26.079029+0000","last_undegraded":"2024-09-12T01:03:26.079029+0000","last_fullsized":"2024-09-12T01:03:26.079029+0000","mapping_epoch":34,"log_start":"268'200","ondisk_log_start":"268'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:37.374742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":517,"num_read_kb":535,"num_write":598,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'816","reported_seq":2373,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.819708+0000","last_change":"2024-09-12T00:18:24.870195+0000","last_active":"2024-09-12T01:04:30.819708+0000","last_peered":"2024-09-12T01:04:30.819708+0000","last_clean":"2024-09-12T01:04:30.819708+0000","last_became_active":"2024-09-12T00:18:24.869633+0000","last_became_peered":"2024-09-12T00:18:24.869633+0000","last_unstale":"2024-09-12T01:04:30.819708+0000","last_undegraded":"2024-09-12T01:04:30.819708+0000","last_fullsized":"2024-09-12T01:04:30.819708+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:24.540261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3879,"num_read_kb":3488,"num_write":1067,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.749218+0000","last_change":"2024-09-12T00:18:10.662993+0000","last_active":"2024-09-12T01:01:57.749218+0000","last_peered":"2024-09-12T01:01:57.749218+0000","last_clean":"2024-09-12T01:01:57.749218+0000","last_became_active":"2024-09-12T00:18:08.645156+0000","last_became_peered":"2024-09-12T00:18:08.645156+0000","last_unstale":"2024-09-12T01:01:57.749218+0000","last_undegraded":"2024-09-12T01:01:57.749218+0000","last_fullsized":"2024-09-12T01:01:57.749218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:52.068369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024595709999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'387","reported_seq":1070,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.120172+0000","last_change":"2024-09-12T00:18:22.855734+0000","last_active":"2024-09-12T01:04:40.120172+0000","last_peered":"2024-09-12T01:04:40.120172+0000","last_clean":"2024-09-12T01:04:40.120172+0000","last_became_active":"2024-09-12T00:18:22.854940+0000","last_became_peered":"2024-09-12T00:18:22.854940+0000","last_unstale":"2024-09-12T01:04:40.120172+0000","last_undegraded":"2024-09-12T01:04:40.120172+0000","last_fullsized":"2024-09-12T01:04:40.120172+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:05.965555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7046756,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":598,"num_read_kb":32178,"num_write":1236,"num_write_kb":29732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.578382+0000","last_change":"2024-09-12T00:18:26.856551+0000","last_active":"2024-09-12T01:02:21.578382+0000","last_peered":"2024-09-12T01:02:21.578382+0000","last_clean":"2024-09-12T01:02:21.578382+0000","last_became_active":"2024-09-12T00:18:26.855239+0000","last_became_peered":"2024-09-12T00:18:26.855239+0000","last_unstale":"2024-09-12T01:02:21.578382+0000","last_undegraded":"2024-09-12T01:02:21.578382+0000","last_fullsized":"2024-09-12T01:02:21.578382+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:33.287785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'122","reported_seq":671,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:01.784399+0000","last_change":"2024-09-12T00:18:28.891881+0000","last_active":"2024-09-12T01:04:01.784399+0000","last_peered":"2024-09-12T01:04:01.784399+0000","last_clean":"2024-09-12T01:04:01.784399+0000","last_became_active":"2024-09-12T00:18:28.891173+0000","last_became_peered":"2024-09-12T00:18:28.891173+0000","last_unstale":"2024-09-12T01:04:01.784399+0000","last_undegraded":"2024-09-12T01:04:01.784399+0000","last_fullsized":"2024-09-12T01:04:01.784399+0000","mapping_epoch":30,"log_start":"268'100","ondisk_log_start":"268'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:02.040523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":142,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":491,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:52.727361+0000","last_change":"2024-09-12T00:18:30.904713+0000","last_active":"2024-09-12T01:01:52.727361+0000","last_peered":"2024-09-12T01:01:52.727361+0000","last_clean":"2024-09-12T01:01:52.727361+0000","last_became_active":"2024-09-12T00:18:30.904080+0000","last_became_peered":"2024-09-12T00:18:30.904080+0000","last_unstale":"2024-09-12T01:01:52.727361+0000","last_undegraded":"2024-09-12T01:01:52.727361+0000","last_fullsized":"2024-09-12T01:01:52.727361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:14.500655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'108","reported_seq":658,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.275864+0000","last_change":"2024-09-12T00:18:32.905383+0000","last_active":"2024-09-12T01:02:54.275864+0000","last_peered":"2024-09-12T01:02:54.275864+0000","last_clean":"2024-09-12T01:02:54.275864+0000","last_became_active":"2024-09-12T00:18:32.903109+0000","last_became_peered":"2024-09-12T00:18:32.903109+0000","last_unstale":"2024-09-12T01:02:54.275864+0000","last_undegraded":"2024-09-12T01:02:54.275864+0000","last_fullsized":"2024-09-12T01:02:54.275864+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:48.630615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":206,"num_read_kb":202,"num_write":268,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'472","reported_seq":1985,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.120332+0000","last_change":"2024-09-12T00:18:24.878475+0000","last_active":"2024-09-12T01:03:25.120332+0000","last_peered":"2024-09-12T01:03:25.120332+0000","last_clean":"2024-09-12T01:03:25.120332+0000","last_became_active":"2024-09-12T00:18:24.878031+0000","last_became_peered":"2024-09-12T00:18:24.878031+0000","last_unstale":"2024-09-12T01:03:25.120332+0000","last_undegraded":"2024-09-12T01:03:25.120332+0000","last_fullsized":"2024-09-12T01:03:25.120332+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:27.805912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2325,"num_read_kb":2173,"num_write":541,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'309","reported_seq":923,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.113128+0000","last_change":"2024-09-12T00:18:22.873808+0000","last_active":"2024-09-12T01:04:40.113128+0000","last_peered":"2024-09-12T01:04:40.113128+0000","last_clean":"2024-09-12T01:04:40.113128+0000","last_became_active":"2024-09-12T00:18:22.861336+0000","last_became_peered":"2024-09-12T00:18:22.861336+0000","last_unstale":"2024-09-12T01:04:40.113128+0000","last_undegraded":"2024-09-12T01:04:40.113128+0000","last_fullsized":"2024-09-12T01:04:40.113128+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:07.579776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194334,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":409,"num_read_kb":16866,"num_write":952,"num_write_kb":39669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.551222+0000","last_change":"2024-09-12T00:18:10.665342+0000","last_active":"2024-09-12T01:01:56.551222+0000","last_peered":"2024-09-12T01:01:56.551222+0000","last_clean":"2024-09-12T01:01:56.551222+0000","last_became_active":"2024-09-12T00:18:08.956785+0000","last_became_peered":"2024-09-12T00:18:08.956785+0000","last_unstale":"2024-09-12T01:01:56.551222+0000","last_undegraded":"2024-09-12T01:01:56.551222+0000","last_fullsized":"2024-09-12T01:01:56.551222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:11.556988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012417909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.575765+0000","last_change":"2024-09-12T00:18:26.879934+0000","last_active":"2024-09-12T01:02:11.575765+0000","last_peered":"2024-09-12T01:02:11.575765+0000","last_clean":"2024-09-12T01:02:11.575765+0000","last_became_active":"2024-09-12T00:18:26.879511+0000","last_became_peered":"2024-09-12T00:18:26.879511+0000","last_unstale":"2024-09-12T01:02:11.575765+0000","last_undegraded":"2024-09-12T01:02:11.575765+0000","last_fullsized":"2024-09-12T01:02:11.575765+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:50.925795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'562","reported_seq":1241,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.968654+0000","last_change":"2024-09-12T00:18:28.880341+0000","last_active":"2024-09-12T01:04:39.968654+0000","last_peered":"2024-09-12T01:04:39.968654+0000","last_clean":"2024-09-12T01:04:39.968654+0000","last_became_active":"2024-09-12T00:18:28.879614+0000","last_became_peered":"2024-09-12T00:18:28.879614+0000","last_unstale":"2024-09-12T01:04:39.968654+0000","last_undegraded":"2024-09-12T01:04:39.968654+0000","last_fullsized":"2024-09-12T01:04:39.968654+0000","mapping_epoch":30,"log_start":"268'500","ondisk_log_start":"268'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:03.149386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100174,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":946,"num_read_kb":2084,"num_write":804,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:17.552865+0000","last_change":"2024-09-12T00:18:30.904154+0000","last_active":"2024-09-12T01:02:17.552865+0000","last_peered":"2024-09-12T01:02:17.552865+0000","last_clean":"2024-09-12T01:02:17.552865+0000","last_became_active":"2024-09-12T00:18:30.903532+0000","last_became_peered":"2024-09-12T00:18:30.903532+0000","last_unstale":"2024-09-12T01:02:17.552865+0000","last_undegraded":"2024-09-12T01:02:17.552865+0000","last_fullsized":"2024-09-12T01:02:17.552865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:56.341364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'142","reported_seq":649,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.969443+0000","last_change":"2024-09-12T00:18:32.897568+0000","last_active":"2024-09-12T01:03:25.969443+0000","last_peered":"2024-09-12T01:03:25.969443+0000","last_clean":"2024-09-12T01:03:25.969443+0000","last_became_active":"2024-09-12T00:18:32.896532+0000","last_became_peered":"2024-09-12T00:18:32.896532+0000","last_unstale":"2024-09-12T01:03:25.969443+0000","last_undegraded":"2024-09-12T01:03:25.969443+0000","last_fullsized":"2024-09-12T01:03:25.969443+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:19.854551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":138,"num_write":339,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'364","reported_seq":1903,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.171828+0000","last_change":"2024-09-12T00:18:24.856127+0000","last_active":"2024-09-12T01:03:03.171828+0000","last_peered":"2024-09-12T01:03:03.171828+0000","last_clean":"2024-09-12T01:03:03.171828+0000","last_became_active":"2024-09-12T00:18:24.852620+0000","last_became_peered":"2024-09-12T00:18:24.852620+0000","last_unstale":"2024-09-12T01:03:03.171828+0000","last_undegraded":"2024-09-12T01:03:03.171828+0000","last_fullsized":"2024-09-12T01:03:03.171828+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:07.552365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2109,"num_read_kb":2037,"num_write":400,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'343","reported_seq":989,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.128116+0000","last_change":"2024-09-12T00:18:22.839269+0000","last_active":"2024-09-12T01:04:40.128116+0000","last_peered":"2024-09-12T01:04:40.128116+0000","last_clean":"2024-09-12T01:04:40.128116+0000","last_became_active":"2024-09-12T00:18:22.839001+0000","last_became_peered":"2024-09-12T00:18:22.839001+0000","last_unstale":"2024-09-12T01:04:40.128116+0000","last_undegraded":"2024-09-12T01:04:40.128116+0000","last_fullsized":"2024-09-12T01:04:40.128116+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:51.522439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":481,"num_read_kb":59946,"num_write":977,"num_write_kb":34875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:07.547276+0000","last_change":"2024-09-12T00:18:10.895453+0000","last_active":"2024-09-12T01:02:07.547276+0000","last_peered":"2024-09-12T01:02:07.547276+0000","last_clean":"2024-09-12T01:02:07.547276+0000","last_became_active":"2024-09-12T00:18:08.958069+0000","last_became_peered":"2024-09-12T00:18:08.958069+0000","last_unstale":"2024-09-12T01:02:07.547276+0000","last_undegraded":"2024-09-12T01:02:07.547276+0000","last_fullsized":"2024-09-12T01:02:07.547276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:41.978158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001047189,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.731707+0000","last_change":"2024-09-12T00:18:26.866580+0000","last_active":"2024-09-12T01:02:12.731707+0000","last_peered":"2024-09-12T01:02:12.731707+0000","last_clean":"2024-09-12T01:02:12.731707+0000","last_became_active":"2024-09-12T00:18:26.865743+0000","last_became_peered":"2024-09-12T00:18:26.865743+0000","last_unstale":"2024-09-12T01:02:12.731707+0000","last_undegraded":"2024-09-12T01:02:12.731707+0000","last_fullsized":"2024-09-12T01:02:12.731707+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:54.698335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'164","reported_seq":741,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.887776+0000","last_change":"2024-09-12T00:18:28.877919+0000","last_active":"2024-09-12T01:03:25.887776+0000","last_peered":"2024-09-12T01:03:25.887776+0000","last_clean":"2024-09-12T01:03:25.887776+0000","last_became_active":"2024-09-12T00:18:28.877233+0000","last_became_peered":"2024-09-12T00:18:28.877233+0000","last_unstale":"2024-09-12T01:03:25.887776+0000","last_undegraded":"2024-09-12T01:03:25.887776+0000","last_fullsized":"2024-09-12T01:03:25.887776+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:54.638936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":206,"num_read_kb":196,"num_write":136,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'792","reported_seq":2607,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.148610+0000","last_change":"2024-09-12T00:18:30.874256+0000","last_active":"2024-09-12T01:04:40.148610+0000","last_peered":"2024-09-12T01:04:40.148610+0000","last_clean":"2024-09-12T01:04:40.148610+0000","last_became_active":"2024-09-12T00:18:30.873484+0000","last_became_peered":"2024-09-12T00:18:30.873484+0000","last_unstale":"2024-09-12T01:04:40.148610+0000","last_undegraded":"2024-09-12T01:04:40.148610+0000","last_fullsized":"2024-09-12T01:04:40.148610+0000","mapping_epoch":32,"log_start":"268'702","ondisk_log_start":"268'702","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":702,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:48.826950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'163","reported_seq":681,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.836361+0000","last_change":"2024-09-12T00:18:32.894083+0000","last_active":"2024-09-12T01:04:30.836361+0000","last_peered":"2024-09-12T01:04:30.836361+0000","last_clean":"2024-09-12T01:04:30.836361+0000","last_became_active":"2024-09-12T00:18:32.893315+0000","last_became_peered":"2024-09-12T00:18:32.893315+0000","last_unstale":"2024-09-12T01:04:30.836361+0000","last_undegraded":"2024-09-12T01:04:30.836361+0000","last_fullsized":"2024-09-12T01:04:30.836361+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:09.991201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":201,"num_read_kb":185,"num_write":395,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'450","reported_seq":2014,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.120605+0000","last_change":"2024-09-12T00:18:24.866105+0000","last_active":"2024-09-12T01:03:25.120605+0000","last_peered":"2024-09-12T01:03:25.120605+0000","last_clean":"2024-09-12T01:03:25.120605+0000","last_became_active":"2024-09-12T00:18:24.865603+0000","last_became_peered":"2024-09-12T00:18:24.865603+0000","last_unstale":"2024-09-12T01:03:25.120605+0000","last_undegraded":"2024-09-12T01:03:25.120605+0000","last_fullsized":"2024-09-12T01:03:25.120605+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:38.883418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2591,"num_read_kb":2430,"num_write":539,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'357","reported_seq":981,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.126571+0000","last_change":"2024-09-12T00:18:22.870893+0000","last_active":"2024-09-12T01:04:40.126571+0000","last_peered":"2024-09-12T01:04:40.126571+0000","last_clean":"2024-09-12T01:04:40.126571+0000","last_became_active":"2024-09-12T00:18:22.870180+0000","last_became_peered":"2024-09-12T00:18:22.870180+0000","last_unstale":"2024-09-12T01:04:40.126571+0000","last_undegraded":"2024-09-12T01:04:40.126571+0000","last_fullsized":"2024-09-12T01:04:40.126571+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:39.546988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":450,"num_read_kb":16363,"num_write":1061,"num_write_kb":31356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":538,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:45.528242+0000","last_change":"2024-09-12T01:04:45.528242+0000","last_active":"2024-09-12T01:04:45.528242+0000","last_peered":"2024-09-12T01:04:45.528242+0000","last_clean":"2024-09-12T01:04:45.528242+0000","last_became_active":"2024-09-12T00:18:08.638003+0000","last_became_peered":"2024-09-12T00:18:08.638003+0000","last_unstale":"2024-09-12T01:04:45.528242+0000","last_undegraded":"2024-09-12T01:04:45.528242+0000","last_fullsized":"2024-09-12T01:04:45.528242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:45.528131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:45.528131+0000","last_clean_scrub_stamp":"2024-09-12T01:04:45.528131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:02.250802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010953429999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.549583+0000","last_change":"2024-09-12T00:18:26.859001+0000","last_active":"2024-09-12T01:02:12.549583+0000","last_peered":"2024-09-12T01:02:12.549583+0000","last_clean":"2024-09-12T01:02:12.549583+0000","last_became_active":"2024-09-12T00:18:26.858300+0000","last_became_peered":"2024-09-12T00:18:26.858300+0000","last_unstale":"2024-09-12T01:02:12.549583+0000","last_undegraded":"2024-09-12T01:02:12.549583+0000","last_fullsized":"2024-09-12T01:02:12.549583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:24.947974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'109","reported_seq":658,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:17.552956+0000","last_change":"2024-09-12T00:18:28.882042+0000","last_active":"2024-09-12T01:02:17.552956+0000","last_peered":"2024-09-12T01:02:17.552956+0000","last_clean":"2024-09-12T01:02:17.552956+0000","last_became_active":"2024-09-12T00:18:28.880684+0000","last_became_peered":"2024-09-12T00:18:28.880684+0000","last_unstale":"2024-09-12T01:02:17.552956+0000","last_undegraded":"2024-09-12T01:02:17.552956+0000","last_fullsized":"2024-09-12T01:02:17.552956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:05.919489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'816","reported_seq":2641,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.564873+0000","last_change":"2024-09-12T00:18:30.903318+0000","last_active":"2024-09-12T01:04:38.564873+0000","last_peered":"2024-09-12T01:04:38.564873+0000","last_clean":"2024-09-12T01:04:38.564873+0000","last_became_active":"2024-09-12T00:18:30.902580+0000","last_became_peered":"2024-09-12T00:18:30.902580+0000","last_unstale":"2024-09-12T01:04:38.564873+0000","last_undegraded":"2024-09-12T01:04:38.564873+0000","last_fullsized":"2024-09-12T01:04:38.564873+0000","mapping_epoch":32,"log_start":"268'800","ondisk_log_start":"268'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:13.015304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'173","reported_seq":673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:24.492347+0000","last_change":"2024-09-12T00:18:32.903845+0000","last_active":"2024-09-12T01:03:24.492347+0000","last_peered":"2024-09-12T01:03:24.492347+0000","last_clean":"2024-09-12T01:03:24.492347+0000","last_became_active":"2024-09-12T00:18:32.902970+0000","last_became_peered":"2024-09-12T00:18:32.902970+0000","last_unstale":"2024-09-12T01:03:24.492347+0000","last_undegraded":"2024-09-12T01:03:24.492347+0000","last_fullsized":"2024-09-12T01:03:24.492347+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:29.969603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":388,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'588","reported_seq":2161,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.347778+0000","last_change":"2024-09-12T00:18:24.879885+0000","last_active":"2024-09-12T01:03:37.347778+0000","last_peered":"2024-09-12T01:03:37.347778+0000","last_clean":"2024-09-12T01:03:37.347778+0000","last_became_active":"2024-09-12T00:18:24.879205+0000","last_became_peered":"2024-09-12T00:18:24.879205+0000","last_unstale":"2024-09-12T01:03:37.347778+0000","last_undegraded":"2024-09-12T01:03:37.347778+0000","last_fullsized":"2024-09-12T01:03:37.347778+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":500,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:25.009708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":3160,"num_read_kb":2876,"num_write":787,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'346","reported_seq":1075,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:45.268249+0000","last_change":"2024-09-12T01:04:45.268249+0000","last_active":"2024-09-12T01:04:45.268249+0000","last_peered":"2024-09-12T01:04:45.268249+0000","last_clean":"2024-09-12T01:04:45.268249+0000","last_became_active":"2024-09-12T00:18:22.850326+0000","last_became_peered":"2024-09-12T00:18:22.850326+0000","last_unstale":"2024-09-12T01:04:45.268249+0000","last_undegraded":"2024-09-12T01:04:45.268249+0000","last_fullsized":"2024-09-12T01:04:45.268249+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'346","last_scrub_stamp":"2024-09-12T01:04:45.268124+0000","last_deep_scrub":"268'346","last_deep_scrub_stamp":"2024-09-12T01:04:45.268124+0000","last_clean_scrub_stamp":"2024-09-12T01:04:45.268124+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:15.830198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":560,"num_read_kb":1535,"num_write":1060,"num_write_kb":23375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:32.723228+0000","last_change":"2024-09-12T00:18:10.895554+0000","last_active":"2024-09-12T01:01:32.723228+0000","last_peered":"2024-09-12T01:01:32.723228+0000","last_clean":"2024-09-12T01:01:32.723228+0000","last_became_active":"2024-09-12T00:18:08.648187+0000","last_became_peered":"2024-09-12T00:18:08.648187+0000","last_unstale":"2024-09-12T01:01:32.723228+0000","last_undegraded":"2024-09-12T01:01:32.723228+0000","last_fullsized":"2024-09-12T01:01:32.723228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.624594+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.624594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:14.147236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001130048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:31.765082+0000","last_change":"2024-09-12T00:18:26.851380+0000","last_active":"2024-09-12T01:02:31.765082+0000","last_peered":"2024-09-12T01:02:31.765082+0000","last_clean":"2024-09-12T01:02:31.765082+0000","last_became_active":"2024-09-12T00:18:26.851038+0000","last_became_peered":"2024-09-12T00:18:26.851038+0000","last_unstale":"2024-09-12T01:02:31.765082+0000","last_undegraded":"2024-09-12T01:02:31.765082+0000","last_fullsized":"2024-09-12T01:02:31.765082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:34.120180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'749","reported_seq":1475,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.360881+0000","last_change":"2024-09-12T00:18:28.885754+0000","last_active":"2024-09-12T01:04:39.360881+0000","last_peered":"2024-09-12T01:04:39.360881+0000","last_clean":"2024-09-12T01:04:39.360881+0000","last_became_active":"2024-09-12T00:18:28.884726+0000","last_became_peered":"2024-09-12T00:18:28.884726+0000","last_unstale":"2024-09-12T01:04:39.360881+0000","last_undegraded":"2024-09-12T01:04:39.360881+0000","last_fullsized":"2024-09-12T01:04:39.360881+0000","mapping_epoch":30,"log_start":"268'700","ondisk_log_start":"268'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:33.539730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153841,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1337,"num_read_kb":3208,"num_write":1092,"num_write_kb":920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:16.760930+0000","last_change":"2024-09-12T00:18:30.902052+0000","last_active":"2024-09-12T01:02:16.760930+0000","last_peered":"2024-09-12T01:02:16.760930+0000","last_clean":"2024-09-12T01:02:16.760930+0000","last_became_active":"2024-09-12T00:18:30.900777+0000","last_became_peered":"2024-09-12T00:18:30.900777+0000","last_unstale":"2024-09-12T01:02:16.760930+0000","last_undegraded":"2024-09-12T01:02:16.760930+0000","last_fullsized":"2024-09-12T01:02:16.760930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:05.763516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'111","reported_seq":608,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.877760+0000","last_change":"2024-09-12T00:18:32.900574+0000","last_active":"2024-09-12T01:03:25.877760+0000","last_peered":"2024-09-12T01:03:25.877760+0000","last_clean":"2024-09-12T01:03:25.877760+0000","last_became_active":"2024-09-12T00:18:32.899881+0000","last_became_peered":"2024-09-12T00:18:32.899881+0000","last_unstale":"2024-09-12T01:03:25.877760+0000","last_undegraded":"2024-09-12T01:03:25.877760+0000","last_fullsized":"2024-09-12T01:03:25.877760+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:39.617551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":105,"num_write":264,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'146","reported_seq":709,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.030418+0000","last_change":"2024-09-12T00:18:32.904423+0000","last_active":"2024-09-12T01:03:26.030418+0000","last_peered":"2024-09-12T01:03:26.030418+0000","last_clean":"2024-09-12T01:03:26.030418+0000","last_became_active":"2024-09-12T00:18:32.902596+0000","last_became_peered":"2024-09-12T00:18:32.902596+0000","last_unstale":"2024-09-12T01:03:26.030418+0000","last_undegraded":"2024-09-12T01:03:26.030418+0000","last_fullsized":"2024-09-12T01:03:26.030418+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:15.240829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":238,"num_read_kb":229,"num_write":342,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'482","reported_seq":2105,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.705235+0000","last_change":"2024-09-12T00:18:24.880298+0000","last_active":"2024-09-12T01:03:20.705235+0000","last_peered":"2024-09-12T01:03:20.705235+0000","last_clean":"2024-09-12T01:03:20.705235+0000","last_became_active":"2024-09-12T00:18:24.879640+0000","last_became_peered":"2024-09-12T00:18:24.879640+0000","last_unstale":"2024-09-12T01:03:20.705235+0000","last_undegraded":"2024-09-12T01:03:20.705235+0000","last_fullsized":"2024-09-12T01:03:20.705235+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:24.256945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2579,"num_read_kb":2446,"num_write":588,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'387","reported_seq":1038,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.086635+0000","last_change":"2024-09-12T00:18:22.877577+0000","last_active":"2024-09-12T01:04:40.086635+0000","last_peered":"2024-09-12T01:04:40.086635+0000","last_clean":"2024-09-12T01:04:40.086635+0000","last_became_active":"2024-09-12T00:18:22.874059+0000","last_became_peered":"2024-09-12T00:18:22.874059+0000","last_unstale":"2024-09-12T01:04:40.086635+0000","last_undegraded":"2024-09-12T01:04:40.086635+0000","last_fullsized":"2024-09-12T01:04:40.086635+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:35.192212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":563,"num_read_kb":19542,"num_write":1220,"num_write_kb":37354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:26.529417+0000","last_change":"2024-09-12T00:18:26.868055+0000","last_active":"2024-09-12T01:00:26.529417+0000","last_peered":"2024-09-12T01:00:26.529417+0000","last_clean":"2024-09-12T01:00:26.529417+0000","last_became_active":"2024-09-12T00:18:26.866940+0000","last_became_peered":"2024-09-12T00:18:26.866940+0000","last_unstale":"2024-09-12T01:00:26.529417+0000","last_undegraded":"2024-09-12T01:00:26.529417+0000","last_fullsized":"2024-09-12T01:00:26.529417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:32.546738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'294","reported_seq":882,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.624803+0000","last_change":"2024-09-12T00:18:28.878607+0000","last_active":"2024-09-12T01:04:39.624803+0000","last_peered":"2024-09-12T01:04:39.624803+0000","last_clean":"2024-09-12T01:04:39.624803+0000","last_became_active":"2024-09-12T00:18:28.877560+0000","last_became_peered":"2024-09-12T00:18:28.877560+0000","last_unstale":"2024-09-12T01:04:39.624803+0000","last_undegraded":"2024-09-12T01:04:39.624803+0000","last_fullsized":"2024-09-12T01:04:39.624803+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:45.619406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44815,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":481,"num_read_kb":1100,"num_write":392,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:31.733041+0000","last_change":"2024-09-12T00:18:30.903541+0000","last_active":"2024-09-12T01:00:31.733041+0000","last_peered":"2024-09-12T01:00:31.733041+0000","last_clean":"2024-09-12T01:00:31.733041+0000","last_became_active":"2024-09-12T00:18:30.901022+0000","last_became_peered":"2024-09-12T00:18:30.901022+0000","last_unstale":"2024-09-12T01:00:31.733041+0000","last_undegraded":"2024-09-12T01:00:31.733041+0000","last_fullsized":"2024-09-12T01:00:31.733041+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:14.300352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'140","reported_seq":654,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.209313+0000","last_change":"2024-09-12T00:18:32.901918+0000","last_active":"2024-09-12T01:03:01.209313+0000","last_peered":"2024-09-12T01:03:01.209313+0000","last_clean":"2024-09-12T01:03:01.209313+0000","last_became_active":"2024-09-12T00:18:32.900434+0000","last_became_peered":"2024-09-12T00:18:32.900434+0000","last_unstale":"2024-09-12T01:03:01.209313+0000","last_undegraded":"2024-09-12T01:03:01.209313+0000","last_fullsized":"2024-09-12T01:03:01.209313+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:49.600913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":83,"num_write":305,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'543","reported_seq":1959,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.741300+0000","last_change":"2024-09-12T00:18:24.878881+0000","last_active":"2024-09-12T01:03:06.741300+0000","last_peered":"2024-09-12T01:03:06.741300+0000","last_clean":"2024-09-12T01:03:06.741300+0000","last_became_active":"2024-09-12T00:18:24.878531+0000","last_became_peered":"2024-09-12T00:18:24.878531+0000","last_unstale":"2024-09-12T01:03:06.741300+0000","last_undegraded":"2024-09-12T01:03:06.741300+0000","last_fullsized":"2024-09-12T01:03:06.741300+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:48.183195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2546,"num_read_kb":2313,"num_write":710,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'412","reported_seq":1134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.033022+0000","last_change":"2024-09-12T00:18:56.194776+0000","last_active":"2024-09-12T01:04:40.033022+0000","last_peered":"2024-09-12T01:04:40.033022+0000","last_clean":"2024-09-12T01:04:40.033022+0000","last_became_active":"2024-09-12T00:18:56.193958+0000","last_became_peered":"2024-09-12T00:18:56.193958+0000","last_unstale":"2024-09-12T01:04:40.033022+0000","last_undegraded":"2024-09-12T01:04:40.033022+0000","last_fullsized":"2024-09-12T01:04:40.033022+0000","mapping_epoch":37,"log_start":"268'400","ondisk_log_start":"268'400","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:37.859959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":783,"num_read_kb":16311,"num_write":1252,"num_write_kb":28883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:26.731697+0000","last_change":"2024-09-12T00:18:26.852947+0000","last_active":"2024-09-12T01:00:26.731697+0000","last_peered":"2024-09-12T01:00:26.731697+0000","last_clean":"2024-09-12T01:00:26.731697+0000","last_became_active":"2024-09-12T00:18:26.852430+0000","last_became_peered":"2024-09-12T00:18:26.852430+0000","last_unstale":"2024-09-12T01:00:26.731697+0000","last_undegraded":"2024-09-12T01:00:26.731697+0000","last_fullsized":"2024-09-12T01:00:26.731697+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:06.569149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'47","reported_seq":552,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:16.496467+0000","last_change":"2024-09-12T00:18:28.889342+0000","last_active":"2024-09-12T01:02:16.496467+0000","last_peered":"2024-09-12T01:02:16.496467+0000","last_clean":"2024-09-12T01:02:16.496467+0000","last_became_active":"2024-09-12T00:18:28.888625+0000","last_became_peered":"2024-09-12T00:18:28.888625+0000","last_unstale":"2024-09-12T01:02:16.496467+0000","last_undegraded":"2024-09-12T01:02:16.496467+0000","last_fullsized":"2024-09-12T01:02:16.496467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:38.074165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:32.525392+0000","last_change":"2024-09-12T00:18:30.895269+0000","last_active":"2024-09-12T01:00:32.525392+0000","last_peered":"2024-09-12T01:00:32.525392+0000","last_clean":"2024-09-12T01:00:32.525392+0000","last_became_active":"2024-09-12T00:18:30.894388+0000","last_became_peered":"2024-09-12T00:18:30.894388+0000","last_unstale":"2024-09-12T01:00:32.525392+0000","last_undegraded":"2024-09-12T01:00:32.525392+0000","last_fullsized":"2024-09-12T01:00:32.525392+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:32.983260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'210","reported_seq":728,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.127161+0000","last_change":"2024-09-12T00:18:32.904521+0000","last_active":"2024-09-12T01:03:25.127161+0000","last_peered":"2024-09-12T01:03:25.127161+0000","last_clean":"2024-09-12T01:03:25.127161+0000","last_became_active":"2024-09-12T00:18:32.903719+0000","last_became_peered":"2024-09-12T00:18:32.903719+0000","last_unstale":"2024-09-12T01:03:25.127161+0000","last_undegraded":"2024-09-12T01:03:25.127161+0000","last_fullsized":"2024-09-12T01:03:25.127161+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:22.565162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":286,"num_read_kb":283,"num_write":470,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'850","reported_seq":2448,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.178028+0000","last_change":"2024-09-12T00:18:24.865796+0000","last_active":"2024-09-12T01:03:11.178028+0000","last_peered":"2024-09-12T01:03:11.178028+0000","last_clean":"2024-09-12T01:03:11.178028+0000","last_became_active":"2024-09-12T00:18:24.865480+0000","last_became_peered":"2024-09-12T00:18:24.865480+0000","last_unstale":"2024-09-12T01:03:11.178028+0000","last_undegraded":"2024-09-12T01:03:11.178028+0000","last_fullsized":"2024-09-12T01:03:11.178028+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":800,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:13.433725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4053,"num_read_kb":3643,"num_write":1115,"num_write_kb":411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'381","reported_seq":1031,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.094297+0000","last_change":"2024-09-12T00:18:55.955883+0000","last_active":"2024-09-12T01:04:40.094297+0000","last_peered":"2024-09-12T01:04:40.094297+0000","last_clean":"2024-09-12T01:04:40.094297+0000","last_became_active":"2024-09-12T00:18:55.955303+0000","last_became_peered":"2024-09-12T00:18:55.955303+0000","last_unstale":"2024-09-12T01:04:40.094297+0000","last_undegraded":"2024-09-12T01:04:40.094297+0000","last_fullsized":"2024-09-12T01:04:40.094297+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:26.714282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1605311,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":590,"num_read_kb":40569,"num_write":1352,"num_write_kb":40151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:27.524107+0000","last_change":"2024-09-12T00:18:26.860720+0000","last_active":"2024-09-12T01:00:27.524107+0000","last_peered":"2024-09-12T01:00:27.524107+0000","last_clean":"2024-09-12T01:00:27.524107+0000","last_became_active":"2024-09-12T00:18:26.859801+0000","last_became_peered":"2024-09-12T00:18:26.859801+0000","last_unstale":"2024-09-12T01:00:27.524107+0000","last_undegraded":"2024-09-12T01:00:27.524107+0000","last_fullsized":"2024-09-12T01:00:27.524107+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:36.551977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'316","reported_seq":914,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.129316+0000","last_change":"2024-09-12T00:18:28.878040+0000","last_active":"2024-09-12T01:04:39.129316+0000","last_peered":"2024-09-12T01:04:39.129316+0000","last_clean":"2024-09-12T01:04:39.129316+0000","last_became_active":"2024-09-12T00:18:28.877317+0000","last_became_peered":"2024-09-12T00:18:28.877317+0000","last_unstale":"2024-09-12T01:04:39.129316+0000","last_undegraded":"2024-09-12T01:04:39.129316+0000","last_fullsized":"2024-09-12T01:04:39.129316+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:36.629509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53640,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":520,"num_read_kb":1147,"num_write":418,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:32.710908+0000","last_change":"2024-09-12T00:18:30.904722+0000","last_active":"2024-09-12T01:00:32.710908+0000","last_peered":"2024-09-12T01:00:32.710908+0000","last_clean":"2024-09-12T01:00:32.710908+0000","last_became_active":"2024-09-12T00:18:30.904052+0000","last_became_peered":"2024-09-12T00:18:30.904052+0000","last_unstale":"2024-09-12T01:00:32.710908+0000","last_undegraded":"2024-09-12T01:00:32.710908+0000","last_fullsized":"2024-09-12T01:00:32.710908+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:47.904502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'138","reported_seq":657,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.556907+0000","last_change":"2024-09-12T00:18:32.900262+0000","last_active":"2024-09-12T01:03:23.556907+0000","last_peered":"2024-09-12T01:03:23.556907+0000","last_clean":"2024-09-12T01:03:23.556907+0000","last_became_active":"2024-09-12T00:18:32.899607+0000","last_became_peered":"2024-09-12T00:18:32.899607+0000","last_unstale":"2024-09-12T01:03:23.556907+0000","last_undegraded":"2024-09-12T01:03:23.556907+0000","last_fullsized":"2024-09-12T01:03:23.556907+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:26.707774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":193,"num_read_kb":183,"num_write":356,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'350","reported_seq":1891,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.346899+0000","last_change":"2024-09-12T00:18:24.863688+0000","last_active":"2024-09-12T01:03:37.346899+0000","last_peered":"2024-09-12T01:03:37.346899+0000","last_clean":"2024-09-12T01:03:37.346899+0000","last_became_active":"2024-09-12T00:18:24.863389+0000","last_became_peered":"2024-09-12T00:18:24.863389+0000","last_unstale":"2024-09-12T01:03:37.346899+0000","last_undegraded":"2024-09-12T01:03:37.346899+0000","last_fullsized":"2024-09-12T01:03:37.346899+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:05.818950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2172,"num_read_kb":2099,"num_write":388,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'347","reported_seq":981,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.126182+0000","last_change":"2024-09-12T00:18:22.863804+0000","last_active":"2024-09-12T01:04:40.126182+0000","last_peered":"2024-09-12T01:04:40.126182+0000","last_clean":"2024-09-12T01:04:40.126182+0000","last_became_active":"2024-09-12T00:18:22.863535+0000","last_became_peered":"2024-09-12T00:18:22.863535+0000","last_unstale":"2024-09-12T01:04:40.126182+0000","last_undegraded":"2024-09-12T01:04:40.126182+0000","last_fullsized":"2024-09-12T01:04:40.126182+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:39.498808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":493,"num_read_kb":3769,"num_write":1077,"num_write_kb":28344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:27.709827+0000","last_change":"2024-09-12T00:18:26.875530+0000","last_active":"2024-09-12T01:00:27.709827+0000","last_peered":"2024-09-12T01:00:27.709827+0000","last_clean":"2024-09-12T01:00:27.709827+0000","last_became_active":"2024-09-12T00:18:26.874839+0000","last_became_peered":"2024-09-12T00:18:26.874839+0000","last_unstale":"2024-09-12T01:00:27.709827+0000","last_undegraded":"2024-09-12T01:00:27.709827+0000","last_fullsized":"2024-09-12T01:00:27.709827+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:15.854373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'271","reported_seq":840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.000852+0000","last_change":"2024-09-12T00:18:28.891511+0000","last_active":"2024-09-12T01:04:39.000852+0000","last_peered":"2024-09-12T01:04:39.000852+0000","last_clean":"2024-09-12T01:04:39.000852+0000","last_became_active":"2024-09-12T00:18:28.888325+0000","last_became_peered":"2024-09-12T00:18:28.888325+0000","last_unstale":"2024-09-12T01:04:39.000852+0000","last_undegraded":"2024-09-12T01:04:39.000852+0000","last_fullsized":"2024-09-12T01:04:39.000852+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:42.542012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52815,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":453,"num_read_kb":1069,"num_write":372,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":491,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:31.547022+0000","last_change":"2024-09-12T00:18:30.900318+0000","last_active":"2024-09-12T01:00:31.547022+0000","last_peered":"2024-09-12T01:00:31.547022+0000","last_clean":"2024-09-12T01:00:31.547022+0000","last_became_active":"2024-09-12T00:18:30.899237+0000","last_became_peered":"2024-09-12T00:18:30.899237+0000","last_unstale":"2024-09-12T01:00:31.547022+0000","last_undegraded":"2024-09-12T01:00:31.547022+0000","last_fullsized":"2024-09-12T01:00:31.547022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:30.916112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'930","reported_seq":2365,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.094892+0000","last_change":"2024-09-12T00:18:24.861100+0000","last_active":"2024-09-12T01:03:04.094892+0000","last_peered":"2024-09-12T01:03:04.094892+0000","last_clean":"2024-09-12T01:03:04.094892+0000","last_became_active":"2024-09-12T00:18:24.859351+0000","last_became_peered":"2024-09-12T00:18:24.859351+0000","last_unstale":"2024-09-12T01:03:04.094892+0000","last_undegraded":"2024-09-12T01:03:04.094892+0000","last_fullsized":"2024-09-12T01:03:04.094892+0000","mapping_epoch":26,"log_start":"268'900","ondisk_log_start":"268'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":900,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:16.033612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4324,"num_read_kb":3896,"num_write":1355,"num_write_kb":567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'313","reported_seq":1013,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.105099+0000","last_change":"2024-09-12T00:18:22.840532+0000","last_active":"2024-09-12T01:04:40.105099+0000","last_peered":"2024-09-12T01:04:40.105099+0000","last_clean":"2024-09-12T01:04:40.105099+0000","last_became_active":"2024-09-12T00:18:22.840244+0000","last_became_peered":"2024-09-12T00:18:22.840244+0000","last_unstale":"2024-09-12T01:04:40.105099+0000","last_undegraded":"2024-09-12T01:04:40.105099+0000","last_fullsized":"2024-09-12T01:04:40.105099+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:57.476911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":618,"num_read_kb":30347,"num_write":961,"num_write_kb":34968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:36.582308+0000","last_change":"2024-09-12T00:18:26.856078+0000","last_active":"2024-09-12T01:02:36.582308+0000","last_peered":"2024-09-12T01:02:36.582308+0000","last_clean":"2024-09-12T01:02:36.582308+0000","last_became_active":"2024-09-12T00:18:26.855432+0000","last_became_peered":"2024-09-12T00:18:26.855432+0000","last_unstale":"2024-09-12T01:02:36.582308+0000","last_undegraded":"2024-09-12T01:02:36.582308+0000","last_fullsized":"2024-09-12T01:02:36.582308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:58.468112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'469","reported_seq":1112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.876428+0000","last_change":"2024-09-12T00:18:28.888006+0000","last_active":"2024-09-12T01:04:39.876428+0000","last_peered":"2024-09-12T01:04:39.876428+0000","last_clean":"2024-09-12T01:04:39.876428+0000","last_became_active":"2024-09-12T00:18:28.887245+0000","last_became_peered":"2024-09-12T00:18:28.887245+0000","last_unstale":"2024-09-12T01:04:39.876428+0000","last_undegraded":"2024-09-12T01:04:39.876428+0000","last_fullsized":"2024-09-12T01:04:39.876428+0000","mapping_epoch":30,"log_start":"268'400","ondisk_log_start":"268'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:58.763012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":845,"num_read_kb":1964,"num_write":726,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":490,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.736385+0000","last_change":"2024-09-12T00:18:30.906327+0000","last_active":"2024-09-12T01:01:02.736385+0000","last_peered":"2024-09-12T01:01:02.736385+0000","last_clean":"2024-09-12T01:01:02.736385+0000","last_became_active":"2024-09-12T00:18:30.905680+0000","last_became_peered":"2024-09-12T00:18:30.905680+0000","last_unstale":"2024-09-12T01:01:02.736385+0000","last_undegraded":"2024-09-12T01:01:02.736385+0000","last_fullsized":"2024-09-12T01:01:02.736385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:50.953253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'152","reported_seq":659,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:43.232099+0000","last_change":"2024-09-12T00:18:32.905858+0000","last_active":"2024-09-12T01:02:43.232099+0000","last_peered":"2024-09-12T01:02:43.232099+0000","last_clean":"2024-09-12T01:02:43.232099+0000","last_became_active":"2024-09-12T00:18:32.905070+0000","last_became_peered":"2024-09-12T00:18:32.905070+0000","last_unstale":"2024-09-12T01:02:43.232099+0000","last_undegraded":"2024-09-12T01:02:43.232099+0000","last_fullsized":"2024-09-12T01:02:43.232099+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:11.929111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":167,"num_read_kb":179,"num_write":337,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'639","reported_seq":2054,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.704634+0000","last_change":"2024-09-12T00:18:24.865575+0000","last_active":"2024-09-12T01:03:20.704634+0000","last_peered":"2024-09-12T01:03:20.704634+0000","last_clean":"2024-09-12T01:03:20.704634+0000","last_became_active":"2024-09-12T00:18:24.865142+0000","last_became_peered":"2024-09-12T00:18:24.865142+0000","last_unstale":"2024-09-12T01:03:20.704634+0000","last_undegraded":"2024-09-12T01:03:20.704634+0000","last_fullsized":"2024-09-12T01:03:20.704634+0000","mapping_epoch":26,"log_start":"268'600","ondisk_log_start":"268'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":600,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:47.722129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2990,"num_read_kb":2759,"num_write":892,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'341","reported_seq":1265,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.105571+0000","last_change":"2024-09-12T00:18:22.846016+0000","last_active":"2024-09-12T01:04:40.105571+0000","last_peered":"2024-09-12T01:04:40.105571+0000","last_clean":"2024-09-12T01:04:40.105571+0000","last_became_active":"2024-09-12T00:18:22.845288+0000","last_became_peered":"2024-09-12T00:18:22.845288+0000","last_unstale":"2024-09-12T01:04:40.105571+0000","last_undegraded":"2024-09-12T01:04:40.105571+0000","last_fullsized":"2024-09-12T01:04:40.105571+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:08.062033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1116,"num_read_kb":11059,"num_write":1212,"num_write_kb":25104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.731837+0000","last_change":"2024-09-12T00:18:26.875611+0000","last_active":"2024-09-12T01:02:12.731837+0000","last_peered":"2024-09-12T01:02:12.731837+0000","last_clean":"2024-09-12T01:02:12.731837+0000","last_became_active":"2024-09-12T00:18:26.874972+0000","last_became_peered":"2024-09-12T00:18:26.874972+0000","last_unstale":"2024-09-12T01:02:12.731837+0000","last_undegraded":"2024-09-12T01:02:12.731837+0000","last_fullsized":"2024-09-12T01:02:12.731837+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:26.192283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'317","reported_seq":900,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.040355+0000","last_change":"2024-09-12T00:18:28.893601+0000","last_active":"2024-09-12T01:04:39.040355+0000","last_peered":"2024-09-12T01:04:39.040355+0000","last_clean":"2024-09-12T01:04:39.040355+0000","last_became_active":"2024-09-12T00:18:28.892852+0000","last_became_peered":"2024-09-12T00:18:28.892852+0000","last_unstale":"2024-09-12T01:04:39.040355+0000","last_undegraded":"2024-09-12T01:04:39.040355+0000","last_fullsized":"2024-09-12T01:04:39.040355+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:16.294300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53047,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":539,"num_read_kb":1212,"num_write":456,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:01.538521+0000","last_change":"2024-09-12T00:18:30.893248+0000","last_active":"2024-09-12T01:01:01.538521+0000","last_peered":"2024-09-12T01:01:01.538521+0000","last_clean":"2024-09-12T01:01:01.538521+0000","last_became_active":"2024-09-12T00:18:30.892643+0000","last_became_peered":"2024-09-12T00:18:30.892643+0000","last_unstale":"2024-09-12T01:01:01.538521+0000","last_undegraded":"2024-09-12T01:01:01.538521+0000","last_fullsized":"2024-09-12T01:01:01.538521+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:18.646293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'240","reported_seq":780,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.132867+0000","last_change":"2024-09-12T00:18:32.902236+0000","last_active":"2024-09-12T01:03:02.132867+0000","last_peered":"2024-09-12T01:03:02.132867+0000","last_clean":"2024-09-12T01:03:02.132867+0000","last_became_active":"2024-09-12T00:18:32.901587+0000","last_became_peered":"2024-09-12T00:18:32.901587+0000","last_unstale":"2024-09-12T01:03:02.132867+0000","last_undegraded":"2024-09-12T01:03:02.132867+0000","last_fullsized":"2024-09-12T01:03:02.132867+0000","mapping_epoch":34,"log_start":"268'200","ondisk_log_start":"268'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:22.015039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":371,"num_read_kb":330,"num_write":585,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'492","reported_seq":2033,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.884678+0000","last_change":"2024-09-12T00:18:24.861062+0000","last_active":"2024-09-12T01:03:25.884678+0000","last_peered":"2024-09-12T01:03:25.884678+0000","last_clean":"2024-09-12T01:03:25.884678+0000","last_became_active":"2024-09-12T00:18:24.860647+0000","last_became_peered":"2024-09-12T00:18:24.860647+0000","last_unstale":"2024-09-12T01:03:25.884678+0000","last_undegraded":"2024-09-12T01:03:25.884678+0000","last_fullsized":"2024-09-12T01:03:25.884678+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:16.460437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2720,"num_read_kb":2539,"num_write":620,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'371","reported_seq":1044,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.138511+0000","last_change":"2024-09-12T00:18:22.856961+0000","last_active":"2024-09-12T01:04:40.138511+0000","last_peered":"2024-09-12T01:04:40.138511+0000","last_clean":"2024-09-12T01:04:40.138511+0000","last_became_active":"2024-09-12T00:18:22.856073+0000","last_became_peered":"2024-09-12T00:18:22.856073+0000","last_unstale":"2024-09-12T01:04:40.138511+0000","last_undegraded":"2024-09-12T01:04:40.138511+0000","last_fullsized":"2024-09-12T01:04:40.138511+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:02.567076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468142,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":578,"num_read_kb":15678,"num_write":1129,"num_write_kb":22765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.532329+0000","last_change":"2024-09-12T00:18:26.862928+0000","last_active":"2024-09-12T01:00:57.532329+0000","last_peered":"2024-09-12T01:00:57.532329+0000","last_clean":"2024-09-12T01:00:57.532329+0000","last_became_active":"2024-09-12T00:18:26.862012+0000","last_became_peered":"2024-09-12T00:18:26.862012+0000","last_unstale":"2024-09-12T01:00:57.532329+0000","last_undegraded":"2024-09-12T01:00:57.532329+0000","last_fullsized":"2024-09-12T01:00:57.532329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:16.642244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'278","reported_seq":869,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.797040+0000","last_change":"2024-09-12T00:18:28.882861+0000","last_active":"2024-09-12T01:04:39.797040+0000","last_peered":"2024-09-12T01:04:39.797040+0000","last_clean":"2024-09-12T01:04:39.797040+0000","last_became_active":"2024-09-12T00:18:28.882129+0000","last_became_peered":"2024-09-12T00:18:28.882129+0000","last_unstale":"2024-09-12T01:04:39.797040+0000","last_undegraded":"2024-09-12T01:04:39.797040+0000","last_fullsized":"2024-09-12T01:04:39.797040+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:30.970755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47744,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":1049,"num_write":372,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:41.562408+0000","last_change":"2024-09-12T00:18:30.906689+0000","last_active":"2024-09-12T01:02:41.562408+0000","last_peered":"2024-09-12T01:02:41.562408+0000","last_clean":"2024-09-12T01:02:41.562408+0000","last_became_active":"2024-09-12T00:18:30.902511+0000","last_became_peered":"2024-09-12T00:18:30.902511+0000","last_unstale":"2024-09-12T01:02:41.562408+0000","last_undegraded":"2024-09-12T01:02:41.562408+0000","last_fullsized":"2024-09-12T01:02:41.562408+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'129","reported_seq":646,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.800676+0000","last_change":"2024-09-12T00:18:32.901622+0000","last_active":"2024-09-12T01:04:31.800676+0000","last_peered":"2024-09-12T01:04:31.800676+0000","last_clean":"2024-09-12T01:04:31.800676+0000","last_became_active":"2024-09-12T00:18:32.899968+0000","last_became_peered":"2024-09-12T00:18:32.899968+0000","last_unstale":"2024-09-12T01:04:31.800676+0000","last_undegraded":"2024-09-12T01:04:31.800676+0000","last_fullsized":"2024-09-12T01:04:31.800676+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:05.182292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":825,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":214,"num_read_kb":184,"num_write":320,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'363","reported_seq":1735,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.094141+0000","last_change":"2024-09-12T00:18:24.861615+0000","last_active":"2024-09-12T01:03:04.094141+0000","last_peered":"2024-09-12T01:03:04.094141+0000","last_clean":"2024-09-12T01:03:04.094141+0000","last_became_active":"2024-09-12T00:18:24.861271+0000","last_became_peered":"2024-09-12T00:18:24.861271+0000","last_unstale":"2024-09-12T01:03:04.094141+0000","last_undegraded":"2024-09-12T01:03:04.094141+0000","last_fullsized":"2024-09-12T01:03:04.094141+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:54.383255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2074,"num_read_kb":1954,"num_write":427,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'342","reported_seq":971,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.118463+0000","last_change":"2024-09-12T00:18:22.860377+0000","last_active":"2024-09-12T01:04:40.118463+0000","last_peered":"2024-09-12T01:04:40.118463+0000","last_clean":"2024-09-12T01:04:40.118463+0000","last_became_active":"2024-09-12T00:18:22.859695+0000","last_became_peered":"2024-09-12T00:18:22.859695+0000","last_unstale":"2024-09-12T01:04:40.118463+0000","last_undegraded":"2024-09-12T01:04:40.118463+0000","last_fullsized":"2024-09-12T01:04:40.118463+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:06.061275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263211,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":478,"num_read_kb":12426,"num_write":1109,"num_write_kb":25448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:56.536187+0000","last_change":"2024-09-12T00:18:26.859701+0000","last_active":"2024-09-12T01:00:56.536187+0000","last_peered":"2024-09-12T01:00:56.536187+0000","last_clean":"2024-09-12T01:00:56.536187+0000","last_became_active":"2024-09-12T00:18:26.859234+0000","last_became_peered":"2024-09-12T00:18:26.859234+0000","last_unstale":"2024-09-12T01:00:56.536187+0000","last_undegraded":"2024-09-12T01:00:56.536187+0000","last_fullsized":"2024-09-12T01:00:56.536187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:11.914399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'122","reported_seq":656,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:42.558624+0000","last_change":"2024-09-12T00:18:28.884827+0000","last_active":"2024-09-12T01:02:42.558624+0000","last_peered":"2024-09-12T01:02:42.558624+0000","last_clean":"2024-09-12T01:02:42.558624+0000","last_became_active":"2024-09-12T00:18:28.883277+0000","last_became_peered":"2024-09-12T00:18:28.883277+0000","last_unstale":"2024-09-12T01:02:42.558624+0000","last_undegraded":"2024-09-12T01:02:42.558624+0000","last_fullsized":"2024-09-12T01:02:42.558624+0000","mapping_epoch":30,"log_start":"268'100","ondisk_log_start":"268'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:38.381310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":135,"num_read_kb":124,"num_write":148,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'770","reported_seq":2201,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.736580+0000","last_change":"2024-09-12T00:18:30.895935+0000","last_active":"2024-09-12T01:04:39.736580+0000","last_peered":"2024-09-12T01:04:39.736580+0000","last_clean":"2024-09-12T01:04:39.736580+0000","last_became_active":"2024-09-12T00:18:30.893175+0000","last_became_peered":"2024-09-12T00:18:30.893175+0000","last_unstale":"2024-09-12T01:04:39.736580+0000","last_undegraded":"2024-09-12T01:04:39.736580+0000","last_fullsized":"2024-09-12T01:04:39.736580+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:51.257227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'108","reported_seq":602,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.731248+0000","last_change":"2024-09-12T00:18:32.909110+0000","last_active":"2024-09-12T01:03:06.731248+0000","last_peered":"2024-09-12T01:03:06.731248+0000","last_clean":"2024-09-12T01:03:06.731248+0000","last_became_active":"2024-09-12T00:18:32.908295+0000","last_became_peered":"2024-09-12T00:18:32.908295+0000","last_unstale":"2024-09-12T01:03:06.731248+0000","last_undegraded":"2024-09-12T01:03:06.731248+0000","last_fullsized":"2024-09-12T01:03:06.731248+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:19.170686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":102,"num_write":264,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'833","reported_seq":2453,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.192049+0000","last_change":"2024-09-12T00:18:24.861275+0000","last_active":"2024-09-12T01:03:11.192049+0000","last_peered":"2024-09-12T01:03:11.192049+0000","last_clean":"2024-09-12T01:03:11.192049+0000","last_became_active":"2024-09-12T00:18:24.860266+0000","last_became_peered":"2024-09-12T00:18:24.860266+0000","last_unstale":"2024-09-12T01:03:11.192049+0000","last_undegraded":"2024-09-12T01:03:11.192049+0000","last_fullsized":"2024-09-12T01:03:11.192049+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":800,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:29.020383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4128,"num_read_kb":3735,"num_write":1126,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'311","reported_seq":915,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.083084+0000","last_change":"2024-09-12T00:18:22.872906+0000","last_active":"2024-09-12T01:04:40.083084+0000","last_peered":"2024-09-12T01:04:40.083084+0000","last_clean":"2024-09-12T01:04:40.083084+0000","last_became_active":"2024-09-12T00:18:22.867694+0000","last_became_peered":"2024-09-12T00:18:22.867694+0000","last_unstale":"2024-09-12T01:04:40.083084+0000","last_undegraded":"2024-09-12T01:04:40.083084+0000","last_fullsized":"2024-09-12T01:04:40.083084+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:34.546151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194362,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":405,"num_read_kb":19923,"num_write":982,"num_write_kb":45748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.531105+0000","last_change":"2024-09-12T00:18:26.865232+0000","last_active":"2024-09-12T01:00:57.531105+0000","last_peered":"2024-09-12T01:00:57.531105+0000","last_clean":"2024-09-12T01:00:57.531105+0000","last_became_active":"2024-09-12T00:18:26.864536+0000","last_became_peered":"2024-09-12T00:18:26.864536+0000","last_unstale":"2024-09-12T01:00:57.531105+0000","last_undegraded":"2024-09-12T01:00:57.531105+0000","last_fullsized":"2024-09-12T01:00:57.531105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:55.926276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'337","reported_seq":947,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.057410+0000","last_change":"2024-09-12T00:18:28.885849+0000","last_active":"2024-09-12T01:04:40.057410+0000","last_peered":"2024-09-12T01:04:40.057410+0000","last_clean":"2024-09-12T01:04:40.057410+0000","last_became_active":"2024-09-12T00:18:28.885152+0000","last_became_peered":"2024-09-12T00:18:28.885152+0000","last_unstale":"2024-09-12T01:04:40.057410+0000","last_undegraded":"2024-09-12T01:04:40.057410+0000","last_fullsized":"2024-09-12T01:04:40.057410+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:29.158839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50453,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":539,"num_read_kb":1151,"num_write":436,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":491,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:01.573124+0000","last_change":"2024-09-12T00:18:30.895751+0000","last_active":"2024-09-12T01:02:01.573124+0000","last_peered":"2024-09-12T01:02:01.573124+0000","last_clean":"2024-09-12T01:02:01.573124+0000","last_became_active":"2024-09-12T00:18:30.888974+0000","last_became_peered":"2024-09-12T00:18:30.888974+0000","last_unstale":"2024-09-12T01:02:01.573124+0000","last_undegraded":"2024-09-12T01:02:01.573124+0000","last_fullsized":"2024-09-12T01:02:01.573124+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:53.240426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'97","reported_seq":604,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.290751+0000","last_change":"2024-09-12T00:18:32.915634+0000","last_active":"2024-09-12T01:03:23.290751+0000","last_peered":"2024-09-12T01:03:23.290751+0000","last_clean":"2024-09-12T01:03:23.290751+0000","last_became_active":"2024-09-12T00:18:32.914994+0000","last_became_peered":"2024-09-12T00:18:32.914994+0000","last_unstale":"2024-09-12T01:03:23.290751+0000","last_undegraded":"2024-09-12T01:03:23.290751+0000","last_fullsized":"2024-09-12T01:03:23.290751+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:03.290807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":129,"num_write":234,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'858","reported_seq":2375,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.841192+0000","last_change":"2024-09-12T00:18:24.854861+0000","last_active":"2024-09-12T01:04:30.841192+0000","last_peered":"2024-09-12T01:04:30.841192+0000","last_clean":"2024-09-12T01:04:30.841192+0000","last_became_active":"2024-09-12T00:18:24.854089+0000","last_became_peered":"2024-09-12T00:18:24.854089+0000","last_unstale":"2024-09-12T01:04:30.841192+0000","last_undegraded":"2024-09-12T01:04:30.841192+0000","last_fullsized":"2024-09-12T01:04:30.841192+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":800,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:09.009238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4036,"num_read_kb":3617,"num_write":1169,"num_write_kb":474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'342","reported_seq":977,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.095994+0000","last_change":"2024-09-12T00:18:22.876376+0000","last_active":"2024-09-12T01:04:40.095994+0000","last_peered":"2024-09-12T01:04:40.095994+0000","last_clean":"2024-09-12T01:04:40.095994+0000","last_became_active":"2024-09-12T00:18:22.867744+0000","last_became_peered":"2024-09-12T00:18:22.867744+0000","last_unstale":"2024-09-12T01:04:40.095994+0000","last_undegraded":"2024-09-12T01:04:40.095994+0000","last_fullsized":"2024-09-12T01:04:40.095994+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:17.533748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":517,"num_read_kb":9523,"num_write":1195,"num_write_kb":17845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.735193+0000","last_change":"2024-09-12T00:18:26.858490+0000","last_active":"2024-09-12T01:00:57.735193+0000","last_peered":"2024-09-12T01:00:57.735193+0000","last_clean":"2024-09-12T01:00:57.735193+0000","last_became_active":"2024-09-12T00:18:26.857810+0000","last_became_peered":"2024-09-12T00:18:26.857810+0000","last_unstale":"2024-09-12T01:00:57.735193+0000","last_undegraded":"2024-09-12T01:00:57.735193+0000","last_fullsized":"2024-09-12T01:00:57.735193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:16.264419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'255","reported_seq":832,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.096997+0000","last_change":"2024-09-12T00:18:28.882323+0000","last_active":"2024-09-12T01:04:40.096997+0000","last_peered":"2024-09-12T01:04:40.096997+0000","last_clean":"2024-09-12T01:04:40.096997+0000","last_became_active":"2024-09-12T00:18:28.881556+0000","last_became_peered":"2024-09-12T00:18:28.881556+0000","last_unstale":"2024-09-12T01:04:40.096997+0000","last_undegraded":"2024-09-12T01:04:40.096997+0000","last_fullsized":"2024-09-12T01:04:40.096997+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:58.134241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48228,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":430,"num_read_kb":998,"num_write":346,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:07.730322+0000","last_change":"2024-09-12T00:18:30.902376+0000","last_active":"2024-09-12T01:02:07.730322+0000","last_peered":"2024-09-12T01:02:07.730322+0000","last_clean":"2024-09-12T01:02:07.730322+0000","last_became_active":"2024-09-12T00:18:30.898539+0000","last_became_peered":"2024-09-12T00:18:30.898539+0000","last_unstale":"2024-09-12T01:02:07.730322+0000","last_undegraded":"2024-09-12T01:02:07.730322+0000","last_fullsized":"2024-09-12T01:02:07.730322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:18.476695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'110","reported_seq":637,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.199453+0000","last_change":"2024-09-12T00:18:32.908261+0000","last_active":"2024-09-12T01:03:08.199453+0000","last_peered":"2024-09-12T01:03:08.199453+0000","last_clean":"2024-09-12T01:03:08.199453+0000","last_became_active":"2024-09-12T00:18:32.907530+0000","last_became_peered":"2024-09-12T00:18:32.907530+0000","last_unstale":"2024-09-12T01:03:08.199453+0000","last_undegraded":"2024-09-12T01:03:08.199453+0000","last_fullsized":"2024-09-12T01:03:08.199453+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:37.368919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":167,"num_read_kb":160,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'364","reported_seq":1689,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.349766+0000","last_change":"2024-09-12T00:18:24.842626+0000","last_active":"2024-09-12T01:03:10.349766+0000","last_peered":"2024-09-12T01:03:10.349766+0000","last_clean":"2024-09-12T01:03:10.349766+0000","last_became_active":"2024-09-12T00:18:24.842263+0000","last_became_peered":"2024-09-12T00:18:24.842263+0000","last_unstale":"2024-09-12T01:03:10.349766+0000","last_undegraded":"2024-09-12T01:03:10.349766+0000","last_fullsized":"2024-09-12T01:03:10.349766+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:07.799244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1879,"num_read_kb":1766,"num_write":437,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'428","reported_seq":1202,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.117266+0000","last_change":"2024-09-12T00:18:22.837822+0000","last_active":"2024-09-12T01:04:40.117266+0000","last_peered":"2024-09-12T01:04:40.117266+0000","last_clean":"2024-09-12T01:04:40.117266+0000","last_became_active":"2024-09-12T00:18:22.837412+0000","last_became_peered":"2024-09-12T00:18:22.837412+0000","last_unstale":"2024-09-12T01:04:40.117266+0000","last_undegraded":"2024-09-12T01:04:40.117266+0000","last_fullsized":"2024-09-12T01:04:40.117266+0000","mapping_epoch":24,"log_start":"268'400","ondisk_log_start":"268'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:41.073377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5614631,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":898,"num_read_kb":48874,"num_write":1334,"num_write_kb":53147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.546076+0000","last_change":"2024-09-12T00:18:26.869821+0000","last_active":"2024-09-12T01:01:57.546076+0000","last_peered":"2024-09-12T01:01:57.546076+0000","last_clean":"2024-09-12T01:01:57.546076+0000","last_became_active":"2024-09-12T00:18:26.868407+0000","last_became_peered":"2024-09-12T00:18:26.868407+0000","last_unstale":"2024-09-12T01:01:57.546076+0000","last_undegraded":"2024-09-12T01:01:57.546076+0000","last_fullsized":"2024-09-12T01:01:57.546076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:11.537097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'267","reported_seq":839,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.712285+0000","last_change":"2024-09-12T00:18:28.896471+0000","last_active":"2024-09-12T01:04:39.712285+0000","last_peered":"2024-09-12T01:04:39.712285+0000","last_clean":"2024-09-12T01:04:39.712285+0000","last_became_active":"2024-09-12T00:18:28.895848+0000","last_became_peered":"2024-09-12T00:18:28.895848+0000","last_unstale":"2024-09-12T01:04:39.712285+0000","last_undegraded":"2024-09-12T01:04:39.712285+0000","last_fullsized":"2024-09-12T01:04:39.712285+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:11.864170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53006,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":433,"num_read_kb":1065,"num_write":360,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":494,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.533540+0000","last_change":"2024-09-12T00:18:30.893385+0000","last_active":"2024-09-12T01:01:02.533540+0000","last_peered":"2024-09-12T01:01:02.533540+0000","last_clean":"2024-09-12T01:01:02.533540+0000","last_became_active":"2024-09-12T00:18:30.892682+0000","last_became_peered":"2024-09-12T00:18:30.892682+0000","last_unstale":"2024-09-12T01:01:02.533540+0000","last_undegraded":"2024-09-12T01:01:02.533540+0000","last_fullsized":"2024-09-12T01:01:02.533540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:03.256684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'208","reported_seq":1695,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.225211+0000","last_change":"2024-09-12T00:18:32.911619+0000","last_active":"2024-09-12T01:03:23.225211+0000","last_peered":"2024-09-12T01:03:23.225211+0000","last_clean":"2024-09-12T01:03:23.225211+0000","last_became_active":"2024-09-12T00:18:32.911082+0000","last_became_peered":"2024-09-12T00:18:32.911082+0000","last_unstale":"2024-09-12T01:03:23.225211+0000","last_undegraded":"2024-09-12T01:03:23.225211+0000","last_fullsized":"2024-09-12T01:03:23.225211+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:46.062158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1287,"num_read_kb":1263,"num_write":482,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'525","reported_seq":2115,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.829396+0000","last_change":"2024-09-12T00:18:24.881623+0000","last_active":"2024-09-12T01:04:30.829396+0000","last_peered":"2024-09-12T01:04:30.829396+0000","last_clean":"2024-09-12T01:04:30.829396+0000","last_became_active":"2024-09-12T00:18:24.881029+0000","last_became_peered":"2024-09-12T00:18:24.881029+0000","last_unstale":"2024-09-12T01:04:30.829396+0000","last_undegraded":"2024-09-12T01:04:30.829396+0000","last_fullsized":"2024-09-12T01:04:30.829396+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:53.918281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2735,"num_read_kb":2532,"num_write":658,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'392","reported_seq":1098,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.113293+0000","last_change":"2024-09-12T00:18:22.864476+0000","last_active":"2024-09-12T01:04:40.113293+0000","last_peered":"2024-09-12T01:04:40.113293+0000","last_clean":"2024-09-12T01:04:40.113293+0000","last_became_active":"2024-09-12T00:18:22.863907+0000","last_became_peered":"2024-09-12T00:18:22.863907+0000","last_unstale":"2024-09-12T01:04:40.113293+0000","last_undegraded":"2024-09-12T01:04:40.113293+0000","last_fullsized":"2024-09-12T01:04:40.113293+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:45.526909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1987000,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":643,"num_read_kb":24608,"num_write":1249,"num_write_kb":29666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:06.553634+0000","last_change":"2024-09-12T00:18:26.867344+0000","last_active":"2024-09-12T01:02:06.553634+0000","last_peered":"2024-09-12T01:02:06.553634+0000","last_clean":"2024-09-12T01:02:06.553634+0000","last_became_active":"2024-09-12T00:18:26.866967+0000","last_became_peered":"2024-09-12T00:18:26.866967+0000","last_unstale":"2024-09-12T01:02:06.553634+0000","last_undegraded":"2024-09-12T01:02:06.553634+0000","last_fullsized":"2024-09-12T01:02:06.553634+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:36.323953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'309","reported_seq":911,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.842454+0000","last_change":"2024-09-12T00:18:28.898664+0000","last_active":"2024-09-12T01:04:39.842454+0000","last_peered":"2024-09-12T01:04:39.842454+0000","last_clean":"2024-09-12T01:04:39.842454+0000","last_became_active":"2024-09-12T00:18:28.897709+0000","last_became_peered":"2024-09-12T00:18:28.897709+0000","last_unstale":"2024-09-12T01:04:39.842454+0000","last_undegraded":"2024-09-12T01:04:39.842454+0000","last_fullsized":"2024-09-12T01:04:39.842454+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:21.269051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54863,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":525,"num_read_kb":1160,"num_write":422,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":490,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:01.554976+0000","last_change":"2024-09-12T00:18:30.898241+0000","last_active":"2024-09-12T01:01:01.554976+0000","last_peered":"2024-09-12T01:01:01.554976+0000","last_clean":"2024-09-12T01:01:01.554976+0000","last_became_active":"2024-09-12T00:18:30.889179+0000","last_became_peered":"2024-09-12T00:18:30.889179+0000","last_unstale":"2024-09-12T01:01:01.554976+0000","last_undegraded":"2024-09-12T01:01:01.554976+0000","last_fullsized":"2024-09-12T01:01:01.554976+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:34.242145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'191","reported_seq":755,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.817447+0000","last_change":"2024-09-12T00:18:32.908462+0000","last_active":"2024-09-12T01:04:30.817447+0000","last_peered":"2024-09-12T01:04:30.817447+0000","last_clean":"2024-09-12T01:04:30.817447+0000","last_became_active":"2024-09-12T00:18:32.907658+0000","last_became_peered":"2024-09-12T00:18:32.907658+0000","last_unstale":"2024-09-12T01:04:30.817447+0000","last_undegraded":"2024-09-12T01:04:30.817447+0000","last_fullsized":"2024-09-12T01:04:30.817447+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:03.641123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":435,"num_read_kb":358,"num_write":481,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'411","reported_seq":1911,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.825050+0000","last_change":"2024-09-12T00:18:24.878945+0000","last_active":"2024-09-12T01:04:30.825050+0000","last_peered":"2024-09-12T01:04:30.825050+0000","last_clean":"2024-09-12T01:04:30.825050+0000","last_became_active":"2024-09-12T00:18:24.878522+0000","last_became_peered":"2024-09-12T00:18:24.878522+0000","last_unstale":"2024-09-12T01:04:30.825050+0000","last_undegraded":"2024-09-12T01:04:30.825050+0000","last_fullsized":"2024-09-12T01:04:30.825050+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:42.239984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2233,"num_read_kb":2110,"num_write":497,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'383","reported_seq":1050,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.094136+0000","last_change":"2024-09-12T00:18:22.853126+0000","last_active":"2024-09-12T01:04:40.094136+0000","last_peered":"2024-09-12T01:04:40.094136+0000","last_clean":"2024-09-12T01:04:40.094136+0000","last_became_active":"2024-09-12T00:18:22.851554+0000","last_became_peered":"2024-09-12T00:18:22.851554+0000","last_unstale":"2024-09-12T01:04:40.094136+0000","last_undegraded":"2024-09-12T01:04:40.094136+0000","last_fullsized":"2024-09-12T01:04:40.094136+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:48.723489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":573,"num_read_kb":70445,"num_write":1144,"num_write_kb":38293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"268'1219","reported_seq":2832,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.908340+0000","last_change":"2024-09-12T00:18:24.857511+0000","last_active":"2024-09-12T01:02:46.908340+0000","last_peered":"2024-09-12T01:02:46.908340+0000","last_clean":"2024-09-12T01:02:46.908340+0000","last_became_active":"2024-09-12T00:18:24.857107+0000","last_became_peered":"2024-09-12T00:18:24.857107+0000","last_unstale":"2024-09-12T01:02:46.908340+0000","last_undegraded":"2024-09-12T01:02:46.908340+0000","last_fullsized":"2024-09-12T01:02:46.908340+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":1200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:46.479301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5568,"num_read_kb":4913,"num_write":1657,"num_write_kb":681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"268'361","reported_seq":1012,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.116826+0000","last_change":"2024-09-12T00:18:56.194536+0000","last_active":"2024-09-12T01:04:40.116826+0000","last_peered":"2024-09-12T01:04:40.116826+0000","last_clean":"2024-09-12T01:04:40.116826+0000","last_became_active":"2024-09-12T00:18:56.193721+0000","last_became_peered":"2024-09-12T00:18:56.193721+0000","last_unstale":"2024-09-12T01:04:40.116826+0000","last_undegraded":"2024-09-12T01:04:40.116826+0000","last_fullsized":"2024-09-12T01:04:40.116826+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:45.173064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342105,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":474,"num_read_kb":19261,"num_write":1030,"num_write_kb":26595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'860","reported_seq":2457,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.120737+0000","last_change":"2024-09-12T00:18:24.871814+0000","last_active":"2024-09-12T01:03:25.120737+0000","last_peered":"2024-09-12T01:03:25.120737+0000","last_clean":"2024-09-12T01:03:25.120737+0000","last_became_active":"2024-09-12T00:18:24.870288+0000","last_became_peered":"2024-09-12T00:18:24.870288+0000","last_unstale":"2024-09-12T01:03:25.120737+0000","last_undegraded":"2024-09-12T01:03:25.120737+0000","last_fullsized":"2024-09-12T01:03:25.120737+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":800,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:41.437287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4146,"num_read_kb":3713,"num_write":1130,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'413","reported_seq":1050,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.071819+0000","last_change":"2024-09-12T00:18:22.872673+0000","last_active":"2024-09-12T01:04:40.071819+0000","last_peered":"2024-09-12T01:04:40.071819+0000","last_clean":"2024-09-12T01:04:40.071819+0000","last_became_active":"2024-09-12T00:18:22.866341+0000","last_became_peered":"2024-09-12T00:18:22.866341+0000","last_unstale":"2024-09-12T01:04:40.071819+0000","last_undegraded":"2024-09-12T01:04:40.071819+0000","last_fullsized":"2024-09-12T01:04:40.071819+0000","mapping_epoch":24,"log_start":"268'400","ondisk_log_start":"268'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:24.768958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1452502,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":481,"num_read_kb":25322,"num_write":1167,"num_write_kb":64729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'397","reported_seq":1894,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.440536+0000","last_change":"2024-09-12T00:18:24.866032+0000","last_active":"2024-09-12T01:03:09.440536+0000","last_peered":"2024-09-12T01:03:09.440536+0000","last_clean":"2024-09-12T01:03:09.440536+0000","last_became_active":"2024-09-12T00:18:24.865674+0000","last_became_peered":"2024-09-12T00:18:24.865674+0000","last_unstale":"2024-09-12T01:03:09.440536+0000","last_undegraded":"2024-09-12T01:03:09.440536+0000","last_fullsized":"2024-09-12T01:03:09.440536+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:58.235628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2040,"num_read_kb":1953,"num_write":432,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'341","reported_seq":1086,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.104940+0000","last_change":"2024-09-12T00:18:22.844535+0000","last_active":"2024-09-12T01:04:40.104940+0000","last_peered":"2024-09-12T01:04:40.104940+0000","last_clean":"2024-09-12T01:04:40.104940+0000","last_became_active":"2024-09-12T00:18:22.844095+0000","last_became_peered":"2024-09-12T00:18:22.844095+0000","last_unstale":"2024-09-12T01:04:40.104940+0000","last_undegraded":"2024-09-12T01:04:40.104940+0000","last_fullsized":"2024-09-12T01:04:40.104940+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:23.543074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":305939,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":760,"num_read_kb":58308,"num_write":997,"num_write_kb":25022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"268'383","reported_seq":1843,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.346854+0000","last_change":"2024-09-12T00:18:24.866012+0000","last_active":"2024-09-12T01:03:37.346854+0000","last_peered":"2024-09-12T01:03:37.346854+0000","last_clean":"2024-09-12T01:03:37.346854+0000","last_became_active":"2024-09-12T00:18:24.865720+0000","last_became_peered":"2024-09-12T00:18:24.865720+0000","last_unstale":"2024-09-12T01:03:37.346854+0000","last_undegraded":"2024-09-12T01:03:37.346854+0000","last_fullsized":"2024-09-12T01:03:37.346854+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:30.348388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2058,"num_read_kb":1953,"num_write":433,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'375","reported_seq":1050,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.107806+0000","last_change":"2024-09-12T00:18:22.858174+0000","last_active":"2024-09-12T01:04:40.107806+0000","last_peered":"2024-09-12T01:04:40.107806+0000","last_clean":"2024-09-12T01:04:40.107806+0000","last_became_active":"2024-09-12T00:18:22.857896+0000","last_became_peered":"2024-09-12T00:18:22.857896+0000","last_unstale":"2024-09-12T01:04:40.107806+0000","last_undegraded":"2024-09-12T01:04:40.107806+0000","last_fullsized":"2024-09-12T01:04:40.107806+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:35.667728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456478,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":576,"num_read_kb":17790,"num_write":1194,"num_write_kb":44407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'440","reported_seq":2170,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.192270+0000","last_change":"2024-09-12T00:18:24.867735+0000","last_active":"2024-09-12T01:03:11.192270+0000","last_peered":"2024-09-12T01:03:11.192270+0000","last_clean":"2024-09-12T01:03:11.192270+0000","last_became_active":"2024-09-12T00:18:24.866980+0000","last_became_peered":"2024-09-12T00:18:24.866980+0000","last_unstale":"2024-09-12T01:03:11.192270+0000","last_undegraded":"2024-09-12T01:03:11.192270+0000","last_fullsized":"2024-09-12T01:03:11.192270+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:25.227858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2639,"num_read_kb":2518,"num_write":497,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'319","reported_seq":977,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.105368+0000","last_change":"2024-09-12T00:18:22.847482+0000","last_active":"2024-09-12T01:04:40.105368+0000","last_peered":"2024-09-12T01:04:40.105368+0000","last_clean":"2024-09-12T01:04:40.105368+0000","last_became_active":"2024-09-12T00:18:22.846805+0000","last_became_peered":"2024-09-12T00:18:22.846805+0000","last_unstale":"2024-09-12T01:04:40.105368+0000","last_undegraded":"2024-09-12T01:04:40.105368+0000","last_fullsized":"2024-09-12T01:04:40.105368+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:38.931220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":456,"num_read_kb":82569,"num_write":1071,"num_write_kb":46093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'467","reported_seq":2006,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.119546+0000","last_change":"2024-09-12T00:18:24.862315+0000","last_active":"2024-09-12T01:03:25.119546+0000","last_peered":"2024-09-12T01:03:25.119546+0000","last_clean":"2024-09-12T01:03:25.119546+0000","last_became_active":"2024-09-12T00:18:24.862022+0000","last_became_peered":"2024-09-12T00:18:24.862022+0000","last_unstale":"2024-09-12T01:03:25.119546+0000","last_undegraded":"2024-09-12T01:03:25.119546+0000","last_fullsized":"2024-09-12T01:03:25.119546+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:31.362187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2433,"num_read_kb":2274,"num_write":552,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'344","reported_seq":968,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.111964+0000","last_change":"2024-09-12T00:18:22.872677+0000","last_active":"2024-09-12T01:04:40.111964+0000","last_peered":"2024-09-12T01:04:40.111964+0000","last_clean":"2024-09-12T01:04:40.111964+0000","last_became_active":"2024-09-12T00:18:22.871980+0000","last_became_peered":"2024-09-12T00:18:22.871980+0000","last_unstale":"2024-09-12T01:04:40.111964+0000","last_undegraded":"2024-09-12T01:04:40.111964+0000","last_fullsized":"2024-09-12T01:04:40.111964+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:06.765741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":467,"num_read_kb":12975,"num_write":1116,"num_write_kb":44636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'438","reported_seq":2028,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.704380+0000","last_change":"2024-09-12T00:18:24.865050+0000","last_active":"2024-09-12T01:03:20.704380+0000","last_peered":"2024-09-12T01:03:20.704380+0000","last_clean":"2024-09-12T01:03:20.704380+0000","last_became_active":"2024-09-12T00:18:24.857010+0000","last_became_peered":"2024-09-12T00:18:24.857010+0000","last_unstale":"2024-09-12T01:03:20.704380+0000","last_undegraded":"2024-09-12T01:03:20.704380+0000","last_fullsized":"2024-09-12T01:03:20.704380+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:11.724243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2477,"num_read_kb":2332,"num_write":519,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'372","reported_seq":1000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.126270+0000","last_change":"2024-09-12T00:18:22.857829+0000","last_active":"2024-09-12T01:04:40.126270+0000","last_peered":"2024-09-12T01:04:40.126270+0000","last_clean":"2024-09-12T01:04:40.126270+0000","last_became_active":"2024-09-12T00:18:22.857468+0000","last_became_peered":"2024-09-12T00:18:22.857468+0000","last_unstale":"2024-09-12T01:04:40.126270+0000","last_undegraded":"2024-09-12T01:04:40.126270+0000","last_fullsized":"2024-09-12T01:04:40.126270+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:27.114391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375108,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":489,"num_read_kb":4433,"num_write":1123,"num_write_kb":23710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"268'835","reported_seq":2445,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.175301+0000","last_change":"2024-09-12T00:18:24.857824+0000","last_active":"2024-09-12T01:03:11.175301+0000","last_peered":"2024-09-12T01:03:11.175301+0000","last_clean":"2024-09-12T01:03:11.175301+0000","last_became_active":"2024-09-12T00:18:24.857438+0000","last_became_peered":"2024-09-12T00:18:24.857438+0000","last_unstale":"2024-09-12T01:03:11.175301+0000","last_undegraded":"2024-09-12T01:03:11.175301+0000","last_fullsized":"2024-09-12T01:03:11.175301+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:33.071795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3858,"num_read_kb":3490,"num_write":1078,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'386","reported_seq":1001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.134185+0000","last_change":"2024-09-12T00:18:22.859579+0000","last_active":"2024-09-12T01:04:40.134185+0000","last_peered":"2024-09-12T01:04:40.134185+0000","last_clean":"2024-09-12T01:04:40.134185+0000","last_became_active":"2024-09-12T00:18:22.858851+0000","last_became_peered":"2024-09-12T00:18:22.858851+0000","last_unstale":"2024-09-12T01:04:40.134185+0000","last_undegraded":"2024-09-12T01:04:40.134185+0000","last_fullsized":"2024-09-12T01:04:40.134185+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:42.545358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1250253,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":485,"num_read_kb":6084,"num_write":1107,"num_write_kb":43198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'1186","reported_seq":2695,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.865689+0000","last_change":"2024-09-12T00:18:24.858035+0000","last_active":"2024-09-12T01:03:25.865689+0000","last_peered":"2024-09-12T01:03:25.865689+0000","last_clean":"2024-09-12T01:03:25.865689+0000","last_became_active":"2024-09-12T00:18:24.856121+0000","last_became_peered":"2024-09-12T00:18:24.856121+0000","last_unstale":"2024-09-12T01:03:25.865689+0000","last_undegraded":"2024-09-12T01:03:25.865689+0000","last_fullsized":"2024-09-12T01:03:25.865689+0000","mapping_epoch":26,"log_start":"268'1100","ondisk_log_start":"268'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":1100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:36.093783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5211,"num_read_kb":4574,"num_write":1611,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'356","reported_seq":1103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.114782+0000","last_change":"2024-09-12T00:18:22.858631+0000","last_active":"2024-09-12T01:04:40.114782+0000","last_peered":"2024-09-12T01:04:40.114782+0000","last_clean":"2024-09-12T01:04:40.114782+0000","last_became_active":"2024-09-12T00:18:22.857806+0000","last_became_peered":"2024-09-12T00:18:22.857806+0000","last_unstale":"2024-09-12T01:04:40.114782+0000","last_undegraded":"2024-09-12T01:04:40.114782+0000","last_fullsized":"2024-09-12T01:04:40.114782+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:33.277291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":676,"num_read_kb":44063,"num_write":1212,"num_write_kb":47646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"268'824","reported_seq":2369,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.350086+0000","last_change":"2024-09-12T00:18:24.856950+0000","last_active":"2024-09-12T01:03:10.350086+0000","last_peered":"2024-09-12T01:03:10.350086+0000","last_clean":"2024-09-12T01:03:10.350086+0000","last_became_active":"2024-09-12T00:18:24.856616+0000","last_became_peered":"2024-09-12T00:18:24.856616+0000","last_unstale":"2024-09-12T01:03:10.350086+0000","last_undegraded":"2024-09-12T01:03:10.350086+0000","last_fullsized":"2024-09-12T01:03:10.350086+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:56.988343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3862,"num_read_kb":3471,"num_write":1076,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'387","reported_seq":1158,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.109930+0000","last_change":"2024-09-12T00:18:22.874720+0000","last_active":"2024-09-12T01:04:40.109930+0000","last_peered":"2024-09-12T01:04:40.109930+0000","last_clean":"2024-09-12T01:04:40.109930+0000","last_became_active":"2024-09-12T00:18:22.873756+0000","last_became_peered":"2024-09-12T00:18:22.873756+0000","last_unstale":"2024-09-12T01:04:40.109930+0000","last_undegraded":"2024-09-12T01:04:40.109930+0000","last_fullsized":"2024-09-12T01:04:40.109930+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:18.449548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263200,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":909,"num_read_kb":25128,"num_write":1275,"num_write_kb":39639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'1580","reported_seq":3271,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.439933+0000","last_change":"2024-09-12T00:18:24.883740+0000","last_active":"2024-09-12T01:03:09.439933+0000","last_peered":"2024-09-12T01:03:09.439933+0000","last_clean":"2024-09-12T01:03:09.439933+0000","last_became_active":"2024-09-12T00:18:24.882937+0000","last_became_peered":"2024-09-12T00:18:24.882937+0000","last_unstale":"2024-09-12T01:03:09.439933+0000","last_undegraded":"2024-09-12T01:03:09.439933+0000","last_fullsized":"2024-09-12T01:03:09.439933+0000","mapping_epoch":26,"log_start":"268'1500","ondisk_log_start":"268'1500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":1500,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:22.907432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7111,"num_read_kb":6230,"num_write":2206,"num_write_kb":938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'433","reported_seq":1163,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.138510+0000","last_change":"2024-09-12T00:18:22.869861+0000","last_active":"2024-09-12T01:04:40.138510+0000","last_peered":"2024-09-12T01:04:40.138510+0000","last_clean":"2024-09-12T01:04:40.138510+0000","last_became_active":"2024-09-12T00:18:22.869527+0000","last_became_peered":"2024-09-12T00:18:22.869527+0000","last_unstale":"2024-09-12T01:04:40.138510+0000","last_undegraded":"2024-09-12T01:04:40.138510+0000","last_fullsized":"2024-09-12T01:04:40.138510+0000","mapping_epoch":24,"log_start":"268'400","ondisk_log_start":"268'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:28.494266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262232,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":772,"num_read_kb":72891,"num_write":1443,"num_write_kb":29040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'772","reported_seq":2178,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.702907+0000","last_change":"2024-09-12T00:18:24.866786+0000","last_active":"2024-09-12T01:03:20.702907+0000","last_peered":"2024-09-12T01:03:20.702907+0000","last_clean":"2024-09-12T01:03:20.702907+0000","last_became_active":"2024-09-12T00:18:24.866062+0000","last_became_peered":"2024-09-12T00:18:24.866062+0000","last_unstale":"2024-09-12T01:03:20.702907+0000","last_undegraded":"2024-09-12T01:03:20.702907+0000","last_fullsized":"2024-09-12T01:03:20.702907+0000","mapping_epoch":26,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:41.456955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3587,"num_read_kb":3210,"num_write":1032,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'372","reported_seq":1053,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.102261+0000","last_change":"2024-09-12T00:18:22.858952+0000","last_active":"2024-09-12T01:04:40.102261+0000","last_peered":"2024-09-12T01:04:40.102261+0000","last_clean":"2024-09-12T01:04:40.102261+0000","last_became_active":"2024-09-12T00:18:22.858141+0000","last_became_peered":"2024-09-12T00:18:22.858141+0000","last_unstale":"2024-09-12T01:04:40.102261+0000","last_undegraded":"2024-09-12T01:04:40.102261+0000","last_fullsized":"2024-09-12T01:04:40.102261+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:25.792326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":648,"num_read_kb":25195,"num_write":1350,"num_write_kb":34646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'1217","reported_seq":3118,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.594177+0000","last_change":"2024-09-12T00:18:24.860271+0000","last_active":"2024-09-12T01:03:26.594177+0000","last_peered":"2024-09-12T01:03:26.594177+0000","last_clean":"2024-09-12T01:03:26.594177+0000","last_became_active":"2024-09-12T00:18:24.859973+0000","last_became_peered":"2024-09-12T00:18:24.859973+0000","last_unstale":"2024-09-12T01:03:26.594177+0000","last_undegraded":"2024-09-12T01:03:26.594177+0000","last_fullsized":"2024-09-12T01:03:26.594177+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":1200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:18.330323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5984,"num_read_kb":5306,"num_write":1779,"num_write_kb":823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'355","reported_seq":981,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.120893+0000","last_change":"2024-09-12T00:18:55.952101+0000","last_active":"2024-09-12T01:04:40.120893+0000","last_peered":"2024-09-12T01:04:40.120893+0000","last_clean":"2024-09-12T01:04:40.120893+0000","last_became_active":"2024-09-12T00:18:55.951826+0000","last_became_peered":"2024-09-12T00:18:55.951826+0000","last_unstale":"2024-09-12T01:04:40.120893+0000","last_undegraded":"2024-09-12T01:04:40.120893+0000","last_fullsized":"2024-09-12T01:04:40.120893+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:47.686652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":11605,"num_write":1081,"num_write_kb":32221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"268'537","reported_seq":2005,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.346854+0000","last_change":"2024-09-12T00:18:24.849840+0000","last_active":"2024-09-12T01:03:37.346854+0000","last_peered":"2024-09-12T01:03:37.346854+0000","last_clean":"2024-09-12T01:03:37.346854+0000","last_became_active":"2024-09-12T00:18:24.849540+0000","last_became_peered":"2024-09-12T00:18:24.849540+0000","last_unstale":"2024-09-12T01:03:37.346854+0000","last_undegraded":"2024-09-12T01:03:37.346854+0000","last_fullsized":"2024-09-12T01:03:37.346854+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:12.695354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2717,"num_read_kb":2465,"num_write":714,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'358","reported_seq":1052,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.062994+0000","last_change":"2024-09-12T00:18:22.834810+0000","last_active":"2024-09-12T01:04:40.062994+0000","last_peered":"2024-09-12T01:04:40.062994+0000","last_clean":"2024-09-12T01:04:40.062994+0000","last_became_active":"2024-09-12T00:18:22.834527+0000","last_became_peered":"2024-09-12T00:18:22.834527+0000","last_unstale":"2024-09-12T01:04:40.062994+0000","last_undegraded":"2024-09-12T01:04:40.062994+0000","last_fullsized":"2024-09-12T01:04:40.062994+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:49.103125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":663,"num_read_kb":13548,"num_write":1359,"num_write_kb":27172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'350","reported_seq":1704,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.704302+0000","last_change":"2024-09-12T00:18:24.871103+0000","last_active":"2024-09-12T01:03:20.704302+0000","last_peered":"2024-09-12T01:03:20.704302+0000","last_clean":"2024-09-12T01:03:20.704302+0000","last_became_active":"2024-09-12T00:18:24.870016+0000","last_became_peered":"2024-09-12T00:18:24.870016+0000","last_unstale":"2024-09-12T01:03:20.704302+0000","last_undegraded":"2024-09-12T01:03:20.704302+0000","last_fullsized":"2024-09-12T01:03:20.704302+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:57.415861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1783,"num_read_kb":1704,"num_write":384,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'330","reported_seq":982,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.129889+0000","last_change":"2024-09-12T00:18:22.883934+0000","last_active":"2024-09-12T01:04:40.129889+0000","last_peered":"2024-09-12T01:04:40.129889+0000","last_clean":"2024-09-12T01:04:40.129889+0000","last_became_active":"2024-09-12T00:18:22.883246+0000","last_became_peered":"2024-09-12T00:18:22.883246+0000","last_unstale":"2024-09-12T01:04:40.129889+0000","last_undegraded":"2024-09-12T01:04:40.129889+0000","last_fullsized":"2024-09-12T01:04:40.129889+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:32.140402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2790244,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":500,"num_read_kb":42045,"num_write":1101,"num_write_kb":34022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'372","reported_seq":1039,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.085969+0000","last_change":"2024-09-12T00:18:22.857851+0000","last_active":"2024-09-12T01:04:40.085969+0000","last_peered":"2024-09-12T01:04:40.085969+0000","last_clean":"2024-09-12T01:04:40.085969+0000","last_became_active":"2024-09-12T00:18:22.857072+0000","last_became_peered":"2024-09-12T00:18:22.857072+0000","last_unstale":"2024-09-12T01:04:40.085969+0000","last_undegraded":"2024-09-12T01:04:40.085969+0000","last_fullsized":"2024-09-12T01:04:40.085969+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:08.141312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525411,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":546,"num_read_kb":42645,"num_write":1246,"num_write_kb":40559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'475","reported_seq":2175,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.700952+0000","last_change":"2024-09-12T00:18:24.867195+0000","last_active":"2024-09-12T01:03:20.700952+0000","last_peered":"2024-09-12T01:03:20.700952+0000","last_clean":"2024-09-12T01:03:20.700952+0000","last_became_active":"2024-09-12T00:18:24.866883+0000","last_became_peered":"2024-09-12T00:18:24.866883+0000","last_unstale":"2024-09-12T01:03:20.700952+0000","last_undegraded":"2024-09-12T01:03:20.700952+0000","last_fullsized":"2024-09-12T01:03:20.700952+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:14.739354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2661,"num_read_kb":2525,"num_write":544,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'451","reported_seq":1178,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.091229+0000","last_change":"2024-09-12T00:18:22.858917+0000","last_active":"2024-09-12T01:04:40.091229+0000","last_peered":"2024-09-12T01:04:40.091229+0000","last_clean":"2024-09-12T01:04:40.091229+0000","last_became_active":"2024-09-12T00:18:22.858176+0000","last_became_peered":"2024-09-12T00:18:22.858176+0000","last_unstale":"2024-09-12T01:04:40.091229+0000","last_undegraded":"2024-09-12T01:04:40.091229+0000","last_fullsized":"2024-09-12T01:04:40.091229+0000","mapping_epoch":24,"log_start":"268'400","ondisk_log_start":"268'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.813335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.813335+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:56.261213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493507,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":841,"num_read_kb":63084,"num_write":1253,"num_write_kb":30414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'807","reported_seq":2404,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.172100+0000","last_change":"2024-09-12T00:18:24.856340+0000","last_active":"2024-09-12T01:03:03.172100+0000","last_peered":"2024-09-12T01:03:03.172100+0000","last_clean":"2024-09-12T01:03:03.172100+0000","last_became_active":"2024-09-12T00:18:24.855524+0000","last_became_peered":"2024-09-12T00:18:24.855524+0000","last_unstale":"2024-09-12T01:03:03.172100+0000","last_undegraded":"2024-09-12T01:03:03.172100+0000","last_fullsized":"2024-09-12T01:03:03.172100+0000","mapping_epoch":26,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:08.775534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3793,"num_read_kb":3425,"num_write":1052,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6125,"num_read_kb":4422,"num_write":1992,"num_write_kb":889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":963,"ondisk_log_size":963,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15018,"num_read_kb":14677,"num_write":16721,"num_write_kb":4879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1955,"ondisk_log_size":1955,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":498,"ondisk_log_size":498,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1590876,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":17701,"num_read_kb":37057,"num_write":14791,"num_write_kb":11631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2022,"ondisk_log_size":2022,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212220,"num_read_kb":193790,"num_write":55147,"num_write_kb":18721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3785,"ondisk_log_size":3785,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":67372279,"num_objects":368,"num_object_clones":0,"num_object_copies":736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":368,"num_whiteouts":0,"num_read":36285,"num_read_kb":1921539,"num_write":72266,"num_write_kb":2133559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":135979008,"data_stored":134744558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3713,"ondisk_log_size":3713,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":193499,"num_write":190,"num_write_kb":135054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":193436,"num_write":190,"num_write_kb":135054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510007,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":288164,"kb_used_data":14036,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94083676,"statfs":{"total":96636764160,"available":96341684224,"internally_reserved":0,"allocated":14372864,"data_stored":12670188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510006,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249776,"kb_used_data":20064,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94122064,"statfs":{"total":96636764160,"available":96380993536,"internally_reserved":0,"allocated":20545536,"data_stored":18946545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":235207113},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510006,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":153172,"kb_used_data":27652,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94218668,"statfs":{"total":96636764160,"available":96479916032,"internally_reserved":0,"allocated":28315648,"data_stored":26521673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128514501},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510007,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111496,"kb_used_data":26168,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94260344,"statfs":{"total":96636764160,"available":96522592256,"internally_reserved":0,"allocated":26796032,"data_stored":25204103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542711,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284248,"kb_used_data":28020,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94087592,"statfs":{"total":96636764160,"available":96345694208,"internally_reserved":0,"allocated":28692480,"data_stored":26984275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":262207943},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542709,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93704,"kb_used_data":12600,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94278136,"statfs":{"total":96636764160,"available":96540811264,"internally_reserved":0,"allocated":12902400,"data_stored":11301467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542710,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148312,"kb_used_data":8904,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94223528,"statfs":{"total":96636764160,"available":96484892672,"internally_reserved":0,"allocated":9117696,"data_stored":7484684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542711,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255332,"kb_used_data":25620,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94116508,"statfs":{"total":96636764160,"available":96375304192,"internally_reserved":0,"allocated":26234880,"data_stored":24489485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21905408,"data_stored":21688322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5402624,"data_stored":5276127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9211904,"data_stored":9091208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24948736,"data_stored":24773620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":23130112,"data_stored":22997083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24514560,"data_stored":24310448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16838656,"data_stored":16736762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10027008,"data_stored":9870988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":5044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":5163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:04:48.289 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.289 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.289 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.289 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.289 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.289 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.290 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.290 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.290 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.290 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.290 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.290 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.290 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.290 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.290 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.291 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.291 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.291 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.291 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.291 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.291 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.291 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.291 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.291 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.292 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.292 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.292 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.292 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.292 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.292 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.292 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.292 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.293 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.293 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.293 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.293 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.293 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.293 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.293 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.293 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.293 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.294 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.294 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.294 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.294 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.294 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.294 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.294 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.294 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.294 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.295 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.295 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.295 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.295 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.295 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.295 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.295 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.295 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.295 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.296 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.296 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.296 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.296 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.296 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.296 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.296 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.296 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.297 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.297 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.297 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.297 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.297 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.297 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.297 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.297 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.298 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.298 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.298 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.298 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.298 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.298 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.298 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.298 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.298 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.299 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.299 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.299 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.299 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.299 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.299 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.299 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.299 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.299 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.300 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.300 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.300 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.300 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.300 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.300 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.300 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.300 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.300 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.301 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.301 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.301 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.301 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.301 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.301 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.301 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.302 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.302 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.302 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.302 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.302 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.302 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.302 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.302 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.302 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.303 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.303 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.303 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.303 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.303 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.303 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.303 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.303 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.303 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.304 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.304 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.304 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.304 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.304 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.304 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.304 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.304 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.304 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.305 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.305 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.305 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.305 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.305 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.305 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.305 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.305 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.306 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.306 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.306 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.306 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.306 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.306 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.306 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.307 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.307 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.307 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.307 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.307 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.307 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.307 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.307 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.307 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.308 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.308 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.308 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.308 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.308 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.308 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.308 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.308 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.309 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.309 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.309 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.309 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.309 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.309 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.310 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.310 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.310 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.310 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.310 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.310 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.310 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.310 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.311 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.311 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.311 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.311 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.312 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.312 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.312 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.312 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.313 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.313 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.313 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.313 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.313 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.313 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.313 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.314 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.314 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.314 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.314 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.314 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.314 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.314 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.314 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.315 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.315 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.315 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.315 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.315 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.315 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.315 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.315 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.315 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.316 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.316 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.316 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.316 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.316 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.316 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.316 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.316 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.316 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.317 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.317 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.317 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.317 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.317 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T00:18:02.531521+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.317 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T00:18:07.624594+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.317 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.317 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.317 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.318 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.318 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.318 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T00:18:07.624594+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.318 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.318 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.318 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.318 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.318 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.319 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.319 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.319 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.319 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.319 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.319 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.319 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T00:18:07.624594+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.320 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.320 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.320 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.320 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.320 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.320 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.320 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.320 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T00:18:07.624594+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.321 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.321 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.321 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.321 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.321 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.321 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.322 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T00:18:07.624594+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.322 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.322 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.322 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.322 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.322 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.322 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.323 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.323 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.323 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.323 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.323 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.323 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T00:18:07.624594+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.323 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.323 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.324 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.324 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.324 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.324 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.324 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.324 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.324 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.325 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.325 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.325 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.325 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.325 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.325 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.325 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.325 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.326 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.326 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.326 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.326 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.326 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.326 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.326 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.326 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.326 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.327 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.327 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.327 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.327 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.327 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.327 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.327 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.327 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.328 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.328 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.328 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.328 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.328 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.328 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.328 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.328 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.329 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.329 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.329 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.329 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.329 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.329 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.329 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.329 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.329 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.330 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.330 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.330 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.330 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.330 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.330 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.330 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.331 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.331 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.331 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.331 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.331 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.331 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.331 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.331 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.331 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.332 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.332 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.332 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.332 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.332 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.333 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.333 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.333 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.333 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.337 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.337 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.337 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.337 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.337 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.337 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.337 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.337 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.338 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.338 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.338 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.338 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.338 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.338 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.338 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.338 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.338 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.339 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.339 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.339 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.339 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.339 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.340 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.340 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.340 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.340 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.341 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.341 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.341 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.341 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.342 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.342 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.342 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.342 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.343 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T00:18:21.813335+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.343 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:04:48.343 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:05:08.345 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:05:08.694 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:05:08.706 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-12T01:05:08.710 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":1674,"stamp":"2024-09-12T01:05:08.050463+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":69570780,"num_objects":858,"num_object_clones":0,"num_object_copies":1716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":858,"num_whiteouts":0,"num_read":290173,"num_read_kb":2561350,"num_write":161440,"num_write_kb":2441443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":48777,"num_omap_keys":191,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13620,"ondisk_log_size":13620,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1592376,"kb_used_data":163064,"kb_used_omap":12,"kb_used_meta":1429171,"kb_avail":753382344,"statfs":{"total":773094113280,"available":771463520256,"internally_reserved":0,"allocated":166977536,"data_stored":153602420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1463471667},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":46368,"num_omap_keys":181,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007908"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.738562+0000","last_change":"2024-09-12T00:46:09.507731+0000","last_active":"2024-09-12T01:01:12.738562+0000","last_peered":"2024-09-12T01:01:12.738562+0000","last_clean":"2024-09-12T01:01:12.738562+0000","last_became_active":"2024-09-12T00:46:09.506992+0000","last_became_peered":"2024-09-12T00:46:09.506992+0000","last_unstale":"2024-09-12T01:01:12.738562+0000","last_undegraded":"2024-09-12T01:01:12.738562+0000","last_fullsized":"2024-09-12T01:01:12.738562+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:58.022915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"265'8","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:27.755817+0000","last_change":"2024-09-12T00:34:55.237418+0000","last_active":"2024-09-12T01:02:27.755817+0000","last_peered":"2024-09-12T01:02:27.755817+0000","last_clean":"2024-09-12T01:02:27.755817+0000","last_became_active":"2024-09-12T00:34:55.236531+0000","last_became_peered":"2024-09-12T00:34:55.236531+0000","last_unstale":"2024-09-12T01:02:27.755817+0000","last_undegraded":"2024-09-12T01:02:27.755817+0000","last_fullsized":"2024-09-12T01:02:27.755817+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"268'4","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.847819+0000","last_change":"2024-09-12T00:34:52.172747+0000","last_active":"2024-09-12T01:04:39.847819+0000","last_peered":"2024-09-12T01:04:39.847819+0000","last_clean":"2024-09-12T01:04:39.847819+0000","last_became_active":"2024-09-12T00:34:52.171918+0000","last_became_peered":"2024-09-12T00:34:52.171918+0000","last_unstale":"2024-09-12T01:04:39.847819+0000","last_undegraded":"2024-09-12T01:04:39.847819+0000","last_fullsized":"2024-09-12T01:04:39.847819+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4100,"num_write":4,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'30","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.578508+0000","last_change":"2024-09-12T00:33:10.849736+0000","last_active":"2024-09-12T01:02:21.578508+0000","last_peered":"2024-09-12T01:02:21.578508+0000","last_clean":"2024-09-12T01:02:21.578508+0000","last_became_active":"2024-09-12T00:33:10.848975+0000","last_became_peered":"2024-09-12T00:33:10.848975+0000","last_unstale":"2024-09-12T01:02:21.578508+0000","last_undegraded":"2024-09-12T01:02:21.578508+0000","last_fullsized":"2024-09-12T01:02:21.578508+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:54.113531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":60,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:11.710587+0000","last_change":"2024-09-12T00:46:09.510162+0000","last_active":"2024-09-12T01:01:11.710587+0000","last_peered":"2024-09-12T01:01:11.710587+0000","last_clean":"2024-09-12T01:01:11.710587+0000","last_became_active":"2024-09-12T00:46:09.509800+0000","last_became_peered":"2024-09-12T00:46:09.509800+0000","last_unstale":"2024-09-12T01:01:11.710587+0000","last_undegraded":"2024-09-12T01:01:11.710587+0000","last_fullsized":"2024-09-12T01:01:11.710587+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:13.709511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'7","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.680752+0000","last_change":"2024-09-12T00:34:55.233869+0000","last_active":"2024-09-12T01:04:38.680752+0000","last_peered":"2024-09-12T01:04:38.680752+0000","last_clean":"2024-09-12T01:04:38.680752+0000","last_became_active":"2024-09-12T00:34:55.232607+0000","last_became_peered":"2024-09-12T00:34:55.232607+0000","last_unstale":"2024-09-12T01:04:38.680752+0000","last_undegraded":"2024-09-12T01:04:38.680752+0000","last_fullsized":"2024-09-12T01:04:38.680752+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"268'2","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.719549+0000","last_change":"2024-09-12T00:34:52.211653+0000","last_active":"2024-09-12T01:04:39.719549+0000","last_peered":"2024-09-12T01:04:39.719549+0000","last_clean":"2024-09-12T01:04:39.719549+0000","last_became_active":"2024-09-12T00:34:52.210935+0000","last_became_peered":"2024-09-12T00:34:52.210935+0000","last_unstale":"2024-09-12T01:04:39.719549+0000","last_undegraded":"2024-09-12T01:04:39.719549+0000","last_fullsized":"2024-09-12T01:04:39.719549+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'30","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:14.858026+0000","last_change":"2024-09-12T00:33:10.852168+0000","last_active":"2024-09-12T01:02:14.858026+0000","last_peered":"2024-09-12T01:02:14.858026+0000","last_clean":"2024-09-12T01:02:14.858026+0000","last_became_active":"2024-09-12T00:33:10.851334+0000","last_became_peered":"2024-09-12T00:33:10.851334+0000","last_unstale":"2024-09-12T01:02:14.858026+0000","last_undegraded":"2024-09-12T01:02:14.858026+0000","last_fullsized":"2024-09-12T01:02:14.858026+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:46.569072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":55,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:42.712847+0000","last_change":"2024-09-12T00:46:09.508043+0000","last_active":"2024-09-12T01:00:42.712847+0000","last_peered":"2024-09-12T01:00:42.712847+0000","last_clean":"2024-09-12T01:00:42.712847+0000","last_became_active":"2024-09-12T00:46:09.507324+0000","last_became_peered":"2024-09-12T00:46:09.507324+0000","last_unstale":"2024-09-12T01:00:42.712847+0000","last_undegraded":"2024-09-12T01:00:42.712847+0000","last_fullsized":"2024-09-12T01:00:42.712847+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:56.424671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"268'2","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:06.601735+0000","last_change":"2024-09-12T00:34:55.253609+0000","last_active":"2024-09-12T01:04:06.601735+0000","last_peered":"2024-09-12T01:04:06.601735+0000","last_clean":"2024-09-12T01:04:06.601735+0000","last_became_active":"2024-09-12T00:34:55.252880+0000","last_became_peered":"2024-09-12T00:34:55.252880+0000","last_unstale":"2024-09-12T01:04:06.601735+0000","last_undegraded":"2024-09-12T01:04:06.601735+0000","last_fullsized":"2024-09-12T01:04:06.601735+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:39.510072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"268'2","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.456079+0000","last_change":"2024-09-12T00:34:52.198542+0000","last_active":"2024-09-12T01:04:39.456079+0000","last_peered":"2024-09-12T01:04:39.456079+0000","last_clean":"2024-09-12T01:04:39.456079+0000","last_became_active":"2024-09-12T00:34:52.195513+0000","last_became_peered":"2024-09-12T00:34:52.195513+0000","last_unstale":"2024-09-12T01:04:39.456079+0000","last_undegraded":"2024-09-12T01:04:39.456079+0000","last_fullsized":"2024-09-12T01:04:39.456079+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'20","reported_seq":99,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.549669+0000","last_change":"2024-09-12T00:33:10.848259+0000","last_active":"2024-09-12T01:00:41.549669+0000","last_peered":"2024-09-12T01:00:41.549669+0000","last_clean":"2024-09-12T01:00:41.549669+0000","last_became_active":"2024-09-12T00:33:10.847432+0000","last_became_peered":"2024-09-12T00:33:10.847432+0000","last_unstale":"2024-09-12T01:00:41.549669+0000","last_undegraded":"2024-09-12T01:00:41.549669+0000","last_fullsized":"2024-09-12T01:00:41.549669+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:33.335638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":67,"num_write":46,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:46.737552+0000","last_change":"2024-09-12T00:46:09.497586+0000","last_active":"2024-09-12T01:00:46.737552+0000","last_peered":"2024-09-12T01:00:46.737552+0000","last_clean":"2024-09-12T01:00:46.737552+0000","last_became_active":"2024-09-12T00:46:09.496807+0000","last_became_peered":"2024-09-12T00:46:09.496807+0000","last_unstale":"2024-09-12T01:00:46.737552+0000","last_undegraded":"2024-09-12T01:00:46.737552+0000","last_fullsized":"2024-09-12T01:00:46.737552+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:06.744888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.772254+0000","last_change":"2024-09-12T00:34:55.248775+0000","last_active":"2024-09-12T01:03:01.772254+0000","last_peered":"2024-09-12T01:03:01.772254+0000","last_clean":"2024-09-12T01:03:01.772254+0000","last_became_active":"2024-09-12T00:34:55.248058+0000","last_became_peered":"2024-09-12T00:34:55.248058+0000","last_unstale":"2024-09-12T01:03:01.772254+0000","last_undegraded":"2024-09-12T01:03:01.772254+0000","last_fullsized":"2024-09-12T01:03:01.772254+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"268'8","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:02.575836+0000","last_change":"2024-09-12T00:34:52.170876+0000","last_active":"2024-09-12T01:04:02.575836+0000","last_peered":"2024-09-12T01:04:02.575836+0000","last_clean":"2024-09-12T01:04:02.575836+0000","last_became_active":"2024-09-12T00:34:52.170013+0000","last_became_peered":"2024-09-12T00:34:52.170013+0000","last_unstale":"2024-09-12T01:04:02.575836+0000","last_undegraded":"2024-09-12T01:04:02.575836+0000","last_fullsized":"2024-09-12T01:04:02.575836+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:37.972262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10242,"num_write":8,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'17","reported_seq":88,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:20.286340+0000","last_change":"2024-09-12T00:33:10.840336+0000","last_active":"2024-09-12T01:02:20.286340+0000","last_peered":"2024-09-12T01:02:20.286340+0000","last_clean":"2024-09-12T01:02:20.286340+0000","last_became_active":"2024-09-12T00:33:10.839248+0000","last_became_peered":"2024-09-12T00:33:10.839248+0000","last_unstale":"2024-09-12T01:02:20.286340+0000","last_undegraded":"2024-09-12T01:02:20.286340+0000","last_fullsized":"2024-09-12T01:02:20.286340+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:57.557088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":49,"num_write":38,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:16.761099+0000","last_change":"2024-09-12T00:46:09.501613+0000","last_active":"2024-09-12T01:02:16.761099+0000","last_peered":"2024-09-12T01:02:16.761099+0000","last_clean":"2024-09-12T01:02:16.761099+0000","last_became_active":"2024-09-12T00:46:09.499830+0000","last_became_peered":"2024-09-12T00:46:09.499830+0000","last_unstale":"2024-09-12T01:02:16.761099+0000","last_undegraded":"2024-09-12T01:02:16.761099+0000","last_fullsized":"2024-09-12T01:02:16.761099+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:10.541266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"268'4","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.680406+0000","last_change":"2024-09-12T00:34:55.242753+0000","last_active":"2024-09-12T01:04:38.680406+0000","last_peered":"2024-09-12T01:04:38.680406+0000","last_clean":"2024-09-12T01:04:38.680406+0000","last_became_active":"2024-09-12T00:34:55.242012+0000","last_became_peered":"2024-09-12T00:34:55.242012+0000","last_unstale":"2024-09-12T01:04:38.680406+0000","last_undegraded":"2024-09-12T01:04:38.680406+0000","last_fullsized":"2024-09-12T01:04:38.680406+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:49.280445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'7","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:51.599019+0000","last_change":"2024-09-12T00:34:52.206650+0000","last_active":"2024-09-12T01:03:51.599019+0000","last_peered":"2024-09-12T01:03:51.599019+0000","last_clean":"2024-09-12T01:03:51.599019+0000","last_became_active":"2024-09-12T00:34:52.205385+0000","last_became_peered":"2024-09-12T00:34:52.205385+0000","last_unstale":"2024-09-12T01:03:51.599019+0000","last_undegraded":"2024-09-12T01:03:51.599019+0000","last_fullsized":"2024-09-12T01:03:51.599019+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:45.297232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4098,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'48","reported_seq":172,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.736371+0000","last_change":"2024-09-12T00:33:10.843742+0000","last_active":"2024-09-12T01:00:41.736371+0000","last_peered":"2024-09-12T01:00:41.736371+0000","last_clean":"2024-09-12T01:00:41.736371+0000","last_became_active":"2024-09-12T00:33:10.842427+0000","last_became_peered":"2024-09-12T00:33:10.842427+0000","last_unstale":"2024-09-12T01:00:41.736371+0000","last_undegraded":"2024-09-12T01:00:41.736371+0000","last_fullsized":"2024-09-12T01:00:41.736371+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:10.839165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":162,"num_write":92,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.564631+0000","last_change":"2024-09-12T00:46:09.514586+0000","last_active":"2024-09-12T01:02:51.564631+0000","last_peered":"2024-09-12T01:02:51.564631+0000","last_clean":"2024-09-12T01:02:51.564631+0000","last_became_active":"2024-09-12T00:46:09.513617+0000","last_became_peered":"2024-09-12T00:46:09.513617+0000","last_unstale":"2024-09-12T01:02:51.564631+0000","last_undegraded":"2024-09-12T01:02:51.564631+0000","last_fullsized":"2024-09-12T01:02:51.564631+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"265'7","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:32.723080+0000","last_change":"2024-09-12T00:35:57.378205+0000","last_active":"2024-09-12T01:01:32.723080+0000","last_peered":"2024-09-12T01:01:32.723080+0000","last_clean":"2024-09-12T01:01:32.723080+0000","last_became_active":"2024-09-12T00:35:57.345894+0000","last_became_peered":"2024-09-12T00:35:57.345894+0000","last_unstale":"2024-09-12T01:01:32.723080+0000","last_undegraded":"2024-09-12T01:01:32.723080+0000","last_fullsized":"2024-09-12T01:01:32.723080+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:29.209762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"265'2","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:37.541584+0000","last_change":"2024-09-12T00:34:52.189042+0000","last_active":"2024-09-12T01:01:37.541584+0000","last_peered":"2024-09-12T01:01:37.541584+0000","last_clean":"2024-09-12T01:01:37.541584+0000","last_became_active":"2024-09-12T00:34:52.188352+0000","last_became_peered":"2024-09-12T00:34:52.188352+0000","last_unstale":"2024-09-12T01:01:37.541584+0000","last_undegraded":"2024-09-12T01:01:37.541584+0000","last_fullsized":"2024-09-12T01:01:37.541584+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:23.453176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'29","reported_seq":125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:42.712902+0000","last_change":"2024-09-12T00:33:10.846375+0000","last_active":"2024-09-12T01:00:42.712902+0000","last_peered":"2024-09-12T01:00:42.712902+0000","last_clean":"2024-09-12T01:00:42.712902+0000","last_became_active":"2024-09-12T00:33:10.845301+0000","last_became_peered":"2024-09-12T00:33:10.845301+0000","last_unstale":"2024-09-12T01:00:42.712902+0000","last_undegraded":"2024-09-12T01:00:42.712902+0000","last_fullsized":"2024-09-12T01:00:42.712902+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:52.282677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.534764+0000","last_change":"2024-09-12T00:46:09.499014+0000","last_active":"2024-09-12T01:01:12.534764+0000","last_peered":"2024-09-12T01:01:12.534764+0000","last_clean":"2024-09-12T01:01:12.534764+0000","last_became_active":"2024-09-12T00:46:09.498002+0000","last_became_peered":"2024-09-12T00:46:09.498002+0000","last_unstale":"2024-09-12T01:01:12.534764+0000","last_undegraded":"2024-09-12T01:01:12.534764+0000","last_fullsized":"2024-09-12T01:01:12.534764+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:50.022966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":35,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:27.734950+0000","last_change":"2024-09-12T00:34:55.215867+0000","last_active":"2024-09-12T01:02:27.734950+0000","last_peered":"2024-09-12T01:02:27.734950+0000","last_clean":"2024-09-12T01:02:27.734950+0000","last_became_active":"2024-09-12T00:34:55.215076+0000","last_became_peered":"2024-09-12T00:34:55.215076+0000","last_unstale":"2024-09-12T01:02:27.734950+0000","last_undegraded":"2024-09-12T01:02:27.734950+0000","last_fullsized":"2024-09-12T01:02:27.734950+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"265'2","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:22.554222+0000","last_change":"2024-09-12T00:34:52.199214+0000","last_active":"2024-09-12T01:02:22.554222+0000","last_peered":"2024-09-12T01:02:22.554222+0000","last_clean":"2024-09-12T01:02:22.554222+0000","last_became_active":"2024-09-12T00:34:52.198548+0000","last_became_peered":"2024-09-12T00:34:52.198548+0000","last_unstale":"2024-09-12T01:02:22.554222+0000","last_undegraded":"2024-09-12T01:02:22.554222+0000","last_fullsized":"2024-09-12T01:02:22.554222+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'18","reported_seq":94,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.578205+0000","last_change":"2024-09-12T00:33:10.857470+0000","last_active":"2024-09-12T01:02:21.578205+0000","last_peered":"2024-09-12T01:02:21.578205+0000","last_clean":"2024-09-12T01:02:21.578205+0000","last_became_active":"2024-09-12T00:33:10.856664+0000","last_became_peered":"2024-09-12T00:33:10.856664+0000","last_unstale":"2024-09-12T01:02:21.578205+0000","last_undegraded":"2024-09-12T01:02:21.578205+0000","last_fullsized":"2024-09-12T01:02:21.578205+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":59,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.534815+0000","last_change":"2024-09-12T00:46:09.504100+0000","last_active":"2024-09-12T01:01:12.534815+0000","last_peered":"2024-09-12T01:01:12.534815+0000","last_clean":"2024-09-12T01:01:12.534815+0000","last_became_active":"2024-09-12T00:46:09.503361+0000","last_became_peered":"2024-09-12T00:46:09.503361+0000","last_unstale":"2024-09-12T01:01:12.534815+0000","last_undegraded":"2024-09-12T01:01:12.534815+0000","last_fullsized":"2024-09-12T01:01:12.534815+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:15.687886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":35,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:26.763689+0000","last_change":"2024-09-12T00:34:55.217786+0000","last_active":"2024-09-12T01:02:26.763689+0000","last_peered":"2024-09-12T01:02:26.763689+0000","last_clean":"2024-09-12T01:02:26.763689+0000","last_became_active":"2024-09-12T00:34:55.217009+0000","last_became_peered":"2024-09-12T00:34:55.217009+0000","last_unstale":"2024-09-12T01:02:26.763689+0000","last_undegraded":"2024-09-12T01:02:26.763689+0000","last_fullsized":"2024-09-12T01:02:26.763689+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"268'2","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.048272+0000","last_change":"2024-09-12T00:34:52.206482+0000","last_active":"2024-09-12T01:04:39.048272+0000","last_peered":"2024-09-12T01:04:39.048272+0000","last_clean":"2024-09-12T01:04:39.048272+0000","last_became_active":"2024-09-12T00:34:52.202432+0000","last_became_peered":"2024-09-12T00:34:52.202432+0000","last_unstale":"2024-09-12T01:04:39.048272+0000","last_undegraded":"2024-09-12T01:04:39.048272+0000","last_fullsized":"2024-09-12T01:04:39.048272+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"268'46","reported_seq":174,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.554878+0000","last_change":"2024-09-12T00:33:10.846991+0000","last_active":"2024-09-12T01:02:11.554878+0000","last_peered":"2024-09-12T01:02:11.554878+0000","last_clean":"2024-09-12T01:02:11.554878+0000","last_became_active":"2024-09-12T00:33:10.846370+0000","last_became_peered":"2024-09-12T00:33:10.846370+0000","last_unstale":"2024-09-12T01:02:11.554878+0000","last_undegraded":"2024-09-12T01:02:11.554878+0000","last_fullsized":"2024-09-12T01:02:11.554878+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:49.969549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":168,"num_write":82,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:31.559756+0000","last_change":"2024-09-12T00:46:09.494884+0000","last_active":"2024-09-12T01:02:31.559756+0000","last_peered":"2024-09-12T01:02:31.559756+0000","last_clean":"2024-09-12T01:02:31.559756+0000","last_became_active":"2024-09-12T00:46:09.494139+0000","last_became_peered":"2024-09-12T00:46:09.494139+0000","last_unstale":"2024-09-12T01:02:31.559756+0000","last_undegraded":"2024-09-12T01:02:31.559756+0000","last_fullsized":"2024-09-12T01:02:31.559756+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":35,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:31.748997+0000","last_change":"2024-09-12T00:34:55.253827+0000","last_active":"2024-09-12T01:01:31.748997+0000","last_peered":"2024-09-12T01:01:31.748997+0000","last_clean":"2024-09-12T01:01:31.748997+0000","last_became_active":"2024-09-12T00:34:55.253209+0000","last_became_peered":"2024-09-12T00:34:55.253209+0000","last_unstale":"2024-09-12T01:01:31.748997+0000","last_undegraded":"2024-09-12T01:01:31.748997+0000","last_fullsized":"2024-09-12T01:01:31.748997+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:58.016129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'2","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.761461+0000","last_change":"2024-09-12T00:34:52.180802+0000","last_active":"2024-09-12T01:02:52.761461+0000","last_peered":"2024-09-12T01:02:52.761461+0000","last_clean":"2024-09-12T01:02:52.761461+0000","last_became_active":"2024-09-12T00:34:52.180036+0000","last_became_peered":"2024-09-12T00:34:52.180036+0000","last_unstale":"2024-09-12T01:02:52.761461+0000","last_undegraded":"2024-09-12T01:02:52.761461+0000","last_fullsized":"2024-09-12T01:02:52.761461+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:25.152180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'75","reported_seq":263,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.576052+0000","last_change":"2024-09-12T00:33:10.852500+0000","last_active":"2024-09-12T01:02:11.576052+0000","last_peered":"2024-09-12T01:02:11.576052+0000","last_clean":"2024-09-12T01:02:11.576052+0000","last_became_active":"2024-09-12T00:33:10.851672+0000","last_became_peered":"2024-09-12T00:33:10.851672+0000","last_unstale":"2024-09-12T01:02:11.576052+0000","last_undegraded":"2024-09-12T01:02:11.576052+0000","last_fullsized":"2024-09-12T01:02:11.576052+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:45.023568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":415,"num_read_kb":311,"num_write":116,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:31.727911+0000","last_change":"2024-09-12T00:46:09.519546+0000","last_active":"2024-09-12T01:02:31.727911+0000","last_peered":"2024-09-12T01:02:31.727911+0000","last_clean":"2024-09-12T01:02:31.727911+0000","last_became_active":"2024-09-12T00:46:09.513012+0000","last_became_peered":"2024-09-12T00:46:09.513012+0000","last_unstale":"2024-09-12T01:02:31.727911+0000","last_undegraded":"2024-09-12T01:02:31.727911+0000","last_fullsized":"2024-09-12T01:02:31.727911+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"268'8","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.804144+0000","last_change":"2024-09-12T00:34:55.254204+0000","last_active":"2024-09-12T01:04:39.804144+0000","last_peered":"2024-09-12T01:04:39.804144+0000","last_clean":"2024-09-12T01:04:39.804144+0000","last_became_active":"2024-09-12T00:34:55.252580+0000","last_became_peered":"2024-09-12T00:34:55.252580+0000","last_unstale":"2024-09-12T01:04:39.804144+0000","last_undegraded":"2024-09-12T01:04:39.804144+0000","last_fullsized":"2024-09-12T01:04:39.804144+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:00.820979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":14336,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:27.538170+0000","last_change":"2024-09-12T00:34:52.204725+0000","last_active":"2024-09-12T01:01:27.538170+0000","last_peered":"2024-09-12T01:01:27.538170+0000","last_clean":"2024-09-12T01:01:27.538170+0000","last_became_active":"2024-09-12T00:34:52.204021+0000","last_became_peered":"2024-09-12T00:34:52.204021+0000","last_unstale":"2024-09-12T01:01:27.538170+0000","last_undegraded":"2024-09-12T01:01:27.538170+0000","last_fullsized":"2024-09-12T01:01:27.538170+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:45.824620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'35","reported_seq":145,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.759818+0000","last_change":"2024-09-12T00:33:10.850040+0000","last_active":"2024-09-12T01:02:11.759818+0000","last_peered":"2024-09-12T01:02:11.759818+0000","last_clean":"2024-09-12T01:02:11.759818+0000","last_became_active":"2024-09-12T00:33:10.849228+0000","last_became_peered":"2024-09-12T00:33:10.849228+0000","last_unstale":"2024-09-12T01:02:11.759818+0000","last_undegraded":"2024-09-12T01:02:11.759818+0000","last_fullsized":"2024-09-12T01:02:11.759818+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:46.335542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":134,"num_write":61,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:32.552713+0000","last_change":"2024-09-12T00:46:09.500158+0000","last_active":"2024-09-12T01:02:32.552713+0000","last_peered":"2024-09-12T01:02:32.552713+0000","last_clean":"2024-09-12T01:02:32.552713+0000","last_became_active":"2024-09-12T00:46:09.499137+0000","last_became_peered":"2024-09-12T00:46:09.499137+0000","last_unstale":"2024-09-12T01:02:32.552713+0000","last_undegraded":"2024-09-12T01:02:32.552713+0000","last_fullsized":"2024-09-12T01:02:32.552713+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"268'5","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:56.783697+0000","last_change":"2024-09-12T00:34:55.254921+0000","last_active":"2024-09-12T01:03:56.783697+0000","last_peered":"2024-09-12T01:03:56.783697+0000","last_clean":"2024-09-12T01:03:56.783697+0000","last_became_active":"2024-09-12T00:34:55.254250+0000","last_became_peered":"2024-09-12T00:34:55.254250+0000","last_unstale":"2024-09-12T01:03:56.783697+0000","last_undegraded":"2024-09-12T01:03:56.783697+0000","last_fullsized":"2024-09-12T01:03:56.783697+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:45.939058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":318,"num_write":10,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:26.714599+0000","last_change":"2024-09-12T00:34:52.179911+0000","last_active":"2024-09-12T01:01:26.714599+0000","last_peered":"2024-09-12T01:01:26.714599+0000","last_clean":"2024-09-12T01:01:26.714599+0000","last_became_active":"2024-09-12T00:34:52.173822+0000","last_became_peered":"2024-09-12T00:34:52.173822+0000","last_unstale":"2024-09-12T01:01:26.714599+0000","last_undegraded":"2024-09-12T01:01:26.714599+0000","last_fullsized":"2024-09-12T01:01:26.714599+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:44.199880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'34","reported_seq":149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:06.452032+0000","last_change":"2024-09-12T01:05:06.452032+0000","last_active":"2024-09-12T01:05:06.452032+0000","last_peered":"2024-09-12T01:05:06.452032+0000","last_clean":"2024-09-12T01:05:06.452032+0000","last_became_active":"2024-09-12T00:33:10.841363+0000","last_became_peered":"2024-09-12T00:33:10.841363+0000","last_unstale":"2024-09-12T01:05:06.452032+0000","last_undegraded":"2024-09-12T01:05:06.452032+0000","last_fullsized":"2024-09-12T01:05:06.452032+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'34","last_scrub_stamp":"2024-09-12T01:05:06.451823+0000","last_deep_scrub":"268'34","last_deep_scrub_stamp":"2024-09-12T01:05:06.451823+0000","last_clean_scrub_stamp":"2024-09-12T01:05:06.451823+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:26.258682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":128,"num_write":55,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:32.756748+0000","last_change":"2024-09-12T00:46:09.506737+0000","last_active":"2024-09-12T01:02:32.756748+0000","last_peered":"2024-09-12T01:02:32.756748+0000","last_clean":"2024-09-12T01:02:32.756748+0000","last_became_active":"2024-09-12T00:46:09.502684+0000","last_became_peered":"2024-09-12T00:46:09.502684+0000","last_unstale":"2024-09-12T01:02:32.756748+0000","last_undegraded":"2024-09-12T01:02:32.756748+0000","last_fullsized":"2024-09-12T01:02:32.756748+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"268'8","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.805326+0000","last_change":"2024-09-12T00:34:55.227141+0000","last_active":"2024-09-12T01:04:39.805326+0000","last_peered":"2024-09-12T01:04:39.805326+0000","last_clean":"2024-09-12T01:04:39.805326+0000","last_became_active":"2024-09-12T00:34:55.226388+0000","last_became_peered":"2024-09-12T00:34:55.226388+0000","last_unstale":"2024-09-12T01:04:39.805326+0000","last_undegraded":"2024-09-12T01:04:39.805326+0000","last_fullsized":"2024-09-12T01:04:39.805326+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:59.431333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":16384,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"268'11","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:51.599165+0000","last_change":"2024-09-12T00:34:52.197590+0000","last_active":"2024-09-12T01:03:51.599165+0000","last_peered":"2024-09-12T01:03:51.599165+0000","last_clean":"2024-09-12T01:03:51.599165+0000","last_became_active":"2024-09-12T00:34:52.196770+0000","last_became_peered":"2024-09-12T00:34:52.196770+0000","last_unstale":"2024-09-12T01:03:51.599165+0000","last_undegraded":"2024-09-12T01:03:51.599165+0000","last_fullsized":"2024-09-12T01:03:51.599165+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:15.638504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":25602,"num_write":16,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'4","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:37.433116+0000","last_change":"2024-09-12T00:33:10.858900+0000","last_active":"2024-09-12T01:01:37.433116+0000","last_peered":"2024-09-12T01:01:37.433116+0000","last_clean":"2024-09-12T01:01:37.433116+0000","last_became_active":"2024-09-12T00:33:10.858178+0000","last_became_peered":"2024-09-12T00:33:10.858178+0000","last_unstale":"2024-09-12T01:01:37.433116+0000","last_undegraded":"2024-09-12T01:01:37.433116+0000","last_fullsized":"2024-09-12T01:01:37.433116+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:45.562348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.736528+0000","last_change":"2024-09-12T00:46:09.522998+0000","last_active":"2024-09-12T01:00:41.736528+0000","last_peered":"2024-09-12T01:00:41.736528+0000","last_clean":"2024-09-12T01:00:41.736528+0000","last_became_active":"2024-09-12T00:46:09.521706+0000","last_became_peered":"2024-09-12T00:46:09.521706+0000","last_unstale":"2024-09-12T01:00:41.736528+0000","last_undegraded":"2024-09-12T01:00:41.736528+0000","last_fullsized":"2024-09-12T01:00:41.736528+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:39.145979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"268'4","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.848099+0000","last_change":"2024-09-12T00:34:55.224573+0000","last_active":"2024-09-12T01:04:39.848099+0000","last_peered":"2024-09-12T01:04:39.848099+0000","last_clean":"2024-09-12T01:04:39.848099+0000","last_became_active":"2024-09-12T00:34:55.223787+0000","last_became_peered":"2024-09-12T00:34:55.223787+0000","last_unstale":"2024-09-12T01:04:39.848099+0000","last_undegraded":"2024-09-12T01:04:39.848099+0000","last_fullsized":"2024-09-12T01:04:39.848099+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:30.131692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"268'6","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.560854+0000","last_change":"2024-09-12T00:34:52.184714+0000","last_active":"2024-09-12T01:02:52.560854+0000","last_peered":"2024-09-12T01:02:52.560854+0000","last_clean":"2024-09-12T01:02:52.560854+0000","last_became_active":"2024-09-12T00:34:52.183982+0000","last_became_peered":"2024-09-12T00:34:52.183982+0000","last_unstale":"2024-09-12T01:02:52.560854+0000","last_undegraded":"2024-09-12T01:02:52.560854+0000","last_fullsized":"2024-09-12T01:02:52.560854+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:07.745456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5649,"num_write":6,"num_write_kb":5649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'25","reported_seq":115,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.534711+0000","last_change":"2024-09-12T00:33:10.858835+0000","last_active":"2024-09-12T01:01:12.534711+0000","last_peered":"2024-09-12T01:01:12.534711+0000","last_clean":"2024-09-12T01:01:12.534711+0000","last_became_active":"2024-09-12T00:33:10.858212+0000","last_became_peered":"2024-09-12T00:33:10.858212+0000","last_unstale":"2024-09-12T01:01:12.534711+0000","last_undegraded":"2024-09-12T01:01:12.534711+0000","last_fullsized":"2024-09-12T01:01:12.534711+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:58.477753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":92,"num_write":42,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.549794+0000","last_change":"2024-09-12T00:46:09.518627+0000","last_active":"2024-09-12T01:00:41.549794+0000","last_peered":"2024-09-12T01:00:41.549794+0000","last_clean":"2024-09-12T01:00:41.549794+0000","last_became_active":"2024-09-12T00:46:09.517833+0000","last_became_peered":"2024-09-12T00:46:09.517833+0000","last_unstale":"2024-09-12T01:00:41.549794+0000","last_undegraded":"2024-09-12T01:00:41.549794+0000","last_fullsized":"2024-09-12T01:00:41.549794+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:23.918442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'9","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:36.531490+0000","last_change":"2024-09-12T00:34:55.227520+0000","last_active":"2024-09-12T01:00:36.531490+0000","last_peered":"2024-09-12T01:00:36.531490+0000","last_clean":"2024-09-12T01:00:36.531490+0000","last_became_active":"2024-09-12T00:34:55.226334+0000","last_became_peered":"2024-09-12T00:34:55.226334+0000","last_unstale":"2024-09-12T01:00:36.531490+0000","last_undegraded":"2024-09-12T01:00:36.531490+0000","last_fullsized":"2024-09-12T01:00:36.531490+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:23.592244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":14,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'6","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.770142+0000","last_change":"2024-09-12T00:34:52.179045+0000","last_active":"2024-09-12T01:02:51.770142+0000","last_peered":"2024-09-12T01:02:51.770142+0000","last_clean":"2024-09-12T01:02:51.770142+0000","last_became_active":"2024-09-12T00:34:52.174421+0000","last_became_peered":"2024-09-12T00:34:52.174421+0000","last_unstale":"2024-09-12T01:02:51.770142+0000","last_undegraded":"2024-09-12T01:02:51.770142+0000","last_fullsized":"2024-09-12T01:02:51.770142+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:27.648444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5438,"num_write":6,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"268'52","reported_seq":187,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.554333+0000","last_change":"2024-09-12T00:33:10.849621+0000","last_active":"2024-09-12T01:02:21.554333+0000","last_peered":"2024-09-12T01:02:21.554333+0000","last_clean":"2024-09-12T01:02:21.554333+0000","last_became_active":"2024-09-12T00:33:10.848890+0000","last_became_peered":"2024-09-12T00:33:10.848890+0000","last_unstale":"2024-09-12T01:02:21.554333+0000","last_undegraded":"2024-09-12T01:02:21.554333+0000","last_fullsized":"2024-09-12T01:02:21.554333+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:26.708631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":180,"num_write":98,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:36.582160+0000","last_change":"2024-09-12T00:46:09.521885+0000","last_active":"2024-09-12T01:02:36.582160+0000","last_peered":"2024-09-12T01:02:36.582160+0000","last_clean":"2024-09-12T01:02:36.582160+0000","last_became_active":"2024-09-12T00:46:09.521575+0000","last_became_peered":"2024-09-12T00:46:09.521575+0000","last_unstale":"2024-09-12T01:02:36.582160+0000","last_undegraded":"2024-09-12T01:02:36.582160+0000","last_fullsized":"2024-09-12T01:02:36.582160+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"268'7","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.410496+0000","last_change":"2024-09-12T00:34:55.233021+0000","last_active":"2024-09-12T01:04:39.410496+0000","last_peered":"2024-09-12T01:04:39.410496+0000","last_clean":"2024-09-12T01:04:39.410496+0000","last_became_active":"2024-09-12T00:34:55.232215+0000","last_became_peered":"2024-09-12T00:34:55.232215+0000","last_unstale":"2024-09-12T01:04:39.410496+0000","last_undegraded":"2024-09-12T01:04:39.410496+0000","last_fullsized":"2024-09-12T01:04:39.410496+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:02.623358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8310,"num_write":12,"num_write_kb":8251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"268'4","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.740083+0000","last_change":"2024-09-12T00:34:52.200570+0000","last_active":"2024-09-12T01:02:52.740083+0000","last_peered":"2024-09-12T01:02:52.740083+0000","last_clean":"2024-09-12T01:02:52.740083+0000","last_became_active":"2024-09-12T00:34:52.199793+0000","last_became_peered":"2024-09-12T00:34:52.199793+0000","last_unstale":"2024-09-12T01:02:52.740083+0000","last_undegraded":"2024-09-12T01:02:52.740083+0000","last_fullsized":"2024-09-12T01:02:52.740083+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:28.505129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'20","reported_seq":103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.535700+0000","last_change":"2024-09-12T00:33:10.845733+0000","last_active":"2024-09-12T01:01:12.535700+0000","last_peered":"2024-09-12T01:01:12.535700+0000","last_clean":"2024-09-12T01:01:12.535700+0000","last_became_active":"2024-09-12T00:33:10.844957+0000","last_became_peered":"2024-09-12T00:33:10.844957+0000","last_unstale":"2024-09-12T01:01:12.535700+0000","last_undegraded":"2024-09-12T01:01:12.535700+0000","last_fullsized":"2024-09-12T01:01:12.535700+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:00.371030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":73,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.736485+0000","last_change":"2024-09-12T00:46:09.515049+0000","last_active":"2024-09-12T01:00:41.736485+0000","last_peered":"2024-09-12T01:00:41.736485+0000","last_clean":"2024-09-12T01:00:41.736485+0000","last_became_active":"2024-09-12T00:46:09.514727+0000","last_became_peered":"2024-09-12T00:46:09.514727+0000","last_unstale":"2024-09-12T01:00:41.736485+0000","last_undegraded":"2024-09-12T01:00:41.736485+0000","last_fullsized":"2024-09-12T01:00:41.736485+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:28.627541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"268'7","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.186330+0000","last_change":"2024-09-12T00:34:55.220880+0000","last_active":"2024-09-12T01:04:39.186330+0000","last_peered":"2024-09-12T01:04:39.186330+0000","last_clean":"2024-09-12T01:04:39.186330+0000","last_became_active":"2024-09-12T00:34:55.220179+0000","last_became_peered":"2024-09-12T00:34:55.220179+0000","last_unstale":"2024-09-12T01:04:39.186330+0000","last_undegraded":"2024-09-12T01:04:39.186330+0000","last_fullsized":"2024-09-12T01:04:39.186330+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:14.092881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"268'7","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.049140+0000","last_change":"2024-09-12T00:34:52.197324+0000","last_active":"2024-09-12T01:04:39.049140+0000","last_peered":"2024-09-12T01:04:39.049140+0000","last_clean":"2024-09-12T01:04:39.049140+0000","last_became_active":"2024-09-12T00:34:52.196592+0000","last_became_peered":"2024-09-12T00:34:52.196592+0000","last_unstale":"2024-09-12T01:04:39.049140+0000","last_undegraded":"2024-09-12T01:04:39.049140+0000","last_fullsized":"2024-09-12T01:04:39.049140+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:12.628205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'27","reported_seq":117,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:11.743558+0000","last_change":"2024-09-12T00:33:10.842922+0000","last_active":"2024-09-12T01:01:11.743558+0000","last_peered":"2024-09-12T01:01:11.743558+0000","last_clean":"2024-09-12T01:01:11.743558+0000","last_became_active":"2024-09-12T00:33:10.842139+0000","last_became_peered":"2024-09-12T00:33:10.842139+0000","last_unstale":"2024-09-12T01:01:11.743558+0000","last_undegraded":"2024-09-12T01:01:11.743558+0000","last_fullsized":"2024-09-12T01:01:11.743558+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:22.677651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":87,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:21.713467+0000","last_change":"2024-09-12T00:46:09.495008+0000","last_active":"2024-09-12T01:01:21.713467+0000","last_peered":"2024-09-12T01:01:21.713467+0000","last_clean":"2024-09-12T01:01:21.713467+0000","last_became_active":"2024-09-12T00:46:09.494257+0000","last_became_peered":"2024-09-12T00:46:09.494257+0000","last_unstale":"2024-09-12T01:01:21.713467+0000","last_undegraded":"2024-09-12T01:01:21.713467+0000","last_fullsized":"2024-09-12T01:01:21.713467+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:13.650561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":36,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.755822+0000","last_change":"2024-09-12T00:34:55.228058+0000","last_active":"2024-09-12T01:01:56.755822+0000","last_peered":"2024-09-12T01:01:56.755822+0000","last_clean":"2024-09-12T01:01:56.755822+0000","last_became_active":"2024-09-12T00:34:55.226471+0000","last_became_peered":"2024-09-12T00:34:55.226471+0000","last_unstale":"2024-09-12T01:01:56.755822+0000","last_undegraded":"2024-09-12T01:01:56.755822+0000","last_fullsized":"2024-09-12T01:01:56.755822+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:56.137407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'2","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:52.543792+0000","last_change":"2024-09-12T00:34:52.203278+0000","last_active":"2024-09-12T01:01:52.543792+0000","last_peered":"2024-09-12T01:01:52.543792+0000","last_clean":"2024-09-12T01:01:52.543792+0000","last_became_active":"2024-09-12T00:34:52.202587+0000","last_became_peered":"2024-09-12T00:34:52.202587+0000","last_unstale":"2024-09-12T01:01:52.543792+0000","last_undegraded":"2024-09-12T01:01:52.543792+0000","last_fullsized":"2024-09-12T01:01:52.543792+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:59.179898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'23","reported_seq":109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:31.765303+0000","last_change":"2024-09-12T00:33:10.833328+0000","last_active":"2024-09-12T01:02:31.765303+0000","last_peered":"2024-09-12T01:02:31.765303+0000","last_clean":"2024-09-12T01:02:31.765303+0000","last_became_active":"2024-09-12T00:33:10.832622+0000","last_became_peered":"2024-09-12T00:33:10.832622+0000","last_unstale":"2024-09-12T01:02:31.765303+0000","last_undegraded":"2024-09-12T01:02:31.765303+0000","last_fullsized":"2024-09-12T01:02:31.765303+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":78,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.544986+0000","last_change":"2024-09-12T00:46:09.502064+0000","last_active":"2024-09-12T01:01:57.544986+0000","last_peered":"2024-09-12T01:01:57.544986+0000","last_clean":"2024-09-12T01:01:57.544986+0000","last_became_active":"2024-09-12T00:46:09.501361+0000","last_became_peered":"2024-09-12T00:46:09.501361+0000","last_unstale":"2024-09-12T01:01:57.544986+0000","last_undegraded":"2024-09-12T01:01:57.544986+0000","last_fullsized":"2024-09-12T01:01:57.544986+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:11.638769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"268'2","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:11.786015+0000","last_change":"2024-09-12T00:34:55.222844+0000","last_active":"2024-09-12T01:04:11.786015+0000","last_peered":"2024-09-12T01:04:11.786015+0000","last_clean":"2024-09-12T01:04:11.786015+0000","last_became_active":"2024-09-12T00:34:55.222079+0000","last_became_peered":"2024-09-12T00:34:55.222079+0000","last_unstale":"2024-09-12T01:04:11.786015+0000","last_undegraded":"2024-09-12T01:04:11.786015+0000","last_fullsized":"2024-09-12T01:04:11.786015+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:10.859567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"268'3","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:06.745540+0000","last_change":"2024-09-12T00:34:52.177816+0000","last_active":"2024-09-12T01:04:06.745540+0000","last_peered":"2024-09-12T01:04:06.745540+0000","last_clean":"2024-09-12T01:04:06.745540+0000","last_became_active":"2024-09-12T00:34:52.176108+0000","last_became_peered":"2024-09-12T00:34:52.176108+0000","last_unstale":"2024-09-12T01:04:06.745540+0000","last_undegraded":"2024-09-12T01:04:06.745540+0000","last_fullsized":"2024-09-12T01:04:06.745540+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:39.727514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'16","reported_seq":91,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:27.755866+0000","last_change":"2024-09-12T00:33:10.850501+0000","last_active":"2024-09-12T01:02:27.755866+0000","last_peered":"2024-09-12T01:02:27.755866+0000","last_clean":"2024-09-12T01:02:27.755866+0000","last_became_active":"2024-09-12T00:33:10.849703+0000","last_became_peered":"2024-09-12T00:33:10.849703+0000","last_unstale":"2024-09-12T01:02:27.755866+0000","last_undegraded":"2024-09-12T01:02:27.755866+0000","last_fullsized":"2024-09-12T01:02:27.755866+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:34.698555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:22.721112+0000","last_change":"2024-09-12T00:46:09.517232+0000","last_active":"2024-09-12T01:01:22.721112+0000","last_peered":"2024-09-12T01:01:22.721112+0000","last_clean":"2024-09-12T01:01:22.721112+0000","last_became_active":"2024-09-12T00:46:09.514197+0000","last_became_peered":"2024-09-12T00:46:09.514197+0000","last_unstale":"2024-09-12T01:01:22.721112+0000","last_undegraded":"2024-09-12T01:01:22.721112+0000","last_fullsized":"2024-09-12T01:01:22.721112+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:13.571995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"268'8","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:21.369472+0000","last_change":"2024-09-12T00:34:55.253416+0000","last_active":"2024-09-12T01:04:21.369472+0000","last_peered":"2024-09-12T01:04:21.369472+0000","last_clean":"2024-09-12T01:04:21.369472+0000","last_became_active":"2024-09-12T00:34:55.252651+0000","last_became_peered":"2024-09-12T00:34:55.252651+0000","last_unstale":"2024-09-12T01:04:21.369472+0000","last_undegraded":"2024-09-12T01:04:21.369472+0000","last_fullsized":"2024-09-12T01:04:21.369472+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:51.619823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":7697,"num_write":8,"num_write_kb":6673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"268'3","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:06.601687+0000","last_change":"2024-09-12T00:34:52.201618+0000","last_active":"2024-09-12T01:04:06.601687+0000","last_peered":"2024-09-12T01:04:06.601687+0000","last_clean":"2024-09-12T01:04:06.601687+0000","last_became_active":"2024-09-12T00:34:52.177094+0000","last_became_peered":"2024-09-12T00:34:52.177094+0000","last_unstale":"2024-09-12T01:04:06.601687+0000","last_undegraded":"2024-09-12T01:04:06.601687+0000","last_fullsized":"2024-09-12T01:04:06.601687+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:28.340168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"268'31","reported_seq":133,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:27.735000+0000","last_change":"2024-09-12T00:33:10.863914+0000","last_active":"2024-09-12T01:02:27.735000+0000","last_peered":"2024-09-12T01:02:27.735000+0000","last_clean":"2024-09-12T01:02:27.735000+0000","last_became_active":"2024-09-12T00:33:10.862993+0000","last_became_peered":"2024-09-12T00:33:10.862993+0000","last_unstale":"2024-09-12T01:02:27.735000+0000","last_undegraded":"2024-09-12T01:02:27.735000+0000","last_fullsized":"2024-09-12T01:02:27.735000+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:01.904051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":107,"num_write":58,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:22.536912+0000","last_change":"2024-09-12T00:46:09.499178+0000","last_active":"2024-09-12T01:01:22.536912+0000","last_peered":"2024-09-12T01:01:22.536912+0000","last_clean":"2024-09-12T01:01:22.536912+0000","last_became_active":"2024-09-12T00:46:09.498482+0000","last_became_peered":"2024-09-12T00:46:09.498482+0000","last_unstale":"2024-09-12T01:01:22.536912+0000","last_undegraded":"2024-09-12T01:01:22.536912+0000","last_fullsized":"2024-09-12T01:01:22.536912+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:41.343998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":36,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.755870+0000","last_change":"2024-09-12T00:34:55.229076+0000","last_active":"2024-09-12T01:01:56.755870+0000","last_peered":"2024-09-12T01:01:56.755870+0000","last_clean":"2024-09-12T01:01:56.755870+0000","last_became_active":"2024-09-12T00:34:55.228136+0000","last_became_peered":"2024-09-12T00:34:55.228136+0000","last_unstale":"2024-09-12T01:01:56.755870+0000","last_undegraded":"2024-09-12T01:01:56.755870+0000","last_fullsized":"2024-09-12T01:01:56.755870+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:13.739031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.551311+0000","last_change":"2024-09-12T00:34:52.191163+0000","last_active":"2024-09-12T01:01:56.551311+0000","last_peered":"2024-09-12T01:01:56.551311+0000","last_clean":"2024-09-12T01:01:56.551311+0000","last_became_active":"2024-09-12T00:34:52.190350+0000","last_became_peered":"2024-09-12T00:34:52.190350+0000","last_unstale":"2024-09-12T01:01:56.551311+0000","last_undegraded":"2024-09-12T01:01:56.551311+0000","last_fullsized":"2024-09-12T01:01:56.551311+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:44.544700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'31","reported_seq":131,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:26.726939+0000","last_change":"2024-09-12T00:33:10.834922+0000","last_active":"2024-09-12T01:02:26.726939+0000","last_peered":"2024-09-12T01:02:26.726939+0000","last_clean":"2024-09-12T01:02:26.726939+0000","last_became_active":"2024-09-12T00:33:10.834095+0000","last_became_peered":"2024-09-12T00:33:10.834095+0000","last_unstale":"2024-09-12T01:02:26.726939+0000","last_undegraded":"2024-09-12T01:02:26.726939+0000","last_fullsized":"2024-09-12T01:02:26.726939+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:09.706426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":107,"num_write":54,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.755937+0000","last_change":"2024-09-12T00:46:09.502145+0000","last_active":"2024-09-12T01:01:56.755937+0000","last_peered":"2024-09-12T01:01:56.755937+0000","last_clean":"2024-09-12T01:01:56.755937+0000","last_became_active":"2024-09-12T00:46:09.500779+0000","last_became_peered":"2024-09-12T00:46:09.500779+0000","last_unstale":"2024-09-12T01:01:56.755937+0000","last_undegraded":"2024-09-12T01:01:56.755937+0000","last_fullsized":"2024-09-12T01:01:56.755937+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:52.290781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"268'8","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.185609+0000","last_change":"2024-09-12T00:34:55.242037+0000","last_active":"2024-09-12T01:04:39.185609+0000","last_peered":"2024-09-12T01:04:39.185609+0000","last_clean":"2024-09-12T01:04:39.185609+0000","last_became_active":"2024-09-12T00:34:55.241223+0000","last_became_peered":"2024-09-12T00:34:55.241223+0000","last_unstale":"2024-09-12T01:04:39.185609+0000","last_undegraded":"2024-09-12T01:04:39.185609+0000","last_fullsized":"2024-09-12T01:04:39.185609+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:56.166816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9218,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"268'2","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.588186+0000","last_change":"2024-09-12T00:34:52.206116+0000","last_active":"2024-09-12T01:03:01.588186+0000","last_peered":"2024-09-12T01:03:01.588186+0000","last_clean":"2024-09-12T01:03:01.588186+0000","last_became_active":"2024-09-12T00:34:52.202407+0000","last_became_peered":"2024-09-12T00:34:52.202407+0000","last_unstale":"2024-09-12T01:03:01.588186+0000","last_undegraded":"2024-09-12T01:03:01.588186+0000","last_fullsized":"2024-09-12T01:03:01.588186+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:16.024426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'46","reported_seq":179,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:26.579456+0000","last_change":"2024-09-12T00:33:10.860057+0000","last_active":"2024-09-12T01:02:26.579456+0000","last_peered":"2024-09-12T01:02:26.579456+0000","last_clean":"2024-09-12T01:02:26.579456+0000","last_became_active":"2024-09-12T00:33:10.859459+0000","last_became_peered":"2024-09-12T00:33:10.859459+0000","last_unstale":"2024-09-12T01:02:26.579456+0000","last_undegraded":"2024-09-12T01:02:26.579456+0000","last_fullsized":"2024-09-12T01:02:26.579456+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:02.662726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":176,"num_write":75,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.546185+0000","last_change":"2024-09-12T00:46:09.505921+0000","last_active":"2024-09-12T01:02:02.546185+0000","last_peered":"2024-09-12T01:02:02.546185+0000","last_clean":"2024-09-12T01:02:02.546185+0000","last_became_active":"2024-09-12T00:46:09.505143+0000","last_became_peered":"2024-09-12T00:46:09.505143+0000","last_unstale":"2024-09-12T01:02:02.546185+0000","last_undegraded":"2024-09-12T01:02:02.546185+0000","last_fullsized":"2024-09-12T01:02:02.546185+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:58.286882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"268'2","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.560722+0000","last_change":"2024-09-12T00:34:55.253946+0000","last_active":"2024-09-12T01:03:07.560722+0000","last_peered":"2024-09-12T01:03:07.560722+0000","last_clean":"2024-09-12T01:03:07.560722+0000","last_became_active":"2024-09-12T00:34:55.253169+0000","last_became_peered":"2024-09-12T00:34:55.253169+0000","last_unstale":"2024-09-12T01:03:07.560722+0000","last_undegraded":"2024-09-12T01:03:07.560722+0000","last_fullsized":"2024-09-12T01:03:07.560722+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:41.186189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"268'2","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.351704+0000","last_change":"2024-09-12T00:34:52.190974+0000","last_active":"2024-09-12T01:03:01.351704+0000","last_peered":"2024-09-12T01:03:01.351704+0000","last_clean":"2024-09-12T01:03:01.351704+0000","last_became_active":"2024-09-12T00:34:52.190174+0000","last_became_peered":"2024-09-12T00:34:52.190174+0000","last_unstale":"2024-09-12T01:03:01.351704+0000","last_undegraded":"2024-09-12T01:03:01.351704+0000","last_fullsized":"2024-09-12T01:03:01.351704+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:22.602978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'29","reported_seq":121,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:32.539090+0000","last_change":"2024-09-12T00:33:10.850390+0000","last_active":"2024-09-12T01:01:32.539090+0000","last_peered":"2024-09-12T01:01:32.539090+0000","last_clean":"2024-09-12T01:01:32.539090+0000","last_became_active":"2024-09-12T00:33:10.849658+0000","last_became_peered":"2024-09-12T00:33:10.849658+0000","last_unstale":"2024-09-12T01:01:32.539090+0000","last_undegraded":"2024-09-12T01:01:32.539090+0000","last_fullsized":"2024-09-12T01:01:32.539090+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:17.300231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":91,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.545034+0000","last_change":"2024-09-12T00:46:09.487986+0000","last_active":"2024-09-12T01:01:57.545034+0000","last_peered":"2024-09-12T01:01:57.545034+0000","last_clean":"2024-09-12T01:01:57.545034+0000","last_became_active":"2024-09-12T00:46:09.485933+0000","last_became_peered":"2024-09-12T00:46:09.485933+0000","last_unstale":"2024-09-12T01:01:57.545034+0000","last_undegraded":"2024-09-12T01:01:57.545034+0000","last_fullsized":"2024-09-12T01:01:57.545034+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:26.699689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"268'2","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:11.364205+0000","last_change":"2024-09-12T00:34:55.237633+0000","last_active":"2024-09-12T01:04:11.364205+0000","last_peered":"2024-09-12T01:04:11.364205+0000","last_clean":"2024-09-12T01:04:11.364205+0000","last_became_active":"2024-09-12T00:34:55.236708+0000","last_became_peered":"2024-09-12T00:34:55.236708+0000","last_unstale":"2024-09-12T01:04:11.364205+0000","last_undegraded":"2024-09-12T01:04:11.364205+0000","last_fullsized":"2024-09-12T01:04:11.364205+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:53.892191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'4","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.047616+0000","last_change":"2024-09-12T00:34:52.209042+0000","last_active":"2024-09-12T01:04:39.047616+0000","last_peered":"2024-09-12T01:04:39.047616+0000","last_clean":"2024-09-12T01:04:39.047616+0000","last_became_active":"2024-09-12T00:34:52.205829+0000","last_became_peered":"2024-09-12T00:34:52.205829+0000","last_unstale":"2024-09-12T01:04:39.047616+0000","last_undegraded":"2024-09-12T01:04:39.047616+0000","last_fullsized":"2024-09-12T01:04:39.047616+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:59.524499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'30","reported_seq":133,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:21.746083+0000","last_change":"2024-09-12T00:33:10.825945+0000","last_active":"2024-09-12T01:01:21.746083+0000","last_peered":"2024-09-12T01:01:21.746083+0000","last_clean":"2024-09-12T01:01:21.746083+0000","last_became_active":"2024-09-12T00:33:10.825191+0000","last_became_peered":"2024-09-12T00:33:10.825191+0000","last_unstale":"2024-09-12T01:01:21.746083+0000","last_undegraded":"2024-09-12T01:01:21.746083+0000","last_fullsized":"2024-09-12T01:01:21.746083+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:47.230850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":116,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.571862+0000","last_change":"2024-09-12T00:46:09.505717+0000","last_active":"2024-09-12T01:01:56.571862+0000","last_peered":"2024-09-12T01:01:56.571862+0000","last_clean":"2024-09-12T01:01:56.571862+0000","last_became_active":"2024-09-12T00:46:09.504789+0000","last_became_peered":"2024-09-12T00:46:09.504789+0000","last_unstale":"2024-09-12T01:01:56.571862+0000","last_undegraded":"2024-09-12T01:01:56.571862+0000","last_fullsized":"2024-09-12T01:01:56.571862+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:54.929380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'2","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.533522+0000","last_change":"2024-09-12T00:34:55.238407+0000","last_active":"2024-09-12T01:01:07.533522+0000","last_peered":"2024-09-12T01:01:07.533522+0000","last_clean":"2024-09-12T01:01:07.533522+0000","last_became_active":"2024-09-12T00:34:55.237691+0000","last_became_peered":"2024-09-12T00:34:55.237691+0000","last_unstale":"2024-09-12T01:01:07.533522+0000","last_undegraded":"2024-09-12T01:01:07.533522+0000","last_fullsized":"2024-09-12T01:01:07.533522+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:43.698302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'8","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:52.545095+0000","last_change":"2024-09-12T00:34:52.200839+0000","last_active":"2024-09-12T01:01:52.545095+0000","last_peered":"2024-09-12T01:01:52.545095+0000","last_clean":"2024-09-12T01:01:52.545095+0000","last_became_active":"2024-09-12T00:34:52.200033+0000","last_became_peered":"2024-09-12T00:34:52.200033+0000","last_unstale":"2024-09-12T01:01:52.545095+0000","last_undegraded":"2024-09-12T01:01:52.545095+0000","last_fullsized":"2024-09-12T01:01:52.545095+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:12.523538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":17410,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'38","reported_seq":149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:20.583311+0000","last_change":"2024-09-12T00:33:10.856023+0000","last_active":"2024-09-12T01:02:20.583311+0000","last_peered":"2024-09-12T01:02:20.583311+0000","last_clean":"2024-09-12T01:02:20.583311+0000","last_became_active":"2024-09-12T00:33:10.855257+0000","last_became_peered":"2024-09-12T00:33:10.855257+0000","last_unstale":"2024-09-12T01:02:20.583311+0000","last_undegraded":"2024-09-12T01:02:20.583311+0000","last_fullsized":"2024-09-12T01:02:20.583311+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:54.073580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":126,"num_write":70,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.557406+0000","last_change":"2024-09-12T00:46:09.504978+0000","last_active":"2024-09-12T01:02:52.557406+0000","last_peered":"2024-09-12T01:02:52.557406+0000","last_clean":"2024-09-12T01:02:52.557406+0000","last_became_active":"2024-09-12T00:46:09.504114+0000","last_became_peered":"2024-09-12T00:46:09.504114+0000","last_unstale":"2024-09-12T01:02:52.557406+0000","last_undegraded":"2024-09-12T01:02:52.557406+0000","last_fullsized":"2024-09-12T01:02:52.557406+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'2","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.575855+0000","last_change":"2024-09-12T00:34:55.235646+0000","last_active":"2024-09-12T01:02:11.575855+0000","last_peered":"2024-09-12T01:02:11.575855+0000","last_clean":"2024-09-12T01:02:11.575855+0000","last_became_active":"2024-09-12T00:34:55.234795+0000","last_became_peered":"2024-09-12T00:34:55.234795+0000","last_unstale":"2024-09-12T01:02:11.575855+0000","last_undegraded":"2024-09-12T01:02:11.575855+0000","last_fullsized":"2024-09-12T01:02:11.575855+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:10.241846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"268'7","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:02.573483+0000","last_change":"2024-09-12T00:34:52.199095+0000","last_active":"2024-09-12T01:04:02.573483+0000","last_peered":"2024-09-12T01:04:02.573483+0000","last_clean":"2024-09-12T01:04:02.573483+0000","last_became_active":"2024-09-12T00:34:52.198346+0000","last_became_peered":"2024-09-12T00:34:52.198346+0000","last_unstale":"2024-09-12T01:04:02.573483+0000","last_undegraded":"2024-09-12T01:04:02.573483+0000","last_fullsized":"2024-09-12T01:04:02.573483+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:09.225827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'29","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:21.563766+0000","last_change":"2024-09-12T00:33:10.848211+0000","last_active":"2024-09-12T01:01:21.563766+0000","last_peered":"2024-09-12T01:01:21.563766+0000","last_clean":"2024-09-12T01:01:21.563766+0000","last_became_active":"2024-09-12T00:33:10.847386+0000","last_became_peered":"2024-09-12T00:33:10.847386+0000","last_unstale":"2024-09-12T01:01:21.563766+0000","last_undegraded":"2024-09-12T01:01:21.563766+0000","last_fullsized":"2024-09-12T01:01:21.563766+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:03.256270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":106,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.761364+0000","last_change":"2024-09-12T00:46:09.514213+0000","last_active":"2024-09-12T01:02:52.761364+0000","last_peered":"2024-09-12T01:02:52.761364+0000","last_clean":"2024-09-12T01:02:52.761364+0000","last_became_active":"2024-09-12T00:46:09.509685+0000","last_became_peered":"2024-09-12T00:46:09.509685+0000","last_unstale":"2024-09-12T01:02:52.761364+0000","last_undegraded":"2024-09-12T01:02:52.761364+0000","last_fullsized":"2024-09-12T01:02:52.761364+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"268'2","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:06.601647+0000","last_change":"2024-09-12T00:34:55.251608+0000","last_active":"2024-09-12T01:04:06.601647+0000","last_peered":"2024-09-12T01:04:06.601647+0000","last_clean":"2024-09-12T01:04:06.601647+0000","last_became_active":"2024-09-12T00:34:55.251057+0000","last_became_peered":"2024-09-12T00:34:55.251057+0000","last_unstale":"2024-09-12T01:04:06.601647+0000","last_undegraded":"2024-09-12T01:04:06.601647+0000","last_fullsized":"2024-09-12T01:04:06.601647+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:44.787440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"268'6","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:01.745019+0000","last_change":"2024-09-12T00:34:52.178623+0000","last_active":"2024-09-12T01:04:01.745019+0000","last_peered":"2024-09-12T01:04:01.745019+0000","last_clean":"2024-09-12T01:04:01.745019+0000","last_became_active":"2024-09-12T00:34:52.177088+0000","last_became_peered":"2024-09-12T00:34:52.177088+0000","last_unstale":"2024-09-12T01:04:01.745019+0000","last_undegraded":"2024-09-12T01:04:01.745019+0000","last_fullsized":"2024-09-12T01:04:01.745019+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:51.705833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"268'21","reported_seq":103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:22.721225+0000","last_change":"2024-09-12T00:33:10.845217+0000","last_active":"2024-09-12T01:01:22.721225+0000","last_peered":"2024-09-12T01:01:22.721225+0000","last_clean":"2024-09-12T01:01:22.721225+0000","last_became_active":"2024-09-12T00:33:10.844093+0000","last_became_peered":"2024-09-12T00:33:10.844093+0000","last_unstale":"2024-09-12T01:01:22.721225+0000","last_undegraded":"2024-09-12T01:01:22.721225+0000","last_fullsized":"2024-09-12T01:01:22.721225+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:20.325448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":69,"num_write":38,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:16.556161+0000","last_change":"2024-09-12T00:46:09.498490+0000","last_active":"2024-09-12T01:02:16.556161+0000","last_peered":"2024-09-12T01:02:16.556161+0000","last_clean":"2024-09-12T01:02:16.556161+0000","last_became_active":"2024-09-12T00:46:09.497751+0000","last_became_peered":"2024-09-12T00:46:09.497751+0000","last_unstale":"2024-09-12T01:02:16.556161+0000","last_undegraded":"2024-09-12T01:02:16.556161+0000","last_fullsized":"2024-09-12T01:02:16.556161+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.301246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":36,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.531241+0000","last_change":"2024-09-12T00:34:55.254981+0000","last_active":"2024-09-12T01:00:57.531241+0000","last_peered":"2024-09-12T01:00:57.531241+0000","last_clean":"2024-09-12T01:00:57.531241+0000","last_became_active":"2024-09-12T00:34:55.254446+0000","last_became_peered":"2024-09-12T00:34:55.254446+0000","last_unstale":"2024-09-12T01:00:57.531241+0000","last_undegraded":"2024-09-12T01:00:57.531241+0000","last_fullsized":"2024-09-12T01:00:57.531241+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:32.699370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:52.734131+0000","last_change":"2024-09-12T00:34:52.194065+0000","last_active":"2024-09-12T01:00:52.734131+0000","last_peered":"2024-09-12T01:00:52.734131+0000","last_clean":"2024-09-12T01:00:52.734131+0000","last_became_active":"2024-09-12T00:34:52.193306+0000","last_became_peered":"2024-09-12T00:34:52.193306+0000","last_unstale":"2024-09-12T01:00:52.734131+0000","last_undegraded":"2024-09-12T01:00:52.734131+0000","last_fullsized":"2024-09-12T01:00:52.734131+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:42.593529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"268'36","reported_seq":152,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:32.552885+0000","last_change":"2024-09-12T00:33:10.860393+0000","last_active":"2024-09-12T01:02:32.552885+0000","last_peered":"2024-09-12T01:02:32.552885+0000","last_clean":"2024-09-12T01:02:32.552885+0000","last_became_active":"2024-09-12T00:33:10.859799+0000","last_became_peered":"2024-09-12T00:33:10.859799+0000","last_unstale":"2024-09-12T01:02:32.552885+0000","last_undegraded":"2024-09-12T01:02:32.552885+0000","last_fullsized":"2024-09-12T01:02:32.552885+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:39.916797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":137,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.560906+0000","last_change":"2024-09-12T00:46:09.499691+0000","last_active":"2024-09-12T01:02:52.560906+0000","last_peered":"2024-09-12T01:02:52.560906+0000","last_clean":"2024-09-12T01:02:52.560906+0000","last_became_active":"2024-09-12T00:46:09.498942+0000","last_became_peered":"2024-09-12T00:46:09.498942+0000","last_unstale":"2024-09-12T01:02:52.560906+0000","last_undegraded":"2024-09-12T01:02:52.560906+0000","last_fullsized":"2024-09-12T01:02:52.560906+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'2","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.564072+0000","last_change":"2024-09-12T00:34:55.215046+0000","last_active":"2024-09-12T01:03:07.564072+0000","last_peered":"2024-09-12T01:03:07.564072+0000","last_clean":"2024-09-12T01:03:07.564072+0000","last_became_active":"2024-09-12T00:34:55.214265+0000","last_became_peered":"2024-09-12T00:34:55.214265+0000","last_unstale":"2024-09-12T01:03:07.564072+0000","last_undegraded":"2024-09-12T01:03:07.564072+0000","last_fullsized":"2024-09-12T01:03:07.564072+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:54.580385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"268'9","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.457051+0000","last_change":"2024-09-12T00:34:52.204774+0000","last_active":"2024-09-12T01:04:39.457051+0000","last_peered":"2024-09-12T01:04:39.457051+0000","last_clean":"2024-09-12T01:04:39.457051+0000","last_became_active":"2024-09-12T00:34:52.204050+0000","last_became_peered":"2024-09-12T00:34:52.204050+0000","last_unstale":"2024-09-12T01:04:39.457051+0000","last_undegraded":"2024-09-12T01:04:39.457051+0000","last_fullsized":"2024-09-12T01:04:39.457051+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:46.767075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5120,"num_write":14,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'20","reported_seq":104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.557497+0000","last_change":"2024-09-12T00:33:10.842211+0000","last_active":"2024-09-12T01:02:21.557497+0000","last_peered":"2024-09-12T01:02:21.557497+0000","last_clean":"2024-09-12T01:02:21.557497+0000","last_became_active":"2024-09-12T00:33:10.841411+0000","last_became_peered":"2024-09-12T00:33:10.841411+0000","last_unstale":"2024-09-12T01:02:21.557497+0000","last_undegraded":"2024-09-12T01:02:21.557497+0000","last_fullsized":"2024-09-12T01:02:21.557497+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:13.664749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":70,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"267'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:21.713593+0000","last_change":"2024-09-12T00:46:09.520640+0000","last_active":"2024-09-12T01:01:21.713593+0000","last_peered":"2024-09-12T01:01:21.713593+0000","last_clean":"2024-09-12T01:01:21.713593+0000","last_became_active":"2024-09-12T00:46:09.520251+0000","last_became_peered":"2024-09-12T00:46:09.520251+0000","last_unstale":"2024-09-12T01:01:21.713593+0000","last_undegraded":"2024-09-12T01:01:21.713593+0000","last_fullsized":"2024-09-12T01:01:21.713593+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:17.060682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"268'5","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:06.363265+0000","last_change":"2024-09-12T00:34:55.232689+0000","last_active":"2024-09-12T01:04:06.363265+0000","last_peered":"2024-09-12T01:04:06.363265+0000","last_clean":"2024-09-12T01:04:06.363265+0000","last_became_active":"2024-09-12T00:34:55.230698+0000","last_became_peered":"2024-09-12T00:34:55.230698+0000","last_unstale":"2024-09-12T01:04:06.363265+0000","last_undegraded":"2024-09-12T01:04:06.363265+0000","last_fullsized":"2024-09-12T01:04:06.363265+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:43.460598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"265'5","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.559576+0000","last_change":"2024-09-12T00:34:52.212267+0000","last_active":"2024-09-12T01:03:02.559576+0000","last_peered":"2024-09-12T01:03:02.559576+0000","last_clean":"2024-09-12T01:03:02.559576+0000","last_became_active":"2024-09-12T00:34:52.211709+0000","last_became_peered":"2024-09-12T00:34:52.211709+0000","last_unstale":"2024-09-12T01:03:02.559576+0000","last_undegraded":"2024-09-12T01:03:02.559576+0000","last_fullsized":"2024-09-12T01:03:02.559576+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'225","reported_seq":751,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:22.754603+0000","last_change":"2024-09-12T00:33:10.853482+0000","last_active":"2024-09-12T01:02:22.754603+0000","last_peered":"2024-09-12T01:02:22.754603+0000","last_clean":"2024-09-12T01:02:22.754603+0000","last_became_active":"2024-09-12T00:33:10.852751+0000","last_became_peered":"2024-09-12T00:33:10.852751+0000","last_unstale":"2024-09-12T01:02:22.754603+0000","last_undegraded":"2024-09-12T01:02:22.754603+0000","last_fullsized":"2024-09-12T01:02:22.754603+0000","mapping_epoch":255,"log_start":"265'200","ondisk_log_start":"265'200","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:29.381396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1385,"num_read_kb":1074,"num_write":267,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:21.563715+0000","last_change":"2024-09-12T00:46:09.516940+0000","last_active":"2024-09-12T01:01:21.563715+0000","last_peered":"2024-09-12T01:01:21.563715+0000","last_clean":"2024-09-12T01:01:21.563715+0000","last_became_active":"2024-09-12T00:46:09.516404+0000","last_became_peered":"2024-09-12T00:46:09.516404+0000","last_unstale":"2024-09-12T01:01:21.563715+0000","last_undegraded":"2024-09-12T01:01:21.563715+0000","last_fullsized":"2024-09-12T01:01:21.563715+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:40.623194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"268'8","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.850790+0000","last_change":"2024-09-12T00:34:55.236475+0000","last_active":"2024-09-12T01:04:39.850790+0000","last_peered":"2024-09-12T01:04:39.850790+0000","last_clean":"2024-09-12T01:04:39.850790+0000","last_became_active":"2024-09-12T00:34:55.235522+0000","last_became_peered":"2024-09-12T00:34:55.235522+0000","last_unstale":"2024-09-12T01:04:39.850790+0000","last_undegraded":"2024-09-12T01:04:39.850790+0000","last_fullsized":"2024-09-12T01:04:39.850790+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":10240,"num_write":8,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"268'6","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:02.573368+0000","last_change":"2024-09-12T00:34:52.184510+0000","last_active":"2024-09-12T01:04:02.573368+0000","last_peered":"2024-09-12T01:04:02.573368+0000","last_clean":"2024-09-12T01:04:02.573368+0000","last_became_active":"2024-09-12T00:34:52.183769+0000","last_became_peered":"2024-09-12T00:34:52.183769+0000","last_unstale":"2024-09-12T01:04:02.573368+0000","last_undegraded":"2024-09-12T01:04:02.573368+0000","last_fullsized":"2024-09-12T01:04:02.573368+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:59.439643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'27","reported_seq":122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:22.554180+0000","last_change":"2024-09-12T00:33:10.831668+0000","last_active":"2024-09-12T01:02:22.554180+0000","last_peered":"2024-09-12T01:02:22.554180+0000","last_clean":"2024-09-12T01:02:22.554180+0000","last_became_active":"2024-09-12T00:33:10.830931+0000","last_became_peered":"2024-09-12T00:33:10.830931+0000","last_unstale":"2024-09-12T01:02:22.554180+0000","last_undegraded":"2024-09-12T01:02:22.554180+0000","last_fullsized":"2024-09-12T01:02:22.554180+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:45.604877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":90,"num_write":55,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.585944+0000","last_change":"2024-09-12T00:46:09.518153+0000","last_active":"2024-09-12T01:02:51.585944+0000","last_peered":"2024-09-12T01:02:51.585944+0000","last_clean":"2024-09-12T01:02:51.585944+0000","last_became_active":"2024-09-12T00:46:09.517353+0000","last_became_peered":"2024-09-12T00:46:09.517353+0000","last_unstale":"2024-09-12T01:02:51.585944+0000","last_undegraded":"2024-09-12T01:02:51.585944+0000","last_fullsized":"2024-09-12T01:02:51.585944+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"268'9","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:07.380394+0000","last_change":"2024-09-12T00:34:55.225406+0000","last_active":"2024-09-12T01:04:07.380394+0000","last_peered":"2024-09-12T01:04:07.380394+0000","last_clean":"2024-09-12T01:04:07.380394+0000","last_became_active":"2024-09-12T00:34:55.224353+0000","last_became_peered":"2024-09-12T00:34:55.224353+0000","last_unstale":"2024-09-12T01:04:07.380394+0000","last_undegraded":"2024-09-12T01:04:07.380394+0000","last_fullsized":"2024-09-12T01:04:07.380394+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:35.525207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":22530,"num_write":14,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"268'6","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.308907+0000","last_change":"2024-09-12T00:34:52.204414+0000","last_active":"2024-09-12T01:04:39.308907+0000","last_peered":"2024-09-12T01:04:39.308907+0000","last_clean":"2024-09-12T01:04:39.308907+0000","last_became_active":"2024-09-12T00:34:52.203625+0000","last_became_peered":"2024-09-12T00:34:52.203625+0000","last_unstale":"2024-09-12T01:04:39.308907+0000","last_undegraded":"2024-09-12T01:04:39.308907+0000","last_fullsized":"2024-09-12T01:04:39.308907+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:35.762002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10299,"num_write":6,"num_write_kb":5179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'24","reported_seq":111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:22.733835+0000","last_change":"2024-09-12T00:33:10.845131+0000","last_active":"2024-09-12T01:02:22.733835+0000","last_peered":"2024-09-12T01:02:22.733835+0000","last_clean":"2024-09-12T01:02:22.733835+0000","last_became_active":"2024-09-12T00:33:10.844416+0000","last_became_peered":"2024-09-12T00:33:10.844416+0000","last_unstale":"2024-09-12T01:02:22.733835+0000","last_undegraded":"2024-09-12T01:02:22.733835+0000","last_fullsized":"2024-09-12T01:02:22.733835+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:44.761181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.558511+0000","last_change":"2024-09-12T00:46:09.494534+0000","last_active":"2024-09-12T01:02:57.558511+0000","last_peered":"2024-09-12T01:02:57.558511+0000","last_clean":"2024-09-12T01:02:57.558511+0000","last_became_active":"2024-09-12T00:46:09.493808+0000","last_became_peered":"2024-09-12T00:46:09.493808+0000","last_unstale":"2024-09-12T01:02:57.558511+0000","last_undegraded":"2024-09-12T01:02:57.558511+0000","last_fullsized":"2024-09-12T01:02:57.558511+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"268'2","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:07.576769+0000","last_change":"2024-09-12T00:34:55.234328+0000","last_active":"2024-09-12T01:04:07.576769+0000","last_peered":"2024-09-12T01:04:07.576769+0000","last_clean":"2024-09-12T01:04:07.576769+0000","last_became_active":"2024-09-12T00:34:55.233708+0000","last_became_peered":"2024-09-12T00:34:55.233708+0000","last_unstale":"2024-09-12T01:04:07.576769+0000","last_undegraded":"2024-09-12T01:04:07.576769+0000","last_fullsized":"2024-09-12T01:04:07.576769+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:10.278114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"268'2","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:02.379362+0000","last_change":"2024-09-12T00:34:52.188218+0000","last_active":"2024-09-12T01:04:02.379362+0000","last_peered":"2024-09-12T01:04:02.379362+0000","last_clean":"2024-09-12T01:04:02.379362+0000","last_became_active":"2024-09-12T00:34:52.186234+0000","last_became_peered":"2024-09-12T00:34:52.186234+0000","last_unstale":"2024-09-12T01:04:02.379362+0000","last_undegraded":"2024-09-12T01:04:02.379362+0000","last_fullsized":"2024-09-12T01:04:02.379362+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:37.401626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'27","reported_seq":126,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:22.536821+0000","last_change":"2024-09-12T00:33:10.853895+0000","last_active":"2024-09-12T01:01:22.536821+0000","last_peered":"2024-09-12T01:01:22.536821+0000","last_clean":"2024-09-12T01:01:22.536821+0000","last_became_active":"2024-09-12T00:33:10.853205+0000","last_became_peered":"2024-09-12T00:33:10.853205+0000","last_unstale":"2024-09-12T01:01:22.536821+0000","last_undegraded":"2024-09-12T01:01:22.536821+0000","last_fullsized":"2024-09-12T01:01:22.536821+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:11.434006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":100,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'373","reported_seq":1028,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.548055+0000","last_change":"2024-09-12T01:04:59.548055+0000","last_active":"2024-09-12T01:04:59.548055+0000","last_peered":"2024-09-12T01:04:59.548055+0000","last_clean":"2024-09-12T01:04:59.548055+0000","last_became_active":"2024-09-12T00:18:22.878117+0000","last_became_peered":"2024-09-12T00:18:22.878117+0000","last_unstale":"2024-09-12T01:04:59.548055+0000","last_undegraded":"2024-09-12T01:04:59.548055+0000","last_fullsized":"2024-09-12T01:04:59.548055+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'373","last_scrub_stamp":"2024-09-12T01:04:59.547794+0000","last_deep_scrub":"268'373","last_deep_scrub_stamp":"2024-09-12T01:04:59.547794+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.547794+0000","objects_scrubbed":10,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:34.105495+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":522,"num_read_kb":62534,"num_write":1202,"num_write_kb":43415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'437","reported_seq":1887,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.459888+0000","last_change":"2024-09-12T01:05:05.459888+0000","last_active":"2024-09-12T01:05:05.459888+0000","last_peered":"2024-09-12T01:05:05.459888+0000","last_clean":"2024-09-12T01:05:05.459888+0000","last_became_active":"2024-09-12T00:18:24.870370+0000","last_became_peered":"2024-09-12T00:18:24.870370+0000","last_unstale":"2024-09-12T01:05:05.459888+0000","last_undegraded":"2024-09-12T01:05:05.459888+0000","last_fullsized":"2024-09-12T01:05:05.459888+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'437","last_scrub_stamp":"2024-09-12T01:05:05.459689+0000","last_deep_scrub":"268'437","last_deep_scrub_stamp":"2024-09-12T01:05:05.459689+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.459689+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:46.800171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2205,"num_read_kb":2060,"num_write":503,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'344","reported_seq":997,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.586245+0000","last_change":"2024-09-12T01:04:52.586245+0000","last_active":"2024-09-12T01:04:52.586245+0000","last_peered":"2024-09-12T01:04:52.586245+0000","last_clean":"2024-09-12T01:04:52.586245+0000","last_became_active":"2024-09-12T00:18:22.845439+0000","last_became_peered":"2024-09-12T00:18:22.845439+0000","last_unstale":"2024-09-12T01:04:52.586245+0000","last_undegraded":"2024-09-12T01:04:52.586245+0000","last_fullsized":"2024-09-12T01:04:52.586245+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'344","last_scrub_stamp":"2024-09-12T01:04:52.586024+0000","last_deep_scrub":"268'344","last_deep_scrub_stamp":"2024-09-12T01:04:52.586024+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.586024+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:26.976158+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079947,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":485,"num_read_kb":5684,"num_write":1011,"num_write_kb":33510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'1351","reported_seq":3046,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.531548+0000","last_change":"2024-09-12T01:05:04.531548+0000","last_active":"2024-09-12T01:05:04.531548+0000","last_peered":"2024-09-12T01:05:04.531548+0000","last_clean":"2024-09-12T01:05:04.531548+0000","last_became_active":"2024-09-12T00:18:24.866026+0000","last_became_peered":"2024-09-12T00:18:24.866026+0000","last_unstale":"2024-09-12T01:05:04.531548+0000","last_undegraded":"2024-09-12T01:05:04.531548+0000","last_fullsized":"2024-09-12T01:05:04.531548+0000","mapping_epoch":26,"log_start":"268'1300","ondisk_log_start":"268'1300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1351","last_scrub_stamp":"2024-09-12T01:05:04.531372+0000","last_deep_scrub":"268'1351","last_deep_scrub_stamp":"2024-09-12T01:05:04.531372+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.531372+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":1300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:45.952638+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6196,"num_read_kb":5451,"num_write":1895,"num_write_kb":802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'348","reported_seq":1045,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.215693+0000","last_change":"2024-09-12T01:04:52.215693+0000","last_active":"2024-09-12T01:04:52.215693+0000","last_peered":"2024-09-12T01:04:52.215693+0000","last_clean":"2024-09-12T01:04:52.215693+0000","last_became_active":"2024-09-12T00:18:22.839379+0000","last_became_peered":"2024-09-12T00:18:22.839379+0000","last_unstale":"2024-09-12T01:04:52.215693+0000","last_undegraded":"2024-09-12T01:04:52.215693+0000","last_fullsized":"2024-09-12T01:04:52.215693+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'348","last_scrub_stamp":"2024-09-12T01:04:52.215433+0000","last_deep_scrub":"268'348","last_deep_scrub_stamp":"2024-09-12T01:04:52.215433+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.215433+0000","objects_scrubbed":9,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:02.897096+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560796,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":569,"num_read_kb":68999,"num_write":1084,"num_write_kb":32744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'870","reported_seq":2683,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:06.211516+0000","last_change":"2024-09-12T01:05:06.211516+0000","last_active":"2024-09-12T01:05:06.211516+0000","last_peered":"2024-09-12T01:05:06.211516+0000","last_clean":"2024-09-12T01:05:06.211516+0000","last_became_active":"2024-09-12T00:18:24.860995+0000","last_became_peered":"2024-09-12T00:18:24.860995+0000","last_unstale":"2024-09-12T01:05:06.211516+0000","last_undegraded":"2024-09-12T01:05:06.211516+0000","last_fullsized":"2024-09-12T01:05:06.211516+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'870","last_scrub_stamp":"2024-09-12T01:05:06.211336+0000","last_deep_scrub":"268'870","last_deep_scrub_stamp":"2024-09-12T01:05:06.211336+0000","last_clean_scrub_stamp":"2024-09-12T01:05:06.211336+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":800,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:09.525854+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4298,"num_read_kb":3905,"num_write":1128,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'339","reported_seq":1004,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.529175+0000","last_change":"2024-09-12T01:04:58.529175+0000","last_active":"2024-09-12T01:04:58.529175+0000","last_peered":"2024-09-12T01:04:58.529175+0000","last_clean":"2024-09-12T01:04:58.529175+0000","last_became_active":"2024-09-12T00:18:55.960413+0000","last_became_peered":"2024-09-12T00:18:55.960413+0000","last_unstale":"2024-09-12T01:04:58.529175+0000","last_undegraded":"2024-09-12T01:04:58.529175+0000","last_fullsized":"2024-09-12T01:04:58.529175+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'339","last_scrub_stamp":"2024-09-12T01:04:58.528952+0000","last_deep_scrub":"268'339","last_deep_scrub_stamp":"2024-09-12T01:04:58.528952+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.528952+0000","objects_scrubbed":7,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:06.429511+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":867046,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":485,"num_read_kb":54980,"num_write":1073,"num_write_kb":32836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'768","reported_seq":2325,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.385618+0000","last_change":"2024-09-12T01:05:02.385618+0000","last_active":"2024-09-12T01:05:02.385618+0000","last_peered":"2024-09-12T01:05:02.385618+0000","last_clean":"2024-09-12T01:05:02.385618+0000","last_became_active":"2024-09-12T00:18:55.955870+0000","last_became_peered":"2024-09-12T00:18:55.955870+0000","last_unstale":"2024-09-12T01:05:02.385618+0000","last_undegraded":"2024-09-12T01:05:02.385618+0000","last_fullsized":"2024-09-12T01:05:02.385618+0000","mapping_epoch":37,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'768","last_scrub_stamp":"2024-09-12T01:05:02.385449+0000","last_deep_scrub":"268'768","last_deep_scrub_stamp":"2024-09-12T01:05:02.385449+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.385449+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:32.646103+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3626,"num_read_kb":3280,"num_write":1010,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'340","reported_seq":977,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.507042+0000","last_change":"2024-09-12T01:04:58.507042+0000","last_active":"2024-09-12T01:04:58.507042+0000","last_peered":"2024-09-12T01:04:58.507042+0000","last_clean":"2024-09-12T01:04:58.507042+0000","last_became_active":"2024-09-12T00:18:22.870564+0000","last_became_peered":"2024-09-12T00:18:22.870564+0000","last_unstale":"2024-09-12T01:04:58.507042+0000","last_undegraded":"2024-09-12T01:04:58.507042+0000","last_fullsized":"2024-09-12T01:04:58.507042+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'340","last_scrub_stamp":"2024-09-12T01:04:58.506853+0000","last_deep_scrub":"268'340","last_deep_scrub_stamp":"2024-09-12T01:04:58.506853+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.506853+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:49.221170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":498,"num_read_kb":32133,"num_write":1040,"num_write_kb":41090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"268'487","reported_seq":2096,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.680342+0000","last_change":"2024-09-12T01:05:01.680342+0000","last_active":"2024-09-12T01:05:01.680342+0000","last_peered":"2024-09-12T01:05:01.680342+0000","last_clean":"2024-09-12T01:05:01.680342+0000","last_became_active":"2024-09-12T00:18:24.846508+0000","last_became_peered":"2024-09-12T00:18:24.846508+0000","last_unstale":"2024-09-12T01:05:01.680342+0000","last_undegraded":"2024-09-12T01:05:01.680342+0000","last_fullsized":"2024-09-12T01:05:01.680342+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'487","last_scrub_stamp":"2024-09-12T01:05:01.680166+0000","last_deep_scrub":"268'487","last_deep_scrub_stamp":"2024-09-12T01:05:01.680166+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.680166+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:35.737714+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2844,"num_read_kb":2655,"num_write":659,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'358","reported_seq":1001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.546009+0000","last_change":"2024-09-12T01:04:59.546009+0000","last_active":"2024-09-12T01:04:59.546009+0000","last_peered":"2024-09-12T01:04:59.546009+0000","last_clean":"2024-09-12T01:04:59.546009+0000","last_became_active":"2024-09-12T00:18:22.861074+0000","last_became_peered":"2024-09-12T00:18:22.861074+0000","last_unstale":"2024-09-12T01:04:59.546009+0000","last_undegraded":"2024-09-12T01:04:59.546009+0000","last_fullsized":"2024-09-12T01:04:59.546009+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'358","last_scrub_stamp":"2024-09-12T01:04:59.545680+0000","last_deep_scrub":"268'358","last_deep_scrub_stamp":"2024-09-12T01:04:59.545680+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.545680+0000","objects_scrubbed":9,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:21.773761+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":434032,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":541,"num_read_kb":4860,"num_write":1084,"num_write_kb":10925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'1021","reported_seq":2758,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:07.211509+0000","last_change":"2024-09-12T01:05:07.211509+0000","last_active":"2024-09-12T01:05:07.211509+0000","last_peered":"2024-09-12T01:05:07.211509+0000","last_clean":"2024-09-12T01:05:07.211509+0000","last_became_active":"2024-09-12T00:18:24.875913+0000","last_became_peered":"2024-09-12T00:18:24.875913+0000","last_unstale":"2024-09-12T01:05:07.211509+0000","last_undegraded":"2024-09-12T01:05:07.211509+0000","last_fullsized":"2024-09-12T01:05:07.211509+0000","mapping_epoch":26,"log_start":"268'1000","ondisk_log_start":"268'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1021","last_scrub_stamp":"2024-09-12T01:05:07.211320+0000","last_deep_scrub":"268'1021","last_deep_scrub_stamp":"2024-09-12T01:05:07.211320+0000","last_clean_scrub_stamp":"2024-09-12T01:05:07.211320+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":1000,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:52.009817+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4809,"num_read_kb":4259,"num_write":1397,"num_write_kb":538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'291","reported_seq":886,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.436540+0000","last_change":"2024-09-12T01:04:50.436366+0000","last_active":"2024-09-12T01:04:50.436540+0000","last_peered":"2024-09-12T01:04:50.436540+0000","last_clean":"2024-09-12T01:04:50.436540+0000","last_became_active":"2024-09-12T00:19:56.412792+0000","last_became_peered":"2024-09-12T00:19:56.412792+0000","last_unstale":"2024-09-12T01:04:50.436540+0000","last_undegraded":"2024-09-12T01:04:50.436540+0000","last_fullsized":"2024-09-12T01:04:50.436540+0000","mapping_epoch":39,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'291","last_scrub_stamp":"2024-09-12T01:04:50.436147+0000","last_deep_scrub":"268'291","last_deep_scrub_stamp":"2024-09-12T01:04:50.436147+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.436147+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:01.502828+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1343091,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":402,"num_read_kb":40979,"num_write":972,"num_write_kb":28776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"268'468","reported_seq":2055,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:06.510587+0000","last_change":"2024-09-12T01:05:06.510587+0000","last_active":"2024-09-12T01:05:06.510587+0000","last_peered":"2024-09-12T01:05:06.510587+0000","last_clean":"2024-09-12T01:05:06.510587+0000","last_became_active":"2024-09-12T00:18:24.862084+0000","last_became_peered":"2024-09-12T00:18:24.862084+0000","last_unstale":"2024-09-12T01:05:06.510587+0000","last_undegraded":"2024-09-12T01:05:06.510587+0000","last_fullsized":"2024-09-12T01:05:06.510587+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'468","last_scrub_stamp":"2024-09-12T01:05:06.510395+0000","last_deep_scrub":"268'468","last_deep_scrub_stamp":"2024-09-12T01:05:06.510395+0000","last_clean_scrub_stamp":"2024-09-12T01:05:06.510395+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:44.814542+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2471,"num_read_kb":2327,"num_write":538,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2554,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'376","reported_seq":1031,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.132657+0000","last_change":"2024-09-12T01:04:58.132657+0000","last_active":"2024-09-12T01:04:58.132657+0000","last_peered":"2024-09-12T01:04:58.132657+0000","last_clean":"2024-09-12T01:04:58.132657+0000","last_became_active":"2024-09-12T00:18:22.867749+0000","last_became_peered":"2024-09-12T00:18:22.867749+0000","last_unstale":"2024-09-12T01:04:58.132657+0000","last_undegraded":"2024-09-12T01:04:58.132657+0000","last_fullsized":"2024-09-12T01:04:58.132657+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'376","last_scrub_stamp":"2024-09-12T01:04:58.132452+0000","last_deep_scrub":"268'376","last_deep_scrub_stamp":"2024-09-12T01:04:58.132452+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.132452+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:04.893853+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":529,"num_read_kb":6849,"num_write":1205,"num_write_kb":38257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'510","reported_seq":2335,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.460303+0000","last_change":"2024-09-12T01:04:57.460303+0000","last_active":"2024-09-12T01:04:57.460303+0000","last_peered":"2024-09-12T01:04:57.460303+0000","last_clean":"2024-09-12T01:04:57.460303+0000","last_became_active":"2024-09-12T00:18:24.848163+0000","last_became_peered":"2024-09-12T00:18:24.848163+0000","last_unstale":"2024-09-12T01:04:57.460303+0000","last_undegraded":"2024-09-12T01:04:57.460303+0000","last_fullsized":"2024-09-12T01:04:57.460303+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'510","last_scrub_stamp":"2024-09-12T01:04:57.460112+0000","last_deep_scrub":"268'510","last_deep_scrub_stamp":"2024-09-12T01:04:57.460112+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.460112+0000","objects_scrubbed":5,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:50.852262+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2972,"num_read_kb":2819,"num_write":593,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4343,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'486","reported_seq":2150,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.207575+0000","last_change":"2024-09-12T01:05:04.207348+0000","last_active":"2024-09-12T01:05:04.207575+0000","last_peered":"2024-09-12T01:05:04.207575+0000","last_clean":"2024-09-12T01:05:04.207575+0000","last_became_active":"2024-09-12T00:18:24.860744+0000","last_became_peered":"2024-09-12T00:18:24.860744+0000","last_unstale":"2024-09-12T01:05:04.207575+0000","last_undegraded":"2024-09-12T01:05:04.207575+0000","last_fullsized":"2024-09-12T01:05:04.207575+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'486","last_scrub_stamp":"2024-09-12T01:05:04.207119+0000","last_deep_scrub":"268'486","last_deep_scrub_stamp":"2024-09-12T01:05:04.207119+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.207119+0000","objects_scrubbed":2,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:40.036635+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2780,"num_read_kb":2600,"num_write":590,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'313","reported_seq":926,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.505125+0000","last_change":"2024-09-12T01:04:57.505125+0000","last_active":"2024-09-12T01:04:57.505125+0000","last_peered":"2024-09-12T01:04:57.505125+0000","last_clean":"2024-09-12T01:04:57.505125+0000","last_became_active":"2024-09-12T00:18:55.962742+0000","last_became_peered":"2024-09-12T00:18:55.962742+0000","last_unstale":"2024-09-12T01:04:57.505125+0000","last_undegraded":"2024-09-12T01:04:57.505125+0000","last_fullsized":"2024-09-12T01:04:57.505125+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'313","last_scrub_stamp":"2024-09-12T01:04:57.504907+0000","last_deep_scrub":"268'313","last_deep_scrub_stamp":"2024-09-12T01:04:57.504907+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.504907+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:14.933948+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":391,"num_read_kb":39262,"num_write":935,"num_write_kb":33071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'396","reported_seq":1858,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.519805+0000","last_change":"2024-09-12T01:05:03.519644+0000","last_active":"2024-09-12T01:05:03.519805+0000","last_peered":"2024-09-12T01:05:03.519805+0000","last_clean":"2024-09-12T01:05:03.519805+0000","last_became_active":"2024-09-12T00:18:24.872902+0000","last_became_peered":"2024-09-12T00:18:24.872902+0000","last_unstale":"2024-09-12T01:05:03.519805+0000","last_undegraded":"2024-09-12T01:05:03.519805+0000","last_fullsized":"2024-09-12T01:05:03.519805+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'396","last_scrub_stamp":"2024-09-12T01:05:03.519461+0000","last_deep_scrub":"268'396","last_deep_scrub_stamp":"2024-09-12T01:05:03.519461+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.519461+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:35.432511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2097,"num_read_kb":1984,"num_write":437,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'310","reported_seq":929,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.742459+0000","last_change":"2024-09-12T01:04:56.742459+0000","last_active":"2024-09-12T01:04:56.742459+0000","last_peered":"2024-09-12T01:04:56.742459+0000","last_clean":"2024-09-12T01:04:56.742459+0000","last_became_active":"2024-09-12T00:18:22.860078+0000","last_became_peered":"2024-09-12T00:18:22.860078+0000","last_unstale":"2024-09-12T01:04:56.742459+0000","last_undegraded":"2024-09-12T01:04:56.742459+0000","last_fullsized":"2024-09-12T01:04:56.742459+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'310","last_scrub_stamp":"2024-09-12T01:04:56.742239+0000","last_deep_scrub":"268'310","last_deep_scrub_stamp":"2024-09-12T01:04:56.742239+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.742239+0000","objects_scrubbed":5,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:19.067757+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4534636,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":413,"num_read_kb":38650,"num_write":947,"num_write_kb":29439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"268'424","reported_seq":2051,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.546750+0000","last_change":"2024-09-12T01:05:01.546750+0000","last_active":"2024-09-12T01:05:01.546750+0000","last_peered":"2024-09-12T01:05:01.546750+0000","last_clean":"2024-09-12T01:05:01.546750+0000","last_became_active":"2024-09-12T00:18:24.852029+0000","last_became_peered":"2024-09-12T00:18:24.852029+0000","last_unstale":"2024-09-12T01:05:01.546750+0000","last_undegraded":"2024-09-12T01:05:01.546750+0000","last_fullsized":"2024-09-12T01:05:01.546750+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'424","last_scrub_stamp":"2024-09-12T01:05:01.546568+0000","last_deep_scrub":"268'424","last_deep_scrub_stamp":"2024-09-12T01:05:01.546568+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.546568+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:38.718196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2334,"num_read_kb":2233,"num_write":466,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'322","reported_seq":932,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.685245+0000","last_change":"2024-09-12T01:04:51.685245+0000","last_active":"2024-09-12T01:04:51.685245+0000","last_peered":"2024-09-12T01:04:51.685245+0000","last_clean":"2024-09-12T01:04:51.685245+0000","last_became_active":"2024-09-12T00:18:22.862665+0000","last_became_peered":"2024-09-12T00:18:22.862665+0000","last_unstale":"2024-09-12T01:04:51.685245+0000","last_undegraded":"2024-09-12T01:04:51.685245+0000","last_fullsized":"2024-09-12T01:04:51.685245+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'322","last_scrub_stamp":"2024-09-12T01:04:51.685000+0000","last_deep_scrub":"268'322","last_deep_scrub_stamp":"2024-09-12T01:04:51.685000+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.685000+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:57.317903+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079909,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":401,"num_read_kb":22932,"num_write":945,"num_write_kb":21492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'477","reported_seq":2108,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.503805+0000","last_change":"2024-09-12T01:04:54.503805+0000","last_active":"2024-09-12T01:04:54.503805+0000","last_peered":"2024-09-12T01:04:54.503805+0000","last_clean":"2024-09-12T01:04:54.503805+0000","last_became_active":"2024-09-12T00:18:24.849491+0000","last_became_peered":"2024-09-12T00:18:24.849491+0000","last_unstale":"2024-09-12T01:04:54.503805+0000","last_undegraded":"2024-09-12T01:04:54.503805+0000","last_fullsized":"2024-09-12T01:04:54.503805+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'477","last_scrub_stamp":"2024-09-12T01:04:54.503576+0000","last_deep_scrub":"268'477","last_deep_scrub_stamp":"2024-09-12T01:04:54.503576+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.503576+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:40.594497+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2579,"num_read_kb":2421,"num_write":543,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'353","reported_seq":986,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.198312+0000","last_change":"2024-09-12T01:04:51.198312+0000","last_active":"2024-09-12T01:04:51.198312+0000","last_peered":"2024-09-12T01:04:51.198312+0000","last_clean":"2024-09-12T01:04:51.198312+0000","last_became_active":"2024-09-12T00:18:22.856051+0000","last_became_peered":"2024-09-12T00:18:22.856051+0000","last_unstale":"2024-09-12T01:04:51.198312+0000","last_undegraded":"2024-09-12T01:04:51.198312+0000","last_fullsized":"2024-09-12T01:04:51.198312+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'353","last_scrub_stamp":"2024-09-12T01:04:51.198077+0000","last_deep_scrub":"268'353","last_deep_scrub_stamp":"2024-09-12T01:04:51.198077+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.198077+0000","objects_scrubbed":4,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:58.275825+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":458,"num_read_kb":24886,"num_write":1069,"num_write_kb":15091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"268'430","reported_seq":1984,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.486920+0000","last_change":"2024-09-12T01:04:55.486920+0000","last_active":"2024-09-12T01:04:55.486920+0000","last_peered":"2024-09-12T01:04:55.486920+0000","last_clean":"2024-09-12T01:04:55.486920+0000","last_became_active":"2024-09-12T00:18:24.853796+0000","last_became_peered":"2024-09-12T00:18:24.853796+0000","last_unstale":"2024-09-12T01:04:55.486920+0000","last_undegraded":"2024-09-12T01:04:55.486920+0000","last_fullsized":"2024-09-12T01:04:55.486920+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'430","last_scrub_stamp":"2024-09-12T01:04:55.486732+0000","last_deep_scrub":"268'430","last_deep_scrub_stamp":"2024-09-12T01:04:55.486732+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.486732+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:53.536416+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2472,"num_read_kb":2322,"num_write":521,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2265,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'333","reported_seq":1094,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.249250+0000","last_change":"2024-09-12T01:04:54.249250+0000","last_active":"2024-09-12T01:04:54.249250+0000","last_peered":"2024-09-12T01:04:54.249250+0000","last_clean":"2024-09-12T01:04:54.249250+0000","last_became_active":"2024-09-12T00:18:22.834904+0000","last_became_peered":"2024-09-12T00:18:22.834904+0000","last_unstale":"2024-09-12T01:04:54.249250+0000","last_undegraded":"2024-09-12T01:04:54.249250+0000","last_fullsized":"2024-09-12T01:04:54.249250+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'333","last_scrub_stamp":"2024-09-12T01:04:54.249011+0000","last_deep_scrub":"268'333","last_deep_scrub_stamp":"2024-09-12T01:04:54.249011+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.249011+0000","objects_scrubbed":10,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:24.413614+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":584,"num_read_kb":49706,"num_write":1054,"num_write_kb":43110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'505","reported_seq":2060,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.180476+0000","last_change":"2024-09-12T01:05:05.180476+0000","last_active":"2024-09-12T01:05:05.180476+0000","last_peered":"2024-09-12T01:05:05.180476+0000","last_clean":"2024-09-12T01:05:05.180476+0000","last_became_active":"2024-09-12T00:18:24.875112+0000","last_became_peered":"2024-09-12T00:18:24.875112+0000","last_unstale":"2024-09-12T01:05:05.180476+0000","last_undegraded":"2024-09-12T01:05:05.180476+0000","last_fullsized":"2024-09-12T01:05:05.180476+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'505","last_scrub_stamp":"2024-09-12T01:05:05.180281+0000","last_deep_scrub":"268'505","last_deep_scrub_stamp":"2024-09-12T01:05:05.180281+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.180281+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:44.845813+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2595,"num_read_kb":2402,"num_write":619,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":944,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'380","reported_seq":1078,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.292248+0000","last_change":"2024-09-12T01:04:57.292248+0000","last_active":"2024-09-12T01:04:57.292248+0000","last_peered":"2024-09-12T01:04:57.292248+0000","last_clean":"2024-09-12T01:04:57.292248+0000","last_became_active":"2024-09-12T00:18:22.841069+0000","last_became_peered":"2024-09-12T00:18:22.841069+0000","last_unstale":"2024-09-12T01:04:57.292248+0000","last_undegraded":"2024-09-12T01:04:57.292248+0000","last_fullsized":"2024-09-12T01:04:57.292248+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'380","last_scrub_stamp":"2024-09-12T01:04:57.292057+0000","last_deep_scrub":"268'380","last_deep_scrub_stamp":"2024-09-12T01:04:57.292057+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.292057+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:30.261493+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":685,"num_read_kb":23761,"num_write":1283,"num_write_kb":30294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'127","reported_seq":651,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.974481+0000","last_change":"2024-09-12T00:18:32.894030+0000","last_active":"2024-09-12T01:03:25.974481+0000","last_peered":"2024-09-12T01:03:25.974481+0000","last_clean":"2024-09-12T01:03:25.974481+0000","last_became_active":"2024-09-12T00:18:32.893410+0000","last_became_peered":"2024-09-12T00:18:32.893410+0000","last_unstale":"2024-09-12T01:03:25.974481+0000","last_undegraded":"2024-09-12T01:03:25.974481+0000","last_fullsized":"2024-09-12T01:03:25.974481+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:21.781324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":200,"num_read_kb":180,"num_write":310,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'428","reported_seq":2038,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.119112+0000","last_change":"2024-09-12T01:05:00.119112+0000","last_active":"2024-09-12T01:05:00.119112+0000","last_peered":"2024-09-12T01:05:00.119112+0000","last_clean":"2024-09-12T01:05:00.119112+0000","last_became_active":"2024-09-12T00:18:24.862963+0000","last_became_peered":"2024-09-12T00:18:24.862963+0000","last_unstale":"2024-09-12T01:05:00.119112+0000","last_undegraded":"2024-09-12T01:05:00.119112+0000","last_fullsized":"2024-09-12T01:05:00.119112+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'428","last_scrub_stamp":"2024-09-12T01:05:00.118957+0000","last_deep_scrub":"268'428","last_deep_scrub_stamp":"2024-09-12T01:05:00.118957+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.118957+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:58.043360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2444,"num_read_kb":2313,"num_write":504,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"268'339","reported_seq":992,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.462684+0000","last_change":"2024-09-12T01:04:54.462526+0000","last_active":"2024-09-12T01:04:54.462684+0000","last_peered":"2024-09-12T01:04:54.462684+0000","last_clean":"2024-09-12T01:04:54.462684+0000","last_became_active":"2024-09-12T00:18:55.954978+0000","last_became_peered":"2024-09-12T00:18:55.954978+0000","last_unstale":"2024-09-12T01:04:54.462684+0000","last_undegraded":"2024-09-12T01:04:54.462684+0000","last_fullsized":"2024-09-12T01:04:54.462684+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'339","last_scrub_stamp":"2024-09-12T01:04:54.462327+0000","last_deep_scrub":"268'339","last_deep_scrub_stamp":"2024-09-12T01:04:54.462327+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.462327+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:39.747015+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":485,"num_read_kb":26304,"num_write":1090,"num_write_kb":30933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.749399+0000","last_change":"2024-09-12T00:18:26.872530+0000","last_active":"2024-09-12T01:01:57.749399+0000","last_peered":"2024-09-12T01:01:57.749399+0000","last_clean":"2024-09-12T01:01:57.749399+0000","last_became_active":"2024-09-12T00:18:26.871803+0000","last_became_peered":"2024-09-12T00:18:26.871803+0000","last_unstale":"2024-09-12T01:01:57.749399+0000","last_undegraded":"2024-09-12T01:01:57.749399+0000","last_fullsized":"2024-09-12T01:01:57.749399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:22.818539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'341","reported_seq":958,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.402373+0000","last_change":"2024-09-12T00:18:28.875623+0000","last_active":"2024-09-12T01:04:39.402373+0000","last_peered":"2024-09-12T01:04:39.402373+0000","last_clean":"2024-09-12T01:04:39.402373+0000","last_became_active":"2024-09-12T00:18:28.874861+0000","last_became_peered":"2024-09-12T00:18:28.874861+0000","last_unstale":"2024-09-12T01:04:39.402373+0000","last_undegraded":"2024-09-12T01:04:39.402373+0000","last_fullsized":"2024-09-12T01:04:39.402373+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:25.073806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51345,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":553,"num_read_kb":1147,"num_write":436,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.546262+0000","last_change":"2024-09-12T00:18:30.894626+0000","last_active":"2024-09-12T01:02:02.546262+0000","last_peered":"2024-09-12T01:02:02.546262+0000","last_clean":"2024-09-12T01:02:02.546262+0000","last_became_active":"2024-09-12T00:18:30.893886+0000","last_became_peered":"2024-09-12T00:18:30.893886+0000","last_unstale":"2024-09-12T01:02:02.546262+0000","last_undegraded":"2024-09-12T01:02:02.546262+0000","last_fullsized":"2024-09-12T01:02:02.546262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:00.518894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'2426","reported_seq":4321,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.416183+0000","last_change":"2024-09-12T00:18:32.899968+0000","last_active":"2024-09-12T01:03:37.416183+0000","last_peered":"2024-09-12T01:03:37.416183+0000","last_clean":"2024-09-12T01:03:37.416183+0000","last_became_active":"2024-09-12T00:18:32.899168+0000","last_became_peered":"2024-09-12T00:18:32.899168+0000","last_unstale":"2024-09-12T01:03:37.416183+0000","last_undegraded":"2024-09-12T01:03:37.416183+0000","last_fullsized":"2024-09-12T01:03:37.416183+0000","mapping_epoch":34,"log_start":"268'2400","ondisk_log_start":"268'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":2400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:13.149755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6111,"num_read_kb":6108,"num_write":4843,"num_write_kb":1788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'1291","reported_seq":2845,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.595104+0000","last_change":"2024-09-12T01:05:02.595104+0000","last_active":"2024-09-12T01:05:02.595104+0000","last_peered":"2024-09-12T01:05:02.595104+0000","last_clean":"2024-09-12T01:05:02.595104+0000","last_became_active":"2024-09-12T00:18:24.869219+0000","last_became_peered":"2024-09-12T00:18:24.869219+0000","last_unstale":"2024-09-12T01:05:02.595104+0000","last_undegraded":"2024-09-12T01:05:02.595104+0000","last_fullsized":"2024-09-12T01:05:02.595104+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1291","last_scrub_stamp":"2024-09-12T01:05:02.594874+0000","last_deep_scrub":"268'1291","last_deep_scrub_stamp":"2024-09-12T01:05:02.594874+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.594874+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":1200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:11.005405+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5815,"num_read_kb":5070,"num_write":1809,"num_write_kb":816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'273","reported_seq":850,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:46.448096+0000","last_change":"2024-09-12T01:04:46.448096+0000","last_active":"2024-09-12T01:04:46.448096+0000","last_peered":"2024-09-12T01:04:46.448096+0000","last_clean":"2024-09-12T01:04:46.448096+0000","last_became_active":"2024-09-12T00:18:55.953363+0000","last_became_peered":"2024-09-12T00:18:55.953363+0000","last_unstale":"2024-09-12T01:04:46.448096+0000","last_undegraded":"2024-09-12T01:04:46.448096+0000","last_fullsized":"2024-09-12T01:04:46.448096+0000","mapping_epoch":37,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'273","last_scrub_stamp":"2024-09-12T01:04:46.447974+0000","last_deep_scrub":"268'273","last_deep_scrub_stamp":"2024-09-12T01:04:46.447974+0000","last_clean_scrub_stamp":"2024-09-12T01:04:46.447974+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:00.461692+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079954,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":346,"num_read_kb":12333,"num_write":862,"num_write_kb":28931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:31.733365+0000","last_change":"2024-09-12T00:18:26.848809+0000","last_active":"2024-09-12T01:00:31.733365+0000","last_peered":"2024-09-12T01:00:31.733365+0000","last_clean":"2024-09-12T01:00:31.733365+0000","last_became_active":"2024-09-12T00:18:26.848272+0000","last_became_peered":"2024-09-12T00:18:26.848272+0000","last_unstale":"2024-09-12T01:00:31.733365+0000","last_undegraded":"2024-09-12T01:00:31.733365+0000","last_fullsized":"2024-09-12T01:00:31.733365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:32.968436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'90","reported_seq":626,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.547603+0000","last_change":"2024-09-12T00:18:28.883255+0000","last_active":"2024-09-12T01:02:02.547603+0000","last_peered":"2024-09-12T01:02:02.547603+0000","last_clean":"2024-09-12T01:02:02.547603+0000","last_became_active":"2024-09-12T00:18:28.882630+0000","last_became_peered":"2024-09-12T00:18:28.882630+0000","last_unstale":"2024-09-12T01:02:02.547603+0000","last_undegraded":"2024-09-12T01:02:02.547603+0000","last_fullsized":"2024-09-12T01:02:02.547603+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:19.332138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":98,"num_write":70,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.547576+0000","last_change":"2024-09-12T00:18:30.901543+0000","last_active":"2024-09-12T01:02:02.547576+0000","last_peered":"2024-09-12T01:02:02.547576+0000","last_clean":"2024-09-12T01:02:02.547576+0000","last_became_active":"2024-09-12T00:18:30.900908+0000","last_became_peered":"2024-09-12T00:18:30.900908+0000","last_unstale":"2024-09-12T01:02:02.547576+0000","last_undegraded":"2024-09-12T01:02:02.547576+0000","last_fullsized":"2024-09-12T01:02:02.547576+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:06.507522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'120","reported_seq":626,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.178090+0000","last_change":"2024-09-12T00:18:32.910263+0000","last_active":"2024-09-12T01:02:58.178090+0000","last_peered":"2024-09-12T01:02:58.178090+0000","last_clean":"2024-09-12T01:02:58.178090+0000","last_became_active":"2024-09-12T00:18:32.909547+0000","last_became_peered":"2024-09-12T00:18:32.909547+0000","last_unstale":"2024-09-12T01:02:58.178090+0000","last_undegraded":"2024-09-12T01:02:58.178090+0000","last_fullsized":"2024-09-12T01:02:58.178090+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:15.935680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":128,"num_write":294,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'1255","reported_seq":2907,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.243155+0000","last_change":"2024-09-12T01:04:55.243155+0000","last_active":"2024-09-12T01:04:55.243155+0000","last_peered":"2024-09-12T01:04:55.243155+0000","last_clean":"2024-09-12T01:04:55.243155+0000","last_became_active":"2024-09-12T00:18:24.859237+0000","last_became_peered":"2024-09-12T00:18:24.859237+0000","last_unstale":"2024-09-12T01:04:55.243155+0000","last_undegraded":"2024-09-12T01:04:55.243155+0000","last_fullsized":"2024-09-12T01:04:55.243155+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1255","last_scrub_stamp":"2024-09-12T01:04:55.242968+0000","last_deep_scrub":"268'1255","last_deep_scrub_stamp":"2024-09-12T01:04:55.242968+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.242968+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:13.838468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5766,"num_read_kb":5095,"num_write":1782,"num_write_kb":773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'386","reported_seq":1113,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.459313+0000","last_change":"2024-09-12T01:04:52.459156+0000","last_active":"2024-09-12T01:04:52.459313+0000","last_peered":"2024-09-12T01:04:52.459313+0000","last_clean":"2024-09-12T01:04:52.459313+0000","last_became_active":"2024-09-12T00:18:22.873262+0000","last_became_peered":"2024-09-12T00:18:22.873262+0000","last_unstale":"2024-09-12T01:04:52.459313+0000","last_undegraded":"2024-09-12T01:04:52.459313+0000","last_fullsized":"2024-09-12T01:04:52.459313+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'386","last_scrub_stamp":"2024-09-12T01:04:52.458890+0000","last_deep_scrub":"268'386","last_deep_scrub_stamp":"2024-09-12T01:04:52.458890+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.458890+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:38.488860+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":606,"num_read_kb":24526,"num_write":1220,"num_write_kb":41630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.756017+0000","last_change":"2024-09-12T00:18:26.855885+0000","last_active":"2024-09-12T01:01:56.756017+0000","last_peered":"2024-09-12T01:01:56.756017+0000","last_clean":"2024-09-12T01:01:56.756017+0000","last_became_active":"2024-09-12T00:18:26.855348+0000","last_became_peered":"2024-09-12T00:18:26.855348+0000","last_unstale":"2024-09-12T01:01:56.756017+0000","last_undegraded":"2024-09-12T01:01:56.756017+0000","last_fullsized":"2024-09-12T01:01:56.756017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:48.816326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'125","reported_seq":685,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.455781+0000","last_change":"2024-09-12T01:05:03.455781+0000","last_active":"2024-09-12T01:05:03.455781+0000","last_peered":"2024-09-12T01:05:03.455781+0000","last_clean":"2024-09-12T01:05:03.455781+0000","last_became_active":"2024-09-12T00:18:28.884722+0000","last_became_peered":"2024-09-12T00:18:28.884722+0000","last_unstale":"2024-09-12T01:05:03.455781+0000","last_undegraded":"2024-09-12T01:05:03.455781+0000","last_fullsized":"2024-09-12T01:05:03.455781+0000","mapping_epoch":30,"log_start":"268'100","ondisk_log_start":"268'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'125","last_scrub_stamp":"2024-09-12T01:05:03.455518+0000","last_deep_scrub":"268'125","last_deep_scrub_stamp":"2024-09-12T01:05:03.455518+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.455518+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:28.693704+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":98,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'784","reported_seq":4742,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.731633+0000","last_change":"2024-09-12T00:18:30.894494+0000","last_active":"2024-09-12T01:04:39.731633+0000","last_peered":"2024-09-12T01:04:39.731633+0000","last_clean":"2024-09-12T01:04:39.731633+0000","last_became_active":"2024-09-12T00:18:30.893739+0000","last_became_peered":"2024-09-12T00:18:30.893739+0000","last_unstale":"2024-09-12T01:04:39.731633+0000","last_undegraded":"2024-09-12T01:04:39.731633+0000","last_fullsized":"2024-09-12T01:04:39.731633+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:28.177468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'210","reported_seq":1045,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.023471+0000","last_change":"2024-09-12T00:18:32.884849+0000","last_active":"2024-09-12T01:03:26.023471+0000","last_peered":"2024-09-12T01:03:26.023471+0000","last_clean":"2024-09-12T01:03:26.023471+0000","last_became_active":"2024-09-12T00:18:32.884130+0000","last_became_peered":"2024-09-12T00:18:32.884130+0000","last_unstale":"2024-09-12T01:03:26.023471+0000","last_undegraded":"2024-09-12T01:03:26.023471+0000","last_fullsized":"2024-09-12T01:03:26.023471+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:08.903193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":639,"num_read_kb":629,"num_write":484,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'895","reported_seq":2632,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.033355+0000","last_change":"2024-09-12T01:05:02.033355+0000","last_active":"2024-09-12T01:05:02.033355+0000","last_peered":"2024-09-12T01:05:02.033355+0000","last_clean":"2024-09-12T01:05:02.033355+0000","last_became_active":"2024-09-12T00:18:24.868103+0000","last_became_peered":"2024-09-12T00:18:24.868103+0000","last_unstale":"2024-09-12T01:05:02.033355+0000","last_undegraded":"2024-09-12T01:05:02.033355+0000","last_fullsized":"2024-09-12T01:05:02.033355+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'895","last_scrub_stamp":"2024-09-12T01:05:02.033166+0000","last_deep_scrub":"268'895","last_deep_scrub_stamp":"2024-09-12T01:05:02.033166+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.033166+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":800,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:53.892778+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4419,"num_read_kb":4003,"num_write":1187,"num_write_kb":433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":709,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'320","reported_seq":946,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.711337+0000","last_change":"2024-09-12T01:04:49.711181+0000","last_active":"2024-09-12T01:04:49.711337+0000","last_peered":"2024-09-12T01:04:49.711337+0000","last_clean":"2024-09-12T01:04:49.711337+0000","last_became_active":"2024-09-12T00:18:22.850530+0000","last_became_peered":"2024-09-12T00:18:22.850530+0000","last_unstale":"2024-09-12T01:04:49.711337+0000","last_undegraded":"2024-09-12T01:04:49.711337+0000","last_fullsized":"2024-09-12T01:04:49.711337+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'320","last_scrub_stamp":"2024-09-12T01:04:49.710990+0000","last_deep_scrub":"268'320","last_deep_scrub_stamp":"2024-09-12T01:04:49.710990+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.710990+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:12.435073+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263200,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":460,"num_read_kb":6949,"num_write":1090,"num_write_kb":36294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.749449+0000","last_change":"2024-09-12T00:18:26.868989+0000","last_active":"2024-09-12T01:01:57.749449+0000","last_peered":"2024-09-12T01:01:57.749449+0000","last_clean":"2024-09-12T01:01:57.749449+0000","last_became_active":"2024-09-12T00:18:26.867729+0000","last_became_peered":"2024-09-12T00:18:26.867729+0000","last_unstale":"2024-09-12T01:01:57.749449+0000","last_undegraded":"2024-09-12T01:01:57.749449+0000","last_fullsized":"2024-09-12T01:01:57.749449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:38.364796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'264","reported_seq":839,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.179373+0000","last_change":"2024-09-12T00:18:28.885774+0000","last_active":"2024-09-12T01:04:39.179373+0000","last_peered":"2024-09-12T01:04:39.179373+0000","last_clean":"2024-09-12T01:04:39.179373+0000","last_became_active":"2024-09-12T00:18:28.884779+0000","last_became_peered":"2024-09-12T00:18:28.884779+0000","last_unstale":"2024-09-12T01:04:39.179373+0000","last_undegraded":"2024-09-12T01:04:39.179373+0000","last_fullsized":"2024-09-12T01:04:39.179373+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:17.954386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49225,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":1009,"num_write":358,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'816","reported_seq":2286,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.568233+0000","last_change":"2024-09-12T00:18:30.903331+0000","last_active":"2024-09-12T01:04:38.568233+0000","last_peered":"2024-09-12T01:04:38.568233+0000","last_clean":"2024-09-12T01:04:38.568233+0000","last_became_active":"2024-09-12T00:18:30.894642+0000","last_became_peered":"2024-09-12T00:18:30.894642+0000","last_unstale":"2024-09-12T01:04:38.568233+0000","last_undegraded":"2024-09-12T01:04:38.568233+0000","last_fullsized":"2024-09-12T01:04:38.568233+0000","mapping_epoch":32,"log_start":"268'800","ondisk_log_start":"268'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:23.687695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'478","reported_seq":2089,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.519507+0000","last_change":"2024-09-12T01:05:00.519507+0000","last_active":"2024-09-12T01:05:00.519507+0000","last_peered":"2024-09-12T01:05:00.519507+0000","last_clean":"2024-09-12T01:05:00.519507+0000","last_became_active":"2024-09-12T00:18:24.869435+0000","last_became_peered":"2024-09-12T00:18:24.869435+0000","last_unstale":"2024-09-12T01:05:00.519507+0000","last_undegraded":"2024-09-12T01:05:00.519507+0000","last_fullsized":"2024-09-12T01:05:00.519507+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'478","last_scrub_stamp":"2024-09-12T01:05:00.519326+0000","last_deep_scrub":"268'478","last_deep_scrub_stamp":"2024-09-12T01:05:00.519326+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.519326+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:06.717819+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2569,"num_read_kb":2408,"num_write":545,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2278,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'380","reported_seq":1016,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.422509+0000","last_change":"2024-09-12T01:04:53.422509+0000","last_active":"2024-09-12T01:04:53.422509+0000","last_peered":"2024-09-12T01:04:53.422509+0000","last_clean":"2024-09-12T01:04:53.422509+0000","last_became_active":"2024-09-12T00:18:22.877327+0000","last_became_peered":"2024-09-12T00:18:22.877327+0000","last_unstale":"2024-09-12T01:04:53.422509+0000","last_undegraded":"2024-09-12T01:04:53.422509+0000","last_fullsized":"2024-09-12T01:04:53.422509+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'380","last_scrub_stamp":"2024-09-12T01:04:53.422308+0000","last_deep_scrub":"268'380","last_deep_scrub_stamp":"2024-09-12T01:04:53.422308+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.422308+0000","objects_scrubbed":7,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:37.542577+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170146,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":498,"num_read_kb":23147,"num_write":1077,"num_write_kb":55226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.519685+0000","last_change":"2024-09-12T01:05:05.519685+0000","last_active":"2024-09-12T01:05:05.519685+0000","last_peered":"2024-09-12T01:05:05.519685+0000","last_clean":"2024-09-12T01:05:05.519685+0000","last_became_active":"2024-09-12T00:18:26.874638+0000","last_became_peered":"2024-09-12T00:18:26.874638+0000","last_unstale":"2024-09-12T01:05:05.519685+0000","last_undegraded":"2024-09-12T01:05:05.519685+0000","last_fullsized":"2024-09-12T01:05:05.519685+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:05.519508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:05.519508+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.519508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:08.182181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'335","reported_seq":954,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.584718+0000","last_change":"2024-09-12T00:18:28.896980+0000","last_active":"2024-09-12T01:04:39.584718+0000","last_peered":"2024-09-12T01:04:39.584718+0000","last_clean":"2024-09-12T01:04:39.584718+0000","last_became_active":"2024-09-12T00:18:28.895950+0000","last_became_peered":"2024-09-12T00:18:28.895950+0000","last_unstale":"2024-09-12T01:04:39.584718+0000","last_undegraded":"2024-09-12T01:04:39.584718+0000","last_fullsized":"2024-09-12T01:04:39.584718+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:16.223388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19722,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":538,"num_read_kb":1043,"num_write":414,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:16.542412+0000","last_change":"2024-09-12T00:18:30.874823+0000","last_active":"2024-09-12T01:01:16.542412+0000","last_peered":"2024-09-12T01:01:16.542412+0000","last_clean":"2024-09-12T01:01:16.542412+0000","last_became_active":"2024-09-12T00:18:30.874074+0000","last_became_peered":"2024-09-12T00:18:30.874074+0000","last_unstale":"2024-09-12T01:01:16.542412+0000","last_undegraded":"2024-09-12T01:01:16.542412+0000","last_fullsized":"2024-09-12T01:01:16.542412+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:46.157942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'552","reported_seq":1366,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.801949+0000","last_change":"2024-09-12T00:18:32.900714+0000","last_active":"2024-09-12T01:04:31.801949+0000","last_peered":"2024-09-12T01:04:31.801949+0000","last_clean":"2024-09-12T01:04:31.801949+0000","last_became_active":"2024-09-12T00:18:32.899046+0000","last_became_peered":"2024-09-12T00:18:32.899046+0000","last_unstale":"2024-09-12T01:04:31.801949+0000","last_undegraded":"2024-09-12T01:04:31.801949+0000","last_fullsized":"2024-09-12T01:04:31.801949+0000","mapping_epoch":34,"log_start":"268'500","ondisk_log_start":"268'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:25.804502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1268,"num_read_kb":1267,"num_write":1132,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'483","reported_seq":2100,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.135439+0000","last_change":"2024-09-12T01:04:54.135439+0000","last_active":"2024-09-12T01:04:54.135439+0000","last_peered":"2024-09-12T01:04:54.135439+0000","last_clean":"2024-09-12T01:04:54.135439+0000","last_became_active":"2024-09-12T00:18:24.861455+0000","last_became_peered":"2024-09-12T00:18:24.861455+0000","last_unstale":"2024-09-12T01:04:54.135439+0000","last_undegraded":"2024-09-12T01:04:54.135439+0000","last_fullsized":"2024-09-12T01:04:54.135439+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'483","last_scrub_stamp":"2024-09-12T01:04:54.135256+0000","last_deep_scrub":"268'483","last_deep_scrub_stamp":"2024-09-12T01:04:54.135256+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.135256+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:48.039409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2490,"num_read_kb":2350,"num_write":569,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'372","reported_seq":1035,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.432703+0000","last_change":"2024-09-12T01:04:51.432703+0000","last_active":"2024-09-12T01:04:51.432703+0000","last_peered":"2024-09-12T01:04:51.432703+0000","last_clean":"2024-09-12T01:04:51.432703+0000","last_became_active":"2024-09-12T00:18:22.871330+0000","last_became_peered":"2024-09-12T00:18:22.871330+0000","last_unstale":"2024-09-12T01:04:51.432703+0000","last_undegraded":"2024-09-12T01:04:51.432703+0000","last_fullsized":"2024-09-12T01:04:51.432703+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'372","last_scrub_stamp":"2024-09-12T01:04:51.432478+0000","last_deep_scrub":"268'372","last_deep_scrub_stamp":"2024-09-12T01:04:51.432478+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.432478+0000","objects_scrubbed":7,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:00.323028+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22053,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":541,"num_read_kb":9754,"num_write":1101,"num_write_kb":25837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"268'4","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.419318+0000","last_change":"2024-09-12T01:04:59.419318+0000","last_active":"2024-09-12T01:04:59.419318+0000","last_peered":"2024-09-12T01:04:59.419318+0000","last_clean":"2024-09-12T01:04:59.419318+0000","last_became_active":"2024-09-12T00:18:26.858529+0000","last_became_peered":"2024-09-12T00:18:26.858529+0000","last_unstale":"2024-09-12T01:04:59.419318+0000","last_undegraded":"2024-09-12T01:04:59.419318+0000","last_fullsized":"2024-09-12T01:04:59.419318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:04:59.419081+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:04:59.419081+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.419081+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:54.969136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'286","reported_seq":870,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.143127+0000","last_change":"2024-09-12T00:18:28.896114+0000","last_active":"2024-09-12T01:04:40.143127+0000","last_peered":"2024-09-12T01:04:40.143127+0000","last_clean":"2024-09-12T01:04:40.143127+0000","last_became_active":"2024-09-12T00:18:28.895521+0000","last_became_peered":"2024-09-12T00:18:28.895521+0000","last_unstale":"2024-09-12T01:04:40.143127+0000","last_undegraded":"2024-09-12T01:04:40.143127+0000","last_fullsized":"2024-09-12T01:04:40.143127+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:58.027139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":471,"num_read_kb":1097,"num_write":388,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.755573+0000","last_change":"2024-09-12T00:18:30.907840+0000","last_active":"2024-09-12T01:01:56.755573+0000","last_peered":"2024-09-12T01:01:56.755573+0000","last_clean":"2024-09-12T01:01:56.755573+0000","last_became_active":"2024-09-12T00:18:30.905601+0000","last_became_peered":"2024-09-12T00:18:30.905601+0000","last_unstale":"2024-09-12T01:01:56.755573+0000","last_undegraded":"2024-09-12T01:01:56.755573+0000","last_fullsized":"2024-09-12T01:01:56.755573+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:08.252494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'122","reported_seq":612,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:20.723358+0000","last_change":"2024-09-12T00:18:32.900357+0000","last_active":"2024-09-12T01:04:20.723358+0000","last_peered":"2024-09-12T01:04:20.723358+0000","last_clean":"2024-09-12T01:04:20.723358+0000","last_became_active":"2024-09-12T00:18:32.899284+0000","last_became_peered":"2024-09-12T00:18:32.899284+0000","last_unstale":"2024-09-12T01:04:20.723358+0000","last_undegraded":"2024-09-12T01:04:20.723358+0000","last_fullsized":"2024-09-12T01:04:20.723358+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:39.218682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":95,"num_write":292,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'840","reported_seq":2349,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.747511+0000","last_change":"2024-09-12T01:04:54.747511+0000","last_active":"2024-09-12T01:04:54.747511+0000","last_peered":"2024-09-12T01:04:54.747511+0000","last_clean":"2024-09-12T01:04:54.747511+0000","last_became_active":"2024-09-12T00:18:24.869582+0000","last_became_peered":"2024-09-12T00:18:24.869582+0000","last_unstale":"2024-09-12T01:04:54.747511+0000","last_undegraded":"2024-09-12T01:04:54.747511+0000","last_fullsized":"2024-09-12T01:04:54.747511+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'840","last_scrub_stamp":"2024-09-12T01:04:54.747326+0000","last_deep_scrub":"268'840","last_deep_scrub_stamp":"2024-09-12T01:04:54.747326+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.747326+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":800,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:53.076407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4018,"num_read_kb":3569,"num_write":1156,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'263","reported_seq":871,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.466935+0000","last_change":"2024-09-12T01:04:55.466935+0000","last_active":"2024-09-12T01:04:55.466935+0000","last_peered":"2024-09-12T01:04:55.466935+0000","last_clean":"2024-09-12T01:04:55.466935+0000","last_became_active":"2024-09-12T00:18:22.875150+0000","last_became_peered":"2024-09-12T00:18:22.875150+0000","last_unstale":"2024-09-12T01:04:55.466935+0000","last_undegraded":"2024-09-12T01:04:55.466935+0000","last_fullsized":"2024-09-12T01:04:55.466935+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'263","last_scrub_stamp":"2024-09-12T01:04:55.466756+0000","last_deep_scrub":"268'263","last_deep_scrub_stamp":"2024-09-12T01:04:55.466756+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.466756+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:15.779888+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174702,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":374,"num_read_kb":19791,"num_write":779,"num_write_kb":25570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"268'6","reported_seq":993,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.376795+0000","last_change":"2024-09-12T01:05:00.376795+0000","last_active":"2024-09-12T01:05:00.376795+0000","last_peered":"2024-09-12T01:05:00.376795+0000","last_clean":"2024-09-12T01:05:00.376795+0000","last_became_active":"2024-09-12T00:18:26.857788+0000","last_became_peered":"2024-09-12T00:18:26.857788+0000","last_unstale":"2024-09-12T01:05:00.376795+0000","last_undegraded":"2024-09-12T01:05:00.376795+0000","last_fullsized":"2024-09-12T01:05:00.376795+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T01:05:00.376612+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T01:05:00.376612+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.376612+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:45.589459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'304","reported_seq":902,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.663169+0000","last_change":"2024-09-12T00:18:28.887534+0000","last_active":"2024-09-12T01:04:39.663169+0000","last_peered":"2024-09-12T01:04:39.663169+0000","last_clean":"2024-09-12T01:04:39.663169+0000","last_became_active":"2024-09-12T00:18:28.886806+0000","last_became_peered":"2024-09-12T00:18:28.886806+0000","last_unstale":"2024-09-12T01:04:39.663169+0000","last_undegraded":"2024-09-12T01:04:39.663169+0000","last_fullsized":"2024-09-12T01:04:39.663169+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:57.100168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45713,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":494,"num_read_kb":1053,"num_write":392,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'808","reported_seq":2411,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.056456+0000","last_change":"2024-09-12T00:18:30.895445+0000","last_active":"2024-09-12T01:04:40.056456+0000","last_peered":"2024-09-12T01:04:40.056456+0000","last_clean":"2024-09-12T01:04:40.056456+0000","last_became_active":"2024-09-12T00:18:30.888688+0000","last_became_peered":"2024-09-12T00:18:30.888688+0000","last_unstale":"2024-09-12T01:04:40.056456+0000","last_undegraded":"2024-09-12T01:04:40.056456+0000","last_fullsized":"2024-09-12T01:04:40.056456+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:44.135657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'131","reported_seq":633,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.832406+0000","last_change":"2024-09-12T00:18:32.909612+0000","last_active":"2024-09-12T01:04:30.832406+0000","last_peered":"2024-09-12T01:04:30.832406+0000","last_clean":"2024-09-12T01:04:30.832406+0000","last_became_active":"2024-09-12T00:18:32.904609+0000","last_became_peered":"2024-09-12T00:18:32.904609+0000","last_unstale":"2024-09-12T01:04:30.832406+0000","last_undegraded":"2024-09-12T01:04:30.832406+0000","last_fullsized":"2024-09-12T01:04:30.832406+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:02.670740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":137,"num_read_kb":127,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'816","reported_seq":2298,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.205034+0000","last_change":"2024-09-12T01:04:54.205034+0000","last_active":"2024-09-12T01:04:54.205034+0000","last_peered":"2024-09-12T01:04:54.205034+0000","last_clean":"2024-09-12T01:04:54.205034+0000","last_became_active":"2024-09-12T00:18:24.856572+0000","last_became_peered":"2024-09-12T00:18:24.856572+0000","last_unstale":"2024-09-12T01:04:54.205034+0000","last_undegraded":"2024-09-12T01:04:54.205034+0000","last_fullsized":"2024-09-12T01:04:54.205034+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'816","last_scrub_stamp":"2024-09-12T01:04:54.204847+0000","last_deep_scrub":"268'816","last_deep_scrub_stamp":"2024-09-12T01:04:54.204847+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.204847+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:06.157588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3705,"num_read_kb":3326,"num_write":1078,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'390","reported_seq":1108,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.585386+0000","last_change":"2024-09-12T01:04:48.585386+0000","last_active":"2024-09-12T01:04:48.585386+0000","last_peered":"2024-09-12T01:04:48.585386+0000","last_clean":"2024-09-12T01:04:48.585386+0000","last_became_active":"2024-09-12T00:18:22.865067+0000","last_became_peered":"2024-09-12T00:18:22.865067+0000","last_unstale":"2024-09-12T01:04:48.585386+0000","last_undegraded":"2024-09-12T01:04:48.585386+0000","last_fullsized":"2024-09-12T01:04:48.585386+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'390","last_scrub_stamp":"2024-09-12T01:04:48.585156+0000","last_deep_scrub":"268'390","last_deep_scrub_stamp":"2024-09-12T01:04:48.585156+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.585156+0000","objects_scrubbed":9,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:32.682633+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300494,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":644,"num_read_kb":35348,"num_write":1371,"num_write_kb":29498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.418400+0000","last_change":"2024-09-12T01:04:58.418400+0000","last_active":"2024-09-12T01:04:58.418400+0000","last_peered":"2024-09-12T01:04:58.418400+0000","last_clean":"2024-09-12T01:04:58.418400+0000","last_became_active":"2024-09-12T00:18:26.867793+0000","last_became_peered":"2024-09-12T00:18:26.867793+0000","last_unstale":"2024-09-12T01:04:58.418400+0000","last_undegraded":"2024-09-12T01:04:58.418400+0000","last_fullsized":"2024-09-12T01:04:58.418400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:58.418226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:58.418226+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.418226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:04.200862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'480","reported_seq":1134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:06.288694+0000","last_change":"2024-09-12T01:05:06.288694+0000","last_active":"2024-09-12T01:05:06.288694+0000","last_peered":"2024-09-12T01:05:06.288694+0000","last_clean":"2024-09-12T01:05:06.288694+0000","last_became_active":"2024-09-12T00:18:28.875891+0000","last_became_peered":"2024-09-12T00:18:28.875891+0000","last_unstale":"2024-09-12T01:05:06.288694+0000","last_undegraded":"2024-09-12T01:05:06.288694+0000","last_fullsized":"2024-09-12T01:05:06.288694+0000","mapping_epoch":30,"log_start":"268'400","ondisk_log_start":"268'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'480","last_scrub_stamp":"2024-09-12T01:05:06.288498+0000","last_deep_scrub":"268'480","last_deep_scrub_stamp":"2024-09-12T01:05:06.288498+0000","last_clean_scrub_stamp":"2024-09-12T01:05:06.288498+0000","objects_scrubbed":7,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:38.359325+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96447,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":834,"num_read_kb":1977,"num_write":680,"num_write_kb":567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.409073+0000","last_change":"2024-09-12T01:05:02.409073+0000","last_active":"2024-09-12T01:05:02.409073+0000","last_peered":"2024-09-12T01:05:02.409073+0000","last_clean":"2024-09-12T01:05:02.409073+0000","last_became_active":"2024-09-12T00:18:30.895401+0000","last_became_peered":"2024-09-12T00:18:30.895401+0000","last_unstale":"2024-09-12T01:05:02.409073+0000","last_undegraded":"2024-09-12T01:05:02.409073+0000","last_fullsized":"2024-09-12T01:05:02.409073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:02.408869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:02.408869+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.408869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:22.455398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'152","reported_seq":679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.551335+0000","last_change":"2024-09-12T00:18:32.893457+0000","last_active":"2024-09-12T01:01:56.551335+0000","last_peered":"2024-09-12T01:01:56.551335+0000","last_clean":"2024-09-12T01:01:56.551335+0000","last_became_active":"2024-09-12T00:18:32.892682+0000","last_became_peered":"2024-09-12T00:18:32.892682+0000","last_unstale":"2024-09-12T01:01:56.551335+0000","last_undegraded":"2024-09-12T01:01:56.551335+0000","last_fullsized":"2024-09-12T01:01:56.551335+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:17.913143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1103,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":196,"num_read_kb":180,"num_write":352,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'460","reported_seq":2083,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.181483+0000","last_change":"2024-09-12T01:04:53.181483+0000","last_active":"2024-09-12T01:04:53.181483+0000","last_peered":"2024-09-12T01:04:53.181483+0000","last_clean":"2024-09-12T01:04:53.181483+0000","last_became_active":"2024-09-12T00:18:24.852683+0000","last_became_peered":"2024-09-12T00:18:24.852683+0000","last_unstale":"2024-09-12T01:04:53.181483+0000","last_undegraded":"2024-09-12T01:04:53.181483+0000","last_fullsized":"2024-09-12T01:04:53.181483+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'460","last_scrub_stamp":"2024-09-12T01:04:53.181308+0000","last_deep_scrub":"268'460","last_deep_scrub_stamp":"2024-09-12T01:04:53.181308+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.181308+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:33.622967+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2390,"num_read_kb":2271,"num_write":519,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'367","reported_seq":1025,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.281782+0000","last_change":"2024-09-12T01:04:49.281782+0000","last_active":"2024-09-12T01:04:49.281782+0000","last_peered":"2024-09-12T01:04:49.281782+0000","last_clean":"2024-09-12T01:04:49.281782+0000","last_became_active":"2024-09-12T00:18:22.841689+0000","last_became_peered":"2024-09-12T00:18:22.841689+0000","last_unstale":"2024-09-12T01:04:49.281782+0000","last_undegraded":"2024-09-12T01:04:49.281782+0000","last_fullsized":"2024-09-12T01:04:49.281782+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'367","last_scrub_stamp":"2024-09-12T01:04:49.281537+0000","last_deep_scrub":"268'367","last_deep_scrub_stamp":"2024-09-12T01:04:49.281537+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.281537+0000","objects_scrubbed":6,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:15.412534+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194384,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":496,"num_read_kb":55770,"num_write":1160,"num_write_kb":35616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.393694+0000","last_change":"2024-09-12T01:05:01.393694+0000","last_active":"2024-09-12T01:05:01.393694+0000","last_peered":"2024-09-12T01:05:01.393694+0000","last_clean":"2024-09-12T01:05:01.393694+0000","last_became_active":"2024-09-12T00:18:26.845618+0000","last_became_peered":"2024-09-12T00:18:26.845618+0000","last_unstale":"2024-09-12T01:05:01.393694+0000","last_undegraded":"2024-09-12T01:05:01.393694+0000","last_fullsized":"2024-09-12T01:05:01.393694+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:01.393507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:01.393507+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.393507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:52.795216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'299","reported_seq":886,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.918791+0000","last_change":"2024-09-12T00:18:28.885743+0000","last_active":"2024-09-12T01:04:38.918791+0000","last_peered":"2024-09-12T01:04:38.918791+0000","last_clean":"2024-09-12T01:04:38.918791+0000","last_became_active":"2024-09-12T00:18:28.884044+0000","last_became_peered":"2024-09-12T00:18:28.884044+0000","last_unstale":"2024-09-12T01:04:38.918791+0000","last_undegraded":"2024-09-12T01:04:38.918791+0000","last_fullsized":"2024-09-12T01:04:38.918791+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:10.970556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53187,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":519,"num_read_kb":1172,"num_write":464,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":492,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:26.564933+0000","last_change":"2024-09-12T00:18:30.903530+0000","last_active":"2024-09-12T01:01:26.564933+0000","last_peered":"2024-09-12T01:01:26.564933+0000","last_clean":"2024-09-12T01:01:26.564933+0000","last_became_active":"2024-09-12T00:18:30.902697+0000","last_became_peered":"2024-09-12T00:18:30.902697+0000","last_unstale":"2024-09-12T01:01:26.564933+0000","last_undegraded":"2024-09-12T01:01:26.564933+0000","last_fullsized":"2024-09-12T01:01:26.564933+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:52.611643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'136","reported_seq":637,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:20.726584+0000","last_change":"2024-09-12T00:18:32.901132+0000","last_active":"2024-09-12T01:04:20.726584+0000","last_peered":"2024-09-12T01:04:20.726584+0000","last_clean":"2024-09-12T01:04:20.726584+0000","last_became_active":"2024-09-12T00:18:32.900235+0000","last_became_peered":"2024-09-12T00:18:32.900235+0000","last_unstale":"2024-09-12T01:04:20.726584+0000","last_undegraded":"2024-09-12T01:04:20.726584+0000","last_fullsized":"2024-09-12T01:04:20.726584+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:52.036568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":465,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":124,"num_read_kb":118,"num_write":347,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'437","reported_seq":2087,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.152400+0000","last_change":"2024-09-12T01:04:55.152400+0000","last_active":"2024-09-12T01:04:55.152400+0000","last_peered":"2024-09-12T01:04:55.152400+0000","last_clean":"2024-09-12T01:04:55.152400+0000","last_became_active":"2024-09-12T00:18:24.872637+0000","last_became_peered":"2024-09-12T00:18:24.872637+0000","last_unstale":"2024-09-12T01:04:55.152400+0000","last_undegraded":"2024-09-12T01:04:55.152400+0000","last_fullsized":"2024-09-12T01:04:55.152400+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'437","last_scrub_stamp":"2024-09-12T01:04:55.152221+0000","last_deep_scrub":"268'437","last_deep_scrub_stamp":"2024-09-12T01:04:55.152221+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.152221+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:56.856049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2400,"num_read_kb":2300,"num_write":500,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'358","reported_seq":1045,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.718500+0000","last_change":"2024-09-12T01:04:48.718500+0000","last_active":"2024-09-12T01:04:48.718500+0000","last_peered":"2024-09-12T01:04:48.718500+0000","last_clean":"2024-09-12T01:04:48.718500+0000","last_became_active":"2024-09-12T00:18:22.861450+0000","last_became_peered":"2024-09-12T00:18:22.861450+0000","last_unstale":"2024-09-12T01:04:48.718500+0000","last_undegraded":"2024-09-12T01:04:48.718500+0000","last_fullsized":"2024-09-12T01:04:48.718500+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'358","last_scrub_stamp":"2024-09-12T01:04:48.718246+0000","last_deep_scrub":"268'358","last_deep_scrub_stamp":"2024-09-12T01:04:48.718246+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.718246+0000","objects_scrubbed":9,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:43.073298+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":662355,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":585,"num_read_kb":32647,"num_write":1179,"num_write_kb":29925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.540215+0000","last_change":"2024-09-12T01:05:00.540215+0000","last_active":"2024-09-12T01:05:00.540215+0000","last_peered":"2024-09-12T01:05:00.540215+0000","last_clean":"2024-09-12T01:05:00.540215+0000","last_became_active":"2024-09-12T00:18:26.859109+0000","last_became_peered":"2024-09-12T00:18:26.859109+0000","last_unstale":"2024-09-12T01:05:00.540215+0000","last_undegraded":"2024-09-12T01:05:00.540215+0000","last_fullsized":"2024-09-12T01:05:00.540215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:00.540042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:00.540042+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.540042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:32.790029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'309","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.459268+0000","last_change":"2024-09-12T01:05:05.459268+0000","last_active":"2024-09-12T01:05:05.459268+0000","last_peered":"2024-09-12T01:05:05.459268+0000","last_clean":"2024-09-12T01:05:05.459268+0000","last_became_active":"2024-09-12T00:18:28.881947+0000","last_became_peered":"2024-09-12T00:18:28.881947+0000","last_unstale":"2024-09-12T01:05:05.459268+0000","last_undegraded":"2024-09-12T01:05:05.459268+0000","last_fullsized":"2024-09-12T01:05:05.459268+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'309","last_scrub_stamp":"2024-09-12T01:05:05.459045+0000","last_deep_scrub":"268'309","last_deep_scrub_stamp":"2024-09-12T01:05:05.459045+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.459045+0000","objects_scrubbed":7,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:15.066600+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45222,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":499,"num_read_kb":1119,"num_write":404,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'746","reported_seq":4324,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.484921+0000","last_change":"2024-09-12T01:05:04.484921+0000","last_active":"2024-09-12T01:05:04.484921+0000","last_peered":"2024-09-12T01:05:04.484921+0000","last_clean":"2024-09-12T01:05:04.484921+0000","last_became_active":"2024-09-12T00:18:30.872360+0000","last_became_peered":"2024-09-12T00:18:30.872360+0000","last_unstale":"2024-09-12T01:05:04.484921+0000","last_undegraded":"2024-09-12T01:05:04.484921+0000","last_fullsized":"2024-09-12T01:05:04.484921+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'746","last_scrub_stamp":"2024-09-12T01:05:04.484658+0000","last_deep_scrub":"268'746","last_deep_scrub_stamp":"2024-09-12T01:05:04.484658+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.484658+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":700,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:16.768023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'112","reported_seq":623,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.964702+0000","last_change":"2024-09-12T00:18:32.897273+0000","last_active":"2024-09-12T01:03:25.964702+0000","last_peered":"2024-09-12T01:03:25.964702+0000","last_clean":"2024-09-12T01:03:25.964702+0000","last_became_active":"2024-09-12T00:18:32.896338+0000","last_became_peered":"2024-09-12T00:18:32.896338+0000","last_unstale":"2024-09-12T01:03:25.964702+0000","last_undegraded":"2024-09-12T01:03:25.964702+0000","last_fullsized":"2024-09-12T01:03:25.964702+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:36.916435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":125,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'463","reported_seq":2021,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.172887+0000","last_change":"2024-09-12T01:04:56.172887+0000","last_active":"2024-09-12T01:04:56.172887+0000","last_peered":"2024-09-12T01:04:56.172887+0000","last_clean":"2024-09-12T01:04:56.172887+0000","last_became_active":"2024-09-12T00:18:24.879622+0000","last_became_peered":"2024-09-12T00:18:24.879622+0000","last_unstale":"2024-09-12T01:04:56.172887+0000","last_undegraded":"2024-09-12T01:04:56.172887+0000","last_fullsized":"2024-09-12T01:04:56.172887+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'463","last_scrub_stamp":"2024-09-12T01:04:56.172706+0000","last_deep_scrub":"268'463","last_deep_scrub_stamp":"2024-09-12T01:04:56.172706+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.172706+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:18.013381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2528,"num_read_kb":2373,"num_write":555,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'408","reported_seq":1113,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.190525+0000","last_change":"2024-09-12T01:04:47.190525+0000","last_active":"2024-09-12T01:04:47.190525+0000","last_peered":"2024-09-12T01:04:47.190525+0000","last_clean":"2024-09-12T01:04:47.190525+0000","last_became_active":"2024-09-12T00:18:22.847861+0000","last_became_peered":"2024-09-12T00:18:22.847861+0000","last_unstale":"2024-09-12T01:04:47.190525+0000","last_undegraded":"2024-09-12T01:04:47.190525+0000","last_fullsized":"2024-09-12T01:04:47.190525+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'408","last_scrub_stamp":"2024-09-12T01:04:47.190319+0000","last_deep_scrub":"268'408","last_deep_scrub_stamp":"2024-09-12T01:04:47.190319+0000","last_clean_scrub_stamp":"2024-09-12T01:04:47.190319+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:08.728064+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":711,"num_read_kb":61883,"num_write":1220,"num_write_kb":26157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1454,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.307415+0000","last_change":"2024-09-12T00:18:26.872031+0000","last_active":"2024-09-12T01:04:38.307415+0000","last_peered":"2024-09-12T01:04:38.307415+0000","last_clean":"2024-09-12T01:04:38.307415+0000","last_became_active":"2024-09-12T00:18:26.871356+0000","last_became_peered":"2024-09-12T00:18:26.871356+0000","last_unstale":"2024-09-12T01:04:38.307415+0000","last_undegraded":"2024-09-12T01:04:38.307415+0000","last_fullsized":"2024-09-12T01:04:38.307415+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:31.045577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'72","reported_seq":600,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:16.745058+0000","last_change":"2024-09-12T00:18:28.889216+0000","last_active":"2024-09-12T01:01:16.745058+0000","last_peered":"2024-09-12T01:01:16.745058+0000","last_clean":"2024-09-12T01:01:16.745058+0000","last_became_active":"2024-09-12T00:18:28.888423+0000","last_became_peered":"2024-09-12T00:18:28.888423+0000","last_unstale":"2024-09-12T01:01:16.745058+0000","last_undegraded":"2024-09-12T01:01:16.745058+0000","last_fullsized":"2024-09-12T01:01:16.745058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:38.462514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":78,"num_read_kb":72,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'768","reported_seq":2123,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.754750+0000","last_change":"2024-09-12T01:05:05.754750+0000","last_active":"2024-09-12T01:05:05.754750+0000","last_peered":"2024-09-12T01:05:05.754750+0000","last_clean":"2024-09-12T01:05:05.754750+0000","last_became_active":"2024-09-12T00:18:30.898814+0000","last_became_peered":"2024-09-12T00:18:30.898814+0000","last_unstale":"2024-09-12T01:05:05.754750+0000","last_undegraded":"2024-09-12T01:05:05.754750+0000","last_fullsized":"2024-09-12T01:05:05.754750+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'768","last_scrub_stamp":"2024-09-12T01:05:05.754569+0000","last_deep_scrub":"268'768","last_deep_scrub_stamp":"2024-09-12T01:05:05.754569+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.754569+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:36.497490+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'94","reported_seq":594,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.707747+0000","last_change":"2024-09-12T00:18:32.909724+0000","last_active":"2024-09-12T01:03:20.707747+0000","last_peered":"2024-09-12T01:03:20.707747+0000","last_clean":"2024-09-12T01:03:20.707747+0000","last_became_active":"2024-09-12T00:18:32.907797+0000","last_became_peered":"2024-09-12T00:18:32.907797+0000","last_unstale":"2024-09-12T01:03:20.707747+0000","last_undegraded":"2024-09-12T01:03:20.707747+0000","last_fullsized":"2024-09-12T01:03:20.707747+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:54.545857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":73,"num_write":219,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'510","reported_seq":2091,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.411066+0000","last_change":"2024-09-12T01:04:51.411066+0000","last_active":"2024-09-12T01:04:51.411066+0000","last_peered":"2024-09-12T01:04:51.411066+0000","last_clean":"2024-09-12T01:04:51.411066+0000","last_became_active":"2024-09-12T00:18:56.196419+0000","last_became_peered":"2024-09-12T00:18:56.196419+0000","last_unstale":"2024-09-12T01:04:51.411066+0000","last_undegraded":"2024-09-12T01:04:51.411066+0000","last_fullsized":"2024-09-12T01:04:51.411066+0000","mapping_epoch":37,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'510","last_scrub_stamp":"2024-09-12T01:04:51.410840+0000","last_deep_scrub":"268'510","last_deep_scrub_stamp":"2024-09-12T01:04:51.410840+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.410840+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:25.199103+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2644,"num_read_kb":2454,"num_write":619,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"268'409","reported_seq":1201,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.265266+0000","last_change":"2024-09-12T01:04:48.265266+0000","last_active":"2024-09-12T01:04:48.265266+0000","last_peered":"2024-09-12T01:04:48.265266+0000","last_clean":"2024-09-12T01:04:48.265266+0000","last_became_active":"2024-09-12T00:18:22.834072+0000","last_became_peered":"2024-09-12T00:18:22.834072+0000","last_unstale":"2024-09-12T01:04:48.265266+0000","last_undegraded":"2024-09-12T01:04:48.265266+0000","last_fullsized":"2024-09-12T01:04:48.265266+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'409","last_scrub_stamp":"2024-09-12T01:04:48.265165+0000","last_deep_scrub":"268'409","last_deep_scrub_stamp":"2024-09-12T01:04:48.265165+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.265165+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:03.330338+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":207192,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":853,"num_read_kb":11806,"num_write":1194,"num_write_kb":23298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.536055+0000","last_change":"2024-09-12T00:18:26.872530+0000","last_active":"2024-09-12T01:01:12.536055+0000","last_peered":"2024-09-12T01:01:12.536055+0000","last_clean":"2024-09-12T01:01:12.536055+0000","last_became_active":"2024-09-12T00:18:26.871183+0000","last_became_peered":"2024-09-12T00:18:26.871183+0000","last_unstale":"2024-09-12T01:01:12.536055+0000","last_undegraded":"2024-09-12T01:01:12.536055+0000","last_fullsized":"2024-09-12T01:01:12.536055+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:37.626693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'370","reported_seq":978,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.450673+0000","last_change":"2024-09-12T00:18:28.895040+0000","last_active":"2024-09-12T01:04:39.450673+0000","last_peered":"2024-09-12T01:04:39.450673+0000","last_clean":"2024-09-12T01:04:39.450673+0000","last_became_active":"2024-09-12T00:18:28.889343+0000","last_became_peered":"2024-09-12T00:18:28.889343+0000","last_unstale":"2024-09-12T01:04:39.450673+0000","last_undegraded":"2024-09-12T01:04:39.450673+0000","last_fullsized":"2024-09-12T01:04:39.450673+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:17.252099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45461,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1181,"num_read_kb":1792,"num_write":1688,"num_write_kb":1549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.754995+0000","last_change":"2024-09-12T01:05:04.754995+0000","last_active":"2024-09-12T01:05:04.754995+0000","last_peered":"2024-09-12T01:05:04.754995+0000","last_clean":"2024-09-12T01:05:04.754995+0000","last_became_active":"2024-09-12T00:18:30.905770+0000","last_became_peered":"2024-09-12T00:18:30.905770+0000","last_unstale":"2024-09-12T01:05:04.754995+0000","last_undegraded":"2024-09-12T01:05:04.754995+0000","last_fullsized":"2024-09-12T01:05:04.754995+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:04.754810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:04.754810+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.754810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:50.499923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'134","reported_seq":635,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.562136+0000","last_change":"2024-09-12T00:18:32.886440+0000","last_active":"2024-09-12T01:03:23.562136+0000","last_peered":"2024-09-12T01:03:23.562136+0000","last_clean":"2024-09-12T01:03:23.562136+0000","last_became_active":"2024-09-12T00:18:32.885619+0000","last_became_peered":"2024-09-12T00:18:32.885619+0000","last_unstale":"2024-09-12T01:03:23.562136+0000","last_undegraded":"2024-09-12T01:03:23.562136+0000","last_fullsized":"2024-09-12T01:03:23.562136+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:21.997695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":117,"num_write":301,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'771","reported_seq":2196,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.714075+0000","last_change":"2024-09-12T01:04:52.714075+0000","last_active":"2024-09-12T01:04:52.714075+0000","last_peered":"2024-09-12T01:04:52.714075+0000","last_clean":"2024-09-12T01:04:52.714075+0000","last_became_active":"2024-09-12T00:18:24.879462+0000","last_became_peered":"2024-09-12T00:18:24.879462+0000","last_unstale":"2024-09-12T01:04:52.714075+0000","last_undegraded":"2024-09-12T01:04:52.714075+0000","last_fullsized":"2024-09-12T01:04:52.714075+0000","mapping_epoch":26,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'771","last_scrub_stamp":"2024-09-12T01:04:52.713880+0000","last_deep_scrub":"268'771","last_deep_scrub_stamp":"2024-09-12T01:04:52.713880+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.713880+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:50.037991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3687,"num_read_kb":3308,"num_write":1074,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"268'74","reported_seq":625,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.387866+0000","last_change":"2024-09-12T01:04:48.387866+0000","last_active":"2024-09-12T01:04:48.387866+0000","last_peered":"2024-09-12T01:04:48.387866+0000","last_clean":"2024-09-12T01:04:48.387866+0000","last_became_active":"2024-09-12T00:18:03.924829+0000","last_became_peered":"2024-09-12T00:18:03.924829+0000","last_unstale":"2024-09-12T01:04:48.387866+0000","last_undegraded":"2024-09-12T01:04:48.387866+0000","last_fullsized":"2024-09-12T01:04:48.387866+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'74","last_scrub_stamp":"2024-09-12T01:04:48.387655+0000","last_deep_scrub":"268'74","last_deep_scrub_stamp":"2024-09-12T01:04:48.387655+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.387655+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:43.335462+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"268'2","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.534759+0000","last_change":"2024-09-12T01:04:47.534759+0000","last_active":"2024-09-12T01:04:47.534759+0000","last_peered":"2024-09-12T01:04:47.534759+0000","last_clean":"2024-09-12T01:04:47.534759+0000","last_became_active":"2024-09-12T00:18:08.644385+0000","last_became_peered":"2024-09-12T00:18:08.644385+0000","last_unstale":"2024-09-12T01:04:47.534759+0000","last_undegraded":"2024-09-12T01:04:47.534759+0000","last_fullsized":"2024-09-12T01:04:47.534759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:04:47.534572+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:04:47.534572+0000","last_clean_scrub_stamp":"2024-09-12T01:04:47.534572+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:43.103409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001156741,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'363","reported_seq":1020,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:46.290029+0000","last_change":"2024-09-12T01:04:46.290029+0000","last_active":"2024-09-12T01:04:46.290029+0000","last_peered":"2024-09-12T01:04:46.290029+0000","last_clean":"2024-09-12T01:04:46.290029+0000","last_became_active":"2024-09-12T00:18:22.867571+0000","last_became_peered":"2024-09-12T00:18:22.867571+0000","last_unstale":"2024-09-12T01:04:46.290029+0000","last_undegraded":"2024-09-12T01:04:46.290029+0000","last_fullsized":"2024-09-12T01:04:46.290029+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'363","last_scrub_stamp":"2024-09-12T01:04:46.289871+0000","last_deep_scrub":"268'363","last_deep_scrub_stamp":"2024-09-12T01:04:46.289871+0000","last_clean_scrub_stamp":"2024-09-12T01:04:46.289871+0000","objects_scrubbed":7,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:39.208915+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262231,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":470,"num_read_kb":26851,"num_write":1093,"num_write_kb":40025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.467331+0000","last_change":"2024-09-12T01:05:02.467331+0000","last_active":"2024-09-12T01:05:02.467331+0000","last_peered":"2024-09-12T01:05:02.467331+0000","last_clean":"2024-09-12T01:05:02.467331+0000","last_became_active":"2024-09-12T00:18:26.846668+0000","last_became_peered":"2024-09-12T00:18:26.846668+0000","last_unstale":"2024-09-12T01:05:02.467331+0000","last_undegraded":"2024-09-12T01:05:02.467331+0000","last_fullsized":"2024-09-12T01:05:02.467331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:02.467156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:02.467156+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.467156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:27.839432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'702","reported_seq":1414,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.916401+0000","last_change":"2024-09-12T00:18:28.887266+0000","last_active":"2024-09-12T01:04:39.916401+0000","last_peered":"2024-09-12T01:04:39.916401+0000","last_clean":"2024-09-12T01:04:39.916401+0000","last_became_active":"2024-09-12T00:18:28.885217+0000","last_became_peered":"2024-09-12T00:18:28.885217+0000","last_unstale":"2024-09-12T01:04:39.916401+0000","last_undegraded":"2024-09-12T01:04:39.916401+0000","last_fullsized":"2024-09-12T01:04:39.916401+0000","mapping_epoch":30,"log_start":"268'600","ondisk_log_start":"268'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":600,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:06.515258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190373,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1378,"num_read_kb":3232,"num_write":1266,"num_write_kb":1158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":493,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:51.570679+0000","last_change":"2024-09-12T00:18:30.899429+0000","last_active":"2024-09-12T01:01:51.570679+0000","last_peered":"2024-09-12T01:01:51.570679+0000","last_clean":"2024-09-12T01:01:51.570679+0000","last_became_active":"2024-09-12T00:18:30.898689+0000","last_became_peered":"2024-09-12T00:18:30.898689+0000","last_unstale":"2024-09-12T01:01:51.570679+0000","last_undegraded":"2024-09-12T01:01:51.570679+0000","last_fullsized":"2024-09-12T01:01:51.570679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:03.955121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'198","reported_seq":907,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.899528+0000","last_change":"2024-09-12T00:18:32.895955+0000","last_active":"2024-09-12T01:03:25.899528+0000","last_peered":"2024-09-12T01:03:25.899528+0000","last_clean":"2024-09-12T01:03:25.899528+0000","last_became_active":"2024-09-12T00:18:32.895239+0000","last_became_peered":"2024-09-12T00:18:32.895239+0000","last_unstale":"2024-09-12T01:03:25.899528+0000","last_undegraded":"2024-09-12T01:03:25.899528+0000","last_fullsized":"2024-09-12T01:03:25.899528+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:55.084809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1443,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":458,"num_write":434,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'489","reported_seq":2073,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.267998+0000","last_change":"2024-09-12T01:04:56.267998+0000","last_active":"2024-09-12T01:04:56.267998+0000","last_peered":"2024-09-12T01:04:56.267998+0000","last_clean":"2024-09-12T01:04:56.267998+0000","last_became_active":"2024-09-12T00:18:24.867067+0000","last_became_peered":"2024-09-12T00:18:24.867067+0000","last_unstale":"2024-09-12T01:04:56.267998+0000","last_undegraded":"2024-09-12T01:04:56.267998+0000","last_fullsized":"2024-09-12T01:04:56.267998+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'489","last_scrub_stamp":"2024-09-12T01:04:56.267771+0000","last_deep_scrub":"268'489","last_deep_scrub_stamp":"2024-09-12T01:04:56.267771+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.267771+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:04.695281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2524,"num_read_kb":2362,"num_write":607,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.421771+0000","last_change":"2024-09-12T01:04:50.421771+0000","last_active":"2024-09-12T01:04:50.421771+0000","last_peered":"2024-09-12T01:04:50.421771+0000","last_clean":"2024-09-12T01:04:50.421771+0000","last_became_active":"2024-09-12T00:18:08.646097+0000","last_became_peered":"2024-09-12T00:18:08.646097+0000","last_unstale":"2024-09-12T01:04:50.421771+0000","last_undegraded":"2024-09-12T01:04:50.421771+0000","last_fullsized":"2024-09-12T01:04:50.421771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:50.421588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:50.421588+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.421588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:10.736613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001003409,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'368","reported_seq":1039,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:46.266343+0000","last_change":"2024-09-12T01:04:46.266343+0000","last_active":"2024-09-12T01:04:46.266343+0000","last_peered":"2024-09-12T01:04:46.266343+0000","last_clean":"2024-09-12T01:04:46.266343+0000","last_became_active":"2024-09-12T00:18:22.857461+0000","last_became_peered":"2024-09-12T00:18:22.857461+0000","last_unstale":"2024-09-12T01:04:46.266343+0000","last_undegraded":"2024-09-12T01:04:46.266343+0000","last_fullsized":"2024-09-12T01:04:46.266343+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'368","last_scrub_stamp":"2024-09-12T01:04:46.266244+0000","last_deep_scrub":"268'368","last_deep_scrub_stamp":"2024-09-12T01:04:46.266244+0000","last_clean_scrub_stamp":"2024-09-12T01:04:46.266244+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:56.316874+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342049,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":576,"num_read_kb":72256,"num_write":1077,"num_write_kb":25510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:47.747024+0000","last_change":"2024-09-12T00:18:26.872369+0000","last_active":"2024-09-12T01:01:47.747024+0000","last_peered":"2024-09-12T01:01:47.747024+0000","last_clean":"2024-09-12T01:01:47.747024+0000","last_became_active":"2024-09-12T00:18:26.871674+0000","last_became_peered":"2024-09-12T00:18:26.871674+0000","last_unstale":"2024-09-12T01:01:47.747024+0000","last_undegraded":"2024-09-12T01:01:47.747024+0000","last_fullsized":"2024-09-12T01:01:47.747024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:53.162492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'1332","reported_seq":2850,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.595923+0000","last_change":"2024-09-12T01:05:05.595923+0000","last_active":"2024-09-12T01:05:05.595923+0000","last_peered":"2024-09-12T01:05:05.595923+0000","last_clean":"2024-09-12T01:05:05.595923+0000","last_became_active":"2024-09-12T00:18:28.889257+0000","last_became_peered":"2024-09-12T00:18:28.889257+0000","last_unstale":"2024-09-12T01:05:05.595923+0000","last_undegraded":"2024-09-12T01:05:05.595923+0000","last_fullsized":"2024-09-12T01:05:05.595923+0000","mapping_epoch":30,"log_start":"268'1301","ondisk_log_start":"268'1301","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1332","last_scrub_stamp":"2024-09-12T01:05:05.595699+0000","last_deep_scrub":"268'1332","last_deep_scrub_stamp":"2024-09-12T01:05:05.595699+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.595699+0000","objects_scrubbed":12,"log_size":31,"log_dups_size":1301,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:21.671487+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142532,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2119,"num_read_kb":4115,"num_write":1220,"num_write_kb":1054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":492,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:27.551882+0000","last_change":"2024-09-12T00:18:30.896021+0000","last_active":"2024-09-12T01:02:27.551882+0000","last_peered":"2024-09-12T01:02:27.551882+0000","last_clean":"2024-09-12T01:02:27.551882+0000","last_became_active":"2024-09-12T00:18:30.895305+0000","last_became_peered":"2024-09-12T00:18:30.895305+0000","last_unstale":"2024-09-12T01:02:27.551882+0000","last_undegraded":"2024-09-12T01:02:27.551882+0000","last_fullsized":"2024-09-12T01:02:27.551882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:43.210391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'203","reported_seq":730,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:06.553696+0000","last_change":"2024-09-12T00:18:32.888386+0000","last_active":"2024-09-12T01:02:06.553696+0000","last_peered":"2024-09-12T01:02:06.553696+0000","last_clean":"2024-09-12T01:02:06.553696+0000","last_became_active":"2024-09-12T00:18:32.887528+0000","last_became_peered":"2024-09-12T00:18:32.887528+0000","last_unstale":"2024-09-12T01:02:06.553696+0000","last_undegraded":"2024-09-12T01:02:06.553696+0000","last_fullsized":"2024-09-12T01:02:06.553696+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:38.435598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":310,"num_read_kb":309,"num_write":446,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'1283","reported_seq":3151,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.562364+0000","last_change":"2024-09-12T01:04:55.562364+0000","last_active":"2024-09-12T01:04:55.562364+0000","last_peered":"2024-09-12T01:04:55.562364+0000","last_clean":"2024-09-12T01:04:55.562364+0000","last_became_active":"2024-09-12T00:18:24.877964+0000","last_became_peered":"2024-09-12T00:18:24.877964+0000","last_unstale":"2024-09-12T01:04:55.562364+0000","last_undegraded":"2024-09-12T01:04:55.562364+0000","last_fullsized":"2024-09-12T01:04:55.562364+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1283","last_scrub_stamp":"2024-09-12T01:04:55.562178+0000","last_deep_scrub":"268'1283","last_deep_scrub_stamp":"2024-09-12T01:04:55.562178+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.562178+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":1200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:32.688184+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6082,"num_read_kb":5401,"num_write":1732,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4650,"num_omap_keys":19,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:45.470703+0000","last_change":"2024-09-12T01:04:45.470703+0000","last_active":"2024-09-12T01:04:45.470703+0000","last_peered":"2024-09-12T01:04:45.470703+0000","last_clean":"2024-09-12T01:04:45.470703+0000","last_became_active":"2024-09-12T00:18:08.874442+0000","last_became_peered":"2024-09-12T00:18:08.874442+0000","last_unstale":"2024-09-12T01:04:45.470703+0000","last_undegraded":"2024-09-12T01:04:45.470703+0000","last_fullsized":"2024-09-12T01:04:45.470703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:45.470576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:45.470576+0000","last_clean_scrub_stamp":"2024-09-12T01:04:45.470576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:41.288997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010707620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'375","reported_seq":1102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.584327+0000","last_change":"2024-09-12T01:04:47.584327+0000","last_active":"2024-09-12T01:04:47.584327+0000","last_peered":"2024-09-12T01:04:47.584327+0000","last_clean":"2024-09-12T01:04:47.584327+0000","last_became_active":"2024-09-12T00:18:22.834724+0000","last_became_peered":"2024-09-12T00:18:22.834724+0000","last_unstale":"2024-09-12T01:04:47.584327+0000","last_undegraded":"2024-09-12T01:04:47.584327+0000","last_fullsized":"2024-09-12T01:04:47.584327+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'375","last_scrub_stamp":"2024-09-12T01:04:47.584227+0000","last_deep_scrub":"268'375","last_deep_scrub_stamp":"2024-09-12T01:04:47.584227+0000","last_clean_scrub_stamp":"2024-09-12T01:04:47.584227+0000","objects_scrubbed":9,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:17.877057+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":674,"num_read_kb":9051,"num_write":1222,"num_write_kb":24587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"268'2","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.486013+0000","last_change":"2024-09-12T01:04:56.486013+0000","last_active":"2024-09-12T01:04:56.486013+0000","last_peered":"2024-09-12T01:04:56.486013+0000","last_clean":"2024-09-12T01:04:56.486013+0000","last_became_active":"2024-09-12T00:18:26.867343+0000","last_became_peered":"2024-09-12T00:18:26.867343+0000","last_unstale":"2024-09-12T01:04:56.486013+0000","last_undegraded":"2024-09-12T01:04:56.486013+0000","last_fullsized":"2024-09-12T01:04:56.486013+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:04:56.485822+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:04:56.485822+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.485822+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:33.613654+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'252","reported_seq":1356,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.962448+0000","last_change":"2024-09-12T00:18:28.892634+0000","last_active":"2024-09-12T01:04:31.962448+0000","last_peered":"2024-09-12T01:04:31.962448+0000","last_clean":"2024-09-12T01:04:31.962448+0000","last_became_active":"2024-09-12T00:18:28.889058+0000","last_became_peered":"2024-09-12T00:18:28.889058+0000","last_unstale":"2024-09-12T01:04:31.962448+0000","last_undegraded":"2024-09-12T01:04:31.962448+0000","last_fullsized":"2024-09-12T01:04:31.962448+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:46.530785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":190,"num_read_kb":179,"num_write":165,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":494,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:16.577209+0000","last_change":"2024-09-12T00:18:30.896789+0000","last_active":"2024-09-12T01:02:16.577209+0000","last_peered":"2024-09-12T01:02:16.577209+0000","last_clean":"2024-09-12T01:02:16.577209+0000","last_became_active":"2024-09-12T00:18:30.896073+0000","last_became_peered":"2024-09-12T00:18:30.896073+0000","last_unstale":"2024-09-12T01:02:16.577209+0000","last_undegraded":"2024-09-12T01:02:16.577209+0000","last_fullsized":"2024-09-12T01:02:16.577209+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:47.152911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'272","reported_seq":884,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.079029+0000","last_change":"2024-09-12T00:18:32.914870+0000","last_active":"2024-09-12T01:03:26.079029+0000","last_peered":"2024-09-12T01:03:26.079029+0000","last_clean":"2024-09-12T01:03:26.079029+0000","last_became_active":"2024-09-12T00:18:32.914004+0000","last_became_peered":"2024-09-12T00:18:32.914004+0000","last_unstale":"2024-09-12T01:03:26.079029+0000","last_undegraded":"2024-09-12T01:03:26.079029+0000","last_fullsized":"2024-09-12T01:03:26.079029+0000","mapping_epoch":34,"log_start":"268'200","ondisk_log_start":"268'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:37.374742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":517,"num_read_kb":535,"num_write":598,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'821","reported_seq":2386,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.584590+0000","last_change":"2024-09-12T01:04:54.584590+0000","last_active":"2024-09-12T01:04:54.584590+0000","last_peered":"2024-09-12T01:04:54.584590+0000","last_clean":"2024-09-12T01:04:54.584590+0000","last_became_active":"2024-09-12T00:18:24.869633+0000","last_became_peered":"2024-09-12T00:18:24.869633+0000","last_unstale":"2024-09-12T01:04:54.584590+0000","last_undegraded":"2024-09-12T01:04:54.584590+0000","last_fullsized":"2024-09-12T01:04:54.584590+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'821","last_scrub_stamp":"2024-09-12T01:04:54.584398+0000","last_deep_scrub":"268'821","last_deep_scrub_stamp":"2024-09-12T01:04:54.584398+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.584398+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:12.332775+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3879,"num_read_kb":3488,"num_write":1067,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"268'3","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.564570+0000","last_change":"2024-09-12T01:04:49.564570+0000","last_active":"2024-09-12T01:04:49.564570+0000","last_peered":"2024-09-12T01:04:49.564570+0000","last_clean":"2024-09-12T01:04:49.564570+0000","last_became_active":"2024-09-12T00:18:08.645156+0000","last_became_peered":"2024-09-12T00:18:08.645156+0000","last_unstale":"2024-09-12T01:04:49.564570+0000","last_undegraded":"2024-09-12T01:04:49.564570+0000","last_fullsized":"2024-09-12T01:04:49.564570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:04:49.564383+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:04:49.564383+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.564383+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:52.244469+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0024595709999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'395","reported_seq":1086,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.209032+0000","last_change":"2024-09-12T01:04:48.209032+0000","last_active":"2024-09-12T01:04:48.209032+0000","last_peered":"2024-09-12T01:04:48.209032+0000","last_clean":"2024-09-12T01:04:48.209032+0000","last_became_active":"2024-09-12T00:18:22.854940+0000","last_became_peered":"2024-09-12T00:18:22.854940+0000","last_unstale":"2024-09-12T01:04:48.209032+0000","last_undegraded":"2024-09-12T01:04:48.209032+0000","last_fullsized":"2024-09-12T01:04:48.209032+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'395","last_scrub_stamp":"2024-09-12T01:04:48.208822+0000","last_deep_scrub":"268'395","last_deep_scrub_stamp":"2024-09-12T01:04:48.208822+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.208822+0000","objects_scrubbed":8,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:04.445359+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7046756,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":598,"num_read_kb":32178,"num_write":1236,"num_write_kb":29732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.329680+0000","last_change":"2024-09-12T01:05:04.329680+0000","last_active":"2024-09-12T01:05:04.329680+0000","last_peered":"2024-09-12T01:05:04.329680+0000","last_clean":"2024-09-12T01:05:04.329680+0000","last_became_active":"2024-09-12T00:18:26.855239+0000","last_became_peered":"2024-09-12T00:18:26.855239+0000","last_unstale":"2024-09-12T01:05:04.329680+0000","last_undegraded":"2024-09-12T01:05:04.329680+0000","last_fullsized":"2024-09-12T01:05:04.329680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:04.329492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:04.329492+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.329492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:56.131898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'122","reported_seq":671,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:01.784399+0000","last_change":"2024-09-12T00:18:28.891881+0000","last_active":"2024-09-12T01:04:01.784399+0000","last_peered":"2024-09-12T01:04:01.784399+0000","last_clean":"2024-09-12T01:04:01.784399+0000","last_became_active":"2024-09-12T00:18:28.891173+0000","last_became_peered":"2024-09-12T00:18:28.891173+0000","last_unstale":"2024-09-12T01:04:01.784399+0000","last_undegraded":"2024-09-12T01:04:01.784399+0000","last_fullsized":"2024-09-12T01:04:01.784399+0000","mapping_epoch":30,"log_start":"268'100","ondisk_log_start":"268'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:02.040523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":142,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.708410+0000","last_change":"2024-09-12T01:05:03.708410+0000","last_active":"2024-09-12T01:05:03.708410+0000","last_peered":"2024-09-12T01:05:03.708410+0000","last_clean":"2024-09-12T01:05:03.708410+0000","last_became_active":"2024-09-12T00:18:30.904080+0000","last_became_peered":"2024-09-12T00:18:30.904080+0000","last_unstale":"2024-09-12T01:05:03.708410+0000","last_undegraded":"2024-09-12T01:05:03.708410+0000","last_fullsized":"2024-09-12T01:05:03.708410+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:03.708236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:03.708236+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.708236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:54.206218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'108","reported_seq":658,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.275864+0000","last_change":"2024-09-12T00:18:32.905383+0000","last_active":"2024-09-12T01:02:54.275864+0000","last_peered":"2024-09-12T01:02:54.275864+0000","last_clean":"2024-09-12T01:02:54.275864+0000","last_became_active":"2024-09-12T00:18:32.903109+0000","last_became_peered":"2024-09-12T00:18:32.903109+0000","last_unstale":"2024-09-12T01:02:54.275864+0000","last_undegraded":"2024-09-12T01:02:54.275864+0000","last_fullsized":"2024-09-12T01:02:54.275864+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:48.630615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":206,"num_read_kb":202,"num_write":268,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'474","reported_seq":1995,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.604762+0000","last_change":"2024-09-12T01:04:56.604762+0000","last_active":"2024-09-12T01:04:56.604762+0000","last_peered":"2024-09-12T01:04:56.604762+0000","last_clean":"2024-09-12T01:04:56.604762+0000","last_became_active":"2024-09-12T00:18:24.878031+0000","last_became_peered":"2024-09-12T00:18:24.878031+0000","last_unstale":"2024-09-12T01:04:56.604762+0000","last_undegraded":"2024-09-12T01:04:56.604762+0000","last_fullsized":"2024-09-12T01:04:56.604762+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'474","last_scrub_stamp":"2024-09-12T01:04:56.604574+0000","last_deep_scrub":"268'474","last_deep_scrub_stamp":"2024-09-12T01:04:56.604574+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.604574+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:32.788784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2325,"num_read_kb":2173,"num_write":541,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'312","reported_seq":934,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.530946+0000","last_change":"2024-09-12T01:04:50.530946+0000","last_active":"2024-09-12T01:04:50.530946+0000","last_peered":"2024-09-12T01:04:50.530946+0000","last_clean":"2024-09-12T01:04:50.530946+0000","last_became_active":"2024-09-12T00:18:22.861336+0000","last_became_peered":"2024-09-12T00:18:22.861336+0000","last_unstale":"2024-09-12T01:04:50.530946+0000","last_undegraded":"2024-09-12T01:04:50.530946+0000","last_fullsized":"2024-09-12T01:04:50.530946+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'312","last_scrub_stamp":"2024-09-12T01:04:50.530749+0000","last_deep_scrub":"268'312","last_deep_scrub_stamp":"2024-09-12T01:04:50.530749+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.530749+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:38.701302+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194334,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":409,"num_read_kb":16866,"num_write":952,"num_write_kb":39669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":539,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:46.542394+0000","last_change":"2024-09-12T01:04:46.542394+0000","last_active":"2024-09-12T01:04:46.542394+0000","last_peered":"2024-09-12T01:04:46.542394+0000","last_clean":"2024-09-12T01:04:46.542394+0000","last_became_active":"2024-09-12T00:18:08.956785+0000","last_became_peered":"2024-09-12T00:18:08.956785+0000","last_unstale":"2024-09-12T01:04:46.542394+0000","last_undegraded":"2024-09-12T01:04:46.542394+0000","last_fullsized":"2024-09-12T01:04:46.542394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:46.542326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:46.542326+0000","last_clean_scrub_stamp":"2024-09-12T01:04:46.542326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:00.080671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012417909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.367455+0000","last_change":"2024-09-12T01:05:03.367455+0000","last_active":"2024-09-12T01:05:03.367455+0000","last_peered":"2024-09-12T01:05:03.367455+0000","last_clean":"2024-09-12T01:05:03.367455+0000","last_became_active":"2024-09-12T00:18:26.879511+0000","last_became_peered":"2024-09-12T00:18:26.879511+0000","last_unstale":"2024-09-12T01:05:03.367455+0000","last_undegraded":"2024-09-12T01:05:03.367455+0000","last_fullsized":"2024-09-12T01:05:03.367455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:03.367276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:03.367276+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.367276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:35.236252+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'562","reported_seq":1241,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.968654+0000","last_change":"2024-09-12T00:18:28.880341+0000","last_active":"2024-09-12T01:04:39.968654+0000","last_peered":"2024-09-12T01:04:39.968654+0000","last_clean":"2024-09-12T01:04:39.968654+0000","last_became_active":"2024-09-12T00:18:28.879614+0000","last_became_peered":"2024-09-12T00:18:28.879614+0000","last_unstale":"2024-09-12T01:04:39.968654+0000","last_undegraded":"2024-09-12T01:04:39.968654+0000","last_fullsized":"2024-09-12T01:04:39.968654+0000","mapping_epoch":30,"log_start":"268'500","ondisk_log_start":"268'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:03.149386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100174,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":946,"num_read_kb":2084,"num_write":804,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:17.552865+0000","last_change":"2024-09-12T00:18:30.904154+0000","last_active":"2024-09-12T01:02:17.552865+0000","last_peered":"2024-09-12T01:02:17.552865+0000","last_clean":"2024-09-12T01:02:17.552865+0000","last_became_active":"2024-09-12T00:18:30.903532+0000","last_became_peered":"2024-09-12T00:18:30.903532+0000","last_unstale":"2024-09-12T01:02:17.552865+0000","last_undegraded":"2024-09-12T01:02:17.552865+0000","last_fullsized":"2024-09-12T01:02:17.552865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:56.341364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'142","reported_seq":649,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.969443+0000","last_change":"2024-09-12T00:18:32.897568+0000","last_active":"2024-09-12T01:03:25.969443+0000","last_peered":"2024-09-12T01:03:25.969443+0000","last_clean":"2024-09-12T01:03:25.969443+0000","last_became_active":"2024-09-12T00:18:32.896532+0000","last_became_peered":"2024-09-12T00:18:32.896532+0000","last_unstale":"2024-09-12T01:03:25.969443+0000","last_undegraded":"2024-09-12T01:03:25.969443+0000","last_fullsized":"2024-09-12T01:03:25.969443+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:19.854551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":138,"num_write":339,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'365","reported_seq":1912,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.176764+0000","last_change":"2024-09-12T01:04:53.176764+0000","last_active":"2024-09-12T01:04:53.176764+0000","last_peered":"2024-09-12T01:04:53.176764+0000","last_clean":"2024-09-12T01:04:53.176764+0000","last_became_active":"2024-09-12T00:18:24.852620+0000","last_became_peered":"2024-09-12T00:18:24.852620+0000","last_unstale":"2024-09-12T01:04:53.176764+0000","last_undegraded":"2024-09-12T01:04:53.176764+0000","last_fullsized":"2024-09-12T01:04:53.176764+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'365","last_scrub_stamp":"2024-09-12T01:04:53.176561+0000","last_deep_scrub":"268'365","last_deep_scrub_stamp":"2024-09-12T01:04:53.176561+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.176561+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:08.338535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2109,"num_read_kb":2037,"num_write":400,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'349","reported_seq":1003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.521739+0000","last_change":"2024-09-12T01:04:49.521739+0000","last_active":"2024-09-12T01:04:49.521739+0000","last_peered":"2024-09-12T01:04:49.521739+0000","last_clean":"2024-09-12T01:04:49.521739+0000","last_became_active":"2024-09-12T00:18:22.839001+0000","last_became_peered":"2024-09-12T00:18:22.839001+0000","last_unstale":"2024-09-12T01:04:49.521739+0000","last_undegraded":"2024-09-12T01:04:49.521739+0000","last_fullsized":"2024-09-12T01:04:49.521739+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'349","last_scrub_stamp":"2024-09-12T01:04:49.521528+0000","last_deep_scrub":"268'349","last_deep_scrub_stamp":"2024-09-12T01:04:49.521528+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.521528+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:43.868981+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":481,"num_read_kb":59946,"num_write":977,"num_write_kb":34875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.373441+0000","last_change":"2024-09-12T01:04:49.373441+0000","last_active":"2024-09-12T01:04:49.373441+0000","last_peered":"2024-09-12T01:04:49.373441+0000","last_clean":"2024-09-12T01:04:49.373441+0000","last_became_active":"2024-09-12T00:18:08.958069+0000","last_became_peered":"2024-09-12T00:18:08.958069+0000","last_unstale":"2024-09-12T01:04:49.373441+0000","last_undegraded":"2024-09-12T01:04:49.373441+0000","last_fullsized":"2024-09-12T01:04:49.373441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:49.373275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:49.373275+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.373275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:16.974812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001047189,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.627037+0000","last_change":"2024-09-12T01:05:00.627037+0000","last_active":"2024-09-12T01:05:00.627037+0000","last_peered":"2024-09-12T01:05:00.627037+0000","last_clean":"2024-09-12T01:05:00.627037+0000","last_became_active":"2024-09-12T00:18:26.865743+0000","last_became_peered":"2024-09-12T00:18:26.865743+0000","last_unstale":"2024-09-12T01:05:00.627037+0000","last_undegraded":"2024-09-12T01:05:00.627037+0000","last_fullsized":"2024-09-12T01:05:00.627037+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:00.626750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:00.626750+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.626750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:33.255245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'172","reported_seq":757,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.595331+0000","last_change":"2024-09-12T01:05:04.595331+0000","last_active":"2024-09-12T01:05:04.595331+0000","last_peered":"2024-09-12T01:05:04.595331+0000","last_clean":"2024-09-12T01:05:04.595331+0000","last_became_active":"2024-09-12T00:18:28.877233+0000","last_became_peered":"2024-09-12T00:18:28.877233+0000","last_unstale":"2024-09-12T01:05:04.595331+0000","last_undegraded":"2024-09-12T01:05:04.595331+0000","last_fullsized":"2024-09-12T01:05:04.595331+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'172","last_scrub_stamp":"2024-09-12T01:05:04.595140+0000","last_deep_scrub":"268'172","last_deep_scrub_stamp":"2024-09-12T01:05:04.595140+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.595140+0000","objects_scrubbed":8,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:08.053394+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":206,"num_read_kb":196,"num_write":136,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'792","reported_seq":2607,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.148610+0000","last_change":"2024-09-12T00:18:30.874256+0000","last_active":"2024-09-12T01:04:40.148610+0000","last_peered":"2024-09-12T01:04:40.148610+0000","last_clean":"2024-09-12T01:04:40.148610+0000","last_became_active":"2024-09-12T00:18:30.873484+0000","last_became_peered":"2024-09-12T00:18:30.873484+0000","last_unstale":"2024-09-12T01:04:40.148610+0000","last_undegraded":"2024-09-12T01:04:40.148610+0000","last_fullsized":"2024-09-12T01:04:40.148610+0000","mapping_epoch":32,"log_start":"268'702","ondisk_log_start":"268'702","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":702,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:48.826950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'163","reported_seq":681,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.836361+0000","last_change":"2024-09-12T00:18:32.894083+0000","last_active":"2024-09-12T01:04:30.836361+0000","last_peered":"2024-09-12T01:04:30.836361+0000","last_clean":"2024-09-12T01:04:30.836361+0000","last_became_active":"2024-09-12T00:18:32.893315+0000","last_became_peered":"2024-09-12T00:18:32.893315+0000","last_unstale":"2024-09-12T01:04:30.836361+0000","last_undegraded":"2024-09-12T01:04:30.836361+0000","last_fullsized":"2024-09-12T01:04:30.836361+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:09.991201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":201,"num_read_kb":185,"num_write":395,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'453","reported_seq":2025,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.185147+0000","last_change":"2024-09-12T01:04:56.185147+0000","last_active":"2024-09-12T01:04:56.185147+0000","last_peered":"2024-09-12T01:04:56.185147+0000","last_clean":"2024-09-12T01:04:56.185147+0000","last_became_active":"2024-09-12T00:18:24.865603+0000","last_became_peered":"2024-09-12T00:18:24.865603+0000","last_unstale":"2024-09-12T01:04:56.185147+0000","last_undegraded":"2024-09-12T01:04:56.185147+0000","last_fullsized":"2024-09-12T01:04:56.185147+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'453","last_scrub_stamp":"2024-09-12T01:04:56.184924+0000","last_deep_scrub":"268'453","last_deep_scrub_stamp":"2024-09-12T01:04:56.184924+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.184924+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:02.597927+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2591,"num_read_kb":2430,"num_write":539,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'362","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.313725+0000","last_change":"2024-09-12T01:04:47.313725+0000","last_active":"2024-09-12T01:04:47.313725+0000","last_peered":"2024-09-12T01:04:47.313725+0000","last_clean":"2024-09-12T01:04:47.313725+0000","last_became_active":"2024-09-12T00:18:22.870180+0000","last_became_peered":"2024-09-12T00:18:22.870180+0000","last_unstale":"2024-09-12T01:04:47.313725+0000","last_undegraded":"2024-09-12T01:04:47.313725+0000","last_fullsized":"2024-09-12T01:04:47.313725+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'362","last_scrub_stamp":"2024-09-12T01:04:47.313542+0000","last_deep_scrub":"268'362","last_deep_scrub_stamp":"2024-09-12T01:04:47.313542+0000","last_clean_scrub_stamp":"2024-09-12T01:04:47.313542+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:20.898497+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":450,"num_read_kb":16363,"num_write":1061,"num_write_kb":31356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":538,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:45.528242+0000","last_change":"2024-09-12T01:04:45.528242+0000","last_active":"2024-09-12T01:04:45.528242+0000","last_peered":"2024-09-12T01:04:45.528242+0000","last_clean":"2024-09-12T01:04:45.528242+0000","last_became_active":"2024-09-12T00:18:08.638003+0000","last_became_peered":"2024-09-12T00:18:08.638003+0000","last_unstale":"2024-09-12T01:04:45.528242+0000","last_undegraded":"2024-09-12T01:04:45.528242+0000","last_fullsized":"2024-09-12T01:04:45.528242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:45.528131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:45.528131+0000","last_clean_scrub_stamp":"2024-09-12T01:04:45.528131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:02.250802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010953429999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.549583+0000","last_change":"2024-09-12T00:18:26.859001+0000","last_active":"2024-09-12T01:02:12.549583+0000","last_peered":"2024-09-12T01:02:12.549583+0000","last_clean":"2024-09-12T01:02:12.549583+0000","last_became_active":"2024-09-12T00:18:26.858300+0000","last_became_peered":"2024-09-12T00:18:26.858300+0000","last_unstale":"2024-09-12T01:02:12.549583+0000","last_undegraded":"2024-09-12T01:02:12.549583+0000","last_fullsized":"2024-09-12T01:02:12.549583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:24.947974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'109","reported_seq":658,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:17.552956+0000","last_change":"2024-09-12T00:18:28.882042+0000","last_active":"2024-09-12T01:02:17.552956+0000","last_peered":"2024-09-12T01:02:17.552956+0000","last_clean":"2024-09-12T01:02:17.552956+0000","last_became_active":"2024-09-12T00:18:28.880684+0000","last_became_peered":"2024-09-12T00:18:28.880684+0000","last_unstale":"2024-09-12T01:02:17.552956+0000","last_undegraded":"2024-09-12T01:02:17.552956+0000","last_fullsized":"2024-09-12T01:02:17.552956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:05.919489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'816","reported_seq":2641,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.564873+0000","last_change":"2024-09-12T00:18:30.903318+0000","last_active":"2024-09-12T01:04:38.564873+0000","last_peered":"2024-09-12T01:04:38.564873+0000","last_clean":"2024-09-12T01:04:38.564873+0000","last_became_active":"2024-09-12T00:18:30.902580+0000","last_became_peered":"2024-09-12T00:18:30.902580+0000","last_unstale":"2024-09-12T01:04:38.564873+0000","last_undegraded":"2024-09-12T01:04:38.564873+0000","last_fullsized":"2024-09-12T01:04:38.564873+0000","mapping_epoch":32,"log_start":"268'800","ondisk_log_start":"268'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:13.015304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'173","reported_seq":673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:24.492347+0000","last_change":"2024-09-12T00:18:32.903845+0000","last_active":"2024-09-12T01:03:24.492347+0000","last_peered":"2024-09-12T01:03:24.492347+0000","last_clean":"2024-09-12T01:03:24.492347+0000","last_became_active":"2024-09-12T00:18:32.902970+0000","last_became_peered":"2024-09-12T00:18:32.902970+0000","last_unstale":"2024-09-12T01:03:24.492347+0000","last_undegraded":"2024-09-12T01:03:24.492347+0000","last_fullsized":"2024-09-12T01:03:24.492347+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:29.969603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":388,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'597","reported_seq":2178,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.221206+0000","last_change":"2024-09-12T01:04:52.221206+0000","last_active":"2024-09-12T01:04:52.221206+0000","last_peered":"2024-09-12T01:04:52.221206+0000","last_clean":"2024-09-12T01:04:52.221206+0000","last_became_active":"2024-09-12T00:18:24.879205+0000","last_became_peered":"2024-09-12T00:18:24.879205+0000","last_unstale":"2024-09-12T01:04:52.221206+0000","last_undegraded":"2024-09-12T01:04:52.221206+0000","last_fullsized":"2024-09-12T01:04:52.221206+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'597","last_scrub_stamp":"2024-09-12T01:04:52.220980+0000","last_deep_scrub":"268'597","last_deep_scrub_stamp":"2024-09-12T01:04:52.220980+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.220980+0000","objects_scrubbed":9,"log_size":97,"log_dups_size":500,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:56.848160+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":3160,"num_read_kb":2876,"num_write":787,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2409,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'346","reported_seq":1075,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:45.268249+0000","last_change":"2024-09-12T01:04:45.268249+0000","last_active":"2024-09-12T01:04:45.268249+0000","last_peered":"2024-09-12T01:04:45.268249+0000","last_clean":"2024-09-12T01:04:45.268249+0000","last_became_active":"2024-09-12T00:18:22.850326+0000","last_became_peered":"2024-09-12T00:18:22.850326+0000","last_unstale":"2024-09-12T01:04:45.268249+0000","last_undegraded":"2024-09-12T01:04:45.268249+0000","last_fullsized":"2024-09-12T01:04:45.268249+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'346","last_scrub_stamp":"2024-09-12T01:04:45.268124+0000","last_deep_scrub":"268'346","last_deep_scrub_stamp":"2024-09-12T01:04:45.268124+0000","last_clean_scrub_stamp":"2024-09-12T01:04:45.268124+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:15.830198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":560,"num_read_kb":1535,"num_write":1060,"num_write_kb":23375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.744967+0000","last_change":"2024-09-12T01:04:47.744967+0000","last_active":"2024-09-12T01:04:47.744967+0000","last_peered":"2024-09-12T01:04:47.744967+0000","last_clean":"2024-09-12T01:04:47.744967+0000","last_became_active":"2024-09-12T00:18:08.648187+0000","last_became_peered":"2024-09-12T00:18:08.648187+0000","last_unstale":"2024-09-12T01:04:47.744967+0000","last_undegraded":"2024-09-12T01:04:47.744967+0000","last_fullsized":"2024-09-12T01:04:47.744967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:47.744772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:47.744772+0000","last_clean_scrub_stamp":"2024-09-12T01:04:47.744772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:48.648305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001130048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:31.765082+0000","last_change":"2024-09-12T00:18:26.851380+0000","last_active":"2024-09-12T01:02:31.765082+0000","last_peered":"2024-09-12T01:02:31.765082+0000","last_clean":"2024-09-12T01:02:31.765082+0000","last_became_active":"2024-09-12T00:18:26.851038+0000","last_became_peered":"2024-09-12T00:18:26.851038+0000","last_unstale":"2024-09-12T01:02:31.765082+0000","last_undegraded":"2024-09-12T01:02:31.765082+0000","last_fullsized":"2024-09-12T01:02:31.765082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:34.120180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'749","reported_seq":1475,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.360881+0000","last_change":"2024-09-12T00:18:28.885754+0000","last_active":"2024-09-12T01:04:39.360881+0000","last_peered":"2024-09-12T01:04:39.360881+0000","last_clean":"2024-09-12T01:04:39.360881+0000","last_became_active":"2024-09-12T00:18:28.884726+0000","last_became_peered":"2024-09-12T00:18:28.884726+0000","last_unstale":"2024-09-12T01:04:39.360881+0000","last_undegraded":"2024-09-12T01:04:39.360881+0000","last_fullsized":"2024-09-12T01:04:39.360881+0000","mapping_epoch":30,"log_start":"268'700","ondisk_log_start":"268'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:33.539730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153841,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1337,"num_read_kb":3208,"num_write":1092,"num_write_kb":920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:16.760930+0000","last_change":"2024-09-12T00:18:30.902052+0000","last_active":"2024-09-12T01:02:16.760930+0000","last_peered":"2024-09-12T01:02:16.760930+0000","last_clean":"2024-09-12T01:02:16.760930+0000","last_became_active":"2024-09-12T00:18:30.900777+0000","last_became_peered":"2024-09-12T00:18:30.900777+0000","last_unstale":"2024-09-12T01:02:16.760930+0000","last_undegraded":"2024-09-12T01:02:16.760930+0000","last_fullsized":"2024-09-12T01:02:16.760930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:05.763516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'111","reported_seq":608,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.877760+0000","last_change":"2024-09-12T00:18:32.900574+0000","last_active":"2024-09-12T01:03:25.877760+0000","last_peered":"2024-09-12T01:03:25.877760+0000","last_clean":"2024-09-12T01:03:25.877760+0000","last_became_active":"2024-09-12T00:18:32.899881+0000","last_became_peered":"2024-09-12T00:18:32.899881+0000","last_unstale":"2024-09-12T01:03:25.877760+0000","last_undegraded":"2024-09-12T01:03:25.877760+0000","last_fullsized":"2024-09-12T01:03:25.877760+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:39.617551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":105,"num_write":264,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'146","reported_seq":709,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.030418+0000","last_change":"2024-09-12T00:18:32.904423+0000","last_active":"2024-09-12T01:03:26.030418+0000","last_peered":"2024-09-12T01:03:26.030418+0000","last_clean":"2024-09-12T01:03:26.030418+0000","last_became_active":"2024-09-12T00:18:32.902596+0000","last_became_peered":"2024-09-12T00:18:32.902596+0000","last_unstale":"2024-09-12T01:03:26.030418+0000","last_undegraded":"2024-09-12T01:03:26.030418+0000","last_fullsized":"2024-09-12T01:03:26.030418+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:15.240829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":238,"num_read_kb":229,"num_write":342,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'487","reported_seq":2119,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.218217+0000","last_change":"2024-09-12T01:04:57.217970+0000","last_active":"2024-09-12T01:04:57.218217+0000","last_peered":"2024-09-12T01:04:57.218217+0000","last_clean":"2024-09-12T01:04:57.218217+0000","last_became_active":"2024-09-12T00:18:24.879640+0000","last_became_peered":"2024-09-12T00:18:24.879640+0000","last_unstale":"2024-09-12T01:04:57.218217+0000","last_undegraded":"2024-09-12T01:04:57.218217+0000","last_fullsized":"2024-09-12T01:04:57.218217+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'487","last_scrub_stamp":"2024-09-12T01:04:57.217724+0000","last_deep_scrub":"268'487","last_deep_scrub_stamp":"2024-09-12T01:04:57.217724+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.217724+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:38.656659+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2579,"num_read_kb":2446,"num_write":588,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'391","reported_seq":1050,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.218588+0000","last_change":"2024-09-12T01:04:49.218588+0000","last_active":"2024-09-12T01:04:49.218588+0000","last_peered":"2024-09-12T01:04:49.218588+0000","last_clean":"2024-09-12T01:04:49.218588+0000","last_became_active":"2024-09-12T00:18:22.874059+0000","last_became_peered":"2024-09-12T00:18:22.874059+0000","last_unstale":"2024-09-12T01:04:49.218588+0000","last_undegraded":"2024-09-12T01:04:49.218588+0000","last_fullsized":"2024-09-12T01:04:49.218588+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'391","last_scrub_stamp":"2024-09-12T01:04:49.218318+0000","last_deep_scrub":"268'391","last_deep_scrub_stamp":"2024-09-12T01:04:49.218318+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.218318+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:02.132035+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":563,"num_read_kb":19542,"num_write":1220,"num_write_kb":37354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.571812+0000","last_change":"2024-09-12T01:05:01.571742+0000","last_active":"2024-09-12T01:05:01.571812+0000","last_peered":"2024-09-12T01:05:01.571812+0000","last_clean":"2024-09-12T01:05:01.571812+0000","last_became_active":"2024-09-12T00:18:26.866940+0000","last_became_peered":"2024-09-12T00:18:26.866940+0000","last_unstale":"2024-09-12T01:05:01.571812+0000","last_undegraded":"2024-09-12T01:05:01.571812+0000","last_fullsized":"2024-09-12T01:05:01.571812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:01.571641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:01.571641+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.571641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:47.206432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'294","reported_seq":882,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.624803+0000","last_change":"2024-09-12T00:18:28.878607+0000","last_active":"2024-09-12T01:04:39.624803+0000","last_peered":"2024-09-12T01:04:39.624803+0000","last_clean":"2024-09-12T01:04:39.624803+0000","last_became_active":"2024-09-12T00:18:28.877560+0000","last_became_peered":"2024-09-12T00:18:28.877560+0000","last_unstale":"2024-09-12T01:04:39.624803+0000","last_undegraded":"2024-09-12T01:04:39.624803+0000","last_fullsized":"2024-09-12T01:04:39.624803+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:45.619406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44815,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":481,"num_read_kb":1100,"num_write":392,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:31.733041+0000","last_change":"2024-09-12T00:18:30.903541+0000","last_active":"2024-09-12T01:00:31.733041+0000","last_peered":"2024-09-12T01:00:31.733041+0000","last_clean":"2024-09-12T01:00:31.733041+0000","last_became_active":"2024-09-12T00:18:30.901022+0000","last_became_peered":"2024-09-12T00:18:30.901022+0000","last_unstale":"2024-09-12T01:00:31.733041+0000","last_undegraded":"2024-09-12T01:00:31.733041+0000","last_fullsized":"2024-09-12T01:00:31.733041+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:14.300352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'140","reported_seq":654,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.209313+0000","last_change":"2024-09-12T00:18:32.901918+0000","last_active":"2024-09-12T01:03:01.209313+0000","last_peered":"2024-09-12T01:03:01.209313+0000","last_clean":"2024-09-12T01:03:01.209313+0000","last_became_active":"2024-09-12T00:18:32.900434+0000","last_became_peered":"2024-09-12T00:18:32.900434+0000","last_unstale":"2024-09-12T01:03:01.209313+0000","last_undegraded":"2024-09-12T01:03:01.209313+0000","last_fullsized":"2024-09-12T01:03:01.209313+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:49.600913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":83,"num_write":305,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'546","reported_seq":1971,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.579599+0000","last_change":"2024-09-12T01:04:58.579473+0000","last_active":"2024-09-12T01:04:58.579599+0000","last_peered":"2024-09-12T01:04:58.579599+0000","last_clean":"2024-09-12T01:04:58.579599+0000","last_became_active":"2024-09-12T00:18:24.878531+0000","last_became_peered":"2024-09-12T00:18:24.878531+0000","last_unstale":"2024-09-12T01:04:58.579599+0000","last_undegraded":"2024-09-12T01:04:58.579599+0000","last_fullsized":"2024-09-12T01:04:58.579599+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'546","last_scrub_stamp":"2024-09-12T01:04:58.579295+0000","last_deep_scrub":"268'546","last_deep_scrub_stamp":"2024-09-12T01:04:58.579295+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.579295+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:45.810541+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2546,"num_read_kb":2313,"num_write":710,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'415","reported_seq":1145,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.472885+0000","last_change":"2024-09-12T01:04:56.472885+0000","last_active":"2024-09-12T01:04:56.472885+0000","last_peered":"2024-09-12T01:04:56.472885+0000","last_clean":"2024-09-12T01:04:56.472885+0000","last_became_active":"2024-09-12T00:18:56.193958+0000","last_became_peered":"2024-09-12T00:18:56.193958+0000","last_unstale":"2024-09-12T01:04:56.472885+0000","last_undegraded":"2024-09-12T01:04:56.472885+0000","last_fullsized":"2024-09-12T01:04:56.472885+0000","mapping_epoch":37,"log_start":"268'400","ondisk_log_start":"268'400","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'415","last_scrub_stamp":"2024-09-12T01:04:56.472681+0000","last_deep_scrub":"268'415","last_deep_scrub_stamp":"2024-09-12T01:04:56.472681+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.472681+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:48.615635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":783,"num_read_kb":16311,"num_write":1252,"num_write_kb":28883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.040560+0000","last_change":"2024-09-12T01:05:04.040415+0000","last_active":"2024-09-12T01:05:04.040560+0000","last_peered":"2024-09-12T01:05:04.040560+0000","last_clean":"2024-09-12T01:05:04.040560+0000","last_became_active":"2024-09-12T00:18:26.852430+0000","last_became_peered":"2024-09-12T00:18:26.852430+0000","last_unstale":"2024-09-12T01:05:04.040560+0000","last_undegraded":"2024-09-12T01:05:04.040560+0000","last_fullsized":"2024-09-12T01:05:04.040560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:04.040228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:04.040228+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.040228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:38.093851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'47","reported_seq":552,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:16.496467+0000","last_change":"2024-09-12T00:18:28.889342+0000","last_active":"2024-09-12T01:02:16.496467+0000","last_peered":"2024-09-12T01:02:16.496467+0000","last_clean":"2024-09-12T01:02:16.496467+0000","last_became_active":"2024-09-12T00:18:28.888625+0000","last_became_peered":"2024-09-12T00:18:28.888625+0000","last_unstale":"2024-09-12T01:02:16.496467+0000","last_undegraded":"2024-09-12T01:02:16.496467+0000","last_fullsized":"2024-09-12T01:02:16.496467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:38.074165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:32.525392+0000","last_change":"2024-09-12T00:18:30.895269+0000","last_active":"2024-09-12T01:00:32.525392+0000","last_peered":"2024-09-12T01:00:32.525392+0000","last_clean":"2024-09-12T01:00:32.525392+0000","last_became_active":"2024-09-12T00:18:30.894388+0000","last_became_peered":"2024-09-12T00:18:30.894388+0000","last_unstale":"2024-09-12T01:00:32.525392+0000","last_undegraded":"2024-09-12T01:00:32.525392+0000","last_fullsized":"2024-09-12T01:00:32.525392+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:32.983260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'210","reported_seq":728,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.127161+0000","last_change":"2024-09-12T00:18:32.904521+0000","last_active":"2024-09-12T01:03:25.127161+0000","last_peered":"2024-09-12T01:03:25.127161+0000","last_clean":"2024-09-12T01:03:25.127161+0000","last_became_active":"2024-09-12T00:18:32.903719+0000","last_became_peered":"2024-09-12T00:18:32.903719+0000","last_unstale":"2024-09-12T01:03:25.127161+0000","last_undegraded":"2024-09-12T01:03:25.127161+0000","last_fullsized":"2024-09-12T01:03:25.127161+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:22.565162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":286,"num_read_kb":283,"num_write":470,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'853","reported_seq":2460,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.164106+0000","last_change":"2024-09-12T01:04:57.163980+0000","last_active":"2024-09-12T01:04:57.164106+0000","last_peered":"2024-09-12T01:04:57.164106+0000","last_clean":"2024-09-12T01:04:57.164106+0000","last_became_active":"2024-09-12T00:18:24.865480+0000","last_became_peered":"2024-09-12T00:18:24.865480+0000","last_unstale":"2024-09-12T01:04:57.164106+0000","last_undegraded":"2024-09-12T01:04:57.164106+0000","last_fullsized":"2024-09-12T01:04:57.164106+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'853","last_scrub_stamp":"2024-09-12T01:04:57.163800+0000","last_deep_scrub":"268'853","last_deep_scrub_stamp":"2024-09-12T01:04:57.163800+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.163800+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":800,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:48.870486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4053,"num_read_kb":3643,"num_write":1115,"num_write_kb":411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3056,"num_omap_keys":12,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'394","reported_seq":1053,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.476888+0000","last_change":"2024-09-12T01:04:48.476828+0000","last_active":"2024-09-12T01:04:48.476888+0000","last_peered":"2024-09-12T01:04:48.476888+0000","last_clean":"2024-09-12T01:04:48.476888+0000","last_became_active":"2024-09-12T00:18:55.955303+0000","last_became_peered":"2024-09-12T00:18:55.955303+0000","last_unstale":"2024-09-12T01:04:48.476888+0000","last_undegraded":"2024-09-12T01:04:48.476888+0000","last_fullsized":"2024-09-12T01:04:48.476888+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'394","last_scrub_stamp":"2024-09-12T01:04:48.476684+0000","last_deep_scrub":"268'394","last_deep_scrub_stamp":"2024-09-12T01:04:48.476684+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.476684+0000","objects_scrubbed":13,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:27.009748+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1605311,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":590,"num_read_kb":40569,"num_write":1352,"num_write_kb":40151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:06.498381+0000","last_change":"2024-09-12T01:05:06.498244+0000","last_active":"2024-09-12T01:05:06.498381+0000","last_peered":"2024-09-12T01:05:06.498381+0000","last_clean":"2024-09-12T01:05:06.498381+0000","last_became_active":"2024-09-12T00:18:26.859801+0000","last_became_peered":"2024-09-12T00:18:26.859801+0000","last_unstale":"2024-09-12T01:05:06.498381+0000","last_undegraded":"2024-09-12T01:05:06.498381+0000","last_fullsized":"2024-09-12T01:05:06.498381+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:06.498058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:06.498058+0000","last_clean_scrub_stamp":"2024-09-12T01:05:06.498058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:23.328223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'316","reported_seq":914,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.129316+0000","last_change":"2024-09-12T00:18:28.878040+0000","last_active":"2024-09-12T01:04:39.129316+0000","last_peered":"2024-09-12T01:04:39.129316+0000","last_clean":"2024-09-12T01:04:39.129316+0000","last_became_active":"2024-09-12T00:18:28.877317+0000","last_became_peered":"2024-09-12T00:18:28.877317+0000","last_unstale":"2024-09-12T01:04:39.129316+0000","last_undegraded":"2024-09-12T01:04:39.129316+0000","last_fullsized":"2024-09-12T01:04:39.129316+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:36.629509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53640,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":520,"num_read_kb":1147,"num_write":418,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:06.754772+0000","last_change":"2024-09-12T01:05:06.754772+0000","last_active":"2024-09-12T01:05:06.754772+0000","last_peered":"2024-09-12T01:05:06.754772+0000","last_clean":"2024-09-12T01:05:06.754772+0000","last_became_active":"2024-09-12T00:18:30.904052+0000","last_became_peered":"2024-09-12T00:18:30.904052+0000","last_unstale":"2024-09-12T01:05:06.754772+0000","last_undegraded":"2024-09-12T01:05:06.754772+0000","last_fullsized":"2024-09-12T01:05:06.754772+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:06.754587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:06.754587+0000","last_clean_scrub_stamp":"2024-09-12T01:05:06.754587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:30.338221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'138","reported_seq":657,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.556907+0000","last_change":"2024-09-12T00:18:32.900262+0000","last_active":"2024-09-12T01:03:23.556907+0000","last_peered":"2024-09-12T01:03:23.556907+0000","last_clean":"2024-09-12T01:03:23.556907+0000","last_became_active":"2024-09-12T00:18:32.899607+0000","last_became_peered":"2024-09-12T00:18:32.899607+0000","last_unstale":"2024-09-12T01:03:23.556907+0000","last_undegraded":"2024-09-12T01:03:23.556907+0000","last_fullsized":"2024-09-12T01:03:23.556907+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:26.707774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":193,"num_read_kb":183,"num_write":356,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'352","reported_seq":1902,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.079954+0000","last_change":"2024-09-12T01:05:01.079819+0000","last_active":"2024-09-12T01:05:01.079954+0000","last_peered":"2024-09-12T01:05:01.079954+0000","last_clean":"2024-09-12T01:05:01.079954+0000","last_became_active":"2024-09-12T00:18:24.863389+0000","last_became_peered":"2024-09-12T00:18:24.863389+0000","last_unstale":"2024-09-12T01:05:01.079954+0000","last_undegraded":"2024-09-12T01:05:01.079954+0000","last_fullsized":"2024-09-12T01:05:01.079954+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'352","last_scrub_stamp":"2024-09-12T01:05:01.079632+0000","last_deep_scrub":"268'352","last_deep_scrub_stamp":"2024-09-12T01:05:01.079632+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.079632+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:11.611171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2172,"num_read_kb":2099,"num_write":388,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1654,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'349","reported_seq":991,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.216827+0000","last_change":"2024-09-12T01:04:47.216827+0000","last_active":"2024-09-12T01:04:47.216827+0000","last_peered":"2024-09-12T01:04:47.216827+0000","last_clean":"2024-09-12T01:04:47.216827+0000","last_became_active":"2024-09-12T00:18:22.863535+0000","last_became_peered":"2024-09-12T00:18:22.863535+0000","last_unstale":"2024-09-12T01:04:47.216827+0000","last_undegraded":"2024-09-12T01:04:47.216827+0000","last_fullsized":"2024-09-12T01:04:47.216827+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'349","last_scrub_stamp":"2024-09-12T01:04:47.216745+0000","last_deep_scrub":"268'349","last_deep_scrub_stamp":"2024-09-12T01:04:47.216745+0000","last_clean_scrub_stamp":"2024-09-12T01:04:47.216745+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:20.488567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":493,"num_read_kb":3769,"num_write":1077,"num_write_kb":28344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.665332+0000","last_change":"2024-09-12T01:04:59.665200+0000","last_active":"2024-09-12T01:04:59.665332+0000","last_peered":"2024-09-12T01:04:59.665332+0000","last_clean":"2024-09-12T01:04:59.665332+0000","last_became_active":"2024-09-12T00:18:26.874839+0000","last_became_peered":"2024-09-12T00:18:26.874839+0000","last_unstale":"2024-09-12T01:04:59.665332+0000","last_undegraded":"2024-09-12T01:04:59.665332+0000","last_fullsized":"2024-09-12T01:04:59.665332+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:59.664986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:59.664986+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.664986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:33.767626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'271","reported_seq":840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.000852+0000","last_change":"2024-09-12T00:18:28.891511+0000","last_active":"2024-09-12T01:04:39.000852+0000","last_peered":"2024-09-12T01:04:39.000852+0000","last_clean":"2024-09-12T01:04:39.000852+0000","last_became_active":"2024-09-12T00:18:28.888325+0000","last_became_peered":"2024-09-12T00:18:28.888325+0000","last_unstale":"2024-09-12T01:04:39.000852+0000","last_undegraded":"2024-09-12T01:04:39.000852+0000","last_fullsized":"2024-09-12T01:04:39.000852+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:42.542012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52815,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":453,"num_read_kb":1069,"num_write":372,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":491,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:31.547022+0000","last_change":"2024-09-12T00:18:30.900318+0000","last_active":"2024-09-12T01:00:31.547022+0000","last_peered":"2024-09-12T01:00:31.547022+0000","last_clean":"2024-09-12T01:00:31.547022+0000","last_became_active":"2024-09-12T00:18:30.899237+0000","last_became_peered":"2024-09-12T00:18:30.899237+0000","last_unstale":"2024-09-12T01:00:31.547022+0000","last_undegraded":"2024-09-12T01:00:31.547022+0000","last_fullsized":"2024-09-12T01:00:31.547022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:30.916112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'936","reported_seq":2379,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.750198+0000","last_change":"2024-09-12T01:04:57.750198+0000","last_active":"2024-09-12T01:04:57.750198+0000","last_peered":"2024-09-12T01:04:57.750198+0000","last_clean":"2024-09-12T01:04:57.750198+0000","last_became_active":"2024-09-12T00:18:24.859351+0000","last_became_peered":"2024-09-12T00:18:24.859351+0000","last_unstale":"2024-09-12T01:04:57.750198+0000","last_undegraded":"2024-09-12T01:04:57.750198+0000","last_fullsized":"2024-09-12T01:04:57.750198+0000","mapping_epoch":26,"log_start":"268'900","ondisk_log_start":"268'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'936","last_scrub_stamp":"2024-09-12T01:04:57.749993+0000","last_deep_scrub":"268'936","last_deep_scrub_stamp":"2024-09-12T01:04:57.749993+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.749993+0000","objects_scrubbed":6,"log_size":36,"log_dups_size":900,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:52.509130+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4324,"num_read_kb":3896,"num_write":1355,"num_write_kb":567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'315","reported_seq":1023,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.272346+0000","last_change":"2024-09-12T01:04:51.272346+0000","last_active":"2024-09-12T01:04:51.272346+0000","last_peered":"2024-09-12T01:04:51.272346+0000","last_clean":"2024-09-12T01:04:51.272346+0000","last_became_active":"2024-09-12T00:18:22.840244+0000","last_became_peered":"2024-09-12T00:18:22.840244+0000","last_unstale":"2024-09-12T01:04:51.272346+0000","last_undegraded":"2024-09-12T01:04:51.272346+0000","last_fullsized":"2024-09-12T01:04:51.272346+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'315","last_scrub_stamp":"2024-09-12T01:04:51.272055+0000","last_deep_scrub":"268'315","last_deep_scrub_stamp":"2024-09-12T01:04:51.272055+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.272055+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:05.495095+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":618,"num_read_kb":30347,"num_write":961,"num_write_kb":34968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.298177+0000","last_change":"2024-09-12T01:05:05.298177+0000","last_active":"2024-09-12T01:05:05.298177+0000","last_peered":"2024-09-12T01:05:05.298177+0000","last_clean":"2024-09-12T01:05:05.298177+0000","last_became_active":"2024-09-12T00:18:26.855432+0000","last_became_peered":"2024-09-12T00:18:26.855432+0000","last_unstale":"2024-09-12T01:05:05.298177+0000","last_undegraded":"2024-09-12T01:05:05.298177+0000","last_fullsized":"2024-09-12T01:05:05.298177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:05.297897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:05.297897+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.297897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:58.875114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'469","reported_seq":1112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.876428+0000","last_change":"2024-09-12T00:18:28.888006+0000","last_active":"2024-09-12T01:04:39.876428+0000","last_peered":"2024-09-12T01:04:39.876428+0000","last_clean":"2024-09-12T01:04:39.876428+0000","last_became_active":"2024-09-12T00:18:28.887245+0000","last_became_peered":"2024-09-12T00:18:28.887245+0000","last_unstale":"2024-09-12T01:04:39.876428+0000","last_undegraded":"2024-09-12T01:04:39.876428+0000","last_fullsized":"2024-09-12T01:04:39.876428+0000","mapping_epoch":30,"log_start":"268'400","ondisk_log_start":"268'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:58.763012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":845,"num_read_kb":1964,"num_write":726,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":490,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.736385+0000","last_change":"2024-09-12T00:18:30.906327+0000","last_active":"2024-09-12T01:01:02.736385+0000","last_peered":"2024-09-12T01:01:02.736385+0000","last_clean":"2024-09-12T01:01:02.736385+0000","last_became_active":"2024-09-12T00:18:30.905680+0000","last_became_peered":"2024-09-12T00:18:30.905680+0000","last_unstale":"2024-09-12T01:01:02.736385+0000","last_undegraded":"2024-09-12T01:01:02.736385+0000","last_fullsized":"2024-09-12T01:01:02.736385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:50.953253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'152","reported_seq":659,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:43.232099+0000","last_change":"2024-09-12T00:18:32.905858+0000","last_active":"2024-09-12T01:02:43.232099+0000","last_peered":"2024-09-12T01:02:43.232099+0000","last_clean":"2024-09-12T01:02:43.232099+0000","last_became_active":"2024-09-12T00:18:32.905070+0000","last_became_peered":"2024-09-12T00:18:32.905070+0000","last_unstale":"2024-09-12T01:02:43.232099+0000","last_undegraded":"2024-09-12T01:02:43.232099+0000","last_fullsized":"2024-09-12T01:02:43.232099+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:11.929111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":167,"num_read_kb":179,"num_write":337,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'642","reported_seq":2065,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.325029+0000","last_change":"2024-09-12T01:04:58.325029+0000","last_active":"2024-09-12T01:04:58.325029+0000","last_peered":"2024-09-12T01:04:58.325029+0000","last_clean":"2024-09-12T01:04:58.325029+0000","last_became_active":"2024-09-12T00:18:24.865142+0000","last_became_peered":"2024-09-12T00:18:24.865142+0000","last_unstale":"2024-09-12T01:04:58.325029+0000","last_undegraded":"2024-09-12T01:04:58.325029+0000","last_fullsized":"2024-09-12T01:04:58.325029+0000","mapping_epoch":26,"log_start":"268'600","ondisk_log_start":"268'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'642","last_scrub_stamp":"2024-09-12T01:04:58.324781+0000","last_deep_scrub":"268'642","last_deep_scrub_stamp":"2024-09-12T01:04:58.324781+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.324781+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":600,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:57.756900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2990,"num_read_kb":2759,"num_write":892,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'343","reported_seq":1275,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.556937+0000","last_change":"2024-09-12T01:04:48.556937+0000","last_active":"2024-09-12T01:04:48.556937+0000","last_peered":"2024-09-12T01:04:48.556937+0000","last_clean":"2024-09-12T01:04:48.556937+0000","last_became_active":"2024-09-12T00:18:22.845288+0000","last_became_peered":"2024-09-12T00:18:22.845288+0000","last_unstale":"2024-09-12T01:04:48.556937+0000","last_undegraded":"2024-09-12T01:04:48.556937+0000","last_fullsized":"2024-09-12T01:04:48.556937+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'343","last_scrub_stamp":"2024-09-12T01:04:48.556730+0000","last_deep_scrub":"268'343","last_deep_scrub_stamp":"2024-09-12T01:04:48.556730+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.556730+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:49.299596+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1116,"num_read_kb":11059,"num_write":1212,"num_write_kb":25104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.672231+0000","last_change":"2024-09-12T01:05:02.672231+0000","last_active":"2024-09-12T01:05:02.672231+0000","last_peered":"2024-09-12T01:05:02.672231+0000","last_clean":"2024-09-12T01:05:02.672231+0000","last_became_active":"2024-09-12T00:18:26.874972+0000","last_became_peered":"2024-09-12T00:18:26.874972+0000","last_unstale":"2024-09-12T01:05:02.672231+0000","last_undegraded":"2024-09-12T01:05:02.672231+0000","last_fullsized":"2024-09-12T01:05:02.672231+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:02.672044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:02.672044+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.672044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:02.283457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'317","reported_seq":900,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.040355+0000","last_change":"2024-09-12T00:18:28.893601+0000","last_active":"2024-09-12T01:04:39.040355+0000","last_peered":"2024-09-12T01:04:39.040355+0000","last_clean":"2024-09-12T01:04:39.040355+0000","last_became_active":"2024-09-12T00:18:28.892852+0000","last_became_peered":"2024-09-12T00:18:28.892852+0000","last_unstale":"2024-09-12T01:04:39.040355+0000","last_undegraded":"2024-09-12T01:04:39.040355+0000","last_fullsized":"2024-09-12T01:04:39.040355+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:16.294300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53047,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":539,"num_read_kb":1212,"num_write":456,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:01.538521+0000","last_change":"2024-09-12T00:18:30.893248+0000","last_active":"2024-09-12T01:01:01.538521+0000","last_peered":"2024-09-12T01:01:01.538521+0000","last_clean":"2024-09-12T01:01:01.538521+0000","last_became_active":"2024-09-12T00:18:30.892643+0000","last_became_peered":"2024-09-12T00:18:30.892643+0000","last_unstale":"2024-09-12T01:01:01.538521+0000","last_undegraded":"2024-09-12T01:01:01.538521+0000","last_fullsized":"2024-09-12T01:01:01.538521+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:18.646293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'240","reported_seq":780,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.132867+0000","last_change":"2024-09-12T00:18:32.902236+0000","last_active":"2024-09-12T01:03:02.132867+0000","last_peered":"2024-09-12T01:03:02.132867+0000","last_clean":"2024-09-12T01:03:02.132867+0000","last_became_active":"2024-09-12T00:18:32.901587+0000","last_became_peered":"2024-09-12T00:18:32.901587+0000","last_unstale":"2024-09-12T01:03:02.132867+0000","last_undegraded":"2024-09-12T01:03:02.132867+0000","last_fullsized":"2024-09-12T01:03:02.132867+0000","mapping_epoch":34,"log_start":"268'200","ondisk_log_start":"268'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:22.015039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":371,"num_read_kb":330,"num_write":585,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'495","reported_seq":2044,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.019421+0000","last_change":"2024-09-12T01:05:05.019421+0000","last_active":"2024-09-12T01:05:05.019421+0000","last_peered":"2024-09-12T01:05:05.019421+0000","last_clean":"2024-09-12T01:05:05.019421+0000","last_became_active":"2024-09-12T00:18:24.860647+0000","last_became_peered":"2024-09-12T00:18:24.860647+0000","last_unstale":"2024-09-12T01:05:05.019421+0000","last_undegraded":"2024-09-12T01:05:05.019421+0000","last_fullsized":"2024-09-12T01:05:05.019421+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'495","last_scrub_stamp":"2024-09-12T01:05:05.019136+0000","last_deep_scrub":"268'495","last_deep_scrub_stamp":"2024-09-12T01:05:05.019136+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.019136+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:27.295349+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2720,"num_read_kb":2539,"num_write":620,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'383","reported_seq":1064,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.176551+0000","last_change":"2024-09-12T01:04:50.176551+0000","last_active":"2024-09-12T01:04:50.176551+0000","last_peered":"2024-09-12T01:04:50.176551+0000","last_clean":"2024-09-12T01:04:50.176551+0000","last_became_active":"2024-09-12T00:18:22.856073+0000","last_became_peered":"2024-09-12T00:18:22.856073+0000","last_unstale":"2024-09-12T01:04:50.176551+0000","last_undegraded":"2024-09-12T01:04:50.176551+0000","last_fullsized":"2024-09-12T01:04:50.176551+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'383","last_scrub_stamp":"2024-09-12T01:04:50.176350+0000","last_deep_scrub":"268'383","last_deep_scrub_stamp":"2024-09-12T01:04:50.176350+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.176350+0000","objects_scrubbed":12,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:59.557330+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468142,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":578,"num_read_kb":15678,"num_write":1129,"num_write_kb":22765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.532329+0000","last_change":"2024-09-12T00:18:26.862928+0000","last_active":"2024-09-12T01:00:57.532329+0000","last_peered":"2024-09-12T01:00:57.532329+0000","last_clean":"2024-09-12T01:00:57.532329+0000","last_became_active":"2024-09-12T00:18:26.862012+0000","last_became_peered":"2024-09-12T00:18:26.862012+0000","last_unstale":"2024-09-12T01:00:57.532329+0000","last_undegraded":"2024-09-12T01:00:57.532329+0000","last_fullsized":"2024-09-12T01:00:57.532329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:16.642244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'278","reported_seq":869,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.797040+0000","last_change":"2024-09-12T00:18:28.882861+0000","last_active":"2024-09-12T01:04:39.797040+0000","last_peered":"2024-09-12T01:04:39.797040+0000","last_clean":"2024-09-12T01:04:39.797040+0000","last_became_active":"2024-09-12T00:18:28.882129+0000","last_became_peered":"2024-09-12T00:18:28.882129+0000","last_unstale":"2024-09-12T01:04:39.797040+0000","last_undegraded":"2024-09-12T01:04:39.797040+0000","last_fullsized":"2024-09-12T01:04:39.797040+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:30.970755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47744,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":1049,"num_write":372,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:41.562408+0000","last_change":"2024-09-12T00:18:30.906689+0000","last_active":"2024-09-12T01:02:41.562408+0000","last_peered":"2024-09-12T01:02:41.562408+0000","last_clean":"2024-09-12T01:02:41.562408+0000","last_became_active":"2024-09-12T00:18:30.902511+0000","last_became_peered":"2024-09-12T00:18:30.902511+0000","last_unstale":"2024-09-12T01:02:41.562408+0000","last_undegraded":"2024-09-12T01:02:41.562408+0000","last_fullsized":"2024-09-12T01:02:41.562408+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'129","reported_seq":646,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:31.800676+0000","last_change":"2024-09-12T00:18:32.901622+0000","last_active":"2024-09-12T01:04:31.800676+0000","last_peered":"2024-09-12T01:04:31.800676+0000","last_clean":"2024-09-12T01:04:31.800676+0000","last_became_active":"2024-09-12T00:18:32.899968+0000","last_became_peered":"2024-09-12T00:18:32.899968+0000","last_unstale":"2024-09-12T01:04:31.800676+0000","last_undegraded":"2024-09-12T01:04:31.800676+0000","last_fullsized":"2024-09-12T01:04:31.800676+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:05.182292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":825,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":214,"num_read_kb":184,"num_write":320,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'364","reported_seq":1744,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.442699+0000","last_change":"2024-09-12T01:04:52.442699+0000","last_active":"2024-09-12T01:04:52.442699+0000","last_peered":"2024-09-12T01:04:52.442699+0000","last_clean":"2024-09-12T01:04:52.442699+0000","last_became_active":"2024-09-12T00:18:24.861271+0000","last_became_peered":"2024-09-12T00:18:24.861271+0000","last_unstale":"2024-09-12T01:04:52.442699+0000","last_undegraded":"2024-09-12T01:04:52.442699+0000","last_fullsized":"2024-09-12T01:04:52.442699+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'364","last_scrub_stamp":"2024-09-12T01:04:52.442472+0000","last_deep_scrub":"268'364","last_deep_scrub_stamp":"2024-09-12T01:04:52.442472+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.442472+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:50.665068+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2074,"num_read_kb":1954,"num_write":427,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'348","reported_seq":985,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.262939+0000","last_change":"2024-09-12T01:04:49.262939+0000","last_active":"2024-09-12T01:04:49.262939+0000","last_peered":"2024-09-12T01:04:49.262939+0000","last_clean":"2024-09-12T01:04:49.262939+0000","last_became_active":"2024-09-12T00:18:22.859695+0000","last_became_peered":"2024-09-12T00:18:22.859695+0000","last_unstale":"2024-09-12T01:04:49.262939+0000","last_undegraded":"2024-09-12T01:04:49.262939+0000","last_fullsized":"2024-09-12T01:04:49.262939+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'348","last_scrub_stamp":"2024-09-12T01:04:49.262596+0000","last_deep_scrub":"268'348","last_deep_scrub_stamp":"2024-09-12T01:04:49.262596+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.262596+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:52.854459+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263211,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":478,"num_read_kb":12426,"num_write":1109,"num_write_kb":25448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:56.536187+0000","last_change":"2024-09-12T00:18:26.859701+0000","last_active":"2024-09-12T01:00:56.536187+0000","last_peered":"2024-09-12T01:00:56.536187+0000","last_clean":"2024-09-12T01:00:56.536187+0000","last_became_active":"2024-09-12T00:18:26.859234+0000","last_became_peered":"2024-09-12T00:18:26.859234+0000","last_unstale":"2024-09-12T01:00:56.536187+0000","last_undegraded":"2024-09-12T01:00:56.536187+0000","last_fullsized":"2024-09-12T01:00:56.536187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:11.914399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'122","reported_seq":656,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:42.558624+0000","last_change":"2024-09-12T00:18:28.884827+0000","last_active":"2024-09-12T01:02:42.558624+0000","last_peered":"2024-09-12T01:02:42.558624+0000","last_clean":"2024-09-12T01:02:42.558624+0000","last_became_active":"2024-09-12T00:18:28.883277+0000","last_became_peered":"2024-09-12T00:18:28.883277+0000","last_unstale":"2024-09-12T01:02:42.558624+0000","last_undegraded":"2024-09-12T01:02:42.558624+0000","last_fullsized":"2024-09-12T01:02:42.558624+0000","mapping_epoch":30,"log_start":"268'100","ondisk_log_start":"268'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:38.381310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":135,"num_read_kb":124,"num_write":148,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'770","reported_seq":2201,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.736580+0000","last_change":"2024-09-12T00:18:30.895935+0000","last_active":"2024-09-12T01:04:39.736580+0000","last_peered":"2024-09-12T01:04:39.736580+0000","last_clean":"2024-09-12T01:04:39.736580+0000","last_became_active":"2024-09-12T00:18:30.893175+0000","last_became_peered":"2024-09-12T00:18:30.893175+0000","last_unstale":"2024-09-12T01:04:39.736580+0000","last_undegraded":"2024-09-12T01:04:39.736580+0000","last_fullsized":"2024-09-12T01:04:39.736580+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:51.257227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'108","reported_seq":602,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.731248+0000","last_change":"2024-09-12T00:18:32.909110+0000","last_active":"2024-09-12T01:03:06.731248+0000","last_peered":"2024-09-12T01:03:06.731248+0000","last_clean":"2024-09-12T01:03:06.731248+0000","last_became_active":"2024-09-12T00:18:32.908295+0000","last_became_peered":"2024-09-12T00:18:32.908295+0000","last_unstale":"2024-09-12T01:03:06.731248+0000","last_undegraded":"2024-09-12T01:03:06.731248+0000","last_fullsized":"2024-09-12T01:03:06.731248+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:19.170686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":102,"num_write":264,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'834","reported_seq":2462,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.178341+0000","last_change":"2024-09-12T01:05:00.178341+0000","last_active":"2024-09-12T01:05:00.178341+0000","last_peered":"2024-09-12T01:05:00.178341+0000","last_clean":"2024-09-12T01:05:00.178341+0000","last_became_active":"2024-09-12T00:18:24.860266+0000","last_became_peered":"2024-09-12T00:18:24.860266+0000","last_unstale":"2024-09-12T01:05:00.178341+0000","last_undegraded":"2024-09-12T01:05:00.178341+0000","last_fullsized":"2024-09-12T01:05:00.178341+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'834","last_scrub_stamp":"2024-09-12T01:05:00.178156+0000","last_deep_scrub":"268'834","last_deep_scrub_stamp":"2024-09-12T01:05:00.178156+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.178156+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:24.839206+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4128,"num_read_kb":3735,"num_write":1126,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'317","reported_seq":929,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.585039+0000","last_change":"2024-09-12T01:04:51.585039+0000","last_active":"2024-09-12T01:04:51.585039+0000","last_peered":"2024-09-12T01:04:51.585039+0000","last_clean":"2024-09-12T01:04:51.585039+0000","last_became_active":"2024-09-12T00:18:22.867694+0000","last_became_peered":"2024-09-12T00:18:22.867694+0000","last_unstale":"2024-09-12T01:04:51.585039+0000","last_undegraded":"2024-09-12T01:04:51.585039+0000","last_fullsized":"2024-09-12T01:04:51.585039+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'317","last_scrub_stamp":"2024-09-12T01:04:51.584788+0000","last_deep_scrub":"268'317","last_deep_scrub_stamp":"2024-09-12T01:04:51.584788+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.584788+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:39.411322+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194362,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":405,"num_read_kb":19923,"num_write":982,"num_write_kb":45748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:07.504144+0000","last_change":"2024-09-12T01:05:07.504144+0000","last_active":"2024-09-12T01:05:07.504144+0000","last_peered":"2024-09-12T01:05:07.504144+0000","last_clean":"2024-09-12T01:05:07.504144+0000","last_became_active":"2024-09-12T00:18:26.864536+0000","last_became_peered":"2024-09-12T00:18:26.864536+0000","last_unstale":"2024-09-12T01:05:07.504144+0000","last_undegraded":"2024-09-12T01:05:07.504144+0000","last_fullsized":"2024-09-12T01:05:07.504144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:07.503869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:07.503869+0000","last_clean_scrub_stamp":"2024-09-12T01:05:07.503869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:30.764859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'337","reported_seq":947,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.057410+0000","last_change":"2024-09-12T00:18:28.885849+0000","last_active":"2024-09-12T01:04:40.057410+0000","last_peered":"2024-09-12T01:04:40.057410+0000","last_clean":"2024-09-12T01:04:40.057410+0000","last_became_active":"2024-09-12T00:18:28.885152+0000","last_became_peered":"2024-09-12T00:18:28.885152+0000","last_unstale":"2024-09-12T01:04:40.057410+0000","last_undegraded":"2024-09-12T01:04:40.057410+0000","last_fullsized":"2024-09-12T01:04:40.057410+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:29.158839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50453,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":539,"num_read_kb":1151,"num_write":436,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":491,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:01.573124+0000","last_change":"2024-09-12T00:18:30.895751+0000","last_active":"2024-09-12T01:02:01.573124+0000","last_peered":"2024-09-12T01:02:01.573124+0000","last_clean":"2024-09-12T01:02:01.573124+0000","last_became_active":"2024-09-12T00:18:30.888974+0000","last_became_peered":"2024-09-12T00:18:30.888974+0000","last_unstale":"2024-09-12T01:02:01.573124+0000","last_undegraded":"2024-09-12T01:02:01.573124+0000","last_fullsized":"2024-09-12T01:02:01.573124+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:53.240426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'97","reported_seq":604,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.290751+0000","last_change":"2024-09-12T00:18:32.915634+0000","last_active":"2024-09-12T01:03:23.290751+0000","last_peered":"2024-09-12T01:03:23.290751+0000","last_clean":"2024-09-12T01:03:23.290751+0000","last_became_active":"2024-09-12T00:18:32.914994+0000","last_became_peered":"2024-09-12T00:18:32.914994+0000","last_unstale":"2024-09-12T01:03:23.290751+0000","last_undegraded":"2024-09-12T01:03:23.290751+0000","last_fullsized":"2024-09-12T01:03:23.290751+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:03.290807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":129,"num_write":234,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'859","reported_seq":2384,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.197006+0000","last_change":"2024-09-12T01:04:59.197006+0000","last_active":"2024-09-12T01:04:59.197006+0000","last_peered":"2024-09-12T01:04:59.197006+0000","last_clean":"2024-09-12T01:04:59.197006+0000","last_became_active":"2024-09-12T00:18:24.854089+0000","last_became_peered":"2024-09-12T00:18:24.854089+0000","last_unstale":"2024-09-12T01:04:59.197006+0000","last_undegraded":"2024-09-12T01:04:59.197006+0000","last_fullsized":"2024-09-12T01:04:59.197006+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'859","last_scrub_stamp":"2024-09-12T01:04:59.196824+0000","last_deep_scrub":"268'859","last_deep_scrub_stamp":"2024-09-12T01:04:59.196824+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.196824+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":800,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:28.550763+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4036,"num_read_kb":3617,"num_write":1169,"num_write_kb":474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'344","reported_seq":987,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.538484+0000","last_change":"2024-09-12T01:04:53.538484+0000","last_active":"2024-09-12T01:04:53.538484+0000","last_peered":"2024-09-12T01:04:53.538484+0000","last_clean":"2024-09-12T01:04:53.538484+0000","last_became_active":"2024-09-12T00:18:22.867744+0000","last_became_peered":"2024-09-12T00:18:22.867744+0000","last_unstale":"2024-09-12T01:04:53.538484+0000","last_undegraded":"2024-09-12T01:04:53.538484+0000","last_fullsized":"2024-09-12T01:04:53.538484+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'344","last_scrub_stamp":"2024-09-12T01:04:53.538289+0000","last_deep_scrub":"268'344","last_deep_scrub_stamp":"2024-09-12T01:04:53.538289+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.538289+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:01.759059+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":517,"num_read_kb":9523,"num_write":1195,"num_write_kb":17845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:57.735193+0000","last_change":"2024-09-12T00:18:26.858490+0000","last_active":"2024-09-12T01:00:57.735193+0000","last_peered":"2024-09-12T01:00:57.735193+0000","last_clean":"2024-09-12T01:00:57.735193+0000","last_became_active":"2024-09-12T00:18:26.857810+0000","last_became_peered":"2024-09-12T00:18:26.857810+0000","last_unstale":"2024-09-12T01:00:57.735193+0000","last_undegraded":"2024-09-12T01:00:57.735193+0000","last_fullsized":"2024-09-12T01:00:57.735193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:16.264419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'255","reported_seq":832,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:40.096997+0000","last_change":"2024-09-12T00:18:28.882323+0000","last_active":"2024-09-12T01:04:40.096997+0000","last_peered":"2024-09-12T01:04:40.096997+0000","last_clean":"2024-09-12T01:04:40.096997+0000","last_became_active":"2024-09-12T00:18:28.881556+0000","last_became_peered":"2024-09-12T00:18:28.881556+0000","last_unstale":"2024-09-12T01:04:40.096997+0000","last_undegraded":"2024-09-12T01:04:40.096997+0000","last_fullsized":"2024-09-12T01:04:40.096997+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:58.134241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48228,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":430,"num_read_kb":998,"num_write":346,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:07.730322+0000","last_change":"2024-09-12T00:18:30.902376+0000","last_active":"2024-09-12T01:02:07.730322+0000","last_peered":"2024-09-12T01:02:07.730322+0000","last_clean":"2024-09-12T01:02:07.730322+0000","last_became_active":"2024-09-12T00:18:30.898539+0000","last_became_peered":"2024-09-12T00:18:30.898539+0000","last_unstale":"2024-09-12T01:02:07.730322+0000","last_undegraded":"2024-09-12T01:02:07.730322+0000","last_fullsized":"2024-09-12T01:02:07.730322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:18.476695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'110","reported_seq":637,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.199453+0000","last_change":"2024-09-12T00:18:32.908261+0000","last_active":"2024-09-12T01:03:08.199453+0000","last_peered":"2024-09-12T01:03:08.199453+0000","last_clean":"2024-09-12T01:03:08.199453+0000","last_became_active":"2024-09-12T00:18:32.907530+0000","last_became_peered":"2024-09-12T00:18:32.907530+0000","last_unstale":"2024-09-12T01:03:08.199453+0000","last_undegraded":"2024-09-12T01:03:08.199453+0000","last_fullsized":"2024-09-12T01:03:08.199453+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:37.368919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":167,"num_read_kb":160,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'366","reported_seq":1699,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.075971+0000","last_change":"2024-09-12T01:05:03.075971+0000","last_active":"2024-09-12T01:05:03.075971+0000","last_peered":"2024-09-12T01:05:03.075971+0000","last_clean":"2024-09-12T01:05:03.075971+0000","last_became_active":"2024-09-12T00:18:24.842263+0000","last_became_peered":"2024-09-12T00:18:24.842263+0000","last_unstale":"2024-09-12T01:05:03.075971+0000","last_undegraded":"2024-09-12T01:05:03.075971+0000","last_fullsized":"2024-09-12T01:05:03.075971+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'366","last_scrub_stamp":"2024-09-12T01:05:03.075784+0000","last_deep_scrub":"268'366","last_deep_scrub_stamp":"2024-09-12T01:05:03.075784+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.075784+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:40.465649+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1879,"num_read_kb":1766,"num_write":437,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'436","reported_seq":1218,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.286861+0000","last_change":"2024-09-12T01:04:52.286861+0000","last_active":"2024-09-12T01:04:52.286861+0000","last_peered":"2024-09-12T01:04:52.286861+0000","last_clean":"2024-09-12T01:04:52.286861+0000","last_became_active":"2024-09-12T00:18:22.837412+0000","last_became_peered":"2024-09-12T00:18:22.837412+0000","last_unstale":"2024-09-12T01:04:52.286861+0000","last_undegraded":"2024-09-12T01:04:52.286861+0000","last_fullsized":"2024-09-12T01:04:52.286861+0000","mapping_epoch":24,"log_start":"268'400","ondisk_log_start":"268'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'436","last_scrub_stamp":"2024-09-12T01:04:52.286655+0000","last_deep_scrub":"268'436","last_deep_scrub_stamp":"2024-09-12T01:04:52.286655+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.286655+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:34.352582+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5614631,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":898,"num_read_kb":48874,"num_write":1334,"num_write_kb":53147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.546076+0000","last_change":"2024-09-12T00:18:26.869821+0000","last_active":"2024-09-12T01:01:57.546076+0000","last_peered":"2024-09-12T01:01:57.546076+0000","last_clean":"2024-09-12T01:01:57.546076+0000","last_became_active":"2024-09-12T00:18:26.868407+0000","last_became_peered":"2024-09-12T00:18:26.868407+0000","last_unstale":"2024-09-12T01:01:57.546076+0000","last_undegraded":"2024-09-12T01:01:57.546076+0000","last_fullsized":"2024-09-12T01:01:57.546076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.826931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.826931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:11.537097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'267","reported_seq":839,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.712285+0000","last_change":"2024-09-12T00:18:28.896471+0000","last_active":"2024-09-12T01:04:39.712285+0000","last_peered":"2024-09-12T01:04:39.712285+0000","last_clean":"2024-09-12T01:04:39.712285+0000","last_became_active":"2024-09-12T00:18:28.895848+0000","last_became_peered":"2024-09-12T00:18:28.895848+0000","last_unstale":"2024-09-12T01:04:39.712285+0000","last_undegraded":"2024-09-12T01:04:39.712285+0000","last_fullsized":"2024-09-12T01:04:39.712285+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:11.864170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53006,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":433,"num_read_kb":1065,"num_write":360,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":494,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.533540+0000","last_change":"2024-09-12T00:18:30.893385+0000","last_active":"2024-09-12T01:01:02.533540+0000","last_peered":"2024-09-12T01:01:02.533540+0000","last_clean":"2024-09-12T01:01:02.533540+0000","last_became_active":"2024-09-12T00:18:30.892682+0000","last_became_peered":"2024-09-12T00:18:30.892682+0000","last_unstale":"2024-09-12T01:01:02.533540+0000","last_undegraded":"2024-09-12T01:01:02.533540+0000","last_fullsized":"2024-09-12T01:01:02.533540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:03.256684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'208","reported_seq":1695,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.225211+0000","last_change":"2024-09-12T00:18:32.911619+0000","last_active":"2024-09-12T01:03:23.225211+0000","last_peered":"2024-09-12T01:03:23.225211+0000","last_clean":"2024-09-12T01:03:23.225211+0000","last_became_active":"2024-09-12T00:18:32.911082+0000","last_became_peered":"2024-09-12T00:18:32.911082+0000","last_unstale":"2024-09-12T01:03:23.225211+0000","last_undegraded":"2024-09-12T01:03:23.225211+0000","last_fullsized":"2024-09-12T01:03:23.225211+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:46.062158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1287,"num_read_kb":1263,"num_write":482,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'527","reported_seq":2125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.235268+0000","last_change":"2024-09-12T01:04:58.235268+0000","last_active":"2024-09-12T01:04:58.235268+0000","last_peered":"2024-09-12T01:04:58.235268+0000","last_clean":"2024-09-12T01:04:58.235268+0000","last_became_active":"2024-09-12T00:18:24.881029+0000","last_became_peered":"2024-09-12T00:18:24.881029+0000","last_unstale":"2024-09-12T01:04:58.235268+0000","last_undegraded":"2024-09-12T01:04:58.235268+0000","last_fullsized":"2024-09-12T01:04:58.235268+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'527","last_scrub_stamp":"2024-09-12T01:04:58.235070+0000","last_deep_scrub":"268'527","last_deep_scrub_stamp":"2024-09-12T01:04:58.235070+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.235070+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":500,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:33.784017+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2735,"num_read_kb":2532,"num_write":658,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'403","reported_seq":1117,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.251141+0000","last_change":"2024-09-12T01:04:48.251141+0000","last_active":"2024-09-12T01:04:48.251141+0000","last_peered":"2024-09-12T01:04:48.251141+0000","last_clean":"2024-09-12T01:04:48.251141+0000","last_became_active":"2024-09-12T00:18:22.863907+0000","last_became_peered":"2024-09-12T00:18:22.863907+0000","last_unstale":"2024-09-12T01:04:48.251141+0000","last_undegraded":"2024-09-12T01:04:48.251141+0000","last_fullsized":"2024-09-12T01:04:48.251141+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'403","last_scrub_stamp":"2024-09-12T01:04:48.250914+0000","last_deep_scrub":"268'403","last_deep_scrub_stamp":"2024-09-12T01:04:48.250914+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.250914+0000","objects_scrubbed":11,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:07.582611+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1987000,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":643,"num_read_kb":24608,"num_write":1249,"num_write_kb":29666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"268'2","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.574020+0000","last_change":"2024-09-12T01:05:02.574020+0000","last_active":"2024-09-12T01:05:02.574020+0000","last_peered":"2024-09-12T01:05:02.574020+0000","last_clean":"2024-09-12T01:05:02.574020+0000","last_became_active":"2024-09-12T00:18:26.866967+0000","last_became_peered":"2024-09-12T00:18:26.866967+0000","last_unstale":"2024-09-12T01:05:02.574020+0000","last_undegraded":"2024-09-12T01:05:02.574020+0000","last_fullsized":"2024-09-12T01:05:02.574020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:02.573832+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:02.573832+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.573832+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:53.608830+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'309","reported_seq":911,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.842454+0000","last_change":"2024-09-12T00:18:28.898664+0000","last_active":"2024-09-12T01:04:39.842454+0000","last_peered":"2024-09-12T01:04:39.842454+0000","last_clean":"2024-09-12T01:04:39.842454+0000","last_became_active":"2024-09-12T00:18:28.897709+0000","last_became_peered":"2024-09-12T00:18:28.897709+0000","last_unstale":"2024-09-12T01:04:39.842454+0000","last_undegraded":"2024-09-12T01:04:39.842454+0000","last_fullsized":"2024-09-12T01:04:39.842454+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.833575+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.833575+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:21.269051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54863,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":525,"num_read_kb":1160,"num_write":422,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":490,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:01.554976+0000","last_change":"2024-09-12T00:18:30.898241+0000","last_active":"2024-09-12T01:01:01.554976+0000","last_peered":"2024-09-12T01:01:01.554976+0000","last_clean":"2024-09-12T01:01:01.554976+0000","last_became_active":"2024-09-12T00:18:30.889179+0000","last_became_peered":"2024-09-12T00:18:30.889179+0000","last_unstale":"2024-09-12T01:01:01.554976+0000","last_undegraded":"2024-09-12T01:01:01.554976+0000","last_fullsized":"2024-09-12T01:01:01.554976+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.851655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.851655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:34.242145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'191","reported_seq":755,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:30.817447+0000","last_change":"2024-09-12T00:18:32.908462+0000","last_active":"2024-09-12T01:04:30.817447+0000","last_peered":"2024-09-12T01:04:30.817447+0000","last_clean":"2024-09-12T01:04:30.817447+0000","last_became_active":"2024-09-12T00:18:32.907658+0000","last_became_peered":"2024-09-12T00:18:32.907658+0000","last_unstale":"2024-09-12T01:04:30.817447+0000","last_undegraded":"2024-09-12T01:04:30.817447+0000","last_fullsized":"2024-09-12T01:04:30.817447+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:03.641123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":435,"num_read_kb":358,"num_write":481,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'411","reported_seq":1919,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.596122+0000","last_change":"2024-09-12T01:05:03.596122+0000","last_active":"2024-09-12T01:05:03.596122+0000","last_peered":"2024-09-12T01:05:03.596122+0000","last_clean":"2024-09-12T01:05:03.596122+0000","last_became_active":"2024-09-12T00:18:24.878522+0000","last_became_peered":"2024-09-12T00:18:24.878522+0000","last_unstale":"2024-09-12T01:05:03.596122+0000","last_undegraded":"2024-09-12T01:05:03.596122+0000","last_fullsized":"2024-09-12T01:05:03.596122+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'411","last_scrub_stamp":"2024-09-12T01:05:03.595908+0000","last_deep_scrub":"268'411","last_deep_scrub_stamp":"2024-09-12T01:05:03.595908+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.595908+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:15.152071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2233,"num_read_kb":2110,"num_write":497,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'384","reported_seq":1059,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.766796+0000","last_change":"2024-09-12T01:04:53.766796+0000","last_active":"2024-09-12T01:04:53.766796+0000","last_peered":"2024-09-12T01:04:53.766796+0000","last_clean":"2024-09-12T01:04:53.766796+0000","last_became_active":"2024-09-12T00:18:22.851554+0000","last_became_peered":"2024-09-12T00:18:22.851554+0000","last_unstale":"2024-09-12T01:04:53.766796+0000","last_undegraded":"2024-09-12T01:04:53.766796+0000","last_fullsized":"2024-09-12T01:04:53.766796+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'384","last_scrub_stamp":"2024-09-12T01:04:53.766598+0000","last_deep_scrub":"268'384","last_deep_scrub_stamp":"2024-09-12T01:04:53.766598+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.766598+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:59.035558+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":573,"num_read_kb":70445,"num_write":1144,"num_write_kb":38293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"268'1219","reported_seq":2840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.588495+0000","last_change":"2024-09-12T01:04:59.588495+0000","last_active":"2024-09-12T01:04:59.588495+0000","last_peered":"2024-09-12T01:04:59.588495+0000","last_clean":"2024-09-12T01:04:59.588495+0000","last_became_active":"2024-09-12T00:18:24.857107+0000","last_became_peered":"2024-09-12T00:18:24.857107+0000","last_unstale":"2024-09-12T01:04:59.588495+0000","last_undegraded":"2024-09-12T01:04:59.588495+0000","last_fullsized":"2024-09-12T01:04:59.588495+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1219","last_scrub_stamp":"2024-09-12T01:04:59.588271+0000","last_deep_scrub":"268'1219","last_deep_scrub_stamp":"2024-09-12T01:04:59.588271+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.588271+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":1200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:26.602528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5568,"num_read_kb":4913,"num_write":1657,"num_write_kb":681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"268'366","reported_seq":1025,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.455879+0000","last_change":"2024-09-12T01:04:47.455879+0000","last_active":"2024-09-12T01:04:47.455879+0000","last_peered":"2024-09-12T01:04:47.455879+0000","last_clean":"2024-09-12T01:04:47.455879+0000","last_became_active":"2024-09-12T00:18:56.193721+0000","last_became_peered":"2024-09-12T00:18:56.193721+0000","last_unstale":"2024-09-12T01:04:47.455879+0000","last_undegraded":"2024-09-12T01:04:47.455879+0000","last_fullsized":"2024-09-12T01:04:47.455879+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'366","last_scrub_stamp":"2024-09-12T01:04:47.455778+0000","last_deep_scrub":"268'366","last_deep_scrub_stamp":"2024-09-12T01:04:47.455778+0000","last_clean_scrub_stamp":"2024-09-12T01:04:47.455778+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:03.972474+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342105,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":474,"num_read_kb":19261,"num_write":1030,"num_write_kb":26595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'861","reported_seq":2466,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.543543+0000","last_change":"2024-09-12T01:05:03.543543+0000","last_active":"2024-09-12T01:05:03.543543+0000","last_peered":"2024-09-12T01:05:03.543543+0000","last_clean":"2024-09-12T01:05:03.543543+0000","last_became_active":"2024-09-12T00:18:24.870288+0000","last_became_peered":"2024-09-12T00:18:24.870288+0000","last_unstale":"2024-09-12T01:05:03.543543+0000","last_undegraded":"2024-09-12T01:05:03.543543+0000","last_fullsized":"2024-09-12T01:05:03.543543+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'861","last_scrub_stamp":"2024-09-12T01:05:03.543359+0000","last_deep_scrub":"268'861","last_deep_scrub_stamp":"2024-09-12T01:05:03.543359+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.543359+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":800,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:05.642071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4146,"num_read_kb":3713,"num_write":1130,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2296,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'416","reported_seq":1061,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.558231+0000","last_change":"2024-09-12T01:04:52.558231+0000","last_active":"2024-09-12T01:04:52.558231+0000","last_peered":"2024-09-12T01:04:52.558231+0000","last_clean":"2024-09-12T01:04:52.558231+0000","last_became_active":"2024-09-12T00:18:22.866341+0000","last_became_peered":"2024-09-12T00:18:22.866341+0000","last_unstale":"2024-09-12T01:04:52.558231+0000","last_undegraded":"2024-09-12T01:04:52.558231+0000","last_fullsized":"2024-09-12T01:04:52.558231+0000","mapping_epoch":24,"log_start":"268'400","ondisk_log_start":"268'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'416","last_scrub_stamp":"2024-09-12T01:04:52.558034+0000","last_deep_scrub":"268'416","last_deep_scrub_stamp":"2024-09-12T01:04:52.558034+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.558034+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:06.937457+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1452502,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":481,"num_read_kb":25322,"num_write":1167,"num_write_kb":64729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'400","reported_seq":1905,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.616499+0000","last_change":"2024-09-12T01:04:57.616499+0000","last_active":"2024-09-12T01:04:57.616499+0000","last_peered":"2024-09-12T01:04:57.616499+0000","last_clean":"2024-09-12T01:04:57.616499+0000","last_became_active":"2024-09-12T00:18:24.865674+0000","last_became_peered":"2024-09-12T00:18:24.865674+0000","last_unstale":"2024-09-12T01:04:57.616499+0000","last_undegraded":"2024-09-12T01:04:57.616499+0000","last_fullsized":"2024-09-12T01:04:57.616499+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'400","last_scrub_stamp":"2024-09-12T01:04:57.616297+0000","last_deep_scrub":"268'400","last_deep_scrub_stamp":"2024-09-12T01:04:57.616297+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.616297+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:18.938055+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2040,"num_read_kb":1953,"num_write":432,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'346","reported_seq":1099,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.241235+0000","last_change":"2024-09-12T01:04:50.241235+0000","last_active":"2024-09-12T01:04:50.241235+0000","last_peered":"2024-09-12T01:04:50.241235+0000","last_clean":"2024-09-12T01:04:50.241235+0000","last_became_active":"2024-09-12T00:18:22.844095+0000","last_became_peered":"2024-09-12T00:18:22.844095+0000","last_unstale":"2024-09-12T01:04:50.241235+0000","last_undegraded":"2024-09-12T01:04:50.241235+0000","last_fullsized":"2024-09-12T01:04:50.241235+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'346","last_scrub_stamp":"2024-09-12T01:04:50.241022+0000","last_deep_scrub":"268'346","last_deep_scrub_stamp":"2024-09-12T01:04:50.241022+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.241022+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:38.319110+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":305939,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":760,"num_read_kb":58308,"num_write":997,"num_write_kb":25022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"268'390","reported_seq":1858,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.133189+0000","last_change":"2024-09-12T01:04:59.133189+0000","last_active":"2024-09-12T01:04:59.133189+0000","last_peered":"2024-09-12T01:04:59.133189+0000","last_clean":"2024-09-12T01:04:59.133189+0000","last_became_active":"2024-09-12T00:18:24.865720+0000","last_became_peered":"2024-09-12T00:18:24.865720+0000","last_unstale":"2024-09-12T01:04:59.133189+0000","last_undegraded":"2024-09-12T01:04:59.133189+0000","last_fullsized":"2024-09-12T01:04:59.133189+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'390","last_scrub_stamp":"2024-09-12T01:04:59.132929+0000","last_deep_scrub":"268'390","last_deep_scrub_stamp":"2024-09-12T01:04:59.132929+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.132929+0000","objects_scrubbed":7,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:05.560879+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2058,"num_read_kb":1953,"num_write":433,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2118,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'381","reported_seq":1064,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.238978+0000","last_change":"2024-09-12T01:04:50.238978+0000","last_active":"2024-09-12T01:04:50.238978+0000","last_peered":"2024-09-12T01:04:50.238978+0000","last_clean":"2024-09-12T01:04:50.238978+0000","last_became_active":"2024-09-12T00:18:22.857896+0000","last_became_peered":"2024-09-12T00:18:22.857896+0000","last_unstale":"2024-09-12T01:04:50.238978+0000","last_undegraded":"2024-09-12T01:04:50.238978+0000","last_fullsized":"2024-09-12T01:04:50.238978+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'381","last_scrub_stamp":"2024-09-12T01:04:50.238615+0000","last_deep_scrub":"268'381","last_deep_scrub_stamp":"2024-09-12T01:04:50.238615+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.238615+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:15.950829+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456478,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":576,"num_read_kb":17790,"num_write":1194,"num_write_kb":44407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'444","reported_seq":2182,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.202943+0000","last_change":"2024-09-12T01:05:01.202943+0000","last_active":"2024-09-12T01:05:01.202943+0000","last_peered":"2024-09-12T01:05:01.202943+0000","last_clean":"2024-09-12T01:05:01.202943+0000","last_became_active":"2024-09-12T00:18:24.866980+0000","last_became_peered":"2024-09-12T00:18:24.866980+0000","last_unstale":"2024-09-12T01:05:01.202943+0000","last_undegraded":"2024-09-12T01:05:01.202943+0000","last_fullsized":"2024-09-12T01:05:01.202943+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'444","last_scrub_stamp":"2024-09-12T01:05:01.202767+0000","last_deep_scrub":"268'444","last_deep_scrub_stamp":"2024-09-12T01:05:01.202767+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.202767+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:44.543465+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2639,"num_read_kb":2518,"num_write":497,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2207,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'322","reported_seq":988,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.507744+0000","last_change":"2024-09-12T01:04:50.507744+0000","last_active":"2024-09-12T01:04:50.507744+0000","last_peered":"2024-09-12T01:04:50.507744+0000","last_clean":"2024-09-12T01:04:50.507744+0000","last_became_active":"2024-09-12T00:18:22.846805+0000","last_became_peered":"2024-09-12T00:18:22.846805+0000","last_unstale":"2024-09-12T01:04:50.507744+0000","last_undegraded":"2024-09-12T01:04:50.507744+0000","last_fullsized":"2024-09-12T01:04:50.507744+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'322","last_scrub_stamp":"2024-09-12T01:04:50.507547+0000","last_deep_scrub":"268'322","last_deep_scrub_stamp":"2024-09-12T01:04:50.507547+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.507547+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:49.831883+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":456,"num_read_kb":82569,"num_write":1071,"num_write_kb":46093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'468","reported_seq":2015,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.989566+0000","last_change":"2024-09-12T01:05:05.989566+0000","last_active":"2024-09-12T01:05:05.989566+0000","last_peered":"2024-09-12T01:05:05.989566+0000","last_clean":"2024-09-12T01:05:05.989566+0000","last_became_active":"2024-09-12T00:18:24.862022+0000","last_became_peered":"2024-09-12T00:18:24.862022+0000","last_unstale":"2024-09-12T01:05:05.989566+0000","last_undegraded":"2024-09-12T01:05:05.989566+0000","last_fullsized":"2024-09-12T01:05:05.989566+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'468","last_scrub_stamp":"2024-09-12T01:05:05.989382+0000","last_deep_scrub":"268'468","last_deep_scrub_stamp":"2024-09-12T01:05:05.989382+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.989382+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:40.188563+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2433,"num_read_kb":2274,"num_write":552,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'349","reported_seq":981,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.673096+0000","last_change":"2024-09-12T01:04:50.673096+0000","last_active":"2024-09-12T01:04:50.673096+0000","last_peered":"2024-09-12T01:04:50.673096+0000","last_clean":"2024-09-12T01:04:50.673096+0000","last_became_active":"2024-09-12T00:18:22.871980+0000","last_became_peered":"2024-09-12T00:18:22.871980+0000","last_unstale":"2024-09-12T01:04:50.673096+0000","last_undegraded":"2024-09-12T01:04:50.673096+0000","last_fullsized":"2024-09-12T01:04:50.673096+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'349","last_scrub_stamp":"2024-09-12T01:04:50.672877+0000","last_deep_scrub":"268'349","last_deep_scrub_stamp":"2024-09-12T01:04:50.672877+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.672877+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:51.786132+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":467,"num_read_kb":12975,"num_write":1116,"num_write_kb":44636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'441","reported_seq":2039,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.710518+0000","last_change":"2024-09-12T01:04:58.710518+0000","last_active":"2024-09-12T01:04:58.710518+0000","last_peered":"2024-09-12T01:04:58.710518+0000","last_clean":"2024-09-12T01:04:58.710518+0000","last_became_active":"2024-09-12T00:18:24.857010+0000","last_became_peered":"2024-09-12T00:18:24.857010+0000","last_unstale":"2024-09-12T01:04:58.710518+0000","last_undegraded":"2024-09-12T01:04:58.710518+0000","last_fullsized":"2024-09-12T01:04:58.710518+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'441","last_scrub_stamp":"2024-09-12T01:04:58.710296+0000","last_deep_scrub":"268'441","last_deep_scrub_stamp":"2024-09-12T01:04:58.710296+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.710296+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:49.317345+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2477,"num_read_kb":2332,"num_write":519,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1335,"num_omap_keys":6,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'383","reported_seq":1019,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.244074+0000","last_change":"2024-09-12T01:04:53.244074+0000","last_active":"2024-09-12T01:04:53.244074+0000","last_peered":"2024-09-12T01:04:53.244074+0000","last_clean":"2024-09-12T01:04:53.244074+0000","last_became_active":"2024-09-12T00:18:22.857468+0000","last_became_peered":"2024-09-12T00:18:22.857468+0000","last_unstale":"2024-09-12T01:04:53.244074+0000","last_undegraded":"2024-09-12T01:04:53.244074+0000","last_fullsized":"2024-09-12T01:04:53.244074+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'383","last_scrub_stamp":"2024-09-12T01:04:53.243865+0000","last_deep_scrub":"268'383","last_deep_scrub_stamp":"2024-09-12T01:04:53.243865+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.243865+0000","objects_scrubbed":11,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:00.400260+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375108,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":489,"num_read_kb":4433,"num_write":1123,"num_write_kb":23710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"268'835","reported_seq":2454,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.301201+0000","last_change":"2024-09-12T01:04:59.301066+0000","last_active":"2024-09-12T01:04:59.301201+0000","last_peered":"2024-09-12T01:04:59.301201+0000","last_clean":"2024-09-12T01:04:59.301201+0000","last_became_active":"2024-09-12T00:18:24.857438+0000","last_became_peered":"2024-09-12T00:18:24.857438+0000","last_unstale":"2024-09-12T01:04:59.301201+0000","last_undegraded":"2024-09-12T01:04:59.301201+0000","last_fullsized":"2024-09-12T01:04:59.301201+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'835","last_scrub_stamp":"2024-09-12T01:04:59.300882+0000","last_deep_scrub":"268'835","last_deep_scrub_stamp":"2024-09-12T01:04:59.300882+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.300882+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:06.256923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3858,"num_read_kb":3490,"num_write":1078,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'394","reported_seq":1017,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.550846+0000","last_change":"2024-09-12T01:04:54.550846+0000","last_active":"2024-09-12T01:04:54.550846+0000","last_peered":"2024-09-12T01:04:54.550846+0000","last_clean":"2024-09-12T01:04:54.550846+0000","last_became_active":"2024-09-12T00:18:22.858851+0000","last_became_peered":"2024-09-12T00:18:22.858851+0000","last_unstale":"2024-09-12T01:04:54.550846+0000","last_undegraded":"2024-09-12T01:04:54.550846+0000","last_fullsized":"2024-09-12T01:04:54.550846+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'394","last_scrub_stamp":"2024-09-12T01:04:54.550600+0000","last_deep_scrub":"268'394","last_deep_scrub_stamp":"2024-09-12T01:04:54.550600+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.550600+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:21.777404+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1250253,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":485,"num_read_kb":6084,"num_write":1107,"num_write_kb":43198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'1190","reported_seq":2708,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.212545+0000","last_change":"2024-09-12T01:05:03.212330+0000","last_active":"2024-09-12T01:05:03.212545+0000","last_peered":"2024-09-12T01:05:03.212545+0000","last_clean":"2024-09-12T01:05:03.212545+0000","last_became_active":"2024-09-12T00:18:24.856121+0000","last_became_peered":"2024-09-12T00:18:24.856121+0000","last_unstale":"2024-09-12T01:05:03.212545+0000","last_undegraded":"2024-09-12T01:05:03.212545+0000","last_fullsized":"2024-09-12T01:05:03.212545+0000","mapping_epoch":26,"log_start":"268'1100","ondisk_log_start":"268'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1190","last_scrub_stamp":"2024-09-12T01:05:03.212083+0000","last_deep_scrub":"268'1190","last_deep_scrub_stamp":"2024-09-12T01:05:03.212083+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.212083+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":1100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:31.434280+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5211,"num_read_kb":4574,"num_write":1611,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'359","reported_seq":1114,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.207192+0000","last_change":"2024-09-12T01:04:55.207192+0000","last_active":"2024-09-12T01:04:55.207192+0000","last_peered":"2024-09-12T01:04:55.207192+0000","last_clean":"2024-09-12T01:04:55.207192+0000","last_became_active":"2024-09-12T00:18:22.857806+0000","last_became_peered":"2024-09-12T00:18:22.857806+0000","last_unstale":"2024-09-12T01:04:55.207192+0000","last_undegraded":"2024-09-12T01:04:55.207192+0000","last_fullsized":"2024-09-12T01:04:55.207192+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'359","last_scrub_stamp":"2024-09-12T01:04:55.206986+0000","last_deep_scrub":"268'359","last_deep_scrub_stamp":"2024-09-12T01:04:55.206986+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.206986+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:18.410646+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":676,"num_read_kb":44063,"num_write":1212,"num_write_kb":47646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"268'827","reported_seq":2380,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.485146+0000","last_change":"2024-09-12T01:04:53.485146+0000","last_active":"2024-09-12T01:04:53.485146+0000","last_peered":"2024-09-12T01:04:53.485146+0000","last_clean":"2024-09-12T01:04:53.485146+0000","last_became_active":"2024-09-12T00:18:24.856616+0000","last_became_peered":"2024-09-12T00:18:24.856616+0000","last_unstale":"2024-09-12T01:04:53.485146+0000","last_undegraded":"2024-09-12T01:04:53.485146+0000","last_fullsized":"2024-09-12T01:04:53.485146+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'827","last_scrub_stamp":"2024-09-12T01:04:53.484958+0000","last_deep_scrub":"268'827","last_deep_scrub_stamp":"2024-09-12T01:04:53.484958+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.484958+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:30.113138+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3862,"num_read_kb":3471,"num_write":1076,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'393","reported_seq":1172,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.519626+0000","last_change":"2024-09-12T01:04:56.519626+0000","last_active":"2024-09-12T01:04:56.519626+0000","last_peered":"2024-09-12T01:04:56.519626+0000","last_clean":"2024-09-12T01:04:56.519626+0000","last_became_active":"2024-09-12T00:18:22.873756+0000","last_became_peered":"2024-09-12T00:18:22.873756+0000","last_unstale":"2024-09-12T01:04:56.519626+0000","last_undegraded":"2024-09-12T01:04:56.519626+0000","last_fullsized":"2024-09-12T01:04:56.519626+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'393","last_scrub_stamp":"2024-09-12T01:04:56.519399+0000","last_deep_scrub":"268'393","last_deep_scrub_stamp":"2024-09-12T01:04:56.519399+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.519399+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:26.788844+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263200,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":909,"num_read_kb":25128,"num_write":1275,"num_write_kb":39639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'1581","reported_seq":3280,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.237198+0000","last_change":"2024-09-12T01:05:02.237198+0000","last_active":"2024-09-12T01:05:02.237198+0000","last_peered":"2024-09-12T01:05:02.237198+0000","last_clean":"2024-09-12T01:05:02.237198+0000","last_became_active":"2024-09-12T00:18:24.882937+0000","last_became_peered":"2024-09-12T00:18:24.882937+0000","last_unstale":"2024-09-12T01:05:02.237198+0000","last_undegraded":"2024-09-12T01:05:02.237198+0000","last_fullsized":"2024-09-12T01:05:02.237198+0000","mapping_epoch":26,"log_start":"268'1500","ondisk_log_start":"268'1500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1581","last_scrub_stamp":"2024-09-12T01:05:02.237002+0000","last_deep_scrub":"268'1581","last_deep_scrub_stamp":"2024-09-12T01:05:02.237002+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.237002+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":1500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:39.333011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7111,"num_read_kb":6230,"num_write":2206,"num_write_kb":938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'438","reported_seq":1176,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.200968+0000","last_change":"2024-09-12T01:04:51.200968+0000","last_active":"2024-09-12T01:04:51.200968+0000","last_peered":"2024-09-12T01:04:51.200968+0000","last_clean":"2024-09-12T01:04:51.200968+0000","last_became_active":"2024-09-12T00:18:22.869527+0000","last_became_peered":"2024-09-12T00:18:22.869527+0000","last_unstale":"2024-09-12T01:04:51.200968+0000","last_undegraded":"2024-09-12T01:04:51.200968+0000","last_fullsized":"2024-09-12T01:04:51.200968+0000","mapping_epoch":24,"log_start":"268'400","ondisk_log_start":"268'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'438","last_scrub_stamp":"2024-09-12T01:04:51.200755+0000","last_deep_scrub":"268'438","last_deep_scrub_stamp":"2024-09-12T01:04:51.200755+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.200755+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:55.971651+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262232,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":772,"num_read_kb":72891,"num_write":1443,"num_write_kb":29040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'772","reported_seq":2186,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.491449+0000","last_change":"2024-09-12T01:05:00.491449+0000","last_active":"2024-09-12T01:05:00.491449+0000","last_peered":"2024-09-12T01:05:00.491449+0000","last_clean":"2024-09-12T01:05:00.491449+0000","last_became_active":"2024-09-12T00:18:24.866062+0000","last_became_peered":"2024-09-12T00:18:24.866062+0000","last_unstale":"2024-09-12T01:05:00.491449+0000","last_undegraded":"2024-09-12T01:05:00.491449+0000","last_fullsized":"2024-09-12T01:05:00.491449+0000","mapping_epoch":26,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'772","last_scrub_stamp":"2024-09-12T01:05:00.491269+0000","last_deep_scrub":"268'772","last_deep_scrub_stamp":"2024-09-12T01:05:00.491269+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.491269+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:14.226037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3587,"num_read_kb":3210,"num_write":1032,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'376","reported_seq":1065,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.767471+0000","last_change":"2024-09-12T01:04:55.767471+0000","last_active":"2024-09-12T01:04:55.767471+0000","last_peered":"2024-09-12T01:04:55.767471+0000","last_clean":"2024-09-12T01:04:55.767471+0000","last_became_active":"2024-09-12T00:18:22.858141+0000","last_became_peered":"2024-09-12T00:18:22.858141+0000","last_unstale":"2024-09-12T01:04:55.767471+0000","last_undegraded":"2024-09-12T01:04:55.767471+0000","last_fullsized":"2024-09-12T01:04:55.767471+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'376","last_scrub_stamp":"2024-09-12T01:04:55.767266+0000","last_deep_scrub":"268'376","last_deep_scrub_stamp":"2024-09-12T01:04:55.767266+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.767266+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:24.248670+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":648,"num_read_kb":25195,"num_write":1350,"num_write_kb":34646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'1220","reported_seq":3129,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.335747+0000","last_change":"2024-09-12T01:05:00.335747+0000","last_active":"2024-09-12T01:05:00.335747+0000","last_peered":"2024-09-12T01:05:00.335747+0000","last_clean":"2024-09-12T01:05:00.335747+0000","last_became_active":"2024-09-12T00:18:24.859973+0000","last_became_peered":"2024-09-12T00:18:24.859973+0000","last_unstale":"2024-09-12T01:05:00.335747+0000","last_undegraded":"2024-09-12T01:05:00.335747+0000","last_fullsized":"2024-09-12T01:05:00.335747+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1220","last_scrub_stamp":"2024-09-12T01:05:00.335499+0000","last_deep_scrub":"268'1220","last_deep_scrub_stamp":"2024-09-12T01:05:00.335499+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.335499+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":1200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:36.786041+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5984,"num_read_kb":5306,"num_write":1779,"num_write_kb":823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'360","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.565625+0000","last_change":"2024-09-12T01:04:53.565625+0000","last_active":"2024-09-12T01:04:53.565625+0000","last_peered":"2024-09-12T01:04:53.565625+0000","last_clean":"2024-09-12T01:04:53.565625+0000","last_became_active":"2024-09-12T00:18:55.951826+0000","last_became_peered":"2024-09-12T00:18:55.951826+0000","last_unstale":"2024-09-12T01:04:53.565625+0000","last_undegraded":"2024-09-12T01:04:53.565625+0000","last_fullsized":"2024-09-12T01:04:53.565625+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'360","last_scrub_stamp":"2024-09-12T01:04:53.565426+0000","last_deep_scrub":"268'360","last_deep_scrub_stamp":"2024-09-12T01:04:53.565426+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.565426+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:24.959465+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":11605,"num_write":1081,"num_write_kb":32221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"268'537","reported_seq":2005,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.346854+0000","last_change":"2024-09-12T00:18:24.849840+0000","last_active":"2024-09-12T01:03:37.346854+0000","last_peered":"2024-09-12T01:03:37.346854+0000","last_clean":"2024-09-12T01:03:37.346854+0000","last_became_active":"2024-09-12T00:18:24.849540+0000","last_became_peered":"2024-09-12T00:18:24.849540+0000","last_unstale":"2024-09-12T01:03:37.346854+0000","last_undegraded":"2024-09-12T01:03:37.346854+0000","last_fullsized":"2024-09-12T01:03:37.346854+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.820069+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.820069+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:12.695354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2717,"num_read_kb":2465,"num_write":714,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'362","reported_seq":1065,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.471347+0000","last_change":"2024-09-12T01:04:49.471154+0000","last_active":"2024-09-12T01:04:49.471347+0000","last_peered":"2024-09-12T01:04:49.471347+0000","last_clean":"2024-09-12T01:04:49.471347+0000","last_became_active":"2024-09-12T00:18:22.834527+0000","last_became_peered":"2024-09-12T00:18:22.834527+0000","last_unstale":"2024-09-12T01:04:49.471347+0000","last_undegraded":"2024-09-12T01:04:49.471347+0000","last_fullsized":"2024-09-12T01:04:49.471347+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'362","last_scrub_stamp":"2024-09-12T01:04:49.470959+0000","last_deep_scrub":"268'362","last_deep_scrub_stamp":"2024-09-12T01:04:49.470959+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.470959+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:03.324964+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":663,"num_read_kb":13548,"num_write":1359,"num_write_kb":27172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'352","reported_seq":1714,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.449859+0000","last_change":"2024-09-12T01:05:01.449859+0000","last_active":"2024-09-12T01:05:01.449859+0000","last_peered":"2024-09-12T01:05:01.449859+0000","last_clean":"2024-09-12T01:05:01.449859+0000","last_became_active":"2024-09-12T00:18:24.870016+0000","last_became_peered":"2024-09-12T00:18:24.870016+0000","last_unstale":"2024-09-12T01:05:01.449859+0000","last_undegraded":"2024-09-12T01:05:01.449859+0000","last_fullsized":"2024-09-12T01:05:01.449859+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'352","last_scrub_stamp":"2024-09-12T01:05:01.449680+0000","last_deep_scrub":"268'352","last_deep_scrub_stamp":"2024-09-12T01:05:01.449680+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.449680+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:14.081003+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1783,"num_read_kb":1704,"num_write":384,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'333","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.528182+0000","last_change":"2024-09-12T01:04:55.528002+0000","last_active":"2024-09-12T01:04:55.528182+0000","last_peered":"2024-09-12T01:04:55.528182+0000","last_clean":"2024-09-12T01:04:55.528182+0000","last_became_active":"2024-09-12T00:18:22.883246+0000","last_became_peered":"2024-09-12T00:18:22.883246+0000","last_unstale":"2024-09-12T01:04:55.528182+0000","last_undegraded":"2024-09-12T01:04:55.528182+0000","last_fullsized":"2024-09-12T01:04:55.528182+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'333","last_scrub_stamp":"2024-09-12T01:04:55.527813+0000","last_deep_scrub":"268'333","last_deep_scrub_stamp":"2024-09-12T01:04:55.527813+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.527813+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:47.812183+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2790244,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":500,"num_read_kb":42045,"num_write":1101,"num_write_kb":34022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'382","reported_seq":1058,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.522637+0000","last_change":"2024-09-12T01:04:57.522370+0000","last_active":"2024-09-12T01:04:57.522637+0000","last_peered":"2024-09-12T01:04:57.522637+0000","last_clean":"2024-09-12T01:04:57.522637+0000","last_became_active":"2024-09-12T00:18:22.857072+0000","last_became_peered":"2024-09-12T00:18:22.857072+0000","last_unstale":"2024-09-12T01:04:57.522637+0000","last_undegraded":"2024-09-12T01:04:57.522637+0000","last_fullsized":"2024-09-12T01:04:57.522637+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'382","last_scrub_stamp":"2024-09-12T01:04:57.522162+0000","last_deep_scrub":"268'382","last_deep_scrub_stamp":"2024-09-12T01:04:57.522162+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.522162+0000","objects_scrubbed":10,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:55.368704+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525411,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":546,"num_read_kb":42645,"num_write":1246,"num_write_kb":40559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'478","reported_seq":2186,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.337968+0000","last_change":"2024-09-12T01:05:01.337968+0000","last_active":"2024-09-12T01:05:01.337968+0000","last_peered":"2024-09-12T01:05:01.337968+0000","last_clean":"2024-09-12T01:05:01.337968+0000","last_became_active":"2024-09-12T00:18:24.866883+0000","last_became_peered":"2024-09-12T00:18:24.866883+0000","last_unstale":"2024-09-12T01:05:01.337968+0000","last_undegraded":"2024-09-12T01:05:01.337968+0000","last_fullsized":"2024-09-12T01:05:01.337968+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'478","last_scrub_stamp":"2024-09-12T01:05:01.337648+0000","last_deep_scrub":"268'478","last_deep_scrub_stamp":"2024-09-12T01:05:01.337648+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.337648+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:51.544486+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2661,"num_read_kb":2525,"num_write":544,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'456","reported_seq":1192,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.550977+0000","last_change":"2024-09-12T01:04:51.550695+0000","last_active":"2024-09-12T01:04:51.550977+0000","last_peered":"2024-09-12T01:04:51.550977+0000","last_clean":"2024-09-12T01:04:51.550977+0000","last_became_active":"2024-09-12T00:18:22.858176+0000","last_became_peered":"2024-09-12T00:18:22.858176+0000","last_unstale":"2024-09-12T01:04:51.550977+0000","last_undegraded":"2024-09-12T01:04:51.550977+0000","last_fullsized":"2024-09-12T01:04:51.550977+0000","mapping_epoch":24,"log_start":"268'400","ondisk_log_start":"268'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'456","last_scrub_stamp":"2024-09-12T01:04:51.550461+0000","last_deep_scrub":"268'456","last_deep_scrub_stamp":"2024-09-12T01:04:51.550461+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.550461+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:00.070041+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493507,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":841,"num_read_kb":63084,"num_write":1253,"num_write_kb":30414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'808","reported_seq":2413,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.507308+0000","last_change":"2024-09-12T01:05:04.507308+0000","last_active":"2024-09-12T01:05:04.507308+0000","last_peered":"2024-09-12T01:05:04.507308+0000","last_clean":"2024-09-12T01:05:04.507308+0000","last_became_active":"2024-09-12T00:18:24.855524+0000","last_became_peered":"2024-09-12T00:18:24.855524+0000","last_unstale":"2024-09-12T01:05:04.507308+0000","last_undegraded":"2024-09-12T01:05:04.507308+0000","last_fullsized":"2024-09-12T01:05:04.507308+0000","mapping_epoch":26,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'808","last_scrub_stamp":"2024-09-12T01:05:04.507124+0000","last_deep_scrub":"268'808","last_deep_scrub_stamp":"2024-09-12T01:05:04.507124+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.507124+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:08.739902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3793,"num_read_kb":3425,"num_write":1052,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6125,"num_read_kb":4422,"num_write":1992,"num_write_kb":889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":963,"ondisk_log_size":963,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15018,"num_read_kb":14677,"num_write":16721,"num_write_kb":4879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1955,"ondisk_log_size":1955,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":498,"ondisk_log_size":498,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1590876,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":17701,"num_read_kb":37057,"num_write":14791,"num_write_kb":11631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2056,"ondisk_log_size":2056,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212220,"num_read_kb":193790,"num_write":55147,"num_write_kb":18721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":42539,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3934,"ondisk_log_size":3934,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":67372279,"num_objects":368,"num_object_clones":0,"num_object_copies":736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":368,"num_whiteouts":0,"num_read":36285,"num_read_kb":1921539,"num_write":72266,"num_write_kb":2133559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":135979008,"data_stored":134744558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3853,"ondisk_log_size":3853,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":193499,"num_write":190,"num_write_kb":135054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":193436,"num_write":190,"num_write_kb":135054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510011,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":288164,"kb_used_data":14036,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94083676,"statfs":{"total":96636764160,"available":96341684224,"internally_reserved":0,"allocated":14372864,"data_stored":12670188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510010,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249776,"kb_used_data":20064,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94122064,"statfs":{"total":96636764160,"available":96380993536,"internally_reserved":0,"allocated":20545536,"data_stored":18946545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":235207113},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510010,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":157332,"kb_used_data":27652,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94214508,"statfs":{"total":96636764160,"available":96475656192,"internally_reserved":0,"allocated":28315648,"data_stored":26521673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510011,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111496,"kb_used_data":26168,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94260344,"statfs":{"total":96636764160,"available":96522592256,"internally_reserved":0,"allocated":26796032,"data_stored":25204103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542715,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284100,"kb_used_data":28020,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94087740,"statfs":{"total":96636764160,"available":96345845760,"internally_reserved":0,"allocated":28692480,"data_stored":26984275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":262207943},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542713,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":97864,"kb_used_data":12600,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94273976,"statfs":{"total":96636764160,"available":96536551424,"internally_reserved":0,"allocated":12902400,"data_stored":11301467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542714,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148312,"kb_used_data":8904,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94223528,"statfs":{"total":96636764160,"available":96484892672,"internally_reserved":0,"allocated":9117696,"data_stored":7484684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542715,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255332,"kb_used_data":25620,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94116508,"statfs":{"total":96636764160,"available":96375304192,"internally_reserved":0,"allocated":26234880,"data_stored":24489485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21905408,"data_stored":21688322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5402624,"data_stored":5276127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9211904,"data_stored":9091208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24948736,"data_stored":24773620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":23130112,"data_stored":22997083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24514560,"data_stored":24310448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16838656,"data_stored":16736762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10027008,"data_stored":9870988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":5044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":5163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:05:08.782 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.782 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.783 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.783 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.783 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.783 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.783 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.783 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.783 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.784 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.784 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.784 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.784 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.784 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.784 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.784 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.784 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.785 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.785 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.785 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.785 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.785 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.785 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.785 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.785 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.786 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.786 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.786 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.786 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.786 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.786 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.786 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.786 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.787 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.787 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.787 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.787 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.787 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.787 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.787 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.788 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.788 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.788 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.788 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.788 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.788 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.788 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.788 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.789 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.789 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.789 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.789 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.789 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.789 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.789 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.790 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.790 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.790 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.790 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.790 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.790 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.790 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.790 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.790 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.791 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.791 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.791 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.791 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.791 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.791 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.791 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.791 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.792 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.792 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.792 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.792 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.792 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.792 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.792 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.793 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.793 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.793 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.793 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.793 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.793 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.793 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.793 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.794 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.794 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.794 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.794 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.794 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.794 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.794 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.794 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.795 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.795 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.795 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.795 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.795 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.795 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.795 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.795 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.796 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.796 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.796 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.796 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.796 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.796 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.796 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.797 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.797 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.797 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.797 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.797 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.797 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.797 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.798 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.798 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.798 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.798 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.798 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.798 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.798 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.798 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.799 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.799 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.799 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.799 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.800 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.800 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.800 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.800 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.800 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.800 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.800 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.801 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.801 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.801 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.801 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.801 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.801 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.801 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.802 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.802 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.802 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.802 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.802 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.802 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.803 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.803 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.803 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.803 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.803 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.803 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.803 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.804 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.804 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.804 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.804 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.804 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.804 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.805 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.805 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.805 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.805 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.805 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.805 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.806 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.806 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.806 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.806 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.806 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.806 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.807 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.807 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.807 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.807 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.807 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.807 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.808 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.808 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.808 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.808 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.808 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.808 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.808 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.809 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.809 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.809 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.809 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.809 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.809 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.809 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.810 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.810 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.810 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.810 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.810 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.810 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.811 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.811 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.811 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.811 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.811 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.811 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.811 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.811 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.812 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.812 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.812 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.812 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.812 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.812 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.813 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.813 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.813 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.813 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.813 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T00:18:25.826931+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=25, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.813 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.813 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.814 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.814 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:18:27.833575+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.814 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:18:29.851655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.814 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.815 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T00:18:23.820069+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:08.815 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:05:28.816 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:05:29.194 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:05:29.209 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-12T01:05:29.227 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":1684,"stamp":"2024-09-12T01:05:28.065003+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":69570780,"num_objects":858,"num_object_clones":0,"num_object_copies":1716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":858,"num_whiteouts":0,"num_read":290173,"num_read_kb":2561350,"num_write":161440,"num_write_kb":2441443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":727605,"num_omap_keys":1778,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13392,"ondisk_log_size":13392,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1596536,"kb_used_data":163064,"kb_used_omap":12,"kb_used_meta":1433331,"kb_avail":753378184,"statfs":{"total":773094113280,"available":771459260416,"internally_reserved":0,"allocated":166977536,"data_stored":153602420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1467731507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":624615,"num_omap_keys":1470,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007950"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.738562+0000","last_change":"2024-09-12T00:46:09.507731+0000","last_active":"2024-09-12T01:01:12.738562+0000","last_peered":"2024-09-12T01:01:12.738562+0000","last_clean":"2024-09-12T01:01:12.738562+0000","last_became_active":"2024-09-12T00:46:09.506992+0000","last_became_peered":"2024-09-12T00:46:09.506992+0000","last_unstale":"2024-09-12T01:01:12.738562+0000","last_undegraded":"2024-09-12T01:01:12.738562+0000","last_fullsized":"2024-09-12T01:01:12.738562+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:58.022915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"265'8","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:27.755817+0000","last_change":"2024-09-12T00:34:55.237418+0000","last_active":"2024-09-12T01:02:27.755817+0000","last_peered":"2024-09-12T01:02:27.755817+0000","last_clean":"2024-09-12T01:02:27.755817+0000","last_became_active":"2024-09-12T00:34:55.236531+0000","last_became_peered":"2024-09-12T00:34:55.236531+0000","last_unstale":"2024-09-12T01:02:27.755817+0000","last_undegraded":"2024-09-12T01:02:27.755817+0000","last_fullsized":"2024-09-12T01:02:27.755817+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"268'4","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.847819+0000","last_change":"2024-09-12T00:34:52.172747+0000","last_active":"2024-09-12T01:04:39.847819+0000","last_peered":"2024-09-12T01:04:39.847819+0000","last_clean":"2024-09-12T01:04:39.847819+0000","last_became_active":"2024-09-12T00:34:52.171918+0000","last_became_peered":"2024-09-12T00:34:52.171918+0000","last_unstale":"2024-09-12T01:04:39.847819+0000","last_undegraded":"2024-09-12T01:04:39.847819+0000","last_fullsized":"2024-09-12T01:04:39.847819+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4100,"num_write":4,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'30","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.578508+0000","last_change":"2024-09-12T00:33:10.849736+0000","last_active":"2024-09-12T01:02:21.578508+0000","last_peered":"2024-09-12T01:02:21.578508+0000","last_clean":"2024-09-12T01:02:21.578508+0000","last_became_active":"2024-09-12T00:33:10.848975+0000","last_became_peered":"2024-09-12T00:33:10.848975+0000","last_unstale":"2024-09-12T01:02:21.578508+0000","last_undegraded":"2024-09-12T01:02:21.578508+0000","last_fullsized":"2024-09-12T01:02:21.578508+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:54.113531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":60,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:16.465361+0000","last_change":"2024-09-12T01:05:16.465361+0000","last_active":"2024-09-12T01:05:16.465361+0000","last_peered":"2024-09-12T01:05:16.465361+0000","last_clean":"2024-09-12T01:05:16.465361+0000","last_became_active":"2024-09-12T00:46:09.509800+0000","last_became_peered":"2024-09-12T00:46:09.509800+0000","last_unstale":"2024-09-12T01:05:16.465361+0000","last_undegraded":"2024-09-12T01:05:16.465361+0000","last_fullsized":"2024-09-12T01:05:16.465361+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:16.465170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:16.465170+0000","last_clean_scrub_stamp":"2024-09-12T01:05:16.465170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:15.986937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'7","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.680752+0000","last_change":"2024-09-12T00:34:55.233869+0000","last_active":"2024-09-12T01:04:38.680752+0000","last_peered":"2024-09-12T01:04:38.680752+0000","last_clean":"2024-09-12T01:04:38.680752+0000","last_became_active":"2024-09-12T00:34:55.232607+0000","last_became_peered":"2024-09-12T00:34:55.232607+0000","last_unstale":"2024-09-12T01:04:38.680752+0000","last_undegraded":"2024-09-12T01:04:38.680752+0000","last_fullsized":"2024-09-12T01:04:38.680752+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"268'2","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.536885+0000","last_change":"2024-09-12T01:05:20.536885+0000","last_active":"2024-09-12T01:05:20.536885+0000","last_peered":"2024-09-12T01:05:20.536885+0000","last_clean":"2024-09-12T01:05:20.536885+0000","last_became_active":"2024-09-12T00:34:52.210935+0000","last_became_peered":"2024-09-12T00:34:52.210935+0000","last_unstale":"2024-09-12T01:05:20.536885+0000","last_undegraded":"2024-09-12T01:05:20.536885+0000","last_fullsized":"2024-09-12T01:05:20.536885+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:20.536676+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:20.536676+0000","last_clean_scrub_stamp":"2024-09-12T01:05:20.536676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:56.161540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'30","reported_seq":139,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:08.468289+0000","last_change":"2024-09-12T01:05:08.468010+0000","last_active":"2024-09-12T01:05:08.468289+0000","last_peered":"2024-09-12T01:05:08.468289+0000","last_clean":"2024-09-12T01:05:08.468289+0000","last_became_active":"2024-09-12T00:33:10.851334+0000","last_became_peered":"2024-09-12T00:33:10.851334+0000","last_unstale":"2024-09-12T01:05:08.468289+0000","last_undegraded":"2024-09-12T01:05:08.468289+0000","last_fullsized":"2024-09-12T01:05:08.468289+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'30","last_scrub_stamp":"2024-09-12T01:05:08.467746+0000","last_deep_scrub":"268'30","last_deep_scrub_stamp":"2024-09-12T01:05:08.467746+0000","last_clean_scrub_stamp":"2024-09-12T01:05:08.467746+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:53.379179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":55,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:24.886923+0000","last_change":"2024-09-12T01:05:24.886923+0000","last_active":"2024-09-12T01:05:24.886923+0000","last_peered":"2024-09-12T01:05:24.886923+0000","last_clean":"2024-09-12T01:05:24.886923+0000","last_became_active":"2024-09-12T00:46:09.507324+0000","last_became_peered":"2024-09-12T00:46:09.507324+0000","last_unstale":"2024-09-12T01:05:24.886923+0000","last_undegraded":"2024-09-12T01:05:24.886923+0000","last_fullsized":"2024-09-12T01:05:24.886923+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:24.886644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:24.886644+0000","last_clean_scrub_stamp":"2024-09-12T01:05:24.886644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:27.230356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"268'2","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:06.601735+0000","last_change":"2024-09-12T00:34:55.253609+0000","last_active":"2024-09-12T01:04:06.601735+0000","last_peered":"2024-09-12T01:04:06.601735+0000","last_clean":"2024-09-12T01:04:06.601735+0000","last_became_active":"2024-09-12T00:34:55.252880+0000","last_became_peered":"2024-09-12T00:34:55.252880+0000","last_unstale":"2024-09-12T01:04:06.601735+0000","last_undegraded":"2024-09-12T01:04:06.601735+0000","last_fullsized":"2024-09-12T01:04:06.601735+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:39.510072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"268'2","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.410136+0000","last_change":"2024-09-12T01:05:13.410136+0000","last_active":"2024-09-12T01:05:13.410136+0000","last_peered":"2024-09-12T01:05:13.410136+0000","last_clean":"2024-09-12T01:05:13.410136+0000","last_became_active":"2024-09-12T00:34:52.195513+0000","last_became_peered":"2024-09-12T00:34:52.195513+0000","last_unstale":"2024-09-12T01:05:13.410136+0000","last_undegraded":"2024-09-12T01:05:13.410136+0000","last_fullsized":"2024-09-12T01:05:13.410136+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:13.409950+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:13.409950+0000","last_clean_scrub_stamp":"2024-09-12T01:05:13.409950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:56.054807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'20","reported_seq":99,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.549669+0000","last_change":"2024-09-12T00:33:10.848259+0000","last_active":"2024-09-12T01:00:41.549669+0000","last_peered":"2024-09-12T01:00:41.549669+0000","last_clean":"2024-09-12T01:00:41.549669+0000","last_became_active":"2024-09-12T00:33:10.847432+0000","last_became_peered":"2024-09-12T00:33:10.847432+0000","last_unstale":"2024-09-12T01:00:41.549669+0000","last_undegraded":"2024-09-12T01:00:41.549669+0000","last_fullsized":"2024-09-12T01:00:41.549669+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:33.335638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":67,"num_write":46,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:46.737552+0000","last_change":"2024-09-12T00:46:09.497586+0000","last_active":"2024-09-12T01:00:46.737552+0000","last_peered":"2024-09-12T01:00:46.737552+0000","last_clean":"2024-09-12T01:00:46.737552+0000","last_became_active":"2024-09-12T00:46:09.496807+0000","last_became_peered":"2024-09-12T00:46:09.496807+0000","last_unstale":"2024-09-12T01:00:46.737552+0000","last_undegraded":"2024-09-12T01:00:46.737552+0000","last_fullsized":"2024-09-12T01:00:46.737552+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:06.744888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.772254+0000","last_change":"2024-09-12T00:34:55.248775+0000","last_active":"2024-09-12T01:03:01.772254+0000","last_peered":"2024-09-12T01:03:01.772254+0000","last_clean":"2024-09-12T01:03:01.772254+0000","last_became_active":"2024-09-12T00:34:55.248058+0000","last_became_peered":"2024-09-12T00:34:55.248058+0000","last_unstale":"2024-09-12T01:03:01.772254+0000","last_undegraded":"2024-09-12T01:03:01.772254+0000","last_fullsized":"2024-09-12T01:03:01.772254+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"268'8","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:02.575836+0000","last_change":"2024-09-12T00:34:52.170876+0000","last_active":"2024-09-12T01:04:02.575836+0000","last_peered":"2024-09-12T01:04:02.575836+0000","last_clean":"2024-09-12T01:04:02.575836+0000","last_became_active":"2024-09-12T00:34:52.170013+0000","last_became_peered":"2024-09-12T00:34:52.170013+0000","last_unstale":"2024-09-12T01:04:02.575836+0000","last_undegraded":"2024-09-12T01:04:02.575836+0000","last_fullsized":"2024-09-12T01:04:02.575836+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:37.972262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10242,"num_write":8,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'17","reported_seq":88,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:20.286340+0000","last_change":"2024-09-12T00:33:10.840336+0000","last_active":"2024-09-12T01:02:20.286340+0000","last_peered":"2024-09-12T01:02:20.286340+0000","last_clean":"2024-09-12T01:02:20.286340+0000","last_became_active":"2024-09-12T00:33:10.839248+0000","last_became_peered":"2024-09-12T00:33:10.839248+0000","last_unstale":"2024-09-12T01:02:20.286340+0000","last_undegraded":"2024-09-12T01:02:20.286340+0000","last_fullsized":"2024-09-12T01:02:20.286340+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:57.557088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":49,"num_write":38,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:16.761099+0000","last_change":"2024-09-12T00:46:09.501613+0000","last_active":"2024-09-12T01:02:16.761099+0000","last_peered":"2024-09-12T01:02:16.761099+0000","last_clean":"2024-09-12T01:02:16.761099+0000","last_became_active":"2024-09-12T00:46:09.499830+0000","last_became_peered":"2024-09-12T00:46:09.499830+0000","last_unstale":"2024-09-12T01:02:16.761099+0000","last_undegraded":"2024-09-12T01:02:16.761099+0000","last_fullsized":"2024-09-12T01:02:16.761099+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:10.541266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"268'4","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.680406+0000","last_change":"2024-09-12T00:34:55.242753+0000","last_active":"2024-09-12T01:04:38.680406+0000","last_peered":"2024-09-12T01:04:38.680406+0000","last_clean":"2024-09-12T01:04:38.680406+0000","last_became_active":"2024-09-12T00:34:55.242012+0000","last_became_peered":"2024-09-12T00:34:55.242012+0000","last_unstale":"2024-09-12T01:04:38.680406+0000","last_undegraded":"2024-09-12T01:04:38.680406+0000","last_fullsized":"2024-09-12T01:04:38.680406+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:49.280445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'7","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:51.599019+0000","last_change":"2024-09-12T00:34:52.206650+0000","last_active":"2024-09-12T01:03:51.599019+0000","last_peered":"2024-09-12T01:03:51.599019+0000","last_clean":"2024-09-12T01:03:51.599019+0000","last_became_active":"2024-09-12T00:34:52.205385+0000","last_became_peered":"2024-09-12T00:34:52.205385+0000","last_unstale":"2024-09-12T01:03:51.599019+0000","last_undegraded":"2024-09-12T01:03:51.599019+0000","last_fullsized":"2024-09-12T01:03:51.599019+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:45.297232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4098,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'48","reported_seq":172,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.736371+0000","last_change":"2024-09-12T00:33:10.843742+0000","last_active":"2024-09-12T01:00:41.736371+0000","last_peered":"2024-09-12T01:00:41.736371+0000","last_clean":"2024-09-12T01:00:41.736371+0000","last_became_active":"2024-09-12T00:33:10.842427+0000","last_became_peered":"2024-09-12T00:33:10.842427+0000","last_unstale":"2024-09-12T01:00:41.736371+0000","last_undegraded":"2024-09-12T01:00:41.736371+0000","last_fullsized":"2024-09-12T01:00:41.736371+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:10.839165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":162,"num_write":92,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.564631+0000","last_change":"2024-09-12T00:46:09.514586+0000","last_active":"2024-09-12T01:02:51.564631+0000","last_peered":"2024-09-12T01:02:51.564631+0000","last_clean":"2024-09-12T01:02:51.564631+0000","last_became_active":"2024-09-12T00:46:09.513617+0000","last_became_peered":"2024-09-12T00:46:09.513617+0000","last_unstale":"2024-09-12T01:02:51.564631+0000","last_undegraded":"2024-09-12T01:02:51.564631+0000","last_fullsized":"2024-09-12T01:02:51.564631+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"265'7","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:21.851883+0000","last_change":"2024-09-12T01:05:21.851883+0000","last_active":"2024-09-12T01:05:21.851883+0000","last_peered":"2024-09-12T01:05:21.851883+0000","last_clean":"2024-09-12T01:05:21.851883+0000","last_became_active":"2024-09-12T00:35:57.345894+0000","last_became_peered":"2024-09-12T00:35:57.345894+0000","last_unstale":"2024-09-12T01:05:21.851883+0000","last_undegraded":"2024-09-12T01:05:21.851883+0000","last_fullsized":"2024-09-12T01:05:21.851883+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T01:05:21.851685+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T01:05:21.851685+0000","last_clean_scrub_stamp":"2024-09-12T01:05:21.851685+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:25.738345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"265'2","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:37.541584+0000","last_change":"2024-09-12T00:34:52.189042+0000","last_active":"2024-09-12T01:01:37.541584+0000","last_peered":"2024-09-12T01:01:37.541584+0000","last_clean":"2024-09-12T01:01:37.541584+0000","last_became_active":"2024-09-12T00:34:52.188352+0000","last_became_peered":"2024-09-12T00:34:52.188352+0000","last_unstale":"2024-09-12T01:01:37.541584+0000","last_undegraded":"2024-09-12T01:01:37.541584+0000","last_fullsized":"2024-09-12T01:01:37.541584+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:23.453176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'29","reported_seq":133,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:15.790576+0000","last_change":"2024-09-12T01:05:15.790576+0000","last_active":"2024-09-12T01:05:15.790576+0000","last_peered":"2024-09-12T01:05:15.790576+0000","last_clean":"2024-09-12T01:05:15.790576+0000","last_became_active":"2024-09-12T00:33:10.845301+0000","last_became_peered":"2024-09-12T00:33:10.845301+0000","last_unstale":"2024-09-12T01:05:15.790576+0000","last_undegraded":"2024-09-12T01:05:15.790576+0000","last_fullsized":"2024-09-12T01:05:15.790576+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'29","last_scrub_stamp":"2024-09-12T01:05:15.790376+0000","last_deep_scrub":"268'29","last_deep_scrub_stamp":"2024-09-12T01:05:15.790376+0000","last_clean_scrub_stamp":"2024-09-12T01:05:15.790376+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:15.531192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.534764+0000","last_change":"2024-09-12T00:46:09.499014+0000","last_active":"2024-09-12T01:01:12.534764+0000","last_peered":"2024-09-12T01:01:12.534764+0000","last_clean":"2024-09-12T01:01:12.534764+0000","last_became_active":"2024-09-12T00:46:09.498002+0000","last_became_peered":"2024-09-12T00:46:09.498002+0000","last_unstale":"2024-09-12T01:01:12.534764+0000","last_undegraded":"2024-09-12T01:01:12.534764+0000","last_fullsized":"2024-09-12T01:01:12.534764+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:50.022966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:22.873969+0000","last_change":"2024-09-12T01:05:22.873969+0000","last_active":"2024-09-12T01:05:22.873969+0000","last_peered":"2024-09-12T01:05:22.873969+0000","last_clean":"2024-09-12T01:05:22.873969+0000","last_became_active":"2024-09-12T00:34:55.215076+0000","last_became_peered":"2024-09-12T00:34:55.215076+0000","last_unstale":"2024-09-12T01:05:22.873969+0000","last_undegraded":"2024-09-12T01:05:22.873969+0000","last_fullsized":"2024-09-12T01:05:22.873969+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:22.873768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:22.873768+0000","last_clean_scrub_stamp":"2024-09-12T01:05:22.873768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:09.281488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"265'2","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:22.554222+0000","last_change":"2024-09-12T00:34:52.199214+0000","last_active":"2024-09-12T01:02:22.554222+0000","last_peered":"2024-09-12T01:02:22.554222+0000","last_clean":"2024-09-12T01:02:22.554222+0000","last_became_active":"2024-09-12T00:34:52.198548+0000","last_became_peered":"2024-09-12T00:34:52.198548+0000","last_unstale":"2024-09-12T01:02:22.554222+0000","last_undegraded":"2024-09-12T01:02:22.554222+0000","last_fullsized":"2024-09-12T01:02:22.554222+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'18","reported_seq":102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:26.037683+0000","last_change":"2024-09-12T01:05:26.037683+0000","last_active":"2024-09-12T01:05:26.037683+0000","last_peered":"2024-09-12T01:05:26.037683+0000","last_clean":"2024-09-12T01:05:26.037683+0000","last_became_active":"2024-09-12T00:33:10.856664+0000","last_became_peered":"2024-09-12T00:33:10.856664+0000","last_unstale":"2024-09-12T01:05:26.037683+0000","last_undegraded":"2024-09-12T01:05:26.037683+0000","last_fullsized":"2024-09-12T01:05:26.037683+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'18","last_scrub_stamp":"2024-09-12T01:05:26.037503+0000","last_deep_scrub":"268'18","last_deep_scrub_stamp":"2024-09-12T01:05:26.037503+0000","last_clean_scrub_stamp":"2024-09-12T01:05:26.037503+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:13.232142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":59,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.534815+0000","last_change":"2024-09-12T00:46:09.504100+0000","last_active":"2024-09-12T01:01:12.534815+0000","last_peered":"2024-09-12T01:01:12.534815+0000","last_clean":"2024-09-12T01:01:12.534815+0000","last_became_active":"2024-09-12T00:46:09.503361+0000","last_became_peered":"2024-09-12T00:46:09.503361+0000","last_unstale":"2024-09-12T01:01:12.534815+0000","last_undegraded":"2024-09-12T01:01:12.534815+0000","last_fullsized":"2024-09-12T01:01:12.534815+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:15.687886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":35,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:26.763689+0000","last_change":"2024-09-12T00:34:55.217786+0000","last_active":"2024-09-12T01:02:26.763689+0000","last_peered":"2024-09-12T01:02:26.763689+0000","last_clean":"2024-09-12T01:02:26.763689+0000","last_became_active":"2024-09-12T00:34:55.217009+0000","last_became_peered":"2024-09-12T00:34:55.217009+0000","last_unstale":"2024-09-12T01:02:26.763689+0000","last_undegraded":"2024-09-12T01:02:26.763689+0000","last_fullsized":"2024-09-12T01:02:26.763689+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"268'2","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.048272+0000","last_change":"2024-09-12T00:34:52.206482+0000","last_active":"2024-09-12T01:04:39.048272+0000","last_peered":"2024-09-12T01:04:39.048272+0000","last_clean":"2024-09-12T01:04:39.048272+0000","last_became_active":"2024-09-12T00:34:52.202432+0000","last_became_peered":"2024-09-12T00:34:52.202432+0000","last_unstale":"2024-09-12T01:04:39.048272+0000","last_undegraded":"2024-09-12T01:04:39.048272+0000","last_fullsized":"2024-09-12T01:04:39.048272+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"268'46","reported_seq":182,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:15.436101+0000","last_change":"2024-09-12T01:05:15.436101+0000","last_active":"2024-09-12T01:05:15.436101+0000","last_peered":"2024-09-12T01:05:15.436101+0000","last_clean":"2024-09-12T01:05:15.436101+0000","last_became_active":"2024-09-12T00:33:10.846370+0000","last_became_peered":"2024-09-12T00:33:10.846370+0000","last_unstale":"2024-09-12T01:05:15.436101+0000","last_undegraded":"2024-09-12T01:05:15.436101+0000","last_fullsized":"2024-09-12T01:05:15.436101+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'46","last_scrub_stamp":"2024-09-12T01:05:15.435917+0000","last_deep_scrub":"268'46","last_deep_scrub_stamp":"2024-09-12T01:05:15.435917+0000","last_clean_scrub_stamp":"2024-09-12T01:05:15.435917+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:19.663406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":168,"num_write":82,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:31.559756+0000","last_change":"2024-09-12T00:46:09.494884+0000","last_active":"2024-09-12T01:02:31.559756+0000","last_peered":"2024-09-12T01:02:31.559756+0000","last_clean":"2024-09-12T01:02:31.559756+0000","last_became_active":"2024-09-12T00:46:09.494139+0000","last_became_peered":"2024-09-12T00:46:09.494139+0000","last_unstale":"2024-09-12T01:02:31.559756+0000","last_undegraded":"2024-09-12T01:02:31.559756+0000","last_fullsized":"2024-09-12T01:02:31.559756+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":35,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:31.748997+0000","last_change":"2024-09-12T00:34:55.253827+0000","last_active":"2024-09-12T01:01:31.748997+0000","last_peered":"2024-09-12T01:01:31.748997+0000","last_clean":"2024-09-12T01:01:31.748997+0000","last_became_active":"2024-09-12T00:34:55.253209+0000","last_became_peered":"2024-09-12T00:34:55.253209+0000","last_unstale":"2024-09-12T01:01:31.748997+0000","last_undegraded":"2024-09-12T01:01:31.748997+0000","last_fullsized":"2024-09-12T01:01:31.748997+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:58.016129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'2","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.096371+0000","last_change":"2024-09-12T00:34:52.180802+0000","last_active":"2024-09-12T01:04:39.096371+0000","last_peered":"2024-09-12T01:04:39.096371+0000","last_clean":"2024-09-12T01:04:39.096371+0000","last_became_active":"2024-09-12T00:34:52.180036+0000","last_became_peered":"2024-09-12T00:34:52.180036+0000","last_unstale":"2024-09-12T01:04:39.096371+0000","last_undegraded":"2024-09-12T01:04:39.096371+0000","last_fullsized":"2024-09-12T01:04:39.096371+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'75","reported_seq":263,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.576052+0000","last_change":"2024-09-12T00:33:10.852500+0000","last_active":"2024-09-12T01:02:11.576052+0000","last_peered":"2024-09-12T01:02:11.576052+0000","last_clean":"2024-09-12T01:02:11.576052+0000","last_became_active":"2024-09-12T00:33:10.851672+0000","last_became_peered":"2024-09-12T00:33:10.851672+0000","last_unstale":"2024-09-12T01:02:11.576052+0000","last_undegraded":"2024-09-12T01:02:11.576052+0000","last_fullsized":"2024-09-12T01:02:11.576052+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:45.023568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":415,"num_read_kb":311,"num_write":116,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'2","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:15.446767+0000","last_change":"2024-09-12T01:05:15.446767+0000","last_active":"2024-09-12T01:05:15.446767+0000","last_peered":"2024-09-12T01:05:15.446767+0000","last_clean":"2024-09-12T01:05:15.446767+0000","last_became_active":"2024-09-12T00:46:09.513012+0000","last_became_peered":"2024-09-12T00:46:09.513012+0000","last_unstale":"2024-09-12T01:05:15.446767+0000","last_undegraded":"2024-09-12T01:05:15.446767+0000","last_fullsized":"2024-09-12T01:05:15.446767+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:15.446573+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:15.446573+0000","last_clean_scrub_stamp":"2024-09-12T01:05:15.446573+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:39.377744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"268'8","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.804253+0000","last_change":"2024-09-12T00:34:55.254204+0000","last_active":"2024-09-12T01:04:39.804253+0000","last_peered":"2024-09-12T01:04:39.804253+0000","last_clean":"2024-09-12T01:04:39.804253+0000","last_became_active":"2024-09-12T00:34:55.252580+0000","last_became_peered":"2024-09-12T00:34:55.252580+0000","last_unstale":"2024-09-12T01:04:39.804253+0000","last_undegraded":"2024-09-12T01:04:39.804253+0000","last_fullsized":"2024-09-12T01:04:39.804253+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":14336,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:27.538170+0000","last_change":"2024-09-12T00:34:52.204725+0000","last_active":"2024-09-12T01:01:27.538170+0000","last_peered":"2024-09-12T01:01:27.538170+0000","last_clean":"2024-09-12T01:01:27.538170+0000","last_became_active":"2024-09-12T00:34:52.204021+0000","last_became_peered":"2024-09-12T00:34:52.204021+0000","last_unstale":"2024-09-12T01:01:27.538170+0000","last_undegraded":"2024-09-12T01:01:27.538170+0000","last_fullsized":"2024-09-12T01:01:27.538170+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:45.824620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'35","reported_seq":145,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.759818+0000","last_change":"2024-09-12T00:33:10.850040+0000","last_active":"2024-09-12T01:02:11.759818+0000","last_peered":"2024-09-12T01:02:11.759818+0000","last_clean":"2024-09-12T01:02:11.759818+0000","last_became_active":"2024-09-12T00:33:10.849228+0000","last_became_peered":"2024-09-12T00:33:10.849228+0000","last_unstale":"2024-09-12T01:02:11.759818+0000","last_undegraded":"2024-09-12T01:02:11.759818+0000","last_fullsized":"2024-09-12T01:02:11.759818+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:46.335542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":134,"num_write":61,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:32.552713+0000","last_change":"2024-09-12T00:46:09.500158+0000","last_active":"2024-09-12T01:02:32.552713+0000","last_peered":"2024-09-12T01:02:32.552713+0000","last_clean":"2024-09-12T01:02:32.552713+0000","last_became_active":"2024-09-12T00:46:09.499137+0000","last_became_peered":"2024-09-12T00:46:09.499137+0000","last_unstale":"2024-09-12T01:02:32.552713+0000","last_undegraded":"2024-09-12T01:02:32.552713+0000","last_fullsized":"2024-09-12T01:02:32.552713+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"268'5","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:56.783697+0000","last_change":"2024-09-12T00:34:55.254921+0000","last_active":"2024-09-12T01:03:56.783697+0000","last_peered":"2024-09-12T01:03:56.783697+0000","last_clean":"2024-09-12T01:03:56.783697+0000","last_became_active":"2024-09-12T00:34:55.254250+0000","last_became_peered":"2024-09-12T00:34:55.254250+0000","last_unstale":"2024-09-12T01:03:56.783697+0000","last_undegraded":"2024-09-12T01:03:56.783697+0000","last_fullsized":"2024-09-12T01:03:56.783697+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:45.939058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":318,"num_write":10,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:10.441334+0000","last_change":"2024-09-12T01:05:10.441334+0000","last_active":"2024-09-12T01:05:10.441334+0000","last_peered":"2024-09-12T01:05:10.441334+0000","last_clean":"2024-09-12T01:05:10.441334+0000","last_became_active":"2024-09-12T00:34:52.173822+0000","last_became_peered":"2024-09-12T00:34:52.173822+0000","last_unstale":"2024-09-12T01:05:10.441334+0000","last_undegraded":"2024-09-12T01:05:10.441334+0000","last_fullsized":"2024-09-12T01:05:10.441334+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:10.441147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:10.441147+0000","last_clean_scrub_stamp":"2024-09-12T01:05:10.441147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:46.274029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'34","reported_seq":149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:06.452032+0000","last_change":"2024-09-12T01:05:06.452032+0000","last_active":"2024-09-12T01:05:06.452032+0000","last_peered":"2024-09-12T01:05:06.452032+0000","last_clean":"2024-09-12T01:05:06.452032+0000","last_became_active":"2024-09-12T00:33:10.841363+0000","last_became_peered":"2024-09-12T00:33:10.841363+0000","last_unstale":"2024-09-12T01:05:06.452032+0000","last_undegraded":"2024-09-12T01:05:06.452032+0000","last_fullsized":"2024-09-12T01:05:06.452032+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'34","last_scrub_stamp":"2024-09-12T01:05:06.451823+0000","last_deep_scrub":"268'34","last_deep_scrub_stamp":"2024-09-12T01:05:06.451823+0000","last_clean_scrub_stamp":"2024-09-12T01:05:06.451823+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:26.258682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":128,"num_write":55,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:32.756748+0000","last_change":"2024-09-12T00:46:09.506737+0000","last_active":"2024-09-12T01:02:32.756748+0000","last_peered":"2024-09-12T01:02:32.756748+0000","last_clean":"2024-09-12T01:02:32.756748+0000","last_became_active":"2024-09-12T00:46:09.502684+0000","last_became_peered":"2024-09-12T00:46:09.502684+0000","last_unstale":"2024-09-12T01:02:32.756748+0000","last_undegraded":"2024-09-12T01:02:32.756748+0000","last_fullsized":"2024-09-12T01:02:32.756748+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"268'8","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.805326+0000","last_change":"2024-09-12T00:34:55.227141+0000","last_active":"2024-09-12T01:04:39.805326+0000","last_peered":"2024-09-12T01:04:39.805326+0000","last_clean":"2024-09-12T01:04:39.805326+0000","last_became_active":"2024-09-12T00:34:55.226388+0000","last_became_peered":"2024-09-12T00:34:55.226388+0000","last_unstale":"2024-09-12T01:04:39.805326+0000","last_undegraded":"2024-09-12T01:04:39.805326+0000","last_fullsized":"2024-09-12T01:04:39.805326+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:59.431333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":16384,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"268'11","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:51.599165+0000","last_change":"2024-09-12T00:34:52.197590+0000","last_active":"2024-09-12T01:03:51.599165+0000","last_peered":"2024-09-12T01:03:51.599165+0000","last_clean":"2024-09-12T01:03:51.599165+0000","last_became_active":"2024-09-12T00:34:52.196770+0000","last_became_peered":"2024-09-12T00:34:52.196770+0000","last_unstale":"2024-09-12T01:03:51.599165+0000","last_undegraded":"2024-09-12T01:03:51.599165+0000","last_fullsized":"2024-09-12T01:03:51.599165+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:15.638504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":25602,"num_write":16,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'4","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.397069+0000","last_change":"2024-09-12T01:05:25.397069+0000","last_active":"2024-09-12T01:05:25.397069+0000","last_peered":"2024-09-12T01:05:25.397069+0000","last_clean":"2024-09-12T01:05:25.397069+0000","last_became_active":"2024-09-12T00:33:10.858178+0000","last_became_peered":"2024-09-12T00:33:10.858178+0000","last_unstale":"2024-09-12T01:05:25.397069+0000","last_undegraded":"2024-09-12T01:05:25.397069+0000","last_fullsized":"2024-09-12T01:05:25.397069+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:05:25.396886+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:05:25.396886+0000","last_clean_scrub_stamp":"2024-09-12T01:05:25.396886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:56.723053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.736528+0000","last_change":"2024-09-12T00:46:09.522998+0000","last_active":"2024-09-12T01:00:41.736528+0000","last_peered":"2024-09-12T01:00:41.736528+0000","last_clean":"2024-09-12T01:00:41.736528+0000","last_became_active":"2024-09-12T00:46:09.521706+0000","last_became_peered":"2024-09-12T00:46:09.521706+0000","last_unstale":"2024-09-12T01:00:41.736528+0000","last_undegraded":"2024-09-12T01:00:41.736528+0000","last_fullsized":"2024-09-12T01:00:41.736528+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:39.145979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"268'4","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:24.561794+0000","last_change":"2024-09-12T01:05:24.561794+0000","last_active":"2024-09-12T01:05:24.561794+0000","last_peered":"2024-09-12T01:05:24.561794+0000","last_clean":"2024-09-12T01:05:24.561794+0000","last_became_active":"2024-09-12T00:34:55.223787+0000","last_became_peered":"2024-09-12T00:34:55.223787+0000","last_unstale":"2024-09-12T01:05:24.561794+0000","last_undegraded":"2024-09-12T01:05:24.561794+0000","last_fullsized":"2024-09-12T01:05:24.561794+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:05:24.561614+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:05:24.561614+0000","last_clean_scrub_stamp":"2024-09-12T01:05:24.561614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:31.053640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"268'6","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:27.256425+0000","last_change":"2024-09-12T01:05:27.256425+0000","last_active":"2024-09-12T01:05:27.256425+0000","last_peered":"2024-09-12T01:05:27.256425+0000","last_clean":"2024-09-12T01:05:27.256425+0000","last_became_active":"2024-09-12T00:34:52.183982+0000","last_became_peered":"2024-09-12T00:34:52.183982+0000","last_unstale":"2024-09-12T01:05:27.256425+0000","last_undegraded":"2024-09-12T01:05:27.256425+0000","last_fullsized":"2024-09-12T01:05:27.256425+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T01:05:27.256194+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T01:05:27.256194+0000","last_clean_scrub_stamp":"2024-09-12T01:05:27.256194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:57.757429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5649,"num_write":6,"num_write_kb":5649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'25","reported_seq":123,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:24.390888+0000","last_change":"2024-09-12T01:05:24.390888+0000","last_active":"2024-09-12T01:05:24.390888+0000","last_peered":"2024-09-12T01:05:24.390888+0000","last_clean":"2024-09-12T01:05:24.390888+0000","last_became_active":"2024-09-12T00:33:10.858212+0000","last_became_peered":"2024-09-12T00:33:10.858212+0000","last_unstale":"2024-09-12T01:05:24.390888+0000","last_undegraded":"2024-09-12T01:05:24.390888+0000","last_fullsized":"2024-09-12T01:05:24.390888+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'25","last_scrub_stamp":"2024-09-12T01:05:24.390620+0000","last_deep_scrub":"268'25","last_deep_scrub_stamp":"2024-09-12T01:05:24.390620+0000","last_clean_scrub_stamp":"2024-09-12T01:05:24.390620+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:50.472958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":92,"num_write":42,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.549794+0000","last_change":"2024-09-12T00:46:09.518627+0000","last_active":"2024-09-12T01:00:41.549794+0000","last_peered":"2024-09-12T01:00:41.549794+0000","last_clean":"2024-09-12T01:00:41.549794+0000","last_became_active":"2024-09-12T00:46:09.517833+0000","last_became_peered":"2024-09-12T00:46:09.517833+0000","last_unstale":"2024-09-12T01:00:41.549794+0000","last_undegraded":"2024-09-12T01:00:41.549794+0000","last_fullsized":"2024-09-12T01:00:41.549794+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:23.918442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'9","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.519111+0000","last_change":"2024-09-12T01:05:25.519111+0000","last_active":"2024-09-12T01:05:25.519111+0000","last_peered":"2024-09-12T01:05:25.519111+0000","last_clean":"2024-09-12T01:05:25.519111+0000","last_became_active":"2024-09-12T00:34:55.226334+0000","last_became_peered":"2024-09-12T00:34:55.226334+0000","last_unstale":"2024-09-12T01:05:25.519111+0000","last_undegraded":"2024-09-12T01:05:25.519111+0000","last_fullsized":"2024-09-12T01:05:25.519111+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-12T01:05:25.518883+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-12T01:05:25.518883+0000","last_clean_scrub_stamp":"2024-09-12T01:05:25.518883+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:34.088936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":14,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'6","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.552963+0000","last_change":"2024-09-12T00:34:52.179045+0000","last_active":"2024-09-12T01:04:39.552963+0000","last_peered":"2024-09-12T01:04:39.552963+0000","last_clean":"2024-09-12T01:04:39.552963+0000","last_became_active":"2024-09-12T00:34:52.174421+0000","last_became_peered":"2024-09-12T00:34:52.174421+0000","last_unstale":"2024-09-12T01:04:39.552963+0000","last_undegraded":"2024-09-12T01:04:39.552963+0000","last_fullsized":"2024-09-12T01:04:39.552963+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5438,"num_write":6,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"268'52","reported_seq":187,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:21.554333+0000","last_change":"2024-09-12T00:33:10.849621+0000","last_active":"2024-09-12T01:02:21.554333+0000","last_peered":"2024-09-12T01:02:21.554333+0000","last_clean":"2024-09-12T01:02:21.554333+0000","last_became_active":"2024-09-12T00:33:10.848890+0000","last_became_peered":"2024-09-12T00:33:10.848890+0000","last_unstale":"2024-09-12T01:02:21.554333+0000","last_undegraded":"2024-09-12T01:02:21.554333+0000","last_fullsized":"2024-09-12T01:02:21.554333+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:26.708631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":180,"num_write":98,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:36.582160+0000","last_change":"2024-09-12T00:46:09.521885+0000","last_active":"2024-09-12T01:02:36.582160+0000","last_peered":"2024-09-12T01:02:36.582160+0000","last_clean":"2024-09-12T01:02:36.582160+0000","last_became_active":"2024-09-12T00:46:09.521575+0000","last_became_peered":"2024-09-12T00:46:09.521575+0000","last_unstale":"2024-09-12T01:02:36.582160+0000","last_undegraded":"2024-09-12T01:02:36.582160+0000","last_fullsized":"2024-09-12T01:02:36.582160+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"268'7","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.847289+0000","last_change":"2024-09-12T00:34:55.233021+0000","last_active":"2024-09-12T01:04:39.847289+0000","last_peered":"2024-09-12T01:04:39.847289+0000","last_clean":"2024-09-12T01:04:39.847289+0000","last_became_active":"2024-09-12T00:34:55.232215+0000","last_became_peered":"2024-09-12T00:34:55.232215+0000","last_unstale":"2024-09-12T01:04:39.847289+0000","last_undegraded":"2024-09-12T01:04:39.847289+0000","last_fullsized":"2024-09-12T01:04:39.847289+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8310,"num_write":12,"num_write_kb":8251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"268'4","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:16.824227+0000","last_change":"2024-09-12T01:05:16.824227+0000","last_active":"2024-09-12T01:05:16.824227+0000","last_peered":"2024-09-12T01:05:16.824227+0000","last_clean":"2024-09-12T01:05:16.824227+0000","last_became_active":"2024-09-12T00:34:52.199793+0000","last_became_peered":"2024-09-12T00:34:52.199793+0000","last_unstale":"2024-09-12T01:05:16.824227+0000","last_undegraded":"2024-09-12T01:05:16.824227+0000","last_fullsized":"2024-09-12T01:05:16.824227+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:05:16.824038+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:05:16.824038+0000","last_clean_scrub_stamp":"2024-09-12T01:05:16.824038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:55.744048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'20","reported_seq":111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.166037+0000","last_change":"2024-09-12T01:05:25.166037+0000","last_active":"2024-09-12T01:05:25.166037+0000","last_peered":"2024-09-12T01:05:25.166037+0000","last_clean":"2024-09-12T01:05:25.166037+0000","last_became_active":"2024-09-12T00:33:10.844957+0000","last_became_peered":"2024-09-12T00:33:10.844957+0000","last_unstale":"2024-09-12T01:05:25.166037+0000","last_undegraded":"2024-09-12T01:05:25.166037+0000","last_fullsized":"2024-09-12T01:05:25.166037+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'20","last_scrub_stamp":"2024-09-12T01:05:25.165837+0000","last_deep_scrub":"268'20","last_deep_scrub_stamp":"2024-09-12T01:05:25.165837+0000","last_clean_scrub_stamp":"2024-09-12T01:05:25.165837+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:53.854836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":73,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.736485+0000","last_change":"2024-09-12T00:46:09.515049+0000","last_active":"2024-09-12T01:00:41.736485+0000","last_peered":"2024-09-12T01:00:41.736485+0000","last_clean":"2024-09-12T01:00:41.736485+0000","last_became_active":"2024-09-12T00:46:09.514727+0000","last_became_peered":"2024-09-12T00:46:09.514727+0000","last_unstale":"2024-09-12T01:00:41.736485+0000","last_undegraded":"2024-09-12T01:00:41.736485+0000","last_fullsized":"2024-09-12T01:00:41.736485+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:28.627541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"268'7","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.875656+0000","last_change":"2024-09-12T01:05:20.875656+0000","last_active":"2024-09-12T01:05:20.875656+0000","last_peered":"2024-09-12T01:05:20.875656+0000","last_clean":"2024-09-12T01:05:20.875656+0000","last_became_active":"2024-09-12T00:34:55.220179+0000","last_became_peered":"2024-09-12T00:34:55.220179+0000","last_unstale":"2024-09-12T01:05:20.875656+0000","last_undegraded":"2024-09-12T01:05:20.875656+0000","last_fullsized":"2024-09-12T01:05:20.875656+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-12T01:05:20.875403+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-12T01:05:20.875403+0000","last_clean_scrub_stamp":"2024-09-12T01:05:20.875403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:37.253656+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"268'7","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.309693+0000","last_change":"2024-09-12T00:34:52.197324+0000","last_active":"2024-09-12T01:04:39.309693+0000","last_peered":"2024-09-12T01:04:39.309693+0000","last_clean":"2024-09-12T01:04:39.309693+0000","last_became_active":"2024-09-12T00:34:52.196592+0000","last_became_peered":"2024-09-12T00:34:52.196592+0000","last_unstale":"2024-09-12T01:04:39.309693+0000","last_undegraded":"2024-09-12T01:04:39.309693+0000","last_fullsized":"2024-09-12T01:04:39.309693+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'27","reported_seq":117,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:11.743558+0000","last_change":"2024-09-12T00:33:10.842922+0000","last_active":"2024-09-12T01:01:11.743558+0000","last_peered":"2024-09-12T01:01:11.743558+0000","last_clean":"2024-09-12T01:01:11.743558+0000","last_became_active":"2024-09-12T00:33:10.842139+0000","last_became_peered":"2024-09-12T00:33:10.842139+0000","last_unstale":"2024-09-12T01:01:11.743558+0000","last_undegraded":"2024-09-12T01:01:11.743558+0000","last_fullsized":"2024-09-12T01:01:11.743558+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:22.677651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":87,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.454784+0000","last_change":"2024-09-12T01:05:14.454784+0000","last_active":"2024-09-12T01:05:14.454784+0000","last_peered":"2024-09-12T01:05:14.454784+0000","last_clean":"2024-09-12T01:05:14.454784+0000","last_became_active":"2024-09-12T00:46:09.494257+0000","last_became_peered":"2024-09-12T00:46:09.494257+0000","last_unstale":"2024-09-12T01:05:14.454784+0000","last_undegraded":"2024-09-12T01:05:14.454784+0000","last_fullsized":"2024-09-12T01:05:14.454784+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:14.454594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:14.454594+0000","last_clean_scrub_stamp":"2024-09-12T01:05:14.454594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:36.996544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":36,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.755822+0000","last_change":"2024-09-12T00:34:55.228058+0000","last_active":"2024-09-12T01:01:56.755822+0000","last_peered":"2024-09-12T01:01:56.755822+0000","last_clean":"2024-09-12T01:01:56.755822+0000","last_became_active":"2024-09-12T00:34:55.226471+0000","last_became_peered":"2024-09-12T00:34:55.226471+0000","last_unstale":"2024-09-12T01:01:56.755822+0000","last_undegraded":"2024-09-12T01:01:56.755822+0000","last_fullsized":"2024-09-12T01:01:56.755822+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:56.137407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'2","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:52.543792+0000","last_change":"2024-09-12T00:34:52.203278+0000","last_active":"2024-09-12T01:01:52.543792+0000","last_peered":"2024-09-12T01:01:52.543792+0000","last_clean":"2024-09-12T01:01:52.543792+0000","last_became_active":"2024-09-12T00:34:52.202587+0000","last_became_peered":"2024-09-12T00:34:52.202587+0000","last_unstale":"2024-09-12T01:01:52.543792+0000","last_undegraded":"2024-09-12T01:01:52.543792+0000","last_fullsized":"2024-09-12T01:01:52.543792+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:59.179898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'23","reported_seq":109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:31.765303+0000","last_change":"2024-09-12T00:33:10.833328+0000","last_active":"2024-09-12T01:02:31.765303+0000","last_peered":"2024-09-12T01:02:31.765303+0000","last_clean":"2024-09-12T01:02:31.765303+0000","last_became_active":"2024-09-12T00:33:10.832622+0000","last_became_peered":"2024-09-12T00:33:10.832622+0000","last_unstale":"2024-09-12T01:02:31.765303+0000","last_undegraded":"2024-09-12T01:02:31.765303+0000","last_fullsized":"2024-09-12T01:02:31.765303+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":78,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.544986+0000","last_change":"2024-09-12T00:46:09.502064+0000","last_active":"2024-09-12T01:01:57.544986+0000","last_peered":"2024-09-12T01:01:57.544986+0000","last_clean":"2024-09-12T01:01:57.544986+0000","last_became_active":"2024-09-12T00:46:09.501361+0000","last_became_peered":"2024-09-12T00:46:09.501361+0000","last_unstale":"2024-09-12T01:01:57.544986+0000","last_undegraded":"2024-09-12T01:01:57.544986+0000","last_fullsized":"2024-09-12T01:01:57.544986+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:11.638769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"268'2","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:11.786015+0000","last_change":"2024-09-12T00:34:55.222844+0000","last_active":"2024-09-12T01:04:11.786015+0000","last_peered":"2024-09-12T01:04:11.786015+0000","last_clean":"2024-09-12T01:04:11.786015+0000","last_became_active":"2024-09-12T00:34:55.222079+0000","last_became_peered":"2024-09-12T00:34:55.222079+0000","last_unstale":"2024-09-12T01:04:11.786015+0000","last_undegraded":"2024-09-12T01:04:11.786015+0000","last_fullsized":"2024-09-12T01:04:11.786015+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:10.859567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"268'3","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:11.443631+0000","last_change":"2024-09-12T01:05:11.443631+0000","last_active":"2024-09-12T01:05:11.443631+0000","last_peered":"2024-09-12T01:05:11.443631+0000","last_clean":"2024-09-12T01:05:11.443631+0000","last_became_active":"2024-09-12T00:34:52.176108+0000","last_became_peered":"2024-09-12T00:34:52.176108+0000","last_unstale":"2024-09-12T01:05:11.443631+0000","last_undegraded":"2024-09-12T01:05:11.443631+0000","last_fullsized":"2024-09-12T01:05:11.443631+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:05:11.443449+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:05:11.443449+0000","last_clean_scrub_stamp":"2024-09-12T01:05:11.443449+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:39.904043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'16","reported_seq":99,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.509817+0000","last_change":"2024-09-12T01:05:25.509817+0000","last_active":"2024-09-12T01:05:25.509817+0000","last_peered":"2024-09-12T01:05:25.509817+0000","last_clean":"2024-09-12T01:05:25.509817+0000","last_became_active":"2024-09-12T00:33:10.849703+0000","last_became_peered":"2024-09-12T00:33:10.849703+0000","last_unstale":"2024-09-12T01:05:25.509817+0000","last_undegraded":"2024-09-12T01:05:25.509817+0000","last_fullsized":"2024-09-12T01:05:25.509817+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'16","last_scrub_stamp":"2024-09-12T01:05:25.509628+0000","last_deep_scrub":"265'16","last_deep_scrub_stamp":"2024-09-12T01:05:25.509628+0000","last_clean_scrub_stamp":"2024-09-12T01:05:25.509628+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:23.064810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:23.901314+0000","last_change":"2024-09-12T01:05:23.901314+0000","last_active":"2024-09-12T01:05:23.901314+0000","last_peered":"2024-09-12T01:05:23.901314+0000","last_clean":"2024-09-12T01:05:23.901314+0000","last_became_active":"2024-09-12T00:46:09.514197+0000","last_became_peered":"2024-09-12T00:46:09.514197+0000","last_unstale":"2024-09-12T01:05:23.901314+0000","last_undegraded":"2024-09-12T01:05:23.901314+0000","last_fullsized":"2024-09-12T01:05:23.901314+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:23.901126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:23.901126+0000","last_clean_scrub_stamp":"2024-09-12T01:05:23.901126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:28.857730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"268'8","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:23.524527+0000","last_change":"2024-09-12T01:05:23.524527+0000","last_active":"2024-09-12T01:05:23.524527+0000","last_peered":"2024-09-12T01:05:23.524527+0000","last_clean":"2024-09-12T01:05:23.524527+0000","last_became_active":"2024-09-12T00:34:55.252651+0000","last_became_peered":"2024-09-12T00:34:55.252651+0000","last_unstale":"2024-09-12T01:05:23.524527+0000","last_undegraded":"2024-09-12T01:05:23.524527+0000","last_fullsized":"2024-09-12T01:05:23.524527+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-12T01:05:23.524342+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-12T01:05:23.524342+0000","last_clean_scrub_stamp":"2024-09-12T01:05:23.524342+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:54.519342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":7697,"num_write":8,"num_write_kb":6673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"268'3","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:06.601687+0000","last_change":"2024-09-12T00:34:52.201618+0000","last_active":"2024-09-12T01:04:06.601687+0000","last_peered":"2024-09-12T01:04:06.601687+0000","last_clean":"2024-09-12T01:04:06.601687+0000","last_became_active":"2024-09-12T00:34:52.177094+0000","last_became_peered":"2024-09-12T00:34:52.177094+0000","last_unstale":"2024-09-12T01:04:06.601687+0000","last_undegraded":"2024-09-12T01:04:06.601687+0000","last_fullsized":"2024-09-12T01:04:06.601687+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:28.340168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"268'31","reported_seq":141,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.781240+0000","last_change":"2024-09-12T01:05:14.781240+0000","last_active":"2024-09-12T01:05:14.781240+0000","last_peered":"2024-09-12T01:05:14.781240+0000","last_clean":"2024-09-12T01:05:14.781240+0000","last_became_active":"2024-09-12T00:33:10.862993+0000","last_became_peered":"2024-09-12T00:33:10.862993+0000","last_unstale":"2024-09-12T01:05:14.781240+0000","last_undegraded":"2024-09-12T01:05:14.781240+0000","last_fullsized":"2024-09-12T01:05:14.781240+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'31","last_scrub_stamp":"2024-09-12T01:05:14.781021+0000","last_deep_scrub":"268'31","last_deep_scrub_stamp":"2024-09-12T01:05:14.781021+0000","last_clean_scrub_stamp":"2024-09-12T01:05:14.781021+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:28.478018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":107,"num_write":58,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:22.536912+0000","last_change":"2024-09-12T00:46:09.499178+0000","last_active":"2024-09-12T01:01:22.536912+0000","last_peered":"2024-09-12T01:01:22.536912+0000","last_clean":"2024-09-12T01:01:22.536912+0000","last_became_active":"2024-09-12T00:46:09.498482+0000","last_became_peered":"2024-09-12T00:46:09.498482+0000","last_unstale":"2024-09-12T01:01:22.536912+0000","last_undegraded":"2024-09-12T01:01:22.536912+0000","last_fullsized":"2024-09-12T01:01:22.536912+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:41.343998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":36,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.755870+0000","last_change":"2024-09-12T00:34:55.229076+0000","last_active":"2024-09-12T01:01:56.755870+0000","last_peered":"2024-09-12T01:01:56.755870+0000","last_clean":"2024-09-12T01:01:56.755870+0000","last_became_active":"2024-09-12T00:34:55.228136+0000","last_became_peered":"2024-09-12T00:34:55.228136+0000","last_unstale":"2024-09-12T01:01:56.755870+0000","last_undegraded":"2024-09-12T01:01:56.755870+0000","last_fullsized":"2024-09-12T01:01:56.755870+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:13.739031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.495292+0000","last_change":"2024-09-12T01:05:19.495292+0000","last_active":"2024-09-12T01:05:19.495292+0000","last_peered":"2024-09-12T01:05:19.495292+0000","last_clean":"2024-09-12T01:05:19.495292+0000","last_became_active":"2024-09-12T00:34:52.190350+0000","last_became_peered":"2024-09-12T00:34:52.190350+0000","last_unstale":"2024-09-12T01:05:19.495292+0000","last_undegraded":"2024-09-12T01:05:19.495292+0000","last_fullsized":"2024-09-12T01:05:19.495292+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:19.495112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:19.495112+0000","last_clean_scrub_stamp":"2024-09-12T01:05:19.495112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:01.884792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'31","reported_seq":139,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:07.485351+0000","last_change":"2024-09-12T01:05:07.485351+0000","last_active":"2024-09-12T01:05:07.485351+0000","last_peered":"2024-09-12T01:05:07.485351+0000","last_clean":"2024-09-12T01:05:07.485351+0000","last_became_active":"2024-09-12T00:33:10.834095+0000","last_became_peered":"2024-09-12T00:33:10.834095+0000","last_unstale":"2024-09-12T01:05:07.485351+0000","last_undegraded":"2024-09-12T01:05:07.485351+0000","last_fullsized":"2024-09-12T01:05:07.485351+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'31","last_scrub_stamp":"2024-09-12T01:05:07.485175+0000","last_deep_scrub":"268'31","last_deep_scrub_stamp":"2024-09-12T01:05:07.485175+0000","last_clean_scrub_stamp":"2024-09-12T01:05:07.485175+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:30.593230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":107,"num_write":54,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.755937+0000","last_change":"2024-09-12T00:46:09.502145+0000","last_active":"2024-09-12T01:01:56.755937+0000","last_peered":"2024-09-12T01:01:56.755937+0000","last_clean":"2024-09-12T01:01:56.755937+0000","last_became_active":"2024-09-12T00:46:09.500779+0000","last_became_peered":"2024-09-12T00:46:09.500779+0000","last_unstale":"2024-09-12T01:01:56.755937+0000","last_undegraded":"2024-09-12T01:01:56.755937+0000","last_fullsized":"2024-09-12T01:01:56.755937+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:52.290781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"268'8","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.410923+0000","last_change":"2024-09-12T00:34:55.242037+0000","last_active":"2024-09-12T01:04:39.410923+0000","last_peered":"2024-09-12T01:04:39.410923+0000","last_clean":"2024-09-12T01:04:39.410923+0000","last_became_active":"2024-09-12T00:34:55.241223+0000","last_became_peered":"2024-09-12T00:34:55.241223+0000","last_unstale":"2024-09-12T01:04:39.410923+0000","last_undegraded":"2024-09-12T01:04:39.410923+0000","last_fullsized":"2024-09-12T01:04:39.410923+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9218,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"268'2","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.554343+0000","last_change":"2024-09-12T00:34:52.206116+0000","last_active":"2024-09-12T01:04:39.554343+0000","last_peered":"2024-09-12T01:04:39.554343+0000","last_clean":"2024-09-12T01:04:39.554343+0000","last_became_active":"2024-09-12T00:34:52.202407+0000","last_became_peered":"2024-09-12T00:34:52.202407+0000","last_unstale":"2024-09-12T01:04:39.554343+0000","last_undegraded":"2024-09-12T01:04:39.554343+0000","last_fullsized":"2024-09-12T01:04:39.554343+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'46","reported_seq":187,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.007682+0000","last_change":"2024-09-12T01:05:25.007682+0000","last_active":"2024-09-12T01:05:25.007682+0000","last_peered":"2024-09-12T01:05:25.007682+0000","last_clean":"2024-09-12T01:05:25.007682+0000","last_became_active":"2024-09-12T00:33:10.859459+0000","last_became_peered":"2024-09-12T00:33:10.859459+0000","last_unstale":"2024-09-12T01:05:25.007682+0000","last_undegraded":"2024-09-12T01:05:25.007682+0000","last_fullsized":"2024-09-12T01:05:25.007682+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'46","last_scrub_stamp":"2024-09-12T01:05:25.007486+0000","last_deep_scrub":"268'46","last_deep_scrub_stamp":"2024-09-12T01:05:25.007486+0000","last_clean_scrub_stamp":"2024-09-12T01:05:25.007486+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:36.922427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":176,"num_write":75,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.546185+0000","last_change":"2024-09-12T00:46:09.505921+0000","last_active":"2024-09-12T01:02:02.546185+0000","last_peered":"2024-09-12T01:02:02.546185+0000","last_clean":"2024-09-12T01:02:02.546185+0000","last_became_active":"2024-09-12T00:46:09.505143+0000","last_became_peered":"2024-09-12T00:46:09.505143+0000","last_unstale":"2024-09-12T01:02:02.546185+0000","last_undegraded":"2024-09-12T01:02:02.546185+0000","last_fullsized":"2024-09-12T01:02:02.546185+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:58.286882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"268'2","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.922281+0000","last_change":"2024-09-12T00:34:55.253946+0000","last_active":"2024-09-12T01:04:39.922281+0000","last_peered":"2024-09-12T01:04:39.922281+0000","last_clean":"2024-09-12T01:04:39.922281+0000","last_became_active":"2024-09-12T00:34:55.253169+0000","last_became_peered":"2024-09-12T00:34:55.253169+0000","last_unstale":"2024-09-12T01:04:39.922281+0000","last_undegraded":"2024-09-12T01:04:39.922281+0000","last_fullsized":"2024-09-12T01:04:39.922281+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"268'2","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:18.531394+0000","last_change":"2024-09-12T01:05:18.531394+0000","last_active":"2024-09-12T01:05:18.531394+0000","last_peered":"2024-09-12T01:05:18.531394+0000","last_clean":"2024-09-12T01:05:18.531394+0000","last_became_active":"2024-09-12T00:34:52.190174+0000","last_became_peered":"2024-09-12T00:34:52.190174+0000","last_unstale":"2024-09-12T01:05:18.531394+0000","last_undegraded":"2024-09-12T01:05:18.531394+0000","last_fullsized":"2024-09-12T01:05:18.531394+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:18.531176+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:18.531176+0000","last_clean_scrub_stamp":"2024-09-12T01:05:18.531176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:29.431630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'29","reported_seq":129,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:23.391346+0000","last_change":"2024-09-12T01:05:23.391346+0000","last_active":"2024-09-12T01:05:23.391346+0000","last_peered":"2024-09-12T01:05:23.391346+0000","last_clean":"2024-09-12T01:05:23.391346+0000","last_became_active":"2024-09-12T00:33:10.849658+0000","last_became_peered":"2024-09-12T00:33:10.849658+0000","last_unstale":"2024-09-12T01:05:23.391346+0000","last_undegraded":"2024-09-12T01:05:23.391346+0000","last_fullsized":"2024-09-12T01:05:23.391346+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'29","last_scrub_stamp":"2024-09-12T01:05:23.391166+0000","last_deep_scrub":"268'29","last_deep_scrub_stamp":"2024-09-12T01:05:23.391166+0000","last_clean_scrub_stamp":"2024-09-12T01:05:23.391166+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:10.325840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":91,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:57.545034+0000","last_change":"2024-09-12T00:46:09.487986+0000","last_active":"2024-09-12T01:01:57.545034+0000","last_peered":"2024-09-12T01:01:57.545034+0000","last_clean":"2024-09-12T01:01:57.545034+0000","last_became_active":"2024-09-12T00:46:09.485933+0000","last_became_peered":"2024-09-12T00:46:09.485933+0000","last_unstale":"2024-09-12T01:01:57.545034+0000","last_undegraded":"2024-09-12T01:01:57.545034+0000","last_fullsized":"2024-09-12T01:01:57.545034+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:26.699689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"268'2","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:22.541565+0000","last_change":"2024-09-12T01:05:22.541565+0000","last_active":"2024-09-12T01:05:22.541565+0000","last_peered":"2024-09-12T01:05:22.541565+0000","last_clean":"2024-09-12T01:05:22.541565+0000","last_became_active":"2024-09-12T00:34:55.236708+0000","last_became_peered":"2024-09-12T00:34:55.236708+0000","last_unstale":"2024-09-12T01:05:22.541565+0000","last_undegraded":"2024-09-12T01:05:22.541565+0000","last_fullsized":"2024-09-12T01:05:22.541565+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:22.541371+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:22.541371+0000","last_clean_scrub_stamp":"2024-09-12T01:05:22.541371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:21.089324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'4","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.552913+0000","last_change":"2024-09-12T00:34:52.209042+0000","last_active":"2024-09-12T01:04:39.552913+0000","last_peered":"2024-09-12T01:04:39.552913+0000","last_clean":"2024-09-12T01:04:39.552913+0000","last_became_active":"2024-09-12T00:34:52.205829+0000","last_became_peered":"2024-09-12T00:34:52.205829+0000","last_unstale":"2024-09-12T01:04:39.552913+0000","last_undegraded":"2024-09-12T01:04:39.552913+0000","last_fullsized":"2024-09-12T01:04:39.552913+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'30","reported_seq":133,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:21.746083+0000","last_change":"2024-09-12T00:33:10.825945+0000","last_active":"2024-09-12T01:01:21.746083+0000","last_peered":"2024-09-12T01:01:21.746083+0000","last_clean":"2024-09-12T01:01:21.746083+0000","last_became_active":"2024-09-12T00:33:10.825191+0000","last_became_peered":"2024-09-12T00:33:10.825191+0000","last_unstale":"2024-09-12T01:01:21.746083+0000","last_undegraded":"2024-09-12T01:01:21.746083+0000","last_fullsized":"2024-09-12T01:01:21.746083+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:33:09.799826+0000","last_clean_scrub_stamp":"2024-09-12T00:33:09.799826+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:47.230850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":116,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:56.571862+0000","last_change":"2024-09-12T00:46:09.505717+0000","last_active":"2024-09-12T01:01:56.571862+0000","last_peered":"2024-09-12T01:01:56.571862+0000","last_clean":"2024-09-12T01:01:56.571862+0000","last_became_active":"2024-09-12T00:46:09.504789+0000","last_became_peered":"2024-09-12T00:46:09.504789+0000","last_unstale":"2024-09-12T01:01:56.571862+0000","last_undegraded":"2024-09-12T01:01:56.571862+0000","last_fullsized":"2024-09-12T01:01:56.571862+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:54.929380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'2","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:17.563098+0000","last_change":"2024-09-12T00:34:55.238407+0000","last_active":"2024-09-12T01:03:17.563098+0000","last_peered":"2024-09-12T01:03:17.563098+0000","last_clean":"2024-09-12T01:03:17.563098+0000","last_became_active":"2024-09-12T00:34:55.237691+0000","last_became_peered":"2024-09-12T00:34:55.237691+0000","last_unstale":"2024-09-12T01:03:17.563098+0000","last_undegraded":"2024-09-12T01:03:17.563098+0000","last_fullsized":"2024-09-12T01:03:17.563098+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'8","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:26.206011+0000","last_change":"2024-09-12T01:05:26.206011+0000","last_active":"2024-09-12T01:05:26.206011+0000","last_peered":"2024-09-12T01:05:26.206011+0000","last_clean":"2024-09-12T01:05:26.206011+0000","last_became_active":"2024-09-12T00:34:52.200033+0000","last_became_peered":"2024-09-12T00:34:52.200033+0000","last_unstale":"2024-09-12T01:05:26.206011+0000","last_undegraded":"2024-09-12T01:05:26.206011+0000","last_fullsized":"2024-09-12T01:05:26.206011+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T01:05:26.205816+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T01:05:26.205816+0000","last_clean_scrub_stamp":"2024-09-12T01:05:26.205816+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:41.934254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":17410,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'38","reported_seq":157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.775104+0000","last_change":"2024-09-12T01:05:13.775104+0000","last_active":"2024-09-12T01:05:13.775104+0000","last_peered":"2024-09-12T01:05:13.775104+0000","last_clean":"2024-09-12T01:05:13.775104+0000","last_became_active":"2024-09-12T00:33:10.855257+0000","last_became_peered":"2024-09-12T00:33:10.855257+0000","last_unstale":"2024-09-12T01:05:13.775104+0000","last_undegraded":"2024-09-12T01:05:13.775104+0000","last_fullsized":"2024-09-12T01:05:13.775104+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'38","last_scrub_stamp":"2024-09-12T01:05:13.774920+0000","last_deep_scrub":"268'38","last_deep_scrub_stamp":"2024-09-12T01:05:13.774920+0000","last_clean_scrub_stamp":"2024-09-12T01:05:13.774920+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:22.509428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":126,"num_write":70,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.557406+0000","last_change":"2024-09-12T00:46:09.504978+0000","last_active":"2024-09-12T01:02:52.557406+0000","last_peered":"2024-09-12T01:02:52.557406+0000","last_clean":"2024-09-12T01:02:52.557406+0000","last_became_active":"2024-09-12T00:46:09.504114+0000","last_became_peered":"2024-09-12T00:46:09.504114+0000","last_unstale":"2024-09-12T01:02:52.557406+0000","last_undegraded":"2024-09-12T01:02:52.557406+0000","last_fullsized":"2024-09-12T01:02:52.557406+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'2","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.575855+0000","last_change":"2024-09-12T00:34:55.235646+0000","last_active":"2024-09-12T01:02:11.575855+0000","last_peered":"2024-09-12T01:02:11.575855+0000","last_clean":"2024-09-12T01:02:11.575855+0000","last_became_active":"2024-09-12T00:34:55.234795+0000","last_became_peered":"2024-09-12T00:34:55.234795+0000","last_unstale":"2024-09-12T01:02:11.575855+0000","last_undegraded":"2024-09-12T01:02:11.575855+0000","last_fullsized":"2024-09-12T01:02:11.575855+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:10.241846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"268'7","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:02.573483+0000","last_change":"2024-09-12T00:34:52.199095+0000","last_active":"2024-09-12T01:04:02.573483+0000","last_peered":"2024-09-12T01:04:02.573483+0000","last_clean":"2024-09-12T01:04:02.573483+0000","last_became_active":"2024-09-12T00:34:52.198346+0000","last_became_peered":"2024-09-12T00:34:52.198346+0000","last_unstale":"2024-09-12T01:04:02.573483+0000","last_undegraded":"2024-09-12T01:04:02.573483+0000","last_fullsized":"2024-09-12T01:04:02.573483+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:09.225827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'29","reported_seq":138,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:24.038574+0000","last_change":"2024-09-12T01:05:24.038574+0000","last_active":"2024-09-12T01:05:24.038574+0000","last_peered":"2024-09-12T01:05:24.038574+0000","last_clean":"2024-09-12T01:05:24.038574+0000","last_became_active":"2024-09-12T00:33:10.847386+0000","last_became_peered":"2024-09-12T00:33:10.847386+0000","last_unstale":"2024-09-12T01:05:24.038574+0000","last_undegraded":"2024-09-12T01:05:24.038574+0000","last_fullsized":"2024-09-12T01:05:24.038574+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'29","last_scrub_stamp":"2024-09-12T01:05:24.038360+0000","last_deep_scrub":"268'29","last_deep_scrub_stamp":"2024-09-12T01:05:24.038360+0000","last_clean_scrub_stamp":"2024-09-12T01:05:24.038360+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:05.679964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":106,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.761364+0000","last_change":"2024-09-12T00:46:09.514213+0000","last_active":"2024-09-12T01:02:52.761364+0000","last_peered":"2024-09-12T01:02:52.761364+0000","last_clean":"2024-09-12T01:02:52.761364+0000","last_became_active":"2024-09-12T00:46:09.509685+0000","last_became_peered":"2024-09-12T00:46:09.509685+0000","last_unstale":"2024-09-12T01:02:52.761364+0000","last_undegraded":"2024-09-12T01:02:52.761364+0000","last_fullsized":"2024-09-12T01:02:52.761364+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"268'2","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:06.601647+0000","last_change":"2024-09-12T00:34:55.251608+0000","last_active":"2024-09-12T01:04:06.601647+0000","last_peered":"2024-09-12T01:04:06.601647+0000","last_clean":"2024-09-12T01:04:06.601647+0000","last_became_active":"2024-09-12T00:34:55.251057+0000","last_became_peered":"2024-09-12T00:34:55.251057+0000","last_unstale":"2024-09-12T01:04:06.601647+0000","last_undegraded":"2024-09-12T01:04:06.601647+0000","last_fullsized":"2024-09-12T01:04:06.601647+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:44.787440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"268'6","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.455561+0000","last_change":"2024-09-12T01:05:09.455561+0000","last_active":"2024-09-12T01:05:09.455561+0000","last_peered":"2024-09-12T01:05:09.455561+0000","last_clean":"2024-09-12T01:05:09.455561+0000","last_became_active":"2024-09-12T00:34:52.177088+0000","last_became_peered":"2024-09-12T00:34:52.177088+0000","last_unstale":"2024-09-12T01:05:09.455561+0000","last_undegraded":"2024-09-12T01:05:09.455561+0000","last_fullsized":"2024-09-12T01:05:09.455561+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T01:05:09.455387+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T01:05:09.455387+0000","last_clean_scrub_stamp":"2024-09-12T01:05:09.455387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:39.598065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"268'21","reported_seq":111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:18.814452+0000","last_change":"2024-09-12T01:05:18.814452+0000","last_active":"2024-09-12T01:05:18.814452+0000","last_peered":"2024-09-12T01:05:18.814452+0000","last_clean":"2024-09-12T01:05:18.814452+0000","last_became_active":"2024-09-12T00:33:10.844093+0000","last_became_peered":"2024-09-12T00:33:10.844093+0000","last_unstale":"2024-09-12T01:05:18.814452+0000","last_undegraded":"2024-09-12T01:05:18.814452+0000","last_fullsized":"2024-09-12T01:05:18.814452+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'21","last_scrub_stamp":"2024-09-12T01:05:18.814273+0000","last_deep_scrub":"268'21","last_deep_scrub_stamp":"2024-09-12T01:05:18.814273+0000","last_clean_scrub_stamp":"2024-09-12T01:05:18.814273+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:27.972849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":69,"num_write":38,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:16.556161+0000","last_change":"2024-09-12T00:46:09.498490+0000","last_active":"2024-09-12T01:02:16.556161+0000","last_peered":"2024-09-12T01:02:16.556161+0000","last_clean":"2024-09-12T01:02:16.556161+0000","last_became_active":"2024-09-12T00:46:09.497751+0000","last_became_peered":"2024-09-12T00:46:09.497751+0000","last_unstale":"2024-09-12T01:02:16.556161+0000","last_undegraded":"2024-09-12T01:02:16.556161+0000","last_fullsized":"2024-09-12T01:02:16.556161+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.301246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.560955+0000","last_change":"2024-09-12T00:34:55.254981+0000","last_active":"2024-09-12T01:03:07.560955+0000","last_peered":"2024-09-12T01:03:07.560955+0000","last_clean":"2024-09-12T01:03:07.560955+0000","last_became_active":"2024-09-12T00:34:55.254446+0000","last_became_peered":"2024-09-12T00:34:55.254446+0000","last_unstale":"2024-09-12T01:03:07.560955+0000","last_undegraded":"2024-09-12T01:03:07.560955+0000","last_fullsized":"2024-09-12T01:03:07.560955+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:26.477520+0000","last_change":"2024-09-12T01:05:26.477520+0000","last_active":"2024-09-12T01:05:26.477520+0000","last_peered":"2024-09-12T01:05:26.477520+0000","last_clean":"2024-09-12T01:05:26.477520+0000","last_became_active":"2024-09-12T00:34:52.193306+0000","last_became_peered":"2024-09-12T00:34:52.193306+0000","last_unstale":"2024-09-12T01:05:26.477520+0000","last_undegraded":"2024-09-12T01:05:26.477520+0000","last_fullsized":"2024-09-12T01:05:26.477520+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:26.477332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:26.477332+0000","last_clean_scrub_stamp":"2024-09-12T01:05:26.477332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:30.919699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"268'36","reported_seq":160,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:22.406472+0000","last_change":"2024-09-12T01:05:22.406472+0000","last_active":"2024-09-12T01:05:22.406472+0000","last_peered":"2024-09-12T01:05:22.406472+0000","last_clean":"2024-09-12T01:05:22.406472+0000","last_became_active":"2024-09-12T00:33:10.859799+0000","last_became_peered":"2024-09-12T00:33:10.859799+0000","last_unstale":"2024-09-12T01:05:22.406472+0000","last_undegraded":"2024-09-12T01:05:22.406472+0000","last_fullsized":"2024-09-12T01:05:22.406472+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'36","last_scrub_stamp":"2024-09-12T01:05:22.406297+0000","last_deep_scrub":"268'36","last_deep_scrub_stamp":"2024-09-12T01:05:22.406297+0000","last_clean_scrub_stamp":"2024-09-12T01:05:22.406297+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:06.893957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":137,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.560906+0000","last_change":"2024-09-12T00:46:09.499691+0000","last_active":"2024-09-12T01:02:52.560906+0000","last_peered":"2024-09-12T01:02:52.560906+0000","last_clean":"2024-09-12T01:02:52.560906+0000","last_became_active":"2024-09-12T00:46:09.498942+0000","last_became_peered":"2024-09-12T00:46:09.498942+0000","last_unstale":"2024-09-12T01:02:52.560906+0000","last_undegraded":"2024-09-12T01:02:52.560906+0000","last_fullsized":"2024-09-12T01:02:52.560906+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'2","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:38.680403+0000","last_change":"2024-09-12T00:34:55.215046+0000","last_active":"2024-09-12T01:04:38.680403+0000","last_peered":"2024-09-12T01:04:38.680403+0000","last_clean":"2024-09-12T01:04:38.680403+0000","last_became_active":"2024-09-12T00:34:55.214265+0000","last_became_peered":"2024-09-12T00:34:55.214265+0000","last_unstale":"2024-09-12T01:04:38.680403+0000","last_undegraded":"2024-09-12T01:04:38.680403+0000","last_fullsized":"2024-09-12T01:04:38.680403+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"268'9","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.718530+0000","last_change":"2024-09-12T00:34:52.204774+0000","last_active":"2024-09-12T01:04:39.718530+0000","last_peered":"2024-09-12T01:04:39.718530+0000","last_clean":"2024-09-12T01:04:39.718530+0000","last_became_active":"2024-09-12T00:34:52.204050+0000","last_became_peered":"2024-09-12T00:34:52.204050+0000","last_unstale":"2024-09-12T01:04:39.718530+0000","last_undegraded":"2024-09-12T01:04:39.718530+0000","last_fullsized":"2024-09-12T01:04:39.718530+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:51.133313+0000","last_clean_scrub_stamp":"2024-09-12T00:34:51.133313+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5120,"num_write":14,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'20","reported_seq":112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:17.524208+0000","last_change":"2024-09-12T01:05:17.524208+0000","last_active":"2024-09-12T01:05:17.524208+0000","last_peered":"2024-09-12T01:05:17.524208+0000","last_clean":"2024-09-12T01:05:17.524208+0000","last_became_active":"2024-09-12T00:33:10.841411+0000","last_became_peered":"2024-09-12T00:33:10.841411+0000","last_unstale":"2024-09-12T01:05:17.524208+0000","last_undegraded":"2024-09-12T01:05:17.524208+0000","last_fullsized":"2024-09-12T01:05:17.524208+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'20","last_scrub_stamp":"2024-09-12T01:05:17.523976+0000","last_deep_scrub":"268'20","last_deep_scrub_stamp":"2024-09-12T01:05:17.523976+0000","last_clean_scrub_stamp":"2024-09-12T01:05:17.523976+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:40.341379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":70,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"268'2","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:12.411412+0000","last_change":"2024-09-12T01:05:12.411412+0000","last_active":"2024-09-12T01:05:12.411412+0000","last_peered":"2024-09-12T01:05:12.411412+0000","last_clean":"2024-09-12T01:05:12.411412+0000","last_became_active":"2024-09-12T00:46:09.520251+0000","last_became_peered":"2024-09-12T00:46:09.520251+0000","last_unstale":"2024-09-12T01:05:12.411412+0000","last_undegraded":"2024-09-12T01:05:12.411412+0000","last_fullsized":"2024-09-12T01:05:12.411412+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:12.411232+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:12.411232+0000","last_clean_scrub_stamp":"2024-09-12T01:05:12.411232+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:29.274957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"268'5","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:21.570025+0000","last_change":"2024-09-12T01:05:21.570025+0000","last_active":"2024-09-12T01:05:21.570025+0000","last_peered":"2024-09-12T01:05:21.570025+0000","last_clean":"2024-09-12T01:05:21.570025+0000","last_became_active":"2024-09-12T00:34:55.230698+0000","last_became_peered":"2024-09-12T00:34:55.230698+0000","last_unstale":"2024-09-12T01:05:21.570025+0000","last_undegraded":"2024-09-12T01:05:21.570025+0000","last_fullsized":"2024-09-12T01:05:21.570025+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-12T01:05:21.569842+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-12T01:05:21.569842+0000","last_clean_scrub_stamp":"2024-09-12T01:05:21.569842+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:03.786355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"265'5","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:26.414797+0000","last_change":"2024-09-12T01:05:26.414797+0000","last_active":"2024-09-12T01:05:26.414797+0000","last_peered":"2024-09-12T01:05:26.414797+0000","last_clean":"2024-09-12T01:05:26.414797+0000","last_became_active":"2024-09-12T00:34:52.211709+0000","last_became_peered":"2024-09-12T00:34:52.211709+0000","last_unstale":"2024-09-12T01:05:26.414797+0000","last_undegraded":"2024-09-12T01:05:26.414797+0000","last_fullsized":"2024-09-12T01:05:26.414797+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:05:26.414506+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:05:26.414506+0000","last_clean_scrub_stamp":"2024-09-12T01:05:26.414506+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:56.218833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'227","reported_seq":761,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:24.559414+0000","last_change":"2024-09-12T01:05:24.559414+0000","last_active":"2024-09-12T01:05:24.559414+0000","last_peered":"2024-09-12T01:05:24.559414+0000","last_clean":"2024-09-12T01:05:24.559414+0000","last_became_active":"2024-09-12T00:33:10.852751+0000","last_became_peered":"2024-09-12T00:33:10.852751+0000","last_unstale":"2024-09-12T01:05:24.559414+0000","last_undegraded":"2024-09-12T01:05:24.559414+0000","last_fullsized":"2024-09-12T01:05:24.559414+0000","mapping_epoch":255,"log_start":"265'200","ondisk_log_start":"265'200","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'227","last_scrub_stamp":"2024-09-12T01:05:24.559221+0000","last_deep_scrub":"268'227","last_deep_scrub_stamp":"2024-09-12T01:05:24.559221+0000","last_clean_scrub_stamp":"2024-09-12T01:05:24.559221+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:26.843031+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1385,"num_read_kb":1074,"num_write":267,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5969,"num_omap_keys":12,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:21.563715+0000","last_change":"2024-09-12T00:46:09.516940+0000","last_active":"2024-09-12T01:01:21.563715+0000","last_peered":"2024-09-12T01:01:21.563715+0000","last_clean":"2024-09-12T01:01:21.563715+0000","last_became_active":"2024-09-12T00:46:09.516404+0000","last_became_peered":"2024-09-12T00:46:09.516404+0000","last_unstale":"2024-09-12T01:01:21.563715+0000","last_undegraded":"2024-09-12T01:01:21.563715+0000","last_fullsized":"2024-09-12T01:01:21.563715+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:40.623194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"268'8","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:39.850790+0000","last_change":"2024-09-12T00:34:55.236475+0000","last_active":"2024-09-12T01:04:39.850790+0000","last_peered":"2024-09-12T01:04:39.850790+0000","last_clean":"2024-09-12T01:04:39.850790+0000","last_became_active":"2024-09-12T00:34:55.235522+0000","last_became_peered":"2024-09-12T00:34:55.235522+0000","last_unstale":"2024-09-12T01:04:39.850790+0000","last_undegraded":"2024-09-12T01:04:39.850790+0000","last_fullsized":"2024-09-12T01:04:39.850790+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":10240,"num_write":8,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"268'6","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:27.384368+0000","last_change":"2024-09-12T01:05:27.384368+0000","last_active":"2024-09-12T01:05:27.384368+0000","last_peered":"2024-09-12T01:05:27.384368+0000","last_clean":"2024-09-12T01:05:27.384368+0000","last_became_active":"2024-09-12T00:34:52.183769+0000","last_became_peered":"2024-09-12T00:34:52.183769+0000","last_unstale":"2024-09-12T01:05:27.384368+0000","last_undegraded":"2024-09-12T01:05:27.384368+0000","last_fullsized":"2024-09-12T01:05:27.384368+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T01:05:27.384180+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T01:05:27.384180+0000","last_clean_scrub_stamp":"2024-09-12T01:05:27.384180+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:55.187847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'27","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:24.191200+0000","last_change":"2024-09-12T01:05:24.191200+0000","last_active":"2024-09-12T01:05:24.191200+0000","last_peered":"2024-09-12T01:05:24.191200+0000","last_clean":"2024-09-12T01:05:24.191200+0000","last_became_active":"2024-09-12T00:33:10.830931+0000","last_became_peered":"2024-09-12T00:33:10.830931+0000","last_unstale":"2024-09-12T01:05:24.191200+0000","last_undegraded":"2024-09-12T01:05:24.191200+0000","last_fullsized":"2024-09-12T01:05:24.191200+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'27","last_scrub_stamp":"2024-09-12T01:05:24.191028+0000","last_deep_scrub":"268'27","last_deep_scrub_stamp":"2024-09-12T01:05:24.191028+0000","last_clean_scrub_stamp":"2024-09-12T01:05:24.191028+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:31.010155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":90,"num_write":55,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.585944+0000","last_change":"2024-09-12T00:46:09.518153+0000","last_active":"2024-09-12T01:02:51.585944+0000","last_peered":"2024-09-12T01:02:51.585944+0000","last_clean":"2024-09-12T01:02:51.585944+0000","last_became_active":"2024-09-12T00:46:09.517353+0000","last_became_peered":"2024-09-12T00:46:09.517353+0000","last_unstale":"2024-09-12T01:02:51.585944+0000","last_undegraded":"2024-09-12T01:02:51.585944+0000","last_fullsized":"2024-09-12T01:02:51.585944+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"268'9","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.856906+0000","last_change":"2024-09-12T01:05:19.856906+0000","last_active":"2024-09-12T01:05:19.856906+0000","last_peered":"2024-09-12T01:05:19.856906+0000","last_clean":"2024-09-12T01:05:19.856906+0000","last_became_active":"2024-09-12T00:34:55.224353+0000","last_became_peered":"2024-09-12T00:34:55.224353+0000","last_unstale":"2024-09-12T01:05:19.856906+0000","last_undegraded":"2024-09-12T01:05:19.856906+0000","last_fullsized":"2024-09-12T01:05:19.856906+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'9","last_scrub_stamp":"2024-09-12T01:05:19.856714+0000","last_deep_scrub":"268'9","last_deep_scrub_stamp":"2024-09-12T01:05:19.856714+0000","last_clean_scrub_stamp":"2024-09-12T01:05:19.856714+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:42.593775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":22530,"num_write":14,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"268'6","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:16.484378+0000","last_change":"2024-09-12T01:05:16.484378+0000","last_active":"2024-09-12T01:05:16.484378+0000","last_peered":"2024-09-12T01:05:16.484378+0000","last_clean":"2024-09-12T01:05:16.484378+0000","last_became_active":"2024-09-12T00:34:52.203625+0000","last_became_peered":"2024-09-12T00:34:52.203625+0000","last_unstale":"2024-09-12T01:05:16.484378+0000","last_undegraded":"2024-09-12T01:05:16.484378+0000","last_fullsized":"2024-09-12T01:05:16.484378+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T01:05:16.484199+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T01:05:16.484199+0000","last_clean_scrub_stamp":"2024-09-12T01:05:16.484199+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:39.312697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10299,"num_write":6,"num_write_kb":5179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'24","reported_seq":119,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:12.783107+0000","last_change":"2024-09-12T01:05:12.783107+0000","last_active":"2024-09-12T01:05:12.783107+0000","last_peered":"2024-09-12T01:05:12.783107+0000","last_clean":"2024-09-12T01:05:12.783107+0000","last_became_active":"2024-09-12T00:33:10.844416+0000","last_became_peered":"2024-09-12T00:33:10.844416+0000","last_unstale":"2024-09-12T01:05:12.783107+0000","last_undegraded":"2024-09-12T01:05:12.783107+0000","last_fullsized":"2024-09-12T01:05:12.783107+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'24","last_scrub_stamp":"2024-09-12T01:05:12.782924+0000","last_deep_scrub":"268'24","last_deep_scrub_stamp":"2024-09-12T01:05:12.782924+0000","last_clean_scrub_stamp":"2024-09-12T01:05:12.782924+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:59.667045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.558511+0000","last_change":"2024-09-12T00:46:09.494534+0000","last_active":"2024-09-12T01:02:57.558511+0000","last_peered":"2024-09-12T01:02:57.558511+0000","last_clean":"2024-09-12T01:02:57.558511+0000","last_became_active":"2024-09-12T00:46:09.493808+0000","last_became_peered":"2024-09-12T00:46:09.493808+0000","last_unstale":"2024-09-12T01:02:57.558511+0000","last_undegraded":"2024-09-12T01:02:57.558511+0000","last_fullsized":"2024-09-12T01:02:57.558511+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"268'2","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:07.576769+0000","last_change":"2024-09-12T00:34:55.234328+0000","last_active":"2024-09-12T01:04:07.576769+0000","last_peered":"2024-09-12T01:04:07.576769+0000","last_clean":"2024-09-12T01:04:07.576769+0000","last_became_active":"2024-09-12T00:34:55.233708+0000","last_became_peered":"2024-09-12T00:34:55.233708+0000","last_unstale":"2024-09-12T01:04:07.576769+0000","last_undegraded":"2024-09-12T01:04:07.576769+0000","last_fullsized":"2024-09-12T01:04:07.576769+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:34:54.170452+0000","last_clean_scrub_stamp":"2024-09-12T00:34:54.170452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:10.278114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"268'2","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:17.809390+0000","last_change":"2024-09-12T01:05:17.809390+0000","last_active":"2024-09-12T01:05:17.809390+0000","last_peered":"2024-09-12T01:05:17.809390+0000","last_clean":"2024-09-12T01:05:17.809390+0000","last_became_active":"2024-09-12T00:34:52.186234+0000","last_became_peered":"2024-09-12T00:34:52.186234+0000","last_unstale":"2024-09-12T01:05:17.809390+0000","last_undegraded":"2024-09-12T01:05:17.809390+0000","last_fullsized":"2024-09-12T01:05:17.809390+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:17.809194+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:17.809194+0000","last_clean_scrub_stamp":"2024-09-12T01:05:17.809194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:21.580344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'27","reported_seq":135,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:21.384237+0000","last_change":"2024-09-12T01:05:21.383982+0000","last_active":"2024-09-12T01:05:21.384237+0000","last_peered":"2024-09-12T01:05:21.384237+0000","last_clean":"2024-09-12T01:05:21.384237+0000","last_became_active":"2024-09-12T00:33:10.853205+0000","last_became_peered":"2024-09-12T00:33:10.853205+0000","last_unstale":"2024-09-12T01:05:21.384237+0000","last_undegraded":"2024-09-12T01:05:21.384237+0000","last_fullsized":"2024-09-12T01:05:21.384237+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'27","last_scrub_stamp":"2024-09-12T01:05:21.383773+0000","last_deep_scrub":"268'27","last_deep_scrub_stamp":"2024-09-12T01:05:21.383773+0000","last_clean_scrub_stamp":"2024-09-12T01:05:21.383773+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:56.970901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":100,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'373","reported_seq":1028,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.548055+0000","last_change":"2024-09-12T01:04:59.548055+0000","last_active":"2024-09-12T01:04:59.548055+0000","last_peered":"2024-09-12T01:04:59.548055+0000","last_clean":"2024-09-12T01:04:59.548055+0000","last_became_active":"2024-09-12T00:18:22.878117+0000","last_became_peered":"2024-09-12T00:18:22.878117+0000","last_unstale":"2024-09-12T01:04:59.548055+0000","last_undegraded":"2024-09-12T01:04:59.548055+0000","last_fullsized":"2024-09-12T01:04:59.548055+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'373","last_scrub_stamp":"2024-09-12T01:04:59.547794+0000","last_deep_scrub":"268'373","last_deep_scrub_stamp":"2024-09-12T01:04:59.547794+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.547794+0000","objects_scrubbed":10,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:34.105495+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":522,"num_read_kb":62534,"num_write":1202,"num_write_kb":43415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'437","reported_seq":1887,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.459888+0000","last_change":"2024-09-12T01:05:05.459888+0000","last_active":"2024-09-12T01:05:05.459888+0000","last_peered":"2024-09-12T01:05:05.459888+0000","last_clean":"2024-09-12T01:05:05.459888+0000","last_became_active":"2024-09-12T00:18:24.870370+0000","last_became_peered":"2024-09-12T00:18:24.870370+0000","last_unstale":"2024-09-12T01:05:05.459888+0000","last_undegraded":"2024-09-12T01:05:05.459888+0000","last_fullsized":"2024-09-12T01:05:05.459888+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'437","last_scrub_stamp":"2024-09-12T01:05:05.459689+0000","last_deep_scrub":"268'437","last_deep_scrub_stamp":"2024-09-12T01:05:05.459689+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.459689+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:46.800171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2205,"num_read_kb":2060,"num_write":503,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'344","reported_seq":997,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.586245+0000","last_change":"2024-09-12T01:04:52.586245+0000","last_active":"2024-09-12T01:04:52.586245+0000","last_peered":"2024-09-12T01:04:52.586245+0000","last_clean":"2024-09-12T01:04:52.586245+0000","last_became_active":"2024-09-12T00:18:22.845439+0000","last_became_peered":"2024-09-12T00:18:22.845439+0000","last_unstale":"2024-09-12T01:04:52.586245+0000","last_undegraded":"2024-09-12T01:04:52.586245+0000","last_fullsized":"2024-09-12T01:04:52.586245+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'344","last_scrub_stamp":"2024-09-12T01:04:52.586024+0000","last_deep_scrub":"268'344","last_deep_scrub_stamp":"2024-09-12T01:04:52.586024+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.586024+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:26.976158+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079947,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":485,"num_read_kb":5684,"num_write":1011,"num_write_kb":33510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'1351","reported_seq":3046,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.531548+0000","last_change":"2024-09-12T01:05:04.531548+0000","last_active":"2024-09-12T01:05:04.531548+0000","last_peered":"2024-09-12T01:05:04.531548+0000","last_clean":"2024-09-12T01:05:04.531548+0000","last_became_active":"2024-09-12T00:18:24.866026+0000","last_became_peered":"2024-09-12T00:18:24.866026+0000","last_unstale":"2024-09-12T01:05:04.531548+0000","last_undegraded":"2024-09-12T01:05:04.531548+0000","last_fullsized":"2024-09-12T01:05:04.531548+0000","mapping_epoch":26,"log_start":"268'1300","ondisk_log_start":"268'1300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1351","last_scrub_stamp":"2024-09-12T01:05:04.531372+0000","last_deep_scrub":"268'1351","last_deep_scrub_stamp":"2024-09-12T01:05:04.531372+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.531372+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":1300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:45.952638+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6196,"num_read_kb":5451,"num_write":1895,"num_write_kb":802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'348","reported_seq":1045,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.215693+0000","last_change":"2024-09-12T01:04:52.215693+0000","last_active":"2024-09-12T01:04:52.215693+0000","last_peered":"2024-09-12T01:04:52.215693+0000","last_clean":"2024-09-12T01:04:52.215693+0000","last_became_active":"2024-09-12T00:18:22.839379+0000","last_became_peered":"2024-09-12T00:18:22.839379+0000","last_unstale":"2024-09-12T01:04:52.215693+0000","last_undegraded":"2024-09-12T01:04:52.215693+0000","last_fullsized":"2024-09-12T01:04:52.215693+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'348","last_scrub_stamp":"2024-09-12T01:04:52.215433+0000","last_deep_scrub":"268'348","last_deep_scrub_stamp":"2024-09-12T01:04:52.215433+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.215433+0000","objects_scrubbed":9,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:02.897096+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560796,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":569,"num_read_kb":68999,"num_write":1084,"num_write_kb":32744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'870","reported_seq":2683,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:06.211516+0000","last_change":"2024-09-12T01:05:06.211516+0000","last_active":"2024-09-12T01:05:06.211516+0000","last_peered":"2024-09-12T01:05:06.211516+0000","last_clean":"2024-09-12T01:05:06.211516+0000","last_became_active":"2024-09-12T00:18:24.860995+0000","last_became_peered":"2024-09-12T00:18:24.860995+0000","last_unstale":"2024-09-12T01:05:06.211516+0000","last_undegraded":"2024-09-12T01:05:06.211516+0000","last_fullsized":"2024-09-12T01:05:06.211516+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'870","last_scrub_stamp":"2024-09-12T01:05:06.211336+0000","last_deep_scrub":"268'870","last_deep_scrub_stamp":"2024-09-12T01:05:06.211336+0000","last_clean_scrub_stamp":"2024-09-12T01:05:06.211336+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":800,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:09.525854+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4298,"num_read_kb":3905,"num_write":1128,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'339","reported_seq":1004,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.529175+0000","last_change":"2024-09-12T01:04:58.529175+0000","last_active":"2024-09-12T01:04:58.529175+0000","last_peered":"2024-09-12T01:04:58.529175+0000","last_clean":"2024-09-12T01:04:58.529175+0000","last_became_active":"2024-09-12T00:18:55.960413+0000","last_became_peered":"2024-09-12T00:18:55.960413+0000","last_unstale":"2024-09-12T01:04:58.529175+0000","last_undegraded":"2024-09-12T01:04:58.529175+0000","last_fullsized":"2024-09-12T01:04:58.529175+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'339","last_scrub_stamp":"2024-09-12T01:04:58.528952+0000","last_deep_scrub":"268'339","last_deep_scrub_stamp":"2024-09-12T01:04:58.528952+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.528952+0000","objects_scrubbed":7,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:06.429511+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":867046,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":485,"num_read_kb":54980,"num_write":1073,"num_write_kb":32836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'768","reported_seq":2325,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.385618+0000","last_change":"2024-09-12T01:05:02.385618+0000","last_active":"2024-09-12T01:05:02.385618+0000","last_peered":"2024-09-12T01:05:02.385618+0000","last_clean":"2024-09-12T01:05:02.385618+0000","last_became_active":"2024-09-12T00:18:55.955870+0000","last_became_peered":"2024-09-12T00:18:55.955870+0000","last_unstale":"2024-09-12T01:05:02.385618+0000","last_undegraded":"2024-09-12T01:05:02.385618+0000","last_fullsized":"2024-09-12T01:05:02.385618+0000","mapping_epoch":37,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'768","last_scrub_stamp":"2024-09-12T01:05:02.385449+0000","last_deep_scrub":"268'768","last_deep_scrub_stamp":"2024-09-12T01:05:02.385449+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.385449+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:32.646103+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3626,"num_read_kb":3280,"num_write":1010,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'340","reported_seq":977,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.507042+0000","last_change":"2024-09-12T01:04:58.507042+0000","last_active":"2024-09-12T01:04:58.507042+0000","last_peered":"2024-09-12T01:04:58.507042+0000","last_clean":"2024-09-12T01:04:58.507042+0000","last_became_active":"2024-09-12T00:18:22.870564+0000","last_became_peered":"2024-09-12T00:18:22.870564+0000","last_unstale":"2024-09-12T01:04:58.507042+0000","last_undegraded":"2024-09-12T01:04:58.507042+0000","last_fullsized":"2024-09-12T01:04:58.507042+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'340","last_scrub_stamp":"2024-09-12T01:04:58.506853+0000","last_deep_scrub":"268'340","last_deep_scrub_stamp":"2024-09-12T01:04:58.506853+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.506853+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:49.221170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":498,"num_read_kb":32133,"num_write":1040,"num_write_kb":41090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"268'487","reported_seq":2096,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.680342+0000","last_change":"2024-09-12T01:05:01.680342+0000","last_active":"2024-09-12T01:05:01.680342+0000","last_peered":"2024-09-12T01:05:01.680342+0000","last_clean":"2024-09-12T01:05:01.680342+0000","last_became_active":"2024-09-12T00:18:24.846508+0000","last_became_peered":"2024-09-12T00:18:24.846508+0000","last_unstale":"2024-09-12T01:05:01.680342+0000","last_undegraded":"2024-09-12T01:05:01.680342+0000","last_fullsized":"2024-09-12T01:05:01.680342+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'487","last_scrub_stamp":"2024-09-12T01:05:01.680166+0000","last_deep_scrub":"268'487","last_deep_scrub_stamp":"2024-09-12T01:05:01.680166+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.680166+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:35.737714+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2844,"num_read_kb":2655,"num_write":659,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'358","reported_seq":1001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.546009+0000","last_change":"2024-09-12T01:04:59.546009+0000","last_active":"2024-09-12T01:04:59.546009+0000","last_peered":"2024-09-12T01:04:59.546009+0000","last_clean":"2024-09-12T01:04:59.546009+0000","last_became_active":"2024-09-12T00:18:22.861074+0000","last_became_peered":"2024-09-12T00:18:22.861074+0000","last_unstale":"2024-09-12T01:04:59.546009+0000","last_undegraded":"2024-09-12T01:04:59.546009+0000","last_fullsized":"2024-09-12T01:04:59.546009+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'358","last_scrub_stamp":"2024-09-12T01:04:59.545680+0000","last_deep_scrub":"268'358","last_deep_scrub_stamp":"2024-09-12T01:04:59.545680+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.545680+0000","objects_scrubbed":9,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:21.773761+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":434032,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":541,"num_read_kb":4860,"num_write":1084,"num_write_kb":10925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'1021","reported_seq":2758,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:07.211509+0000","last_change":"2024-09-12T01:05:07.211509+0000","last_active":"2024-09-12T01:05:07.211509+0000","last_peered":"2024-09-12T01:05:07.211509+0000","last_clean":"2024-09-12T01:05:07.211509+0000","last_became_active":"2024-09-12T00:18:24.875913+0000","last_became_peered":"2024-09-12T00:18:24.875913+0000","last_unstale":"2024-09-12T01:05:07.211509+0000","last_undegraded":"2024-09-12T01:05:07.211509+0000","last_fullsized":"2024-09-12T01:05:07.211509+0000","mapping_epoch":26,"log_start":"268'1000","ondisk_log_start":"268'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1021","last_scrub_stamp":"2024-09-12T01:05:07.211320+0000","last_deep_scrub":"268'1021","last_deep_scrub_stamp":"2024-09-12T01:05:07.211320+0000","last_clean_scrub_stamp":"2024-09-12T01:05:07.211320+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":1000,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:52.009817+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4809,"num_read_kb":4259,"num_write":1397,"num_write_kb":538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'291","reported_seq":886,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.436540+0000","last_change":"2024-09-12T01:04:50.436366+0000","last_active":"2024-09-12T01:04:50.436540+0000","last_peered":"2024-09-12T01:04:50.436540+0000","last_clean":"2024-09-12T01:04:50.436540+0000","last_became_active":"2024-09-12T00:19:56.412792+0000","last_became_peered":"2024-09-12T00:19:56.412792+0000","last_unstale":"2024-09-12T01:04:50.436540+0000","last_undegraded":"2024-09-12T01:04:50.436540+0000","last_fullsized":"2024-09-12T01:04:50.436540+0000","mapping_epoch":39,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'291","last_scrub_stamp":"2024-09-12T01:04:50.436147+0000","last_deep_scrub":"268'291","last_deep_scrub_stamp":"2024-09-12T01:04:50.436147+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.436147+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:01.502828+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1343091,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":402,"num_read_kb":40979,"num_write":972,"num_write_kb":28776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"268'468","reported_seq":2055,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:06.510587+0000","last_change":"2024-09-12T01:05:06.510587+0000","last_active":"2024-09-12T01:05:06.510587+0000","last_peered":"2024-09-12T01:05:06.510587+0000","last_clean":"2024-09-12T01:05:06.510587+0000","last_became_active":"2024-09-12T00:18:24.862084+0000","last_became_peered":"2024-09-12T00:18:24.862084+0000","last_unstale":"2024-09-12T01:05:06.510587+0000","last_undegraded":"2024-09-12T01:05:06.510587+0000","last_fullsized":"2024-09-12T01:05:06.510587+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'468","last_scrub_stamp":"2024-09-12T01:05:06.510395+0000","last_deep_scrub":"268'468","last_deep_scrub_stamp":"2024-09-12T01:05:06.510395+0000","last_clean_scrub_stamp":"2024-09-12T01:05:06.510395+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:44.814542+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2471,"num_read_kb":2327,"num_write":538,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2554,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'376","reported_seq":1031,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.132657+0000","last_change":"2024-09-12T01:04:58.132657+0000","last_active":"2024-09-12T01:04:58.132657+0000","last_peered":"2024-09-12T01:04:58.132657+0000","last_clean":"2024-09-12T01:04:58.132657+0000","last_became_active":"2024-09-12T00:18:22.867749+0000","last_became_peered":"2024-09-12T00:18:22.867749+0000","last_unstale":"2024-09-12T01:04:58.132657+0000","last_undegraded":"2024-09-12T01:04:58.132657+0000","last_fullsized":"2024-09-12T01:04:58.132657+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'376","last_scrub_stamp":"2024-09-12T01:04:58.132452+0000","last_deep_scrub":"268'376","last_deep_scrub_stamp":"2024-09-12T01:04:58.132452+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.132452+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:04.893853+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":529,"num_read_kb":6849,"num_write":1205,"num_write_kb":38257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'510","reported_seq":2335,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.460303+0000","last_change":"2024-09-12T01:04:57.460303+0000","last_active":"2024-09-12T01:04:57.460303+0000","last_peered":"2024-09-12T01:04:57.460303+0000","last_clean":"2024-09-12T01:04:57.460303+0000","last_became_active":"2024-09-12T00:18:24.848163+0000","last_became_peered":"2024-09-12T00:18:24.848163+0000","last_unstale":"2024-09-12T01:04:57.460303+0000","last_undegraded":"2024-09-12T01:04:57.460303+0000","last_fullsized":"2024-09-12T01:04:57.460303+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'510","last_scrub_stamp":"2024-09-12T01:04:57.460112+0000","last_deep_scrub":"268'510","last_deep_scrub_stamp":"2024-09-12T01:04:57.460112+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.460112+0000","objects_scrubbed":5,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:50.852262+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2972,"num_read_kb":2819,"num_write":593,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4343,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'486","reported_seq":2150,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.207575+0000","last_change":"2024-09-12T01:05:04.207348+0000","last_active":"2024-09-12T01:05:04.207575+0000","last_peered":"2024-09-12T01:05:04.207575+0000","last_clean":"2024-09-12T01:05:04.207575+0000","last_became_active":"2024-09-12T00:18:24.860744+0000","last_became_peered":"2024-09-12T00:18:24.860744+0000","last_unstale":"2024-09-12T01:05:04.207575+0000","last_undegraded":"2024-09-12T01:05:04.207575+0000","last_fullsized":"2024-09-12T01:05:04.207575+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'486","last_scrub_stamp":"2024-09-12T01:05:04.207119+0000","last_deep_scrub":"268'486","last_deep_scrub_stamp":"2024-09-12T01:05:04.207119+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.207119+0000","objects_scrubbed":2,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:40.036635+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2780,"num_read_kb":2600,"num_write":590,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'313","reported_seq":926,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.505125+0000","last_change":"2024-09-12T01:04:57.505125+0000","last_active":"2024-09-12T01:04:57.505125+0000","last_peered":"2024-09-12T01:04:57.505125+0000","last_clean":"2024-09-12T01:04:57.505125+0000","last_became_active":"2024-09-12T00:18:55.962742+0000","last_became_peered":"2024-09-12T00:18:55.962742+0000","last_unstale":"2024-09-12T01:04:57.505125+0000","last_undegraded":"2024-09-12T01:04:57.505125+0000","last_fullsized":"2024-09-12T01:04:57.505125+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'313","last_scrub_stamp":"2024-09-12T01:04:57.504907+0000","last_deep_scrub":"268'313","last_deep_scrub_stamp":"2024-09-12T01:04:57.504907+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.504907+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:14.933948+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":391,"num_read_kb":39262,"num_write":935,"num_write_kb":33071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'396","reported_seq":1858,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.519805+0000","last_change":"2024-09-12T01:05:03.519644+0000","last_active":"2024-09-12T01:05:03.519805+0000","last_peered":"2024-09-12T01:05:03.519805+0000","last_clean":"2024-09-12T01:05:03.519805+0000","last_became_active":"2024-09-12T00:18:24.872902+0000","last_became_peered":"2024-09-12T00:18:24.872902+0000","last_unstale":"2024-09-12T01:05:03.519805+0000","last_undegraded":"2024-09-12T01:05:03.519805+0000","last_fullsized":"2024-09-12T01:05:03.519805+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'396","last_scrub_stamp":"2024-09-12T01:05:03.519461+0000","last_deep_scrub":"268'396","last_deep_scrub_stamp":"2024-09-12T01:05:03.519461+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.519461+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:35.432511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2097,"num_read_kb":1984,"num_write":437,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'310","reported_seq":929,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.742459+0000","last_change":"2024-09-12T01:04:56.742459+0000","last_active":"2024-09-12T01:04:56.742459+0000","last_peered":"2024-09-12T01:04:56.742459+0000","last_clean":"2024-09-12T01:04:56.742459+0000","last_became_active":"2024-09-12T00:18:22.860078+0000","last_became_peered":"2024-09-12T00:18:22.860078+0000","last_unstale":"2024-09-12T01:04:56.742459+0000","last_undegraded":"2024-09-12T01:04:56.742459+0000","last_fullsized":"2024-09-12T01:04:56.742459+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'310","last_scrub_stamp":"2024-09-12T01:04:56.742239+0000","last_deep_scrub":"268'310","last_deep_scrub_stamp":"2024-09-12T01:04:56.742239+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.742239+0000","objects_scrubbed":5,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:19.067757+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4534636,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":413,"num_read_kb":38650,"num_write":947,"num_write_kb":29439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"268'424","reported_seq":2052,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.546888+0000","last_change":"2024-09-12T01:05:01.546750+0000","last_active":"2024-09-12T01:05:01.546888+0000","last_peered":"2024-09-12T01:05:01.546888+0000","last_clean":"2024-09-12T01:05:01.546888+0000","last_became_active":"2024-09-12T00:18:24.852029+0000","last_became_peered":"2024-09-12T00:18:24.852029+0000","last_unstale":"2024-09-12T01:05:01.546888+0000","last_undegraded":"2024-09-12T01:05:01.546888+0000","last_fullsized":"2024-09-12T01:05:01.546888+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'424","last_scrub_stamp":"2024-09-12T01:05:01.546568+0000","last_deep_scrub":"268'424","last_deep_scrub_stamp":"2024-09-12T01:05:01.546568+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.546568+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:38.718196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2334,"num_read_kb":2233,"num_write":466,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'322","reported_seq":932,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.685245+0000","last_change":"2024-09-12T01:04:51.685245+0000","last_active":"2024-09-12T01:04:51.685245+0000","last_peered":"2024-09-12T01:04:51.685245+0000","last_clean":"2024-09-12T01:04:51.685245+0000","last_became_active":"2024-09-12T00:18:22.862665+0000","last_became_peered":"2024-09-12T00:18:22.862665+0000","last_unstale":"2024-09-12T01:04:51.685245+0000","last_undegraded":"2024-09-12T01:04:51.685245+0000","last_fullsized":"2024-09-12T01:04:51.685245+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'322","last_scrub_stamp":"2024-09-12T01:04:51.685000+0000","last_deep_scrub":"268'322","last_deep_scrub_stamp":"2024-09-12T01:04:51.685000+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.685000+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:57.317903+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079909,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":401,"num_read_kb":22932,"num_write":945,"num_write_kb":21492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'477","reported_seq":2108,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.503805+0000","last_change":"2024-09-12T01:04:54.503805+0000","last_active":"2024-09-12T01:04:54.503805+0000","last_peered":"2024-09-12T01:04:54.503805+0000","last_clean":"2024-09-12T01:04:54.503805+0000","last_became_active":"2024-09-12T00:18:24.849491+0000","last_became_peered":"2024-09-12T00:18:24.849491+0000","last_unstale":"2024-09-12T01:04:54.503805+0000","last_undegraded":"2024-09-12T01:04:54.503805+0000","last_fullsized":"2024-09-12T01:04:54.503805+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'477","last_scrub_stamp":"2024-09-12T01:04:54.503576+0000","last_deep_scrub":"268'477","last_deep_scrub_stamp":"2024-09-12T01:04:54.503576+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.503576+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:40.594497+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2579,"num_read_kb":2421,"num_write":543,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'353","reported_seq":986,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.198312+0000","last_change":"2024-09-12T01:04:51.198312+0000","last_active":"2024-09-12T01:04:51.198312+0000","last_peered":"2024-09-12T01:04:51.198312+0000","last_clean":"2024-09-12T01:04:51.198312+0000","last_became_active":"2024-09-12T00:18:22.856051+0000","last_became_peered":"2024-09-12T00:18:22.856051+0000","last_unstale":"2024-09-12T01:04:51.198312+0000","last_undegraded":"2024-09-12T01:04:51.198312+0000","last_fullsized":"2024-09-12T01:04:51.198312+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'353","last_scrub_stamp":"2024-09-12T01:04:51.198077+0000","last_deep_scrub":"268'353","last_deep_scrub_stamp":"2024-09-12T01:04:51.198077+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.198077+0000","objects_scrubbed":4,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:58.275825+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":458,"num_read_kb":24886,"num_write":1069,"num_write_kb":15091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"268'430","reported_seq":1984,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.486920+0000","last_change":"2024-09-12T01:04:55.486920+0000","last_active":"2024-09-12T01:04:55.486920+0000","last_peered":"2024-09-12T01:04:55.486920+0000","last_clean":"2024-09-12T01:04:55.486920+0000","last_became_active":"2024-09-12T00:18:24.853796+0000","last_became_peered":"2024-09-12T00:18:24.853796+0000","last_unstale":"2024-09-12T01:04:55.486920+0000","last_undegraded":"2024-09-12T01:04:55.486920+0000","last_fullsized":"2024-09-12T01:04:55.486920+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'430","last_scrub_stamp":"2024-09-12T01:04:55.486732+0000","last_deep_scrub":"268'430","last_deep_scrub_stamp":"2024-09-12T01:04:55.486732+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.486732+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:53.536416+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2472,"num_read_kb":2322,"num_write":521,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2265,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'333","reported_seq":1094,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.249250+0000","last_change":"2024-09-12T01:04:54.249250+0000","last_active":"2024-09-12T01:04:54.249250+0000","last_peered":"2024-09-12T01:04:54.249250+0000","last_clean":"2024-09-12T01:04:54.249250+0000","last_became_active":"2024-09-12T00:18:22.834904+0000","last_became_peered":"2024-09-12T00:18:22.834904+0000","last_unstale":"2024-09-12T01:04:54.249250+0000","last_undegraded":"2024-09-12T01:04:54.249250+0000","last_fullsized":"2024-09-12T01:04:54.249250+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'333","last_scrub_stamp":"2024-09-12T01:04:54.249011+0000","last_deep_scrub":"268'333","last_deep_scrub_stamp":"2024-09-12T01:04:54.249011+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.249011+0000","objects_scrubbed":10,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:24.413614+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":584,"num_read_kb":49706,"num_write":1054,"num_write_kb":43110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'505","reported_seq":2060,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.180476+0000","last_change":"2024-09-12T01:05:05.180476+0000","last_active":"2024-09-12T01:05:05.180476+0000","last_peered":"2024-09-12T01:05:05.180476+0000","last_clean":"2024-09-12T01:05:05.180476+0000","last_became_active":"2024-09-12T00:18:24.875112+0000","last_became_peered":"2024-09-12T00:18:24.875112+0000","last_unstale":"2024-09-12T01:05:05.180476+0000","last_undegraded":"2024-09-12T01:05:05.180476+0000","last_fullsized":"2024-09-12T01:05:05.180476+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'505","last_scrub_stamp":"2024-09-12T01:05:05.180281+0000","last_deep_scrub":"268'505","last_deep_scrub_stamp":"2024-09-12T01:05:05.180281+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.180281+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:44.845813+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2595,"num_read_kb":2402,"num_write":619,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":944,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'380","reported_seq":1079,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.292423+0000","last_change":"2024-09-12T01:04:57.292248+0000","last_active":"2024-09-12T01:04:57.292423+0000","last_peered":"2024-09-12T01:04:57.292423+0000","last_clean":"2024-09-12T01:04:57.292423+0000","last_became_active":"2024-09-12T00:18:22.841069+0000","last_became_peered":"2024-09-12T00:18:22.841069+0000","last_unstale":"2024-09-12T01:04:57.292423+0000","last_undegraded":"2024-09-12T01:04:57.292423+0000","last_fullsized":"2024-09-12T01:04:57.292423+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'380","last_scrub_stamp":"2024-09-12T01:04:57.292057+0000","last_deep_scrub":"268'380","last_deep_scrub_stamp":"2024-09-12T01:04:57.292057+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.292057+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:30.261493+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":685,"num_read_kb":23761,"num_write":1283,"num_write_kb":30294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'128","reported_seq":660,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:22.172702+0000","last_change":"2024-09-12T01:05:22.172702+0000","last_active":"2024-09-12T01:05:22.172702+0000","last_peered":"2024-09-12T01:05:22.172702+0000","last_clean":"2024-09-12T01:05:22.172702+0000","last_became_active":"2024-09-12T00:18:32.893410+0000","last_became_peered":"2024-09-12T00:18:32.893410+0000","last_unstale":"2024-09-12T01:05:22.172702+0000","last_undegraded":"2024-09-12T01:05:22.172702+0000","last_fullsized":"2024-09-12T01:05:22.172702+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'128","last_scrub_stamp":"2024-09-12T01:05:22.172513+0000","last_deep_scrub":"268'128","last_deep_scrub_stamp":"2024-09-12T01:05:22.172513+0000","last_clean_scrub_stamp":"2024-09-12T01:05:22.172513+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:42.436426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":200,"num_read_kb":180,"num_write":310,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'428","reported_seq":2039,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.119224+0000","last_change":"2024-09-12T01:05:00.119112+0000","last_active":"2024-09-12T01:05:00.119224+0000","last_peered":"2024-09-12T01:05:00.119224+0000","last_clean":"2024-09-12T01:05:00.119224+0000","last_became_active":"2024-09-12T00:18:24.862963+0000","last_became_peered":"2024-09-12T00:18:24.862963+0000","last_unstale":"2024-09-12T01:05:00.119224+0000","last_undegraded":"2024-09-12T01:05:00.119224+0000","last_fullsized":"2024-09-12T01:05:00.119224+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'428","last_scrub_stamp":"2024-09-12T01:05:00.118957+0000","last_deep_scrub":"268'428","last_deep_scrub_stamp":"2024-09-12T01:05:00.118957+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.118957+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:58.043360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2444,"num_read_kb":2313,"num_write":504,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"268'339","reported_seq":992,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.462684+0000","last_change":"2024-09-12T01:04:54.462526+0000","last_active":"2024-09-12T01:04:54.462684+0000","last_peered":"2024-09-12T01:04:54.462684+0000","last_clean":"2024-09-12T01:04:54.462684+0000","last_became_active":"2024-09-12T00:18:55.954978+0000","last_became_peered":"2024-09-12T00:18:55.954978+0000","last_unstale":"2024-09-12T01:04:54.462684+0000","last_undegraded":"2024-09-12T01:04:54.462684+0000","last_fullsized":"2024-09-12T01:04:54.462684+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'339","last_scrub_stamp":"2024-09-12T01:04:54.462327+0000","last_deep_scrub":"268'339","last_deep_scrub_stamp":"2024-09-12T01:04:54.462327+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.462327+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:39.747015+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":485,"num_read_kb":26304,"num_write":1090,"num_write_kb":30933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.560759+0000","last_change":"2024-09-12T01:05:09.560759+0000","last_active":"2024-09-12T01:05:09.560759+0000","last_peered":"2024-09-12T01:05:09.560759+0000","last_clean":"2024-09-12T01:05:09.560759+0000","last_became_active":"2024-09-12T00:18:26.871803+0000","last_became_peered":"2024-09-12T00:18:26.871803+0000","last_unstale":"2024-09-12T01:05:09.560759+0000","last_undegraded":"2024-09-12T01:05:09.560759+0000","last_fullsized":"2024-09-12T01:05:09.560759+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:09.560580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:09.560580+0000","last_clean_scrub_stamp":"2024-09-12T01:05:09.560580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:59.747447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'346","reported_seq":971,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:08.236524+0000","last_change":"2024-09-12T01:05:08.236524+0000","last_active":"2024-09-12T01:05:08.236524+0000","last_peered":"2024-09-12T01:05:08.236524+0000","last_clean":"2024-09-12T01:05:08.236524+0000","last_became_active":"2024-09-12T00:18:28.874861+0000","last_became_peered":"2024-09-12T00:18:28.874861+0000","last_unstale":"2024-09-12T01:05:08.236524+0000","last_undegraded":"2024-09-12T01:05:08.236524+0000","last_fullsized":"2024-09-12T01:05:08.236524+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'346","last_scrub_stamp":"2024-09-12T01:05:08.236282+0000","last_deep_scrub":"268'346","last_deep_scrub_stamp":"2024-09-12T01:05:08.236282+0000","last_clean_scrub_stamp":"2024-09-12T01:05:08.236282+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:46.275921+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51345,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":553,"num_read_kb":1147,"num_write":436,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:17.409971+0000","last_change":"2024-09-12T01:05:17.409971+0000","last_active":"2024-09-12T01:05:17.409971+0000","last_peered":"2024-09-12T01:05:17.409971+0000","last_clean":"2024-09-12T01:05:17.409971+0000","last_became_active":"2024-09-12T00:18:30.893886+0000","last_became_peered":"2024-09-12T00:18:30.893886+0000","last_unstale":"2024-09-12T01:05:17.409971+0000","last_undegraded":"2024-09-12T01:05:17.409971+0000","last_fullsized":"2024-09-12T01:05:17.409971+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:17.409798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:17.409798+0000","last_clean_scrub_stamp":"2024-09-12T01:05:17.409798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:36.218457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'2430","reported_seq":4333,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:22.557774+0000","last_change":"2024-09-12T01:05:22.557774+0000","last_active":"2024-09-12T01:05:22.557774+0000","last_peered":"2024-09-12T01:05:22.557774+0000","last_clean":"2024-09-12T01:05:22.557774+0000","last_became_active":"2024-09-12T00:18:32.899168+0000","last_became_peered":"2024-09-12T00:18:32.899168+0000","last_unstale":"2024-09-12T01:05:22.557774+0000","last_undegraded":"2024-09-12T01:05:22.557774+0000","last_fullsized":"2024-09-12T01:05:22.557774+0000","mapping_epoch":34,"log_start":"268'2400","ondisk_log_start":"268'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2430","last_scrub_stamp":"2024-09-12T01:05:22.557549+0000","last_deep_scrub":"268'2430","last_deep_scrub_stamp":"2024-09-12T01:05:22.557549+0000","last_clean_scrub_stamp":"2024-09-12T01:05:22.557549+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":2400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:32.205803+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6111,"num_read_kb":6108,"num_write":4843,"num_write_kb":1788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'1291","reported_seq":2845,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.595104+0000","last_change":"2024-09-12T01:05:02.595104+0000","last_active":"2024-09-12T01:05:02.595104+0000","last_peered":"2024-09-12T01:05:02.595104+0000","last_clean":"2024-09-12T01:05:02.595104+0000","last_became_active":"2024-09-12T00:18:24.869219+0000","last_became_peered":"2024-09-12T00:18:24.869219+0000","last_unstale":"2024-09-12T01:05:02.595104+0000","last_undegraded":"2024-09-12T01:05:02.595104+0000","last_fullsized":"2024-09-12T01:05:02.595104+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1291","last_scrub_stamp":"2024-09-12T01:05:02.594874+0000","last_deep_scrub":"268'1291","last_deep_scrub_stamp":"2024-09-12T01:05:02.594874+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.594874+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":1200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:11.005405+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5815,"num_read_kb":5070,"num_write":1809,"num_write_kb":816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'273","reported_seq":850,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:46.448096+0000","last_change":"2024-09-12T01:04:46.448096+0000","last_active":"2024-09-12T01:04:46.448096+0000","last_peered":"2024-09-12T01:04:46.448096+0000","last_clean":"2024-09-12T01:04:46.448096+0000","last_became_active":"2024-09-12T00:18:55.953363+0000","last_became_peered":"2024-09-12T00:18:55.953363+0000","last_unstale":"2024-09-12T01:04:46.448096+0000","last_undegraded":"2024-09-12T01:04:46.448096+0000","last_fullsized":"2024-09-12T01:04:46.448096+0000","mapping_epoch":37,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'273","last_scrub_stamp":"2024-09-12T01:04:46.447974+0000","last_deep_scrub":"268'273","last_deep_scrub_stamp":"2024-09-12T01:04:46.447974+0000","last_clean_scrub_stamp":"2024-09-12T01:04:46.447974+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:00.461692+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079954,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":346,"num_read_kb":12333,"num_write":862,"num_write_kb":28931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.054015+0000","last_change":"2024-09-12T01:05:09.053858+0000","last_active":"2024-09-12T01:05:09.054015+0000","last_peered":"2024-09-12T01:05:09.054015+0000","last_clean":"2024-09-12T01:05:09.054015+0000","last_became_active":"2024-09-12T00:18:26.848272+0000","last_became_peered":"2024-09-12T00:18:26.848272+0000","last_unstale":"2024-09-12T01:05:09.054015+0000","last_undegraded":"2024-09-12T01:05:09.054015+0000","last_fullsized":"2024-09-12T01:05:09.054015+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:09.053670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:09.053670+0000","last_clean_scrub_stamp":"2024-09-12T01:05:09.053670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:19.675861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'94","reported_seq":638,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.224917+0000","last_change":"2024-09-12T01:05:14.224917+0000","last_active":"2024-09-12T01:05:14.224917+0000","last_peered":"2024-09-12T01:05:14.224917+0000","last_clean":"2024-09-12T01:05:14.224917+0000","last_became_active":"2024-09-12T00:18:28.882630+0000","last_became_peered":"2024-09-12T00:18:28.882630+0000","last_unstale":"2024-09-12T01:05:14.224917+0000","last_undegraded":"2024-09-12T01:05:14.224917+0000","last_fullsized":"2024-09-12T01:05:14.224917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'94","last_scrub_stamp":"2024-09-12T01:05:14.224707+0000","last_deep_scrub":"268'94","last_deep_scrub_stamp":"2024-09-12T01:05:14.224707+0000","last_clean_scrub_stamp":"2024-09-12T01:05:14.224707+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:39.732375+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":98,"num_write":70,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:21.130425+0000","last_change":"2024-09-12T01:05:21.130425+0000","last_active":"2024-09-12T01:05:21.130425+0000","last_peered":"2024-09-12T01:05:21.130425+0000","last_clean":"2024-09-12T01:05:21.130425+0000","last_became_active":"2024-09-12T00:18:30.900908+0000","last_became_peered":"2024-09-12T00:18:30.900908+0000","last_unstale":"2024-09-12T01:05:21.130425+0000","last_undegraded":"2024-09-12T01:05:21.130425+0000","last_fullsized":"2024-09-12T01:05:21.130425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:21.130241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:21.130241+0000","last_clean_scrub_stamp":"2024-09-12T01:05:21.130241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:12.810251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'125","reported_seq":639,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:21.065203+0000","last_change":"2024-09-12T01:05:21.065203+0000","last_active":"2024-09-12T01:05:21.065203+0000","last_peered":"2024-09-12T01:05:21.065203+0000","last_clean":"2024-09-12T01:05:21.065203+0000","last_became_active":"2024-09-12T00:18:32.909547+0000","last_became_peered":"2024-09-12T00:18:32.909547+0000","last_unstale":"2024-09-12T01:05:21.065203+0000","last_undegraded":"2024-09-12T01:05:21.065203+0000","last_fullsized":"2024-09-12T01:05:21.065203+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'125","last_scrub_stamp":"2024-09-12T01:05:21.065082+0000","last_deep_scrub":"268'125","last_deep_scrub_stamp":"2024-09-12T01:05:21.065082+0000","last_clean_scrub_stamp":"2024-09-12T01:05:21.065082+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:04.170768+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":128,"num_write":294,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'1255","reported_seq":2907,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.243155+0000","last_change":"2024-09-12T01:04:55.243155+0000","last_active":"2024-09-12T01:04:55.243155+0000","last_peered":"2024-09-12T01:04:55.243155+0000","last_clean":"2024-09-12T01:04:55.243155+0000","last_became_active":"2024-09-12T00:18:24.859237+0000","last_became_peered":"2024-09-12T00:18:24.859237+0000","last_unstale":"2024-09-12T01:04:55.243155+0000","last_undegraded":"2024-09-12T01:04:55.243155+0000","last_fullsized":"2024-09-12T01:04:55.243155+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1255","last_scrub_stamp":"2024-09-12T01:04:55.242968+0000","last_deep_scrub":"268'1255","last_deep_scrub_stamp":"2024-09-12T01:04:55.242968+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.242968+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:13.838468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5766,"num_read_kb":5095,"num_write":1782,"num_write_kb":773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'386","reported_seq":1113,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.459313+0000","last_change":"2024-09-12T01:04:52.459156+0000","last_active":"2024-09-12T01:04:52.459313+0000","last_peered":"2024-09-12T01:04:52.459313+0000","last_clean":"2024-09-12T01:04:52.459313+0000","last_became_active":"2024-09-12T00:18:22.873262+0000","last_became_peered":"2024-09-12T00:18:22.873262+0000","last_unstale":"2024-09-12T01:04:52.459313+0000","last_undegraded":"2024-09-12T01:04:52.459313+0000","last_fullsized":"2024-09-12T01:04:52.459313+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'386","last_scrub_stamp":"2024-09-12T01:04:52.458890+0000","last_deep_scrub":"268'386","last_deep_scrub_stamp":"2024-09-12T01:04:52.458890+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.458890+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:38.488860+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":606,"num_read_kb":24526,"num_write":1220,"num_write_kb":41630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:10.016844+0000","last_change":"2024-09-12T01:05:10.016844+0000","last_active":"2024-09-12T01:05:10.016844+0000","last_peered":"2024-09-12T01:05:10.016844+0000","last_clean":"2024-09-12T01:05:10.016844+0000","last_became_active":"2024-09-12T00:18:26.855348+0000","last_became_peered":"2024-09-12T00:18:26.855348+0000","last_unstale":"2024-09-12T01:05:10.016844+0000","last_undegraded":"2024-09-12T01:05:10.016844+0000","last_fullsized":"2024-09-12T01:05:10.016844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:10.016740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:10.016740+0000","last_clean_scrub_stamp":"2024-09-12T01:05:10.016740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:03.375637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'125","reported_seq":686,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.456078+0000","last_change":"2024-09-12T01:05:03.455781+0000","last_active":"2024-09-12T01:05:03.456078+0000","last_peered":"2024-09-12T01:05:03.456078+0000","last_clean":"2024-09-12T01:05:03.456078+0000","last_became_active":"2024-09-12T00:18:28.884722+0000","last_became_peered":"2024-09-12T00:18:28.884722+0000","last_unstale":"2024-09-12T01:05:03.456078+0000","last_undegraded":"2024-09-12T01:05:03.456078+0000","last_fullsized":"2024-09-12T01:05:03.456078+0000","mapping_epoch":30,"log_start":"268'100","ondisk_log_start":"268'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'125","last_scrub_stamp":"2024-09-12T01:05:03.455518+0000","last_deep_scrub":"268'125","last_deep_scrub_stamp":"2024-09-12T01:05:03.455518+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.455518+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:28.693704+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":98,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'785","reported_seq":4751,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:16.426530+0000","last_change":"2024-09-12T01:05:16.426530+0000","last_active":"2024-09-12T01:05:16.426530+0000","last_peered":"2024-09-12T01:05:16.426530+0000","last_clean":"2024-09-12T01:05:16.426530+0000","last_became_active":"2024-09-12T00:18:30.893739+0000","last_became_peered":"2024-09-12T00:18:30.893739+0000","last_unstale":"2024-09-12T01:05:16.426530+0000","last_undegraded":"2024-09-12T01:05:16.426530+0000","last_fullsized":"2024-09-12T01:05:16.426530+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'785","last_scrub_stamp":"2024-09-12T01:05:16.426339+0000","last_deep_scrub":"268'785","last_deep_scrub_stamp":"2024-09-12T01:05:16.426339+0000","last_clean_scrub_stamp":"2024-09-12T01:05:16.426339+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:12.363363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'213","reported_seq":1056,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:23.179674+0000","last_change":"2024-09-12T01:05:23.179674+0000","last_active":"2024-09-12T01:05:23.179674+0000","last_peered":"2024-09-12T01:05:23.179674+0000","last_clean":"2024-09-12T01:05:23.179674+0000","last_became_active":"2024-09-12T00:18:32.884130+0000","last_became_peered":"2024-09-12T00:18:32.884130+0000","last_unstale":"2024-09-12T01:05:23.179674+0000","last_undegraded":"2024-09-12T01:05:23.179674+0000","last_fullsized":"2024-09-12T01:05:23.179674+0000","mapping_epoch":34,"log_start":"268'201","ondisk_log_start":"268'201","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'213","last_scrub_stamp":"2024-09-12T01:05:23.179469+0000","last_deep_scrub":"268'213","last_deep_scrub_stamp":"2024-09-12T01:05:23.179469+0000","last_clean_scrub_stamp":"2024-09-12T01:05:23.179469+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":201,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:35.435066+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":639,"num_read_kb":629,"num_write":484,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'895","reported_seq":2632,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.033355+0000","last_change":"2024-09-12T01:05:02.033355+0000","last_active":"2024-09-12T01:05:02.033355+0000","last_peered":"2024-09-12T01:05:02.033355+0000","last_clean":"2024-09-12T01:05:02.033355+0000","last_became_active":"2024-09-12T00:18:24.868103+0000","last_became_peered":"2024-09-12T00:18:24.868103+0000","last_unstale":"2024-09-12T01:05:02.033355+0000","last_undegraded":"2024-09-12T01:05:02.033355+0000","last_fullsized":"2024-09-12T01:05:02.033355+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'895","last_scrub_stamp":"2024-09-12T01:05:02.033166+0000","last_deep_scrub":"268'895","last_deep_scrub_stamp":"2024-09-12T01:05:02.033166+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.033166+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":800,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:53.892778+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4419,"num_read_kb":4003,"num_write":1187,"num_write_kb":433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":709,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'320","reported_seq":946,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.711337+0000","last_change":"2024-09-12T01:04:49.711181+0000","last_active":"2024-09-12T01:04:49.711337+0000","last_peered":"2024-09-12T01:04:49.711337+0000","last_clean":"2024-09-12T01:04:49.711337+0000","last_became_active":"2024-09-12T00:18:22.850530+0000","last_became_peered":"2024-09-12T00:18:22.850530+0000","last_unstale":"2024-09-12T01:04:49.711337+0000","last_undegraded":"2024-09-12T01:04:49.711337+0000","last_fullsized":"2024-09-12T01:04:49.711337+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'320","last_scrub_stamp":"2024-09-12T01:04:49.710990+0000","last_deep_scrub":"268'320","last_deep_scrub_stamp":"2024-09-12T01:04:49.710990+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.710990+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:12.435073+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263200,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":460,"num_read_kb":6949,"num_write":1090,"num_write_kb":36294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:10.595358+0000","last_change":"2024-09-12T01:05:10.595358+0000","last_active":"2024-09-12T01:05:10.595358+0000","last_peered":"2024-09-12T01:05:10.595358+0000","last_clean":"2024-09-12T01:05:10.595358+0000","last_became_active":"2024-09-12T00:18:26.867729+0000","last_became_peered":"2024-09-12T00:18:26.867729+0000","last_unstale":"2024-09-12T01:05:10.595358+0000","last_undegraded":"2024-09-12T01:05:10.595358+0000","last_fullsized":"2024-09-12T01:05:10.595358+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:10.595177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:10.595177+0000","last_clean_scrub_stamp":"2024-09-12T01:05:10.595177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:11.351936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'269","reported_seq":852,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.440753+0000","last_change":"2024-09-12T01:05:13.440753+0000","last_active":"2024-09-12T01:05:13.440753+0000","last_peered":"2024-09-12T01:05:13.440753+0000","last_clean":"2024-09-12T01:05:13.440753+0000","last_became_active":"2024-09-12T00:18:28.884779+0000","last_became_peered":"2024-09-12T00:18:28.884779+0000","last_unstale":"2024-09-12T01:05:13.440753+0000","last_undegraded":"2024-09-12T01:05:13.440753+0000","last_fullsized":"2024-09-12T01:05:13.440753+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'269","last_scrub_stamp":"2024-09-12T01:05:13.440552+0000","last_deep_scrub":"268'269","last_deep_scrub_stamp":"2024-09-12T01:05:13.440552+0000","last_clean_scrub_stamp":"2024-09-12T01:05:13.440552+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:53.485878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49225,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":1009,"num_write":358,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'817","reported_seq":2296,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:21.083036+0000","last_change":"2024-09-12T01:05:21.083036+0000","last_active":"2024-09-12T01:05:21.083036+0000","last_peered":"2024-09-12T01:05:21.083036+0000","last_clean":"2024-09-12T01:05:21.083036+0000","last_became_active":"2024-09-12T00:18:30.894642+0000","last_became_peered":"2024-09-12T00:18:30.894642+0000","last_unstale":"2024-09-12T01:05:21.083036+0000","last_undegraded":"2024-09-12T01:05:21.083036+0000","last_fullsized":"2024-09-12T01:05:21.083036+0000","mapping_epoch":32,"log_start":"268'800","ondisk_log_start":"268'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'817","last_scrub_stamp":"2024-09-12T01:05:21.082861+0000","last_deep_scrub":"268'817","last_deep_scrub_stamp":"2024-09-12T01:05:21.082861+0000","last_clean_scrub_stamp":"2024-09-12T01:05:21.082861+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:43.763014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'478","reported_seq":2089,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.519507+0000","last_change":"2024-09-12T01:05:00.519507+0000","last_active":"2024-09-12T01:05:00.519507+0000","last_peered":"2024-09-12T01:05:00.519507+0000","last_clean":"2024-09-12T01:05:00.519507+0000","last_became_active":"2024-09-12T00:18:24.869435+0000","last_became_peered":"2024-09-12T00:18:24.869435+0000","last_unstale":"2024-09-12T01:05:00.519507+0000","last_undegraded":"2024-09-12T01:05:00.519507+0000","last_fullsized":"2024-09-12T01:05:00.519507+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'478","last_scrub_stamp":"2024-09-12T01:05:00.519326+0000","last_deep_scrub":"268'478","last_deep_scrub_stamp":"2024-09-12T01:05:00.519326+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.519326+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:06.717819+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2569,"num_read_kb":2408,"num_write":545,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2278,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'380","reported_seq":1016,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.422509+0000","last_change":"2024-09-12T01:04:53.422509+0000","last_active":"2024-09-12T01:04:53.422509+0000","last_peered":"2024-09-12T01:04:53.422509+0000","last_clean":"2024-09-12T01:04:53.422509+0000","last_became_active":"2024-09-12T00:18:22.877327+0000","last_became_peered":"2024-09-12T00:18:22.877327+0000","last_unstale":"2024-09-12T01:04:53.422509+0000","last_undegraded":"2024-09-12T01:04:53.422509+0000","last_fullsized":"2024-09-12T01:04:53.422509+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'380","last_scrub_stamp":"2024-09-12T01:04:53.422308+0000","last_deep_scrub":"268'380","last_deep_scrub_stamp":"2024-09-12T01:04:53.422308+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.422308+0000","objects_scrubbed":7,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:37.542577+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170146,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":498,"num_read_kb":23147,"num_write":1077,"num_write_kb":55226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.519685+0000","last_change":"2024-09-12T01:05:05.519685+0000","last_active":"2024-09-12T01:05:05.519685+0000","last_peered":"2024-09-12T01:05:05.519685+0000","last_clean":"2024-09-12T01:05:05.519685+0000","last_became_active":"2024-09-12T00:18:26.874638+0000","last_became_peered":"2024-09-12T00:18:26.874638+0000","last_unstale":"2024-09-12T01:05:05.519685+0000","last_undegraded":"2024-09-12T01:05:05.519685+0000","last_fullsized":"2024-09-12T01:05:05.519685+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:05.519508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:05.519508+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.519508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:08.182181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'345","reported_seq":972,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.584867+0000","last_change":"2024-09-12T01:05:13.584867+0000","last_active":"2024-09-12T01:05:13.584867+0000","last_peered":"2024-09-12T01:05:13.584867+0000","last_clean":"2024-09-12T01:05:13.584867+0000","last_became_active":"2024-09-12T00:18:28.895950+0000","last_became_peered":"2024-09-12T00:18:28.895950+0000","last_unstale":"2024-09-12T01:05:13.584867+0000","last_undegraded":"2024-09-12T01:05:13.584867+0000","last_fullsized":"2024-09-12T01:05:13.584867+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'345","last_scrub_stamp":"2024-09-12T01:05:13.584649+0000","last_deep_scrub":"268'345","last_deep_scrub_stamp":"2024-09-12T01:05:13.584649+0000","last_clean_scrub_stamp":"2024-09-12T01:05:13.584649+0000","objects_scrubbed":10,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:19.236652+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19722,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":538,"num_read_kb":1043,"num_write":414,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:07.581890+0000","last_change":"2024-09-12T01:05:07.581890+0000","last_active":"2024-09-12T01:05:07.581890+0000","last_peered":"2024-09-12T01:05:07.581890+0000","last_clean":"2024-09-12T01:05:07.581890+0000","last_became_active":"2024-09-12T00:18:30.874074+0000","last_became_peered":"2024-09-12T00:18:30.874074+0000","last_unstale":"2024-09-12T01:05:07.581890+0000","last_undegraded":"2024-09-12T01:05:07.581890+0000","last_fullsized":"2024-09-12T01:05:07.581890+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:07.581718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:07.581718+0000","last_clean_scrub_stamp":"2024-09-12T01:05:07.581718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:16.962248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'556","reported_seq":1378,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:18.539562+0000","last_change":"2024-09-12T01:05:18.539562+0000","last_active":"2024-09-12T01:05:18.539562+0000","last_peered":"2024-09-12T01:05:18.539562+0000","last_clean":"2024-09-12T01:05:18.539562+0000","last_became_active":"2024-09-12T00:18:32.899046+0000","last_became_peered":"2024-09-12T00:18:32.899046+0000","last_unstale":"2024-09-12T01:05:18.539562+0000","last_undegraded":"2024-09-12T01:05:18.539562+0000","last_fullsized":"2024-09-12T01:05:18.539562+0000","mapping_epoch":34,"log_start":"268'500","ondisk_log_start":"268'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'556","last_scrub_stamp":"2024-09-12T01:05:18.539369+0000","last_deep_scrub":"268'556","last_deep_scrub_stamp":"2024-09-12T01:05:18.539369+0000","last_clean_scrub_stamp":"2024-09-12T01:05:18.539369+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:42.569213+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1268,"num_read_kb":1267,"num_write":1132,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'483","reported_seq":2100,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.135439+0000","last_change":"2024-09-12T01:04:54.135439+0000","last_active":"2024-09-12T01:04:54.135439+0000","last_peered":"2024-09-12T01:04:54.135439+0000","last_clean":"2024-09-12T01:04:54.135439+0000","last_became_active":"2024-09-12T00:18:24.861455+0000","last_became_peered":"2024-09-12T00:18:24.861455+0000","last_unstale":"2024-09-12T01:04:54.135439+0000","last_undegraded":"2024-09-12T01:04:54.135439+0000","last_fullsized":"2024-09-12T01:04:54.135439+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'483","last_scrub_stamp":"2024-09-12T01:04:54.135256+0000","last_deep_scrub":"268'483","last_deep_scrub_stamp":"2024-09-12T01:04:54.135256+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.135256+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:48.039409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2490,"num_read_kb":2350,"num_write":569,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'372","reported_seq":1035,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.432703+0000","last_change":"2024-09-12T01:04:51.432703+0000","last_active":"2024-09-12T01:04:51.432703+0000","last_peered":"2024-09-12T01:04:51.432703+0000","last_clean":"2024-09-12T01:04:51.432703+0000","last_became_active":"2024-09-12T00:18:22.871330+0000","last_became_peered":"2024-09-12T00:18:22.871330+0000","last_unstale":"2024-09-12T01:04:51.432703+0000","last_undegraded":"2024-09-12T01:04:51.432703+0000","last_fullsized":"2024-09-12T01:04:51.432703+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'372","last_scrub_stamp":"2024-09-12T01:04:51.432478+0000","last_deep_scrub":"268'372","last_deep_scrub_stamp":"2024-09-12T01:04:51.432478+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.432478+0000","objects_scrubbed":7,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:00.323028+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22053,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":541,"num_read_kb":9754,"num_write":1101,"num_write_kb":25837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"268'4","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.419318+0000","last_change":"2024-09-12T01:04:59.419318+0000","last_active":"2024-09-12T01:04:59.419318+0000","last_peered":"2024-09-12T01:04:59.419318+0000","last_clean":"2024-09-12T01:04:59.419318+0000","last_became_active":"2024-09-12T00:18:26.858529+0000","last_became_peered":"2024-09-12T00:18:26.858529+0000","last_unstale":"2024-09-12T01:04:59.419318+0000","last_undegraded":"2024-09-12T01:04:59.419318+0000","last_fullsized":"2024-09-12T01:04:59.419318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:04:59.419081+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:04:59.419081+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.419081+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:54.969136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'291","reported_seq":883,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:11.045026+0000","last_change":"2024-09-12T01:05:11.045026+0000","last_active":"2024-09-12T01:05:11.045026+0000","last_peered":"2024-09-12T01:05:11.045026+0000","last_clean":"2024-09-12T01:05:11.045026+0000","last_became_active":"2024-09-12T00:18:28.895521+0000","last_became_peered":"2024-09-12T00:18:28.895521+0000","last_unstale":"2024-09-12T01:05:11.045026+0000","last_undegraded":"2024-09-12T01:05:11.045026+0000","last_fullsized":"2024-09-12T01:05:11.045026+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'291","last_scrub_stamp":"2024-09-12T01:05:11.044839+0000","last_deep_scrub":"268'291","last_deep_scrub_stamp":"2024-09-12T01:05:11.044839+0000","last_clean_scrub_stamp":"2024-09-12T01:05:11.044839+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:01.971620+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":471,"num_read_kb":1097,"num_write":388,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:22.076868+0000","last_change":"2024-09-12T01:05:22.076868+0000","last_active":"2024-09-12T01:05:22.076868+0000","last_peered":"2024-09-12T01:05:22.076868+0000","last_clean":"2024-09-12T01:05:22.076868+0000","last_became_active":"2024-09-12T00:18:30.905601+0000","last_became_peered":"2024-09-12T00:18:30.905601+0000","last_unstale":"2024-09-12T01:05:22.076868+0000","last_undegraded":"2024-09-12T01:05:22.076868+0000","last_fullsized":"2024-09-12T01:05:22.076868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:22.076639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:22.076639+0000","last_clean_scrub_stamp":"2024-09-12T01:05:22.076639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:49.872299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'124","reported_seq":622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.771180+0000","last_change":"2024-09-12T01:05:09.771180+0000","last_active":"2024-09-12T01:05:09.771180+0000","last_peered":"2024-09-12T01:05:09.771180+0000","last_clean":"2024-09-12T01:05:09.771180+0000","last_became_active":"2024-09-12T00:18:32.899284+0000","last_became_peered":"2024-09-12T00:18:32.899284+0000","last_unstale":"2024-09-12T01:05:09.771180+0000","last_undegraded":"2024-09-12T01:05:09.771180+0000","last_fullsized":"2024-09-12T01:05:09.771180+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'124","last_scrub_stamp":"2024-09-12T01:05:09.771002+0000","last_deep_scrub":"268'124","last_deep_scrub_stamp":"2024-09-12T01:05:09.771002+0000","last_clean_scrub_stamp":"2024-09-12T01:05:09.771002+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:14.512976+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":95,"num_write":292,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'840","reported_seq":2349,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.747511+0000","last_change":"2024-09-12T01:04:54.747511+0000","last_active":"2024-09-12T01:04:54.747511+0000","last_peered":"2024-09-12T01:04:54.747511+0000","last_clean":"2024-09-12T01:04:54.747511+0000","last_became_active":"2024-09-12T00:18:24.869582+0000","last_became_peered":"2024-09-12T00:18:24.869582+0000","last_unstale":"2024-09-12T01:04:54.747511+0000","last_undegraded":"2024-09-12T01:04:54.747511+0000","last_fullsized":"2024-09-12T01:04:54.747511+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'840","last_scrub_stamp":"2024-09-12T01:04:54.747326+0000","last_deep_scrub":"268'840","last_deep_scrub_stamp":"2024-09-12T01:04:54.747326+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.747326+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":800,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:53.076407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4018,"num_read_kb":3569,"num_write":1156,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'263","reported_seq":871,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.466935+0000","last_change":"2024-09-12T01:04:55.466935+0000","last_active":"2024-09-12T01:04:55.466935+0000","last_peered":"2024-09-12T01:04:55.466935+0000","last_clean":"2024-09-12T01:04:55.466935+0000","last_became_active":"2024-09-12T00:18:22.875150+0000","last_became_peered":"2024-09-12T00:18:22.875150+0000","last_unstale":"2024-09-12T01:04:55.466935+0000","last_undegraded":"2024-09-12T01:04:55.466935+0000","last_fullsized":"2024-09-12T01:04:55.466935+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'263","last_scrub_stamp":"2024-09-12T01:04:55.466756+0000","last_deep_scrub":"268'263","last_deep_scrub_stamp":"2024-09-12T01:04:55.466756+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.466756+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:15.779888+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174702,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":374,"num_read_kb":19791,"num_write":779,"num_write_kb":25570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"268'6","reported_seq":993,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.376795+0000","last_change":"2024-09-12T01:05:00.376795+0000","last_active":"2024-09-12T01:05:00.376795+0000","last_peered":"2024-09-12T01:05:00.376795+0000","last_clean":"2024-09-12T01:05:00.376795+0000","last_became_active":"2024-09-12T00:18:26.857788+0000","last_became_peered":"2024-09-12T00:18:26.857788+0000","last_unstale":"2024-09-12T01:05:00.376795+0000","last_undegraded":"2024-09-12T01:05:00.376795+0000","last_fullsized":"2024-09-12T01:05:00.376795+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T01:05:00.376612+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T01:05:00.376612+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.376612+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:45.589459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'313","reported_seq":919,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:10.500913+0000","last_change":"2024-09-12T01:05:10.500913+0000","last_active":"2024-09-12T01:05:10.500913+0000","last_peered":"2024-09-12T01:05:10.500913+0000","last_clean":"2024-09-12T01:05:10.500913+0000","last_became_active":"2024-09-12T00:18:28.886806+0000","last_became_peered":"2024-09-12T00:18:28.886806+0000","last_unstale":"2024-09-12T01:05:10.500913+0000","last_undegraded":"2024-09-12T01:05:10.500913+0000","last_fullsized":"2024-09-12T01:05:10.500913+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'313","last_scrub_stamp":"2024-09-12T01:05:10.500704+0000","last_deep_scrub":"268'313","last_deep_scrub_stamp":"2024-09-12T01:05:10.500704+0000","last_clean_scrub_stamp":"2024-09-12T01:05:10.500704+0000","objects_scrubbed":9,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:48.042274+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45713,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":494,"num_read_kb":1053,"num_write":392,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'809","reported_seq":2420,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.203907+0000","last_change":"2024-09-12T01:05:14.203907+0000","last_active":"2024-09-12T01:05:14.203907+0000","last_peered":"2024-09-12T01:05:14.203907+0000","last_clean":"2024-09-12T01:05:14.203907+0000","last_became_active":"2024-09-12T00:18:30.888688+0000","last_became_peered":"2024-09-12T00:18:30.888688+0000","last_unstale":"2024-09-12T01:05:14.203907+0000","last_undegraded":"2024-09-12T01:05:14.203907+0000","last_fullsized":"2024-09-12T01:05:14.203907+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'809","last_scrub_stamp":"2024-09-12T01:05:14.203732+0000","last_deep_scrub":"268'809","last_deep_scrub_stamp":"2024-09-12T01:05:14.203732+0000","last_clean_scrub_stamp":"2024-09-12T01:05:14.203732+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:46.916328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'132","reported_seq":642,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:18.127644+0000","last_change":"2024-09-12T01:05:18.127644+0000","last_active":"2024-09-12T01:05:18.127644+0000","last_peered":"2024-09-12T01:05:18.127644+0000","last_clean":"2024-09-12T01:05:18.127644+0000","last_became_active":"2024-09-12T00:18:32.904609+0000","last_became_peered":"2024-09-12T00:18:32.904609+0000","last_unstale":"2024-09-12T01:05:18.127644+0000","last_undegraded":"2024-09-12T01:05:18.127644+0000","last_fullsized":"2024-09-12T01:05:18.127644+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'132","last_scrub_stamp":"2024-09-12T01:05:18.127453+0000","last_deep_scrub":"268'132","last_deep_scrub_stamp":"2024-09-12T01:05:18.127453+0000","last_clean_scrub_stamp":"2024-09-12T01:05:18.127453+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:38.888363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":137,"num_read_kb":127,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'816","reported_seq":2298,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.205034+0000","last_change":"2024-09-12T01:04:54.205034+0000","last_active":"2024-09-12T01:04:54.205034+0000","last_peered":"2024-09-12T01:04:54.205034+0000","last_clean":"2024-09-12T01:04:54.205034+0000","last_became_active":"2024-09-12T00:18:24.856572+0000","last_became_peered":"2024-09-12T00:18:24.856572+0000","last_unstale":"2024-09-12T01:04:54.205034+0000","last_undegraded":"2024-09-12T01:04:54.205034+0000","last_fullsized":"2024-09-12T01:04:54.205034+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'816","last_scrub_stamp":"2024-09-12T01:04:54.204847+0000","last_deep_scrub":"268'816","last_deep_scrub_stamp":"2024-09-12T01:04:54.204847+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.204847+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:06.157588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3705,"num_read_kb":3326,"num_write":1078,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'390","reported_seq":1108,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.585386+0000","last_change":"2024-09-12T01:04:48.585386+0000","last_active":"2024-09-12T01:04:48.585386+0000","last_peered":"2024-09-12T01:04:48.585386+0000","last_clean":"2024-09-12T01:04:48.585386+0000","last_became_active":"2024-09-12T00:18:22.865067+0000","last_became_peered":"2024-09-12T00:18:22.865067+0000","last_unstale":"2024-09-12T01:04:48.585386+0000","last_undegraded":"2024-09-12T01:04:48.585386+0000","last_fullsized":"2024-09-12T01:04:48.585386+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'390","last_scrub_stamp":"2024-09-12T01:04:48.585156+0000","last_deep_scrub":"268'390","last_deep_scrub_stamp":"2024-09-12T01:04:48.585156+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.585156+0000","objects_scrubbed":9,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:32.682633+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300494,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":644,"num_read_kb":35348,"num_write":1371,"num_write_kb":29498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.418400+0000","last_change":"2024-09-12T01:04:58.418400+0000","last_active":"2024-09-12T01:04:58.418400+0000","last_peered":"2024-09-12T01:04:58.418400+0000","last_clean":"2024-09-12T01:04:58.418400+0000","last_became_active":"2024-09-12T00:18:26.867793+0000","last_became_peered":"2024-09-12T00:18:26.867793+0000","last_unstale":"2024-09-12T01:04:58.418400+0000","last_undegraded":"2024-09-12T01:04:58.418400+0000","last_fullsized":"2024-09-12T01:04:58.418400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:58.418226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:58.418226+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.418226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:04.200862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'480","reported_seq":1134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:06.288694+0000","last_change":"2024-09-12T01:05:06.288694+0000","last_active":"2024-09-12T01:05:06.288694+0000","last_peered":"2024-09-12T01:05:06.288694+0000","last_clean":"2024-09-12T01:05:06.288694+0000","last_became_active":"2024-09-12T00:18:28.875891+0000","last_became_peered":"2024-09-12T00:18:28.875891+0000","last_unstale":"2024-09-12T01:05:06.288694+0000","last_undegraded":"2024-09-12T01:05:06.288694+0000","last_fullsized":"2024-09-12T01:05:06.288694+0000","mapping_epoch":30,"log_start":"268'400","ondisk_log_start":"268'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'480","last_scrub_stamp":"2024-09-12T01:05:06.288498+0000","last_deep_scrub":"268'480","last_deep_scrub_stamp":"2024-09-12T01:05:06.288498+0000","last_clean_scrub_stamp":"2024-09-12T01:05:06.288498+0000","objects_scrubbed":7,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:38.359325+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96447,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":834,"num_read_kb":1977,"num_write":680,"num_write_kb":567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.409073+0000","last_change":"2024-09-12T01:05:02.409073+0000","last_active":"2024-09-12T01:05:02.409073+0000","last_peered":"2024-09-12T01:05:02.409073+0000","last_clean":"2024-09-12T01:05:02.409073+0000","last_became_active":"2024-09-12T00:18:30.895401+0000","last_became_peered":"2024-09-12T00:18:30.895401+0000","last_unstale":"2024-09-12T01:05:02.409073+0000","last_undegraded":"2024-09-12T01:05:02.409073+0000","last_fullsized":"2024-09-12T01:05:02.409073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:02.408869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:02.408869+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.408869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:22.455398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'155","reported_seq":690,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:12.562877+0000","last_change":"2024-09-12T01:05:12.562877+0000","last_active":"2024-09-12T01:05:12.562877+0000","last_peered":"2024-09-12T01:05:12.562877+0000","last_clean":"2024-09-12T01:05:12.562877+0000","last_became_active":"2024-09-12T00:18:32.892682+0000","last_became_peered":"2024-09-12T00:18:32.892682+0000","last_unstale":"2024-09-12T01:05:12.562877+0000","last_undegraded":"2024-09-12T01:05:12.562877+0000","last_fullsized":"2024-09-12T01:05:12.562877+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'155","last_scrub_stamp":"2024-09-12T01:05:12.562632+0000","last_deep_scrub":"268'155","last_deep_scrub_stamp":"2024-09-12T01:05:12.562632+0000","last_clean_scrub_stamp":"2024-09-12T01:05:12.562632+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:26.872352+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1103,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":196,"num_read_kb":180,"num_write":352,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'460","reported_seq":2083,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.181483+0000","last_change":"2024-09-12T01:04:53.181483+0000","last_active":"2024-09-12T01:04:53.181483+0000","last_peered":"2024-09-12T01:04:53.181483+0000","last_clean":"2024-09-12T01:04:53.181483+0000","last_became_active":"2024-09-12T00:18:24.852683+0000","last_became_peered":"2024-09-12T00:18:24.852683+0000","last_unstale":"2024-09-12T01:04:53.181483+0000","last_undegraded":"2024-09-12T01:04:53.181483+0000","last_fullsized":"2024-09-12T01:04:53.181483+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'460","last_scrub_stamp":"2024-09-12T01:04:53.181308+0000","last_deep_scrub":"268'460","last_deep_scrub_stamp":"2024-09-12T01:04:53.181308+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.181308+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:33.622967+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2390,"num_read_kb":2271,"num_write":519,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'367","reported_seq":1025,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.281782+0000","last_change":"2024-09-12T01:04:49.281782+0000","last_active":"2024-09-12T01:04:49.281782+0000","last_peered":"2024-09-12T01:04:49.281782+0000","last_clean":"2024-09-12T01:04:49.281782+0000","last_became_active":"2024-09-12T00:18:22.841689+0000","last_became_peered":"2024-09-12T00:18:22.841689+0000","last_unstale":"2024-09-12T01:04:49.281782+0000","last_undegraded":"2024-09-12T01:04:49.281782+0000","last_fullsized":"2024-09-12T01:04:49.281782+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'367","last_scrub_stamp":"2024-09-12T01:04:49.281537+0000","last_deep_scrub":"268'367","last_deep_scrub_stamp":"2024-09-12T01:04:49.281537+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.281537+0000","objects_scrubbed":6,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:15.412534+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194384,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":496,"num_read_kb":55770,"num_write":1160,"num_write_kb":35616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.393694+0000","last_change":"2024-09-12T01:05:01.393694+0000","last_active":"2024-09-12T01:05:01.393694+0000","last_peered":"2024-09-12T01:05:01.393694+0000","last_clean":"2024-09-12T01:05:01.393694+0000","last_became_active":"2024-09-12T00:18:26.845618+0000","last_became_peered":"2024-09-12T00:18:26.845618+0000","last_unstale":"2024-09-12T01:05:01.393694+0000","last_undegraded":"2024-09-12T01:05:01.393694+0000","last_fullsized":"2024-09-12T01:05:01.393694+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:01.393507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:01.393507+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.393507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:52.795216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'306","reported_seq":901,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.207429+0000","last_change":"2024-09-12T01:05:13.207429+0000","last_active":"2024-09-12T01:05:13.207429+0000","last_peered":"2024-09-12T01:05:13.207429+0000","last_clean":"2024-09-12T01:05:13.207429+0000","last_became_active":"2024-09-12T00:18:28.884044+0000","last_became_peered":"2024-09-12T00:18:28.884044+0000","last_unstale":"2024-09-12T01:05:13.207429+0000","last_undegraded":"2024-09-12T01:05:13.207429+0000","last_fullsized":"2024-09-12T01:05:13.207429+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'306","last_scrub_stamp":"2024-09-12T01:05:13.207241+0000","last_deep_scrub":"268'306","last_deep_scrub_stamp":"2024-09-12T01:05:13.207241+0000","last_clean_scrub_stamp":"2024-09-12T01:05:13.207241+0000","objects_scrubbed":7,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:54.963951+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53187,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":519,"num_read_kb":1172,"num_write":464,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:12.209840+0000","last_change":"2024-09-12T01:05:12.209840+0000","last_active":"2024-09-12T01:05:12.209840+0000","last_peered":"2024-09-12T01:05:12.209840+0000","last_clean":"2024-09-12T01:05:12.209840+0000","last_became_active":"2024-09-12T00:18:30.902697+0000","last_became_peered":"2024-09-12T00:18:30.902697+0000","last_unstale":"2024-09-12T01:05:12.209840+0000","last_undegraded":"2024-09-12T01:05:12.209840+0000","last_fullsized":"2024-09-12T01:05:12.209840+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:12.209656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:12.209656+0000","last_clean_scrub_stamp":"2024-09-12T01:05:12.209656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:09.569231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'140","reported_seq":649,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.091385+0000","last_change":"2024-09-12T01:05:25.091385+0000","last_active":"2024-09-12T01:05:25.091385+0000","last_peered":"2024-09-12T01:05:25.091385+0000","last_clean":"2024-09-12T01:05:25.091385+0000","last_became_active":"2024-09-12T00:18:32.900235+0000","last_became_peered":"2024-09-12T00:18:32.900235+0000","last_unstale":"2024-09-12T01:05:25.091385+0000","last_undegraded":"2024-09-12T01:05:25.091385+0000","last_fullsized":"2024-09-12T01:05:25.091385+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'140","last_scrub_stamp":"2024-09-12T01:05:25.091155+0000","last_deep_scrub":"268'140","last_deep_scrub_stamp":"2024-09-12T01:05:25.091155+0000","last_clean_scrub_stamp":"2024-09-12T01:05:25.091155+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:36.766475+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":465,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":124,"num_read_kb":118,"num_write":347,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'437","reported_seq":2087,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.152400+0000","last_change":"2024-09-12T01:04:55.152400+0000","last_active":"2024-09-12T01:04:55.152400+0000","last_peered":"2024-09-12T01:04:55.152400+0000","last_clean":"2024-09-12T01:04:55.152400+0000","last_became_active":"2024-09-12T00:18:24.872637+0000","last_became_peered":"2024-09-12T00:18:24.872637+0000","last_unstale":"2024-09-12T01:04:55.152400+0000","last_undegraded":"2024-09-12T01:04:55.152400+0000","last_fullsized":"2024-09-12T01:04:55.152400+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'437","last_scrub_stamp":"2024-09-12T01:04:55.152221+0000","last_deep_scrub":"268'437","last_deep_scrub_stamp":"2024-09-12T01:04:55.152221+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.152221+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:56.856049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2400,"num_read_kb":2300,"num_write":500,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'358","reported_seq":1045,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.718500+0000","last_change":"2024-09-12T01:04:48.718500+0000","last_active":"2024-09-12T01:04:48.718500+0000","last_peered":"2024-09-12T01:04:48.718500+0000","last_clean":"2024-09-12T01:04:48.718500+0000","last_became_active":"2024-09-12T00:18:22.861450+0000","last_became_peered":"2024-09-12T00:18:22.861450+0000","last_unstale":"2024-09-12T01:04:48.718500+0000","last_undegraded":"2024-09-12T01:04:48.718500+0000","last_fullsized":"2024-09-12T01:04:48.718500+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'358","last_scrub_stamp":"2024-09-12T01:04:48.718246+0000","last_deep_scrub":"268'358","last_deep_scrub_stamp":"2024-09-12T01:04:48.718246+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.718246+0000","objects_scrubbed":9,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:43.073298+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":662355,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":585,"num_read_kb":32647,"num_write":1179,"num_write_kb":29925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.540215+0000","last_change":"2024-09-12T01:05:00.540215+0000","last_active":"2024-09-12T01:05:00.540215+0000","last_peered":"2024-09-12T01:05:00.540215+0000","last_clean":"2024-09-12T01:05:00.540215+0000","last_became_active":"2024-09-12T00:18:26.859109+0000","last_became_peered":"2024-09-12T00:18:26.859109+0000","last_unstale":"2024-09-12T01:05:00.540215+0000","last_undegraded":"2024-09-12T01:05:00.540215+0000","last_fullsized":"2024-09-12T01:05:00.540215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:00.540042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:00.540042+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.540042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:32.790029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'309","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.459268+0000","last_change":"2024-09-12T01:05:05.459268+0000","last_active":"2024-09-12T01:05:05.459268+0000","last_peered":"2024-09-12T01:05:05.459268+0000","last_clean":"2024-09-12T01:05:05.459268+0000","last_became_active":"2024-09-12T00:18:28.881947+0000","last_became_peered":"2024-09-12T00:18:28.881947+0000","last_unstale":"2024-09-12T01:05:05.459268+0000","last_undegraded":"2024-09-12T01:05:05.459268+0000","last_fullsized":"2024-09-12T01:05:05.459268+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'309","last_scrub_stamp":"2024-09-12T01:05:05.459045+0000","last_deep_scrub":"268'309","last_deep_scrub_stamp":"2024-09-12T01:05:05.459045+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.459045+0000","objects_scrubbed":7,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:15.066600+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45222,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":499,"num_read_kb":1119,"num_write":404,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'746","reported_seq":4324,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.484921+0000","last_change":"2024-09-12T01:05:04.484921+0000","last_active":"2024-09-12T01:05:04.484921+0000","last_peered":"2024-09-12T01:05:04.484921+0000","last_clean":"2024-09-12T01:05:04.484921+0000","last_became_active":"2024-09-12T00:18:30.872360+0000","last_became_peered":"2024-09-12T00:18:30.872360+0000","last_unstale":"2024-09-12T01:05:04.484921+0000","last_undegraded":"2024-09-12T01:05:04.484921+0000","last_fullsized":"2024-09-12T01:05:04.484921+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'746","last_scrub_stamp":"2024-09-12T01:05:04.484658+0000","last_deep_scrub":"268'746","last_deep_scrub_stamp":"2024-09-12T01:05:04.484658+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.484658+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":700,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:16.768023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'115","reported_seq":634,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:10.632589+0000","last_change":"2024-09-12T01:05:10.632589+0000","last_active":"2024-09-12T01:05:10.632589+0000","last_peered":"2024-09-12T01:05:10.632589+0000","last_clean":"2024-09-12T01:05:10.632589+0000","last_became_active":"2024-09-12T00:18:32.896338+0000","last_became_peered":"2024-09-12T00:18:32.896338+0000","last_unstale":"2024-09-12T01:05:10.632589+0000","last_undegraded":"2024-09-12T01:05:10.632589+0000","last_fullsized":"2024-09-12T01:05:10.632589+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'115","last_scrub_stamp":"2024-09-12T01:05:10.632400+0000","last_deep_scrub":"268'115","last_deep_scrub_stamp":"2024-09-12T01:05:10.632400+0000","last_clean_scrub_stamp":"2024-09-12T01:05:10.632400+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:08.929433+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":125,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'463","reported_seq":2021,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.172887+0000","last_change":"2024-09-12T01:04:56.172887+0000","last_active":"2024-09-12T01:04:56.172887+0000","last_peered":"2024-09-12T01:04:56.172887+0000","last_clean":"2024-09-12T01:04:56.172887+0000","last_became_active":"2024-09-12T00:18:24.879622+0000","last_became_peered":"2024-09-12T00:18:24.879622+0000","last_unstale":"2024-09-12T01:04:56.172887+0000","last_undegraded":"2024-09-12T01:04:56.172887+0000","last_fullsized":"2024-09-12T01:04:56.172887+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'463","last_scrub_stamp":"2024-09-12T01:04:56.172706+0000","last_deep_scrub":"268'463","last_deep_scrub_stamp":"2024-09-12T01:04:56.172706+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.172706+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:18.013381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2528,"num_read_kb":2373,"num_write":555,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'408","reported_seq":1113,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.190525+0000","last_change":"2024-09-12T01:04:47.190525+0000","last_active":"2024-09-12T01:04:47.190525+0000","last_peered":"2024-09-12T01:04:47.190525+0000","last_clean":"2024-09-12T01:04:47.190525+0000","last_became_active":"2024-09-12T00:18:22.847861+0000","last_became_peered":"2024-09-12T00:18:22.847861+0000","last_unstale":"2024-09-12T01:04:47.190525+0000","last_undegraded":"2024-09-12T01:04:47.190525+0000","last_fullsized":"2024-09-12T01:04:47.190525+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'408","last_scrub_stamp":"2024-09-12T01:04:47.190319+0000","last_deep_scrub":"268'408","last_deep_scrub_stamp":"2024-09-12T01:04:47.190319+0000","last_clean_scrub_stamp":"2024-09-12T01:04:47.190319+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:08.728064+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":711,"num_read_kb":61883,"num_write":1220,"num_write_kb":26157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"268'4","reported_seq":1464,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:08.520192+0000","last_change":"2024-09-12T01:05:08.520192+0000","last_active":"2024-09-12T01:05:08.520192+0000","last_peered":"2024-09-12T01:05:08.520192+0000","last_clean":"2024-09-12T01:05:08.520192+0000","last_became_active":"2024-09-12T00:18:26.871356+0000","last_became_peered":"2024-09-12T00:18:26.871356+0000","last_unstale":"2024-09-12T01:05:08.520192+0000","last_undegraded":"2024-09-12T01:05:08.520192+0000","last_fullsized":"2024-09-12T01:05:08.520192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:05:08.519909+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:05:08.519909+0000","last_clean_scrub_stamp":"2024-09-12T01:05:08.519909+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:24.897378+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'77","reported_seq":613,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:12.080212+0000","last_change":"2024-09-12T01:05:12.080212+0000","last_active":"2024-09-12T01:05:12.080212+0000","last_peered":"2024-09-12T01:05:12.080212+0000","last_clean":"2024-09-12T01:05:12.080212+0000","last_became_active":"2024-09-12T00:18:28.888423+0000","last_became_peered":"2024-09-12T00:18:28.888423+0000","last_unstale":"2024-09-12T01:05:12.080212+0000","last_undegraded":"2024-09-12T01:05:12.080212+0000","last_fullsized":"2024-09-12T01:05:12.080212+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'77","last_scrub_stamp":"2024-09-12T01:05:12.080009+0000","last_deep_scrub":"268'77","last_deep_scrub_stamp":"2024-09-12T01:05:12.080009+0000","last_clean_scrub_stamp":"2024-09-12T01:05:12.080009+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:59.149037+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":78,"num_read_kb":72,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'768","reported_seq":2123,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.754750+0000","last_change":"2024-09-12T01:05:05.754750+0000","last_active":"2024-09-12T01:05:05.754750+0000","last_peered":"2024-09-12T01:05:05.754750+0000","last_clean":"2024-09-12T01:05:05.754750+0000","last_became_active":"2024-09-12T00:18:30.898814+0000","last_became_peered":"2024-09-12T00:18:30.898814+0000","last_unstale":"2024-09-12T01:05:05.754750+0000","last_undegraded":"2024-09-12T01:05:05.754750+0000","last_fullsized":"2024-09-12T01:05:05.754750+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'768","last_scrub_stamp":"2024-09-12T01:05:05.754569+0000","last_deep_scrub":"268'768","last_deep_scrub_stamp":"2024-09-12T01:05:05.754569+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.754569+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:36.497490+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'94","reported_seq":602,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:18.159280+0000","last_change":"2024-09-12T01:05:18.159280+0000","last_active":"2024-09-12T01:05:18.159280+0000","last_peered":"2024-09-12T01:05:18.159280+0000","last_clean":"2024-09-12T01:05:18.159280+0000","last_became_active":"2024-09-12T00:18:32.907797+0000","last_became_peered":"2024-09-12T00:18:32.907797+0000","last_unstale":"2024-09-12T01:05:18.159280+0000","last_undegraded":"2024-09-12T01:05:18.159280+0000","last_fullsized":"2024-09-12T01:05:18.159280+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'94","last_scrub_stamp":"2024-09-12T01:05:18.159064+0000","last_deep_scrub":"268'94","last_deep_scrub_stamp":"2024-09-12T01:05:18.159064+0000","last_clean_scrub_stamp":"2024-09-12T01:05:18.159064+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:38.097320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":73,"num_write":219,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'510","reported_seq":2091,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.411066+0000","last_change":"2024-09-12T01:04:51.411066+0000","last_active":"2024-09-12T01:04:51.411066+0000","last_peered":"2024-09-12T01:04:51.411066+0000","last_clean":"2024-09-12T01:04:51.411066+0000","last_became_active":"2024-09-12T00:18:56.196419+0000","last_became_peered":"2024-09-12T00:18:56.196419+0000","last_unstale":"2024-09-12T01:04:51.411066+0000","last_undegraded":"2024-09-12T01:04:51.411066+0000","last_fullsized":"2024-09-12T01:04:51.411066+0000","mapping_epoch":37,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'510","last_scrub_stamp":"2024-09-12T01:04:51.410840+0000","last_deep_scrub":"268'510","last_deep_scrub_stamp":"2024-09-12T01:04:51.410840+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.410840+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:25.199103+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2644,"num_read_kb":2454,"num_write":619,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"268'409","reported_seq":1201,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.265266+0000","last_change":"2024-09-12T01:04:48.265266+0000","last_active":"2024-09-12T01:04:48.265266+0000","last_peered":"2024-09-12T01:04:48.265266+0000","last_clean":"2024-09-12T01:04:48.265266+0000","last_became_active":"2024-09-12T00:18:22.834072+0000","last_became_peered":"2024-09-12T00:18:22.834072+0000","last_unstale":"2024-09-12T01:04:48.265266+0000","last_undegraded":"2024-09-12T01:04:48.265266+0000","last_fullsized":"2024-09-12T01:04:48.265266+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'409","last_scrub_stamp":"2024-09-12T01:04:48.265165+0000","last_deep_scrub":"268'409","last_deep_scrub_stamp":"2024-09-12T01:04:48.265165+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.265165+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:03.330338+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":207192,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":853,"num_read_kb":11806,"num_write":1194,"num_write_kb":23298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.149297+0000","last_change":"2024-09-12T01:05:09.149297+0000","last_active":"2024-09-12T01:05:09.149297+0000","last_peered":"2024-09-12T01:05:09.149297+0000","last_clean":"2024-09-12T01:05:09.149297+0000","last_became_active":"2024-09-12T00:18:26.871183+0000","last_became_peered":"2024-09-12T00:18:26.871183+0000","last_unstale":"2024-09-12T01:05:09.149297+0000","last_undegraded":"2024-09-12T01:05:09.149297+0000","last_fullsized":"2024-09-12T01:05:09.149297+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:09.149047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:09.149047+0000","last_clean_scrub_stamp":"2024-09-12T01:05:09.149047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:18.048008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'379","reported_seq":995,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.572220+0000","last_change":"2024-09-12T01:05:14.572220+0000","last_active":"2024-09-12T01:05:14.572220+0000","last_peered":"2024-09-12T01:05:14.572220+0000","last_clean":"2024-09-12T01:05:14.572220+0000","last_became_active":"2024-09-12T00:18:28.889343+0000","last_became_peered":"2024-09-12T00:18:28.889343+0000","last_unstale":"2024-09-12T01:05:14.572220+0000","last_undegraded":"2024-09-12T01:05:14.572220+0000","last_fullsized":"2024-09-12T01:05:14.572220+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'379","last_scrub_stamp":"2024-09-12T01:05:14.572004+0000","last_deep_scrub":"268'379","last_deep_scrub_stamp":"2024-09-12T01:05:14.572004+0000","last_clean_scrub_stamp":"2024-09-12T01:05:14.572004+0000","objects_scrubbed":9,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:56.833847+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45461,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1181,"num_read_kb":1792,"num_write":1688,"num_write_kb":1549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":488742,"num_omap_keys":1130,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.754995+0000","last_change":"2024-09-12T01:05:04.754995+0000","last_active":"2024-09-12T01:05:04.754995+0000","last_peered":"2024-09-12T01:05:04.754995+0000","last_clean":"2024-09-12T01:05:04.754995+0000","last_became_active":"2024-09-12T00:18:30.905770+0000","last_became_peered":"2024-09-12T00:18:30.905770+0000","last_unstale":"2024-09-12T01:05:04.754995+0000","last_undegraded":"2024-09-12T01:05:04.754995+0000","last_fullsized":"2024-09-12T01:05:04.754995+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:04.754810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:04.754810+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.754810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:50.499923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'137","reported_seq":646,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.483268+0000","last_change":"2024-09-12T01:05:14.483268+0000","last_active":"2024-09-12T01:05:14.483268+0000","last_peered":"2024-09-12T01:05:14.483268+0000","last_clean":"2024-09-12T01:05:14.483268+0000","last_became_active":"2024-09-12T00:18:32.885619+0000","last_became_peered":"2024-09-12T00:18:32.885619+0000","last_unstale":"2024-09-12T01:05:14.483268+0000","last_undegraded":"2024-09-12T01:05:14.483268+0000","last_fullsized":"2024-09-12T01:05:14.483268+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'137","last_scrub_stamp":"2024-09-12T01:05:14.483031+0000","last_deep_scrub":"268'137","last_deep_scrub_stamp":"2024-09-12T01:05:14.483031+0000","last_clean_scrub_stamp":"2024-09-12T01:05:14.483031+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:52.743881+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":117,"num_write":301,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'771","reported_seq":2196,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.714075+0000","last_change":"2024-09-12T01:04:52.714075+0000","last_active":"2024-09-12T01:04:52.714075+0000","last_peered":"2024-09-12T01:04:52.714075+0000","last_clean":"2024-09-12T01:04:52.714075+0000","last_became_active":"2024-09-12T00:18:24.879462+0000","last_became_peered":"2024-09-12T00:18:24.879462+0000","last_unstale":"2024-09-12T01:04:52.714075+0000","last_undegraded":"2024-09-12T01:04:52.714075+0000","last_fullsized":"2024-09-12T01:04:52.714075+0000","mapping_epoch":26,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'771","last_scrub_stamp":"2024-09-12T01:04:52.713880+0000","last_deep_scrub":"268'771","last_deep_scrub_stamp":"2024-09-12T01:04:52.713880+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.713880+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:50.037991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3687,"num_read_kb":3308,"num_write":1074,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"268'74","reported_seq":625,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.387866+0000","last_change":"2024-09-12T01:04:48.387866+0000","last_active":"2024-09-12T01:04:48.387866+0000","last_peered":"2024-09-12T01:04:48.387866+0000","last_clean":"2024-09-12T01:04:48.387866+0000","last_became_active":"2024-09-12T00:18:03.924829+0000","last_became_peered":"2024-09-12T00:18:03.924829+0000","last_unstale":"2024-09-12T01:04:48.387866+0000","last_undegraded":"2024-09-12T01:04:48.387866+0000","last_fullsized":"2024-09-12T01:04:48.387866+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'74","last_scrub_stamp":"2024-09-12T01:04:48.387655+0000","last_deep_scrub":"268'74","last_deep_scrub_stamp":"2024-09-12T01:04:48.387655+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.387655+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:43.335462+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"268'2","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.534759+0000","last_change":"2024-09-12T01:04:47.534759+0000","last_active":"2024-09-12T01:04:47.534759+0000","last_peered":"2024-09-12T01:04:47.534759+0000","last_clean":"2024-09-12T01:04:47.534759+0000","last_became_active":"2024-09-12T00:18:08.644385+0000","last_became_peered":"2024-09-12T00:18:08.644385+0000","last_unstale":"2024-09-12T01:04:47.534759+0000","last_undegraded":"2024-09-12T01:04:47.534759+0000","last_fullsized":"2024-09-12T01:04:47.534759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:04:47.534572+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:04:47.534572+0000","last_clean_scrub_stamp":"2024-09-12T01:04:47.534572+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:43.103409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001156741,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'363","reported_seq":1020,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:46.290029+0000","last_change":"2024-09-12T01:04:46.290029+0000","last_active":"2024-09-12T01:04:46.290029+0000","last_peered":"2024-09-12T01:04:46.290029+0000","last_clean":"2024-09-12T01:04:46.290029+0000","last_became_active":"2024-09-12T00:18:22.867571+0000","last_became_peered":"2024-09-12T00:18:22.867571+0000","last_unstale":"2024-09-12T01:04:46.290029+0000","last_undegraded":"2024-09-12T01:04:46.290029+0000","last_fullsized":"2024-09-12T01:04:46.290029+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'363","last_scrub_stamp":"2024-09-12T01:04:46.289871+0000","last_deep_scrub":"268'363","last_deep_scrub_stamp":"2024-09-12T01:04:46.289871+0000","last_clean_scrub_stamp":"2024-09-12T01:04:46.289871+0000","objects_scrubbed":7,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:39.208915+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262231,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":470,"num_read_kb":26851,"num_write":1093,"num_write_kb":40025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.467331+0000","last_change":"2024-09-12T01:05:02.467331+0000","last_active":"2024-09-12T01:05:02.467331+0000","last_peered":"2024-09-12T01:05:02.467331+0000","last_clean":"2024-09-12T01:05:02.467331+0000","last_became_active":"2024-09-12T00:18:26.846668+0000","last_became_peered":"2024-09-12T00:18:26.846668+0000","last_unstale":"2024-09-12T01:05:02.467331+0000","last_undegraded":"2024-09-12T01:05:02.467331+0000","last_fullsized":"2024-09-12T01:05:02.467331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:02.467156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:02.467156+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.467156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:27.839432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'709","reported_seq":1429,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:12.579337+0000","last_change":"2024-09-12T01:05:12.579337+0000","last_active":"2024-09-12T01:05:12.579337+0000","last_peered":"2024-09-12T01:05:12.579337+0000","last_clean":"2024-09-12T01:05:12.579337+0000","last_became_active":"2024-09-12T00:18:28.885217+0000","last_became_peered":"2024-09-12T00:18:28.885217+0000","last_unstale":"2024-09-12T01:05:12.579337+0000","last_undegraded":"2024-09-12T01:05:12.579337+0000","last_fullsized":"2024-09-12T01:05:12.579337+0000","mapping_epoch":30,"log_start":"268'600","ondisk_log_start":"268'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'709","last_scrub_stamp":"2024-09-12T01:05:12.579141+0000","last_deep_scrub":"268'709","last_deep_scrub_stamp":"2024-09-12T01:05:12.579141+0000","last_clean_scrub_stamp":"2024-09-12T01:05:12.579141+0000","objects_scrubbed":7,"log_size":109,"log_dups_size":600,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:08.727940+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190373,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1378,"num_read_kb":3232,"num_write":1266,"num_write_kb":1158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89472,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:17.098442+0000","last_change":"2024-09-12T01:05:17.098442+0000","last_active":"2024-09-12T01:05:17.098442+0000","last_peered":"2024-09-12T01:05:17.098442+0000","last_clean":"2024-09-12T01:05:17.098442+0000","last_became_active":"2024-09-12T00:18:30.898689+0000","last_became_peered":"2024-09-12T00:18:30.898689+0000","last_unstale":"2024-09-12T01:05:17.098442+0000","last_undegraded":"2024-09-12T01:05:17.098442+0000","last_fullsized":"2024-09-12T01:05:17.098442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:17.098261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:17.098261+0000","last_clean_scrub_stamp":"2024-09-12T01:05:17.098261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:07.482389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'203","reported_seq":920,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:11.758630+0000","last_change":"2024-09-12T01:05:11.758630+0000","last_active":"2024-09-12T01:05:11.758630+0000","last_peered":"2024-09-12T01:05:11.758630+0000","last_clean":"2024-09-12T01:05:11.758630+0000","last_became_active":"2024-09-12T00:18:32.895239+0000","last_became_peered":"2024-09-12T00:18:32.895239+0000","last_unstale":"2024-09-12T01:05:11.758630+0000","last_undegraded":"2024-09-12T01:05:11.758630+0000","last_fullsized":"2024-09-12T01:05:11.758630+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'203","last_scrub_stamp":"2024-09-12T01:05:11.758417+0000","last_deep_scrub":"268'203","last_deep_scrub_stamp":"2024-09-12T01:05:11.758417+0000","last_clean_scrub_stamp":"2024-09-12T01:05:11.758417+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:16.614404+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1443,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":458,"num_write":434,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'489","reported_seq":2073,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.267998+0000","last_change":"2024-09-12T01:04:56.267998+0000","last_active":"2024-09-12T01:04:56.267998+0000","last_peered":"2024-09-12T01:04:56.267998+0000","last_clean":"2024-09-12T01:04:56.267998+0000","last_became_active":"2024-09-12T00:18:24.867067+0000","last_became_peered":"2024-09-12T00:18:24.867067+0000","last_unstale":"2024-09-12T01:04:56.267998+0000","last_undegraded":"2024-09-12T01:04:56.267998+0000","last_fullsized":"2024-09-12T01:04:56.267998+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'489","last_scrub_stamp":"2024-09-12T01:04:56.267771+0000","last_deep_scrub":"268'489","last_deep_scrub_stamp":"2024-09-12T01:04:56.267771+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.267771+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:04.695281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2524,"num_read_kb":2362,"num_write":607,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.421771+0000","last_change":"2024-09-12T01:04:50.421771+0000","last_active":"2024-09-12T01:04:50.421771+0000","last_peered":"2024-09-12T01:04:50.421771+0000","last_clean":"2024-09-12T01:04:50.421771+0000","last_became_active":"2024-09-12T00:18:08.646097+0000","last_became_peered":"2024-09-12T00:18:08.646097+0000","last_unstale":"2024-09-12T01:04:50.421771+0000","last_undegraded":"2024-09-12T01:04:50.421771+0000","last_fullsized":"2024-09-12T01:04:50.421771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:50.421588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:50.421588+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.421588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:10.736613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001003409,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'368","reported_seq":1039,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:46.266343+0000","last_change":"2024-09-12T01:04:46.266343+0000","last_active":"2024-09-12T01:04:46.266343+0000","last_peered":"2024-09-12T01:04:46.266343+0000","last_clean":"2024-09-12T01:04:46.266343+0000","last_became_active":"2024-09-12T00:18:22.857461+0000","last_became_peered":"2024-09-12T00:18:22.857461+0000","last_unstale":"2024-09-12T01:04:46.266343+0000","last_undegraded":"2024-09-12T01:04:46.266343+0000","last_fullsized":"2024-09-12T01:04:46.266343+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'368","last_scrub_stamp":"2024-09-12T01:04:46.266244+0000","last_deep_scrub":"268'368","last_deep_scrub_stamp":"2024-09-12T01:04:46.266244+0000","last_clean_scrub_stamp":"2024-09-12T01:04:46.266244+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:56.316874+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342049,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":576,"num_read_kb":72256,"num_write":1077,"num_write_kb":25510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:07.550454+0000","last_change":"2024-09-12T01:05:07.550454+0000","last_active":"2024-09-12T01:05:07.550454+0000","last_peered":"2024-09-12T01:05:07.550454+0000","last_clean":"2024-09-12T01:05:07.550454+0000","last_became_active":"2024-09-12T00:18:26.871674+0000","last_became_peered":"2024-09-12T00:18:26.871674+0000","last_unstale":"2024-09-12T01:05:07.550454+0000","last_undegraded":"2024-09-12T01:05:07.550454+0000","last_fullsized":"2024-09-12T01:05:07.550454+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:07.550275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:07.550275+0000","last_clean_scrub_stamp":"2024-09-12T01:05:07.550275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:29.322955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'1332","reported_seq":2850,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.595923+0000","last_change":"2024-09-12T01:05:05.595923+0000","last_active":"2024-09-12T01:05:05.595923+0000","last_peered":"2024-09-12T01:05:05.595923+0000","last_clean":"2024-09-12T01:05:05.595923+0000","last_became_active":"2024-09-12T00:18:28.889257+0000","last_became_peered":"2024-09-12T00:18:28.889257+0000","last_unstale":"2024-09-12T01:05:05.595923+0000","last_undegraded":"2024-09-12T01:05:05.595923+0000","last_fullsized":"2024-09-12T01:05:05.595923+0000","mapping_epoch":30,"log_start":"268'1301","ondisk_log_start":"268'1301","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1332","last_scrub_stamp":"2024-09-12T01:05:05.595699+0000","last_deep_scrub":"268'1332","last_deep_scrub_stamp":"2024-09-12T01:05:05.595699+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.595699+0000","objects_scrubbed":12,"log_size":31,"log_dups_size":1301,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:21.671487+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142532,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2119,"num_read_kb":4115,"num_write":1220,"num_write_kb":1054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:15.411292+0000","last_change":"2024-09-12T01:05:15.411292+0000","last_active":"2024-09-12T01:05:15.411292+0000","last_peered":"2024-09-12T01:05:15.411292+0000","last_clean":"2024-09-12T01:05:15.411292+0000","last_became_active":"2024-09-12T00:18:30.895305+0000","last_became_peered":"2024-09-12T00:18:30.895305+0000","last_unstale":"2024-09-12T01:05:15.411292+0000","last_undegraded":"2024-09-12T01:05:15.411292+0000","last_fullsized":"2024-09-12T01:05:15.411292+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:15.411111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:15.411111+0000","last_clean_scrub_stamp":"2024-09-12T01:05:15.411111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:06.456720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'206","reported_seq":741,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.525292+0000","last_change":"2024-09-12T01:05:13.525292+0000","last_active":"2024-09-12T01:05:13.525292+0000","last_peered":"2024-09-12T01:05:13.525292+0000","last_clean":"2024-09-12T01:05:13.525292+0000","last_became_active":"2024-09-12T00:18:32.887528+0000","last_became_peered":"2024-09-12T00:18:32.887528+0000","last_unstale":"2024-09-12T01:05:13.525292+0000","last_undegraded":"2024-09-12T01:05:13.525292+0000","last_fullsized":"2024-09-12T01:05:13.525292+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'206","last_scrub_stamp":"2024-09-12T01:05:13.525024+0000","last_deep_scrub":"268'206","last_deep_scrub_stamp":"2024-09-12T01:05:13.525024+0000","last_clean_scrub_stamp":"2024-09-12T01:05:13.525024+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:24.202578+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":310,"num_read_kb":309,"num_write":446,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'1283","reported_seq":3151,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.562364+0000","last_change":"2024-09-12T01:04:55.562364+0000","last_active":"2024-09-12T01:04:55.562364+0000","last_peered":"2024-09-12T01:04:55.562364+0000","last_clean":"2024-09-12T01:04:55.562364+0000","last_became_active":"2024-09-12T00:18:24.877964+0000","last_became_peered":"2024-09-12T00:18:24.877964+0000","last_unstale":"2024-09-12T01:04:55.562364+0000","last_undegraded":"2024-09-12T01:04:55.562364+0000","last_fullsized":"2024-09-12T01:04:55.562364+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1283","last_scrub_stamp":"2024-09-12T01:04:55.562178+0000","last_deep_scrub":"268'1283","last_deep_scrub_stamp":"2024-09-12T01:04:55.562178+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.562178+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":1200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:32.688184+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6082,"num_read_kb":5401,"num_write":1732,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4650,"num_omap_keys":19,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:45.470703+0000","last_change":"2024-09-12T01:04:45.470703+0000","last_active":"2024-09-12T01:04:45.470703+0000","last_peered":"2024-09-12T01:04:45.470703+0000","last_clean":"2024-09-12T01:04:45.470703+0000","last_became_active":"2024-09-12T00:18:08.874442+0000","last_became_peered":"2024-09-12T00:18:08.874442+0000","last_unstale":"2024-09-12T01:04:45.470703+0000","last_undegraded":"2024-09-12T01:04:45.470703+0000","last_fullsized":"2024-09-12T01:04:45.470703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:45.470576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:45.470576+0000","last_clean_scrub_stamp":"2024-09-12T01:04:45.470576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:41.288997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010707620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'375","reported_seq":1102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.584327+0000","last_change":"2024-09-12T01:04:47.584327+0000","last_active":"2024-09-12T01:04:47.584327+0000","last_peered":"2024-09-12T01:04:47.584327+0000","last_clean":"2024-09-12T01:04:47.584327+0000","last_became_active":"2024-09-12T00:18:22.834724+0000","last_became_peered":"2024-09-12T00:18:22.834724+0000","last_unstale":"2024-09-12T01:04:47.584327+0000","last_undegraded":"2024-09-12T01:04:47.584327+0000","last_fullsized":"2024-09-12T01:04:47.584327+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'375","last_scrub_stamp":"2024-09-12T01:04:47.584227+0000","last_deep_scrub":"268'375","last_deep_scrub_stamp":"2024-09-12T01:04:47.584227+0000","last_clean_scrub_stamp":"2024-09-12T01:04:47.584227+0000","objects_scrubbed":9,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:17.877057+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":674,"num_read_kb":9051,"num_write":1222,"num_write_kb":24587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"268'2","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.486013+0000","last_change":"2024-09-12T01:04:56.486013+0000","last_active":"2024-09-12T01:04:56.486013+0000","last_peered":"2024-09-12T01:04:56.486013+0000","last_clean":"2024-09-12T01:04:56.486013+0000","last_became_active":"2024-09-12T00:18:26.867343+0000","last_became_peered":"2024-09-12T00:18:26.867343+0000","last_unstale":"2024-09-12T01:04:56.486013+0000","last_undegraded":"2024-09-12T01:04:56.486013+0000","last_fullsized":"2024-09-12T01:04:56.486013+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:04:56.485822+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:04:56.485822+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.485822+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:33.613654+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'261","reported_seq":1373,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.541125+0000","last_change":"2024-09-12T01:05:09.541125+0000","last_active":"2024-09-12T01:05:09.541125+0000","last_peered":"2024-09-12T01:05:09.541125+0000","last_clean":"2024-09-12T01:05:09.541125+0000","last_became_active":"2024-09-12T00:18:28.889058+0000","last_became_peered":"2024-09-12T00:18:28.889058+0000","last_unstale":"2024-09-12T01:05:09.541125+0000","last_undegraded":"2024-09-12T01:05:09.541125+0000","last_fullsized":"2024-09-12T01:05:09.541125+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'261","last_scrub_stamp":"2024-09-12T01:05:09.540895+0000","last_deep_scrub":"268'261","last_deep_scrub_stamp":"2024-09-12T01:05:09.540895+0000","last_clean_scrub_stamp":"2024-09-12T01:05:09.540895+0000","objects_scrubbed":9,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:27.914177+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":190,"num_read_kb":179,"num_write":165,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.215476+0000","last_change":"2024-09-12T01:05:09.215476+0000","last_active":"2024-09-12T01:05:09.215476+0000","last_peered":"2024-09-12T01:05:09.215476+0000","last_clean":"2024-09-12T01:05:09.215476+0000","last_became_active":"2024-09-12T00:18:30.896073+0000","last_became_peered":"2024-09-12T00:18:30.896073+0000","last_unstale":"2024-09-12T01:05:09.215476+0000","last_undegraded":"2024-09-12T01:05:09.215476+0000","last_fullsized":"2024-09-12T01:05:09.215476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:09.215305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:09.215305+0000","last_clean_scrub_stamp":"2024-09-12T01:05:09.215305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:51.474097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'274","reported_seq":894,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:24.077480+0000","last_change":"2024-09-12T01:05:24.077480+0000","last_active":"2024-09-12T01:05:24.077480+0000","last_peered":"2024-09-12T01:05:24.077480+0000","last_clean":"2024-09-12T01:05:24.077480+0000","last_became_active":"2024-09-12T00:18:32.914004+0000","last_became_peered":"2024-09-12T00:18:32.914004+0000","last_unstale":"2024-09-12T01:05:24.077480+0000","last_undegraded":"2024-09-12T01:05:24.077480+0000","last_fullsized":"2024-09-12T01:05:24.077480+0000","mapping_epoch":34,"log_start":"268'200","ondisk_log_start":"268'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'274","last_scrub_stamp":"2024-09-12T01:05:24.077297+0000","last_deep_scrub":"268'274","last_deep_scrub_stamp":"2024-09-12T01:05:24.077297+0000","last_clean_scrub_stamp":"2024-09-12T01:05:24.077297+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:56.784653+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":517,"num_read_kb":535,"num_write":598,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'821","reported_seq":2386,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.584590+0000","last_change":"2024-09-12T01:04:54.584590+0000","last_active":"2024-09-12T01:04:54.584590+0000","last_peered":"2024-09-12T01:04:54.584590+0000","last_clean":"2024-09-12T01:04:54.584590+0000","last_became_active":"2024-09-12T00:18:24.869633+0000","last_became_peered":"2024-09-12T00:18:24.869633+0000","last_unstale":"2024-09-12T01:04:54.584590+0000","last_undegraded":"2024-09-12T01:04:54.584590+0000","last_fullsized":"2024-09-12T01:04:54.584590+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'821","last_scrub_stamp":"2024-09-12T01:04:54.584398+0000","last_deep_scrub":"268'821","last_deep_scrub_stamp":"2024-09-12T01:04:54.584398+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.584398+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:12.332775+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3879,"num_read_kb":3488,"num_write":1067,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"268'3","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.564570+0000","last_change":"2024-09-12T01:04:49.564570+0000","last_active":"2024-09-12T01:04:49.564570+0000","last_peered":"2024-09-12T01:04:49.564570+0000","last_clean":"2024-09-12T01:04:49.564570+0000","last_became_active":"2024-09-12T00:18:08.645156+0000","last_became_peered":"2024-09-12T00:18:08.645156+0000","last_unstale":"2024-09-12T01:04:49.564570+0000","last_undegraded":"2024-09-12T01:04:49.564570+0000","last_fullsized":"2024-09-12T01:04:49.564570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:04:49.564383+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:04:49.564383+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.564383+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:52.244469+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0024595709999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'395","reported_seq":1086,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.209032+0000","last_change":"2024-09-12T01:04:48.209032+0000","last_active":"2024-09-12T01:04:48.209032+0000","last_peered":"2024-09-12T01:04:48.209032+0000","last_clean":"2024-09-12T01:04:48.209032+0000","last_became_active":"2024-09-12T00:18:22.854940+0000","last_became_peered":"2024-09-12T00:18:22.854940+0000","last_unstale":"2024-09-12T01:04:48.209032+0000","last_undegraded":"2024-09-12T01:04:48.209032+0000","last_fullsized":"2024-09-12T01:04:48.209032+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'395","last_scrub_stamp":"2024-09-12T01:04:48.208822+0000","last_deep_scrub":"268'395","last_deep_scrub_stamp":"2024-09-12T01:04:48.208822+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.208822+0000","objects_scrubbed":8,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:04.445359+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7046756,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":598,"num_read_kb":32178,"num_write":1236,"num_write_kb":29732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.329680+0000","last_change":"2024-09-12T01:05:04.329680+0000","last_active":"2024-09-12T01:05:04.329680+0000","last_peered":"2024-09-12T01:05:04.329680+0000","last_clean":"2024-09-12T01:05:04.329680+0000","last_became_active":"2024-09-12T00:18:26.855239+0000","last_became_peered":"2024-09-12T00:18:26.855239+0000","last_unstale":"2024-09-12T01:05:04.329680+0000","last_undegraded":"2024-09-12T01:05:04.329680+0000","last_fullsized":"2024-09-12T01:05:04.329680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:04.329492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:04.329492+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.329492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:56.131898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'129","reported_seq":686,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.075044+0000","last_change":"2024-09-12T01:05:13.075044+0000","last_active":"2024-09-12T01:05:13.075044+0000","last_peered":"2024-09-12T01:05:13.075044+0000","last_clean":"2024-09-12T01:05:13.075044+0000","last_became_active":"2024-09-12T00:18:28.891173+0000","last_became_peered":"2024-09-12T00:18:28.891173+0000","last_unstale":"2024-09-12T01:05:13.075044+0000","last_undegraded":"2024-09-12T01:05:13.075044+0000","last_fullsized":"2024-09-12T01:05:13.075044+0000","mapping_epoch":30,"log_start":"268'100","ondisk_log_start":"268'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'129","last_scrub_stamp":"2024-09-12T01:05:13.074823+0000","last_deep_scrub":"268'129","last_deep_scrub_stamp":"2024-09-12T01:05:13.074823+0000","last_clean_scrub_stamp":"2024-09-12T01:05:13.074823+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:19.910471+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":142,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3226,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.708410+0000","last_change":"2024-09-12T01:05:03.708410+0000","last_active":"2024-09-12T01:05:03.708410+0000","last_peered":"2024-09-12T01:05:03.708410+0000","last_clean":"2024-09-12T01:05:03.708410+0000","last_became_active":"2024-09-12T00:18:30.904080+0000","last_became_peered":"2024-09-12T00:18:30.904080+0000","last_unstale":"2024-09-12T01:05:03.708410+0000","last_undegraded":"2024-09-12T01:05:03.708410+0000","last_fullsized":"2024-09-12T01:05:03.708410+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:03.708236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:03.708236+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.708236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:54.206218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'110","reported_seq":668,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.576677+0000","last_change":"2024-09-12T01:05:19.576677+0000","last_active":"2024-09-12T01:05:19.576677+0000","last_peered":"2024-09-12T01:05:19.576677+0000","last_clean":"2024-09-12T01:05:19.576677+0000","last_became_active":"2024-09-12T00:18:32.903109+0000","last_became_peered":"2024-09-12T00:18:32.903109+0000","last_unstale":"2024-09-12T01:05:19.576677+0000","last_undegraded":"2024-09-12T01:05:19.576677+0000","last_fullsized":"2024-09-12T01:05:19.576677+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'110","last_scrub_stamp":"2024-09-12T01:05:19.576486+0000","last_deep_scrub":"268'110","last_deep_scrub_stamp":"2024-09-12T01:05:19.576486+0000","last_clean_scrub_stamp":"2024-09-12T01:05:19.576486+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:01.415265+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":206,"num_read_kb":202,"num_write":268,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'474","reported_seq":1995,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.604762+0000","last_change":"2024-09-12T01:04:56.604762+0000","last_active":"2024-09-12T01:04:56.604762+0000","last_peered":"2024-09-12T01:04:56.604762+0000","last_clean":"2024-09-12T01:04:56.604762+0000","last_became_active":"2024-09-12T00:18:24.878031+0000","last_became_peered":"2024-09-12T00:18:24.878031+0000","last_unstale":"2024-09-12T01:04:56.604762+0000","last_undegraded":"2024-09-12T01:04:56.604762+0000","last_fullsized":"2024-09-12T01:04:56.604762+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'474","last_scrub_stamp":"2024-09-12T01:04:56.604574+0000","last_deep_scrub":"268'474","last_deep_scrub_stamp":"2024-09-12T01:04:56.604574+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.604574+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:32.788784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2325,"num_read_kb":2173,"num_write":541,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'312","reported_seq":934,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.530946+0000","last_change":"2024-09-12T01:04:50.530946+0000","last_active":"2024-09-12T01:04:50.530946+0000","last_peered":"2024-09-12T01:04:50.530946+0000","last_clean":"2024-09-12T01:04:50.530946+0000","last_became_active":"2024-09-12T00:18:22.861336+0000","last_became_peered":"2024-09-12T00:18:22.861336+0000","last_unstale":"2024-09-12T01:04:50.530946+0000","last_undegraded":"2024-09-12T01:04:50.530946+0000","last_fullsized":"2024-09-12T01:04:50.530946+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'312","last_scrub_stamp":"2024-09-12T01:04:50.530749+0000","last_deep_scrub":"268'312","last_deep_scrub_stamp":"2024-09-12T01:04:50.530749+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.530749+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:38.701302+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194334,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":409,"num_read_kb":16866,"num_write":952,"num_write_kb":39669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":539,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:46.542394+0000","last_change":"2024-09-12T01:04:46.542394+0000","last_active":"2024-09-12T01:04:46.542394+0000","last_peered":"2024-09-12T01:04:46.542394+0000","last_clean":"2024-09-12T01:04:46.542394+0000","last_became_active":"2024-09-12T00:18:08.956785+0000","last_became_peered":"2024-09-12T00:18:08.956785+0000","last_unstale":"2024-09-12T01:04:46.542394+0000","last_undegraded":"2024-09-12T01:04:46.542394+0000","last_fullsized":"2024-09-12T01:04:46.542394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:46.542326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:46.542326+0000","last_clean_scrub_stamp":"2024-09-12T01:04:46.542326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:00.080671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012417909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.367455+0000","last_change":"2024-09-12T01:05:03.367455+0000","last_active":"2024-09-12T01:05:03.367455+0000","last_peered":"2024-09-12T01:05:03.367455+0000","last_clean":"2024-09-12T01:05:03.367455+0000","last_became_active":"2024-09-12T00:18:26.879511+0000","last_became_peered":"2024-09-12T00:18:26.879511+0000","last_unstale":"2024-09-12T01:05:03.367455+0000","last_undegraded":"2024-09-12T01:05:03.367455+0000","last_fullsized":"2024-09-12T01:05:03.367455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:03.367276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:03.367276+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.367276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:35.236252+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'571","reported_seq":1258,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:07.272500+0000","last_change":"2024-09-12T01:05:07.272500+0000","last_active":"2024-09-12T01:05:07.272500+0000","last_peered":"2024-09-12T01:05:07.272500+0000","last_clean":"2024-09-12T01:05:07.272500+0000","last_became_active":"2024-09-12T00:18:28.879614+0000","last_became_peered":"2024-09-12T00:18:28.879614+0000","last_unstale":"2024-09-12T01:05:07.272500+0000","last_undegraded":"2024-09-12T01:05:07.272500+0000","last_fullsized":"2024-09-12T01:05:07.272500+0000","mapping_epoch":30,"log_start":"268'500","ondisk_log_start":"268'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'571","last_scrub_stamp":"2024-09-12T01:05:07.272279+0000","last_deep_scrub":"268'571","last_deep_scrub_stamp":"2024-09-12T01:05:07.272279+0000","last_clean_scrub_stamp":"2024-09-12T01:05:07.272279+0000","objects_scrubbed":11,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:01.844534+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100174,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":946,"num_read_kb":2084,"num_write":804,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10824,"num_omap_keys":26,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:16.195170+0000","last_change":"2024-09-12T01:05:16.195170+0000","last_active":"2024-09-12T01:05:16.195170+0000","last_peered":"2024-09-12T01:05:16.195170+0000","last_clean":"2024-09-12T01:05:16.195170+0000","last_became_active":"2024-09-12T00:18:30.903532+0000","last_became_peered":"2024-09-12T00:18:30.903532+0000","last_unstale":"2024-09-12T01:05:16.195170+0000","last_undegraded":"2024-09-12T01:05:16.195170+0000","last_fullsized":"2024-09-12T01:05:16.195170+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:16.194961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:16.194961+0000","last_clean_scrub_stamp":"2024-09-12T01:05:16.194961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:04.425970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'146","reported_seq":661,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.094131+0000","last_change":"2024-09-12T01:05:20.094131+0000","last_active":"2024-09-12T01:05:20.094131+0000","last_peered":"2024-09-12T01:05:20.094131+0000","last_clean":"2024-09-12T01:05:20.094131+0000","last_became_active":"2024-09-12T00:18:32.896532+0000","last_became_peered":"2024-09-12T00:18:32.896532+0000","last_unstale":"2024-09-12T01:05:20.094131+0000","last_undegraded":"2024-09-12T01:05:20.094131+0000","last_fullsized":"2024-09-12T01:05:20.094131+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'146","last_scrub_stamp":"2024-09-12T01:05:20.093935+0000","last_deep_scrub":"268'146","last_deep_scrub_stamp":"2024-09-12T01:05:20.093935+0000","last_clean_scrub_stamp":"2024-09-12T01:05:20.093935+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:50.320749+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":138,"num_write":339,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'365","reported_seq":1912,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.176764+0000","last_change":"2024-09-12T01:04:53.176764+0000","last_active":"2024-09-12T01:04:53.176764+0000","last_peered":"2024-09-12T01:04:53.176764+0000","last_clean":"2024-09-12T01:04:53.176764+0000","last_became_active":"2024-09-12T00:18:24.852620+0000","last_became_peered":"2024-09-12T00:18:24.852620+0000","last_unstale":"2024-09-12T01:04:53.176764+0000","last_undegraded":"2024-09-12T01:04:53.176764+0000","last_fullsized":"2024-09-12T01:04:53.176764+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'365","last_scrub_stamp":"2024-09-12T01:04:53.176561+0000","last_deep_scrub":"268'365","last_deep_scrub_stamp":"2024-09-12T01:04:53.176561+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.176561+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:08.338535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2109,"num_read_kb":2037,"num_write":400,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'349","reported_seq":1003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.521739+0000","last_change":"2024-09-12T01:04:49.521739+0000","last_active":"2024-09-12T01:04:49.521739+0000","last_peered":"2024-09-12T01:04:49.521739+0000","last_clean":"2024-09-12T01:04:49.521739+0000","last_became_active":"2024-09-12T00:18:22.839001+0000","last_became_peered":"2024-09-12T00:18:22.839001+0000","last_unstale":"2024-09-12T01:04:49.521739+0000","last_undegraded":"2024-09-12T01:04:49.521739+0000","last_fullsized":"2024-09-12T01:04:49.521739+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'349","last_scrub_stamp":"2024-09-12T01:04:49.521528+0000","last_deep_scrub":"268'349","last_deep_scrub_stamp":"2024-09-12T01:04:49.521528+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.521528+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:43.868981+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":481,"num_read_kb":59946,"num_write":977,"num_write_kb":34875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.373441+0000","last_change":"2024-09-12T01:04:49.373441+0000","last_active":"2024-09-12T01:04:49.373441+0000","last_peered":"2024-09-12T01:04:49.373441+0000","last_clean":"2024-09-12T01:04:49.373441+0000","last_became_active":"2024-09-12T00:18:08.958069+0000","last_became_peered":"2024-09-12T00:18:08.958069+0000","last_unstale":"2024-09-12T01:04:49.373441+0000","last_undegraded":"2024-09-12T01:04:49.373441+0000","last_fullsized":"2024-09-12T01:04:49.373441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:49.373275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:49.373275+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.373275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:16.974812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001047189,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.627037+0000","last_change":"2024-09-12T01:05:00.627037+0000","last_active":"2024-09-12T01:05:00.627037+0000","last_peered":"2024-09-12T01:05:00.627037+0000","last_clean":"2024-09-12T01:05:00.627037+0000","last_became_active":"2024-09-12T00:18:26.865743+0000","last_became_peered":"2024-09-12T00:18:26.865743+0000","last_unstale":"2024-09-12T01:05:00.627037+0000","last_undegraded":"2024-09-12T01:05:00.627037+0000","last_fullsized":"2024-09-12T01:05:00.627037+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:00.626750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:00.626750+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.626750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:33.255245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'172","reported_seq":757,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.595331+0000","last_change":"2024-09-12T01:05:04.595331+0000","last_active":"2024-09-12T01:05:04.595331+0000","last_peered":"2024-09-12T01:05:04.595331+0000","last_clean":"2024-09-12T01:05:04.595331+0000","last_became_active":"2024-09-12T00:18:28.877233+0000","last_became_peered":"2024-09-12T00:18:28.877233+0000","last_unstale":"2024-09-12T01:05:04.595331+0000","last_undegraded":"2024-09-12T01:05:04.595331+0000","last_fullsized":"2024-09-12T01:05:04.595331+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'172","last_scrub_stamp":"2024-09-12T01:05:04.595140+0000","last_deep_scrub":"268'172","last_deep_scrub_stamp":"2024-09-12T01:05:04.595140+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.595140+0000","objects_scrubbed":8,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:08.053394+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":206,"num_read_kb":196,"num_write":136,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'793","reported_seq":2616,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:16.566566+0000","last_change":"2024-09-12T01:05:16.566566+0000","last_active":"2024-09-12T01:05:16.566566+0000","last_peered":"2024-09-12T01:05:16.566566+0000","last_clean":"2024-09-12T01:05:16.566566+0000","last_became_active":"2024-09-12T00:18:30.873484+0000","last_became_peered":"2024-09-12T00:18:30.873484+0000","last_unstale":"2024-09-12T01:05:16.566566+0000","last_undegraded":"2024-09-12T01:05:16.566566+0000","last_fullsized":"2024-09-12T01:05:16.566566+0000","mapping_epoch":32,"log_start":"268'702","ondisk_log_start":"268'702","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'793","last_scrub_stamp":"2024-09-12T01:05:16.566382+0000","last_deep_scrub":"268'793","last_deep_scrub_stamp":"2024-09-12T01:05:16.566382+0000","last_clean_scrub_stamp":"2024-09-12T01:05:16.566382+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":702,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:02.420995+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'166","reported_seq":692,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:23.074944+0000","last_change":"2024-09-12T01:05:23.074944+0000","last_active":"2024-09-12T01:05:23.074944+0000","last_peered":"2024-09-12T01:05:23.074944+0000","last_clean":"2024-09-12T01:05:23.074944+0000","last_became_active":"2024-09-12T00:18:32.893315+0000","last_became_peered":"2024-09-12T00:18:32.893315+0000","last_unstale":"2024-09-12T01:05:23.074944+0000","last_undegraded":"2024-09-12T01:05:23.074944+0000","last_fullsized":"2024-09-12T01:05:23.074944+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'166","last_scrub_stamp":"2024-09-12T01:05:23.074744+0000","last_deep_scrub":"268'166","last_deep_scrub_stamp":"2024-09-12T01:05:23.074744+0000","last_clean_scrub_stamp":"2024-09-12T01:05:23.074744+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:54.155808+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":201,"num_read_kb":185,"num_write":395,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'453","reported_seq":2025,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.185147+0000","last_change":"2024-09-12T01:04:56.185147+0000","last_active":"2024-09-12T01:04:56.185147+0000","last_peered":"2024-09-12T01:04:56.185147+0000","last_clean":"2024-09-12T01:04:56.185147+0000","last_became_active":"2024-09-12T00:18:24.865603+0000","last_became_peered":"2024-09-12T00:18:24.865603+0000","last_unstale":"2024-09-12T01:04:56.185147+0000","last_undegraded":"2024-09-12T01:04:56.185147+0000","last_fullsized":"2024-09-12T01:04:56.185147+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'453","last_scrub_stamp":"2024-09-12T01:04:56.184924+0000","last_deep_scrub":"268'453","last_deep_scrub_stamp":"2024-09-12T01:04:56.184924+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.184924+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:02.597927+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2591,"num_read_kb":2430,"num_write":539,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'362","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.313725+0000","last_change":"2024-09-12T01:04:47.313725+0000","last_active":"2024-09-12T01:04:47.313725+0000","last_peered":"2024-09-12T01:04:47.313725+0000","last_clean":"2024-09-12T01:04:47.313725+0000","last_became_active":"2024-09-12T00:18:22.870180+0000","last_became_peered":"2024-09-12T00:18:22.870180+0000","last_unstale":"2024-09-12T01:04:47.313725+0000","last_undegraded":"2024-09-12T01:04:47.313725+0000","last_fullsized":"2024-09-12T01:04:47.313725+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'362","last_scrub_stamp":"2024-09-12T01:04:47.313542+0000","last_deep_scrub":"268'362","last_deep_scrub_stamp":"2024-09-12T01:04:47.313542+0000","last_clean_scrub_stamp":"2024-09-12T01:04:47.313542+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:20.898497+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":450,"num_read_kb":16363,"num_write":1061,"num_write_kb":31356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":538,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:45.528242+0000","last_change":"2024-09-12T01:04:45.528242+0000","last_active":"2024-09-12T01:04:45.528242+0000","last_peered":"2024-09-12T01:04:45.528242+0000","last_clean":"2024-09-12T01:04:45.528242+0000","last_became_active":"2024-09-12T00:18:08.638003+0000","last_became_peered":"2024-09-12T00:18:08.638003+0000","last_unstale":"2024-09-12T01:04:45.528242+0000","last_undegraded":"2024-09-12T01:04:45.528242+0000","last_fullsized":"2024-09-12T01:04:45.528242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:45.528131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:45.528131+0000","last_clean_scrub_stamp":"2024-09-12T01:04:45.528131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:02.250802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010953429999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:08.194135+0000","last_change":"2024-09-12T01:05:08.194135+0000","last_active":"2024-09-12T01:05:08.194135+0000","last_peered":"2024-09-12T01:05:08.194135+0000","last_clean":"2024-09-12T01:05:08.194135+0000","last_became_active":"2024-09-12T00:18:26.858300+0000","last_became_peered":"2024-09-12T00:18:26.858300+0000","last_unstale":"2024-09-12T01:05:08.194135+0000","last_undegraded":"2024-09-12T01:05:08.194135+0000","last_fullsized":"2024-09-12T01:05:08.194135+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:08.193956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:08.193956+0000","last_clean_scrub_stamp":"2024-09-12T01:05:08.193956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:19.373254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'115","reported_seq":672,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:12.182678+0000","last_change":"2024-09-12T01:05:12.182678+0000","last_active":"2024-09-12T01:05:12.182678+0000","last_peered":"2024-09-12T01:05:12.182678+0000","last_clean":"2024-09-12T01:05:12.182678+0000","last_became_active":"2024-09-12T00:18:28.880684+0000","last_became_peered":"2024-09-12T00:18:28.880684+0000","last_unstale":"2024-09-12T01:05:12.182678+0000","last_undegraded":"2024-09-12T01:05:12.182678+0000","last_fullsized":"2024-09-12T01:05:12.182678+0000","mapping_epoch":30,"log_start":"268'100","ondisk_log_start":"268'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'115","last_scrub_stamp":"2024-09-12T01:05:12.182490+0000","last_deep_scrub":"268'115","last_deep_scrub_stamp":"2024-09-12T01:05:12.182490+0000","last_clean_scrub_stamp":"2024-09-12T01:05:12.182490+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:17.746846+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'817","reported_seq":2650,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:18.115608+0000","last_change":"2024-09-12T01:05:18.115608+0000","last_active":"2024-09-12T01:05:18.115608+0000","last_peered":"2024-09-12T01:05:18.115608+0000","last_clean":"2024-09-12T01:05:18.115608+0000","last_became_active":"2024-09-12T00:18:30.902580+0000","last_became_peered":"2024-09-12T00:18:30.902580+0000","last_unstale":"2024-09-12T01:05:18.115608+0000","last_undegraded":"2024-09-12T01:05:18.115608+0000","last_fullsized":"2024-09-12T01:05:18.115608+0000","mapping_epoch":32,"log_start":"268'800","ondisk_log_start":"268'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'817","last_scrub_stamp":"2024-09-12T01:05:18.115426+0000","last_deep_scrub":"268'817","last_deep_scrub_stamp":"2024-09-12T01:05:18.115426+0000","last_clean_scrub_stamp":"2024-09-12T01:05:18.115426+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:40.730445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'176","reported_seq":684,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.130705+0000","last_change":"2024-09-12T01:05:19.130705+0000","last_active":"2024-09-12T01:05:19.130705+0000","last_peered":"2024-09-12T01:05:19.130705+0000","last_clean":"2024-09-12T01:05:19.130705+0000","last_became_active":"2024-09-12T00:18:32.902970+0000","last_became_peered":"2024-09-12T00:18:32.902970+0000","last_unstale":"2024-09-12T01:05:19.130705+0000","last_undegraded":"2024-09-12T01:05:19.130705+0000","last_fullsized":"2024-09-12T01:05:19.130705+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'176","last_scrub_stamp":"2024-09-12T01:05:19.130483+0000","last_deep_scrub":"268'176","last_deep_scrub_stamp":"2024-09-12T01:05:19.130483+0000","last_clean_scrub_stamp":"2024-09-12T01:05:19.130483+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:48.772293+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":388,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'597","reported_seq":2178,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.221206+0000","last_change":"2024-09-12T01:04:52.221206+0000","last_active":"2024-09-12T01:04:52.221206+0000","last_peered":"2024-09-12T01:04:52.221206+0000","last_clean":"2024-09-12T01:04:52.221206+0000","last_became_active":"2024-09-12T00:18:24.879205+0000","last_became_peered":"2024-09-12T00:18:24.879205+0000","last_unstale":"2024-09-12T01:04:52.221206+0000","last_undegraded":"2024-09-12T01:04:52.221206+0000","last_fullsized":"2024-09-12T01:04:52.221206+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'597","last_scrub_stamp":"2024-09-12T01:04:52.220980+0000","last_deep_scrub":"268'597","last_deep_scrub_stamp":"2024-09-12T01:04:52.220980+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.220980+0000","objects_scrubbed":9,"log_size":97,"log_dups_size":500,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:56.848160+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":3160,"num_read_kb":2876,"num_write":787,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2409,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'346","reported_seq":1075,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:45.268249+0000","last_change":"2024-09-12T01:04:45.268249+0000","last_active":"2024-09-12T01:04:45.268249+0000","last_peered":"2024-09-12T01:04:45.268249+0000","last_clean":"2024-09-12T01:04:45.268249+0000","last_became_active":"2024-09-12T00:18:22.850326+0000","last_became_peered":"2024-09-12T00:18:22.850326+0000","last_unstale":"2024-09-12T01:04:45.268249+0000","last_undegraded":"2024-09-12T01:04:45.268249+0000","last_fullsized":"2024-09-12T01:04:45.268249+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'346","last_scrub_stamp":"2024-09-12T01:04:45.268124+0000","last_deep_scrub":"268'346","last_deep_scrub_stamp":"2024-09-12T01:04:45.268124+0000","last_clean_scrub_stamp":"2024-09-12T01:04:45.268124+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:15.830198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":560,"num_read_kb":1535,"num_write":1060,"num_write_kb":23375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.744967+0000","last_change":"2024-09-12T01:04:47.744967+0000","last_active":"2024-09-12T01:04:47.744967+0000","last_peered":"2024-09-12T01:04:47.744967+0000","last_clean":"2024-09-12T01:04:47.744967+0000","last_became_active":"2024-09-12T00:18:08.648187+0000","last_became_peered":"2024-09-12T00:18:08.648187+0000","last_unstale":"2024-09-12T01:04:47.744967+0000","last_undegraded":"2024-09-12T01:04:47.744967+0000","last_fullsized":"2024-09-12T01:04:47.744967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:47.744772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:47.744772+0000","last_clean_scrub_stamp":"2024-09-12T01:04:47.744772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:48.648305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001130048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:08.026683+0000","last_change":"2024-09-12T01:05:08.026683+0000","last_active":"2024-09-12T01:05:08.026683+0000","last_peered":"2024-09-12T01:05:08.026683+0000","last_clean":"2024-09-12T01:05:08.026683+0000","last_became_active":"2024-09-12T00:18:26.851038+0000","last_became_peered":"2024-09-12T00:18:26.851038+0000","last_unstale":"2024-09-12T01:05:08.026683+0000","last_undegraded":"2024-09-12T01:05:08.026683+0000","last_fullsized":"2024-09-12T01:05:08.026683+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:08.026477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:08.026477+0000","last_clean_scrub_stamp":"2024-09-12T01:05:08.026477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:14.731757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'755","reported_seq":1489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:08.531549+0000","last_change":"2024-09-12T01:05:08.531549+0000","last_active":"2024-09-12T01:05:08.531549+0000","last_peered":"2024-09-12T01:05:08.531549+0000","last_clean":"2024-09-12T01:05:08.531549+0000","last_became_active":"2024-09-12T00:18:28.884726+0000","last_became_peered":"2024-09-12T00:18:28.884726+0000","last_unstale":"2024-09-12T01:05:08.531549+0000","last_undegraded":"2024-09-12T01:05:08.531549+0000","last_fullsized":"2024-09-12T01:05:08.531549+0000","mapping_epoch":30,"log_start":"268'700","ondisk_log_start":"268'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'755","last_scrub_stamp":"2024-09-12T01:05:08.531341+0000","last_deep_scrub":"268'755","last_deep_scrub_stamp":"2024-09-12T01:05:08.531341+0000","last_clean_scrub_stamp":"2024-09-12T01:05:08.531341+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:07.665283+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153841,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1337,"num_read_kb":3208,"num_write":1092,"num_write_kb":920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.075130+0000","last_change":"2024-09-12T01:05:19.075130+0000","last_active":"2024-09-12T01:05:19.075130+0000","last_peered":"2024-09-12T01:05:19.075130+0000","last_clean":"2024-09-12T01:05:19.075130+0000","last_became_active":"2024-09-12T00:18:30.900777+0000","last_became_peered":"2024-09-12T00:18:30.900777+0000","last_unstale":"2024-09-12T01:05:19.075130+0000","last_undegraded":"2024-09-12T01:05:19.075130+0000","last_fullsized":"2024-09-12T01:05:19.075130+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:19.074938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:19.074938+0000","last_clean_scrub_stamp":"2024-09-12T01:05:19.074938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:47.649281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'114","reported_seq":619,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.587583+0000","last_change":"2024-09-12T01:05:20.587583+0000","last_active":"2024-09-12T01:05:20.587583+0000","last_peered":"2024-09-12T01:05:20.587583+0000","last_clean":"2024-09-12T01:05:20.587583+0000","last_became_active":"2024-09-12T00:18:32.899881+0000","last_became_peered":"2024-09-12T00:18:32.899881+0000","last_unstale":"2024-09-12T01:05:20.587583+0000","last_undegraded":"2024-09-12T01:05:20.587583+0000","last_fullsized":"2024-09-12T01:05:20.587583+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'114","last_scrub_stamp":"2024-09-12T01:05:20.587401+0000","last_deep_scrub":"268'114","last_deep_scrub_stamp":"2024-09-12T01:05:20.587401+0000","last_clean_scrub_stamp":"2024-09-12T01:05:20.587401+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:26.494254+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":105,"num_write":264,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'148","reported_seq":719,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:22.070821+0000","last_change":"2024-09-12T01:05:22.070821+0000","last_active":"2024-09-12T01:05:22.070821+0000","last_peered":"2024-09-12T01:05:22.070821+0000","last_clean":"2024-09-12T01:05:22.070821+0000","last_became_active":"2024-09-12T00:18:32.902596+0000","last_became_peered":"2024-09-12T00:18:32.902596+0000","last_unstale":"2024-09-12T01:05:22.070821+0000","last_undegraded":"2024-09-12T01:05:22.070821+0000","last_fullsized":"2024-09-12T01:05:22.070821+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'148","last_scrub_stamp":"2024-09-12T01:05:22.070634+0000","last_deep_scrub":"268'148","last_deep_scrub_stamp":"2024-09-12T01:05:22.070634+0000","last_clean_scrub_stamp":"2024-09-12T01:05:22.070634+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:47.287403+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":238,"num_read_kb":229,"num_write":342,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'487","reported_seq":2119,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.218217+0000","last_change":"2024-09-12T01:04:57.217970+0000","last_active":"2024-09-12T01:04:57.218217+0000","last_peered":"2024-09-12T01:04:57.218217+0000","last_clean":"2024-09-12T01:04:57.218217+0000","last_became_active":"2024-09-12T00:18:24.879640+0000","last_became_peered":"2024-09-12T00:18:24.879640+0000","last_unstale":"2024-09-12T01:04:57.218217+0000","last_undegraded":"2024-09-12T01:04:57.218217+0000","last_fullsized":"2024-09-12T01:04:57.218217+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'487","last_scrub_stamp":"2024-09-12T01:04:57.217724+0000","last_deep_scrub":"268'487","last_deep_scrub_stamp":"2024-09-12T01:04:57.217724+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.217724+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:38.656659+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2579,"num_read_kb":2446,"num_write":588,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'391","reported_seq":1051,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.218806+0000","last_change":"2024-09-12T01:04:49.218588+0000","last_active":"2024-09-12T01:04:49.218806+0000","last_peered":"2024-09-12T01:04:49.218806+0000","last_clean":"2024-09-12T01:04:49.218806+0000","last_became_active":"2024-09-12T00:18:22.874059+0000","last_became_peered":"2024-09-12T00:18:22.874059+0000","last_unstale":"2024-09-12T01:04:49.218806+0000","last_undegraded":"2024-09-12T01:04:49.218806+0000","last_fullsized":"2024-09-12T01:04:49.218806+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'391","last_scrub_stamp":"2024-09-12T01:04:49.218318+0000","last_deep_scrub":"268'391","last_deep_scrub_stamp":"2024-09-12T01:04:49.218318+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.218318+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:02.132035+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":563,"num_read_kb":19542,"num_write":1220,"num_write_kb":37354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.571812+0000","last_change":"2024-09-12T01:05:01.571742+0000","last_active":"2024-09-12T01:05:01.571812+0000","last_peered":"2024-09-12T01:05:01.571812+0000","last_clean":"2024-09-12T01:05:01.571812+0000","last_became_active":"2024-09-12T00:18:26.866940+0000","last_became_peered":"2024-09-12T00:18:26.866940+0000","last_unstale":"2024-09-12T01:05:01.571812+0000","last_undegraded":"2024-09-12T01:05:01.571812+0000","last_fullsized":"2024-09-12T01:05:01.571812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:01.571641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:01.571641+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.571641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:47.206432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'300","reported_seq":897,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:15.045576+0000","last_change":"2024-09-12T01:05:15.045576+0000","last_active":"2024-09-12T01:05:15.045576+0000","last_peered":"2024-09-12T01:05:15.045576+0000","last_clean":"2024-09-12T01:05:15.045576+0000","last_became_active":"2024-09-12T00:18:28.877560+0000","last_became_peered":"2024-09-12T00:18:28.877560+0000","last_unstale":"2024-09-12T01:05:15.045576+0000","last_undegraded":"2024-09-12T01:05:15.045576+0000","last_fullsized":"2024-09-12T01:05:15.045576+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'300","last_scrub_stamp":"2024-09-12T01:05:15.045366+0000","last_deep_scrub":"268'300","last_deep_scrub_stamp":"2024-09-12T01:05:15.045366+0000","last_clean_scrub_stamp":"2024-09-12T01:05:15.045366+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:01.170647+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44815,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":481,"num_read_kb":1100,"num_write":392,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.067841+0000","last_change":"2024-09-12T01:05:20.067841+0000","last_active":"2024-09-12T01:05:20.067841+0000","last_peered":"2024-09-12T01:05:20.067841+0000","last_clean":"2024-09-12T01:05:20.067841+0000","last_became_active":"2024-09-12T00:18:30.901022+0000","last_became_peered":"2024-09-12T00:18:30.901022+0000","last_unstale":"2024-09-12T01:05:20.067841+0000","last_undegraded":"2024-09-12T01:05:20.067841+0000","last_fullsized":"2024-09-12T01:05:20.067841+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:20.067661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:20.067661+0000","last_clean_scrub_stamp":"2024-09-12T01:05:20.067661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:49.558004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'140","reported_seq":654,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.209313+0000","last_change":"2024-09-12T00:18:32.901918+0000","last_active":"2024-09-12T01:03:01.209313+0000","last_peered":"2024-09-12T01:03:01.209313+0000","last_clean":"2024-09-12T01:03:01.209313+0000","last_became_active":"2024-09-12T00:18:32.900434+0000","last_became_peered":"2024-09-12T00:18:32.900434+0000","last_unstale":"2024-09-12T01:03:01.209313+0000","last_undegraded":"2024-09-12T01:03:01.209313+0000","last_fullsized":"2024-09-12T01:03:01.209313+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:49.600913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":83,"num_write":305,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'546","reported_seq":1971,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.579599+0000","last_change":"2024-09-12T01:04:58.579473+0000","last_active":"2024-09-12T01:04:58.579599+0000","last_peered":"2024-09-12T01:04:58.579599+0000","last_clean":"2024-09-12T01:04:58.579599+0000","last_became_active":"2024-09-12T00:18:24.878531+0000","last_became_peered":"2024-09-12T00:18:24.878531+0000","last_unstale":"2024-09-12T01:04:58.579599+0000","last_undegraded":"2024-09-12T01:04:58.579599+0000","last_fullsized":"2024-09-12T01:04:58.579599+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'546","last_scrub_stamp":"2024-09-12T01:04:58.579295+0000","last_deep_scrub":"268'546","last_deep_scrub_stamp":"2024-09-12T01:04:58.579295+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.579295+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:45.810541+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2546,"num_read_kb":2313,"num_write":710,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'415","reported_seq":1145,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.472885+0000","last_change":"2024-09-12T01:04:56.472885+0000","last_active":"2024-09-12T01:04:56.472885+0000","last_peered":"2024-09-12T01:04:56.472885+0000","last_clean":"2024-09-12T01:04:56.472885+0000","last_became_active":"2024-09-12T00:18:56.193958+0000","last_became_peered":"2024-09-12T00:18:56.193958+0000","last_unstale":"2024-09-12T01:04:56.472885+0000","last_undegraded":"2024-09-12T01:04:56.472885+0000","last_fullsized":"2024-09-12T01:04:56.472885+0000","mapping_epoch":37,"log_start":"268'400","ondisk_log_start":"268'400","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'415","last_scrub_stamp":"2024-09-12T01:04:56.472681+0000","last_deep_scrub":"268'415","last_deep_scrub_stamp":"2024-09-12T01:04:56.472681+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.472681+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:48.615635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":783,"num_read_kb":16311,"num_write":1252,"num_write_kb":28883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.040560+0000","last_change":"2024-09-12T01:05:04.040415+0000","last_active":"2024-09-12T01:05:04.040560+0000","last_peered":"2024-09-12T01:05:04.040560+0000","last_clean":"2024-09-12T01:05:04.040560+0000","last_became_active":"2024-09-12T00:18:26.852430+0000","last_became_peered":"2024-09-12T00:18:26.852430+0000","last_unstale":"2024-09-12T01:05:04.040560+0000","last_undegraded":"2024-09-12T01:05:04.040560+0000","last_fullsized":"2024-09-12T01:05:04.040560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:04.040228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:04.040228+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.040228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:38.093851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'50","reported_seq":564,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:10.219343+0000","last_change":"2024-09-12T01:05:10.219162+0000","last_active":"2024-09-12T01:05:10.219343+0000","last_peered":"2024-09-12T01:05:10.219343+0000","last_clean":"2024-09-12T01:05:10.219343+0000","last_became_active":"2024-09-12T00:18:28.888625+0000","last_became_peered":"2024-09-12T00:18:28.888625+0000","last_unstale":"2024-09-12T01:05:10.219343+0000","last_undegraded":"2024-09-12T01:05:10.219343+0000","last_fullsized":"2024-09-12T01:05:10.219343+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'50","last_scrub_stamp":"2024-09-12T01:05:10.218980+0000","last_deep_scrub":"268'50","last_deep_scrub_stamp":"2024-09-12T01:05:10.218980+0000","last_clean_scrub_stamp":"2024-09-12T01:05:10.218980+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:06.439044+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.417865+0000","last_change":"2024-09-12T01:05:14.417865+0000","last_active":"2024-09-12T01:05:14.417865+0000","last_peered":"2024-09-12T01:05:14.417865+0000","last_clean":"2024-09-12T01:05:14.417865+0000","last_became_active":"2024-09-12T00:18:30.894388+0000","last_became_peered":"2024-09-12T00:18:30.894388+0000","last_unstale":"2024-09-12T01:05:14.417865+0000","last_undegraded":"2024-09-12T01:05:14.417865+0000","last_fullsized":"2024-09-12T01:05:14.417865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:14.417664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:14.417664+0000","last_clean_scrub_stamp":"2024-09-12T01:05:14.417664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:10.320787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'211","reported_seq":737,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:23.057200+0000","last_change":"2024-09-12T01:05:23.057200+0000","last_active":"2024-09-12T01:05:23.057200+0000","last_peered":"2024-09-12T01:05:23.057200+0000","last_clean":"2024-09-12T01:05:23.057200+0000","last_became_active":"2024-09-12T00:18:32.903719+0000","last_became_peered":"2024-09-12T00:18:32.903719+0000","last_unstale":"2024-09-12T01:05:23.057200+0000","last_undegraded":"2024-09-12T01:05:23.057200+0000","last_fullsized":"2024-09-12T01:05:23.057200+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'211","last_scrub_stamp":"2024-09-12T01:05:23.056965+0000","last_deep_scrub":"268'211","last_deep_scrub_stamp":"2024-09-12T01:05:23.056965+0000","last_clean_scrub_stamp":"2024-09-12T01:05:23.056965+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":100,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:28.934047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":286,"num_read_kb":283,"num_write":470,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'853","reported_seq":2460,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.164106+0000","last_change":"2024-09-12T01:04:57.163980+0000","last_active":"2024-09-12T01:04:57.164106+0000","last_peered":"2024-09-12T01:04:57.164106+0000","last_clean":"2024-09-12T01:04:57.164106+0000","last_became_active":"2024-09-12T00:18:24.865480+0000","last_became_peered":"2024-09-12T00:18:24.865480+0000","last_unstale":"2024-09-12T01:04:57.164106+0000","last_undegraded":"2024-09-12T01:04:57.164106+0000","last_fullsized":"2024-09-12T01:04:57.164106+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'853","last_scrub_stamp":"2024-09-12T01:04:57.163800+0000","last_deep_scrub":"268'853","last_deep_scrub_stamp":"2024-09-12T01:04:57.163800+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.163800+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":800,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:48.870486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4053,"num_read_kb":3643,"num_write":1115,"num_write_kb":411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3056,"num_omap_keys":12,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'394","reported_seq":1053,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.476888+0000","last_change":"2024-09-12T01:04:48.476828+0000","last_active":"2024-09-12T01:04:48.476888+0000","last_peered":"2024-09-12T01:04:48.476888+0000","last_clean":"2024-09-12T01:04:48.476888+0000","last_became_active":"2024-09-12T00:18:55.955303+0000","last_became_peered":"2024-09-12T00:18:55.955303+0000","last_unstale":"2024-09-12T01:04:48.476888+0000","last_undegraded":"2024-09-12T01:04:48.476888+0000","last_fullsized":"2024-09-12T01:04:48.476888+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'394","last_scrub_stamp":"2024-09-12T01:04:48.476684+0000","last_deep_scrub":"268'394","last_deep_scrub_stamp":"2024-09-12T01:04:48.476684+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.476684+0000","objects_scrubbed":13,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:27.009748+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1605311,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":590,"num_read_kb":40569,"num_write":1352,"num_write_kb":40151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:06.498381+0000","last_change":"2024-09-12T01:05:06.498244+0000","last_active":"2024-09-12T01:05:06.498381+0000","last_peered":"2024-09-12T01:05:06.498381+0000","last_clean":"2024-09-12T01:05:06.498381+0000","last_became_active":"2024-09-12T00:18:26.859801+0000","last_became_peered":"2024-09-12T00:18:26.859801+0000","last_unstale":"2024-09-12T01:05:06.498381+0000","last_undegraded":"2024-09-12T01:05:06.498381+0000","last_fullsized":"2024-09-12T01:05:06.498381+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:06.498058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:06.498058+0000","last_clean_scrub_stamp":"2024-09-12T01:05:06.498058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:23.328223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'321","reported_seq":928,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.052652+0000","last_change":"2024-09-12T01:05:14.052652+0000","last_active":"2024-09-12T01:05:14.052652+0000","last_peered":"2024-09-12T01:05:14.052652+0000","last_clean":"2024-09-12T01:05:14.052652+0000","last_became_active":"2024-09-12T00:18:28.877317+0000","last_became_peered":"2024-09-12T00:18:28.877317+0000","last_unstale":"2024-09-12T01:05:14.052652+0000","last_undegraded":"2024-09-12T01:05:14.052652+0000","last_fullsized":"2024-09-12T01:05:14.052652+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'321","last_scrub_stamp":"2024-09-12T01:05:14.052413+0000","last_deep_scrub":"268'321","last_deep_scrub_stamp":"2024-09-12T01:05:14.052413+0000","last_clean_scrub_stamp":"2024-09-12T01:05:14.052413+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:18.845969+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53640,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":520,"num_read_kb":1147,"num_write":418,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:06.754939+0000","last_change":"2024-09-12T01:05:06.754772+0000","last_active":"2024-09-12T01:05:06.754939+0000","last_peered":"2024-09-12T01:05:06.754939+0000","last_clean":"2024-09-12T01:05:06.754939+0000","last_became_active":"2024-09-12T00:18:30.904052+0000","last_became_peered":"2024-09-12T00:18:30.904052+0000","last_unstale":"2024-09-12T01:05:06.754939+0000","last_undegraded":"2024-09-12T01:05:06.754939+0000","last_fullsized":"2024-09-12T01:05:06.754939+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:06.754587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:06.754587+0000","last_clean_scrub_stamp":"2024-09-12T01:05:06.754587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:30.338221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'140","reported_seq":667,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:23.564204+0000","last_change":"2024-09-12T01:05:23.564204+0000","last_active":"2024-09-12T01:05:23.564204+0000","last_peered":"2024-09-12T01:05:23.564204+0000","last_clean":"2024-09-12T01:05:23.564204+0000","last_became_active":"2024-09-12T00:18:32.899607+0000","last_became_peered":"2024-09-12T00:18:32.899607+0000","last_unstale":"2024-09-12T01:05:23.564204+0000","last_undegraded":"2024-09-12T01:05:23.564204+0000","last_fullsized":"2024-09-12T01:05:23.564204+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'140","last_scrub_stamp":"2024-09-12T01:05:23.564023+0000","last_deep_scrub":"268'140","last_deep_scrub_stamp":"2024-09-12T01:05:23.564023+0000","last_clean_scrub_stamp":"2024-09-12T01:05:23.564023+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:21.633929+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":193,"num_read_kb":183,"num_write":356,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'352","reported_seq":1902,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.079954+0000","last_change":"2024-09-12T01:05:01.079819+0000","last_active":"2024-09-12T01:05:01.079954+0000","last_peered":"2024-09-12T01:05:01.079954+0000","last_clean":"2024-09-12T01:05:01.079954+0000","last_became_active":"2024-09-12T00:18:24.863389+0000","last_became_peered":"2024-09-12T00:18:24.863389+0000","last_unstale":"2024-09-12T01:05:01.079954+0000","last_undegraded":"2024-09-12T01:05:01.079954+0000","last_fullsized":"2024-09-12T01:05:01.079954+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'352","last_scrub_stamp":"2024-09-12T01:05:01.079632+0000","last_deep_scrub":"268'352","last_deep_scrub_stamp":"2024-09-12T01:05:01.079632+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.079632+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:11.611171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2172,"num_read_kb":2099,"num_write":388,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1654,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'349","reported_seq":991,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.216827+0000","last_change":"2024-09-12T01:04:47.216827+0000","last_active":"2024-09-12T01:04:47.216827+0000","last_peered":"2024-09-12T01:04:47.216827+0000","last_clean":"2024-09-12T01:04:47.216827+0000","last_became_active":"2024-09-12T00:18:22.863535+0000","last_became_peered":"2024-09-12T00:18:22.863535+0000","last_unstale":"2024-09-12T01:04:47.216827+0000","last_undegraded":"2024-09-12T01:04:47.216827+0000","last_fullsized":"2024-09-12T01:04:47.216827+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'349","last_scrub_stamp":"2024-09-12T01:04:47.216745+0000","last_deep_scrub":"268'349","last_deep_scrub_stamp":"2024-09-12T01:04:47.216745+0000","last_clean_scrub_stamp":"2024-09-12T01:04:47.216745+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:20.488567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":493,"num_read_kb":3769,"num_write":1077,"num_write_kb":28344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.665332+0000","last_change":"2024-09-12T01:04:59.665200+0000","last_active":"2024-09-12T01:04:59.665332+0000","last_peered":"2024-09-12T01:04:59.665332+0000","last_clean":"2024-09-12T01:04:59.665332+0000","last_became_active":"2024-09-12T00:18:26.874839+0000","last_became_peered":"2024-09-12T00:18:26.874839+0000","last_unstale":"2024-09-12T01:04:59.665332+0000","last_undegraded":"2024-09-12T01:04:59.665332+0000","last_fullsized":"2024-09-12T01:04:59.665332+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:59.664986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:59.664986+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.664986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:33.767626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'275","reported_seq":853,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:11.466667+0000","last_change":"2024-09-12T01:05:11.466530+0000","last_active":"2024-09-12T01:05:11.466667+0000","last_peered":"2024-09-12T01:05:11.466667+0000","last_clean":"2024-09-12T01:05:11.466667+0000","last_became_active":"2024-09-12T00:18:28.888325+0000","last_became_peered":"2024-09-12T00:18:28.888325+0000","last_unstale":"2024-09-12T01:05:11.466667+0000","last_undegraded":"2024-09-12T01:05:11.466667+0000","last_fullsized":"2024-09-12T01:05:11.466667+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'275","last_scrub_stamp":"2024-09-12T01:05:11.466332+0000","last_deep_scrub":"268'275","last_deep_scrub_stamp":"2024-09-12T01:05:11.466332+0000","last_clean_scrub_stamp":"2024-09-12T01:05:11.466332+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:30.117767+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52815,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":453,"num_read_kb":1069,"num_write":372,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.209381+0000","last_change":"2024-09-12T01:05:13.209381+0000","last_active":"2024-09-12T01:05:13.209381+0000","last_peered":"2024-09-12T01:05:13.209381+0000","last_clean":"2024-09-12T01:05:13.209381+0000","last_became_active":"2024-09-12T00:18:30.899237+0000","last_became_peered":"2024-09-12T00:18:30.899237+0000","last_unstale":"2024-09-12T01:05:13.209381+0000","last_undegraded":"2024-09-12T01:05:13.209381+0000","last_fullsized":"2024-09-12T01:05:13.209381+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:13.209258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:13.209258+0000","last_clean_scrub_stamp":"2024-09-12T01:05:13.209258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:48.679519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'936","reported_seq":2379,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.750198+0000","last_change":"2024-09-12T01:04:57.750198+0000","last_active":"2024-09-12T01:04:57.750198+0000","last_peered":"2024-09-12T01:04:57.750198+0000","last_clean":"2024-09-12T01:04:57.750198+0000","last_became_active":"2024-09-12T00:18:24.859351+0000","last_became_peered":"2024-09-12T00:18:24.859351+0000","last_unstale":"2024-09-12T01:04:57.750198+0000","last_undegraded":"2024-09-12T01:04:57.750198+0000","last_fullsized":"2024-09-12T01:04:57.750198+0000","mapping_epoch":26,"log_start":"268'900","ondisk_log_start":"268'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'936","last_scrub_stamp":"2024-09-12T01:04:57.749993+0000","last_deep_scrub":"268'936","last_deep_scrub_stamp":"2024-09-12T01:04:57.749993+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.749993+0000","objects_scrubbed":6,"log_size":36,"log_dups_size":900,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:52.509130+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4324,"num_read_kb":3896,"num_write":1355,"num_write_kb":567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'315","reported_seq":1023,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.272346+0000","last_change":"2024-09-12T01:04:51.272346+0000","last_active":"2024-09-12T01:04:51.272346+0000","last_peered":"2024-09-12T01:04:51.272346+0000","last_clean":"2024-09-12T01:04:51.272346+0000","last_became_active":"2024-09-12T00:18:22.840244+0000","last_became_peered":"2024-09-12T00:18:22.840244+0000","last_unstale":"2024-09-12T01:04:51.272346+0000","last_undegraded":"2024-09-12T01:04:51.272346+0000","last_fullsized":"2024-09-12T01:04:51.272346+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'315","last_scrub_stamp":"2024-09-12T01:04:51.272055+0000","last_deep_scrub":"268'315","last_deep_scrub_stamp":"2024-09-12T01:04:51.272055+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.272055+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:05.495095+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":618,"num_read_kb":30347,"num_write":961,"num_write_kb":34968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.298177+0000","last_change":"2024-09-12T01:05:05.298177+0000","last_active":"2024-09-12T01:05:05.298177+0000","last_peered":"2024-09-12T01:05:05.298177+0000","last_clean":"2024-09-12T01:05:05.298177+0000","last_became_active":"2024-09-12T00:18:26.855432+0000","last_became_peered":"2024-09-12T00:18:26.855432+0000","last_unstale":"2024-09-12T01:05:05.298177+0000","last_undegraded":"2024-09-12T01:05:05.298177+0000","last_fullsized":"2024-09-12T01:05:05.298177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:05.297897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:05.297897+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.297897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:58.875114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'474","reported_seq":1125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:08.566134+0000","last_change":"2024-09-12T01:05:08.566134+0000","last_active":"2024-09-12T01:05:08.566134+0000","last_peered":"2024-09-12T01:05:08.566134+0000","last_clean":"2024-09-12T01:05:08.566134+0000","last_became_active":"2024-09-12T00:18:28.887245+0000","last_became_peered":"2024-09-12T00:18:28.887245+0000","last_unstale":"2024-09-12T01:05:08.566134+0000","last_undegraded":"2024-09-12T01:05:08.566134+0000","last_fullsized":"2024-09-12T01:05:08.566134+0000","mapping_epoch":30,"log_start":"268'400","ondisk_log_start":"268'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'474","last_scrub_stamp":"2024-09-12T01:05:08.565945+0000","last_deep_scrub":"268'474","last_deep_scrub_stamp":"2024-09-12T01:05:08.565945+0000","last_clean_scrub_stamp":"2024-09-12T01:05:08.565945+0000","objects_scrubbed":7,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:06.432369+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":845,"num_read_kb":1964,"num_write":726,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:17.578807+0000","last_change":"2024-09-12T01:05:17.578807+0000","last_active":"2024-09-12T01:05:17.578807+0000","last_peered":"2024-09-12T01:05:17.578807+0000","last_clean":"2024-09-12T01:05:17.578807+0000","last_became_active":"2024-09-12T00:18:30.905680+0000","last_became_peered":"2024-09-12T00:18:30.905680+0000","last_unstale":"2024-09-12T01:05:17.578807+0000","last_undegraded":"2024-09-12T01:05:17.578807+0000","last_fullsized":"2024-09-12T01:05:17.578807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:17.578603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:17.578603+0000","last_clean_scrub_stamp":"2024-09-12T01:05:17.578603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:02.013094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'154","reported_seq":670,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:26.083011+0000","last_change":"2024-09-12T01:05:26.083011+0000","last_active":"2024-09-12T01:05:26.083011+0000","last_peered":"2024-09-12T01:05:26.083011+0000","last_clean":"2024-09-12T01:05:26.083011+0000","last_became_active":"2024-09-12T00:18:32.905070+0000","last_became_peered":"2024-09-12T00:18:32.905070+0000","last_unstale":"2024-09-12T01:05:26.083011+0000","last_undegraded":"2024-09-12T01:05:26.083011+0000","last_fullsized":"2024-09-12T01:05:26.083011+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'154","last_scrub_stamp":"2024-09-12T01:05:26.082827+0000","last_deep_scrub":"268'154","last_deep_scrub_stamp":"2024-09-12T01:05:26.082827+0000","last_clean_scrub_stamp":"2024-09-12T01:05:26.082827+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:27.746790+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":167,"num_read_kb":179,"num_write":337,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'642","reported_seq":2065,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.325029+0000","last_change":"2024-09-12T01:04:58.325029+0000","last_active":"2024-09-12T01:04:58.325029+0000","last_peered":"2024-09-12T01:04:58.325029+0000","last_clean":"2024-09-12T01:04:58.325029+0000","last_became_active":"2024-09-12T00:18:24.865142+0000","last_became_peered":"2024-09-12T00:18:24.865142+0000","last_unstale":"2024-09-12T01:04:58.325029+0000","last_undegraded":"2024-09-12T01:04:58.325029+0000","last_fullsized":"2024-09-12T01:04:58.325029+0000","mapping_epoch":26,"log_start":"268'600","ondisk_log_start":"268'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'642","last_scrub_stamp":"2024-09-12T01:04:58.324781+0000","last_deep_scrub":"268'642","last_deep_scrub_stamp":"2024-09-12T01:04:58.324781+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.324781+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":600,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:57.756900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2990,"num_read_kb":2759,"num_write":892,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'343","reported_seq":1275,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.556937+0000","last_change":"2024-09-12T01:04:48.556937+0000","last_active":"2024-09-12T01:04:48.556937+0000","last_peered":"2024-09-12T01:04:48.556937+0000","last_clean":"2024-09-12T01:04:48.556937+0000","last_became_active":"2024-09-12T00:18:22.845288+0000","last_became_peered":"2024-09-12T00:18:22.845288+0000","last_unstale":"2024-09-12T01:04:48.556937+0000","last_undegraded":"2024-09-12T01:04:48.556937+0000","last_fullsized":"2024-09-12T01:04:48.556937+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'343","last_scrub_stamp":"2024-09-12T01:04:48.556730+0000","last_deep_scrub":"268'343","last_deep_scrub_stamp":"2024-09-12T01:04:48.556730+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.556730+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:49.299596+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1116,"num_read_kb":11059,"num_write":1212,"num_write_kb":25104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.672231+0000","last_change":"2024-09-12T01:05:02.672231+0000","last_active":"2024-09-12T01:05:02.672231+0000","last_peered":"2024-09-12T01:05:02.672231+0000","last_clean":"2024-09-12T01:05:02.672231+0000","last_became_active":"2024-09-12T00:18:26.874972+0000","last_became_peered":"2024-09-12T00:18:26.874972+0000","last_unstale":"2024-09-12T01:05:02.672231+0000","last_undegraded":"2024-09-12T01:05:02.672231+0000","last_fullsized":"2024-09-12T01:05:02.672231+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:02.672044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:02.672044+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.672044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:02.283457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'325","reported_seq":916,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:12.435694+0000","last_change":"2024-09-12T01:05:12.435694+0000","last_active":"2024-09-12T01:05:12.435694+0000","last_peered":"2024-09-12T01:05:12.435694+0000","last_clean":"2024-09-12T01:05:12.435694+0000","last_became_active":"2024-09-12T00:18:28.892852+0000","last_became_peered":"2024-09-12T00:18:28.892852+0000","last_unstale":"2024-09-12T01:05:12.435694+0000","last_undegraded":"2024-09-12T01:05:12.435694+0000","last_fullsized":"2024-09-12T01:05:12.435694+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'325","last_scrub_stamp":"2024-09-12T01:05:12.435470+0000","last_deep_scrub":"268'325","last_deep_scrub_stamp":"2024-09-12T01:05:12.435470+0000","last_clean_scrub_stamp":"2024-09-12T01:05:12.435470+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:44.860765+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53047,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":539,"num_read_kb":1212,"num_write":456,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:11.583125+0000","last_change":"2024-09-12T01:05:11.583125+0000","last_active":"2024-09-12T01:05:11.583125+0000","last_peered":"2024-09-12T01:05:11.583125+0000","last_clean":"2024-09-12T01:05:11.583125+0000","last_became_active":"2024-09-12T00:18:30.892643+0000","last_became_peered":"2024-09-12T00:18:30.892643+0000","last_unstale":"2024-09-12T01:05:11.583125+0000","last_undegraded":"2024-09-12T01:05:11.583125+0000","last_fullsized":"2024-09-12T01:05:11.583125+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:11.582956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:11.582956+0000","last_clean_scrub_stamp":"2024-09-12T01:05:11.582956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:57.356251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'244","reported_seq":793,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:10.730777+0000","last_change":"2024-09-12T01:05:10.730642+0000","last_active":"2024-09-12T01:05:10.730777+0000","last_peered":"2024-09-12T01:05:10.730777+0000","last_clean":"2024-09-12T01:05:10.730777+0000","last_became_active":"2024-09-12T00:18:32.901587+0000","last_became_peered":"2024-09-12T00:18:32.901587+0000","last_unstale":"2024-09-12T01:05:10.730777+0000","last_undegraded":"2024-09-12T01:05:10.730777+0000","last_fullsized":"2024-09-12T01:05:10.730777+0000","mapping_epoch":34,"log_start":"268'200","ondisk_log_start":"268'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'244","last_scrub_stamp":"2024-09-12T01:05:10.730461+0000","last_deep_scrub":"268'244","last_deep_scrub_stamp":"2024-09-12T01:05:10.730461+0000","last_clean_scrub_stamp":"2024-09-12T01:05:10.730461+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:53.942944+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":371,"num_read_kb":330,"num_write":585,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'495","reported_seq":2044,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.019421+0000","last_change":"2024-09-12T01:05:05.019421+0000","last_active":"2024-09-12T01:05:05.019421+0000","last_peered":"2024-09-12T01:05:05.019421+0000","last_clean":"2024-09-12T01:05:05.019421+0000","last_became_active":"2024-09-12T00:18:24.860647+0000","last_became_peered":"2024-09-12T00:18:24.860647+0000","last_unstale":"2024-09-12T01:05:05.019421+0000","last_undegraded":"2024-09-12T01:05:05.019421+0000","last_fullsized":"2024-09-12T01:05:05.019421+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'495","last_scrub_stamp":"2024-09-12T01:05:05.019136+0000","last_deep_scrub":"268'495","last_deep_scrub_stamp":"2024-09-12T01:05:05.019136+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.019136+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:27.295349+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2720,"num_read_kb":2539,"num_write":620,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'383","reported_seq":1064,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.176551+0000","last_change":"2024-09-12T01:04:50.176551+0000","last_active":"2024-09-12T01:04:50.176551+0000","last_peered":"2024-09-12T01:04:50.176551+0000","last_clean":"2024-09-12T01:04:50.176551+0000","last_became_active":"2024-09-12T00:18:22.856073+0000","last_became_peered":"2024-09-12T00:18:22.856073+0000","last_unstale":"2024-09-12T01:04:50.176551+0000","last_undegraded":"2024-09-12T01:04:50.176551+0000","last_fullsized":"2024-09-12T01:04:50.176551+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'383","last_scrub_stamp":"2024-09-12T01:04:50.176350+0000","last_deep_scrub":"268'383","last_deep_scrub_stamp":"2024-09-12T01:04:50.176350+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.176350+0000","objects_scrubbed":12,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:59.557330+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468142,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":578,"num_read_kb":15678,"num_write":1129,"num_write_kb":22765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:11.161508+0000","last_change":"2024-09-12T01:05:11.161508+0000","last_active":"2024-09-12T01:05:11.161508+0000","last_peered":"2024-09-12T01:05:11.161508+0000","last_clean":"2024-09-12T01:05:11.161508+0000","last_became_active":"2024-09-12T00:18:26.862012+0000","last_became_peered":"2024-09-12T00:18:26.862012+0000","last_unstale":"2024-09-12T01:05:11.161508+0000","last_undegraded":"2024-09-12T01:05:11.161508+0000","last_fullsized":"2024-09-12T01:05:11.161508+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:11.161326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:11.161326+0000","last_clean_scrub_stamp":"2024-09-12T01:05:11.161326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:12.901407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'284","reported_seq":883,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:16.048179+0000","last_change":"2024-09-12T01:05:16.048179+0000","last_active":"2024-09-12T01:05:16.048179+0000","last_peered":"2024-09-12T01:05:16.048179+0000","last_clean":"2024-09-12T01:05:16.048179+0000","last_became_active":"2024-09-12T00:18:28.882129+0000","last_became_peered":"2024-09-12T00:18:28.882129+0000","last_unstale":"2024-09-12T01:05:16.048179+0000","last_undegraded":"2024-09-12T01:05:16.048179+0000","last_fullsized":"2024-09-12T01:05:16.048179+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'284","last_scrub_stamp":"2024-09-12T01:05:16.047992+0000","last_deep_scrub":"268'284","last_deep_scrub_stamp":"2024-09-12T01:05:16.047992+0000","last_clean_scrub_stamp":"2024-09-12T01:05:16.047992+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:00.794228+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47744,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":1049,"num_write":372,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.586021+0000","last_change":"2024-09-12T01:05:09.586021+0000","last_active":"2024-09-12T01:05:09.586021+0000","last_peered":"2024-09-12T01:05:09.586021+0000","last_clean":"2024-09-12T01:05:09.586021+0000","last_became_active":"2024-09-12T00:18:30.902511+0000","last_became_peered":"2024-09-12T00:18:30.902511+0000","last_unstale":"2024-09-12T01:05:09.586021+0000","last_undegraded":"2024-09-12T01:05:09.586021+0000","last_fullsized":"2024-09-12T01:05:09.586021+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:09.585833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:09.585833+0000","last_clean_scrub_stamp":"2024-09-12T01:05:09.585833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:20.848216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'134","reported_seq":660,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:21.567735+0000","last_change":"2024-09-12T01:05:21.567735+0000","last_active":"2024-09-12T01:05:21.567735+0000","last_peered":"2024-09-12T01:05:21.567735+0000","last_clean":"2024-09-12T01:05:21.567735+0000","last_became_active":"2024-09-12T00:18:32.899968+0000","last_became_peered":"2024-09-12T00:18:32.899968+0000","last_unstale":"2024-09-12T01:05:21.567735+0000","last_undegraded":"2024-09-12T01:05:21.567735+0000","last_fullsized":"2024-09-12T01:05:21.567735+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'134","last_scrub_stamp":"2024-09-12T01:05:21.567485+0000","last_deep_scrub":"268'134","last_deep_scrub_stamp":"2024-09-12T01:05:21.567485+0000","last_clean_scrub_stamp":"2024-09-12T01:05:21.567485+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:08.663806+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":825,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":214,"num_read_kb":184,"num_write":320,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'364","reported_seq":1744,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.442699+0000","last_change":"2024-09-12T01:04:52.442699+0000","last_active":"2024-09-12T01:04:52.442699+0000","last_peered":"2024-09-12T01:04:52.442699+0000","last_clean":"2024-09-12T01:04:52.442699+0000","last_became_active":"2024-09-12T00:18:24.861271+0000","last_became_peered":"2024-09-12T00:18:24.861271+0000","last_unstale":"2024-09-12T01:04:52.442699+0000","last_undegraded":"2024-09-12T01:04:52.442699+0000","last_fullsized":"2024-09-12T01:04:52.442699+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'364","last_scrub_stamp":"2024-09-12T01:04:52.442472+0000","last_deep_scrub":"268'364","last_deep_scrub_stamp":"2024-09-12T01:04:52.442472+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.442472+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:50.665068+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2074,"num_read_kb":1954,"num_write":427,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'348","reported_seq":985,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.262939+0000","last_change":"2024-09-12T01:04:49.262939+0000","last_active":"2024-09-12T01:04:49.262939+0000","last_peered":"2024-09-12T01:04:49.262939+0000","last_clean":"2024-09-12T01:04:49.262939+0000","last_became_active":"2024-09-12T00:18:22.859695+0000","last_became_peered":"2024-09-12T00:18:22.859695+0000","last_unstale":"2024-09-12T01:04:49.262939+0000","last_undegraded":"2024-09-12T01:04:49.262939+0000","last_fullsized":"2024-09-12T01:04:49.262939+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'348","last_scrub_stamp":"2024-09-12T01:04:49.262596+0000","last_deep_scrub":"268'348","last_deep_scrub_stamp":"2024-09-12T01:04:49.262596+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.262596+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:52.854459+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263211,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":478,"num_read_kb":12426,"num_write":1109,"num_write_kb":25448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:06.535966+0000","last_change":"2024-09-12T01:05:06.535966+0000","last_active":"2024-09-12T01:05:06.535966+0000","last_peered":"2024-09-12T01:05:06.535966+0000","last_clean":"2024-09-12T01:05:06.535966+0000","last_became_active":"2024-09-12T00:18:26.859234+0000","last_became_peered":"2024-09-12T00:18:26.859234+0000","last_unstale":"2024-09-12T01:05:06.535966+0000","last_undegraded":"2024-09-12T01:05:06.535966+0000","last_fullsized":"2024-09-12T01:05:06.535966+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:06.535753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:06.535753+0000","last_clean_scrub_stamp":"2024-09-12T01:05:06.535753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:39.417495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'130","reported_seq":672,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.215863+0000","last_change":"2024-09-12T01:05:19.215863+0000","last_active":"2024-09-12T01:05:19.215863+0000","last_peered":"2024-09-12T01:05:19.215863+0000","last_clean":"2024-09-12T01:05:19.215863+0000","last_became_active":"2024-09-12T00:18:28.883277+0000","last_became_peered":"2024-09-12T00:18:28.883277+0000","last_unstale":"2024-09-12T01:05:19.215863+0000","last_undegraded":"2024-09-12T01:05:19.215863+0000","last_fullsized":"2024-09-12T01:05:19.215863+0000","mapping_epoch":30,"log_start":"268'100","ondisk_log_start":"268'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'130","last_scrub_stamp":"2024-09-12T01:05:19.215623+0000","last_deep_scrub":"268'130","last_deep_scrub_stamp":"2024-09-12T01:05:19.215623+0000","last_clean_scrub_stamp":"2024-09-12T01:05:19.215623+0000","objects_scrubbed":8,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:44.684825+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":135,"num_read_kb":124,"num_write":148,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'770","reported_seq":2209,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:08.749470+0000","last_change":"2024-09-12T01:05:08.749470+0000","last_active":"2024-09-12T01:05:08.749470+0000","last_peered":"2024-09-12T01:05:08.749470+0000","last_clean":"2024-09-12T01:05:08.749470+0000","last_became_active":"2024-09-12T00:18:30.893175+0000","last_became_peered":"2024-09-12T00:18:30.893175+0000","last_unstale":"2024-09-12T01:05:08.749470+0000","last_undegraded":"2024-09-12T01:05:08.749470+0000","last_fullsized":"2024-09-12T01:05:08.749470+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'770","last_scrub_stamp":"2024-09-12T01:05:08.749187+0000","last_deep_scrub":"268'770","last_deep_scrub_stamp":"2024-09-12T01:05:08.749187+0000","last_clean_scrub_stamp":"2024-09-12T01:05:08.749187+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:10.450055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'108","reported_seq":611,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:18.408460+0000","last_change":"2024-09-12T01:05:18.408460+0000","last_active":"2024-09-12T01:05:18.408460+0000","last_peered":"2024-09-12T01:05:18.408460+0000","last_clean":"2024-09-12T01:05:18.408460+0000","last_became_active":"2024-09-12T00:18:32.908295+0000","last_became_peered":"2024-09-12T00:18:32.908295+0000","last_unstale":"2024-09-12T01:05:18.408460+0000","last_undegraded":"2024-09-12T01:05:18.408460+0000","last_fullsized":"2024-09-12T01:05:18.408460+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'108","last_scrub_stamp":"2024-09-12T01:05:18.408258+0000","last_deep_scrub":"268'108","last_deep_scrub_stamp":"2024-09-12T01:05:18.408258+0000","last_clean_scrub_stamp":"2024-09-12T01:05:18.408258+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:56.861384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":102,"num_write":264,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'834","reported_seq":2462,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.178341+0000","last_change":"2024-09-12T01:05:00.178341+0000","last_active":"2024-09-12T01:05:00.178341+0000","last_peered":"2024-09-12T01:05:00.178341+0000","last_clean":"2024-09-12T01:05:00.178341+0000","last_became_active":"2024-09-12T00:18:24.860266+0000","last_became_peered":"2024-09-12T00:18:24.860266+0000","last_unstale":"2024-09-12T01:05:00.178341+0000","last_undegraded":"2024-09-12T01:05:00.178341+0000","last_fullsized":"2024-09-12T01:05:00.178341+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'834","last_scrub_stamp":"2024-09-12T01:05:00.178156+0000","last_deep_scrub":"268'834","last_deep_scrub_stamp":"2024-09-12T01:05:00.178156+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.178156+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:24.839206+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4128,"num_read_kb":3735,"num_write":1126,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'317","reported_seq":929,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.585039+0000","last_change":"2024-09-12T01:04:51.585039+0000","last_active":"2024-09-12T01:04:51.585039+0000","last_peered":"2024-09-12T01:04:51.585039+0000","last_clean":"2024-09-12T01:04:51.585039+0000","last_became_active":"2024-09-12T00:18:22.867694+0000","last_became_peered":"2024-09-12T00:18:22.867694+0000","last_unstale":"2024-09-12T01:04:51.585039+0000","last_undegraded":"2024-09-12T01:04:51.585039+0000","last_fullsized":"2024-09-12T01:04:51.585039+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'317","last_scrub_stamp":"2024-09-12T01:04:51.584788+0000","last_deep_scrub":"268'317","last_deep_scrub_stamp":"2024-09-12T01:04:51.584788+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.584788+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:39.411322+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194362,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":405,"num_read_kb":19923,"num_write":982,"num_write_kb":45748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:07.504144+0000","last_change":"2024-09-12T01:05:07.504144+0000","last_active":"2024-09-12T01:05:07.504144+0000","last_peered":"2024-09-12T01:05:07.504144+0000","last_clean":"2024-09-12T01:05:07.504144+0000","last_became_active":"2024-09-12T00:18:26.864536+0000","last_became_peered":"2024-09-12T00:18:26.864536+0000","last_unstale":"2024-09-12T01:05:07.504144+0000","last_undegraded":"2024-09-12T01:05:07.504144+0000","last_fullsized":"2024-09-12T01:05:07.504144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:07.503869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:07.503869+0000","last_clean_scrub_stamp":"2024-09-12T01:05:07.503869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:30.764859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'348","reported_seq":966,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:15.606980+0000","last_change":"2024-09-12T01:05:15.606980+0000","last_active":"2024-09-12T01:05:15.606980+0000","last_peered":"2024-09-12T01:05:15.606980+0000","last_clean":"2024-09-12T01:05:15.606980+0000","last_became_active":"2024-09-12T00:18:28.885152+0000","last_became_peered":"2024-09-12T00:18:28.885152+0000","last_unstale":"2024-09-12T01:05:15.606980+0000","last_undegraded":"2024-09-12T01:05:15.606980+0000","last_fullsized":"2024-09-12T01:05:15.606980+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'348","last_scrub_stamp":"2024-09-12T01:05:15.606862+0000","last_deep_scrub":"268'348","last_deep_scrub_stamp":"2024-09-12T01:05:15.606862+0000","last_clean_scrub_stamp":"2024-09-12T01:05:15.606862+0000","objects_scrubbed":11,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:34.302412+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50453,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":539,"num_read_kb":1151,"num_write":436,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:15.162275+0000","last_change":"2024-09-12T01:05:15.162275+0000","last_active":"2024-09-12T01:05:15.162275+0000","last_peered":"2024-09-12T01:05:15.162275+0000","last_clean":"2024-09-12T01:05:15.162275+0000","last_became_active":"2024-09-12T00:18:30.888974+0000","last_became_peered":"2024-09-12T00:18:30.888974+0000","last_unstale":"2024-09-12T01:05:15.162275+0000","last_undegraded":"2024-09-12T01:05:15.162275+0000","last_fullsized":"2024-09-12T01:05:15.162275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:15.162085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:15.162085+0000","last_clean_scrub_stamp":"2024-09-12T01:05:15.162085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:33.981687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'100","reported_seq":615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.362653+0000","last_change":"2024-09-12T01:05:20.362653+0000","last_active":"2024-09-12T01:05:20.362653+0000","last_peered":"2024-09-12T01:05:20.362653+0000","last_clean":"2024-09-12T01:05:20.362653+0000","last_became_active":"2024-09-12T00:18:32.914994+0000","last_became_peered":"2024-09-12T00:18:32.914994+0000","last_unstale":"2024-09-12T01:05:20.362653+0000","last_undegraded":"2024-09-12T01:05:20.362653+0000","last_fullsized":"2024-09-12T01:05:20.362653+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'100","last_scrub_stamp":"2024-09-12T01:05:20.362477+0000","last_deep_scrub":"268'100","last_deep_scrub_stamp":"2024-09-12T01:05:20.362477+0000","last_clean_scrub_stamp":"2024-09-12T01:05:20.362477+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:42.589444+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":129,"num_write":234,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'859","reported_seq":2384,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.197006+0000","last_change":"2024-09-12T01:04:59.197006+0000","last_active":"2024-09-12T01:04:59.197006+0000","last_peered":"2024-09-12T01:04:59.197006+0000","last_clean":"2024-09-12T01:04:59.197006+0000","last_became_active":"2024-09-12T00:18:24.854089+0000","last_became_peered":"2024-09-12T00:18:24.854089+0000","last_unstale":"2024-09-12T01:04:59.197006+0000","last_undegraded":"2024-09-12T01:04:59.197006+0000","last_fullsized":"2024-09-12T01:04:59.197006+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'859","last_scrub_stamp":"2024-09-12T01:04:59.196824+0000","last_deep_scrub":"268'859","last_deep_scrub_stamp":"2024-09-12T01:04:59.196824+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.196824+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":800,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:28.550763+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4036,"num_read_kb":3617,"num_write":1169,"num_write_kb":474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'344","reported_seq":987,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.538484+0000","last_change":"2024-09-12T01:04:53.538484+0000","last_active":"2024-09-12T01:04:53.538484+0000","last_peered":"2024-09-12T01:04:53.538484+0000","last_clean":"2024-09-12T01:04:53.538484+0000","last_became_active":"2024-09-12T00:18:22.867744+0000","last_became_peered":"2024-09-12T00:18:22.867744+0000","last_unstale":"2024-09-12T01:04:53.538484+0000","last_undegraded":"2024-09-12T01:04:53.538484+0000","last_fullsized":"2024-09-12T01:04:53.538484+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'344","last_scrub_stamp":"2024-09-12T01:04:53.538289+0000","last_deep_scrub":"268'344","last_deep_scrub_stamp":"2024-09-12T01:04:53.538289+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.538289+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:01.759059+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":517,"num_read_kb":9523,"num_write":1195,"num_write_kb":17845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:11.595876+0000","last_change":"2024-09-12T01:05:11.595876+0000","last_active":"2024-09-12T01:05:11.595876+0000","last_peered":"2024-09-12T01:05:11.595876+0000","last_clean":"2024-09-12T01:05:11.595876+0000","last_became_active":"2024-09-12T00:18:26.857810+0000","last_became_peered":"2024-09-12T00:18:26.857810+0000","last_unstale":"2024-09-12T01:05:11.595876+0000","last_undegraded":"2024-09-12T01:05:11.595876+0000","last_fullsized":"2024-09-12T01:05:11.595876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:11.595702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:11.595702+0000","last_clean_scrub_stamp":"2024-09-12T01:05:11.595702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:02.285161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'260","reported_seq":845,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:11.189156+0000","last_change":"2024-09-12T01:05:11.189156+0000","last_active":"2024-09-12T01:05:11.189156+0000","last_peered":"2024-09-12T01:05:11.189156+0000","last_clean":"2024-09-12T01:05:11.189156+0000","last_became_active":"2024-09-12T00:18:28.881556+0000","last_became_peered":"2024-09-12T00:18:28.881556+0000","last_unstale":"2024-09-12T01:05:11.189156+0000","last_undegraded":"2024-09-12T01:05:11.189156+0000","last_fullsized":"2024-09-12T01:05:11.189156+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'260","last_scrub_stamp":"2024-09-12T01:05:11.188953+0000","last_deep_scrub":"268'260","last_deep_scrub_stamp":"2024-09-12T01:05:11.188953+0000","last_clean_scrub_stamp":"2024-09-12T01:05:11.188953+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:16.718034+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48228,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":430,"num_read_kb":998,"num_write":346,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:07.730304+0000","last_change":"2024-09-12T01:05:07.730304+0000","last_active":"2024-09-12T01:05:07.730304+0000","last_peered":"2024-09-12T01:05:07.730304+0000","last_clean":"2024-09-12T01:05:07.730304+0000","last_became_active":"2024-09-12T00:18:30.898539+0000","last_became_peered":"2024-09-12T00:18:30.898539+0000","last_unstale":"2024-09-12T01:05:07.730304+0000","last_undegraded":"2024-09-12T01:05:07.730304+0000","last_fullsized":"2024-09-12T01:05:07.730304+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:07.730123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:07.730123+0000","last_clean_scrub_stamp":"2024-09-12T01:05:07.730123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:08.477914+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'110","reported_seq":637,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.199453+0000","last_change":"2024-09-12T00:18:32.908261+0000","last_active":"2024-09-12T01:03:08.199453+0000","last_peered":"2024-09-12T01:03:08.199453+0000","last_clean":"2024-09-12T01:03:08.199453+0000","last_became_active":"2024-09-12T00:18:32.907530+0000","last_became_peered":"2024-09-12T00:18:32.907530+0000","last_unstale":"2024-09-12T01:03:08.199453+0000","last_undegraded":"2024-09-12T01:03:08.199453+0000","last_fullsized":"2024-09-12T01:03:08.199453+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.857529+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.857529+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:37.368919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":167,"num_read_kb":160,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'366","reported_seq":1699,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.075971+0000","last_change":"2024-09-12T01:05:03.075971+0000","last_active":"2024-09-12T01:05:03.075971+0000","last_peered":"2024-09-12T01:05:03.075971+0000","last_clean":"2024-09-12T01:05:03.075971+0000","last_became_active":"2024-09-12T00:18:24.842263+0000","last_became_peered":"2024-09-12T00:18:24.842263+0000","last_unstale":"2024-09-12T01:05:03.075971+0000","last_undegraded":"2024-09-12T01:05:03.075971+0000","last_fullsized":"2024-09-12T01:05:03.075971+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'366","last_scrub_stamp":"2024-09-12T01:05:03.075784+0000","last_deep_scrub":"268'366","last_deep_scrub_stamp":"2024-09-12T01:05:03.075784+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.075784+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:40.465649+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1879,"num_read_kb":1766,"num_write":437,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'436","reported_seq":1218,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.286861+0000","last_change":"2024-09-12T01:04:52.286861+0000","last_active":"2024-09-12T01:04:52.286861+0000","last_peered":"2024-09-12T01:04:52.286861+0000","last_clean":"2024-09-12T01:04:52.286861+0000","last_became_active":"2024-09-12T00:18:22.837412+0000","last_became_peered":"2024-09-12T00:18:22.837412+0000","last_unstale":"2024-09-12T01:04:52.286861+0000","last_undegraded":"2024-09-12T01:04:52.286861+0000","last_fullsized":"2024-09-12T01:04:52.286861+0000","mapping_epoch":24,"log_start":"268'400","ondisk_log_start":"268'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'436","last_scrub_stamp":"2024-09-12T01:04:52.286655+0000","last_deep_scrub":"268'436","last_deep_scrub_stamp":"2024-09-12T01:04:52.286655+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.286655+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:34.352582+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5614631,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":898,"num_read_kb":48874,"num_write":1334,"num_write_kb":53147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:10.170546+0000","last_change":"2024-09-12T01:05:10.170546+0000","last_active":"2024-09-12T01:05:10.170546+0000","last_peered":"2024-09-12T01:05:10.170546+0000","last_clean":"2024-09-12T01:05:10.170546+0000","last_became_active":"2024-09-12T00:18:26.868407+0000","last_became_peered":"2024-09-12T00:18:26.868407+0000","last_unstale":"2024-09-12T01:05:10.170546+0000","last_undegraded":"2024-09-12T01:05:10.170546+0000","last_fullsized":"2024-09-12T01:05:10.170546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:10.170374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:10.170374+0000","last_clean_scrub_stamp":"2024-09-12T01:05:10.170374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:57.128330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'270","reported_seq":850,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:17.084853+0000","last_change":"2024-09-12T01:05:17.084853+0000","last_active":"2024-09-12T01:05:17.084853+0000","last_peered":"2024-09-12T01:05:17.084853+0000","last_clean":"2024-09-12T01:05:17.084853+0000","last_became_active":"2024-09-12T00:18:28.895848+0000","last_became_peered":"2024-09-12T00:18:28.895848+0000","last_unstale":"2024-09-12T01:05:17.084853+0000","last_undegraded":"2024-09-12T01:05:17.084853+0000","last_fullsized":"2024-09-12T01:05:17.084853+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'270","last_scrub_stamp":"2024-09-12T01:05:17.084644+0000","last_deep_scrub":"268'270","last_deep_scrub_stamp":"2024-09-12T01:05:17.084644+0000","last_clean_scrub_stamp":"2024-09-12T01:05:17.084644+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:58.323594+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53006,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":433,"num_read_kb":1065,"num_write":360,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:17.196033+0000","last_change":"2024-09-12T01:05:17.196033+0000","last_active":"2024-09-12T01:05:17.196033+0000","last_peered":"2024-09-12T01:05:17.196033+0000","last_clean":"2024-09-12T01:05:17.196033+0000","last_became_active":"2024-09-12T00:18:30.892682+0000","last_became_peered":"2024-09-12T00:18:30.892682+0000","last_unstale":"2024-09-12T01:05:17.196033+0000","last_undegraded":"2024-09-12T01:05:17.196033+0000","last_fullsized":"2024-09-12T01:05:17.196033+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:17.195793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:17.195793+0000","last_clean_scrub_stamp":"2024-09-12T01:05:17.195793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:29.371582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'213","reported_seq":1708,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.399573+0000","last_change":"2024-09-12T01:05:19.399573+0000","last_active":"2024-09-12T01:05:19.399573+0000","last_peered":"2024-09-12T01:05:19.399573+0000","last_clean":"2024-09-12T01:05:19.399573+0000","last_became_active":"2024-09-12T00:18:32.911082+0000","last_became_peered":"2024-09-12T00:18:32.911082+0000","last_unstale":"2024-09-12T01:05:19.399573+0000","last_undegraded":"2024-09-12T01:05:19.399573+0000","last_fullsized":"2024-09-12T01:05:19.399573+0000","mapping_epoch":34,"log_start":"268'200","ondisk_log_start":"268'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'213","last_scrub_stamp":"2024-09-12T01:05:19.399393+0000","last_deep_scrub":"268'213","last_deep_scrub_stamp":"2024-09-12T01:05:19.399393+0000","last_clean_scrub_stamp":"2024-09-12T01:05:19.399393+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:14.911475+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1287,"num_read_kb":1263,"num_write":482,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'527","reported_seq":2125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.235268+0000","last_change":"2024-09-12T01:04:58.235268+0000","last_active":"2024-09-12T01:04:58.235268+0000","last_peered":"2024-09-12T01:04:58.235268+0000","last_clean":"2024-09-12T01:04:58.235268+0000","last_became_active":"2024-09-12T00:18:24.881029+0000","last_became_peered":"2024-09-12T00:18:24.881029+0000","last_unstale":"2024-09-12T01:04:58.235268+0000","last_undegraded":"2024-09-12T01:04:58.235268+0000","last_fullsized":"2024-09-12T01:04:58.235268+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'527","last_scrub_stamp":"2024-09-12T01:04:58.235070+0000","last_deep_scrub":"268'527","last_deep_scrub_stamp":"2024-09-12T01:04:58.235070+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.235070+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":500,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:33.784017+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2735,"num_read_kb":2532,"num_write":658,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'403","reported_seq":1117,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.251141+0000","last_change":"2024-09-12T01:04:48.251141+0000","last_active":"2024-09-12T01:04:48.251141+0000","last_peered":"2024-09-12T01:04:48.251141+0000","last_clean":"2024-09-12T01:04:48.251141+0000","last_became_active":"2024-09-12T00:18:22.863907+0000","last_became_peered":"2024-09-12T00:18:22.863907+0000","last_unstale":"2024-09-12T01:04:48.251141+0000","last_undegraded":"2024-09-12T01:04:48.251141+0000","last_fullsized":"2024-09-12T01:04:48.251141+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'403","last_scrub_stamp":"2024-09-12T01:04:48.250914+0000","last_deep_scrub":"268'403","last_deep_scrub_stamp":"2024-09-12T01:04:48.250914+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.250914+0000","objects_scrubbed":11,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:07.582611+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1987000,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":643,"num_read_kb":24608,"num_write":1249,"num_write_kb":29666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"268'2","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.574020+0000","last_change":"2024-09-12T01:05:02.574020+0000","last_active":"2024-09-12T01:05:02.574020+0000","last_peered":"2024-09-12T01:05:02.574020+0000","last_clean":"2024-09-12T01:05:02.574020+0000","last_became_active":"2024-09-12T00:18:26.866967+0000","last_became_peered":"2024-09-12T00:18:26.866967+0000","last_unstale":"2024-09-12T01:05:02.574020+0000","last_undegraded":"2024-09-12T01:05:02.574020+0000","last_fullsized":"2024-09-12T01:05:02.574020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:02.573832+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:02.573832+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.573832+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:53.608830+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'315","reported_seq":925,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:15.214103+0000","last_change":"2024-09-12T01:05:15.214103+0000","last_active":"2024-09-12T01:05:15.214103+0000","last_peered":"2024-09-12T01:05:15.214103+0000","last_clean":"2024-09-12T01:05:15.214103+0000","last_became_active":"2024-09-12T00:18:28.897709+0000","last_became_peered":"2024-09-12T00:18:28.897709+0000","last_unstale":"2024-09-12T01:05:15.214103+0000","last_undegraded":"2024-09-12T01:05:15.214103+0000","last_fullsized":"2024-09-12T01:05:15.214103+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'315","last_scrub_stamp":"2024-09-12T01:05:15.213915+0000","last_deep_scrub":"268'315","last_deep_scrub_stamp":"2024-09-12T01:05:15.213915+0000","last_clean_scrub_stamp":"2024-09-12T01:05:15.213915+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:47.575742+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54863,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":525,"num_read_kb":1160,"num_write":422,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:16.123449+0000","last_change":"2024-09-12T01:05:16.123449+0000","last_active":"2024-09-12T01:05:16.123449+0000","last_peered":"2024-09-12T01:05:16.123449+0000","last_clean":"2024-09-12T01:05:16.123449+0000","last_became_active":"2024-09-12T00:18:30.889179+0000","last_became_peered":"2024-09-12T00:18:30.889179+0000","last_unstale":"2024-09-12T01:05:16.123449+0000","last_undegraded":"2024-09-12T01:05:16.123449+0000","last_fullsized":"2024-09-12T01:05:16.123449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:16.123278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:16.123278+0000","last_clean_scrub_stamp":"2024-09-12T01:05:16.123278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:43.328841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'193","reported_seq":766,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.174722+0000","last_change":"2024-09-12T01:05:20.174584+0000","last_active":"2024-09-12T01:05:20.174722+0000","last_peered":"2024-09-12T01:05:20.174722+0000","last_clean":"2024-09-12T01:05:20.174722+0000","last_became_active":"2024-09-12T00:18:32.907658+0000","last_became_peered":"2024-09-12T00:18:32.907658+0000","last_unstale":"2024-09-12T01:05:20.174722+0000","last_undegraded":"2024-09-12T01:05:20.174722+0000","last_fullsized":"2024-09-12T01:05:20.174722+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'193","last_scrub_stamp":"2024-09-12T01:05:20.174417+0000","last_deep_scrub":"268'193","last_deep_scrub_stamp":"2024-09-12T01:05:20.174417+0000","last_clean_scrub_stamp":"2024-09-12T01:05:20.174417+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:27.927387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":435,"num_read_kb":358,"num_write":481,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'411","reported_seq":1919,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.596122+0000","last_change":"2024-09-12T01:05:03.596122+0000","last_active":"2024-09-12T01:05:03.596122+0000","last_peered":"2024-09-12T01:05:03.596122+0000","last_clean":"2024-09-12T01:05:03.596122+0000","last_became_active":"2024-09-12T00:18:24.878522+0000","last_became_peered":"2024-09-12T00:18:24.878522+0000","last_unstale":"2024-09-12T01:05:03.596122+0000","last_undegraded":"2024-09-12T01:05:03.596122+0000","last_fullsized":"2024-09-12T01:05:03.596122+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'411","last_scrub_stamp":"2024-09-12T01:05:03.595908+0000","last_deep_scrub":"268'411","last_deep_scrub_stamp":"2024-09-12T01:05:03.595908+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.595908+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:15.152071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2233,"num_read_kb":2110,"num_write":497,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'384","reported_seq":1059,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.766796+0000","last_change":"2024-09-12T01:04:53.766796+0000","last_active":"2024-09-12T01:04:53.766796+0000","last_peered":"2024-09-12T01:04:53.766796+0000","last_clean":"2024-09-12T01:04:53.766796+0000","last_became_active":"2024-09-12T00:18:22.851554+0000","last_became_peered":"2024-09-12T00:18:22.851554+0000","last_unstale":"2024-09-12T01:04:53.766796+0000","last_undegraded":"2024-09-12T01:04:53.766796+0000","last_fullsized":"2024-09-12T01:04:53.766796+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'384","last_scrub_stamp":"2024-09-12T01:04:53.766598+0000","last_deep_scrub":"268'384","last_deep_scrub_stamp":"2024-09-12T01:04:53.766598+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.766598+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:59.035558+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":573,"num_read_kb":70445,"num_write":1144,"num_write_kb":38293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"268'1219","reported_seq":2840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.588495+0000","last_change":"2024-09-12T01:04:59.588495+0000","last_active":"2024-09-12T01:04:59.588495+0000","last_peered":"2024-09-12T01:04:59.588495+0000","last_clean":"2024-09-12T01:04:59.588495+0000","last_became_active":"2024-09-12T00:18:24.857107+0000","last_became_peered":"2024-09-12T00:18:24.857107+0000","last_unstale":"2024-09-12T01:04:59.588495+0000","last_undegraded":"2024-09-12T01:04:59.588495+0000","last_fullsized":"2024-09-12T01:04:59.588495+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1219","last_scrub_stamp":"2024-09-12T01:04:59.588271+0000","last_deep_scrub":"268'1219","last_deep_scrub_stamp":"2024-09-12T01:04:59.588271+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.588271+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":1200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:26.602528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5568,"num_read_kb":4913,"num_write":1657,"num_write_kb":681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"268'366","reported_seq":1025,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.455879+0000","last_change":"2024-09-12T01:04:47.455879+0000","last_active":"2024-09-12T01:04:47.455879+0000","last_peered":"2024-09-12T01:04:47.455879+0000","last_clean":"2024-09-12T01:04:47.455879+0000","last_became_active":"2024-09-12T00:18:56.193721+0000","last_became_peered":"2024-09-12T00:18:56.193721+0000","last_unstale":"2024-09-12T01:04:47.455879+0000","last_undegraded":"2024-09-12T01:04:47.455879+0000","last_fullsized":"2024-09-12T01:04:47.455879+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'366","last_scrub_stamp":"2024-09-12T01:04:47.455778+0000","last_deep_scrub":"268'366","last_deep_scrub_stamp":"2024-09-12T01:04:47.455778+0000","last_clean_scrub_stamp":"2024-09-12T01:04:47.455778+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:03.972474+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342105,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":474,"num_read_kb":19261,"num_write":1030,"num_write_kb":26595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'861","reported_seq":2466,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.543543+0000","last_change":"2024-09-12T01:05:03.543543+0000","last_active":"2024-09-12T01:05:03.543543+0000","last_peered":"2024-09-12T01:05:03.543543+0000","last_clean":"2024-09-12T01:05:03.543543+0000","last_became_active":"2024-09-12T00:18:24.870288+0000","last_became_peered":"2024-09-12T00:18:24.870288+0000","last_unstale":"2024-09-12T01:05:03.543543+0000","last_undegraded":"2024-09-12T01:05:03.543543+0000","last_fullsized":"2024-09-12T01:05:03.543543+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'861","last_scrub_stamp":"2024-09-12T01:05:03.543359+0000","last_deep_scrub":"268'861","last_deep_scrub_stamp":"2024-09-12T01:05:03.543359+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.543359+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":800,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:05.642071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4146,"num_read_kb":3713,"num_write":1130,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2296,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'416","reported_seq":1061,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.558231+0000","last_change":"2024-09-12T01:04:52.558231+0000","last_active":"2024-09-12T01:04:52.558231+0000","last_peered":"2024-09-12T01:04:52.558231+0000","last_clean":"2024-09-12T01:04:52.558231+0000","last_became_active":"2024-09-12T00:18:22.866341+0000","last_became_peered":"2024-09-12T00:18:22.866341+0000","last_unstale":"2024-09-12T01:04:52.558231+0000","last_undegraded":"2024-09-12T01:04:52.558231+0000","last_fullsized":"2024-09-12T01:04:52.558231+0000","mapping_epoch":24,"log_start":"268'400","ondisk_log_start":"268'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'416","last_scrub_stamp":"2024-09-12T01:04:52.558034+0000","last_deep_scrub":"268'416","last_deep_scrub_stamp":"2024-09-12T01:04:52.558034+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.558034+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:06.937457+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1452502,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":481,"num_read_kb":25322,"num_write":1167,"num_write_kb":64729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'400","reported_seq":1905,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.616499+0000","last_change":"2024-09-12T01:04:57.616499+0000","last_active":"2024-09-12T01:04:57.616499+0000","last_peered":"2024-09-12T01:04:57.616499+0000","last_clean":"2024-09-12T01:04:57.616499+0000","last_became_active":"2024-09-12T00:18:24.865674+0000","last_became_peered":"2024-09-12T00:18:24.865674+0000","last_unstale":"2024-09-12T01:04:57.616499+0000","last_undegraded":"2024-09-12T01:04:57.616499+0000","last_fullsized":"2024-09-12T01:04:57.616499+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'400","last_scrub_stamp":"2024-09-12T01:04:57.616297+0000","last_deep_scrub":"268'400","last_deep_scrub_stamp":"2024-09-12T01:04:57.616297+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.616297+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:18.938055+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2040,"num_read_kb":1953,"num_write":432,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'346","reported_seq":1099,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.241235+0000","last_change":"2024-09-12T01:04:50.241235+0000","last_active":"2024-09-12T01:04:50.241235+0000","last_peered":"2024-09-12T01:04:50.241235+0000","last_clean":"2024-09-12T01:04:50.241235+0000","last_became_active":"2024-09-12T00:18:22.844095+0000","last_became_peered":"2024-09-12T00:18:22.844095+0000","last_unstale":"2024-09-12T01:04:50.241235+0000","last_undegraded":"2024-09-12T01:04:50.241235+0000","last_fullsized":"2024-09-12T01:04:50.241235+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'346","last_scrub_stamp":"2024-09-12T01:04:50.241022+0000","last_deep_scrub":"268'346","last_deep_scrub_stamp":"2024-09-12T01:04:50.241022+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.241022+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:38.319110+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":305939,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":760,"num_read_kb":58308,"num_write":997,"num_write_kb":25022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"268'390","reported_seq":1858,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.133189+0000","last_change":"2024-09-12T01:04:59.133189+0000","last_active":"2024-09-12T01:04:59.133189+0000","last_peered":"2024-09-12T01:04:59.133189+0000","last_clean":"2024-09-12T01:04:59.133189+0000","last_became_active":"2024-09-12T00:18:24.865720+0000","last_became_peered":"2024-09-12T00:18:24.865720+0000","last_unstale":"2024-09-12T01:04:59.133189+0000","last_undegraded":"2024-09-12T01:04:59.133189+0000","last_fullsized":"2024-09-12T01:04:59.133189+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'390","last_scrub_stamp":"2024-09-12T01:04:59.132929+0000","last_deep_scrub":"268'390","last_deep_scrub_stamp":"2024-09-12T01:04:59.132929+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.132929+0000","objects_scrubbed":7,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:05.560879+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2058,"num_read_kb":1953,"num_write":433,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2118,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'381","reported_seq":1064,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.238978+0000","last_change":"2024-09-12T01:04:50.238978+0000","last_active":"2024-09-12T01:04:50.238978+0000","last_peered":"2024-09-12T01:04:50.238978+0000","last_clean":"2024-09-12T01:04:50.238978+0000","last_became_active":"2024-09-12T00:18:22.857896+0000","last_became_peered":"2024-09-12T00:18:22.857896+0000","last_unstale":"2024-09-12T01:04:50.238978+0000","last_undegraded":"2024-09-12T01:04:50.238978+0000","last_fullsized":"2024-09-12T01:04:50.238978+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'381","last_scrub_stamp":"2024-09-12T01:04:50.238615+0000","last_deep_scrub":"268'381","last_deep_scrub_stamp":"2024-09-12T01:04:50.238615+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.238615+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:15.950829+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456478,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":576,"num_read_kb":17790,"num_write":1194,"num_write_kb":44407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'444","reported_seq":2182,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.202943+0000","last_change":"2024-09-12T01:05:01.202943+0000","last_active":"2024-09-12T01:05:01.202943+0000","last_peered":"2024-09-12T01:05:01.202943+0000","last_clean":"2024-09-12T01:05:01.202943+0000","last_became_active":"2024-09-12T00:18:24.866980+0000","last_became_peered":"2024-09-12T00:18:24.866980+0000","last_unstale":"2024-09-12T01:05:01.202943+0000","last_undegraded":"2024-09-12T01:05:01.202943+0000","last_fullsized":"2024-09-12T01:05:01.202943+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'444","last_scrub_stamp":"2024-09-12T01:05:01.202767+0000","last_deep_scrub":"268'444","last_deep_scrub_stamp":"2024-09-12T01:05:01.202767+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.202767+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:44.543465+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2639,"num_read_kb":2518,"num_write":497,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2207,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'322","reported_seq":988,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.507744+0000","last_change":"2024-09-12T01:04:50.507744+0000","last_active":"2024-09-12T01:04:50.507744+0000","last_peered":"2024-09-12T01:04:50.507744+0000","last_clean":"2024-09-12T01:04:50.507744+0000","last_became_active":"2024-09-12T00:18:22.846805+0000","last_became_peered":"2024-09-12T00:18:22.846805+0000","last_unstale":"2024-09-12T01:04:50.507744+0000","last_undegraded":"2024-09-12T01:04:50.507744+0000","last_fullsized":"2024-09-12T01:04:50.507744+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'322","last_scrub_stamp":"2024-09-12T01:04:50.507547+0000","last_deep_scrub":"268'322","last_deep_scrub_stamp":"2024-09-12T01:04:50.507547+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.507547+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:49.831883+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":456,"num_read_kb":82569,"num_write":1071,"num_write_kb":46093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'468","reported_seq":2015,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.989566+0000","last_change":"2024-09-12T01:05:05.989566+0000","last_active":"2024-09-12T01:05:05.989566+0000","last_peered":"2024-09-12T01:05:05.989566+0000","last_clean":"2024-09-12T01:05:05.989566+0000","last_became_active":"2024-09-12T00:18:24.862022+0000","last_became_peered":"2024-09-12T00:18:24.862022+0000","last_unstale":"2024-09-12T01:05:05.989566+0000","last_undegraded":"2024-09-12T01:05:05.989566+0000","last_fullsized":"2024-09-12T01:05:05.989566+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'468","last_scrub_stamp":"2024-09-12T01:05:05.989382+0000","last_deep_scrub":"268'468","last_deep_scrub_stamp":"2024-09-12T01:05:05.989382+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.989382+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:40.188563+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2433,"num_read_kb":2274,"num_write":552,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'349","reported_seq":981,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.673096+0000","last_change":"2024-09-12T01:04:50.673096+0000","last_active":"2024-09-12T01:04:50.673096+0000","last_peered":"2024-09-12T01:04:50.673096+0000","last_clean":"2024-09-12T01:04:50.673096+0000","last_became_active":"2024-09-12T00:18:22.871980+0000","last_became_peered":"2024-09-12T00:18:22.871980+0000","last_unstale":"2024-09-12T01:04:50.673096+0000","last_undegraded":"2024-09-12T01:04:50.673096+0000","last_fullsized":"2024-09-12T01:04:50.673096+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'349","last_scrub_stamp":"2024-09-12T01:04:50.672877+0000","last_deep_scrub":"268'349","last_deep_scrub_stamp":"2024-09-12T01:04:50.672877+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.672877+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:51.786132+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":467,"num_read_kb":12975,"num_write":1116,"num_write_kb":44636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'441","reported_seq":2039,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.710518+0000","last_change":"2024-09-12T01:04:58.710518+0000","last_active":"2024-09-12T01:04:58.710518+0000","last_peered":"2024-09-12T01:04:58.710518+0000","last_clean":"2024-09-12T01:04:58.710518+0000","last_became_active":"2024-09-12T00:18:24.857010+0000","last_became_peered":"2024-09-12T00:18:24.857010+0000","last_unstale":"2024-09-12T01:04:58.710518+0000","last_undegraded":"2024-09-12T01:04:58.710518+0000","last_fullsized":"2024-09-12T01:04:58.710518+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'441","last_scrub_stamp":"2024-09-12T01:04:58.710296+0000","last_deep_scrub":"268'441","last_deep_scrub_stamp":"2024-09-12T01:04:58.710296+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.710296+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:49.317345+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2477,"num_read_kb":2332,"num_write":519,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1335,"num_omap_keys":6,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'383","reported_seq":1019,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.244074+0000","last_change":"2024-09-12T01:04:53.244074+0000","last_active":"2024-09-12T01:04:53.244074+0000","last_peered":"2024-09-12T01:04:53.244074+0000","last_clean":"2024-09-12T01:04:53.244074+0000","last_became_active":"2024-09-12T00:18:22.857468+0000","last_became_peered":"2024-09-12T00:18:22.857468+0000","last_unstale":"2024-09-12T01:04:53.244074+0000","last_undegraded":"2024-09-12T01:04:53.244074+0000","last_fullsized":"2024-09-12T01:04:53.244074+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'383","last_scrub_stamp":"2024-09-12T01:04:53.243865+0000","last_deep_scrub":"268'383","last_deep_scrub_stamp":"2024-09-12T01:04:53.243865+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.243865+0000","objects_scrubbed":11,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:00.400260+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375108,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":489,"num_read_kb":4433,"num_write":1123,"num_write_kb":23710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"268'835","reported_seq":2454,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.301201+0000","last_change":"2024-09-12T01:04:59.301066+0000","last_active":"2024-09-12T01:04:59.301201+0000","last_peered":"2024-09-12T01:04:59.301201+0000","last_clean":"2024-09-12T01:04:59.301201+0000","last_became_active":"2024-09-12T00:18:24.857438+0000","last_became_peered":"2024-09-12T00:18:24.857438+0000","last_unstale":"2024-09-12T01:04:59.301201+0000","last_undegraded":"2024-09-12T01:04:59.301201+0000","last_fullsized":"2024-09-12T01:04:59.301201+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'835","last_scrub_stamp":"2024-09-12T01:04:59.300882+0000","last_deep_scrub":"268'835","last_deep_scrub_stamp":"2024-09-12T01:04:59.300882+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.300882+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:06.256923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3858,"num_read_kb":3490,"num_write":1078,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'394","reported_seq":1017,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.550846+0000","last_change":"2024-09-12T01:04:54.550846+0000","last_active":"2024-09-12T01:04:54.550846+0000","last_peered":"2024-09-12T01:04:54.550846+0000","last_clean":"2024-09-12T01:04:54.550846+0000","last_became_active":"2024-09-12T00:18:22.858851+0000","last_became_peered":"2024-09-12T00:18:22.858851+0000","last_unstale":"2024-09-12T01:04:54.550846+0000","last_undegraded":"2024-09-12T01:04:54.550846+0000","last_fullsized":"2024-09-12T01:04:54.550846+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'394","last_scrub_stamp":"2024-09-12T01:04:54.550600+0000","last_deep_scrub":"268'394","last_deep_scrub_stamp":"2024-09-12T01:04:54.550600+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.550600+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:21.777404+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1250253,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":485,"num_read_kb":6084,"num_write":1107,"num_write_kb":43198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'1190","reported_seq":2708,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.212545+0000","last_change":"2024-09-12T01:05:03.212330+0000","last_active":"2024-09-12T01:05:03.212545+0000","last_peered":"2024-09-12T01:05:03.212545+0000","last_clean":"2024-09-12T01:05:03.212545+0000","last_became_active":"2024-09-12T00:18:24.856121+0000","last_became_peered":"2024-09-12T00:18:24.856121+0000","last_unstale":"2024-09-12T01:05:03.212545+0000","last_undegraded":"2024-09-12T01:05:03.212545+0000","last_fullsized":"2024-09-12T01:05:03.212545+0000","mapping_epoch":26,"log_start":"268'1100","ondisk_log_start":"268'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1190","last_scrub_stamp":"2024-09-12T01:05:03.212083+0000","last_deep_scrub":"268'1190","last_deep_scrub_stamp":"2024-09-12T01:05:03.212083+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.212083+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":1100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:31.434280+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5211,"num_read_kb":4574,"num_write":1611,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'359","reported_seq":1114,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.207192+0000","last_change":"2024-09-12T01:04:55.207192+0000","last_active":"2024-09-12T01:04:55.207192+0000","last_peered":"2024-09-12T01:04:55.207192+0000","last_clean":"2024-09-12T01:04:55.207192+0000","last_became_active":"2024-09-12T00:18:22.857806+0000","last_became_peered":"2024-09-12T00:18:22.857806+0000","last_unstale":"2024-09-12T01:04:55.207192+0000","last_undegraded":"2024-09-12T01:04:55.207192+0000","last_fullsized":"2024-09-12T01:04:55.207192+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'359","last_scrub_stamp":"2024-09-12T01:04:55.206986+0000","last_deep_scrub":"268'359","last_deep_scrub_stamp":"2024-09-12T01:04:55.206986+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.206986+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:18.410646+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":676,"num_read_kb":44063,"num_write":1212,"num_write_kb":47646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"268'827","reported_seq":2380,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.485146+0000","last_change":"2024-09-12T01:04:53.485146+0000","last_active":"2024-09-12T01:04:53.485146+0000","last_peered":"2024-09-12T01:04:53.485146+0000","last_clean":"2024-09-12T01:04:53.485146+0000","last_became_active":"2024-09-12T00:18:24.856616+0000","last_became_peered":"2024-09-12T00:18:24.856616+0000","last_unstale":"2024-09-12T01:04:53.485146+0000","last_undegraded":"2024-09-12T01:04:53.485146+0000","last_fullsized":"2024-09-12T01:04:53.485146+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'827","last_scrub_stamp":"2024-09-12T01:04:53.484958+0000","last_deep_scrub":"268'827","last_deep_scrub_stamp":"2024-09-12T01:04:53.484958+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.484958+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:30.113138+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3862,"num_read_kb":3471,"num_write":1076,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'393","reported_seq":1172,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.519626+0000","last_change":"2024-09-12T01:04:56.519626+0000","last_active":"2024-09-12T01:04:56.519626+0000","last_peered":"2024-09-12T01:04:56.519626+0000","last_clean":"2024-09-12T01:04:56.519626+0000","last_became_active":"2024-09-12T00:18:22.873756+0000","last_became_peered":"2024-09-12T00:18:22.873756+0000","last_unstale":"2024-09-12T01:04:56.519626+0000","last_undegraded":"2024-09-12T01:04:56.519626+0000","last_fullsized":"2024-09-12T01:04:56.519626+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'393","last_scrub_stamp":"2024-09-12T01:04:56.519399+0000","last_deep_scrub":"268'393","last_deep_scrub_stamp":"2024-09-12T01:04:56.519399+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.519399+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:26.788844+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263200,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":909,"num_read_kb":25128,"num_write":1275,"num_write_kb":39639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'1581","reported_seq":3280,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.237198+0000","last_change":"2024-09-12T01:05:02.237198+0000","last_active":"2024-09-12T01:05:02.237198+0000","last_peered":"2024-09-12T01:05:02.237198+0000","last_clean":"2024-09-12T01:05:02.237198+0000","last_became_active":"2024-09-12T00:18:24.882937+0000","last_became_peered":"2024-09-12T00:18:24.882937+0000","last_unstale":"2024-09-12T01:05:02.237198+0000","last_undegraded":"2024-09-12T01:05:02.237198+0000","last_fullsized":"2024-09-12T01:05:02.237198+0000","mapping_epoch":26,"log_start":"268'1500","ondisk_log_start":"268'1500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1581","last_scrub_stamp":"2024-09-12T01:05:02.237002+0000","last_deep_scrub":"268'1581","last_deep_scrub_stamp":"2024-09-12T01:05:02.237002+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.237002+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":1500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:39.333011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7111,"num_read_kb":6230,"num_write":2206,"num_write_kb":938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'438","reported_seq":1176,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.200968+0000","last_change":"2024-09-12T01:04:51.200968+0000","last_active":"2024-09-12T01:04:51.200968+0000","last_peered":"2024-09-12T01:04:51.200968+0000","last_clean":"2024-09-12T01:04:51.200968+0000","last_became_active":"2024-09-12T00:18:22.869527+0000","last_became_peered":"2024-09-12T00:18:22.869527+0000","last_unstale":"2024-09-12T01:04:51.200968+0000","last_undegraded":"2024-09-12T01:04:51.200968+0000","last_fullsized":"2024-09-12T01:04:51.200968+0000","mapping_epoch":24,"log_start":"268'400","ondisk_log_start":"268'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'438","last_scrub_stamp":"2024-09-12T01:04:51.200755+0000","last_deep_scrub":"268'438","last_deep_scrub_stamp":"2024-09-12T01:04:51.200755+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.200755+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:55.971651+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262232,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":772,"num_read_kb":72891,"num_write":1443,"num_write_kb":29040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'772","reported_seq":2186,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.491449+0000","last_change":"2024-09-12T01:05:00.491449+0000","last_active":"2024-09-12T01:05:00.491449+0000","last_peered":"2024-09-12T01:05:00.491449+0000","last_clean":"2024-09-12T01:05:00.491449+0000","last_became_active":"2024-09-12T00:18:24.866062+0000","last_became_peered":"2024-09-12T00:18:24.866062+0000","last_unstale":"2024-09-12T01:05:00.491449+0000","last_undegraded":"2024-09-12T01:05:00.491449+0000","last_fullsized":"2024-09-12T01:05:00.491449+0000","mapping_epoch":26,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'772","last_scrub_stamp":"2024-09-12T01:05:00.491269+0000","last_deep_scrub":"268'772","last_deep_scrub_stamp":"2024-09-12T01:05:00.491269+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.491269+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:14.226037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3587,"num_read_kb":3210,"num_write":1032,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'376","reported_seq":1065,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.767471+0000","last_change":"2024-09-12T01:04:55.767471+0000","last_active":"2024-09-12T01:04:55.767471+0000","last_peered":"2024-09-12T01:04:55.767471+0000","last_clean":"2024-09-12T01:04:55.767471+0000","last_became_active":"2024-09-12T00:18:22.858141+0000","last_became_peered":"2024-09-12T00:18:22.858141+0000","last_unstale":"2024-09-12T01:04:55.767471+0000","last_undegraded":"2024-09-12T01:04:55.767471+0000","last_fullsized":"2024-09-12T01:04:55.767471+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'376","last_scrub_stamp":"2024-09-12T01:04:55.767266+0000","last_deep_scrub":"268'376","last_deep_scrub_stamp":"2024-09-12T01:04:55.767266+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.767266+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:24.248670+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":648,"num_read_kb":25195,"num_write":1350,"num_write_kb":34646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'1220","reported_seq":3129,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.335747+0000","last_change":"2024-09-12T01:05:00.335747+0000","last_active":"2024-09-12T01:05:00.335747+0000","last_peered":"2024-09-12T01:05:00.335747+0000","last_clean":"2024-09-12T01:05:00.335747+0000","last_became_active":"2024-09-12T00:18:24.859973+0000","last_became_peered":"2024-09-12T00:18:24.859973+0000","last_unstale":"2024-09-12T01:05:00.335747+0000","last_undegraded":"2024-09-12T01:05:00.335747+0000","last_fullsized":"2024-09-12T01:05:00.335747+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1220","last_scrub_stamp":"2024-09-12T01:05:00.335499+0000","last_deep_scrub":"268'1220","last_deep_scrub_stamp":"2024-09-12T01:05:00.335499+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.335499+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":1200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:36.786041+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5984,"num_read_kb":5306,"num_write":1779,"num_write_kb":823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'360","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.565625+0000","last_change":"2024-09-12T01:04:53.565625+0000","last_active":"2024-09-12T01:04:53.565625+0000","last_peered":"2024-09-12T01:04:53.565625+0000","last_clean":"2024-09-12T01:04:53.565625+0000","last_became_active":"2024-09-12T00:18:55.951826+0000","last_became_peered":"2024-09-12T00:18:55.951826+0000","last_unstale":"2024-09-12T01:04:53.565625+0000","last_undegraded":"2024-09-12T01:04:53.565625+0000","last_fullsized":"2024-09-12T01:04:53.565625+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'360","last_scrub_stamp":"2024-09-12T01:04:53.565426+0000","last_deep_scrub":"268'360","last_deep_scrub_stamp":"2024-09-12T01:04:53.565426+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.565426+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:24.959465+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":11605,"num_write":1081,"num_write_kb":32221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"268'542","reported_seq":2018,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:07.016136+0000","last_change":"2024-09-12T01:05:07.016136+0000","last_active":"2024-09-12T01:05:07.016136+0000","last_peered":"2024-09-12T01:05:07.016136+0000","last_clean":"2024-09-12T01:05:07.016136+0000","last_became_active":"2024-09-12T00:18:24.849540+0000","last_became_peered":"2024-09-12T00:18:24.849540+0000","last_unstale":"2024-09-12T01:05:07.016136+0000","last_undegraded":"2024-09-12T01:05:07.016136+0000","last_fullsized":"2024-09-12T01:05:07.016136+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'542","last_scrub_stamp":"2024-09-12T01:05:07.015941+0000","last_deep_scrub":"268'542","last_deep_scrub_stamp":"2024-09-12T01:05:07.015941+0000","last_clean_scrub_stamp":"2024-09-12T01:05:07.015941+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:39.395014+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2717,"num_read_kb":2465,"num_write":714,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":489,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'362","reported_seq":1065,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.471347+0000","last_change":"2024-09-12T01:04:49.471154+0000","last_active":"2024-09-12T01:04:49.471347+0000","last_peered":"2024-09-12T01:04:49.471347+0000","last_clean":"2024-09-12T01:04:49.471347+0000","last_became_active":"2024-09-12T00:18:22.834527+0000","last_became_peered":"2024-09-12T00:18:22.834527+0000","last_unstale":"2024-09-12T01:04:49.471347+0000","last_undegraded":"2024-09-12T01:04:49.471347+0000","last_fullsized":"2024-09-12T01:04:49.471347+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'362","last_scrub_stamp":"2024-09-12T01:04:49.470959+0000","last_deep_scrub":"268'362","last_deep_scrub_stamp":"2024-09-12T01:04:49.470959+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.470959+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:03.324964+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":663,"num_read_kb":13548,"num_write":1359,"num_write_kb":27172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'352","reported_seq":1714,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.449859+0000","last_change":"2024-09-12T01:05:01.449859+0000","last_active":"2024-09-12T01:05:01.449859+0000","last_peered":"2024-09-12T01:05:01.449859+0000","last_clean":"2024-09-12T01:05:01.449859+0000","last_became_active":"2024-09-12T00:18:24.870016+0000","last_became_peered":"2024-09-12T00:18:24.870016+0000","last_unstale":"2024-09-12T01:05:01.449859+0000","last_undegraded":"2024-09-12T01:05:01.449859+0000","last_fullsized":"2024-09-12T01:05:01.449859+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'352","last_scrub_stamp":"2024-09-12T01:05:01.449680+0000","last_deep_scrub":"268'352","last_deep_scrub_stamp":"2024-09-12T01:05:01.449680+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.449680+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:14.081003+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1783,"num_read_kb":1704,"num_write":384,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'333","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.528182+0000","last_change":"2024-09-12T01:04:55.528002+0000","last_active":"2024-09-12T01:04:55.528182+0000","last_peered":"2024-09-12T01:04:55.528182+0000","last_clean":"2024-09-12T01:04:55.528182+0000","last_became_active":"2024-09-12T00:18:22.883246+0000","last_became_peered":"2024-09-12T00:18:22.883246+0000","last_unstale":"2024-09-12T01:04:55.528182+0000","last_undegraded":"2024-09-12T01:04:55.528182+0000","last_fullsized":"2024-09-12T01:04:55.528182+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'333","last_scrub_stamp":"2024-09-12T01:04:55.527813+0000","last_deep_scrub":"268'333","last_deep_scrub_stamp":"2024-09-12T01:04:55.527813+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.527813+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:47.812183+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2790244,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":500,"num_read_kb":42045,"num_write":1101,"num_write_kb":34022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'382","reported_seq":1058,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.522637+0000","last_change":"2024-09-12T01:04:57.522370+0000","last_active":"2024-09-12T01:04:57.522637+0000","last_peered":"2024-09-12T01:04:57.522637+0000","last_clean":"2024-09-12T01:04:57.522637+0000","last_became_active":"2024-09-12T00:18:22.857072+0000","last_became_peered":"2024-09-12T00:18:22.857072+0000","last_unstale":"2024-09-12T01:04:57.522637+0000","last_undegraded":"2024-09-12T01:04:57.522637+0000","last_fullsized":"2024-09-12T01:04:57.522637+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'382","last_scrub_stamp":"2024-09-12T01:04:57.522162+0000","last_deep_scrub":"268'382","last_deep_scrub_stamp":"2024-09-12T01:04:57.522162+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.522162+0000","objects_scrubbed":10,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:55.368704+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525411,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":546,"num_read_kb":42645,"num_write":1246,"num_write_kb":40559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'478","reported_seq":2186,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.337968+0000","last_change":"2024-09-12T01:05:01.337968+0000","last_active":"2024-09-12T01:05:01.337968+0000","last_peered":"2024-09-12T01:05:01.337968+0000","last_clean":"2024-09-12T01:05:01.337968+0000","last_became_active":"2024-09-12T00:18:24.866883+0000","last_became_peered":"2024-09-12T00:18:24.866883+0000","last_unstale":"2024-09-12T01:05:01.337968+0000","last_undegraded":"2024-09-12T01:05:01.337968+0000","last_fullsized":"2024-09-12T01:05:01.337968+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'478","last_scrub_stamp":"2024-09-12T01:05:01.337648+0000","last_deep_scrub":"268'478","last_deep_scrub_stamp":"2024-09-12T01:05:01.337648+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.337648+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:51.544486+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2661,"num_read_kb":2525,"num_write":544,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'456","reported_seq":1192,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.550977+0000","last_change":"2024-09-12T01:04:51.550695+0000","last_active":"2024-09-12T01:04:51.550977+0000","last_peered":"2024-09-12T01:04:51.550977+0000","last_clean":"2024-09-12T01:04:51.550977+0000","last_became_active":"2024-09-12T00:18:22.858176+0000","last_became_peered":"2024-09-12T00:18:22.858176+0000","last_unstale":"2024-09-12T01:04:51.550977+0000","last_undegraded":"2024-09-12T01:04:51.550977+0000","last_fullsized":"2024-09-12T01:04:51.550977+0000","mapping_epoch":24,"log_start":"268'400","ondisk_log_start":"268'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'456","last_scrub_stamp":"2024-09-12T01:04:51.550461+0000","last_deep_scrub":"268'456","last_deep_scrub_stamp":"2024-09-12T01:04:51.550461+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.550461+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:00.070041+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493507,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":841,"num_read_kb":63084,"num_write":1253,"num_write_kb":30414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'808","reported_seq":2413,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.507308+0000","last_change":"2024-09-12T01:05:04.507308+0000","last_active":"2024-09-12T01:05:04.507308+0000","last_peered":"2024-09-12T01:05:04.507308+0000","last_clean":"2024-09-12T01:05:04.507308+0000","last_became_active":"2024-09-12T00:18:24.855524+0000","last_became_peered":"2024-09-12T00:18:24.855524+0000","last_unstale":"2024-09-12T01:05:04.507308+0000","last_undegraded":"2024-09-12T01:05:04.507308+0000","last_fullsized":"2024-09-12T01:05:04.507308+0000","mapping_epoch":26,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'808","last_scrub_stamp":"2024-09-12T01:05:04.507124+0000","last_deep_scrub":"268'808","last_deep_scrub_stamp":"2024-09-12T01:05:04.507124+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.507124+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:08.739902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3793,"num_read_kb":3425,"num_write":1052,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6125,"num_read_kb":4422,"num_write":1992,"num_write_kb":889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5969,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":965,"ondisk_log_size":965,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15018,"num_read_kb":14677,"num_write":16721,"num_write_kb":4879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1838,"ondisk_log_size":1838,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1590876,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":17701,"num_read_kb":37057,"num_write":14791,"num_write_kb":11631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":675540,"num_omap_keys":1570,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1929,"ondisk_log_size":1929,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212220,"num_read_kb":193790,"num_write":55147,"num_write_kb":18721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43028,"num_omap_keys":175,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3939,"ondisk_log_size":3939,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":67372279,"num_objects":368,"num_object_clones":0,"num_object_copies":736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":368,"num_whiteouts":0,"num_read":36285,"num_read_kb":1921539,"num_write":72266,"num_write_kb":2133559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":135979008,"data_stored":134744558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3853,"ondisk_log_size":3853,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":193499,"num_write":190,"num_write_kb":135054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":193436,"num_write":190,"num_write_kb":135054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510015,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":288164,"kb_used_data":14036,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94083676,"statfs":{"total":96636764160,"available":96341684224,"internally_reserved":0,"allocated":14372864,"data_stored":12670188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510014,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249776,"kb_used_data":20064,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94122064,"statfs":{"total":96636764160,"available":96380993536,"internally_reserved":0,"allocated":20545536,"data_stored":18946545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":235207113},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510014,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":157332,"kb_used_data":27652,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94214508,"statfs":{"total":96636764160,"available":96475656192,"internally_reserved":0,"allocated":28315648,"data_stored":26521673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510015,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111496,"kb_used_data":26168,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94260344,"statfs":{"total":96636764160,"available":96522592256,"internally_reserved":0,"allocated":26796032,"data_stored":25204103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542719,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":288260,"kb_used_data":28020,"kb_used_omap":1,"kb_used_meta":260222,"kb_avail":94083580,"statfs":{"total":96636764160,"available":96341585920,"internally_reserved":0,"allocated":28692480,"data_stored":26984275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":266467783},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542717,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":97864,"kb_used_data":12600,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94273976,"statfs":{"total":96636764160,"available":96536551424,"internally_reserved":0,"allocated":12902400,"data_stored":11301467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542718,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148312,"kb_used_data":8904,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94223528,"statfs":{"total":96636764160,"available":96484892672,"internally_reserved":0,"allocated":9117696,"data_stored":7484684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542719,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255332,"kb_used_data":25620,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94116508,"statfs":{"total":96636764160,"available":96375304192,"internally_reserved":0,"allocated":26234880,"data_stored":24489485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21905408,"data_stored":21688322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5402624,"data_stored":5276127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9211904,"data_stored":9091208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24948736,"data_stored":24773620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":23130112,"data_stored":22997083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24514560,"data_stored":24310448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16838656,"data_stored":16736762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10027008,"data_stored":9870988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":5044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":5163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:05:29.243 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.243 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.243 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.243 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.244 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.244 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.244 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.244 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.244 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.244 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.244 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.244 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.245 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.245 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.245 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.245 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.245 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.245 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.245 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.245 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.246 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.246 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.246 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.246 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.246 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.246 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.246 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.246 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.247 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.247 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.247 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.247 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.247 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.247 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.247 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.247 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.248 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.248 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.248 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.248 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.248 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.248 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.248 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.248 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.249 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.249 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.249 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.249 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.249 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.249 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.249 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.250 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.250 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.250 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.250 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.250 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.250 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.250 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.250 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:33:09.799826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=33, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.251 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.251 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.251 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.251 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.251 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.251 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.251 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.251 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.252 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.252 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.252 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.252 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:34:51.133313+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.252 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.252 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.252 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.253 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.253 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:34:54.170452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=34, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.255 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.255 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:18:31.857529+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=18, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:29.256 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:05:49.258 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:05:49.628 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:05:49.640 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-12T01:05:49.648 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":1694,"stamp":"2024-09-12T01:05:48.079239+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":69570780,"num_objects":858,"num_object_clones":0,"num_object_copies":1716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":858,"num_whiteouts":0,"num_read":290173,"num_read_kb":2561350,"num_write":161440,"num_write_kb":2441443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":728169,"num_omap_keys":1784,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13298,"ondisk_log_size":13298,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1596536,"kb_used_data":163064,"kb_used_omap":12,"kb_used_meta":1433331,"kb_avail":753378184,"statfs":{"total":773094113280,"available":771459260416,"internally_reserved":0,"allocated":166977536,"data_stored":153602420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1467731507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":564,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007906"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:34.479967+0000","last_change":"2024-09-12T01:05:34.479967+0000","last_active":"2024-09-12T01:05:34.479967+0000","last_peered":"2024-09-12T01:05:34.479967+0000","last_clean":"2024-09-12T01:05:34.479967+0000","last_became_active":"2024-09-12T00:46:09.506992+0000","last_became_peered":"2024-09-12T00:46:09.506992+0000","last_unstale":"2024-09-12T01:05:34.479967+0000","last_undegraded":"2024-09-12T01:05:34.479967+0000","last_fullsized":"2024-09-12T01:05:34.479967+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:34.479760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:34.479760+0000","last_clean_scrub_stamp":"2024-09-12T01:05:34.479760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:52.009439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"265'8","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:31.434832+0000","last_change":"2024-09-12T01:05:31.434832+0000","last_active":"2024-09-12T01:05:31.434832+0000","last_peered":"2024-09-12T01:05:31.434832+0000","last_clean":"2024-09-12T01:05:31.434832+0000","last_became_active":"2024-09-12T00:34:55.236531+0000","last_became_peered":"2024-09-12T00:34:55.236531+0000","last_unstale":"2024-09-12T01:05:31.434832+0000","last_undegraded":"2024-09-12T01:05:31.434832+0000","last_fullsized":"2024-09-12T01:05:31.434832+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T01:05:31.434639+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T01:05:31.434639+0000","last_clean_scrub_stamp":"2024-09-12T01:05:31.434639+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:10.341415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"268'4","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:34.056760+0000","last_change":"2024-09-12T01:05:34.056760+0000","last_active":"2024-09-12T01:05:34.056760+0000","last_peered":"2024-09-12T01:05:34.056760+0000","last_clean":"2024-09-12T01:05:34.056760+0000","last_became_active":"2024-09-12T00:34:52.171918+0000","last_became_peered":"2024-09-12T00:34:52.171918+0000","last_unstale":"2024-09-12T01:05:34.056760+0000","last_undegraded":"2024-09-12T01:05:34.056760+0000","last_fullsized":"2024-09-12T01:05:34.056760+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:05:34.056579+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:05:34.056579+0000","last_clean_scrub_stamp":"2024-09-12T01:05:34.056579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:48.083105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4100,"num_write":4,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'30","reported_seq":138,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:30.020115+0000","last_change":"2024-09-12T01:05:30.020115+0000","last_active":"2024-09-12T01:05:30.020115+0000","last_peered":"2024-09-12T01:05:30.020115+0000","last_clean":"2024-09-12T01:05:30.020115+0000","last_became_active":"2024-09-12T00:33:10.848975+0000","last_became_peered":"2024-09-12T00:33:10.848975+0000","last_unstale":"2024-09-12T01:05:30.020115+0000","last_undegraded":"2024-09-12T01:05:30.020115+0000","last_fullsized":"2024-09-12T01:05:30.020115+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'30","last_scrub_stamp":"2024-09-12T01:05:30.019918+0000","last_deep_scrub":"268'30","last_deep_scrub_stamp":"2024-09-12T01:05:30.019918+0000","last_clean_scrub_stamp":"2024-09-12T01:05:30.019918+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:05.712091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":60,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:16.465361+0000","last_change":"2024-09-12T01:05:16.465361+0000","last_active":"2024-09-12T01:05:16.465361+0000","last_peered":"2024-09-12T01:05:16.465361+0000","last_clean":"2024-09-12T01:05:16.465361+0000","last_became_active":"2024-09-12T00:46:09.509800+0000","last_became_peered":"2024-09-12T00:46:09.509800+0000","last_unstale":"2024-09-12T01:05:16.465361+0000","last_undegraded":"2024-09-12T01:05:16.465361+0000","last_fullsized":"2024-09-12T01:05:16.465361+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:16.465170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:16.465170+0000","last_clean_scrub_stamp":"2024-09-12T01:05:16.465170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:15.986937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'7","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:35.187623+0000","last_change":"2024-09-12T01:05:35.187623+0000","last_active":"2024-09-12T01:05:35.187623+0000","last_peered":"2024-09-12T01:05:35.187623+0000","last_clean":"2024-09-12T01:05:35.187623+0000","last_became_active":"2024-09-12T00:34:55.232607+0000","last_became_peered":"2024-09-12T00:34:55.232607+0000","last_unstale":"2024-09-12T01:05:35.187623+0000","last_undegraded":"2024-09-12T01:05:35.187623+0000","last_fullsized":"2024-09-12T01:05:35.187623+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-12T01:05:35.187444+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-12T01:05:35.187444+0000","last_clean_scrub_stamp":"2024-09-12T01:05:35.187444+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:08.369969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"268'2","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.536885+0000","last_change":"2024-09-12T01:05:20.536885+0000","last_active":"2024-09-12T01:05:20.536885+0000","last_peered":"2024-09-12T01:05:20.536885+0000","last_clean":"2024-09-12T01:05:20.536885+0000","last_became_active":"2024-09-12T00:34:52.210935+0000","last_became_peered":"2024-09-12T00:34:52.210935+0000","last_unstale":"2024-09-12T01:05:20.536885+0000","last_undegraded":"2024-09-12T01:05:20.536885+0000","last_fullsized":"2024-09-12T01:05:20.536885+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:20.536676+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:20.536676+0000","last_clean_scrub_stamp":"2024-09-12T01:05:20.536676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:56.161540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'30","reported_seq":139,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:08.468289+0000","last_change":"2024-09-12T01:05:08.468010+0000","last_active":"2024-09-12T01:05:08.468289+0000","last_peered":"2024-09-12T01:05:08.468289+0000","last_clean":"2024-09-12T01:05:08.468289+0000","last_became_active":"2024-09-12T00:33:10.851334+0000","last_became_peered":"2024-09-12T00:33:10.851334+0000","last_unstale":"2024-09-12T01:05:08.468289+0000","last_undegraded":"2024-09-12T01:05:08.468289+0000","last_fullsized":"2024-09-12T01:05:08.468289+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'30","last_scrub_stamp":"2024-09-12T01:05:08.467746+0000","last_deep_scrub":"268'30","last_deep_scrub_stamp":"2024-09-12T01:05:08.467746+0000","last_clean_scrub_stamp":"2024-09-12T01:05:08.467746+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:53.379179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":55,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:24.887158+0000","last_change":"2024-09-12T01:05:24.886923+0000","last_active":"2024-09-12T01:05:24.887158+0000","last_peered":"2024-09-12T01:05:24.887158+0000","last_clean":"2024-09-12T01:05:24.887158+0000","last_became_active":"2024-09-12T00:46:09.507324+0000","last_became_peered":"2024-09-12T00:46:09.507324+0000","last_unstale":"2024-09-12T01:05:24.887158+0000","last_undegraded":"2024-09-12T01:05:24.887158+0000","last_fullsized":"2024-09-12T01:05:24.887158+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:24.886644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:24.886644+0000","last_clean_scrub_stamp":"2024-09-12T01:05:24.886644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:27.230356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"268'2","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:36.078946+0000","last_change":"2024-09-12T01:05:36.078946+0000","last_active":"2024-09-12T01:05:36.078946+0000","last_peered":"2024-09-12T01:05:36.078946+0000","last_clean":"2024-09-12T01:05:36.078946+0000","last_became_active":"2024-09-12T00:34:55.252880+0000","last_became_peered":"2024-09-12T00:34:55.252880+0000","last_unstale":"2024-09-12T01:05:36.078946+0000","last_undegraded":"2024-09-12T01:05:36.078946+0000","last_fullsized":"2024-09-12T01:05:36.078946+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:36.078772+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:36.078772+0000","last_clean_scrub_stamp":"2024-09-12T01:05:36.078772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:46.949241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"268'2","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.410136+0000","last_change":"2024-09-12T01:05:13.410136+0000","last_active":"2024-09-12T01:05:13.410136+0000","last_peered":"2024-09-12T01:05:13.410136+0000","last_clean":"2024-09-12T01:05:13.410136+0000","last_became_active":"2024-09-12T00:34:52.195513+0000","last_became_peered":"2024-09-12T00:34:52.195513+0000","last_unstale":"2024-09-12T01:05:13.410136+0000","last_undegraded":"2024-09-12T01:05:13.410136+0000","last_fullsized":"2024-09-12T01:05:13.410136+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:13.409950+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:13.409950+0000","last_clean_scrub_stamp":"2024-09-12T01:05:13.409950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:56.054807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'20","reported_seq":108,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:40.991879+0000","last_change":"2024-09-12T01:05:40.991624+0000","last_active":"2024-09-12T01:05:40.991879+0000","last_peered":"2024-09-12T01:05:40.991879+0000","last_clean":"2024-09-12T01:05:40.991879+0000","last_became_active":"2024-09-12T00:33:10.847432+0000","last_became_peered":"2024-09-12T00:33:10.847432+0000","last_unstale":"2024-09-12T01:05:40.991879+0000","last_undegraded":"2024-09-12T01:05:40.991879+0000","last_fullsized":"2024-09-12T01:05:40.991879+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'20","last_scrub_stamp":"2024-09-12T01:05:40.991339+0000","last_deep_scrub":"268'20","last_deep_scrub_stamp":"2024-09-12T01:05:40.991339+0000","last_clean_scrub_stamp":"2024-09-12T01:05:40.991339+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:51.254375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":67,"num_write":46,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.774453+0000","last_change":"2024-09-12T00:46:09.497586+0000","last_active":"2024-09-12T01:03:11.774453+0000","last_peered":"2024-09-12T01:03:11.774453+0000","last_clean":"2024-09-12T01:03:11.774453+0000","last_became_active":"2024-09-12T00:46:09.496807+0000","last_became_peered":"2024-09-12T00:46:09.496807+0000","last_unstale":"2024-09-12T01:03:11.774453+0000","last_undegraded":"2024-09-12T01:03:11.774453+0000","last_fullsized":"2024-09-12T01:03:11.774453+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:45.019195+0000","last_change":"2024-09-12T01:05:45.019195+0000","last_active":"2024-09-12T01:05:45.019195+0000","last_peered":"2024-09-12T01:05:45.019195+0000","last_clean":"2024-09-12T01:05:45.019195+0000","last_became_active":"2024-09-12T00:34:55.248058+0000","last_became_peered":"2024-09-12T00:34:55.248058+0000","last_unstale":"2024-09-12T01:05:45.019195+0000","last_undegraded":"2024-09-12T01:05:45.019195+0000","last_fullsized":"2024-09-12T01:05:45.019195+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:45.019013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:45.019013+0000","last_clean_scrub_stamp":"2024-09-12T01:05:45.019013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:57.709160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"268'8","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:33.227640+0000","last_change":"2024-09-12T01:05:33.227640+0000","last_active":"2024-09-12T01:05:33.227640+0000","last_peered":"2024-09-12T01:05:33.227640+0000","last_clean":"2024-09-12T01:05:33.227640+0000","last_became_active":"2024-09-12T00:34:52.170013+0000","last_became_peered":"2024-09-12T00:34:52.170013+0000","last_unstale":"2024-09-12T01:05:33.227640+0000","last_undegraded":"2024-09-12T01:05:33.227640+0000","last_fullsized":"2024-09-12T01:05:33.227640+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-12T01:05:33.227458+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-12T01:05:33.227458+0000","last_clean_scrub_stamp":"2024-09-12T01:05:33.227458+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:57.287267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10242,"num_write":8,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'17","reported_seq":97,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:33.037835+0000","last_change":"2024-09-12T01:05:33.037699+0000","last_active":"2024-09-12T01:05:33.037835+0000","last_peered":"2024-09-12T01:05:33.037835+0000","last_clean":"2024-09-12T01:05:33.037835+0000","last_became_active":"2024-09-12T00:33:10.839248+0000","last_became_peered":"2024-09-12T00:33:10.839248+0000","last_unstale":"2024-09-12T01:05:33.037835+0000","last_undegraded":"2024-09-12T01:05:33.037835+0000","last_fullsized":"2024-09-12T01:05:33.037835+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'17","last_scrub_stamp":"2024-09-12T01:05:33.037511+0000","last_deep_scrub":"268'17","last_deep_scrub_stamp":"2024-09-12T01:05:33.037511+0000","last_clean_scrub_stamp":"2024-09-12T01:05:33.037511+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:25.147656+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":49,"num_write":38,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:16.761099+0000","last_change":"2024-09-12T00:46:09.501613+0000","last_active":"2024-09-12T01:02:16.761099+0000","last_peered":"2024-09-12T01:02:16.761099+0000","last_clean":"2024-09-12T01:02:16.761099+0000","last_became_active":"2024-09-12T00:46:09.499830+0000","last_became_peered":"2024-09-12T00:46:09.499830+0000","last_unstale":"2024-09-12T01:02:16.761099+0000","last_undegraded":"2024-09-12T01:02:16.761099+0000","last_fullsized":"2024-09-12T01:02:16.761099+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:10.541266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"268'4","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:30.431406+0000","last_change":"2024-09-12T01:05:30.431406+0000","last_active":"2024-09-12T01:05:30.431406+0000","last_peered":"2024-09-12T01:05:30.431406+0000","last_clean":"2024-09-12T01:05:30.431406+0000","last_became_active":"2024-09-12T00:34:55.242012+0000","last_became_peered":"2024-09-12T00:34:55.242012+0000","last_unstale":"2024-09-12T01:05:30.431406+0000","last_undegraded":"2024-09-12T01:05:30.431406+0000","last_fullsized":"2024-09-12T01:05:30.431406+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:05:30.431227+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:05:30.431227+0000","last_clean_scrub_stamp":"2024-09-12T01:05:30.431227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:17.235355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'7","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:32.050224+0000","last_change":"2024-09-12T01:05:32.050224+0000","last_active":"2024-09-12T01:05:32.050224+0000","last_peered":"2024-09-12T01:05:32.050224+0000","last_clean":"2024-09-12T01:05:32.050224+0000","last_became_active":"2024-09-12T00:34:52.205385+0000","last_became_peered":"2024-09-12T00:34:52.205385+0000","last_unstale":"2024-09-12T01:05:32.050224+0000","last_undegraded":"2024-09-12T01:05:32.050224+0000","last_fullsized":"2024-09-12T01:05:32.050224+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-12T01:05:32.049936+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-12T01:05:32.049936+0000","last_clean_scrub_stamp":"2024-09-12T01:05:32.049936+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:14.183635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4098,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'48","reported_seq":181,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:32.074225+0000","last_change":"2024-09-12T01:05:32.073951+0000","last_active":"2024-09-12T01:05:32.074225+0000","last_peered":"2024-09-12T01:05:32.074225+0000","last_clean":"2024-09-12T01:05:32.074225+0000","last_became_active":"2024-09-12T00:33:10.842427+0000","last_became_peered":"2024-09-12T00:33:10.842427+0000","last_unstale":"2024-09-12T01:05:32.074225+0000","last_undegraded":"2024-09-12T01:05:32.074225+0000","last_fullsized":"2024-09-12T01:05:32.074225+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'48","last_scrub_stamp":"2024-09-12T01:05:32.073740+0000","last_deep_scrub":"268'48","last_deep_scrub_stamp":"2024-09-12T01:05:32.073740+0000","last_clean_scrub_stamp":"2024-09-12T01:05:32.073740+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:22.272041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":162,"num_write":92,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:27.472053+0000","last_change":"2024-09-12T01:05:27.472053+0000","last_active":"2024-09-12T01:05:27.472053+0000","last_peered":"2024-09-12T01:05:27.472053+0000","last_clean":"2024-09-12T01:05:27.472053+0000","last_became_active":"2024-09-12T00:46:09.513617+0000","last_became_peered":"2024-09-12T00:46:09.513617+0000","last_unstale":"2024-09-12T01:05:27.472053+0000","last_undegraded":"2024-09-12T01:05:27.472053+0000","last_fullsized":"2024-09-12T01:05:27.472053+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:27.471880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:27.471880+0000","last_clean_scrub_stamp":"2024-09-12T01:05:27.471880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:06.890956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"265'7","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:21.851883+0000","last_change":"2024-09-12T01:05:21.851883+0000","last_active":"2024-09-12T01:05:21.851883+0000","last_peered":"2024-09-12T01:05:21.851883+0000","last_clean":"2024-09-12T01:05:21.851883+0000","last_became_active":"2024-09-12T00:35:57.345894+0000","last_became_peered":"2024-09-12T00:35:57.345894+0000","last_unstale":"2024-09-12T01:05:21.851883+0000","last_undegraded":"2024-09-12T01:05:21.851883+0000","last_fullsized":"2024-09-12T01:05:21.851883+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T01:05:21.851685+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T01:05:21.851685+0000","last_clean_scrub_stamp":"2024-09-12T01:05:21.851685+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:25.738345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"265'2","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.167923+0000","last_change":"2024-09-12T01:05:29.167923+0000","last_active":"2024-09-12T01:05:29.167923+0000","last_peered":"2024-09-12T01:05:29.167923+0000","last_clean":"2024-09-12T01:05:29.167923+0000","last_became_active":"2024-09-12T00:34:52.188352+0000","last_became_peered":"2024-09-12T00:34:52.188352+0000","last_unstale":"2024-09-12T01:05:29.167923+0000","last_undegraded":"2024-09-12T01:05:29.167923+0000","last_fullsized":"2024-09-12T01:05:29.167923+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:05:29.167728+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:05:29.167728+0000","last_clean_scrub_stamp":"2024-09-12T01:05:29.167728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:44.370901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'29","reported_seq":134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:15.790723+0000","last_change":"2024-09-12T01:05:15.790576+0000","last_active":"2024-09-12T01:05:15.790723+0000","last_peered":"2024-09-12T01:05:15.790723+0000","last_clean":"2024-09-12T01:05:15.790723+0000","last_became_active":"2024-09-12T00:33:10.845301+0000","last_became_peered":"2024-09-12T00:33:10.845301+0000","last_unstale":"2024-09-12T01:05:15.790723+0000","last_undegraded":"2024-09-12T01:05:15.790723+0000","last_fullsized":"2024-09-12T01:05:15.790723+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'29","last_scrub_stamp":"2024-09-12T01:05:15.790376+0000","last_deep_scrub":"268'29","last_deep_scrub_stamp":"2024-09-12T01:05:15.790376+0000","last_clean_scrub_stamp":"2024-09-12T01:05:15.790376+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:15.531192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'2","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:43.497951+0000","last_change":"2024-09-12T01:05:43.497951+0000","last_active":"2024-09-12T01:05:43.497951+0000","last_peered":"2024-09-12T01:05:43.497951+0000","last_clean":"2024-09-12T01:05:43.497951+0000","last_became_active":"2024-09-12T00:46:09.498002+0000","last_became_peered":"2024-09-12T00:46:09.498002+0000","last_unstale":"2024-09-12T01:05:43.497951+0000","last_undegraded":"2024-09-12T01:05:43.497951+0000","last_fullsized":"2024-09-12T01:05:43.497951+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:43.497762+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:43.497762+0000","last_clean_scrub_stamp":"2024-09-12T01:05:43.497762+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:22.550990+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:22.873969+0000","last_change":"2024-09-12T01:05:22.873969+0000","last_active":"2024-09-12T01:05:22.873969+0000","last_peered":"2024-09-12T01:05:22.873969+0000","last_clean":"2024-09-12T01:05:22.873969+0000","last_became_active":"2024-09-12T00:34:55.215076+0000","last_became_peered":"2024-09-12T00:34:55.215076+0000","last_unstale":"2024-09-12T01:05:22.873969+0000","last_undegraded":"2024-09-12T01:05:22.873969+0000","last_fullsized":"2024-09-12T01:05:22.873969+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:22.873768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:22.873768+0000","last_clean_scrub_stamp":"2024-09-12T01:05:22.873768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:09.281488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"265'2","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:28.213743+0000","last_change":"2024-09-12T01:05:28.213743+0000","last_active":"2024-09-12T01:05:28.213743+0000","last_peered":"2024-09-12T01:05:28.213743+0000","last_clean":"2024-09-12T01:05:28.213743+0000","last_became_active":"2024-09-12T00:34:52.198548+0000","last_became_peered":"2024-09-12T00:34:52.198548+0000","last_unstale":"2024-09-12T01:05:28.213743+0000","last_undegraded":"2024-09-12T01:05:28.213743+0000","last_fullsized":"2024-09-12T01:05:28.213743+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:05:28.213515+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:05:28.213515+0000","last_clean_scrub_stamp":"2024-09-12T01:05:28.213515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:27.761724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'18","reported_seq":102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:26.037683+0000","last_change":"2024-09-12T01:05:26.037683+0000","last_active":"2024-09-12T01:05:26.037683+0000","last_peered":"2024-09-12T01:05:26.037683+0000","last_clean":"2024-09-12T01:05:26.037683+0000","last_became_active":"2024-09-12T00:33:10.856664+0000","last_became_peered":"2024-09-12T00:33:10.856664+0000","last_unstale":"2024-09-12T01:05:26.037683+0000","last_undegraded":"2024-09-12T01:05:26.037683+0000","last_fullsized":"2024-09-12T01:05:26.037683+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'18","last_scrub_stamp":"2024-09-12T01:05:26.037503+0000","last_deep_scrub":"268'18","last_deep_scrub_stamp":"2024-09-12T01:05:26.037503+0000","last_clean_scrub_stamp":"2024-09-12T01:05:26.037503+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:13.232142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":59,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:42.445833+0000","last_change":"2024-09-12T01:05:42.445833+0000","last_active":"2024-09-12T01:05:42.445833+0000","last_peered":"2024-09-12T01:05:42.445833+0000","last_clean":"2024-09-12T01:05:42.445833+0000","last_became_active":"2024-09-12T00:46:09.503361+0000","last_became_peered":"2024-09-12T00:46:09.503361+0000","last_unstale":"2024-09-12T01:05:42.445833+0000","last_undegraded":"2024-09-12T01:05:42.445833+0000","last_fullsized":"2024-09-12T01:05:42.445833+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:42.445637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:42.445637+0000","last_clean_scrub_stamp":"2024-09-12T01:05:42.445637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:34.408576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:43.043155+0000","last_change":"2024-09-12T01:05:43.043155+0000","last_active":"2024-09-12T01:05:43.043155+0000","last_peered":"2024-09-12T01:05:43.043155+0000","last_clean":"2024-09-12T01:05:43.043155+0000","last_became_active":"2024-09-12T00:34:55.217009+0000","last_became_peered":"2024-09-12T00:34:55.217009+0000","last_unstale":"2024-09-12T01:05:43.043155+0000","last_undegraded":"2024-09-12T01:05:43.043155+0000","last_fullsized":"2024-09-12T01:05:43.043155+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:43.042970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:43.042970+0000","last_clean_scrub_stamp":"2024-09-12T01:05:43.042970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:06.239414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"268'2","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:34.035625+0000","last_change":"2024-09-12T01:05:34.035625+0000","last_active":"2024-09-12T01:05:34.035625+0000","last_peered":"2024-09-12T01:05:34.035625+0000","last_clean":"2024-09-12T01:05:34.035625+0000","last_became_active":"2024-09-12T00:34:52.202432+0000","last_became_peered":"2024-09-12T00:34:52.202432+0000","last_unstale":"2024-09-12T01:05:34.035625+0000","last_undegraded":"2024-09-12T01:05:34.035625+0000","last_fullsized":"2024-09-12T01:05:34.035625+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:34.035427+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:34.035427+0000","last_clean_scrub_stamp":"2024-09-12T01:05:34.035427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:15.177766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"268'46","reported_seq":182,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:15.436101+0000","last_change":"2024-09-12T01:05:15.436101+0000","last_active":"2024-09-12T01:05:15.436101+0000","last_peered":"2024-09-12T01:05:15.436101+0000","last_clean":"2024-09-12T01:05:15.436101+0000","last_became_active":"2024-09-12T00:33:10.846370+0000","last_became_peered":"2024-09-12T00:33:10.846370+0000","last_unstale":"2024-09-12T01:05:15.436101+0000","last_undegraded":"2024-09-12T01:05:15.436101+0000","last_fullsized":"2024-09-12T01:05:15.436101+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'46","last_scrub_stamp":"2024-09-12T01:05:15.435917+0000","last_deep_scrub":"268'46","last_deep_scrub_stamp":"2024-09-12T01:05:15.435917+0000","last_clean_scrub_stamp":"2024-09-12T01:05:15.435917+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:19.663406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":168,"num_write":82,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:28.504954+0000","last_change":"2024-09-12T01:05:28.504954+0000","last_active":"2024-09-12T01:05:28.504954+0000","last_peered":"2024-09-12T01:05:28.504954+0000","last_clean":"2024-09-12T01:05:28.504954+0000","last_became_active":"2024-09-12T00:46:09.494139+0000","last_became_peered":"2024-09-12T00:46:09.494139+0000","last_unstale":"2024-09-12T01:05:28.504954+0000","last_undegraded":"2024-09-12T01:05:28.504954+0000","last_fullsized":"2024-09-12T01:05:28.504954+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:28.504733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:28.504733+0000","last_clean_scrub_stamp":"2024-09-12T01:05:28.504733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:14.984939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:42.000570+0000","last_change":"2024-09-12T01:05:42.000570+0000","last_active":"2024-09-12T01:05:42.000570+0000","last_peered":"2024-09-12T01:05:42.000570+0000","last_clean":"2024-09-12T01:05:42.000570+0000","last_became_active":"2024-09-12T00:34:55.253209+0000","last_became_peered":"2024-09-12T00:34:55.253209+0000","last_unstale":"2024-09-12T01:05:42.000570+0000","last_undegraded":"2024-09-12T01:05:42.000570+0000","last_fullsized":"2024-09-12T01:05:42.000570+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:42.000381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:42.000381+0000","last_clean_scrub_stamp":"2024-09-12T01:05:42.000381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:35.990230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'2","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:28.419350+0000","last_change":"2024-09-12T01:05:28.419350+0000","last_active":"2024-09-12T01:05:28.419350+0000","last_peered":"2024-09-12T01:05:28.419350+0000","last_clean":"2024-09-12T01:05:28.419350+0000","last_became_active":"2024-09-12T00:34:52.180036+0000","last_became_peered":"2024-09-12T00:34:52.180036+0000","last_unstale":"2024-09-12T01:05:28.419350+0000","last_undegraded":"2024-09-12T01:05:28.419350+0000","last_fullsized":"2024-09-12T01:05:28.419350+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:28.419145+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:28.419145+0000","last_clean_scrub_stamp":"2024-09-12T01:05:28.419145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:46.678390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'75","reported_seq":271,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:27.010551+0000","last_change":"2024-09-12T01:05:27.010551+0000","last_active":"2024-09-12T01:05:27.010551+0000","last_peered":"2024-09-12T01:05:27.010551+0000","last_clean":"2024-09-12T01:05:27.010551+0000","last_became_active":"2024-09-12T00:33:10.851672+0000","last_became_peered":"2024-09-12T00:33:10.851672+0000","last_unstale":"2024-09-12T01:05:27.010551+0000","last_undegraded":"2024-09-12T01:05:27.010551+0000","last_fullsized":"2024-09-12T01:05:27.010551+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'75","last_scrub_stamp":"2024-09-12T01:05:27.010369+0000","last_deep_scrub":"268'75","last_deep_scrub_stamp":"2024-09-12T01:05:27.010369+0000","last_clean_scrub_stamp":"2024-09-12T01:05:27.010369+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:27.277619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":415,"num_read_kb":311,"num_write":116,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'2","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:15.446767+0000","last_change":"2024-09-12T01:05:15.446767+0000","last_active":"2024-09-12T01:05:15.446767+0000","last_peered":"2024-09-12T01:05:15.446767+0000","last_clean":"2024-09-12T01:05:15.446767+0000","last_became_active":"2024-09-12T00:46:09.513012+0000","last_became_peered":"2024-09-12T00:46:09.513012+0000","last_unstale":"2024-09-12T01:05:15.446767+0000","last_undegraded":"2024-09-12T01:05:15.446767+0000","last_fullsized":"2024-09-12T01:05:15.446767+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:15.446573+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:15.446573+0000","last_clean_scrub_stamp":"2024-09-12T01:05:15.446573+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:39.377744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"268'8","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:40.989384+0000","last_change":"2024-09-12T01:05:40.989384+0000","last_active":"2024-09-12T01:05:40.989384+0000","last_peered":"2024-09-12T01:05:40.989384+0000","last_clean":"2024-09-12T01:05:40.989384+0000","last_became_active":"2024-09-12T00:34:55.252580+0000","last_became_peered":"2024-09-12T00:34:55.252580+0000","last_unstale":"2024-09-12T01:05:40.989384+0000","last_undegraded":"2024-09-12T01:05:40.989384+0000","last_fullsized":"2024-09-12T01:05:40.989384+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-12T01:05:40.989007+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-12T01:05:40.989007+0000","last_clean_scrub_stamp":"2024-09-12T01:05:40.989007+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:45.822703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":14336,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:31.417233+0000","last_change":"2024-09-12T01:05:31.417233+0000","last_active":"2024-09-12T01:05:31.417233+0000","last_peered":"2024-09-12T01:05:31.417233+0000","last_clean":"2024-09-12T01:05:31.417233+0000","last_became_active":"2024-09-12T00:34:52.204021+0000","last_became_peered":"2024-09-12T00:34:52.204021+0000","last_unstale":"2024-09-12T01:05:31.417233+0000","last_undegraded":"2024-09-12T01:05:31.417233+0000","last_fullsized":"2024-09-12T01:05:31.417233+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:31.417025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:31.417025+0000","last_clean_scrub_stamp":"2024-09-12T01:05:31.417025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:06.735736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'35","reported_seq":153,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:35.091069+0000","last_change":"2024-09-12T01:05:35.091069+0000","last_active":"2024-09-12T01:05:35.091069+0000","last_peered":"2024-09-12T01:05:35.091069+0000","last_clean":"2024-09-12T01:05:35.091069+0000","last_became_active":"2024-09-12T00:33:10.849228+0000","last_became_peered":"2024-09-12T00:33:10.849228+0000","last_unstale":"2024-09-12T01:05:35.091069+0000","last_undegraded":"2024-09-12T01:05:35.091069+0000","last_fullsized":"2024-09-12T01:05:35.091069+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'35","last_scrub_stamp":"2024-09-12T01:05:35.090885+0000","last_deep_scrub":"268'35","last_deep_scrub_stamp":"2024-09-12T01:05:35.090885+0000","last_clean_scrub_stamp":"2024-09-12T01:05:35.090885+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:49.821614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":134,"num_write":61,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:40.492032+0000","last_change":"2024-09-12T01:05:40.492032+0000","last_active":"2024-09-12T01:05:40.492032+0000","last_peered":"2024-09-12T01:05:40.492032+0000","last_clean":"2024-09-12T01:05:40.492032+0000","last_became_active":"2024-09-12T00:46:09.499137+0000","last_became_peered":"2024-09-12T00:46:09.499137+0000","last_unstale":"2024-09-12T01:05:40.492032+0000","last_undegraded":"2024-09-12T01:05:40.492032+0000","last_fullsized":"2024-09-12T01:05:40.492032+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:40.491830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:40.491830+0000","last_clean_scrub_stamp":"2024-09-12T01:05:40.491830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:59.276277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"268'5","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:44.051242+0000","last_change":"2024-09-12T01:05:44.051242+0000","last_active":"2024-09-12T01:05:44.051242+0000","last_peered":"2024-09-12T01:05:44.051242+0000","last_clean":"2024-09-12T01:05:44.051242+0000","last_became_active":"2024-09-12T00:34:55.254250+0000","last_became_peered":"2024-09-12T00:34:55.254250+0000","last_unstale":"2024-09-12T01:05:44.051242+0000","last_undegraded":"2024-09-12T01:05:44.051242+0000","last_fullsized":"2024-09-12T01:05:44.051242+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-12T01:05:44.051054+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-12T01:05:44.051054+0000","last_clean_scrub_stamp":"2024-09-12T01:05:44.051054+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:04.029709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":318,"num_write":10,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:10.441334+0000","last_change":"2024-09-12T01:05:10.441334+0000","last_active":"2024-09-12T01:05:10.441334+0000","last_peered":"2024-09-12T01:05:10.441334+0000","last_clean":"2024-09-12T01:05:10.441334+0000","last_became_active":"2024-09-12T00:34:52.173822+0000","last_became_peered":"2024-09-12T00:34:52.173822+0000","last_unstale":"2024-09-12T01:05:10.441334+0000","last_undegraded":"2024-09-12T01:05:10.441334+0000","last_fullsized":"2024-09-12T01:05:10.441334+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:10.441147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:10.441147+0000","last_clean_scrub_stamp":"2024-09-12T01:05:10.441147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:46.274029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'34","reported_seq":149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:06.452032+0000","last_change":"2024-09-12T01:05:06.452032+0000","last_active":"2024-09-12T01:05:06.452032+0000","last_peered":"2024-09-12T01:05:06.452032+0000","last_clean":"2024-09-12T01:05:06.452032+0000","last_became_active":"2024-09-12T00:33:10.841363+0000","last_became_peered":"2024-09-12T00:33:10.841363+0000","last_unstale":"2024-09-12T01:05:06.452032+0000","last_undegraded":"2024-09-12T01:05:06.452032+0000","last_fullsized":"2024-09-12T01:05:06.452032+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'34","last_scrub_stamp":"2024-09-12T01:05:06.451823+0000","last_deep_scrub":"268'34","last_deep_scrub_stamp":"2024-09-12T01:05:06.451823+0000","last_clean_scrub_stamp":"2024-09-12T01:05:06.451823+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:26.258682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":128,"num_write":55,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:33.465804+0000","last_change":"2024-09-12T01:05:33.465804+0000","last_active":"2024-09-12T01:05:33.465804+0000","last_peered":"2024-09-12T01:05:33.465804+0000","last_clean":"2024-09-12T01:05:33.465804+0000","last_became_active":"2024-09-12T00:46:09.502684+0000","last_became_peered":"2024-09-12T00:46:09.502684+0000","last_unstale":"2024-09-12T01:05:33.465804+0000","last_undegraded":"2024-09-12T01:05:33.465804+0000","last_fullsized":"2024-09-12T01:05:33.465804+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:33.465597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:33.465597+0000","last_clean_scrub_stamp":"2024-09-12T01:05:33.465597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:32.901131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"268'8","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:36.177708+0000","last_change":"2024-09-12T01:05:36.177708+0000","last_active":"2024-09-12T01:05:36.177708+0000","last_peered":"2024-09-12T01:05:36.177708+0000","last_clean":"2024-09-12T01:05:36.177708+0000","last_became_active":"2024-09-12T00:34:55.226388+0000","last_became_peered":"2024-09-12T00:34:55.226388+0000","last_unstale":"2024-09-12T01:05:36.177708+0000","last_undegraded":"2024-09-12T01:05:36.177708+0000","last_fullsized":"2024-09-12T01:05:36.177708+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-12T01:05:36.177522+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-12T01:05:36.177522+0000","last_clean_scrub_stamp":"2024-09-12T01:05:36.177522+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:33.966724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":16384,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"268'11","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:33.062758+0000","last_change":"2024-09-12T01:05:33.062758+0000","last_active":"2024-09-12T01:05:33.062758+0000","last_peered":"2024-09-12T01:05:33.062758+0000","last_clean":"2024-09-12T01:05:33.062758+0000","last_became_active":"2024-09-12T00:34:52.196770+0000","last_became_peered":"2024-09-12T00:34:52.196770+0000","last_unstale":"2024-09-12T01:05:33.062758+0000","last_undegraded":"2024-09-12T01:05:33.062758+0000","last_fullsized":"2024-09-12T01:05:33.062758+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'11","last_scrub_stamp":"2024-09-12T01:05:33.062577+0000","last_deep_scrub":"268'11","last_deep_scrub_stamp":"2024-09-12T01:05:33.062577+0000","last_clean_scrub_stamp":"2024-09-12T01:05:33.062577+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:35.967177+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":25602,"num_write":16,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'4","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.397069+0000","last_change":"2024-09-12T01:05:25.397069+0000","last_active":"2024-09-12T01:05:25.397069+0000","last_peered":"2024-09-12T01:05:25.397069+0000","last_clean":"2024-09-12T01:05:25.397069+0000","last_became_active":"2024-09-12T00:33:10.858178+0000","last_became_peered":"2024-09-12T00:33:10.858178+0000","last_unstale":"2024-09-12T01:05:25.397069+0000","last_undegraded":"2024-09-12T01:05:25.397069+0000","last_fullsized":"2024-09-12T01:05:25.397069+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:05:25.396886+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:05:25.396886+0000","last_clean_scrub_stamp":"2024-09-12T01:05:25.396886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:56.723053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.773413+0000","last_change":"2024-09-12T00:46:09.522998+0000","last_active":"2024-09-12T01:03:06.773413+0000","last_peered":"2024-09-12T01:03:06.773413+0000","last_clean":"2024-09-12T01:03:06.773413+0000","last_became_active":"2024-09-12T00:46:09.521706+0000","last_became_peered":"2024-09-12T00:46:09.521706+0000","last_unstale":"2024-09-12T01:03:06.773413+0000","last_undegraded":"2024-09-12T01:03:06.773413+0000","last_fullsized":"2024-09-12T01:03:06.773413+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"268'4","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:24.561794+0000","last_change":"2024-09-12T01:05:24.561794+0000","last_active":"2024-09-12T01:05:24.561794+0000","last_peered":"2024-09-12T01:05:24.561794+0000","last_clean":"2024-09-12T01:05:24.561794+0000","last_became_active":"2024-09-12T00:34:55.223787+0000","last_became_peered":"2024-09-12T00:34:55.223787+0000","last_unstale":"2024-09-12T01:05:24.561794+0000","last_undegraded":"2024-09-12T01:05:24.561794+0000","last_fullsized":"2024-09-12T01:05:24.561794+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:05:24.561614+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:05:24.561614+0000","last_clean_scrub_stamp":"2024-09-12T01:05:24.561614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:31.053640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"268'6","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:27.256425+0000","last_change":"2024-09-12T01:05:27.256425+0000","last_active":"2024-09-12T01:05:27.256425+0000","last_peered":"2024-09-12T01:05:27.256425+0000","last_clean":"2024-09-12T01:05:27.256425+0000","last_became_active":"2024-09-12T00:34:52.183982+0000","last_became_peered":"2024-09-12T00:34:52.183982+0000","last_unstale":"2024-09-12T01:05:27.256425+0000","last_undegraded":"2024-09-12T01:05:27.256425+0000","last_fullsized":"2024-09-12T01:05:27.256425+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T01:05:27.256194+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T01:05:27.256194+0000","last_clean_scrub_stamp":"2024-09-12T01:05:27.256194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:57.757429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5649,"num_write":6,"num_write_kb":5649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'25","reported_seq":123,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:24.390888+0000","last_change":"2024-09-12T01:05:24.390888+0000","last_active":"2024-09-12T01:05:24.390888+0000","last_peered":"2024-09-12T01:05:24.390888+0000","last_clean":"2024-09-12T01:05:24.390888+0000","last_became_active":"2024-09-12T00:33:10.858212+0000","last_became_peered":"2024-09-12T00:33:10.858212+0000","last_unstale":"2024-09-12T01:05:24.390888+0000","last_undegraded":"2024-09-12T01:05:24.390888+0000","last_fullsized":"2024-09-12T01:05:24.390888+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'25","last_scrub_stamp":"2024-09-12T01:05:24.390620+0000","last_deep_scrub":"268'25","last_deep_scrub_stamp":"2024-09-12T01:05:24.390620+0000","last_clean_scrub_stamp":"2024-09-12T01:05:24.390620+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:50.472958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":92,"num_write":42,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:40.012078+0000","last_change":"2024-09-12T01:05:40.012078+0000","last_active":"2024-09-12T01:05:40.012078+0000","last_peered":"2024-09-12T01:05:40.012078+0000","last_clean":"2024-09-12T01:05:40.012078+0000","last_became_active":"2024-09-12T00:46:09.517833+0000","last_became_peered":"2024-09-12T00:46:09.517833+0000","last_unstale":"2024-09-12T01:05:40.012078+0000","last_undegraded":"2024-09-12T01:05:40.012078+0000","last_fullsized":"2024-09-12T01:05:40.012078+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:40.011898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:40.011898+0000","last_clean_scrub_stamp":"2024-09-12T01:05:40.011898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:00.987487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'9","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.519111+0000","last_change":"2024-09-12T01:05:25.519111+0000","last_active":"2024-09-12T01:05:25.519111+0000","last_peered":"2024-09-12T01:05:25.519111+0000","last_clean":"2024-09-12T01:05:25.519111+0000","last_became_active":"2024-09-12T00:34:55.226334+0000","last_became_peered":"2024-09-12T00:34:55.226334+0000","last_unstale":"2024-09-12T01:05:25.519111+0000","last_undegraded":"2024-09-12T01:05:25.519111+0000","last_fullsized":"2024-09-12T01:05:25.519111+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-12T01:05:25.518883+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-12T01:05:25.518883+0000","last_clean_scrub_stamp":"2024-09-12T01:05:25.518883+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:34.088936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":14,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'6","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:37.036142+0000","last_change":"2024-09-12T01:05:37.036142+0000","last_active":"2024-09-12T01:05:37.036142+0000","last_peered":"2024-09-12T01:05:37.036142+0000","last_clean":"2024-09-12T01:05:37.036142+0000","last_became_active":"2024-09-12T00:34:52.174421+0000","last_became_peered":"2024-09-12T00:34:52.174421+0000","last_unstale":"2024-09-12T01:05:37.036142+0000","last_undegraded":"2024-09-12T01:05:37.036142+0000","last_fullsized":"2024-09-12T01:05:37.036142+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T01:05:37.035955+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T01:05:37.035955+0000","last_clean_scrub_stamp":"2024-09-12T01:05:37.035955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:53.006466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5438,"num_write":6,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"268'52","reported_seq":195,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.056264+0000","last_change":"2024-09-12T01:05:29.056264+0000","last_active":"2024-09-12T01:05:29.056264+0000","last_peered":"2024-09-12T01:05:29.056264+0000","last_clean":"2024-09-12T01:05:29.056264+0000","last_became_active":"2024-09-12T00:33:10.848890+0000","last_became_peered":"2024-09-12T00:33:10.848890+0000","last_unstale":"2024-09-12T01:05:29.056264+0000","last_undegraded":"2024-09-12T01:05:29.056264+0000","last_fullsized":"2024-09-12T01:05:29.056264+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'52","last_scrub_stamp":"2024-09-12T01:05:29.056070+0000","last_deep_scrub":"268'52","last_deep_scrub_stamp":"2024-09-12T01:05:29.056070+0000","last_clean_scrub_stamp":"2024-09-12T01:05:29.056070+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:02.187193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":180,"num_write":98,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"268'2","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:41.970844+0000","last_change":"2024-09-12T01:05:41.970844+0000","last_active":"2024-09-12T01:05:41.970844+0000","last_peered":"2024-09-12T01:05:41.970844+0000","last_clean":"2024-09-12T01:05:41.970844+0000","last_became_active":"2024-09-12T00:46:09.521575+0000","last_became_peered":"2024-09-12T00:46:09.521575+0000","last_unstale":"2024-09-12T01:05:41.970844+0000","last_undegraded":"2024-09-12T01:05:41.970844+0000","last_fullsized":"2024-09-12T01:05:41.970844+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:41.970651+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:41.970651+0000","last_clean_scrub_stamp":"2024-09-12T01:05:41.970651+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:08.128140+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"268'7","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:39.950757+0000","last_change":"2024-09-12T01:05:39.950757+0000","last_active":"2024-09-12T01:05:39.950757+0000","last_peered":"2024-09-12T01:05:39.950757+0000","last_clean":"2024-09-12T01:05:39.950757+0000","last_became_active":"2024-09-12T00:34:55.232215+0000","last_became_peered":"2024-09-12T00:34:55.232215+0000","last_unstale":"2024-09-12T01:05:39.950757+0000","last_undegraded":"2024-09-12T01:05:39.950757+0000","last_fullsized":"2024-09-12T01:05:39.950757+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-12T01:05:39.950567+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-12T01:05:39.950567+0000","last_clean_scrub_stamp":"2024-09-12T01:05:39.950567+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:19.154371+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8310,"num_write":12,"num_write_kb":8251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"268'4","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:16.824227+0000","last_change":"2024-09-12T01:05:16.824227+0000","last_active":"2024-09-12T01:05:16.824227+0000","last_peered":"2024-09-12T01:05:16.824227+0000","last_clean":"2024-09-12T01:05:16.824227+0000","last_became_active":"2024-09-12T00:34:52.199793+0000","last_became_peered":"2024-09-12T00:34:52.199793+0000","last_unstale":"2024-09-12T01:05:16.824227+0000","last_undegraded":"2024-09-12T01:05:16.824227+0000","last_fullsized":"2024-09-12T01:05:16.824227+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:05:16.824038+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:05:16.824038+0000","last_clean_scrub_stamp":"2024-09-12T01:05:16.824038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:55.744048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'20","reported_seq":111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.166037+0000","last_change":"2024-09-12T01:05:25.166037+0000","last_active":"2024-09-12T01:05:25.166037+0000","last_peered":"2024-09-12T01:05:25.166037+0000","last_clean":"2024-09-12T01:05:25.166037+0000","last_became_active":"2024-09-12T00:33:10.844957+0000","last_became_peered":"2024-09-12T00:33:10.844957+0000","last_unstale":"2024-09-12T01:05:25.166037+0000","last_undegraded":"2024-09-12T01:05:25.166037+0000","last_fullsized":"2024-09-12T01:05:25.166037+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'20","last_scrub_stamp":"2024-09-12T01:05:25.165837+0000","last_deep_scrub":"268'20","last_deep_scrub_stamp":"2024-09-12T01:05:25.165837+0000","last_clean_scrub_stamp":"2024-09-12T01:05:25.165837+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:53.854836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":73,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.773338+0000","last_change":"2024-09-12T00:46:09.515049+0000","last_active":"2024-09-12T01:03:06.773338+0000","last_peered":"2024-09-12T01:03:06.773338+0000","last_clean":"2024-09-12T01:03:06.773338+0000","last_became_active":"2024-09-12T00:46:09.514727+0000","last_became_peered":"2024-09-12T00:46:09.514727+0000","last_unstale":"2024-09-12T01:03:06.773338+0000","last_undegraded":"2024-09-12T01:03:06.773338+0000","last_fullsized":"2024-09-12T01:03:06.773338+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:08.458202+0000","last_clean_scrub_stamp":"2024-09-12T00:46:08.458202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"268'7","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.875656+0000","last_change":"2024-09-12T01:05:20.875656+0000","last_active":"2024-09-12T01:05:20.875656+0000","last_peered":"2024-09-12T01:05:20.875656+0000","last_clean":"2024-09-12T01:05:20.875656+0000","last_became_active":"2024-09-12T00:34:55.220179+0000","last_became_peered":"2024-09-12T00:34:55.220179+0000","last_unstale":"2024-09-12T01:05:20.875656+0000","last_undegraded":"2024-09-12T01:05:20.875656+0000","last_fullsized":"2024-09-12T01:05:20.875656+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-12T01:05:20.875403+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-12T01:05:20.875403+0000","last_clean_scrub_stamp":"2024-09-12T01:05:20.875403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:37.253656+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"268'7","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:27.465316+0000","last_change":"2024-09-12T01:05:27.465316+0000","last_active":"2024-09-12T01:05:27.465316+0000","last_peered":"2024-09-12T01:05:27.465316+0000","last_clean":"2024-09-12T01:05:27.465316+0000","last_became_active":"2024-09-12T00:34:52.196592+0000","last_became_peered":"2024-09-12T00:34:52.196592+0000","last_unstale":"2024-09-12T01:05:27.465316+0000","last_undegraded":"2024-09-12T01:05:27.465316+0000","last_fullsized":"2024-09-12T01:05:27.465316+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-12T01:05:27.465133+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-12T01:05:27.465133+0000","last_clean_scrub_stamp":"2024-09-12T01:05:27.465133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:26.670583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'27","reported_seq":125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:31.079810+0000","last_change":"2024-09-12T01:05:31.079810+0000","last_active":"2024-09-12T01:05:31.079810+0000","last_peered":"2024-09-12T01:05:31.079810+0000","last_clean":"2024-09-12T01:05:31.079810+0000","last_became_active":"2024-09-12T00:33:10.842139+0000","last_became_peered":"2024-09-12T00:33:10.842139+0000","last_unstale":"2024-09-12T01:05:31.079810+0000","last_undegraded":"2024-09-12T01:05:31.079810+0000","last_fullsized":"2024-09-12T01:05:31.079810+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'27","last_scrub_stamp":"2024-09-12T01:05:31.079635+0000","last_deep_scrub":"268'27","last_deep_scrub_stamp":"2024-09-12T01:05:31.079635+0000","last_clean_scrub_stamp":"2024-09-12T01:05:31.079635+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:45.293345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":87,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.454915+0000","last_change":"2024-09-12T01:05:14.454784+0000","last_active":"2024-09-12T01:05:14.454915+0000","last_peered":"2024-09-12T01:05:14.454915+0000","last_clean":"2024-09-12T01:05:14.454915+0000","last_became_active":"2024-09-12T00:46:09.494257+0000","last_became_peered":"2024-09-12T00:46:09.494257+0000","last_unstale":"2024-09-12T01:05:14.454915+0000","last_undegraded":"2024-09-12T01:05:14.454915+0000","last_fullsized":"2024-09-12T01:05:14.454915+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:14.454594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:14.454594+0000","last_clean_scrub_stamp":"2024-09-12T01:05:14.454594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:36.996544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:37.991973+0000","last_change":"2024-09-12T01:05:37.991973+0000","last_active":"2024-09-12T01:05:37.991973+0000","last_peered":"2024-09-12T01:05:37.991973+0000","last_clean":"2024-09-12T01:05:37.991973+0000","last_became_active":"2024-09-12T00:34:55.226471+0000","last_became_peered":"2024-09-12T00:34:55.226471+0000","last_unstale":"2024-09-12T01:05:37.991973+0000","last_undegraded":"2024-09-12T01:05:37.991973+0000","last_fullsized":"2024-09-12T01:05:37.991973+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:37.991781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:37.991781+0000","last_clean_scrub_stamp":"2024-09-12T01:05:37.991781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:54.440430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'2","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:30.450750+0000","last_change":"2024-09-12T01:05:30.450750+0000","last_active":"2024-09-12T01:05:30.450750+0000","last_peered":"2024-09-12T01:05:30.450750+0000","last_clean":"2024-09-12T01:05:30.450750+0000","last_became_active":"2024-09-12T00:34:52.202587+0000","last_became_peered":"2024-09-12T00:34:52.202587+0000","last_unstale":"2024-09-12T01:05:30.450750+0000","last_undegraded":"2024-09-12T01:05:30.450750+0000","last_fullsized":"2024-09-12T01:05:30.450750+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:05:30.450558+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:05:30.450558+0000","last_clean_scrub_stamp":"2024-09-12T01:05:30.450558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:50.380227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'23","reported_seq":117,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.072410+0000","last_change":"2024-09-12T01:05:29.072410+0000","last_active":"2024-09-12T01:05:29.072410+0000","last_peered":"2024-09-12T01:05:29.072410+0000","last_clean":"2024-09-12T01:05:29.072410+0000","last_became_active":"2024-09-12T00:33:10.832622+0000","last_became_peered":"2024-09-12T00:33:10.832622+0000","last_unstale":"2024-09-12T01:05:29.072410+0000","last_undegraded":"2024-09-12T01:05:29.072410+0000","last_fullsized":"2024-09-12T01:05:29.072410+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'23","last_scrub_stamp":"2024-09-12T01:05:29.072243+0000","last_deep_scrub":"268'23","last_deep_scrub_stamp":"2024-09-12T01:05:29.072243+0000","last_clean_scrub_stamp":"2024-09-12T01:05:29.072243+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:21.968941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":78,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:41.488347+0000","last_change":"2024-09-12T01:05:41.488347+0000","last_active":"2024-09-12T01:05:41.488347+0000","last_peered":"2024-09-12T01:05:41.488347+0000","last_clean":"2024-09-12T01:05:41.488347+0000","last_became_active":"2024-09-12T00:46:09.501361+0000","last_became_peered":"2024-09-12T00:46:09.501361+0000","last_unstale":"2024-09-12T01:05:41.488347+0000","last_undegraded":"2024-09-12T01:05:41.488347+0000","last_fullsized":"2024-09-12T01:05:41.488347+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:41.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:41.488156+0000","last_clean_scrub_stamp":"2024-09-12T01:05:41.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:12.285022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"268'2","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:36.054992+0000","last_change":"2024-09-12T01:05:36.054992+0000","last_active":"2024-09-12T01:05:36.054992+0000","last_peered":"2024-09-12T01:05:36.054992+0000","last_clean":"2024-09-12T01:05:36.054992+0000","last_became_active":"2024-09-12T00:34:55.222079+0000","last_became_peered":"2024-09-12T00:34:55.222079+0000","last_unstale":"2024-09-12T01:05:36.054992+0000","last_undegraded":"2024-09-12T01:05:36.054992+0000","last_fullsized":"2024-09-12T01:05:36.054992+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:36.054792+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:36.054792+0000","last_clean_scrub_stamp":"2024-09-12T01:05:36.054792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:03.597560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"268'3","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:11.443631+0000","last_change":"2024-09-12T01:05:11.443631+0000","last_active":"2024-09-12T01:05:11.443631+0000","last_peered":"2024-09-12T01:05:11.443631+0000","last_clean":"2024-09-12T01:05:11.443631+0000","last_became_active":"2024-09-12T00:34:52.176108+0000","last_became_peered":"2024-09-12T00:34:52.176108+0000","last_unstale":"2024-09-12T01:05:11.443631+0000","last_undegraded":"2024-09-12T01:05:11.443631+0000","last_fullsized":"2024-09-12T01:05:11.443631+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:05:11.443449+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:05:11.443449+0000","last_clean_scrub_stamp":"2024-09-12T01:05:11.443449+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:39.904043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'16","reported_seq":99,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.509817+0000","last_change":"2024-09-12T01:05:25.509817+0000","last_active":"2024-09-12T01:05:25.509817+0000","last_peered":"2024-09-12T01:05:25.509817+0000","last_clean":"2024-09-12T01:05:25.509817+0000","last_became_active":"2024-09-12T00:33:10.849703+0000","last_became_peered":"2024-09-12T00:33:10.849703+0000","last_unstale":"2024-09-12T01:05:25.509817+0000","last_undegraded":"2024-09-12T01:05:25.509817+0000","last_fullsized":"2024-09-12T01:05:25.509817+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'16","last_scrub_stamp":"2024-09-12T01:05:25.509628+0000","last_deep_scrub":"265'16","last_deep_scrub_stamp":"2024-09-12T01:05:25.509628+0000","last_clean_scrub_stamp":"2024-09-12T01:05:25.509628+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:23.064810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:23.901445+0000","last_change":"2024-09-12T01:05:23.901314+0000","last_active":"2024-09-12T01:05:23.901445+0000","last_peered":"2024-09-12T01:05:23.901445+0000","last_clean":"2024-09-12T01:05:23.901445+0000","last_became_active":"2024-09-12T00:46:09.514197+0000","last_became_peered":"2024-09-12T00:46:09.514197+0000","last_unstale":"2024-09-12T01:05:23.901445+0000","last_undegraded":"2024-09-12T01:05:23.901445+0000","last_fullsized":"2024-09-12T01:05:23.901445+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:23.901126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:23.901126+0000","last_clean_scrub_stamp":"2024-09-12T01:05:23.901126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:28.857730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"268'8","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:23.524527+0000","last_change":"2024-09-12T01:05:23.524527+0000","last_active":"2024-09-12T01:05:23.524527+0000","last_peered":"2024-09-12T01:05:23.524527+0000","last_clean":"2024-09-12T01:05:23.524527+0000","last_became_active":"2024-09-12T00:34:55.252651+0000","last_became_peered":"2024-09-12T00:34:55.252651+0000","last_unstale":"2024-09-12T01:05:23.524527+0000","last_undegraded":"2024-09-12T01:05:23.524527+0000","last_fullsized":"2024-09-12T01:05:23.524527+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-12T01:05:23.524342+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-12T01:05:23.524342+0000","last_clean_scrub_stamp":"2024-09-12T01:05:23.524342+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:54.519342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":7697,"num_write":8,"num_write_kb":6673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"268'3","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:31.032586+0000","last_change":"2024-09-12T01:05:31.032586+0000","last_active":"2024-09-12T01:05:31.032586+0000","last_peered":"2024-09-12T01:05:31.032586+0000","last_clean":"2024-09-12T01:05:31.032586+0000","last_became_active":"2024-09-12T00:34:52.177094+0000","last_became_peered":"2024-09-12T00:34:52.177094+0000","last_unstale":"2024-09-12T01:05:31.032586+0000","last_undegraded":"2024-09-12T01:05:31.032586+0000","last_fullsized":"2024-09-12T01:05:31.032586+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:05:31.032404+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:05:31.032404+0000","last_clean_scrub_stamp":"2024-09-12T01:05:31.032404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:59.797386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"268'31","reported_seq":141,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.781240+0000","last_change":"2024-09-12T01:05:14.781240+0000","last_active":"2024-09-12T01:05:14.781240+0000","last_peered":"2024-09-12T01:05:14.781240+0000","last_clean":"2024-09-12T01:05:14.781240+0000","last_became_active":"2024-09-12T00:33:10.862993+0000","last_became_peered":"2024-09-12T00:33:10.862993+0000","last_unstale":"2024-09-12T01:05:14.781240+0000","last_undegraded":"2024-09-12T01:05:14.781240+0000","last_fullsized":"2024-09-12T01:05:14.781240+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'31","last_scrub_stamp":"2024-09-12T01:05:14.781021+0000","last_deep_scrub":"268'31","last_deep_scrub_stamp":"2024-09-12T01:05:14.781021+0000","last_clean_scrub_stamp":"2024-09-12T01:05:14.781021+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:28.478018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":107,"num_write":58,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:36.496743+0000","last_change":"2024-09-12T01:05:36.496569+0000","last_active":"2024-09-12T01:05:36.496743+0000","last_peered":"2024-09-12T01:05:36.496743+0000","last_clean":"2024-09-12T01:05:36.496743+0000","last_became_active":"2024-09-12T00:46:09.498482+0000","last_became_peered":"2024-09-12T00:46:09.498482+0000","last_unstale":"2024-09-12T01:05:36.496743+0000","last_undegraded":"2024-09-12T01:05:36.496743+0000","last_fullsized":"2024-09-12T01:05:36.496743+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:36.496375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:36.496375+0000","last_clean_scrub_stamp":"2024-09-12T01:05:36.496375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:08.554029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:38.972577+0000","last_change":"2024-09-12T01:05:38.972577+0000","last_active":"2024-09-12T01:05:38.972577+0000","last_peered":"2024-09-12T01:05:38.972577+0000","last_clean":"2024-09-12T01:05:38.972577+0000","last_became_active":"2024-09-12T00:34:55.228136+0000","last_became_peered":"2024-09-12T00:34:55.228136+0000","last_unstale":"2024-09-12T01:05:38.972577+0000","last_undegraded":"2024-09-12T01:05:38.972577+0000","last_fullsized":"2024-09-12T01:05:38.972577+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:38.972391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:38.972391+0000","last_clean_scrub_stamp":"2024-09-12T01:05:38.972391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:27.334184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.495292+0000","last_change":"2024-09-12T01:05:19.495292+0000","last_active":"2024-09-12T01:05:19.495292+0000","last_peered":"2024-09-12T01:05:19.495292+0000","last_clean":"2024-09-12T01:05:19.495292+0000","last_became_active":"2024-09-12T00:34:52.190350+0000","last_became_peered":"2024-09-12T00:34:52.190350+0000","last_unstale":"2024-09-12T01:05:19.495292+0000","last_undegraded":"2024-09-12T01:05:19.495292+0000","last_fullsized":"2024-09-12T01:05:19.495292+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:19.495112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:19.495112+0000","last_clean_scrub_stamp":"2024-09-12T01:05:19.495112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:01.884792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'31","reported_seq":139,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:07.485351+0000","last_change":"2024-09-12T01:05:07.485351+0000","last_active":"2024-09-12T01:05:07.485351+0000","last_peered":"2024-09-12T01:05:07.485351+0000","last_clean":"2024-09-12T01:05:07.485351+0000","last_became_active":"2024-09-12T00:33:10.834095+0000","last_became_peered":"2024-09-12T00:33:10.834095+0000","last_unstale":"2024-09-12T01:05:07.485351+0000","last_undegraded":"2024-09-12T01:05:07.485351+0000","last_fullsized":"2024-09-12T01:05:07.485351+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'31","last_scrub_stamp":"2024-09-12T01:05:07.485175+0000","last_deep_scrub":"268'31","last_deep_scrub_stamp":"2024-09-12T01:05:07.485175+0000","last_clean_scrub_stamp":"2024-09-12T01:05:07.485175+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:30.593230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":107,"num_write":54,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:46.002332+0000","last_change":"2024-09-12T01:05:46.002332+0000","last_active":"2024-09-12T01:05:46.002332+0000","last_peered":"2024-09-12T01:05:46.002332+0000","last_clean":"2024-09-12T01:05:46.002332+0000","last_became_active":"2024-09-12T00:46:09.500779+0000","last_became_peered":"2024-09-12T00:46:09.500779+0000","last_unstale":"2024-09-12T01:05:46.002332+0000","last_undegraded":"2024-09-12T01:05:46.002332+0000","last_fullsized":"2024-09-12T01:05:46.002332+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:46.002130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:46.002130+0000","last_clean_scrub_stamp":"2024-09-12T01:05:46.002130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:54.776939+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"268'8","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:32.222083+0000","last_change":"2024-09-12T01:05:32.222083+0000","last_active":"2024-09-12T01:05:32.222083+0000","last_peered":"2024-09-12T01:05:32.222083+0000","last_clean":"2024-09-12T01:05:32.222083+0000","last_became_active":"2024-09-12T00:34:55.241223+0000","last_became_peered":"2024-09-12T00:34:55.241223+0000","last_unstale":"2024-09-12T01:05:32.222083+0000","last_undegraded":"2024-09-12T01:05:32.222083+0000","last_fullsized":"2024-09-12T01:05:32.222083+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-12T01:05:32.221898+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-12T01:05:32.221898+0000","last_clean_scrub_stamp":"2024-09-12T01:05:32.221898+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:10.526262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9218,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"268'2","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:28.059546+0000","last_change":"2024-09-12T01:05:28.059546+0000","last_active":"2024-09-12T01:05:28.059546+0000","last_peered":"2024-09-12T01:05:28.059546+0000","last_clean":"2024-09-12T01:05:28.059546+0000","last_became_active":"2024-09-12T00:34:52.202407+0000","last_became_peered":"2024-09-12T00:34:52.202407+0000","last_unstale":"2024-09-12T01:05:28.059546+0000","last_undegraded":"2024-09-12T01:05:28.059546+0000","last_fullsized":"2024-09-12T01:05:28.059546+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:28.059362+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:28.059362+0000","last_clean_scrub_stamp":"2024-09-12T01:05:28.059362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:28.939897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'46","reported_seq":187,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.007682+0000","last_change":"2024-09-12T01:05:25.007682+0000","last_active":"2024-09-12T01:05:25.007682+0000","last_peered":"2024-09-12T01:05:25.007682+0000","last_clean":"2024-09-12T01:05:25.007682+0000","last_became_active":"2024-09-12T00:33:10.859459+0000","last_became_peered":"2024-09-12T00:33:10.859459+0000","last_unstale":"2024-09-12T01:05:25.007682+0000","last_undegraded":"2024-09-12T01:05:25.007682+0000","last_fullsized":"2024-09-12T01:05:25.007682+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'46","last_scrub_stamp":"2024-09-12T01:05:25.007486+0000","last_deep_scrub":"268'46","last_deep_scrub_stamp":"2024-09-12T01:05:25.007486+0000","last_clean_scrub_stamp":"2024-09-12T01:05:25.007486+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:36.922427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":176,"num_write":75,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:39.467891+0000","last_change":"2024-09-12T01:05:39.467891+0000","last_active":"2024-09-12T01:05:39.467891+0000","last_peered":"2024-09-12T01:05:39.467891+0000","last_clean":"2024-09-12T01:05:39.467891+0000","last_became_active":"2024-09-12T00:46:09.505143+0000","last_became_peered":"2024-09-12T00:46:09.505143+0000","last_unstale":"2024-09-12T01:05:39.467891+0000","last_undegraded":"2024-09-12T01:05:39.467891+0000","last_fullsized":"2024-09-12T01:05:39.467891+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:39.467705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:39.467705+0000","last_clean_scrub_stamp":"2024-09-12T01:05:39.467705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:16.714797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"268'2","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:33.475483+0000","last_change":"2024-09-12T01:05:33.475483+0000","last_active":"2024-09-12T01:05:33.475483+0000","last_peered":"2024-09-12T01:05:33.475483+0000","last_clean":"2024-09-12T01:05:33.475483+0000","last_became_active":"2024-09-12T00:34:55.253169+0000","last_became_peered":"2024-09-12T00:34:55.253169+0000","last_unstale":"2024-09-12T01:05:33.475483+0000","last_undegraded":"2024-09-12T01:05:33.475483+0000","last_fullsized":"2024-09-12T01:05:33.475483+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:33.475199+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:33.475199+0000","last_clean_scrub_stamp":"2024-09-12T01:05:33.475199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:40.221978+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"268'2","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:18.531394+0000","last_change":"2024-09-12T01:05:18.531394+0000","last_active":"2024-09-12T01:05:18.531394+0000","last_peered":"2024-09-12T01:05:18.531394+0000","last_clean":"2024-09-12T01:05:18.531394+0000","last_became_active":"2024-09-12T00:34:52.190174+0000","last_became_peered":"2024-09-12T00:34:52.190174+0000","last_unstale":"2024-09-12T01:05:18.531394+0000","last_undegraded":"2024-09-12T01:05:18.531394+0000","last_fullsized":"2024-09-12T01:05:18.531394+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:18.531176+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:18.531176+0000","last_clean_scrub_stamp":"2024-09-12T01:05:18.531176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:29.431630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'29","reported_seq":129,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:23.391346+0000","last_change":"2024-09-12T01:05:23.391346+0000","last_active":"2024-09-12T01:05:23.391346+0000","last_peered":"2024-09-12T01:05:23.391346+0000","last_clean":"2024-09-12T01:05:23.391346+0000","last_became_active":"2024-09-12T00:33:10.849658+0000","last_became_peered":"2024-09-12T00:33:10.849658+0000","last_unstale":"2024-09-12T01:05:23.391346+0000","last_undegraded":"2024-09-12T01:05:23.391346+0000","last_fullsized":"2024-09-12T01:05:23.391346+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'29","last_scrub_stamp":"2024-09-12T01:05:23.391166+0000","last_deep_scrub":"268'29","last_deep_scrub_stamp":"2024-09-12T01:05:23.391166+0000","last_clean_scrub_stamp":"2024-09-12T01:05:23.391166+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:10.325840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":91,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'2","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:38.505366+0000","last_change":"2024-09-12T01:05:38.505366+0000","last_active":"2024-09-12T01:05:38.505366+0000","last_peered":"2024-09-12T01:05:38.505366+0000","last_clean":"2024-09-12T01:05:38.505366+0000","last_became_active":"2024-09-12T00:46:09.485933+0000","last_became_peered":"2024-09-12T00:46:09.485933+0000","last_unstale":"2024-09-12T01:05:38.505366+0000","last_undegraded":"2024-09-12T01:05:38.505366+0000","last_fullsized":"2024-09-12T01:05:38.505366+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:38.505148+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:38.505148+0000","last_clean_scrub_stamp":"2024-09-12T01:05:38.505148+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:10.425204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"268'2","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:22.541565+0000","last_change":"2024-09-12T01:05:22.541565+0000","last_active":"2024-09-12T01:05:22.541565+0000","last_peered":"2024-09-12T01:05:22.541565+0000","last_clean":"2024-09-12T01:05:22.541565+0000","last_became_active":"2024-09-12T00:34:55.236708+0000","last_became_peered":"2024-09-12T00:34:55.236708+0000","last_unstale":"2024-09-12T01:05:22.541565+0000","last_undegraded":"2024-09-12T01:05:22.541565+0000","last_fullsized":"2024-09-12T01:05:22.541565+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:22.541371+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:22.541371+0000","last_clean_scrub_stamp":"2024-09-12T01:05:22.541371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:21.089324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'4","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:35.051883+0000","last_change":"2024-09-12T01:05:35.051883+0000","last_active":"2024-09-12T01:05:35.051883+0000","last_peered":"2024-09-12T01:05:35.051883+0000","last_clean":"2024-09-12T01:05:35.051883+0000","last_became_active":"2024-09-12T00:34:52.205829+0000","last_became_peered":"2024-09-12T00:34:52.205829+0000","last_unstale":"2024-09-12T01:05:35.051883+0000","last_undegraded":"2024-09-12T01:05:35.051883+0000","last_fullsized":"2024-09-12T01:05:35.051883+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:05:35.051696+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:05:35.051696+0000","last_clean_scrub_stamp":"2024-09-12T01:05:35.051696+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:53.088317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'30","reported_seq":142,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:28.056779+0000","last_change":"2024-09-12T01:05:28.056620+0000","last_active":"2024-09-12T01:05:28.056779+0000","last_peered":"2024-09-12T01:05:28.056779+0000","last_clean":"2024-09-12T01:05:28.056779+0000","last_became_active":"2024-09-12T00:33:10.825191+0000","last_became_peered":"2024-09-12T00:33:10.825191+0000","last_unstale":"2024-09-12T01:05:28.056779+0000","last_undegraded":"2024-09-12T01:05:28.056779+0000","last_fullsized":"2024-09-12T01:05:28.056779+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'30","last_scrub_stamp":"2024-09-12T01:05:28.056432+0000","last_deep_scrub":"268'30","last_deep_scrub_stamp":"2024-09-12T01:05:28.056432+0000","last_clean_scrub_stamp":"2024-09-12T01:05:28.056432+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:43.332413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":116,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:43.942888+0000","last_change":"2024-09-12T01:05:43.942888+0000","last_active":"2024-09-12T01:05:43.942888+0000","last_peered":"2024-09-12T01:05:43.942888+0000","last_clean":"2024-09-12T01:05:43.942888+0000","last_became_active":"2024-09-12T00:46:09.504789+0000","last_became_peered":"2024-09-12T00:46:09.504789+0000","last_unstale":"2024-09-12T01:05:43.942888+0000","last_undegraded":"2024-09-12T01:05:43.942888+0000","last_fullsized":"2024-09-12T01:05:43.942888+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:43.942708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:43.942708+0000","last_clean_scrub_stamp":"2024-09-12T01:05:43.942708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:38.496834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'2","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:34.487038+0000","last_change":"2024-09-12T01:05:34.487038+0000","last_active":"2024-09-12T01:05:34.487038+0000","last_peered":"2024-09-12T01:05:34.487038+0000","last_clean":"2024-09-12T01:05:34.487038+0000","last_became_active":"2024-09-12T00:34:55.237691+0000","last_became_peered":"2024-09-12T00:34:55.237691+0000","last_unstale":"2024-09-12T01:05:34.487038+0000","last_undegraded":"2024-09-12T01:05:34.487038+0000","last_fullsized":"2024-09-12T01:05:34.487038+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:05:34.486820+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:05:34.486820+0000","last_clean_scrub_stamp":"2024-09-12T01:05:34.486820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:19.893016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'8","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:26.206011+0000","last_change":"2024-09-12T01:05:26.206011+0000","last_active":"2024-09-12T01:05:26.206011+0000","last_peered":"2024-09-12T01:05:26.206011+0000","last_clean":"2024-09-12T01:05:26.206011+0000","last_became_active":"2024-09-12T00:34:52.200033+0000","last_became_peered":"2024-09-12T00:34:52.200033+0000","last_unstale":"2024-09-12T01:05:26.206011+0000","last_undegraded":"2024-09-12T01:05:26.206011+0000","last_fullsized":"2024-09-12T01:05:26.206011+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T01:05:26.205816+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T01:05:26.205816+0000","last_clean_scrub_stamp":"2024-09-12T01:05:26.205816+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:41.934254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":17410,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'38","reported_seq":158,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.775241+0000","last_change":"2024-09-12T01:05:13.775104+0000","last_active":"2024-09-12T01:05:13.775241+0000","last_peered":"2024-09-12T01:05:13.775241+0000","last_clean":"2024-09-12T01:05:13.775241+0000","last_became_active":"2024-09-12T00:33:10.855257+0000","last_became_peered":"2024-09-12T00:33:10.855257+0000","last_unstale":"2024-09-12T01:05:13.775241+0000","last_undegraded":"2024-09-12T01:05:13.775241+0000","last_fullsized":"2024-09-12T01:05:13.775241+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'38","last_scrub_stamp":"2024-09-12T01:05:13.774920+0000","last_deep_scrub":"268'38","last_deep_scrub_stamp":"2024-09-12T01:05:13.774920+0000","last_clean_scrub_stamp":"2024-09-12T01:05:13.774920+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:22.509428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":126,"num_write":70,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:37.474805+0000","last_change":"2024-09-12T01:05:37.474805+0000","last_active":"2024-09-12T01:05:37.474805+0000","last_peered":"2024-09-12T01:05:37.474805+0000","last_clean":"2024-09-12T01:05:37.474805+0000","last_became_active":"2024-09-12T00:46:09.504114+0000","last_became_peered":"2024-09-12T00:46:09.504114+0000","last_unstale":"2024-09-12T01:05:37.474805+0000","last_undegraded":"2024-09-12T01:05:37.474805+0000","last_fullsized":"2024-09-12T01:05:37.474805+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:37.474628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:37.474628+0000","last_clean_scrub_stamp":"2024-09-12T01:05:37.474628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:18.789397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'2","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:42.985065+0000","last_change":"2024-09-12T01:05:42.985065+0000","last_active":"2024-09-12T01:05:42.985065+0000","last_peered":"2024-09-12T01:05:42.985065+0000","last_clean":"2024-09-12T01:05:42.985065+0000","last_became_active":"2024-09-12T00:34:55.234795+0000","last_became_peered":"2024-09-12T00:34:55.234795+0000","last_unstale":"2024-09-12T01:05:42.985065+0000","last_undegraded":"2024-09-12T01:05:42.985065+0000","last_fullsized":"2024-09-12T01:05:42.985065+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:05:42.984730+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:05:42.984730+0000","last_clean_scrub_stamp":"2024-09-12T01:05:42.984730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:09.905663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"268'7","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:28.379291+0000","last_change":"2024-09-12T01:05:28.379291+0000","last_active":"2024-09-12T01:05:28.379291+0000","last_peered":"2024-09-12T01:05:28.379291+0000","last_clean":"2024-09-12T01:05:28.379291+0000","last_became_active":"2024-09-12T00:34:52.198346+0000","last_became_peered":"2024-09-12T00:34:52.198346+0000","last_unstale":"2024-09-12T01:05:28.379291+0000","last_undegraded":"2024-09-12T01:05:28.379291+0000","last_fullsized":"2024-09-12T01:05:28.379291+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-12T01:05:28.379115+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-12T01:05:28.379115+0000","last_clean_scrub_stamp":"2024-09-12T01:05:28.379115+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:47.902643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'29","reported_seq":139,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:24.038827+0000","last_change":"2024-09-12T01:05:24.038574+0000","last_active":"2024-09-12T01:05:24.038827+0000","last_peered":"2024-09-12T01:05:24.038827+0000","last_clean":"2024-09-12T01:05:24.038827+0000","last_became_active":"2024-09-12T00:33:10.847386+0000","last_became_peered":"2024-09-12T00:33:10.847386+0000","last_unstale":"2024-09-12T01:05:24.038827+0000","last_undegraded":"2024-09-12T01:05:24.038827+0000","last_fullsized":"2024-09-12T01:05:24.038827+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'29","last_scrub_stamp":"2024-09-12T01:05:24.038360+0000","last_deep_scrub":"268'29","last_deep_scrub_stamp":"2024-09-12T01:05:24.038360+0000","last_clean_scrub_stamp":"2024-09-12T01:05:24.038360+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:05.679964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":106,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:32.480211+0000","last_change":"2024-09-12T01:05:32.480211+0000","last_active":"2024-09-12T01:05:32.480211+0000","last_peered":"2024-09-12T01:05:32.480211+0000","last_clean":"2024-09-12T01:05:32.480211+0000","last_became_active":"2024-09-12T00:46:09.509685+0000","last_became_peered":"2024-09-12T00:46:09.509685+0000","last_unstale":"2024-09-12T01:05:32.480211+0000","last_undegraded":"2024-09-12T01:05:32.480211+0000","last_fullsized":"2024-09-12T01:05:32.480211+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:32.480026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:32.480026+0000","last_clean_scrub_stamp":"2024-09-12T01:05:32.480026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:16.998203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"268'2","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:37.036367+0000","last_change":"2024-09-12T01:05:37.036367+0000","last_active":"2024-09-12T01:05:37.036367+0000","last_peered":"2024-09-12T01:05:37.036367+0000","last_clean":"2024-09-12T01:05:37.036367+0000","last_became_active":"2024-09-12T00:34:55.251057+0000","last_became_peered":"2024-09-12T00:34:55.251057+0000","last_unstale":"2024-09-12T01:05:37.036367+0000","last_undegraded":"2024-09-12T01:05:37.036367+0000","last_fullsized":"2024-09-12T01:05:37.036367+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:37.036184+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:37.036184+0000","last_clean_scrub_stamp":"2024-09-12T01:05:37.036184+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:51.624947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"268'6","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.455561+0000","last_change":"2024-09-12T01:05:09.455561+0000","last_active":"2024-09-12T01:05:09.455561+0000","last_peered":"2024-09-12T01:05:09.455561+0000","last_clean":"2024-09-12T01:05:09.455561+0000","last_became_active":"2024-09-12T00:34:52.177088+0000","last_became_peered":"2024-09-12T00:34:52.177088+0000","last_unstale":"2024-09-12T01:05:09.455561+0000","last_undegraded":"2024-09-12T01:05:09.455561+0000","last_fullsized":"2024-09-12T01:05:09.455561+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T01:05:09.455387+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T01:05:09.455387+0000","last_clean_scrub_stamp":"2024-09-12T01:05:09.455387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:39.598065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"268'21","reported_seq":112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:18.814656+0000","last_change":"2024-09-12T01:05:18.814452+0000","last_active":"2024-09-12T01:05:18.814656+0000","last_peered":"2024-09-12T01:05:18.814656+0000","last_clean":"2024-09-12T01:05:18.814656+0000","last_became_active":"2024-09-12T00:33:10.844093+0000","last_became_peered":"2024-09-12T00:33:10.844093+0000","last_unstale":"2024-09-12T01:05:18.814656+0000","last_undegraded":"2024-09-12T01:05:18.814656+0000","last_fullsized":"2024-09-12T01:05:18.814656+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'21","last_scrub_stamp":"2024-09-12T01:05:18.814273+0000","last_deep_scrub":"268'21","last_deep_scrub_stamp":"2024-09-12T01:05:18.814273+0000","last_clean_scrub_stamp":"2024-09-12T01:05:18.814273+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:27.972849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":69,"num_write":38,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:26.499156+0000","last_change":"2024-09-12T01:05:26.499156+0000","last_active":"2024-09-12T01:05:26.499156+0000","last_peered":"2024-09-12T01:05:26.499156+0000","last_clean":"2024-09-12T01:05:26.499156+0000","last_became_active":"2024-09-12T00:46:09.497751+0000","last_became_peered":"2024-09-12T00:46:09.497751+0000","last_unstale":"2024-09-12T01:05:26.499156+0000","last_undegraded":"2024-09-12T01:05:26.499156+0000","last_fullsized":"2024-09-12T01:05:26.499156+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:26.498937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:26.498937+0000","last_clean_scrub_stamp":"2024-09-12T01:05:26.498937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:49.533104+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:32.457818+0000","last_change":"2024-09-12T01:05:32.457818+0000","last_active":"2024-09-12T01:05:32.457818+0000","last_peered":"2024-09-12T01:05:32.457818+0000","last_clean":"2024-09-12T01:05:32.457818+0000","last_became_active":"2024-09-12T00:34:55.254446+0000","last_became_peered":"2024-09-12T00:34:55.254446+0000","last_unstale":"2024-09-12T01:05:32.457818+0000","last_undegraded":"2024-09-12T01:05:32.457818+0000","last_fullsized":"2024-09-12T01:05:32.457818+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:32.457635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:32.457635+0000","last_clean_scrub_stamp":"2024-09-12T01:05:32.457635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:11.026076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:26.477520+0000","last_change":"2024-09-12T01:05:26.477520+0000","last_active":"2024-09-12T01:05:26.477520+0000","last_peered":"2024-09-12T01:05:26.477520+0000","last_clean":"2024-09-12T01:05:26.477520+0000","last_became_active":"2024-09-12T00:34:52.193306+0000","last_became_peered":"2024-09-12T00:34:52.193306+0000","last_unstale":"2024-09-12T01:05:26.477520+0000","last_undegraded":"2024-09-12T01:05:26.477520+0000","last_fullsized":"2024-09-12T01:05:26.477520+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:26.477332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:26.477332+0000","last_clean_scrub_stamp":"2024-09-12T01:05:26.477332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:30.919699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"268'36","reported_seq":160,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:22.406472+0000","last_change":"2024-09-12T01:05:22.406472+0000","last_active":"2024-09-12T01:05:22.406472+0000","last_peered":"2024-09-12T01:05:22.406472+0000","last_clean":"2024-09-12T01:05:22.406472+0000","last_became_active":"2024-09-12T00:33:10.859799+0000","last_became_peered":"2024-09-12T00:33:10.859799+0000","last_unstale":"2024-09-12T01:05:22.406472+0000","last_undegraded":"2024-09-12T01:05:22.406472+0000","last_fullsized":"2024-09-12T01:05:22.406472+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'36","last_scrub_stamp":"2024-09-12T01:05:22.406297+0000","last_deep_scrub":"268'36","last_deep_scrub_stamp":"2024-09-12T01:05:22.406297+0000","last_clean_scrub_stamp":"2024-09-12T01:05:22.406297+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:06.893957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":137,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:34.217673+0000","last_change":"2024-09-12T01:05:34.217673+0000","last_active":"2024-09-12T01:05:34.217673+0000","last_peered":"2024-09-12T01:05:34.217673+0000","last_clean":"2024-09-12T01:05:34.217673+0000","last_became_active":"2024-09-12T00:46:09.498942+0000","last_became_peered":"2024-09-12T00:46:09.498942+0000","last_unstale":"2024-09-12T01:05:34.217673+0000","last_undegraded":"2024-09-12T01:05:34.217673+0000","last_fullsized":"2024-09-12T01:05:34.217673+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:34.217494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:34.217494+0000","last_clean_scrub_stamp":"2024-09-12T01:05:34.217494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:32.460009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'2","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:31.192948+0000","last_change":"2024-09-12T01:05:31.192948+0000","last_active":"2024-09-12T01:05:31.192948+0000","last_peered":"2024-09-12T01:05:31.192948+0000","last_clean":"2024-09-12T01:05:31.192948+0000","last_became_active":"2024-09-12T00:34:55.214265+0000","last_became_peered":"2024-09-12T00:34:55.214265+0000","last_unstale":"2024-09-12T01:05:31.192948+0000","last_undegraded":"2024-09-12T01:05:31.192948+0000","last_fullsized":"2024-09-12T01:05:31.192948+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:31.192759+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:31.192759+0000","last_clean_scrub_stamp":"2024-09-12T01:05:31.192759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:40.634332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"268'9","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.417229+0000","last_change":"2024-09-12T01:05:29.417229+0000","last_active":"2024-09-12T01:05:29.417229+0000","last_peered":"2024-09-12T01:05:29.417229+0000","last_clean":"2024-09-12T01:05:29.417229+0000","last_became_active":"2024-09-12T00:34:52.204050+0000","last_became_peered":"2024-09-12T00:34:52.204050+0000","last_unstale":"2024-09-12T01:05:29.417229+0000","last_undegraded":"2024-09-12T01:05:29.417229+0000","last_fullsized":"2024-09-12T01:05:29.417229+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'9","last_scrub_stamp":"2024-09-12T01:05:29.417033+0000","last_deep_scrub":"268'9","last_deep_scrub_stamp":"2024-09-12T01:05:29.417033+0000","last_clean_scrub_stamp":"2024-09-12T01:05:29.417033+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:48.658895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5120,"num_write":14,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'20","reported_seq":112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:17.524208+0000","last_change":"2024-09-12T01:05:17.524208+0000","last_active":"2024-09-12T01:05:17.524208+0000","last_peered":"2024-09-12T01:05:17.524208+0000","last_clean":"2024-09-12T01:05:17.524208+0000","last_became_active":"2024-09-12T00:33:10.841411+0000","last_became_peered":"2024-09-12T00:33:10.841411+0000","last_unstale":"2024-09-12T01:05:17.524208+0000","last_undegraded":"2024-09-12T01:05:17.524208+0000","last_fullsized":"2024-09-12T01:05:17.524208+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'20","last_scrub_stamp":"2024-09-12T01:05:17.523976+0000","last_deep_scrub":"268'20","last_deep_scrub_stamp":"2024-09-12T01:05:17.523976+0000","last_clean_scrub_stamp":"2024-09-12T01:05:17.523976+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:40.341379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":70,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"268'2","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:12.411578+0000","last_change":"2024-09-12T01:05:12.411412+0000","last_active":"2024-09-12T01:05:12.411578+0000","last_peered":"2024-09-12T01:05:12.411578+0000","last_clean":"2024-09-12T01:05:12.411578+0000","last_became_active":"2024-09-12T00:46:09.520251+0000","last_became_peered":"2024-09-12T00:46:09.520251+0000","last_unstale":"2024-09-12T01:05:12.411578+0000","last_undegraded":"2024-09-12T01:05:12.411578+0000","last_fullsized":"2024-09-12T01:05:12.411578+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:12.411232+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:12.411232+0000","last_clean_scrub_stamp":"2024-09-12T01:05:12.411232+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:29.274957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"268'5","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:21.570025+0000","last_change":"2024-09-12T01:05:21.570025+0000","last_active":"2024-09-12T01:05:21.570025+0000","last_peered":"2024-09-12T01:05:21.570025+0000","last_clean":"2024-09-12T01:05:21.570025+0000","last_became_active":"2024-09-12T00:34:55.230698+0000","last_became_peered":"2024-09-12T00:34:55.230698+0000","last_unstale":"2024-09-12T01:05:21.570025+0000","last_undegraded":"2024-09-12T01:05:21.570025+0000","last_fullsized":"2024-09-12T01:05:21.570025+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-12T01:05:21.569842+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-12T01:05:21.569842+0000","last_clean_scrub_stamp":"2024-09-12T01:05:21.569842+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:03.786355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"265'5","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:26.414797+0000","last_change":"2024-09-12T01:05:26.414797+0000","last_active":"2024-09-12T01:05:26.414797+0000","last_peered":"2024-09-12T01:05:26.414797+0000","last_clean":"2024-09-12T01:05:26.414797+0000","last_became_active":"2024-09-12T00:34:52.211709+0000","last_became_peered":"2024-09-12T00:34:52.211709+0000","last_unstale":"2024-09-12T01:05:26.414797+0000","last_undegraded":"2024-09-12T01:05:26.414797+0000","last_fullsized":"2024-09-12T01:05:26.414797+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:05:26.414506+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:05:26.414506+0000","last_clean_scrub_stamp":"2024-09-12T01:05:26.414506+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:56.218833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'227","reported_seq":761,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:24.559414+0000","last_change":"2024-09-12T01:05:24.559414+0000","last_active":"2024-09-12T01:05:24.559414+0000","last_peered":"2024-09-12T01:05:24.559414+0000","last_clean":"2024-09-12T01:05:24.559414+0000","last_became_active":"2024-09-12T00:33:10.852751+0000","last_became_peered":"2024-09-12T00:33:10.852751+0000","last_unstale":"2024-09-12T01:05:24.559414+0000","last_undegraded":"2024-09-12T01:05:24.559414+0000","last_fullsized":"2024-09-12T01:05:24.559414+0000","mapping_epoch":255,"log_start":"265'200","ondisk_log_start":"265'200","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'227","last_scrub_stamp":"2024-09-12T01:05:24.559221+0000","last_deep_scrub":"268'227","last_deep_scrub_stamp":"2024-09-12T01:05:24.559221+0000","last_clean_scrub_stamp":"2024-09-12T01:05:24.559221+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:26.843031+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1385,"num_read_kb":1074,"num_write":267,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5969,"num_omap_keys":12,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:38.036094+0000","last_change":"2024-09-12T01:05:38.035922+0000","last_active":"2024-09-12T01:05:38.036094+0000","last_peered":"2024-09-12T01:05:38.036094+0000","last_clean":"2024-09-12T01:05:38.036094+0000","last_became_active":"2024-09-12T00:46:09.516404+0000","last_became_peered":"2024-09-12T00:46:09.516404+0000","last_unstale":"2024-09-12T01:05:38.036094+0000","last_undegraded":"2024-09-12T01:05:38.036094+0000","last_fullsized":"2024-09-12T01:05:38.036094+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:38.035738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:38.035738+0000","last_clean_scrub_stamp":"2024-09-12T01:05:38.035738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:57.224049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"268'8","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.448368+0000","last_change":"2024-09-12T01:05:29.448368+0000","last_active":"2024-09-12T01:05:29.448368+0000","last_peered":"2024-09-12T01:05:29.448368+0000","last_clean":"2024-09-12T01:05:29.448368+0000","last_became_active":"2024-09-12T00:34:55.235522+0000","last_became_peered":"2024-09-12T00:34:55.235522+0000","last_unstale":"2024-09-12T01:05:29.448368+0000","last_undegraded":"2024-09-12T01:05:29.448368+0000","last_fullsized":"2024-09-12T01:05:29.448368+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-12T01:05:29.448184+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-12T01:05:29.448184+0000","last_clean_scrub_stamp":"2024-09-12T01:05:29.448184+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:43.934073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":10240,"num_write":8,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"268'6","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:27.384368+0000","last_change":"2024-09-12T01:05:27.384368+0000","last_active":"2024-09-12T01:05:27.384368+0000","last_peered":"2024-09-12T01:05:27.384368+0000","last_clean":"2024-09-12T01:05:27.384368+0000","last_became_active":"2024-09-12T00:34:52.183769+0000","last_became_peered":"2024-09-12T00:34:52.183769+0000","last_unstale":"2024-09-12T01:05:27.384368+0000","last_undegraded":"2024-09-12T01:05:27.384368+0000","last_fullsized":"2024-09-12T01:05:27.384368+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T01:05:27.384180+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T01:05:27.384180+0000","last_clean_scrub_stamp":"2024-09-12T01:05:27.384180+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:55.187847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'27","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:24.191200+0000","last_change":"2024-09-12T01:05:24.191200+0000","last_active":"2024-09-12T01:05:24.191200+0000","last_peered":"2024-09-12T01:05:24.191200+0000","last_clean":"2024-09-12T01:05:24.191200+0000","last_became_active":"2024-09-12T00:33:10.830931+0000","last_became_peered":"2024-09-12T00:33:10.830931+0000","last_unstale":"2024-09-12T01:05:24.191200+0000","last_undegraded":"2024-09-12T01:05:24.191200+0000","last_fullsized":"2024-09-12T01:05:24.191200+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'27","last_scrub_stamp":"2024-09-12T01:05:24.191028+0000","last_deep_scrub":"268'27","last_deep_scrub_stamp":"2024-09-12T01:05:24.191028+0000","last_clean_scrub_stamp":"2024-09-12T01:05:24.191028+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:31.010155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":90,"num_write":55,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:39.016366+0000","last_change":"2024-09-12T01:05:39.016366+0000","last_active":"2024-09-12T01:05:39.016366+0000","last_peered":"2024-09-12T01:05:39.016366+0000","last_clean":"2024-09-12T01:05:39.016366+0000","last_became_active":"2024-09-12T00:46:09.517353+0000","last_became_peered":"2024-09-12T00:46:09.517353+0000","last_unstale":"2024-09-12T01:05:39.016366+0000","last_undegraded":"2024-09-12T01:05:39.016366+0000","last_fullsized":"2024-09-12T01:05:39.016366+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:39.016159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:39.016159+0000","last_clean_scrub_stamp":"2024-09-12T01:05:39.016159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:43.077357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"268'9","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.856906+0000","last_change":"2024-09-12T01:05:19.856906+0000","last_active":"2024-09-12T01:05:19.856906+0000","last_peered":"2024-09-12T01:05:19.856906+0000","last_clean":"2024-09-12T01:05:19.856906+0000","last_became_active":"2024-09-12T00:34:55.224353+0000","last_became_peered":"2024-09-12T00:34:55.224353+0000","last_unstale":"2024-09-12T01:05:19.856906+0000","last_undegraded":"2024-09-12T01:05:19.856906+0000","last_fullsized":"2024-09-12T01:05:19.856906+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'9","last_scrub_stamp":"2024-09-12T01:05:19.856714+0000","last_deep_scrub":"268'9","last_deep_scrub_stamp":"2024-09-12T01:05:19.856714+0000","last_clean_scrub_stamp":"2024-09-12T01:05:19.856714+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:42.593775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":22530,"num_write":14,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"268'6","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:16.484378+0000","last_change":"2024-09-12T01:05:16.484378+0000","last_active":"2024-09-12T01:05:16.484378+0000","last_peered":"2024-09-12T01:05:16.484378+0000","last_clean":"2024-09-12T01:05:16.484378+0000","last_became_active":"2024-09-12T00:34:52.203625+0000","last_became_peered":"2024-09-12T00:34:52.203625+0000","last_unstale":"2024-09-12T01:05:16.484378+0000","last_undegraded":"2024-09-12T01:05:16.484378+0000","last_fullsized":"2024-09-12T01:05:16.484378+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T01:05:16.484199+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T01:05:16.484199+0000","last_clean_scrub_stamp":"2024-09-12T01:05:16.484199+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:39.312697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10299,"num_write":6,"num_write_kb":5179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'24","reported_seq":119,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:12.783107+0000","last_change":"2024-09-12T01:05:12.783107+0000","last_active":"2024-09-12T01:05:12.783107+0000","last_peered":"2024-09-12T01:05:12.783107+0000","last_clean":"2024-09-12T01:05:12.783107+0000","last_became_active":"2024-09-12T00:33:10.844416+0000","last_became_peered":"2024-09-12T00:33:10.844416+0000","last_unstale":"2024-09-12T01:05:12.783107+0000","last_undegraded":"2024-09-12T01:05:12.783107+0000","last_fullsized":"2024-09-12T01:05:12.783107+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'24","last_scrub_stamp":"2024-09-12T01:05:12.782924+0000","last_deep_scrub":"268'24","last_deep_scrub_stamp":"2024-09-12T01:05:12.782924+0000","last_clean_scrub_stamp":"2024-09-12T01:05:12.782924+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:59.667045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:35.487734+0000","last_change":"2024-09-12T01:05:35.487734+0000","last_active":"2024-09-12T01:05:35.487734+0000","last_peered":"2024-09-12T01:05:35.487734+0000","last_clean":"2024-09-12T01:05:35.487734+0000","last_became_active":"2024-09-12T00:46:09.493808+0000","last_became_peered":"2024-09-12T00:46:09.493808+0000","last_unstale":"2024-09-12T01:05:35.487734+0000","last_undegraded":"2024-09-12T01:05:35.487734+0000","last_fullsized":"2024-09-12T01:05:35.487734+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:35.487553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:35.487553+0000","last_clean_scrub_stamp":"2024-09-12T01:05:35.487553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:01.345463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"268'2","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:30.162390+0000","last_change":"2024-09-12T01:05:30.162390+0000","last_active":"2024-09-12T01:05:30.162390+0000","last_peered":"2024-09-12T01:05:30.162390+0000","last_clean":"2024-09-12T01:05:30.162390+0000","last_became_active":"2024-09-12T00:34:55.233708+0000","last_became_peered":"2024-09-12T00:34:55.233708+0000","last_unstale":"2024-09-12T01:05:30.162390+0000","last_undegraded":"2024-09-12T01:05:30.162390+0000","last_fullsized":"2024-09-12T01:05:30.162390+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:30.162203+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:30.162203+0000","last_clean_scrub_stamp":"2024-09-12T01:05:30.162203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:23.957891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"268'2","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:17.809390+0000","last_change":"2024-09-12T01:05:17.809390+0000","last_active":"2024-09-12T01:05:17.809390+0000","last_peered":"2024-09-12T01:05:17.809390+0000","last_clean":"2024-09-12T01:05:17.809390+0000","last_became_active":"2024-09-12T00:34:52.186234+0000","last_became_peered":"2024-09-12T00:34:52.186234+0000","last_unstale":"2024-09-12T01:05:17.809390+0000","last_undegraded":"2024-09-12T01:05:17.809390+0000","last_fullsized":"2024-09-12T01:05:17.809390+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:17.809194+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:17.809194+0000","last_clean_scrub_stamp":"2024-09-12T01:05:17.809194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:21.580344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'27","reported_seq":135,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:21.384237+0000","last_change":"2024-09-12T01:05:21.383982+0000","last_active":"2024-09-12T01:05:21.384237+0000","last_peered":"2024-09-12T01:05:21.384237+0000","last_clean":"2024-09-12T01:05:21.384237+0000","last_became_active":"2024-09-12T00:33:10.853205+0000","last_became_peered":"2024-09-12T00:33:10.853205+0000","last_unstale":"2024-09-12T01:05:21.384237+0000","last_undegraded":"2024-09-12T01:05:21.384237+0000","last_fullsized":"2024-09-12T01:05:21.384237+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'27","last_scrub_stamp":"2024-09-12T01:05:21.383773+0000","last_deep_scrub":"268'27","last_deep_scrub_stamp":"2024-09-12T01:05:21.383773+0000","last_clean_scrub_stamp":"2024-09-12T01:05:21.383773+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:56.970901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":100,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'373","reported_seq":1028,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.548055+0000","last_change":"2024-09-12T01:04:59.548055+0000","last_active":"2024-09-12T01:04:59.548055+0000","last_peered":"2024-09-12T01:04:59.548055+0000","last_clean":"2024-09-12T01:04:59.548055+0000","last_became_active":"2024-09-12T00:18:22.878117+0000","last_became_peered":"2024-09-12T00:18:22.878117+0000","last_unstale":"2024-09-12T01:04:59.548055+0000","last_undegraded":"2024-09-12T01:04:59.548055+0000","last_fullsized":"2024-09-12T01:04:59.548055+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'373","last_scrub_stamp":"2024-09-12T01:04:59.547794+0000","last_deep_scrub":"268'373","last_deep_scrub_stamp":"2024-09-12T01:04:59.547794+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.547794+0000","objects_scrubbed":10,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:34.105495+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":522,"num_read_kb":62534,"num_write":1202,"num_write_kb":43415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'437","reported_seq":1887,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.459888+0000","last_change":"2024-09-12T01:05:05.459888+0000","last_active":"2024-09-12T01:05:05.459888+0000","last_peered":"2024-09-12T01:05:05.459888+0000","last_clean":"2024-09-12T01:05:05.459888+0000","last_became_active":"2024-09-12T00:18:24.870370+0000","last_became_peered":"2024-09-12T00:18:24.870370+0000","last_unstale":"2024-09-12T01:05:05.459888+0000","last_undegraded":"2024-09-12T01:05:05.459888+0000","last_fullsized":"2024-09-12T01:05:05.459888+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'437","last_scrub_stamp":"2024-09-12T01:05:05.459689+0000","last_deep_scrub":"268'437","last_deep_scrub_stamp":"2024-09-12T01:05:05.459689+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.459689+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:46.800171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2205,"num_read_kb":2060,"num_write":503,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'344","reported_seq":997,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.586245+0000","last_change":"2024-09-12T01:04:52.586245+0000","last_active":"2024-09-12T01:04:52.586245+0000","last_peered":"2024-09-12T01:04:52.586245+0000","last_clean":"2024-09-12T01:04:52.586245+0000","last_became_active":"2024-09-12T00:18:22.845439+0000","last_became_peered":"2024-09-12T00:18:22.845439+0000","last_unstale":"2024-09-12T01:04:52.586245+0000","last_undegraded":"2024-09-12T01:04:52.586245+0000","last_fullsized":"2024-09-12T01:04:52.586245+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'344","last_scrub_stamp":"2024-09-12T01:04:52.586024+0000","last_deep_scrub":"268'344","last_deep_scrub_stamp":"2024-09-12T01:04:52.586024+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.586024+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:26.976158+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079947,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":485,"num_read_kb":5684,"num_write":1011,"num_write_kb":33510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'1351","reported_seq":3046,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.531548+0000","last_change":"2024-09-12T01:05:04.531548+0000","last_active":"2024-09-12T01:05:04.531548+0000","last_peered":"2024-09-12T01:05:04.531548+0000","last_clean":"2024-09-12T01:05:04.531548+0000","last_became_active":"2024-09-12T00:18:24.866026+0000","last_became_peered":"2024-09-12T00:18:24.866026+0000","last_unstale":"2024-09-12T01:05:04.531548+0000","last_undegraded":"2024-09-12T01:05:04.531548+0000","last_fullsized":"2024-09-12T01:05:04.531548+0000","mapping_epoch":26,"log_start":"268'1300","ondisk_log_start":"268'1300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1351","last_scrub_stamp":"2024-09-12T01:05:04.531372+0000","last_deep_scrub":"268'1351","last_deep_scrub_stamp":"2024-09-12T01:05:04.531372+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.531372+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":1300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:45.952638+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6196,"num_read_kb":5451,"num_write":1895,"num_write_kb":802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'348","reported_seq":1045,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.215693+0000","last_change":"2024-09-12T01:04:52.215693+0000","last_active":"2024-09-12T01:04:52.215693+0000","last_peered":"2024-09-12T01:04:52.215693+0000","last_clean":"2024-09-12T01:04:52.215693+0000","last_became_active":"2024-09-12T00:18:22.839379+0000","last_became_peered":"2024-09-12T00:18:22.839379+0000","last_unstale":"2024-09-12T01:04:52.215693+0000","last_undegraded":"2024-09-12T01:04:52.215693+0000","last_fullsized":"2024-09-12T01:04:52.215693+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'348","last_scrub_stamp":"2024-09-12T01:04:52.215433+0000","last_deep_scrub":"268'348","last_deep_scrub_stamp":"2024-09-12T01:04:52.215433+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.215433+0000","objects_scrubbed":9,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:02.897096+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560796,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":569,"num_read_kb":68999,"num_write":1084,"num_write_kb":32744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'870","reported_seq":2683,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:06.211516+0000","last_change":"2024-09-12T01:05:06.211516+0000","last_active":"2024-09-12T01:05:06.211516+0000","last_peered":"2024-09-12T01:05:06.211516+0000","last_clean":"2024-09-12T01:05:06.211516+0000","last_became_active":"2024-09-12T00:18:24.860995+0000","last_became_peered":"2024-09-12T00:18:24.860995+0000","last_unstale":"2024-09-12T01:05:06.211516+0000","last_undegraded":"2024-09-12T01:05:06.211516+0000","last_fullsized":"2024-09-12T01:05:06.211516+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'870","last_scrub_stamp":"2024-09-12T01:05:06.211336+0000","last_deep_scrub":"268'870","last_deep_scrub_stamp":"2024-09-12T01:05:06.211336+0000","last_clean_scrub_stamp":"2024-09-12T01:05:06.211336+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":800,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:09.525854+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4298,"num_read_kb":3905,"num_write":1128,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'339","reported_seq":1004,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.529175+0000","last_change":"2024-09-12T01:04:58.529175+0000","last_active":"2024-09-12T01:04:58.529175+0000","last_peered":"2024-09-12T01:04:58.529175+0000","last_clean":"2024-09-12T01:04:58.529175+0000","last_became_active":"2024-09-12T00:18:55.960413+0000","last_became_peered":"2024-09-12T00:18:55.960413+0000","last_unstale":"2024-09-12T01:04:58.529175+0000","last_undegraded":"2024-09-12T01:04:58.529175+0000","last_fullsized":"2024-09-12T01:04:58.529175+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'339","last_scrub_stamp":"2024-09-12T01:04:58.528952+0000","last_deep_scrub":"268'339","last_deep_scrub_stamp":"2024-09-12T01:04:58.528952+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.528952+0000","objects_scrubbed":7,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:06.429511+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":867046,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":485,"num_read_kb":54980,"num_write":1073,"num_write_kb":32836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'768","reported_seq":2325,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.385618+0000","last_change":"2024-09-12T01:05:02.385618+0000","last_active":"2024-09-12T01:05:02.385618+0000","last_peered":"2024-09-12T01:05:02.385618+0000","last_clean":"2024-09-12T01:05:02.385618+0000","last_became_active":"2024-09-12T00:18:55.955870+0000","last_became_peered":"2024-09-12T00:18:55.955870+0000","last_unstale":"2024-09-12T01:05:02.385618+0000","last_undegraded":"2024-09-12T01:05:02.385618+0000","last_fullsized":"2024-09-12T01:05:02.385618+0000","mapping_epoch":37,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'768","last_scrub_stamp":"2024-09-12T01:05:02.385449+0000","last_deep_scrub":"268'768","last_deep_scrub_stamp":"2024-09-12T01:05:02.385449+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.385449+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:32.646103+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3626,"num_read_kb":3280,"num_write":1010,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'340","reported_seq":977,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.507042+0000","last_change":"2024-09-12T01:04:58.507042+0000","last_active":"2024-09-12T01:04:58.507042+0000","last_peered":"2024-09-12T01:04:58.507042+0000","last_clean":"2024-09-12T01:04:58.507042+0000","last_became_active":"2024-09-12T00:18:22.870564+0000","last_became_peered":"2024-09-12T00:18:22.870564+0000","last_unstale":"2024-09-12T01:04:58.507042+0000","last_undegraded":"2024-09-12T01:04:58.507042+0000","last_fullsized":"2024-09-12T01:04:58.507042+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'340","last_scrub_stamp":"2024-09-12T01:04:58.506853+0000","last_deep_scrub":"268'340","last_deep_scrub_stamp":"2024-09-12T01:04:58.506853+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.506853+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:49.221170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":498,"num_read_kb":32133,"num_write":1040,"num_write_kb":41090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"268'487","reported_seq":2096,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.680342+0000","last_change":"2024-09-12T01:05:01.680342+0000","last_active":"2024-09-12T01:05:01.680342+0000","last_peered":"2024-09-12T01:05:01.680342+0000","last_clean":"2024-09-12T01:05:01.680342+0000","last_became_active":"2024-09-12T00:18:24.846508+0000","last_became_peered":"2024-09-12T00:18:24.846508+0000","last_unstale":"2024-09-12T01:05:01.680342+0000","last_undegraded":"2024-09-12T01:05:01.680342+0000","last_fullsized":"2024-09-12T01:05:01.680342+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'487","last_scrub_stamp":"2024-09-12T01:05:01.680166+0000","last_deep_scrub":"268'487","last_deep_scrub_stamp":"2024-09-12T01:05:01.680166+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.680166+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:35.737714+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2844,"num_read_kb":2655,"num_write":659,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'358","reported_seq":1001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.546009+0000","last_change":"2024-09-12T01:04:59.546009+0000","last_active":"2024-09-12T01:04:59.546009+0000","last_peered":"2024-09-12T01:04:59.546009+0000","last_clean":"2024-09-12T01:04:59.546009+0000","last_became_active":"2024-09-12T00:18:22.861074+0000","last_became_peered":"2024-09-12T00:18:22.861074+0000","last_unstale":"2024-09-12T01:04:59.546009+0000","last_undegraded":"2024-09-12T01:04:59.546009+0000","last_fullsized":"2024-09-12T01:04:59.546009+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'358","last_scrub_stamp":"2024-09-12T01:04:59.545680+0000","last_deep_scrub":"268'358","last_deep_scrub_stamp":"2024-09-12T01:04:59.545680+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.545680+0000","objects_scrubbed":9,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:21.773761+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":434032,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":541,"num_read_kb":4860,"num_write":1084,"num_write_kb":10925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'1021","reported_seq":2758,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:07.211509+0000","last_change":"2024-09-12T01:05:07.211509+0000","last_active":"2024-09-12T01:05:07.211509+0000","last_peered":"2024-09-12T01:05:07.211509+0000","last_clean":"2024-09-12T01:05:07.211509+0000","last_became_active":"2024-09-12T00:18:24.875913+0000","last_became_peered":"2024-09-12T00:18:24.875913+0000","last_unstale":"2024-09-12T01:05:07.211509+0000","last_undegraded":"2024-09-12T01:05:07.211509+0000","last_fullsized":"2024-09-12T01:05:07.211509+0000","mapping_epoch":26,"log_start":"268'1000","ondisk_log_start":"268'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1021","last_scrub_stamp":"2024-09-12T01:05:07.211320+0000","last_deep_scrub":"268'1021","last_deep_scrub_stamp":"2024-09-12T01:05:07.211320+0000","last_clean_scrub_stamp":"2024-09-12T01:05:07.211320+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":1000,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:52.009817+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4809,"num_read_kb":4259,"num_write":1397,"num_write_kb":538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'291","reported_seq":886,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.436540+0000","last_change":"2024-09-12T01:04:50.436366+0000","last_active":"2024-09-12T01:04:50.436540+0000","last_peered":"2024-09-12T01:04:50.436540+0000","last_clean":"2024-09-12T01:04:50.436540+0000","last_became_active":"2024-09-12T00:19:56.412792+0000","last_became_peered":"2024-09-12T00:19:56.412792+0000","last_unstale":"2024-09-12T01:04:50.436540+0000","last_undegraded":"2024-09-12T01:04:50.436540+0000","last_fullsized":"2024-09-12T01:04:50.436540+0000","mapping_epoch":39,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'291","last_scrub_stamp":"2024-09-12T01:04:50.436147+0000","last_deep_scrub":"268'291","last_deep_scrub_stamp":"2024-09-12T01:04:50.436147+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.436147+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:01.502828+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1343091,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":402,"num_read_kb":40979,"num_write":972,"num_write_kb":28776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"268'468","reported_seq":2055,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:06.510587+0000","last_change":"2024-09-12T01:05:06.510587+0000","last_active":"2024-09-12T01:05:06.510587+0000","last_peered":"2024-09-12T01:05:06.510587+0000","last_clean":"2024-09-12T01:05:06.510587+0000","last_became_active":"2024-09-12T00:18:24.862084+0000","last_became_peered":"2024-09-12T00:18:24.862084+0000","last_unstale":"2024-09-12T01:05:06.510587+0000","last_undegraded":"2024-09-12T01:05:06.510587+0000","last_fullsized":"2024-09-12T01:05:06.510587+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'468","last_scrub_stamp":"2024-09-12T01:05:06.510395+0000","last_deep_scrub":"268'468","last_deep_scrub_stamp":"2024-09-12T01:05:06.510395+0000","last_clean_scrub_stamp":"2024-09-12T01:05:06.510395+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:44.814542+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2471,"num_read_kb":2327,"num_write":538,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2554,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'376","reported_seq":1031,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.132657+0000","last_change":"2024-09-12T01:04:58.132657+0000","last_active":"2024-09-12T01:04:58.132657+0000","last_peered":"2024-09-12T01:04:58.132657+0000","last_clean":"2024-09-12T01:04:58.132657+0000","last_became_active":"2024-09-12T00:18:22.867749+0000","last_became_peered":"2024-09-12T00:18:22.867749+0000","last_unstale":"2024-09-12T01:04:58.132657+0000","last_undegraded":"2024-09-12T01:04:58.132657+0000","last_fullsized":"2024-09-12T01:04:58.132657+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'376","last_scrub_stamp":"2024-09-12T01:04:58.132452+0000","last_deep_scrub":"268'376","last_deep_scrub_stamp":"2024-09-12T01:04:58.132452+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.132452+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:04.893853+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":529,"num_read_kb":6849,"num_write":1205,"num_write_kb":38257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'510","reported_seq":2335,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.460303+0000","last_change":"2024-09-12T01:04:57.460303+0000","last_active":"2024-09-12T01:04:57.460303+0000","last_peered":"2024-09-12T01:04:57.460303+0000","last_clean":"2024-09-12T01:04:57.460303+0000","last_became_active":"2024-09-12T00:18:24.848163+0000","last_became_peered":"2024-09-12T00:18:24.848163+0000","last_unstale":"2024-09-12T01:04:57.460303+0000","last_undegraded":"2024-09-12T01:04:57.460303+0000","last_fullsized":"2024-09-12T01:04:57.460303+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'510","last_scrub_stamp":"2024-09-12T01:04:57.460112+0000","last_deep_scrub":"268'510","last_deep_scrub_stamp":"2024-09-12T01:04:57.460112+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.460112+0000","objects_scrubbed":5,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:50.852262+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2972,"num_read_kb":2819,"num_write":593,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4343,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'486","reported_seq":2150,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.207575+0000","last_change":"2024-09-12T01:05:04.207348+0000","last_active":"2024-09-12T01:05:04.207575+0000","last_peered":"2024-09-12T01:05:04.207575+0000","last_clean":"2024-09-12T01:05:04.207575+0000","last_became_active":"2024-09-12T00:18:24.860744+0000","last_became_peered":"2024-09-12T00:18:24.860744+0000","last_unstale":"2024-09-12T01:05:04.207575+0000","last_undegraded":"2024-09-12T01:05:04.207575+0000","last_fullsized":"2024-09-12T01:05:04.207575+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'486","last_scrub_stamp":"2024-09-12T01:05:04.207119+0000","last_deep_scrub":"268'486","last_deep_scrub_stamp":"2024-09-12T01:05:04.207119+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.207119+0000","objects_scrubbed":2,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:40.036635+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2780,"num_read_kb":2600,"num_write":590,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'313","reported_seq":926,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.505125+0000","last_change":"2024-09-12T01:04:57.505125+0000","last_active":"2024-09-12T01:04:57.505125+0000","last_peered":"2024-09-12T01:04:57.505125+0000","last_clean":"2024-09-12T01:04:57.505125+0000","last_became_active":"2024-09-12T00:18:55.962742+0000","last_became_peered":"2024-09-12T00:18:55.962742+0000","last_unstale":"2024-09-12T01:04:57.505125+0000","last_undegraded":"2024-09-12T01:04:57.505125+0000","last_fullsized":"2024-09-12T01:04:57.505125+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'313","last_scrub_stamp":"2024-09-12T01:04:57.504907+0000","last_deep_scrub":"268'313","last_deep_scrub_stamp":"2024-09-12T01:04:57.504907+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.504907+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:14.933948+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":391,"num_read_kb":39262,"num_write":935,"num_write_kb":33071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'396","reported_seq":1858,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.519805+0000","last_change":"2024-09-12T01:05:03.519644+0000","last_active":"2024-09-12T01:05:03.519805+0000","last_peered":"2024-09-12T01:05:03.519805+0000","last_clean":"2024-09-12T01:05:03.519805+0000","last_became_active":"2024-09-12T00:18:24.872902+0000","last_became_peered":"2024-09-12T00:18:24.872902+0000","last_unstale":"2024-09-12T01:05:03.519805+0000","last_undegraded":"2024-09-12T01:05:03.519805+0000","last_fullsized":"2024-09-12T01:05:03.519805+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'396","last_scrub_stamp":"2024-09-12T01:05:03.519461+0000","last_deep_scrub":"268'396","last_deep_scrub_stamp":"2024-09-12T01:05:03.519461+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.519461+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:35.432511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2097,"num_read_kb":1984,"num_write":437,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'310","reported_seq":929,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.742459+0000","last_change":"2024-09-12T01:04:56.742459+0000","last_active":"2024-09-12T01:04:56.742459+0000","last_peered":"2024-09-12T01:04:56.742459+0000","last_clean":"2024-09-12T01:04:56.742459+0000","last_became_active":"2024-09-12T00:18:22.860078+0000","last_became_peered":"2024-09-12T00:18:22.860078+0000","last_unstale":"2024-09-12T01:04:56.742459+0000","last_undegraded":"2024-09-12T01:04:56.742459+0000","last_fullsized":"2024-09-12T01:04:56.742459+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'310","last_scrub_stamp":"2024-09-12T01:04:56.742239+0000","last_deep_scrub":"268'310","last_deep_scrub_stamp":"2024-09-12T01:04:56.742239+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.742239+0000","objects_scrubbed":5,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:19.067757+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4534636,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":413,"num_read_kb":38650,"num_write":947,"num_write_kb":29439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"268'424","reported_seq":2052,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.546888+0000","last_change":"2024-09-12T01:05:01.546750+0000","last_active":"2024-09-12T01:05:01.546888+0000","last_peered":"2024-09-12T01:05:01.546888+0000","last_clean":"2024-09-12T01:05:01.546888+0000","last_became_active":"2024-09-12T00:18:24.852029+0000","last_became_peered":"2024-09-12T00:18:24.852029+0000","last_unstale":"2024-09-12T01:05:01.546888+0000","last_undegraded":"2024-09-12T01:05:01.546888+0000","last_fullsized":"2024-09-12T01:05:01.546888+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'424","last_scrub_stamp":"2024-09-12T01:05:01.546568+0000","last_deep_scrub":"268'424","last_deep_scrub_stamp":"2024-09-12T01:05:01.546568+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.546568+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:38.718196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2334,"num_read_kb":2233,"num_write":466,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'322","reported_seq":932,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.685245+0000","last_change":"2024-09-12T01:04:51.685245+0000","last_active":"2024-09-12T01:04:51.685245+0000","last_peered":"2024-09-12T01:04:51.685245+0000","last_clean":"2024-09-12T01:04:51.685245+0000","last_became_active":"2024-09-12T00:18:22.862665+0000","last_became_peered":"2024-09-12T00:18:22.862665+0000","last_unstale":"2024-09-12T01:04:51.685245+0000","last_undegraded":"2024-09-12T01:04:51.685245+0000","last_fullsized":"2024-09-12T01:04:51.685245+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'322","last_scrub_stamp":"2024-09-12T01:04:51.685000+0000","last_deep_scrub":"268'322","last_deep_scrub_stamp":"2024-09-12T01:04:51.685000+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.685000+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:57.317903+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079909,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":401,"num_read_kb":22932,"num_write":945,"num_write_kb":21492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'477","reported_seq":2108,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.503805+0000","last_change":"2024-09-12T01:04:54.503805+0000","last_active":"2024-09-12T01:04:54.503805+0000","last_peered":"2024-09-12T01:04:54.503805+0000","last_clean":"2024-09-12T01:04:54.503805+0000","last_became_active":"2024-09-12T00:18:24.849491+0000","last_became_peered":"2024-09-12T00:18:24.849491+0000","last_unstale":"2024-09-12T01:04:54.503805+0000","last_undegraded":"2024-09-12T01:04:54.503805+0000","last_fullsized":"2024-09-12T01:04:54.503805+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'477","last_scrub_stamp":"2024-09-12T01:04:54.503576+0000","last_deep_scrub":"268'477","last_deep_scrub_stamp":"2024-09-12T01:04:54.503576+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.503576+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:40.594497+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2579,"num_read_kb":2421,"num_write":543,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'353","reported_seq":986,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.198312+0000","last_change":"2024-09-12T01:04:51.198312+0000","last_active":"2024-09-12T01:04:51.198312+0000","last_peered":"2024-09-12T01:04:51.198312+0000","last_clean":"2024-09-12T01:04:51.198312+0000","last_became_active":"2024-09-12T00:18:22.856051+0000","last_became_peered":"2024-09-12T00:18:22.856051+0000","last_unstale":"2024-09-12T01:04:51.198312+0000","last_undegraded":"2024-09-12T01:04:51.198312+0000","last_fullsized":"2024-09-12T01:04:51.198312+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'353","last_scrub_stamp":"2024-09-12T01:04:51.198077+0000","last_deep_scrub":"268'353","last_deep_scrub_stamp":"2024-09-12T01:04:51.198077+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.198077+0000","objects_scrubbed":4,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:58.275825+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":458,"num_read_kb":24886,"num_write":1069,"num_write_kb":15091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"268'430","reported_seq":1984,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.486920+0000","last_change":"2024-09-12T01:04:55.486920+0000","last_active":"2024-09-12T01:04:55.486920+0000","last_peered":"2024-09-12T01:04:55.486920+0000","last_clean":"2024-09-12T01:04:55.486920+0000","last_became_active":"2024-09-12T00:18:24.853796+0000","last_became_peered":"2024-09-12T00:18:24.853796+0000","last_unstale":"2024-09-12T01:04:55.486920+0000","last_undegraded":"2024-09-12T01:04:55.486920+0000","last_fullsized":"2024-09-12T01:04:55.486920+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'430","last_scrub_stamp":"2024-09-12T01:04:55.486732+0000","last_deep_scrub":"268'430","last_deep_scrub_stamp":"2024-09-12T01:04:55.486732+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.486732+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:53.536416+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2472,"num_read_kb":2322,"num_write":521,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2265,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'333","reported_seq":1094,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.249250+0000","last_change":"2024-09-12T01:04:54.249250+0000","last_active":"2024-09-12T01:04:54.249250+0000","last_peered":"2024-09-12T01:04:54.249250+0000","last_clean":"2024-09-12T01:04:54.249250+0000","last_became_active":"2024-09-12T00:18:22.834904+0000","last_became_peered":"2024-09-12T00:18:22.834904+0000","last_unstale":"2024-09-12T01:04:54.249250+0000","last_undegraded":"2024-09-12T01:04:54.249250+0000","last_fullsized":"2024-09-12T01:04:54.249250+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'333","last_scrub_stamp":"2024-09-12T01:04:54.249011+0000","last_deep_scrub":"268'333","last_deep_scrub_stamp":"2024-09-12T01:04:54.249011+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.249011+0000","objects_scrubbed":10,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:24.413614+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":584,"num_read_kb":49706,"num_write":1054,"num_write_kb":43110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'505","reported_seq":2060,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.180476+0000","last_change":"2024-09-12T01:05:05.180476+0000","last_active":"2024-09-12T01:05:05.180476+0000","last_peered":"2024-09-12T01:05:05.180476+0000","last_clean":"2024-09-12T01:05:05.180476+0000","last_became_active":"2024-09-12T00:18:24.875112+0000","last_became_peered":"2024-09-12T00:18:24.875112+0000","last_unstale":"2024-09-12T01:05:05.180476+0000","last_undegraded":"2024-09-12T01:05:05.180476+0000","last_fullsized":"2024-09-12T01:05:05.180476+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'505","last_scrub_stamp":"2024-09-12T01:05:05.180281+0000","last_deep_scrub":"268'505","last_deep_scrub_stamp":"2024-09-12T01:05:05.180281+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.180281+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:44.845813+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2595,"num_read_kb":2402,"num_write":619,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":944,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'380","reported_seq":1079,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.292423+0000","last_change":"2024-09-12T01:04:57.292248+0000","last_active":"2024-09-12T01:04:57.292423+0000","last_peered":"2024-09-12T01:04:57.292423+0000","last_clean":"2024-09-12T01:04:57.292423+0000","last_became_active":"2024-09-12T00:18:22.841069+0000","last_became_peered":"2024-09-12T00:18:22.841069+0000","last_unstale":"2024-09-12T01:04:57.292423+0000","last_undegraded":"2024-09-12T01:04:57.292423+0000","last_fullsized":"2024-09-12T01:04:57.292423+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'380","last_scrub_stamp":"2024-09-12T01:04:57.292057+0000","last_deep_scrub":"268'380","last_deep_scrub_stamp":"2024-09-12T01:04:57.292057+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.292057+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:30.261493+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":685,"num_read_kb":23761,"num_write":1283,"num_write_kb":30294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'128","reported_seq":660,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:22.172702+0000","last_change":"2024-09-12T01:05:22.172702+0000","last_active":"2024-09-12T01:05:22.172702+0000","last_peered":"2024-09-12T01:05:22.172702+0000","last_clean":"2024-09-12T01:05:22.172702+0000","last_became_active":"2024-09-12T00:18:32.893410+0000","last_became_peered":"2024-09-12T00:18:32.893410+0000","last_unstale":"2024-09-12T01:05:22.172702+0000","last_undegraded":"2024-09-12T01:05:22.172702+0000","last_fullsized":"2024-09-12T01:05:22.172702+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'128","last_scrub_stamp":"2024-09-12T01:05:22.172513+0000","last_deep_scrub":"268'128","last_deep_scrub_stamp":"2024-09-12T01:05:22.172513+0000","last_clean_scrub_stamp":"2024-09-12T01:05:22.172513+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:42.436426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":200,"num_read_kb":180,"num_write":310,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'428","reported_seq":2039,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.119224+0000","last_change":"2024-09-12T01:05:00.119112+0000","last_active":"2024-09-12T01:05:00.119224+0000","last_peered":"2024-09-12T01:05:00.119224+0000","last_clean":"2024-09-12T01:05:00.119224+0000","last_became_active":"2024-09-12T00:18:24.862963+0000","last_became_peered":"2024-09-12T00:18:24.862963+0000","last_unstale":"2024-09-12T01:05:00.119224+0000","last_undegraded":"2024-09-12T01:05:00.119224+0000","last_fullsized":"2024-09-12T01:05:00.119224+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'428","last_scrub_stamp":"2024-09-12T01:05:00.118957+0000","last_deep_scrub":"268'428","last_deep_scrub_stamp":"2024-09-12T01:05:00.118957+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.118957+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:58.043360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2444,"num_read_kb":2313,"num_write":504,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"268'339","reported_seq":992,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.462684+0000","last_change":"2024-09-12T01:04:54.462526+0000","last_active":"2024-09-12T01:04:54.462684+0000","last_peered":"2024-09-12T01:04:54.462684+0000","last_clean":"2024-09-12T01:04:54.462684+0000","last_became_active":"2024-09-12T00:18:55.954978+0000","last_became_peered":"2024-09-12T00:18:55.954978+0000","last_unstale":"2024-09-12T01:04:54.462684+0000","last_undegraded":"2024-09-12T01:04:54.462684+0000","last_fullsized":"2024-09-12T01:04:54.462684+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'339","last_scrub_stamp":"2024-09-12T01:04:54.462327+0000","last_deep_scrub":"268'339","last_deep_scrub_stamp":"2024-09-12T01:04:54.462327+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.462327+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:39.747015+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":485,"num_read_kb":26304,"num_write":1090,"num_write_kb":30933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.560759+0000","last_change":"2024-09-12T01:05:09.560759+0000","last_active":"2024-09-12T01:05:09.560759+0000","last_peered":"2024-09-12T01:05:09.560759+0000","last_clean":"2024-09-12T01:05:09.560759+0000","last_became_active":"2024-09-12T00:18:26.871803+0000","last_became_peered":"2024-09-12T00:18:26.871803+0000","last_unstale":"2024-09-12T01:05:09.560759+0000","last_undegraded":"2024-09-12T01:05:09.560759+0000","last_fullsized":"2024-09-12T01:05:09.560759+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:09.560580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:09.560580+0000","last_clean_scrub_stamp":"2024-09-12T01:05:09.560580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:59.747447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'346","reported_seq":971,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:08.236524+0000","last_change":"2024-09-12T01:05:08.236524+0000","last_active":"2024-09-12T01:05:08.236524+0000","last_peered":"2024-09-12T01:05:08.236524+0000","last_clean":"2024-09-12T01:05:08.236524+0000","last_became_active":"2024-09-12T00:18:28.874861+0000","last_became_peered":"2024-09-12T00:18:28.874861+0000","last_unstale":"2024-09-12T01:05:08.236524+0000","last_undegraded":"2024-09-12T01:05:08.236524+0000","last_fullsized":"2024-09-12T01:05:08.236524+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'346","last_scrub_stamp":"2024-09-12T01:05:08.236282+0000","last_deep_scrub":"268'346","last_deep_scrub_stamp":"2024-09-12T01:05:08.236282+0000","last_clean_scrub_stamp":"2024-09-12T01:05:08.236282+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:46.275921+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51345,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":553,"num_read_kb":1147,"num_write":436,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:17.409971+0000","last_change":"2024-09-12T01:05:17.409971+0000","last_active":"2024-09-12T01:05:17.409971+0000","last_peered":"2024-09-12T01:05:17.409971+0000","last_clean":"2024-09-12T01:05:17.409971+0000","last_became_active":"2024-09-12T00:18:30.893886+0000","last_became_peered":"2024-09-12T00:18:30.893886+0000","last_unstale":"2024-09-12T01:05:17.409971+0000","last_undegraded":"2024-09-12T01:05:17.409971+0000","last_fullsized":"2024-09-12T01:05:17.409971+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:17.409798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:17.409798+0000","last_clean_scrub_stamp":"2024-09-12T01:05:17.409798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:36.218457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'2430","reported_seq":4333,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:22.557774+0000","last_change":"2024-09-12T01:05:22.557774+0000","last_active":"2024-09-12T01:05:22.557774+0000","last_peered":"2024-09-12T01:05:22.557774+0000","last_clean":"2024-09-12T01:05:22.557774+0000","last_became_active":"2024-09-12T00:18:32.899168+0000","last_became_peered":"2024-09-12T00:18:32.899168+0000","last_unstale":"2024-09-12T01:05:22.557774+0000","last_undegraded":"2024-09-12T01:05:22.557774+0000","last_fullsized":"2024-09-12T01:05:22.557774+0000","mapping_epoch":34,"log_start":"268'2400","ondisk_log_start":"268'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2430","last_scrub_stamp":"2024-09-12T01:05:22.557549+0000","last_deep_scrub":"268'2430","last_deep_scrub_stamp":"2024-09-12T01:05:22.557549+0000","last_clean_scrub_stamp":"2024-09-12T01:05:22.557549+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":2400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:32.205803+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6111,"num_read_kb":6108,"num_write":4843,"num_write_kb":1788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'1291","reported_seq":2845,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.595104+0000","last_change":"2024-09-12T01:05:02.595104+0000","last_active":"2024-09-12T01:05:02.595104+0000","last_peered":"2024-09-12T01:05:02.595104+0000","last_clean":"2024-09-12T01:05:02.595104+0000","last_became_active":"2024-09-12T00:18:24.869219+0000","last_became_peered":"2024-09-12T00:18:24.869219+0000","last_unstale":"2024-09-12T01:05:02.595104+0000","last_undegraded":"2024-09-12T01:05:02.595104+0000","last_fullsized":"2024-09-12T01:05:02.595104+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1291","last_scrub_stamp":"2024-09-12T01:05:02.594874+0000","last_deep_scrub":"268'1291","last_deep_scrub_stamp":"2024-09-12T01:05:02.594874+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.594874+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":1200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:11.005405+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5815,"num_read_kb":5070,"num_write":1809,"num_write_kb":816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'273","reported_seq":851,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:46.448230+0000","last_change":"2024-09-12T01:04:46.448096+0000","last_active":"2024-09-12T01:04:46.448230+0000","last_peered":"2024-09-12T01:04:46.448230+0000","last_clean":"2024-09-12T01:04:46.448230+0000","last_became_active":"2024-09-12T00:18:55.953363+0000","last_became_peered":"2024-09-12T00:18:55.953363+0000","last_unstale":"2024-09-12T01:04:46.448230+0000","last_undegraded":"2024-09-12T01:04:46.448230+0000","last_fullsized":"2024-09-12T01:04:46.448230+0000","mapping_epoch":37,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'273","last_scrub_stamp":"2024-09-12T01:04:46.447974+0000","last_deep_scrub":"268'273","last_deep_scrub_stamp":"2024-09-12T01:04:46.447974+0000","last_clean_scrub_stamp":"2024-09-12T01:04:46.447974+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:00.461692+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079954,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":346,"num_read_kb":12333,"num_write":862,"num_write_kb":28931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.054015+0000","last_change":"2024-09-12T01:05:09.053858+0000","last_active":"2024-09-12T01:05:09.054015+0000","last_peered":"2024-09-12T01:05:09.054015+0000","last_clean":"2024-09-12T01:05:09.054015+0000","last_became_active":"2024-09-12T00:18:26.848272+0000","last_became_peered":"2024-09-12T00:18:26.848272+0000","last_unstale":"2024-09-12T01:05:09.054015+0000","last_undegraded":"2024-09-12T01:05:09.054015+0000","last_fullsized":"2024-09-12T01:05:09.054015+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:09.053670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:09.053670+0000","last_clean_scrub_stamp":"2024-09-12T01:05:09.053670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:19.675861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'94","reported_seq":638,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.224917+0000","last_change":"2024-09-12T01:05:14.224917+0000","last_active":"2024-09-12T01:05:14.224917+0000","last_peered":"2024-09-12T01:05:14.224917+0000","last_clean":"2024-09-12T01:05:14.224917+0000","last_became_active":"2024-09-12T00:18:28.882630+0000","last_became_peered":"2024-09-12T00:18:28.882630+0000","last_unstale":"2024-09-12T01:05:14.224917+0000","last_undegraded":"2024-09-12T01:05:14.224917+0000","last_fullsized":"2024-09-12T01:05:14.224917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'94","last_scrub_stamp":"2024-09-12T01:05:14.224707+0000","last_deep_scrub":"268'94","last_deep_scrub_stamp":"2024-09-12T01:05:14.224707+0000","last_clean_scrub_stamp":"2024-09-12T01:05:14.224707+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:39.732375+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":98,"num_write":70,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:21.130425+0000","last_change":"2024-09-12T01:05:21.130425+0000","last_active":"2024-09-12T01:05:21.130425+0000","last_peered":"2024-09-12T01:05:21.130425+0000","last_clean":"2024-09-12T01:05:21.130425+0000","last_became_active":"2024-09-12T00:18:30.900908+0000","last_became_peered":"2024-09-12T00:18:30.900908+0000","last_unstale":"2024-09-12T01:05:21.130425+0000","last_undegraded":"2024-09-12T01:05:21.130425+0000","last_fullsized":"2024-09-12T01:05:21.130425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:21.130241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:21.130241+0000","last_clean_scrub_stamp":"2024-09-12T01:05:21.130241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:12.810251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'125","reported_seq":639,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:21.065203+0000","last_change":"2024-09-12T01:05:21.065203+0000","last_active":"2024-09-12T01:05:21.065203+0000","last_peered":"2024-09-12T01:05:21.065203+0000","last_clean":"2024-09-12T01:05:21.065203+0000","last_became_active":"2024-09-12T00:18:32.909547+0000","last_became_peered":"2024-09-12T00:18:32.909547+0000","last_unstale":"2024-09-12T01:05:21.065203+0000","last_undegraded":"2024-09-12T01:05:21.065203+0000","last_fullsized":"2024-09-12T01:05:21.065203+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'125","last_scrub_stamp":"2024-09-12T01:05:21.065082+0000","last_deep_scrub":"268'125","last_deep_scrub_stamp":"2024-09-12T01:05:21.065082+0000","last_clean_scrub_stamp":"2024-09-12T01:05:21.065082+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:04.170768+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":128,"num_write":294,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'1255","reported_seq":2907,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.243155+0000","last_change":"2024-09-12T01:04:55.243155+0000","last_active":"2024-09-12T01:04:55.243155+0000","last_peered":"2024-09-12T01:04:55.243155+0000","last_clean":"2024-09-12T01:04:55.243155+0000","last_became_active":"2024-09-12T00:18:24.859237+0000","last_became_peered":"2024-09-12T00:18:24.859237+0000","last_unstale":"2024-09-12T01:04:55.243155+0000","last_undegraded":"2024-09-12T01:04:55.243155+0000","last_fullsized":"2024-09-12T01:04:55.243155+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1255","last_scrub_stamp":"2024-09-12T01:04:55.242968+0000","last_deep_scrub":"268'1255","last_deep_scrub_stamp":"2024-09-12T01:04:55.242968+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.242968+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:13.838468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5766,"num_read_kb":5095,"num_write":1782,"num_write_kb":773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'386","reported_seq":1113,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.459313+0000","last_change":"2024-09-12T01:04:52.459156+0000","last_active":"2024-09-12T01:04:52.459313+0000","last_peered":"2024-09-12T01:04:52.459313+0000","last_clean":"2024-09-12T01:04:52.459313+0000","last_became_active":"2024-09-12T00:18:22.873262+0000","last_became_peered":"2024-09-12T00:18:22.873262+0000","last_unstale":"2024-09-12T01:04:52.459313+0000","last_undegraded":"2024-09-12T01:04:52.459313+0000","last_fullsized":"2024-09-12T01:04:52.459313+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'386","last_scrub_stamp":"2024-09-12T01:04:52.458890+0000","last_deep_scrub":"268'386","last_deep_scrub_stamp":"2024-09-12T01:04:52.458890+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.458890+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:38.488860+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":606,"num_read_kb":24526,"num_write":1220,"num_write_kb":41630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:10.016844+0000","last_change":"2024-09-12T01:05:10.016844+0000","last_active":"2024-09-12T01:05:10.016844+0000","last_peered":"2024-09-12T01:05:10.016844+0000","last_clean":"2024-09-12T01:05:10.016844+0000","last_became_active":"2024-09-12T00:18:26.855348+0000","last_became_peered":"2024-09-12T00:18:26.855348+0000","last_unstale":"2024-09-12T01:05:10.016844+0000","last_undegraded":"2024-09-12T01:05:10.016844+0000","last_fullsized":"2024-09-12T01:05:10.016844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:10.016740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:10.016740+0000","last_clean_scrub_stamp":"2024-09-12T01:05:10.016740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:03.375637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'125","reported_seq":686,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.456078+0000","last_change":"2024-09-12T01:05:03.455781+0000","last_active":"2024-09-12T01:05:03.456078+0000","last_peered":"2024-09-12T01:05:03.456078+0000","last_clean":"2024-09-12T01:05:03.456078+0000","last_became_active":"2024-09-12T00:18:28.884722+0000","last_became_peered":"2024-09-12T00:18:28.884722+0000","last_unstale":"2024-09-12T01:05:03.456078+0000","last_undegraded":"2024-09-12T01:05:03.456078+0000","last_fullsized":"2024-09-12T01:05:03.456078+0000","mapping_epoch":30,"log_start":"268'100","ondisk_log_start":"268'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'125","last_scrub_stamp":"2024-09-12T01:05:03.455518+0000","last_deep_scrub":"268'125","last_deep_scrub_stamp":"2024-09-12T01:05:03.455518+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.455518+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:28.693704+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":98,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'785","reported_seq":4751,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:16.426530+0000","last_change":"2024-09-12T01:05:16.426530+0000","last_active":"2024-09-12T01:05:16.426530+0000","last_peered":"2024-09-12T01:05:16.426530+0000","last_clean":"2024-09-12T01:05:16.426530+0000","last_became_active":"2024-09-12T00:18:30.893739+0000","last_became_peered":"2024-09-12T00:18:30.893739+0000","last_unstale":"2024-09-12T01:05:16.426530+0000","last_undegraded":"2024-09-12T01:05:16.426530+0000","last_fullsized":"2024-09-12T01:05:16.426530+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'785","last_scrub_stamp":"2024-09-12T01:05:16.426339+0000","last_deep_scrub":"268'785","last_deep_scrub_stamp":"2024-09-12T01:05:16.426339+0000","last_clean_scrub_stamp":"2024-09-12T01:05:16.426339+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:12.363363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'213","reported_seq":1056,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:23.179674+0000","last_change":"2024-09-12T01:05:23.179674+0000","last_active":"2024-09-12T01:05:23.179674+0000","last_peered":"2024-09-12T01:05:23.179674+0000","last_clean":"2024-09-12T01:05:23.179674+0000","last_became_active":"2024-09-12T00:18:32.884130+0000","last_became_peered":"2024-09-12T00:18:32.884130+0000","last_unstale":"2024-09-12T01:05:23.179674+0000","last_undegraded":"2024-09-12T01:05:23.179674+0000","last_fullsized":"2024-09-12T01:05:23.179674+0000","mapping_epoch":34,"log_start":"268'201","ondisk_log_start":"268'201","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'213","last_scrub_stamp":"2024-09-12T01:05:23.179469+0000","last_deep_scrub":"268'213","last_deep_scrub_stamp":"2024-09-12T01:05:23.179469+0000","last_clean_scrub_stamp":"2024-09-12T01:05:23.179469+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":201,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:35.435066+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":639,"num_read_kb":629,"num_write":484,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'895","reported_seq":2632,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.033355+0000","last_change":"2024-09-12T01:05:02.033355+0000","last_active":"2024-09-12T01:05:02.033355+0000","last_peered":"2024-09-12T01:05:02.033355+0000","last_clean":"2024-09-12T01:05:02.033355+0000","last_became_active":"2024-09-12T00:18:24.868103+0000","last_became_peered":"2024-09-12T00:18:24.868103+0000","last_unstale":"2024-09-12T01:05:02.033355+0000","last_undegraded":"2024-09-12T01:05:02.033355+0000","last_fullsized":"2024-09-12T01:05:02.033355+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'895","last_scrub_stamp":"2024-09-12T01:05:02.033166+0000","last_deep_scrub":"268'895","last_deep_scrub_stamp":"2024-09-12T01:05:02.033166+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.033166+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":800,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:53.892778+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4419,"num_read_kb":4003,"num_write":1187,"num_write_kb":433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":709,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'320","reported_seq":946,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.711337+0000","last_change":"2024-09-12T01:04:49.711181+0000","last_active":"2024-09-12T01:04:49.711337+0000","last_peered":"2024-09-12T01:04:49.711337+0000","last_clean":"2024-09-12T01:04:49.711337+0000","last_became_active":"2024-09-12T00:18:22.850530+0000","last_became_peered":"2024-09-12T00:18:22.850530+0000","last_unstale":"2024-09-12T01:04:49.711337+0000","last_undegraded":"2024-09-12T01:04:49.711337+0000","last_fullsized":"2024-09-12T01:04:49.711337+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'320","last_scrub_stamp":"2024-09-12T01:04:49.710990+0000","last_deep_scrub":"268'320","last_deep_scrub_stamp":"2024-09-12T01:04:49.710990+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.710990+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:12.435073+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263200,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":460,"num_read_kb":6949,"num_write":1090,"num_write_kb":36294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:10.595358+0000","last_change":"2024-09-12T01:05:10.595358+0000","last_active":"2024-09-12T01:05:10.595358+0000","last_peered":"2024-09-12T01:05:10.595358+0000","last_clean":"2024-09-12T01:05:10.595358+0000","last_became_active":"2024-09-12T00:18:26.867729+0000","last_became_peered":"2024-09-12T00:18:26.867729+0000","last_unstale":"2024-09-12T01:05:10.595358+0000","last_undegraded":"2024-09-12T01:05:10.595358+0000","last_fullsized":"2024-09-12T01:05:10.595358+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:10.595177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:10.595177+0000","last_clean_scrub_stamp":"2024-09-12T01:05:10.595177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:11.351936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'269","reported_seq":852,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.440753+0000","last_change":"2024-09-12T01:05:13.440753+0000","last_active":"2024-09-12T01:05:13.440753+0000","last_peered":"2024-09-12T01:05:13.440753+0000","last_clean":"2024-09-12T01:05:13.440753+0000","last_became_active":"2024-09-12T00:18:28.884779+0000","last_became_peered":"2024-09-12T00:18:28.884779+0000","last_unstale":"2024-09-12T01:05:13.440753+0000","last_undegraded":"2024-09-12T01:05:13.440753+0000","last_fullsized":"2024-09-12T01:05:13.440753+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'269","last_scrub_stamp":"2024-09-12T01:05:13.440552+0000","last_deep_scrub":"268'269","last_deep_scrub_stamp":"2024-09-12T01:05:13.440552+0000","last_clean_scrub_stamp":"2024-09-12T01:05:13.440552+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:53.485878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49225,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":1009,"num_write":358,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'817","reported_seq":2296,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:21.083036+0000","last_change":"2024-09-12T01:05:21.083036+0000","last_active":"2024-09-12T01:05:21.083036+0000","last_peered":"2024-09-12T01:05:21.083036+0000","last_clean":"2024-09-12T01:05:21.083036+0000","last_became_active":"2024-09-12T00:18:30.894642+0000","last_became_peered":"2024-09-12T00:18:30.894642+0000","last_unstale":"2024-09-12T01:05:21.083036+0000","last_undegraded":"2024-09-12T01:05:21.083036+0000","last_fullsized":"2024-09-12T01:05:21.083036+0000","mapping_epoch":32,"log_start":"268'800","ondisk_log_start":"268'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'817","last_scrub_stamp":"2024-09-12T01:05:21.082861+0000","last_deep_scrub":"268'817","last_deep_scrub_stamp":"2024-09-12T01:05:21.082861+0000","last_clean_scrub_stamp":"2024-09-12T01:05:21.082861+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:43.763014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'478","reported_seq":2089,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.519507+0000","last_change":"2024-09-12T01:05:00.519507+0000","last_active":"2024-09-12T01:05:00.519507+0000","last_peered":"2024-09-12T01:05:00.519507+0000","last_clean":"2024-09-12T01:05:00.519507+0000","last_became_active":"2024-09-12T00:18:24.869435+0000","last_became_peered":"2024-09-12T00:18:24.869435+0000","last_unstale":"2024-09-12T01:05:00.519507+0000","last_undegraded":"2024-09-12T01:05:00.519507+0000","last_fullsized":"2024-09-12T01:05:00.519507+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'478","last_scrub_stamp":"2024-09-12T01:05:00.519326+0000","last_deep_scrub":"268'478","last_deep_scrub_stamp":"2024-09-12T01:05:00.519326+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.519326+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:06.717819+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2569,"num_read_kb":2408,"num_write":545,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2278,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'380","reported_seq":1017,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.422656+0000","last_change":"2024-09-12T01:04:53.422509+0000","last_active":"2024-09-12T01:04:53.422656+0000","last_peered":"2024-09-12T01:04:53.422656+0000","last_clean":"2024-09-12T01:04:53.422656+0000","last_became_active":"2024-09-12T00:18:22.877327+0000","last_became_peered":"2024-09-12T00:18:22.877327+0000","last_unstale":"2024-09-12T01:04:53.422656+0000","last_undegraded":"2024-09-12T01:04:53.422656+0000","last_fullsized":"2024-09-12T01:04:53.422656+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'380","last_scrub_stamp":"2024-09-12T01:04:53.422308+0000","last_deep_scrub":"268'380","last_deep_scrub_stamp":"2024-09-12T01:04:53.422308+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.422308+0000","objects_scrubbed":7,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:37.542577+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170146,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":498,"num_read_kb":23147,"num_write":1077,"num_write_kb":55226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.519685+0000","last_change":"2024-09-12T01:05:05.519685+0000","last_active":"2024-09-12T01:05:05.519685+0000","last_peered":"2024-09-12T01:05:05.519685+0000","last_clean":"2024-09-12T01:05:05.519685+0000","last_became_active":"2024-09-12T00:18:26.874638+0000","last_became_peered":"2024-09-12T00:18:26.874638+0000","last_unstale":"2024-09-12T01:05:05.519685+0000","last_undegraded":"2024-09-12T01:05:05.519685+0000","last_fullsized":"2024-09-12T01:05:05.519685+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:05.519508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:05.519508+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.519508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:08.182181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'345","reported_seq":972,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.584867+0000","last_change":"2024-09-12T01:05:13.584867+0000","last_active":"2024-09-12T01:05:13.584867+0000","last_peered":"2024-09-12T01:05:13.584867+0000","last_clean":"2024-09-12T01:05:13.584867+0000","last_became_active":"2024-09-12T00:18:28.895950+0000","last_became_peered":"2024-09-12T00:18:28.895950+0000","last_unstale":"2024-09-12T01:05:13.584867+0000","last_undegraded":"2024-09-12T01:05:13.584867+0000","last_fullsized":"2024-09-12T01:05:13.584867+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'345","last_scrub_stamp":"2024-09-12T01:05:13.584649+0000","last_deep_scrub":"268'345","last_deep_scrub_stamp":"2024-09-12T01:05:13.584649+0000","last_clean_scrub_stamp":"2024-09-12T01:05:13.584649+0000","objects_scrubbed":10,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:19.236652+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19722,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":538,"num_read_kb":1043,"num_write":414,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:07.582029+0000","last_change":"2024-09-12T01:05:07.581890+0000","last_active":"2024-09-12T01:05:07.582029+0000","last_peered":"2024-09-12T01:05:07.582029+0000","last_clean":"2024-09-12T01:05:07.582029+0000","last_became_active":"2024-09-12T00:18:30.874074+0000","last_became_peered":"2024-09-12T00:18:30.874074+0000","last_unstale":"2024-09-12T01:05:07.582029+0000","last_undegraded":"2024-09-12T01:05:07.582029+0000","last_fullsized":"2024-09-12T01:05:07.582029+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:07.581718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:07.581718+0000","last_clean_scrub_stamp":"2024-09-12T01:05:07.581718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:16.962248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'556","reported_seq":1378,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:18.539562+0000","last_change":"2024-09-12T01:05:18.539562+0000","last_active":"2024-09-12T01:05:18.539562+0000","last_peered":"2024-09-12T01:05:18.539562+0000","last_clean":"2024-09-12T01:05:18.539562+0000","last_became_active":"2024-09-12T00:18:32.899046+0000","last_became_peered":"2024-09-12T00:18:32.899046+0000","last_unstale":"2024-09-12T01:05:18.539562+0000","last_undegraded":"2024-09-12T01:05:18.539562+0000","last_fullsized":"2024-09-12T01:05:18.539562+0000","mapping_epoch":34,"log_start":"268'500","ondisk_log_start":"268'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'556","last_scrub_stamp":"2024-09-12T01:05:18.539369+0000","last_deep_scrub":"268'556","last_deep_scrub_stamp":"2024-09-12T01:05:18.539369+0000","last_clean_scrub_stamp":"2024-09-12T01:05:18.539369+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:42.569213+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1268,"num_read_kb":1267,"num_write":1132,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'483","reported_seq":2100,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.135439+0000","last_change":"2024-09-12T01:04:54.135439+0000","last_active":"2024-09-12T01:04:54.135439+0000","last_peered":"2024-09-12T01:04:54.135439+0000","last_clean":"2024-09-12T01:04:54.135439+0000","last_became_active":"2024-09-12T00:18:24.861455+0000","last_became_peered":"2024-09-12T00:18:24.861455+0000","last_unstale":"2024-09-12T01:04:54.135439+0000","last_undegraded":"2024-09-12T01:04:54.135439+0000","last_fullsized":"2024-09-12T01:04:54.135439+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'483","last_scrub_stamp":"2024-09-12T01:04:54.135256+0000","last_deep_scrub":"268'483","last_deep_scrub_stamp":"2024-09-12T01:04:54.135256+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.135256+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:48.039409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2490,"num_read_kb":2350,"num_write":569,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'372","reported_seq":1036,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.432841+0000","last_change":"2024-09-12T01:04:51.432703+0000","last_active":"2024-09-12T01:04:51.432841+0000","last_peered":"2024-09-12T01:04:51.432841+0000","last_clean":"2024-09-12T01:04:51.432841+0000","last_became_active":"2024-09-12T00:18:22.871330+0000","last_became_peered":"2024-09-12T00:18:22.871330+0000","last_unstale":"2024-09-12T01:04:51.432841+0000","last_undegraded":"2024-09-12T01:04:51.432841+0000","last_fullsized":"2024-09-12T01:04:51.432841+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'372","last_scrub_stamp":"2024-09-12T01:04:51.432478+0000","last_deep_scrub":"268'372","last_deep_scrub_stamp":"2024-09-12T01:04:51.432478+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.432478+0000","objects_scrubbed":7,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:00.323028+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22053,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":541,"num_read_kb":9754,"num_write":1101,"num_write_kb":25837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"268'4","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.419318+0000","last_change":"2024-09-12T01:04:59.419318+0000","last_active":"2024-09-12T01:04:59.419318+0000","last_peered":"2024-09-12T01:04:59.419318+0000","last_clean":"2024-09-12T01:04:59.419318+0000","last_became_active":"2024-09-12T00:18:26.858529+0000","last_became_peered":"2024-09-12T00:18:26.858529+0000","last_unstale":"2024-09-12T01:04:59.419318+0000","last_undegraded":"2024-09-12T01:04:59.419318+0000","last_fullsized":"2024-09-12T01:04:59.419318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:04:59.419081+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:04:59.419081+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.419081+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:54.969136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'291","reported_seq":884,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:11.045156+0000","last_change":"2024-09-12T01:05:11.045026+0000","last_active":"2024-09-12T01:05:11.045156+0000","last_peered":"2024-09-12T01:05:11.045156+0000","last_clean":"2024-09-12T01:05:11.045156+0000","last_became_active":"2024-09-12T00:18:28.895521+0000","last_became_peered":"2024-09-12T00:18:28.895521+0000","last_unstale":"2024-09-12T01:05:11.045156+0000","last_undegraded":"2024-09-12T01:05:11.045156+0000","last_fullsized":"2024-09-12T01:05:11.045156+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'291","last_scrub_stamp":"2024-09-12T01:05:11.044839+0000","last_deep_scrub":"268'291","last_deep_scrub_stamp":"2024-09-12T01:05:11.044839+0000","last_clean_scrub_stamp":"2024-09-12T01:05:11.044839+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:01.971620+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":471,"num_read_kb":1097,"num_write":388,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:22.076868+0000","last_change":"2024-09-12T01:05:22.076868+0000","last_active":"2024-09-12T01:05:22.076868+0000","last_peered":"2024-09-12T01:05:22.076868+0000","last_clean":"2024-09-12T01:05:22.076868+0000","last_became_active":"2024-09-12T00:18:30.905601+0000","last_became_peered":"2024-09-12T00:18:30.905601+0000","last_unstale":"2024-09-12T01:05:22.076868+0000","last_undegraded":"2024-09-12T01:05:22.076868+0000","last_fullsized":"2024-09-12T01:05:22.076868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:22.076639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:22.076639+0000","last_clean_scrub_stamp":"2024-09-12T01:05:22.076639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:49.872299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'124","reported_seq":622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.771180+0000","last_change":"2024-09-12T01:05:09.771180+0000","last_active":"2024-09-12T01:05:09.771180+0000","last_peered":"2024-09-12T01:05:09.771180+0000","last_clean":"2024-09-12T01:05:09.771180+0000","last_became_active":"2024-09-12T00:18:32.899284+0000","last_became_peered":"2024-09-12T00:18:32.899284+0000","last_unstale":"2024-09-12T01:05:09.771180+0000","last_undegraded":"2024-09-12T01:05:09.771180+0000","last_fullsized":"2024-09-12T01:05:09.771180+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'124","last_scrub_stamp":"2024-09-12T01:05:09.771002+0000","last_deep_scrub":"268'124","last_deep_scrub_stamp":"2024-09-12T01:05:09.771002+0000","last_clean_scrub_stamp":"2024-09-12T01:05:09.771002+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:14.512976+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":95,"num_write":292,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'840","reported_seq":2349,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.747511+0000","last_change":"2024-09-12T01:04:54.747511+0000","last_active":"2024-09-12T01:04:54.747511+0000","last_peered":"2024-09-12T01:04:54.747511+0000","last_clean":"2024-09-12T01:04:54.747511+0000","last_became_active":"2024-09-12T00:18:24.869582+0000","last_became_peered":"2024-09-12T00:18:24.869582+0000","last_unstale":"2024-09-12T01:04:54.747511+0000","last_undegraded":"2024-09-12T01:04:54.747511+0000","last_fullsized":"2024-09-12T01:04:54.747511+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'840","last_scrub_stamp":"2024-09-12T01:04:54.747326+0000","last_deep_scrub":"268'840","last_deep_scrub_stamp":"2024-09-12T01:04:54.747326+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.747326+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":800,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:53.076407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4018,"num_read_kb":3569,"num_write":1156,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'263","reported_seq":872,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.467075+0000","last_change":"2024-09-12T01:04:55.466935+0000","last_active":"2024-09-12T01:04:55.467075+0000","last_peered":"2024-09-12T01:04:55.467075+0000","last_clean":"2024-09-12T01:04:55.467075+0000","last_became_active":"2024-09-12T00:18:22.875150+0000","last_became_peered":"2024-09-12T00:18:22.875150+0000","last_unstale":"2024-09-12T01:04:55.467075+0000","last_undegraded":"2024-09-12T01:04:55.467075+0000","last_fullsized":"2024-09-12T01:04:55.467075+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'263","last_scrub_stamp":"2024-09-12T01:04:55.466756+0000","last_deep_scrub":"268'263","last_deep_scrub_stamp":"2024-09-12T01:04:55.466756+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.466756+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:15.779888+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174702,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":374,"num_read_kb":19791,"num_write":779,"num_write_kb":25570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"268'6","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.376956+0000","last_change":"2024-09-12T01:05:00.376795+0000","last_active":"2024-09-12T01:05:00.376956+0000","last_peered":"2024-09-12T01:05:00.376956+0000","last_clean":"2024-09-12T01:05:00.376956+0000","last_became_active":"2024-09-12T00:18:26.857788+0000","last_became_peered":"2024-09-12T00:18:26.857788+0000","last_unstale":"2024-09-12T01:05:00.376956+0000","last_undegraded":"2024-09-12T01:05:00.376956+0000","last_fullsized":"2024-09-12T01:05:00.376956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T01:05:00.376612+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T01:05:00.376612+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.376612+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:45.589459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'313","reported_seq":919,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:10.500913+0000","last_change":"2024-09-12T01:05:10.500913+0000","last_active":"2024-09-12T01:05:10.500913+0000","last_peered":"2024-09-12T01:05:10.500913+0000","last_clean":"2024-09-12T01:05:10.500913+0000","last_became_active":"2024-09-12T00:18:28.886806+0000","last_became_peered":"2024-09-12T00:18:28.886806+0000","last_unstale":"2024-09-12T01:05:10.500913+0000","last_undegraded":"2024-09-12T01:05:10.500913+0000","last_fullsized":"2024-09-12T01:05:10.500913+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'313","last_scrub_stamp":"2024-09-12T01:05:10.500704+0000","last_deep_scrub":"268'313","last_deep_scrub_stamp":"2024-09-12T01:05:10.500704+0000","last_clean_scrub_stamp":"2024-09-12T01:05:10.500704+0000","objects_scrubbed":9,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:48.042274+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45713,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":494,"num_read_kb":1053,"num_write":392,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'809","reported_seq":2420,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.203907+0000","last_change":"2024-09-12T01:05:14.203907+0000","last_active":"2024-09-12T01:05:14.203907+0000","last_peered":"2024-09-12T01:05:14.203907+0000","last_clean":"2024-09-12T01:05:14.203907+0000","last_became_active":"2024-09-12T00:18:30.888688+0000","last_became_peered":"2024-09-12T00:18:30.888688+0000","last_unstale":"2024-09-12T01:05:14.203907+0000","last_undegraded":"2024-09-12T01:05:14.203907+0000","last_fullsized":"2024-09-12T01:05:14.203907+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'809","last_scrub_stamp":"2024-09-12T01:05:14.203732+0000","last_deep_scrub":"268'809","last_deep_scrub_stamp":"2024-09-12T01:05:14.203732+0000","last_clean_scrub_stamp":"2024-09-12T01:05:14.203732+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:46.916328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'132","reported_seq":642,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:18.127644+0000","last_change":"2024-09-12T01:05:18.127644+0000","last_active":"2024-09-12T01:05:18.127644+0000","last_peered":"2024-09-12T01:05:18.127644+0000","last_clean":"2024-09-12T01:05:18.127644+0000","last_became_active":"2024-09-12T00:18:32.904609+0000","last_became_peered":"2024-09-12T00:18:32.904609+0000","last_unstale":"2024-09-12T01:05:18.127644+0000","last_undegraded":"2024-09-12T01:05:18.127644+0000","last_fullsized":"2024-09-12T01:05:18.127644+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'132","last_scrub_stamp":"2024-09-12T01:05:18.127453+0000","last_deep_scrub":"268'132","last_deep_scrub_stamp":"2024-09-12T01:05:18.127453+0000","last_clean_scrub_stamp":"2024-09-12T01:05:18.127453+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:38.888363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":137,"num_read_kb":127,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'816","reported_seq":2299,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.205176+0000","last_change":"2024-09-12T01:04:54.205034+0000","last_active":"2024-09-12T01:04:54.205176+0000","last_peered":"2024-09-12T01:04:54.205176+0000","last_clean":"2024-09-12T01:04:54.205176+0000","last_became_active":"2024-09-12T00:18:24.856572+0000","last_became_peered":"2024-09-12T00:18:24.856572+0000","last_unstale":"2024-09-12T01:04:54.205176+0000","last_undegraded":"2024-09-12T01:04:54.205176+0000","last_fullsized":"2024-09-12T01:04:54.205176+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'816","last_scrub_stamp":"2024-09-12T01:04:54.204847+0000","last_deep_scrub":"268'816","last_deep_scrub_stamp":"2024-09-12T01:04:54.204847+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.204847+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:06.157588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3705,"num_read_kb":3326,"num_write":1078,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'390","reported_seq":1109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.585521+0000","last_change":"2024-09-12T01:04:48.585386+0000","last_active":"2024-09-12T01:04:48.585521+0000","last_peered":"2024-09-12T01:04:48.585521+0000","last_clean":"2024-09-12T01:04:48.585521+0000","last_became_active":"2024-09-12T00:18:22.865067+0000","last_became_peered":"2024-09-12T00:18:22.865067+0000","last_unstale":"2024-09-12T01:04:48.585521+0000","last_undegraded":"2024-09-12T01:04:48.585521+0000","last_fullsized":"2024-09-12T01:04:48.585521+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'390","last_scrub_stamp":"2024-09-12T01:04:48.585156+0000","last_deep_scrub":"268'390","last_deep_scrub_stamp":"2024-09-12T01:04:48.585156+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.585156+0000","objects_scrubbed":9,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:32.682633+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300494,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":644,"num_read_kb":35348,"num_write":1371,"num_write_kb":29498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.418400+0000","last_change":"2024-09-12T01:04:58.418400+0000","last_active":"2024-09-12T01:04:58.418400+0000","last_peered":"2024-09-12T01:04:58.418400+0000","last_clean":"2024-09-12T01:04:58.418400+0000","last_became_active":"2024-09-12T00:18:26.867793+0000","last_became_peered":"2024-09-12T00:18:26.867793+0000","last_unstale":"2024-09-12T01:04:58.418400+0000","last_undegraded":"2024-09-12T01:04:58.418400+0000","last_fullsized":"2024-09-12T01:04:58.418400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:58.418226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:58.418226+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.418226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:04.200862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'480","reported_seq":1134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:06.288694+0000","last_change":"2024-09-12T01:05:06.288694+0000","last_active":"2024-09-12T01:05:06.288694+0000","last_peered":"2024-09-12T01:05:06.288694+0000","last_clean":"2024-09-12T01:05:06.288694+0000","last_became_active":"2024-09-12T00:18:28.875891+0000","last_became_peered":"2024-09-12T00:18:28.875891+0000","last_unstale":"2024-09-12T01:05:06.288694+0000","last_undegraded":"2024-09-12T01:05:06.288694+0000","last_fullsized":"2024-09-12T01:05:06.288694+0000","mapping_epoch":30,"log_start":"268'400","ondisk_log_start":"268'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'480","last_scrub_stamp":"2024-09-12T01:05:06.288498+0000","last_deep_scrub":"268'480","last_deep_scrub_stamp":"2024-09-12T01:05:06.288498+0000","last_clean_scrub_stamp":"2024-09-12T01:05:06.288498+0000","objects_scrubbed":7,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:38.359325+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96447,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":834,"num_read_kb":1977,"num_write":680,"num_write_kb":567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.409073+0000","last_change":"2024-09-12T01:05:02.409073+0000","last_active":"2024-09-12T01:05:02.409073+0000","last_peered":"2024-09-12T01:05:02.409073+0000","last_clean":"2024-09-12T01:05:02.409073+0000","last_became_active":"2024-09-12T00:18:30.895401+0000","last_became_peered":"2024-09-12T00:18:30.895401+0000","last_unstale":"2024-09-12T01:05:02.409073+0000","last_undegraded":"2024-09-12T01:05:02.409073+0000","last_fullsized":"2024-09-12T01:05:02.409073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:02.408869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:02.408869+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.408869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:22.455398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'155","reported_seq":690,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:12.562877+0000","last_change":"2024-09-12T01:05:12.562877+0000","last_active":"2024-09-12T01:05:12.562877+0000","last_peered":"2024-09-12T01:05:12.562877+0000","last_clean":"2024-09-12T01:05:12.562877+0000","last_became_active":"2024-09-12T00:18:32.892682+0000","last_became_peered":"2024-09-12T00:18:32.892682+0000","last_unstale":"2024-09-12T01:05:12.562877+0000","last_undegraded":"2024-09-12T01:05:12.562877+0000","last_fullsized":"2024-09-12T01:05:12.562877+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'155","last_scrub_stamp":"2024-09-12T01:05:12.562632+0000","last_deep_scrub":"268'155","last_deep_scrub_stamp":"2024-09-12T01:05:12.562632+0000","last_clean_scrub_stamp":"2024-09-12T01:05:12.562632+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:26.872352+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1103,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":196,"num_read_kb":180,"num_write":352,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'460","reported_seq":2084,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.181632+0000","last_change":"2024-09-12T01:04:53.181483+0000","last_active":"2024-09-12T01:04:53.181632+0000","last_peered":"2024-09-12T01:04:53.181632+0000","last_clean":"2024-09-12T01:04:53.181632+0000","last_became_active":"2024-09-12T00:18:24.852683+0000","last_became_peered":"2024-09-12T00:18:24.852683+0000","last_unstale":"2024-09-12T01:04:53.181632+0000","last_undegraded":"2024-09-12T01:04:53.181632+0000","last_fullsized":"2024-09-12T01:04:53.181632+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'460","last_scrub_stamp":"2024-09-12T01:04:53.181308+0000","last_deep_scrub":"268'460","last_deep_scrub_stamp":"2024-09-12T01:04:53.181308+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.181308+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:33.622967+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2390,"num_read_kb":2271,"num_write":519,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'367","reported_seq":1026,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.282069+0000","last_change":"2024-09-12T01:04:49.281782+0000","last_active":"2024-09-12T01:04:49.282069+0000","last_peered":"2024-09-12T01:04:49.282069+0000","last_clean":"2024-09-12T01:04:49.282069+0000","last_became_active":"2024-09-12T00:18:22.841689+0000","last_became_peered":"2024-09-12T00:18:22.841689+0000","last_unstale":"2024-09-12T01:04:49.282069+0000","last_undegraded":"2024-09-12T01:04:49.282069+0000","last_fullsized":"2024-09-12T01:04:49.282069+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'367","last_scrub_stamp":"2024-09-12T01:04:49.281537+0000","last_deep_scrub":"268'367","last_deep_scrub_stamp":"2024-09-12T01:04:49.281537+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.281537+0000","objects_scrubbed":6,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:15.412534+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194384,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":496,"num_read_kb":55770,"num_write":1160,"num_write_kb":35616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.393823+0000","last_change":"2024-09-12T01:05:01.393694+0000","last_active":"2024-09-12T01:05:01.393823+0000","last_peered":"2024-09-12T01:05:01.393823+0000","last_clean":"2024-09-12T01:05:01.393823+0000","last_became_active":"2024-09-12T00:18:26.845618+0000","last_became_peered":"2024-09-12T00:18:26.845618+0000","last_unstale":"2024-09-12T01:05:01.393823+0000","last_undegraded":"2024-09-12T01:05:01.393823+0000","last_fullsized":"2024-09-12T01:05:01.393823+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:01.393507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:01.393507+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.393507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:52.795216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'306","reported_seq":902,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.207564+0000","last_change":"2024-09-12T01:05:13.207429+0000","last_active":"2024-09-12T01:05:13.207564+0000","last_peered":"2024-09-12T01:05:13.207564+0000","last_clean":"2024-09-12T01:05:13.207564+0000","last_became_active":"2024-09-12T00:18:28.884044+0000","last_became_peered":"2024-09-12T00:18:28.884044+0000","last_unstale":"2024-09-12T01:05:13.207564+0000","last_undegraded":"2024-09-12T01:05:13.207564+0000","last_fullsized":"2024-09-12T01:05:13.207564+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'306","last_scrub_stamp":"2024-09-12T01:05:13.207241+0000","last_deep_scrub":"268'306","last_deep_scrub_stamp":"2024-09-12T01:05:13.207241+0000","last_clean_scrub_stamp":"2024-09-12T01:05:13.207241+0000","objects_scrubbed":7,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:54.963951+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53187,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":519,"num_read_kb":1172,"num_write":464,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:12.209840+0000","last_change":"2024-09-12T01:05:12.209840+0000","last_active":"2024-09-12T01:05:12.209840+0000","last_peered":"2024-09-12T01:05:12.209840+0000","last_clean":"2024-09-12T01:05:12.209840+0000","last_became_active":"2024-09-12T00:18:30.902697+0000","last_became_peered":"2024-09-12T00:18:30.902697+0000","last_unstale":"2024-09-12T01:05:12.209840+0000","last_undegraded":"2024-09-12T01:05:12.209840+0000","last_fullsized":"2024-09-12T01:05:12.209840+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:12.209656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:12.209656+0000","last_clean_scrub_stamp":"2024-09-12T01:05:12.209656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:09.569231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'140","reported_seq":649,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.091385+0000","last_change":"2024-09-12T01:05:25.091385+0000","last_active":"2024-09-12T01:05:25.091385+0000","last_peered":"2024-09-12T01:05:25.091385+0000","last_clean":"2024-09-12T01:05:25.091385+0000","last_became_active":"2024-09-12T00:18:32.900235+0000","last_became_peered":"2024-09-12T00:18:32.900235+0000","last_unstale":"2024-09-12T01:05:25.091385+0000","last_undegraded":"2024-09-12T01:05:25.091385+0000","last_fullsized":"2024-09-12T01:05:25.091385+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'140","last_scrub_stamp":"2024-09-12T01:05:25.091155+0000","last_deep_scrub":"268'140","last_deep_scrub_stamp":"2024-09-12T01:05:25.091155+0000","last_clean_scrub_stamp":"2024-09-12T01:05:25.091155+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:36.766475+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":465,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":124,"num_read_kb":118,"num_write":347,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'437","reported_seq":2088,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.152535+0000","last_change":"2024-09-12T01:04:55.152400+0000","last_active":"2024-09-12T01:04:55.152535+0000","last_peered":"2024-09-12T01:04:55.152535+0000","last_clean":"2024-09-12T01:04:55.152535+0000","last_became_active":"2024-09-12T00:18:24.872637+0000","last_became_peered":"2024-09-12T00:18:24.872637+0000","last_unstale":"2024-09-12T01:04:55.152535+0000","last_undegraded":"2024-09-12T01:04:55.152535+0000","last_fullsized":"2024-09-12T01:04:55.152535+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'437","last_scrub_stamp":"2024-09-12T01:04:55.152221+0000","last_deep_scrub":"268'437","last_deep_scrub_stamp":"2024-09-12T01:04:55.152221+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.152221+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:56.856049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2400,"num_read_kb":2300,"num_write":500,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'358","reported_seq":1045,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.718500+0000","last_change":"2024-09-12T01:04:48.718500+0000","last_active":"2024-09-12T01:04:48.718500+0000","last_peered":"2024-09-12T01:04:48.718500+0000","last_clean":"2024-09-12T01:04:48.718500+0000","last_became_active":"2024-09-12T00:18:22.861450+0000","last_became_peered":"2024-09-12T00:18:22.861450+0000","last_unstale":"2024-09-12T01:04:48.718500+0000","last_undegraded":"2024-09-12T01:04:48.718500+0000","last_fullsized":"2024-09-12T01:04:48.718500+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'358","last_scrub_stamp":"2024-09-12T01:04:48.718246+0000","last_deep_scrub":"268'358","last_deep_scrub_stamp":"2024-09-12T01:04:48.718246+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.718246+0000","objects_scrubbed":9,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:43.073298+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":662355,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":585,"num_read_kb":32647,"num_write":1179,"num_write_kb":29925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.540359+0000","last_change":"2024-09-12T01:05:00.540215+0000","last_active":"2024-09-12T01:05:00.540359+0000","last_peered":"2024-09-12T01:05:00.540359+0000","last_clean":"2024-09-12T01:05:00.540359+0000","last_became_active":"2024-09-12T00:18:26.859109+0000","last_became_peered":"2024-09-12T00:18:26.859109+0000","last_unstale":"2024-09-12T01:05:00.540359+0000","last_undegraded":"2024-09-12T01:05:00.540359+0000","last_fullsized":"2024-09-12T01:05:00.540359+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:00.540042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:00.540042+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.540042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:32.790029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'309","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.459268+0000","last_change":"2024-09-12T01:05:05.459268+0000","last_active":"2024-09-12T01:05:05.459268+0000","last_peered":"2024-09-12T01:05:05.459268+0000","last_clean":"2024-09-12T01:05:05.459268+0000","last_became_active":"2024-09-12T00:18:28.881947+0000","last_became_peered":"2024-09-12T00:18:28.881947+0000","last_unstale":"2024-09-12T01:05:05.459268+0000","last_undegraded":"2024-09-12T01:05:05.459268+0000","last_fullsized":"2024-09-12T01:05:05.459268+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'309","last_scrub_stamp":"2024-09-12T01:05:05.459045+0000","last_deep_scrub":"268'309","last_deep_scrub_stamp":"2024-09-12T01:05:05.459045+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.459045+0000","objects_scrubbed":7,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:15.066600+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45222,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":499,"num_read_kb":1119,"num_write":404,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'746","reported_seq":4325,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.485198+0000","last_change":"2024-09-12T01:05:04.484921+0000","last_active":"2024-09-12T01:05:04.485198+0000","last_peered":"2024-09-12T01:05:04.485198+0000","last_clean":"2024-09-12T01:05:04.485198+0000","last_became_active":"2024-09-12T00:18:30.872360+0000","last_became_peered":"2024-09-12T00:18:30.872360+0000","last_unstale":"2024-09-12T01:05:04.485198+0000","last_undegraded":"2024-09-12T01:05:04.485198+0000","last_fullsized":"2024-09-12T01:05:04.485198+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'746","last_scrub_stamp":"2024-09-12T01:05:04.484658+0000","last_deep_scrub":"268'746","last_deep_scrub_stamp":"2024-09-12T01:05:04.484658+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.484658+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":700,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:16.768023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'115","reported_seq":634,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:10.632589+0000","last_change":"2024-09-12T01:05:10.632589+0000","last_active":"2024-09-12T01:05:10.632589+0000","last_peered":"2024-09-12T01:05:10.632589+0000","last_clean":"2024-09-12T01:05:10.632589+0000","last_became_active":"2024-09-12T00:18:32.896338+0000","last_became_peered":"2024-09-12T00:18:32.896338+0000","last_unstale":"2024-09-12T01:05:10.632589+0000","last_undegraded":"2024-09-12T01:05:10.632589+0000","last_fullsized":"2024-09-12T01:05:10.632589+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'115","last_scrub_stamp":"2024-09-12T01:05:10.632400+0000","last_deep_scrub":"268'115","last_deep_scrub_stamp":"2024-09-12T01:05:10.632400+0000","last_clean_scrub_stamp":"2024-09-12T01:05:10.632400+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:08.929433+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":125,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'463","reported_seq":2022,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.173058+0000","last_change":"2024-09-12T01:04:56.172887+0000","last_active":"2024-09-12T01:04:56.173058+0000","last_peered":"2024-09-12T01:04:56.173058+0000","last_clean":"2024-09-12T01:04:56.173058+0000","last_became_active":"2024-09-12T00:18:24.879622+0000","last_became_peered":"2024-09-12T00:18:24.879622+0000","last_unstale":"2024-09-12T01:04:56.173058+0000","last_undegraded":"2024-09-12T01:04:56.173058+0000","last_fullsized":"2024-09-12T01:04:56.173058+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'463","last_scrub_stamp":"2024-09-12T01:04:56.172706+0000","last_deep_scrub":"268'463","last_deep_scrub_stamp":"2024-09-12T01:04:56.172706+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.172706+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:18.013381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2528,"num_read_kb":2373,"num_write":555,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'408","reported_seq":1113,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.190525+0000","last_change":"2024-09-12T01:04:47.190525+0000","last_active":"2024-09-12T01:04:47.190525+0000","last_peered":"2024-09-12T01:04:47.190525+0000","last_clean":"2024-09-12T01:04:47.190525+0000","last_became_active":"2024-09-12T00:18:22.847861+0000","last_became_peered":"2024-09-12T00:18:22.847861+0000","last_unstale":"2024-09-12T01:04:47.190525+0000","last_undegraded":"2024-09-12T01:04:47.190525+0000","last_fullsized":"2024-09-12T01:04:47.190525+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'408","last_scrub_stamp":"2024-09-12T01:04:47.190319+0000","last_deep_scrub":"268'408","last_deep_scrub_stamp":"2024-09-12T01:04:47.190319+0000","last_clean_scrub_stamp":"2024-09-12T01:04:47.190319+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:08.728064+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":711,"num_read_kb":61883,"num_write":1220,"num_write_kb":26157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"268'4","reported_seq":1464,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:08.520192+0000","last_change":"2024-09-12T01:05:08.520192+0000","last_active":"2024-09-12T01:05:08.520192+0000","last_peered":"2024-09-12T01:05:08.520192+0000","last_clean":"2024-09-12T01:05:08.520192+0000","last_became_active":"2024-09-12T00:18:26.871356+0000","last_became_peered":"2024-09-12T00:18:26.871356+0000","last_unstale":"2024-09-12T01:05:08.520192+0000","last_undegraded":"2024-09-12T01:05:08.520192+0000","last_fullsized":"2024-09-12T01:05:08.520192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:05:08.519909+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:05:08.519909+0000","last_clean_scrub_stamp":"2024-09-12T01:05:08.519909+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:24.897378+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'77","reported_seq":614,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:12.080348+0000","last_change":"2024-09-12T01:05:12.080212+0000","last_active":"2024-09-12T01:05:12.080348+0000","last_peered":"2024-09-12T01:05:12.080348+0000","last_clean":"2024-09-12T01:05:12.080348+0000","last_became_active":"2024-09-12T00:18:28.888423+0000","last_became_peered":"2024-09-12T00:18:28.888423+0000","last_unstale":"2024-09-12T01:05:12.080348+0000","last_undegraded":"2024-09-12T01:05:12.080348+0000","last_fullsized":"2024-09-12T01:05:12.080348+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'77","last_scrub_stamp":"2024-09-12T01:05:12.080009+0000","last_deep_scrub":"268'77","last_deep_scrub_stamp":"2024-09-12T01:05:12.080009+0000","last_clean_scrub_stamp":"2024-09-12T01:05:12.080009+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:59.149037+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":78,"num_read_kb":72,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'768","reported_seq":2124,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.754928+0000","last_change":"2024-09-12T01:05:05.754750+0000","last_active":"2024-09-12T01:05:05.754928+0000","last_peered":"2024-09-12T01:05:05.754928+0000","last_clean":"2024-09-12T01:05:05.754928+0000","last_became_active":"2024-09-12T00:18:30.898814+0000","last_became_peered":"2024-09-12T00:18:30.898814+0000","last_unstale":"2024-09-12T01:05:05.754928+0000","last_undegraded":"2024-09-12T01:05:05.754928+0000","last_fullsized":"2024-09-12T01:05:05.754928+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'768","last_scrub_stamp":"2024-09-12T01:05:05.754569+0000","last_deep_scrub":"268'768","last_deep_scrub_stamp":"2024-09-12T01:05:05.754569+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.754569+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:36.497490+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'94","reported_seq":602,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:18.159280+0000","last_change":"2024-09-12T01:05:18.159280+0000","last_active":"2024-09-12T01:05:18.159280+0000","last_peered":"2024-09-12T01:05:18.159280+0000","last_clean":"2024-09-12T01:05:18.159280+0000","last_became_active":"2024-09-12T00:18:32.907797+0000","last_became_peered":"2024-09-12T00:18:32.907797+0000","last_unstale":"2024-09-12T01:05:18.159280+0000","last_undegraded":"2024-09-12T01:05:18.159280+0000","last_fullsized":"2024-09-12T01:05:18.159280+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'94","last_scrub_stamp":"2024-09-12T01:05:18.159064+0000","last_deep_scrub":"268'94","last_deep_scrub_stamp":"2024-09-12T01:05:18.159064+0000","last_clean_scrub_stamp":"2024-09-12T01:05:18.159064+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:38.097320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":73,"num_write":219,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'510","reported_seq":2091,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.411066+0000","last_change":"2024-09-12T01:04:51.411066+0000","last_active":"2024-09-12T01:04:51.411066+0000","last_peered":"2024-09-12T01:04:51.411066+0000","last_clean":"2024-09-12T01:04:51.411066+0000","last_became_active":"2024-09-12T00:18:56.196419+0000","last_became_peered":"2024-09-12T00:18:56.196419+0000","last_unstale":"2024-09-12T01:04:51.411066+0000","last_undegraded":"2024-09-12T01:04:51.411066+0000","last_fullsized":"2024-09-12T01:04:51.411066+0000","mapping_epoch":37,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'510","last_scrub_stamp":"2024-09-12T01:04:51.410840+0000","last_deep_scrub":"268'510","last_deep_scrub_stamp":"2024-09-12T01:04:51.410840+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.410840+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:25.199103+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2644,"num_read_kb":2454,"num_write":619,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"268'409","reported_seq":1201,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.265266+0000","last_change":"2024-09-12T01:04:48.265266+0000","last_active":"2024-09-12T01:04:48.265266+0000","last_peered":"2024-09-12T01:04:48.265266+0000","last_clean":"2024-09-12T01:04:48.265266+0000","last_became_active":"2024-09-12T00:18:22.834072+0000","last_became_peered":"2024-09-12T00:18:22.834072+0000","last_unstale":"2024-09-12T01:04:48.265266+0000","last_undegraded":"2024-09-12T01:04:48.265266+0000","last_fullsized":"2024-09-12T01:04:48.265266+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'409","last_scrub_stamp":"2024-09-12T01:04:48.265165+0000","last_deep_scrub":"268'409","last_deep_scrub_stamp":"2024-09-12T01:04:48.265165+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.265165+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:03.330338+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":207192,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":853,"num_read_kb":11806,"num_write":1194,"num_write_kb":23298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.149436+0000","last_change":"2024-09-12T01:05:09.149297+0000","last_active":"2024-09-12T01:05:09.149436+0000","last_peered":"2024-09-12T01:05:09.149436+0000","last_clean":"2024-09-12T01:05:09.149436+0000","last_became_active":"2024-09-12T00:18:26.871183+0000","last_became_peered":"2024-09-12T00:18:26.871183+0000","last_unstale":"2024-09-12T01:05:09.149436+0000","last_undegraded":"2024-09-12T01:05:09.149436+0000","last_fullsized":"2024-09-12T01:05:09.149436+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:09.149047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:09.149047+0000","last_clean_scrub_stamp":"2024-09-12T01:05:09.149047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:18.048008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'379","reported_seq":996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.572353+0000","last_change":"2024-09-12T01:05:14.572220+0000","last_active":"2024-09-12T01:05:14.572353+0000","last_peered":"2024-09-12T01:05:14.572353+0000","last_clean":"2024-09-12T01:05:14.572353+0000","last_became_active":"2024-09-12T00:18:28.889343+0000","last_became_peered":"2024-09-12T00:18:28.889343+0000","last_unstale":"2024-09-12T01:05:14.572353+0000","last_undegraded":"2024-09-12T01:05:14.572353+0000","last_fullsized":"2024-09-12T01:05:14.572353+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'379","last_scrub_stamp":"2024-09-12T01:05:14.572004+0000","last_deep_scrub":"268'379","last_deep_scrub_stamp":"2024-09-12T01:05:14.572004+0000","last_clean_scrub_stamp":"2024-09-12T01:05:14.572004+0000","objects_scrubbed":9,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:56.833847+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45461,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1181,"num_read_kb":1792,"num_write":1688,"num_write_kb":1549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":488742,"num_omap_keys":1130,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.755160+0000","last_change":"2024-09-12T01:05:04.754995+0000","last_active":"2024-09-12T01:05:04.755160+0000","last_peered":"2024-09-12T01:05:04.755160+0000","last_clean":"2024-09-12T01:05:04.755160+0000","last_became_active":"2024-09-12T00:18:30.905770+0000","last_became_peered":"2024-09-12T00:18:30.905770+0000","last_unstale":"2024-09-12T01:05:04.755160+0000","last_undegraded":"2024-09-12T01:05:04.755160+0000","last_fullsized":"2024-09-12T01:05:04.755160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:04.754810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:04.754810+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.754810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:50.499923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'137","reported_seq":646,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.483268+0000","last_change":"2024-09-12T01:05:14.483268+0000","last_active":"2024-09-12T01:05:14.483268+0000","last_peered":"2024-09-12T01:05:14.483268+0000","last_clean":"2024-09-12T01:05:14.483268+0000","last_became_active":"2024-09-12T00:18:32.885619+0000","last_became_peered":"2024-09-12T00:18:32.885619+0000","last_unstale":"2024-09-12T01:05:14.483268+0000","last_undegraded":"2024-09-12T01:05:14.483268+0000","last_fullsized":"2024-09-12T01:05:14.483268+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'137","last_scrub_stamp":"2024-09-12T01:05:14.483031+0000","last_deep_scrub":"268'137","last_deep_scrub_stamp":"2024-09-12T01:05:14.483031+0000","last_clean_scrub_stamp":"2024-09-12T01:05:14.483031+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:52.743881+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":117,"num_write":301,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'771","reported_seq":2196,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.714075+0000","last_change":"2024-09-12T01:04:52.714075+0000","last_active":"2024-09-12T01:04:52.714075+0000","last_peered":"2024-09-12T01:04:52.714075+0000","last_clean":"2024-09-12T01:04:52.714075+0000","last_became_active":"2024-09-12T00:18:24.879462+0000","last_became_peered":"2024-09-12T00:18:24.879462+0000","last_unstale":"2024-09-12T01:04:52.714075+0000","last_undegraded":"2024-09-12T01:04:52.714075+0000","last_fullsized":"2024-09-12T01:04:52.714075+0000","mapping_epoch":26,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'771","last_scrub_stamp":"2024-09-12T01:04:52.713880+0000","last_deep_scrub":"268'771","last_deep_scrub_stamp":"2024-09-12T01:04:52.713880+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.713880+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:50.037991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3687,"num_read_kb":3308,"num_write":1074,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"268'74","reported_seq":625,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.387866+0000","last_change":"2024-09-12T01:04:48.387866+0000","last_active":"2024-09-12T01:04:48.387866+0000","last_peered":"2024-09-12T01:04:48.387866+0000","last_clean":"2024-09-12T01:04:48.387866+0000","last_became_active":"2024-09-12T00:18:03.924829+0000","last_became_peered":"2024-09-12T00:18:03.924829+0000","last_unstale":"2024-09-12T01:04:48.387866+0000","last_undegraded":"2024-09-12T01:04:48.387866+0000","last_fullsized":"2024-09-12T01:04:48.387866+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'74","last_scrub_stamp":"2024-09-12T01:04:48.387655+0000","last_deep_scrub":"268'74","last_deep_scrub_stamp":"2024-09-12T01:04:48.387655+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.387655+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:43.335462+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"268'2","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.534759+0000","last_change":"2024-09-12T01:04:47.534759+0000","last_active":"2024-09-12T01:04:47.534759+0000","last_peered":"2024-09-12T01:04:47.534759+0000","last_clean":"2024-09-12T01:04:47.534759+0000","last_became_active":"2024-09-12T00:18:08.644385+0000","last_became_peered":"2024-09-12T00:18:08.644385+0000","last_unstale":"2024-09-12T01:04:47.534759+0000","last_undegraded":"2024-09-12T01:04:47.534759+0000","last_fullsized":"2024-09-12T01:04:47.534759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:04:47.534572+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:04:47.534572+0000","last_clean_scrub_stamp":"2024-09-12T01:04:47.534572+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:43.103409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001156741,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'363","reported_seq":1020,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:46.290029+0000","last_change":"2024-09-12T01:04:46.290029+0000","last_active":"2024-09-12T01:04:46.290029+0000","last_peered":"2024-09-12T01:04:46.290029+0000","last_clean":"2024-09-12T01:04:46.290029+0000","last_became_active":"2024-09-12T00:18:22.867571+0000","last_became_peered":"2024-09-12T00:18:22.867571+0000","last_unstale":"2024-09-12T01:04:46.290029+0000","last_undegraded":"2024-09-12T01:04:46.290029+0000","last_fullsized":"2024-09-12T01:04:46.290029+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'363","last_scrub_stamp":"2024-09-12T01:04:46.289871+0000","last_deep_scrub":"268'363","last_deep_scrub_stamp":"2024-09-12T01:04:46.289871+0000","last_clean_scrub_stamp":"2024-09-12T01:04:46.289871+0000","objects_scrubbed":7,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:39.208915+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262231,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":470,"num_read_kb":26851,"num_write":1093,"num_write_kb":40025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.467331+0000","last_change":"2024-09-12T01:05:02.467331+0000","last_active":"2024-09-12T01:05:02.467331+0000","last_peered":"2024-09-12T01:05:02.467331+0000","last_clean":"2024-09-12T01:05:02.467331+0000","last_became_active":"2024-09-12T00:18:26.846668+0000","last_became_peered":"2024-09-12T00:18:26.846668+0000","last_unstale":"2024-09-12T01:05:02.467331+0000","last_undegraded":"2024-09-12T01:05:02.467331+0000","last_fullsized":"2024-09-12T01:05:02.467331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:02.467156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:02.467156+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.467156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:27.839432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'709","reported_seq":1429,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:12.579337+0000","last_change":"2024-09-12T01:05:12.579337+0000","last_active":"2024-09-12T01:05:12.579337+0000","last_peered":"2024-09-12T01:05:12.579337+0000","last_clean":"2024-09-12T01:05:12.579337+0000","last_became_active":"2024-09-12T00:18:28.885217+0000","last_became_peered":"2024-09-12T00:18:28.885217+0000","last_unstale":"2024-09-12T01:05:12.579337+0000","last_undegraded":"2024-09-12T01:05:12.579337+0000","last_fullsized":"2024-09-12T01:05:12.579337+0000","mapping_epoch":30,"log_start":"268'600","ondisk_log_start":"268'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'709","last_scrub_stamp":"2024-09-12T01:05:12.579141+0000","last_deep_scrub":"268'709","last_deep_scrub_stamp":"2024-09-12T01:05:12.579141+0000","last_clean_scrub_stamp":"2024-09-12T01:05:12.579141+0000","objects_scrubbed":7,"log_size":109,"log_dups_size":600,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:08.727940+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190373,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1378,"num_read_kb":3232,"num_write":1266,"num_write_kb":1158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89472,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:17.098442+0000","last_change":"2024-09-12T01:05:17.098442+0000","last_active":"2024-09-12T01:05:17.098442+0000","last_peered":"2024-09-12T01:05:17.098442+0000","last_clean":"2024-09-12T01:05:17.098442+0000","last_became_active":"2024-09-12T00:18:30.898689+0000","last_became_peered":"2024-09-12T00:18:30.898689+0000","last_unstale":"2024-09-12T01:05:17.098442+0000","last_undegraded":"2024-09-12T01:05:17.098442+0000","last_fullsized":"2024-09-12T01:05:17.098442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:17.098261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:17.098261+0000","last_clean_scrub_stamp":"2024-09-12T01:05:17.098261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:07.482389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'203","reported_seq":920,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:11.758630+0000","last_change":"2024-09-12T01:05:11.758630+0000","last_active":"2024-09-12T01:05:11.758630+0000","last_peered":"2024-09-12T01:05:11.758630+0000","last_clean":"2024-09-12T01:05:11.758630+0000","last_became_active":"2024-09-12T00:18:32.895239+0000","last_became_peered":"2024-09-12T00:18:32.895239+0000","last_unstale":"2024-09-12T01:05:11.758630+0000","last_undegraded":"2024-09-12T01:05:11.758630+0000","last_fullsized":"2024-09-12T01:05:11.758630+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'203","last_scrub_stamp":"2024-09-12T01:05:11.758417+0000","last_deep_scrub":"268'203","last_deep_scrub_stamp":"2024-09-12T01:05:11.758417+0000","last_clean_scrub_stamp":"2024-09-12T01:05:11.758417+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:16.614404+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1443,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":458,"num_write":434,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'489","reported_seq":2073,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.267998+0000","last_change":"2024-09-12T01:04:56.267998+0000","last_active":"2024-09-12T01:04:56.267998+0000","last_peered":"2024-09-12T01:04:56.267998+0000","last_clean":"2024-09-12T01:04:56.267998+0000","last_became_active":"2024-09-12T00:18:24.867067+0000","last_became_peered":"2024-09-12T00:18:24.867067+0000","last_unstale":"2024-09-12T01:04:56.267998+0000","last_undegraded":"2024-09-12T01:04:56.267998+0000","last_fullsized":"2024-09-12T01:04:56.267998+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'489","last_scrub_stamp":"2024-09-12T01:04:56.267771+0000","last_deep_scrub":"268'489","last_deep_scrub_stamp":"2024-09-12T01:04:56.267771+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.267771+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:04.695281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2524,"num_read_kb":2362,"num_write":607,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.421771+0000","last_change":"2024-09-12T01:04:50.421771+0000","last_active":"2024-09-12T01:04:50.421771+0000","last_peered":"2024-09-12T01:04:50.421771+0000","last_clean":"2024-09-12T01:04:50.421771+0000","last_became_active":"2024-09-12T00:18:08.646097+0000","last_became_peered":"2024-09-12T00:18:08.646097+0000","last_unstale":"2024-09-12T01:04:50.421771+0000","last_undegraded":"2024-09-12T01:04:50.421771+0000","last_fullsized":"2024-09-12T01:04:50.421771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:50.421588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:50.421588+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.421588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:10.736613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001003409,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'368","reported_seq":1039,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:46.266343+0000","last_change":"2024-09-12T01:04:46.266343+0000","last_active":"2024-09-12T01:04:46.266343+0000","last_peered":"2024-09-12T01:04:46.266343+0000","last_clean":"2024-09-12T01:04:46.266343+0000","last_became_active":"2024-09-12T00:18:22.857461+0000","last_became_peered":"2024-09-12T00:18:22.857461+0000","last_unstale":"2024-09-12T01:04:46.266343+0000","last_undegraded":"2024-09-12T01:04:46.266343+0000","last_fullsized":"2024-09-12T01:04:46.266343+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'368","last_scrub_stamp":"2024-09-12T01:04:46.266244+0000","last_deep_scrub":"268'368","last_deep_scrub_stamp":"2024-09-12T01:04:46.266244+0000","last_clean_scrub_stamp":"2024-09-12T01:04:46.266244+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:56.316874+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342049,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":576,"num_read_kb":72256,"num_write":1077,"num_write_kb":25510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:07.550454+0000","last_change":"2024-09-12T01:05:07.550454+0000","last_active":"2024-09-12T01:05:07.550454+0000","last_peered":"2024-09-12T01:05:07.550454+0000","last_clean":"2024-09-12T01:05:07.550454+0000","last_became_active":"2024-09-12T00:18:26.871674+0000","last_became_peered":"2024-09-12T00:18:26.871674+0000","last_unstale":"2024-09-12T01:05:07.550454+0000","last_undegraded":"2024-09-12T01:05:07.550454+0000","last_fullsized":"2024-09-12T01:05:07.550454+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:07.550275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:07.550275+0000","last_clean_scrub_stamp":"2024-09-12T01:05:07.550275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:29.322955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'1332","reported_seq":2850,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.595923+0000","last_change":"2024-09-12T01:05:05.595923+0000","last_active":"2024-09-12T01:05:05.595923+0000","last_peered":"2024-09-12T01:05:05.595923+0000","last_clean":"2024-09-12T01:05:05.595923+0000","last_became_active":"2024-09-12T00:18:28.889257+0000","last_became_peered":"2024-09-12T00:18:28.889257+0000","last_unstale":"2024-09-12T01:05:05.595923+0000","last_undegraded":"2024-09-12T01:05:05.595923+0000","last_fullsized":"2024-09-12T01:05:05.595923+0000","mapping_epoch":30,"log_start":"268'1301","ondisk_log_start":"268'1301","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1332","last_scrub_stamp":"2024-09-12T01:05:05.595699+0000","last_deep_scrub":"268'1332","last_deep_scrub_stamp":"2024-09-12T01:05:05.595699+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.595699+0000","objects_scrubbed":12,"log_size":31,"log_dups_size":1301,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:21.671487+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142532,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2119,"num_read_kb":4115,"num_write":1220,"num_write_kb":1054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:15.411292+0000","last_change":"2024-09-12T01:05:15.411292+0000","last_active":"2024-09-12T01:05:15.411292+0000","last_peered":"2024-09-12T01:05:15.411292+0000","last_clean":"2024-09-12T01:05:15.411292+0000","last_became_active":"2024-09-12T00:18:30.895305+0000","last_became_peered":"2024-09-12T00:18:30.895305+0000","last_unstale":"2024-09-12T01:05:15.411292+0000","last_undegraded":"2024-09-12T01:05:15.411292+0000","last_fullsized":"2024-09-12T01:05:15.411292+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:15.411111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:15.411111+0000","last_clean_scrub_stamp":"2024-09-12T01:05:15.411111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:06.456720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'206","reported_seq":741,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.525292+0000","last_change":"2024-09-12T01:05:13.525292+0000","last_active":"2024-09-12T01:05:13.525292+0000","last_peered":"2024-09-12T01:05:13.525292+0000","last_clean":"2024-09-12T01:05:13.525292+0000","last_became_active":"2024-09-12T00:18:32.887528+0000","last_became_peered":"2024-09-12T00:18:32.887528+0000","last_unstale":"2024-09-12T01:05:13.525292+0000","last_undegraded":"2024-09-12T01:05:13.525292+0000","last_fullsized":"2024-09-12T01:05:13.525292+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'206","last_scrub_stamp":"2024-09-12T01:05:13.525024+0000","last_deep_scrub":"268'206","last_deep_scrub_stamp":"2024-09-12T01:05:13.525024+0000","last_clean_scrub_stamp":"2024-09-12T01:05:13.525024+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:24.202578+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":310,"num_read_kb":309,"num_write":446,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'1283","reported_seq":3151,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.562364+0000","last_change":"2024-09-12T01:04:55.562364+0000","last_active":"2024-09-12T01:04:55.562364+0000","last_peered":"2024-09-12T01:04:55.562364+0000","last_clean":"2024-09-12T01:04:55.562364+0000","last_became_active":"2024-09-12T00:18:24.877964+0000","last_became_peered":"2024-09-12T00:18:24.877964+0000","last_unstale":"2024-09-12T01:04:55.562364+0000","last_undegraded":"2024-09-12T01:04:55.562364+0000","last_fullsized":"2024-09-12T01:04:55.562364+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1283","last_scrub_stamp":"2024-09-12T01:04:55.562178+0000","last_deep_scrub":"268'1283","last_deep_scrub_stamp":"2024-09-12T01:04:55.562178+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.562178+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":1200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:32.688184+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6082,"num_read_kb":5401,"num_write":1732,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4650,"num_omap_keys":19,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:45.470703+0000","last_change":"2024-09-12T01:04:45.470703+0000","last_active":"2024-09-12T01:04:45.470703+0000","last_peered":"2024-09-12T01:04:45.470703+0000","last_clean":"2024-09-12T01:04:45.470703+0000","last_became_active":"2024-09-12T00:18:08.874442+0000","last_became_peered":"2024-09-12T00:18:08.874442+0000","last_unstale":"2024-09-12T01:04:45.470703+0000","last_undegraded":"2024-09-12T01:04:45.470703+0000","last_fullsized":"2024-09-12T01:04:45.470703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:45.470576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:45.470576+0000","last_clean_scrub_stamp":"2024-09-12T01:04:45.470576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:41.288997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010707620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'375","reported_seq":1102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.584327+0000","last_change":"2024-09-12T01:04:47.584327+0000","last_active":"2024-09-12T01:04:47.584327+0000","last_peered":"2024-09-12T01:04:47.584327+0000","last_clean":"2024-09-12T01:04:47.584327+0000","last_became_active":"2024-09-12T00:18:22.834724+0000","last_became_peered":"2024-09-12T00:18:22.834724+0000","last_unstale":"2024-09-12T01:04:47.584327+0000","last_undegraded":"2024-09-12T01:04:47.584327+0000","last_fullsized":"2024-09-12T01:04:47.584327+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'375","last_scrub_stamp":"2024-09-12T01:04:47.584227+0000","last_deep_scrub":"268'375","last_deep_scrub_stamp":"2024-09-12T01:04:47.584227+0000","last_clean_scrub_stamp":"2024-09-12T01:04:47.584227+0000","objects_scrubbed":9,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:17.877057+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":674,"num_read_kb":9051,"num_write":1222,"num_write_kb":24587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"268'2","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.486013+0000","last_change":"2024-09-12T01:04:56.486013+0000","last_active":"2024-09-12T01:04:56.486013+0000","last_peered":"2024-09-12T01:04:56.486013+0000","last_clean":"2024-09-12T01:04:56.486013+0000","last_became_active":"2024-09-12T00:18:26.867343+0000","last_became_peered":"2024-09-12T00:18:26.867343+0000","last_unstale":"2024-09-12T01:04:56.486013+0000","last_undegraded":"2024-09-12T01:04:56.486013+0000","last_fullsized":"2024-09-12T01:04:56.486013+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:04:56.485822+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:04:56.485822+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.485822+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:33.613654+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'261","reported_seq":1373,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.541125+0000","last_change":"2024-09-12T01:05:09.541125+0000","last_active":"2024-09-12T01:05:09.541125+0000","last_peered":"2024-09-12T01:05:09.541125+0000","last_clean":"2024-09-12T01:05:09.541125+0000","last_became_active":"2024-09-12T00:18:28.889058+0000","last_became_peered":"2024-09-12T00:18:28.889058+0000","last_unstale":"2024-09-12T01:05:09.541125+0000","last_undegraded":"2024-09-12T01:05:09.541125+0000","last_fullsized":"2024-09-12T01:05:09.541125+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'261","last_scrub_stamp":"2024-09-12T01:05:09.540895+0000","last_deep_scrub":"268'261","last_deep_scrub_stamp":"2024-09-12T01:05:09.540895+0000","last_clean_scrub_stamp":"2024-09-12T01:05:09.540895+0000","objects_scrubbed":9,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:27.914177+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":190,"num_read_kb":179,"num_write":165,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.215476+0000","last_change":"2024-09-12T01:05:09.215476+0000","last_active":"2024-09-12T01:05:09.215476+0000","last_peered":"2024-09-12T01:05:09.215476+0000","last_clean":"2024-09-12T01:05:09.215476+0000","last_became_active":"2024-09-12T00:18:30.896073+0000","last_became_peered":"2024-09-12T00:18:30.896073+0000","last_unstale":"2024-09-12T01:05:09.215476+0000","last_undegraded":"2024-09-12T01:05:09.215476+0000","last_fullsized":"2024-09-12T01:05:09.215476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:09.215305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:09.215305+0000","last_clean_scrub_stamp":"2024-09-12T01:05:09.215305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:51.474097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'274","reported_seq":894,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:24.077480+0000","last_change":"2024-09-12T01:05:24.077480+0000","last_active":"2024-09-12T01:05:24.077480+0000","last_peered":"2024-09-12T01:05:24.077480+0000","last_clean":"2024-09-12T01:05:24.077480+0000","last_became_active":"2024-09-12T00:18:32.914004+0000","last_became_peered":"2024-09-12T00:18:32.914004+0000","last_unstale":"2024-09-12T01:05:24.077480+0000","last_undegraded":"2024-09-12T01:05:24.077480+0000","last_fullsized":"2024-09-12T01:05:24.077480+0000","mapping_epoch":34,"log_start":"268'200","ondisk_log_start":"268'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'274","last_scrub_stamp":"2024-09-12T01:05:24.077297+0000","last_deep_scrub":"268'274","last_deep_scrub_stamp":"2024-09-12T01:05:24.077297+0000","last_clean_scrub_stamp":"2024-09-12T01:05:24.077297+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:56.784653+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":517,"num_read_kb":535,"num_write":598,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'821","reported_seq":2386,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.584590+0000","last_change":"2024-09-12T01:04:54.584590+0000","last_active":"2024-09-12T01:04:54.584590+0000","last_peered":"2024-09-12T01:04:54.584590+0000","last_clean":"2024-09-12T01:04:54.584590+0000","last_became_active":"2024-09-12T00:18:24.869633+0000","last_became_peered":"2024-09-12T00:18:24.869633+0000","last_unstale":"2024-09-12T01:04:54.584590+0000","last_undegraded":"2024-09-12T01:04:54.584590+0000","last_fullsized":"2024-09-12T01:04:54.584590+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'821","last_scrub_stamp":"2024-09-12T01:04:54.584398+0000","last_deep_scrub":"268'821","last_deep_scrub_stamp":"2024-09-12T01:04:54.584398+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.584398+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:12.332775+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3879,"num_read_kb":3488,"num_write":1067,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"268'3","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.564570+0000","last_change":"2024-09-12T01:04:49.564570+0000","last_active":"2024-09-12T01:04:49.564570+0000","last_peered":"2024-09-12T01:04:49.564570+0000","last_clean":"2024-09-12T01:04:49.564570+0000","last_became_active":"2024-09-12T00:18:08.645156+0000","last_became_peered":"2024-09-12T00:18:08.645156+0000","last_unstale":"2024-09-12T01:04:49.564570+0000","last_undegraded":"2024-09-12T01:04:49.564570+0000","last_fullsized":"2024-09-12T01:04:49.564570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:04:49.564383+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:04:49.564383+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.564383+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:52.244469+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0024595709999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'395","reported_seq":1086,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.209032+0000","last_change":"2024-09-12T01:04:48.209032+0000","last_active":"2024-09-12T01:04:48.209032+0000","last_peered":"2024-09-12T01:04:48.209032+0000","last_clean":"2024-09-12T01:04:48.209032+0000","last_became_active":"2024-09-12T00:18:22.854940+0000","last_became_peered":"2024-09-12T00:18:22.854940+0000","last_unstale":"2024-09-12T01:04:48.209032+0000","last_undegraded":"2024-09-12T01:04:48.209032+0000","last_fullsized":"2024-09-12T01:04:48.209032+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'395","last_scrub_stamp":"2024-09-12T01:04:48.208822+0000","last_deep_scrub":"268'395","last_deep_scrub_stamp":"2024-09-12T01:04:48.208822+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.208822+0000","objects_scrubbed":8,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:04.445359+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7046756,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":598,"num_read_kb":32178,"num_write":1236,"num_write_kb":29732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.329680+0000","last_change":"2024-09-12T01:05:04.329680+0000","last_active":"2024-09-12T01:05:04.329680+0000","last_peered":"2024-09-12T01:05:04.329680+0000","last_clean":"2024-09-12T01:05:04.329680+0000","last_became_active":"2024-09-12T00:18:26.855239+0000","last_became_peered":"2024-09-12T00:18:26.855239+0000","last_unstale":"2024-09-12T01:05:04.329680+0000","last_undegraded":"2024-09-12T01:05:04.329680+0000","last_fullsized":"2024-09-12T01:05:04.329680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:04.329492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:04.329492+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.329492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:56.131898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'129","reported_seq":686,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.075044+0000","last_change":"2024-09-12T01:05:13.075044+0000","last_active":"2024-09-12T01:05:13.075044+0000","last_peered":"2024-09-12T01:05:13.075044+0000","last_clean":"2024-09-12T01:05:13.075044+0000","last_became_active":"2024-09-12T00:18:28.891173+0000","last_became_peered":"2024-09-12T00:18:28.891173+0000","last_unstale":"2024-09-12T01:05:13.075044+0000","last_undegraded":"2024-09-12T01:05:13.075044+0000","last_fullsized":"2024-09-12T01:05:13.075044+0000","mapping_epoch":30,"log_start":"268'100","ondisk_log_start":"268'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'129","last_scrub_stamp":"2024-09-12T01:05:13.074823+0000","last_deep_scrub":"268'129","last_deep_scrub_stamp":"2024-09-12T01:05:13.074823+0000","last_clean_scrub_stamp":"2024-09-12T01:05:13.074823+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:19.910471+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":142,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3226,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.708410+0000","last_change":"2024-09-12T01:05:03.708410+0000","last_active":"2024-09-12T01:05:03.708410+0000","last_peered":"2024-09-12T01:05:03.708410+0000","last_clean":"2024-09-12T01:05:03.708410+0000","last_became_active":"2024-09-12T00:18:30.904080+0000","last_became_peered":"2024-09-12T00:18:30.904080+0000","last_unstale":"2024-09-12T01:05:03.708410+0000","last_undegraded":"2024-09-12T01:05:03.708410+0000","last_fullsized":"2024-09-12T01:05:03.708410+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:03.708236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:03.708236+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.708236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:54.206218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'110","reported_seq":668,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.576677+0000","last_change":"2024-09-12T01:05:19.576677+0000","last_active":"2024-09-12T01:05:19.576677+0000","last_peered":"2024-09-12T01:05:19.576677+0000","last_clean":"2024-09-12T01:05:19.576677+0000","last_became_active":"2024-09-12T00:18:32.903109+0000","last_became_peered":"2024-09-12T00:18:32.903109+0000","last_unstale":"2024-09-12T01:05:19.576677+0000","last_undegraded":"2024-09-12T01:05:19.576677+0000","last_fullsized":"2024-09-12T01:05:19.576677+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'110","last_scrub_stamp":"2024-09-12T01:05:19.576486+0000","last_deep_scrub":"268'110","last_deep_scrub_stamp":"2024-09-12T01:05:19.576486+0000","last_clean_scrub_stamp":"2024-09-12T01:05:19.576486+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:01.415265+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":206,"num_read_kb":202,"num_write":268,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'474","reported_seq":1995,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.604762+0000","last_change":"2024-09-12T01:04:56.604762+0000","last_active":"2024-09-12T01:04:56.604762+0000","last_peered":"2024-09-12T01:04:56.604762+0000","last_clean":"2024-09-12T01:04:56.604762+0000","last_became_active":"2024-09-12T00:18:24.878031+0000","last_became_peered":"2024-09-12T00:18:24.878031+0000","last_unstale":"2024-09-12T01:04:56.604762+0000","last_undegraded":"2024-09-12T01:04:56.604762+0000","last_fullsized":"2024-09-12T01:04:56.604762+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'474","last_scrub_stamp":"2024-09-12T01:04:56.604574+0000","last_deep_scrub":"268'474","last_deep_scrub_stamp":"2024-09-12T01:04:56.604574+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.604574+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:32.788784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2325,"num_read_kb":2173,"num_write":541,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'312","reported_seq":934,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.530946+0000","last_change":"2024-09-12T01:04:50.530946+0000","last_active":"2024-09-12T01:04:50.530946+0000","last_peered":"2024-09-12T01:04:50.530946+0000","last_clean":"2024-09-12T01:04:50.530946+0000","last_became_active":"2024-09-12T00:18:22.861336+0000","last_became_peered":"2024-09-12T00:18:22.861336+0000","last_unstale":"2024-09-12T01:04:50.530946+0000","last_undegraded":"2024-09-12T01:04:50.530946+0000","last_fullsized":"2024-09-12T01:04:50.530946+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'312","last_scrub_stamp":"2024-09-12T01:04:50.530749+0000","last_deep_scrub":"268'312","last_deep_scrub_stamp":"2024-09-12T01:04:50.530749+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.530749+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:38.701302+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194334,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":409,"num_read_kb":16866,"num_write":952,"num_write_kb":39669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":539,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:46.542394+0000","last_change":"2024-09-12T01:04:46.542394+0000","last_active":"2024-09-12T01:04:46.542394+0000","last_peered":"2024-09-12T01:04:46.542394+0000","last_clean":"2024-09-12T01:04:46.542394+0000","last_became_active":"2024-09-12T00:18:08.956785+0000","last_became_peered":"2024-09-12T00:18:08.956785+0000","last_unstale":"2024-09-12T01:04:46.542394+0000","last_undegraded":"2024-09-12T01:04:46.542394+0000","last_fullsized":"2024-09-12T01:04:46.542394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:46.542326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:46.542326+0000","last_clean_scrub_stamp":"2024-09-12T01:04:46.542326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:00.080671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012417909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.367455+0000","last_change":"2024-09-12T01:05:03.367455+0000","last_active":"2024-09-12T01:05:03.367455+0000","last_peered":"2024-09-12T01:05:03.367455+0000","last_clean":"2024-09-12T01:05:03.367455+0000","last_became_active":"2024-09-12T00:18:26.879511+0000","last_became_peered":"2024-09-12T00:18:26.879511+0000","last_unstale":"2024-09-12T01:05:03.367455+0000","last_undegraded":"2024-09-12T01:05:03.367455+0000","last_fullsized":"2024-09-12T01:05:03.367455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:03.367276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:03.367276+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.367276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:35.236252+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'571","reported_seq":1258,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:07.272500+0000","last_change":"2024-09-12T01:05:07.272500+0000","last_active":"2024-09-12T01:05:07.272500+0000","last_peered":"2024-09-12T01:05:07.272500+0000","last_clean":"2024-09-12T01:05:07.272500+0000","last_became_active":"2024-09-12T00:18:28.879614+0000","last_became_peered":"2024-09-12T00:18:28.879614+0000","last_unstale":"2024-09-12T01:05:07.272500+0000","last_undegraded":"2024-09-12T01:05:07.272500+0000","last_fullsized":"2024-09-12T01:05:07.272500+0000","mapping_epoch":30,"log_start":"268'500","ondisk_log_start":"268'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'571","last_scrub_stamp":"2024-09-12T01:05:07.272279+0000","last_deep_scrub":"268'571","last_deep_scrub_stamp":"2024-09-12T01:05:07.272279+0000","last_clean_scrub_stamp":"2024-09-12T01:05:07.272279+0000","objects_scrubbed":11,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:01.844534+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100174,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":946,"num_read_kb":2084,"num_write":804,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10824,"num_omap_keys":26,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:16.195170+0000","last_change":"2024-09-12T01:05:16.195170+0000","last_active":"2024-09-12T01:05:16.195170+0000","last_peered":"2024-09-12T01:05:16.195170+0000","last_clean":"2024-09-12T01:05:16.195170+0000","last_became_active":"2024-09-12T00:18:30.903532+0000","last_became_peered":"2024-09-12T00:18:30.903532+0000","last_unstale":"2024-09-12T01:05:16.195170+0000","last_undegraded":"2024-09-12T01:05:16.195170+0000","last_fullsized":"2024-09-12T01:05:16.195170+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:16.194961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:16.194961+0000","last_clean_scrub_stamp":"2024-09-12T01:05:16.194961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:04.425970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'146","reported_seq":661,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.094131+0000","last_change":"2024-09-12T01:05:20.094131+0000","last_active":"2024-09-12T01:05:20.094131+0000","last_peered":"2024-09-12T01:05:20.094131+0000","last_clean":"2024-09-12T01:05:20.094131+0000","last_became_active":"2024-09-12T00:18:32.896532+0000","last_became_peered":"2024-09-12T00:18:32.896532+0000","last_unstale":"2024-09-12T01:05:20.094131+0000","last_undegraded":"2024-09-12T01:05:20.094131+0000","last_fullsized":"2024-09-12T01:05:20.094131+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'146","last_scrub_stamp":"2024-09-12T01:05:20.093935+0000","last_deep_scrub":"268'146","last_deep_scrub_stamp":"2024-09-12T01:05:20.093935+0000","last_clean_scrub_stamp":"2024-09-12T01:05:20.093935+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:50.320749+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":138,"num_write":339,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'365","reported_seq":1912,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.176764+0000","last_change":"2024-09-12T01:04:53.176764+0000","last_active":"2024-09-12T01:04:53.176764+0000","last_peered":"2024-09-12T01:04:53.176764+0000","last_clean":"2024-09-12T01:04:53.176764+0000","last_became_active":"2024-09-12T00:18:24.852620+0000","last_became_peered":"2024-09-12T00:18:24.852620+0000","last_unstale":"2024-09-12T01:04:53.176764+0000","last_undegraded":"2024-09-12T01:04:53.176764+0000","last_fullsized":"2024-09-12T01:04:53.176764+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'365","last_scrub_stamp":"2024-09-12T01:04:53.176561+0000","last_deep_scrub":"268'365","last_deep_scrub_stamp":"2024-09-12T01:04:53.176561+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.176561+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:08.338535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2109,"num_read_kb":2037,"num_write":400,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'349","reported_seq":1003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.521739+0000","last_change":"2024-09-12T01:04:49.521739+0000","last_active":"2024-09-12T01:04:49.521739+0000","last_peered":"2024-09-12T01:04:49.521739+0000","last_clean":"2024-09-12T01:04:49.521739+0000","last_became_active":"2024-09-12T00:18:22.839001+0000","last_became_peered":"2024-09-12T00:18:22.839001+0000","last_unstale":"2024-09-12T01:04:49.521739+0000","last_undegraded":"2024-09-12T01:04:49.521739+0000","last_fullsized":"2024-09-12T01:04:49.521739+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'349","last_scrub_stamp":"2024-09-12T01:04:49.521528+0000","last_deep_scrub":"268'349","last_deep_scrub_stamp":"2024-09-12T01:04:49.521528+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.521528+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:43.868981+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":481,"num_read_kb":59946,"num_write":977,"num_write_kb":34875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.373441+0000","last_change":"2024-09-12T01:04:49.373441+0000","last_active":"2024-09-12T01:04:49.373441+0000","last_peered":"2024-09-12T01:04:49.373441+0000","last_clean":"2024-09-12T01:04:49.373441+0000","last_became_active":"2024-09-12T00:18:08.958069+0000","last_became_peered":"2024-09-12T00:18:08.958069+0000","last_unstale":"2024-09-12T01:04:49.373441+0000","last_undegraded":"2024-09-12T01:04:49.373441+0000","last_fullsized":"2024-09-12T01:04:49.373441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:49.373275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:49.373275+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.373275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:16.974812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001047189,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.627037+0000","last_change":"2024-09-12T01:05:00.627037+0000","last_active":"2024-09-12T01:05:00.627037+0000","last_peered":"2024-09-12T01:05:00.627037+0000","last_clean":"2024-09-12T01:05:00.627037+0000","last_became_active":"2024-09-12T00:18:26.865743+0000","last_became_peered":"2024-09-12T00:18:26.865743+0000","last_unstale":"2024-09-12T01:05:00.627037+0000","last_undegraded":"2024-09-12T01:05:00.627037+0000","last_fullsized":"2024-09-12T01:05:00.627037+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:00.626750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:00.626750+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.626750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:33.255245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'172","reported_seq":757,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.595331+0000","last_change":"2024-09-12T01:05:04.595331+0000","last_active":"2024-09-12T01:05:04.595331+0000","last_peered":"2024-09-12T01:05:04.595331+0000","last_clean":"2024-09-12T01:05:04.595331+0000","last_became_active":"2024-09-12T00:18:28.877233+0000","last_became_peered":"2024-09-12T00:18:28.877233+0000","last_unstale":"2024-09-12T01:05:04.595331+0000","last_undegraded":"2024-09-12T01:05:04.595331+0000","last_fullsized":"2024-09-12T01:05:04.595331+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'172","last_scrub_stamp":"2024-09-12T01:05:04.595140+0000","last_deep_scrub":"268'172","last_deep_scrub_stamp":"2024-09-12T01:05:04.595140+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.595140+0000","objects_scrubbed":8,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:08.053394+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":206,"num_read_kb":196,"num_write":136,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'793","reported_seq":2616,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:16.566566+0000","last_change":"2024-09-12T01:05:16.566566+0000","last_active":"2024-09-12T01:05:16.566566+0000","last_peered":"2024-09-12T01:05:16.566566+0000","last_clean":"2024-09-12T01:05:16.566566+0000","last_became_active":"2024-09-12T00:18:30.873484+0000","last_became_peered":"2024-09-12T00:18:30.873484+0000","last_unstale":"2024-09-12T01:05:16.566566+0000","last_undegraded":"2024-09-12T01:05:16.566566+0000","last_fullsized":"2024-09-12T01:05:16.566566+0000","mapping_epoch":32,"log_start":"268'702","ondisk_log_start":"268'702","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'793","last_scrub_stamp":"2024-09-12T01:05:16.566382+0000","last_deep_scrub":"268'793","last_deep_scrub_stamp":"2024-09-12T01:05:16.566382+0000","last_clean_scrub_stamp":"2024-09-12T01:05:16.566382+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":702,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:02.420995+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'166","reported_seq":692,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:23.074944+0000","last_change":"2024-09-12T01:05:23.074944+0000","last_active":"2024-09-12T01:05:23.074944+0000","last_peered":"2024-09-12T01:05:23.074944+0000","last_clean":"2024-09-12T01:05:23.074944+0000","last_became_active":"2024-09-12T00:18:32.893315+0000","last_became_peered":"2024-09-12T00:18:32.893315+0000","last_unstale":"2024-09-12T01:05:23.074944+0000","last_undegraded":"2024-09-12T01:05:23.074944+0000","last_fullsized":"2024-09-12T01:05:23.074944+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'166","last_scrub_stamp":"2024-09-12T01:05:23.074744+0000","last_deep_scrub":"268'166","last_deep_scrub_stamp":"2024-09-12T01:05:23.074744+0000","last_clean_scrub_stamp":"2024-09-12T01:05:23.074744+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:54.155808+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":201,"num_read_kb":185,"num_write":395,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'453","reported_seq":2025,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.185147+0000","last_change":"2024-09-12T01:04:56.185147+0000","last_active":"2024-09-12T01:04:56.185147+0000","last_peered":"2024-09-12T01:04:56.185147+0000","last_clean":"2024-09-12T01:04:56.185147+0000","last_became_active":"2024-09-12T00:18:24.865603+0000","last_became_peered":"2024-09-12T00:18:24.865603+0000","last_unstale":"2024-09-12T01:04:56.185147+0000","last_undegraded":"2024-09-12T01:04:56.185147+0000","last_fullsized":"2024-09-12T01:04:56.185147+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'453","last_scrub_stamp":"2024-09-12T01:04:56.184924+0000","last_deep_scrub":"268'453","last_deep_scrub_stamp":"2024-09-12T01:04:56.184924+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.184924+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:02.597927+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2591,"num_read_kb":2430,"num_write":539,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'362","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.313725+0000","last_change":"2024-09-12T01:04:47.313725+0000","last_active":"2024-09-12T01:04:47.313725+0000","last_peered":"2024-09-12T01:04:47.313725+0000","last_clean":"2024-09-12T01:04:47.313725+0000","last_became_active":"2024-09-12T00:18:22.870180+0000","last_became_peered":"2024-09-12T00:18:22.870180+0000","last_unstale":"2024-09-12T01:04:47.313725+0000","last_undegraded":"2024-09-12T01:04:47.313725+0000","last_fullsized":"2024-09-12T01:04:47.313725+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'362","last_scrub_stamp":"2024-09-12T01:04:47.313542+0000","last_deep_scrub":"268'362","last_deep_scrub_stamp":"2024-09-12T01:04:47.313542+0000","last_clean_scrub_stamp":"2024-09-12T01:04:47.313542+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:20.898497+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":450,"num_read_kb":16363,"num_write":1061,"num_write_kb":31356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":538,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:45.528242+0000","last_change":"2024-09-12T01:04:45.528242+0000","last_active":"2024-09-12T01:04:45.528242+0000","last_peered":"2024-09-12T01:04:45.528242+0000","last_clean":"2024-09-12T01:04:45.528242+0000","last_became_active":"2024-09-12T00:18:08.638003+0000","last_became_peered":"2024-09-12T00:18:08.638003+0000","last_unstale":"2024-09-12T01:04:45.528242+0000","last_undegraded":"2024-09-12T01:04:45.528242+0000","last_fullsized":"2024-09-12T01:04:45.528242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:45.528131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:45.528131+0000","last_clean_scrub_stamp":"2024-09-12T01:04:45.528131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:02.250802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010953429999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:08.194135+0000","last_change":"2024-09-12T01:05:08.194135+0000","last_active":"2024-09-12T01:05:08.194135+0000","last_peered":"2024-09-12T01:05:08.194135+0000","last_clean":"2024-09-12T01:05:08.194135+0000","last_became_active":"2024-09-12T00:18:26.858300+0000","last_became_peered":"2024-09-12T00:18:26.858300+0000","last_unstale":"2024-09-12T01:05:08.194135+0000","last_undegraded":"2024-09-12T01:05:08.194135+0000","last_fullsized":"2024-09-12T01:05:08.194135+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:08.193956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:08.193956+0000","last_clean_scrub_stamp":"2024-09-12T01:05:08.193956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:19.373254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'115","reported_seq":672,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:12.182678+0000","last_change":"2024-09-12T01:05:12.182678+0000","last_active":"2024-09-12T01:05:12.182678+0000","last_peered":"2024-09-12T01:05:12.182678+0000","last_clean":"2024-09-12T01:05:12.182678+0000","last_became_active":"2024-09-12T00:18:28.880684+0000","last_became_peered":"2024-09-12T00:18:28.880684+0000","last_unstale":"2024-09-12T01:05:12.182678+0000","last_undegraded":"2024-09-12T01:05:12.182678+0000","last_fullsized":"2024-09-12T01:05:12.182678+0000","mapping_epoch":30,"log_start":"268'100","ondisk_log_start":"268'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'115","last_scrub_stamp":"2024-09-12T01:05:12.182490+0000","last_deep_scrub":"268'115","last_deep_scrub_stamp":"2024-09-12T01:05:12.182490+0000","last_clean_scrub_stamp":"2024-09-12T01:05:12.182490+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:17.746846+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'817","reported_seq":2650,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:18.115608+0000","last_change":"2024-09-12T01:05:18.115608+0000","last_active":"2024-09-12T01:05:18.115608+0000","last_peered":"2024-09-12T01:05:18.115608+0000","last_clean":"2024-09-12T01:05:18.115608+0000","last_became_active":"2024-09-12T00:18:30.902580+0000","last_became_peered":"2024-09-12T00:18:30.902580+0000","last_unstale":"2024-09-12T01:05:18.115608+0000","last_undegraded":"2024-09-12T01:05:18.115608+0000","last_fullsized":"2024-09-12T01:05:18.115608+0000","mapping_epoch":32,"log_start":"268'800","ondisk_log_start":"268'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'817","last_scrub_stamp":"2024-09-12T01:05:18.115426+0000","last_deep_scrub":"268'817","last_deep_scrub_stamp":"2024-09-12T01:05:18.115426+0000","last_clean_scrub_stamp":"2024-09-12T01:05:18.115426+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:40.730445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'176","reported_seq":684,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.130705+0000","last_change":"2024-09-12T01:05:19.130705+0000","last_active":"2024-09-12T01:05:19.130705+0000","last_peered":"2024-09-12T01:05:19.130705+0000","last_clean":"2024-09-12T01:05:19.130705+0000","last_became_active":"2024-09-12T00:18:32.902970+0000","last_became_peered":"2024-09-12T00:18:32.902970+0000","last_unstale":"2024-09-12T01:05:19.130705+0000","last_undegraded":"2024-09-12T01:05:19.130705+0000","last_fullsized":"2024-09-12T01:05:19.130705+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'176","last_scrub_stamp":"2024-09-12T01:05:19.130483+0000","last_deep_scrub":"268'176","last_deep_scrub_stamp":"2024-09-12T01:05:19.130483+0000","last_clean_scrub_stamp":"2024-09-12T01:05:19.130483+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:48.772293+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":388,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'597","reported_seq":2178,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.221206+0000","last_change":"2024-09-12T01:04:52.221206+0000","last_active":"2024-09-12T01:04:52.221206+0000","last_peered":"2024-09-12T01:04:52.221206+0000","last_clean":"2024-09-12T01:04:52.221206+0000","last_became_active":"2024-09-12T00:18:24.879205+0000","last_became_peered":"2024-09-12T00:18:24.879205+0000","last_unstale":"2024-09-12T01:04:52.221206+0000","last_undegraded":"2024-09-12T01:04:52.221206+0000","last_fullsized":"2024-09-12T01:04:52.221206+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'597","last_scrub_stamp":"2024-09-12T01:04:52.220980+0000","last_deep_scrub":"268'597","last_deep_scrub_stamp":"2024-09-12T01:04:52.220980+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.220980+0000","objects_scrubbed":9,"log_size":97,"log_dups_size":500,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:56.848160+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":3160,"num_read_kb":2876,"num_write":787,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2409,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'346","reported_seq":1075,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:45.268249+0000","last_change":"2024-09-12T01:04:45.268249+0000","last_active":"2024-09-12T01:04:45.268249+0000","last_peered":"2024-09-12T01:04:45.268249+0000","last_clean":"2024-09-12T01:04:45.268249+0000","last_became_active":"2024-09-12T00:18:22.850326+0000","last_became_peered":"2024-09-12T00:18:22.850326+0000","last_unstale":"2024-09-12T01:04:45.268249+0000","last_undegraded":"2024-09-12T01:04:45.268249+0000","last_fullsized":"2024-09-12T01:04:45.268249+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'346","last_scrub_stamp":"2024-09-12T01:04:45.268124+0000","last_deep_scrub":"268'346","last_deep_scrub_stamp":"2024-09-12T01:04:45.268124+0000","last_clean_scrub_stamp":"2024-09-12T01:04:45.268124+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:15.830198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":560,"num_read_kb":1535,"num_write":1060,"num_write_kb":23375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.744967+0000","last_change":"2024-09-12T01:04:47.744967+0000","last_active":"2024-09-12T01:04:47.744967+0000","last_peered":"2024-09-12T01:04:47.744967+0000","last_clean":"2024-09-12T01:04:47.744967+0000","last_became_active":"2024-09-12T00:18:08.648187+0000","last_became_peered":"2024-09-12T00:18:08.648187+0000","last_unstale":"2024-09-12T01:04:47.744967+0000","last_undegraded":"2024-09-12T01:04:47.744967+0000","last_fullsized":"2024-09-12T01:04:47.744967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:47.744772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:47.744772+0000","last_clean_scrub_stamp":"2024-09-12T01:04:47.744772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:48.648305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001130048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:08.026683+0000","last_change":"2024-09-12T01:05:08.026683+0000","last_active":"2024-09-12T01:05:08.026683+0000","last_peered":"2024-09-12T01:05:08.026683+0000","last_clean":"2024-09-12T01:05:08.026683+0000","last_became_active":"2024-09-12T00:18:26.851038+0000","last_became_peered":"2024-09-12T00:18:26.851038+0000","last_unstale":"2024-09-12T01:05:08.026683+0000","last_undegraded":"2024-09-12T01:05:08.026683+0000","last_fullsized":"2024-09-12T01:05:08.026683+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:08.026477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:08.026477+0000","last_clean_scrub_stamp":"2024-09-12T01:05:08.026477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:14.731757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'755","reported_seq":1489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:08.531549+0000","last_change":"2024-09-12T01:05:08.531549+0000","last_active":"2024-09-12T01:05:08.531549+0000","last_peered":"2024-09-12T01:05:08.531549+0000","last_clean":"2024-09-12T01:05:08.531549+0000","last_became_active":"2024-09-12T00:18:28.884726+0000","last_became_peered":"2024-09-12T00:18:28.884726+0000","last_unstale":"2024-09-12T01:05:08.531549+0000","last_undegraded":"2024-09-12T01:05:08.531549+0000","last_fullsized":"2024-09-12T01:05:08.531549+0000","mapping_epoch":30,"log_start":"268'700","ondisk_log_start":"268'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'755","last_scrub_stamp":"2024-09-12T01:05:08.531341+0000","last_deep_scrub":"268'755","last_deep_scrub_stamp":"2024-09-12T01:05:08.531341+0000","last_clean_scrub_stamp":"2024-09-12T01:05:08.531341+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:07.665283+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153841,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1337,"num_read_kb":3208,"num_write":1092,"num_write_kb":920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.075130+0000","last_change":"2024-09-12T01:05:19.075130+0000","last_active":"2024-09-12T01:05:19.075130+0000","last_peered":"2024-09-12T01:05:19.075130+0000","last_clean":"2024-09-12T01:05:19.075130+0000","last_became_active":"2024-09-12T00:18:30.900777+0000","last_became_peered":"2024-09-12T00:18:30.900777+0000","last_unstale":"2024-09-12T01:05:19.075130+0000","last_undegraded":"2024-09-12T01:05:19.075130+0000","last_fullsized":"2024-09-12T01:05:19.075130+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:19.074938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:19.074938+0000","last_clean_scrub_stamp":"2024-09-12T01:05:19.074938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:47.649281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'114","reported_seq":620,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.587716+0000","last_change":"2024-09-12T01:05:20.587583+0000","last_active":"2024-09-12T01:05:20.587716+0000","last_peered":"2024-09-12T01:05:20.587716+0000","last_clean":"2024-09-12T01:05:20.587716+0000","last_became_active":"2024-09-12T00:18:32.899881+0000","last_became_peered":"2024-09-12T00:18:32.899881+0000","last_unstale":"2024-09-12T01:05:20.587716+0000","last_undegraded":"2024-09-12T01:05:20.587716+0000","last_fullsized":"2024-09-12T01:05:20.587716+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'114","last_scrub_stamp":"2024-09-12T01:05:20.587401+0000","last_deep_scrub":"268'114","last_deep_scrub_stamp":"2024-09-12T01:05:20.587401+0000","last_clean_scrub_stamp":"2024-09-12T01:05:20.587401+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:26.494254+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":105,"num_write":264,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'148","reported_seq":719,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:22.070821+0000","last_change":"2024-09-12T01:05:22.070821+0000","last_active":"2024-09-12T01:05:22.070821+0000","last_peered":"2024-09-12T01:05:22.070821+0000","last_clean":"2024-09-12T01:05:22.070821+0000","last_became_active":"2024-09-12T00:18:32.902596+0000","last_became_peered":"2024-09-12T00:18:32.902596+0000","last_unstale":"2024-09-12T01:05:22.070821+0000","last_undegraded":"2024-09-12T01:05:22.070821+0000","last_fullsized":"2024-09-12T01:05:22.070821+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'148","last_scrub_stamp":"2024-09-12T01:05:22.070634+0000","last_deep_scrub":"268'148","last_deep_scrub_stamp":"2024-09-12T01:05:22.070634+0000","last_clean_scrub_stamp":"2024-09-12T01:05:22.070634+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:47.287403+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":238,"num_read_kb":229,"num_write":342,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'487","reported_seq":2119,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.218217+0000","last_change":"2024-09-12T01:04:57.217970+0000","last_active":"2024-09-12T01:04:57.218217+0000","last_peered":"2024-09-12T01:04:57.218217+0000","last_clean":"2024-09-12T01:04:57.218217+0000","last_became_active":"2024-09-12T00:18:24.879640+0000","last_became_peered":"2024-09-12T00:18:24.879640+0000","last_unstale":"2024-09-12T01:04:57.218217+0000","last_undegraded":"2024-09-12T01:04:57.218217+0000","last_fullsized":"2024-09-12T01:04:57.218217+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'487","last_scrub_stamp":"2024-09-12T01:04:57.217724+0000","last_deep_scrub":"268'487","last_deep_scrub_stamp":"2024-09-12T01:04:57.217724+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.217724+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:38.656659+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2579,"num_read_kb":2446,"num_write":588,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'391","reported_seq":1051,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.218806+0000","last_change":"2024-09-12T01:04:49.218588+0000","last_active":"2024-09-12T01:04:49.218806+0000","last_peered":"2024-09-12T01:04:49.218806+0000","last_clean":"2024-09-12T01:04:49.218806+0000","last_became_active":"2024-09-12T00:18:22.874059+0000","last_became_peered":"2024-09-12T00:18:22.874059+0000","last_unstale":"2024-09-12T01:04:49.218806+0000","last_undegraded":"2024-09-12T01:04:49.218806+0000","last_fullsized":"2024-09-12T01:04:49.218806+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'391","last_scrub_stamp":"2024-09-12T01:04:49.218318+0000","last_deep_scrub":"268'391","last_deep_scrub_stamp":"2024-09-12T01:04:49.218318+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.218318+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:02.132035+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":563,"num_read_kb":19542,"num_write":1220,"num_write_kb":37354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.571812+0000","last_change":"2024-09-12T01:05:01.571742+0000","last_active":"2024-09-12T01:05:01.571812+0000","last_peered":"2024-09-12T01:05:01.571812+0000","last_clean":"2024-09-12T01:05:01.571812+0000","last_became_active":"2024-09-12T00:18:26.866940+0000","last_became_peered":"2024-09-12T00:18:26.866940+0000","last_unstale":"2024-09-12T01:05:01.571812+0000","last_undegraded":"2024-09-12T01:05:01.571812+0000","last_fullsized":"2024-09-12T01:05:01.571812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:01.571641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:01.571641+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.571641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:47.206432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'300","reported_seq":897,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:15.045576+0000","last_change":"2024-09-12T01:05:15.045576+0000","last_active":"2024-09-12T01:05:15.045576+0000","last_peered":"2024-09-12T01:05:15.045576+0000","last_clean":"2024-09-12T01:05:15.045576+0000","last_became_active":"2024-09-12T00:18:28.877560+0000","last_became_peered":"2024-09-12T00:18:28.877560+0000","last_unstale":"2024-09-12T01:05:15.045576+0000","last_undegraded":"2024-09-12T01:05:15.045576+0000","last_fullsized":"2024-09-12T01:05:15.045576+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'300","last_scrub_stamp":"2024-09-12T01:05:15.045366+0000","last_deep_scrub":"268'300","last_deep_scrub_stamp":"2024-09-12T01:05:15.045366+0000","last_clean_scrub_stamp":"2024-09-12T01:05:15.045366+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:01.170647+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44815,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":481,"num_read_kb":1100,"num_write":392,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.067841+0000","last_change":"2024-09-12T01:05:20.067841+0000","last_active":"2024-09-12T01:05:20.067841+0000","last_peered":"2024-09-12T01:05:20.067841+0000","last_clean":"2024-09-12T01:05:20.067841+0000","last_became_active":"2024-09-12T00:18:30.901022+0000","last_became_peered":"2024-09-12T00:18:30.901022+0000","last_unstale":"2024-09-12T01:05:20.067841+0000","last_undegraded":"2024-09-12T01:05:20.067841+0000","last_fullsized":"2024-09-12T01:05:20.067841+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:20.067661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:20.067661+0000","last_clean_scrub_stamp":"2024-09-12T01:05:20.067661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:49.558004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'142","reported_seq":664,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:30.107435+0000","last_change":"2024-09-12T01:05:30.107435+0000","last_active":"2024-09-12T01:05:30.107435+0000","last_peered":"2024-09-12T01:05:30.107435+0000","last_clean":"2024-09-12T01:05:30.107435+0000","last_became_active":"2024-09-12T00:18:32.900434+0000","last_became_peered":"2024-09-12T00:18:32.900434+0000","last_unstale":"2024-09-12T01:05:30.107435+0000","last_undegraded":"2024-09-12T01:05:30.107435+0000","last_fullsized":"2024-09-12T01:05:30.107435+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'142","last_scrub_stamp":"2024-09-12T01:05:30.107252+0000","last_deep_scrub":"268'142","last_deep_scrub_stamp":"2024-09-12T01:05:30.107252+0000","last_clean_scrub_stamp":"2024-09-12T01:05:30.107252+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:29.618093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":83,"num_write":305,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'546","reported_seq":1971,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.579599+0000","last_change":"2024-09-12T01:04:58.579473+0000","last_active":"2024-09-12T01:04:58.579599+0000","last_peered":"2024-09-12T01:04:58.579599+0000","last_clean":"2024-09-12T01:04:58.579599+0000","last_became_active":"2024-09-12T00:18:24.878531+0000","last_became_peered":"2024-09-12T00:18:24.878531+0000","last_unstale":"2024-09-12T01:04:58.579599+0000","last_undegraded":"2024-09-12T01:04:58.579599+0000","last_fullsized":"2024-09-12T01:04:58.579599+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'546","last_scrub_stamp":"2024-09-12T01:04:58.579295+0000","last_deep_scrub":"268'546","last_deep_scrub_stamp":"2024-09-12T01:04:58.579295+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.579295+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:45.810541+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2546,"num_read_kb":2313,"num_write":710,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'415","reported_seq":1145,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.472885+0000","last_change":"2024-09-12T01:04:56.472885+0000","last_active":"2024-09-12T01:04:56.472885+0000","last_peered":"2024-09-12T01:04:56.472885+0000","last_clean":"2024-09-12T01:04:56.472885+0000","last_became_active":"2024-09-12T00:18:56.193958+0000","last_became_peered":"2024-09-12T00:18:56.193958+0000","last_unstale":"2024-09-12T01:04:56.472885+0000","last_undegraded":"2024-09-12T01:04:56.472885+0000","last_fullsized":"2024-09-12T01:04:56.472885+0000","mapping_epoch":37,"log_start":"268'400","ondisk_log_start":"268'400","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'415","last_scrub_stamp":"2024-09-12T01:04:56.472681+0000","last_deep_scrub":"268'415","last_deep_scrub_stamp":"2024-09-12T01:04:56.472681+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.472681+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:48.615635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":783,"num_read_kb":16311,"num_write":1252,"num_write_kb":28883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.040560+0000","last_change":"2024-09-12T01:05:04.040415+0000","last_active":"2024-09-12T01:05:04.040560+0000","last_peered":"2024-09-12T01:05:04.040560+0000","last_clean":"2024-09-12T01:05:04.040560+0000","last_became_active":"2024-09-12T00:18:26.852430+0000","last_became_peered":"2024-09-12T00:18:26.852430+0000","last_unstale":"2024-09-12T01:05:04.040560+0000","last_undegraded":"2024-09-12T01:05:04.040560+0000","last_fullsized":"2024-09-12T01:05:04.040560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:04.040228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:04.040228+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.040228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:38.093851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'50","reported_seq":564,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:10.219343+0000","last_change":"2024-09-12T01:05:10.219162+0000","last_active":"2024-09-12T01:05:10.219343+0000","last_peered":"2024-09-12T01:05:10.219343+0000","last_clean":"2024-09-12T01:05:10.219343+0000","last_became_active":"2024-09-12T00:18:28.888625+0000","last_became_peered":"2024-09-12T00:18:28.888625+0000","last_unstale":"2024-09-12T01:05:10.219343+0000","last_undegraded":"2024-09-12T01:05:10.219343+0000","last_fullsized":"2024-09-12T01:05:10.219343+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'50","last_scrub_stamp":"2024-09-12T01:05:10.218980+0000","last_deep_scrub":"268'50","last_deep_scrub_stamp":"2024-09-12T01:05:10.218980+0000","last_clean_scrub_stamp":"2024-09-12T01:05:10.218980+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:06.439044+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.417865+0000","last_change":"2024-09-12T01:05:14.417865+0000","last_active":"2024-09-12T01:05:14.417865+0000","last_peered":"2024-09-12T01:05:14.417865+0000","last_clean":"2024-09-12T01:05:14.417865+0000","last_became_active":"2024-09-12T00:18:30.894388+0000","last_became_peered":"2024-09-12T00:18:30.894388+0000","last_unstale":"2024-09-12T01:05:14.417865+0000","last_undegraded":"2024-09-12T01:05:14.417865+0000","last_fullsized":"2024-09-12T01:05:14.417865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:14.417664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:14.417664+0000","last_clean_scrub_stamp":"2024-09-12T01:05:14.417664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:10.320787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'211","reported_seq":737,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:23.057200+0000","last_change":"2024-09-12T01:05:23.057200+0000","last_active":"2024-09-12T01:05:23.057200+0000","last_peered":"2024-09-12T01:05:23.057200+0000","last_clean":"2024-09-12T01:05:23.057200+0000","last_became_active":"2024-09-12T00:18:32.903719+0000","last_became_peered":"2024-09-12T00:18:32.903719+0000","last_unstale":"2024-09-12T01:05:23.057200+0000","last_undegraded":"2024-09-12T01:05:23.057200+0000","last_fullsized":"2024-09-12T01:05:23.057200+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'211","last_scrub_stamp":"2024-09-12T01:05:23.056965+0000","last_deep_scrub":"268'211","last_deep_scrub_stamp":"2024-09-12T01:05:23.056965+0000","last_clean_scrub_stamp":"2024-09-12T01:05:23.056965+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":100,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:28.934047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":286,"num_read_kb":283,"num_write":470,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'853","reported_seq":2460,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.164106+0000","last_change":"2024-09-12T01:04:57.163980+0000","last_active":"2024-09-12T01:04:57.164106+0000","last_peered":"2024-09-12T01:04:57.164106+0000","last_clean":"2024-09-12T01:04:57.164106+0000","last_became_active":"2024-09-12T00:18:24.865480+0000","last_became_peered":"2024-09-12T00:18:24.865480+0000","last_unstale":"2024-09-12T01:04:57.164106+0000","last_undegraded":"2024-09-12T01:04:57.164106+0000","last_fullsized":"2024-09-12T01:04:57.164106+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'853","last_scrub_stamp":"2024-09-12T01:04:57.163800+0000","last_deep_scrub":"268'853","last_deep_scrub_stamp":"2024-09-12T01:04:57.163800+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.163800+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":800,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:48.870486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4053,"num_read_kb":3643,"num_write":1115,"num_write_kb":411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3056,"num_omap_keys":12,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'394","reported_seq":1053,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.476888+0000","last_change":"2024-09-12T01:04:48.476828+0000","last_active":"2024-09-12T01:04:48.476888+0000","last_peered":"2024-09-12T01:04:48.476888+0000","last_clean":"2024-09-12T01:04:48.476888+0000","last_became_active":"2024-09-12T00:18:55.955303+0000","last_became_peered":"2024-09-12T00:18:55.955303+0000","last_unstale":"2024-09-12T01:04:48.476888+0000","last_undegraded":"2024-09-12T01:04:48.476888+0000","last_fullsized":"2024-09-12T01:04:48.476888+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'394","last_scrub_stamp":"2024-09-12T01:04:48.476684+0000","last_deep_scrub":"268'394","last_deep_scrub_stamp":"2024-09-12T01:04:48.476684+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.476684+0000","objects_scrubbed":13,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:27.009748+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1605311,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":590,"num_read_kb":40569,"num_write":1352,"num_write_kb":40151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:06.498381+0000","last_change":"2024-09-12T01:05:06.498244+0000","last_active":"2024-09-12T01:05:06.498381+0000","last_peered":"2024-09-12T01:05:06.498381+0000","last_clean":"2024-09-12T01:05:06.498381+0000","last_became_active":"2024-09-12T00:18:26.859801+0000","last_became_peered":"2024-09-12T00:18:26.859801+0000","last_unstale":"2024-09-12T01:05:06.498381+0000","last_undegraded":"2024-09-12T01:05:06.498381+0000","last_fullsized":"2024-09-12T01:05:06.498381+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:06.498058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:06.498058+0000","last_clean_scrub_stamp":"2024-09-12T01:05:06.498058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:23.328223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'321","reported_seq":928,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.052652+0000","last_change":"2024-09-12T01:05:14.052652+0000","last_active":"2024-09-12T01:05:14.052652+0000","last_peered":"2024-09-12T01:05:14.052652+0000","last_clean":"2024-09-12T01:05:14.052652+0000","last_became_active":"2024-09-12T00:18:28.877317+0000","last_became_peered":"2024-09-12T00:18:28.877317+0000","last_unstale":"2024-09-12T01:05:14.052652+0000","last_undegraded":"2024-09-12T01:05:14.052652+0000","last_fullsized":"2024-09-12T01:05:14.052652+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'321","last_scrub_stamp":"2024-09-12T01:05:14.052413+0000","last_deep_scrub":"268'321","last_deep_scrub_stamp":"2024-09-12T01:05:14.052413+0000","last_clean_scrub_stamp":"2024-09-12T01:05:14.052413+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:18.845969+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53640,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":520,"num_read_kb":1147,"num_write":418,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:06.754939+0000","last_change":"2024-09-12T01:05:06.754772+0000","last_active":"2024-09-12T01:05:06.754939+0000","last_peered":"2024-09-12T01:05:06.754939+0000","last_clean":"2024-09-12T01:05:06.754939+0000","last_became_active":"2024-09-12T00:18:30.904052+0000","last_became_peered":"2024-09-12T00:18:30.904052+0000","last_unstale":"2024-09-12T01:05:06.754939+0000","last_undegraded":"2024-09-12T01:05:06.754939+0000","last_fullsized":"2024-09-12T01:05:06.754939+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:06.754587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:06.754587+0000","last_clean_scrub_stamp":"2024-09-12T01:05:06.754587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:30.338221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'140","reported_seq":667,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:23.564204+0000","last_change":"2024-09-12T01:05:23.564204+0000","last_active":"2024-09-12T01:05:23.564204+0000","last_peered":"2024-09-12T01:05:23.564204+0000","last_clean":"2024-09-12T01:05:23.564204+0000","last_became_active":"2024-09-12T00:18:32.899607+0000","last_became_peered":"2024-09-12T00:18:32.899607+0000","last_unstale":"2024-09-12T01:05:23.564204+0000","last_undegraded":"2024-09-12T01:05:23.564204+0000","last_fullsized":"2024-09-12T01:05:23.564204+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'140","last_scrub_stamp":"2024-09-12T01:05:23.564023+0000","last_deep_scrub":"268'140","last_deep_scrub_stamp":"2024-09-12T01:05:23.564023+0000","last_clean_scrub_stamp":"2024-09-12T01:05:23.564023+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:21.633929+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":193,"num_read_kb":183,"num_write":356,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'352","reported_seq":1902,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.079954+0000","last_change":"2024-09-12T01:05:01.079819+0000","last_active":"2024-09-12T01:05:01.079954+0000","last_peered":"2024-09-12T01:05:01.079954+0000","last_clean":"2024-09-12T01:05:01.079954+0000","last_became_active":"2024-09-12T00:18:24.863389+0000","last_became_peered":"2024-09-12T00:18:24.863389+0000","last_unstale":"2024-09-12T01:05:01.079954+0000","last_undegraded":"2024-09-12T01:05:01.079954+0000","last_fullsized":"2024-09-12T01:05:01.079954+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'352","last_scrub_stamp":"2024-09-12T01:05:01.079632+0000","last_deep_scrub":"268'352","last_deep_scrub_stamp":"2024-09-12T01:05:01.079632+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.079632+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:11.611171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2172,"num_read_kb":2099,"num_write":388,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1654,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'349","reported_seq":991,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.216827+0000","last_change":"2024-09-12T01:04:47.216827+0000","last_active":"2024-09-12T01:04:47.216827+0000","last_peered":"2024-09-12T01:04:47.216827+0000","last_clean":"2024-09-12T01:04:47.216827+0000","last_became_active":"2024-09-12T00:18:22.863535+0000","last_became_peered":"2024-09-12T00:18:22.863535+0000","last_unstale":"2024-09-12T01:04:47.216827+0000","last_undegraded":"2024-09-12T01:04:47.216827+0000","last_fullsized":"2024-09-12T01:04:47.216827+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'349","last_scrub_stamp":"2024-09-12T01:04:47.216745+0000","last_deep_scrub":"268'349","last_deep_scrub_stamp":"2024-09-12T01:04:47.216745+0000","last_clean_scrub_stamp":"2024-09-12T01:04:47.216745+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:20.488567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":493,"num_read_kb":3769,"num_write":1077,"num_write_kb":28344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.665332+0000","last_change":"2024-09-12T01:04:59.665200+0000","last_active":"2024-09-12T01:04:59.665332+0000","last_peered":"2024-09-12T01:04:59.665332+0000","last_clean":"2024-09-12T01:04:59.665332+0000","last_became_active":"2024-09-12T00:18:26.874839+0000","last_became_peered":"2024-09-12T00:18:26.874839+0000","last_unstale":"2024-09-12T01:04:59.665332+0000","last_undegraded":"2024-09-12T01:04:59.665332+0000","last_fullsized":"2024-09-12T01:04:59.665332+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:59.664986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:59.664986+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.664986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:33.767626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'275","reported_seq":853,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:11.466667+0000","last_change":"2024-09-12T01:05:11.466530+0000","last_active":"2024-09-12T01:05:11.466667+0000","last_peered":"2024-09-12T01:05:11.466667+0000","last_clean":"2024-09-12T01:05:11.466667+0000","last_became_active":"2024-09-12T00:18:28.888325+0000","last_became_peered":"2024-09-12T00:18:28.888325+0000","last_unstale":"2024-09-12T01:05:11.466667+0000","last_undegraded":"2024-09-12T01:05:11.466667+0000","last_fullsized":"2024-09-12T01:05:11.466667+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'275","last_scrub_stamp":"2024-09-12T01:05:11.466332+0000","last_deep_scrub":"268'275","last_deep_scrub_stamp":"2024-09-12T01:05:11.466332+0000","last_clean_scrub_stamp":"2024-09-12T01:05:11.466332+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:30.117767+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52815,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":453,"num_read_kb":1069,"num_write":372,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.209381+0000","last_change":"2024-09-12T01:05:13.209381+0000","last_active":"2024-09-12T01:05:13.209381+0000","last_peered":"2024-09-12T01:05:13.209381+0000","last_clean":"2024-09-12T01:05:13.209381+0000","last_became_active":"2024-09-12T00:18:30.899237+0000","last_became_peered":"2024-09-12T00:18:30.899237+0000","last_unstale":"2024-09-12T01:05:13.209381+0000","last_undegraded":"2024-09-12T01:05:13.209381+0000","last_fullsized":"2024-09-12T01:05:13.209381+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:13.209258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:13.209258+0000","last_clean_scrub_stamp":"2024-09-12T01:05:13.209258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:48.679519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'936","reported_seq":2379,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.750198+0000","last_change":"2024-09-12T01:04:57.750198+0000","last_active":"2024-09-12T01:04:57.750198+0000","last_peered":"2024-09-12T01:04:57.750198+0000","last_clean":"2024-09-12T01:04:57.750198+0000","last_became_active":"2024-09-12T00:18:24.859351+0000","last_became_peered":"2024-09-12T00:18:24.859351+0000","last_unstale":"2024-09-12T01:04:57.750198+0000","last_undegraded":"2024-09-12T01:04:57.750198+0000","last_fullsized":"2024-09-12T01:04:57.750198+0000","mapping_epoch":26,"log_start":"268'900","ondisk_log_start":"268'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'936","last_scrub_stamp":"2024-09-12T01:04:57.749993+0000","last_deep_scrub":"268'936","last_deep_scrub_stamp":"2024-09-12T01:04:57.749993+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.749993+0000","objects_scrubbed":6,"log_size":36,"log_dups_size":900,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:52.509130+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4324,"num_read_kb":3896,"num_write":1355,"num_write_kb":567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'315","reported_seq":1023,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.272346+0000","last_change":"2024-09-12T01:04:51.272346+0000","last_active":"2024-09-12T01:04:51.272346+0000","last_peered":"2024-09-12T01:04:51.272346+0000","last_clean":"2024-09-12T01:04:51.272346+0000","last_became_active":"2024-09-12T00:18:22.840244+0000","last_became_peered":"2024-09-12T00:18:22.840244+0000","last_unstale":"2024-09-12T01:04:51.272346+0000","last_undegraded":"2024-09-12T01:04:51.272346+0000","last_fullsized":"2024-09-12T01:04:51.272346+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'315","last_scrub_stamp":"2024-09-12T01:04:51.272055+0000","last_deep_scrub":"268'315","last_deep_scrub_stamp":"2024-09-12T01:04:51.272055+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.272055+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:05.495095+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":618,"num_read_kb":30347,"num_write":961,"num_write_kb":34968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.298177+0000","last_change":"2024-09-12T01:05:05.298177+0000","last_active":"2024-09-12T01:05:05.298177+0000","last_peered":"2024-09-12T01:05:05.298177+0000","last_clean":"2024-09-12T01:05:05.298177+0000","last_became_active":"2024-09-12T00:18:26.855432+0000","last_became_peered":"2024-09-12T00:18:26.855432+0000","last_unstale":"2024-09-12T01:05:05.298177+0000","last_undegraded":"2024-09-12T01:05:05.298177+0000","last_fullsized":"2024-09-12T01:05:05.298177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:05.297897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:05.297897+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.297897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:58.875114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'474","reported_seq":1125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:08.566134+0000","last_change":"2024-09-12T01:05:08.566134+0000","last_active":"2024-09-12T01:05:08.566134+0000","last_peered":"2024-09-12T01:05:08.566134+0000","last_clean":"2024-09-12T01:05:08.566134+0000","last_became_active":"2024-09-12T00:18:28.887245+0000","last_became_peered":"2024-09-12T00:18:28.887245+0000","last_unstale":"2024-09-12T01:05:08.566134+0000","last_undegraded":"2024-09-12T01:05:08.566134+0000","last_fullsized":"2024-09-12T01:05:08.566134+0000","mapping_epoch":30,"log_start":"268'400","ondisk_log_start":"268'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'474","last_scrub_stamp":"2024-09-12T01:05:08.565945+0000","last_deep_scrub":"268'474","last_deep_scrub_stamp":"2024-09-12T01:05:08.565945+0000","last_clean_scrub_stamp":"2024-09-12T01:05:08.565945+0000","objects_scrubbed":7,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:06.432369+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":845,"num_read_kb":1964,"num_write":726,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:17.578807+0000","last_change":"2024-09-12T01:05:17.578807+0000","last_active":"2024-09-12T01:05:17.578807+0000","last_peered":"2024-09-12T01:05:17.578807+0000","last_clean":"2024-09-12T01:05:17.578807+0000","last_became_active":"2024-09-12T00:18:30.905680+0000","last_became_peered":"2024-09-12T00:18:30.905680+0000","last_unstale":"2024-09-12T01:05:17.578807+0000","last_undegraded":"2024-09-12T01:05:17.578807+0000","last_fullsized":"2024-09-12T01:05:17.578807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:17.578603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:17.578603+0000","last_clean_scrub_stamp":"2024-09-12T01:05:17.578603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:02.013094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'154","reported_seq":670,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:26.083011+0000","last_change":"2024-09-12T01:05:26.083011+0000","last_active":"2024-09-12T01:05:26.083011+0000","last_peered":"2024-09-12T01:05:26.083011+0000","last_clean":"2024-09-12T01:05:26.083011+0000","last_became_active":"2024-09-12T00:18:32.905070+0000","last_became_peered":"2024-09-12T00:18:32.905070+0000","last_unstale":"2024-09-12T01:05:26.083011+0000","last_undegraded":"2024-09-12T01:05:26.083011+0000","last_fullsized":"2024-09-12T01:05:26.083011+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'154","last_scrub_stamp":"2024-09-12T01:05:26.082827+0000","last_deep_scrub":"268'154","last_deep_scrub_stamp":"2024-09-12T01:05:26.082827+0000","last_clean_scrub_stamp":"2024-09-12T01:05:26.082827+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:27.746790+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":167,"num_read_kb":179,"num_write":337,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'642","reported_seq":2065,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.325029+0000","last_change":"2024-09-12T01:04:58.325029+0000","last_active":"2024-09-12T01:04:58.325029+0000","last_peered":"2024-09-12T01:04:58.325029+0000","last_clean":"2024-09-12T01:04:58.325029+0000","last_became_active":"2024-09-12T00:18:24.865142+0000","last_became_peered":"2024-09-12T00:18:24.865142+0000","last_unstale":"2024-09-12T01:04:58.325029+0000","last_undegraded":"2024-09-12T01:04:58.325029+0000","last_fullsized":"2024-09-12T01:04:58.325029+0000","mapping_epoch":26,"log_start":"268'600","ondisk_log_start":"268'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'642","last_scrub_stamp":"2024-09-12T01:04:58.324781+0000","last_deep_scrub":"268'642","last_deep_scrub_stamp":"2024-09-12T01:04:58.324781+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.324781+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":600,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:57.756900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2990,"num_read_kb":2759,"num_write":892,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'343","reported_seq":1275,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.556937+0000","last_change":"2024-09-12T01:04:48.556937+0000","last_active":"2024-09-12T01:04:48.556937+0000","last_peered":"2024-09-12T01:04:48.556937+0000","last_clean":"2024-09-12T01:04:48.556937+0000","last_became_active":"2024-09-12T00:18:22.845288+0000","last_became_peered":"2024-09-12T00:18:22.845288+0000","last_unstale":"2024-09-12T01:04:48.556937+0000","last_undegraded":"2024-09-12T01:04:48.556937+0000","last_fullsized":"2024-09-12T01:04:48.556937+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'343","last_scrub_stamp":"2024-09-12T01:04:48.556730+0000","last_deep_scrub":"268'343","last_deep_scrub_stamp":"2024-09-12T01:04:48.556730+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.556730+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:49.299596+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1116,"num_read_kb":11059,"num_write":1212,"num_write_kb":25104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.672231+0000","last_change":"2024-09-12T01:05:02.672231+0000","last_active":"2024-09-12T01:05:02.672231+0000","last_peered":"2024-09-12T01:05:02.672231+0000","last_clean":"2024-09-12T01:05:02.672231+0000","last_became_active":"2024-09-12T00:18:26.874972+0000","last_became_peered":"2024-09-12T00:18:26.874972+0000","last_unstale":"2024-09-12T01:05:02.672231+0000","last_undegraded":"2024-09-12T01:05:02.672231+0000","last_fullsized":"2024-09-12T01:05:02.672231+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:02.672044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:02.672044+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.672044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:02.283457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'325","reported_seq":916,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:12.435694+0000","last_change":"2024-09-12T01:05:12.435694+0000","last_active":"2024-09-12T01:05:12.435694+0000","last_peered":"2024-09-12T01:05:12.435694+0000","last_clean":"2024-09-12T01:05:12.435694+0000","last_became_active":"2024-09-12T00:18:28.892852+0000","last_became_peered":"2024-09-12T00:18:28.892852+0000","last_unstale":"2024-09-12T01:05:12.435694+0000","last_undegraded":"2024-09-12T01:05:12.435694+0000","last_fullsized":"2024-09-12T01:05:12.435694+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'325","last_scrub_stamp":"2024-09-12T01:05:12.435470+0000","last_deep_scrub":"268'325","last_deep_scrub_stamp":"2024-09-12T01:05:12.435470+0000","last_clean_scrub_stamp":"2024-09-12T01:05:12.435470+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:44.860765+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53047,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":539,"num_read_kb":1212,"num_write":456,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:11.583125+0000","last_change":"2024-09-12T01:05:11.583125+0000","last_active":"2024-09-12T01:05:11.583125+0000","last_peered":"2024-09-12T01:05:11.583125+0000","last_clean":"2024-09-12T01:05:11.583125+0000","last_became_active":"2024-09-12T00:18:30.892643+0000","last_became_peered":"2024-09-12T00:18:30.892643+0000","last_unstale":"2024-09-12T01:05:11.583125+0000","last_undegraded":"2024-09-12T01:05:11.583125+0000","last_fullsized":"2024-09-12T01:05:11.583125+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:11.582956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:11.582956+0000","last_clean_scrub_stamp":"2024-09-12T01:05:11.582956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:57.356251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'244","reported_seq":793,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:10.730777+0000","last_change":"2024-09-12T01:05:10.730642+0000","last_active":"2024-09-12T01:05:10.730777+0000","last_peered":"2024-09-12T01:05:10.730777+0000","last_clean":"2024-09-12T01:05:10.730777+0000","last_became_active":"2024-09-12T00:18:32.901587+0000","last_became_peered":"2024-09-12T00:18:32.901587+0000","last_unstale":"2024-09-12T01:05:10.730777+0000","last_undegraded":"2024-09-12T01:05:10.730777+0000","last_fullsized":"2024-09-12T01:05:10.730777+0000","mapping_epoch":34,"log_start":"268'200","ondisk_log_start":"268'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'244","last_scrub_stamp":"2024-09-12T01:05:10.730461+0000","last_deep_scrub":"268'244","last_deep_scrub_stamp":"2024-09-12T01:05:10.730461+0000","last_clean_scrub_stamp":"2024-09-12T01:05:10.730461+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:53.942944+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":371,"num_read_kb":330,"num_write":585,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'495","reported_seq":2044,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.019421+0000","last_change":"2024-09-12T01:05:05.019421+0000","last_active":"2024-09-12T01:05:05.019421+0000","last_peered":"2024-09-12T01:05:05.019421+0000","last_clean":"2024-09-12T01:05:05.019421+0000","last_became_active":"2024-09-12T00:18:24.860647+0000","last_became_peered":"2024-09-12T00:18:24.860647+0000","last_unstale":"2024-09-12T01:05:05.019421+0000","last_undegraded":"2024-09-12T01:05:05.019421+0000","last_fullsized":"2024-09-12T01:05:05.019421+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'495","last_scrub_stamp":"2024-09-12T01:05:05.019136+0000","last_deep_scrub":"268'495","last_deep_scrub_stamp":"2024-09-12T01:05:05.019136+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.019136+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:27.295349+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2720,"num_read_kb":2539,"num_write":620,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'383","reported_seq":1064,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.176551+0000","last_change":"2024-09-12T01:04:50.176551+0000","last_active":"2024-09-12T01:04:50.176551+0000","last_peered":"2024-09-12T01:04:50.176551+0000","last_clean":"2024-09-12T01:04:50.176551+0000","last_became_active":"2024-09-12T00:18:22.856073+0000","last_became_peered":"2024-09-12T00:18:22.856073+0000","last_unstale":"2024-09-12T01:04:50.176551+0000","last_undegraded":"2024-09-12T01:04:50.176551+0000","last_fullsized":"2024-09-12T01:04:50.176551+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'383","last_scrub_stamp":"2024-09-12T01:04:50.176350+0000","last_deep_scrub":"268'383","last_deep_scrub_stamp":"2024-09-12T01:04:50.176350+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.176350+0000","objects_scrubbed":12,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:59.557330+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468142,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":578,"num_read_kb":15678,"num_write":1129,"num_write_kb":22765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:11.161508+0000","last_change":"2024-09-12T01:05:11.161508+0000","last_active":"2024-09-12T01:05:11.161508+0000","last_peered":"2024-09-12T01:05:11.161508+0000","last_clean":"2024-09-12T01:05:11.161508+0000","last_became_active":"2024-09-12T00:18:26.862012+0000","last_became_peered":"2024-09-12T00:18:26.862012+0000","last_unstale":"2024-09-12T01:05:11.161508+0000","last_undegraded":"2024-09-12T01:05:11.161508+0000","last_fullsized":"2024-09-12T01:05:11.161508+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:11.161326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:11.161326+0000","last_clean_scrub_stamp":"2024-09-12T01:05:11.161326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:12.901407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'284","reported_seq":883,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:16.048179+0000","last_change":"2024-09-12T01:05:16.048179+0000","last_active":"2024-09-12T01:05:16.048179+0000","last_peered":"2024-09-12T01:05:16.048179+0000","last_clean":"2024-09-12T01:05:16.048179+0000","last_became_active":"2024-09-12T00:18:28.882129+0000","last_became_peered":"2024-09-12T00:18:28.882129+0000","last_unstale":"2024-09-12T01:05:16.048179+0000","last_undegraded":"2024-09-12T01:05:16.048179+0000","last_fullsized":"2024-09-12T01:05:16.048179+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'284","last_scrub_stamp":"2024-09-12T01:05:16.047992+0000","last_deep_scrub":"268'284","last_deep_scrub_stamp":"2024-09-12T01:05:16.047992+0000","last_clean_scrub_stamp":"2024-09-12T01:05:16.047992+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:00.794228+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47744,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":1049,"num_write":372,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.586021+0000","last_change":"2024-09-12T01:05:09.586021+0000","last_active":"2024-09-12T01:05:09.586021+0000","last_peered":"2024-09-12T01:05:09.586021+0000","last_clean":"2024-09-12T01:05:09.586021+0000","last_became_active":"2024-09-12T00:18:30.902511+0000","last_became_peered":"2024-09-12T00:18:30.902511+0000","last_unstale":"2024-09-12T01:05:09.586021+0000","last_undegraded":"2024-09-12T01:05:09.586021+0000","last_fullsized":"2024-09-12T01:05:09.586021+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:09.585833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:09.585833+0000","last_clean_scrub_stamp":"2024-09-12T01:05:09.585833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:20.848216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'134","reported_seq":660,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:21.567735+0000","last_change":"2024-09-12T01:05:21.567735+0000","last_active":"2024-09-12T01:05:21.567735+0000","last_peered":"2024-09-12T01:05:21.567735+0000","last_clean":"2024-09-12T01:05:21.567735+0000","last_became_active":"2024-09-12T00:18:32.899968+0000","last_became_peered":"2024-09-12T00:18:32.899968+0000","last_unstale":"2024-09-12T01:05:21.567735+0000","last_undegraded":"2024-09-12T01:05:21.567735+0000","last_fullsized":"2024-09-12T01:05:21.567735+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'134","last_scrub_stamp":"2024-09-12T01:05:21.567485+0000","last_deep_scrub":"268'134","last_deep_scrub_stamp":"2024-09-12T01:05:21.567485+0000","last_clean_scrub_stamp":"2024-09-12T01:05:21.567485+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:08.663806+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":825,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":214,"num_read_kb":184,"num_write":320,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'364","reported_seq":1744,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.442699+0000","last_change":"2024-09-12T01:04:52.442699+0000","last_active":"2024-09-12T01:04:52.442699+0000","last_peered":"2024-09-12T01:04:52.442699+0000","last_clean":"2024-09-12T01:04:52.442699+0000","last_became_active":"2024-09-12T00:18:24.861271+0000","last_became_peered":"2024-09-12T00:18:24.861271+0000","last_unstale":"2024-09-12T01:04:52.442699+0000","last_undegraded":"2024-09-12T01:04:52.442699+0000","last_fullsized":"2024-09-12T01:04:52.442699+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'364","last_scrub_stamp":"2024-09-12T01:04:52.442472+0000","last_deep_scrub":"268'364","last_deep_scrub_stamp":"2024-09-12T01:04:52.442472+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.442472+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:50.665068+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2074,"num_read_kb":1954,"num_write":427,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'348","reported_seq":985,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.262939+0000","last_change":"2024-09-12T01:04:49.262939+0000","last_active":"2024-09-12T01:04:49.262939+0000","last_peered":"2024-09-12T01:04:49.262939+0000","last_clean":"2024-09-12T01:04:49.262939+0000","last_became_active":"2024-09-12T00:18:22.859695+0000","last_became_peered":"2024-09-12T00:18:22.859695+0000","last_unstale":"2024-09-12T01:04:49.262939+0000","last_undegraded":"2024-09-12T01:04:49.262939+0000","last_fullsized":"2024-09-12T01:04:49.262939+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'348","last_scrub_stamp":"2024-09-12T01:04:49.262596+0000","last_deep_scrub":"268'348","last_deep_scrub_stamp":"2024-09-12T01:04:49.262596+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.262596+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:52.854459+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263211,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":478,"num_read_kb":12426,"num_write":1109,"num_write_kb":25448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:06.535966+0000","last_change":"2024-09-12T01:05:06.535966+0000","last_active":"2024-09-12T01:05:06.535966+0000","last_peered":"2024-09-12T01:05:06.535966+0000","last_clean":"2024-09-12T01:05:06.535966+0000","last_became_active":"2024-09-12T00:18:26.859234+0000","last_became_peered":"2024-09-12T00:18:26.859234+0000","last_unstale":"2024-09-12T01:05:06.535966+0000","last_undegraded":"2024-09-12T01:05:06.535966+0000","last_fullsized":"2024-09-12T01:05:06.535966+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:06.535753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:06.535753+0000","last_clean_scrub_stamp":"2024-09-12T01:05:06.535753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:39.417495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'130","reported_seq":672,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.215863+0000","last_change":"2024-09-12T01:05:19.215863+0000","last_active":"2024-09-12T01:05:19.215863+0000","last_peered":"2024-09-12T01:05:19.215863+0000","last_clean":"2024-09-12T01:05:19.215863+0000","last_became_active":"2024-09-12T00:18:28.883277+0000","last_became_peered":"2024-09-12T00:18:28.883277+0000","last_unstale":"2024-09-12T01:05:19.215863+0000","last_undegraded":"2024-09-12T01:05:19.215863+0000","last_fullsized":"2024-09-12T01:05:19.215863+0000","mapping_epoch":30,"log_start":"268'100","ondisk_log_start":"268'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'130","last_scrub_stamp":"2024-09-12T01:05:19.215623+0000","last_deep_scrub":"268'130","last_deep_scrub_stamp":"2024-09-12T01:05:19.215623+0000","last_clean_scrub_stamp":"2024-09-12T01:05:19.215623+0000","objects_scrubbed":8,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:44.684825+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":135,"num_read_kb":124,"num_write":148,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'770","reported_seq":2209,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:08.749470+0000","last_change":"2024-09-12T01:05:08.749470+0000","last_active":"2024-09-12T01:05:08.749470+0000","last_peered":"2024-09-12T01:05:08.749470+0000","last_clean":"2024-09-12T01:05:08.749470+0000","last_became_active":"2024-09-12T00:18:30.893175+0000","last_became_peered":"2024-09-12T00:18:30.893175+0000","last_unstale":"2024-09-12T01:05:08.749470+0000","last_undegraded":"2024-09-12T01:05:08.749470+0000","last_fullsized":"2024-09-12T01:05:08.749470+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'770","last_scrub_stamp":"2024-09-12T01:05:08.749187+0000","last_deep_scrub":"268'770","last_deep_scrub_stamp":"2024-09-12T01:05:08.749187+0000","last_clean_scrub_stamp":"2024-09-12T01:05:08.749187+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:10.450055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'108","reported_seq":611,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:18.408460+0000","last_change":"2024-09-12T01:05:18.408460+0000","last_active":"2024-09-12T01:05:18.408460+0000","last_peered":"2024-09-12T01:05:18.408460+0000","last_clean":"2024-09-12T01:05:18.408460+0000","last_became_active":"2024-09-12T00:18:32.908295+0000","last_became_peered":"2024-09-12T00:18:32.908295+0000","last_unstale":"2024-09-12T01:05:18.408460+0000","last_undegraded":"2024-09-12T01:05:18.408460+0000","last_fullsized":"2024-09-12T01:05:18.408460+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'108","last_scrub_stamp":"2024-09-12T01:05:18.408258+0000","last_deep_scrub":"268'108","last_deep_scrub_stamp":"2024-09-12T01:05:18.408258+0000","last_clean_scrub_stamp":"2024-09-12T01:05:18.408258+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:56.861384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":102,"num_write":264,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'834","reported_seq":2462,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.178341+0000","last_change":"2024-09-12T01:05:00.178341+0000","last_active":"2024-09-12T01:05:00.178341+0000","last_peered":"2024-09-12T01:05:00.178341+0000","last_clean":"2024-09-12T01:05:00.178341+0000","last_became_active":"2024-09-12T00:18:24.860266+0000","last_became_peered":"2024-09-12T00:18:24.860266+0000","last_unstale":"2024-09-12T01:05:00.178341+0000","last_undegraded":"2024-09-12T01:05:00.178341+0000","last_fullsized":"2024-09-12T01:05:00.178341+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'834","last_scrub_stamp":"2024-09-12T01:05:00.178156+0000","last_deep_scrub":"268'834","last_deep_scrub_stamp":"2024-09-12T01:05:00.178156+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.178156+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:24.839206+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4128,"num_read_kb":3735,"num_write":1126,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'317","reported_seq":929,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.585039+0000","last_change":"2024-09-12T01:04:51.585039+0000","last_active":"2024-09-12T01:04:51.585039+0000","last_peered":"2024-09-12T01:04:51.585039+0000","last_clean":"2024-09-12T01:04:51.585039+0000","last_became_active":"2024-09-12T00:18:22.867694+0000","last_became_peered":"2024-09-12T00:18:22.867694+0000","last_unstale":"2024-09-12T01:04:51.585039+0000","last_undegraded":"2024-09-12T01:04:51.585039+0000","last_fullsized":"2024-09-12T01:04:51.585039+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'317","last_scrub_stamp":"2024-09-12T01:04:51.584788+0000","last_deep_scrub":"268'317","last_deep_scrub_stamp":"2024-09-12T01:04:51.584788+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.584788+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:39.411322+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194362,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":405,"num_read_kb":19923,"num_write":982,"num_write_kb":45748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:07.504144+0000","last_change":"2024-09-12T01:05:07.504144+0000","last_active":"2024-09-12T01:05:07.504144+0000","last_peered":"2024-09-12T01:05:07.504144+0000","last_clean":"2024-09-12T01:05:07.504144+0000","last_became_active":"2024-09-12T00:18:26.864536+0000","last_became_peered":"2024-09-12T00:18:26.864536+0000","last_unstale":"2024-09-12T01:05:07.504144+0000","last_undegraded":"2024-09-12T01:05:07.504144+0000","last_fullsized":"2024-09-12T01:05:07.504144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:07.503869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:07.503869+0000","last_clean_scrub_stamp":"2024-09-12T01:05:07.503869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:30.764859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'348","reported_seq":966,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:15.606980+0000","last_change":"2024-09-12T01:05:15.606980+0000","last_active":"2024-09-12T01:05:15.606980+0000","last_peered":"2024-09-12T01:05:15.606980+0000","last_clean":"2024-09-12T01:05:15.606980+0000","last_became_active":"2024-09-12T00:18:28.885152+0000","last_became_peered":"2024-09-12T00:18:28.885152+0000","last_unstale":"2024-09-12T01:05:15.606980+0000","last_undegraded":"2024-09-12T01:05:15.606980+0000","last_fullsized":"2024-09-12T01:05:15.606980+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'348","last_scrub_stamp":"2024-09-12T01:05:15.606862+0000","last_deep_scrub":"268'348","last_deep_scrub_stamp":"2024-09-12T01:05:15.606862+0000","last_clean_scrub_stamp":"2024-09-12T01:05:15.606862+0000","objects_scrubbed":11,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:34.302412+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50453,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":539,"num_read_kb":1151,"num_write":436,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:15.162275+0000","last_change":"2024-09-12T01:05:15.162275+0000","last_active":"2024-09-12T01:05:15.162275+0000","last_peered":"2024-09-12T01:05:15.162275+0000","last_clean":"2024-09-12T01:05:15.162275+0000","last_became_active":"2024-09-12T00:18:30.888974+0000","last_became_peered":"2024-09-12T00:18:30.888974+0000","last_unstale":"2024-09-12T01:05:15.162275+0000","last_undegraded":"2024-09-12T01:05:15.162275+0000","last_fullsized":"2024-09-12T01:05:15.162275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:15.162085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:15.162085+0000","last_clean_scrub_stamp":"2024-09-12T01:05:15.162085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:33.981687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'100","reported_seq":615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.362653+0000","last_change":"2024-09-12T01:05:20.362653+0000","last_active":"2024-09-12T01:05:20.362653+0000","last_peered":"2024-09-12T01:05:20.362653+0000","last_clean":"2024-09-12T01:05:20.362653+0000","last_became_active":"2024-09-12T00:18:32.914994+0000","last_became_peered":"2024-09-12T00:18:32.914994+0000","last_unstale":"2024-09-12T01:05:20.362653+0000","last_undegraded":"2024-09-12T01:05:20.362653+0000","last_fullsized":"2024-09-12T01:05:20.362653+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'100","last_scrub_stamp":"2024-09-12T01:05:20.362477+0000","last_deep_scrub":"268'100","last_deep_scrub_stamp":"2024-09-12T01:05:20.362477+0000","last_clean_scrub_stamp":"2024-09-12T01:05:20.362477+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:42.589444+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":129,"num_write":234,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'859","reported_seq":2384,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.197006+0000","last_change":"2024-09-12T01:04:59.197006+0000","last_active":"2024-09-12T01:04:59.197006+0000","last_peered":"2024-09-12T01:04:59.197006+0000","last_clean":"2024-09-12T01:04:59.197006+0000","last_became_active":"2024-09-12T00:18:24.854089+0000","last_became_peered":"2024-09-12T00:18:24.854089+0000","last_unstale":"2024-09-12T01:04:59.197006+0000","last_undegraded":"2024-09-12T01:04:59.197006+0000","last_fullsized":"2024-09-12T01:04:59.197006+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'859","last_scrub_stamp":"2024-09-12T01:04:59.196824+0000","last_deep_scrub":"268'859","last_deep_scrub_stamp":"2024-09-12T01:04:59.196824+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.196824+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":800,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:28.550763+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4036,"num_read_kb":3617,"num_write":1169,"num_write_kb":474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'344","reported_seq":987,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.538484+0000","last_change":"2024-09-12T01:04:53.538484+0000","last_active":"2024-09-12T01:04:53.538484+0000","last_peered":"2024-09-12T01:04:53.538484+0000","last_clean":"2024-09-12T01:04:53.538484+0000","last_became_active":"2024-09-12T00:18:22.867744+0000","last_became_peered":"2024-09-12T00:18:22.867744+0000","last_unstale":"2024-09-12T01:04:53.538484+0000","last_undegraded":"2024-09-12T01:04:53.538484+0000","last_fullsized":"2024-09-12T01:04:53.538484+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'344","last_scrub_stamp":"2024-09-12T01:04:53.538289+0000","last_deep_scrub":"268'344","last_deep_scrub_stamp":"2024-09-12T01:04:53.538289+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.538289+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:01.759059+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":517,"num_read_kb":9523,"num_write":1195,"num_write_kb":17845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:11.595876+0000","last_change":"2024-09-12T01:05:11.595876+0000","last_active":"2024-09-12T01:05:11.595876+0000","last_peered":"2024-09-12T01:05:11.595876+0000","last_clean":"2024-09-12T01:05:11.595876+0000","last_became_active":"2024-09-12T00:18:26.857810+0000","last_became_peered":"2024-09-12T00:18:26.857810+0000","last_unstale":"2024-09-12T01:05:11.595876+0000","last_undegraded":"2024-09-12T01:05:11.595876+0000","last_fullsized":"2024-09-12T01:05:11.595876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:11.595702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:11.595702+0000","last_clean_scrub_stamp":"2024-09-12T01:05:11.595702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:02.285161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'260","reported_seq":845,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:11.189156+0000","last_change":"2024-09-12T01:05:11.189156+0000","last_active":"2024-09-12T01:05:11.189156+0000","last_peered":"2024-09-12T01:05:11.189156+0000","last_clean":"2024-09-12T01:05:11.189156+0000","last_became_active":"2024-09-12T00:18:28.881556+0000","last_became_peered":"2024-09-12T00:18:28.881556+0000","last_unstale":"2024-09-12T01:05:11.189156+0000","last_undegraded":"2024-09-12T01:05:11.189156+0000","last_fullsized":"2024-09-12T01:05:11.189156+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'260","last_scrub_stamp":"2024-09-12T01:05:11.188953+0000","last_deep_scrub":"268'260","last_deep_scrub_stamp":"2024-09-12T01:05:11.188953+0000","last_clean_scrub_stamp":"2024-09-12T01:05:11.188953+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:16.718034+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48228,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":430,"num_read_kb":998,"num_write":346,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:07.730304+0000","last_change":"2024-09-12T01:05:07.730304+0000","last_active":"2024-09-12T01:05:07.730304+0000","last_peered":"2024-09-12T01:05:07.730304+0000","last_clean":"2024-09-12T01:05:07.730304+0000","last_became_active":"2024-09-12T00:18:30.898539+0000","last_became_peered":"2024-09-12T00:18:30.898539+0000","last_unstale":"2024-09-12T01:05:07.730304+0000","last_undegraded":"2024-09-12T01:05:07.730304+0000","last_fullsized":"2024-09-12T01:05:07.730304+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:07.730123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:07.730123+0000","last_clean_scrub_stamp":"2024-09-12T01:05:07.730123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:08.477914+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'112","reported_seq":647,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:27.064119+0000","last_change":"2024-09-12T01:05:27.064119+0000","last_active":"2024-09-12T01:05:27.064119+0000","last_peered":"2024-09-12T01:05:27.064119+0000","last_clean":"2024-09-12T01:05:27.064119+0000","last_became_active":"2024-09-12T00:18:32.907530+0000","last_became_peered":"2024-09-12T00:18:32.907530+0000","last_unstale":"2024-09-12T01:05:27.064119+0000","last_undegraded":"2024-09-12T01:05:27.064119+0000","last_fullsized":"2024-09-12T01:05:27.064119+0000","mapping_epoch":34,"log_start":"268'101","ondisk_log_start":"268'101","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'112","last_scrub_stamp":"2024-09-12T01:05:27.063927+0000","last_deep_scrub":"268'112","last_deep_scrub_stamp":"2024-09-12T01:05:27.063927+0000","last_clean_scrub_stamp":"2024-09-12T01:05:27.063927+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":101,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:41.979256+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":167,"num_read_kb":160,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'366","reported_seq":1699,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.075971+0000","last_change":"2024-09-12T01:05:03.075971+0000","last_active":"2024-09-12T01:05:03.075971+0000","last_peered":"2024-09-12T01:05:03.075971+0000","last_clean":"2024-09-12T01:05:03.075971+0000","last_became_active":"2024-09-12T00:18:24.842263+0000","last_became_peered":"2024-09-12T00:18:24.842263+0000","last_unstale":"2024-09-12T01:05:03.075971+0000","last_undegraded":"2024-09-12T01:05:03.075971+0000","last_fullsized":"2024-09-12T01:05:03.075971+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'366","last_scrub_stamp":"2024-09-12T01:05:03.075784+0000","last_deep_scrub":"268'366","last_deep_scrub_stamp":"2024-09-12T01:05:03.075784+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.075784+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:40.465649+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1879,"num_read_kb":1766,"num_write":437,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'436","reported_seq":1218,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.286861+0000","last_change":"2024-09-12T01:04:52.286861+0000","last_active":"2024-09-12T01:04:52.286861+0000","last_peered":"2024-09-12T01:04:52.286861+0000","last_clean":"2024-09-12T01:04:52.286861+0000","last_became_active":"2024-09-12T00:18:22.837412+0000","last_became_peered":"2024-09-12T00:18:22.837412+0000","last_unstale":"2024-09-12T01:04:52.286861+0000","last_undegraded":"2024-09-12T01:04:52.286861+0000","last_fullsized":"2024-09-12T01:04:52.286861+0000","mapping_epoch":24,"log_start":"268'400","ondisk_log_start":"268'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'436","last_scrub_stamp":"2024-09-12T01:04:52.286655+0000","last_deep_scrub":"268'436","last_deep_scrub_stamp":"2024-09-12T01:04:52.286655+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.286655+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:34.352582+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5614631,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":898,"num_read_kb":48874,"num_write":1334,"num_write_kb":53147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:10.170546+0000","last_change":"2024-09-12T01:05:10.170546+0000","last_active":"2024-09-12T01:05:10.170546+0000","last_peered":"2024-09-12T01:05:10.170546+0000","last_clean":"2024-09-12T01:05:10.170546+0000","last_became_active":"2024-09-12T00:18:26.868407+0000","last_became_peered":"2024-09-12T00:18:26.868407+0000","last_unstale":"2024-09-12T01:05:10.170546+0000","last_undegraded":"2024-09-12T01:05:10.170546+0000","last_fullsized":"2024-09-12T01:05:10.170546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:10.170374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:10.170374+0000","last_clean_scrub_stamp":"2024-09-12T01:05:10.170374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:57.128330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'270","reported_seq":850,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:17.084853+0000","last_change":"2024-09-12T01:05:17.084853+0000","last_active":"2024-09-12T01:05:17.084853+0000","last_peered":"2024-09-12T01:05:17.084853+0000","last_clean":"2024-09-12T01:05:17.084853+0000","last_became_active":"2024-09-12T00:18:28.895848+0000","last_became_peered":"2024-09-12T00:18:28.895848+0000","last_unstale":"2024-09-12T01:05:17.084853+0000","last_undegraded":"2024-09-12T01:05:17.084853+0000","last_fullsized":"2024-09-12T01:05:17.084853+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'270","last_scrub_stamp":"2024-09-12T01:05:17.084644+0000","last_deep_scrub":"268'270","last_deep_scrub_stamp":"2024-09-12T01:05:17.084644+0000","last_clean_scrub_stamp":"2024-09-12T01:05:17.084644+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:58.323594+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53006,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":433,"num_read_kb":1065,"num_write":360,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:17.196033+0000","last_change":"2024-09-12T01:05:17.196033+0000","last_active":"2024-09-12T01:05:17.196033+0000","last_peered":"2024-09-12T01:05:17.196033+0000","last_clean":"2024-09-12T01:05:17.196033+0000","last_became_active":"2024-09-12T00:18:30.892682+0000","last_became_peered":"2024-09-12T00:18:30.892682+0000","last_unstale":"2024-09-12T01:05:17.196033+0000","last_undegraded":"2024-09-12T01:05:17.196033+0000","last_fullsized":"2024-09-12T01:05:17.196033+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:17.195793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:17.195793+0000","last_clean_scrub_stamp":"2024-09-12T01:05:17.195793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:29.371582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'213","reported_seq":1708,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.399573+0000","last_change":"2024-09-12T01:05:19.399573+0000","last_active":"2024-09-12T01:05:19.399573+0000","last_peered":"2024-09-12T01:05:19.399573+0000","last_clean":"2024-09-12T01:05:19.399573+0000","last_became_active":"2024-09-12T00:18:32.911082+0000","last_became_peered":"2024-09-12T00:18:32.911082+0000","last_unstale":"2024-09-12T01:05:19.399573+0000","last_undegraded":"2024-09-12T01:05:19.399573+0000","last_fullsized":"2024-09-12T01:05:19.399573+0000","mapping_epoch":34,"log_start":"268'200","ondisk_log_start":"268'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'213","last_scrub_stamp":"2024-09-12T01:05:19.399393+0000","last_deep_scrub":"268'213","last_deep_scrub_stamp":"2024-09-12T01:05:19.399393+0000","last_clean_scrub_stamp":"2024-09-12T01:05:19.399393+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:14.911475+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1287,"num_read_kb":1263,"num_write":482,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'527","reported_seq":2125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.235268+0000","last_change":"2024-09-12T01:04:58.235268+0000","last_active":"2024-09-12T01:04:58.235268+0000","last_peered":"2024-09-12T01:04:58.235268+0000","last_clean":"2024-09-12T01:04:58.235268+0000","last_became_active":"2024-09-12T00:18:24.881029+0000","last_became_peered":"2024-09-12T00:18:24.881029+0000","last_unstale":"2024-09-12T01:04:58.235268+0000","last_undegraded":"2024-09-12T01:04:58.235268+0000","last_fullsized":"2024-09-12T01:04:58.235268+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'527","last_scrub_stamp":"2024-09-12T01:04:58.235070+0000","last_deep_scrub":"268'527","last_deep_scrub_stamp":"2024-09-12T01:04:58.235070+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.235070+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":500,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:33.784017+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2735,"num_read_kb":2532,"num_write":658,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'403","reported_seq":1117,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.251141+0000","last_change":"2024-09-12T01:04:48.251141+0000","last_active":"2024-09-12T01:04:48.251141+0000","last_peered":"2024-09-12T01:04:48.251141+0000","last_clean":"2024-09-12T01:04:48.251141+0000","last_became_active":"2024-09-12T00:18:22.863907+0000","last_became_peered":"2024-09-12T00:18:22.863907+0000","last_unstale":"2024-09-12T01:04:48.251141+0000","last_undegraded":"2024-09-12T01:04:48.251141+0000","last_fullsized":"2024-09-12T01:04:48.251141+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'403","last_scrub_stamp":"2024-09-12T01:04:48.250914+0000","last_deep_scrub":"268'403","last_deep_scrub_stamp":"2024-09-12T01:04:48.250914+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.250914+0000","objects_scrubbed":11,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:07.582611+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1987000,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":643,"num_read_kb":24608,"num_write":1249,"num_write_kb":29666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"268'2","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.574020+0000","last_change":"2024-09-12T01:05:02.574020+0000","last_active":"2024-09-12T01:05:02.574020+0000","last_peered":"2024-09-12T01:05:02.574020+0000","last_clean":"2024-09-12T01:05:02.574020+0000","last_became_active":"2024-09-12T00:18:26.866967+0000","last_became_peered":"2024-09-12T00:18:26.866967+0000","last_unstale":"2024-09-12T01:05:02.574020+0000","last_undegraded":"2024-09-12T01:05:02.574020+0000","last_fullsized":"2024-09-12T01:05:02.574020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:02.573832+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:02.573832+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.573832+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:53.608830+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'315","reported_seq":925,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:15.214103+0000","last_change":"2024-09-12T01:05:15.214103+0000","last_active":"2024-09-12T01:05:15.214103+0000","last_peered":"2024-09-12T01:05:15.214103+0000","last_clean":"2024-09-12T01:05:15.214103+0000","last_became_active":"2024-09-12T00:18:28.897709+0000","last_became_peered":"2024-09-12T00:18:28.897709+0000","last_unstale":"2024-09-12T01:05:15.214103+0000","last_undegraded":"2024-09-12T01:05:15.214103+0000","last_fullsized":"2024-09-12T01:05:15.214103+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'315","last_scrub_stamp":"2024-09-12T01:05:15.213915+0000","last_deep_scrub":"268'315","last_deep_scrub_stamp":"2024-09-12T01:05:15.213915+0000","last_clean_scrub_stamp":"2024-09-12T01:05:15.213915+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:47.575742+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54863,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":525,"num_read_kb":1160,"num_write":422,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:16.123449+0000","last_change":"2024-09-12T01:05:16.123449+0000","last_active":"2024-09-12T01:05:16.123449+0000","last_peered":"2024-09-12T01:05:16.123449+0000","last_clean":"2024-09-12T01:05:16.123449+0000","last_became_active":"2024-09-12T00:18:30.889179+0000","last_became_peered":"2024-09-12T00:18:30.889179+0000","last_unstale":"2024-09-12T01:05:16.123449+0000","last_undegraded":"2024-09-12T01:05:16.123449+0000","last_fullsized":"2024-09-12T01:05:16.123449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:16.123278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:16.123278+0000","last_clean_scrub_stamp":"2024-09-12T01:05:16.123278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:43.328841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'193","reported_seq":766,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.174722+0000","last_change":"2024-09-12T01:05:20.174584+0000","last_active":"2024-09-12T01:05:20.174722+0000","last_peered":"2024-09-12T01:05:20.174722+0000","last_clean":"2024-09-12T01:05:20.174722+0000","last_became_active":"2024-09-12T00:18:32.907658+0000","last_became_peered":"2024-09-12T00:18:32.907658+0000","last_unstale":"2024-09-12T01:05:20.174722+0000","last_undegraded":"2024-09-12T01:05:20.174722+0000","last_fullsized":"2024-09-12T01:05:20.174722+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'193","last_scrub_stamp":"2024-09-12T01:05:20.174417+0000","last_deep_scrub":"268'193","last_deep_scrub_stamp":"2024-09-12T01:05:20.174417+0000","last_clean_scrub_stamp":"2024-09-12T01:05:20.174417+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:27.927387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":435,"num_read_kb":358,"num_write":481,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'411","reported_seq":1919,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.596122+0000","last_change":"2024-09-12T01:05:03.596122+0000","last_active":"2024-09-12T01:05:03.596122+0000","last_peered":"2024-09-12T01:05:03.596122+0000","last_clean":"2024-09-12T01:05:03.596122+0000","last_became_active":"2024-09-12T00:18:24.878522+0000","last_became_peered":"2024-09-12T00:18:24.878522+0000","last_unstale":"2024-09-12T01:05:03.596122+0000","last_undegraded":"2024-09-12T01:05:03.596122+0000","last_fullsized":"2024-09-12T01:05:03.596122+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'411","last_scrub_stamp":"2024-09-12T01:05:03.595908+0000","last_deep_scrub":"268'411","last_deep_scrub_stamp":"2024-09-12T01:05:03.595908+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.595908+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:15.152071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2233,"num_read_kb":2110,"num_write":497,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'384","reported_seq":1059,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.766796+0000","last_change":"2024-09-12T01:04:53.766796+0000","last_active":"2024-09-12T01:04:53.766796+0000","last_peered":"2024-09-12T01:04:53.766796+0000","last_clean":"2024-09-12T01:04:53.766796+0000","last_became_active":"2024-09-12T00:18:22.851554+0000","last_became_peered":"2024-09-12T00:18:22.851554+0000","last_unstale":"2024-09-12T01:04:53.766796+0000","last_undegraded":"2024-09-12T01:04:53.766796+0000","last_fullsized":"2024-09-12T01:04:53.766796+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'384","last_scrub_stamp":"2024-09-12T01:04:53.766598+0000","last_deep_scrub":"268'384","last_deep_scrub_stamp":"2024-09-12T01:04:53.766598+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.766598+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:59.035558+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":573,"num_read_kb":70445,"num_write":1144,"num_write_kb":38293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"268'1219","reported_seq":2840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.588495+0000","last_change":"2024-09-12T01:04:59.588495+0000","last_active":"2024-09-12T01:04:59.588495+0000","last_peered":"2024-09-12T01:04:59.588495+0000","last_clean":"2024-09-12T01:04:59.588495+0000","last_became_active":"2024-09-12T00:18:24.857107+0000","last_became_peered":"2024-09-12T00:18:24.857107+0000","last_unstale":"2024-09-12T01:04:59.588495+0000","last_undegraded":"2024-09-12T01:04:59.588495+0000","last_fullsized":"2024-09-12T01:04:59.588495+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1219","last_scrub_stamp":"2024-09-12T01:04:59.588271+0000","last_deep_scrub":"268'1219","last_deep_scrub_stamp":"2024-09-12T01:04:59.588271+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.588271+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":1200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:26.602528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5568,"num_read_kb":4913,"num_write":1657,"num_write_kb":681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"268'366","reported_seq":1025,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.455879+0000","last_change":"2024-09-12T01:04:47.455879+0000","last_active":"2024-09-12T01:04:47.455879+0000","last_peered":"2024-09-12T01:04:47.455879+0000","last_clean":"2024-09-12T01:04:47.455879+0000","last_became_active":"2024-09-12T00:18:56.193721+0000","last_became_peered":"2024-09-12T00:18:56.193721+0000","last_unstale":"2024-09-12T01:04:47.455879+0000","last_undegraded":"2024-09-12T01:04:47.455879+0000","last_fullsized":"2024-09-12T01:04:47.455879+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'366","last_scrub_stamp":"2024-09-12T01:04:47.455778+0000","last_deep_scrub":"268'366","last_deep_scrub_stamp":"2024-09-12T01:04:47.455778+0000","last_clean_scrub_stamp":"2024-09-12T01:04:47.455778+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:03.972474+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342105,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":474,"num_read_kb":19261,"num_write":1030,"num_write_kb":26595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'861","reported_seq":2466,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.543543+0000","last_change":"2024-09-12T01:05:03.543543+0000","last_active":"2024-09-12T01:05:03.543543+0000","last_peered":"2024-09-12T01:05:03.543543+0000","last_clean":"2024-09-12T01:05:03.543543+0000","last_became_active":"2024-09-12T00:18:24.870288+0000","last_became_peered":"2024-09-12T00:18:24.870288+0000","last_unstale":"2024-09-12T01:05:03.543543+0000","last_undegraded":"2024-09-12T01:05:03.543543+0000","last_fullsized":"2024-09-12T01:05:03.543543+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'861","last_scrub_stamp":"2024-09-12T01:05:03.543359+0000","last_deep_scrub":"268'861","last_deep_scrub_stamp":"2024-09-12T01:05:03.543359+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.543359+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":800,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:05.642071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4146,"num_read_kb":3713,"num_write":1130,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2296,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'416","reported_seq":1061,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.558231+0000","last_change":"2024-09-12T01:04:52.558231+0000","last_active":"2024-09-12T01:04:52.558231+0000","last_peered":"2024-09-12T01:04:52.558231+0000","last_clean":"2024-09-12T01:04:52.558231+0000","last_became_active":"2024-09-12T00:18:22.866341+0000","last_became_peered":"2024-09-12T00:18:22.866341+0000","last_unstale":"2024-09-12T01:04:52.558231+0000","last_undegraded":"2024-09-12T01:04:52.558231+0000","last_fullsized":"2024-09-12T01:04:52.558231+0000","mapping_epoch":24,"log_start":"268'400","ondisk_log_start":"268'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'416","last_scrub_stamp":"2024-09-12T01:04:52.558034+0000","last_deep_scrub":"268'416","last_deep_scrub_stamp":"2024-09-12T01:04:52.558034+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.558034+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:06.937457+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1452502,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":481,"num_read_kb":25322,"num_write":1167,"num_write_kb":64729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'400","reported_seq":1905,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.616499+0000","last_change":"2024-09-12T01:04:57.616499+0000","last_active":"2024-09-12T01:04:57.616499+0000","last_peered":"2024-09-12T01:04:57.616499+0000","last_clean":"2024-09-12T01:04:57.616499+0000","last_became_active":"2024-09-12T00:18:24.865674+0000","last_became_peered":"2024-09-12T00:18:24.865674+0000","last_unstale":"2024-09-12T01:04:57.616499+0000","last_undegraded":"2024-09-12T01:04:57.616499+0000","last_fullsized":"2024-09-12T01:04:57.616499+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'400","last_scrub_stamp":"2024-09-12T01:04:57.616297+0000","last_deep_scrub":"268'400","last_deep_scrub_stamp":"2024-09-12T01:04:57.616297+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.616297+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:18.938055+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2040,"num_read_kb":1953,"num_write":432,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'346","reported_seq":1099,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.241235+0000","last_change":"2024-09-12T01:04:50.241235+0000","last_active":"2024-09-12T01:04:50.241235+0000","last_peered":"2024-09-12T01:04:50.241235+0000","last_clean":"2024-09-12T01:04:50.241235+0000","last_became_active":"2024-09-12T00:18:22.844095+0000","last_became_peered":"2024-09-12T00:18:22.844095+0000","last_unstale":"2024-09-12T01:04:50.241235+0000","last_undegraded":"2024-09-12T01:04:50.241235+0000","last_fullsized":"2024-09-12T01:04:50.241235+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'346","last_scrub_stamp":"2024-09-12T01:04:50.241022+0000","last_deep_scrub":"268'346","last_deep_scrub_stamp":"2024-09-12T01:04:50.241022+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.241022+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:38.319110+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":305939,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":760,"num_read_kb":58308,"num_write":997,"num_write_kb":25022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"268'390","reported_seq":1858,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.133189+0000","last_change":"2024-09-12T01:04:59.133189+0000","last_active":"2024-09-12T01:04:59.133189+0000","last_peered":"2024-09-12T01:04:59.133189+0000","last_clean":"2024-09-12T01:04:59.133189+0000","last_became_active":"2024-09-12T00:18:24.865720+0000","last_became_peered":"2024-09-12T00:18:24.865720+0000","last_unstale":"2024-09-12T01:04:59.133189+0000","last_undegraded":"2024-09-12T01:04:59.133189+0000","last_fullsized":"2024-09-12T01:04:59.133189+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'390","last_scrub_stamp":"2024-09-12T01:04:59.132929+0000","last_deep_scrub":"268'390","last_deep_scrub_stamp":"2024-09-12T01:04:59.132929+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.132929+0000","objects_scrubbed":7,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:05.560879+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2058,"num_read_kb":1953,"num_write":433,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2118,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'381","reported_seq":1064,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.238978+0000","last_change":"2024-09-12T01:04:50.238978+0000","last_active":"2024-09-12T01:04:50.238978+0000","last_peered":"2024-09-12T01:04:50.238978+0000","last_clean":"2024-09-12T01:04:50.238978+0000","last_became_active":"2024-09-12T00:18:22.857896+0000","last_became_peered":"2024-09-12T00:18:22.857896+0000","last_unstale":"2024-09-12T01:04:50.238978+0000","last_undegraded":"2024-09-12T01:04:50.238978+0000","last_fullsized":"2024-09-12T01:04:50.238978+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'381","last_scrub_stamp":"2024-09-12T01:04:50.238615+0000","last_deep_scrub":"268'381","last_deep_scrub_stamp":"2024-09-12T01:04:50.238615+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.238615+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:15.950829+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456478,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":576,"num_read_kb":17790,"num_write":1194,"num_write_kb":44407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'444","reported_seq":2182,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.202943+0000","last_change":"2024-09-12T01:05:01.202943+0000","last_active":"2024-09-12T01:05:01.202943+0000","last_peered":"2024-09-12T01:05:01.202943+0000","last_clean":"2024-09-12T01:05:01.202943+0000","last_became_active":"2024-09-12T00:18:24.866980+0000","last_became_peered":"2024-09-12T00:18:24.866980+0000","last_unstale":"2024-09-12T01:05:01.202943+0000","last_undegraded":"2024-09-12T01:05:01.202943+0000","last_fullsized":"2024-09-12T01:05:01.202943+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'444","last_scrub_stamp":"2024-09-12T01:05:01.202767+0000","last_deep_scrub":"268'444","last_deep_scrub_stamp":"2024-09-12T01:05:01.202767+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.202767+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:44.543465+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2639,"num_read_kb":2518,"num_write":497,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2207,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'322","reported_seq":988,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.507744+0000","last_change":"2024-09-12T01:04:50.507744+0000","last_active":"2024-09-12T01:04:50.507744+0000","last_peered":"2024-09-12T01:04:50.507744+0000","last_clean":"2024-09-12T01:04:50.507744+0000","last_became_active":"2024-09-12T00:18:22.846805+0000","last_became_peered":"2024-09-12T00:18:22.846805+0000","last_unstale":"2024-09-12T01:04:50.507744+0000","last_undegraded":"2024-09-12T01:04:50.507744+0000","last_fullsized":"2024-09-12T01:04:50.507744+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'322","last_scrub_stamp":"2024-09-12T01:04:50.507547+0000","last_deep_scrub":"268'322","last_deep_scrub_stamp":"2024-09-12T01:04:50.507547+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.507547+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:49.831883+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":456,"num_read_kb":82569,"num_write":1071,"num_write_kb":46093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'468","reported_seq":2015,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.989566+0000","last_change":"2024-09-12T01:05:05.989566+0000","last_active":"2024-09-12T01:05:05.989566+0000","last_peered":"2024-09-12T01:05:05.989566+0000","last_clean":"2024-09-12T01:05:05.989566+0000","last_became_active":"2024-09-12T00:18:24.862022+0000","last_became_peered":"2024-09-12T00:18:24.862022+0000","last_unstale":"2024-09-12T01:05:05.989566+0000","last_undegraded":"2024-09-12T01:05:05.989566+0000","last_fullsized":"2024-09-12T01:05:05.989566+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'468","last_scrub_stamp":"2024-09-12T01:05:05.989382+0000","last_deep_scrub":"268'468","last_deep_scrub_stamp":"2024-09-12T01:05:05.989382+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.989382+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:40.188563+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2433,"num_read_kb":2274,"num_write":552,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'349","reported_seq":981,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.673096+0000","last_change":"2024-09-12T01:04:50.673096+0000","last_active":"2024-09-12T01:04:50.673096+0000","last_peered":"2024-09-12T01:04:50.673096+0000","last_clean":"2024-09-12T01:04:50.673096+0000","last_became_active":"2024-09-12T00:18:22.871980+0000","last_became_peered":"2024-09-12T00:18:22.871980+0000","last_unstale":"2024-09-12T01:04:50.673096+0000","last_undegraded":"2024-09-12T01:04:50.673096+0000","last_fullsized":"2024-09-12T01:04:50.673096+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'349","last_scrub_stamp":"2024-09-12T01:04:50.672877+0000","last_deep_scrub":"268'349","last_deep_scrub_stamp":"2024-09-12T01:04:50.672877+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.672877+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:51.786132+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":467,"num_read_kb":12975,"num_write":1116,"num_write_kb":44636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'441","reported_seq":2039,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.710518+0000","last_change":"2024-09-12T01:04:58.710518+0000","last_active":"2024-09-12T01:04:58.710518+0000","last_peered":"2024-09-12T01:04:58.710518+0000","last_clean":"2024-09-12T01:04:58.710518+0000","last_became_active":"2024-09-12T00:18:24.857010+0000","last_became_peered":"2024-09-12T00:18:24.857010+0000","last_unstale":"2024-09-12T01:04:58.710518+0000","last_undegraded":"2024-09-12T01:04:58.710518+0000","last_fullsized":"2024-09-12T01:04:58.710518+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'441","last_scrub_stamp":"2024-09-12T01:04:58.710296+0000","last_deep_scrub":"268'441","last_deep_scrub_stamp":"2024-09-12T01:04:58.710296+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.710296+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:49.317345+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2477,"num_read_kb":2332,"num_write":519,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1335,"num_omap_keys":6,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'383","reported_seq":1019,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.244074+0000","last_change":"2024-09-12T01:04:53.244074+0000","last_active":"2024-09-12T01:04:53.244074+0000","last_peered":"2024-09-12T01:04:53.244074+0000","last_clean":"2024-09-12T01:04:53.244074+0000","last_became_active":"2024-09-12T00:18:22.857468+0000","last_became_peered":"2024-09-12T00:18:22.857468+0000","last_unstale":"2024-09-12T01:04:53.244074+0000","last_undegraded":"2024-09-12T01:04:53.244074+0000","last_fullsized":"2024-09-12T01:04:53.244074+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'383","last_scrub_stamp":"2024-09-12T01:04:53.243865+0000","last_deep_scrub":"268'383","last_deep_scrub_stamp":"2024-09-12T01:04:53.243865+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.243865+0000","objects_scrubbed":11,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:00.400260+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375108,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":489,"num_read_kb":4433,"num_write":1123,"num_write_kb":23710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"268'835","reported_seq":2454,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.301201+0000","last_change":"2024-09-12T01:04:59.301066+0000","last_active":"2024-09-12T01:04:59.301201+0000","last_peered":"2024-09-12T01:04:59.301201+0000","last_clean":"2024-09-12T01:04:59.301201+0000","last_became_active":"2024-09-12T00:18:24.857438+0000","last_became_peered":"2024-09-12T00:18:24.857438+0000","last_unstale":"2024-09-12T01:04:59.301201+0000","last_undegraded":"2024-09-12T01:04:59.301201+0000","last_fullsized":"2024-09-12T01:04:59.301201+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'835","last_scrub_stamp":"2024-09-12T01:04:59.300882+0000","last_deep_scrub":"268'835","last_deep_scrub_stamp":"2024-09-12T01:04:59.300882+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.300882+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:06.256923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3858,"num_read_kb":3490,"num_write":1078,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'394","reported_seq":1017,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.550846+0000","last_change":"2024-09-12T01:04:54.550846+0000","last_active":"2024-09-12T01:04:54.550846+0000","last_peered":"2024-09-12T01:04:54.550846+0000","last_clean":"2024-09-12T01:04:54.550846+0000","last_became_active":"2024-09-12T00:18:22.858851+0000","last_became_peered":"2024-09-12T00:18:22.858851+0000","last_unstale":"2024-09-12T01:04:54.550846+0000","last_undegraded":"2024-09-12T01:04:54.550846+0000","last_fullsized":"2024-09-12T01:04:54.550846+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'394","last_scrub_stamp":"2024-09-12T01:04:54.550600+0000","last_deep_scrub":"268'394","last_deep_scrub_stamp":"2024-09-12T01:04:54.550600+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.550600+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:21.777404+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1250253,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":485,"num_read_kb":6084,"num_write":1107,"num_write_kb":43198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'1190","reported_seq":2708,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.212545+0000","last_change":"2024-09-12T01:05:03.212330+0000","last_active":"2024-09-12T01:05:03.212545+0000","last_peered":"2024-09-12T01:05:03.212545+0000","last_clean":"2024-09-12T01:05:03.212545+0000","last_became_active":"2024-09-12T00:18:24.856121+0000","last_became_peered":"2024-09-12T00:18:24.856121+0000","last_unstale":"2024-09-12T01:05:03.212545+0000","last_undegraded":"2024-09-12T01:05:03.212545+0000","last_fullsized":"2024-09-12T01:05:03.212545+0000","mapping_epoch":26,"log_start":"268'1100","ondisk_log_start":"268'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1190","last_scrub_stamp":"2024-09-12T01:05:03.212083+0000","last_deep_scrub":"268'1190","last_deep_scrub_stamp":"2024-09-12T01:05:03.212083+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.212083+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":1100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:31.434280+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5211,"num_read_kb":4574,"num_write":1611,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'359","reported_seq":1115,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.207399+0000","last_change":"2024-09-12T01:04:55.207192+0000","last_active":"2024-09-12T01:04:55.207399+0000","last_peered":"2024-09-12T01:04:55.207399+0000","last_clean":"2024-09-12T01:04:55.207399+0000","last_became_active":"2024-09-12T00:18:22.857806+0000","last_became_peered":"2024-09-12T00:18:22.857806+0000","last_unstale":"2024-09-12T01:04:55.207399+0000","last_undegraded":"2024-09-12T01:04:55.207399+0000","last_fullsized":"2024-09-12T01:04:55.207399+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'359","last_scrub_stamp":"2024-09-12T01:04:55.206986+0000","last_deep_scrub":"268'359","last_deep_scrub_stamp":"2024-09-12T01:04:55.206986+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.206986+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:18.410646+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":676,"num_read_kb":44063,"num_write":1212,"num_write_kb":47646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"268'827","reported_seq":2381,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.485273+0000","last_change":"2024-09-12T01:04:53.485146+0000","last_active":"2024-09-12T01:04:53.485273+0000","last_peered":"2024-09-12T01:04:53.485273+0000","last_clean":"2024-09-12T01:04:53.485273+0000","last_became_active":"2024-09-12T00:18:24.856616+0000","last_became_peered":"2024-09-12T00:18:24.856616+0000","last_unstale":"2024-09-12T01:04:53.485273+0000","last_undegraded":"2024-09-12T01:04:53.485273+0000","last_fullsized":"2024-09-12T01:04:53.485273+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'827","last_scrub_stamp":"2024-09-12T01:04:53.484958+0000","last_deep_scrub":"268'827","last_deep_scrub_stamp":"2024-09-12T01:04:53.484958+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.484958+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:30.113138+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3862,"num_read_kb":3471,"num_write":1076,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'393","reported_seq":1173,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.519765+0000","last_change":"2024-09-12T01:04:56.519626+0000","last_active":"2024-09-12T01:04:56.519765+0000","last_peered":"2024-09-12T01:04:56.519765+0000","last_clean":"2024-09-12T01:04:56.519765+0000","last_became_active":"2024-09-12T00:18:22.873756+0000","last_became_peered":"2024-09-12T00:18:22.873756+0000","last_unstale":"2024-09-12T01:04:56.519765+0000","last_undegraded":"2024-09-12T01:04:56.519765+0000","last_fullsized":"2024-09-12T01:04:56.519765+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'393","last_scrub_stamp":"2024-09-12T01:04:56.519399+0000","last_deep_scrub":"268'393","last_deep_scrub_stamp":"2024-09-12T01:04:56.519399+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.519399+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:26.788844+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263200,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":909,"num_read_kb":25128,"num_write":1275,"num_write_kb":39639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'1581","reported_seq":3281,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.237336+0000","last_change":"2024-09-12T01:05:02.237198+0000","last_active":"2024-09-12T01:05:02.237336+0000","last_peered":"2024-09-12T01:05:02.237336+0000","last_clean":"2024-09-12T01:05:02.237336+0000","last_became_active":"2024-09-12T00:18:24.882937+0000","last_became_peered":"2024-09-12T00:18:24.882937+0000","last_unstale":"2024-09-12T01:05:02.237336+0000","last_undegraded":"2024-09-12T01:05:02.237336+0000","last_fullsized":"2024-09-12T01:05:02.237336+0000","mapping_epoch":26,"log_start":"268'1500","ondisk_log_start":"268'1500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1581","last_scrub_stamp":"2024-09-12T01:05:02.237002+0000","last_deep_scrub":"268'1581","last_deep_scrub_stamp":"2024-09-12T01:05:02.237002+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.237002+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":1500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:39.333011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7111,"num_read_kb":6230,"num_write":2206,"num_write_kb":938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'438","reported_seq":1177,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.201113+0000","last_change":"2024-09-12T01:04:51.200968+0000","last_active":"2024-09-12T01:04:51.201113+0000","last_peered":"2024-09-12T01:04:51.201113+0000","last_clean":"2024-09-12T01:04:51.201113+0000","last_became_active":"2024-09-12T00:18:22.869527+0000","last_became_peered":"2024-09-12T00:18:22.869527+0000","last_unstale":"2024-09-12T01:04:51.201113+0000","last_undegraded":"2024-09-12T01:04:51.201113+0000","last_fullsized":"2024-09-12T01:04:51.201113+0000","mapping_epoch":24,"log_start":"268'400","ondisk_log_start":"268'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'438","last_scrub_stamp":"2024-09-12T01:04:51.200755+0000","last_deep_scrub":"268'438","last_deep_scrub_stamp":"2024-09-12T01:04:51.200755+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.200755+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:55.971651+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262232,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":772,"num_read_kb":72891,"num_write":1443,"num_write_kb":29040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'772","reported_seq":2187,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.491608+0000","last_change":"2024-09-12T01:05:00.491449+0000","last_active":"2024-09-12T01:05:00.491608+0000","last_peered":"2024-09-12T01:05:00.491608+0000","last_clean":"2024-09-12T01:05:00.491608+0000","last_became_active":"2024-09-12T00:18:24.866062+0000","last_became_peered":"2024-09-12T00:18:24.866062+0000","last_unstale":"2024-09-12T01:05:00.491608+0000","last_undegraded":"2024-09-12T01:05:00.491608+0000","last_fullsized":"2024-09-12T01:05:00.491608+0000","mapping_epoch":26,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'772","last_scrub_stamp":"2024-09-12T01:05:00.491269+0000","last_deep_scrub":"268'772","last_deep_scrub_stamp":"2024-09-12T01:05:00.491269+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.491269+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:14.226037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3587,"num_read_kb":3210,"num_write":1032,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'376","reported_seq":1066,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.767631+0000","last_change":"2024-09-12T01:04:55.767471+0000","last_active":"2024-09-12T01:04:55.767631+0000","last_peered":"2024-09-12T01:04:55.767631+0000","last_clean":"2024-09-12T01:04:55.767631+0000","last_became_active":"2024-09-12T00:18:22.858141+0000","last_became_peered":"2024-09-12T00:18:22.858141+0000","last_unstale":"2024-09-12T01:04:55.767631+0000","last_undegraded":"2024-09-12T01:04:55.767631+0000","last_fullsized":"2024-09-12T01:04:55.767631+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'376","last_scrub_stamp":"2024-09-12T01:04:55.767266+0000","last_deep_scrub":"268'376","last_deep_scrub_stamp":"2024-09-12T01:04:55.767266+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.767266+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:24.248670+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":648,"num_read_kb":25195,"num_write":1350,"num_write_kb":34646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'1220","reported_seq":3130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.336062+0000","last_change":"2024-09-12T01:05:00.335747+0000","last_active":"2024-09-12T01:05:00.336062+0000","last_peered":"2024-09-12T01:05:00.336062+0000","last_clean":"2024-09-12T01:05:00.336062+0000","last_became_active":"2024-09-12T00:18:24.859973+0000","last_became_peered":"2024-09-12T00:18:24.859973+0000","last_unstale":"2024-09-12T01:05:00.336062+0000","last_undegraded":"2024-09-12T01:05:00.336062+0000","last_fullsized":"2024-09-12T01:05:00.336062+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1220","last_scrub_stamp":"2024-09-12T01:05:00.335499+0000","last_deep_scrub":"268'1220","last_deep_scrub_stamp":"2024-09-12T01:05:00.335499+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.335499+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":1200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:36.786041+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5984,"num_read_kb":5306,"num_write":1779,"num_write_kb":823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'360","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.565625+0000","last_change":"2024-09-12T01:04:53.565625+0000","last_active":"2024-09-12T01:04:53.565625+0000","last_peered":"2024-09-12T01:04:53.565625+0000","last_clean":"2024-09-12T01:04:53.565625+0000","last_became_active":"2024-09-12T00:18:55.951826+0000","last_became_peered":"2024-09-12T00:18:55.951826+0000","last_unstale":"2024-09-12T01:04:53.565625+0000","last_undegraded":"2024-09-12T01:04:53.565625+0000","last_fullsized":"2024-09-12T01:04:53.565625+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'360","last_scrub_stamp":"2024-09-12T01:04:53.565426+0000","last_deep_scrub":"268'360","last_deep_scrub_stamp":"2024-09-12T01:04:53.565426+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.565426+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:24.959465+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":11605,"num_write":1081,"num_write_kb":32221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"268'542","reported_seq":2019,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:07.016290+0000","last_change":"2024-09-12T01:05:07.016136+0000","last_active":"2024-09-12T01:05:07.016290+0000","last_peered":"2024-09-12T01:05:07.016290+0000","last_clean":"2024-09-12T01:05:07.016290+0000","last_became_active":"2024-09-12T00:18:24.849540+0000","last_became_peered":"2024-09-12T00:18:24.849540+0000","last_unstale":"2024-09-12T01:05:07.016290+0000","last_undegraded":"2024-09-12T01:05:07.016290+0000","last_fullsized":"2024-09-12T01:05:07.016290+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'542","last_scrub_stamp":"2024-09-12T01:05:07.015941+0000","last_deep_scrub":"268'542","last_deep_scrub_stamp":"2024-09-12T01:05:07.015941+0000","last_clean_scrub_stamp":"2024-09-12T01:05:07.015941+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:39.395014+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2717,"num_read_kb":2465,"num_write":714,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":489,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'362","reported_seq":1065,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.471347+0000","last_change":"2024-09-12T01:04:49.471154+0000","last_active":"2024-09-12T01:04:49.471347+0000","last_peered":"2024-09-12T01:04:49.471347+0000","last_clean":"2024-09-12T01:04:49.471347+0000","last_became_active":"2024-09-12T00:18:22.834527+0000","last_became_peered":"2024-09-12T00:18:22.834527+0000","last_unstale":"2024-09-12T01:04:49.471347+0000","last_undegraded":"2024-09-12T01:04:49.471347+0000","last_fullsized":"2024-09-12T01:04:49.471347+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'362","last_scrub_stamp":"2024-09-12T01:04:49.470959+0000","last_deep_scrub":"268'362","last_deep_scrub_stamp":"2024-09-12T01:04:49.470959+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.470959+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:03.324964+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":663,"num_read_kb":13548,"num_write":1359,"num_write_kb":27172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'352","reported_seq":1714,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.449859+0000","last_change":"2024-09-12T01:05:01.449859+0000","last_active":"2024-09-12T01:05:01.449859+0000","last_peered":"2024-09-12T01:05:01.449859+0000","last_clean":"2024-09-12T01:05:01.449859+0000","last_became_active":"2024-09-12T00:18:24.870016+0000","last_became_peered":"2024-09-12T00:18:24.870016+0000","last_unstale":"2024-09-12T01:05:01.449859+0000","last_undegraded":"2024-09-12T01:05:01.449859+0000","last_fullsized":"2024-09-12T01:05:01.449859+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'352","last_scrub_stamp":"2024-09-12T01:05:01.449680+0000","last_deep_scrub":"268'352","last_deep_scrub_stamp":"2024-09-12T01:05:01.449680+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.449680+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:14.081003+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1783,"num_read_kb":1704,"num_write":384,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'333","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.528182+0000","last_change":"2024-09-12T01:04:55.528002+0000","last_active":"2024-09-12T01:04:55.528182+0000","last_peered":"2024-09-12T01:04:55.528182+0000","last_clean":"2024-09-12T01:04:55.528182+0000","last_became_active":"2024-09-12T00:18:22.883246+0000","last_became_peered":"2024-09-12T00:18:22.883246+0000","last_unstale":"2024-09-12T01:04:55.528182+0000","last_undegraded":"2024-09-12T01:04:55.528182+0000","last_fullsized":"2024-09-12T01:04:55.528182+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'333","last_scrub_stamp":"2024-09-12T01:04:55.527813+0000","last_deep_scrub":"268'333","last_deep_scrub_stamp":"2024-09-12T01:04:55.527813+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.527813+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:47.812183+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2790244,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":500,"num_read_kb":42045,"num_write":1101,"num_write_kb":34022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'382","reported_seq":1058,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.522637+0000","last_change":"2024-09-12T01:04:57.522370+0000","last_active":"2024-09-12T01:04:57.522637+0000","last_peered":"2024-09-12T01:04:57.522637+0000","last_clean":"2024-09-12T01:04:57.522637+0000","last_became_active":"2024-09-12T00:18:22.857072+0000","last_became_peered":"2024-09-12T00:18:22.857072+0000","last_unstale":"2024-09-12T01:04:57.522637+0000","last_undegraded":"2024-09-12T01:04:57.522637+0000","last_fullsized":"2024-09-12T01:04:57.522637+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'382","last_scrub_stamp":"2024-09-12T01:04:57.522162+0000","last_deep_scrub":"268'382","last_deep_scrub_stamp":"2024-09-12T01:04:57.522162+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.522162+0000","objects_scrubbed":10,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:55.368704+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525411,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":546,"num_read_kb":42645,"num_write":1246,"num_write_kb":40559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'478","reported_seq":2186,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.337968+0000","last_change":"2024-09-12T01:05:01.337968+0000","last_active":"2024-09-12T01:05:01.337968+0000","last_peered":"2024-09-12T01:05:01.337968+0000","last_clean":"2024-09-12T01:05:01.337968+0000","last_became_active":"2024-09-12T00:18:24.866883+0000","last_became_peered":"2024-09-12T00:18:24.866883+0000","last_unstale":"2024-09-12T01:05:01.337968+0000","last_undegraded":"2024-09-12T01:05:01.337968+0000","last_fullsized":"2024-09-12T01:05:01.337968+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'478","last_scrub_stamp":"2024-09-12T01:05:01.337648+0000","last_deep_scrub":"268'478","last_deep_scrub_stamp":"2024-09-12T01:05:01.337648+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.337648+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:51.544486+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2661,"num_read_kb":2525,"num_write":544,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'456","reported_seq":1192,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.550977+0000","last_change":"2024-09-12T01:04:51.550695+0000","last_active":"2024-09-12T01:04:51.550977+0000","last_peered":"2024-09-12T01:04:51.550977+0000","last_clean":"2024-09-12T01:04:51.550977+0000","last_became_active":"2024-09-12T00:18:22.858176+0000","last_became_peered":"2024-09-12T00:18:22.858176+0000","last_unstale":"2024-09-12T01:04:51.550977+0000","last_undegraded":"2024-09-12T01:04:51.550977+0000","last_fullsized":"2024-09-12T01:04:51.550977+0000","mapping_epoch":24,"log_start":"268'400","ondisk_log_start":"268'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'456","last_scrub_stamp":"2024-09-12T01:04:51.550461+0000","last_deep_scrub":"268'456","last_deep_scrub_stamp":"2024-09-12T01:04:51.550461+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.550461+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:00.070041+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493507,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":841,"num_read_kb":63084,"num_write":1253,"num_write_kb":30414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'808","reported_seq":2413,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.507308+0000","last_change":"2024-09-12T01:05:04.507308+0000","last_active":"2024-09-12T01:05:04.507308+0000","last_peered":"2024-09-12T01:05:04.507308+0000","last_clean":"2024-09-12T01:05:04.507308+0000","last_became_active":"2024-09-12T00:18:24.855524+0000","last_became_peered":"2024-09-12T00:18:24.855524+0000","last_unstale":"2024-09-12T01:05:04.507308+0000","last_undegraded":"2024-09-12T01:05:04.507308+0000","last_fullsized":"2024-09-12T01:05:04.507308+0000","mapping_epoch":26,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'808","last_scrub_stamp":"2024-09-12T01:05:04.507124+0000","last_deep_scrub":"268'808","last_deep_scrub_stamp":"2024-09-12T01:05:04.507124+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.507124+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:08.739902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3793,"num_read_kb":3425,"num_write":1052,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6125,"num_read_kb":4422,"num_write":1992,"num_write_kb":889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5969,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":965,"ondisk_log_size":965,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15018,"num_read_kb":14677,"num_write":16721,"num_write_kb":4879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1741,"ondisk_log_size":1741,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1590876,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":17701,"num_read_kb":37057,"num_write":14791,"num_write_kb":11631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":675540,"num_omap_keys":1570,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1929,"ondisk_log_size":1929,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212220,"num_read_kb":193790,"num_write":55147,"num_write_kb":18721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43028,"num_omap_keys":175,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3939,"ondisk_log_size":3939,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":940,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":67372279,"num_objects":368,"num_object_clones":0,"num_object_copies":736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":368,"num_whiteouts":0,"num_read":36285,"num_read_kb":1921539,"num_write":72266,"num_write_kb":2133559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":135979008,"data_stored":134744558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3853,"ondisk_log_size":3853,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":193499,"num_write":190,"num_write_kb":135054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":193436,"num_write":190,"num_write_kb":135054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510019,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":288164,"kb_used_data":14036,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94083676,"statfs":{"total":96636764160,"available":96341684224,"internally_reserved":0,"allocated":14372864,"data_stored":12670188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510018,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249776,"kb_used_data":20064,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94122064,"statfs":{"total":96636764160,"available":96380993536,"internally_reserved":0,"allocated":20545536,"data_stored":18946545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":235207113},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510018,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":157332,"kb_used_data":27652,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94214508,"statfs":{"total":96636764160,"available":96475656192,"internally_reserved":0,"allocated":28315648,"data_stored":26521673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510019,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111496,"kb_used_data":26168,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94260344,"statfs":{"total":96636764160,"available":96522592256,"internally_reserved":0,"allocated":26796032,"data_stored":25204103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542723,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":288260,"kb_used_data":28020,"kb_used_omap":1,"kb_used_meta":260222,"kb_avail":94083580,"statfs":{"total":96636764160,"available":96341585920,"internally_reserved":0,"allocated":28692480,"data_stored":26984275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":266467783},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542721,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":97864,"kb_used_data":12600,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94273976,"statfs":{"total":96636764160,"available":96536551424,"internally_reserved":0,"allocated":12902400,"data_stored":11301467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542722,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148312,"kb_used_data":8904,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94223528,"statfs":{"total":96636764160,"available":96484892672,"internally_reserved":0,"allocated":9117696,"data_stored":7484684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542723,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255332,"kb_used_data":25620,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94116508,"statfs":{"total":96636764160,"available":96375304192,"internally_reserved":0,"allocated":26234880,"data_stored":24489485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21905408,"data_stored":21688322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5402624,"data_stored":5276127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9211904,"data_stored":9091208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24948736,"data_stored":24773620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":23130112,"data_stored":22997083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24514560,"data_stored":24310448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16838656,"data_stored":16736762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10027008,"data_stored":9870988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":5044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":5163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:05:49.664 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:49.664 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:49.664 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:49.665 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T00:46:08.458202+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:05:49.669 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:06:09.671 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:06:10.031 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-12T01:06:10.043 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-12T01:06:10.050 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":1704,"stamp":"2024-09-12T01:06:08.093057+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":69570780,"num_objects":858,"num_object_clones":0,"num_object_copies":1716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":858,"num_whiteouts":0,"num_read":290173,"num_read_kb":2561350,"num_write":161440,"num_write_kb":2441443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":728357,"num_omap_keys":1786,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13299,"ondisk_log_size":13299,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1596536,"kb_used_data":163064,"kb_used_omap":12,"kb_used_meta":1433331,"kb_avail":753378184,"statfs":{"total":773094113280,"available":771459260416,"internally_reserved":0,"allocated":166977536,"data_stored":153602420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1467731507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007580"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:34.479967+0000","last_change":"2024-09-12T01:05:34.479967+0000","last_active":"2024-09-12T01:05:34.479967+0000","last_peered":"2024-09-12T01:05:34.479967+0000","last_clean":"2024-09-12T01:05:34.479967+0000","last_became_active":"2024-09-12T00:46:09.506992+0000","last_became_peered":"2024-09-12T00:46:09.506992+0000","last_unstale":"2024-09-12T01:05:34.479967+0000","last_undegraded":"2024-09-12T01:05:34.479967+0000","last_fullsized":"2024-09-12T01:05:34.479967+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:34.479760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:34.479760+0000","last_clean_scrub_stamp":"2024-09-12T01:05:34.479760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:52.009439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"265'8","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:31.434832+0000","last_change":"2024-09-12T01:05:31.434832+0000","last_active":"2024-09-12T01:05:31.434832+0000","last_peered":"2024-09-12T01:05:31.434832+0000","last_clean":"2024-09-12T01:05:31.434832+0000","last_became_active":"2024-09-12T00:34:55.236531+0000","last_became_peered":"2024-09-12T00:34:55.236531+0000","last_unstale":"2024-09-12T01:05:31.434832+0000","last_undegraded":"2024-09-12T01:05:31.434832+0000","last_fullsized":"2024-09-12T01:05:31.434832+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T01:05:31.434639+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T01:05:31.434639+0000","last_clean_scrub_stamp":"2024-09-12T01:05:31.434639+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:10.341415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"268'4","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:34.056760+0000","last_change":"2024-09-12T01:05:34.056760+0000","last_active":"2024-09-12T01:05:34.056760+0000","last_peered":"2024-09-12T01:05:34.056760+0000","last_clean":"2024-09-12T01:05:34.056760+0000","last_became_active":"2024-09-12T00:34:52.171918+0000","last_became_peered":"2024-09-12T00:34:52.171918+0000","last_unstale":"2024-09-12T01:05:34.056760+0000","last_undegraded":"2024-09-12T01:05:34.056760+0000","last_fullsized":"2024-09-12T01:05:34.056760+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:05:34.056579+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:05:34.056579+0000","last_clean_scrub_stamp":"2024-09-12T01:05:34.056579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:48.083105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4100,"num_write":4,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'30","reported_seq":138,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:30.020115+0000","last_change":"2024-09-12T01:05:30.020115+0000","last_active":"2024-09-12T01:05:30.020115+0000","last_peered":"2024-09-12T01:05:30.020115+0000","last_clean":"2024-09-12T01:05:30.020115+0000","last_became_active":"2024-09-12T00:33:10.848975+0000","last_became_peered":"2024-09-12T00:33:10.848975+0000","last_unstale":"2024-09-12T01:05:30.020115+0000","last_undegraded":"2024-09-12T01:05:30.020115+0000","last_fullsized":"2024-09-12T01:05:30.020115+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'30","last_scrub_stamp":"2024-09-12T01:05:30.019918+0000","last_deep_scrub":"268'30","last_deep_scrub_stamp":"2024-09-12T01:05:30.019918+0000","last_clean_scrub_stamp":"2024-09-12T01:05:30.019918+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:05.712091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":60,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:16.465361+0000","last_change":"2024-09-12T01:05:16.465361+0000","last_active":"2024-09-12T01:05:16.465361+0000","last_peered":"2024-09-12T01:05:16.465361+0000","last_clean":"2024-09-12T01:05:16.465361+0000","last_became_active":"2024-09-12T00:46:09.509800+0000","last_became_peered":"2024-09-12T00:46:09.509800+0000","last_unstale":"2024-09-12T01:05:16.465361+0000","last_undegraded":"2024-09-12T01:05:16.465361+0000","last_fullsized":"2024-09-12T01:05:16.465361+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:16.465170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:16.465170+0000","last_clean_scrub_stamp":"2024-09-12T01:05:16.465170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:15.986937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'7","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:35.187623+0000","last_change":"2024-09-12T01:05:35.187623+0000","last_active":"2024-09-12T01:05:35.187623+0000","last_peered":"2024-09-12T01:05:35.187623+0000","last_clean":"2024-09-12T01:05:35.187623+0000","last_became_active":"2024-09-12T00:34:55.232607+0000","last_became_peered":"2024-09-12T00:34:55.232607+0000","last_unstale":"2024-09-12T01:05:35.187623+0000","last_undegraded":"2024-09-12T01:05:35.187623+0000","last_fullsized":"2024-09-12T01:05:35.187623+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-12T01:05:35.187444+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-12T01:05:35.187444+0000","last_clean_scrub_stamp":"2024-09-12T01:05:35.187444+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:08.369969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"268'2","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.536885+0000","last_change":"2024-09-12T01:05:20.536885+0000","last_active":"2024-09-12T01:05:20.536885+0000","last_peered":"2024-09-12T01:05:20.536885+0000","last_clean":"2024-09-12T01:05:20.536885+0000","last_became_active":"2024-09-12T00:34:52.210935+0000","last_became_peered":"2024-09-12T00:34:52.210935+0000","last_unstale":"2024-09-12T01:05:20.536885+0000","last_undegraded":"2024-09-12T01:05:20.536885+0000","last_fullsized":"2024-09-12T01:05:20.536885+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:20.536676+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:20.536676+0000","last_clean_scrub_stamp":"2024-09-12T01:05:20.536676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:56.161540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'30","reported_seq":139,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:08.468289+0000","last_change":"2024-09-12T01:05:08.468010+0000","last_active":"2024-09-12T01:05:08.468289+0000","last_peered":"2024-09-12T01:05:08.468289+0000","last_clean":"2024-09-12T01:05:08.468289+0000","last_became_active":"2024-09-12T00:33:10.851334+0000","last_became_peered":"2024-09-12T00:33:10.851334+0000","last_unstale":"2024-09-12T01:05:08.468289+0000","last_undegraded":"2024-09-12T01:05:08.468289+0000","last_fullsized":"2024-09-12T01:05:08.468289+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'30","last_scrub_stamp":"2024-09-12T01:05:08.467746+0000","last_deep_scrub":"268'30","last_deep_scrub_stamp":"2024-09-12T01:05:08.467746+0000","last_clean_scrub_stamp":"2024-09-12T01:05:08.467746+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:53.379179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":108,"num_write":55,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:24.887158+0000","last_change":"2024-09-12T01:05:24.886923+0000","last_active":"2024-09-12T01:05:24.887158+0000","last_peered":"2024-09-12T01:05:24.887158+0000","last_clean":"2024-09-12T01:05:24.887158+0000","last_became_active":"2024-09-12T00:46:09.507324+0000","last_became_peered":"2024-09-12T00:46:09.507324+0000","last_unstale":"2024-09-12T01:05:24.887158+0000","last_undegraded":"2024-09-12T01:05:24.887158+0000","last_fullsized":"2024-09-12T01:05:24.887158+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:24.886644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:24.886644+0000","last_clean_scrub_stamp":"2024-09-12T01:05:24.886644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:27.230356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"268'2","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:36.078946+0000","last_change":"2024-09-12T01:05:36.078946+0000","last_active":"2024-09-12T01:05:36.078946+0000","last_peered":"2024-09-12T01:05:36.078946+0000","last_clean":"2024-09-12T01:05:36.078946+0000","last_became_active":"2024-09-12T00:34:55.252880+0000","last_became_peered":"2024-09-12T00:34:55.252880+0000","last_unstale":"2024-09-12T01:05:36.078946+0000","last_undegraded":"2024-09-12T01:05:36.078946+0000","last_fullsized":"2024-09-12T01:05:36.078946+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:36.078772+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:36.078772+0000","last_clean_scrub_stamp":"2024-09-12T01:05:36.078772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:46.949241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"268'2","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.410136+0000","last_change":"2024-09-12T01:05:13.410136+0000","last_active":"2024-09-12T01:05:13.410136+0000","last_peered":"2024-09-12T01:05:13.410136+0000","last_clean":"2024-09-12T01:05:13.410136+0000","last_became_active":"2024-09-12T00:34:52.195513+0000","last_became_peered":"2024-09-12T00:34:52.195513+0000","last_unstale":"2024-09-12T01:05:13.410136+0000","last_undegraded":"2024-09-12T01:05:13.410136+0000","last_fullsized":"2024-09-12T01:05:13.410136+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:13.409950+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:13.409950+0000","last_clean_scrub_stamp":"2024-09-12T01:05:13.409950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:56.054807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'20","reported_seq":108,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:40.991879+0000","last_change":"2024-09-12T01:05:40.991624+0000","last_active":"2024-09-12T01:05:40.991879+0000","last_peered":"2024-09-12T01:05:40.991879+0000","last_clean":"2024-09-12T01:05:40.991879+0000","last_became_active":"2024-09-12T00:33:10.847432+0000","last_became_peered":"2024-09-12T00:33:10.847432+0000","last_unstale":"2024-09-12T01:05:40.991879+0000","last_undegraded":"2024-09-12T01:05:40.991879+0000","last_fullsized":"2024-09-12T01:05:40.991879+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'20","last_scrub_stamp":"2024-09-12T01:05:40.991339+0000","last_deep_scrub":"268'20","last_deep_scrub_stamp":"2024-09-12T01:05:40.991339+0000","last_clean_scrub_stamp":"2024-09-12T01:05:40.991339+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:51.254375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":67,"num_write":46,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:49.899319+0000","last_change":"2024-09-12T01:05:49.899319+0000","last_active":"2024-09-12T01:05:49.899319+0000","last_peered":"2024-09-12T01:05:49.899319+0000","last_clean":"2024-09-12T01:05:49.899319+0000","last_became_active":"2024-09-12T00:46:09.496807+0000","last_became_peered":"2024-09-12T00:46:09.496807+0000","last_unstale":"2024-09-12T01:05:49.899319+0000","last_undegraded":"2024-09-12T01:05:49.899319+0000","last_fullsized":"2024-09-12T01:05:49.899319+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:49.899130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:49.899130+0000","last_clean_scrub_stamp":"2024-09-12T01:05:49.899130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:00.551139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:45.019195+0000","last_change":"2024-09-12T01:05:45.019195+0000","last_active":"2024-09-12T01:05:45.019195+0000","last_peered":"2024-09-12T01:05:45.019195+0000","last_clean":"2024-09-12T01:05:45.019195+0000","last_became_active":"2024-09-12T00:34:55.248058+0000","last_became_peered":"2024-09-12T00:34:55.248058+0000","last_unstale":"2024-09-12T01:05:45.019195+0000","last_undegraded":"2024-09-12T01:05:45.019195+0000","last_fullsized":"2024-09-12T01:05:45.019195+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:45.019013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:45.019013+0000","last_clean_scrub_stamp":"2024-09-12T01:05:45.019013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:57.709160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"268'8","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:33.227802+0000","last_change":"2024-09-12T01:05:33.227640+0000","last_active":"2024-09-12T01:05:33.227802+0000","last_peered":"2024-09-12T01:05:33.227802+0000","last_clean":"2024-09-12T01:05:33.227802+0000","last_became_active":"2024-09-12T00:34:52.170013+0000","last_became_peered":"2024-09-12T00:34:52.170013+0000","last_unstale":"2024-09-12T01:05:33.227802+0000","last_undegraded":"2024-09-12T01:05:33.227802+0000","last_fullsized":"2024-09-12T01:05:33.227802+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-12T01:05:33.227458+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-12T01:05:33.227458+0000","last_clean_scrub_stamp":"2024-09-12T01:05:33.227458+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:57.287267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10242,"num_write":8,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'17","reported_seq":97,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:33.037835+0000","last_change":"2024-09-12T01:05:33.037699+0000","last_active":"2024-09-12T01:05:33.037835+0000","last_peered":"2024-09-12T01:05:33.037835+0000","last_clean":"2024-09-12T01:05:33.037835+0000","last_became_active":"2024-09-12T00:33:10.839248+0000","last_became_peered":"2024-09-12T00:33:10.839248+0000","last_unstale":"2024-09-12T01:05:33.037835+0000","last_undegraded":"2024-09-12T01:05:33.037835+0000","last_fullsized":"2024-09-12T01:05:33.037835+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'17","last_scrub_stamp":"2024-09-12T01:05:33.037511+0000","last_deep_scrub":"268'17","last_deep_scrub_stamp":"2024-09-12T01:05:33.037511+0000","last_clean_scrub_stamp":"2024-09-12T01:05:33.037511+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:25.147656+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":49,"num_write":38,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:48.906523+0000","last_change":"2024-09-12T01:05:48.906523+0000","last_active":"2024-09-12T01:05:48.906523+0000","last_peered":"2024-09-12T01:05:48.906523+0000","last_clean":"2024-09-12T01:05:48.906523+0000","last_became_active":"2024-09-12T00:46:09.499830+0000","last_became_peered":"2024-09-12T00:46:09.499830+0000","last_unstale":"2024-09-12T01:05:48.906523+0000","last_undegraded":"2024-09-12T01:05:48.906523+0000","last_fullsized":"2024-09-12T01:05:48.906523+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:48.906335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:48.906335+0000","last_clean_scrub_stamp":"2024-09-12T01:05:48.906335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:46.656971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"268'4","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:30.431406+0000","last_change":"2024-09-12T01:05:30.431406+0000","last_active":"2024-09-12T01:05:30.431406+0000","last_peered":"2024-09-12T01:05:30.431406+0000","last_clean":"2024-09-12T01:05:30.431406+0000","last_became_active":"2024-09-12T00:34:55.242012+0000","last_became_peered":"2024-09-12T00:34:55.242012+0000","last_unstale":"2024-09-12T01:05:30.431406+0000","last_undegraded":"2024-09-12T01:05:30.431406+0000","last_fullsized":"2024-09-12T01:05:30.431406+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:05:30.431227+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:05:30.431227+0000","last_clean_scrub_stamp":"2024-09-12T01:05:30.431227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:17.235355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'7","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:32.050224+0000","last_change":"2024-09-12T01:05:32.050224+0000","last_active":"2024-09-12T01:05:32.050224+0000","last_peered":"2024-09-12T01:05:32.050224+0000","last_clean":"2024-09-12T01:05:32.050224+0000","last_became_active":"2024-09-12T00:34:52.205385+0000","last_became_peered":"2024-09-12T00:34:52.205385+0000","last_unstale":"2024-09-12T01:05:32.050224+0000","last_undegraded":"2024-09-12T01:05:32.050224+0000","last_fullsized":"2024-09-12T01:05:32.050224+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-12T01:05:32.049936+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-12T01:05:32.049936+0000","last_clean_scrub_stamp":"2024-09-12T01:05:32.049936+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:14.183635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4098,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'48","reported_seq":181,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:32.074225+0000","last_change":"2024-09-12T01:05:32.073951+0000","last_active":"2024-09-12T01:05:32.074225+0000","last_peered":"2024-09-12T01:05:32.074225+0000","last_clean":"2024-09-12T01:05:32.074225+0000","last_became_active":"2024-09-12T00:33:10.842427+0000","last_became_peered":"2024-09-12T00:33:10.842427+0000","last_unstale":"2024-09-12T01:05:32.074225+0000","last_undegraded":"2024-09-12T01:05:32.074225+0000","last_fullsized":"2024-09-12T01:05:32.074225+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'48","last_scrub_stamp":"2024-09-12T01:05:32.073740+0000","last_deep_scrub":"268'48","last_deep_scrub_stamp":"2024-09-12T01:05:32.073740+0000","last_clean_scrub_stamp":"2024-09-12T01:05:32.073740+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:22.272041+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":162,"num_write":92,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:27.472053+0000","last_change":"2024-09-12T01:05:27.472053+0000","last_active":"2024-09-12T01:05:27.472053+0000","last_peered":"2024-09-12T01:05:27.472053+0000","last_clean":"2024-09-12T01:05:27.472053+0000","last_became_active":"2024-09-12T00:46:09.513617+0000","last_became_peered":"2024-09-12T00:46:09.513617+0000","last_unstale":"2024-09-12T01:05:27.472053+0000","last_undegraded":"2024-09-12T01:05:27.472053+0000","last_fullsized":"2024-09-12T01:05:27.472053+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:27.471880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:27.471880+0000","last_clean_scrub_stamp":"2024-09-12T01:05:27.471880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:06.890956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"265'7","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:21.851883+0000","last_change":"2024-09-12T01:05:21.851883+0000","last_active":"2024-09-12T01:05:21.851883+0000","last_peered":"2024-09-12T01:05:21.851883+0000","last_clean":"2024-09-12T01:05:21.851883+0000","last_became_active":"2024-09-12T00:35:57.345894+0000","last_became_peered":"2024-09-12T00:35:57.345894+0000","last_unstale":"2024-09-12T01:05:21.851883+0000","last_undegraded":"2024-09-12T01:05:21.851883+0000","last_fullsized":"2024-09-12T01:05:21.851883+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T01:05:21.851685+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T01:05:21.851685+0000","last_clean_scrub_stamp":"2024-09-12T01:05:21.851685+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:25.738345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"265'2","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.167923+0000","last_change":"2024-09-12T01:05:29.167923+0000","last_active":"2024-09-12T01:05:29.167923+0000","last_peered":"2024-09-12T01:05:29.167923+0000","last_clean":"2024-09-12T01:05:29.167923+0000","last_became_active":"2024-09-12T00:34:52.188352+0000","last_became_peered":"2024-09-12T00:34:52.188352+0000","last_unstale":"2024-09-12T01:05:29.167923+0000","last_undegraded":"2024-09-12T01:05:29.167923+0000","last_fullsized":"2024-09-12T01:05:29.167923+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:05:29.167728+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:05:29.167728+0000","last_clean_scrub_stamp":"2024-09-12T01:05:29.167728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:44.370901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'29","reported_seq":134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:15.790723+0000","last_change":"2024-09-12T01:05:15.790576+0000","last_active":"2024-09-12T01:05:15.790723+0000","last_peered":"2024-09-12T01:05:15.790723+0000","last_clean":"2024-09-12T01:05:15.790723+0000","last_became_active":"2024-09-12T00:33:10.845301+0000","last_became_peered":"2024-09-12T00:33:10.845301+0000","last_unstale":"2024-09-12T01:05:15.790723+0000","last_undegraded":"2024-09-12T01:05:15.790723+0000","last_fullsized":"2024-09-12T01:05:15.790723+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'29","last_scrub_stamp":"2024-09-12T01:05:15.790376+0000","last_deep_scrub":"268'29","last_deep_scrub_stamp":"2024-09-12T01:05:15.790376+0000","last_clean_scrub_stamp":"2024-09-12T01:05:15.790376+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:15.531192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'2","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:43.497951+0000","last_change":"2024-09-12T01:05:43.497951+0000","last_active":"2024-09-12T01:05:43.497951+0000","last_peered":"2024-09-12T01:05:43.497951+0000","last_clean":"2024-09-12T01:05:43.497951+0000","last_became_active":"2024-09-12T00:46:09.498002+0000","last_became_peered":"2024-09-12T00:46:09.498002+0000","last_unstale":"2024-09-12T01:05:43.497951+0000","last_undegraded":"2024-09-12T01:05:43.497951+0000","last_fullsized":"2024-09-12T01:05:43.497951+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:43.497762+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:43.497762+0000","last_clean_scrub_stamp":"2024-09-12T01:05:43.497762+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:22.550990+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:22.873969+0000","last_change":"2024-09-12T01:05:22.873969+0000","last_active":"2024-09-12T01:05:22.873969+0000","last_peered":"2024-09-12T01:05:22.873969+0000","last_clean":"2024-09-12T01:05:22.873969+0000","last_became_active":"2024-09-12T00:34:55.215076+0000","last_became_peered":"2024-09-12T00:34:55.215076+0000","last_unstale":"2024-09-12T01:05:22.873969+0000","last_undegraded":"2024-09-12T01:05:22.873969+0000","last_fullsized":"2024-09-12T01:05:22.873969+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:22.873768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:22.873768+0000","last_clean_scrub_stamp":"2024-09-12T01:05:22.873768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:09.281488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"265'2","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:28.213743+0000","last_change":"2024-09-12T01:05:28.213743+0000","last_active":"2024-09-12T01:05:28.213743+0000","last_peered":"2024-09-12T01:05:28.213743+0000","last_clean":"2024-09-12T01:05:28.213743+0000","last_became_active":"2024-09-12T00:34:52.198548+0000","last_became_peered":"2024-09-12T00:34:52.198548+0000","last_unstale":"2024-09-12T01:05:28.213743+0000","last_undegraded":"2024-09-12T01:05:28.213743+0000","last_fullsized":"2024-09-12T01:05:28.213743+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:05:28.213515+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:05:28.213515+0000","last_clean_scrub_stamp":"2024-09-12T01:05:28.213515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:27.761724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'18","reported_seq":102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:26.037683+0000","last_change":"2024-09-12T01:05:26.037683+0000","last_active":"2024-09-12T01:05:26.037683+0000","last_peered":"2024-09-12T01:05:26.037683+0000","last_clean":"2024-09-12T01:05:26.037683+0000","last_became_active":"2024-09-12T00:33:10.856664+0000","last_became_peered":"2024-09-12T00:33:10.856664+0000","last_unstale":"2024-09-12T01:05:26.037683+0000","last_undegraded":"2024-09-12T01:05:26.037683+0000","last_fullsized":"2024-09-12T01:05:26.037683+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'18","last_scrub_stamp":"2024-09-12T01:05:26.037503+0000","last_deep_scrub":"268'18","last_deep_scrub_stamp":"2024-09-12T01:05:26.037503+0000","last_clean_scrub_stamp":"2024-09-12T01:05:26.037503+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:13.232142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":59,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:42.445833+0000","last_change":"2024-09-12T01:05:42.445833+0000","last_active":"2024-09-12T01:05:42.445833+0000","last_peered":"2024-09-12T01:05:42.445833+0000","last_clean":"2024-09-12T01:05:42.445833+0000","last_became_active":"2024-09-12T00:46:09.503361+0000","last_became_peered":"2024-09-12T00:46:09.503361+0000","last_unstale":"2024-09-12T01:05:42.445833+0000","last_undegraded":"2024-09-12T01:05:42.445833+0000","last_fullsized":"2024-09-12T01:05:42.445833+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:42.445637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:42.445637+0000","last_clean_scrub_stamp":"2024-09-12T01:05:42.445637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:34.408576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:43.043155+0000","last_change":"2024-09-12T01:05:43.043155+0000","last_active":"2024-09-12T01:05:43.043155+0000","last_peered":"2024-09-12T01:05:43.043155+0000","last_clean":"2024-09-12T01:05:43.043155+0000","last_became_active":"2024-09-12T00:34:55.217009+0000","last_became_peered":"2024-09-12T00:34:55.217009+0000","last_unstale":"2024-09-12T01:05:43.043155+0000","last_undegraded":"2024-09-12T01:05:43.043155+0000","last_fullsized":"2024-09-12T01:05:43.043155+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:43.042970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:43.042970+0000","last_clean_scrub_stamp":"2024-09-12T01:05:43.042970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:06.239414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"268'2","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:34.035625+0000","last_change":"2024-09-12T01:05:34.035625+0000","last_active":"2024-09-12T01:05:34.035625+0000","last_peered":"2024-09-12T01:05:34.035625+0000","last_clean":"2024-09-12T01:05:34.035625+0000","last_became_active":"2024-09-12T00:34:52.202432+0000","last_became_peered":"2024-09-12T00:34:52.202432+0000","last_unstale":"2024-09-12T01:05:34.035625+0000","last_undegraded":"2024-09-12T01:05:34.035625+0000","last_fullsized":"2024-09-12T01:05:34.035625+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:34.035427+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:34.035427+0000","last_clean_scrub_stamp":"2024-09-12T01:05:34.035427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:15.177766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"268'46","reported_seq":182,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:15.436101+0000","last_change":"2024-09-12T01:05:15.436101+0000","last_active":"2024-09-12T01:05:15.436101+0000","last_peered":"2024-09-12T01:05:15.436101+0000","last_clean":"2024-09-12T01:05:15.436101+0000","last_became_active":"2024-09-12T00:33:10.846370+0000","last_became_peered":"2024-09-12T00:33:10.846370+0000","last_unstale":"2024-09-12T01:05:15.436101+0000","last_undegraded":"2024-09-12T01:05:15.436101+0000","last_fullsized":"2024-09-12T01:05:15.436101+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'46","last_scrub_stamp":"2024-09-12T01:05:15.435917+0000","last_deep_scrub":"268'46","last_deep_scrub_stamp":"2024-09-12T01:05:15.435917+0000","last_clean_scrub_stamp":"2024-09-12T01:05:15.435917+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:19.663406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":168,"num_write":82,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:28.504954+0000","last_change":"2024-09-12T01:05:28.504954+0000","last_active":"2024-09-12T01:05:28.504954+0000","last_peered":"2024-09-12T01:05:28.504954+0000","last_clean":"2024-09-12T01:05:28.504954+0000","last_became_active":"2024-09-12T00:46:09.494139+0000","last_became_peered":"2024-09-12T00:46:09.494139+0000","last_unstale":"2024-09-12T01:05:28.504954+0000","last_undegraded":"2024-09-12T01:05:28.504954+0000","last_fullsized":"2024-09-12T01:05:28.504954+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:28.504733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:28.504733+0000","last_clean_scrub_stamp":"2024-09-12T01:05:28.504733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:14.984939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:42.000570+0000","last_change":"2024-09-12T01:05:42.000570+0000","last_active":"2024-09-12T01:05:42.000570+0000","last_peered":"2024-09-12T01:05:42.000570+0000","last_clean":"2024-09-12T01:05:42.000570+0000","last_became_active":"2024-09-12T00:34:55.253209+0000","last_became_peered":"2024-09-12T00:34:55.253209+0000","last_unstale":"2024-09-12T01:05:42.000570+0000","last_undegraded":"2024-09-12T01:05:42.000570+0000","last_fullsized":"2024-09-12T01:05:42.000570+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:42.000381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:42.000381+0000","last_clean_scrub_stamp":"2024-09-12T01:05:42.000381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:35.990230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'2","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:28.419350+0000","last_change":"2024-09-12T01:05:28.419350+0000","last_active":"2024-09-12T01:05:28.419350+0000","last_peered":"2024-09-12T01:05:28.419350+0000","last_clean":"2024-09-12T01:05:28.419350+0000","last_became_active":"2024-09-12T00:34:52.180036+0000","last_became_peered":"2024-09-12T00:34:52.180036+0000","last_unstale":"2024-09-12T01:05:28.419350+0000","last_undegraded":"2024-09-12T01:05:28.419350+0000","last_fullsized":"2024-09-12T01:05:28.419350+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:28.419145+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:28.419145+0000","last_clean_scrub_stamp":"2024-09-12T01:05:28.419145+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:46.678390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'75","reported_seq":271,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:27.010551+0000","last_change":"2024-09-12T01:05:27.010551+0000","last_active":"2024-09-12T01:05:27.010551+0000","last_peered":"2024-09-12T01:05:27.010551+0000","last_clean":"2024-09-12T01:05:27.010551+0000","last_became_active":"2024-09-12T00:33:10.851672+0000","last_became_peered":"2024-09-12T00:33:10.851672+0000","last_unstale":"2024-09-12T01:05:27.010551+0000","last_undegraded":"2024-09-12T01:05:27.010551+0000","last_fullsized":"2024-09-12T01:05:27.010551+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'75","last_scrub_stamp":"2024-09-12T01:05:27.010369+0000","last_deep_scrub":"268'75","last_deep_scrub_stamp":"2024-09-12T01:05:27.010369+0000","last_clean_scrub_stamp":"2024-09-12T01:05:27.010369+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:27.277619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":415,"num_read_kb":311,"num_write":116,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'2","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:15.446767+0000","last_change":"2024-09-12T01:05:15.446767+0000","last_active":"2024-09-12T01:05:15.446767+0000","last_peered":"2024-09-12T01:05:15.446767+0000","last_clean":"2024-09-12T01:05:15.446767+0000","last_became_active":"2024-09-12T00:46:09.513012+0000","last_became_peered":"2024-09-12T00:46:09.513012+0000","last_unstale":"2024-09-12T01:05:15.446767+0000","last_undegraded":"2024-09-12T01:05:15.446767+0000","last_fullsized":"2024-09-12T01:05:15.446767+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:15.446573+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:15.446573+0000","last_clean_scrub_stamp":"2024-09-12T01:05:15.446573+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:39.377744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"268'8","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:40.989384+0000","last_change":"2024-09-12T01:05:40.989384+0000","last_active":"2024-09-12T01:05:40.989384+0000","last_peered":"2024-09-12T01:05:40.989384+0000","last_clean":"2024-09-12T01:05:40.989384+0000","last_became_active":"2024-09-12T00:34:55.252580+0000","last_became_peered":"2024-09-12T00:34:55.252580+0000","last_unstale":"2024-09-12T01:05:40.989384+0000","last_undegraded":"2024-09-12T01:05:40.989384+0000","last_fullsized":"2024-09-12T01:05:40.989384+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-12T01:05:40.989007+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-12T01:05:40.989007+0000","last_clean_scrub_stamp":"2024-09-12T01:05:40.989007+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:45.822703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":14336,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:31.417233+0000","last_change":"2024-09-12T01:05:31.417233+0000","last_active":"2024-09-12T01:05:31.417233+0000","last_peered":"2024-09-12T01:05:31.417233+0000","last_clean":"2024-09-12T01:05:31.417233+0000","last_became_active":"2024-09-12T00:34:52.204021+0000","last_became_peered":"2024-09-12T00:34:52.204021+0000","last_unstale":"2024-09-12T01:05:31.417233+0000","last_undegraded":"2024-09-12T01:05:31.417233+0000","last_fullsized":"2024-09-12T01:05:31.417233+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:31.417025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:31.417025+0000","last_clean_scrub_stamp":"2024-09-12T01:05:31.417025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:06.735736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'35","reported_seq":153,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:35.091069+0000","last_change":"2024-09-12T01:05:35.091069+0000","last_active":"2024-09-12T01:05:35.091069+0000","last_peered":"2024-09-12T01:05:35.091069+0000","last_clean":"2024-09-12T01:05:35.091069+0000","last_became_active":"2024-09-12T00:33:10.849228+0000","last_became_peered":"2024-09-12T00:33:10.849228+0000","last_unstale":"2024-09-12T01:05:35.091069+0000","last_undegraded":"2024-09-12T01:05:35.091069+0000","last_fullsized":"2024-09-12T01:05:35.091069+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'35","last_scrub_stamp":"2024-09-12T01:05:35.090885+0000","last_deep_scrub":"268'35","last_deep_scrub_stamp":"2024-09-12T01:05:35.090885+0000","last_clean_scrub_stamp":"2024-09-12T01:05:35.090885+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:49.821614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":134,"num_write":61,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:40.492032+0000","last_change":"2024-09-12T01:05:40.492032+0000","last_active":"2024-09-12T01:05:40.492032+0000","last_peered":"2024-09-12T01:05:40.492032+0000","last_clean":"2024-09-12T01:05:40.492032+0000","last_became_active":"2024-09-12T00:46:09.499137+0000","last_became_peered":"2024-09-12T00:46:09.499137+0000","last_unstale":"2024-09-12T01:05:40.492032+0000","last_undegraded":"2024-09-12T01:05:40.492032+0000","last_fullsized":"2024-09-12T01:05:40.492032+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:40.491830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:40.491830+0000","last_clean_scrub_stamp":"2024-09-12T01:05:40.491830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:59.276277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"268'5","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:44.051242+0000","last_change":"2024-09-12T01:05:44.051242+0000","last_active":"2024-09-12T01:05:44.051242+0000","last_peered":"2024-09-12T01:05:44.051242+0000","last_clean":"2024-09-12T01:05:44.051242+0000","last_became_active":"2024-09-12T00:34:55.254250+0000","last_became_peered":"2024-09-12T00:34:55.254250+0000","last_unstale":"2024-09-12T01:05:44.051242+0000","last_undegraded":"2024-09-12T01:05:44.051242+0000","last_fullsized":"2024-09-12T01:05:44.051242+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-12T01:05:44.051054+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-12T01:05:44.051054+0000","last_clean_scrub_stamp":"2024-09-12T01:05:44.051054+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:04.029709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":318,"num_write":10,"num_write_kb":4414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:10.441334+0000","last_change":"2024-09-12T01:05:10.441334+0000","last_active":"2024-09-12T01:05:10.441334+0000","last_peered":"2024-09-12T01:05:10.441334+0000","last_clean":"2024-09-12T01:05:10.441334+0000","last_became_active":"2024-09-12T00:34:52.173822+0000","last_became_peered":"2024-09-12T00:34:52.173822+0000","last_unstale":"2024-09-12T01:05:10.441334+0000","last_undegraded":"2024-09-12T01:05:10.441334+0000","last_fullsized":"2024-09-12T01:05:10.441334+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:10.441147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:10.441147+0000","last_clean_scrub_stamp":"2024-09-12T01:05:10.441147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:46.274029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'34","reported_seq":149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:06.452032+0000","last_change":"2024-09-12T01:05:06.452032+0000","last_active":"2024-09-12T01:05:06.452032+0000","last_peered":"2024-09-12T01:05:06.452032+0000","last_clean":"2024-09-12T01:05:06.452032+0000","last_became_active":"2024-09-12T00:33:10.841363+0000","last_became_peered":"2024-09-12T00:33:10.841363+0000","last_unstale":"2024-09-12T01:05:06.452032+0000","last_undegraded":"2024-09-12T01:05:06.452032+0000","last_fullsized":"2024-09-12T01:05:06.452032+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'34","last_scrub_stamp":"2024-09-12T01:05:06.451823+0000","last_deep_scrub":"268'34","last_deep_scrub_stamp":"2024-09-12T01:05:06.451823+0000","last_clean_scrub_stamp":"2024-09-12T01:05:06.451823+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:26.258682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":128,"num_write":55,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:33.465804+0000","last_change":"2024-09-12T01:05:33.465804+0000","last_active":"2024-09-12T01:05:33.465804+0000","last_peered":"2024-09-12T01:05:33.465804+0000","last_clean":"2024-09-12T01:05:33.465804+0000","last_became_active":"2024-09-12T00:46:09.502684+0000","last_became_peered":"2024-09-12T00:46:09.502684+0000","last_unstale":"2024-09-12T01:05:33.465804+0000","last_undegraded":"2024-09-12T01:05:33.465804+0000","last_fullsized":"2024-09-12T01:05:33.465804+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:33.465597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:33.465597+0000","last_clean_scrub_stamp":"2024-09-12T01:05:33.465597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:32.901131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"268'8","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:36.177708+0000","last_change":"2024-09-12T01:05:36.177708+0000","last_active":"2024-09-12T01:05:36.177708+0000","last_peered":"2024-09-12T01:05:36.177708+0000","last_clean":"2024-09-12T01:05:36.177708+0000","last_became_active":"2024-09-12T00:34:55.226388+0000","last_became_peered":"2024-09-12T00:34:55.226388+0000","last_unstale":"2024-09-12T01:05:36.177708+0000","last_undegraded":"2024-09-12T01:05:36.177708+0000","last_fullsized":"2024-09-12T01:05:36.177708+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-12T01:05:36.177522+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-12T01:05:36.177522+0000","last_clean_scrub_stamp":"2024-09-12T01:05:36.177522+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:33.966724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":16384,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"268'11","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:33.062758+0000","last_change":"2024-09-12T01:05:33.062758+0000","last_active":"2024-09-12T01:05:33.062758+0000","last_peered":"2024-09-12T01:05:33.062758+0000","last_clean":"2024-09-12T01:05:33.062758+0000","last_became_active":"2024-09-12T00:34:52.196770+0000","last_became_peered":"2024-09-12T00:34:52.196770+0000","last_unstale":"2024-09-12T01:05:33.062758+0000","last_undegraded":"2024-09-12T01:05:33.062758+0000","last_fullsized":"2024-09-12T01:05:33.062758+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'11","last_scrub_stamp":"2024-09-12T01:05:33.062577+0000","last_deep_scrub":"268'11","last_deep_scrub_stamp":"2024-09-12T01:05:33.062577+0000","last_clean_scrub_stamp":"2024-09-12T01:05:33.062577+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:35.967177+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":25602,"num_write":16,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'4","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.397236+0000","last_change":"2024-09-12T01:05:25.397069+0000","last_active":"2024-09-12T01:05:25.397236+0000","last_peered":"2024-09-12T01:05:25.397236+0000","last_clean":"2024-09-12T01:05:25.397236+0000","last_became_active":"2024-09-12T00:33:10.858178+0000","last_became_peered":"2024-09-12T00:33:10.858178+0000","last_unstale":"2024-09-12T01:05:25.397236+0000","last_undegraded":"2024-09-12T01:05:25.397236+0000","last_fullsized":"2024-09-12T01:05:25.397236+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:05:25.396886+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:05:25.396886+0000","last_clean_scrub_stamp":"2024-09-12T01:05:25.396886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:56.723053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:47.935092+0000","last_change":"2024-09-12T01:05:47.935092+0000","last_active":"2024-09-12T01:05:47.935092+0000","last_peered":"2024-09-12T01:05:47.935092+0000","last_clean":"2024-09-12T01:05:47.935092+0000","last_became_active":"2024-09-12T00:46:09.521706+0000","last_became_peered":"2024-09-12T00:46:09.521706+0000","last_unstale":"2024-09-12T01:05:47.935092+0000","last_undegraded":"2024-09-12T01:05:47.935092+0000","last_fullsized":"2024-09-12T01:05:47.935092+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:47.934909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:47.934909+0000","last_clean_scrub_stamp":"2024-09-12T01:05:47.934909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:27.637464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"268'4","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:24.561794+0000","last_change":"2024-09-12T01:05:24.561794+0000","last_active":"2024-09-12T01:05:24.561794+0000","last_peered":"2024-09-12T01:05:24.561794+0000","last_clean":"2024-09-12T01:05:24.561794+0000","last_became_active":"2024-09-12T00:34:55.223787+0000","last_became_peered":"2024-09-12T00:34:55.223787+0000","last_unstale":"2024-09-12T01:05:24.561794+0000","last_undegraded":"2024-09-12T01:05:24.561794+0000","last_fullsized":"2024-09-12T01:05:24.561794+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:05:24.561614+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:05:24.561614+0000","last_clean_scrub_stamp":"2024-09-12T01:05:24.561614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:31.053640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"268'6","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:27.256425+0000","last_change":"2024-09-12T01:05:27.256425+0000","last_active":"2024-09-12T01:05:27.256425+0000","last_peered":"2024-09-12T01:05:27.256425+0000","last_clean":"2024-09-12T01:05:27.256425+0000","last_became_active":"2024-09-12T00:34:52.183982+0000","last_became_peered":"2024-09-12T00:34:52.183982+0000","last_unstale":"2024-09-12T01:05:27.256425+0000","last_undegraded":"2024-09-12T01:05:27.256425+0000","last_fullsized":"2024-09-12T01:05:27.256425+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T01:05:27.256194+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T01:05:27.256194+0000","last_clean_scrub_stamp":"2024-09-12T01:05:27.256194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:57.757429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5649,"num_write":6,"num_write_kb":5649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'25","reported_seq":124,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:24.391074+0000","last_change":"2024-09-12T01:05:24.390888+0000","last_active":"2024-09-12T01:05:24.391074+0000","last_peered":"2024-09-12T01:05:24.391074+0000","last_clean":"2024-09-12T01:05:24.391074+0000","last_became_active":"2024-09-12T00:33:10.858212+0000","last_became_peered":"2024-09-12T00:33:10.858212+0000","last_unstale":"2024-09-12T01:05:24.391074+0000","last_undegraded":"2024-09-12T01:05:24.391074+0000","last_fullsized":"2024-09-12T01:05:24.391074+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'25","last_scrub_stamp":"2024-09-12T01:05:24.390620+0000","last_deep_scrub":"268'25","last_deep_scrub_stamp":"2024-09-12T01:05:24.390620+0000","last_clean_scrub_stamp":"2024-09-12T01:05:24.390620+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:50.472958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":92,"num_write":42,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:40.012078+0000","last_change":"2024-09-12T01:05:40.012078+0000","last_active":"2024-09-12T01:05:40.012078+0000","last_peered":"2024-09-12T01:05:40.012078+0000","last_clean":"2024-09-12T01:05:40.012078+0000","last_became_active":"2024-09-12T00:46:09.517833+0000","last_became_peered":"2024-09-12T00:46:09.517833+0000","last_unstale":"2024-09-12T01:05:40.012078+0000","last_undegraded":"2024-09-12T01:05:40.012078+0000","last_fullsized":"2024-09-12T01:05:40.012078+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:40.011898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:40.011898+0000","last_clean_scrub_stamp":"2024-09-12T01:05:40.011898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:00.987487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'9","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.519111+0000","last_change":"2024-09-12T01:05:25.519111+0000","last_active":"2024-09-12T01:05:25.519111+0000","last_peered":"2024-09-12T01:05:25.519111+0000","last_clean":"2024-09-12T01:05:25.519111+0000","last_became_active":"2024-09-12T00:34:55.226334+0000","last_became_peered":"2024-09-12T00:34:55.226334+0000","last_unstale":"2024-09-12T01:05:25.519111+0000","last_undegraded":"2024-09-12T01:05:25.519111+0000","last_fullsized":"2024-09-12T01:05:25.519111+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-12T01:05:25.518883+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-12T01:05:25.518883+0000","last_clean_scrub_stamp":"2024-09-12T01:05:25.518883+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:34.088936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20484,"num_write":14,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'6","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:37.036142+0000","last_change":"2024-09-12T01:05:37.036142+0000","last_active":"2024-09-12T01:05:37.036142+0000","last_peered":"2024-09-12T01:05:37.036142+0000","last_clean":"2024-09-12T01:05:37.036142+0000","last_became_active":"2024-09-12T00:34:52.174421+0000","last_became_peered":"2024-09-12T00:34:52.174421+0000","last_unstale":"2024-09-12T01:05:37.036142+0000","last_undegraded":"2024-09-12T01:05:37.036142+0000","last_fullsized":"2024-09-12T01:05:37.036142+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T01:05:37.035955+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T01:05:37.035955+0000","last_clean_scrub_stamp":"2024-09-12T01:05:37.035955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:53.006466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5438,"num_write":6,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"268'52","reported_seq":196,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.056426+0000","last_change":"2024-09-12T01:05:29.056264+0000","last_active":"2024-09-12T01:05:29.056426+0000","last_peered":"2024-09-12T01:05:29.056426+0000","last_clean":"2024-09-12T01:05:29.056426+0000","last_became_active":"2024-09-12T00:33:10.848890+0000","last_became_peered":"2024-09-12T00:33:10.848890+0000","last_unstale":"2024-09-12T01:05:29.056426+0000","last_undegraded":"2024-09-12T01:05:29.056426+0000","last_fullsized":"2024-09-12T01:05:29.056426+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'52","last_scrub_stamp":"2024-09-12T01:05:29.056070+0000","last_deep_scrub":"268'52","last_deep_scrub_stamp":"2024-09-12T01:05:29.056070+0000","last_clean_scrub_stamp":"2024-09-12T01:05:29.056070+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:02.187193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":180,"num_write":98,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"268'2","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:41.970844+0000","last_change":"2024-09-12T01:05:41.970844+0000","last_active":"2024-09-12T01:05:41.970844+0000","last_peered":"2024-09-12T01:05:41.970844+0000","last_clean":"2024-09-12T01:05:41.970844+0000","last_became_active":"2024-09-12T00:46:09.521575+0000","last_became_peered":"2024-09-12T00:46:09.521575+0000","last_unstale":"2024-09-12T01:05:41.970844+0000","last_undegraded":"2024-09-12T01:05:41.970844+0000","last_fullsized":"2024-09-12T01:05:41.970844+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:41.970651+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:41.970651+0000","last_clean_scrub_stamp":"2024-09-12T01:05:41.970651+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:08.128140+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"268'7","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:39.950757+0000","last_change":"2024-09-12T01:05:39.950757+0000","last_active":"2024-09-12T01:05:39.950757+0000","last_peered":"2024-09-12T01:05:39.950757+0000","last_clean":"2024-09-12T01:05:39.950757+0000","last_became_active":"2024-09-12T00:34:55.232215+0000","last_became_peered":"2024-09-12T00:34:55.232215+0000","last_unstale":"2024-09-12T01:05:39.950757+0000","last_undegraded":"2024-09-12T01:05:39.950757+0000","last_fullsized":"2024-09-12T01:05:39.950757+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-12T01:05:39.950567+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-12T01:05:39.950567+0000","last_clean_scrub_stamp":"2024-09-12T01:05:39.950567+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:19.154371+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8310,"num_write":12,"num_write_kb":8251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"268'4","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:16.824227+0000","last_change":"2024-09-12T01:05:16.824227+0000","last_active":"2024-09-12T01:05:16.824227+0000","last_peered":"2024-09-12T01:05:16.824227+0000","last_clean":"2024-09-12T01:05:16.824227+0000","last_became_active":"2024-09-12T00:34:52.199793+0000","last_became_peered":"2024-09-12T00:34:52.199793+0000","last_unstale":"2024-09-12T01:05:16.824227+0000","last_undegraded":"2024-09-12T01:05:16.824227+0000","last_fullsized":"2024-09-12T01:05:16.824227+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:05:16.824038+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:05:16.824038+0000","last_clean_scrub_stamp":"2024-09-12T01:05:16.824038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:55.744048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'20","reported_seq":112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.166169+0000","last_change":"2024-09-12T01:05:25.166037+0000","last_active":"2024-09-12T01:05:25.166169+0000","last_peered":"2024-09-12T01:05:25.166169+0000","last_clean":"2024-09-12T01:05:25.166169+0000","last_became_active":"2024-09-12T00:33:10.844957+0000","last_became_peered":"2024-09-12T00:33:10.844957+0000","last_unstale":"2024-09-12T01:05:25.166169+0000","last_undegraded":"2024-09-12T01:05:25.166169+0000","last_fullsized":"2024-09-12T01:05:25.166169+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'20","last_scrub_stamp":"2024-09-12T01:05:25.165837+0000","last_deep_scrub":"268'20","last_deep_scrub_stamp":"2024-09-12T01:05:25.165837+0000","last_clean_scrub_stamp":"2024-09-12T01:05:25.165837+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:53.854836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":73,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'2","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:46.984088+0000","last_change":"2024-09-12T01:05:46.984088+0000","last_active":"2024-09-12T01:05:46.984088+0000","last_peered":"2024-09-12T01:05:46.984088+0000","last_clean":"2024-09-12T01:05:46.984088+0000","last_became_active":"2024-09-12T00:46:09.514727+0000","last_became_peered":"2024-09-12T00:46:09.514727+0000","last_unstale":"2024-09-12T01:05:46.984088+0000","last_undegraded":"2024-09-12T01:05:46.984088+0000","last_fullsized":"2024-09-12T01:05:46.984088+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:46.983920+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:46.983920+0000","last_clean_scrub_stamp":"2024-09-12T01:05:46.983920+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:15.795444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"268'7","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.875656+0000","last_change":"2024-09-12T01:05:20.875656+0000","last_active":"2024-09-12T01:05:20.875656+0000","last_peered":"2024-09-12T01:05:20.875656+0000","last_clean":"2024-09-12T01:05:20.875656+0000","last_became_active":"2024-09-12T00:34:55.220179+0000","last_became_peered":"2024-09-12T00:34:55.220179+0000","last_unstale":"2024-09-12T01:05:20.875656+0000","last_undegraded":"2024-09-12T01:05:20.875656+0000","last_fullsized":"2024-09-12T01:05:20.875656+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-12T01:05:20.875403+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-12T01:05:20.875403+0000","last_clean_scrub_stamp":"2024-09-12T01:05:20.875403+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:37.253656+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"268'7","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:27.465316+0000","last_change":"2024-09-12T01:05:27.465316+0000","last_active":"2024-09-12T01:05:27.465316+0000","last_peered":"2024-09-12T01:05:27.465316+0000","last_clean":"2024-09-12T01:05:27.465316+0000","last_became_active":"2024-09-12T00:34:52.196592+0000","last_became_peered":"2024-09-12T00:34:52.196592+0000","last_unstale":"2024-09-12T01:05:27.465316+0000","last_undegraded":"2024-09-12T01:05:27.465316+0000","last_fullsized":"2024-09-12T01:05:27.465316+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-12T01:05:27.465133+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-12T01:05:27.465133+0000","last_clean_scrub_stamp":"2024-09-12T01:05:27.465133+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:26.670583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":12,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'27","reported_seq":126,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:31.080035+0000","last_change":"2024-09-12T01:05:31.079810+0000","last_active":"2024-09-12T01:05:31.080035+0000","last_peered":"2024-09-12T01:05:31.080035+0000","last_clean":"2024-09-12T01:05:31.080035+0000","last_became_active":"2024-09-12T00:33:10.842139+0000","last_became_peered":"2024-09-12T00:33:10.842139+0000","last_unstale":"2024-09-12T01:05:31.080035+0000","last_undegraded":"2024-09-12T01:05:31.080035+0000","last_fullsized":"2024-09-12T01:05:31.080035+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'27","last_scrub_stamp":"2024-09-12T01:05:31.079635+0000","last_deep_scrub":"268'27","last_deep_scrub_stamp":"2024-09-12T01:05:31.079635+0000","last_clean_scrub_stamp":"2024-09-12T01:05:31.079635+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:45.293345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":87,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.454915+0000","last_change":"2024-09-12T01:05:14.454784+0000","last_active":"2024-09-12T01:05:14.454915+0000","last_peered":"2024-09-12T01:05:14.454915+0000","last_clean":"2024-09-12T01:05:14.454915+0000","last_became_active":"2024-09-12T00:46:09.494257+0000","last_became_peered":"2024-09-12T00:46:09.494257+0000","last_unstale":"2024-09-12T01:05:14.454915+0000","last_undegraded":"2024-09-12T01:05:14.454915+0000","last_fullsized":"2024-09-12T01:05:14.454915+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:14.454594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:14.454594+0000","last_clean_scrub_stamp":"2024-09-12T01:05:14.454594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:36.996544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:37.991973+0000","last_change":"2024-09-12T01:05:37.991973+0000","last_active":"2024-09-12T01:05:37.991973+0000","last_peered":"2024-09-12T01:05:37.991973+0000","last_clean":"2024-09-12T01:05:37.991973+0000","last_became_active":"2024-09-12T00:34:55.226471+0000","last_became_peered":"2024-09-12T00:34:55.226471+0000","last_unstale":"2024-09-12T01:05:37.991973+0000","last_undegraded":"2024-09-12T01:05:37.991973+0000","last_fullsized":"2024-09-12T01:05:37.991973+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:37.991781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:37.991781+0000","last_clean_scrub_stamp":"2024-09-12T01:05:37.991781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:54.440430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'2","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:30.450750+0000","last_change":"2024-09-12T01:05:30.450750+0000","last_active":"2024-09-12T01:05:30.450750+0000","last_peered":"2024-09-12T01:05:30.450750+0000","last_clean":"2024-09-12T01:05:30.450750+0000","last_became_active":"2024-09-12T00:34:52.202587+0000","last_became_peered":"2024-09-12T00:34:52.202587+0000","last_unstale":"2024-09-12T01:05:30.450750+0000","last_undegraded":"2024-09-12T01:05:30.450750+0000","last_fullsized":"2024-09-12T01:05:30.450750+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:05:30.450558+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:05:30.450558+0000","last_clean_scrub_stamp":"2024-09-12T01:05:30.450558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:50.380227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'23","reported_seq":117,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.072410+0000","last_change":"2024-09-12T01:05:29.072410+0000","last_active":"2024-09-12T01:05:29.072410+0000","last_peered":"2024-09-12T01:05:29.072410+0000","last_clean":"2024-09-12T01:05:29.072410+0000","last_became_active":"2024-09-12T00:33:10.832622+0000","last_became_peered":"2024-09-12T00:33:10.832622+0000","last_unstale":"2024-09-12T01:05:29.072410+0000","last_undegraded":"2024-09-12T01:05:29.072410+0000","last_fullsized":"2024-09-12T01:05:29.072410+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'23","last_scrub_stamp":"2024-09-12T01:05:29.072243+0000","last_deep_scrub":"268'23","last_deep_scrub_stamp":"2024-09-12T01:05:29.072243+0000","last_clean_scrub_stamp":"2024-09-12T01:05:29.072243+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:21.968941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":78,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:41.488347+0000","last_change":"2024-09-12T01:05:41.488347+0000","last_active":"2024-09-12T01:05:41.488347+0000","last_peered":"2024-09-12T01:05:41.488347+0000","last_clean":"2024-09-12T01:05:41.488347+0000","last_became_active":"2024-09-12T00:46:09.501361+0000","last_became_peered":"2024-09-12T00:46:09.501361+0000","last_unstale":"2024-09-12T01:05:41.488347+0000","last_undegraded":"2024-09-12T01:05:41.488347+0000","last_fullsized":"2024-09-12T01:05:41.488347+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:41.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:41.488156+0000","last_clean_scrub_stamp":"2024-09-12T01:05:41.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:12.285022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"268'2","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:36.054992+0000","last_change":"2024-09-12T01:05:36.054992+0000","last_active":"2024-09-12T01:05:36.054992+0000","last_peered":"2024-09-12T01:05:36.054992+0000","last_clean":"2024-09-12T01:05:36.054992+0000","last_became_active":"2024-09-12T00:34:55.222079+0000","last_became_peered":"2024-09-12T00:34:55.222079+0000","last_unstale":"2024-09-12T01:05:36.054992+0000","last_undegraded":"2024-09-12T01:05:36.054992+0000","last_fullsized":"2024-09-12T01:05:36.054992+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:36.054792+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:36.054792+0000","last_clean_scrub_stamp":"2024-09-12T01:05:36.054792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:03.597560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"268'3","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:11.443631+0000","last_change":"2024-09-12T01:05:11.443631+0000","last_active":"2024-09-12T01:05:11.443631+0000","last_peered":"2024-09-12T01:05:11.443631+0000","last_clean":"2024-09-12T01:05:11.443631+0000","last_became_active":"2024-09-12T00:34:52.176108+0000","last_became_peered":"2024-09-12T00:34:52.176108+0000","last_unstale":"2024-09-12T01:05:11.443631+0000","last_undegraded":"2024-09-12T01:05:11.443631+0000","last_fullsized":"2024-09-12T01:05:11.443631+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:05:11.443449+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:05:11.443449+0000","last_clean_scrub_stamp":"2024-09-12T01:05:11.443449+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:39.904043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'16","reported_seq":99,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.509817+0000","last_change":"2024-09-12T01:05:25.509817+0000","last_active":"2024-09-12T01:05:25.509817+0000","last_peered":"2024-09-12T01:05:25.509817+0000","last_clean":"2024-09-12T01:05:25.509817+0000","last_became_active":"2024-09-12T00:33:10.849703+0000","last_became_peered":"2024-09-12T00:33:10.849703+0000","last_unstale":"2024-09-12T01:05:25.509817+0000","last_undegraded":"2024-09-12T01:05:25.509817+0000","last_fullsized":"2024-09-12T01:05:25.509817+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'16","last_scrub_stamp":"2024-09-12T01:05:25.509628+0000","last_deep_scrub":"265'16","last_deep_scrub_stamp":"2024-09-12T01:05:25.509628+0000","last_clean_scrub_stamp":"2024-09-12T01:05:25.509628+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:23.064810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":28,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:23.901445+0000","last_change":"2024-09-12T01:05:23.901314+0000","last_active":"2024-09-12T01:05:23.901445+0000","last_peered":"2024-09-12T01:05:23.901445+0000","last_clean":"2024-09-12T01:05:23.901445+0000","last_became_active":"2024-09-12T00:46:09.514197+0000","last_became_peered":"2024-09-12T00:46:09.514197+0000","last_unstale":"2024-09-12T01:05:23.901445+0000","last_undegraded":"2024-09-12T01:05:23.901445+0000","last_fullsized":"2024-09-12T01:05:23.901445+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:23.901126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:23.901126+0000","last_clean_scrub_stamp":"2024-09-12T01:05:23.901126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:28.857730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"268'8","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:23.524527+0000","last_change":"2024-09-12T01:05:23.524527+0000","last_active":"2024-09-12T01:05:23.524527+0000","last_peered":"2024-09-12T01:05:23.524527+0000","last_clean":"2024-09-12T01:05:23.524527+0000","last_became_active":"2024-09-12T00:34:55.252651+0000","last_became_peered":"2024-09-12T00:34:55.252651+0000","last_unstale":"2024-09-12T01:05:23.524527+0000","last_undegraded":"2024-09-12T01:05:23.524527+0000","last_fullsized":"2024-09-12T01:05:23.524527+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-12T01:05:23.524342+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-12T01:05:23.524342+0000","last_clean_scrub_stamp":"2024-09-12T01:05:23.524342+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:54.519342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":7697,"num_write":8,"num_write_kb":6673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"268'3","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:31.032586+0000","last_change":"2024-09-12T01:05:31.032586+0000","last_active":"2024-09-12T01:05:31.032586+0000","last_peered":"2024-09-12T01:05:31.032586+0000","last_clean":"2024-09-12T01:05:31.032586+0000","last_became_active":"2024-09-12T00:34:52.177094+0000","last_became_peered":"2024-09-12T00:34:52.177094+0000","last_unstale":"2024-09-12T01:05:31.032586+0000","last_undegraded":"2024-09-12T01:05:31.032586+0000","last_fullsized":"2024-09-12T01:05:31.032586+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:05:31.032404+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:05:31.032404+0000","last_clean_scrub_stamp":"2024-09-12T01:05:31.032404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:59.797386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"268'31","reported_seq":141,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.781240+0000","last_change":"2024-09-12T01:05:14.781240+0000","last_active":"2024-09-12T01:05:14.781240+0000","last_peered":"2024-09-12T01:05:14.781240+0000","last_clean":"2024-09-12T01:05:14.781240+0000","last_became_active":"2024-09-12T00:33:10.862993+0000","last_became_peered":"2024-09-12T00:33:10.862993+0000","last_unstale":"2024-09-12T01:05:14.781240+0000","last_undegraded":"2024-09-12T01:05:14.781240+0000","last_fullsized":"2024-09-12T01:05:14.781240+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'31","last_scrub_stamp":"2024-09-12T01:05:14.781021+0000","last_deep_scrub":"268'31","last_deep_scrub_stamp":"2024-09-12T01:05:14.781021+0000","last_clean_scrub_stamp":"2024-09-12T01:05:14.781021+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:28.478018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":107,"num_write":58,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:36.496743+0000","last_change":"2024-09-12T01:05:36.496569+0000","last_active":"2024-09-12T01:05:36.496743+0000","last_peered":"2024-09-12T01:05:36.496743+0000","last_clean":"2024-09-12T01:05:36.496743+0000","last_became_active":"2024-09-12T00:46:09.498482+0000","last_became_peered":"2024-09-12T00:46:09.498482+0000","last_unstale":"2024-09-12T01:05:36.496743+0000","last_undegraded":"2024-09-12T01:05:36.496743+0000","last_fullsized":"2024-09-12T01:05:36.496743+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:36.496375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:36.496375+0000","last_clean_scrub_stamp":"2024-09-12T01:05:36.496375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:08.554029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:38.972577+0000","last_change":"2024-09-12T01:05:38.972577+0000","last_active":"2024-09-12T01:05:38.972577+0000","last_peered":"2024-09-12T01:05:38.972577+0000","last_clean":"2024-09-12T01:05:38.972577+0000","last_became_active":"2024-09-12T00:34:55.228136+0000","last_became_peered":"2024-09-12T00:34:55.228136+0000","last_unstale":"2024-09-12T01:05:38.972577+0000","last_undegraded":"2024-09-12T01:05:38.972577+0000","last_fullsized":"2024-09-12T01:05:38.972577+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:38.972391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:38.972391+0000","last_clean_scrub_stamp":"2024-09-12T01:05:38.972391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:27.334184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.495292+0000","last_change":"2024-09-12T01:05:19.495292+0000","last_active":"2024-09-12T01:05:19.495292+0000","last_peered":"2024-09-12T01:05:19.495292+0000","last_clean":"2024-09-12T01:05:19.495292+0000","last_became_active":"2024-09-12T00:34:52.190350+0000","last_became_peered":"2024-09-12T00:34:52.190350+0000","last_unstale":"2024-09-12T01:05:19.495292+0000","last_undegraded":"2024-09-12T01:05:19.495292+0000","last_fullsized":"2024-09-12T01:05:19.495292+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:19.495112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:19.495112+0000","last_clean_scrub_stamp":"2024-09-12T01:05:19.495112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:01.884792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'31","reported_seq":139,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:07.485351+0000","last_change":"2024-09-12T01:05:07.485351+0000","last_active":"2024-09-12T01:05:07.485351+0000","last_peered":"2024-09-12T01:05:07.485351+0000","last_clean":"2024-09-12T01:05:07.485351+0000","last_became_active":"2024-09-12T00:33:10.834095+0000","last_became_peered":"2024-09-12T00:33:10.834095+0000","last_unstale":"2024-09-12T01:05:07.485351+0000","last_undegraded":"2024-09-12T01:05:07.485351+0000","last_fullsized":"2024-09-12T01:05:07.485351+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'31","last_scrub_stamp":"2024-09-12T01:05:07.485175+0000","last_deep_scrub":"268'31","last_deep_scrub_stamp":"2024-09-12T01:05:07.485175+0000","last_clean_scrub_stamp":"2024-09-12T01:05:07.485175+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:30.593230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":107,"num_write":54,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:46.002332+0000","last_change":"2024-09-12T01:05:46.002332+0000","last_active":"2024-09-12T01:05:46.002332+0000","last_peered":"2024-09-12T01:05:46.002332+0000","last_clean":"2024-09-12T01:05:46.002332+0000","last_became_active":"2024-09-12T00:46:09.500779+0000","last_became_peered":"2024-09-12T00:46:09.500779+0000","last_unstale":"2024-09-12T01:05:46.002332+0000","last_undegraded":"2024-09-12T01:05:46.002332+0000","last_fullsized":"2024-09-12T01:05:46.002332+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:46.002130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:46.002130+0000","last_clean_scrub_stamp":"2024-09-12T01:05:46.002130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:54.776939+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"268'8","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:32.222083+0000","last_change":"2024-09-12T01:05:32.222083+0000","last_active":"2024-09-12T01:05:32.222083+0000","last_peered":"2024-09-12T01:05:32.222083+0000","last_clean":"2024-09-12T01:05:32.222083+0000","last_became_active":"2024-09-12T00:34:55.241223+0000","last_became_peered":"2024-09-12T00:34:55.241223+0000","last_unstale":"2024-09-12T01:05:32.222083+0000","last_undegraded":"2024-09-12T01:05:32.222083+0000","last_fullsized":"2024-09-12T01:05:32.222083+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-12T01:05:32.221898+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-12T01:05:32.221898+0000","last_clean_scrub_stamp":"2024-09-12T01:05:32.221898+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:10.526262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9218,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"268'2","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:28.059546+0000","last_change":"2024-09-12T01:05:28.059546+0000","last_active":"2024-09-12T01:05:28.059546+0000","last_peered":"2024-09-12T01:05:28.059546+0000","last_clean":"2024-09-12T01:05:28.059546+0000","last_became_active":"2024-09-12T00:34:52.202407+0000","last_became_peered":"2024-09-12T00:34:52.202407+0000","last_unstale":"2024-09-12T01:05:28.059546+0000","last_undegraded":"2024-09-12T01:05:28.059546+0000","last_fullsized":"2024-09-12T01:05:28.059546+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:28.059362+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:28.059362+0000","last_clean_scrub_stamp":"2024-09-12T01:05:28.059362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:28.939897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'46","reported_seq":187,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.007682+0000","last_change":"2024-09-12T01:05:25.007682+0000","last_active":"2024-09-12T01:05:25.007682+0000","last_peered":"2024-09-12T01:05:25.007682+0000","last_clean":"2024-09-12T01:05:25.007682+0000","last_became_active":"2024-09-12T00:33:10.859459+0000","last_became_peered":"2024-09-12T00:33:10.859459+0000","last_unstale":"2024-09-12T01:05:25.007682+0000","last_undegraded":"2024-09-12T01:05:25.007682+0000","last_fullsized":"2024-09-12T01:05:25.007682+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'46","last_scrub_stamp":"2024-09-12T01:05:25.007486+0000","last_deep_scrub":"268'46","last_deep_scrub_stamp":"2024-09-12T01:05:25.007486+0000","last_clean_scrub_stamp":"2024-09-12T01:05:25.007486+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:36.922427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":176,"num_write":75,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:39.467891+0000","last_change":"2024-09-12T01:05:39.467891+0000","last_active":"2024-09-12T01:05:39.467891+0000","last_peered":"2024-09-12T01:05:39.467891+0000","last_clean":"2024-09-12T01:05:39.467891+0000","last_became_active":"2024-09-12T00:46:09.505143+0000","last_became_peered":"2024-09-12T00:46:09.505143+0000","last_unstale":"2024-09-12T01:05:39.467891+0000","last_undegraded":"2024-09-12T01:05:39.467891+0000","last_fullsized":"2024-09-12T01:05:39.467891+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:39.467705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:39.467705+0000","last_clean_scrub_stamp":"2024-09-12T01:05:39.467705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:16.714797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"268'2","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:33.475483+0000","last_change":"2024-09-12T01:05:33.475483+0000","last_active":"2024-09-12T01:05:33.475483+0000","last_peered":"2024-09-12T01:05:33.475483+0000","last_clean":"2024-09-12T01:05:33.475483+0000","last_became_active":"2024-09-12T00:34:55.253169+0000","last_became_peered":"2024-09-12T00:34:55.253169+0000","last_unstale":"2024-09-12T01:05:33.475483+0000","last_undegraded":"2024-09-12T01:05:33.475483+0000","last_fullsized":"2024-09-12T01:05:33.475483+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:33.475199+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:33.475199+0000","last_clean_scrub_stamp":"2024-09-12T01:05:33.475199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:40.221978+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"268'2","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:18.531394+0000","last_change":"2024-09-12T01:05:18.531394+0000","last_active":"2024-09-12T01:05:18.531394+0000","last_peered":"2024-09-12T01:05:18.531394+0000","last_clean":"2024-09-12T01:05:18.531394+0000","last_became_active":"2024-09-12T00:34:52.190174+0000","last_became_peered":"2024-09-12T00:34:52.190174+0000","last_unstale":"2024-09-12T01:05:18.531394+0000","last_undegraded":"2024-09-12T01:05:18.531394+0000","last_fullsized":"2024-09-12T01:05:18.531394+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:18.531176+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:18.531176+0000","last_clean_scrub_stamp":"2024-09-12T01:05:18.531176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:29.431630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'29","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:23.391512+0000","last_change":"2024-09-12T01:05:23.391346+0000","last_active":"2024-09-12T01:05:23.391512+0000","last_peered":"2024-09-12T01:05:23.391512+0000","last_clean":"2024-09-12T01:05:23.391512+0000","last_became_active":"2024-09-12T00:33:10.849658+0000","last_became_peered":"2024-09-12T00:33:10.849658+0000","last_unstale":"2024-09-12T01:05:23.391512+0000","last_undegraded":"2024-09-12T01:05:23.391512+0000","last_fullsized":"2024-09-12T01:05:23.391512+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'29","last_scrub_stamp":"2024-09-12T01:05:23.391166+0000","last_deep_scrub":"268'29","last_deep_scrub_stamp":"2024-09-12T01:05:23.391166+0000","last_clean_scrub_stamp":"2024-09-12T01:05:23.391166+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:10.325840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":91,"num_write":56,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'2","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:38.505366+0000","last_change":"2024-09-12T01:05:38.505366+0000","last_active":"2024-09-12T01:05:38.505366+0000","last_peered":"2024-09-12T01:05:38.505366+0000","last_clean":"2024-09-12T01:05:38.505366+0000","last_became_active":"2024-09-12T00:46:09.485933+0000","last_became_peered":"2024-09-12T00:46:09.485933+0000","last_unstale":"2024-09-12T01:05:38.505366+0000","last_undegraded":"2024-09-12T01:05:38.505366+0000","last_fullsized":"2024-09-12T01:05:38.505366+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:38.505148+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:38.505148+0000","last_clean_scrub_stamp":"2024-09-12T01:05:38.505148+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:10.425204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"268'2","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:22.541565+0000","last_change":"2024-09-12T01:05:22.541565+0000","last_active":"2024-09-12T01:05:22.541565+0000","last_peered":"2024-09-12T01:05:22.541565+0000","last_clean":"2024-09-12T01:05:22.541565+0000","last_became_active":"2024-09-12T00:34:55.236708+0000","last_became_peered":"2024-09-12T00:34:55.236708+0000","last_unstale":"2024-09-12T01:05:22.541565+0000","last_undegraded":"2024-09-12T01:05:22.541565+0000","last_fullsized":"2024-09-12T01:05:22.541565+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:22.541371+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:22.541371+0000","last_clean_scrub_stamp":"2024-09-12T01:05:22.541371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:21.089324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'4","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:35.051883+0000","last_change":"2024-09-12T01:05:35.051883+0000","last_active":"2024-09-12T01:05:35.051883+0000","last_peered":"2024-09-12T01:05:35.051883+0000","last_clean":"2024-09-12T01:05:35.051883+0000","last_became_active":"2024-09-12T00:34:52.205829+0000","last_became_peered":"2024-09-12T00:34:52.205829+0000","last_unstale":"2024-09-12T01:05:35.051883+0000","last_undegraded":"2024-09-12T01:05:35.051883+0000","last_fullsized":"2024-09-12T01:05:35.051883+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:05:35.051696+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:05:35.051696+0000","last_clean_scrub_stamp":"2024-09-12T01:05:35.051696+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:53.088317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'30","reported_seq":142,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:28.056779+0000","last_change":"2024-09-12T01:05:28.056620+0000","last_active":"2024-09-12T01:05:28.056779+0000","last_peered":"2024-09-12T01:05:28.056779+0000","last_clean":"2024-09-12T01:05:28.056779+0000","last_became_active":"2024-09-12T00:33:10.825191+0000","last_became_peered":"2024-09-12T00:33:10.825191+0000","last_unstale":"2024-09-12T01:05:28.056779+0000","last_undegraded":"2024-09-12T01:05:28.056779+0000","last_fullsized":"2024-09-12T01:05:28.056779+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'30","last_scrub_stamp":"2024-09-12T01:05:28.056432+0000","last_deep_scrub":"268'30","last_deep_scrub_stamp":"2024-09-12T01:05:28.056432+0000","last_clean_scrub_stamp":"2024-09-12T01:05:28.056432+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:43.332413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":116,"num_write":60,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:43.942888+0000","last_change":"2024-09-12T01:05:43.942888+0000","last_active":"2024-09-12T01:05:43.942888+0000","last_peered":"2024-09-12T01:05:43.942888+0000","last_clean":"2024-09-12T01:05:43.942888+0000","last_became_active":"2024-09-12T00:46:09.504789+0000","last_became_peered":"2024-09-12T00:46:09.504789+0000","last_unstale":"2024-09-12T01:05:43.942888+0000","last_undegraded":"2024-09-12T01:05:43.942888+0000","last_fullsized":"2024-09-12T01:05:43.942888+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:43.942708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:43.942708+0000","last_clean_scrub_stamp":"2024-09-12T01:05:43.942708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:38.496834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'2","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:34.487038+0000","last_change":"2024-09-12T01:05:34.487038+0000","last_active":"2024-09-12T01:05:34.487038+0000","last_peered":"2024-09-12T01:05:34.487038+0000","last_clean":"2024-09-12T01:05:34.487038+0000","last_became_active":"2024-09-12T00:34:55.237691+0000","last_became_peered":"2024-09-12T00:34:55.237691+0000","last_unstale":"2024-09-12T01:05:34.487038+0000","last_undegraded":"2024-09-12T01:05:34.487038+0000","last_fullsized":"2024-09-12T01:05:34.487038+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:05:34.486820+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:05:34.486820+0000","last_clean_scrub_stamp":"2024-09-12T01:05:34.486820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:19.893016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'8","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:26.206011+0000","last_change":"2024-09-12T01:05:26.206011+0000","last_active":"2024-09-12T01:05:26.206011+0000","last_peered":"2024-09-12T01:05:26.206011+0000","last_clean":"2024-09-12T01:05:26.206011+0000","last_became_active":"2024-09-12T00:34:52.200033+0000","last_became_peered":"2024-09-12T00:34:52.200033+0000","last_unstale":"2024-09-12T01:05:26.206011+0000","last_undegraded":"2024-09-12T01:05:26.206011+0000","last_fullsized":"2024-09-12T01:05:26.206011+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T01:05:26.205816+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T01:05:26.205816+0000","last_clean_scrub_stamp":"2024-09-12T01:05:26.205816+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:41.934254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":17410,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'38","reported_seq":158,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.775241+0000","last_change":"2024-09-12T01:05:13.775104+0000","last_active":"2024-09-12T01:05:13.775241+0000","last_peered":"2024-09-12T01:05:13.775241+0000","last_clean":"2024-09-12T01:05:13.775241+0000","last_became_active":"2024-09-12T00:33:10.855257+0000","last_became_peered":"2024-09-12T00:33:10.855257+0000","last_unstale":"2024-09-12T01:05:13.775241+0000","last_undegraded":"2024-09-12T01:05:13.775241+0000","last_fullsized":"2024-09-12T01:05:13.775241+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'38","last_scrub_stamp":"2024-09-12T01:05:13.774920+0000","last_deep_scrub":"268'38","last_deep_scrub_stamp":"2024-09-12T01:05:13.774920+0000","last_clean_scrub_stamp":"2024-09-12T01:05:13.774920+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:22.509428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":126,"num_write":70,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:37.474805+0000","last_change":"2024-09-12T01:05:37.474805+0000","last_active":"2024-09-12T01:05:37.474805+0000","last_peered":"2024-09-12T01:05:37.474805+0000","last_clean":"2024-09-12T01:05:37.474805+0000","last_became_active":"2024-09-12T00:46:09.504114+0000","last_became_peered":"2024-09-12T00:46:09.504114+0000","last_unstale":"2024-09-12T01:05:37.474805+0000","last_undegraded":"2024-09-12T01:05:37.474805+0000","last_fullsized":"2024-09-12T01:05:37.474805+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:37.474628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:37.474628+0000","last_clean_scrub_stamp":"2024-09-12T01:05:37.474628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:18.789397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'2","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:42.985065+0000","last_change":"2024-09-12T01:05:42.985065+0000","last_active":"2024-09-12T01:05:42.985065+0000","last_peered":"2024-09-12T01:05:42.985065+0000","last_clean":"2024-09-12T01:05:42.985065+0000","last_became_active":"2024-09-12T00:34:55.234795+0000","last_became_peered":"2024-09-12T00:34:55.234795+0000","last_unstale":"2024-09-12T01:05:42.985065+0000","last_undegraded":"2024-09-12T01:05:42.985065+0000","last_fullsized":"2024-09-12T01:05:42.985065+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:05:42.984730+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:05:42.984730+0000","last_clean_scrub_stamp":"2024-09-12T01:05:42.984730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:09.905663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"268'7","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:28.379424+0000","last_change":"2024-09-12T01:05:28.379291+0000","last_active":"2024-09-12T01:05:28.379424+0000","last_peered":"2024-09-12T01:05:28.379424+0000","last_clean":"2024-09-12T01:05:28.379424+0000","last_became_active":"2024-09-12T00:34:52.198346+0000","last_became_peered":"2024-09-12T00:34:52.198346+0000","last_unstale":"2024-09-12T01:05:28.379424+0000","last_undegraded":"2024-09-12T01:05:28.379424+0000","last_fullsized":"2024-09-12T01:05:28.379424+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-12T01:05:28.379115+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-12T01:05:28.379115+0000","last_clean_scrub_stamp":"2024-09-12T01:05:28.379115+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:47.902643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'29","reported_seq":139,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:24.038827+0000","last_change":"2024-09-12T01:05:24.038574+0000","last_active":"2024-09-12T01:05:24.038827+0000","last_peered":"2024-09-12T01:05:24.038827+0000","last_clean":"2024-09-12T01:05:24.038827+0000","last_became_active":"2024-09-12T00:33:10.847386+0000","last_became_peered":"2024-09-12T00:33:10.847386+0000","last_unstale":"2024-09-12T01:05:24.038827+0000","last_undegraded":"2024-09-12T01:05:24.038827+0000","last_fullsized":"2024-09-12T01:05:24.038827+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'29","last_scrub_stamp":"2024-09-12T01:05:24.038360+0000","last_deep_scrub":"268'29","last_deep_scrub_stamp":"2024-09-12T01:05:24.038360+0000","last_clean_scrub_stamp":"2024-09-12T01:05:24.038360+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:05.679964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":106,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:32.480211+0000","last_change":"2024-09-12T01:05:32.480211+0000","last_active":"2024-09-12T01:05:32.480211+0000","last_peered":"2024-09-12T01:05:32.480211+0000","last_clean":"2024-09-12T01:05:32.480211+0000","last_became_active":"2024-09-12T00:46:09.509685+0000","last_became_peered":"2024-09-12T00:46:09.509685+0000","last_unstale":"2024-09-12T01:05:32.480211+0000","last_undegraded":"2024-09-12T01:05:32.480211+0000","last_fullsized":"2024-09-12T01:05:32.480211+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:32.480026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:32.480026+0000","last_clean_scrub_stamp":"2024-09-12T01:05:32.480026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:16.998203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"268'2","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:37.036367+0000","last_change":"2024-09-12T01:05:37.036367+0000","last_active":"2024-09-12T01:05:37.036367+0000","last_peered":"2024-09-12T01:05:37.036367+0000","last_clean":"2024-09-12T01:05:37.036367+0000","last_became_active":"2024-09-12T00:34:55.251057+0000","last_became_peered":"2024-09-12T00:34:55.251057+0000","last_unstale":"2024-09-12T01:05:37.036367+0000","last_undegraded":"2024-09-12T01:05:37.036367+0000","last_fullsized":"2024-09-12T01:05:37.036367+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:37.036184+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:37.036184+0000","last_clean_scrub_stamp":"2024-09-12T01:05:37.036184+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:51.624947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"268'6","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.455726+0000","last_change":"2024-09-12T01:05:09.455561+0000","last_active":"2024-09-12T01:05:09.455726+0000","last_peered":"2024-09-12T01:05:09.455726+0000","last_clean":"2024-09-12T01:05:09.455726+0000","last_became_active":"2024-09-12T00:34:52.177088+0000","last_became_peered":"2024-09-12T00:34:52.177088+0000","last_unstale":"2024-09-12T01:05:09.455726+0000","last_undegraded":"2024-09-12T01:05:09.455726+0000","last_fullsized":"2024-09-12T01:05:09.455726+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T01:05:09.455387+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T01:05:09.455387+0000","last_clean_scrub_stamp":"2024-09-12T01:05:09.455387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:39.598065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"268'21","reported_seq":112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:18.814656+0000","last_change":"2024-09-12T01:05:18.814452+0000","last_active":"2024-09-12T01:05:18.814656+0000","last_peered":"2024-09-12T01:05:18.814656+0000","last_clean":"2024-09-12T01:05:18.814656+0000","last_became_active":"2024-09-12T00:33:10.844093+0000","last_became_peered":"2024-09-12T00:33:10.844093+0000","last_unstale":"2024-09-12T01:05:18.814656+0000","last_undegraded":"2024-09-12T01:05:18.814656+0000","last_fullsized":"2024-09-12T01:05:18.814656+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'21","last_scrub_stamp":"2024-09-12T01:05:18.814273+0000","last_deep_scrub":"268'21","last_deep_scrub_stamp":"2024-09-12T01:05:18.814273+0000","last_clean_scrub_stamp":"2024-09-12T01:05:18.814273+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:27.972849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":69,"num_write":38,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:26.499156+0000","last_change":"2024-09-12T01:05:26.499156+0000","last_active":"2024-09-12T01:05:26.499156+0000","last_peered":"2024-09-12T01:05:26.499156+0000","last_clean":"2024-09-12T01:05:26.499156+0000","last_became_active":"2024-09-12T00:46:09.497751+0000","last_became_peered":"2024-09-12T00:46:09.497751+0000","last_unstale":"2024-09-12T01:05:26.499156+0000","last_undegraded":"2024-09-12T01:05:26.499156+0000","last_fullsized":"2024-09-12T01:05:26.499156+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:26.498937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:26.498937+0000","last_clean_scrub_stamp":"2024-09-12T01:05:26.498937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:49.533104+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:32.457818+0000","last_change":"2024-09-12T01:05:32.457818+0000","last_active":"2024-09-12T01:05:32.457818+0000","last_peered":"2024-09-12T01:05:32.457818+0000","last_clean":"2024-09-12T01:05:32.457818+0000","last_became_active":"2024-09-12T00:34:55.254446+0000","last_became_peered":"2024-09-12T00:34:55.254446+0000","last_unstale":"2024-09-12T01:05:32.457818+0000","last_undegraded":"2024-09-12T01:05:32.457818+0000","last_fullsized":"2024-09-12T01:05:32.457818+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:32.457635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:32.457635+0000","last_clean_scrub_stamp":"2024-09-12T01:05:32.457635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:11.026076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:26.477520+0000","last_change":"2024-09-12T01:05:26.477520+0000","last_active":"2024-09-12T01:05:26.477520+0000","last_peered":"2024-09-12T01:05:26.477520+0000","last_clean":"2024-09-12T01:05:26.477520+0000","last_became_active":"2024-09-12T00:34:52.193306+0000","last_became_peered":"2024-09-12T00:34:52.193306+0000","last_unstale":"2024-09-12T01:05:26.477520+0000","last_undegraded":"2024-09-12T01:05:26.477520+0000","last_fullsized":"2024-09-12T01:05:26.477520+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:26.477332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:26.477332+0000","last_clean_scrub_stamp":"2024-09-12T01:05:26.477332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:30.919699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"268'36","reported_seq":160,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:22.406472+0000","last_change":"2024-09-12T01:05:22.406472+0000","last_active":"2024-09-12T01:05:22.406472+0000","last_peered":"2024-09-12T01:05:22.406472+0000","last_clean":"2024-09-12T01:05:22.406472+0000","last_became_active":"2024-09-12T00:33:10.859799+0000","last_became_peered":"2024-09-12T00:33:10.859799+0000","last_unstale":"2024-09-12T01:05:22.406472+0000","last_undegraded":"2024-09-12T01:05:22.406472+0000","last_fullsized":"2024-09-12T01:05:22.406472+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'36","last_scrub_stamp":"2024-09-12T01:05:22.406297+0000","last_deep_scrub":"268'36","last_deep_scrub_stamp":"2024-09-12T01:05:22.406297+0000","last_clean_scrub_stamp":"2024-09-12T01:05:22.406297+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:06.893957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":137,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:34.217673+0000","last_change":"2024-09-12T01:05:34.217673+0000","last_active":"2024-09-12T01:05:34.217673+0000","last_peered":"2024-09-12T01:05:34.217673+0000","last_clean":"2024-09-12T01:05:34.217673+0000","last_became_active":"2024-09-12T00:46:09.498942+0000","last_became_peered":"2024-09-12T00:46:09.498942+0000","last_unstale":"2024-09-12T01:05:34.217673+0000","last_undegraded":"2024-09-12T01:05:34.217673+0000","last_fullsized":"2024-09-12T01:05:34.217673+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:34.217494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:34.217494+0000","last_clean_scrub_stamp":"2024-09-12T01:05:34.217494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:32.460009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'2","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:31.192948+0000","last_change":"2024-09-12T01:05:31.192948+0000","last_active":"2024-09-12T01:05:31.192948+0000","last_peered":"2024-09-12T01:05:31.192948+0000","last_clean":"2024-09-12T01:05:31.192948+0000","last_became_active":"2024-09-12T00:34:55.214265+0000","last_became_peered":"2024-09-12T00:34:55.214265+0000","last_unstale":"2024-09-12T01:05:31.192948+0000","last_undegraded":"2024-09-12T01:05:31.192948+0000","last_fullsized":"2024-09-12T01:05:31.192948+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:31.192759+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:31.192759+0000","last_clean_scrub_stamp":"2024-09-12T01:05:31.192759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:40.634332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"268'9","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.417229+0000","last_change":"2024-09-12T01:05:29.417229+0000","last_active":"2024-09-12T01:05:29.417229+0000","last_peered":"2024-09-12T01:05:29.417229+0000","last_clean":"2024-09-12T01:05:29.417229+0000","last_became_active":"2024-09-12T00:34:52.204050+0000","last_became_peered":"2024-09-12T00:34:52.204050+0000","last_unstale":"2024-09-12T01:05:29.417229+0000","last_undegraded":"2024-09-12T01:05:29.417229+0000","last_fullsized":"2024-09-12T01:05:29.417229+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'9","last_scrub_stamp":"2024-09-12T01:05:29.417033+0000","last_deep_scrub":"268'9","last_deep_scrub_stamp":"2024-09-12T01:05:29.417033+0000","last_clean_scrub_stamp":"2024-09-12T01:05:29.417033+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:48.658895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5120,"num_write":14,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'20","reported_seq":112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:17.524208+0000","last_change":"2024-09-12T01:05:17.524208+0000","last_active":"2024-09-12T01:05:17.524208+0000","last_peered":"2024-09-12T01:05:17.524208+0000","last_clean":"2024-09-12T01:05:17.524208+0000","last_became_active":"2024-09-12T00:33:10.841411+0000","last_became_peered":"2024-09-12T00:33:10.841411+0000","last_unstale":"2024-09-12T01:05:17.524208+0000","last_undegraded":"2024-09-12T01:05:17.524208+0000","last_fullsized":"2024-09-12T01:05:17.524208+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'20","last_scrub_stamp":"2024-09-12T01:05:17.523976+0000","last_deep_scrub":"268'20","last_deep_scrub_stamp":"2024-09-12T01:05:17.523976+0000","last_clean_scrub_stamp":"2024-09-12T01:05:17.523976+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:40.341379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":70,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"268'2","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:12.411578+0000","last_change":"2024-09-12T01:05:12.411412+0000","last_active":"2024-09-12T01:05:12.411578+0000","last_peered":"2024-09-12T01:05:12.411578+0000","last_clean":"2024-09-12T01:05:12.411578+0000","last_became_active":"2024-09-12T00:46:09.520251+0000","last_became_peered":"2024-09-12T00:46:09.520251+0000","last_unstale":"2024-09-12T01:05:12.411578+0000","last_undegraded":"2024-09-12T01:05:12.411578+0000","last_fullsized":"2024-09-12T01:05:12.411578+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:12.411232+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:12.411232+0000","last_clean_scrub_stamp":"2024-09-12T01:05:12.411232+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:29.274957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"268'5","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:21.570025+0000","last_change":"2024-09-12T01:05:21.570025+0000","last_active":"2024-09-12T01:05:21.570025+0000","last_peered":"2024-09-12T01:05:21.570025+0000","last_clean":"2024-09-12T01:05:21.570025+0000","last_became_active":"2024-09-12T00:34:55.230698+0000","last_became_peered":"2024-09-12T00:34:55.230698+0000","last_unstale":"2024-09-12T01:05:21.570025+0000","last_undegraded":"2024-09-12T01:05:21.570025+0000","last_fullsized":"2024-09-12T01:05:21.570025+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-12T01:05:21.569842+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-12T01:05:21.569842+0000","last_clean_scrub_stamp":"2024-09-12T01:05:21.569842+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:03.786355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"265'5","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:26.414797+0000","last_change":"2024-09-12T01:05:26.414797+0000","last_active":"2024-09-12T01:05:26.414797+0000","last_peered":"2024-09-12T01:05:26.414797+0000","last_clean":"2024-09-12T01:05:26.414797+0000","last_became_active":"2024-09-12T00:34:52.211709+0000","last_became_peered":"2024-09-12T00:34:52.211709+0000","last_unstale":"2024-09-12T01:05:26.414797+0000","last_undegraded":"2024-09-12T01:05:26.414797+0000","last_fullsized":"2024-09-12T01:05:26.414797+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:05:26.414506+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:05:26.414506+0000","last_clean_scrub_stamp":"2024-09-12T01:05:26.414506+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:56.218833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'227","reported_seq":761,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:24.559414+0000","last_change":"2024-09-12T01:05:24.559414+0000","last_active":"2024-09-12T01:05:24.559414+0000","last_peered":"2024-09-12T01:05:24.559414+0000","last_clean":"2024-09-12T01:05:24.559414+0000","last_became_active":"2024-09-12T00:33:10.852751+0000","last_became_peered":"2024-09-12T00:33:10.852751+0000","last_unstale":"2024-09-12T01:05:24.559414+0000","last_undegraded":"2024-09-12T01:05:24.559414+0000","last_fullsized":"2024-09-12T01:05:24.559414+0000","mapping_epoch":255,"log_start":"265'200","ondisk_log_start":"265'200","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'227","last_scrub_stamp":"2024-09-12T01:05:24.559221+0000","last_deep_scrub":"268'227","last_deep_scrub_stamp":"2024-09-12T01:05:24.559221+0000","last_clean_scrub_stamp":"2024-09-12T01:05:24.559221+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:26.843031+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1385,"num_read_kb":1074,"num_write":267,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5969,"num_omap_keys":12,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:38.036094+0000","last_change":"2024-09-12T01:05:38.035922+0000","last_active":"2024-09-12T01:05:38.036094+0000","last_peered":"2024-09-12T01:05:38.036094+0000","last_clean":"2024-09-12T01:05:38.036094+0000","last_became_active":"2024-09-12T00:46:09.516404+0000","last_became_peered":"2024-09-12T00:46:09.516404+0000","last_unstale":"2024-09-12T01:05:38.036094+0000","last_undegraded":"2024-09-12T01:05:38.036094+0000","last_fullsized":"2024-09-12T01:05:38.036094+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:38.035738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:38.035738+0000","last_clean_scrub_stamp":"2024-09-12T01:05:38.035738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:57.224049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"268'8","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:29.448368+0000","last_change":"2024-09-12T01:05:29.448368+0000","last_active":"2024-09-12T01:05:29.448368+0000","last_peered":"2024-09-12T01:05:29.448368+0000","last_clean":"2024-09-12T01:05:29.448368+0000","last_became_active":"2024-09-12T00:34:55.235522+0000","last_became_peered":"2024-09-12T00:34:55.235522+0000","last_unstale":"2024-09-12T01:05:29.448368+0000","last_undegraded":"2024-09-12T01:05:29.448368+0000","last_fullsized":"2024-09-12T01:05:29.448368+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-12T01:05:29.448184+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-12T01:05:29.448184+0000","last_clean_scrub_stamp":"2024-09-12T01:05:29.448184+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:43.934073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":10240,"num_write":8,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"268'6","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:27.384500+0000","last_change":"2024-09-12T01:05:27.384368+0000","last_active":"2024-09-12T01:05:27.384500+0000","last_peered":"2024-09-12T01:05:27.384500+0000","last_clean":"2024-09-12T01:05:27.384500+0000","last_became_active":"2024-09-12T00:34:52.183769+0000","last_became_peered":"2024-09-12T00:34:52.183769+0000","last_unstale":"2024-09-12T01:05:27.384500+0000","last_undegraded":"2024-09-12T01:05:27.384500+0000","last_fullsized":"2024-09-12T01:05:27.384500+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T01:05:27.384180+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T01:05:27.384180+0000","last_clean_scrub_stamp":"2024-09-12T01:05:27.384180+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:55.187847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'27","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:24.191200+0000","last_change":"2024-09-12T01:05:24.191200+0000","last_active":"2024-09-12T01:05:24.191200+0000","last_peered":"2024-09-12T01:05:24.191200+0000","last_clean":"2024-09-12T01:05:24.191200+0000","last_became_active":"2024-09-12T00:33:10.830931+0000","last_became_peered":"2024-09-12T00:33:10.830931+0000","last_unstale":"2024-09-12T01:05:24.191200+0000","last_undegraded":"2024-09-12T01:05:24.191200+0000","last_fullsized":"2024-09-12T01:05:24.191200+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'27","last_scrub_stamp":"2024-09-12T01:05:24.191028+0000","last_deep_scrub":"268'27","last_deep_scrub_stamp":"2024-09-12T01:05:24.191028+0000","last_clean_scrub_stamp":"2024-09-12T01:05:24.191028+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:31.010155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":90,"num_write":55,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:39.016366+0000","last_change":"2024-09-12T01:05:39.016366+0000","last_active":"2024-09-12T01:05:39.016366+0000","last_peered":"2024-09-12T01:05:39.016366+0000","last_clean":"2024-09-12T01:05:39.016366+0000","last_became_active":"2024-09-12T00:46:09.517353+0000","last_became_peered":"2024-09-12T00:46:09.517353+0000","last_unstale":"2024-09-12T01:05:39.016366+0000","last_undegraded":"2024-09-12T01:05:39.016366+0000","last_fullsized":"2024-09-12T01:05:39.016366+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:39.016159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:39.016159+0000","last_clean_scrub_stamp":"2024-09-12T01:05:39.016159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:43.077357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"268'9","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.856906+0000","last_change":"2024-09-12T01:05:19.856906+0000","last_active":"2024-09-12T01:05:19.856906+0000","last_peered":"2024-09-12T01:05:19.856906+0000","last_clean":"2024-09-12T01:05:19.856906+0000","last_became_active":"2024-09-12T00:34:55.224353+0000","last_became_peered":"2024-09-12T00:34:55.224353+0000","last_unstale":"2024-09-12T01:05:19.856906+0000","last_undegraded":"2024-09-12T01:05:19.856906+0000","last_fullsized":"2024-09-12T01:05:19.856906+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'9","last_scrub_stamp":"2024-09-12T01:05:19.856714+0000","last_deep_scrub":"268'9","last_deep_scrub_stamp":"2024-09-12T01:05:19.856714+0000","last_clean_scrub_stamp":"2024-09-12T01:05:19.856714+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:42.593775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":22530,"num_write":14,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"268'6","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:16.484536+0000","last_change":"2024-09-12T01:05:16.484378+0000","last_active":"2024-09-12T01:05:16.484536+0000","last_peered":"2024-09-12T01:05:16.484536+0000","last_clean":"2024-09-12T01:05:16.484536+0000","last_became_active":"2024-09-12T00:34:52.203625+0000","last_became_peered":"2024-09-12T00:34:52.203625+0000","last_unstale":"2024-09-12T01:05:16.484536+0000","last_undegraded":"2024-09-12T01:05:16.484536+0000","last_fullsized":"2024-09-12T01:05:16.484536+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T01:05:16.484199+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T01:05:16.484199+0000","last_clean_scrub_stamp":"2024-09-12T01:05:16.484199+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:39.312697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10299,"num_write":6,"num_write_kb":5179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'24","reported_seq":119,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:12.783107+0000","last_change":"2024-09-12T01:05:12.783107+0000","last_active":"2024-09-12T01:05:12.783107+0000","last_peered":"2024-09-12T01:05:12.783107+0000","last_clean":"2024-09-12T01:05:12.783107+0000","last_became_active":"2024-09-12T00:33:10.844416+0000","last_became_peered":"2024-09-12T00:33:10.844416+0000","last_unstale":"2024-09-12T01:05:12.783107+0000","last_undegraded":"2024-09-12T01:05:12.783107+0000","last_fullsized":"2024-09-12T01:05:12.783107+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'24","last_scrub_stamp":"2024-09-12T01:05:12.782924+0000","last_deep_scrub":"268'24","last_deep_scrub_stamp":"2024-09-12T01:05:12.782924+0000","last_clean_scrub_stamp":"2024-09-12T01:05:12.782924+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:59.667045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:35.487734+0000","last_change":"2024-09-12T01:05:35.487734+0000","last_active":"2024-09-12T01:05:35.487734+0000","last_peered":"2024-09-12T01:05:35.487734+0000","last_clean":"2024-09-12T01:05:35.487734+0000","last_became_active":"2024-09-12T00:46:09.493808+0000","last_became_peered":"2024-09-12T00:46:09.493808+0000","last_unstale":"2024-09-12T01:05:35.487734+0000","last_undegraded":"2024-09-12T01:05:35.487734+0000","last_fullsized":"2024-09-12T01:05:35.487734+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:35.487553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:35.487553+0000","last_clean_scrub_stamp":"2024-09-12T01:05:35.487553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:01.345463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"268'2","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:30.162390+0000","last_change":"2024-09-12T01:05:30.162390+0000","last_active":"2024-09-12T01:05:30.162390+0000","last_peered":"2024-09-12T01:05:30.162390+0000","last_clean":"2024-09-12T01:05:30.162390+0000","last_became_active":"2024-09-12T00:34:55.233708+0000","last_became_peered":"2024-09-12T00:34:55.233708+0000","last_unstale":"2024-09-12T01:05:30.162390+0000","last_undegraded":"2024-09-12T01:05:30.162390+0000","last_fullsized":"2024-09-12T01:05:30.162390+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:30.162203+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:30.162203+0000","last_clean_scrub_stamp":"2024-09-12T01:05:30.162203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:23.957891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"268'2","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:17.809529+0000","last_change":"2024-09-12T01:05:17.809390+0000","last_active":"2024-09-12T01:05:17.809529+0000","last_peered":"2024-09-12T01:05:17.809529+0000","last_clean":"2024-09-12T01:05:17.809529+0000","last_became_active":"2024-09-12T00:34:52.186234+0000","last_became_peered":"2024-09-12T00:34:52.186234+0000","last_unstale":"2024-09-12T01:05:17.809529+0000","last_undegraded":"2024-09-12T01:05:17.809529+0000","last_fullsized":"2024-09-12T01:05:17.809529+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:17.809194+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:17.809194+0000","last_clean_scrub_stamp":"2024-09-12T01:05:17.809194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:21.580344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'27","reported_seq":135,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:21.384237+0000","last_change":"2024-09-12T01:05:21.383982+0000","last_active":"2024-09-12T01:05:21.384237+0000","last_peered":"2024-09-12T01:05:21.384237+0000","last_clean":"2024-09-12T01:05:21.384237+0000","last_became_active":"2024-09-12T00:33:10.853205+0000","last_became_peered":"2024-09-12T00:33:10.853205+0000","last_unstale":"2024-09-12T01:05:21.384237+0000","last_undegraded":"2024-09-12T01:05:21.384237+0000","last_fullsized":"2024-09-12T01:05:21.384237+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'27","last_scrub_stamp":"2024-09-12T01:05:21.383773+0000","last_deep_scrub":"268'27","last_deep_scrub_stamp":"2024-09-12T01:05:21.383773+0000","last_clean_scrub_stamp":"2024-09-12T01:05:21.383773+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:56.970901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":100,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'373","reported_seq":1028,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.548055+0000","last_change":"2024-09-12T01:04:59.548055+0000","last_active":"2024-09-12T01:04:59.548055+0000","last_peered":"2024-09-12T01:04:59.548055+0000","last_clean":"2024-09-12T01:04:59.548055+0000","last_became_active":"2024-09-12T00:18:22.878117+0000","last_became_peered":"2024-09-12T00:18:22.878117+0000","last_unstale":"2024-09-12T01:04:59.548055+0000","last_undegraded":"2024-09-12T01:04:59.548055+0000","last_fullsized":"2024-09-12T01:04:59.548055+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'373","last_scrub_stamp":"2024-09-12T01:04:59.547794+0000","last_deep_scrub":"268'373","last_deep_scrub_stamp":"2024-09-12T01:04:59.547794+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.547794+0000","objects_scrubbed":10,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:34.105495+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":522,"num_read_kb":62534,"num_write":1202,"num_write_kb":43415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'437","reported_seq":1888,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.460017+0000","last_change":"2024-09-12T01:05:05.459888+0000","last_active":"2024-09-12T01:05:05.460017+0000","last_peered":"2024-09-12T01:05:05.460017+0000","last_clean":"2024-09-12T01:05:05.460017+0000","last_became_active":"2024-09-12T00:18:24.870370+0000","last_became_peered":"2024-09-12T00:18:24.870370+0000","last_unstale":"2024-09-12T01:05:05.460017+0000","last_undegraded":"2024-09-12T01:05:05.460017+0000","last_fullsized":"2024-09-12T01:05:05.460017+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'437","last_scrub_stamp":"2024-09-12T01:05:05.459689+0000","last_deep_scrub":"268'437","last_deep_scrub_stamp":"2024-09-12T01:05:05.459689+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.459689+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:46.800171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2205,"num_read_kb":2060,"num_write":503,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'344","reported_seq":997,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.586245+0000","last_change":"2024-09-12T01:04:52.586245+0000","last_active":"2024-09-12T01:04:52.586245+0000","last_peered":"2024-09-12T01:04:52.586245+0000","last_clean":"2024-09-12T01:04:52.586245+0000","last_became_active":"2024-09-12T00:18:22.845439+0000","last_became_peered":"2024-09-12T00:18:22.845439+0000","last_unstale":"2024-09-12T01:04:52.586245+0000","last_undegraded":"2024-09-12T01:04:52.586245+0000","last_fullsized":"2024-09-12T01:04:52.586245+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'344","last_scrub_stamp":"2024-09-12T01:04:52.586024+0000","last_deep_scrub":"268'344","last_deep_scrub_stamp":"2024-09-12T01:04:52.586024+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.586024+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:26.976158+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079947,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":485,"num_read_kb":5684,"num_write":1011,"num_write_kb":33510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'1351","reported_seq":3047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.531697+0000","last_change":"2024-09-12T01:05:04.531548+0000","last_active":"2024-09-12T01:05:04.531697+0000","last_peered":"2024-09-12T01:05:04.531697+0000","last_clean":"2024-09-12T01:05:04.531697+0000","last_became_active":"2024-09-12T00:18:24.866026+0000","last_became_peered":"2024-09-12T00:18:24.866026+0000","last_unstale":"2024-09-12T01:05:04.531697+0000","last_undegraded":"2024-09-12T01:05:04.531697+0000","last_fullsized":"2024-09-12T01:05:04.531697+0000","mapping_epoch":26,"log_start":"268'1300","ondisk_log_start":"268'1300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1351","last_scrub_stamp":"2024-09-12T01:05:04.531372+0000","last_deep_scrub":"268'1351","last_deep_scrub_stamp":"2024-09-12T01:05:04.531372+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.531372+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":1300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:45.952638+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6196,"num_read_kb":5451,"num_write":1895,"num_write_kb":802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'348","reported_seq":1045,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.215693+0000","last_change":"2024-09-12T01:04:52.215693+0000","last_active":"2024-09-12T01:04:52.215693+0000","last_peered":"2024-09-12T01:04:52.215693+0000","last_clean":"2024-09-12T01:04:52.215693+0000","last_became_active":"2024-09-12T00:18:22.839379+0000","last_became_peered":"2024-09-12T00:18:22.839379+0000","last_unstale":"2024-09-12T01:04:52.215693+0000","last_undegraded":"2024-09-12T01:04:52.215693+0000","last_fullsized":"2024-09-12T01:04:52.215693+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'348","last_scrub_stamp":"2024-09-12T01:04:52.215433+0000","last_deep_scrub":"268'348","last_deep_scrub_stamp":"2024-09-12T01:04:52.215433+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.215433+0000","objects_scrubbed":9,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:02.897096+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1560796,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":569,"num_read_kb":68999,"num_write":1084,"num_write_kb":32744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'870","reported_seq":2684,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:06.211659+0000","last_change":"2024-09-12T01:05:06.211516+0000","last_active":"2024-09-12T01:05:06.211659+0000","last_peered":"2024-09-12T01:05:06.211659+0000","last_clean":"2024-09-12T01:05:06.211659+0000","last_became_active":"2024-09-12T00:18:24.860995+0000","last_became_peered":"2024-09-12T00:18:24.860995+0000","last_unstale":"2024-09-12T01:05:06.211659+0000","last_undegraded":"2024-09-12T01:05:06.211659+0000","last_fullsized":"2024-09-12T01:05:06.211659+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'870","last_scrub_stamp":"2024-09-12T01:05:06.211336+0000","last_deep_scrub":"268'870","last_deep_scrub_stamp":"2024-09-12T01:05:06.211336+0000","last_clean_scrub_stamp":"2024-09-12T01:05:06.211336+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":800,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:09.525854+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4298,"num_read_kb":3905,"num_write":1128,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'339","reported_seq":1004,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.529175+0000","last_change":"2024-09-12T01:04:58.529175+0000","last_active":"2024-09-12T01:04:58.529175+0000","last_peered":"2024-09-12T01:04:58.529175+0000","last_clean":"2024-09-12T01:04:58.529175+0000","last_became_active":"2024-09-12T00:18:55.960413+0000","last_became_peered":"2024-09-12T00:18:55.960413+0000","last_unstale":"2024-09-12T01:04:58.529175+0000","last_undegraded":"2024-09-12T01:04:58.529175+0000","last_fullsized":"2024-09-12T01:04:58.529175+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'339","last_scrub_stamp":"2024-09-12T01:04:58.528952+0000","last_deep_scrub":"268'339","last_deep_scrub_stamp":"2024-09-12T01:04:58.528952+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.528952+0000","objects_scrubbed":7,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:06.429511+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":867046,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":485,"num_read_kb":54980,"num_write":1073,"num_write_kb":32836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'768","reported_seq":2326,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.385763+0000","last_change":"2024-09-12T01:05:02.385618+0000","last_active":"2024-09-12T01:05:02.385763+0000","last_peered":"2024-09-12T01:05:02.385763+0000","last_clean":"2024-09-12T01:05:02.385763+0000","last_became_active":"2024-09-12T00:18:55.955870+0000","last_became_peered":"2024-09-12T00:18:55.955870+0000","last_unstale":"2024-09-12T01:05:02.385763+0000","last_undegraded":"2024-09-12T01:05:02.385763+0000","last_fullsized":"2024-09-12T01:05:02.385763+0000","mapping_epoch":37,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'768","last_scrub_stamp":"2024-09-12T01:05:02.385449+0000","last_deep_scrub":"268'768","last_deep_scrub_stamp":"2024-09-12T01:05:02.385449+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.385449+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:32.646103+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3626,"num_read_kb":3280,"num_write":1010,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'340","reported_seq":978,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.507180+0000","last_change":"2024-09-12T01:04:58.507042+0000","last_active":"2024-09-12T01:04:58.507180+0000","last_peered":"2024-09-12T01:04:58.507180+0000","last_clean":"2024-09-12T01:04:58.507180+0000","last_became_active":"2024-09-12T00:18:22.870564+0000","last_became_peered":"2024-09-12T00:18:22.870564+0000","last_unstale":"2024-09-12T01:04:58.507180+0000","last_undegraded":"2024-09-12T01:04:58.507180+0000","last_fullsized":"2024-09-12T01:04:58.507180+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'340","last_scrub_stamp":"2024-09-12T01:04:58.506853+0000","last_deep_scrub":"268'340","last_deep_scrub_stamp":"2024-09-12T01:04:58.506853+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.506853+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:49.221170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":498,"num_read_kb":32133,"num_write":1040,"num_write_kb":41090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"268'487","reported_seq":2096,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.680342+0000","last_change":"2024-09-12T01:05:01.680342+0000","last_active":"2024-09-12T01:05:01.680342+0000","last_peered":"2024-09-12T01:05:01.680342+0000","last_clean":"2024-09-12T01:05:01.680342+0000","last_became_active":"2024-09-12T00:18:24.846508+0000","last_became_peered":"2024-09-12T00:18:24.846508+0000","last_unstale":"2024-09-12T01:05:01.680342+0000","last_undegraded":"2024-09-12T01:05:01.680342+0000","last_fullsized":"2024-09-12T01:05:01.680342+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'487","last_scrub_stamp":"2024-09-12T01:05:01.680166+0000","last_deep_scrub":"268'487","last_deep_scrub_stamp":"2024-09-12T01:05:01.680166+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.680166+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:35.737714+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2844,"num_read_kb":2655,"num_write":659,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'358","reported_seq":1002,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.546291+0000","last_change":"2024-09-12T01:04:59.546009+0000","last_active":"2024-09-12T01:04:59.546291+0000","last_peered":"2024-09-12T01:04:59.546291+0000","last_clean":"2024-09-12T01:04:59.546291+0000","last_became_active":"2024-09-12T00:18:22.861074+0000","last_became_peered":"2024-09-12T00:18:22.861074+0000","last_unstale":"2024-09-12T01:04:59.546291+0000","last_undegraded":"2024-09-12T01:04:59.546291+0000","last_fullsized":"2024-09-12T01:04:59.546291+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'358","last_scrub_stamp":"2024-09-12T01:04:59.545680+0000","last_deep_scrub":"268'358","last_deep_scrub_stamp":"2024-09-12T01:04:59.545680+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.545680+0000","objects_scrubbed":9,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:21.773761+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":434032,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":541,"num_read_kb":4860,"num_write":1084,"num_write_kb":10925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'1021","reported_seq":2758,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:07.211509+0000","last_change":"2024-09-12T01:05:07.211509+0000","last_active":"2024-09-12T01:05:07.211509+0000","last_peered":"2024-09-12T01:05:07.211509+0000","last_clean":"2024-09-12T01:05:07.211509+0000","last_became_active":"2024-09-12T00:18:24.875913+0000","last_became_peered":"2024-09-12T00:18:24.875913+0000","last_unstale":"2024-09-12T01:05:07.211509+0000","last_undegraded":"2024-09-12T01:05:07.211509+0000","last_fullsized":"2024-09-12T01:05:07.211509+0000","mapping_epoch":26,"log_start":"268'1000","ondisk_log_start":"268'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1021","last_scrub_stamp":"2024-09-12T01:05:07.211320+0000","last_deep_scrub":"268'1021","last_deep_scrub_stamp":"2024-09-12T01:05:07.211320+0000","last_clean_scrub_stamp":"2024-09-12T01:05:07.211320+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":1000,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:52.009817+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4809,"num_read_kb":4259,"num_write":1397,"num_write_kb":538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'291","reported_seq":886,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.436540+0000","last_change":"2024-09-12T01:04:50.436366+0000","last_active":"2024-09-12T01:04:50.436540+0000","last_peered":"2024-09-12T01:04:50.436540+0000","last_clean":"2024-09-12T01:04:50.436540+0000","last_became_active":"2024-09-12T00:19:56.412792+0000","last_became_peered":"2024-09-12T00:19:56.412792+0000","last_unstale":"2024-09-12T01:04:50.436540+0000","last_undegraded":"2024-09-12T01:04:50.436540+0000","last_fullsized":"2024-09-12T01:04:50.436540+0000","mapping_epoch":39,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'291","last_scrub_stamp":"2024-09-12T01:04:50.436147+0000","last_deep_scrub":"268'291","last_deep_scrub_stamp":"2024-09-12T01:04:50.436147+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.436147+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:01.502828+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1343091,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":402,"num_read_kb":40979,"num_write":972,"num_write_kb":28776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"268'468","reported_seq":2055,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:06.510587+0000","last_change":"2024-09-12T01:05:06.510587+0000","last_active":"2024-09-12T01:05:06.510587+0000","last_peered":"2024-09-12T01:05:06.510587+0000","last_clean":"2024-09-12T01:05:06.510587+0000","last_became_active":"2024-09-12T00:18:24.862084+0000","last_became_peered":"2024-09-12T00:18:24.862084+0000","last_unstale":"2024-09-12T01:05:06.510587+0000","last_undegraded":"2024-09-12T01:05:06.510587+0000","last_fullsized":"2024-09-12T01:05:06.510587+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'468","last_scrub_stamp":"2024-09-12T01:05:06.510395+0000","last_deep_scrub":"268'468","last_deep_scrub_stamp":"2024-09-12T01:05:06.510395+0000","last_clean_scrub_stamp":"2024-09-12T01:05:06.510395+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:44.814542+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2471,"num_read_kb":2327,"num_write":538,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2554,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'376","reported_seq":1032,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.132790+0000","last_change":"2024-09-12T01:04:58.132657+0000","last_active":"2024-09-12T01:04:58.132790+0000","last_peered":"2024-09-12T01:04:58.132790+0000","last_clean":"2024-09-12T01:04:58.132790+0000","last_became_active":"2024-09-12T00:18:22.867749+0000","last_became_peered":"2024-09-12T00:18:22.867749+0000","last_unstale":"2024-09-12T01:04:58.132790+0000","last_undegraded":"2024-09-12T01:04:58.132790+0000","last_fullsized":"2024-09-12T01:04:58.132790+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'376","last_scrub_stamp":"2024-09-12T01:04:58.132452+0000","last_deep_scrub":"268'376","last_deep_scrub_stamp":"2024-09-12T01:04:58.132452+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.132452+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:04.893853+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":529,"num_read_kb":6849,"num_write":1205,"num_write_kb":38257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'510","reported_seq":2335,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.460303+0000","last_change":"2024-09-12T01:04:57.460303+0000","last_active":"2024-09-12T01:04:57.460303+0000","last_peered":"2024-09-12T01:04:57.460303+0000","last_clean":"2024-09-12T01:04:57.460303+0000","last_became_active":"2024-09-12T00:18:24.848163+0000","last_became_peered":"2024-09-12T00:18:24.848163+0000","last_unstale":"2024-09-12T01:04:57.460303+0000","last_undegraded":"2024-09-12T01:04:57.460303+0000","last_fullsized":"2024-09-12T01:04:57.460303+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'510","last_scrub_stamp":"2024-09-12T01:04:57.460112+0000","last_deep_scrub":"268'510","last_deep_scrub_stamp":"2024-09-12T01:04:57.460112+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.460112+0000","objects_scrubbed":5,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:50.852262+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2972,"num_read_kb":2819,"num_write":593,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4343,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'486","reported_seq":2150,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.207575+0000","last_change":"2024-09-12T01:05:04.207348+0000","last_active":"2024-09-12T01:05:04.207575+0000","last_peered":"2024-09-12T01:05:04.207575+0000","last_clean":"2024-09-12T01:05:04.207575+0000","last_became_active":"2024-09-12T00:18:24.860744+0000","last_became_peered":"2024-09-12T00:18:24.860744+0000","last_unstale":"2024-09-12T01:05:04.207575+0000","last_undegraded":"2024-09-12T01:05:04.207575+0000","last_fullsized":"2024-09-12T01:05:04.207575+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'486","last_scrub_stamp":"2024-09-12T01:05:04.207119+0000","last_deep_scrub":"268'486","last_deep_scrub_stamp":"2024-09-12T01:05:04.207119+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.207119+0000","objects_scrubbed":2,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:40.036635+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2780,"num_read_kb":2600,"num_write":590,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'313","reported_seq":926,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.505125+0000","last_change":"2024-09-12T01:04:57.505125+0000","last_active":"2024-09-12T01:04:57.505125+0000","last_peered":"2024-09-12T01:04:57.505125+0000","last_clean":"2024-09-12T01:04:57.505125+0000","last_became_active":"2024-09-12T00:18:55.962742+0000","last_became_peered":"2024-09-12T00:18:55.962742+0000","last_unstale":"2024-09-12T01:04:57.505125+0000","last_undegraded":"2024-09-12T01:04:57.505125+0000","last_fullsized":"2024-09-12T01:04:57.505125+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'313","last_scrub_stamp":"2024-09-12T01:04:57.504907+0000","last_deep_scrub":"268'313","last_deep_scrub_stamp":"2024-09-12T01:04:57.504907+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.504907+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:14.933948+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":391,"num_read_kb":39262,"num_write":935,"num_write_kb":33071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'396","reported_seq":1858,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.519805+0000","last_change":"2024-09-12T01:05:03.519644+0000","last_active":"2024-09-12T01:05:03.519805+0000","last_peered":"2024-09-12T01:05:03.519805+0000","last_clean":"2024-09-12T01:05:03.519805+0000","last_became_active":"2024-09-12T00:18:24.872902+0000","last_became_peered":"2024-09-12T00:18:24.872902+0000","last_unstale":"2024-09-12T01:05:03.519805+0000","last_undegraded":"2024-09-12T01:05:03.519805+0000","last_fullsized":"2024-09-12T01:05:03.519805+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'396","last_scrub_stamp":"2024-09-12T01:05:03.519461+0000","last_deep_scrub":"268'396","last_deep_scrub_stamp":"2024-09-12T01:05:03.519461+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.519461+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:35.432511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2097,"num_read_kb":1984,"num_write":437,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'310","reported_seq":929,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.742459+0000","last_change":"2024-09-12T01:04:56.742459+0000","last_active":"2024-09-12T01:04:56.742459+0000","last_peered":"2024-09-12T01:04:56.742459+0000","last_clean":"2024-09-12T01:04:56.742459+0000","last_became_active":"2024-09-12T00:18:22.860078+0000","last_became_peered":"2024-09-12T00:18:22.860078+0000","last_unstale":"2024-09-12T01:04:56.742459+0000","last_undegraded":"2024-09-12T01:04:56.742459+0000","last_fullsized":"2024-09-12T01:04:56.742459+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'310","last_scrub_stamp":"2024-09-12T01:04:56.742239+0000","last_deep_scrub":"268'310","last_deep_scrub_stamp":"2024-09-12T01:04:56.742239+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.742239+0000","objects_scrubbed":5,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:19.067757+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4534636,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":413,"num_read_kb":38650,"num_write":947,"num_write_kb":29439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"268'424","reported_seq":2052,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.546888+0000","last_change":"2024-09-12T01:05:01.546750+0000","last_active":"2024-09-12T01:05:01.546888+0000","last_peered":"2024-09-12T01:05:01.546888+0000","last_clean":"2024-09-12T01:05:01.546888+0000","last_became_active":"2024-09-12T00:18:24.852029+0000","last_became_peered":"2024-09-12T00:18:24.852029+0000","last_unstale":"2024-09-12T01:05:01.546888+0000","last_undegraded":"2024-09-12T01:05:01.546888+0000","last_fullsized":"2024-09-12T01:05:01.546888+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'424","last_scrub_stamp":"2024-09-12T01:05:01.546568+0000","last_deep_scrub":"268'424","last_deep_scrub_stamp":"2024-09-12T01:05:01.546568+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.546568+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:38.718196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2334,"num_read_kb":2233,"num_write":466,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'322","reported_seq":932,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.685245+0000","last_change":"2024-09-12T01:04:51.685245+0000","last_active":"2024-09-12T01:04:51.685245+0000","last_peered":"2024-09-12T01:04:51.685245+0000","last_clean":"2024-09-12T01:04:51.685245+0000","last_became_active":"2024-09-12T00:18:22.862665+0000","last_became_peered":"2024-09-12T00:18:22.862665+0000","last_unstale":"2024-09-12T01:04:51.685245+0000","last_undegraded":"2024-09-12T01:04:51.685245+0000","last_fullsized":"2024-09-12T01:04:51.685245+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'322","last_scrub_stamp":"2024-09-12T01:04:51.685000+0000","last_deep_scrub":"268'322","last_deep_scrub_stamp":"2024-09-12T01:04:51.685000+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.685000+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:57.317903+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079909,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":401,"num_read_kb":22932,"num_write":945,"num_write_kb":21492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'477","reported_seq":2108,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.503805+0000","last_change":"2024-09-12T01:04:54.503805+0000","last_active":"2024-09-12T01:04:54.503805+0000","last_peered":"2024-09-12T01:04:54.503805+0000","last_clean":"2024-09-12T01:04:54.503805+0000","last_became_active":"2024-09-12T00:18:24.849491+0000","last_became_peered":"2024-09-12T00:18:24.849491+0000","last_unstale":"2024-09-12T01:04:54.503805+0000","last_undegraded":"2024-09-12T01:04:54.503805+0000","last_fullsized":"2024-09-12T01:04:54.503805+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'477","last_scrub_stamp":"2024-09-12T01:04:54.503576+0000","last_deep_scrub":"268'477","last_deep_scrub_stamp":"2024-09-12T01:04:54.503576+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.503576+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:40.594497+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2579,"num_read_kb":2421,"num_write":543,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'353","reported_seq":986,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.198312+0000","last_change":"2024-09-12T01:04:51.198312+0000","last_active":"2024-09-12T01:04:51.198312+0000","last_peered":"2024-09-12T01:04:51.198312+0000","last_clean":"2024-09-12T01:04:51.198312+0000","last_became_active":"2024-09-12T00:18:22.856051+0000","last_became_peered":"2024-09-12T00:18:22.856051+0000","last_unstale":"2024-09-12T01:04:51.198312+0000","last_undegraded":"2024-09-12T01:04:51.198312+0000","last_fullsized":"2024-09-12T01:04:51.198312+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'353","last_scrub_stamp":"2024-09-12T01:04:51.198077+0000","last_deep_scrub":"268'353","last_deep_scrub_stamp":"2024-09-12T01:04:51.198077+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.198077+0000","objects_scrubbed":4,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:58.275825+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":458,"num_read_kb":24886,"num_write":1069,"num_write_kb":15091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"268'430","reported_seq":1984,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.486920+0000","last_change":"2024-09-12T01:04:55.486920+0000","last_active":"2024-09-12T01:04:55.486920+0000","last_peered":"2024-09-12T01:04:55.486920+0000","last_clean":"2024-09-12T01:04:55.486920+0000","last_became_active":"2024-09-12T00:18:24.853796+0000","last_became_peered":"2024-09-12T00:18:24.853796+0000","last_unstale":"2024-09-12T01:04:55.486920+0000","last_undegraded":"2024-09-12T01:04:55.486920+0000","last_fullsized":"2024-09-12T01:04:55.486920+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'430","last_scrub_stamp":"2024-09-12T01:04:55.486732+0000","last_deep_scrub":"268'430","last_deep_scrub_stamp":"2024-09-12T01:04:55.486732+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.486732+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:53.536416+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2472,"num_read_kb":2322,"num_write":521,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2265,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'333","reported_seq":1094,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.249250+0000","last_change":"2024-09-12T01:04:54.249250+0000","last_active":"2024-09-12T01:04:54.249250+0000","last_peered":"2024-09-12T01:04:54.249250+0000","last_clean":"2024-09-12T01:04:54.249250+0000","last_became_active":"2024-09-12T00:18:22.834904+0000","last_became_peered":"2024-09-12T00:18:22.834904+0000","last_unstale":"2024-09-12T01:04:54.249250+0000","last_undegraded":"2024-09-12T01:04:54.249250+0000","last_fullsized":"2024-09-12T01:04:54.249250+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'333","last_scrub_stamp":"2024-09-12T01:04:54.249011+0000","last_deep_scrub":"268'333","last_deep_scrub_stamp":"2024-09-12T01:04:54.249011+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.249011+0000","objects_scrubbed":10,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:24.413614+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":584,"num_read_kb":49706,"num_write":1054,"num_write_kb":43110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'505","reported_seq":2060,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.180476+0000","last_change":"2024-09-12T01:05:05.180476+0000","last_active":"2024-09-12T01:05:05.180476+0000","last_peered":"2024-09-12T01:05:05.180476+0000","last_clean":"2024-09-12T01:05:05.180476+0000","last_became_active":"2024-09-12T00:18:24.875112+0000","last_became_peered":"2024-09-12T00:18:24.875112+0000","last_unstale":"2024-09-12T01:05:05.180476+0000","last_undegraded":"2024-09-12T01:05:05.180476+0000","last_fullsized":"2024-09-12T01:05:05.180476+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'505","last_scrub_stamp":"2024-09-12T01:05:05.180281+0000","last_deep_scrub":"268'505","last_deep_scrub_stamp":"2024-09-12T01:05:05.180281+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.180281+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:44.845813+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2595,"num_read_kb":2402,"num_write":619,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":944,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'380","reported_seq":1079,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.292423+0000","last_change":"2024-09-12T01:04:57.292248+0000","last_active":"2024-09-12T01:04:57.292423+0000","last_peered":"2024-09-12T01:04:57.292423+0000","last_clean":"2024-09-12T01:04:57.292423+0000","last_became_active":"2024-09-12T00:18:22.841069+0000","last_became_peered":"2024-09-12T00:18:22.841069+0000","last_unstale":"2024-09-12T01:04:57.292423+0000","last_undegraded":"2024-09-12T01:04:57.292423+0000","last_fullsized":"2024-09-12T01:04:57.292423+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'380","last_scrub_stamp":"2024-09-12T01:04:57.292057+0000","last_deep_scrub":"268'380","last_deep_scrub_stamp":"2024-09-12T01:04:57.292057+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.292057+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:30.261493+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":685,"num_read_kb":23761,"num_write":1283,"num_write_kb":30294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'128","reported_seq":660,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:22.172702+0000","last_change":"2024-09-12T01:05:22.172702+0000","last_active":"2024-09-12T01:05:22.172702+0000","last_peered":"2024-09-12T01:05:22.172702+0000","last_clean":"2024-09-12T01:05:22.172702+0000","last_became_active":"2024-09-12T00:18:32.893410+0000","last_became_peered":"2024-09-12T00:18:32.893410+0000","last_unstale":"2024-09-12T01:05:22.172702+0000","last_undegraded":"2024-09-12T01:05:22.172702+0000","last_fullsized":"2024-09-12T01:05:22.172702+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'128","last_scrub_stamp":"2024-09-12T01:05:22.172513+0000","last_deep_scrub":"268'128","last_deep_scrub_stamp":"2024-09-12T01:05:22.172513+0000","last_clean_scrub_stamp":"2024-09-12T01:05:22.172513+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:42.436426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":200,"num_read_kb":180,"num_write":310,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'428","reported_seq":2039,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.119224+0000","last_change":"2024-09-12T01:05:00.119112+0000","last_active":"2024-09-12T01:05:00.119224+0000","last_peered":"2024-09-12T01:05:00.119224+0000","last_clean":"2024-09-12T01:05:00.119224+0000","last_became_active":"2024-09-12T00:18:24.862963+0000","last_became_peered":"2024-09-12T00:18:24.862963+0000","last_unstale":"2024-09-12T01:05:00.119224+0000","last_undegraded":"2024-09-12T01:05:00.119224+0000","last_fullsized":"2024-09-12T01:05:00.119224+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'428","last_scrub_stamp":"2024-09-12T01:05:00.118957+0000","last_deep_scrub":"268'428","last_deep_scrub_stamp":"2024-09-12T01:05:00.118957+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.118957+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:58.043360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2444,"num_read_kb":2313,"num_write":504,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"268'339","reported_seq":992,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.462684+0000","last_change":"2024-09-12T01:04:54.462526+0000","last_active":"2024-09-12T01:04:54.462684+0000","last_peered":"2024-09-12T01:04:54.462684+0000","last_clean":"2024-09-12T01:04:54.462684+0000","last_became_active":"2024-09-12T00:18:55.954978+0000","last_became_peered":"2024-09-12T00:18:55.954978+0000","last_unstale":"2024-09-12T01:04:54.462684+0000","last_undegraded":"2024-09-12T01:04:54.462684+0000","last_fullsized":"2024-09-12T01:04:54.462684+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'339","last_scrub_stamp":"2024-09-12T01:04:54.462327+0000","last_deep_scrub":"268'339","last_deep_scrub_stamp":"2024-09-12T01:04:54.462327+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.462327+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:39.747015+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":485,"num_read_kb":26304,"num_write":1090,"num_write_kb":30933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.560759+0000","last_change":"2024-09-12T01:05:09.560759+0000","last_active":"2024-09-12T01:05:09.560759+0000","last_peered":"2024-09-12T01:05:09.560759+0000","last_clean":"2024-09-12T01:05:09.560759+0000","last_became_active":"2024-09-12T00:18:26.871803+0000","last_became_peered":"2024-09-12T00:18:26.871803+0000","last_unstale":"2024-09-12T01:05:09.560759+0000","last_undegraded":"2024-09-12T01:05:09.560759+0000","last_fullsized":"2024-09-12T01:05:09.560759+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:09.560580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:09.560580+0000","last_clean_scrub_stamp":"2024-09-12T01:05:09.560580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:59.747447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'346","reported_seq":971,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:08.236524+0000","last_change":"2024-09-12T01:05:08.236524+0000","last_active":"2024-09-12T01:05:08.236524+0000","last_peered":"2024-09-12T01:05:08.236524+0000","last_clean":"2024-09-12T01:05:08.236524+0000","last_became_active":"2024-09-12T00:18:28.874861+0000","last_became_peered":"2024-09-12T00:18:28.874861+0000","last_unstale":"2024-09-12T01:05:08.236524+0000","last_undegraded":"2024-09-12T01:05:08.236524+0000","last_fullsized":"2024-09-12T01:05:08.236524+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'346","last_scrub_stamp":"2024-09-12T01:05:08.236282+0000","last_deep_scrub":"268'346","last_deep_scrub_stamp":"2024-09-12T01:05:08.236282+0000","last_clean_scrub_stamp":"2024-09-12T01:05:08.236282+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:46.275921+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51345,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":553,"num_read_kb":1147,"num_write":436,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:17.409971+0000","last_change":"2024-09-12T01:05:17.409971+0000","last_active":"2024-09-12T01:05:17.409971+0000","last_peered":"2024-09-12T01:05:17.409971+0000","last_clean":"2024-09-12T01:05:17.409971+0000","last_became_active":"2024-09-12T00:18:30.893886+0000","last_became_peered":"2024-09-12T00:18:30.893886+0000","last_unstale":"2024-09-12T01:05:17.409971+0000","last_undegraded":"2024-09-12T01:05:17.409971+0000","last_fullsized":"2024-09-12T01:05:17.409971+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:17.409798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:17.409798+0000","last_clean_scrub_stamp":"2024-09-12T01:05:17.409798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:36.218457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'2430","reported_seq":4333,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:22.557774+0000","last_change":"2024-09-12T01:05:22.557774+0000","last_active":"2024-09-12T01:05:22.557774+0000","last_peered":"2024-09-12T01:05:22.557774+0000","last_clean":"2024-09-12T01:05:22.557774+0000","last_became_active":"2024-09-12T00:18:32.899168+0000","last_became_peered":"2024-09-12T00:18:32.899168+0000","last_unstale":"2024-09-12T01:05:22.557774+0000","last_undegraded":"2024-09-12T01:05:22.557774+0000","last_fullsized":"2024-09-12T01:05:22.557774+0000","mapping_epoch":34,"log_start":"268'2400","ondisk_log_start":"268'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2430","last_scrub_stamp":"2024-09-12T01:05:22.557549+0000","last_deep_scrub":"268'2430","last_deep_scrub_stamp":"2024-09-12T01:05:22.557549+0000","last_clean_scrub_stamp":"2024-09-12T01:05:22.557549+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":2400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:32.205803+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":628,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6111,"num_read_kb":6108,"num_write":4843,"num_write_kb":1788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'1291","reported_seq":2845,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.595104+0000","last_change":"2024-09-12T01:05:02.595104+0000","last_active":"2024-09-12T01:05:02.595104+0000","last_peered":"2024-09-12T01:05:02.595104+0000","last_clean":"2024-09-12T01:05:02.595104+0000","last_became_active":"2024-09-12T00:18:24.869219+0000","last_became_peered":"2024-09-12T00:18:24.869219+0000","last_unstale":"2024-09-12T01:05:02.595104+0000","last_undegraded":"2024-09-12T01:05:02.595104+0000","last_fullsized":"2024-09-12T01:05:02.595104+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1291","last_scrub_stamp":"2024-09-12T01:05:02.594874+0000","last_deep_scrub":"268'1291","last_deep_scrub_stamp":"2024-09-12T01:05:02.594874+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.594874+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":1200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:11.005405+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5815,"num_read_kb":5070,"num_write":1809,"num_write_kb":816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'273","reported_seq":851,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:46.448230+0000","last_change":"2024-09-12T01:04:46.448096+0000","last_active":"2024-09-12T01:04:46.448230+0000","last_peered":"2024-09-12T01:04:46.448230+0000","last_clean":"2024-09-12T01:04:46.448230+0000","last_became_active":"2024-09-12T00:18:55.953363+0000","last_became_peered":"2024-09-12T00:18:55.953363+0000","last_unstale":"2024-09-12T01:04:46.448230+0000","last_undegraded":"2024-09-12T01:04:46.448230+0000","last_fullsized":"2024-09-12T01:04:46.448230+0000","mapping_epoch":37,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'273","last_scrub_stamp":"2024-09-12T01:04:46.447974+0000","last_deep_scrub":"268'273","last_deep_scrub_stamp":"2024-09-12T01:04:46.447974+0000","last_clean_scrub_stamp":"2024-09-12T01:04:46.447974+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:00.461692+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079954,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":346,"num_read_kb":12333,"num_write":862,"num_write_kb":28931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.054015+0000","last_change":"2024-09-12T01:05:09.053858+0000","last_active":"2024-09-12T01:05:09.054015+0000","last_peered":"2024-09-12T01:05:09.054015+0000","last_clean":"2024-09-12T01:05:09.054015+0000","last_became_active":"2024-09-12T00:18:26.848272+0000","last_became_peered":"2024-09-12T00:18:26.848272+0000","last_unstale":"2024-09-12T01:05:09.054015+0000","last_undegraded":"2024-09-12T01:05:09.054015+0000","last_fullsized":"2024-09-12T01:05:09.054015+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:09.053670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:09.053670+0000","last_clean_scrub_stamp":"2024-09-12T01:05:09.053670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:19.675861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'94","reported_seq":638,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.224917+0000","last_change":"2024-09-12T01:05:14.224917+0000","last_active":"2024-09-12T01:05:14.224917+0000","last_peered":"2024-09-12T01:05:14.224917+0000","last_clean":"2024-09-12T01:05:14.224917+0000","last_became_active":"2024-09-12T00:18:28.882630+0000","last_became_peered":"2024-09-12T00:18:28.882630+0000","last_unstale":"2024-09-12T01:05:14.224917+0000","last_undegraded":"2024-09-12T01:05:14.224917+0000","last_fullsized":"2024-09-12T01:05:14.224917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'94","last_scrub_stamp":"2024-09-12T01:05:14.224707+0000","last_deep_scrub":"268'94","last_deep_scrub_stamp":"2024-09-12T01:05:14.224707+0000","last_clean_scrub_stamp":"2024-09-12T01:05:14.224707+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:39.732375+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":98,"num_write":70,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:21.130425+0000","last_change":"2024-09-12T01:05:21.130425+0000","last_active":"2024-09-12T01:05:21.130425+0000","last_peered":"2024-09-12T01:05:21.130425+0000","last_clean":"2024-09-12T01:05:21.130425+0000","last_became_active":"2024-09-12T00:18:30.900908+0000","last_became_peered":"2024-09-12T00:18:30.900908+0000","last_unstale":"2024-09-12T01:05:21.130425+0000","last_undegraded":"2024-09-12T01:05:21.130425+0000","last_fullsized":"2024-09-12T01:05:21.130425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:21.130241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:21.130241+0000","last_clean_scrub_stamp":"2024-09-12T01:05:21.130241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:12.810251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'125","reported_seq":640,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:21.065294+0000","last_change":"2024-09-12T01:05:21.065203+0000","last_active":"2024-09-12T01:05:21.065294+0000","last_peered":"2024-09-12T01:05:21.065294+0000","last_clean":"2024-09-12T01:05:21.065294+0000","last_became_active":"2024-09-12T00:18:32.909547+0000","last_became_peered":"2024-09-12T00:18:32.909547+0000","last_unstale":"2024-09-12T01:05:21.065294+0000","last_undegraded":"2024-09-12T01:05:21.065294+0000","last_fullsized":"2024-09-12T01:05:21.065294+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'125","last_scrub_stamp":"2024-09-12T01:05:21.065082+0000","last_deep_scrub":"268'125","last_deep_scrub_stamp":"2024-09-12T01:05:21.065082+0000","last_clean_scrub_stamp":"2024-09-12T01:05:21.065082+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:04.170768+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":128,"num_write":294,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'1255","reported_seq":2907,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.243155+0000","last_change":"2024-09-12T01:04:55.243155+0000","last_active":"2024-09-12T01:04:55.243155+0000","last_peered":"2024-09-12T01:04:55.243155+0000","last_clean":"2024-09-12T01:04:55.243155+0000","last_became_active":"2024-09-12T00:18:24.859237+0000","last_became_peered":"2024-09-12T00:18:24.859237+0000","last_unstale":"2024-09-12T01:04:55.243155+0000","last_undegraded":"2024-09-12T01:04:55.243155+0000","last_fullsized":"2024-09-12T01:04:55.243155+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1255","last_scrub_stamp":"2024-09-12T01:04:55.242968+0000","last_deep_scrub":"268'1255","last_deep_scrub_stamp":"2024-09-12T01:04:55.242968+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.242968+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:13.838468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5766,"num_read_kb":5095,"num_write":1782,"num_write_kb":773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'386","reported_seq":1113,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.459313+0000","last_change":"2024-09-12T01:04:52.459156+0000","last_active":"2024-09-12T01:04:52.459313+0000","last_peered":"2024-09-12T01:04:52.459313+0000","last_clean":"2024-09-12T01:04:52.459313+0000","last_became_active":"2024-09-12T00:18:22.873262+0000","last_became_peered":"2024-09-12T00:18:22.873262+0000","last_unstale":"2024-09-12T01:04:52.459313+0000","last_undegraded":"2024-09-12T01:04:52.459313+0000","last_fullsized":"2024-09-12T01:04:52.459313+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'386","last_scrub_stamp":"2024-09-12T01:04:52.458890+0000","last_deep_scrub":"268'386","last_deep_scrub_stamp":"2024-09-12T01:04:52.458890+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.458890+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:38.488860+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":606,"num_read_kb":24526,"num_write":1220,"num_write_kb":41630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:10.016844+0000","last_change":"2024-09-12T01:05:10.016844+0000","last_active":"2024-09-12T01:05:10.016844+0000","last_peered":"2024-09-12T01:05:10.016844+0000","last_clean":"2024-09-12T01:05:10.016844+0000","last_became_active":"2024-09-12T00:18:26.855348+0000","last_became_peered":"2024-09-12T00:18:26.855348+0000","last_unstale":"2024-09-12T01:05:10.016844+0000","last_undegraded":"2024-09-12T01:05:10.016844+0000","last_fullsized":"2024-09-12T01:05:10.016844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:10.016740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:10.016740+0000","last_clean_scrub_stamp":"2024-09-12T01:05:10.016740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:03.375637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'125","reported_seq":686,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.456078+0000","last_change":"2024-09-12T01:05:03.455781+0000","last_active":"2024-09-12T01:05:03.456078+0000","last_peered":"2024-09-12T01:05:03.456078+0000","last_clean":"2024-09-12T01:05:03.456078+0000","last_became_active":"2024-09-12T00:18:28.884722+0000","last_became_peered":"2024-09-12T00:18:28.884722+0000","last_unstale":"2024-09-12T01:05:03.456078+0000","last_undegraded":"2024-09-12T01:05:03.456078+0000","last_fullsized":"2024-09-12T01:05:03.456078+0000","mapping_epoch":30,"log_start":"268'100","ondisk_log_start":"268'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'125","last_scrub_stamp":"2024-09-12T01:05:03.455518+0000","last_deep_scrub":"268'125","last_deep_scrub_stamp":"2024-09-12T01:05:03.455518+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.455518+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:28.693704+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":98,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'785","reported_seq":4751,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:16.426530+0000","last_change":"2024-09-12T01:05:16.426530+0000","last_active":"2024-09-12T01:05:16.426530+0000","last_peered":"2024-09-12T01:05:16.426530+0000","last_clean":"2024-09-12T01:05:16.426530+0000","last_became_active":"2024-09-12T00:18:30.893739+0000","last_became_peered":"2024-09-12T00:18:30.893739+0000","last_unstale":"2024-09-12T01:05:16.426530+0000","last_undegraded":"2024-09-12T01:05:16.426530+0000","last_fullsized":"2024-09-12T01:05:16.426530+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'785","last_scrub_stamp":"2024-09-12T01:05:16.426339+0000","last_deep_scrub":"268'785","last_deep_scrub_stamp":"2024-09-12T01:05:16.426339+0000","last_clean_scrub_stamp":"2024-09-12T01:05:16.426339+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:12.363363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'213","reported_seq":1057,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:23.179811+0000","last_change":"2024-09-12T01:05:23.179674+0000","last_active":"2024-09-12T01:05:23.179811+0000","last_peered":"2024-09-12T01:05:23.179811+0000","last_clean":"2024-09-12T01:05:23.179811+0000","last_became_active":"2024-09-12T00:18:32.884130+0000","last_became_peered":"2024-09-12T00:18:32.884130+0000","last_unstale":"2024-09-12T01:05:23.179811+0000","last_undegraded":"2024-09-12T01:05:23.179811+0000","last_fullsized":"2024-09-12T01:05:23.179811+0000","mapping_epoch":34,"log_start":"268'201","ondisk_log_start":"268'201","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'213","last_scrub_stamp":"2024-09-12T01:05:23.179469+0000","last_deep_scrub":"268'213","last_deep_scrub_stamp":"2024-09-12T01:05:23.179469+0000","last_clean_scrub_stamp":"2024-09-12T01:05:23.179469+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":201,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:35.435066+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":639,"num_read_kb":629,"num_write":484,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'895","reported_seq":2632,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.033355+0000","last_change":"2024-09-12T01:05:02.033355+0000","last_active":"2024-09-12T01:05:02.033355+0000","last_peered":"2024-09-12T01:05:02.033355+0000","last_clean":"2024-09-12T01:05:02.033355+0000","last_became_active":"2024-09-12T00:18:24.868103+0000","last_became_peered":"2024-09-12T00:18:24.868103+0000","last_unstale":"2024-09-12T01:05:02.033355+0000","last_undegraded":"2024-09-12T01:05:02.033355+0000","last_fullsized":"2024-09-12T01:05:02.033355+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'895","last_scrub_stamp":"2024-09-12T01:05:02.033166+0000","last_deep_scrub":"268'895","last_deep_scrub_stamp":"2024-09-12T01:05:02.033166+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.033166+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":800,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:53.892778+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4419,"num_read_kb":4003,"num_write":1187,"num_write_kb":433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":709,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'320","reported_seq":946,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.711337+0000","last_change":"2024-09-12T01:04:49.711181+0000","last_active":"2024-09-12T01:04:49.711337+0000","last_peered":"2024-09-12T01:04:49.711337+0000","last_clean":"2024-09-12T01:04:49.711337+0000","last_became_active":"2024-09-12T00:18:22.850530+0000","last_became_peered":"2024-09-12T00:18:22.850530+0000","last_unstale":"2024-09-12T01:04:49.711337+0000","last_undegraded":"2024-09-12T01:04:49.711337+0000","last_fullsized":"2024-09-12T01:04:49.711337+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'320","last_scrub_stamp":"2024-09-12T01:04:49.710990+0000","last_deep_scrub":"268'320","last_deep_scrub_stamp":"2024-09-12T01:04:49.710990+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.710990+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:12.435073+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263200,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":460,"num_read_kb":6949,"num_write":1090,"num_write_kb":36294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:10.595358+0000","last_change":"2024-09-12T01:05:10.595358+0000","last_active":"2024-09-12T01:05:10.595358+0000","last_peered":"2024-09-12T01:05:10.595358+0000","last_clean":"2024-09-12T01:05:10.595358+0000","last_became_active":"2024-09-12T00:18:26.867729+0000","last_became_peered":"2024-09-12T00:18:26.867729+0000","last_unstale":"2024-09-12T01:05:10.595358+0000","last_undegraded":"2024-09-12T01:05:10.595358+0000","last_fullsized":"2024-09-12T01:05:10.595358+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:10.595177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:10.595177+0000","last_clean_scrub_stamp":"2024-09-12T01:05:10.595177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:11.351936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'269","reported_seq":852,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.440753+0000","last_change":"2024-09-12T01:05:13.440753+0000","last_active":"2024-09-12T01:05:13.440753+0000","last_peered":"2024-09-12T01:05:13.440753+0000","last_clean":"2024-09-12T01:05:13.440753+0000","last_became_active":"2024-09-12T00:18:28.884779+0000","last_became_peered":"2024-09-12T00:18:28.884779+0000","last_unstale":"2024-09-12T01:05:13.440753+0000","last_undegraded":"2024-09-12T01:05:13.440753+0000","last_fullsized":"2024-09-12T01:05:13.440753+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'269","last_scrub_stamp":"2024-09-12T01:05:13.440552+0000","last_deep_scrub":"268'269","last_deep_scrub_stamp":"2024-09-12T01:05:13.440552+0000","last_clean_scrub_stamp":"2024-09-12T01:05:13.440552+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:53.485878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49225,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":1009,"num_write":358,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'817","reported_seq":2296,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:21.083036+0000","last_change":"2024-09-12T01:05:21.083036+0000","last_active":"2024-09-12T01:05:21.083036+0000","last_peered":"2024-09-12T01:05:21.083036+0000","last_clean":"2024-09-12T01:05:21.083036+0000","last_became_active":"2024-09-12T00:18:30.894642+0000","last_became_peered":"2024-09-12T00:18:30.894642+0000","last_unstale":"2024-09-12T01:05:21.083036+0000","last_undegraded":"2024-09-12T01:05:21.083036+0000","last_fullsized":"2024-09-12T01:05:21.083036+0000","mapping_epoch":32,"log_start":"268'800","ondisk_log_start":"268'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'817","last_scrub_stamp":"2024-09-12T01:05:21.082861+0000","last_deep_scrub":"268'817","last_deep_scrub_stamp":"2024-09-12T01:05:21.082861+0000","last_clean_scrub_stamp":"2024-09-12T01:05:21.082861+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:43.763014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'478","reported_seq":2090,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.519654+0000","last_change":"2024-09-12T01:05:00.519507+0000","last_active":"2024-09-12T01:05:00.519654+0000","last_peered":"2024-09-12T01:05:00.519654+0000","last_clean":"2024-09-12T01:05:00.519654+0000","last_became_active":"2024-09-12T00:18:24.869435+0000","last_became_peered":"2024-09-12T00:18:24.869435+0000","last_unstale":"2024-09-12T01:05:00.519654+0000","last_undegraded":"2024-09-12T01:05:00.519654+0000","last_fullsized":"2024-09-12T01:05:00.519654+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'478","last_scrub_stamp":"2024-09-12T01:05:00.519326+0000","last_deep_scrub":"268'478","last_deep_scrub_stamp":"2024-09-12T01:05:00.519326+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.519326+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:06.717819+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2569,"num_read_kb":2408,"num_write":545,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2278,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'380","reported_seq":1017,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.422656+0000","last_change":"2024-09-12T01:04:53.422509+0000","last_active":"2024-09-12T01:04:53.422656+0000","last_peered":"2024-09-12T01:04:53.422656+0000","last_clean":"2024-09-12T01:04:53.422656+0000","last_became_active":"2024-09-12T00:18:22.877327+0000","last_became_peered":"2024-09-12T00:18:22.877327+0000","last_unstale":"2024-09-12T01:04:53.422656+0000","last_undegraded":"2024-09-12T01:04:53.422656+0000","last_fullsized":"2024-09-12T01:04:53.422656+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'380","last_scrub_stamp":"2024-09-12T01:04:53.422308+0000","last_deep_scrub":"268'380","last_deep_scrub_stamp":"2024-09-12T01:04:53.422308+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.422308+0000","objects_scrubbed":7,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:37.542577+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170146,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":498,"num_read_kb":23147,"num_write":1077,"num_write_kb":55226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.519808+0000","last_change":"2024-09-12T01:05:05.519685+0000","last_active":"2024-09-12T01:05:05.519808+0000","last_peered":"2024-09-12T01:05:05.519808+0000","last_clean":"2024-09-12T01:05:05.519808+0000","last_became_active":"2024-09-12T00:18:26.874638+0000","last_became_peered":"2024-09-12T00:18:26.874638+0000","last_unstale":"2024-09-12T01:05:05.519808+0000","last_undegraded":"2024-09-12T01:05:05.519808+0000","last_fullsized":"2024-09-12T01:05:05.519808+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:05.519508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:05.519508+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.519508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:08.182181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'345","reported_seq":972,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.584867+0000","last_change":"2024-09-12T01:05:13.584867+0000","last_active":"2024-09-12T01:05:13.584867+0000","last_peered":"2024-09-12T01:05:13.584867+0000","last_clean":"2024-09-12T01:05:13.584867+0000","last_became_active":"2024-09-12T00:18:28.895950+0000","last_became_peered":"2024-09-12T00:18:28.895950+0000","last_unstale":"2024-09-12T01:05:13.584867+0000","last_undegraded":"2024-09-12T01:05:13.584867+0000","last_fullsized":"2024-09-12T01:05:13.584867+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'345","last_scrub_stamp":"2024-09-12T01:05:13.584649+0000","last_deep_scrub":"268'345","last_deep_scrub_stamp":"2024-09-12T01:05:13.584649+0000","last_clean_scrub_stamp":"2024-09-12T01:05:13.584649+0000","objects_scrubbed":10,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:19.236652+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19722,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":538,"num_read_kb":1043,"num_write":414,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:07.582029+0000","last_change":"2024-09-12T01:05:07.581890+0000","last_active":"2024-09-12T01:05:07.582029+0000","last_peered":"2024-09-12T01:05:07.582029+0000","last_clean":"2024-09-12T01:05:07.582029+0000","last_became_active":"2024-09-12T00:18:30.874074+0000","last_became_peered":"2024-09-12T00:18:30.874074+0000","last_unstale":"2024-09-12T01:05:07.582029+0000","last_undegraded":"2024-09-12T01:05:07.582029+0000","last_fullsized":"2024-09-12T01:05:07.582029+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:07.581718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:07.581718+0000","last_clean_scrub_stamp":"2024-09-12T01:05:07.581718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:16.962248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'556","reported_seq":1378,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:18.539562+0000","last_change":"2024-09-12T01:05:18.539562+0000","last_active":"2024-09-12T01:05:18.539562+0000","last_peered":"2024-09-12T01:05:18.539562+0000","last_clean":"2024-09-12T01:05:18.539562+0000","last_became_active":"2024-09-12T00:18:32.899046+0000","last_became_peered":"2024-09-12T00:18:32.899046+0000","last_unstale":"2024-09-12T01:05:18.539562+0000","last_undegraded":"2024-09-12T01:05:18.539562+0000","last_fullsized":"2024-09-12T01:05:18.539562+0000","mapping_epoch":34,"log_start":"268'500","ondisk_log_start":"268'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'556","last_scrub_stamp":"2024-09-12T01:05:18.539369+0000","last_deep_scrub":"268'556","last_deep_scrub_stamp":"2024-09-12T01:05:18.539369+0000","last_clean_scrub_stamp":"2024-09-12T01:05:18.539369+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:42.569213+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1268,"num_read_kb":1267,"num_write":1132,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'483","reported_seq":2101,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.135576+0000","last_change":"2024-09-12T01:04:54.135439+0000","last_active":"2024-09-12T01:04:54.135576+0000","last_peered":"2024-09-12T01:04:54.135576+0000","last_clean":"2024-09-12T01:04:54.135576+0000","last_became_active":"2024-09-12T00:18:24.861455+0000","last_became_peered":"2024-09-12T00:18:24.861455+0000","last_unstale":"2024-09-12T01:04:54.135576+0000","last_undegraded":"2024-09-12T01:04:54.135576+0000","last_fullsized":"2024-09-12T01:04:54.135576+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'483","last_scrub_stamp":"2024-09-12T01:04:54.135256+0000","last_deep_scrub":"268'483","last_deep_scrub_stamp":"2024-09-12T01:04:54.135256+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.135256+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:48.039409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2490,"num_read_kb":2350,"num_write":569,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'372","reported_seq":1036,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.432841+0000","last_change":"2024-09-12T01:04:51.432703+0000","last_active":"2024-09-12T01:04:51.432841+0000","last_peered":"2024-09-12T01:04:51.432841+0000","last_clean":"2024-09-12T01:04:51.432841+0000","last_became_active":"2024-09-12T00:18:22.871330+0000","last_became_peered":"2024-09-12T00:18:22.871330+0000","last_unstale":"2024-09-12T01:04:51.432841+0000","last_undegraded":"2024-09-12T01:04:51.432841+0000","last_fullsized":"2024-09-12T01:04:51.432841+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'372","last_scrub_stamp":"2024-09-12T01:04:51.432478+0000","last_deep_scrub":"268'372","last_deep_scrub_stamp":"2024-09-12T01:04:51.432478+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.432478+0000","objects_scrubbed":7,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:00.323028+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22053,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":541,"num_read_kb":9754,"num_write":1101,"num_write_kb":25837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"268'4","reported_seq":995,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.419572+0000","last_change":"2024-09-12T01:04:59.419318+0000","last_active":"2024-09-12T01:04:59.419572+0000","last_peered":"2024-09-12T01:04:59.419572+0000","last_clean":"2024-09-12T01:04:59.419572+0000","last_became_active":"2024-09-12T00:18:26.858529+0000","last_became_peered":"2024-09-12T00:18:26.858529+0000","last_unstale":"2024-09-12T01:04:59.419572+0000","last_undegraded":"2024-09-12T01:04:59.419572+0000","last_fullsized":"2024-09-12T01:04:59.419572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:04:59.419081+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:04:59.419081+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.419081+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:54.969136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'291","reported_seq":884,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:11.045156+0000","last_change":"2024-09-12T01:05:11.045026+0000","last_active":"2024-09-12T01:05:11.045156+0000","last_peered":"2024-09-12T01:05:11.045156+0000","last_clean":"2024-09-12T01:05:11.045156+0000","last_became_active":"2024-09-12T00:18:28.895521+0000","last_became_peered":"2024-09-12T00:18:28.895521+0000","last_unstale":"2024-09-12T01:05:11.045156+0000","last_undegraded":"2024-09-12T01:05:11.045156+0000","last_fullsized":"2024-09-12T01:05:11.045156+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'291","last_scrub_stamp":"2024-09-12T01:05:11.044839+0000","last_deep_scrub":"268'291","last_deep_scrub_stamp":"2024-09-12T01:05:11.044839+0000","last_clean_scrub_stamp":"2024-09-12T01:05:11.044839+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:01.971620+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":471,"num_read_kb":1097,"num_write":388,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:22.076868+0000","last_change":"2024-09-12T01:05:22.076868+0000","last_active":"2024-09-12T01:05:22.076868+0000","last_peered":"2024-09-12T01:05:22.076868+0000","last_clean":"2024-09-12T01:05:22.076868+0000","last_became_active":"2024-09-12T00:18:30.905601+0000","last_became_peered":"2024-09-12T00:18:30.905601+0000","last_unstale":"2024-09-12T01:05:22.076868+0000","last_undegraded":"2024-09-12T01:05:22.076868+0000","last_fullsized":"2024-09-12T01:05:22.076868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:22.076639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:22.076639+0000","last_clean_scrub_stamp":"2024-09-12T01:05:22.076639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:49.872299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'124","reported_seq":622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.771180+0000","last_change":"2024-09-12T01:05:09.771180+0000","last_active":"2024-09-12T01:05:09.771180+0000","last_peered":"2024-09-12T01:05:09.771180+0000","last_clean":"2024-09-12T01:05:09.771180+0000","last_became_active":"2024-09-12T00:18:32.899284+0000","last_became_peered":"2024-09-12T00:18:32.899284+0000","last_unstale":"2024-09-12T01:05:09.771180+0000","last_undegraded":"2024-09-12T01:05:09.771180+0000","last_fullsized":"2024-09-12T01:05:09.771180+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'124","last_scrub_stamp":"2024-09-12T01:05:09.771002+0000","last_deep_scrub":"268'124","last_deep_scrub_stamp":"2024-09-12T01:05:09.771002+0000","last_clean_scrub_stamp":"2024-09-12T01:05:09.771002+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:14.512976+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":847,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":95,"num_write":292,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'840","reported_seq":2349,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.747511+0000","last_change":"2024-09-12T01:04:54.747511+0000","last_active":"2024-09-12T01:04:54.747511+0000","last_peered":"2024-09-12T01:04:54.747511+0000","last_clean":"2024-09-12T01:04:54.747511+0000","last_became_active":"2024-09-12T00:18:24.869582+0000","last_became_peered":"2024-09-12T00:18:24.869582+0000","last_unstale":"2024-09-12T01:04:54.747511+0000","last_undegraded":"2024-09-12T01:04:54.747511+0000","last_fullsized":"2024-09-12T01:04:54.747511+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'840","last_scrub_stamp":"2024-09-12T01:04:54.747326+0000","last_deep_scrub":"268'840","last_deep_scrub_stamp":"2024-09-12T01:04:54.747326+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.747326+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":800,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:53.076407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4018,"num_read_kb":3569,"num_write":1156,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'263","reported_seq":872,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.467075+0000","last_change":"2024-09-12T01:04:55.466935+0000","last_active":"2024-09-12T01:04:55.467075+0000","last_peered":"2024-09-12T01:04:55.467075+0000","last_clean":"2024-09-12T01:04:55.467075+0000","last_became_active":"2024-09-12T00:18:22.875150+0000","last_became_peered":"2024-09-12T00:18:22.875150+0000","last_unstale":"2024-09-12T01:04:55.467075+0000","last_undegraded":"2024-09-12T01:04:55.467075+0000","last_fullsized":"2024-09-12T01:04:55.467075+0000","mapping_epoch":24,"log_start":"268'200","ondisk_log_start":"268'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'263","last_scrub_stamp":"2024-09-12T01:04:55.466756+0000","last_deep_scrub":"268'263","last_deep_scrub_stamp":"2024-09-12T01:04:55.466756+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.466756+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:15.779888+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174702,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":374,"num_read_kb":19791,"num_write":779,"num_write_kb":25570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"268'6","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.376956+0000","last_change":"2024-09-12T01:05:00.376795+0000","last_active":"2024-09-12T01:05:00.376956+0000","last_peered":"2024-09-12T01:05:00.376956+0000","last_clean":"2024-09-12T01:05:00.376956+0000","last_became_active":"2024-09-12T00:18:26.857788+0000","last_became_peered":"2024-09-12T00:18:26.857788+0000","last_unstale":"2024-09-12T01:05:00.376956+0000","last_undegraded":"2024-09-12T01:05:00.376956+0000","last_fullsized":"2024-09-12T01:05:00.376956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T01:05:00.376612+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T01:05:00.376612+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.376612+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:45.589459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'313","reported_seq":919,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:10.500913+0000","last_change":"2024-09-12T01:05:10.500913+0000","last_active":"2024-09-12T01:05:10.500913+0000","last_peered":"2024-09-12T01:05:10.500913+0000","last_clean":"2024-09-12T01:05:10.500913+0000","last_became_active":"2024-09-12T00:18:28.886806+0000","last_became_peered":"2024-09-12T00:18:28.886806+0000","last_unstale":"2024-09-12T01:05:10.500913+0000","last_undegraded":"2024-09-12T01:05:10.500913+0000","last_fullsized":"2024-09-12T01:05:10.500913+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'313","last_scrub_stamp":"2024-09-12T01:05:10.500704+0000","last_deep_scrub":"268'313","last_deep_scrub_stamp":"2024-09-12T01:05:10.500704+0000","last_clean_scrub_stamp":"2024-09-12T01:05:10.500704+0000","objects_scrubbed":9,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:48.042274+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45713,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":494,"num_read_kb":1053,"num_write":392,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'809","reported_seq":2420,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.203907+0000","last_change":"2024-09-12T01:05:14.203907+0000","last_active":"2024-09-12T01:05:14.203907+0000","last_peered":"2024-09-12T01:05:14.203907+0000","last_clean":"2024-09-12T01:05:14.203907+0000","last_became_active":"2024-09-12T00:18:30.888688+0000","last_became_peered":"2024-09-12T00:18:30.888688+0000","last_unstale":"2024-09-12T01:05:14.203907+0000","last_undegraded":"2024-09-12T01:05:14.203907+0000","last_fullsized":"2024-09-12T01:05:14.203907+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'809","last_scrub_stamp":"2024-09-12T01:05:14.203732+0000","last_deep_scrub":"268'809","last_deep_scrub_stamp":"2024-09-12T01:05:14.203732+0000","last_clean_scrub_stamp":"2024-09-12T01:05:14.203732+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:46.916328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'132","reported_seq":642,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:18.127644+0000","last_change":"2024-09-12T01:05:18.127644+0000","last_active":"2024-09-12T01:05:18.127644+0000","last_peered":"2024-09-12T01:05:18.127644+0000","last_clean":"2024-09-12T01:05:18.127644+0000","last_became_active":"2024-09-12T00:18:32.904609+0000","last_became_peered":"2024-09-12T00:18:32.904609+0000","last_unstale":"2024-09-12T01:05:18.127644+0000","last_undegraded":"2024-09-12T01:05:18.127644+0000","last_fullsized":"2024-09-12T01:05:18.127644+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'132","last_scrub_stamp":"2024-09-12T01:05:18.127453+0000","last_deep_scrub":"268'132","last_deep_scrub_stamp":"2024-09-12T01:05:18.127453+0000","last_clean_scrub_stamp":"2024-09-12T01:05:18.127453+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:38.888363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":137,"num_read_kb":127,"num_write":302,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'816","reported_seq":2299,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.205176+0000","last_change":"2024-09-12T01:04:54.205034+0000","last_active":"2024-09-12T01:04:54.205176+0000","last_peered":"2024-09-12T01:04:54.205176+0000","last_clean":"2024-09-12T01:04:54.205176+0000","last_became_active":"2024-09-12T00:18:24.856572+0000","last_became_peered":"2024-09-12T00:18:24.856572+0000","last_unstale":"2024-09-12T01:04:54.205176+0000","last_undegraded":"2024-09-12T01:04:54.205176+0000","last_fullsized":"2024-09-12T01:04:54.205176+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'816","last_scrub_stamp":"2024-09-12T01:04:54.204847+0000","last_deep_scrub":"268'816","last_deep_scrub_stamp":"2024-09-12T01:04:54.204847+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.204847+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:06.157588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3705,"num_read_kb":3326,"num_write":1078,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'390","reported_seq":1109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.585521+0000","last_change":"2024-09-12T01:04:48.585386+0000","last_active":"2024-09-12T01:04:48.585521+0000","last_peered":"2024-09-12T01:04:48.585521+0000","last_clean":"2024-09-12T01:04:48.585521+0000","last_became_active":"2024-09-12T00:18:22.865067+0000","last_became_peered":"2024-09-12T00:18:22.865067+0000","last_unstale":"2024-09-12T01:04:48.585521+0000","last_undegraded":"2024-09-12T01:04:48.585521+0000","last_fullsized":"2024-09-12T01:04:48.585521+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'390","last_scrub_stamp":"2024-09-12T01:04:48.585156+0000","last_deep_scrub":"268'390","last_deep_scrub_stamp":"2024-09-12T01:04:48.585156+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.585156+0000","objects_scrubbed":9,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:32.682633+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":300494,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":644,"num_read_kb":35348,"num_write":1371,"num_write_kb":29498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.418400+0000","last_change":"2024-09-12T01:04:58.418400+0000","last_active":"2024-09-12T01:04:58.418400+0000","last_peered":"2024-09-12T01:04:58.418400+0000","last_clean":"2024-09-12T01:04:58.418400+0000","last_became_active":"2024-09-12T00:18:26.867793+0000","last_became_peered":"2024-09-12T00:18:26.867793+0000","last_unstale":"2024-09-12T01:04:58.418400+0000","last_undegraded":"2024-09-12T01:04:58.418400+0000","last_fullsized":"2024-09-12T01:04:58.418400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:58.418226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:58.418226+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.418226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:04.200862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'480","reported_seq":1134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:06.288694+0000","last_change":"2024-09-12T01:05:06.288694+0000","last_active":"2024-09-12T01:05:06.288694+0000","last_peered":"2024-09-12T01:05:06.288694+0000","last_clean":"2024-09-12T01:05:06.288694+0000","last_became_active":"2024-09-12T00:18:28.875891+0000","last_became_peered":"2024-09-12T00:18:28.875891+0000","last_unstale":"2024-09-12T01:05:06.288694+0000","last_undegraded":"2024-09-12T01:05:06.288694+0000","last_fullsized":"2024-09-12T01:05:06.288694+0000","mapping_epoch":30,"log_start":"268'400","ondisk_log_start":"268'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'480","last_scrub_stamp":"2024-09-12T01:05:06.288498+0000","last_deep_scrub":"268'480","last_deep_scrub_stamp":"2024-09-12T01:05:06.288498+0000","last_clean_scrub_stamp":"2024-09-12T01:05:06.288498+0000","objects_scrubbed":7,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:38.359325+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96447,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":834,"num_read_kb":1977,"num_write":680,"num_write_kb":567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.409073+0000","last_change":"2024-09-12T01:05:02.409073+0000","last_active":"2024-09-12T01:05:02.409073+0000","last_peered":"2024-09-12T01:05:02.409073+0000","last_clean":"2024-09-12T01:05:02.409073+0000","last_became_active":"2024-09-12T00:18:30.895401+0000","last_became_peered":"2024-09-12T00:18:30.895401+0000","last_unstale":"2024-09-12T01:05:02.409073+0000","last_undegraded":"2024-09-12T01:05:02.409073+0000","last_fullsized":"2024-09-12T01:05:02.409073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:02.408869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:02.408869+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.408869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:22.455398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'155","reported_seq":690,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:12.562877+0000","last_change":"2024-09-12T01:05:12.562877+0000","last_active":"2024-09-12T01:05:12.562877+0000","last_peered":"2024-09-12T01:05:12.562877+0000","last_clean":"2024-09-12T01:05:12.562877+0000","last_became_active":"2024-09-12T00:18:32.892682+0000","last_became_peered":"2024-09-12T00:18:32.892682+0000","last_unstale":"2024-09-12T01:05:12.562877+0000","last_undegraded":"2024-09-12T01:05:12.562877+0000","last_fullsized":"2024-09-12T01:05:12.562877+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'155","last_scrub_stamp":"2024-09-12T01:05:12.562632+0000","last_deep_scrub":"268'155","last_deep_scrub_stamp":"2024-09-12T01:05:12.562632+0000","last_clean_scrub_stamp":"2024-09-12T01:05:12.562632+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:26.872352+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1103,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":196,"num_read_kb":180,"num_write":352,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'460","reported_seq":2084,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.181632+0000","last_change":"2024-09-12T01:04:53.181483+0000","last_active":"2024-09-12T01:04:53.181632+0000","last_peered":"2024-09-12T01:04:53.181632+0000","last_clean":"2024-09-12T01:04:53.181632+0000","last_became_active":"2024-09-12T00:18:24.852683+0000","last_became_peered":"2024-09-12T00:18:24.852683+0000","last_unstale":"2024-09-12T01:04:53.181632+0000","last_undegraded":"2024-09-12T01:04:53.181632+0000","last_fullsized":"2024-09-12T01:04:53.181632+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'460","last_scrub_stamp":"2024-09-12T01:04:53.181308+0000","last_deep_scrub":"268'460","last_deep_scrub_stamp":"2024-09-12T01:04:53.181308+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.181308+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:33.622967+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2390,"num_read_kb":2271,"num_write":519,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'367","reported_seq":1026,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.282069+0000","last_change":"2024-09-12T01:04:49.281782+0000","last_active":"2024-09-12T01:04:49.282069+0000","last_peered":"2024-09-12T01:04:49.282069+0000","last_clean":"2024-09-12T01:04:49.282069+0000","last_became_active":"2024-09-12T00:18:22.841689+0000","last_became_peered":"2024-09-12T00:18:22.841689+0000","last_unstale":"2024-09-12T01:04:49.282069+0000","last_undegraded":"2024-09-12T01:04:49.282069+0000","last_fullsized":"2024-09-12T01:04:49.282069+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'367","last_scrub_stamp":"2024-09-12T01:04:49.281537+0000","last_deep_scrub":"268'367","last_deep_scrub_stamp":"2024-09-12T01:04:49.281537+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.281537+0000","objects_scrubbed":6,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:15.412534+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194384,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":496,"num_read_kb":55770,"num_write":1160,"num_write_kb":35616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.393823+0000","last_change":"2024-09-12T01:05:01.393694+0000","last_active":"2024-09-12T01:05:01.393823+0000","last_peered":"2024-09-12T01:05:01.393823+0000","last_clean":"2024-09-12T01:05:01.393823+0000","last_became_active":"2024-09-12T00:18:26.845618+0000","last_became_peered":"2024-09-12T00:18:26.845618+0000","last_unstale":"2024-09-12T01:05:01.393823+0000","last_undegraded":"2024-09-12T01:05:01.393823+0000","last_fullsized":"2024-09-12T01:05:01.393823+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:01.393507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:01.393507+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.393507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:52.795216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'306","reported_seq":902,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.207564+0000","last_change":"2024-09-12T01:05:13.207429+0000","last_active":"2024-09-12T01:05:13.207564+0000","last_peered":"2024-09-12T01:05:13.207564+0000","last_clean":"2024-09-12T01:05:13.207564+0000","last_became_active":"2024-09-12T00:18:28.884044+0000","last_became_peered":"2024-09-12T00:18:28.884044+0000","last_unstale":"2024-09-12T01:05:13.207564+0000","last_undegraded":"2024-09-12T01:05:13.207564+0000","last_fullsized":"2024-09-12T01:05:13.207564+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'306","last_scrub_stamp":"2024-09-12T01:05:13.207241+0000","last_deep_scrub":"268'306","last_deep_scrub_stamp":"2024-09-12T01:05:13.207241+0000","last_clean_scrub_stamp":"2024-09-12T01:05:13.207241+0000","objects_scrubbed":7,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:54.963951+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53187,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":519,"num_read_kb":1172,"num_write":464,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:12.210004+0000","last_change":"2024-09-12T01:05:12.209840+0000","last_active":"2024-09-12T01:05:12.210004+0000","last_peered":"2024-09-12T01:05:12.210004+0000","last_clean":"2024-09-12T01:05:12.210004+0000","last_became_active":"2024-09-12T00:18:30.902697+0000","last_became_peered":"2024-09-12T00:18:30.902697+0000","last_unstale":"2024-09-12T01:05:12.210004+0000","last_undegraded":"2024-09-12T01:05:12.210004+0000","last_fullsized":"2024-09-12T01:05:12.210004+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:12.209656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:12.209656+0000","last_clean_scrub_stamp":"2024-09-12T01:05:12.209656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:09.569231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'140","reported_seq":649,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:25.091385+0000","last_change":"2024-09-12T01:05:25.091385+0000","last_active":"2024-09-12T01:05:25.091385+0000","last_peered":"2024-09-12T01:05:25.091385+0000","last_clean":"2024-09-12T01:05:25.091385+0000","last_became_active":"2024-09-12T00:18:32.900235+0000","last_became_peered":"2024-09-12T00:18:32.900235+0000","last_unstale":"2024-09-12T01:05:25.091385+0000","last_undegraded":"2024-09-12T01:05:25.091385+0000","last_fullsized":"2024-09-12T01:05:25.091385+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'140","last_scrub_stamp":"2024-09-12T01:05:25.091155+0000","last_deep_scrub":"268'140","last_deep_scrub_stamp":"2024-09-12T01:05:25.091155+0000","last_clean_scrub_stamp":"2024-09-12T01:05:25.091155+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:36.766475+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":465,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":124,"num_read_kb":118,"num_write":347,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'437","reported_seq":2088,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.152535+0000","last_change":"2024-09-12T01:04:55.152400+0000","last_active":"2024-09-12T01:04:55.152535+0000","last_peered":"2024-09-12T01:04:55.152535+0000","last_clean":"2024-09-12T01:04:55.152535+0000","last_became_active":"2024-09-12T00:18:24.872637+0000","last_became_peered":"2024-09-12T00:18:24.872637+0000","last_unstale":"2024-09-12T01:04:55.152535+0000","last_undegraded":"2024-09-12T01:04:55.152535+0000","last_fullsized":"2024-09-12T01:04:55.152535+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'437","last_scrub_stamp":"2024-09-12T01:04:55.152221+0000","last_deep_scrub":"268'437","last_deep_scrub_stamp":"2024-09-12T01:04:55.152221+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.152221+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:56.856049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2400,"num_read_kb":2300,"num_write":500,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'358","reported_seq":1045,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.718500+0000","last_change":"2024-09-12T01:04:48.718500+0000","last_active":"2024-09-12T01:04:48.718500+0000","last_peered":"2024-09-12T01:04:48.718500+0000","last_clean":"2024-09-12T01:04:48.718500+0000","last_became_active":"2024-09-12T00:18:22.861450+0000","last_became_peered":"2024-09-12T00:18:22.861450+0000","last_unstale":"2024-09-12T01:04:48.718500+0000","last_undegraded":"2024-09-12T01:04:48.718500+0000","last_fullsized":"2024-09-12T01:04:48.718500+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'358","last_scrub_stamp":"2024-09-12T01:04:48.718246+0000","last_deep_scrub":"268'358","last_deep_scrub_stamp":"2024-09-12T01:04:48.718246+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.718246+0000","objects_scrubbed":9,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:43.073298+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":662355,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":585,"num_read_kb":32647,"num_write":1179,"num_write_kb":29925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.540359+0000","last_change":"2024-09-12T01:05:00.540215+0000","last_active":"2024-09-12T01:05:00.540359+0000","last_peered":"2024-09-12T01:05:00.540359+0000","last_clean":"2024-09-12T01:05:00.540359+0000","last_became_active":"2024-09-12T00:18:26.859109+0000","last_became_peered":"2024-09-12T00:18:26.859109+0000","last_unstale":"2024-09-12T01:05:00.540359+0000","last_undegraded":"2024-09-12T01:05:00.540359+0000","last_fullsized":"2024-09-12T01:05:00.540359+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:00.540042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:00.540042+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.540042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:32.790029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'309","reported_seq":909,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.459427+0000","last_change":"2024-09-12T01:05:05.459268+0000","last_active":"2024-09-12T01:05:05.459427+0000","last_peered":"2024-09-12T01:05:05.459427+0000","last_clean":"2024-09-12T01:05:05.459427+0000","last_became_active":"2024-09-12T00:18:28.881947+0000","last_became_peered":"2024-09-12T00:18:28.881947+0000","last_unstale":"2024-09-12T01:05:05.459427+0000","last_undegraded":"2024-09-12T01:05:05.459427+0000","last_fullsized":"2024-09-12T01:05:05.459427+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'309","last_scrub_stamp":"2024-09-12T01:05:05.459045+0000","last_deep_scrub":"268'309","last_deep_scrub_stamp":"2024-09-12T01:05:05.459045+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.459045+0000","objects_scrubbed":7,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:15.066600+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45222,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":499,"num_read_kb":1119,"num_write":404,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'746","reported_seq":4325,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.485198+0000","last_change":"2024-09-12T01:05:04.484921+0000","last_active":"2024-09-12T01:05:04.485198+0000","last_peered":"2024-09-12T01:05:04.485198+0000","last_clean":"2024-09-12T01:05:04.485198+0000","last_became_active":"2024-09-12T00:18:30.872360+0000","last_became_peered":"2024-09-12T00:18:30.872360+0000","last_unstale":"2024-09-12T01:05:04.485198+0000","last_undegraded":"2024-09-12T01:05:04.485198+0000","last_fullsized":"2024-09-12T01:05:04.485198+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'746","last_scrub_stamp":"2024-09-12T01:05:04.484658+0000","last_deep_scrub":"268'746","last_deep_scrub_stamp":"2024-09-12T01:05:04.484658+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.484658+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":700,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:16.768023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'115","reported_seq":634,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:10.632589+0000","last_change":"2024-09-12T01:05:10.632589+0000","last_active":"2024-09-12T01:05:10.632589+0000","last_peered":"2024-09-12T01:05:10.632589+0000","last_clean":"2024-09-12T01:05:10.632589+0000","last_became_active":"2024-09-12T00:18:32.896338+0000","last_became_peered":"2024-09-12T00:18:32.896338+0000","last_unstale":"2024-09-12T01:05:10.632589+0000","last_undegraded":"2024-09-12T01:05:10.632589+0000","last_fullsized":"2024-09-12T01:05:10.632589+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'115","last_scrub_stamp":"2024-09-12T01:05:10.632400+0000","last_deep_scrub":"268'115","last_deep_scrub_stamp":"2024-09-12T01:05:10.632400+0000","last_clean_scrub_stamp":"2024-09-12T01:05:10.632400+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:08.929433+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":125,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'463","reported_seq":2022,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.173058+0000","last_change":"2024-09-12T01:04:56.172887+0000","last_active":"2024-09-12T01:04:56.173058+0000","last_peered":"2024-09-12T01:04:56.173058+0000","last_clean":"2024-09-12T01:04:56.173058+0000","last_became_active":"2024-09-12T00:18:24.879622+0000","last_became_peered":"2024-09-12T00:18:24.879622+0000","last_unstale":"2024-09-12T01:04:56.173058+0000","last_undegraded":"2024-09-12T01:04:56.173058+0000","last_fullsized":"2024-09-12T01:04:56.173058+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'463","last_scrub_stamp":"2024-09-12T01:04:56.172706+0000","last_deep_scrub":"268'463","last_deep_scrub_stamp":"2024-09-12T01:04:56.172706+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.172706+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:18.013381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2528,"num_read_kb":2373,"num_write":555,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'408","reported_seq":1114,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.190683+0000","last_change":"2024-09-12T01:04:47.190525+0000","last_active":"2024-09-12T01:04:47.190683+0000","last_peered":"2024-09-12T01:04:47.190683+0000","last_clean":"2024-09-12T01:04:47.190683+0000","last_became_active":"2024-09-12T00:18:22.847861+0000","last_became_peered":"2024-09-12T00:18:22.847861+0000","last_unstale":"2024-09-12T01:04:47.190683+0000","last_undegraded":"2024-09-12T01:04:47.190683+0000","last_fullsized":"2024-09-12T01:04:47.190683+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'408","last_scrub_stamp":"2024-09-12T01:04:47.190319+0000","last_deep_scrub":"268'408","last_deep_scrub_stamp":"2024-09-12T01:04:47.190319+0000","last_clean_scrub_stamp":"2024-09-12T01:04:47.190319+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:08.728064+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":711,"num_read_kb":61883,"num_write":1220,"num_write_kb":26157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"268'4","reported_seq":1465,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:08.520456+0000","last_change":"2024-09-12T01:05:08.520192+0000","last_active":"2024-09-12T01:05:08.520456+0000","last_peered":"2024-09-12T01:05:08.520456+0000","last_clean":"2024-09-12T01:05:08.520456+0000","last_became_active":"2024-09-12T00:18:26.871356+0000","last_became_peered":"2024-09-12T00:18:26.871356+0000","last_unstale":"2024-09-12T01:05:08.520456+0000","last_undegraded":"2024-09-12T01:05:08.520456+0000","last_fullsized":"2024-09-12T01:05:08.520456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:05:08.519909+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:05:08.519909+0000","last_clean_scrub_stamp":"2024-09-12T01:05:08.519909+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:24.897378+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'77","reported_seq":614,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:12.080348+0000","last_change":"2024-09-12T01:05:12.080212+0000","last_active":"2024-09-12T01:05:12.080348+0000","last_peered":"2024-09-12T01:05:12.080348+0000","last_clean":"2024-09-12T01:05:12.080348+0000","last_became_active":"2024-09-12T00:18:28.888423+0000","last_became_peered":"2024-09-12T00:18:28.888423+0000","last_unstale":"2024-09-12T01:05:12.080348+0000","last_undegraded":"2024-09-12T01:05:12.080348+0000","last_fullsized":"2024-09-12T01:05:12.080348+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'77","last_scrub_stamp":"2024-09-12T01:05:12.080009+0000","last_deep_scrub":"268'77","last_deep_scrub_stamp":"2024-09-12T01:05:12.080009+0000","last_clean_scrub_stamp":"2024-09-12T01:05:12.080009+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:59.149037+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":78,"num_read_kb":72,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'768","reported_seq":2124,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.754928+0000","last_change":"2024-09-12T01:05:05.754750+0000","last_active":"2024-09-12T01:05:05.754928+0000","last_peered":"2024-09-12T01:05:05.754928+0000","last_clean":"2024-09-12T01:05:05.754928+0000","last_became_active":"2024-09-12T00:18:30.898814+0000","last_became_peered":"2024-09-12T00:18:30.898814+0000","last_unstale":"2024-09-12T01:05:05.754928+0000","last_undegraded":"2024-09-12T01:05:05.754928+0000","last_fullsized":"2024-09-12T01:05:05.754928+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'768","last_scrub_stamp":"2024-09-12T01:05:05.754569+0000","last_deep_scrub":"268'768","last_deep_scrub_stamp":"2024-09-12T01:05:05.754569+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.754569+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:36.497490+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'94","reported_seq":602,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:18.159280+0000","last_change":"2024-09-12T01:05:18.159280+0000","last_active":"2024-09-12T01:05:18.159280+0000","last_peered":"2024-09-12T01:05:18.159280+0000","last_clean":"2024-09-12T01:05:18.159280+0000","last_became_active":"2024-09-12T00:18:32.907797+0000","last_became_peered":"2024-09-12T00:18:32.907797+0000","last_unstale":"2024-09-12T01:05:18.159280+0000","last_undegraded":"2024-09-12T01:05:18.159280+0000","last_fullsized":"2024-09-12T01:05:18.159280+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'94","last_scrub_stamp":"2024-09-12T01:05:18.159064+0000","last_deep_scrub":"268'94","last_deep_scrub_stamp":"2024-09-12T01:05:18.159064+0000","last_clean_scrub_stamp":"2024-09-12T01:05:18.159064+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:38.097320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":73,"num_write":219,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'510","reported_seq":2091,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.411066+0000","last_change":"2024-09-12T01:04:51.411066+0000","last_active":"2024-09-12T01:04:51.411066+0000","last_peered":"2024-09-12T01:04:51.411066+0000","last_clean":"2024-09-12T01:04:51.411066+0000","last_became_active":"2024-09-12T00:18:56.196419+0000","last_became_peered":"2024-09-12T00:18:56.196419+0000","last_unstale":"2024-09-12T01:04:51.411066+0000","last_undegraded":"2024-09-12T01:04:51.411066+0000","last_fullsized":"2024-09-12T01:04:51.411066+0000","mapping_epoch":37,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'510","last_scrub_stamp":"2024-09-12T01:04:51.410840+0000","last_deep_scrub":"268'510","last_deep_scrub_stamp":"2024-09-12T01:04:51.410840+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.410840+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:25.199103+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2644,"num_read_kb":2454,"num_write":619,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"268'409","reported_seq":1202,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.265347+0000","last_change":"2024-09-12T01:04:48.265266+0000","last_active":"2024-09-12T01:04:48.265347+0000","last_peered":"2024-09-12T01:04:48.265347+0000","last_clean":"2024-09-12T01:04:48.265347+0000","last_became_active":"2024-09-12T00:18:22.834072+0000","last_became_peered":"2024-09-12T00:18:22.834072+0000","last_unstale":"2024-09-12T01:04:48.265347+0000","last_undegraded":"2024-09-12T01:04:48.265347+0000","last_fullsized":"2024-09-12T01:04:48.265347+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'409","last_scrub_stamp":"2024-09-12T01:04:48.265165+0000","last_deep_scrub":"268'409","last_deep_scrub_stamp":"2024-09-12T01:04:48.265165+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.265165+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:03.330338+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":207192,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":853,"num_read_kb":11806,"num_write":1194,"num_write_kb":23298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.149436+0000","last_change":"2024-09-12T01:05:09.149297+0000","last_active":"2024-09-12T01:05:09.149436+0000","last_peered":"2024-09-12T01:05:09.149436+0000","last_clean":"2024-09-12T01:05:09.149436+0000","last_became_active":"2024-09-12T00:18:26.871183+0000","last_became_peered":"2024-09-12T00:18:26.871183+0000","last_unstale":"2024-09-12T01:05:09.149436+0000","last_undegraded":"2024-09-12T01:05:09.149436+0000","last_fullsized":"2024-09-12T01:05:09.149436+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:09.149047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:09.149047+0000","last_clean_scrub_stamp":"2024-09-12T01:05:09.149047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:18.048008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'379","reported_seq":996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.572353+0000","last_change":"2024-09-12T01:05:14.572220+0000","last_active":"2024-09-12T01:05:14.572353+0000","last_peered":"2024-09-12T01:05:14.572353+0000","last_clean":"2024-09-12T01:05:14.572353+0000","last_became_active":"2024-09-12T00:18:28.889343+0000","last_became_peered":"2024-09-12T00:18:28.889343+0000","last_unstale":"2024-09-12T01:05:14.572353+0000","last_undegraded":"2024-09-12T01:05:14.572353+0000","last_fullsized":"2024-09-12T01:05:14.572353+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'379","last_scrub_stamp":"2024-09-12T01:05:14.572004+0000","last_deep_scrub":"268'379","last_deep_scrub_stamp":"2024-09-12T01:05:14.572004+0000","last_clean_scrub_stamp":"2024-09-12T01:05:14.572004+0000","objects_scrubbed":9,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:56.833847+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45461,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1181,"num_read_kb":1792,"num_write":1688,"num_write_kb":1549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":488742,"num_omap_keys":1130,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.755160+0000","last_change":"2024-09-12T01:05:04.754995+0000","last_active":"2024-09-12T01:05:04.755160+0000","last_peered":"2024-09-12T01:05:04.755160+0000","last_clean":"2024-09-12T01:05:04.755160+0000","last_became_active":"2024-09-12T00:18:30.905770+0000","last_became_peered":"2024-09-12T00:18:30.905770+0000","last_unstale":"2024-09-12T01:05:04.755160+0000","last_undegraded":"2024-09-12T01:05:04.755160+0000","last_fullsized":"2024-09-12T01:05:04.755160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:04.754810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:04.754810+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.754810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:50.499923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'137","reported_seq":646,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.483268+0000","last_change":"2024-09-12T01:05:14.483268+0000","last_active":"2024-09-12T01:05:14.483268+0000","last_peered":"2024-09-12T01:05:14.483268+0000","last_clean":"2024-09-12T01:05:14.483268+0000","last_became_active":"2024-09-12T00:18:32.885619+0000","last_became_peered":"2024-09-12T00:18:32.885619+0000","last_unstale":"2024-09-12T01:05:14.483268+0000","last_undegraded":"2024-09-12T01:05:14.483268+0000","last_fullsized":"2024-09-12T01:05:14.483268+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'137","last_scrub_stamp":"2024-09-12T01:05:14.483031+0000","last_deep_scrub":"268'137","last_deep_scrub_stamp":"2024-09-12T01:05:14.483031+0000","last_clean_scrub_stamp":"2024-09-12T01:05:14.483031+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:52.743881+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":117,"num_write":301,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'771","reported_seq":2196,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.714075+0000","last_change":"2024-09-12T01:04:52.714075+0000","last_active":"2024-09-12T01:04:52.714075+0000","last_peered":"2024-09-12T01:04:52.714075+0000","last_clean":"2024-09-12T01:04:52.714075+0000","last_became_active":"2024-09-12T00:18:24.879462+0000","last_became_peered":"2024-09-12T00:18:24.879462+0000","last_unstale":"2024-09-12T01:04:52.714075+0000","last_undegraded":"2024-09-12T01:04:52.714075+0000","last_fullsized":"2024-09-12T01:04:52.714075+0000","mapping_epoch":26,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'771","last_scrub_stamp":"2024-09-12T01:04:52.713880+0000","last_deep_scrub":"268'771","last_deep_scrub_stamp":"2024-09-12T01:04:52.713880+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.713880+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:50.037991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3687,"num_read_kb":3308,"num_write":1074,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"268'74","reported_seq":625,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.387866+0000","last_change":"2024-09-12T01:04:48.387866+0000","last_active":"2024-09-12T01:04:48.387866+0000","last_peered":"2024-09-12T01:04:48.387866+0000","last_clean":"2024-09-12T01:04:48.387866+0000","last_became_active":"2024-09-12T00:18:03.924829+0000","last_became_peered":"2024-09-12T00:18:03.924829+0000","last_unstale":"2024-09-12T01:04:48.387866+0000","last_undegraded":"2024-09-12T01:04:48.387866+0000","last_fullsized":"2024-09-12T01:04:48.387866+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'74","last_scrub_stamp":"2024-09-12T01:04:48.387655+0000","last_deep_scrub":"268'74","last_deep_scrub_stamp":"2024-09-12T01:04:48.387655+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.387655+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:43.335462+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"268'2","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.534907+0000","last_change":"2024-09-12T01:04:47.534759+0000","last_active":"2024-09-12T01:04:47.534907+0000","last_peered":"2024-09-12T01:04:47.534907+0000","last_clean":"2024-09-12T01:04:47.534907+0000","last_became_active":"2024-09-12T00:18:08.644385+0000","last_became_peered":"2024-09-12T00:18:08.644385+0000","last_unstale":"2024-09-12T01:04:47.534907+0000","last_undegraded":"2024-09-12T01:04:47.534907+0000","last_fullsized":"2024-09-12T01:04:47.534907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:04:47.534572+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:04:47.534572+0000","last_clean_scrub_stamp":"2024-09-12T01:04:47.534572+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:43.103409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001156741,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'363","reported_seq":1020,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:46.290029+0000","last_change":"2024-09-12T01:04:46.290029+0000","last_active":"2024-09-12T01:04:46.290029+0000","last_peered":"2024-09-12T01:04:46.290029+0000","last_clean":"2024-09-12T01:04:46.290029+0000","last_became_active":"2024-09-12T00:18:22.867571+0000","last_became_peered":"2024-09-12T00:18:22.867571+0000","last_unstale":"2024-09-12T01:04:46.290029+0000","last_undegraded":"2024-09-12T01:04:46.290029+0000","last_fullsized":"2024-09-12T01:04:46.290029+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'363","last_scrub_stamp":"2024-09-12T01:04:46.289871+0000","last_deep_scrub":"268'363","last_deep_scrub_stamp":"2024-09-12T01:04:46.289871+0000","last_clean_scrub_stamp":"2024-09-12T01:04:46.289871+0000","objects_scrubbed":7,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:39.208915+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262231,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":470,"num_read_kb":26851,"num_write":1093,"num_write_kb":40025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.467331+0000","last_change":"2024-09-12T01:05:02.467331+0000","last_active":"2024-09-12T01:05:02.467331+0000","last_peered":"2024-09-12T01:05:02.467331+0000","last_clean":"2024-09-12T01:05:02.467331+0000","last_became_active":"2024-09-12T00:18:26.846668+0000","last_became_peered":"2024-09-12T00:18:26.846668+0000","last_unstale":"2024-09-12T01:05:02.467331+0000","last_undegraded":"2024-09-12T01:05:02.467331+0000","last_fullsized":"2024-09-12T01:05:02.467331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:02.467156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:02.467156+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.467156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:27.839432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'709","reported_seq":1429,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:12.579337+0000","last_change":"2024-09-12T01:05:12.579337+0000","last_active":"2024-09-12T01:05:12.579337+0000","last_peered":"2024-09-12T01:05:12.579337+0000","last_clean":"2024-09-12T01:05:12.579337+0000","last_became_active":"2024-09-12T00:18:28.885217+0000","last_became_peered":"2024-09-12T00:18:28.885217+0000","last_unstale":"2024-09-12T01:05:12.579337+0000","last_undegraded":"2024-09-12T01:05:12.579337+0000","last_fullsized":"2024-09-12T01:05:12.579337+0000","mapping_epoch":30,"log_start":"268'600","ondisk_log_start":"268'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'709","last_scrub_stamp":"2024-09-12T01:05:12.579141+0000","last_deep_scrub":"268'709","last_deep_scrub_stamp":"2024-09-12T01:05:12.579141+0000","last_clean_scrub_stamp":"2024-09-12T01:05:12.579141+0000","objects_scrubbed":7,"log_size":109,"log_dups_size":600,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:08.727940+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190373,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1378,"num_read_kb":3232,"num_write":1266,"num_write_kb":1158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89472,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:17.098442+0000","last_change":"2024-09-12T01:05:17.098442+0000","last_active":"2024-09-12T01:05:17.098442+0000","last_peered":"2024-09-12T01:05:17.098442+0000","last_clean":"2024-09-12T01:05:17.098442+0000","last_became_active":"2024-09-12T00:18:30.898689+0000","last_became_peered":"2024-09-12T00:18:30.898689+0000","last_unstale":"2024-09-12T01:05:17.098442+0000","last_undegraded":"2024-09-12T01:05:17.098442+0000","last_fullsized":"2024-09-12T01:05:17.098442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:17.098261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:17.098261+0000","last_clean_scrub_stamp":"2024-09-12T01:05:17.098261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:07.482389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'203","reported_seq":920,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:11.758630+0000","last_change":"2024-09-12T01:05:11.758630+0000","last_active":"2024-09-12T01:05:11.758630+0000","last_peered":"2024-09-12T01:05:11.758630+0000","last_clean":"2024-09-12T01:05:11.758630+0000","last_became_active":"2024-09-12T00:18:32.895239+0000","last_became_peered":"2024-09-12T00:18:32.895239+0000","last_unstale":"2024-09-12T01:05:11.758630+0000","last_undegraded":"2024-09-12T01:05:11.758630+0000","last_fullsized":"2024-09-12T01:05:11.758630+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'203","last_scrub_stamp":"2024-09-12T01:05:11.758417+0000","last_deep_scrub":"268'203","last_deep_scrub_stamp":"2024-09-12T01:05:11.758417+0000","last_clean_scrub_stamp":"2024-09-12T01:05:11.758417+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:16.614404+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1443,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":458,"num_write":434,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'489","reported_seq":2074,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.268278+0000","last_change":"2024-09-12T01:04:56.267998+0000","last_active":"2024-09-12T01:04:56.268278+0000","last_peered":"2024-09-12T01:04:56.268278+0000","last_clean":"2024-09-12T01:04:56.268278+0000","last_became_active":"2024-09-12T00:18:24.867067+0000","last_became_peered":"2024-09-12T00:18:24.867067+0000","last_unstale":"2024-09-12T01:04:56.268278+0000","last_undegraded":"2024-09-12T01:04:56.268278+0000","last_fullsized":"2024-09-12T01:04:56.268278+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'489","last_scrub_stamp":"2024-09-12T01:04:56.267771+0000","last_deep_scrub":"268'489","last_deep_scrub_stamp":"2024-09-12T01:04:56.267771+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.267771+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:04.695281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2524,"num_read_kb":2362,"num_write":607,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.421771+0000","last_change":"2024-09-12T01:04:50.421771+0000","last_active":"2024-09-12T01:04:50.421771+0000","last_peered":"2024-09-12T01:04:50.421771+0000","last_clean":"2024-09-12T01:04:50.421771+0000","last_became_active":"2024-09-12T00:18:08.646097+0000","last_became_peered":"2024-09-12T00:18:08.646097+0000","last_unstale":"2024-09-12T01:04:50.421771+0000","last_undegraded":"2024-09-12T01:04:50.421771+0000","last_fullsized":"2024-09-12T01:04:50.421771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:50.421588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:50.421588+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.421588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:10.736613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001003409,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'368","reported_seq":1039,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:46.266343+0000","last_change":"2024-09-12T01:04:46.266343+0000","last_active":"2024-09-12T01:04:46.266343+0000","last_peered":"2024-09-12T01:04:46.266343+0000","last_clean":"2024-09-12T01:04:46.266343+0000","last_became_active":"2024-09-12T00:18:22.857461+0000","last_became_peered":"2024-09-12T00:18:22.857461+0000","last_unstale":"2024-09-12T01:04:46.266343+0000","last_undegraded":"2024-09-12T01:04:46.266343+0000","last_fullsized":"2024-09-12T01:04:46.266343+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'368","last_scrub_stamp":"2024-09-12T01:04:46.266244+0000","last_deep_scrub":"268'368","last_deep_scrub_stamp":"2024-09-12T01:04:46.266244+0000","last_clean_scrub_stamp":"2024-09-12T01:04:46.266244+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:56.316874+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342049,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":576,"num_read_kb":72256,"num_write":1077,"num_write_kb":25510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:07.550588+0000","last_change":"2024-09-12T01:05:07.550454+0000","last_active":"2024-09-12T01:05:07.550588+0000","last_peered":"2024-09-12T01:05:07.550588+0000","last_clean":"2024-09-12T01:05:07.550588+0000","last_became_active":"2024-09-12T00:18:26.871674+0000","last_became_peered":"2024-09-12T00:18:26.871674+0000","last_unstale":"2024-09-12T01:05:07.550588+0000","last_undegraded":"2024-09-12T01:05:07.550588+0000","last_fullsized":"2024-09-12T01:05:07.550588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:07.550275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:07.550275+0000","last_clean_scrub_stamp":"2024-09-12T01:05:07.550275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:29.322955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'1332","reported_seq":2850,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.595923+0000","last_change":"2024-09-12T01:05:05.595923+0000","last_active":"2024-09-12T01:05:05.595923+0000","last_peered":"2024-09-12T01:05:05.595923+0000","last_clean":"2024-09-12T01:05:05.595923+0000","last_became_active":"2024-09-12T00:18:28.889257+0000","last_became_peered":"2024-09-12T00:18:28.889257+0000","last_unstale":"2024-09-12T01:05:05.595923+0000","last_undegraded":"2024-09-12T01:05:05.595923+0000","last_fullsized":"2024-09-12T01:05:05.595923+0000","mapping_epoch":30,"log_start":"268'1301","ondisk_log_start":"268'1301","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1332","last_scrub_stamp":"2024-09-12T01:05:05.595699+0000","last_deep_scrub":"268'1332","last_deep_scrub_stamp":"2024-09-12T01:05:05.595699+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.595699+0000","objects_scrubbed":12,"log_size":31,"log_dups_size":1301,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:21.671487+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142532,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2119,"num_read_kb":4115,"num_write":1220,"num_write_kb":1054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:15.411292+0000","last_change":"2024-09-12T01:05:15.411292+0000","last_active":"2024-09-12T01:05:15.411292+0000","last_peered":"2024-09-12T01:05:15.411292+0000","last_clean":"2024-09-12T01:05:15.411292+0000","last_became_active":"2024-09-12T00:18:30.895305+0000","last_became_peered":"2024-09-12T00:18:30.895305+0000","last_unstale":"2024-09-12T01:05:15.411292+0000","last_undegraded":"2024-09-12T01:05:15.411292+0000","last_fullsized":"2024-09-12T01:05:15.411292+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:15.411111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:15.411111+0000","last_clean_scrub_stamp":"2024-09-12T01:05:15.411111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:06.456720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'206","reported_seq":741,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.525292+0000","last_change":"2024-09-12T01:05:13.525292+0000","last_active":"2024-09-12T01:05:13.525292+0000","last_peered":"2024-09-12T01:05:13.525292+0000","last_clean":"2024-09-12T01:05:13.525292+0000","last_became_active":"2024-09-12T00:18:32.887528+0000","last_became_peered":"2024-09-12T00:18:32.887528+0000","last_unstale":"2024-09-12T01:05:13.525292+0000","last_undegraded":"2024-09-12T01:05:13.525292+0000","last_fullsized":"2024-09-12T01:05:13.525292+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'206","last_scrub_stamp":"2024-09-12T01:05:13.525024+0000","last_deep_scrub":"268'206","last_deep_scrub_stamp":"2024-09-12T01:05:13.525024+0000","last_clean_scrub_stamp":"2024-09-12T01:05:13.525024+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:24.202578+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":310,"num_read_kb":309,"num_write":446,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'1283","reported_seq":3152,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.562497+0000","last_change":"2024-09-12T01:04:55.562364+0000","last_active":"2024-09-12T01:04:55.562497+0000","last_peered":"2024-09-12T01:04:55.562497+0000","last_clean":"2024-09-12T01:04:55.562497+0000","last_became_active":"2024-09-12T00:18:24.877964+0000","last_became_peered":"2024-09-12T00:18:24.877964+0000","last_unstale":"2024-09-12T01:04:55.562497+0000","last_undegraded":"2024-09-12T01:04:55.562497+0000","last_fullsized":"2024-09-12T01:04:55.562497+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1283","last_scrub_stamp":"2024-09-12T01:04:55.562178+0000","last_deep_scrub":"268'1283","last_deep_scrub_stamp":"2024-09-12T01:04:55.562178+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.562178+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":1200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:32.688184+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6082,"num_read_kb":5401,"num_write":1732,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4650,"num_omap_keys":19,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":538,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:45.470785+0000","last_change":"2024-09-12T01:04:45.470703+0000","last_active":"2024-09-12T01:04:45.470785+0000","last_peered":"2024-09-12T01:04:45.470785+0000","last_clean":"2024-09-12T01:04:45.470785+0000","last_became_active":"2024-09-12T00:18:08.874442+0000","last_became_peered":"2024-09-12T00:18:08.874442+0000","last_unstale":"2024-09-12T01:04:45.470785+0000","last_undegraded":"2024-09-12T01:04:45.470785+0000","last_fullsized":"2024-09-12T01:04:45.470785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:45.470576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:45.470576+0000","last_clean_scrub_stamp":"2024-09-12T01:04:45.470576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:41.288997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010707620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'375","reported_seq":1102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.584327+0000","last_change":"2024-09-12T01:04:47.584327+0000","last_active":"2024-09-12T01:04:47.584327+0000","last_peered":"2024-09-12T01:04:47.584327+0000","last_clean":"2024-09-12T01:04:47.584327+0000","last_became_active":"2024-09-12T00:18:22.834724+0000","last_became_peered":"2024-09-12T00:18:22.834724+0000","last_unstale":"2024-09-12T01:04:47.584327+0000","last_undegraded":"2024-09-12T01:04:47.584327+0000","last_fullsized":"2024-09-12T01:04:47.584327+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'375","last_scrub_stamp":"2024-09-12T01:04:47.584227+0000","last_deep_scrub":"268'375","last_deep_scrub_stamp":"2024-09-12T01:04:47.584227+0000","last_clean_scrub_stamp":"2024-09-12T01:04:47.584227+0000","objects_scrubbed":9,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:17.877057+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":674,"num_read_kb":9051,"num_write":1222,"num_write_kb":24587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"268'2","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.486178+0000","last_change":"2024-09-12T01:04:56.486013+0000","last_active":"2024-09-12T01:04:56.486178+0000","last_peered":"2024-09-12T01:04:56.486178+0000","last_clean":"2024-09-12T01:04:56.486178+0000","last_became_active":"2024-09-12T00:18:26.867343+0000","last_became_peered":"2024-09-12T00:18:26.867343+0000","last_unstale":"2024-09-12T01:04:56.486178+0000","last_undegraded":"2024-09-12T01:04:56.486178+0000","last_fullsized":"2024-09-12T01:04:56.486178+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:04:56.485822+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:04:56.485822+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.485822+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:33.613654+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'261","reported_seq":1373,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.541125+0000","last_change":"2024-09-12T01:05:09.541125+0000","last_active":"2024-09-12T01:05:09.541125+0000","last_peered":"2024-09-12T01:05:09.541125+0000","last_clean":"2024-09-12T01:05:09.541125+0000","last_became_active":"2024-09-12T00:18:28.889058+0000","last_became_peered":"2024-09-12T00:18:28.889058+0000","last_unstale":"2024-09-12T01:05:09.541125+0000","last_undegraded":"2024-09-12T01:05:09.541125+0000","last_fullsized":"2024-09-12T01:05:09.541125+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'261","last_scrub_stamp":"2024-09-12T01:05:09.540895+0000","last_deep_scrub":"268'261","last_deep_scrub_stamp":"2024-09-12T01:05:09.540895+0000","last_clean_scrub_stamp":"2024-09-12T01:05:09.540895+0000","objects_scrubbed":9,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:27.914177+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":190,"num_read_kb":179,"num_write":165,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.215476+0000","last_change":"2024-09-12T01:05:09.215476+0000","last_active":"2024-09-12T01:05:09.215476+0000","last_peered":"2024-09-12T01:05:09.215476+0000","last_clean":"2024-09-12T01:05:09.215476+0000","last_became_active":"2024-09-12T00:18:30.896073+0000","last_became_peered":"2024-09-12T00:18:30.896073+0000","last_unstale":"2024-09-12T01:05:09.215476+0000","last_undegraded":"2024-09-12T01:05:09.215476+0000","last_fullsized":"2024-09-12T01:05:09.215476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:09.215305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:09.215305+0000","last_clean_scrub_stamp":"2024-09-12T01:05:09.215305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:51.474097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'274","reported_seq":895,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:24.077669+0000","last_change":"2024-09-12T01:05:24.077480+0000","last_active":"2024-09-12T01:05:24.077669+0000","last_peered":"2024-09-12T01:05:24.077669+0000","last_clean":"2024-09-12T01:05:24.077669+0000","last_became_active":"2024-09-12T00:18:32.914004+0000","last_became_peered":"2024-09-12T00:18:32.914004+0000","last_unstale":"2024-09-12T01:05:24.077669+0000","last_undegraded":"2024-09-12T01:05:24.077669+0000","last_fullsized":"2024-09-12T01:05:24.077669+0000","mapping_epoch":34,"log_start":"268'200","ondisk_log_start":"268'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'274","last_scrub_stamp":"2024-09-12T01:05:24.077297+0000","last_deep_scrub":"268'274","last_deep_scrub_stamp":"2024-09-12T01:05:24.077297+0000","last_clean_scrub_stamp":"2024-09-12T01:05:24.077297+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:56.784653+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":517,"num_read_kb":535,"num_write":598,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'821","reported_seq":2386,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.584590+0000","last_change":"2024-09-12T01:04:54.584590+0000","last_active":"2024-09-12T01:04:54.584590+0000","last_peered":"2024-09-12T01:04:54.584590+0000","last_clean":"2024-09-12T01:04:54.584590+0000","last_became_active":"2024-09-12T00:18:24.869633+0000","last_became_peered":"2024-09-12T00:18:24.869633+0000","last_unstale":"2024-09-12T01:04:54.584590+0000","last_undegraded":"2024-09-12T01:04:54.584590+0000","last_fullsized":"2024-09-12T01:04:54.584590+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'821","last_scrub_stamp":"2024-09-12T01:04:54.584398+0000","last_deep_scrub":"268'821","last_deep_scrub_stamp":"2024-09-12T01:04:54.584398+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.584398+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:12.332775+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3879,"num_read_kb":3488,"num_write":1067,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"268'3","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.564757+0000","last_change":"2024-09-12T01:04:49.564570+0000","last_active":"2024-09-12T01:04:49.564757+0000","last_peered":"2024-09-12T01:04:49.564757+0000","last_clean":"2024-09-12T01:04:49.564757+0000","last_became_active":"2024-09-12T00:18:08.645156+0000","last_became_peered":"2024-09-12T00:18:08.645156+0000","last_unstale":"2024-09-12T01:04:49.564757+0000","last_undegraded":"2024-09-12T01:04:49.564757+0000","last_fullsized":"2024-09-12T01:04:49.564757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:04:49.564383+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:04:49.564383+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.564383+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:52.244469+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0024595709999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'395","reported_seq":1086,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.209032+0000","last_change":"2024-09-12T01:04:48.209032+0000","last_active":"2024-09-12T01:04:48.209032+0000","last_peered":"2024-09-12T01:04:48.209032+0000","last_clean":"2024-09-12T01:04:48.209032+0000","last_became_active":"2024-09-12T00:18:22.854940+0000","last_became_peered":"2024-09-12T00:18:22.854940+0000","last_unstale":"2024-09-12T01:04:48.209032+0000","last_undegraded":"2024-09-12T01:04:48.209032+0000","last_fullsized":"2024-09-12T01:04:48.209032+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'395","last_scrub_stamp":"2024-09-12T01:04:48.208822+0000","last_deep_scrub":"268'395","last_deep_scrub_stamp":"2024-09-12T01:04:48.208822+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.208822+0000","objects_scrubbed":8,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:04.445359+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7046756,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":598,"num_read_kb":32178,"num_write":1236,"num_write_kb":29732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.329680+0000","last_change":"2024-09-12T01:05:04.329680+0000","last_active":"2024-09-12T01:05:04.329680+0000","last_peered":"2024-09-12T01:05:04.329680+0000","last_clean":"2024-09-12T01:05:04.329680+0000","last_became_active":"2024-09-12T00:18:26.855239+0000","last_became_peered":"2024-09-12T00:18:26.855239+0000","last_unstale":"2024-09-12T01:05:04.329680+0000","last_undegraded":"2024-09-12T01:05:04.329680+0000","last_fullsized":"2024-09-12T01:05:04.329680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:04.329492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:04.329492+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.329492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:56.131898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'129","reported_seq":686,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.075044+0000","last_change":"2024-09-12T01:05:13.075044+0000","last_active":"2024-09-12T01:05:13.075044+0000","last_peered":"2024-09-12T01:05:13.075044+0000","last_clean":"2024-09-12T01:05:13.075044+0000","last_became_active":"2024-09-12T00:18:28.891173+0000","last_became_peered":"2024-09-12T00:18:28.891173+0000","last_unstale":"2024-09-12T01:05:13.075044+0000","last_undegraded":"2024-09-12T01:05:13.075044+0000","last_fullsized":"2024-09-12T01:05:13.075044+0000","mapping_epoch":30,"log_start":"268'100","ondisk_log_start":"268'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'129","last_scrub_stamp":"2024-09-12T01:05:13.074823+0000","last_deep_scrub":"268'129","last_deep_scrub_stamp":"2024-09-12T01:05:13.074823+0000","last_clean_scrub_stamp":"2024-09-12T01:05:13.074823+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:19.910471+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":142,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3226,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.708410+0000","last_change":"2024-09-12T01:05:03.708410+0000","last_active":"2024-09-12T01:05:03.708410+0000","last_peered":"2024-09-12T01:05:03.708410+0000","last_clean":"2024-09-12T01:05:03.708410+0000","last_became_active":"2024-09-12T00:18:30.904080+0000","last_became_peered":"2024-09-12T00:18:30.904080+0000","last_unstale":"2024-09-12T01:05:03.708410+0000","last_undegraded":"2024-09-12T01:05:03.708410+0000","last_fullsized":"2024-09-12T01:05:03.708410+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:03.708236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:03.708236+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.708236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:54.206218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'110","reported_seq":668,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.576677+0000","last_change":"2024-09-12T01:05:19.576677+0000","last_active":"2024-09-12T01:05:19.576677+0000","last_peered":"2024-09-12T01:05:19.576677+0000","last_clean":"2024-09-12T01:05:19.576677+0000","last_became_active":"2024-09-12T00:18:32.903109+0000","last_became_peered":"2024-09-12T00:18:32.903109+0000","last_unstale":"2024-09-12T01:05:19.576677+0000","last_undegraded":"2024-09-12T01:05:19.576677+0000","last_fullsized":"2024-09-12T01:05:19.576677+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'110","last_scrub_stamp":"2024-09-12T01:05:19.576486+0000","last_deep_scrub":"268'110","last_deep_scrub_stamp":"2024-09-12T01:05:19.576486+0000","last_clean_scrub_stamp":"2024-09-12T01:05:19.576486+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:01.415265+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":852,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":206,"num_read_kb":202,"num_write":268,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'474","reported_seq":1995,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.604762+0000","last_change":"2024-09-12T01:04:56.604762+0000","last_active":"2024-09-12T01:04:56.604762+0000","last_peered":"2024-09-12T01:04:56.604762+0000","last_clean":"2024-09-12T01:04:56.604762+0000","last_became_active":"2024-09-12T00:18:24.878031+0000","last_became_peered":"2024-09-12T00:18:24.878031+0000","last_unstale":"2024-09-12T01:04:56.604762+0000","last_undegraded":"2024-09-12T01:04:56.604762+0000","last_fullsized":"2024-09-12T01:04:56.604762+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'474","last_scrub_stamp":"2024-09-12T01:04:56.604574+0000","last_deep_scrub":"268'474","last_deep_scrub_stamp":"2024-09-12T01:04:56.604574+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.604574+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:32.788784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2325,"num_read_kb":2173,"num_write":541,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'312","reported_seq":934,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.530946+0000","last_change":"2024-09-12T01:04:50.530946+0000","last_active":"2024-09-12T01:04:50.530946+0000","last_peered":"2024-09-12T01:04:50.530946+0000","last_clean":"2024-09-12T01:04:50.530946+0000","last_became_active":"2024-09-12T00:18:22.861336+0000","last_became_peered":"2024-09-12T00:18:22.861336+0000","last_unstale":"2024-09-12T01:04:50.530946+0000","last_undegraded":"2024-09-12T01:04:50.530946+0000","last_fullsized":"2024-09-12T01:04:50.530946+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'312","last_scrub_stamp":"2024-09-12T01:04:50.530749+0000","last_deep_scrub":"268'312","last_deep_scrub_stamp":"2024-09-12T01:04:50.530749+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.530749+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:38.701302+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194334,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":409,"num_read_kb":16866,"num_write":952,"num_write_kb":39669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":540,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:46.542439+0000","last_change":"2024-09-12T01:04:46.542394+0000","last_active":"2024-09-12T01:04:46.542439+0000","last_peered":"2024-09-12T01:04:46.542439+0000","last_clean":"2024-09-12T01:04:46.542439+0000","last_became_active":"2024-09-12T00:18:08.956785+0000","last_became_peered":"2024-09-12T00:18:08.956785+0000","last_unstale":"2024-09-12T01:04:46.542439+0000","last_undegraded":"2024-09-12T01:04:46.542439+0000","last_fullsized":"2024-09-12T01:04:46.542439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:46.542326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:46.542326+0000","last_clean_scrub_stamp":"2024-09-12T01:04:46.542326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:00.080671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012417909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.367455+0000","last_change":"2024-09-12T01:05:03.367455+0000","last_active":"2024-09-12T01:05:03.367455+0000","last_peered":"2024-09-12T01:05:03.367455+0000","last_clean":"2024-09-12T01:05:03.367455+0000","last_became_active":"2024-09-12T00:18:26.879511+0000","last_became_peered":"2024-09-12T00:18:26.879511+0000","last_unstale":"2024-09-12T01:05:03.367455+0000","last_undegraded":"2024-09-12T01:05:03.367455+0000","last_fullsized":"2024-09-12T01:05:03.367455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:03.367276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:03.367276+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.367276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:35.236252+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'571","reported_seq":1258,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:07.272500+0000","last_change":"2024-09-12T01:05:07.272500+0000","last_active":"2024-09-12T01:05:07.272500+0000","last_peered":"2024-09-12T01:05:07.272500+0000","last_clean":"2024-09-12T01:05:07.272500+0000","last_became_active":"2024-09-12T00:18:28.879614+0000","last_became_peered":"2024-09-12T00:18:28.879614+0000","last_unstale":"2024-09-12T01:05:07.272500+0000","last_undegraded":"2024-09-12T01:05:07.272500+0000","last_fullsized":"2024-09-12T01:05:07.272500+0000","mapping_epoch":30,"log_start":"268'500","ondisk_log_start":"268'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'571","last_scrub_stamp":"2024-09-12T01:05:07.272279+0000","last_deep_scrub":"268'571","last_deep_scrub_stamp":"2024-09-12T01:05:07.272279+0000","last_clean_scrub_stamp":"2024-09-12T01:05:07.272279+0000","objects_scrubbed":11,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:01.844534+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100174,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":946,"num_read_kb":2084,"num_write":804,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10824,"num_omap_keys":26,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:16.195170+0000","last_change":"2024-09-12T01:05:16.195170+0000","last_active":"2024-09-12T01:05:16.195170+0000","last_peered":"2024-09-12T01:05:16.195170+0000","last_clean":"2024-09-12T01:05:16.195170+0000","last_became_active":"2024-09-12T00:18:30.903532+0000","last_became_peered":"2024-09-12T00:18:30.903532+0000","last_unstale":"2024-09-12T01:05:16.195170+0000","last_undegraded":"2024-09-12T01:05:16.195170+0000","last_fullsized":"2024-09-12T01:05:16.195170+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:16.194961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:16.194961+0000","last_clean_scrub_stamp":"2024-09-12T01:05:16.194961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:04.425970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'146","reported_seq":662,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.094269+0000","last_change":"2024-09-12T01:05:20.094131+0000","last_active":"2024-09-12T01:05:20.094269+0000","last_peered":"2024-09-12T01:05:20.094269+0000","last_clean":"2024-09-12T01:05:20.094269+0000","last_became_active":"2024-09-12T00:18:32.896532+0000","last_became_peered":"2024-09-12T00:18:32.896532+0000","last_unstale":"2024-09-12T01:05:20.094269+0000","last_undegraded":"2024-09-12T01:05:20.094269+0000","last_fullsized":"2024-09-12T01:05:20.094269+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'146","last_scrub_stamp":"2024-09-12T01:05:20.093935+0000","last_deep_scrub":"268'146","last_deep_scrub_stamp":"2024-09-12T01:05:20.093935+0000","last_clean_scrub_stamp":"2024-09-12T01:05:20.093935+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:50.320749+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":147,"num_read_kb":138,"num_write":339,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'365","reported_seq":1912,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.176764+0000","last_change":"2024-09-12T01:04:53.176764+0000","last_active":"2024-09-12T01:04:53.176764+0000","last_peered":"2024-09-12T01:04:53.176764+0000","last_clean":"2024-09-12T01:04:53.176764+0000","last_became_active":"2024-09-12T00:18:24.852620+0000","last_became_peered":"2024-09-12T00:18:24.852620+0000","last_unstale":"2024-09-12T01:04:53.176764+0000","last_undegraded":"2024-09-12T01:04:53.176764+0000","last_fullsized":"2024-09-12T01:04:53.176764+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'365","last_scrub_stamp":"2024-09-12T01:04:53.176561+0000","last_deep_scrub":"268'365","last_deep_scrub_stamp":"2024-09-12T01:04:53.176561+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.176561+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:08.338535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2109,"num_read_kb":2037,"num_write":400,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'349","reported_seq":1003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.521739+0000","last_change":"2024-09-12T01:04:49.521739+0000","last_active":"2024-09-12T01:04:49.521739+0000","last_peered":"2024-09-12T01:04:49.521739+0000","last_clean":"2024-09-12T01:04:49.521739+0000","last_became_active":"2024-09-12T00:18:22.839001+0000","last_became_peered":"2024-09-12T00:18:22.839001+0000","last_unstale":"2024-09-12T01:04:49.521739+0000","last_undegraded":"2024-09-12T01:04:49.521739+0000","last_fullsized":"2024-09-12T01:04:49.521739+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'349","last_scrub_stamp":"2024-09-12T01:04:49.521528+0000","last_deep_scrub":"268'349","last_deep_scrub_stamp":"2024-09-12T01:04:49.521528+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.521528+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:43.868981+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":481,"num_read_kb":59946,"num_write":977,"num_write_kb":34875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.373441+0000","last_change":"2024-09-12T01:04:49.373441+0000","last_active":"2024-09-12T01:04:49.373441+0000","last_peered":"2024-09-12T01:04:49.373441+0000","last_clean":"2024-09-12T01:04:49.373441+0000","last_became_active":"2024-09-12T00:18:08.958069+0000","last_became_peered":"2024-09-12T00:18:08.958069+0000","last_unstale":"2024-09-12T01:04:49.373441+0000","last_undegraded":"2024-09-12T01:04:49.373441+0000","last_fullsized":"2024-09-12T01:04:49.373441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:49.373275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:49.373275+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.373275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:16.974812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001047189,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.627037+0000","last_change":"2024-09-12T01:05:00.627037+0000","last_active":"2024-09-12T01:05:00.627037+0000","last_peered":"2024-09-12T01:05:00.627037+0000","last_clean":"2024-09-12T01:05:00.627037+0000","last_became_active":"2024-09-12T00:18:26.865743+0000","last_became_peered":"2024-09-12T00:18:26.865743+0000","last_unstale":"2024-09-12T01:05:00.627037+0000","last_undegraded":"2024-09-12T01:05:00.627037+0000","last_fullsized":"2024-09-12T01:05:00.627037+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:00.626750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:00.626750+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.626750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:33.255245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'172","reported_seq":757,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.595331+0000","last_change":"2024-09-12T01:05:04.595331+0000","last_active":"2024-09-12T01:05:04.595331+0000","last_peered":"2024-09-12T01:05:04.595331+0000","last_clean":"2024-09-12T01:05:04.595331+0000","last_became_active":"2024-09-12T00:18:28.877233+0000","last_became_peered":"2024-09-12T00:18:28.877233+0000","last_unstale":"2024-09-12T01:05:04.595331+0000","last_undegraded":"2024-09-12T01:05:04.595331+0000","last_fullsized":"2024-09-12T01:05:04.595331+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'172","last_scrub_stamp":"2024-09-12T01:05:04.595140+0000","last_deep_scrub":"268'172","last_deep_scrub_stamp":"2024-09-12T01:05:04.595140+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.595140+0000","objects_scrubbed":8,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:08.053394+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":206,"num_read_kb":196,"num_write":136,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'793","reported_seq":2616,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:16.566566+0000","last_change":"2024-09-12T01:05:16.566566+0000","last_active":"2024-09-12T01:05:16.566566+0000","last_peered":"2024-09-12T01:05:16.566566+0000","last_clean":"2024-09-12T01:05:16.566566+0000","last_became_active":"2024-09-12T00:18:30.873484+0000","last_became_peered":"2024-09-12T00:18:30.873484+0000","last_unstale":"2024-09-12T01:05:16.566566+0000","last_undegraded":"2024-09-12T01:05:16.566566+0000","last_fullsized":"2024-09-12T01:05:16.566566+0000","mapping_epoch":32,"log_start":"268'702","ondisk_log_start":"268'702","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'793","last_scrub_stamp":"2024-09-12T01:05:16.566382+0000","last_deep_scrub":"268'793","last_deep_scrub_stamp":"2024-09-12T01:05:16.566382+0000","last_clean_scrub_stamp":"2024-09-12T01:05:16.566382+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":702,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:02.420995+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'166","reported_seq":693,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:23.075092+0000","last_change":"2024-09-12T01:05:23.074944+0000","last_active":"2024-09-12T01:05:23.075092+0000","last_peered":"2024-09-12T01:05:23.075092+0000","last_clean":"2024-09-12T01:05:23.075092+0000","last_became_active":"2024-09-12T00:18:32.893315+0000","last_became_peered":"2024-09-12T00:18:32.893315+0000","last_unstale":"2024-09-12T01:05:23.075092+0000","last_undegraded":"2024-09-12T01:05:23.075092+0000","last_fullsized":"2024-09-12T01:05:23.075092+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'166","last_scrub_stamp":"2024-09-12T01:05:23.074744+0000","last_deep_scrub":"268'166","last_deep_scrub_stamp":"2024-09-12T01:05:23.074744+0000","last_clean_scrub_stamp":"2024-09-12T01:05:23.074744+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:54.155808+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":923,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":201,"num_read_kb":185,"num_write":395,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'453","reported_seq":2025,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.185147+0000","last_change":"2024-09-12T01:04:56.185147+0000","last_active":"2024-09-12T01:04:56.185147+0000","last_peered":"2024-09-12T01:04:56.185147+0000","last_clean":"2024-09-12T01:04:56.185147+0000","last_became_active":"2024-09-12T00:18:24.865603+0000","last_became_peered":"2024-09-12T00:18:24.865603+0000","last_unstale":"2024-09-12T01:04:56.185147+0000","last_undegraded":"2024-09-12T01:04:56.185147+0000","last_fullsized":"2024-09-12T01:04:56.185147+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'453","last_scrub_stamp":"2024-09-12T01:04:56.184924+0000","last_deep_scrub":"268'453","last_deep_scrub_stamp":"2024-09-12T01:04:56.184924+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.184924+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:02.597927+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2591,"num_read_kb":2430,"num_write":539,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'362","reported_seq":995,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.313872+0000","last_change":"2024-09-12T01:04:47.313725+0000","last_active":"2024-09-12T01:04:47.313872+0000","last_peered":"2024-09-12T01:04:47.313872+0000","last_clean":"2024-09-12T01:04:47.313872+0000","last_became_active":"2024-09-12T00:18:22.870180+0000","last_became_peered":"2024-09-12T00:18:22.870180+0000","last_unstale":"2024-09-12T01:04:47.313872+0000","last_undegraded":"2024-09-12T01:04:47.313872+0000","last_fullsized":"2024-09-12T01:04:47.313872+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'362","last_scrub_stamp":"2024-09-12T01:04:47.313542+0000","last_deep_scrub":"268'362","last_deep_scrub_stamp":"2024-09-12T01:04:47.313542+0000","last_clean_scrub_stamp":"2024-09-12T01:04:47.313542+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:20.898497+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":450,"num_read_kb":16363,"num_write":1061,"num_write_kb":31356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":539,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:45.528298+0000","last_change":"2024-09-12T01:04:45.528242+0000","last_active":"2024-09-12T01:04:45.528298+0000","last_peered":"2024-09-12T01:04:45.528298+0000","last_clean":"2024-09-12T01:04:45.528298+0000","last_became_active":"2024-09-12T00:18:08.638003+0000","last_became_peered":"2024-09-12T00:18:08.638003+0000","last_unstale":"2024-09-12T01:04:45.528298+0000","last_undegraded":"2024-09-12T01:04:45.528298+0000","last_fullsized":"2024-09-12T01:04:45.528298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:45.528131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:45.528131+0000","last_clean_scrub_stamp":"2024-09-12T01:04:45.528131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:02.250802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010953429999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:08.194135+0000","last_change":"2024-09-12T01:05:08.194135+0000","last_active":"2024-09-12T01:05:08.194135+0000","last_peered":"2024-09-12T01:05:08.194135+0000","last_clean":"2024-09-12T01:05:08.194135+0000","last_became_active":"2024-09-12T00:18:26.858300+0000","last_became_peered":"2024-09-12T00:18:26.858300+0000","last_unstale":"2024-09-12T01:05:08.194135+0000","last_undegraded":"2024-09-12T01:05:08.194135+0000","last_fullsized":"2024-09-12T01:05:08.194135+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:08.193956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:08.193956+0000","last_clean_scrub_stamp":"2024-09-12T01:05:08.193956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:19.373254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'115","reported_seq":672,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:12.182678+0000","last_change":"2024-09-12T01:05:12.182678+0000","last_active":"2024-09-12T01:05:12.182678+0000","last_peered":"2024-09-12T01:05:12.182678+0000","last_clean":"2024-09-12T01:05:12.182678+0000","last_became_active":"2024-09-12T00:18:28.880684+0000","last_became_peered":"2024-09-12T00:18:28.880684+0000","last_unstale":"2024-09-12T01:05:12.182678+0000","last_undegraded":"2024-09-12T01:05:12.182678+0000","last_fullsized":"2024-09-12T01:05:12.182678+0000","mapping_epoch":30,"log_start":"268'100","ondisk_log_start":"268'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'115","last_scrub_stamp":"2024-09-12T01:05:12.182490+0000","last_deep_scrub":"268'115","last_deep_scrub_stamp":"2024-09-12T01:05:12.182490+0000","last_clean_scrub_stamp":"2024-09-12T01:05:12.182490+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:17.746846+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'817","reported_seq":2650,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:18.115608+0000","last_change":"2024-09-12T01:05:18.115608+0000","last_active":"2024-09-12T01:05:18.115608+0000","last_peered":"2024-09-12T01:05:18.115608+0000","last_clean":"2024-09-12T01:05:18.115608+0000","last_became_active":"2024-09-12T00:18:30.902580+0000","last_became_peered":"2024-09-12T00:18:30.902580+0000","last_unstale":"2024-09-12T01:05:18.115608+0000","last_undegraded":"2024-09-12T01:05:18.115608+0000","last_fullsized":"2024-09-12T01:05:18.115608+0000","mapping_epoch":32,"log_start":"268'800","ondisk_log_start":"268'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'817","last_scrub_stamp":"2024-09-12T01:05:18.115426+0000","last_deep_scrub":"268'817","last_deep_scrub_stamp":"2024-09-12T01:05:18.115426+0000","last_clean_scrub_stamp":"2024-09-12T01:05:18.115426+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:40.730445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'176","reported_seq":685,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.130853+0000","last_change":"2024-09-12T01:05:19.130705+0000","last_active":"2024-09-12T01:05:19.130853+0000","last_peered":"2024-09-12T01:05:19.130853+0000","last_clean":"2024-09-12T01:05:19.130853+0000","last_became_active":"2024-09-12T00:18:32.902970+0000","last_became_peered":"2024-09-12T00:18:32.902970+0000","last_unstale":"2024-09-12T01:05:19.130853+0000","last_undegraded":"2024-09-12T01:05:19.130853+0000","last_fullsized":"2024-09-12T01:05:19.130853+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'176","last_scrub_stamp":"2024-09-12T01:05:19.130483+0000","last_deep_scrub":"268'176","last_deep_scrub_stamp":"2024-09-12T01:05:19.130483+0000","last_clean_scrub_stamp":"2024-09-12T01:05:19.130483+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:48.772293+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":388,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'597","reported_seq":2178,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.221206+0000","last_change":"2024-09-12T01:04:52.221206+0000","last_active":"2024-09-12T01:04:52.221206+0000","last_peered":"2024-09-12T01:04:52.221206+0000","last_clean":"2024-09-12T01:04:52.221206+0000","last_became_active":"2024-09-12T00:18:24.879205+0000","last_became_peered":"2024-09-12T00:18:24.879205+0000","last_unstale":"2024-09-12T01:04:52.221206+0000","last_undegraded":"2024-09-12T01:04:52.221206+0000","last_fullsized":"2024-09-12T01:04:52.221206+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'597","last_scrub_stamp":"2024-09-12T01:04:52.220980+0000","last_deep_scrub":"268'597","last_deep_scrub_stamp":"2024-09-12T01:04:52.220980+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.220980+0000","objects_scrubbed":9,"log_size":97,"log_dups_size":500,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:56.848160+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":3160,"num_read_kb":2876,"num_write":787,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2409,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'346","reported_seq":1076,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:45.268384+0000","last_change":"2024-09-12T01:04:45.268249+0000","last_active":"2024-09-12T01:04:45.268384+0000","last_peered":"2024-09-12T01:04:45.268384+0000","last_clean":"2024-09-12T01:04:45.268384+0000","last_became_active":"2024-09-12T00:18:22.850326+0000","last_became_peered":"2024-09-12T00:18:22.850326+0000","last_unstale":"2024-09-12T01:04:45.268384+0000","last_undegraded":"2024-09-12T01:04:45.268384+0000","last_fullsized":"2024-09-12T01:04:45.268384+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'346","last_scrub_stamp":"2024-09-12T01:04:45.268124+0000","last_deep_scrub":"268'346","last_deep_scrub_stamp":"2024-09-12T01:04:45.268124+0000","last_clean_scrub_stamp":"2024-09-12T01:04:45.268124+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:15.830198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":560,"num_read_kb":1535,"num_write":1060,"num_write_kb":23375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.745127+0000","last_change":"2024-09-12T01:04:47.744967+0000","last_active":"2024-09-12T01:04:47.745127+0000","last_peered":"2024-09-12T01:04:47.745127+0000","last_clean":"2024-09-12T01:04:47.745127+0000","last_became_active":"2024-09-12T00:18:08.648187+0000","last_became_peered":"2024-09-12T00:18:08.648187+0000","last_unstale":"2024-09-12T01:04:47.745127+0000","last_undegraded":"2024-09-12T01:04:47.745127+0000","last_fullsized":"2024-09-12T01:04:47.745127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:47.744772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:47.744772+0000","last_clean_scrub_stamp":"2024-09-12T01:04:47.744772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:48.648305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001130048,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:08.026683+0000","last_change":"2024-09-12T01:05:08.026683+0000","last_active":"2024-09-12T01:05:08.026683+0000","last_peered":"2024-09-12T01:05:08.026683+0000","last_clean":"2024-09-12T01:05:08.026683+0000","last_became_active":"2024-09-12T00:18:26.851038+0000","last_became_peered":"2024-09-12T00:18:26.851038+0000","last_unstale":"2024-09-12T01:05:08.026683+0000","last_undegraded":"2024-09-12T01:05:08.026683+0000","last_fullsized":"2024-09-12T01:05:08.026683+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:08.026477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:08.026477+0000","last_clean_scrub_stamp":"2024-09-12T01:05:08.026477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:14.731757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'755","reported_seq":1489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:08.531549+0000","last_change":"2024-09-12T01:05:08.531549+0000","last_active":"2024-09-12T01:05:08.531549+0000","last_peered":"2024-09-12T01:05:08.531549+0000","last_clean":"2024-09-12T01:05:08.531549+0000","last_became_active":"2024-09-12T00:18:28.884726+0000","last_became_peered":"2024-09-12T00:18:28.884726+0000","last_unstale":"2024-09-12T01:05:08.531549+0000","last_undegraded":"2024-09-12T01:05:08.531549+0000","last_fullsized":"2024-09-12T01:05:08.531549+0000","mapping_epoch":30,"log_start":"268'700","ondisk_log_start":"268'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'755","last_scrub_stamp":"2024-09-12T01:05:08.531341+0000","last_deep_scrub":"268'755","last_deep_scrub_stamp":"2024-09-12T01:05:08.531341+0000","last_clean_scrub_stamp":"2024-09-12T01:05:08.531341+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:07.665283+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153841,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1337,"num_read_kb":3208,"num_write":1092,"num_write_kb":920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.075130+0000","last_change":"2024-09-12T01:05:19.075130+0000","last_active":"2024-09-12T01:05:19.075130+0000","last_peered":"2024-09-12T01:05:19.075130+0000","last_clean":"2024-09-12T01:05:19.075130+0000","last_became_active":"2024-09-12T00:18:30.900777+0000","last_became_peered":"2024-09-12T00:18:30.900777+0000","last_unstale":"2024-09-12T01:05:19.075130+0000","last_undegraded":"2024-09-12T01:05:19.075130+0000","last_fullsized":"2024-09-12T01:05:19.075130+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:19.074938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:19.074938+0000","last_clean_scrub_stamp":"2024-09-12T01:05:19.074938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:47.649281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'114","reported_seq":620,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.587716+0000","last_change":"2024-09-12T01:05:20.587583+0000","last_active":"2024-09-12T01:05:20.587716+0000","last_peered":"2024-09-12T01:05:20.587716+0000","last_clean":"2024-09-12T01:05:20.587716+0000","last_became_active":"2024-09-12T00:18:32.899881+0000","last_became_peered":"2024-09-12T00:18:32.899881+0000","last_unstale":"2024-09-12T01:05:20.587716+0000","last_undegraded":"2024-09-12T01:05:20.587716+0000","last_fullsized":"2024-09-12T01:05:20.587716+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'114","last_scrub_stamp":"2024-09-12T01:05:20.587401+0000","last_deep_scrub":"268'114","last_deep_scrub_stamp":"2024-09-12T01:05:20.587401+0000","last_clean_scrub_stamp":"2024-09-12T01:05:20.587401+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:26.494254+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":105,"num_write":264,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'148","reported_seq":719,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:22.070821+0000","last_change":"2024-09-12T01:05:22.070821+0000","last_active":"2024-09-12T01:05:22.070821+0000","last_peered":"2024-09-12T01:05:22.070821+0000","last_clean":"2024-09-12T01:05:22.070821+0000","last_became_active":"2024-09-12T00:18:32.902596+0000","last_became_peered":"2024-09-12T00:18:32.902596+0000","last_unstale":"2024-09-12T01:05:22.070821+0000","last_undegraded":"2024-09-12T01:05:22.070821+0000","last_fullsized":"2024-09-12T01:05:22.070821+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'148","last_scrub_stamp":"2024-09-12T01:05:22.070634+0000","last_deep_scrub":"268'148","last_deep_scrub_stamp":"2024-09-12T01:05:22.070634+0000","last_clean_scrub_stamp":"2024-09-12T01:05:22.070634+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:47.287403+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":238,"num_read_kb":229,"num_write":342,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'487","reported_seq":2119,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.218217+0000","last_change":"2024-09-12T01:04:57.217970+0000","last_active":"2024-09-12T01:04:57.218217+0000","last_peered":"2024-09-12T01:04:57.218217+0000","last_clean":"2024-09-12T01:04:57.218217+0000","last_became_active":"2024-09-12T00:18:24.879640+0000","last_became_peered":"2024-09-12T00:18:24.879640+0000","last_unstale":"2024-09-12T01:04:57.218217+0000","last_undegraded":"2024-09-12T01:04:57.218217+0000","last_fullsized":"2024-09-12T01:04:57.218217+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'487","last_scrub_stamp":"2024-09-12T01:04:57.217724+0000","last_deep_scrub":"268'487","last_deep_scrub_stamp":"2024-09-12T01:04:57.217724+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.217724+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:38.656659+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2579,"num_read_kb":2446,"num_write":588,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'391","reported_seq":1051,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.218806+0000","last_change":"2024-09-12T01:04:49.218588+0000","last_active":"2024-09-12T01:04:49.218806+0000","last_peered":"2024-09-12T01:04:49.218806+0000","last_clean":"2024-09-12T01:04:49.218806+0000","last_became_active":"2024-09-12T00:18:22.874059+0000","last_became_peered":"2024-09-12T00:18:22.874059+0000","last_unstale":"2024-09-12T01:04:49.218806+0000","last_undegraded":"2024-09-12T01:04:49.218806+0000","last_fullsized":"2024-09-12T01:04:49.218806+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'391","last_scrub_stamp":"2024-09-12T01:04:49.218318+0000","last_deep_scrub":"268'391","last_deep_scrub_stamp":"2024-09-12T01:04:49.218318+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.218318+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:02.132035+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":563,"num_read_kb":19542,"num_write":1220,"num_write_kb":37354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.571812+0000","last_change":"2024-09-12T01:05:01.571742+0000","last_active":"2024-09-12T01:05:01.571812+0000","last_peered":"2024-09-12T01:05:01.571812+0000","last_clean":"2024-09-12T01:05:01.571812+0000","last_became_active":"2024-09-12T00:18:26.866940+0000","last_became_peered":"2024-09-12T00:18:26.866940+0000","last_unstale":"2024-09-12T01:05:01.571812+0000","last_undegraded":"2024-09-12T01:05:01.571812+0000","last_fullsized":"2024-09-12T01:05:01.571812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:01.571641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:01.571641+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.571641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:47.206432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'300","reported_seq":897,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:15.045576+0000","last_change":"2024-09-12T01:05:15.045576+0000","last_active":"2024-09-12T01:05:15.045576+0000","last_peered":"2024-09-12T01:05:15.045576+0000","last_clean":"2024-09-12T01:05:15.045576+0000","last_became_active":"2024-09-12T00:18:28.877560+0000","last_became_peered":"2024-09-12T00:18:28.877560+0000","last_unstale":"2024-09-12T01:05:15.045576+0000","last_undegraded":"2024-09-12T01:05:15.045576+0000","last_fullsized":"2024-09-12T01:05:15.045576+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'300","last_scrub_stamp":"2024-09-12T01:05:15.045366+0000","last_deep_scrub":"268'300","last_deep_scrub_stamp":"2024-09-12T01:05:15.045366+0000","last_clean_scrub_stamp":"2024-09-12T01:05:15.045366+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:01.170647+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44815,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":481,"num_read_kb":1100,"num_write":392,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.067841+0000","last_change":"2024-09-12T01:05:20.067841+0000","last_active":"2024-09-12T01:05:20.067841+0000","last_peered":"2024-09-12T01:05:20.067841+0000","last_clean":"2024-09-12T01:05:20.067841+0000","last_became_active":"2024-09-12T00:18:30.901022+0000","last_became_peered":"2024-09-12T00:18:30.901022+0000","last_unstale":"2024-09-12T01:05:20.067841+0000","last_undegraded":"2024-09-12T01:05:20.067841+0000","last_fullsized":"2024-09-12T01:05:20.067841+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:20.067661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:20.067661+0000","last_clean_scrub_stamp":"2024-09-12T01:05:20.067661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:49.558004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'142","reported_seq":664,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:30.107435+0000","last_change":"2024-09-12T01:05:30.107435+0000","last_active":"2024-09-12T01:05:30.107435+0000","last_peered":"2024-09-12T01:05:30.107435+0000","last_clean":"2024-09-12T01:05:30.107435+0000","last_became_active":"2024-09-12T00:18:32.900434+0000","last_became_peered":"2024-09-12T00:18:32.900434+0000","last_unstale":"2024-09-12T01:05:30.107435+0000","last_undegraded":"2024-09-12T01:05:30.107435+0000","last_fullsized":"2024-09-12T01:05:30.107435+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'142","last_scrub_stamp":"2024-09-12T01:05:30.107252+0000","last_deep_scrub":"268'142","last_deep_scrub_stamp":"2024-09-12T01:05:30.107252+0000","last_clean_scrub_stamp":"2024-09-12T01:05:30.107252+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:29.618093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":83,"num_write":305,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'546","reported_seq":1971,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.579599+0000","last_change":"2024-09-12T01:04:58.579473+0000","last_active":"2024-09-12T01:04:58.579599+0000","last_peered":"2024-09-12T01:04:58.579599+0000","last_clean":"2024-09-12T01:04:58.579599+0000","last_became_active":"2024-09-12T00:18:24.878531+0000","last_became_peered":"2024-09-12T00:18:24.878531+0000","last_unstale":"2024-09-12T01:04:58.579599+0000","last_undegraded":"2024-09-12T01:04:58.579599+0000","last_fullsized":"2024-09-12T01:04:58.579599+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'546","last_scrub_stamp":"2024-09-12T01:04:58.579295+0000","last_deep_scrub":"268'546","last_deep_scrub_stamp":"2024-09-12T01:04:58.579295+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.579295+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:45.810541+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2546,"num_read_kb":2313,"num_write":710,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'415","reported_seq":1145,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.472885+0000","last_change":"2024-09-12T01:04:56.472885+0000","last_active":"2024-09-12T01:04:56.472885+0000","last_peered":"2024-09-12T01:04:56.472885+0000","last_clean":"2024-09-12T01:04:56.472885+0000","last_became_active":"2024-09-12T00:18:56.193958+0000","last_became_peered":"2024-09-12T00:18:56.193958+0000","last_unstale":"2024-09-12T01:04:56.472885+0000","last_undegraded":"2024-09-12T01:04:56.472885+0000","last_fullsized":"2024-09-12T01:04:56.472885+0000","mapping_epoch":37,"log_start":"268'400","ondisk_log_start":"268'400","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'415","last_scrub_stamp":"2024-09-12T01:04:56.472681+0000","last_deep_scrub":"268'415","last_deep_scrub_stamp":"2024-09-12T01:04:56.472681+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.472681+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:48.615635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":783,"num_read_kb":16311,"num_write":1252,"num_write_kb":28883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.040560+0000","last_change":"2024-09-12T01:05:04.040415+0000","last_active":"2024-09-12T01:05:04.040560+0000","last_peered":"2024-09-12T01:05:04.040560+0000","last_clean":"2024-09-12T01:05:04.040560+0000","last_became_active":"2024-09-12T00:18:26.852430+0000","last_became_peered":"2024-09-12T00:18:26.852430+0000","last_unstale":"2024-09-12T01:05:04.040560+0000","last_undegraded":"2024-09-12T01:05:04.040560+0000","last_fullsized":"2024-09-12T01:05:04.040560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:04.040228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:04.040228+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.040228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:38.093851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'50","reported_seq":564,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:10.219343+0000","last_change":"2024-09-12T01:05:10.219162+0000","last_active":"2024-09-12T01:05:10.219343+0000","last_peered":"2024-09-12T01:05:10.219343+0000","last_clean":"2024-09-12T01:05:10.219343+0000","last_became_active":"2024-09-12T00:18:28.888625+0000","last_became_peered":"2024-09-12T00:18:28.888625+0000","last_unstale":"2024-09-12T01:05:10.219343+0000","last_undegraded":"2024-09-12T01:05:10.219343+0000","last_fullsized":"2024-09-12T01:05:10.219343+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'50","last_scrub_stamp":"2024-09-12T01:05:10.218980+0000","last_deep_scrub":"268'50","last_deep_scrub_stamp":"2024-09-12T01:05:10.218980+0000","last_clean_scrub_stamp":"2024-09-12T01:05:10.218980+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:06.439044+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.417865+0000","last_change":"2024-09-12T01:05:14.417865+0000","last_active":"2024-09-12T01:05:14.417865+0000","last_peered":"2024-09-12T01:05:14.417865+0000","last_clean":"2024-09-12T01:05:14.417865+0000","last_became_active":"2024-09-12T00:18:30.894388+0000","last_became_peered":"2024-09-12T00:18:30.894388+0000","last_unstale":"2024-09-12T01:05:14.417865+0000","last_undegraded":"2024-09-12T01:05:14.417865+0000","last_fullsized":"2024-09-12T01:05:14.417865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:14.417664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:14.417664+0000","last_clean_scrub_stamp":"2024-09-12T01:05:14.417664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:10.320787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'211","reported_seq":738,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:23.057468+0000","last_change":"2024-09-12T01:05:23.057200+0000","last_active":"2024-09-12T01:05:23.057468+0000","last_peered":"2024-09-12T01:05:23.057468+0000","last_clean":"2024-09-12T01:05:23.057468+0000","last_became_active":"2024-09-12T00:18:32.903719+0000","last_became_peered":"2024-09-12T00:18:32.903719+0000","last_unstale":"2024-09-12T01:05:23.057468+0000","last_undegraded":"2024-09-12T01:05:23.057468+0000","last_fullsized":"2024-09-12T01:05:23.057468+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'211","last_scrub_stamp":"2024-09-12T01:05:23.056965+0000","last_deep_scrub":"268'211","last_deep_scrub_stamp":"2024-09-12T01:05:23.056965+0000","last_clean_scrub_stamp":"2024-09-12T01:05:23.056965+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":100,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:28.934047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":286,"num_read_kb":283,"num_write":470,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'853","reported_seq":2460,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.164106+0000","last_change":"2024-09-12T01:04:57.163980+0000","last_active":"2024-09-12T01:04:57.164106+0000","last_peered":"2024-09-12T01:04:57.164106+0000","last_clean":"2024-09-12T01:04:57.164106+0000","last_became_active":"2024-09-12T00:18:24.865480+0000","last_became_peered":"2024-09-12T00:18:24.865480+0000","last_unstale":"2024-09-12T01:04:57.164106+0000","last_undegraded":"2024-09-12T01:04:57.164106+0000","last_fullsized":"2024-09-12T01:04:57.164106+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'853","last_scrub_stamp":"2024-09-12T01:04:57.163800+0000","last_deep_scrub":"268'853","last_deep_scrub_stamp":"2024-09-12T01:04:57.163800+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.163800+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":800,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:48.870486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4053,"num_read_kb":3643,"num_write":1115,"num_write_kb":411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3056,"num_omap_keys":12,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'394","reported_seq":1053,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.476888+0000","last_change":"2024-09-12T01:04:48.476828+0000","last_active":"2024-09-12T01:04:48.476888+0000","last_peered":"2024-09-12T01:04:48.476888+0000","last_clean":"2024-09-12T01:04:48.476888+0000","last_became_active":"2024-09-12T00:18:55.955303+0000","last_became_peered":"2024-09-12T00:18:55.955303+0000","last_unstale":"2024-09-12T01:04:48.476888+0000","last_undegraded":"2024-09-12T01:04:48.476888+0000","last_fullsized":"2024-09-12T01:04:48.476888+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'394","last_scrub_stamp":"2024-09-12T01:04:48.476684+0000","last_deep_scrub":"268'394","last_deep_scrub_stamp":"2024-09-12T01:04:48.476684+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.476684+0000","objects_scrubbed":13,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:27.009748+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1605311,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":590,"num_read_kb":40569,"num_write":1352,"num_write_kb":40151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:06.498381+0000","last_change":"2024-09-12T01:05:06.498244+0000","last_active":"2024-09-12T01:05:06.498381+0000","last_peered":"2024-09-12T01:05:06.498381+0000","last_clean":"2024-09-12T01:05:06.498381+0000","last_became_active":"2024-09-12T00:18:26.859801+0000","last_became_peered":"2024-09-12T00:18:26.859801+0000","last_unstale":"2024-09-12T01:05:06.498381+0000","last_undegraded":"2024-09-12T01:05:06.498381+0000","last_fullsized":"2024-09-12T01:05:06.498381+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:06.498058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:06.498058+0000","last_clean_scrub_stamp":"2024-09-12T01:05:06.498058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:23.328223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'321","reported_seq":928,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:14.052652+0000","last_change":"2024-09-12T01:05:14.052652+0000","last_active":"2024-09-12T01:05:14.052652+0000","last_peered":"2024-09-12T01:05:14.052652+0000","last_clean":"2024-09-12T01:05:14.052652+0000","last_became_active":"2024-09-12T00:18:28.877317+0000","last_became_peered":"2024-09-12T00:18:28.877317+0000","last_unstale":"2024-09-12T01:05:14.052652+0000","last_undegraded":"2024-09-12T01:05:14.052652+0000","last_fullsized":"2024-09-12T01:05:14.052652+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'321","last_scrub_stamp":"2024-09-12T01:05:14.052413+0000","last_deep_scrub":"268'321","last_deep_scrub_stamp":"2024-09-12T01:05:14.052413+0000","last_clean_scrub_stamp":"2024-09-12T01:05:14.052413+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:18.845969+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53640,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":520,"num_read_kb":1147,"num_write":418,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:06.754939+0000","last_change":"2024-09-12T01:05:06.754772+0000","last_active":"2024-09-12T01:05:06.754939+0000","last_peered":"2024-09-12T01:05:06.754939+0000","last_clean":"2024-09-12T01:05:06.754939+0000","last_became_active":"2024-09-12T00:18:30.904052+0000","last_became_peered":"2024-09-12T00:18:30.904052+0000","last_unstale":"2024-09-12T01:05:06.754939+0000","last_undegraded":"2024-09-12T01:05:06.754939+0000","last_fullsized":"2024-09-12T01:05:06.754939+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:06.754587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:06.754587+0000","last_clean_scrub_stamp":"2024-09-12T01:05:06.754587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:30.338221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'140","reported_seq":668,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:23.564337+0000","last_change":"2024-09-12T01:05:23.564204+0000","last_active":"2024-09-12T01:05:23.564337+0000","last_peered":"2024-09-12T01:05:23.564337+0000","last_clean":"2024-09-12T01:05:23.564337+0000","last_became_active":"2024-09-12T00:18:32.899607+0000","last_became_peered":"2024-09-12T00:18:32.899607+0000","last_unstale":"2024-09-12T01:05:23.564337+0000","last_undegraded":"2024-09-12T01:05:23.564337+0000","last_fullsized":"2024-09-12T01:05:23.564337+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'140","last_scrub_stamp":"2024-09-12T01:05:23.564023+0000","last_deep_scrub":"268'140","last_deep_scrub_stamp":"2024-09-12T01:05:23.564023+0000","last_clean_scrub_stamp":"2024-09-12T01:05:23.564023+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:21.633929+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":193,"num_read_kb":183,"num_write":356,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'352","reported_seq":1902,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.079954+0000","last_change":"2024-09-12T01:05:01.079819+0000","last_active":"2024-09-12T01:05:01.079954+0000","last_peered":"2024-09-12T01:05:01.079954+0000","last_clean":"2024-09-12T01:05:01.079954+0000","last_became_active":"2024-09-12T00:18:24.863389+0000","last_became_peered":"2024-09-12T00:18:24.863389+0000","last_unstale":"2024-09-12T01:05:01.079954+0000","last_undegraded":"2024-09-12T01:05:01.079954+0000","last_fullsized":"2024-09-12T01:05:01.079954+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'352","last_scrub_stamp":"2024-09-12T01:05:01.079632+0000","last_deep_scrub":"268'352","last_deep_scrub_stamp":"2024-09-12T01:05:01.079632+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.079632+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:11.611171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2172,"num_read_kb":2099,"num_write":388,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1654,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'349","reported_seq":991,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.216827+0000","last_change":"2024-09-12T01:04:47.216827+0000","last_active":"2024-09-12T01:04:47.216827+0000","last_peered":"2024-09-12T01:04:47.216827+0000","last_clean":"2024-09-12T01:04:47.216827+0000","last_became_active":"2024-09-12T00:18:22.863535+0000","last_became_peered":"2024-09-12T00:18:22.863535+0000","last_unstale":"2024-09-12T01:04:47.216827+0000","last_undegraded":"2024-09-12T01:04:47.216827+0000","last_fullsized":"2024-09-12T01:04:47.216827+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'349","last_scrub_stamp":"2024-09-12T01:04:47.216745+0000","last_deep_scrub":"268'349","last_deep_scrub_stamp":"2024-09-12T01:04:47.216745+0000","last_clean_scrub_stamp":"2024-09-12T01:04:47.216745+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:20.488567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":493,"num_read_kb":3769,"num_write":1077,"num_write_kb":28344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.665332+0000","last_change":"2024-09-12T01:04:59.665200+0000","last_active":"2024-09-12T01:04:59.665332+0000","last_peered":"2024-09-12T01:04:59.665332+0000","last_clean":"2024-09-12T01:04:59.665332+0000","last_became_active":"2024-09-12T00:18:26.874839+0000","last_became_peered":"2024-09-12T00:18:26.874839+0000","last_unstale":"2024-09-12T01:04:59.665332+0000","last_undegraded":"2024-09-12T01:04:59.665332+0000","last_fullsized":"2024-09-12T01:04:59.665332+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:59.664986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:59.664986+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.664986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:33.767626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'275","reported_seq":853,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:11.466667+0000","last_change":"2024-09-12T01:05:11.466530+0000","last_active":"2024-09-12T01:05:11.466667+0000","last_peered":"2024-09-12T01:05:11.466667+0000","last_clean":"2024-09-12T01:05:11.466667+0000","last_became_active":"2024-09-12T00:18:28.888325+0000","last_became_peered":"2024-09-12T00:18:28.888325+0000","last_unstale":"2024-09-12T01:05:11.466667+0000","last_undegraded":"2024-09-12T01:05:11.466667+0000","last_fullsized":"2024-09-12T01:05:11.466667+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'275","last_scrub_stamp":"2024-09-12T01:05:11.466332+0000","last_deep_scrub":"268'275","last_deep_scrub_stamp":"2024-09-12T01:05:11.466332+0000","last_clean_scrub_stamp":"2024-09-12T01:05:11.466332+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:30.117767+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52815,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":453,"num_read_kb":1069,"num_write":372,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:13.209381+0000","last_change":"2024-09-12T01:05:13.209381+0000","last_active":"2024-09-12T01:05:13.209381+0000","last_peered":"2024-09-12T01:05:13.209381+0000","last_clean":"2024-09-12T01:05:13.209381+0000","last_became_active":"2024-09-12T00:18:30.899237+0000","last_became_peered":"2024-09-12T00:18:30.899237+0000","last_unstale":"2024-09-12T01:05:13.209381+0000","last_undegraded":"2024-09-12T01:05:13.209381+0000","last_fullsized":"2024-09-12T01:05:13.209381+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:13.209258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:13.209258+0000","last_clean_scrub_stamp":"2024-09-12T01:05:13.209258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:48.679519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'936","reported_seq":2379,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.750198+0000","last_change":"2024-09-12T01:04:57.750198+0000","last_active":"2024-09-12T01:04:57.750198+0000","last_peered":"2024-09-12T01:04:57.750198+0000","last_clean":"2024-09-12T01:04:57.750198+0000","last_became_active":"2024-09-12T00:18:24.859351+0000","last_became_peered":"2024-09-12T00:18:24.859351+0000","last_unstale":"2024-09-12T01:04:57.750198+0000","last_undegraded":"2024-09-12T01:04:57.750198+0000","last_fullsized":"2024-09-12T01:04:57.750198+0000","mapping_epoch":26,"log_start":"268'900","ondisk_log_start":"268'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'936","last_scrub_stamp":"2024-09-12T01:04:57.749993+0000","last_deep_scrub":"268'936","last_deep_scrub_stamp":"2024-09-12T01:04:57.749993+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.749993+0000","objects_scrubbed":6,"log_size":36,"log_dups_size":900,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:52.509130+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4324,"num_read_kb":3896,"num_write":1355,"num_write_kb":567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'315","reported_seq":1023,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.272346+0000","last_change":"2024-09-12T01:04:51.272346+0000","last_active":"2024-09-12T01:04:51.272346+0000","last_peered":"2024-09-12T01:04:51.272346+0000","last_clean":"2024-09-12T01:04:51.272346+0000","last_became_active":"2024-09-12T00:18:22.840244+0000","last_became_peered":"2024-09-12T00:18:22.840244+0000","last_unstale":"2024-09-12T01:04:51.272346+0000","last_undegraded":"2024-09-12T01:04:51.272346+0000","last_fullsized":"2024-09-12T01:04:51.272346+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'315","last_scrub_stamp":"2024-09-12T01:04:51.272055+0000","last_deep_scrub":"268'315","last_deep_scrub_stamp":"2024-09-12T01:04:51.272055+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.272055+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:05.495095+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":618,"num_read_kb":30347,"num_write":961,"num_write_kb":34968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.298177+0000","last_change":"2024-09-12T01:05:05.298177+0000","last_active":"2024-09-12T01:05:05.298177+0000","last_peered":"2024-09-12T01:05:05.298177+0000","last_clean":"2024-09-12T01:05:05.298177+0000","last_became_active":"2024-09-12T00:18:26.855432+0000","last_became_peered":"2024-09-12T00:18:26.855432+0000","last_unstale":"2024-09-12T01:05:05.298177+0000","last_undegraded":"2024-09-12T01:05:05.298177+0000","last_fullsized":"2024-09-12T01:05:05.298177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:05.297897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:05.297897+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.297897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:58.875114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'474","reported_seq":1126,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:08.566270+0000","last_change":"2024-09-12T01:05:08.566134+0000","last_active":"2024-09-12T01:05:08.566270+0000","last_peered":"2024-09-12T01:05:08.566270+0000","last_clean":"2024-09-12T01:05:08.566270+0000","last_became_active":"2024-09-12T00:18:28.887245+0000","last_became_peered":"2024-09-12T00:18:28.887245+0000","last_unstale":"2024-09-12T01:05:08.566270+0000","last_undegraded":"2024-09-12T01:05:08.566270+0000","last_fullsized":"2024-09-12T01:05:08.566270+0000","mapping_epoch":30,"log_start":"268'400","ondisk_log_start":"268'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'474","last_scrub_stamp":"2024-09-12T01:05:08.565945+0000","last_deep_scrub":"268'474","last_deep_scrub_stamp":"2024-09-12T01:05:08.565945+0000","last_clean_scrub_stamp":"2024-09-12T01:05:08.565945+0000","objects_scrubbed":7,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:06.432369+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":845,"num_read_kb":1964,"num_write":726,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:17.579047+0000","last_change":"2024-09-12T01:05:17.578807+0000","last_active":"2024-09-12T01:05:17.579047+0000","last_peered":"2024-09-12T01:05:17.579047+0000","last_clean":"2024-09-12T01:05:17.579047+0000","last_became_active":"2024-09-12T00:18:30.905680+0000","last_became_peered":"2024-09-12T00:18:30.905680+0000","last_unstale":"2024-09-12T01:05:17.579047+0000","last_undegraded":"2024-09-12T01:05:17.579047+0000","last_fullsized":"2024-09-12T01:05:17.579047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:17.578603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:17.578603+0000","last_clean_scrub_stamp":"2024-09-12T01:05:17.578603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:02.013094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'154","reported_seq":670,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:26.083011+0000","last_change":"2024-09-12T01:05:26.083011+0000","last_active":"2024-09-12T01:05:26.083011+0000","last_peered":"2024-09-12T01:05:26.083011+0000","last_clean":"2024-09-12T01:05:26.083011+0000","last_became_active":"2024-09-12T00:18:32.905070+0000","last_became_peered":"2024-09-12T00:18:32.905070+0000","last_unstale":"2024-09-12T01:05:26.083011+0000","last_undegraded":"2024-09-12T01:05:26.083011+0000","last_fullsized":"2024-09-12T01:05:26.083011+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'154","last_scrub_stamp":"2024-09-12T01:05:26.082827+0000","last_deep_scrub":"268'154","last_deep_scrub_stamp":"2024-09-12T01:05:26.082827+0000","last_clean_scrub_stamp":"2024-09-12T01:05:26.082827+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:27.746790+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":167,"num_read_kb":179,"num_write":337,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'642","reported_seq":2065,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.325029+0000","last_change":"2024-09-12T01:04:58.325029+0000","last_active":"2024-09-12T01:04:58.325029+0000","last_peered":"2024-09-12T01:04:58.325029+0000","last_clean":"2024-09-12T01:04:58.325029+0000","last_became_active":"2024-09-12T00:18:24.865142+0000","last_became_peered":"2024-09-12T00:18:24.865142+0000","last_unstale":"2024-09-12T01:04:58.325029+0000","last_undegraded":"2024-09-12T01:04:58.325029+0000","last_fullsized":"2024-09-12T01:04:58.325029+0000","mapping_epoch":26,"log_start":"268'600","ondisk_log_start":"268'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'642","last_scrub_stamp":"2024-09-12T01:04:58.324781+0000","last_deep_scrub":"268'642","last_deep_scrub_stamp":"2024-09-12T01:04:58.324781+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.324781+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":600,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:57.756900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2990,"num_read_kb":2759,"num_write":892,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'343","reported_seq":1275,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.556937+0000","last_change":"2024-09-12T01:04:48.556937+0000","last_active":"2024-09-12T01:04:48.556937+0000","last_peered":"2024-09-12T01:04:48.556937+0000","last_clean":"2024-09-12T01:04:48.556937+0000","last_became_active":"2024-09-12T00:18:22.845288+0000","last_became_peered":"2024-09-12T00:18:22.845288+0000","last_unstale":"2024-09-12T01:04:48.556937+0000","last_undegraded":"2024-09-12T01:04:48.556937+0000","last_fullsized":"2024-09-12T01:04:48.556937+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'343","last_scrub_stamp":"2024-09-12T01:04:48.556730+0000","last_deep_scrub":"268'343","last_deep_scrub_stamp":"2024-09-12T01:04:48.556730+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.556730+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:49.299596+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1116,"num_read_kb":11059,"num_write":1212,"num_write_kb":25104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.672231+0000","last_change":"2024-09-12T01:05:02.672231+0000","last_active":"2024-09-12T01:05:02.672231+0000","last_peered":"2024-09-12T01:05:02.672231+0000","last_clean":"2024-09-12T01:05:02.672231+0000","last_became_active":"2024-09-12T00:18:26.874972+0000","last_became_peered":"2024-09-12T00:18:26.874972+0000","last_unstale":"2024-09-12T01:05:02.672231+0000","last_undegraded":"2024-09-12T01:05:02.672231+0000","last_fullsized":"2024-09-12T01:05:02.672231+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:02.672044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:02.672044+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.672044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:02.283457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'325","reported_seq":917,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:12.435854+0000","last_change":"2024-09-12T01:05:12.435694+0000","last_active":"2024-09-12T01:05:12.435854+0000","last_peered":"2024-09-12T01:05:12.435854+0000","last_clean":"2024-09-12T01:05:12.435854+0000","last_became_active":"2024-09-12T00:18:28.892852+0000","last_became_peered":"2024-09-12T00:18:28.892852+0000","last_unstale":"2024-09-12T01:05:12.435854+0000","last_undegraded":"2024-09-12T01:05:12.435854+0000","last_fullsized":"2024-09-12T01:05:12.435854+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'325","last_scrub_stamp":"2024-09-12T01:05:12.435470+0000","last_deep_scrub":"268'325","last_deep_scrub_stamp":"2024-09-12T01:05:12.435470+0000","last_clean_scrub_stamp":"2024-09-12T01:05:12.435470+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:44.860765+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53047,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":539,"num_read_kb":1212,"num_write":456,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:11.583273+0000","last_change":"2024-09-12T01:05:11.583125+0000","last_active":"2024-09-12T01:05:11.583273+0000","last_peered":"2024-09-12T01:05:11.583273+0000","last_clean":"2024-09-12T01:05:11.583273+0000","last_became_active":"2024-09-12T00:18:30.892643+0000","last_became_peered":"2024-09-12T00:18:30.892643+0000","last_unstale":"2024-09-12T01:05:11.583273+0000","last_undegraded":"2024-09-12T01:05:11.583273+0000","last_fullsized":"2024-09-12T01:05:11.583273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:11.582956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:11.582956+0000","last_clean_scrub_stamp":"2024-09-12T01:05:11.582956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:57.356251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'244","reported_seq":793,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:10.730777+0000","last_change":"2024-09-12T01:05:10.730642+0000","last_active":"2024-09-12T01:05:10.730777+0000","last_peered":"2024-09-12T01:05:10.730777+0000","last_clean":"2024-09-12T01:05:10.730777+0000","last_became_active":"2024-09-12T00:18:32.901587+0000","last_became_peered":"2024-09-12T00:18:32.901587+0000","last_unstale":"2024-09-12T01:05:10.730777+0000","last_undegraded":"2024-09-12T01:05:10.730777+0000","last_fullsized":"2024-09-12T01:05:10.730777+0000","mapping_epoch":34,"log_start":"268'200","ondisk_log_start":"268'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'244","last_scrub_stamp":"2024-09-12T01:05:10.730461+0000","last_deep_scrub":"268'244","last_deep_scrub_stamp":"2024-09-12T01:05:10.730461+0000","last_clean_scrub_stamp":"2024-09-12T01:05:10.730461+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:53.942944+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":371,"num_read_kb":330,"num_write":585,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'495","reported_seq":2045,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.019565+0000","last_change":"2024-09-12T01:05:05.019421+0000","last_active":"2024-09-12T01:05:05.019565+0000","last_peered":"2024-09-12T01:05:05.019565+0000","last_clean":"2024-09-12T01:05:05.019565+0000","last_became_active":"2024-09-12T00:18:24.860647+0000","last_became_peered":"2024-09-12T00:18:24.860647+0000","last_unstale":"2024-09-12T01:05:05.019565+0000","last_undegraded":"2024-09-12T01:05:05.019565+0000","last_fullsized":"2024-09-12T01:05:05.019565+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'495","last_scrub_stamp":"2024-09-12T01:05:05.019136+0000","last_deep_scrub":"268'495","last_deep_scrub_stamp":"2024-09-12T01:05:05.019136+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.019136+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:27.295349+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2720,"num_read_kb":2539,"num_write":620,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'383","reported_seq":1065,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.176691+0000","last_change":"2024-09-12T01:04:50.176551+0000","last_active":"2024-09-12T01:04:50.176691+0000","last_peered":"2024-09-12T01:04:50.176691+0000","last_clean":"2024-09-12T01:04:50.176691+0000","last_became_active":"2024-09-12T00:18:22.856073+0000","last_became_peered":"2024-09-12T00:18:22.856073+0000","last_unstale":"2024-09-12T01:04:50.176691+0000","last_undegraded":"2024-09-12T01:04:50.176691+0000","last_fullsized":"2024-09-12T01:04:50.176691+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'383","last_scrub_stamp":"2024-09-12T01:04:50.176350+0000","last_deep_scrub":"268'383","last_deep_scrub_stamp":"2024-09-12T01:04:50.176350+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.176350+0000","objects_scrubbed":12,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:59.557330+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468142,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":578,"num_read_kb":15678,"num_write":1129,"num_write_kb":22765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:11.161654+0000","last_change":"2024-09-12T01:05:11.161508+0000","last_active":"2024-09-12T01:05:11.161654+0000","last_peered":"2024-09-12T01:05:11.161654+0000","last_clean":"2024-09-12T01:05:11.161654+0000","last_became_active":"2024-09-12T00:18:26.862012+0000","last_became_peered":"2024-09-12T00:18:26.862012+0000","last_unstale":"2024-09-12T01:05:11.161654+0000","last_undegraded":"2024-09-12T01:05:11.161654+0000","last_fullsized":"2024-09-12T01:05:11.161654+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:11.161326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:11.161326+0000","last_clean_scrub_stamp":"2024-09-12T01:05:11.161326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:12.901407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'284","reported_seq":883,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:16.048179+0000","last_change":"2024-09-12T01:05:16.048179+0000","last_active":"2024-09-12T01:05:16.048179+0000","last_peered":"2024-09-12T01:05:16.048179+0000","last_clean":"2024-09-12T01:05:16.048179+0000","last_became_active":"2024-09-12T00:18:28.882129+0000","last_became_peered":"2024-09-12T00:18:28.882129+0000","last_unstale":"2024-09-12T01:05:16.048179+0000","last_undegraded":"2024-09-12T01:05:16.048179+0000","last_fullsized":"2024-09-12T01:05:16.048179+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'284","last_scrub_stamp":"2024-09-12T01:05:16.047992+0000","last_deep_scrub":"268'284","last_deep_scrub_stamp":"2024-09-12T01:05:16.047992+0000","last_clean_scrub_stamp":"2024-09-12T01:05:16.047992+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:00.794228+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47744,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":1049,"num_write":372,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:09.586021+0000","last_change":"2024-09-12T01:05:09.586021+0000","last_active":"2024-09-12T01:05:09.586021+0000","last_peered":"2024-09-12T01:05:09.586021+0000","last_clean":"2024-09-12T01:05:09.586021+0000","last_became_active":"2024-09-12T00:18:30.902511+0000","last_became_peered":"2024-09-12T00:18:30.902511+0000","last_unstale":"2024-09-12T01:05:09.586021+0000","last_undegraded":"2024-09-12T01:05:09.586021+0000","last_fullsized":"2024-09-12T01:05:09.586021+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:09.585833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:09.585833+0000","last_clean_scrub_stamp":"2024-09-12T01:05:09.585833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:20.848216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'134","reported_seq":660,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:21.567735+0000","last_change":"2024-09-12T01:05:21.567735+0000","last_active":"2024-09-12T01:05:21.567735+0000","last_peered":"2024-09-12T01:05:21.567735+0000","last_clean":"2024-09-12T01:05:21.567735+0000","last_became_active":"2024-09-12T00:18:32.899968+0000","last_became_peered":"2024-09-12T00:18:32.899968+0000","last_unstale":"2024-09-12T01:05:21.567735+0000","last_undegraded":"2024-09-12T01:05:21.567735+0000","last_fullsized":"2024-09-12T01:05:21.567735+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'134","last_scrub_stamp":"2024-09-12T01:05:21.567485+0000","last_deep_scrub":"268'134","last_deep_scrub_stamp":"2024-09-12T01:05:21.567485+0000","last_clean_scrub_stamp":"2024-09-12T01:05:21.567485+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:08.663806+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":825,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":214,"num_read_kb":184,"num_write":320,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'364","reported_seq":1745,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.442997+0000","last_change":"2024-09-12T01:04:52.442699+0000","last_active":"2024-09-12T01:04:52.442997+0000","last_peered":"2024-09-12T01:04:52.442997+0000","last_clean":"2024-09-12T01:04:52.442997+0000","last_became_active":"2024-09-12T00:18:24.861271+0000","last_became_peered":"2024-09-12T00:18:24.861271+0000","last_unstale":"2024-09-12T01:04:52.442997+0000","last_undegraded":"2024-09-12T01:04:52.442997+0000","last_fullsized":"2024-09-12T01:04:52.442997+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'364","last_scrub_stamp":"2024-09-12T01:04:52.442472+0000","last_deep_scrub":"268'364","last_deep_scrub_stamp":"2024-09-12T01:04:52.442472+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.442472+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:50.665068+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2074,"num_read_kb":1954,"num_write":427,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'348","reported_seq":986,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.263218+0000","last_change":"2024-09-12T01:04:49.262939+0000","last_active":"2024-09-12T01:04:49.263218+0000","last_peered":"2024-09-12T01:04:49.263218+0000","last_clean":"2024-09-12T01:04:49.263218+0000","last_became_active":"2024-09-12T00:18:22.859695+0000","last_became_peered":"2024-09-12T00:18:22.859695+0000","last_unstale":"2024-09-12T01:04:49.263218+0000","last_undegraded":"2024-09-12T01:04:49.263218+0000","last_fullsized":"2024-09-12T01:04:49.263218+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'348","last_scrub_stamp":"2024-09-12T01:04:49.262596+0000","last_deep_scrub":"268'348","last_deep_scrub_stamp":"2024-09-12T01:04:49.262596+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.262596+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:52.854459+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263211,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":478,"num_read_kb":12426,"num_write":1109,"num_write_kb":25448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:06.536226+0000","last_change":"2024-09-12T01:05:06.535966+0000","last_active":"2024-09-12T01:05:06.536226+0000","last_peered":"2024-09-12T01:05:06.536226+0000","last_clean":"2024-09-12T01:05:06.536226+0000","last_became_active":"2024-09-12T00:18:26.859234+0000","last_became_peered":"2024-09-12T00:18:26.859234+0000","last_unstale":"2024-09-12T01:05:06.536226+0000","last_undegraded":"2024-09-12T01:05:06.536226+0000","last_fullsized":"2024-09-12T01:05:06.536226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:06.535753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:06.535753+0000","last_clean_scrub_stamp":"2024-09-12T01:05:06.535753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:39.417495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'130","reported_seq":672,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.215863+0000","last_change":"2024-09-12T01:05:19.215863+0000","last_active":"2024-09-12T01:05:19.215863+0000","last_peered":"2024-09-12T01:05:19.215863+0000","last_clean":"2024-09-12T01:05:19.215863+0000","last_became_active":"2024-09-12T00:18:28.883277+0000","last_became_peered":"2024-09-12T00:18:28.883277+0000","last_unstale":"2024-09-12T01:05:19.215863+0000","last_undegraded":"2024-09-12T01:05:19.215863+0000","last_fullsized":"2024-09-12T01:05:19.215863+0000","mapping_epoch":30,"log_start":"268'100","ondisk_log_start":"268'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'130","last_scrub_stamp":"2024-09-12T01:05:19.215623+0000","last_deep_scrub":"268'130","last_deep_scrub_stamp":"2024-09-12T01:05:19.215623+0000","last_clean_scrub_stamp":"2024-09-12T01:05:19.215623+0000","objects_scrubbed":8,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:44.684825+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":135,"num_read_kb":124,"num_write":148,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'770","reported_seq":2209,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:08.749470+0000","last_change":"2024-09-12T01:05:08.749470+0000","last_active":"2024-09-12T01:05:08.749470+0000","last_peered":"2024-09-12T01:05:08.749470+0000","last_clean":"2024-09-12T01:05:08.749470+0000","last_became_active":"2024-09-12T00:18:30.893175+0000","last_became_peered":"2024-09-12T00:18:30.893175+0000","last_unstale":"2024-09-12T01:05:08.749470+0000","last_undegraded":"2024-09-12T01:05:08.749470+0000","last_fullsized":"2024-09-12T01:05:08.749470+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'770","last_scrub_stamp":"2024-09-12T01:05:08.749187+0000","last_deep_scrub":"268'770","last_deep_scrub_stamp":"2024-09-12T01:05:08.749187+0000","last_clean_scrub_stamp":"2024-09-12T01:05:08.749187+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:10.450055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'108","reported_seq":611,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:18.408460+0000","last_change":"2024-09-12T01:05:18.408460+0000","last_active":"2024-09-12T01:05:18.408460+0000","last_peered":"2024-09-12T01:05:18.408460+0000","last_clean":"2024-09-12T01:05:18.408460+0000","last_became_active":"2024-09-12T00:18:32.908295+0000","last_became_peered":"2024-09-12T00:18:32.908295+0000","last_unstale":"2024-09-12T01:05:18.408460+0000","last_undegraded":"2024-09-12T01:05:18.408460+0000","last_fullsized":"2024-09-12T01:05:18.408460+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'108","last_scrub_stamp":"2024-09-12T01:05:18.408258+0000","last_deep_scrub":"268'108","last_deep_scrub_stamp":"2024-09-12T01:05:18.408258+0000","last_clean_scrub_stamp":"2024-09-12T01:05:18.408258+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:56.861384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":102,"num_write":264,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'834","reported_seq":2463,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.178532+0000","last_change":"2024-09-12T01:05:00.178341+0000","last_active":"2024-09-12T01:05:00.178532+0000","last_peered":"2024-09-12T01:05:00.178532+0000","last_clean":"2024-09-12T01:05:00.178532+0000","last_became_active":"2024-09-12T00:18:24.860266+0000","last_became_peered":"2024-09-12T00:18:24.860266+0000","last_unstale":"2024-09-12T01:05:00.178532+0000","last_undegraded":"2024-09-12T01:05:00.178532+0000","last_fullsized":"2024-09-12T01:05:00.178532+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'834","last_scrub_stamp":"2024-09-12T01:05:00.178156+0000","last_deep_scrub":"268'834","last_deep_scrub_stamp":"2024-09-12T01:05:00.178156+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.178156+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:24.839206+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4128,"num_read_kb":3735,"num_write":1126,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'317","reported_seq":930,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.585316+0000","last_change":"2024-09-12T01:04:51.585039+0000","last_active":"2024-09-12T01:04:51.585316+0000","last_peered":"2024-09-12T01:04:51.585316+0000","last_clean":"2024-09-12T01:04:51.585316+0000","last_became_active":"2024-09-12T00:18:22.867694+0000","last_became_peered":"2024-09-12T00:18:22.867694+0000","last_unstale":"2024-09-12T01:04:51.585316+0000","last_undegraded":"2024-09-12T01:04:51.585316+0000","last_fullsized":"2024-09-12T01:04:51.585316+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'317","last_scrub_stamp":"2024-09-12T01:04:51.584788+0000","last_deep_scrub":"268'317","last_deep_scrub_stamp":"2024-09-12T01:04:51.584788+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.584788+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:39.411322+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194362,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":405,"num_read_kb":19923,"num_write":982,"num_write_kb":45748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:07.504389+0000","last_change":"2024-09-12T01:05:07.504144+0000","last_active":"2024-09-12T01:05:07.504389+0000","last_peered":"2024-09-12T01:05:07.504389+0000","last_clean":"2024-09-12T01:05:07.504389+0000","last_became_active":"2024-09-12T00:18:26.864536+0000","last_became_peered":"2024-09-12T00:18:26.864536+0000","last_unstale":"2024-09-12T01:05:07.504389+0000","last_undegraded":"2024-09-12T01:05:07.504389+0000","last_fullsized":"2024-09-12T01:05:07.504389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:07.503869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:07.503869+0000","last_clean_scrub_stamp":"2024-09-12T01:05:07.503869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:30.764859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'348","reported_seq":966,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:15.606980+0000","last_change":"2024-09-12T01:05:15.606980+0000","last_active":"2024-09-12T01:05:15.606980+0000","last_peered":"2024-09-12T01:05:15.606980+0000","last_clean":"2024-09-12T01:05:15.606980+0000","last_became_active":"2024-09-12T00:18:28.885152+0000","last_became_peered":"2024-09-12T00:18:28.885152+0000","last_unstale":"2024-09-12T01:05:15.606980+0000","last_undegraded":"2024-09-12T01:05:15.606980+0000","last_fullsized":"2024-09-12T01:05:15.606980+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'348","last_scrub_stamp":"2024-09-12T01:05:15.606862+0000","last_deep_scrub":"268'348","last_deep_scrub_stamp":"2024-09-12T01:05:15.606862+0000","last_clean_scrub_stamp":"2024-09-12T01:05:15.606862+0000","objects_scrubbed":11,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:34.302412+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50453,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":539,"num_read_kb":1151,"num_write":436,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:15.162275+0000","last_change":"2024-09-12T01:05:15.162275+0000","last_active":"2024-09-12T01:05:15.162275+0000","last_peered":"2024-09-12T01:05:15.162275+0000","last_clean":"2024-09-12T01:05:15.162275+0000","last_became_active":"2024-09-12T00:18:30.888974+0000","last_became_peered":"2024-09-12T00:18:30.888974+0000","last_unstale":"2024-09-12T01:05:15.162275+0000","last_undegraded":"2024-09-12T01:05:15.162275+0000","last_fullsized":"2024-09-12T01:05:15.162275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:15.162085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:15.162085+0000","last_clean_scrub_stamp":"2024-09-12T01:05:15.162085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:33.981687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'100","reported_seq":615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.362653+0000","last_change":"2024-09-12T01:05:20.362653+0000","last_active":"2024-09-12T01:05:20.362653+0000","last_peered":"2024-09-12T01:05:20.362653+0000","last_clean":"2024-09-12T01:05:20.362653+0000","last_became_active":"2024-09-12T00:18:32.914994+0000","last_became_peered":"2024-09-12T00:18:32.914994+0000","last_unstale":"2024-09-12T01:05:20.362653+0000","last_undegraded":"2024-09-12T01:05:20.362653+0000","last_fullsized":"2024-09-12T01:05:20.362653+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'100","last_scrub_stamp":"2024-09-12T01:05:20.362477+0000","last_deep_scrub":"268'100","last_deep_scrub_stamp":"2024-09-12T01:05:20.362477+0000","last_clean_scrub_stamp":"2024-09-12T01:05:20.362477+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:42.589444+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":129,"num_write":234,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'859","reported_seq":2385,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.197184+0000","last_change":"2024-09-12T01:04:59.197006+0000","last_active":"2024-09-12T01:04:59.197184+0000","last_peered":"2024-09-12T01:04:59.197184+0000","last_clean":"2024-09-12T01:04:59.197184+0000","last_became_active":"2024-09-12T00:18:24.854089+0000","last_became_peered":"2024-09-12T00:18:24.854089+0000","last_unstale":"2024-09-12T01:04:59.197184+0000","last_undegraded":"2024-09-12T01:04:59.197184+0000","last_fullsized":"2024-09-12T01:04:59.197184+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'859","last_scrub_stamp":"2024-09-12T01:04:59.196824+0000","last_deep_scrub":"268'859","last_deep_scrub_stamp":"2024-09-12T01:04:59.196824+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.196824+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":800,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:28.550763+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4036,"num_read_kb":3617,"num_write":1169,"num_write_kb":474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'344","reported_seq":988,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.538655+0000","last_change":"2024-09-12T01:04:53.538484+0000","last_active":"2024-09-12T01:04:53.538655+0000","last_peered":"2024-09-12T01:04:53.538655+0000","last_clean":"2024-09-12T01:04:53.538655+0000","last_became_active":"2024-09-12T00:18:22.867744+0000","last_became_peered":"2024-09-12T00:18:22.867744+0000","last_unstale":"2024-09-12T01:04:53.538655+0000","last_undegraded":"2024-09-12T01:04:53.538655+0000","last_fullsized":"2024-09-12T01:04:53.538655+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'344","last_scrub_stamp":"2024-09-12T01:04:53.538289+0000","last_deep_scrub":"268'344","last_deep_scrub_stamp":"2024-09-12T01:04:53.538289+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.538289+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:01.759059+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":517,"num_read_kb":9523,"num_write":1195,"num_write_kb":17845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:11.596027+0000","last_change":"2024-09-12T01:05:11.595876+0000","last_active":"2024-09-12T01:05:11.596027+0000","last_peered":"2024-09-12T01:05:11.596027+0000","last_clean":"2024-09-12T01:05:11.596027+0000","last_became_active":"2024-09-12T00:18:26.857810+0000","last_became_peered":"2024-09-12T00:18:26.857810+0000","last_unstale":"2024-09-12T01:05:11.596027+0000","last_undegraded":"2024-09-12T01:05:11.596027+0000","last_fullsized":"2024-09-12T01:05:11.596027+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:11.595702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:11.595702+0000","last_clean_scrub_stamp":"2024-09-12T01:05:11.595702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:02.285161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'260","reported_seq":845,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:11.189156+0000","last_change":"2024-09-12T01:05:11.189156+0000","last_active":"2024-09-12T01:05:11.189156+0000","last_peered":"2024-09-12T01:05:11.189156+0000","last_clean":"2024-09-12T01:05:11.189156+0000","last_became_active":"2024-09-12T00:18:28.881556+0000","last_became_peered":"2024-09-12T00:18:28.881556+0000","last_unstale":"2024-09-12T01:05:11.189156+0000","last_undegraded":"2024-09-12T01:05:11.189156+0000","last_fullsized":"2024-09-12T01:05:11.189156+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'260","last_scrub_stamp":"2024-09-12T01:05:11.188953+0000","last_deep_scrub":"268'260","last_deep_scrub_stamp":"2024-09-12T01:05:11.188953+0000","last_clean_scrub_stamp":"2024-09-12T01:05:11.188953+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:16.718034+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48228,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":430,"num_read_kb":998,"num_write":346,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:07.730304+0000","last_change":"2024-09-12T01:05:07.730304+0000","last_active":"2024-09-12T01:05:07.730304+0000","last_peered":"2024-09-12T01:05:07.730304+0000","last_clean":"2024-09-12T01:05:07.730304+0000","last_became_active":"2024-09-12T00:18:30.898539+0000","last_became_peered":"2024-09-12T00:18:30.898539+0000","last_unstale":"2024-09-12T01:05:07.730304+0000","last_undegraded":"2024-09-12T01:05:07.730304+0000","last_fullsized":"2024-09-12T01:05:07.730304+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:07.730123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:07.730123+0000","last_clean_scrub_stamp":"2024-09-12T01:05:07.730123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:08.477914+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'112","reported_seq":647,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:27.064119+0000","last_change":"2024-09-12T01:05:27.064119+0000","last_active":"2024-09-12T01:05:27.064119+0000","last_peered":"2024-09-12T01:05:27.064119+0000","last_clean":"2024-09-12T01:05:27.064119+0000","last_became_active":"2024-09-12T00:18:32.907530+0000","last_became_peered":"2024-09-12T00:18:32.907530+0000","last_unstale":"2024-09-12T01:05:27.064119+0000","last_undegraded":"2024-09-12T01:05:27.064119+0000","last_fullsized":"2024-09-12T01:05:27.064119+0000","mapping_epoch":34,"log_start":"268'101","ondisk_log_start":"268'101","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'112","last_scrub_stamp":"2024-09-12T01:05:27.063927+0000","last_deep_scrub":"268'112","last_deep_scrub_stamp":"2024-09-12T01:05:27.063927+0000","last_clean_scrub_stamp":"2024-09-12T01:05:27.063927+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":101,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:41.979256+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":167,"num_read_kb":160,"num_write":271,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'366","reported_seq":1699,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.075971+0000","last_change":"2024-09-12T01:05:03.075971+0000","last_active":"2024-09-12T01:05:03.075971+0000","last_peered":"2024-09-12T01:05:03.075971+0000","last_clean":"2024-09-12T01:05:03.075971+0000","last_became_active":"2024-09-12T00:18:24.842263+0000","last_became_peered":"2024-09-12T00:18:24.842263+0000","last_unstale":"2024-09-12T01:05:03.075971+0000","last_undegraded":"2024-09-12T01:05:03.075971+0000","last_fullsized":"2024-09-12T01:05:03.075971+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'366","last_scrub_stamp":"2024-09-12T01:05:03.075784+0000","last_deep_scrub":"268'366","last_deep_scrub_stamp":"2024-09-12T01:05:03.075784+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.075784+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:40.465649+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1879,"num_read_kb":1766,"num_write":437,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'436","reported_seq":1218,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.286861+0000","last_change":"2024-09-12T01:04:52.286861+0000","last_active":"2024-09-12T01:04:52.286861+0000","last_peered":"2024-09-12T01:04:52.286861+0000","last_clean":"2024-09-12T01:04:52.286861+0000","last_became_active":"2024-09-12T00:18:22.837412+0000","last_became_peered":"2024-09-12T00:18:22.837412+0000","last_unstale":"2024-09-12T01:04:52.286861+0000","last_undegraded":"2024-09-12T01:04:52.286861+0000","last_fullsized":"2024-09-12T01:04:52.286861+0000","mapping_epoch":24,"log_start":"268'400","ondisk_log_start":"268'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'436","last_scrub_stamp":"2024-09-12T01:04:52.286655+0000","last_deep_scrub":"268'436","last_deep_scrub_stamp":"2024-09-12T01:04:52.286655+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.286655+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:34.352582+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5614631,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":898,"num_read_kb":48874,"num_write":1334,"num_write_kb":53147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:10.170546+0000","last_change":"2024-09-12T01:05:10.170546+0000","last_active":"2024-09-12T01:05:10.170546+0000","last_peered":"2024-09-12T01:05:10.170546+0000","last_clean":"2024-09-12T01:05:10.170546+0000","last_became_active":"2024-09-12T00:18:26.868407+0000","last_became_peered":"2024-09-12T00:18:26.868407+0000","last_unstale":"2024-09-12T01:05:10.170546+0000","last_undegraded":"2024-09-12T01:05:10.170546+0000","last_fullsized":"2024-09-12T01:05:10.170546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:10.170374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:10.170374+0000","last_clean_scrub_stamp":"2024-09-12T01:05:10.170374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:57.128330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'270","reported_seq":851,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:17.085001+0000","last_change":"2024-09-12T01:05:17.084853+0000","last_active":"2024-09-12T01:05:17.085001+0000","last_peered":"2024-09-12T01:05:17.085001+0000","last_clean":"2024-09-12T01:05:17.085001+0000","last_became_active":"2024-09-12T00:18:28.895848+0000","last_became_peered":"2024-09-12T00:18:28.895848+0000","last_unstale":"2024-09-12T01:05:17.085001+0000","last_undegraded":"2024-09-12T01:05:17.085001+0000","last_fullsized":"2024-09-12T01:05:17.085001+0000","mapping_epoch":30,"log_start":"268'200","ondisk_log_start":"268'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'270","last_scrub_stamp":"2024-09-12T01:05:17.084644+0000","last_deep_scrub":"268'270","last_deep_scrub_stamp":"2024-09-12T01:05:17.084644+0000","last_clean_scrub_stamp":"2024-09-12T01:05:17.084644+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:58.323594+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53006,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":433,"num_read_kb":1065,"num_write":360,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:17.196265+0000","last_change":"2024-09-12T01:05:17.196033+0000","last_active":"2024-09-12T01:05:17.196265+0000","last_peered":"2024-09-12T01:05:17.196265+0000","last_clean":"2024-09-12T01:05:17.196265+0000","last_became_active":"2024-09-12T00:18:30.892682+0000","last_became_peered":"2024-09-12T00:18:30.892682+0000","last_unstale":"2024-09-12T01:05:17.196265+0000","last_undegraded":"2024-09-12T01:05:17.196265+0000","last_fullsized":"2024-09-12T01:05:17.196265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:17.195793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:17.195793+0000","last_clean_scrub_stamp":"2024-09-12T01:05:17.195793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:29.371582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'213","reported_seq":1708,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:19.399573+0000","last_change":"2024-09-12T01:05:19.399573+0000","last_active":"2024-09-12T01:05:19.399573+0000","last_peered":"2024-09-12T01:05:19.399573+0000","last_clean":"2024-09-12T01:05:19.399573+0000","last_became_active":"2024-09-12T00:18:32.911082+0000","last_became_peered":"2024-09-12T00:18:32.911082+0000","last_unstale":"2024-09-12T01:05:19.399573+0000","last_undegraded":"2024-09-12T01:05:19.399573+0000","last_fullsized":"2024-09-12T01:05:19.399573+0000","mapping_epoch":34,"log_start":"268'200","ondisk_log_start":"268'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'213","last_scrub_stamp":"2024-09-12T01:05:19.399393+0000","last_deep_scrub":"268'213","last_deep_scrub_stamp":"2024-09-12T01:05:19.399393+0000","last_clean_scrub_stamp":"2024-09-12T01:05:19.399393+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:14.911475+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1287,"num_read_kb":1263,"num_write":482,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'527","reported_seq":2125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.235268+0000","last_change":"2024-09-12T01:04:58.235268+0000","last_active":"2024-09-12T01:04:58.235268+0000","last_peered":"2024-09-12T01:04:58.235268+0000","last_clean":"2024-09-12T01:04:58.235268+0000","last_became_active":"2024-09-12T00:18:24.881029+0000","last_became_peered":"2024-09-12T00:18:24.881029+0000","last_unstale":"2024-09-12T01:04:58.235268+0000","last_undegraded":"2024-09-12T01:04:58.235268+0000","last_fullsized":"2024-09-12T01:04:58.235268+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'527","last_scrub_stamp":"2024-09-12T01:04:58.235070+0000","last_deep_scrub":"268'527","last_deep_scrub_stamp":"2024-09-12T01:04:58.235070+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.235070+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":500,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:33.784017+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2735,"num_read_kb":2532,"num_write":658,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'403","reported_seq":1117,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:48.251141+0000","last_change":"2024-09-12T01:04:48.251141+0000","last_active":"2024-09-12T01:04:48.251141+0000","last_peered":"2024-09-12T01:04:48.251141+0000","last_clean":"2024-09-12T01:04:48.251141+0000","last_became_active":"2024-09-12T00:18:22.863907+0000","last_became_peered":"2024-09-12T00:18:22.863907+0000","last_unstale":"2024-09-12T01:04:48.251141+0000","last_undegraded":"2024-09-12T01:04:48.251141+0000","last_fullsized":"2024-09-12T01:04:48.251141+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'403","last_scrub_stamp":"2024-09-12T01:04:48.250914+0000","last_deep_scrub":"268'403","last_deep_scrub_stamp":"2024-09-12T01:04:48.250914+0000","last_clean_scrub_stamp":"2024-09-12T01:04:48.250914+0000","objects_scrubbed":11,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:07.582611+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1987000,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":643,"num_read_kb":24608,"num_write":1249,"num_write_kb":29666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"268'2","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.574020+0000","last_change":"2024-09-12T01:05:02.574020+0000","last_active":"2024-09-12T01:05:02.574020+0000","last_peered":"2024-09-12T01:05:02.574020+0000","last_clean":"2024-09-12T01:05:02.574020+0000","last_became_active":"2024-09-12T00:18:26.866967+0000","last_became_peered":"2024-09-12T00:18:26.866967+0000","last_unstale":"2024-09-12T01:05:02.574020+0000","last_undegraded":"2024-09-12T01:05:02.574020+0000","last_fullsized":"2024-09-12T01:05:02.574020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:05:02.573832+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:05:02.573832+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.573832+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:53.608830+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'315","reported_seq":926,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:15.214263+0000","last_change":"2024-09-12T01:05:15.214103+0000","last_active":"2024-09-12T01:05:15.214263+0000","last_peered":"2024-09-12T01:05:15.214263+0000","last_clean":"2024-09-12T01:05:15.214263+0000","last_became_active":"2024-09-12T00:18:28.897709+0000","last_became_peered":"2024-09-12T00:18:28.897709+0000","last_unstale":"2024-09-12T01:05:15.214263+0000","last_undegraded":"2024-09-12T01:05:15.214263+0000","last_fullsized":"2024-09-12T01:05:15.214263+0000","mapping_epoch":30,"log_start":"268'300","ondisk_log_start":"268'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'315","last_scrub_stamp":"2024-09-12T01:05:15.213915+0000","last_deep_scrub":"268'315","last_deep_scrub_stamp":"2024-09-12T01:05:15.213915+0000","last_clean_scrub_stamp":"2024-09-12T01:05:15.213915+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:47.575742+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54863,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":525,"num_read_kb":1160,"num_write":422,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:16.123585+0000","last_change":"2024-09-12T01:05:16.123449+0000","last_active":"2024-09-12T01:05:16.123585+0000","last_peered":"2024-09-12T01:05:16.123585+0000","last_clean":"2024-09-12T01:05:16.123585+0000","last_became_active":"2024-09-12T00:18:30.889179+0000","last_became_peered":"2024-09-12T00:18:30.889179+0000","last_unstale":"2024-09-12T01:05:16.123585+0000","last_undegraded":"2024-09-12T01:05:16.123585+0000","last_fullsized":"2024-09-12T01:05:16.123585+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:05:16.123278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:05:16.123278+0000","last_clean_scrub_stamp":"2024-09-12T01:05:16.123278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:43.328841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'193","reported_seq":766,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:20.174722+0000","last_change":"2024-09-12T01:05:20.174584+0000","last_active":"2024-09-12T01:05:20.174722+0000","last_peered":"2024-09-12T01:05:20.174722+0000","last_clean":"2024-09-12T01:05:20.174722+0000","last_became_active":"2024-09-12T00:18:32.907658+0000","last_became_peered":"2024-09-12T00:18:32.907658+0000","last_unstale":"2024-09-12T01:05:20.174722+0000","last_undegraded":"2024-09-12T01:05:20.174722+0000","last_fullsized":"2024-09-12T01:05:20.174722+0000","mapping_epoch":34,"log_start":"268'100","ondisk_log_start":"268'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'193","last_scrub_stamp":"2024-09-12T01:05:20.174417+0000","last_deep_scrub":"268'193","last_deep_scrub_stamp":"2024-09-12T01:05:20.174417+0000","last_clean_scrub_stamp":"2024-09-12T01:05:20.174417+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:27.927387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":435,"num_read_kb":358,"num_write":481,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'411","reported_seq":1920,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.596379+0000","last_change":"2024-09-12T01:05:03.596122+0000","last_active":"2024-09-12T01:05:03.596379+0000","last_peered":"2024-09-12T01:05:03.596379+0000","last_clean":"2024-09-12T01:05:03.596379+0000","last_became_active":"2024-09-12T00:18:24.878522+0000","last_became_peered":"2024-09-12T00:18:24.878522+0000","last_unstale":"2024-09-12T01:05:03.596379+0000","last_undegraded":"2024-09-12T01:05:03.596379+0000","last_fullsized":"2024-09-12T01:05:03.596379+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'411","last_scrub_stamp":"2024-09-12T01:05:03.595908+0000","last_deep_scrub":"268'411","last_deep_scrub_stamp":"2024-09-12T01:05:03.595908+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.595908+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:15.152071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2233,"num_read_kb":2110,"num_write":497,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'384","reported_seq":1059,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.766796+0000","last_change":"2024-09-12T01:04:53.766796+0000","last_active":"2024-09-12T01:04:53.766796+0000","last_peered":"2024-09-12T01:04:53.766796+0000","last_clean":"2024-09-12T01:04:53.766796+0000","last_became_active":"2024-09-12T00:18:22.851554+0000","last_became_peered":"2024-09-12T00:18:22.851554+0000","last_unstale":"2024-09-12T01:04:53.766796+0000","last_undegraded":"2024-09-12T01:04:53.766796+0000","last_fullsized":"2024-09-12T01:04:53.766796+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'384","last_scrub_stamp":"2024-09-12T01:04:53.766598+0000","last_deep_scrub":"268'384","last_deep_scrub_stamp":"2024-09-12T01:04:53.766598+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.766598+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:59.035558+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":573,"num_read_kb":70445,"num_write":1144,"num_write_kb":38293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"268'1219","reported_seq":2841,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.588766+0000","last_change":"2024-09-12T01:04:59.588495+0000","last_active":"2024-09-12T01:04:59.588766+0000","last_peered":"2024-09-12T01:04:59.588766+0000","last_clean":"2024-09-12T01:04:59.588766+0000","last_became_active":"2024-09-12T00:18:24.857107+0000","last_became_peered":"2024-09-12T00:18:24.857107+0000","last_unstale":"2024-09-12T01:04:59.588766+0000","last_undegraded":"2024-09-12T01:04:59.588766+0000","last_fullsized":"2024-09-12T01:04:59.588766+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1219","last_scrub_stamp":"2024-09-12T01:04:59.588271+0000","last_deep_scrub":"268'1219","last_deep_scrub_stamp":"2024-09-12T01:04:59.588271+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.588271+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":1200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:26.602528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5568,"num_read_kb":4913,"num_write":1657,"num_write_kb":681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"268'366","reported_seq":1025,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:47.455879+0000","last_change":"2024-09-12T01:04:47.455879+0000","last_active":"2024-09-12T01:04:47.455879+0000","last_peered":"2024-09-12T01:04:47.455879+0000","last_clean":"2024-09-12T01:04:47.455879+0000","last_became_active":"2024-09-12T00:18:56.193721+0000","last_became_peered":"2024-09-12T00:18:56.193721+0000","last_unstale":"2024-09-12T01:04:47.455879+0000","last_undegraded":"2024-09-12T01:04:47.455879+0000","last_fullsized":"2024-09-12T01:04:47.455879+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'366","last_scrub_stamp":"2024-09-12T01:04:47.455778+0000","last_deep_scrub":"268'366","last_deep_scrub_stamp":"2024-09-12T01:04:47.455778+0000","last_clean_scrub_stamp":"2024-09-12T01:04:47.455778+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:03.972474+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342105,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":474,"num_read_kb":19261,"num_write":1030,"num_write_kb":26595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'861","reported_seq":2467,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.543706+0000","last_change":"2024-09-12T01:05:03.543543+0000","last_active":"2024-09-12T01:05:03.543706+0000","last_peered":"2024-09-12T01:05:03.543706+0000","last_clean":"2024-09-12T01:05:03.543706+0000","last_became_active":"2024-09-12T00:18:24.870288+0000","last_became_peered":"2024-09-12T00:18:24.870288+0000","last_unstale":"2024-09-12T01:05:03.543706+0000","last_undegraded":"2024-09-12T01:05:03.543706+0000","last_fullsized":"2024-09-12T01:05:03.543706+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'861","last_scrub_stamp":"2024-09-12T01:05:03.543359+0000","last_deep_scrub":"268'861","last_deep_scrub_stamp":"2024-09-12T01:05:03.543359+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.543359+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":800,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:05.642071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4146,"num_read_kb":3713,"num_write":1130,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2296,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'416","reported_seq":1061,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:52.558231+0000","last_change":"2024-09-12T01:04:52.558231+0000","last_active":"2024-09-12T01:04:52.558231+0000","last_peered":"2024-09-12T01:04:52.558231+0000","last_clean":"2024-09-12T01:04:52.558231+0000","last_became_active":"2024-09-12T00:18:22.866341+0000","last_became_peered":"2024-09-12T00:18:22.866341+0000","last_unstale":"2024-09-12T01:04:52.558231+0000","last_undegraded":"2024-09-12T01:04:52.558231+0000","last_fullsized":"2024-09-12T01:04:52.558231+0000","mapping_epoch":24,"log_start":"268'400","ondisk_log_start":"268'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'416","last_scrub_stamp":"2024-09-12T01:04:52.558034+0000","last_deep_scrub":"268'416","last_deep_scrub_stamp":"2024-09-12T01:04:52.558034+0000","last_clean_scrub_stamp":"2024-09-12T01:04:52.558034+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:06.937457+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1452502,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":481,"num_read_kb":25322,"num_write":1167,"num_write_kb":64729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'400","reported_seq":1906,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.616651+0000","last_change":"2024-09-12T01:04:57.616499+0000","last_active":"2024-09-12T01:04:57.616651+0000","last_peered":"2024-09-12T01:04:57.616651+0000","last_clean":"2024-09-12T01:04:57.616651+0000","last_became_active":"2024-09-12T00:18:24.865674+0000","last_became_peered":"2024-09-12T00:18:24.865674+0000","last_unstale":"2024-09-12T01:04:57.616651+0000","last_undegraded":"2024-09-12T01:04:57.616651+0000","last_fullsized":"2024-09-12T01:04:57.616651+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'400","last_scrub_stamp":"2024-09-12T01:04:57.616297+0000","last_deep_scrub":"268'400","last_deep_scrub_stamp":"2024-09-12T01:04:57.616297+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.616297+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:18.938055+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2040,"num_read_kb":1953,"num_write":432,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'346","reported_seq":1099,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.241235+0000","last_change":"2024-09-12T01:04:50.241235+0000","last_active":"2024-09-12T01:04:50.241235+0000","last_peered":"2024-09-12T01:04:50.241235+0000","last_clean":"2024-09-12T01:04:50.241235+0000","last_became_active":"2024-09-12T00:18:22.844095+0000","last_became_peered":"2024-09-12T00:18:22.844095+0000","last_unstale":"2024-09-12T01:04:50.241235+0000","last_undegraded":"2024-09-12T01:04:50.241235+0000","last_fullsized":"2024-09-12T01:04:50.241235+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'346","last_scrub_stamp":"2024-09-12T01:04:50.241022+0000","last_deep_scrub":"268'346","last_deep_scrub_stamp":"2024-09-12T01:04:50.241022+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.241022+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:38.319110+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":305939,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":760,"num_read_kb":58308,"num_write":997,"num_write_kb":25022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"268'390","reported_seq":1858,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.133189+0000","last_change":"2024-09-12T01:04:59.133189+0000","last_active":"2024-09-12T01:04:59.133189+0000","last_peered":"2024-09-12T01:04:59.133189+0000","last_clean":"2024-09-12T01:04:59.133189+0000","last_became_active":"2024-09-12T00:18:24.865720+0000","last_became_peered":"2024-09-12T00:18:24.865720+0000","last_unstale":"2024-09-12T01:04:59.133189+0000","last_undegraded":"2024-09-12T01:04:59.133189+0000","last_fullsized":"2024-09-12T01:04:59.133189+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'390","last_scrub_stamp":"2024-09-12T01:04:59.132929+0000","last_deep_scrub":"268'390","last_deep_scrub_stamp":"2024-09-12T01:04:59.132929+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.132929+0000","objects_scrubbed":7,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:05.560879+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2058,"num_read_kb":1953,"num_write":433,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2118,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'381","reported_seq":1065,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.239214+0000","last_change":"2024-09-12T01:04:50.238978+0000","last_active":"2024-09-12T01:04:50.239214+0000","last_peered":"2024-09-12T01:04:50.239214+0000","last_clean":"2024-09-12T01:04:50.239214+0000","last_became_active":"2024-09-12T00:18:22.857896+0000","last_became_peered":"2024-09-12T00:18:22.857896+0000","last_unstale":"2024-09-12T01:04:50.239214+0000","last_undegraded":"2024-09-12T01:04:50.239214+0000","last_fullsized":"2024-09-12T01:04:50.239214+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'381","last_scrub_stamp":"2024-09-12T01:04:50.238615+0000","last_deep_scrub":"268'381","last_deep_scrub_stamp":"2024-09-12T01:04:50.238615+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.238615+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:15.950829+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456478,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":576,"num_read_kb":17790,"num_write":1194,"num_write_kb":44407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'444","reported_seq":2182,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.202943+0000","last_change":"2024-09-12T01:05:01.202943+0000","last_active":"2024-09-12T01:05:01.202943+0000","last_peered":"2024-09-12T01:05:01.202943+0000","last_clean":"2024-09-12T01:05:01.202943+0000","last_became_active":"2024-09-12T00:18:24.866980+0000","last_became_peered":"2024-09-12T00:18:24.866980+0000","last_unstale":"2024-09-12T01:05:01.202943+0000","last_undegraded":"2024-09-12T01:05:01.202943+0000","last_fullsized":"2024-09-12T01:05:01.202943+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'444","last_scrub_stamp":"2024-09-12T01:05:01.202767+0000","last_deep_scrub":"268'444","last_deep_scrub_stamp":"2024-09-12T01:05:01.202767+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.202767+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:44.543465+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2639,"num_read_kb":2518,"num_write":497,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2207,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'322","reported_seq":989,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.507889+0000","last_change":"2024-09-12T01:04:50.507744+0000","last_active":"2024-09-12T01:04:50.507889+0000","last_peered":"2024-09-12T01:04:50.507889+0000","last_clean":"2024-09-12T01:04:50.507889+0000","last_became_active":"2024-09-12T00:18:22.846805+0000","last_became_peered":"2024-09-12T00:18:22.846805+0000","last_unstale":"2024-09-12T01:04:50.507889+0000","last_undegraded":"2024-09-12T01:04:50.507889+0000","last_fullsized":"2024-09-12T01:04:50.507889+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'322","last_scrub_stamp":"2024-09-12T01:04:50.507547+0000","last_deep_scrub":"268'322","last_deep_scrub_stamp":"2024-09-12T01:04:50.507547+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.507547+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:49.831883+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":456,"num_read_kb":82569,"num_write":1071,"num_write_kb":46093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'468","reported_seq":2015,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:05.989566+0000","last_change":"2024-09-12T01:05:05.989566+0000","last_active":"2024-09-12T01:05:05.989566+0000","last_peered":"2024-09-12T01:05:05.989566+0000","last_clean":"2024-09-12T01:05:05.989566+0000","last_became_active":"2024-09-12T00:18:24.862022+0000","last_became_peered":"2024-09-12T00:18:24.862022+0000","last_unstale":"2024-09-12T01:05:05.989566+0000","last_undegraded":"2024-09-12T01:05:05.989566+0000","last_fullsized":"2024-09-12T01:05:05.989566+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'468","last_scrub_stamp":"2024-09-12T01:05:05.989382+0000","last_deep_scrub":"268'468","last_deep_scrub_stamp":"2024-09-12T01:05:05.989382+0000","last_clean_scrub_stamp":"2024-09-12T01:05:05.989382+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:40.188563+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2433,"num_read_kb":2274,"num_write":552,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'349","reported_seq":982,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:50.673293+0000","last_change":"2024-09-12T01:04:50.673096+0000","last_active":"2024-09-12T01:04:50.673293+0000","last_peered":"2024-09-12T01:04:50.673293+0000","last_clean":"2024-09-12T01:04:50.673293+0000","last_became_active":"2024-09-12T00:18:22.871980+0000","last_became_peered":"2024-09-12T00:18:22.871980+0000","last_unstale":"2024-09-12T01:04:50.673293+0000","last_undegraded":"2024-09-12T01:04:50.673293+0000","last_fullsized":"2024-09-12T01:04:50.673293+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'349","last_scrub_stamp":"2024-09-12T01:04:50.672877+0000","last_deep_scrub":"268'349","last_deep_scrub_stamp":"2024-09-12T01:04:50.672877+0000","last_clean_scrub_stamp":"2024-09-12T01:04:50.672877+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:51.786132+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":467,"num_read_kb":12975,"num_write":1116,"num_write_kb":44636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'441","reported_seq":2039,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:58.710518+0000","last_change":"2024-09-12T01:04:58.710518+0000","last_active":"2024-09-12T01:04:58.710518+0000","last_peered":"2024-09-12T01:04:58.710518+0000","last_clean":"2024-09-12T01:04:58.710518+0000","last_became_active":"2024-09-12T00:18:24.857010+0000","last_became_peered":"2024-09-12T00:18:24.857010+0000","last_unstale":"2024-09-12T01:04:58.710518+0000","last_undegraded":"2024-09-12T01:04:58.710518+0000","last_fullsized":"2024-09-12T01:04:58.710518+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'441","last_scrub_stamp":"2024-09-12T01:04:58.710296+0000","last_deep_scrub":"268'441","last_deep_scrub_stamp":"2024-09-12T01:04:58.710296+0000","last_clean_scrub_stamp":"2024-09-12T01:04:58.710296+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:49.317345+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2477,"num_read_kb":2332,"num_write":519,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1335,"num_omap_keys":6,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'383","reported_seq":1020,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.244232+0000","last_change":"2024-09-12T01:04:53.244074+0000","last_active":"2024-09-12T01:04:53.244232+0000","last_peered":"2024-09-12T01:04:53.244232+0000","last_clean":"2024-09-12T01:04:53.244232+0000","last_became_active":"2024-09-12T00:18:22.857468+0000","last_became_peered":"2024-09-12T00:18:22.857468+0000","last_unstale":"2024-09-12T01:04:53.244232+0000","last_undegraded":"2024-09-12T01:04:53.244232+0000","last_fullsized":"2024-09-12T01:04:53.244232+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'383","last_scrub_stamp":"2024-09-12T01:04:53.243865+0000","last_deep_scrub":"268'383","last_deep_scrub_stamp":"2024-09-12T01:04:53.243865+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.243865+0000","objects_scrubbed":11,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:00.400260+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":375108,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":489,"num_read_kb":4433,"num_write":1123,"num_write_kb":23710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"268'835","reported_seq":2454,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:59.301201+0000","last_change":"2024-09-12T01:04:59.301066+0000","last_active":"2024-09-12T01:04:59.301201+0000","last_peered":"2024-09-12T01:04:59.301201+0000","last_clean":"2024-09-12T01:04:59.301201+0000","last_became_active":"2024-09-12T00:18:24.857438+0000","last_became_peered":"2024-09-12T00:18:24.857438+0000","last_unstale":"2024-09-12T01:04:59.301201+0000","last_undegraded":"2024-09-12T01:04:59.301201+0000","last_fullsized":"2024-09-12T01:04:59.301201+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'835","last_scrub_stamp":"2024-09-12T01:04:59.300882+0000","last_deep_scrub":"268'835","last_deep_scrub_stamp":"2024-09-12T01:04:59.300882+0000","last_clean_scrub_stamp":"2024-09-12T01:04:59.300882+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:06.256923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3858,"num_read_kb":3490,"num_write":1078,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'394","reported_seq":1017,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:54.550846+0000","last_change":"2024-09-12T01:04:54.550846+0000","last_active":"2024-09-12T01:04:54.550846+0000","last_peered":"2024-09-12T01:04:54.550846+0000","last_clean":"2024-09-12T01:04:54.550846+0000","last_became_active":"2024-09-12T00:18:22.858851+0000","last_became_peered":"2024-09-12T00:18:22.858851+0000","last_unstale":"2024-09-12T01:04:54.550846+0000","last_undegraded":"2024-09-12T01:04:54.550846+0000","last_fullsized":"2024-09-12T01:04:54.550846+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'394","last_scrub_stamp":"2024-09-12T01:04:54.550600+0000","last_deep_scrub":"268'394","last_deep_scrub_stamp":"2024-09-12T01:04:54.550600+0000","last_clean_scrub_stamp":"2024-09-12T01:04:54.550600+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:21.777404+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1250253,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":485,"num_read_kb":6084,"num_write":1107,"num_write_kb":43198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'1190","reported_seq":2708,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:03.212545+0000","last_change":"2024-09-12T01:05:03.212330+0000","last_active":"2024-09-12T01:05:03.212545+0000","last_peered":"2024-09-12T01:05:03.212545+0000","last_clean":"2024-09-12T01:05:03.212545+0000","last_became_active":"2024-09-12T00:18:24.856121+0000","last_became_peered":"2024-09-12T00:18:24.856121+0000","last_unstale":"2024-09-12T01:05:03.212545+0000","last_undegraded":"2024-09-12T01:05:03.212545+0000","last_fullsized":"2024-09-12T01:05:03.212545+0000","mapping_epoch":26,"log_start":"268'1100","ondisk_log_start":"268'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1190","last_scrub_stamp":"2024-09-12T01:05:03.212083+0000","last_deep_scrub":"268'1190","last_deep_scrub_stamp":"2024-09-12T01:05:03.212083+0000","last_clean_scrub_stamp":"2024-09-12T01:05:03.212083+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":1100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:31.434280+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5211,"num_read_kb":4574,"num_write":1611,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'359","reported_seq":1115,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.207399+0000","last_change":"2024-09-12T01:04:55.207192+0000","last_active":"2024-09-12T01:04:55.207399+0000","last_peered":"2024-09-12T01:04:55.207399+0000","last_clean":"2024-09-12T01:04:55.207399+0000","last_became_active":"2024-09-12T00:18:22.857806+0000","last_became_peered":"2024-09-12T00:18:22.857806+0000","last_unstale":"2024-09-12T01:04:55.207399+0000","last_undegraded":"2024-09-12T01:04:55.207399+0000","last_fullsized":"2024-09-12T01:04:55.207399+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'359","last_scrub_stamp":"2024-09-12T01:04:55.206986+0000","last_deep_scrub":"268'359","last_deep_scrub_stamp":"2024-09-12T01:04:55.206986+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.206986+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:18.410646+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":676,"num_read_kb":44063,"num_write":1212,"num_write_kb":47646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"268'827","reported_seq":2381,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.485273+0000","last_change":"2024-09-12T01:04:53.485146+0000","last_active":"2024-09-12T01:04:53.485273+0000","last_peered":"2024-09-12T01:04:53.485273+0000","last_clean":"2024-09-12T01:04:53.485273+0000","last_became_active":"2024-09-12T00:18:24.856616+0000","last_became_peered":"2024-09-12T00:18:24.856616+0000","last_unstale":"2024-09-12T01:04:53.485273+0000","last_undegraded":"2024-09-12T01:04:53.485273+0000","last_fullsized":"2024-09-12T01:04:53.485273+0000","mapping_epoch":26,"log_start":"268'800","ondisk_log_start":"268'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'827","last_scrub_stamp":"2024-09-12T01:04:53.484958+0000","last_deep_scrub":"268'827","last_deep_scrub_stamp":"2024-09-12T01:04:53.484958+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.484958+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:30.113138+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3862,"num_read_kb":3471,"num_write":1076,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'393","reported_seq":1173,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:56.519765+0000","last_change":"2024-09-12T01:04:56.519626+0000","last_active":"2024-09-12T01:04:56.519765+0000","last_peered":"2024-09-12T01:04:56.519765+0000","last_clean":"2024-09-12T01:04:56.519765+0000","last_became_active":"2024-09-12T00:18:22.873756+0000","last_became_peered":"2024-09-12T00:18:22.873756+0000","last_unstale":"2024-09-12T01:04:56.519765+0000","last_undegraded":"2024-09-12T01:04:56.519765+0000","last_fullsized":"2024-09-12T01:04:56.519765+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'393","last_scrub_stamp":"2024-09-12T01:04:56.519399+0000","last_deep_scrub":"268'393","last_deep_scrub_stamp":"2024-09-12T01:04:56.519399+0000","last_clean_scrub_stamp":"2024-09-12T01:04:56.519399+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:26.788844+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263200,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":909,"num_read_kb":25128,"num_write":1275,"num_write_kb":39639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'1581","reported_seq":3281,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:02.237336+0000","last_change":"2024-09-12T01:05:02.237198+0000","last_active":"2024-09-12T01:05:02.237336+0000","last_peered":"2024-09-12T01:05:02.237336+0000","last_clean":"2024-09-12T01:05:02.237336+0000","last_became_active":"2024-09-12T00:18:24.882937+0000","last_became_peered":"2024-09-12T00:18:24.882937+0000","last_unstale":"2024-09-12T01:05:02.237336+0000","last_undegraded":"2024-09-12T01:05:02.237336+0000","last_fullsized":"2024-09-12T01:05:02.237336+0000","mapping_epoch":26,"log_start":"268'1500","ondisk_log_start":"268'1500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1581","last_scrub_stamp":"2024-09-12T01:05:02.237002+0000","last_deep_scrub":"268'1581","last_deep_scrub_stamp":"2024-09-12T01:05:02.237002+0000","last_clean_scrub_stamp":"2024-09-12T01:05:02.237002+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":1500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:39.333011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7111,"num_read_kb":6230,"num_write":2206,"num_write_kb":938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'438","reported_seq":1177,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.201113+0000","last_change":"2024-09-12T01:04:51.200968+0000","last_active":"2024-09-12T01:04:51.201113+0000","last_peered":"2024-09-12T01:04:51.201113+0000","last_clean":"2024-09-12T01:04:51.201113+0000","last_became_active":"2024-09-12T00:18:22.869527+0000","last_became_peered":"2024-09-12T00:18:22.869527+0000","last_unstale":"2024-09-12T01:04:51.201113+0000","last_undegraded":"2024-09-12T01:04:51.201113+0000","last_fullsized":"2024-09-12T01:04:51.201113+0000","mapping_epoch":24,"log_start":"268'400","ondisk_log_start":"268'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'438","last_scrub_stamp":"2024-09-12T01:04:51.200755+0000","last_deep_scrub":"268'438","last_deep_scrub_stamp":"2024-09-12T01:04:51.200755+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.200755+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:55.971651+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262232,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":772,"num_read_kb":72891,"num_write":1443,"num_write_kb":29040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'772","reported_seq":2187,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.491608+0000","last_change":"2024-09-12T01:05:00.491449+0000","last_active":"2024-09-12T01:05:00.491608+0000","last_peered":"2024-09-12T01:05:00.491608+0000","last_clean":"2024-09-12T01:05:00.491608+0000","last_became_active":"2024-09-12T00:18:24.866062+0000","last_became_peered":"2024-09-12T00:18:24.866062+0000","last_unstale":"2024-09-12T01:05:00.491608+0000","last_undegraded":"2024-09-12T01:05:00.491608+0000","last_fullsized":"2024-09-12T01:05:00.491608+0000","mapping_epoch":26,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'772","last_scrub_stamp":"2024-09-12T01:05:00.491269+0000","last_deep_scrub":"268'772","last_deep_scrub_stamp":"2024-09-12T01:05:00.491269+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.491269+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:14.226037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3587,"num_read_kb":3210,"num_write":1032,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'376","reported_seq":1066,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.767631+0000","last_change":"2024-09-12T01:04:55.767471+0000","last_active":"2024-09-12T01:04:55.767631+0000","last_peered":"2024-09-12T01:04:55.767631+0000","last_clean":"2024-09-12T01:04:55.767631+0000","last_became_active":"2024-09-12T00:18:22.858141+0000","last_became_peered":"2024-09-12T00:18:22.858141+0000","last_unstale":"2024-09-12T01:04:55.767631+0000","last_undegraded":"2024-09-12T01:04:55.767631+0000","last_fullsized":"2024-09-12T01:04:55.767631+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'376","last_scrub_stamp":"2024-09-12T01:04:55.767266+0000","last_deep_scrub":"268'376","last_deep_scrub_stamp":"2024-09-12T01:04:55.767266+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.767266+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:24.248670+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":648,"num_read_kb":25195,"num_write":1350,"num_write_kb":34646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'1220","reported_seq":3130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:00.336062+0000","last_change":"2024-09-12T01:05:00.335747+0000","last_active":"2024-09-12T01:05:00.336062+0000","last_peered":"2024-09-12T01:05:00.336062+0000","last_clean":"2024-09-12T01:05:00.336062+0000","last_became_active":"2024-09-12T00:18:24.859973+0000","last_became_peered":"2024-09-12T00:18:24.859973+0000","last_unstale":"2024-09-12T01:05:00.336062+0000","last_undegraded":"2024-09-12T01:05:00.336062+0000","last_fullsized":"2024-09-12T01:05:00.336062+0000","mapping_epoch":26,"log_start":"268'1200","ondisk_log_start":"268'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1220","last_scrub_stamp":"2024-09-12T01:05:00.335499+0000","last_deep_scrub":"268'1220","last_deep_scrub_stamp":"2024-09-12T01:05:00.335499+0000","last_clean_scrub_stamp":"2024-09-12T01:05:00.335499+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":1200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:36.786041+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5984,"num_read_kb":5306,"num_write":1779,"num_write_kb":823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'360","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:53.565625+0000","last_change":"2024-09-12T01:04:53.565625+0000","last_active":"2024-09-12T01:04:53.565625+0000","last_peered":"2024-09-12T01:04:53.565625+0000","last_clean":"2024-09-12T01:04:53.565625+0000","last_became_active":"2024-09-12T00:18:55.951826+0000","last_became_peered":"2024-09-12T00:18:55.951826+0000","last_unstale":"2024-09-12T01:04:53.565625+0000","last_undegraded":"2024-09-12T01:04:53.565625+0000","last_fullsized":"2024-09-12T01:04:53.565625+0000","mapping_epoch":37,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'360","last_scrub_stamp":"2024-09-12T01:04:53.565426+0000","last_deep_scrub":"268'360","last_deep_scrub_stamp":"2024-09-12T01:04:53.565426+0000","last_clean_scrub_stamp":"2024-09-12T01:04:53.565426+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:24.959465+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":11605,"num_write":1081,"num_write_kb":32221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"268'542","reported_seq":2019,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:07.016290+0000","last_change":"2024-09-12T01:05:07.016136+0000","last_active":"2024-09-12T01:05:07.016290+0000","last_peered":"2024-09-12T01:05:07.016290+0000","last_clean":"2024-09-12T01:05:07.016290+0000","last_became_active":"2024-09-12T00:18:24.849540+0000","last_became_peered":"2024-09-12T00:18:24.849540+0000","last_unstale":"2024-09-12T01:05:07.016290+0000","last_undegraded":"2024-09-12T01:05:07.016290+0000","last_fullsized":"2024-09-12T01:05:07.016290+0000","mapping_epoch":26,"log_start":"268'500","ondisk_log_start":"268'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'542","last_scrub_stamp":"2024-09-12T01:05:07.015941+0000","last_deep_scrub":"268'542","last_deep_scrub_stamp":"2024-09-12T01:05:07.015941+0000","last_clean_scrub_stamp":"2024-09-12T01:05:07.015941+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:39.395014+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2717,"num_read_kb":2465,"num_write":714,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":489,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'362","reported_seq":1065,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:49.471347+0000","last_change":"2024-09-12T01:04:49.471154+0000","last_active":"2024-09-12T01:04:49.471347+0000","last_peered":"2024-09-12T01:04:49.471347+0000","last_clean":"2024-09-12T01:04:49.471347+0000","last_became_active":"2024-09-12T00:18:22.834527+0000","last_became_peered":"2024-09-12T00:18:22.834527+0000","last_unstale":"2024-09-12T01:04:49.471347+0000","last_undegraded":"2024-09-12T01:04:49.471347+0000","last_fullsized":"2024-09-12T01:04:49.471347+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'362","last_scrub_stamp":"2024-09-12T01:04:49.470959+0000","last_deep_scrub":"268'362","last_deep_scrub_stamp":"2024-09-12T01:04:49.470959+0000","last_clean_scrub_stamp":"2024-09-12T01:04:49.470959+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:03.324964+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":663,"num_read_kb":13548,"num_write":1359,"num_write_kb":27172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'352","reported_seq":1714,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.449859+0000","last_change":"2024-09-12T01:05:01.449859+0000","last_active":"2024-09-12T01:05:01.449859+0000","last_peered":"2024-09-12T01:05:01.449859+0000","last_clean":"2024-09-12T01:05:01.449859+0000","last_became_active":"2024-09-12T00:18:24.870016+0000","last_became_peered":"2024-09-12T00:18:24.870016+0000","last_unstale":"2024-09-12T01:05:01.449859+0000","last_undegraded":"2024-09-12T01:05:01.449859+0000","last_fullsized":"2024-09-12T01:05:01.449859+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'352","last_scrub_stamp":"2024-09-12T01:05:01.449680+0000","last_deep_scrub":"268'352","last_deep_scrub_stamp":"2024-09-12T01:05:01.449680+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.449680+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:14.081003+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1783,"num_read_kb":1704,"num_write":384,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'333","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:55.528182+0000","last_change":"2024-09-12T01:04:55.528002+0000","last_active":"2024-09-12T01:04:55.528182+0000","last_peered":"2024-09-12T01:04:55.528182+0000","last_clean":"2024-09-12T01:04:55.528182+0000","last_became_active":"2024-09-12T00:18:22.883246+0000","last_became_peered":"2024-09-12T00:18:22.883246+0000","last_unstale":"2024-09-12T01:04:55.528182+0000","last_undegraded":"2024-09-12T01:04:55.528182+0000","last_fullsized":"2024-09-12T01:04:55.528182+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'333","last_scrub_stamp":"2024-09-12T01:04:55.527813+0000","last_deep_scrub":"268'333","last_deep_scrub_stamp":"2024-09-12T01:04:55.527813+0000","last_clean_scrub_stamp":"2024-09-12T01:04:55.527813+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:47.812183+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2790244,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":500,"num_read_kb":42045,"num_write":1101,"num_write_kb":34022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'382","reported_seq":1058,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:57.522637+0000","last_change":"2024-09-12T01:04:57.522370+0000","last_active":"2024-09-12T01:04:57.522637+0000","last_peered":"2024-09-12T01:04:57.522637+0000","last_clean":"2024-09-12T01:04:57.522637+0000","last_became_active":"2024-09-12T00:18:22.857072+0000","last_became_peered":"2024-09-12T00:18:22.857072+0000","last_unstale":"2024-09-12T01:04:57.522637+0000","last_undegraded":"2024-09-12T01:04:57.522637+0000","last_fullsized":"2024-09-12T01:04:57.522637+0000","mapping_epoch":24,"log_start":"268'300","ondisk_log_start":"268'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'382","last_scrub_stamp":"2024-09-12T01:04:57.522162+0000","last_deep_scrub":"268'382","last_deep_scrub_stamp":"2024-09-12T01:04:57.522162+0000","last_clean_scrub_stamp":"2024-09-12T01:04:57.522162+0000","objects_scrubbed":10,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:55.368704+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525411,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":546,"num_read_kb":42645,"num_write":1246,"num_write_kb":40559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'478","reported_seq":2186,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:01.337968+0000","last_change":"2024-09-12T01:05:01.337968+0000","last_active":"2024-09-12T01:05:01.337968+0000","last_peered":"2024-09-12T01:05:01.337968+0000","last_clean":"2024-09-12T01:05:01.337968+0000","last_became_active":"2024-09-12T00:18:24.866883+0000","last_became_peered":"2024-09-12T00:18:24.866883+0000","last_unstale":"2024-09-12T01:05:01.337968+0000","last_undegraded":"2024-09-12T01:05:01.337968+0000","last_fullsized":"2024-09-12T01:05:01.337968+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'478","last_scrub_stamp":"2024-09-12T01:05:01.337648+0000","last_deep_scrub":"268'478","last_deep_scrub_stamp":"2024-09-12T01:05:01.337648+0000","last_clean_scrub_stamp":"2024-09-12T01:05:01.337648+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:51.544486+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2661,"num_read_kb":2525,"num_write":544,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'456","reported_seq":1192,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:04:51.550977+0000","last_change":"2024-09-12T01:04:51.550695+0000","last_active":"2024-09-12T01:04:51.550977+0000","last_peered":"2024-09-12T01:04:51.550977+0000","last_clean":"2024-09-12T01:04:51.550977+0000","last_became_active":"2024-09-12T00:18:22.858176+0000","last_became_peered":"2024-09-12T00:18:22.858176+0000","last_unstale":"2024-09-12T01:04:51.550977+0000","last_undegraded":"2024-09-12T01:04:51.550977+0000","last_fullsized":"2024-09-12T01:04:51.550977+0000","mapping_epoch":24,"log_start":"268'400","ondisk_log_start":"268'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'456","last_scrub_stamp":"2024-09-12T01:04:51.550461+0000","last_deep_scrub":"268'456","last_deep_scrub_stamp":"2024-09-12T01:04:51.550461+0000","last_clean_scrub_stamp":"2024-09-12T01:04:51.550461+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:00.070041+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493507,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":841,"num_read_kb":63084,"num_write":1253,"num_write_kb":30414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'808","reported_seq":2413,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:05:04.507308+0000","last_change":"2024-09-12T01:05:04.507308+0000","last_active":"2024-09-12T01:05:04.507308+0000","last_peered":"2024-09-12T01:05:04.507308+0000","last_clean":"2024-09-12T01:05:04.507308+0000","last_became_active":"2024-09-12T00:18:24.855524+0000","last_became_peered":"2024-09-12T00:18:24.855524+0000","last_unstale":"2024-09-12T01:05:04.507308+0000","last_undegraded":"2024-09-12T01:05:04.507308+0000","last_fullsized":"2024-09-12T01:05:04.507308+0000","mapping_epoch":26,"log_start":"268'700","ondisk_log_start":"268'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'808","last_scrub_stamp":"2024-09-12T01:05:04.507124+0000","last_deep_scrub":"268'808","last_deep_scrub_stamp":"2024-09-12T01:05:04.507124+0000","last_clean_scrub_stamp":"2024-09-12T01:05:04.507124+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:08.739902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3793,"num_read_kb":3425,"num_write":1052,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6125,"num_read_kb":4422,"num_write":1992,"num_write_kb":889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5969,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":965,"ondisk_log_size":965,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15018,"num_read_kb":14677,"num_write":16721,"num_write_kb":4879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1741,"ondisk_log_size":1741,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1590876,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":17701,"num_read_kb":37057,"num_write":14791,"num_write_kb":11631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":675540,"num_omap_keys":1570,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1929,"ondisk_log_size":1929,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212220,"num_read_kb":193790,"num_write":55147,"num_write_kb":18721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43028,"num_omap_keys":175,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3939,"ondisk_log_size":3939,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":67372279,"num_objects":368,"num_object_clones":0,"num_object_copies":736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":368,"num_whiteouts":0,"num_read":36285,"num_read_kb":1921539,"num_write":72266,"num_write_kb":2133559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":135979008,"data_stored":134744558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3853,"ondisk_log_size":3853,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":193499,"num_write":190,"num_write_kb":135054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":193436,"num_write":190,"num_write_kb":135054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510023,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":288164,"kb_used_data":14036,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94083676,"statfs":{"total":96636764160,"available":96341684224,"internally_reserved":0,"allocated":14372864,"data_stored":12670188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510022,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249776,"kb_used_data":20064,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94122064,"statfs":{"total":96636764160,"available":96380993536,"internally_reserved":0,"allocated":20545536,"data_stored":18946545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":235207113},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510022,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":157332,"kb_used_data":27652,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94214508,"statfs":{"total":96636764160,"available":96475656192,"internally_reserved":0,"allocated":28315648,"data_stored":26521673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510023,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111496,"kb_used_data":26168,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94260344,"statfs":{"total":96636764160,"available":96522592256,"internally_reserved":0,"allocated":26796032,"data_stored":25204103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542727,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":288260,"kb_used_data":28020,"kb_used_omap":1,"kb_used_meta":260222,"kb_avail":94083580,"statfs":{"total":96636764160,"available":96341585920,"internally_reserved":0,"allocated":28692480,"data_stored":26984275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":266467783},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542725,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":97864,"kb_used_data":12600,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94273976,"statfs":{"total":96636764160,"available":96536551424,"internally_reserved":0,"allocated":12902400,"data_stored":11301467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542726,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148312,"kb_used_data":8904,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94223528,"statfs":{"total":96636764160,"available":96484892672,"internally_reserved":0,"allocated":9117696,"data_stored":7484684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542727,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255332,"kb_used_data":25620,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94116508,"statfs":{"total":96636764160,"available":96375304192,"internally_reserved":0,"allocated":26234880,"data_stored":24489485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21905408,"data_stored":21688322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5402624,"data_stored":5276127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9211904,"data_stored":9091208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24948736,"data_stored":24773620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":23130112,"data_stored":22997083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24514560,"data_stored":24310448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16838656,"data_stored":16736762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10027008,"data_stored":9870988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":5044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":5163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":2957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:06:10.072 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T01:06:10.434 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T01:06:10.434 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T01:06:10.434 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T01:06:10.434 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:06:10.504 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T01:06:10.505 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T01:06:10.505 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:06:10.585 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T01:06:10.585 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T01:06:10.585 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:06:10.667 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T01:06:10.668 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T01:06:10.668 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:06:10.766 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T01:06:10.766 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T01:06:10.766 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:06:10.859 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T01:06:10.859 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T01:06:10.859 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:06:10.960 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T01:06:10.961 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T01:06:10.961 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:06:14.416 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-12T01:06:17.062 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T01:06:17.063 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T01:06:17.063 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:06:19.921 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-12T01:06:19.921 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-12T01:06:23.165 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T01:06:23.165 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T01:06:23.165 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T01:06:23.165 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:06:23.197 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T01:06:23.197 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T01:06:23.197 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:06:23.225 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T01:06:23.225 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T01:06:23.225 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T01:06:23.226 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:06:23.264 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T01:06:23.265 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T01:06:23.265 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:06:23.335 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T01:06:23.335 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T01:06:23.335 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:06:23.362 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T01:06:23.362 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T01:06:23.362 DEBUG:teuthology.orchestra.run.smithi043:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-12T01:06:23.392 INFO:teuthology.orchestra.run.smithi043.stdout:2024-09-12T00:20:00.000194+0000 mon.a (mon.0) 231 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive 2024-09-12T01:06:23.393 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2024-09-12T01:06:23.393 DEBUG:teuthology.orchestra.run.smithi043:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-12T01:06:23.453 DEBUG:teuthology.orchestra.run.smithi043:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-12T01:06:23.510 DEBUG:teuthology.orchestra.run.smithi043:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-12T01:06:23.564 INFO:teuthology.orchestra.run.smithi043.stdout:2024-09-12T00:20:00.000194+0000 mon.a (mon.0) 231 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive 2024-09-12T01:06:23.565 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi043.front.sepia.ceph.com 2024-09-12T01:06:23.565 DEBUG:teuthology.orchestra.run.smithi043:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T01:06:24.013 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi043.front.sepia.ceph.com 2024-09-12T01:06:24.013 DEBUG:teuthology.orchestra.run.smithi043:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T01:06:24.236 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi043.front.sepia.ceph.com 2024-09-12T01:06:24.236 DEBUG:teuthology.orchestra.run.smithi043:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T01:06:24.440 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi043.front.sepia.ceph.com 2024-09-12T01:06:24.441 DEBUG:teuthology.orchestra.run.smithi043:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T01:06:24.662 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-12T01:06:24.663 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T01:06:24.922 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-12T01:06:24.996 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-12T01:06:24.997 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T01:06:25.204 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-12T01:06:25.204 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T01:06:25.385 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-12T01:06:25.386 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T01:06:25.561 INFO:tasks.ceph:Archiving mon data... 2024-09-12T01:06:25.562 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901842/data/mon.a.tgz 2024-09-12T01:06:25.563 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2024-09-12T01:06:25.569 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.XcYtkRpCOP 2024-09-12T01:06:25.569 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.XcYtkRpCOP 2024-09-12T01:06:25.751 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.XcYtkRpCOP 2024-09-12T01:06:25.813 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.XcYtkRpCOP is 515KB 2024-09-12T01:06:25.875 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.XcYtkRpCOP 2024-09-12T01:06:25.880 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901842/data/mon.c.tgz 2024-09-12T01:06:25.880 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2024-09-12T01:06:25.929 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.66gnnUDOe7 2024-09-12T01:06:25.929 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.66gnnUDOe7 2024-09-12T01:06:26.117 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.66gnnUDOe7 2024-09-12T01:06:26.186 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.66gnnUDOe7 is 535KB 2024-09-12T01:06:26.286 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.66gnnUDOe7 2024-09-12T01:06:26.292 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901842/data/mon.b.tgz 2024-09-12T01:06:26.292 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2024-09-12T01:06:26.298 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.BJqBDlTVCm 2024-09-12T01:06:26.298 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.BJqBDlTVCm 2024-09-12T01:06:26.486 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.BJqBDlTVCm 2024-09-12T01:06:26.552 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.BJqBDlTVCm is 535KB 2024-09-12T01:06:26.650 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.BJqBDlTVCm 2024-09-12T01:06:26.656 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T01:06:26.656 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T01:06:26.658 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T01:06:26.719 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T01:06:26.761 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T01:06:26.761 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T01:06:26.763 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901842/remote/smithi043/crash 2024-09-12T01:06:26.763 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T01:06:26.777 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901842/remote/smithi097/crash 2024-09-12T01:06:26.778 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T01:06:26.816 INFO:tasks.ceph:Compressing logs... 2024-09-12T01:06:26.816 DEBUG:teuthology.orchestra.run.smithi043:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:06:26.826 DEBUG:teuthology.orchestra.run.smithi097:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:06:26.882 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26767.log 2024-09-12T01:06:26.884 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T01:06:26.884 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.26767.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-osd.6.log -- replaced with /var/log/ceph/ceph-client.admin.26767.log.gz 2024-09-12T01:06:26.884 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-12T01:06:26.885 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26863.log 2024-09-12T01:06:26.885 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T01:06:26.885 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.26863.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26863.log.gz 2024-09-12T01:06:26.885 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26791.log 2024-09-12T01:06:26.886 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26815.log 2024-09-12T01:06:26.886 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.26791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26791.log.gz 2024-09-12T01:06:26.886 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26719.log 2024-09-12T01:06:26.886 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.26815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26815.log.gz 2024-09-12T01:06:26.886 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T01:06:26.887 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T01:06:26.887 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.26719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26719.log.gz 2024-09-12T01:06:26.887 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26839.log 2024-09-12T01:06:26.888 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26743.log 2024-09-12T01:06:26.889 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.26839.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T01:06:26.889 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26839.log.gz 2024-09-12T01:06:26.889 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.26743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26679.log 2024-09-12T01:06:26.890 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26743.log.gz 2024-09-12T01:06:26.890 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T01:06:26.890 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T01:06:26.890 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.26679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26679.log.gz 2024-09-12T01:06:26.891 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 90.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T01:06:26.892 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96766.log 2024-09-12T01:06:26.893 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181250.log 2024-09-12T01:06:26.894 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.96766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171134.log 2024-09-12T01:06:26.894 INFO:teuthology.orchestra.run.smithi043.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.96766.log.gz 2024-09-12T01:06:26.894 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.181250.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181250.log.gz 2024-09-12T01:06:26.894 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61311.log 2024-09-12T01:06:26.895 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125678.log 2024-09-12T01:06:26.895 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.171134.log: /var/log/ceph/ceph-client.admin.61311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30828.log 2024-09-12T01:06:26.895 INFO:teuthology.orchestra.run.smithi043.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.0.171134.log.gz 2024-09-12T01:06:26.895 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.125678.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T01:06:26.897 INFO:teuthology.orchestra.run.smithi043.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.125678.log.gz 2024-09-12T01:06:26.897 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58084.log 2024-09-12T01:06:26.897 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30828.log.gz 2024-09-12T01:06:26.897 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/rgw.ceph.client.0.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61311.log.gz 2024-09-12T01:06:26.897 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32579.log 2024-09-12T01:06:26.897 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.58084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44666.log 2024-09-12T01:06:26.898 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110928.log 2024-09-12T01:06:26.898 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32579.log.gz 2024-09-12T01:06:26.898 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.44666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99126.log 2024-09-12T01:06:26.898 INFO:teuthology.orchestra.run.smithi043.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.44666.log.gz 2024-09-12T01:06:26.898 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.110928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130399.log 2024-09-12T01:06:26.899 INFO:teuthology.orchestra.run.smithi097.stderr: 87.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T01:06:26.900 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.99126.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.110928.log.gz 2024-09-12T01:06:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26835.log 2024-09-12T01:06:26.901 INFO:teuthology.orchestra.run.smithi043.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.99126.log.gz 2024-09-12T01:06:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54281.log 2024-09-12T01:06:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.130399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118598.log 2024-09-12T01:06:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26835.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.130399.log.gz 2024-09-12T01:06:26.901 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26835.log.gz 2024-09-12T01:06:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.54281.log: 54.9% -- replaced with /var/log/ceph/ceph-client.admin.54281.log.gz 2024-09-12T01:06:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T01:06:26.901 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146920.log 2024-09-12T01:06:26.903 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.118598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124498.log 2024-09-12T01:06:26.903 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.146920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65281.log 2024-09-12T01:06:26.903 INFO:teuthology.orchestra.run.smithi043.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.146920.log.gz 2024-09-12T01:06:26.903 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60666.log 2024-09-12T01:06:26.903 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.124498.log: /var/log/ceph/ceph-client.admin.65281.log: 93.1% 82.1% -- replaced with /var/log/ceph/ceph-client.admin.124498.log.gz 2024-09-12T01:06:26.903 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92046.log 2024-09-12T01:06:26.903 INFO:teuthology.orchestra.run.smithi043.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58084.log.gz 2024-09-12T01:06:26.903 INFO:teuthology.orchestra.run.smithi043.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.118598.log.gz 2024-09-12T01:06:26.903 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140430.log 2024-09-12T01:06:26.906 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.60666.log: /var/log/ceph/ceph-client.admin.92046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176717.log 2024-09-12T01:06:26.906 INFO:teuthology.orchestra.run.smithi043.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.65281.log.gz 2024-09-12T01:06:26.906 INFO:teuthology.orchestra.run.smithi043.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.92046.log.gz 2024-09-12T01:06:26.906 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.140430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79066.log 2024-09-12T01:06:26.906 INFO:teuthology.orchestra.run.smithi043.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.140430.log.gz 2024-09-12T01:06:26.906 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.176717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120958.log 2024-09-12T01:06:26.906 INFO:teuthology.orchestra.run.smithi043.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.176717.log.gz 2024-09-12T01:06:26.906 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.79066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123908.log 2024-09-12T01:06:26.906 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.120958.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.79066.log.gz 2024-09-12T01:06:26.907 INFO:teuthology.orchestra.run.smithi043.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.120958.log.gz 2024-09-12T01:06:26.907 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181041.log 2024-09-12T01:06:26.907 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.123908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180885.log 2024-09-12T01:06:26.907 INFO:teuthology.orchestra.run.smithi043.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.123908.log.gz 2024-09-12T01:06:26.907 INFO:teuthology.orchestra.run.smithi043.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.60666.log.gz 2024-09-12T01:06:26.907 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.181041.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181041.log.gz 2024-09-12T01:06:26.907 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108568.log 2024-09-12T01:06:26.910 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113288.log 2024-09-12T01:06:26.910 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.180885.log: 0.0%/var/log/ceph/ceph-client.admin.108568.log: -- replaced with /var/log/ceph/ceph-client.admin.180885.log.gz 2024-09-12T01:06:26.910 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41666.log 2024-09-12T01:06:26.910 INFO:teuthology.orchestra.run.smithi043.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.108568.log.gz 2024-09-12T01:06:26.910 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.113288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36158.log 2024-09-12T01:06:26.910 INFO:teuthology.orchestra.run.smithi043.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.113288.log.gz 2024-09-12T01:06:26.910 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107978.log 2024-09-12T01:06:26.910 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.41666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98536.log 2024-09-12T01:06:26.910 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.36158.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.41666.log.gz 2024-09-12T01:06:26.910 INFO:teuthology.orchestra.run.smithi043.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.36158.log.gz 2024-09-12T01:06:26.910 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.107978.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T01:06:26.910 INFO:teuthology.orchestra.run.smithi043.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107978.log.gz 2024-09-12T01:06:26.911 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104438.log 2024-09-12T01:06:26.911 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.98536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179288.log 2024-09-12T01:06:26.911 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-osd.0.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.98536.log.gz 2024-09-12T01:06:26.911 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.104438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139840.log 2024-09-12T01:06:26.913 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.179288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79656.log 2024-09-12T01:06:26.913 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.139840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30972.log 2024-09-12T01:06:26.913 INFO:teuthology.orchestra.run.smithi043.stderr: 87.2% 86.0% -- replaced with /var/log/ceph/ceph-client.admin.139840.log.gz 2024-09-12T01:06:26.913 INFO:teuthology.orchestra.run.smithi043.stderr: -- replaced with /var/log/ceph/ceph-client.admin.104438.log.gz 2024-09-12T01:06:26.913 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.79656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94996.log 2024-09-12T01:06:26.913 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33226.log 2024-09-12T01:06:26.913 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30972.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.79656.log.gz 2024-09-12T01:06:26.913 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30972.log.gz 2024-09-12T01:06:26.913 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.94996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58729.log 2024-09-12T01:06:26.913 INFO:teuthology.orchestra.run.smithi043.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.94996.log.gz 2024-09-12T01:06:26.913 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51821.log 2024-09-12T01:06:26.915 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.33226.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.33226.log.gz 2024-09-12T01:06:26.915 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.58729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152842.log 2024-09-12T01:06:26.915 INFO:teuthology.orchestra.run.smithi043.stderr:gzip/var/log/ceph/ceph-client.admin.51821.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.115058.log 2024-09-12T01:06:26.916 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51821.log.gz 2024-09-12T01:06:26.916 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.152842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61956.log 2024-09-12T01:06:26.916 INFO:teuthology.orchestra.run.smithi043.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.152842.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51206.log 2024-09-12T01:06:26.916 INFO:teuthology.orchestra.run.smithi043.stderr: 2024-09-12T01:06:26.916 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.115058.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.58729.log.gz 2024-09-12T01:06:26.916 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.61956.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.115058.log.gz 2024-09-12T01:06:26.916 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70806.log 2024-09-12T01:06:26.917 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.51206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41026.log 2024-09-12T01:06:26.917 INFO:teuthology.orchestra.run.smithi043.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.51206.log.gz 2024-09-12T01:06:26.917 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165222.log 2024-09-12T01:06:26.917 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.70806.log: /var/log/ceph/ceph-client.admin.41026.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.70806.log.gz 2024-09-12T01:06:26.917 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83196.log 2024-09-12T01:06:26.918 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41026.log.gz 2024-09-12T01:06:26.918 INFO:teuthology.orchestra.run.smithi043.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61956.log.gz 2024-09-12T01:06:26.918 INFO:teuthology.orchestra.run.smithi097.stderr: 95.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T01:06:26.918 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.165222.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.165222.log.gz 2024-09-12T01:06:26.919 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63252.log 2024-09-12T01:06:26.919 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.83196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57439.log 2024-09-12T01:06:26.920 INFO:teuthology.orchestra.run.smithi043.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.83196.log.gz 2024-09-12T01:06:26.920 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.63252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76706.log 2024-09-12T01:06:26.921 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.57439.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.63252.log.gz 2024-09-12T01:06:26.921 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125088.log 2024-09-12T01:06:26.921 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.76706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31177.log 2024-09-12T01:06:26.921 INFO:teuthology.orchestra.run.smithi043.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.76706.log.gz 2024-09-12T01:06:26.922 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.125088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81426.log 2024-09-12T01:06:26.922 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39846.log 2024-09-12T01:06:26.922 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31177.log.gz 2024-09-12T01:06:26.923 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.81426.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.125088.log.gz 2024-09-12T01:06:26.924 INFO:teuthology.orchestra.run.smithi043.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.81426.log.gz 2024-09-12T01:06:26.924 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44076.log 2024-09-12T01:06:26.925 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.39846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54227.log 2024-09-12T01:06:26.925 INFO:teuthology.orchestra.run.smithi043.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.39846.log.gz 2024-09-12T01:06:26.925 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.44076.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.57439.log.gz 2024-09-12T01:06:26.926 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118008.log 2024-09-12T01:06:26.927 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154072.log 2024-09-12T01:06:26.927 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.54227.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.44076.log.gz 2024-09-12T01:06:26.927 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54227.log.gz 2024-09-12T01:06:26.927 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.118008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131579.log 2024-09-12T01:06:26.927 INFO:teuthology.orchestra.run.smithi043.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.118008.log.gz 2024-09-12T01:06:26.927 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.154072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180703.log 2024-09-12T01:06:26.927 INFO:teuthology.orchestra.run.smithi043.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.154072.log.gz 2024-09-12T01:06:26.929 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26591.log 2024-09-12T01:06:26.929 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.131579.log: /var/log/ceph/ceph-client.admin.180703.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180703.log.gz 2024-09-12T01:06:26.929 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54183.log 2024-09-12T01:06:26.929 INFO:teuthology.orchestra.run.smithi043.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.131579.log.gz 2024-09-12T01:06:26.930 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31161.log 2024-09-12T01:06:26.930 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26591.log: /var/log/ceph/ceph-client.admin.54183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26591.log.gz 2024-09-12T01:06:26.930 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92636.log 2024-09-12T01:06:26.930 INFO:teuthology.orchestra.run.smithi043.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54183.log.gz 2024-09-12T01:06:26.930 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49386.log 2024-09-12T01:06:26.930 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31161.log.gz 2024-09-12T01:06:26.930 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.92636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146330.log 2024-09-12T01:06:26.930 INFO:teuthology.orchestra.run.smithi043.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.92636.log.gz 2024-09-12T01:06:26.932 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.49386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181015.log 2024-09-12T01:06:26.932 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49386.log.gz 2024-09-12T01:06:26.932 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.146330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143380.log 2024-09-12T01:06:26.932 INFO:teuthology.orchestra.run.smithi043.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.146330.log.gz 2024-09-12T01:06:26.932 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.181015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181015.log.gz 2024-09-12T01:06:26.932 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121548.log 2024-09-12T01:06:26.932 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127449.log 2024-09-12T01:06:26.932 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.143380.log: /var/log/ceph/ceph-client.admin.121548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178018.log 2024-09-12T01:06:26.932 INFO:teuthology.orchestra.run.smithi043.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.121548.log.gz 2024-09-12T01:06:26.932 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32605.log 2024-09-12T01:06:26.934 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.127449.log: /var/log/ceph/ceph-client.admin.178018.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.127449.log.gz 2024-09-12T01:06:26.934 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T01:06:26.934 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178018.log.gz 2024-09-12T01:06:26.934 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32605.log.gz 2024-09-12T01:06:26.935 INFO:teuthology.orchestra.run.smithi043.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.143380.log.gz 2024-09-12T01:06:26.935 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31368.log 2024-09-12T01:06:26.935 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174084.log 2024-09-12T01:06:26.935 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177330.log 2024-09-12T01:06:26.935 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31368.log.gz 2024-09-12T01:06:26.935 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129809.log 2024-09-12T01:06:26.936 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.174084.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.174084.log.gz 2024-09-12T01:06:26.936 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.177330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177330.log.gz 2024-09-12T01:06:26.936 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180651.log 2024-09-12T01:06:26.937 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.129809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30980.log 2024-09-12T01:06:26.937 INFO:teuthology.orchestra.run.smithi043.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.129809.log.gz 2024-09-12T01:06:26.937 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.180651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144560.log 2024-09-12T01:06:26.937 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180651.log.gz 2024-09-12T01:06:26.940 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181067.log 2024-09-12T01:06:26.940 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30980.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30980.log.gz 2024-09-12T01:06:26.940 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80836.log 2024-09-12T01:06:26.940 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.144560.log: /var/log/ceph/ceph-client.admin.181067.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.144560.log.gz 2024-09-12T01:06:26.940 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181067.log.gz 2024-09-12T01:06:26.940 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149280.log 2024-09-12T01:06:26.940 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.80836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74346.log 2024-09-12T01:06:26.940 INFO:teuthology.orchestra.run.smithi043.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.80836.log.gz 2024-09-12T01:06:26.940 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149280.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T01:06:26.940 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155892.log 2024-09-12T01:06:26.940 INFO:teuthology.orchestra.run.smithi043.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.149280.log.gz 2024-09-12T01:06:26.940 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.74346.log: /var/log/ceph/ceph-mon.a.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.74346.log.gz 2024-09-12T01:06:26.942 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54850.log 2024-09-12T01:06:26.942 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.155892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115648.log 2024-09-12T01:06:26.942 INFO:teuthology.orchestra.run.smithi043.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.155892.log.gz 2024-09-12T01:06:26.942 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.54850.log: 19.9% -- replaced with /var/log/ceph/ceph-client.admin.54850.log.gz 2024-09-12T01:06:26.942 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105028.log 2024-09-12T01:06:26.943 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.115648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82606.log 2024-09-12T01:06:26.943 INFO:teuthology.orchestra.run.smithi043.stderr: 85.2%/var/log/ceph/ceph-client.admin.105028.log: -- replaced with /var/log/ceph/ceph-client.admin.115648.log.gz 2024-09-12T01:06:26.943 INFO:teuthology.orchestra.run.smithi043.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.105028.log.gz 2024-09-12T01:06:26.944 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89686.log 2024-09-12T01:06:26.944 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.82606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67101.log 2024-09-12T01:06:26.944 INFO:teuthology.orchestra.run.smithi043.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.82606.log.gz 2024-09-12T01:06:26.945 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.89686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54877.log 2024-09-12T01:06:26.946 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.67101.log: 84.9% -- replaced with /var/log/ceph/ceph-client.0.67101.log.gz 2024-09-12T01:06:26.946 INFO:teuthology.orchestra.run.smithi043.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.89686.log.gz 2024-09-12T01:06:26.946 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154047.log 2024-09-12T01:06:26.947 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.54877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177993.log 2024-09-12T01:06:26.947 INFO:teuthology.orchestra.run.smithi043.stderr: 21.6% -- replaced with /var/log/ceph/ceph-client.admin.54877.log.gz 87.2% -- replaced with /var/log/ceph/ceph-client.0.179288.log.gz 2024-09-12T01:06:26.947 INFO:teuthology.orchestra.run.smithi043.stderr: 2024-09-12T01:06:26.947 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.154047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154047.log.gz 2024-09-12T01:06:26.948 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86146.log 2024-09-12T01:06:26.949 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.177993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50616.log 2024-09-12T01:06:26.949 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177993.log.gz 2024-09-12T01:06:26.949 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.86146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135710.log 2024-09-12T01:06:26.949 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161853.log 2024-09-12T01:06:26.950 INFO:teuthology.orchestra.run.smithi043.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.86146.log.gz 2024-09-12T01:06:26.950 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.50616.log: /var/log/ceph/ceph-client.admin.135710.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.50616.log.gz 2024-09-12T01:06:26.950 INFO:teuthology.orchestra.run.smithi043.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.135710.log.gz 2024-09-12T01:06:26.951 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31187.log 2024-09-12T01:06:26.951 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.161853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155252.log 2024-09-12T01:06:26.951 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102668.log 2024-09-12T01:06:26.951 INFO:teuthology.orchestra.run.smithi043.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.161853.log.gz 2024-09-12T01:06:26.951 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31187.log.gz 2024-09-12T01:06:26.952 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.155252.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.155252.log.gz 2024-09-12T01:06:26.952 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31180.log 2024-09-12T01:06:26.952 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36742.log 2024-09-12T01:06:26.953 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.102668.log: /var/log/ceph/ceph-client.admin.31180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138660.log 2024-09-12T01:06:26.953 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31180.log.gz 2024-09-12T01:06:26.953 INFO:teuthology.orchestra.run.smithi043.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.102668.log.gz 2024-09-12T01:06:26.953 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.36742.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.36742.log.gz 2024-09-12T01:06:26.953 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88506.log 2024-09-12T01:06:26.955 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100898.log 2024-09-12T01:06:26.955 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.138660.log: /var/log/ceph/ceph-client.admin.88506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165811.log 2024-09-12T01:06:26.955 INFO:teuthology.orchestra.run.smithi043.stderr: 82.4%/var/log/ceph/ceph-client.admin.100898.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.138660.log.gz 2024-09-12T01:06:26.955 INFO:teuthology.orchestra.run.smithi043.stderr: -- replaced with /var/log/ceph/ceph-client.admin.88506.log.gz 2024-09-12T01:06:26.956 INFO:teuthology.orchestra.run.smithi043.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.100898.log.gz 2024-09-12T01:06:26.956 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122138.log 2024-09-12T01:06:26.956 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114468.log 2024-09-12T01:06:26.956 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.165811.log: /var/log/ceph/ceph-client.admin.122138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96176.log 2024-09-12T01:06:26.959 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.114468.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.122138.log.gz 2024-09-12T01:06:26.959 INFO:teuthology.orchestra.run.smithi043.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.165811.log.gz 2024-09-12T01:06:26.959 INFO:teuthology.orchestra.run.smithi043.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.114468.log.gz 2024-09-12T01:06:26.959 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45846.log 2024-09-12T01:06:26.959 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180963.log 2024-09-12T01:06:26.959 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.96176.log: /var/log/ceph/ceph-client.admin.45846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60021.log 2024-09-12T01:06:26.959 INFO:teuthology.orchestra.run.smithi043.stderr: 85.5%/var/log/ceph/ceph-client.admin.180963.log: -- replaced with /var/log/ceph/ceph-client.admin.45846.log.gz 2024-09-12T01:06:26.959 INFO:teuthology.orchestra.run.smithi043.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96176.log.gz 2024-09-12T01:06:26.960 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180963.log.gz 2024-09-12T01:06:26.960 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154022.log 2024-09-12T01:06:26.960 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178691.log 2024-09-12T01:06:26.960 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.60021.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.154022.log: /var/log/ceph/ceph-client.admin.163159.log 2024-09-12T01:06:26.960 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154022.log.gz 2024-09-12T01:06:26.960 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.178691.log: 81.4% -- replaced with /var/log/ceph/ceph-client.0.178691.log.gz 2024-09-12T01:06:26.961 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161264.log 2024-09-12T01:06:26.961 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30874.log 2024-09-12T01:06:26.961 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.163159.log: /var/log/ceph/ceph-client.admin.161264.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.163159.log.gz 2024-09-12T01:06:26.962 INFO:teuthology.orchestra.run.smithi043.stderr: 92.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173494.log 2024-09-12T01:06:26.962 INFO:teuthology.orchestra.run.smithi043.stderr: -- replaced with /var/log/ceph/ceph-client.admin.161264.log.gz 2024-09-12T01:06:26.963 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30874.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30874.log.gz 2024-09-12T01:06:26.963 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112108.log 2024-09-12T01:06:26.963 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76116.log 2024-09-12T01:06:26.964 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.173494.log: /var/log/ceph/ceph-client.admin.112108.log: 80.6% -- replaced with /var/log/ceph/ceph-client.0.173494.log.gz 2024-09-12T01:06:26.964 INFO:teuthology.orchestra.run.smithi043.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.112108.log.gz 2024-09-12T01:06:26.964 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180859.log 2024-09-12T01:06:26.965 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.76116.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.76116.log.gz 2024-09-12T01:06:26.965 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34400.log 2024-09-12T01:06:26.966 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116828.log 2024-09-12T01:06:26.966 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.180859.log: /var/log/ceph/ceph-client.0.34400.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180859.log.gz 2024-09-12T01:06:26.967 INFO:teuthology.orchestra.run.smithi043.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.34400.log.gz 2024-09-12T01:06:26.967 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159152.log 2024-09-12T01:06:26.967 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.116828.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.116828.log.gz 2024-09-12T01:06:26.967 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106208.log 2024-09-12T01:06:26.968 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103258.log 2024-09-12T01:06:26.969 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.159152.log: /var/log/ceph/ceph-client.admin.106208.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.159152.log.gz 2024-09-12T01:06:26.969 INFO:teuthology.orchestra.run.smithi043.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.106208.log.gz 2024-09-12T01:06:26.969 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46436.log 2024-09-12T01:06:26.970 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32555.log 2024-09-12T01:06:26.970 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.103258.log: /var/log/ceph/ceph-client.admin.46436.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.103258.log.gz 2024-09-12T01:06:26.971 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43436.log 2024-09-12T01:06:26.971 INFO:teuthology.orchestra.run.smithi043.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.46436.log.gz 2024-09-12T01:06:26.971 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32555.log.gz 2024-09-12T01:06:26.971 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155867.log 2024-09-12T01:06:26.972 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54306.log 2024-09-12T01:06:26.972 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.43436.log: /var/log/ceph/ceph-client.admin.155867.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43436.log.gz 2024-09-12T01:06:26.972 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155867.log.gz 2024-09-12T01:06:26.973 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147510.log 2024-09-12T01:06:26.973 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.54306.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.54306.log.gz 2024-09-12T01:06:26.973 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129219.log 2024-09-12T01:06:26.975 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71396.log 2024-09-12T01:06:26.975 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.147510.log: /var/log/ceph/ceph-client.admin.129219.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.147510.log.gz 2024-09-12T01:06:26.975 INFO:teuthology.orchestra.run.smithi043.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.129219.log.gz 2024-09-12T01:06:26.975 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177307.log 2024-09-12T01:06:26.976 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109158.log 2024-09-12T01:06:26.976 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.71396.log: /var/log/ceph/ceph-client.admin.177307.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.71396.log.gz 2024-09-12T01:06:26.976 INFO:teuthology.orchestra.run.smithi043.stderr: 25.4% -- replaced with /var/log/ceph/ceph-client.admin.177307.log.gz 2024-09-12T01:06:26.976 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.169364.log 2024-09-12T01:06:26.977 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142790.log 2024-09-12T01:06:26.978 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.109158.log: /var/log/ceph/ceph-client.0.169364.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.109158.log.gz 2024-09-12T01:06:26.978 INFO:teuthology.orchestra.run.smithi043.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.0.169364.log.gz 2024-09-12T01:06:26.978 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49436.log 2024-09-12T01:06:26.978 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.142790.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.142790.log.gz 2024-09-12T01:06:26.979 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31171.log 2024-09-12T01:06:26.980 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73756.log 2024-09-12T01:06:26.980 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.49436.log: /var/log/ceph/ceph-client.admin.31171.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.49436.log.gz 2024-09-12T01:06:26.980 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31171.log.gz 2024-09-12T01:06:26.980 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53026.log 2024-09-12T01:06:26.981 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T01:06:26.981 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.73756.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.73756.log.gz 2024-09-12T01:06:26.981 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.53026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150460.log 2024-09-12T01:06:26.982 INFO:teuthology.orchestra.run.smithi043.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.53026.log.gz 2024-09-12T01:06:26.984 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177380.log 2024-09-12T01:06:26.985 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.150460.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.150460.log.gz 2024-09-12T01:06:26.986 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171724.log 2024-09-12T01:06:26.986 INFO:teuthology.orchestra.run.smithi043.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.60021.log.gz/var/log/ceph/ceph-client.admin.177380.log: 2024-09-12T01:06:26.987 INFO:teuthology.orchestra.run.smithi043.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.177380.log.gz 2024-09-12T01:06:26.987 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180625.log 2024-09-12T01:06:26.987 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93226.log 2024-09-12T01:06:26.988 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.171724.log: /var/log/ceph/ceph-client.admin.180625.log: 80.6% -- replaced with /var/log/ceph/ceph-client.0.171724.log.gz 2024-09-12T01:06:26.988 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180625.log.gz 2024-09-12T01:06:26.988 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71986.log 2024-09-12T01:06:26.989 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69626.log 2024-09-12T01:06:26.989 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.93226.log: /var/log/ceph/ceph-client.admin.71986.log: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.93226.log.gz 2024-09-12T01:06:26.990 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91456.log 2024-09-12T01:06:26.990 INFO:teuthology.orchestra.run.smithi043.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.71986.log.gz 2024-09-12T01:06:26.990 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.69626.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.69626.log.gz 2024-09-12T01:06:26.991 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55502.log 2024-09-12T01:06:26.991 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.91456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30979.log 2024-09-12T01:06:26.992 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.55502.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.91456.log.gz 2024-09-12T01:06:26.992 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30926.log 2024-09-12T01:06:26.992 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30979.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30979.log.gz 2024-09-12T01:06:26.993 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132169.log 2024-09-12T01:06:26.993 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30926.log.gz 2024-09-12T01:06:26.994 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119778.log 2024-09-12T01:06:26.995 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.132169.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.132169.log.gz 2024-09-12T01:06:26.995 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73166.log 2024-09-12T01:06:26.996 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.119778.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.119778.log.gz 2024-09-12T01:06:26.996 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136890.log 2024-09-12T01:06:26.997 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.73166.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.73166.log.gz 2024-09-12T01:06:26.997 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30689.log 2024-09-12T01:06:26.998 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.136890.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.136890.log.gz 2024-09-12T01:06:26.999 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152252.log 2024-09-12T01:06:27.000 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30689.log.gz 2024-09-12T01:06:27.000 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107388.log 2024-09-12T01:06:27.001 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.152252.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.152252.log.gz 2024-09-12T01:06:27.001 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128629.log 2024-09-12T01:06:27.002 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.107388.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.107388.log.gz 2024-09-12T01:06:27.003 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100308.log 2024-09-12T01:06:27.004 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.128629.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.128629.log.gz 2024-09-12T01:06:27.004 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53914.log 2024-09-12T01:06:27.005 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.100308.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.100308.log.gz 2024-09-12T01:06:27.005 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97356.log 2024-09-12T01:06:27.006 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.53914.log: 55.0% -- replaced with /var/log/ceph/ceph-client.admin.53914.log.gz 2024-09-12T01:06:27.006 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48796.log 2024-09-12T01:06:27.007 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.97356.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.97356.log.gz 2024-09-12T01:06:27.008 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180755.log 2024-09-12T01:06:27.008 INFO:teuthology.orchestra.run.smithi043.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.55502.log.gz 2024-09-12T01:06:27.009 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.48796.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.48796.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.68371.log 2024-09-12T01:06:27.009 INFO:teuthology.orchestra.run.smithi043.stderr: 2024-09-12T01:06:27.009 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.180755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83786.log 2024-09-12T01:06:27.010 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0%/var/log/ceph/ceph-client.0.68371.log: -- replaced with /var/log/ceph/ceph-client.admin.180755.log.gz 2024-09-12T01:06:27.010 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142200.log 2024-09-12T01:06:27.010 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.83786.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.83786.log.gz 2024-09-12T01:06:27.011 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-12T01:06:27.011 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.142200.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.142200.log.gz 2024-09-12T01:06:27.012 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30778.log 2024-09-12T01:06:27.013 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: 92.1% -- replaced with /var/log/ceph/ceph-client.0.68371.log.gz 2024-09-12T01:06:27.013 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138070.log 2024-09-12T01:06:27.014 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30778.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30778.log.gz 2024-09-12T01:06:27.014 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T01:06:27.015 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.138070.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.138070.log.gz 2024-09-12T01:06:27.016 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181174.log 2024-09-12T01:06:27.017 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-osd.1.log: 94.1% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-12T01:06:27.025 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151050.log 2024-09-12T01:06:27.025 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.181174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181174.log.gz 2024-09-12T01:06:27.026 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26738.log 2024-09-12T01:06:27.026 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.151050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151050.log.gz 2024-09-12T01:06:27.027 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39256.log 2024-09-12T01:06:27.027 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.26738.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26738.log.gz 2024-09-12T01:06:27.028 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82016.log 2024-09-12T01:06:27.029 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.39256.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.39256.log.gz 2024-09-12T01:06:27.029 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157072.log 2024-09-12T01:06:27.030 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.82016.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.82016.log.gz 2024-09-12T01:06:27.030 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41051.log 2024-09-12T01:06:27.031 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.157072.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.157072.log.gz 2024-09-12T01:06:27.031 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89096.log 2024-09-12T01:06:27.032 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.41051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41051.log.gz 2024-09-12T01:06:27.033 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130989.log 2024-09-12T01:06:27.034 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.89096.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.89096.log.gz 2024-09-12T01:06:27.034 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149870.log 2024-09-12T01:06:27.035 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.130989.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.130989.log.gz 2024-09-12T01:06:27.035 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59375.log 2024-09-12T01:06:27.036 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.149870.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.149870.log.gz 2024-09-12T01:06:27.036 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164337.log 2024-09-12T01:06:27.039 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.59375.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.59375.log.gz 2024-09-12T01:06:27.039 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126268.log 2024-09-12T01:06:27.040 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.164337.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.164337.log.gz 2024-09-12T01:06:27.041 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153432.log 2024-09-12T01:06:27.041 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.126268.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.126268.log.gz 2024-09-12T01:06:27.042 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33810.log 2024-09-12T01:06:27.043 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.153432.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.153432.log.gz 2024-09-12T01:06:27.043 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30977.log 2024-09-12T01:06:27.044 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.33810.log: 81.1% -- replaced with /var/log/ceph/ceph-client.0.33810.log.gz 2024-09-12T01:06:27.044 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112698.log 2024-09-12T01:06:27.045 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30977.log.gz 2024-09-12T01:06:27.045 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30968.log 2024-09-12T01:06:27.048 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.112698.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.112698.log.gz 2024-09-12T01:06:27.048 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105618.log 2024-09-12T01:06:27.049 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30968.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30968.log.gz 2024-09-12T01:06:27.049 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120368.log 2024-09-12T01:06:27.050 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.105618.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.105618.log.gz 2024-09-12T01:06:27.050 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110338.log 2024-09-12T01:06:27.051 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.120368.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.120368.log.gz 2024-09-12T01:06:27.052 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181200.log 2024-09-12T01:06:27.053 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.110338.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.110338.log.gz 2024-09-12T01:06:27.053 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43486.log 2024-09-12T01:06:27.054 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.181200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181200.log.gz 2024-09-12T01:06:27.054 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94406.log 2024-09-12T01:06:27.055 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.43486.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.43486.log.gz 2024-09-12T01:06:27.055 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151072.log 2024-09-12T01:06:27.056 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.94406.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.94406.log.gz 2024-09-12T01:06:27.057 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133349.log 2024-09-12T01:06:27.058 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.151072.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.151072.log.gz 2024-09-12T01:06:27.058 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101488.log 2024-09-12T01:06:27.060 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.133349.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.133349.log.gz 2024-09-12T01:06:27.061 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111518.log 2024-09-12T01:06:27.062 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.101488.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101488.log.gz 2024-09-12T01:06:27.062 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54913.log 2024-09-12T01:06:27.063 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.111518.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.111518.log.gz 2024-09-12T01:06:27.063 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180833.log 2024-09-12T01:06:27.064 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.54913.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.54913.log.gz 2024-09-12T01:06:27.064 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180599.log 2024-09-12T01:06:27.065 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.180833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180833.log.gz 2024-09-12T01:06:27.066 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86736.log 2024-09-12T01:06:27.066 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.180599.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180599.log.gz 2024-09-12T01:06:27.067 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123318.log 2024-09-12T01:06:27.067 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.86736.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.86736.log.gz 2024-09-12T01:06:27.068 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180989.log 2024-09-12T01:06:27.069 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.123318.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.123318.log.gz 2024-09-12T01:06:27.069 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67691.log 2024-09-12T01:06:27.070 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.180989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180989.log.gz 2024-09-12T01:06:27.070 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30803.log 2024-09-12T01:06:27.071 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.67691.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.67691.log.gz 2024-09-12T01:06:27.072 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136300.log 2024-09-12T01:06:27.072 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30803.log.gz 2024-09-12T01:06:27.073 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181119.log 2024-09-12T01:06:27.073 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.136300.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.136300.log.gz 2024-09-12T01:06:27.074 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T01:06:27.075 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.181119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181119.log.gz 2024-09-12T01:06:27.075 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53994.log 2024-09-12T01:06:27.086 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135120.log 2024-09-12T01:06:27.087 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.53994.log: 53.0% -- replaced with /var/log/ceph/ceph-client.admin.53994.log.gz 2024-09-12T01:06:27.088 INFO:teuthology.orchestra.run.smithi043.stderr: 93.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T01:06:27.088 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151662.log 2024-09-12T01:06:27.090 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.135120.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.135120.log.gz 2024-09-12T01:06:27.090 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148690.log 2024-09-12T01:06:27.091 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.151662.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.151662.log.gz 2024-09-12T01:06:27.091 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122728.log 2024-09-12T01:06:27.092 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.148690.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.148690.log.gz 2024-09-12T01:06:27.093 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75526.log 2024-09-12T01:06:27.093 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.122728.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.122728.log.gz 2024-09-12T01:06:27.094 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84966.log 2024-09-12T01:06:27.095 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.75526.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.75526.log.gz 2024-09-12T01:06:27.095 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137480.log 2024-09-12T01:06:27.096 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.84966.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.84966.log.gz 2024-09-12T01:06:27.096 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31167.log 2024-09-12T01:06:27.099 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.137480.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.137480.log.gz 2024-09-12T01:06:27.099 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126859.log 2024-09-12T01:06:27.100 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31167.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31167.log.gz 2024-09-12T01:06:27.100 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78476.log 2024-09-12T01:06:27.101 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.126859.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.126859.log.gz 2024-09-12T01:06:27.101 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31472.log 2024-09-12T01:06:27.102 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.78476.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.78476.log.gz 2024-09-12T01:06:27.103 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42256.log 2024-09-12T01:06:27.103 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31472.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31472.log.gz 2024-09-12T01:06:27.104 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51846.log 2024-09-12T01:06:27.105 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.42256.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.42256.log.gz 2024-09-12T01:06:27.105 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53679.log 2024-09-12T01:06:27.106 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.51846.log: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.51846.log.gz 2024-09-12T01:06:27.106 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141020.log 2024-09-12T01:06:27.107 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.53679.log: 59.8% -- replaced with /var/log/ceph/ceph-client.admin.53679.log.gz 2024-09-12T01:06:27.107 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172904.log 2024-09-12T01:06:27.108 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.141020.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.141020.log.gz 2024-09-12T01:06:27.109 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87326.log 2024-09-12T01:06:27.110 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.172904.log: 84.6% -- replaced with /var/log/ceph/ceph-client.0.172904.log.gz 2024-09-12T01:06:27.110 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181093.log 2024-09-12T01:06:27.111 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.87326.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.87326.log.gz 2024-09-12T01:06:27.111 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48206.log 2024-09-12T01:06:27.112 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.181093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181093.log.gz 2024-09-12T01:06:27.112 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35574.log 2024-09-12T01:06:27.113 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.48206.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.48206.log.gz 2024-09-12T01:06:27.113 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30961.log 2024-09-12T01:06:27.114 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.35574.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.35574.log.gz 2024-09-12T01:06:27.115 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158563.log 2024-09-12T01:06:27.115 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30961.log.gz 2024-09-12T01:06:27.116 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145150.log 2024-09-12T01:06:27.121 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.158563.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.158563.log.gz 2024-09-12T01:06:27.121 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177355.log 2024-09-12T01:06:27.123 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.145150.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.145150.log.gz 2024-09-12T01:06:27.123 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163748.log 2024-09-12T01:06:27.124 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.177355.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177355.log.gz 2024-09-12T01:06:27.124 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30969.log 2024-09-12T01:06:27.125 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.163748.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.163748.log.gz 2024-09-12T01:06:27.126 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T01:06:27.126 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30969.log.gz 2024-09-12T01:06:27.127 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160086.log 2024-09-12T01:06:27.136 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116238.log 2024-09-12T01:06:27.138 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.160086.log: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.160086.log.gz 2024-09-12T01:06:27.161 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168774.log 2024-09-12T01:06:27.161 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.116238.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.116238.log.gz 2024-09-12T01:06:27.168 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181148.log 2024-09-12T01:06:27.169 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.168774.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.168774.log.gz 2024-09-12T01:06:27.177 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.157970.log 2024-09-12T01:06:27.177 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.181148.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181148.log.gz 2024-09-12T01:06:27.185 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178043.log 2024-09-12T01:06:27.185 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.157970.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.157970.log.gz 2024-09-12T01:06:27.193 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178094.log 2024-09-12T01:06:27.193 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.178043.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178043.log.gz 2024-09-12T01:06:27.200 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77886.log 2024-09-12T01:06:27.201 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.178094.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.178094.log.gz 2024-09-12T01:06:27.209 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.166412.log 2024-09-12T01:06:27.209 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.77886.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.77886.log.gz 2024-09-12T01:06:27.216 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175264.log 2024-09-12T01:06:27.217 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.166412.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.166412.log.gz 2024-09-12T01:06:27.233 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132759.log 2024-09-12T01:06:27.233 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.175264.log: 80.8% -- replaced with /var/log/ceph/ceph-client.0.175264.log.gz 2024-09-12T01:06:27.240 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T01:06:27.241 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.132759.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.132759.log.gz 2024-09-12T01:06:27.249 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32529.log 2024-09-12T01:06:27.257 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134529.log 2024-09-12T01:06:27.257 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32529.log.gz 2024-09-12T01:06:27.265 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148100.log 2024-09-12T01:06:27.265 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.134529.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.134529.log.gz 2024-09-12T01:06:27.272 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T01:06:27.273 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.148100.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.148100.log.gz 2024-09-12T01:06:27.281 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67053.log 2024-09-12T01:06:27.284 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph.audit.log: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T01:06:27.289 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49411.log 2024-09-12T01:06:27.289 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.67053.log: 25.4% -- replaced with /var/log/ceph/ceph-client.admin.67053.log.gz 2024-09-12T01:06:27.296 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80246.log 2024-09-12T01:06:27.297 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.49411.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49411.log.gz 2024-09-12T01:06:27.304 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70216.log 2024-09-12T01:06:27.305 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.80246.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.80246.log.gz 2024-09-12T01:06:27.313 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113878.log 2024-09-12T01:06:27.313 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.70216.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.70216.log.gz 2024-09-12T01:06:27.321 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37326.log 2024-09-12T01:06:27.321 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.113878.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.113878.log.gz 2024-09-12T01:06:27.329 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72576.log 2024-09-12T01:06:27.329 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.37326.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.37326.log.gz 2024-09-12T01:06:27.337 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68329.log 2024-09-12T01:06:27.337 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.72576.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.72576.log.gz 2024-09-12T01:06:27.345 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51796.log 2024-09-12T01:06:27.345 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.68329.log: 53.0% -- replaced with /var/log/ceph/ceph-client.admin.68329.log.gz 2024-09-12T01:06:27.353 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180807.log 2024-09-12T01:06:27.353 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.51796.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51796.log.gz 2024-09-12T01:06:27.373 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34984.log 2024-09-12T01:06:27.373 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.180807.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180807.log.gz 2024-09-12T01:06:27.381 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31372.log 2024-09-12T01:06:27.381 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.34984.log: 81.3% -- replaced with /var/log/ceph/ceph-client.0.34984.log.gz 2024-09-12T01:06:27.389 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90276.log 2024-09-12T01:06:27.389 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31372.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31372.log.gz 2024-09-12T01:06:27.397 INFO:teuthology.orchestra.run.smithi043.stderr: 94.6% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T01:06:27.398 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84376.log 2024-09-12T01:06:27.398 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.90276.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.90276.log.gz 2024-09-12T01:06:27.399 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42846.log 2024-09-12T01:06:27.400 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.84376.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.84376.log.gz 2024-09-12T01:06:27.400 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145740.log 2024-09-12T01:06:27.401 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.42846.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.42846.log.gz 2024-09-12T01:06:27.401 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.167002.log 2024-09-12T01:06:27.402 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.145740.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.145740.log.gz 2024-09-12T01:06:27.402 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156482.log 2024-09-12T01:06:27.403 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.167002.log: 80.3% -- replaced with /var/log/ceph/ceph-client.0.167002.log.gz 2024-09-12T01:06:27.403 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170544.log 2024-09-12T01:06:27.404 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.156482.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.156482.log.gz 2024-09-12T01:06:27.404 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66462.log 2024-09-12T01:06:27.405 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.170544.log: 84.6% -- replaced with /var/log/ceph/ceph-client.0.170544.log.gz 2024-09-12T01:06:27.405 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180729.log 2024-09-12T01:06:27.406 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.66462.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.66462.log.gz 2024-09-12T01:06:27.407 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68961.log 2024-09-12T01:06:27.407 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.180729.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180729.log.gz 2024-09-12T01:06:27.407 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103848.log 2024-09-12T01:06:27.408 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.68961.log: 80.8% -- replaced with /var/log/ceph/ceph-client.0.68961.log.gz 2024-09-12T01:06:27.408 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154662.log 2024-09-12T01:06:27.409 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.103848.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.103848.log.gz 2024-09-12T01:06:27.409 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102078.log 2024-09-12T01:06:27.410 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.154662.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.154662.log.gz 2024-09-12T01:06:27.410 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74936.log 2024-09-12T01:06:27.411 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.102078.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.102078.log.gz 2024-09-12T01:06:27.411 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31524.log 2024-09-12T01:06:27.412 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.74936.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.74936.log.gz 2024-09-12T01:06:27.412 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172314.log 2024-09-12T01:06:27.413 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31524.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31524.log.gz 2024-09-12T01:06:27.413 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47026.log 2024-09-12T01:06:27.414 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.172314.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.172314.log.gz 2024-09-12T01:06:27.415 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93816.log 2024-09-12T01:06:27.415 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.47026.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.47026.log.gz 2024-09-12T01:06:27.416 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43461.log 2024-09-12T01:06:27.417 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.93816.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.93816.log.gz 2024-09-12T01:06:27.417 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141610.log 2024-09-12T01:06:27.418 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.43461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43461.log.gz 2024-09-12T01:06:27.418 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97946.log 2024-09-12T01:06:27.420 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.141610.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.141610.log.gz 2024-09-12T01:06:27.420 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181226.log 2024-09-12T01:06:27.422 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.97946.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.97946.log.gz 2024-09-12T01:06:27.423 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109748.log 2024-09-12T01:06:27.423 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.181226.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181226.log.gz 2024-09-12T01:06:27.424 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32628.log 2024-09-12T01:06:27.424 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.109748.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.109748.log.gz 2024-09-12T01:06:27.425 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117418.log 2024-09-12T01:06:27.426 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.32628.log: 96.0% -- replaced with /var/log/ceph/ceph-client.0.32628.log.gz 2024-09-12T01:06:27.427 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87916.log 2024-09-12T01:06:27.427 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.117418.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.117418.log.gz 2024-09-12T01:06:27.428 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31420.log 2024-09-12T01:06:27.429 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.87916.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.87916.log.gz 2024-09-12T01:06:27.429 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176127.log 2024-09-12T01:06:27.430 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31420.log.gz 2024-09-12T01:06:27.430 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31188.log 2024-09-12T01:06:27.431 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.176127.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.176127.log.gz 2024-09-12T01:06:27.431 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119188.log 2024-09-12T01:06:27.432 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31188.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31188.log.gz 2024-09-12T01:06:27.432 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162570.log 2024-09-12T01:06:27.433 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.119188.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.119188.log.gz 2024-09-12T01:06:27.433 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177970.log 2024-09-12T01:06:27.434 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.162570.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.162570.log.gz 2024-09-12T01:06:27.435 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139250.log 2024-09-12T01:06:27.435 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.177970.log: 25.0% -- replaced with /var/log/ceph/ceph-client.admin.177970.log.gz 2024-09-12T01:06:27.436 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133939.log 2024-09-12T01:06:27.436 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.139250.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.139250.log.gz 2024-09-12T01:06:27.437 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31176.log 2024-09-12T01:06:27.437 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.133939.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.133939.log.gz 2024-09-12T01:06:27.438 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62601.log 2024-09-12T01:06:27.438 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31176.log.gz 2024-09-12T01:06:27.439 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56147.log 2024-09-12T01:06:27.443 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.62601.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.62601.log.gz 2024-09-12T01:06:27.444 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52436.log 2024-09-12T01:06:27.445 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.56147.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.56147.log.gz 2024-09-12T01:06:27.445 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64689.log 2024-09-12T01:06:27.446 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.52436.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.52436.log.gz 2024-09-12T01:06:27.446 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85556.log 2024-09-12T01:06:27.447 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.64689.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.64689.log.gz 2024-09-12T01:06:27.448 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41076.log 2024-09-12T01:06:27.448 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.85556.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.85556.log.gz 2024-09-12T01:06:27.449 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143970.log 2024-09-12T01:06:27.450 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.41076.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.41076.log.gz 2024-09-12T01:06:27.450 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.169954.log 2024-09-12T01:06:27.451 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.143970.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.143970.log.gz 2024-09-12T01:06:27.451 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128039.log 2024-09-12T01:06:27.452 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.169954.log: 80.8% -- replaced with /var/log/ceph/ceph-client.0.169954.log.gz 2024-09-12T01:06:27.452 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95586.log 2024-09-12T01:06:27.453 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.128039.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.128039.log.gz 2024-09-12T01:06:27.453 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40436.log 2024-09-12T01:06:27.454 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.95586.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.95586.log.gz 2024-09-12T01:06:27.454 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180781.log 2024-09-12T01:06:27.455 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.40436.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.40436.log.gz 2024-09-12T01:06:27.456 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38666.log 2024-09-12T01:06:27.457 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.180781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180781.log.gz 2024-09-12T01:06:27.457 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31498.log 2024-09-12T01:06:27.457 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.38666.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.38666.log.gz 2024-09-12T01:06:27.458 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45256.log 2024-09-12T01:06:27.458 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31498.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31498.log.gz 2024-09-12T01:06:27.459 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180911.log 2024-09-12T01:06:27.459 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.45256.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.45256.log.gz 2024-09-12T01:06:27.460 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180937.log 2024-09-12T01:06:27.461 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.180911.log: 28.8% -- replaced with /var/log/ceph/ceph-client.admin.180911.log.gz 2024-09-12T01:06:27.461 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168184.log 2024-09-12T01:06:27.462 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.180937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180937.log.gz 2024-09-12T01:06:27.462 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30978.log 2024-09-12T01:06:27.463 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.168184.log: 80.8% -- replaced with /var/log/ceph/ceph-client.0.168184.log.gz 2024-09-12T01:06:27.463 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47616.log 2024-09-12T01:06:27.464 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30978.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30978.log.gz 2024-09-12T01:06:27.464 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178069.log 2024-09-12T01:06:27.465 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.47616.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.47616.log.gz 2024-09-12T01:06:27.465 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64100.log 2024-09-12T01:06:27.466 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.178069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178069.log.gz 2024-09-12T01:06:27.466 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56792.log 2024-09-12T01:06:27.467 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.64100.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.64100.log.gz 2024-09-12T01:06:27.467 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160675.log 2024-09-12T01:06:27.470 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.56792.log: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T01:06:27.472 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50026.log 2024-09-12T01:06:27.473 INFO:teuthology.orchestra.run.smithi043.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.56792.log.gz/var/log/ceph/ceph-client.admin.160675.log: 2024-09-12T01:06:27.474 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174674.log 2024-09-12T01:06:27.475 INFO:teuthology.orchestra.run.smithi043.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.160675.log.gz 2024-09-12T01:06:27.475 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.50026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30848.log 2024-09-12T01:06:27.475 INFO:teuthology.orchestra.run.smithi043.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.50026.log.gz 2024-09-12T01:06:27.475 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.174674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90866.log 2024-09-12T01:06:27.476 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30848.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.174674.log.gz 2024-09-12T01:06:27.476 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30848.log.gz 2024-09-12T01:06:27.476 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106798.log 2024-09-12T01:06:27.476 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.90866.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.90866.log.gz 2024-09-12T01:06:27.477 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54252.log 2024-09-12T01:06:27.477 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.106798.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.106798.log.gz 2024-09-12T01:06:27.478 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21799.log 2024-09-12T01:06:27.493 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.54252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77296.log 2024-09-12T01:06:27.493 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph.tmp-client.admin.21799.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21799.log.gz 2024-09-12T01:06:27.494 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99718.log 2024-09-12T01:06:27.495 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.77296.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.77296.log.gz 2024-09-12T01:06:27.496 INFO:teuthology.orchestra.run.smithi043.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54252.log.gz 2024-09-12T01:06:27.496 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65871.log 2024-09-12T01:06:27.497 INFO:teuthology.orchestra.run.smithi097.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T01:06:27.498 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.99718.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.99718.log.gz 2024-09-12T01:06:27.498 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.167594.log 2024-09-12T01:06:27.499 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.65871.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.65871.log.gz 2024-09-12T01:06:27.499 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180677.log 2024-09-12T01:06:27.500 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.0.167594.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.167594.log.gz 2024-09-12T01:06:27.500 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155842.log 2024-09-12T01:06:27.501 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.180677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180677.log.gz 2024-09-12T01:06:27.501 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31424.log 2024-09-12T01:06:27.502 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.155842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155842.log.gz 2024-09-12T01:06:27.502 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30900.log 2024-09-12T01:06:27.503 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31424.log.gz 2024-09-12T01:06:27.504 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30900.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30900.log.gz 2024-09-12T01:06:28.267 INFO:teuthology.orchestra.run.smithi043.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T01:06:29.467 INFO:teuthology.orchestra.run.smithi043.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T01:06:30.142 INFO:teuthology.orchestra.run.smithi043.stderr: 93.6% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T01:06:34.206 INFO:teuthology.orchestra.run.smithi043.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T01:06:35.993 INFO:teuthology.orchestra.run.smithi097.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T01:06:36.572 INFO:teuthology.orchestra.run.smithi097.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T01:06:36.769 INFO:teuthology.orchestra.run.smithi097.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T01:06:37.076 INFO:teuthology.orchestra.run.smithi043.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T01:06:40.434 INFO:teuthology.orchestra.run.smithi097.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T01:06:40.436 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-12T01:06:40.436 INFO:teuthology.orchestra.run.smithi097.stderr:real 0m13.572s 2024-09-12T01:06:40.436 INFO:teuthology.orchestra.run.smithi097.stderr:user 0m41.360s 2024-09-12T01:06:40.436 INFO:teuthology.orchestra.run.smithi097.stderr:sys 0m1.546s 2024-09-12T01:06:40.646 INFO:teuthology.orchestra.run.smithi043.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T01:06:46.805 INFO:teuthology.orchestra.run.smithi043.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T01:06:46.806 INFO:teuthology.orchestra.run.smithi043.stderr: 2024-09-12T01:06:46.806 INFO:teuthology.orchestra.run.smithi043.stderr:real 0m19.979s 2024-09-12T01:06:46.807 INFO:teuthology.orchestra.run.smithi043.stderr:user 0m56.843s 2024-09-12T01:06:46.807 INFO:teuthology.orchestra.run.smithi043.stderr:sys 0m1.980s 2024-09-12T01:06:46.808 INFO:tasks.ceph:Archiving logs... 2024-09-12T01:06:46.808 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901842/remote/smithi043/log 2024-09-12T01:06:46.809 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:06:52.975 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901842/remote/smithi097/log 2024-09-12T01:06:52.976 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:06:57.983 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T01:06:57.995 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T01:06:57.995 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:06:57.998 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:06:58.089 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T01:06:58.100 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T01:06:58.100 DEBUG:teuthology.orchestra.run.smithi043:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:06:58.103 DEBUG:teuthology.orchestra.run.smithi097:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:06:58.115 INFO:teuthology.orchestra.run.smithi043.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T01:06:58.115 INFO:teuthology.orchestra.run.smithi043.stdout:============================================================================== 2024-09-12T01:06:58.115 INFO:teuthology.orchestra.run.smithi043.stdout:*hv01.front.sepi 67.205.162.81 3 u 17 128 377 0.153 -2.270 0.453 2024-09-12T01:06:58.115 INFO:teuthology.orchestra.run.smithi043.stdout:+hv02.front.sepi 63.231.80.2 3 u 113 128 377 0.181 -1.171 0.268 2024-09-12T01:06:58.115 INFO:teuthology.orchestra.run.smithi043.stdout:+hv03.front.sepi 74.6.168.72 3 u 22 128 377 0.173 -3.606 0.556 2024-09-12T01:06:58.115 INFO:teuthology.orchestra.run.smithi043.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-12T01:06:58.117 INFO:teuthology.orchestra.run.smithi097.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T01:06:58.117 INFO:teuthology.orchestra.run.smithi097.stdout:============================================================================== 2024-09-12T01:06:58.117 INFO:teuthology.orchestra.run.smithi097.stdout:*hv01.front.sepi 67.205.162.81 3 u 43 128 377 0.083 -2.241 0.453 2024-09-12T01:06:58.117 INFO:teuthology.orchestra.run.smithi097.stdout:+hv02.front.sepi 63.231.80.2 3 u 101 128 377 0.080 -1.214 0.313 2024-09-12T01:06:58.117 INFO:teuthology.orchestra.run.smithi097.stdout:+hv03.front.sepi 74.6.168.72 3 u 103 128 377 0.088 -2.998 0.440 2024-09-12T01:06:58.117 INFO:teuthology.orchestra.run.smithi097.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-12T01:06:58.118 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T01:06:58.128 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T01:06:58.128 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T01:06:58.138 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T01:06:58.148 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T01:06:58.158 INFO:teuthology.task.internal:Duration was 3591.557665 seconds 2024-09-12T01:06:58.158 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T01:06:58.168 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T01:06:58.169 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:06:58.171 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:06:58.210 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T01:06:58.211 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi043.front.sepia.ceph.com 2024-09-12T01:06:58.211 DEBUG:teuthology.orchestra.run.smithi043:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:06:58.262 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi097.front.sepia.ceph.com 2024-09-12T01:06:58.262 DEBUG:teuthology.orchestra.run.smithi097:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:06:58.272 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T01:06:58.272 DEBUG:teuthology.orchestra.run.smithi043:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:06:58.306 DEBUG:teuthology.orchestra.run.smithi097:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:06:58.342 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T01:06:58.342 DEBUG:teuthology.orchestra.run.smithi043:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:06:58.378 DEBUG:teuthology.orchestra.run.smithi097:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:06:58.438 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T01:06:58.456 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T01:06:58.456 DEBUG:teuthology.orchestra.run.smithi043:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:06:58.470 DEBUG:teuthology.orchestra.run.smithi097:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:06:58.482 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T01:06:58.497 DEBUG:teuthology.orchestra.run.smithi043:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:06:58.514 DEBUG:teuthology.orchestra.run.smithi097:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:06:58.523 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = core 2024-09-12T01:06:58.534 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = core 2024-09-12T01:06:58.559 DEBUG:teuthology.orchestra.run.smithi043:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:06:58.580 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:06:58.580 DEBUG:teuthology.orchestra.run.smithi097:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:06:58.603 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:06:58.604 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T01:06:58.615 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T01:06:58.616 DEBUG:teuthology.misc:Transferring archived files from smithi043:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901842/remote/smithi043 2024-09-12T01:06:58.616 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:06:58.646 DEBUG:teuthology.misc:Transferring archived files from smithi097:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901842/remote/smithi097 2024-09-12T01:06:58.646 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:06:58.666 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T01:06:58.667 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:06:58.686 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:06:58.708 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T01:06:58.721 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T01:06:58.721 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T01:06:58.765 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T01:06:58.766 DEBUG:teuthology.orchestra.run.smithi043:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:06:58.768 DEBUG:teuthology.orchestra.run.smithi097:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:06:58.772 INFO:teuthology.orchestra.run.smithi043.stdout: 658469 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:06 /home/ubuntu/cephtest 2024-09-12T01:06:58.774 INFO:teuthology.orchestra.run.smithi097.stdout: 655475 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:06 /home/ubuntu/cephtest 2024-09-12T01:06:58.775 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T01:06:58.788 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T01:06:58.823 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} duration: 3591.557664871216 failure_reason: '"2024-09-12T00:20:00.000194+0000 mon.a (mon.0) 231 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive" in cluster log' flavor: default owner: scheduled_cbodley@teuthology success: false 2024-09-12T01:06:58.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T01:06:58.915 INFO:teuthology.run:FAIL